2023-08-09T12:19:23.002 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-09T12:19:23.003 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --name vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --archive /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087 -- /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/orig.config.yaml 2023-08-09T12:19:23.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T12:19:23.130 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087 branch: wip-vshankar-testing-20230809.035933 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: vshankar@redhat.com first_in_suite: false job_id: '7364087' kernel: client: branch: testing flavor: default kdb: true sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20230809.035933 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230809.035933 sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8976 sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 sleep_before_teardown: 0 subset: 486/1024 suite: fs suite_branch: wip-vshankar-testing-20230809.035933 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_668a86f232c9454b2ce5928d1432a29a72964d85/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNiRdK8KBEkCYEFGVsnvyjQMwGl1X8ouvA0XeobFuLFtAWt6scI5wwoMHvtRHTRn4wL7f/vjXbrF891KPddar8U= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMWSjGVLUMIzgjxvYuqvXv1yqr9ZFVjIg0RMuYd90lIDf8DfMCLsB4Y0IfblLZPBCDAS0yMY+nCtW0Ea/7ihJek= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 7fda95956ac10132c9b74016ba832db907df09fa timestamp: 2023-08-09_05:46:29 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-09T12:19:23.131 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_668a86f232c9454b2ce5928d1432a29a72964d85/qa; will attempt to use it 2023-08-09T12:19:23.131 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_668a86f232c9454b2ce5928d1432a29a72964d85/qa/tasks 2023-08-09T12:19:23.132 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-09T12:19:23.137 INFO:teuthology.task.internal:Checking packages... 2023-08-09T12:19:23.168 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '668a86f232c9454b2ce5928d1432a29a72964d85' 2023-08-09T12:19:23.169 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-09T12:19:23.169 INFO:teuthology.packaging:ref: None 2023-08-09T12:19:23.169 INFO:teuthology.packaging:tag: None 2023-08-09T12:19:23.170 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230809.035933 2023-08-09T12:19:23.170 INFO:teuthology.packaging:sha1: 668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T12:19:23.171 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20230809.035933 2023-08-09T12:19:23.312 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5389.g668a86f2 2023-08-09T12:19:23.313 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-09T12:19:23.322 INFO:teuthology.task.internal:no buildpackages task found 2023-08-09T12:19:23.323 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-09T12:19:23.364 INFO:teuthology.task.internal:Saving configuration 2023-08-09T12:19:23.393 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-09T12:19:23.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-09T12:19:23.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 12:14:30.900113', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNiRdK8KBEkCYEFGVsnvyjQMwGl1X8ouvA0XeobFuLFtAWt6scI5wwoMHvtRHTRn4wL7f/vjXbrF891KPddar8U='} 2023-08-09T12:19:23.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 12:14:30.901840', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMWSjGVLUMIzgjxvYuqvXv1yqr9ZFVjIg0RMuYd90lIDf8DfMCLsB4Y0IfblLZPBCDAS0yMY+nCtW0Ea/7ihJek='} 2023-08-09T12:19:23.449 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-09T12:19:23.460 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-09T12:19:23.461 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-09T12:19:23.461 INFO:teuthology.run_tasks:Running task console_log... 2023-08-09T12:19:23.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d95fec040>, signals=[15]) 2023-08-09T12:19:23.552 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-09T12:19:23.563 INFO:teuthology.task.internal:Opening connections... 2023-08-09T12:19:23.563 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:19:23.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T12:19:23.666 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:19:23.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T12:19:23.744 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-09T12:19:23.751 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-08-09T12:19:23.769 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-08-09T12:19:23.769 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-08-09T12:19:23.825 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-08-09T12:19:23.826 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2023-08-09T12:19:23.826 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-08-09T12:19:23.826 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-08-09T12:19:23.826 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2023-08-09T12:19:23.826 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2023-08-09T12:19:23.826 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-09T12:19:23.826 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-08-09T12:19:23.827 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2023-08-09T12:19:23.827 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-09T12:19:23.827 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-08-09T12:19:23.827 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-09T12:19:23.827 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-09T12:19:23.827 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-09T12:19:23.828 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-08-09T12:19:23.845 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-08-09T12:19:23.862 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-08-09T12:19:23.863 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-08-09T12:19:23.920 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-08-09T12:19:23.920 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2023-08-09T12:19:23.921 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-08-09T12:19:23.921 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-08-09T12:19:23.921 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2023-08-09T12:19:23.921 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2023-08-09T12:19:23.921 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-09T12:19:23.921 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-08-09T12:19:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2023-08-09T12:19:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-09T12:19:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-08-09T12:19:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-09T12:19:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-09T12:19:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-09T12:19:23.923 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-08-09T12:19:23.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-09T12:19:23.955 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-09T12:19:23.984 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-09T12:19:23.984 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2023-08-09T12:19:23.988 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2023-08-09T12:19:24.005 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-09T12:19:24.011 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-09T12:19:24.012 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2023-08-09T12:19:24.044 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2023-08-09T12:19:24.074 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-09T12:19:24.142 INFO:teuthology.run_tasks:Running task kernel... 2023-08-09T12:19:24.162 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'} 2023-08-09T12:19:24.163 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-08-09T12:19:24.164 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-08-09T12:19:24.164 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-09T12:19:24.165 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-09T12:19:24.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:19:24.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-08-09T12:19:24.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:19:24.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-08-09T12:19:24.354 DEBUG:teuthology.task.kernel:sha1 for client.0 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-09T12:19:24.355 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-09T12:19:24.355 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-08-09T12:19:24.369 DEBUG:teuthology.task.kernel:sha1 for client.1 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-09T12:19:24.370 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-09T12:19:24.370 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-08-09T12:19:24.373 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-239.el9.x86_64 2023-08-09T12:19:24.373 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-239.el9.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-09T12:19:24.374 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-09T12:19:24.374 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum upgrade -y linux-firmware 2023-08-09T12:19:24.387 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-239.el9.x86_64 2023-08-09T12:19:24.388 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-239.el9.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-09T12:19:24.388 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-09T12:19:24.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2023-08-09T12:19:26.344 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 12 MB/s | 6.3 MB 00:00 2023-08-09T12:19:26.410 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 10 MB/s | 6.3 MB 00:00 2023-08-09T12:19:27.704 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2023-08-09T12:19:27.760 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2023-08-09T12:19:28.694 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.8 MB 00:00 2023-08-09T12:19:29.495 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 7.8 MB 00:01 2023-08-09T12:19:30.787 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 23 MB/s | 18 MB 00:00 2023-08-09T12:19:33.444 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 18 MB 00:02 2023-08-09T12:19:34.480 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 14 kB 00:00 2023-08-09T12:19:35.839 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 15 MB/s | 18 MB 00:01 2023-08-09T12:19:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 14 kB 00:00 2023-08-09T12:19:38.021 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 24 MB/s | 18 MB 00:00 2023-08-09T12:19:41.784 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-08-09T12:19:41.795 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-08-09T12:19:41.795 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2023-08-09T12:19:41.795 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-08-09T12:19:41.796 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2023-08-09T12:19:41.796 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware noarch 20230726-138.el9 CentOS-BaseOS 294 M 2023-08-09T12:19:41.796 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:19:41.796 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-08-09T12:19:41.796 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-08-09T12:19:41.797 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 1 Package 2023-08-09T12:19:41.797 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:19:41.798 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 294 M 2023-08-09T12:19:41.798 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-08-09T12:19:44.408 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-08-09T12:19:44.418 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-08-09T12:19:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2023-08-09T12:19:44.418 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-08-09T12:19:44.418 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2023-08-09T12:19:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: linux-firmware noarch 20230726-138.el9 CentOS-BaseOS 294 M 2023-08-09T12:19:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:19:44.419 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-08-09T12:19:44.419 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-08-09T12:19:44.419 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 1 Package 2023-08-09T12:19:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:19:44.419 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 294 M 2023-08-09T12:19:44.420 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2023-08-09T12:19:51.056 INFO:teuthology.orchestra.run.smithi142.stdout:linux-firmware-20230726-138.el9.noarch.rpm 32 MB/s | 294 MB 00:09 2023-08-09T12:19:51.057 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-08-09T12:19:51.058 INFO:teuthology.orchestra.run.smithi142.stdout:Total 32 MB/s | 294 MB 00:09 2023-08-09T12:19:51.058 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-08-09T12:19:51.124 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-08-09T12:19:51.125 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-08-09T12:19:52.969 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-08-09T12:19:52.970 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-08-09T12:19:53.455 INFO:teuthology.orchestra.run.smithi017.stdout:linux-firmware-20230726-138.el9.noarch.rpm 32 MB/s | 294 MB 00:09 2023-08-09T12:19:53.456 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-08-09T12:19:53.457 INFO:teuthology.orchestra.run.smithi017.stdout:Total 32 MB/s | 294 MB 00:09 2023-08-09T12:19:53.457 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2023-08-09T12:19:53.530 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2023-08-09T12:19:53.531 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2023-08-09T12:19:55.453 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2023-08-09T12:19:55.454 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2023-08-09T12:19:59.085 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-08-09T12:19:59.634 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : linux-firmware-20230726-138.el9.noarch 1/2 2023-08-09T12:19:59.720 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-09T12:20:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: linux-firmware-20221214-129.el9.noarch 2/2 2023-08-09T12:20:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20230726-138.el9.noarch 1/2 2023-08-09T12:20:01.617 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-09T12:20:01.617 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:20:01.618 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2023-08-09T12:20:01.618 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware-20230726-138.el9.noarch 2023-08-09T12:20:01.618 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:20:01.618 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-08-09T12:20:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2023-08-09T12:20:01.947 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.1... 2023-08-09T12:20:01.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-09T12:20:02.109 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/ 2023-08-09T12:20:02.109 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/ --input-file=- 2023-08-09T12:20:02.112 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2023-08-09T12:20:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : linux-firmware-20230726-138.el9.noarch 1/2 2023-08-09T12:20:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-09T12:20:04.215 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: linux-firmware-20221214-129.el9.noarch 2/2 2023-08-09T12:20:04.216 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : linux-firmware-20230726-138.el9.noarch 1/2 2023-08-09T12:20:04.734 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-09T12:20:04.734 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:20:04.734 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2023-08-09T12:20:04.735 INFO:teuthology.orchestra.run.smithi017.stdout: linux-firmware-20230726-138.el9.noarch 2023-08-09T12:20:04.735 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:20:04.735 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-08-09T12:20:05.094 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-09T12:20:05.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-09T12:20:05.238 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/ 2023-08-09T12:20:05.240 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/ --input-file=- 2023-08-09T12:20:05.244 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi017.front.sepia.ceph.com to complete... 2023-08-09T12:20:15.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09 12:20:15 URL:https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [319463472/319463472] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-09T12:20:15.879 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2023-08-09 12:20:15-- 2023-08-09T12:20:15.879 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 14s 2023-08-09T12:20:15.879 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 305M in 13s (22.8 MB/s) 2023-08-09T12:20:15.881 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.1... 2023-08-09T12:20:15.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-09T12:20:17.712 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2023-08-09T12:20:17.751 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2023-08-09T12:20:17.802 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2023-08-09T12:20:24.820 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-09T12:20:24.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09 12:20:24 URL:https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/9/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [319463472/319463472] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-09T12:20:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:FINISHED --2023-08-09 12:20:24-- 2023-08-09T12:20:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:Total wall clock time: 20s 2023-08-09T12:20:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:Downloaded: 1 files, 305M in 19s (15.9 MB/s) 2023-08-09T12:20:24.908 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-09T12:20:24.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-09T12:20:26.845 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying... ######################################## 2023-08-09T12:20:26.890 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing... ######################################## 2023-08-09T12:20:26.942 INFO:teuthology.orchestra.run.smithi017.stdout:Updating / installing... 2023-08-09T12:20:34.229 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-09T12:21:05.008 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-09T12:21:05.008 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-09T12:21:05.079 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.080 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.080 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-09T12:21:05.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-09T12:21:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-09T12:21:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-09T12:21:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-09T12:21:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-09T12:21:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-09T12:21:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-09T12:21:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-09T12:21:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-09T12:21:05.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-09T12:21:05.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-09T12:21:05.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-09T12:21:05.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-09T12:21:05.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-09T12:21:05.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-09T12:21:05.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-09T12:21:05.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-09T12:21:05.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-09T12:21:05.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-09T12:21:05.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-09T12:21:05.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-09T12:21:05.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-09T12:21:05.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-09T12:21:05.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-09T12:21:05.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-09T12:21:05.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-09T12:21:05.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-09T12:21:05.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-09T12:21:05.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-09T12:21:05.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-09T12:21:05.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-09T12:21:05.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-09T12:21:05.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-09T12:21:05.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-09T12:21:05.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-09T12:21:05.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-09T12:21:05.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-09T12:21:05.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-09T12:21:05.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-09T12:21:05.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-09T12:21:05.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-09T12:21:05.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-09T12:21:05.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-09T12:21:05.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-09T12:21:05.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-09T12:21:05.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-09T12:21:05.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-09T12:21:05.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-09T12:21:05.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-09T12:21:05.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-09T12:21:05.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-09T12:21:05.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-09T12:21:05.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-09T12:21:05.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-09T12:21:05.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-09T12:21:05.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-09T12:21:05.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-09T12:21:05.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-09T12:21:05.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-09T12:21:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-09T12:21:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-09T12:21:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-09T12:21:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-09T12:21:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-09T12:21:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-09T12:21:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-09T12:21:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-09T12:21:05.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-09T12:21:05.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-09T12:21:05.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-09T12:21:05.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-09T12:21:05.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-09T12:21:05.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-09T12:21:05.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-09T12:21:05.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-09T12:21:05.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-09T12:21:05.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-09T12:21:05.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-09T12:21:05.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-09T12:21:05.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-09T12:21:05.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-09T12:21:05.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-09T12:21:05.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-09T12:21:05.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-09T12:21:05.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-09T12:21:05.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-09T12:21:05.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-09T12:21:05.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-09T12:21:05.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-09T12:21:05.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-09T12:21:05.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-09T12:21:05.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-09T12:21:05.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-09T12:21:05.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-09T12:21:05.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-09T12:21:05.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-09T12:21:05.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-09T12:21:05.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-09T12:21:05.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-09T12:21:05.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-09T12:21:05.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-09T12:21:05.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-09T12:21:05.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-09T12:21:05.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-09T12:21:05.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-09T12:21:05.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-09T12:21:05.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-09T12:21:05.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-09T12:21:05.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-09T12:21:05.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-09T12:21:05.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-09T12:21:05.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-09T12:21:05.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-09T12:21:05.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-09T12:21:05.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-09T12:21:05.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-09T12:21:05.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-09T12:21:05.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-09T12:21:05.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-09T12:21:05.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-09T12:21:05.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-09T12:21:05.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-09T12:21:05.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-09T12:21:05.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-09T12:21:05.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-09T12:21:05.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-09T12:21:05.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-09T12:21:05.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-09T12:21:05.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-09T12:21:05.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-09T12:21:05.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-09T12:21:05.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-09T12:21:05.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-09T12:21:05.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-09T12:21:05.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-09T12:21:05.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-09T12:21:05.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-09T12:21:05.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-09T12:21:05.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-09T12:21:05.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-09T12:21:05.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-09T12:21:05.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-09T12:21:05.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-09T12:21:05.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-09T12:21:05.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-09T12:21:05.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-09T12:21:05.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-09T12:21:05.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-09T12:21:05.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-09T12:21:05.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-09T12:21:05.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-09T12:21:05.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-09T12:21:05.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-09T12:21:05.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-09T12:21:05.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-09T12:21:05.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-09T12:21:05.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-09T12:21:05.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-09T12:21:05.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-09T12:21:05.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-09T12:21:05.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-09T12:21:05.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-09T12:21:05.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-09T12:21:05.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-09T12:21:05.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-09T12:21:05.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-09T12:21:05.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-09T12:21:05.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-09T12:21:05.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-09T12:21:05.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-09T12:21:05.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-09T12:21:05.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-09T12:21:05.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-09T12:21:05.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-09T12:21:05.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-09T12:21:05.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-09T12:21:05.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-09T12:21:05.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-09T12:21:05.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-09T12:21:05.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-09T12:21:05.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-09T12:21:05.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-09T12:21:05.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-09T12:21:05.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-09T12:21:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-09T12:21:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-09T12:21:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-09T12:21:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-09T12:21:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-09T12:21:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-09T12:21:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-09T12:21:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-09T12:21:05.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-09T12:21:05.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-09T12:21:05.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-09T12:21:05.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-09T12:21:05.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-09T12:21:05.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-09T12:21:05.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-09T12:21:05.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-09T12:21:05.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-09T12:21:05.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-09T12:21:05.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-09T12:21:05.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-09T12:21:05.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-09T12:21:05.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-09T12:21:05.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-09T12:21:05.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-09T12:21:05.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-09T12:21:05.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-09T12:21:05.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-09T12:21:05.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-09T12:21:05.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-09T12:21:05.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-09T12:21:05.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-09T12:21:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-09T12:21:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-09T12:21:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-09T12:21:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-09T12:21:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-09T12:21:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-09T12:21:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-09T12:21:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-09T12:21:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-09T12:21:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-09T12:21:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-09T12:21:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-09T12:21:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-09T12:21:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-09T12:21:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-09T12:21:05.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-09T12:21:05.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-09T12:21:05.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-09T12:21:05.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-09T12:21:05.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-09T12:21:05.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-09T12:21:05.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-09T12:21:05.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-09T12:21:05.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-09T12:21:05.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-09T12:21:05.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-09T12:21:05.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-09T12:21:05.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-09T12:21:05.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-09T12:21:05.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-09T12:21:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-09T12:21:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-09T12:21:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-09T12:21:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-09T12:21:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-09T12:21:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-09T12:21:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-09T12:21:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-09T12:21:05.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-09T12:21:05.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-09T12:21:05.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-09T12:21:05.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-09T12:21:05.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-09T12:21:05.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-09T12:21:05.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-09T12:21:05.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-09T12:21:05.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-09T12:21:05.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-09T12:21:05.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-09T12:21:05.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-09T12:21:05.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-09T12:21:05.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-09T12:21:05.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-09T12:21:05.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-09T12:21:05.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-09T12:21:05.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-09T12:21:05.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-09T12:21:05.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-09T12:21:05.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-09T12:21:05.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-09T12:21:05.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-09T12:21:05.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-09T12:21:05.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-09T12:21:05.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-09T12:21:05.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-09T12:21:05.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-09T12:21:05.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-09T12:21:05.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-09T12:21:05.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-09T12:21:05.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-09T12:21:05.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-09T12:21:05.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-09T12:21:05.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-09T12:21:05.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-09T12:21:05.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-09T12:21:05.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-09T12:21:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-09T12:21:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-09T12:21:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-09T12:21:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-09T12:21:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-09T12:21:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-09T12:21:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-09T12:21:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-09T12:21:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-09T12:21:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-09T12:21:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-09T12:21:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-09T12:21:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-09T12:21:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-09T12:21:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-09T12:21:05.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-09T12:21:05.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-09T12:21:05.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-09T12:21:05.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-09T12:21:05.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-09T12:21:05.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-09T12:21:05.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-09T12:21:05.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-09T12:21:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-09T12:21:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-09T12:21:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-09T12:21:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-09T12:21:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-09T12:21:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-09T12:21:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-09T12:21:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-09T12:21:05.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-09T12:21:05.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-09T12:21:05.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-09T12:21:05.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-09T12:21:05.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-09T12:21:05.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-09T12:21:05.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-09T12:21:05.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-09T12:21:05.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-09T12:21:05.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-09T12:21:05.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-09T12:21:05.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-09T12:21:05.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-09T12:21:05.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-09T12:21:05.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-09T12:21:05.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-09T12:21:05.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-09T12:21:05.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-09T12:21:05.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-09T12:21:05.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-09T12:21:05.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-09T12:21:05.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-09T12:21:05.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-09T12:21:05.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-09T12:21:05.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-09T12:21:05.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-09T12:21:05.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-09T12:21:05.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-09T12:21:05.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-09T12:21:05.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-09T12:21:05.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-09T12:21:05.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-09T12:21:05.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-09T12:21:05.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-09T12:21:05.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-09T12:21:05.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-09T12:21:05.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-09T12:21:05.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-09T12:21:05.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-09T12:21:05.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-09T12:21:05.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-09T12:21:05.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-09T12:21:05.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-09T12:21:05.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-09T12:21:05.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-09T12:21:05.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-09T12:21:05.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-09T12:21:05.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-09T12:21:05.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-09T12:21:05.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-09T12:21:05.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-09T12:21:05.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-09T12:21:05.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-09T12:21:05.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-09T12:21:05.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-09T12:21:05.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-09T12:21:05.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-09T12:21:05.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-09T12:21:05.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-09T12:21:05.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-09T12:21:05.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-09T12:21:05.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-09T12:21:05.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-09T12:21:05.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-09T12:21:05.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-09T12:21:05.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-09T12:21:05.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-09T12:21:05.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-09T12:21:05.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-09T12:21:05.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-09T12:21:05.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-09T12:21:05.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-09T12:21:05.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-09T12:21:05.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-09T12:21:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-09T12:21:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-09T12:21:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-09T12:21:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-09T12:21:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-09T12:21:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-09T12:21:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-09T12:21:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-09T12:21:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-09T12:21:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-09T12:21:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-09T12:21:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-09T12:21:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-09T12:21:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-09T12:21:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-09T12:21:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-09T12:21:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-09T12:21:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-09T12:21:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-09T12:21:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-09T12:21:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-09T12:21:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-09T12:21:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-09T12:21:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-09T12:21:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-09T12:21:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-09T12:21:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-09T12:21:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-09T12:21:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-09T12:21:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-09T12:21:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-09T12:21:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-09T12:21:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-09T12:21:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-09T12:21:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-09T12:21:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-09T12:21:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-09T12:21:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-09T12:21:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-09T12:21:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-09T12:21:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-09T12:21:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-09T12:21:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-09T12:21:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-09T12:21:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-09T12:21:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-09T12:21:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-09T12:21:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-09T12:21:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-09T12:21:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-09T12:21:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-09T12:21:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-09T12:21:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-09T12:21:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-09T12:21:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-09T12:21:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-09T12:21:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-09T12:21:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-09T12:21:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-09T12:21:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-09T12:21:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-09T12:21:05.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-09T12:21:05.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-09T12:21:05.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-09T12:21:05.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-09T12:21:05.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-09T12:21:05.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-09T12:21:05.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-09T12:21:05.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-09T12:21:05.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-09T12:21:05.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-09T12:21:05.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-09T12:21:05.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-09T12:21:05.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-09T12:21:05.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-09T12:21:05.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-09T12:21:05.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-09T12:21:05.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-09T12:21:05.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-09T12:21:05.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-09T12:21:05.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-09T12:21:05.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-09T12:21:05.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-09T12:21:05.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-09T12:21:05.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-09T12:21:05.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-09T12:21:05.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-09T12:21:05.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-09T12:21:05.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-09T12:21:05.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-09T12:21:05.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-09T12:21:05.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-09T12:21:05.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-09T12:21:05.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-09T12:21:05.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-09T12:21:05.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-09T12:21:05.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-09T12:21:05.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-09T12:21:05.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-09T12:21:05.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-09T12:21:05.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-09T12:21:05.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-09T12:21:05.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-09T12:21:05.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-09T12:21:05.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-09T12:21:05.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-09T12:21:05.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-09T12:21:05.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-09T12:21:05.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-09T12:21:05.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-09T12:21:05.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-09T12:21:05.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-09T12:21:05.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-09T12:21:05.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-09T12:21:05.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-09T12:21:05.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-09T12:21:05.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-09T12:21:05.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-09T12:21:05.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-09T12:21:05.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-09T12:21:05.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-09T12:21:05.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-09T12:21:05.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-09T12:21:05.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-09T12:21:05.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-09T12:21:05.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-09T12:21:05.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-09T12:21:05.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-09T12:21:05.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-09T12:21:05.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-09T12:21:05.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-09T12:21:05.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-09T12:21:05.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-09T12:21:05.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-09T12:21:05.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-09T12:21:05.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-09T12:21:05.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-09T12:21:05.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-09T12:21:05.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-09T12:21:05.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-09T12:21:05.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-09T12:21:05.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-09T12:21:05.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-09T12:21:05.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-09T12:21:05.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-09T12:21:05.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-09T12:21:05.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-09T12:21:05.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-09T12:21:05.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-09T12:21:05.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-09T12:21:05.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-09T12:21:05.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-09T12:21:05.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-09T12:21:05.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-09T12:21:05.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-09T12:21:05.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-09T12:21:05.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-09T12:21:05.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-09T12:21:05.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-09T12:21:05.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-09T12:21:05.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-09T12:21:05.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-09T12:21:05.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-09T12:21:05.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-09T12:21:05.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-09T12:21:05.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-09T12:21:05.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-09T12:21:05.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-09T12:21:05.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-09T12:21:05.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-09T12:21:05.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-09T12:21:05.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-09T12:21:05.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-09T12:21:05.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-09T12:21:05.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-09T12:21:05.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-09T12:21:05.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-09T12:21:05.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-09T12:21:05.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-09T12:21:05.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-09T12:21:05.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-09T12:21:05.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-09T12:21:05.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-09T12:21:05.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-09T12:21:05.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-09T12:21:05.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-09T12:21:05.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-09T12:21:05.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-09T12:21:05.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-09T12:21:05.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-09T12:21:05.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-09T12:21:05.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-09T12:21:05.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-09T12:21:05.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-09T12:21:05.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-09T12:21:05.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-09T12:21:05.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-09T12:21:05.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-09T12:21:05.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-09T12:21:05.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-09T12:21:05.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-09T12:21:05.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-09T12:21:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-09T12:21:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-09T12:21:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-09T12:21:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-09T12:21:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-09T12:21:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-09T12:21:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-09T12:21:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-09T12:21:05.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-09T12:21:05.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-09T12:21:05.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-09T12:21:05.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-09T12:21:05.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-09T12:21:05.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-09T12:21:05.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-09T12:21:05.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-09T12:21:05.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-09T12:21:05.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-09T12:21:05.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-09T12:21:05.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-09T12:21:05.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-09T12:21:05.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-09T12:21:05.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-09T12:21:05.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-09T12:21:05.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-09T12:21:05.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-09T12:21:05.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-09T12:21:05.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-09T12:21:05.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-09T12:21:05.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-09T12:21:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-09T12:21:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-09T12:21:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-09T12:21:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-09T12:21:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-09T12:21:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-09T12:21:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-09T12:21:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-09T12:21:05.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-09T12:21:05.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-09T12:21:05.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-09T12:21:05.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-09T12:21:05.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-09T12:21:05.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-09T12:21:05.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-09T12:21:05.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-09T12:21:05.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-09T12:21:05.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-09T12:21:05.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-09T12:21:05.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-09T12:21:05.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-09T12:21:05.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-09T12:21:05.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-09T12:21:05.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-09T12:21:05.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-09T12:21:05.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-09T12:21:05.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-09T12:21:05.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-09T12:21:05.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-09T12:21:05.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-09T12:21:05.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-09T12:21:05.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-09T12:21:05.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-09T12:21:05.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-09T12:21:05.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-09T12:21:05.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-09T12:21:05.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-09T12:21:05.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-09T12:21:05.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-09T12:21:05.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-09T12:21:05.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-09T12:21:05.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-09T12:21:05.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-09T12:21:05.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-09T12:21:05.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-09T12:21:05.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-09T12:21:05.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-09T12:21:05.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-09T12:21:05.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-09T12:21:05.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-09T12:21:05.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-09T12:21:05.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-09T12:21:05.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-09T12:21:05.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-09T12:21:05.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-09T12:21:05.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-09T12:21:05.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-09T12:21:05.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-09T12:21:05.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-09T12:21:05.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-09T12:21:05.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-09T12:21:05.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-09T12:21:05.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-09T12:21:05.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-09T12:21:05.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-09T12:21:05.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-09T12:21:05.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-09T12:21:05.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-09T12:21:05.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-09T12:21:05.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-09T12:21:05.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-09T12:21:05.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-09T12:21:05.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-09T12:21:05.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-09T12:21:05.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-09T12:21:05.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-09T12:21:05.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-09T12:21:05.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-09T12:21:05.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-09T12:21:05.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-09T12:21:05.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-09T12:21:05.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-09T12:21:05.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-09T12:21:05.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-09T12:21:05.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-09T12:21:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-09T12:21:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-09T12:21:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-09T12:21:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-09T12:21:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-09T12:21:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-09T12:21:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-09T12:21:05.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-09T12:21:05.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-09T12:21:05.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-09T12:21:05.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-09T12:21:05.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-09T12:21:05.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-09T12:21:05.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-09T12:21:05.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-09T12:21:05.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-09T12:21:05.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-09T12:21:05.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-09T12:21:05.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-09T12:21:05.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-09T12:21:05.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-09T12:21:05.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-09T12:21:05.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-09T12:21:05.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-09T12:21:05.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-09T12:21:05.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-09T12:21:05.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-09T12:21:05.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-09T12:21:05.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-09T12:21:05.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-09T12:21:05.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-09T12:21:05.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-09T12:21:05.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-09T12:21:05.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-09T12:21:05.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-09T12:21:05.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-09T12:21:05.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-09T12:21:05.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-09T12:21:05.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-09T12:21:05.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-09T12:21:05.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-09T12:21:05.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-09T12:21:05.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-09T12:21:05.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-09T12:21:05.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-09T12:21:05.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-09T12:21:05.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-09T12:21:05.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-09T12:21:05.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-09T12:21:05.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-09T12:21:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-09T12:21:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-09T12:21:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-09T12:21:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-09T12:21:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-09T12:21:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-09T12:21:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-09T12:21:05.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-09T12:21:05.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-09T12:21:05.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-09T12:21:05.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-09T12:21:05.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-09T12:21:05.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-09T12:21:05.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-09T12:21:05.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-09T12:21:05.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-09T12:21:05.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-09T12:21:05.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-09T12:21:05.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-09T12:21:05.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-09T12:21:05.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-09T12:21:05.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-09T12:21:05.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-09T12:21:05.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-09T12:21:05.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-09T12:21:05.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-09T12:21:05.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-09T12:21:05.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-09T12:21:05.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-09T12:21:05.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-09T12:21:05.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-09T12:21:05.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-09T12:21:05.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-09T12:21:05.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-09T12:21:05.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-09T12:21:05.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-09T12:21:05.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-09T12:21:05.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-09T12:21:05.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-09T12:21:05.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-09T12:21:05.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-09T12:21:05.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-09T12:21:05.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-09T12:21:05.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-09T12:21:05.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-09T12:21:05.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-09T12:21:05.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-09T12:21:05.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-09T12:21:05.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-09T12:21:05.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-09T12:21:05.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-09T12:21:05.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-09T12:21:05.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-09T12:21:05.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-09T12:21:05.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-09T12:21:05.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-09T12:21:05.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-09T12:21:05.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-09T12:21:05.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-09T12:21:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-09T12:21:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-09T12:21:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-09T12:21:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-09T12:21:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-09T12:21:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-09T12:21:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-09T12:21:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-09T12:21:05.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-09T12:21:05.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-09T12:21:05.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-09T12:21:05.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-09T12:21:05.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-09T12:21:05.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-09T12:21:05.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-09T12:21:05.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-09T12:21:05.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-09T12:21:05.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-09T12:21:05.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-09T12:21:05.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-09T12:21:05.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-09T12:21:05.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-09T12:21:05.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-09T12:21:05.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-09T12:21:05.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-09T12:21:05.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-09T12:21:05.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-09T12:21:05.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-09T12:21:05.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-09T12:21:05.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-09T12:21:05.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-09T12:21:05.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-09T12:21:05.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-09T12:21:05.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-09T12:21:05.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-09T12:21:05.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-09T12:21:05.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-09T12:21:05.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-09T12:21:05.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-09T12:21:05.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-09T12:21:05.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-09T12:21:05.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-09T12:21:05.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-09T12:21:05.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-09T12:21:05.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-09T12:21:05.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-09T12:21:05.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-09T12:21:05.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-09T12:21:05.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-09T12:21:05.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-09T12:21:05.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-09T12:21:05.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-09T12:21:05.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-09T12:21:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-09T12:21:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-09T12:21:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-09T12:21:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-09T12:21:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-09T12:21:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-09T12:21:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-09T12:21:05.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-09T12:21:05.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-09T12:21:05.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-09T12:21:05.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-09T12:21:05.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-09T12:21:05.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-09T12:21:05.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-09T12:21:05.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-09T12:21:05.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-09T12:21:05.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-09T12:21:05.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-09T12:21:05.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-09T12:21:05.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-09T12:21:05.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-09T12:21:05.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-09T12:21:05.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-09T12:21:05.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-09T12:21:05.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-09T12:21:05.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-09T12:21:05.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-09T12:21:05.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-09T12:21:05.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-09T12:21:05.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-09T12:21:05.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-09T12:21:05.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-09T12:21:05.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-09T12:21:05.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-09T12:21:05.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-09T12:21:05.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-09T12:21:05.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-09T12:21:05.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-09T12:21:05.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-09T12:21:05.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-09T12:21:05.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-09T12:21:05.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-09T12:21:05.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-09T12:21:05.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-09T12:21:05.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-09T12:21:05.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-09T12:21:05.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-09T12:21:05.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-09T12:21:05.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-09T12:21:05.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-09T12:21:05.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-09T12:21:05.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-09T12:21:05.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-09T12:21:05.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-09T12:21:05.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-09T12:21:05.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-09T12:21:05.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-09T12:21:05.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-09T12:21:05.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-09T12:21:05.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-09T12:21:05.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-09T12:21:05.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-09T12:21:05.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-09T12:21:05.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-09T12:21:05.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-09T12:21:05.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-09T12:21:05.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-09T12:21:05.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-09T12:21:05.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-09T12:21:05.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-09T12:21:05.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-09T12:21:05.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-09T12:21:05.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-09T12:21:05.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-09T12:21:05.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-09T12:21:05.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-09T12:21:05.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-09T12:21:05.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-09T12:21:05.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-09T12:21:05.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-09T12:21:05.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-09T12:21:05.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-09T12:21:05.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-09T12:21:05.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-09T12:21:05.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-09T12:21:05.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-09T12:21:05.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-09T12:21:05.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-09T12:21:05.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-09T12:21:05.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-09T12:21:05.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-09T12:21:05.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-09T12:21:05.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-09T12:21:05.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-09T12:21:05.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-09T12:21:05.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-09T12:21:05.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-09T12:21:05.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-09T12:21:05.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-09T12:21:05.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-09T12:21:05.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-09T12:21:05.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-09T12:21:05.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-09T12:21:05.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-09T12:21:05.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-09T12:21:05.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-09T12:21:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-09T12:21:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-09T12:21:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-09T12:21:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-09T12:21:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-09T12:21:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-09T12:21:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-09T12:21:05.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-09T12:21:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-09T12:21:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-09T12:21:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-09T12:21:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-09T12:21:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-09T12:21:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-09T12:21:05.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-09T12:21:05.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-09T12:21:05.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-09T12:21:05.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-09T12:21:05.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-09T12:21:05.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-09T12:21:05.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-09T12:21:05.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-09T12:21:05.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-09T12:21:05.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-09T12:21:05.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-09T12:21:05.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-09T12:21:05.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-09T12:21:05.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-09T12:21:05.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-09T12:21:05.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-09T12:21:05.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-09T12:21:05.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-09T12:21:05.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-09T12:21:05.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-09T12:21:05.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-09T12:21:05.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-09T12:21:05.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-09T12:21:05.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-09T12:21:05.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-09T12:21:05.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-09T12:21:05.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-09T12:21:05.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-09T12:21:05.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-09T12:21:05.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-09T12:21:05.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-09T12:21:05.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-09T12:21:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-09T12:21:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-09T12:21:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-09T12:21:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-09T12:21:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-09T12:21:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-09T12:21:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-09T12:21:05.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-09T12:21:05.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-09T12:21:05.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-09T12:21:05.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-09T12:21:05.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-09T12:21:05.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-09T12:21:05.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-09T12:21:05.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-09T12:21:05.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-09T12:21:05.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-09T12:21:05.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-09T12:21:05.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-09T12:21:05.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-09T12:21:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-09T12:21:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-09T12:21:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-09T12:21:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-09T12:21:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-09T12:21:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-09T12:21:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-09T12:21:05.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-09T12:21:05.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-09T12:21:05.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-09T12:21:05.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-09T12:21:05.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-09T12:21:05.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-09T12:21:05.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-09T12:21:05.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-09T12:21:05.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-09T12:21:05.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-09T12:21:05.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-09T12:21:05.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-09T12:21:05.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-09T12:21:05.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-09T12:21:05.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-09T12:21:05.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-09T12:21:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-09T12:21:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-09T12:21:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-09T12:21:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-09T12:21:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-09T12:21:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-09T12:21:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-09T12:21:05.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-09T12:21:05.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-09T12:21:05.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-09T12:21:05.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-09T12:21:05.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-09T12:21:05.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-09T12:21:05.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-09T12:21:05.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-09T12:21:05.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-09T12:21:05.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-09T12:21:05.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-09T12:21:05.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-09T12:21:05.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-09T12:21:05.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-09T12:21:05.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-09T12:21:05.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-09T12:21:05.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-09T12:21:05.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-09T12:21:05.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-09T12:21:05.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-09T12:21:05.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-09T12:21:05.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-09T12:21:05.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-09T12:21:05.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-09T12:21:05.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-09T12:21:05.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-09T12:21:05.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-09T12:21:05.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-09T12:21:05.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-09T12:21:05.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-09T12:21:05.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-09T12:21:05.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-09T12:21:05.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-09T12:21:05.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-09T12:21:05.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-09T12:21:05.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-09T12:21:05.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-09T12:21:05.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-09T12:21:05.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-09T12:21:05.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-09T12:21:05.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-09T12:21:05.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-09T12:21:05.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-09T12:21:05.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-09T12:21:05.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-09T12:21:05.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-09T12:21:05.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-09T12:21:05.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-09T12:21:05.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-09T12:21:05.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-09T12:21:05.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-09T12:21:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-09T12:21:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-09T12:21:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-09T12:21:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-09T12:21:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-09T12:21:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-09T12:21:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-09T12:21:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-09T12:21:05.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-09T12:21:05.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-09T12:21:05.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-09T12:21:05.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-09T12:21:05.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-09T12:21:05.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-09T12:21:05.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-09T12:21:05.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-09T12:21:05.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-09T12:21:05.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-09T12:21:05.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-09T12:21:05.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-09T12:21:05.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-09T12:21:05.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-09T12:21:05.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-09T12:21:05.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-09T12:21:05.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-09T12:21:05.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-09T12:21:05.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-09T12:21:05.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-09T12:21:05.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-09T12:21:05.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-09T12:21:05.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-09T12:21:05.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-09T12:21:05.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-09T12:21:05.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-09T12:21:05.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-09T12:21:05.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-09T12:21:05.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-09T12:21:05.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-09T12:21:05.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-09T12:21:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-09T12:21:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-09T12:21:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-09T12:21:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-09T12:21:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-09T12:21:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-09T12:21:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-09T12:21:05.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-09T12:21:05.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-09T12:21:05.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-09T12:21:05.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-09T12:21:05.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-09T12:21:05.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-09T12:21:05.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-09T12:21:05.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-09T12:21:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-09T12:21:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-09T12:21:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-09T12:21:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-09T12:21:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-09T12:21:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-09T12:21:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-09T12:21:05.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-09T12:21:05.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-09T12:21:05.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-09T12:21:05.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-09T12:21:05.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-09T12:21:05.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-09T12:21:05.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-09T12:21:05.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-09T12:21:05.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-09T12:21:05.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-09T12:21:05.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-09T12:21:05.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-09T12:21:05.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-09T12:21:05.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-09T12:21:05.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-09T12:21:05.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-09T12:21:05.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-09T12:21:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-09T12:21:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-09T12:21:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-09T12:21:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-09T12:21:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-09T12:21:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-09T12:21:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-09T12:21:05.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-09T12:21:05.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-09T12:21:05.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-09T12:21:05.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-09T12:21:05.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-09T12:21:05.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-09T12:21:05.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-09T12:21:05.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-09T12:21:05.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-09T12:21:05.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-09T12:21:05.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-09T12:21:05.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-09T12:21:05.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-09T12:21:05.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-09T12:21:05.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-09T12:21:05.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-09T12:21:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-09T12:21:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-09T12:21:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-09T12:21:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-09T12:21:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-09T12:21:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-09T12:21:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-09T12:21:05.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-09T12:21:05.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-09T12:21:05.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-09T12:21:05.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-09T12:21:05.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-09T12:21:05.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-09T12:21:05.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-09T12:21:05.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-09T12:21:05.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-09T12:21:05.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-09T12:21:05.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-09T12:21:05.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-09T12:21:05.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-09T12:21:05.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-09T12:21:05.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-09T12:21:05.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-09T12:21:05.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-09T12:21:05.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-09T12:21:05.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-09T12:21:05.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-09T12:21:05.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-09T12:21:05.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-09T12:21:05.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-09T12:21:05.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-09T12:21:05.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-09T12:21:05.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-09T12:21:05.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-09T12:21:05.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-09T12:21:05.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-09T12:21:05.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-09T12:21:05.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-09T12:21:05.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-09T12:21:05.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-09T12:21:05.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-09T12:21:05.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-09T12:21:05.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-09T12:21:05.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-09T12:21:05.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-09T12:21:05.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-09T12:21:05.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-09T12:21:05.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-09T12:21:05.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-09T12:21:05.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-09T12:21:05.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-09T12:21:05.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-09T12:21:05.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-09T12:21:05.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-09T12:21:05.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-09T12:21:05.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-09T12:21:05.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-09T12:21:05.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-09T12:21:05.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-09T12:21:05.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-09T12:21:05.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-09T12:21:05.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-09T12:21:05.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-09T12:21:05.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-09T12:21:05.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-09T12:21:05.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-09T12:21:05.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-09T12:21:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-09T12:21:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-09T12:21:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-09T12:21:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-09T12:21:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-09T12:21:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-09T12:21:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-09T12:21:05.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-09T12:21:05.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-09T12:21:05.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-09T12:21:05.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-09T12:21:05.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-09T12:21:05.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-09T12:21:05.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-09T12:21:05.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-09T12:21:05.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-09T12:21:05.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-09T12:21:05.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-09T12:21:05.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-09T12:21:05.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-09T12:21:05.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-09T12:21:05.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-09T12:21:05.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-09T12:21:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-09T12:21:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-09T12:21:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-09T12:21:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-09T12:21:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-09T12:21:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-09T12:21:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-09T12:21:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-09T12:21:05.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-09T12:21:05.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-09T12:21:05.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-09T12:21:05.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-09T12:21:05.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-09T12:21:05.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-09T12:21:05.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-09T12:21:05.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-09T12:21:05.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-09T12:21:05.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-09T12:21:05.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-09T12:21:05.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-09T12:21:05.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-09T12:21:05.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-09T12:21:05.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-09T12:21:05.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-09T12:21:05.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-09T12:21:05.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-09T12:21:05.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-09T12:21:05.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-09T12:21:05.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-09T12:21:05.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-09T12:21:05.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-09T12:21:05.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-09T12:21:05.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-09T12:21:05.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-09T12:21:05.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-09T12:21:05.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-09T12:21:05.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-09T12:21:05.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-09T12:21:05.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-09T12:21:05.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-09T12:21:05.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-09T12:21:05.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-09T12:21:05.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-09T12:21:05.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-09T12:21:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-09T12:21:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-09T12:21:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-09T12:21:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-09T12:21:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-09T12:21:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-09T12:21:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-09T12:21:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-09T12:21:05.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-09T12:21:05.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-09T12:21:05.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-09T12:21:05.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-09T12:21:05.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-09T12:21:05.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-09T12:21:05.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-09T12:21:05.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-09T12:21:05.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-09T12:21:05.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-09T12:21:05.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-09T12:21:05.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-09T12:21:05.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-09T12:21:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-09T12:21:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-09T12:21:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-09T12:21:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-09T12:21:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-09T12:21:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-09T12:21:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-09T12:21:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-09T12:21:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-09T12:21:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-09T12:21:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-09T12:21:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-09T12:21:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-09T12:21:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-09T12:21:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-09T12:21:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-09T12:21:05.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-09T12:21:05.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-09T12:21:05.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-09T12:21:05.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-09T12:21:05.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-09T12:21:05.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-09T12:21:05.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-09T12:21:05.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-09T12:21:05.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-09T12:21:05.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-09T12:21:05.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-09T12:21:05.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-09T12:21:05.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-09T12:21:05.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-09T12:21:05.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-09T12:21:05.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-09T12:21:05.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-09T12:21:05.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-09T12:21:05.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-09T12:21:05.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-09T12:21:05.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-09T12:21:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-09T12:21:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-09T12:21:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-09T12:21:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-09T12:21:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-09T12:21:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-09T12:21:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-09T12:21:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-09T12:21:05.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-09T12:21:05.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-09T12:21:05.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-09T12:21:05.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-09T12:21:05.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-09T12:21:05.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-09T12:21:05.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-09T12:21:05.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-09T12:21:05.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-09T12:21:05.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-09T12:21:05.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-09T12:21:05.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-09T12:21:05.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-09T12:21:05.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-09T12:21:05.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-09T12:21:05.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-09T12:21:05.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-09T12:21:05.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-09T12:21:05.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-09T12:21:05.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-09T12:21:05.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-09T12:21:05.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-09T12:21:05.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-09T12:21:05.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-09T12:21:05.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-09T12:21:05.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-09T12:21:05.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-09T12:21:05.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-09T12:21:05.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-09T12:21:05.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-09T12:21:05.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-09T12:21:05.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-09T12:21:05.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-09T12:21:05.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-09T12:21:05.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-09T12:21:05.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-09T12:21:05.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-09T12:21:05.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-09T12:21:05.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-09T12:21:05.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-09T12:21:05.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-09T12:21:05.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-09T12:21:05.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-09T12:21:05.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-09T12:21:05.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-09T12:21:05.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-09T12:21:05.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-09T12:21:05.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-09T12:21:05.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-09T12:21:05.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-09T12:21:05.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-09T12:21:05.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-09T12:21:05.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-09T12:21:05.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-09T12:21:05.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-09T12:21:05.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-09T12:21:05.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-09T12:21:05.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-09T12:21:05.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-09T12:21:05.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-09T12:21:05.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-09T12:21:05.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-09T12:21:05.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-09T12:21:05.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-09T12:21:05.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-09T12:21:05.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-09T12:21:05.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-09T12:21:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-09T12:21:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-09T12:21:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-09T12:21:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-09T12:21:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-09T12:21:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-09T12:21:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-09T12:21:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-09T12:21:05.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-09T12:21:05.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-09T12:21:05.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-09T12:21:05.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-09T12:21:05.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-09T12:21:05.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-09T12:21:05.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-09T12:21:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-09T12:21:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-09T12:21:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-09T12:21:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-09T12:21:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-09T12:21:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-09T12:21:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-09T12:21:05.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-09T12:21:05.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-09T12:21:05.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-09T12:21:05.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-09T12:21:05.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-09T12:21:05.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-09T12:21:05.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-09T12:21:05.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-09T12:21:05.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-09T12:21:05.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-09T12:21:05.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-09T12:21:05.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-09T12:21:05.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-09T12:21:05.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-09T12:21:05.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-09T12:21:05.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-09T12:21:05.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-09T12:21:05.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-09T12:21:05.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-09T12:21:05.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-09T12:21:05.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-09T12:21:05.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-09T12:21:05.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-09T12:21:05.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-09T12:21:05.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-09T12:21:05.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-09T12:21:05.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-09T12:21:05.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-09T12:21:05.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-09T12:21:05.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-09T12:21:05.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-09T12:21:05.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-09T12:21:05.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-09T12:21:05.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-09T12:21:05.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-09T12:21:05.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-09T12:21:05.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-09T12:21:05.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-09T12:21:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-09T12:21:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-09T12:21:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-09T12:21:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-09T12:21:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-09T12:21:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-09T12:21:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-09T12:21:05.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-09T12:21:05.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-09T12:21:05.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-09T12:21:05.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-09T12:21:05.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-09T12:21:05.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-09T12:21:05.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-09T12:21:05.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-09T12:21:05.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-09T12:21:05.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-09T12:21:05.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-09T12:21:05.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-09T12:21:05.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-09T12:21:05.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-09T12:21:05.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-09T12:21:05.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-09T12:21:05.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-09T12:21:05.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-09T12:21:05.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-09T12:21:05.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-09T12:21:05.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-09T12:21:05.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-09T12:21:05.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-09T12:21:05.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-09T12:21:05.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-09T12:21:05.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-09T12:21:05.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-09T12:21:05.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-09T12:21:05.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-09T12:21:05.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-09T12:21:05.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-09T12:21:05.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-09T12:21:05.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-09T12:21:05.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-09T12:21:05.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-09T12:21:05.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-09T12:21:05.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-09T12:21:05.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-09T12:21:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-09T12:21:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-09T12:21:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-09T12:21:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-09T12:21:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-09T12:21:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-09T12:21:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-09T12:21:05.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-09T12:21:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-09T12:21:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-09T12:21:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-09T12:21:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-09T12:21:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-09T12:21:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-09T12:21:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-09T12:21:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-09T12:21:05.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-09T12:21:05.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-09T12:21:05.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-09T12:21:05.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-09T12:21:05.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-09T12:21:05.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-09T12:21:05.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-09T12:21:05.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-09T12:21:05.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-09T12:21:05.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-09T12:21:05.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-09T12:21:05.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-09T12:21:05.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-09T12:21:05.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-09T12:21:05.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-09T12:21:05.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-09T12:21:05.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-09T12:21:05.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-09T12:21:05.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-09T12:21:05.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-09T12:21:05.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-09T12:21:05.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-09T12:21:05.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-09T12:21:05.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-09T12:21:05.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-09T12:21:05.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-09T12:21:05.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-09T12:21:05.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-09T12:21:05.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-09T12:21:05.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-09T12:21:05.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-09T12:21:05.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-09T12:21:05.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-09T12:21:05.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-09T12:21:05.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-09T12:21:05.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-09T12:21:05.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-09T12:21:05.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-09T12:21:05.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-09T12:21:05.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-09T12:21:05.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-09T12:21:05.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-09T12:21:05.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-09T12:21:05.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-09T12:21:05.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-09T12:21:05.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-09T12:21:05.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-09T12:21:05.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-09T12:21:05.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-09T12:21:05.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-09T12:21:05.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-09T12:21:05.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-09T12:21:05.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-09T12:21:05.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-09T12:21:05.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-09T12:21:05.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-09T12:21:05.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-09T12:21:05.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-09T12:21:05.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-09T12:21:05.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-09T12:21:05.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-09T12:21:05.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-09T12:21:05.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-09T12:21:05.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-09T12:21:05.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-09T12:21:05.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-09T12:21:05.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-09T12:21:05.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-09T12:21:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-09T12:21:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-09T12:21:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-09T12:21:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-09T12:21:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-09T12:21:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-09T12:21:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-09T12:21:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-09T12:21:05.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-09T12:21:05.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-09T12:21:05.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-09T12:21:05.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-09T12:21:05.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-09T12:21:05.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-09T12:21:05.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-09T12:21:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-09T12:21:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-09T12:21:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-09T12:21:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-09T12:21:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-09T12:21:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-09T12:21:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-09T12:21:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-09T12:21:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-09T12:21:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-09T12:21:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-09T12:21:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-09T12:21:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-09T12:21:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-09T12:21:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-09T12:21:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-09T12:21:05.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-09T12:21:05.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-09T12:21:05.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-09T12:21:05.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-09T12:21:05.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-09T12:21:05.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-09T12:21:05.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-09T12:21:05.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-09T12:21:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-09T12:21:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-09T12:21:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-09T12:21:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-09T12:21:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-09T12:21:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-09T12:21:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-09T12:21:05.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-09T12:21:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-09T12:21:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-09T12:21:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-09T12:21:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-09T12:21:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-09T12:21:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-09T12:21:05.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-09T12:21:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-09T12:21:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-09T12:21:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-09T12:21:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-09T12:21:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-09T12:21:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-09T12:21:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-09T12:21:05.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-09T12:21:05.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-09T12:21:05.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-09T12:21:05.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-09T12:21:05.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-09T12:21:05.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-09T12:21:05.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-09T12:21:05.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-09T12:21:05.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-09T12:21:05.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-09T12:21:05.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-09T12:21:05.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-09T12:21:05.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-09T12:21:05.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-09T12:21:05.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-09T12:21:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-09T12:21:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-09T12:21:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-09T12:21:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-09T12:21:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-09T12:21:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-09T12:21:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-09T12:21:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-09T12:21:05.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-09T12:21:05.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-09T12:21:05.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-09T12:21:05.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-09T12:21:05.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-09T12:21:05.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-09T12:21:05.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-09T12:21:05.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-09T12:21:05.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-09T12:21:05.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-09T12:21:05.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-09T12:21:05.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-09T12:21:05.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-09T12:21:05.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-09T12:21:05.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-09T12:21:05.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-09T12:21:05.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-09T12:21:05.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-09T12:21:05.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-09T12:21:05.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-09T12:21:05.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-09T12:21:05.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-09T12:21:05.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-09T12:21:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-09T12:21:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-09T12:21:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-09T12:21:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-09T12:21:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-09T12:21:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-09T12:21:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-09T12:21:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-09T12:21:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-09T12:21:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-09T12:21:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-09T12:21:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-09T12:21:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-09T12:21:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-09T12:21:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-09T12:21:05.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-09T12:21:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-09T12:21:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-09T12:21:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-09T12:21:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-09T12:21:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-09T12:21:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-09T12:21:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-09T12:21:05.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-09T12:21:05.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-09T12:21:05.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-09T12:21:05.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-09T12:21:05.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-09T12:21:05.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-09T12:21:05.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-09T12:21:05.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-09T12:21:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-09T12:21:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-09T12:21:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-09T12:21:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-09T12:21:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-09T12:21:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-09T12:21:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-09T12:21:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-09T12:21:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-09T12:21:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-09T12:21:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-09T12:21:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-09T12:21:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-09T12:21:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-09T12:21:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-09T12:21:05.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-09T12:21:05.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-09T12:21:05.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-09T12:21:05.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-09T12:21:05.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-09T12:21:05.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-09T12:21:05.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-09T12:21:05.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-09T12:21:05.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-09T12:21:05.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-09T12:21:05.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-09T12:21:05.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-09T12:21:05.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-09T12:21:05.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-09T12:21:05.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-09T12:21:05.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-09T12:21:05.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-09T12:21:05.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-09T12:21:05.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-09T12:21:05.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-09T12:21:05.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-09T12:21:05.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-09T12:21:05.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-09T12:21:05.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-09T12:21:05.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-09T12:21:05.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-09T12:21:05.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-09T12:21:05.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-09T12:21:05.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-09T12:21:05.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-09T12:21:05.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-09T12:21:05.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-09T12:21:05.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-09T12:21:05.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-09T12:21:05.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-09T12:21:05.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-09T12:21:05.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-09T12:21:05.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-09T12:21:05.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-09T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-09T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-09T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-09T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-09T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-09T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-09T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-09T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-09T12:21:05.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-09T12:21:05.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-09T12:21:05.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-09T12:21:05.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-09T12:21:05.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-09T12:21:05.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-09T12:21:05.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-09T12:21:05.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-09T12:21:05.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-09T12:21:05.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-09T12:21:05.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-09T12:21:05.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-09T12:21:05.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-09T12:21:05.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-09T12:21:05.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-09T12:21:05.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-09T12:21:05.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-09T12:21:05.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-09T12:21:05.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-09T12:21:05.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-09T12:21:05.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-09T12:21:05.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-09T12:21:05.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-09T12:21:05.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-09T12:21:05.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-09T12:21:05.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-09T12:21:05.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-09T12:21:05.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-09T12:21:05.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-09T12:21:05.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-09T12:21:05.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-09T12:21:05.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-09T12:21:05.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-09T12:21:05.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-09T12:21:05.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-09T12:21:05.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-09T12:21:05.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-09T12:21:05.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-09T12:21:05.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-09T12:21:05.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-09T12:21:05.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-09T12:21:05.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-09T12:21:05.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-09T12:21:05.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-09T12:21:05.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-09T12:21:05.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-09T12:21:05.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-09T12:21:05.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-09T12:21:05.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-09T12:21:05.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-09T12:21:05.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-09T12:21:05.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-09T12:21:05.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-09T12:21:05.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.alias.bin 2023-08-09T12:21:05.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-09T12:21:05.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-09T12:21:05.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-09T12:21:05.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-09T12:21:05.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-09T12:21:05.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-09T12:21:05.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-09T12:21:05.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-09T12:21:05.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-09T12:21:05.340 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.341 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-09T12:21:05.364 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2023-08-09T12:21:05.364 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-09T12:21:05.364 INFO:teuthology.orchestra.run.smithi142.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-09T12:21:05.364 INFO:teuthology.orchestra.run.smithi142.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-09T12:21:05.364 INFO:teuthology.orchestra.run.smithi142.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-09T12:21:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-09T12:21:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-08-09T12:21:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-09T12:21:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-09T12:21:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-09T12:21:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-09T12:21:05.365 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.366 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-08-09T12:21:05.366 INFO:teuthology.orchestra.run.smithi142.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-09T12:21:05.366 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-09T12:21:05.366 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.366 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-08-09T12:21:05.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2023-08-09T12:21:05.453 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2023-08-09T12:21:05.453 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2023-08-09T12:21:05.454 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2023-08-09T12:21:05.454 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 53.el9 2023-08-09T12:21:05.454 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2023-08-09T12:21:05.454 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Mon 30 Jan 2023 10:38:40 AM UTC 2023-08-09T12:21:05.454 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2023-08-09T12:21:05.454 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8551923 2023-08-09T12:21:05.454 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2023-08-09T12:21:05.454 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Wed 18 Jan 2023 04:40:07 PM UTC, Key ID 05b555b38483c65d 2023-08-09T12:21:05.455 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-53.el9.src.rpm 2023-08-09T12:21:05.455 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Fri 13 Jan 2023 09:07:28 PM UTC 2023-08-09T12:21:05.455 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-08-09T12:21:05.455 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2023-08-09T12:21:05.455 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2023-08-09T12:21:05.455 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-09T12:21:05.455 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2023-08-09T12:21:05.456 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2023-08-09T12:21:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:21:05.456 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-09T12:21:05.456 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-09T12:21:05.456 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-09T12:21:05.456 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2023-08-09T12:21:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:21:05.456 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2023-08-09T12:21:05.458 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-09T12:21:05.458 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:05.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-09T12:21:05.958 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2023-08-09T12:21:07.371 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-08-09T12:21:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:done 2023-08-09T12:21:07.408 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-08-09T12:21:07.453 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.MlDQN4xuW1 2023-08-09T12:21:07.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MlDQN4xuW1 2023-08-09T12:21:07.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.MlDQN4xuW1 2023-08-09T12:21:07.632 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.MlDQN4xuW1 is 6KB 2023-08-09T12:21:07.679 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.MlDQN4xuW1 2023-08-09T12:21:07.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2023-08-09T12:21:07.758 INFO:teuthology.orchestra.run.smithi142.stdout:e13cba1d25f14c51a1d04da8db823a4e-0-rescue.conf 2023-08-09T12:21:07.759 INFO:teuthology.orchestra.run.smithi142.stdout:e13cba1d25f14c51a1d04da8db823a4e-5.14.0-239.el9.x86_64.conf 2023-08-09T12:21:07.759 INFO:teuthology.orchestra.run.smithi142.stdout:e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc4-ga7fb1265323d.conf 2023-08-09T12:21:07.760 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:07.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2023-08-09T12:21:14.471 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-09T12:21:14.472 DEBUG:teuthology.orchestra.run.smithi017:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-09T12:21:14.551 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.551 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.552 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.552 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.552 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-09T12:21:14.553 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-09T12:21:14.553 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-09T12:21:14.553 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-09T12:21:14.554 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-09T12:21:14.554 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-09T12:21:14.554 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-09T12:21:14.554 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-09T12:21:14.554 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-09T12:21:14.554 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-09T12:21:14.554 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-09T12:21:14.555 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-09T12:21:14.555 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-09T12:21:14.555 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-09T12:21:14.555 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-09T12:21:14.555 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-09T12:21:14.555 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-09T12:21:14.555 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-09T12:21:14.556 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-09T12:21:14.556 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-09T12:21:14.556 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-09T12:21:14.556 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-09T12:21:14.556 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-09T12:21:14.556 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-09T12:21:14.556 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-09T12:21:14.557 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-09T12:21:14.557 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-09T12:21:14.557 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-09T12:21:14.557 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-09T12:21:14.557 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-09T12:21:14.557 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-09T12:21:14.557 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-09T12:21:14.558 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-09T12:21:14.558 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-09T12:21:14.558 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-09T12:21:14.558 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-09T12:21:14.558 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-09T12:21:14.558 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-09T12:21:14.558 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-09T12:21:14.558 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-09T12:21:14.559 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-09T12:21:14.559 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-09T12:21:14.559 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-09T12:21:14.559 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-09T12:21:14.559 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-09T12:21:14.559 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-09T12:21:14.559 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-09T12:21:14.560 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-09T12:21:14.560 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-09T12:21:14.560 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-09T12:21:14.560 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-09T12:21:14.560 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-09T12:21:14.561 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-09T12:21:14.561 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-09T12:21:14.561 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-09T12:21:14.561 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-09T12:21:14.561 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-09T12:21:14.561 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-09T12:21:14.561 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-09T12:21:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-09T12:21:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-09T12:21:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-09T12:21:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-09T12:21:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-09T12:21:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-09T12:21:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-09T12:21:14.562 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-09T12:21:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-09T12:21:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-09T12:21:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-09T12:21:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-09T12:21:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-09T12:21:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-09T12:21:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-09T12:21:14.564 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-09T12:21:14.564 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-09T12:21:14.564 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-09T12:21:14.564 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-09T12:21:14.564 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-09T12:21:14.564 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-09T12:21:14.564 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-09T12:21:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-09T12:21:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-09T12:21:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-09T12:21:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-09T12:21:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-09T12:21:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-09T12:21:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-09T12:21:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-09T12:21:14.566 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-09T12:21:14.566 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-09T12:21:14.566 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-09T12:21:14.566 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-09T12:21:14.566 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-09T12:21:14.566 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-09T12:21:14.566 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-09T12:21:14.567 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-09T12:21:14.567 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-09T12:21:14.567 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-09T12:21:14.567 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-09T12:21:14.567 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-09T12:21:14.568 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-09T12:21:14.568 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-09T12:21:14.568 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-09T12:21:14.568 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-09T12:21:14.568 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-09T12:21:14.568 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-09T12:21:14.569 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-09T12:21:14.569 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-09T12:21:14.569 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-09T12:21:14.569 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-09T12:21:14.569 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-09T12:21:14.569 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-09T12:21:14.569 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-09T12:21:14.570 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-09T12:21:14.570 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-09T12:21:14.570 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-09T12:21:14.570 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-09T12:21:14.570 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-09T12:21:14.570 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-09T12:21:14.571 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-09T12:21:14.571 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-09T12:21:14.571 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-09T12:21:14.572 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-09T12:21:14.572 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-09T12:21:14.572 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-09T12:21:14.573 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-09T12:21:14.573 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-09T12:21:14.573 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-09T12:21:14.573 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-09T12:21:14.574 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-09T12:21:14.574 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-09T12:21:14.574 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-09T12:21:14.574 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-09T12:21:14.575 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-09T12:21:14.575 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-09T12:21:14.575 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-09T12:21:14.576 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-09T12:21:14.576 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-09T12:21:14.576 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-09T12:21:14.576 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-09T12:21:14.577 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-09T12:21:14.577 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-09T12:21:14.577 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-09T12:21:14.577 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-09T12:21:14.577 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-09T12:21:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-09T12:21:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-09T12:21:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-09T12:21:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-09T12:21:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-09T12:21:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-09T12:21:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-09T12:21:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-09T12:21:14.579 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-09T12:21:14.579 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-09T12:21:14.579 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-09T12:21:14.579 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-09T12:21:14.579 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-09T12:21:14.579 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-09T12:21:14.579 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-09T12:21:14.579 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-09T12:21:14.580 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-09T12:21:14.580 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-09T12:21:14.580 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-09T12:21:14.580 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-09T12:21:14.580 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-09T12:21:14.580 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-09T12:21:14.580 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-09T12:21:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-09T12:21:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-09T12:21:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-09T12:21:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-09T12:21:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-09T12:21:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-09T12:21:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-09T12:21:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-09T12:21:14.582 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-09T12:21:14.582 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-09T12:21:14.582 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-09T12:21:14.582 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-09T12:21:14.582 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-09T12:21:14.582 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-09T12:21:14.582 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-09T12:21:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-09T12:21:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-09T12:21:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-09T12:21:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-09T12:21:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-09T12:21:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-09T12:21:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-09T12:21:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-09T12:21:14.584 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-09T12:21:14.584 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-09T12:21:14.584 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-09T12:21:14.584 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-09T12:21:14.584 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-09T12:21:14.584 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-09T12:21:14.584 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-09T12:21:14.585 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-09T12:21:14.585 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-09T12:21:14.585 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-09T12:21:14.585 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-09T12:21:14.585 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-09T12:21:14.585 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-09T12:21:14.585 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-09T12:21:14.585 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-09T12:21:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-09T12:21:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-09T12:21:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-09T12:21:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-09T12:21:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-09T12:21:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-09T12:21:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-09T12:21:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-09T12:21:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-09T12:21:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-09T12:21:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-09T12:21:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-09T12:21:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-09T12:21:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-09T12:21:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-09T12:21:14.588 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-09T12:21:14.588 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-09T12:21:14.588 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-09T12:21:14.588 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-09T12:21:14.588 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-09T12:21:14.588 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-09T12:21:14.588 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-09T12:21:14.588 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-09T12:21:14.589 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-09T12:21:14.589 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-09T12:21:14.589 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-09T12:21:14.589 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-09T12:21:14.589 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-09T12:21:14.589 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-09T12:21:14.589 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-09T12:21:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-09T12:21:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-09T12:21:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-09T12:21:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-09T12:21:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-09T12:21:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-09T12:21:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-09T12:21:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-09T12:21:14.591 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-09T12:21:14.591 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-09T12:21:14.591 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-09T12:21:14.591 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-09T12:21:14.591 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-09T12:21:14.591 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-09T12:21:14.591 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-09T12:21:14.592 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-09T12:21:14.592 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-09T12:21:14.592 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-09T12:21:14.592 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-09T12:21:14.592 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-09T12:21:14.592 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-09T12:21:14.592 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-09T12:21:14.592 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-09T12:21:14.593 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-09T12:21:14.593 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-09T12:21:14.593 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-09T12:21:14.593 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-09T12:21:14.593 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-09T12:21:14.593 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-09T12:21:14.593 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-09T12:21:14.593 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-09T12:21:14.594 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-09T12:21:14.594 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-09T12:21:14.594 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-09T12:21:14.594 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-09T12:21:14.594 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-09T12:21:14.594 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-09T12:21:14.594 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-09T12:21:14.594 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-09T12:21:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-09T12:21:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-09T12:21:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-09T12:21:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-09T12:21:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-09T12:21:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-09T12:21:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-09T12:21:14.596 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-09T12:21:14.596 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-09T12:21:14.596 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-09T12:21:14.596 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-09T12:21:14.596 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-09T12:21:14.596 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-09T12:21:14.596 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-09T12:21:14.596 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-09T12:21:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-09T12:21:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-09T12:21:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-09T12:21:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-09T12:21:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-09T12:21:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-09T12:21:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-09T12:21:14.598 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-09T12:21:14.598 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-09T12:21:14.598 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-09T12:21:14.598 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-09T12:21:14.598 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-09T12:21:14.598 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-09T12:21:14.599 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-09T12:21:14.599 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-09T12:21:14.599 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-09T12:21:14.599 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-09T12:21:14.599 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-09T12:21:14.599 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-09T12:21:14.599 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-09T12:21:14.599 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-09T12:21:14.600 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-09T12:21:14.600 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-09T12:21:14.600 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-09T12:21:14.600 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-09T12:21:14.600 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-09T12:21:14.600 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-09T12:21:14.600 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-09T12:21:14.601 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-09T12:21:14.601 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-09T12:21:14.601 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-09T12:21:14.601 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-09T12:21:14.601 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-09T12:21:14.601 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-09T12:21:14.601 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-09T12:21:14.601 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-09T12:21:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-09T12:21:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-09T12:21:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-09T12:21:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-09T12:21:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-09T12:21:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-09T12:21:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-09T12:21:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-09T12:21:14.603 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-09T12:21:14.603 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-09T12:21:14.603 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-09T12:21:14.603 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-09T12:21:14.603 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-09T12:21:14.603 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-09T12:21:14.603 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-09T12:21:14.603 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-09T12:21:14.604 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-09T12:21:14.604 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-09T12:21:14.604 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-09T12:21:14.604 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-09T12:21:14.604 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-09T12:21:14.604 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-09T12:21:14.604 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-09T12:21:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-09T12:21:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-09T12:21:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-09T12:21:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-09T12:21:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-09T12:21:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-09T12:21:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-09T12:21:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-09T12:21:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-09T12:21:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-09T12:21:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-09T12:21:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-09T12:21:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-09T12:21:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-09T12:21:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-09T12:21:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-09T12:21:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-09T12:21:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-09T12:21:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-09T12:21:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-09T12:21:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-09T12:21:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-09T12:21:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-09T12:21:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-09T12:21:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-09T12:21:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-09T12:21:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-09T12:21:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-09T12:21:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-09T12:21:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-09T12:21:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-09T12:21:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-09T12:21:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-09T12:21:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-09T12:21:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-09T12:21:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-09T12:21:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-09T12:21:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-09T12:21:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-09T12:21:14.610 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-09T12:21:14.610 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-09T12:21:14.610 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-09T12:21:14.610 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-09T12:21:14.610 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-09T12:21:14.610 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-09T12:21:14.610 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-09T12:21:14.610 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-09T12:21:14.611 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-09T12:21:14.611 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-09T12:21:14.611 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-09T12:21:14.611 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-09T12:21:14.611 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-09T12:21:14.611 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-09T12:21:14.611 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-09T12:21:14.611 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-09T12:21:14.612 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-09T12:21:14.612 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-09T12:21:14.612 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-09T12:21:14.612 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-09T12:21:14.612 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-09T12:21:14.612 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-09T12:21:14.612 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-09T12:21:14.612 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-09T12:21:14.613 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-09T12:21:14.613 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-09T12:21:14.613 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-09T12:21:14.613 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-09T12:21:14.613 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-09T12:21:14.613 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-09T12:21:14.613 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-09T12:21:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-09T12:21:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-09T12:21:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-09T12:21:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-09T12:21:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-09T12:21:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-09T12:21:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-09T12:21:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-09T12:21:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-09T12:21:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-09T12:21:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-09T12:21:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-09T12:21:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-09T12:21:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-09T12:21:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-09T12:21:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-09T12:21:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-09T12:21:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-09T12:21:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-09T12:21:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-09T12:21:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-09T12:21:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-09T12:21:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-09T12:21:14.616 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-09T12:21:14.617 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-09T12:21:14.617 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-09T12:21:14.617 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-09T12:21:14.617 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-09T12:21:14.617 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-09T12:21:14.617 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-09T12:21:14.617 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-09T12:21:14.618 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-09T12:21:14.618 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-09T12:21:14.618 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-09T12:21:14.618 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-09T12:21:14.618 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-09T12:21:14.618 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-09T12:21:14.618 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-09T12:21:14.618 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-09T12:21:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-09T12:21:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-09T12:21:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-09T12:21:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-09T12:21:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-09T12:21:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-09T12:21:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-09T12:21:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-09T12:21:14.620 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-09T12:21:14.620 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-09T12:21:14.620 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-09T12:21:14.620 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-09T12:21:14.620 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-09T12:21:14.620 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-09T12:21:14.620 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-09T12:21:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-09T12:21:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-09T12:21:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-09T12:21:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-09T12:21:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-09T12:21:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-09T12:21:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-09T12:21:14.621 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-09T12:21:14.622 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-09T12:21:14.622 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-09T12:21:14.622 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-09T12:21:14.622 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-09T12:21:14.622 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-09T12:21:14.622 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-09T12:21:14.622 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-09T12:21:14.622 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-09T12:21:14.623 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-09T12:21:14.623 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-09T12:21:14.623 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-09T12:21:14.623 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-09T12:21:14.623 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-09T12:21:14.623 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-09T12:21:14.623 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-09T12:21:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-09T12:21:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-09T12:21:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-09T12:21:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-09T12:21:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-09T12:21:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-09T12:21:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-09T12:21:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-09T12:21:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-09T12:21:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-09T12:21:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-09T12:21:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-09T12:21:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-09T12:21:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-09T12:21:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-09T12:21:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-09T12:21:14.626 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-09T12:21:14.626 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-09T12:21:14.626 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-09T12:21:14.626 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-09T12:21:14.626 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-09T12:21:14.626 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-09T12:21:14.626 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-09T12:21:14.626 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-09T12:21:14.627 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-09T12:21:14.627 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-09T12:21:14.627 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-09T12:21:14.627 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-09T12:21:14.627 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-09T12:21:14.627 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-09T12:21:14.627 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-09T12:21:14.628 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-09T12:21:14.628 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-09T12:21:14.628 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-09T12:21:14.628 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-09T12:21:14.628 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-09T12:21:14.628 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-09T12:21:14.628 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-09T12:21:14.628 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-09T12:21:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-09T12:21:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-09T12:21:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-09T12:21:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-09T12:21:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-09T12:21:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-09T12:21:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-09T12:21:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-09T12:21:14.630 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-09T12:21:14.631 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-09T12:21:14.631 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-09T12:21:14.631 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-09T12:21:14.631 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-09T12:21:14.631 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-09T12:21:14.631 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-09T12:21:14.631 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-09T12:21:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-09T12:21:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-09T12:21:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-09T12:21:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-09T12:21:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-09T12:21:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-09T12:21:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-09T12:21:14.633 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-09T12:21:14.633 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-09T12:21:14.633 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-09T12:21:14.633 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-09T12:21:14.633 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-09T12:21:14.633 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-09T12:21:14.633 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-09T12:21:14.633 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-09T12:21:14.634 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-09T12:21:14.634 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-09T12:21:14.634 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-09T12:21:14.634 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-09T12:21:14.634 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-09T12:21:14.634 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-09T12:21:14.634 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-09T12:21:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-09T12:21:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-09T12:21:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-09T12:21:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-09T12:21:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-09T12:21:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-09T12:21:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-09T12:21:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-09T12:21:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-09T12:21:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-09T12:21:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-09T12:21:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-09T12:21:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-09T12:21:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-09T12:21:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-09T12:21:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-09T12:21:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-09T12:21:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-09T12:21:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-09T12:21:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-09T12:21:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-09T12:21:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-09T12:21:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-09T12:21:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-09T12:21:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-09T12:21:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-09T12:21:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-09T12:21:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-09T12:21:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-09T12:21:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-09T12:21:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-09T12:21:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-09T12:21:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-09T12:21:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-09T12:21:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-09T12:21:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-09T12:21:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-09T12:21:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-09T12:21:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-09T12:21:14.640 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-09T12:21:14.640 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-09T12:21:14.640 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-09T12:21:14.640 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-09T12:21:14.640 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-09T12:21:14.640 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-09T12:21:14.640 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-09T12:21:14.641 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-09T12:21:14.641 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-09T12:21:14.641 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-09T12:21:14.641 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-09T12:21:14.641 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-09T12:21:14.641 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-09T12:21:14.641 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-09T12:21:14.641 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-09T12:21:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-09T12:21:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-09T12:21:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-09T12:21:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-09T12:21:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-09T12:21:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-09T12:21:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-09T12:21:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-09T12:21:14.643 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-09T12:21:14.643 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-09T12:21:14.643 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-09T12:21:14.643 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-09T12:21:14.643 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-09T12:21:14.643 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-09T12:21:14.643 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-09T12:21:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-09T12:21:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-09T12:21:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-09T12:21:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-09T12:21:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-09T12:21:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-09T12:21:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-09T12:21:14.644 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-09T12:21:14.645 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-09T12:21:14.645 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-09T12:21:14.645 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-09T12:21:14.645 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-09T12:21:14.645 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-09T12:21:14.645 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-09T12:21:14.645 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-09T12:21:14.645 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-09T12:21:14.646 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-09T12:21:14.646 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-09T12:21:14.646 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-09T12:21:14.646 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-09T12:21:14.646 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-09T12:21:14.646 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-09T12:21:14.646 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-09T12:21:14.647 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-09T12:21:14.647 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-09T12:21:14.647 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-09T12:21:14.647 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-09T12:21:14.647 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-09T12:21:14.647 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-09T12:21:14.647 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-09T12:21:14.647 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-09T12:21:14.648 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-09T12:21:14.648 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-09T12:21:14.648 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-09T12:21:14.648 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-09T12:21:14.648 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-09T12:21:14.648 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-09T12:21:14.648 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-09T12:21:14.648 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-09T12:21:14.649 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-09T12:21:14.649 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-09T12:21:14.649 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-09T12:21:14.649 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-09T12:21:14.649 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-09T12:21:14.649 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-09T12:21:14.649 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-09T12:21:14.650 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-09T12:21:14.650 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-09T12:21:14.650 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-09T12:21:14.650 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-09T12:21:14.650 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-09T12:21:14.650 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-09T12:21:14.650 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-09T12:21:14.650 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-09T12:21:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-09T12:21:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-09T12:21:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-09T12:21:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-09T12:21:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-09T12:21:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-09T12:21:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-09T12:21:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-09T12:21:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-09T12:21:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-09T12:21:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-09T12:21:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-09T12:21:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-09T12:21:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-09T12:21:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-09T12:21:14.653 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-09T12:21:14.653 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-09T12:21:14.653 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-09T12:21:14.653 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-09T12:21:14.653 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-09T12:21:14.653 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-09T12:21:14.653 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-09T12:21:14.653 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-09T12:21:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-09T12:21:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-09T12:21:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-09T12:21:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-09T12:21:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-09T12:21:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-09T12:21:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-09T12:21:14.654 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-09T12:21:14.655 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-09T12:21:14.655 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-09T12:21:14.655 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-09T12:21:14.655 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-09T12:21:14.655 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-09T12:21:14.655 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-09T12:21:14.655 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-09T12:21:14.656 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-09T12:21:14.656 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-09T12:21:14.656 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-09T12:21:14.656 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-09T12:21:14.656 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-09T12:21:14.656 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-09T12:21:14.656 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-09T12:21:14.656 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-09T12:21:14.657 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-09T12:21:14.657 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-09T12:21:14.657 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-09T12:21:14.657 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-09T12:21:14.657 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-09T12:21:14.657 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-09T12:21:14.657 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-09T12:21:14.657 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-09T12:21:14.658 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-09T12:21:14.658 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-09T12:21:14.658 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-09T12:21:14.658 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-09T12:21:14.658 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-09T12:21:14.658 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-09T12:21:14.658 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-09T12:21:14.659 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-09T12:21:14.659 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-09T12:21:14.659 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-09T12:21:14.659 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-09T12:21:14.659 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-09T12:21:14.659 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-09T12:21:14.659 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-09T12:21:14.659 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-09T12:21:14.660 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-09T12:21:14.660 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-09T12:21:14.660 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-09T12:21:14.660 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-09T12:21:14.660 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-09T12:21:14.660 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-09T12:21:14.660 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-09T12:21:14.660 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-09T12:21:14.661 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-09T12:21:14.661 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-09T12:21:14.661 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-09T12:21:14.661 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-09T12:21:14.661 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-09T12:21:14.661 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-09T12:21:14.661 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-09T12:21:14.662 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-09T12:21:14.662 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-09T12:21:14.662 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-09T12:21:14.662 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-09T12:21:14.662 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-09T12:21:14.662 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-09T12:21:14.662 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-09T12:21:14.662 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-09T12:21:14.663 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-09T12:21:14.663 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-09T12:21:14.663 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-09T12:21:14.663 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-09T12:21:14.663 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-09T12:21:14.663 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-09T12:21:14.663 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-09T12:21:14.664 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-09T12:21:14.664 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-09T12:21:14.664 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-09T12:21:14.664 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-09T12:21:14.664 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-09T12:21:14.664 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-09T12:21:14.664 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-09T12:21:14.664 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-09T12:21:14.665 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-09T12:21:14.665 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-09T12:21:14.665 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-09T12:21:14.665 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-09T12:21:14.665 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-09T12:21:14.665 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-09T12:21:14.665 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-09T12:21:14.665 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-09T12:21:14.666 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-09T12:21:14.666 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-09T12:21:14.666 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-09T12:21:14.666 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-09T12:21:14.666 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-09T12:21:14.666 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-09T12:21:14.666 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-09T12:21:14.667 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-09T12:21:14.667 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-09T12:21:14.667 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-09T12:21:14.667 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-09T12:21:14.667 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-09T12:21:14.667 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-09T12:21:14.667 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-09T12:21:14.667 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-09T12:21:14.668 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-09T12:21:14.668 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-09T12:21:14.668 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-09T12:21:14.668 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-09T12:21:14.668 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-09T12:21:14.668 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-09T12:21:14.668 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-09T12:21:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-09T12:21:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-09T12:21:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-09T12:21:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-09T12:21:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-09T12:21:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-09T12:21:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-09T12:21:14.669 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-09T12:21:14.670 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-09T12:21:14.670 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-09T12:21:14.670 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-09T12:21:14.670 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-09T12:21:14.670 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-09T12:21:14.670 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-09T12:21:14.670 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-09T12:21:14.670 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-09T12:21:14.671 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-09T12:21:14.671 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-09T12:21:14.671 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-09T12:21:14.671 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-09T12:21:14.671 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-09T12:21:14.671 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-09T12:21:14.671 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-09T12:21:14.672 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-09T12:21:14.672 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-09T12:21:14.672 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-09T12:21:14.672 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-09T12:21:14.672 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-09T12:21:14.672 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-09T12:21:14.672 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-09T12:21:14.672 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-09T12:21:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-09T12:21:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-09T12:21:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-09T12:21:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-09T12:21:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-09T12:21:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-09T12:21:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-09T12:21:14.673 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-09T12:21:14.674 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-09T12:21:14.674 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-09T12:21:14.674 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-09T12:21:14.674 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-09T12:21:14.674 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-09T12:21:14.674 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-09T12:21:14.674 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-09T12:21:14.674 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-09T12:21:14.675 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-09T12:21:14.675 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-09T12:21:14.675 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-09T12:21:14.675 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-09T12:21:14.675 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-09T12:21:14.675 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-09T12:21:14.675 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-09T12:21:14.676 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-09T12:21:14.676 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-09T12:21:14.676 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-09T12:21:14.676 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-09T12:21:14.676 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-09T12:21:14.676 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-09T12:21:14.676 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-09T12:21:14.676 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-09T12:21:14.677 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-09T12:21:14.677 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-09T12:21:14.677 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-09T12:21:14.677 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-09T12:21:14.677 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-09T12:21:14.677 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-09T12:21:14.677 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-09T12:21:14.677 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-09T12:21:14.678 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-09T12:21:14.678 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-09T12:21:14.678 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-09T12:21:14.678 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-09T12:21:14.678 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-09T12:21:14.678 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-09T12:21:14.678 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-09T12:21:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-09T12:21:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-09T12:21:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-09T12:21:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-09T12:21:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-09T12:21:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-09T12:21:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-09T12:21:14.679 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-09T12:21:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-09T12:21:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-09T12:21:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-09T12:21:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-09T12:21:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-09T12:21:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-09T12:21:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-09T12:21:14.680 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-09T12:21:14.681 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-09T12:21:14.681 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-09T12:21:14.681 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-09T12:21:14.681 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-09T12:21:14.681 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-09T12:21:14.681 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-09T12:21:14.681 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-09T12:21:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-09T12:21:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-09T12:21:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-09T12:21:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-09T12:21:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-09T12:21:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-09T12:21:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-09T12:21:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-09T12:21:14.683 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-09T12:21:14.683 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-09T12:21:14.683 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-09T12:21:14.683 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-09T12:21:14.683 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-09T12:21:14.683 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-09T12:21:14.683 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-09T12:21:14.683 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-09T12:21:14.684 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-09T12:21:14.684 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-09T12:21:14.684 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-09T12:21:14.684 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-09T12:21:14.684 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-09T12:21:14.684 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-09T12:21:14.684 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-09T12:21:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-09T12:21:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-09T12:21:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-09T12:21:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-09T12:21:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-09T12:21:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-09T12:21:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-09T12:21:14.685 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-09T12:21:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-09T12:21:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-09T12:21:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-09T12:21:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-09T12:21:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-09T12:21:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-09T12:21:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-09T12:21:14.686 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-09T12:21:14.687 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-09T12:21:14.687 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-09T12:21:14.687 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-09T12:21:14.687 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-09T12:21:14.687 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-09T12:21:14.687 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-09T12:21:14.687 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-09T12:21:14.687 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-09T12:21:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-09T12:21:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-09T12:21:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-09T12:21:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-09T12:21:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-09T12:21:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-09T12:21:14.688 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-09T12:21:14.689 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-09T12:21:14.689 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-09T12:21:14.689 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-09T12:21:14.689 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-09T12:21:14.689 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-09T12:21:14.689 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-09T12:21:14.689 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-09T12:21:14.689 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-09T12:21:14.690 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-09T12:21:14.690 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-09T12:21:14.690 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-09T12:21:14.690 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-09T12:21:14.690 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-09T12:21:14.690 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-09T12:21:14.690 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-09T12:21:14.690 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-09T12:21:14.691 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-09T12:21:14.691 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-09T12:21:14.691 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-09T12:21:14.691 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-09T12:21:14.691 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-09T12:21:14.691 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-09T12:21:14.691 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-09T12:21:14.691 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-09T12:21:14.692 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-09T12:21:14.692 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-09T12:21:14.692 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-09T12:21:14.692 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-09T12:21:14.692 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-09T12:21:14.692 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-09T12:21:14.692 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-09T12:21:14.693 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-09T12:21:14.693 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-09T12:21:14.693 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-09T12:21:14.693 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-09T12:21:14.693 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-09T12:21:14.693 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-09T12:21:14.693 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-09T12:21:14.693 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-09T12:21:14.694 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-09T12:21:14.694 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-09T12:21:14.694 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-09T12:21:14.694 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-09T12:21:14.694 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-09T12:21:14.694 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-09T12:21:14.694 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-09T12:21:14.695 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-09T12:21:14.695 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-09T12:21:14.695 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-09T12:21:14.695 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-09T12:21:14.695 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-09T12:21:14.695 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-09T12:21:14.695 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-09T12:21:14.695 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-09T12:21:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-09T12:21:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-09T12:21:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-09T12:21:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-09T12:21:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-09T12:21:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-09T12:21:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-09T12:21:14.696 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-09T12:21:14.697 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-09T12:21:14.697 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-09T12:21:14.697 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-09T12:21:14.697 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-09T12:21:14.697 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-09T12:21:14.697 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-09T12:21:14.697 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-09T12:21:14.698 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-09T12:21:14.698 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-09T12:21:14.698 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-09T12:21:14.698 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-09T12:21:14.698 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-09T12:21:14.698 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-09T12:21:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-09T12:21:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-09T12:21:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-09T12:21:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-09T12:21:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-09T12:21:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-09T12:21:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-09T12:21:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-09T12:21:14.700 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-09T12:21:14.700 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-09T12:21:14.700 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-09T12:21:14.700 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-09T12:21:14.700 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-09T12:21:14.700 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-09T12:21:14.700 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-09T12:21:14.701 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-09T12:21:14.701 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-09T12:21:14.701 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-09T12:21:14.701 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-09T12:21:14.701 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-09T12:21:14.701 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-09T12:21:14.701 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-09T12:21:14.701 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-09T12:21:14.702 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-09T12:21:14.702 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-09T12:21:14.702 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-09T12:21:14.702 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-09T12:21:14.702 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-09T12:21:14.702 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-09T12:21:14.702 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-09T12:21:14.703 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-09T12:21:14.703 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-09T12:21:14.703 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-09T12:21:14.703 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-09T12:21:14.703 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-09T12:21:14.703 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-09T12:21:14.703 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-09T12:21:14.703 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-09T12:21:14.704 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-09T12:21:14.704 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-09T12:21:14.704 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-09T12:21:14.704 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-09T12:21:14.704 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-09T12:21:14.704 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-09T12:21:14.704 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-09T12:21:14.704 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-09T12:21:14.705 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-09T12:21:14.705 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-09T12:21:14.705 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-09T12:21:14.705 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-09T12:21:14.705 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-09T12:21:14.705 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-09T12:21:14.705 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-09T12:21:14.706 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-09T12:21:14.706 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-09T12:21:14.706 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-09T12:21:14.706 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-09T12:21:14.706 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-09T12:21:14.706 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-09T12:21:14.706 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-09T12:21:14.706 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-09T12:21:14.707 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-09T12:21:14.707 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-09T12:21:14.707 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-09T12:21:14.707 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-09T12:21:14.707 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-09T12:21:14.707 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-09T12:21:14.707 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-09T12:21:14.708 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-09T12:21:14.708 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-09T12:21:14.708 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-09T12:21:14.708 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-09T12:21:14.708 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-09T12:21:14.708 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-09T12:21:14.708 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-09T12:21:14.708 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-09T12:21:14.709 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-09T12:21:14.709 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-09T12:21:14.709 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-09T12:21:14.709 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-09T12:21:14.709 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-09T12:21:14.709 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-09T12:21:14.709 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-09T12:21:14.709 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-09T12:21:14.710 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-09T12:21:14.710 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-09T12:21:14.710 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-09T12:21:14.710 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-09T12:21:14.710 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-09T12:21:14.710 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-09T12:21:14.710 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-09T12:21:14.710 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-09T12:21:14.711 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-09T12:21:14.711 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-09T12:21:14.711 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-09T12:21:14.711 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-09T12:21:14.711 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-09T12:21:14.711 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-09T12:21:14.711 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-09T12:21:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-09T12:21:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-09T12:21:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-09T12:21:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-09T12:21:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-09T12:21:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-09T12:21:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-09T12:21:14.712 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-09T12:21:14.713 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-09T12:21:14.713 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-09T12:21:14.713 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-09T12:21:14.713 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-09T12:21:14.713 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-09T12:21:14.713 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-09T12:21:14.713 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-09T12:21:14.713 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-09T12:21:14.714 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-09T12:21:14.714 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-09T12:21:14.714 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-09T12:21:14.714 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-09T12:21:14.714 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-09T12:21:14.714 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-09T12:21:14.714 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-09T12:21:14.714 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-09T12:21:14.715 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-09T12:21:14.715 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-09T12:21:14.715 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-09T12:21:14.715 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-09T12:21:14.715 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-09T12:21:14.715 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-09T12:21:14.715 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-09T12:21:14.716 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-09T12:21:14.716 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-09T12:21:14.716 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-09T12:21:14.716 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-09T12:21:14.716 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-09T12:21:14.716 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-09T12:21:14.716 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-09T12:21:14.716 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-09T12:21:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-09T12:21:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-09T12:21:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-09T12:21:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-09T12:21:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-09T12:21:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-09T12:21:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-09T12:21:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-09T12:21:14.718 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-09T12:21:14.718 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-09T12:21:14.718 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-09T12:21:14.718 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-09T12:21:14.718 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-09T12:21:14.718 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-09T12:21:14.718 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-09T12:21:14.718 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-09T12:21:14.719 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-09T12:21:14.719 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-09T12:21:14.719 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-09T12:21:14.719 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-09T12:21:14.719 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-09T12:21:14.719 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-09T12:21:14.719 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-09T12:21:14.719 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-09T12:21:14.720 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-09T12:21:14.720 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-09T12:21:14.720 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-09T12:21:14.720 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-09T12:21:14.720 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-09T12:21:14.720 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-09T12:21:14.720 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-09T12:21:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-09T12:21:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-09T12:21:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-09T12:21:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-09T12:21:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-09T12:21:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-09T12:21:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-09T12:21:14.721 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-09T12:21:14.722 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-09T12:21:14.722 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-09T12:21:14.722 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-09T12:21:14.722 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-09T12:21:14.722 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-09T12:21:14.722 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-09T12:21:14.722 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-09T12:21:14.722 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-09T12:21:14.723 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-09T12:21:14.723 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-09T12:21:14.723 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-09T12:21:14.723 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-09T12:21:14.723 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-09T12:21:14.723 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-09T12:21:14.723 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-09T12:21:14.723 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-09T12:21:14.724 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-09T12:21:14.724 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-09T12:21:14.724 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-09T12:21:14.724 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-09T12:21:14.724 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-09T12:21:14.724 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-09T12:21:14.724 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-09T12:21:14.725 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-09T12:21:14.725 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-09T12:21:14.725 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-09T12:21:14.725 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-09T12:21:14.725 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-09T12:21:14.725 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-09T12:21:14.725 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-09T12:21:14.725 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-09T12:21:14.726 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-09T12:21:14.726 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-09T12:21:14.726 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-09T12:21:14.726 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-09T12:21:14.726 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-09T12:21:14.726 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-09T12:21:14.726 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-09T12:21:14.726 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-09T12:21:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-09T12:21:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-09T12:21:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-09T12:21:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-09T12:21:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-09T12:21:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-09T12:21:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-09T12:21:14.727 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-09T12:21:14.728 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-09T12:21:14.728 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-09T12:21:14.728 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-09T12:21:14.728 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-09T12:21:14.728 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-09T12:21:14.728 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-09T12:21:14.728 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-09T12:21:14.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-09T12:21:14.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-09T12:21:14.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-09T12:21:14.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-09T12:21:14.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-09T12:21:14.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-09T12:21:14.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-09T12:21:14.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-09T12:21:14.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-09T12:21:14.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-09T12:21:14.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-09T12:21:14.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-09T12:21:14.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-09T12:21:14.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-09T12:21:14.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-09T12:21:14.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-09T12:21:14.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-09T12:21:14.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-09T12:21:14.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-09T12:21:14.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-09T12:21:14.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-09T12:21:14.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-09T12:21:14.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-09T12:21:14.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-09T12:21:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-09T12:21:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-09T12:21:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-09T12:21:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-09T12:21:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-09T12:21:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-09T12:21:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-09T12:21:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-09T12:21:14.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-09T12:21:14.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-09T12:21:14.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-09T12:21:14.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-09T12:21:14.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-09T12:21:14.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-09T12:21:14.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-09T12:21:14.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-09T12:21:14.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-09T12:21:14.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-09T12:21:14.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-09T12:21:14.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-09T12:21:14.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-09T12:21:14.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-09T12:21:14.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-09T12:21:14.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-09T12:21:14.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-09T12:21:14.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-09T12:21:14.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-09T12:21:14.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-09T12:21:14.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-09T12:21:14.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-09T12:21:14.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-09T12:21:14.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-09T12:21:14.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-09T12:21:14.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-09T12:21:14.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-09T12:21:14.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-09T12:21:14.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-09T12:21:14.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-09T12:21:14.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-09T12:21:14.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-09T12:21:14.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-09T12:21:14.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-09T12:21:14.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-09T12:21:14.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-09T12:21:14.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-09T12:21:14.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-09T12:21:14.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-09T12:21:14.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-09T12:21:14.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-09T12:21:14.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-09T12:21:14.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-09T12:21:14.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-09T12:21:14.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-09T12:21:14.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-09T12:21:14.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-09T12:21:14.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-09T12:21:14.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-09T12:21:14.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-09T12:21:14.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-09T12:21:14.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-09T12:21:14.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-09T12:21:14.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-09T12:21:14.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-09T12:21:14.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-09T12:21:14.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-09T12:21:14.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-09T12:21:14.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-09T12:21:14.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-09T12:21:14.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-09T12:21:14.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-09T12:21:14.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-09T12:21:14.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-09T12:21:14.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-09T12:21:14.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-09T12:21:14.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-09T12:21:14.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-09T12:21:14.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-09T12:21:14.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-09T12:21:14.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-09T12:21:14.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-09T12:21:14.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-09T12:21:14.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-09T12:21:14.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-09T12:21:14.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-09T12:21:14.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-09T12:21:14.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-09T12:21:14.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-09T12:21:14.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-09T12:21:14.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-09T12:21:14.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-09T12:21:14.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-09T12:21:14.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-09T12:21:14.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-09T12:21:14.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-09T12:21:14.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-09T12:21:14.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-09T12:21:14.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-09T12:21:14.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-09T12:21:14.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-09T12:21:14.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-09T12:21:14.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-09T12:21:14.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-09T12:21:14.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-09T12:21:14.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-09T12:21:14.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-09T12:21:14.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-09T12:21:14.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-09T12:21:14.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-09T12:21:14.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-09T12:21:14.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-09T12:21:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-09T12:21:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-09T12:21:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-09T12:21:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-09T12:21:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-09T12:21:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-09T12:21:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-09T12:21:14.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-09T12:21:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-09T12:21:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-09T12:21:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-09T12:21:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-09T12:21:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-09T12:21:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-09T12:21:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-09T12:21:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-09T12:21:14.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-09T12:21:14.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-09T12:21:14.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-09T12:21:14.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-09T12:21:14.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-09T12:21:14.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-09T12:21:14.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-09T12:21:14.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-09T12:21:14.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-09T12:21:14.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-09T12:21:14.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-09T12:21:14.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-09T12:21:14.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-09T12:21:14.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-09T12:21:14.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-09T12:21:14.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-09T12:21:14.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-09T12:21:14.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-09T12:21:14.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-09T12:21:14.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-09T12:21:14.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-09T12:21:14.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-09T12:21:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-09T12:21:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-09T12:21:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-09T12:21:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-09T12:21:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-09T12:21:14.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-09T12:21:14.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-09T12:21:14.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-09T12:21:14.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-09T12:21:14.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-09T12:21:14.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-09T12:21:14.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-09T12:21:14.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-09T12:21:14.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-09T12:21:14.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-09T12:21:14.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-09T12:21:14.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-09T12:21:14.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-09T12:21:14.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-09T12:21:14.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-09T12:21:14.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-09T12:21:14.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-09T12:21:14.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-09T12:21:14.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-09T12:21:14.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-09T12:21:14.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-09T12:21:14.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-09T12:21:14.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-09T12:21:14.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-09T12:21:14.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-09T12:21:14.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-09T12:21:14.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-09T12:21:14.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-09T12:21:14.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-09T12:21:14.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-09T12:21:14.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-09T12:21:14.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-09T12:21:14.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-09T12:21:14.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-09T12:21:14.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-09T12:21:14.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-09T12:21:14.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-09T12:21:14.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-09T12:21:14.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-09T12:21:14.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-09T12:21:14.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-09T12:21:14.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-09T12:21:14.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-09T12:21:14.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-09T12:21:14.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-09T12:21:14.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-09T12:21:14.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-09T12:21:14.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-09T12:21:14.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-09T12:21:14.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-09T12:21:14.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-09T12:21:14.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-09T12:21:14.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-09T12:21:14.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-09T12:21:14.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-09T12:21:14.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-09T12:21:14.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-09T12:21:14.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-09T12:21:14.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-09T12:21:14.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-09T12:21:14.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-09T12:21:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-09T12:21:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-09T12:21:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-09T12:21:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-09T12:21:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-09T12:21:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-09T12:21:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-09T12:21:14.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-09T12:21:14.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-09T12:21:14.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-09T12:21:14.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-09T12:21:14.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-09T12:21:14.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-09T12:21:14.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-09T12:21:14.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-09T12:21:14.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-09T12:21:14.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-09T12:21:14.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-09T12:21:14.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-09T12:21:14.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-09T12:21:14.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-09T12:21:14.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-09T12:21:14.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-09T12:21:14.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-09T12:21:14.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-09T12:21:14.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-09T12:21:14.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-09T12:21:14.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-09T12:21:14.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-09T12:21:14.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-09T12:21:14.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-09T12:21:14.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-09T12:21:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-09T12:21:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-09T12:21:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-09T12:21:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-09T12:21:14.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-09T12:21:14.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-09T12:21:14.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-09T12:21:14.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-09T12:21:14.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-09T12:21:14.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-09T12:21:14.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-09T12:21:14.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-09T12:21:14.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-09T12:21:14.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-09T12:21:14.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-09T12:21:14.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-09T12:21:14.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-09T12:21:14.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-09T12:21:14.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-09T12:21:14.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-09T12:21:14.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-09T12:21:14.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-09T12:21:14.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-09T12:21:14.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-09T12:21:14.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-09T12:21:14.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-09T12:21:14.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-09T12:21:14.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-09T12:21:14.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-09T12:21:14.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-09T12:21:14.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-09T12:21:14.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-09T12:21:14.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-09T12:21:14.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-09T12:21:14.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-09T12:21:14.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-09T12:21:14.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-09T12:21:14.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-09T12:21:14.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-09T12:21:14.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-09T12:21:14.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-09T12:21:14.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-09T12:21:14.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-09T12:21:14.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-09T12:21:14.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-09T12:21:14.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-09T12:21:14.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-09T12:21:14.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-09T12:21:14.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-09T12:21:14.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-09T12:21:14.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-09T12:21:14.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-09T12:21:14.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-09T12:21:14.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-09T12:21:14.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-09T12:21:14.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-09T12:21:14.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-09T12:21:14.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-09T12:21:14.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-09T12:21:14.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-09T12:21:14.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-09T12:21:14.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-09T12:21:14.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-09T12:21:14.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-09T12:21:14.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-09T12:21:14.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-09T12:21:14.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-09T12:21:14.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-09T12:21:14.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-09T12:21:14.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-09T12:21:14.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-09T12:21:14.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-09T12:21:14.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-09T12:21:14.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-09T12:21:14.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-09T12:21:14.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-09T12:21:14.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-09T12:21:14.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-09T12:21:14.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-09T12:21:14.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-09T12:21:14.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-09T12:21:14.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-09T12:21:14.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-09T12:21:14.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-09T12:21:14.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-09T12:21:14.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-09T12:21:14.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-09T12:21:14.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-09T12:21:14.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-09T12:21:14.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-09T12:21:14.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-09T12:21:14.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-09T12:21:14.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-09T12:21:14.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-09T12:21:14.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-09T12:21:14.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-09T12:21:14.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-09T12:21:14.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-09T12:21:14.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-09T12:21:14.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-09T12:21:14.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-09T12:21:14.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-09T12:21:14.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-09T12:21:14.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-09T12:21:14.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-09T12:21:14.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-09T12:21:14.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-09T12:21:14.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-09T12:21:14.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-09T12:21:14.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-09T12:21:14.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-09T12:21:14.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-09T12:21:14.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-09T12:21:14.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-09T12:21:14.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-09T12:21:14.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-09T12:21:14.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-09T12:21:14.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-09T12:21:14.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-09T12:21:14.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-09T12:21:14.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-09T12:21:14.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-09T12:21:14.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-09T12:21:14.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-09T12:21:14.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-09T12:21:14.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-09T12:21:14.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-09T12:21:14.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-09T12:21:14.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-09T12:21:14.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-09T12:21:14.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-09T12:21:14.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-09T12:21:14.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-09T12:21:14.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-09T12:21:14.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-09T12:21:14.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-09T12:21:14.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-09T12:21:14.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-09T12:21:14.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-09T12:21:14.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-09T12:21:14.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-09T12:21:14.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-09T12:21:14.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-09T12:21:14.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-09T12:21:14.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-09T12:21:14.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-09T12:21:14.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-09T12:21:14.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-09T12:21:14.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-09T12:21:14.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-09T12:21:14.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-09T12:21:14.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-09T12:21:14.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-09T12:21:14.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-09T12:21:14.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-09T12:21:14.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-09T12:21:14.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-09T12:21:14.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-09T12:21:14.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-09T12:21:14.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-09T12:21:14.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-09T12:21:14.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-09T12:21:14.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-09T12:21:14.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-09T12:21:14.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-09T12:21:14.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-09T12:21:14.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-09T12:21:14.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-09T12:21:14.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-09T12:21:14.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-09T12:21:14.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-09T12:21:14.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-09T12:21:14.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-09T12:21:14.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-09T12:21:14.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-09T12:21:14.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-09T12:21:14.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-09T12:21:14.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-09T12:21:14.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-09T12:21:14.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-09T12:21:14.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-09T12:21:14.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-09T12:21:14.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-09T12:21:14.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-09T12:21:14.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-09T12:21:14.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-09T12:21:14.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-09T12:21:14.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-09T12:21:14.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-09T12:21:14.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-09T12:21:14.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-09T12:21:14.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-09T12:21:14.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-09T12:21:14.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-09T12:21:14.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-09T12:21:14.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-09T12:21:14.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-09T12:21:14.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-09T12:21:14.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-09T12:21:14.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-09T12:21:14.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-09T12:21:14.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-09T12:21:14.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-09T12:21:14.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-09T12:21:14.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-09T12:21:14.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-09T12:21:14.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-09T12:21:14.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-09T12:21:14.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-09T12:21:14.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-09T12:21:14.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-09T12:21:14.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-09T12:21:14.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-09T12:21:14.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-09T12:21:14.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-09T12:21:14.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-09T12:21:14.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-09T12:21:14.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-09T12:21:14.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-09T12:21:14.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-09T12:21:14.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-09T12:21:14.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-09T12:21:14.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-09T12:21:14.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-09T12:21:14.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-09T12:21:14.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-09T12:21:14.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-09T12:21:14.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-09T12:21:14.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-09T12:21:14.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-09T12:21:14.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-09T12:21:14.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-09T12:21:14.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-09T12:21:14.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-09T12:21:14.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-09T12:21:14.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-09T12:21:14.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-09T12:21:14.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-09T12:21:14.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-09T12:21:14.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-09T12:21:14.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-09T12:21:14.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-09T12:21:14.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-09T12:21:14.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-09T12:21:14.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-09T12:21:14.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-09T12:21:14.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-09T12:21:14.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-09T12:21:14.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-09T12:21:14.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-09T12:21:14.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-09T12:21:14.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-09T12:21:14.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-09T12:21:14.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-09T12:21:14.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-09T12:21:14.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-09T12:21:14.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-09T12:21:14.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-09T12:21:14.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-09T12:21:14.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-09T12:21:14.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-09T12:21:14.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-09T12:21:14.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-09T12:21:14.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-09T12:21:14.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-09T12:21:14.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-09T12:21:14.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-09T12:21:14.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-09T12:21:14.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-09T12:21:14.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-09T12:21:14.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-09T12:21:14.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-09T12:21:14.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-09T12:21:14.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-09T12:21:14.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-09T12:21:14.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-09T12:21:14.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-09T12:21:14.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-09T12:21:14.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-09T12:21:14.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-09T12:21:14.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-09T12:21:14.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-09T12:21:14.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-09T12:21:14.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-09T12:21:14.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-09T12:21:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-09T12:21:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-09T12:21:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-09T12:21:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-09T12:21:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-09T12:21:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-09T12:21:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-09T12:21:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-09T12:21:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-09T12:21:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-09T12:21:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-09T12:21:14.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-09T12:21:14.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-09T12:21:14.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-09T12:21:14.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-09T12:21:14.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-09T12:21:14.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-09T12:21:14.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-09T12:21:14.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-09T12:21:14.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-09T12:21:14.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-09T12:21:14.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-09T12:21:14.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-09T12:21:14.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-09T12:21:14.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-09T12:21:14.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-09T12:21:14.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-09T12:21:14.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-09T12:21:14.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-09T12:21:14.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-09T12:21:14.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-09T12:21:14.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-09T12:21:14.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-09T12:21:14.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-09T12:21:14.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-09T12:21:14.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-09T12:21:14.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-09T12:21:14.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-09T12:21:14.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-09T12:21:14.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-09T12:21:14.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-09T12:21:14.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-09T12:21:14.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-09T12:21:14.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-09T12:21:14.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-09T12:21:14.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-09T12:21:14.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-09T12:21:14.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-09T12:21:14.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-09T12:21:14.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-09T12:21:14.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-09T12:21:14.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-09T12:21:14.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-09T12:21:14.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-09T12:21:14.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-09T12:21:14.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-09T12:21:14.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-09T12:21:14.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-09T12:21:14.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-09T12:21:14.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-09T12:21:14.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-09T12:21:14.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-09T12:21:14.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-09T12:21:14.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-09T12:21:14.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-09T12:21:14.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-09T12:21:14.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-09T12:21:14.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-09T12:21:14.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-09T12:21:14.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-09T12:21:14.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-09T12:21:14.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-09T12:21:14.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-09T12:21:14.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-09T12:21:14.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-09T12:21:14.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-09T12:21:14.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-09T12:21:14.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-09T12:21:14.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-09T12:21:14.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-09T12:21:14.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-09T12:21:14.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-09T12:21:14.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-09T12:21:14.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-09T12:21:14.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-09T12:21:14.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-09T12:21:14.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-09T12:21:14.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-09T12:21:14.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-09T12:21:14.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-09T12:21:14.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.alias.bin 2023-08-09T12:21:14.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-09T12:21:14.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-09T12:21:14.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-09T12:21:14.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-09T12:21:14.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-09T12:21:14.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-09T12:21:14.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-09T12:21:14.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-09T12:21:14.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-09T12:21:14.842 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.843 DEBUG:teuthology.orchestra.run.smithi017:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-09T12:21:14.869 INFO:teuthology.orchestra.run.smithi017.stdout:postinstall scriptlet (using /bin/sh): 2023-08-09T12:21:14.869 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-09T12:21:14.869 INFO:teuthology.orchestra.run.smithi017.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-09T12:21:14.869 INFO:teuthology.orchestra.run.smithi017.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-09T12:21:14.870 INFO:teuthology.orchestra.run.smithi017.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.870 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-09T12:21:14.870 INFO:teuthology.orchestra.run.smithi017.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-09T12:21:14.870 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-08-09T12:21:14.870 INFO:teuthology.orchestra.run.smithi017.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-09T12:21:14.870 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-09T12:21:14.871 INFO:teuthology.orchestra.run.smithi017.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-09T12:21:14.871 INFO:teuthology.orchestra.run.smithi017.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-09T12:21:14.871 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.871 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-08-09T12:21:14.871 INFO:teuthology.orchestra.run.smithi017.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-09T12:21:14.871 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-09T12:21:14.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.872 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-08-09T12:21:14.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2023-08-09T12:21:14.970 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2023-08-09T12:21:14.970 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2023-08-09T12:21:14.970 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2023-08-09T12:21:14.970 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 53.el9 2023-08-09T12:21:14.971 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2023-08-09T12:21:14.971 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Mon 30 Jan 2023 10:38:40 AM UTC 2023-08-09T12:21:14.971 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2023-08-09T12:21:14.971 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8551923 2023-08-09T12:21:14.971 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2023-08-09T12:21:14.971 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Wed 18 Jan 2023 04:40:07 PM UTC, Key ID 05b555b38483c65d 2023-08-09T12:21:14.971 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-53.el9.src.rpm 2023-08-09T12:21:14.971 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Fri 13 Jan 2023 09:07:28 PM UTC 2023-08-09T12:21:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-08-09T12:21:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2023-08-09T12:21:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2023-08-09T12:21:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-09T12:21:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2023-08-09T12:21:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2023-08-09T12:21:14.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:21:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-09T12:21:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-09T12:21:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-09T12:21:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2023-08-09T12:21:14.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:21:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2023-08-09T12:21:14.974 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-09T12:21:14.974 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:14.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-09T12:21:15.656 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2023-08-09T12:21:17.001 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-08-09T12:21:17.025 INFO:teuthology.orchestra.run.smithi017.stderr:done 2023-08-09T12:21:17.036 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-08-09T12:21:17.086 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.BHx6vmPlkD 2023-08-09T12:21:17.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BHx6vmPlkD 2023-08-09T12:21:17.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.BHx6vmPlkD 2023-08-09T12:21:17.267 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.BHx6vmPlkD is 6KB 2023-08-09T12:21:17.315 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.BHx6vmPlkD 2023-08-09T12:21:17.330 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2023-08-09T12:21:17.413 INFO:teuthology.orchestra.run.smithi017.stdout:e13cba1d25f14c51a1d04da8db823a4e-0-rescue.conf 2023-08-09T12:21:17.413 INFO:teuthology.orchestra.run.smithi017.stdout:e13cba1d25f14c51a1d04da8db823a4e-5.14.0-239.el9.x86_64.conf 2023-08-09T12:21:17.414 INFO:teuthology.orchestra.run.smithi017.stdout:e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc4-ga7fb1265323d.conf 2023-08-09T12:21:17.415 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc4-ga7fb1265323d 2023-08-09T12:21:17.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2023-08-09T12:21:37.972 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-08-09T12:21:37.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-08-09T12:21:37.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T12:21:47.585 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-09T12:21:47.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-08-09T12:21:47.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T12:22:38.024 DEBUG:teuthology.orchestra.remote:timed out 2023-08-09T12:22:47.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-08-09T12:22:47.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T12:22:47.588 DEBUG:teuthology.orchestra.remote:timed out 2023-08-09T12:22:48.310 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-08-09T12:22:49.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-08-09T12:22:49.007 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-09T12:22:49.008 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-08-09T12:22:49.046 INFO:teuthology.orchestra.run.smithi142.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-09T12:22:49.047 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:22:49.047 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-09T12:22:49.047 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-09T12:22:50.048 DEBUG:teuthology.parallel:result is None 2023-08-09T12:22:56.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-08-09T12:22:56.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T12:23:04.120 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-08-09T12:23:04.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-08-09T12:23:04.742 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-09T12:23:04.742 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-08-09T12:23:04.784 INFO:teuthology.orchestra.run.smithi017.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-09T12:23:04.785 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-09T12:23:04.785 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-09T12:23:04.785 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-09T12:23:05.786 DEBUG:teuthology.parallel:result is None 2023-08-09T12:23:05.787 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-09T12:23:05.795 INFO:teuthology.task.internal:Creating test directory... 2023-08-09T12:23:05.795 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-09T12:23:05.802 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-09T12:23:05.861 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-09T12:23:05.872 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-09T12:23:05.899 INFO:teuthology.task.internal:Creating archive directory... 2023-08-09T12:23:05.900 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-09T12:23:05.905 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-09T12:23:05.989 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-09T12:23:05.999 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-09T12:23:05.999 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-09T12:23:06.005 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-09T12:23:06.139 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-09T12:23:06.171 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-09T12:23:06.185 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-09T12:23:06.225 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-09T12:23:06.229 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-09T12:23:06.239 INFO:teuthology.task.internal:Configuring sudo... 2023-08-09T12:23:06.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-09T12:23:06.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-09T12:23:06.326 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-09T12:23:06.340 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-09T12:23:06.340 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-09T12:23:06.345 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-09T12:23:06.401 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-09T12:23:06.476 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-09T12:23:06.566 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-09T12:23:06.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-09T12:23:06.731 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:23:06.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-09T12:23:06.808 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-09T12:23:06.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-09T12:23:06.973 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-09T12:23:07.041 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-09T12:23:07.140 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:23:07.140 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-09T12:23:07.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2023-08-09T12:23:07.223 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2023-08-09T12:23:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-09T12:23:07.622 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-09T12:23:08.134 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-09T12:23:08.142 INFO:teuthology.task.internal:Starting timer... 2023-08-09T12:23:08.143 INFO:teuthology.run_tasks:Running task pcp... 2023-08-09T12:23:08.178 INFO:teuthology.run_tasks:Running task selinux... 2023-08-09T12:23:08.210 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2023-08-09T12:23:08.328 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2023-08-09T12:23:08.331 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2023-08-09T12:23:08.452 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2023-08-09T12:23:08.456 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-09T12:23:08.456 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2023-08-09T12:23:08.527 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2023-08-09T12:23:08.528 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2023-08-09T12:23:08.588 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2023-08-09T12:23:08.588 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2023-08-09T12:23:08.589 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-09T12:23:08.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:23:08.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-09T12:23:08.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:23:08.759 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-09T12:23:08.760 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2023-08-09T12:23:08.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2023-08-09T12:23:08.945 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-09T12:23:08.956 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-09T12:23:08.963 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-09T12:23:09.131 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-09T12:23:09.151 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-09T12:23:09.153 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-09T12:34:23.290 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2023-08-09T12:34:23.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-08-09T12:34:23.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T12:34:23.443 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-08-09T12:34:23.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-08-09T12:34:23.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-08-09T12:34:23.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-09T12:34:23.730 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-08-09T12:34:23.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-08-09T12:34:23.887 INFO:teuthology.run_tasks:Running task clock... 2023-08-09T12:34:23.898 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-09T12:34:23.899 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-09T12:34:23.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-09T12:34:23.909 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-09T12:34:23.909 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-09T12:34:24.013 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-09T12:34:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-09T12:34:24.066 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-09T12:34:24.075 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-09T12:34:24.158 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2023-08-09T12:34:24.178 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2023-08-09T12:34:24.198 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2023-08-09T12:34:24.225 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2023-08-09T12:34:24.249 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-09T12:34:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-09T12:34:24.302 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-09T12:34:24.339 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-09T12:34:24.419 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2023-08-09T12:34:24.428 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-09T12:34:24.429 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-08-09T12:34:24.429 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:34:24.429 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:34:24.429 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:34:24.430 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:34:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2023-08-09T12:34:24.480 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-09T12:34:24.480 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-08-09T12:34:24.481 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:34:24.481 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:34:24.481 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:34:24.481 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:34:24.482 INFO:teuthology.run_tasks:Running task install... 2023-08-09T12:34:24.492 DEBUG:teuthology.task.install:project ceph 2023-08-09T12:34:24.492 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}} 2023-08-09T12:34:24.493 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'} 2023-08-09T12:34:24.493 INFO:teuthology.task.install:Using flavor: default 2023-08-09T12:34:24.498 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-09T12:34:24.499 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-09T12:34:24.499 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85', 'tag': None, 'wait_for_package': False} 2023-08-09T12:34:24.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T12:34:24.502 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85', 'tag': None, 'wait_for_package': False} 2023-08-09T12:34:24.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T12:34:24.642 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/9/flavors/default/ 2023-08-09T12:34:24.643 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5389.g668a86f2 2023-08-09T12:34:24.722 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/9/flavors/default/ 2023-08-09T12:34:24.723 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5389.g668a86f2 2023-08-09T12:34:24.829 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-09T12:34:24.829 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:34:24.830 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-09T12:34:24.910 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230809.035933/668a86f232c9454b2ce5928d1432a29a72964d85/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-09T12:34:24.911 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:34:24.911 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-09T12:34:24.930 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-09T12:34:24.931 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/668a86f232c9454b2ce5928d1432a29a72964d85/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-09T12:34:25.021 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-09T12:34:25.021 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/668a86f232c9454b2ce5928d1432a29a72964d85/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-09T12:34:25.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-09T12:34:25.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-09T12:34:25.205 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-09T12:34:25.297 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2023-08-09T12:34:25.301 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2023-08-09T12:34:25.319 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-09T12:34:25.417 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2023-08-09T12:34:25.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2023-08-09T12:34:25.670 INFO:teuthology.orchestra.run.smithi142.stdout:72 files removed 2023-08-09T12:34:25.708 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-09T12:34:25.815 INFO:teuthology.orchestra.run.smithi017.stdout:72 files removed 2023-08-09T12:34:25.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-09T12:34:26.654 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 154 kB/s | 78 kB 00:00 2023-08-09T12:34:26.853 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 144 kB/s | 78 kB 00:00 2023-08-09T12:34:27.188 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 21 kB/s | 9.5 kB 00:00 2023-08-09T12:34:27.445 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 19 kB/s | 9.5 kB 00:00 2023-08-09T12:34:27.739 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-08-09T12:34:27.997 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-08-09T12:34:28.392 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-08-09T12:34:28.832 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 8.1 MB/s | 6.3 MB 00:00 2023-08-09T12:34:30.035 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2023-08-09T12:34:30.425 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2023-08-09T12:34:32.583 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 7.8 MB 00:01 2023-08-09T12:34:34.747 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 7.8 MB 00:04 2023-08-09T12:34:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 18 MB 00:02 2023-08-09T12:34:41.004 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.6 MB 00:01 2023-08-09T12:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 14 kB 00:00 2023-08-09T12:34:44.192 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 17 MB/s | 18 MB 00:01 2023-08-09T12:34:44.572 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 2.0 MB/s | 18 MB 00:08 2023-08-09T12:34:49.820 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 5.6 MB 00:01 2023-08-09T12:34:51.591 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 14 kB 00:00 2023-08-09T12:34:51.663 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-09T12:34:51.664 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-09T12:34:51.684 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.41.8-1.el9.x86_64 is already installed. 2023-08-09T12:34:51.685 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.0.0-2.el9.x86_64 is already installed. 2023-08-09T12:34:51.687 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-9.el9.x86_64 is already installed. 2023-08-09T12:34:51.688 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-08-09T12:34:51.691 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-08-09T12:34:51.694 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.10-1.el9.x86_64 is already installed. 2023-08-09T12:34:51.696 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-5.14.2-1.el9.x86_64 is already installed. 2023-08-09T12:34:51.785 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-08-09T12:34:51.809 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2023-08-09T12:34:51.809 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2023-08-09T12:34:51.810 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2023-08-09T12:34:51.810 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2023-08-09T12:34:51.810 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-08-09T12:34:51.810 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 6.5 k 2023-08-09T12:34:51.810 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 5.2 M 2023-08-09T12:34:51.810 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 849 k 2023-08-09T12:34:51.810 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 141 k 2023-08-09T12:34:51.811 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 1.5 M 2023-08-09T12:34:51.811 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 131 k 2023-08-09T12:34:51.811 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 1.7 M 2023-08-09T12:34:51.811 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 7.4 M 2023-08-09T12:34:51.811 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 47 k 2023-08-09T12:34:51.811 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 8.1 M 2023-08-09T12:34:51.812 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 40 M 2023-08-09T12:34:51.812 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 261 k 2023-08-09T12:34:51.812 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 218 k 2023-08-09T12:34:51.812 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 218 k 2023-08-09T12:34:51.812 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 18 k 2023-08-09T12:34:51.812 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 CentOS-AppStream 21 k 2023-08-09T12:34:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-08-09T12:34:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-08-09T12:34:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 31 k 2023-08-09T12:34:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 666 k 2023-08-09T12:34:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 126 k 2023-08-09T12:34:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-08-09T12:34:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-11.el9 CentOS-AppStream 24 k 2023-08-09T12:34:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-08-09T12:34:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-08-09T12:34:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-08-09T12:34:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-08-09T12:34:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 162 k 2023-08-09T12:34:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 320 k 2023-08-09T12:34:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 297 k 2023-08-09T12:34:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 99 k 2023-08-09T12:34:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 85 k 2023-08-09T12:34:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 3.0 M 2023-08-09T12:34:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 169 k 2023-08-09T12:34:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-08-09T12:34:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2023-08-09T12:34:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.43.90-1.el9 CentOS-BaseOS 2.2 M 2023-08-09T12:34:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.43.90-1.el9 CentOS-BaseOS 1.8 M 2023-08-09T12:34:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.43.90-1.el9 CentOS-BaseOS 41 k 2023-08-09T12:34:51.816 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.43.90-1.el9 CentOS-BaseOS 245 k 2023-08-09T12:34:51.816 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-debuginfod-client x86_64 0.189-3.el9 CentOS-BaseOS 36 k 2023-08-09T12:34:51.816 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf x86_64 0.189-3.el9 CentOS-BaseOS 192 k 2023-08-09T12:34:51.816 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libs x86_64 0.189-3.el9 CentOS-BaseOS 254 k 2023-08-09T12:34:51.816 INFO:teuthology.orchestra.run.smithi017.stdout: iproute x86_64 6.2.0-5.el9 CentOS-BaseOS 785 k 2023-08-09T12:34:51.816 INFO:teuthology.orchestra.run.smithi017.stdout: iproute-tc x86_64 6.2.0-5.el9 CentOS-BaseOS 448 k 2023-08-09T12:34:51.816 INFO:teuthology.orchestra.run.smithi017.stdout: libblkid x86_64 2.37.4-11.el9 CentOS-BaseOS 107 k 2023-08-09T12:34:51.817 INFO:teuthology.orchestra.run.smithi017.stdout: libfdisk x86_64 2.37.4-11.el9 CentOS-BaseOS 153 k 2023-08-09T12:34:51.817 INFO:teuthology.orchestra.run.smithi017.stdout: libmount x86_64 2.37.4-11.el9 CentOS-BaseOS 133 k 2023-08-09T12:34:51.817 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 3.3 M 2023-08-09T12:34:51.817 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 3.0 M 2023-08-09T12:34:51.817 INFO:teuthology.orchestra.run.smithi017.stdout: libsmartcols x86_64 2.37.4-11.el9 CentOS-BaseOS 62 k 2023-08-09T12:34:51.817 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid x86_64 2.37.4-11.el9 CentOS-BaseOS 27 k 2023-08-09T12:34:51.817 INFO:teuthology.orchestra.run.smithi017.stdout: openssl x86_64 1:3.0.7-24.el9 CentOS-BaseOS 1.2 M 2023-08-09T12:34:51.817 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs x86_64 1:3.0.7-24.el9 CentOS-BaseOS 2.1 M 2023-08-09T12:34:51.818 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux x86_64 2.37.4-11.el9 CentOS-BaseOS 2.2 M 2023-08-09T12:34:51.818 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-core x86_64 2.37.4-11.el9 CentOS-BaseOS 432 k 2023-08-09T12:34:51.818 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-user x86_64 2.37.4-11.el9 CentOS-BaseOS 30 k 2023-08-09T12:34:51.818 INFO:teuthology.orchestra.run.smithi017.stdout: xfsdump x86_64 3.1.12-3.el9 CentOS-BaseOS 321 k 2023-08-09T12:34:51.818 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs x86_64 5.19.0-4.el9 baseos 1.0 M 2023-08-09T12:34:51.818 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2023-08-09T12:34:51.818 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-08-09T12:34:51.818 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-08-09T12:34:51.819 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 19 M 2023-08-09T12:34:51.819 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 23 k 2023-08-09T12:34:51.819 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 2.1 M 2023-08-09T12:34:51.819 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 242 k 2023-08-09T12:34:51.819 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 4.4 M 2023-08-09T12:34:51.819 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 18 M 2023-08-09T12:34:51.819 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 15 k 2023-08-09T12:34:51.819 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 24 k 2023-08-09T12:34:51.820 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-08-09T12:34:51.820 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-08-09T12:34:51.820 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-08-09T12:34:51.820 INFO:teuthology.orchestra.run.smithi017.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-08-09T12:34:51.820 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-08-09T12:34:51.820 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-08-09T12:34:51.820 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.6-15.el9 CentOS-AppStream 186 k 2023-08-09T12:34:51.821 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-08-09T12:34:51.821 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-08-09T12:34:51.821 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 164 k 2023-08-09T12:34:51.821 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.4.1-2.1.el9 CentOS-BaseOS 807 k 2023-08-09T12:34:51.821 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-08-09T12:34:51.821 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-08-09T12:34:51.821 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.4.1-2.1.el9 CentOS-BaseOS 197 k 2023-08-09T12:34:51.821 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-08-09T12:34:51.822 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 473 k 2023-08-09T12:34:51.822 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-08-09T12:34:51.822 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 4.7 M 2023-08-09T12:34:51.822 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-08-09T12:34:51.822 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-08-09T12:34:51.822 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-08-09T12:34:51.822 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-08-09T12:34:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-08-09T12:34:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-08-09T12:34:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-08-09T12:34:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-08-09T12:34:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-08-09T12:34:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-08-09T12:34:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-08-09T12:34:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-08-09T12:34:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 45 k 2023-08-09T12:34:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 125 k 2023-08-09T12:34:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-08-09T12:34:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-08-09T12:34:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-08-09T12:34:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-08-09T12:34:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-08-09T12:34:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.16-1.el9 appstream 247 k 2023-08-09T12:34:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-08-09T12:34:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-08-09T12:34:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-08-09T12:34:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-08-09T12:34:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-08-09T12:34:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-08-09T12:34:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-08-09T12:34:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-08-09T12:34:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-08-09T12:34:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-08-09T12:34:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-08-09T12:34:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-08-09T12:34:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-08-09T12:34:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-08-09T12:34:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-08-09T12:34:51.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-08-09T12:34:51.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-08-09T12:34:51.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-08-09T12:34:51.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-08-09T12:34:51.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-08-09T12:34:51.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-08-09T12:34:51.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-08-09T12:34:51.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-08-09T12:34:51.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-08-09T12:34:51.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-08-09T12:34:51.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-08-09T12:34:51.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-08-09T12:34:51.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-08-09T12:34:51.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-08-09T12:34:51.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-08-09T12:34:51.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-08-09T12:34:51.829 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-08-09T12:34:51.829 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-08-09T12:34:51.829 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-08-09T12:34:51.829 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-08-09T12:34:51.829 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-08-09T12:34:51.829 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-08-09T12:34:51.829 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-08-09T12:34:51.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-08-09T12:34:51.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-08-09T12:34:51.830 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-2.el9 epel 192 k 2023-08-09T12:34:51.830 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-08-09T12:34:51.830 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-08-09T12:34:51.830 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-08-09T12:34:51.830 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-08-09T12:34:51.830 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-36.el9 appstream 45 k 2023-08-09T12:34:51.831 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2023-08-09T12:34:51.831 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-08-09T12:34:51.831 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:34:51.831 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-08-09T12:34:51.831 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2023-08-09T12:34:51.831 INFO:teuthology.orchestra.run.smithi017.stdout:Install 131 Packages 2023-08-09T12:34:51.831 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 23 Packages 2023-08-09T12:34:51.831 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:34:51.832 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 205 M 2023-08-09T12:34:51.832 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2023-08-09T12:34:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:(1/154): ceph-18.0.0-5389.g668a86f2.el9.x86_64. 25 kB/s | 6.5 kB 00:00 2023-08-09T12:34:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:(2/154): ceph-fuse-18.0.0-5389.g668a86f2.el9.x8 3.6 MB/s | 849 kB 00:00 2023-08-09T12:34:53.038 INFO:teuthology.orchestra.run.smithi017.stdout:(3/154): ceph-immutable-object-cache-18.0.0-538 1.3 MB/s | 141 kB 00:00 2023-08-09T12:34:53.211 INFO:teuthology.orchestra.run.smithi017.stdout:(4/154): ceph-base-18.0.0-5389.g668a86f2.el9.x8 6.6 MB/s | 5.2 MB 00:00 2023-08-09T12:34:53.362 INFO:teuthology.orchestra.run.smithi017.stdout:(5/154): ceph-mds-18.0.0-5389.g668a86f2.el9.x86 6.5 MB/s | 2.1 MB 00:00 2023-08-09T12:34:53.445 INFO:teuthology.orchestra.run.smithi017.stdout:(6/154): ceph-mgr-18.0.0-5389.g668a86f2.el9.x86 6.3 MB/s | 1.5 MB 00:00 2023-08-09T12:34:53.812 INFO:teuthology.orchestra.run.smithi017.stdout:(7/154): ceph-mon-18.0.0-5389.g668a86f2.el9.x86 9.7 MB/s | 4.4 MB 00:00 2023-08-09T12:34:53.956 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 18 MB 00:02 2023-08-09T12:34:54.354 INFO:teuthology.orchestra.run.smithi017.stdout:(8/154): ceph-common-18.0.0-5389.g668a86f2.el9. 9.8 MB/s | 19 MB 00:01 2023-08-09T12:34:54.404 INFO:teuthology.orchestra.run.smithi017.stdout:(9/154): ceph-selinux-18.0.0-5389.g668a86f2.el9 495 kB/s | 24 kB 00:00 2023-08-09T12:34:54.621 INFO:teuthology.orchestra.run.smithi017.stdout:(10/154): ceph-radosgw-18.0.0-5389.g668a86f2.el 10 MB/s | 8.1 MB 00:00 2023-08-09T12:34:54.722 INFO:teuthology.orchestra.run.smithi017.stdout:(11/154): cephfs-mirror-18.0.0-5389.g668a86f2.e 2.2 MB/s | 218 kB 00:00 2023-08-09T12:34:54.797 INFO:teuthology.orchestra.run.smithi017.stdout:(12/154): libcephfs-devel-18.0.0-5389.g668a86f2 421 kB/s | 31 kB 00:00 2023-08-09T12:34:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:(13/154): libcephfs2-18.0.0-5389.g668a86f2.el9. 4.1 MB/s | 666 kB 00:00 2023-08-09T12:34:55.089 INFO:teuthology.orchestra.run.smithi017.stdout:(14/154): libcephsqlite-18.0.0-5389.g668a86f2.e 1.2 MB/s | 164 kB 00:00 2023-08-09T12:34:55.190 INFO:teuthology.orchestra.run.smithi017.stdout:(15/154): librados-devel-18.0.0-5389.g668a86f2. 1.2 MB/s | 126 kB 00:00 2023-08-09T12:34:55.315 INFO:teuthology.orchestra.run.smithi017.stdout:(16/154): libradosstriper1-18.0.0-5389.g668a86f 3.7 MB/s | 473 kB 00:00 2023-08-09T12:34:55.841 INFO:teuthology.orchestra.run.smithi017.stdout:(17/154): librgw2-18.0.0-5389.g668a86f2.el9.x86 8.9 MB/s | 4.7 MB 00:00 2023-08-09T12:34:56.107 INFO:teuthology.orchestra.run.smithi017.stdout:(18/154): ceph-osd-18.0.0-5389.g668a86f2.el9.x8 6.6 MB/s | 18 MB 00:02 2023-08-09T12:34:56.124 INFO:teuthology.orchestra.run.smithi017.stdout:(19/154): python3-ceph-argparse-18.0.0-5389.g66 160 kB/s | 45 kB 00:00 2023-08-09T12:34:56.174 INFO:teuthology.orchestra.run.smithi017.stdout:(20/154): python3-ceph-common-18.0.0-5389.g668a 1.9 MB/s | 125 kB 00:00 2023-08-09T12:34:56.250 INFO:teuthology.orchestra.run.smithi017.stdout:(21/154): python3-cephfs-18.0.0-5389.g668a86f2. 1.3 MB/s | 162 kB 00:00 2023-08-09T12:34:56.308 INFO:teuthology.orchestra.run.smithi017.stdout:(22/154): python3-rados-18.0.0-5389.g668a86f2.e 2.4 MB/s | 320 kB 00:00 2023-08-09T12:34:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:(23/154): python3-rbd-18.0.0-5389.g668a86f2.el9 2.6 MB/s | 297 kB 00:00 2023-08-09T12:34:56.411 INFO:teuthology.orchestra.run.smithi017.stdout:(24/154): python3-rgw-18.0.0-5389.g668a86f2.el9 982 kB/s | 99 kB 00:00 2023-08-09T12:34:56.453 INFO:teuthology.orchestra.run.smithi017.stdout:(25/154): rbd-fuse-18.0.0-5389.g668a86f2.el9.x8 938 kB/s | 85 kB 00:00 2023-08-09T12:34:56.520 INFO:teuthology.orchestra.run.smithi017.stdout:(26/154): rbd-nbd-18.0.0-5389.g668a86f2.el9.x86 2.5 MB/s | 169 kB 00:00 2023-08-09T12:34:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:(27/154): ceph-grafana-dashboards-18.0.0-5389.g 475 kB/s | 23 kB 00:00 2023-08-09T12:34:56.638 INFO:teuthology.orchestra.run.smithi017.stdout:(28/154): ceph-mgr-cephadm-18.0.0-5389.g668a86f 1.9 MB/s | 131 kB 00:00 2023-08-09T12:34:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:(29/154): rbd-mirror-18.0.0-5389.g668a86f2.el9. 8.0 MB/s | 3.0 MB 00:00 2023-08-09T12:34:56.930 INFO:teuthology.orchestra.run.smithi017.stdout:(30/154): ceph-mgr-dashboard-18.0.0-5389.g668a8 6.0 MB/s | 1.7 MB 00:00 2023-08-09T12:34:57.005 INFO:teuthology.orchestra.run.smithi017.stdout:(31/154): ceph-mgr-modules-core-18.0.0-5389.g66 3.2 MB/s | 242 kB 00:00 2023-08-09T12:34:57.064 INFO:teuthology.orchestra.run.smithi017.stdout:(32/154): ceph-mgr-rook-18.0.0-5389.g668a86f2.e 831 kB/s | 47 kB 00:00 2023-08-09T12:34:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:(33/154): ceph-prometheus-alerts-18.0.0-5389.g6 301 kB/s | 15 kB 00:00 2023-08-09T12:34:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:(34/154): ceph-volume-18.0.0-5389.g668a86f2.el9 3.5 MB/s | 261 kB 00:00 2023-08-09T12:34:57.264 INFO:teuthology.orchestra.run.smithi017.stdout:(35/154): cephadm-18.0.0-5389.g668a86f2.el9.noa 2.9 MB/s | 218 kB 00:00 2023-08-09T12:34:57.315 INFO:teuthology.orchestra.run.smithi017.stdout:(36/154): cephfs-top-18.0.0-5389.g668a86f2.el9. 371 kB/s | 18 kB 00:00 2023-08-09T12:34:57.849 INFO:teuthology.orchestra.run.smithi017.stdout:(37/154): ceph-test-18.0.0-5389.g668a86f2.el9.x 12 MB/s | 40 MB 00:03 2023-08-09T12:34:57.932 INFO:teuthology.orchestra.run.smithi017.stdout:(38/154): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 662 kB 00:00 2023-08-09T12:34:58.091 INFO:teuthology.orchestra.run.smithi017.stdout:(39/154): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-08-09T12:34:58.141 INFO:teuthology.orchestra.run.smithi017.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 920 kB 00:00 2023-08-09T12:34:58.174 INFO:teuthology.orchestra.run.smithi017.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 452 kB/s | 106 kB 00:00 2023-08-09T12:34:58.191 INFO:teuthology.orchestra.run.smithi017.stdout:(42/154): elfutils-libelf-devel-0.189-3.el9.x86 225 kB/s | 21 kB 00:00 2023-08-09T12:34:58.250 INFO:teuthology.orchestra.run.smithi017.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 307 kB 00:00 2023-08-09T12:34:58.275 INFO:teuthology.orchestra.run.smithi017.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 321 kB/s | 32 kB 00:00 2023-08-09T12:34:58.467 INFO:teuthology.orchestra.run.smithi017.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2023-08-09T12:34:58.526 INFO:teuthology.orchestra.run.smithi017.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 65 kB/s | 17 kB 00:00 2023-08-09T12:34:58.559 INFO:teuthology.orchestra.run.smithi017.stdout:(47/154): jq-1.6-15.el9.x86_64.rpm 664 kB/s | 186 kB 00:00 2023-08-09T12:34:58.576 INFO:teuthology.orchestra.run.smithi017.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 10 kB 00:00 2023-08-09T12:34:58.618 INFO:teuthology.orchestra.run.smithi017.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-08-09T12:34:58.635 INFO:teuthology.orchestra.run.smithi017.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 597 kB/s | 44 kB 00:00 2023-08-09T12:34:58.685 INFO:teuthology.orchestra.run.smithi017.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 6.1 MB/s | 661 kB 00:00 2023-08-09T12:34:58.702 INFO:teuthology.orchestra.run.smithi017.stdout:(52/154): libuuid-devel-2.37.4-11.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2023-08-09T12:34:58.761 INFO:teuthology.orchestra.run.smithi017.stdout:(53/154): libtool-2.4.6-45.el9.x86_64.rpm 4.8 MB/s | 578 kB 00:00 2023-08-09T12:34:58.778 INFO:teuthology.orchestra.run.smithi017.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 509 kB/s | 46 kB 00:00 2023-08-09T12:34:58.820 INFO:teuthology.orchestra.run.smithi017.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 282 kB 00:00 2023-08-09T12:34:58.836 INFO:teuthology.orchestra.run.smithi017.stdout:(56/154): openblas-0.3.21-2.el9.x86_64.rpm 633 kB/s | 34 kB 00:00 2023-08-09T12:34:58.879 INFO:teuthology.orchestra.run.smithi017.stdout:(57/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.2 MB/s | 217 kB 00:00 2023-08-09T12:34:59.112 INFO:teuthology.orchestra.run.smithi017.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2023-08-09T12:34:59.237 INFO:teuthology.orchestra.run.smithi017.stdout:(59/154): openssl-devel-3.0.7-24.el9.x86_64.rpm 7.6 MB/s | 3.0 MB 00:00 2023-08-09T12:34:59.313 INFO:teuthology.orchestra.run.smithi017.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 3.7 MB/s | 1.5 MB 00:00 2023-08-09T12:34:59.354 INFO:teuthology.orchestra.run.smithi017.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 3.6 MB/s | 811 kB 00:00 2023-08-09T12:34:59.396 INFO:teuthology.orchestra.run.smithi017.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 905 kB/s | 134 kB 00:00 2023-08-09T12:34:59.714 INFO:teuthology.orchestra.run.smithi017.stdout:(63/154): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2023-08-09T12:34:59.847 INFO:teuthology.orchestra.run.smithi017.stdout:(64/154): postgresql-server-13.11-1.el9.x86_64. 12 MB/s | 5.7 MB 00:00 2023-08-09T12:34:59.889 INFO:teuthology.orchestra.run.smithi017.stdout:(65/154): python3-jinja2-2.11.3-4.el9.noarch.rp 471 kB/s | 228 kB 00:00 2023-08-09T12:34:59.914 INFO:teuthology.orchestra.run.smithi017.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 124 kB/s | 24 kB 00:00 2023-08-09T12:34:59.939 INFO:teuthology.orchestra.run.smithi017.stdout:(67/154): python3-jsonpointer-2.0-4.el9.noarch. 369 kB/s | 18 kB 00:00 2023-08-09T12:34:59.973 INFO:teuthology.orchestra.run.smithi017.stdout:(68/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2023-08-09T12:34:59.998 INFO:teuthology.orchestra.run.smithi017.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 382 kB/s | 32 kB 00:00 2023-08-09T12:35:00.040 INFO:teuthology.orchestra.run.smithi017.stdout:(70/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 217 kB 00:00 2023-08-09T12:35:00.238 INFO:teuthology.orchestra.run.smithi017.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 4.8 MB 00:00 2023-08-09T12:35:00.291 INFO:teuthology.orchestra.run.smithi017.stdout:(72/154): python3-oauthlib-3.1.1-5.el9.noarch.r 604 kB/s | 174 kB 00:00 2023-08-09T12:35:00.316 INFO:teuthology.orchestra.run.smithi017.stdout:(73/154): python3-prettytable-0.7.2-27.el9.noar 161 kB/s | 41 kB 00:00 2023-08-09T12:35:00.358 INFO:teuthology.orchestra.run.smithi017.stdout:(74/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 132 kB 00:00 2023-08-09T12:35:00.408 INFO:teuthology.orchestra.run.smithi017.stdout:(75/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-08-09T12:35:00.433 INFO:teuthology.orchestra.run.smithi017.stdout:(76/154): python3-pytz-2021.1-5.el9.noarch.rpm 414 kB/s | 47 kB 00:00 2023-08-09T12:35:00.459 INFO:teuthology.orchestra.run.smithi017.stdout:(77/154): python3-requests-oauthlib-1.3.0-12.el 443 kB/s | 43 kB 00:00 2023-08-09T12:35:00.500 INFO:teuthology.orchestra.run.smithi017.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 594 kB/s | 39 kB 00:00 2023-08-09T12:35:00.776 INFO:teuthology.orchestra.run.smithi017.stdout:(79/154): uuid-1.6.2-55.el9.x86_64.rpm 221 kB/s | 56 kB 00:00 2023-08-09T12:35:00.843 INFO:teuthology.orchestra.run.smithi017.stdout:(80/154): socat-1.7.4.1-5.el9.x86_64.rpm 789 kB/s | 300 kB 00:00 2023-08-09T12:35:01.101 INFO:teuthology.orchestra.run.smithi017.stdout:(81/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2023-08-09T12:35:01.126 INFO:teuthology.orchestra.run.smithi017.stdout:(82/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 182 kB/s | 63 kB 00:00 2023-08-09T12:35:01.168 INFO:teuthology.orchestra.run.smithi017.stdout:(83/154): fuse-2.9.9-15.el9.x86_64.rpm 257 kB/s | 79 kB 00:00 2023-08-09T12:35:01.271 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-09T12:35:01.273 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-09T12:35:01.293 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.41.8-1.el9.x86_64 is already installed. 2023-08-09T12:35:01.294 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.0.0-2.el9.x86_64 is already installed. 2023-08-09T12:35:01.295 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-9.el9.x86_64 is already installed. 2023-08-09T12:35:01.300 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-08-09T12:35:01.300 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-08-09T12:35:01.303 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.10-1.el9.x86_64 is already installed. 2023-08-09T12:35:01.304 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.14.2-1.el9.x86_64 is already installed. 2023-08-09T12:35:01.328 INFO:teuthology.orchestra.run.smithi017.stdout:(84/154): libquadmath-11.4.1-2.1.el9.x86_64.rpm 990 kB/s | 197 kB 00:00 2023-08-09T12:35:01.388 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-08-09T12:35:01.407 INFO:teuthology.orchestra.run.smithi017.stdout:(85/154): libgfortran-11.4.1-2.1.el9.x86_64.rpm 2.8 MB/s | 807 kB 00:00 2023-08-09T12:35:01.414 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2023-08-09T12:35:01.415 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2023-08-09T12:35:01.415 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2023-08-09T12:35:01.415 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2023-08-09T12:35:01.415 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-08-09T12:35:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 6.5 k 2023-08-09T12:35:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 5.2 M 2023-08-09T12:35:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 849 k 2023-08-09T12:35:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 141 k 2023-08-09T12:35:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 1.5 M 2023-08-09T12:35:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 131 k 2023-08-09T12:35:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 1.7 M 2023-08-09T12:35:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 7.4 M 2023-08-09T12:35:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 47 k 2023-08-09T12:35:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 8.1 M 2023-08-09T12:35:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 40 M 2023-08-09T12:35:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 261 k 2023-08-09T12:35:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 218 k 2023-08-09T12:35:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 218 k 2023-08-09T12:35:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 18 k 2023-08-09T12:35:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 CentOS-AppStream 21 k 2023-08-09T12:35:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-08-09T12:35:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-08-09T12:35:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 31 k 2023-08-09T12:35:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 666 k 2023-08-09T12:35:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 126 k 2023-08-09T12:35:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-08-09T12:35:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-11.el9 CentOS-AppStream 24 k 2023-08-09T12:35:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-08-09T12:35:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-08-09T12:35:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-08-09T12:35:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-08-09T12:35:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 162 k 2023-08-09T12:35:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 320 k 2023-08-09T12:35:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 297 k 2023-08-09T12:35:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 99 k 2023-08-09T12:35:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 85 k 2023-08-09T12:35:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 3.0 M 2023-08-09T12:35:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 169 k 2023-08-09T12:35:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-08-09T12:35:01.421 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2023-08-09T12:35:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.43.90-1.el9 CentOS-BaseOS 2.2 M 2023-08-09T12:35:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.43.90-1.el9 CentOS-BaseOS 1.8 M 2023-08-09T12:35:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.43.90-1.el9 CentOS-BaseOS 41 k 2023-08-09T12:35:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.43.90-1.el9 CentOS-BaseOS 245 k 2023-08-09T12:35:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.189-3.el9 CentOS-BaseOS 36 k 2023-08-09T12:35:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.189-3.el9 CentOS-BaseOS 192 k 2023-08-09T12:35:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.189-3.el9 CentOS-BaseOS 254 k 2023-08-09T12:35:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: iproute x86_64 6.2.0-5.el9 CentOS-BaseOS 785 k 2023-08-09T12:35:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-tc x86_64 6.2.0-5.el9 CentOS-BaseOS 448 k 2023-08-09T12:35:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid x86_64 2.37.4-11.el9 CentOS-BaseOS 107 k 2023-08-09T12:35:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk x86_64 2.37.4-11.el9 CentOS-BaseOS 153 k 2023-08-09T12:35:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: libmount x86_64 2.37.4-11.el9 CentOS-BaseOS 133 k 2023-08-09T12:35:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 3.3 M 2023-08-09T12:35:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 3.0 M 2023-08-09T12:35:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols x86_64 2.37.4-11.el9 CentOS-BaseOS 62 k 2023-08-09T12:35:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid x86_64 2.37.4-11.el9 CentOS-BaseOS 27 k 2023-08-09T12:35:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.0.7-24.el9 CentOS-BaseOS 1.2 M 2023-08-09T12:35:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.0.7-24.el9 CentOS-BaseOS 2.1 M 2023-08-09T12:35:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux x86_64 2.37.4-11.el9 CentOS-BaseOS 2.2 M 2023-08-09T12:35:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core x86_64 2.37.4-11.el9 CentOS-BaseOS 432 k 2023-08-09T12:35:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user x86_64 2.37.4-11.el9 CentOS-BaseOS 30 k 2023-08-09T12:35:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump x86_64 3.1.12-3.el9 CentOS-BaseOS 321 k 2023-08-09T12:35:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 5.19.0-4.el9 baseos 1.0 M 2023-08-09T12:35:01.424 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2023-08-09T12:35:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-08-09T12:35:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-08-09T12:35:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 19 M 2023-08-09T12:35:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 23 k 2023-08-09T12:35:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 2.1 M 2023-08-09T12:35:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 242 k 2023-08-09T12:35:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 4.4 M 2023-08-09T12:35:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 18 M 2023-08-09T12:35:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5389.g668a86f2.el9 ceph-noarch 15 k 2023-08-09T12:35:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 24 k 2023-08-09T12:35:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-08-09T12:35:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-08-09T12:35:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-08-09T12:35:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-08-09T12:35:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-08-09T12:35:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-08-09T12:35:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-15.el9 CentOS-AppStream 186 k 2023-08-09T12:35:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-08-09T12:35:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-08-09T12:35:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 164 k 2023-08-09T12:35:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-2.1.el9 CentOS-BaseOS 807 k 2023-08-09T12:35:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-08-09T12:35:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-08-09T12:35:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-2.1.el9 CentOS-BaseOS 197 k 2023-08-09T12:35:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-08-09T12:35:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 473 k 2023-08-09T12:35:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-08-09T12:35:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 4.7 M 2023-08-09T12:35:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-08-09T12:35:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-08-09T12:35:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-08-09T12:35:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-08-09T12:35:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-08-09T12:35:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-08-09T12:35:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-08-09T12:35:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-08-09T12:35:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-08-09T12:35:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-08-09T12:35:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-08-09T12:35:01.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-08-09T12:35:01.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 45 k 2023-08-09T12:35:01.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:18.0.0-5389.g668a86f2.el9 ceph 125 k 2023-08-09T12:35:01.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-08-09T12:35:01.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-08-09T12:35:01.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-08-09T12:35:01.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-08-09T12:35:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-08-09T12:35:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.16-1.el9 appstream 247 k 2023-08-09T12:35:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-08-09T12:35:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-08-09T12:35:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-08-09T12:35:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-08-09T12:35:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-08-09T12:35:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-08-09T12:35:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-08-09T12:35:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-08-09T12:35:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-08-09T12:35:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-08-09T12:35:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-08-09T12:35:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-08-09T12:35:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-08-09T12:35:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-08-09T12:35:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-08-09T12:35:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-08-09T12:35:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-08-09T12:35:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-08-09T12:35:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-08-09T12:35:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-08-09T12:35:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-08-09T12:35:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-08-09T12:35:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-08-09T12:35:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-08-09T12:35:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-08-09T12:35:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-08-09T12:35:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-08-09T12:35:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-08-09T12:35:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-08-09T12:35:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-08-09T12:35:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-08-09T12:35:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-08-09T12:35:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-08-09T12:35:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-08-09T12:35:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-08-09T12:35:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-08-09T12:35:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-08-09T12:35:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-08-09T12:35:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-08-09T12:35:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-08-09T12:35:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-2.el9 epel 192 k 2023-08-09T12:35:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-08-09T12:35:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-08-09T12:35:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-08-09T12:35:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-08-09T12:35:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-36.el9 appstream 45 k 2023-08-09T12:35:01.437 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2023-08-09T12:35:01.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-08-09T12:35:01.438 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:35:01.438 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-08-09T12:35:01.438 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2023-08-09T12:35:01.438 INFO:teuthology.orchestra.run.smithi142.stdout:Install 131 Packages 2023-08-09T12:35:01.438 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 23 Packages 2023-08-09T12:35:01.438 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:35:01.439 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 205 M 2023-08-09T12:35:01.439 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-08-09T12:35:01.453 INFO:teuthology.orchestra.run.smithi017.stdout:(86/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 878 kB/s | 241 kB 00:00 2023-08-09T12:35:01.520 INFO:teuthology.orchestra.run.smithi017.stdout:(87/154): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.1 MB 00:00 2023-08-09T12:35:01.570 INFO:teuthology.orchestra.run.smithi017.stdout:(88/154): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-08-09T12:35:01.612 INFO:teuthology.orchestra.run.smithi017.stdout:(89/154): python3-ply-3.11-14.el9.noarch.rpm 714 kB/s | 103 kB 00:00 2023-08-09T12:35:02.020 INFO:teuthology.orchestra.run.smithi017.stdout:(90/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 192 kB/s | 86 kB 00:00 2023-08-09T12:35:02.027 INFO:teuthology.orchestra.run.smithi142.stdout:(1/154): ceph-18.0.0-5389.g668a86f2.el9.x86_64. 26 kB/s | 6.5 kB 00:00 2023-08-09T12:35:02.046 INFO:teuthology.orchestra.run.smithi017.stdout:(91/154): zlib-devel-1.2.11-36.el9.x86_64.rpm 104 kB/s | 45 kB 00:00 2023-08-09T12:35:02.171 INFO:teuthology.orchestra.run.smithi017.stdout:(92/154): python3-devel-3.9.16-1.el9.x86_64.rpm 380 kB/s | 247 kB 00:00 2023-08-09T12:35:02.219 INFO:teuthology.orchestra.run.smithi142.stdout:(2/154): ceph-fuse-18.0.0-5389.g668a86f2.el9.x8 4.3 MB/s | 849 kB 00:00 2023-08-09T12:35:02.295 INFO:teuthology.orchestra.run.smithi142.stdout:(3/154): ceph-immutable-object-cache-18.0.0-538 1.9 MB/s | 141 kB 00:00 2023-08-09T12:35:02.553 INFO:teuthology.orchestra.run.smithi142.stdout:(4/154): ceph-mds-18.0.0-5389.g668a86f2.el9.x86 8.2 MB/s | 2.1 MB 00:00 2023-08-09T12:35:02.828 INFO:teuthology.orchestra.run.smithi142.stdout:(5/154): ceph-mgr-18.0.0-5389.g668a86f2.el9.x86 5.3 MB/s | 1.5 MB 00:00 2023-08-09T12:35:03.362 INFO:teuthology.orchestra.run.smithi142.stdout:(6/154): ceph-common-18.0.0-5389.g668a86f2.el9. 12 MB/s | 19 MB 00:01 2023-08-09T12:35:03.512 INFO:teuthology.orchestra.run.smithi142.stdout:(7/154): ceph-mon-18.0.0-5389.g668a86f2.el9.x86 6.4 MB/s | 4.4 MB 00:00 2023-08-09T12:35:04.087 INFO:teuthology.orchestra.run.smithi142.stdout:(8/154): ceph-base-18.0.0-5389.g668a86f2.el9.x8 2.2 MB/s | 5.2 MB 00:02 2023-08-09T12:35:04.205 INFO:teuthology.orchestra.run.smithi142.stdout:(9/154): ceph-selinux-18.0.0-5389.g668a86f2.el9 207 kB/s | 24 kB 00:00 2023-08-09T12:35:04.446 INFO:teuthology.orchestra.run.smithi142.stdout:(10/154): ceph-radosgw-18.0.0-5389.g668a86f2.el 8.7 MB/s | 8.1 MB 00:00 2023-08-09T12:35:04.705 INFO:teuthology.orchestra.run.smithi142.stdout:(11/154): ceph-osd-18.0.0-5389.g668a86f2.el9.x8 13 MB/s | 18 MB 00:01 2023-08-09T12:35:04.747 INFO:teuthology.orchestra.run.smithi142.stdout:(12/154): cephfs-mirror-18.0.0-5389.g668a86f2.e 727 kB/s | 218 kB 00:00 2023-08-09T12:35:04.772 INFO:teuthology.orchestra.run.smithi142.stdout:(13/154): libcephfs-devel-18.0.0-5389.g668a86f2 476 kB/s | 31 kB 00:00 2023-08-09T12:35:04.839 INFO:teuthology.orchestra.run.smithi142.stdout:(14/154): libcephsqlite-18.0.0-5389.g668a86f2.e 2.4 MB/s | 164 kB 00:00 2023-08-09T12:35:04.898 INFO:teuthology.orchestra.run.smithi142.stdout:(15/154): libcephfs2-18.0.0-5389.g668a86f2.el9. 4.3 MB/s | 666 kB 00:00 2023-08-09T12:35:04.940 INFO:teuthology.orchestra.run.smithi142.stdout:(16/154): librados-devel-18.0.0-5389.g668a86f2. 1.2 MB/s | 126 kB 00:00 2023-08-09T12:35:04.998 INFO:teuthology.orchestra.run.smithi142.stdout:(17/154): libradosstriper1-18.0.0-5389.g668a86f 4.7 MB/s | 473 kB 00:00 2023-08-09T12:35:05.090 INFO:teuthology.orchestra.run.smithi142.stdout:(18/154): python3-ceph-argparse-18.0.0-5389.g66 498 kB/s | 45 kB 00:00 2023-08-09T12:35:05.191 INFO:teuthology.orchestra.run.smithi142.stdout:(19/154): python3-ceph-common-18.0.0-5389.g668a 1.2 MB/s | 125 kB 00:00 2023-08-09T12:35:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:(20/154): python3-cephfs-18.0.0-5389.g668a86f2. 2.1 MB/s | 162 kB 00:00 2023-08-09T12:35:05.408 INFO:teuthology.orchestra.run.smithi142.stdout:(21/154): librgw2-18.0.0-5389.g668a86f2.el9.x86 10 MB/s | 4.7 MB 00:00 2023-08-09T12:35:05.458 INFO:teuthology.orchestra.run.smithi142.stdout:(22/154): python3-rados-18.0.0-5389.g668a86f2.e 1.6 MB/s | 320 kB 00:00 2023-08-09T12:35:05.508 INFO:teuthology.orchestra.run.smithi142.stdout:(23/154): python3-rbd-18.0.0-5389.g668a86f2.el9 2.9 MB/s | 297 kB 00:00 2023-08-09T12:35:05.550 INFO:teuthology.orchestra.run.smithi142.stdout:(24/154): python3-rgw-18.0.0-5389.g668a86f2.el9 1.1 MB/s | 99 kB 00:00 2023-08-09T12:35:05.592 INFO:teuthology.orchestra.run.smithi142.stdout:(25/154): rbd-fuse-18.0.0-5389.g668a86f2.el9.x8 1.0 MB/s | 85 kB 00:00 2023-08-09T12:35:05.684 INFO:teuthology.orchestra.run.smithi142.stdout:(26/154): rbd-nbd-18.0.0-5389.g668a86f2.el9.x86 1.8 MB/s | 169 kB 00:00 2023-08-09T12:35:05.743 INFO:teuthology.orchestra.run.smithi142.stdout:(27/154): ceph-grafana-dashboards-18.0.0-5389.g 404 kB/s | 23 kB 00:00 2023-08-09T12:35:05.835 INFO:teuthology.orchestra.run.smithi142.stdout:(28/154): rbd-mirror-18.0.0-5389.g668a86f2.el9. 11 MB/s | 3.0 MB 00:00 2023-08-09T12:35:05.877 INFO:teuthology.orchestra.run.smithi142.stdout:(29/154): ceph-mgr-cephadm-18.0.0-5389.g668a86f 985 kB/s | 131 kB 00:00 2023-08-09T12:35:06.027 INFO:teuthology.orchestra.run.smithi142.stdout:(30/154): ceph-mgr-dashboard-18.0.0-5389.g668a8 9.1 MB/s | 1.7 MB 00:00 2023-08-09T12:35:06.152 INFO:teuthology.orchestra.run.smithi142.stdout:(31/154): ceph-mgr-modules-core-18.0.0-5389.g66 1.9 MB/s | 242 kB 00:00 2023-08-09T12:35:06.219 INFO:teuthology.orchestra.run.smithi142.stdout:(32/154): ceph-mgr-rook-18.0.0-5389.g668a86f2.e 725 kB/s | 47 kB 00:00 2023-08-09T12:35:06.278 INFO:teuthology.orchestra.run.smithi142.stdout:(33/154): ceph-prometheus-alerts-18.0.0-5389.g6 255 kB/s | 15 kB 00:00 2023-08-09T12:35:06.445 INFO:teuthology.orchestra.run.smithi142.stdout:(34/154): ceph-mgr-diskprediction-local-18.0.0- 13 MB/s | 7.4 MB 00:00 2023-08-09T12:35:06.487 INFO:teuthology.orchestra.run.smithi142.stdout:(35/154): ceph-volume-18.0.0-5389.g668a86f2.el9 1.2 MB/s | 261 kB 00:00 2023-08-09T12:35:06.537 INFO:teuthology.orchestra.run.smithi142.stdout:(36/154): cephadm-18.0.0-5389.g668a86f2.el9.noa 2.3 MB/s | 218 kB 00:00 2023-08-09T12:35:06.563 INFO:teuthology.orchestra.run.smithi142.stdout:(37/154): cephfs-top-18.0.0-5389.g668a86f2.el9. 243 kB/s | 18 kB 00:00 2023-08-09T12:35:06.813 INFO:teuthology.orchestra.run.smithi142.stdout:(38/154): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2023-08-09T12:35:06.872 INFO:teuthology.orchestra.run.smithi142.stdout:(39/154): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 920 kB 00:00 2023-08-09T12:35:06.914 INFO:teuthology.orchestra.run.smithi142.stdout:(40/154): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 106 kB 00:00 2023-08-09T12:35:06.939 INFO:teuthology.orchestra.run.smithi142.stdout:(41/154): elfutils-libelf-devel-0.189-3.el9.x86 325 kB/s | 21 kB 00:00 2023-08-09T12:35:06.989 INFO:teuthology.orchestra.run.smithi142.stdout:(42/154): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 307 kB 00:00 2023-08-09T12:35:07.014 INFO:teuthology.orchestra.run.smithi142.stdout:(43/154): flexiblas-3.0.4-8.el9.x86_64.rpm 445 kB/s | 32 kB 00:00 2023-08-09T12:35:07.157 INFO:teuthology.orchestra.run.smithi142.stdout:(44/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2023-08-09T12:35:07.173 INFO:teuthology.orchestra.run.smithi142.stdout:(45/154): flexiblas-openblas-openmp-3.0.4-8.el9 114 kB/s | 17 kB 00:00 2023-08-09T12:35:07.207 INFO:teuthology.orchestra.run.smithi142.stdout:(46/154): libaio-devel-0.3.111-13.el9.x86_64.rp 316 kB/s | 10 kB 00:00 2023-08-09T12:35:07.274 INFO:teuthology.orchestra.run.smithi142.stdout:(47/154): jq-1.6-15.el9.x86_64.rpm 1.8 MB/s | 186 kB 00:00 2023-08-09T12:35:07.324 INFO:teuthology.orchestra.run.smithi142.stdout:(48/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 159 kB 00:00 2023-08-09T12:35:07.341 INFO:teuthology.orchestra.run.smithi142.stdout:(49/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 687 kB/s | 44 kB 00:00 2023-08-09T12:35:07.400 INFO:teuthology.orchestra.run.smithi142.stdout:(50/154): librdkafka-1.6.1-102.el9.x86_64.rpm 8.8 MB/s | 661 kB 00:00 2023-08-09T12:35:07.458 INFO:teuthology.orchestra.run.smithi142.stdout:(51/154): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 578 kB 00:00 2023-08-09T12:35:07.500 INFO:teuthology.orchestra.run.smithi142.stdout:(52/154): libuuid-devel-2.37.4-11.el9.x86_64.rp 259 kB/s | 24 kB 00:00 2023-08-09T12:35:07.517 INFO:teuthology.orchestra.run.smithi142.stdout:(53/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 803 kB/s | 46 kB 00:00 2023-08-09T12:35:07.559 INFO:teuthology.orchestra.run.smithi142.stdout:(54/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-08-09T12:35:07.610 INFO:teuthology.orchestra.run.smithi142.stdout:(55/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2023-08-09T12:35:07.627 INFO:teuthology.orchestra.run.smithi142.stdout:(56/154): openblas-0.3.21-2.el9.x86_64.rpm 536 kB/s | 34 kB 00:00 2023-08-09T12:35:07.794 INFO:teuthology.orchestra.run.smithi142.stdout:(57/154): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2023-08-09T12:35:07.936 INFO:teuthology.orchestra.run.smithi142.stdout:(58/154): openssl-devel-3.0.7-24.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2023-08-09T12:35:07.994 INFO:teuthology.orchestra.run.smithi142.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 8.3 MB/s | 1.5 MB 00:00 2023-08-09T12:35:08.045 INFO:teuthology.orchestra.run.smithi142.stdout:(60/154): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2023-08-09T12:35:08.111 INFO:teuthology.orchestra.run.smithi142.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 6.9 MB/s | 811 kB 00:00 2023-08-09T12:35:08.287 INFO:teuthology.orchestra.run.smithi142.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2023-08-09T12:35:08.437 INFO:teuthology.orchestra.run.smithi142.stdout:(63/154): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2023-08-09T12:35:08.470 INFO:teuthology.orchestra.run.smithi142.stdout:(64/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2023-08-09T12:35:08.504 INFO:teuthology.orchestra.run.smithi142.stdout:(65/154): python3-jsonpointer-2.0-4.el9.noarch. 567 kB/s | 18 kB 00:00 2023-08-09T12:35:08.563 INFO:teuthology.orchestra.run.smithi142.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 268 kB/s | 24 kB 00:00 2023-08-09T12:35:08.613 INFO:teuthology.orchestra.run.smithi142.stdout:(67/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2023-08-09T12:35:08.638 INFO:teuthology.orchestra.run.smithi142.stdout:(68/154): python3-markupsafe-1.1.1-12.el9.x86_6 434 kB/s | 32 kB 00:00 2023-08-09T12:35:08.797 INFO:teuthology.orchestra.run.smithi142.stdout:(69/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-08-09T12:35:08.839 INFO:teuthology.orchestra.run.smithi142.stdout:(70/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-08-09T12:35:08.881 INFO:teuthology.orchestra.run.smithi142.stdout:(71/154): python3-oauthlib-3.1.1-5.el9.noarch.r 2.1 MB/s | 174 kB 00:00 2023-08-09T12:35:08.906 INFO:teuthology.orchestra.run.smithi142.stdout:(72/154): python3-prettytable-0.7.2-27.el9.noar 643 kB/s | 41 kB 00:00 2023-08-09T12:35:08.948 INFO:teuthology.orchestra.run.smithi142.stdout:(73/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-08-09T12:35:08.999 INFO:teuthology.orchestra.run.smithi142.stdout:(74/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-08-09T12:35:09.024 INFO:teuthology.orchestra.run.smithi142.stdout:(75/154): python3-pytz-2021.1-5.el9.noarch.rpm 655 kB/s | 47 kB 00:00 2023-08-09T12:35:09.049 INFO:teuthology.orchestra.run.smithi142.stdout:(76/154): python3-requests-oauthlib-1.3.0-12.el 877 kB/s | 43 kB 00:00 2023-08-09T12:35:09.516 INFO:teuthology.orchestra.run.smithi142.stdout:(77/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2023-08-09T12:35:09.542 INFO:teuthology.orchestra.run.smithi142.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 82 kB/s | 39 kB 00:00 2023-08-09T12:35:09.592 INFO:teuthology.orchestra.run.smithi142.stdout:(79/154): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2023-08-09T12:35:09.625 INFO:teuthology.orchestra.run.smithi142.stdout:(80/154): uuid-1.6.2-55.el9.x86_64.rpm 713 kB/s | 56 kB 00:00 2023-08-09T12:35:09.651 INFO:teuthology.orchestra.run.smithi142.stdout:(81/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2023-08-09T12:35:09.693 INFO:teuthology.orchestra.run.smithi142.stdout:(82/154): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2023-08-09T12:35:09.751 INFO:teuthology.orchestra.run.smithi142.stdout:(83/154): libgfortran-11.4.1-2.1.el9.x86_64.rpm 8.0 MB/s | 807 kB 00:00 2023-08-09T12:35:09.821 INFO:teuthology.orchestra.run.smithi142.stdout:(84/154): libquadmath-11.4.1-2.1.el9.x86_64.rpm 1.6 MB/s | 197 kB 00:00 2023-08-09T12:35:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:(85/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 241 kB 00:00 2023-08-09T12:35:09.944 INFO:teuthology.orchestra.run.smithi142.stdout:(86/154): python3-cryptography-36.0.1-4.el9.x86 9.6 MB/s | 1.1 MB 00:00 2023-08-09T12:35:09.977 INFO:teuthology.orchestra.run.smithi142.stdout:(87/154): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2023-08-09T12:35:10.019 INFO:teuthology.orchestra.run.smithi142.stdout:(88/154): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 124 kB 00:00 2023-08-09T12:35:10.578 INFO:teuthology.orchestra.run.smithi142.stdout:(89/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 155 kB/s | 86 kB 00:00 2023-08-09T12:35:10.687 INFO:teuthology.orchestra.run.smithi142.stdout:(90/154): python3-devel-3.9.16-1.el9.x86_64.rpm 350 kB/s | 247 kB 00:00 2023-08-09T12:35:10.703 INFO:teuthology.orchestra.run.smithi142.stdout:(91/154): zlib-devel-1.2.11-36.el9.x86_64.rpm 365 kB/s | 45 kB 00:00 2023-08-09T12:35:11.229 INFO:teuthology.orchestra.run.smithi142.stdout:(92/154): ceph-test-18.0.0-5389.g668a86f2.el9.x 5.7 MB/s | 40 MB 00:07 2023-08-09T12:35:11.288 INFO:teuthology.orchestra.run.smithi142.stdout:(93/154): fmt-8.1.1-5.el9.x86_64.rpm 185 kB/s | 111 kB 00:00 2023-08-09T12:35:11.321 INFO:teuthology.orchestra.run.smithi142.stdout:(94/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 501 kB/s | 309 kB 00:00 2023-08-09T12:35:11.571 INFO:teuthology.orchestra.run.smithi142.stdout:(95/154): libarrow-doc-9.0.0-9.el9.noarch.rpm 98 kB/s | 24 kB 00:00 2023-08-09T12:35:11.597 INFO:teuthology.orchestra.run.smithi142.stdout:(96/154): liboath-2.6.7-2.el9.x86_64.rpm 178 kB/s | 49 kB 00:00 2023-08-09T12:35:11.737 INFO:teuthology.orchestra.run.smithi142.stdout:(97/154): libarrow-9.0.0-9.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2023-08-09T12:35:11.789 INFO:teuthology.orchestra.run.smithi142.stdout:(98/154): libunwind-1.6.2-1.el9.x86_64.rpm 311 kB/s | 67 kB 00:00 2023-08-09T12:35:11.839 INFO:teuthology.orchestra.run.smithi142.stdout:(99/154): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.6 MB/s | 837 kB 00:00 2023-08-09T12:35:11.898 INFO:teuthology.orchestra.run.smithi142.stdout:(100/154): python3-asyncssh-2.13.2-3.el9.noarch 3.7 MB/s | 548 kB 00:00 2023-08-09T12:35:11.990 INFO:teuthology.orchestra.run.smithi142.stdout:(101/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 303 kB/s | 43 kB 00:00 2023-08-09T12:35:12.032 INFO:teuthology.orchestra.run.smithi142.stdout:(102/154): python3-cachetools-4.2.4-1.el9.noarc 174 kB/s | 32 kB 00:00 2023-08-09T12:35:12.057 INFO:teuthology.orchestra.run.smithi142.stdout:(103/154): python3-certifi-2021.10.8-2.el9.noar 94 kB/s | 15 kB 00:00 2023-08-09T12:35:12.149 INFO:teuthology.orchestra.run.smithi142.stdout:(104/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2023-08-09T12:35:12.191 INFO:teuthology.orchestra.run.smithi142.stdout:(105/154): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-08-09T12:35:12.224 INFO:teuthology.orchestra.run.smithi142.stdout:(106/154): python3-google-auth-2.22.0-1.el9.noa 1.2 MB/s | 197 kB 00:00 2023-08-09T12:35:12.258 INFO:teuthology.orchestra.run.smithi142.stdout:(107/154): python3-jaraco-8.2.1-3.el9.noarch.rp 105 kB/s | 11 kB 00:00 2023-08-09T12:35:12.325 INFO:teuthology.orchestra.run.smithi142.stdout:(108/154): python3-jaraco-classes-3.2.1-5.el9.n 178 kB/s | 18 kB 00:00 2023-08-09T12:35:12.350 INFO:teuthology.orchestra.run.smithi142.stdout:(109/154): python3-jaraco-collections-3.0.0-8.e 186 kB/s | 23 kB 00:00 2023-08-09T12:35:12.400 INFO:teuthology.orchestra.run.smithi142.stdout:(110/154): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2023-08-09T12:35:12.450 INFO:teuthology.orchestra.run.smithi142.stdout:(111/154): python3-jaraco-text-3.2.0-6.el9.noar 199 kB/s | 20 kB 00:00 2023-08-09T12:35:12.476 INFO:teuthology.orchestra.run.smithi142.stdout:(112/154): python3-jwt+crypto-2.4.0-1.el9.noarc 73 kB/s | 9.0 kB 00:00 2023-08-09T12:35:12.501 INFO:teuthology.orchestra.run.smithi142.stdout:(113/154): python3-jwt-2.4.0-1.el9.noarch.rpm 409 kB/s | 41 kB 00:00 2023-08-09T12:35:12.618 INFO:teuthology.orchestra.run.smithi142.stdout:(114/154): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2023-08-09T12:35:12.651 INFO:teuthology.orchestra.run.smithi142.stdout:(115/154): python3-logutils-0.3.5-21.el9.noarch 265 kB/s | 46 kB 00:00 2023-08-09T12:35:12.685 INFO:teuthology.orchestra.run.smithi142.stdout:(116/154): python3-more-itertools-8.12.0-2.el9. 430 kB/s | 79 kB 00:00 2023-08-09T12:35:12.719 INFO:teuthology.orchestra.run.smithi142.stdout:(117/154): python3-natsort-7.1.1-5.el9.noarch.r 578 kB/s | 58 kB 00:00 2023-08-09T12:35:12.769 INFO:teuthology.orchestra.run.smithi142.stdout:(118/154): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2023-08-09T12:35:12.794 INFO:teuthology.orchestra.run.smithi142.stdout:(119/154): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2023-08-09T12:35:12.870 INFO:teuthology.orchestra.run.smithi142.stdout:(120/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 600 kB/s | 90 kB 00:00 2023-08-09T12:35:12.895 INFO:teuthology.orchestra.run.smithi142.stdout:(121/154): python3-repoze-lru-0.7-16.el9.noarch 246 kB/s | 31 kB 00:00 2023-08-09T12:35:12.953 INFO:teuthology.orchestra.run.smithi142.stdout:(122/154): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-08-09T12:35:12.979 INFO:teuthology.orchestra.run.smithi142.stdout:(123/154): python3-rsa-4.9-2.el9.noarch.rpm 549 kB/s | 59 kB 00:00 2023-08-09T12:35:13.025 INFO:teuthology.orchestra.run.smithi142.stdout:(124/154): python3-tempora-5.0.0-2.el9.noarch.r 275 kB/s | 36 kB 00:00 2023-08-09T12:35:13.096 INFO:teuthology.orchestra.run.smithi142.stdout:(125/154): python3-typing-extensions-4.4.0-2.el 361 kB/s | 51 kB 00:00 2023-08-09T12:35:13.138 INFO:teuthology.orchestra.run.smithi142.stdout:(126/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2023-08-09T12:35:13.172 INFO:teuthology.orchestra.run.smithi142.stdout:(127/154): python3-websocket-client-1.2.3-2.el9 617 kB/s | 90 kB 00:00 2023-08-09T12:35:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:(128/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.4 MB/s | 427 kB 00:00 2023-08-09T12:35:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:(129/154): python3-zc-lockfile-2.0-10.el9.noarc 202 kB/s | 20 kB 00:00 2023-08-09T12:35:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:(130/154): re2-20211101-2.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-08-09T12:35:13.381 INFO:teuthology.orchestra.run.smithi142.stdout:(131/154): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-08-09T12:35:13.498 INFO:teuthology.orchestra.run.smithi142.stdout:(132/154): NetworkManager-1.43.90-1.el9.x86_64. 19 MB/s | 2.2 MB 00:00 2023-08-09T12:35:13.598 INFO:teuthology.orchestra.run.smithi142.stdout:(133/154): NetworkManager-libnm-1.43.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2023-08-09T12:35:13.663 INFO:teuthology.orchestra.run.smithi142.stdout:(134/154): NetworkManager-team-1.43.90-1.el9.x8 645 kB/s | 41 kB 00:00 2023-08-09T12:35:13.724 INFO:teuthology.orchestra.run.smithi142.stdout:(135/154): NetworkManager-tui-1.43.90-1.el9.x86 4.0 MB/s | 245 kB 00:00 2023-08-09T12:35:13.757 INFO:teuthology.orchestra.run.smithi142.stdout:(136/154): elfutils-debuginfod-client-0.189-3.e 1.1 MB/s | 36 kB 00:00 2023-08-09T12:35:13.808 INFO:teuthology.orchestra.run.smithi142.stdout:(137/154): elfutils-libelf-0.189-3.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-08-09T12:35:13.858 INFO:teuthology.orchestra.run.smithi142.stdout:(138/154): elfutils-libs-0.189-3.el9.x86_64.rpm 5.1 MB/s | 254 kB 00:00 2023-08-09T12:35:13.950 INFO:teuthology.orchestra.run.smithi142.stdout:(139/154): librados2-18.0.0-5389.g668a86f2.el9. 4.6 MB/s | 3.3 MB 00:00 2023-08-09T12:35:14.009 INFO:teuthology.orchestra.run.smithi142.stdout:(140/154): iproute-6.2.0-5.el9.x86_64.rpm 5.1 MB/s | 785 kB 00:00 2023-08-09T12:35:14.051 INFO:teuthology.orchestra.run.smithi142.stdout:(141/154): iproute-tc-6.2.0-5.el9.x86_64.rpm 4.8 MB/s | 448 kB 00:00 2023-08-09T12:35:14.084 INFO:teuthology.orchestra.run.smithi142.stdout:(142/154): libblkid-2.37.4-11.el9.x86_64.rpm 1.5 MB/s | 107 kB 00:00 2023-08-09T12:35:14.123 INFO:teuthology.orchestra.run.smithi142.stdout:(143/154): libfdisk-2.37.4-11.el9.x86_64.rpm 2.2 MB/s | 153 kB 00:00 2023-08-09T12:35:14.168 INFO:teuthology.orchestra.run.smithi142.stdout:(144/154): libmount-2.37.4-11.el9.x86_64.rpm 1.6 MB/s | 133 kB 00:00 2023-08-09T12:35:14.193 INFO:teuthology.orchestra.run.smithi142.stdout:(145/154): libsmartcols-2.37.4-11.el9.x86_64.rp 918 kB/s | 62 kB 00:00 2023-08-09T12:35:14.219 INFO:teuthology.orchestra.run.smithi142.stdout:(146/154): libuuid-2.37.4-11.el9.x86_64.rpm 558 kB/s | 27 kB 00:00 2023-08-09T12:35:14.307 INFO:teuthology.orchestra.run.smithi142.stdout:(147/154): openssl-3.0.7-24.el9.x86_64.rpm 10 MB/s | 1.2 MB 00:00 2023-08-09T12:35:14.402 INFO:teuthology.orchestra.run.smithi142.stdout:(148/154): openssl-libs-3.0.7-24.el9.x86_64.rpm 13 MB/s | 2.1 MB 00:00 2023-08-09T12:35:14.495 INFO:teuthology.orchestra.run.smithi142.stdout:(149/154): util-linux-2.37.4-11.el9.x86_64.rpm 13 MB/s | 2.2 MB 00:00 2023-08-09T12:35:14.537 INFO:teuthology.orchestra.run.smithi142.stdout:(150/154): util-linux-core-2.37.4-11.el9.x86_64 3.6 MB/s | 432 kB 00:00 2023-08-09T12:35:14.562 INFO:teuthology.orchestra.run.smithi142.stdout:(151/154): util-linux-user-2.37.4-11.el9.x86_64 482 kB/s | 30 kB 00:00 2023-08-09T12:35:14.604 INFO:teuthology.orchestra.run.smithi142.stdout:(152/154): xfsdump-3.1.12-3.el9.x86_64.rpm 4.8 MB/s | 321 kB 00:00 2023-08-09T12:35:14.696 INFO:teuthology.orchestra.run.smithi142.stdout:(153/154): librbd1-18.0.0-5389.g668a86f2.el9.x8 2.2 MB/s | 3.0 MB 00:01 2023-08-09T12:35:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:(154/154): xfsprogs-5.19.0-4.el9.x86_64.rpm 3.1 MB/s | 1.0 MB 00:00 2023-08-09T12:35:14.918 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-08-09T12:35:14.919 INFO:teuthology.orchestra.run.smithi142.stdout:Total 15 MB/s | 205 MB 00:13 2023-08-09T12:35:15.094 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-08-09T12:35:15.407 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-08-09T12:35:15.408 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-08-09T12:35:17.553 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-08-09T12:35:17.554 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-08-09T12:35:24.303 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-08-09T12:35:24.410 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.0.7-24.el9.x86_64 1/177 2023-08-09T12:35:24.457 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libuuid-2.37.4-11.el9.x86_64 2/177 2023-08-09T12:35:24.514 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libblkid-2.37.4-11.el9.x86_64 3/177 2023-08-09T12:35:24.646 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.37.4-11.el9.x86_64 3/177 2023-08-09T12:35:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/177 2023-08-09T12:35:24.798 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.189-3.el9.x86_64 5/177 2023-08-09T12:35:24.889 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/177 2023-08-09T12:35:24.976 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/177 2023-08-09T12:35:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/177 2023-08-09T12:35:25.156 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/177 2023-08-09T12:35:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/177 2023-08-09T12:35:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:18.0.0-5389.g668a86f2.el9.x86_64 11/177 2023-08-09T12:35:25.825 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:18.0.0-5389.g668a86f2.el9.x86_64 11/177 2023-08-09T12:35:25.863 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:18.0.0-5389.g668a86f2.el9.x86_64 12/177 2023-08-09T12:35:25.987 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:18.0.0-5389.g668a86f2.el9.x86_64 12/177 2023-08-09T12:35:26.037 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:18.0.0-5389.g668a86f2.el9.x86_64 13/177 2023-08-09T12:35:26.301 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/177 2023-08-09T12:35:26.375 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/177 2023-08-09T12:35:26.417 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:18.0.0-5389.g668a86f2.el9.x86_64 16/177 2023-08-09T12:35:26.579 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5389.g668a86f2.el9.x86_64 16/177 2023-08-09T12:35:26.618 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:18.0.0-5389.g668a86f2.el9.x86 17/177 2023-08-09T12:35:26.704 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5389.g668a86f2.el9.x86 17/177 2023-08-09T12:35:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libmount-2.37.4-11.el9.x86_64 18/177 2023-08-09T12:35:27.162 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsmartcols-2.37.4-11.el9.x86_64 19/177 2023-08-09T12:35:27.356 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.43.90-1.el9.x86_64 20/177 2023-08-09T12:35:27.444 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.43.90-1.el9.x86_64 20/177 2023-08-09T12:35:27.652 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-09T12:35:27.763 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-09T12:35:28.221 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-09T12:35:28.273 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/177 2023-08-09T12:35:28.319 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/177 2023-08-09T12:35:28.446 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 24/177 2023-08-09T12:35:28.519 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 25/177 2023-08-09T12:35:28.654 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/177 2023-08-09T12:35:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/177 2023-08-09T12:35:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/177 2023-08-09T12:35:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/177 2023-08-09T12:35:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:18.0.0-5389.g668a86f2.el9. 30/177 2023-08-09T12:35:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el 31/177 2023-08-09T12:35:29.137 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:18.0.0-5389.g668a86f2.el9.x86_6 32/177 2023-08-09T12:35:29.329 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/177 2023-08-09T12:35:29.399 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/177 2023-08-09T12:35:30.057 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/177 2023-08-09T12:35:30.177 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/177 2023-08-09T12:35:30.543 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/177 2023-08-09T12:35:30.607 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-core-2.37.4-11.el9.x86_64 38/177 2023-08-09T12:35:30.657 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: util-linux-core-2.37.4-11.el9.x86_64 38/177 2023-08-09T12:35:30.718 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:18.0.0-5389.g668a86f2.el9.x86_6 39/177 2023-08-09T12:35:30.775 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/177 2023-08-09T12:35:30.968 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.189-3.el9.x86_64 41/177 2023-08-09T12:35:31.027 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : iproute-6.2.0-5.el9.x86_64 42/177 2023-08-09T12:35:31.433 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libfdisk-2.37.4-11.el9.x86_64 43/177 2023-08-09T12:35:31.673 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-2.37.4-11.el9.x86_64 44/177 2023-08-09T12:35:31.831 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-5.19.0-4.el9.x86_64 45/177 2023-08-09T12:35:31.904 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-11.el9.x86_64 46/177 2023-08-09T12:35:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/177 2023-08-09T12:35:32.187 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.0.7-24.el9.x86_64 48/177 2023-08-09T12:35:32.359 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-2.el9.x86_64 49/177 2023-08-09T12:35:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 50/177 2023-08-09T12:35:32.492 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/177 2023-08-09T12:35:32.596 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/177 2023-08-09T12:35:32.642 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/177 2023-08-09T12:35:32.697 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/177 2023-08-09T12:35:32.784 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/177 2023-08-09T12:35:32.864 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/177 2023-08-09T12:35:32.935 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/177 2023-08-09T12:35:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/177 2023-08-09T12:35:33.208 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/177 2023-08-09T12:35:33.271 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/177 2023-08-09T12:35:33.413 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/177 2023-08-09T12:35:33.465 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 62/177 2023-08-09T12:35:33.529 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/177 2023-08-09T12:35:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/177 2023-08-09T12:35:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 65/177 2023-08-09T12:35:33.690 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fmt-8.1.1-5.el9.x86_64 66/177 2023-08-09T12:35:33.873 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-36.el9.x86_64 67/177 2023-08-09T12:35:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.16-1.el9.x86_64 68/177 2023-08-09T12:35:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 69/177 2023-08-09T12:35:34.135 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 70/177 2023-08-09T12:35:34.421 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 71/177 2023-08-09T12:35:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 72/177 2023-08-09T12:35:34.689 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 73/177 2023-08-09T12:35:34.753 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 74/177 2023-08-09T12:35:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 75/177 2023-08-09T12:35:34.851 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 76/177 2023-08-09T12:35:34.912 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 77/177 2023-08-09T12:35:34.981 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 78/177 2023-08-09T12:35:35.081 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/177 2023-08-09T12:35:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/177 2023-08-09T12:35:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/177 2023-08-09T12:35:35.374 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/177 2023-08-09T12:35:35.426 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/177 2023-08-09T12:35:35.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/177 2023-08-09T12:35:35.571 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/177 2023-08-09T12:35:35.632 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/177 2023-08-09T12:35:35.823 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/177 2023-08-09T12:35:35.870 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/177 2023-08-09T12:35:36.030 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/177 2023-08-09T12:35:36.100 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/177 2023-08-09T12:35:37.108 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/177 2023-08-09T12:35:37.166 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/177 2023-08-09T12:35:37.208 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/177 2023-08-09T12:35:37.249 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/177 2023-08-09T12:35:37.524 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/177 2023-08-09T12:35:37.562 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/177 2023-08-09T12:35:37.709 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/177 2023-08-09T12:35:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/177 2023-08-09T12:35:38.674 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/177 2023-08-09T12:35:40.263 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/177 2023-08-09T12:35:40.366 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/177 2023-08-09T12:35:40.413 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 102/177 2023-08-09T12:35:40.452 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-15.el9.x86_64 103/177 2023-08-09T12:35:40.501 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/177 2023-08-09T12:35:40.891 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/177 2023-08-09T12:35:40.940 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:18.0.0-5389.g668a86f2.el9.x86_64 106/177 2023-08-09T12:35:41.052 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:18.0.0-5389.g668a86f2.el9.x86_64 106/177 2023-08-09T12:35:41.104 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:18.0.0-5389.g668a86f2.el9.x86_64 107/177 2023-08-09T12:35:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/177 2023-08-09T12:35:41.672 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 109/177 2023-08-09T12:35:41.710 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:18.0.0-5389.g668a86f2.el9.x86_64 110/177 2023-08-09T12:35:41.792 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:18.0.0-5389.g668a86f2.el9.x86_64 110/177 2023-08-09T12:35:41.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:18.0.0-5389.g668a86f2.el9.x86_64 111/177 2023-08-09T12:35:44.351 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 112/177 2023-08-09T12:35:44.407 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 112/177 2023-08-09T12:35:45.037 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 112/177 2023-08-09T12:35:45.095 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:18.0.0-5389.g668a86f2.el9.x86_64 113/177 2023-08-09T12:35:45.234 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:18.0.0-5389.g668a86f2.el9.x86_64 113/177 2023-08-09T12:35:45.234 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-08-09T12:35:45.235 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-08-09T12:35:45.235 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:35:45.312 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:18.0.0-5389.g668a86f2.el9.x86_64 114/177 2023-08-09T12:35:58.300 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5389.g668a86f2.el9.x86_64 114/177 2023-08-09T12:35:58.301 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2023-08-09T12:35:58.301 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2023-08-09T12:35:58.301 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2023-08-09T12:35:58.302 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2023-08-09T12:35:58.302 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2023-08-09T12:35:58.302 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2023-08-09T12:35:58.302 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2023-08-09T12:35:58.302 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:35:58.531 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:18.0.0-5389.g668a86f2.el9.noarch 115/177 2023-08-09T12:35:58.584 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:18.0.0-5389.g668a86f2.el9.noarch 115/177 2023-08-09T12:35:58.584 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:35:58.584 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-08-09T12:35:58.584 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:00.331 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:18.0.0-5389.g668a86f2.el9.x86_64 116/177 2023-08-09T12:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:18.0.0-5389.g668a86f2.el9.x86_64 116/177 2023-08-09T12:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-08-09T12:36:00.416 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-09T12:36:00.416 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-09T12:36:00.416 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:00.665 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:18.0.0-5389.g668a86f2.el9.x86_64 117/177 2023-08-09T12:36:00.738 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:18.0.0-5389.g668a86f2.el9.x86_64 117/177 2023-08-09T12:36:00.738 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:36:00.738 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-08-09T12:36:00.738 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-09T12:36:00.739 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-09T12:36:00.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:18.0.0-5389.g668a86f2.el9.x86_64 118/177 2023-08-09T12:36:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:18.0.0-5389.g668a86f2.el9.x86_64 118/177 2023-08-09T12:36:01.345 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:36:01.345 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-08-09T12:36:01.345 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-09T12:36:01.345 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-09T12:36:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:01.467 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 119/177 2023-08-09T12:36:02.107 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 120/177 2023-08-09T12:36:02.161 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 120/177 2023-08-09T12:36:02.226 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.e 121/177 2023-08-09T12:36:02.362 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2. 122/177 2023-08-09T12:36:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el9.noa 123/177 2023-08-09T12:36:02.784 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el9.noa 123/177 2023-08-09T12:36:02.831 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el9.n 124/177 2023-08-09T12:36:03.995 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el9.n 124/177 2023-08-09T12:36:04.039 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 125/177 2023-08-09T12:36:04.180 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 125/177 2023-08-09T12:36:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el 126/177 2023-08-09T12:36:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:18.0.0-5389.g668a86f2.el9.x86_64 127/177 2023-08-09T12:36:04.475 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5389.g668a86f2.el9.x86_64 127/177 2023-08-09T12:36:04.475 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:36:04.476 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-08-09T12:36:04.476 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-09T12:36:04.476 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-09T12:36:04.476 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el9.noarch 128/177 2023-08-09T12:36:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el9.noarch 128/177 2023-08-09T12:36:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:18.0.0-5389.g668a86f2.el9.x86_64 129/177 2023-08-09T12:36:05.568 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/177 2023-08-09T12:36:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:18.0.0-5389.g668a86f2.el9.x86_64 131/177 2023-08-09T12:36:05.736 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5389.g668a86f2.el9.x86_64 131/177 2023-08-09T12:36:05.736 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:36:05.737 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-08-09T12:36:05.737 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-09T12:36:05.737 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-09T12:36:05.737 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:05.803 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5389.g668a8 132/177 2023-08-09T12:36:05.879 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5389.g668a8 132/177 2023-08-09T12:36:05.879 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:36:05.879 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-08-09T12:36:05.879 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:05.954 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 133/177 2023-08-09T12:36:06.071 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 133/177 2023-08-09T12:36:06.071 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:36:06.071 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-08-09T12:36:06.072 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-09T12:36:06.072 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-09T12:36:06.072 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:06.484 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 134/177 2023-08-09T12:36:06.563 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 134/177 2023-08-09T12:36:06.563 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:36:06.563 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-08-09T12:36:06.563 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-09T12:36:06.563 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-09T12:36:06.563 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:10.743 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:18.0.0-5389.g668a86f2.el9.x86_64 135/177 2023-08-09T12:36:10.814 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 136/177 2023-08-09T12:36:10.865 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:18.0.0-5389.g668a86f2.el9.x86_64 137/177 2023-08-09T12:36:11.145 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 138/177 2023-08-09T12:36:11.300 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 139/177 2023-08-09T12:36:11.358 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 140/177 2023-08-09T12:36:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 141/177 2023-08-09T12:36:11.508 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsdump-3.1.12-3.el9.x86_64 142/177 2023-08-09T12:36:11.641 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-user-2.37.4-11.el9.x86_64 143/177 2023-08-09T12:36:11.701 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : iproute-tc-6.2.0-5.el9.x86_64 144/177 2023-08-09T12:36:11.755 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/177 2023-08-09T12:36:11.807 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:18.0.0-5389.g668a86f2.el9.x86_ 146/177 2023-08-09T12:36:11.887 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.43.90-1.el9.x86_64 147/177 2023-08-09T12:36:11.940 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.43.90-1.el9.x86_64 148/177 2023-08-09T12:36:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-09T12:36:12.903 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-09T12:36:12.961 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-09T12:36:14.235 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:18.0.0-5389.g668a86f2.el9.noarch 150/177 2023-08-09T12:36:14.325 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 151/177 2023-08-09T12:36:14.386 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/177 2023-08-09T12:36:14.560 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/177 2023-08-09T12:36:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/177 2023-08-09T12:36:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.41.8-1.el9.x86_64 155/177 2023-08-09T12:36:14.718 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.188-3.el9.x86_64 156/177 2023-08-09T12:36:14.778 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.188-3.el9.x86_64 157/177 2023-08-09T12:36:14.778 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-09T12:36:14.963 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-09T12:36:15.049 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.0.7-2.el9.x86_64 159/177 2023-08-09T12:36:15.050 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-09T12:36:15.192 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-09T12:36:15.255 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsdump-3.1.10-1.el9.x86_64 161/177 2023-08-09T12:36:15.318 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.14.2-1.el9.x86_64 162/177 2023-08-09T12:36:15.373 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : iproute-tc-6.0.0-2.el9.x86_64 163/177 2023-08-09T12:36:15.424 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : iproute-6.0.0-2.el9.x86_64 164/177 2023-08-09T12:36:15.507 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-user-2.37.4-9.el9.x86_64 165/177 2023-08-09T12:36:15.596 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-2.37.4-9.el9.x86_64 166/177 2023-08-09T12:36:15.655 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-core-2.37.4-9.el9.x86_64 167/177 2023-08-09T12:36:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libfdisk-2.37.4-9.el9.x86_64 168/177 2023-08-09T12:36:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libmount-2.37.4-9.el9.x86_64 169/177 2023-08-09T12:36:15.814 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libblkid-2.37.4-9.el9.x86_64 170/177 2023-08-09T12:36:15.864 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.41.8-1.el9.x86_64 171/177 2023-08-09T12:36:15.903 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-09T12:36:15.904 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-09T12:36:16.247 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-09T12:36:16.247 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-09T12:36:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-09T12:36:16.458 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libuuid-2.37.4-9.el9.x86_64 174/177 2023-08-09T12:36:16.501 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsmartcols-2.37.4-9.el9.x86_64 175/177 2023-08-09T12:36:16.553 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.188-3.el9.x86_64 176/177 2023-08-09T12:36:16.698 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-09T12:36:17.172 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-09T12:36:17.172 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-09T12:36:17.172 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:21.991 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:18.0.0-5389.g668a86f2.el9.x86_64 1/177 2023-08-09T12:36:21.991 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:18.0.0-5389.g668a86f2.el9.x86_64 2/177 2023-08-09T12:36:21.991 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 3/177 2023-08-09T12:36:21.991 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 4/177 2023-08-09T12:36:21.992 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5389.g668a8 5/177 2023-08-09T12:36:21.992 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:18.0.0-5389.g668a86f2.el9.x86_64 6/177 2023-08-09T12:36:21.992 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:18.0.0-5389.g668a86f2.el9.x86_64 7/177 2023-08-09T12:36:21.992 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:18.0.0-5389.g668a86f2.el9.x86_64 8/177 2023-08-09T12:36:21.992 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:18.0.0-5389.g668a86f2.el9.x86_64 9/177 2023-08-09T12:36:21.992 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:18.0.0-5389.g668a86f2.el9.x86_64 10/177 2023-08-09T12:36:21.992 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:18.0.0-5389.g668a86f2.el9.x86_64 11/177 2023-08-09T12:36:21.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:18.0.0-5389.g668a86f2.el9.x86_64 12/177 2023-08-09T12:36:21.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 13/177 2023-08-09T12:36:21.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:18.0.0-5389.g668a86f2.el9.x86_ 14/177 2023-08-09T12:36:21.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:18.0.0-5389.g668a86f2.el9.x86_64 15/177 2023-08-09T12:36:21.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:18.0.0-5389.g668a86f2.el9.x86_64 16/177 2023-08-09T12:36:21.993 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:18.0.0-5389.g668a86f2.el9.x86_6 17/177 2023-08-09T12:36:21.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:18.0.0-5389.g668a86f2.el9.x86 18/177 2023-08-09T12:36:21.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:18.0.0-5389.g668a86f2.el9.x86_64 19/177 2023-08-09T12:36:21.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el 20/177 2023-08-09T12:36:21.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:18.0.0-5389.g668a86f2.el9. 21/177 2023-08-09T12:36:21.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:18.0.0-5389.g668a86f2.el9.x86_6 22/177 2023-08-09T12:36:21.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:18.0.0-5389.g668a86f2.el9.x86_64 23/177 2023-08-09T12:36:21.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:18.0.0-5389.g668a86f2.el9.x86_64 24/177 2023-08-09T12:36:21.994 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:18.0.0-5389.g668a86f2.el9.x86_64 25/177 2023-08-09T12:36:21.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 26/177 2023-08-09T12:36:21.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 27/177 2023-08-09T12:36:21.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:18.0.0-5389.g668a86f2.el9.x86_64 28/177 2023-08-09T12:36:22.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2. 29/177 2023-08-09T12:36:22.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el9.noa 30/177 2023-08-09T12:36:22.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el9.n 31/177 2023-08-09T12:36:22.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 32/177 2023-08-09T12:36:22.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el 33/177 2023-08-09T12:36:22.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el9.noarch 34/177 2023-08-09T12:36:22.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.e 35/177 2023-08-09T12:36:22.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:18.0.0-5389.g668a86f2.el9.noarch 36/177 2023-08-09T12:36:22.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 37/177 2023-08-09T12:36:22.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:18.0.0-5389.g668a86f2.el9.noarch 38/177 2023-08-09T12:36:22.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/177 2023-08-09T12:36:22.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/177 2023-08-09T12:36:22.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/177 2023-08-09T12:36:22.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 42/177 2023-08-09T12:36:22.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/177 2023-08-09T12:36:22.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/177 2023-08-09T12:36:22.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/177 2023-08-09T12:36:22.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/177 2023-08-09T12:36:22.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-15.el9.x86_64 47/177 2023-08-09T12:36:22.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/177 2023-08-09T12:36:22.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/177 2023-08-09T12:36:22.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/177 2023-08-09T12:36:22.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/177 2023-08-09T12:36:22.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/177 2023-08-09T12:36:22.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-11.el9.x86_64 53/177 2023-08-09T12:36:22.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/177 2023-08-09T12:36:22.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/177 2023-08-09T12:36:22.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/177 2023-08-09T12:36:22.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/177 2023-08-09T12:36:22.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/177 2023-08-09T12:36:22.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/177 2023-08-09T12:36:22.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/177 2023-08-09T12:36:22.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/177 2023-08-09T12:36:22.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/177 2023-08-09T12:36:22.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/177 2023-08-09T12:36:22.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/177 2023-08-09T12:36:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/177 2023-08-09T12:36:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/177 2023-08-09T12:36:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/177 2023-08-09T12:36:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/177 2023-08-09T12:36:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/177 2023-08-09T12:36:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/177 2023-08-09T12:36:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/177 2023-08-09T12:36:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/177 2023-08-09T12:36:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/177 2023-08-09T12:36:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/177 2023-08-09T12:36:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/177 2023-08-09T12:36:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/177 2023-08-09T12:36:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/177 2023-08-09T12:36:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/177 2023-08-09T12:36:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/177 2023-08-09T12:36:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/177 2023-08-09T12:36:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/177 2023-08-09T12:36:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/177 2023-08-09T12:36:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 83/177 2023-08-09T12:36:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 84/177 2023-08-09T12:36:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 85/177 2023-08-09T12:36:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 86/177 2023-08-09T12:36:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 87/177 2023-08-09T12:36:22.015 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 88/177 2023-08-09T12:36:22.015 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 89/177 2023-08-09T12:36:22.015 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.16-1.el9.x86_64 90/177 2023-08-09T12:36:22.015 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 91/177 2023-08-09T12:36:22.015 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-36.el9.x86_64 92/177 2023-08-09T12:36:22.015 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 93/177 2023-08-09T12:36:22.015 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 94/177 2023-08-09T12:36:22.015 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 95/177 2023-08-09T12:36:22.016 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 96/177 2023-08-09T12:36:22.016 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 97/177 2023-08-09T12:36:22.016 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 98/177 2023-08-09T12:36:22.016 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 99/177 2023-08-09T12:36:22.016 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 100/177 2023-08-09T12:36:22.016 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 101/177 2023-08-09T12:36:22.016 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 102/177 2023-08-09T12:36:22.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 103/177 2023-08-09T12:36:22.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 104/177 2023-08-09T12:36:22.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 105/177 2023-08-09T12:36:22.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 106/177 2023-08-09T12:36:22.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 107/177 2023-08-09T12:36:22.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 108/177 2023-08-09T12:36:22.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 109/177 2023-08-09T12:36:22.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 110/177 2023-08-09T12:36:22.018 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 111/177 2023-08-09T12:36:22.020 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 112/177 2023-08-09T12:36:22.021 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 113/177 2023-08-09T12:36:22.021 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 114/177 2023-08-09T12:36:22.021 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 115/177 2023-08-09T12:36:22.021 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 116/177 2023-08-09T12:36:22.021 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 117/177 2023-08-09T12:36:22.021 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 118/177 2023-08-09T12:36:22.022 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 119/177 2023-08-09T12:36:22.022 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/177 2023-08-09T12:36:22.022 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 121/177 2023-08-09T12:36:22.022 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 122/177 2023-08-09T12:36:22.022 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 123/177 2023-08-09T12:36:22.022 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 124/177 2023-08-09T12:36:22.022 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 125/177 2023-08-09T12:36:22.022 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 126/177 2023-08-09T12:36:22.023 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 127/177 2023-08-09T12:36:22.023 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 128/177 2023-08-09T12:36:22.023 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 129/177 2023-08-09T12:36:22.023 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-2.el9.x86_64 130/177 2023-08-09T12:36:22.023 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 131/177 2023-08-09T12:36:22.023 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:18.0.0-5389.g668a86f2.el9.x86_64 132/177 2023-08-09T12:36:22.023 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 133/177 2023-08-09T12:36:22.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:18.0.0-5389.g668a86f2.el9.x86_64 134/177 2023-08-09T12:36:22.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 135/177 2023-08-09T12:36:22.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.43.90-1.el9.x86_64 136/177 2023-08-09T12:36:22.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.41.8-1.el9.x86_64 137/177 2023-08-09T12:36:22.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.43.90-1.el9.x86_64 138/177 2023-08-09T12:36:22.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 139/177 2023-08-09T12:36:22.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.43.90-1.el9.x86_64 140/177 2023-08-09T12:36:22.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.41.8-1.el9.x86_64 141/177 2023-08-09T12:36:22.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.43.90-1.el9.x86_64 142/177 2023-08-09T12:36:22.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.41.8-1.el9.x86_64 143/177 2023-08-09T12:36:22.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/177 2023-08-09T12:36:22.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el9.x86_64 145/177 2023-08-09T12:36:22.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/177 2023-08-09T12:36:22.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.188-3.el9.x86_64 147/177 2023-08-09T12:36:22.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/177 2023-08-09T12:36:22.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.188-3.el9.x86_64 149/177 2023-08-09T12:36:22.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 150/177 2023-08-09T12:36:22.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-6.0.0-2.el9.x86_64 151/177 2023-08-09T12:36:22.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 152/177 2023-08-09T12:36:22.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-tc-6.0.0-2.el9.x86_64 153/177 2023-08-09T12:36:22.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-11.el9.x86_64 154/177 2023-08-09T12:36:22.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-9.el9.x86_64 155/177 2023-08-09T12:36:22.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-11.el9.x86_64 156/177 2023-08-09T12:36:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-9.el9.x86_64 157/177 2023-08-09T12:36:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-11.el9.x86_64 158/177 2023-08-09T12:36:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-9.el9.x86_64 159/177 2023-08-09T12:36:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-11.el9.x86_64 160/177 2023-08-09T12:36:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-9.el9.x86_64 161/177 2023-08-09T12:36:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-11.el9.x86_64 162/177 2023-08-09T12:36:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-9.el9.x86_64 163/177 2023-08-09T12:36:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 164/177 2023-08-09T12:36:22.028 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-2.el9.x86_64 165/177 2023-08-09T12:36:22.028 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 166/177 2023-08-09T12:36:22.028 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-2.el9.x86_64 167/177 2023-08-09T12:36:22.028 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-11.el9.x86_64 168/177 2023-08-09T12:36:22.028 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-9.el9.x86_64 169/177 2023-08-09T12:36:22.028 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-11.el9.x86_64 170/177 2023-08-09T12:36:22.028 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-9.el9.x86_64 171/177 2023-08-09T12:36:22.028 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-11.el9.x86_64 172/177 2023-08-09T12:36:22.029 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-9.el9.x86_64 173/177 2023-08-09T12:36:22.029 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 174/177 2023-08-09T12:36:22.029 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.10-1.el9.x86_64 175/177 2023-08-09T12:36:22.029 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 176/177 2023-08-09T12:36:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.14.2-1.el9.x86_64 177/177 2023-08-09T12:36:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:24.421 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2023-08-09T12:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.43.90-1.el9.x86_64 2023-08-09T12:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.43.90-1.el9.x86_64 2023-08-09T12:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.43.90-1.el9.x86_64 2023-08-09T12:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.43.90-1.el9.x86_64 2023-08-09T12:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.189-3.el9.x86_64 2023-08-09T12:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.189-3.el9.x86_64 2023-08-09T12:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.189-3.el9.x86_64 2023-08-09T12:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-6.2.0-5.el9.x86_64 2023-08-09T12:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-tc-6.2.0-5.el9.x86_64 2023-08-09T12:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: libmount-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.0.7-24.el9.x86_64 2023-08-09T12:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.0.7-24.el9.x86_64 2023-08-09T12:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump-3.1.12-3.el9.x86_64 2023-08-09T12:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-5.19.0-4.el9.x86_64 2023-08-09T12:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2023-08-09T12:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2023-08-09T12:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2023-08-09T12:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-08-09T12:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-08-09T12:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2023-08-09T12:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-08-09T12:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-08-09T12:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-08-09T12:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: fmt-8.1.1-5.el9.x86_64 2023-08-09T12:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2023-08-09T12:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-08-09T12:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-15.el9.x86_64 2023-08-09T12:36:24.430 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-08-09T12:36:24.430 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-9.el9.x86_64 2023-08-09T12:36:24.430 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-08-09T12:36:24.430 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.430 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.430 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.430 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-08-09T12:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2023-08-09T12:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-08-09T12:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-08-09T12:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-08-09T12:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-08-09T12:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-45.el9.x86_64 2023-08-09T12:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2023-08-09T12:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-11.el9.x86_64 2023-08-09T12:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-08-09T12:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-08-09T12:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-08-09T12:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2023-08-09T12:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-08-09T12:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-08-09T12:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-08-09T12:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.11-1.el9.x86_64 2023-08-09T12:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-08-09T12:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-08-09T12:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.11-1.el9.x86_64 2023-08-09T12:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-08-09T12:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2023-08-09T12:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-08-09T12:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-08-09T12:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-08-09T12:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-08-09T12:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-08-09T12:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-08-09T12:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-08-09T12:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.16-1.el9.x86_64 2023-08-09T12:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-08-09T12:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-08-09T12:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-08-09T12:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-08-09T12:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-08-09T12:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-08-09T12:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-08-09T12:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-08-09T12:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-08-09T12:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-08-09T12:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-08-09T12:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-08-09T12:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-08-09T12:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2023-08-09T12:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-08-09T12:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-08-09T12:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-08-09T12:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-08-09T12:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-08-09T12:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-08-09T12:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-08-09T12:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2023-08-09T12:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2023-08-09T12:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-08-09T12:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-08-09T12:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-08-09T12:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-08-09T12:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2023-08-09T12:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2023-08-09T12:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-08-09T12:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-08-09T12:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2023-08-09T12:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2023-08-09T12:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-08-09T12:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-08-09T12:36:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2023-08-09T12:36:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-08-09T12:36:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2023-08-09T12:36:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-08-09T12:36:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-08-09T12:36:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-08-09T12:36:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-2.el9.x86_64 2023-08-09T12:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2023-08-09T12:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2023-08-09T12:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2023-08-09T12:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-08-09T12:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-08-09T12:36:24.443 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-36.el9.x86_64 2023-08-09T12:36:24.443 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:36:24.443 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-08-09T12:36:25.067 DEBUG:teuthology.parallel:result is None 2023-08-09T12:37:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:[MIRROR] gperftools-libs-2.9.1-2.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-2.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-09T12:37:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:[MIRROR] libarrow-9.0.0-9.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-9.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-09T12:37:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:[MIRROR] fmt-8.1.1-5.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.es.its.nyu.edu/epel/9/Everything/x86_64/Packages/f/fmt-8.1.1-5.el9.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-09T12:37:17.358 INFO:teuthology.orchestra.run.smithi017.stdout:(93/154): fmt-8.1.1-5.el9.x86_64.rpm 837 B/s | 111 kB 02:15 2023-08-09T12:37:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:(94/154): libarrow-doc-9.0.0-9.el9.noarch.rpm 210 kB/s | 24 kB 00:00 2023-08-09T12:37:17.525 INFO:teuthology.orchestra.run.smithi017.stdout:(95/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.3 kB/s | 309 kB 02:15 2023-08-09T12:37:17.617 INFO:teuthology.orchestra.run.smithi017.stdout:(96/154): liboath-2.6.7-2.el9.x86_64.rpm 345 kB/s | 49 kB 00:00 2023-08-09T12:37:17.667 INFO:teuthology.orchestra.run.smithi017.stdout:(97/154): libunwind-1.6.2-1.el9.x86_64.rpm 477 kB/s | 67 kB 00:00 2023-08-09T12:37:17.984 INFO:teuthology.orchestra.run.smithi017.stdout:(98/154): libarrow-9.0.0-9.el9.x86_64.rpm 33 kB/s | 4.4 MB 02:15 2023-08-09T12:37:18.034 INFO:teuthology.orchestra.run.smithi017.stdout:(99/154): python3-asyncssh-2.13.2-3.el9.noarch. 1.5 MB/s | 548 kB 00:00 2023-08-09T12:37:18.093 INFO:teuthology.orchestra.run.smithi017.stdout:(100/154): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.7 MB/s | 837 kB 00:00 2023-08-09T12:37:18.118 INFO:teuthology.orchestra.run.smithi017.stdout:(101/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 326 kB/s | 43 kB 00:00 2023-08-09T12:37:18.144 INFO:teuthology.orchestra.run.smithi017.stdout:(102/154): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2023-08-09T12:37:18.186 INFO:teuthology.orchestra.run.smithi017.stdout:(103/154): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2023-08-09T12:37:18.227 INFO:teuthology.orchestra.run.smithi017.stdout:(104/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2023-08-09T12:37:18.269 INFO:teuthology.orchestra.run.smithi017.stdout:(105/154): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-08-09T12:37:18.320 INFO:teuthology.orchestra.run.smithi017.stdout:(106/154): python3-google-auth-2.22.0-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-08-09T12:37:18.345 INFO:teuthology.orchestra.run.smithi017.stdout:(107/154): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2023-08-09T12:37:18.370 INFO:teuthology.orchestra.run.smithi017.stdout:(108/154): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2023-08-09T12:37:18.412 INFO:teuthology.orchestra.run.smithi017.stdout:(109/154): python3-jaraco-collections-3.0.0-8.e 254 kB/s | 23 kB 00:00 2023-08-09T12:37:18.437 INFO:teuthology.orchestra.run.smithi017.stdout:(110/154): python3-jaraco-functools-3.5.0-2.el9 213 kB/s | 19 kB 00:00 2023-08-09T12:37:18.488 INFO:teuthology.orchestra.run.smithi017.stdout:(111/154): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2023-08-09T12:37:18.513 INFO:teuthology.orchestra.run.smithi017.stdout:(112/154): python3-jwt+crypto-2.4.0-1.el9.noarc 91 kB/s | 9.0 kB 00:00 2023-08-09T12:37:18.538 INFO:teuthology.orchestra.run.smithi017.stdout:(113/154): python3-jwt-2.4.0-1.el9.noarch.rpm 410 kB/s | 41 kB 00:00 2023-08-09T12:37:18.589 INFO:teuthology.orchestra.run.smithi017.stdout:(114/154): python3-logutils-0.3.5-21.el9.noarch 622 kB/s | 46 kB 00:00 2023-08-09T12:37:18.630 INFO:teuthology.orchestra.run.smithi017.stdout:(115/154): python3-more-itertools-8.12.0-2.el9. 865 kB/s | 79 kB 00:00 2023-08-09T12:37:18.664 INFO:teuthology.orchestra.run.smithi017.stdout:(116/154): python3-natsort-7.1.1-5.el9.noarch.r 776 kB/s | 58 kB 00:00 2023-08-09T12:37:18.723 INFO:teuthology.orchestra.run.smithi017.stdout:(117/154): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2023-08-09T12:37:18.748 INFO:teuthology.orchestra.run.smithi017.stdout:(118/154): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2023-08-09T12:37:18.790 INFO:teuthology.orchestra.run.smithi017.stdout:(119/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2023-08-09T12:37:18.823 INFO:teuthology.orchestra.run.smithi017.stdout:(120/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 904 kB/s | 90 kB 00:00 2023-08-09T12:37:18.848 INFO:teuthology.orchestra.run.smithi017.stdout:(121/154): python3-repoze-lru-0.7-16.el9.noarch 309 kB/s | 31 kB 00:00 2023-08-09T12:37:18.899 INFO:teuthology.orchestra.run.smithi017.stdout:(122/154): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-08-09T12:37:18.924 INFO:teuthology.orchestra.run.smithi017.stdout:(123/154): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2023-08-09T12:37:18.949 INFO:teuthology.orchestra.run.smithi017.stdout:(124/154): python3-rsa-4.9-2.el9.noarch.rpm 473 kB/s | 59 kB 00:00 2023-08-09T12:37:18.975 INFO:teuthology.orchestra.run.smithi017.stdout:(125/154): python3-typing-extensions-4.4.0-2.el 686 kB/s | 51 kB 00:00 2023-08-09T12:37:19.025 INFO:teuthology.orchestra.run.smithi017.stdout:(126/154): python3-webob-1.8.7-6.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2023-08-09T12:37:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:(127/154): python3-websocket-client-1.2.3-2.el9 674 kB/s | 90 kB 00:00 2023-08-09T12:37:19.100 INFO:teuthology.orchestra.run.smithi017.stdout:(128/154): python3-zc-lockfile-2.0-10.el9.noarc 267 kB/s | 20 kB 00:00 2023-08-09T12:37:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:(129/154): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2023-08-09T12:37:19.193 INFO:teuthology.orchestra.run.smithi017.stdout:(130/154): re2-20211101-2.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-08-09T12:37:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:(131/154): thrift-0.15.0-2.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2023-08-09T12:37:19.652 INFO:teuthology.orchestra.run.smithi017.stdout:(132/154): NetworkManager-1.43.90-1.el9.x86_64. 8.7 MB/s | 2.2 MB 00:00 2023-08-09T12:37:19.752 INFO:teuthology.orchestra.run.smithi017.stdout:(133/154): NetworkManager-libnm-1.43.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2023-08-09T12:37:19.794 INFO:teuthology.orchestra.run.smithi017.stdout:(134/154): NetworkManager-team-1.43.90-1.el9.x8 1.0 MB/s | 41 kB 00:00 2023-08-09T12:37:19.853 INFO:teuthology.orchestra.run.smithi017.stdout:(135/154): NetworkManager-tui-1.43.90-1.el9.x86 4.2 MB/s | 245 kB 00:00 2023-08-09T12:37:19.886 INFO:teuthology.orchestra.run.smithi017.stdout:(136/154): elfutils-debuginfod-client-0.189-3.e 1.1 MB/s | 36 kB 00:00 2023-08-09T12:37:19.945 INFO:teuthology.orchestra.run.smithi017.stdout:(137/154): elfutils-libelf-0.189-3.el9.x86_64.r 3.3 MB/s | 192 kB 00:00 2023-08-09T12:37:20.003 INFO:teuthology.orchestra.run.smithi017.stdout:(138/154): elfutils-libs-0.189-3.el9.x86_64.rpm 4.3 MB/s | 254 kB 00:00 2023-08-09T12:37:20.071 INFO:teuthology.orchestra.run.smithi017.stdout:(139/154): iproute-6.2.0-5.el9.x86_64.rpm 12 MB/s | 785 kB 00:00 2023-08-09T12:37:20.129 INFO:teuthology.orchestra.run.smithi017.stdout:(140/154): iproute-tc-6.2.0-5.el9.x86_64.rpm 7.6 MB/s | 448 kB 00:00 2023-08-09T12:37:20.246 INFO:teuthology.orchestra.run.smithi017.stdout:(141/154): librados2-18.0.0-5389.g668a86f2.el9. 3.0 MB/s | 3.3 MB 00:01 2023-08-09T12:37:20.280 INFO:teuthology.orchestra.run.smithi017.stdout:(142/154): libblkid-2.37.4-11.el9.x86_64.rpm 716 kB/s | 107 kB 00:00 2023-08-09T12:37:20.321 INFO:teuthology.orchestra.run.smithi017.stdout:(143/154): libfdisk-2.37.4-11.el9.x86_64.rpm 2.1 MB/s | 153 kB 00:00 2023-08-09T12:37:20.355 INFO:teuthology.orchestra.run.smithi017.stdout:(144/154): libmount-2.37.4-11.el9.x86_64.rpm 1.8 MB/s | 133 kB 00:00 2023-08-09T12:37:20.380 INFO:teuthology.orchestra.run.smithi017.stdout:(145/154): libsmartcols-2.37.4-11.el9.x86_64.rp 1.1 MB/s | 62 kB 00:00 2023-08-09T12:37:20.409 INFO:teuthology.orchestra.run.smithi017.stdout:(146/154): libuuid-2.37.4-11.el9.x86_64.rpm 562 kB/s | 27 kB 00:00 2023-08-09T12:37:20.481 INFO:teuthology.orchestra.run.smithi017.stdout:(147/154): openssl-3.0.7-24.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2023-08-09T12:37:20.581 INFO:teuthology.orchestra.run.smithi017.stdout:(148/154): openssl-libs-3.0.7-24.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2023-08-09T12:37:20.673 INFO:teuthology.orchestra.run.smithi017.stdout:(149/154): util-linux-2.37.4-11.el9.x86_64.rpm 13 MB/s | 2.2 MB 00:00 2023-08-09T12:37:20.724 INFO:teuthology.orchestra.run.smithi017.stdout:(150/154): util-linux-core-2.37.4-11.el9.x86_64 3.4 MB/s | 432 kB 00:00 2023-08-09T12:37:20.749 INFO:teuthology.orchestra.run.smithi017.stdout:(151/154): util-linux-user-2.37.4-11.el9.x86_64 428 kB/s | 30 kB 00:00 2023-08-09T12:37:20.807 INFO:teuthology.orchestra.run.smithi017.stdout:(152/154): xfsdump-3.1.12-3.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2023-08-09T12:37:20.907 INFO:teuthology.orchestra.run.smithi017.stdout:(153/154): librbd1-18.0.0-5389.g668a86f2.el9.x8 1.8 MB/s | 3.0 MB 00:01 2023-08-09T12:37:23.424 INFO:teuthology.orchestra.run.smithi017.stdout:(154/154): xfsprogs-5.19.0-4.el9.x86_64.rpm 400 kB/s | 1.0 MB 00:02 2023-08-09T12:37:23.432 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-08-09T12:37:23.433 INFO:teuthology.orchestra.run.smithi017.stdout:Total 1.4 MB/s | 205 MB 02:31 2023-08-09T12:37:23.616 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2023-08-09T12:37:23.953 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2023-08-09T12:37:23.954 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2023-08-09T12:37:26.262 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2023-08-09T12:37:26.263 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2023-08-09T12:37:32.980 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2023-08-09T12:37:33.111 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-libs-1:3.0.7-24.el9.x86_64 1/177 2023-08-09T12:37:33.171 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libuuid-2.37.4-11.el9.x86_64 2/177 2023-08-09T12:37:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libblkid-2.37.4-11.el9.x86_64 3/177 2023-08-09T12:37:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libblkid-2.37.4-11.el9.x86_64 3/177 2023-08-09T12:37:33.544 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/177 2023-08-09T12:37:33.629 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-libelf-0.189-3.el9.x86_64 5/177 2023-08-09T12:37:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/177 2023-08-09T12:37:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/177 2023-08-09T12:37:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/177 2023-08-09T12:37:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/177 2023-08-09T12:37:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/177 2023-08-09T12:37:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:18.0.0-5389.g668a86f2.el9.x86_64 11/177 2023-08-09T12:37:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:18.0.0-5389.g668a86f2.el9.x86_64 11/177 2023-08-09T12:37:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:18.0.0-5389.g668a86f2.el9.x86_64 12/177 2023-08-09T12:37:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:18.0.0-5389.g668a86f2.el9.x86_64 12/177 2023-08-09T12:37:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:18.0.0-5389.g668a86f2.el9.x86_64 13/177 2023-08-09T12:37:35.326 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/177 2023-08-09T12:37:35.404 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/177 2023-08-09T12:37:35.445 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:18.0.0-5389.g668a86f2.el9.x86_64 16/177 2023-08-09T12:37:35.594 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5389.g668a86f2.el9.x86_64 16/177 2023-08-09T12:37:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:18.0.0-5389.g668a86f2.el9.x86 17/177 2023-08-09T12:37:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5389.g668a86f2.el9.x86 17/177 2023-08-09T12:37:35.818 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libmount-2.37.4-11.el9.x86_64 18/177 2023-08-09T12:37:36.234 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libsmartcols-2.37.4-11.el9.x86_64 19/177 2023-08-09T12:37:36.385 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.43.90-1.el9.x86_64 20/177 2023-08-09T12:37:36.482 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.43.90-1.el9.x86_64 20/177 2023-08-09T12:37:36.699 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-09T12:37:36.787 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-09T12:37:37.296 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.43.90-1.el9.x86_64 21/177 2023-08-09T12:37:37.367 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/177 2023-08-09T12:37:37.415 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/177 2023-08-09T12:37:37.536 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 24/177 2023-08-09T12:37:37.624 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 25/177 2023-08-09T12:37:37.768 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/177 2023-08-09T12:37:37.836 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/177 2023-08-09T12:37:37.892 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/177 2023-08-09T12:37:38.036 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/177 2023-08-09T12:37:38.105 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:18.0.0-5389.g668a86f2.el9. 30/177 2023-08-09T12:37:38.167 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el 31/177 2023-08-09T12:37:38.297 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:18.0.0-5389.g668a86f2.el9.x86_6 32/177 2023-08-09T12:37:38.499 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/177 2023-08-09T12:37:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/177 2023-08-09T12:37:39.368 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/177 2023-08-09T12:37:39.483 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/177 2023-08-09T12:37:39.609 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/177 2023-08-09T12:37:39.661 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-core-2.37.4-11.el9.x86_64 38/177 2023-08-09T12:37:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: util-linux-core-2.37.4-11.el9.x86_64 38/177 2023-08-09T12:37:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:18.0.0-5389.g668a86f2.el9.x86_6 39/177 2023-08-09T12:37:39.844 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/177 2023-08-09T12:37:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-libs-0.189-3.el9.x86_64 41/177 2023-08-09T12:37:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : iproute-6.2.0-5.el9.x86_64 42/177 2023-08-09T12:37:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libfdisk-2.37.4-11.el9.x86_64 43/177 2023-08-09T12:37:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-2.37.4-11.el9.x86_64 44/177 2023-08-09T12:37:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : xfsprogs-5.19.0-4.el9.x86_64 45/177 2023-08-09T12:37:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-11.el9.x86_64 46/177 2023-08-09T12:37:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/177 2023-08-09T12:37:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-1:3.0.7-24.el9.x86_64 48/177 2023-08-09T12:37:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-2.el9.x86_64 49/177 2023-08-09T12:37:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 50/177 2023-08-09T12:37:41.568 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/177 2023-08-09T12:37:41.691 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/177 2023-08-09T12:37:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/177 2023-08-09T12:37:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/177 2023-08-09T12:37:41.885 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/177 2023-08-09T12:37:41.971 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/177 2023-08-09T12:37:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/177 2023-08-09T12:37:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/177 2023-08-09T12:37:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/177 2023-08-09T12:37:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/177 2023-08-09T12:37:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/177 2023-08-09T12:37:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 62/177 2023-08-09T12:37:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/177 2023-08-09T12:37:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/177 2023-08-09T12:37:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 65/177 2023-08-09T12:37:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fmt-8.1.1-5.el9.x86_64 66/177 2023-08-09T12:37:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-36.el9.x86_64 67/177 2023-08-09T12:37:43.139 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.16-1.el9.x86_64 68/177 2023-08-09T12:37:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 69/177 2023-08-09T12:37:43.329 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 70/177 2023-08-09T12:37:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 71/177 2023-08-09T12:37:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 72/177 2023-08-09T12:37:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 73/177 2023-08-09T12:37:43.946 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 74/177 2023-08-09T12:37:43.995 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 75/177 2023-08-09T12:37:44.065 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 76/177 2023-08-09T12:37:44.125 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 77/177 2023-08-09T12:37:44.183 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-15.el9.x86_64 78/177 2023-08-09T12:37:44.254 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/177 2023-08-09T12:37:44.333 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/177 2023-08-09T12:37:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/177 2023-08-09T12:37:44.583 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/177 2023-08-09T12:37:44.644 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/177 2023-08-09T12:37:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/177 2023-08-09T12:37:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/177 2023-08-09T12:37:44.833 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/177 2023-08-09T12:37:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/177 2023-08-09T12:37:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/177 2023-08-09T12:37:45.215 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/177 2023-08-09T12:37:45.298 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/177 2023-08-09T12:37:46.348 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/177 2023-08-09T12:37:46.416 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/177 2023-08-09T12:37:46.458 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/177 2023-08-09T12:37:46.500 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/177 2023-08-09T12:37:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/177 2023-08-09T12:37:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/177 2023-08-09T12:37:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/177 2023-08-09T12:37:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/177 2023-08-09T12:37:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/177 2023-08-09T12:37:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/177 2023-08-09T12:37:49.774 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/177 2023-08-09T12:37:49.820 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 102/177 2023-08-09T12:37:49.859 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.6-15.el9.x86_64 103/177 2023-08-09T12:37:49.909 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/177 2023-08-09T12:37:50.312 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/177 2023-08-09T12:37:50.356 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:18.0.0-5389.g668a86f2.el9.x86_64 106/177 2023-08-09T12:37:50.479 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:18.0.0-5389.g668a86f2.el9.x86_64 106/177 2023-08-09T12:37:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:18.0.0-5389.g668a86f2.el9.x86_64 107/177 2023-08-09T12:37:50.589 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/177 2023-08-09T12:37:51.121 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 109/177 2023-08-09T12:37:51.158 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:18.0.0-5389.g668a86f2.el9.x86_64 110/177 2023-08-09T12:37:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:18.0.0-5389.g668a86f2.el9.x86_64 110/177 2023-08-09T12:37:51.324 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:18.0.0-5389.g668a86f2.el9.x86_64 111/177 2023-08-09T12:37:53.991 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 112/177 2023-08-09T12:37:54.040 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 112/177 2023-08-09T12:37:54.739 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 112/177 2023-08-09T12:37:54.802 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:18.0.0-5389.g668a86f2.el9.x86_64 113/177 2023-08-09T12:37:54.997 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:18.0.0-5389.g668a86f2.el9.x86_64 113/177 2023-08-09T12:37:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-08-09T12:37:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-08-09T12:37:54.998 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:37:55.052 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:18.0.0-5389.g668a86f2.el9.x86_64 114/177 2023-08-09T12:38:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5389.g668a86f2.el9.x86_64 114/177 2023-08-09T12:38:08.090 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2023-08-09T12:38:08.090 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2023-08-09T12:38:08.091 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2023-08-09T12:38:08.091 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2023-08-09T12:38:08.091 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2023-08-09T12:38:08.091 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2023-08-09T12:38:08.091 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2023-08-09T12:38:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:18.0.0-5389.g668a86f2.el9.noarch 115/177 2023-08-09T12:38:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:18.0.0-5389.g668a86f2.el9.noarch 115/177 2023-08-09T12:38:08.416 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:08.416 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-08-09T12:38:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:10.237 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:18.0.0-5389.g668a86f2.el9.x86_64 116/177 2023-08-09T12:38:10.346 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:18.0.0-5389.g668a86f2.el9.x86_64 116/177 2023-08-09T12:38:10.346 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:10.347 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-08-09T12:38:10.347 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-09T12:38:10.347 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-09T12:38:10.347 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:10.605 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:18.0.0-5389.g668a86f2.el9.x86_64 117/177 2023-08-09T12:38:10.687 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:18.0.0-5389.g668a86f2.el9.x86_64 117/177 2023-08-09T12:38:10.687 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:10.688 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-08-09T12:38:10.688 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-09T12:38:10.688 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-09T12:38:10.688 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:11.230 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:18.0.0-5389.g668a86f2.el9.x86_64 118/177 2023-08-09T12:38:11.310 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:18.0.0-5389.g668a86f2.el9.x86_64 118/177 2023-08-09T12:38:11.310 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:11.311 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-08-09T12:38:11.311 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-09T12:38:11.311 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-09T12:38:11.312 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:11.466 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 119/177 2023-08-09T12:38:11.974 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 120/177 2023-08-09T12:38:12.018 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 120/177 2023-08-09T12:38:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.e 121/177 2023-08-09T12:38:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2. 122/177 2023-08-09T12:38:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el9.noa 123/177 2023-08-09T12:38:12.646 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el9.noa 123/177 2023-08-09T12:38:12.729 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el9.n 124/177 2023-08-09T12:38:13.963 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el9.n 124/177 2023-08-09T12:38:14.004 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 125/177 2023-08-09T12:38:14.154 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 125/177 2023-08-09T12:38:14.340 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el 126/177 2023-08-09T12:38:14.381 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:18.0.0-5389.g668a86f2.el9.x86_64 127/177 2023-08-09T12:38:14.459 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5389.g668a86f2.el9.x86_64 127/177 2023-08-09T12:38:14.459 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:14.459 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-08-09T12:38:14.459 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-09T12:38:14.460 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-09T12:38:14.460 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:14.523 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el9.noarch 128/177 2023-08-09T12:38:14.567 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el9.noarch 128/177 2023-08-09T12:38:14.685 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:18.0.0-5389.g668a86f2.el9.x86_64 129/177 2023-08-09T12:38:15.638 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/177 2023-08-09T12:38:15.684 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:18.0.0-5389.g668a86f2.el9.x86_64 131/177 2023-08-09T12:38:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5389.g668a86f2.el9.x86_64 131/177 2023-08-09T12:38:15.765 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:15.765 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-08-09T12:38:15.765 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-09T12:38:15.765 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-09T12:38:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5389.g668a8 132/177 2023-08-09T12:38:15.906 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5389.g668a8 132/177 2023-08-09T12:38:15.907 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:15.907 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-08-09T12:38:15.907 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:16.002 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 133/177 2023-08-09T12:38:16.091 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 133/177 2023-08-09T12:38:16.092 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:16.092 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-08-09T12:38:16.092 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-09T12:38:16.092 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-09T12:38:16.093 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 134/177 2023-08-09T12:38:16.562 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 134/177 2023-08-09T12:38:16.562 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-09T12:38:16.563 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-08-09T12:38:16.563 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-09T12:38:16.563 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-09T12:38:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:18.0.0-5389.g668a86f2.el9.x86_64 135/177 2023-08-09T12:38:21.090 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 136/177 2023-08-09T12:38:21.148 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:18.0.0-5389.g668a86f2.el9.x86_64 137/177 2023-08-09T12:38:21.459 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 138/177 2023-08-09T12:38:21.602 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 139/177 2023-08-09T12:38:21.673 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 140/177 2023-08-09T12:38:21.757 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 141/177 2023-08-09T12:38:21.865 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : xfsdump-3.1.12-3.el9.x86_64 142/177 2023-08-09T12:38:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-user-2.37.4-11.el9.x86_64 143/177 2023-08-09T12:38:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : iproute-tc-6.2.0-5.el9.x86_64 144/177 2023-08-09T12:38:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/177 2023-08-09T12:38:22.146 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:18.0.0-5389.g668a86f2.el9.x86_ 146/177 2023-08-09T12:38:22.218 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.43.90-1.el9.x86_64 147/177 2023-08-09T12:38:22.288 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.43.90-1.el9.x86_64 148/177 2023-08-09T12:38:23.290 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-09T12:38:23.350 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-09T12:38:23.415 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-09T12:38:24.873 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:18.0.0-5389.g668a86f2.el9.noarch 150/177 2023-08-09T12:38:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 151/177 2023-08-09T12:38:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/177 2023-08-09T12:38:25.186 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/177 2023-08-09T12:38:25.233 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/177 2023-08-09T12:38:25.304 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.41.8-1.el9.x86_64 155/177 2023-08-09T12:38:25.351 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-debuginfod-client-0.188-3.el9.x86_64 156/177 2023-08-09T12:38:25.411 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-libs-0.188-3.el9.x86_64 157/177 2023-08-09T12:38:25.411 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-09T12:38:25.589 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-09T12:38:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-1:3.0.7-2.el9.x86_64 159/177 2023-08-09T12:38:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-09T12:38:25.778 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-09T12:38:25.847 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : xfsdump-3.1.10-1.el9.x86_64 161/177 2023-08-09T12:38:25.910 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : xfsprogs-5.14.2-1.el9.x86_64 162/177 2023-08-09T12:38:25.974 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : iproute-tc-6.0.0-2.el9.x86_64 163/177 2023-08-09T12:38:26.034 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : iproute-6.0.0-2.el9.x86_64 164/177 2023-08-09T12:38:26.122 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-user-2.37.4-9.el9.x86_64 165/177 2023-08-09T12:38:26.213 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-2.37.4-9.el9.x86_64 166/177 2023-08-09T12:38:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-core-2.37.4-9.el9.x86_64 167/177 2023-08-09T12:38:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libfdisk-2.37.4-9.el9.x86_64 168/177 2023-08-09T12:38:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libmount-2.37.4-9.el9.x86_64 169/177 2023-08-09T12:38:26.413 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libblkid-2.37.4-9.el9.x86_64 170/177 2023-08-09T12:38:26.487 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.41.8-1.el9.x86_64 171/177 2023-08-09T12:38:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-09T12:38:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-09T12:38:26.897 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-09T12:38:26.898 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-09T12:38:27.051 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-09T12:38:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libuuid-2.37.4-9.el9.x86_64 174/177 2023-08-09T12:38:27.141 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libsmartcols-2.37.4-9.el9.x86_64 175/177 2023-08-09T12:38:27.194 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-libelf-0.188-3.el9.x86_64 176/177 2023-08-09T12:38:27.341 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-09T12:38:27.826 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-09T12:38:27.826 INFO:teuthology.orchestra.run.smithi017.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-09T12:38:27.826 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:32.582 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:18.0.0-5389.g668a86f2.el9.x86_64 1/177 2023-08-09T12:38:32.582 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:18.0.0-5389.g668a86f2.el9.x86_64 2/177 2023-08-09T12:38:32.582 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 3/177 2023-08-09T12:38:32.583 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 4/177 2023-08-09T12:38:32.583 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5389.g668a8 5/177 2023-08-09T12:38:32.583 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:18.0.0-5389.g668a86f2.el9.x86_64 6/177 2023-08-09T12:38:32.584 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:18.0.0-5389.g668a86f2.el9.x86_64 7/177 2023-08-09T12:38:32.584 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:18.0.0-5389.g668a86f2.el9.x86_64 8/177 2023-08-09T12:38:32.584 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:18.0.0-5389.g668a86f2.el9.x86_64 9/177 2023-08-09T12:38:32.584 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:18.0.0-5389.g668a86f2.el9.x86_64 10/177 2023-08-09T12:38:32.584 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:18.0.0-5389.g668a86f2.el9.x86_64 11/177 2023-08-09T12:38:32.584 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:18.0.0-5389.g668a86f2.el9.x86_64 12/177 2023-08-09T12:38:32.584 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 13/177 2023-08-09T12:38:32.585 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:18.0.0-5389.g668a86f2.el9.x86_ 14/177 2023-08-09T12:38:32.585 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:18.0.0-5389.g668a86f2.el9.x86_64 15/177 2023-08-09T12:38:32.585 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:18.0.0-5389.g668a86f2.el9.x86_64 16/177 2023-08-09T12:38:32.585 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:18.0.0-5389.g668a86f2.el9.x86_6 17/177 2023-08-09T12:38:32.585 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:18.0.0-5389.g668a86f2.el9.x86 18/177 2023-08-09T12:38:32.585 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:18.0.0-5389.g668a86f2.el9.x86_64 19/177 2023-08-09T12:38:32.585 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el 20/177 2023-08-09T12:38:32.586 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:18.0.0-5389.g668a86f2.el9. 21/177 2023-08-09T12:38:32.586 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:18.0.0-5389.g668a86f2.el9.x86_6 22/177 2023-08-09T12:38:32.586 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:18.0.0-5389.g668a86f2.el9.x86_64 23/177 2023-08-09T12:38:32.586 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:18.0.0-5389.g668a86f2.el9.x86_64 24/177 2023-08-09T12:38:32.586 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:18.0.0-5389.g668a86f2.el9.x86_64 25/177 2023-08-09T12:38:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 26/177 2023-08-09T12:38:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 27/177 2023-08-09T12:38:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:18.0.0-5389.g668a86f2.el9.x86_64 28/177 2023-08-09T12:38:32.600 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2. 29/177 2023-08-09T12:38:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el9.noa 30/177 2023-08-09T12:38:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el9.n 31/177 2023-08-09T12:38:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5389.g668 32/177 2023-08-09T12:38:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el 33/177 2023-08-09T12:38:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el9.noarch 34/177 2023-08-09T12:38:32.601 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.e 35/177 2023-08-09T12:38:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:18.0.0-5389.g668a86f2.el9.noarch 36/177 2023-08-09T12:38:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 37/177 2023-08-09T12:38:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:18.0.0-5389.g668a86f2.el9.noarch 38/177 2023-08-09T12:38:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/177 2023-08-09T12:38:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/177 2023-08-09T12:38:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/177 2023-08-09T12:38:32.602 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 42/177 2023-08-09T12:38:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/177 2023-08-09T12:38:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/177 2023-08-09T12:38:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/177 2023-08-09T12:38:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/177 2023-08-09T12:38:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.6-15.el9.x86_64 47/177 2023-08-09T12:38:32.603 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/177 2023-08-09T12:38:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/177 2023-08-09T12:38:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/177 2023-08-09T12:38:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/177 2023-08-09T12:38:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/177 2023-08-09T12:38:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-11.el9.x86_64 53/177 2023-08-09T12:38:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/177 2023-08-09T12:38:32.604 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/177 2023-08-09T12:38:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/177 2023-08-09T12:38:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/177 2023-08-09T12:38:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/177 2023-08-09T12:38:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/177 2023-08-09T12:38:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/177 2023-08-09T12:38:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/177 2023-08-09T12:38:32.605 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/177 2023-08-09T12:38:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/177 2023-08-09T12:38:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/177 2023-08-09T12:38:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/177 2023-08-09T12:38:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/177 2023-08-09T12:38:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/177 2023-08-09T12:38:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/177 2023-08-09T12:38:32.606 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/177 2023-08-09T12:38:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/177 2023-08-09T12:38:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/177 2023-08-09T12:38:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/177 2023-08-09T12:38:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/177 2023-08-09T12:38:32.607 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/177 2023-08-09T12:38:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/177 2023-08-09T12:38:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/177 2023-08-09T12:38:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/177 2023-08-09T12:38:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/177 2023-08-09T12:38:32.608 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/177 2023-08-09T12:38:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/177 2023-08-09T12:38:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/177 2023-08-09T12:38:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/177 2023-08-09T12:38:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 83/177 2023-08-09T12:38:32.609 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 84/177 2023-08-09T12:38:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 85/177 2023-08-09T12:38:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 86/177 2023-08-09T12:38:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 87/177 2023-08-09T12:38:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 88/177 2023-08-09T12:38:32.610 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 89/177 2023-08-09T12:38:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.16-1.el9.x86_64 90/177 2023-08-09T12:38:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 91/177 2023-08-09T12:38:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-36.el9.x86_64 92/177 2023-08-09T12:38:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 93/177 2023-08-09T12:38:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 94/177 2023-08-09T12:38:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 95/177 2023-08-09T12:38:32.611 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 96/177 2023-08-09T12:38:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 97/177 2023-08-09T12:38:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 98/177 2023-08-09T12:38:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 99/177 2023-08-09T12:38:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 100/177 2023-08-09T12:38:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 101/177 2023-08-09T12:38:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 102/177 2023-08-09T12:38:32.612 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 103/177 2023-08-09T12:38:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 104/177 2023-08-09T12:38:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 105/177 2023-08-09T12:38:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 106/177 2023-08-09T12:38:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 107/177 2023-08-09T12:38:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 108/177 2023-08-09T12:38:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 109/177 2023-08-09T12:38:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 110/177 2023-08-09T12:38:32.613 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 111/177 2023-08-09T12:38:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 112/177 2023-08-09T12:38:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 113/177 2023-08-09T12:38:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 114/177 2023-08-09T12:38:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 115/177 2023-08-09T12:38:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 116/177 2023-08-09T12:38:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 117/177 2023-08-09T12:38:32.614 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 118/177 2023-08-09T12:38:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 119/177 2023-08-09T12:38:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/177 2023-08-09T12:38:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 121/177 2023-08-09T12:38:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 122/177 2023-08-09T12:38:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 123/177 2023-08-09T12:38:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 124/177 2023-08-09T12:38:32.615 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 125/177 2023-08-09T12:38:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 126/177 2023-08-09T12:38:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 127/177 2023-08-09T12:38:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 128/177 2023-08-09T12:38:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 129/177 2023-08-09T12:38:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-2.el9.x86_64 130/177 2023-08-09T12:38:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 131/177 2023-08-09T12:38:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:18.0.0-5389.g668a86f2.el9.x86_64 132/177 2023-08-09T12:38:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 133/177 2023-08-09T12:38:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:18.0.0-5389.g668a86f2.el9.x86_64 134/177 2023-08-09T12:38:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 135/177 2023-08-09T12:38:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.43.90-1.el9.x86_64 136/177 2023-08-09T12:38:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.41.8-1.el9.x86_64 137/177 2023-08-09T12:38:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.43.90-1.el9.x86_64 138/177 2023-08-09T12:38:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 139/177 2023-08-09T12:38:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.43.90-1.el9.x86_64 140/177 2023-08-09T12:38:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.41.8-1.el9.x86_64 141/177 2023-08-09T12:38:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.43.90-1.el9.x86_64 142/177 2023-08-09T12:38:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.41.8-1.el9.x86_64 143/177 2023-08-09T12:38:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/177 2023-08-09T12:38:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el9.x86_64 145/177 2023-08-09T12:38:32.618 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/177 2023-08-09T12:38:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-0.188-3.el9.x86_64 147/177 2023-08-09T12:38:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/177 2023-08-09T12:38:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libs-0.188-3.el9.x86_64 149/177 2023-08-09T12:38:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 150/177 2023-08-09T12:38:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : iproute-6.0.0-2.el9.x86_64 151/177 2023-08-09T12:38:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 152/177 2023-08-09T12:38:32.619 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : iproute-tc-6.0.0-2.el9.x86_64 153/177 2023-08-09T12:38:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libblkid-2.37.4-11.el9.x86_64 154/177 2023-08-09T12:38:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libblkid-2.37.4-9.el9.x86_64 155/177 2023-08-09T12:38:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libfdisk-2.37.4-11.el9.x86_64 156/177 2023-08-09T12:38:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libfdisk-2.37.4-9.el9.x86_64 157/177 2023-08-09T12:38:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libmount-2.37.4-11.el9.x86_64 158/177 2023-08-09T12:38:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libmount-2.37.4-9.el9.x86_64 159/177 2023-08-09T12:38:32.620 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsmartcols-2.37.4-11.el9.x86_64 160/177 2023-08-09T12:38:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsmartcols-2.37.4-9.el9.x86_64 161/177 2023-08-09T12:38:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-2.37.4-11.el9.x86_64 162/177 2023-08-09T12:38:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-2.37.4-9.el9.x86_64 163/177 2023-08-09T12:38:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 164/177 2023-08-09T12:38:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.0.7-2.el9.x86_64 165/177 2023-08-09T12:38:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 166/177 2023-08-09T12:38:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.0.7-2.el9.x86_64 167/177 2023-08-09T12:38:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-2.37.4-11.el9.x86_64 168/177 2023-08-09T12:38:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-2.37.4-9.el9.x86_64 169/177 2023-08-09T12:38:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-core-2.37.4-11.el9.x86_64 170/177 2023-08-09T12:38:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-core-2.37.4-9.el9.x86_64 171/177 2023-08-09T12:38:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-user-2.37.4-11.el9.x86_64 172/177 2023-08-09T12:38:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-user-2.37.4-9.el9.x86_64 173/177 2023-08-09T12:38:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 174/177 2023-08-09T12:38:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsdump-3.1.10-1.el9.x86_64 175/177 2023-08-09T12:38:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 176/177 2023-08-09T12:38:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-5.14.2-1.el9.x86_64 177/177 2023-08-09T12:38:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:34.948 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2023-08-09T12:38:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.43.90-1.el9.x86_64 2023-08-09T12:38:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.43.90-1.el9.x86_64 2023-08-09T12:38:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.43.90-1.el9.x86_64 2023-08-09T12:38:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.43.90-1.el9.x86_64 2023-08-09T12:38:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-debuginfod-client-0.189-3.el9.x86_64 2023-08-09T12:38:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-0.189-3.el9.x86_64 2023-08-09T12:38:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libs-0.189-3.el9.x86_64 2023-08-09T12:38:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: iproute-6.2.0-5.el9.x86_64 2023-08-09T12:38:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: iproute-tc-6.2.0-5.el9.x86_64 2023-08-09T12:38:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: libblkid-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: libfdisk-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: libmount-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: libsmartcols-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-1:3.0.7-24.el9.x86_64 2023-08-09T12:38:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs-1:3.0.7-24.el9.x86_64 2023-08-09T12:38:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-core-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-user-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: xfsdump-3.1.12-3.el9.x86_64 2023-08-09T12:38:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-5.19.0-4.el9.x86_64 2023-08-09T12:38:34.951 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2023-08-09T12:38:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2023-08-09T12:38:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2023-08-09T12:38:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-08-09T12:38:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:18.0.0-5389.g668a86f2.el9.noarch 2023-08-09T12:38:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-08-09T12:38:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2023-08-09T12:38:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-08-09T12:38:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-08-09T12:38:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-08-09T12:38:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: fmt-8.1.1-5.el9.x86_64 2023-08-09T12:38:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-15.el9.x86_64 2023-08-09T12:38:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-08-09T12:38:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.6-15.el9.x86_64 2023-08-09T12:38:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-08-09T12:38:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-9.el9.x86_64 2023-08-09T12:38:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-08-09T12:38:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-08-09T12:38:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2023-08-09T12:38:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-08-09T12:38:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-08-09T12:38:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-08-09T12:38:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-08-09T12:38:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-45.el9.x86_64 2023-08-09T12:38:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2023-08-09T12:38:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-11.el9.x86_64 2023-08-09T12:38:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-08-09T12:38:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-08-09T12:38:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-08-09T12:38:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.21-2.el9.x86_64 2023-08-09T12:38:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-08-09T12:38:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-08-09T12:38:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-08-09T12:38:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.11-1.el9.x86_64 2023-08-09T12:38:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-08-09T12:38:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-08-09T12:38:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.11-1.el9.x86_64 2023-08-09T12:38:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-08-09T12:38:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2023-08-09T12:38:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-08-09T12:38:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-08-09T12:38:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-08-09T12:38:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-08-09T12:38:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-08-09T12:38:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-08-09T12:38:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-08-09T12:38:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.16-1.el9.x86_64 2023-08-09T12:38:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-08-09T12:38:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-08-09T12:38:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-08-09T12:38:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-08-09T12:38:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-08-09T12:38:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-08-09T12:38:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-08-09T12:38:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-08-09T12:38:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-08-09T12:38:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-08-09T12:38:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-08-09T12:38:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-08-09T12:38:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-08-09T12:38:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2023-08-09T12:38:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-08-09T12:38:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-08-09T12:38:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-08-09T12:38:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-08-09T12:38:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-08-09T12:38:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-08-09T12:38:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-08-09T12:38:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2023-08-09T12:38:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2023-08-09T12:38:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-08-09T12:38:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-08-09T12:38:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-08-09T12:38:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-08-09T12:38:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2023-08-09T12:38:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2023-08-09T12:38:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-08-09T12:38:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-08-09T12:38:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2023-08-09T12:38:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2023-08-09T12:38:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-08-09T12:38:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-08-09T12:38:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2023-08-09T12:38:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-08-09T12:38:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.7-6.el9.noarch 2023-08-09T12:38:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-08-09T12:38:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-08-09T12:38:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-08-09T12:38:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:18.0.0-5389.g668a86f2.el9.x86_64 2023-08-09T12:38:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-2.el9.x86_64 2023-08-09T12:38:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-5.el9.x86_64 2023-08-09T12:38:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2023-08-09T12:38:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2023-08-09T12:38:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-08-09T12:38:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-08-09T12:38:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-36.el9.x86_64 2023-08-09T12:38:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:34.970 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-08-09T12:38:35.576 DEBUG:teuthology.parallel:result is None 2023-08-09T12:38:35.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T12:38:35.718 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-09T12:38:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:18.0.0-5389.g668a86f2.el9 2023-08-09T12:38:35.778 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5389.g668a86f2.el9 2023-08-09T12:38:35.779 INFO:teuthology.task.install:The correct ceph version 18.0.0-5389.g668a86f2 is installed. 2023-08-09T12:38:35.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=668a86f232c9454b2ce5928d1432a29a72964d85 2023-08-09T12:38:35.915 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-09T12:38:35.995 INFO:teuthology.orchestra.run.smithi142.stdout:18.0.0-5389.g668a86f2.el9 2023-08-09T12:38:35.996 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5389.g668a86f2.el9 2023-08-09T12:38:35.996 INFO:teuthology.task.install:The correct ceph version 18.0.0-5389.g668a86f2 is installed. 2023-08-09T12:38:35.996 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-09T12:38:35.997 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:35.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-09T12:38:36.087 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:36.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-09T12:38:36.198 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-09T12:38:36.199 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:36.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2023-08-09T12:38:36.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-09T12:38:36.401 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:36.401 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2023-08-09T12:38:36.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-09T12:38:36.597 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-09T12:38:36.598 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:36.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-09T12:38:36.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-09T12:38:36.800 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:36.801 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-09T12:38:36.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-09T12:38:37.044 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-09T12:38:37.045 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:37.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2023-08-09T12:38:37.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-09T12:38:37.249 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:37.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2023-08-09T12:38:37.357 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-09T12:38:37.446 INFO:teuthology.run_tasks:Running task ceph... 2023-08-09T12:38:37.525 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-09T12:38:37.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2023-08-09T12:38:37.532 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2023-08-09T12:38:37.641 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-09T12:38:37.642 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-09T12:38:37.647 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-09T12:38:37.743 INFO:tasks.ceph:Creating extra log directories... 2023-08-09T12:38:37.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-09T12:38:37.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-09T12:38:37.859 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-09T12:38:37.859 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-09T12:38:37.859 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-09T12:38:37.860 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:37.860 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-09T12:38:37.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-09T12:38:38.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-09T12:38:38.204 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:38.205 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-09T12:38:38.265 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-09T12:38:38.544 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-09T12:38:38.647 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-09T12:38:38.650 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-09T12:38:38.650 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087', 'branch': 'wip-vshankar-testing-20230809.035933', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7364087', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230809.035933'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230809.035933', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8976, 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85', 'sleep_before_teardown': 0, 'subset': '486/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230809.035933', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_668a86f232c9454b2ce5928d1432a29a72964d85/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '668a86f232c9454b2ce5928d1432a29a72964d85', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNiRdK8KBEkCYEFGVsnvyjQMwGl1X8ouvA0XeobFuLFtAWt6scI5wwoMHvtRHTRn4wL7f/vjXbrF891KPddar8U=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMWSjGVLUMIzgjxvYuqvXv1yqr9ZFVjIg0RMuYd90lIDf8DfMCLsB4Y0IfblLZPBCDAS0yMY+nCtW0Ea/7ihJek='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '668a86f232c9454b2ce5928d1432a29a72964d85'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '7fda95956ac10132c9b74016ba832db907df09fa', 'timestamp': '2023-08-09_05:46:29', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-09T12:38:38.651 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-09T12:38:38.658 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-09T12:38:38.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2023-08-09T12:38:38.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2023-08-09T12:38:38.847 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:38.848 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2023-08-09T12:38:38.891 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-09T12:38:38.891 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2023-08-09T12:38:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-09T12:38:38.987 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T12:38:38.987 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 623 Links: 1 2023-08-09T12:38:38.988 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T12:38:38.988 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T12:38:38.988 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-08-09 12:38:28.318546196 +0000 2023-08-09T12:38:38.989 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-08-09 12:33:33.303395643 +0000 2023-08-09T12:38:38.989 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-08-09 12:33:33.303395643 +0000 2023-08-09T12:38:38.989 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-08-09 12:33:33.303395643 +0000 2023-08-09T12:38:38.990 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-09T12:38:39.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-08-09T12:38:39.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-08-09T12:38:39.072 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000265492 s, 1.9 MB/s 2023-08-09T12:38:39.075 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-09T12:38:39.120 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2023-08-09T12:38:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-09T12:38:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T12:38:39.205 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 641 Links: 1 2023-08-09T12:38:39.205 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T12:38:39.206 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T12:38:39.206 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-08-09 12:38:28.319546186 +0000 2023-08-09T12:38:39.206 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-08-09 12:33:34.344384468 +0000 2023-08-09T12:38:39.206 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-08-09 12:33:34.344384468 +0000 2023-08-09T12:38:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-08-09 12:33:34.344384468 +0000 2023-08-09T12:38:39.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-09T12:38:39.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-08-09T12:38:39.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-08-09T12:38:39.324 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000223553 s, 2.3 MB/s 2023-08-09T12:38:39.326 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-09T12:38:39.374 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2023-08-09T12:38:39.414 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-09T12:38:39.415 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T12:38:39.415 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 659 Links: 1 2023-08-09T12:38:39.415 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T12:38:39.415 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T12:38:39.415 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-08-09 12:38:28.320546175 +0000 2023-08-09T12:38:39.415 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-08-09 12:33:35.397373165 +0000 2023-08-09T12:38:39.415 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-08-09 12:33:35.397373165 +0000 2023-08-09T12:38:39.416 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-08-09 12:33:35.397373165 +0000 2023-08-09T12:38:39.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-09T12:38:39.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-08-09T12:38:39.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-08-09T12:38:39.529 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000203768 s, 2.5 MB/s 2023-08-09T12:38:39.532 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-09T12:38:39.576 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2023-08-09T12:38:39.656 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-09T12:38:39.657 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T12:38:39.657 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 676 Links: 1 2023-08-09T12:38:39.657 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T12:38:39.657 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T12:38:39.657 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-08-09 12:38:28.321546165 +0000 2023-08-09T12:38:39.657 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-08-09 12:33:36.468361668 +0000 2023-08-09T12:38:39.657 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-08-09 12:33:36.468361668 +0000 2023-08-09T12:38:39.658 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-08-09 12:33:36.468361668 +0000 2023-08-09T12:38:39.658 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-09T12:38:39.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-08-09T12:38:39.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-08-09T12:38:39.771 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000192946 s, 2.7 MB/s 2023-08-09T12:38:39.774 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-09T12:38:39.817 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:39.818 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:39.818 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2023-08-09T12:38:39.879 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-09T12:38:39.880 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2023-08-09T12:38:39.936 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-09T12:38:39.936 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T12:38:39.937 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 624 Links: 1 2023-08-09T12:38:39.937 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T12:38:39.937 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T12:38:39.937 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-08-09 12:36:17.659888085 +0000 2023-08-09T12:38:39.938 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-08-09 12:33:18.000847722 +0000 2023-08-09T12:38:39.938 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-08-09 12:33:18.000847722 +0000 2023-08-09T12:38:39.938 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-08-09 12:33:18.000847722 +0000 2023-08-09T12:38:39.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-09T12:38:40.033 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-08-09T12:38:40.033 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-08-09T12:38:40.033 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000388277 s, 1.3 MB/s 2023-08-09T12:38:40.036 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-09T12:38:40.094 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2023-08-09T12:38:40.147 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-09T12:38:40.147 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T12:38:40.148 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 641 Links: 1 2023-08-09T12:38:40.148 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T12:38:40.148 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T12:38:40.148 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-08-09 12:36:17.660888066 +0000 2023-08-09T12:38:40.149 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-08-09 12:33:19.002828722 +0000 2023-08-09T12:38:40.149 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-08-09 12:33:19.002828722 +0000 2023-08-09T12:38:40.149 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-08-09 12:33:19.002828722 +0000 2023-08-09T12:38:40.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-09T12:38:40.238 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-08-09T12:38:40.238 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-08-09T12:38:40.238 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000354985 s, 1.4 MB/s 2023-08-09T12:38:40.241 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-09T12:38:40.297 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2023-08-09T12:38:40.349 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-09T12:38:40.349 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T12:38:40.349 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 659 Links: 1 2023-08-09T12:38:40.350 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T12:38:40.350 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T12:38:40.350 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-08-09 12:36:17.661888047 +0000 2023-08-09T12:38:40.350 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-08-09 12:33:20.032809192 +0000 2023-08-09T12:38:40.350 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-08-09 12:33:20.032809192 +0000 2023-08-09T12:38:40.350 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-08-09 12:33:20.032809192 +0000 2023-08-09T12:38:40.350 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-09T12:38:40.440 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-08-09T12:38:40.440 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-08-09T12:38:40.440 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000364341 s, 1.4 MB/s 2023-08-09T12:38:40.444 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-09T12:38:40.499 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2023-08-09T12:38:40.550 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-09T12:38:40.551 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-09T12:38:40.551 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 677 Links: 1 2023-08-09T12:38:40.552 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-09T12:38:40.552 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-08-09T12:38:40.552 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-08-09 12:36:17.662888028 +0000 2023-08-09T12:38:40.552 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-08-09 12:33:21.079789339 +0000 2023-08-09T12:38:40.552 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-08-09 12:33:21.079789339 +0000 2023-08-09T12:38:40.553 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-08-09 12:33:21.079789339 +0000 2023-08-09T12:38:40.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-09T12:38:40.642 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-08-09T12:38:40.643 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-08-09T12:38:40.643 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000326465 s, 1.6 MB/s 2023-08-09T12:38:40.646 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-09T12:38:40.701 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:40.702 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-09T12:38:40.702 INFO:tasks.ceph:Generating config... 2023-08-09T12:38:40.703 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-09T12:38:40.703 INFO:tasks.ceph:[client] debug client = 20 2023-08-09T12:38:40.704 INFO:tasks.ceph:[client] debug ms = 1 2023-08-09T12:38:40.704 INFO:tasks.ceph:[client] pid file = 2023-08-09T12:38:40.704 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-09T12:38:40.704 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-09T12:38:40.705 INFO:tasks.ceph:[client.0] debug client = 20 2023-08-09T12:38:40.705 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-08-09T12:38:40.705 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-08-09T12:38:40.705 INFO:tasks.ceph:[client.1] debug client = 20 2023-08-09T12:38:40.705 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-08-09T12:38:40.706 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-08-09T12:38:40.706 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-09T12:38:40.706 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-09T12:38:40.706 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-09T12:38:40.706 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-09T12:38:40.707 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-09T12:38:40.707 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-09T12:38:40.707 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-09T12:38:40.707 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-09T12:38:40.707 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-09T12:38:40.707 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-09T12:38:40.708 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-09T12:38:40.708 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-09T12:38:40.708 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-09T12:38:40.708 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-09T12:38:40.709 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-09T12:38:40.709 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-09T12:38:40.710 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-09T12:38:40.710 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-08-09T12:38:40.710 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-08-09T12:38:40.710 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-08-09T12:38:40.711 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-09T12:38:40.711 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-09T12:38:40.711 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-08-09T12:38:40.711 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-08-09T12:38:40.711 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-09T12:38:40.712 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-09T12:38:40.712 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-08-09T12:38:40.712 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-08-09T12:38:40.712 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-09T12:38:40.713 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-09T12:38:40.713 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-09T12:38:40.713 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-08-09T12:38:40.713 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-08-09T12:38:40.713 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-08-09T12:38:40.714 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-09T12:38:40.714 INFO:tasks.ceph:Setting up mon.a... 2023-08-09T12:38:40.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-09T12:38:40.830 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2023-08-09T12:38:40.836 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-09T12:38:40.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-09T12:38:41.015 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2023-08-09T12:38:41.016 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-09T12:38:41.017 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:41.017 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-09T12:38:41.061 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:41.191 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:41.192 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid 00c647bf-6030-4006-bfa6-56fa996e3ac5 2023-08-09T12:38:41.192 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = pacific 2023-08-09T12:38:41.192 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2023-08-09T12:38:41.192 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 00c647bf-6030-4006-bfa6-56fa996e3ac5 2023-08-09T12:38:41.192 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2023-08-09T12:38:41.189625+0000 2023-08-09T12:38:41.193 INFO:teuthology.orchestra.run.smithi017.stdout:created 2023-08-09T12:38:41.189625+0000 2023-08-09T12:38:41.193 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 16 (pacific) 2023-08-09T12:38:41.193 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2023-08-09T12:38:41.193 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2023-08-09T12:38:41.193 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2023-08-09T12:38:41.193 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2023-08-09T12:38:41.193 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-09T12:38:41.195 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-09T12:38:41.235 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 00c647bf-6030-4006-bfa6-56fa996e3ac5... 2023-08-09T12:38:41.237 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-09T12:38:41.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-09T12:38:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2023-08-09T12:38:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2023-08-09T12:38:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-09T12:38:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2023-08-09T12:38:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2023-08-09T12:38:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2023-08-09T12:38:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2023-08-09T12:38:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2023-08-09T12:38:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2023-08-09T12:38:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2023-08-09T12:38:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-09T12:38:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2023-08-09T12:38:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2023-08-09T12:38:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-09T12:38:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2023-08-09T12:38:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2023-08-09T12:38:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2023-08-09T12:38:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2023-08-09T12:38:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2023-08-09T12:38:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2023-08-09T12:38:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2023-08-09T12:38:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2023-08-09T12:38:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-09T12:38:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-09T12:38:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2023-08-09T12:38:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-09T12:38:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2023-08-09T12:38:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2023-08-09T12:38:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2023-08-09T12:38:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2023-08-09T12:38:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2023-08-09T12:38:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-08-09T12:38:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on skipped message = False 2023-08-09T12:38:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 00c647bf-6030-4006-bfa6-56fa996e3ac5 2023-08-09T12:38:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.469 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2023-08-09T12:38:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2023-08-09T12:38:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2023-08-09T12:38:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2023-08-09T12:38:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2023-08-09T12:38:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2023-08-09T12:38:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2023-08-09T12:38:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2023-08-09T12:38:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2023-08-09T12:38:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2023-08-09T12:38:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2023-08-09T12:38:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2023-08-09T12:38:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2023-08-09T12:38:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2023-08-09T12:38:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2023-08-09T12:38:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2023-08-09T12:38:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2023-08-09T12:38:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2023-08-09T12:38:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2023-08-09T12:38:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2023-08-09T12:38:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2023-08-09T12:38:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2023-08-09T12:38:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2023-08-09T12:38:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-08-09T12:38:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2023-08-09T12:38:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2023-08-09T12:38:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: memstore device bytes = 200000000 2023-08-09T12:38:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2023-08-09T12:38:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2023-08-09T12:38:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2023-08-09T12:38:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 1.0 2023-08-09T12:38:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: osd mon report interval = 5 2023-08-09T12:38:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = memstore 2023-08-09T12:38:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2023-08-09T12:38:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.475 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2023-08-09T12:38:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-08-09T12:38:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2023-08-09T12:38:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2023-08-09T12:38:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2023-08-09T12:38:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2023-08-09T12:38:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2023-08-09T12:38:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2023-08-09T12:38:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.476 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2023-08-09T12:38:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-08-09T12:38:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2023-08-09T12:38:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2023-08-09T12:38:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2023-08-09T12:38:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2023-08-09T12:38:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2023-08-09T12:38:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2023-08-09T12:38:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2023-08-09T12:38:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2023-08-09T12:38:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2023-08-09T12:38:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-09T12:38:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2023-08-09T12:38:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2023-08-09T12:38:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2023-08-09T12:38:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-09T12:38:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-09T12:38:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2023-08-09T12:38:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2023-08-09T12:38:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2023-08-09T12:38:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: mon op complaint time = 120 2023-08-09T12:38:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull ratio = 0.6 2023-08-09T12:38:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.7 2023-08-09T12:38:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.6 2023-08-09T12:38:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:38:41.480 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2023-08-09T12:38:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2023-08-09T12:38:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2023-08-09T12:38:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2023-08-09T12:38:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-09T12:38:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-09T12:38:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 600 2023-08-09T12:38:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2023-08-09T12:38:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-08-09T12:38:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = "" 2023-08-09T12:38:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2023-08-09T12:38:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2023-08-09T12:38:41.481 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2023-08-09T12:38:41.481 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2023-08-09T12:38:41.482 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2023-08-09T12:38:41.482 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2023-08-09T12:38:41.482 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2023-08-09T12:38:41.482 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2023-08-09T12:38:41.482 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2023-08-09T12:38:41.482 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:38:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2023-08-09T12:38:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: debug objectcacher = 20 2023-08-09T12:38:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: debug objecter = 20 2023-08-09T12:38:41.483 INFO:teuthology.orchestra.run.smithi017.stdout:[client.1] 2023-08-09T12:38:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2023-08-09T12:38:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: debug objectcacher = 20 2023-08-09T12:38:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: debug objecter = 20 2023-08-09T12:38:41.483 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2023-08-09T12:38:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds = 20 2023-08-09T12:38:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds balancer = 20 2023-08-09T12:38:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-08-09T12:38:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug frag = True 2023-08-09T12:38:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug scatterstat = True 2023-08-09T12:38:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: mds op complaint time = 180 2023-08-09T12:38:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = True 2023-08-09T12:38:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2023-08-09T12:38:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2023-08-09T12:38:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2023-08-09T12:38:41.485 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-08-09T12:38:41.485 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2023-08-09T12:38:41.485 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-09T12:38:41.485 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2023-08-09T12:38:41.486 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.486 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2023-08-09T12:38:41.486 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.486 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2023-08-09T12:38:41.486 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.486 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2023-08-09T12:38:41.486 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2023-08-09T12:38:41.486 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.487 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2023-08-09T12:38:41.487 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2023-08-09T12:38:41.487 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.487 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-09T12:38:41.487 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2023-08-09T12:38:41.487 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.487 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2023-08-09T12:38:41.488 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-09T12:38:41.488 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.488 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2023-08-09T12:38:41.488 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.488 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2023-08-09T12:38:41.488 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2023-08-09T12:38:41.488 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2023-08-09T12:38:41.488 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2023-08-09T12:38:41.489 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2023-08-09T12:38:41.489 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2023-08-09T12:38:41.489 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2023-08-09T12:38:41.489 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-09T12:38:41.489 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-09T12:38:41.489 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2023-08-09T12:38:41.489 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.489 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-09T12:38:41.490 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.490 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2023-08-09T12:38:41.490 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.490 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2023-08-09T12:38:41.490 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.490 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2023-08-09T12:38:41.490 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2023-08-09T12:38:41.491 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2023-08-09T12:38:41.491 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.17,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-08-09T12:38:41.491 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2023-08-09T12:38:41.491 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 00c647bf-6030-4006-bfa6-56fa996e3ac5 2023-08-09T12:38:41.491 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.491 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2023-08-09T12:38:41.491 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2023-08-09T12:38:41.491 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.492 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2023-08-09T12:38:41.492 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2023-08-09T12:38:41.492 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2023-08-09T12:38:41.492 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.492 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2023-08-09T12:38:41.492 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2023-08-09T12:38:41.492 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.492 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2023-08-09T12:38:41.493 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2023-08-09T12:38:41.493 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2023-08-09T12:38:41.493 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.493 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2023-08-09T12:38:41.493 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2023-08-09T12:38:41.493 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.493 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2023-08-09T12:38:41.494 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.494 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2023-08-09T12:38:41.494 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.494 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2023-08-09T12:38:41.494 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.494 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2023-08-09T12:38:41.494 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2023-08-09T12:38:41.494 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.495 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2023-08-09T12:38:41.495 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2023-08-09T12:38:41.495 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2023-08-09T12:38:41.495 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2023-08-09T12:38:41.495 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2023-08-09T12:38:41.495 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2023-08-09T12:38:41.495 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-08-09T12:38:41.495 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2023-08-09T12:38:41.496 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2023-08-09T12:38:41.496 INFO:teuthology.orchestra.run.smithi142.stdout: memstore device bytes = 200000000 2023-08-09T12:38:41.496 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2023-08-09T12:38:41.496 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2023-08-09T12:38:41.496 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2023-08-09T12:38:41.496 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 1.0 2023-08-09T12:38:41.496 INFO:teuthology.orchestra.run.smithi142.stdout: osd mon report interval = 5 2023-08-09T12:38:41.496 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = memstore 2023-08-09T12:38:41.497 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-08-09T12:38:41.497 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.497 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2023-08-09T12:38:41.497 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-08-09T12:38:41.497 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2023-08-09T12:38:41.497 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-08-09T12:38:41.497 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-08-09T12:38:41.498 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-08-09T12:38:41.498 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-08-09T12:38:41.498 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2023-08-09T12:38:41.498 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.498 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2023-08-09T12:38:41.498 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-08-09T12:38:41.498 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-08-09T12:38:41.498 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2023-08-09T12:38:41.499 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-08-09T12:38:41.499 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2023-08-09T12:38:41.499 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2023-08-09T12:38:41.499 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-08-09T12:38:41.499 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2023-08-09T12:38:41.499 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2023-08-09T12:38:41.499 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-08-09T12:38:41.499 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.500 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-09T12:38:41.500 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2023-08-09T12:38:41.500 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2023-08-09T12:38:41.500 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.500 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2023-08-09T12:38:41.500 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-09T12:38:41.500 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-09T12:38:41.500 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.501 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2023-08-09T12:38:41.501 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2023-08-09T12:38:41.501 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.501 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2023-08-09T12:38:41.501 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2023-08-09T12:38:41.501 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull ratio = 0.6 2023-08-09T12:38:41.501 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.7 2023-08-09T12:38:41.501 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.6 2023-08-09T12:38:41.502 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-09T12:38:41.502 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2023-08-09T12:38:41.502 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2023-08-09T12:38:41.502 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2023-08-09T12:38:41.502 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2023-08-09T12:38:41.502 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-09T12:38:41.502 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-09T12:38:41.502 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2023-08-09T12:38:41.503 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-08-09T12:38:41.503 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-08-09T12:38:41.503 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2023-08-09T12:38:41.503 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-08-09T12:38:41.503 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-08-09T12:38:41.503 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2023-08-09T12:38:41.503 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2023-08-09T12:38:41.504 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2023-08-09T12:38:41.504 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-08-09T12:38:41.504 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-08-09T12:38:41.504 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-08-09T12:38:41.504 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-08-09T12:38:41.504 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-08-09T12:38:41.504 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-08-09T12:38:41.504 INFO:teuthology.orchestra.run.smithi142.stdout: debug objectcacher = 20 2023-08-09T12:38:41.505 INFO:teuthology.orchestra.run.smithi142.stdout: debug objecter = 20 2023-08-09T12:38:41.505 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2023-08-09T12:38:41.505 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-08-09T12:38:41.505 INFO:teuthology.orchestra.run.smithi142.stdout: debug objectcacher = 20 2023-08-09T12:38:41.505 INFO:teuthology.orchestra.run.smithi142.stdout: debug objecter = 20 2023-08-09T12:38:41.505 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2023-08-09T12:38:41.505 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2023-08-09T12:38:41.505 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2023-08-09T12:38:41.506 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-08-09T12:38:41.506 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2023-08-09T12:38:41.506 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2023-08-09T12:38:41.506 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2023-08-09T12:38:41.506 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2023-08-09T12:38:41.506 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-08-09T12:38:41.506 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-08-09T12:38:41.506 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-08-09T12:38:41.511 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-09T12:38:41.512 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-09T12:38:41.666 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-09T12:38:41.667 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:41.667 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-09T12:38:41.721 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:41.721 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-09T12:38:41.768 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:38:41.769 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:41.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-09T12:38:41.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-09T12:38:41.966 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:41.966 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:42.071 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:38:42.071 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:42.071 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-09T12:38:42.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-09T12:38:42.227 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:42.227 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:42.327 INFO:tasks.ceph:Setting up mon nodes... 2023-08-09T12:38:42.327 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-09T12:38:42.327 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-09T12:38:42.553 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-09T12:38:42.561 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-09T12:38:42.765 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-09T12:38:42.776 INFO:tasks.ceph:Setting up mds nodes... 2023-08-09T12:38:42.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-09T12:38:42.987 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-09T12:38:42.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-09T12:38:43.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-09T12:38:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-09T12:38:43.286 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-09T12:38:43.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-09T12:38:43.571 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-09T12:38:43.578 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-09T12:38:43.659 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-09T12:38:43.833 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-09T12:38:43.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-09T12:38:43.934 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-09T12:38:43.935 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-09T12:38:44.080 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-09T12:38:44.137 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-09T12:38:44.276 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-09T12:38:44.350 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-09T12:38:44.484 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-09T12:38:44.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-09T12:38:44.671 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-09T12:38:44.733 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-09T12:38:44.733 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-09T12:38:44.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-09T12:38:44.844 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:44.844 INFO:tasks.ceph:role: osd.0 2023-08-09T12:38:44.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:38:44.845 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-09T12:38:44.949 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T12:38:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T12:38:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T12:38:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-09T12:38:44.950 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T12:38:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2023-08-09T12:38:44.951 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T12:38:44.951 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-09T12:38:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T12:38:44.951 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T12:38:44.983 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2023-08-09T12:38:44.989 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2023-08-09T12:38:44.990 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-09T12:38:45.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-09T12:38:45.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-09T12:38:45.285 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:45.286 INFO:tasks.ceph:role: osd.1 2023-08-09T12:38:45.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:38:45.286 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-09T12:38:45.391 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T12:38:45.391 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T12:38:45.391 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T12:38:45.391 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-09T12:38:45.391 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T12:38:45.392 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2023-08-09T12:38:45.392 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T12:38:45.392 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-09T12:38:45.392 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T12:38:45.392 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T12:38:45.424 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2023-08-09T12:38:45.429 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2023-08-09T12:38:45.430 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-09T12:38:45.552 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-09T12:38:45.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-09T12:38:45.731 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:45.732 INFO:tasks.ceph:role: osd.2 2023-08-09T12:38:45.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:38:45.732 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-09T12:38:45.823 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T12:38:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T12:38:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T12:38:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-09T12:38:45.824 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T12:38:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2023-08-09T12:38:45.824 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T12:38:45.824 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-09T12:38:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T12:38:45.824 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T12:38:45.856 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2023-08-09T12:38:45.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2023-08-09T12:38:45.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-09T12:38:45.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-09T12:38:46.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-09T12:38:46.180 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:46.180 INFO:tasks.ceph:role: osd.3 2023-08-09T12:38:46.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:38:46.181 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-09T12:38:46.281 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T12:38:46.281 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T12:38:46.282 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T12:38:46.282 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-09T12:38:46.282 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T12:38:46.282 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2023-08-09T12:38:46.282 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T12:38:46.282 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-09T12:38:46.282 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T12:38:46.282 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T12:38:46.316 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2023-08-09T12:38:46.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2023-08-09T12:38:46.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-09T12:38:46.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-09T12:38:46.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:46.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:46.701+0000 7f3d9e417500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-09T12:38:46.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:46.702+0000 7f3d9e417500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-09T12:38:46.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:46.705+0000 7f3d9e417500 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-08-09T12:38:46.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-09T12:38:46.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:46.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:46.974+0000 7f1b6820c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-09T12:38:46.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:46.975+0000 7f1b6820c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-09T12:38:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:46.977+0000 7f1b6820c500 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-08-09T12:38:46.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-09T12:38:47.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:47.248+0000 7f0601f1f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-09T12:38:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:47.248+0000 7f0601f1f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-09T12:38:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:47.250+0000 7f0601f1f500 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-08-09T12:38:47.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-09T12:38:47.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:47.522+0000 7f5e7060c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-09T12:38:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:47.522+0000 7f5e7060c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-09T12:38:47.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:47.524+0000 7f5e7060c500 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-08-09T12:38:47.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-09T12:38:47.649 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-09T12:38:47.751 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:47.751 INFO:tasks.ceph:role: osd.4 2023-08-09T12:38:47.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:38:47.751 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-09T12:38:47.851 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T12:38:47.851 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T12:38:47.851 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T12:38:47.852 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-09T12:38:47.852 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T12:38:47.852 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-08-09T12:38:47.852 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T12:38:47.852 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-09T12:38:47.852 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T12:38:47.853 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T12:38:48.369 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-08-09T12:38:48.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-08-09T12:38:48.378 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-09T12:38:48.582 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-09T12:38:48.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-09T12:38:48.794 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:48.794 INFO:tasks.ceph:role: osd.5 2023-08-09T12:38:48.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:38:48.795 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-09T12:38:48.895 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T12:38:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T12:38:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T12:38:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-09T12:38:48.896 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T12:38:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-08-09T12:38:48.897 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T12:38:48.897 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-09T12:38:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T12:38:48.897 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T12:38:49.387 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-08-09T12:38:49.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-08-09T12:38:49.393 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-09T12:38:49.542 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-09T12:38:49.635 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-09T12:38:49.718 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:49.718 INFO:tasks.ceph:role: osd.6 2023-08-09T12:38:49.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:38:49.719 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-09T12:38:49.821 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T12:38:49.821 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T12:38:49.821 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T12:38:49.821 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-09T12:38:49.821 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T12:38:49.822 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-08-09T12:38:49.822 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T12:38:49.822 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-09T12:38:49.822 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T12:38:49.822 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T12:38:50.353 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-08-09T12:38:50.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-08-09T12:38:50.360 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-09T12:38:50.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-09T12:38:50.655 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-09T12:38:50.742 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-09T12:38:50.742 INFO:tasks.ceph:role: osd.7 2023-08-09T12:38:50.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:38:50.743 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-09T12:38:50.843 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-09T12:38:50.843 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-09T12:38:50.843 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-09T12:38:50.844 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-09T12:38:50.844 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-09T12:38:50.844 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-08-09T12:38:50.844 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-09T12:38:50.844 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-09T12:38:50.844 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-09T12:38:50.844 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-09T12:38:51.299 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-08-09T12:38:51.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-08-09T12:38:51.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-09T12:38:51.457 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-09T12:38:51.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:51.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:51.686+0000 7fefe05be500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-09T12:38:51.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:51.687+0000 7fefe05be500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-09T12:38:51.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:51.692+0000 7fefe05be500 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-08-09T12:38:51.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-09T12:38:51.809 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:51.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:51.937+0000 7fcf06298500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-09T12:38:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:51.943+0000 7fcf06298500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-09T12:38:51.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:51.950+0000 7fcf06298500 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-08-09T12:38:51.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-09T12:38:52.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:52.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:52.221+0000 7f72d180d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-09T12:38:52.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:52.222+0000 7f72d180d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-09T12:38:52.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:52.231+0000 7f72d180d500 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-08-09T12:38:52.272 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-09T12:38:52.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:52.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:52.515+0000 7ff360b1f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-09T12:38:52.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:52.515+0000 7ff360b1f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-09T12:38:52.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:38:52.517+0000 7ff360b1f500 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-08-09T12:38:52.537 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-09T12:38:52.626 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-09T12:38:52.627 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:52.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-09T12:38:52.738 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:52.739 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-09T12:38:52.844 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:52.844 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-09T12:38:52.947 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:52.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-09T12:38:53.052 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:53.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-09T12:38:53.162 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:53.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-09T12:38:53.261 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:53.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-09T12:38:53.354 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:53.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-09T12:38:53.459 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:53.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-09T12:38:53.551 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:53.552 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-09T12:38:53.643 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:53.644 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-09T12:38:53.741 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:53.741 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-09T12:38:53.833 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:53.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-09T12:38:53.921 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:53.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-09T12:38:54.061 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:54.062 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-09T12:38:54.126 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:38:54.127 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-09T12:38:54.184 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:54.184 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-09T12:38:54.244 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:38:54.244 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-09T12:38:54.296 INFO:tasks.ceph:Adding keys to all mons... 2023-08-09T12:38:54.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-09T12:38:54.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-09T12:38:54.394 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2023-08-09T12:38:54.394 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA== 2023-08-09T12:38:54.395 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-08-09T12:38:54.395 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ== 2023-08-09T12:38:54.395 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-08-09T12:38:54.395 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag== 2023-08-09T12:38:54.395 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2023-08-09T12:38:54.396 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng== 2023-08-09T12:38:54.396 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2023-08-09T12:38:54.396 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg== 2023-08-09T12:38:54.396 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2023-08-09T12:38:54.397 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg== 2023-08-09T12:38:54.397 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2023-08-09T12:38:54.397 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w== 2023-08-09T12:38:54.398 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2023-08-09T12:38:54.398 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ== 2023-08-09T12:38:54.398 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-08-09T12:38:54.398 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg== 2023-08-09T12:38:54.398 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-08-09T12:38:54.398 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ== 2023-08-09T12:38:54.399 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2023-08-09T12:38:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q== 2023-08-09T12:38:54.399 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2023-08-09T12:38:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ== 2023-08-09T12:38:54.399 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2023-08-09T12:38:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ== 2023-08-09T12:38:54.399 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2023-08-09T12:38:54.400 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ== 2023-08-09T12:38:54.400 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-08-09T12:38:54.400 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:38:54.400 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2023-08-09T12:38:54.400 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA== 2023-08-09T12:38:54.400 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2023-08-09T12:38:54.400 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA== 2023-08-09T12:38:54.401 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2023-08-09T12:38:54.401 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ== 2023-08-09T12:38:54.405 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2023-08-09T12:38:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA== 2023-08-09T12:38:54.406 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2023-08-09T12:38:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ== 2023-08-09T12:38:54.406 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2023-08-09T12:38:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag== 2023-08-09T12:38:54.406 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2023-08-09T12:38:54.406 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng== 2023-08-09T12:38:54.406 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2023-08-09T12:38:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg== 2023-08-09T12:38:54.407 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2023-08-09T12:38:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg== 2023-08-09T12:38:54.407 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2023-08-09T12:38:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w== 2023-08-09T12:38:54.407 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2023-08-09T12:38:54.407 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ== 2023-08-09T12:38:54.407 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2023-08-09T12:38:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg== 2023-08-09T12:38:54.408 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2023-08-09T12:38:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ== 2023-08-09T12:38:54.408 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2023-08-09T12:38:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q== 2023-08-09T12:38:54.408 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2023-08-09T12:38:54.408 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ== 2023-08-09T12:38:54.409 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.6] 2023-08-09T12:38:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ== 2023-08-09T12:38:54.409 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.7] 2023-08-09T12:38:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ== 2023-08-09T12:38:54.409 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:38:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:38:54.410 INFO:teuthology.orchestra.run.smithi017.stdout:[client.2] 2023-08-09T12:38:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA== 2023-08-09T12:38:54.410 INFO:teuthology.orchestra.run.smithi017.stdout:[client.1] 2023-08-09T12:38:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA== 2023-08-09T12:38:54.410 INFO:teuthology.orchestra.run.smithi017.stdout:[client.3] 2023-08-09T12:38:54.410 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ== 2023-08-09T12:38:54.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-09T12:38:54.421 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-09T12:38:54.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T12:38:54.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T12:38:54.755 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T12:38:54.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T12:38:54.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:54.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:55.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:55.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:55.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:55.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:55.383 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:55.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:55.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-09T12:38:55.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-09T12:38:55.742 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T12:38:55.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T12:38:55.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T12:38:55.908 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-09T12:38:56.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:56.066 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:56.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:56.222 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:56.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:56.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:56.523 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:56.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-09T12:38:56.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T12:38:56.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T12:38:56.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T12:38:56.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T12:38:56.993 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T12:38:57.002 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T12:38:57.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T12:38:57.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-09T12:38:57.315 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-09T12:38:57.316 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-09T12:38:57.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-09T12:38:57.588 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-09T12:38:57.689 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-09T12:38:57.799 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-09T12:38:57.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-09T12:38:58.041 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-09T12:38:58.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-09T12:38:58.284 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-09T12:38:58.369 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:58.378 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-09T12:38:58.433 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-09T12:38:58.434 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-09T12:38:58.434 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-09T12:38:58.440 INFO:tasks.ceph.mon.a:Started 2023-08-09T12:38:58.441 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-09T12:38:58.441 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-09T12:38:58.447 INFO:tasks.ceph.mon.b:Started 2023-08-09T12:38:58.447 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-09T12:38:58.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-09T12:38:58.453 INFO:tasks.ceph.mon.c:Started 2023-08-09T12:38:58.453 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-09T12:38:58.453 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-09T12:38:58.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-09T12:38:58.459 INFO:tasks.ceph.mgr.y:Started 2023-08-09T12:38:58.460 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-09T12:38:58.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-09T12:38:58.465 INFO:tasks.ceph.mgr.x:Started 2023-08-09T12:38:58.465 INFO:tasks.ceph:Setting crush tunables to default 2023-08-09T12:38:58.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2023-08-09T12:38:58.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.654+0000 7ff1df939640 1 Processor -- start 2023-08-09T12:38:58.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.654+0000 7ff1df939640 1 -- start start 2023-08-09T12:38:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1df939640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:38:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1df939640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d8160640 con 0x7ff1d806fde0 2023-08-09T12:38:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1df939640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80d0d40 con 0x7ff1d80b1dc0 2023-08-09T12:38:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1df939640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d80d1020 con 0x7ff1d8160260 2023-08-09T12:38:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1dd6d5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:38:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1dded6640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff1d806fde0 0x7ff1d80d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49380/0 (socket says 172.21.15.17:49380) 2023-08-09T12:38:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1dded6640 1 -- 172.21.15.17:0/2911823139 learned_addr learned my addr 172.21.15.17:0/2911823139 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:38:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38092/0 (socket says 172.21.15.17:38092) 2023-08-09T12:38:58.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T12:38:58.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:38:58.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:38:58.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.656+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-09T12:38:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.858+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:38:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.858+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T12:38:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.858+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:38:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.858+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:38:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:58.858+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-09T12:38:59.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:59.259+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:38:59.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:59.260+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T12:38:59.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:59.260+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:38:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:59.260+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:38:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:38:59.260+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-09T12:39:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:00.062+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:00.062+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T12:39:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:00.062+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:00.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:00.062+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:00.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:00.062+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-09T12:39:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.656+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 msgr2=0x7ff1d80b5bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T12:39:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.656+0000 7ff1ceffd640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1d8160260 0x7ff1d80b5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.656+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 >> v1:172.21.15.142:6789/0 conn(0x7ff1d80b1dc0 legacy=0x7ff1d80b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.656+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 >> v1:172.21.15.17:6789/0 conn(0x7ff1d806fde0 legacy=0x7ff1d80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.656+0000 7ff1ceffd640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.656+0000 7ff1ceffd640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.656+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d80d1020 con 0x7ff1bc0036e0 2023-08-09T12:39:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.656+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc008dd0 con 0x7ff1bc006210 2023-08-09T12:39:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.657+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.657+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.658+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T12:39:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.658+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.658+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.658+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-09T12:39:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.658+0000 7ff1dced4640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-09T12:39:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.658+0000 7ff1dced4640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.658+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.658+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-09T12:39:01.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.859+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:01.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.859+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:01.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.860+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-09T12:39:01.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.860+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:01.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.860+0000 7ff1dced4640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T12:39:01.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.860+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:01.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.860+0000 7ff1dced4640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:01.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.860+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:01.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.860+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-09T12:39:01.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:01.860+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-09T12:39:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.261+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:02.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T12:39:02.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:02.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dced4640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-09T12:39:02.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dced4640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-09T12:39:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:02.262+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-09T12:39:03.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.064+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.064+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.064+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-09T12:39:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.064+0000 7ff1dd6d5640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.064+0000 7ff1dced4640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-09T12:39:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.064+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.064+0000 7ff1dced4640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-09T12:39:03.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.064+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-09T12:39:03.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.065+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-09T12:39:03.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:03.065+0000 7ff1dced4640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-09T12:39:03.926 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:03.922+0000 7fa61160f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-09T12:39:03.935 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:03.931+0000 7f06efe42040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-09T12:39:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.656+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 msgr2=0x7ff1bc0086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T12:39:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1ceffd640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc006210 0x7ff1bc0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 msgr2=0x7ff1bc005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T12:39:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1ceffd640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc0036e0 0x7ff1bc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1dded6640 1 -- 172.21.15.17:0/2911823139 reap_dead start 2023-08-09T12:39:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1ceffd640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1bc003b30 0x7ff1bc0066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1ceffd640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc008700 0x7ff1bc00d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80d1300 con 0x7ff1bc006be0 2023-08-09T12:39:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d80d1020 con 0x7ff1bc003b30 2023-08-09T12:39:04.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1ceffd640 1 -- 172.21.15.17:0/2911823139 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc008dd0 con 0x7ff1bc008700 2023-08-09T12:39:04.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.657+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1bc003b30 0x7ff1bc0066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.658+0000 7ff1dded6640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.142:3300/0 conn(0x7ff1bc008700 0x7ff1bc00d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.659+0000 7ff1cffff640 1 -- 172.21.15.17:0/2911823139 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230440193 0 0) 0x7ff1d80d1300 con 0x7ff1bc006be0 2023-08-09T12:39:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.659+0000 7ff1cffff640 1 -- 172.21.15.17:0/2911823139 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c4003520 con 0x7ff1bc006be0 2023-08-09T12:39:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.659+0000 7ff1dded6640 1 -- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1bc003b30 msgr2=0x7ff1bc0066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.659+0000 7ff1dded6640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1bc003b30 0x7ff1bc0066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.659+0000 7ff1dded6640 1 -- 172.21.15.17:0/2911823139 >> v1:172.21.15.142:6789/0 conn(0x7ff1bc006be0 legacy=0x7ff1bc006fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.659+0000 7ff1dded6640 1 -- 172.21.15.17:0/2911823139 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc00e950 con 0x7ff1bc008700 2023-08-09T12:39:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.659+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1bc003b30 0x7ff1bc0066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.661+0000 7ff1dded6640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc008700 0x7ff1bc00d1f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80b57b0 tx=0x7ff1d002bbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99eb5c2e6e36da5e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.661+0000 7ff1cffff640 1 -- 172.21.15.17:0/2911823139 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d002c9a0 con 0x7ff1bc008700 2023-08-09T12:39:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.661+0000 7ff1cffff640 1 -- 172.21.15.17:0/2911823139 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d002cb00 con 0x7ff1bc008700 2023-08-09T12:39:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.662+0000 7ff1cffff640 1 -- 172.21.15.17:0/2911823139 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d002ce70 con 0x7ff1bc008700 2023-08-09T12:39:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.662+0000 7ff1df939640 1 -- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc008700 msgr2=0x7ff1bc00d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.662+0000 7ff1df939640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc008700 0x7ff1bc00d1f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80b57b0 tx=0x7ff1d002bbf0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.663+0000 7ff1df939640 1 -- 172.21.15.17:0/2911823139 shutdown_connections 2023-08-09T12:39:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.663+0000 7ff1df939640 1 --2- 172.21.15.17:0/2911823139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc008700 0x7ff1bc00d1f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.663+0000 7ff1df939640 1 --2- 172.21.15.17:0/2911823139 >> v2:172.21.15.17:3300/0 conn(0x7ff1bc003b30 0x7ff1bc0066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.663+0000 7ff1df939640 1 -- 172.21.15.17:0/2911823139 >> 172.21.15.17:0/2911823139 conn(0x7ff1d8069be0 msgr2=0x7ff1d8069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.663+0000 7ff1df939640 1 -- 172.21.15.17:0/2911823139 shutdown_connections 2023-08-09T12:39:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.663+0000 7ff1df939640 1 -- 172.21.15.17:0/2911823139 wait complete. 2023-08-09T12:39:04.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.666+0000 7ff1df939640 1 Processor -- start 2023-08-09T12:39:04.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.666+0000 7ff1df939640 1 -- start start 2023-08-09T12:39:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.668+0000 7ff1df939640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc003b30 0x7ff1d80cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:04.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.668+0000 7ff1df939640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1bc006be0 0x7ff1d814e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:04.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.668+0000 7ff1df939640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc008700 0x7ff1d80b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:04.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.668+0000 7ff1df939640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d80ca9e0 con 0x7ff1bc006be0 2023-08-09T12:39:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.668+0000 7ff1df939640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d814e610 con 0x7ff1bc003b30 2023-08-09T12:39:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.668+0000 7ff1df939640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d80c9d60 con 0x7ff1bc008700 2023-08-09T12:39:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1bc006be0 0x7ff1d814e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1bc006be0 0x7ff1d814e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38166/0 (socket says 172.21.15.17:38166) 2023-08-09T12:39:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 -- 172.21.15.17:0/298756845 learned_addr learned my addr 172.21.15.17:0/298756845 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dded6640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc008700 0x7ff1d80b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dd6d5640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc003b30 0x7ff1d80cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 -- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc008700 msgr2=0x7ff1d80b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc008700 0x7ff1d80b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 -- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc003b30 msgr2=0x7ff1d80cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc003b30 0x7ff1d80cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 -- 172.21.15.17:0/298756845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d400e040 con 0x7ff1bc006be0 2023-08-09T12:39:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dded6640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc008700 0x7ff1d80b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.669+0000 7ff1dced4640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1bc006be0 0x7ff1d814e0d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8003f80 tx=0x7ff1c80055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.670+0000 7ff1cdffb640 1 -- 172.21.15.17:0/298756845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8016660 con 0x7ff1bc006be0 2023-08-09T12:39:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.670+0000 7ff1cdffb640 1 -- 172.21.15.17:0/298756845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c80167c0 con 0x7ff1bc006be0 2023-08-09T12:39:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.670+0000 7ff1cdffb640 1 -- 172.21.15.17:0/298756845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8016b70 con 0x7ff1bc006be0 2023-08-09T12:39:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.670+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d0001d20 con 0x7ff1bc006be0 2023-08-09T12:39:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.670+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d80ca320 con 0x7ff1bc006be0 2023-08-09T12:39:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.670+0000 7ff1cdffb640 1 -- 172.21.15.17:0/298756845 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff1c8016cd0 con 0x7ff1bc006be0 2023-08-09T12:39:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.670+0000 7ff1cdffb640 1 -- 172.21.15.17:0/298756845 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff1c80153b0 con 0x7ff1bc006be0 2023-08-09T12:39:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.671+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d80cab20 con 0x7ff1bc006be0 2023-08-09T12:39:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.675+0000 7ff1cdffb640 1 -- 172.21.15.17:0/298756845 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff1c803eb00 con 0x7ff1bc006be0 2023-08-09T12:39:04.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.758+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff1d8067a80 con 0x7ff1bc006be0 2023-08-09T12:39:04.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.762+0000 7ff1cdffb640 1 -- 172.21.15.17:0/298756845 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff1c802d020 con 0x7ff1bc006be0 2023-08-09T12:39:04.766 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2023-08-09T12:39:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1bc006be0 msgr2=0x7ff1d814e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1bc006be0 0x7ff1d814e0d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8003f80 tx=0x7ff1c80055e0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 shutdown_connections 2023-08-09T12:39:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1bc008700 0x7ff1d80b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1bc006be0 0x7ff1d814e0d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 --2- 172.21.15.17:0/298756845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1bc003b30 0x7ff1d80cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 >> 172.21.15.17:0/298756845 conn(0x7ff1d8069be0 msgr2=0x7ff1d80b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 shutdown_connections 2023-08-09T12:39:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:04.764+0000 7ff1df939640 1 -- 172.21.15.17:0/298756845 wait complete. 2023-08-09T12:39:04.785 INFO:tasks.ceph:check_enable_crimson: False 2023-08-09T12:39:04.785 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-09T12:39:04.785 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:39:04.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-09T12:39:04.871 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:04.867+0000 7fa61160f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-09T12:39:04.881 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:39:04.881 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-09T12:39:04.948 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:04.945+0000 7f06efe42040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-09T12:39:04.970 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:39:04.970 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-09T12:39:05.027 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:05.023+0000 7fa61160f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-09T12:39:05.059 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:39:05.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-09T12:39:05.083 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:05.080+0000 7fa61160f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-09T12:39:05.116 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:05.113+0000 7f06efe42040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-09T12:39:05.136 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:05.133+0000 7fa61160f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-09T12:39:05.152 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:39:05.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-09T12:39:05.177 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:05.174+0000 7f06efe42040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-09T12:39:05.238 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:05.229+0000 7f06efe42040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-09T12:39:05.245 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:39:05.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-09T12:39:05.336 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:39:05.336 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-09T12:39:05.465 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:39:05.466 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-09T12:39:05.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-08-09T12:39:05.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.768+0000 7f9c2b142640 1 Processor -- start 2023-08-09T12:39:05.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.768+0000 7f9c2b142640 1 -- start start 2023-08-09T12:39:05.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.769+0000 7f9c2b142640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c24072850 0x7f9c2406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:05.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.769+0000 7f9c2b142640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9c2415d260 0x7f9c24072c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:05.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.769+0000 7f9c2b142640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9c2406be20 0x7f9c2406c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:05.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.769+0000 7f9c2b142640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2406dd70 con 0x7f9c2406be20 2023-08-09T12:39:05.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.769+0000 7f9c2b142640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c24073170 con 0x7f9c2415d260 2023-08-09T12:39:05.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.769+0000 7f9c2b142640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2406da90 con 0x7f9c24072850 2023-08-09T12:39:05.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c28ede640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c24072850 0x7f9c2406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:05.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c28ede640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c24072850 0x7f9c2406ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57340/0 (socket says 172.21.15.142:57340) 2023-08-09T12:39:05.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c28ede640 1 -- 172.21.15.142:0/4015143945 learned_addr learned my addr 172.21.15.142:0/4015143945 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:05.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c23fff640 1 --2- 172.21.15.142:0/4015143945 >> v2:172.21.15.142:3300/0 conn(0x7f9c2415d260 0x7f9c24072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:05.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c296df640 1 --2- 172.21.15.142:0/4015143945 >> v2:172.21.15.17:3300/0 conn(0x7f9c2406be20 0x7f9c2406c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:05.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c28ede640 1 -- 172.21.15.142:0/4015143945 >> v2:172.21.15.142:3300/0 conn(0x7f9c2415d260 msgr2=0x7f9c24072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:05.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c28ede640 1 --2- 172.21.15.142:0/4015143945 >> v2:172.21.15.142:3300/0 conn(0x7f9c2415d260 0x7f9c24072c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c28ede640 1 -- 172.21.15.142:0/4015143945 >> v2:172.21.15.17:3300/0 conn(0x7f9c2406be20 msgr2=0x7f9c2406c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:05.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c28ede640 1 --2- 172.21.15.142:0/4015143945 >> v2:172.21.15.17:3300/0 conn(0x7f9c2406be20 0x7f9c2406c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.770+0000 7f9c28ede640 1 -- 172.21.15.142:0/4015143945 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24069960 con 0x7f9c24072850 2023-08-09T12:39:05.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.771+0000 7f9c28ede640 1 --2- 172.21.15.142:0/4015143945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c24072850 0x7f9c2406ac60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c240712a0 tx=0x7f9c1802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fbb6dea956d6922 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:05.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.772+0000 7f9c237fe640 1 -- 172.21.15.142:0/4015143945 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18031870 con 0x7f9c24072850 2023-08-09T12:39:05.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.772+0000 7f9c237fe640 1 -- 172.21.15.142:0/4015143945 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c180319d0 con 0x7f9c24072850 2023-08-09T12:39:05.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.772+0000 7f9c237fe640 1 -- 172.21.15.142:0/4015143945 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18031d60 con 0x7f9c24072850 2023-08-09T12:39:05.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.772+0000 7f9c2b142640 1 -- 172.21.15.142:0/4015143945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c24072850 msgr2=0x7f9c2406ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:05.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.772+0000 7f9c2b142640 1 --2- 172.21.15.142:0/4015143945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c24072850 0x7f9c2406ac60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c240712a0 tx=0x7f9c1802b910 comp rx=0 tx=0).stop 2023-08-09T12:39:05.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.773+0000 7f9c2b142640 1 -- 172.21.15.142:0/4015143945 shutdown_connections 2023-08-09T12:39:05.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.773+0000 7f9c2b142640 1 --2- 172.21.15.142:0/4015143945 >> v2:172.21.15.17:3300/0 conn(0x7f9c2406be20 0x7f9c2406c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.773+0000 7f9c2b142640 1 --2- 172.21.15.142:0/4015143945 >> v2:172.21.15.142:3300/0 conn(0x7f9c2415d260 0x7f9c24072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.773+0000 7f9c2b142640 1 --2- 172.21.15.142:0/4015143945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c24072850 0x7f9c2406ac60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.773+0000 7f9c2b142640 1 -- 172.21.15.142:0/4015143945 >> 172.21.15.142:0/4015143945 conn(0x7f9c240b13c0 msgr2=0x7f9c240b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:05.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.773+0000 7f9c2b142640 1 -- 172.21.15.142:0/4015143945 shutdown_connections 2023-08-09T12:39:05.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.773+0000 7f9c2b142640 1 -- 172.21.15.142:0/4015143945 wait complete. 2023-08-09T12:39:05.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.775+0000 7f9c2b142640 1 Processor -- start 2023-08-09T12:39:05.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.775+0000 7f9c2b142640 1 -- start start 2023-08-09T12:39:05.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c2b142640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c2406be20 0x7f9c241f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:05.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c2b142640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c24072850 0x7f9c2415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:05.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c2b142640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c2415d260 0x7f9c2415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:05.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c2b142640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2414b540 con 0x7f9c24072850 2023-08-09T12:39:05.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c2b142640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c241f2710 con 0x7f9c2406be20 2023-08-09T12:39:05.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c2b142640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2415db70 con 0x7f9c2415d260 2023-08-09T12:39:05.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c28ede640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c2406be20 0x7f9c241f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:05.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c28ede640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c2406be20 0x7f9c241f21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32824/0 (socket says 172.21.15.142:32824) 2023-08-09T12:39:05.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c28ede640 1 -- 172.21.15.142:0/2843943182 learned_addr learned my addr 172.21.15.142:0/2843943182 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:05.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c296df640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c2415d260 0x7f9c2415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:05.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.776+0000 7f9c23fff640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c24072850 0x7f9c2415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:05.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c28ede640 1 -- 172.21.15.142:0/2843943182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c2415d260 msgr2=0x7f9c2415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:05.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c28ede640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c2415d260 0x7f9c2415ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c28ede640 1 -- 172.21.15.142:0/2843943182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c24072850 msgr2=0x7f9c2415a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:05.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c28ede640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c24072850 0x7f9c2415a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c28ede640 1 -- 172.21.15.142:0/2843943182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180094d0 con 0x7f9c2406be20 2023-08-09T12:39:05.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c28ede640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c2406be20 0x7f9c241f21d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c1802b950 tx=0x7f9c180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:05.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c217fa640 1 -- 172.21.15.142:0/2843943182 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1803abe0 con 0x7f9c2406be20 2023-08-09T12:39:05.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c217fa640 1 -- 172.21.15.142:0/2843943182 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1803ad40 con 0x7f9c2406be20 2023-08-09T12:39:05.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c217fa640 1 -- 172.21.15.142:0/2843943182 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18044630 con 0x7f9c2406be20 2023-08-09T12:39:05.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.777+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2415f550 con 0x7f9c2406be20 2023-08-09T12:39:05.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.778+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2415fb10 con 0x7f9c2406be20 2023-08-09T12:39:05.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.779+0000 7f9c217fa640 1 -- 172.21.15.142:0/2843943182 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9c18044a90 con 0x7f9c2406be20 2023-08-09T12:39:05.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.779+0000 7f9c217fa640 1 -- 172.21.15.142:0/2843943182 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9c1802d040 con 0x7f9c2406be20 2023-08-09T12:39:05.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.779+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2415f390 con 0x7f9c2406be20 2023-08-09T12:39:05.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.782+0000 7f9c217fa640 1 -- 172.21.15.142:0/2843943182 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9c18052060 con 0x7f9c2406be20 2023-08-09T12:39:05.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.871+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f9c240cd670 con 0x7f9c2406be20 2023-08-09T12:39:05.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.877+0000 7f9c217fa640 1 -- 172.21.15.142:0/2843943182 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c18035020 con 0x7f9c2406be20 2023-08-09T12:39:05.880 INFO:teuthology.orchestra.run.smithi142.stdout:0 2023-08-09T12:39:05.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c2406be20 msgr2=0x7f9c241f21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:05.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c2406be20 0x7f9c241f21d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c1802b950 tx=0x7f9c180046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 shutdown_connections 2023-08-09T12:39:05.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c2415d260 0x7f9c2415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c24072850 0x7f9c2415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 --2- 172.21.15.142:0/2843943182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c2406be20 0x7f9c241f21d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:05.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 >> 172.21.15.142:0/2843943182 conn(0x7f9c240b13c0 msgr2=0x7f9c240aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:05.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 shutdown_connections 2023-08-09T12:39:05.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:05.878+0000 7f9c2b142640 1 -- 172.21.15.142:0/2843943182 wait complete. 2023-08-09T12:39:05.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-08-09T12:39:06.080 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:06.077+0000 7fa61160f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-09T12:39:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.088+0000 7f6c76114640 1 Processor -- start 2023-08-09T12:39:06.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.088+0000 7f6c76114640 1 -- start start 2023-08-09T12:39:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c76114640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c700703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c76114640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c700708e0 0x7f6c700d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c76114640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c700d2360 0x7f6c700697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c76114640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700d1a80 con 0x7f6c700d2360 2023-08-09T12:39:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c76114640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700d2810 con 0x7f6c700708e0 2023-08-09T12:39:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c76114640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700d0f00 con 0x7f6c7015caf0 2023-08-09T12:39:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c75112640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c700703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c75112640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c700703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57344/0 (socket says 172.21.15.142:57344) 2023-08-09T12:39:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c74911640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c700708e0 0x7f6c700d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.090+0000 7f6c75112640 1 -- 172.21.15.142:0/3842289801 learned_addr learned my addr 172.21.15.142:0/3842289801 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:06.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.091+0000 7f6c75913640 1 --2- 172.21.15.142:0/3842289801 >> v2:172.21.15.17:3300/0 conn(0x7f6c700d2360 0x7f6c700697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.091+0000 7f6c75112640 1 -- 172.21.15.142:0/3842289801 >> v2:172.21.15.142:3300/0 conn(0x7f6c700708e0 msgr2=0x7f6c700d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.091+0000 7f6c75112640 1 --2- 172.21.15.142:0/3842289801 >> v2:172.21.15.142:3300/0 conn(0x7f6c700708e0 0x7f6c700d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.091+0000 7f6c75112640 1 -- 172.21.15.142:0/3842289801 >> v2:172.21.15.17:3300/0 conn(0x7f6c700d2360 msgr2=0x7f6c700697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.091+0000 7f6c75112640 1 --2- 172.21.15.142:0/3842289801 >> v2:172.21.15.17:3300/0 conn(0x7f6c700d2360 0x7f6c700697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.091+0000 7f6c75112640 1 -- 172.21.15.142:0/3842289801 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c700d11e0 con 0x7f6c7015caf0 2023-08-09T12:39:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.091+0000 7f6c75913640 1 --2- 172.21.15.142:0/3842289801 >> v2:172.21.15.17:3300/0 conn(0x7f6c700d2360 0x7f6c700697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.092+0000 7f6c75112640 1 --2- 172.21.15.142:0/3842289801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c700703a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c700d04d0 tx=0x7f6c6c02b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a24d2616e4cd39ac server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:06.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.092+0000 7f6c67fff640 1 -- 172.21.15.142:0/3842289801 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c030860 con 0x7f6c7015caf0 2023-08-09T12:39:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.092+0000 7f6c67fff640 1 -- 172.21.15.142:0/3842289801 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0309c0 con 0x7f6c7015caf0 2023-08-09T12:39:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.092+0000 7f6c67fff640 1 -- 172.21.15.142:0/3842289801 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c030d50 con 0x7f6c7015caf0 2023-08-09T12:39:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 -- 172.21.15.142:0/3842289801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 msgr2=0x7f6c700703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 --2- 172.21.15.142:0/3842289801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c700703a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c700d04d0 tx=0x7f6c6c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 -- 172.21.15.142:0/3842289801 shutdown_connections 2023-08-09T12:39:06.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 --2- 172.21.15.142:0/3842289801 >> v2:172.21.15.17:3300/0 conn(0x7f6c700d2360 0x7f6c700697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 --2- 172.21.15.142:0/3842289801 >> v2:172.21.15.142:3300/0 conn(0x7f6c700708e0 0x7f6c700d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 --2- 172.21.15.142:0/3842289801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c700703a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 -- 172.21.15.142:0/3842289801 >> 172.21.15.142:0/3842289801 conn(0x7f6c700cf6b0 msgr2=0x7f6c700cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:06.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 -- 172.21.15.142:0/3842289801 shutdown_connections 2023-08-09T12:39:06.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.093+0000 7f6c76114640 1 -- 172.21.15.142:0/3842289801 wait complete. 2023-08-09T12:39:06.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.094+0000 7f6c76114640 1 Processor -- start 2023-08-09T12:39:06.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.095+0000 7f6c76114640 1 -- start start 2023-08-09T12:39:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c76114640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c700d2360 0x7f6c70152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c76114640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c70154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c76114640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c701f3630 0x7f6c70155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c76114640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70152790 con 0x7f6c701f3630 2023-08-09T12:39:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c76114640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7015eaf0 con 0x7f6c700d2360 2023-08-09T12:39:06.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c76114640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700c9360 con 0x7f6c7015caf0 2023-08-09T12:39:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c74911640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c70154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c74911640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c70154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57350/0 (socket says 172.21.15.142:57350) 2023-08-09T12:39:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c74911640 1 -- 172.21.15.142:0/2161340343 learned_addr learned my addr 172.21.15.142:0/2161340343 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c75112640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c700d2360 0x7f6c70152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c74911640 1 -- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c700d2360 msgr2=0x7f6c70152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c74911640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c700d2360 0x7f6c70152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c74911640 1 -- 172.21.15.142:0/2161340343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c701f3630 msgr2=0x7f6c70155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c74911640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c701f3630 0x7f6c70155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c74911640 1 -- 172.21.15.142:0/2161340343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c0094d0 con 0x7f6c7015caf0 2023-08-09T12:39:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.096+0000 7f6c75112640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c700d2360 0x7f6c70152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.097+0000 7f6c74911640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c70154ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e890 tx=0x7f6c6000ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.097+0000 7f6c65ffb640 1 -- 172.21.15.142:0/2161340343 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000c940 con 0x7f6c7015caf0 2023-08-09T12:39:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.097+0000 7f6c65ffb640 1 -- 172.21.15.142:0/2161340343 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6000caa0 con 0x7f6c7015caf0 2023-08-09T12:39:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.097+0000 7f6c65ffb640 1 -- 172.21.15.142:0/2161340343 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000ce30 con 0x7f6c7015caf0 2023-08-09T12:39:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.097+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c701f3050 con 0x7f6c7015caf0 2023-08-09T12:39:06.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.097+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7015e4a0 con 0x7f6c7015caf0 2023-08-09T12:39:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.097+0000 7f6c65ffb640 1 -- 172.21.15.142:0/2161340343 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c60013770 con 0x7f6c7015caf0 2023-08-09T12:39:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.098+0000 7f6c65ffb640 1 -- 172.21.15.142:0/2161340343 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6c60013dd0 con 0x7f6c7015caf0 2023-08-09T12:39:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.098+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7015ec60 con 0x7f6c7015caf0 2023-08-09T12:39:06.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.101+0000 7f6c65ffb640 1 -- 172.21.15.142:0/2161340343 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6c60021060 con 0x7f6c7015caf0 2023-08-09T12:39:06.149 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:06.146+0000 7fa61160f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-09T12:39:06.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.178+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f6c7004e390 con 0x7f6c7015caf0 2023-08-09T12:39:06.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.185+0000 7f6c65ffb640 1 -- 172.21.15.142:0/2161340343 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c6002a020 con 0x7f6c7015caf0 2023-08-09T12:39:06.188 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:39:06.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 msgr2=0x7f6c70154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c70154ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e890 tx=0x7f6c6000ed50 comp rx=0 tx=0).stop 2023-08-09T12:39:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 shutdown_connections 2023-08-09T12:39:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c701f3630 0x7f6c70155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c7015caf0 0x7f6c70154ad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 --2- 172.21.15.142:0/2161340343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c700d2360 0x7f6c70152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 >> 172.21.15.142:0/2161340343 conn(0x7f6c700cf6b0 msgr2=0x7f6c700b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:06.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 shutdown_connections 2023-08-09T12:39:06.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.186+0000 7f6c76114640 1 -- 172.21.15.142:0/2161340343 wait complete. 2023-08-09T12:39:06.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-08-09T12:39:06.213 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:06.209+0000 7fa61160f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-09T12:39:06.228 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:06.224+0000 7f06efe42040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-09T12:39:06.293 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:06.290+0000 7f06efe42040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-09T12:39:06.349 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:06.346+0000 7f06efe42040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-09T12:39:06.350 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:06.347+0000 7fa61160f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-09T12:39:06.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.395+0000 7f43acfe3640 1 Processor -- start 2023-08-09T12:39:06.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.395+0000 7f43acfe3640 1 -- start start 2023-08-09T12:39:06.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f43acfe3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43a815ce90 0x7f43a81616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f43acfe3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f43acfe3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a80b6460 con 0x7f43a80d29d0 2023-08-09T12:39:06.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f43acfe3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a80cda40 con 0x7f43a815ce90 2023-08-09T12:39:06.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f43acfe3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80cdd10 con 0x7f43a80b6000 2023-08-09T12:39:06.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f43a659c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43a815ce90 0x7f43a81616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f43a659c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43a815ce90 0x7f43a81616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32848/0 (socket says 172.21.15.142:32848) 2023-08-09T12:39:06.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f43a659c640 1 -- 172.21.15.142:0/2327133272 learned_addr learned my addr 172.21.15.142:0/2327133272 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:06.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.397+0000 7f439ffff640 1 --2- 172.21.15.142:0/2327133272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.398+0000 7f43a659c640 1 -- 172.21.15.142:0/2327133272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 msgr2=0x7f43a80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:06.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.398+0000 7f43a659c640 1 --2- 172.21.15.142:0/2327133272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a80cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.398+0000 7f43a659c640 1 -- 172.21.15.142:0/2327133272 >> v1:172.21.15.142:6789/0 conn(0x7f43a80d29d0 legacy=0x7f43a80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.398+0000 7f43a5d9b640 1 -- 172.21.15.142:0/2327133272 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132782521 0 0) 0x7f43a80b6460 con 0x7f43a80d29d0 2023-08-09T12:39:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.398+0000 7f43a659c640 1 -- 172.21.15.142:0/2327133272 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80cdff0 con 0x7f43a815ce90 2023-08-09T12:39:06.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.399+0000 7f43a659c640 1 --2- 172.21.15.142:0/2327133272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 0x7f43a81616e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4398009870 tx=0x7f439802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a0b7cc5e84d994 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:06.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.399+0000 7f43a5d9b640 1 -- 172.21.15.142:0/2327133272 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398030840 con 0x7f43a815ce90 2023-08-09T12:39:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.399+0000 7f43a5d9b640 1 -- 172.21.15.142:0/2327133272 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43980309a0 con 0x7f43a815ce90 2023-08-09T12:39:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.399+0000 7f43a5d9b640 1 -- 172.21.15.142:0/2327133272 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398030d30 con 0x7f43a815ce90 2023-08-09T12:39:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.400+0000 7f43acfe3640 1 -- 172.21.15.142:0/2327133272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 msgr2=0x7f43a81616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.400+0000 7f43acfe3640 1 --2- 172.21.15.142:0/2327133272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 0x7f43a81616e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4398009870 tx=0x7f439802b980 comp rx=0 tx=0).stop 2023-08-09T12:39:06.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.400+0000 7f43acfe3640 1 -- 172.21.15.142:0/2327133272 shutdown_connections 2023-08-09T12:39:06.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.400+0000 7f43acfe3640 1 --2- 172.21.15.142:0/2327133272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a80cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.400+0000 7f43acfe3640 1 --2- 172.21.15.142:0/2327133272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 0x7f43a81616e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.400+0000 7f43acfe3640 1 -- 172.21.15.142:0/2327133272 >> 172.21.15.142:0/2327133272 conn(0x7f43a806fde0 msgr2=0x7f43a80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:06.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.400+0000 7f43acfe3640 1 -- 172.21.15.142:0/2327133272 shutdown_connections 2023-08-09T12:39:06.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.400+0000 7f43acfe3640 1 -- 172.21.15.142:0/2327133272 wait complete. 2023-08-09T12:39:06.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.402+0000 7f43acfe3640 1 Processor -- start 2023-08-09T12:39:06.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.402+0000 7f43acfe3640 1 -- start start 2023-08-09T12:39:06.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43acfe3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43acfe3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a80d29d0 0x7f43a8157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43acfe3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 0x7f43a81f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43acfe3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a815f390 con 0x7f43a80d29d0 2023-08-09T12:39:06.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43acfe3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a815f670 con 0x7f43a815ce90 2023-08-09T12:39:06.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43acfe3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a81f70d0 con 0x7f43a80b6000 2023-08-09T12:39:06.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a815d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57370/0 (socket says 172.21.15.142:57370) 2023-08-09T12:39:06.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a659c640 1 -- 172.21.15.142:0/4197559267 learned_addr learned my addr 172.21.15.142:0/4197559267 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:06.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a6d9d640 1 --2- 172.21.15.142:0/4197559267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 0x7f43a81f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a659c640 1 -- 172.21.15.142:0/4197559267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 msgr2=0x7f43a81f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a659c640 1 --2- 172.21.15.142:0/4197559267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 0x7f43a81f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a659c640 1 -- 172.21.15.142:0/4197559267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a80d29d0 msgr2=0x7f43a8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a659c640 1 --2- 172.21.15.142:0/4197559267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a80d29d0 0x7f43a8157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.403+0000 7f43a659c640 1 -- 172.21.15.142:0/4197559267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43980094d0 con 0x7f43a80b6000 2023-08-09T12:39:06.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.404+0000 7f43a659c640 1 --2- 172.21.15.142:0/4197559267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a815d580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4398000c00 tx=0x7f43980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:06.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.404+0000 7f439effd640 1 -- 172.21.15.142:0/4197559267 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439803e070 con 0x7f43a80b6000 2023-08-09T12:39:06.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.404+0000 7f439effd640 1 -- 172.21.15.142:0/4197559267 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398004030 con 0x7f43a80b6000 2023-08-09T12:39:06.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.404+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a81f33a0 con 0x7f43a80b6000 2023-08-09T12:39:06.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.404+0000 7f439effd640 1 -- 172.21.15.142:0/4197559267 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43980043e0 con 0x7f43a80b6000 2023-08-09T12:39:06.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.404+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a81f3960 con 0x7f43a80b6000 2023-08-09T12:39:06.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.405+0000 7f439effd640 1 -- 172.21.15.142:0/4197559267 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4398042070 con 0x7f43a80b6000 2023-08-09T12:39:06.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.405+0000 7f439effd640 1 -- 172.21.15.142:0/4197559267 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f43980037a0 con 0x7f43a80b6000 2023-08-09T12:39:06.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.405+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a81f3b50 con 0x7f43a80b6000 2023-08-09T12:39:06.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.408+0000 7f439effd640 1 -- 172.21.15.142:0/4197559267 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4398034070 con 0x7f43a80b6000 2023-08-09T12:39:06.481 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:06.478+0000 7f06efe42040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-09T12:39:06.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.485+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f43a80b4d70 con 0x7f43a80b6000 2023-08-09T12:39:06.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.491+0000 7f439effd640 1 -- 172.21.15.142:0/4197559267 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4398039b00 con 0x7f43a80b6000 2023-08-09T12:39:06.495 INFO:teuthology.orchestra.run.smithi142.stdout:2 2023-08-09T12:39:06.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.492+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 msgr2=0x7f43a815d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.492+0000 7f43acfe3640 1 --2- 172.21.15.142:0/4197559267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a815d580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4398000c00 tx=0x7f43980046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.492+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 shutdown_connections 2023-08-09T12:39:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.492+0000 7f43acfe3640 1 --2- 172.21.15.142:0/4197559267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a815ce90 0x7f43a81f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.492+0000 7f43acfe3640 1 --2- 172.21.15.142:0/4197559267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a80d29d0 0x7f43a8157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.492+0000 7f43acfe3640 1 --2- 172.21.15.142:0/4197559267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80b6000 0x7f43a815d580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.492+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 >> 172.21.15.142:0/4197559267 conn(0x7f43a806fde0 msgr2=0x7f43a80b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.492+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 shutdown_connections 2023-08-09T12:39:06.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.493+0000 7f43acfe3640 1 -- 172.21.15.142:0/4197559267 wait complete. 2023-08-09T12:39:06.512 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-08-09T12:39:06.525 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:06.522+0000 7fa61160f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-09T12:39:06.641 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:06.638+0000 7fa61160f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-09T12:39:06.648 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:06.644+0000 7f06efe42040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-09T12:39:06.694 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:06.691+0000 7fa61160f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-09T12:39:06.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.710+0000 7fb430c25640 1 Processor -- start 2023-08-09T12:39:06.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.710+0000 7fb430c25640 1 -- start start 2023-08-09T12:39:06.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.712+0000 7fb430c25640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb42c0d2290 0x7fb42c0b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.712+0000 7fb430c25640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c070ab0 con 0x7fb42c0d1e20 2023-08-09T12:39:06.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.712+0000 7fb430c25640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c0d2720 con 0x7fb42c15caf0 2023-08-09T12:39:06.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.712+0000 7fb430c25640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c0d1a80 con 0x7fb42c0d2290 2023-08-09T12:39:06.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.712+0000 7fb42bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb42c0d2290 0x7fb42c0b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.712+0000 7fb42bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb42c0d2290 0x7fb42c0b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32868/0 (socket says 172.21.15.142:32868) 2023-08-09T12:39:06.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.712+0000 7fb42bfff640 1 -- 172.21.15.142:0/889401165 learned_addr learned my addr 172.21.15.142:0/889401165 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:06.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.713+0000 7fb42bfff640 1 -- 172.21.15.142:0/889401165 >> v1:172.21.15.142:6789/0 conn(0x7fb42c15caf0 legacy=0x7fb42c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.713+0000 7fb42bfff640 1 -- 172.21.15.142:0/889401165 >> v1:172.21.15.17:6789/0 conn(0x7fb42c0d1e20 legacy=0x7fb42c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.713+0000 7fb42bfff640 1 -- 172.21.15.142:0/889401165 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c0d0f00 con 0x7fb42c0d2290 2023-08-09T12:39:06.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.714+0000 7fb42bfff640 1 --2- 172.21.15.142:0/889401165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d2290 0x7fb42c0b64f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb424009e50 tx=0x7fb42402bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcf433d0551e1ee7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:06.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.714+0000 7fb42affd640 1 -- 172.21.15.142:0/889401165 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42402cb90 con 0x7fb42c0d2290 2023-08-09T12:39:06.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.714+0000 7fb42affd640 1 -- 172.21.15.142:0/889401165 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42402ccf0 con 0x7fb42c0d2290 2023-08-09T12:39:06.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.714+0000 7fb42affd640 1 -- 172.21.15.142:0/889401165 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424034610 con 0x7fb42c0d2290 2023-08-09T12:39:06.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.715+0000 7fb430c25640 1 -- 172.21.15.142:0/889401165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d2290 msgr2=0x7fb42c0b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.715+0000 7fb430c25640 1 --2- 172.21.15.142:0/889401165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d2290 0x7fb42c0b64f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb424009e50 tx=0x7fb42402bff0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.715+0000 7fb430c25640 1 -- 172.21.15.142:0/889401165 shutdown_connections 2023-08-09T12:39:06.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.715+0000 7fb430c25640 1 --2- 172.21.15.142:0/889401165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d2290 0x7fb42c0b64f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.715+0000 7fb430c25640 1 -- 172.21.15.142:0/889401165 >> 172.21.15.142:0/889401165 conn(0x7fb42c0cf6b0 msgr2=0x7fb42c0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:06.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.715+0000 7fb430c25640 1 -- 172.21.15.142:0/889401165 shutdown_connections 2023-08-09T12:39:06.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.715+0000 7fb430c25640 1 -- 172.21.15.142:0/889401165 wait complete. 2023-08-09T12:39:06.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.716+0000 7fb430c25640 1 Processor -- start 2023-08-09T12:39:06.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.717+0000 7fb430c25640 1 -- start start 2023-08-09T12:39:06.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb430c25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d1e20 0x7fb42c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb430c25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c0d2290 0x7fb42c155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb430c25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb42c15caf0 0x7fb42c155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:06.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb430c25640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c153c70 con 0x7fb42c0d2290 2023-08-09T12:39:06.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb430c25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c153060 con 0x7fb42c0d1e20 2023-08-09T12:39:06.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb430c25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c153340 con 0x7fb42c15caf0 2023-08-09T12:39:06.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d1e20 0x7fb42c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb42c15caf0 0x7fb42c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d1e20 0x7fb42c0b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32874/0 (socket says 172.21.15.142:32874) 2023-08-09T12:39:06.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42b7fe640 1 -- 172.21.15.142:0/3283082378 learned_addr learned my addr 172.21.15.142:0/3283082378 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:06.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb423fff640 1 --2- 172.21.15.142:0/3283082378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c0d2290 0x7fb42c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:06.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42bfff640 1 -- 172.21.15.142:0/3283082378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d1e20 msgr2=0x7fb42c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42bfff640 1 --2- 172.21.15.142:0/3283082378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d1e20 0x7fb42c0b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42bfff640 1 -- 172.21.15.142:0/3283082378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c0d2290 msgr2=0x7fb42c155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42bfff640 1 --2- 172.21.15.142:0/3283082378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c0d2290 0x7fb42c155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.718+0000 7fb42bfff640 1 -- 172.21.15.142:0/3283082378 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424009b30 con 0x7fb42c15caf0 2023-08-09T12:39:06.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.719+0000 7fb42bfff640 1 --2- 172.21.15.142:0/3283082378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb42c15caf0 0x7fb42c155980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0ce100 tx=0x7fb424004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:06.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.719+0000 7fb428ff9640 1 -- 172.21.15.142:0/3283082378 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424009510 con 0x7fb42c15caf0 2023-08-09T12:39:06.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.719+0000 7fb428ff9640 1 -- 172.21.15.142:0/3283082378 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42403e450 con 0x7fb42c15caf0 2023-08-09T12:39:06.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.719+0000 7fb428ff9640 1 -- 172.21.15.142:0/3283082378 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42403e800 con 0x7fb42c15caf0 2023-08-09T12:39:06.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.719+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c153620 con 0x7fb42c15caf0 2023-08-09T12:39:06.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.719+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c0b4090 con 0x7fb42c15caf0 2023-08-09T12:39:06.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.719+0000 7fb428ff9640 1 -- 172.21.15.142:0/3283082378 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb42403ec60 con 0x7fb42c15caf0 2023-08-09T12:39:06.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.719+0000 7fb428ff9640 1 -- 172.21.15.142:0/3283082378 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb424048ae0 con 0x7fb42c15caf0 2023-08-09T12:39:06.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.720+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c153ae0 con 0x7fb42c15caf0 2023-08-09T12:39:06.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.723+0000 7fb428ff9640 1 -- 172.21.15.142:0/3283082378 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb424043020 con 0x7fb42c15caf0 2023-08-09T12:39:06.764 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:06.761+0000 7f06efe42040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-09T12:39:06.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.800+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7fb42c153e20 con 0x7fb42c15caf0 2023-08-09T12:39:06.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.806+0000 7fb428ff9640 1 -- 172.21.15.142:0/3283082378 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb42c153e20 con 0x7fb42c15caf0 2023-08-09T12:39:06.810 INFO:teuthology.orchestra.run.smithi142.stdout:3 2023-08-09T12:39:06.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb42c15caf0 msgr2=0x7fb42c155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:06.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 --2- 172.21.15.142:0/3283082378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb42c15caf0 0x7fb42c155980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0ce100 tx=0x7fb424004a40 comp rx=0 tx=0).stop 2023-08-09T12:39:06.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 shutdown_connections 2023-08-09T12:39:06.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 --2- 172.21.15.142:0/3283082378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb42c15caf0 0x7fb42c155980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 --2- 172.21.15.142:0/3283082378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c0d2290 0x7fb42c155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 --2- 172.21.15.142:0/3283082378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0d1e20 0x7fb42c0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:06.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 >> 172.21.15.142:0/3283082378 conn(0x7fb42c0cf6b0 msgr2=0x7fb42c0cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:06.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 shutdown_connections 2023-08-09T12:39:06.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:06.807+0000 7fb430c25640 1 -- 172.21.15.142:0/3283082378 wait complete. 2023-08-09T12:39:06.816 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:06.813+0000 7f06efe42040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-09T12:39:06.827 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-08-09T12:39:06.876 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:06.866+0000 7fa61160f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-09T12:39:06.990 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:06.986+0000 7f06efe42040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-09T12:39:07.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.062+0000 7fc2b8d2f640 1 Processor -- start 2023-08-09T12:39:07.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.062+0000 7fc2b8d2f640 1 -- start start 2023-08-09T12:39:07.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b8d2f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc2b415ce90 0x7fc2b41616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b8d2f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40b6000 0x7fc2b40cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b8d2f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2b40d29d0 0x7fc2b40d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b8d2f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b40d33a0 con 0x7fc2b415ce90 2023-08-09T12:39:07.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b8d2f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b40b6460 con 0x7fc2b40d29d0 2023-08-09T12:39:07.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b8d2f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40cda40 con 0x7fc2b40b6000 2023-08-09T12:39:07.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b1d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40b6000 0x7fc2b40cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b2d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2b40d29d0 0x7fc2b40d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b1d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40b6000 0x7fc2b40cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57394/0 (socket says 172.21.15.142:57394) 2023-08-09T12:39:07.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b1d9b640 1 -- 172.21.15.142:0/2486517874 learned_addr learned my addr 172.21.15.142:0/2486517874 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:07.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.064+0000 7fc2b259c640 1 --2- 172.21.15.142:0/2486517874 >> v2:172.21.15.17:3300/0 conn(0x7fc2b415ce90 0x7fc2b41616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.065+0000 7fc2b1d9b640 1 -- 172.21.15.142:0/2486517874 >> v2:172.21.15.142:3300/0 conn(0x7fc2b40d29d0 msgr2=0x7fc2b40d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:07.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.065+0000 7fc2b1d9b640 1 --2- 172.21.15.142:0/2486517874 >> v2:172.21.15.142:3300/0 conn(0x7fc2b40d29d0 0x7fc2b40d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.065+0000 7fc2b1d9b640 1 -- 172.21.15.142:0/2486517874 >> v2:172.21.15.17:3300/0 conn(0x7fc2b415ce90 msgr2=0x7fc2b41616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:07.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.065+0000 7fc2b1d9b640 1 --2- 172.21.15.142:0/2486517874 >> v2:172.21.15.17:3300/0 conn(0x7fc2b415ce90 0x7fc2b41616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.065+0000 7fc2b1d9b640 1 -- 172.21.15.142:0/2486517874 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b40cdd10 con 0x7fc2b40b6000 2023-08-09T12:39:07.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.065+0000 7fc2b2d9d640 1 --2- 172.21.15.142:0/2486517874 >> v2:172.21.15.142:3300/0 conn(0x7fc2b40d29d0 0x7fc2b40d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:07.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.066+0000 7fc2b1d9b640 1 --2- 172.21.15.142:0/2486517874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40b6000 0x7fc2b40cd500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40d0a70 tx=0x7fc2a802b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5383a82a834784c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:07.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.066+0000 7fc2b159a640 1 -- 172.21.15.142:0/2486517874 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8031880 con 0x7fc2b40b6000 2023-08-09T12:39:07.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.066+0000 7fc2b159a640 1 -- 172.21.15.142:0/2486517874 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a80319e0 con 0x7fc2b40b6000 2023-08-09T12:39:07.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.066+0000 7fc2b159a640 1 -- 172.21.15.142:0/2486517874 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8031d70 con 0x7fc2b40b6000 2023-08-09T12:39:07.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/2486517874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40b6000 msgr2=0x7fc2b40cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 --2- 172.21.15.142:0/2486517874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40b6000 0x7fc2b40cd500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40d0a70 tx=0x7fc2a802b920 comp rx=0 tx=0).stop 2023-08-09T12:39:07.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/2486517874 shutdown_connections 2023-08-09T12:39:07.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 --2- 172.21.15.142:0/2486517874 >> v2:172.21.15.142:3300/0 conn(0x7fc2b40d29d0 0x7fc2b40d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 --2- 172.21.15.142:0/2486517874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40b6000 0x7fc2b40cd500 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 --2- 172.21.15.142:0/2486517874 >> v2:172.21.15.17:3300/0 conn(0x7fc2b415ce90 0x7fc2b41616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/2486517874 >> 172.21.15.142:0/2486517874 conn(0x7fc2b406fde0 msgr2=0x7fc2b40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:07.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/2486517874 shutdown_connections 2023-08-09T12:39:07.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.067+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/2486517874 wait complete. 2023-08-09T12:39:07.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.069+0000 7fc2b8d2f640 1 Processor -- start 2023-08-09T12:39:07.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.069+0000 7fc2b8d2f640 1 -- start start 2023-08-09T12:39:07.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b8d2f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b40b6000 0x7fc2b40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b8d2f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40d29d0 0x7fc2b41e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b8d2f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b415ce90 0x7fc2b41e6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b8d2f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b413fc00 con 0x7fc2b415ce90 2023-08-09T12:39:07.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b8d2f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4140a20 con 0x7fc2b40b6000 2023-08-09T12:39:07.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b8d2f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40ca8a0 con 0x7fc2b40d29d0 2023-08-09T12:39:07.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b40b6000 0x7fc2b40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b1d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40d29d0 0x7fc2b41e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b40b6000 0x7fc2b40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32878/0 (socket says 172.21.15.142:32878) 2023-08-09T12:39:07.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b259c640 1 -- 172.21.15.142:0/1388392552 learned_addr learned my addr 172.21.15.142:0/1388392552 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:07.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b2d9d640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b415ce90 0x7fc2b41e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b259c640 1 -- 172.21.15.142:0/1388392552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40d29d0 msgr2=0x7fc2b41e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b259c640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40d29d0 0x7fc2b41e63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b259c640 1 -- 172.21.15.142:0/1388392552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b415ce90 msgr2=0x7fc2b41e6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b259c640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b415ce90 0x7fc2b41e6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b259c640 1 -- 172.21.15.142:0/1388392552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac009a70 con 0x7fc2b40b6000 2023-08-09T12:39:07.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.070+0000 7fc2b2d9d640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b415ce90 0x7fc2b41e6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:07.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.071+0000 7fc2b259c640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b40b6000 0x7fc2b40ca360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400d5f0 tx=0x7fc2a400dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:07.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.071+0000 7fc2a2ffd640 1 -- 172.21.15.142:0/1388392552 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40125f0 con 0x7fc2b40b6000 2023-08-09T12:39:07.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.071+0000 7fc2a2ffd640 1 -- 172.21.15.142:0/1388392552 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4012750 con 0x7fc2b40b6000 2023-08-09T12:39:07.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.071+0000 7fc2a2ffd640 1 -- 172.21.15.142:0/1388392552 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4012b00 con 0x7fc2b40b6000 2023-08-09T12:39:07.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.071+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a80094d0 con 0x7fc2b40b6000 2023-08-09T12:39:07.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.071+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b41400f0 con 0x7fc2b40b6000 2023-08-09T12:39:07.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.071+0000 7fc2a2ffd640 1 -- 172.21.15.142:0/1388392552 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc2a401e460 con 0x7fc2b40b6000 2023-08-09T12:39:07.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.071+0000 7fc2a2ffd640 1 -- 172.21.15.142:0/1388392552 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc2a4014990 con 0x7fc2b40b6000 2023-08-09T12:39:07.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.072+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b4160940 con 0x7fc2b40b6000 2023-08-09T12:39:07.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.075+0000 7fc2a2ffd640 1 -- 172.21.15.142:0/1388392552 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc2a4014be0 con 0x7fc2b40b6000 2023-08-09T12:39:07.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.152+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7fc2b4067a80 con 0x7fc2b40b6000 2023-08-09T12:39:07.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.158+0000 7fc2a2ffd640 1 -- 172.21.15.142:0/1388392552 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc2a4014e50 con 0x7fc2b40b6000 2023-08-09T12:39:07.161 INFO:teuthology.orchestra.run.smithi142.stdout:4 2023-08-09T12:39:07.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.159+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b40b6000 msgr2=0x7fc2b40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.159+0000 7fc2b8d2f640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b40b6000 0x7fc2b40ca360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400d5f0 tx=0x7fc2a400dab0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.159+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 shutdown_connections 2023-08-09T12:39:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.159+0000 7fc2b8d2f640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b415ce90 0x7fc2b41e6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.159+0000 7fc2b8d2f640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2b40d29d0 0x7fc2b41e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.159+0000 7fc2b8d2f640 1 --2- 172.21.15.142:0/1388392552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2b40b6000 0x7fc2b40ca360 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.159+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 >> 172.21.15.142:0/1388392552 conn(0x7fc2b406fde0 msgr2=0x7fc2b40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.160+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 shutdown_connections 2023-08-09T12:39:07.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.160+0000 7fc2b8d2f640 1 -- 172.21.15.142:0/1388392552 wait complete. 2023-08-09T12:39:07.177 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-08-09T12:39:07.344 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:07.341+0000 7fa61160f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-09T12:39:07.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.367+0000 7ff4f759e640 1 Processor -- start 2023-08-09T12:39:07.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.367+0000 7ff4f759e640 1 -- start start 2023-08-09T12:39:07.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f815cb40 0x7ff4f81609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff4f80b8420 0x7ff4f80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4f815cf20 0x7ff4f80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f80d0f00 con 0x7ff4f80b8420 2023-08-09T12:39:07.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f81611f0 con 0x7ff4f815cf20 2023-08-09T12:39:07.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81614d0 con 0x7ff4f815cb40 2023-08-09T12:39:07.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f815cb40 0x7ff4f81609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f815cb40 0x7ff4f81609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57414/0 (socket says 172.21.15.142:57414) 2023-08-09T12:39:07.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f659c640 1 -- 172.21.15.142:0/100573021 learned_addr learned my addr 172.21.15.142:0/100573021 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:07.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.369+0000 7ff4f6d9d640 1 --2- 172.21.15.142:0/100573021 >> v2:172.21.15.142:3300/0 conn(0x7ff4f815cf20 0x7ff4f80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.370+0000 7ff4effff640 1 --2- 172.21.15.142:0/100573021 >> v2:172.21.15.17:3300/0 conn(0x7ff4f80b8420 0x7ff4f80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.370+0000 7ff4f659c640 1 -- 172.21.15.142:0/100573021 >> v2:172.21.15.142:3300/0 conn(0x7ff4f815cf20 msgr2=0x7ff4f80cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:07.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.370+0000 7ff4f659c640 1 --2- 172.21.15.142:0/100573021 >> v2:172.21.15.142:3300/0 conn(0x7ff4f815cf20 0x7ff4f80cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.370+0000 7ff4f659c640 1 -- 172.21.15.142:0/100573021 >> v2:172.21.15.17:3300/0 conn(0x7ff4f80b8420 msgr2=0x7ff4f80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:07.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.370+0000 7ff4f659c640 1 --2- 172.21.15.142:0/100573021 >> v2:172.21.15.17:3300/0 conn(0x7ff4f80b8420 0x7ff4f80cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.370+0000 7ff4f659c640 1 -- 172.21.15.142:0/100573021 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f81617b0 con 0x7ff4f815cb40 2023-08-09T12:39:07.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.370+0000 7ff4effff640 1 --2- 172.21.15.142:0/100573021 >> v2:172.21.15.17:3300/0 conn(0x7ff4f80b8420 0x7ff4f80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:07.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.371+0000 7ff4f659c640 1 --2- 172.21.15.142:0/100573021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f815cb40 0x7ff4f81609a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80b88b0 tx=0x7ff4e802b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d43f4191b8fb6ac server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:07.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.371+0000 7ff4f5d9b640 1 -- 172.21.15.142:0/100573021 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8030850 con 0x7ff4f815cb40 2023-08-09T12:39:07.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.371+0000 7ff4f5d9b640 1 -- 172.21.15.142:0/100573021 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e80309b0 con 0x7ff4f815cb40 2023-08-09T12:39:07.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.371+0000 7ff4f5d9b640 1 -- 172.21.15.142:0/100573021 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8030d40 con 0x7ff4f815cb40 2023-08-09T12:39:07.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 -- 172.21.15.142:0/100573021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f815cb40 msgr2=0x7ff4f81609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 --2- 172.21.15.142:0/100573021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f815cb40 0x7ff4f81609a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80b88b0 tx=0x7ff4e802b990 comp rx=0 tx=0).stop 2023-08-09T12:39:07.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 -- 172.21.15.142:0/100573021 shutdown_connections 2023-08-09T12:39:07.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 --2- 172.21.15.142:0/100573021 >> v2:172.21.15.142:3300/0 conn(0x7ff4f815cf20 0x7ff4f80cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 --2- 172.21.15.142:0/100573021 >> v2:172.21.15.17:3300/0 conn(0x7ff4f80b8420 0x7ff4f80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 --2- 172.21.15.142:0/100573021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f815cb40 0x7ff4f81609a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 -- 172.21.15.142:0/100573021 >> 172.21.15.142:0/100573021 conn(0x7ff4f80d2ab0 msgr2=0x7ff4f80d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:07.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 -- 172.21.15.142:0/100573021 shutdown_connections 2023-08-09T12:39:07.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.372+0000 7ff4f759e640 1 -- 172.21.15.142:0/100573021 wait complete. 2023-08-09T12:39:07.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.374+0000 7ff4f759e640 1 Processor -- start 2023-08-09T12:39:07.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.374+0000 7ff4f759e640 1 -- start start 2023-08-09T12:39:07.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f80b8420 0x7ff4f814c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f815cb40 0x7ff4f81f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f815cf20 0x7ff4f8159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f814cb00 con 0x7ff4f815cf20 2023-08-09T12:39:07.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80c8a00 con 0x7ff4f815cb40 2023-08-09T12:39:07.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f814c5a0 con 0x7ff4f80b8420 2023-08-09T12:39:07.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f80b8420 0x7ff4f814c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f80b8420 0x7ff4f814c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57428/0 (socket says 172.21.15.142:57428) 2023-08-09T12:39:07.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f659c640 1 -- 172.21.15.142:0/2488517435 learned_addr learned my addr 172.21.15.142:0/2488517435 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:07.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4effff640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f815cb40 0x7ff4f81f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f6d9d640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f815cf20 0x7ff4f8159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f659c640 1 -- 172.21.15.142:0/2488517435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f815cb40 msgr2=0x7ff4f81f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f659c640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f815cb40 0x7ff4f81f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f659c640 1 -- 172.21.15.142:0/2488517435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f815cf20 msgr2=0x7ff4f8159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f659c640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f815cf20 0x7ff4f8159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.375+0000 7ff4f659c640 1 -- 172.21.15.142:0/2488517435 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80094d0 con 0x7ff4f80b8420 2023-08-09T12:39:07.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.376+0000 7ff4f659c640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f80b8420 0x7ff4f814c060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff4e802b9d0 tx=0x7ff4e8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:07.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.376+0000 7ff4eeffd640 1 -- 172.21.15.142:0/2488517435 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8039c90 con 0x7ff4f80b8420 2023-08-09T12:39:07.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.376+0000 7ff4eeffd640 1 -- 172.21.15.142:0/2488517435 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8039e10 con 0x7ff4f80b8420 2023-08-09T12:39:07.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.376+0000 7ff4eeffd640 1 -- 172.21.15.142:0/2488517435 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8043640 con 0x7ff4f80b8420 2023-08-09T12:39:07.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.376+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f81f6720 con 0x7ff4f80b8420 2023-08-09T12:39:07.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.376+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f815e020 con 0x7ff4f80b8420 2023-08-09T12:39:07.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.377+0000 7ff4eeffd640 1 -- 172.21.15.142:0/2488517435 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff4e802e070 con 0x7ff4f80b8420 2023-08-09T12:39:07.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.377+0000 7ff4eeffd640 1 -- 172.21.15.142:0/2488517435 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff4e803e070 con 0x7ff4f80b8420 2023-08-09T12:39:07.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.377+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f804e390 con 0x7ff4f80b8420 2023-08-09T12:39:07.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.380+0000 7ff4eeffd640 1 -- 172.21.15.142:0/2488517435 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff4e8034070 con 0x7ff4f80b8420 2023-08-09T12:39:07.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.459+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7ff4f80ccde0 con 0x7ff4f80b8420 2023-08-09T12:39:07.464 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:07.460+0000 7f06efe42040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-09T12:39:07.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.465+0000 7ff4eeffd640 1 -- 172.21.15.142:0/2488517435 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4e8043c30 con 0x7ff4f80b8420 2023-08-09T12:39:07.468 INFO:teuthology.orchestra.run.smithi142.stdout:5 2023-08-09T12:39:07.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.466+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f80b8420 msgr2=0x7ff4f814c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.466+0000 7ff4f759e640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f80b8420 0x7ff4f814c060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff4e802b9d0 tx=0x7ff4e8004730 comp rx=0 tx=0).stop 2023-08-09T12:39:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.466+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 shutdown_connections 2023-08-09T12:39:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.466+0000 7ff4f759e640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f815cf20 0x7ff4f8159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.466+0000 7ff4f759e640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4f815cb40 0x7ff4f81f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.466+0000 7ff4f759e640 1 --2- 172.21.15.142:0/2488517435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4f80b8420 0x7ff4f814c060 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.466+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 >> 172.21.15.142:0/2488517435 conn(0x7ff4f80d2ab0 msgr2=0x7ff4f81581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:07.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.466+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 shutdown_connections 2023-08-09T12:39:07.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.467+0000 7ff4f759e640 1 -- 172.21.15.142:0/2488517435 wait complete. 2023-08-09T12:39:07.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-08-09T12:39:07.575 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:07.572+0000 7fa61160f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-09T12:39:07.640 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:07.637+0000 7fa61160f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-09T12:39:07.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.678+0000 7f3e7c68e640 1 Processor -- start 2023-08-09T12:39:07.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.678+0000 7f3e7c68e640 1 -- start start 2023-08-09T12:39:07.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e7c68e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740b38a0 0x7f3e740cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e7c68e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e740717e0 0x7f3e740cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e7c68e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e740cdd60 con 0x7f3e7415add0 2023-08-09T12:39:07.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e7c68e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740cc660 con 0x7f3e740717e0 2023-08-09T12:39:07.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e7c68e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740cc940 con 0x7f3e740b38a0 2023-08-09T12:39:07.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e79c29640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740b38a0 0x7f3e740cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e79c29640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740b38a0 0x7f3e740cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57438/0 (socket says 172.21.15.142:57438) 2023-08-09T12:39:07.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e79c29640 1 -- 172.21.15.142:0/3158099407 learned_addr learned my addr 172.21.15.142:0/3158099407 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:07.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.680+0000 7f3e7ac2b640 1 --2- 172.21.15.142:0/3158099407 >> v2:172.21.15.17:3300/0 conn(0x7f3e740717e0 0x7f3e740cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.681+0000 7f3e79c29640 1 -- 172.21.15.142:0/3158099407 >> v2:172.21.15.17:3300/0 conn(0x7f3e740717e0 msgr2=0x7f3e740cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:07.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.681+0000 7f3e79c29640 1 --2- 172.21.15.142:0/3158099407 >> v2:172.21.15.17:3300/0 conn(0x7f3e740717e0 0x7f3e740cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.681+0000 7f3e79c29640 1 -- 172.21.15.142:0/3158099407 >> v1:172.21.15.17:6789/0 conn(0x7f3e7415add0 legacy=0x7f3e740b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:07.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.681+0000 7f3e79c29640 1 -- 172.21.15.142:0/3158099407 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e740ccc20 con 0x7f3e740b38a0 2023-08-09T12:39:07.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.682+0000 7f3e79c29640 1 --2- 172.21.15.142:0/3158099407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740b38a0 0x7f3e740cd2e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009870 tx=0x7f3e6402b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947948e5fb5f2853 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:07.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e79428640 1 -- 172.21.15.142:0/3158099407 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64031740 con 0x7f3e740b38a0 2023-08-09T12:39:07.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e79428640 1 -- 172.21.15.142:0/3158099407 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e640318a0 con 0x7f3e740b38a0 2023-08-09T12:39:07.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e79428640 1 -- 172.21.15.142:0/3158099407 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64031c30 con 0x7f3e740b38a0 2023-08-09T12:39:07.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3158099407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740b38a0 msgr2=0x7f3e740cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e7c68e640 1 --2- 172.21.15.142:0/3158099407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740b38a0 0x7f3e740cd2e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009870 tx=0x7f3e6402b7e0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3158099407 shutdown_connections 2023-08-09T12:39:07.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e7c68e640 1 --2- 172.21.15.142:0/3158099407 >> v2:172.21.15.17:3300/0 conn(0x7f3e740717e0 0x7f3e740cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e7c68e640 1 --2- 172.21.15.142:0/3158099407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740b38a0 0x7f3e740cd2e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3158099407 >> 172.21.15.142:0/3158099407 conn(0x7f3e7406b9d0 msgr2=0x7f3e7406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:07.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3158099407 shutdown_connections 2023-08-09T12:39:07.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.683+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3158099407 wait complete. 2023-08-09T12:39:07.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.685+0000 7f3e7c68e640 1 Processor -- start 2023-08-09T12:39:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.685+0000 7f3e7c68e640 1 -- start start 2023-08-09T12:39:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7c68e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740717e0 0x7f3e740ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7c68e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b38a0 0x7f3e740ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7c68e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e7415add0 0x7f3e741f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7c68e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740acbd0 con 0x7f3e740b38a0 2023-08-09T12:39:07.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7c68e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74069b90 con 0x7f3e7415add0 2023-08-09T12:39:07.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7c68e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74069e70 con 0x7f3e740717e0 2023-08-09T12:39:07.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7a42a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740717e0 0x7f3e740ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7a42a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740717e0 0x7f3e740ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57450/0 (socket says 172.21.15.142:57450) 2023-08-09T12:39:07.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7a42a640 1 -- 172.21.15.142:0/3470545201 learned_addr learned my addr 172.21.15.142:0/3470545201 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:07.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.686+0000 7f3e7ac2b640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e7415add0 0x7f3e741f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e79c29640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b38a0 0x7f3e740ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e7a42a640 1 -- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e7415add0 msgr2=0x7f3e741f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e7a42a640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e7415add0 0x7f3e741f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e7a42a640 1 -- 172.21.15.142:0/3470545201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b38a0 msgr2=0x7f3e740ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e7a42a640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b38a0 0x7f3e740ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e7a42a640 1 -- 172.21.15.142:0/3470545201 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640094d0 con 0x7f3e740717e0 2023-08-09T12:39:07.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e7ac2b640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e7415add0 0x7f3e741f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:07.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e7a42a640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740717e0 0x7f3e740ad230 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000b3e0 tx=0x7f3e7000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:07.698 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:07.688+0000 7f06efe42040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-09T12:39:07.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e6affd640 1 -- 172.21.15.142:0/3470545201 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70011830 con 0x7f3e740717e0 2023-08-09T12:39:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e6affd640 1 -- 172.21.15.142:0/3470545201 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e700119b0 con 0x7f3e740717e0 2023-08-09T12:39:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7406a150 con 0x7f3e740717e0 2023-08-09T12:39:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.687+0000 7f3e6affd640 1 -- 172.21.15.142:0/3470545201 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70011d60 con 0x7f3e740717e0 2023-08-09T12:39:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.688+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7406a710 con 0x7f3e740717e0 2023-08-09T12:39:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.688+0000 7f3e6affd640 1 -- 172.21.15.142:0/3470545201 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e7001a700 con 0x7f3e740717e0 2023-08-09T12:39:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.688+0000 7f3e6affd640 1 -- 172.21.15.142:0/3470545201 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3e700196d0 con 0x7f3e740717e0 2023-08-09T12:39:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.689+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7406a900 con 0x7f3e740717e0 2023-08-09T12:39:07.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.691+0000 7f3e6affd640 1 -- 172.21.15.142:0/3470545201 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3e70039b00 con 0x7f3e740717e0 2023-08-09T12:39:07.701 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:07.695+0000 7fa61160f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-09T12:39:07.756 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:07.753+0000 7f06efe42040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-09T12:39:07.763 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:07.760+0000 7fa61160f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-09T12:39:07.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.771+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f3e74067a80 con 0x7f3e740717e0 2023-08-09T12:39:07.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.781+0000 7f3e6affd640 1 -- 172.21.15.142:0/3470545201 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3e70028030 con 0x7f3e740717e0 2023-08-09T12:39:07.784 INFO:teuthology.orchestra.run.smithi142.stdout:6 2023-08-09T12:39:07.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740717e0 msgr2=0x7f3e740ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:07.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740717e0 0x7f3e740ad230 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000b3e0 tx=0x7f3e7000b8a0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 shutdown_connections 2023-08-09T12:39:07.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e7415add0 0x7f3e741f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b38a0 0x7f3e740ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 --2- 172.21.15.142:0/3470545201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e740717e0 0x7f3e740ad230 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:07.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 >> 172.21.15.142:0/3470545201 conn(0x7f3e7406b9d0 msgr2=0x7f3e740c4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:07.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 shutdown_connections 2023-08-09T12:39:07.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.782+0000 7f3e7c68e640 1 -- 172.21.15.142:0/3470545201 wait complete. 2023-08-09T12:39:07.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-08-09T12:39:07.812 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:07.809+0000 7f06efe42040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-09T12:39:07.876 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:07.873+0000 7f06efe42040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-09T12:39:07.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.992+0000 7f06548cc640 1 Processor -- start 2023-08-09T12:39:07.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.992+0000 7f06548cc640 1 -- start start 2023-08-09T12:39:07.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.994+0000 7f06548cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f06501616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.994+0000 7f06548cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f06500d29d0 0x7f06500d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:07.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.994+0000 7f06548cc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06500b6460 con 0x7f06500b6000 2023-08-09T12:39:07.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.994+0000 7f06548cc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06500d33a0 con 0x7f06500d29d0 2023-08-09T12:39:07.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.994+0000 7f06548cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500cdd10 con 0x7f065015ce90 2023-08-09T12:39:07.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f06501616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:07.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f06501616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57464/0 (socket says 172.21.15.142:57464) 2023-08-09T12:39:07.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064e59c640 1 -- 172.21.15.142:0/1485125940 learned_addr learned my addr 172.21.15.142:0/1485125940 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:07.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064ed9d640 1 --2- 172.21.15.142:0/1485125940 >> v2:172.21.15.142:3300/0 conn(0x7f06500d29d0 0x7f06500d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:08.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064ed9d640 1 -- 172.21.15.142:0/1485125940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 msgr2=0x7f06501616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:08.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064ed9d640 1 --2- 172.21.15.142:0/1485125940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f06501616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064ed9d640 1 -- 172.21.15.142:0/1485125940 >> v1:172.21.15.17:6789/0 conn(0x7f06500b6000 legacy=0x7f06500cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:08.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064ed9d640 1 -- 172.21.15.142:0/1485125940 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500cdff0 con 0x7f06500d29d0 2023-08-09T12:39:08.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.995+0000 7f064e59c640 1 --2- 172.21.15.142:0/1485125940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f06501616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:08.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.996+0000 7f064ed9d640 1 --2- 172.21.15.142:0/1485125940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500d29d0 0x7f06500d2e60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0648009d90 tx=0x7f064802be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca030da9f4e3d43 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:08.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.996+0000 7f064d59a640 1 -- 172.21.15.142:0/1485125940 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064802cbd0 con 0x7f06500d29d0 2023-08-09T12:39:08.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f064d59a640 1 -- 172.21.15.142:0/1485125940 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064802cd30 con 0x7f06500d29d0 2023-08-09T12:39:08.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f064d59a640 1 -- 172.21.15.142:0/1485125940 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064802cea0 con 0x7f06500d29d0 2023-08-09T12:39:08.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f06548cc640 1 -- 172.21.15.142:0/1485125940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500d29d0 msgr2=0x7f06500d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f06548cc640 1 --2- 172.21.15.142:0/1485125940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500d29d0 0x7f06500d2e60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0648009d90 tx=0x7f064802be20 comp rx=0 tx=0).stop 2023-08-09T12:39:08.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f06548cc640 1 -- 172.21.15.142:0/1485125940 shutdown_connections 2023-08-09T12:39:08.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f06548cc640 1 --2- 172.21.15.142:0/1485125940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500d29d0 0x7f06500d2e60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f06548cc640 1 --2- 172.21.15.142:0/1485125940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f06501616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f06548cc640 1 -- 172.21.15.142:0/1485125940 >> 172.21.15.142:0/1485125940 conn(0x7f065006fde0 msgr2=0x7f06500701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:08.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.997+0000 7f06548cc640 1 -- 172.21.15.142:0/1485125940 shutdown_connections 2023-08-09T12:39:08.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:07.998+0000 7f06548cc640 1 -- 172.21.15.142:0/1485125940 wait complete. 2023-08-09T12:39:08.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.000+0000 7f06548cc640 1 Processor -- start 2023-08-09T12:39:08.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.000+0000 7f06548cc640 1 -- start start 2023-08-09T12:39:08.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f06548cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500b6000 0x7f0650154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:08.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f06548cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06500d29d0 0x7f065015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:08.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f06548cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f065015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:08.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f06548cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06501e79c0 con 0x7f06500d29d0 2023-08-09T12:39:08.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f06548cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500ca910 con 0x7f06500b6000 2023-08-09T12:39:08.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f06548cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06501e7c10 con 0x7f065015ce90 2023-08-09T12:39:08.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f064e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500b6000 0x7f0650154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:08.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f064e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500b6000 0x7f0650154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32930/0 (socket says 172.21.15.142:32930) 2023-08-09T12:39:08.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f064ed9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f065015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:08.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.002+0000 7f064e59c640 1 -- 172.21.15.142:0/1751116314 learned_addr learned my addr 172.21.15.142:0/1751116314 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-08-09T12:39:08.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f064dd9b640 1 --2- 172.21.15.142:0/1751116314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06500d29d0 0x7f065015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:08.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f064e59c640 1 -- 172.21.15.142:0/1751116314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 msgr2=0x7f065015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f064e59c640 1 --2- 172.21.15.142:0/1751116314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f065015ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f064e59c640 1 -- 172.21.15.142:0/1751116314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06500d29d0 msgr2=0x7f065015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f064e59c640 1 --2- 172.21.15.142:0/1751116314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06500d29d0 0x7f065015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f064e59c640 1 -- 172.21.15.142:0/1751116314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400094d0 con 0x7f06500b6000 2023-08-09T12:39:08.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f064e59c640 1 --2- 172.21.15.142:0/1751116314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500b6000 0x7f0650154930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f064000e9b0 tx=0x7f064000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:08.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f063effd640 1 -- 172.21.15.142:0/1751116314 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000c9a0 con 0x7f06500b6000 2023-08-09T12:39:08.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f063effd640 1 -- 172.21.15.142:0/1751116314 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064000cb00 con 0x7f06500b6000 2023-08-09T12:39:08.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f063effd640 1 -- 172.21.15.142:0/1751116314 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000ce70 con 0x7f06500b6000 2023-08-09T12:39:08.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.003+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0648009a70 con 0x7f06500b6000 2023-08-09T12:39:08.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.004+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06501e81d0 con 0x7f06500b6000 2023-08-09T12:39:08.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.004+0000 7f063effd640 1 -- 172.21.15.142:0/1751116314 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0640005c90 con 0x7f06500b6000 2023-08-09T12:39:08.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.004+0000 7f063effd640 1 -- 172.21.15.142:0/1751116314 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f0640013470 con 0x7f06500b6000 2023-08-09T12:39:08.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.005+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0650067a80 con 0x7f06500b6000 2023-08-09T12:39:08.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.007+0000 7f063effd640 1 -- 172.21.15.142:0/1751116314 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f064003bb00 con 0x7f06500b6000 2023-08-09T12:39:08.083 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:08.080+0000 7fa61160f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-09T12:39:08.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.084+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f06500ccc80 con 0x7f06500b6000 2023-08-09T12:39:08.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.098+0000 7f063effd640 1 -- 172.21.15.142:0/1751116314 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f064002a070 con 0x7f06500b6000 2023-08-09T12:39:08.102 INFO:teuthology.orchestra.run.smithi142.stdout:7 2023-08-09T12:39:08.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.099+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500b6000 msgr2=0x7f0650154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.099+0000 7f06548cc640 1 --2- 172.21.15.142:0/1751116314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500b6000 0x7f0650154930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f064000e9b0 tx=0x7f064000ee70 comp rx=0 tx=0).stop 2023-08-09T12:39:08.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.099+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 shutdown_connections 2023-08-09T12:39:08.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.099+0000 7f06548cc640 1 --2- 172.21.15.142:0/1751116314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f065015ce90 0x7f065015ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.099+0000 7f06548cc640 1 --2- 172.21.15.142:0/1751116314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06500d29d0 0x7f065015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.099+0000 7f06548cc640 1 --2- 172.21.15.142:0/1751116314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06500b6000 0x7f0650154930 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.099+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 >> 172.21.15.142:0/1751116314 conn(0x7f065006fde0 msgr2=0x7f06500b82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:08.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.099+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 shutdown_connections 2023-08-09T12:39:08.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-08-09T12:39:08.100+0000 7f06548cc640 1 -- 172.21.15.142:0/1751116314 wait complete. 2023-08-09T12:39:08.119 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-09T12:39:08.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-09T12:39:08.128 INFO:tasks.ceph.osd.0:Started 2023-08-09T12:39:08.129 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-09T12:39:08.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-09T12:39:08.137 INFO:tasks.ceph.osd.1:Started 2023-08-09T12:39:08.138 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-09T12:39:08.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-09T12:39:08.145 INFO:tasks.ceph.osd.2:Started 2023-08-09T12:39:08.146 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-09T12:39:08.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-09T12:39:08.148 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:08.145+0000 7fa61160f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-09T12:39:08.154 INFO:tasks.ceph.osd.3:Started 2023-08-09T12:39:08.154 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-09T12:39:08.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-09T12:39:08.163 INFO:tasks.ceph.osd.4:Started 2023-08-09T12:39:08.163 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-09T12:39:08.163 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-09T12:39:08.171 INFO:tasks.ceph.osd.5:Started 2023-08-09T12:39:08.172 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-09T12:39:08.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-09T12:39:08.178 INFO:tasks.ceph.osd.6:Started 2023-08-09T12:39:08.179 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-09T12:39:08.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-09T12:39:08.184 INFO:tasks.ceph.osd.7:Started 2023-08-09T12:39:08.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:08.208 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:08.204+0000 7f06efe42040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-09T12:39:08.233 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:08.229+0000 7fa61160f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-09T12:39:08.286 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:08.283+0000 7f06efe42040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-09T12:39:08.331 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-08-09T12:39:08.328+0000 7f54c2215500 -1 Falling back to public interface 2023-08-09T12:39:08.332 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-08-09T12:39:08.328+0000 7ff7bc01a500 -1 Falling back to public interface 2023-08-09T12:39:08.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-08-09T12:39:08.341+0000 7f49e79be500 -1 Falling back to public interface 2023-08-09T12:39:08.346 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-08-09T12:39:08.343+0000 7f47dec9a500 -1 Falling back to public interface 2023-08-09T12:39:08.350 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-08-09T12:39:08.347+0000 7ff7bc01a500 -1 osd.5 0 log_to_monitors true 2023-08-09T12:39:08.351 INFO:tasks.ceph.osd.1.smithi017.stderr:2023-08-09T12:39:08.348+0000 7fcccf00f500 -1 Falling back to public interface 2023-08-09T12:39:08.361 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:08.358+0000 7f06efe42040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-09T12:39:08.362 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-08-09T12:39:08.359+0000 7f54c2215500 -1 osd.2 0 log_to_monitors true 2023-08-09T12:39:08.369 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-08-09T12:39:08.366+0000 7f47dec9a500 -1 osd.4 0 log_to_monitors true 2023-08-09T12:39:08.370 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-08-09T12:39:08.367+0000 7f4e1b419500 -1 Falling back to public interface 2023-08-09T12:39:08.377 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-08-09T12:39:08.374+0000 7f064b217500 -1 Falling back to public interface 2023-08-09T12:39:08.380 INFO:tasks.ceph.osd.3.smithi017.stderr:2023-08-09T12:39:08.377+0000 7f57f9a1e500 -1 Falling back to public interface 2023-08-09T12:39:08.383 INFO:tasks.ceph.osd.1.smithi017.stderr:2023-08-09T12:39:08.380+0000 7fcccf00f500 -1 osd.1 0 log_to_monitors true 2023-08-09T12:39:08.389 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-08-09T12:39:08.385+0000 7f49e79be500 -1 osd.0 0 log_to_monitors true 2023-08-09T12:39:08.398 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-08-09T12:39:08.395+0000 7f4e1b419500 -1 osd.7 0 log_to_monitors true 2023-08-09T12:39:08.407 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-08-09T12:39:08.404+0000 7f064b217500 -1 osd.6 0 log_to_monitors true 2023-08-09T12:39:08.409 INFO:tasks.ceph.osd.3.smithi017.stderr:2023-08-09T12:39:08.406+0000 7f57f9a1e500 -1 osd.3 0 log_to_monitors true 2023-08-09T12:39:08.442 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:08.439+0000 7fa61160f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-09T12:39:08.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.440+0000 7f1fa24ec640 1 Processor -- start 2023-08-09T12:39:08.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.440+0000 7f1fa24ec640 1 -- start start 2023-08-09T12:39:08.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.441+0000 7f1fa24ec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f9c1616e0 0x7f1f9c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:08.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.441+0000 7f1fa24ec640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9c0cdd10 con 0x7f1f9c15ce90 2023-08-09T12:39:08.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.441+0000 7f1fa24ec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9c0cdff0 con 0x7f1f9c0d29d0 2023-08-09T12:39:08.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.441+0000 7f1fa24ec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9c0b6540 con 0x7f1f9c1616e0 2023-08-09T12:39:08.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.441+0000 7f1f9bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1f9c15ce90 0x7f1f9c0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39478/0 (socket says 172.21.15.17:39478) 2023-08-09T12:39:08.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.441+0000 7f1f9bfff640 1 -- 172.21.15.17:0/87021688 learned_addr learned my addr 172.21.15.17:0/87021688 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:08.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.441+0000 7f1f9b7fe640 1 --2- 172.21.15.17:0/87021688 >> v2:172.21.15.17:3300/0 conn(0x7f1f9c1616e0 0x7f1f9c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:08.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.442+0000 7f1f9affd640 1 -- 172.21.15.17:0/87021688 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143129718 0 0) 0x7f1f9c0cdd10 con 0x7f1f9c15ce90 2023-08-09T12:39:08.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.442+0000 7f1f9b7fe640 1 -- 172.21.15.17:0/87021688 >> v1:172.21.15.142:6789/0 conn(0x7f1f9c0d29d0 legacy=0x7f1f9c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.442+0000 7f1f9b7fe640 1 -- 172.21.15.17:0/87021688 >> v1:172.21.15.17:6789/0 conn(0x7f1f9c15ce90 legacy=0x7f1f9c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.442+0000 7f1f9b7fe640 1 -- 172.21.15.17:0/87021688 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c0ce2d0 con 0x7f1f9c1616e0 2023-08-09T12:39:08.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.443+0000 7f1f9b7fe640 1 --2- 172.21.15.17:0/87021688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c1616e0 0x7f1f9c0b6000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009720 tx=0x7f1f9002b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d54c81b7d21cbe server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:08.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.443+0000 7f1f9affd640 1 -- 172.21.15.17:0/87021688 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90030710 con 0x7f1f9c1616e0 2023-08-09T12:39:08.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.443+0000 7f1f9affd640 1 -- 172.21.15.17:0/87021688 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9002e050 con 0x7f1f9c1616e0 2023-08-09T12:39:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.443+0000 7f1f9affd640 1 -- 172.21.15.17:0/87021688 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90030a90 con 0x7f1f9c1616e0 2023-08-09T12:39:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.444+0000 7f1fa24ec640 1 -- 172.21.15.17:0/87021688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c1616e0 msgr2=0x7f1f9c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.444+0000 7f1fa24ec640 1 --2- 172.21.15.17:0/87021688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c1616e0 0x7f1f9c0b6000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009720 tx=0x7f1f9002b730 comp rx=0 tx=0).stop 2023-08-09T12:39:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.444+0000 7f1fa24ec640 1 -- 172.21.15.17:0/87021688 shutdown_connections 2023-08-09T12:39:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.444+0000 7f1fa24ec640 1 --2- 172.21.15.17:0/87021688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c1616e0 0x7f1f9c0b6000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.444+0000 7f1fa24ec640 1 -- 172.21.15.17:0/87021688 >> 172.21.15.17:0/87021688 conn(0x7f1f9c06fde0 msgr2=0x7f1f9c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.444+0000 7f1fa24ec640 1 -- 172.21.15.17:0/87021688 shutdown_connections 2023-08-09T12:39:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.444+0000 7f1fa24ec640 1 -- 172.21.15.17:0/87021688 wait complete. 2023-08-09T12:39:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.446+0000 7f1fa24ec640 1 Processor -- start 2023-08-09T12:39:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.446+0000 7f1fa24ec640 1 -- start start 2023-08-09T12:39:08.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1fa24ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f9c0d29d0 0x7f1f9c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:08.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1fa24ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c15ce90 0x7f1f9c15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:08.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1fa24ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f9c1616e0 0x7f1f9c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:08.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1fa24ec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c0ccd60 con 0x7f1f9c15ce90 2023-08-09T12:39:08.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1fa24ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c160430 con 0x7f1f9c0d29d0 2023-08-09T12:39:08.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1fa24ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c0b2fc0 con 0x7f1f9c1616e0 2023-08-09T12:39:08.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1f9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c15ce90 0x7f1f9c15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:08.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1f9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c15ce90 0x7f1f9c15fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52686/0 (socket says 172.21.15.17:52686) 2023-08-09T12:39:08.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1f9b7fe640 1 -- 172.21.15.17:0/3862781401 learned_addr learned my addr 172.21.15.17:0/3862781401 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:08.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1f9bfff640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f9c0d29d0 0x7f1f9c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:08.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.447+0000 7f1fa0a89640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f9c1616e0 0x7f1f9c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f9b7fe640 1 -- 172.21.15.17:0/3862781401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f9c1616e0 msgr2=0x7f1f9c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f9b7fe640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f9c1616e0 0x7f1f9c0cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f9b7fe640 1 -- 172.21.15.17:0/3862781401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f9c0d29d0 msgr2=0x7f1f9c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f9b7fe640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f9c0d29d0 0x7f1f9c0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f9b7fe640 1 -- 172.21.15.17:0/3862781401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f90009400 con 0x7f1f9c15ce90 2023-08-09T12:39:08.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f9b7fe640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c15ce90 0x7f1f9c15fef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009840 tx=0x7f1f900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f98ff9640 1 -- 172.21.15.17:0/3862781401 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900329d0 con 0x7f1f9c15ce90 2023-08-09T12:39:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f98ff9640 1 -- 172.21.15.17:0/3862781401 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90032b50 con 0x7f1f9c15ce90 2023-08-09T12:39:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1f98ff9640 1 -- 172.21.15.17:0/3862781401 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9003c470 con 0x7f1f9c15ce90 2023-08-09T12:39:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.448+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9c0b32a0 con 0x7f1f9c15ce90 2023-08-09T12:39:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.449+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9c0b3860 con 0x7f1f9c15ce90 2023-08-09T12:39:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.449+0000 7f1f98ff9640 1 -- 172.21.15.17:0/3862781401 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1f90039040 con 0x7f1f9c15ce90 2023-08-09T12:39:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.449+0000 7f1f98ff9640 1 -- 172.21.15.17:0/3862781401 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1f90048630 con 0x7f1f9c15ce90 2023-08-09T12:39:08.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.450+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9c067a80 con 0x7f1f9c15ce90 2023-08-09T12:39:08.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.452+0000 7f1f98ff9640 1 -- 172.21.15.17:0/3862781401 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1f9004d060 con 0x7f1f9c15ce90 2023-08-09T12:39:08.493 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:08.490+0000 7fa61160f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-09T12:39:08.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.517+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f9c0d0ad0 con 0x7f1f9c15ce90 2023-08-09T12:39:08.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.518+0000 7f1f98ff9640 1 -- 172.21.15.17:0/3862781401 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1f90057090 con 0x7f1f9c15ce90 2023-08-09T12:39:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:08.522 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:08.087505+0000","last_up_change":"0.000000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:08.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.519+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c15ce90 msgr2=0x7f1f9c15fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:08.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.519+0000 7f1fa24ec640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c15ce90 0x7f1f9c15fef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009840 tx=0x7f1f900046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.520+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 shutdown_connections 2023-08-09T12:39:08.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.520+0000 7f1fa24ec640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f9c1616e0 0x7f1f9c0cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.520+0000 7f1fa24ec640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f9c15ce90 0x7f1f9c15fef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.520+0000 7f1fa24ec640 1 --2- 172.21.15.17:0/3862781401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f9c0d29d0 0x7f1f9c0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:08.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.520+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 >> 172.21.15.17:0/3862781401 conn(0x7f1f9c06fde0 msgr2=0x7f1f9c0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:08.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.520+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 shutdown_connections 2023-08-09T12:39:08.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:08.520+0000 7f1fa24ec640 1 -- 172.21.15.17:0/3862781401 wait complete. 2023-08-09T12:39:08.539 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-09T12:39:08.539 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-09T12:39:08.546 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:08.543+0000 7f06efe42040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-09T12:39:08.553 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:08.550+0000 7fa61160f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-09T12:39:08.599 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:08.595+0000 7f06efe42040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-09T12:39:08.606 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:08.602+0000 7fa61160f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-09T12:39:08.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:39:08.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:39:08.669 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:08.665+0000 7f06efe42040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-09T12:39:08.729 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-08-09T12:39:08.726+0000 7f06efe42040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-09T12:39:09.345 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:09.545 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.542+0000 7f3deef37640 1 Processor -- start 2023-08-09T12:39:09.545 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.542+0000 7f3deef37640 1 -- start start 2023-08-09T12:39:09.547 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.543+0000 7f3deef37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80d21f0 0x7f3de80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:09.547 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.543+0000 7f3deef37640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3de80b8410 0x7f3de80b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:09.547 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.543+0000 7f3deef37640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de80d2650 con 0x7f3de80cf370 2023-08-09T12:39:09.548 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3deef37640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80b88a0 con 0x7f3de80b8410 2023-08-09T12:39:09.548 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3deef37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80d1150 con 0x7f3de80d21f0 2023-08-09T12:39:09.548 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3dee736640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3de80b8410 0x7f3de80b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:09.548 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3dee736640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3de80b8410 0x7f3de80b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52694/0 (socket says 172.21.15.17:52694) 2023-08-09T12:39:09.548 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3dee736640 1 -- 172.21.15.17:0/4105607576 learned_addr learned my addr 172.21.15.17:0/4105607576 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:09.548 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3dedf35640 1 --1- 172.21.15.17:0/4105607576 >> v1:172.21.15.17:6789/0 conn(0x7f3de80cf370 0x7f3de80cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39494/0 (socket says 172.21.15.17:39494) 2023-08-09T12:39:09.549 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3ded734640 1 --2- 172.21.15.17:0/4105607576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80d21f0 0x7f3de80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:09.550 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3dee736640 1 -- 172.21.15.17:0/4105607576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80d21f0 msgr2=0x7f3de80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:09.550 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3dee736640 1 --2- 172.21.15.17:0/4105607576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80d21f0 0x7f3de80d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:09.550 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3dee736640 1 -- 172.21.15.17:0/4105607576 >> v1:172.21.15.17:6789/0 conn(0x7f3de80cf370 legacy=0x7f3de80cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:09.550 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3dee736640 1 -- 172.21.15.17:0/4105607576 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80d1430 con 0x7f3de80b8410 2023-08-09T12:39:09.550 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.544+0000 7f3decf33640 1 -- 172.21.15.17:0/4105607576 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635106414 0 0) 0x7f3de80d2650 con 0x7f3de80cf370 2023-08-09T12:39:09.550 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.545+0000 7f3dee736640 1 --2- 172.21.15.17:0/4105607576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80b5a90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009850 tx=0x7f3de002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294fec635711ab4a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:09.551 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.546+0000 7f3decf33640 1 -- 172.21.15.17:0/4105607576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0030610 con 0x7f3de80b8410 2023-08-09T12:39:09.551 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.546+0000 7f3decf33640 1 -- 172.21.15.17:0/4105607576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0030770 con 0x7f3de80b8410 2023-08-09T12:39:09.551 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.546+0000 7f3decf33640 1 -- 172.21.15.17:0/4105607576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0030b00 con 0x7f3de80b8410 2023-08-09T12:39:09.551 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.546+0000 7f3deef37640 1 -- 172.21.15.17:0/4105607576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 msgr2=0x7f3de80b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:09.551 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.546+0000 7f3deef37640 1 --2- 172.21.15.17:0/4105607576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80b5a90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009850 tx=0x7f3de002b960 comp rx=0 tx=0).stop 2023-08-09T12:39:09.551 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.546+0000 7f3deef37640 1 -- 172.21.15.17:0/4105607576 shutdown_connections 2023-08-09T12:39:09.551 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.546+0000 7f3deef37640 1 --2- 172.21.15.17:0/4105607576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80b5a90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:09.552 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.546+0000 7f3deef37640 1 --2- 172.21.15.17:0/4105607576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80d21f0 0x7f3de80d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:09.552 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.547+0000 7f3deef37640 1 -- 172.21.15.17:0/4105607576 >> 172.21.15.17:0/4105607576 conn(0x7f3de80697c0 msgr2=0x7f3de8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:09.552 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.547+0000 7f3deef37640 1 -- 172.21.15.17:0/4105607576 shutdown_connections 2023-08-09T12:39:09.552 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.547+0000 7f3deef37640 1 -- 172.21.15.17:0/4105607576 wait complete. 2023-08-09T12:39:09.553 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.548+0000 7f3deef37640 1 Processor -- start 2023-08-09T12:39:09.553 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.548+0000 7f3deef37640 1 -- start start 2023-08-09T12:39:09.554 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.549+0000 7f3deef37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:09.554 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.549+0000 7f3deef37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf370 0x7f3de814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:09.554 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.549+0000 7f3deef37640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80d21f0 0x7f3de80b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:09.554 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.549+0000 7f3deef37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80b2c10 con 0x7f3de80b8410 2023-08-09T12:39:09.554 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.549+0000 7f3deef37640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80b2ef0 con 0x7f3de80d21f0 2023-08-09T12:39:09.554 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.549+0000 7f3deef37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80b31d0 con 0x7f3de80cf370 2023-08-09T12:39:09.554 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:09.555 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52696/0 (socket says 172.21.15.17:52696) 2023-08-09T12:39:09.555 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 -- 172.21.15.17:0/2057699137 learned_addr learned my addr 172.21.15.17:0/2057699137 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:09.555 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3ded734640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf370 0x7f3de814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:09.555 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dee736640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80d21f0 0x7f3de80b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:09.555 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 -- 172.21.15.17:0/2057699137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf370 msgr2=0x7f3de814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:09.555 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf370 0x7f3de814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:09.555 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 -- 172.21.15.17:0/2057699137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80d21f0 msgr2=0x7f3de80b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:09.556 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80d21f0 0x7f3de80b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:09.556 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 -- 172.21.15.17:0/2057699137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00094b0 con 0x7f3de80b8410 2023-08-09T12:39:09.556 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.550+0000 7f3dedf35640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80cad00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3de400c890 tx=0x7f3de400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:09.557 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.551+0000 7f3dde7fc640 1 -- 172.21.15.17:0/2057699137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400a640 con 0x7f3de80b8410 2023-08-09T12:39:09.557 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.551+0000 7f3dde7fc640 1 -- 172.21.15.17:0/2057699137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400a7c0 con 0x7f3de80b8410 2023-08-09T12:39:09.557 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.551+0000 7f3dde7fc640 1 -- 172.21.15.17:0/2057699137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400ab70 con 0x7f3de80b8410 2023-08-09T12:39:09.557 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.551+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de80b34b0 con 0x7f3de80b8410 2023-08-09T12:39:09.557 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.551+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de814b250 con 0x7f3de80b8410 2023-08-09T12:39:09.557 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.552+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de80b39d0 con 0x7f3de80b8410 2023-08-09T12:39:09.557 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.552+0000 7f3dde7fc640 1 -- 172.21.15.17:0/2057699137 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 2) v1 ==== 44122+0+0 (secure 0 0 0) 0x7f3de400acd0 con 0x7f3de80b8410 2023-08-09T12:39:09.558 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.552+0000 7f3dde7fc640 1 -- 172.21.15.17:0/2057699137 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7f3de4048280 con 0x7f3de80b8410 2023-08-09T12:39:09.558 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.555+0000 7f3dde7fc640 1 -- 172.21.15.17:0/2057699137 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3de80b39d0 con 0x7f3de80b8410 2023-08-09T12:39:09.622 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.619+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3de80b39d0 con 0x7f3de80b8410 2023-08-09T12:39:09.623 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.620+0000 7f3dde7fc640 1 -- 172.21.15.17:0/2057699137 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3de80b39d0 con 0x7f3de80b8410 2023-08-09T12:39:09.624 INFO:teuthology.misc.health.smithi017.stdout: 2023-08-09T12:39:09.624 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":11,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:09.092486+0000","last_up_change":"0.000000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:09.626 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.621+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 msgr2=0x7f3de80cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:09.626 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.621+0000 7f3deef37640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80cad00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3de400c890 tx=0x7f3de400cd50 comp rx=0 tx=0).stop 2023-08-09T12:39:09.627 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.622+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 shutdown_connections 2023-08-09T12:39:09.627 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.622+0000 7f3deef37640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80d21f0 0x7f3de80b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:09.627 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.622+0000 7f3deef37640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf370 0x7f3de814ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:09.627 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.622+0000 7f3deef37640 1 --2- 172.21.15.17:0/2057699137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3de80b8410 0x7f3de80cad00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:09.627 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.622+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 >> 172.21.15.17:0/2057699137 conn(0x7f3de80697c0 msgr2=0x7f3de80b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:09.628 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.622+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 shutdown_connections 2023-08-09T12:39:09.628 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:09.622+0000 7f3deef37640 1 -- 172.21.15.17:0/2057699137 wait complete. 2023-08-09T12:39:09.638 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-09T12:39:09.674 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:09.671+0000 7fa5b2724640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-09T12:39:09.674 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-08-09T12:39:09.671+0000 7fa5b2724640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-09T12:39:10.147 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-08-09T12:39:10.144+0000 7f4e16de3640 -1 osd.7 0 waiting for initial osdmap 2023-08-09T12:39:10.149 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-08-09T12:39:10.146+0000 7f47dac26640 -1 osd.4 0 waiting for initial osdmap 2023-08-09T12:39:10.150 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-08-09T12:39:10.147+0000 7f4e10417640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T12:39:10.151 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-08-09T12:39:10.148+0000 7f47d425a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T12:39:10.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-08-09T12:39:10.151+0000 7f49e394c640 -1 osd.0 0 waiting for initial osdmap 2023-08-09T12:39:10.158 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-08-09T12:39:10.155+0000 7ff7b7a03640 -1 osd.5 0 waiting for initial osdmap 2023-08-09T12:39:10.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-08-09T12:39:10.155+0000 7f49dcf80640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T12:39:10.159 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-08-09T12:39:10.156+0000 7f0646ae1640 -1 osd.6 0 waiting for initial osdmap 2023-08-09T12:39:10.160 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-08-09T12:39:10.157+0000 7ff7b1037640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T12:39:10.160 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-08-09T12:39:10.158+0000 7f54bdc03640 -1 osd.2 0 waiting for initial osdmap 2023-08-09T12:39:10.161 INFO:tasks.ceph.osd.3.smithi017.stderr:2023-08-09T12:39:10.158+0000 7f57f540a640 -1 osd.3 0 waiting for initial osdmap 2023-08-09T12:39:10.162 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-08-09T12:39:10.158+0000 7f0640115640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T12:39:10.164 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-08-09T12:39:10.161+0000 7f54b7237640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T12:39:10.165 INFO:tasks.ceph.osd.1.smithi017.stderr:2023-08-09T12:39:10.161+0000 7fcccaa49640 -1 osd.1 0 waiting for initial osdmap 2023-08-09T12:39:10.165 INFO:tasks.ceph.osd.3.smithi017.stderr:2023-08-09T12:39:10.163+0000 7f57eea3e640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T12:39:10.168 INFO:tasks.ceph.osd.1.smithi017.stderr:2023-08-09T12:39:10.165+0000 7fccc407d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-09T12:39:16.445 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:16.645 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.643+0000 7fba11e99640 1 Processor -- start 2023-08-09T12:39:16.646 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.643+0000 7fba11e99640 1 -- start start 2023-08-09T12:39:16.647 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba11e99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c15cd80 0x7fba0c161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:16.647 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba11e99640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba0c06adb0 0x7fba0c06b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:16.647 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba11e99640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c161080 con 0x7fba0c0697c0 2023-08-09T12:39:16.647 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba11e99640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c06b770 con 0x7fba0c06adb0 2023-08-09T12:39:16.648 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba11e99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0cdb10 con 0x7fba0c15cd80 2023-08-09T12:39:16.649 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0affd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba0c06adb0 0x7fba0c06b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:16.649 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0affd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba0c06adb0 0x7fba0c06b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52708/0 (socket says 172.21.15.17:52708) 2023-08-09T12:39:16.649 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0affd640 1 -- 172.21.15.17:0/1392088664 learned_addr learned my addr 172.21.15.17:0/1392088664 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:16.649 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0b7fe640 1 --2- 172.21.15.17:0/1392088664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c15cd80 0x7fba0c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:16.649 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0affd640 1 -- 172.21.15.17:0/1392088664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c15cd80 msgr2=0x7fba0c161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:16.649 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0affd640 1 --2- 172.21.15.17:0/1392088664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c15cd80 0x7fba0c161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.649 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0affd640 1 -- 172.21.15.17:0/1392088664 >> v1:172.21.15.142:6789/0 conn(0x7fba0c0697c0 legacy=0x7fba0c069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:16.650 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0affd640 1 -- 172.21.15.17:0/1392088664 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0cddf0 con 0x7fba0c06adb0 2023-08-09T12:39:16.650 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.645+0000 7fba0b7fe640 1 --2- 172.21.15.17:0/1392088664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c15cd80 0x7fba0c161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:16.651 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.646+0000 7fba0affd640 1 --2- 172.21.15.17:0/1392088664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c06adb0 0x7fba0c06b230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fba00009870 tx=0x7fba0002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a451ef076d26cce server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:16.651 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.647+0000 7fba0a7fc640 1 -- 172.21.15.17:0/1392088664 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00030840 con 0x7fba0c06adb0 2023-08-09T12:39:16.651 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.647+0000 7fba0a7fc640 1 -- 172.21.15.17:0/1392088664 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba000309a0 con 0x7fba0c06adb0 2023-08-09T12:39:16.651 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.647+0000 7fba0a7fc640 1 -- 172.21.15.17:0/1392088664 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00030d30 con 0x7fba0c06adb0 2023-08-09T12:39:16.651 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.647+0000 7fba11e99640 1 -- 172.21.15.17:0/1392088664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c06adb0 msgr2=0x7fba0c06b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:16.651 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.647+0000 7fba11e99640 1 --2- 172.21.15.17:0/1392088664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c06adb0 0x7fba0c06b230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fba00009870 tx=0x7fba0002b980 comp rx=0 tx=0).stop 2023-08-09T12:39:16.651 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.648+0000 7fba11e99640 1 -- 172.21.15.17:0/1392088664 shutdown_connections 2023-08-09T12:39:16.652 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.648+0000 7fba11e99640 1 --2- 172.21.15.17:0/1392088664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c06adb0 0x7fba0c06b230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.652 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.648+0000 7fba11e99640 1 --2- 172.21.15.17:0/1392088664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c15cd80 0x7fba0c161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.652 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.648+0000 7fba11e99640 1 -- 172.21.15.17:0/1392088664 >> 172.21.15.17:0/1392088664 conn(0x7fba0c06b9d0 msgr2=0x7fba0c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:16.652 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.648+0000 7fba11e99640 1 -- 172.21.15.17:0/1392088664 shutdown_connections 2023-08-09T12:39:16.652 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.648+0000 7fba11e99640 1 -- 172.21.15.17:0/1392088664 wait complete. 2023-08-09T12:39:16.653 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.649+0000 7fba11e99640 1 Processor -- start 2023-08-09T12:39:16.653 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.650+0000 7fba11e99640 1 -- start start 2023-08-09T12:39:16.654 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba11e99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c0697c0 0x7fba0c0add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:16.654 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba11e99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c06adb0 0x7fba0c1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:16.654 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba11e99640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c15cd80 0x7fba0c148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:16.654 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba11e99640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c14a130 con 0x7fba0c0697c0 2023-08-09T12:39:16.654 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba11e99640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0acbb0 con 0x7fba0c15cd80 2023-08-09T12:39:16.654 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba11e99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c149520 con 0x7fba0c06adb0 2023-08-09T12:39:16.655 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c0697c0 0x7fba0c0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:16.655 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c0697c0 0x7fba0c0add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52710/0 (socket says 172.21.15.17:52710) 2023-08-09T12:39:16.655 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0b7fe640 1 -- 172.21.15.17:0/470207408 learned_addr learned my addr 172.21.15.17:0/470207408 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:16.657 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0bfff640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c15cd80 0x7fba0c148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:16.657 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0affd640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c06adb0 0x7fba0c1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:16.657 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0b7fe640 1 -- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c06adb0 msgr2=0x7fba0c1489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:16.658 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0b7fe640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c06adb0 0x7fba0c1489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.658 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0b7fe640 1 -- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c15cd80 msgr2=0x7fba0c148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:16.658 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0b7fe640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c15cd80 0x7fba0c148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.659 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.651+0000 7fba0b7fe640 1 -- 172.21.15.17:0/470207408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000094d0 con 0x7fba0c0697c0 2023-08-09T12:39:16.659 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.652+0000 7fba0b7fe640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c0697c0 0x7fba0c0add90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00c7f0 tx=0x7fb9fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:16.659 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.652+0000 7fb9f3fff640 1 -- 172.21.15.17:0/470207408 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc007820 con 0x7fba0c0697c0 2023-08-09T12:39:16.659 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.652+0000 7fb9f3fff640 1 -- 172.21.15.17:0/470207408 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc007980 con 0x7fba0c0697c0 2023-08-09T12:39:16.660 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.652+0000 7fb9f3fff640 1 -- 172.21.15.17:0/470207408 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc007cf0 con 0x7fba0c0697c0 2023-08-09T12:39:16.660 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.652+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c149800 con 0x7fba0c0697c0 2023-08-09T12:39:16.660 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.652+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c149dc0 con 0x7fba0c0697c0 2023-08-09T12:39:16.660 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.654+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c067a30 con 0x7fba0c0697c0 2023-08-09T12:39:16.661 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.655+0000 7fb9f3fff640 1 -- 172.21.15.17:0/470207408 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb9fc0113f0 con 0x7fba0c0697c0 2023-08-09T12:39:16.662 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.656+0000 7fb9f3fff640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9f806a050 0x7fb9f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:16.662 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.656+0000 7fb9f3fff640 1 -- 172.21.15.17:0/470207408 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb9fc0884e0 con 0x7fba0c0697c0 2023-08-09T12:39:16.662 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.656+0000 7fba0affd640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9f806a050 0x7fb9f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:16.662 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.657+0000 7fba0affd640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9f806a050 0x7fb9f806c510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fba00036000 tx=0x7fba0003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:16.663 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.661+0000 7fb9f3fff640 1 -- 172.21.15.17:0/470207408 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb9fc053fe0 con 0x7fba0c0697c0 2023-08-09T12:39:16.859 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.855+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba0c0b6a40 con 0x7fba0c0697c0 2023-08-09T12:39:16.859 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.857+0000 7fb9f3fff640 1 -- 172.21.15.17:0/470207408 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fb9fc057600 con 0x7fba0c0697c0 2023-08-09T12:39:16.860 INFO:teuthology.misc.health.smithi017.stdout: 2023-08-09T12:39:16.860 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":17,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:15.171960+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:16.862 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9f806a050 msgr2=0x7fb9f806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:16.862 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9f806a050 0x7fb9f806c510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fba00036000 tx=0x7fba0003b040 comp rx=0 tx=0).stop 2023-08-09T12:39:16.862 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c0697c0 msgr2=0x7fba0c0add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:16.863 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c0697c0 0x7fba0c0add90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00c7f0 tx=0x7fb9fc00ccb0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.863 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 shutdown_connections 2023-08-09T12:39:16.863 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9f806a050 0x7fb9f806c510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.863 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c15cd80 0x7fba0c148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.864 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c06adb0 0x7fba0c1489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.864 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 --2- 172.21.15.17:0/470207408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba0c0697c0 0x7fba0c0add90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:16.864 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.859+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 >> 172.21.15.17:0/470207408 conn(0x7fba0c06b9d0 msgr2=0x7fba0c0b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:16.864 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.860+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 shutdown_connections 2023-08-09T12:39:16.865 INFO:teuthology.misc.health.smithi017.stderr:2023-08-09T12:39:16.860+0000 7fba11e99640 1 -- 172.21.15.17:0/470207408 wait complete. 2023-08-09T12:39:16.881 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-09T12:39:16.882 INFO:tasks.ceph:Creating RBD pool 2023-08-09T12:39:16.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-09T12:39:17.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.100+0000 7fce2f799640 1 Processor -- start 2023-08-09T12:39:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.100+0000 7fce2f799640 1 -- start start 2023-08-09T12:39:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.102+0000 7fce2f799640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fce280adc40 0x7fce2806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.102+0000 7fce2f799640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce280b3b40 0x7fce280b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.102+0000 7fce2f799640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280b2250 con 0x7fce2815e8f0 2023-08-09T12:39:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.102+0000 7fce2f799640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280ae020 con 0x7fce280adc40 2023-08-09T12:39:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.102+0000 7fce2f799640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b2530 con 0x7fce280b3b40 2023-08-09T12:39:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.102+0000 7fce2d535640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fce280adc40 0x7fce2806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.102+0000 7fce2d535640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fce280adc40 0x7fce2806c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52720/0 (socket says 172.21.15.17:52720) 2023-08-09T12:39:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.102+0000 7fce2d535640 1 -- 172.21.15.17:0/456159380 learned_addr learned my addr 172.21.15.17:0/456159380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.103+0000 7fce2d535640 1 -- 172.21.15.17:0/456159380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce280b3b40 msgr2=0x7fce280b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.103+0000 7fce2d535640 1 --2- 172.21.15.17:0/456159380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce280b3b40 0x7fce280b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.103+0000 7fce2d535640 1 -- 172.21.15.17:0/456159380 >> v1:172.21.15.142:6789/0 conn(0x7fce2815e8f0 legacy=0x7fce2815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.103+0000 7fce2d535640 1 -- 172.21.15.17:0/456159380 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2806fe80 con 0x7fce280adc40 2023-08-09T12:39:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2d535640 1 --2- 172.21.15.17:0/456159380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce280adc40 0x7fce2806c280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce24009870 tx=0x7fce2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5942bc5b73aea71b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce1ffff640 1 -- 172.21.15.17:0/456159380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24031640 con 0x7fce280adc40 2023-08-09T12:39:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce1ffff640 1 -- 172.21.15.17:0/456159380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce240317a0 con 0x7fce280adc40 2023-08-09T12:39:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce1ffff640 1 -- 172.21.15.17:0/456159380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24031b30 con 0x7fce280adc40 2023-08-09T12:39:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2f799640 1 -- 172.21.15.17:0/456159380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce280adc40 msgr2=0x7fce2806c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2f799640 1 --2- 172.21.15.17:0/456159380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce280adc40 0x7fce2806c280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce24009870 tx=0x7fce2402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:39:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2f799640 1 -- 172.21.15.17:0/456159380 shutdown_connections 2023-08-09T12:39:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2f799640 1 --2- 172.21.15.17:0/456159380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce280b3b40 0x7fce280b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2f799640 1 --2- 172.21.15.17:0/456159380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce280adc40 0x7fce2806c280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2f799640 1 -- 172.21.15.17:0/456159380 >> 172.21.15.17:0/456159380 conn(0x7fce280cb1b0 msgr2=0x7fce280cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2f799640 1 -- 172.21.15.17:0/456159380 shutdown_connections 2023-08-09T12:39:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.105+0000 7fce2f799640 1 -- 172.21.15.17:0/456159380 wait complete. 2023-08-09T12:39:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.108+0000 7fce2f799640 1 Processor -- start 2023-08-09T12:39:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.108+0000 7fce2f799640 1 -- start start 2023-08-09T12:39:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2f799640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce280adc40 0x7fce280c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2f799640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce280b3b40 0x7fce28152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2f799640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce2815e8f0 0x7fce280ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2f799640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c3bc0 con 0x7fce2815e8f0 2023-08-09T12:39:17.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2f799640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c2f40 con 0x7fce280b3b40 2023-08-09T12:39:17.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2f799640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c3220 con 0x7fce280adc40 2023-08-09T12:39:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce2815e8f0 0x7fce280ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce2815e8f0 0x7fce280ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52724/0 (socket says 172.21.15.17:52724) 2023-08-09T12:39:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 -- 172.21.15.17:0/1639721166 learned_addr learned my addr 172.21.15.17:0/1639721166 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 -- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce280adc40 msgr2=0x7fce280c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce280adc40 0x7fce280c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 -- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce280b3b40 msgr2=0x7fce28152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce280b3b40 0x7fce28152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 -- 172.21.15.17:0/1639721166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce240094d0 con 0x7fce2815e8f0 2023-08-09T12:39:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2dd36640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce2815e8f0 0x7fce280ac8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce2000b990 tx=0x7fce2000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce1dffb640 1 -- 172.21.15.17:0/1639721166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2000cba0 con 0x7fce2815e8f0 2023-08-09T12:39:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce1dffb640 1 -- 172.21.15.17:0/1639721166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2000cd00 con 0x7fce2815e8f0 2023-08-09T12:39:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce1dffb640 1 -- 172.21.15.17:0/1639721166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20014680 con 0x7fce2815e8f0 2023-08-09T12:39:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.109+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280c3500 con 0x7fce2815e8f0 2023-08-09T12:39:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.110+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce28153250 con 0x7fce2815e8f0 2023-08-09T12:39:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.111+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce28067a80 con 0x7fce2815e8f0 2023-08-09T12:39:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.111+0000 7fce1dffb640 1 -- 172.21.15.17:0/1639721166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce2001d3b0 con 0x7fce2815e8f0 2023-08-09T12:39:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.113+0000 7fce1dffb640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce0c06a050 0x7fce0c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.113+0000 7fce1dffb640 1 -- 172.21.15.17:0/1639721166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce200880b0 con 0x7fce2815e8f0 2023-08-09T12:39:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.113+0000 7fce2d535640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce0c06a050 0x7fce0c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.114+0000 7fce2d535640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce0c06a050 0x7fce0c06c510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fce24036000 tx=0x7fce24030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.117+0000 7fce1dffb640 1 -- 172.21.15.17:0/1639721166 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fce20053c30 con 0x7fce2815e8f0 2023-08-09T12:39:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:17.312+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fce2806ed40 con 0x7fce2815e8f0 2023-08-09T12:39:18.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.279+0000 7fce1dffb640 1 -- 172.21.15.17:0/1639721166 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fce20057250 con 0x7fce2815e8f0 2023-08-09T12:39:18.282 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2023-08-09T12:39:18.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.284+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce0c06a050 msgr2=0x7fce0c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:18.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.284+0000 7fce2f799640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce0c06a050 0x7fce0c06c510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fce24036000 tx=0x7fce24030000 comp rx=0 tx=0).stop 2023-08-09T12:39:18.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.284+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce2815e8f0 msgr2=0x7fce280ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:18.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.284+0000 7fce2f799640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce2815e8f0 0x7fce280ac8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce2000b990 tx=0x7fce2000be50 comp rx=0 tx=0).stop 2023-08-09T12:39:18.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.284+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 shutdown_connections 2023-08-09T12:39:18.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.284+0000 7fce2f799640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce0c06a050 0x7fce0c06c510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.284+0000 7fce2f799640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce2815e8f0 0x7fce280ac8b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.284+0000 7fce2f799640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce280b3b40 0x7fce28152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.285+0000 7fce2f799640 1 --2- 172.21.15.17:0/1639721166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce280adc40 0x7fce280c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.285+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 >> 172.21.15.17:0/1639721166 conn(0x7fce280cb1b0 msgr2=0x7fce2815da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:18.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.285+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 shutdown_connections 2023-08-09T12:39:18.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.285+0000 7fce2f799640 1 -- 172.21.15.17:0/1639721166 wait complete. 2023-08-09T12:39:18.308 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-09T12:39:18.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.535+0000 7feddb604640 1 Processor -- start 2023-08-09T12:39:18.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.536+0000 7feddb604640 1 -- start start 2023-08-09T12:39:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.537+0000 7feddb604640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fedd415abe0 0x7fedd40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.537+0000 7feddb604640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fedd40add60 0x7fedd415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.537+0000 7feddb604640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd415f6e0 con 0x7fedd4070190 2023-08-09T12:39:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.537+0000 7feddb604640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd40b4770 con 0x7fedd40add60 2023-08-09T12:39:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.537+0000 7feddb604640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd40caa70 con 0x7fedd415abe0 2023-08-09T12:39:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.538+0000 7fedd8b9f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fedd40add60 0x7fedd415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.538+0000 7fedd8b9f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fedd40add60 0x7fedd415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42060/0 (socket says 172.21.15.17:42060) 2023-08-09T12:39:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.538+0000 7fedd8b9f640 1 -- 172.21.15.17:0/3142304692 learned_addr learned my addr 172.21.15.17:0/3142304692 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.538+0000 7fedd8b9f640 1 -- 172.21.15.17:0/3142304692 >> v2:172.21.15.142:3300/0 conn(0x7fedd415abe0 msgr2=0x7fedd40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.538+0000 7fedd8b9f640 1 --2- 172.21.15.17:0/3142304692 >> v2:172.21.15.142:3300/0 conn(0x7fedd415abe0 0x7fedd40c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.538+0000 7fedd8b9f640 1 -- 172.21.15.17:0/3142304692 >> v1:172.21.15.142:6789/0 conn(0x7fedd4070190 legacy=0x7fedd4070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:18.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.538+0000 7fedd8b9f640 1 -- 172.21.15.17:0/3142304692 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40b41b0 con 0x7fedd40add60 2023-08-09T12:39:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.539+0000 7fedd8b9f640 1 --2- 172.21.15.17:0/3142304692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd415f1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fedd4071100 tx=0x7fedc402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f516dff78ff639 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7fedcbfff640 1 -- 172.21.15.17:0/3142304692 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4031750 con 0x7fedd40add60 2023-08-09T12:39:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7fedcbfff640 1 -- 172.21.15.17:0/3142304692 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc40318b0 con 0x7fedd40add60 2023-08-09T12:39:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7fedcbfff640 1 -- 172.21.15.17:0/3142304692 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4031c40 con 0x7fedd40add60 2023-08-09T12:39:18.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7feddb604640 1 -- 172.21.15.17:0/3142304692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 msgr2=0x7fedd415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:18.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7feddb604640 1 --2- 172.21.15.17:0/3142304692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd415f1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fedd4071100 tx=0x7fedc402b7f0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7feddb604640 1 -- 172.21.15.17:0/3142304692 shutdown_connections 2023-08-09T12:39:18.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7feddb604640 1 --2- 172.21.15.17:0/3142304692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd415f1a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7feddb604640 1 --2- 172.21.15.17:0/3142304692 >> v2:172.21.15.142:3300/0 conn(0x7fedd415abe0 0x7fedd40c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.540+0000 7feddb604640 1 -- 172.21.15.17:0/3142304692 >> 172.21.15.17:0/3142304692 conn(0x7fedd40697c0 msgr2=0x7fedd4069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.541+0000 7feddb604640 1 -- 172.21.15.17:0/3142304692 shutdown_connections 2023-08-09T12:39:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.541+0000 7feddb604640 1 -- 172.21.15.17:0/3142304692 wait complete. 2023-08-09T12:39:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.542+0000 7feddb604640 1 Processor -- start 2023-08-09T12:39:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.542+0000 7feddb604640 1 -- start start 2023-08-09T12:39:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.543+0000 7feddb604640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedd4070190 0x7fedd40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.543+0000 7feddb604640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd4159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.543+0000 7feddb604640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedd415abe0 0x7fedd40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.543+0000 7feddb604640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40c5880 con 0x7fedd40add60 2023-08-09T12:39:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.543+0000 7feddb604640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40ad800 con 0x7fedd415abe0 2023-08-09T12:39:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.543+0000 7feddb604640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40ae720 con 0x7fedd4070190 2023-08-09T12:39:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd8b9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd4159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd8b9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd4159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42066/0 (socket says 172.21.15.17:42066) 2023-08-09T12:39:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd8b9f640 1 -- 172.21.15.17:0/4175540134 learned_addr learned my addr 172.21.15.17:0/4175540134 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd93a0640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedd4070190 0x7fedd40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd8b9f640 1 -- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedd4070190 msgr2=0x7fedd40c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd8b9f640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedd4070190 0x7fedd40c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd9ba1640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedd415abe0 0x7fedd40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd8b9f640 1 -- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedd415abe0 msgr2=0x7fedd40afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd8b9f640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedd415abe0 0x7fedd40afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd8b9f640 1 -- 172.21.15.17:0/4175540134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40094d0 con 0x7fedd40add60 2023-08-09T12:39:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd93a0640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedd4070190 0x7fedd40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.544+0000 7fedd9ba1640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedd415abe0 0x7fedd40afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.545+0000 7fedd8b9f640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd4159a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fedc4000c00 tx=0x7fedc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:18.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.545+0000 7fedc9ffb640 1 -- 172.21.15.17:0/4175540134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4033c60 con 0x7fedd40add60 2023-08-09T12:39:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.545+0000 7fedc9ffb640 1 -- 172.21.15.17:0/4175540134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4033de0 con 0x7fedd40add60 2023-08-09T12:39:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.545+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd40aea00 con 0x7fedd40add60 2023-08-09T12:39:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.545+0000 7fedc9ffb640 1 -- 172.21.15.17:0/4175540134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc403d6b0 con 0x7fedd40add60 2023-08-09T12:39:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.545+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd40aefc0 con 0x7fedd40add60 2023-08-09T12:39:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.546+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd40c59c0 con 0x7fedd40add60 2023-08-09T12:39:18.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.547+0000 7fedc9ffb640 1 -- 172.21.15.17:0/4175540134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fedc403a040 con 0x7fedd40add60 2023-08-09T12:39:18.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.548+0000 7fedc9ffb640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fedb806a050 0x7fedb806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:18.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.548+0000 7fedc9ffb640 1 -- 172.21.15.17:0/4175540134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fedc40aa470 con 0x7fedd40add60 2023-08-09T12:39:18.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.549+0000 7fedd93a0640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fedb806a050 0x7fedb806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:18.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.550+0000 7fedd93a0640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fedb806a050 0x7fedb806c510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedd40c2270 tx=0x7fedd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.552+0000 7fedc9ffb640 1 -- 172.21.15.17:0/4175540134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fedc4075ea0 con 0x7fedd40add60 2023-08-09T12:39:18.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:18.746+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fedd415f6e0 con 0x7fedd40add60 2023-08-09T12:39:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.292+0000 7fedc9ffb640 1 -- 172.21.15.17:0/4175540134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7fedd415f6e0 con 0x7fedd40add60 2023-08-09T12:39:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-09T12:39:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.296+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fedb806a050 msgr2=0x7fedb806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.296+0000 7feddb604640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fedb806a050 0x7fedb806c510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedd40c2270 tx=0x7fedd0008040 comp rx=0 tx=0).stop 2023-08-09T12:39:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.296+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 msgr2=0x7fedd4159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.296+0000 7feddb604640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd4159a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fedc4000c00 tx=0x7fedc40046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.297+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 shutdown_connections 2023-08-09T12:39:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.297+0000 7feddb604640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fedb806a050 0x7fedb806c510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.297+0000 7feddb604640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedd415abe0 0x7fedd40afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.297+0000 7feddb604640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedd40add60 0x7fedd4159a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.297+0000 7feddb604640 1 --2- 172.21.15.17:0/4175540134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedd4070190 0x7fedd40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.297+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 >> 172.21.15.17:0/4175540134 conn(0x7fedd40697c0 msgr2=0x7fedd40b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.297+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 shutdown_connections 2023-08-09T12:39:19.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.298+0000 7feddb604640 1 -- 172.21.15.17:0/4175540134 wait complete. 2023-08-09T12:39:19.321 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-09T12:39:19.321 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:39:19.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:39:19.326 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:39:19.326 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:39:19.327 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:39:19.331 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:39:19.332 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:39:19.332 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:39:19.340 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:39:19.340 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:39:19.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:39:19.349 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:39:19.349 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-09T12:39:19.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:19.495 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:39:19.500 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:39:19.504 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:39:19.504 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:39:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.549+0000 7ffb38f0f640 1 Processor -- start 2023-08-09T12:39:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.549+0000 7ffb38f0f640 1 -- start start 2023-08-09T12:39:19.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.551+0000 7ffb38f0f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffb3415ce90 0x7ffb341616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:19.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.551+0000 7ffb38f0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb340d29d0 0x7ffb340d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:19.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.551+0000 7ffb38f0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340d3360 con 0x7ffb340b6000 2023-08-09T12:39:19.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.551+0000 7ffb38f0f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340b6460 con 0x7ffb3415ce90 2023-08-09T12:39:19.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.551+0000 7ffb38f0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340cdd10 con 0x7ffb340d29d0 2023-08-09T12:39:19.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.551+0000 7ffb3259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffb3415ce90 0x7ffb341616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:19.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.551+0000 7ffb3259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffb3415ce90 0x7ffb341616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42102/0 (socket says 172.21.15.17:42102) 2023-08-09T12:39:19.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.551+0000 7ffb3259c640 1 -- 172.21.15.17:0/861628684 learned_addr learned my addr 172.21.15.17:0/861628684 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:19.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.552+0000 7ffb32d9d640 1 --2- 172.21.15.17:0/861628684 >> v2:172.21.15.142:3300/0 conn(0x7ffb340d29d0 0x7ffb340d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:19.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.552+0000 7ffb3259c640 1 -- 172.21.15.17:0/861628684 >> v2:172.21.15.142:3300/0 conn(0x7ffb340d29d0 msgr2=0x7ffb340d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:19.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.552+0000 7ffb3259c640 1 --2- 172.21.15.17:0/861628684 >> v2:172.21.15.142:3300/0 conn(0x7ffb340d29d0 0x7ffb340d2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.552+0000 7ffb3259c640 1 -- 172.21.15.17:0/861628684 >> v1:172.21.15.142:6789/0 conn(0x7ffb340b6000 legacy=0x7ffb340cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:19.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.552+0000 7ffb3259c640 1 -- 172.21.15.17:0/861628684 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340cdff0 con 0x7ffb3415ce90 2023-08-09T12:39:19.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.553+0000 7ffb3259c640 1 --2- 172.21.15.17:0/861628684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341616e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffb340d07e0 tx=0x7ffb2402b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bba90fafc31b1b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:19.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.553+0000 7ffb31d9b640 1 -- 172.21.15.17:0/861628684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24030880 con 0x7ffb3415ce90 2023-08-09T12:39:19.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.553+0000 7ffb31d9b640 1 -- 172.21.15.17:0/861628684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb240309e0 con 0x7ffb3415ce90 2023-08-09T12:39:19.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.553+0000 7ffb31d9b640 1 -- 172.21.15.17:0/861628684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24030d70 con 0x7ffb3415ce90 2023-08-09T12:39:19.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.554+0000 7ffb38f0f640 1 -- 172.21.15.17:0/861628684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 msgr2=0x7ffb341616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.554+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/861628684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341616e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffb340d07e0 tx=0x7ffb2402b9c0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.554+0000 7ffb38f0f640 1 -- 172.21.15.17:0/861628684 shutdown_connections 2023-08-09T12:39:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.554+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/861628684 >> v2:172.21.15.142:3300/0 conn(0x7ffb340d29d0 0x7ffb340d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.554+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/861628684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341616e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.554+0000 7ffb38f0f640 1 -- 172.21.15.17:0/861628684 >> 172.21.15.17:0/861628684 conn(0x7ffb3406fde0 msgr2=0x7ffb340701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.554+0000 7ffb38f0f640 1 -- 172.21.15.17:0/861628684 shutdown_connections 2023-08-09T12:39:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.554+0000 7ffb38f0f640 1 -- 172.21.15.17:0/861628684 wait complete. 2023-08-09T12:39:19.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.556+0000 7ffb38f0f640 1 Processor -- start 2023-08-09T12:39:19.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.556+0000 7ffb38f0f640 1 -- start start 2023-08-09T12:39:19.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.557+0000 7ffb38f0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb340b6000 0x7ffb34155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:19.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.557+0000 7ffb38f0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340d29d0 0x7ffb34159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:19.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.557+0000 7ffb38f0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:19.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.557+0000 7ffb38f0f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341568f0 con 0x7ffb3415ce90 2023-08-09T12:39:19.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.557+0000 7ffb38f0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340cae50 con 0x7ffb340d29d0 2023-08-09T12:39:19.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.557+0000 7ffb38f0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3415fc50 con 0x7ffb340b6000 2023-08-09T12:39:19.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:19.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341f6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42104/0 (socket says 172.21.15.17:42104) 2023-08-09T12:39:19.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 -- 172.21.15.17:0/3930430334 learned_addr learned my addr 172.21.15.17:0/3930430334 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:19.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb2bfff640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340d29d0 0x7ffb34159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:19.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb3259c640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb340b6000 0x7ffb34155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:19.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 -- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb340b6000 msgr2=0x7ffb34155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:19.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb340b6000 0x7ffb34155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 -- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340d29d0 msgr2=0x7ffb34159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:19.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340d29d0 0x7ffb34159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 -- 172.21.15.17:0/3930430334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240094d0 con 0x7ffb3415ce90 2023-08-09T12:39:19.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb2bfff640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340d29d0 0x7ffb34159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:19.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.558+0000 7ffb32d9d640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341f6480 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00efc0 tx=0x7ffb2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:19.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.559+0000 7ffb2affd640 1 -- 172.21.15.17:0/3930430334 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c014480 con 0x7ffb3415ce90 2023-08-09T12:39:19.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.559+0000 7ffb2affd640 1 -- 172.21.15.17:0/3930430334 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00f040 con 0x7ffb3415ce90 2023-08-09T12:39:19.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.559+0000 7ffb2affd640 1 -- 172.21.15.17:0/3930430334 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c014820 con 0x7ffb3415ce90 2023-08-09T12:39:19.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.559+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340ca890 con 0x7ffb3415ce90 2023-08-09T12:39:19.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.559+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3415f450 con 0x7ffb3415ce90 2023-08-09T12:39:19.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.560+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb340b3600 con 0x7ffb3415ce90 2023-08-09T12:39:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.561+0000 7ffb2affd640 1 -- 172.21.15.17:0/3930430334 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffb2c014980 con 0x7ffb3415ce90 2023-08-09T12:39:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.562+0000 7ffb2affd640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb1406a050 0x7ffb1406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.562+0000 7ffb2affd640 1 -- 172.21.15.17:0/3930430334 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffb2c0891c0 con 0x7ffb3415ce90 2023-08-09T12:39:19.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.562+0000 7ffb3259c640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb1406a050 0x7ffb1406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:19.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.563+0000 7ffb3259c640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb1406a050 0x7ffb1406c510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffb24036000 tx=0x7ffb2403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.567+0000 7ffb2affd640 1 -- 172.21.15.17:0/3930430334 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ffb2c054b60 con 0x7ffb3415ce90 2023-08-09T12:39:19.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.757+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb34067a80 con 0x7ffb3415ce90 2023-08-09T12:39:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.759+0000 7ffb2affd640 1 -- 172.21.15.17:0/3930430334 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14625 (secure 0 0 0) 0x7ffb2c058180 con 0x7ffb3415ce90 2023-08-09T12:39:19.762 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:19.762 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:19.276170+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:19.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb1406a050 msgr2=0x7ffb1406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:19.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb1406a050 0x7ffb1406c510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffb24036000 tx=0x7ffb2403b040 comp rx=0 tx=0).stop 2023-08-09T12:39:19.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 msgr2=0x7ffb341f6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341f6480 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00efc0 tx=0x7ffb2c00c490 comp rx=0 tx=0).stop 2023-08-09T12:39:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 shutdown_connections 2023-08-09T12:39:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb1406a050 0x7ffb1406c510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb3415ce90 0x7ffb341f6480 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb340d29d0 0x7ffb34159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 --2- 172.21.15.17:0/3930430334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb340b6000 0x7ffb34155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 >> 172.21.15.17:0/3930430334 conn(0x7ffb3406fde0 msgr2=0x7ffb340b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 shutdown_connections 2023-08-09T12:39:19.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:19.762+0000 7ffb38f0f640 1 -- 172.21.15.17:0/3930430334 wait complete. 2023-08-09T12:39:19.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:39:19.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:39:20.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.007+0000 7f1a06678640 1 Processor -- start 2023-08-09T12:39:20.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.008+0000 7f1a06678640 1 -- start start 2023-08-09T12:39:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.009+0000 7f1a06678640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a000b0730 0x7f1a000b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.009+0000 7f1a06678640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0015e7b0 con 0x7f1a0015a8c0 2023-08-09T12:39:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.009+0000 7f1a06678640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0015e460 con 0x7f1a000b4170 2023-08-09T12:39:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.009+0000 7f1a06678640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0015aca0 con 0x7f1a000b0730 2023-08-09T12:39:20.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.009+0000 7f1a05676640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1a0015a8c0 0x7f1a0015ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35182/0 (socket says 172.21.15.17:35182) 2023-08-09T12:39:20.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.009+0000 7f1a05676640 1 -- 172.21.15.17:0/2000256124 learned_addr learned my addr 172.21.15.17:0/2000256124 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:20.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.009+0000 7f1a05e77640 1 --2- 172.21.15.17:0/2000256124 >> v2:172.21.15.17:3300/0 conn(0x7f1a000b0730 0x7f1a000b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.010+0000 7f1a05e77640 1 -- 172.21.15.17:0/2000256124 >> v1:172.21.15.142:6789/0 conn(0x7f1a000b4170 legacy=0x7f1a000b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:20.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.010+0000 7f1a05e77640 1 -- 172.21.15.17:0/2000256124 >> v1:172.21.15.17:6789/0 conn(0x7f1a0015a8c0 legacy=0x7f1a0015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.010+0000 7f1a05e77640 1 -- 172.21.15.17:0/2000256124 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000b1af0 con 0x7f1a000b0730 2023-08-09T12:39:20.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.010+0000 7f19f7fff640 1 -- 172.21.15.17:0/2000256124 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205054046 0 0) 0x7f1a0015e7b0 con 0x7f1a0015a8c0 2023-08-09T12:39:20.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.011+0000 7f1a05e77640 1 --2- 172.21.15.17:0/2000256124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b0730 0x7f1a000b13f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009d90 tx=0x7f19f802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43d1b913ec8e72a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.011+0000 7f19f7fff640 1 -- 172.21.15.17:0/2000256124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f802cc60 con 0x7f1a000b0730 2023-08-09T12:39:20.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.011+0000 7f19f7fff640 1 -- 172.21.15.17:0/2000256124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f802cdc0 con 0x7f1a000b0730 2023-08-09T12:39:20.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.011+0000 7f19f7fff640 1 -- 172.21.15.17:0/2000256124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8034660 con 0x7f1a000b0730 2023-08-09T12:39:20.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.012+0000 7f1a06678640 1 -- 172.21.15.17:0/2000256124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b0730 msgr2=0x7f1a000b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.012+0000 7f1a06678640 1 --2- 172.21.15.17:0/2000256124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b0730 0x7f1a000b13f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009d90 tx=0x7f19f802beb0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.012+0000 7f1a06678640 1 -- 172.21.15.17:0/2000256124 shutdown_connections 2023-08-09T12:39:20.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.012+0000 7f1a06678640 1 --2- 172.21.15.17:0/2000256124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b0730 0x7f1a000b13f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.012+0000 7f1a06678640 1 -- 172.21.15.17:0/2000256124 >> 172.21.15.17:0/2000256124 conn(0x7f1a000cb020 msgr2=0x7f1a000cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:20.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.012+0000 7f1a06678640 1 -- 172.21.15.17:0/2000256124 shutdown_connections 2023-08-09T12:39:20.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.012+0000 7f1a06678640 1 -- 172.21.15.17:0/2000256124 wait complete. 2023-08-09T12:39:20.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.014+0000 7f1a06678640 1 Processor -- start 2023-08-09T12:39:20.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.014+0000 7f1a06678640 1 -- start start 2023-08-09T12:39:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a06678640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a000b0730 0x7f1a001f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a06678640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b4170 0x7f1a000c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a06678640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0015a8c0 0x7f1a0015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a06678640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c3a50 con 0x7f1a000b4170 2023-08-09T12:39:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a06678640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c3d30 con 0x7f1a0015a8c0 2023-08-09T12:39:20.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a06678640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c4010 con 0x7f1a000b0730 2023-08-09T12:39:20.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a04e75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b4170 0x7f1a000c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a04e75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b4170 0x7f1a000c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42120/0 (socket says 172.21.15.17:42120) 2023-08-09T12:39:20.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a04e75640 1 -- 172.21.15.17:0/3203090218 learned_addr learned my addr 172.21.15.17:0/3203090218 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a05676640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a000b0730 0x7f1a001f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a05e77640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0015a8c0 0x7f1a0015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.015+0000 7f1a04e75640 1 -- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a000b0730 msgr2=0x7f1a001f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f1a04e75640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a000b0730 0x7f1a001f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f1a04e75640 1 -- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0015a8c0 msgr2=0x7f1a0015d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f1a04e75640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0015a8c0 0x7f1a0015d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f1a04e75640 1 -- 172.21.15.17:0/3203090218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8009a70 con 0x7f1a000b4170 2023-08-09T12:39:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f1a04e75640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b4170 0x7f1a000c30e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19f000c430 tx=0x7f19f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f19f5ffb640 1 -- 172.21.15.17:0/3203090218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0011790 con 0x7f1a000b4170 2023-08-09T12:39:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f19f5ffb640 1 -- 172.21.15.17:0/3203090218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f00118f0 con 0x7f1a000b4170 2023-08-09T12:39:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a000c42f0 con 0x7f1a000b4170 2023-08-09T12:39:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f19f5ffb640 1 -- 172.21.15.17:0/3203090218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0011ce0 con 0x7f1a000b4170 2023-08-09T12:39:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.016+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a001f3110 con 0x7f1a000b4170 2023-08-09T12:39:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.017+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a000c4810 con 0x7f1a000b4170 2023-08-09T12:39:20.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.018+0000 7f19f5ffb640 1 -- 172.21.15.17:0/3203090218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f19f001c460 con 0x7f1a000b4170 2023-08-09T12:39:20.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.019+0000 7f19f5ffb640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19e406a050 0x7f19e406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.019+0000 7f19f5ffb640 1 -- 172.21.15.17:0/3203090218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f19f0088250 con 0x7f1a000b4170 2023-08-09T12:39:20.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.020+0000 7f1a05676640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19e406a050 0x7f19e406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.021+0000 7f1a05676640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19e406a050 0x7f19e406c510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19fc000f60 tx=0x7f19fc007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.024+0000 7f19f5ffb640 1 -- 172.21.15.17:0/3203090218 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1a000c4810 con 0x7f1a000b4170 2023-08-09T12:39:20.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.220+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a000c4810 con 0x7f1a000b4170 2023-08-09T12:39:20.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.221+0000 7f19f5ffb640 1 -- 172.21.15.17:0/3203090218 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a000c4810 con 0x7f1a000b4170 2023-08-09T12:39:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:39:20.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.223+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19e406a050 msgr2=0x7f19e406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.223+0000 7f1a06678640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19e406a050 0x7f19e406c510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19fc000f60 tx=0x7f19fc007c00 comp rx=0 tx=0).stop 2023-08-09T12:39:20.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.223+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b4170 msgr2=0x7f1a000c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.223+0000 7f1a06678640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b4170 0x7f1a000c30e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19f000c430 tx=0x7f19f000c8f0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.223+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 shutdown_connections 2023-08-09T12:39:20.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.223+0000 7f1a06678640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19e406a050 0x7f19e406c510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.223+0000 7f1a06678640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a0015a8c0 0x7f1a0015d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.223+0000 7f1a06678640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a000b4170 0x7f1a000c30e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.224+0000 7f1a06678640 1 --2- 172.21.15.17:0/3203090218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a000b0730 0x7f1a001f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.224+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 >> 172.21.15.17:0/3203090218 conn(0x7f1a000cb020 msgr2=0x7f1a000cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:20.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.224+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 shutdown_connections 2023-08-09T12:39:20.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.224+0000 7f1a06678640 1 -- 172.21.15.17:0/3203090218 wait complete. 2023-08-09T12:39:20.246 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:39:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.475+0000 7f2f38eba640 1 Processor -- start 2023-08-09T12:39:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.475+0000 7f2f38eba640 1 -- start start 2023-08-09T12:39:20.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.477+0000 7f2f38eba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f340b3b40 0x7f2f340b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.477+0000 7f2f38eba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3406c990 con 0x7f2f340adc40 2023-08-09T12:39:20.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.477+0000 7f2f38eba640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340b2250 con 0x7f2f340cc630 2023-08-09T12:39:20.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.477+0000 7f2f38eba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340ae020 con 0x7f2f340b3b40 2023-08-09T12:39:20.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.477+0000 7f2f3259c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2f340adc40 0x7f2f3406c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35188/0 (socket says 172.21.15.17:35188) 2023-08-09T12:39:20.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.477+0000 7f2f3259c640 1 -- 172.21.15.17:0/2275006945 learned_addr learned my addr 172.21.15.17:0/2275006945 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:20.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.477+0000 7f2f31d9b640 1 --2- 172.21.15.17:0/2275006945 >> v2:172.21.15.17:3300/0 conn(0x7f2f340b3b40 0x7f2f340b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.478+0000 7f2f31d9b640 1 -- 172.21.15.17:0/2275006945 >> v1:172.21.15.142:6789/0 conn(0x7f2f340cc630 legacy=0x7f2f340ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:20.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.478+0000 7f2f31d9b640 1 -- 172.21.15.17:0/2275006945 >> v1:172.21.15.17:6789/0 conn(0x7f2f340adc40 legacy=0x7f2f3406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.478+0000 7f2f31d9b640 1 -- 172.21.15.17:0/2275006945 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340b2530 con 0x7f2f340b3b40 2023-08-09T12:39:20.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.478+0000 7f2f3159a640 1 -- 172.21.15.17:0/2275006945 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509799805 0 0) 0x7f2f3406c990 con 0x7f2f340adc40 2023-08-09T12:39:20.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.479+0000 7f2f31d9b640 1 --2- 172.21.15.17:0/2275006945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340b3b40 0x7f2f340b3fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009790 tx=0x7f2f2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b3ac55cb202cd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.479+0000 7f2f3159a640 1 -- 172.21.15.17:0/2275006945 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28031830 con 0x7f2f340b3b40 2023-08-09T12:39:20.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.479+0000 7f2f3159a640 1 -- 172.21.15.17:0/2275006945 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28031990 con 0x7f2f340b3b40 2023-08-09T12:39:20.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.479+0000 7f2f3159a640 1 -- 172.21.15.17:0/2275006945 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28031d20 con 0x7f2f340b3b40 2023-08-09T12:39:20.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.480+0000 7f2f38eba640 1 -- 172.21.15.17:0/2275006945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340b3b40 msgr2=0x7f2f340b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.480+0000 7f2f38eba640 1 --2- 172.21.15.17:0/2275006945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340b3b40 0x7f2f340b3fd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009790 tx=0x7f2f2802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.480+0000 7f2f38eba640 1 -- 172.21.15.17:0/2275006945 shutdown_connections 2023-08-09T12:39:20.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.480+0000 7f2f38eba640 1 --2- 172.21.15.17:0/2275006945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340b3b40 0x7f2f340b3fd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.480+0000 7f2f38eba640 1 -- 172.21.15.17:0/2275006945 >> 172.21.15.17:0/2275006945 conn(0x7f2f340cb1b0 msgr2=0x7f2f340cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:20.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.480+0000 7f2f38eba640 1 -- 172.21.15.17:0/2275006945 shutdown_connections 2023-08-09T12:39:20.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.480+0000 7f2f38eba640 1 -- 172.21.15.17:0/2275006945 wait complete. 2023-08-09T12:39:20.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.482+0000 7f2f38eba640 1 Processor -- start 2023-08-09T12:39:20.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.482+0000 7f2f38eba640 1 -- start start 2023-08-09T12:39:20.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f38eba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340adc40 0x7f2f341f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f38eba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f340b3b40 0x7f2f340c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f38eba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f340cc630 0x7f2f340af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f38eba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341f38d0 con 0x7f2f340adc40 2023-08-09T12:39:20.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f38eba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341f6720 con 0x7f2f340cc630 2023-08-09T12:39:20.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f38eba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340c5ab0 con 0x7f2f340b3b40 2023-08-09T12:39:20.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f3259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340adc40 0x7f2f341f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f3259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340adc40 0x7f2f341f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42132/0 (socket says 172.21.15.17:42132) 2023-08-09T12:39:20.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.483+0000 7f2f3259c640 1 -- 172.21.15.17:0/346716810 learned_addr learned my addr 172.21.15.17:0/346716810 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:20.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f3259c640 1 -- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f340b3b40 msgr2=0x7f2f340c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f31d9b640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f340b3b40 0x7f2f340c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f3259c640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f340b3b40 0x7f2f340c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f3259c640 1 -- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f340cc630 msgr2=0x7f2f340af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f3259c640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f340cc630 0x7f2f340af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f3259c640 1 -- 172.21.15.17:0/346716810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280093a0 con 0x7f2f340adc40 2023-08-09T12:39:20.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f3259c640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340adc40 0x7f2f341f3390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400c530 tx=0x7f2f2400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f22ffd640 1 -- 172.21.15.17:0/346716810 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240074e0 con 0x7f2f340adc40 2023-08-09T12:39:20.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f22ffd640 1 -- 172.21.15.17:0/346716810 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f24007660 con 0x7f2f340adc40 2023-08-09T12:39:20.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f22ffd640 1 -- 172.21.15.17:0/346716810 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24004a20 con 0x7f2f340adc40 2023-08-09T12:39:20.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.484+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f341f5ba0 con 0x7f2f340adc40 2023-08-09T12:39:20.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.485+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f341f6160 con 0x7f2f340adc40 2023-08-09T12:39:20.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.486+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f34067a80 con 0x7f2f340adc40 2023-08-09T12:39:20.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.487+0000 7f2f22ffd640 1 -- 172.21.15.17:0/346716810 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f24004b80 con 0x7f2f340adc40 2023-08-09T12:39:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.488+0000 7f2f22ffd640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2f1406a050 0x7f2f1406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.488+0000 7f2f22ffd640 1 -- 172.21.15.17:0/346716810 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2f24087460 con 0x7f2f340adc40 2023-08-09T12:39:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.488+0000 7f2f31d9b640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2f1406a050 0x7f2f1406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.489+0000 7f2f31d9b640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2f1406a050 0x7f2f1406c510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f28036000 tx=0x7f2f28008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.492+0000 7f2f22ffd640 1 -- 172.21.15.17:0/346716810 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2f24052e00 con 0x7f2f340adc40 2023-08-09T12:39:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.687+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f3406ed40 con 0x7f2f340adc40 2023-08-09T12:39:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.688+0000 7f2f22ffd640 1 -- 172.21.15.17:0/346716810 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f24056420 con 0x7f2f340adc40 2023-08-09T12:39:20.690 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:39:20.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.690+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2f1406a050 msgr2=0x7f2f1406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2f1406a050 0x7f2f1406c510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f28036000 tx=0x7f2f28008030 comp rx=0 tx=0).stop 2023-08-09T12:39:20.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340adc40 msgr2=0x7f2f341f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340adc40 0x7f2f341f3390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400c530 tx=0x7f2f2400c9f0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 shutdown_connections 2023-08-09T12:39:20.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2f1406a050 0x7f2f1406c510 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f340cc630 0x7f2f340af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f340b3b40 0x7f2f340c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 --2- 172.21.15.17:0/346716810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340adc40 0x7f2f341f3390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 >> 172.21.15.17:0/346716810 conn(0x7f2f340cb1b0 msgr2=0x7f2f340cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:20.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 shutdown_connections 2023-08-09T12:39:20.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.691+0000 7f2f38eba640 1 -- 172.21.15.17:0/346716810 wait complete. 2023-08-09T12:39:20.712 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:39:20.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.936+0000 7f4605478640 1 Processor -- start 2023-08-09T12:39:20.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.936+0000 7f4605478640 1 -- start start 2023-08-09T12:39:20.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4605478640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f46000c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4605478640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46000c9ab0 0x7f46000b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4605478640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f46001593a0 0x7f46000b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4605478640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46000ae030 con 0x7f46001593a0 2023-08-09T12:39:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4605478640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46000ae310 con 0x7f46000c9ab0 2023-08-09T12:39:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4605478640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46000ae5f0 con 0x7f4600158fc0 2023-08-09T12:39:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4604c77640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f46001593a0 0x7f46000b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4604c77640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f46001593a0 0x7f46000b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42140/0 (socket says 172.21.15.17:42140) 2023-08-09T12:39:20.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.938+0000 7f4604c77640 1 -- 172.21.15.17:0/190926620 learned_addr learned my addr 172.21.15.17:0/190926620 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f45fffff640 1 --2- 172.21.15.17:0/190926620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f46000c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f4604c77640 1 -- 172.21.15.17:0/190926620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 msgr2=0x7f46000c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f4604c77640 1 --2- 172.21.15.17:0/190926620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f46000c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f4604c77640 1 -- 172.21.15.17:0/190926620 >> v2:172.21.15.142:3300/0 conn(0x7f46000c9ab0 msgr2=0x7f46000b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f45ff7fe640 1 --2- 172.21.15.17:0/190926620 >> v2:172.21.15.142:3300/0 conn(0x7f46000c9ab0 0x7f46000b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f4604c77640 1 --2- 172.21.15.17:0/190926620 >> v2:172.21.15.142:3300/0 conn(0x7f46000c9ab0 0x7f46000b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f4604c77640 1 -- 172.21.15.17:0/190926620 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46000abf00 con 0x7f46001593a0 2023-08-09T12:39:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f45fffff640 1 --2- 172.21.15.17:0/190926620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f46000c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.939+0000 7f45ff7fe640 1 --2- 172.21.15.17:0/190926620 >> v2:172.21.15.142:3300/0 conn(0x7f46000c9ab0 0x7f46000b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.940+0000 7f4604c77640 1 --2- 172.21.15.17:0/190926620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f46000b0ee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46000b16f0 tx=0x7f45f802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ddff4563ccbefb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.940+0000 7f45feffd640 1 -- 172.21.15.17:0/190926620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f802ca80 con 0x7f46001593a0 2023-08-09T12:39:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.940+0000 7f45feffd640 1 -- 172.21.15.17:0/190926620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f802cbe0 con 0x7f46001593a0 2023-08-09T12:39:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.940+0000 7f45feffd640 1 -- 172.21.15.17:0/190926620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80343f0 con 0x7f46001593a0 2023-08-09T12:39:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 -- 172.21.15.17:0/190926620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 msgr2=0x7f46000b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 --2- 172.21.15.17:0/190926620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f46000b0ee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46000b16f0 tx=0x7f45f802bee0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 -- 172.21.15.17:0/190926620 shutdown_connections 2023-08-09T12:39:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 --2- 172.21.15.17:0/190926620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f46000b0ee0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 --2- 172.21.15.17:0/190926620 >> v2:172.21.15.142:3300/0 conn(0x7f46000c9ab0 0x7f46000b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 --2- 172.21.15.17:0/190926620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f46000c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 -- 172.21.15.17:0/190926620 >> 172.21.15.17:0/190926620 conn(0x7f46000cb9a0 msgr2=0x7f46000cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 -- 172.21.15.17:0/190926620 shutdown_connections 2023-08-09T12:39:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.941+0000 7f4605478640 1 -- 172.21.15.17:0/190926620 wait complete. 2023-08-09T12:39:20.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.943+0000 7f4605478640 1 Processor -- start 2023-08-09T12:39:20.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.943+0000 7f4605478640 1 -- start start 2023-08-09T12:39:20.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.944+0000 7f4605478640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46000c9ab0 0x7f4600148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.944+0000 7f4605478640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f4600099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.944+0000 7f4605478640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f4600099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.944+0000 7f4605478640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46001e3180 con 0x7f46001593a0 2023-08-09T12:39:20.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.944+0000 7f4605478640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4600159870 con 0x7f46000c9ab0 2023-08-09T12:39:20.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.944+0000 7f4605478640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46001e2590 con 0x7f4600158fc0 2023-08-09T12:39:20.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f4604c77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f4600099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f4604c77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f4600099f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42154/0 (socket says 172.21.15.17:42154) 2023-08-09T12:39:20.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f4604c77640 1 -- 172.21.15.17:0/950652496 learned_addr learned my addr 172.21.15.17:0/950652496 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:20.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f45fffff640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46000c9ab0 0x7f4600148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f45ff7fe640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f4600099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f4604c77640 1 -- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 msgr2=0x7f4600099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f4604c77640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f4600099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f4604c77640 1 -- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46000c9ab0 msgr2=0x7f4600148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:20.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f4604c77640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46000c9ab0 0x7f4600148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:20.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.945+0000 7f4604c77640 1 -- 172.21.15.17:0/950652496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009b30 con 0x7f46001593a0 2023-08-09T12:39:20.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.946+0000 7f4604c77640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f4600099f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45f8036040 tx=0x7f45f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.946+0000 7f45fcff9640 1 -- 172.21.15.17:0/950652496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8009510 con 0x7f46001593a0 2023-08-09T12:39:20.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.946+0000 7f45fcff9640 1 -- 172.21.15.17:0/950652496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f803e450 con 0x7f46001593a0 2023-08-09T12:39:20.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.946+0000 7f45fcff9640 1 -- 172.21.15.17:0/950652496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f803e800 con 0x7f46001593a0 2023-08-09T12:39:20.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.946+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4600148890 con 0x7f46001593a0 2023-08-09T12:39:20.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.946+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46001e2ac0 con 0x7f46001593a0 2023-08-09T12:39:20.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.947+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46001e32c0 con 0x7f46001593a0 2023-08-09T12:39:20.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.948+0000 7f45fcff9640 1 -- 172.21.15.17:0/950652496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45f802cd50 con 0x7f46001593a0 2023-08-09T12:39:20.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.949+0000 7f45fcff9640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45ec06a050 0x7f45ec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:20.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.949+0000 7f45fcff9640 1 -- 172.21.15.17:0/950652496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f45f80ab0f0 con 0x7f46001593a0 2023-08-09T12:39:20.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.950+0000 7f45fffff640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45ec06a050 0x7f45ec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:20.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.951+0000 7f45fffff640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45ec06a050 0x7f45ec06c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f45f0006fd0 tx=0x7f45f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:20.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:20.954+0000 7f45fcff9640 1 -- 172.21.15.17:0/950652496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f46001e32c0 con 0x7f46001593a0 2023-08-09T12:39:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.181+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46001e32c0 con 0x7f46001593a0 2023-08-09T12:39:21.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.182+0000 7f45fcff9640 1 -- 172.21.15.17:0/950652496 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f45f8043e90 con 0x7f46001593a0 2023-08-09T12:39:21.184 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:21.185 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-09T12:39:21.185 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2023-08-09T12:39:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.184+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45ec06a050 msgr2=0x7f45ec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.184+0000 7f4605478640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45ec06a050 0x7f45ec06c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f45f0006fd0 tx=0x7f45f0008040 comp rx=0 tx=0).stop 2023-08-09T12:39:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.184+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 msgr2=0x7f4600099f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.184+0000 7f4605478640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f4600099f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45f8036040 tx=0x7f45f8004a40 comp rx=0 tx=0).stop 2023-08-09T12:39:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.185+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 shutdown_connections 2023-08-09T12:39:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.185+0000 7f4605478640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45ec06a050 0x7f45ec06c510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.185+0000 7f4605478640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46001593a0 0x7f4600099f70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.185+0000 7f4605478640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4600158fc0 0x7f4600099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.185+0000 7f4605478640 1 --2- 172.21.15.17:0/950652496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46000c9ab0 0x7f4600148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.185+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 >> 172.21.15.17:0/950652496 conn(0x7f46000cb9a0 msgr2=0x7f46000ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.185+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 shutdown_connections 2023-08-09T12:39:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.185+0000 7f4605478640 1 -- 172.21.15.17:0/950652496 wait complete. 2023-08-09T12:39:21.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:21.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.433+0000 7f8736912640 1 Processor -- start 2023-08-09T12:39:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.434+0000 7f8736912640 1 -- start start 2023-08-09T12:39:21.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.435+0000 7f8736912640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8730161280 0x7f87300c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.435+0000 7f8736912640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8730161660 0x7f87300ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.435+0000 7f8736912640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f87300acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.435+0000 7f8736912640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873015d430 con 0x7f8730161660 2023-08-09T12:39:21.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.435+0000 7f8736912640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873015df30 con 0x7f8730161280 2023-08-09T12:39:21.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.435+0000 7f8736912640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87300ca9d0 con 0x7f87300ca450 2023-08-09T12:39:21.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.435+0000 7f872f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8730161660 0x7f87300ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8730161660 0x7f87300ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42168/0 (socket says 172.21.15.17:42168) 2023-08-09T12:39:21.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872f7fe640 1 -- 172.21.15.17:0/442019813 learned_addr learned my addr 172.21.15.17:0/442019813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:21.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872ffff640 1 --2- 172.21.15.17:0/442019813 >> v2:172.21.15.142:3300/0 conn(0x7f8730161280 0x7f87300c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f8734eaf640 1 --2- 172.21.15.17:0/442019813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f87300acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872f7fe640 1 -- 172.21.15.17:0/442019813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 msgr2=0x7f87300acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:21.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872f7fe640 1 --2- 172.21.15.17:0/442019813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f87300acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872f7fe640 1 -- 172.21.15.17:0/442019813 >> v2:172.21.15.142:3300/0 conn(0x7f8730161280 msgr2=0x7f87300c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:21.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872f7fe640 1 --2- 172.21.15.17:0/442019813 >> v2:172.21.15.142:3300/0 conn(0x7f8730161280 0x7f87300c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872f7fe640 1 -- 172.21.15.17:0/442019813 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873015e3c0 con 0x7f8730161660 2023-08-09T12:39:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f872ffff640 1 --2- 172.21.15.17:0/442019813 >> v2:172.21.15.142:3300/0 conn(0x7f8730161280 0x7f87300c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.436+0000 7f8734eaf640 1 --2- 172.21.15.17:0/442019813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f87300acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.437+0000 7f872f7fe640 1 --2- 172.21.15.17:0/442019813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ac8b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f87300ad990 tx=0x7f872402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cc36fe632f39c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.437+0000 7f872effd640 1 -- 172.21.15.17:0/442019813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724004030 con 0x7f8730161660 2023-08-09T12:39:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f872effd640 1 -- 172.21.15.17:0/442019813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724004190 con 0x7f8730161660 2023-08-09T12:39:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f872effd640 1 -- 172.21.15.17:0/442019813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724003610 con 0x7f8730161660 2023-08-09T12:39:21.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 -- 172.21.15.17:0/442019813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 msgr2=0x7f87300ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 --2- 172.21.15.17:0/442019813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ac8b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f87300ad990 tx=0x7f872402b7c0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 -- 172.21.15.17:0/442019813 shutdown_connections 2023-08-09T12:39:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 --2- 172.21.15.17:0/442019813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f87300acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 --2- 172.21.15.17:0/442019813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ac8b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 --2- 172.21.15.17:0/442019813 >> v2:172.21.15.142:3300/0 conn(0x7f8730161280 0x7f87300c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 -- 172.21.15.17:0/442019813 >> 172.21.15.17:0/442019813 conn(0x7f87300cb1b0 msgr2=0x7f87300cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 -- 172.21.15.17:0/442019813 shutdown_connections 2023-08-09T12:39:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.438+0000 7f8736912640 1 -- 172.21.15.17:0/442019813 wait complete. 2023-08-09T12:39:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.440+0000 7f8736912640 1 Processor -- start 2023-08-09T12:39:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.440+0000 7f8736912640 1 -- start start 2023-08-09T12:39:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.441+0000 7f8736912640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f873014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.441+0000 7f8736912640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8730161280 0x7f87300cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.441+0000 7f8736912640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.441+0000 7f8736912640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87301560b0 con 0x7f8730161660 2023-08-09T12:39:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.441+0000 7f8736912640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8730155ac0 con 0x7f8730161280 2023-08-09T12:39:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.441+0000 7f8736912640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87300c3140 con 0x7f87300ca450 2023-08-09T12:39:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.441+0000 7f8734eaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f8734eaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42174/0 (socket says 172.21.15.17:42174) 2023-08-09T12:39:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f8734eaf640 1 -- 172.21.15.17:0/3666275779 learned_addr learned my addr 172.21.15.17:0/3666275779 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f872ffff640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f873014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f872f7fe640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8730161280 0x7f87300cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f8734eaf640 1 -- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 msgr2=0x7f873014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f8734eaf640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f873014fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f8734eaf640 1 -- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8730161280 msgr2=0x7f87300cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f8734eaf640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8730161280 0x7f87300cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f8734eaf640 1 -- 172.21.15.17:0/3666275779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724009460 con 0x7f8730161660 2023-08-09T12:39:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.442+0000 7f8734eaf640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ccb70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f872800cd10 tx=0x7f872800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.443+0000 7f872cff9640 1 -- 172.21.15.17:0/3666275779 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800f680 con 0x7f8730161660 2023-08-09T12:39:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.443+0000 7f872cff9640 1 -- 172.21.15.17:0/3666275779 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872800f800 con 0x7f8730161660 2023-08-09T12:39:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.443+0000 7f872cff9640 1 -- 172.21.15.17:0/3666275779 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800fbb0 con 0x7f8730161660 2023-08-09T12:39:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.443+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87301503d0 con 0x7f8730161660 2023-08-09T12:39:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.443+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8730155500 con 0x7f8730161660 2023-08-09T12:39:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.444+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87301561f0 con 0x7f8730161660 2023-08-09T12:39:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.445+0000 7f872cff9640 1 -- 172.21.15.17:0/3666275779 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f872800b040 con 0x7f8730161660 2023-08-09T12:39:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.446+0000 7f872cff9640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871c06a050 0x7f871c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.446+0000 7f872cff9640 1 -- 172.21.15.17:0/3666275779 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8728088c80 con 0x7f8730161660 2023-08-09T12:39:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.447+0000 7f872ffff640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871c06a050 0x7f871c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.448+0000 7f872ffff640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871c06a050 0x7f871c06c510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87300698c0 tx=0x7f8720008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:21.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.451+0000 7f872cff9640 1 -- 172.21.15.17:0/3666275779 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f87301561f0 con 0x7f8730161660 2023-08-09T12:39:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.648+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87301561f0 con 0x7f8730161660 2023-08-09T12:39:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.650+0000 7f872cff9640 1 -- 172.21.15.17:0/3666275779 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14612 (secure 0 0 0) 0x7f87301561f0 con 0x7f8730161660 2023-08-09T12:39:21.652 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:21.652 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:20.285431+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871c06a050 msgr2=0x7f871c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871c06a050 0x7f871c06c510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87300698c0 tx=0x7f8720008040 comp rx=0 tx=0).stop 2023-08-09T12:39:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 msgr2=0x7f87300ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ccb70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f872800cd10 tx=0x7f872800a650 comp rx=0 tx=0).stop 2023-08-09T12:39:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 shutdown_connections 2023-08-09T12:39:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871c06a050 0x7f871c06c510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8730161660 0x7f87300ccb70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8730161280 0x7f87300cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 --2- 172.21.15.17:0/3666275779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ca450 0x7f873014fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 >> 172.21.15.17:0/3666275779 conn(0x7f87300cb1b0 msgr2=0x7f87300c99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 shutdown_connections 2023-08-09T12:39:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.652+0000 7f8736912640 1 -- 172.21.15.17:0/3666275779 wait complete. 2023-08-09T12:39:21.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:39:21.674 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:39:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.888+0000 7ff14e917640 1 Processor -- start 2023-08-09T12:39:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.889+0000 7ff14e917640 1 -- start start 2023-08-09T12:39:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.890+0000 7ff14e917640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 0x7ff1480b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.890+0000 7ff14e917640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff1480b13f0 0x7ff14815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.890+0000 7ff14e917640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14815e7b0 con 0x7ff14815f180 2023-08-09T12:39:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.890+0000 7ff14e917640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1480b1850 con 0x7ff1480b13f0 2023-08-09T12:39:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.890+0000 7ff14e917640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14815e460 con 0x7ff14815a8c0 2023-08-09T12:39:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.891+0000 7ff14d114640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff1480b13f0 0x7ff14815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.891+0000 7ff14d114640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff1480b13f0 0x7ff14815ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42184/0 (socket says 172.21.15.17:42184) 2023-08-09T12:39:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.891+0000 7ff14d114640 1 -- 172.21.15.17:0/2799799750 learned_addr learned my addr 172.21.15.17:0/2799799750 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.891+0000 7ff14d915640 1 --2- 172.21.15.17:0/2799799750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 0x7ff1480b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.891+0000 7ff14d114640 1 -- 172.21.15.17:0/2799799750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 msgr2=0x7ff1480b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.891+0000 7ff14d114640 1 --2- 172.21.15.17:0/2799799750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 0x7ff1480b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.891+0000 7ff14d114640 1 -- 172.21.15.17:0/2799799750 >> v1:172.21.15.142:6789/0 conn(0x7ff14815f180 legacy=0x7ff1480b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.891+0000 7ff14d114640 1 -- 172.21.15.17:0/2799799750 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14815aca0 con 0x7ff1480b13f0 2023-08-09T12:39:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.892+0000 7ff14d114640 1 --2- 172.21.15.17:0/2799799750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff14815ec40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff138009870 tx=0x7ff13802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c98e829e32ab57 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.893+0000 7ff14c913640 1 -- 172.21.15.17:0/2799799750 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138030840 con 0x7ff1480b13f0 2023-08-09T12:39:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.893+0000 7ff14c913640 1 -- 172.21.15.17:0/2799799750 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1380309a0 con 0x7ff1480b13f0 2023-08-09T12:39:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.893+0000 7ff14c913640 1 -- 172.21.15.17:0/2799799750 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138030d30 con 0x7ff1480b13f0 2023-08-09T12:39:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.893+0000 7ff14e917640 1 -- 172.21.15.17:0/2799799750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 msgr2=0x7ff14815ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.893+0000 7ff14e917640 1 --2- 172.21.15.17:0/2799799750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff14815ec40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff138009870 tx=0x7ff13802b980 comp rx=0 tx=0).stop 2023-08-09T12:39:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.894+0000 7ff14e917640 1 -- 172.21.15.17:0/2799799750 shutdown_connections 2023-08-09T12:39:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.894+0000 7ff14e917640 1 --2- 172.21.15.17:0/2799799750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff14815ec40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.894+0000 7ff14e917640 1 --2- 172.21.15.17:0/2799799750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 0x7ff1480b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.894+0000 7ff14e917640 1 -- 172.21.15.17:0/2799799750 >> 172.21.15.17:0/2799799750 conn(0x7ff1480cb020 msgr2=0x7ff1480cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.894+0000 7ff14e917640 1 -- 172.21.15.17:0/2799799750 shutdown_connections 2023-08-09T12:39:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.894+0000 7ff14e917640 1 -- 172.21.15.17:0/2799799750 wait complete. 2023-08-09T12:39:21.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.896+0000 7ff14e917640 1 Processor -- start 2023-08-09T12:39:21.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.896+0000 7ff14e917640 1 -- start start 2023-08-09T12:39:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14e917640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff1481f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14e917640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 0x7ff14815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14e917640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff14815f180 0x7ff14815b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14e917640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff148150f80 con 0x7ff1480b13f0 2023-08-09T12:39:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14e917640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff148151260 con 0x7ff14815f180 2023-08-09T12:39:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14e917640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff148151540 con 0x7ff14815a8c0 2023-08-09T12:39:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d915640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff1481f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d915640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff1481f1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42200/0 (socket says 172.21.15.17:42200) 2023-08-09T12:39:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d915640 1 -- 172.21.15.17:0/4012927408 learned_addr learned my addr 172.21.15.17:0/4012927408 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d114640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 0x7ff14815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14e116640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff14815f180 0x7ff14815b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d915640 1 -- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 msgr2=0x7ff14815aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d915640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 0x7ff14815aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d915640 1 -- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff14815f180 msgr2=0x7ff14815b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d915640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff14815f180 0x7ff14815b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.897+0000 7ff14d915640 1 -- 172.21.15.17:0/4012927408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380094d0 con 0x7ff1480b13f0 2023-08-09T12:39:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.898+0000 7ff14d915640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff1481f1910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff14400d800 tx=0x7ff14400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.898+0000 7ff13e7fc640 1 -- 172.21.15.17:0/4012927408 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14400b6c0 con 0x7ff1480b13f0 2023-08-09T12:39:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.898+0000 7ff13e7fc640 1 -- 172.21.15.17:0/4012927408 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400b820 con 0x7ff1480b13f0 2023-08-09T12:39:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.898+0000 7ff13e7fc640 1 -- 172.21.15.17:0/4012927408 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14400bbb0 con 0x7ff1480b13f0 2023-08-09T12:39:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.898+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff148151820 con 0x7ff1480b13f0 2023-08-09T12:39:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.898+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14815bbb0 con 0x7ff1480b13f0 2023-08-09T12:39:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.899+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14815bd40 con 0x7ff1480b13f0 2023-08-09T12:39:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.900+0000 7ff13e7fc640 1 -- 172.21.15.17:0/4012927408 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff14400bd10 con 0x7ff1480b13f0 2023-08-09T12:39:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.901+0000 7ff13e7fc640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff12c06a080 0x7ff12c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:21.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.901+0000 7ff13e7fc640 1 -- 172.21.15.17:0/4012927408 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff144088810 con 0x7ff1480b13f0 2023-08-09T12:39:21.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.902+0000 7ff14d114640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff12c06a080 0x7ff12c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:21.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.903+0000 7ff14d114640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff12c06a080 0x7ff12c06c540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff138036000 tx=0x7ff138008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:21.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:21.905+0000 7ff13e7fc640 1 -- 172.21.15.17:0/4012927408 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff1440541b0 con 0x7ff1480b13f0 2023-08-09T12:39:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.102+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff14804e390 con 0x7ff1480b13f0 2023-08-09T12:39:22.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.103+0000 7ff13e7fc640 1 -- 172.21.15.17:0/4012927408 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1440577d0 con 0x7ff1480b13f0 2023-08-09T12:39:22.105 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:39:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff12c06a080 msgr2=0x7ff12c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff12c06a080 0x7ff12c06c540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff138036000 tx=0x7ff138008030 comp rx=0 tx=0).stop 2023-08-09T12:39:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 msgr2=0x7ff1481f1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff1481f1910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff14400d800 tx=0x7ff14400dcc0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 shutdown_connections 2023-08-09T12:39:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff12c06a080 0x7ff12c06c540 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff14815f180 0x7ff14815b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff14815a8c0 0x7ff14815aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 --2- 172.21.15.17:0/4012927408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1480b13f0 0x7ff1481f1910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 >> 172.21.15.17:0/4012927408 conn(0x7ff1480cb020 msgr2=0x7ff1480b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 shutdown_connections 2023-08-09T12:39:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.105+0000 7ff14e917640 1 -- 172.21.15.17:0/4012927408 wait complete. 2023-08-09T12:39:22.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:39:22.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.344+0000 7f5247fff640 1 Processor -- start 2023-08-09T12:39:22.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.345+0000 7f5247fff640 1 -- start start 2023-08-09T12:39:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.346+0000 7f5247fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f52480d1e20 0x7f52480d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.346+0000 7f5247fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480b5de0 0x7f52480b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.346+0000 7f5247fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5248070ab0 con 0x7f524815caf0 2023-08-09T12:39:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.346+0000 7f5247fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52480d1a80 con 0x7f52480d1e20 2023-08-09T12:39:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.346+0000 7f5247fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52480d27d0 con 0x7f52480b5de0 2023-08-09T12:39:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f52467fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f52480d1e20 0x7f52480d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f5246ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f524815caf0 0x7f52480703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35198/0 (socket says 172.21.15.17:35198) 2023-08-09T12:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f5246ffd640 1 -- 172.21.15.17:0/1238341978 learned_addr learned my addr 172.21.15.17:0/1238341978 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f52477fe640 1 --2- 172.21.15.17:0/1238341978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480b5de0 0x7f52480b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f52467fc640 1 -- 172.21.15.17:0/1238341978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480b5de0 msgr2=0x7f52480b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f52467fc640 1 --2- 172.21.15.17:0/1238341978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480b5de0 0x7f52480b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f52467fc640 1 -- 172.21.15.17:0/1238341978 >> v1:172.21.15.17:6789/0 conn(0x7f524815caf0 legacy=0x7f52480703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f52467fc640 1 -- 172.21.15.17:0/1238341978 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480d0f00 con 0x7f52480d1e20 2023-08-09T12:39:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.347+0000 7f5245ffb640 1 -- 172.21.15.17:0/1238341978 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997612561 0 0) 0x7f5248070ab0 con 0x7f524815caf0 2023-08-09T12:39:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.348+0000 7f52467fc640 1 --2- 172.21.15.17:0/1238341978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480d1e20 0x7f52480d2290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097d0 tx=0x7f523c02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361f2ed019f8b2f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5245ffb640 1 -- 172.21.15.17:0/1238341978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c031890 con 0x7f52480d1e20 2023-08-09T12:39:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5245ffb640 1 -- 172.21.15.17:0/1238341978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0319f0 con 0x7f52480d1e20 2023-08-09T12:39:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5245ffb640 1 -- 172.21.15.17:0/1238341978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c031d80 con 0x7f52480d1e20 2023-08-09T12:39:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5247fff640 1 -- 172.21.15.17:0/1238341978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480d1e20 msgr2=0x7f52480d2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5247fff640 1 --2- 172.21.15.17:0/1238341978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480d1e20 0x7f52480d2290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097d0 tx=0x7f523c02b930 comp rx=0 tx=0).stop 2023-08-09T12:39:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5247fff640 1 -- 172.21.15.17:0/1238341978 shutdown_connections 2023-08-09T12:39:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5247fff640 1 --2- 172.21.15.17:0/1238341978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480b5de0 0x7f52480b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5247fff640 1 --2- 172.21.15.17:0/1238341978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480d1e20 0x7f52480d2290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5247fff640 1 -- 172.21.15.17:0/1238341978 >> 172.21.15.17:0/1238341978 conn(0x7f52480cf6b0 msgr2=0x7f52480cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5247fff640 1 -- 172.21.15.17:0/1238341978 shutdown_connections 2023-08-09T12:39:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.349+0000 7f5247fff640 1 -- 172.21.15.17:0/1238341978 wait complete. 2023-08-09T12:39:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.351+0000 7f5247fff640 1 Processor -- start 2023-08-09T12:39:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.351+0000 7f5247fff640 1 -- start start 2023-08-09T12:39:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.352+0000 7f5247fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480b5de0 0x7f524814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.352+0000 7f5247fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480d1e20 0x7f524814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.352+0000 7f5247fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524815caf0 0x7f52480cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.352+0000 7f5247fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524815dbf0 con 0x7f52480b5de0 2023-08-09T12:39:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.352+0000 7f5247fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524814d620 con 0x7f524815caf0 2023-08-09T12:39:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.352+0000 7f5247fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524814e000 con 0x7f52480d1e20 2023-08-09T12:39:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f5246ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480b5de0 0x7f524814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f5246ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480b5de0 0x7f524814d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42222/0 (socket says 172.21.15.17:42222) 2023-08-09T12:39:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f5246ffd640 1 -- 172.21.15.17:0/3213275784 learned_addr learned my addr 172.21.15.17:0/3213275784 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f5246ffd640 1 -- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480d1e20 msgr2=0x7f524814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f5246ffd640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480d1e20 0x7f524814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f52477fe640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524815caf0 0x7f52480cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f5246ffd640 1 -- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524815caf0 msgr2=0x7f52480cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f5246ffd640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524815caf0 0x7f52480cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.353+0000 7f5246ffd640 1 -- 172.21.15.17:0/3213275784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009400 con 0x7f52480b5de0 2023-08-09T12:39:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.354+0000 7f5246ffd640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480b5de0 0x7f524814d0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f523800c7c0 tx=0x7f523800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.354+0000 7f522ffff640 1 -- 172.21.15.17:0/3213275784 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523800a640 con 0x7f52480b5de0 2023-08-09T12:39:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.354+0000 7f522ffff640 1 -- 172.21.15.17:0/3213275784 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523800a7c0 con 0x7f52480b5de0 2023-08-09T12:39:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.354+0000 7f522ffff640 1 -- 172.21.15.17:0/3213275784 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523800ab70 con 0x7f52480b5de0 2023-08-09T12:39:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.354+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524815cf70 con 0x7f52480b5de0 2023-08-09T12:39:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.354+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524815d530 con 0x7f52480b5de0 2023-08-09T12:39:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.355+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524815dd30 con 0x7f52480b5de0 2023-08-09T12:39:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.356+0000 7f522ffff640 1 -- 172.21.15.17:0/3213275784 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f523800acd0 con 0x7f52480b5de0 2023-08-09T12:39:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.358+0000 7f522ffff640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f523406a050 0x7f523406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.358+0000 7f522ffff640 1 -- 172.21.15.17:0/3213275784 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5238087800 con 0x7f52480b5de0 2023-08-09T12:39:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.359+0000 7f52467fc640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f523406a050 0x7f523406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.360+0000 7f52467fc640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f523406a050 0x7f523406c510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f523c036000 tx=0x7f523c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:22.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.362+0000 7f522ffff640 1 -- 172.21.15.17:0/3213275784 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f524815dd30 con 0x7f52480b5de0 2023-08-09T12:39:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.554+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f524815dd30 con 0x7f52480b5de0 2023-08-09T12:39:22.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.555+0000 7f522ffff640 1 -- 172.21.15.17:0/3213275784 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f524815dd30 con 0x7f52480b5de0 2023-08-09T12:39:22.558 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:39:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.557+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f523406a050 msgr2=0x7f523406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.557+0000 7f5247fff640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f523406a050 0x7f523406c510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f523c036000 tx=0x7f523c030000 comp rx=0 tx=0).stop 2023-08-09T12:39:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.557+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480b5de0 msgr2=0x7f524814d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.557+0000 7f5247fff640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480b5de0 0x7f524814d0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f523800c7c0 tx=0x7f523800cc80 comp rx=0 tx=0).stop 2023-08-09T12:39:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.558+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 shutdown_connections 2023-08-09T12:39:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.558+0000 7f5247fff640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f523406a050 0x7f523406c510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.558+0000 7f5247fff640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524815caf0 0x7f52480cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.558+0000 7f5247fff640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52480d1e20 0x7f524814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.558+0000 7f5247fff640 1 --2- 172.21.15.17:0/3213275784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52480b5de0 0x7f524814d0e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.558+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 >> 172.21.15.17:0/3213275784 conn(0x7f52480cf6b0 msgr2=0x7f52480c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.558+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 shutdown_connections 2023-08-09T12:39:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.558+0000 7f5247fff640 1 -- 172.21.15.17:0/3213275784 wait complete. 2023-08-09T12:39:22.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:39:22.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.803+0000 7f016f46a640 1 Processor -- start 2023-08-09T12:39:22.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.803+0000 7f016f46a640 1 -- start start 2023-08-09T12:39:22.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.804+0000 7f016f46a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0168160030 0x7f0168160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.804+0000 7f016f46a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01680cfb50 0x7f01680d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016f46a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680b5a30 con 0x7f01680b86e0 2023-08-09T12:39:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016f46a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680d1110 con 0x7f0168160030 2023-08-09T12:39:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016f46a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680ceac0 con 0x7f01680cfb50 2023-08-09T12:39:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016e468640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0168160030 0x7f0168160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016e468640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0168160030 0x7f0168160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42236/0 (socket says 172.21.15.17:42236) 2023-08-09T12:39:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016e468640 1 -- 172.21.15.17:0/584757818 learned_addr learned my addr 172.21.15.17:0/584757818 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016e468640 1 -- 172.21.15.17:0/584757818 >> v2:172.21.15.142:3300/0 conn(0x7f01680cfb50 msgr2=0x7f01680d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016ec69640 1 --2- 172.21.15.17:0/584757818 >> v2:172.21.15.142:3300/0 conn(0x7f01680cfb50 0x7f01680d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016e468640 1 --2- 172.21.15.17:0/584757818 >> v2:172.21.15.142:3300/0 conn(0x7f01680cfb50 0x7f01680d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016e468640 1 -- 172.21.15.17:0/584757818 >> v1:172.21.15.17:6789/0 conn(0x7f01680b86e0 legacy=0x7f01680cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016e468640 1 -- 172.21.15.17:0/584757818 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680d0d70 con 0x7f0168160030 2023-08-09T12:39:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.805+0000 7f016ec69640 1 --2- 172.21.15.17:0/584757818 >> v2:172.21.15.142:3300/0 conn(0x7f01680cfb50 0x7f01680d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.807+0000 7f016e468640 1 --2- 172.21.15.17:0/584757818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0168160030 0x7f0168160740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f016806b980 tx=0x7f016402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c1a899c344a435 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.807+0000 7f016d466640 1 -- 172.21.15.17:0/584757818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016402cb20 con 0x7f0168160030 2023-08-09T12:39:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.807+0000 7f016d466640 1 -- 172.21.15.17:0/584757818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016402cc80 con 0x7f0168160030 2023-08-09T12:39:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.807+0000 7f016d466640 1 -- 172.21.15.17:0/584757818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640343f0 con 0x7f0168160030 2023-08-09T12:39:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.808+0000 7f016f46a640 1 -- 172.21.15.17:0/584757818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0168160030 msgr2=0x7f0168160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.808+0000 7f016f46a640 1 --2- 172.21.15.17:0/584757818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0168160030 0x7f0168160740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f016806b980 tx=0x7f016402bf80 comp rx=0 tx=0).stop 2023-08-09T12:39:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.808+0000 7f016f46a640 1 -- 172.21.15.17:0/584757818 shutdown_connections 2023-08-09T12:39:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.808+0000 7f016f46a640 1 --2- 172.21.15.17:0/584757818 >> v2:172.21.15.142:3300/0 conn(0x7f01680cfb50 0x7f01680d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.808+0000 7f016f46a640 1 --2- 172.21.15.17:0/584757818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0168160030 0x7f0168160740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.808+0000 7f016f46a640 1 -- 172.21.15.17:0/584757818 >> 172.21.15.17:0/584757818 conn(0x7f01680697c0 msgr2=0x7f0168069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.808+0000 7f016f46a640 1 -- 172.21.15.17:0/584757818 shutdown_connections 2023-08-09T12:39:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.808+0000 7f016f46a640 1 -- 172.21.15.17:0/584757818 wait complete. 2023-08-09T12:39:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.810+0000 7f016f46a640 1 Processor -- start 2023-08-09T12:39:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.810+0000 7f016f46a640 1 -- start start 2023-08-09T12:39:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.811+0000 7f016f46a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b86e0 0x7f016814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.811+0000 7f016f46a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680cfb50 0x7f01680cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.811+0000 7f016f46a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0168160030 0x7f01680c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.811+0000 7f016f46a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680cbab0 con 0x7f01680cfb50 2023-08-09T12:39:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.811+0000 7f016f46a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016814f9b0 con 0x7f0168160030 2023-08-09T12:39:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.811+0000 7f016f46a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680cc2d0 con 0x7f01680b86e0 2023-08-09T12:39:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.811+0000 7f016dc67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680cfb50 0x7f01680cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016dc67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680cfb50 0x7f01680cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42240/0 (socket says 172.21.15.17:42240) 2023-08-09T12:39:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016dc67640 1 -- 172.21.15.17:0/3646272602 learned_addr learned my addr 172.21.15.17:0/3646272602 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016e468640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b86e0 0x7f016814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016ec69640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0168160030 0x7f01680c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016dc67640 1 -- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b86e0 msgr2=0x7f016814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016dc67640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b86e0 0x7f016814ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016dc67640 1 -- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0168160030 msgr2=0x7f01680c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016dc67640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0168160030 0x7f01680c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016dc67640 1 -- 172.21.15.17:0/3646272602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164009b30 con 0x7f01680cfb50 2023-08-09T12:39:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016ec69640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0168160030 0x7f01680c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016e468640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b86e0 0x7f016814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.812+0000 7f016dc67640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680cfb50 0x7f01680cb570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f015800c4d0 tx=0x7f015800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.813+0000 7f015effd640 1 -- 172.21.15.17:0/3646272602 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01580052d0 con 0x7f01680cfb50 2023-08-09T12:39:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.813+0000 7f015effd640 1 -- 172.21.15.17:0/3646272602 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158005430 con 0x7f01680cfb50 2023-08-09T12:39:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.813+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01680cbd10 con 0x7f01680cfb50 2023-08-09T12:39:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.813+0000 7f015effd640 1 -- 172.21.15.17:0/3646272602 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158012850 con 0x7f01680cfb50 2023-08-09T12:39:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.813+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01680a9460 con 0x7f01680cfb50 2023-08-09T12:39:22.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.814+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01680d0380 con 0x7f01680cfb50 2023-08-09T12:39:22.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.815+0000 7f015effd640 1 -- 172.21.15.17:0/3646272602 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f01580129b0 con 0x7f01680cfb50 2023-08-09T12:39:22.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.816+0000 7f015effd640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014c06a050 0x7f014c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:22.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.816+0000 7f015effd640 1 -- 172.21.15.17:0/3646272602 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0158087e00 con 0x7f01680cfb50 2023-08-09T12:39:22.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.816+0000 7f016e468640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014c06a050 0x7f014c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:22.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.817+0000 7f016e468640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014c06a050 0x7f014c06c510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0164035000 tx=0x7f0164030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:22.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:22.820+0000 7f015effd640 1 -- 172.21.15.17:0/3646272602 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f01580537a0 con 0x7f01680cfb50 2023-08-09T12:39:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.016+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f016804e390 con 0x7f01680cfb50 2023-08-09T12:39:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.017+0000 7f015effd640 1 -- 172.21.15.17:0/3646272602 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0158056dc0 con 0x7f01680cfb50 2023-08-09T12:39:23.020 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:23.020 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:39:23.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:39:23.021 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:39:23.021 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:39:23.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:39:23.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:39:23.021 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:39:23.021 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:39:23.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:39:23.022 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:39:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014c06a050 msgr2=0x7f014c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014c06a050 0x7f014c06c510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0164035000 tx=0x7f0164030000 comp rx=0 tx=0).stop 2023-08-09T12:39:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680cfb50 msgr2=0x7f01680cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680cfb50 0x7f01680cb570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f015800c4d0 tx=0x7f015800c990 comp rx=0 tx=0).stop 2023-08-09T12:39:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 shutdown_connections 2023-08-09T12:39:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014c06a050 0x7f014c06c510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0168160030 0x7f01680c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680cfb50 0x7f01680cb570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 --2- 172.21.15.17:0/3646272602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b86e0 0x7f016814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 >> 172.21.15.17:0/3646272602 conn(0x7f01680697c0 msgr2=0x7f01680c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 shutdown_connections 2023-08-09T12:39:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.020+0000 7f016f46a640 1 -- 172.21.15.17:0/3646272602 wait complete. 2023-08-09T12:39:23.043 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:39:23.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:39:23.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.276+0000 7f03da6cd640 1 Processor -- start 2023-08-09T12:39:23.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.276+0000 7f03da6cd640 1 -- start start 2023-08-09T12:39:23.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.278+0000 7f03da6cd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03d40b3dd0 0x7f03d40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.278+0000 7f03da6cd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f03d40b41b0 0x7f03d415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.278+0000 7f03da6cd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d40b18b0 con 0x7f03d415f0e0 2023-08-09T12:39:23.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.278+0000 7f03da6cd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d40b1b10 con 0x7f03d40b41b0 2023-08-09T12:39:23.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.278+0000 7f03da6cd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d40b1df0 con 0x7f03d40b3dd0 2023-08-09T12:39:23.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.278+0000 7f03d9ecc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f03d415f0e0 0x7f03d40affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35212/0 (socket says 172.21.15.17:35212) 2023-08-09T12:39:23.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.278+0000 7f03d9ecc640 1 -- 172.21.15.17:0/132903833 learned_addr learned my addr 172.21.15.17:0/132903833 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:23.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.278+0000 7f03d8eca640 1 --2- 172.21.15.17:0/132903833 >> v2:172.21.15.17:3300/0 conn(0x7f03d40b41b0 0x7f03d415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.279+0000 7f03d96cb640 1 --2- 172.21.15.17:0/132903833 >> v2:172.21.15.142:3300/0 conn(0x7f03d40b3dd0 0x7f03d40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.279+0000 7f03cbfff640 1 -- 172.21.15.17:0/132903833 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254668147 0 0) 0x7f03d40b18b0 con 0x7f03d415f0e0 2023-08-09T12:39:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.279+0000 7f03cbfff640 1 -- 172.21.15.17:0/132903833 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c0003520 con 0x7f03d415f0e0 2023-08-09T12:39:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.279+0000 7f03d8eca640 1 -- 172.21.15.17:0/132903833 >> v2:172.21.15.142:3300/0 conn(0x7f03d40b3dd0 msgr2=0x7f03d40b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.279+0000 7f03d8eca640 1 --2- 172.21.15.17:0/132903833 >> v2:172.21.15.142:3300/0 conn(0x7f03d40b3dd0 0x7f03d40b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.279+0000 7f03cbfff640 1 -- 172.21.15.17:0/132903833 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1474171696 0 0) 0x7f03c0003520 con 0x7f03d415f0e0 2023-08-09T12:39:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.279+0000 7f03d8eca640 1 -- 172.21.15.17:0/132903833 >> v1:172.21.15.17:6789/0 conn(0x7f03d415f0e0 legacy=0x7f03d40affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.279+0000 7f03d8eca640 1 -- 172.21.15.17:0/132903833 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d40b20d0 con 0x7f03d40b41b0 2023-08-09T12:39:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.280+0000 7f03d8eca640 1 --2- 172.21.15.17:0/132903833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b41b0 0x7f03d415eba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03c40097a0 tx=0x7f03c402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807f7230dc4822de server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03cbfff640 1 -- 172.21.15.17:0/132903833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0019f0 con 0x7f03d40b41b0 2023-08-09T12:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03cbfff640 1 -- 172.21.15.17:0/132903833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c402e050 con 0x7f03d40b41b0 2023-08-09T12:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03cbfff640 1 -- 172.21.15.17:0/132903833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4030710 con 0x7f03d40b41b0 2023-08-09T12:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03da6cd640 1 -- 172.21.15.17:0/132903833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b41b0 msgr2=0x7f03d415eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03da6cd640 1 --2- 172.21.15.17:0/132903833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b41b0 0x7f03d415eba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03c40097a0 tx=0x7f03c402b710 comp rx=0 tx=0).stop 2023-08-09T12:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03da6cd640 1 -- 172.21.15.17:0/132903833 shutdown_connections 2023-08-09T12:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03da6cd640 1 --2- 172.21.15.17:0/132903833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b41b0 0x7f03d415eba0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03da6cd640 1 --2- 172.21.15.17:0/132903833 >> v2:172.21.15.142:3300/0 conn(0x7f03d40b3dd0 0x7f03d40b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03da6cd640 1 -- 172.21.15.17:0/132903833 >> 172.21.15.17:0/132903833 conn(0x7f03d40cafa0 msgr2=0x7f03d40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03da6cd640 1 -- 172.21.15.17:0/132903833 shutdown_connections 2023-08-09T12:39:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.281+0000 7f03da6cd640 1 -- 172.21.15.17:0/132903833 wait complete. 2023-08-09T12:39:23.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.283+0000 7f03da6cd640 1 Processor -- start 2023-08-09T12:39:23.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.283+0000 7f03da6cd640 1 -- start start 2023-08-09T12:39:23.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.284+0000 7f03da6cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b3dd0 0x7f03d41f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.284+0000 7f03da6cd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03d40b41b0 0x7f03d4153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.284+0000 7f03da6cd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03d415f0e0 0x7f03d40c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.284+0000 7f03da6cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4154380 con 0x7f03d40b3dd0 2023-08-09T12:39:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.284+0000 7f03da6cd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d40c35e0 con 0x7f03d415f0e0 2023-08-09T12:39:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.284+0000 7f03da6cd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d41545b0 con 0x7f03d40b41b0 2023-08-09T12:39:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b3dd0 0x7f03d41f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b3dd0 0x7f03d41f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42256/0 (socket says 172.21.15.17:42256) 2023-08-09T12:39:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 -- 172.21.15.17:0/3863998620 learned_addr learned my addr 172.21.15.17:0/3863998620 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d8eca640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03d40b41b0 0x7f03d4153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d9ecc640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03d415f0e0 0x7f03d40c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 -- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03d40b41b0 msgr2=0x7f03d4153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03d40b41b0 0x7f03d4153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 -- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03d415f0e0 msgr2=0x7f03d40c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03d415f0e0 0x7f03d40c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 -- 172.21.15.17:0/3863998620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4009400 con 0x7f03d40b3dd0 2023-08-09T12:39:23.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d9ecc640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03d415f0e0 0x7f03d40c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.285+0000 7f03d96cb640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b3dd0 0x7f03d41f6550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03d000e9b0 tx=0x7f03d000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.286+0000 7f03c9ffb640 1 -- 172.21.15.17:0/3863998620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0009670 con 0x7f03d40b3dd0 2023-08-09T12:39:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.286+0000 7f03c9ffb640 1 -- 172.21.15.17:0/3863998620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d000c9a0 con 0x7f03d40b3dd0 2023-08-09T12:39:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.286+0000 7f03c9ffb640 1 -- 172.21.15.17:0/3863998620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d000cd50 con 0x7f03d40b3dd0 2023-08-09T12:39:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.286+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d4154890 con 0x7f03d40b3dd0 2023-08-09T12:39:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.286+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d4154e50 con 0x7f03d40b3dd0 2023-08-09T12:39:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.287+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d404e390 con 0x7f03d40b3dd0 2023-08-09T12:39:23.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.288+0000 7f03c9ffb640 1 -- 172.21.15.17:0/3863998620 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f03d0013470 con 0x7f03d40b3dd0 2023-08-09T12:39:23.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.289+0000 7f03c9ffb640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03b806a050 0x7f03b806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.289+0000 7f03c9ffb640 1 -- 172.21.15.17:0/3863998620 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f03d0088530 con 0x7f03d40b3dd0 2023-08-09T12:39:23.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.289+0000 7f03d8eca640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03b806a050 0x7f03b806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.291+0000 7f03d8eca640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03b806a050 0x7f03b806c510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03c4034000 tx=0x7f03c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:23.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.294+0000 7f03c9ffb640 1 -- 172.21.15.17:0/3863998620 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f03d0053f70 con 0x7f03d40b3dd0 2023-08-09T12:39:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.488+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f03d40b2d70 con 0x7f03d40b3dd0 2023-08-09T12:39:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.602+0000 7f03c9ffb640 1 -- 172.21.15.17:0/3863998620 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f03d0057590 con 0x7f03d40b3dd0 2023-08-09T12:39:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:39:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03b806a050 msgr2=0x7f03b806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03b806a050 0x7f03b806c510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03c4034000 tx=0x7f03c4008030 comp rx=0 tx=0).stop 2023-08-09T12:39:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b3dd0 msgr2=0x7f03d41f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b3dd0 0x7f03d41f6550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03d000e9b0 tx=0x7f03d000ee70 comp rx=0 tx=0).stop 2023-08-09T12:39:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 shutdown_connections 2023-08-09T12:39:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03b806a050 0x7f03b806c510 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03c4034000 tx=0x7f03c4008030 comp rx=0 tx=0).stop 2023-08-09T12:39:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03d415f0e0 0x7f03d40c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03d40b41b0 0x7f03d4153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 --2- 172.21.15.17:0/3863998620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03d40b3dd0 0x7f03d41f6550 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03d000e9b0 tx=0x7f03d000ee70 comp rx=0 tx=0).stop 2023-08-09T12:39:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.608+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 >> 172.21.15.17:0/3863998620 conn(0x7f03d40cafa0 msgr2=0x7f03d40cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.609+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 shutdown_connections 2023-08-09T12:39:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.609+0000 7f03da6cd640 1 -- 172.21.15.17:0/3863998620 wait complete. 2023-08-09T12:39:23.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:39:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.869+0000 7f845b59e640 1 Processor -- start 2023-08-09T12:39:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.869+0000 7f845b59e640 1 -- start start 2023-08-09T12:39:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.870+0000 7f845b59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f845c06ac60 0x7f845c06cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.870+0000 7f845b59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c1578d0 con 0x7f845c1574f0 2023-08-09T12:39:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.870+0000 7f845b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c15a090 con 0x7f845c06a7d0 2023-08-09T12:39:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.870+0000 7f845b59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c159ea0 con 0x7f845c06ac60 2023-08-09T12:39:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.870+0000 7f845a59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f845c1574f0 0x7f845c070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35218/0 (socket says 172.21.15.17:35218) 2023-08-09T12:39:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.870+0000 7f845a59c640 1 -- 172.21.15.17:0/3770986241 learned_addr learned my addr 172.21.15.17:0/3770986241 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.870+0000 7f845ad9d640 1 --2- 172.21.15.17:0/3770986241 >> v2:172.21.15.17:3300/0 conn(0x7f845c06ac60 0x7f845c06cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.871+0000 7f845ad9d640 1 -- 172.21.15.17:0/3770986241 >> v1:172.21.15.142:6789/0 conn(0x7f845c06a7d0 legacy=0x7f845c06c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:23.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.871+0000 7f845ad9d640 1 -- 172.21.15.17:0/3770986241 >> v1:172.21.15.17:6789/0 conn(0x7f845c1574f0 legacy=0x7f845c070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.871+0000 7f845ad9d640 1 -- 172.21.15.17:0/3770986241 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c15a370 con 0x7f845c06ac60 2023-08-09T12:39:23.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.871+0000 7f8459d9b640 1 -- 172.21.15.17:0/3770986241 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687917312 0 0) 0x7f845c1578d0 con 0x7f845c1574f0 2023-08-09T12:39:23.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.872+0000 7f845ad9d640 1 --2- 172.21.15.17:0/3770986241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06ac60 0x7f845c06cfa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84540097a0 tx=0x7f845402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935f3eb656a1e6f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:23.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f8459d9b640 1 -- 172.21.15.17:0/3770986241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454031830 con 0x7f845c06ac60 2023-08-09T12:39:23.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f8459d9b640 1 -- 172.21.15.17:0/3770986241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8454031990 con 0x7f845c06ac60 2023-08-09T12:39:23.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f8459d9b640 1 -- 172.21.15.17:0/3770986241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454031d20 con 0x7f845c06ac60 2023-08-09T12:39:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f845b59e640 1 -- 172.21.15.17:0/3770986241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06ac60 msgr2=0x7f845c06cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f845b59e640 1 --2- 172.21.15.17:0/3770986241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06ac60 0x7f845c06cfa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84540097a0 tx=0x7f845402b8d0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f845b59e640 1 -- 172.21.15.17:0/3770986241 shutdown_connections 2023-08-09T12:39:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f845b59e640 1 --2- 172.21.15.17:0/3770986241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06ac60 0x7f845c06cfa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f845b59e640 1 -- 172.21.15.17:0/3770986241 >> 172.21.15.17:0/3770986241 conn(0x7f845c06fc70 msgr2=0x7f845c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f845b59e640 1 -- 172.21.15.17:0/3770986241 shutdown_connections 2023-08-09T12:39:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.873+0000 7f845b59e640 1 -- 172.21.15.17:0/3770986241 wait complete. 2023-08-09T12:39:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.875+0000 7f845b59e640 1 Processor -- start 2023-08-09T12:39:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.875+0000 7f845b59e640 1 -- start start 2023-08-09T12:39:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.876+0000 7f845b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06a7d0 0x7f845c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.876+0000 7f845b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845c06ac60 0x7f845c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.876+0000 7f845b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845c1574f0 0x7f845c15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.876+0000 7f845b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c154ae0 con 0x7f845c06a7d0 2023-08-09T12:39:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.876+0000 7f845b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1f21a0 con 0x7f845c1574f0 2023-08-09T12:39:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.876+0000 7f845b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c158da0 con 0x7f845c06ac60 2023-08-09T12:39:23.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.876+0000 7f845a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06a7d0 0x7f845c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06a7d0 0x7f845c0cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42266/0 (socket says 172.21.15.17:42266) 2023-08-09T12:39:23.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845a59c640 1 -- 172.21.15.17:0/1243392270 learned_addr learned my addr 172.21.15.17:0/1243392270 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f8451d9b640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845c06ac60 0x7f845c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845a59c640 1 -- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845c06ac60 msgr2=0x7f845c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845a59c640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845c06ac60 0x7f845c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845a59c640 1 -- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845c1574f0 msgr2=0x7f845c15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845ad9d640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845c1574f0 0x7f845c15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845a59c640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845c1574f0 0x7f845c15c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845a59c640 1 -- 172.21.15.17:0/1243392270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454009400 con 0x7f845c06a7d0 2023-08-09T12:39:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f8451d9b640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845c06ac60 0x7f845c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.877+0000 7f845a59c640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06a7d0 0x7f845c0cd5c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f844c00c7c0 tx=0x7f844c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.878+0000 7f84537fe640 1 -- 172.21.15.17:0/1243392270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00a640 con 0x7f845c06a7d0 2023-08-09T12:39:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.878+0000 7f84537fe640 1 -- 172.21.15.17:0/1243392270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00a7c0 con 0x7f845c06a7d0 2023-08-09T12:39:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.878+0000 7f84537fe640 1 -- 172.21.15.17:0/1243392270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00ab70 con 0x7f845c06a7d0 2023-08-09T12:39:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.878+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c159080 con 0x7f845c06a7d0 2023-08-09T12:39:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.878+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c154d30 con 0x7f845c06a7d0 2023-08-09T12:39:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.879+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c04e390 con 0x7f845c06a7d0 2023-08-09T12:39:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.881+0000 7f84537fe640 1 -- 172.21.15.17:0/1243392270 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f844c00acd0 con 0x7f845c06a7d0 2023-08-09T12:39:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.882+0000 7f84537fe640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f843c06a050 0x7f843c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.882+0000 7f84537fe640 1 -- 172.21.15.17:0/1243392270 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f844c087960 con 0x7f845c06a7d0 2023-08-09T12:39:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.882+0000 7f8451d9b640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f843c06a050 0x7f843c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.884+0000 7f8451d9b640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f843c06a050 0x7f843c06c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f845c1f53e0 tx=0x7f8444009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:23.886+0000 7f84537fe640 1 -- 172.21.15.17:0/1243392270 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f844c0532a0 con 0x7f845c06a7d0 2023-08-09T12:39:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.083+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f845c1e4190 con 0x7f845c06a7d0 2023-08-09T12:39:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.610+0000 7f84537fe640 1 -- 172.21.15.17:0/1243392270 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f844c0180d0 con 0x7f845c06a7d0 2023-08-09T12:39:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:39:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.616+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f843c06a050 msgr2=0x7f843c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.616+0000 7f845b59e640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f843c06a050 0x7f843c06c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f845c1f53e0 tx=0x7f8444009040 comp rx=0 tx=0).stop 2023-08-09T12:39:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.616+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06a7d0 msgr2=0x7f845c0cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.616+0000 7f845b59e640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06a7d0 0x7f845c0cd5c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f844c00c7c0 tx=0x7f844c00cc80 comp rx=0 tx=0).stop 2023-08-09T12:39:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.628+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 shutdown_connections 2023-08-09T12:39:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.628+0000 7f845b59e640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f843c06a050 0x7f843c06c510 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.628+0000 7f845b59e640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f845c1574f0 0x7f845c15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.628+0000 7f845b59e640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f845c06ac60 0x7f845c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.628+0000 7f845b59e640 1 --2- 172.21.15.17:0/1243392270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c06a7d0 0x7f845c0cd5c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.628+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 >> 172.21.15.17:0/1243392270 conn(0x7f845c06fc70 msgr2=0x7f845c153940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.630+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 shutdown_connections 2023-08-09T12:39:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.632+0000 7f845b59e640 1 -- 172.21.15.17:0/1243392270 wait complete. 2023-08-09T12:39:24.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:39:24.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.861+0000 7fbe71a38640 1 Processor -- start 2023-08-09T12:39:24.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.861+0000 7fbe71a38640 1 -- start start 2023-08-09T12:39:24.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe71a38640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbe6c1616e0 0x7fbe6c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:24.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe71a38640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:24.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe71a38640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c0cdd10 con 0x7fbe6c15ce90 2023-08-09T12:39:24.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe71a38640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b6540 con 0x7fbe6c1616e0 2023-08-09T12:39:24.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe71a38640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0d33a0 con 0x7fbe6c0d29d0 2023-08-09T12:39:24.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe6a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbe6c1616e0 0x7fbe6c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:24.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe6a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbe6c1616e0 0x7fbe6c0b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42272/0 (socket says 172.21.15.17:42272) 2023-08-09T12:39:24.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe6a7fc640 1 -- 172.21.15.17:0/314658207 learned_addr learned my addr 172.21.15.17:0/314658207 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:24.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.863+0000 7fbe6b7fe640 1 --2- 172.21.15.17:0/314658207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:24.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.864+0000 7fbe6a7fc640 1 -- 172.21.15.17:0/314658207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 msgr2=0x7fbe6c0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:24.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.864+0000 7fbe6a7fc640 1 --2- 172.21.15.17:0/314658207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.864+0000 7fbe6a7fc640 1 -- 172.21.15.17:0/314658207 >> v1:172.21.15.142:6789/0 conn(0x7fbe6c15ce90 legacy=0x7fbe6c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:24.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.864+0000 7fbe6a7fc640 1 -- 172.21.15.17:0/314658207 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0cdff0 con 0x7fbe6c1616e0 2023-08-09T12:39:24.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.865+0000 7fbe6a7fc640 1 --2- 172.21.15.17:0/314658207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c1616e0 0x7fbe6c0b6000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009870 tx=0x7fbe5402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500014f1aabefaf7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:24.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.865+0000 7fbe69ffb640 1 -- 172.21.15.17:0/314658207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54030840 con 0x7fbe6c1616e0 2023-08-09T12:39:24.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.865+0000 7fbe69ffb640 1 -- 172.21.15.17:0/314658207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe540309a0 con 0x7fbe6c1616e0 2023-08-09T12:39:24.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.865+0000 7fbe69ffb640 1 -- 172.21.15.17:0/314658207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54030d30 con 0x7fbe6c1616e0 2023-08-09T12:39:24.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.866+0000 7fbe71a38640 1 -- 172.21.15.17:0/314658207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c1616e0 msgr2=0x7fbe6c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:24.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.866+0000 7fbe71a38640 1 --2- 172.21.15.17:0/314658207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c1616e0 0x7fbe6c0b6000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009870 tx=0x7fbe5402b980 comp rx=0 tx=0).stop 2023-08-09T12:39:24.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.866+0000 7fbe71a38640 1 -- 172.21.15.17:0/314658207 shutdown_connections 2023-08-09T12:39:24.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.866+0000 7fbe71a38640 1 --2- 172.21.15.17:0/314658207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.866+0000 7fbe71a38640 1 --2- 172.21.15.17:0/314658207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c1616e0 0x7fbe6c0b6000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.866+0000 7fbe71a38640 1 -- 172.21.15.17:0/314658207 >> 172.21.15.17:0/314658207 conn(0x7fbe6c06fde0 msgr2=0x7fbe6c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:24.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.866+0000 7fbe71a38640 1 -- 172.21.15.17:0/314658207 shutdown_connections 2023-08-09T12:39:24.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.866+0000 7fbe71a38640 1 -- 172.21.15.17:0/314658207 wait complete. 2023-08-09T12:39:24.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.868+0000 7fbe71a38640 1 Processor -- start 2023-08-09T12:39:24.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.868+0000 7fbe71a38640 1 -- start start 2023-08-09T12:39:24.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.869+0000 7fbe71a38640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:24.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.869+0000 7fbe71a38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c15ce90 0x7fbe6c157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:24.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.869+0000 7fbe71a38640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c1616e0 0x7fbe6c1e7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:24.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.869+0000 7fbe71a38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0cb720 con 0x7fbe6c15ce90 2023-08-09T12:39:24.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.869+0000 7fbe71a38640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0cb920 con 0x7fbe6c1616e0 2023-08-09T12:39:24.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.869+0000 7fbe71a38640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0cbec0 con 0x7fbe6c0d29d0 2023-08-09T12:39:24.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c15ce90 0x7fbe6c157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:24.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c15ce90 0x7fbe6c157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42286/0 (socket says 172.21.15.17:42286) 2023-08-09T12:39:24.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 -- 172.21.15.17:0/2894624417 learned_addr learned my addr 172.21.15.17:0/2894624417 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:24.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6affd640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:24.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6b7fe640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c1616e0 0x7fbe6c1e7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:24.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 -- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 msgr2=0x7fbe6c0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:24.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 -- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c1616e0 msgr2=0x7fbe6c1e7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:24.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c1616e0 0x7fbe6c1e7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:24.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 -- 172.21.15.17:0/2894624417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540094d0 con 0x7fbe6c15ce90 2023-08-09T12:39:24.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6affd640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:24.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.870+0000 7fbe6a7fc640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c15ce90 0x7fbe6c157260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe5402b9c0 tx=0x7fbe540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:24.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.871+0000 7fbe63fff640 1 -- 172.21.15.17:0/2894624417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5403e070 con 0x7fbe6c15ce90 2023-08-09T12:39:24.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.871+0000 7fbe63fff640 1 -- 172.21.15.17:0/2894624417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54039a10 con 0x7fbe6c15ce90 2023-08-09T12:39:24.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.871+0000 7fbe63fff640 1 -- 172.21.15.17:0/2894624417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54039de0 con 0x7fbe6c15ce90 2023-08-09T12:39:24.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.871+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c0cbbe0 con 0x7fbe6c15ce90 2023-08-09T12:39:24.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.871+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c0ca9e0 con 0x7fbe6c15ce90 2023-08-09T12:39:24.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.872+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c067a80 con 0x7fbe6c15ce90 2023-08-09T12:39:24.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.873+0000 7fbe63fff640 1 -- 172.21.15.17:0/2894624417 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbe5404b400 con 0x7fbe6c15ce90 2023-08-09T12:39:24.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.874+0000 7fbe63fff640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbe4c06a050 0x7fbe4c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:24.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.875+0000 7fbe63fff640 1 -- 172.21.15.17:0/2894624417 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fbe540aaba0 con 0x7fbe6c15ce90 2023-08-09T12:39:24.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.875+0000 7fbe6affd640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbe4c06a050 0x7fbe4c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:24.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.876+0000 7fbe6affd640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbe4c06a050 0x7fbe4c06c510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0ccc50 tx=0x7fbe5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:24.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:24.880+0000 7fbe63fff640 1 -- 172.21.15.17:0/2894624417 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbe54076400 con 0x7fbe6c15ce90 2023-08-09T12:39:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.111+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbe6c0ccc80 con 0x7fbe6c15ce90 2023-08-09T12:39:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.646+0000 7fbe63fff640 1 -- 172.21.15.17:0/2894624417 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbe54079a20 con 0x7fbe6c15ce90 2023-08-09T12:39:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 3 and data pool 4 2023-08-09T12:39:25.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.654+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbe4c06a050 msgr2=0x7fbe4c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:25.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.654+0000 7fbe71a38640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbe4c06a050 0x7fbe4c06c510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0ccc50 tx=0x7fbe5c009040 comp rx=0 tx=0).stop 2023-08-09T12:39:25.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.654+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c15ce90 msgr2=0x7fbe6c157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:25.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.655+0000 7fbe71a38640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c15ce90 0x7fbe6c157260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe5402b9c0 tx=0x7fbe540046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.656+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 shutdown_connections 2023-08-09T12:39:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.656+0000 7fbe71a38640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbe4c06a050 0x7fbe4c06c510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.656+0000 7fbe71a38640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe6c1616e0 0x7fbe6c1e7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.656+0000 7fbe71a38640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe6c15ce90 0x7fbe6c157260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.656+0000 7fbe71a38640 1 --2- 172.21.15.17:0/2894624417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe6c0d29d0 0x7fbe6c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.656+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 >> 172.21.15.17:0/2894624417 conn(0x7fbe6c06fde0 msgr2=0x7fbe6c0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.657+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 shutdown_connections 2023-08-09T12:39:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.658+0000 7fbe71a38640 1 -- 172.21.15.17:0/2894624417 wait complete. 2023-08-09T12:39:25.680 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:25.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.870+0000 7faa6d66c640 1 Processor -- start 2023-08-09T12:39:25.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.870+0000 7faa6d66c640 1 -- start start 2023-08-09T12:39:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa6d66c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa680adc40 0x7faa6806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa6d66c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa680b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa6d66c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa6815e8f0 0x7faa6815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa6d66c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680ae020 con 0x7faa6815e8f0 2023-08-09T12:39:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa6d66c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680b2250 con 0x7faa680adc40 2023-08-09T12:39:25.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa6d66c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680b2530 con 0x7faa680b3b40 2023-08-09T12:39:25.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa677fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa6815e8f0 0x7faa6815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:25.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa677fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa6815e8f0 0x7faa6815ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42288/0 (socket says 172.21.15.17:42288) 2023-08-09T12:39:25.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa677fe640 1 -- 172.21.15.17:0/2802056671 learned_addr learned my addr 172.21.15.17:0/2802056671 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:25.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa5e7fc640 1 --2- 172.21.15.17:0/2802056671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa680b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:25.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa66ffd640 1 --2- 172.21.15.17:0/2802056671 >> v2:172.21.15.142:3300/0 conn(0x7faa680adc40 0x7faa6806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:25.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa677fe640 1 -- 172.21.15.17:0/2802056671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 msgr2=0x7faa680b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:25.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa677fe640 1 --2- 172.21.15.17:0/2802056671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa680b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa677fe640 1 -- 172.21.15.17:0/2802056671 >> v2:172.21.15.142:3300/0 conn(0x7faa680adc40 msgr2=0x7faa6806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa677fe640 1 --2- 172.21.15.17:0/2802056671 >> v2:172.21.15.142:3300/0 conn(0x7faa680adc40 0x7faa6806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.872+0000 7faa677fe640 1 -- 172.21.15.17:0/2802056671 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6806fe80 con 0x7faa6815e8f0 2023-08-09T12:39:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.873+0000 7faa66ffd640 1 --2- 172.21.15.17:0/2802056671 >> v2:172.21.15.142:3300/0 conn(0x7faa680adc40 0x7faa6806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.874+0000 7faa677fe640 1 --2- 172.21.15.17:0/2802056671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa6815e8f0 0x7faa6815ed80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa680b1320 tx=0x7faa6002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4140bccb7d53fedb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.874+0000 7faa667fc640 1 -- 172.21.15.17:0/2802056671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60031870 con 0x7faa6815e8f0 2023-08-09T12:39:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.874+0000 7faa667fc640 1 -- 172.21.15.17:0/2802056671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa600319d0 con 0x7faa6815e8f0 2023-08-09T12:39:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.874+0000 7faa667fc640 1 -- 172.21.15.17:0/2802056671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60031d60 con 0x7faa6815e8f0 2023-08-09T12:39:25.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 -- 172.21.15.17:0/2802056671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa6815e8f0 msgr2=0x7faa6815ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:25.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 --2- 172.21.15.17:0/2802056671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa6815e8f0 0x7faa6815ed80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa680b1320 tx=0x7faa6002b910 comp rx=0 tx=0).stop 2023-08-09T12:39:25.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 -- 172.21.15.17:0/2802056671 shutdown_connections 2023-08-09T12:39:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 --2- 172.21.15.17:0/2802056671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa6815e8f0 0x7faa6815ed80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 --2- 172.21.15.17:0/2802056671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa680b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 --2- 172.21.15.17:0/2802056671 >> v2:172.21.15.142:3300/0 conn(0x7faa680adc40 0x7faa6806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 -- 172.21.15.17:0/2802056671 >> 172.21.15.17:0/2802056671 conn(0x7faa680cb1b0 msgr2=0x7faa680cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 -- 172.21.15.17:0/2802056671 shutdown_connections 2023-08-09T12:39:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.875+0000 7faa6d66c640 1 -- 172.21.15.17:0/2802056671 wait complete. 2023-08-09T12:39:25.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.877+0000 7faa6d66c640 1 Processor -- start 2023-08-09T12:39:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.877+0000 7faa6d66c640 1 -- start start 2023-08-09T12:39:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa6d66c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa680adc40 0x7faa68154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa6d66c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa681f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa6d66c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa6815e8f0 0x7faa681f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa6d66c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c6ad0 con 0x7faa680adc40 2023-08-09T12:39:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa6d66c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c6db0 con 0x7faa6815e8f0 2023-08-09T12:39:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa6d66c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c7090 con 0x7faa680b3b40 2023-08-09T12:39:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa66ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa680adc40 0x7faa68154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa66ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa680adc40 0x7faa68154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42292/0 (socket says 172.21.15.17:42292) 2023-08-09T12:39:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa66ffd640 1 -- 172.21.15.17:0/929605409 learned_addr learned my addr 172.21.15.17:0/929605409 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa677fe640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa6815e8f0 0x7faa681f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.878+0000 7faa5e7fc640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa681f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa66ffd640 1 -- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 msgr2=0x7faa681f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa66ffd640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa681f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa66ffd640 1 -- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa6815e8f0 msgr2=0x7faa681f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa66ffd640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa6815e8f0 0x7faa681f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa66ffd640 1 -- 172.21.15.17:0/929605409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600094d0 con 0x7faa680adc40 2023-08-09T12:39:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa677fe640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa6815e8f0 0x7faa681f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa5e7fc640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa681f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa66ffd640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa680adc40 0x7faa68154520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa5800c7c0 tx=0x7faa5800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa5ffff640 1 -- 172.21.15.17:0/929605409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58007a30 con 0x7faa680adc40 2023-08-09T12:39:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa5ffff640 1 -- 172.21.15.17:0/929605409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58007b90 con 0x7faa680adc40 2023-08-09T12:39:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa5ffff640 1 -- 172.21.15.17:0/929605409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800ce70 con 0x7faa680adc40 2023-08-09T12:39:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa680697c0 con 0x7faa680adc40 2023-08-09T12:39:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.879+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa68154a60 con 0x7faa680adc40 2023-08-09T12:39:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.881+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa68154c80 con 0x7faa680adc40 2023-08-09T12:39:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.881+0000 7faa5ffff640 1 -- 172.21.15.17:0/929605409 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faa580113f0 con 0x7faa680adc40 2023-08-09T12:39:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.882+0000 7faa5ffff640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faa4806a050 0x7faa4806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.882+0000 7faa5ffff640 1 -- 172.21.15.17:0/929605409 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa58088730 con 0x7faa680adc40 2023-08-09T12:39:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.883+0000 7faa5e7fc640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faa4806a050 0x7faa4806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.884+0000 7faa5e7fc640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faa4806a050 0x7faa4806c510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa68155750 tx=0x7faa5000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:25.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:25.887+0000 7faa5ffff640 1 -- 172.21.15.17:0/929605409 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7faa58053d80 con 0x7faa680adc40 2023-08-09T12:39:26.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.085+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa680b44b0 con 0x7faa680adc40 2023-08-09T12:39:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.086+0000 7faa5ffff640 1 -- 172.21.15.17:0/929605409 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18268 (secure 0 0 0) 0x7faa580573a0 con 0x7faa680adc40 2023-08-09T12:39:26.090 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:26.090 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":23,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:25.113222+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faa4806a050 msgr2=0x7faa4806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faa4806a050 0x7faa4806c510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa68155750 tx=0x7faa5000b040 comp rx=0 tx=0).stop 2023-08-09T12:39:26.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa680adc40 msgr2=0x7faa68154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa680adc40 0x7faa68154520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa5800c7c0 tx=0x7faa5800cc80 comp rx=0 tx=0).stop 2023-08-09T12:39:26.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 shutdown_connections 2023-08-09T12:39:26.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faa4806a050 0x7faa4806c510 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa6815e8f0 0x7faa681f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa680b3b40 0x7faa681f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 --2- 172.21.15.17:0/929605409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa680adc40 0x7faa68154520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.089+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 >> 172.21.15.17:0/929605409 conn(0x7faa680cb1b0 msgr2=0x7faa680c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.090+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 shutdown_connections 2023-08-09T12:39:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.090+0000 7faa6d66c640 1 -- 172.21.15.17:0/929605409 wait complete. 2023-08-09T12:39:26.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:26.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.343+0000 7f21e0efa640 1 Processor -- start 2023-08-09T12:39:26.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.343+0000 7f21e0efa640 1 -- start start 2023-08-09T12:39:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21e0efa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0cb630 0x7f21dc06b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21e0efa640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21dc161390 con 0x7f21dc15ccf0 2023-08-09T12:39:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21e0efa640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21dc0ad010 con 0x7f21dc0cd340 2023-08-09T12:39:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21e0efa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc1618c0 con 0x7f21dc0cb630 2023-08-09T12:39:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21da59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f21dc15ccf0 0x7f21dc0ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35228/0 (socket says 172.21.15.17:35228) 2023-08-09T12:39:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21da59c640 1 -- 172.21.15.17:0/50086312 learned_addr learned my addr 172.21.15.17:0/50086312 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117121771 0 0) 0x7f21dc161390 con 0x7f21dc15ccf0 2023-08-09T12:39:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21dad9d640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0cb630 0x7f21dc06b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.345+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c8003520 con 0x7f21dc15ccf0 2023-08-09T12:39:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2163264003 0 0) 0x7f21c8003520 con 0x7f21dc15ccf0 2023-08-09T12:39:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0cb630 msgr2=0x7f21dc06b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0cb630 0x7f21dc06b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 >> v1:172.21.15.142:6789/0 conn(0x7f21dc0cd340 legacy=0x7f21dc0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc1615e0 con 0x7f21dc15ccf0 2023-08-09T12:39:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f21cc0019f0 con 0x7f21dc15ccf0 2023-08-09T12:39:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 >> v1:172.21.15.17:6789/0 conn(0x7f21dc15ccf0 legacy=0x7f21dc0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c80039a0 0x7f21c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0cb630 0x7f21c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc1618c0 con 0x7f21c8004d00 2023-08-09T12:39:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c800bb10 con 0x7f21c80039a0 2023-08-09T12:39:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c800bca0 con 0x7f21dc0cb630 2023-08-09T12:39:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21dad9d640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21d1d9b640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0cb630 0x7f21c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.346+0000 7f21da59c640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c80039a0 0x7f21c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.347+0000 7f21dad9d640 1 -- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0cb630 msgr2=0x7f21c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.347+0000 7f21dad9d640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0cb630 0x7f21c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.347+0000 7f21dad9d640 1 -- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c80039a0 msgr2=0x7f21c8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.347+0000 7f21dad9d640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c80039a0 0x7f21c8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.347+0000 7f21dad9d640 1 -- 172.21.15.17:0/50086312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8003520 con 0x7f21c8004d00 2023-08-09T12:39:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.347+0000 7f21da59c640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c80039a0 0x7f21c8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:26.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.348+0000 7f21dad9d640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21d400ba30 tx=0x7f21c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14df1fc035edb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:26.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.348+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4032620 con 0x7f21c8004d00 2023-08-09T12:39:26.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.348+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4032780 con 0x7f21c8004d00 2023-08-09T12:39:26.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.348+0000 7f21d9d9b640 1 -- 172.21.15.17:0/50086312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4032b10 con 0x7f21c8004d00 2023-08-09T12:39:26.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.349+0000 7f21e0efa640 1 -- 172.21.15.17:0/50086312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 msgr2=0x7f21c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.349+0000 7f21e0efa640 1 --2- 172.21.15.17:0/50086312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21d400ba30 tx=0x7f21c80057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.349+0000 7f21dad9d640 1 -- 172.21.15.17:0/50086312 reap_dead start 2023-08-09T12:39:26.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.349+0000 7f21e0efa640 1 -- 172.21.15.17:0/50086312 shutdown_connections 2023-08-09T12:39:26.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.349+0000 7f21e0efa640 1 -- 172.21.15.17:0/50086312 >> 172.21.15.17:0/50086312 conn(0x7f21dc0cf060 msgr2=0x7f21dc0cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:26.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.349+0000 7f21e0efa640 1 -- 172.21.15.17:0/50086312 shutdown_connections 2023-08-09T12:39:26.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.349+0000 7f21e0efa640 1 -- 172.21.15.17:0/50086312 wait complete. 2023-08-09T12:39:26.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.351+0000 7f21e0efa640 1 Processor -- start 2023-08-09T12:39:26.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.351+0000 7f21e0efa640 1 -- start start 2023-08-09T12:39:26.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21e0efa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21dc150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21e0efa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21dc151560 0x7f21dc0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21e0efa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0c8430 0x7f21dc0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21e0efa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0b4ad0 con 0x7f21c8004d00 2023-08-09T12:39:26.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21e0efa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc1513e0 con 0x7f21dc151560 2023-08-09T12:39:26.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21e0efa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc1f22f0 con 0x7f21dc0c8430 2023-08-09T12:39:26.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21da59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21dc150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21da59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21dc150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42310/0 (socket says 172.21.15.17:42310) 2023-08-09T12:39:26.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21da59c640 1 -- 172.21.15.17:0/821818428 learned_addr learned my addr 172.21.15.17:0/821818428 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:26.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21dad9d640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0c8430 0x7f21dc0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21da59c640 1 -- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0c8430 msgr2=0x7f21dc0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21d1d9b640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21dc151560 0x7f21dc0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21da59c640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0c8430 0x7f21dc0c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21da59c640 1 -- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21dc151560 msgr2=0x7f21dc0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21da59c640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21dc151560 0x7f21dc0c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.352+0000 7f21da59c640 1 -- 172.21.15.17:0/821818428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc15a8f0 con 0x7f21c8004d00 2023-08-09T12:39:26.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.353+0000 7f21da59c640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21dc150ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00b100 tx=0x7f21cc00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:26.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.353+0000 7f21d37fe640 1 -- 172.21.15.17:0/821818428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc004d60 con 0x7f21c8004d00 2023-08-09T12:39:26.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.353+0000 7f21d37fe640 1 -- 172.21.15.17:0/821818428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc0070d0 con 0x7f21c8004d00 2023-08-09T12:39:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.353+0000 7f21d37fe640 1 -- 172.21.15.17:0/821818428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc007440 con 0x7f21c8004d00 2023-08-09T12:39:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.353+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc0b3e50 con 0x7f21c8004d00 2023-08-09T12:39:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.353+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc0b4410 con 0x7f21c8004d00 2023-08-09T12:39:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.354+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc067a80 con 0x7f21c8004d00 2023-08-09T12:39:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.356+0000 7f21d37fe640 1 -- 172.21.15.17:0/821818428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f21cc0075a0 con 0x7f21c8004d00 2023-08-09T12:39:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.356+0000 7f21d37fe640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21bc06a050 0x7f21bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.357+0000 7f21d37fe640 1 -- 172.21.15.17:0/821818428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21cc0886b0 con 0x7f21c8004d00 2023-08-09T12:39:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.357+0000 7f21d1d9b640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21bc06a050 0x7f21bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.358+0000 7f21d1d9b640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21bc06a050 0x7f21bc06c510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007fd0 tx=0x7f21c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.361+0000 7f21d37fe640 1 -- 172.21.15.17:0/821818428 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f21cc053d90 con 0x7f21c8004d00 2023-08-09T12:39:26.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.555+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21dc0acc70 con 0x7f21c8004d00 2023-08-09T12:39:26.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.557+0000 7f21d37fe640 1 -- 172.21.15.17:0/821818428 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18268 (secure 0 0 0) 0x7f21cc0573b0 con 0x7f21c8004d00 2023-08-09T12:39:26.561 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:26.561 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":23,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:25.113222+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:26.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21bc06a050 msgr2=0x7f21bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21bc06a050 0x7f21bc06c510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007fd0 tx=0x7f21c4009040 comp rx=0 tx=0).stop 2023-08-09T12:39:26.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 msgr2=0x7f21dc150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21dc150ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00b100 tx=0x7f21cc00b5c0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 shutdown_connections 2023-08-09T12:39:26.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21bc06a050 0x7f21bc06c510 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21dc0c8430 0x7f21dc0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21dc151560 0x7f21dc0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 --2- 172.21.15.17:0/821818428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21c8004d00 0x7f21dc150ea0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 >> 172.21.15.17:0/821818428 conn(0x7f21dc0cf060 msgr2=0x7f21dc160850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 shutdown_connections 2023-08-09T12:39:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.560+0000 7f21e0efa640 1 -- 172.21.15.17:0/821818428 wait complete. 2023-08-09T12:39:26.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:39:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.803+0000 7f1deaa37640 1 Processor -- start 2023-08-09T12:39:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.803+0000 7f1deaa37640 1 -- start start 2023-08-09T12:39:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.804+0000 7f1deaa37640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1de40cd270 0x7f1de406a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.804+0000 7f1deaa37640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de406b170 con 0x7f1de40b1d90 2023-08-09T12:39:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.804+0000 7f1deaa37640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de406a8d0 con 0x7f1de40d0ca0 2023-08-09T12:39:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.804+0000 7f1deaa37640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de406abb0 con 0x7f1de40cd270 2023-08-09T12:39:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.805+0000 7f1de9a35640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1de40cd270 0x7f1de406a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.805+0000 7f1de9a35640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1de40cd270 0x7f1de406a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42320/0 (socket says 172.21.15.17:42320) 2023-08-09T12:39:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.805+0000 7f1de9a35640 1 -- 172.21.15.17:0/2901240538 learned_addr learned my addr 172.21.15.17:0/2901240538 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.805+0000 7f1de9a35640 1 -- 172.21.15.17:0/2901240538 >> v1:172.21.15.142:6789/0 conn(0x7f1de40d0ca0 legacy=0x7f1de40d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.805+0000 7f1de9a35640 1 -- 172.21.15.17:0/2901240538 >> v1:172.21.15.17:6789/0 conn(0x7f1de40b1d90 legacy=0x7f1de40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.805+0000 7f1de9a35640 1 -- 172.21.15.17:0/2901240538 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de406ae90 con 0x7f1de40cd270 2023-08-09T12:39:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.806+0000 7f1de9a35640 1 --2- 172.21.15.17:0/2901240538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de406a1d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009870 tx=0x7f1de002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c345924b0c17b58 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1de8a33640 1 -- 172.21.15.17:0/2901240538 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0031870 con 0x7f1de40cd270 2023-08-09T12:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1de8a33640 1 -- 172.21.15.17:0/2901240538 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de00319d0 con 0x7f1de40cd270 2023-08-09T12:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1de8a33640 1 -- 172.21.15.17:0/2901240538 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0031d60 con 0x7f1de40cd270 2023-08-09T12:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1deaa37640 1 -- 172.21.15.17:0/2901240538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 msgr2=0x7f1de406a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1deaa37640 1 --2- 172.21.15.17:0/2901240538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de406a1d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009870 tx=0x7f1de002b910 comp rx=0 tx=0).stop 2023-08-09T12:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1deaa37640 1 -- 172.21.15.17:0/2901240538 shutdown_connections 2023-08-09T12:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1deaa37640 1 --2- 172.21.15.17:0/2901240538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de406a1d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1deaa37640 1 -- 172.21.15.17:0/2901240538 >> 172.21.15.17:0/2901240538 conn(0x7f1de40d2a10 msgr2=0x7f1de40d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1deaa37640 1 -- 172.21.15.17:0/2901240538 shutdown_connections 2023-08-09T12:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.807+0000 7f1deaa37640 1 -- 172.21.15.17:0/2901240538 wait complete. 2023-08-09T12:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.809+0000 7f1deaa37640 1 Processor -- start 2023-08-09T12:39:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.809+0000 7f1deaa37640 1 -- start start 2023-08-09T12:39:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1deaa37640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de40b1d90 0x7f1de414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1deaa37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1deaa37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de40d0ca0 0x7f1de415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1deaa37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40b44e0 con 0x7f1de40cd270 2023-08-09T12:39:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1deaa37640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40b5060 con 0x7f1de40b1d90 2023-08-09T12:39:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1deaa37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40b4730 con 0x7f1de40d0ca0 2023-08-09T12:39:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1de9234640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1de9234640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de415e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42332/0 (socket says 172.21.15.17:42332) 2023-08-09T12:39:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.810+0000 7f1de9234640 1 -- 172.21.15.17:0/1985838949 learned_addr learned my addr 172.21.15.17:0/1985838949 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:26.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.811+0000 7f1de9234640 1 -- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de40d0ca0 msgr2=0x7f1de415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.811+0000 7f1de9234640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de40d0ca0 0x7f1de415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.811+0000 7f1de9234640 1 -- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de40b1d90 msgr2=0x7f1de414cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.811+0000 7f1de9a35640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de40b1d90 0x7f1de414cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.811+0000 7f1de9234640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de40b1d90 0x7f1de414cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.811+0000 7f1de9234640 1 -- 172.21.15.17:0/1985838949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00094d0 con 0x7f1de40cd270 2023-08-09T12:39:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.811+0000 7f1de9234640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de415e580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c430 tx=0x7f1dd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.811+0000 7f1dda7fc640 1 -- 172.21.15.17:0/1985838949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40052d0 con 0x7f1de40cd270 2023-08-09T12:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.812+0000 7f1dda7fc640 1 -- 172.21.15.17:0/1985838949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4005430 con 0x7f1de40cd270 2023-08-09T12:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.812+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de40b4a10 con 0x7f1de40cd270 2023-08-09T12:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.812+0000 7f1dda7fc640 1 -- 172.21.15.17:0/1985838949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4003830 con 0x7f1de40cd270 2023-08-09T12:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.812+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de414d530 con 0x7f1de40cd270 2023-08-09T12:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.813+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de414d6f0 con 0x7f1de40cd270 2023-08-09T12:39:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.814+0000 7f1dda7fc640 1 -- 172.21.15.17:0/1985838949 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1dd4003990 con 0x7f1de40cd270 2023-08-09T12:39:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.815+0000 7f1dda7fc640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1dc806a050 0x7f1dc806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.815+0000 7f1dda7fc640 1 -- 172.21.15.17:0/1985838949 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1dd4087ae0 con 0x7f1de40cd270 2023-08-09T12:39:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.815+0000 7f1de9a35640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1dc806a050 0x7f1dc806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:26.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.817+0000 7f1de9a35640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1dc806a050 0x7f1dc806c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1de0036000 tx=0x7f1de003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:26.819+0000 7f1dda7fc640 1 -- 172.21.15.17:0/1985838949 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1dd40531c0 con 0x7f1de40cd270 2023-08-09T12:39:27.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.049+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1de40cea20 con 0x7f1de40cd270 2023-08-09T12:39:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.663+0000 7f1dda7fc640 1 -- 172.21.15.17:0/1985838949 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1dd40567e0 con 0x7f1de40cd270 2023-08-09T12:39:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1dc806a050 msgr2=0x7f1dc806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1dc806a050 0x7f1dc806c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1de0036000 tx=0x7f1de003c040 comp rx=0 tx=0).stop 2023-08-09T12:39:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 msgr2=0x7f1de415e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de415e580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c430 tx=0x7f1dd400c8f0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 shutdown_connections 2023-08-09T12:39:27.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1dc806a050 0x7f1dc806c510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de40d0ca0 0x7f1de415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1de40cd270 0x7f1de415e580 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 --2- 172.21.15.17:0/1985838949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de40b1d90 0x7f1de414cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 >> 172.21.15.17:0/1985838949 conn(0x7f1de40d2a10 msgr2=0x7f1de40c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 shutdown_connections 2023-08-09T12:39:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.667+0000 7f1deaa37640 1 -- 172.21.15.17:0/1985838949 wait complete. 2023-08-09T12:39:27.689 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']} 2023-08-09T12:39:27.690 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:39:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.921+0000 7f36d73ab640 1 Processor -- start 2023-08-09T12:39:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.921+0000 7f36d73ab640 1 -- start start 2023-08-09T12:39:27.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.923+0000 7f36d73ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00cfab0 0x7f36d00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:27.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.923+0000 7f36d73ab640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00b2010 con 0x7f36d015d2d0 2023-08-09T12:39:27.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.923+0000 7f36d73ab640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00b1d30 con 0x7f36d015cef0 2023-08-09T12:39:27.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.923+0000 7f36d73ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00cdee0 con 0x7f36d00cfab0 2023-08-09T12:39:27.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.923+0000 7f36d5948640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f36d015d2d0 0x7f36d00d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48948/0 (socket says 172.21.15.17:48948) 2023-08-09T12:39:27.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.923+0000 7f36d5948640 1 -- 172.21.15.17:0/2526577435 learned_addr learned my addr 172.21.15.17:0/2526577435 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36d4946640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00cfab0 0x7f36d00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248670767 0 0) 0x7f36d00b2010 con 0x7f36d015d2d0 2023-08-09T12:39:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36bc003520 con 0x7f36d015d2d0 2023-08-09T12:39:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2387989570 0 0) 0x7f36bc003520 con 0x7f36d015d2d0 2023-08-09T12:39:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00cfab0 msgr2=0x7f36d00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00cfab0 0x7f36d00b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 >> v1:172.21.15.142:6789/0 conn(0x7f36d015cef0 legacy=0x7f36d00cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00cd820 con 0x7f36d015d2d0 2023-08-09T12:39:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f36c8001a10 con 0x7f36d015d2d0 2023-08-09T12:39:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 >> v1:172.21.15.17:6789/0 conn(0x7f36d015d2d0 legacy=0x7f36d00d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36bc0039a0 0x7f36bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00cfab0 0x7f36bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36bc004d00 0x7f36bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00cdee0 con 0x7f36bc0039a0 2023-08-09T12:39:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc00bb70 con 0x7f36bc004d00 2023-08-09T12:39:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.924+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc00bd30 con 0x7f36d00cfab0 2023-08-09T12:39:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.925+0000 7f36d5147640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36bc0039a0 0x7f36bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.925+0000 7f36d4946640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00cfab0 0x7f36bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.925+0000 7f36d5948640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36bc004d00 0x7f36bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.925+0000 7f36d5147640 1 -- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00cfab0 msgr2=0x7f36bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.925+0000 7f36d5147640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d00cfab0 0x7f36bc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.925+0000 7f36d5147640 1 -- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36bc004d00 msgr2=0x7f36bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.925+0000 7f36d5147640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36bc004d00 0x7f36bc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.925+0000 7f36d5147640 1 -- 172.21.15.17:0/2526577435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc003520 con 0x7f36bc0039a0 2023-08-09T12:39:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.926+0000 7f36d5147640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36bc0039a0 0x7f36bc003dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36cc001750 tx=0x7f36bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca39b9457e817e83 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.926+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0052d0 con 0x7f36bc0039a0 2023-08-09T12:39:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.926+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc02e050 con 0x7f36bc0039a0 2023-08-09T12:39:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.926+0000 7f36c7fff640 1 -- 172.21.15.17:0/2526577435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0035f0 con 0x7f36bc0039a0 2023-08-09T12:39:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.927+0000 7f36d73ab640 1 -- 172.21.15.17:0/2526577435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36bc0039a0 msgr2=0x7f36bc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.927+0000 7f36d73ab640 1 --2- 172.21.15.17:0/2526577435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36bc0039a0 0x7f36bc003dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36cc001750 tx=0x7f36bc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.927+0000 7f36d5948640 1 -- 172.21.15.17:0/2526577435 reap_dead start 2023-08-09T12:39:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.927+0000 7f36d73ab640 1 -- 172.21.15.17:0/2526577435 shutdown_connections 2023-08-09T12:39:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.927+0000 7f36d73ab640 1 -- 172.21.15.17:0/2526577435 >> 172.21.15.17:0/2526577435 conn(0x7f36d006fde0 msgr2=0x7f36d00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.927+0000 7f36d73ab640 1 -- 172.21.15.17:0/2526577435 shutdown_connections 2023-08-09T12:39:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.927+0000 7f36d73ab640 1 -- 172.21.15.17:0/2526577435 wait complete. 2023-08-09T12:39:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.929+0000 7f36d73ab640 1 Processor -- start 2023-08-09T12:39:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.929+0000 7f36d73ab640 1 -- start start 2023-08-09T12:39:27.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d73ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36bc0039a0 0x7f36d01f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d73ab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d00c9f40 0x7f36d00ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d73ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36d00c80f0 0x7f36d00c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d73ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00ca900 con 0x7f36d00c80f0 2023-08-09T12:39:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d73ab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d01f5bf0 con 0x7f36d00c9f40 2023-08-09T12:39:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d73ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0145dd0 con 0x7f36bc0039a0 2023-08-09T12:39:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d5948640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36d00c80f0 0x7f36d00c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d5948640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36d00c80f0 0x7f36d00c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55774/0 (socket says 172.21.15.17:55774) 2023-08-09T12:39:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.930+0000 7f36d5948640 1 -- 172.21.15.17:0/2818926586 learned_addr learned my addr 172.21.15.17:0/2818926586 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36d5147640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36bc0039a0 0x7f36d01f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36d4946640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d00c9f40 0x7f36d00ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36d5948640 1 -- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36bc0039a0 msgr2=0x7f36d01f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36d5948640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36bc0039a0 0x7f36d01f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36d5948640 1 -- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d00c9f40 msgr2=0x7f36d00ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36d5948640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d00c9f40 0x7f36d00ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36d5948640 1 -- 172.21.15.17:0/2818926586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00c8e70 con 0x7f36d00c80f0 2023-08-09T12:39:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36d5948640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36d00c80f0 0x7f36d00c8570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f36d00c6770 tx=0x7f36c800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.931+0000 7f36c5ffb640 1 -- 172.21.15.17:0/2818926586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8004d60 con 0x7f36d00c80f0 2023-08-09T12:39:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.932+0000 7f36c5ffb640 1 -- 172.21.15.17:0/2818926586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c800bb20 con 0x7f36d00c80f0 2023-08-09T12:39:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.932+0000 7f36c5ffb640 1 -- 172.21.15.17:0/2818926586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c800bed0 con 0x7f36d00c80f0 2023-08-09T12:39:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.932+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d00c9150 con 0x7f36d00c80f0 2023-08-09T12:39:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.932+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d0146020 con 0x7f36d00c80f0 2023-08-09T12:39:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.933+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d00c9670 con 0x7f36d00c80f0 2023-08-09T12:39:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.934+0000 7f36c5ffb640 1 -- 172.21.15.17:0/2818926586 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f36c8007070 con 0x7f36d00c80f0 2023-08-09T12:39:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.935+0000 7f36c5ffb640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36b406a050 0x7f36b406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.935+0000 7f36c5ffb640 1 -- 172.21.15.17:0/2818926586 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36c8088920 con 0x7f36d00c80f0 2023-08-09T12:39:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.935+0000 7f36d5147640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36b406a050 0x7f36b406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.936+0000 7f36d5147640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36b406a050 0x7f36b406c510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f36cc033000 tx=0x7f36cc009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:27.939+0000 7f36c5ffb640 1 -- 172.21.15.17:0/2818926586 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f36c8054000 con 0x7f36d00c80f0 2023-08-09T12:39:28.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.174+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f36d0146240 con 0x7f36d00c80f0 2023-08-09T12:39:28.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.665+0000 7f36c5ffb640 1 -- 172.21.15.17:0/2818926586 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36c8057620 con 0x7f36d00c80f0 2023-08-09T12:39:28.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36b406a050 msgr2=0x7f36b406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:28.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36b406a050 0x7f36b406c510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f36cc033000 tx=0x7f36cc009030 comp rx=0 tx=0).stop 2023-08-09T12:39:28.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36d00c80f0 msgr2=0x7f36d00c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:28.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36d00c80f0 0x7f36d00c8570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f36d00c6770 tx=0x7f36c800b4a0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 shutdown_connections 2023-08-09T12:39:28.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36b406a050 0x7f36b406c510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36d00c80f0 0x7f36d00c8570 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d00c9f40 0x7f36d00ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 --2- 172.21.15.17:0/2818926586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36bc0039a0 0x7f36d01f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 >> 172.21.15.17:0/2818926586 conn(0x7f36d006fde0 msgr2=0x7f36d015c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:28.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 shutdown_connections 2023-08-09T12:39:28.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.669+0000 7f36d73ab640 1 -- 172.21.15.17:0/2818926586 wait complete. 2023-08-09T12:39:28.694 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:39:28.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:39:28.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.902+0000 7f4d0d277640 1 Processor -- start 2023-08-09T12:39:28.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.902+0000 7f4d0d277640 1 -- start start 2023-08-09T12:39:28.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.903+0000 7f4d0d277640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4d0815ce90 0x7f4d081616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:28.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.903+0000 7f4d0d277640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d080d29d0 0x7f4d080d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:28.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d0d277640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d080d3360 con 0x7f4d080b6000 2023-08-09T12:39:28.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d0d277640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080b6460 con 0x7f4d0815ce90 2023-08-09T12:39:28.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d0d277640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080cdd10 con 0x7f4d080d29d0 2023-08-09T12:39:28.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d06ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4d0815ce90 0x7f4d081616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:28.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d06ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4d0815ce90 0x7f4d081616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55778/0 (socket says 172.21.15.17:55778) 2023-08-09T12:39:28.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d06ffd640 1 -- 172.21.15.17:0/1071420511 learned_addr learned my addr 172.21.15.17:0/1071420511 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d077fe640 1 --2- 172.21.15.17:0/1071420511 >> v2:172.21.15.142:3300/0 conn(0x7f4d080d29d0 0x7f4d080d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d06ffd640 1 -- 172.21.15.17:0/1071420511 >> v2:172.21.15.142:3300/0 conn(0x7f4d080d29d0 msgr2=0x7f4d080d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d06ffd640 1 --2- 172.21.15.17:0/1071420511 >> v2:172.21.15.142:3300/0 conn(0x7f4d080d29d0 0x7f4d080d2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d06ffd640 1 -- 172.21.15.17:0/1071420511 >> v1:172.21.15.142:6789/0 conn(0x7f4d080b6000 legacy=0x7f4d080cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d06ffd640 1 -- 172.21.15.17:0/1071420511 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080cdff0 con 0x7f4d0815ce90 2023-08-09T12:39:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.904+0000 7f4d077fe640 1 --2- 172.21.15.17:0/1071420511 >> v2:172.21.15.142:3300/0 conn(0x7f4d080d29d0 0x7f4d080d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.905+0000 7f4d06ffd640 1 --2- 172.21.15.17:0/1071420511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d0815ce90 0x7f4d081616e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d080d07e0 tx=0x7f4cf802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88aea7446216bf0c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.906+0000 7f4d05ffb640 1 -- 172.21.15.17:0/1071420511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8031870 con 0x7f4d0815ce90 2023-08-09T12:39:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.906+0000 7f4d05ffb640 1 -- 172.21.15.17:0/1071420511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf80319d0 con 0x7f4d0815ce90 2023-08-09T12:39:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.906+0000 7f4d05ffb640 1 -- 172.21.15.17:0/1071420511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8031d60 con 0x7f4d0815ce90 2023-08-09T12:39:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.906+0000 7f4d0d277640 1 -- 172.21.15.17:0/1071420511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d0815ce90 msgr2=0x7f4d081616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.906+0000 7f4d0d277640 1 --2- 172.21.15.17:0/1071420511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d0815ce90 0x7f4d081616e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d080d07e0 tx=0x7f4cf802b910 comp rx=0 tx=0).stop 2023-08-09T12:39:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.907+0000 7f4d0d277640 1 -- 172.21.15.17:0/1071420511 shutdown_connections 2023-08-09T12:39:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.907+0000 7f4d0d277640 1 --2- 172.21.15.17:0/1071420511 >> v2:172.21.15.142:3300/0 conn(0x7f4d080d29d0 0x7f4d080d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.907+0000 7f4d0d277640 1 --2- 172.21.15.17:0/1071420511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d0815ce90 0x7f4d081616e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.907+0000 7f4d0d277640 1 -- 172.21.15.17:0/1071420511 >> 172.21.15.17:0/1071420511 conn(0x7f4d0806fde0 msgr2=0x7f4d080701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:28.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.907+0000 7f4d0d277640 1 -- 172.21.15.17:0/1071420511 shutdown_connections 2023-08-09T12:39:28.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.907+0000 7f4d0d277640 1 -- 172.21.15.17:0/1071420511 wait complete. 2023-08-09T12:39:28.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.909+0000 7f4d0d277640 1 Processor -- start 2023-08-09T12:39:28.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.909+0000 7f4d0d277640 1 -- start start 2023-08-09T12:39:28.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.910+0000 7f4d0d277640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d080b6000 0x7f4d080c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:28.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.910+0000 7f4d0d277640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d080d29d0 0x7f4d080ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:28.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.910+0000 7f4d0d277640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0815ce90 0x7f4d080ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:28.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.910+0000 7f4d0d277640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d081595e0 con 0x7f4d080b6000 2023-08-09T12:39:28.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.910+0000 7f4d0d277640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d081e7900 con 0x7f4d080d29d0 2023-08-09T12:39:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.910+0000 7f4d0d277640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08159830 con 0x7f4d0815ce90 2023-08-09T12:39:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d080b6000 0x7f4d080c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d080b6000 0x7f4d080c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55790/0 (socket says 172.21.15.17:55790) 2023-08-09T12:39:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d06ffd640 1 -- 172.21.15.17:0/911676156 learned_addr learned my addr 172.21.15.17:0/911676156 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d067fc640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d080d29d0 0x7f4d080ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d077fe640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0815ce90 0x7f4d080ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d06ffd640 1 -- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0815ce90 msgr2=0x7f4d080ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d06ffd640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0815ce90 0x7f4d080ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d06ffd640 1 -- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d080d29d0 msgr2=0x7f4d080ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d06ffd640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d080d29d0 0x7f4d080ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d06ffd640 1 -- 172.21.15.17:0/911676156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80094d0 con 0x7f4d080b6000 2023-08-09T12:39:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.911+0000 7f4d067fc640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d080d29d0 0x7f4d080ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.912+0000 7f4d06ffd640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d080b6000 0x7f4d080c9c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000c00 tx=0x7f4cf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.912+0000 7f4cef7fe640 1 -- 172.21.15.17:0/911676156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8031840 con 0x7f4d080b6000 2023-08-09T12:39:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.912+0000 7f4cef7fe640 1 -- 172.21.15.17:0/911676156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf80443f0 con 0x7f4d080b6000 2023-08-09T12:39:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.912+0000 7f4cef7fe640 1 -- 172.21.15.17:0/911676156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80447a0 con 0x7f4d080b6000 2023-08-09T12:39:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.912+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d08159b10 con 0x7f4d080b6000 2023-08-09T12:39:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.912+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0815bca0 con 0x7f4d080b6000 2023-08-09T12:39:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.913+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0815be90 con 0x7f4d080b6000 2023-08-09T12:39:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.914+0000 7f4cef7fe640 1 -- 172.21.15.17:0/911676156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4cf804d450 con 0x7f4d080b6000 2023-08-09T12:39:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.916+0000 7f4cef7fe640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4cf406a050 0x7f4cf406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:28.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.917+0000 7f4cef7fe640 1 -- 172.21.15.17:0/911676156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4cf802d040 con 0x7f4d080b6000 2023-08-09T12:39:28.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.917+0000 7f4d067fc640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4cf406a050 0x7f4cf406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.918+0000 7f4d067fc640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4cf406a050 0x7f4cf406c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d080cb8d0 tx=0x7f4cfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:28.921+0000 7f4cef7fe640 1 -- 172.21.15.17:0/911676156 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4d0815be90 con 0x7f4d080b6000 2023-08-09T12:39:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.160+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d080d3360 con 0x7f4d080b6000 2023-08-09T12:39:29.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.161+0000 7f4cef7fe640 1 -- 172.21.15.17:0/911676156 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4872 (secure 0 0 0) 0x7f4d080d3360 con 0x7f4d080b6000 2023-08-09T12:39:29.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:29.165 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:39:25.114229+0000","modified":"2023-08-09T12:39:28.660973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T12:39:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-08-09T12:39:29.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4cf406a050 msgr2=0x7f4cf406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4cf406a050 0x7f4cf406c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d080cb8d0 tx=0x7f4cfc009040 comp rx=0 tx=0).stop 2023-08-09T12:39:29.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d080b6000 msgr2=0x7f4d080c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d080b6000 0x7f4d080c9c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000c00 tx=0x7f4cf80046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 shutdown_connections 2023-08-09T12:39:29.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4cf406a050 0x7f4cf406c510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d0815ce90 0x7f4d080ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d080d29d0 0x7f4d080ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 --2- 172.21.15.17:0/911676156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d080b6000 0x7f4d080c9c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 >> 172.21.15.17:0/911676156 conn(0x7f4d0806fde0 msgr2=0x7f4d080b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 shutdown_connections 2023-08-09T12:39:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.164+0000 7f4d0d277640 1 -- 172.21.15.17:0/911676156 wait complete. 2023-08-09T12:39:29.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.411+0000 7f7611dab640 1 Processor -- start 2023-08-09T12:39:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.411+0000 7f7611dab640 1 -- start start 2023-08-09T12:39:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.413+0000 7f7611dab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0b3fe0 0x7f760c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.413+0000 7f7611dab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f760c0697c0 0x7f760c069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.413+0000 7f7611dab640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c06fe10 con 0x7f760c159bd0 2023-08-09T12:39:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.413+0000 7f7611dab640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0b11a0 con 0x7f760c0697c0 2023-08-09T12:39:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.413+0000 7f7611dab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c06a190 con 0x7f760c0b3fe0 2023-08-09T12:39:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.413+0000 7f7610da9640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f760c159bd0 0x7f760c070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48958/0 (socket says 172.21.15.17:48958) 2023-08-09T12:39:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.413+0000 7f7610da9640 1 -- 172.21.15.17:0/1560166610 learned_addr learned my addr 172.21.15.17:0/1560166610 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f76115aa640 1 --2- 172.21.15.17:0/1560166610 >> v2:172.21.15.142:3300/0 conn(0x7f760c0697c0 0x7f760c069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760bfff640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0b3fe0 0x7f760c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410870138 0 0) 0x7f760c06fe10 con 0x7f760c159bd0 2023-08-09T12:39:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75fc003520 con 0x7f760c159bd0 2023-08-09T12:39:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2340086527 0 0) 0x7f75fc003520 con 0x7f760c159bd0 2023-08-09T12:39:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0b3fe0 msgr2=0x7f760c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0b3fe0 0x7f760c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 >> v2:172.21.15.142:3300/0 conn(0x7f760c0697c0 msgr2=0x7f760c069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 --2- 172.21.15.17:0/1560166610 >> v2:172.21.15.142:3300/0 conn(0x7f760c0697c0 0x7f760c069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c159fb0 con 0x7f760c159bd0 2023-08-09T12:39:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f7600001670 con 0x7f760c159bd0 2023-08-09T12:39:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 >> v1:172.21.15.17:6789/0 conn(0x7f760c159bd0 legacy=0x7f760c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc003970 0x7f75fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0b3fe0 0x7f75fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75fc004d00 0x7f75fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b11a0 con 0x7f75fc004d00 2023-08-09T12:39:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c06a190 con 0x7f75fc003970 2023-08-09T12:39:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.414+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc00b980 con 0x7f760c0b3fe0 2023-08-09T12:39:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.415+0000 7f76115aa640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75fc004d00 0x7f75fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.415+0000 7f760bfff640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0b3fe0 0x7f75fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.415+0000 7f7610da9640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc003970 0x7f75fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.415+0000 7f76115aa640 1 -- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0b3fe0 msgr2=0x7f75fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:29.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.415+0000 7f76115aa640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0b3fe0 0x7f75fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.415+0000 7f76115aa640 1 -- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc003970 msgr2=0x7f75fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:29.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.415+0000 7f76115aa640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc003970 0x7f75fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.415+0000 7f76115aa640 1 -- 172.21.15.17:0/1560166610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc003520 con 0x7f75fc004d00 2023-08-09T12:39:29.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.416+0000 7f76115aa640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75fc004d00 0x7f75fc005180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7604009fc0 tx=0x7f75fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1f33c72c846eb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:29.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760402cc60 con 0x7f75fc004d00 2023-08-09T12:39:29.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400f040 con 0x7f75fc004d00 2023-08-09T12:39:29.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f760b7fe640 1 -- 172.21.15.17:0/1560166610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604034440 con 0x7f75fc004d00 2023-08-09T12:39:29.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f7611dab640 1 -- 172.21.15.17:0/1560166610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75fc004d00 msgr2=0x7f75fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f7611dab640 1 --2- 172.21.15.17:0/1560166610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75fc004d00 0x7f75fc005180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7604009fc0 tx=0x7f75fc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f76115aa640 1 -- 172.21.15.17:0/1560166610 reap_dead start 2023-08-09T12:39:29.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f7611dab640 1 -- 172.21.15.17:0/1560166610 shutdown_connections 2023-08-09T12:39:29.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f7611dab640 1 -- 172.21.15.17:0/1560166610 >> 172.21.15.17:0/1560166610 conn(0x7f760c0b1d50 msgr2=0x7f760c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f7611dab640 1 -- 172.21.15.17:0/1560166610 shutdown_connections 2023-08-09T12:39:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.417+0000 7f7611dab640 1 -- 172.21.15.17:0/1560166610 wait complete. 2023-08-09T12:39:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.419+0000 7f7611dab640 1 Processor -- start 2023-08-09T12:39:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.420+0000 7f7611dab640 1 -- start start 2023-08-09T12:39:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.420+0000 7f7611dab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc004d00 0x7f760c1f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.420+0000 7f7611dab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f760c0c4240 0x7f760c157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f7611dab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0ca240 0x7f760c0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f7611dab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0cac00 con 0x7f760c0c4240 2023-08-09T12:39:29.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f7611dab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0c5410 con 0x7f75fc004d00 2023-08-09T12:39:29.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f7611dab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1f2e20 con 0x7f760c0ca240 2023-08-09T12:39:29.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f760bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f760c0c4240 0x7f760c157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f760bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f760c0c4240 0x7f760c157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55808/0 (socket says 172.21.15.17:55808) 2023-08-09T12:39:29.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f760bfff640 1 -- 172.21.15.17:0/3635481343 learned_addr learned my addr 172.21.15.17:0/3635481343 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:29.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f7610da9640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc004d00 0x7f760c1f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f76115aa640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0ca240 0x7f760c0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f760bfff640 1 -- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0ca240 msgr2=0x7f760c0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f760bfff640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0ca240 0x7f760c0ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f760bfff640 1 -- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc004d00 msgr2=0x7f760c1f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f760bfff640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc004d00 0x7f760c1f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.421+0000 7f760bfff640 1 -- 172.21.15.17:0/3635481343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0c4800 con 0x7f760c0c4240 2023-08-09T12:39:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.422+0000 7f760bfff640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f760c0c4240 0x7f760c157a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75f8011630 tx=0x7f75f8011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.422+0000 7f76097fa640 1 -- 172.21.15.17:0/3635481343 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800f920 con 0x7f760c0c4240 2023-08-09T12:39:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.422+0000 7f76097fa640 1 -- 172.21.15.17:0/3635481343 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f800fa80 con 0x7f760c0c4240 2023-08-09T12:39:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.422+0000 7f76097fa640 1 -- 172.21.15.17:0/3635481343 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800fdf0 con 0x7f760c0c4240 2023-08-09T12:39:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.422+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0c4ae0 con 0x7f760c0c4240 2023-08-09T12:39:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.422+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c0c50a0 con 0x7f760c0c4240 2023-08-09T12:39:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.423+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c04e390 con 0x7f760c0c4240 2023-08-09T12:39:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.424+0000 7f76097fa640 1 -- 172.21.15.17:0/3635481343 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75f8015460 con 0x7f760c0c4240 2023-08-09T12:39:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.425+0000 7f76097fa640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75f006a050 0x7f75f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.425+0000 7f76097fa640 1 -- 172.21.15.17:0/3635481343 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75f8088a70 con 0x7f760c0c4240 2023-08-09T12:39:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.426+0000 7f7610da9640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75f006a050 0x7f75f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.427+0000 7f7610da9640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75f006a050 0x7f75f006c510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7600001050 tx=0x7f7600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.429+0000 7f76097fa640 1 -- 172.21.15.17:0/3635481343 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f75f808ae60 con 0x7f760c0c4240 2023-08-09T12:39:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.628+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f760c157fc0 con 0x7f760c0c4240 2023-08-09T12:39:29.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.630+0000 7f76097fa640 1 -- 172.21.15.17:0/3635481343 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f75f8054140 con 0x7f760c0c4240 2023-08-09T12:39:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:29.634 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:29.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75f006a050 msgr2=0x7f75f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75f006a050 0x7f75f006c510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7600001050 tx=0x7f7600009040 comp rx=0 tx=0).stop 2023-08-09T12:39:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f760c0c4240 msgr2=0x7f760c157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f760c0c4240 0x7f760c157a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75f8011630 tx=0x7f75f8011af0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 shutdown_connections 2023-08-09T12:39:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75f006a050 0x7f75f006c510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f760c0ca240 0x7f760c0ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f760c0c4240 0x7f760c157a80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 --2- 172.21.15.17:0/3635481343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75fc004d00 0x7f760c1f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 >> 172.21.15.17:0/3635481343 conn(0x7f760c0b1d50 msgr2=0x7f760c158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 shutdown_connections 2023-08-09T12:39:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.633+0000 7f7611dab640 1 -- 172.21.15.17:0/3635481343 wait complete. 2023-08-09T12:39:29.657 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:39:29.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:39:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.887+0000 7f5dff59e640 1 Processor -- start 2023-08-09T12:39:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.887+0000 7f5dff59e640 1 -- start start 2023-08-09T12:39:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.889+0000 7f5dff59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e00070f00 0x7f5e0015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.889+0000 7f5dff59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e00071340 con 0x7f5e001587e0 2023-08-09T12:39:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.889+0000 7f5dff59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e000715c0 con 0x7f5e0015bce0 2023-08-09T12:39:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.889+0000 7f5dff59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000718a0 con 0x7f5e00070f00 2023-08-09T12:39:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.889+0000 7f5dfe59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5e001587e0 0x7f5e000b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48962/0 (socket says 172.21.15.17:48962) 2023-08-09T12:39:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.889+0000 7f5dfe59c640 1 -- 172.21.15.17:0/3555546851 learned_addr learned my addr 172.21.15.17:0/3555546851 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:29.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.889+0000 7f5dfdd9b640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e00070f00 0x7f5e0015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026048954 0 0) 0x7f5e00071340 con 0x7f5e001587e0 2023-08-09T12:39:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de8003520 con 0x7f5e001587e0 2023-08-09T12:39:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359116285 0 0) 0x7f5e000715c0 con 0x7f5e0015bce0 2023-08-09T12:39:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e00071340 con 0x7f5e0015bce0 2023-08-09T12:39:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 763186330 0 0) 0x7f5de8003520 con 0x7f5e001587e0 2023-08-09T12:39:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e00070f00 msgr2=0x7f5e0015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e00070f00 0x7f5e0015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 >> v1:172.21.15.142:6789/0 conn(0x7f5e0015bce0 legacy=0x7f5e000cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00071b80 con 0x7f5e001587e0 2023-08-09T12:39:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f5df0001670 con 0x7f5e001587e0 2023-08-09T12:39:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 >> v1:172.21.15.17:6789/0 conn(0x7f5e001587e0 legacy=0x7f5e000b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de8003b30 0x7f5de8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5de80047c0 0x7f5de8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e00070f00 0x7f5de8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000718a0 con 0x7f5de80047c0 2023-08-09T12:39:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de800fe40 con 0x7f5de8003b30 2023-08-09T12:39:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.890+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de800ffd0 con 0x7f5e00070f00 2023-08-09T12:39:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.891+0000 7f5dfdd9b640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5de80047c0 0x7f5de8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.891+0000 7f5dfe59c640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de8003b30 0x7f5de8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.891+0000 7f5dfdd9b640 1 -- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e00070f00 msgr2=0x7f5de8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:29.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.891+0000 7f5dfdd9b640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e00070f00 0x7f5de8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.891+0000 7f5dfdd9b640 1 -- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de8003b30 msgr2=0x7f5de8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:29.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.891+0000 7f5dfdd9b640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de8003b30 0x7f5de8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.891+0000 7f5dfdd9b640 1 -- 172.21.15.17:0/3555546851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8003520 con 0x7f5de80047c0 2023-08-09T12:39:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.891+0000 7f5dfe59c640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de8003b30 0x7f5de8003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.892+0000 7f5dfdd9b640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5de80047c0 0x7f5de8004c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009fc0 tx=0x7f5de80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999400cf2134d38f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df402cbf0 con 0x7f5de80047c0 2023-08-09T12:39:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400f040 con 0x7f5de80047c0 2023-08-09T12:39:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dfd59a640 1 -- 172.21.15.17:0/3555546851 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4034440 con 0x7f5de80047c0 2023-08-09T12:39:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dff59e640 1 -- 172.21.15.17:0/3555546851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5de80047c0 msgr2=0x7f5de8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dff59e640 1 --2- 172.21.15.17:0/3555546851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5de80047c0 0x7f5de8004c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009fc0 tx=0x7f5de80057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dfed9d640 1 -- 172.21.15.17:0/3555546851 reap_dead start 2023-08-09T12:39:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dff59e640 1 -- 172.21.15.17:0/3555546851 shutdown_connections 2023-08-09T12:39:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dff59e640 1 -- 172.21.15.17:0/3555546851 >> 172.21.15.17:0/3555546851 conn(0x7f5e000b1d50 msgr2=0x7f5e0006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dff59e640 1 -- 172.21.15.17:0/3555546851 shutdown_connections 2023-08-09T12:39:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.893+0000 7f5dff59e640 1 -- 172.21.15.17:0/3555546851 wait complete. 2023-08-09T12:39:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.895+0000 7f5dff59e640 1 Processor -- start 2023-08-09T12:39:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.895+0000 7f5dff59e640 1 -- start start 2023-08-09T12:39:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.896+0000 7f5dff59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de80047c0 0x7f5e001eea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.896+0000 7f5dff59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e001ef070 0x7f5e000c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.896+0000 7f5dff59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e001f0c00 0x7f5e000c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.896+0000 7f5dff59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00152480 con 0x7f5e001f0c00 2023-08-09T12:39:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.896+0000 7f5dff59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000c8380 con 0x7f5de80047c0 2023-08-09T12:39:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.896+0000 7f5dff59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00152720 con 0x7f5e001ef070 2023-08-09T12:39:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e001f0c00 0x7f5e000c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e001f0c00 0x7f5e000c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55830/0 (socket says 172.21.15.17:55830) 2023-08-09T12:39:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 -- 172.21.15.17:0/3998887144 learned_addr learned my addr 172.21.15.17:0/3998887144 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfe59c640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de80047c0 0x7f5e001eea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfdd9b640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e001ef070 0x7f5e000c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 -- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e001ef070 msgr2=0x7f5e000c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e001ef070 0x7f5e000c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 -- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de80047c0 msgr2=0x7f5e001eea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de80047c0 0x7f5e001eea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 -- 172.21.15.17:0/3998887144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00152a00 con 0x7f5e001f0c00 2023-08-09T12:39:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.897+0000 7f5dfed9d640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e001f0c00 0x7f5e000c5a60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e000b0740 tx=0x7f5df800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.898+0000 7f5deeffd640 1 -- 172.21.15.17:0/3998887144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80074e0 con 0x7f5e001f0c00 2023-08-09T12:39:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.898+0000 7f5deeffd640 1 -- 172.21.15.17:0/3998887144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df8007660 con 0x7f5e001f0c00 2023-08-09T12:39:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.898+0000 7f5deeffd640 1 -- 172.21.15.17:0/3998887144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8004260 con 0x7f5e001f0c00 2023-08-09T12:39:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.898+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e000c8660 con 0x7f5e001f0c00 2023-08-09T12:39:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.898+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e001f1090 con 0x7f5e001f0c00 2023-08-09T12:39:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.899+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0006fa10 con 0x7f5e001f0c00 2023-08-09T12:39:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.900+0000 7f5deeffd640 1 -- 172.21.15.17:0/3998887144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5df80057c0 con 0x7f5e001f0c00 2023-08-09T12:39:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.901+0000 7f5deeffd640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5de006a050 0x7f5de006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.901+0000 7f5deeffd640 1 -- 172.21.15.17:0/3998887144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5df8087640 con 0x7f5e001f0c00 2023-08-09T12:39:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.901+0000 7f5dfe59c640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5de006a050 0x7f5de006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:29.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.902+0000 7f5dfe59c640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5de006a050 0x7f5de006c510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000ff0 tx=0x7f5df0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:29.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:29.905+0000 7f5deeffd640 1 -- 172.21.15.17:0/3998887144 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5e0006fa10 con 0x7f5e001f0c00 2023-08-09T12:39:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.096+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e0015b280 con 0x7f5de006a050 2023-08-09T12:39:30.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.123+0000 7f5deeffd640 1 -- 172.21.15.17:0/3998887144 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280524 (secure 0 0 0) 0x7f5df000d070 con 0x7f5de006a050 2023-08-09T12:39:30.133 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:39:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5de006a050 msgr2=0x7f5de006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5de006a050 0x7f5de006c510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000ff0 tx=0x7f5df0009040 comp rx=0 tx=0).stop 2023-08-09T12:39:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e001f0c00 msgr2=0x7f5e000c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e001f0c00 0x7f5e000c5a60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e000b0740 tx=0x7f5df800c820 comp rx=0 tx=0).stop 2023-08-09T12:39:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 shutdown_connections 2023-08-09T12:39:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5de006a050 0x7f5de006c510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e001f0c00 0x7f5e000c5a60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e001ef070 0x7f5e000c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 --2- 172.21.15.17:0/3998887144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5de80047c0 0x7f5e001eea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 >> 172.21.15.17:0/3998887144 conn(0x7f5e000b1d50 msgr2=0x7f5e001551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 shutdown_connections 2023-08-09T12:39:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.131+0000 7f5dff59e640 1 -- 172.21.15.17:0/3998887144 wait complete. 2023-08-09T12:39:30.155 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-09T12:39:28.634552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560673,"statfs":{"total":1600000000,"available":1598129626,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.032089"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613678+0000","last_change":"2023-08-09T12:39:25.635863+0000","last_active":"2023-08-09T12:39:26.613678+0000","last_peered":"2023-08-09T12:39:26.613678+0000","last_clean":"2023-08-09T12:39:26.613678+0000","last_became_active":"2023-08-09T12:39:25.635612+0000","last_became_peered":"2023-08-09T12:39:25.635612+0000","last_unstale":"2023-08-09T12:39:26.613678+0000","last_undegraded":"2023-08-09T12:39:26.613678+0000","last_fullsized":"2023-08-09T12:39:26.613678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.643372+0000","last_change":"2023-08-09T12:39:25.643258+0000","last_active":"2023-08-09T12:39:25.643372+0000","last_peered":"2023-08-09T12:39:25.643372+0000","last_clean":"2023-08-09T12:39:25.643372+0000","last_became_active":"2023-08-09T12:39:25.642998+0000","last_became_peered":"2023-08-09T12:39:25.642998+0000","last_unstale":"2023-08-09T12:39:25.643372+0000","last_undegraded":"2023-08-09T12:39:25.643372+0000","last_fullsized":"2023-08-09T12:39:25.643372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.646733+0000","last_change":"2023-08-09T12:39:25.646436+0000","last_active":"2023-08-09T12:39:25.646733+0000","last_peered":"2023-08-09T12:39:25.646733+0000","last_clean":"2023-08-09T12:39:25.646733+0000","last_became_active":"2023-08-09T12:39:25.646140+0000","last_became_peered":"2023-08-09T12:39:25.646140+0000","last_unstale":"2023-08-09T12:39:25.646733+0000","last_undegraded":"2023-08-09T12:39:25.646733+0000","last_fullsized":"2023-08-09T12:39:25.646733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:26.422299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616957+0000","last_change":"2023-08-09T12:39:25.633360+0000","last_active":"2023-08-09T12:39:26.616957+0000","last_peered":"2023-08-09T12:39:26.616957+0000","last_clean":"2023-08-09T12:39:26.616957+0000","last_became_active":"2023-08-09T12:39:25.632781+0000","last_became_peered":"2023-08-09T12:39:25.632781+0000","last_unstale":"2023-08-09T12:39:26.616957+0000","last_undegraded":"2023-08-09T12:39:26.616957+0000","last_fullsized":"2023-08-09T12:39:26.616957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:42.820863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.636524+0000","last_change":"2023-08-09T12:39:25.636182+0000","last_active":"2023-08-09T12:39:25.636524+0000","last_peered":"2023-08-09T12:39:25.636524+0000","last_clean":"2023-08-09T12:39:25.636524+0000","last_became_active":"2023-08-09T12:39:25.635794+0000","last_became_peered":"2023-08-09T12:39:25.635794+0000","last_unstale":"2023-08-09T12:39:25.636524+0000","last_undegraded":"2023-08-09T12:39:25.636524+0000","last_fullsized":"2023-08-09T12:39:25.636524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.650416+0000","last_change":"2023-08-09T12:39:25.650226+0000","last_active":"2023-08-09T12:39:25.650416+0000","last_peered":"2023-08-09T12:39:25.650416+0000","last_clean":"2023-08-09T12:39:25.650416+0000","last_became_active":"2023-08-09T12:39:25.646910+0000","last_became_peered":"2023-08-09T12:39:25.646910+0000","last_unstale":"2023-08-09T12:39:25.650416+0000","last_undegraded":"2023-08-09T12:39:25.650416+0000","last_fullsized":"2023-08-09T12:39:25.650416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.644147+0000","last_change":"2023-08-09T12:39:25.643948+0000","last_active":"2023-08-09T12:39:25.644147+0000","last_peered":"2023-08-09T12:39:25.644147+0000","last_clean":"2023-08-09T12:39:25.644147+0000","last_became_active":"2023-08-09T12:39:25.643568+0000","last_became_peered":"2023-08-09T12:39:25.643568+0000","last_unstale":"2023-08-09T12:39:25.644147+0000","last_undegraded":"2023-08-09T12:39:25.644147+0000","last_fullsized":"2023-08-09T12:39:25.644147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.637519+0000","last_change":"2023-08-09T12:39:25.636008+0000","last_active":"2023-08-09T12:39:25.637519+0000","last_peered":"2023-08-09T12:39:25.637519+0000","last_clean":"2023-08-09T12:39:25.637519+0000","last_became_active":"2023-08-09T12:39:25.635696+0000","last_became_peered":"2023-08-09T12:39:25.635696+0000","last_unstale":"2023-08-09T12:39:25.637519+0000","last_undegraded":"2023-08-09T12:39:25.637519+0000","last_fullsized":"2023-08-09T12:39:25.637519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:42.820863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.642320+0000","last_change":"2023-08-09T12:39:25.642164+0000","last_active":"2023-08-09T12:39:25.642320+0000","last_peered":"2023-08-09T12:39:25.642320+0000","last_clean":"2023-08-09T12:39:25.642320+0000","last_became_active":"2023-08-09T12:39:25.641895+0000","last_became_peered":"2023-08-09T12:39:25.641895+0000","last_unstale":"2023-08-09T12:39:25.642320+0000","last_undegraded":"2023-08-09T12:39:25.642320+0000","last_fullsized":"2023-08-09T12:39:25.642320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:16.783668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.637541+0000","last_change":"2023-08-09T12:39:25.637312+0000","last_active":"2023-08-09T12:39:25.637541+0000","last_peered":"2023-08-09T12:39:25.637541+0000","last_clean":"2023-08-09T12:39:25.637541+0000","last_became_active":"2023-08-09T12:39:25.636849+0000","last_became_peered":"2023-08-09T12:39:25.636849+0000","last_unstale":"2023-08-09T12:39:25.637541+0000","last_undegraded":"2023-08-09T12:39:25.637541+0000","last_fullsized":"2023-08-09T12:39:25.637541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:21.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.650602+0000","last_change":"2023-08-09T12:39:25.650515+0000","last_active":"2023-08-09T12:39:25.650602+0000","last_peered":"2023-08-09T12:39:25.650602+0000","last_clean":"2023-08-09T12:39:25.650602+0000","last_became_active":"2023-08-09T12:39:25.649243+0000","last_became_peered":"2023-08-09T12:39:25.649243+0000","last_unstale":"2023-08-09T12:39:25.650602+0000","last_undegraded":"2023-08-09T12:39:25.650602+0000","last_fullsized":"2023-08-09T12:39:25.650602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:16.783668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613554+0000","last_change":"2023-08-09T12:39:25.634920+0000","last_active":"2023-08-09T12:39:26.613554+0000","last_peered":"2023-08-09T12:39:26.613554+0000","last_clean":"2023-08-09T12:39:26.613554+0000","last_became_active":"2023-08-09T12:39:25.634629+0000","last_became_peered":"2023-08-09T12:39:25.634629+0000","last_unstale":"2023-08-09T12:39:26.613554+0000","last_undegraded":"2023-08-09T12:39:26.613554+0000","last_fullsized":"2023-08-09T12:39:26.613554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:15.819900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613610+0000","last_change":"2023-08-09T12:39:25.633027+0000","last_active":"2023-08-09T12:39:26.613610+0000","last_peered":"2023-08-09T12:39:26.613610+0000","last_clean":"2023-08-09T12:39:26.613610+0000","last_became_active":"2023-08-09T12:39:25.632604+0000","last_became_peered":"2023-08-09T12:39:25.632604+0000","last_unstale":"2023-08-09T12:39:26.613610+0000","last_undegraded":"2023-08-09T12:39:26.613610+0000","last_fullsized":"2023-08-09T12:39:26.613610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.639433+0000","last_change":"2023-08-09T12:39:25.639141+0000","last_active":"2023-08-09T12:39:25.639433+0000","last_peered":"2023-08-09T12:39:25.639433+0000","last_clean":"2023-08-09T12:39:25.639433+0000","last_became_active":"2023-08-09T12:39:25.638059+0000","last_became_peered":"2023-08-09T12:39:25.638059+0000","last_unstale":"2023-08-09T12:39:25.639433+0000","last_undegraded":"2023-08-09T12:39:25.639433+0000","last_fullsized":"2023-08-09T12:39:25.639433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.654706+0000","last_change":"2023-08-09T12:39:25.652960+0000","last_active":"2023-08-09T12:39:25.654706+0000","last_peered":"2023-08-09T12:39:25.654706+0000","last_clean":"2023-08-09T12:39:25.654706+0000","last_became_active":"2023-08-09T12:39:25.652713+0000","last_became_peered":"2023-08-09T12:39:25.652713+0000","last_unstale":"2023-08-09T12:39:25.654706+0000","last_undegraded":"2023-08-09T12:39:25.654706+0000","last_fullsized":"2023-08-09T12:39:25.654706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:36.686027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.650058+0000","last_change":"2023-08-09T12:39:25.649932+0000","last_active":"2023-08-09T12:39:25.650058+0000","last_peered":"2023-08-09T12:39:25.650058+0000","last_clean":"2023-08-09T12:39:25.650058+0000","last_became_active":"2023-08-09T12:39:25.645779+0000","last_became_peered":"2023-08-09T12:39:25.645779+0000","last_unstale":"2023-08-09T12:39:25.650058+0000","last_undegraded":"2023-08-09T12:39:25.650058+0000","last_fullsized":"2023-08-09T12:39:25.650058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:07.828328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.642337+0000","last_change":"2023-08-09T12:39:25.642272+0000","last_active":"2023-08-09T12:39:25.642337+0000","last_peered":"2023-08-09T12:39:25.642337+0000","last_clean":"2023-08-09T12:39:25.642337+0000","last_became_active":"2023-08-09T12:39:25.641857+0000","last_became_peered":"2023-08-09T12:39:25.641857+0000","last_unstale":"2023-08-09T12:39:25.642337+0000","last_undegraded":"2023-08-09T12:39:25.642337+0000","last_fullsized":"2023-08-09T12:39:25.642337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.638206+0000","last_change":"2023-08-09T12:39:25.638050+0000","last_active":"2023-08-09T12:39:25.638206+0000","last_peered":"2023-08-09T12:39:25.638206+0000","last_clean":"2023-08-09T12:39:25.638206+0000","last_became_active":"2023-08-09T12:39:25.637427+0000","last_became_peered":"2023-08-09T12:39:25.637427+0000","last_unstale":"2023-08-09T12:39:25.638206+0000","last_undegraded":"2023-08-09T12:39:25.638206+0000","last_fullsized":"2023-08-09T12:39:25.638206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613553+0000","last_change":"2023-08-09T12:39:25.625546+0000","last_active":"2023-08-09T12:39:26.613553+0000","last_peered":"2023-08-09T12:39:26.613553+0000","last_clean":"2023-08-09T12:39:26.613553+0000","last_became_active":"2023-08-09T12:39:25.623517+0000","last_became_peered":"2023-08-09T12:39:25.623517+0000","last_unstale":"2023-08-09T12:39:26.613553+0000","last_undegraded":"2023-08-09T12:39:26.613553+0000","last_fullsized":"2023-08-09T12:39:26.613553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.648897+0000","last_change":"2023-08-09T12:39:25.648778+0000","last_active":"2023-08-09T12:39:25.648897+0000","last_peered":"2023-08-09T12:39:25.648897+0000","last_clean":"2023-08-09T12:39:25.648897+0000","last_became_active":"2023-08-09T12:39:25.646303+0000","last_became_peered":"2023-08-09T12:39:25.646303+0000","last_unstale":"2023-08-09T12:39:25.648897+0000","last_undegraded":"2023-08-09T12:39:25.648897+0000","last_fullsized":"2023-08-09T12:39:25.648897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.624018+0000","last_change":"2023-08-09T12:39:25.621729+0000","last_active":"2023-08-09T12:39:25.624018+0000","last_peered":"2023-08-09T12:39:25.624018+0000","last_clean":"2023-08-09T12:39:25.624018+0000","last_became_active":"2023-08-09T12:39:25.620974+0000","last_became_peered":"2023-08-09T12:39:25.620974+0000","last_unstale":"2023-08-09T12:39:25.624018+0000","last_undegraded":"2023-08-09T12:39:25.624018+0000","last_fullsized":"2023-08-09T12:39:25.624018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:30.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.644527+0000","last_change":"2023-08-09T12:39:25.644455+0000","last_active":"2023-08-09T12:39:25.644527+0000","last_peered":"2023-08-09T12:39:25.644527+0000","last_clean":"2023-08-09T12:39:25.644527+0000","last_became_active":"2023-08-09T12:39:25.644178+0000","last_became_peered":"2023-08-09T12:39:25.644178+0000","last_unstale":"2023-08-09T12:39:25.644527+0000","last_undegraded":"2023-08-09T12:39:25.644527+0000","last_fullsized":"2023-08-09T12:39:25.644527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.614982+0000","last_change":"2023-08-09T12:39:25.638742+0000","last_active":"2023-08-09T12:39:26.614982+0000","last_peered":"2023-08-09T12:39:26.614982+0000","last_clean":"2023-08-09T12:39:26.614982+0000","last_became_active":"2023-08-09T12:39:25.638454+0000","last_became_peered":"2023-08-09T12:39:25.638454+0000","last_unstale":"2023-08-09T12:39:26.614982+0000","last_undegraded":"2023-08-09T12:39:26.614982+0000","last_fullsized":"2023-08-09T12:39:26.614982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:36.686027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.624150+0000","last_change":"2023-08-09T12:39:25.623830+0000","last_active":"2023-08-09T12:39:25.624150+0000","last_peered":"2023-08-09T12:39:25.624150+0000","last_clean":"2023-08-09T12:39:25.624150+0000","last_became_active":"2023-08-09T12:39:25.623070+0000","last_became_peered":"2023-08-09T12:39:25.623070+0000","last_unstale":"2023-08-09T12:39:25.624150+0000","last_undegraded":"2023-08-09T12:39:25.624150+0000","last_fullsized":"2023-08-09T12:39:25.624150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.653040+0000","last_change":"2023-08-09T12:39:25.652932+0000","last_active":"2023-08-09T12:39:25.653040+0000","last_peered":"2023-08-09T12:39:25.653040+0000","last_clean":"2023-08-09T12:39:25.653040+0000","last_became_active":"2023-08-09T12:39:25.651614+0000","last_became_peered":"2023-08-09T12:39:25.651614+0000","last_unstale":"2023-08-09T12:39:25.653040+0000","last_undegraded":"2023-08-09T12:39:25.653040+0000","last_fullsized":"2023-08-09T12:39:25.653040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.644754+0000","last_change":"2023-08-09T12:39:25.644658+0000","last_active":"2023-08-09T12:39:25.644754+0000","last_peered":"2023-08-09T12:39:25.644754+0000","last_clean":"2023-08-09T12:39:25.644754+0000","last_became_active":"2023-08-09T12:39:25.643855+0000","last_became_peered":"2023-08-09T12:39:25.643855+0000","last_unstale":"2023-08-09T12:39:25.644754+0000","last_undegraded":"2023-08-09T12:39:25.644754+0000","last_fullsized":"2023-08-09T12:39:25.644754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.640304+0000","last_change":"2023-08-09T12:39:25.640170+0000","last_active":"2023-08-09T12:39:25.640304+0000","last_peered":"2023-08-09T12:39:25.640304+0000","last_clean":"2023-08-09T12:39:25.640304+0000","last_became_active":"2023-08-09T12:39:25.639694+0000","last_became_peered":"2023-08-09T12:39:25.639694+0000","last_unstale":"2023-08-09T12:39:25.640304+0000","last_undegraded":"2023-08-09T12:39:25.640304+0000","last_fullsized":"2023-08-09T12:39:25.640304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.642786+0000","last_change":"2023-08-09T12:39:25.642608+0000","last_active":"2023-08-09T12:39:25.642786+0000","last_peered":"2023-08-09T12:39:25.642786+0000","last_clean":"2023-08-09T12:39:25.642786+0000","last_became_active":"2023-08-09T12:39:25.637346+0000","last_became_peered":"2023-08-09T12:39:25.637346+0000","last_unstale":"2023-08-09T12:39:25.642786+0000","last_undegraded":"2023-08-09T12:39:25.642786+0000","last_fullsized":"2023-08-09T12:39:25.642786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:01:12.743573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615253+0000","last_change":"2023-08-09T12:39:25.640403+0000","last_active":"2023-08-09T12:39:26.615253+0000","last_peered":"2023-08-09T12:39:26.615253+0000","last_clean":"2023-08-09T12:39:26.615253+0000","last_became_active":"2023-08-09T12:39:25.635661+0000","last_became_peered":"2023-08-09T12:39:25.635661+0000","last_unstale":"2023-08-09T12:39:26.615253+0000","last_undegraded":"2023-08-09T12:39:26.615253+0000","last_fullsized":"2023-08-09T12:39:26.615253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:47.710010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.647004+0000","last_change":"2023-08-09T12:39:25.646903+0000","last_active":"2023-08-09T12:39:25.647004+0000","last_peered":"2023-08-09T12:39:25.647004+0000","last_clean":"2023-08-09T12:39:25.647004+0000","last_became_active":"2023-08-09T12:39:25.645744+0000","last_became_peered":"2023-08-09T12:39:25.645744+0000","last_unstale":"2023-08-09T12:39:25.647004+0000","last_undegraded":"2023-08-09T12:39:25.647004+0000","last_fullsized":"2023-08-09T12:39:25.647004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615530+0000","last_change":"2023-08-09T12:39:25.645982+0000","last_active":"2023-08-09T12:39:26.615530+0000","last_peered":"2023-08-09T12:39:26.615530+0000","last_clean":"2023-08-09T12:39:26.615530+0000","last_became_active":"2023-08-09T12:39:25.645632+0000","last_became_peered":"2023-08-09T12:39:25.645632+0000","last_unstale":"2023-08-09T12:39:26.615530+0000","last_undegraded":"2023-08-09T12:39:26.615530+0000","last_fullsized":"2023-08-09T12:39:26.615530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616738+0000","last_change":"2023-08-09T12:39:25.632004+0000","last_active":"2023-08-09T12:39:26.616738+0000","last_peered":"2023-08-09T12:39:26.616738+0000","last_clean":"2023-08-09T12:39:26.616738+0000","last_became_active":"2023-08-09T12:39:25.631477+0000","last_became_peered":"2023-08-09T12:39:25.631477+0000","last_unstale":"2023-08-09T12:39:26.616738+0000","last_undegraded":"2023-08-09T12:39:26.616738+0000","last_fullsized":"2023-08-09T12:39:26.616738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615919+0000","last_change":"2023-08-09T12:39:25.641384+0000","last_active":"2023-08-09T12:39:26.615919+0000","last_peered":"2023-08-09T12:39:26.615919+0000","last_clean":"2023-08-09T12:39:26.615919+0000","last_became_active":"2023-08-09T12:39:25.640764+0000","last_became_peered":"2023-08-09T12:39:25.640764+0000","last_unstale":"2023-08-09T12:39:26.615919+0000","last_undegraded":"2023-08-09T12:39:26.615919+0000","last_fullsized":"2023-08-09T12:39:26.615919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:33.925265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.659201+0000","last_change":"2023-08-09T12:39:24.640639+0000","last_active":"2023-08-09T12:39:25.659201+0000","last_peered":"2023-08-09T12:39:25.659201+0000","last_clean":"2023-08-09T12:39:25.659201+0000","last_became_active":"2023-08-09T12:39:24.640266+0000","last_became_peered":"2023-08-09T12:39:24.640266+0000","last_unstale":"2023-08-09T12:39:25.659201+0000","last_undegraded":"2023-08-09T12:39:25.659201+0000","last_fullsized":"2023-08-09T12:39:25.659201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.633579+0000","last_change":"2023-08-09T12:39:25.631972+0000","last_active":"2023-08-09T12:39:25.633579+0000","last_peered":"2023-08-09T12:39:25.633579+0000","last_clean":"2023-08-09T12:39:25.633579+0000","last_became_active":"2023-08-09T12:39:25.631386+0000","last_became_peered":"2023-08-09T12:39:25.631386+0000","last_unstale":"2023-08-09T12:39:25.633579+0000","last_undegraded":"2023-08-09T12:39:25.633579+0000","last_fullsized":"2023-08-09T12:39:25.633579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.627829+0000","last_change":"2023-08-09T12:39:24.631980+0000","last_active":"2023-08-09T12:39:25.627829+0000","last_peered":"2023-08-09T12:39:25.627829+0000","last_clean":"2023-08-09T12:39:25.627829+0000","last_became_active":"2023-08-09T12:39:24.631321+0000","last_became_peered":"2023-08-09T12:39:24.631321+0000","last_unstale":"2023-08-09T12:39:25.627829+0000","last_undegraded":"2023-08-09T12:39:25.627829+0000","last_fullsized":"2023-08-09T12:39:25.627829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:37.798834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.642301+0000","last_change":"2023-08-09T12:39:25.642115+0000","last_active":"2023-08-09T12:39:25.642301+0000","last_peered":"2023-08-09T12:39:25.642301+0000","last_clean":"2023-08-09T12:39:25.642301+0000","last_became_active":"2023-08-09T12:39:25.641510+0000","last_became_peered":"2023-08-09T12:39:25.641510+0000","last_unstale":"2023-08-09T12:39:25.642301+0000","last_undegraded":"2023-08-09T12:39:25.642301+0000","last_fullsized":"2023-08-09T12:39:25.642301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.613431+0000","last_change":"2023-08-09T12:39:24.640562+0000","last_active":"2023-08-09T12:39:25.613431+0000","last_peered":"2023-08-09T12:39:25.613431+0000","last_clean":"2023-08-09T12:39:25.613431+0000","last_became_active":"2023-08-09T12:39:24.640227+0000","last_became_peered":"2023-08-09T12:39:24.640227+0000","last_unstale":"2023-08-09T12:39:25.613431+0000","last_undegraded":"2023-08-09T12:39:25.613431+0000","last_fullsized":"2023-08-09T12:39:25.613431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:32.216613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615401+0000","last_change":"2023-08-09T12:39:25.629884+0000","last_active":"2023-08-09T12:39:26.615401+0000","last_peered":"2023-08-09T12:39:26.615401+0000","last_clean":"2023-08-09T12:39:26.615401+0000","last_became_active":"2023-08-09T12:39:25.629153+0000","last_became_peered":"2023-08-09T12:39:25.629153+0000","last_unstale":"2023-08-09T12:39:26.615401+0000","last_undegraded":"2023-08-09T12:39:26.615401+0000","last_fullsized":"2023-08-09T12:39:26.615401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617036+0000","last_change":"2023-08-09T12:39:24.634685+0000","last_active":"2023-08-09T12:39:26.617036+0000","last_peered":"2023-08-09T12:39:26.617036+0000","last_clean":"2023-08-09T12:39:26.617036+0000","last_became_active":"2023-08-09T12:39:24.634383+0000","last_became_peered":"2023-08-09T12:39:24.634383+0000","last_unstale":"2023-08-09T12:39:26.617036+0000","last_undegraded":"2023-08-09T12:39:26.617036+0000","last_fullsized":"2023-08-09T12:39:26.617036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.654896+0000","last_change":"2023-08-09T12:39:24.641613+0000","last_active":"2023-08-09T12:39:25.654896+0000","last_peered":"2023-08-09T12:39:25.654896+0000","last_clean":"2023-08-09T12:39:25.654896+0000","last_became_active":"2023-08-09T12:39:24.641213+0000","last_became_peered":"2023-08-09T12:39:24.641213+0000","last_unstale":"2023-08-09T12:39:25.654896+0000","last_undegraded":"2023-08-09T12:39:25.654896+0000","last_fullsized":"2023-08-09T12:39:25.654896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:55.511153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.634815+0000","last_change":"2023-08-09T12:39:25.634677+0000","last_active":"2023-08-09T12:39:25.634815+0000","last_peered":"2023-08-09T12:39:25.634815+0000","last_clean":"2023-08-09T12:39:25.634815+0000","last_became_active":"2023-08-09T12:39:25.634264+0000","last_became_peered":"2023-08-09T12:39:25.634264+0000","last_unstale":"2023-08-09T12:39:25.634815+0000","last_undegraded":"2023-08-09T12:39:25.634815+0000","last_fullsized":"2023-08-09T12:39:25.634815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.658744+0000","last_change":"2023-08-09T12:39:24.641554+0000","last_active":"2023-08-09T12:39:25.658744+0000","last_peered":"2023-08-09T12:39:25.658744+0000","last_clean":"2023-08-09T12:39:25.658744+0000","last_became_active":"2023-08-09T12:39:24.641197+0000","last_became_peered":"2023-08-09T12:39:24.641197+0000","last_unstale":"2023-08-09T12:39:25.658744+0000","last_undegraded":"2023-08-09T12:39:25.658744+0000","last_fullsized":"2023-08-09T12:39:25.658744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:25.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.659293+0000","last_change":"2023-08-09T12:39:25.659204+0000","last_active":"2023-08-09T12:39:25.659293+0000","last_peered":"2023-08-09T12:39:25.659293+0000","last_clean":"2023-08-09T12:39:25.659293+0000","last_became_active":"2023-08-09T12:39:25.657091+0000","last_became_peered":"2023-08-09T12:39:25.657091+0000","last_unstale":"2023-08-09T12:39:25.659293+0000","last_undegraded":"2023-08-09T12:39:25.659293+0000","last_fullsized":"2023-08-09T12:39:25.659293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:42.820863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.654644+0000","last_change":"2023-08-09T12:39:24.628533+0000","last_active":"2023-08-09T12:39:25.654644+0000","last_peered":"2023-08-09T12:39:25.654644+0000","last_clean":"2023-08-09T12:39:25.654644+0000","last_became_active":"2023-08-09T12:39:24.628153+0000","last_became_peered":"2023-08-09T12:39:24.628153+0000","last_unstale":"2023-08-09T12:39:25.654644+0000","last_undegraded":"2023-08-09T12:39:25.654644+0000","last_fullsized":"2023-08-09T12:39:25.654644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:46.705148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617326+0000","last_change":"2023-08-09T12:39:25.638917+0000","last_active":"2023-08-09T12:39:26.617326+0000","last_peered":"2023-08-09T12:39:26.617326+0000","last_clean":"2023-08-09T12:39:26.617326+0000","last_became_active":"2023-08-09T12:39:25.638612+0000","last_became_peered":"2023-08-09T12:39:25.638612+0000","last_unstale":"2023-08-09T12:39:26.617326+0000","last_undegraded":"2023-08-09T12:39:26.617326+0000","last_fullsized":"2023-08-09T12:39:26.617326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.629734+0000","last_change":"2023-08-09T12:39:24.634717+0000","last_active":"2023-08-09T12:39:25.629734+0000","last_peered":"2023-08-09T12:39:25.629734+0000","last_clean":"2023-08-09T12:39:25.629734+0000","last_became_active":"2023-08-09T12:39:24.634225+0000","last_became_peered":"2023-08-09T12:39:24.634225+0000","last_unstale":"2023-08-09T12:39:25.629734+0000","last_undegraded":"2023-08-09T12:39:25.629734+0000","last_fullsized":"2023-08-09T12:39:25.629734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:46.705148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.645953+0000","last_change":"2023-08-09T12:39:25.645761+0000","last_active":"2023-08-09T12:39:25.645953+0000","last_peered":"2023-08-09T12:39:25.645953+0000","last_clean":"2023-08-09T12:39:25.645953+0000","last_became_active":"2023-08-09T12:39:25.645313+0000","last_became_peered":"2023-08-09T12:39:25.645313+0000","last_unstale":"2023-08-09T12:39:25.645953+0000","last_undegraded":"2023-08-09T12:39:25.645953+0000","last_fullsized":"2023-08-09T12:39:25.645953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:01:12.743573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615527+0000","last_change":"2023-08-09T12:39:24.636912+0000","last_active":"2023-08-09T12:39:26.615527+0000","last_peered":"2023-08-09T12:39:26.615527+0000","last_clean":"2023-08-09T12:39:26.615527+0000","last_became_active":"2023-08-09T12:39:24.636156+0000","last_became_peered":"2023-08-09T12:39:24.636156+0000","last_unstale":"2023-08-09T12:39:26.615527+0000","last_undegraded":"2023-08-09T12:39:26.615527+0000","last_fullsized":"2023-08-09T12:39:26.615527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.646813+0000","last_change":"2023-08-09T12:39:25.646628+0000","last_active":"2023-08-09T12:39:25.646813+0000","last_peered":"2023-08-09T12:39:25.646813+0000","last_clean":"2023-08-09T12:39:25.646813+0000","last_became_active":"2023-08-09T12:39:25.646139+0000","last_became_peered":"2023-08-09T12:39:25.646139+0000","last_unstale":"2023-08-09T12:39:25.646813+0000","last_undegraded":"2023-08-09T12:39:25.646813+0000","last_fullsized":"2023-08-09T12:39:25.646813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:38:19.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617710+0000","last_change":"2023-08-09T12:39:24.632474+0000","last_active":"2023-08-09T12:39:26.617710+0000","last_peered":"2023-08-09T12:39:26.617710+0000","last_clean":"2023-08-09T12:39:26.617710+0000","last_became_active":"2023-08-09T12:39:24.631809+0000","last_became_peered":"2023-08-09T12:39:24.631809+0000","last_unstale":"2023-08-09T12:39:26.617710+0000","last_undegraded":"2023-08-09T12:39:26.617710+0000","last_fullsized":"2023-08-09T12:39:26.617710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:35.681165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.649779+0000","last_change":"2023-08-09T12:39:25.649637+0000","last_active":"2023-08-09T12:39:25.649779+0000","last_peered":"2023-08-09T12:39:25.649779+0000","last_clean":"2023-08-09T12:39:25.649779+0000","last_became_active":"2023-08-09T12:39:25.644325+0000","last_became_peered":"2023-08-09T12:39:25.644325+0000","last_unstale":"2023-08-09T12:39:25.649779+0000","last_undegraded":"2023-08-09T12:39:25.649779+0000","last_fullsized":"2023-08-09T12:39:25.649779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:01:12.743573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.635570+0000","last_change":"2023-08-09T12:39:24.629489+0000","last_active":"2023-08-09T12:39:25.635570+0000","last_peered":"2023-08-09T12:39:25.635570+0000","last_clean":"2023-08-09T12:39:25.635570+0000","last_became_active":"2023-08-09T12:39:24.629107+0000","last_became_peered":"2023-08-09T12:39:24.629107+0000","last_unstale":"2023-08-09T12:39:25.635570+0000","last_undegraded":"2023-08-09T12:39:25.635570+0000","last_fullsized":"2023-08-09T12:39:25.635570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:35.681165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.638231+0000","last_change":"2023-08-09T12:39:25.638108+0000","last_active":"2023-08-09T12:39:25.638231+0000","last_peered":"2023-08-09T12:39:25.638231+0000","last_clean":"2023-08-09T12:39:25.638231+0000","last_became_active":"2023-08-09T12:39:25.636796+0000","last_became_peered":"2023-08-09T12:39:25.636796+0000","last_unstale":"2023-08-09T12:39:25.638231+0000","last_undegraded":"2023-08-09T12:39:25.638231+0000","last_fullsized":"2023-08-09T12:39:25.638231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615617+0000","last_change":"2023-08-09T12:39:24.628803+0000","last_active":"2023-08-09T12:39:26.615617+0000","last_peered":"2023-08-09T12:39:26.615617+0000","last_clean":"2023-08-09T12:39:26.615617+0000","last_became_active":"2023-08-09T12:39:24.628410+0000","last_became_peered":"2023-08-09T12:39:24.628410+0000","last_unstale":"2023-08-09T12:39:26.615617+0000","last_undegraded":"2023-08-09T12:39:26.615617+0000","last_fullsized":"2023-08-09T12:39:26.615617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:32.805465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.643449+0000","last_change":"2023-08-09T12:39:25.643385+0000","last_active":"2023-08-09T12:39:25.643449+0000","last_peered":"2023-08-09T12:39:25.643449+0000","last_clean":"2023-08-09T12:39:25.643449+0000","last_became_active":"2023-08-09T12:39:25.643109+0000","last_became_peered":"2023-08-09T12:39:25.643109+0000","last_unstale":"2023-08-09T12:39:25.643449+0000","last_undegraded":"2023-08-09T12:39:25.643449+0000","last_fullsized":"2023-08-09T12:39:25.643449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.613971+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:39:25.613971+0000","last_peered":"2023-08-09T12:39:25.613971+0000","last_clean":"2023-08-09T12:39:25.613971+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:39:25.613971+0000","last_undegraded":"2023-08-09T12:39:25.613971+0000","last_fullsized":"2023-08-09T12:39:25.613971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:04:56.540645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.626584+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:39:25.626584+0000","last_peered":"2023-08-09T12:39:25.626584+0000","last_clean":"2023-08-09T12:39:25.626584+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:39:25.626584+0000","last_undegraded":"2023-08-09T12:39:25.626584+0000","last_fullsized":"2023-08-09T12:39:25.626584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:30.350165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615676+0000","last_change":"2023-08-09T12:39:24.635989+0000","last_active":"2023-08-09T12:39:26.615676+0000","last_peered":"2023-08-09T12:39:26.615676+0000","last_clean":"2023-08-09T12:39:26.615676+0000","last_became_active":"2023-08-09T12:39:24.635506+0000","last_became_peered":"2023-08-09T12:39:24.635506+0000","last_unstale":"2023-08-09T12:39:26.615676+0000","last_undegraded":"2023-08-09T12:39:26.615676+0000","last_fullsized":"2023-08-09T12:39:26.615676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:47.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617544+0000","last_change":"2023-08-09T12:39:25.637598+0000","last_active":"2023-08-09T12:39:26.617544+0000","last_peered":"2023-08-09T12:39:26.617544+0000","last_clean":"2023-08-09T12:39:26.617544+0000","last_became_active":"2023-08-09T12:39:25.637286+0000","last_became_peered":"2023-08-09T12:39:25.637286+0000","last_unstale":"2023-08-09T12:39:26.617544+0000","last_undegraded":"2023-08-09T12:39:26.617544+0000","last_fullsized":"2023-08-09T12:39:26.617544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.613668+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:39:25.613668+0000","last_peered":"2023-08-09T12:39:25.613668+0000","last_clean":"2023-08-09T12:39:25.613668+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:39:25.613668+0000","last_undegraded":"2023-08-09T12:39:25.613668+0000","last_fullsized":"2023-08-09T12:39:25.613668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:16.514526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.634032+0000","last_change":"2023-08-09T12:39:24.636357+0000","last_active":"2023-08-09T12:39:25.634032+0000","last_peered":"2023-08-09T12:39:25.634032+0000","last_clean":"2023-08-09T12:39:25.634032+0000","last_became_active":"2023-08-09T12:39:24.634441+0000","last_became_peered":"2023-08-09T12:39:24.634441+0000","last_unstale":"2023-08-09T12:39:25.634032+0000","last_undegraded":"2023-08-09T12:39:25.634032+0000","last_fullsized":"2023-08-09T12:39:25.634032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:55.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.645935+0000","last_change":"2023-08-09T12:39:25.645605+0000","last_active":"2023-08-09T12:39:25.645935+0000","last_peered":"2023-08-09T12:39:25.645935+0000","last_clean":"2023-08-09T12:39:25.645935+0000","last_became_active":"2023-08-09T12:39:25.644989+0000","last_became_peered":"2023-08-09T12:39:25.644989+0000","last_unstale":"2023-08-09T12:39:25.645935+0000","last_undegraded":"2023-08-09T12:39:25.645935+0000","last_fullsized":"2023-08-09T12:39:25.645935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:07.828328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613725+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:39:26.613725+0000","last_peered":"2023-08-09T12:39:26.613725+0000","last_clean":"2023-08-09T12:39:26.613725+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:39:26.613725+0000","last_undegraded":"2023-08-09T12:39:26.613725+0000","last_fullsized":"2023-08-09T12:39:26.613725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:46.297345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.632287+0000","last_change":"2023-08-09T12:39:24.623190+0000","last_active":"2023-08-09T12:39:25.632287+0000","last_peered":"2023-08-09T12:39:25.632287+0000","last_clean":"2023-08-09T12:39:25.632287+0000","last_became_active":"2023-08-09T12:39:24.622946+0000","last_became_peered":"2023-08-09T12:39:24.622946+0000","last_unstale":"2023-08-09T12:39:25.632287+0000","last_undegraded":"2023-08-09T12:39:25.632287+0000","last_fullsized":"2023-08-09T12:39:25.632287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:41.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.657096+0000","last_change":"2023-08-09T12:39:25.656984+0000","last_active":"2023-08-09T12:39:25.657096+0000","last_peered":"2023-08-09T12:39:25.657096+0000","last_clean":"2023-08-09T12:39:25.657096+0000","last_became_active":"2023-08-09T12:39:25.651565+0000","last_became_peered":"2023-08-09T12:39:25.651565+0000","last_unstale":"2023-08-09T12:39:25.657096+0000","last_undegraded":"2023-08-09T12:39:25.657096+0000","last_fullsized":"2023-08-09T12:39:25.657096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:15.819900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.629892+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:39:25.629892+0000","last_peered":"2023-08-09T12:39:25.629892+0000","last_clean":"2023-08-09T12:39:25.629892+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:39:25.629892+0000","last_undegraded":"2023-08-09T12:39:25.629892+0000","last_fullsized":"2023-08-09T12:39:25.629892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:26.885613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.629960+0000","last_change":"2023-08-09T12:39:24.633725+0000","last_active":"2023-08-09T12:39:25.629960+0000","last_peered":"2023-08-09T12:39:25.629960+0000","last_clean":"2023-08-09T12:39:25.629960+0000","last_became_active":"2023-08-09T12:39:24.633401+0000","last_became_peered":"2023-08-09T12:39:24.633401+0000","last_unstale":"2023-08-09T12:39:25.629960+0000","last_undegraded":"2023-08-09T12:39:25.629960+0000","last_fullsized":"2023-08-09T12:39:25.629960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:28.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.652236+0000","last_change":"2023-08-09T12:39:25.652044+0000","last_active":"2023-08-09T12:39:25.652236+0000","last_peered":"2023-08-09T12:39:25.652236+0000","last_clean":"2023-08-09T12:39:25.652236+0000","last_became_active":"2023-08-09T12:39:25.646950+0000","last_became_peered":"2023-08-09T12:39:25.646950+0000","last_unstale":"2023-08-09T12:39:25.652236+0000","last_undegraded":"2023-08-09T12:39:25.652236+0000","last_fullsized":"2023-08-09T12:39:25.652236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.623213+0000","last_change":"2023-08-09T12:39:24.629351+0000","last_active":"2023-08-09T12:39:25.623213+0000","last_peered":"2023-08-09T12:39:25.623213+0000","last_clean":"2023-08-09T12:39:25.623213+0000","last_became_active":"2023-08-09T12:39:24.628605+0000","last_became_peered":"2023-08-09T12:39:24.628605+0000","last_unstale":"2023-08-09T12:39:25.623213+0000","last_undegraded":"2023-08-09T12:39:25.623213+0000","last_fullsized":"2023-08-09T12:39:25.623213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.635404+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:39:25.635404+0000","last_peered":"2023-08-09T12:39:25.635404+0000","last_clean":"2023-08-09T12:39:25.635404+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:39:25.635404+0000","last_undegraded":"2023-08-09T12:39:25.635404+0000","last_fullsized":"2023-08-09T12:39:25.635404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:50.219229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.656700+0000","last_change":"2023-08-09T12:39:25.656505+0000","last_active":"2023-08-09T12:39:25.656700+0000","last_peered":"2023-08-09T12:39:25.656700+0000","last_clean":"2023-08-09T12:39:25.656700+0000","last_became_active":"2023-08-09T12:39:25.651066+0000","last_became_peered":"2023-08-09T12:39:25.651066+0000","last_unstale":"2023-08-09T12:39:25.656700+0000","last_undegraded":"2023-08-09T12:39:25.656700+0000","last_fullsized":"2023-08-09T12:39:25.656700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:16.783668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.635313+0000","last_change":"2023-08-09T12:39:24.624402+0000","last_active":"2023-08-09T12:39:25.635313+0000","last_peered":"2023-08-09T12:39:25.635313+0000","last_clean":"2023-08-09T12:39:25.635313+0000","last_became_active":"2023-08-09T12:39:24.623543+0000","last_became_peered":"2023-08-09T12:39:24.623543+0000","last_unstale":"2023-08-09T12:39:25.635313+0000","last_undegraded":"2023-08-09T12:39:25.635313+0000","last_fullsized":"2023-08-09T12:39:25.635313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:20.515256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.613387+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:39:25.613387+0000","last_peered":"2023-08-09T12:39:25.613387+0000","last_clean":"2023-08-09T12:39:25.613387+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:39:25.613387+0000","last_undegraded":"2023-08-09T12:39:25.613387+0000","last_fullsized":"2023-08-09T12:39:25.613387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:38.946780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.637229+0000","last_change":"2023-08-09T12:39:25.637151+0000","last_active":"2023-08-09T12:39:25.637229+0000","last_peered":"2023-08-09T12:39:25.637229+0000","last_clean":"2023-08-09T12:39:25.637229+0000","last_became_active":"2023-08-09T12:39:25.636899+0000","last_became_peered":"2023-08-09T12:39:25.636899+0000","last_unstale":"2023-08-09T12:39:25.637229+0000","last_undegraded":"2023-08-09T12:39:25.637229+0000","last_fullsized":"2023-08-09T12:39:25.637229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:38:19.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615546+0000","last_change":"2023-08-09T12:39:24.628972+0000","last_active":"2023-08-09T12:39:26.615546+0000","last_peered":"2023-08-09T12:39:26.615546+0000","last_clean":"2023-08-09T12:39:26.615546+0000","last_became_active":"2023-08-09T12:39:24.628110+0000","last_became_peered":"2023-08-09T12:39:24.628110+0000","last_unstale":"2023-08-09T12:39:26.615546+0000","last_undegraded":"2023-08-09T12:39:26.615546+0000","last_fullsized":"2023-08-09T12:39:26.615546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:25.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.633087+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:39:25.633087+0000","last_peered":"2023-08-09T12:39:25.633087+0000","last_clean":"2023-08-09T12:39:25.633087+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:39:25.633087+0000","last_undegraded":"2023-08-09T12:39:25.633087+0000","last_fullsized":"2023-08-09T12:39:25.633087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:52.854435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615554+0000","last_change":"2023-08-09T12:39:25.641020+0000","last_active":"2023-08-09T12:39:26.615554+0000","last_peered":"2023-08-09T12:39:26.615554+0000","last_clean":"2023-08-09T12:39:26.615554+0000","last_became_active":"2023-08-09T12:39:25.638752+0000","last_became_peered":"2023-08-09T12:39:25.638752+0000","last_unstale":"2023-08-09T12:39:26.615554+0000","last_undegraded":"2023-08-09T12:39:26.615554+0000","last_fullsized":"2023-08-09T12:39:26.615554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:44.285538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.633555+0000","last_change":"2023-08-09T12:39:24.636769+0000","last_active":"2023-08-09T12:39:25.633555+0000","last_peered":"2023-08-09T12:39:25.633555+0000","last_clean":"2023-08-09T12:39:25.633555+0000","last_became_active":"2023-08-09T12:39:24.635218+0000","last_became_peered":"2023-08-09T12:39:24.635218+0000","last_unstale":"2023-08-09T12:39:25.633555+0000","last_undegraded":"2023-08-09T12:39:25.633555+0000","last_fullsized":"2023-08-09T12:39:25.633555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616980+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:39:26.616980+0000","last_peered":"2023-08-09T12:39:26.616980+0000","last_clean":"2023-08-09T12:39:26.616980+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:39:26.616980+0000","last_undegraded":"2023-08-09T12:39:26.616980+0000","last_fullsized":"2023-08-09T12:39:26.616980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:15.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.634943+0000","last_change":"2023-08-09T12:39:25.634557+0000","last_active":"2023-08-09T12:39:25.634943+0000","last_peered":"2023-08-09T12:39:25.634943+0000","last_clean":"2023-08-09T12:39:25.634943+0000","last_became_active":"2023-08-09T12:39:25.633799+0000","last_became_peered":"2023-08-09T12:39:25.633799+0000","last_unstale":"2023-08-09T12:39:25.634943+0000","last_undegraded":"2023-08-09T12:39:25.634943+0000","last_fullsized":"2023-08-09T12:39:25.634943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:22.587888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.643976+0000","last_change":"2023-08-09T12:39:25.643842+0000","last_active":"2023-08-09T12:39:25.643976+0000","last_peered":"2023-08-09T12:39:25.643976+0000","last_clean":"2023-08-09T12:39:25.643976+0000","last_became_active":"2023-08-09T12:39:25.637275+0000","last_became_peered":"2023-08-09T12:39:25.637275+0000","last_unstale":"2023-08-09T12:39:25.643976+0000","last_undegraded":"2023-08-09T12:39:25.643976+0000","last_fullsized":"2023-08-09T12:39:25.643976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.660534+0000","last_change":"2023-08-09T12:39:24.640696+0000","last_active":"2023-08-09T12:39:25.660534+0000","last_peered":"2023-08-09T12:39:25.660534+0000","last_clean":"2023-08-09T12:39:25.660534+0000","last_became_active":"2023-08-09T12:39:24.640413+0000","last_became_peered":"2023-08-09T12:39:24.640413+0000","last_unstale":"2023-08-09T12:39:25.660534+0000","last_undegraded":"2023-08-09T12:39:25.660534+0000","last_fullsized":"2023-08-09T12:39:25.660534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:00:23.709248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.644527+0000","last_change":"2023-08-09T12:39:25.644428+0000","last_active":"2023-08-09T12:39:25.644527+0000","last_peered":"2023-08-09T12:39:25.644527+0000","last_clean":"2023-08-09T12:39:25.644527+0000","last_became_active":"2023-08-09T12:39:25.643285+0000","last_became_peered":"2023-08-09T12:39:25.643285+0000","last_unstale":"2023-08-09T12:39:25.644527+0000","last_undegraded":"2023-08-09T12:39:25.644527+0000","last_fullsized":"2023-08-09T12:39:25.644527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.657293+0000","last_change":"2023-08-09T12:39:24.637201+0000","last_active":"2023-08-09T12:39:25.657293+0000","last_peered":"2023-08-09T12:39:25.657293+0000","last_clean":"2023-08-09T12:39:25.657293+0000","last_became_active":"2023-08-09T12:39:24.636809+0000","last_became_peered":"2023-08-09T12:39:24.636809+0000","last_unstale":"2023-08-09T12:39:25.657293+0000","last_undegraded":"2023-08-09T12:39:25.657293+0000","last_fullsized":"2023-08-09T12:39:25.657293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:20.515256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.629435+0000","last_change":"2023-08-09T12:39:24.632390+0000","last_active":"2023-08-09T12:39:25.629435+0000","last_peered":"2023-08-09T12:39:25.629435+0000","last_clean":"2023-08-09T12:39:25.629435+0000","last_became_active":"2023-08-09T12:39:24.631880+0000","last_became_peered":"2023-08-09T12:39:24.631880+0000","last_unstale":"2023-08-09T12:39:25.629435+0000","last_undegraded":"2023-08-09T12:39:25.629435+0000","last_fullsized":"2023-08-09T12:39:25.629435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:55.511153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615322+0000","last_change":"2023-08-09T12:39:25.622421+0000","last_active":"2023-08-09T12:39:26.615322+0000","last_peered":"2023-08-09T12:39:26.615322+0000","last_clean":"2023-08-09T12:39:26.615322+0000","last_became_active":"2023-08-09T12:39:25.621727+0000","last_became_peered":"2023-08-09T12:39:25.621727+0000","last_unstale":"2023-08-09T12:39:26.615322+0000","last_undegraded":"2023-08-09T12:39:26.615322+0000","last_fullsized":"2023-08-09T12:39:26.615322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.627606+0000","last_change":"2023-08-09T12:39:24.632830+0000","last_active":"2023-08-09T12:39:25.627606+0000","last_peered":"2023-08-09T12:39:25.627606+0000","last_clean":"2023-08-09T12:39:25.627606+0000","last_became_active":"2023-08-09T12:39:24.631677+0000","last_became_peered":"2023-08-09T12:39:24.631677+0000","last_unstale":"2023-08-09T12:39:25.627606+0000","last_undegraded":"2023-08-09T12:39:25.627606+0000","last_fullsized":"2023-08-09T12:39:25.627606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:14.815038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615307+0000","last_change":"2023-08-09T12:39:25.638155+0000","last_active":"2023-08-09T12:39:26.615307+0000","last_peered":"2023-08-09T12:39:26.615307+0000","last_clean":"2023-08-09T12:39:26.615307+0000","last_became_active":"2023-08-09T12:39:25.635955+0000","last_became_peered":"2023-08-09T12:39:25.635955+0000","last_unstale":"2023-08-09T12:39:26.615307+0000","last_undegraded":"2023-08-09T12:39:26.615307+0000","last_fullsized":"2023-08-09T12:39:26.615307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:33.221475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616702+0000","last_change":"2023-08-09T12:39:25.630728+0000","last_active":"2023-08-09T12:39:26.616702+0000","last_peered":"2023-08-09T12:39:26.616702+0000","last_clean":"2023-08-09T12:39:26.616702+0000","last_became_active":"2023-08-09T12:39:25.630222+0000","last_became_peered":"2023-08-09T12:39:25.630222+0000","last_unstale":"2023-08-09T12:39:26.616702+0000","last_undegraded":"2023-08-09T12:39:26.616702+0000","last_fullsized":"2023-08-09T12:39:26.616702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615209+0000","last_change":"2023-08-09T12:39:24.631880+0000","last_active":"2023-08-09T12:39:26.615209+0000","last_peered":"2023-08-09T12:39:26.615209+0000","last_clean":"2023-08-09T12:39:26.615209+0000","last_became_active":"2023-08-09T12:39:24.631638+0000","last_became_peered":"2023-08-09T12:39:24.631638+0000","last_unstale":"2023-08-09T12:39:26.615209+0000","last_undegraded":"2023-08-09T12:39:26.615209+0000","last_fullsized":"2023-08-09T12:39:26.615209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:55.511153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.635453+0000","last_change":"2023-08-09T12:39:25.635263+0000","last_active":"2023-08-09T12:39:25.635453+0000","last_peered":"2023-08-09T12:39:25.635453+0000","last_clean":"2023-08-09T12:39:25.635453+0000","last_became_active":"2023-08-09T12:39:25.634710+0000","last_became_peered":"2023-08-09T12:39:25.634710+0000","last_unstale":"2023-08-09T12:39:25.635453+0000","last_undegraded":"2023-08-09T12:39:25.635453+0000","last_fullsized":"2023-08-09T12:39:25.635453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:26.422299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.630989+0000","last_change":"2023-08-09T12:39:24.633355+0000","last_active":"2023-08-09T12:39:25.630989+0000","last_peered":"2023-08-09T12:39:25.630989+0000","last_clean":"2023-08-09T12:39:25.630989+0000","last_became_active":"2023-08-09T12:39:24.633106+0000","last_became_peered":"2023-08-09T12:39:24.633106+0000","last_unstale":"2023-08-09T12:39:25.630989+0000","last_undegraded":"2023-08-09T12:39:25.630989+0000","last_fullsized":"2023-08-09T12:39:25.630989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:28.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615076+0000","last_change":"2023-08-09T12:39:25.652713+0000","last_active":"2023-08-09T12:39:26.615076+0000","last_peered":"2023-08-09T12:39:26.615076+0000","last_clean":"2023-08-09T12:39:26.615076+0000","last_became_active":"2023-08-09T12:39:25.652458+0000","last_became_peered":"2023-08-09T12:39:25.652458+0000","last_unstale":"2023-08-09T12:39:26.615076+0000","last_undegraded":"2023-08-09T12:39:26.615076+0000","last_fullsized":"2023-08-09T12:39:26.615076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:30.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.654392+0000","last_change":"2023-08-09T12:39:24.628762+0000","last_active":"2023-08-09T12:39:25.654392+0000","last_peered":"2023-08-09T12:39:25.654392+0000","last_clean":"2023-08-09T12:39:25.654392+0000","last_became_active":"2023-08-09T12:39:24.628281+0000","last_became_peered":"2023-08-09T12:39:24.628281+0000","last_unstale":"2023-08-09T12:39:25.654392+0000","last_undegraded":"2023-08-09T12:39:25.654392+0000","last_fullsized":"2023-08-09T12:39:25.654392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613808+0000","last_change":"2023-08-09T12:39:25.643729+0000","last_active":"2023-08-09T12:39:26.613808+0000","last_peered":"2023-08-09T12:39:26.613808+0000","last_clean":"2023-08-09T12:39:26.613808+0000","last_became_active":"2023-08-09T12:39:25.643482+0000","last_became_peered":"2023-08-09T12:39:25.643482+0000","last_unstale":"2023-08-09T12:39:26.613808+0000","last_undegraded":"2023-08-09T12:39:26.613808+0000","last_fullsized":"2023-08-09T12:39:26.613808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.658775+0000","last_change":"2023-08-09T12:39:24.632751+0000","last_active":"2023-08-09T12:39:25.658775+0000","last_peered":"2023-08-09T12:39:25.658775+0000","last_clean":"2023-08-09T12:39:25.658775+0000","last_became_active":"2023-08-09T12:39:24.632458+0000","last_became_peered":"2023-08-09T12:39:24.632458+0000","last_unstale":"2023-08-09T12:39:25.658775+0000","last_undegraded":"2023-08-09T12:39:25.658775+0000","last_fullsized":"2023-08-09T12:39:25.658775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:41.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.646709+0000","last_change":"2023-08-09T12:39:25.646421+0000","last_active":"2023-08-09T12:39:25.646709+0000","last_peered":"2023-08-09T12:39:25.646709+0000","last_clean":"2023-08-09T12:39:25.646709+0000","last_became_active":"2023-08-09T12:39:25.645698+0000","last_became_peered":"2023-08-09T12:39:25.645698+0000","last_unstale":"2023-08-09T12:39:25.646709+0000","last_undegraded":"2023-08-09T12:39:25.646709+0000","last_fullsized":"2023-08-09T12:39:25.646709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:05:46.856117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.658574+0000","last_change":"2023-08-09T12:39:24.631472+0000","last_active":"2023-08-09T12:39:25.658574+0000","last_peered":"2023-08-09T12:39:25.658574+0000","last_clean":"2023-08-09T12:39:25.658574+0000","last_became_active":"2023-08-09T12:39:24.631123+0000","last_became_peered":"2023-08-09T12:39:24.631123+0000","last_unstale":"2023-08-09T12:39:25.658574+0000","last_undegraded":"2023-08-09T12:39:25.658574+0000","last_fullsized":"2023-08-09T12:39:25.658574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:32.905483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.634966+0000","last_change":"2023-08-09T12:39:25.634781+0000","last_active":"2023-08-09T12:39:25.634966+0000","last_peered":"2023-08-09T12:39:25.634966+0000","last_clean":"2023-08-09T12:39:25.634966+0000","last_became_active":"2023-08-09T12:39:25.634211+0000","last_became_peered":"2023-08-09T12:39:25.634211+0000","last_unstale":"2023-08-09T12:39:25.634966+0000","last_undegraded":"2023-08-09T12:39:25.634966+0000","last_fullsized":"2023-08-09T12:39:25.634966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:15.819900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.659036+0000","last_change":"2023-08-09T12:39:24.631252+0000","last_active":"2023-08-09T12:39:25.659036+0000","last_peered":"2023-08-09T12:39:25.659036+0000","last_clean":"2023-08-09T12:39:25.659036+0000","last_became_active":"2023-08-09T12:39:24.630940+0000","last_became_peered":"2023-08-09T12:39:24.630940+0000","last_unstale":"2023-08-09T12:39:25.659036+0000","last_undegraded":"2023-08-09T12:39:25.659036+0000","last_fullsized":"2023-08-09T12:39:25.659036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:29.971483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615783+0000","last_change":"2023-08-09T12:39:25.640158+0000","last_active":"2023-08-09T12:39:26.615783+0000","last_peered":"2023-08-09T12:39:26.615783+0000","last_clean":"2023-08-09T12:39:26.615783+0000","last_became_active":"2023-08-09T12:39:25.633644+0000","last_became_peered":"2023-08-09T12:39:25.633644+0000","last_unstale":"2023-08-09T12:39:26.615783+0000","last_undegraded":"2023-08-09T12:39:26.615783+0000","last_fullsized":"2023-08-09T12:39:26.615783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616014+0000","last_change":"2023-08-09T12:39:24.625994+0000","last_active":"2023-08-09T12:39:26.616014+0000","last_peered":"2023-08-09T12:39:26.616014+0000","last_clean":"2023-08-09T12:39:26.616014+0000","last_became_active":"2023-08-09T12:39:24.624612+0000","last_became_peered":"2023-08-09T12:39:24.624612+0000","last_unstale":"2023-08-09T12:39:26.616014+0000","last_undegraded":"2023-08-09T12:39:26.616014+0000","last_fullsized":"2023-08-09T12:39:26.616014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:30.602392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.646792+0000","last_change":"2023-08-09T12:39:25.646605+0000","last_active":"2023-08-09T12:39:25.646792+0000","last_peered":"2023-08-09T12:39:25.646792+0000","last_clean":"2023-08-09T12:39:25.646792+0000","last_became_active":"2023-08-09T12:39:25.644813+0000","last_became_peered":"2023-08-09T12:39:25.644813+0000","last_unstale":"2023-08-09T12:39:25.646792+0000","last_undegraded":"2023-08-09T12:39:25.646792+0000","last_fullsized":"2023-08-09T12:39:25.646792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:21.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.657538+0000","last_change":"2023-08-09T12:39:24.635709+0000","last_active":"2023-08-09T12:39:25.657538+0000","last_peered":"2023-08-09T12:39:25.657538+0000","last_clean":"2023-08-09T12:39:25.657538+0000","last_became_active":"2023-08-09T12:39:24.633560+0000","last_became_peered":"2023-08-09T12:39:24.633560+0000","last_unstale":"2023-08-09T12:39:25.657538+0000","last_undegraded":"2023-08-09T12:39:25.657538+0000","last_fullsized":"2023-08-09T12:39:25.657538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:20.515256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":663,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199320347,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":85,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195227,"statfs":{"total":200000000,"available":199912543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":86,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195226,"statfs":{"total":200000000,"available":199911891,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910875,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":85,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195227,"statfs":{"total":200000000,"available":199912453,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5110000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":85,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195227,"statfs":{"total":200000000,"available":199912543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":78,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195234,"statfs":{"total":200000000,"available":199919671,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":654,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194657,"statfs":{"total":200000000,"available":199329303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]}]}],"pool_statfs":[]}} 2023-08-09T12:39:30.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:39:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.432+0000 7fa1f7999640 1 Processor -- start 2023-08-09T12:39:30.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.433+0000 7fa1f7999640 1 -- start start 2023-08-09T12:39:30.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.434+0000 7fa1f7999640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00b3b40 0x7fa1f00b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.434+0000 7fa1f7999640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f006c990 con 0x7fa1f00cc630 2023-08-09T12:39:30.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.434+0000 7fa1f7999640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00b2250 con 0x7fa1f00adc40 2023-08-09T12:39:30.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.434+0000 7fa1f7999640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00ae020 con 0x7fa1f00b3b40 2023-08-09T12:39:30.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1f5f36640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa1f00cc630 0x7fa1f00ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48964/0 (socket says 172.21.15.17:48964) 2023-08-09T12:39:30.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1f5f36640 1 -- 172.21.15.17:0/3829729044 learned_addr learned my addr 172.21.15.17:0/3829729044 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:30.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1f4f34640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00b3b40 0x7fa1f00b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631954763 0 0) 0x7fa1f006c990 con 0x7fa1f00cc630 2023-08-09T12:39:30.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1dc003520 con 0x7fa1f00cc630 2023-08-09T12:39:30.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 34292944 0 0) 0x7fa1dc003520 con 0x7fa1f00cc630 2023-08-09T12:39:30.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00b3b40 msgr2=0x7fa1f00b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:30.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1e7fff640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00b3b40 0x7fa1f00b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 >> v1:172.21.15.142:6789/0 conn(0x7fa1f00adc40 legacy=0x7fa1f006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00b2530 con 0x7fa1f00cc630 2023-08-09T12:39:30.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.435+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa1e80019f0 con 0x7fa1f00cc630 2023-08-09T12:39:30.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 >> v1:172.21.15.17:6789/0 conn(0x7fa1f00cc630 legacy=0x7fa1f00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1e7fff640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1dc0039a0 0x7fa1dc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1e7fff640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1e7fff640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00b3b40 0x7fa1dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00ae020 con 0x7fa1dc0047c0 2023-08-09T12:39:30.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc00ba30 con 0x7fa1dc0039a0 2023-08-09T12:39:30.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc00bbf0 con 0x7fa1f00b3b40 2023-08-09T12:39:30.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1f4f34640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1f5735640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1dc0039a0 0x7fa1dc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1f5f36640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00b3b40 0x7fa1dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1f4f34640 1 -- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00b3b40 msgr2=0x7fa1dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.436+0000 7fa1f4f34640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00b3b40 0x7fa1dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.437+0000 7fa1f4f34640 1 -- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1dc0039a0 msgr2=0x7fa1dc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.437+0000 7fa1f4f34640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1dc0039a0 0x7fa1dc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.437+0000 7fa1f4f34640 1 -- 172.21.15.17:0/3829729044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc003520 con 0x7fa1dc0047c0 2023-08-09T12:39:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.437+0000 7fa1f5735640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1dc0039a0 0x7fa1dc003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.438+0000 7fa1f4f34640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1dc004c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000b9e0 tx=0x7fa1dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f859fdf9d9c64b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.438+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0005b90 con 0x7fa1dc0047c0 2023-08-09T12:39:30.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.438+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e0005cf0 con 0x7fa1dc0047c0 2023-08-09T12:39:30.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.438+0000 7fa1e7fff640 1 -- 172.21.15.17:0/3829729044 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0006270 con 0x7fa1dc0047c0 2023-08-09T12:39:30.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.438+0000 7fa1f7999640 1 -- 172.21.15.17:0/3829729044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 msgr2=0x7fa1dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.438+0000 7fa1f7999640 1 --2- 172.21.15.17:0/3829729044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1dc004c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000b9e0 tx=0x7fa1dc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.439+0000 7fa1f5f36640 1 -- 172.21.15.17:0/3829729044 reap_dead start 2023-08-09T12:39:30.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.439+0000 7fa1f7999640 1 -- 172.21.15.17:0/3829729044 shutdown_connections 2023-08-09T12:39:30.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.439+0000 7fa1f7999640 1 -- 172.21.15.17:0/3829729044 >> 172.21.15.17:0/3829729044 conn(0x7fa1f00cb1b0 msgr2=0x7fa1f00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:30.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.439+0000 7fa1f7999640 1 -- 172.21.15.17:0/3829729044 shutdown_connections 2023-08-09T12:39:30.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.439+0000 7fa1f7999640 1 -- 172.21.15.17:0/3829729044 wait complete. 2023-08-09T12:39:30.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.441+0000 7fa1f7999640 1 Processor -- start 2023-08-09T12:39:30.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.441+0000 7fa1f7999640 1 -- start start 2023-08-09T12:39:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f7999640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1f00cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f7999640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f00c2620 0x7fa1f01f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f7999640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00c8cf0 0x7fa1f00c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f7999640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00c3f50 con 0x7fa1dc0047c0 2023-08-09T12:39:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f7999640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00af850 con 0x7fa1f00c2620 2023-08-09T12:39:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f7999640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00afb30 con 0x7fa1f00c8cf0 2023-08-09T12:39:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f5735640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1f00cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f5735640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1f00cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55838/0 (socket says 172.21.15.17:55838) 2023-08-09T12:39:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f5735640 1 -- 172.21.15.17:0/4175740333 learned_addr learned my addr 172.21.15.17:0/4175740333 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f5735640 1 -- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00c8cf0 msgr2=0x7fa1f00c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f5735640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00c8cf0 0x7fa1f00c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f5735640 1 -- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f00c2620 msgr2=0x7fa1f01f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f5735640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f00c2620 0x7fa1f01f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.442+0000 7fa1f5735640 1 -- 172.21.15.17:0/4175740333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00c41f0 con 0x7fa1dc0047c0 2023-08-09T12:39:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.443+0000 7fa1f5735640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1f00cd420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00e7d0 tx=0x7fa1ec00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.443+0000 7fa1e5ffb640 1 -- 172.21.15.17:0/4175740333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec001390 con 0x7fa1dc0047c0 2023-08-09T12:39:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.443+0000 7fa1e5ffb640 1 -- 172.21.15.17:0/4175740333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec0050d0 con 0x7fa1dc0047c0 2023-08-09T12:39:30.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.443+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00afe10 con 0x7fa1dc0047c0 2023-08-09T12:39:30.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.443+0000 7fa1e5ffb640 1 -- 172.21.15.17:0/4175740333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec005440 con 0x7fa1dc0047c0 2023-08-09T12:39:30.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.443+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f01f22b0 con 0x7fa1dc0047c0 2023-08-09T12:39:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.444+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f0067a80 con 0x7fa1dc0047c0 2023-08-09T12:39:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.445+0000 7fa1e5ffb640 1 -- 172.21.15.17:0/4175740333 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa1ec00c6c0 con 0x7fa1dc0047c0 2023-08-09T12:39:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.446+0000 7fa1e5ffb640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1d406a050 0x7fa1d406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.446+0000 7fa1e5ffb640 1 -- 172.21.15.17:0/4175740333 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1ec088490 con 0x7fa1dc0047c0 2023-08-09T12:39:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.447+0000 7fa1f4f34640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1d406a050 0x7fa1d406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.448+0000 7fa1f4f34640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1d406a050 0x7fa1d406c510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0036000 tx=0x7fa1e0031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:30.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.451+0000 7fa1e5ffb640 1 -- 172.21.15.17:0/4175740333 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa1ec053b70 con 0x7fa1dc0047c0 2023-08-09T12:39:30.518 INFO:tasks.ceph.mds.c.smithi017.stderr:2023-08-09T12:39:30.514+0000 7faa529fe640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:39:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.645+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1f00c3dd0 con 0x7fa1d406a050 2023-08-09T12:39:30.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.667+0000 7fa1e5ffb640 1 -- 172.21.15.17:0/4175740333 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280524 (secure 0 0 0) 0x7fa1e0040070 con 0x7fa1d406a050 2023-08-09T12:39:30.675 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:30.677 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:39:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.674+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1d406a050 msgr2=0x7fa1d406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.674+0000 7fa1f7999640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1d406a050 0x7fa1d406c510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0036000 tx=0x7fa1e0031000 comp rx=0 tx=0).stop 2023-08-09T12:39:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.674+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 msgr2=0x7fa1f00cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.674+0000 7fa1f7999640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1f00cd420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00e7d0 tx=0x7fa1ec00ec90 comp rx=0 tx=0).stop 2023-08-09T12:39:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.675+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 shutdown_connections 2023-08-09T12:39:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.675+0000 7fa1f7999640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1d406a050 0x7fa1d406c510 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.675+0000 7fa1f7999640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1f00c8cf0 0x7fa1f00c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.675+0000 7fa1f7999640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f00c2620 0x7fa1f01f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.675+0000 7fa1f7999640 1 --2- 172.21.15.17:0/4175740333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1dc0047c0 0x7fa1f00cd420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.675+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 >> 172.21.15.17:0/4175740333 conn(0x7fa1f00cb1b0 msgr2=0x7fa1f00697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.675+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 shutdown_connections 2023-08-09T12:39:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.675+0000 7fa1f7999640 1 -- 172.21.15.17:0/4175740333 wait complete. 2023-08-09T12:39:30.699 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-09T12:39:30.635711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560673,"statfs":{"total":1600000000,"available":1598129626,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.027523"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613678+0000","last_change":"2023-08-09T12:39:25.635863+0000","last_active":"2023-08-09T12:39:26.613678+0000","last_peered":"2023-08-09T12:39:26.613678+0000","last_clean":"2023-08-09T12:39:26.613678+0000","last_became_active":"2023-08-09T12:39:25.635612+0000","last_became_peered":"2023-08-09T12:39:25.635612+0000","last_unstale":"2023-08-09T12:39:26.613678+0000","last_undegraded":"2023-08-09T12:39:26.613678+0000","last_fullsized":"2023-08-09T12:39:26.613678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.643372+0000","last_change":"2023-08-09T12:39:25.643258+0000","last_active":"2023-08-09T12:39:25.643372+0000","last_peered":"2023-08-09T12:39:25.643372+0000","last_clean":"2023-08-09T12:39:25.643372+0000","last_became_active":"2023-08-09T12:39:25.642998+0000","last_became_peered":"2023-08-09T12:39:25.642998+0000","last_unstale":"2023-08-09T12:39:25.643372+0000","last_undegraded":"2023-08-09T12:39:25.643372+0000","last_fullsized":"2023-08-09T12:39:25.643372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.646733+0000","last_change":"2023-08-09T12:39:25.646436+0000","last_active":"2023-08-09T12:39:25.646733+0000","last_peered":"2023-08-09T12:39:25.646733+0000","last_clean":"2023-08-09T12:39:25.646733+0000","last_became_active":"2023-08-09T12:39:25.646140+0000","last_became_peered":"2023-08-09T12:39:25.646140+0000","last_unstale":"2023-08-09T12:39:25.646733+0000","last_undegraded":"2023-08-09T12:39:25.646733+0000","last_fullsized":"2023-08-09T12:39:25.646733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:26.422299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616957+0000","last_change":"2023-08-09T12:39:25.633360+0000","last_active":"2023-08-09T12:39:26.616957+0000","last_peered":"2023-08-09T12:39:26.616957+0000","last_clean":"2023-08-09T12:39:26.616957+0000","last_became_active":"2023-08-09T12:39:25.632781+0000","last_became_peered":"2023-08-09T12:39:25.632781+0000","last_unstale":"2023-08-09T12:39:26.616957+0000","last_undegraded":"2023-08-09T12:39:26.616957+0000","last_fullsized":"2023-08-09T12:39:26.616957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:42.820863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.636524+0000","last_change":"2023-08-09T12:39:25.636182+0000","last_active":"2023-08-09T12:39:25.636524+0000","last_peered":"2023-08-09T12:39:25.636524+0000","last_clean":"2023-08-09T12:39:25.636524+0000","last_became_active":"2023-08-09T12:39:25.635794+0000","last_became_peered":"2023-08-09T12:39:25.635794+0000","last_unstale":"2023-08-09T12:39:25.636524+0000","last_undegraded":"2023-08-09T12:39:25.636524+0000","last_fullsized":"2023-08-09T12:39:25.636524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.650416+0000","last_change":"2023-08-09T12:39:25.650226+0000","last_active":"2023-08-09T12:39:25.650416+0000","last_peered":"2023-08-09T12:39:25.650416+0000","last_clean":"2023-08-09T12:39:25.650416+0000","last_became_active":"2023-08-09T12:39:25.646910+0000","last_became_peered":"2023-08-09T12:39:25.646910+0000","last_unstale":"2023-08-09T12:39:25.650416+0000","last_undegraded":"2023-08-09T12:39:25.650416+0000","last_fullsized":"2023-08-09T12:39:25.650416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.644147+0000","last_change":"2023-08-09T12:39:25.643948+0000","last_active":"2023-08-09T12:39:25.644147+0000","last_peered":"2023-08-09T12:39:25.644147+0000","last_clean":"2023-08-09T12:39:25.644147+0000","last_became_active":"2023-08-09T12:39:25.643568+0000","last_became_peered":"2023-08-09T12:39:25.643568+0000","last_unstale":"2023-08-09T12:39:25.644147+0000","last_undegraded":"2023-08-09T12:39:25.644147+0000","last_fullsized":"2023-08-09T12:39:25.644147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.637519+0000","last_change":"2023-08-09T12:39:25.636008+0000","last_active":"2023-08-09T12:39:25.637519+0000","last_peered":"2023-08-09T12:39:25.637519+0000","last_clean":"2023-08-09T12:39:25.637519+0000","last_became_active":"2023-08-09T12:39:25.635696+0000","last_became_peered":"2023-08-09T12:39:25.635696+0000","last_unstale":"2023-08-09T12:39:25.637519+0000","last_undegraded":"2023-08-09T12:39:25.637519+0000","last_fullsized":"2023-08-09T12:39:25.637519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:42.820863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.642320+0000","last_change":"2023-08-09T12:39:25.642164+0000","last_active":"2023-08-09T12:39:25.642320+0000","last_peered":"2023-08-09T12:39:25.642320+0000","last_clean":"2023-08-09T12:39:25.642320+0000","last_became_active":"2023-08-09T12:39:25.641895+0000","last_became_peered":"2023-08-09T12:39:25.641895+0000","last_unstale":"2023-08-09T12:39:25.642320+0000","last_undegraded":"2023-08-09T12:39:25.642320+0000","last_fullsized":"2023-08-09T12:39:25.642320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:16.783668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.637541+0000","last_change":"2023-08-09T12:39:25.637312+0000","last_active":"2023-08-09T12:39:25.637541+0000","last_peered":"2023-08-09T12:39:25.637541+0000","last_clean":"2023-08-09T12:39:25.637541+0000","last_became_active":"2023-08-09T12:39:25.636849+0000","last_became_peered":"2023-08-09T12:39:25.636849+0000","last_unstale":"2023-08-09T12:39:25.637541+0000","last_undegraded":"2023-08-09T12:39:25.637541+0000","last_fullsized":"2023-08-09T12:39:25.637541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:21.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.650602+0000","last_change":"2023-08-09T12:39:25.650515+0000","last_active":"2023-08-09T12:39:25.650602+0000","last_peered":"2023-08-09T12:39:25.650602+0000","last_clean":"2023-08-09T12:39:25.650602+0000","last_became_active":"2023-08-09T12:39:25.649243+0000","last_became_peered":"2023-08-09T12:39:25.649243+0000","last_unstale":"2023-08-09T12:39:25.650602+0000","last_undegraded":"2023-08-09T12:39:25.650602+0000","last_fullsized":"2023-08-09T12:39:25.650602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:16.783668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613554+0000","last_change":"2023-08-09T12:39:25.634920+0000","last_active":"2023-08-09T12:39:26.613554+0000","last_peered":"2023-08-09T12:39:26.613554+0000","last_clean":"2023-08-09T12:39:26.613554+0000","last_became_active":"2023-08-09T12:39:25.634629+0000","last_became_peered":"2023-08-09T12:39:25.634629+0000","last_unstale":"2023-08-09T12:39:26.613554+0000","last_undegraded":"2023-08-09T12:39:26.613554+0000","last_fullsized":"2023-08-09T12:39:26.613554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:15.819900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613610+0000","last_change":"2023-08-09T12:39:25.633027+0000","last_active":"2023-08-09T12:39:26.613610+0000","last_peered":"2023-08-09T12:39:26.613610+0000","last_clean":"2023-08-09T12:39:26.613610+0000","last_became_active":"2023-08-09T12:39:25.632604+0000","last_became_peered":"2023-08-09T12:39:25.632604+0000","last_unstale":"2023-08-09T12:39:26.613610+0000","last_undegraded":"2023-08-09T12:39:26.613610+0000","last_fullsized":"2023-08-09T12:39:26.613610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.639433+0000","last_change":"2023-08-09T12:39:25.639141+0000","last_active":"2023-08-09T12:39:25.639433+0000","last_peered":"2023-08-09T12:39:25.639433+0000","last_clean":"2023-08-09T12:39:25.639433+0000","last_became_active":"2023-08-09T12:39:25.638059+0000","last_became_peered":"2023-08-09T12:39:25.638059+0000","last_unstale":"2023-08-09T12:39:25.639433+0000","last_undegraded":"2023-08-09T12:39:25.639433+0000","last_fullsized":"2023-08-09T12:39:25.639433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.654706+0000","last_change":"2023-08-09T12:39:25.652960+0000","last_active":"2023-08-09T12:39:25.654706+0000","last_peered":"2023-08-09T12:39:25.654706+0000","last_clean":"2023-08-09T12:39:25.654706+0000","last_became_active":"2023-08-09T12:39:25.652713+0000","last_became_peered":"2023-08-09T12:39:25.652713+0000","last_unstale":"2023-08-09T12:39:25.654706+0000","last_undegraded":"2023-08-09T12:39:25.654706+0000","last_fullsized":"2023-08-09T12:39:25.654706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:36.686027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.650058+0000","last_change":"2023-08-09T12:39:25.649932+0000","last_active":"2023-08-09T12:39:25.650058+0000","last_peered":"2023-08-09T12:39:25.650058+0000","last_clean":"2023-08-09T12:39:25.650058+0000","last_became_active":"2023-08-09T12:39:25.645779+0000","last_became_peered":"2023-08-09T12:39:25.645779+0000","last_unstale":"2023-08-09T12:39:25.650058+0000","last_undegraded":"2023-08-09T12:39:25.650058+0000","last_fullsized":"2023-08-09T12:39:25.650058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:07.828328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.642337+0000","last_change":"2023-08-09T12:39:25.642272+0000","last_active":"2023-08-09T12:39:25.642337+0000","last_peered":"2023-08-09T12:39:25.642337+0000","last_clean":"2023-08-09T12:39:25.642337+0000","last_became_active":"2023-08-09T12:39:25.641857+0000","last_became_peered":"2023-08-09T12:39:25.641857+0000","last_unstale":"2023-08-09T12:39:25.642337+0000","last_undegraded":"2023-08-09T12:39:25.642337+0000","last_fullsized":"2023-08-09T12:39:25.642337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.638206+0000","last_change":"2023-08-09T12:39:25.638050+0000","last_active":"2023-08-09T12:39:25.638206+0000","last_peered":"2023-08-09T12:39:25.638206+0000","last_clean":"2023-08-09T12:39:25.638206+0000","last_became_active":"2023-08-09T12:39:25.637427+0000","last_became_peered":"2023-08-09T12:39:25.637427+0000","last_unstale":"2023-08-09T12:39:25.638206+0000","last_undegraded":"2023-08-09T12:39:25.638206+0000","last_fullsized":"2023-08-09T12:39:25.638206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613553+0000","last_change":"2023-08-09T12:39:25.625546+0000","last_active":"2023-08-09T12:39:26.613553+0000","last_peered":"2023-08-09T12:39:26.613553+0000","last_clean":"2023-08-09T12:39:26.613553+0000","last_became_active":"2023-08-09T12:39:25.623517+0000","last_became_peered":"2023-08-09T12:39:25.623517+0000","last_unstale":"2023-08-09T12:39:26.613553+0000","last_undegraded":"2023-08-09T12:39:26.613553+0000","last_fullsized":"2023-08-09T12:39:26.613553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.648897+0000","last_change":"2023-08-09T12:39:25.648778+0000","last_active":"2023-08-09T12:39:25.648897+0000","last_peered":"2023-08-09T12:39:25.648897+0000","last_clean":"2023-08-09T12:39:25.648897+0000","last_became_active":"2023-08-09T12:39:25.646303+0000","last_became_peered":"2023-08-09T12:39:25.646303+0000","last_unstale":"2023-08-09T12:39:25.648897+0000","last_undegraded":"2023-08-09T12:39:25.648897+0000","last_fullsized":"2023-08-09T12:39:25.648897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.624018+0000","last_change":"2023-08-09T12:39:25.621729+0000","last_active":"2023-08-09T12:39:25.624018+0000","last_peered":"2023-08-09T12:39:25.624018+0000","last_clean":"2023-08-09T12:39:25.624018+0000","last_became_active":"2023-08-09T12:39:25.620974+0000","last_became_peered":"2023-08-09T12:39:25.620974+0000","last_unstale":"2023-08-09T12:39:25.624018+0000","last_undegraded":"2023-08-09T12:39:25.624018+0000","last_fullsized":"2023-08-09T12:39:25.624018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:30.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.644527+0000","last_change":"2023-08-09T12:39:25.644455+0000","last_active":"2023-08-09T12:39:25.644527+0000","last_peered":"2023-08-09T12:39:25.644527+0000","last_clean":"2023-08-09T12:39:25.644527+0000","last_became_active":"2023-08-09T12:39:25.644178+0000","last_became_peered":"2023-08-09T12:39:25.644178+0000","last_unstale":"2023-08-09T12:39:25.644527+0000","last_undegraded":"2023-08-09T12:39:25.644527+0000","last_fullsized":"2023-08-09T12:39:25.644527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.614982+0000","last_change":"2023-08-09T12:39:25.638742+0000","last_active":"2023-08-09T12:39:26.614982+0000","last_peered":"2023-08-09T12:39:26.614982+0000","last_clean":"2023-08-09T12:39:26.614982+0000","last_became_active":"2023-08-09T12:39:25.638454+0000","last_became_peered":"2023-08-09T12:39:25.638454+0000","last_unstale":"2023-08-09T12:39:26.614982+0000","last_undegraded":"2023-08-09T12:39:26.614982+0000","last_fullsized":"2023-08-09T12:39:26.614982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:36.686027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.624150+0000","last_change":"2023-08-09T12:39:25.623830+0000","last_active":"2023-08-09T12:39:25.624150+0000","last_peered":"2023-08-09T12:39:25.624150+0000","last_clean":"2023-08-09T12:39:25.624150+0000","last_became_active":"2023-08-09T12:39:25.623070+0000","last_became_peered":"2023-08-09T12:39:25.623070+0000","last_unstale":"2023-08-09T12:39:25.624150+0000","last_undegraded":"2023-08-09T12:39:25.624150+0000","last_fullsized":"2023-08-09T12:39:25.624150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.653040+0000","last_change":"2023-08-09T12:39:25.652932+0000","last_active":"2023-08-09T12:39:25.653040+0000","last_peered":"2023-08-09T12:39:25.653040+0000","last_clean":"2023-08-09T12:39:25.653040+0000","last_became_active":"2023-08-09T12:39:25.651614+0000","last_became_peered":"2023-08-09T12:39:25.651614+0000","last_unstale":"2023-08-09T12:39:25.653040+0000","last_undegraded":"2023-08-09T12:39:25.653040+0000","last_fullsized":"2023-08-09T12:39:25.653040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.644754+0000","last_change":"2023-08-09T12:39:25.644658+0000","last_active":"2023-08-09T12:39:25.644754+0000","last_peered":"2023-08-09T12:39:25.644754+0000","last_clean":"2023-08-09T12:39:25.644754+0000","last_became_active":"2023-08-09T12:39:25.643855+0000","last_became_peered":"2023-08-09T12:39:25.643855+0000","last_unstale":"2023-08-09T12:39:25.644754+0000","last_undegraded":"2023-08-09T12:39:25.644754+0000","last_fullsized":"2023-08-09T12:39:25.644754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.640304+0000","last_change":"2023-08-09T12:39:25.640170+0000","last_active":"2023-08-09T12:39:25.640304+0000","last_peered":"2023-08-09T12:39:25.640304+0000","last_clean":"2023-08-09T12:39:25.640304+0000","last_became_active":"2023-08-09T12:39:25.639694+0000","last_became_peered":"2023-08-09T12:39:25.639694+0000","last_unstale":"2023-08-09T12:39:25.640304+0000","last_undegraded":"2023-08-09T12:39:25.640304+0000","last_fullsized":"2023-08-09T12:39:25.640304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.642786+0000","last_change":"2023-08-09T12:39:25.642608+0000","last_active":"2023-08-09T12:39:25.642786+0000","last_peered":"2023-08-09T12:39:25.642786+0000","last_clean":"2023-08-09T12:39:25.642786+0000","last_became_active":"2023-08-09T12:39:25.637346+0000","last_became_peered":"2023-08-09T12:39:25.637346+0000","last_unstale":"2023-08-09T12:39:25.642786+0000","last_undegraded":"2023-08-09T12:39:25.642786+0000","last_fullsized":"2023-08-09T12:39:25.642786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:01:12.743573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615253+0000","last_change":"2023-08-09T12:39:25.640403+0000","last_active":"2023-08-09T12:39:26.615253+0000","last_peered":"2023-08-09T12:39:26.615253+0000","last_clean":"2023-08-09T12:39:26.615253+0000","last_became_active":"2023-08-09T12:39:25.635661+0000","last_became_peered":"2023-08-09T12:39:25.635661+0000","last_unstale":"2023-08-09T12:39:26.615253+0000","last_undegraded":"2023-08-09T12:39:26.615253+0000","last_fullsized":"2023-08-09T12:39:26.615253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:47.710010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.647004+0000","last_change":"2023-08-09T12:39:25.646903+0000","last_active":"2023-08-09T12:39:25.647004+0000","last_peered":"2023-08-09T12:39:25.647004+0000","last_clean":"2023-08-09T12:39:25.647004+0000","last_became_active":"2023-08-09T12:39:25.645744+0000","last_became_peered":"2023-08-09T12:39:25.645744+0000","last_unstale":"2023-08-09T12:39:25.647004+0000","last_undegraded":"2023-08-09T12:39:25.647004+0000","last_fullsized":"2023-08-09T12:39:25.647004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615530+0000","last_change":"2023-08-09T12:39:25.645982+0000","last_active":"2023-08-09T12:39:26.615530+0000","last_peered":"2023-08-09T12:39:26.615530+0000","last_clean":"2023-08-09T12:39:26.615530+0000","last_became_active":"2023-08-09T12:39:25.645632+0000","last_became_peered":"2023-08-09T12:39:25.645632+0000","last_unstale":"2023-08-09T12:39:26.615530+0000","last_undegraded":"2023-08-09T12:39:26.615530+0000","last_fullsized":"2023-08-09T12:39:26.615530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616738+0000","last_change":"2023-08-09T12:39:25.632004+0000","last_active":"2023-08-09T12:39:26.616738+0000","last_peered":"2023-08-09T12:39:26.616738+0000","last_clean":"2023-08-09T12:39:26.616738+0000","last_became_active":"2023-08-09T12:39:25.631477+0000","last_became_peered":"2023-08-09T12:39:25.631477+0000","last_unstale":"2023-08-09T12:39:26.616738+0000","last_undegraded":"2023-08-09T12:39:26.616738+0000","last_fullsized":"2023-08-09T12:39:26.616738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615919+0000","last_change":"2023-08-09T12:39:25.641384+0000","last_active":"2023-08-09T12:39:26.615919+0000","last_peered":"2023-08-09T12:39:26.615919+0000","last_clean":"2023-08-09T12:39:26.615919+0000","last_became_active":"2023-08-09T12:39:25.640764+0000","last_became_peered":"2023-08-09T12:39:25.640764+0000","last_unstale":"2023-08-09T12:39:26.615919+0000","last_undegraded":"2023-08-09T12:39:26.615919+0000","last_fullsized":"2023-08-09T12:39:26.615919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:33.925265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.659201+0000","last_change":"2023-08-09T12:39:24.640639+0000","last_active":"2023-08-09T12:39:25.659201+0000","last_peered":"2023-08-09T12:39:25.659201+0000","last_clean":"2023-08-09T12:39:25.659201+0000","last_became_active":"2023-08-09T12:39:24.640266+0000","last_became_peered":"2023-08-09T12:39:24.640266+0000","last_unstale":"2023-08-09T12:39:25.659201+0000","last_undegraded":"2023-08-09T12:39:25.659201+0000","last_fullsized":"2023-08-09T12:39:25.659201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.633579+0000","last_change":"2023-08-09T12:39:25.631972+0000","last_active":"2023-08-09T12:39:25.633579+0000","last_peered":"2023-08-09T12:39:25.633579+0000","last_clean":"2023-08-09T12:39:25.633579+0000","last_became_active":"2023-08-09T12:39:25.631386+0000","last_became_peered":"2023-08-09T12:39:25.631386+0000","last_unstale":"2023-08-09T12:39:25.633579+0000","last_undegraded":"2023-08-09T12:39:25.633579+0000","last_fullsized":"2023-08-09T12:39:25.633579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.627829+0000","last_change":"2023-08-09T12:39:24.631980+0000","last_active":"2023-08-09T12:39:25.627829+0000","last_peered":"2023-08-09T12:39:25.627829+0000","last_clean":"2023-08-09T12:39:25.627829+0000","last_became_active":"2023-08-09T12:39:24.631321+0000","last_became_peered":"2023-08-09T12:39:24.631321+0000","last_unstale":"2023-08-09T12:39:25.627829+0000","last_undegraded":"2023-08-09T12:39:25.627829+0000","last_fullsized":"2023-08-09T12:39:25.627829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:37.798834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.642301+0000","last_change":"2023-08-09T12:39:25.642115+0000","last_active":"2023-08-09T12:39:25.642301+0000","last_peered":"2023-08-09T12:39:25.642301+0000","last_clean":"2023-08-09T12:39:25.642301+0000","last_became_active":"2023-08-09T12:39:25.641510+0000","last_became_peered":"2023-08-09T12:39:25.641510+0000","last_unstale":"2023-08-09T12:39:25.642301+0000","last_undegraded":"2023-08-09T12:39:25.642301+0000","last_fullsized":"2023-08-09T12:39:25.642301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.613431+0000","last_change":"2023-08-09T12:39:24.640562+0000","last_active":"2023-08-09T12:39:25.613431+0000","last_peered":"2023-08-09T12:39:25.613431+0000","last_clean":"2023-08-09T12:39:25.613431+0000","last_became_active":"2023-08-09T12:39:24.640227+0000","last_became_peered":"2023-08-09T12:39:24.640227+0000","last_unstale":"2023-08-09T12:39:25.613431+0000","last_undegraded":"2023-08-09T12:39:25.613431+0000","last_fullsized":"2023-08-09T12:39:25.613431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:32.216613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615401+0000","last_change":"2023-08-09T12:39:25.629884+0000","last_active":"2023-08-09T12:39:26.615401+0000","last_peered":"2023-08-09T12:39:26.615401+0000","last_clean":"2023-08-09T12:39:26.615401+0000","last_became_active":"2023-08-09T12:39:25.629153+0000","last_became_peered":"2023-08-09T12:39:25.629153+0000","last_unstale":"2023-08-09T12:39:26.615401+0000","last_undegraded":"2023-08-09T12:39:26.615401+0000","last_fullsized":"2023-08-09T12:39:26.615401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617036+0000","last_change":"2023-08-09T12:39:24.634685+0000","last_active":"2023-08-09T12:39:26.617036+0000","last_peered":"2023-08-09T12:39:26.617036+0000","last_clean":"2023-08-09T12:39:26.617036+0000","last_became_active":"2023-08-09T12:39:24.634383+0000","last_became_peered":"2023-08-09T12:39:24.634383+0000","last_unstale":"2023-08-09T12:39:26.617036+0000","last_undegraded":"2023-08-09T12:39:26.617036+0000","last_fullsized":"2023-08-09T12:39:26.617036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.654896+0000","last_change":"2023-08-09T12:39:24.641613+0000","last_active":"2023-08-09T12:39:25.654896+0000","last_peered":"2023-08-09T12:39:25.654896+0000","last_clean":"2023-08-09T12:39:25.654896+0000","last_became_active":"2023-08-09T12:39:24.641213+0000","last_became_peered":"2023-08-09T12:39:24.641213+0000","last_unstale":"2023-08-09T12:39:25.654896+0000","last_undegraded":"2023-08-09T12:39:25.654896+0000","last_fullsized":"2023-08-09T12:39:25.654896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:55.511153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.634815+0000","last_change":"2023-08-09T12:39:25.634677+0000","last_active":"2023-08-09T12:39:25.634815+0000","last_peered":"2023-08-09T12:39:25.634815+0000","last_clean":"2023-08-09T12:39:25.634815+0000","last_became_active":"2023-08-09T12:39:25.634264+0000","last_became_peered":"2023-08-09T12:39:25.634264+0000","last_unstale":"2023-08-09T12:39:25.634815+0000","last_undegraded":"2023-08-09T12:39:25.634815+0000","last_fullsized":"2023-08-09T12:39:25.634815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.658744+0000","last_change":"2023-08-09T12:39:24.641554+0000","last_active":"2023-08-09T12:39:25.658744+0000","last_peered":"2023-08-09T12:39:25.658744+0000","last_clean":"2023-08-09T12:39:25.658744+0000","last_became_active":"2023-08-09T12:39:24.641197+0000","last_became_peered":"2023-08-09T12:39:24.641197+0000","last_unstale":"2023-08-09T12:39:25.658744+0000","last_undegraded":"2023-08-09T12:39:25.658744+0000","last_fullsized":"2023-08-09T12:39:25.658744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:25.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.659293+0000","last_change":"2023-08-09T12:39:25.659204+0000","last_active":"2023-08-09T12:39:25.659293+0000","last_peered":"2023-08-09T12:39:25.659293+0000","last_clean":"2023-08-09T12:39:25.659293+0000","last_became_active":"2023-08-09T12:39:25.657091+0000","last_became_peered":"2023-08-09T12:39:25.657091+0000","last_unstale":"2023-08-09T12:39:25.659293+0000","last_undegraded":"2023-08-09T12:39:25.659293+0000","last_fullsized":"2023-08-09T12:39:25.659293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:42.820863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.654644+0000","last_change":"2023-08-09T12:39:24.628533+0000","last_active":"2023-08-09T12:39:25.654644+0000","last_peered":"2023-08-09T12:39:25.654644+0000","last_clean":"2023-08-09T12:39:25.654644+0000","last_became_active":"2023-08-09T12:39:24.628153+0000","last_became_peered":"2023-08-09T12:39:24.628153+0000","last_unstale":"2023-08-09T12:39:25.654644+0000","last_undegraded":"2023-08-09T12:39:25.654644+0000","last_fullsized":"2023-08-09T12:39:25.654644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:46.705148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617326+0000","last_change":"2023-08-09T12:39:25.638917+0000","last_active":"2023-08-09T12:39:26.617326+0000","last_peered":"2023-08-09T12:39:26.617326+0000","last_clean":"2023-08-09T12:39:26.617326+0000","last_became_active":"2023-08-09T12:39:25.638612+0000","last_became_peered":"2023-08-09T12:39:25.638612+0000","last_unstale":"2023-08-09T12:39:26.617326+0000","last_undegraded":"2023-08-09T12:39:26.617326+0000","last_fullsized":"2023-08-09T12:39:26.617326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.629734+0000","last_change":"2023-08-09T12:39:24.634717+0000","last_active":"2023-08-09T12:39:25.629734+0000","last_peered":"2023-08-09T12:39:25.629734+0000","last_clean":"2023-08-09T12:39:25.629734+0000","last_became_active":"2023-08-09T12:39:24.634225+0000","last_became_peered":"2023-08-09T12:39:24.634225+0000","last_unstale":"2023-08-09T12:39:25.629734+0000","last_undegraded":"2023-08-09T12:39:25.629734+0000","last_fullsized":"2023-08-09T12:39:25.629734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:46.705148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.645953+0000","last_change":"2023-08-09T12:39:25.645761+0000","last_active":"2023-08-09T12:39:25.645953+0000","last_peered":"2023-08-09T12:39:25.645953+0000","last_clean":"2023-08-09T12:39:25.645953+0000","last_became_active":"2023-08-09T12:39:25.645313+0000","last_became_peered":"2023-08-09T12:39:25.645313+0000","last_unstale":"2023-08-09T12:39:25.645953+0000","last_undegraded":"2023-08-09T12:39:25.645953+0000","last_fullsized":"2023-08-09T12:39:25.645953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:01:12.743573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615527+0000","last_change":"2023-08-09T12:39:24.636912+0000","last_active":"2023-08-09T12:39:26.615527+0000","last_peered":"2023-08-09T12:39:26.615527+0000","last_clean":"2023-08-09T12:39:26.615527+0000","last_became_active":"2023-08-09T12:39:24.636156+0000","last_became_peered":"2023-08-09T12:39:24.636156+0000","last_unstale":"2023-08-09T12:39:26.615527+0000","last_undegraded":"2023-08-09T12:39:26.615527+0000","last_fullsized":"2023-08-09T12:39:26.615527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.646813+0000","last_change":"2023-08-09T12:39:25.646628+0000","last_active":"2023-08-09T12:39:25.646813+0000","last_peered":"2023-08-09T12:39:25.646813+0000","last_clean":"2023-08-09T12:39:25.646813+0000","last_became_active":"2023-08-09T12:39:25.646139+0000","last_became_peered":"2023-08-09T12:39:25.646139+0000","last_unstale":"2023-08-09T12:39:25.646813+0000","last_undegraded":"2023-08-09T12:39:25.646813+0000","last_fullsized":"2023-08-09T12:39:25.646813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:38:19.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617710+0000","last_change":"2023-08-09T12:39:24.632474+0000","last_active":"2023-08-09T12:39:26.617710+0000","last_peered":"2023-08-09T12:39:26.617710+0000","last_clean":"2023-08-09T12:39:26.617710+0000","last_became_active":"2023-08-09T12:39:24.631809+0000","last_became_peered":"2023-08-09T12:39:24.631809+0000","last_unstale":"2023-08-09T12:39:26.617710+0000","last_undegraded":"2023-08-09T12:39:26.617710+0000","last_fullsized":"2023-08-09T12:39:26.617710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:35.681165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.649779+0000","last_change":"2023-08-09T12:39:25.649637+0000","last_active":"2023-08-09T12:39:25.649779+0000","last_peered":"2023-08-09T12:39:25.649779+0000","last_clean":"2023-08-09T12:39:25.649779+0000","last_became_active":"2023-08-09T12:39:25.644325+0000","last_became_peered":"2023-08-09T12:39:25.644325+0000","last_unstale":"2023-08-09T12:39:25.649779+0000","last_undegraded":"2023-08-09T12:39:25.649779+0000","last_fullsized":"2023-08-09T12:39:25.649779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:01:12.743573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.635570+0000","last_change":"2023-08-09T12:39:24.629489+0000","last_active":"2023-08-09T12:39:25.635570+0000","last_peered":"2023-08-09T12:39:25.635570+0000","last_clean":"2023-08-09T12:39:25.635570+0000","last_became_active":"2023-08-09T12:39:24.629107+0000","last_became_peered":"2023-08-09T12:39:24.629107+0000","last_unstale":"2023-08-09T12:39:25.635570+0000","last_undegraded":"2023-08-09T12:39:25.635570+0000","last_fullsized":"2023-08-09T12:39:25.635570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:35.681165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.638231+0000","last_change":"2023-08-09T12:39:25.638108+0000","last_active":"2023-08-09T12:39:25.638231+0000","last_peered":"2023-08-09T12:39:25.638231+0000","last_clean":"2023-08-09T12:39:25.638231+0000","last_became_active":"2023-08-09T12:39:25.636796+0000","last_became_peered":"2023-08-09T12:39:25.636796+0000","last_unstale":"2023-08-09T12:39:25.638231+0000","last_undegraded":"2023-08-09T12:39:25.638231+0000","last_fullsized":"2023-08-09T12:39:25.638231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615617+0000","last_change":"2023-08-09T12:39:24.628803+0000","last_active":"2023-08-09T12:39:26.615617+0000","last_peered":"2023-08-09T12:39:26.615617+0000","last_clean":"2023-08-09T12:39:26.615617+0000","last_became_active":"2023-08-09T12:39:24.628410+0000","last_became_peered":"2023-08-09T12:39:24.628410+0000","last_unstale":"2023-08-09T12:39:26.615617+0000","last_undegraded":"2023-08-09T12:39:26.615617+0000","last_fullsized":"2023-08-09T12:39:26.615617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:32.805465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.643449+0000","last_change":"2023-08-09T12:39:25.643385+0000","last_active":"2023-08-09T12:39:25.643449+0000","last_peered":"2023-08-09T12:39:25.643449+0000","last_clean":"2023-08-09T12:39:25.643449+0000","last_became_active":"2023-08-09T12:39:25.643109+0000","last_became_peered":"2023-08-09T12:39:25.643109+0000","last_unstale":"2023-08-09T12:39:25.643449+0000","last_undegraded":"2023-08-09T12:39:25.643449+0000","last_fullsized":"2023-08-09T12:39:25.643449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.613971+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:39:25.613971+0000","last_peered":"2023-08-09T12:39:25.613971+0000","last_clean":"2023-08-09T12:39:25.613971+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:39:25.613971+0000","last_undegraded":"2023-08-09T12:39:25.613971+0000","last_fullsized":"2023-08-09T12:39:25.613971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:04:56.540645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.626584+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:39:25.626584+0000","last_peered":"2023-08-09T12:39:25.626584+0000","last_clean":"2023-08-09T12:39:25.626584+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:39:25.626584+0000","last_undegraded":"2023-08-09T12:39:25.626584+0000","last_fullsized":"2023-08-09T12:39:25.626584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:30.350165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615676+0000","last_change":"2023-08-09T12:39:24.635989+0000","last_active":"2023-08-09T12:39:26.615676+0000","last_peered":"2023-08-09T12:39:26.615676+0000","last_clean":"2023-08-09T12:39:26.615676+0000","last_became_active":"2023-08-09T12:39:24.635506+0000","last_became_peered":"2023-08-09T12:39:24.635506+0000","last_unstale":"2023-08-09T12:39:26.615676+0000","last_undegraded":"2023-08-09T12:39:26.615676+0000","last_fullsized":"2023-08-09T12:39:26.615676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:47.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617544+0000","last_change":"2023-08-09T12:39:25.637598+0000","last_active":"2023-08-09T12:39:26.617544+0000","last_peered":"2023-08-09T12:39:26.617544+0000","last_clean":"2023-08-09T12:39:26.617544+0000","last_became_active":"2023-08-09T12:39:25.637286+0000","last_became_peered":"2023-08-09T12:39:25.637286+0000","last_unstale":"2023-08-09T12:39:26.617544+0000","last_undegraded":"2023-08-09T12:39:26.617544+0000","last_fullsized":"2023-08-09T12:39:26.617544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.613668+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:39:25.613668+0000","last_peered":"2023-08-09T12:39:25.613668+0000","last_clean":"2023-08-09T12:39:25.613668+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:39:25.613668+0000","last_undegraded":"2023-08-09T12:39:25.613668+0000","last_fullsized":"2023-08-09T12:39:25.613668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:16.514526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.634032+0000","last_change":"2023-08-09T12:39:24.636357+0000","last_active":"2023-08-09T12:39:25.634032+0000","last_peered":"2023-08-09T12:39:25.634032+0000","last_clean":"2023-08-09T12:39:25.634032+0000","last_became_active":"2023-08-09T12:39:24.634441+0000","last_became_peered":"2023-08-09T12:39:24.634441+0000","last_unstale":"2023-08-09T12:39:25.634032+0000","last_undegraded":"2023-08-09T12:39:25.634032+0000","last_fullsized":"2023-08-09T12:39:25.634032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:55.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.645935+0000","last_change":"2023-08-09T12:39:25.645605+0000","last_active":"2023-08-09T12:39:25.645935+0000","last_peered":"2023-08-09T12:39:25.645935+0000","last_clean":"2023-08-09T12:39:25.645935+0000","last_became_active":"2023-08-09T12:39:25.644989+0000","last_became_peered":"2023-08-09T12:39:25.644989+0000","last_unstale":"2023-08-09T12:39:25.645935+0000","last_undegraded":"2023-08-09T12:39:25.645935+0000","last_fullsized":"2023-08-09T12:39:25.645935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:07.828328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613725+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:39:26.613725+0000","last_peered":"2023-08-09T12:39:26.613725+0000","last_clean":"2023-08-09T12:39:26.613725+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:39:26.613725+0000","last_undegraded":"2023-08-09T12:39:26.613725+0000","last_fullsized":"2023-08-09T12:39:26.613725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:46.297345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.632287+0000","last_change":"2023-08-09T12:39:24.623190+0000","last_active":"2023-08-09T12:39:25.632287+0000","last_peered":"2023-08-09T12:39:25.632287+0000","last_clean":"2023-08-09T12:39:25.632287+0000","last_became_active":"2023-08-09T12:39:24.622946+0000","last_became_peered":"2023-08-09T12:39:24.622946+0000","last_unstale":"2023-08-09T12:39:25.632287+0000","last_undegraded":"2023-08-09T12:39:25.632287+0000","last_fullsized":"2023-08-09T12:39:25.632287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:41.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.657096+0000","last_change":"2023-08-09T12:39:25.656984+0000","last_active":"2023-08-09T12:39:25.657096+0000","last_peered":"2023-08-09T12:39:25.657096+0000","last_clean":"2023-08-09T12:39:25.657096+0000","last_became_active":"2023-08-09T12:39:25.651565+0000","last_became_peered":"2023-08-09T12:39:25.651565+0000","last_unstale":"2023-08-09T12:39:25.657096+0000","last_undegraded":"2023-08-09T12:39:25.657096+0000","last_fullsized":"2023-08-09T12:39:25.657096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:15.819900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.629892+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:39:25.629892+0000","last_peered":"2023-08-09T12:39:25.629892+0000","last_clean":"2023-08-09T12:39:25.629892+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:39:25.629892+0000","last_undegraded":"2023-08-09T12:39:25.629892+0000","last_fullsized":"2023-08-09T12:39:25.629892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:26.885613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.629960+0000","last_change":"2023-08-09T12:39:24.633725+0000","last_active":"2023-08-09T12:39:25.629960+0000","last_peered":"2023-08-09T12:39:25.629960+0000","last_clean":"2023-08-09T12:39:25.629960+0000","last_became_active":"2023-08-09T12:39:24.633401+0000","last_became_peered":"2023-08-09T12:39:24.633401+0000","last_unstale":"2023-08-09T12:39:25.629960+0000","last_undegraded":"2023-08-09T12:39:25.629960+0000","last_fullsized":"2023-08-09T12:39:25.629960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:28.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.652236+0000","last_change":"2023-08-09T12:39:25.652044+0000","last_active":"2023-08-09T12:39:25.652236+0000","last_peered":"2023-08-09T12:39:25.652236+0000","last_clean":"2023-08-09T12:39:25.652236+0000","last_became_active":"2023-08-09T12:39:25.646950+0000","last_became_peered":"2023-08-09T12:39:25.646950+0000","last_unstale":"2023-08-09T12:39:25.652236+0000","last_undegraded":"2023-08-09T12:39:25.652236+0000","last_fullsized":"2023-08-09T12:39:25.652236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.623213+0000","last_change":"2023-08-09T12:39:24.629351+0000","last_active":"2023-08-09T12:39:25.623213+0000","last_peered":"2023-08-09T12:39:25.623213+0000","last_clean":"2023-08-09T12:39:25.623213+0000","last_became_active":"2023-08-09T12:39:24.628605+0000","last_became_peered":"2023-08-09T12:39:24.628605+0000","last_unstale":"2023-08-09T12:39:25.623213+0000","last_undegraded":"2023-08-09T12:39:25.623213+0000","last_fullsized":"2023-08-09T12:39:25.623213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.635404+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:39:25.635404+0000","last_peered":"2023-08-09T12:39:25.635404+0000","last_clean":"2023-08-09T12:39:25.635404+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:39:25.635404+0000","last_undegraded":"2023-08-09T12:39:25.635404+0000","last_fullsized":"2023-08-09T12:39:25.635404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:50.219229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.656700+0000","last_change":"2023-08-09T12:39:25.656505+0000","last_active":"2023-08-09T12:39:25.656700+0000","last_peered":"2023-08-09T12:39:25.656700+0000","last_clean":"2023-08-09T12:39:25.656700+0000","last_became_active":"2023-08-09T12:39:25.651066+0000","last_became_peered":"2023-08-09T12:39:25.651066+0000","last_unstale":"2023-08-09T12:39:25.656700+0000","last_undegraded":"2023-08-09T12:39:25.656700+0000","last_fullsized":"2023-08-09T12:39:25.656700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:16.783668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.635313+0000","last_change":"2023-08-09T12:39:24.624402+0000","last_active":"2023-08-09T12:39:25.635313+0000","last_peered":"2023-08-09T12:39:25.635313+0000","last_clean":"2023-08-09T12:39:25.635313+0000","last_became_active":"2023-08-09T12:39:24.623543+0000","last_became_peered":"2023-08-09T12:39:24.623543+0000","last_unstale":"2023-08-09T12:39:25.635313+0000","last_undegraded":"2023-08-09T12:39:25.635313+0000","last_fullsized":"2023-08-09T12:39:25.635313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:20.515256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.613387+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:39:25.613387+0000","last_peered":"2023-08-09T12:39:25.613387+0000","last_clean":"2023-08-09T12:39:25.613387+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:39:25.613387+0000","last_undegraded":"2023-08-09T12:39:25.613387+0000","last_fullsized":"2023-08-09T12:39:25.613387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:38.946780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.637229+0000","last_change":"2023-08-09T12:39:25.637151+0000","last_active":"2023-08-09T12:39:25.637229+0000","last_peered":"2023-08-09T12:39:25.637229+0000","last_clean":"2023-08-09T12:39:25.637229+0000","last_became_active":"2023-08-09T12:39:25.636899+0000","last_became_peered":"2023-08-09T12:39:25.636899+0000","last_unstale":"2023-08-09T12:39:25.637229+0000","last_undegraded":"2023-08-09T12:39:25.637229+0000","last_fullsized":"2023-08-09T12:39:25.637229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:38:19.564694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615546+0000","last_change":"2023-08-09T12:39:24.628972+0000","last_active":"2023-08-09T12:39:26.615546+0000","last_peered":"2023-08-09T12:39:26.615546+0000","last_clean":"2023-08-09T12:39:26.615546+0000","last_became_active":"2023-08-09T12:39:24.628110+0000","last_became_peered":"2023-08-09T12:39:24.628110+0000","last_unstale":"2023-08-09T12:39:26.615546+0000","last_undegraded":"2023-08-09T12:39:26.615546+0000","last_fullsized":"2023-08-09T12:39:26.615546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:25.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.633087+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:39:25.633087+0000","last_peered":"2023-08-09T12:39:25.633087+0000","last_clean":"2023-08-09T12:39:25.633087+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:39:25.633087+0000","last_undegraded":"2023-08-09T12:39:25.633087+0000","last_fullsized":"2023-08-09T12:39:25.633087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:52.854435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615554+0000","last_change":"2023-08-09T12:39:25.641020+0000","last_active":"2023-08-09T12:39:26.615554+0000","last_peered":"2023-08-09T12:39:26.615554+0000","last_clean":"2023-08-09T12:39:26.615554+0000","last_became_active":"2023-08-09T12:39:25.638752+0000","last_became_peered":"2023-08-09T12:39:25.638752+0000","last_unstale":"2023-08-09T12:39:26.615554+0000","last_undegraded":"2023-08-09T12:39:26.615554+0000","last_fullsized":"2023-08-09T12:39:26.615554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:44.285538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.633555+0000","last_change":"2023-08-09T12:39:24.636769+0000","last_active":"2023-08-09T12:39:25.633555+0000","last_peered":"2023-08-09T12:39:25.633555+0000","last_clean":"2023-08-09T12:39:25.633555+0000","last_became_active":"2023-08-09T12:39:24.635218+0000","last_became_peered":"2023-08-09T12:39:24.635218+0000","last_unstale":"2023-08-09T12:39:25.633555+0000","last_undegraded":"2023-08-09T12:39:25.633555+0000","last_fullsized":"2023-08-09T12:39:25.633555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616980+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:39:26.616980+0000","last_peered":"2023-08-09T12:39:26.616980+0000","last_clean":"2023-08-09T12:39:26.616980+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:39:26.616980+0000","last_undegraded":"2023-08-09T12:39:26.616980+0000","last_fullsized":"2023-08-09T12:39:26.616980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:15.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.634943+0000","last_change":"2023-08-09T12:39:25.634557+0000","last_active":"2023-08-09T12:39:25.634943+0000","last_peered":"2023-08-09T12:39:25.634943+0000","last_clean":"2023-08-09T12:39:25.634943+0000","last_became_active":"2023-08-09T12:39:25.633799+0000","last_became_peered":"2023-08-09T12:39:25.633799+0000","last_unstale":"2023-08-09T12:39:25.634943+0000","last_undegraded":"2023-08-09T12:39:25.634943+0000","last_fullsized":"2023-08-09T12:39:25.634943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:22.587888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.643976+0000","last_change":"2023-08-09T12:39:25.643842+0000","last_active":"2023-08-09T12:39:25.643976+0000","last_peered":"2023-08-09T12:39:25.643976+0000","last_clean":"2023-08-09T12:39:25.643976+0000","last_became_active":"2023-08-09T12:39:25.637275+0000","last_became_peered":"2023-08-09T12:39:25.637275+0000","last_unstale":"2023-08-09T12:39:25.643976+0000","last_undegraded":"2023-08-09T12:39:25.643976+0000","last_fullsized":"2023-08-09T12:39:25.643976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.660534+0000","last_change":"2023-08-09T12:39:24.640696+0000","last_active":"2023-08-09T12:39:25.660534+0000","last_peered":"2023-08-09T12:39:25.660534+0000","last_clean":"2023-08-09T12:39:25.660534+0000","last_became_active":"2023-08-09T12:39:24.640413+0000","last_became_peered":"2023-08-09T12:39:24.640413+0000","last_unstale":"2023-08-09T12:39:25.660534+0000","last_undegraded":"2023-08-09T12:39:25.660534+0000","last_fullsized":"2023-08-09T12:39:25.660534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:00:23.709248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.644527+0000","last_change":"2023-08-09T12:39:25.644428+0000","last_active":"2023-08-09T12:39:25.644527+0000","last_peered":"2023-08-09T12:39:25.644527+0000","last_clean":"2023-08-09T12:39:25.644527+0000","last_became_active":"2023-08-09T12:39:25.643285+0000","last_became_peered":"2023-08-09T12:39:25.643285+0000","last_unstale":"2023-08-09T12:39:25.644527+0000","last_undegraded":"2023-08-09T12:39:25.644527+0000","last_fullsized":"2023-08-09T12:39:25.644527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.657293+0000","last_change":"2023-08-09T12:39:24.637201+0000","last_active":"2023-08-09T12:39:25.657293+0000","last_peered":"2023-08-09T12:39:25.657293+0000","last_clean":"2023-08-09T12:39:25.657293+0000","last_became_active":"2023-08-09T12:39:24.636809+0000","last_became_peered":"2023-08-09T12:39:24.636809+0000","last_unstale":"2023-08-09T12:39:25.657293+0000","last_undegraded":"2023-08-09T12:39:25.657293+0000","last_fullsized":"2023-08-09T12:39:25.657293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:20.515256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.629435+0000","last_change":"2023-08-09T12:39:24.632390+0000","last_active":"2023-08-09T12:39:25.629435+0000","last_peered":"2023-08-09T12:39:25.629435+0000","last_clean":"2023-08-09T12:39:25.629435+0000","last_became_active":"2023-08-09T12:39:24.631880+0000","last_became_peered":"2023-08-09T12:39:24.631880+0000","last_unstale":"2023-08-09T12:39:25.629435+0000","last_undegraded":"2023-08-09T12:39:25.629435+0000","last_fullsized":"2023-08-09T12:39:25.629435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:55.511153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615322+0000","last_change":"2023-08-09T12:39:25.622421+0000","last_active":"2023-08-09T12:39:26.615322+0000","last_peered":"2023-08-09T12:39:26.615322+0000","last_clean":"2023-08-09T12:39:26.615322+0000","last_became_active":"2023-08-09T12:39:25.621727+0000","last_became_peered":"2023-08-09T12:39:25.621727+0000","last_unstale":"2023-08-09T12:39:26.615322+0000","last_undegraded":"2023-08-09T12:39:26.615322+0000","last_fullsized":"2023-08-09T12:39:26.615322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.627606+0000","last_change":"2023-08-09T12:39:24.632830+0000","last_active":"2023-08-09T12:39:25.627606+0000","last_peered":"2023-08-09T12:39:25.627606+0000","last_clean":"2023-08-09T12:39:25.627606+0000","last_became_active":"2023-08-09T12:39:24.631677+0000","last_became_peered":"2023-08-09T12:39:24.631677+0000","last_unstale":"2023-08-09T12:39:25.627606+0000","last_undegraded":"2023-08-09T12:39:25.627606+0000","last_fullsized":"2023-08-09T12:39:25.627606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:14.815038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615307+0000","last_change":"2023-08-09T12:39:25.638155+0000","last_active":"2023-08-09T12:39:26.615307+0000","last_peered":"2023-08-09T12:39:26.615307+0000","last_clean":"2023-08-09T12:39:26.615307+0000","last_became_active":"2023-08-09T12:39:25.635955+0000","last_became_peered":"2023-08-09T12:39:25.635955+0000","last_unstale":"2023-08-09T12:39:26.615307+0000","last_undegraded":"2023-08-09T12:39:26.615307+0000","last_fullsized":"2023-08-09T12:39:26.615307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:33.221475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616702+0000","last_change":"2023-08-09T12:39:25.630728+0000","last_active":"2023-08-09T12:39:26.616702+0000","last_peered":"2023-08-09T12:39:26.616702+0000","last_clean":"2023-08-09T12:39:26.616702+0000","last_became_active":"2023-08-09T12:39:25.630222+0000","last_became_peered":"2023-08-09T12:39:25.630222+0000","last_unstale":"2023-08-09T12:39:26.616702+0000","last_undegraded":"2023-08-09T12:39:26.616702+0000","last_fullsized":"2023-08-09T12:39:26.616702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615209+0000","last_change":"2023-08-09T12:39:24.631880+0000","last_active":"2023-08-09T12:39:26.615209+0000","last_peered":"2023-08-09T12:39:26.615209+0000","last_clean":"2023-08-09T12:39:26.615209+0000","last_became_active":"2023-08-09T12:39:24.631638+0000","last_became_peered":"2023-08-09T12:39:24.631638+0000","last_unstale":"2023-08-09T12:39:26.615209+0000","last_undegraded":"2023-08-09T12:39:26.615209+0000","last_fullsized":"2023-08-09T12:39:26.615209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:55.511153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.635453+0000","last_change":"2023-08-09T12:39:25.635263+0000","last_active":"2023-08-09T12:39:25.635453+0000","last_peered":"2023-08-09T12:39:25.635453+0000","last_clean":"2023-08-09T12:39:25.635453+0000","last_became_active":"2023-08-09T12:39:25.634710+0000","last_became_peered":"2023-08-09T12:39:25.634710+0000","last_unstale":"2023-08-09T12:39:25.635453+0000","last_undegraded":"2023-08-09T12:39:25.635453+0000","last_fullsized":"2023-08-09T12:39:25.635453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:26.422299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.630989+0000","last_change":"2023-08-09T12:39:24.633355+0000","last_active":"2023-08-09T12:39:25.630989+0000","last_peered":"2023-08-09T12:39:25.630989+0000","last_clean":"2023-08-09T12:39:25.630989+0000","last_became_active":"2023-08-09T12:39:24.633106+0000","last_became_peered":"2023-08-09T12:39:24.633106+0000","last_unstale":"2023-08-09T12:39:25.630989+0000","last_undegraded":"2023-08-09T12:39:25.630989+0000","last_fullsized":"2023-08-09T12:39:25.630989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:28.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615076+0000","last_change":"2023-08-09T12:39:25.652713+0000","last_active":"2023-08-09T12:39:26.615076+0000","last_peered":"2023-08-09T12:39:26.615076+0000","last_clean":"2023-08-09T12:39:26.615076+0000","last_became_active":"2023-08-09T12:39:25.652458+0000","last_became_peered":"2023-08-09T12:39:25.652458+0000","last_unstale":"2023-08-09T12:39:26.615076+0000","last_undegraded":"2023-08-09T12:39:26.615076+0000","last_fullsized":"2023-08-09T12:39:26.615076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:30.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.654392+0000","last_change":"2023-08-09T12:39:24.628762+0000","last_active":"2023-08-09T12:39:25.654392+0000","last_peered":"2023-08-09T12:39:25.654392+0000","last_clean":"2023-08-09T12:39:25.654392+0000","last_became_active":"2023-08-09T12:39:24.628281+0000","last_became_peered":"2023-08-09T12:39:24.628281+0000","last_unstale":"2023-08-09T12:39:25.654392+0000","last_undegraded":"2023-08-09T12:39:25.654392+0000","last_fullsized":"2023-08-09T12:39:25.654392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613808+0000","last_change":"2023-08-09T12:39:25.643729+0000","last_active":"2023-08-09T12:39:26.613808+0000","last_peered":"2023-08-09T12:39:26.613808+0000","last_clean":"2023-08-09T12:39:26.613808+0000","last_became_active":"2023-08-09T12:39:25.643482+0000","last_became_peered":"2023-08-09T12:39:25.643482+0000","last_unstale":"2023-08-09T12:39:26.613808+0000","last_undegraded":"2023-08-09T12:39:26.613808+0000","last_fullsized":"2023-08-09T12:39:26.613808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.658775+0000","last_change":"2023-08-09T12:39:24.632751+0000","last_active":"2023-08-09T12:39:25.658775+0000","last_peered":"2023-08-09T12:39:25.658775+0000","last_clean":"2023-08-09T12:39:25.658775+0000","last_became_active":"2023-08-09T12:39:24.632458+0000","last_became_peered":"2023-08-09T12:39:24.632458+0000","last_unstale":"2023-08-09T12:39:25.658775+0000","last_undegraded":"2023-08-09T12:39:25.658775+0000","last_fullsized":"2023-08-09T12:39:25.658775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:41.816001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.646709+0000","last_change":"2023-08-09T12:39:25.646421+0000","last_active":"2023-08-09T12:39:25.646709+0000","last_peered":"2023-08-09T12:39:25.646709+0000","last_clean":"2023-08-09T12:39:25.646709+0000","last_became_active":"2023-08-09T12:39:25.645698+0000","last_became_peered":"2023-08-09T12:39:25.645698+0000","last_unstale":"2023-08-09T12:39:25.646709+0000","last_undegraded":"2023-08-09T12:39:25.646709+0000","last_fullsized":"2023-08-09T12:39:25.646709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:05:46.856117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.658574+0000","last_change":"2023-08-09T12:39:24.631472+0000","last_active":"2023-08-09T12:39:25.658574+0000","last_peered":"2023-08-09T12:39:25.658574+0000","last_clean":"2023-08-09T12:39:25.658574+0000","last_became_active":"2023-08-09T12:39:24.631123+0000","last_became_peered":"2023-08-09T12:39:24.631123+0000","last_unstale":"2023-08-09T12:39:25.658574+0000","last_undegraded":"2023-08-09T12:39:25.658574+0000","last_fullsized":"2023-08-09T12:39:25.658574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:32.905483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.634966+0000","last_change":"2023-08-09T12:39:25.634781+0000","last_active":"2023-08-09T12:39:25.634966+0000","last_peered":"2023-08-09T12:39:25.634966+0000","last_clean":"2023-08-09T12:39:25.634966+0000","last_became_active":"2023-08-09T12:39:25.634211+0000","last_became_peered":"2023-08-09T12:39:25.634211+0000","last_unstale":"2023-08-09T12:39:25.634966+0000","last_undegraded":"2023-08-09T12:39:25.634966+0000","last_fullsized":"2023-08-09T12:39:25.634966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:15.819900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.659036+0000","last_change":"2023-08-09T12:39:24.631252+0000","last_active":"2023-08-09T12:39:25.659036+0000","last_peered":"2023-08-09T12:39:25.659036+0000","last_clean":"2023-08-09T12:39:25.659036+0000","last_became_active":"2023-08-09T12:39:24.630940+0000","last_became_peered":"2023-08-09T12:39:24.630940+0000","last_unstale":"2023-08-09T12:39:25.659036+0000","last_undegraded":"2023-08-09T12:39:25.659036+0000","last_fullsized":"2023-08-09T12:39:25.659036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:29.971483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615783+0000","last_change":"2023-08-09T12:39:25.640158+0000","last_active":"2023-08-09T12:39:26.615783+0000","last_peered":"2023-08-09T12:39:26.615783+0000","last_clean":"2023-08-09T12:39:26.615783+0000","last_became_active":"2023-08-09T12:39:25.633644+0000","last_became_peered":"2023-08-09T12:39:25.633644+0000","last_unstale":"2023-08-09T12:39:26.615783+0000","last_undegraded":"2023-08-09T12:39:26.615783+0000","last_fullsized":"2023-08-09T12:39:26.615783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616014+0000","last_change":"2023-08-09T12:39:24.625994+0000","last_active":"2023-08-09T12:39:26.616014+0000","last_peered":"2023-08-09T12:39:26.616014+0000","last_clean":"2023-08-09T12:39:26.616014+0000","last_became_active":"2023-08-09T12:39:24.624612+0000","last_became_peered":"2023-08-09T12:39:24.624612+0000","last_unstale":"2023-08-09T12:39:26.616014+0000","last_undegraded":"2023-08-09T12:39:26.616014+0000","last_fullsized":"2023-08-09T12:39:26.616014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:30.602392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.646792+0000","last_change":"2023-08-09T12:39:25.646605+0000","last_active":"2023-08-09T12:39:25.646792+0000","last_peered":"2023-08-09T12:39:25.646792+0000","last_clean":"2023-08-09T12:39:25.646792+0000","last_became_active":"2023-08-09T12:39:25.644813+0000","last_became_peered":"2023-08-09T12:39:25.644813+0000","last_unstale":"2023-08-09T12:39:25.646792+0000","last_undegraded":"2023-08-09T12:39:25.646792+0000","last_fullsized":"2023-08-09T12:39:25.646792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:21.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-09T12:39:25.657538+0000","last_change":"2023-08-09T12:39:24.635709+0000","last_active":"2023-08-09T12:39:25.657538+0000","last_peered":"2023-08-09T12:39:25.657538+0000","last_clean":"2023-08-09T12:39:25.657538+0000","last_became_active":"2023-08-09T12:39:24.633560+0000","last_became_peered":"2023-08-09T12:39:24.633560+0000","last_unstale":"2023-08-09T12:39:25.657538+0000","last_undegraded":"2023-08-09T12:39:25.657538+0000","last_fullsized":"2023-08-09T12:39:25.657538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:20.515256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":663,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194648,"statfs":{"total":200000000,"available":199320347,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":85,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195227,"statfs":{"total":200000000,"available":199912543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":86,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195226,"statfs":{"total":200000000,"available":199911891,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":87,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195225,"statfs":{"total":200000000,"available":199910875,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.71}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":85,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195227,"statfs":{"total":200000000,"available":199912453,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5110000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":85,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195227,"statfs":{"total":200000000,"available":199912543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":78,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195234,"statfs":{"total":200000000,"available":199919671,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":654,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194657,"statfs":{"total":200000000,"available":199329303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]}]}],"pool_statfs":[]}} 2023-08-09T12:39:30.705 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:39:30.706 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-09T12:39:30.706 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-09T12:39:30.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-09T12:39:30.707 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-09T12:39:30.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.971+0000 7f43673e8640 1 Processor -- start 2023-08-09T12:39:30.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.972+0000 7f43673e8640 1 -- start start 2023-08-09T12:39:30.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.973+0000 7f43673e8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f436015ce90 0x7f43601616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.973+0000 7f43673e8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43600b6000 0x7f43600cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.973+0000 7f43673e8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43600b6460 con 0x7f43600d29d0 2023-08-09T12:39:30.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.973+0000 7f43673e8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43600cda40 con 0x7f43600b6000 2023-08-09T12:39:30.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.973+0000 7f43673e8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43600cdd10 con 0x7f436015ce90 2023-08-09T12:39:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4364983640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43600b6000 0x7f43600cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4364983640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43600b6000 0x7f43600cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55844/0 (socket says 172.21.15.17:55844) 2023-08-09T12:39:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4364983640 1 -- 172.21.15.17:0/4137156685 learned_addr learned my addr 172.21.15.17:0/4137156685 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4365184640 1 --2- 172.21.15.17:0/4137156685 >> v2:172.21.15.142:3300/0 conn(0x7f436015ce90 0x7f43601616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4364983640 1 -- 172.21.15.17:0/4137156685 >> v2:172.21.15.142:3300/0 conn(0x7f436015ce90 msgr2=0x7f43601616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4364983640 1 --2- 172.21.15.17:0/4137156685 >> v2:172.21.15.142:3300/0 conn(0x7f436015ce90 0x7f43601616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4364983640 1 -- 172.21.15.17:0/4137156685 >> v1:172.21.15.17:6789/0 conn(0x7f43600d29d0 legacy=0x7f43600d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4364983640 1 -- 172.21.15.17:0/4137156685 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43600cdff0 con 0x7f43600b6000 2023-08-09T12:39:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.974+0000 7f4357fff640 1 -- 172.21.15.17:0/4137156685 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284137972 0 0) 0x7f43600b6460 con 0x7f43600d29d0 2023-08-09T12:39:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.975+0000 7f4364983640 1 --2- 172.21.15.17:0/4137156685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43600b6000 0x7f43600cd500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43600d0690 tx=0x7f435002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6857e5dc2409b8de server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f4357fff640 1 -- 172.21.15.17:0/4137156685 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350030860 con 0x7f43600b6000 2023-08-09T12:39:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f4357fff640 1 -- 172.21.15.17:0/4137156685 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43500309c0 con 0x7f43600b6000 2023-08-09T12:39:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f4357fff640 1 -- 172.21.15.17:0/4137156685 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350030d50 con 0x7f43600b6000 2023-08-09T12:39:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f43673e8640 1 -- 172.21.15.17:0/4137156685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43600b6000 msgr2=0x7f43600cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f43673e8640 1 --2- 172.21.15.17:0/4137156685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43600b6000 0x7f43600cd500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43600d0690 tx=0x7f435002b9a0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f43673e8640 1 -- 172.21.15.17:0/4137156685 shutdown_connections 2023-08-09T12:39:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f43673e8640 1 --2- 172.21.15.17:0/4137156685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43600b6000 0x7f43600cd500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f43673e8640 1 --2- 172.21.15.17:0/4137156685 >> v2:172.21.15.142:3300/0 conn(0x7f436015ce90 0x7f43601616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f43673e8640 1 -- 172.21.15.17:0/4137156685 >> 172.21.15.17:0/4137156685 conn(0x7f436006fde0 msgr2=0x7f43600701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f43673e8640 1 -- 172.21.15.17:0/4137156685 shutdown_connections 2023-08-09T12:39:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.976+0000 7f43673e8640 1 -- 172.21.15.17:0/4137156685 wait complete. 2023-08-09T12:39:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.978+0000 7f43673e8640 1 Processor -- start 2023-08-09T12:39:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.978+0000 7f43673e8640 1 -- start start 2023-08-09T12:39:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.979+0000 7f43673e8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43600b6000 0x7f43601f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.979+0000 7f43673e8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600d29d0 0x7f43600b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.979+0000 7f43673e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f436015ce90 0x7f43600b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.979+0000 7f43673e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360146030 con 0x7f436015ce90 2023-08-09T12:39:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.979+0000 7f43673e8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43601e6a10 con 0x7f43600b6000 2023-08-09T12:39:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.979+0000 7f43673e8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43600c8f50 con 0x7f43600d29d0 2023-08-09T12:39:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365985640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f436015ce90 0x7f43600b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365985640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f436015ce90 0x7f43600b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55854/0 (socket says 172.21.15.17:55854) 2023-08-09T12:39:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365985640 1 -- 172.21.15.17:0/1827670593 learned_addr learned my addr 172.21.15.17:0/1827670593 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365184640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43600b6000 0x7f43601f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4364983640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600d29d0 0x7f43600b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365985640 1 -- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600d29d0 msgr2=0x7f43600b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365985640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600d29d0 0x7f43600b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365985640 1 -- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43600b6000 msgr2=0x7f43601f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365985640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43600b6000 0x7f43601f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.980+0000 7f4365985640 1 -- 172.21.15.17:0/1827670593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43500094d0 con 0x7f436015ce90 2023-08-09T12:39:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.981+0000 7f4365985640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f436015ce90 0x7f43600b5040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4358001560 tx=0x7f435800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.981+0000 7f4355ffb640 1 -- 172.21.15.17:0/1827670593 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358003da0 con 0x7f436015ce90 2023-08-09T12:39:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.981+0000 7f4355ffb640 1 -- 172.21.15.17:0/1827670593 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4358005070 con 0x7f436015ce90 2023-08-09T12:39:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.981+0000 7f4355ffb640 1 -- 172.21.15.17:0/1827670593 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358005420 con 0x7f436015ce90 2023-08-09T12:39:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.981+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360145440 con 0x7f436015ce90 2023-08-09T12:39:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.981+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4360145970 con 0x7f436015ce90 2023-08-09T12:39:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.982+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4360067a80 con 0x7f436015ce90 2023-08-09T12:39:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.983+0000 7f4355ffb640 1 -- 172.21.15.17:0/1827670593 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4358005580 con 0x7f436015ce90 2023-08-09T12:39:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.984+0000 7f4355ffb640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f434406a050 0x7f434406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.984+0000 7f4355ffb640 1 -- 172.21.15.17:0/1827670593 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4358087e50 con 0x7f436015ce90 2023-08-09T12:39:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.985+0000 7f4365184640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f434406a050 0x7f434406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:30.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.986+0000 7f4365184640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f434406a050 0x7f434406c510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f435c006fd0 tx=0x7f435c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:30.988+0000 7f4355ffb640 1 -- 172.21.15.17:0/1827670593 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4358053530 con 0x7f436015ce90 2023-08-09T12:39:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.230+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f436015c640 con 0x7f436015ce90 2023-08-09T12:39:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.239+0000 7f4355ffb640 1 -- 172.21.15.17:0/1827670593 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169498 (secure 0 0 0) 0x7f4358017070 con 0x7f436015ce90 2023-08-09T12:39:31.245 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f434406a050 msgr2=0x7f434406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f434406a050 0x7f434406c510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f435c006fd0 tx=0x7f435c008040 comp rx=0 tx=0).stop 2023-08-09T12:39:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f436015ce90 msgr2=0x7f43600b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f436015ce90 0x7f43600b5040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4358001560 tx=0x7f435800cc70 comp rx=0 tx=0).stop 2023-08-09T12:39:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 shutdown_connections 2023-08-09T12:39:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f434406a050 0x7f434406c510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f436015ce90 0x7f43600b5040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600d29d0 0x7f43600b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 --2- 172.21.15.17:0/1827670593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43600b6000 0x7f43601f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 >> 172.21.15.17:0/1827670593 conn(0x7f436006fde0 msgr2=0x7f43600cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 shutdown_connections 2023-08-09T12:39:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.244+0000 7f43673e8640 1 -- 172.21.15.17:0/1827670593 wait complete. 2023-08-09T12:39:31.266 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1755133845},{"type":"v1","addr":"172.21.15.142:6833","nonce":1755133845}]},"active_addr":"172.21.15.142:6833/1755133845","active_change":"2023-08-09T12:39:08.607947+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1718231384}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":3369312183}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":104849562}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":3311489659}]}]} 2023-08-09T12:39:31.271 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-09T12:39:31.271 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-09T12:39:31.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:31.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.499+0000 7fdaa93ab640 1 Processor -- start 2023-08-09T12:39:31.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.500+0000 7fdaa93ab640 1 -- start start 2023-08-09T12:39:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.501+0000 7fdaa93ab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdaa4160030 0x7fdaa4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.501+0000 7fdaa93ab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdaa40b86e0 0x7fdaa40cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.501+0000 7fdaa93ab640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa40b5a30 con 0x7fdaa40cf980 2023-08-09T12:39:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.501+0000 7fdaa93ab640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa40d1110 con 0x7fdaa40b86e0 2023-08-09T12:39:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.501+0000 7fdaa93ab640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa40ceac0 con 0x7fdaa4160030 2023-08-09T12:39:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fda9bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdaa40b86e0 0x7fdaa40cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fda9bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdaa40b86e0 0x7fdaa40cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55868/0 (socket says 172.21.15.17:55868) 2023-08-09T12:39:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fda9bfff640 1 -- 172.21.15.17:0/1166651627 learned_addr learned my addr 172.21.15.17:0/1166651627 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:31.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fdaa3fff640 1 --2- 172.21.15.17:0/1166651627 >> v2:172.21.15.142:3300/0 conn(0x7fdaa4160030 0x7fdaa4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:31.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fda9bfff640 1 -- 172.21.15.17:0/1166651627 >> v2:172.21.15.142:3300/0 conn(0x7fdaa4160030 msgr2=0x7fdaa4160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:31.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fda9bfff640 1 --2- 172.21.15.17:0/1166651627 >> v2:172.21.15.142:3300/0 conn(0x7fdaa4160030 0x7fdaa4160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fda9bfff640 1 -- 172.21.15.17:0/1166651627 >> v1:172.21.15.142:6789/0 conn(0x7fdaa40cf980 legacy=0x7fdaa40b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:31.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fda9bfff640 1 -- 172.21.15.17:0/1166651627 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40cfdd0 con 0x7fdaa40b86e0 2023-08-09T12:39:31.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.502+0000 7fdaa3fff640 1 --2- 172.21.15.17:0/1166651627 >> v2:172.21.15.142:3300/0 conn(0x7fdaa4160030 0x7fdaa4160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:31.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.503+0000 7fda9bfff640 1 --2- 172.21.15.17:0/1166651627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40b86e0 0x7fdaa40cf440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40d3b70 tx=0x7fda8c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3717cb0d1a7462 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:31.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.504+0000 7fdaa37fe640 1 -- 172.21.15.17:0/1166651627 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c031640 con 0x7fdaa40b86e0 2023-08-09T12:39:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.504+0000 7fdaa37fe640 1 -- 172.21.15.17:0/1166651627 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c0317a0 con 0x7fdaa40b86e0 2023-08-09T12:39:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.504+0000 7fdaa37fe640 1 -- 172.21.15.17:0/1166651627 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c031b30 con 0x7fdaa40b86e0 2023-08-09T12:39:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.505+0000 7fdaa93ab640 1 -- 172.21.15.17:0/1166651627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40b86e0 msgr2=0x7fdaa40cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.505+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/1166651627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40b86e0 0x7fdaa40cf440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40d3b70 tx=0x7fda8c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.505+0000 7fdaa93ab640 1 -- 172.21.15.17:0/1166651627 shutdown_connections 2023-08-09T12:39:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.505+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/1166651627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40b86e0 0x7fdaa40cf440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.505+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/1166651627 >> v2:172.21.15.142:3300/0 conn(0x7fdaa4160030 0x7fdaa4160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.505+0000 7fdaa93ab640 1 -- 172.21.15.17:0/1166651627 >> 172.21.15.17:0/1166651627 conn(0x7fdaa40697c0 msgr2=0x7fdaa4069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.505+0000 7fdaa93ab640 1 -- 172.21.15.17:0/1166651627 shutdown_connections 2023-08-09T12:39:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.505+0000 7fdaa93ab640 1 -- 172.21.15.17:0/1166651627 wait complete. 2023-08-09T12:39:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.507+0000 7fdaa93ab640 1 Processor -- start 2023-08-09T12:39:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.507+0000 7fdaa93ab640 1 -- start start 2023-08-09T12:39:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fdaa93ab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa40b86e0 0x7fdaa41597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fdaa93ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40cf980 0x7fdaa4158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fdaa93ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa4160030 0x7fdaa415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fdaa93ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa40c90a0 con 0x7fdaa40cf980 2023-08-09T12:39:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fdaa93ab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4154b90 con 0x7fdaa40b86e0 2023-08-09T12:39:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fdaa93ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa41559f0 con 0x7fdaa4160030 2023-08-09T12:39:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fda9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40cf980 0x7fdaa4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fda9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40cf980 0x7fdaa4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55872/0 (socket says 172.21.15.17:55872) 2023-08-09T12:39:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fda9bfff640 1 -- 172.21.15.17:0/3792355467 learned_addr learned my addr 172.21.15.17:0/3792355467 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.508+0000 7fda9bfff640 1 -- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa4160030 msgr2=0x7fdaa415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fda9bfff640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa4160030 0x7fdaa415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fda9bfff640 1 -- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa40b86e0 msgr2=0x7fdaa41597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fda9bfff640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa40b86e0 0x7fdaa41597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fda9bfff640 1 -- 172.21.15.17:0/3792355467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0094d0 con 0x7fdaa40cf980 2023-08-09T12:39:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fda9bfff640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40cf980 0x7fdaa4158110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda8c02b930 tx=0x7fda8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fdaa17fa640 1 -- 172.21.15.17:0/3792355467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c03ac60 con 0x7fdaa40cf980 2023-08-09T12:39:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fdaa17fa640 1 -- 172.21.15.17:0/3792355467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c03adc0 con 0x7fdaa40cf980 2023-08-09T12:39:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fdaa17fa640 1 -- 172.21.15.17:0/3792355467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c044630 con 0x7fdaa40cf980 2023-08-09T12:39:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa4154de0 con 0x7fdaa40cf980 2023-08-09T12:39:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.509+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa41553a0 con 0x7fdaa40cf980 2023-08-09T12:39:31.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.511+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa40d0cf0 con 0x7fdaa40cf980 2023-08-09T12:39:31.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.512+0000 7fdaa17fa640 1 -- 172.21.15.17:0/3792355467 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda8c02f050 con 0x7fdaa40cf980 2023-08-09T12:39:31.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.513+0000 7fdaa17fa640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda8406a050 0x7fda8406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.513+0000 7fdaa17fa640 1 -- 172.21.15.17:0/3792355467 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda8c0aa610 con 0x7fdaa40cf980 2023-08-09T12:39:31.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.513+0000 7fdaa3fff640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda8406a050 0x7fda8406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:31.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.514+0000 7fdaa3fff640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda8406a050 0x7fda8406c510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda94006fd0 tx=0x7fda94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:31.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.517+0000 7fdaa17fa640 1 -- 172.21.15.17:0/3792355467 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fda8c075cf0 con 0x7fdaa40cf980 2023-08-09T12:39:31.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.712+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdaa40cfdd0 con 0x7fdaa40cf980 2023-08-09T12:39:31.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.715+0000 7fdaa17fa640 1 -- 172.21.15.17:0/3792355467 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fdaa40cfdd0 con 0x7fdaa40cf980 2023-08-09T12:39:31.719 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:31.719 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda8406a050 msgr2=0x7fda8406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda8406a050 0x7fda8406c510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda94006fd0 tx=0x7fda94008040 comp rx=0 tx=0).stop 2023-08-09T12:39:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40cf980 msgr2=0x7fdaa4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40cf980 0x7fdaa4158110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda8c02b930 tx=0x7fda8c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 shutdown_connections 2023-08-09T12:39:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda8406a050 0x7fda8406c510 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa4160030 0x7fdaa415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa40cf980 0x7fdaa4158110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 --2- 172.21.15.17:0/3792355467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa40b86e0 0x7fdaa41597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 >> 172.21.15.17:0/3792355467 conn(0x7fdaa40697c0 msgr2=0x7fdaa415dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 shutdown_connections 2023-08-09T12:39:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.718+0000 7fdaa93ab640 1 -- 172.21.15.17:0/3792355467 wait complete. 2023-08-09T12:39:31.741 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-09T12:39:31.741 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.962+0000 7fa369179640 1 Processor -- start 2023-08-09T12:39:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.963+0000 7fa369179640 1 -- start start 2023-08-09T12:39:31.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.964+0000 7fa369179640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa36415ce90 0x7fa3641616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.964+0000 7fa369179640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640d29d0 0x7fa3640d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.964+0000 7fa369179640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3640b6460 con 0x7fa3640b6000 2023-08-09T12:39:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.964+0000 7fa369179640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3640d33a0 con 0x7fa36415ce90 2023-08-09T12:39:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.964+0000 7fa369179640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3640cdd10 con 0x7fa3640d29d0 2023-08-09T12:39:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.965+0000 7fa362d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa36415ce90 0x7fa3641616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.965+0000 7fa362d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa36415ce90 0x7fa3641616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55888/0 (socket says 172.21.15.17:55888) 2023-08-09T12:39:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.965+0000 7fa362d9d640 1 -- 172.21.15.17:0/3882873938 learned_addr learned my addr 172.21.15.17:0/3882873938 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.965+0000 7fa362d9d640 1 -- 172.21.15.17:0/3882873938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640d29d0 msgr2=0x7fa3640d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:31.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.965+0000 7fa362d9d640 1 --2- 172.21.15.17:0/3882873938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640d29d0 0x7fa3640d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.965+0000 7fa362d9d640 1 -- 172.21.15.17:0/3882873938 >> v1:172.21.15.142:6789/0 conn(0x7fa3640b6000 legacy=0x7fa3640cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:31.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.965+0000 7fa362d9d640 1 -- 172.21.15.17:0/3882873938 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3640cdff0 con 0x7fa36415ce90 2023-08-09T12:39:31.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.966+0000 7fa362d9d640 1 --2- 172.21.15.17:0/3882873938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641616e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa354009870 tx=0x7fa35402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fd1e798fc5adf2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:31.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa36259c640 1 -- 172.21.15.17:0/3882873938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354031640 con 0x7fa36415ce90 2023-08-09T12:39:31.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa36259c640 1 -- 172.21.15.17:0/3882873938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3540317a0 con 0x7fa36415ce90 2023-08-09T12:39:31.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa36259c640 1 -- 172.21.15.17:0/3882873938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354031b30 con 0x7fa36415ce90 2023-08-09T12:39:31.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa369179640 1 -- 172.21.15.17:0/3882873938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 msgr2=0x7fa3641616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa369179640 1 --2- 172.21.15.17:0/3882873938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641616e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa354009870 tx=0x7fa35402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa369179640 1 -- 172.21.15.17:0/3882873938 shutdown_connections 2023-08-09T12:39:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa369179640 1 --2- 172.21.15.17:0/3882873938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640d29d0 0x7fa3640d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa369179640 1 --2- 172.21.15.17:0/3882873938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641616e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.967+0000 7fa369179640 1 -- 172.21.15.17:0/3882873938 >> 172.21.15.17:0/3882873938 conn(0x7fa36406fde0 msgr2=0x7fa3640701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.968+0000 7fa369179640 1 -- 172.21.15.17:0/3882873938 shutdown_connections 2023-08-09T12:39:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.968+0000 7fa369179640 1 -- 172.21.15.17:0/3882873938 wait complete. 2023-08-09T12:39:31.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.969+0000 7fa369179640 1 Processor -- start 2023-08-09T12:39:31.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.969+0000 7fa369179640 1 -- start start 2023-08-09T12:39:31.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.970+0000 7fa369179640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640b6000 0x7fa364148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.970+0000 7fa369179640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3640d29d0 0x7fa36414a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.970+0000 7fa369179640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.970+0000 7fa369179640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364149190 con 0x7fa36415ce90 2023-08-09T12:39:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.970+0000 7fa369179640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364149380 con 0x7fa3640d29d0 2023-08-09T12:39:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.970+0000 7fa369179640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa364149660 con 0x7fa3640b6000 2023-08-09T12:39:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55892/0 (socket says 172.21.15.17:55892) 2023-08-09T12:39:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 -- 172.21.15.17:0/2226728989 learned_addr learned my addr 172.21.15.17:0/2226728989 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa362d9d640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640b6000 0x7fa364148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 -- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640b6000 msgr2=0x7fa364148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640b6000 0x7fa364148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 -- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3640d29d0 msgr2=0x7fa36414a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3640d29d0 0x7fa36414a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 -- 172.21.15.17:0/2226728989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540094d0 con 0x7fa36415ce90 2023-08-09T12:39:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.971+0000 7fa36359e640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641f24d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b970 tx=0x7fa35c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.972+0000 7fa35b7fe640 1 -- 172.21.15.17:0/2226728989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00cb40 con 0x7fa36415ce90 2023-08-09T12:39:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.972+0000 7fa35b7fe640 1 -- 172.21.15.17:0/2226728989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c00ccc0 con 0x7fa36415ce90 2023-08-09T12:39:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.972+0000 7fa35b7fe640 1 -- 172.21.15.17:0/2226728989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c014680 con 0x7fa36415ce90 2023-08-09T12:39:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.972+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa364149940 con 0x7fa36415ce90 2023-08-09T12:39:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.972+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa364149f00 con 0x7fa36415ce90 2023-08-09T12:39:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.973+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36414a120 con 0x7fa36415ce90 2023-08-09T12:39:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.974+0000 7fa35b7fe640 1 -- 172.21.15.17:0/2226728989 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa35c01d3b0 con 0x7fa36415ce90 2023-08-09T12:39:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.975+0000 7fa35b7fe640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34406a050 0x7fa34406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.975+0000 7fa35b7fe640 1 -- 172.21.15.17:0/2226728989 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa35c088530 con 0x7fa36415ce90 2023-08-09T12:39:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.976+0000 7fa362d9d640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34406a050 0x7fa34406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.977+0000 7fa362d9d640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34406a050 0x7fa34406c510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa354036000 tx=0x7fa35403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:31.980+0000 7fa35b7fe640 1 -- 172.21.15.17:0/2226728989 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa35c0576a0 con 0x7fa36415ce90 2023-08-09T12:39:32.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.173+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa364067a80 con 0x7fa36415ce90 2023-08-09T12:39:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.175+0000 7fa35b7fe640 1 -- 172.21.15.17:0/2226728989 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fa35c057230 con 0x7fa36415ce90 2023-08-09T12:39:32.179 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:32.179 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34406a050 msgr2=0x7fa34406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34406a050 0x7fa34406c510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa354036000 tx=0x7fa35403c040 comp rx=0 tx=0).stop 2023-08-09T12:39:32.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 msgr2=0x7fa3641f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641f24d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b970 tx=0x7fa35c00be30 comp rx=0 tx=0).stop 2023-08-09T12:39:32.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 shutdown_connections 2023-08-09T12:39:32.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34406a050 0x7fa34406c510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36415ce90 0x7fa3641f24d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3640d29d0 0x7fa36414a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 --2- 172.21.15.17:0/2226728989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3640b6000 0x7fa364148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 >> 172.21.15.17:0/2226728989 conn(0x7fa36406fde0 msgr2=0x7fa3640cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 shutdown_connections 2023-08-09T12:39:32.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.178+0000 7fa369179640 1 -- 172.21.15.17:0/2226728989 wait complete. 2023-08-09T12:39:32.202 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-09T12:39:32.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-09T12:39:32.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-09T12:39:32.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-09T12:39:32.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-09T12:39:32.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-09T12:39:32.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-09T12:39:32.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-09T12:39:32.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.529+0000 7f5b01986640 1 Processor -- start 2023-08-09T12:39:32.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.530+0000 7f5b01986640 1 -- start start 2023-08-09T12:39:32.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.532+0000 7f5b01986640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf170 0x7f5afc158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.532+0000 7f5b01986640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5afc0c8ca0 0x7f5afc0697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.532+0000 7f5b01986640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc159110 con 0x7f5afc0ca700 2023-08-09T12:39:32.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.532+0000 7f5b01986640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc0cd030 con 0x7f5afc0c8ca0 2023-08-09T12:39:32.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.532+0000 7f5b01986640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0c3a00 con 0x7f5afc0cf170 2023-08-09T12:39:32.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.533+0000 7f5afa7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5afc0ca700 0x7f5afc0cc220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48992/0 (socket says 172.21.15.17:48992) 2023-08-09T12:39:32.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.533+0000 7f5afa7fc640 1 -- 172.21.15.17:0/511334936 learned_addr learned my addr 172.21.15.17:0/511334936 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:32.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.533+0000 7f5afaffd640 1 --2- 172.21.15.17:0/511334936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf170 0x7f5afc158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.533+0000 7f116a85e640 1 Processor -- start 2023-08-09T12:39:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.533+0000 7f5afb7fe640 1 --2- 172.21.15.17:0/511334936 >> v2:172.21.15.142:3300/0 conn(0x7f5afc0c8ca0 0x7f5afc0697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.533+0000 7f83f759e640 1 Processor -- start 2023-08-09T12:39:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.534+0000 7f5afaffd640 1 -- 172.21.15.17:0/511334936 >> v2:172.21.15.142:3300/0 conn(0x7f5afc0c8ca0 msgr2=0x7f5afc0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.534+0000 7f5afaffd640 1 --2- 172.21.15.17:0/511334936 >> v2:172.21.15.142:3300/0 conn(0x7f5afc0c8ca0 0x7f5afc0697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.534+0000 7f5afaffd640 1 -- 172.21.15.17:0/511334936 >> v1:172.21.15.17:6789/0 conn(0x7f5afc0ca700 legacy=0x7f5afc0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.534+0000 7f5afaffd640 1 -- 172.21.15.17:0/511334936 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc0ccd50 con 0x7f5afc0cf170 2023-08-09T12:39:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.534+0000 7f83f759e640 1 -- start start 2023-08-09T12:39:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.533+0000 7f116a85e640 1 -- start start 2023-08-09T12:39:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f116a85e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1164158e40 0x7f11640cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f116a85e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ca700 0x7f11640c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f116a85e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11640c91e0 0x7f11640c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f116a85e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640cd030 con 0x7f1164158e40 2023-08-09T12:39:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f116a85e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640c3a00 con 0x7f11640c91e0 2023-08-09T12:39:32.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f116a85e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640cca70 con 0x7f11640ca700 2023-08-09T12:39:32.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f83f759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f83f80cb610 0x7f83f806ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f83f759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80b3b60 con 0x7f83f80b0ac0 2023-08-09T12:39:32.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f83f759e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80b3550 con 0x7f83f80b0ea0 2023-08-09T12:39:32.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f83f759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f81617b0 con 0x7f83f80cb610 2023-08-09T12:39:32.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.536+0000 7f5afaffd640 1 --2- 172.21.15.17:0/511334936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf170 0x7f5afc158bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0097a0 tx=0x7f5aec02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e0dd948264cea9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f115b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ca700 0x7f11640c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f1168dfb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11640c91e0 0x7f11640c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f115b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ca700 0x7f11640c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38724/0 (socket says 172.21.15.17:38724) 2023-08-09T12:39:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f115b7fe640 1 -- 172.21.15.17:0/3578400306 learned_addr learned my addr 172.21.15.17:0/3578400306 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f83f659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f83f80b0ac0 0x7f83f80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48994/0 (socket says 172.21.15.17:48994) 2023-08-09T12:39:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f83f659c640 1 -- 172.21.15.17:0/3391793680 learned_addr learned my addr 172.21.15.17:0/3391793680 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f1163fff640 1 --2- 172.21.15.17:0/3578400306 >> v2:172.21.15.17:3300/0 conn(0x7f1164158e40 0x7f11640cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f5af9ffb640 1 -- 172.21.15.17:0/511334936 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec030800 con 0x7f5afc0cf170 2023-08-09T12:39:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f5af9ffb640 1 -- 172.21.15.17:0/511334936 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec030960 con 0x7f5afc0cf170 2023-08-09T12:39:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f5af9ffb640 1 -- 172.21.15.17:0/511334936 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec030cf0 con 0x7f5afc0cf170 2023-08-09T12:39:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f115b7fe640 1 -- 172.21.15.17:0/3578400306 >> v2:172.21.15.142:3300/0 conn(0x7f11640c91e0 msgr2=0x7f11640c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f115b7fe640 1 --2- 172.21.15.17:0/3578400306 >> v2:172.21.15.142:3300/0 conn(0x7f11640c91e0 0x7f11640c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f115b7fe640 1 -- 172.21.15.17:0/3578400306 >> v2:172.21.15.17:3300/0 conn(0x7f1164158e40 msgr2=0x7f11640cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.537+0000 7f83f6d9d640 1 --2- 172.21.15.17:0/3391793680 >> v2:172.21.15.17:3300/0 conn(0x7f83f80cb610 0x7f83f806ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098079088 0 0) 0x7f83f80b3550 con 0x7f83f80b0ea0 2023-08-09T12:39:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e0003520 con 0x7f83f80b0ea0 2023-08-09T12:39:32.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f5b01986640 1 -- 172.21.15.17:0/511334936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf170 msgr2=0x7f5afc158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f5b01986640 1 --2- 172.21.15.17:0/511334936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf170 0x7f5afc158bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0097a0 tx=0x7f5aec02b940 comp rx=0 tx=0).stop 2023-08-09T12:39:32.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f5b01986640 1 -- 172.21.15.17:0/511334936 shutdown_connections 2023-08-09T12:39:32.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f5b01986640 1 --2- 172.21.15.17:0/511334936 >> v2:172.21.15.142:3300/0 conn(0x7f5afc0c8ca0 0x7f5afc0697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f5b01986640 1 --2- 172.21.15.17:0/511334936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf170 0x7f5afc158bd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f5b01986640 1 -- 172.21.15.17:0/511334936 >> 172.21.15.17:0/511334936 conn(0x7f5afc0ce650 msgr2=0x7f5afc0cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813358082 0 0) 0x7f83f80b3b60 con 0x7f83f80b0ac0 2023-08-09T12:39:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f80b3550 con 0x7f83f80b0ac0 2023-08-09T12:39:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3031983993 0 0) 0x7f83e0003520 con 0x7f83f80b0ea0 2023-08-09T12:39:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 >> v2:172.21.15.17:3300/0 conn(0x7f83f80cb610 msgr2=0x7f83f806ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 --2- 172.21.15.17:0/3391793680 >> v2:172.21.15.17:3300/0 conn(0x7f83f80cb610 0x7f83f806ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 >> v1:172.21.15.17:6789/0 conn(0x7f83f80b0ac0 legacy=0x7f83f80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80c9e10 con 0x7f83f80b0ea0 2023-08-09T12:39:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f83e8001670 con 0x7f83f80b0ea0 2023-08-09T12:39:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 >> v1:172.21.15.142:6789/0 conn(0x7f83f80b0ea0 legacy=0x7f83f80caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e0003b50 0x7f83e0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e00047c0 0x7f83e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e0005180 0x7f83e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f81617b0 con 0x7f83e00047c0 2023-08-09T12:39:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e000c050 con 0x7f83e0005180 2023-08-09T12:39:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e000c210 con 0x7f83e0003b50 2023-08-09T12:39:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f6d9d640 1 --2- 172.21.15.17:0/3391793680 >> v2:172.21.15.17:3300/0 conn(0x7f83f80cb610 0x7f83f806ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:32.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f115b7fe640 1 --2- 172.21.15.17:0/3578400306 >> v2:172.21.15.17:3300/0 conn(0x7f1164158e40 0x7f11640cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.538+0000 7f115b7fe640 1 -- 172.21.15.17:0/3578400306 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640ccd50 con 0x7f11640ca700 2023-08-09T12:39:32.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f5b01986640 1 -- 172.21.15.17:0/511334936 shutdown_connections 2023-08-09T12:39:32.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f5d9b640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e00047c0 0x7f83e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f83f659c640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e0003b50 0x7f83e0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.540+0000 7f1163fff640 1 --2- 172.21.15.17:0/3578400306 >> v2:172.21.15.17:3300/0 conn(0x7f1164158e40 0x7f11640cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:32.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.539+0000 7f5b01986640 1 -- 172.21.15.17:0/511334936 wait complete. 2023-08-09T12:39:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.540+0000 7f83f6d9d640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e0005180 0x7f83e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.540+0000 7f115b7fe640 1 --2- 172.21.15.17:0/3578400306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ca700 0x7f11640c8ca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f11640b1250 tx=0x7f114c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930bc7fa08bf1ea4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.541+0000 7f11637fe640 1 -- 172.21.15.17:0/3578400306 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c031890 con 0x7f11640ca700 2023-08-09T12:39:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.541+0000 7f11637fe640 1 -- 172.21.15.17:0/3578400306 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c0319f0 con 0x7f11640ca700 2023-08-09T12:39:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.541+0000 7f11637fe640 1 -- 172.21.15.17:0/3578400306 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c031d60 con 0x7f11640ca700 2023-08-09T12:39:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.540+0000 7f83f5d9b640 1 -- 172.21.15.17:0/3391793680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e0003b50 msgr2=0x7f83e0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.540+0000 7f83f5d9b640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83e0003b50 0x7f83e0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.540+0000 7f83f5d9b640 1 -- 172.21.15.17:0/3391793680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e0005180 msgr2=0x7f83e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.540+0000 7f83f5d9b640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83e0005180 0x7f83e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.540+0000 7f83f5d9b640 1 -- 172.21.15.17:0/3391793680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0003520 con 0x7f83e00047c0 2023-08-09T12:39:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.541+0000 7f83f6d9d640 1 -- 172.21.15.17:0/3391793680 reap_dead start 2023-08-09T12:39:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 -- 172.21.15.17:0/3578400306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ca700 msgr2=0x7f11640c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 --2- 172.21.15.17:0/3578400306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ca700 0x7f11640c8ca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f11640b1250 tx=0x7f114c02b930 comp rx=0 tx=0).stop 2023-08-09T12:39:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f5b01986640 1 Processor -- start 2023-08-09T12:39:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 -- 172.21.15.17:0/3578400306 shutdown_connections 2023-08-09T12:39:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 --2- 172.21.15.17:0/3578400306 >> v2:172.21.15.142:3300/0 conn(0x7f11640c91e0 0x7f11640c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 --2- 172.21.15.17:0/3578400306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11640ca700 0x7f11640c8ca0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 --2- 172.21.15.17:0/3578400306 >> v2:172.21.15.17:3300/0 conn(0x7f1164158e40 0x7f11640cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 -- 172.21.15.17:0/3578400306 >> 172.21.15.17:0/3578400306 conn(0x7f11640ce650 msgr2=0x7f11640cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 -- 172.21.15.17:0/3578400306 shutdown_connections 2023-08-09T12:39:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.543+0000 7f83f5d9b640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e00047c0 0x7f83e0004c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83e8007e80 tx=0x7f83e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb70bc8d7f39efc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f5b01986640 1 -- start start 2023-08-09T12:39:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.544+0000 7f5b01986640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0c8ca0 0x7f5afc15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.544+0000 7f5b01986640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5afc0ca700 0x7f5afc0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f5afa7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5afc0ca700 0x7f5afc0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f5afa7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5afc0ca700 0x7f5afc0c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55932/0 (socket says 172.21.15.17:55932) 2023-08-09T12:39:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.543+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e802c830 con 0x7f83e00047c0 2023-08-09T12:39:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.543+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e802c990 con 0x7f83e00047c0 2023-08-09T12:39:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.543+0000 7f83f559a640 1 -- 172.21.15.17:0/3391793680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e802cd80 con 0x7f83e00047c0 2023-08-09T12:39:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.544+0000 7f83f759e640 1 -- 172.21.15.17:0/3391793680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e00047c0 msgr2=0x7f83e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.544+0000 7f83f759e640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e00047c0 0x7f83e0004c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83e8007e80 tx=0x7f83e00057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f83f759e640 1 -- 172.21.15.17:0/3391793680 shutdown_connections 2023-08-09T12:39:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f83f759e640 1 --2- 172.21.15.17:0/3391793680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e00047c0 0x7f83e0004c40 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83e8007e80 tx=0x7f83e00057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f83f759e640 1 -- 172.21.15.17:0/3391793680 >> 172.21.15.17:0/3391793680 conn(0x7f83f80b1d50 msgr2=0x7f83f806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f5afaffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0c8ca0 0x7f5afc15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f5afa7fc640 1 -- 172.21.15.17:0/685206782 learned_addr learned my addr 172.21.15.17:0/685206782 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f5b01986640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc0cf170 0x7f5afc162850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.542+0000 7f116a85e640 1 -- 172.21.15.17:0/3578400306 wait complete. 2023-08-09T12:39:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f116a85e640 1 Processor -- start 2023-08-09T12:39:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f83f759e640 1 -- 172.21.15.17:0/3391793680 shutdown_connections 2023-08-09T12:39:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f116a85e640 1 -- start start 2023-08-09T12:39:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.546+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0c7b10 con 0x7f5afc0ca700 2023-08-09T12:39:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.546+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc15c030 con 0x7f5afc0cf170 2023-08-09T12:39:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.546+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc163340 con 0x7f5afc0c8ca0 2023-08-09T12:39:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.546+0000 7f5afb7fe640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc0cf170 0x7f5afc162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.547+0000 7f5afa7fc640 1 -- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0c8ca0 msgr2=0x7f5afc15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.547+0000 7f5afa7fc640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0c8ca0 0x7f5afc15baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.547+0000 7f5afa7fc640 1 -- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc0cf170 msgr2=0x7f5afc162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.547+0000 7f5afa7fc640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc0cf170 0x7f5afc162850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.547+0000 7f5afa7fc640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009400 con 0x7f5afc0ca700 2023-08-09T12:39:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f116a85e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640c91e0 0x7f1164159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f116a85e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640ca700 0x7f116406ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.545+0000 7f83f759e640 1 -- 172.21.15.17:0/3391793680 wait complete. 2023-08-09T12:39:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f83f759e640 1 Processor -- start 2023-08-09T12:39:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f5afa7fc640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5afc0ca700 0x7f5afc0c7fa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5af400cba0 tx=0x7f5af400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f116a85e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1164158e40 0x7f1164070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f83f759e640 1 -- start start 2023-08-09T12:39:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f5afaffd640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0c8ca0 0x7f5afc15baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400ad40 con 0x7f5afc0ca700 2023-08-09T12:39:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.549+0000 7f116a85e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1164159220 con 0x7f11640c91e0 2023-08-09T12:39:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af4012400 con 0x7f5afc0ca700 2023-08-09T12:39:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400aea0 con 0x7f5afc0ca700 2023-08-09T12:39:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.548+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc163620 con 0x7f5afc0ca700 2023-08-09T12:39:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.549+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc0c84e0 con 0x7f5afc0ca700 2023-08-09T12:39:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.549+0000 7f5afb7fe640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc0cf170 0x7f5afc162850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.549+0000 7f115b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640ca700 0x7f116406ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.549+0000 7f115b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640ca700 0x7f116406ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:33878/0 (socket says 172.21.15.17:33878) 2023-08-09T12:39:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.549+0000 7f115b7fe640 1 -- 172.21.15.17:0/291014540 learned_addr learned my addr 172.21.15.17:0/291014540 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.549+0000 7f1168dfb640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1164158e40 0x7f1164070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.549+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11641534b0 con 0x7f11640ca700 2023-08-09T12:39:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.550+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1164153790 con 0x7f1164158e40 2023-08-09T12:39:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.550+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5adc000fc0 con 0x7f5afc0ca700 2023-08-09T12:39:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f1168dfb640 1 -- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640ca700 msgr2=0x7f116406ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f1168dfb640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640ca700 0x7f116406ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f1168dfb640 1 -- 172.21.15.17:0/291014540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640c91e0 msgr2=0x7f1164159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f1168dfb640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640c91e0 0x7f1164159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f1168dfb640 1 -- 172.21.15.17:0/291014540 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c0094d0 con 0x7f1164158e40 2023-08-09T12:39:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f115b7fe640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11640ca700 0x7f116406ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f83f759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83f814dda0 0x7f83f8150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f83f759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83f814e180 0x7f83f80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.551+0000 7f1168dfb640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1164158e40 0x7f1164070500 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f115c007470 tx=0x7f115c007930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83f814dda0 0x7f83f8150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83f814dda0 0x7f83f8150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38778/0 (socket says 172.21.15.17:38778) 2023-08-09T12:39:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83f8150bd0 0x7f83f8070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f659c640 1 -- 172.21.15.17:0/2279333987 learned_addr learned my addr 172.21.15.17:0/2279333987 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c00d310 con 0x7f1164158e40 2023-08-09T12:39:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c00d470 con 0x7f1164158e40 2023-08-09T12:39:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c003bb0 con 0x7f1164158e40 2023-08-09T12:39:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f759e640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f814eb70 con 0x7f83f8150bd0 2023-08-09T12:39:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f5d9b640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83f814e180 0x7f83f80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f759e640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8151670 con 0x7f83f814e180 2023-08-09T12:39:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f759e640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f81510b0 con 0x7f83f814dda0 2023-08-09T12:39:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f83f6d9d640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83f8150bd0 0x7f83f8070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.552+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11641594e0 con 0x7f1164158e40 2023-08-09T12:39:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.553+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11641feee0 con 0x7f1164158e40 2023-08-09T12:39:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.553+0000 7f83f659c640 1 -- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83f814e180 msgr2=0x7f83f80702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.553+0000 7f83f659c640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83f814e180 0x7f83f80702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.553+0000 7f83f659c640 1 -- 172.21.15.17:0/2279333987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83f8150bd0 msgr2=0x7f83f8070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.553+0000 7f83f659c640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83f8150bd0 0x7f83f8070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.553+0000 7f83f659c640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8151390 con 0x7f83f814dda0 2023-08-09T12:39:32.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.554+0000 7f83f659c640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83f814dda0 0x7f83f8150690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0014a0 tx=0x7f83ec001960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.554+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11640c3ef0 con 0x7f1164158e40 2023-08-09T12:39:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.554+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00f6e0 con 0x7f83f814dda0 2023-08-09T12:39:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.554+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00f880 con 0x7f83f814dda0 2023-08-09T12:39:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.554+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00fc30 con 0x7f83f814dda0 2023-08-09T12:39:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.554+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5af4007070 con 0x7f5afc0ca700 2023-08-09T12:39:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.555+0000 7f5ae3fff640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ae806a150 0x7f5ae806c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.555+0000 7f83f759e640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f814e790 con 0x7f83f814dda0 2023-08-09T12:39:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.556+0000 7f83f759e640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f80bd5e0 con 0x7f83f814dda0 2023-08-09T12:39:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.555+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5af4088cd0 con 0x7f5afc0ca700 2023-08-09T12:39:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.556+0000 7f5ae3fff640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7f5ae8072a10 0x7f5ae8074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.556+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ae80754e0 con 0x7f5ae8072a10 2023-08-09T12:39:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.556+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5af4089080 con 0x7f5afc0ca700 2023-08-09T12:39:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.556+0000 7f5afb7fe640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7f5ae8072a10 0x7f5ae8074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.557+0000 7f324f179640 1 Processor -- start 2023-08-09T12:39:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.558+0000 7f324f179640 1 -- start start 2023-08-09T12:39:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.557+0000 7f5afb7fe640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7f5ae8072a10 0x7f5ae8074e30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.558+0000 7f5afaffd640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ae806a150 0x7f5ae806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.558+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f115c003d10 con 0x7f1164158e40 2023-08-09T12:39:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.559+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 <== osd.0 v2:172.21.15.17:6808/1208264847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f5ae80754e0 con 0x7f5ae8072a10 2023-08-09T12:39:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.559+0000 7f5afaffd640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ae806a150 0x7f5ae806c610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5aec036000 tx=0x7f5aec03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f11617fa640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f114806a080 0x7f114806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f115c088b80 con 0x7f1164158e40 2023-08-09T12:39:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f11617fa640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f11480728c0 0x7f1148074ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 --> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1148075390 con 0x7f11480728c0 2023-08-09T12:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f115c088fd0 con 0x7f1164158e40 2023-08-09T12:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.562+0000 7f115b7fe640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f11480728c0 0x7f1148074ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.562+0000 7f1163fff640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f114806a080 0x7f114806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f115b7fe640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f11480728c0 0x7f1148074ce0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.560+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f83ec00fd90 con 0x7f83f814dda0 2023-08-09T12:39:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f83f759e640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83f80b37f0 con 0x7f83f814dda0 2023-08-09T12:39:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f83e6ffd640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f83d806a050 0x7f83d806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83ec088510 con 0x7f83f814dda0 2023-08-09T12:39:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f83e6ffd640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f83d8072890 0x7f83d8074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83d8075360 con 0x7f83d8072890 2023-08-09T12:39:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.562+0000 7f83f5d9b640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f83d806a050 0x7f83d806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.562+0000 7f83f6d9d640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f83d8072890 0x7f83d8074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.562+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83ec053bf0 con 0x7f83f814dda0 2023-08-09T12:39:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f83f6d9d640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f83d8072890 0x7f83d8074cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f4502c1a640 1 Processor -- start 2023-08-09T12:39:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.562+0000 7f9dd63c4640 1 Processor -- start 2023-08-09T12:39:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f9dd63c4640 1 -- start start 2023-08-09T12:39:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.560+0000 7f324f179640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32480cd1d0 0x7f32480cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.560+0000 7f324f179640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480cdaf0 con 0x7f32480d1a00 2023-08-09T12:39:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.560+0000 7f324f179640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480d0220 con 0x7f32480d15c0 2023-08-09T12:39:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.560+0000 7f324f179640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480ced10 con 0x7f32480cd1d0 2023-08-09T12:39:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f3247fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f32480d15c0 0x7f32480b59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:50028/0 (socket says 172.21.15.17:50028) 2023-08-09T12:39:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f3247fff640 1 -- 172.21.15.17:0/2473158998 learned_addr learned my addr 172.21.15.17:0/2473158998 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f324cf15640 1 --2- 172.21.15.17:0/2473158998 >> v2:172.21.15.142:3300/0 conn(0x7f32480cd1d0 0x7f32480cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.562+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532749600 0 0) 0x7f32480d0220 con 0x7f32480d15c0 2023-08-09T12:39:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.562+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234003520 con 0x7f32480d15c0 2023-08-09T12:39:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2973799206 0 0) 0x7f3234003520 con 0x7f32480d15c0 2023-08-09T12:39:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 >> v2:172.21.15.142:3300/0 conn(0x7f32480cd1d0 msgr2=0x7f32480cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 --2- 172.21.15.17:0/2473158998 >> v2:172.21.15.142:3300/0 conn(0x7f32480cd1d0 0x7f32480cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 >> v1:172.21.15.17:6789/0 conn(0x7f32480d1a00 legacy=0x7f32480cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32480d0ae0 con 0x7f32480d15c0 2023-08-09T12:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f3240001670 con 0x7f32480d15c0 2023-08-09T12:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 >> v1:172.21.15.142:6789/0 conn(0x7f32480d15c0 legacy=0x7f32480b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3234003970 0x7f3234003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340047c0 0x7f3234004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3234005180 0x7f323400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323400c080 con 0x7f32340047c0 2023-08-09T12:39:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323400c1f0 con 0x7f3234003970 2023-08-09T12:39:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.563+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323400c3b0 con 0x7f3234005180 2023-08-09T12:39:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f1163fff640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f114806a080 0x7f114806c540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1154006fd0 tx=0x7f1154008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.561+0000 7f4502c1a640 1 -- start start 2023-08-09T12:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f83f5d9b640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f83d806a050 0x7f83d806c510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83e8036000 tx=0x7f83e8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f324d716640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3234005180 0x7f323400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f324cf15640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3234003970 0x7f3234003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f3247fff640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340047c0 0x7f3234004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 <== osd.1 v2:172.21.15.17:6816/160883259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f1148075390 con 0x7f11480728c0 2023-08-09T12:39:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f4502c1a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc15ea30 0x7f44fc0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f4502c1a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f44fc161550 0x7f44fc0c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f4502c1a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f44fc0c9660 0x7f44fc164a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f4502c1a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0c9b10 con 0x7f44fc161550 2023-08-09T12:39:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f4502c1a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0cdb90 con 0x7f44fc0c9660 2023-08-09T12:39:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.564+0000 7f4502c1a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc15ee10 con 0x7f44fc15ea30 2023-08-09T12:39:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f9dd63c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9dd00ada40 0x7f9dd00c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f4501c18640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc15ea30 0x7f44fc0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f4501c18640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc15ea30 0x7f44fc0cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38788/0 (socket says 172.21.15.17:38788) 2023-08-09T12:39:32.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f4501c18640 1 -- 172.21.15.17:0/1195918489 learned_addr learned my addr 172.21.15.17:0/1195918489 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f9dd63c4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd00adeb0 con 0x7f9dd00cf110 2023-08-09T12:39:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f9dd63c4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd00c8c40 con 0x7f9dd00ad4f0 2023-08-09T12:39:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f9dd63c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd00c8f90 con 0x7f9dd00ada40 2023-08-09T12:39:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f4501417640 1 --2- 172.21.15.17:0/1195918489 >> v2:172.21.15.17:3300/0 conn(0x7f44fc161550 0x7f44fc0c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f4502419640 1 --2- 172.21.15.17:0/1195918489 >> v2:172.21.15.142:3300/0 conn(0x7f44fc0c9660 0x7f44fc164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.567+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 <== osd.2 v2:172.21.15.17:6800/1219800306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f83d8075360 con 0x7f83d8072890 2023-08-09T12:39:32.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f9dd4bc1640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9dd00ad4f0 0x7f9dd00c93b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:50032/0 (socket says 172.21.15.17:50032) 2023-08-09T12:39:32.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f9dd4bc1640 1 -- 172.21.15.17:0/4276971000 learned_addr learned my addr 172.21.15.17:0/4276971000 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f9dd5bc3640 1 --2- 172.21.15.17:0/4276971000 >> v2:172.21.15.142:3300/0 conn(0x7f9dd00ada40 0x7f9dd00c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f9dd5bc3640 1 -- 172.21.15.17:0/4276971000 >> v1:172.21.15.142:6789/0 conn(0x7f9dd00ad4f0 legacy=0x7f9dd00c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f9dd5bc3640 1 -- 172.21.15.17:0/4276971000 >> v1:172.21.15.17:6789/0 conn(0x7f9dd00cf110 legacy=0x7f9dd0158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f9dd5bc3640 1 -- 172.21.15.17:0/4276971000 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00c1f30 con 0x7f9dd00ada40 2023-08-09T12:39:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f324d716640 1 -- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3234003970 msgr2=0x7f3234003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f324d716640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3234003970 0x7f3234003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f324d716640 1 -- 172.21.15.17:0/2473158998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340047c0 msgr2=0x7f3234004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f324d716640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340047c0 0x7f3234004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f324d716640 1 -- 172.21.15.17:0/2473158998 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32480d0ae0 con 0x7f3234005180 2023-08-09T12:39:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.565+0000 7f3247fff640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340047c0 0x7f3234004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f324d716640 1 -- 172.21.15.17:0/2473158998 reap_dead start 2023-08-09T12:39:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.567+0000 7f324cf15640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3234003970 0x7f3234003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f4501c18640 1 -- 172.21.15.17:0/1195918489 >> v2:172.21.15.142:3300/0 conn(0x7f44fc0c9660 msgr2=0x7f44fc164a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f4501c18640 1 --2- 172.21.15.17:0/1195918489 >> v2:172.21.15.142:3300/0 conn(0x7f44fc0c9660 0x7f44fc164a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f4501c18640 1 -- 172.21.15.17:0/1195918489 >> v2:172.21.15.17:3300/0 conn(0x7f44fc161550 msgr2=0x7f44fc0c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f4501c18640 1 --2- 172.21.15.17:0/1195918489 >> v2:172.21.15.17:3300/0 conn(0x7f44fc161550 0x7f44fc0c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.566+0000 7f4501c18640 1 -- 172.21.15.17:0/1195918489 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0ccf80 con 0x7f44fc15ea30 2023-08-09T12:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.567+0000 7f324d716640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3234005180 0x7f323400b980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3230001640 tx=0x7f32340057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=866f5c5d58769f52 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.567+0000 7f90fd4ba640 1 Processor -- start 2023-08-09T12:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.568+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230005270 con 0x7f3234005180 2023-08-09T12:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.568+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323002e070 con 0x7f3234005180 2023-08-09T12:39:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.568+0000 7f32477fe640 1 -- 172.21.15.17:0/2473158998 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230003610 con 0x7f3234005180 2023-08-09T12:39:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.568+0000 7f90fd4ba640 1 -- start start 2023-08-09T12:39:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.568+0000 7f9dd5bc3640 1 --2- 172.21.15.17:0/4276971000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd00ada40 0x7f9dd00c9ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009c80 tx=0x7f9dc802cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fffc661e27549de server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f4501c18640 1 --2- 172.21.15.17:0/1195918489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc15ea30 0x7f44fc0cc6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0ae600 tx=0x7f44f402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742465afb2903441 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f324f179640 1 -- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3234005180 msgr2=0x7f323400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f324f179640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3234005180 0x7f323400b980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3230001640 tx=0x7f32340057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f324f179640 1 -- 172.21.15.17:0/2473158998 shutdown_connections 2023-08-09T12:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f324f179640 1 --2- 172.21.15.17:0/2473158998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3234005180 0x7f323400b980 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f324f179640 1 -- 172.21.15.17:0/2473158998 >> 172.21.15.17:0/2473158998 conn(0x7f324806fde0 msgr2=0x7f32480701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f9dc7fff640 1 -- 172.21.15.17:0/4276971000 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc802dce0 con 0x7f9dd00ada40 2023-08-09T12:39:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f9dc7fff640 1 -- 172.21.15.17:0/4276971000 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc802de40 con 0x7f9dd00ada40 2023-08-09T12:39:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f9dc7fff640 1 -- 172.21.15.17:0/4276971000 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8035660 con 0x7f9dd00ada40 2023-08-09T12:39:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f324f179640 1 -- 172.21.15.17:0/2473158998 shutdown_connections 2023-08-09T12:39:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f4500c16640 1 -- 172.21.15.17:0/1195918489 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f402ca80 con 0x7f44fc15ea30 2023-08-09T12:39:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f4500c16640 1 -- 172.21.15.17:0/1195918489 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f402cbe0 con 0x7f44fc15ea30 2023-08-09T12:39:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f4500c16640 1 -- 172.21.15.17:0/1195918489 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40343f0 con 0x7f44fc15ea30 2023-08-09T12:39:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f9dd63c4640 1 -- 172.21.15.17:0/4276971000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd00ada40 msgr2=0x7f9dd00c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f9dd63c4640 1 --2- 172.21.15.17:0/4276971000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd00ada40 0x7f9dd00c9ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009c80 tx=0x7f9dc802cf30 comp rx=0 tx=0).stop 2023-08-09T12:39:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f90fd4ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f8161090 0x7f90f80697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f9dd63c4640 1 -- 172.21.15.17:0/4276971000 shutdown_connections 2023-08-09T12:39:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f9dd63c4640 1 --2- 172.21.15.17:0/4276971000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd00ada40 0x7f9dd00c9ac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f9dd63c4640 1 -- 172.21.15.17:0/4276971000 >> 172.21.15.17:0/4276971000 conn(0x7f9dd00ce5f0 msgr2=0x7f9dd00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.569+0000 7f324f179640 1 -- 172.21.15.17:0/2473158998 wait complete. 2023-08-09T12:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f890fbb1640 1 Processor -- start 2023-08-09T12:39:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.570+0000 7f90fd4ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f90f8069d00 0x7f90f80c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90fd4ba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f806a160 con 0x7f90f80c4fe0 2023-08-09T12:39:32.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90fd4ba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f806cff0 con 0x7f90f8069d00 2023-08-09T12:39:32.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90fd4ba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f806c3e0 con 0x7f90f8161090 2023-08-09T12:39:32.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90f6ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f8161090 0x7f90f80697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90f6ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f8161090 0x7f90f80697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38796/0 (socket says 172.21.15.17:38796) 2023-08-09T12:39:32.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90f6ffd640 1 -- 172.21.15.17:0/3693372309 learned_addr learned my addr 172.21.15.17:0/3693372309 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90f67fc640 1 --2- 172.21.15.17:0/3693372309 >> v2:172.21.15.17:3300/0 conn(0x7f90f8069d00 0x7f90f80c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90f6ffd640 1 -- 172.21.15.17:0/3693372309 >> v2:172.21.15.17:3300/0 conn(0x7f90f8069d00 msgr2=0x7f90f80c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f90f6ffd640 1 --2- 172.21.15.17:0/3693372309 >> v2:172.21.15.17:3300/0 conn(0x7f90f8069d00 0x7f90f80c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.572+0000 7f90f6ffd640 1 -- 172.21.15.17:0/3693372309 >> v1:172.21.15.17:6789/0 conn(0x7f90f80c4fe0 legacy=0x7f90f80c3560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T12:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.572+0000 7f90f6ffd640 1 -- 172.21.15.17:0/3693372309 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f806c6c0 con 0x7f90f8161090 2023-08-09T12:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f4502c1a640 1 -- 172.21.15.17:0/1195918489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc15ea30 msgr2=0x7f44fc0cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f4502c1a640 1 --2- 172.21.15.17:0/1195918489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc15ea30 0x7f44fc0cc6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0ae600 tx=0x7f44f402bee0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f4502c1a640 1 -- 172.21.15.17:0/1195918489 shutdown_connections 2023-08-09T12:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f4502c1a640 1 --2- 172.21.15.17:0/1195918489 >> v2:172.21.15.142:3300/0 conn(0x7f44fc0c9660 0x7f44fc164a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f4502c1a640 1 --2- 172.21.15.17:0/1195918489 >> v2:172.21.15.17:3300/0 conn(0x7f44fc161550 0x7f44fc0c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f4502c1a640 1 --2- 172.21.15.17:0/1195918489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc15ea30 0x7f44fc0cc6a0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0ae600 tx=0x7f44f402bee0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f4502c1a640 1 -- 172.21.15.17:0/1195918489 >> 172.21.15.17:0/1195918489 conn(0x7f44fc0cead0 msgr2=0x7f44fc0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.571+0000 7f890fbb1640 1 -- start start 2023-08-09T12:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f890fbb1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f890815a8e0 0x7f890815d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f890fbb1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89080b4f90 0x7f89080d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.572+0000 7f324f179640 1 Processor -- start 2023-08-09T12:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f324f179640 1 -- start start 2023-08-09T12:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f9dd63c4640 1 -- 172.21.15.17:0/4276971000 shutdown_connections 2023-08-09T12:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f9dd63c4640 1 -- 172.21.15.17:0/4276971000 wait complete. 2023-08-09T12:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f890fbb1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89080d0d80 con 0x7f89080b8330 2023-08-09T12:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f890fbb1640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89080b1f70 con 0x7f890815a8e0 2023-08-09T12:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f890fbb1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890815d6c0 con 0x7f89080b4f90 2023-08-09T12:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.573+0000 7f4502c1a640 1 -- 172.21.15.17:0/1195918489 shutdown_connections 2023-08-09T12:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.574+0000 7f890d14c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f89080b8330 0x7f89080b4880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:50038/0 (socket says 172.21.15.17:50038) 2023-08-09T12:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.574+0000 7f890d14c640 1 -- 172.21.15.17:0/3577227661 learned_addr learned my addr 172.21.15.17:0/3577227661 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.574+0000 7f890e14e640 1 --2- 172.21.15.17:0/3577227661 >> v2:172.21.15.142:3300/0 conn(0x7f89080b4f90 0x7f89080d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.574+0000 7f4502c1a640 1 -- 172.21.15.17:0/1195918489 wait complete. 2023-08-09T12:39:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.574+0000 7f90f6ffd640 1 --2- 172.21.15.17:0/3693372309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f8161090 0x7f90f80697c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009e50 tx=0x7f90f002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0ea8bdc899d38e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.574+0000 7f890d94d640 1 --2- 172.21.15.17:0/3577227661 >> v2:172.21.15.17:3300/0 conn(0x7f890815a8e0 0x7f890815d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f90f5ffb640 1 -- 172.21.15.17:0/3693372309 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f002c9e0 con 0x7f90f8161090 2023-08-09T12:39:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f90f5ffb640 1 -- 172.21.15.17:0/3693372309 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f002cb40 con 0x7f90f8161090 2023-08-09T12:39:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f90f5ffb640 1 -- 172.21.15.17:0/3693372309 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00343f0 con 0x7f90f8161090 2023-08-09T12:39:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029356194 0 0) 0x7f89080d0d80 con 0x7f89080b8330 2023-08-09T12:39:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88f0003520 con 0x7f89080b8330 2023-08-09T12:39:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f324f179640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234005180 0x7f32481f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f9dd63c4640 1 Processor -- start 2023-08-09T12:39:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f324cf15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234005180 0x7f32481f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f324cf15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234005180 0x7f32481f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56002/0 (socket says 172.21.15.17:56002) 2023-08-09T12:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f324f179640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32480c9500 0x7f3248155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f324cf15640 1 -- 172.21.15.17:0/2698355236 learned_addr learned my addr 172.21.15.17:0/2698355236 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f324f179640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3248202f70 0x7f3248203400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2040081000 0 0) 0x7f88f0003520 con 0x7f89080b8330 2023-08-09T12:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.575+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 >> v2:172.21.15.142:3300/0 conn(0x7f89080b4f90 msgr2=0x7f89080d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f90fd4ba640 1 -- 172.21.15.17:0/3693372309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f8161090 msgr2=0x7f90f80697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f90fd4ba640 1 --2- 172.21.15.17:0/3693372309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f8161090 0x7f90f80697c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009e50 tx=0x7f90f002be40 comp rx=0 tx=0).stop 2023-08-09T12:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 --2- 172.21.15.17:0/3577227661 >> v2:172.21.15.142:3300/0 conn(0x7f89080b4f90 0x7f89080d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 >> v2:172.21.15.17:3300/0 conn(0x7f890815a8e0 msgr2=0x7f890815d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 --2- 172.21.15.17:0/3577227661 >> v2:172.21.15.17:3300/0 conn(0x7f890815a8e0 0x7f890815d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890815d9a0 con 0x7f89080b8330 2023-08-09T12:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f88fc001670 con 0x7f89080b8330 2023-08-09T12:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 >> v1:172.21.15.142:6789/0 conn(0x7f89080b8330 legacy=0x7f89080b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f0003970 0x7f88f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f00047c0 0x7f88f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f0005180 0x7f88f0014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89080b1f70 con 0x7f88f0003970 2023-08-09T12:39:32.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890815d6c0 con 0x7f88f0005180 2023-08-09T12:39:32.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0014700 con 0x7f88f00047c0 2023-08-09T12:39:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f3247fff640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32480c9500 0x7f3248155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3248203940 con 0x7f3234005180 2023-08-09T12:39:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3248154670 con 0x7f3248202f70 2023-08-09T12:39:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f324d716640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3248202f70 0x7f3248203400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f90fd4ba640 1 -- 172.21.15.17:0/3693372309 shutdown_connections 2023-08-09T12:39:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f90fd4ba640 1 --2- 172.21.15.17:0/3693372309 >> v2:172.21.15.17:3300/0 conn(0x7f90f8069d00 0x7f90f80c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f90fd4ba640 1 --2- 172.21.15.17:0/3693372309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f8161090 0x7f90f80697c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f90fd4ba640 1 -- 172.21.15.17:0/3693372309 >> 172.21.15.17:0/3693372309 conn(0x7f90f80ce650 msgr2=0x7f90f80cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3248154950 con 0x7f32480c9500 2023-08-09T12:39:32.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f9dd63c4640 1 -- start start 2023-08-09T12:39:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f90fd4ba640 1 -- 172.21.15.17:0/3693372309 shutdown_connections 2023-08-09T12:39:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f90fd4ba640 1 -- 172.21.15.17:0/3693372309 wait complete. 2023-08-09T12:39:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f9dd63c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dd00ad4f0 0x7f9dd00c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f4502c1a640 1 Processor -- start 2023-08-09T12:39:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f324cf15640 1 -- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32480c9500 msgr2=0x7f3248155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f324cf15640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32480c9500 0x7f3248155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f324cf15640 1 -- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3248202f70 msgr2=0x7f3248203400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f324cf15640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3248202f70 0x7f3248203400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f324cf15640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248154c30 con 0x7f3234005180 2023-08-09T12:39:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f4502c1a640 1 -- start start 2023-08-09T12:39:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.576+0000 7f890d94d640 1 --2- 172.21.15.17:0/3577227661 >> v2:172.21.15.17:3300/0 conn(0x7f890815a8e0 0x7f890815d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f890d14c640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f00047c0 0x7f88f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f890d14c640 1 -- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f0005180 msgr2=0x7f88f0014190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T12:39:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f890d14c640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f0005180 0x7f88f0014190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f890d14c640 1 -- 172.21.15.17:0/3577227661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f0003970 msgr2=0x7f88f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f890d14c640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f0003970 0x7f88f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.577+0000 7f890d14c640 1 -- 172.21.15.17:0/3577227661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890815d9a0 con 0x7f88f00047c0 2023-08-09T12:39:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f890e14e640 1 --2- 172.21.15.17:0/3577227661 >> v2:172.21.15.142:3300/0 conn(0x7f89080b4f90 0x7f89080d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.578+0000 7f890e14e640 1 -- 172.21.15.17:0/3577227661 reap_dead start 2023-08-09T12:39:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f9dd53c2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dd00ad4f0 0x7f9dd00c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f9dd53c2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dd00ad4f0 0x7f9dd00c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38836/0 (socket says 172.21.15.17:38836) 2023-08-09T12:39:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f9dd53c2640 1 -- 172.21.15.17:0/2543858028 learned_addr learned my addr 172.21.15.17:0/2543858028 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f324cf15640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234005180 0x7f32481f6250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f323800f410 tx=0x7f323800f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f9dd63c4640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd00ada40 0x7f9dd00c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.580+0000 7f4502c1a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44fc0c9660 0x7f44fc1fa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4502c1a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc161550 0x7f44fc0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.580+0000 7f9dd4bc1640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd00ada40 0x7f9dd00c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.580+0000 7f9dd63c4640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd00cf110 0x7f9dd00c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.580+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd00af620 con 0x7f9dd00ada40 2023-08-09T12:39:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.580+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd01faa70 con 0x7f9dd00cf110 2023-08-09T12:39:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f90fd4ba640 1 Processor -- start 2023-08-09T12:39:32.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f890d14c640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f00047c0 0x7f88f0004c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88fc007fd0 tx=0x7f88f00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3260b7278daedee4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4501c18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44fc0c9660 0x7f44fc1fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4502c1a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc14abd0 0x7f44fc14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4501c18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44fc0c9660 0x7f44fc1fa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56012/0 (socket says 172.21.15.17:56012) 2023-08-09T12:39:32.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f9dd5bc3640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd00cf110 0x7f9dd00c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4501c18640 1 -- 172.21.15.17:0/1382526533 learned_addr learned my addr 172.21.15.17:0/1382526533 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.580+0000 7f90fd4ba640 1 -- start start 2023-08-09T12:39:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f90fd4ba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f8069d00 0x7f90f80c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc14e6f0 con 0x7f44fc0c9660 2023-08-09T12:39:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4501417640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc161550 0x7f44fc0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323800e040 con 0x7f3234005180 2023-08-09T12:39:32.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323800f040 con 0x7f3234005180 2023-08-09T12:39:32.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.579+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238003df0 con 0x7f3234005180 2023-08-09T12:39:32.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc14b5a0 con 0x7f44fc161550 2023-08-09T12:39:32.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.580+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32480c6950 con 0x7f3234005180 2023-08-09T12:39:32.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc14da70 con 0x7f44fc14abd0 2023-08-09T12:39:32.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.580+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3248155bc0 con 0x7f3234005180 2023-08-09T12:39:32.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32480d10a0 con 0x7f3234005180 2023-08-09T12:39:32.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f4502419640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc14abd0 0x7f44fc14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f90fd4ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f80c4fe0 0x7f90f80b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd01fad50 con 0x7f9dd00ad4f0 2023-08-09T12:39:32.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f90f6ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f8069d00 0x7f90f80c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f90f6ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f8069d00 0x7f90f80c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:33940/0 (socket says 172.21.15.17:33940) 2023-08-09T12:39:32.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f90f67fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f80c4fe0 0x7f90f80b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f90f67fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f80c4fe0 0x7f90f80b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38864/0 (socket says 172.21.15.17:38864) 2023-08-09T12:39:32.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f90fd4ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90f8161090 0x7f90f814b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc02cae0 con 0x7f88f00047c0 2023-08-09T12:39:32.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc02cc60 con 0x7f88f00047c0 2023-08-09T12:39:32.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.581+0000 7f890c94b640 1 -- 172.21.15.17:0/3577227661 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc005b10 con 0x7f88f00047c0 2023-08-09T12:39:32.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f890fbb1640 1 -- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f00047c0 msgr2=0x7f88f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f890fbb1640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f00047c0 0x7f88f0004c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88fc007fd0 tx=0x7f88f00057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f4501c18640 1 -- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc14abd0 msgr2=0x7f44fc14b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f4501c18640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44fc14abd0 0x7f44fc14b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f4501c18640 1 -- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc161550 msgr2=0x7f44fc0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f4501c18640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc161550 0x7f44fc0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.582+0000 7f4501c18640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4009b30 con 0x7f44fc0c9660 2023-08-09T12:39:32.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f890fbb1640 1 -- 172.21.15.17:0/3577227661 shutdown_connections 2023-08-09T12:39:32.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f890fbb1640 1 --2- 172.21.15.17:0/3577227661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88f00047c0 0x7f88f0004c40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f890fbb1640 1 -- 172.21.15.17:0/3577227661 >> 172.21.15.17:0/3577227661 conn(0x7f89080d2c20 msgr2=0x7f89080d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f90f6ffd640 1 -- 172.21.15.17:0/513080164 learned_addr learned my addr 172.21.15.17:0/513080164 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f9dd4bc1640 1 -- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dd00ad4f0 msgr2=0x7f9dd00c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f9dd4bc1640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dd00ad4f0 0x7f9dd00c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f9dd4bc1640 1 -- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd00cf110 msgr2=0x7f9dd00c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f9dd4bc1640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd00cf110 0x7f9dd00c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f9dd4bc1640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc800d040 con 0x7f9dd00ada40 2023-08-09T12:39:32.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f90f77fe640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90f8161090 0x7f90f814b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f890fbb1640 1 -- 172.21.15.17:0/3577227661 shutdown_connections 2023-08-09T12:39:32.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80c5f80 con 0x7f90f8161090 2023-08-09T12:39:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f814c5e0 con 0x7f90f8069d00 2023-08-09T12:39:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f4501c18640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44fc0c9660 0x7f44fc1fa3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44f402c470 tx=0x7f44f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f9dd4bc1640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd00ada40 0x7f9dd00c92b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000c3e0 tx=0x7f9dc000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f814c8c0 con 0x7f90f80c4fe0 2023-08-09T12:39:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f403e450 con 0x7f44fc0c9660 2023-08-09T12:39:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f403e5b0 con 0x7f44fc0c9660 2023-08-09T12:39:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f403e960 con 0x7f44fc0c9660 2023-08-09T12:39:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc14dd50 con 0x7f44fc0c9660 2023-08-09T12:39:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.585+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc14e310 con 0x7f44fc0c9660 2023-08-09T12:39:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0005ce0 con 0x7f9dd00ada40 2023-08-09T12:39:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0005e40 con 0x7f9dd00ada40 2023-08-09T12:39:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0007310 con 0x7f9dd00ada40 2023-08-09T12:39:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd00c67b0 con 0x7f9dd00ada40 2023-08-09T12:39:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.584+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd00c6d70 con 0x7f9dd00ada40 2023-08-09T12:39:32.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.583+0000 7f890fbb1640 1 -- 172.21.15.17:0/3577227661 wait complete. 2023-08-09T12:39:32.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.586+0000 7f890fbb1640 1 Processor -- start 2023-08-09T12:39:32.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44fc0cd540 con 0x7f44fc0c9660 2023-08-09T12:39:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f890fbb1640 1 -- start start 2023-08-09T12:39:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.586+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3238004020 con 0x7f3234005180 2023-08-09T12:39:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f32457fa640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322806a150 0x7f322806c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3238089630 con 0x7f3234005180 2023-08-09T12:39:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f32457fa640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f3228072a10 0x7f3228074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32280754e0 con 0x7f3228072a10 2023-08-09T12:39:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32380899e0 con 0x7f3234005180 2023-08-09T12:39:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44f402cd50 con 0x7f44fc0c9660 2023-08-09T12:39:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f3247fff640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322806a150 0x7f322806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.585+0000 7f90f67fc640 1 -- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f8069d00 msgr2=0x7f90f80c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.585+0000 7f90f67fc640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f8069d00 0x7f90f80c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.585+0000 7f90f67fc640 1 -- 172.21.15.17:0/513080164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90f8161090 msgr2=0x7f90f814b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.585+0000 7f90f67fc640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90f8161090 0x7f90f814b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.585+0000 7f90f67fc640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0009b30 con 0x7f90f80c4fe0 2023-08-09T12:39:32.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.586+0000 7f90f67fc640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f80c4fe0 0x7f90f80b3280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f90e800e850 tx=0x7f90e800ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.587+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800c940 con 0x7f90f80c4fe0 2023-08-09T12:39:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.587+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e800caa0 con 0x7f90f80c4fe0 2023-08-09T12:39:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.587+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800ce10 con 0x7f90f80c4fe0 2023-08-09T12:39:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.588+0000 7f90f77fe640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90f8161090 0x7f90f814b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.589+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f814cba0 con 0x7f90f80c4fe0 2023-08-09T12:39:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.589+0000 7f324d716640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f3228072a10 0x7f3228074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.589+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f814d160 con 0x7f90f80c4fe0 2023-08-09T12:39:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9db0000fc0 con 0x7f9dd00ada40 2023-08-09T12:39:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890fbb1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f00047c0 0x7f89081581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890fbb1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89081eda00 0x7f89081f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890fbb1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89081ede80 0x7f89081f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890fbb1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89081ee9e0 con 0x7f88f00047c0 2023-08-09T12:39:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890fbb1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8908158720 con 0x7f89081eda00 2023-08-09T12:39:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890fbb1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89081ee420 con 0x7f89081ede80 2023-08-09T12:39:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f3247fff640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322806a150 0x7f322806c610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32480c9920 tx=0x7f3240007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890d94d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f00047c0 0x7f89081581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f324d716640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f3228072a10 0x7f3228074e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890d94d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f00047c0 0x7f89081581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56034/0 (socket says 172.21.15.17:56034) 2023-08-09T12:39:32.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f890d94d640 1 -- 172.21.15.17:0/202457384 learned_addr learned my addr 172.21.15.17:0/202457384 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:32.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.590+0000 7f44ee7fc640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f44e006a120 0x7f44e006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44f40aaea0 con 0x7f44fc0c9660 2023-08-09T12:39:32.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f44ee7fc640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f44e00729e0 0x7f44e0074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44e00754b0 con 0x7f44e00729e0 2023-08-09T12:39:32.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44f40ad4c0 con 0x7f44fc0c9660 2023-08-09T12:39:32.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f890d14c640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89081eda00 0x7f89081f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f890d94d640 1 -- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89081ede80 msgr2=0x7f89081f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f890d94d640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89081ede80 0x7f89081f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f890d94d640 1 -- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89081eda00 msgr2=0x7f89081f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f890d94d640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89081eda00 0x7f89081f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f890d94d640 1 -- 172.21.15.17:0/202457384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89081ee700 con 0x7f88f00047c0 2023-08-09T12:39:32.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f890d94d640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f00047c0 0x7f89081581e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88f800ef70 tx=0x7f88f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.592+0000 7f4502419640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f44e00729e0 0x7f44e0074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.592+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8014480 con 0x7f88f00047c0 2023-08-09T12:39:32.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.591+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9dc0007470 con 0x7f9dd00ada40 2023-08-09T12:39:32.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.592+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f800f040 con 0x7f88f00047c0 2023-08-09T12:39:32.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.592+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8014840 con 0x7f88f00047c0 2023-08-09T12:39:32.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.592+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 <== osd.5 v2:172.21.15.142:6800/445717890 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f32280754e0 con 0x7f3228072a10 2023-08-09T12:39:32.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.592+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89081ebb00 con 0x7f88f00047c0 2023-08-09T12:39:32.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.592+0000 7f90ed7fa640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90d0000fc0 con 0x7f90f80c4fe0 2023-08-09T12:39:32.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.593+0000 7f4501417640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f44e006a120 0x7f44e006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.593+0000 7f4502419640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f44e00729e0 0x7f44e0074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.593+0000 7f9dc5ffb640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9db406a120 0x7f9db406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.593+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9dc0087b00 con 0x7f9dd00ada40 2023-08-09T12:39:32.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.593+0000 7f9dc5ffb640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f9db40729e0 0x7f9db4074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.593+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9db40754b0 con 0x7f9db40729e0 2023-08-09T12:39:32.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.593+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dc0089ea0 con 0x7f9dd00ada40 2023-08-09T12:39:32.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.593+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89080b7d90 con 0x7f88f00047c0 2023-08-09T12:39:32.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.594+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 <== osd.3 v2:172.21.15.17:6824/2232182345 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f44e00754b0 con 0x7f44e00729e0 2023-08-09T12:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.594+0000 7f9dd53c2640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9db406a120 0x7f9db406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.594+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f890815df60 con 0x7f88f00047c0 2023-08-09T12:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.594+0000 7f9dd5bc3640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f9db40729e0 0x7f9db4074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.594+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 --> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11640c3c10 con 0x7f11480728c0 2023-08-09T12:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.594+0000 7f11617fa640 1 -- 172.21.15.17:0/291014540 <== osd.1 v2:172.21.15.17:6816/160883259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f114c042040 con 0x7f11480728c0 2023-08-09T12:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.595+0000 7f83f759e640 1 -- 172.21.15.17:0/2279333987 --> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83f80c9b30 con 0x7f83d8072890 2023-08-09T12:39:32.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.595+0000 7f83e6ffd640 1 -- 172.21.15.17:0/2279333987 <== osd.2 v2:172.21.15.17:6800/1219800306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f83f000f040 con 0x7f83d8072890 2023-08-09T12:39:32.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.595+0000 7f4501417640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f44e006a120 0x7f44e006c5e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44fc071400 tx=0x7f44f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.595+0000 7f9dd5bc3640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f9db40729e0 0x7f9db4074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.595+0000 7f9dd53c2640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9db406a120 0x7f9db406c5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001790 tx=0x7f9dcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.596+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f88f80149a0 con 0x7f88f00047c0 2023-08-09T12:39:32.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.594+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f90e8013470 con 0x7f90f80c4fe0 2023-08-09T12:39:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.596+0000 7f90ef7fe640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90d806a050 0x7f90d806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.596+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90e8088740 con 0x7f90f80c4fe0 2023-08-09T12:39:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.596+0000 7f90ef7fe640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f90d8072890 0x7f90d8074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.596+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90d8075360 con 0x7f90d8072890 2023-08-09T12:39:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.596+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f11480728c0 msgr2=0x7f1148074ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.596+0000 7f116a85e640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f11480728c0 0x7f1148074ce0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f114806a080 msgr2=0x7f114806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f116a85e640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f114806a080 0x7f114806c540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1154006fd0 tx=0x7f1154008040 comp rx=0 tx=0).stop 2023-08-09T12:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1164158e40 msgr2=0x7f1164070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f83e4ff9640 1 -- 172.21.15.17:0/2279333987 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f83d8072890 msgr2=0x7f83d8074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f83e4ff9640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f83d8072890 0x7f83d8074cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f116a85e640 1 --2- 172.21.15.17:0/291014540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1164158e40 0x7f1164070500 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f115c007470 tx=0x7f115c007930 comp rx=0 tx=0).stop 2023-08-09T12:39:32.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f1168dfb640 1 -- 172.21.15.17:0/291014540 reap_dead start 2023-08-09T12:39:32.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 shutdown_connections 2023-08-09T12:39:32.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90e8053e20 con 0x7f90f80c4fe0 2023-08-09T12:39:32.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f90f6ffd640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90d806a050 0x7f90d806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f83e4ff9640 1 -- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f83d806a050 msgr2=0x7f83d806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 >> 172.21.15.17:0/291014540 conn(0x7f11640ce650 msgr2=0x7f1164157440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f89067fc640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f88f406a050 0x7f88f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88f80893e0 con 0x7f88f00047c0 2023-08-09T12:39:32.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f83e4ff9640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f83d806a050 0x7f83d806c510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83e8036000 tx=0x7f83e8009030 comp rx=0 tx=0).stop 2023-08-09T12:39:32.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f83e4ff9640 1 -- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83f814dda0 msgr2=0x7f83f8150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 <== osd.4 v2:172.21.15.142:6808/701351329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9db40754b0 con 0x7f9db40729e0 2023-08-09T12:39:32.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f90f77fe640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f90d8072890 0x7f90d8074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f89067fc640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f88f4072890 0x7f88f4074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:32.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 --> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88f4075360 con 0x7f88f4072890 2023-08-09T12:39:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.597+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88f808baa0 con 0x7f88f00047c0 2023-08-09T12:39:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f83e4ff9640 1 --2- 172.21.15.17:0/2279333987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83f814dda0 0x7f83f8150690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0014a0 tx=0x7f83ec001960 comp rx=0 tx=0).stop 2023-08-09T12:39:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f83f6d9d640 1 -- 172.21.15.17:0/2279333987 reap_dead start 2023-08-09T12:39:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 shutdown_connections 2023-08-09T12:39:32.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f890d14c640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f88f406a050 0x7f88f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f116a85e640 1 -- 172.21.15.17:0/291014540 wait complete. 2023-08-09T12:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f83e4ff9640 1 -- 172.21.15.17:0/2279333987 shutdown_connections 2023-08-09T12:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f83e4ff9640 1 -- 172.21.15.17:0/2279333987 >> 172.21.15.17:0/2279333987 conn(0x7f83f80b1d50 msgr2=0x7f83f80cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f83e4ff9640 1 -- 172.21.15.17:0/2279333987 shutdown_connections 2023-08-09T12:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f83e4ff9640 1 -- 172.21.15.17:0/2279333987 wait complete. 2023-08-09T12:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.598+0000 7f890e14e640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f88f4072890 0x7f88f4074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.599+0000 7f90f77fe640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f90d8072890 0x7f90d8074cb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.599+0000 7f90f6ffd640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90d806a050 0x7f90d806c510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90f0000f80 tx=0x7f90f0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.599+0000 7f890d14c640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f88f406a050 0x7f88f406c510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f88fc034000 tx=0x7f88fc007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.600+0000 7f890e14e640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f88f4072890 0x7f88f4074cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.601+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 <== osd.6 v2:172.21.15.142:6821/1908382838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f90d8075360 con 0x7f90d8072890 2023-08-09T12:39:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.602+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 --> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5adc002cb0 con 0x7f5ae8072a10 2023-08-09T12:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.602+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 <== osd.7 v2:172.21.15.142:6816/3944800056 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f88f4075360 con 0x7f88f4072890 2023-08-09T12:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.603+0000 7f5ae3fff640 1 -- 172.21.15.17:0/685206782 <== osd.0 v2:172.21.15.17:6808/1208264847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5adc002cb0 con 0x7f5ae8072a10 2023-08-09T12:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.607+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7f5ae8072a10 msgr2=0x7f5ae8074e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.607+0000 7f5b01986640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7f5ae8072a10 0x7f5ae8074e30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.608+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ae806a150 msgr2=0x7f5ae806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.608+0000 7f5b01986640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ae806a150 0x7f5ae806c610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5aec036000 tx=0x7f5aec03b040 comp rx=0 tx=0).stop 2023-08-09T12:39:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.608+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5afc0ca700 msgr2=0x7f5afc0c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.609+0000 7f5b01986640 1 --2- 172.21.15.17:0/685206782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5afc0ca700 0x7f5afc0c7fa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5af400cba0 tx=0x7f5af400a430 comp rx=0 tx=0).stop 2023-08-09T12:39:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.609+0000 7f5afb7fe640 1 -- 172.21.15.17:0/685206782 reap_dead start 2023-08-09T12:39:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.609+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 shutdown_connections 2023-08-09T12:39:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.609+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 >> 172.21.15.17:0/685206782 conn(0x7f5afc0ce650 msgr2=0x7f5afc06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.610+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 shutdown_connections 2023-08-09T12:39:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.610+0000 7f5b01986640 1 -- 172.21.15.17:0/685206782 wait complete. 2023-08-09T12:39:32.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.622+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 --> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f32480d0dc0 con 0x7f3228072a10 2023-08-09T12:39:32.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.622+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 --> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9db0002cb0 con 0x7f9db40729e0 2023-08-09T12:39:32.684 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:32.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.623+0000 7f32457fa640 1 -- 172.21.15.17:0/2698355236 <== osd.5 v2:172.21.15.142:6800/445717890 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3230005230 con 0x7f3228072a10 2023-08-09T12:39:32.686 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-09T12:39:32.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.623+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 --> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f44fc0cd260 con 0x7f44e00729e0 2023-08-09T12:39:32.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.624+0000 7f9dc5ffb640 1 -- 172.21.15.17:0/2543858028 <== osd.4 v2:172.21.15.142:6808/701351329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9db0002cb0 con 0x7f9db40729e0 2023-08-09T12:39:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.624+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f3228072a10 msgr2=0x7f3228074e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.624+0000 7f324f179640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f3228072a10 0x7f3228074e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.624+0000 7f44ee7fc640 1 -- 172.21.15.17:0/1382526533 <== osd.3 v2:172.21.15.17:6824/2232182345 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f44f8009720 con 0x7f44e00729e0 2023-08-09T12:39:32.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.624+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322806a150 msgr2=0x7f322806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.624+0000 7f324f179640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322806a150 0x7f322806c610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32480c9920 tx=0x7f3240007ef0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234005180 msgr2=0x7f32481f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f324f179640 1 --2- 172.21.15.17:0/2698355236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234005180 0x7f32481f6250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f323800f410 tx=0x7f323800f8d0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f44e00729e0 msgr2=0x7f44e0074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f9db40729e0 msgr2=0x7f9db4074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f324d716640 1 -- 172.21.15.17:0/2698355236 reap_dead start 2023-08-09T12:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f4502c1a640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f44e00729e0 0x7f44e0074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd63c4640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f9db40729e0 0x7f9db4074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9db406a120 msgr2=0x7f9db406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd63c4640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9db406a120 0x7f9db406c5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001790 tx=0x7f9dcc009040 comp rx=0 tx=0).stop 2023-08-09T12:39:32.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd00ada40 msgr2=0x7f9dd00c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd63c4640 1 --2- 172.21.15.17:0/2543858028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd00ada40 0x7f9dd00c92b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000c3e0 tx=0x7f9dc000c8a0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd5bc3640 1 -- 172.21.15.17:0/2543858028 reap_dead start 2023-08-09T12:39:32.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 shutdown_connections 2023-08-09T12:39:32.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 shutdown_connections 2023-08-09T12:39:32.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 >> 172.21.15.17:0/2543858028 conn(0x7f9dd00ce5f0 msgr2=0x7f9dd0155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 >> 172.21.15.17:0/2698355236 conn(0x7f324806fde0 msgr2=0x7f32481607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f44e006a120 msgr2=0x7f44e006c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.693 INFO:teuthology.orchestra.run.smithi017.stdout:55834574855 2023-08-09T12:39:32.694 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-09T12:39:32.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.625+0000 7f4502c1a640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f44e006a120 0x7f44e006c5e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44fc071400 tx=0x7f44f0008040 comp rx=0 tx=0).stop 2023-08-09T12:39:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 shutdown_connections 2023-08-09T12:39:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 shutdown_connections 2023-08-09T12:39:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f324f179640 1 -- 172.21.15.17:0/2698355236 wait complete. 2023-08-09T12:39:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44fc0c9660 msgr2=0x7f44fc1fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f4502c1a640 1 --2- 172.21.15.17:0/1382526533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44fc0c9660 0x7f44fc1fa3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44f402c470 tx=0x7f44f4004a40 comp rx=0 tx=0).stop 2023-08-09T12:39:32.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f4502419640 1 -- 172.21.15.17:0/1382526533 reap_dead start 2023-08-09T12:39:32.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f9dd63c4640 1 -- 172.21.15.17:0/2543858028 wait complete. 2023-08-09T12:39:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 shutdown_connections 2023-08-09T12:39:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 >> 172.21.15.17:0/1382526533 conn(0x7f44fc0cead0 msgr2=0x7f44fc162580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 shutdown_connections 2023-08-09T12:39:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.626+0000 7f4502c1a640 1 -- 172.21.15.17:0/1382526533 wait complete. 2023-08-09T12:39:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.630+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 --> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f890815dc80 con 0x7f88f4072890 2023-08-09T12:39:32.698 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:32.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-09T12:39:32.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.632+0000 7f90ed7fa640 1 -- 172.21.15.17:0/513080164 --> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90d0002cb0 con 0x7f90d8072890 2023-08-09T12:39:32.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.632+0000 7f89067fc640 1 -- 172.21.15.17:0/202457384 <== osd.7 v2:172.21.15.142:6816/3944800056 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8900006bd0 con 0x7f88f4072890 2023-08-09T12:39:32.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f88f4072890 msgr2=0x7f88f4074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f88f4072890 0x7f88f4074cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f90ef7fe640 1 -- 172.21.15.17:0/513080164 <== osd.6 v2:172.21.15.142:6821/1908382838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90d0002cb0 con 0x7f90d8072890 2023-08-09T12:39:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f88f406a050 msgr2=0x7f88f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f88f406a050 0x7f88f406c510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f88fc034000 tx=0x7f88fc007000 comp rx=0 tx=0).stop 2023-08-09T12:39:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f00047c0 msgr2=0x7f89081581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 --2- 172.21.15.17:0/202457384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88f00047c0 0x7f89081581e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88f800ef70 tx=0x7f88f800c490 comp rx=0 tx=0).stop 2023-08-09T12:39:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890e14e640 1 -- 172.21.15.17:0/202457384 reap_dead start 2023-08-09T12:39:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 shutdown_connections 2023-08-09T12:39:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 >> 172.21.15.17:0/202457384 conn(0x7f89080d2c20 msgr2=0x7f890815edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.633+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 shutdown_connections 2023-08-09T12:39:32.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f890fbb1640 1 -- 172.21.15.17:0/202457384 wait complete. 2023-08-09T12:39:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f90d8072890 msgr2=0x7f90d8074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f90d8072890 0x7f90d8074cb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90d806a050 msgr2=0x7f90d806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90d806a050 0x7f90d806c510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90f0000f80 tx=0x7f90f0030000 comp rx=0 tx=0).stop 2023-08-09T12:39:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f80c4fe0 msgr2=0x7f90f80b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 --2- 172.21.15.17:0/513080164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90f80c4fe0 0x7f90f80b3280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f90e800e850 tx=0x7f90e800ed10 comp rx=0 tx=0).stop 2023-08-09T12:39:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90f77fe640 1 -- 172.21.15.17:0/513080164 reap_dead start 2023-08-09T12:39:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 shutdown_connections 2023-08-09T12:39:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 >> 172.21.15.17:0/513080164 conn(0x7f90f80ce650 msgr2=0x7f90f80b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.634+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 shutdown_connections 2023-08-09T12:39:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:32.635+0000 7f90fd4ba640 1 -- 172.21.15.17:0/513080164 wait complete. 2023-08-09T12:39:32.705 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:32.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-09T12:39:32.706 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:32.706 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-09T12:39:32.707 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:32.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-09T12:39:32.708 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:32.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-09T12:39:32.709 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:32.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-09T12:39:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.035+0000 7fce91ead640 1 Processor -- start 2023-08-09T12:39:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.035+0000 7fce91ead640 1 -- start start 2023-08-09T12:39:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.037+0000 7fce91ead640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.038+0000 7fce91ead640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c06a160 con 0x7fce8c0c4570 2023-08-09T12:39:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.038+0000 7fce91ead640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c06cff0 con 0x7fce8c069d00 2023-08-09T12:39:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.038+0000 7fce91ead640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c06c3e0 con 0x7fce8c161090 2023-08-09T12:39:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.038+0000 7fce8bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fce8c0c4570 0x7fce8c16ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49028/0 (socket says 172.21.15.17:49028) 2023-08-09T12:39:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.038+0000 7fce8bfff640 1 -- 172.21.15.17:0/3068467048 learned_addr learned my addr 172.21.15.17:0/3068467048 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.039+0000 7fce8b7fe640 1 --2- 172.21.15.17:0/3068467048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.039+0000 7fce8affd640 1 -- 172.21.15.17:0/3068467048 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287933848 0 0) 0x7fce8c06a160 con 0x7fce8c0c4570 2023-08-09T12:39:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.039+0000 7fce8affd640 1 -- 172.21.15.17:0/3068467048 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce78003520 con 0x7fce8c0c4570 2023-08-09T12:39:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.040+0000 7fce8b7fe640 1 -- 172.21.15.17:0/3068467048 >> v1:172.21.15.142:6789/0 conn(0x7fce8c069d00 legacy=0x7fce8c0c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.040+0000 7fce8b7fe640 1 -- 172.21.15.17:0/3068467048 >> v1:172.21.15.17:6789/0 conn(0x7fce8c0c4570 legacy=0x7fce8c16ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.040+0000 7fce8b7fe640 1 -- 172.21.15.17:0/3068467048 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c06c6c0 con 0x7fce8c161090 2023-08-09T12:39:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.042+0000 7fce8b7fe640 1 --2- 172.21.15.17:0/3068467048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0697c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0097d0 tx=0x7fce7c02b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf952071f0eaeca server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.043+0000 7fce8affd640 1 -- 172.21.15.17:0/3068467048 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840019f0 con 0x7fce8c161090 2023-08-09T12:39:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.043+0000 7fce8affd640 1 -- 172.21.15.17:0/3068467048 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c02e050 con 0x7fce8c161090 2023-08-09T12:39:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.043+0000 7fce8affd640 1 -- 172.21.15.17:0/3068467048 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c030730 con 0x7fce8c161090 2023-08-09T12:39:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.044+0000 7fce91ead640 1 -- 172.21.15.17:0/3068467048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 msgr2=0x7fce8c0697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.044+0000 7fce91ead640 1 --2- 172.21.15.17:0/3068467048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0697c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0097d0 tx=0x7fce7c02b5d0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.046+0000 7fce91ead640 1 -- 172.21.15.17:0/3068467048 shutdown_connections 2023-08-09T12:39:33.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.046+0000 7fce91ead640 1 --2- 172.21.15.17:0/3068467048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0697c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.046+0000 7fce91ead640 1 -- 172.21.15.17:0/3068467048 >> 172.21.15.17:0/3068467048 conn(0x7fce8c0ce650 msgr2=0x7fce8c0cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.046+0000 7fce91ead640 1 -- 172.21.15.17:0/3068467048 shutdown_connections 2023-08-09T12:39:33.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.046+0000 7fce91ead640 1 -- 172.21.15.17:0/3068467048 wait complete. 2023-08-09T12:39:33.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.049+0000 7fce91ead640 1 Processor -- start 2023-08-09T12:39:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.049+0000 7fce91ead640 1 -- start start 2023-08-09T12:39:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.050+0000 7fce91ead640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c069d00 0x7fce8c0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.050+0000 7fce91ead640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce8c0c4570 0x7fce8c161470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.050+0000 7fce91ead640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.050+0000 7fce91ead640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0cc8d0 con 0x7fce8c0c4570 2023-08-09T12:39:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.050+0000 7fce91ead640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c161b50 con 0x7fce8c069d00 2023-08-09T12:39:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.050+0000 7fce91ead640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c161e30 con 0x7fce8c161090 2023-08-09T12:39:33.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.051+0000 7fce83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce8c0c4570 0x7fce8c161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.051+0000 7fce83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce8c0c4570 0x7fce8c161470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56036/0 (socket says 172.21.15.17:56036) 2023-08-09T12:39:33.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.051+0000 7fce8b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c069d00 0x7fce8c0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.051+0000 7fce83fff640 1 -- 172.21.15.17:0/3553940130 learned_addr learned my addr 172.21.15.17:0/3553940130 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.051+0000 7fce8bfff640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.052+0000 7fce8b7fe640 1 -- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 msgr2=0x7fce8c0706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.052+0000 7fce8b7fe640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.052+0000 7fce8b7fe640 1 -- 172.21.15.17:0/3553940130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce8c0c4570 msgr2=0x7fce8c161470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.052+0000 7fce8b7fe640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce8c0c4570 0x7fce8c161470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.052+0000 7fce8b7fe640 1 -- 172.21.15.17:0/3553940130 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c009400 con 0x7fce8c069d00 2023-08-09T12:39:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.052+0000 7fce83fff640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce8c0c4570 0x7fce8c161470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.053+0000 7fce8b7fe640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c069d00 0x7fce8c0ccc20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce7c032000 tx=0x7fce7c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.053+0000 7fce88ff9640 1 -- 172.21.15.17:0/3553940130 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c03d950 con 0x7fce8c069d00 2023-08-09T12:39:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.053+0000 7fce88ff9640 1 -- 172.21.15.17:0/3553940130 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c03dab0 con 0x7fce8c069d00 2023-08-09T12:39:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.053+0000 7fce88ff9640 1 -- 172.21.15.17:0/3553940130 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c03de60 con 0x7fce8c069d00 2023-08-09T12:39:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.053+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c162110 con 0x7fce8c069d00 2023-08-09T12:39:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.054+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c13f6d0 con 0x7fce8c069d00 2023-08-09T12:39:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.054+0000 7f0f2c384640 1 Processor -- start 2023-08-09T12:39:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.054+0000 7f0f2c384640 1 -- start start 2023-08-09T12:39:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.055+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c13f920 con 0x7fce8c069d00 2023-08-09T12:39:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.057+0000 7fe121a2d640 1 Processor -- start 2023-08-09T12:39:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.057+0000 7fe121a2d640 1 -- start start 2023-08-09T12:39:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.057+0000 7f0f2c384640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f240c9780 0x7f0f2406b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.057+0000 7f0f2c384640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240ccb30 0x7f0f241594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.057+0000 7f0f2c384640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2406caa0 con 0x7f0f240cc6d0 2023-08-09T12:39:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.058+0000 7f0f2c384640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f240c9b60 con 0x7f0f240c9780 2023-08-09T12:39:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.058+0000 7f0f2c384640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2406b600 con 0x7f0f240ccb30 2023-08-09T12:39:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.058+0000 7f0f2a120640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f240c9780 0x7f0f2406b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.058+0000 7f0f2a120640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f240c9780 0x7f0f2406b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56052/0 (socket says 172.21.15.17:56052) 2023-08-09T12:39:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.058+0000 7f0f2a921640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240ccb30 0x7f0f241594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.058+0000 7f0f2a921640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240ccb30 0x7f0f241594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38896/0 (socket says 172.21.15.17:38896) 2023-08-09T12:39:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.058+0000 7f0f2a120640 1 -- 172.21.15.17:0/3517122275 learned_addr learned my addr 172.21.15.17:0/3517122275 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.059+0000 7f0f2a921640 1 -- 172.21.15.17:0/3517122275 >> v2:172.21.15.17:3300/0 conn(0x7f0f240c9780 msgr2=0x7f0f2406b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.059+0000 7fe121a2d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe11c0b0720 0x7fe11c0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.058+0000 7fce88ff9640 1 -- 172.21.15.17:0/3553940130 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce7c039040 con 0x7fce8c069d00 2023-08-09T12:39:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.059+0000 7fce88ff9640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce6c06a050 0x7fce6c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.059+0000 7fce88ff9640 1 -- 172.21.15.17:0/3553940130 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce7c0aad40 con 0x7fce8c069d00 2023-08-09T12:39:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.060+0000 7fe11affd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe11c15a9a0 0x7fe11c0cb310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:50058/0 (socket says 172.21.15.17:50058) 2023-08-09T12:39:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.060+0000 7fe11affd640 1 -- 172.21.15.17:0/678606913 learned_addr learned my addr 172.21.15.17:0/678606913 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.060+0000 7fe121a2d640 1 -- 172.21.15.17:0/678606913 --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0cba20 con 0x7fe11c0cdcd0 2023-08-09T12:39:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.060+0000 7fe121a2d640 1 -- 172.21.15.17:0/678606913 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0cc600 con 0x7fe11c15a9a0 2023-08-09T12:39:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.060+0000 7fe121a2d640 1 -- 172.21.15.17:0/678606913 --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0b1110 con 0x7fe11c0b0720 2023-08-09T12:39:33.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.060+0000 7fce83fff640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce6c06a050 0x7fce6c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.059+0000 7f0f2a921640 1 --2- 172.21.15.17:0/3517122275 >> v2:172.21.15.17:3300/0 conn(0x7f0f240c9780 0x7f0f2406b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.059+0000 7f0f2a921640 1 -- 172.21.15.17:0/3517122275 >> v1:172.21.15.142:6789/0 conn(0x7f0f240cc6d0 legacy=0x7f0f2406cf30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-09T12:39:33.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.059+0000 7f0f2a921640 1 -- 172.21.15.17:0/3517122275 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2406b8e0 con 0x7f0f240ccb30 2023-08-09T12:39:33.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.060+0000 7f0f2a120640 1 --2- 172.21.15.17:0/3517122275 >> v2:172.21.15.17:3300/0 conn(0x7f0f240c9780 0x7f0f2406b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:39:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.061+0000 7fe11a7fc640 1 --2- 172.21.15.17:0/678606913 >> v2:172.21.15.17:3300/0 conn(0x7fe11c0b0720 0x7fe11c0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.061+0000 7f0f2a921640 1 --2- 172.21.15.17:0/3517122275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240ccb30 0x7f0f241594e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f140097a0 tx=0x7f0f1402b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6737925a45f60e22 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7fce83fff640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce6c06a050 0x7fce6c06c510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0cd160 tx=0x7fce74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7fe11a7fc640 1 -- 172.21.15.17:0/678606913 >> v1:172.21.15.142:6789/0 conn(0x7fe11c15a9a0 legacy=0x7fe11c0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7fe11a7fc640 1 -- 172.21.15.17:0/678606913 >> v1:172.21.15.17:6789/0 conn(0x7fe11c0cdcd0 legacy=0x7fe11c0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7fe11a7fc640 1 -- 172.21.15.17:0/678606913 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0cc8e0 con 0x7fe11c0b0720 2023-08-09T12:39:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7f0f2911e640 1 -- 172.21.15.17:0/3517122275 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14031710 con 0x7f0f240ccb30 2023-08-09T12:39:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7f0f2911e640 1 -- 172.21.15.17:0/3517122275 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1402f050 con 0x7f0f240ccb30 2023-08-09T12:39:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7f0f2911e640 1 -- 172.21.15.17:0/3517122275 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14031ad0 con 0x7f0f240ccb30 2023-08-09T12:39:33.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7fc3cd347640 1 Processor -- start 2023-08-09T12:39:33.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7f043c364640 1 Processor -- start 2023-08-09T12:39:33.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.062+0000 7fc3cd347640 1 -- start start 2023-08-09T12:39:33.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7f0f2c384640 1 -- 172.21.15.17:0/3517122275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240ccb30 msgr2=0x7f0f241594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7f0f2c384640 1 --2- 172.21.15.17:0/3517122275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240ccb30 0x7f0f241594e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f140097a0 tx=0x7f0f1402b7b0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7f0f2c384640 1 -- 172.21.15.17:0/3517122275 shutdown_connections 2023-08-09T12:39:33.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7f0f2c384640 1 --2- 172.21.15.17:0/3517122275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240ccb30 0x7f0f241594e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7f0f2c384640 1 --2- 172.21.15.17:0/3517122275 >> v2:172.21.15.17:3300/0 conn(0x7f0f240c9780 0x7f0f2406b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7f0f2c384640 1 -- 172.21.15.17:0/3517122275 >> 172.21.15.17:0/3517122275 conn(0x7f0f240ceb00 msgr2=0x7f0f240cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7fe11a7fc640 1 --2- 172.21.15.17:0/678606913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c0b0720 0x7fe11c0b0bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe1100097a0 tx=0x7fe11002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dfd2f513a7a3fd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.063+0000 7f043c364640 1 -- start start 2023-08-09T12:39:33.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7f0f2c384640 1 -- 172.21.15.17:0/3517122275 shutdown_connections 2023-08-09T12:39:33.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7f0f2c384640 1 -- 172.21.15.17:0/3517122275 wait complete. 2023-08-09T12:39:33.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7fe119ffb640 1 -- 172.21.15.17:0/678606913 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110030610 con 0x7fe11c0b0720 2023-08-09T12:39:33.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7fe119ffb640 1 -- 172.21.15.17:0/678606913 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe110030770 con 0x7fe11c0b0720 2023-08-09T12:39:33.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7fe119ffb640 1 -- 172.21.15.17:0/678606913 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110030610 con 0x7fe11c0b0720 2023-08-09T12:39:33.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7f043c364640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f042c0e78e0 0x7f042c04f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7fe121a2d640 1 -- 172.21.15.17:0/678606913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c0b0720 msgr2=0x7fe11c0b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7f043c364640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c0eb2f0 0x7f042c0eb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7f043c364640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042c050370 con 0x7f042c053010 2023-08-09T12:39:33.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7f043c364640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c0064b0 con 0x7f042c0e78e0 2023-08-09T12:39:33.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7f043c364640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0ebc70 con 0x7f042c0eb2f0 2023-08-09T12:39:33.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7fc3cd347640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3c81610e0 0x7fc3c80cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7fc3cd347640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c80cda00 0x7fc3c806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7fc3cd347640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c806cd30 con 0x7fc3c806d700 2023-08-09T12:39:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7fc3cd347640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c806c7b0 con 0x7fc3c81610e0 2023-08-09T12:39:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.064+0000 7fc3cd347640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80712f0 con 0x7fc3c80cda00 2023-08-09T12:39:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7fc3c77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc3c806d700 0x7fc3c80ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49042/0 (socket says 172.21.15.17:49042) 2023-08-09T12:39:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7fc3c77fe640 1 -- 172.21.15.17:0/432885833 learned_addr learned my addr 172.21.15.17:0/432885833 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:33.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.065+0000 7fe121a2d640 1 --2- 172.21.15.17:0/678606913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c0b0720 0x7fe11c0b0bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe1100097a0 tx=0x7fe11002b960 comp rx=0 tx=0).stop 2023-08-09T12:39:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7fe121a2d640 1 -- 172.21.15.17:0/678606913 shutdown_connections 2023-08-09T12:39:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7fe121a2d640 1 --2- 172.21.15.17:0/678606913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c0b0720 0x7fe11c0b0bd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7fe121a2d640 1 -- 172.21.15.17:0/678606913 >> 172.21.15.17:0/678606913 conn(0x7fe11c0b1610 msgr2=0x7fe11c0b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7f043a901640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f042c053010 0x7f042c0534a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49048/0 (socket says 172.21.15.17:49048) 2023-08-09T12:39:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7f043a901640 1 -- 172.21.15.17:0/1740824499 learned_addr learned my addr 172.21.15.17:0/1740824499 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7f04398ff640 1 --2- 172.21.15.17:0/1740824499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c0eb2f0 0x7f042c0eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7fe121a2d640 1 -- 172.21.15.17:0/678606913 shutdown_connections 2023-08-09T12:39:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7fc3c67fc640 1 --2- 172.21.15.17:0/432885833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c80cda00 0x7fc3c806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.066+0000 7fe121a2d640 1 -- 172.21.15.17:0/678606913 wait complete. 2023-08-09T12:39:33.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7f0f2c384640 1 Processor -- start 2023-08-09T12:39:33.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7f04398ff640 1 -- 172.21.15.17:0/1740824499 >> v2:172.21.15.17:3300/0 conn(0x7f042c0e78e0 msgr2=0x7f042c04f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7f04398ff640 1 --2- 172.21.15.17:0/1740824499 >> v2:172.21.15.17:3300/0 conn(0x7f042c0e78e0 0x7f042c04f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7f04398ff640 1 -- 172.21.15.17:0/1740824499 >> v1:172.21.15.17:6789/0 conn(0x7f042c053010 legacy=0x7f042c0534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7f04390fe640 1 -- 172.21.15.17:0/1740824499 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355886642 0 0) 0x7f042c050370 con 0x7f042c053010 2023-08-09T12:39:33.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7f0f2c384640 1 -- start start 2023-08-09T12:39:33.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7fc3c5ffb640 1 -- 172.21.15.17:0/432885833 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493247725 0 0) 0x7fc3c806cd30 con 0x7fc3c806d700 2023-08-09T12:39:33.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7fc3c5ffb640 1 -- 172.21.15.17:0/432885833 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b0003520 con 0x7fc3c806d700 2023-08-09T12:39:33.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7fc3c67fc640 1 -- 172.21.15.17:0/432885833 >> v2:172.21.15.17:3300/0 conn(0x7fc3c81610e0 msgr2=0x7fc3c80cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.067+0000 7fc3c67fc640 1 --2- 172.21.15.17:0/432885833 >> v2:172.21.15.17:3300/0 conn(0x7fc3c81610e0 0x7fc3c80cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7fc3c67fc640 1 -- 172.21.15.17:0/432885833 >> v1:172.21.15.17:6789/0 conn(0x7fc3c806d700 legacy=0x7fc3c80ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7fc3c67fc640 1 -- 172.21.15.17:0/432885833 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80715d0 con 0x7fc3c80cda00 2023-08-09T12:39:33.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7f04398ff640 1 -- 172.21.15.17:0/1740824499 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c007950 con 0x7f042c0eb2f0 2023-08-09T12:39:33.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7f0f2c384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f240c9780 0x7f0f240c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7f0f2c384640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240cc6d0 0x7f0f240cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7f0f2c384640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f240ccb30 0x7f0f240afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7f0f2c384640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2414ba10 con 0x7f0f240c9780 2023-08-09T12:39:33.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7f0f2c384640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2414b430 con 0x7f0f240ccb30 2023-08-09T12:39:33.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.068+0000 7f0f2c384640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240cbf90 con 0x7f0f240cc6d0 2023-08-09T12:39:33.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.069+0000 7f0f2991f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240cc6d0 0x7f0f240cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.069+0000 7f0f2a120640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f240c9780 0x7f0f240c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.069+0000 7f0f2991f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240cc6d0 0x7f0f240cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38926/0 (socket says 172.21.15.17:38926) 2023-08-09T12:39:33.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.069+0000 7f0f2991f640 1 -- 172.21.15.17:0/1526899758 learned_addr learned my addr 172.21.15.17:0/1526899758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.069+0000 7f0f2a921640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f240ccb30 0x7f0f240afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.069+0000 7f04398ff640 1 --2- 172.21.15.17:0/1740824499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c0eb2f0 0x7f042c0eb730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0434000b60 tx=0x7f04340a55c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7622c69971afb64b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7fe121a2d640 1 Processor -- start 2023-08-09T12:39:33.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f04390fe640 1 -- 172.21.15.17:0/1740824499 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340aa7d0 con 0x7f042c0eb2f0 2023-08-09T12:39:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f0f2991f640 1 -- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f240ccb30 msgr2=0x7f0f240afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f0f2991f640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f240ccb30 0x7f0f240afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f0f2991f640 1 -- 172.21.15.17:0/1526899758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f240c9780 msgr2=0x7f0f240c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f0f2991f640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f240c9780 0x7f0f240c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f0f2991f640 1 -- 172.21.15.17:0/1526899758 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c009b30 con 0x7f0f240cc6d0 2023-08-09T12:39:33.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f04390fe640 1 -- 172.21.15.17:0/1740824499 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04340a8050 con 0x7f042c0eb2f0 2023-08-09T12:39:33.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f04390fe640 1 -- 172.21.15.17:0/1740824499 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340aabd0 con 0x7f042c0eb2f0 2023-08-09T12:39:33.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7fe121a2d640 1 -- start start 2023-08-09T12:39:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7f0f2991f640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240cc6d0 0x7f0f240cb890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000b480 tx=0x7f0f2000b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.070+0000 7fc3c67fc640 1 --2- 172.21.15.17:0/432885833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c80cda00 0x7fc3c806d1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0097a0 tx=0x7fc3bc02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5396753c27ba7f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f043c364640 1 -- 172.21.15.17:0/1740824499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c0eb2f0 msgr2=0x7f042c0eb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f043c364640 1 --2- 172.21.15.17:0/1740824499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c0eb2f0 0x7f042c0eb730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0434000b60 tx=0x7f04340a55c0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f043c364640 1 -- 172.21.15.17:0/1740824499 shutdown_connections 2023-08-09T12:39:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f043c364640 1 --2- 172.21.15.17:0/1740824499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c0eb2f0 0x7f042c0eb730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f043c364640 1 --2- 172.21.15.17:0/1740824499 >> v2:172.21.15.17:3300/0 conn(0x7f042c0e78e0 0x7f042c04f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f043c364640 1 -- 172.21.15.17:0/1740824499 >> 172.21.15.17:0/1740824499 conn(0x7f042c054c40 msgr2=0x7f042c055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f0f1affd640 1 -- 172.21.15.17:0/1526899758 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20010870 con 0x7f0f240cc6d0 2023-08-09T12:39:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f0f2c384640 1 -- 172.21.15.17:0/1526899758 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f14009400 con 0x7f0f240cc6d0 2023-08-09T12:39:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f0f2c384640 1 -- 172.21.15.17:0/1526899758 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2414b6a0 con 0x7f0f240cc6d0 2023-08-09T12:39:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f0f1affd640 1 -- 172.21.15.17:0/1526899758 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f200109f0 con 0x7f0f240cc6d0 2023-08-09T12:39:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f0f1affd640 1 -- 172.21.15.17:0/1526899758 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20010da0 con 0x7f0f240cc6d0 2023-08-09T12:39:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7fc3c5ffb640 1 -- 172.21.15.17:0/432885833 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc031780 con 0x7fc3c80cda00 2023-08-09T12:39:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7fc3c5ffb640 1 -- 172.21.15.17:0/432885833 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc0318e0 con 0x7fc3c80cda00 2023-08-09T12:39:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7fc3c5ffb640 1 -- 172.21.15.17:0/432885833 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc031c70 con 0x7fc3c80cda00 2023-08-09T12:39:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f043c364640 1 -- 172.21.15.17:0/1740824499 shutdown_connections 2023-08-09T12:39:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.071+0000 7f043c364640 1 -- 172.21.15.17:0/1740824499 wait complete. 2023-08-09T12:39:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.072+0000 7fc3cd347640 1 -- 172.21.15.17:0/432885833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c80cda00 msgr2=0x7fc3c806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.072+0000 7fc3cd347640 1 --2- 172.21.15.17:0/432885833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c80cda00 0x7fc3c806d1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0097a0 tx=0x7fc3bc02b820 comp rx=0 tx=0).stop 2023-08-09T12:39:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.072+0000 7fc3cd347640 1 -- 172.21.15.17:0/432885833 shutdown_connections 2023-08-09T12:39:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.072+0000 7fc3cd347640 1 --2- 172.21.15.17:0/432885833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c80cda00 0x7fc3c806d1c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.072+0000 7fc3cd347640 1 --2- 172.21.15.17:0/432885833 >> v2:172.21.15.17:3300/0 conn(0x7fc3c81610e0 0x7fc3c80cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.072+0000 7fc3cd347640 1 -- 172.21.15.17:0/432885833 >> 172.21.15.17:0/432885833 conn(0x7fc3c80b0ad0 msgr2=0x7fc3c80b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.073+0000 7fc3cd347640 1 -- 172.21.15.17:0/432885833 shutdown_connections 2023-08-09T12:39:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.073+0000 7f0f2c384640 1 -- 172.21.15.17:0/1526899758 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c005250 con 0x7f0f240cc6d0 2023-08-09T12:39:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.073+0000 7fc3cd347640 1 -- 172.21.15.17:0/432885833 wait complete. 2023-08-09T12:39:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.073+0000 7fe121a2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0b0720 0x7fe11c0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.073+0000 7fe121a2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c0cdcd0 0x7fe11c1f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.074+0000 7fe121a2d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c15a9a0 0x7fe11c155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.074+0000 7fe11affd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0b0720 0x7fe11c0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.074+0000 7fe11affd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0b0720 0x7fe11c0c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:33968/0 (socket says 172.21.15.17:33968) 2023-08-09T12:39:33.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.074+0000 7fce88ff9640 1 -- 172.21.15.17:0/3553940130 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fce7c0764c0 con 0x7fce8c069d00 2023-08-09T12:39:33.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.074+0000 7f043c364640 1 Processor -- start 2023-08-09T12:39:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.074+0000 7fe11affd640 1 -- 172.21.15.17:0/1877600608 learned_addr learned my addr 172.21.15.17:0/1877600608 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.074+0000 7fe11a7fc640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c0cdcd0 0x7fe11c1f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.074+0000 7fe121a2d640 1 -- 172.21.15.17:0/1877600608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1f34d0 con 0x7fe11c15a9a0 2023-08-09T12:39:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.075+0000 7fe121a2d640 1 -- 172.21.15.17:0/1877600608 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c154e80 con 0x7fe11c0b0720 2023-08-09T12:39:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.075+0000 7f0f1affd640 1 -- 172.21.15.17:0/1526899758 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f2000f3c0 con 0x7f0f240cc6d0 2023-08-09T12:39:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.075+0000 7f043c364640 1 -- start start 2023-08-09T12:39:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.075+0000 7fe11b7fe640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c15a9a0 0x7fe11c155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.075+0000 7fe121a2d640 1 -- 172.21.15.17:0/1877600608 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c155160 con 0x7fe11c0cdcd0 2023-08-09T12:39:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.076+0000 7fe11affd640 1 -- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c0cdcd0 msgr2=0x7fe11c1f10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.076+0000 7fe11affd640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c0cdcd0 0x7fe11c1f10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.076+0000 7fe11affd640 1 -- 172.21.15.17:0/1877600608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c15a9a0 msgr2=0x7fe11c155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.076+0000 7fe11affd640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c15a9a0 0x7fe11c155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.076+0000 7fe11affd640 1 -- 172.21.15.17:0/1877600608 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009400 con 0x7fe11c0b0720 2023-08-09T12:39:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.076+0000 7f0f1affd640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f0806a050 0x7f0f0806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.076+0000 7fc3cd347640 1 Processor -- start 2023-08-09T12:39:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.076+0000 7f0f1affd640 1 -- 172.21.15.17:0/1526899758 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f20088570 con 0x7f0f240cc6d0 2023-08-09T12:39:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f1895dd5640 1 Processor -- start 2023-08-09T12:39:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f0f2a120640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f0806a050 0x7f0f0806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7fe11affd640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0b0720 0x7fe11c0c8170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe10c001830 tx=0x7fe10c001cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7fc3cd347640 1 -- start start 2023-08-09T12:39:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f1895dd5640 1 -- start start 2023-08-09T12:39:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f043c364640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c053010 0x7f042c047ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f043c364640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f042c0e78e0 0x7f042c04a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f043c364640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f042c0eb2f0 0x7f042c17c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f043c364640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0eab10 con 0x7f042c0e78e0 2023-08-09T12:39:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f043c364640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c04a430 con 0x7f042c0eb2f0 2023-08-09T12:39:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.077+0000 7f043c364640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0492b0 con 0x7f042c053010 2023-08-09T12:39:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.078+0000 7f043a100640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c053010 0x7f042c047ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.078+0000 7f043a100640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c053010 0x7f042c047ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38930/0 (socket says 172.21.15.17:38930) 2023-08-09T12:39:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.078+0000 7f043a100640 1 -- 172.21.15.17:0/1923821247 learned_addr learned my addr 172.21.15.17:0/1923821247 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.078+0000 7f04398ff640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f042c0e78e0 0x7f042c04a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.078+0000 7f043a901640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f042c0eb2f0 0x7f042c17c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.078+0000 7f0f2a120640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f0806a050 0x7f0f0806c510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f2406c6f0 tx=0x7f0f1c012040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fc3cd347640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3c806d700 0x7fc3c80c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fe103fff640 1 -- 172.21.15.17:0/1877600608 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c005ae0 con 0x7fe11c0b0720 2023-08-09T12:39:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fe121a2d640 1 -- 172.21.15.17:0/1877600608 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c155440 con 0x7fe11c0b0720 2023-08-09T12:39:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fc3cd347640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3c80cda00 0x7fc3c80c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f3245134640 1 Processor -- start 2023-08-09T12:39:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fe103fff640 1 -- 172.21.15.17:0/1877600608 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c005c40 con 0x7fe11c0b0720 2023-08-09T12:39:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fe103fff640 1 -- 172.21.15.17:0/1877600608 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0070d0 con 0x7fe11c0b0720 2023-08-09T12:39:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fe121a2d640 1 -- 172.21.15.17:0/1877600608 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c1f15e0 con 0x7fe11c0b0720 2023-08-09T12:39:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fc3cd347640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c81610e0 0x7fc3c80b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f1895dd5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18880e78e0 0x7f188804f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f043a100640 1 -- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f042c0eb2f0 msgr2=0x7f042c17c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f043a100640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f042c0eb2f0 0x7f042c17c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f043a100640 1 -- 172.21.15.17:0/1923821247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f042c0e78e0 msgr2=0x7f042c04a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f043a100640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f042c0e78e0 0x7f042c04a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f043a100640 1 -- 172.21.15.17:0/1923821247 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c049590 con 0x7f042c053010 2023-08-09T12:39:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f1895dd5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb730 0x7f1888053720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f1895dd5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1888050370 con 0x7f18880eb2f0 2023-08-09T12:39:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f1895dd5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880064b0 con 0x7f18880e78e0 2023-08-09T12:39:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7f1895dd5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1888007950 con 0x7f18880eb730 2023-08-09T12:39:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.079+0000 7fc3c67fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3c80cda00 0x7fc3c80c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7fc3c67fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3c80cda00 0x7fc3c80c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:33982/0 (socket says 172.21.15.17:33982) 2023-08-09T12:39:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7fc3c67fc640 1 -- 172.21.15.17:0/1158790214 learned_addr learned my addr 172.21.15.17:0/1158790214 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80c44a0 con 0x7fc3c806d700 2023-08-09T12:39:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815a700 con 0x7fc3c80cda00 2023-08-09T12:39:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7f3245134640 1 -- start start 2023-08-09T12:39:33.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80c7600 con 0x7fc3c81610e0 2023-08-09T12:39:33.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7fc3c77fe640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c81610e0 0x7fc3c80b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7f188f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18880e78e0 0x7f188804f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7f188f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18880e78e0 0x7f188804f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:33984/0 (socket says 172.21.15.17:33984) 2023-08-09T12:39:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7f188f7fe640 1 -- 172.21.15.17:0/2087108289 learned_addr learned my addr 172.21.15.17:0/2087108289 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7f043a100640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c053010 0x7f042c047ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f043000b410 tx=0x7f043000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7f188ffff640 1 --2- 172.21.15.17:0/2087108289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb730 0x7f1888053720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.080+0000 7fc3c6ffd640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3c806d700 0x7fc3c80c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7fc3c77fe640 1 -- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3c80cda00 msgr2=0x7fc3c80c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7fc3c77fe640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3c80cda00 0x7fc3c80c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7fc3c77fe640 1 -- 172.21.15.17:0/1158790214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3c806d700 msgr2=0x7fc3c80c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7fc3c77fe640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3c806d700 0x7fc3c80c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7fc3c77fe640 1 -- 172.21.15.17:0/1158790214 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc009400 con 0x7fc3c81610e0 2023-08-09T12:39:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7f188f7fe640 1 -- 172.21.15.17:0/2087108289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb730 msgr2=0x7f1888053720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7f188f7fe640 1 --2- 172.21.15.17:0/2087108289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb730 0x7f1888053720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7f188f7fe640 1 -- 172.21.15.17:0/2087108289 >> v1:172.21.15.142:6789/0 conn(0x7f18880eb2f0 legacy=0x7f1888053010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7f188f7fe640 1 -- 172.21.15.17:0/2087108289 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188804fdb0 con 0x7f18880e78e0 2023-08-09T12:39:33.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.081+0000 7fc3c77fe640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c81610e0 0x7fc3c80b3e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000caa0 tx=0x7fc3c000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f958dcfb640 1 Processor -- start 2023-08-09T12:39:33.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f3245134640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32380e3190 0x7f323803e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f3245134640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32380544a0 0x7f32380573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f958dcfb640 1 -- start start 2023-08-09T12:39:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f3245134640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323803ee60 con 0x7f3238038180 2023-08-09T12:39:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f3245134640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323803f100 con 0x7f32380e3190 2023-08-09T12:39:33.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f3245134640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3238007c40 con 0x7f32380544a0 2023-08-09T12:39:33.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7fe121a2d640 1 -- 172.21.15.17:0/1877600608 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc005250 con 0x7fe11c0b0720 2023-08-09T12:39:33.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f323ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32380e3190 0x7f323803e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f3244933640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32380544a0 0x7f32380573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f323ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32380e3190 0x7f323803e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:33992/0 (socket says 172.21.15.17:33992) 2023-08-09T12:39:33.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.082+0000 7f323ffff640 1 -- 172.21.15.17:0/1470428156 learned_addr learned my addr 172.21.15.17:0/1470428156 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.083+0000 7f188f7fe640 1 --2- 172.21.15.17:0/2087108289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880e78e0 0x7f188804f290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1890068040 tx=0x7f18900a5610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68be754dbd164496 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.083+0000 7f188e7fc640 1 -- 172.21.15.17:0/2087108289 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900aa7d0 con 0x7f18880e78e0 2023-08-09T12:39:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.083+0000 7f188e7fc640 1 -- 172.21.15.17:0/2087108289 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18900a8050 con 0x7f18880e78e0 2023-08-09T12:39:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.083+0000 7f188e7fc640 1 -- 172.21.15.17:0/2087108289 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900aab70 con 0x7f18880e78e0 2023-08-09T12:39:33.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.083+0000 7f323ffff640 1 -- 172.21.15.17:0/1470428156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32380544a0 msgr2=0x7f32380573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.083+0000 7f323ffff640 1 --2- 172.21.15.17:0/1470428156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32380544a0 0x7f32380573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.083+0000 7f323ffff640 1 -- 172.21.15.17:0/1470428156 >> v1:172.21.15.142:6789/0 conn(0x7f3238038180 legacy=0x7f3238053d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.083+0000 7f323ffff640 1 -- 172.21.15.17:0/1470428156 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3238006e80 con 0x7f32380e3190 2023-08-09T12:39:33.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7f1895dd5640 1 -- 172.21.15.17:0/2087108289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880e78e0 msgr2=0x7f188804f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7f1895dd5640 1 --2- 172.21.15.17:0/2087108289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880e78e0 0x7f188804f290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1890068040 tx=0x7f18900a5610 comp rx=0 tx=0).stop 2023-08-09T12:39:33.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7fe103fff640 1 -- 172.21.15.17:0/1877600608 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe10c007230 con 0x7fe11c0b0720 2023-08-09T12:39:33.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7f1895dd5640 1 -- 172.21.15.17:0/2087108289 shutdown_connections 2023-08-09T12:39:33.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7f1895dd5640 1 --2- 172.21.15.17:0/2087108289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb730 0x7f1888053720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7f1895dd5640 1 --2- 172.21.15.17:0/2087108289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880e78e0 0x7f188804f290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7f1895dd5640 1 -- 172.21.15.17:0/2087108289 >> 172.21.15.17:0/2087108289 conn(0x7f1888054c40 msgr2=0x7f1888055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7f1895dd5640 1 -- 172.21.15.17:0/2087108289 shutdown_connections 2023-08-09T12:39:33.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.084+0000 7f1895dd5640 1 -- 172.21.15.17:0/2087108289 wait complete. 2023-08-09T12:39:33.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.085+0000 7f323ffff640 1 --2- 172.21.15.17:0/1470428156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 0x7f323803e920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f32340098a0 tx=0x7f323402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc190e5231963013 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.085+0000 7fe103fff640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe10806a120 0x7fe10806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.085+0000 7fe103fff640 1 -- 172.21.15.17:0/1877600608 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe10c087f00 con 0x7fe11c0b0720 2023-08-09T12:39:33.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.085+0000 7f958dcfb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95880b83f0 0x7f95880b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.085+0000 7f958dcfb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95880b4a90 0x7f95880b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.085+0000 7f958dcfb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95880b4ee0 con 0x7f958815ced0 2023-08-09T12:39:33.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.085+0000 7f958dcfb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958815d2b0 con 0x7f95880b83f0 2023-08-09T12:39:33.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.086+0000 7f958dcfb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95880d1730 con 0x7f95880b4a90 2023-08-09T12:39:33.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.086+0000 7fe11a7fc640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe10806a120 0x7fe10806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.086+0000 7f958ccf9640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f958815ced0 0x7f95880d0f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:50086/0 (socket says 172.21.15.17:50086) 2023-08-09T12:39:33.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.086+0000 7f958ccf9640 1 -- 172.21.15.17:0/2567109613 learned_addr learned my addr 172.21.15.17:0/2567109613 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:33.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.086+0000 7f958d4fa640 1 --2- 172.21.15.17:0/2567109613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95880b4a90 0x7f95880b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.086+0000 7f957ffff640 1 --2- 172.21.15.17:0/2567109613 >> v2:172.21.15.142:3300/0 conn(0x7f95880b83f0 0x7f95880b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.086+0000 7f1895dd5640 1 Processor -- start 2023-08-09T12:39:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.087+0000 7f958d4fa640 1 -- 172.21.15.17:0/2567109613 >> v2:172.21.15.142:3300/0 conn(0x7f95880b83f0 msgr2=0x7f95880b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.087+0000 7f958d4fa640 1 --2- 172.21.15.17:0/2567109613 >> v2:172.21.15.142:3300/0 conn(0x7f95880b83f0 0x7f95880b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.087+0000 7f958d4fa640 1 -- 172.21.15.17:0/2567109613 >> v1:172.21.15.142:6789/0 conn(0x7f958815ced0 legacy=0x7f95880d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.087+0000 7f958d4fa640 1 -- 172.21.15.17:0/2567109613 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880d1a10 con 0x7f95880b4a90 2023-08-09T12:39:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.087+0000 7f1895dd5640 1 -- start start 2023-08-09T12:39:33.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.087+0000 7fe11a7fc640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe10806a120 0x7fe10806c5e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe110036000 tx=0x7fe110044040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f1895dd5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18880e78e0 0x7f18880e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f1895dd5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb2f0 0x7f18880e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f958d4fa640 1 --2- 172.21.15.17:0/2567109613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95880b4a90 0x7f95880b5c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9580009d90 tx=0x7f958002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71011781b959cc17 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f1895dd5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880eb730 0x7f1888180160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f1895dd5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18880498f0 con 0x7f18880e78e0 2023-08-09T12:39:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f1895dd5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18880d2620 con 0x7f18880eb730 2023-08-09T12:39:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f1895dd5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188817e650 con 0x7f18880eb2f0 2023-08-09T12:39:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f188f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18880e78e0 0x7f18880e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f188f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18880e78e0 0x7f18880e3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56118/0 (socket says 172.21.15.17:56118) 2023-08-09T12:39:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.088+0000 7f188f7fe640 1 -- 172.21.15.17:0/244739846 learned_addr learned my addr 172.21.15.17:0/244739846 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.089+0000 7f188effd640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb2f0 0x7f18880e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.089+0000 7f188ffff640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880eb730 0x7f1888180160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.089+0000 7f188f7fe640 1 -- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb2f0 msgr2=0x7f18880e40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.089+0000 7f188f7fe640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb2f0 0x7f18880e40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.089+0000 7f188f7fe640 1 -- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880eb730 msgr2=0x7f1888180160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.089+0000 7f188f7fe640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880eb730 0x7f1888180160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.089+0000 7f188f7fe640 1 -- 172.21.15.17:0/244739846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188817e930 con 0x7f18880e78e0 2023-08-09T12:39:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.089+0000 7f188f7fe640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18880e78e0 0x7f18880e3b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1890068cb0 tx=0x7f18900a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.090+0000 7f187bfff640 1 -- 172.21.15.17:0/244739846 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900acbc0 con 0x7f18880e78e0 2023-08-09T12:39:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.090+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188817ec10 con 0x7f18880e78e0 2023-08-09T12:39:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.090+0000 7f187bfff640 1 -- 172.21.15.17:0/244739846 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18900a5e90 con 0x7f18880e78e0 2023-08-09T12:39:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.090+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18881806a0 con 0x7f18880e78e0 2023-08-09T12:39:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.090+0000 7f187bfff640 1 -- 172.21.15.17:0/244739846 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900aae30 con 0x7f18880e78e0 2023-08-09T12:39:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.091+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1870005250 con 0x7f18880e78e0 2023-08-09T12:39:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.092+0000 7f187bfff640 1 -- 172.21.15.17:0/244739846 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f18900b53a0 con 0x7f18880e78e0 2023-08-09T12:39:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.093+0000 7f187bfff640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f187406a050 0x7f187406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.093+0000 7f187bfff640 1 -- 172.21.15.17:0/244739846 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1890124080 con 0x7f18880e78e0 2023-08-09T12:39:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.093+0000 7f188effd640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f187406a050 0x7f187406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.095+0000 7f188effd640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f187406a050 0x7f187406c510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f187c006fd0 tx=0x7f187c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1158790214 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000ab40 con 0x7fc3c81610e0 2023-08-09T12:39:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1158790214 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000aca0 con 0x7fc3c81610e0 2023-08-09T12:39:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1158790214 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0012620 con 0x7fc3c81610e0 2023-08-09T12:39:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7f0426ffd640 1 -- 172.21.15.17:0/1923821247 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430011830 con 0x7f042c053010 2023-08-09T12:39:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c80c78e0 con 0x7fc3c81610e0 2023-08-09T12:39:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c049870 con 0x7f042c053010 2023-08-09T12:39:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7f0f1affd640 1 -- 172.21.15.17:0/1526899758 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0f20053d00 con 0x7f0f240cc6d0 2023-08-09T12:39:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c80c8180 con 0x7fc3c81610e0 2023-08-09T12:39:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.096+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c04ae50 con 0x7f042c053010 2023-08-09T12:39:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.097+0000 7f0426ffd640 1 -- 172.21.15.17:0/1923821247 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04300119b0 con 0x7f042c053010 2023-08-09T12:39:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.097+0000 7f0426ffd640 1 -- 172.21.15.17:0/1923821247 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430011d60 con 0x7f042c053010 2023-08-09T12:39:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.098+0000 7f957f7fe640 1 -- 172.21.15.17:0/2567109613 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958002cc50 con 0x7f95880b4a90 2023-08-09T12:39:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.098+0000 7f957f7fe640 1 -- 172.21.15.17:0/2567109613 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958002cdb0 con 0x7f95880b4a90 2023-08-09T12:39:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.098+0000 7f957f7fe640 1 -- 172.21.15.17:0/2567109613 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580034660 con 0x7f95880b4a90 2023-08-09T12:39:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.098+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c80c7ce0 con 0x7fc3c81610e0 2023-08-09T12:39:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.098+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c005250 con 0x7f042c053010 2023-08-09T12:39:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.100+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1158790214 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc3c0007070 con 0x7fc3c81610e0 2023-08-09T12:39:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.100+0000 7f958dcfb640 1 -- 172.21.15.17:0/2567109613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95880b4a90 msgr2=0x7f95880b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.100+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2567109613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95880b4a90 0x7f95880b5c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9580009d90 tx=0x7f958002bea0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.100+0000 7f958dcfb640 1 -- 172.21.15.17:0/2567109613 shutdown_connections 2023-08-09T12:39:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.100+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2567109613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95880b4a90 0x7f95880b5c00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.100+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2567109613 >> v2:172.21.15.142:3300/0 conn(0x7f95880b83f0 0x7f95880b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.100+0000 7f958dcfb640 1 -- 172.21.15.17:0/2567109613 >> 172.21.15.17:0/2567109613 conn(0x7f95880d2ad0 msgr2=0x7f95880d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7fc3af7fe640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3b406a120 0x7fc3b406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1158790214 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3c00887f0 con 0x7fc3c81610e0 2023-08-09T12:39:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.100+0000 7f187bfff640 1 -- 172.21.15.17:0/244739846 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f18900ef6d0 con 0x7f18880e78e0 2023-08-09T12:39:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7f323effd640 1 -- 172.21.15.17:0/1470428156 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234030800 con 0x7f32380e3190 2023-08-09T12:39:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7f323effd640 1 -- 172.21.15.17:0/1470428156 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234030960 con 0x7f32380e3190 2023-08-09T12:39:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7f323effd640 1 -- 172.21.15.17:0/1470428156 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234030cf0 con 0x7f32380e3190 2023-08-09T12:39:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7f958dcfb640 1 -- 172.21.15.17:0/2567109613 shutdown_connections 2023-08-09T12:39:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7f958dcfb640 1 -- 172.21.15.17:0/2567109613 wait complete. 2023-08-09T12:39:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7fc3c6ffd640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3b406a120 0x7fc3b406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7fe103fff640 1 -- 172.21.15.17:0/1877600608 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe10c0535d0 con 0x7fe11c0b0720 2023-08-09T12:39:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.102+0000 7f3245134640 1 -- 172.21.15.17:0/1470428156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 msgr2=0x7f323803e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.102+0000 7f3245134640 1 --2- 172.21.15.17:0/1470428156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 0x7f323803e920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f32340098a0 tx=0x7f323402b940 comp rx=0 tx=0).stop 2023-08-09T12:39:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.102+0000 7f3245134640 1 -- 172.21.15.17:0/1470428156 shutdown_connections 2023-08-09T12:39:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.102+0000 7f3245134640 1 --2- 172.21.15.17:0/1470428156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32380544a0 0x7f32380573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.102+0000 7f3245134640 1 --2- 172.21.15.17:0/1470428156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 0x7f323803e920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.102+0000 7f3245134640 1 -- 172.21.15.17:0/1470428156 >> 172.21.15.17:0/1470428156 conn(0x7f32380590c0 msgr2=0x7f32380594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.102+0000 7f3245134640 1 -- 172.21.15.17:0/1470428156 shutdown_connections 2023-08-09T12:39:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.102+0000 7f3245134640 1 -- 172.21.15.17:0/1470428156 wait complete. 2023-08-09T12:39:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.101+0000 7f0426ffd640 1 -- 172.21.15.17:0/1923821247 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f043001a400 con 0x7f042c053010 2023-08-09T12:39:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.103+0000 7fc3c6ffd640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3b406a120 0x7fc3b406c5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009970 tx=0x7fc3b8009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.103+0000 7f0426ffd640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f041806a020 0x7f041806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.103+0000 7f0426ffd640 1 -- 172.21.15.17:0/1923821247 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0430088ab0 con 0x7f042c053010 2023-08-09T12:39:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.104+0000 7f04398ff640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f041806a020 0x7f041806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.105+0000 7f3245134640 1 Processor -- start 2023-08-09T12:39:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.105+0000 7f04398ff640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f041806a020 0x7f041806c4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f042c0ebdb0 tx=0x7f04340aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.105+0000 7f3245134640 1 -- start start 2023-08-09T12:39:33.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.105+0000 7f958dcfb640 1 Processor -- start 2023-08-09T12:39:33.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.106+0000 7f958dcfb640 1 -- start start 2023-08-09T12:39:33.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.106+0000 7f3245134640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3238038180 0x7f32380d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f3245134640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32380544a0 0x7f3238051780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f958dcfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95880b4a90 0x7f9588156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f958dcfb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95880b83f0 0x7f95880c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f958dcfb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958815ced0 0x7f95881f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f958dcfb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880c73a0 con 0x7f95880b4a90 2023-08-09T12:39:33.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f958dcfb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880c81e0 con 0x7f95880b83f0 2023-08-09T12:39:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f958dcfb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95880c75d0 con 0x7f958815ced0 2023-08-09T12:39:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f3245134640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 0x7f3238051cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f323ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3238038180 0x7f32380d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f323ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3238038180 0x7f32380d23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:39002/0 (socket says 172.21.15.17:39002) 2023-08-09T12:39:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f323f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32380544a0 0x7f3238051780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f3245134640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323816b1f0 con 0x7f32380544a0 2023-08-09T12:39:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f323f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32380544a0 0x7f3238051780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56120/0 (socket says 172.21.15.17:56120) 2023-08-09T12:39:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323816a150 con 0x7f32380e3190 2023-08-09T12:39:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f323f7fe640 1 -- 172.21.15.17:0/2148673513 learned_addr learned my addr 172.21.15.17:0/2148673513 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.107+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323816a430 con 0x7f3238038180 2023-08-09T12:39:33.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f958ccf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95880b4a90 0x7f9588156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f958ccf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95880b4a90 0x7f9588156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56136/0 (socket says 172.21.15.17:56136) 2023-08-09T12:39:33.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f958ccf9640 1 -- 172.21.15.17:0/2472069157 learned_addr learned my addr 172.21.15.17:0/2472069157 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f958d4fa640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958815ced0 0x7f95881f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f3244933640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 0x7f3238051cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f323f7fe640 1 -- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3238038180 msgr2=0x7f32380d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f323f7fe640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3238038180 0x7f32380d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f323f7fe640 1 -- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 msgr2=0x7f3238051cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f323f7fe640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 0x7f3238051cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f323f7fe640 1 -- 172.21.15.17:0/2148673513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340094d0 con 0x7f32380544a0 2023-08-09T12:39:33.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f3244933640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 0x7f3238051cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:33.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.108+0000 7f957ffff640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95880b83f0 0x7f95880c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.109+0000 7f323f7fe640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32380544a0 0x7f3238051780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f323000c450 tx=0x7f323000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.109+0000 7f958ccf9640 1 -- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958815ced0 msgr2=0x7f95881f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.109+0000 7f958ccf9640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958815ced0 0x7f95881f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.109+0000 7f958ccf9640 1 -- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95880b83f0 msgr2=0x7f95880c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.109+0000 7f958ccf9640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95880b83f0 0x7f95880c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.109+0000 7f958ccf9640 1 -- 172.21.15.17:0/2472069157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580009a70 con 0x7f95880b4a90 2023-08-09T12:39:33.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.109+0000 7f323cff9640 1 -- 172.21.15.17:0/2148673513 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300052d0 con 0x7f32380544a0 2023-08-09T12:39:33.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.109+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323816a710 con 0x7f32380544a0 2023-08-09T12:39:33.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.110+0000 7f958ccf9640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95880b4a90 0x7f9588156ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f958400c4a0 tx=0x7f958400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.110+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323816acd0 con 0x7f32380544a0 2023-08-09T12:39:33.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.110+0000 7f323cff9640 1 -- 172.21.15.17:0/2148673513 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32300011e0 con 0x7f32380544a0 2023-08-09T12:39:33.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.110+0000 7f323cff9640 1 -- 172.21.15.17:0/2148673513 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230012630 con 0x7f32380544a0 2023-08-09T12:39:33.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.112+0000 7f957d7fa640 1 -- 172.21.15.17:0/2472069157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584005ce0 con 0x7f95880b4a90 2023-08-09T12:39:33.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.112+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95880c78b0 con 0x7f95880b4a90 2023-08-09T12:39:33.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.112+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95880c7e70 con 0x7f95880b4a90 2023-08-09T12:39:33.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.113+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3238007140 con 0x7f32380544a0 2023-08-09T12:39:33.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.113+0000 7f957d7fa640 1 -- 172.21.15.17:0/2472069157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584005e40 con 0x7f95880b4a90 2023-08-09T12:39:33.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.114+0000 7f957d7fa640 1 -- 172.21.15.17:0/2472069157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584007270 con 0x7f95880b4a90 2023-08-09T12:39:33.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.114+0000 7f323cff9640 1 -- 172.21.15.17:0/2148673513 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3230012790 con 0x7f32380544a0 2023-08-09T12:39:33.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.115+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9568005250 con 0x7f95880b4a90 2023-08-09T12:39:33.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.116+0000 7f323cff9640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322c06a050 0x7f322c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.116+0000 7f323cff9640 1 -- 172.21.15.17:0/2148673513 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3230087f40 con 0x7f32380544a0 2023-08-09T12:39:33.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.116+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1158790214 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc3c0053f70 con 0x7fc3c81610e0 2023-08-09T12:39:33.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.116+0000 7f323ffff640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322c06a050 0x7f322c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.118+0000 7f323ffff640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322c06a050 0x7f322c06c510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3234036000 tx=0x7f3234008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.118+0000 7f957d7fa640 1 -- 172.21.15.17:0/2472069157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f95840073d0 con 0x7f95880b4a90 2023-08-09T12:39:33.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.119+0000 7f957d7fa640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f957406a050 0x7f957406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.120+0000 7f957d7fa640 1 -- 172.21.15.17:0/2472069157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9584087d20 con 0x7f95880b4a90 2023-08-09T12:39:33.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.121+0000 7f957ffff640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f957406a050 0x7f957406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.122+0000 7f957ffff640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f957406a050 0x7f957406c510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95880d05c0 tx=0x7f9578008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.126+0000 7f0426ffd640 1 -- 172.21.15.17:0/1923821247 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f04300542c0 con 0x7f042c053010 2023-08-09T12:39:33.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.128+0000 7f323cff9640 1 -- 172.21.15.17:0/2148673513 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3238007140 con 0x7f32380544a0 2023-08-09T12:39:33.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.137+0000 7f957d7fa640 1 -- 172.21.15.17:0/2472069157 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f95840534c0 con 0x7f95880b4a90 2023-08-09T12:39:33.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.519+0000 7fe121a2d640 1 -- 172.21.15.17:0/1877600608 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0fc0050c0 con 0x7fe11c0b0720 2023-08-09T12:39:33.523 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:33.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.520+0000 7fe103fff640 1 -- 172.21.15.17:0/1877600608 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe10c056bf0 con 0x7fe11c0b0720 2023-08-09T12:39:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 -- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe10806a120 msgr2=0x7fe10806c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe10806a120 0x7fe10806c5e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe110036000 tx=0x7fe110044040 comp rx=0 tx=0).stop 2023-08-09T12:39:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 -- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0b0720 msgr2=0x7fe11c0c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0b0720 0x7fe11c0c8170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe10c001830 tx=0x7fe10c001cf0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 -- 172.21.15.17:0/1877600608 shutdown_connections 2023-08-09T12:39:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe10806a120 0x7fe10806c5e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe11c15a9a0 0x7fe11c155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c0cdcd0 0x7fe11c1f10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 --2- 172.21.15.17:0/1877600608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0b0720 0x7fe11c0c8170 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 -- 172.21.15.17:0/1877600608 >> 172.21.15.17:0/1877600608 conn(0x7fe11c0b1610 msgr2=0x7fe11c0b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 -- 172.21.15.17:0/1877600608 shutdown_connections 2023-08-09T12:39:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.524+0000 7fe101ffb640 1 -- 172.21.15.17:0/1877600608 wait complete. 2023-08-09T12:39:33.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.531+0000 7f0f2c384640 1 -- 172.21.15.17:0/1526899758 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f0c005500 con 0x7f0f240cc6d0 2023-08-09T12:39:33.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.532+0000 7f0f1affd640 1 -- 172.21.15.17:0/1526899758 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f20057320 con 0x7f0f240cc6d0 2023-08-09T12:39:33.537 INFO:teuthology.orchestra.run.smithi017.stdout:55834574855 2023-08-09T12:39:33.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.535+0000 7f0f18ff9640 1 -- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f0806a050 msgr2=0x7f0f0806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.535+0000 7f0f18ff9640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f0806a050 0x7f0f0806c510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f2406c6f0 tx=0x7f0f1c012040 comp rx=0 tx=0).stop 2023-08-09T12:39:33.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.535+0000 7f0f18ff9640 1 -- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240cc6d0 msgr2=0x7f0f240cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.535+0000 7f0f18ff9640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240cc6d0 0x7f0f240cb890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000b480 tx=0x7f0f2000b940 comp rx=0 tx=0).stop 2023-08-09T12:39:33.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.536+0000 7f0f18ff9640 1 -- 172.21.15.17:0/1526899758 shutdown_connections 2023-08-09T12:39:33.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.536+0000 7f0f18ff9640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f0806a050 0x7f0f0806c510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.536+0000 7f0f18ff9640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f240ccb30 0x7f0f240afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.536+0000 7f0f18ff9640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f240cc6d0 0x7f0f240cb890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.536+0000 7f0f18ff9640 1 --2- 172.21.15.17:0/1526899758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f240c9780 0x7f0f240c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.536+0000 7f0f18ff9640 1 -- 172.21.15.17:0/1526899758 >> 172.21.15.17:0/1526899758 conn(0x7f0f240ceb00 msgr2=0x7f0f240ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.536+0000 7f0f18ff9640 1 -- 172.21.15.17:0/1526899758 shutdown_connections 2023-08-09T12:39:33.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.536+0000 7f0f18ff9640 1 -- 172.21.15.17:0/1526899758 wait complete. 2023-08-09T12:39:33.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.551+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fce8c04e390 con 0x7fce8c069d00 2023-08-09T12:39:33.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-08-09T12:39:33.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.552+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc3c80c8370 con 0x7fc3c81610e0 2023-08-09T12:39:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.552+0000 7fce88ff9640 1 -- 172.21.15.17:0/3553940130 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce7c04d020 con 0x7fce8c069d00 2023-08-09T12:39:33.558 DEBUG:teuthology.parallel:result is None 2023-08-09T12:39:33.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.552+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f323816af10 con 0x7f32380544a0 2023-08-09T12:39:33.559 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:33.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.553+0000 7f323cff9640 1 -- 172.21.15.17:0/2148673513 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f323816af10 con 0x7f32380544a0 2023-08-09T12:39:33.560 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.553+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1158790214 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3c0017020 con 0x7fc3c81610e0 2023-08-09T12:39:33.561 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce6c06a050 msgr2=0x7fce6c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce6c06a050 0x7fce6c06c510 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0cd160 tx=0x7fce74009040 comp rx=0 tx=0).stop 2023-08-09T12:39:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c069d00 msgr2=0x7fce8c0ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c069d00 0x7fce8c0ccc20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce7c032000 tx=0x7fce7c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322c06a050 msgr2=0x7f322c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322c06a050 0x7f322c06c510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3234036000 tx=0x7f3234008030 comp rx=0 tx=0).stop 2023-08-09T12:39:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32380544a0 msgr2=0x7f3238051780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32380544a0 0x7f3238051780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f323000c450 tx=0x7f323000c910 comp rx=0 tx=0).stop 2023-08-09T12:39:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 shutdown_connections 2023-08-09T12:39:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce6c06a050 0x7fce6c06c510 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce8c161090 0x7fce8c0706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce8c0c4570 0x7fce8c161470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 --2- 172.21.15.17:0/3553940130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce8c069d00 0x7fce8c0ccc20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 >> 172.21.15.17:0/3553940130 conn(0x7fce8c0ce650 msgr2=0x7fce8c06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 shutdown_connections 2023-08-09T12:39:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f322c06a050 0x7f322c06c510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32380e3190 0x7f3238051cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32380544a0 0x7f3238051780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.556+0000 7f3245134640 1 --2- 172.21.15.17:0/2148673513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3238038180 0x7f32380d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3b406a120 msgr2=0x7fc3b406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3b406a120 0x7fc3b406c5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009970 tx=0x7fc3b8009110 comp rx=0 tx=0).stop 2023-08-09T12:39:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 >> 172.21.15.17:0/2148673513 conn(0x7f32380590c0 msgr2=0x7f3238038a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c81610e0 msgr2=0x7fc3c80b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c81610e0 0x7fc3c80b3e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000caa0 tx=0x7fc3c000cf60 comp rx=0 tx=0).stop 2023-08-09T12:39:33.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 shutdown_connections 2023-08-09T12:39:33.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 shutdown_connections 2023-08-09T12:39:33.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3b406a120 0x7fc3b406c5e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7f3245134640 1 -- 172.21.15.17:0/2148673513 wait complete. 2023-08-09T12:39:33.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3c81610e0 0x7fc3c80b3e40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3c80cda00 0x7fc3c80c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1870005500 con 0x7f18880e78e0 2023-08-09T12:39:33.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 --2- 172.21.15.17:0/1158790214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3c806d700 0x7fc3c80c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 >> 172.21.15.17:0/1158790214 conn(0x7fc3c80b0ad0 msgr2=0x7fc3c80703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 shutdown_connections 2023-08-09T12:39:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7fce91ead640 1 -- 172.21.15.17:0/3553940130 wait complete. 2023-08-09T12:39:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.557+0000 7f187bfff640 1 -- 172.21.15.17:0/244739846 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18900f2cf0 con 0x7f18880e78e0 2023-08-09T12:39:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.558+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 shutdown_connections 2023-08-09T12:39:33.572 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:33.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.558+0000 7fc3cd347640 1 -- 172.21.15.17:0/1158790214 wait complete. 2023-08-09T12:39:33.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.559+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f95680057d0 con 0x7f95880b4a90 2023-08-09T12:39:33.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.560+0000 7f957d7fa640 1 -- 172.21.15.17:0/2472069157 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9584017090 con 0x7f95880b4a90 2023-08-09T12:39:33.573 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.560+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f187406a050 msgr2=0x7f187406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.560+0000 7f1895dd5640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f187406a050 0x7f187406c510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f187c006fd0 tx=0x7f187c008040 comp rx=0 tx=0).stop 2023-08-09T12:39:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.560+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18880e78e0 msgr2=0x7f18880e3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.560+0000 7f1895dd5640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18880e78e0 0x7f18880e3b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1890068cb0 tx=0x7f18900a7000 comp rx=0 tx=0).stop 2023-08-09T12:39:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.561+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 shutdown_connections 2023-08-09T12:39:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.561+0000 7f1895dd5640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f187406a050 0x7f187406c510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.561+0000 7f1895dd5640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18880eb730 0x7f1888180160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.561+0000 7f1895dd5640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18880eb2f0 0x7f18880e40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.561+0000 7f1895dd5640 1 --2- 172.21.15.17:0/244739846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18880e78e0 0x7f18880e3b70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.561+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 >> 172.21.15.17:0/244739846 conn(0x7f1888054c40 msgr2=0x7f188804e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.561+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f041c0057d0 con 0x7f042c053010 2023-08-09T12:39:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.562+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 shutdown_connections 2023-08-09T12:39:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.562+0000 7f1895dd5640 1 -- 172.21.15.17:0/244739846 wait complete. 2023-08-09T12:39:33.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.563+0000 7f0426ffd640 1 -- 172.21.15.17:0/1923821247 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0430015020 con 0x7f042c053010 2023-08-09T12:39:33.579 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-08-09T12:39:33.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.564+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f957406a050 msgr2=0x7f957406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.564+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f957406a050 0x7f957406c510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95880d05c0 tx=0x7f9578008040 comp rx=0 tx=0).stop 2023-08-09T12:39:33.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.564+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95880b4a90 msgr2=0x7f9588156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.564+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95880b4a90 0x7f9588156ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f958400c4a0 tx=0x7f958400c960 comp rx=0 tx=0).stop 2023-08-09T12:39:33.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.565+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 shutdown_connections 2023-08-09T12:39:33.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.565+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f957406a050 0x7f957406c510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.565+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958815ced0 0x7f95881f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.565+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95880b83f0 0x7f95880c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.565+0000 7f958dcfb640 1 --2- 172.21.15.17:0/2472069157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95880b4a90 0x7f9588156ba0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.565+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 >> 172.21.15.17:0/2472069157 conn(0x7f95880d2ad0 msgr2=0x7f95880cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-08-09T12:39:33.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.566+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 shutdown_connections 2023-08-09T12:39:33.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.566+0000 7f958dcfb640 1 -- 172.21.15.17:0/2472069157 wait complete. 2023-08-09T12:39:33.583 DEBUG:teuthology.parallel:result is None 2023-08-09T12:39:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.566+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f041806a020 msgr2=0x7f041806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.566+0000 7f043c364640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f041806a020 0x7f041806c4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f042c0ebdb0 tx=0x7f04340aa000 comp rx=0 tx=0).stop 2023-08-09T12:39:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.566+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c053010 msgr2=0x7f042c047ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.566+0000 7f043c364640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c053010 0x7f042c047ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f043000b410 tx=0x7f043000b8d0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.566+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 shutdown_connections 2023-08-09T12:39:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.566+0000 7f043c364640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f041806a020 0x7f041806c4e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.567+0000 7f043c364640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f042c0eb2f0 0x7f042c17c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.567+0000 7f043c364640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f042c0e78e0 0x7f042c04a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.567+0000 7f043c364640 1 --2- 172.21.15.17:0/1923821247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f042c053010 0x7f042c047ce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.567+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 >> 172.21.15.17:0/1923821247 conn(0x7f042c054c40 msgr2=0x7f042c037d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.567+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 shutdown_connections 2023-08-09T12:39:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.567+0000 7f043c364640 1 -- 172.21.15.17:0/1923821247 wait complete. 2023-08-09T12:39:33.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-08-09T12:39:33.587 DEBUG:teuthology.parallel:result is None 2023-08-09T12:39:33.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-08-09T12:39:33.592 DEBUG:teuthology.parallel:result is None 2023-08-09T12:39:33.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-08-09T12:39:33.593 DEBUG:teuthology.parallel:result is None 2023-08-09T12:39:33.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-08-09T12:39:33.594 DEBUG:teuthology.parallel:result is None 2023-08-09T12:39:33.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-08-09T12:39:33.595 DEBUG:teuthology.parallel:result is None 2023-08-09T12:39:33.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-08-09T12:39:33.596 DEBUG:teuthology.parallel:result is None 2023-08-09T12:39:33.596 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-09T12:39:33.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:39:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.844+0000 7fb6f759e640 1 Processor -- start 2023-08-09T12:39:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.844+0000 7fb6f759e640 1 -- start start 2023-08-09T12:39:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.845+0000 7fb6f759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb6f81587e0 0x7fb6f8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.845+0000 7fb6f759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb6f815bce0 0x7fb6f80cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f80715c0 con 0x7fb6f815bce0 2023-08-09T12:39:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f80718a0 con 0x7fb6f81587e0 2023-08-09T12:39:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f8071b80 con 0x7fb6f80b0b10 2023-08-09T12:39:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f6d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb6f815bce0 0x7fb6f80cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f6d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb6f815bce0 0x7fb6f80cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56140/0 (socket says 172.21.15.17:56140) 2023-08-09T12:39:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f6d9d640 1 -- 172.21.15.17:0/3598101296 learned_addr learned my addr 172.21.15.17:0/3598101296 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f659c640 1 --2- 172.21.15.17:0/3598101296 >> v2:172.21.15.142:3300/0 conn(0x7fb6f81587e0 0x7fb6f8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f5d9b640 1 --2- 172.21.15.17:0/3598101296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.846+0000 7fb6f6d9d640 1 -- 172.21.15.17:0/3598101296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 msgr2=0x7fb6f815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.847+0000 7fb6f6d9d640 1 --2- 172.21.15.17:0/3598101296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.847+0000 7fb6f6d9d640 1 -- 172.21.15.17:0/3598101296 >> v2:172.21.15.142:3300/0 conn(0x7fb6f81587e0 msgr2=0x7fb6f8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.847+0000 7fb6f6d9d640 1 --2- 172.21.15.17:0/3598101296 >> v2:172.21.15.142:3300/0 conn(0x7fb6f81587e0 0x7fb6f8070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.847+0000 7fb6f6d9d640 1 -- 172.21.15.17:0/3598101296 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f815b280 con 0x7fb6f815bce0 2023-08-09T12:39:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.847+0000 7fb6f659c640 1 --2- 172.21.15.17:0/3598101296 >> v2:172.21.15.142:3300/0 conn(0x7fb6f81587e0 0x7fb6f8070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.847+0000 7fb6f5d9b640 1 --2- 172.21.15.17:0/3598101296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.848+0000 7fb6f6d9d640 1 --2- 172.21.15.17:0/3598101296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f815bce0 0x7fb6f80cb070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb6f806cc50 tx=0x7fb6f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2bae321ec7b4d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.848+0000 7fb6f559a640 1 -- 172.21.15.17:0/3598101296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f002ca80 con 0x7fb6f815bce0 2023-08-09T12:39:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f559a640 1 -- 172.21.15.17:0/3598101296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f002cbe0 con 0x7fb6f815bce0 2023-08-09T12:39:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f559a640 1 -- 172.21.15.17:0/3598101296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f00343f0 con 0x7fb6f815bce0 2023-08-09T12:39:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 -- 172.21.15.17:0/3598101296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f815bce0 msgr2=0x7fb6f80cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 --2- 172.21.15.17:0/3598101296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f815bce0 0x7fb6f80cb070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb6f806cc50 tx=0x7fb6f002bee0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 -- 172.21.15.17:0/3598101296 shutdown_connections 2023-08-09T12:39:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 --2- 172.21.15.17:0/3598101296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f815bce0 0x7fb6f80cb070 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 --2- 172.21.15.17:0/3598101296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 --2- 172.21.15.17:0/3598101296 >> v2:172.21.15.142:3300/0 conn(0x7fb6f81587e0 0x7fb6f8070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 -- 172.21.15.17:0/3598101296 >> 172.21.15.17:0/3598101296 conn(0x7fb6f80b1d50 msgr2=0x7fb6f806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 -- 172.21.15.17:0/3598101296 shutdown_connections 2023-08-09T12:39:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.849+0000 7fb6f759e640 1 -- 172.21.15.17:0/3598101296 wait complete. 2023-08-09T12:39:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.851+0000 7fb6f759e640 1 Processor -- start 2023-08-09T12:39:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.851+0000 7fb6f759e640 1 -- start start 2023-08-09T12:39:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f81587e0 0x7fb6f8155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80afb80 0x7fb6f815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80b0320 con 0x7fb6f81587e0 2023-08-09T12:39:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f815cd70 con 0x7fb6f80afb80 2023-08-09T12:39:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80b0040 con 0x7fb6f80b0b10 2023-08-09T12:39:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f81587e0 0x7fb6f8155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f81587e0 0x7fb6f8155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56150/0 (socket says 172.21.15.17:56150) 2023-08-09T12:39:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.852+0000 7fb6f5d9b640 1 -- 172.21.15.17:0/2723002427 learned_addr learned my addr 172.21.15.17:0/2723002427 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f659c640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f5d9b640 1 -- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 msgr2=0x7fb6f815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f5d9b640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f5d9b640 1 -- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80afb80 msgr2=0x7fb6f815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f5d9b640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80afb80 0x7fb6f815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f5d9b640 1 -- 172.21.15.17:0/2723002427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f0009b30 con 0x7fb6f81587e0 2023-08-09T12:39:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f659c640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f5d9b640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f81587e0 0x7fb6f8155820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00d830 tx=0x7fb6ec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6e6ffd640 1 -- 172.21.15.17:0/2723002427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00be10 con 0x7fb6f81587e0 2023-08-09T12:39:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6e6ffd640 1 -- 172.21.15.17:0/2723002427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec004030 con 0x7fb6f81587e0 2023-08-09T12:39:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6e6ffd640 1 -- 172.21.15.17:0/2723002427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec0043c0 con 0x7fb6f81587e0 2023-08-09T12:39:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.853+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f815c720 con 0x7fb6f81587e0 2023-08-09T12:39:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.854+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f81f61c0 con 0x7fb6f81587e0 2023-08-09T12:39:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.855+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f815cf00 con 0x7fb6f81587e0 2023-08-09T12:39:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.855+0000 7fb6e6ffd640 1 -- 172.21.15.17:0/2723002427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb6ec0098b0 con 0x7fb6f81587e0 2023-08-09T12:39:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.856+0000 7fb6e6ffd640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb6d806a050 0x7fb6d806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.856+0000 7fb6e6ffd640 1 -- 172.21.15.17:0/2723002427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6ec0886b0 con 0x7fb6f81587e0 2023-08-09T12:39:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.857+0000 7fb6f659c640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb6d806a050 0x7fb6d806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.858+0000 7fb6f659c640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb6d806a050 0x7fb6d806c510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006fd0 tx=0x7fb6e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:33.861+0000 7fb6e6ffd640 1 -- 172.21.15.17:0/2723002427 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb6ec053e30 con 0x7fb6f81587e0 2023-08-09T12:39:34.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.042+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6f815af70 con 0x7fb6d806a050 2023-08-09T12:39:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.065+0000 7fb6e6ffd640 1 -- 172.21.15.17:0/2723002427 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280625 (secure 0 0 0) 0x7fb6e8009100 con 0x7fb6d806a050 2023-08-09T12:39:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:39:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.070+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb6d806a050 msgr2=0x7fb6d806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.070+0000 7fb6f759e640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb6d806a050 0x7fb6d806c510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006fd0 tx=0x7fb6e8008040 comp rx=0 tx=0).stop 2023-08-09T12:39:34.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f81587e0 msgr2=0x7fb6f8155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f81587e0 0x7fb6f8155820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00d830 tx=0x7fb6ec00dcf0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 shutdown_connections 2023-08-09T12:39:34.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb6d806a050 0x7fb6d806c510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80afb80 0x7fb6f815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6f81587e0 0x7fb6f8155820 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 --2- 172.21.15.17:0/2723002427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80b0b10 0x7fb6f815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 >> 172.21.15.17:0/2723002427 conn(0x7fb6f80b1d50 msgr2=0x7fb6f8157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 shutdown_connections 2023-08-09T12:39:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.071+0000 7fb6f759e640 1 -- 172.21.15.17:0/2723002427 wait complete. 2023-08-09T12:39:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-09T12:39:32.636309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560606,"statfs":{"total":1600000000,"available":1598061564,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003148"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613678+0000","last_change":"2023-08-09T12:39:25.635863+0000","last_active":"2023-08-09T12:39:26.613678+0000","last_peered":"2023-08-09T12:39:26.613678+0000","last_clean":"2023-08-09T12:39:26.613678+0000","last_became_active":"2023-08-09T12:39:25.635612+0000","last_became_peered":"2023-08-09T12:39:25.635612+0000","last_unstale":"2023-08-09T12:39:26.613678+0000","last_undegraded":"2023-08-09T12:39:26.613678+0000","last_fullsized":"2023-08-09T12:39:26.613678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420553+0000","last_change":"2023-08-09T12:39:25.643258+0000","last_active":"2023-08-09T12:39:27.420553+0000","last_peered":"2023-08-09T12:39:27.420553+0000","last_clean":"2023-08-09T12:39:27.420553+0000","last_became_active":"2023-08-09T12:39:25.642998+0000","last_became_peered":"2023-08-09T12:39:25.642998+0000","last_unstale":"2023-08-09T12:39:27.420553+0000","last_undegraded":"2023-08-09T12:39:27.420553+0000","last_fullsized":"2023-08-09T12:39:27.420553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359791+0000","last_change":"2023-08-09T12:39:25.646436+0000","last_active":"2023-08-09T12:39:29.359791+0000","last_peered":"2023-08-09T12:39:29.359791+0000","last_clean":"2023-08-09T12:39:29.359791+0000","last_became_active":"2023-08-09T12:39:25.646140+0000","last_became_peered":"2023-08-09T12:39:25.646140+0000","last_unstale":"2023-08-09T12:39:29.359791+0000","last_undegraded":"2023-08-09T12:39:29.359791+0000","last_fullsized":"2023-08-09T12:39:29.359791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:35.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616957+0000","last_change":"2023-08-09T12:39:25.633360+0000","last_active":"2023-08-09T12:39:26.616957+0000","last_peered":"2023-08-09T12:39:26.616957+0000","last_clean":"2023-08-09T12:39:26.616957+0000","last_became_active":"2023-08-09T12:39:25.632781+0000","last_became_peered":"2023-08-09T12:39:25.632781+0000","last_unstale":"2023-08-09T12:39:26.616957+0000","last_undegraded":"2023-08-09T12:39:26.616957+0000","last_fullsized":"2023-08-09T12:39:26.616957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:42.820863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498344+0000","last_change":"2023-08-09T12:39:25.636182+0000","last_active":"2023-08-09T12:39:27.498344+0000","last_peered":"2023-08-09T12:39:27.498344+0000","last_clean":"2023-08-09T12:39:27.498344+0000","last_became_active":"2023-08-09T12:39:25.635794+0000","last_became_peered":"2023-08-09T12:39:25.635794+0000","last_unstale":"2023-08-09T12:39:27.498344+0000","last_undegraded":"2023-08-09T12:39:27.498344+0000","last_fullsized":"2023-08-09T12:39:27.498344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.358925+0000","last_change":"2023-08-09T12:39:25.650226+0000","last_active":"2023-08-09T12:39:29.358925+0000","last_peered":"2023-08-09T12:39:29.358925+0000","last_clean":"2023-08-09T12:39:29.358925+0000","last_became_active":"2023-08-09T12:39:25.646910+0000","last_became_peered":"2023-08-09T12:39:25.646910+0000","last_unstale":"2023-08-09T12:39:29.358925+0000","last_undegraded":"2023-08-09T12:39:29.358925+0000","last_fullsized":"2023-08-09T12:39:29.358925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499364+0000","last_change":"2023-08-09T12:39:25.643948+0000","last_active":"2023-08-09T12:39:27.499364+0000","last_peered":"2023-08-09T12:39:27.499364+0000","last_clean":"2023-08-09T12:39:27.499364+0000","last_became_active":"2023-08-09T12:39:25.643568+0000","last_became_peered":"2023-08-09T12:39:25.643568+0000","last_unstale":"2023-08-09T12:39:27.499364+0000","last_undegraded":"2023-08-09T12:39:27.499364+0000","last_fullsized":"2023-08-09T12:39:27.499364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:35.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420714+0000","last_change":"2023-08-09T12:39:25.636008+0000","last_active":"2023-08-09T12:39:27.420714+0000","last_peered":"2023-08-09T12:39:27.420714+0000","last_clean":"2023-08-09T12:39:27.420714+0000","last_became_active":"2023-08-09T12:39:25.635696+0000","last_became_peered":"2023-08-09T12:39:25.635696+0000","last_unstale":"2023-08-09T12:39:27.420714+0000","last_undegraded":"2023-08-09T12:39:27.420714+0000","last_fullsized":"2023-08-09T12:39:27.420714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:31.607254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.497838+0000","last_change":"2023-08-09T12:39:25.642164+0000","last_active":"2023-08-09T12:39:27.497838+0000","last_peered":"2023-08-09T12:39:27.497838+0000","last_clean":"2023-08-09T12:39:27.497838+0000","last_became_active":"2023-08-09T12:39:25.641895+0000","last_became_peered":"2023-08-09T12:39:25.641895+0000","last_unstale":"2023-08-09T12:39:27.497838+0000","last_undegraded":"2023-08-09T12:39:27.497838+0000","last_fullsized":"2023-08-09T12:39:27.497838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:30.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420243+0000","last_change":"2023-08-09T12:39:25.637312+0000","last_active":"2023-08-09T12:39:27.420243+0000","last_peered":"2023-08-09T12:39:27.420243+0000","last_clean":"2023-08-09T12:39:27.420243+0000","last_became_active":"2023-08-09T12:39:25.636849+0000","last_became_peered":"2023-08-09T12:39:25.636849+0000","last_unstale":"2023-08-09T12:39:27.420243+0000","last_undegraded":"2023-08-09T12:39:27.420243+0000","last_fullsized":"2023-08-09T12:39:27.420243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:26.121156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359347+0000","last_change":"2023-08-09T12:39:25.650515+0000","last_active":"2023-08-09T12:39:29.359347+0000","last_peered":"2023-08-09T12:39:29.359347+0000","last_clean":"2023-08-09T12:39:29.359347+0000","last_became_active":"2023-08-09T12:39:25.649243+0000","last_became_peered":"2023-08-09T12:39:25.649243+0000","last_unstale":"2023-08-09T12:39:29.359347+0000","last_undegraded":"2023-08-09T12:39:29.359347+0000","last_fullsized":"2023-08-09T12:39:29.359347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:33.810328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613554+0000","last_change":"2023-08-09T12:39:25.634920+0000","last_active":"2023-08-09T12:39:26.613554+0000","last_peered":"2023-08-09T12:39:26.613554+0000","last_clean":"2023-08-09T12:39:26.613554+0000","last_became_active":"2023-08-09T12:39:25.634629+0000","last_became_peered":"2023-08-09T12:39:25.634629+0000","last_unstale":"2023-08-09T12:39:26.613554+0000","last_undegraded":"2023-08-09T12:39:26.613554+0000","last_fullsized":"2023-08-09T12:39:26.613554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:15.819900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613610+0000","last_change":"2023-08-09T12:39:25.633027+0000","last_active":"2023-08-09T12:39:26.613610+0000","last_peered":"2023-08-09T12:39:26.613610+0000","last_clean":"2023-08-09T12:39:26.613610+0000","last_became_active":"2023-08-09T12:39:25.632604+0000","last_became_peered":"2023-08-09T12:39:25.632604+0000","last_unstale":"2023-08-09T12:39:26.613610+0000","last_undegraded":"2023-08-09T12:39:26.613610+0000","last_fullsized":"2023-08-09T12:39:26.613610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420033+0000","last_change":"2023-08-09T12:39:25.639141+0000","last_active":"2023-08-09T12:39:27.420033+0000","last_peered":"2023-08-09T12:39:27.420033+0000","last_clean":"2023-08-09T12:39:27.420033+0000","last_became_active":"2023-08-09T12:39:25.638059+0000","last_became_peered":"2023-08-09T12:39:25.638059+0000","last_unstale":"2023-08-09T12:39:27.420033+0000","last_undegraded":"2023-08-09T12:39:27.420033+0000","last_fullsized":"2023-08-09T12:39:27.420033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498779+0000","last_change":"2023-08-09T12:39:25.652960+0000","last_active":"2023-08-09T12:39:27.498779+0000","last_peered":"2023-08-09T12:39:27.498779+0000","last_clean":"2023-08-09T12:39:27.498779+0000","last_became_active":"2023-08-09T12:39:25.652713+0000","last_became_peered":"2023-08-09T12:39:25.652713+0000","last_unstale":"2023-08-09T12:39:27.498779+0000","last_undegraded":"2023-08-09T12:39:27.498779+0000","last_fullsized":"2023-08-09T12:39:27.498779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359865+0000","last_change":"2023-08-09T12:39:25.649932+0000","last_active":"2023-08-09T12:39:29.359865+0000","last_peered":"2023-08-09T12:39:29.359865+0000","last_clean":"2023-08-09T12:39:29.359865+0000","last_became_active":"2023-08-09T12:39:25.645779+0000","last_became_peered":"2023-08-09T12:39:25.645779+0000","last_unstale":"2023-08-09T12:39:29.359865+0000","last_undegraded":"2023-08-09T12:39:29.359865+0000","last_fullsized":"2023-08-09T12:39:29.359865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:36:19.751633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.497822+0000","last_change":"2023-08-09T12:39:25.642272+0000","last_active":"2023-08-09T12:39:27.497822+0000","last_peered":"2023-08-09T12:39:27.497822+0000","last_clean":"2023-08-09T12:39:27.497822+0000","last_became_active":"2023-08-09T12:39:25.641857+0000","last_became_peered":"2023-08-09T12:39:25.641857+0000","last_unstale":"2023-08-09T12:39:27.497822+0000","last_undegraded":"2023-08-09T12:39:27.497822+0000","last_fullsized":"2023-08-09T12:39:27.497822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:56.516015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359004+0000","last_change":"2023-08-09T12:39:25.638050+0000","last_active":"2023-08-09T12:39:29.359004+0000","last_peered":"2023-08-09T12:39:29.359004+0000","last_clean":"2023-08-09T12:39:29.359004+0000","last_became_active":"2023-08-09T12:39:25.637427+0000","last_became_peered":"2023-08-09T12:39:25.637427+0000","last_unstale":"2023-08-09T12:39:29.359004+0000","last_undegraded":"2023-08-09T12:39:29.359004+0000","last_fullsized":"2023-08-09T12:39:29.359004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613553+0000","last_change":"2023-08-09T12:39:25.625546+0000","last_active":"2023-08-09T12:39:26.613553+0000","last_peered":"2023-08-09T12:39:26.613553+0000","last_clean":"2023-08-09T12:39:26.613553+0000","last_became_active":"2023-08-09T12:39:25.623517+0000","last_became_peered":"2023-08-09T12:39:25.623517+0000","last_unstale":"2023-08-09T12:39:26.613553+0000","last_undegraded":"2023-08-09T12:39:26.613553+0000","last_fullsized":"2023-08-09T12:39:26.613553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359010+0000","last_change":"2023-08-09T12:39:25.648778+0000","last_active":"2023-08-09T12:39:29.359010+0000","last_peered":"2023-08-09T12:39:29.359010+0000","last_clean":"2023-08-09T12:39:29.359010+0000","last_became_active":"2023-08-09T12:39:25.646303+0000","last_became_peered":"2023-08-09T12:39:25.646303+0000","last_unstale":"2023-08-09T12:39:29.359010+0000","last_undegraded":"2023-08-09T12:39:29.359010+0000","last_fullsized":"2023-08-09T12:39:29.359010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:29.784828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499367+0000","last_change":"2023-08-09T12:39:25.621729+0000","last_active":"2023-08-09T12:39:27.499367+0000","last_peered":"2023-08-09T12:39:27.499367+0000","last_clean":"2023-08-09T12:39:27.499367+0000","last_became_active":"2023-08-09T12:39:25.620974+0000","last_became_peered":"2023-08-09T12:39:25.620974+0000","last_unstale":"2023-08-09T12:39:27.499367+0000","last_undegraded":"2023-08-09T12:39:27.499367+0000","last_fullsized":"2023-08-09T12:39:27.499367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:37.239773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498260+0000","last_change":"2023-08-09T12:39:25.644455+0000","last_active":"2023-08-09T12:39:27.498260+0000","last_peered":"2023-08-09T12:39:27.498260+0000","last_clean":"2023-08-09T12:39:27.498260+0000","last_became_active":"2023-08-09T12:39:25.644178+0000","last_became_peered":"2023-08-09T12:39:25.644178+0000","last_unstale":"2023-08-09T12:39:27.498260+0000","last_undegraded":"2023-08-09T12:39:27.498260+0000","last_fullsized":"2023-08-09T12:39:27.498260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:33.221475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.614982+0000","last_change":"2023-08-09T12:39:25.638742+0000","last_active":"2023-08-09T12:39:26.614982+0000","last_peered":"2023-08-09T12:39:26.614982+0000","last_clean":"2023-08-09T12:39:26.614982+0000","last_became_active":"2023-08-09T12:39:25.638454+0000","last_became_peered":"2023-08-09T12:39:25.638454+0000","last_unstale":"2023-08-09T12:39:26.614982+0000","last_undegraded":"2023-08-09T12:39:26.614982+0000","last_fullsized":"2023-08-09T12:39:26.614982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:36.686027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499469+0000","last_change":"2023-08-09T12:39:25.623830+0000","last_active":"2023-08-09T12:39:27.499469+0000","last_peered":"2023-08-09T12:39:27.499469+0000","last_clean":"2023-08-09T12:39:27.499469+0000","last_became_active":"2023-08-09T12:39:25.623070+0000","last_became_peered":"2023-08-09T12:39:25.623070+0000","last_unstale":"2023-08-09T12:39:27.499469+0000","last_undegraded":"2023-08-09T12:39:27.499469+0000","last_fullsized":"2023-08-09T12:39:27.499469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:36:19.751633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409782+0000","last_change":"2023-08-09T12:39:25.652932+0000","last_active":"2023-08-09T12:39:27.409782+0000","last_peered":"2023-08-09T12:39:27.409782+0000","last_clean":"2023-08-09T12:39:27.409782+0000","last_became_active":"2023-08-09T12:39:25.651614+0000","last_became_peered":"2023-08-09T12:39:25.651614+0000","last_unstale":"2023-08-09T12:39:27.409782+0000","last_undegraded":"2023-08-09T12:39:27.409782+0000","last_fullsized":"2023-08-09T12:39:27.409782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409703+0000","last_change":"2023-08-09T12:39:25.644658+0000","last_active":"2023-08-09T12:39:27.409703+0000","last_peered":"2023-08-09T12:39:27.409703+0000","last_clean":"2023-08-09T12:39:27.409703+0000","last_became_active":"2023-08-09T12:39:25.643855+0000","last_became_peered":"2023-08-09T12:39:25.643855+0000","last_unstale":"2023-08-09T12:39:27.409703+0000","last_undegraded":"2023-08-09T12:39:27.409703+0000","last_fullsized":"2023-08-09T12:39:27.409703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420812+0000","last_change":"2023-08-09T12:39:25.640170+0000","last_active":"2023-08-09T12:39:27.420812+0000","last_peered":"2023-08-09T12:39:27.420812+0000","last_clean":"2023-08-09T12:39:27.420812+0000","last_became_active":"2023-08-09T12:39:25.639694+0000","last_became_peered":"2023-08-09T12:39:25.639694+0000","last_unstale":"2023-08-09T12:39:27.420812+0000","last_undegraded":"2023-08-09T12:39:27.420812+0000","last_fullsized":"2023-08-09T12:39:27.420812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:37.239773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410774+0000","last_change":"2023-08-09T12:39:25.642608+0000","last_active":"2023-08-09T12:39:27.410774+0000","last_peered":"2023-08-09T12:39:27.410774+0000","last_clean":"2023-08-09T12:39:27.410774+0000","last_became_active":"2023-08-09T12:39:25.637346+0000","last_became_peered":"2023-08-09T12:39:25.637346+0000","last_unstale":"2023-08-09T12:39:27.410774+0000","last_undegraded":"2023-08-09T12:39:27.410774+0000","last_fullsized":"2023-08-09T12:39:27.410774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:31.607254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615253+0000","last_change":"2023-08-09T12:39:25.640403+0000","last_active":"2023-08-09T12:39:26.615253+0000","last_peered":"2023-08-09T12:39:26.615253+0000","last_clean":"2023-08-09T12:39:26.615253+0000","last_became_active":"2023-08-09T12:39:25.635661+0000","last_became_peered":"2023-08-09T12:39:25.635661+0000","last_unstale":"2023-08-09T12:39:26.615253+0000","last_undegraded":"2023-08-09T12:39:26.615253+0000","last_fullsized":"2023-08-09T12:39:26.615253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:47.710010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359270+0000","last_change":"2023-08-09T12:39:25.646903+0000","last_active":"2023-08-09T12:39:29.359270+0000","last_peered":"2023-08-09T12:39:29.359270+0000","last_clean":"2023-08-09T12:39:29.359270+0000","last_became_active":"2023-08-09T12:39:25.645744+0000","last_became_peered":"2023-08-09T12:39:25.645744+0000","last_unstale":"2023-08-09T12:39:29.359270+0000","last_undegraded":"2023-08-09T12:39:29.359270+0000","last_fullsized":"2023-08-09T12:39:29.359270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:44.285538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615530+0000","last_change":"2023-08-09T12:39:25.645982+0000","last_active":"2023-08-09T12:39:26.615530+0000","last_peered":"2023-08-09T12:39:26.615530+0000","last_clean":"2023-08-09T12:39:26.615530+0000","last_became_active":"2023-08-09T12:39:25.645632+0000","last_became_peered":"2023-08-09T12:39:25.645632+0000","last_unstale":"2023-08-09T12:39:26.615530+0000","last_undegraded":"2023-08-09T12:39:26.615530+0000","last_fullsized":"2023-08-09T12:39:26.615530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616738+0000","last_change":"2023-08-09T12:39:25.632004+0000","last_active":"2023-08-09T12:39:26.616738+0000","last_peered":"2023-08-09T12:39:26.616738+0000","last_clean":"2023-08-09T12:39:26.616738+0000","last_became_active":"2023-08-09T12:39:25.631477+0000","last_became_peered":"2023-08-09T12:39:25.631477+0000","last_unstale":"2023-08-09T12:39:26.616738+0000","last_undegraded":"2023-08-09T12:39:26.616738+0000","last_fullsized":"2023-08-09T12:39:26.616738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615919+0000","last_change":"2023-08-09T12:39:25.641384+0000","last_active":"2023-08-09T12:39:26.615919+0000","last_peered":"2023-08-09T12:39:26.615919+0000","last_clean":"2023-08-09T12:39:26.615919+0000","last_became_active":"2023-08-09T12:39:25.640764+0000","last_became_peered":"2023-08-09T12:39:25.640764+0000","last_unstale":"2023-08-09T12:39:26.615919+0000","last_undegraded":"2023-08-09T12:39:26.615919+0000","last_fullsized":"2023-08-09T12:39:26.615919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:33.925265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499326+0000","last_change":"2023-08-09T12:39:24.640639+0000","last_active":"2023-08-09T12:39:27.499326+0000","last_peered":"2023-08-09T12:39:27.499326+0000","last_clean":"2023-08-09T12:39:27.499326+0000","last_became_active":"2023-08-09T12:39:24.640266+0000","last_became_peered":"2023-08-09T12:39:24.640266+0000","last_unstale":"2023-08-09T12:39:27.499326+0000","last_undegraded":"2023-08-09T12:39:27.499326+0000","last_fullsized":"2023-08-09T12:39:27.499326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:30.602392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.421062+0000","last_change":"2023-08-09T12:39:25.631972+0000","last_active":"2023-08-09T12:39:27.421062+0000","last_peered":"2023-08-09T12:39:27.421062+0000","last_clean":"2023-08-09T12:39:27.421062+0000","last_became_active":"2023-08-09T12:39:25.631386+0000","last_became_peered":"2023-08-09T12:39:25.631386+0000","last_unstale":"2023-08-09T12:39:27.421062+0000","last_undegraded":"2023-08-09T12:39:27.421062+0000","last_fullsized":"2023-08-09T12:39:27.421062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:36:19.751633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498727+0000","last_change":"2023-08-09T12:39:24.631980+0000","last_active":"2023-08-09T12:39:27.498727+0000","last_peered":"2023-08-09T12:39:27.498727+0000","last_clean":"2023-08-09T12:39:27.498727+0000","last_became_active":"2023-08-09T12:39:24.631321+0000","last_became_peered":"2023-08-09T12:39:24.631321+0000","last_unstale":"2023-08-09T12:39:27.498727+0000","last_undegraded":"2023-08-09T12:39:27.498727+0000","last_fullsized":"2023-08-09T12:39:27.498727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:43.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498612+0000","last_change":"2023-08-09T12:39:25.642115+0000","last_active":"2023-08-09T12:39:27.498612+0000","last_peered":"2023-08-09T12:39:27.498612+0000","last_clean":"2023-08-09T12:39:27.498612+0000","last_became_active":"2023-08-09T12:39:25.641510+0000","last_became_peered":"2023-08-09T12:39:25.641510+0000","last_unstale":"2023-08-09T12:39:27.498612+0000","last_undegraded":"2023-08-09T12:39:27.498612+0000","last_fullsized":"2023-08-09T12:39:27.498612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:26.121156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499878+0000","last_change":"2023-08-09T12:39:24.640562+0000","last_active":"2023-08-09T12:39:27.499878+0000","last_peered":"2023-08-09T12:39:27.499878+0000","last_clean":"2023-08-09T12:39:27.499878+0000","last_became_active":"2023-08-09T12:39:24.640227+0000","last_became_peered":"2023-08-09T12:39:24.640227+0000","last_unstale":"2023-08-09T12:39:27.499878+0000","last_undegraded":"2023-08-09T12:39:27.499878+0000","last_fullsized":"2023-08-09T12:39:27.499878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:42.623908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615401+0000","last_change":"2023-08-09T12:39:25.629884+0000","last_active":"2023-08-09T12:39:26.615401+0000","last_peered":"2023-08-09T12:39:26.615401+0000","last_clean":"2023-08-09T12:39:26.615401+0000","last_became_active":"2023-08-09T12:39:25.629153+0000","last_became_peered":"2023-08-09T12:39:25.629153+0000","last_unstale":"2023-08-09T12:39:26.615401+0000","last_undegraded":"2023-08-09T12:39:26.615401+0000","last_fullsized":"2023-08-09T12:39:26.615401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617036+0000","last_change":"2023-08-09T12:39:24.634685+0000","last_active":"2023-08-09T12:39:26.617036+0000","last_peered":"2023-08-09T12:39:26.617036+0000","last_clean":"2023-08-09T12:39:26.617036+0000","last_became_active":"2023-08-09T12:39:24.634383+0000","last_became_peered":"2023-08-09T12:39:24.634383+0000","last_unstale":"2023-08-09T12:39:26.617036+0000","last_undegraded":"2023-08-09T12:39:26.617036+0000","last_fullsized":"2023-08-09T12:39:26.617036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499828+0000","last_change":"2023-08-09T12:39:24.641613+0000","last_active":"2023-08-09T12:39:27.499828+0000","last_peered":"2023-08-09T12:39:27.499828+0000","last_clean":"2023-08-09T12:39:27.499828+0000","last_became_active":"2023-08-09T12:39:24.641213+0000","last_became_peered":"2023-08-09T12:39:24.641213+0000","last_unstale":"2023-08-09T12:39:27.499828+0000","last_undegraded":"2023-08-09T12:39:27.499828+0000","last_fullsized":"2023-08-09T12:39:27.499828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:59:09.967517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420450+0000","last_change":"2023-08-09T12:39:25.634677+0000","last_active":"2023-08-09T12:39:27.420450+0000","last_peered":"2023-08-09T12:39:27.420450+0000","last_clean":"2023-08-09T12:39:27.420450+0000","last_became_active":"2023-08-09T12:39:25.634264+0000","last_became_peered":"2023-08-09T12:39:25.634264+0000","last_unstale":"2023-08-09T12:39:27.420450+0000","last_undegraded":"2023-08-09T12:39:27.420450+0000","last_fullsized":"2023-08-09T12:39:27.420450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:33.810328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499541+0000","last_change":"2023-08-09T12:39:24.641554+0000","last_active":"2023-08-09T12:39:27.499541+0000","last_peered":"2023-08-09T12:39:27.499541+0000","last_clean":"2023-08-09T12:39:27.499541+0000","last_became_active":"2023-08-09T12:39:24.641197+0000","last_became_peered":"2023-08-09T12:39:24.641197+0000","last_unstale":"2023-08-09T12:39:27.499541+0000","last_undegraded":"2023-08-09T12:39:27.499541+0000","last_fullsized":"2023-08-09T12:39:27.499541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:52:28.419385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359647+0000","last_change":"2023-08-09T12:39:25.659204+0000","last_active":"2023-08-09T12:39:29.359647+0000","last_peered":"2023-08-09T12:39:29.359647+0000","last_clean":"2023-08-09T12:39:29.359647+0000","last_became_active":"2023-08-09T12:39:25.657091+0000","last_became_peered":"2023-08-09T12:39:25.657091+0000","last_unstale":"2023-08-09T12:39:29.359647+0000","last_undegraded":"2023-08-09T12:39:29.359647+0000","last_fullsized":"2023-08-09T12:39:29.359647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:37.239773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499719+0000","last_change":"2023-08-09T12:39:24.628533+0000","last_active":"2023-08-09T12:39:27.499719+0000","last_peered":"2023-08-09T12:39:27.499719+0000","last_clean":"2023-08-09T12:39:27.499719+0000","last_became_active":"2023-08-09T12:39:24.628153+0000","last_became_peered":"2023-08-09T12:39:24.628153+0000","last_unstale":"2023-08-09T12:39:27.499719+0000","last_undegraded":"2023-08-09T12:39:27.499719+0000","last_fullsized":"2023-08-09T12:39:27.499719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:47.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617326+0000","last_change":"2023-08-09T12:39:25.638917+0000","last_active":"2023-08-09T12:39:26.617326+0000","last_peered":"2023-08-09T12:39:26.617326+0000","last_clean":"2023-08-09T12:39:26.617326+0000","last_became_active":"2023-08-09T12:39:25.638612+0000","last_became_peered":"2023-08-09T12:39:25.638612+0000","last_unstale":"2023-08-09T12:39:26.617326+0000","last_undegraded":"2023-08-09T12:39:26.617326+0000","last_fullsized":"2023-08-09T12:39:26.617326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.421229+0000","last_change":"2023-08-09T12:39:24.634717+0000","last_active":"2023-08-09T12:39:27.421229+0000","last_peered":"2023-08-09T12:39:27.421229+0000","last_clean":"2023-08-09T12:39:27.421229+0000","last_became_active":"2023-08-09T12:39:24.634225+0000","last_became_peered":"2023-08-09T12:39:24.634225+0000","last_unstale":"2023-08-09T12:39:27.421229+0000","last_undegraded":"2023-08-09T12:39:27.421229+0000","last_fullsized":"2023-08-09T12:39:27.421229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:52:28.419385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498949+0000","last_change":"2023-08-09T12:39:25.645761+0000","last_active":"2023-08-09T12:39:27.498949+0000","last_peered":"2023-08-09T12:39:27.498949+0000","last_clean":"2023-08-09T12:39:27.498949+0000","last_became_active":"2023-08-09T12:39:25.645313+0000","last_became_peered":"2023-08-09T12:39:25.645313+0000","last_unstale":"2023-08-09T12:39:27.498949+0000","last_undegraded":"2023-08-09T12:39:27.498949+0000","last_fullsized":"2023-08-09T12:39:27.498949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:48.378100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615527+0000","last_change":"2023-08-09T12:39:24.636912+0000","last_active":"2023-08-09T12:39:26.615527+0000","last_peered":"2023-08-09T12:39:26.615527+0000","last_clean":"2023-08-09T12:39:26.615527+0000","last_became_active":"2023-08-09T12:39:24.636156+0000","last_became_peered":"2023-08-09T12:39:24.636156+0000","last_unstale":"2023-08-09T12:39:26.615527+0000","last_undegraded":"2023-08-09T12:39:26.615527+0000","last_fullsized":"2023-08-09T12:39:26.615527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.358948+0000","last_change":"2023-08-09T12:39:25.646628+0000","last_active":"2023-08-09T12:39:29.358948+0000","last_peered":"2023-08-09T12:39:29.358948+0000","last_clean":"2023-08-09T12:39:29.358948+0000","last_became_active":"2023-08-09T12:39:25.646139+0000","last_became_peered":"2023-08-09T12:39:25.646139+0000","last_unstale":"2023-08-09T12:39:29.358948+0000","last_undegraded":"2023-08-09T12:39:29.358948+0000","last_fullsized":"2023-08-09T12:39:29.358948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617710+0000","last_change":"2023-08-09T12:39:24.632474+0000","last_active":"2023-08-09T12:39:26.617710+0000","last_peered":"2023-08-09T12:39:26.617710+0000","last_clean":"2023-08-09T12:39:26.617710+0000","last_became_active":"2023-08-09T12:39:24.631809+0000","last_became_peered":"2023-08-09T12:39:24.631809+0000","last_unstale":"2023-08-09T12:39:26.617710+0000","last_undegraded":"2023-08-09T12:39:26.617710+0000","last_fullsized":"2023-08-09T12:39:26.617710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:35.681165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359576+0000","last_change":"2023-08-09T12:39:25.649637+0000","last_active":"2023-08-09T12:39:29.359576+0000","last_peered":"2023-08-09T12:39:29.359576+0000","last_clean":"2023-08-09T12:39:29.359576+0000","last_became_active":"2023-08-09T12:39:25.644325+0000","last_became_peered":"2023-08-09T12:39:25.644325+0000","last_unstale":"2023-08-09T12:39:29.359576+0000","last_undegraded":"2023-08-09T12:39:29.359576+0000","last_fullsized":"2023-08-09T12:39:29.359576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:31.607254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360488+0000","last_change":"2023-08-09T12:39:24.629489+0000","last_active":"2023-08-09T12:39:29.360488+0000","last_peered":"2023-08-09T12:39:29.360488+0000","last_clean":"2023-08-09T12:39:29.360488+0000","last_became_active":"2023-08-09T12:39:24.629107+0000","last_became_peered":"2023-08-09T12:39:24.629107+0000","last_unstale":"2023-08-09T12:39:29.360488+0000","last_undegraded":"2023-08-09T12:39:29.360488+0000","last_fullsized":"2023-08-09T12:39:29.360488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:11.053446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360333+0000","last_change":"2023-08-09T12:39:25.638108+0000","last_active":"2023-08-09T12:39:29.360333+0000","last_peered":"2023-08-09T12:39:29.360333+0000","last_clean":"2023-08-09T12:39:29.360333+0000","last_became_active":"2023-08-09T12:39:25.636796+0000","last_became_peered":"2023-08-09T12:39:25.636796+0000","last_unstale":"2023-08-09T12:39:29.360333+0000","last_undegraded":"2023-08-09T12:39:29.360333+0000","last_fullsized":"2023-08-09T12:39:29.360333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:43.628770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615617+0000","last_change":"2023-08-09T12:39:24.628803+0000","last_active":"2023-08-09T12:39:26.615617+0000","last_peered":"2023-08-09T12:39:26.615617+0000","last_clean":"2023-08-09T12:39:26.615617+0000","last_became_active":"2023-08-09T12:39:24.628410+0000","last_became_peered":"2023-08-09T12:39:24.628410+0000","last_unstale":"2023-08-09T12:39:26.615617+0000","last_undegraded":"2023-08-09T12:39:26.615617+0000","last_fullsized":"2023-08-09T12:39:26.615617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:32.805465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409467+0000","last_change":"2023-08-09T12:39:25.643385+0000","last_active":"2023-08-09T12:39:27.409467+0000","last_peered":"2023-08-09T12:39:27.409467+0000","last_clean":"2023-08-09T12:39:27.409467+0000","last_became_active":"2023-08-09T12:39:25.643109+0000","last_became_peered":"2023-08-09T12:39:25.643109+0000","last_unstale":"2023-08-09T12:39:27.409467+0000","last_undegraded":"2023-08-09T12:39:27.409467+0000","last_fullsized":"2023-08-09T12:39:27.409467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:33.221475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.500731+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:39:27.500731+0000","last_peered":"2023-08-09T12:39:27.500731+0000","last_clean":"2023-08-09T12:39:27.500731+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:39:27.500731+0000","last_undegraded":"2023-08-09T12:39:27.500731+0000","last_fullsized":"2023-08-09T12:39:27.500731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:59:37.389325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.419903+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:39:27.419903+0000","last_peered":"2023-08-09T12:39:27.419903+0000","last_clean":"2023-08-09T12:39:27.419903+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:39:27.419903+0000","last_undegraded":"2023-08-09T12:39:27.419903+0000","last_fullsized":"2023-08-09T12:39:27.419903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:23.448966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615676+0000","last_change":"2023-08-09T12:39:24.635989+0000","last_active":"2023-08-09T12:39:26.615676+0000","last_peered":"2023-08-09T12:39:26.615676+0000","last_clean":"2023-08-09T12:39:26.615676+0000","last_became_active":"2023-08-09T12:39:24.635506+0000","last_became_peered":"2023-08-09T12:39:24.635506+0000","last_unstale":"2023-08-09T12:39:26.615676+0000","last_undegraded":"2023-08-09T12:39:26.615676+0000","last_fullsized":"2023-08-09T12:39:26.615676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:47.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617544+0000","last_change":"2023-08-09T12:39:25.637598+0000","last_active":"2023-08-09T12:39:26.617544+0000","last_peered":"2023-08-09T12:39:26.617544+0000","last_clean":"2023-08-09T12:39:26.617544+0000","last_became_active":"2023-08-09T12:39:25.637286+0000","last_became_peered":"2023-08-09T12:39:25.637286+0000","last_unstale":"2023-08-09T12:39:26.617544+0000","last_undegraded":"2023-08-09T12:39:26.617544+0000","last_fullsized":"2023-08-09T12:39:26.617544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.500435+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:39:27.500435+0000","last_peered":"2023-08-09T12:39:27.500435+0000","last_clean":"2023-08-09T12:39:27.500435+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:39:27.500435+0000","last_undegraded":"2023-08-09T12:39:27.500435+0000","last_fullsized":"2023-08-09T12:39:27.500435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:38:32.670551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499660+0000","last_change":"2023-08-09T12:39:24.636357+0000","last_active":"2023-08-09T12:39:27.499660+0000","last_peered":"2023-08-09T12:39:27.499660+0000","last_clean":"2023-08-09T12:39:27.499660+0000","last_became_active":"2023-08-09T12:39:24.634441+0000","last_became_peered":"2023-08-09T12:39:24.634441+0000","last_unstale":"2023-08-09T12:39:27.499660+0000","last_undegraded":"2023-08-09T12:39:27.499660+0000","last_fullsized":"2023-08-09T12:39:27.499660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:30.602392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499261+0000","last_change":"2023-08-09T12:39:25.645605+0000","last_active":"2023-08-09T12:39:27.499261+0000","last_peered":"2023-08-09T12:39:27.499261+0000","last_clean":"2023-08-09T12:39:27.499261+0000","last_became_active":"2023-08-09T12:39:25.644989+0000","last_became_peered":"2023-08-09T12:39:25.644989+0000","last_unstale":"2023-08-09T12:39:27.499261+0000","last_undegraded":"2023-08-09T12:39:27.499261+0000","last_fullsized":"2023-08-09T12:39:27.499261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613725+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:39:26.613725+0000","last_peered":"2023-08-09T12:39:26.613725+0000","last_clean":"2023-08-09T12:39:26.613725+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:39:26.613725+0000","last_undegraded":"2023-08-09T12:39:26.613725+0000","last_fullsized":"2023-08-09T12:39:26.613725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:46.297345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410523+0000","last_change":"2023-08-09T12:39:24.623190+0000","last_active":"2023-08-09T12:39:27.410523+0000","last_peered":"2023-08-09T12:39:27.410523+0000","last_clean":"2023-08-09T12:39:27.410523+0000","last_became_active":"2023-08-09T12:39:24.622946+0000","last_became_peered":"2023-08-09T12:39:24.622946+0000","last_unstale":"2023-08-09T12:39:27.410523+0000","last_undegraded":"2023-08-09T12:39:27.410523+0000","last_fullsized":"2023-08-09T12:39:27.410523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:47.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409926+0000","last_change":"2023-08-09T12:39:25.656984+0000","last_active":"2023-08-09T12:39:27.409926+0000","last_peered":"2023-08-09T12:39:27.409926+0000","last_clean":"2023-08-09T12:39:27.409926+0000","last_became_active":"2023-08-09T12:39:25.651565+0000","last_became_peered":"2023-08-09T12:39:25.651565+0000","last_unstale":"2023-08-09T12:39:27.409926+0000","last_undegraded":"2023-08-09T12:39:27.409926+0000","last_fullsized":"2023-08-09T12:39:27.409926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.421375+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:39:27.421375+0000","last_peered":"2023-08-09T12:39:27.421375+0000","last_clean":"2023-08-09T12:39:27.421375+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:39:27.421375+0000","last_undegraded":"2023-08-09T12:39:27.421375+0000","last_fullsized":"2023-08-09T12:39:27.421375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:42.504678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360038+0000","last_change":"2023-08-09T12:39:24.633725+0000","last_active":"2023-08-09T12:39:29.360038+0000","last_peered":"2023-08-09T12:39:29.360038+0000","last_clean":"2023-08-09T12:39:29.360038+0000","last_became_active":"2023-08-09T12:39:24.633401+0000","last_became_peered":"2023-08-09T12:39:24.633401+0000","last_unstale":"2023-08-09T12:39:29.360038+0000","last_undegraded":"2023-08-09T12:39:29.360038+0000","last_fullsized":"2023-08-09T12:39:29.360038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:52:28.419385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410252+0000","last_change":"2023-08-09T12:39:25.652044+0000","last_active":"2023-08-09T12:39:27.410252+0000","last_peered":"2023-08-09T12:39:27.410252+0000","last_clean":"2023-08-09T12:39:27.410252+0000","last_became_active":"2023-08-09T12:39:25.646950+0000","last_became_peered":"2023-08-09T12:39:25.646950+0000","last_unstale":"2023-08-09T12:39:27.410252+0000","last_undegraded":"2023-08-09T12:39:27.410252+0000","last_fullsized":"2023-08-09T12:39:27.410252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:44.285538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420435+0000","last_change":"2023-08-09T12:39:24.629351+0000","last_active":"2023-08-09T12:39:27.420435+0000","last_peered":"2023-08-09T12:39:27.420435+0000","last_clean":"2023-08-09T12:39:27.420435+0000","last_became_active":"2023-08-09T12:39:24.628605+0000","last_became_peered":"2023-08-09T12:39:24.628605+0000","last_unstale":"2023-08-09T12:39:27.420435+0000","last_undegraded":"2023-08-09T12:39:27.420435+0000","last_fullsized":"2023-08-09T12:39:27.420435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:47.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410628+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:39:27.410628+0000","last_peered":"2023-08-09T12:39:27.410628+0000","last_clean":"2023-08-09T12:39:27.410628+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:39:27.410628+0000","last_undegraded":"2023-08-09T12:39:27.410628+0000","last_fullsized":"2023-08-09T12:39:27.410628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:35.938410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410642+0000","last_change":"2023-08-09T12:39:25.656505+0000","last_active":"2023-08-09T12:39:27.410642+0000","last_peered":"2023-08-09T12:39:27.410642+0000","last_clean":"2023-08-09T12:39:27.410642+0000","last_became_active":"2023-08-09T12:39:25.651066+0000","last_became_peered":"2023-08-09T12:39:25.651066+0000","last_unstale":"2023-08-09T12:39:27.410642+0000","last_undegraded":"2023-08-09T12:39:27.410642+0000","last_fullsized":"2023-08-09T12:39:27.410642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:33.925265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410464+0000","last_change":"2023-08-09T12:39:24.624402+0000","last_active":"2023-08-09T12:39:27.410464+0000","last_peered":"2023-08-09T12:39:27.410464+0000","last_clean":"2023-08-09T12:39:27.410464+0000","last_became_active":"2023-08-09T12:39:24.623543+0000","last_became_peered":"2023-08-09T12:39:24.623543+0000","last_unstale":"2023-08-09T12:39:27.410464+0000","last_undegraded":"2023-08-09T12:39:27.410464+0000","last_fullsized":"2023-08-09T12:39:27.410464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:32.805465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.500160+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:39:27.500160+0000","last_peered":"2023-08-09T12:39:27.500160+0000","last_clean":"2023-08-09T12:39:27.500160+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:39:27.500160+0000","last_undegraded":"2023-08-09T12:39:27.500160+0000","last_fullsized":"2023-08-09T12:39:27.500160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:05.722446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498354+0000","last_change":"2023-08-09T12:39:25.637151+0000","last_active":"2023-08-09T12:39:27.498354+0000","last_peered":"2023-08-09T12:39:27.498354+0000","last_clean":"2023-08-09T12:39:27.498354+0000","last_became_active":"2023-08-09T12:39:25.636899+0000","last_became_peered":"2023-08-09T12:39:25.636899+0000","last_unstale":"2023-08-09T12:39:27.498354+0000","last_undegraded":"2023-08-09T12:39:27.498354+0000","last_fullsized":"2023-08-09T12:39:27.498354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615546+0000","last_change":"2023-08-09T12:39:24.628972+0000","last_active":"2023-08-09T12:39:26.615546+0000","last_peered":"2023-08-09T12:39:26.615546+0000","last_clean":"2023-08-09T12:39:26.615546+0000","last_became_active":"2023-08-09T12:39:24.628110+0000","last_became_peered":"2023-08-09T12:39:24.628110+0000","last_unstale":"2023-08-09T12:39:26.615546+0000","last_undegraded":"2023-08-09T12:39:26.615546+0000","last_fullsized":"2023-08-09T12:39:26.615546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:25.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409144+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:39:27.409144+0000","last_peered":"2023-08-09T12:39:27.409144+0000","last_clean":"2023-08-09T12:39:27.409144+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:39:27.409144+0000","last_undegraded":"2023-08-09T12:39:27.409144+0000","last_fullsized":"2023-08-09T12:39:27.409144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:41.374148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615554+0000","last_change":"2023-08-09T12:39:25.641020+0000","last_active":"2023-08-09T12:39:26.615554+0000","last_peered":"2023-08-09T12:39:26.615554+0000","last_clean":"2023-08-09T12:39:26.615554+0000","last_became_active":"2023-08-09T12:39:25.638752+0000","last_became_peered":"2023-08-09T12:39:25.638752+0000","last_unstale":"2023-08-09T12:39:26.615554+0000","last_undegraded":"2023-08-09T12:39:26.615554+0000","last_fullsized":"2023-08-09T12:39:26.615554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:44.285538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498690+0000","last_change":"2023-08-09T12:39:24.636769+0000","last_active":"2023-08-09T12:39:27.498690+0000","last_peered":"2023-08-09T12:39:27.498690+0000","last_clean":"2023-08-09T12:39:27.498690+0000","last_became_active":"2023-08-09T12:39:24.635218+0000","last_became_peered":"2023-08-09T12:39:24.635218+0000","last_unstale":"2023-08-09T12:39:27.498690+0000","last_undegraded":"2023-08-09T12:39:27.498690+0000","last_fullsized":"2023-08-09T12:39:27.498690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:06.988459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616980+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:39:26.616980+0000","last_peered":"2023-08-09T12:39:26.616980+0000","last_clean":"2023-08-09T12:39:26.616980+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:39:26.616980+0000","last_undegraded":"2023-08-09T12:39:26.616980+0000","last_fullsized":"2023-08-09T12:39:26.616980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:15.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360134+0000","last_change":"2023-08-09T12:39:25.634557+0000","last_active":"2023-08-09T12:39:29.360134+0000","last_peered":"2023-08-09T12:39:29.360134+0000","last_clean":"2023-08-09T12:39:29.360134+0000","last_became_active":"2023-08-09T12:39:25.633799+0000","last_became_peered":"2023-08-09T12:39:25.633799+0000","last_unstale":"2023-08-09T12:39:29.360134+0000","last_undegraded":"2023-08-09T12:39:29.360134+0000","last_fullsized":"2023-08-09T12:39:29.360134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:59:10.972380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360149+0000","last_change":"2023-08-09T12:39:25.643842+0000","last_active":"2023-08-09T12:39:29.360149+0000","last_peered":"2023-08-09T12:39:29.360149+0000","last_clean":"2023-08-09T12:39:29.360149+0000","last_became_active":"2023-08-09T12:39:25.637275+0000","last_became_peered":"2023-08-09T12:39:25.637275+0000","last_unstale":"2023-08-09T12:39:29.360149+0000","last_undegraded":"2023-08-09T12:39:29.360149+0000","last_fullsized":"2023-08-09T12:39:29.360149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:48.840541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359195+0000","last_change":"2023-08-09T12:39:24.640696+0000","last_active":"2023-08-09T12:39:29.359195+0000","last_peered":"2023-08-09T12:39:29.359195+0000","last_clean":"2023-08-09T12:39:29.359195+0000","last_became_active":"2023-08-09T12:39:24.640413+0000","last_became_peered":"2023-08-09T12:39:24.640413+0000","last_unstale":"2023-08-09T12:39:29.359195+0000","last_undegraded":"2023-08-09T12:39:29.359195+0000","last_fullsized":"2023-08-09T12:39:29.359195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:25.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410185+0000","last_change":"2023-08-09T12:39:25.644428+0000","last_active":"2023-08-09T12:39:27.410185+0000","last_peered":"2023-08-09T12:39:27.410185+0000","last_clean":"2023-08-09T12:39:27.410185+0000","last_became_active":"2023-08-09T12:39:25.643285+0000","last_became_peered":"2023-08-09T12:39:25.643285+0000","last_unstale":"2023-08-09T12:39:27.410185+0000","last_undegraded":"2023-08-09T12:39:27.410185+0000","last_fullsized":"2023-08-09T12:39:27.410185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:26.121156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499161+0000","last_change":"2023-08-09T12:39:24.637201+0000","last_active":"2023-08-09T12:39:27.499161+0000","last_peered":"2023-08-09T12:39:27.499161+0000","last_clean":"2023-08-09T12:39:27.499161+0000","last_became_active":"2023-08-09T12:39:24.636809+0000","last_became_peered":"2023-08-09T12:39:24.636809+0000","last_unstale":"2023-08-09T12:39:27.499161+0000","last_undegraded":"2023-08-09T12:39:27.499161+0000","last_fullsized":"2023-08-09T12:39:27.499161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.421054+0000","last_change":"2023-08-09T12:39:24.632390+0000","last_active":"2023-08-09T12:39:27.421054+0000","last_peered":"2023-08-09T12:39:27.421054+0000","last_clean":"2023-08-09T12:39:27.421054+0000","last_became_active":"2023-08-09T12:39:24.631880+0000","last_became_peered":"2023-08-09T12:39:24.631880+0000","last_unstale":"2023-08-09T12:39:27.421054+0000","last_undegraded":"2023-08-09T12:39:27.421054+0000","last_fullsized":"2023-08-09T12:39:27.421054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:34.743508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615322+0000","last_change":"2023-08-09T12:39:25.622421+0000","last_active":"2023-08-09T12:39:26.615322+0000","last_peered":"2023-08-09T12:39:26.615322+0000","last_clean":"2023-08-09T12:39:26.615322+0000","last_became_active":"2023-08-09T12:39:25.621727+0000","last_became_peered":"2023-08-09T12:39:25.621727+0000","last_unstale":"2023-08-09T12:39:26.615322+0000","last_undegraded":"2023-08-09T12:39:26.615322+0000","last_fullsized":"2023-08-09T12:39:26.615322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498554+0000","last_change":"2023-08-09T12:39:24.632830+0000","last_active":"2023-08-09T12:39:27.498554+0000","last_peered":"2023-08-09T12:39:27.498554+0000","last_clean":"2023-08-09T12:39:27.498554+0000","last_became_active":"2023-08-09T12:39:24.631677+0000","last_became_peered":"2023-08-09T12:39:24.631677+0000","last_unstale":"2023-08-09T12:39:27.498554+0000","last_undegraded":"2023-08-09T12:39:27.498554+0000","last_fullsized":"2023-08-09T12:39:27.498554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615307+0000","last_change":"2023-08-09T12:39:25.638155+0000","last_active":"2023-08-09T12:39:26.615307+0000","last_peered":"2023-08-09T12:39:26.615307+0000","last_clean":"2023-08-09T12:39:26.615307+0000","last_became_active":"2023-08-09T12:39:25.635955+0000","last_became_peered":"2023-08-09T12:39:25.635955+0000","last_unstale":"2023-08-09T12:39:26.615307+0000","last_undegraded":"2023-08-09T12:39:26.615307+0000","last_fullsized":"2023-08-09T12:39:26.615307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:33.221475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616702+0000","last_change":"2023-08-09T12:39:25.630728+0000","last_active":"2023-08-09T12:39:26.616702+0000","last_peered":"2023-08-09T12:39:26.616702+0000","last_clean":"2023-08-09T12:39:26.616702+0000","last_became_active":"2023-08-09T12:39:25.630222+0000","last_became_peered":"2023-08-09T12:39:25.630222+0000","last_unstale":"2023-08-09T12:39:26.616702+0000","last_undegraded":"2023-08-09T12:39:26.616702+0000","last_fullsized":"2023-08-09T12:39:26.616702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615209+0000","last_change":"2023-08-09T12:39:24.631880+0000","last_active":"2023-08-09T12:39:26.615209+0000","last_peered":"2023-08-09T12:39:26.615209+0000","last_clean":"2023-08-09T12:39:26.615209+0000","last_became_active":"2023-08-09T12:39:24.631638+0000","last_became_peered":"2023-08-09T12:39:24.631638+0000","last_unstale":"2023-08-09T12:39:26.615209+0000","last_undegraded":"2023-08-09T12:39:26.615209+0000","last_fullsized":"2023-08-09T12:39:26.615209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:55.511153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498112+0000","last_change":"2023-08-09T12:39:25.635263+0000","last_active":"2023-08-09T12:39:27.498112+0000","last_peered":"2023-08-09T12:39:27.498112+0000","last_clean":"2023-08-09T12:39:27.498112+0000","last_became_active":"2023-08-09T12:39:25.634710+0000","last_became_peered":"2023-08-09T12:39:25.634710+0000","last_unstale":"2023-08-09T12:39:27.498112+0000","last_undegraded":"2023-08-09T12:39:27.498112+0000","last_fullsized":"2023-08-09T12:39:27.498112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:47.710010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409836+0000","last_change":"2023-08-09T12:39:24.633355+0000","last_active":"2023-08-09T12:39:27.409836+0000","last_peered":"2023-08-09T12:39:27.409836+0000","last_clean":"2023-08-09T12:39:27.409836+0000","last_became_active":"2023-08-09T12:39:24.633106+0000","last_became_peered":"2023-08-09T12:39:24.633106+0000","last_unstale":"2023-08-09T12:39:27.409836+0000","last_undegraded":"2023-08-09T12:39:27.409836+0000","last_fullsized":"2023-08-09T12:39:27.409836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615076+0000","last_change":"2023-08-09T12:39:25.652713+0000","last_active":"2023-08-09T12:39:26.615076+0000","last_peered":"2023-08-09T12:39:26.615076+0000","last_clean":"2023-08-09T12:39:26.615076+0000","last_became_active":"2023-08-09T12:39:25.652458+0000","last_became_peered":"2023-08-09T12:39:25.652458+0000","last_unstale":"2023-08-09T12:39:26.615076+0000","last_undegraded":"2023-08-09T12:39:26.615076+0000","last_fullsized":"2023-08-09T12:39:26.615076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:30.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360627+0000","last_change":"2023-08-09T12:39:24.628762+0000","last_active":"2023-08-09T12:39:29.360627+0000","last_peered":"2023-08-09T12:39:29.360627+0000","last_clean":"2023-08-09T12:39:29.360627+0000","last_became_active":"2023-08-09T12:39:24.628281+0000","last_became_peered":"2023-08-09T12:39:24.628281+0000","last_unstale":"2023-08-09T12:39:29.360627+0000","last_undegraded":"2023-08-09T12:39:29.360627+0000","last_fullsized":"2023-08-09T12:39:29.360627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:38:38.001551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613808+0000","last_change":"2023-08-09T12:39:25.643729+0000","last_active":"2023-08-09T12:39:26.613808+0000","last_peered":"2023-08-09T12:39:26.613808+0000","last_clean":"2023-08-09T12:39:26.613808+0000","last_became_active":"2023-08-09T12:39:25.643482+0000","last_became_peered":"2023-08-09T12:39:25.643482+0000","last_unstale":"2023-08-09T12:39:26.613808+0000","last_undegraded":"2023-08-09T12:39:26.613808+0000","last_fullsized":"2023-08-09T12:39:26.613808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498943+0000","last_change":"2023-08-09T12:39:24.632751+0000","last_active":"2023-08-09T12:39:27.498943+0000","last_peered":"2023-08-09T12:39:27.498943+0000","last_clean":"2023-08-09T12:39:27.498943+0000","last_became_active":"2023-08-09T12:39:24.632458+0000","last_became_peered":"2023-08-09T12:39:24.632458+0000","last_unstale":"2023-08-09T12:39:27.498943+0000","last_undegraded":"2023-08-09T12:39:27.498943+0000","last_fullsized":"2023-08-09T12:39:27.498943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:32.805465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359374+0000","last_change":"2023-08-09T12:39:25.646421+0000","last_active":"2023-08-09T12:39:29.359374+0000","last_peered":"2023-08-09T12:39:29.359374+0000","last_clean":"2023-08-09T12:39:29.359374+0000","last_became_active":"2023-08-09T12:39:25.645698+0000","last_became_peered":"2023-08-09T12:39:25.645698+0000","last_unstale":"2023-08-09T12:39:29.359374+0000","last_undegraded":"2023-08-09T12:39:29.359374+0000","last_fullsized":"2023-08-09T12:39:29.359374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:48.378100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420675+0000","last_change":"2023-08-09T12:39:24.631472+0000","last_active":"2023-08-09T12:39:27.420675+0000","last_peered":"2023-08-09T12:39:27.420675+0000","last_clean":"2023-08-09T12:39:27.420675+0000","last_became_active":"2023-08-09T12:39:24.631123+0000","last_became_peered":"2023-08-09T12:39:24.631123+0000","last_unstale":"2023-08-09T12:39:27.420675+0000","last_undegraded":"2023-08-09T12:39:27.420675+0000","last_fullsized":"2023-08-09T12:39:27.420675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359437+0000","last_change":"2023-08-09T12:39:25.634781+0000","last_active":"2023-08-09T12:39:29.359437+0000","last_peered":"2023-08-09T12:39:29.359437+0000","last_clean":"2023-08-09T12:39:29.359437+0000","last_became_active":"2023-08-09T12:39:25.634211+0000","last_became_peered":"2023-08-09T12:39:25.634211+0000","last_unstale":"2023-08-09T12:39:29.359437+0000","last_undegraded":"2023-08-09T12:39:29.359437+0000","last_fullsized":"2023-08-09T12:39:29.359437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:33.925265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420462+0000","last_change":"2023-08-09T12:39:24.631252+0000","last_active":"2023-08-09T12:39:27.420462+0000","last_peered":"2023-08-09T12:39:27.420462+0000","last_clean":"2023-08-09T12:39:27.420462+0000","last_became_active":"2023-08-09T12:39:24.630940+0000","last_became_peered":"2023-08-09T12:39:24.630940+0000","last_unstale":"2023-08-09T12:39:27.420462+0000","last_undegraded":"2023-08-09T12:39:27.420462+0000","last_fullsized":"2023-08-09T12:39:27.420462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:43.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615783+0000","last_change":"2023-08-09T12:39:25.640158+0000","last_active":"2023-08-09T12:39:26.615783+0000","last_peered":"2023-08-09T12:39:26.615783+0000","last_clean":"2023-08-09T12:39:26.615783+0000","last_became_active":"2023-08-09T12:39:25.633644+0000","last_became_peered":"2023-08-09T12:39:25.633644+0000","last_unstale":"2023-08-09T12:39:26.615783+0000","last_undegraded":"2023-08-09T12:39:26.615783+0000","last_fullsized":"2023-08-09T12:39:26.615783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616014+0000","last_change":"2023-08-09T12:39:24.625994+0000","last_active":"2023-08-09T12:39:26.616014+0000","last_peered":"2023-08-09T12:39:26.616014+0000","last_clean":"2023-08-09T12:39:26.616014+0000","last_became_active":"2023-08-09T12:39:24.624612+0000","last_became_peered":"2023-08-09T12:39:24.624612+0000","last_unstale":"2023-08-09T12:39:26.616014+0000","last_undegraded":"2023-08-09T12:39:26.616014+0000","last_fullsized":"2023-08-09T12:39:26.616014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:30.602392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359468+0000","last_change":"2023-08-09T12:39:25.646605+0000","last_active":"2023-08-09T12:39:29.359468+0000","last_peered":"2023-08-09T12:39:29.359468+0000","last_clean":"2023-08-09T12:39:29.359468+0000","last_became_active":"2023-08-09T12:39:25.644813+0000","last_became_peered":"2023-08-09T12:39:25.644813+0000","last_unstale":"2023-08-09T12:39:29.359468+0000","last_undegraded":"2023-08-09T12:39:29.359468+0000","last_fullsized":"2023-08-09T12:39:29.359468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499428+0000","last_change":"2023-08-09T12:39:24.635709+0000","last_active":"2023-08-09T12:39:27.499428+0000","last_peered":"2023-08-09T12:39:27.499428+0000","last_clean":"2023-08-09T12:39:27.499428+0000","last_became_active":"2023-08-09T12:39:24.633560+0000","last_became_peered":"2023-08-09T12:39:24.633560+0000","last_unstale":"2023-08-09T12:39:27.499428+0000","last_undegraded":"2023-08-09T12:39:27.499428+0000","last_fullsized":"2023-08-09T12:39:27.499428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194642,"statfs":{"total":200000000,"available":199313694,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":92,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195219,"statfs":{"total":200000000,"available":199905238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":93,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195218,"statfs":{"total":200000000,"available":199904222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905800,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314940,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]}],"pool_statfs":[]}} 2023-08-09T12:39:34.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:39:34.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.359+0000 7f5323fff640 1 Processor -- start 2023-08-09T12:39:34.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.359+0000 7f5323fff640 1 -- start start 2023-08-09T12:39:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.360+0000 7f5323fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5324159bd0 0x7f53240ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.360+0000 7f5323fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 0x7f5324070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.360+0000 7f5323fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53240697c0 0x7f5324069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5323fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240b11a0 con 0x7f5324159bd0 2023-08-09T12:39:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5323fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532406a190 con 0x7f53240697c0 2023-08-09T12:39:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5323fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532406fe10 con 0x7f53240b3fe0 2023-08-09T12:39:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5322ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5324159bd0 0x7f53240ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5322ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5324159bd0 0x7f53240ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56166/0 (socket says 172.21.15.17:56166) 2023-08-09T12:39:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5322ffd640 1 -- 172.21.15.17:0/205633906 learned_addr learned my addr 172.21.15.17:0/205633906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f531bfff640 1 --2- 172.21.15.17:0/205633906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 0x7f5324070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f53237fe640 1 --2- 172.21.15.17:0/205633906 >> v2:172.21.15.142:3300/0 conn(0x7f53240697c0 0x7f5324069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5322ffd640 1 -- 172.21.15.17:0/205633906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 msgr2=0x7f5324070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5322ffd640 1 --2- 172.21.15.17:0/205633906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 0x7f5324070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5322ffd640 1 -- 172.21.15.17:0/205633906 >> v2:172.21.15.142:3300/0 conn(0x7f53240697c0 msgr2=0x7f5324069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5322ffd640 1 --2- 172.21.15.17:0/205633906 >> v2:172.21.15.142:3300/0 conn(0x7f53240697c0 0x7f5324069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f5322ffd640 1 -- 172.21.15.17:0/205633906 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324159fb0 con 0x7f5324159bd0 2023-08-09T12:39:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.361+0000 7f53237fe640 1 --2- 172.21.15.17:0/205633906 >> v2:172.21.15.142:3300/0 conn(0x7f53240697c0 0x7f5324069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.362+0000 7f5322ffd640 1 --2- 172.21.15.17:0/205633906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5324159bd0 0x7f53240ca730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f532406b410 tx=0x7f531402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dc3e163b72e0d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.363+0000 7f53227fc640 1 -- 172.21.15.17:0/205633906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314031870 con 0x7f5324159bd0 2023-08-09T12:39:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.363+0000 7f53227fc640 1 -- 172.21.15.17:0/205633906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53140319d0 con 0x7f5324159bd0 2023-08-09T12:39:34.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.363+0000 7f53227fc640 1 -- 172.21.15.17:0/205633906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314031d60 con 0x7f5324159bd0 2023-08-09T12:39:34.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.363+0000 7f5323fff640 1 -- 172.21.15.17:0/205633906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5324159bd0 msgr2=0x7f53240ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.363+0000 7f5323fff640 1 --2- 172.21.15.17:0/205633906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5324159bd0 0x7f53240ca730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f532406b410 tx=0x7f531402b910 comp rx=0 tx=0).stop 2023-08-09T12:39:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.364+0000 7f5323fff640 1 -- 172.21.15.17:0/205633906 shutdown_connections 2023-08-09T12:39:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.364+0000 7f5323fff640 1 --2- 172.21.15.17:0/205633906 >> v2:172.21.15.142:3300/0 conn(0x7f53240697c0 0x7f5324069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.364+0000 7f5323fff640 1 --2- 172.21.15.17:0/205633906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 0x7f5324070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.364+0000 7f5323fff640 1 --2- 172.21.15.17:0/205633906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5324159bd0 0x7f53240ca730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.364+0000 7f5323fff640 1 -- 172.21.15.17:0/205633906 >> 172.21.15.17:0/205633906 conn(0x7f53240b1d50 msgr2=0x7f532406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.364+0000 7f5323fff640 1 -- 172.21.15.17:0/205633906 shutdown_connections 2023-08-09T12:39:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.364+0000 7f5323fff640 1 -- 172.21.15.17:0/205633906 wait complete. 2023-08-09T12:39:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.365+0000 7f5323fff640 1 Processor -- start 2023-08-09T12:39:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.366+0000 7f5323fff640 1 -- start start 2023-08-09T12:39:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.366+0000 7f5323fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53240697c0 0x7f53240ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.366+0000 7f5323fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 0x7f53240c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.366+0000 7f5323fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5324159bd0 0x7f5324151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.366+0000 7f5323fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53241e4fa0 con 0x7f53240697c0 2023-08-09T12:39:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.366+0000 7f5323fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53240ce590 con 0x7f5324159bd0 2023-08-09T12:39:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.366+0000 7f5323fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53241e51f0 con 0x7f53240b3fe0 2023-08-09T12:39:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f5322ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53240697c0 0x7f53240ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f5322ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53240697c0 0x7f53240ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56170/0 (socket says 172.21.15.17:56170) 2023-08-09T12:39:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f5322ffd640 1 -- 172.21.15.17:0/2188987133 learned_addr learned my addr 172.21.15.17:0/2188987133 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f53237fe640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5324159bd0 0x7f5324151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f531bfff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 0x7f53240c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f5322ffd640 1 -- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 msgr2=0x7f53240c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f5322ffd640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 0x7f53240c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f5322ffd640 1 -- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5324159bd0 msgr2=0x7f5324151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f5322ffd640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5324159bd0 0x7f5324151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.367+0000 7f5322ffd640 1 -- 172.21.15.17:0/2188987133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140094d0 con 0x7f53240697c0 2023-08-09T12:39:34.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.368+0000 7f5322ffd640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53240697c0 0x7f53240ce050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5314000c00 tx=0x7f53140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:34.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.368+0000 7f531b7fe640 1 -- 172.21.15.17:0/2188987133 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531403abe0 con 0x7f53240697c0 2023-08-09T12:39:34.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.368+0000 7f531b7fe640 1 -- 172.21.15.17:0/2188987133 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531403ad40 con 0x7f53240697c0 2023-08-09T12:39:34.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.368+0000 7f531b7fe640 1 -- 172.21.15.17:0/2188987133 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314044610 con 0x7f53240697c0 2023-08-09T12:39:34.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.368+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53241e54d0 con 0x7f53240697c0 2023-08-09T12:39:34.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.368+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53241e5a90 con 0x7f53240697c0 2023-08-09T12:39:34.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.369+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532404e390 con 0x7f53240697c0 2023-08-09T12:39:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.370+0000 7f531b7fe640 1 -- 172.21.15.17:0/2188987133 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f531404d450 con 0x7f53240697c0 2023-08-09T12:39:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.371+0000 7f531b7fe640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.371+0000 7f531b7fe640 1 -- 172.21.15.17:0/2188987133 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f531402d040 con 0x7f53240697c0 2023-08-09T12:39:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.372+0000 7f531bfff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.373+0000 7f531bfff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53240b0db0 tx=0x7f530c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:34.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.376+0000 7f531b7fe640 1 -- 172.21.15.17:0/2188987133 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5314076000 con 0x7f53240697c0 2023-08-09T12:39:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.557+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53240cac70 con 0x7f530406a050 2023-08-09T12:39:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.579+0000 7f531b7fe640 1 -- 172.21.15.17:0/2188987133 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280625 (secure 0 0 0) 0x7f530c00b200 con 0x7f530406a050 2023-08-09T12:39:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:34.586 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:39:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 msgr2=0x7f530406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53240b0db0 tx=0x7f530c008040 comp rx=0 tx=0).stop 2023-08-09T12:39:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53240697c0 msgr2=0x7f53240ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53240697c0 0x7f53240ce050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5314000c00 tx=0x7f53140046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 shutdown_connections 2023-08-09T12:39:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5324159bd0 0x7f5324151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240b3fe0 0x7f53240c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 --2- 172.21.15.17:0/2188987133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53240697c0 0x7f53240ce050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.584+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 >> 172.21.15.17:0/2188987133 conn(0x7f53240b1d50 msgr2=0x7f53240c8190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.585+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 shutdown_connections 2023-08-09T12:39:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.585+0000 7f5323fff640 1 -- 172.21.15.17:0/2188987133 wait complete. 2023-08-09T12:39:34.607 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-09T12:39:32.636309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560606,"statfs":{"total":1600000000,"available":1598061564,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003148"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613678+0000","last_change":"2023-08-09T12:39:25.635863+0000","last_active":"2023-08-09T12:39:26.613678+0000","last_peered":"2023-08-09T12:39:26.613678+0000","last_clean":"2023-08-09T12:39:26.613678+0000","last_became_active":"2023-08-09T12:39:25.635612+0000","last_became_peered":"2023-08-09T12:39:25.635612+0000","last_unstale":"2023-08-09T12:39:26.613678+0000","last_undegraded":"2023-08-09T12:39:26.613678+0000","last_fullsized":"2023-08-09T12:39:26.613678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:47.816962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420553+0000","last_change":"2023-08-09T12:39:25.643258+0000","last_active":"2023-08-09T12:39:27.420553+0000","last_peered":"2023-08-09T12:39:27.420553+0000","last_clean":"2023-08-09T12:39:27.420553+0000","last_became_active":"2023-08-09T12:39:25.642998+0000","last_became_peered":"2023-08-09T12:39:25.642998+0000","last_unstale":"2023-08-09T12:39:27.420553+0000","last_undegraded":"2023-08-09T12:39:27.420553+0000","last_fullsized":"2023-08-09T12:39:27.420553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359791+0000","last_change":"2023-08-09T12:39:25.646436+0000","last_active":"2023-08-09T12:39:29.359791+0000","last_peered":"2023-08-09T12:39:29.359791+0000","last_clean":"2023-08-09T12:39:29.359791+0000","last_became_active":"2023-08-09T12:39:25.646140+0000","last_became_peered":"2023-08-09T12:39:25.646140+0000","last_unstale":"2023-08-09T12:39:29.359791+0000","last_undegraded":"2023-08-09T12:39:29.359791+0000","last_fullsized":"2023-08-09T12:39:29.359791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:35.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616957+0000","last_change":"2023-08-09T12:39:25.633360+0000","last_active":"2023-08-09T12:39:26.616957+0000","last_peered":"2023-08-09T12:39:26.616957+0000","last_clean":"2023-08-09T12:39:26.616957+0000","last_became_active":"2023-08-09T12:39:25.632781+0000","last_became_peered":"2023-08-09T12:39:25.632781+0000","last_unstale":"2023-08-09T12:39:26.616957+0000","last_undegraded":"2023-08-09T12:39:26.616957+0000","last_fullsized":"2023-08-09T12:39:26.616957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:42.820863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498344+0000","last_change":"2023-08-09T12:39:25.636182+0000","last_active":"2023-08-09T12:39:27.498344+0000","last_peered":"2023-08-09T12:39:27.498344+0000","last_clean":"2023-08-09T12:39:27.498344+0000","last_became_active":"2023-08-09T12:39:25.635794+0000","last_became_peered":"2023-08-09T12:39:25.635794+0000","last_unstale":"2023-08-09T12:39:27.498344+0000","last_undegraded":"2023-08-09T12:39:27.498344+0000","last_fullsized":"2023-08-09T12:39:27.498344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.358925+0000","last_change":"2023-08-09T12:39:25.650226+0000","last_active":"2023-08-09T12:39:29.358925+0000","last_peered":"2023-08-09T12:39:29.358925+0000","last_clean":"2023-08-09T12:39:29.358925+0000","last_became_active":"2023-08-09T12:39:25.646910+0000","last_became_peered":"2023-08-09T12:39:25.646910+0000","last_unstale":"2023-08-09T12:39:29.358925+0000","last_undegraded":"2023-08-09T12:39:29.358925+0000","last_fullsized":"2023-08-09T12:39:29.358925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499364+0000","last_change":"2023-08-09T12:39:25.643948+0000","last_active":"2023-08-09T12:39:27.499364+0000","last_peered":"2023-08-09T12:39:27.499364+0000","last_clean":"2023-08-09T12:39:27.499364+0000","last_became_active":"2023-08-09T12:39:25.643568+0000","last_became_peered":"2023-08-09T12:39:25.643568+0000","last_unstale":"2023-08-09T12:39:27.499364+0000","last_undegraded":"2023-08-09T12:39:27.499364+0000","last_fullsized":"2023-08-09T12:39:27.499364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:35.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420714+0000","last_change":"2023-08-09T12:39:25.636008+0000","last_active":"2023-08-09T12:39:27.420714+0000","last_peered":"2023-08-09T12:39:27.420714+0000","last_clean":"2023-08-09T12:39:27.420714+0000","last_became_active":"2023-08-09T12:39:25.635696+0000","last_became_peered":"2023-08-09T12:39:25.635696+0000","last_unstale":"2023-08-09T12:39:27.420714+0000","last_undegraded":"2023-08-09T12:39:27.420714+0000","last_fullsized":"2023-08-09T12:39:27.420714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:31.607254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.497838+0000","last_change":"2023-08-09T12:39:25.642164+0000","last_active":"2023-08-09T12:39:27.497838+0000","last_peered":"2023-08-09T12:39:27.497838+0000","last_clean":"2023-08-09T12:39:27.497838+0000","last_became_active":"2023-08-09T12:39:25.641895+0000","last_became_peered":"2023-08-09T12:39:25.641895+0000","last_unstale":"2023-08-09T12:39:27.497838+0000","last_undegraded":"2023-08-09T12:39:27.497838+0000","last_fullsized":"2023-08-09T12:39:27.497838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:30.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420243+0000","last_change":"2023-08-09T12:39:25.637312+0000","last_active":"2023-08-09T12:39:27.420243+0000","last_peered":"2023-08-09T12:39:27.420243+0000","last_clean":"2023-08-09T12:39:27.420243+0000","last_became_active":"2023-08-09T12:39:25.636849+0000","last_became_peered":"2023-08-09T12:39:25.636849+0000","last_unstale":"2023-08-09T12:39:27.420243+0000","last_undegraded":"2023-08-09T12:39:27.420243+0000","last_fullsized":"2023-08-09T12:39:27.420243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:26.121156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359347+0000","last_change":"2023-08-09T12:39:25.650515+0000","last_active":"2023-08-09T12:39:29.359347+0000","last_peered":"2023-08-09T12:39:29.359347+0000","last_clean":"2023-08-09T12:39:29.359347+0000","last_became_active":"2023-08-09T12:39:25.649243+0000","last_became_peered":"2023-08-09T12:39:25.649243+0000","last_unstale":"2023-08-09T12:39:29.359347+0000","last_undegraded":"2023-08-09T12:39:29.359347+0000","last_fullsized":"2023-08-09T12:39:29.359347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:33.810328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613554+0000","last_change":"2023-08-09T12:39:25.634920+0000","last_active":"2023-08-09T12:39:26.613554+0000","last_peered":"2023-08-09T12:39:26.613554+0000","last_clean":"2023-08-09T12:39:26.613554+0000","last_became_active":"2023-08-09T12:39:25.634629+0000","last_became_peered":"2023-08-09T12:39:25.634629+0000","last_unstale":"2023-08-09T12:39:26.613554+0000","last_undegraded":"2023-08-09T12:39:26.613554+0000","last_fullsized":"2023-08-09T12:39:26.613554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:15.819900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613610+0000","last_change":"2023-08-09T12:39:25.633027+0000","last_active":"2023-08-09T12:39:26.613610+0000","last_peered":"2023-08-09T12:39:26.613610+0000","last_clean":"2023-08-09T12:39:26.613610+0000","last_became_active":"2023-08-09T12:39:25.632604+0000","last_became_peered":"2023-08-09T12:39:25.632604+0000","last_unstale":"2023-08-09T12:39:26.613610+0000","last_undegraded":"2023-08-09T12:39:26.613610+0000","last_fullsized":"2023-08-09T12:39:26.613610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:31:38.803697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420033+0000","last_change":"2023-08-09T12:39:25.639141+0000","last_active":"2023-08-09T12:39:27.420033+0000","last_peered":"2023-08-09T12:39:27.420033+0000","last_clean":"2023-08-09T12:39:27.420033+0000","last_became_active":"2023-08-09T12:39:25.638059+0000","last_became_peered":"2023-08-09T12:39:25.638059+0000","last_unstale":"2023-08-09T12:39:27.420033+0000","last_undegraded":"2023-08-09T12:39:27.420033+0000","last_fullsized":"2023-08-09T12:39:27.420033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498779+0000","last_change":"2023-08-09T12:39:25.652960+0000","last_active":"2023-08-09T12:39:27.498779+0000","last_peered":"2023-08-09T12:39:27.498779+0000","last_clean":"2023-08-09T12:39:27.498779+0000","last_became_active":"2023-08-09T12:39:25.652713+0000","last_became_peered":"2023-08-09T12:39:25.652713+0000","last_unstale":"2023-08-09T12:39:27.498779+0000","last_undegraded":"2023-08-09T12:39:27.498779+0000","last_fullsized":"2023-08-09T12:39:27.498779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359865+0000","last_change":"2023-08-09T12:39:25.649932+0000","last_active":"2023-08-09T12:39:29.359865+0000","last_peered":"2023-08-09T12:39:29.359865+0000","last_clean":"2023-08-09T12:39:29.359865+0000","last_became_active":"2023-08-09T12:39:25.645779+0000","last_became_peered":"2023-08-09T12:39:25.645779+0000","last_unstale":"2023-08-09T12:39:29.359865+0000","last_undegraded":"2023-08-09T12:39:29.359865+0000","last_fullsized":"2023-08-09T12:39:29.359865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:36:19.751633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.497822+0000","last_change":"2023-08-09T12:39:25.642272+0000","last_active":"2023-08-09T12:39:27.497822+0000","last_peered":"2023-08-09T12:39:27.497822+0000","last_clean":"2023-08-09T12:39:27.497822+0000","last_became_active":"2023-08-09T12:39:25.641857+0000","last_became_peered":"2023-08-09T12:39:25.641857+0000","last_unstale":"2023-08-09T12:39:27.497822+0000","last_undegraded":"2023-08-09T12:39:27.497822+0000","last_fullsized":"2023-08-09T12:39:27.497822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:56.516015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359004+0000","last_change":"2023-08-09T12:39:25.638050+0000","last_active":"2023-08-09T12:39:29.359004+0000","last_peered":"2023-08-09T12:39:29.359004+0000","last_clean":"2023-08-09T12:39:29.359004+0000","last_became_active":"2023-08-09T12:39:25.637427+0000","last_became_peered":"2023-08-09T12:39:25.637427+0000","last_unstale":"2023-08-09T12:39:29.359004+0000","last_undegraded":"2023-08-09T12:39:29.359004+0000","last_fullsized":"2023-08-09T12:39:29.359004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613553+0000","last_change":"2023-08-09T12:39:25.625546+0000","last_active":"2023-08-09T12:39:26.613553+0000","last_peered":"2023-08-09T12:39:26.613553+0000","last_clean":"2023-08-09T12:39:26.613553+0000","last_became_active":"2023-08-09T12:39:25.623517+0000","last_became_peered":"2023-08-09T12:39:25.623517+0000","last_unstale":"2023-08-09T12:39:26.613553+0000","last_undegraded":"2023-08-09T12:39:26.613553+0000","last_fullsized":"2023-08-09T12:39:26.613553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:37.691345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359010+0000","last_change":"2023-08-09T12:39:25.648778+0000","last_active":"2023-08-09T12:39:29.359010+0000","last_peered":"2023-08-09T12:39:29.359010+0000","last_clean":"2023-08-09T12:39:29.359010+0000","last_became_active":"2023-08-09T12:39:25.646303+0000","last_became_peered":"2023-08-09T12:39:25.646303+0000","last_unstale":"2023-08-09T12:39:29.359010+0000","last_undegraded":"2023-08-09T12:39:29.359010+0000","last_fullsized":"2023-08-09T12:39:29.359010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:29.784828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499367+0000","last_change":"2023-08-09T12:39:25.621729+0000","last_active":"2023-08-09T12:39:27.499367+0000","last_peered":"2023-08-09T12:39:27.499367+0000","last_clean":"2023-08-09T12:39:27.499367+0000","last_became_active":"2023-08-09T12:39:25.620974+0000","last_became_peered":"2023-08-09T12:39:25.620974+0000","last_unstale":"2023-08-09T12:39:27.499367+0000","last_undegraded":"2023-08-09T12:39:27.499367+0000","last_fullsized":"2023-08-09T12:39:27.499367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:37.239773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498260+0000","last_change":"2023-08-09T12:39:25.644455+0000","last_active":"2023-08-09T12:39:27.498260+0000","last_peered":"2023-08-09T12:39:27.498260+0000","last_clean":"2023-08-09T12:39:27.498260+0000","last_became_active":"2023-08-09T12:39:25.644178+0000","last_became_peered":"2023-08-09T12:39:25.644178+0000","last_unstale":"2023-08-09T12:39:27.498260+0000","last_undegraded":"2023-08-09T12:39:27.498260+0000","last_fullsized":"2023-08-09T12:39:27.498260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:33.221475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.614982+0000","last_change":"2023-08-09T12:39:25.638742+0000","last_active":"2023-08-09T12:39:26.614982+0000","last_peered":"2023-08-09T12:39:26.614982+0000","last_clean":"2023-08-09T12:39:26.614982+0000","last_became_active":"2023-08-09T12:39:25.638454+0000","last_became_peered":"2023-08-09T12:39:25.638454+0000","last_unstale":"2023-08-09T12:39:26.614982+0000","last_undegraded":"2023-08-09T12:39:26.614982+0000","last_fullsized":"2023-08-09T12:39:26.614982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:36.686027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499469+0000","last_change":"2023-08-09T12:39:25.623830+0000","last_active":"2023-08-09T12:39:27.499469+0000","last_peered":"2023-08-09T12:39:27.499469+0000","last_clean":"2023-08-09T12:39:27.499469+0000","last_became_active":"2023-08-09T12:39:25.623070+0000","last_became_peered":"2023-08-09T12:39:25.623070+0000","last_unstale":"2023-08-09T12:39:27.499469+0000","last_undegraded":"2023-08-09T12:39:27.499469+0000","last_fullsized":"2023-08-09T12:39:27.499469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:36:19.751633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409782+0000","last_change":"2023-08-09T12:39:25.652932+0000","last_active":"2023-08-09T12:39:27.409782+0000","last_peered":"2023-08-09T12:39:27.409782+0000","last_clean":"2023-08-09T12:39:27.409782+0000","last_became_active":"2023-08-09T12:39:25.651614+0000","last_became_peered":"2023-08-09T12:39:25.651614+0000","last_unstale":"2023-08-09T12:39:27.409782+0000","last_undegraded":"2023-08-09T12:39:27.409782+0000","last_fullsized":"2023-08-09T12:39:27.409782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409703+0000","last_change":"2023-08-09T12:39:25.644658+0000","last_active":"2023-08-09T12:39:27.409703+0000","last_peered":"2023-08-09T12:39:27.409703+0000","last_clean":"2023-08-09T12:39:27.409703+0000","last_became_active":"2023-08-09T12:39:25.643855+0000","last_became_peered":"2023-08-09T12:39:25.643855+0000","last_unstale":"2023-08-09T12:39:27.409703+0000","last_undegraded":"2023-08-09T12:39:27.409703+0000","last_fullsized":"2023-08-09T12:39:27.409703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420812+0000","last_change":"2023-08-09T12:39:25.640170+0000","last_active":"2023-08-09T12:39:27.420812+0000","last_peered":"2023-08-09T12:39:27.420812+0000","last_clean":"2023-08-09T12:39:27.420812+0000","last_became_active":"2023-08-09T12:39:25.639694+0000","last_became_peered":"2023-08-09T12:39:25.639694+0000","last_unstale":"2023-08-09T12:39:27.420812+0000","last_undegraded":"2023-08-09T12:39:27.420812+0000","last_fullsized":"2023-08-09T12:39:27.420812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:37.239773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410774+0000","last_change":"2023-08-09T12:39:25.642608+0000","last_active":"2023-08-09T12:39:27.410774+0000","last_peered":"2023-08-09T12:39:27.410774+0000","last_clean":"2023-08-09T12:39:27.410774+0000","last_became_active":"2023-08-09T12:39:25.637346+0000","last_became_peered":"2023-08-09T12:39:25.637346+0000","last_unstale":"2023-08-09T12:39:27.410774+0000","last_undegraded":"2023-08-09T12:39:27.410774+0000","last_fullsized":"2023-08-09T12:39:27.410774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:31.607254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615253+0000","last_change":"2023-08-09T12:39:25.640403+0000","last_active":"2023-08-09T12:39:26.615253+0000","last_peered":"2023-08-09T12:39:26.615253+0000","last_clean":"2023-08-09T12:39:26.615253+0000","last_became_active":"2023-08-09T12:39:25.635661+0000","last_became_peered":"2023-08-09T12:39:25.635661+0000","last_unstale":"2023-08-09T12:39:26.615253+0000","last_undegraded":"2023-08-09T12:39:26.615253+0000","last_fullsized":"2023-08-09T12:39:26.615253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:47.710010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359270+0000","last_change":"2023-08-09T12:39:25.646903+0000","last_active":"2023-08-09T12:39:29.359270+0000","last_peered":"2023-08-09T12:39:29.359270+0000","last_clean":"2023-08-09T12:39:29.359270+0000","last_became_active":"2023-08-09T12:39:25.645744+0000","last_became_peered":"2023-08-09T12:39:25.645744+0000","last_unstale":"2023-08-09T12:39:29.359270+0000","last_undegraded":"2023-08-09T12:39:29.359270+0000","last_fullsized":"2023-08-09T12:39:29.359270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:44.285538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615530+0000","last_change":"2023-08-09T12:39:25.645982+0000","last_active":"2023-08-09T12:39:26.615530+0000","last_peered":"2023-08-09T12:39:26.615530+0000","last_clean":"2023-08-09T12:39:26.615530+0000","last_became_active":"2023-08-09T12:39:25.645632+0000","last_became_peered":"2023-08-09T12:39:25.645632+0000","last_unstale":"2023-08-09T12:39:26.615530+0000","last_undegraded":"2023-08-09T12:39:26.615530+0000","last_fullsized":"2023-08-09T12:39:26.615530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616738+0000","last_change":"2023-08-09T12:39:25.632004+0000","last_active":"2023-08-09T12:39:26.616738+0000","last_peered":"2023-08-09T12:39:26.616738+0000","last_clean":"2023-08-09T12:39:26.616738+0000","last_became_active":"2023-08-09T12:39:25.631477+0000","last_became_peered":"2023-08-09T12:39:25.631477+0000","last_unstale":"2023-08-09T12:39:26.616738+0000","last_undegraded":"2023-08-09T12:39:26.616738+0000","last_fullsized":"2023-08-09T12:39:26.616738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615919+0000","last_change":"2023-08-09T12:39:25.641384+0000","last_active":"2023-08-09T12:39:26.615919+0000","last_peered":"2023-08-09T12:39:26.615919+0000","last_clean":"2023-08-09T12:39:26.615919+0000","last_became_active":"2023-08-09T12:39:25.640764+0000","last_became_peered":"2023-08-09T12:39:25.640764+0000","last_unstale":"2023-08-09T12:39:26.615919+0000","last_undegraded":"2023-08-09T12:39:26.615919+0000","last_fullsized":"2023-08-09T12:39:26.615919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:33.925265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499326+0000","last_change":"2023-08-09T12:39:24.640639+0000","last_active":"2023-08-09T12:39:27.499326+0000","last_peered":"2023-08-09T12:39:27.499326+0000","last_clean":"2023-08-09T12:39:27.499326+0000","last_became_active":"2023-08-09T12:39:24.640266+0000","last_became_peered":"2023-08-09T12:39:24.640266+0000","last_unstale":"2023-08-09T12:39:27.499326+0000","last_undegraded":"2023-08-09T12:39:27.499326+0000","last_fullsized":"2023-08-09T12:39:27.499326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:30.602392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.421062+0000","last_change":"2023-08-09T12:39:25.631972+0000","last_active":"2023-08-09T12:39:27.421062+0000","last_peered":"2023-08-09T12:39:27.421062+0000","last_clean":"2023-08-09T12:39:27.421062+0000","last_became_active":"2023-08-09T12:39:25.631386+0000","last_became_peered":"2023-08-09T12:39:25.631386+0000","last_unstale":"2023-08-09T12:39:27.421062+0000","last_undegraded":"2023-08-09T12:39:27.421062+0000","last_fullsized":"2023-08-09T12:39:27.421062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:36:19.751633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498727+0000","last_change":"2023-08-09T12:39:24.631980+0000","last_active":"2023-08-09T12:39:27.498727+0000","last_peered":"2023-08-09T12:39:27.498727+0000","last_clean":"2023-08-09T12:39:27.498727+0000","last_became_active":"2023-08-09T12:39:24.631321+0000","last_became_peered":"2023-08-09T12:39:24.631321+0000","last_unstale":"2023-08-09T12:39:27.498727+0000","last_undegraded":"2023-08-09T12:39:27.498727+0000","last_fullsized":"2023-08-09T12:39:27.498727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:43.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498612+0000","last_change":"2023-08-09T12:39:25.642115+0000","last_active":"2023-08-09T12:39:27.498612+0000","last_peered":"2023-08-09T12:39:27.498612+0000","last_clean":"2023-08-09T12:39:27.498612+0000","last_became_active":"2023-08-09T12:39:25.641510+0000","last_became_peered":"2023-08-09T12:39:25.641510+0000","last_unstale":"2023-08-09T12:39:27.498612+0000","last_undegraded":"2023-08-09T12:39:27.498612+0000","last_fullsized":"2023-08-09T12:39:27.498612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:26.121156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499878+0000","last_change":"2023-08-09T12:39:24.640562+0000","last_active":"2023-08-09T12:39:27.499878+0000","last_peered":"2023-08-09T12:39:27.499878+0000","last_clean":"2023-08-09T12:39:27.499878+0000","last_became_active":"2023-08-09T12:39:24.640227+0000","last_became_peered":"2023-08-09T12:39:24.640227+0000","last_unstale":"2023-08-09T12:39:27.499878+0000","last_undegraded":"2023-08-09T12:39:27.499878+0000","last_fullsized":"2023-08-09T12:39:27.499878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:42.623908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615401+0000","last_change":"2023-08-09T12:39:25.629884+0000","last_active":"2023-08-09T12:39:26.615401+0000","last_peered":"2023-08-09T12:39:26.615401+0000","last_clean":"2023-08-09T12:39:26.615401+0000","last_became_active":"2023-08-09T12:39:25.629153+0000","last_became_peered":"2023-08-09T12:39:25.629153+0000","last_unstale":"2023-08-09T12:39:26.615401+0000","last_undegraded":"2023-08-09T12:39:26.615401+0000","last_fullsized":"2023-08-09T12:39:26.615401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617036+0000","last_change":"2023-08-09T12:39:24.634685+0000","last_active":"2023-08-09T12:39:26.617036+0000","last_peered":"2023-08-09T12:39:26.617036+0000","last_clean":"2023-08-09T12:39:26.617036+0000","last_became_active":"2023-08-09T12:39:24.634383+0000","last_became_peered":"2023-08-09T12:39:24.634383+0000","last_unstale":"2023-08-09T12:39:26.617036+0000","last_undegraded":"2023-08-09T12:39:26.617036+0000","last_fullsized":"2023-08-09T12:39:26.617036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:58.185435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499828+0000","last_change":"2023-08-09T12:39:24.641613+0000","last_active":"2023-08-09T12:39:27.499828+0000","last_peered":"2023-08-09T12:39:27.499828+0000","last_clean":"2023-08-09T12:39:27.499828+0000","last_became_active":"2023-08-09T12:39:24.641213+0000","last_became_peered":"2023-08-09T12:39:24.641213+0000","last_unstale":"2023-08-09T12:39:27.499828+0000","last_undegraded":"2023-08-09T12:39:27.499828+0000","last_fullsized":"2023-08-09T12:39:27.499828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:59:09.967517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420450+0000","last_change":"2023-08-09T12:39:25.634677+0000","last_active":"2023-08-09T12:39:27.420450+0000","last_peered":"2023-08-09T12:39:27.420450+0000","last_clean":"2023-08-09T12:39:27.420450+0000","last_became_active":"2023-08-09T12:39:25.634264+0000","last_became_peered":"2023-08-09T12:39:25.634264+0000","last_unstale":"2023-08-09T12:39:27.420450+0000","last_undegraded":"2023-08-09T12:39:27.420450+0000","last_fullsized":"2023-08-09T12:39:27.420450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:33.810328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499541+0000","last_change":"2023-08-09T12:39:24.641554+0000","last_active":"2023-08-09T12:39:27.499541+0000","last_peered":"2023-08-09T12:39:27.499541+0000","last_clean":"2023-08-09T12:39:27.499541+0000","last_became_active":"2023-08-09T12:39:24.641197+0000","last_became_peered":"2023-08-09T12:39:24.641197+0000","last_unstale":"2023-08-09T12:39:27.499541+0000","last_undegraded":"2023-08-09T12:39:27.499541+0000","last_fullsized":"2023-08-09T12:39:27.499541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:52:28.419385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359647+0000","last_change":"2023-08-09T12:39:25.659204+0000","last_active":"2023-08-09T12:39:29.359647+0000","last_peered":"2023-08-09T12:39:29.359647+0000","last_clean":"2023-08-09T12:39:29.359647+0000","last_became_active":"2023-08-09T12:39:25.657091+0000","last_became_peered":"2023-08-09T12:39:25.657091+0000","last_unstale":"2023-08-09T12:39:29.359647+0000","last_undegraded":"2023-08-09T12:39:29.359647+0000","last_fullsized":"2023-08-09T12:39:29.359647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:37.239773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499719+0000","last_change":"2023-08-09T12:39:24.628533+0000","last_active":"2023-08-09T12:39:27.499719+0000","last_peered":"2023-08-09T12:39:27.499719+0000","last_clean":"2023-08-09T12:39:27.499719+0000","last_became_active":"2023-08-09T12:39:24.628153+0000","last_became_peered":"2023-08-09T12:39:24.628153+0000","last_unstale":"2023-08-09T12:39:27.499719+0000","last_undegraded":"2023-08-09T12:39:27.499719+0000","last_fullsized":"2023-08-09T12:39:27.499719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:47.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617326+0000","last_change":"2023-08-09T12:39:25.638917+0000","last_active":"2023-08-09T12:39:26.617326+0000","last_peered":"2023-08-09T12:39:26.617326+0000","last_clean":"2023-08-09T12:39:26.617326+0000","last_became_active":"2023-08-09T12:39:25.638612+0000","last_became_peered":"2023-08-09T12:39:25.638612+0000","last_unstale":"2023-08-09T12:39:26.617326+0000","last_undegraded":"2023-08-09T12:39:26.617326+0000","last_fullsized":"2023-08-09T12:39:26.617326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:56.555091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.421229+0000","last_change":"2023-08-09T12:39:24.634717+0000","last_active":"2023-08-09T12:39:27.421229+0000","last_peered":"2023-08-09T12:39:27.421229+0000","last_clean":"2023-08-09T12:39:27.421229+0000","last_became_active":"2023-08-09T12:39:24.634225+0000","last_became_peered":"2023-08-09T12:39:24.634225+0000","last_unstale":"2023-08-09T12:39:27.421229+0000","last_undegraded":"2023-08-09T12:39:27.421229+0000","last_fullsized":"2023-08-09T12:39:27.421229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:52:28.419385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498949+0000","last_change":"2023-08-09T12:39:25.645761+0000","last_active":"2023-08-09T12:39:27.498949+0000","last_peered":"2023-08-09T12:39:27.498949+0000","last_clean":"2023-08-09T12:39:27.498949+0000","last_became_active":"2023-08-09T12:39:25.645313+0000","last_became_peered":"2023-08-09T12:39:25.645313+0000","last_unstale":"2023-08-09T12:39:27.498949+0000","last_undegraded":"2023-08-09T12:39:27.498949+0000","last_fullsized":"2023-08-09T12:39:27.498949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:48.378100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615527+0000","last_change":"2023-08-09T12:39:24.636912+0000","last_active":"2023-08-09T12:39:26.615527+0000","last_peered":"2023-08-09T12:39:26.615527+0000","last_clean":"2023-08-09T12:39:26.615527+0000","last_became_active":"2023-08-09T12:39:24.636156+0000","last_became_peered":"2023-08-09T12:39:24.636156+0000","last_unstale":"2023-08-09T12:39:26.615527+0000","last_undegraded":"2023-08-09T12:39:26.615527+0000","last_fullsized":"2023-08-09T12:39:26.615527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.358948+0000","last_change":"2023-08-09T12:39:25.646628+0000","last_active":"2023-08-09T12:39:29.358948+0000","last_peered":"2023-08-09T12:39:29.358948+0000","last_clean":"2023-08-09T12:39:29.358948+0000","last_became_active":"2023-08-09T12:39:25.646139+0000","last_became_peered":"2023-08-09T12:39:25.646139+0000","last_unstale":"2023-08-09T12:39:29.358948+0000","last_undegraded":"2023-08-09T12:39:29.358948+0000","last_fullsized":"2023-08-09T12:39:29.358948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:22.850388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617710+0000","last_change":"2023-08-09T12:39:24.632474+0000","last_active":"2023-08-09T12:39:26.617710+0000","last_peered":"2023-08-09T12:39:26.617710+0000","last_clean":"2023-08-09T12:39:26.617710+0000","last_became_active":"2023-08-09T12:39:24.631809+0000","last_became_peered":"2023-08-09T12:39:24.631809+0000","last_unstale":"2023-08-09T12:39:26.617710+0000","last_undegraded":"2023-08-09T12:39:26.617710+0000","last_fullsized":"2023-08-09T12:39:26.617710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:35.681165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359576+0000","last_change":"2023-08-09T12:39:25.649637+0000","last_active":"2023-08-09T12:39:29.359576+0000","last_peered":"2023-08-09T12:39:29.359576+0000","last_clean":"2023-08-09T12:39:29.359576+0000","last_became_active":"2023-08-09T12:39:25.644325+0000","last_became_peered":"2023-08-09T12:39:25.644325+0000","last_unstale":"2023-08-09T12:39:29.359576+0000","last_undegraded":"2023-08-09T12:39:29.359576+0000","last_fullsized":"2023-08-09T12:39:29.359576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:31.607254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360488+0000","last_change":"2023-08-09T12:39:24.629489+0000","last_active":"2023-08-09T12:39:29.360488+0000","last_peered":"2023-08-09T12:39:29.360488+0000","last_clean":"2023-08-09T12:39:29.360488+0000","last_became_active":"2023-08-09T12:39:24.629107+0000","last_became_peered":"2023-08-09T12:39:24.629107+0000","last_unstale":"2023-08-09T12:39:29.360488+0000","last_undegraded":"2023-08-09T12:39:29.360488+0000","last_fullsized":"2023-08-09T12:39:29.360488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:11.053446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360333+0000","last_change":"2023-08-09T12:39:25.638108+0000","last_active":"2023-08-09T12:39:29.360333+0000","last_peered":"2023-08-09T12:39:29.360333+0000","last_clean":"2023-08-09T12:39:29.360333+0000","last_became_active":"2023-08-09T12:39:25.636796+0000","last_became_peered":"2023-08-09T12:39:25.636796+0000","last_unstale":"2023-08-09T12:39:29.360333+0000","last_undegraded":"2023-08-09T12:39:29.360333+0000","last_fullsized":"2023-08-09T12:39:29.360333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:43.628770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615617+0000","last_change":"2023-08-09T12:39:24.628803+0000","last_active":"2023-08-09T12:39:26.615617+0000","last_peered":"2023-08-09T12:39:26.615617+0000","last_clean":"2023-08-09T12:39:26.615617+0000","last_became_active":"2023-08-09T12:39:24.628410+0000","last_became_peered":"2023-08-09T12:39:24.628410+0000","last_unstale":"2023-08-09T12:39:26.615617+0000","last_undegraded":"2023-08-09T12:39:26.615617+0000","last_fullsized":"2023-08-09T12:39:26.615617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:32.805465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409467+0000","last_change":"2023-08-09T12:39:25.643385+0000","last_active":"2023-08-09T12:39:27.409467+0000","last_peered":"2023-08-09T12:39:27.409467+0000","last_clean":"2023-08-09T12:39:27.409467+0000","last_became_active":"2023-08-09T12:39:25.643109+0000","last_became_peered":"2023-08-09T12:39:25.643109+0000","last_unstale":"2023-08-09T12:39:27.409467+0000","last_undegraded":"2023-08-09T12:39:27.409467+0000","last_fullsized":"2023-08-09T12:39:27.409467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:33.221475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.500731+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:39:27.500731+0000","last_peered":"2023-08-09T12:39:27.500731+0000","last_clean":"2023-08-09T12:39:27.500731+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:39:27.500731+0000","last_undegraded":"2023-08-09T12:39:27.500731+0000","last_fullsized":"2023-08-09T12:39:27.500731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:59:37.389325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.419903+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:39:27.419903+0000","last_peered":"2023-08-09T12:39:27.419903+0000","last_clean":"2023-08-09T12:39:27.419903+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:39:27.419903+0000","last_undegraded":"2023-08-09T12:39:27.419903+0000","last_fullsized":"2023-08-09T12:39:27.419903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:23.448966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615676+0000","last_change":"2023-08-09T12:39:24.635989+0000","last_active":"2023-08-09T12:39:26.615676+0000","last_peered":"2023-08-09T12:39:26.615676+0000","last_clean":"2023-08-09T12:39:26.615676+0000","last_became_active":"2023-08-09T12:39:24.635506+0000","last_became_peered":"2023-08-09T12:39:24.635506+0000","last_unstale":"2023-08-09T12:39:26.615676+0000","last_undegraded":"2023-08-09T12:39:26.615676+0000","last_fullsized":"2023-08-09T12:39:26.615676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:47.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.617544+0000","last_change":"2023-08-09T12:39:25.637598+0000","last_active":"2023-08-09T12:39:26.617544+0000","last_peered":"2023-08-09T12:39:26.617544+0000","last_clean":"2023-08-09T12:39:26.617544+0000","last_became_active":"2023-08-09T12:39:25.637286+0000","last_became_peered":"2023-08-09T12:39:25.637286+0000","last_unstale":"2023-08-09T12:39:26.617544+0000","last_undegraded":"2023-08-09T12:39:26.617544+0000","last_fullsized":"2023-08-09T12:39:26.617544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:33.910345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.500435+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:39:27.500435+0000","last_peered":"2023-08-09T12:39:27.500435+0000","last_clean":"2023-08-09T12:39:27.500435+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:39:27.500435+0000","last_undegraded":"2023-08-09T12:39:27.500435+0000","last_fullsized":"2023-08-09T12:39:27.500435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:38:32.670551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499660+0000","last_change":"2023-08-09T12:39:24.636357+0000","last_active":"2023-08-09T12:39:27.499660+0000","last_peered":"2023-08-09T12:39:27.499660+0000","last_clean":"2023-08-09T12:39:27.499660+0000","last_became_active":"2023-08-09T12:39:24.634441+0000","last_became_peered":"2023-08-09T12:39:24.634441+0000","last_unstale":"2023-08-09T12:39:27.499660+0000","last_undegraded":"2023-08-09T12:39:27.499660+0000","last_fullsized":"2023-08-09T12:39:27.499660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:30.602392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499261+0000","last_change":"2023-08-09T12:39:25.645605+0000","last_active":"2023-08-09T12:39:27.499261+0000","last_peered":"2023-08-09T12:39:27.499261+0000","last_clean":"2023-08-09T12:39:27.499261+0000","last_became_active":"2023-08-09T12:39:25.644989+0000","last_became_peered":"2023-08-09T12:39:25.644989+0000","last_unstale":"2023-08-09T12:39:27.499261+0000","last_undegraded":"2023-08-09T12:39:27.499261+0000","last_fullsized":"2023-08-09T12:39:27.499261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613725+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:39:26.613725+0000","last_peered":"2023-08-09T12:39:26.613725+0000","last_clean":"2023-08-09T12:39:26.613725+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:39:26.613725+0000","last_undegraded":"2023-08-09T12:39:26.613725+0000","last_fullsized":"2023-08-09T12:39:26.613725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:46.297345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410523+0000","last_change":"2023-08-09T12:39:24.623190+0000","last_active":"2023-08-09T12:39:27.410523+0000","last_peered":"2023-08-09T12:39:27.410523+0000","last_clean":"2023-08-09T12:39:27.410523+0000","last_became_active":"2023-08-09T12:39:24.622946+0000","last_became_peered":"2023-08-09T12:39:24.622946+0000","last_unstale":"2023-08-09T12:39:27.410523+0000","last_undegraded":"2023-08-09T12:39:27.410523+0000","last_fullsized":"2023-08-09T12:39:27.410523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:47.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409926+0000","last_change":"2023-08-09T12:39:25.656984+0000","last_active":"2023-08-09T12:39:27.409926+0000","last_peered":"2023-08-09T12:39:27.409926+0000","last_clean":"2023-08-09T12:39:27.409926+0000","last_became_active":"2023-08-09T12:39:25.651565+0000","last_became_peered":"2023-08-09T12:39:25.651565+0000","last_unstale":"2023-08-09T12:39:27.409926+0000","last_undegraded":"2023-08-09T12:39:27.409926+0000","last_fullsized":"2023-08-09T12:39:27.409926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.993321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.421375+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:39:27.421375+0000","last_peered":"2023-08-09T12:39:27.421375+0000","last_clean":"2023-08-09T12:39:27.421375+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:39:27.421375+0000","last_undegraded":"2023-08-09T12:39:27.421375+0000","last_fullsized":"2023-08-09T12:39:27.421375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:42.504678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360038+0000","last_change":"2023-08-09T12:39:24.633725+0000","last_active":"2023-08-09T12:39:29.360038+0000","last_peered":"2023-08-09T12:39:29.360038+0000","last_clean":"2023-08-09T12:39:29.360038+0000","last_became_active":"2023-08-09T12:39:24.633401+0000","last_became_peered":"2023-08-09T12:39:24.633401+0000","last_unstale":"2023-08-09T12:39:29.360038+0000","last_undegraded":"2023-08-09T12:39:29.360038+0000","last_fullsized":"2023-08-09T12:39:29.360038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:52:28.419385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410252+0000","last_change":"2023-08-09T12:39:25.652044+0000","last_active":"2023-08-09T12:39:27.410252+0000","last_peered":"2023-08-09T12:39:27.410252+0000","last_clean":"2023-08-09T12:39:27.410252+0000","last_became_active":"2023-08-09T12:39:25.646950+0000","last_became_peered":"2023-08-09T12:39:25.646950+0000","last_unstale":"2023-08-09T12:39:27.410252+0000","last_undegraded":"2023-08-09T12:39:27.410252+0000","last_fullsized":"2023-08-09T12:39:27.410252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:44.285538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420435+0000","last_change":"2023-08-09T12:39:24.629351+0000","last_active":"2023-08-09T12:39:27.420435+0000","last_peered":"2023-08-09T12:39:27.420435+0000","last_clean":"2023-08-09T12:39:27.420435+0000","last_became_active":"2023-08-09T12:39:24.628605+0000","last_became_peered":"2023-08-09T12:39:24.628605+0000","last_unstale":"2023-08-09T12:39:27.420435+0000","last_undegraded":"2023-08-09T12:39:27.420435+0000","last_fullsized":"2023-08-09T12:39:27.420435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:47.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410628+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:39:27.410628+0000","last_peered":"2023-08-09T12:39:27.410628+0000","last_clean":"2023-08-09T12:39:27.410628+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:39:27.410628+0000","last_undegraded":"2023-08-09T12:39:27.410628+0000","last_fullsized":"2023-08-09T12:39:27.410628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:35.938410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410642+0000","last_change":"2023-08-09T12:39:25.656505+0000","last_active":"2023-08-09T12:39:27.410642+0000","last_peered":"2023-08-09T12:39:27.410642+0000","last_clean":"2023-08-09T12:39:27.410642+0000","last_became_active":"2023-08-09T12:39:25.651066+0000","last_became_peered":"2023-08-09T12:39:25.651066+0000","last_unstale":"2023-08-09T12:39:27.410642+0000","last_undegraded":"2023-08-09T12:39:27.410642+0000","last_fullsized":"2023-08-09T12:39:27.410642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:33.925265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410464+0000","last_change":"2023-08-09T12:39:24.624402+0000","last_active":"2023-08-09T12:39:27.410464+0000","last_peered":"2023-08-09T12:39:27.410464+0000","last_clean":"2023-08-09T12:39:27.410464+0000","last_became_active":"2023-08-09T12:39:24.623543+0000","last_became_peered":"2023-08-09T12:39:24.623543+0000","last_unstale":"2023-08-09T12:39:27.410464+0000","last_undegraded":"2023-08-09T12:39:27.410464+0000","last_fullsized":"2023-08-09T12:39:27.410464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:32.805465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.500160+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:39:27.500160+0000","last_peered":"2023-08-09T12:39:27.500160+0000","last_clean":"2023-08-09T12:39:27.500160+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:39:27.500160+0000","last_undegraded":"2023-08-09T12:39:27.500160+0000","last_fullsized":"2023-08-09T12:39:27.500160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:05.722446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498354+0000","last_change":"2023-08-09T12:39:25.637151+0000","last_active":"2023-08-09T12:39:27.498354+0000","last_peered":"2023-08-09T12:39:27.498354+0000","last_clean":"2023-08-09T12:39:27.498354+0000","last_became_active":"2023-08-09T12:39:25.636899+0000","last_became_peered":"2023-08-09T12:39:25.636899+0000","last_unstale":"2023-08-09T12:39:27.498354+0000","last_undegraded":"2023-08-09T12:39:27.498354+0000","last_fullsized":"2023-08-09T12:39:27.498354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615546+0000","last_change":"2023-08-09T12:39:24.628972+0000","last_active":"2023-08-09T12:39:26.615546+0000","last_peered":"2023-08-09T12:39:26.615546+0000","last_clean":"2023-08-09T12:39:26.615546+0000","last_became_active":"2023-08-09T12:39:24.628110+0000","last_became_peered":"2023-08-09T12:39:24.628110+0000","last_unstale":"2023-08-09T12:39:26.615546+0000","last_undegraded":"2023-08-09T12:39:26.615546+0000","last_fullsized":"2023-08-09T12:39:26.615546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:25.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409144+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:39:27.409144+0000","last_peered":"2023-08-09T12:39:27.409144+0000","last_clean":"2023-08-09T12:39:27.409144+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:39:27.409144+0000","last_undegraded":"2023-08-09T12:39:27.409144+0000","last_fullsized":"2023-08-09T12:39:27.409144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:41.374148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615554+0000","last_change":"2023-08-09T12:39:25.641020+0000","last_active":"2023-08-09T12:39:26.615554+0000","last_peered":"2023-08-09T12:39:26.615554+0000","last_clean":"2023-08-09T12:39:26.615554+0000","last_became_active":"2023-08-09T12:39:25.638752+0000","last_became_peered":"2023-08-09T12:39:25.638752+0000","last_unstale":"2023-08-09T12:39:26.615554+0000","last_undegraded":"2023-08-09T12:39:26.615554+0000","last_fullsized":"2023-08-09T12:39:26.615554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:44.285538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498690+0000","last_change":"2023-08-09T12:39:24.636769+0000","last_active":"2023-08-09T12:39:27.498690+0000","last_peered":"2023-08-09T12:39:27.498690+0000","last_clean":"2023-08-09T12:39:27.498690+0000","last_became_active":"2023-08-09T12:39:24.635218+0000","last_became_peered":"2023-08-09T12:39:24.635218+0000","last_unstale":"2023-08-09T12:39:27.498690+0000","last_undegraded":"2023-08-09T12:39:27.498690+0000","last_fullsized":"2023-08-09T12:39:27.498690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:06.988459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616980+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:39:26.616980+0000","last_peered":"2023-08-09T12:39:26.616980+0000","last_clean":"2023-08-09T12:39:26.616980+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:39:26.616980+0000","last_undegraded":"2023-08-09T12:39:26.616980+0000","last_fullsized":"2023-08-09T12:39:26.616980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:34:15.184256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360134+0000","last_change":"2023-08-09T12:39:25.634557+0000","last_active":"2023-08-09T12:39:29.360134+0000","last_peered":"2023-08-09T12:39:29.360134+0000","last_clean":"2023-08-09T12:39:29.360134+0000","last_became_active":"2023-08-09T12:39:25.633799+0000","last_became_peered":"2023-08-09T12:39:25.633799+0000","last_unstale":"2023-08-09T12:39:29.360134+0000","last_undegraded":"2023-08-09T12:39:29.360134+0000","last_fullsized":"2023-08-09T12:39:29.360134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:59:10.972380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360149+0000","last_change":"2023-08-09T12:39:25.643842+0000","last_active":"2023-08-09T12:39:29.360149+0000","last_peered":"2023-08-09T12:39:29.360149+0000","last_clean":"2023-08-09T12:39:29.360149+0000","last_became_active":"2023-08-09T12:39:25.637275+0000","last_became_peered":"2023-08-09T12:39:25.637275+0000","last_unstale":"2023-08-09T12:39:29.360149+0000","last_undegraded":"2023-08-09T12:39:29.360149+0000","last_fullsized":"2023-08-09T12:39:29.360149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:48.840541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359195+0000","last_change":"2023-08-09T12:39:24.640696+0000","last_active":"2023-08-09T12:39:29.359195+0000","last_peered":"2023-08-09T12:39:29.359195+0000","last_clean":"2023-08-09T12:39:29.359195+0000","last_became_active":"2023-08-09T12:39:24.640413+0000","last_became_peered":"2023-08-09T12:39:24.640413+0000","last_unstale":"2023-08-09T12:39:29.359195+0000","last_undegraded":"2023-08-09T12:39:29.359195+0000","last_fullsized":"2023-08-09T12:39:29.359195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:25.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.410185+0000","last_change":"2023-08-09T12:39:25.644428+0000","last_active":"2023-08-09T12:39:27.410185+0000","last_peered":"2023-08-09T12:39:27.410185+0000","last_clean":"2023-08-09T12:39:27.410185+0000","last_became_active":"2023-08-09T12:39:25.643285+0000","last_became_peered":"2023-08-09T12:39:25.643285+0000","last_unstale":"2023-08-09T12:39:27.410185+0000","last_undegraded":"2023-08-09T12:39:27.410185+0000","last_fullsized":"2023-08-09T12:39:27.410185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:26.121156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499161+0000","last_change":"2023-08-09T12:39:24.637201+0000","last_active":"2023-08-09T12:39:27.499161+0000","last_peered":"2023-08-09T12:39:27.499161+0000","last_clean":"2023-08-09T12:39:27.499161+0000","last_became_active":"2023-08-09T12:39:24.636809+0000","last_became_peered":"2023-08-09T12:39:24.636809+0000","last_unstale":"2023-08-09T12:39:27.499161+0000","last_undegraded":"2023-08-09T12:39:27.499161+0000","last_fullsized":"2023-08-09T12:39:27.499161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.421054+0000","last_change":"2023-08-09T12:39:24.632390+0000","last_active":"2023-08-09T12:39:27.421054+0000","last_peered":"2023-08-09T12:39:27.421054+0000","last_clean":"2023-08-09T12:39:27.421054+0000","last_became_active":"2023-08-09T12:39:24.631880+0000","last_became_peered":"2023-08-09T12:39:24.631880+0000","last_unstale":"2023-08-09T12:39:27.421054+0000","last_undegraded":"2023-08-09T12:39:27.421054+0000","last_fullsized":"2023-08-09T12:39:27.421054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:34.743508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615322+0000","last_change":"2023-08-09T12:39:25.622421+0000","last_active":"2023-08-09T12:39:26.615322+0000","last_peered":"2023-08-09T12:39:26.615322+0000","last_clean":"2023-08-09T12:39:26.615322+0000","last_became_active":"2023-08-09T12:39:25.621727+0000","last_became_peered":"2023-08-09T12:39:25.621727+0000","last_unstale":"2023-08-09T12:39:26.615322+0000","last_undegraded":"2023-08-09T12:39:26.615322+0000","last_fullsized":"2023-08-09T12:39:26.615322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:45.282642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498554+0000","last_change":"2023-08-09T12:39:24.632830+0000","last_active":"2023-08-09T12:39:27.498554+0000","last_peered":"2023-08-09T12:39:27.498554+0000","last_clean":"2023-08-09T12:39:27.498554+0000","last_became_active":"2023-08-09T12:39:24.631677+0000","last_became_peered":"2023-08-09T12:39:24.631677+0000","last_unstale":"2023-08-09T12:39:27.498554+0000","last_undegraded":"2023-08-09T12:39:27.498554+0000","last_fullsized":"2023-08-09T12:39:27.498554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615307+0000","last_change":"2023-08-09T12:39:25.638155+0000","last_active":"2023-08-09T12:39:26.615307+0000","last_peered":"2023-08-09T12:39:26.615307+0000","last_clean":"2023-08-09T12:39:26.615307+0000","last_became_active":"2023-08-09T12:39:25.635955+0000","last_became_peered":"2023-08-09T12:39:25.635955+0000","last_unstale":"2023-08-09T12:39:26.615307+0000","last_undegraded":"2023-08-09T12:39:26.615307+0000","last_fullsized":"2023-08-09T12:39:26.615307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:33.221475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616702+0000","last_change":"2023-08-09T12:39:25.630728+0000","last_active":"2023-08-09T12:39:26.616702+0000","last_peered":"2023-08-09T12:39:26.616702+0000","last_clean":"2023-08-09T12:39:26.616702+0000","last_became_active":"2023-08-09T12:39:25.630222+0000","last_became_peered":"2023-08-09T12:39:25.630222+0000","last_unstale":"2023-08-09T12:39:26.616702+0000","last_undegraded":"2023-08-09T12:39:26.616702+0000","last_fullsized":"2023-08-09T12:39:26.616702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:52.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615209+0000","last_change":"2023-08-09T12:39:24.631880+0000","last_active":"2023-08-09T12:39:26.615209+0000","last_peered":"2023-08-09T12:39:26.615209+0000","last_clean":"2023-08-09T12:39:26.615209+0000","last_became_active":"2023-08-09T12:39:24.631638+0000","last_became_peered":"2023-08-09T12:39:24.631638+0000","last_unstale":"2023-08-09T12:39:26.615209+0000","last_undegraded":"2023-08-09T12:39:26.615209+0000","last_fullsized":"2023-08-09T12:39:26.615209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:55.511153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498112+0000","last_change":"2023-08-09T12:39:25.635263+0000","last_active":"2023-08-09T12:39:27.498112+0000","last_peered":"2023-08-09T12:39:27.498112+0000","last_clean":"2023-08-09T12:39:27.498112+0000","last_became_active":"2023-08-09T12:39:25.634710+0000","last_became_peered":"2023-08-09T12:39:25.634710+0000","last_unstale":"2023-08-09T12:39:27.498112+0000","last_undegraded":"2023-08-09T12:39:27.498112+0000","last_fullsized":"2023-08-09T12:39:27.498112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:47.710010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.409836+0000","last_change":"2023-08-09T12:39:24.633355+0000","last_active":"2023-08-09T12:39:27.409836+0000","last_peered":"2023-08-09T12:39:27.409836+0000","last_clean":"2023-08-09T12:39:27.409836+0000","last_became_active":"2023-08-09T12:39:24.633106+0000","last_became_peered":"2023-08-09T12:39:24.633106+0000","last_unstale":"2023-08-09T12:39:27.409836+0000","last_undegraded":"2023-08-09T12:39:27.409836+0000","last_fullsized":"2023-08-09T12:39:27.409836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:28.779966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615076+0000","last_change":"2023-08-09T12:39:25.652713+0000","last_active":"2023-08-09T12:39:26.615076+0000","last_peered":"2023-08-09T12:39:26.615076+0000","last_clean":"2023-08-09T12:39:26.615076+0000","last_became_active":"2023-08-09T12:39:25.652458+0000","last_became_peered":"2023-08-09T12:39:25.652458+0000","last_unstale":"2023-08-09T12:39:26.615076+0000","last_undegraded":"2023-08-09T12:39:26.615076+0000","last_fullsized":"2023-08-09T12:39:26.615076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:30.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.360627+0000","last_change":"2023-08-09T12:39:24.628762+0000","last_active":"2023-08-09T12:39:29.360627+0000","last_peered":"2023-08-09T12:39:29.360627+0000","last_clean":"2023-08-09T12:39:29.360627+0000","last_became_active":"2023-08-09T12:39:24.628281+0000","last_became_peered":"2023-08-09T12:39:24.628281+0000","last_unstale":"2023-08-09T12:39:29.360627+0000","last_undegraded":"2023-08-09T12:39:29.360627+0000","last_fullsized":"2023-08-09T12:39:29.360627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:38:38.001551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.613808+0000","last_change":"2023-08-09T12:39:25.643729+0000","last_active":"2023-08-09T12:39:26.613808+0000","last_peered":"2023-08-09T12:39:26.613808+0000","last_clean":"2023-08-09T12:39:26.613808+0000","last_became_active":"2023-08-09T12:39:25.643482+0000","last_became_peered":"2023-08-09T12:39:25.643482+0000","last_unstale":"2023-08-09T12:39:26.613808+0000","last_undegraded":"2023-08-09T12:39:26.613808+0000","last_fullsized":"2023-08-09T12:39:26.613808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:29.812405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.498943+0000","last_change":"2023-08-09T12:39:24.632751+0000","last_active":"2023-08-09T12:39:27.498943+0000","last_peered":"2023-08-09T12:39:27.498943+0000","last_clean":"2023-08-09T12:39:27.498943+0000","last_became_active":"2023-08-09T12:39:24.632458+0000","last_became_peered":"2023-08-09T12:39:24.632458+0000","last_unstale":"2023-08-09T12:39:27.498943+0000","last_undegraded":"2023-08-09T12:39:27.498943+0000","last_fullsized":"2023-08-09T12:39:27.498943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:32.805465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359374+0000","last_change":"2023-08-09T12:39:25.646421+0000","last_active":"2023-08-09T12:39:29.359374+0000","last_peered":"2023-08-09T12:39:29.359374+0000","last_clean":"2023-08-09T12:39:29.359374+0000","last_became_active":"2023-08-09T12:39:25.645698+0000","last_became_peered":"2023-08-09T12:39:25.645698+0000","last_unstale":"2023-08-09T12:39:29.359374+0000","last_undegraded":"2023-08-09T12:39:29.359374+0000","last_fullsized":"2023-08-09T12:39:29.359374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:48.378100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420675+0000","last_change":"2023-08-09T12:39:24.631472+0000","last_active":"2023-08-09T12:39:27.420675+0000","last_peered":"2023-08-09T12:39:27.420675+0000","last_clean":"2023-08-09T12:39:27.420675+0000","last_became_active":"2023-08-09T12:39:24.631123+0000","last_became_peered":"2023-08-09T12:39:24.631123+0000","last_unstale":"2023-08-09T12:39:27.420675+0000","last_undegraded":"2023-08-09T12:39:27.420675+0000","last_fullsized":"2023-08-09T12:39:27.420675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359437+0000","last_change":"2023-08-09T12:39:25.634781+0000","last_active":"2023-08-09T12:39:29.359437+0000","last_peered":"2023-08-09T12:39:29.359437+0000","last_clean":"2023-08-09T12:39:29.359437+0000","last_became_active":"2023-08-09T12:39:25.634211+0000","last_became_peered":"2023-08-09T12:39:25.634211+0000","last_unstale":"2023-08-09T12:39:29.359437+0000","last_undegraded":"2023-08-09T12:39:29.359437+0000","last_fullsized":"2023-08-09T12:39:29.359437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:33.925265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.420462+0000","last_change":"2023-08-09T12:39:24.631252+0000","last_active":"2023-08-09T12:39:27.420462+0000","last_peered":"2023-08-09T12:39:27.420462+0000","last_clean":"2023-08-09T12:39:27.420462+0000","last_became_active":"2023-08-09T12:39:24.630940+0000","last_became_peered":"2023-08-09T12:39:24.630940+0000","last_unstale":"2023-08-09T12:39:27.420462+0000","last_undegraded":"2023-08-09T12:39:27.420462+0000","last_fullsized":"2023-08-09T12:39:27.420462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:43.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.615783+0000","last_change":"2023-08-09T12:39:25.640158+0000","last_active":"2023-08-09T12:39:26.615783+0000","last_peered":"2023-08-09T12:39:26.615783+0000","last_clean":"2023-08-09T12:39:26.615783+0000","last_became_active":"2023-08-09T12:39:25.633644+0000","last_became_peered":"2023-08-09T12:39:25.633644+0000","last_unstale":"2023-08-09T12:39:26.615783+0000","last_undegraded":"2023-08-09T12:39:26.615783+0000","last_fullsized":"2023-08-09T12:39:26.615783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:26.616014+0000","last_change":"2023-08-09T12:39:24.625994+0000","last_active":"2023-08-09T12:39:26.616014+0000","last_peered":"2023-08-09T12:39:26.616014+0000","last_clean":"2023-08-09T12:39:26.616014+0000","last_became_active":"2023-08-09T12:39:24.624612+0000","last_became_peered":"2023-08-09T12:39:24.624612+0000","last_unstale":"2023-08-09T12:39:26.616014+0000","last_undegraded":"2023-08-09T12:39:26.616014+0000","last_fullsized":"2023-08-09T12:39:26.616014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:30.602392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:29.359468+0000","last_change":"2023-08-09T12:39:25.646605+0000","last_active":"2023-08-09T12:39:29.359468+0000","last_peered":"2023-08-09T12:39:29.359468+0000","last_clean":"2023-08-09T12:39:29.359468+0000","last_became_active":"2023-08-09T12:39:25.644813+0000","last_became_peered":"2023-08-09T12:39:25.644813+0000","last_unstale":"2023-08-09T12:39:29.359468+0000","last_undegraded":"2023-08-09T12:39:29.359468+0000","last_fullsized":"2023-08-09T12:39:29.359468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:24.599174+0000","last_clean_scrub_stamp":"2023-08-09T12:39:24.599174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:04:42.274273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-09T12:39:27.499428+0000","last_change":"2023-08-09T12:39:24.635709+0000","last_active":"2023-08-09T12:39:27.499428+0000","last_peered":"2023-08-09T12:39:27.499428+0000","last_clean":"2023-08-09T12:39:27.499428+0000","last_became_active":"2023-08-09T12:39:24.633560+0000","last_became_peered":"2023-08-09T12:39:24.633560+0000","last_unstale":"2023-08-09T12:39:27.499428+0000","last_undegraded":"2023-08-09T12:39:27.499428+0000","last_fullsized":"2023-08-09T12:39:27.499428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:23.594312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:23.594312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194642,"statfs":{"total":200000000,"available":199313694,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":92,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195219,"statfs":{"total":200000000,"available":199905238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":93,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195218,"statfs":{"total":200000000,"available":199904222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905800,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314940,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]}],"pool_statfs":[]}} 2023-08-09T12:39:34.613 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-09T12:39:34.613 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-09T12:39:34.613 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-09T12:39:34.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-09T12:39:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.871+0000 7fa89bfff640 1 Processor -- start 2023-08-09T12:39:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.871+0000 7fa89bfff640 1 -- start start 2023-08-09T12:39:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.872+0000 7fa89bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa89c0cb7f0 0x7fa89c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.872+0000 7fa89bfff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c06abb0 con 0x7fa89c15cb30 2023-08-09T12:39:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.872+0000 7fa89bfff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c06cc10 con 0x7fa89c072f60 2023-08-09T12:39:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.872+0000 7fa89bfff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c06ae90 con 0x7fa89c0cb7f0 2023-08-09T12:39:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.872+0000 7fa89affd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa89c15cb30 0x7fa89c072850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49052/0 (socket says 172.21.15.17:49052) 2023-08-09T12:39:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.872+0000 7fa89affd640 1 -- 172.21.15.17:0/1250024574 learned_addr learned my addr 172.21.15.17:0/1250024574 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.872+0000 7fa89b7fe640 1 --2- 172.21.15.17:0/1250024574 >> v2:172.21.15.17:3300/0 conn(0x7fa89c0cb7f0 0x7fa89c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.873+0000 7fa89b7fe640 1 -- 172.21.15.17:0/1250024574 >> v1:172.21.15.142:6789/0 conn(0x7fa89c072f60 legacy=0x7fa89c06b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.873+0000 7fa89b7fe640 1 -- 172.21.15.17:0/1250024574 >> v1:172.21.15.17:6789/0 conn(0x7fa89c15cb30 legacy=0x7fa89c072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.873+0000 7fa89b7fe640 1 -- 172.21.15.17:0/1250024574 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c06cef0 con 0x7fa89c0cb7f0 2023-08-09T12:39:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.873+0000 7fa899ffb640 1 -- 172.21.15.17:0/1250024574 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793140941 0 0) 0x7fa89c06abb0 con 0x7fa89c15cb30 2023-08-09T12:39:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.874+0000 7fa89b7fe640 1 --2- 172.21.15.17:0/1250024574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c0cb7f0 0x7fa89c06bed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8940097a0 tx=0x7fa89402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ea669a3c44cd79 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.874+0000 7fa899ffb640 1 -- 172.21.15.17:0/1250024574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894031830 con 0x7fa89c0cb7f0 2023-08-09T12:39:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.874+0000 7fa899ffb640 1 -- 172.21.15.17:0/1250024574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894031990 con 0x7fa89c0cb7f0 2023-08-09T12:39:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.874+0000 7fa899ffb640 1 -- 172.21.15.17:0/1250024574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894031d20 con 0x7fa89c0cb7f0 2023-08-09T12:39:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.875+0000 7fa89bfff640 1 -- 172.21.15.17:0/1250024574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c0cb7f0 msgr2=0x7fa89c06bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.875+0000 7fa89bfff640 1 --2- 172.21.15.17:0/1250024574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c0cb7f0 0x7fa89c06bed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8940097a0 tx=0x7fa89402b8d0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.875+0000 7fa89bfff640 1 -- 172.21.15.17:0/1250024574 shutdown_connections 2023-08-09T12:39:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.875+0000 7fa89bfff640 1 --2- 172.21.15.17:0/1250024574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c0cb7f0 0x7fa89c06bed0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.875+0000 7fa89bfff640 1 -- 172.21.15.17:0/1250024574 >> 172.21.15.17:0/1250024574 conn(0x7fa89c0cf7f0 msgr2=0x7fa89c0cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.875+0000 7fa89bfff640 1 -- 172.21.15.17:0/1250024574 shutdown_connections 2023-08-09T12:39:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.875+0000 7fa89bfff640 1 -- 172.21.15.17:0/1250024574 wait complete. 2023-08-09T12:39:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.877+0000 7fa89bfff640 1 Processor -- start 2023-08-09T12:39:34.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.877+0000 7fa89bfff640 1 -- start start 2023-08-09T12:39:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c072f60 0x7fa89c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89bfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c0cb7f0 0x7fa89c1f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c15cb30 0x7fa89c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89bfff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c159300 con 0x7fa89c15cb30 2023-08-09T12:39:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89bfff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f26b0 con 0x7fa89c0cb7f0 2023-08-09T12:39:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89bfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f2990 con 0x7fa89c072f60 2023-08-09T12:39:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c15cb30 0x7fa89c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c15cb30 0x7fa89c15cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56194/0 (socket says 172.21.15.17:56194) 2023-08-09T12:39:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89b7fe640 1 -- 172.21.15.17:0/1550833639 learned_addr learned my addr 172.21.15.17:0/1550833639 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89a7fc640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c0cb7f0 0x7fa89c1f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89b7fe640 1 -- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c072f60 msgr2=0x7fa89c157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89affd640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c072f60 0x7fa89c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89b7fe640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c072f60 0x7fa89c157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89b7fe640 1 -- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c0cb7f0 msgr2=0x7fa89c1f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89b7fe640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c0cb7f0 0x7fa89c1f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89b7fe640 1 -- 172.21.15.17:0/1550833639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894009400 con 0x7fa89c15cb30 2023-08-09T12:39:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.878+0000 7fa89a7fc640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c0cb7f0 0x7fa89c1f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.879+0000 7fa89b7fe640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c15cb30 0x7fa89c15cfe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa8940098c0 tx=0x7fa8940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.879+0000 7fa8837fe640 1 -- 172.21.15.17:0/1550833639 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89403b9f0 con 0x7fa89c15cb30 2023-08-09T12:39:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.879+0000 7fa8837fe640 1 -- 172.21.15.17:0/1550833639 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89403bb50 con 0x7fa89c15cb30 2023-08-09T12:39:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.879+0000 7fa8837fe640 1 -- 172.21.15.17:0/1550833639 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940453f0 con 0x7fa89c15cb30 2023-08-09T12:39:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.879+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c1f2c70 con 0x7fa89c15cb30 2023-08-09T12:39:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.879+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c1f3230 con 0x7fa89c15cb30 2023-08-09T12:39:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.880+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c04e390 con 0x7fa89c15cb30 2023-08-09T12:39:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.881+0000 7fa8837fe640 1 -- 172.21.15.17:0/1550833639 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa894045550 con 0x7fa89c15cb30 2023-08-09T12:39:34.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.882+0000 7fa8837fe640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88806a080 0x7fa88806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:34.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.882+0000 7fa8837fe640 1 -- 172.21.15.17:0/1550833639 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8940aa810 con 0x7fa89c15cb30 2023-08-09T12:39:34.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.883+0000 7fa89affd640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88806a080 0x7fa88806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:34.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.884+0000 7fa89affd640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88806a080 0x7fa88806c540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0012e0 tx=0x7fa88c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:34.886+0000 7fa8837fe640 1 -- 172.21.15.17:0/1550833639 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa894075ef0 con 0x7fa89c15cb30 2023-08-09T12:39:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.115+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa89c06a090 con 0x7fa89c15cb30 2023-08-09T12:39:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.115+0000 7fa8837fe640 1 -- 172.21.15.17:0/1550833639 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa894079510 con 0x7fa89c15cb30 2023-08-09T12:39:35.119 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:35.119 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-09T12:39:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88806a080 msgr2=0x7fa88806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88806a080 0x7fa88806c540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0012e0 tx=0x7fa88c009040 comp rx=0 tx=0).stop 2023-08-09T12:39:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c15cb30 msgr2=0x7fa89c15cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c15cb30 0x7fa89c15cfe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa8940098c0 tx=0x7fa8940046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 shutdown_connections 2023-08-09T12:39:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88806a080 0x7fa88806c540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89c15cb30 0x7fa89c15cfe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c0cb7f0 0x7fa89c1f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 --2- 172.21.15.17:0/1550833639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c072f60 0x7fa89c157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 >> 172.21.15.17:0/1550833639 conn(0x7fa89c0cf7f0 msgr2=0x7fa89c15f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 shutdown_connections 2023-08-09T12:39:35.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.118+0000 7fa89bfff640 1 -- 172.21.15.17:0/1550833639 wait complete. 2023-08-09T12:39:35.138 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-09T12:39:35.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:35.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.363+0000 7fd6447c4640 1 Processor -- start 2023-08-09T12:39:35.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.364+0000 7fd6447c4640 1 -- start start 2023-08-09T12:39:35.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.365+0000 7fd6447c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd63c0b3b40 0x7fd63c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.365+0000 7fd6447c4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd63c0cc630 0x7fd63c0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.365+0000 7fd6447c4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c06c990 con 0x7fd63c0adc40 2023-08-09T12:39:35.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.365+0000 7fd6447c4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0ae020 con 0x7fd63c0cc630 2023-08-09T12:39:35.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.365+0000 7fd6447c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0b2250 con 0x7fd63c0b3b40 2023-08-09T12:39:35.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.366+0000 7fd642d61640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd63c0cc630 0x7fd63c0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.366+0000 7fd642d61640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd63c0cc630 0x7fd63c0ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56210/0 (socket says 172.21.15.17:56210) 2023-08-09T12:39:35.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.366+0000 7fd642d61640 1 -- 172.21.15.17:0/4170352732 learned_addr learned my addr 172.21.15.17:0/4170352732 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:35.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.366+0000 7fd641d5f640 1 --2- 172.21.15.17:0/4170352732 >> v2:172.21.15.142:3300/0 conn(0x7fd63c0b3b40 0x7fd63c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.366+0000 7fd642d61640 1 -- 172.21.15.17:0/4170352732 >> v2:172.21.15.142:3300/0 conn(0x7fd63c0b3b40 msgr2=0x7fd63c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:35.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.366+0000 7fd642d61640 1 --2- 172.21.15.17:0/4170352732 >> v2:172.21.15.142:3300/0 conn(0x7fd63c0b3b40 0x7fd63c0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.367+0000 7fd642d61640 1 -- 172.21.15.17:0/4170352732 >> v1:172.21.15.142:6789/0 conn(0x7fd63c0adc40 legacy=0x7fd63c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.367+0000 7fd642d61640 1 -- 172.21.15.17:0/4170352732 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c0b2530 con 0x7fd63c0cc630 2023-08-09T12:39:35.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.368+0000 7fd642d61640 1 --2- 172.21.15.17:0/4170352732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0ccaa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0b48a0 tx=0x7fd63402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c2c74362488db7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:35.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.368+0000 7fd64155e640 1 -- 172.21.15.17:0/4170352732 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63402cb10 con 0x7fd63c0cc630 2023-08-09T12:39:35.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.368+0000 7fd64155e640 1 -- 172.21.15.17:0/4170352732 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63402cc70 con 0x7fd63c0cc630 2023-08-09T12:39:35.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.368+0000 7fd64155e640 1 -- 172.21.15.17:0/4170352732 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340343f0 con 0x7fd63c0cc630 2023-08-09T12:39:35.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.369+0000 7fd6447c4640 1 -- 172.21.15.17:0/4170352732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 msgr2=0x7fd63c0ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.369+0000 7fd6447c4640 1 --2- 172.21.15.17:0/4170352732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0ccaa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0b48a0 tx=0x7fd63402bf70 comp rx=0 tx=0).stop 2023-08-09T12:39:35.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.369+0000 7fd6447c4640 1 -- 172.21.15.17:0/4170352732 shutdown_connections 2023-08-09T12:39:35.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.369+0000 7fd6447c4640 1 --2- 172.21.15.17:0/4170352732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0ccaa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.369+0000 7fd6447c4640 1 --2- 172.21.15.17:0/4170352732 >> v2:172.21.15.142:3300/0 conn(0x7fd63c0b3b40 0x7fd63c0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.369+0000 7fd6447c4640 1 -- 172.21.15.17:0/4170352732 >> 172.21.15.17:0/4170352732 conn(0x7fd63c0cb1b0 msgr2=0x7fd63c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:35.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.369+0000 7fd6447c4640 1 -- 172.21.15.17:0/4170352732 shutdown_connections 2023-08-09T12:39:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.369+0000 7fd6447c4640 1 -- 172.21.15.17:0/4170352732 wait complete. 2023-08-09T12:39:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.371+0000 7fd6447c4640 1 Processor -- start 2023-08-09T12:39:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.371+0000 7fd6447c4640 1 -- start start 2023-08-09T12:39:35.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.372+0000 7fd6447c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd63c0adc40 0x7fd63c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.372+0000 7fd6447c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd63c0b3b40 0x7fd63c14fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.372+0000 7fd6447c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.372+0000 7fd6447c4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c157410 con 0x7fd63c0cc630 2023-08-09T12:39:35.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.372+0000 7fd6447c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c15ac30 con 0x7fd63c0b3b40 2023-08-09T12:39:35.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.372+0000 7fd6447c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0c35a0 con 0x7fd63c0adc40 2023-08-09T12:39:35.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642d61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642d61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0c2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56214/0 (socket says 172.21.15.17:56214) 2023-08-09T12:39:35.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642d61640 1 -- 172.21.15.17:0/3666561551 learned_addr learned my addr 172.21.15.17:0/3666561551 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:35.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd641d5f640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd63c0b3b40 0x7fd63c14fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642560640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd63c0adc40 0x7fd63c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642d61640 1 -- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd63c0adc40 msgr2=0x7fd63c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642d61640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd63c0adc40 0x7fd63c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642d61640 1 -- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd63c0b3b40 msgr2=0x7fd63c14fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642d61640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd63c0b3b40 0x7fd63c14fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.373+0000 7fd642d61640 1 -- 172.21.15.17:0/3666561551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634009b30 con 0x7fd63c0cc630 2023-08-09T12:39:35.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.374+0000 7fd642d61640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0c2be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd634036040 tx=0x7fd634004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:35.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.374+0000 7fd632ffd640 1 -- 172.21.15.17:0/3666561551 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634009510 con 0x7fd63c0cc630 2023-08-09T12:39:35.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.374+0000 7fd632ffd640 1 -- 172.21.15.17:0/3666561551 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63403e450 con 0x7fd63c0cc630 2023-08-09T12:39:35.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.374+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c156a70 con 0x7fd63c0cc630 2023-08-09T12:39:35.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.374+0000 7fd632ffd640 1 -- 172.21.15.17:0/3666561551 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63403e800 con 0x7fd63c0cc630 2023-08-09T12:39:35.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.374+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c157030 con 0x7fd63c0cc630 2023-08-09T12:39:35.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.375+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c070140 con 0x7fd63c0cc630 2023-08-09T12:39:35.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.376+0000 7fd632ffd640 1 -- 172.21.15.17:0/3666561551 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd63403e960 con 0x7fd63c0cc630 2023-08-09T12:39:35.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.377+0000 7fd632ffd640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd62006a050 0x7fd62006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.377+0000 7fd632ffd640 1 -- 172.21.15.17:0/3666561551 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6340ab3e0 con 0x7fd63c0cc630 2023-08-09T12:39:35.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.378+0000 7fd642560640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd62006a050 0x7fd62006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.379+0000 7fd642560640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd62006a050 0x7fd62006c510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0caed0 tx=0x7fd638009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:35.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.381+0000 7fd632ffd640 1 -- 172.21.15.17:0/3666561551 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd63c070140 con 0x7fd63c0cc630 2023-08-09T12:39:35.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.578+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd63c157550 con 0x7fd63c0cc630 2023-08-09T12:39:35.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.581+0000 7fd632ffd640 1 -- 172.21.15.17:0/3666561551 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fd63c157550 con 0x7fd63c0cc630 2023-08-09T12:39:35.585 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:35.585 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:35.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd62006a050 msgr2=0x7fd62006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd62006a050 0x7fd62006c510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0caed0 tx=0x7fd638009040 comp rx=0 tx=0).stop 2023-08-09T12:39:35.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 msgr2=0x7fd63c0c2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0c2be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd634036040 tx=0x7fd634004a40 comp rx=0 tx=0).stop 2023-08-09T12:39:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 shutdown_connections 2023-08-09T12:39:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd62006a050 0x7fd62006c510 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63c0cc630 0x7fd63c0c2be0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd63c0b3b40 0x7fd63c14fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 --2- 172.21.15.17:0/3666561551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd63c0adc40 0x7fd63c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 >> 172.21.15.17:0/3666561551 conn(0x7fd63c0cb1b0 msgr2=0x7fd63c06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 shutdown_connections 2023-08-09T12:39:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.584+0000 7fd6447c4640 1 -- 172.21.15.17:0/3666561551 wait complete. 2023-08-09T12:39:35.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:39:35.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:39:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.835+0000 7f49d680f640 1 Processor -- start 2023-08-09T12:39:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.835+0000 7f49d680f640 1 -- start start 2023-08-09T12:39:35.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.837+0000 7f49d680f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d01609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.837+0000 7f49d680f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49d00b8420 0x7f49d00cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.837+0000 7f49d680f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d00d0f00 con 0x7f49d015cf20 2023-08-09T12:39:35.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.837+0000 7f49d680f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d01611f0 con 0x7f49d00b8420 2023-08-09T12:39:35.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.837+0000 7f49d680f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d01614d0 con 0x7f49d015cb40 2023-08-09T12:39:35.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d580d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d01609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d500c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49d00b8420 0x7f49d00cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d500c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49d00b8420 0x7f49d00cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:34116/0 (socket says 172.21.15.17:34116) 2023-08-09T12:39:35.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d500c640 1 -- 172.21.15.17:0/1168124218 learned_addr learned my addr 172.21.15.17:0/1168124218 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:35.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d600e640 1 --1- 172.21.15.17:0/1168124218 >> v1:172.21.15.142:6789/0 conn(0x7f49d015cf20 0x7f49d00697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:50112/0 (socket says 172.21.15.17:50112) 2023-08-09T12:39:35.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d500c640 1 -- 172.21.15.17:0/1168124218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 msgr2=0x7f49d01609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:35.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d500c640 1 --2- 172.21.15.17:0/1168124218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d01609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d500c640 1 -- 172.21.15.17:0/1168124218 >> v1:172.21.15.142:6789/0 conn(0x7f49d015cf20 legacy=0x7f49d00697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.838+0000 7f49d500c640 1 -- 172.21.15.17:0/1168124218 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d01617b0 con 0x7f49d00b8420 2023-08-09T12:39:35.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.840+0000 7f49d500c640 1 --2- 172.21.15.17:0/1168124218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 0x7f49d00cd860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009870 tx=0x7f49c002ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1498889d82006cce server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:35.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.840+0000 7f49d480b640 1 -- 172.21.15.17:0/1168124218 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c002f830 con 0x7f49d00b8420 2023-08-09T12:39:35.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.840+0000 7f49d480b640 1 -- 172.21.15.17:0/1168124218 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c002f990 con 0x7f49d00b8420 2023-08-09T12:39:35.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.840+0000 7f49d480b640 1 -- 172.21.15.17:0/1168124218 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c002fd20 con 0x7f49d00b8420 2023-08-09T12:39:35.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.841+0000 7f49d680f640 1 -- 172.21.15.17:0/1168124218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 msgr2=0x7f49d00cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.841+0000 7f49d680f640 1 --2- 172.21.15.17:0/1168124218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 0x7f49d00cd860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009870 tx=0x7f49c002ba10 comp rx=0 tx=0).stop 2023-08-09T12:39:35.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.841+0000 7f49d680f640 1 -- 172.21.15.17:0/1168124218 shutdown_connections 2023-08-09T12:39:35.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.841+0000 7f49d680f640 1 --2- 172.21.15.17:0/1168124218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 0x7f49d00cd860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.841+0000 7f49d680f640 1 --2- 172.21.15.17:0/1168124218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d01609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.841+0000 7f49d680f640 1 -- 172.21.15.17:0/1168124218 >> 172.21.15.17:0/1168124218 conn(0x7f49d00d2ab0 msgr2=0x7f49d00d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:35.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.841+0000 7f49d680f640 1 -- 172.21.15.17:0/1168124218 shutdown_connections 2023-08-09T12:39:35.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.841+0000 7f49d680f640 1 -- 172.21.15.17:0/1168124218 wait complete. 2023-08-09T12:39:35.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.843+0000 7f49d680f640 1 Processor -- start 2023-08-09T12:39:35.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.843+0000 7f49d680f640 1 -- start start 2023-08-09T12:39:35.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d680f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 0x7f49d0153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d680f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d00c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d680f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49d015cf20 0x7f49d00cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d680f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0154030 con 0x7f49d015cf20 2023-08-09T12:39:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d680f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00c9390 con 0x7f49d00b8420 2023-08-09T12:39:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d680f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00c6a90 con 0x7f49d015cb40 2023-08-09T12:39:35.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d600e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49d015cf20 0x7f49d00cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d600e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49d015cf20 0x7f49d00cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56218/0 (socket says 172.21.15.17:56218) 2023-08-09T12:39:35.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.844+0000 7f49d600e640 1 -- 172.21.15.17:0/3279715895 learned_addr learned my addr 172.21.15.17:0/3279715895 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:35.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d580d640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 0x7f49d0153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d500c640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d00c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d600e640 1 -- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 msgr2=0x7f49d00c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d600e640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d00c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d600e640 1 -- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 msgr2=0x7f49d0153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d600e640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 0x7f49d0153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d600e640 1 -- 172.21.15.17:0/3279715895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00094d0 con 0x7f49d015cf20 2023-08-09T12:39:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d580d640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 0x7f49d0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d500c640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d00c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:35.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49d600e640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49d015cf20 0x7f49d00cbab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c400 tx=0x7f49c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:35.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.845+0000 7f49c67fc640 1 -- 172.21.15.17:0/3279715895 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80074e0 con 0x7f49d015cf20 2023-08-09T12:39:35.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.846+0000 7f49c67fc640 1 -- 172.21.15.17:0/3279715895 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8007640 con 0x7f49d015cf20 2023-08-09T12:39:35.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.846+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d00c8dd0 con 0x7f49d015cf20 2023-08-09T12:39:35.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.846+0000 7f49c67fc640 1 -- 172.21.15.17:0/3279715895 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80049e0 con 0x7f49d015cf20 2023-08-09T12:39:35.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.846+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d00c74b0 con 0x7f49d015cf20 2023-08-09T12:39:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.847+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d004e390 con 0x7f49d015cf20 2023-08-09T12:39:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.848+0000 7f49c67fc640 1 -- 172.21.15.17:0/3279715895 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f49c8004b40 con 0x7f49d015cf20 2023-08-09T12:39:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.849+0000 7f49c67fc640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f49b406a050 0x7f49b406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.849+0000 7f49c67fc640 1 -- 172.21.15.17:0/3279715895 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49c8088060 con 0x7f49d015cf20 2023-08-09T12:39:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.850+0000 7f49d580d640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f49b406a050 0x7f49b406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.851+0000 7f49d580d640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f49b406a050 0x7f49b406c510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49d00cc600 tx=0x7f49cc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:35.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:35.854+0000 7f49c67fc640 1 -- 172.21.15.17:0/3279715895 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f49c80ba7b0 con 0x7f49d015cf20 2023-08-09T12:39:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.048+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49d00ccfe0 con 0x7f49d015cf20 2023-08-09T12:39:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.049+0000 7f49c67fc640 1 -- 172.21.15.17:0/3279715895 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49c8057140 con 0x7f49d015cf20 2023-08-09T12:39:36.052 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:39:36.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f49b406a050 msgr2=0x7f49b406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f49b406a050 0x7f49b406c510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49d00cc600 tx=0x7f49cc00b040 comp rx=0 tx=0).stop 2023-08-09T12:39:36.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49d015cf20 msgr2=0x7f49d00cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49d015cf20 0x7f49d00cbab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c400 tx=0x7f49c800c8c0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 shutdown_connections 2023-08-09T12:39:36.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f49b406a050 0x7f49b406c510 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49d015cf20 0x7f49d00cbab0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49d015cb40 0x7f49d00c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 --2- 172.21.15.17:0/3279715895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49d00b8420 0x7f49d0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 >> 172.21.15.17:0/3279715895 conn(0x7f49d00d2ab0 msgr2=0x7f49d00b70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:36.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 shutdown_connections 2023-08-09T12:39:36.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.052+0000 7f49d680f640 1 -- 172.21.15.17:0/3279715895 wait complete. 2023-08-09T12:39:36.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:39:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.298+0000 7f87e1e8c640 1 Processor -- start 2023-08-09T12:39:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.298+0000 7f87e1e8c640 1 -- start start 2023-08-09T12:39:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.299+0000 7f87e1e8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f87dc15ce90 0x7f87dc1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.299+0000 7f87e1e8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc0d29d0 0x7f87dc0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.299+0000 7f87e1e8c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc0b6460 con 0x7f87dc0b6000 2023-08-09T12:39:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.299+0000 7f87e1e8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc0d33a0 con 0x7f87dc15ce90 2023-08-09T12:39:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.299+0000 7f87e1e8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0cdd10 con 0x7f87dc0d29d0 2023-08-09T12:39:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.300+0000 7f87daffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f87dc0b6000 0x7f87dc0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49058/0 (socket says 172.21.15.17:49058) 2023-08-09T12:39:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.300+0000 7f87daffd640 1 -- 172.21.15.17:0/199707148 learned_addr learned my addr 172.21.15.17:0/199707148 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.300+0000 7f87db7fe640 1 --2- 172.21.15.17:0/199707148 >> v2:172.21.15.142:3300/0 conn(0x7f87dc15ce90 0x7f87dc1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.300+0000 7f87dbfff640 1 --2- 172.21.15.17:0/199707148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc0d29d0 0x7f87dc0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.300+0000 7f87da7fc640 1 -- 172.21.15.17:0/199707148 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659543654 0 0) 0x7f87dc0b6460 con 0x7f87dc0b6000 2023-08-09T12:39:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.300+0000 7f87da7fc640 1 -- 172.21.15.17:0/199707148 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c4003520 con 0x7f87dc0b6000 2023-08-09T12:39:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.301+0000 7f87db7fe640 1 -- 172.21.15.17:0/199707148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc0d29d0 msgr2=0x7f87dc0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.301+0000 7f87db7fe640 1 --2- 172.21.15.17:0/199707148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc0d29d0 0x7f87dc0d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.301+0000 7f87db7fe640 1 -- 172.21.15.17:0/199707148 >> v1:172.21.15.17:6789/0 conn(0x7f87dc0b6000 legacy=0x7f87dc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.301+0000 7f87da7fc640 1 -- 172.21.15.17:0/199707148 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3289669458 0 0) 0x7f87c4003520 con 0x7f87dc0b6000 2023-08-09T12:39:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.301+0000 7f87db7fe640 1 -- 172.21.15.17:0/199707148 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0cdff0 con 0x7f87dc15ce90 2023-08-09T12:39:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.302+0000 7f87db7fe640 1 --2- 172.21.15.17:0/199707148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87dc15ce90 0x7f87dc1616e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009d90 tx=0x7f87cc02bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=486a10b8b5388fb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87da7fc640 1 -- 172.21.15.17:0/199707148 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0001670 con 0x7f87dc15ce90 2023-08-09T12:39:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87da7fc640 1 -- 172.21.15.17:0/199707148 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc02c8a0 con 0x7f87dc15ce90 2023-08-09T12:39:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87da7fc640 1 -- 172.21.15.17:0/199707148 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc02cc30 con 0x7f87dc15ce90 2023-08-09T12:39:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87e1e8c640 1 -- 172.21.15.17:0/199707148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87dc15ce90 msgr2=0x7f87dc1616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/199707148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87dc15ce90 0x7f87dc1616e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009d90 tx=0x7f87cc02bd70 comp rx=0 tx=0).stop 2023-08-09T12:39:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87e1e8c640 1 -- 172.21.15.17:0/199707148 shutdown_connections 2023-08-09T12:39:36.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/199707148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc0d29d0 0x7f87dc0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/199707148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87dc15ce90 0x7f87dc1616e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87e1e8c640 1 -- 172.21.15.17:0/199707148 >> 172.21.15.17:0/199707148 conn(0x7f87dc06fde0 msgr2=0x7f87dc0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:36.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87e1e8c640 1 -- 172.21.15.17:0/199707148 shutdown_connections 2023-08-09T12:39:36.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.303+0000 7f87e1e8c640 1 -- 172.21.15.17:0/199707148 wait complete. 2023-08-09T12:39:36.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.305+0000 7f87e1e8c640 1 Processor -- start 2023-08-09T12:39:36.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.305+0000 7f87e1e8c640 1 -- start start 2023-08-09T12:39:36.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.306+0000 7f87e1e8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87dc0b6000 0x7f87dc0b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.306+0000 7f87e1e8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87dc0d29d0 0x7f87dc0a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.306+0000 7f87e1e8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc15ce90 0x7f87dc0c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.306+0000 7f87e1e8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc15c1a0 con 0x7f87dc0d29d0 2023-08-09T12:39:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.306+0000 7f87e1e8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc149980 con 0x7f87dc0b6000 2023-08-09T12:39:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.306+0000 7f87e1e8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc148d70 con 0x7f87dc15ce90 2023-08-09T12:39:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.306+0000 7f87daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87dc0d29d0 0x7f87dc0a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87dc0d29d0 0x7f87dc0a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56226/0 (socket says 172.21.15.17:56226) 2023-08-09T12:39:36.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87daffd640 1 -- 172.21.15.17:0/2857692302 learned_addr learned my addr 172.21.15.17:0/2857692302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87daffd640 1 -- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc15ce90 msgr2=0x7f87dc0c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87daffd640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc15ce90 0x7f87dc0c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87daffd640 1 -- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87dc0b6000 msgr2=0x7f87dc0b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87daffd640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87dc0b6000 0x7f87dc0b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87daffd640 1 -- 172.21.15.17:0/2857692302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc009a70 con 0x7f87dc0d29d0 2023-08-09T12:39:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87daffd640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87dc0d29d0 0x7f87dc0a9560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c710 tx=0x7f87d000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87c3fff640 1 -- 172.21.15.17:0/2857692302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0005ad0 con 0x7f87dc0d29d0 2023-08-09T12:39:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.307+0000 7f87c3fff640 1 -- 172.21.15.17:0/2857692302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d0005c30 con 0x7f87dc0d29d0 2023-08-09T12:39:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.308+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc149050 con 0x7f87dc0d29d0 2023-08-09T12:39:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.308+0000 7f87c3fff640 1 -- 172.21.15.17:0/2857692302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0007070 con 0x7f87dc0d29d0 2023-08-09T12:39:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.308+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc149610 con 0x7f87dc0d29d0 2023-08-09T12:39:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.309+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc067a80 con 0x7f87dc0d29d0 2023-08-09T12:39:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.310+0000 7f87c3fff640 1 -- 172.21.15.17:0/2857692302 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f87d00071f0 con 0x7f87dc0d29d0 2023-08-09T12:39:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.311+0000 7f87c3fff640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87c806a0a0 0x7f87c806c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.311+0000 7f87c3fff640 1 -- 172.21.15.17:0/2857692302 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87d0088400 con 0x7f87dc0d29d0 2023-08-09T12:39:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.311+0000 7f87db7fe640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87c806a0a0 0x7f87c806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.312+0000 7f87db7fe640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87c806a0a0 0x7f87c806c560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87cc036000 tx=0x7f87cc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.315+0000 7f87c3fff640 1 -- 172.21.15.17:0/2857692302 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f87d0053ad0 con 0x7f87dc0d29d0 2023-08-09T12:39:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.509+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87dc149ac0 con 0x7f87dc0d29d0 2023-08-09T12:39:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.510+0000 7f87c3fff640 1 -- 172.21.15.17:0/2857692302 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87d00570f0 con 0x7f87dc0d29d0 2023-08-09T12:39:36.513 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:39:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87c806a0a0 msgr2=0x7f87c806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87c806a0a0 0x7f87c806c560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87cc036000 tx=0x7f87cc02e000 comp rx=0 tx=0).stop 2023-08-09T12:39:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87dc0d29d0 msgr2=0x7f87dc0a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87dc0d29d0 0x7f87dc0a9560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c710 tx=0x7f87d000cbd0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 shutdown_connections 2023-08-09T12:39:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87c806a0a0 0x7f87c806c560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87dc15ce90 0x7f87dc0c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87dc0d29d0 0x7f87dc0a9560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 --2- 172.21.15.17:0/2857692302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87dc0b6000 0x7f87dc0b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.512+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 >> 172.21.15.17:0/2857692302 conn(0x7f87dc06fde0 msgr2=0x7f87dc0ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:36.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.513+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 shutdown_connections 2023-08-09T12:39:36.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.513+0000 7f87e1e8c640 1 -- 172.21.15.17:0/2857692302 wait complete. 2023-08-09T12:39:36.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:39:36.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.763+0000 7f9fa8099640 1 Processor -- start 2023-08-09T12:39:36.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.764+0000 7f9fa8099640 1 -- start start 2023-08-09T12:39:36.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.765+0000 7f9fa8099640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa0158840 0x7f9fa00af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.765+0000 7f9fa8099640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa00b0220 con 0x7f9fa00cf0f0 2023-08-09T12:39:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.765+0000 7f9fa8099640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa015e7f0 con 0x7f9fa00afce0 2023-08-09T12:39:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.765+0000 7f9fa8099640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0158c20 con 0x7f9fa0158840 2023-08-09T12:39:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.766+0000 7f9fa6636640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9fa00cf0f0 0x7f9fa015b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49060/0 (socket says 172.21.15.17:49060) 2023-08-09T12:39:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.766+0000 7f9fa6636640 1 -- 172.21.15.17:0/1125025629 learned_addr learned my addr 172.21.15.17:0/1125025629 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.766+0000 7f9fa5e35640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa0158840 0x7f9fa00af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.766+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320570290 0 0) 0x7f9fa00b0220 con 0x7f9fa00cf0f0 2023-08-09T12:39:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.766+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f8c003520 con 0x7f9fa00cf0f0 2023-08-09T12:39:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2857236078 0 0) 0x7f9f8c003520 con 0x7f9fa00cf0f0 2023-08-09T12:39:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa0158840 msgr2=0x7f9fa00af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa0158840 0x7f9fa00af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 >> v1:172.21.15.142:6789/0 conn(0x7f9fa00afce0 legacy=0x7f9fa00ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa015ead0 con 0x7f9fa00cf0f0 2023-08-09T12:39:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f9f980019f0 con 0x7f9fa00cf0f0 2023-08-09T12:39:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 >> v1:172.21.15.17:6789/0 conn(0x7f9fa00cf0f0 legacy=0x7f9fa015b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa0158840 0x7f9f8c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c003f20 0x7f9f8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f8c004d00 0x7f9f8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0158c20 con 0x7f9f8c004d00 2023-08-09T12:39:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c00ba60 con 0x7f9f8c003f20 2023-08-09T12:39:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c00bc20 con 0x7f9fa0158840 2023-08-09T12:39:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa6636640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f8c004d00 0x7f9f8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa5e35640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa0158840 0x7f9f8c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.767+0000 7f9fa5634640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c003f20 0x7f9f8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.768+0000 7f9fa6636640 1 -- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa0158840 msgr2=0x7f9f8c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.768+0000 7f9fa6636640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa0158840 0x7f9f8c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.768+0000 7f9fa6636640 1 -- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c003f20 msgr2=0x7f9f8c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.768+0000 7f9fa6636640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c003f20 0x7f9f8c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.768+0000 7f9fa6636640 1 -- 172.21.15.17:0/1125025629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c003520 con 0x7f9f8c004d00 2023-08-09T12:39:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.769+0000 7f9fa6636640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f8c004d00 0x7f9f8c005180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800a830 tx=0x7f9f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19ce1db1eef1dae server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.769+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980072d0 con 0x7f9f8c004d00 2023-08-09T12:39:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.769+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9802f070 con 0x7f9f8c004d00 2023-08-09T12:39:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.769+0000 7f9fa4e33640 1 -- 172.21.15.17:0/1125025629 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980076f0 con 0x7f9f8c004d00 2023-08-09T12:39:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.770+0000 7f9fa8099640 1 -- 172.21.15.17:0/1125025629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f8c004d00 msgr2=0x7f9f8c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.770+0000 7f9fa8099640 1 --2- 172.21.15.17:0/1125025629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f8c004d00 0x7f9f8c005180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800a830 tx=0x7f9f8c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.770+0000 7f9fa6636640 1 -- 172.21.15.17:0/1125025629 reap_dead start 2023-08-09T12:39:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.770+0000 7f9fa8099640 1 -- 172.21.15.17:0/1125025629 shutdown_connections 2023-08-09T12:39:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.770+0000 7f9fa8099640 1 -- 172.21.15.17:0/1125025629 >> 172.21.15.17:0/1125025629 conn(0x7f9fa0069be0 msgr2=0x7f9fa0069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.770+0000 7f9fa8099640 1 -- 172.21.15.17:0/1125025629 shutdown_connections 2023-08-09T12:39:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.770+0000 7f9fa8099640 1 -- 172.21.15.17:0/1125025629 wait complete. 2023-08-09T12:39:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.772+0000 7f9fa8099640 1 Processor -- start 2023-08-09T12:39:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.772+0000 7f9fa8099640 1 -- start start 2023-08-09T12:39:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.773+0000 7f9fa8099640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c004d00 0x7f9fa0152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.773+0000 7f9fa8099640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa00c7b10 0x7f9fa00c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.773+0000 7f9fa8099640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa015c3a0 0x7f9fa015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.773+0000 7f9fa8099640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00c9140 con 0x7f9fa00c7b10 2023-08-09T12:39:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.773+0000 7f9fa8099640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00c84d0 con 0x7f9f8c004d00 2023-08-09T12:39:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.773+0000 7f9fa8099640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00c8df0 con 0x7f9fa015c3a0 2023-08-09T12:39:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5634640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa00c7b10 0x7f9fa00c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5634640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa00c7b10 0x7f9fa00c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56248/0 (socket says 172.21.15.17:56248) 2023-08-09T12:39:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5634640 1 -- 172.21.15.17:0/3980740240 learned_addr learned my addr 172.21.15.17:0/3980740240 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5e35640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c004d00 0x7f9fa0152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5634640 1 -- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa015c3a0 msgr2=0x7f9fa015c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5634640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa015c3a0 0x7f9fa015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5634640 1 -- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c004d00 msgr2=0x7f9fa0152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5634640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c004d00 0x7f9fa0152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.774+0000 7f9fa5634640 1 -- 172.21.15.17:0/3980740240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa015cd60 con 0x7f9fa00c7b10 2023-08-09T12:39:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.775+0000 7f9fa5634640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa00c7b10 0x7f9fa00c7f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000e580 tx=0x7f9f9000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.775+0000 7f9f967fc640 1 -- 172.21.15.17:0/3980740240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900052e0 con 0x7f9fa00c7b10 2023-08-09T12:39:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.775+0000 7f9f967fc640 1 -- 172.21.15.17:0/3980740240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90005440 con 0x7f9fa00c7b10 2023-08-09T12:39:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.775+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa01527d0 con 0x7f9fa00c7b10 2023-08-09T12:39:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.775+0000 7f9f967fc640 1 -- 172.21.15.17:0/3980740240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90003810 con 0x7f9fa00c7b10 2023-08-09T12:39:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.775+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa015d2f0 con 0x7f9fa00c7b10 2023-08-09T12:39:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.776+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa0067a80 con 0x7f9fa00c7b10 2023-08-09T12:39:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.777+0000 7f9f967fc640 1 -- 172.21.15.17:0/3980740240 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9f90003970 con 0x7f9fa00c7b10 2023-08-09T12:39:36.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.778+0000 7f9f967fc640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9f8406a050 0x7f9f8406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:36.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.778+0000 7f9f967fc640 1 -- 172.21.15.17:0/3980740240 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f90088220 con 0x7f9fa00c7b10 2023-08-09T12:39:36.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.779+0000 7f9fa5e35640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9f8406a050 0x7f9f8406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:36.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.780+0000 7f9fa5e35640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9f8406a050 0x7f9f8406c510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9fa015e6b0 tx=0x7f9f9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.782+0000 7f9f967fc640 1 -- 172.21.15.17:0/3980740240 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9f90053880 con 0x7f9fa00c7b10 2023-08-09T12:39:36.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.972+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9fa006b380 con 0x7f9fa00c7b10 2023-08-09T12:39:36.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.973+0000 7f9f967fc640 1 -- 172.21.15.17:0/3980740240 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f90056ea0 con 0x7f9fa00c7b10 2023-08-09T12:39:36.976 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:39:36.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9f8406a050 msgr2=0x7f9f8406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9f8406a050 0x7f9f8406c510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9fa015e6b0 tx=0x7f9f9c008040 comp rx=0 tx=0).stop 2023-08-09T12:39:36.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa00c7b10 msgr2=0x7f9fa00c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:36.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa00c7b10 0x7f9fa00c7f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000e580 tx=0x7f9f9000ea40 comp rx=0 tx=0).stop 2023-08-09T12:39:36.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 shutdown_connections 2023-08-09T12:39:36.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9f8406a050 0x7f9f8406c510 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fa015c3a0 0x7f9fa015c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa00c7b10 0x7f9fa00c7f90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 --2- 172.21.15.17:0/3980740240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c004d00 0x7f9fa0152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 >> 172.21.15.17:0/3980740240 conn(0x7f9fa0069be0 msgr2=0x7f9fa01539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.975+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 shutdown_connections 2023-08-09T12:39:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:36.976+0000 7f9fa8099640 1 -- 172.21.15.17:0/3980740240 wait complete. 2023-08-09T12:39:36.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:39:37.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.223+0000 7f4cfce21640 1 Processor -- start 2023-08-09T12:39:37.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.223+0000 7f4cfce21640 1 -- start start 2023-08-09T12:39:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.225+0000 7f4cfce21640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cf80b4170 0x7f4cf80b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.225+0000 7f4cfce21640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b0020 0x7f4cf80b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.225+0000 7f4cfce21640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf815e7b0 con 0x7f4cf815a8c0 2023-08-09T12:39:37.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.225+0000 7f4cfce21640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80b09d0 con 0x7f4cf80b4170 2023-08-09T12:39:37.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.225+0000 7f4cfce21640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf815e460 con 0x7f4cf80b0020 2023-08-09T12:39:37.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.225+0000 7f4cf6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cf80b4170 0x7f4cf80b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.225+0000 7f4cf6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cf80b4170 0x7f4cf80b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56256/0 (socket says 172.21.15.17:56256) 2023-08-09T12:39:37.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.225+0000 7f4cf6ffd640 1 -- 172.21.15.17:0/1950882592 learned_addr learned my addr 172.21.15.17:0/1950882592 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:37.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.226+0000 7f4cf7fff640 1 --2- 172.21.15.17:0/1950882592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b0020 0x7f4cf80b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.226+0000 7f4cf6ffd640 1 -- 172.21.15.17:0/1950882592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b0020 msgr2=0x7f4cf80b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:37.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.226+0000 7f4cf6ffd640 1 --2- 172.21.15.17:0/1950882592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b0020 0x7f4cf80b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.226+0000 7f4cf6ffd640 1 -- 172.21.15.17:0/1950882592 >> v1:172.21.15.142:6789/0 conn(0x7f4cf815a8c0 legacy=0x7f4cf815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.226+0000 7f4cf6ffd640 1 -- 172.21.15.17:0/1950882592 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf815aca0 con 0x7f4cf80b4170 2023-08-09T12:39:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.227+0000 7f4cf6ffd640 1 --2- 172.21.15.17:0/1950882592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b4170 0x7f4cf80b13f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009870 tx=0x7f4cec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b332c024c5013eb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.227+0000 7f4cf67fc640 1 -- 172.21.15.17:0/1950882592 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec030840 con 0x7f4cf80b4170 2023-08-09T12:39:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.227+0000 7f4cf67fc640 1 -- 172.21.15.17:0/1950882592 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0309a0 con 0x7f4cf80b4170 2023-08-09T12:39:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.227+0000 7f4cf67fc640 1 -- 172.21.15.17:0/1950882592 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec030d30 con 0x7f4cf80b4170 2023-08-09T12:39:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.228+0000 7f4cfce21640 1 -- 172.21.15.17:0/1950882592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b4170 msgr2=0x7f4cf80b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.228+0000 7f4cfce21640 1 --2- 172.21.15.17:0/1950882592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b4170 0x7f4cf80b13f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009870 tx=0x7f4cec02b980 comp rx=0 tx=0).stop 2023-08-09T12:39:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.228+0000 7f4cfce21640 1 -- 172.21.15.17:0/1950882592 shutdown_connections 2023-08-09T12:39:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.228+0000 7f4cfce21640 1 --2- 172.21.15.17:0/1950882592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b0020 0x7f4cf80b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.228+0000 7f4cfce21640 1 --2- 172.21.15.17:0/1950882592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b4170 0x7f4cf80b13f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.228+0000 7f4cfce21640 1 -- 172.21.15.17:0/1950882592 >> 172.21.15.17:0/1950882592 conn(0x7f4cf80cb020 msgr2=0x7f4cf80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.228+0000 7f4cfce21640 1 -- 172.21.15.17:0/1950882592 shutdown_connections 2023-08-09T12:39:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.228+0000 7f4cfce21640 1 -- 172.21.15.17:0/1950882592 wait complete. 2023-08-09T12:39:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.230+0000 7f4cfce21640 1 Processor -- start 2023-08-09T12:39:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.230+0000 7f4cfce21640 1 -- start start 2023-08-09T12:39:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cfce21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b0020 0x7f4cf815ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cfce21640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b4170 0x7f4cf80c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cfce21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cf815a8c0 0x7f4cf8157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cfce21640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf81e3950 con 0x7f4cf80b0020 2023-08-09T12:39:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cfce21640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf815d2b0 con 0x7f4cf815a8c0 2023-08-09T12:39:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cfce21640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf815d590 con 0x7f4cf80b4170 2023-08-09T12:39:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cf77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b0020 0x7f4cf815ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cf77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b0020 0x7f4cf815ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56258/0 (socket says 172.21.15.17:56258) 2023-08-09T12:39:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.231+0000 7f4cf77fe640 1 -- 172.21.15.17:0/2536571204 learned_addr learned my addr 172.21.15.17:0/2536571204 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:37.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cf6ffd640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b4170 0x7f4cf80c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cf77fe640 1 -- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b4170 msgr2=0x7f4cf80c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cf77fe640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b4170 0x7f4cf80c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cf7fff640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cf815a8c0 0x7f4cf8157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cf77fe640 1 -- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cf815a8c0 msgr2=0x7f4cf8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cf77fe640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cf815a8c0 0x7f4cf8157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cf77fe640 1 -- 172.21.15.17:0/2536571204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0094d0 con 0x7f4cf80b0020 2023-08-09T12:39:37.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cf77fe640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b0020 0x7f4cf815ccd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c450 tx=0x7f4ce800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:37.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cdffff640 1 -- 172.21.15.17:0/2536571204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80052d0 con 0x7f4cf80b0020 2023-08-09T12:39:37.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cdffff640 1 -- 172.21.15.17:0/2536571204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8005430 con 0x7f4cf80b0020 2023-08-09T12:39:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cdffff640 1 -- 172.21.15.17:0/2536571204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8012870 con 0x7f4cf80b0020 2023-08-09T12:39:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.232+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf815d870 con 0x7f4cf80b0020 2023-08-09T12:39:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.233+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf80c3890 con 0x7f4cf80b0020 2023-08-09T12:39:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.234+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf81e3ac0 con 0x7f4cf80b0020 2023-08-09T12:39:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.235+0000 7f4cdffff640 1 -- 172.21.15.17:0/2536571204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ce80129d0 con 0x7f4cf80b0020 2023-08-09T12:39:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.235+0000 7f4cdffff640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ce406a080 0x7f4ce406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.236+0000 7f4cdffff640 1 -- 172.21.15.17:0/2536571204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ce80880b0 con 0x7f4cf80b0020 2023-08-09T12:39:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.236+0000 7f4cf6ffd640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ce406a080 0x7f4ce406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.237+0000 7f4cf6ffd640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ce406a080 0x7f4ce406c540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.240+0000 7f4cdffff640 1 -- 172.21.15.17:0/2536571204 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4ce8053790 con 0x7f4cf80b0020 2023-08-09T12:39:37.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.433+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cf804e390 con 0x7f4cf80b0020 2023-08-09T12:39:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.434+0000 7f4cdffff640 1 -- 172.21.15.17:0/2536571204 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ce8056db0 con 0x7f4cf80b0020 2023-08-09T12:39:37.437 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:39:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ce406a080 msgr2=0x7f4ce406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ce406a080 0x7f4ce406c540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec03b040 comp rx=0 tx=0).stop 2023-08-09T12:39:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b0020 msgr2=0x7f4cf815ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b0020 0x7f4cf815ccd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c450 tx=0x7f4ce800c910 comp rx=0 tx=0).stop 2023-08-09T12:39:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 shutdown_connections 2023-08-09T12:39:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ce406a080 0x7f4ce406c540 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cf815a8c0 0x7f4cf8157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cf80b4170 0x7f4cf80c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 --2- 172.21.15.17:0/2536571204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cf80b0020 0x7f4cf815ccd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.436+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 >> 172.21.15.17:0/2536571204 conn(0x7f4cf80cb020 msgr2=0x7f4cf80709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:37.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.437+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 shutdown_connections 2023-08-09T12:39:37.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.437+0000 7f4cfce21640 1 -- 172.21.15.17:0/2536571204 wait complete. 2023-08-09T12:39:37.458 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:39:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.667+0000 7fc24ffff640 1 Processor -- start 2023-08-09T12:39:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.667+0000 7fc24ffff640 1 -- start start 2023-08-09T12:39:37.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.668+0000 7fc24ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc250160030 0x7fc250160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.669+0000 7fc24ffff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2500b5a30 con 0x7fc2500b86e0 2023-08-09T12:39:37.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.669+0000 7fc24ffff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2500d0d70 con 0x7fc2500cfb50 2023-08-09T12:39:37.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.669+0000 7fc24ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500d1110 con 0x7fc250160030 2023-08-09T12:39:37.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.669+0000 7fc24e7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc2500b86e0 0x7fc2500cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49074/0 (socket says 172.21.15.17:49074) 2023-08-09T12:39:37.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.669+0000 7fc24e7fc640 1 -- 172.21.15.17:0/1675906104 learned_addr learned my addr 172.21.15.17:0/1675906104 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.669+0000 7fc24effd640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc250160030 0x7fc250160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.669+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940168599 0 0) 0x7fc2500b5a30 con 0x7fc2500b86e0 2023-08-09T12:39:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.669+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc238003520 con 0x7fc2500b86e0 2023-08-09T12:39:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144238905 0 0) 0x7fc238003520 con 0x7fc2500b86e0 2023-08-09T12:39:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc250160030 msgr2=0x7fc250160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc250160030 0x7fc250160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 >> v1:172.21.15.142:6789/0 conn(0x7fc2500cfb50 legacy=0x7fc2500d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250160f70 con 0x7fc2500b86e0 2023-08-09T12:39:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc244001670 con 0x7fc2500b86e0 2023-08-09T12:39:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 >> v1:172.21.15.17:6789/0 conn(0x7fc2500b86e0 legacy=0x7fc2500cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2380039a0 0x7fc238003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc238004390 0x7fc238004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc250160030 0x7fc2380050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500d1110 con 0x7fc2380039a0 2023-08-09T12:39:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23800b9b0 con 0x7fc238004390 2023-08-09T12:39:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23800bb70 con 0x7fc250160030 2023-08-09T12:39:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.670+0000 7fc24effd640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2380039a0 0x7fc238003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.671+0000 7fc24e7fc640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc238004390 0x7fc238004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.671+0000 7fc24effd640 1 -- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc250160030 msgr2=0x7fc2380050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.671+0000 7fc24effd640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc250160030 0x7fc2380050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.671+0000 7fc24effd640 1 -- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc238004390 msgr2=0x7fc238004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.671+0000 7fc24effd640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc238004390 0x7fc238004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.671+0000 7fc24effd640 1 -- 172.21.15.17:0/1675906104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250160f70 con 0x7fc2380039a0 2023-08-09T12:39:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.671+0000 7fc24e7fc640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc238004390 0x7fc238004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.672+0000 7fc24effd640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2380039a0 0x7fc238003dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc240009ac0 tx=0x7fc2380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96282fc378113e94 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.672+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24002c710 con 0x7fc2380039a0 2023-08-09T12:39:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.672+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24002c870 con 0x7fc2380039a0 2023-08-09T12:39:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.672+0000 7fc24dffb640 1 -- 172.21.15.17:0/1675906104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24002cc00 con 0x7fc2380039a0 2023-08-09T12:39:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.673+0000 7fc24ffff640 1 -- 172.21.15.17:0/1675906104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2380039a0 msgr2=0x7fc238003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.673+0000 7fc24ffff640 1 --2- 172.21.15.17:0/1675906104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2380039a0 0x7fc238003dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc240009ac0 tx=0x7fc2380057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.673+0000 7fc24f7fe640 1 -- 172.21.15.17:0/1675906104 reap_dead start 2023-08-09T12:39:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.673+0000 7fc24ffff640 1 -- 172.21.15.17:0/1675906104 shutdown_connections 2023-08-09T12:39:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.673+0000 7fc24ffff640 1 -- 172.21.15.17:0/1675906104 >> 172.21.15.17:0/1675906104 conn(0x7fc2500697c0 msgr2=0x7fc250069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.673+0000 7fc24ffff640 1 -- 172.21.15.17:0/1675906104 shutdown_connections 2023-08-09T12:39:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.673+0000 7fc24ffff640 1 -- 172.21.15.17:0/1675906104 wait complete. 2023-08-09T12:39:37.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.675+0000 7fc24ffff640 1 Processor -- start 2023-08-09T12:39:37.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.675+0000 7fc24ffff640 1 -- start start 2023-08-09T12:39:37.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2380039a0 0x7fc250156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2500cbd70 0x7fc2500a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2500aa4d0 0x7fc2501f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24ffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500aa950 con 0x7fc2500cbd70 2023-08-09T12:39:37.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500b21b0 con 0x7fc2500aa4d0 2023-08-09T12:39:37.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500ccac0 con 0x7fc2380039a0 2023-08-09T12:39:37.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2500cbd70 0x7fc2500a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2500cbd70 0x7fc2500a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56282/0 (socket says 172.21.15.17:56282) 2023-08-09T12:39:37.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.676+0000 7fc24e7fc640 1 -- 172.21.15.17:0/2465119959 learned_addr learned my addr 172.21.15.17:0/2465119959 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:37.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24effd640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2380039a0 0x7fc250156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24f7fe640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2500aa4d0 0x7fc2501f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24e7fc640 1 -- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2380039a0 msgr2=0x7fc250156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24e7fc640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2380039a0 0x7fc250156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24e7fc640 1 -- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2500aa4d0 msgr2=0x7fc2501f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24e7fc640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2500aa4d0 0x7fc2501f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24e7fc640 1 -- 172.21.15.17:0/2465119959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2500ccda0 con 0x7fc2500cbd70 2023-08-09T12:39:37.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24f7fe640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2500aa4d0 0x7fc2501f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:37.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24e7fc640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2500cbd70 0x7fc2500a9f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc24400d960 tx=0x7fc24400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:37.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc2377fe640 1 -- 172.21.15.17:0/2465119959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440074e0 con 0x7fc2500cbd70 2023-08-09T12:39:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc2377fe640 1 -- 172.21.15.17:0/2465119959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc244007640 con 0x7fc2500cbd70 2023-08-09T12:39:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc2377fe640 1 -- 172.21.15.17:0/2465119959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244004a00 con 0x7fc2500cbd70 2023-08-09T12:39:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.677+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2500cd080 con 0x7fc2500cbd70 2023-08-09T12:39:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.678+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2500cd640 con 0x7fc2500cbd70 2023-08-09T12:39:37.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.679+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2500cd860 con 0x7fc2500cbd70 2023-08-09T12:39:37.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.680+0000 7fc2377fe640 1 -- 172.21.15.17:0/2465119959 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc244004b60 con 0x7fc2500cbd70 2023-08-09T12:39:37.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.681+0000 7fc2377fe640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23c06a050 0x7fc23c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:37.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.681+0000 7fc2377fe640 1 -- 172.21.15.17:0/2465119959 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc244087f00 con 0x7fc2500cbd70 2023-08-09T12:39:37.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.681+0000 7fc24effd640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23c06a050 0x7fc23c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:37.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.682+0000 7fc24effd640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23c06a050 0x7fc23c06c510 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc240036000 tx=0x7fc240030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:37.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.685+0000 7fc2377fe640 1 -- 172.21.15.17:0/2465119959 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc244053680 con 0x7fc2500cbd70 2023-08-09T12:39:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.920+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2500cf8c0 con 0x7fc2500cbd70 2023-08-09T12:39:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.921+0000 7fc2377fe640 1 -- 172.21.15.17:0/2465119959 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4872 (secure 0 0 0) 0x7fc244019020 con 0x7fc2500cbd70 2023-08-09T12:39:37.925 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:37.925 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:39:25.114229+0000","modified":"2023-08-09T12:39:28.660973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T12:39:37.925 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-08-09T12:39:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23c06a050 msgr2=0x7fc23c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23c06a050 0x7fc23c06c510 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc240036000 tx=0x7fc240030000 comp rx=0 tx=0).stop 2023-08-09T12:39:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2500cbd70 msgr2=0x7fc2500a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2500cbd70 0x7fc2500a9f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc24400d960 tx=0x7fc24400de20 comp rx=0 tx=0).stop 2023-08-09T12:39:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 shutdown_connections 2023-08-09T12:39:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23c06a050 0x7fc23c06c510 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2500aa4d0 0x7fc2501f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2500cbd70 0x7fc2500a9f90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 --2- 172.21.15.17:0/2465119959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2380039a0 0x7fc250156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:37.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.924+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 >> 172.21.15.17:0/2465119959 conn(0x7fc2500697c0 msgr2=0x7fc25015db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:37.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.925+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 shutdown_connections 2023-08-09T12:39:37.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:37.925+0000 7fc24ffff640 1 -- 172.21.15.17:0/2465119959 wait complete. 2023-08-09T12:39:37.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:38.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.160+0000 7f61331ab640 1 Processor -- start 2023-08-09T12:39:38.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.160+0000 7f61331ab640 1 -- start start 2023-08-09T12:39:38.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.162+0000 7f61331ab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f612c15ce90 0x7f612c1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.162+0000 7f61331ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c0d29d0 0x7f612c0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.162+0000 7f61331ab640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c0b6460 con 0x7f612c0b6000 2023-08-09T12:39:38.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.162+0000 7f61331ab640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c0d33a0 con 0x7f612c15ce90 2023-08-09T12:39:38.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.162+0000 7f61331ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0cdd10 con 0x7f612c0d29d0 2023-08-09T12:39:38.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.162+0000 7f6130f47640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f612c15ce90 0x7f612c1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.162+0000 7f6130f47640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f612c15ce90 0x7f612c1616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50080/0 (socket says 172.21.15.17:50080) 2023-08-09T12:39:38.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.162+0000 7f6130f47640 1 -- 172.21.15.17:0/629921472 learned_addr learned my addr 172.21.15.17:0/629921472 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.163+0000 7f6131748640 1 --2- 172.21.15.17:0/629921472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c0d29d0 0x7f612c0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.163+0000 7f6130f47640 1 -- 172.21.15.17:0/629921472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c0d29d0 msgr2=0x7f612c0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.163+0000 7f6130f47640 1 --2- 172.21.15.17:0/629921472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c0d29d0 0x7f612c0d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.163+0000 7f6130f47640 1 -- 172.21.15.17:0/629921472 >> v1:172.21.15.142:6789/0 conn(0x7f612c0b6000 legacy=0x7f612c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.163+0000 7f6130f47640 1 -- 172.21.15.17:0/629921472 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0cdff0 con 0x7f612c15ce90 2023-08-09T12:39:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.163+0000 7f6131748640 1 --2- 172.21.15.17:0/629921472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c0d29d0 0x7f612c0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.164+0000 7f6130f47640 1 --2- 172.21.15.17:0/629921472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c15ce90 0x7f612c1616e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f611c009e50 tx=0x7f611c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7ff2790c11b87d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.165+0000 7f612b7fe640 1 -- 172.21.15.17:0/629921472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c02cb00 con 0x7f612c15ce90 2023-08-09T12:39:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.165+0000 7f612b7fe640 1 -- 172.21.15.17:0/629921472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c02cc60 con 0x7f612c15ce90 2023-08-09T12:39:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.165+0000 7f612b7fe640 1 -- 172.21.15.17:0/629921472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c0343f0 con 0x7f612c15ce90 2023-08-09T12:39:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.166+0000 7f61331ab640 1 -- 172.21.15.17:0/629921472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c15ce90 msgr2=0x7f612c1616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.166+0000 7f61331ab640 1 --2- 172.21.15.17:0/629921472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c15ce90 0x7f612c1616e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f611c009e50 tx=0x7f611c02bf60 comp rx=0 tx=0).stop 2023-08-09T12:39:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.166+0000 7f61331ab640 1 -- 172.21.15.17:0/629921472 shutdown_connections 2023-08-09T12:39:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.166+0000 7f61331ab640 1 --2- 172.21.15.17:0/629921472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c0d29d0 0x7f612c0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.166+0000 7f61331ab640 1 --2- 172.21.15.17:0/629921472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c15ce90 0x7f612c1616e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.166+0000 7f61331ab640 1 -- 172.21.15.17:0/629921472 >> 172.21.15.17:0/629921472 conn(0x7f612c06fde0 msgr2=0x7f612c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.166+0000 7f61331ab640 1 -- 172.21.15.17:0/629921472 shutdown_connections 2023-08-09T12:39:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.166+0000 7f61331ab640 1 -- 172.21.15.17:0/629921472 wait complete. 2023-08-09T12:39:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.168+0000 7f61331ab640 1 Processor -- start 2023-08-09T12:39:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.168+0000 7f61331ab640 1 -- start start 2023-08-09T12:39:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f61331ab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f612c0b6000 0x7f612c0a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f61331ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c0d29d0 0x7f612c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f61331ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c15ce90 0x7f612c149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f61331ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c14af70 con 0x7f612c0d29d0 2023-08-09T12:39:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f61331ab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c14a3f0 con 0x7f612c0b6000 2023-08-09T12:39:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f61331ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c14a6d0 con 0x7f612c15ce90 2023-08-09T12:39:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f612bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c0d29d0 0x7f612c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f612bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c0d29d0 0x7f612c0b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50096/0 (socket says 172.21.15.17:50096) 2023-08-09T12:39:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f612bfff640 1 -- 172.21.15.17:0/1114312835 learned_addr learned my addr 172.21.15.17:0/1114312835 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f6130f47640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f612c0b6000 0x7f612c0a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.169+0000 7f6131748640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c15ce90 0x7f612c149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f612bfff640 1 -- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c15ce90 msgr2=0x7f612c149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f612bfff640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c15ce90 0x7f612c149a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f612bfff640 1 -- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f612c0b6000 msgr2=0x7f612c0a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f612bfff640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f612c0b6000 0x7f612c0a9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f612bfff640 1 -- 172.21.15.17:0/1114312835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c009b30 con 0x7f612c0d29d0 2023-08-09T12:39:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f6130f47640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f612c0b6000 0x7f612c0a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f612bfff640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c0d29d0 0x7f612c0b1820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f611400c3c0 tx=0x7f611400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f61297fa640 1 -- 172.21.15.17:0/1114312835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140052d0 con 0x7f612c0d29d0 2023-08-09T12:39:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f61297fa640 1 -- 172.21.15.17:0/1114312835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114005450 con 0x7f612c0d29d0 2023-08-09T12:39:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f61297fa640 1 -- 172.21.15.17:0/1114312835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114007260 con 0x7f612c0d29d0 2023-08-09T12:39:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c14a9b0 con 0x7f612c0d29d0 2023-08-09T12:39:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.170+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c149fc0 con 0x7f612c0d29d0 2023-08-09T12:39:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.172+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c14a150 con 0x7f612c0d29d0 2023-08-09T12:39:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.173+0000 7f61297fa640 1 -- 172.21.15.17:0/1114312835 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f61140073c0 con 0x7f612c0d29d0 2023-08-09T12:39:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.174+0000 7f61297fa640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f610c06a050 0x7f610c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.174+0000 7f61297fa640 1 -- 172.21.15.17:0/1114312835 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61140879c0 con 0x7f612c0d29d0 2023-08-09T12:39:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.174+0000 7f6130f47640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f610c06a050 0x7f610c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.175+0000 7f6130f47640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f610c06a050 0x7f610c06c510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f611c035000 tx=0x7f611c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.178+0000 7f61297fa640 1 -- 172.21.15.17:0/1114312835 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6114053010 con 0x7f612c0d29d0 2023-08-09T12:39:38.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.371+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f612c0ce2a0 con 0x7f612c0d29d0 2023-08-09T12:39:38.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.373+0000 7f61297fa640 1 -- 172.21.15.17:0/1114312835 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f6114056630 con 0x7f612c0d29d0 2023-08-09T12:39:38.377 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:38.377 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:38.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.375+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f610c06a050 msgr2=0x7f610c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.375+0000 7f61331ab640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f610c06a050 0x7f610c06c510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f611c035000 tx=0x7f611c030000 comp rx=0 tx=0).stop 2023-08-09T12:39:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.375+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c0d29d0 msgr2=0x7f612c0b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.375+0000 7f61331ab640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c0d29d0 0x7f612c0b1820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f611400c3c0 tx=0x7f611400c880 comp rx=0 tx=0).stop 2023-08-09T12:39:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.376+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 shutdown_connections 2023-08-09T12:39:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.376+0000 7f61331ab640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f610c06a050 0x7f610c06c510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.376+0000 7f61331ab640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f612c15ce90 0x7f612c149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.376+0000 7f61331ab640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f612c0d29d0 0x7f612c0b1820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.376+0000 7f61331ab640 1 --2- 172.21.15.17:0/1114312835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f612c0b6000 0x7f612c0a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.376+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 >> 172.21.15.17:0/1114312835 conn(0x7f612c06fde0 msgr2=0x7f612c0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.376+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 shutdown_connections 2023-08-09T12:39:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.376+0000 7f61331ab640 1 -- 172.21.15.17:0/1114312835 wait complete. 2023-08-09T12:39:38.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:39:38.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:39:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.633+0000 7f38cd5e6640 1 Processor -- start 2023-08-09T12:39:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.634+0000 7f38cd5e6640 1 -- start start 2023-08-09T12:39:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.635+0000 7f38cd5e6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f38c80d26d0 0x7f38c8167b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.635+0000 7f38cd5e6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c80d0f00 con 0x7f38c815cb40 2023-08-09T12:39:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.635+0000 7f38cd5e6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c81611f0 con 0x7f38c80b8420 2023-08-09T12:39:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.635+0000 7f38cd5e6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c81614d0 con 0x7f38c80d26d0 2023-08-09T12:39:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.636+0000 7f38c7fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f38c815cb40 0x7f38c81609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37990/0 (socket says 172.21.15.17:37990) 2023-08-09T12:39:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.636+0000 7f38c7fff640 1 -- 172.21.15.17:0/1471445643 learned_addr learned my addr 172.21.15.17:0/1471445643 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.636+0000 7f38ccde5640 1 --2- 172.21.15.17:0/1471445643 >> v2:172.21.15.17:3300/0 conn(0x7f38c80d26d0 0x7f38c8167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.636+0000 7f38c77fe640 1 -- 172.21.15.17:0/1471445643 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797744117 0 0) 0x7f38c80d0f00 con 0x7f38c815cb40 2023-08-09T12:39:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.636+0000 7f38c77fe640 1 -- 172.21.15.17:0/1471445643 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b4003520 con 0x7f38c815cb40 2023-08-09T12:39:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.636+0000 7f38ccde5640 1 -- 172.21.15.17:0/1471445643 >> v1:172.21.15.142:6789/0 conn(0x7f38c80b8420 legacy=0x7f38c80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.636+0000 7f38ccde5640 1 -- 172.21.15.17:0/1471445643 >> v1:172.21.15.17:6789/0 conn(0x7f38c815cb40 legacy=0x7f38c81609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.636+0000 7f38ccde5640 1 -- 172.21.15.17:0/1471445643 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c81617b0 con 0x7f38c80d26d0 2023-08-09T12:39:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.638+0000 7f38ccde5640 1 --2- 172.21.15.17:0/1471445643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c80d26d0 0x7f38c8167b20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009d90 tx=0x7f38c002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af6ae83469c7c4b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.638+0000 7f38c77fe640 1 -- 172.21.15.17:0/1471445643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c002cd80 con 0x7f38c80d26d0 2023-08-09T12:39:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.638+0000 7f38c77fe640 1 -- 172.21.15.17:0/1471445643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0034440 con 0x7f38c80d26d0 2023-08-09T12:39:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.638+0000 7f38c77fe640 1 -- 172.21.15.17:0/1471445643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c00347b0 con 0x7f38c80d26d0 2023-08-09T12:39:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.639+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1471445643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c80d26d0 msgr2=0x7f38c8167b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.639+0000 7f38cd5e6640 1 --2- 172.21.15.17:0/1471445643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c80d26d0 0x7f38c8167b20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009d90 tx=0x7f38c002bfd0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.639+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1471445643 shutdown_connections 2023-08-09T12:39:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.639+0000 7f38cd5e6640 1 --2- 172.21.15.17:0/1471445643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c80d26d0 0x7f38c8167b20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.639+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1471445643 >> 172.21.15.17:0/1471445643 conn(0x7f38c80d2ab0 msgr2=0x7f38c80d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.639+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1471445643 shutdown_connections 2023-08-09T12:39:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.639+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1471445643 wait complete. 2023-08-09T12:39:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.641+0000 7f38cd5e6640 1 Processor -- start 2023-08-09T12:39:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.642+0000 7f38cd5e6640 1 -- start start 2023-08-09T12:39:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.642+0000 7f38cd5e6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c80b8420 0x7f38c8159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.642+0000 7f38cd5e6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c80d26d0 0x7f38c80ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38cd5e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c815cb40 0x7f38c81551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38cd5e6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80caa40 con 0x7f38c815cb40 2023-08-09T12:39:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38cd5e6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80c8bf0 con 0x7f38c80b8420 2023-08-09T12:39:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38cd5e6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8156bb0 con 0x7f38c80d26d0 2023-08-09T12:39:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38ccde5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c815cb40 0x7f38c81551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38ccde5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c815cb40 0x7f38c81551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50118/0 (socket says 172.21.15.17:50118) 2023-08-09T12:39:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38ccde5640 1 -- 172.21.15.17:0/1321646526 learned_addr learned my addr 172.21.15.17:0/1321646526 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38bffff640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c80d26d0 0x7f38c80ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38c7fff640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c80b8420 0x7f38c8159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38ccde5640 1 -- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c80d26d0 msgr2=0x7f38c80ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38ccde5640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c80d26d0 0x7f38c80ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38ccde5640 1 -- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c80b8420 msgr2=0x7f38c8159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38ccde5640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c80b8420 0x7f38c8159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.643+0000 7f38ccde5640 1 -- 172.21.15.17:0/1321646526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009a70 con 0x7f38c815cb40 2023-08-09T12:39:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.644+0000 7f38ccde5640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c815cb40 0x7f38c81551f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f38c002c5e0 tx=0x7f38c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.644+0000 7f38c57fa640 1 -- 172.21.15.17:0/1321646526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0004250 con 0x7f38c815cb40 2023-08-09T12:39:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.644+0000 7f38c57fa640 1 -- 172.21.15.17:0/1321646526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c00043d0 con 0x7f38c815cb40 2023-08-09T12:39:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.644+0000 7f38c57fa640 1 -- 172.21.15.17:0/1321646526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0004780 con 0x7f38c815cb40 2023-08-09T12:39:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.644+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c80c8e40 con 0x7f38c815cb40 2023-08-09T12:39:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.644+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c8156e00 con 0x7f38c815cb40 2023-08-09T12:39:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.646+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c804e390 con 0x7f38c815cb40 2023-08-09T12:39:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.646+0000 7f38c57fa640 1 -- 172.21.15.17:0/1321646526 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f38c003b070 con 0x7f38c815cb40 2023-08-09T12:39:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.647+0000 7f38c57fa640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38a806a050 0x7f38a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.647+0000 7f38c57fa640 1 -- 172.21.15.17:0/1321646526 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38c00aab90 con 0x7f38c815cb40 2023-08-09T12:39:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.648+0000 7f38c7fff640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38a806a050 0x7f38a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.649+0000 7f38c7fff640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38a806a050 0x7f38a806c510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38b80011e0 tx=0x7f38b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.653+0000 7f38c57fa640 1 -- 172.21.15.17:0/1321646526 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f38c0076390 con 0x7f38c815cb40 2023-08-09T12:39:38.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:39:38.855 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:39:38.856 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:39:38.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.849+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38c80b5770 con 0x7f38c815cb40 2023-08-09T12:39:38.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.850+0000 7f38c57fa640 1 -- 172.21.15.17:0/1321646526 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38c00390a0 con 0x7f38c815cb40 2023-08-09T12:39:38.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38a806a050 msgr2=0x7f38a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38a806a050 0x7f38a806c510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38b80011e0 tx=0x7f38b8009040 comp rx=0 tx=0).stop 2023-08-09T12:39:38.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c815cb40 msgr2=0x7f38c81551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:38.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c815cb40 0x7f38c81551f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f38c002c5e0 tx=0x7f38c0004a40 comp rx=0 tx=0).stop 2023-08-09T12:39:38.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 shutdown_connections 2023-08-09T12:39:38.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38a806a050 0x7f38a806c510 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c815cb40 0x7f38c81551f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38c80d26d0 0x7f38c80ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 --2- 172.21.15.17:0/1321646526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38c80b8420 0x7f38c8159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:38.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 >> 172.21.15.17:0/1321646526 conn(0x7f38c80d2ab0 msgr2=0x7f38c8156010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:38.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 shutdown_connections 2023-08-09T12:39:38.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:38.853+0000 7f38cd5e6640 1 -- 172.21.15.17:0/1321646526 wait complete. 2023-08-09T12:39:38.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:39:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.134+0000 7fb559322640 1 Processor -- start 2023-08-09T12:39:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.134+0000 7fb559322640 1 -- start start 2023-08-09T12:39:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.135+0000 7fb559322640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb55415cb50 0x7fb5540b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb559322640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb5540b6c40 0x7fb5540cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb559322640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5540b7cf0 con 0x7fb5540cdd90 2023-08-09T12:39:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb559322640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5540ce200 con 0x7fb5540b6c40 2023-08-09T12:39:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb559322640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5540b70e0 con 0x7fb55415cb50 2023-08-09T12:39:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb5527fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb5540b6c40 0x7fb5540cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb5527fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb5540b6c40 0x7fb5540cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50134/0 (socket says 172.21.15.17:50134) 2023-08-09T12:39:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb5527fc640 1 -- 172.21.15.17:0/1533876076 learned_addr learned my addr 172.21.15.17:0/1533876076 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb552ffd640 1 --2- 172.21.15.17:0/1533876076 >> v2:172.21.15.142:3300/0 conn(0x7fb55415cb50 0x7fb5540b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb5527fc640 1 -- 172.21.15.17:0/1533876076 >> v2:172.21.15.142:3300/0 conn(0x7fb55415cb50 msgr2=0x7fb5540b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb5527fc640 1 --2- 172.21.15.17:0/1533876076 >> v2:172.21.15.142:3300/0 conn(0x7fb55415cb50 0x7fb5540b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.136+0000 7fb5527fc640 1 -- 172.21.15.17:0/1533876076 >> v1:172.21.15.142:6789/0 conn(0x7fb5540cdd90 legacy=0x7fb5540cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.137+0000 7fb5527fc640 1 -- 172.21.15.17:0/1533876076 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540b73c0 con 0x7fb5540b6c40 2023-08-09T12:39:39.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.138+0000 7fb5527fc640 1 --2- 172.21.15.17:0/1533876076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540cd850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb5540b5090 tx=0x7fb53c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f2681f015dc774 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.138+0000 7fb551ffb640 1 -- 172.21.15.17:0/1533876076 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c030860 con 0x7fb5540b6c40 2023-08-09T12:39:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.138+0000 7fb551ffb640 1 -- 172.21.15.17:0/1533876076 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c0309c0 con 0x7fb5540b6c40 2023-08-09T12:39:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.138+0000 7fb551ffb640 1 -- 172.21.15.17:0/1533876076 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c030d50 con 0x7fb5540b6c40 2023-08-09T12:39:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.139+0000 7fb559322640 1 -- 172.21.15.17:0/1533876076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 msgr2=0x7fb5540cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.139+0000 7fb559322640 1 --2- 172.21.15.17:0/1533876076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540cd850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb5540b5090 tx=0x7fb53c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.139+0000 7fb559322640 1 -- 172.21.15.17:0/1533876076 shutdown_connections 2023-08-09T12:39:39.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.139+0000 7fb559322640 1 --2- 172.21.15.17:0/1533876076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540cd850 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.139+0000 7fb559322640 1 --2- 172.21.15.17:0/1533876076 >> v2:172.21.15.142:3300/0 conn(0x7fb55415cb50 0x7fb5540b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.139+0000 7fb559322640 1 -- 172.21.15.17:0/1533876076 >> 172.21.15.17:0/1533876076 conn(0x7fb554069be0 msgr2=0x7fb554069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:39.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.139+0000 7fb559322640 1 -- 172.21.15.17:0/1533876076 shutdown_connections 2023-08-09T12:39:39.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.139+0000 7fb559322640 1 -- 172.21.15.17:0/1533876076 wait complete. 2023-08-09T12:39:39.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.141+0000 7fb559322640 1 Processor -- start 2023-08-09T12:39:39.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.141+0000 7fb559322640 1 -- start start 2023-08-09T12:39:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.142+0000 7fb559322640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.142+0000 7fb559322640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5540cdd90 0x7fb554151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.142+0000 7fb559322640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55415cb50 0x7fb5540c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.142+0000 7fb559322640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540c8ad0 con 0x7fb5540b6c40 2023-08-09T12:39:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.142+0000 7fb559322640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5541518b0 con 0x7fb5540cdd90 2023-08-09T12:39:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.142+0000 7fb559322640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540c7ec0 con 0x7fb55415cb50 2023-08-09T12:39:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb552ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb552ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50136/0 (socket says 172.21.15.17:50136) 2023-08-09T12:39:39.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb552ffd640 1 -- 172.21.15.17:0/2366575589 learned_addr learned my addr 172.21.15.17:0/2366575589 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:39.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb5527fc640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5540cdd90 0x7fb554151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb5537fe640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55415cb50 0x7fb5540c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb552ffd640 1 -- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55415cb50 msgr2=0x7fb5540c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb552ffd640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55415cb50 0x7fb5540c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb552ffd640 1 -- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5540cdd90 msgr2=0x7fb554151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb552ffd640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5540cdd90 0x7fb554151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb552ffd640 1 -- 172.21.15.17:0/2366575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0094d0 con 0x7fb5540b6c40 2023-08-09T12:39:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb5527fc640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5540cdd90 0x7fb554151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.143+0000 7fb5537fe640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55415cb50 0x7fb5540c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.144+0000 7fb552ffd640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540c8f60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb544007e40 tx=0x7fb54400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.144+0000 7fb54b7fe640 1 -- 172.21.15.17:0/2366575589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544014620 con 0x7fb5540b6c40 2023-08-09T12:39:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.144+0000 7fb54b7fe640 1 -- 172.21.15.17:0/2366575589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400ee90 con 0x7fb5540b6c40 2023-08-09T12:39:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.144+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5540c81a0 con 0x7fb5540b6c40 2023-08-09T12:39:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.144+0000 7fb54b7fe640 1 -- 172.21.15.17:0/2366575589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440149c0 con 0x7fb5540b6c40 2023-08-09T12:39:39.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.144+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5540c8760 con 0x7fb5540b6c40 2023-08-09T12:39:39.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.145+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5540c94a0 con 0x7fb5540b6c40 2023-08-09T12:39:39.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.146+0000 7fb54b7fe640 1 -- 172.21.15.17:0/2366575589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb544014b20 con 0x7fb5540b6c40 2023-08-09T12:39:39.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.147+0000 7fb54b7fe640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb53406a050 0x7fb53406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.147+0000 7fb54b7fe640 1 -- 172.21.15.17:0/2366575589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb544088fb0 con 0x7fb5540b6c40 2023-08-09T12:39:39.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.148+0000 7fb5527fc640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb53406a050 0x7fb53406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.149+0000 7fb5527fc640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb53406a050 0x7fb53406c510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb53c036000 tx=0x7fb53c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:39.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.152+0000 7fb54b7fe640 1 -- 172.21.15.17:0/2366575589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb544058120 con 0x7fb5540b6c40 2023-08-09T12:39:39.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.345+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb554067a80 con 0x7fb5540b6c40 2023-08-09T12:39:39.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.346+0000 7fb54b7fe640 1 -- 172.21.15.17:0/2366575589 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb544057cb0 con 0x7fb5540b6c40 2023-08-09T12:39:39.349 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:39:39.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb53406a050 msgr2=0x7fb53406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb53406a050 0x7fb53406c510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb53c036000 tx=0x7fb53c03b040 comp rx=0 tx=0).stop 2023-08-09T12:39:39.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 msgr2=0x7fb5540c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540c8f60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb544007e40 tx=0x7fb54400e4b0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 shutdown_connections 2023-08-09T12:39:39.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb53406a050 0x7fb53406c510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55415cb50 0x7fb5540c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5540cdd90 0x7fb554151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 --2- 172.21.15.17:0/2366575589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5540b6c40 0x7fb5540c8f60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.348+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 >> 172.21.15.17:0/2366575589 conn(0x7fb554069be0 msgr2=0x7fb55406fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:39.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.349+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 shutdown_connections 2023-08-09T12:39:39.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.349+0000 7fb559322640 1 -- 172.21.15.17:0/2366575589 wait complete. 2023-08-09T12:39:39.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:39:39.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.590+0000 7f8c80576640 1 Processor -- start 2023-08-09T12:39:39.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.590+0000 7f8c80576640 1 -- start start 2023-08-09T12:39:39.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.592+0000 7f8c80576640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c7806f900 0x7f8c7806ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.592+0000 7f8c80576640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780caf20 con 0x7f8c780ce9e0 2023-08-09T12:39:39.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.592+0000 7f8c80576640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780afc40 con 0x7f8c78159b70 2023-08-09T12:39:39.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.592+0000 7f8c80576640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780aff00 con 0x7f8c7806f900 2023-08-09T12:39:39.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.592+0000 7f8c7e312640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8c780ce9e0 0x7f8c7815a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37994/0 (socket says 172.21.15.17:37994) 2023-08-09T12:39:39.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.592+0000 7f8c7e312640 1 -- 172.21.15.17:0/1311809669 learned_addr learned my addr 172.21.15.17:0/1311809669 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361137020 0 0) 0x7f8c780caf20 con 0x7f8c780ce9e0 2023-08-09T12:39:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7eb13640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c7806f900 0x7f8c7806ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c64003520 con 0x7f8c780ce9e0 2023-08-09T12:39:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3788656902 0 0) 0x7f8c64003520 con 0x7f8c780ce9e0 2023-08-09T12:39:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c7806f900 msgr2=0x7f8c7806ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c7806f900 0x7f8c7806ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 >> v1:172.21.15.142:6789/0 conn(0x7f8c78159b70 legacy=0x7f8c780cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780ca960 con 0x7f8c780ce9e0 2023-08-09T12:39:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8c74001670 con 0x7f8c780ce9e0 2023-08-09T12:39:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 >> v1:172.21.15.17:6789/0 conn(0x7f8c780ce9e0 legacy=0x7f8c7815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c640039a0 0x7f8c64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640047c0 0x7f8c64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c7806f900 0x7f8c640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780aff00 con 0x7f8c640039a0 2023-08-09T12:39:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6400bab0 con 0x7f8c640047c0 2023-08-09T12:39:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.593+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6400bc70 con 0x7f8c7806f900 2023-08-09T12:39:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7e312640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c640039a0 0x7f8c64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7db11640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640047c0 0x7f8c64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7e312640 1 -- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c7806f900 msgr2=0x7f8c640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:39.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7eb13640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c7806f900 0x7f8c640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7e312640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c7806f900 0x7f8c640051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7e312640 1 -- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640047c0 msgr2=0x7f8c64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:39.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7e312640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640047c0 0x7f8c64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7e312640 1 -- 172.21.15.17:0/1311809669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64003520 con 0x7f8c640039a0 2023-08-09T12:39:39.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.594+0000 7f8c7db11640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640047c0 0x7f8c64004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:39.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.595+0000 7f8c7e312640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c640039a0 0x7f8c64003dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c240 tx=0x7f8c640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c8bf2e5bde8383 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:39.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74005ad0 con 0x7f8c640039a0 2023-08-09T12:39:39.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74005c50 con 0x7f8c640039a0 2023-08-09T12:39:39.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c7d310640 1 -- 172.21.15.17:0/1311809669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7402c8b0 con 0x7f8c640039a0 2023-08-09T12:39:39.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c80576640 1 -- 172.21.15.17:0/1311809669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c640039a0 msgr2=0x7f8c64003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c80576640 1 --2- 172.21.15.17:0/1311809669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c640039a0 0x7f8c64003dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c240 tx=0x7f8c640057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c7eb13640 1 -- 172.21.15.17:0/1311809669 reap_dead start 2023-08-09T12:39:39.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c80576640 1 -- 172.21.15.17:0/1311809669 shutdown_connections 2023-08-09T12:39:39.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c80576640 1 -- 172.21.15.17:0/1311809669 >> 172.21.15.17:0/1311809669 conn(0x7f8c78069be0 msgr2=0x7f8c78069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:39.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c80576640 1 -- 172.21.15.17:0/1311809669 shutdown_connections 2023-08-09T12:39:39.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.596+0000 7f8c80576640 1 -- 172.21.15.17:0/1311809669 wait complete. 2023-08-09T12:39:39.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.598+0000 7f8c80576640 1 Processor -- start 2023-08-09T12:39:39.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.599+0000 7f8c80576640 1 -- start start 2023-08-09T12:39:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c80576640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640039a0 0x7f8c780c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c80576640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c780c8620 0x7f8c780c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c80576640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c6630 0x7f8c780c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c80576640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780c7020 con 0x7f8c780c8620 2023-08-09T12:39:39.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c80576640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781577e0 con 0x7f8c640039a0 2023-08-09T12:39:39.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c80576640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78157ac0 con 0x7f8c780c6630 2023-08-09T12:39:39.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c7db11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c780c8620 0x7f8c780c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c7db11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c780c8620 0x7f8c780c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50156/0 (socket says 172.21.15.17:50156) 2023-08-09T12:39:39.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.600+0000 7f8c7db11640 1 -- 172.21.15.17:0/640310157 learned_addr learned my addr 172.21.15.17:0/640310157 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:39.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7e312640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640039a0 0x7f8c780c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7db11640 1 -- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c6630 msgr2=0x7f8c780c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7eb13640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c6630 0x7f8c780c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7db11640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c6630 0x7f8c780c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7db11640 1 -- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640039a0 msgr2=0x7f8c780c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7db11640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640039a0 0x7f8c780c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7db11640 1 -- 172.21.15.17:0/640310157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78157da0 con 0x7f8c780c8620 2023-08-09T12:39:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7e312640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640039a0 0x7f8c780c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c7db11640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c780c8620 0x7f8c780c8aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800d770 tx=0x7f8c6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c6effd640 1 -- 172.21.15.17:0/640310157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68005270 con 0x7f8c780c8620 2023-08-09T12:39:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c6effd640 1 -- 172.21.15.17:0/640310157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c680053d0 con 0x7f8c780c8620 2023-08-09T12:39:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c6effd640 1 -- 172.21.15.17:0/640310157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800b8f0 con 0x7f8c780c8620 2023-08-09T12:39:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.601+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c78158080 con 0x7f8c780c8620 2023-08-09T12:39:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.602+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7814b8b0 con 0x7f8c780c8620 2023-08-09T12:39:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.603+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78067a80 con 0x7f8c780c8620 2023-08-09T12:39:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.604+0000 7f8c6effd640 1 -- 172.21.15.17:0/640310157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c6800ba50 con 0x7f8c780c8620 2023-08-09T12:39:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.605+0000 7f8c6effd640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5c06a050 0x7f8c5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.605+0000 7f8c6effd640 1 -- 172.21.15.17:0/640310157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c68088560 con 0x7f8c780c8620 2023-08-09T12:39:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.606+0000 7f8c7e312640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5c06a050 0x7f8c5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:39.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.607+0000 7f8c7e312640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5c06a050 0x7f8c5c06c510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c74034000 tx=0x7f8c74009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.609+0000 7f8c6effd640 1 -- 172.21.15.17:0/640310157 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8c68053bb0 con 0x7f8c780c8620 2023-08-09T12:39:39.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.805+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c780b4860 con 0x7f8c780c8620 2023-08-09T12:39:39.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.806+0000 7f8c6effd640 1 -- 172.21.15.17:0/640310157 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c68019310 con 0x7f8c780c8620 2023-08-09T12:39:39.810 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:39:39.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5c06a050 msgr2=0x7f8c5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5c06a050 0x7f8c5c06c510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c74034000 tx=0x7f8c74009030 comp rx=0 tx=0).stop 2023-08-09T12:39:39.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c780c8620 msgr2=0x7f8c780c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:39.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c780c8620 0x7f8c780c8aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800d770 tx=0x7f8c6800dc30 comp rx=0 tx=0).stop 2023-08-09T12:39:39.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 shutdown_connections 2023-08-09T12:39:39.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5c06a050 0x7f8c5c06c510 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c6630 0x7f8c780c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c780c8620 0x7f8c780c8aa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 --2- 172.21.15.17:0/640310157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c640039a0 0x7f8c780c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:39.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 >> 172.21.15.17:0/640310157 conn(0x7f8c78069be0 msgr2=0x7f8c780b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:39.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 shutdown_connections 2023-08-09T12:39:39.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:39.809+0000 7f8c80576640 1 -- 172.21.15.17:0/640310157 wait complete. 2023-08-09T12:39:39.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:39:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.044+0000 7f9d11e1f640 1 Processor -- start 2023-08-09T12:39:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.044+0000 7f9d11e1f640 1 -- start start 2023-08-09T12:39:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.046+0000 7f9d11e1f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d0c0adc40 0x7f9d0c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.046+0000 7f9d11e1f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c0b2250 con 0x7f9d0c0cc630 2023-08-09T12:39:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.046+0000 7f9d11e1f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c0b2530 con 0x7f9d0c0b3b40 2023-08-09T12:39:40.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.046+0000 7f9d11e1f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0c0ae020 con 0x7f9d0c0adc40 2023-08-09T12:39:40.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.047+0000 7f9d0bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9d0c0cc630 0x7f9d0c0ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38000/0 (socket says 172.21.15.17:38000) 2023-08-09T12:39:40.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.047+0000 7f9d0b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d0c0adc40 0x7f9d0c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.047+0000 7f9d0bfff640 1 -- 172.21.15.17:0/2294646432 learned_addr learned my addr 172.21.15.17:0/2294646432 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:40.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.047+0000 7f9d0b7fe640 1 -- 172.21.15.17:0/2294646432 >> v1:172.21.15.142:6789/0 conn(0x7f9d0c0b3b40 legacy=0x7f9d0c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:40.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.047+0000 7f9d0b7fe640 1 -- 172.21.15.17:0/2294646432 >> v1:172.21.15.17:6789/0 conn(0x7f9d0c0cc630 legacy=0x7f9d0c0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.047+0000 7f9d0b7fe640 1 -- 172.21.15.17:0/2294646432 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c06fe80 con 0x7f9d0c0adc40 2023-08-09T12:39:40.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.047+0000 7f9d0a7fc640 1 -- 172.21.15.17:0/2294646432 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073496183 0 0) 0x7f9d0c0b2250 con 0x7f9d0c0cc630 2023-08-09T12:39:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.048+0000 7f9d0b7fe640 1 --2- 172.21.15.17:0/2294646432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c06c280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0097a0 tx=0x7f9cfc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bc07bd36539ffb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.049+0000 7f9d0a7fc640 1 -- 172.21.15.17:0/2294646432 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc031830 con 0x7f9d0c0adc40 2023-08-09T12:39:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.049+0000 7f9d0a7fc640 1 -- 172.21.15.17:0/2294646432 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc031990 con 0x7f9d0c0adc40 2023-08-09T12:39:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.049+0000 7f9d0a7fc640 1 -- 172.21.15.17:0/2294646432 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc031d20 con 0x7f9d0c0adc40 2023-08-09T12:39:40.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.050+0000 7f9d11e1f640 1 -- 172.21.15.17:0/2294646432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 msgr2=0x7f9d0c06c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.050+0000 7f9d11e1f640 1 --2- 172.21.15.17:0/2294646432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c06c280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0097a0 tx=0x7f9cfc02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.050+0000 7f9d11e1f640 1 -- 172.21.15.17:0/2294646432 shutdown_connections 2023-08-09T12:39:40.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.050+0000 7f9d11e1f640 1 --2- 172.21.15.17:0/2294646432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c06c280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.050+0000 7f9d11e1f640 1 -- 172.21.15.17:0/2294646432 >> 172.21.15.17:0/2294646432 conn(0x7f9d0c0cb1b0 msgr2=0x7f9d0c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.050+0000 7f9d11e1f640 1 -- 172.21.15.17:0/2294646432 shutdown_connections 2023-08-09T12:39:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.050+0000 7f9d11e1f640 1 -- 172.21.15.17:0/2294646432 wait complete. 2023-08-09T12:39:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.052+0000 7f9d11e1f640 1 Processor -- start 2023-08-09T12:39:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.052+0000 7f9d11e1f640 1 -- start start 2023-08-09T12:39:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d11e1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c0c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d11e1f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d0c0b3b40 0x7f9d0c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d11e1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d0c0cc630 0x7f9d0c0ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d11e1f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0c2d10 con 0x7f9d0c0adc40 2023-08-09T12:39:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d11e1f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0cad60 con 0x7f9d0c0b3b40 2023-08-09T12:39:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d11e1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0c2370 con 0x7f9d0c0cc630 2023-08-09T12:39:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c0c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c0c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50180/0 (socket says 172.21.15.17:50180) 2023-08-09T12:39:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0b7fe640 1 -- 172.21.15.17:0/517465340 learned_addr learned my addr 172.21.15.17:0/517465340 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0affd640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d0c0b3b40 0x7f9d0c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0bfff640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d0c0cc630 0x7f9d0c0ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0b7fe640 1 -- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d0c0cc630 msgr2=0x7f9d0c0ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0b7fe640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d0c0cc630 0x7f9d0c0ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0b7fe640 1 -- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d0c0b3b40 msgr2=0x7f9d0c156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.053+0000 7f9d0b7fe640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d0c0b3b40 0x7f9d0c156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.054+0000 7f9d0b7fe640 1 -- 172.21.15.17:0/517465340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc009400 con 0x7f9d0c0adc40 2023-08-09T12:39:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.054+0000 7f9d0bfff640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d0c0cc630 0x7f9d0c0ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.054+0000 7f9d0b7fe640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c0c48b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc000c00 tx=0x7f9cfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.054+0000 7f9cf3fff640 1 -- 172.21.15.17:0/517465340 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc03ca00 con 0x7f9d0c0adc40 2023-08-09T12:39:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.054+0000 7f9cf3fff640 1 -- 172.21.15.17:0/517465340 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc03cb60 con 0x7f9d0c0adc40 2023-08-09T12:39:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.054+0000 7f9cf3fff640 1 -- 172.21.15.17:0/517465340 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc004030 con 0x7f9d0c0adc40 2023-08-09T12:39:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.054+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c0c2650 con 0x7f9d0c0adc40 2023-08-09T12:39:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.054+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c0caa70 con 0x7f9d0c0adc40 2023-08-09T12:39:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.056+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c0c24b0 con 0x7f9d0c0adc40 2023-08-09T12:39:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.056+0000 7f9cf3fff640 1 -- 172.21.15.17:0/517465340 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9cfc004190 con 0x7f9d0c0adc40 2023-08-09T12:39:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.057+0000 7f9cf3fff640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9cf806a050 0x7f9cf806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.057+0000 7f9cf3fff640 1 -- 172.21.15.17:0/517465340 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9cfc0aad70 con 0x7f9d0c0adc40 2023-08-09T12:39:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.058+0000 7f9d0affd640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9cf806a050 0x7f9cf806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.059+0000 7f9d0affd640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9cf806a050 0x7f9cf806c510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0c8900 tx=0x7f9d00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.062+0000 7f9cf3fff640 1 -- 172.21.15.17:0/517465340 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9d0c0c24b0 con 0x7f9d0c0adc40 2023-08-09T12:39:40.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.252+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d0c0c24b0 con 0x7f9d0c0adc40 2023-08-09T12:39:40.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.253+0000 7f9cf3fff640 1 -- 172.21.15.17:0/517465340 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d0c0c24b0 con 0x7f9d0c0adc40 2023-08-09T12:39:40.256 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:39:40.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9cf806a050 msgr2=0x7f9cf806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9cf806a050 0x7f9cf806c510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0c8900 tx=0x7f9d00009040 comp rx=0 tx=0).stop 2023-08-09T12:39:40.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 msgr2=0x7f9d0c0c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c0c48b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc000c00 tx=0x7f9cfc0046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 shutdown_connections 2023-08-09T12:39:40.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9cf806a050 0x7f9cf806c510 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d0c0cc630 0x7f9d0c0ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d0c0b3b40 0x7f9d0c156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 --2- 172.21.15.17:0/517465340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d0c0adc40 0x7f9d0c0c48b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 >> 172.21.15.17:0/517465340 conn(0x7f9d0c0cb1b0 msgr2=0x7f9d0c06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:40.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 shutdown_connections 2023-08-09T12:39:40.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.256+0000 7f9d11e1f640 1 -- 172.21.15.17:0/517465340 wait complete. 2023-08-09T12:39:40.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:39:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.503+0000 7f948eda2640 1 Processor -- start 2023-08-09T12:39:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.503+0000 7f948eda2640 1 -- start start 2023-08-09T12:39:40.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.504+0000 7f948eda2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94880cc430 0x7f948806f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f948eda2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94880af8d0 0x7f94880afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f948eda2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880ccbc0 con 0x7f948815aab0 2023-08-09T12:39:40.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f948eda2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94880b0280 con 0x7f94880cc430 2023-08-09T12:39:40.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f948eda2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880ccea0 con 0x7f94880af8d0 2023-08-09T12:39:40.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f948cb3e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f948815aab0 0x7f94880b2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38014/0 (socket says 172.21.15.17:38014) 2023-08-09T12:39:40.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f948cb3e640 1 -- 172.21.15.17:0/3059943942 learned_addr learned my addr 172.21.15.17:0/3059943942 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:40.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f9487fff640 1 --2- 172.21.15.17:0/3059943942 >> v2:172.21.15.17:3300/0 conn(0x7f94880cc430 0x7f948806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f948d33f640 1 --2- 172.21.15.17:0/3059943942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94880af8d0 0x7f94880afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.505+0000 7f94877fe640 1 -- 172.21.15.17:0/3059943942 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770127920 0 0) 0x7f94880ccbc0 con 0x7f948815aab0 2023-08-09T12:39:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.506+0000 7f9487fff640 1 -- 172.21.15.17:0/3059943942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94880af8d0 msgr2=0x7f94880afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.506+0000 7f9487fff640 1 --2- 172.21.15.17:0/3059943942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94880af8d0 0x7f94880afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.506+0000 7f9487fff640 1 -- 172.21.15.17:0/3059943942 >> v1:172.21.15.17:6789/0 conn(0x7f948815aab0 legacy=0x7f94880b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.506+0000 7f9487fff640 1 -- 172.21.15.17:0/3059943942 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880cd180 con 0x7f94880cc430 2023-08-09T12:39:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.507+0000 7f9487fff640 1 --2- 172.21.15.17:0/3059943942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f948806f010 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f947c0097a0 tx=0x7f947c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a60211dd0be5691 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:40.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.507+0000 7f94877fe640 1 -- 172.21.15.17:0/3059943942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c02d040 con 0x7f94880cc430 2023-08-09T12:39:40.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.507+0000 7f94877fe640 1 -- 172.21.15.17:0/3059943942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c031810 con 0x7f94880cc430 2023-08-09T12:39:40.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.507+0000 7f94877fe640 1 -- 172.21.15.17:0/3059943942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c031ba0 con 0x7f94880cc430 2023-08-09T12:39:40.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.508+0000 7f948eda2640 1 -- 172.21.15.17:0/3059943942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 msgr2=0x7f948806f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.508+0000 7f948eda2640 1 --2- 172.21.15.17:0/3059943942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f948806f010 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f947c0097a0 tx=0x7f947c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.508+0000 7f948eda2640 1 -- 172.21.15.17:0/3059943942 shutdown_connections 2023-08-09T12:39:40.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.508+0000 7f948eda2640 1 --2- 172.21.15.17:0/3059943942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94880af8d0 0x7f94880afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.508+0000 7f948eda2640 1 --2- 172.21.15.17:0/3059943942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f948806f010 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.508+0000 7f948eda2640 1 -- 172.21.15.17:0/3059943942 >> 172.21.15.17:0/3059943942 conn(0x7f94880cd440 msgr2=0x7f94880cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.508+0000 7f948eda2640 1 -- 172.21.15.17:0/3059943942 shutdown_connections 2023-08-09T12:39:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.508+0000 7f948eda2640 1 -- 172.21.15.17:0/3059943942 wait complete. 2023-08-09T12:39:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.510+0000 7f948eda2640 1 Processor -- start 2023-08-09T12:39:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.511+0000 7f948eda2640 1 -- start start 2023-08-09T12:39:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f948eda2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94880af8d0 0x7f948814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f948eda2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f94881f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f948eda2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948815aab0 0x7f94880c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f948eda2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c4f20 con 0x7f94880cc430 2023-08-09T12:39:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f948eda2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9488150490 con 0x7f94880af8d0 2023-08-09T12:39:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f948eda2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c4050 con 0x7f948815aab0 2023-08-09T12:39:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f9487fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f94881f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f9487fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f94881f1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50208/0 (socket says 172.21.15.17:50208) 2023-08-09T12:39:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.512+0000 7f9487fff640 1 -- 172.21.15.17:0/3516712447 learned_addr learned my addr 172.21.15.17:0/3516712447 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f948d33f640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948815aab0 0x7f94880c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f9487fff640 1 -- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948815aab0 msgr2=0x7f94880c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f9487fff640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948815aab0 0x7f94880c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f948cb3e640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94880af8d0 0x7f948814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f9487fff640 1 -- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94880af8d0 msgr2=0x7f948814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f9487fff640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94880af8d0 0x7f948814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f9487fff640 1 -- 172.21.15.17:0/3516712447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009400 con 0x7f94880cc430 2023-08-09T12:39:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f948cb3e640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94880af8d0 0x7f948814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.513+0000 7f9487fff640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f94881f1740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f947c02bec0 tx=0x7f947c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.514+0000 7f94857fa640 1 -- 172.21.15.17:0/3516712447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c03ad60 con 0x7f94880cc430 2023-08-09T12:39:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.514+0000 7f94857fa640 1 -- 172.21.15.17:0/3516712447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c0423f0 con 0x7f94880cc430 2023-08-09T12:39:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.514+0000 7f94857fa640 1 -- 172.21.15.17:0/3516712447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0427a0 con 0x7f94880cc430 2023-08-09T12:39:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.514+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94880c8c10 con 0x7f94880cc430 2023-08-09T12:39:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.514+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94880c4580 con 0x7f94880cc430 2023-08-09T12:39:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.515+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94880c5060 con 0x7f94880cc430 2023-08-09T12:39:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.517+0000 7f94857fa640 1 -- 172.21.15.17:0/3516712447 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f947c042900 con 0x7f94880cc430 2023-08-09T12:39:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.517+0000 7f94857fa640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947406a080 0x7f947406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.518+0000 7f94857fa640 1 -- 172.21.15.17:0/3516712447 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f947c0aa4e0 con 0x7f94880cc430 2023-08-09T12:39:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.518+0000 7f948cb3e640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947406a080 0x7f947406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.519+0000 7f948cb3e640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947406a080 0x7f947406c540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9478007fd0 tx=0x7f9478009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.522+0000 7f94857fa640 1 -- 172.21.15.17:0/3516712447 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f94880c5060 con 0x7f94880cc430 2023-08-09T12:39:40.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.754+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94880c5060 con 0x7f94880cc430 2023-08-09T12:39:40.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.755+0000 7f94857fa640 1 -- 172.21.15.17:0/3516712447 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4872 (secure 0 0 0) 0x7f94880c5060 con 0x7f94880cc430 2023-08-09T12:39:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:40.759 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:39:25.114229+0000","modified":"2023-08-09T12:39:28.660973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T12:39:40.759 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-08-09T12:39:40.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.757+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947406a080 msgr2=0x7f947406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.757+0000 7f948eda2640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947406a080 0x7f947406c540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9478007fd0 tx=0x7f9478009040 comp rx=0 tx=0).stop 2023-08-09T12:39:40.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 msgr2=0x7f94881f1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:40.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f94881f1740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f947c02bec0 tx=0x7f947c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 shutdown_connections 2023-08-09T12:39:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947406a080 0x7f947406c540 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948815aab0 0x7f94880c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94880cc430 0x7f94881f1740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 --2- 172.21.15.17:0/3516712447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94880af8d0 0x7f948814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 >> 172.21.15.17:0/3516712447 conn(0x7f94880cd440 msgr2=0x7f94880b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 shutdown_connections 2023-08-09T12:39:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.758+0000 7f948eda2640 1 -- 172.21.15.17:0/3516712447 wait complete. 2023-08-09T12:39:40.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:40.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.993+0000 7fd39e025640 1 Processor -- start 2023-08-09T12:39:40.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.994+0000 7fd39e025640 1 -- start start 2023-08-09T12:39:40.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.995+0000 7fd39e025640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3980b86e0 0x7fd3980cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.995+0000 7fd39e025640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3980cf980 0x7fd3980d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.995+0000 7fd39e025640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3980b5a30 con 0x7fd398160030 2023-08-09T12:39:41.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.995+0000 7fd39e025640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980d1110 con 0x7fd3980cf980 2023-08-09T12:39:41.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.995+0000 7fd39e025640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980ceac0 con 0x7fd3980b86e0 2023-08-09T12:39:41.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.996+0000 7fd39d824640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3980cf980 0x7fd3980d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.996+0000 7fd39d824640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3980cf980 0x7fd3980d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50210/0 (socket says 172.21.15.17:50210) 2023-08-09T12:39:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.996+0000 7fd39d824640 1 -- 172.21.15.17:0/4131483736 learned_addr learned my addr 172.21.15.17:0/4131483736 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.996+0000 7fd39c822640 1 --2- 172.21.15.17:0/4131483736 >> v2:172.21.15.142:3300/0 conn(0x7fd3980b86e0 0x7fd3980cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.996+0000 7fd39d824640 1 -- 172.21.15.17:0/4131483736 >> v2:172.21.15.142:3300/0 conn(0x7fd3980b86e0 msgr2=0x7fd3980cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.996+0000 7fd39d824640 1 --2- 172.21.15.17:0/4131483736 >> v2:172.21.15.142:3300/0 conn(0x7fd3980b86e0 0x7fd3980cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.996+0000 7fd39d824640 1 -- 172.21.15.17:0/4131483736 >> v1:172.21.15.142:6789/0 conn(0x7fd398160030 legacy=0x7fd398160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.996+0000 7fd39d824640 1 -- 172.21.15.17:0/4131483736 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980cfdd0 con 0x7fd3980cf980 2023-08-09T12:39:41.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.997+0000 7fd39d824640 1 --2- 172.21.15.17:0/4131483736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980d1530 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd39806b980 tx=0x7fd39002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32aa5419ce814ff server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:41.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd397fff640 1 -- 172.21.15.17:0/4131483736 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390031640 con 0x7fd3980cf980 2023-08-09T12:39:41.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd397fff640 1 -- 172.21.15.17:0/4131483736 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3900317a0 con 0x7fd3980cf980 2023-08-09T12:39:41.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd397fff640 1 -- 172.21.15.17:0/4131483736 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390031b30 con 0x7fd3980cf980 2023-08-09T12:39:41.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd39e025640 1 -- 172.21.15.17:0/4131483736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 msgr2=0x7fd3980d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd39e025640 1 --2- 172.21.15.17:0/4131483736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980d1530 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd39806b980 tx=0x7fd39002b8f0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd39e025640 1 -- 172.21.15.17:0/4131483736 shutdown_connections 2023-08-09T12:39:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd39e025640 1 --2- 172.21.15.17:0/4131483736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980d1530 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd39e025640 1 --2- 172.21.15.17:0/4131483736 >> v2:172.21.15.142:3300/0 conn(0x7fd3980b86e0 0x7fd3980cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd39e025640 1 -- 172.21.15.17:0/4131483736 >> 172.21.15.17:0/4131483736 conn(0x7fd3980697c0 msgr2=0x7fd398069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd39e025640 1 -- 172.21.15.17:0/4131483736 shutdown_connections 2023-08-09T12:39:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:40.998+0000 7fd39e025640 1 -- 172.21.15.17:0/4131483736 wait complete. 2023-08-09T12:39:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.000+0000 7fd39e025640 1 Processor -- start 2023-08-09T12:39:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.000+0000 7fd39e025640 1 -- start start 2023-08-09T12:39:41.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.001+0000 7fd39e025640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3980b86e0 0x7fd39815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.001+0000 7fd39e025640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.001+0000 7fd39e025640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd398160030 0x7fd3980c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.001+0000 7fd39e025640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd398154c20 con 0x7fd3980cf980 2023-08-09T12:39:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.001+0000 7fd39e025640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3981551e0 con 0x7fd3980b86e0 2023-08-09T12:39:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.001+0000 7fd39e025640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980cc6c0 con 0x7fd398160030 2023-08-09T12:39:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.001+0000 7fd39c822640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39c822640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50222/0 (socket says 172.21.15.17:50222) 2023-08-09T12:39:41.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39c822640 1 -- 172.21.15.17:0/3042030283 learned_addr learned my addr 172.21.15.17:0/3042030283 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:41.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39d023640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3980b86e0 0x7fd39815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39d824640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd398160030 0x7fd3980c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39c822640 1 -- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd398160030 msgr2=0x7fd3980c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39c822640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd398160030 0x7fd3980c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39c822640 1 -- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3980b86e0 msgr2=0x7fd39815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39c822640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3980b86e0 0x7fd39815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39c822640 1 -- 172.21.15.17:0/3042030283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900094d0 con 0x7fd3980cf980 2023-08-09T12:39:41.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39d023640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3980b86e0 0x7fd39815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:41.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.002+0000 7fd39c822640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980c5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00d830 tx=0x7fd38c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:41.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.003+0000 7fd395ffb640 1 -- 172.21.15.17:0/3042030283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00b6c0 con 0x7fd3980cf980 2023-08-09T12:39:41.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.003+0000 7fd395ffb640 1 -- 172.21.15.17:0/3042030283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c00b820 con 0x7fd3980cf980 2023-08-09T12:39:41.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.003+0000 7fd395ffb640 1 -- 172.21.15.17:0/3042030283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00bbb0 con 0x7fd3980cf980 2023-08-09T12:39:41.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.003+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3980cc9a0 con 0x7fd3980cf980 2023-08-09T12:39:41.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.003+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39815e830 con 0x7fd3980cf980 2023-08-09T12:39:41.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.004+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3980d0cf0 con 0x7fd3980cf980 2023-08-09T12:39:41.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.005+0000 7fd395ffb640 1 -- 172.21.15.17:0/3042030283 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd38c01e460 con 0x7fd3980cf980 2023-08-09T12:39:41.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.006+0000 7fd395ffb640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd38406a050 0x7fd38406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.006+0000 7fd395ffb640 1 -- 172.21.15.17:0/3042030283 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd38c088dd0 con 0x7fd3980cf980 2023-08-09T12:39:41.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.007+0000 7fd39d023640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd38406a050 0x7fd38406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.008+0000 7fd39d023640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd38406a050 0x7fd38406c510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd388007e90 tx=0x7fd3880073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:41.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.011+0000 7fd395ffb640 1 -- 172.21.15.17:0/3042030283 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd38c054420 con 0x7fd3980cf980 2023-08-09T12:39:41.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.197+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd39804e390 con 0x7fd3980cf980 2023-08-09T12:39:41.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.200+0000 7fd395ffb640 1 -- 172.21.15.17:0/3042030283 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fd38c057a40 con 0x7fd3980cf980 2023-08-09T12:39:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:41.204 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd38406a050 msgr2=0x7fd38406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd38406a050 0x7fd38406c510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd388007e90 tx=0x7fd3880073a0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 msgr2=0x7fd3980c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980c5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00d830 tx=0x7fd38c00dcf0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 shutdown_connections 2023-08-09T12:39:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd38406a050 0x7fd38406c510 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd398160030 0x7fd3980c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3980cf980 0x7fd3980c5160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 --2- 172.21.15.17:0/3042030283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3980b86e0 0x7fd39815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 >> 172.21.15.17:0/3042030283 conn(0x7fd3980697c0 msgr2=0x7fd39815f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 shutdown_connections 2023-08-09T12:39:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.203+0000 7fd39e025640 1 -- 172.21.15.17:0/3042030283 wait complete. 2023-08-09T12:39:41.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:39:41.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.436+0000 7fc0367bd640 1 Processor -- start 2023-08-09T12:39:41.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.436+0000 7fc0367bd640 1 -- start start 2023-08-09T12:39:41.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.438+0000 7fc0367bd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0300cfb50 0x7fc030167a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.438+0000 7fc0367bd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300b5a30 con 0x7fc030160030 2023-08-09T12:39:41.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.438+0000 7fc0367bd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300d0d70 con 0x7fc0300b86e0 2023-08-09T12:39:41.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.438+0000 7fc0367bd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0300d1110 con 0x7fc0300cfb50 2023-08-09T12:39:41.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.438+0000 7fc0357bb640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc030160030 0x7fc030160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38016/0 (socket says 172.21.15.17:38016) 2023-08-09T12:39:41.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.438+0000 7fc0357bb640 1 -- 172.21.15.17:0/4157212880 learned_addr learned my addr 172.21.15.17:0/4157212880 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:41.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.438+0000 7fc035fbc640 1 --2- 172.21.15.17:0/4157212880 >> v2:172.21.15.17:3300/0 conn(0x7fc0300cfb50 0x7fc030167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.439+0000 7fc027fff640 1 -- 172.21.15.17:0/4157212880 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281858232 0 0) 0x7fc0300b5a30 con 0x7fc030160030 2023-08-09T12:39:41.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.439+0000 7fc027fff640 1 -- 172.21.15.17:0/4157212880 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc01c003520 con 0x7fc030160030 2023-08-09T12:39:41.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.439+0000 7fc035fbc640 1 -- 172.21.15.17:0/4157212880 >> v1:172.21.15.142:6789/0 conn(0x7fc0300b86e0 legacy=0x7fc0300cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.439+0000 7fc035fbc640 1 -- 172.21.15.17:0/4157212880 >> v1:172.21.15.17:6789/0 conn(0x7fc030160030 legacy=0x7fc030160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.439+0000 7fc035fbc640 1 -- 172.21.15.17:0/4157212880 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030160f70 con 0x7fc0300cfb50 2023-08-09T12:39:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.440+0000 7fc035fbc640 1 --2- 172.21.15.17:0/4157212880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300cfb50 0x7fc030167a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0280097a0 tx=0x7fc02802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad79590b3dce9b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.440+0000 7fc027fff640 1 -- 172.21.15.17:0/4157212880 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028030610 con 0x7fc0300cfb50 2023-08-09T12:39:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.440+0000 7fc027fff640 1 -- 172.21.15.17:0/4157212880 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc028030770 con 0x7fc0300cfb50 2023-08-09T12:39:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.440+0000 7fc027fff640 1 -- 172.21.15.17:0/4157212880 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028030ae0 con 0x7fc0300cfb50 2023-08-09T12:39:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.441+0000 7fc0367bd640 1 -- 172.21.15.17:0/4157212880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300cfb50 msgr2=0x7fc030167a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.441+0000 7fc0367bd640 1 --2- 172.21.15.17:0/4157212880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300cfb50 0x7fc030167a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0280097a0 tx=0x7fc02802b960 comp rx=0 tx=0).stop 2023-08-09T12:39:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.441+0000 7fc0367bd640 1 -- 172.21.15.17:0/4157212880 shutdown_connections 2023-08-09T12:39:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.441+0000 7fc0367bd640 1 --2- 172.21.15.17:0/4157212880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300cfb50 0x7fc030167a90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.441+0000 7fc0367bd640 1 -- 172.21.15.17:0/4157212880 >> 172.21.15.17:0/4157212880 conn(0x7fc0300697c0 msgr2=0x7fc030069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.441+0000 7fc0367bd640 1 -- 172.21.15.17:0/4157212880 shutdown_connections 2023-08-09T12:39:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.441+0000 7fc0367bd640 1 -- 172.21.15.17:0/4157212880 wait complete. 2023-08-09T12:39:41.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.443+0000 7fc0367bd640 1 Processor -- start 2023-08-09T12:39:41.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.443+0000 7fc0367bd640 1 -- start start 2023-08-09T12:39:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.444+0000 7fc0367bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300b86e0 0x7fc030148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.444+0000 7fc0367bd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0300cfb50 0x7fc0300d2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.444+0000 7fc0367bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030160030 0x7fc0300d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.444+0000 7fc0367bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300b3890 con 0x7fc0300b86e0 2023-08-09T12:39:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.444+0000 7fc0367bd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300b3b70 con 0x7fc0300cfb50 2023-08-09T12:39:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.444+0000 7fc0367bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300b3e50 con 0x7fc030160030 2023-08-09T12:39:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.444+0000 7fc0357bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300b86e0 0x7fc030148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc0357bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300b86e0 0x7fc030148a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50240/0 (socket says 172.21.15.17:50240) 2023-08-09T12:39:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc0357bb640 1 -- 172.21.15.17:0/1295621372 learned_addr learned my addr 172.21.15.17:0/1295621372 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc035fbc640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030160030 0x7fc0300d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc034fba640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0300cfb50 0x7fc0300d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc0357bb640 1 -- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030160030 msgr2=0x7fc0300d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc0357bb640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030160030 0x7fc0300d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc0357bb640 1 -- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0300cfb50 msgr2=0x7fc0300d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc0357bb640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0300cfb50 0x7fc0300d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc0357bb640 1 -- 172.21.15.17:0/1295621372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028009400 con 0x7fc0300b86e0 2023-08-09T12:39:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc035fbc640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030160030 0x7fc0300d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc0357bb640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300b86e0 0x7fc030148a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00cbb0 tx=0x7fc02c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:41.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.445+0000 7fc025ffb640 1 -- 172.21.15.17:0/1295621372 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00ad40 con 0x7fc0300b86e0 2023-08-09T12:39:41.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.446+0000 7fc025ffb640 1 -- 172.21.15.17:0/1295621372 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c012400 con 0x7fc0300b86e0 2023-08-09T12:39:41.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.446+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0300b4130 con 0x7fc0300b86e0 2023-08-09T12:39:41.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.446+0000 7fc025ffb640 1 -- 172.21.15.17:0/1295621372 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00aea0 con 0x7fc0300b86e0 2023-08-09T12:39:41.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.446+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0300cb250 con 0x7fc0300b86e0 2023-08-09T12:39:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.447+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0300cb440 con 0x7fc0300b86e0 2023-08-09T12:39:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.448+0000 7fc025ffb640 1 -- 172.21.15.17:0/1295621372 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc02c007070 con 0x7fc0300b86e0 2023-08-09T12:39:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.449+0000 7fc025ffb640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc01406a050 0x7fc01406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.449+0000 7fc025ffb640 1 -- 172.21.15.17:0/1295621372 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc02c088600 con 0x7fc0300b86e0 2023-08-09T12:39:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.449+0000 7fc034fba640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc01406a050 0x7fc01406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:41.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.450+0000 7fc034fba640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc01406a050 0x7fc01406c510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc030153f10 tx=0x7fc020009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:41.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.453+0000 7fc025ffb640 1 -- 172.21.15.17:0/1295621372 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc02c053c70 con 0x7fc0300b86e0 2023-08-09T12:39:41.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.686+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc03004e390 con 0x7fc0300b86e0 2023-08-09T12:39:41.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.687+0000 7fc025ffb640 1 -- 172.21.15.17:0/1295621372 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4872 (secure 0 0 0) 0x7fc02c017090 con 0x7fc0300b86e0 2023-08-09T12:39:41.690 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:41.691 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:39:25.114229+0000","modified":"2023-08-09T12:39:28.660973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T12:39:41.691 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-08-09T12:39:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc01406a050 msgr2=0x7fc01406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc01406a050 0x7fc01406c510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc030153f10 tx=0x7fc020009040 comp rx=0 tx=0).stop 2023-08-09T12:39:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300b86e0 msgr2=0x7fc030148a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300b86e0 0x7fc030148a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00cbb0 tx=0x7fc02c00a430 comp rx=0 tx=0).stop 2023-08-09T12:39:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 shutdown_connections 2023-08-09T12:39:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc01406a050 0x7fc01406c510 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030160030 0x7fc0300d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0300cfb50 0x7fc0300d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 --2- 172.21.15.17:0/1295621372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0300b86e0 0x7fc030148a30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:41.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 >> 172.21.15.17:0/1295621372 conn(0x7fc0300697c0 msgr2=0x7fc0300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:41.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 shutdown_connections 2023-08-09T12:39:41.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:41.690+0000 7fc0367bd640 1 -- 172.21.15.17:0/1295621372 wait complete. 2023-08-09T12:39:42.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:39:25.114229+0000', 'modified': '2023-08-09T12:39:28.660973+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/2079787239', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 2079787239}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2079787239}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:39:42.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:39:42.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-09T12:39:42.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.349+0000 7f9645114640 1 Processor -- start 2023-08-09T12:39:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.349+0000 7f9645114640 1 -- start start 2023-08-09T12:39:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.351+0000 7f9645114640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9640070f00 0x7f964015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.351+0000 7f9645114640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964015bce0 0x7f96400cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.351+0000 7f9645114640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9640071340 con 0x7f96401587e0 2023-08-09T12:39:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.351+0000 7f9645114640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96400715c0 con 0x7f9640070f00 2023-08-09T12:39:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.351+0000 7f9645114640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96400718a0 con 0x7f964015bce0 2023-08-09T12:39:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.351+0000 7f963f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9640070f00 0x7f964015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f963f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9640070f00 0x7f964015b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50256/0 (socket says 172.21.15.17:50256) 2023-08-09T12:39:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f963f7fe640 1 -- 172.21.15.17:0/3455132222 learned_addr learned my addr 172.21.15.17:0/3455132222 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f9644913640 1 --2- 172.21.15.17:0/3455132222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964015bce0 0x7f96400cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f963f7fe640 1 -- 172.21.15.17:0/3455132222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964015bce0 msgr2=0x7f96400cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f963f7fe640 1 --2- 172.21.15.17:0/3455132222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964015bce0 0x7f96400cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f963f7fe640 1 -- 172.21.15.17:0/3455132222 >> v1:172.21.15.17:6789/0 conn(0x7f96401587e0 legacy=0x7f96400b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f963f7fe640 1 -- 172.21.15.17:0/3455132222 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640071b80 con 0x7f9640070f00 2023-08-09T12:39:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f963effd640 1 -- 172.21.15.17:0/3455132222 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735106841 0 0) 0x7f9640071340 con 0x7f96401587e0 2023-08-09T12:39:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.352+0000 7f9644913640 1 --2- 172.21.15.17:0/3455132222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964015bce0 0x7f96400cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:39:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.354+0000 7f963f7fe640 1 --2- 172.21.15.17:0/3455132222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9640070f00 0x7f964015b7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9634009870 tx=0x7f963402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226dd9a42a596a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.354+0000 7f963effd640 1 -- 172.21.15.17:0/3455132222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634030840 con 0x7f9640070f00 2023-08-09T12:39:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.354+0000 7f963effd640 1 -- 172.21.15.17:0/3455132222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96340309a0 con 0x7f9640070f00 2023-08-09T12:39:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.354+0000 7f963effd640 1 -- 172.21.15.17:0/3455132222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634030d30 con 0x7f9640070f00 2023-08-09T12:39:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.354+0000 7f9645114640 1 -- 172.21.15.17:0/3455132222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9640070f00 msgr2=0x7f964015b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.354+0000 7f9645114640 1 --2- 172.21.15.17:0/3455132222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9640070f00 0x7f964015b7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9634009870 tx=0x7f963402b980 comp rx=0 tx=0).stop 2023-08-09T12:39:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.355+0000 7f9645114640 1 -- 172.21.15.17:0/3455132222 shutdown_connections 2023-08-09T12:39:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.355+0000 7f9645114640 1 --2- 172.21.15.17:0/3455132222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f964015bce0 0x7f96400cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.355+0000 7f9645114640 1 --2- 172.21.15.17:0/3455132222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9640070f00 0x7f964015b7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.355+0000 7f9645114640 1 -- 172.21.15.17:0/3455132222 >> 172.21.15.17:0/3455132222 conn(0x7f96400b1d50 msgr2=0x7f964006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.355+0000 7f9645114640 1 -- 172.21.15.17:0/3455132222 shutdown_connections 2023-08-09T12:39:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.355+0000 7f9645114640 1 -- 172.21.15.17:0/3455132222 wait complete. 2023-08-09T12:39:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.357+0000 7f9645114640 1 Processor -- start 2023-08-09T12:39:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.357+0000 7f9645114640 1 -- start start 2023-08-09T12:39:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f9645114640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9640070f00 0x7f964014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f9645114640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96401587e0 0x7f96400ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f9645114640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400ad7d0 0x7f96400c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f9645114640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96400c6810 con 0x7f96401587e0 2023-08-09T12:39:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f9645114640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964014f060 con 0x7f96400ad7d0 2023-08-09T12:39:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f9645114640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96400c6ad0 con 0x7f9640070f00 2023-08-09T12:39:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f963f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96401587e0 0x7f96400ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f963f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96401587e0 0x7f96400ad290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50270/0 (socket says 172.21.15.17:50270) 2023-08-09T12:39:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f963f7fe640 1 -- 172.21.15.17:0/3787059939 learned_addr learned my addr 172.21.15.17:0/3787059939 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.358+0000 7f963ffff640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9640070f00 0x7f964014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.359+0000 7f963f7fe640 1 -- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9640070f00 msgr2=0x7f964014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.359+0000 7f963f7fe640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9640070f00 0x7f964014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.359+0000 7f9644913640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400ad7d0 0x7f96400c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.359+0000 7f963f7fe640 1 -- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400ad7d0 msgr2=0x7f96400c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.359+0000 7f963f7fe640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400ad7d0 0x7f96400c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.359+0000 7f963f7fe640 1 -- 172.21.15.17:0/3787059939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340094d0 con 0x7f96401587e0 2023-08-09T12:39:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.359+0000 7f963f7fe640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96401587e0 0x7f96400ad290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9634009870 tx=0x7f9634004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.359+0000 7f963cff9640 1 -- 172.21.15.17:0/3787059939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634039c90 con 0x7f96401587e0 2023-08-09T12:39:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.360+0000 7f963cff9640 1 -- 172.21.15.17:0/3787059939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9634039df0 con 0x7f96401587e0 2023-08-09T12:39:42.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.360+0000 7f9645114640 1 -- 172.21.15.17:0/3787059939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96400c6db0 con 0x7f96401587e0 2023-08-09T12:39:42.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.360+0000 7f963cff9640 1 -- 172.21.15.17:0/3787059939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634043620 con 0x7f96401587e0 2023-08-09T12:39:42.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.360+0000 7f9645114640 1 -- 172.21.15.17:0/3787059939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96400c7370 con 0x7f96401587e0 2023-08-09T12:39:42.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.362+0000 7f963cff9640 1 -- 172.21.15.17:0/3787059939 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9634043780 con 0x7f96401587e0 2023-08-09T12:39:42.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.363+0000 7f963cff9640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f962c06a050 0x7f962c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.363+0000 7f963cff9640 1 -- 172.21.15.17:0/3787059939 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f963403e070 con 0x7f96401587e0 2023-08-09T12:39:42.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.364+0000 7f9648fc1740 1 Processor -- start 2023-08-09T12:39:42.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.364+0000 7f963ffff640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f962c06a050 0x7f962c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.364+0000 7f9648fc1740 1 -- start start 2023-08-09T12:39:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f2c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01efbdb0 0x562d01f290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01eff9b0 0x562d01f295e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f9648fc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d01e6d8f0 con 0x562d01efbdb0 2023-08-09T12:39:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f9648fc1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d01e6afe0 con 0x562d01eff9b0 2023-08-09T12:39:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f9648fc1740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d01e668d0 con 0x562d01f2be30 2023-08-09T12:39:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f963ffff640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f962c06a050 0x7f962c06c510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9630000f60 tx=0x7f9630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f963f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01efbdb0 0x562d01f290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f963f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01efbdb0 0x562d01f290a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50274/0 (socket says 172.21.15.17:50274) 2023-08-09T12:39:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f963f7fe640 1 -- 172.21.15.17:0/4427065 learned_addr learned my addr 172.21.15.17:0/4427065 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f9644913640 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01eff9b0 0x562d01f295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f963ffff640 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f2c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f963f7fe640 1 -- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 msgr2=0x562d01f2c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.365+0000 7f963f7fe640 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f2c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f963f7fe640 1 -- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01eff9b0 msgr2=0x562d01f295e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f963f7fe640 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01eff9b0 0x562d01f295e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f963f7fe640 1 -- 172.21.15.17:0/4427065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d01e1fac0 con 0x562d01efbdb0 2023-08-09T12:39:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f9644913640 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01eff9b0 0x562d01f295e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f963ffff640 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f2c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f963f7fe640 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01efbdb0 0x562d01f290a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f96340090b0 tx=0x7f963404d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe28f6926e3e723 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f9625ffb640 1 -- 172.21.15.17:0/4427065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634078bc0 con 0x562d01efbdb0 2023-08-09T12:39:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f9625ffb640 1 -- 172.21.15.17:0/4427065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9634078e20 con 0x562d01efbdb0 2023-08-09T12:39:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.366+0000 7f9625ffb640 1 -- 172.21.15.17:0/4427065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634076870 con 0x562d01efbdb0 2023-08-09T12:39:42.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 -- 172.21.15.17:0/4427065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01efbdb0 msgr2=0x562d01f290a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01efbdb0 0x562d01f290a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f96340090b0 tx=0x7f963404d000 comp rx=0 tx=0).stop 2023-08-09T12:39:42.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 -- 172.21.15.17:0/4427065 shutdown_connections 2023-08-09T12:39:42.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01eff9b0 0x562d01f295e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01efbdb0 0x562d01f290a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4427065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f2c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 -- 172.21.15.17:0/4427065 >> 172.21.15.17:0/4427065 conn(0x562d01efe0c0 msgr2=0x562d01f46c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 -- 172.21.15.17:0/4427065 shutdown_connections 2023-08-09T12:39:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.367+0000 7f9648fc1740 1 -- 172.21.15.17:0/4427065 wait complete. 2023-08-09T12:39:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.368+0000 7f9648fc1740 1 -- start start 2023-08-09T12:39:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.368+0000 7f9648fc1740 1 Processor -- start 2023-08-09T12:39:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01eff9b0 0x562d01f2eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f26bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f3fd20 0x562d01f3d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9648fc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d01e06d40 con 0x562d01eff9b0 2023-08-09T12:39:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9648fc1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d01e069e0 con 0x562d01f3fd20 2023-08-09T12:39:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9648fc1740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d01bccf20 con 0x562d01f2be30 2023-08-09T12:39:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9648fc1740 10 client.0 _ll_register_callbacks cb 0x562d01e1f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:39:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01eff9b0 0x562d01f2eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01eff9b0 0x562d01f2eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50280/0 (socket says 172.21.15.17:50280) 2023-08-09T12:39:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963ffff640 1 -- 172.21.15.17:0/2930225792 learned_addr learned my addr 172.21.15.17:0/2930225792 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963f7fe640 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f26bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9644913640 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f3fd20 0x562d01f3d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963ffff640 1 -- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 msgr2=0x562d01f26bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963ffff640 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f26bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963ffff640 1 -- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f3fd20 msgr2=0x562d01f3d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963ffff640 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f3fd20 0x562d01f3d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f963ffff640 1 -- 172.21.15.17:0/2930225792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96400c7370 con 0x562d01eff9b0 2023-08-09T12:39:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.370+0000 7f9644913640 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f3fd20 0x562d01f3d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.371+0000 7f963ffff640 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01eff9b0 0x562d01f2eb60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f963000ea90 tx=0x7f9630000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3c335315ae6895 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.371+0000 7f961effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:39:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.371+0000 7f961effd640 1 -- 172.21.15.17:0/2930225792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630003d00 con 0x562d01eff9b0 2023-08-09T12:39:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.371+0000 7f961effd640 1 -- 172.21.15.17:0/2930225792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9630021be0 con 0x562d01eff9b0 2023-08-09T12:39:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.371+0000 7f9648fc1740 1 -- 172.21.15.17:0/2930225792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d01e3e500 con 0x562d01eff9b0 2023-08-09T12:39:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.371+0000 7f961effd640 1 -- 172.21.15.17:0/2930225792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9630003e60 con 0x562d01eff9b0 2023-08-09T12:39:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.371+0000 7f9648fc1740 10 client.4650 fetch_fsmap learned FSMap version 8 2023-08-09T12:39:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.371+0000 7f9648fc1740 1 -- 172.21.15.17:0/2930225792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x562d01e64f50 con 0x562d01eff9b0 2023-08-09T12:39:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f961effd640 1 -- 172.21.15.17:0/2930225792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562d01e3e500 con 0x562d01eff9b0 2023-08-09T12:39:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f961effd640 1 -- 172.21.15.17:0/2930225792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9630021420 con 0x562d01eff9b0 2023-08-09T12:39:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f9648fc1740 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2023-08-09T12:39:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f9648fc1740 10 client.4650 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T12:39:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f9648fc1740 20 client.4650 populate_metadata read hostname 'smithi017' 2023-08-09T12:39:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] conn(0x562d01f5a140 0x562d01f5a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f9648fc1740 4 client.4650 mds_command: new command op to 4281 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:39:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f9648fc1740 1 -- 172.21.15.17:0/2930225792 --> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d01e3bbc0 con 0x562d01f5a140 2023-08-09T12:39:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.372+0000 7f963f7fe640 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] conn(0x562d01f5a140 0x562d01f5a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.373+0000 7f963f7fe640 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] conn(0x562d01f5a140 0x562d01f5a520 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2092827ae31f0b9e server_cookie=ec8236387f665a91 in_seq=0 out_seq=0 2023-08-09T12:39:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.373+0000 7f961effd640 10 client.4650 ms_handle_connect on v2:172.21.15.17:6834/2079787239 2023-08-09T12:39:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.373+0000 7f961effd640 1 -- 172.21.15.17:0/2930225792 <== mds.0 v2:172.21.15.17:6834/2079787239 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562d01e3bbc0 con 0x562d01f5a140 2023-08-09T12:39:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.373+0000 7f961effd640 10 client.4650 handle_command_reply: tid=0 2023-08-09T12:39:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.373+0000 7f9648fc1740 1 client.4650 shutdown 2023-08-09T12:39:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 -- 172.21.15.17:0/2930225792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01eff9b0 msgr2=0x562d01f2eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01eff9b0 0x562d01f2eb60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f963000ea90 tx=0x7f9630000ed0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 -- 172.21.15.17:0/2930225792 shutdown_connections 2023-08-09T12:39:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] conn(0x562d01f5a140 0x562d01f5a520 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f3fd20 0x562d01f3d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01f2be30 0x562d01f26bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2930225792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01eff9b0 0x562d01f2eb60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 -- 172.21.15.17:0/2930225792 >> 172.21.15.17:0/2930225792 conn(0x562d01efbdb0 msgr2=0x562d01f00230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f961effd640 0 client.4650 ms_handle_reset on v2:172.21.15.17:6834/2079787239 2023-08-09T12:39:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 -- 172.21.15.17:0/2930225792 shutdown_connections 2023-08-09T12:39:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 1 -- 172.21.15.17:0/2930225792 wait complete. 2023-08-09T12:39:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.374+0000 7f9648fc1740 20 client.4650 trim_cache size 0 max 16384 2023-08-09T12:39:42.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.393+0000 7f9648fc1740 1 Processor -- start 2023-08-09T12:39:42.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.393+0000 7f9648fc1740 1 -- start start 2023-08-09T12:39:42.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.394+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 0x562d01efb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f59330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f2e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f9648fc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d01f29980 con 0x562d01f3fd20 2023-08-09T12:39:42.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f9648fc1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d01f41170 con 0x562d01f2be30 2023-08-09T12:39:42.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f9648fc1740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d01f294e0 con 0x562d01eff9b0 2023-08-09T12:39:42.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f9644913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f2e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f9644913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f2e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50284/0 (socket says 172.21.15.17:50284) 2023-08-09T12:39:42.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f9644913640 1 -- 172.21.15.17:0/2388652923 learned_addr learned my addr 172.21.15.17:0/2388652923 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:42.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f963ffff640 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 0x562d01efb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.395+0000 7f963f7fe640 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f59330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f9644913640 1 -- 172.21.15.17:0/2388652923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 msgr2=0x562d01efb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f9644913640 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 0x562d01efb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f9644913640 1 -- 172.21.15.17:0/2388652923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 msgr2=0x562d01f59330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f9644913640 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f59330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f9644913640 1 -- 172.21.15.17:0/2388652923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d01e98300 con 0x562d01f3fd20 2023-08-09T12:39:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f9644913640 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f2e590 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9638004220 tx=0x7f96380046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d6d8f2cd2182d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f96267fc640 1 -- 172.21.15.17:0/2388652923 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638015480 con 0x562d01f3fd20 2023-08-09T12:39:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f96267fc640 1 -- 172.21.15.17:0/2388652923 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963800f040 con 0x562d01f3fd20 2023-08-09T12:39:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.396+0000 7f96267fc640 1 -- 172.21.15.17:0/2388652923 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638015800 con 0x562d01f3fd20 2023-08-09T12:39:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 -- 172.21.15.17:0/2388652923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 msgr2=0x562d01f2e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f2e590 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9638004220 tx=0x7f96380046e0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 -- 172.21.15.17:0/2388652923 shutdown_connections 2023-08-09T12:39:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f2e590 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f59330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 --2- 172.21.15.17:0/2388652923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 0x562d01efb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 -- 172.21.15.17:0/2388652923 >> 172.21.15.17:0/2388652923 conn(0x562d01efbdb0 msgr2=0x562d01efc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 -- 172.21.15.17:0/2388652923 shutdown_connections 2023-08-09T12:39:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.397+0000 7f9648fc1740 1 -- 172.21.15.17:0/2388652923 wait complete. 2023-08-09T12:39:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.398+0000 7f9648fc1740 1 -- start start 2023-08-09T12:39:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.398+0000 7f9648fc1740 1 Processor -- start 2023-08-09T12:39:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.399+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 0x562d01f550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.399+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f555f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.399+0000 7f9648fc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f488e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.399+0000 7f9648fc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d01f3e460 con 0x562d01f3fd20 2023-08-09T12:39:42.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.399+0000 7f9648fc1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d01f3e610 con 0x562d01f2be30 2023-08-09T12:39:42.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.399+0000 7f9648fc1740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d01f2e9a0 con 0x562d01eff9b0 2023-08-09T12:39:42.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.399+0000 7f9648fc1740 10 client.0 _ll_register_callbacks cb 0x7f9630001410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:39:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50288/0 (socket says 172.21.15.17:50288) 2023-08-09T12:39:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 -- 172.21.15.17:0/4261278111 learned_addr learned my addr 172.21.15.17:0/4261278111 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f963f7fe640 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f963ffff640 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 0x562d01f550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 -- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 msgr2=0x562d01f550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 0x562d01f550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 -- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 msgr2=0x562d01f555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 -- 172.21.15.17:0/4261278111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9638003dc0 con 0x562d01f3fd20 2023-08-09T12:39:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f963f7fe640 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f9644913640 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f488e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9638017040 tx=0x7f9638004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4422f2159423837 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.400+0000 7f961effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:39:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f961effd640 1 -- 172.21.15.17:0/4261278111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638015e50 con 0x562d01f3fd20 2023-08-09T12:39:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f961effd640 1 -- 172.21.15.17:0/4261278111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9638029c40 con 0x562d01f3fd20 2023-08-09T12:39:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 1 -- 172.21.15.17:0/4261278111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d01e8e800 con 0x562d01f3fd20 2023-08-09T12:39:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f961effd640 1 -- 172.21.15.17:0/4261278111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9638003c40 con 0x562d01f3fd20 2023-08-09T12:39:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 10 client.4656 fetch_fsmap learned FSMap version 8 2023-08-09T12:39:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 1 -- 172.21.15.17:0/4261278111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x562d01e05a10 con 0x562d01f3fd20 2023-08-09T12:39:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f961effd640 1 -- 172.21.15.17:0/4261278111 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562d01e8e800 con 0x562d01f3fd20 2023-08-09T12:39:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f961effd640 1 -- 172.21.15.17:0/4261278111 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9638028430 con 0x562d01f3fd20 2023-08-09T12:39:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2023-08-09T12:39:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 10 client.4656 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T12:39:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 20 client.4656 populate_metadata read hostname 'smithi017' 2023-08-09T12:39:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] conn(0x562d01faec60 0x562d01faf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 4 client.4656 mds_command: new command op to 4281 tid=0[{"prefix": "status"}] 2023-08-09T12:39:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.401+0000 7f9648fc1740 1 -- 172.21.15.17:0/4261278111 --> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562d01e5f8b0 con 0x562d01faec60 2023-08-09T12:39:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.402+0000 7f963ffff640 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] conn(0x562d01faec60 0x562d01faf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.402+0000 7f963ffff640 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] conn(0x562d01faec60 0x562d01faf040 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92babdd2f9203a0b server_cookie=d64a87da15133f50 in_seq=0 out_seq=0 2023-08-09T12:39:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.402+0000 7f961effd640 10 client.4656 ms_handle_connect on v2:172.21.15.17:6834/2079787239 2023-08-09T12:39:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.402+0000 7f961effd640 1 -- 172.21.15.17:0/4261278111 <== mds.0 v2:172.21.15.17:6834/2079787239 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x562d01e5f8b0 con 0x562d01faec60 2023-08-09T12:39:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f961effd640 10 client.4656 handle_command_reply: tid=0 2023-08-09T12:39:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 client.4656 shutdown 2023-08-09T12:39:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 -- 172.21.15.17:0/4261278111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 msgr2=0x562d01f488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f488e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9638017040 tx=0x7f9638004ab0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 -- 172.21.15.17:0/4261278111 shutdown_connections 2023-08-09T12:39:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.17:6834/2079787239,v1:172.21.15.17:6835/2079787239] conn(0x562d01faec60 0x562d01faf040 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d01f3fd20 0x562d01f488e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d01f2be30 0x562d01f555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 --2- 172.21.15.17:0/4261278111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562d01eff9b0 0x562d01f550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f961effd640 0 client.4656 ms_handle_reset on v2:172.21.15.17:6834/2079787239 2023-08-09T12:39:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 -- 172.21.15.17:0/4261278111 >> 172.21.15.17:0/4261278111 conn(0x562d01efbdb0 msgr2=0x562d01efaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 -- 172.21.15.17:0/4261278111 shutdown_connections 2023-08-09T12:39:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 1 -- 172.21.15.17:0/4261278111 wait complete. 2023-08-09T12:39:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.403+0000 7f9648fc1740 20 client.4656 trim_cache size 0 max 16384 2023-08-09T12:39:42.415 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:39:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:39:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:39:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4281, 2023-08-09T12:39:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:39:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:39:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:39:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 16.762331237000001, 2023-08-09T12:39:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 8, 2023-08-09T12:39:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 24, 2023-08-09T12:39:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 24, 2023-08-09T12:39:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 22.900235075000001 2023-08-09T12:39:42.417 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:39:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 -- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f962c06a050 msgr2=0x7f962c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f962c06a050 0x7f962c06c510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9630000f60 tx=0x7f9630009040 comp rx=0 tx=0).stop 2023-08-09T12:39:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 -- 172.21.15.17:0/3787059939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96401587e0 msgr2=0x7f96400ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96401587e0 0x7f96400ad290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9634009870 tx=0x7f9634004730 comp rx=0 tx=0).stop 2023-08-09T12:39:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 -- 172.21.15.17:0/3787059939 shutdown_connections 2023-08-09T12:39:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f962c06a050 0x7f962c06c510 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96400ad7d0 0x7f96400c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96401587e0 0x7f96400ad290 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 --2- 172.21.15.17:0/3787059939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9640070f00 0x7f964014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 -- 172.21.15.17:0/3787059939 >> 172.21.15.17:0/3787059939 conn(0x7f96400b1d50 msgr2=0x7f96400cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 -- 172.21.15.17:0/3787059939 shutdown_connections 2023-08-09T12:39:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:42.404+0000 7f9645114640 1 -- 172.21.15.17:0/3787059939 wait complete. 2023-08-09T12:39:42.425 INFO:teuthology.run_tasks:Running task kclient... 2023-08-09T12:39:42.453 INFO:tasks.kclient:Mounting kernel clients... 2023-08-09T12:39:42.454 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-09T12:39:42.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:42.455 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:39:42.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:42.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-08-09T12:39:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2023-08-09T12:39:42.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:39:42.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:42.632 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:39:42.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:42.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-08-09T12:39:42.803 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2023-08-09T12:39:42.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:39:42.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:42.809 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:39:42.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:42.871 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-08-09T12:39:42.977 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-08-09T12:39:42.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:39:42.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:42.981 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:39:43.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:43.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-08-09T12:39:43.131 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-08-09T12:39:43.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:39:43.135 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-08-09T12:39:43.135 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-09T12:39:43.135 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:39:43.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:39:43.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.373+0000 7f6de4b79640 1 Processor -- start 2023-08-09T12:39:43.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.373+0000 7f6de4b79640 1 -- start start 2023-08-09T12:39:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.374+0000 7f6de4b79640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6de00adc40 0x7f6de006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.375+0000 7f6de4b79640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de00b2250 con 0x7f6de00cc630 2023-08-09T12:39:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.375+0000 7f6de4b79640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de00b2530 con 0x7f6de00b3b40 2023-08-09T12:39:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.375+0000 7f6de4b79640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de00ae020 con 0x7f6de00adc40 2023-08-09T12:39:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.375+0000 7f6dded9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6de00cc630 0x7f6de00ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38032/0 (socket says 172.21.15.17:38032) 2023-08-09T12:39:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.375+0000 7f6dded9d640 1 -- 172.21.15.17:0/2016885565 learned_addr learned my addr 172.21.15.17:0/2016885565 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.375+0000 7f6dde59c640 1 --2- 172.21.15.17:0/2016885565 >> v2:172.21.15.142:3300/0 conn(0x7f6de00adc40 0x7f6de006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648115790 0 0) 0x7f6de00b2250 con 0x7f6de00cc630 2023-08-09T12:39:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dcc003520 con 0x7f6de00cc630 2023-08-09T12:39:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2073319527 0 0) 0x7f6dcc003520 con 0x7f6de00cc630 2023-08-09T12:39:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 >> v2:172.21.15.142:3300/0 conn(0x7f6de00adc40 msgr2=0x7f6de006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 --2- 172.21.15.17:0/2016885565 >> v2:172.21.15.142:3300/0 conn(0x7f6de00adc40 0x7f6de006c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 >> v1:172.21.15.142:6789/0 conn(0x7f6de00b3b40 legacy=0x7f6de00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de006fe80 con 0x7f6de00cc630 2023-08-09T12:39:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f6dd80019f0 con 0x7f6de00cc630 2023-08-09T12:39:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 >> v1:172.21.15.17:6789/0 conn(0x7f6de00cc630 legacy=0x7f6de00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dcc003970 0x7f6dcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dcc0047c0 0x7f6dcc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc005180 0x7f6dcc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00ae020 con 0x7f6dcc003970 2023-08-09T12:39:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc00c120 con 0x7f6dcc0047c0 2023-08-09T12:39:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.376+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc00c2e0 con 0x7f6dcc005180 2023-08-09T12:39:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dde59c640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dcc003970 0x7f6dcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dd7fff640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dcc0047c0 0x7f6dcc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dded9d640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc005180 0x7f6dcc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dde59c640 1 -- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc005180 msgr2=0x7f6dcc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dde59c640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc005180 0x7f6dcc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dde59c640 1 -- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dcc0047c0 msgr2=0x7f6dcc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dde59c640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dcc0047c0 0x7f6dcc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dde59c640 1 -- 172.21.15.17:0/2016885565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc003520 con 0x7f6dcc003970 2023-08-09T12:39:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dded9d640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc005180 0x7f6dcc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.377+0000 7f6dded9d640 1 -- 172.21.15.17:0/2016885565 reap_dead start 2023-08-09T12:39:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.379+0000 7f6dde59c640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dcc003970 0x7f6dcc003d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009ac0 tx=0x7f6dcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa16b690ca293fa server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.379+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd002c6b0 con 0x7f6dcc003970 2023-08-09T12:39:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.379+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd002c810 con 0x7f6dcc003970 2023-08-09T12:39:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.379+0000 7f6dddd9b640 1 -- 172.21.15.17:0/2016885565 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd002cba0 con 0x7f6dcc003970 2023-08-09T12:39:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.380+0000 7f6de4b79640 1 -- 172.21.15.17:0/2016885565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dcc003970 msgr2=0x7f6dcc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.380+0000 7f6de4b79640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dcc003970 0x7f6dcc003d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009ac0 tx=0x7f6dcc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.380+0000 7f6de4b79640 1 -- 172.21.15.17:0/2016885565 shutdown_connections 2023-08-09T12:39:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.380+0000 7f6de4b79640 1 --2- 172.21.15.17:0/2016885565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6dcc003970 0x7f6dcc003d90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.380+0000 7f6de4b79640 1 -- 172.21.15.17:0/2016885565 >> 172.21.15.17:0/2016885565 conn(0x7f6de00cb1b0 msgr2=0x7f6de00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:43.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.380+0000 7f6de4b79640 1 -- 172.21.15.17:0/2016885565 shutdown_connections 2023-08-09T12:39:43.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.380+0000 7f6de4b79640 1 -- 172.21.15.17:0/2016885565 wait complete. 2023-08-09T12:39:43.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.382+0000 7f6de4b79640 1 Processor -- start 2023-08-09T12:39:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.382+0000 7f6de4b79640 1 -- start start 2023-08-09T12:39:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6de4b79640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc003970 0x7f6de00c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6de4b79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de01e3a70 0x7f6de00c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6de4b79640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de01e3ef0 0x7f6de00c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6de4b79640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de015b0e0 con 0x7f6de01e3a70 2023-08-09T12:39:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6de4b79640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c3c80 con 0x7f6de01e3ef0 2023-08-09T12:39:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6de4b79640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c71b0 con 0x7f6dcc003970 2023-08-09T12:39:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6dd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de01e3a70 0x7f6de00c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6dd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de01e3a70 0x7f6de00c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50304/0 (socket says 172.21.15.17:50304) 2023-08-09T12:39:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6dd7fff640 1 -- 172.21.15.17:0/1958851688 learned_addr learned my addr 172.21.15.17:0/1958851688 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.383+0000 7f6dde59c640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc003970 0x7f6de00c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd7fff640 1 -- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc003970 msgr2=0x7f6de00c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd7fff640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc003970 0x7f6de00c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dded9d640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de01e3ef0 0x7f6de00c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd7fff640 1 -- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de01e3ef0 msgr2=0x7f6de00c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd7fff640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de01e3ef0 0x7f6de00c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd7fff640 1 -- 172.21.15.17:0/1958851688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de01e6ac0 con 0x7f6de01e3a70 2023-08-09T12:39:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dde59c640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc003970 0x7f6de00c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd7fff640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de01e3a70 0x7f6de00c6730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e4a0 tx=0x7f6dc800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd6ffd640 1 -- 172.21.15.17:0/1958851688 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80052e0 con 0x7f6de01e3a70 2023-08-09T12:39:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd6ffd640 1 -- 172.21.15.17:0/1958851688 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8005440 con 0x7f6de01e3a70 2023-08-09T12:39:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de01e6da0 con 0x7f6de01e3a70 2023-08-09T12:39:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6dd6ffd640 1 -- 172.21.15.17:0/1958851688 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8003880 con 0x7f6de01e3a70 2023-08-09T12:39:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.384+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de00c41b0 con 0x7f6de01e3a70 2023-08-09T12:39:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.385+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de00c4340 con 0x7f6de01e3a70 2023-08-09T12:39:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.387+0000 7f6dd6ffd640 1 -- 172.21.15.17:0/1958851688 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6dc80039e0 con 0x7f6de01e3a70 2023-08-09T12:39:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.387+0000 7f6dd6ffd640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dc006a080 0x7f6dc006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.388+0000 7f6dd6ffd640 1 -- 172.21.15.17:0/1958851688 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6dc8088300 con 0x7f6de01e3a70 2023-08-09T12:39:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.388+0000 7f6dde59c640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dc006a080 0x7f6dc006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.389+0000 7f6dde59c640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dc006a080 0x7f6dc006c540 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0036000 tx=0x7f6dd0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.392+0000 7f6dd6ffd640 1 -- 172.21.15.17:0/1958851688 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6dc80539e0 con 0x7f6de01e3a70 2023-08-09T12:39:43.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.625+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6de0067a80 con 0x7f6de01e3a70 2023-08-09T12:39:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.625+0000 7f6dd6ffd640 1 -- 172.21.15.17:0/1958851688 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6dc8057000 con 0x7f6de01e3a70 2023-08-09T12:39:43.629 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:39:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.628+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dc006a080 msgr2=0x7f6dc006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.628+0000 7f6de4b79640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dc006a080 0x7f6dc006c540 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0036000 tx=0x7f6dd0030000 comp rx=0 tx=0).stop 2023-08-09T12:39:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.628+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de01e3a70 msgr2=0x7f6de00c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.628+0000 7f6de4b79640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de01e3a70 0x7f6de00c6730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e4a0 tx=0x7f6dc800e960 comp rx=0 tx=0).stop 2023-08-09T12:39:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.629+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 shutdown_connections 2023-08-09T12:39:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.629+0000 7f6de4b79640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dc006a080 0x7f6dc006c540 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.629+0000 7f6de4b79640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de01e3ef0 0x7f6de00c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.629+0000 7f6de4b79640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de01e3a70 0x7f6de00c6730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.629+0000 7f6de4b79640 1 --2- 172.21.15.17:0/1958851688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dcc003970 0x7f6de00c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.629+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 >> 172.21.15.17:0/1958851688 conn(0x7f6de00cb1b0 msgr2=0x7f6de00699d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.629+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 shutdown_connections 2023-08-09T12:39:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:43.629+0000 7f6de4b79640 1 -- 172.21.15.17:0/1958851688 wait complete. 2023-08-09T12:39:43.653 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-09T12:39:43.653 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:39:43.653 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:39:43.654 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:39:43.654 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:39:43.654 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-09T12:39:43.654 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-09T12:39:43.654 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:39:43.654 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:39:43.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:43.655 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:39:43.712 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:39:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:39:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:39:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:39:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:43.714 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:39:43.715 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:39:43.716 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:39:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:39:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:39:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42196sec preferred_lft 42196sec 2023-08-09T12:39:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:39:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:43.717 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:39:43.719 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-09T12:39:43.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:43.720 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:43.720 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:43.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2023-08-09T12:39:43.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2023-08-09T12:39:43.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2023-08-09T12:39:43.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-09T12:39:43.723 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:44.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:44.218 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:39:44.301 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:39:44.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:44.305 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:39:44.361 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:39:44.361 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:39:44.361 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:39:44.361 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:39:44.361 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:39:44.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:44.362 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:44.362 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:44.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:39:44.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:39:44.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:39:44.363 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:45.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:45.230 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:39:45.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:45.291 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2023-08-09T12:39:45.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:45.350 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:45.350 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:45.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:39:45.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-09T12:39:45.351 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:45.508 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-09T12:39:45.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:45.509 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:45.509 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:45.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-09T12:39:45.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-09T12:39:45.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-09T12:39:45.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-09T12:39:45.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-09T12:39:45.510 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:45.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:45.812 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:45.813 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:45.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:39:45.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2023-08-09T12:39:45.813 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:45.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:39:45.992 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:39:46.041 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:39:46.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:39:46.042 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:39:46.093 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:39:46.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:46.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:39:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:39:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:39:46.230 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:39:46.805 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:39:46.805 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:39:46.805 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:39:46.806 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:39:46.806 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:39:46.836 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:39:46.836 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:39:46.836 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:39:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:39:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:39:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:39:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:39:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:39:46.838 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:39:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:39:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:39:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:39:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:39:46.841 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:39:46.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:46.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:39:46.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:46.935 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:47.003 INFO:teuthology.orchestra.run.smithi017.stdout:client4665 2023-08-09T12:39:47.004 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:39:47.004 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:39:47.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:47.067 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:47.134 INFO:teuthology.orchestra.run.smithi017.stdout:client4665 2023-08-09T12:39:47.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:47.136 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:47.210 INFO:teuthology.orchestra.run.smithi017.stdout:client4665 2023-08-09T12:39:47.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:47.211 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client4665/status') 2023-08-09T12:39:47.320 INFO:teuthology.orchestra.run.smithi017.stdout:instance: client.4665 (3)192.168.0.1:0/4163024859 2023-08-09T12:39:47.321 INFO:teuthology.orchestra.run.smithi017.stdout:blocklisted: false 2023-08-09T12:39:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records in 2023-08-09T12:39:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records out 2023-08-09T12:39:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:69 bytes copied, 7.1811e-05 s, 961 kB/s 2023-08-09T12:39:47.325 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-08-09T12:39:47.326 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-09T12:39:47.326 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-09T12:39:47.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:39:47.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.559+0000 7ff56ec21640 1 Processor -- start 2023-08-09T12:39:47.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.559+0000 7ff56ec21640 1 -- start start 2023-08-09T12:39:47.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56ec21640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff568070f00 0x7ff56815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:47.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56ec21640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff568071340 con 0x7ff5681587e0 2023-08-09T12:39:47.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56ec21640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680715c0 con 0x7ff56815bce0 2023-08-09T12:39:47.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56ec21640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680718a0 con 0x7ff568070f00 2023-08-09T12:39:47.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56dc1f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff5681587e0 0x7ff5680b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38036/0 (socket says 172.21.15.17:38036) 2023-08-09T12:39:47.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56dc1f640 1 -- 172.21.15.17:0/911086502 learned_addr learned my addr 172.21.15.17:0/911086502 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:47.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720520448 0 0) 0x7ff568071340 con 0x7ff5681587e0 2023-08-09T12:39:47.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff554003520 con 0x7ff5681587e0 2023-08-09T12:39:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.561+0000 7ff56d41e640 1 --2- 172.21.15.17:0/911086502 >> v2:172.21.15.142:3300/0 conn(0x7ff568070f00 0x7ff56815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720934646 0 0) 0x7ff554003520 con 0x7ff5681587e0 2023-08-09T12:39:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 >> v2:172.21.15.142:3300/0 conn(0x7ff568070f00 msgr2=0x7ff56815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 --2- 172.21.15.17:0/911086502 >> v2:172.21.15.142:3300/0 conn(0x7ff568070f00 0x7ff56815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 >> v1:172.21.15.142:6789/0 conn(0x7ff56815bce0 legacy=0x7ff5680cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff568071b80 con 0x7ff5681587e0 2023-08-09T12:39:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff564001670 con 0x7ff5681587e0 2023-08-09T12:39:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 >> v1:172.21.15.17:6789/0 conn(0x7ff5681587e0 legacy=0x7ff5680b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:47.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff554003970 0x7ff554003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:47.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5540047c0 0x7ff554004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:47.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff554005180 0x7ff55400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:47.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680718a0 con 0x7ff554003970 2023-08-09T12:39:47.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55400c020 con 0x7ff5540047c0 2023-08-09T12:39:47.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55400c1e0 con 0x7ff554005180 2023-08-09T12:39:47.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.562+0000 7ff56dc1f640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff554003970 0x7ff554003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:47.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56dc1f640 1 -- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff554005180 msgr2=0x7ff55400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:47.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56e420640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff554005180 0x7ff55400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:47.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56d41e640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5540047c0 0x7ff554004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:47.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56dc1f640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff554005180 0x7ff55400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56dc1f640 1 -- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5540047c0 msgr2=0x7ff554004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:47.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56dc1f640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5540047c0 0x7ff554004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56dc1f640 1 -- 172.21.15.17:0/911086502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554003520 con 0x7ff554003970 2023-08-09T12:39:47.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56e420640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff554005180 0x7ff55400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:47.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.563+0000 7ff56e420640 1 -- 172.21.15.17:0/911086502 reap_dead start 2023-08-09T12:39:47.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.564+0000 7ff56dc1f640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff554003970 0x7ff554003d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c240 tx=0x7ff5540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8600c5b0a164cb84 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:47.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.564+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564005ad0 con 0x7ff554003970 2023-08-09T12:39:47.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.564+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564005c30 con 0x7ff554003970 2023-08-09T12:39:47.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.564+0000 7ff56cc1d640 1 -- 172.21.15.17:0/911086502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56402caf0 con 0x7ff554003970 2023-08-09T12:39:47.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.565+0000 7ff56ec21640 1 -- 172.21.15.17:0/911086502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff554003970 msgr2=0x7ff554003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:47.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.565+0000 7ff56ec21640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff554003970 0x7ff554003d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c240 tx=0x7ff5540057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.565+0000 7ff56ec21640 1 -- 172.21.15.17:0/911086502 shutdown_connections 2023-08-09T12:39:47.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.565+0000 7ff56ec21640 1 --2- 172.21.15.17:0/911086502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff554003970 0x7ff554003d90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.565+0000 7ff56ec21640 1 -- 172.21.15.17:0/911086502 >> 172.21.15.17:0/911086502 conn(0x7ff5680b1d50 msgr2=0x7ff56806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:47.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.565+0000 7ff56ec21640 1 -- 172.21.15.17:0/911086502 shutdown_connections 2023-08-09T12:39:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.565+0000 7ff56ec21640 1 -- 172.21.15.17:0/911086502 wait complete. 2023-08-09T12:39:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.567+0000 7ff56ec21640 1 Processor -- start 2023-08-09T12:39:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.567+0000 7ff56ec21640 1 -- start start 2023-08-09T12:39:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.568+0000 7ff56ec21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554003970 0x7ff5681f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.568+0000 7ff56ec21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5680c9750 0x7ff568159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.568+0000 7ff56ec21640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5680c9bd0 0x7ff56815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.568+0000 7ff56ec21640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56815c290 con 0x7ff5680c9750 2023-08-09T12:39:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.568+0000 7ff56ec21640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680caa40 con 0x7ff554003970 2023-08-09T12:39:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.568+0000 7ff56ec21640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680ca1a0 con 0x7ff5680c9bd0 2023-08-09T12:39:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.568+0000 7ff56d41e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5680c9750 0x7ff568159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56d41e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5680c9750 0x7ff568159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50310/0 (socket says 172.21.15.17:50310) 2023-08-09T12:39:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56d41e640 1 -- 172.21.15.17:0/2963624381 learned_addr learned my addr 172.21.15.17:0/2963624381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56e420640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5680c9bd0 0x7ff56815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56dc1f640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554003970 0x7ff5681f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:47.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56d41e640 1 -- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5680c9bd0 msgr2=0x7ff56815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:47.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56d41e640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5680c9bd0 0x7ff56815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56d41e640 1 -- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554003970 msgr2=0x7ff5681f1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:47.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56d41e640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554003970 0x7ff5681f1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56d41e640 1 -- 172.21.15.17:0/2963624381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680ca480 con 0x7ff5680c9750 2023-08-09T12:39:47.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.569+0000 7ff56d41e640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5680c9750 0x7ff568159c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff5580108e0 tx=0x7ff558010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:47.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.570+0000 7ff55e7fc640 1 -- 172.21.15.17:0/2963624381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55800eb60 con 0x7ff5680c9750 2023-08-09T12:39:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.570+0000 7ff55e7fc640 1 -- 172.21.15.17:0/2963624381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55800ecc0 con 0x7ff5680c9750 2023-08-09T12:39:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.570+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5680ca760 con 0x7ff5680c9750 2023-08-09T12:39:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.570+0000 7ff55e7fc640 1 -- 172.21.15.17:0/2963624381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55801c400 con 0x7ff5680c9750 2023-08-09T12:39:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.570+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5680afe60 con 0x7ff5680c9750 2023-08-09T12:39:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.571+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56804e390 con 0x7ff5680c9750 2023-08-09T12:39:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.572+0000 7ff55e7fc640 1 -- 172.21.15.17:0/2963624381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff55801c560 con 0x7ff5680c9750 2023-08-09T12:39:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.573+0000 7ff55e7fc640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff54c06a080 0x7ff54c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.573+0000 7ff55e7fc640 1 -- 172.21.15.17:0/2963624381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff558088af0 con 0x7ff5680c9750 2023-08-09T12:39:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.574+0000 7ff56dc1f640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff54c06a080 0x7ff54c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.575+0000 7ff56dc1f640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff54c06a080 0x7ff54c06c540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff564034000 tx=0x7ff564009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.578+0000 7ff55e7fc640 1 -- 172.21.15.17:0/2963624381 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff5580541d0 con 0x7ff5680c9750 2023-08-09T12:39:47.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.808+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff56806b8d0 con 0x7ff5680c9750 2023-08-09T12:39:47.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.809+0000 7ff55e7fc640 1 -- 172.21.15.17:0/2963624381 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff5580577f0 con 0x7ff5680c9750 2023-08-09T12:39:47.812 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:39:47.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.811+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff54c06a080 msgr2=0x7ff54c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:47.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.811+0000 7ff56ec21640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff54c06a080 0x7ff54c06c540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff564034000 tx=0x7ff564009030 comp rx=0 tx=0).stop 2023-08-09T12:39:47.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.811+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5680c9750 msgr2=0x7ff568159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:47.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.811+0000 7ff56ec21640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5680c9750 0x7ff568159c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff5580108e0 tx=0x7ff558010da0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.812+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 shutdown_connections 2023-08-09T12:39:47.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.812+0000 7ff56ec21640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff54c06a080 0x7ff54c06c540 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.812+0000 7ff56ec21640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5680c9bd0 0x7ff56815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.812+0000 7ff56ec21640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5680c9750 0x7ff568159c10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.812+0000 7ff56ec21640 1 --2- 172.21.15.17:0/2963624381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554003970 0x7ff5681f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:47.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.812+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 >> 172.21.15.17:0/2963624381 conn(0x7ff5680b1d50 msgr2=0x7ff56806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:47.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.812+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 shutdown_connections 2023-08-09T12:39:47.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:47.812+0000 7ff56ec21640 1 -- 172.21.15.17:0/2963624381 wait complete. 2023-08-09T12:39:47.834 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-09T12:39:47.835 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:39:47.835 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:39:47.835 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-09T12:39:47.835 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-09T12:39:47.835 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-09T12:39:47.836 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-09T12:39:47.836 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:39:47.836 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-09T12:39:47.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:47.837 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:39:47.891 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:39:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:39:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:39:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:39:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:47.892 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:39:47.892 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:39:47.893 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:39:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:39:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:39:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42192sec preferred_lft 42192sec 2023-08-09T12:39:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:39:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:47.894 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:39:47.894 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:39:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:39:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:39:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:47.895 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:39:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:39:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:39:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:47.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:47.898 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:39:47.998 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:39:48.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:48.003 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:39:48.061 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:39:48.062 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:39:48.062 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:39:48.062 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:39:48.062 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:39:48.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:48.063 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:48.063 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:48.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:39:48.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:39:48.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:39:48.064 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:48.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:48.262 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:39:48.317 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:39:48.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:48.319 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2023-08-09T12:39:48.375 INFO:teuthology.orchestra.run.smithi017.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-09T12:39:48.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:48.378 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:48.378 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:48.379 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:39:48.379 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-09T12:39:48.380 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:48.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:48.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-09T12:39:48.650 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:39:48.650 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:39:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:39:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:39:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:48.651 INFO:teuthology.orchestra.run.smithi017.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:39:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:b7:76:2c:30:15 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-09T12:39:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-09T12:39:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4b7:76ff:fe2c:3015/64 scope link 2023-08-09T12:39:48.652 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:48.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:48.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-09T12:39:48.762 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:39:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:39:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:39:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:39:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:48.763 INFO:teuthology.orchestra.run.smithi017.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:39:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:b7:76:2c:30:15 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-09T12:39:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-09T12:39:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4b7:76ff:fe2c:3015/64 scope link 2023-08-09T12:39:48.764 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:48.768 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-09T12:39:48.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:48.769 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:48.769 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:48.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-09T12:39:48.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-09T12:39:48.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-09T12:39:48.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-09T12:39:48.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-09T12:39:48.771 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:49.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:49.075 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:39:49.075 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:39:49.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.1 up 2023-08-09T12:39:49.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.1 master ceph-brx 2023-08-09T12:39:49.076 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:39:49.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:39:49.259 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-09T12:39:49.315 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-09T12:39:49.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:39:49.316 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-09T12:39:49.372 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:39:49.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:49.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-08-09T12:39:49.528 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-08-09T12:39:49.529 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-08-09T12:39:49.529 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:39:49.552 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-08-09T12:39:49.552 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-08-09T12:39:49.552 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:39:49.552 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:39:49.552 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:39:49.577 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-08-09T12:39:49.578 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-08-09T12:39:49.578 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:39:49.578 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:39:49.578 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:39:49.579 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:39:49.579 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:39:49.579 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:39:49.579 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-08-09T12:39:49.580 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:39:49.580 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:39:49.580 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:39:49.580 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:39:49.585 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:39:49.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:49.585 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-09T12:39:49.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:49.691 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:49.753 INFO:teuthology.orchestra.run.smithi017.stdout:client4483 2023-08-09T12:39:49.753 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:39:49.753 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:39:49.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:49.809 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:49.870 INFO:teuthology.orchestra.run.smithi017.stdout:client4483 2023-08-09T12:39:49.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:49.871 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:49.933 INFO:teuthology.orchestra.run.smithi017.stdout:client4483 2023-08-09T12:39:49.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:49.934 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client4483/status') 2023-08-09T12:39:50.035 INFO:teuthology.orchestra.run.smithi017.stdout:instance: client.4483 (3)172.21.15.17:0/3957886786 2023-08-09T12:39:50.035 INFO:teuthology.orchestra.run.smithi017.stdout:blocklisted: false 2023-08-09T12:39:50.036 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records in 2023-08-09T12:39:50.036 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records out 2023-08-09T12:39:50.036 INFO:teuthology.orchestra.run.smithi017.stderr:70 bytes copied, 7.7382e-05 s, 905 kB/s 2023-08-09T12:39:50.039 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-08-09T12:39:50.039 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-09T12:39:50.039 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:39:50.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:39:50.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.266+0000 7f2b2f59e640 1 Processor -- start 2023-08-09T12:39:50.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.267+0000 7f2b2f59e640 1 -- start start 2023-08-09T12:39:50.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.268+0000 7f2b2f59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2b30160030 0x7f2b30160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:50.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.268+0000 7f2b2f59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2b300cfb50 0x7f2b300d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:50.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.268+0000 7f2b2f59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b300b5a30 con 0x7f2b300b86e0 2023-08-09T12:39:50.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2f59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300d1110 con 0x7f2b300cfb50 2023-08-09T12:39:50.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2f59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300ceac0 con 0x7f2b30160030 2023-08-09T12:39:50.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2dd9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2b300b86e0 0x7f2b300cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37598/0 (socket says 172.21.15.17:37598) 2023-08-09T12:39:50.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2dd9b640 1 -- 172.21.15.17:0/835727143 learned_addr learned my addr 172.21.15.17:0/835727143 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2ed9d640 1 --2- 172.21.15.17:0/835727143 >> v2:172.21.15.17:3300/0 conn(0x7f2b300cfb50 0x7f2b300d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2e59c640 1 --2- 172.21.15.17:0/835727143 >> v2:172.21.15.142:3300/0 conn(0x7f2b30160030 0x7f2b30160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2ed9d640 1 -- 172.21.15.17:0/835727143 >> v2:172.21.15.142:3300/0 conn(0x7f2b30160030 msgr2=0x7f2b30160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2ed9d640 1 --2- 172.21.15.17:0/835727143 >> v2:172.21.15.142:3300/0 conn(0x7f2b30160030 0x7f2b30160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2ed9d640 1 -- 172.21.15.17:0/835727143 >> v1:172.21.15.17:6789/0 conn(0x7f2b300b86e0 legacy=0x7f2b300cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.270+0000 7f2b2ed9d640 1 -- 172.21.15.17:0/835727143 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300d0d70 con 0x7f2b300cfb50 2023-08-09T12:39:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.269+0000 7f2b2d59a640 1 -- 172.21.15.17:0/835727143 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829517975 0 0) 0x7f2b300b5a30 con 0x7f2b300b86e0 2023-08-09T12:39:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.271+0000 7f2b2ed9d640 1 --2- 172.21.15.17:0/835727143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b300d1530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b30065f60 tx=0x7f2b2802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da692502f06915f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.271+0000 7f2b2d59a640 1 -- 172.21.15.17:0/835727143 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2802cc70 con 0x7f2b300cfb50 2023-08-09T12:39:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.271+0000 7f2b2d59a640 1 -- 172.21.15.17:0/835727143 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2802cdd0 con 0x7f2b300cfb50 2023-08-09T12:39:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.271+0000 7f2b2d59a640 1 -- 172.21.15.17:0/835727143 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b28034660 con 0x7f2b300cfb50 2023-08-09T12:39:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.272+0000 7f2b2f59e640 1 -- 172.21.15.17:0/835727143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 msgr2=0x7f2b300d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.272+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/835727143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b300d1530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b30065f60 tx=0x7f2b2802bec0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.272+0000 7f2b2f59e640 1 -- 172.21.15.17:0/835727143 shutdown_connections 2023-08-09T12:39:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.272+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/835727143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b300d1530 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.272+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/835727143 >> v2:172.21.15.142:3300/0 conn(0x7f2b30160030 0x7f2b30160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.272+0000 7f2b2f59e640 1 -- 172.21.15.17:0/835727143 >> 172.21.15.17:0/835727143 conn(0x7f2b300697c0 msgr2=0x7f2b30069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:50.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.272+0000 7f2b2f59e640 1 -- 172.21.15.17:0/835727143 shutdown_connections 2023-08-09T12:39:50.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.272+0000 7f2b2f59e640 1 -- 172.21.15.17:0/835727143 wait complete. 2023-08-09T12:39:50.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.274+0000 7f2b2f59e640 1 Processor -- start 2023-08-09T12:39:50.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.274+0000 7f2b2f59e640 1 -- start start 2023-08-09T12:39:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.275+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b300b86e0 0x7f2b30159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.275+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b30148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.275+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b30160030 0x7f2b301f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.275+0000 7f2b2f59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b30157430 con 0x7f2b300cfb50 2023-08-09T12:39:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.275+0000 7f2b2f59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b301493b0 con 0x7f2b300b86e0 2023-08-09T12:39:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.275+0000 7f2b2f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300c9b40 con 0x7f2b30160030 2023-08-09T12:39:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b30148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b30148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50286/0 (socket says 172.21.15.17:50286) 2023-08-09T12:39:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 -- 172.21.15.17:0/1808162042 learned_addr learned my addr 172.21.15.17:0/1808162042 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2e59c640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b300b86e0 0x7f2b30159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2ed9d640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b30160030 0x7f2b301f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 -- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b30160030 msgr2=0x7f2b301f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b30160030 0x7f2b301f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 -- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b300b86e0 msgr2=0x7f2b30159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b300b86e0 0x7f2b30159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 -- 172.21.15.17:0/1808162042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28009a70 con 0x7f2b300cfb50 2023-08-09T12:39:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2ed9d640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b30160030 0x7f2b301f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.276+0000 7f2b2dd9b640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b30148e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c4a0 tx=0x7f2b2400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.277+0000 7f2b1effd640 1 -- 172.21.15.17:0/1808162042 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24005ce0 con 0x7f2b300cfb50 2023-08-09T12:39:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.277+0000 7f2b1effd640 1 -- 172.21.15.17:0/1808162042 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24005e40 con 0x7f2b300cfb50 2023-08-09T12:39:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.277+0000 7f2b1effd640 1 -- 172.21.15.17:0/1808162042 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240072b0 con 0x7f2b300cfb50 2023-08-09T12:39:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.277+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b301f2e00 con 0x7f2b300cfb50 2023-08-09T12:39:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.277+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b301f33c0 con 0x7f2b300cfb50 2023-08-09T12:39:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.278+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b300caac0 con 0x7f2b300cfb50 2023-08-09T12:39:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.279+0000 7f2b1effd640 1 -- 172.21.15.17:0/1808162042 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2b24007410 con 0x7f2b300cfb50 2023-08-09T12:39:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.280+0000 7f2b1effd640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2b1006a050 0x7f2b1006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:50.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.280+0000 7f2b1effd640 1 -- 172.21.15.17:0/1808162042 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b24087c20 con 0x7f2b300cfb50 2023-08-09T12:39:50.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.281+0000 7f2b2e59c640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2b1006a050 0x7f2b1006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:50.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.282+0000 7f2b2e59c640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2b1006a050 0x7f2b1006c510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009a30 tx=0x7f2b20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.285+0000 7f2b1effd640 1 -- 172.21.15.17:0/1808162042 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2b24053270 con 0x7f2b300cfb50 2023-08-09T12:39:50.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.516+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2b3004e390 con 0x7f2b300cfb50 2023-08-09T12:39:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.517+0000 7f2b1effd640 1 -- 172.21.15.17:0/1808162042 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2b24017070 con 0x7f2b300cfb50 2023-08-09T12:39:50.521 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:39:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2b1006a050 msgr2=0x7f2b1006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2b1006a050 0x7f2b1006c510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009a30 tx=0x7f2b20008040 comp rx=0 tx=0).stop 2023-08-09T12:39:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 msgr2=0x7f2b30148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b30148e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c4a0 tx=0x7f2b2400c960 comp rx=0 tx=0).stop 2023-08-09T12:39:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 shutdown_connections 2023-08-09T12:39:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2b1006a050 0x7f2b1006c510 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b30160030 0x7f2b301f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b300cfb50 0x7f2b30148e70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 --2- 172.21.15.17:0/1808162042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b300b86e0 0x7f2b30159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.519+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 >> 172.21.15.17:0/1808162042 conn(0x7f2b300697c0 msgr2=0x7f2b3015d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.520+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 shutdown_connections 2023-08-09T12:39:50.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:50.520+0000 7f2b2f59e640 1 -- 172.21.15.17:0/1808162042 wait complete. 2023-08-09T12:39:50.542 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-09T12:39:50.542 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:39:50.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:39:50.543 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:39:50.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:39:50.543 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-09T12:39:50.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-09T12:39:50.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:39:50.544 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:39:50.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:50.544 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:39:50.603 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:39:50.603 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:39:50.603 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:39:50.604 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:50.604 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:39:50.604 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:50.604 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:50.604 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:50.605 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:39:50.605 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:50.605 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:50.606 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:39:50.606 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:50.606 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:50.606 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:39:50.606 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:50.606 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:39:50.607 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42178sec preferred_lft 42178sec 2023-08-09T12:39:50.607 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:39:50.607 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:50.607 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-09T12:39:50.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:50.608 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:50.609 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:50.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2023-08-09T12:39:50.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2023-08-09T12:39:50.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2023-08-09T12:39:50.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-09T12:39:50.610 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:51.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:51.119 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:39:51.201 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:39:51.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:51.204 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:39:51.262 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:39:51.262 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:39:51.263 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:39:51.263 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:39:51.263 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:39:51.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:51.264 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:51.264 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:51.264 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:39:51.264 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:39:51.265 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:39:51.265 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:52.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:52.120 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:39:52.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:52.181 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-08-09T12:39:52.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:52.233 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:52.233 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:52.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:39:52.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-09T12:39:52.234 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:52.371 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-09T12:39:52.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:52.372 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:52.372 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:52.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-09T12:39:52.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-09T12:39:52.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-09T12:39:52.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-09T12:39:52.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-09T12:39:52.373 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:52.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:52.677 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:52.677 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:52.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:39:52.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2023-08-09T12:39:52.678 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:52.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:39:52.844 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:39:52.892 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:39:52.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:39:52.893 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:39:52.937 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:39:52.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:52.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:39:53.119 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:39:53.120 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:39:53.120 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:39:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:39:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:39:53.643 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:39:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:39:53.644 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:39:53.677 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:39:53.677 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:39:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:39:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:39:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:39:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:39:53.678 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:39:53.679 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:39:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:39:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:39:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:39:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:39:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:39:53.684 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:39:53.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:53.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:39:53.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:53.780 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:53.842 INFO:teuthology.orchestra.run.smithi142.stdout:client4492 2023-08-09T12:39:53.842 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:39:53.843 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:39:53.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:53.894 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:53.998 INFO:teuthology.orchestra.run.smithi142.stdout:client4492 2023-08-09T12:39:53.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:53.999 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:54.061 INFO:teuthology.orchestra.run.smithi142.stdout:client4492 2023-08-09T12:39:54.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:54.062 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client4492/status') 2023-08-09T12:39:54.159 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4492 (3)192.168.0.1:0/58738978 2023-08-09T12:39:54.159 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2023-08-09T12:39:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2023-08-09T12:39:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2023-08-09T12:39:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:67 bytes copied, 7.1582e-05 s, 936 kB/s 2023-08-09T12:39:54.163 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-08-09T12:39:54.164 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-09T12:39:54.165 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-09T12:39:54.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:39:54.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.402+0000 7f4f8e701640 1 Processor -- start 2023-08-09T12:39:54.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.402+0000 7f4f8e701640 1 -- start start 2023-08-09T12:39:54.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.403+0000 7f4f8e701640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f88070a90 0x7f4f880b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:54.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.403+0000 7f4f8e701640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4f880ad810 0x7f4f880c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:54.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.403+0000 7f4f8e701640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f880b4630 con 0x7f4f88159d80 2023-08-09T12:39:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.403+0000 7f4f8e701640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8815a160 con 0x7f4f880ad810 2023-08-09T12:39:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.403+0000 7f4f8e701640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f880b3ab0 con 0x7f4f88070a90 2023-08-09T12:39:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.404+0000 7f4f8cc9e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4f880ad810 0x7f4f880c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.404+0000 7f4f8cc9e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4f880ad810 0x7f4f880c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50300/0 (socket says 172.21.15.17:50300) 2023-08-09T12:39:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.404+0000 7f4f8cc9e640 1 -- 172.21.15.17:0/2108436880 learned_addr learned my addr 172.21.15.17:0/2108436880 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.404+0000 7f4f8cc9e640 1 -- 172.21.15.17:0/2108436880 >> v2:172.21.15.142:3300/0 conn(0x7f4f88070a90 msgr2=0x7f4f880b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.404+0000 7f4f877fe640 1 --2- 172.21.15.17:0/2108436880 >> v2:172.21.15.142:3300/0 conn(0x7f4f88070a90 0x7f4f880b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:54.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.404+0000 7f4f8cc9e640 1 --2- 172.21.15.17:0/2108436880 >> v2:172.21.15.142:3300/0 conn(0x7f4f88070a90 0x7f4f880b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.404+0000 7f4f8cc9e640 1 -- 172.21.15.17:0/2108436880 >> v1:172.21.15.142:6789/0 conn(0x7f4f88159d80 legacy=0x7f4f88070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:54.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.404+0000 7f4f8cc9e640 1 -- 172.21.15.17:0/2108436880 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880b3d90 con 0x7f4f880ad810 2023-08-09T12:39:54.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.405+0000 7f4f8cc9e640 1 --2- 172.21.15.17:0/2108436880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f880ad810 0x7f4f880c8fd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4f880b1270 tx=0x7f4f8002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a080ed975edba479 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:54.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f86ffd640 1 -- 172.21.15.17:0/2108436880 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8002ca80 con 0x7f4f880ad810 2023-08-09T12:39:54.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f86ffd640 1 -- 172.21.15.17:0/2108436880 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8002cbe0 con 0x7f4f880ad810 2023-08-09T12:39:54.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f86ffd640 1 -- 172.21.15.17:0/2108436880 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800343f0 con 0x7f4f880ad810 2023-08-09T12:39:54.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f8e701640 1 -- 172.21.15.17:0/2108436880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f880ad810 msgr2=0x7f4f880c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:54.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f8e701640 1 --2- 172.21.15.17:0/2108436880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f880ad810 0x7f4f880c8fd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4f880b1270 tx=0x7f4f8002bee0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f8e701640 1 -- 172.21.15.17:0/2108436880 shutdown_connections 2023-08-09T12:39:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f8e701640 1 --2- 172.21.15.17:0/2108436880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f880ad810 0x7f4f880c8fd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f8e701640 1 --2- 172.21.15.17:0/2108436880 >> v2:172.21.15.142:3300/0 conn(0x7f4f88070a90 0x7f4f880b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.406+0000 7f4f8e701640 1 -- 172.21.15.17:0/2108436880 >> 172.21.15.17:0/2108436880 conn(0x7f4f880cb1b0 msgr2=0x7f4f880cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:54.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.407+0000 7f4f8e701640 1 -- 172.21.15.17:0/2108436880 shutdown_connections 2023-08-09T12:39:54.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.407+0000 7f4f8e701640 1 -- 172.21.15.17:0/2108436880 wait complete. 2023-08-09T12:39:54.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.408+0000 7f4f8e701640 1 Processor -- start 2023-08-09T12:39:54.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.408+0000 7f4f8e701640 1 -- start start 2023-08-09T12:39:54.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.409+0000 7f4f8e701640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88070a90 0x7f4f8815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:54.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.409+0000 7f4f8e701640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f880ad810 0x7f4f880c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:54.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.409+0000 7f4f8e701640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f88159d80 0x7f4f880b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:54.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.409+0000 7f4f8e701640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881f0200 con 0x7f4f88070a90 2023-08-09T12:39:54.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.409+0000 7f4f8e701640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88158530 con 0x7f4f880ad810 2023-08-09T12:39:54.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.409+0000 7f4f8e701640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8815a860 con 0x7f4f88159d80 2023-08-09T12:39:54.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88070a90 0x7f4f8815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:54.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88070a90 0x7f4f8815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50316/0 (socket says 172.21.15.17:50316) 2023-08-09T12:39:54.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 -- 172.21.15.17:0/1136190586 learned_addr learned my addr 172.21.15.17:0/1136190586 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:54.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 -- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f88159d80 msgr2=0x7f4f880b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:54.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f88159d80 0x7f4f880b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 -- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f880ad810 msgr2=0x7f4f880c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:54.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f880ad810 0x7f4f880c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 -- 172.21.15.17:0/1136190586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009b30 con 0x7f4f88070a90 2023-08-09T12:39:54.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.410+0000 7f4f87fff640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88070a90 0x7f4f8815bd50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800b3e0 tx=0x7f4f7800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:54.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.411+0000 7f4f84ff9640 1 -- 172.21.15.17:0/1136190586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78011830 con 0x7f4f88070a90 2023-08-09T12:39:54.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.411+0000 7f4f84ff9640 1 -- 172.21.15.17:0/1136190586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f780119b0 con 0x7f4f88070a90 2023-08-09T12:39:54.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.411+0000 7f4f84ff9640 1 -- 172.21.15.17:0/1136190586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78011d60 con 0x7f4f88070a90 2023-08-09T12:39:54.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.411+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8815ab40 con 0x7f4f88070a90 2023-08-09T12:39:54.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.411+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8815b100 con 0x7f4f88070a90 2023-08-09T12:39:54.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.412+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f880664b0 con 0x7f4f88070a90 2023-08-09T12:39:54.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.413+0000 7f4f84ff9640 1 -- 172.21.15.17:0/1136190586 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f7801a400 con 0x7f4f88070a90 2023-08-09T12:39:54.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.414+0000 7f4f84ff9640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7406a050 0x7f4f7406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:54.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.414+0000 7f4f84ff9640 1 -- 172.21.15.17:0/1136190586 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f780886c0 con 0x7f4f88070a90 2023-08-09T12:39:54.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.415+0000 7f4f877fe640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7406a050 0x7f4f7406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:54.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.416+0000 7f4f877fe640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7406a050 0x7f4f7406c510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f8815d430 tx=0x7f4f7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:54.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.419+0000 7f4f84ff9640 1 -- 172.21.15.17:0/1136190586 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4f78053e20 con 0x7f4f88070a90 2023-08-09T12:39:54.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.654+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f88067a80 con 0x7f4f88070a90 2023-08-09T12:39:54.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.654+0000 7f4f84ff9640 1 -- 172.21.15.17:0/1136190586 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4f78057440 con 0x7f4f88070a90 2023-08-09T12:39:54.658 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:39:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7406a050 msgr2=0x7f4f7406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7406a050 0x7f4f7406c510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f8815d430 tx=0x7f4f7c008040 comp rx=0 tx=0).stop 2023-08-09T12:39:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88070a90 msgr2=0x7f4f8815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88070a90 0x7f4f8815bd50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800b3e0 tx=0x7f4f7800b8a0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 shutdown_connections 2023-08-09T12:39:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7406a050 0x7f4f7406c510 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f88159d80 0x7f4f880b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f880ad810 0x7f4f880c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 --2- 172.21.15.17:0/1136190586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88070a90 0x7f4f8815bd50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.658+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 >> 172.21.15.17:0/1136190586 conn(0x7f4f880cb1b0 msgr2=0x7f4f8806b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.659+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 shutdown_connections 2023-08-09T12:39:54.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:54.659+0000 7f4f8e701640 1 -- 172.21.15.17:0/1136190586 wait complete. 2023-08-09T12:39:54.681 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-09T12:39:54.682 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:39:54.682 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:39:54.682 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-09T12:39:54.683 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-09T12:39:54.683 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-09T12:39:54.684 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-09T12:39:54.684 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:39:54.684 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-09T12:39:54.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:54.685 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:39:54.747 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:39:54.748 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:39:54.748 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:39:54.748 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:54.749 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:39:54.749 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:54.749 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:54.749 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:54.750 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:39:54.750 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:54.750 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:54.750 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:39:54.751 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:39:54.751 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:54.751 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:39:54.751 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:54.752 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:39:54.752 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42173sec preferred_lft 42173sec 2023-08-09T12:39:54.752 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:39:54.753 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:54.753 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:39:54.753 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:39:54.753 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:39:54.754 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:54.754 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:39:54.754 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:54.754 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:39:54.755 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:39:54.755 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:39:54.755 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:54.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:54.756 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:39:54.843 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:39:54.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:54.847 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:39:54.901 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:39:54.901 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:39:54.901 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:39:54.901 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:39:54.901 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:39:54.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:54.902 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:54.902 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:54.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:39:54.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:39:54.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:39:54.903 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:55.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:55.085 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:39:55.137 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:39:55.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:55.139 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-08-09T12:39:55.191 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-09T12:39:55.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:55.192 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:55.193 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:55.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:39:55.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-09T12:39:55.193 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:55.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:55.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-09T12:39:55.419 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:39:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:39:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:39:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:39:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:55.421 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:39:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether c2:5e:83:2d:65:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-09T12:39:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-09T12:39:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::c05e:83ff:fe2d:6578/64 scope link 2023-08-09T12:39:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:55.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:55.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-09T12:39:55.514 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:39:55.514 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:39:55.515 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:39:55.515 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:55.515 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:39:55.516 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:55.516 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:39:55.516 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether c2:5e:83:2d:65:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-09T12:39:55.516 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-09T12:39:55.517 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:55.517 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::c05e:83ff:fe2d:6578/64 scope link 2023-08-09T12:39:55.517 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:39:55.521 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-09T12:39:55.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:55.521 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:55.522 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:55.522 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-09T12:39:55.522 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-09T12:39:55.522 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-09T12:39:55.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-09T12:39:55.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-09T12:39:55.523 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:55.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:55.801 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:39:55.801 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:39:55.801 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2023-08-09T12:39:55.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2023-08-09T12:39:55.802 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:39:55.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:39:55.973 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-09T12:39:56.021 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-09T12:39:56.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:39:56.022 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-09T12:39:56.118 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:39:56.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:56.119 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-08-09T12:39:56.261 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-08-09T12:39:56.261 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-08-09T12:39:56.261 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:39:56.281 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-08-09T12:39:56.282 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-08-09T12:39:56.282 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:39:56.282 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:39:56.282 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:39:56.306 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-08-09T12:39:56.306 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-08-09T12:39:56.307 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:39:56.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:39:56.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:39:56.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:39:56.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:39:56.307 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:39:56.308 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-08-09T12:39:56.309 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:39:56.309 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:39:56.309 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:39:56.309 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:39:56.313 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:39:56.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:56.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-09T12:39:56.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:56.410 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:56.464 INFO:teuthology.orchestra.run.smithi142.stdout:client4433 2023-08-09T12:39:56.465 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:39:56.465 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:39:56.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:56.512 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:56.618 INFO:teuthology.orchestra.run.smithi142.stdout:client4433 2023-08-09T12:39:56.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:56.619 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:39:56.672 INFO:teuthology.orchestra.run.smithi142.stdout:client4433 2023-08-09T12:39:56.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:39:56.673 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client4433/status') 2023-08-09T12:39:56.749 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4433 (3)192.168.0.2:0/4164871902 2023-08-09T12:39:56.750 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2023-08-09T12:39:56.750 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2023-08-09T12:39:56.750 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2023-08-09T12:39:56.750 INFO:teuthology.orchestra.run.smithi142.stderr:69 bytes copied, 6.1606e-05 s, 1.1 MB/s 2023-08-09T12:39:56.753 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-09T12:39:56.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:57.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.006+0000 7ff9d9832640 1 Processor -- start 2023-08-09T12:39:57.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.006+0000 7ff9d9832640 1 -- start start 2023-08-09T12:39:57.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.008+0000 7ff9d9832640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d41601f0 0x7ff9d40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.008+0000 7ff9d9832640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9d40b2ee0 0x7ff9d40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.008+0000 7ff9d9832640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d40c3250 con 0x7ff9d40cb440 2023-08-09T12:39:57.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.008+0000 7ff9d9832640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d40b4120 con 0x7ff9d40b2ee0 2023-08-09T12:39:57.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.008+0000 7ff9d9832640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40cb870 con 0x7ff9d41601f0 2023-08-09T12:39:57.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.009+0000 7ff9cbfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9d40b2ee0 0x7ff9d40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.009+0000 7ff9cbfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9d40b2ee0 0x7ff9d40caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:59656/0 (socket says 172.21.15.17:59656) 2023-08-09T12:39:57.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.009+0000 7ff9cbfff640 1 -- 172.21.15.17:0/1497602071 learned_addr learned my addr 172.21.15.17:0/1497602071 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:57.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.009+0000 7ff9d8830640 1 --2- 172.21.15.17:0/1497602071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d41601f0 0x7ff9d40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.009+0000 7ff9cbfff640 1 -- 172.21.15.17:0/1497602071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d41601f0 msgr2=0x7ff9d40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:57.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.009+0000 7ff9cbfff640 1 --2- 172.21.15.17:0/1497602071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d41601f0 0x7ff9d40b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.009+0000 7ff9cbfff640 1 -- 172.21.15.17:0/1497602071 >> v1:172.21.15.142:6789/0 conn(0x7ff9d40cb440 legacy=0x7ff9d40697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.009+0000 7ff9cbfff640 1 -- 172.21.15.17:0/1497602071 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d40b34a0 con 0x7ff9d40b2ee0 2023-08-09T12:39:57.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.011+0000 7ff9cbfff640 1 --2- 172.21.15.17:0/1497602071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 0x7ff9d40caf00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009870 tx=0x7ff9c402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52962372b38cfd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9cb7fe640 1 -- 172.21.15.17:0/1497602071 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4030840 con 0x7ff9d40b2ee0 2023-08-09T12:39:57.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9cb7fe640 1 -- 172.21.15.17:0/1497602071 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40309a0 con 0x7ff9d40b2ee0 2023-08-09T12:39:57.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9cb7fe640 1 -- 172.21.15.17:0/1497602071 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4030d30 con 0x7ff9d40b2ee0 2023-08-09T12:39:57.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9d9832640 1 -- 172.21.15.17:0/1497602071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 msgr2=0x7ff9d40caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1497602071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 0x7ff9d40caf00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009870 tx=0x7ff9c402b980 comp rx=0 tx=0).stop 2023-08-09T12:39:57.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9d9832640 1 -- 172.21.15.17:0/1497602071 shutdown_connections 2023-08-09T12:39:57.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1497602071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 0x7ff9d40caf00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1497602071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d41601f0 0x7ff9d40b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.012+0000 7ff9d9832640 1 -- 172.21.15.17:0/1497602071 >> 172.21.15.17:0/1497602071 conn(0x7ff9d40b1d50 msgr2=0x7ff9d406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:57.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.013+0000 7ff9d9832640 1 -- 172.21.15.17:0/1497602071 shutdown_connections 2023-08-09T12:39:57.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.013+0000 7ff9d9832640 1 -- 172.21.15.17:0/1497602071 wait complete. 2023-08-09T12:39:57.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.014+0000 7ff9d9832640 1 Processor -- start 2023-08-09T12:39:57.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.015+0000 7ff9d9832640 1 -- start start 2023-08-09T12:39:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9832640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 0x7ff9d415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9832640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d40cb440 0x7ff9d4071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9832640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9d41601f0 0x7ff9d4158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9832640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d406f610 con 0x7ff9d41601f0 2023-08-09T12:39:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9832640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40c61f0 con 0x7ff9d40b2ee0 2023-08-09T12:39:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9832640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d415fa30 con 0x7ff9d40cb440 2023-08-09T12:39:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9031640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9d41601f0 0x7ff9d4158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9031640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9d41601f0 0x7ff9d4158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50320/0 (socket says 172.21.15.17:50320) 2023-08-09T12:39:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d9031640 1 -- 172.21.15.17:0/1716761820 learned_addr learned my addr 172.21.15.17:0/1716761820 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9d8830640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 0x7ff9d415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.016+0000 7ff9cbfff640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d40cb440 0x7ff9d4071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9d9031640 1 -- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d40cb440 msgr2=0x7ff9d4071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9d9031640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d40cb440 0x7ff9d4071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9d9031640 1 -- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 msgr2=0x7ff9d415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9d9031640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 0x7ff9d415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9d9031640 1 -- 172.21.15.17:0/1716761820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c40094d0 con 0x7ff9d41601f0 2023-08-09T12:39:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9d9031640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9d41601f0 0x7ff9d4158600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c7a0 tx=0x7ff9cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9c97fa640 1 -- 172.21.15.17:0/1716761820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc003b70 con 0x7ff9d41601f0 2023-08-09T12:39:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9c97fa640 1 -- 172.21.15.17:0/1716761820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc003cf0 con 0x7ff9d41601f0 2023-08-09T12:39:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9c97fa640 1 -- 172.21.15.17:0/1716761820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc003ea0 con 0x7ff9d41601f0 2023-08-09T12:39:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.017+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d406fe70 con 0x7ff9d41601f0 2023-08-09T12:39:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.018+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d406fb90 con 0x7ff9d41601f0 2023-08-09T12:39:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.019+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d40c6050 con 0x7ff9d41601f0 2023-08-09T12:39:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.020+0000 7ff9c97fa640 1 -- 172.21.15.17:0/1716761820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff9cc00aa90 con 0x7ff9d41601f0 2023-08-09T12:39:57.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.021+0000 7ff9c97fa640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9c006a050 0x7ff9c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.021+0000 7ff9c97fa640 1 -- 172.21.15.17:0/1716761820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9cc0883c0 con 0x7ff9d41601f0 2023-08-09T12:39:57.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.021+0000 7ff9d8830640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9c006a050 0x7ff9c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.022+0000 7ff9d8830640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9c006a050 0x7ff9c006c510 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009b40 tx=0x7ff9d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.025+0000 7ff9c97fa640 1 -- 172.21.15.17:0/1716761820 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff9d40c6050 con 0x7ff9d41601f0 2023-08-09T12:39:57.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.224+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9d40c6050 con 0x7ff9d41601f0 2023-08-09T12:39:57.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.226+0000 7ff9c97fa640 1 -- 172.21.15.17:0/1716761820 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7ff9d40c6050 con 0x7ff9d41601f0 2023-08-09T12:39:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:57.230 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:57.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9c006a050 msgr2=0x7ff9c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9c006a050 0x7ff9c006c510 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009b40 tx=0x7ff9d0009190 comp rx=0 tx=0).stop 2023-08-09T12:39:57.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9d41601f0 msgr2=0x7ff9d4158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9d41601f0 0x7ff9d4158600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c7a0 tx=0x7ff9cc00cc60 comp rx=0 tx=0).stop 2023-08-09T12:39:57.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 shutdown_connections 2023-08-09T12:39:57.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9c006a050 0x7ff9c006c510 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9d41601f0 0x7ff9d4158600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9d40cb440 0x7ff9d4071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 --2- 172.21.15.17:0/1716761820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9d40b2ee0 0x7ff9d415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 >> 172.21.15.17:0/1716761820 conn(0x7ff9d40b1d50 msgr2=0x7ff9d41e81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:57.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 shutdown_connections 2023-08-09T12:39:57.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.229+0000 7ff9d9832640 1 -- 172.21.15.17:0/1716761820 wait complete. 2023-08-09T12:39:57.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:39:57.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:39:57.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.484+0000 7f34a6d9b640 1 Processor -- start 2023-08-09T12:39:57.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.484+0000 7f34a6d9b640 1 -- start start 2023-08-09T12:39:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.486+0000 7f34a6d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f34a00b3d60 0x7f34a00cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.486+0000 7f34a6d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a00cc6b0 0x7f34a00b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.486+0000 7f34a6d9b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a00b2b90 con 0x7f34a0159bd0 2023-08-09T12:39:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.486+0000 7f34a6d9b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a00cabb0 con 0x7f34a00b3d60 2023-08-09T12:39:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.486+0000 7f34a6d9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00b2580 con 0x7f34a00cc6b0 2023-08-09T12:39:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.486+0000 7f34a5d99640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f34a0159bd0 0x7f34a00c9e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37600/0 (socket says 172.21.15.17:37600) 2023-08-09T12:39:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.486+0000 7f34a5d99640 1 -- 172.21.15.17:0/3368771486 learned_addr learned my addr 172.21.15.17:0/3368771486 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.486+0000 7f34a5598640 1 --2- 172.21.15.17:0/3368771486 >> v2:172.21.15.17:3300/0 conn(0x7f34a00b3d60 0x7f34a00cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.487+0000 7f34a659a640 1 --2- 172.21.15.17:0/3368771486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a00cc6b0 0x7f34a00b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.487+0000 7f34a5598640 1 -- 172.21.15.17:0/3368771486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a00cc6b0 msgr2=0x7f34a00b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.487+0000 7f34a4d97640 1 -- 172.21.15.17:0/3368771486 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814787464 0 0) 0x7f34a00b2b90 con 0x7f34a0159bd0 2023-08-09T12:39:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.487+0000 7f34a5598640 1 --2- 172.21.15.17:0/3368771486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a00cc6b0 0x7f34a00b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.487+0000 7f34a5598640 1 -- 172.21.15.17:0/3368771486 >> v1:172.21.15.17:6789/0 conn(0x7f34a0159bd0 legacy=0x7f34a00c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.487+0000 7f34a5598640 1 -- 172.21.15.17:0/3368771486 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a00ca5f0 con 0x7f34a00b3d60 2023-08-09T12:39:57.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.488+0000 7f34a5598640 1 --2- 172.21.15.17:0/3368771486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a00cc170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f34900097a0 tx=0x7f349002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fef00022817bb0b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.488+0000 7f34a4d97640 1 -- 172.21.15.17:0/3368771486 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349002d040 con 0x7f34a00b3d60 2023-08-09T12:39:57.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.488+0000 7f34a4d97640 1 -- 172.21.15.17:0/3368771486 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490031810 con 0x7f34a00b3d60 2023-08-09T12:39:57.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.488+0000 7f34a4d97640 1 -- 172.21.15.17:0/3368771486 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490031ba0 con 0x7f34a00b3d60 2023-08-09T12:39:57.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.489+0000 7f34a6d9b640 1 -- 172.21.15.17:0/3368771486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 msgr2=0x7f34a00cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.489+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/3368771486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a00cc170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f34900097a0 tx=0x7f349002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.489+0000 7f34a6d9b640 1 -- 172.21.15.17:0/3368771486 shutdown_connections 2023-08-09T12:39:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.489+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/3368771486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a00cc6b0 0x7f34a00b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.489+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/3368771486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a00cc170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.489+0000 7f34a6d9b640 1 -- 172.21.15.17:0/3368771486 >> 172.21.15.17:0/3368771486 conn(0x7f34a00cb020 msgr2=0x7f34a00cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.489+0000 7f34a6d9b640 1 -- 172.21.15.17:0/3368771486 shutdown_connections 2023-08-09T12:39:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.489+0000 7f34a6d9b640 1 -- 172.21.15.17:0/3368771486 wait complete. 2023-08-09T12:39:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.491+0000 7f34a6d9b640 1 Processor -- start 2023-08-09T12:39:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.491+0000 7f34a6d9b640 1 -- start start 2023-08-09T12:39:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a6d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a01f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a6d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a00cc6b0 0x7f34a00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a6d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a0159bd0 0x7f34a00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a6d9b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a01f1e30 con 0x7f34a00b3d60 2023-08-09T12:39:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a6d9b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0149410 con 0x7f34a00cc6b0 2023-08-09T12:39:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a6d9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00aee10 con 0x7f34a0159bd0 2023-08-09T12:39:57.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a5d99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a01f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a5d99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a01f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50332/0 (socket says 172.21.15.17:50332) 2023-08-09T12:39:57.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.492+0000 7f34a5d99640 1 -- 172.21.15.17:0/1170018467 learned_addr learned my addr 172.21.15.17:0/1170018467 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:57.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34a5d99640 1 -- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a0159bd0 msgr2=0x7f34a00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34a5d99640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a0159bd0 0x7f34a00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34a5d99640 1 -- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a00cc6b0 msgr2=0x7f34a00ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34a5d99640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a00cc6b0 0x7f34a00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34a5d99640 1 -- 172.21.15.17:0/1170018467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009400 con 0x7f34a00b3d60 2023-08-09T12:39:57.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34a5d99640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a01f18f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c460 tx=0x7f349c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34967fc640 1 -- 172.21.15.17:0/1170018467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0074e0 con 0x7f34a00b3d60 2023-08-09T12:39:57.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34967fc640 1 -- 172.21.15.17:0/1170018467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c007660 con 0x7f34a00b3d60 2023-08-09T12:39:57.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34967fc640 1 -- 172.21.15.17:0/1170018467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c004a20 con 0x7f34a00b3d60 2023-08-09T12:39:57.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a00af090 con 0x7f34a00b3d60 2023-08-09T12:39:57.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.493+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a00af650 con 0x7f34a00b3d60 2023-08-09T12:39:57.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.495+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a01495c0 con 0x7f34a00b3d60 2023-08-09T12:39:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.496+0000 7f34967fc640 1 -- 172.21.15.17:0/1170018467 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f349c004b80 con 0x7f34a00b3d60 2023-08-09T12:39:57.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.497+0000 7f34967fc640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f348406a050 0x7f348406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.497+0000 7f34967fc640 1 -- 172.21.15.17:0/1170018467 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f349c0882e0 con 0x7f34a00b3d60 2023-08-09T12:39:57.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.497+0000 7f34a5598640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f348406a050 0x7f348406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.499+0000 7f34a5598640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f348406a050 0x7f348406c510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3490036000 tx=0x7f3490030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.501+0000 7f34967fc640 1 -- 172.21.15.17:0/1170018467 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f34a01495c0 con 0x7f34a00b3d60 2023-08-09T12:39:57.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.710+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34a01495c0 con 0x7f34a00b3d60 2023-08-09T12:39:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.711+0000 7f34967fc640 1 -- 172.21.15.17:0/1170018467 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34a01495c0 con 0x7f34a00b3d60 2023-08-09T12:39:57.714 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:39:57.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f348406a050 msgr2=0x7f348406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f348406a050 0x7f348406c510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3490036000 tx=0x7f3490030000 comp rx=0 tx=0).stop 2023-08-09T12:39:57.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 msgr2=0x7f34a01f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a01f18f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c460 tx=0x7f349c00c920 comp rx=0 tx=0).stop 2023-08-09T12:39:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 shutdown_connections 2023-08-09T12:39:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f348406a050 0x7f348406c510 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a0159bd0 0x7f34a00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a00cc6b0 0x7f34a00ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 --2- 172.21.15.17:0/1170018467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a00b3d60 0x7f34a01f18f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 >> 172.21.15.17:0/1170018467 conn(0x7f34a00cb020 msgr2=0x7f34a00b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 shutdown_connections 2023-08-09T12:39:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.714+0000 7f34a6d9b640 1 -- 172.21.15.17:0/1170018467 wait complete. 2023-08-09T12:39:57.736 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:39:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.959+0000 7f929fca9640 1 Processor -- start 2023-08-09T12:39:57.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.960+0000 7f929fca9640 1 -- start start 2023-08-09T12:39:57.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.961+0000 7f929fca9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92980d30e0 0x7f92980b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.961+0000 7f929fca9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980cdd10 con 0x7f929815ce90 2023-08-09T12:39:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.961+0000 7f929fca9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980cdff0 con 0x7f92981616e0 2023-08-09T12:39:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.961+0000 7f929fca9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980b6540 con 0x7f92980d30e0 2023-08-09T12:39:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.962+0000 7f929da45640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f929815ce90 0x7f92980cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42450/0 (socket says 172.21.15.17:42450) 2023-08-09T12:39:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.962+0000 7f929da45640 1 -- 172.21.15.17:0/4228726852 learned_addr learned my addr 172.21.15.17:0/4228726852 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.962+0000 7f929e246640 1 --2- 172.21.15.17:0/4228726852 >> v2:172.21.15.142:3300/0 conn(0x7f92980d30e0 0x7f92980b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.962+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208311049 0 0) 0x7f92980cdd10 con 0x7f929815ce90 2023-08-09T12:39:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.962+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9284003520 con 0x7f929815ce90 2023-08-09T12:39:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057469209 0 0) 0x7f9284003520 con 0x7f929815ce90 2023-08-09T12:39:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 >> v2:172.21.15.142:3300/0 conn(0x7f92980d30e0 msgr2=0x7f92980b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 --2- 172.21.15.17:0/4228726852 >> v2:172.21.15.142:3300/0 conn(0x7f92980d30e0 0x7f92980b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 >> v1:172.21.15.142:6789/0 conn(0x7f92981616e0 legacy=0x7f92980d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980ce2d0 con 0x7f929815ce90 2023-08-09T12:39:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f9294001670 con 0x7f929815ce90 2023-08-09T12:39:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 >> v1:172.21.15.17:6789/0 conn(0x7f929815ce90 legacy=0x7f92980cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284003970 0x7f9284003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92840047c0 0x7f9284004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9284005180 0x7f928400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b6540 con 0x7f9284005180 2023-08-09T12:39:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928400c020 con 0x7f9284003970 2023-08-09T12:39:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928400c1e0 con 0x7f92840047c0 2023-08-09T12:39:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929e246640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9284005180 0x7f928400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929e246640 1 -- 172.21.15.17:0/4228726852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92840047c0 msgr2=0x7f9284004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:57.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929e246640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92840047c0 0x7f9284004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929da45640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284003970 0x7f9284003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.963+0000 7f929e246640 1 -- 172.21.15.17:0/4228726852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284003970 msgr2=0x7f9284003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:57.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.964+0000 7f929e246640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284003970 0x7f9284003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.964+0000 7f929e246640 1 -- 172.21.15.17:0/4228726852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284003520 con 0x7f9284005180 2023-08-09T12:39:57.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.964+0000 7f929da45640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284003970 0x7f9284003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:57.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.965+0000 7f929e246640 1 -- 172.21.15.17:0/4228726852 reap_dead start 2023-08-09T12:39:57.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.965+0000 7f929e246640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9284005180 0x7f928400b980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9290009f90 tx=0x7f92840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c56ae56ec5d96 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.965+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929002cc20 con 0x7f9284005180 2023-08-09T12:39:57.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.965+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000f040 con 0x7f9284005180 2023-08-09T12:39:57.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.965+0000 7f929ca43640 1 -- 172.21.15.17:0/4228726852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290003990 con 0x7f9284005180 2023-08-09T12:39:57.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.966+0000 7f929fca9640 1 -- 172.21.15.17:0/4228726852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9284005180 msgr2=0x7f928400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.966+0000 7f929fca9640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9284005180 0x7f928400b980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9290009f90 tx=0x7f92840057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.966+0000 7f929fca9640 1 -- 172.21.15.17:0/4228726852 shutdown_connections 2023-08-09T12:39:57.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.966+0000 7f929fca9640 1 --2- 172.21.15.17:0/4228726852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9284005180 0x7f928400b980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.966+0000 7f929fca9640 1 -- 172.21.15.17:0/4228726852 >> 172.21.15.17:0/4228726852 conn(0x7f929806fde0 msgr2=0x7f92980701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:57.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.966+0000 7f929fca9640 1 -- 172.21.15.17:0/4228726852 shutdown_connections 2023-08-09T12:39:57.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.966+0000 7f929fca9640 1 -- 172.21.15.17:0/4228726852 wait complete. 2023-08-09T12:39:57.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.968+0000 7f929fca9640 1 Processor -- start 2023-08-09T12:39:57.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.968+0000 7f929fca9640 1 -- start start 2023-08-09T12:39:57.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929fca9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284005180 0x7f92980c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929fca9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929815ffc0 0x7f929815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929fca9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f929815e510 0x7f92980b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929fca9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92981f0390 con 0x7f929815e510 2023-08-09T12:39:57.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929fca9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929815ef20 con 0x7f9284005180 2023-08-09T12:39:57.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929fca9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929815f200 con 0x7f929815ffc0 2023-08-09T12:39:57.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929e246640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f929815e510 0x7f92980b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929e246640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f929815e510 0x7f92980b76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39222/0 (socket says 172.21.15.17:39222) 2023-08-09T12:39:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929e246640 1 -- 172.21.15.17:0/2388854940 learned_addr learned my addr 172.21.15.17:0/2388854940 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929da45640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284005180 0x7f92980c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.969+0000 7f929d244640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929815ffc0 0x7f929815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f929e246640 1 -- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929815ffc0 msgr2=0x7f929815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f929e246640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929815ffc0 0x7f929815dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f929e246640 1 -- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284005180 msgr2=0x7f92980c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:57.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f929e246640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284005180 0x7f92980c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:57.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f929e246640 1 -- 172.21.15.17:0/2388854940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929815f4e0 con 0x7f929815e510 2023-08-09T12:39:57.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f929e246640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f929815e510 0x7f92980b76d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f929002c690 tx=0x7f9290009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f928e7fc640 1 -- 172.21.15.17:0/2388854940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929002cea0 con 0x7f929815e510 2023-08-09T12:39:57.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f928e7fc640 1 -- 172.21.15.17:0/2388854940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290004230 con 0x7f929815e510 2023-08-09T12:39:57.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f928e7fc640 1 -- 172.21.15.17:0/2388854940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900045e0 con 0x7f929815e510 2023-08-09T12:39:57.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929815f7c0 con 0x7f929815e510 2023-08-09T12:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.970+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92981f2b60 con 0x7f929815e510 2023-08-09T12:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.971+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929815fce0 con 0x7f929815e510 2023-08-09T12:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.972+0000 7f928e7fc640 1 -- 172.21.15.17:0/2388854940 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9290004740 con 0x7f929815e510 2023-08-09T12:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.974+0000 7f928e7fc640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f927c06a050 0x7f927c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.974+0000 7f928e7fc640 1 -- 172.21.15.17:0/2388854940 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92900aaed0 con 0x7f929815e510 2023-08-09T12:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.975+0000 7f929da45640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f927c06a050 0x7f927c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:57.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.976+0000 7f929da45640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f927c06a050 0x7f927c06c510 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f929814d9d0 tx=0x7f9294009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:57.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:57.978+0000 7f928e7fc640 1 -- 172.21.15.17:0/2388854940 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f929815fce0 con 0x7f929815e510 2023-08-09T12:39:58.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.173+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f929815fce0 con 0x7f929815e510 2023-08-09T12:39:58.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.174+0000 7f928e7fc640 1 -- 172.21.15.17:0/2388854940 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f929815fce0 con 0x7f929815e510 2023-08-09T12:39:58.178 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:39:58.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.177+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f927c06a050 msgr2=0x7f927c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.177+0000 7f929fca9640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f927c06a050 0x7f927c06c510 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f929814d9d0 tx=0x7f9294009040 comp rx=0 tx=0).stop 2023-08-09T12:39:58.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.177+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f929815e510 msgr2=0x7f92980b76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.177+0000 7f929fca9640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f929815e510 0x7f92980b76d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f929002c690 tx=0x7f9290009750 comp rx=0 tx=0).stop 2023-08-09T12:39:58.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.178+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 shutdown_connections 2023-08-09T12:39:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.178+0000 7f929fca9640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f927c06a050 0x7f927c06c510 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.178+0000 7f929fca9640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f929815e510 0x7f92980b76d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.178+0000 7f929fca9640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929815ffc0 0x7f929815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.178+0000 7f929fca9640 1 --2- 172.21.15.17:0/2388854940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284005180 0x7f92980c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.178+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 >> 172.21.15.17:0/2388854940 conn(0x7f929806fde0 msgr2=0x7f929815ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.178+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 shutdown_connections 2023-08-09T12:39:58.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.178+0000 7f929fca9640 1 -- 172.21.15.17:0/2388854940 wait complete. 2023-08-09T12:39:58.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:39:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.425+0000 7fc006599640 1 Processor -- start 2023-08-09T12:39:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.426+0000 7fc006599640 1 -- start start 2023-08-09T12:39:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fc006599640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc000070bf0 0x7fc000156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fc006599640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0001596e0 0x7fc000159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fc006599640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00015a700 con 0x7fc00015d680 2023-08-09T12:39:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fc006599640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00015d260 con 0x7fc0001596e0 2023-08-09T12:39:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fc006599640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0000cf0f0 con 0x7fc000070bf0 2023-08-09T12:39:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fc004b36640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0001596e0 0x7fc000159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fc004b36640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0001596e0 0x7fc000159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39232/0 (socket says 172.21.15.17:39232) 2023-08-09T12:39:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fbfff7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc00015d680 0x7fc0000ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42454/0 (socket says 172.21.15.17:42454) 2023-08-09T12:39:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fc004b36640 1 -- 172.21.15.17:0/1680457288 learned_addr learned my addr 172.21.15.17:0/1680457288 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.428+0000 7fbffffff640 1 --2- 172.21.15.17:0/1680457288 >> v2:172.21.15.142:3300/0 conn(0x7fc000070bf0 0x7fc000156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.429+0000 7fbffeffd640 1 -- 172.21.15.17:0/1680457288 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898630060 0 0) 0x7fc00015a700 con 0x7fc00015d680 2023-08-09T12:39:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.429+0000 7fc004b36640 1 -- 172.21.15.17:0/1680457288 >> v2:172.21.15.142:3300/0 conn(0x7fc000070bf0 msgr2=0x7fc000156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.429+0000 7fc004b36640 1 --2- 172.21.15.17:0/1680457288 >> v2:172.21.15.142:3300/0 conn(0x7fc000070bf0 0x7fc000156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.429+0000 7fc004b36640 1 -- 172.21.15.17:0/1680457288 >> v1:172.21.15.17:6789/0 conn(0x7fc00015d680 legacy=0x7fc0000ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.429+0000 7fc004b36640 1 -- 172.21.15.17:0/1680457288 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0001571d0 con 0x7fc0001596e0 2023-08-09T12:39:58.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.430+0000 7fc004b36640 1 --2- 172.21.15.17:0/1680457288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0001596e0 0x7fc000159b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0000cf8a0 tx=0x7fbff802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7110ebc05a74a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:58.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.430+0000 7fbffeffd640 1 -- 172.21.15.17:0/1680457288 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff802c9f0 con 0x7fc0001596e0 2023-08-09T12:39:58.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.430+0000 7fbffeffd640 1 -- 172.21.15.17:0/1680457288 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff802cb50 con 0x7fc0001596e0 2023-08-09T12:39:58.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.430+0000 7fbffeffd640 1 -- 172.21.15.17:0/1680457288 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80343f0 con 0x7fc0001596e0 2023-08-09T12:39:58.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.431+0000 7fc006599640 1 -- 172.21.15.17:0/1680457288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0001596e0 msgr2=0x7fc000159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.431+0000 7fc006599640 1 --2- 172.21.15.17:0/1680457288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0001596e0 0x7fc000159b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0000cf8a0 tx=0x7fbff802be50 comp rx=0 tx=0).stop 2023-08-09T12:39:58.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.431+0000 7fc006599640 1 -- 172.21.15.17:0/1680457288 shutdown_connections 2023-08-09T12:39:58.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.431+0000 7fc006599640 1 --2- 172.21.15.17:0/1680457288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0001596e0 0x7fc000159b30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.431+0000 7fc006599640 1 --2- 172.21.15.17:0/1680457288 >> v2:172.21.15.142:3300/0 conn(0x7fc000070bf0 0x7fc000156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.431+0000 7fc006599640 1 -- 172.21.15.17:0/1680457288 >> 172.21.15.17:0/1680457288 conn(0x7fc000069be0 msgr2=0x7fc000069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:58.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.431+0000 7fc006599640 1 -- 172.21.15.17:0/1680457288 shutdown_connections 2023-08-09T12:39:58.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.431+0000 7fc006599640 1 -- 172.21.15.17:0/1680457288 wait complete. 2023-08-09T12:39:58.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.433+0000 7fc006599640 1 Processor -- start 2023-08-09T12:39:58.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.433+0000 7fc006599640 1 -- start start 2023-08-09T12:39:58.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc006599640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc000070bf0 0x7fc0000c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc006599640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0001596e0 0x7fc0000c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc006599640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc00015d680 0x7fc0000c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc006599640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000b1840 con 0x7fc00015d680 2023-08-09T12:39:58.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc006599640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000b1480 con 0x7fc000070bf0 2023-08-09T12:39:58.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc006599640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000c8100 con 0x7fc0001596e0 2023-08-09T12:39:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc004b36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc00015d680 0x7fc0000c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc004b36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc00015d680 0x7fc0000c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39234/0 (socket says 172.21.15.17:39234) 2023-08-09T12:39:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fc004b36640 1 -- 172.21.15.17:0/2052473040 learned_addr learned my addr 172.21.15.17:0/2052473040 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:58.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fbffffff640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc000070bf0 0x7fc0000c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.434+0000 7fbfff7fe640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0001596e0 0x7fc0000c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fc004b36640 1 -- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0001596e0 msgr2=0x7fc0000c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fc004b36640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0001596e0 0x7fc0000c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fc004b36640 1 -- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc000070bf0 msgr2=0x7fc0000c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fc004b36640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc000070bf0 0x7fc0000c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fc004b36640 1 -- 172.21.15.17:0/2052473040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8009b30 con 0x7fc00015d680 2023-08-09T12:39:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fbfff7fe640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0001596e0 0x7fc0000c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fc004b36640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc00015d680 0x7fc0000c73d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbff8036040 tx=0x7fbff8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fbffcff9640 1 -- 172.21.15.17:0/2052473040 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8009510 con 0x7fc00015d680 2023-08-09T12:39:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fbffcff9640 1 -- 172.21.15.17:0/2052473040 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff803e450 con 0x7fc00015d680 2023-08-09T12:39:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fbffcff9640 1 -- 172.21.15.17:0/2052473040 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff803e5e0 con 0x7fc00015d680 2023-08-09T12:39:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.435+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0000c83e0 con 0x7fc00015d680 2023-08-09T12:39:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.436+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc000144f00 con 0x7fc00015d680 2023-08-09T12:39:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.437+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0000b1980 con 0x7fc00015d680 2023-08-09T12:39:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.438+0000 7fbffcff9640 1 -- 172.21.15.17:0/2052473040 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbff803e740 con 0x7fc00015d680 2023-08-09T12:39:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.439+0000 7fbffcff9640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfec06a050 0x7fbfec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.439+0000 7fbffcff9640 1 -- 172.21.15.17:0/2052473040 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbff80aaf70 con 0x7fc00015d680 2023-08-09T12:39:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.440+0000 7fbffffff640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfec06a050 0x7fbfec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.441+0000 7fbffffff640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfec06a050 0x7fbfec06c510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbff0006fd0 tx=0x7fbff0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:58.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.443+0000 7fbffcff9640 1 -- 172.21.15.17:0/2052473040 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc0000b1980 con 0x7fc00015d680 2023-08-09T12:39:58.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.637+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0000b1980 con 0x7fc00015d680 2023-08-09T12:39:58.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.638+0000 7fbffcff9640 1 -- 172.21.15.17:0/2052473040 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0000b1980 con 0x7fc00015d680 2023-08-09T12:39:58.641 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:39:58.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfec06a050 msgr2=0x7fbfec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfec06a050 0x7fbfec06c510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbff0006fd0 tx=0x7fbff0008040 comp rx=0 tx=0).stop 2023-08-09T12:39:58.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc00015d680 msgr2=0x7fc0000c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc00015d680 0x7fc0000c73d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbff8036040 tx=0x7fbff8004a40 comp rx=0 tx=0).stop 2023-08-09T12:39:58.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 shutdown_connections 2023-08-09T12:39:58.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfec06a050 0x7fbfec06c510 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc00015d680 0x7fc0000c73d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0001596e0 0x7fc0000c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 --2- 172.21.15.17:0/2052473040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc000070bf0 0x7fc0000c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.641+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 >> 172.21.15.17:0/2052473040 conn(0x7fc000069be0 msgr2=0x7fc000069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:58.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.642+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 shutdown_connections 2023-08-09T12:39:58.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.642+0000 7fc006599640 1 -- 172.21.15.17:0/2052473040 wait complete. 2023-08-09T12:39:58.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:39:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.901+0000 7f2ed3be3640 1 Processor -- start 2023-08-09T12:39:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.901+0000 7f2ed3be3640 1 -- start start 2023-08-09T12:39:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.902+0000 7f2ed3be3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0adc40 0x7f2ecc06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.902+0000 7f2ed3be3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2ecc0b3b40 0x7f2ecc0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.902+0000 7f2ed3be3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2ecc15e8f0 0x7f2ecc15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.902+0000 7f2ed3be3640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc0ae020 con 0x7f2ecc0b3b40 2023-08-09T12:39:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.902+0000 7f2ed3be3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc0b2250 con 0x7f2ecc15e8f0 2023-08-09T12:39:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.902+0000 7f2ed3be3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0b2530 con 0x7f2ecc0adc40 2023-08-09T12:39:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed117e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2ecc0b3b40 0x7f2ecc0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed117e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2ecc0b3b40 0x7f2ecc0b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39242/0 (socket says 172.21.15.17:39242) 2023-08-09T12:39:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed117e640 1 -- 172.21.15.17:0/3621902614 learned_addr learned my addr 172.21.15.17:0/3621902614 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed2180640 1 --2- 172.21.15.17:0/3621902614 >> v2:172.21.15.142:3300/0 conn(0x7f2ecc15e8f0 0x7f2ecc15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed117e640 1 -- 172.21.15.17:0/3621902614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0adc40 msgr2=0x7f2ecc06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:58.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed117e640 1 --2- 172.21.15.17:0/3621902614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0adc40 0x7f2ecc06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed117e640 1 -- 172.21.15.17:0/3621902614 >> v2:172.21.15.142:3300/0 conn(0x7f2ecc15e8f0 msgr2=0x7f2ecc15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:58.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed117e640 1 --2- 172.21.15.17:0/3621902614 >> v2:172.21.15.142:3300/0 conn(0x7f2ecc15e8f0 0x7f2ecc15ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.903+0000 7f2ed117e640 1 -- 172.21.15.17:0/3621902614 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc06fe80 con 0x7f2ecc0b3b40 2023-08-09T12:39:58.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.905+0000 7f2ed117e640 1 --2- 172.21.15.17:0/3621902614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0b3b40 0x7f2ecc0b3fa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0cf780 tx=0x7f2ebc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b177d5979ef30785 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:58.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.905+0000 7f2ed097d640 1 -- 172.21.15.17:0/3621902614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc004230 con 0x7f2ecc0b3b40 2023-08-09T12:39:58.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.905+0000 7f2ed097d640 1 -- 172.21.15.17:0/3621902614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc004390 con 0x7f2ecc0b3b40 2023-08-09T12:39:58.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.905+0000 7f2ed097d640 1 -- 172.21.15.17:0/3621902614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc003810 con 0x7f2ecc0b3b40 2023-08-09T12:39:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.905+0000 7f2ed3be3640 1 -- 172.21.15.17:0/3621902614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0b3b40 msgr2=0x7f2ecc0b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.905+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/3621902614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0b3b40 0x7f2ecc0b3fa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0cf780 tx=0x7f2ebc02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.906+0000 7f2ed3be3640 1 -- 172.21.15.17:0/3621902614 shutdown_connections 2023-08-09T12:39:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.906+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/3621902614 >> v2:172.21.15.142:3300/0 conn(0x7f2ecc15e8f0 0x7f2ecc15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.906+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/3621902614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0b3b40 0x7f2ecc0b3fa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.906+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/3621902614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0adc40 0x7f2ecc06c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.906+0000 7f2ed3be3640 1 -- 172.21.15.17:0/3621902614 >> 172.21.15.17:0/3621902614 conn(0x7f2ecc0cb1b0 msgr2=0x7f2ecc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.906+0000 7f2ed3be3640 1 -- 172.21.15.17:0/3621902614 shutdown_connections 2023-08-09T12:39:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.906+0000 7f2ed3be3640 1 -- 172.21.15.17:0/3621902614 wait complete. 2023-08-09T12:39:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.908+0000 7f2ed3be3640 1 Processor -- start 2023-08-09T12:39:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.908+0000 7f2ed3be3640 1 -- start start 2023-08-09T12:39:58.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed3be3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0adc40 0x7f2ecc153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed3be3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0b3b40 0x7f2ecc1f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed3be3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc15e8f0 0x7f2ecc06bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed3be3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc157650 con 0x7f2ecc0adc40 2023-08-09T12:39:58.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed3be3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc06aca0 con 0x7f2ecc15e8f0 2023-08-09T12:39:58.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed3be3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc06af80 con 0x7f2ecc0b3b40 2023-08-09T12:39:58.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed197f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0adc40 0x7f2ecc153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed197f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0adc40 0x7f2ecc153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39254/0 (socket says 172.21.15.17:39254) 2023-08-09T12:39:58.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed197f640 1 -- 172.21.15.17:0/593614380 learned_addr learned my addr 172.21.15.17:0/593614380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:58.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed2180640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc15e8f0 0x7f2ecc06bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.909+0000 7f2ed117e640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0b3b40 0x7f2ecc1f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed197f640 1 -- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0b3b40 msgr2=0x7f2ecc1f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed197f640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0b3b40 0x7f2ecc1f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed197f640 1 -- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc15e8f0 msgr2=0x7f2ecc06bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:58.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed197f640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc15e8f0 0x7f2ecc06bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:58.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed197f640 1 -- 172.21.15.17:0/593614380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc009460 con 0x7f2ecc0adc40 2023-08-09T12:39:58.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed2180640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc15e8f0 0x7f2ecc06bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:58.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed117e640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0b3b40 0x7f2ecc1f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:58.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed197f640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0adc40 0x7f2ecc153840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800b4a0 tx=0x7f2ec800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:58.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ec27fc640 1 -- 172.21.15.17:0/593614380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8010610 con 0x7f2ecc0adc40 2023-08-09T12:39:58.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ec27fc640 1 -- 172.21.15.17:0/593614380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8010770 con 0x7f2ecc0adc40 2023-08-09T12:39:58.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc06b260 con 0x7f2ecc0adc40 2023-08-09T12:39:58.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.910+0000 7f2ec27fc640 1 -- 172.21.15.17:0/593614380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8010b20 con 0x7f2ecc0adc40 2023-08-09T12:39:58.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.911+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc06b820 con 0x7f2ecc0adc40 2023-08-09T12:39:58.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.912+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc067a80 con 0x7f2ecc0adc40 2023-08-09T12:39:58.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.913+0000 7f2ec27fc640 1 -- 172.21.15.17:0/593614380 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ec8010c80 con 0x7f2ecc0adc40 2023-08-09T12:39:58.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.914+0000 7f2ec27fc640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2eb006a050 0x7f2eb006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:58.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.914+0000 7f2ec27fc640 1 -- 172.21.15.17:0/593614380 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ec8088250 con 0x7f2ecc0adc40 2023-08-09T12:39:58.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.915+0000 7f2ed117e640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2eb006a050 0x7f2eb006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:58.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.916+0000 7f2ed117e640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2eb006a050 0x7f2eb006c510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc035000 tx=0x7f2ebc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:58.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:58.919+0000 7f2ec27fc640 1 -- 172.21.15.17:0/593614380 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2ec80538a0 con 0x7f2ecc0adc40 2023-08-09T12:39:59.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.114+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ecc06ed40 con 0x7f2ecc0adc40 2023-08-09T12:39:59.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.115+0000 7f2ec27fc640 1 -- 172.21.15.17:0/593614380 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ec8056ec0 con 0x7f2ecc0adc40 2023-08-09T12:39:59.118 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:39:59.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2eb006a050 msgr2=0x7f2eb006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2eb006a050 0x7f2eb006c510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc035000 tx=0x7f2ebc008030 comp rx=0 tx=0).stop 2023-08-09T12:39:59.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0adc40 msgr2=0x7f2ecc153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0adc40 0x7f2ecc153840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800b4a0 tx=0x7f2ec800b960 comp rx=0 tx=0).stop 2023-08-09T12:39:59.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 shutdown_connections 2023-08-09T12:39:59.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2eb006a050 0x7f2eb006c510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc15e8f0 0x7f2ecc06bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ecc0b3b40 0x7f2ecc1f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 --2- 172.21.15.17:0/593614380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ecc0adc40 0x7f2ecc153840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 >> 172.21.15.17:0/593614380 conn(0x7f2ecc0cb1b0 msgr2=0x7f2ecc15dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:59.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 shutdown_connections 2023-08-09T12:39:59.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.118+0000 7f2ed3be3640 1 -- 172.21.15.17:0/593614380 wait complete. 2023-08-09T12:39:59.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:39:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.360+0000 7f8732837640 1 Processor -- start 2023-08-09T12:39:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.360+0000 7f8732837640 1 -- start start 2023-08-09T12:39:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.361+0000 7f8732837640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f872c1587e0 0x7f872c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.362+0000 7f8732837640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c15beb0 con 0x7f872c0cb070 2023-08-09T12:39:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.362+0000 7f8732837640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c0715c0 con 0x7f872c0b0b10 2023-08-09T12:39:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.362+0000 7f8732837640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c0718a0 con 0x7f872c1587e0 2023-08-09T12:39:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.362+0000 7f8732036640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f872c0cb070 0x7f872c15e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42466/0 (socket says 172.21.15.17:42466) 2023-08-09T12:39:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.362+0000 7f8732036640 1 -- 172.21.15.17:0/4105036352 learned_addr learned my addr 172.21.15.17:0/4105036352 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.362+0000 7f8731835640 1 --2- 172.21.15.17:0/4105036352 >> v2:172.21.15.142:3300/0 conn(0x7f872c1587e0 0x7f872c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.362+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899890220 0 0) 0x7f872c15beb0 con 0x7f872c0cb070 2023-08-09T12:39:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8718003520 con 0x7f872c0cb070 2023-08-09T12:39:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922875223 0 0) 0x7f8718003520 con 0x7f872c0cb070 2023-08-09T12:39:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 >> v2:172.21.15.142:3300/0 conn(0x7f872c1587e0 msgr2=0x7f872c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 --2- 172.21.15.17:0/4105036352 >> v2:172.21.15.142:3300/0 conn(0x7f872c1587e0 0x7f872c070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 >> v1:172.21.15.142:6789/0 conn(0x7f872c0b0b10 legacy=0x7f872c15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c071b80 con 0x7f872c0cb070 2023-08-09T12:39:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f87240019f0 con 0x7f872c0cb070 2023-08-09T12:39:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 >> v1:172.21.15.17:6789/0 conn(0x7f872c0cb070 legacy=0x7f872c15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8718003970 0x7f8718003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87180047c0 0x7f8718004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718005180 0x7f871800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0718a0 con 0x7f87180047c0 2023-08-09T12:39:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871800c020 con 0x7f8718003970 2023-08-09T12:39:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871800c1e0 con 0x7f8718005180 2023-08-09T12:39:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.363+0000 7f8731034640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87180047c0 0x7f8718004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.364+0000 7f8731835640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8718003970 0x7f8718003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.364+0000 7f8732036640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718005180 0x7f871800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.364+0000 7f8731034640 1 -- 172.21.15.17:0/4105036352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718005180 msgr2=0x7f871800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.364+0000 7f8731034640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718005180 0x7f871800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.364+0000 7f8731034640 1 -- 172.21.15.17:0/4105036352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8718003970 msgr2=0x7f8718003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:59.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.364+0000 7f8731034640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8718003970 0x7f8718003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.364+0000 7f8731034640 1 -- 172.21.15.17:0/4105036352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718003520 con 0x7f87180047c0 2023-08-09T12:39:59.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.364+0000 7f8732036640 1 -- 172.21.15.17:0/4105036352 reap_dead start 2023-08-09T12:39:59.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.365+0000 7f8731034640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87180047c0 0x7f8718004c40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f871c001750 tx=0x7f87180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a3d13dcb6e51c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:59.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.365+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c0052d0 con 0x7f87180047c0 2023-08-09T12:39:59.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.365+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c02e050 con 0x7f87180047c0 2023-08-09T12:39:59.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.365+0000 7f8730833640 1 -- 172.21.15.17:0/4105036352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c003830 con 0x7f87180047c0 2023-08-09T12:39:59.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.366+0000 7f8732837640 1 -- 172.21.15.17:0/4105036352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87180047c0 msgr2=0x7f8718004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.366+0000 7f8732837640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87180047c0 0x7f8718004c40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f871c001750 tx=0x7f87180057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.366+0000 7f8732837640 1 -- 172.21.15.17:0/4105036352 shutdown_connections 2023-08-09T12:39:59.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.366+0000 7f8732837640 1 --2- 172.21.15.17:0/4105036352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87180047c0 0x7f8718004c40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.366+0000 7f8732837640 1 -- 172.21.15.17:0/4105036352 >> 172.21.15.17:0/4105036352 conn(0x7f872c0b1d50 msgr2=0x7f872c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:59.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.366+0000 7f8732837640 1 -- 172.21.15.17:0/4105036352 shutdown_connections 2023-08-09T12:39:59.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.366+0000 7f8732837640 1 -- 172.21.15.17:0/4105036352 wait complete. 2023-08-09T12:39:59.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.368+0000 7f8732837640 1 Processor -- start 2023-08-09T12:39:59.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.368+0000 7f8732837640 1 -- start start 2023-08-09T12:39:59.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8732837640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180047c0 0x7f872c1f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8732837640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f872c148c30 0x7f872c1f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8732837640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f872c1f1980 0x7f872c1f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8732837640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0c5960 con 0x7f872c148c30 2023-08-09T12:39:59.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8732837640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c1f49d0 con 0x7f87180047c0 2023-08-09T12:39:59.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8732837640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c1490b0 con 0x7f872c1f1980 2023-08-09T12:39:59.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8731034640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f872c148c30 0x7f872c1f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8731034640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f872c148c30 0x7f872c1f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39276/0 (socket says 172.21.15.17:39276) 2023-08-09T12:39:59.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.369+0000 7f8731034640 1 -- 172.21.15.17:0/709617200 learned_addr learned my addr 172.21.15.17:0/709617200 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:59.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8732036640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f872c1f1980 0x7f872c1f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8731835640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180047c0 0x7f872c1f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8731034640 1 -- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f872c1f1980 msgr2=0x7f872c1f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8731034640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f872c1f1980 0x7f872c1f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8731034640 1 -- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180047c0 msgr2=0x7f872c1f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8731034640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180047c0 0x7f872c1f0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8731034640 1 -- 172.21.15.17:0/709617200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c0c50a0 con 0x7f872c148c30 2023-08-09T12:39:59.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8732036640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f872c1f1980 0x7f872c1f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:59.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.370+0000 7f8731034640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f872c148c30 0x7f872c1f4490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f871c034040 tx=0x7f871c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:59.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.371+0000 7f87227fc640 1 -- 172.21.15.17:0/709617200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c007a30 con 0x7f872c148c30 2023-08-09T12:39:59.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.371+0000 7f87227fc640 1 -- 172.21.15.17:0/709617200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c0069e0 con 0x7f872c148c30 2023-08-09T12:39:59.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.371+0000 7f87227fc640 1 -- 172.21.15.17:0/709617200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c006db0 con 0x7f872c148c30 2023-08-09T12:39:59.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.371+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c1f0ae0 con 0x7f872c148c30 2023-08-09T12:39:59.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.371+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c1f10a0 con 0x7f872c148c30 2023-08-09T12:39:59.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.372+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c0c5aa0 con 0x7f872c148c30 2023-08-09T12:39:59.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.373+0000 7f87227fc640 1 -- 172.21.15.17:0/709617200 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f871c0035f0 con 0x7f872c148c30 2023-08-09T12:39:59.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.374+0000 7f87227fc640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871006a080 0x7f871006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.374+0000 7f87227fc640 1 -- 172.21.15.17:0/709617200 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f871c0aa2f0 con 0x7f872c148c30 2023-08-09T12:39:59.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.375+0000 7f8731835640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871006a080 0x7f871006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.376+0000 7f8731835640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871006a080 0x7f871006c540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f872c0c55e0 tx=0x7f8728008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.378+0000 7f87227fc640 1 -- 172.21.15.17:0/709617200 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f872c0c5aa0 con 0x7f872c148c30 2023-08-09T12:39:59.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.572+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f872c0c5aa0 con 0x7f872c148c30 2023-08-09T12:39:59.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.575+0000 7f87227fc640 1 -- 172.21.15.17:0/709617200 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f872c0c5aa0 con 0x7f872c148c30 2023-08-09T12:39:59.579 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:39:59.579 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:39:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.577+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871006a080 msgr2=0x7f871006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.577+0000 7f8732837640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871006a080 0x7f871006c540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f872c0c55e0 tx=0x7f8728008040 comp rx=0 tx=0).stop 2023-08-09T12:39:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.577+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f872c148c30 msgr2=0x7f872c1f4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.577+0000 7f8732837640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f872c148c30 0x7f872c1f4490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f871c034040 tx=0x7f871c001120 comp rx=0 tx=0).stop 2023-08-09T12:39:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.578+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 shutdown_connections 2023-08-09T12:39:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.578+0000 7f8732837640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f871006a080 0x7f871006c540 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.578+0000 7f8732837640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f872c1f1980 0x7f872c1f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.578+0000 7f8732837640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f872c148c30 0x7f872c1f4490 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.578+0000 7f8732837640 1 --2- 172.21.15.17:0/709617200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180047c0 0x7f872c1f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.578+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 >> 172.21.15.17:0/709617200 conn(0x7f872c0b1d50 msgr2=0x7f872c0b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:59.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.578+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 shutdown_connections 2023-08-09T12:39:59.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.578+0000 7f8732837640 1 -- 172.21.15.17:0/709617200 wait complete. 2023-08-09T12:39:59.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:39:59.601 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:39:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.826+0000 7f0cd3337640 1 Processor -- start 2023-08-09T12:39:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.827+0000 7f0cd3337640 1 -- start start 2023-08-09T12:39:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.828+0000 7f0cd3337640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ccc15caf0 0x7f0ccc0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.828+0000 7f0cd3337640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc0d0f00 con 0x7f0ccc0708e0 2023-08-09T12:39:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.828+0000 7f0cd3337640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc0d11e0 con 0x7f0ccc0d2530 2023-08-09T12:39:59.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.828+0000 7f0cd3337640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ccc0d1a80 con 0x7f0ccc15caf0 2023-08-09T12:39:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.829+0000 7f0cd1b34640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0ccc0708e0 0x7f0ccc0d1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42476/0 (socket says 172.21.15.17:42476) 2023-08-09T12:39:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.829+0000 7f0cd1b34640 1 -- 172.21.15.17:0/111537272 learned_addr learned my addr 172.21.15.17:0/111537272 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:39:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.829+0000 7f0cd2335640 1 --2- 172.21.15.17:0/111537272 >> v2:172.21.15.142:3300/0 conn(0x7f0ccc15caf0 0x7f0ccc0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.829+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102011909 0 0) 0x7f0ccc0d0f00 con 0x7f0ccc0708e0 2023-08-09T12:39:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.829+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb8003520 con 0x7f0ccc0708e0 2023-08-09T12:39:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.829+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 522043305 0 0) 0x7f0cb8003520 con 0x7f0ccc0708e0 2023-08-09T12:39:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 >> v2:172.21.15.142:3300/0 conn(0x7f0ccc15caf0 msgr2=0x7f0ccc0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 --2- 172.21.15.17:0/111537272 >> v2:172.21.15.142:3300/0 conn(0x7f0ccc15caf0 0x7f0ccc0703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 >> v1:172.21.15.142:6789/0 conn(0x7f0ccc0d2530 legacy=0x7f0ccc0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0d14c0 con 0x7f0ccc0708e0 2023-08-09T12:39:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0cbc001670 con 0x7f0ccc0708e0 2023-08-09T12:39:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 >> v1:172.21.15.17:6789/0 conn(0x7f0ccc0708e0 legacy=0x7f0ccc0d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0cb8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cb80047c0 0x7f0cb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cb8005180 0x7f0cb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0d1a80 con 0x7f0cb8003970 2023-08-09T12:39:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb800c000 con 0x7f0cb8005180 2023-08-09T12:39:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb800c1c0 con 0x7f0cb80047c0 2023-08-09T12:39:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd2335640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0cb8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd2b36640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cb8005180 0x7f0cb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.830+0000 7f0cd1b34640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cb80047c0 0x7f0cb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.831+0000 7f0cd2335640 1 -- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cb80047c0 msgr2=0x7f0cb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.831+0000 7f0cd2335640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cb80047c0 0x7f0cb8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.831+0000 7f0cd2335640 1 -- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cb8005180 msgr2=0x7f0cb800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:39:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.831+0000 7f0cd2335640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cb8005180 0x7f0cb800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.831+0000 7f0cd2335640 1 -- 172.21.15.17:0/111537272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8003520 con 0x7f0cb8003970 2023-08-09T12:39:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.831+0000 7f0cd2b36640 1 -- 172.21.15.17:0/111537272 reap_dead start 2023-08-09T12:39:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.831+0000 7f0cd1b34640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cb80047c0 0x7f0cb8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.832+0000 7f0cd2335640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0cb8003d70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ac0 tx=0x7f0cb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa23916601b30c33 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.832+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc802c6b0 con 0x7f0cb8003970 2023-08-09T12:39:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.832+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc802c810 con 0x7f0cb8003970 2023-08-09T12:39:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.832+0000 7f0cd1333640 1 -- 172.21.15.17:0/111537272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc802cba0 con 0x7f0cb8003970 2023-08-09T12:39:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.833+0000 7f0cd3337640 1 -- 172.21.15.17:0/111537272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 msgr2=0x7f0cb8003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.833+0000 7f0cd3337640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0cb8003d70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ac0 tx=0x7f0cb80057f0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.833+0000 7f0cd3337640 1 -- 172.21.15.17:0/111537272 shutdown_connections 2023-08-09T12:39:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.833+0000 7f0cd3337640 1 --2- 172.21.15.17:0/111537272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0cb8003d70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.833+0000 7f0cd3337640 1 -- 172.21.15.17:0/111537272 >> 172.21.15.17:0/111537272 conn(0x7f0ccc0cf6b0 msgr2=0x7f0ccc0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:39:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.833+0000 7f0cd3337640 1 -- 172.21.15.17:0/111537272 shutdown_connections 2023-08-09T12:39:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.833+0000 7f0cd3337640 1 -- 172.21.15.17:0/111537272 wait complete. 2023-08-09T12:39:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.835+0000 7f0cd3337640 1 Processor -- start 2023-08-09T12:39:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.835+0000 7f0cd3337640 1 -- start start 2023-08-09T12:39:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd3337640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0ccc158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd3337640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ccc1521c0 0x7f0ccc0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd3337640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ccc0c69e0 0x7f0ccc0c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd3337640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc158960 con 0x7f0cb8003970 2023-08-09T12:39:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd3337640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc155050 con 0x7f0ccc0c69e0 2023-08-09T12:39:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd3337640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc158310 con 0x7f0ccc1521c0 2023-08-09T12:39:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd2335640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0ccc158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd2335640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0ccc158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39294/0 (socket says 172.21.15.17:39294) 2023-08-09T12:39:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd2335640 1 -- 172.21.15.17:0/3367873802 learned_addr learned my addr 172.21.15.17:0/3367873802 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:39:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd1b34640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ccc1521c0 0x7f0ccc0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd2b36640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ccc0c69e0 0x7f0ccc0c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd2335640 1 -- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ccc1521c0 msgr2=0x7f0ccc0c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd2335640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ccc1521c0 0x7f0ccc0c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.836+0000 7f0cd2335640 1 -- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ccc0c69e0 msgr2=0x7f0ccc0c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:39:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cd2335640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ccc0c69e0 0x7f0ccc0c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:39:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cd2335640 1 -- 172.21.15.17:0/3367873802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc1585f0 con 0x7f0cb8003970 2023-08-09T12:39:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cd1b34640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ccc1521c0 0x7f0ccc0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cd2b36640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ccc0c69e0 0x7f0ccc0c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:39:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cd2335640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0ccc158df0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ac0 tx=0x7f0cc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cc2ffd640 1 -- 172.21.15.17:0/3367873802 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8003810 con 0x7f0cb8003970 2023-08-09T12:39:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cc2ffd640 1 -- 172.21.15.17:0/3367873802 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc8003970 con 0x7f0cb8003970 2023-08-09T12:39:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cc2ffd640 1 -- 172.21.15.17:0/3367873802 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8003d00 con 0x7f0cb8003970 2023-08-09T12:39:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc155330 con 0x7f0cb8003970 2023-08-09T12:39:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.837+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc153b60 con 0x7f0cb8003970 2023-08-09T12:39:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.839+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc04e390 con 0x7f0cb8003970 2023-08-09T12:39:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.840+0000 7f0cc2ffd640 1 -- 172.21.15.17:0/3367873802 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0cc8040450 con 0x7f0cb8003970 2023-08-09T12:39:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.840+0000 7f0cc2ffd640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0cb006a050 0x7f0cb006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:39:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.841+0000 7f0cc2ffd640 1 -- 172.21.15.17:0/3367873802 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cc80aa550 con 0x7f0cb8003970 2023-08-09T12:39:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.841+0000 7f0cd1b34640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0cb006a050 0x7f0cb006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:39:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.842+0000 7f0cd1b34640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0cb006a050 0x7f0cb006c510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000fd0 tx=0x7f0cbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:39:59.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:39:59.845+0000 7f0cc2ffd640 1 -- 172.21.15.17:0/3367873802 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0cc8075b90 con 0x7f0cb8003970 2023-08-09T12:40:00.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.042+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ccc0b4b80 con 0x7f0cb8003970 2023-08-09T12:40:00.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.043+0000 7f0cc2ffd640 1 -- 172.21.15.17:0/3367873802 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cc8003e60 con 0x7f0cb8003970 2023-08-09T12:40:00.047 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:00.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0cb006a050 msgr2=0x7f0cb006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0cb006a050 0x7f0cb006c510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000fd0 tx=0x7f0cbc009040 comp rx=0 tx=0).stop 2023-08-09T12:40:00.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 msgr2=0x7f0ccc158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0ccc158df0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ac0 tx=0x7f0cc8004730 comp rx=0 tx=0).stop 2023-08-09T12:40:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 shutdown_connections 2023-08-09T12:40:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0cb006a050 0x7f0cb006c510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ccc0c69e0 0x7f0ccc0c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ccc1521c0 0x7f0ccc0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 --2- 172.21.15.17:0/3367873802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cb8003970 0x7f0ccc158df0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 >> 172.21.15.17:0/3367873802 conn(0x7f0ccc0cf6b0 msgr2=0x7f0ccc0b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 shutdown_connections 2023-08-09T12:40:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.046+0000 7f0cd3337640 1 -- 172.21.15.17:0/3367873802 wait complete. 2023-08-09T12:40:00.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.290+0000 7f96a12e0640 1 Processor -- start 2023-08-09T12:40:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.290+0000 7f96a12e0640 1 -- start start 2023-08-09T12:40:00.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.292+0000 7f96a12e0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f969c0d1e20 0x7f969c0d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.292+0000 7f96a12e0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c070ab0 con 0x7f969c15caf0 2023-08-09T12:40:00.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.292+0000 7f96a12e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c0d0f00 con 0x7f969c0b5de0 2023-08-09T12:40:00.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.292+0000 7f96a12e0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c0d1a80 con 0x7f969c0d1e20 2023-08-09T12:40:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.292+0000 7f969b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f969c0d1e20 0x7f969c0d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.292+0000 7f969b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f969c0d1e20 0x7f969c0d2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39302/0 (socket says 172.21.15.17:39302) 2023-08-09T12:40:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.292+0000 7f969b7fe640 1 -- 172.21.15.17:0/2454393731 learned_addr learned my addr 172.21.15.17:0/2454393731 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:00.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.292+0000 7f969bfff640 1 --1- 172.21.15.17:0/2454393731 >> v1:172.21.15.17:6789/0 conn(0x7f969c15caf0 0x7f969c0703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42486/0 (socket says 172.21.15.17:42486) 2023-08-09T12:40:00.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.293+0000 7f969b7fe640 1 -- 172.21.15.17:0/2454393731 >> v1:172.21.15.142:6789/0 conn(0x7f969c0b5de0 legacy=0x7f969c0b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:00.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.293+0000 7f969b7fe640 1 -- 172.21.15.17:0/2454393731 >> v1:172.21.15.17:6789/0 conn(0x7f969c15caf0 legacy=0x7f969c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.293+0000 7f969b7fe640 1 -- 172.21.15.17:0/2454393731 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c0d11e0 con 0x7f969c0d1e20 2023-08-09T12:40:00.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.294+0000 7f969b7fe640 1 --2- 172.21.15.17:0/2454393731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0d1e20 0x7f969c0d2290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9690009870 tx=0x7f969002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd58efc1be68637e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:00.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.294+0000 7f969affd640 1 -- 172.21.15.17:0/2454393731 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690030850 con 0x7f969c0d1e20 2023-08-09T12:40:00.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.294+0000 7f969affd640 1 -- 172.21.15.17:0/2454393731 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96900309b0 con 0x7f969c0d1e20 2023-08-09T12:40:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.294+0000 7f969affd640 1 -- 172.21.15.17:0/2454393731 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690030d40 con 0x7f969c0d1e20 2023-08-09T12:40:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.295+0000 7f96a12e0640 1 -- 172.21.15.17:0/2454393731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0d1e20 msgr2=0x7f969c0d2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.295+0000 7f96a12e0640 1 --2- 172.21.15.17:0/2454393731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0d1e20 0x7f969c0d2290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9690009870 tx=0x7f969002b990 comp rx=0 tx=0).stop 2023-08-09T12:40:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.295+0000 7f96a12e0640 1 -- 172.21.15.17:0/2454393731 shutdown_connections 2023-08-09T12:40:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.295+0000 7f96a12e0640 1 --2- 172.21.15.17:0/2454393731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0d1e20 0x7f969c0d2290 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.295+0000 7f96a12e0640 1 -- 172.21.15.17:0/2454393731 >> 172.21.15.17:0/2454393731 conn(0x7f969c0cf6b0 msgr2=0x7f969c0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:00.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.295+0000 7f96a12e0640 1 -- 172.21.15.17:0/2454393731 shutdown_connections 2023-08-09T12:40:00.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.295+0000 7f96a12e0640 1 -- 172.21.15.17:0/2454393731 wait complete. 2023-08-09T12:40:00.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.297+0000 7f96a12e0640 1 Processor -- start 2023-08-09T12:40:00.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.297+0000 7f96a12e0640 1 -- start start 2023-08-09T12:40:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.298+0000 7f96a12e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b5de0 0x7f969c14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.298+0000 7f96a12e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0d1e20 0x7f969c0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.298+0000 7f96a12e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15caf0 0x7f969c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.298+0000 7f96a12e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1f6250 con 0x7f969c0b5de0 2023-08-09T12:40:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.298+0000 7f96a12e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0a99c0 con 0x7f969c0d1e20 2023-08-09T12:40:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.298+0000 7f96a12e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1f5940 con 0x7f969c15caf0 2023-08-09T12:40:00.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b5de0 0x7f969c14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b5de0 0x7f969c14e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39312/0 (socket says 172.21.15.17:39312) 2023-08-09T12:40:00.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 -- 172.21.15.17:0/1275747391 learned_addr learned my addr 172.21.15.17:0/1275747391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:00.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969b7fe640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0d1e20 0x7f969c0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f96a0adf640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15caf0 0x7f969c0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 -- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15caf0 msgr2=0x7f969c0c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15caf0 0x7f969c0c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 -- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0d1e20 msgr2=0x7f969c0c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0d1e20 0x7f969c0c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 -- 172.21.15.17:0/1275747391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900094d0 con 0x7f969c0b5de0 2023-08-09T12:40:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969b7fe640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0d1e20 0x7f969c0c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.299+0000 7f969bfff640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b5de0 0x7f969c14e6b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c800 tx=0x7f968c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.300+0000 7f9698ff9640 1 -- 172.21.15.17:0/1275747391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00a640 con 0x7f969c0b5de0 2023-08-09T12:40:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.300+0000 7f9698ff9640 1 -- 172.21.15.17:0/1275747391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c00a7a0 con 0x7f969c0b5de0 2023-08-09T12:40:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.300+0000 7f9698ff9640 1 -- 172.21.15.17:0/1275747391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00ab10 con 0x7f969c0b5de0 2023-08-09T12:40:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.300+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c0a96e0 con 0x7f969c0b5de0 2023-08-09T12:40:00.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.300+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c1f5e70 con 0x7f969c0b5de0 2023-08-09T12:40:00.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.301+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c04e390 con 0x7f969c0b5de0 2023-08-09T12:40:00.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.302+0000 7f9698ff9640 1 -- 172.21.15.17:0/1275747391 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f968c00ac70 con 0x7f969c0b5de0 2023-08-09T12:40:00.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.303+0000 7f9698ff9640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a080 0x7f968806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.304+0000 7f9698ff9640 1 -- 172.21.15.17:0/1275747391 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f968c087c60 con 0x7f969c0b5de0 2023-08-09T12:40:00.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.304+0000 7f969b7fe640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a080 0x7f968806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.305+0000 7f969b7fe640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a080 0x7f968806c540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9690036000 tx=0x7f969003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.308+0000 7f9698ff9640 1 -- 172.21.15.17:0/1275747391 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f968c0533f0 con 0x7f969c0b5de0 2023-08-09T12:40:00.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.500+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f969c14ebf0 con 0x7f969c0b5de0 2023-08-09T12:40:00.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.501+0000 7f9698ff9640 1 -- 172.21.15.17:0/1275747391 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f968c017020 con 0x7f969c0b5de0 2023-08-09T12:40:00.504 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a080 msgr2=0x7f968806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a080 0x7f968806c540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9690036000 tx=0x7f969003b040 comp rx=0 tx=0).stop 2023-08-09T12:40:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b5de0 msgr2=0x7f969c14e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b5de0 0x7f969c14e6b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c800 tx=0x7f968c00ccc0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 shutdown_connections 2023-08-09T12:40:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a080 0x7f968806c540 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15caf0 0x7f969c0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c0d1e20 0x7f969c0c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 --2- 172.21.15.17:0/1275747391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b5de0 0x7f969c14e6b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.503+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 >> 172.21.15.17:0/1275747391 conn(0x7f969c0cf6b0 msgr2=0x7f969c0d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:00.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.504+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 shutdown_connections 2023-08-09T12:40:00.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.504+0000 7f96a12e0640 1 -- 172.21.15.17:0/1275747391 wait complete. 2023-08-09T12:40:00.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.756+0000 7fc3b5856640 1 Processor -- start 2023-08-09T12:40:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.757+0000 7fc3b5856640 1 -- start start 2023-08-09T12:40:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.758+0000 7fc3b5856640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3b0069ed0 0x7fc3b00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.758+0000 7fc3b5856640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc3b00ccbc0 0x7fc3b00ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.758+0000 7fc3b5856640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b00cdd40 con 0x7fc3b015ca30 2023-08-09T12:40:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.758+0000 7fc3b5856640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b00cd130 con 0x7fc3b0069ed0 2023-08-09T12:40:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.758+0000 7fc3b5856640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b00cd410 con 0x7fc3b00ccbc0 2023-08-09T12:40:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.759+0000 7fc3affff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3b0069ed0 0x7fc3b00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.759+0000 7fc3affff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3b0069ed0 0x7fc3b00c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39320/0 (socket says 172.21.15.17:39320) 2023-08-09T12:40:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.759+0000 7fc3affff640 1 -- 172.21.15.17:0/1813251492 learned_addr learned my addr 172.21.15.17:0/1813251492 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.759+0000 7fc3b4854640 1 --1- 172.21.15.17:0/1813251492 >> v1:172.21.15.17:6789/0 conn(0x7fc3b015ca30 0x7fc3b00697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42488/0 (socket says 172.21.15.17:42488) 2023-08-09T12:40:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.759+0000 7fc3affff640 1 -- 172.21.15.17:0/1813251492 >> v2:172.21.15.142:3300/0 conn(0x7fc3b00ccbc0 msgr2=0x7fc3b00ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.759+0000 7fc3affff640 1 --2- 172.21.15.17:0/1813251492 >> v2:172.21.15.142:3300/0 conn(0x7fc3b00ccbc0 0x7fc3b00ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.759+0000 7fc3affff640 1 -- 172.21.15.17:0/1813251492 >> v1:172.21.15.17:6789/0 conn(0x7fc3b015ca30 legacy=0x7fc3b00697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.759+0000 7fc3affff640 1 -- 172.21.15.17:0/1813251492 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b00cd6f0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.760+0000 7fc3affff640 1 --2- 172.21.15.17:0/1813251492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b00c9d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0161780 tx=0x7fc39c02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df64f014ba0b9ab5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1813251492 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c030870 con 0x7fc3b0069ed0 2023-08-09T12:40:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1813251492 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c0309d0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3af7fe640 1 -- 172.21.15.17:0/1813251492 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c030d60 con 0x7fc3b0069ed0 2023-08-09T12:40:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3b5856640 1 -- 172.21.15.17:0/1813251492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 msgr2=0x7fc3b00c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3b5856640 1 --2- 172.21.15.17:0/1813251492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b00c9d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0161780 tx=0x7fc39c02b9b0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3b5856640 1 -- 172.21.15.17:0/1813251492 shutdown_connections 2023-08-09T12:40:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3b5856640 1 --2- 172.21.15.17:0/1813251492 >> v2:172.21.15.142:3300/0 conn(0x7fc3b00ccbc0 0x7fc3b00ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3b5856640 1 --2- 172.21.15.17:0/1813251492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b00c9d00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.761+0000 7fc3b5856640 1 -- 172.21.15.17:0/1813251492 >> 172.21.15.17:0/1813251492 conn(0x7fc3b006abd0 msgr2=0x7fc3b006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.762+0000 7fc3b5856640 1 -- 172.21.15.17:0/1813251492 shutdown_connections 2023-08-09T12:40:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.762+0000 7fc3b5856640 1 -- 172.21.15.17:0/1813251492 wait complete. 2023-08-09T12:40:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.763+0000 7fc3b5856640 1 Processor -- start 2023-08-09T12:40:00.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.764+0000 7fc3b5856640 1 -- start start 2023-08-09T12:40:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.764+0000 7fc3b5856640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.764+0000 7fc3b5856640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b00ccbc0 0x7fc3b00b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.764+0000 7fc3b5856640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015ca30 0x7fc3b00ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b5856640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b015ba90 con 0x7fc3b0069ed0 2023-08-09T12:40:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b5856640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b01f2a00 con 0x7fc3b00ccbc0 2023-08-09T12:40:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b5856640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b01f2ce0 con 0x7fc3b015ca30 2023-08-09T12:40:00.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b4854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b4854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39332/0 (socket says 172.21.15.17:39332) 2023-08-09T12:40:00.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b4854640 1 -- 172.21.15.17:0/3267667325 learned_addr learned my addr 172.21.15.17:0/3267667325 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3affff640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b00ccbc0 0x7fc3b00b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b4854640 1 -- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015ca30 msgr2=0x7fc3b00ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b4854640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015ca30 0x7fc3b00ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b4854640 1 -- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b00ccbc0 msgr2=0x7fc3b00b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b4854640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b00ccbc0 0x7fc3b00b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.765+0000 7fc3b4854640 1 -- 172.21.15.17:0/3267667325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c0094d0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.766+0000 7fc3b4854640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b015b550 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c400 tx=0x7fc3a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.766+0000 7fc3ad7fa640 1 -- 172.21.15.17:0/3267667325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40074e0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.766+0000 7fc3ad7fa640 1 -- 172.21.15.17:0/3267667325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a4007640 con 0x7fc3b0069ed0 2023-08-09T12:40:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.766+0000 7fc3ad7fa640 1 -- 172.21.15.17:0/3267667325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4004a00 con 0x7fc3b0069ed0 2023-08-09T12:40:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.766+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b01f2fc0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.766+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b01f26b0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.767+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b01f34e0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.768+0000 7fc3ad7fa640 1 -- 172.21.15.17:0/3267667325 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc3a4004b60 con 0x7fc3b0069ed0 2023-08-09T12:40:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.769+0000 7fc3ad7fa640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.769+0000 7fc3ad7fa640 1 -- 172.21.15.17:0/3267667325 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3a4087fe0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.770+0000 7fc3affff640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.771+0000 7fc3affff640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc39c036000 tx=0x7fc39c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:00.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.773+0000 7fc3ad7fa640 1 -- 172.21.15.17:0/3267667325 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc3b01f34e0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.964+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3b01f34e0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.965+0000 7fc3ad7fa640 1 -- 172.21.15.17:0/3267667325 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3b01f34e0 con 0x7fc3b0069ed0 2023-08-09T12:40:00.968 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 msgr2=0x7fc39406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc39c036000 tx=0x7fc39c03b040 comp rx=0 tx=0).stop 2023-08-09T12:40:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 msgr2=0x7fc3b015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b015b550 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c400 tx=0x7fc3a400c8c0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 shutdown_connections 2023-08-09T12:40:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b015ca30 0x7fc3b00ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b00ccbc0 0x7fc3b00b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.967+0000 7fc3b5856640 1 --2- 172.21.15.17:0/3267667325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b0069ed0 0x7fc3b015b550 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:00.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.968+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 >> 172.21.15.17:0/3267667325 conn(0x7fc3b006abd0 msgr2=0x7fc3b00af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:00.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.968+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 shutdown_connections 2023-08-09T12:40:00.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:00.968+0000 7fc3b5856640 1 -- 172.21.15.17:0/3267667325 wait complete. 2023-08-09T12:40:00.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.220+0000 7fe9a6502640 1 Processor -- start 2023-08-09T12:40:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.220+0000 7fe9a6502640 1 -- start start 2023-08-09T12:40:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.221+0000 7fe9a6502640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a0159bd0 0x7fe9a00c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.221+0000 7fe9a6502640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9a00b3d60 0x7fe9a00cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.221+0000 7fe9a6502640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a00b2b90 con 0x7fe9a00cc6b0 2023-08-09T12:40:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.221+0000 7fe9a6502640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a00cabb0 con 0x7fe9a00b3d60 2023-08-09T12:40:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.221+0000 7fe9a6502640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00b2580 con 0x7fe9a0159bd0 2023-08-09T12:40:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.222+0000 7fe9a4cff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9a00b3d60 0x7fe9a00cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.222+0000 7fe9a4cff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9a00b3d60 0x7fe9a00cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39340/0 (socket says 172.21.15.17:39340) 2023-08-09T12:40:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.222+0000 7fe9a4cff640 1 -- 172.21.15.17:0/3745099678 learned_addr learned my addr 172.21.15.17:0/3745099678 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.222+0000 7fe9a5500640 1 --2- 172.21.15.17:0/3745099678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a0159bd0 0x7fe9a00c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.222+0000 7fe9a4cff640 1 -- 172.21.15.17:0/3745099678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a0159bd0 msgr2=0x7fe9a00c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.222+0000 7fe9a4cff640 1 --2- 172.21.15.17:0/3745099678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a0159bd0 0x7fe9a00c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.222+0000 7fe9a4cff640 1 -- 172.21.15.17:0/3745099678 >> v1:172.21.15.142:6789/0 conn(0x7fe9a00cc6b0 legacy=0x7fe9a00b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.222+0000 7fe9a4cff640 1 -- 172.21.15.17:0/3745099678 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a00ca350 con 0x7fe9a00b3d60 2023-08-09T12:40:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.223+0000 7fe9a4cff640 1 --2- 172.21.15.17:0/3745099678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a00b3d60 0x7fe9a00cc170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009870 tx=0x7fe98c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c36c32aadd72d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe99ffff640 1 -- 172.21.15.17:0/3745099678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c031640 con 0x7fe9a00b3d60 2023-08-09T12:40:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe99ffff640 1 -- 172.21.15.17:0/3745099678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c0317a0 con 0x7fe9a00b3d60 2023-08-09T12:40:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe99ffff640 1 -- 172.21.15.17:0/3745099678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c031b30 con 0x7fe9a00b3d60 2023-08-09T12:40:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe9a6502640 1 -- 172.21.15.17:0/3745099678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a00b3d60 msgr2=0x7fe9a00cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3745099678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a00b3d60 0x7fe9a00cc170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009870 tx=0x7fe98c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe9a6502640 1 -- 172.21.15.17:0/3745099678 shutdown_connections 2023-08-09T12:40:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3745099678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a00b3d60 0x7fe9a00cc170 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3745099678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a0159bd0 0x7fe9a00c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe9a6502640 1 -- 172.21.15.17:0/3745099678 >> 172.21.15.17:0/3745099678 conn(0x7fe9a00cb020 msgr2=0x7fe9a00cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.224+0000 7fe9a6502640 1 -- 172.21.15.17:0/3745099678 shutdown_connections 2023-08-09T12:40:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.225+0000 7fe9a6502640 1 -- 172.21.15.17:0/3745099678 wait complete. 2023-08-09T12:40:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.226+0000 7fe9a6502640 1 Processor -- start 2023-08-09T12:40:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.226+0000 7fe9a6502640 1 -- start start 2023-08-09T12:40:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.227+0000 7fe9a6502640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a00b3d60 0x7fe9a014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.227+0000 7fe9a6502640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a00cc6b0 0x7fe9a00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.227+0000 7fe9a6502640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a0159bd0 0x7fe9a00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.227+0000 7fe9a6502640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00c5ec0 con 0x7fe9a0159bd0 2023-08-09T12:40:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.227+0000 7fe9a6502640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00c2c10 con 0x7fe9a00cc6b0 2023-08-09T12:40:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.227+0000 7fe9a6502640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00c2270 con 0x7fe9a00b3d60 2023-08-09T12:40:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a0159bd0 0x7fe9a00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a0159bd0 0x7fe9a00ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39344/0 (socket says 172.21.15.17:39344) 2023-08-09T12:40:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 -- 172.21.15.17:0/3346784420 learned_addr learned my addr 172.21.15.17:0/3346784420 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5500640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a00b3d60 0x7fe9a014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a4cff640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a00cc6b0 0x7fe9a00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 -- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a00b3d60 msgr2=0x7fe9a014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a00b3d60 0x7fe9a014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 -- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a00cc6b0 msgr2=0x7fe9a00c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a00cc6b0 0x7fe9a00c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 -- 172.21.15.17:0/3346784420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c0094d0 con 0x7fe9a0159bd0 2023-08-09T12:40:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5500640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a00b3d60 0x7fe9a014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.228+0000 7fe9a5d01640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a0159bd0 0x7fe9a00ac8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe99800c410 tx=0x7fe99800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.229+0000 7fe99dffb640 1 -- 172.21.15.17:0/3346784420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998011790 con 0x7fe9a0159bd0 2023-08-09T12:40:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.229+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a00c2550 con 0x7fe9a0159bd0 2023-08-09T12:40:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.229+0000 7fe99dffb640 1 -- 172.21.15.17:0/3346784420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9980118f0 con 0x7fe9a0159bd0 2023-08-09T12:40:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.229+0000 7fe99dffb640 1 -- 172.21.15.17:0/3346784420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998011ca0 con 0x7fe9a0159bd0 2023-08-09T12:40:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.229+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a00c5bb0 con 0x7fe9a0159bd0 2023-08-09T12:40:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.230+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a00c2d50 con 0x7fe9a0159bd0 2023-08-09T12:40:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.231+0000 7fe99dffb640 1 -- 172.21.15.17:0/3346784420 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe99801c460 con 0x7fe9a0159bd0 2023-08-09T12:40:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.232+0000 7fe99dffb640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe98406a050 0x7fe98406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.232+0000 7fe99dffb640 1 -- 172.21.15.17:0/3346784420 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9980885d0 con 0x7fe9a0159bd0 2023-08-09T12:40:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.233+0000 7fe9a5500640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe98406a050 0x7fe98406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.233+0000 7fe9a5500640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe98406a050 0x7fe98406c510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe994007330 tx=0x7fe99400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:01.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.236+0000 7fe99dffb640 1 -- 172.21.15.17:0/3346784420 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe9a00c2d50 con 0x7fe9a0159bd0 2023-08-09T12:40:01.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.425+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9a00c2d50 con 0x7fe9a0159bd0 2023-08-09T12:40:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.426+0000 7fe99dffb640 1 -- 172.21.15.17:0/3346784420 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe9a00c2d50 con 0x7fe9a0159bd0 2023-08-09T12:40:01.430 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:01.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe98406a050 msgr2=0x7fe98406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe98406a050 0x7fe98406c510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe994007330 tx=0x7fe99400b040 comp rx=0 tx=0).stop 2023-08-09T12:40:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a0159bd0 msgr2=0x7fe9a00ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a0159bd0 0x7fe9a00ac8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe99800c410 tx=0x7fe99800c8d0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 shutdown_connections 2023-08-09T12:40:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe98406a050 0x7fe98406c510 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a0159bd0 0x7fe9a00ac8b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a00cc6b0 0x7fe9a00c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 --2- 172.21.15.17:0/3346784420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a00b3d60 0x7fe9a014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 >> 172.21.15.17:0/3346784420 conn(0x7fe9a00cb020 msgr2=0x7fe9a00cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 shutdown_connections 2023-08-09T12:40:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.429+0000 7fe9a6502640 1 -- 172.21.15.17:0/3346784420 wait complete. 2023-08-09T12:40:01.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.665+0000 7f4b36625640 1 Processor -- start 2023-08-09T12:40:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.666+0000 7f4b36625640 1 -- start start 2023-08-09T12:40:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.667+0000 7f4b36625640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4b3015ce20 0x7f4b300b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.667+0000 7f4b36625640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b300b0ee0 0x7f4b300cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.667+0000 7f4b36625640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b300cdd70 0x7f4b30160900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.667+0000 7f4b36625640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300ceda0 con 0x7f4b3015ce20 2023-08-09T12:40:01.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.667+0000 7f4b36625640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300ce200 con 0x7f4b300cdd70 2023-08-09T12:40:01.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.667+0000 7f4b36625640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300b1300 con 0x7f4b300b0ee0 2023-08-09T12:40:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b35623640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4b3015ce20 0x7f4b300b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b35623640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4b3015ce20 0x7f4b300b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39360/0 (socket says 172.21.15.17:39360) 2023-08-09T12:40:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b35623640 1 -- 172.21.15.17:0/285823391 learned_addr learned my addr 172.21.15.17:0/285823391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b34e22640 1 --2- 172.21.15.17:0/285823391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b300b0ee0 0x7f4b300cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b35e24640 1 --2- 172.21.15.17:0/285823391 >> v2:172.21.15.142:3300/0 conn(0x7f4b300cdd70 0x7f4b30160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b35623640 1 -- 172.21.15.17:0/285823391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b300b0ee0 msgr2=0x7f4b300cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b35623640 1 --2- 172.21.15.17:0/285823391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b300b0ee0 0x7f4b300cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b35623640 1 -- 172.21.15.17:0/285823391 >> v2:172.21.15.142:3300/0 conn(0x7f4b300cdd70 msgr2=0x7f4b30160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.668+0000 7f4b35623640 1 --2- 172.21.15.17:0/285823391 >> v2:172.21.15.142:3300/0 conn(0x7f4b300cdd70 0x7f4b30160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.669+0000 7f4b35623640 1 -- 172.21.15.17:0/285823391 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3015d200 con 0x7f4b3015ce20 2023-08-09T12:40:01.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.670+0000 7f4b35623640 1 --2- 172.21.15.17:0/285823391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b3015ce20 0x7f4b300b09a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4b3009cf40 tx=0x7f4b2c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f0773fac88a52c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.670+0000 7f4b27fff640 1 -- 172.21.15.17:0/285823391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004230 con 0x7f4b3015ce20 2023-08-09T12:40:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.670+0000 7f4b27fff640 1 -- 172.21.15.17:0/285823391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c004390 con 0x7f4b3015ce20 2023-08-09T12:40:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.670+0000 7f4b27fff640 1 -- 172.21.15.17:0/285823391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c030840 con 0x7f4b3015ce20 2023-08-09T12:40:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 -- 172.21.15.17:0/285823391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b3015ce20 msgr2=0x7f4b300b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 --2- 172.21.15.17:0/285823391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b3015ce20 0x7f4b300b09a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4b3009cf40 tx=0x7f4b2c02b980 comp rx=0 tx=0).stop 2023-08-09T12:40:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 -- 172.21.15.17:0/285823391 shutdown_connections 2023-08-09T12:40:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 --2- 172.21.15.17:0/285823391 >> v2:172.21.15.142:3300/0 conn(0x7f4b300cdd70 0x7f4b30160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 --2- 172.21.15.17:0/285823391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b300b0ee0 0x7f4b300cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 --2- 172.21.15.17:0/285823391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b3015ce20 0x7f4b300b09a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 -- 172.21.15.17:0/285823391 >> 172.21.15.17:0/285823391 conn(0x7f4b300cb9a0 msgr2=0x7f4b300cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:01.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 -- 172.21.15.17:0/285823391 shutdown_connections 2023-08-09T12:40:01.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.671+0000 7f4b36625640 1 -- 172.21.15.17:0/285823391 wait complete. 2023-08-09T12:40:01.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.673+0000 7f4b36625640 1 Processor -- start 2023-08-09T12:40:01.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.673+0000 7f4b36625640 1 -- start start 2023-08-09T12:40:01.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b36625640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b300b0ee0 0x7f4b30159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b36625640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b300cdd70 0x7f4b301f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b36625640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b3015ce20 0x7f4b30149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b36625640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30146e10 con 0x7f4b300cdd70 2023-08-09T12:40:01.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b36625640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3014a090 con 0x7f4b300b0ee0 2023-08-09T12:40:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b36625640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301497f0 con 0x7f4b3015ce20 2023-08-09T12:40:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b34e22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b300cdd70 0x7f4b301f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b34e22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b300cdd70 0x7f4b301f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39370/0 (socket says 172.21.15.17:39370) 2023-08-09T12:40:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.674+0000 7f4b34e22640 1 -- 172.21.15.17:0/1866071919 learned_addr learned my addr 172.21.15.17:0/1866071919 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b35623640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b300b0ee0 0x7f4b30159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b34e22640 1 -- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b3015ce20 msgr2=0x7f4b30149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b35e24640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b3015ce20 0x7f4b30149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b34e22640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b3015ce20 0x7f4b30149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b34e22640 1 -- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b300b0ee0 msgr2=0x7f4b30159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b34e22640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b300b0ee0 0x7f4b30159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b34e22640 1 -- 172.21.15.17:0/1866071919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c009460 con 0x7f4b300cdd70 2023-08-09T12:40:01.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b34e22640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b300cdd70 0x7f4b301f2100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000e890 tx=0x7f4b2000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:01.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b25ffb640 1 -- 172.21.15.17:0/1866071919 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000c940 con 0x7f4b300cdd70 2023-08-09T12:40:01.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b25ffb640 1 -- 172.21.15.17:0/1866071919 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2000caa0 con 0x7f4b300cdd70 2023-08-09T12:40:01.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b25ffb640 1 -- 172.21.15.17:0/1866071919 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000ce30 con 0x7f4b300cdd70 2023-08-09T12:40:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b30149ad0 con 0x7f4b300cdd70 2023-08-09T12:40:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.675+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b301f5d20 con 0x7f4b300cdd70 2023-08-09T12:40:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.677+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b301f5ee0 con 0x7f4b300cdd70 2023-08-09T12:40:01.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.677+0000 7f4b25ffb640 1 -- 172.21.15.17:0/1866071919 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b20013470 con 0x7f4b300cdd70 2023-08-09T12:40:01.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.678+0000 7f4b25ffb640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b1406a050 0x7f4b1406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:01.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.678+0000 7f4b25ffb640 1 -- 172.21.15.17:0/1866071919 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b200887a0 con 0x7f4b300cdd70 2023-08-09T12:40:01.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.679+0000 7f4b35623640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b1406a050 0x7f4b1406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:01.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.680+0000 7f4b35623640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b1406a050 0x7f4b1406c510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c035000 tx=0x7f4b2c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.684+0000 7f4b25ffb640 1 -- 172.21.15.17:0/1866071919 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4b20057880 con 0x7f4b300cdd70 2023-08-09T12:40:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.880+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b3004e390 con 0x7f4b300cdd70 2023-08-09T12:40:01.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.881+0000 7f4b25ffb640 1 -- 172.21.15.17:0/1866071919 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f4b20057410 con 0x7f4b300cdd70 2023-08-09T12:40:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:01.885 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b1406a050 msgr2=0x7f4b1406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b1406a050 0x7f4b1406c510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c035000 tx=0x7f4b2c008030 comp rx=0 tx=0).stop 2023-08-09T12:40:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b300cdd70 msgr2=0x7f4b301f2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b300cdd70 0x7f4b301f2100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000e890 tx=0x7f4b2000ed50 comp rx=0 tx=0).stop 2023-08-09T12:40:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 shutdown_connections 2023-08-09T12:40:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b1406a050 0x7f4b1406c510 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b3015ce20 0x7f4b30149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b300cdd70 0x7f4b301f2100 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 --2- 172.21.15.17:0/1866071919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b300b0ee0 0x7f4b30159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 >> 172.21.15.17:0/1866071919 conn(0x7f4b300cb9a0 msgr2=0x7f4b30070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 shutdown_connections 2023-08-09T12:40:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:01.884+0000 7f4b36625640 1 -- 172.21.15.17:0/1866071919 wait complete. 2023-08-09T12:40:01.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:01.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:02.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.135+0000 7f0e5fc67640 1 Processor -- start 2023-08-09T12:40:02.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.135+0000 7f0e5fc67640 1 -- start start 2023-08-09T12:40:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.137+0000 7f0e5fc67640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580adc40 0x7f0e5806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.137+0000 7f0e5fc67640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580b2250 con 0x7f0e580b3b40 2023-08-09T12:40:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.137+0000 7f0e5fc67640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580b2530 con 0x7f0e580cc630 2023-08-09T12:40:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.137+0000 7f0e5fc67640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580ae020 con 0x7f0e580adc40 2023-08-09T12:40:02.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.137+0000 7f0e5d202640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0e580b3b40 0x7f0e580b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42490/0 (socket says 172.21.15.17:42490) 2023-08-09T12:40:02.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.137+0000 7f0e5d202640 1 -- 172.21.15.17:0/1168327738 learned_addr learned my addr 172.21.15.17:0/1168327738 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:02.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.137+0000 7f0e5da03640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580adc40 0x7f0e5806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320041391 0 0) 0x7f0e580b2250 con 0x7f0e580b3b40 2023-08-09T12:40:02.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44003520 con 0x7f0e580b3b40 2023-08-09T12:40:02.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3749095429 0 0) 0x7f0e44003520 con 0x7f0e580b3b40 2023-08-09T12:40:02.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580adc40 msgr2=0x7f0e5806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:02.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580adc40 0x7f0e5806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 >> v1:172.21.15.142:6789/0 conn(0x7f0e580cc630 legacy=0x7f0e580ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5806fe80 con 0x7f0e580b3b40 2023-08-09T12:40:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0e480017f0 con 0x7f0e580b3b40 2023-08-09T12:40:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 >> v1:172.21.15.17:6789/0 conn(0x7f0e580b3b40 legacy=0x7f0e580b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580adc40 0x7f0e440039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e44003f20 0x7f0e440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580ae020 con 0x7f0e44004d00 2023-08-09T12:40:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4400ba60 con 0x7f0e44003f20 2023-08-09T12:40:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.138+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4400bc20 con 0x7f0e580adc40 2023-08-09T12:40:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.139+0000 7f0e5e204640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.139+0000 7f0e5d202640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e44003f20 0x7f0e440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.139+0000 7f0e5da03640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580adc40 0x7f0e440039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.139+0000 7f0e5e204640 1 -- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580adc40 msgr2=0x7f0e440039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.139+0000 7f0e5e204640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580adc40 0x7f0e440039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.139+0000 7f0e5e204640 1 -- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e44003f20 msgr2=0x7f0e440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.139+0000 7f0e5e204640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e44003f20 0x7f0e440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.139+0000 7f0e5e204640 1 -- 172.21.15.17:0/1168327738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44003520 con 0x7f0e44004d00 2023-08-09T12:40:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.140+0000 7f0e5e204640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e44005180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0e50001e50 tx=0x7f0e440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934d6718b023b938 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.141+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50003b70 con 0x7f0e44004d00 2023-08-09T12:40:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.141+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50003cd0 con 0x7f0e44004d00 2023-08-09T12:40:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.141+0000 7f0e5ca01640 1 -- 172.21.15.17:0/1168327738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50005310 con 0x7f0e44004d00 2023-08-09T12:40:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.141+0000 7f0e5fc67640 1 -- 172.21.15.17:0/1168327738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 msgr2=0x7f0e44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.141+0000 7f0e5fc67640 1 --2- 172.21.15.17:0/1168327738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e44005180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0e50001e50 tx=0x7f0e440057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.141+0000 7f0e5e204640 1 -- 172.21.15.17:0/1168327738 reap_dead start 2023-08-09T12:40:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.142+0000 7f0e5fc67640 1 -- 172.21.15.17:0/1168327738 shutdown_connections 2023-08-09T12:40:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.142+0000 7f0e5fc67640 1 -- 172.21.15.17:0/1168327738 >> 172.21.15.17:0/1168327738 conn(0x7f0e580cb1b0 msgr2=0x7f0e580cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.142+0000 7f0e5fc67640 1 -- 172.21.15.17:0/1168327738 shutdown_connections 2023-08-09T12:40:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.142+0000 7f0e5fc67640 1 -- 172.21.15.17:0/1168327738 wait complete. 2023-08-09T12:40:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.143+0000 7f0e5fc67640 1 Processor -- start 2023-08-09T12:40:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.144+0000 7f0e5fc67640 1 -- start start 2023-08-09T12:40:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5fc67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e580c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5fc67640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e5814ebf0 0x7f0e580acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5fc67640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e5814b4e0 0x7f0e5814b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5fc67640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581f2310 con 0x7f0e44004d00 2023-08-09T12:40:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5fc67640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5814bea0 con 0x7f0e5814b4e0 2023-08-09T12:40:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5fc67640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5814c130 con 0x7f0e5814ebf0 2023-08-09T12:40:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5da03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e580c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5da03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e580c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39388/0 (socket says 172.21.15.17:39388) 2023-08-09T12:40:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5da03640 1 -- 172.21.15.17:0/2984301605 learned_addr learned my addr 172.21.15.17:0/2984301605 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5da03640 1 -- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e5814ebf0 msgr2=0x7f0e580acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5da03640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e5814ebf0 0x7f0e580acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5da03640 1 -- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e5814b4e0 msgr2=0x7f0e5814b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5da03640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e5814b4e0 0x7f0e5814b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.145+0000 7f0e5da03640 1 -- 172.21.15.17:0/2984301605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5814c9d0 con 0x7f0e44004d00 2023-08-09T12:40:02.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.146+0000 7f0e5da03640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e580c67c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0e54011630 tx=0x7f0e54011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:02.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.146+0000 7f0e4e7fc640 1 -- 172.21.15.17:0/2984301605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54015870 con 0x7f0e44004d00 2023-08-09T12:40:02.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.146+0000 7f0e4e7fc640 1 -- 172.21.15.17:0/2984301605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e540159d0 con 0x7f0e44004d00 2023-08-09T12:40:02.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.146+0000 7f0e4e7fc640 1 -- 172.21.15.17:0/2984301605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54015d40 con 0x7f0e44004d00 2023-08-09T12:40:02.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.146+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e580c6e60 con 0x7f0e44004d00 2023-08-09T12:40:02.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.146+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5814c660 con 0x7f0e44004d00 2023-08-09T12:40:02.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.147+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e58067a80 con 0x7f0e44004d00 2023-08-09T12:40:02.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.148+0000 7f0e4e7fc640 1 -- 172.21.15.17:0/2984301605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e5400f490 con 0x7f0e44004d00 2023-08-09T12:40:02.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.149+0000 7f0e4e7fc640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e3c06a050 0x7f0e3c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.150+0000 7f0e4e7fc640 1 -- 172.21.15.17:0/2984301605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e54088ac0 con 0x7f0e44004d00 2023-08-09T12:40:02.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.150+0000 7f0e5d202640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e3c06a050 0x7f0e3c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.151+0000 7f0e5d202640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e3c06a050 0x7f0e3c06c510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e48000ef0 tx=0x7f0e48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:02.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.154+0000 7f0e4e7fc640 1 -- 172.21.15.17:0/2984301605 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0e54057ba0 con 0x7f0e44004d00 2023-08-09T12:40:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.345+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e5806ed40 con 0x7f0e44004d00 2023-08-09T12:40:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.346+0000 7f0e4e7fc640 1 -- 172.21.15.17:0/2984301605 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e54057730 con 0x7f0e44004d00 2023-08-09T12:40:02.350 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:02.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e3c06a050 msgr2=0x7f0e3c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e3c06a050 0x7f0e3c06c510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e48000ef0 tx=0x7f0e48009040 comp rx=0 tx=0).stop 2023-08-09T12:40:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 msgr2=0x7f0e580c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e580c67c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0e54011630 tx=0x7f0e54011af0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 shutdown_connections 2023-08-09T12:40:02.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e3c06a050 0x7f0e3c06c510 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e5814b4e0 0x7f0e5814b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e5814ebf0 0x7f0e580acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 --2- 172.21.15.17:0/2984301605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44004d00 0x7f0e580c67c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.349+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 >> 172.21.15.17:0/2984301605 conn(0x7f0e580cb1b0 msgr2=0x7f0e5806a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:02.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.350+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 shutdown_connections 2023-08-09T12:40:02.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.350+0000 7f0e5fc67640 1 -- 172.21.15.17:0/2984301605 wait complete. 2023-08-09T12:40:02.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.600+0000 7f01a7fff640 1 Processor -- start 2023-08-09T12:40:02.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.600+0000 7f01a7fff640 1 -- start start 2023-08-09T12:40:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.602+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a8159bd0 0x7f01a80c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.602+0000 7f01a7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01a80b3d60 0x7f01a80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.602+0000 7f01a7fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80b2b90 con 0x7f01a80cc6b0 2023-08-09T12:40:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.602+0000 7f01a7fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80cabb0 con 0x7f01a80b3d60 2023-08-09T12:40:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.602+0000 7f01a7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80b2580 con 0x7f01a8159bd0 2023-08-09T12:40:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.602+0000 7f01a77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f01a80cc6b0 0x7f01a80b3020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42496/0 (socket says 172.21.15.17:42496) 2023-08-09T12:40:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.602+0000 7f01a77fe640 1 -- 172.21.15.17:0/3694563868 learned_addr learned my addr 172.21.15.17:0/3694563868 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a6ffd640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a8159bd0 0x7f01a80c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a67fc640 1 --2- 172.21.15.17:0/3694563868 >> v2:172.21.15.142:3300/0 conn(0x7f01a80b3d60 0x7f01a80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109821122 0 0) 0x7f01a80b2b90 con 0x7f01a80cc6b0 2023-08-09T12:40:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0190005730 con 0x7f01a80cc6b0 2023-08-09T12:40:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821520051 0 0) 0x7f0190005730 con 0x7f01a80cc6b0 2023-08-09T12:40:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a8159bd0 msgr2=0x7f01a80c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a8159bd0 0x7f01a80c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 >> v2:172.21.15.142:3300/0 conn(0x7f01a80b3d60 msgr2=0x7f01a80cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 --2- 172.21.15.17:0/3694563868 >> v2:172.21.15.142:3300/0 conn(0x7f01a80b3d60 0x7f01a80cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80ca350 con 0x7f01a80cc6b0 2023-08-09T12:40:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f01a00019f0 con 0x7f01a80cc6b0 2023-08-09T12:40:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 >> v1:172.21.15.17:6789/0 conn(0x7f01a80cc6b0 legacy=0x7f01a80b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0190005b80 0x7f0190005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01900069d0 0x7f0190006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a8159bd0 0x7f0190007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80cabb0 con 0x7f0190005b80 2023-08-09T12:40:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80b2580 con 0x7f01900069d0 2023-08-09T12:40:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.603+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019000db90 con 0x7f01a8159bd0 2023-08-09T12:40:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a6ffd640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0190005b80 0x7f0190005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a77fe640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a8159bd0 0x7f0190007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a67fc640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01900069d0 0x7f0190006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a6ffd640 1 -- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a8159bd0 msgr2=0x7f0190007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:02.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a6ffd640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01a8159bd0 0x7f0190007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a6ffd640 1 -- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01900069d0 msgr2=0x7f0190006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:02.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a6ffd640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01900069d0 0x7f0190006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a6ffd640 1 -- 172.21.15.17:0/3694563868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190005730 con 0x7f0190005b80 2023-08-09T12:40:02.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.604+0000 7f01a67fc640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01900069d0 0x7f0190006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:02.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.606+0000 7f01a6ffd640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0190005b80 0x7f0190005fa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0198009ac0 tx=0x7f0190007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e925e821cc60eb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:02.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.606+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019802c6b0 con 0x7f0190005b80 2023-08-09T12:40:02.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.606+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019802c810 con 0x7f0190005b80 2023-08-09T12:40:02.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.606+0000 7f01a5ffb640 1 -- 172.21.15.17:0/3694563868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019802cba0 con 0x7f0190005b80 2023-08-09T12:40:02.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.607+0000 7f01a7fff640 1 -- 172.21.15.17:0/3694563868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0190005b80 msgr2=0x7f0190005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.607+0000 7f01a7fff640 1 --2- 172.21.15.17:0/3694563868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0190005b80 0x7f0190005fa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0198009ac0 tx=0x7f0190007a00 comp rx=0 tx=0).stop 2023-08-09T12:40:02.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.607+0000 7f01a77fe640 1 -- 172.21.15.17:0/3694563868 reap_dead start 2023-08-09T12:40:02.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.607+0000 7f01a7fff640 1 -- 172.21.15.17:0/3694563868 shutdown_connections 2023-08-09T12:40:02.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.607+0000 7f01a7fff640 1 -- 172.21.15.17:0/3694563868 >> 172.21.15.17:0/3694563868 conn(0x7f01a80cb020 msgr2=0x7f01a80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:02.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.607+0000 7f01a7fff640 1 -- 172.21.15.17:0/3694563868 shutdown_connections 2023-08-09T12:40:02.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.607+0000 7f01a7fff640 1 -- 172.21.15.17:0/3694563868 wait complete. 2023-08-09T12:40:02.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.609+0000 7f01a7fff640 1 Processor -- start 2023-08-09T12:40:02.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.609+0000 7f01a7fff640 1 -- start start 2023-08-09T12:40:02.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.610+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0190005b80 0x7f01a8153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.610+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a80c8bd0 0x7f01a80c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.610+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a80c6df0 0x7f01a80c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.610+0000 7f01a7fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8154370 con 0x7f01a80c6df0 2023-08-09T12:40:02.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.610+0000 7f01a7fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c9570 con 0x7f01a80c8bd0 2023-08-09T12:40:02.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.610+0000 7f01a7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c7b20 con 0x7f0190005b80 2023-08-09T12:40:02.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a80c6df0 0x7f01a80c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a80c6df0 0x7f01a80c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39410/0 (socket says 172.21.15.17:39410) 2023-08-09T12:40:02.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 -- 172.21.15.17:0/3400437814 learned_addr learned my addr 172.21.15.17:0/3400437814 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:02.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a6ffd640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0190005b80 0x7f01a8153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a67fc640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a80c8bd0 0x7f01a80c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 -- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0190005b80 msgr2=0x7f01a8153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0190005b80 0x7f01a8153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 -- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a80c8bd0 msgr2=0x7f01a80c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a80c8bd0 0x7f01a80c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 -- 172.21.15.17:0/3400437814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80c7e00 con 0x7f01a80c6df0 2023-08-09T12:40:02.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.611+0000 7f01a77fe640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a80c6df0 0x7f01a80c7270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f01a0000f80 tx=0x7f01a0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:02.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.612+0000 7f018f7fe640 1 -- 172.21.15.17:0/3400437814 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0017070 con 0x7f01a80c6df0 2023-08-09T12:40:02.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.612+0000 7f018f7fe640 1 -- 172.21.15.17:0/3400437814 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000eb00 con 0x7f01a80c6df0 2023-08-09T12:40:02.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.612+0000 7f018f7fe640 1 -- 172.21.15.17:0/3400437814 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000ecb0 con 0x7f01a80c6df0 2023-08-09T12:40:02.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.612+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a80c80e0 con 0x7f01a80c6df0 2023-08-09T12:40:02.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.612+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a8159fb0 con 0x7f01a80c6df0 2023-08-09T12:40:02.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.613+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a804e390 con 0x7f01a80c6df0 2023-08-09T12:40:02.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.614+0000 7f018f7fe640 1 -- 172.21.15.17:0/3400437814 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f01a0013420 con 0x7f01a80c6df0 2023-08-09T12:40:02.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.615+0000 7f018f7fe640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f019406a080 0x7f019406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:02.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.615+0000 7f018f7fe640 1 -- 172.21.15.17:0/3400437814 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01a00880d0 con 0x7f01a80c6df0 2023-08-09T12:40:02.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.616+0000 7f01a6ffd640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f019406a080 0x7f019406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:02.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.617+0000 7f01a6ffd640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f019406a080 0x7f019406c540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0198036000 tx=0x7f0198030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:02.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.619+0000 7f018f7fe640 1 -- 172.21.15.17:0/3400437814 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f01a0053720 con 0x7f01a80c6df0 2023-08-09T12:40:02.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.809+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f01a80cb720 con 0x7f01a80c6df0 2023-08-09T12:40:02.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.810+0000 7f018f7fe640 1 -- 172.21.15.17:0/3400437814 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f01a0056d40 con 0x7f01a80c6df0 2023-08-09T12:40:02.813 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.812+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f019406a080 msgr2=0x7f019406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.812+0000 7f01a7fff640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f019406a080 0x7f019406c540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0198036000 tx=0x7f0198030000 comp rx=0 tx=0).stop 2023-08-09T12:40:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.812+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a80c6df0 msgr2=0x7f01a80c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.812+0000 7f01a7fff640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a80c6df0 0x7f01a80c7270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f01a0000f80 tx=0x7f01a0007bc0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.813+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 shutdown_connections 2023-08-09T12:40:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.813+0000 7f01a7fff640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f019406a080 0x7f019406c540 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.813+0000 7f01a7fff640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a80c6df0 0x7f01a80c7270 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.813+0000 7f01a7fff640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01a80c8bd0 0x7f01a80c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.813+0000 7f01a7fff640 1 --2- 172.21.15.17:0/3400437814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0190005b80 0x7f01a8153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.813+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 >> 172.21.15.17:0/3400437814 conn(0x7f01a80cb020 msgr2=0x7f01a80b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.813+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 shutdown_connections 2023-08-09T12:40:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:02.813+0000 7f01a7fff640 1 -- 172.21.15.17:0/3400437814 wait complete. 2023-08-09T12:40:02.833 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:03.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.057+0000 7f838482d640 1 Processor -- start 2023-08-09T12:40:03.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.058+0000 7f838482d640 1 -- start start 2023-08-09T12:40:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.059+0000 7f838482d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f83800ce9e0 0x7f83800cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.059+0000 7f838482d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83800cf380 con 0x7f8380158840 2023-08-09T12:40:03.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.059+0000 7f838482d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83800b0220 con 0x7f838015b160 2023-08-09T12:40:03.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.059+0000 7f838482d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8380158c20 con 0x7f83800ce9e0 2023-08-09T12:40:03.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.060+0000 7f837dd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f83800ce9e0 0x7f83800cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.060+0000 7f837e59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8380158840 0x7f83800af7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42504/0 (socket says 172.21.15.17:42504) 2023-08-09T12:40:03.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.060+0000 7f837e59c640 1 -- 172.21.15.17:0/2010807436 learned_addr learned my addr 172.21.15.17:0/2010807436 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:03.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.060+0000 7f837dd9b640 1 -- 172.21.15.17:0/2010807436 >> v1:172.21.15.142:6789/0 conn(0x7f838015b160 legacy=0x7f838015b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:03.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.060+0000 7f837dd9b640 1 -- 172.21.15.17:0/2010807436 >> v1:172.21.15.17:6789/0 conn(0x7f8380158840 legacy=0x7f83800af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.060+0000 7f837dd9b640 1 -- 172.21.15.17:0/2010807436 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838015e7f0 con 0x7f83800ce9e0 2023-08-09T12:40:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.061+0000 7f837dd9b640 1 --2- 172.21.15.17:0/2010807436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83800ce9e0 0x7f83800cee40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f83740097a0 tx=0x7f837402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2306882e7b3faa server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.062+0000 7f837d59a640 1 -- 172.21.15.17:0/2010807436 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374031830 con 0x7f83800ce9e0 2023-08-09T12:40:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.062+0000 7f837d59a640 1 -- 172.21.15.17:0/2010807436 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374031990 con 0x7f83800ce9e0 2023-08-09T12:40:03.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.062+0000 7f837d59a640 1 -- 172.21.15.17:0/2010807436 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374031d20 con 0x7f83800ce9e0 2023-08-09T12:40:03.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.062+0000 7f838482d640 1 -- 172.21.15.17:0/2010807436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83800ce9e0 msgr2=0x7f83800cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.062+0000 7f838482d640 1 --2- 172.21.15.17:0/2010807436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83800ce9e0 0x7f83800cee40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f83740097a0 tx=0x7f837402b8d0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.063+0000 7f838482d640 1 -- 172.21.15.17:0/2010807436 shutdown_connections 2023-08-09T12:40:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.063+0000 7f838482d640 1 --2- 172.21.15.17:0/2010807436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83800ce9e0 0x7f83800cee40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.063+0000 7f838482d640 1 -- 172.21.15.17:0/2010807436 >> 172.21.15.17:0/2010807436 conn(0x7f8380069be0 msgr2=0x7f8380069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.063+0000 7f838482d640 1 -- 172.21.15.17:0/2010807436 shutdown_connections 2023-08-09T12:40:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.063+0000 7f838482d640 1 -- 172.21.15.17:0/2010807436 wait complete. 2023-08-09T12:40:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.064+0000 7f838482d640 1 Processor -- start 2023-08-09T12:40:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.065+0000 7f838482d640 1 -- start start 2023-08-09T12:40:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.065+0000 7f838482d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83800ce9e0 0x7f8380141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.065+0000 7f838482d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8380158840 0x7f83800c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.065+0000 7f838482d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838015b160 0x7f838015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.065+0000 7f838482d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838015c6e0 con 0x7f838015b160 2023-08-09T12:40:03.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.065+0000 7f838482d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838015c400 con 0x7f83800ce9e0 2023-08-09T12:40:03.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.065+0000 7f838482d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83800cc330 con 0x7f8380158840 2023-08-09T12:40:03.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838015b160 0x7f838015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838015b160 0x7f838015ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39438/0 (socket says 172.21.15.17:39438) 2023-08-09T12:40:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837ed9d640 1 -- 172.21.15.17:0/4235855977 learned_addr learned my addr 172.21.15.17:0/4235855977 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837e59c640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83800ce9e0 0x7f8380141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837ed9d640 1 -- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8380158840 msgr2=0x7f83800c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837ed9d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8380158840 0x7f83800c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837ed9d640 1 -- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83800ce9e0 msgr2=0x7f8380141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837ed9d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83800ce9e0 0x7f8380141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.066+0000 7f837ed9d640 1 -- 172.21.15.17:0/4235855977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009400 con 0x7f838015b160 2023-08-09T12:40:03.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.067+0000 7f837ed9d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838015b160 0x7f838015ca20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f837800b970 tx=0x7f837800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.067+0000 7f836effd640 1 -- 172.21.15.17:0/4235855977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837800cb40 con 0x7f838015b160 2023-08-09T12:40:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.067+0000 7f836effd640 1 -- 172.21.15.17:0/4235855977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837800cca0 con 0x7f838015b160 2023-08-09T12:40:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.067+0000 7f836effd640 1 -- 172.21.15.17:0/4235855977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378014680 con 0x7f838015b160 2023-08-09T12:40:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.067+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83800cc610 con 0x7f838015b160 2023-08-09T12:40:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.067+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838015cf60 con 0x7f838015b160 2023-08-09T12:40:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.068+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83800ccb30 con 0x7f838015b160 2023-08-09T12:40:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.069+0000 7f836effd640 1 -- 172.21.15.17:0/4235855977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f837801d3b0 con 0x7f838015b160 2023-08-09T12:40:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.070+0000 7f836effd640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f836006a050 0x7f836006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.071+0000 7f836effd640 1 -- 172.21.15.17:0/4235855977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83780883a0 con 0x7f838015b160 2023-08-09T12:40:03.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.071+0000 7f837e59c640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f836006a050 0x7f836006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.072+0000 7f837e59c640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f836006a050 0x7f836006c510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8370005880 tx=0x7f8370009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.075+0000 7f836effd640 1 -- 172.21.15.17:0/4235855977 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f83800ccb30 con 0x7f838015b160 2023-08-09T12:40:03.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.269+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83800ccb30 con 0x7f838015b160 2023-08-09T12:40:03.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.270+0000 7f836effd640 1 -- 172.21.15.17:0/4235855977 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83800ccb30 con 0x7f838015b160 2023-08-09T12:40:03.273 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:03.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f836006a050 msgr2=0x7f836006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f836006a050 0x7f836006c510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8370005880 tx=0x7f8370009040 comp rx=0 tx=0).stop 2023-08-09T12:40:03.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838015b160 msgr2=0x7f838015ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838015b160 0x7f838015ca20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f837800b970 tx=0x7f837800be30 comp rx=0 tx=0).stop 2023-08-09T12:40:03.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 shutdown_connections 2023-08-09T12:40:03.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f836006a050 0x7f836006c510 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838015b160 0x7f838015ca20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8380158840 0x7f83800c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 --2- 172.21.15.17:0/4235855977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83800ce9e0 0x7f8380141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 >> 172.21.15.17:0/4235855977 conn(0x7f8380069be0 msgr2=0x7f838006ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:03.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 shutdown_connections 2023-08-09T12:40:03.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.272+0000 7f838482d640 1 -- 172.21.15.17:0/4235855977 wait complete. 2023-08-09T12:40:03.294 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:03.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.522+0000 7fc8e8f79640 1 Processor -- start 2023-08-09T12:40:03.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.522+0000 7fc8e8f79640 1 -- start start 2023-08-09T12:40:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.523+0000 7fc8e8f79640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8e40b38a0 0x7fc8e40cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.523+0000 7fc8e8f79640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e40cc660 con 0x7fc8e415add0 2023-08-09T12:40:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.523+0000 7fc8e8f79640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e40cc940 con 0x7fc8e40717e0 2023-08-09T12:40:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.524+0000 7fc8e8f79640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e40ccc20 con 0x7fc8e40b38a0 2023-08-09T12:40:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.524+0000 7fc8e259c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc8e415add0 0x7fc8e40b6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42514/0 (socket says 172.21.15.17:42514) 2023-08-09T12:40:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.524+0000 7fc8e259c640 1 -- 172.21.15.17:0/2867238898 learned_addr learned my addr 172.21.15.17:0/2867238898 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.524+0000 7fc8e1d9b640 1 --2- 172.21.15.17:0/2867238898 >> v2:172.21.15.142:3300/0 conn(0x7fc8e40b38a0 0x7fc8e40cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.524+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750676383 0 0) 0x7fc8e40cc660 con 0x7fc8e415add0 2023-08-09T12:40:03.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.524+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8cc003520 con 0x7fc8e415add0 2023-08-09T12:40:03.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1346123626 0 0) 0x7fc8cc003520 con 0x7fc8e415add0 2023-08-09T12:40:03.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 >> v2:172.21.15.142:3300/0 conn(0x7fc8e40b38a0 msgr2=0x7fc8e40cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:03.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 --2- 172.21.15.17:0/2867238898 >> v2:172.21.15.142:3300/0 conn(0x7fc8e40b38a0 0x7fc8e40cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 >> v1:172.21.15.142:6789/0 conn(0x7fc8e40717e0 legacy=0x7fc8e40cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e40ccf00 con 0x7fc8e415add0 2023-08-09T12:40:03.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc8d4001670 con 0x7fc8e415add0 2023-08-09T12:40:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 >> v1:172.21.15.17:6789/0 conn(0x7fc8e415add0 legacy=0x7fc8e40b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8cc003970 0x7fc8cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8cc0047c0 0x7fc8cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e40ccc20 con 0x7fc8cc0052a0 2023-08-09T12:40:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc00c170 con 0x7fc8cc0047c0 2023-08-09T12:40:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc00c330 con 0x7fc8cc003970 2023-08-09T12:40:03.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.525+0000 7fc8e2d9d640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.526+0000 7fc8e1d9b640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8cc0047c0 0x7fc8cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.526+0000 7fc8e259c640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8cc003970 0x7fc8cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.526+0000 7fc8e2d9d640 1 -- 172.21.15.17:0/2867238898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8cc003970 msgr2=0x7fc8cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.526+0000 7fc8e2d9d640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8cc003970 0x7fc8cc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.526+0000 7fc8e2d9d640 1 -- 172.21.15.17:0/2867238898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8cc0047c0 msgr2=0x7fc8cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.526+0000 7fc8e2d9d640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8cc0047c0 0x7fc8cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.526+0000 7fc8e2d9d640 1 -- 172.21.15.17:0/2867238898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc003520 con 0x7fc8cc0052a0 2023-08-09T12:40:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.527+0000 7fc8e2d9d640 1 -- 172.21.15.17:0/2867238898 reap_dead start 2023-08-09T12:40:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.527+0000 7fc8e2d9d640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8cc00b980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc001e20 tx=0x7fc8cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a647de4e578ae44c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.527+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc003b70 con 0x7fc8cc0052a0 2023-08-09T12:40:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.527+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc003cd0 con 0x7fc8cc0052a0 2023-08-09T12:40:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.527+0000 7fc8e159a640 1 -- 172.21.15.17:0/2867238898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc005310 con 0x7fc8cc0052a0 2023-08-09T12:40:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.528+0000 7fc8e8f79640 1 -- 172.21.15.17:0/2867238898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 msgr2=0x7fc8cc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.528+0000 7fc8e8f79640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8cc00b980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc001e20 tx=0x7fc8cc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.528+0000 7fc8e8f79640 1 -- 172.21.15.17:0/2867238898 shutdown_connections 2023-08-09T12:40:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.528+0000 7fc8e8f79640 1 --2- 172.21.15.17:0/2867238898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8cc00b980 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.528+0000 7fc8e8f79640 1 -- 172.21.15.17:0/2867238898 >> 172.21.15.17:0/2867238898 conn(0x7fc8e406b9d0 msgr2=0x7fc8e406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.528+0000 7fc8e8f79640 1 -- 172.21.15.17:0/2867238898 shutdown_connections 2023-08-09T12:40:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.528+0000 7fc8e8f79640 1 -- 172.21.15.17:0/2867238898 wait complete. 2023-08-09T12:40:03.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.530+0000 7fc8e8f79640 1 Processor -- start 2023-08-09T12:40:03.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.530+0000 7fc8e8f79640 1 -- start start 2023-08-09T12:40:03.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e8f79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8e40b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e8f79640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8e41f2340 0x7fc8e40ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e8f79640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8e414bc00 0x7fc8e40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e8f79640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e41f5910 con 0x7fc8cc0052a0 2023-08-09T12:40:03.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e8f79640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e40b53a0 con 0x7fc8e41f2340 2023-08-09T12:40:03.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e8f79640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e40ad380 con 0x7fc8e414bc00 2023-08-09T12:40:03.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8e40b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8e40b4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39456/0 (socket says 172.21.15.17:39456) 2023-08-09T12:40:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.531+0000 7fc8e259c640 1 -- 172.21.15.17:0/1669386769 learned_addr learned my addr 172.21.15.17:0/1669386769 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e1d9b640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8e41f2340 0x7fc8e40ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e2d9d640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8e414bc00 0x7fc8e40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e259c640 1 -- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8e414bc00 msgr2=0x7fc8e40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e259c640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8e414bc00 0x7fc8e40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e259c640 1 -- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8e41f2340 msgr2=0x7fc8e40ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e259c640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8e41f2340 0x7fc8e40ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e259c640 1 -- 172.21.15.17:0/1669386769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e41f2840 con 0x7fc8cc0052a0 2023-08-09T12:40:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e2d9d640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8e414bc00 0x7fc8e40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.532+0000 7fc8e259c640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8e40b4590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400d7a0 tx=0x7fc8d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.533+0000 7fc8d2ffd640 1 -- 172.21.15.17:0/1669386769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d40074e0 con 0x7fc8cc0052a0 2023-08-09T12:40:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.533+0000 7fc8d2ffd640 1 -- 172.21.15.17:0/1669386769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4007640 con 0x7fc8cc0052a0 2023-08-09T12:40:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.533+0000 7fc8d2ffd640 1 -- 172.21.15.17:0/1669386769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4004a20 con 0x7fc8cc0052a0 2023-08-09T12:40:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.533+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e41f2b20 con 0x7fc8cc0052a0 2023-08-09T12:40:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.533+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e41f30e0 con 0x7fc8cc0052a0 2023-08-09T12:40:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.534+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e41f5a80 con 0x7fc8cc0052a0 2023-08-09T12:40:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.535+0000 7fc8d2ffd640 1 -- 172.21.15.17:0/1669386769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc8d4004b80 con 0x7fc8cc0052a0 2023-08-09T12:40:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.536+0000 7fc8d2ffd640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc8c406a080 0x7fc8c406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.536+0000 7fc8d2ffd640 1 -- 172.21.15.17:0/1669386769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8d4087db0 con 0x7fc8cc0052a0 2023-08-09T12:40:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.537+0000 7fc8e1d9b640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc8c406a080 0x7fc8c406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.538+0000 7fc8e1d9b640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc8c406a080 0x7fc8c406c540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40d0290 tx=0x7fc8d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.541+0000 7fc8d2ffd640 1 -- 172.21.15.17:0/1669386769 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc8d408c070 con 0x7fc8cc0052a0 2023-08-09T12:40:03.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.728+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8e4067a80 con 0x7fc8cc0052a0 2023-08-09T12:40:03.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.729+0000 7fc8d2ffd640 1 -- 172.21.15.17:0/1669386769 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8d4019020 con 0x7fc8cc0052a0 2023-08-09T12:40:03.732 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:03.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc8c406a080 msgr2=0x7fc8c406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc8c406a080 0x7fc8c406c540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40d0290 tx=0x7fc8d8008040 comp rx=0 tx=0).stop 2023-08-09T12:40:03.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 msgr2=0x7fc8e40b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8e40b4590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400d7a0 tx=0x7fc8d400dc60 comp rx=0 tx=0).stop 2023-08-09T12:40:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 shutdown_connections 2023-08-09T12:40:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc8c406a080 0x7fc8c406c540 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8e414bc00 0x7fc8e40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8e41f2340 0x7fc8e40ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 --2- 172.21.15.17:0/1669386769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0052a0 0x7fc8e40b4590 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 >> 172.21.15.17:0/1669386769 conn(0x7fc8e406b9d0 msgr2=0x7fc8e4159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 shutdown_connections 2023-08-09T12:40:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.732+0000 7fc8e8f79640 1 -- 172.21.15.17:0/1669386769 wait complete. 2023-08-09T12:40:03.755 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.970+0000 7f5c19fe8640 1 Processor -- start 2023-08-09T12:40:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.971+0000 7f5c19fe8640 1 -- start start 2023-08-09T12:40:03.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.972+0000 7f5c19fe8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5c1415ce90 0x7f5c141616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.972+0000 7f5c19fe8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c140b6000 0x7f5c140cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.972+0000 7f5c19fe8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c140b6460 con 0x7f5c140d29d0 2023-08-09T12:40:03.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.972+0000 7f5c19fe8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c140cda40 con 0x7f5c1415ce90 2023-08-09T12:40:03.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.972+0000 7f5c19fe8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140cdd10 con 0x7f5c140b6000 2023-08-09T12:40:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.973+0000 7f5c137fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5c1415ce90 0x7f5c141616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.973+0000 7f5c137fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5c1415ce90 0x7f5c141616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39472/0 (socket says 172.21.15.17:39472) 2023-08-09T12:40:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.973+0000 7f5c137fe640 1 -- 172.21.15.17:0/3283927534 learned_addr learned my addr 172.21.15.17:0/3283927534 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.973+0000 7f5c137fe640 1 -- 172.21.15.17:0/3283927534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c140b6000 msgr2=0x7f5c140cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.973+0000 7f5c137fe640 1 --2- 172.21.15.17:0/3283927534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c140b6000 0x7f5c140cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.973+0000 7f5c137fe640 1 -- 172.21.15.17:0/3283927534 >> v1:172.21.15.142:6789/0 conn(0x7f5c140d29d0 legacy=0x7f5c140d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.973+0000 7f5c137fe640 1 -- 172.21.15.17:0/3283927534 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c140cdff0 con 0x7f5c1415ce90 2023-08-09T12:40:03.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.974+0000 7f5c137fe640 1 --2- 172.21.15.17:0/3283927534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1415ce90 0x7f5c141616e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009870 tx=0x7f5c0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f866221910fc7728 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.974+0000 7f5c127fc640 1 -- 172.21.15.17:0/3283927534 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04031640 con 0x7f5c1415ce90 2023-08-09T12:40:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c127fc640 1 -- 172.21.15.17:0/3283927534 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c040317a0 con 0x7f5c1415ce90 2023-08-09T12:40:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c127fc640 1 -- 172.21.15.17:0/3283927534 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04031b30 con 0x7f5c1415ce90 2023-08-09T12:40:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c19fe8640 1 -- 172.21.15.17:0/3283927534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1415ce90 msgr2=0x7f5c141616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/3283927534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1415ce90 0x7f5c141616e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009870 tx=0x7f5c0402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c19fe8640 1 -- 172.21.15.17:0/3283927534 shutdown_connections 2023-08-09T12:40:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/3283927534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c140b6000 0x7f5c140cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/3283927534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1415ce90 0x7f5c141616e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c19fe8640 1 -- 172.21.15.17:0/3283927534 >> 172.21.15.17:0/3283927534 conn(0x7f5c1406fde0 msgr2=0x7f5c140701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c19fe8640 1 -- 172.21.15.17:0/3283927534 shutdown_connections 2023-08-09T12:40:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.975+0000 7f5c19fe8640 1 -- 172.21.15.17:0/3283927534 wait complete. 2023-08-09T12:40:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.977+0000 7f5c19fe8640 1 Processor -- start 2023-08-09T12:40:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.977+0000 7f5c19fe8640 1 -- start start 2023-08-09T12:40:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.978+0000 7f5c19fe8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c140b6000 0x7f5c14154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.978+0000 7f5c19fe8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c140d29d0 0x7f5c1415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.978+0000 7f5c19fe8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1415ce90 0x7f5c1415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.978+0000 7f5c19fe8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1415d270 con 0x7f5c140d29d0 2023-08-09T12:40:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.978+0000 7f5c19fe8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1415d550 con 0x7f5c140b6000 2023-08-09T12:40:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.978+0000 7f5c19fe8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140cc210 con 0x7f5c1415ce90 2023-08-09T12:40:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.978+0000 7f5c12ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c140d29d0 0x7f5c1415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c12ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c140d29d0 0x7f5c1415b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39478/0 (socket says 172.21.15.17:39478) 2023-08-09T12:40:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c12ffd640 1 -- 172.21.15.17:0/2895599003 learned_addr learned my addr 172.21.15.17:0/2895599003 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c12ffd640 1 -- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1415ce90 msgr2=0x7f5c1415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c12ffd640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1415ce90 0x7f5c1415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c12ffd640 1 -- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c140b6000 msgr2=0x7f5c14154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c137fe640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c140b6000 0x7f5c14154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c12ffd640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c140b6000 0x7f5c14154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c12ffd640 1 -- 172.21.15.17:0/2895599003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c040094d0 con 0x7f5c140d29d0 2023-08-09T12:40:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.979+0000 7f5c12ffd640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c140d29d0 0x7f5c1415b130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800b4d0 tx=0x7f5c0800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.980+0000 7f5bfbfff640 1 -- 172.21.15.17:0/2895599003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08010870 con 0x7f5c140d29d0 2023-08-09T12:40:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.980+0000 7f5bfbfff640 1 -- 172.21.15.17:0/2895599003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c080109d0 con 0x7f5c140d29d0 2023-08-09T12:40:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.980+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c140cc4f0 con 0x7f5c140d29d0 2023-08-09T12:40:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.980+0000 7f5bfbfff640 1 -- 172.21.15.17:0/2895599003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08010d80 con 0x7f5c140d29d0 2023-08-09T12:40:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.980+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c14154bc0 con 0x7f5c140d29d0 2023-08-09T12:40:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.981+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c14160940 con 0x7f5c140d29d0 2023-08-09T12:40:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.982+0000 7f5bfbfff640 1 -- 172.21.15.17:0/2895599003 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c0800f3c0 con 0x7f5c140d29d0 2023-08-09T12:40:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.984+0000 7f5bfbfff640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c0006a050 0x7f5c0006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.984+0000 7f5bfbfff640 1 -- 172.21.15.17:0/2895599003 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c08088560 con 0x7f5c140d29d0 2023-08-09T12:40:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.984+0000 7f5c137fe640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c0006a050 0x7f5c0006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.986+0000 7f5c137fe640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c0006a050 0x7f5c0006c510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c04036000 tx=0x7f5c0403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:03.988+0000 7f5bfbfff640 1 -- 172.21.15.17:0/2895599003 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5c08053c40 con 0x7f5c140d29d0 2023-08-09T12:40:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.189+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c140d0400 con 0x7f5c140d29d0 2023-08-09T12:40:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.192+0000 7f5bfbfff640 1 -- 172.21.15.17:0/2895599003 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f5c08057260 con 0x7f5c140d29d0 2023-08-09T12:40:04.196 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:04.196 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c0006a050 msgr2=0x7f5c0006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c0006a050 0x7f5c0006c510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c04036000 tx=0x7f5c0403c040 comp rx=0 tx=0).stop 2023-08-09T12:40:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c140d29d0 msgr2=0x7f5c1415b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c140d29d0 0x7f5c1415b130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800b4d0 tx=0x7f5c0800b990 comp rx=0 tx=0).stop 2023-08-09T12:40:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 shutdown_connections 2023-08-09T12:40:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c0006a050 0x7f5c0006c510 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c1415ce90 0x7f5c1415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c140d29d0 0x7f5c1415b130 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 --2- 172.21.15.17:0/2895599003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c140b6000 0x7f5c14154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 >> 172.21.15.17:0/2895599003 conn(0x7f5c1406fde0 msgr2=0x7f5c141584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:04.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 shutdown_connections 2023-08-09T12:40:04.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.195+0000 7f5c19fe8640 1 -- 172.21.15.17:0/2895599003 wait complete. 2023-08-09T12:40:04.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:04.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:04.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.438+0000 7f1aa3399640 1 Processor -- start 2023-08-09T12:40:04.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.439+0000 7f1aa3399640 1 -- start start 2023-08-09T12:40:04.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.440+0000 7f1aa3399640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a9c15ce90 0x7f1a9c1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.440+0000 7f1aa3399640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c0b6460 con 0x7f1a9c0b6000 2023-08-09T12:40:04.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.440+0000 7f1aa3399640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c0cdd10 con 0x7f1a9c0d29d0 2023-08-09T12:40:04.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.440+0000 7f1aa3399640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0cdff0 con 0x7f1a9c15ce90 2023-08-09T12:40:04.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.441+0000 7f1aa1135640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a9c15ce90 0x7f1a9c1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.441+0000 7f1aa0934640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1a9c0b6000 0x7f1a9c0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42522/0 (socket says 172.21.15.17:42522) 2023-08-09T12:40:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.441+0000 7f1aa0934640 1 -- 172.21.15.17:0/678979697 learned_addr learned my addr 172.21.15.17:0/678979697 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.441+0000 7f1aa1135640 1 -- 172.21.15.17:0/678979697 >> v1:172.21.15.142:6789/0 conn(0x7f1a9c0d29d0 legacy=0x7f1a9c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.441+0000 7f1aa1135640 1 -- 172.21.15.17:0/678979697 >> v1:172.21.15.17:6789/0 conn(0x7f1a9c0b6000 legacy=0x7f1a9c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.441+0000 7f1a93fff640 1 -- 172.21.15.17:0/678979697 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145552293 0 0) 0x7f1a9c0b6460 con 0x7f1a9c0b6000 2023-08-09T12:40:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.441+0000 7f1aa1135640 1 -- 172.21.15.17:0/678979697 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0ce2d0 con 0x7f1a9c15ce90 2023-08-09T12:40:04.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.443+0000 7f1aa1135640 1 --2- 172.21.15.17:0/678979697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1616e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a980097a0 tx=0x7f1a9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af32392757e0635 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:04.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.443+0000 7f1a93fff640 1 -- 172.21.15.17:0/678979697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98031830 con 0x7f1a9c15ce90 2023-08-09T12:40:04.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.443+0000 7f1a93fff640 1 -- 172.21.15.17:0/678979697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98031990 con 0x7f1a9c15ce90 2023-08-09T12:40:04.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.443+0000 7f1a93fff640 1 -- 172.21.15.17:0/678979697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98031d20 con 0x7f1a9c15ce90 2023-08-09T12:40:04.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.444+0000 7f1aa3399640 1 -- 172.21.15.17:0/678979697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 msgr2=0x7f1a9c1616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.444+0000 7f1aa3399640 1 --2- 172.21.15.17:0/678979697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1616e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a980097a0 tx=0x7f1a9802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.444+0000 7f1aa3399640 1 -- 172.21.15.17:0/678979697 shutdown_connections 2023-08-09T12:40:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.444+0000 7f1aa3399640 1 --2- 172.21.15.17:0/678979697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1616e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.444+0000 7f1aa3399640 1 -- 172.21.15.17:0/678979697 >> 172.21.15.17:0/678979697 conn(0x7f1a9c06fde0 msgr2=0x7f1a9c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.444+0000 7f1aa3399640 1 -- 172.21.15.17:0/678979697 shutdown_connections 2023-08-09T12:40:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.444+0000 7f1aa3399640 1 -- 172.21.15.17:0/678979697 wait complete. 2023-08-09T12:40:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.446+0000 7f1aa3399640 1 Processor -- start 2023-08-09T12:40:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.446+0000 7f1aa3399640 1 -- start start 2023-08-09T12:40:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa3399640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a9c0b6000 0x7f1a9c15fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa3399640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a9c0d29d0 0x7f1a9c145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa3399640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa3399640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c0ccd50 con 0x7f1a9c15ce90 2023-08-09T12:40:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa3399640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c156de0 con 0x7f1a9c0b6000 2023-08-09T12:40:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa3399640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c1570c0 con 0x7f1a9c0d29d0 2023-08-09T12:40:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa1936640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa1936640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39502/0 (socket says 172.21.15.17:39502) 2023-08-09T12:40:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.447+0000 7f1aa1936640 1 -- 172.21.15.17:0/4160844970 learned_addr learned my addr 172.21.15.17:0/4160844970 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:04.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1aa1936640 1 -- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a9c0d29d0 msgr2=0x7f1a9c145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1aa1936640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a9c0d29d0 0x7f1a9c145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1aa1936640 1 -- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a9c0b6000 msgr2=0x7f1a9c15fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1aa1936640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a9c0b6000 0x7f1a9c15fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1aa1936640 1 -- 172.21.15.17:0/4160844970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98009400 con 0x7f1a9c15ce90 2023-08-09T12:40:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1aa1936640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1463b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c780 tx=0x7f1a9400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1a91ffb640 1 -- 172.21.15.17:0/4160844970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94004b60 con 0x7f1a9c15ce90 2023-08-09T12:40:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1a91ffb640 1 -- 172.21.15.17:0/4160844970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9400ce90 con 0x7f1a9c15ce90 2023-08-09T12:40:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c15f070 con 0x7f1a9c15ce90 2023-08-09T12:40:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1a91ffb640 1 -- 172.21.15.17:0/4160844970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400a850 con 0x7f1a9c15ce90 2023-08-09T12:40:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.448+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c15f630 con 0x7f1a9c15ce90 2023-08-09T12:40:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.449+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c15f850 con 0x7f1a9c15ce90 2023-08-09T12:40:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.450+0000 7f1a91ffb640 1 -- 172.21.15.17:0/4160844970 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a9400a9b0 con 0x7f1a9c15ce90 2023-08-09T12:40:04.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.451+0000 7f1a91ffb640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1a8006a080 0x7f1a8006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.451+0000 7f1a91ffb640 1 -- 172.21.15.17:0/4160844970 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a94088850 con 0x7f1a9c15ce90 2023-08-09T12:40:04.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.452+0000 7f1aa1135640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1a8006a080 0x7f1a8006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.453+0000 7f1aa1135640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1a8006a080 0x7f1a8006c540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a98036000 tx=0x7f1a98030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:04.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.455+0000 7f1a91ffb640 1 -- 172.21.15.17:0/4160844970 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1a94053ea0 con 0x7f1a9c15ce90 2023-08-09T12:40:04.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.653+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a9c067a80 con 0x7f1a9c15ce90 2023-08-09T12:40:04.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.654+0000 7f1a91ffb640 1 -- 172.21.15.17:0/4160844970 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a940574c0 con 0x7f1a9c15ce90 2023-08-09T12:40:04.657 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:04.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.656+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1a8006a080 msgr2=0x7f1a8006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.656+0000 7f1aa3399640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1a8006a080 0x7f1a8006c540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a98036000 tx=0x7f1a98030000 comp rx=0 tx=0).stop 2023-08-09T12:40:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.656+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 msgr2=0x7f1a9c1463b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.656+0000 7f1aa3399640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1463b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c780 tx=0x7f1a9400cc40 comp rx=0 tx=0).stop 2023-08-09T12:40:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.657+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 shutdown_connections 2023-08-09T12:40:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.657+0000 7f1aa3399640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1a8006a080 0x7f1a8006c540 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.657+0000 7f1aa3399640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c15ce90 0x7f1a9c1463b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.657+0000 7f1aa3399640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a9c0d29d0 0x7f1a9c145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.657+0000 7f1aa3399640 1 --2- 172.21.15.17:0/4160844970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a9c0b6000 0x7f1a9c15fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.657+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 >> 172.21.15.17:0/4160844970 conn(0x7f1a9c06fde0 msgr2=0x7f1a9c0b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.657+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 shutdown_connections 2023-08-09T12:40:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.657+0000 7f1aa3399640 1 -- 172.21.15.17:0/4160844970 wait complete. 2023-08-09T12:40:04.680 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:04.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.907+0000 7f2976f47640 1 Processor -- start 2023-08-09T12:40:04.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.907+0000 7f2976f47640 1 -- start start 2023-08-09T12:40:04.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2976f47640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2970070a90 0x7f29700b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2976f47640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29700ad810 0x7f29700c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2976f47640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29700b4630 con 0x7f2970159d80 2023-08-09T12:40:04.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2976f47640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297015a160 con 0x7f2970070a90 2023-08-09T12:40:04.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2976f47640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700b3ab0 con 0x7f29700ad810 2023-08-09T12:40:04.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2967fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2970070a90 0x7f29700b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2967fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2970070a90 0x7f29700b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39506/0 (socket says 172.21.15.17:39506) 2023-08-09T12:40:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2967fff640 1 -- 172.21.15.17:0/570099719 learned_addr learned my addr 172.21.15.17:0/570099719 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.909+0000 7f2974ce3640 1 --1- 172.21.15.17:0/570099719 >> v1:172.21.15.17:6789/0 conn(0x7f2970159d80 0x7f2970070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42528/0 (socket says 172.21.15.17:42528) 2023-08-09T12:40:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.910+0000 7f29754e4640 1 --2- 172.21.15.17:0/570099719 >> v2:172.21.15.142:3300/0 conn(0x7f29700ad810 0x7f29700c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.910+0000 7f2967fff640 1 -- 172.21.15.17:0/570099719 >> v2:172.21.15.142:3300/0 conn(0x7f29700ad810 msgr2=0x7f29700c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.910+0000 7f2967fff640 1 --2- 172.21.15.17:0/570099719 >> v2:172.21.15.142:3300/0 conn(0x7f29700ad810 0x7f29700c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.910+0000 7f2967fff640 1 -- 172.21.15.17:0/570099719 >> v1:172.21.15.17:6789/0 conn(0x7f2970159d80 legacy=0x7f2970070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.910+0000 7f29677fe640 1 -- 172.21.15.17:0/570099719 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032593603 0 0) 0x7f29700b4630 con 0x7f2970159d80 2023-08-09T12:40:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.910+0000 7f2967fff640 1 -- 172.21.15.17:0/570099719 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700b3d90 con 0x7f2970070a90 2023-08-09T12:40:04.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.911+0000 7f2967fff640 1 --2- 172.21.15.17:0/570099719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970070a90 0x7f29700b34d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f29700c5700 tx=0x7f296002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b6213e39ac65be server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:04.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.912+0000 7f29677fe640 1 -- 172.21.15.17:0/570099719 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960004230 con 0x7f2970070a90 2023-08-09T12:40:04.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.912+0000 7f29677fe640 1 -- 172.21.15.17:0/570099719 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960004390 con 0x7f2970070a90 2023-08-09T12:40:04.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.912+0000 7f29677fe640 1 -- 172.21.15.17:0/570099719 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960030840 con 0x7f2970070a90 2023-08-09T12:40:04.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.912+0000 7f2976f47640 1 -- 172.21.15.17:0/570099719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970070a90 msgr2=0x7f29700b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.912+0000 7f2976f47640 1 --2- 172.21.15.17:0/570099719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970070a90 0x7f29700b34d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f29700c5700 tx=0x7f296002b980 comp rx=0 tx=0).stop 2023-08-09T12:40:04.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.912+0000 7f2976f47640 1 -- 172.21.15.17:0/570099719 shutdown_connections 2023-08-09T12:40:04.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.912+0000 7f2976f47640 1 --2- 172.21.15.17:0/570099719 >> v2:172.21.15.142:3300/0 conn(0x7f29700ad810 0x7f29700c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.912+0000 7f2976f47640 1 --2- 172.21.15.17:0/570099719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970070a90 0x7f29700b34d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.913+0000 7f2976f47640 1 -- 172.21.15.17:0/570099719 >> 172.21.15.17:0/570099719 conn(0x7f29700cb1b0 msgr2=0x7f29700cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:04.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.913+0000 7f2976f47640 1 -- 172.21.15.17:0/570099719 shutdown_connections 2023-08-09T12:40:04.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.913+0000 7f2976f47640 1 -- 172.21.15.17:0/570099719 wait complete. 2023-08-09T12:40:04.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.914+0000 7f2976f47640 1 Processor -- start 2023-08-09T12:40:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.915+0000 7f2976f47640 1 -- start start 2023-08-09T12:40:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f2976f47640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2970070a90 0x7f29700b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f2976f47640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700ad810 0x7f29700cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f2976f47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970159d80 0x7f297014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f2976f47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c3210 con 0x7f2970159d80 2023-08-09T12:40:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f2976f47640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c3790 con 0x7f29700ad810 2023-08-09T12:40:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f2976f47640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700ae230 con 0x7f2970070a90 2023-08-09T12:40:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f29754e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970159d80 0x7f297014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f29754e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970159d80 0x7f297014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39510/0 (socket says 172.21.15.17:39510) 2023-08-09T12:40:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f29754e4640 1 -- 172.21.15.17:0/2796538432 learned_addr learned my addr 172.21.15.17:0/2796538432 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f2974ce3640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2970070a90 0x7f29700b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f2967fff640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700ad810 0x7f29700cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f29754e4640 1 -- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2970070a90 msgr2=0x7f29700b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f29754e4640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2970070a90 0x7f29700b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f29754e4640 1 -- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700ad810 msgr2=0x7f29700cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:04.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.916+0000 7f29754e4640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700ad810 0x7f29700cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:04.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.917+0000 7f29754e4640 1 -- 172.21.15.17:0/2796538432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960009460 con 0x7f2970159d80 2023-08-09T12:40:04.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.917+0000 7f2974ce3640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2970070a90 0x7f29700b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:04.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.917+0000 7f29754e4640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970159d80 0x7f297014e670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2968007e70 tx=0x7f296800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:04.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.917+0000 7f29657fa640 1 -- 172.21.15.17:0/2796538432 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968014620 con 0x7f2970159d80 2023-08-09T12:40:04.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.917+0000 7f29657fa640 1 -- 172.21.15.17:0/2796538432 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29680147a0 con 0x7f2970159d80 2023-08-09T12:40:04.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.917+0000 7f29657fa640 1 -- 172.21.15.17:0/2796538432 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968014b50 con 0x7f2970159d80 2023-08-09T12:40:04.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.917+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29700ae510 con 0x7f2970159d80 2023-08-09T12:40:04.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.917+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700af6b0 con 0x7f2970159d80 2023-08-09T12:40:04.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.918+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29700ae700 con 0x7f2970159d80 2023-08-09T12:40:04.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.919+0000 7f29657fa640 1 -- 172.21.15.17:0/2796538432 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2968014cb0 con 0x7f2970159d80 2023-08-09T12:40:04.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.921+0000 7f29657fa640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f295c06a050 0x7f295c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:04.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.921+0000 7f29657fa640 1 -- 172.21.15.17:0/2796538432 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2968088ff0 con 0x7f2970159d80 2023-08-09T12:40:04.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.922+0000 7f2974ce3640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f295c06a050 0x7f295c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:04.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.923+0000 7f2974ce3640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f295c06a050 0x7f295c06c510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f296c000f60 tx=0x7f296c007cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:04.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:04.925+0000 7f29657fa640 1 -- 172.21.15.17:0/2796538432 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f29680bb7b0 con 0x7f2970159d80 2023-08-09T12:40:05.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.117+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2970067a80 con 0x7f2970159d80 2023-08-09T12:40:05.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.118+0000 7f29657fa640 1 -- 172.21.15.17:0/2796538432 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f29700ae700 con 0x7f2970159d80 2023-08-09T12:40:05.121 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:05.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f295c06a050 msgr2=0x7f295c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f295c06a050 0x7f295c06c510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f296c000f60 tx=0x7f296c007cc0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970159d80 msgr2=0x7f297014e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970159d80 0x7f297014e670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2968007e70 tx=0x7f296800e4b0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 shutdown_connections 2023-08-09T12:40:05.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f295c06a050 0x7f295c06c510 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2970159d80 0x7f297014e670 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29700ad810 0x7f29700cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 --2- 172.21.15.17:0/2796538432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2970070a90 0x7f29700b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 >> 172.21.15.17:0/2796538432 conn(0x7f29700cb1b0 msgr2=0x7f2970070380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:05.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 shutdown_connections 2023-08-09T12:40:05.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.121+0000 7f2976f47640 1 -- 172.21.15.17:0/2796538432 wait complete. 2023-08-09T12:40:05.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.375+0000 7fbfda779640 1 Processor -- start 2023-08-09T12:40:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.375+0000 7fbfda779640 1 -- start start 2023-08-09T12:40:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.377+0000 7fbfda779640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfd4160260 0x7fbfd40b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.377+0000 7fbfda779640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd4070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.377+0000 7fbfda779640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd4160640 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.377+0000 7fbfda779640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd4070770 con 0x7fbfd4160260 2023-08-09T12:40:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.377+0000 7fbfda779640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40d0d40 con 0x7fbfd406fde0 2023-08-09T12:40:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.377+0000 7fbfd3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfd4160260 0x7fbfd40b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.377+0000 7fbfd3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfd4160260 0x7fbfd40b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39514/0 (socket says 172.21.15.17:39514) 2023-08-09T12:40:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.377+0000 7fbfd3fff640 1 -- 172.21.15.17:0/1539438993 learned_addr learned my addr 172.21.15.17:0/1539438993 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.378+0000 7fbfd8d16640 1 --2- 172.21.15.17:0/1539438993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd4070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.378+0000 7fbfd3fff640 1 -- 172.21.15.17:0/1539438993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 msgr2=0x7fbfd4070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.378+0000 7fbfd3fff640 1 --2- 172.21.15.17:0/1539438993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd4070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.378+0000 7fbfd3fff640 1 -- 172.21.15.17:0/1539438993 >> v1:172.21.15.142:6789/0 conn(0x7fbfd40b1dc0 legacy=0x7fbfd40b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.378+0000 7fbfd3fff640 1 -- 172.21.15.17:0/1539438993 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40d1020 con 0x7fbfd4160260 2023-08-09T12:40:05.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.378+0000 7fbfd8d16640 1 --2- 172.21.15.17:0/1539438993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd4070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.379+0000 7fbfd3fff640 1 --2- 172.21.15.17:0/1539438993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd4160260 0x7fbfd40b5bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009e50 tx=0x7fbfc402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad6f0285f06d473 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfd2ffd640 1 -- 172.21.15.17:0/1539438993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc402cb90 con 0x7fbfd4160260 2023-08-09T12:40:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfd2ffd640 1 -- 172.21.15.17:0/1539438993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc402ccf0 con 0x7fbfd4160260 2023-08-09T12:40:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfd2ffd640 1 -- 172.21.15.17:0/1539438993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4034610 con 0x7fbfd4160260 2023-08-09T12:40:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfda779640 1 -- 172.21.15.17:0/1539438993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd4160260 msgr2=0x7fbfd40b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfda779640 1 --2- 172.21.15.17:0/1539438993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd4160260 0x7fbfd40b5bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009e50 tx=0x7fbfc402bff0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfda779640 1 -- 172.21.15.17:0/1539438993 shutdown_connections 2023-08-09T12:40:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfda779640 1 --2- 172.21.15.17:0/1539438993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd4070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfda779640 1 --2- 172.21.15.17:0/1539438993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd4160260 0x7fbfd40b5bb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfda779640 1 -- 172.21.15.17:0/1539438993 >> 172.21.15.17:0/1539438993 conn(0x7fbfd4069be0 msgr2=0x7fbfd4069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.380+0000 7fbfda779640 1 -- 172.21.15.17:0/1539438993 shutdown_connections 2023-08-09T12:40:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.381+0000 7fbfda779640 1 -- 172.21.15.17:0/1539438993 wait complete. 2023-08-09T12:40:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.382+0000 7fbfda779640 1 Processor -- start 2023-08-09T12:40:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.383+0000 7fbfda779640 1 -- start start 2023-08-09T12:40:05.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfda779640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfda779640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd40b1dc0 0x7fbfd40c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfda779640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd4160260 0x7fbfd415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfda779640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40b1530 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfda779640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40c6610 con 0x7fbfd4160260 2023-08-09T12:40:05.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfda779640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40aad80 con 0x7fbfd406fde0 2023-08-09T12:40:05.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd40b1dc0 0x7fbfd40c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd40b1dc0 0x7fbfd40c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39520/0 (socket says 172.21.15.17:39520) 2023-08-09T12:40:05.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd37fe640 1 -- 172.21.15.17:0/858235906 learned_addr learned my addr 172.21.15.17:0/858235906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:05.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd3fff640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd37fe640 1 -- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 msgr2=0x7fbfd415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd37fe640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd415dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd37fe640 1 -- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd4160260 msgr2=0x7fbfd415aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd37fe640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd4160260 0x7fbfd415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.384+0000 7fbfd37fe640 1 -- 172.21.15.17:0/858235906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009b30 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.385+0000 7fbfd37fe640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd40b1dc0 0x7fbfd40c70b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c4d0 tx=0x7fbfc800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.385+0000 7fbfd0ff9640 1 -- 172.21.15.17:0/858235906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80052d0 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.385+0000 7fbfd0ff9640 1 -- 172.21.15.17:0/858235906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8005430 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.385+0000 7fbfd0ff9640 1 -- 172.21.15.17:0/858235906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8012850 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.385+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd40c68b0 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.385+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40ab060 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.386+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd40ab1f0 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.387+0000 7fbfd0ff9640 1 -- 172.21.15.17:0/858235906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbfc80129b0 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.389+0000 7fbfd0ff9640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc006a050 0x7fbfc006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.389+0000 7fbfd0ff9640 1 -- 172.21.15.17:0/858235906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfc8087f10 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.389+0000 7fbfd3fff640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc006a050 0x7fbfc006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.391+0000 7fbfd3fff640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc006a050 0x7fbfc006c510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4035000 tx=0x7fbfc4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:05.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.393+0000 7fbfd0ff9640 1 -- 172.21.15.17:0/858235906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbfc80535f0 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.587+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfd40c6dd0 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.588+0000 7fbfd0ff9640 1 -- 172.21.15.17:0/858235906 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbfd40c6dd0 con 0x7fbfd40b1dc0 2023-08-09T12:40:05.592 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:05.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc006a050 msgr2=0x7fbfc006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc006a050 0x7fbfc006c510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4035000 tx=0x7fbfc4030000 comp rx=0 tx=0).stop 2023-08-09T12:40:05.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd40b1dc0 msgr2=0x7fbfd40c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd40b1dc0 0x7fbfd40c70b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c4d0 tx=0x7fbfc800c990 comp rx=0 tx=0).stop 2023-08-09T12:40:05.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 shutdown_connections 2023-08-09T12:40:05.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc006a050 0x7fbfc006c510 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd4160260 0x7fbfd415aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfd40b1dc0 0x7fbfd40c70b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 --2- 172.21.15.17:0/858235906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd406fde0 0x7fbfd415dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 >> 172.21.15.17:0/858235906 conn(0x7fbfd4069be0 msgr2=0x7fbfd40d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:05.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 shutdown_connections 2023-08-09T12:40:05.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.591+0000 7fbfda779640 1 -- 172.21.15.17:0/858235906 wait complete. 2023-08-09T12:40:05.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:05.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.849+0000 7fe4bcba4640 1 Processor -- start 2023-08-09T12:40:05.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.850+0000 7fe4bcba4640 1 -- start start 2023-08-09T12:40:05.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.851+0000 7fe4bcba4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4b80b0020 0x7fe4b80b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.851+0000 7fe4bcba4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b8160640 0x7fe4b815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.851+0000 7fe4bcba4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b8157580 con 0x7fe4b80cdb00 2023-08-09T12:40:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.851+0000 7fe4bcba4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b815d1c0 con 0x7fe4b80b0020 2023-08-09T12:40:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.851+0000 7fe4bcba4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80ad490 con 0x7fe4b8160640 2023-08-09T12:40:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4b80b0020 0x7fe4b80b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4b80b0020 0x7fe4b80b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39526/0 (socket says 172.21.15.17:39526) 2023-08-09T12:40:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b77fe640 1 -- 172.21.15.17:0/2292002297 learned_addr learned my addr 172.21.15.17:0/2292002297 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b7fff640 1 --2- 172.21.15.17:0/2292002297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b8160640 0x7fe4b815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b77fe640 1 -- 172.21.15.17:0/2292002297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b8160640 msgr2=0x7fe4b815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:05.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b77fe640 1 --2- 172.21.15.17:0/2292002297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b8160640 0x7fe4b815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b77fe640 1 -- 172.21.15.17:0/2292002297 >> v1:172.21.15.142:6789/0 conn(0x7fe4b80cdb00 legacy=0x7fe4b80acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:05.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b77fe640 1 -- 172.21.15.17:0/2292002297 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80b0940 con 0x7fe4b80b0020 2023-08-09T12:40:05.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.852+0000 7fe4b7fff640 1 --2- 172.21.15.17:0/2292002297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b8160640 0x7fe4b815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.853+0000 7fe4b77fe640 1 --2- 172.21.15.17:0/2292002297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b0400 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009870 tx=0x7fe4a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c18c51aac07e468 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.854+0000 7fe4b6ffd640 1 -- 172.21.15.17:0/2292002297 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8031640 con 0x7fe4b80b0020 2023-08-09T12:40:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.854+0000 7fe4b6ffd640 1 -- 172.21.15.17:0/2292002297 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a80317a0 con 0x7fe4b80b0020 2023-08-09T12:40:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.854+0000 7fe4b6ffd640 1 -- 172.21.15.17:0/2292002297 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8031b30 con 0x7fe4b80b0020 2023-08-09T12:40:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.854+0000 7fe4bcba4640 1 -- 172.21.15.17:0/2292002297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 msgr2=0x7fe4b80b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.854+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/2292002297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b0400 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009870 tx=0x7fe4a802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.855+0000 7fe4bcba4640 1 -- 172.21.15.17:0/2292002297 shutdown_connections 2023-08-09T12:40:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.855+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/2292002297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b8160640 0x7fe4b815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.855+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/2292002297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b0400 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.855+0000 7fe4bcba4640 1 -- 172.21.15.17:0/2292002297 >> 172.21.15.17:0/2292002297 conn(0x7fe4b80cb020 msgr2=0x7fe4b80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.855+0000 7fe4bcba4640 1 -- 172.21.15.17:0/2292002297 shutdown_connections 2023-08-09T12:40:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.855+0000 7fe4bcba4640 1 -- 172.21.15.17:0/2292002297 wait complete. 2023-08-09T12:40:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.857+0000 7fe4bcba4640 1 Processor -- start 2023-08-09T12:40:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.857+0000 7fe4bcba4640 1 -- start start 2023-08-09T12:40:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4bcba4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4bcba4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b80cdb00 0x7fe4b815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4bcba4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b8160640 0x7fe4b814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4bcba4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815f1c0 con 0x7fe4b80b0020 2023-08-09T12:40:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4bcba4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815dbe0 con 0x7fe4b8160640 2023-08-09T12:40:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4bcba4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815dec0 con 0x7fe4b80cdb00 2023-08-09T12:40:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4b77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4b77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39542/0 (socket says 172.21.15.17:39542) 2023-08-09T12:40:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4b77fe640 1 -- 172.21.15.17:0/1733457367 learned_addr learned my addr 172.21.15.17:0/1733457367 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4b77fe640 1 -- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b80cdb00 msgr2=0x7fe4b815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4b77fe640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b80cdb00 0x7fe4b815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4b77fe640 1 -- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b8160640 msgr2=0x7fe4b814bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4b77fe640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b8160640 0x7fe4b814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.858+0000 7fe4b77fe640 1 -- 172.21.15.17:0/1733457367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a80094d0 con 0x7fe4b80b0020 2023-08-09T12:40:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.859+0000 7fe4b77fe640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b1b70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009870 tx=0x7fe4a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.859+0000 7fe4b4ff9640 1 -- 172.21.15.17:0/1733457367 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a803ac60 con 0x7fe4b80b0020 2023-08-09T12:40:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.859+0000 7fe4b4ff9640 1 -- 172.21.15.17:0/1733457367 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a803ade0 con 0x7fe4b80b0020 2023-08-09T12:40:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.859+0000 7fe4b4ff9640 1 -- 172.21.15.17:0/1733457367 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8044630 con 0x7fe4b80b0020 2023-08-09T12:40:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.859+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b815e1a0 con 0x7fe4b80b0020 2023-08-09T12:40:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.859+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b815e760 con 0x7fe4b80b0020 2023-08-09T12:40:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.861+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b804e390 con 0x7fe4b80b0020 2023-08-09T12:40:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.861+0000 7fe4b4ff9640 1 -- 172.21.15.17:0/1733457367 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4a802f050 con 0x7fe4b80b0020 2023-08-09T12:40:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.862+0000 7fe4b4ff9640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe49806a050 0x7fe49806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.862+0000 7fe4b4ff9640 1 -- 172.21.15.17:0/1733457367 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4a80aa7d0 con 0x7fe4b80b0020 2023-08-09T12:40:05.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.863+0000 7fe4affff640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe49806a050 0x7fe49806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:05.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.864+0000 7fe4affff640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe49806a050 0x7fe49806c510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80b4200 tx=0x7fe4a00079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:05.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:05.867+0000 7fe4b4ff9640 1 -- 172.21.15.17:0/1733457367 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe4a8075f40 con 0x7fe4b80b0020 2023-08-09T12:40:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.058+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4b8161120 con 0x7fe4b80b0020 2023-08-09T12:40:06.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.059+0000 7fe4b4ff9640 1 -- 172.21.15.17:0/1733457367 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4a8079560 con 0x7fe4b80b0020 2023-08-09T12:40:06.062 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:06.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe49806a050 msgr2=0x7fe49806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe49806a050 0x7fe49806c510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80b4200 tx=0x7fe4a00079b0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 msgr2=0x7fe4b80b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b1b70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009870 tx=0x7fe4a80046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 shutdown_connections 2023-08-09T12:40:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe49806a050 0x7fe49806c510 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4b8160640 0x7fe4b814bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4b80cdb00 0x7fe4b815ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.061+0000 7fe4bcba4640 1 --2- 172.21.15.17:0/1733457367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b80b0020 0x7fe4b80b1b70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.062+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 >> 172.21.15.17:0/1733457367 conn(0x7fe4b80cb020 msgr2=0x7fe4b80acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.062+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 shutdown_connections 2023-08-09T12:40:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.062+0000 7fe4bcba4640 1 -- 172.21.15.17:0/1733457367 wait complete. 2023-08-09T12:40:06.093 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-08-09T12:40:06.095 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-08-09T12:40:06.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.329+0000 7f11a5ca9640 1 Processor -- start 2023-08-09T12:40:06.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.329+0000 7f11a5ca9640 1 -- start start 2023-08-09T12:40:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.331+0000 7f11a5ca9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11a0164f50 0x7f11a00cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.331+0000 7f11a5ca9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00cd520 con 0x7f11a00c1980 2023-08-09T12:40:06.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.331+0000 7f11a5ca9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00cc630 con 0x7f11a0162650 2023-08-09T12:40:06.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.331+0000 7f11a5ca9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a00cc910 con 0x7f11a0164f50 2023-08-09T12:40:06.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.331+0000 7f119f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11a0164f50 0x7f11a00cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:06.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.331+0000 7f119f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11a0164f50 0x7f11a00cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39550/0 (socket says 172.21.15.17:39550) 2023-08-09T12:40:06.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.331+0000 7f119f7fe640 1 -- 172.21.15.17:0/75645172 learned_addr learned my addr 172.21.15.17:0/75645172 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:06.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.331+0000 7f1197fff640 1 --1- 172.21.15.17:0/75645172 >> v1:172.21.15.17:6789/0 conn(0x7f11a00c1980 0x7f11a0165330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42536/0 (socket says 172.21.15.17:42536) 2023-08-09T12:40:06.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.332+0000 7f119f7fe640 1 -- 172.21.15.17:0/75645172 >> v1:172.21.15.142:6789/0 conn(0x7f11a0162650 legacy=0x7f11a00c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:06.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.332+0000 7f119f7fe640 1 -- 172.21.15.17:0/75645172 >> v1:172.21.15.17:6789/0 conn(0x7f11a00c1980 legacy=0x7f11a0165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:06.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.332+0000 7f119f7fe640 1 -- 172.21.15.17:0/75645172 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a00ccbf0 con 0x7f11a0164f50 2023-08-09T12:40:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.333+0000 7f119f7fe640 1 --2- 172.21.15.17:0/75645172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a00cd9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1190009870 tx=0x7f119002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674bfacb3d4e11e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.333+0000 7f119effd640 1 -- 172.21.15.17:0/75645172 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190030860 con 0x7f11a0164f50 2023-08-09T12:40:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.333+0000 7f119effd640 1 -- 172.21.15.17:0/75645172 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11900309c0 con 0x7f11a0164f50 2023-08-09T12:40:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.333+0000 7f119effd640 1 -- 172.21.15.17:0/75645172 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190030d50 con 0x7f11a0164f50 2023-08-09T12:40:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.334+0000 7f11a5ca9640 1 -- 172.21.15.17:0/75645172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 msgr2=0x7f11a00cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.334+0000 7f11a5ca9640 1 --2- 172.21.15.17:0/75645172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a00cd9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1190009870 tx=0x7f119002b9a0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.334+0000 7f11a5ca9640 1 -- 172.21.15.17:0/75645172 shutdown_connections 2023-08-09T12:40:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.334+0000 7f11a5ca9640 1 --2- 172.21.15.17:0/75645172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a00cd9b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.334+0000 7f11a5ca9640 1 -- 172.21.15.17:0/75645172 >> 172.21.15.17:0/75645172 conn(0x7f11a00cb1b0 msgr2=0x7f11a00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:06.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.334+0000 7f11a5ca9640 1 -- 172.21.15.17:0/75645172 shutdown_connections 2023-08-09T12:40:06.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.334+0000 7f11a5ca9640 1 -- 172.21.15.17:0/75645172 wait complete. 2023-08-09T12:40:06.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.336+0000 7f11a5ca9640 1 Processor -- start 2023-08-09T12:40:06.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.336+0000 7f11a5ca9640 1 -- start start 2023-08-09T12:40:06.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f11a5ca9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11a00c1980 0x7f11a0157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:06.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f11a5ca9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a0162650 0x7f11a00c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:06.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f11a5ca9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a0160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:06.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f11a5ca9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a006aa60 con 0x7f11a0164f50 2023-08-09T12:40:06.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f11a5ca9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a006ae90 con 0x7f11a0162650 2023-08-09T12:40:06.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f11a5ca9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00c35a0 con 0x7f11a00c1980 2023-08-09T12:40:06.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f119ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a0160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:06.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f119ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a0160320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39562/0 (socket says 172.21.15.17:39562) 2023-08-09T12:40:06.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.337+0000 7f119ffff640 1 -- 172.21.15.17:0/2159306590 learned_addr learned my addr 172.21.15.17:0/2159306590 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:06.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119f7fe640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11a00c1980 0x7f11a0157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:06.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f1197fff640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a0162650 0x7f11a00c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:06.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119ffff640 1 -- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11a00c1980 msgr2=0x7f11a0157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119ffff640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11a00c1980 0x7f11a0157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119ffff640 1 -- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a0162650 msgr2=0x7f11a00c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119ffff640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a0162650 0x7f11a00c2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119ffff640 1 -- 172.21.15.17:0/2159306590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900094d0 con 0x7f11a0164f50 2023-08-09T12:40:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119ffff640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a0160320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f119800c780 tx=0x7f119800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119cff9640 1 -- 172.21.15.17:0/2159306590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198004b60 con 0x7f11a0164f50 2023-08-09T12:40:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119cff9640 1 -- 172.21.15.17:0/2159306590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119800ce90 con 0x7f11a0164f50 2023-08-09T12:40:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f119cff9640 1 -- 172.21.15.17:0/2159306590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119800a850 con 0x7f11a0164f50 2023-08-09T12:40:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.338+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a00c3880 con 0x7f11a0164f50 2023-08-09T12:40:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.339+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a0157d50 con 0x7f11a0164f50 2023-08-09T12:40:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.340+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a006b370 con 0x7f11a0164f50 2023-08-09T12:40:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.341+0000 7f119cff9640 1 -- 172.21.15.17:0/2159306590 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f119800a9b0 con 0x7f11a0164f50 2023-08-09T12:40:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.342+0000 7f119cff9640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f118006a080 0x7f118006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.342+0000 7f119cff9640 1 -- 172.21.15.17:0/2159306590 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11980887c0 con 0x7f11a0164f50 2023-08-09T12:40:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.342+0000 7f119f7fe640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f118006a080 0x7f118006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.343+0000 7f119f7fe640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f118006a080 0x7f118006c540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1190036000 tx=0x7f119003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:06.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.346+0000 7f119cff9640 1 -- 172.21.15.17:0/2159306590 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f11a006b370 con 0x7f11a0164f50 2023-08-09T12:40:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.612+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f11a006b370 con 0x7f11a0164f50 2023-08-09T12:40:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.753+0000 7f119cff9640 1 -- 172.21.15.17:0/2159306590 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v57) v1 ==== 133+0+0 (secure 0 0 0) 0x7f11a006b370 con 0x7f11a0164f50 2023-08-09T12:40:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f118006a080 msgr2=0x7f118006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f118006a080 0x7f118006c540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1190036000 tx=0x7f119003b040 comp rx=0 tx=0).stop 2023-08-09T12:40:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 msgr2=0x7f11a0160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a0160320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f119800c780 tx=0x7f119800cc40 comp rx=0 tx=0).stop 2023-08-09T12:40:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 shutdown_connections 2023-08-09T12:40:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f118006a080 0x7f118006c540 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a0164f50 0x7f11a0160320 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a0162650 0x7f11a00c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 --2- 172.21.15.17:0/2159306590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11a00c1980 0x7f11a0157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.757+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 >> 172.21.15.17:0/2159306590 conn(0x7f11a00cb1b0 msgr2=0x7f11a0162b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.758+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 shutdown_connections 2023-08-09T12:40:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:06.758+0000 7f11a5ca9640 1 -- 172.21.15.17:0/2159306590 wait complete. 2023-08-09T12:40:06.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-09T12:40:07.018 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_objectstore":"memstore"} 2023-08-09T12:40:07.019 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-09T12:40:07.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:07.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.248+0000 7ff609371640 1 Processor -- start 2023-08-09T12:40:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.248+0000 7ff609371640 1 -- start start 2023-08-09T12:40:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff609371640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff60415ce90 0x7ff6041616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff609371640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6040b6000 0x7ff6040cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff609371640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6040b6460 con 0x7ff6040d29d0 2023-08-09T12:40:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff609371640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040cda40 con 0x7ff6040b6000 2023-08-09T12:40:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff609371640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040cdd10 con 0x7ff60415ce90 2023-08-09T12:40:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff6037fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff6040d29d0 0x7ff6040d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42544/0 (socket says 172.21.15.17:42544) 2023-08-09T12:40:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff6037fe640 1 -- 172.21.15.17:0/3063198553 learned_addr learned my addr 172.21.15.17:0/3063198553 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff5fbfff640 1 --2- 172.21.15.17:0/3063198553 >> v2:172.21.15.142:3300/0 conn(0x7ff6040b6000 0x7ff6040cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.250+0000 7ff602ffd640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff60415ce90 0x7ff6041616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018589134 0 0) 0x7ff6040b6460 con 0x7ff6040d29d0 2023-08-09T12:40:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f0003520 con 0x7ff6040d29d0 2023-08-09T12:40:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2792348432 0 0) 0x7ff5f0003520 con 0x7ff6040d29d0 2023-08-09T12:40:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff60415ce90 msgr2=0x7ff6041616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff60415ce90 0x7ff6041616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 >> v2:172.21.15.142:3300/0 conn(0x7ff6040b6000 msgr2=0x7ff6040cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 --2- 172.21.15.17:0/3063198553 >> v2:172.21.15.142:3300/0 conn(0x7ff6040b6000 0x7ff6040cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6040cdff0 con 0x7ff6040d29d0 2023-08-09T12:40:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff5fc0019f0 con 0x7ff6040d29d0 2023-08-09T12:40:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff602ffd640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff60415ce90 0x7ff6041616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:40:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 >> v1:172.21.15.17:6789/0 conn(0x7ff6040d29d0 legacy=0x7ff6040d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f0003970 0x7ff5f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.251+0000 7ff6027fc640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00047c0 0x7ff5f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff6027fc640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff60415ce90 0x7ff5f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040cda40 con 0x7ff5f00047c0 2023-08-09T12:40:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040cdd10 con 0x7ff5f0003970 2023-08-09T12:40:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f000b980 con 0x7ff60415ce90 2023-08-09T12:40:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff5fbfff640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00047c0 0x7ff5f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff602ffd640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f0003970 0x7ff5f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff5fbfff640 1 -- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff60415ce90 msgr2=0x7ff5f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff5fbfff640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff60415ce90 0x7ff5f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff5fbfff640 1 -- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f0003970 msgr2=0x7ff5f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff5fbfff640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f0003970 0x7ff5f0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.252+0000 7ff5fbfff640 1 -- 172.21.15.17:0/3063198553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f4009400 con 0x7ff5f00047c0 2023-08-09T12:40:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.253+0000 7ff5fbfff640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00047c0 0x7ff5f0004c40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009ac0 tx=0x7ff5f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd4cf4e259c9ca3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.254+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec02c710 con 0x7ff5f00047c0 2023-08-09T12:40:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.254+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec02c870 con 0x7ff5f00047c0 2023-08-09T12:40:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.254+0000 7ff6027fc640 1 -- 172.21.15.17:0/3063198553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec02cc00 con 0x7ff5f00047c0 2023-08-09T12:40:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.254+0000 7ff609371640 1 -- 172.21.15.17:0/3063198553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00047c0 msgr2=0x7ff5f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.254+0000 7ff609371640 1 --2- 172.21.15.17:0/3063198553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00047c0 0x7ff5f0004c40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009ac0 tx=0x7ff5f00057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.254+0000 7ff6037fe640 1 -- 172.21.15.17:0/3063198553 reap_dead start 2023-08-09T12:40:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.254+0000 7ff609371640 1 -- 172.21.15.17:0/3063198553 shutdown_connections 2023-08-09T12:40:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.254+0000 7ff609371640 1 -- 172.21.15.17:0/3063198553 >> 172.21.15.17:0/3063198553 conn(0x7ff60406fde0 msgr2=0x7ff6040701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.255+0000 7ff609371640 1 -- 172.21.15.17:0/3063198553 shutdown_connections 2023-08-09T12:40:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.255+0000 7ff609371640 1 -- 172.21.15.17:0/3063198553 wait complete. 2023-08-09T12:40:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.256+0000 7ff609371640 1 Processor -- start 2023-08-09T12:40:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.257+0000 7ff609371640 1 -- start start 2023-08-09T12:40:07.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.257+0000 7ff609371640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00047c0 0x7ff6040cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.257+0000 7ff609371640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6040cc0d0 0x7ff604150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.257+0000 7ff609371640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff604151210 0x7ff604152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.257+0000 7ff609371640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040caf70 con 0x7ff604151210 2023-08-09T12:40:07.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.257+0000 7ff609371640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040ca660 con 0x7ff5f00047c0 2023-08-09T12:40:07.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.257+0000 7ff609371640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040cc5b0 con 0x7ff6040cc0d0 2023-08-09T12:40:07.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff6037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff604151210 0x7ff604152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff6037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff604151210 0x7ff604152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39572/0 (socket says 172.21.15.17:39572) 2023-08-09T12:40:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff6037fe640 1 -- 172.21.15.17:0/639278644 learned_addr learned my addr 172.21.15.17:0/639278644 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff5fbfff640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6040cc0d0 0x7ff604150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff602ffd640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00047c0 0x7ff6040cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff6037fe640 1 -- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6040cc0d0 msgr2=0x7ff604150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff6037fe640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6040cc0d0 0x7ff604150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff6037fe640 1 -- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00047c0 msgr2=0x7ff6040cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff6037fe640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00047c0 0x7ff6040cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.258+0000 7ff6037fe640 1 -- 172.21.15.17:0/639278644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6040ca8b0 con 0x7ff604151210 2023-08-09T12:40:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.259+0000 7ff6037fe640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff604151210 0x7ff604152050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff6040d0690 tx=0x7ff5fc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.259+0000 7ff5fb7fe640 1 -- 172.21.15.17:0/639278644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00cec0 con 0x7ff604151210 2023-08-09T12:40:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.259+0000 7ff5fb7fe640 1 -- 172.21.15.17:0/639278644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc00a5b0 con 0x7ff604151210 2023-08-09T12:40:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.259+0000 7ff5fb7fe640 1 -- 172.21.15.17:0/639278644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00a920 con 0x7ff604151210 2023-08-09T12:40:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.259+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6040cab90 con 0x7ff604151210 2023-08-09T12:40:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.259+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff604152e80 con 0x7ff604151210 2023-08-09T12:40:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.260+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6040cb0b0 con 0x7ff604151210 2023-08-09T12:40:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.261+0000 7ff5fb7fe640 1 -- 172.21.15.17:0/639278644 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff5fc00aa80 con 0x7ff604151210 2023-08-09T12:40:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.262+0000 7ff5fb7fe640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5e406a080 0x7ff5e406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.262+0000 7ff5fb7fe640 1 -- 172.21.15.17:0/639278644 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5fc0879b0 con 0x7ff604151210 2023-08-09T12:40:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.263+0000 7ff602ffd640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5e406a080 0x7ff5e406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.265+0000 7ff602ffd640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5e406a080 0x7ff5e406c540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009ac0 tx=0x7ff5f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.267+0000 7ff5fb7fe640 1 -- 172.21.15.17:0/639278644 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff6040cb0b0 con 0x7ff604151210 2023-08-09T12:40:07.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.462+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6040cb0b0 con 0x7ff604151210 2023-08-09T12:40:07.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.465+0000 7ff5fb7fe640 1 -- 172.21.15.17:0/639278644 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18255 (secure 0 0 0) 0x7ff6040cb0b0 con 0x7ff604151210 2023-08-09T12:40:07.468 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:07.468 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:39:26.609134+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:07.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.467+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5e406a080 msgr2=0x7ff5e406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.467+0000 7ff609371640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5e406a080 0x7ff5e406c540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009ac0 tx=0x7ff5f4008040 comp rx=0 tx=0).stop 2023-08-09T12:40:07.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff604151210 msgr2=0x7ff604152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff604151210 0x7ff604152050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff6040d0690 tx=0x7ff5fc00ccd0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 shutdown_connections 2023-08-09T12:40:07.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5e406a080 0x7ff5e406c540 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff604151210 0x7ff604152050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6040cc0d0 0x7ff604150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 --2- 172.21.15.17:0/639278644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00047c0 0x7ff6040cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 >> 172.21.15.17:0/639278644 conn(0x7ff60406fde0 msgr2=0x7ff6040b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:07.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 shutdown_connections 2023-08-09T12:40:07.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.468+0000 7ff609371640 1 -- 172.21.15.17:0/639278644 wait complete. 2023-08-09T12:40:07.490 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:07.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:07.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.722+0000 7fb8e3683640 1 Processor -- start 2023-08-09T12:40:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.722+0000 7fb8e3683640 1 -- start start 2023-08-09T12:40:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.724+0000 7fb8e3683640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8dc070a90 0x7fb8dc0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.724+0000 7fb8e3683640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8dc0ad810 0x7fb8dc0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.724+0000 7fb8e3683640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc0b4630 con 0x7fb8dc159d80 2023-08-09T12:40:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.724+0000 7fb8e3683640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc15a160 con 0x7fb8dc070a90 2023-08-09T12:40:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.724+0000 7fb8e3683640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc0b3ab0 con 0x7fb8dc0ad810 2023-08-09T12:40:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.724+0000 7fb8e0c1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8dc070a90 0x7fb8dc0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.725+0000 7fb8e0c1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8dc070a90 0x7fb8dc0b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39578/0 (socket says 172.21.15.17:39578) 2023-08-09T12:40:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.725+0000 7fb8e0c1e640 1 -- 172.21.15.17:0/537415455 learned_addr learned my addr 172.21.15.17:0/537415455 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.725+0000 7fb8e1c20640 1 --2- 172.21.15.17:0/537415455 >> v2:172.21.15.142:3300/0 conn(0x7fb8dc0ad810 0x7fb8dc0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.725+0000 7fb8e0c1e640 1 -- 172.21.15.17:0/537415455 >> v2:172.21.15.142:3300/0 conn(0x7fb8dc0ad810 msgr2=0x7fb8dc0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.725+0000 7fb8e0c1e640 1 --2- 172.21.15.17:0/537415455 >> v2:172.21.15.142:3300/0 conn(0x7fb8dc0ad810 0x7fb8dc0c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.725+0000 7fb8e0c1e640 1 -- 172.21.15.17:0/537415455 >> v1:172.21.15.142:6789/0 conn(0x7fb8dc159d80 legacy=0x7fb8dc070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.725+0000 7fb8e0c1e640 1 -- 172.21.15.17:0/537415455 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0b3d90 con 0x7fb8dc070a90 2023-08-09T12:40:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.727+0000 7fb8e0c1e640 1 --2- 172.21.15.17:0/537415455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc070a90 0x7fb8dc0b34d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0c5700 tx=0x7fb8cc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fe65c3319cd154 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.727+0000 7fb8d3fff640 1 -- 172.21.15.17:0/537415455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc004230 con 0x7fb8dc070a90 2023-08-09T12:40:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.727+0000 7fb8d3fff640 1 -- 172.21.15.17:0/537415455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc004390 con 0x7fb8dc070a90 2023-08-09T12:40:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.727+0000 7fb8d3fff640 1 -- 172.21.15.17:0/537415455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc003810 con 0x7fb8dc070a90 2023-08-09T12:40:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.728+0000 7fb8e3683640 1 -- 172.21.15.17:0/537415455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc070a90 msgr2=0x7fb8dc0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.728+0000 7fb8e3683640 1 --2- 172.21.15.17:0/537415455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc070a90 0x7fb8dc0b34d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0c5700 tx=0x7fb8cc02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.728+0000 7fb8e3683640 1 -- 172.21.15.17:0/537415455 shutdown_connections 2023-08-09T12:40:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.728+0000 7fb8e3683640 1 --2- 172.21.15.17:0/537415455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc070a90 0x7fb8dc0b34d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.728+0000 7fb8e3683640 1 --2- 172.21.15.17:0/537415455 >> v2:172.21.15.142:3300/0 conn(0x7fb8dc0ad810 0x7fb8dc0c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.728+0000 7fb8e3683640 1 -- 172.21.15.17:0/537415455 >> 172.21.15.17:0/537415455 conn(0x7fb8dc0cb1b0 msgr2=0x7fb8dc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.728+0000 7fb8e3683640 1 -- 172.21.15.17:0/537415455 shutdown_connections 2023-08-09T12:40:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.728+0000 7fb8e3683640 1 -- 172.21.15.17:0/537415455 wait complete. 2023-08-09T12:40:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.730+0000 7fb8e3683640 1 Processor -- start 2023-08-09T12:40:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.730+0000 7fb8e3683640 1 -- start start 2023-08-09T12:40:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e3683640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8dc070a90 0x7fb8dc069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e3683640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc0ad810 0x7fb8dc15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e3683640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8dc159d80 0x7fb8dc15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e3683640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc15ca30 con 0x7fb8dc0ad810 2023-08-09T12:40:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e3683640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc14c4b0 con 0x7fb8dc159d80 2023-08-09T12:40:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e3683640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc15c470 con 0x7fb8dc070a90 2023-08-09T12:40:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e0c1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc0ad810 0x7fb8dc15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e0c1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc0ad810 0x7fb8dc15b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39592/0 (socket says 172.21.15.17:39592) 2023-08-09T12:40:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.731+0000 7fb8e0c1e640 1 -- 172.21.15.17:0/809558087 learned_addr learned my addr 172.21.15.17:0/809558087 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e141f640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8dc070a90 0x7fb8dc069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e1c20640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8dc159d80 0x7fb8dc15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e0c1e640 1 -- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8dc070a90 msgr2=0x7fb8dc069a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e0c1e640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8dc070a90 0x7fb8dc069a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e0c1e640 1 -- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8dc159d80 msgr2=0x7fb8dc15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e0c1e640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8dc159d80 0x7fb8dc15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e0c1e640 1 -- 172.21.15.17:0/809558087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009460 con 0x7fb8dc0ad810 2023-08-09T12:40:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e1c20640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8dc159d80 0x7fb8dc15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:07.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.732+0000 7fb8e0c1e640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc0ad810 0x7fb8dc15b330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0090b0 tx=0x7fb8cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:07.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.733+0000 7fb8d1ffb640 1 -- 172.21.15.17:0/809558087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc003c40 con 0x7fb8dc0ad810 2023-08-09T12:40:07.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.733+0000 7fb8d1ffb640 1 -- 172.21.15.17:0/809558087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc03f070 con 0x7fb8dc0ad810 2023-08-09T12:40:07.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.733+0000 7fb8d1ffb640 1 -- 172.21.15.17:0/809558087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc004500 con 0x7fb8dc0ad810 2023-08-09T12:40:07.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.733+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc15c750 con 0x7fb8dc0ad810 2023-08-09T12:40:07.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.733+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc0c5e00 con 0x7fb8dc0ad810 2023-08-09T12:40:07.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.734+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc0c5980 con 0x7fb8dc0ad810 2023-08-09T12:40:07.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.735+0000 7fb8d1ffb640 1 -- 172.21.15.17:0/809558087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb8cc041030 con 0x7fb8dc0ad810 2023-08-09T12:40:07.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.736+0000 7fb8d1ffb640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb8c006a050 0x7fb8c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:07.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.736+0000 7fb8d1ffb640 1 -- 172.21.15.17:0/809558087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8cc0aa8c0 con 0x7fb8dc0ad810 2023-08-09T12:40:07.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.736+0000 7fb8e141f640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb8c006a050 0x7fb8c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:07.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.738+0000 7fb8e141f640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb8c006a050 0x7fb8c006c510 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8006fd0 tx=0x7fb8d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:07.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.741+0000 7fb8d1ffb640 1 -- 172.21.15.17:0/809558087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb8dc0c5980 con 0x7fb8dc0ad810 2023-08-09T12:40:07.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.937+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8dc0c5980 con 0x7fb8dc0ad810 2023-08-09T12:40:07.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.938+0000 7fb8d1ffb640 1 -- 172.21.15.17:0/809558087 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8dc0c5980 con 0x7fb8dc0ad810 2023-08-09T12:40:07.949 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:07.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb8c006a050 msgr2=0x7fb8c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb8c006a050 0x7fb8c006c510 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8006fd0 tx=0x7fb8d8008040 comp rx=0 tx=0).stop 2023-08-09T12:40:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc0ad810 msgr2=0x7fb8dc15b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc0ad810 0x7fb8dc15b330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0090b0 tx=0x7fb8cc0046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 shutdown_connections 2023-08-09T12:40:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb8c006a050 0x7fb8c006c510 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8dc159d80 0x7fb8dc15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8dc0ad810 0x7fb8dc15b330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 --2- 172.21.15.17:0/809558087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8dc070a90 0x7fb8dc069a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:07.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 >> 172.21.15.17:0/809558087 conn(0x7fb8dc0cb1b0 msgr2=0x7fb8dc070380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:07.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 shutdown_connections 2023-08-09T12:40:07.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:07.941+0000 7fb8e3683640 1 -- 172.21.15.17:0/809558087 wait complete. 2023-08-09T12:40:07.962 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.191+0000 7f5b6b4a6640 1 Processor -- start 2023-08-09T12:40:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.191+0000 7f5b6b4a6640 1 -- start start 2023-08-09T12:40:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.192+0000 7f5b6b4a6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b6415cc30 0x7f5b64160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.193+0000 7f5b6b4a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b64161510 0x7f5b6415d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.193+0000 7f5b6b4a6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b64160860 con 0x7f5b64072850 2023-08-09T12:40:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.193+0000 7f5b6b4a6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b64160bb0 con 0x7f5b6415cc30 2023-08-09T12:40:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.193+0000 7f5b6b4a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6415dae0 con 0x7f5b64161510 2023-08-09T12:40:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.193+0000 7f5b69a43640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5b64072850 0x7f5b640697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55248/0 (socket says 172.21.15.17:55248) 2023-08-09T12:40:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.193+0000 7f5b69a43640 1 -- 172.21.15.17:0/2977584043 learned_addr learned my addr 172.21.15.17:0/2977584043 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.193+0000 7f5b68a41640 1 --2- 172.21.15.17:0/2977584043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b64161510 0x7f5b6415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.193+0000 7f5b69242640 1 --2- 172.21.15.17:0/2977584043 >> v2:172.21.15.142:3300/0 conn(0x7f5b6415cc30 0x7f5b64160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.194+0000 7f5b5bfff640 1 -- 172.21.15.17:0/2977584043 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863558748 0 0) 0x7f5b64160860 con 0x7f5b64072850 2023-08-09T12:40:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.194+0000 7f5b5bfff640 1 -- 172.21.15.17:0/2977584043 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b50003520 con 0x7f5b64072850 2023-08-09T12:40:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.194+0000 7f5b68a41640 1 -- 172.21.15.17:0/2977584043 >> v2:172.21.15.142:3300/0 conn(0x7f5b6415cc30 msgr2=0x7f5b64160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.194+0000 7f5b68a41640 1 --2- 172.21.15.17:0/2977584043 >> v2:172.21.15.142:3300/0 conn(0x7f5b6415cc30 0x7f5b64160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.194+0000 7f5b68a41640 1 -- 172.21.15.17:0/2977584043 >> v1:172.21.15.17:6789/0 conn(0x7f5b64072850 legacy=0x7f5b640697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.194+0000 7f5b68a41640 1 -- 172.21.15.17:0/2977584043 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6415ddc0 con 0x7f5b64161510 2023-08-09T12:40:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.195+0000 7f5b68a41640 1 --2- 172.21.15.17:0/2977584043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b64161510 0x7f5b6415d010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b540097a0 tx=0x7f5b5402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ee11ab03dba7a42 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.196+0000 7f5b5bfff640 1 -- 172.21.15.17:0/2977584043 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54031780 con 0x7f5b64161510 2023-08-09T12:40:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.196+0000 7f5b5bfff640 1 -- 172.21.15.17:0/2977584043 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b540318e0 con 0x7f5b64161510 2023-08-09T12:40:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.196+0000 7f5b5bfff640 1 -- 172.21.15.17:0/2977584043 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54031c70 con 0x7f5b64161510 2023-08-09T12:40:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.196+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/2977584043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b64161510 msgr2=0x7f5b6415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.196+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/2977584043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b64161510 0x7f5b6415d010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b540097a0 tx=0x7f5b5402b820 comp rx=0 tx=0).stop 2023-08-09T12:40:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.197+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/2977584043 shutdown_connections 2023-08-09T12:40:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.197+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/2977584043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b64161510 0x7f5b6415d010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.197+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/2977584043 >> v2:172.21.15.142:3300/0 conn(0x7f5b6415cc30 0x7f5b64160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.197+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/2977584043 >> 172.21.15.17:0/2977584043 conn(0x7f5b640cc2e0 msgr2=0x7f5b640cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:08.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.197+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/2977584043 shutdown_connections 2023-08-09T12:40:08.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.197+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/2977584043 wait complete. 2023-08-09T12:40:08.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.198+0000 7f5b6b4a6640 1 Processor -- start 2023-08-09T12:40:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.199+0000 7f5b6b4a6640 1 -- start start 2023-08-09T12:40:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b6b4a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b64072850 0x7f5b641477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b6b4a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b6415cc30 0x7f5b640b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b6b4a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b640b1780 0x7f5b6414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b6b4a6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640b1c30 con 0x7f5b640b1780 2023-08-09T12:40:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b6b4a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64147d00 con 0x7f5b64072850 2023-08-09T12:40:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b6b4a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b641fa700 con 0x7f5b6415cc30 2023-08-09T12:40:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b69a43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b640b1780 0x7f5b6414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b69a43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b640b1780 0x7f5b6414a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49602/0 (socket says 172.21.15.17:49602) 2023-08-09T12:40:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b69a43640 1 -- 172.21.15.17:0/472447788 learned_addr learned my addr 172.21.15.17:0/472447788 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b68a41640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b6415cc30 0x7f5b640b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.200+0000 7f5b69242640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b64072850 0x7f5b641477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b69a43640 1 -- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b6415cc30 msgr2=0x7f5b640b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b69a43640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b6415cc30 0x7f5b640b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b69a43640 1 -- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b64072850 msgr2=0x7f5b641477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b69a43640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b64072850 0x7f5b641477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b69a43640 1 -- 172.21.15.17:0/472447788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54009400 con 0x7f5b640b1780 2023-08-09T12:40:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b69242640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b64072850 0x7f5b641477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b69a43640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b640b1780 0x7f5b6414a1e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00cb10 tx=0x7f5b5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b59ffb640 1 -- 172.21.15.17:0/472447788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00ac10 con 0x7f5b640b1780 2023-08-09T12:40:08.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b59ffb640 1 -- 172.21.15.17:0/472447788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00ad70 con 0x7f5b640b1780 2023-08-09T12:40:08.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6414af30 con 0x7f5b640b1780 2023-08-09T12:40:08.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b59ffb640 1 -- 172.21.15.17:0/472447788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c012620 con 0x7f5b640b1780 2023-08-09T12:40:08.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.201+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b641fa0b0 con 0x7f5b640b1780 2023-08-09T12:40:08.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.203+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b64067a80 con 0x7f5b640b1780 2023-08-09T12:40:08.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.204+0000 7f5b59ffb640 1 -- 172.21.15.17:0/472447788 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b5c007070 con 0x7f5b640b1780 2023-08-09T12:40:08.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.205+0000 7f5b59ffb640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b4806a050 0x7f5b4806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.205+0000 7f5b59ffb640 1 -- 172.21.15.17:0/472447788 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b5c088610 con 0x7f5b640b1780 2023-08-09T12:40:08.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.206+0000 7f5b69242640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b4806a050 0x7f5b4806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.207+0000 7f5b69242640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b4806a050 0x7f5b4806c510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009ac0 tx=0x7f5b60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.210+0000 7f5b59ffb640 1 -- 172.21.15.17:0/472447788 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5b5c0576f0 con 0x7f5b640b1780 2023-08-09T12:40:08.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.404+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b641fa840 con 0x7f5b640b1780 2023-08-09T12:40:08.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.404+0000 7f5b59ffb640 1 -- 172.21.15.17:0/472447788 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b5c017020 con 0x7f5b640b1780 2023-08-09T12:40:08.408 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:08.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.407+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b4806a050 msgr2=0x7f5b4806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.407+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b4806a050 0x7f5b4806c510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009ac0 tx=0x7f5b60008040 comp rx=0 tx=0).stop 2023-08-09T12:40:08.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.407+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b640b1780 msgr2=0x7f5b6414a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.407+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b640b1780 0x7f5b6414a1e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00cb10 tx=0x7f5b5c00a060 comp rx=0 tx=0).stop 2023-08-09T12:40:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.408+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 shutdown_connections 2023-08-09T12:40:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.408+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b4806a050 0x7f5b4806c510 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.408+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b640b1780 0x7f5b6414a1e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.408+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b6415cc30 0x7f5b640b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.408+0000 7f5b6b4a6640 1 --2- 172.21.15.17:0/472447788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b64072850 0x7f5b641477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.408+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 >> 172.21.15.17:0/472447788 conn(0x7f5b640cc2e0 msgr2=0x7f5b640cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:08.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.408+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 shutdown_connections 2023-08-09T12:40:08.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.408+0000 7f5b6b4a6640 1 -- 172.21.15.17:0/472447788 wait complete. 2023-08-09T12:40:08.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:08.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.660+0000 7f139b4b8640 1 Processor -- start 2023-08-09T12:40:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.660+0000 7f139b4b8640 1 -- start start 2023-08-09T12:40:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.662+0000 7f139b4b8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139406ac80 0x7f139406b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.662+0000 7f139b4b8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13940cb100 0x7f139406b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.662+0000 7f139b4b8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139406bae0 con 0x7f139415ac40 2023-08-09T12:40:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.662+0000 7f139b4b8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13940adbd0 con 0x7f13940cb100 2023-08-09T12:40:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.662+0000 7f139b4b8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139415b170 con 0x7f139406ac80 2023-08-09T12:40:08.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.663+0000 7f1398a53640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f139415ac40 0x7f13940b1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55260/0 (socket says 172.21.15.17:55260) 2023-08-09T12:40:08.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.663+0000 7f1398a53640 1 -- 172.21.15.17:0/3757777081 learned_addr learned my addr 172.21.15.17:0/3757777081 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.663+0000 7f1399254640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139406ac80 0x7f139406b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.663+0000 7f1399a55640 1 --2- 172.21.15.17:0/3757777081 >> v2:172.21.15.142:3300/0 conn(0x7f13940cb100 0x7f139406b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.663+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895425491 0 0) 0x7f139406bae0 con 0x7f139415ac40 2023-08-09T12:40:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.663+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1380003520 con 0x7f139415ac40 2023-08-09T12:40:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.663+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 270965445 0 0) 0x7f1380003520 con 0x7f139415ac40 2023-08-09T12:40:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139406ac80 msgr2=0x7f139406b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:08.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139406ac80 0x7f139406b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 >> v2:172.21.15.142:3300/0 conn(0x7f13940cb100 msgr2=0x7f139406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:08.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 --2- 172.21.15.17:0/3757777081 >> v2:172.21.15.142:3300/0 conn(0x7f13940cb100 0x7f139406b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139415b450 con 0x7f139415ac40 2023-08-09T12:40:08.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1384001670 con 0x7f139415ac40 2023-08-09T12:40:08.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 >> v1:172.21.15.17:6789/0 conn(0x7f139415ac40 legacy=0x7f13940b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139406ac80 0x7f1380003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1380003ef0 0x7f13800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1380004d00 0x7f1380005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940adbd0 con 0x7f1380003ef0 2023-08-09T12:40:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139415b170 con 0x7f1380004d00 2023-08-09T12:40:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138000b980 con 0x7f139406ac80 2023-08-09T12:40:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f1398a53640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1380003ef0 0x7f13800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f1399a55640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1380004d00 0x7f1380005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f1398a53640 1 -- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139406ac80 msgr2=0x7f1380003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f1398a53640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139406ac80 0x7f1380003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f1398a53640 1 -- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1380004d00 msgr2=0x7f1380005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:08.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f1398a53640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1380004d00 0x7f1380005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.664+0000 7f1398a53640 1 -- 172.21.15.17:0/3757777081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380003520 con 0x7f1380003ef0 2023-08-09T12:40:08.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.666+0000 7f1398a53640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1380003ef0 0x7f13800047c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f139415b0a0 tx=0x7f13800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c2e28d4e47522f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:08.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.666+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384005ad0 con 0x7f1380003ef0 2023-08-09T12:40:08.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.666+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1384005c30 con 0x7f1380003ef0 2023-08-09T12:40:08.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.666+0000 7f138bfff640 1 -- 172.21.15.17:0/3757777081 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138402c880 con 0x7f1380003ef0 2023-08-09T12:40:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.666+0000 7f139b4b8640 1 -- 172.21.15.17:0/3757777081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1380003ef0 msgr2=0x7f13800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.666+0000 7f139b4b8640 1 --2- 172.21.15.17:0/3757777081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1380003ef0 0x7f13800047c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f139415b0a0 tx=0x7f13800057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.666+0000 7f1399a55640 1 -- 172.21.15.17:0/3757777081 reap_dead start 2023-08-09T12:40:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.667+0000 7f139b4b8640 1 -- 172.21.15.17:0/3757777081 shutdown_connections 2023-08-09T12:40:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.667+0000 7f139b4b8640 1 -- 172.21.15.17:0/3757777081 >> 172.21.15.17:0/3757777081 conn(0x7f13940697c0 msgr2=0x7f1394069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.667+0000 7f139b4b8640 1 -- 172.21.15.17:0/3757777081 shutdown_connections 2023-08-09T12:40:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.667+0000 7f139b4b8640 1 -- 172.21.15.17:0/3757777081 wait complete. 2023-08-09T12:40:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.669+0000 7f139b4b8640 1 Processor -- start 2023-08-09T12:40:08.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.669+0000 7f139b4b8640 1 -- start start 2023-08-09T12:40:08.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f139b4b8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1380003ef0 0x7f13941f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f139b4b8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394159780 0x7f1394158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f139b4b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940a8700 0x7f1394152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f139b4b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1394158360 con 0x7f13940a8700 2023-08-09T12:40:08.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f139b4b8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13941f11b0 con 0x7f1394159780 2023-08-09T12:40:08.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f139b4b8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13941576e0 con 0x7f1380003ef0 2023-08-09T12:40:08.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f1399a55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940a8700 0x7f1394152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f1399a55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940a8700 0x7f1394152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49618/0 (socket says 172.21.15.17:49618) 2023-08-09T12:40:08.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.670+0000 7f1399a55640 1 -- 172.21.15.17:0/3633621027 learned_addr learned my addr 172.21.15.17:0/3633621027 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:08.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.671+0000 7f1399a55640 1 -- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1380003ef0 msgr2=0x7f13941f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.671+0000 7f1399a55640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1380003ef0 0x7f13941f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.671+0000 7f1399a55640 1 -- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394159780 msgr2=0x7f1394158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.671+0000 7f1398a53640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394159780 0x7f1394158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.671+0000 7f1399a55640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394159780 0x7f1394158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.671+0000 7f1399a55640 1 -- 172.21.15.17:0/3633621027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13941579c0 con 0x7f13940a8700 2023-08-09T12:40:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.671+0000 7f1398a53640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394159780 0x7f1394158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.671+0000 7f1399a55640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940a8700 0x7f1394152970 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f139406d0a0 tx=0x7f138c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.672+0000 7f1389ffb640 1 -- 172.21.15.17:0/3633621027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c016620 con 0x7f13940a8700 2023-08-09T12:40:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.672+0000 7f1389ffb640 1 -- 172.21.15.17:0/3633621027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c0167a0 con 0x7f13940a8700 2023-08-09T12:40:08.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.672+0000 7f1389ffb640 1 -- 172.21.15.17:0/3633621027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c016b50 con 0x7f13940a8700 2023-08-09T12:40:08.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.672+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1394157ca0 con 0x7f13940a8700 2023-08-09T12:40:08.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.672+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1394158cc0 con 0x7f13940a8700 2023-08-09T12:40:08.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.673+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13941584a0 con 0x7f13940a8700 2023-08-09T12:40:08.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.674+0000 7f1389ffb640 1 -- 172.21.15.17:0/3633621027 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f138c016cb0 con 0x7f13940a8700 2023-08-09T12:40:08.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.675+0000 7f1389ffb640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f137806a050 0x7f137806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:08.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.675+0000 7f1389ffb640 1 -- 172.21.15.17:0/3633621027 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f138c089380 con 0x7f13940a8700 2023-08-09T12:40:08.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.675+0000 7f1399254640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f137806a050 0x7f137806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:08.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.677+0000 7f1399254640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f137806a050 0x7f137806c510 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1390006e80 tx=0x7f1390006dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:08.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.679+0000 7f1389ffb640 1 -- 172.21.15.17:0/3633621027 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f13941584a0 con 0x7f13940a8700 2023-08-09T12:40:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.877+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13941584a0 con 0x7f13940a8700 2023-08-09T12:40:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.878+0000 7f1389ffb640 1 -- 172.21.15.17:0/3633621027 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13941584a0 con 0x7f13940a8700 2023-08-09T12:40:08.881 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:08.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.880+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f137806a050 msgr2=0x7f137806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.880+0000 7f139b4b8640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f137806a050 0x7f137806c510 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1390006e80 tx=0x7f1390006dd0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.880+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940a8700 msgr2=0x7f1394152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:08.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.880+0000 7f139b4b8640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940a8700 0x7f1394152970 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f139406d0a0 tx=0x7f138c00f520 comp rx=0 tx=0).stop 2023-08-09T12:40:08.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.881+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 shutdown_connections 2023-08-09T12:40:08.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.881+0000 7f139b4b8640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f137806a050 0x7f137806c510 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.881+0000 7f139b4b8640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940a8700 0x7f1394152970 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.881+0000 7f139b4b8640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394159780 0x7f1394158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.881+0000 7f139b4b8640 1 --2- 172.21.15.17:0/3633621027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1380003ef0 0x7f13941f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:08.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.881+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 >> 172.21.15.17:0/3633621027 conn(0x7f13940697c0 msgr2=0x7f13940cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:08.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.881+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 shutdown_connections 2023-08-09T12:40:08.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:08.881+0000 7f139b4b8640 1 -- 172.21.15.17:0/3633621027 wait complete. 2023-08-09T12:40:08.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:09.015 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:40:09.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:40:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.125+0000 7f364dc8e640 1 Processor -- start 2023-08-09T12:40:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.125+0000 7f364dc8e640 1 -- start start 2023-08-09T12:40:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.127+0000 7f364dc8e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36480cce70 0x7f3648072e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.127+0000 7f364dc8e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3648073350 0x7f36480cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.127+0000 7f364dc8e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480b5840 con 0x7f364815d260 2023-08-09T12:40:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.127+0000 7f364dc8e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36480737c0 con 0x7f36480cce70 2023-08-09T12:40:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.127+0000 7f364dc8e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3648161ac0 con 0x7f3648073350 2023-08-09T12:40:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.128+0000 7f3647fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3648073350 0x7f36480cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.128+0000 7f3646ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36480cce70 0x7f3648072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.128+0000 7f3647fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3648073350 0x7f36480cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:47436/0 (socket says 172.21.15.17:47436) 2023-08-09T12:40:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.128+0000 7f3647fff640 1 -- 172.21.15.17:0/4242582552 learned_addr learned my addr 172.21.15.17:0/4242582552 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.128+0000 7f3647fff640 1 -- 172.21.15.17:0/4242582552 >> v2:172.21.15.142:3300/0 conn(0x7f36480cce70 msgr2=0x7f3648072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.128+0000 7f3647fff640 1 --2- 172.21.15.17:0/4242582552 >> v2:172.21.15.142:3300/0 conn(0x7f36480cce70 0x7f3648072e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.128+0000 7f3647fff640 1 -- 172.21.15.17:0/4242582552 >> v1:172.21.15.142:6789/0 conn(0x7f364815d260 legacy=0x7f36480697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.128+0000 7f3647fff640 1 -- 172.21.15.17:0/4242582552 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480b5280 con 0x7f3648073350 2023-08-09T12:40:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.130+0000 7f3647fff640 1 --2- 172.21.15.17:0/4242582552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3648073350 0x7f36480cb3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3640009e50 tx=0x7f364002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5deec9a958396e72 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.130+0000 7f36467fc640 1 -- 172.21.15.17:0/4242582552 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364002cb00 con 0x7f3648073350 2023-08-09T12:40:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.130+0000 7f36467fc640 1 -- 172.21.15.17:0/4242582552 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364002cc60 con 0x7f3648073350 2023-08-09T12:40:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.130+0000 7f36467fc640 1 -- 172.21.15.17:0/4242582552 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400343f0 con 0x7f3648073350 2023-08-09T12:40:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.130+0000 7f364dc8e640 1 -- 172.21.15.17:0/4242582552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3648073350 msgr2=0x7f36480cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.130+0000 7f364dc8e640 1 --2- 172.21.15.17:0/4242582552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3648073350 0x7f36480cb3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3640009e50 tx=0x7f364002bf60 comp rx=0 tx=0).stop 2023-08-09T12:40:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.131+0000 7f364dc8e640 1 -- 172.21.15.17:0/4242582552 shutdown_connections 2023-08-09T12:40:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.131+0000 7f364dc8e640 1 --2- 172.21.15.17:0/4242582552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3648073350 0x7f36480cb3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.131+0000 7f364dc8e640 1 --2- 172.21.15.17:0/4242582552 >> v2:172.21.15.142:3300/0 conn(0x7f36480cce70 0x7f3648072e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.131+0000 7f364dc8e640 1 -- 172.21.15.17:0/4242582552 >> 172.21.15.17:0/4242582552 conn(0x7f36480cc350 msgr2=0x7f36480cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.131+0000 7f364dc8e640 1 -- 172.21.15.17:0/4242582552 shutdown_connections 2023-08-09T12:40:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.131+0000 7f364dc8e640 1 -- 172.21.15.17:0/4242582552 wait complete. 2023-08-09T12:40:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.132+0000 7f364dc8e640 1 Processor -- start 2023-08-09T12:40:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.133+0000 7f364dc8e640 1 -- start start 2023-08-09T12:40:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.133+0000 7f364dc8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648073350 0x7f36481600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f364dc8e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cce70 0x7f364815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f364dc8e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364815d260 0x7f3648154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f364dc8e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364815c8e0 con 0x7f3648073350 2023-08-09T12:40:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f364dc8e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364815caf0 con 0x7f364815d260 2023-08-09T12:40:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f364dc8e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480c8550 con 0x7f36480cce70 2023-08-09T12:40:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f36477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648073350 0x7f36481600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f36477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648073350 0x7f36481600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49634/0 (socket says 172.21.15.17:49634) 2023-08-09T12:40:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f36477fe640 1 -- 172.21.15.17:0/162612725 learned_addr learned my addr 172.21.15.17:0/162612725 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f3646ffd640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cce70 0x7f364815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f3647fff640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364815d260 0x7f3648154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f36477fe640 1 -- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cce70 msgr2=0x7f364815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f36477fe640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cce70 0x7f364815c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f36477fe640 1 -- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364815d260 msgr2=0x7f3648154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f36477fe640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364815d260 0x7f3648154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f36477fe640 1 -- 172.21.15.17:0/162612725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009b30 con 0x7f3648073350 2023-08-09T12:40:09.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.134+0000 7f3646ffd640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cce70 0x7f364815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:09.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.135+0000 7f36477fe640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648073350 0x7f36481600f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f363800c400 tx=0x7f363800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.135+0000 7f362ffff640 1 -- 172.21.15.17:0/162612725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380052d0 con 0x7f3648073350 2023-08-09T12:40:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.135+0000 7f362ffff640 1 -- 172.21.15.17:0/162612725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3638005430 con 0x7f3648073350 2023-08-09T12:40:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.135+0000 7f362ffff640 1 -- 172.21.15.17:0/162612725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638003830 con 0x7f3648073350 2023-08-09T12:40:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.135+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36480c8830 con 0x7f3648073350 2023-08-09T12:40:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.135+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36480c8df0 con 0x7f3648073350 2023-08-09T12:40:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.136+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36480c9010 con 0x7f3648073350 2023-08-09T12:40:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.137+0000 7f362ffff640 1 -- 172.21.15.17:0/162612725 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3638003990 con 0x7f3648073350 2023-08-09T12:40:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.138+0000 7f362ffff640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f363406a080 0x7f363406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.138+0000 7f362ffff640 1 -- 172.21.15.17:0/162612725 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3638087be0 con 0x7f3648073350 2023-08-09T12:40:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.139+0000 7f3646ffd640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f363406a080 0x7f363406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.140+0000 7f3646ffd640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f363406a080 0x7f363406c540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f36480c7780 tx=0x7f363c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.142+0000 7f362ffff640 1 -- 172.21.15.17:0/162612725 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f36380531f0 con 0x7f3648073350 2023-08-09T12:40:09.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.340+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3648069e70 con 0x7f3648073350 2023-08-09T12:40:09.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.341+0000 7f362ffff640 1 -- 172.21.15.17:0/162612725 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3638056810 con 0x7f3648073350 2023-08-09T12:40:09.344 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.343+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f363406a080 msgr2=0x7f363406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.343+0000 7f364dc8e640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f363406a080 0x7f363406c540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f36480c7780 tx=0x7f363c008040 comp rx=0 tx=0).stop 2023-08-09T12:40:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.343+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648073350 msgr2=0x7f36481600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.343+0000 7f364dc8e640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648073350 0x7f36481600f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f363800c400 tx=0x7f363800c8c0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.344+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 shutdown_connections 2023-08-09T12:40:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.344+0000 7f364dc8e640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f363406a080 0x7f363406c540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.344+0000 7f364dc8e640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364815d260 0x7f3648154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.344+0000 7f364dc8e640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cce70 0x7f364815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.344+0000 7f364dc8e640 1 --2- 172.21.15.17:0/162612725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648073350 0x7f36481600f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.344+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 >> 172.21.15.17:0/162612725 conn(0x7f36480cc350 msgr2=0x7f36480cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:09.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.344+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 shutdown_connections 2023-08-09T12:40:09.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.344+0000 7f364dc8e640 1 -- 172.21.15.17:0/162612725 wait complete. 2023-08-09T12:40:09.365 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:40:09.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.630+0000 7f59da699640 1 Processor -- start 2023-08-09T12:40:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.630+0000 7f59da699640 1 -- start start 2023-08-09T12:40:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.632+0000 7f59da699640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 0x7f59d415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.632+0000 7f59da699640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f59d406c070 0x7f59d40cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.632+0000 7f59da699640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d415e240 con 0x7f59d40cb6c0 2023-08-09T12:40:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.632+0000 7f59da699640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d41577c0 con 0x7f59d406c070 2023-08-09T12:40:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.632+0000 7f59da699640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d415d240 con 0x7f59d41573e0 2023-08-09T12:40:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.632+0000 7f59d37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f59d406c070 0x7f59d40cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d8c36640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f59d40cb6c0 0x7f59d40ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55274/0 (socket says 172.21.15.17:55274) 2023-08-09T12:40:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d8c36640 1 -- 172.21.15.17:0/2735915490 learned_addr learned my addr 172.21.15.17:0/2735915490 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d3fff640 1 --2- 172.21.15.17:0/2735915490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 0x7f59d415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d2ffd640 1 -- 172.21.15.17:0/2735915490 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498369508 0 0) 0x7f59cc001490 con 0x7f59d40cb6c0 2023-08-09T12:40:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d2ffd640 1 -- 172.21.15.17:0/2735915490 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59bc003520 con 0x7f59d40cb6c0 2023-08-09T12:40:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d37fe640 1 -- 172.21.15.17:0/2735915490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 msgr2=0x7f59d415dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d37fe640 1 --2- 172.21.15.17:0/2735915490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 0x7f59d415dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d37fe640 1 -- 172.21.15.17:0/2735915490 >> v1:172.21.15.17:6789/0 conn(0x7f59d40cb6c0 legacy=0x7f59d40ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.633+0000 7f59d37fe640 1 -- 172.21.15.17:0/2735915490 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d40cbb90 con 0x7f59d406c070 2023-08-09T12:40:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.635+0000 7f59d37fe640 1 --2- 172.21.15.17:0/2735915490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40cb180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f59c80097a0 tx=0x7f59c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178eed1d72a6fcd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.635+0000 7f59d2ffd640 1 -- 172.21.15.17:0/2735915490 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c802e070 con 0x7f59d406c070 2023-08-09T12:40:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.635+0000 7f59d2ffd640 1 -- 172.21.15.17:0/2735915490 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c80315a0 con 0x7f59d406c070 2023-08-09T12:40:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.635+0000 7f59d2ffd640 1 -- 172.21.15.17:0/2735915490 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8031930 con 0x7f59d406c070 2023-08-09T12:40:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.636+0000 7f59da699640 1 -- 172.21.15.17:0/2735915490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 msgr2=0x7f59d40cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.636+0000 7f59da699640 1 --2- 172.21.15.17:0/2735915490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40cb180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f59c80097a0 tx=0x7f59c802b840 comp rx=0 tx=0).stop 2023-08-09T12:40:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.636+0000 7f59da699640 1 -- 172.21.15.17:0/2735915490 shutdown_connections 2023-08-09T12:40:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.636+0000 7f59da699640 1 --2- 172.21.15.17:0/2735915490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40cb180 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.636+0000 7f59da699640 1 --2- 172.21.15.17:0/2735915490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 0x7f59d415dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.636+0000 7f59da699640 1 -- 172.21.15.17:0/2735915490 >> 172.21.15.17:0/2735915490 conn(0x7f59d4069be0 msgr2=0x7f59d4069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.636+0000 7f59da699640 1 -- 172.21.15.17:0/2735915490 shutdown_connections 2023-08-09T12:40:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.636+0000 7f59da699640 1 -- 172.21.15.17:0/2735915490 wait complete. 2023-08-09T12:40:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.638+0000 7f59da699640 1 Processor -- start 2023-08-09T12:40:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.638+0000 7f59da699640 1 -- start start 2023-08-09T12:40:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59da699640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59da699640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59d40cb6c0 0x7f59d40cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59da699640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 0x7f59d41586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59da699640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d4157fa0 con 0x7f59d406c070 2023-08-09T12:40:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59da699640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d415baa0 con 0x7f59d40cb6c0 2023-08-09T12:40:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59da699640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d4148d40 con 0x7f59d41573e0 2023-08-09T12:40:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49650/0 (socket says 172.21.15.17:49650) 2023-08-09T12:40:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.639+0000 7f59d3fff640 1 -- 172.21.15.17:0/1441156153 learned_addr learned my addr 172.21.15.17:0/1441156153 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d3fff640 1 -- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 msgr2=0x7f59d41586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d3fff640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 0x7f59d41586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d3fff640 1 -- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59d40cb6c0 msgr2=0x7f59d40cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d3fff640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59d40cb6c0 0x7f59d40cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d3fff640 1 -- 172.21.15.17:0/1441156153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8009400 con 0x7f59d406c070 2023-08-09T12:40:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d3fff640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40b1440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f59c400ea10 tx=0x7f59c400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d0ff9640 1 -- 172.21.15.17:0/1441156153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400ca00 con 0x7f59d406c070 2023-08-09T12:40:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d0ff9640 1 -- 172.21.15.17:0/1441156153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c400cb60 con 0x7f59d406c070 2023-08-09T12:40:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d4157cc0 con 0x7f59d406c070 2023-08-09T12:40:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59d0ff9640 1 -- 172.21.15.17:0/1441156153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4013470 con 0x7f59d406c070 2023-08-09T12:40:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.640+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d415b730 con 0x7f59d406c070 2023-08-09T12:40:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.642+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d415b2b0 con 0x7f59d406c070 2023-08-09T12:40:09.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.642+0000 7f59d0ff9640 1 -- 172.21.15.17:0/1441156153 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f59c40135d0 con 0x7f59d406c070 2023-08-09T12:40:09.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.643+0000 7f59d0ff9640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c006a050 0x7f59c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:09.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.643+0000 7f59d0ff9640 1 -- 172.21.15.17:0/1441156153 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f59c4088780 con 0x7f59d406c070 2023-08-09T12:40:09.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.644+0000 7f59d37fe640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c006a050 0x7f59c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:09.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.645+0000 7f59d37fe640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c006a050 0x7f59c006c510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f59c8036000 tx=0x7f59c8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.648+0000 7f59d0ff9640 1 -- 172.21.15.17:0/1441156153 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f59d415b2b0 con 0x7f59d406c070 2023-08-09T12:40:09.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.848+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f59d415b2b0 con 0x7f59d406c070 2023-08-09T12:40:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.854+0000 7f59d0ff9640 1 -- 172.21.15.17:0/1441156153 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59d415b2b0 con 0x7f59d406c070 2023-08-09T12:40:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c006a050 msgr2=0x7f59c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c006a050 0x7f59c006c510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f59c8036000 tx=0x7f59c8030000 comp rx=0 tx=0).stop 2023-08-09T12:40:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 msgr2=0x7f59d40b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40b1440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f59c400ea10 tx=0x7f59c400eed0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 shutdown_connections 2023-08-09T12:40:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c006a050 0x7f59c006c510 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59d41573e0 0x7f59d41586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59d40cb6c0 0x7f59d40cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 --2- 172.21.15.17:0/1441156153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d406c070 0x7f59d40b1440 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.857+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 >> 172.21.15.17:0/1441156153 conn(0x7f59d4069be0 msgr2=0x7f59d415fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.858+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 shutdown_connections 2023-08-09T12:40:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:09.858+0000 7f59da699640 1 -- 172.21.15.17:0/1441156153 wait complete. 2023-08-09T12:40:09.878 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:40:09.879 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:40:09.998 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:40:10.122 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:40:10.123 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:10.124 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:10.187 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:10.188 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:10.246 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:10.246 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:10.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:10.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.532+0000 7f61a7bd2640 1 Processor -- start 2023-08-09T12:40:10.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.533+0000 7f61a7bd2640 1 -- start start 2023-08-09T12:40:10.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.534+0000 7f61a7bd2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61a00b3b40 0x7f61a00b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:10.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.534+0000 7f61a7bd2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a006c990 con 0x7f61a00adc40 2023-08-09T12:40:10.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.534+0000 7f61a7bd2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a00b2250 con 0x7f61a00cc630 2023-08-09T12:40:10.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.534+0000 7f61a7bd2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a00ae020 con 0x7f61a00b3b40 2023-08-09T12:40:10.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.535+0000 7f61a516d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61a00b3b40 0x7f61a00b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:10.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.535+0000 7f61a516d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61a00b3b40 0x7f61a00b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49652/0 (socket says 172.21.15.17:49652) 2023-08-09T12:40:10.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.535+0000 7f61a516d640 1 -- 172.21.15.17:0/2038312102 learned_addr learned my addr 172.21.15.17:0/2038312102 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:10.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.535+0000 7f61a596e640 1 --1- 172.21.15.17:0/2038312102 >> v1:172.21.15.17:6789/0 conn(0x7f61a00adc40 0x7f61a006c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55284/0 (socket says 172.21.15.17:55284) 2023-08-09T12:40:10.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.535+0000 7f61a516d640 1 -- 172.21.15.17:0/2038312102 >> v1:172.21.15.142:6789/0 conn(0x7f61a00cc630 legacy=0x7f61a00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:10.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.535+0000 7f61a516d640 1 -- 172.21.15.17:0/2038312102 >> v1:172.21.15.17:6789/0 conn(0x7f61a00adc40 legacy=0x7f61a006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:10.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.535+0000 7f61a516d640 1 -- 172.21.15.17:0/2038312102 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00b2530 con 0x7f61a00b3b40 2023-08-09T12:40:10.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.536+0000 7f61a516d640 1 --2- 172.21.15.17:0/2038312102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a00b3fd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6190009850 tx=0x7f619002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9bc415ce5eb3e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:10.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.537+0000 7f61a496c640 1 -- 172.21.15.17:0/2038312102 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190004230 con 0x7f61a00b3b40 2023-08-09T12:40:10.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.537+0000 7f61a496c640 1 -- 172.21.15.17:0/2038312102 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190004390 con 0x7f61a00b3b40 2023-08-09T12:40:10.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.537+0000 7f61a496c640 1 -- 172.21.15.17:0/2038312102 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190030840 con 0x7f61a00b3b40 2023-08-09T12:40:10.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.537+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2038312102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 msgr2=0x7f61a00b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:10.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.537+0000 7f61a7bd2640 1 --2- 172.21.15.17:0/2038312102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a00b3fd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6190009850 tx=0x7f619002b980 comp rx=0 tx=0).stop 2023-08-09T12:40:10.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.537+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2038312102 shutdown_connections 2023-08-09T12:40:10.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.537+0000 7f61a7bd2640 1 --2- 172.21.15.17:0/2038312102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a00b3fd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.537+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2038312102 >> 172.21.15.17:0/2038312102 conn(0x7f61a00cb1b0 msgr2=0x7f61a00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:10.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.538+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2038312102 shutdown_connections 2023-08-09T12:40:10.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.538+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2038312102 wait complete. 2023-08-09T12:40:10.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.539+0000 7f61a7bd2640 1 Processor -- start 2023-08-09T12:40:10.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.539+0000 7f61a7bd2640 1 -- start start 2023-08-09T12:40:10.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.540+0000 7f61a7bd2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61a00adc40 0x7f61a00c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:10.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.540+0000 7f61a7bd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a0153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:10.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.540+0000 7f61a7bd2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a00cc630 0x7f61a01f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:10.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.540+0000 7f61a7bd2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a01544a0 con 0x7f61a00b3b40 2023-08-09T12:40:10.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.540+0000 7f61a7bd2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00c9100 con 0x7f61a00cc630 2023-08-09T12:40:10.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.540+0000 7f61a7bd2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00c6180 con 0x7f61a00adc40 2023-08-09T12:40:10.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a516d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a0153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:10.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a516d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a0153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49658/0 (socket says 172.21.15.17:49658) 2023-08-09T12:40:10.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a516d640 1 -- 172.21.15.17:0/2741280436 learned_addr learned my addr 172.21.15.17:0/2741280436 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:10.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a616f640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a00cc630 0x7f61a01f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:10.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a516d640 1 -- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61a00adc40 msgr2=0x7f61a00c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:10.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a516d640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61a00adc40 0x7f61a00c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a516d640 1 -- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a00cc630 msgr2=0x7f61a01f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:10.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a516d640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a00cc630 0x7f61a01f1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a516d640 1 -- 172.21.15.17:0/2741280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190009460 con 0x7f61a00b3b40 2023-08-09T12:40:10.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.541+0000 7f61a616f640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a00cc630 0x7f61a01f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:10.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.542+0000 7f61a516d640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a0153f60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6190000c00 tx=0x7f61900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:10.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.542+0000 7f61967fc640 1 -- 172.21.15.17:0/2741280436 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619003e070 con 0x7f61a00b3b40 2023-08-09T12:40:10.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.542+0000 7f61967fc640 1 -- 172.21.15.17:0/2741280436 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190004500 con 0x7f61a00b3b40 2023-08-09T12:40:10.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.542+0000 7f61967fc640 1 -- 172.21.15.17:0/2741280436 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190030e40 con 0x7f61a00b3b40 2023-08-09T12:40:10.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.542+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a00c6460 con 0x7f61a00b3b40 2023-08-09T12:40:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.542+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a00c6740 con 0x7f61a00b3b40 2023-08-09T12:40:10.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.543+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a0067a80 con 0x7f61a00b3b40 2023-08-09T12:40:10.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.544+0000 7f61967fc640 1 -- 172.21.15.17:0/2741280436 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6190003610 con 0x7f61a00b3b40 2023-08-09T12:40:10.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.545+0000 7f61967fc640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f618406a050 0x7f618406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:10.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.545+0000 7f61967fc640 1 -- 172.21.15.17:0/2741280436 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f61900aa810 con 0x7f61a00b3b40 2023-08-09T12:40:10.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.546+0000 7f61a596e640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f618406a050 0x7f618406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:10.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.547+0000 7f61a596e640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f618406a050 0x7f618406c510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f619c0015e0 tx=0x7f619c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:10.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.550+0000 7f61967fc640 1 -- 172.21.15.17:0/2741280436 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6190075f40 con 0x7f61a00b3b40 2023-08-09T12:40:10.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.744+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61a006ed40 con 0x7f61a00b3b40 2023-08-09T12:40:10.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.747+0000 7f61967fc640 1 -- 172.21.15.17:0/2741280436 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f6190079560 con 0x7f61a00b3b40 2023-08-09T12:40:10.751 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:09.763656+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f618406a050 msgr2=0x7f618406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f618406a050 0x7f618406c510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f619c0015e0 tx=0x7f619c0079c0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 msgr2=0x7f61a0153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a0153f60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6190000c00 tx=0x7f61900046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 shutdown_connections 2023-08-09T12:40:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f618406a050 0x7f618406c510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a00cc630 0x7f61a01f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61a00b3b40 0x7f61a0153f60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 --2- 172.21.15.17:0/2741280436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61a00adc40 0x7f61a00c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 >> 172.21.15.17:0/2741280436 conn(0x7f61a00cb1b0 msgr2=0x7f61a0069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 shutdown_connections 2023-08-09T12:40:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:10.750+0000 7f61a7bd2640 1 -- 172.21.15.17:0/2741280436 wait complete. 2023-08-09T12:40:10.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:10.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.003+0000 7f15b3ce7640 1 Processor -- start 2023-08-09T12:40:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.003+0000 7f15b3ce7640 1 -- start start 2023-08-09T12:40:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.005+0000 7f15b3ce7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f15ac0adc40 0x7f15ac06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.005+0000 7f15b3ce7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0b3b40 0x7f15ac0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.005+0000 7f15b3ce7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15ac15e8f0 0x7f15ac15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.005+0000 7f15b3ce7640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0ae020 con 0x7f15ac0adc40 2023-08-09T12:40:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.005+0000 7f15b3ce7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0b2250 con 0x7f15ac15e8f0 2023-08-09T12:40:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.005+0000 7f15b3ce7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0b2530 con 0x7f15ac0b3b40 2023-08-09T12:40:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.005+0000 7f15b1a83640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f15ac0adc40 0x7f15ac06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b1a83640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f15ac0adc40 0x7f15ac06c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49662/0 (socket says 172.21.15.17:49662) 2023-08-09T12:40:11.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b1a83640 1 -- 172.21.15.17:0/52966398 learned_addr learned my addr 172.21.15.17:0/52966398 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:11.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b2284640 1 --2- 172.21.15.17:0/52966398 >> v2:172.21.15.142:3300/0 conn(0x7f15ac15e8f0 0x7f15ac15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b1282640 1 --2- 172.21.15.17:0/52966398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0b3b40 0x7f15ac0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b1a83640 1 -- 172.21.15.17:0/52966398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0b3b40 msgr2=0x7f15ac0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b1a83640 1 --2- 172.21.15.17:0/52966398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0b3b40 0x7f15ac0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b1a83640 1 -- 172.21.15.17:0/52966398 >> v2:172.21.15.142:3300/0 conn(0x7f15ac15e8f0 msgr2=0x7f15ac15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b1a83640 1 --2- 172.21.15.17:0/52966398 >> v2:172.21.15.142:3300/0 conn(0x7f15ac15e8f0 0x7f15ac15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.006+0000 7f15b1a83640 1 -- 172.21.15.17:0/52966398 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac06fe80 con 0x7f15ac0adc40 2023-08-09T12:40:11.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.007+0000 7f15b1a83640 1 --2- 172.21.15.17:0/52966398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0adc40 0x7f15ac06c280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0cf780 tx=0x7f15a802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7cfebcb27ec5b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.008+0000 7f15b0a81640 1 -- 172.21.15.17:0/52966398 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8031860 con 0x7f15ac0adc40 2023-08-09T12:40:11.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.008+0000 7f15b0a81640 1 -- 172.21.15.17:0/52966398 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80319c0 con 0x7f15ac0adc40 2023-08-09T12:40:11.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.008+0000 7f15b0a81640 1 -- 172.21.15.17:0/52966398 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8031d50 con 0x7f15ac0adc40 2023-08-09T12:40:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.008+0000 7f15b3ce7640 1 -- 172.21.15.17:0/52966398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0adc40 msgr2=0x7f15ac06c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.008+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/52966398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0adc40 0x7f15ac06c280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0cf780 tx=0x7f15a802b900 comp rx=0 tx=0).stop 2023-08-09T12:40:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.008+0000 7f15b3ce7640 1 -- 172.21.15.17:0/52966398 shutdown_connections 2023-08-09T12:40:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.009+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/52966398 >> v2:172.21.15.142:3300/0 conn(0x7f15ac15e8f0 0x7f15ac15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.009+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/52966398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0b3b40 0x7f15ac0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.009+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/52966398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0adc40 0x7f15ac06c280 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.009+0000 7f15b3ce7640 1 -- 172.21.15.17:0/52966398 >> 172.21.15.17:0/52966398 conn(0x7f15ac0cb1b0 msgr2=0x7f15ac0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.009+0000 7f15b3ce7640 1 -- 172.21.15.17:0/52966398 shutdown_connections 2023-08-09T12:40:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.009+0000 7f15b3ce7640 1 -- 172.21.15.17:0/52966398 wait complete. 2023-08-09T12:40:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.010+0000 7f15b3ce7640 1 Processor -- start 2023-08-09T12:40:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.011+0000 7f15b3ce7640 1 -- start start 2023-08-09T12:40:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b3ce7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0adc40 0x7f15ac14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b3ce7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0b3b40 0x7f15ac06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b3ce7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac15e8f0 0x7f15ac06aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b3ce7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac06c800 con 0x7f15ac0b3b40 2023-08-09T12:40:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b3ce7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac06c190 con 0x7f15ac15e8f0 2023-08-09T12:40:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b3ce7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac06b0f0 con 0x7f15ac0adc40 2023-08-09T12:40:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1282640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0b3b40 0x7f15ac06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1282640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0b3b40 0x7f15ac06a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49668/0 (socket says 172.21.15.17:49668) 2023-08-09T12:40:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1282640 1 -- 172.21.15.17:0/3061994853 learned_addr learned my addr 172.21.15.17:0/3061994853 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1a83640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0adc40 0x7f15ac14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b2284640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac15e8f0 0x7f15ac06aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1282640 1 -- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0adc40 msgr2=0x7f15ac14db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1282640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0adc40 0x7f15ac14db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1282640 1 -- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac15e8f0 msgr2=0x7f15ac06aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1282640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac15e8f0 0x7f15ac06aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b1282640 1 -- 172.21.15.17:0/3061994853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80094d0 con 0x7f15ac0b3b40 2023-08-09T12:40:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.012+0000 7f15b2284640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac15e8f0 0x7f15ac06aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.013+0000 7f15b1282640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0b3b40 0x7f15ac06a4e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f159c00d800 tx=0x7f159c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.013+0000 7f15a27fc640 1 -- 172.21.15.17:0/3061994853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0096a0 con 0x7f15ac0b3b40 2023-08-09T12:40:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.013+0000 7f15a27fc640 1 -- 172.21.15.17:0/3061994853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c009800 con 0x7f15ac0b3b40 2023-08-09T12:40:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.013+0000 7f15a27fc640 1 -- 172.21.15.17:0/3061994853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c009b90 con 0x7f15ac0b3b40 2023-08-09T12:40:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.013+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac06b3d0 con 0x7f15ac0b3b40 2023-08-09T12:40:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.013+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac06b990 con 0x7f15ac0b3b40 2023-08-09T12:40:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.014+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac067a80 con 0x7f15ac0b3b40 2023-08-09T12:40:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.015+0000 7f15a27fc640 1 -- 172.21.15.17:0/3061994853 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f159c009cf0 con 0x7f15ac0b3b40 2023-08-09T12:40:11.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.016+0000 7f15a27fc640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f159006a050 0x7f159006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.016+0000 7f15a27fc640 1 -- 172.21.15.17:0/3061994853 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f159c088c30 con 0x7f15ac0b3b40 2023-08-09T12:40:11.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.017+0000 7f15b1a83640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f159006a050 0x7f159006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.018+0000 7f15b1a83640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f159006a050 0x7f159006c510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15a8036000 tx=0x7f15a803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.020+0000 7f15a27fc640 1 -- 172.21.15.17:0/3061994853 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f159c057c40 con 0x7f15ac0b3b40 2023-08-09T12:40:11.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.214+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15ac06ed40 con 0x7f15ac0b3b40 2023-08-09T12:40:11.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.214+0000 7f15a27fc640 1 -- 172.21.15.17:0/3061994853 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f159c0577d0 con 0x7f15ac0b3b40 2023-08-09T12:40:11.218 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.217+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f159006a050 msgr2=0x7f159006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.217+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f159006a050 0x7f159006c510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15a8036000 tx=0x7f15a803c040 comp rx=0 tx=0).stop 2023-08-09T12:40:11.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.217+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0b3b40 msgr2=0x7f15ac06a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.217+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0b3b40 0x7f15ac06a4e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f159c00d800 tx=0x7f159c00dcc0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.218+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 shutdown_connections 2023-08-09T12:40:11.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.218+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f159006a050 0x7f159006c510 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.218+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac15e8f0 0x7f15ac06aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.218+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15ac0b3b40 0x7f15ac06a4e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.218+0000 7f15b3ce7640 1 --2- 172.21.15.17:0/3061994853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15ac0adc40 0x7f15ac14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.218+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 >> 172.21.15.17:0/3061994853 conn(0x7f15ac0cb1b0 msgr2=0x7f15ac15dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:11.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.218+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 shutdown_connections 2023-08-09T12:40:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.218+0000 7f15b3ce7640 1 -- 172.21.15.17:0/3061994853 wait complete. 2023-08-09T12:40:11.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.456+0000 7f6c0ac87640 1 Processor -- start 2023-08-09T12:40:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.456+0000 7f6c0ac87640 1 -- start start 2023-08-09T12:40:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.458+0000 7f6c0ac87640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c04159d80 0x7f6c040b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.458+0000 7f6c0ac87640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040b4630 con 0x7f6c040ad810 2023-08-09T12:40:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.458+0000 7f6c0ac87640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040b3ab0 con 0x7f6c04070a90 2023-08-09T12:40:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.458+0000 7f6c0ac87640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0415a160 con 0x7f6c04159d80 2023-08-09T12:40:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.458+0000 7f6c08a23640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c04159d80 0x7f6c040b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.458+0000 7f6c08a23640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c04159d80 0x7f6c040b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49670/0 (socket says 172.21.15.17:49670) 2023-08-09T12:40:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.458+0000 7f6c08a23640 1 -- 172.21.15.17:0/3076030461 learned_addr learned my addr 172.21.15.17:0/3076030461 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.459+0000 7f6c08a23640 1 -- 172.21.15.17:0/3076030461 >> v1:172.21.15.142:6789/0 conn(0x7f6c04070a90 legacy=0x7f6c040c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.459+0000 7f6c08a23640 1 -- 172.21.15.17:0/3076030461 >> v1:172.21.15.17:6789/0 conn(0x7f6c040ad810 legacy=0x7f6c04070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.459+0000 7f6c08a23640 1 -- 172.21.15.17:0/3076030461 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040b3d90 con 0x7f6c04159d80 2023-08-09T12:40:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.460+0000 7f6c08a23640 1 --2- 172.21.15.17:0/3076030461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c040b34d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009e50 tx=0x7f6c0002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bafd8b21cec784 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.460+0000 7f6bfb7fe640 1 -- 172.21.15.17:0/3076030461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0002cb10 con 0x7f6c04159d80 2023-08-09T12:40:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.460+0000 7f6bfb7fe640 1 -- 172.21.15.17:0/3076030461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0002cc70 con 0x7f6c04159d80 2023-08-09T12:40:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.460+0000 7f6bfb7fe640 1 -- 172.21.15.17:0/3076030461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000343f0 con 0x7f6c04159d80 2023-08-09T12:40:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.461+0000 7f6c0ac87640 1 -- 172.21.15.17:0/3076030461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 msgr2=0x7f6c040b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.461+0000 7f6c0ac87640 1 --2- 172.21.15.17:0/3076030461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c040b34d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009e50 tx=0x7f6c0002bf70 comp rx=0 tx=0).stop 2023-08-09T12:40:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.461+0000 7f6c0ac87640 1 -- 172.21.15.17:0/3076030461 shutdown_connections 2023-08-09T12:40:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.461+0000 7f6c0ac87640 1 --2- 172.21.15.17:0/3076030461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c040b34d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.461+0000 7f6c0ac87640 1 -- 172.21.15.17:0/3076030461 >> 172.21.15.17:0/3076030461 conn(0x7f6c040cb1b0 msgr2=0x7f6c040cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.461+0000 7f6c0ac87640 1 -- 172.21.15.17:0/3076030461 shutdown_connections 2023-08-09T12:40:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.461+0000 7f6c0ac87640 1 -- 172.21.15.17:0/3076030461 wait complete. 2023-08-09T12:40:11.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.463+0000 7f6c0ac87640 1 Processor -- start 2023-08-09T12:40:11.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.463+0000 7f6c0ac87640 1 -- start start 2023-08-09T12:40:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c0ac87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c04070a90 0x7f6c040c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c0ac87640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c040ad810 0x7f6c040c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c0ac87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c041562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c0ac87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040c7e10 con 0x7f6c04159d80 2023-08-09T12:40:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c0ac87640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c041567f0 con 0x7f6c040ad810 2023-08-09T12:40:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c0ac87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04157250 con 0x7f6c04070a90 2023-08-09T12:40:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c09224640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c041562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c09224640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c041562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49680/0 (socket says 172.21.15.17:49680) 2023-08-09T12:40:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c09224640 1 -- 172.21.15.17:0/4104147868 learned_addr learned my addr 172.21.15.17:0/4104147868 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6bfbfff640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c040ad810 0x7f6c040c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.464+0000 7f6c08a23640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c04070a90 0x7f6c040c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6c09224640 1 -- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c04070a90 msgr2=0x7f6c040c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6c09224640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c04070a90 0x7f6c040c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6c09224640 1 -- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c040ad810 msgr2=0x7f6c040c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6c09224640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c040ad810 0x7f6c040c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6c09224640 1 -- 172.21.15.17:0/4104147868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009b30 con 0x7f6c04159d80 2023-08-09T12:40:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6c09224640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c041562b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00b440 tx=0x7f6bfc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6bf97fa640 1 -- 172.21.15.17:0/4104147868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc011830 con 0x7f6c04159d80 2023-08-09T12:40:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6bf97fa640 1 -- 172.21.15.17:0/4104147868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc011990 con 0x7f6c04159d80 2023-08-09T12:40:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6bf97fa640 1 -- 172.21.15.17:0/4104147868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc011d40 con 0x7f6c04159d80 2023-08-09T12:40:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.465+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c040c7190 con 0x7f6c04159d80 2023-08-09T12:40:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.466+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c040c7750 con 0x7f6c04159d80 2023-08-09T12:40:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.467+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c040c7f50 con 0x7f6c04159d80 2023-08-09T12:40:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.468+0000 7f6bf97fa640 1 -- 172.21.15.17:0/4104147868 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6bfc01a400 con 0x7f6c04159d80 2023-08-09T12:40:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.468+0000 7f6bf97fa640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6bf006a050 0x7f6bf006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.469+0000 7f6bf97fa640 1 -- 172.21.15.17:0/4104147868 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6bfc0883f0 con 0x7f6c04159d80 2023-08-09T12:40:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.469+0000 7f6c08a23640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6bf006a050 0x7f6bf006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.470+0000 7f6c08a23640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6bf006a050 0x7f6bf006c510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6c00035000 tx=0x7f6c00030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.473+0000 7f6bf97fa640 1 -- 172.21.15.17:0/4104147868 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6c040c7f50 con 0x7f6c04159d80 2023-08-09T12:40:11.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.666+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c040c7f50 con 0x7f6c04159d80 2023-08-09T12:40:11.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.667+0000 7f6bf97fa640 1 -- 172.21.15.17:0/4104147868 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c040c7f50 con 0x7f6c04159d80 2023-08-09T12:40:11.671 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6bf006a050 msgr2=0x7f6bf006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6bf006a050 0x7f6bf006c510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6c00035000 tx=0x7f6c00030000 comp rx=0 tx=0).stop 2023-08-09T12:40:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 msgr2=0x7f6c041562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c041562b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00b440 tx=0x7f6bfc00b900 comp rx=0 tx=0).stop 2023-08-09T12:40:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 shutdown_connections 2023-08-09T12:40:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6bf006a050 0x7f6bf006c510 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c04159d80 0x7f6c041562b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c040ad810 0x7f6c040c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 --2- 172.21.15.17:0/4104147868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c04070a90 0x7f6c040c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.670+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 >> 172.21.15.17:0/4104147868 conn(0x7f6c040cb1b0 msgr2=0x7f6c040ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.671+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 shutdown_connections 2023-08-09T12:40:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.671+0000 7f6c0ac87640 1 -- 172.21.15.17:0/4104147868 wait complete. 2023-08-09T12:40:11.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:11.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.921+0000 7f2ada683640 1 Processor -- start 2023-08-09T12:40:11.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.922+0000 7f2ada683640 1 -- start start 2023-08-09T12:40:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.924+0000 7f2ada683640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2ad40ce9e0 0x7f2ad40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.924+0000 7f2ada683640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad415b160 0x7f2ad415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.924+0000 7f2ada683640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40cf380 con 0x7f2ad4158840 2023-08-09T12:40:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.924+0000 7f2ada683640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad4158c20 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.924+0000 7f2ada683640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b0220 con 0x7f2ad415b160 2023-08-09T12:40:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.924+0000 7f2ad37fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2ad40ce9e0 0x7f2ad40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.925+0000 7f2ad8c20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad415b160 0x7f2ad415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.925+0000 7f2ad37fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2ad40ce9e0 0x7f2ad40cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:34958/0 (socket says 172.21.15.17:34958) 2023-08-09T12:40:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.925+0000 7f2ad37fe640 1 -- 172.21.15.17:0/324182002 learned_addr learned my addr 172.21.15.17:0/324182002 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:11.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.925+0000 7f2ad37fe640 1 -- 172.21.15.17:0/324182002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad415b160 msgr2=0x7f2ad415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:11.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.925+0000 7f2ad37fe640 1 --2- 172.21.15.17:0/324182002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad415b160 0x7f2ad415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.925+0000 7f2ad37fe640 1 -- 172.21.15.17:0/324182002 >> v1:172.21.15.142:6789/0 conn(0x7f2ad4158840 legacy=0x7f2ad40af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.925+0000 7f2ad37fe640 1 -- 172.21.15.17:0/324182002 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad415e7f0 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.925+0000 7f2ad8c20640 1 --2- 172.21.15.17:0/324182002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad415b160 0x7f2ad415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:40:11.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.927+0000 7f2ad37fe640 1 --2- 172.21.15.17:0/324182002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad40cee40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009870 tx=0x7f2ac802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78b4ff4f82f93f8a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.928+0000 7f2ad2ffd640 1 -- 172.21.15.17:0/324182002 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8030840 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.928+0000 7f2ad2ffd640 1 -- 172.21.15.17:0/324182002 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac80309a0 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.928+0000 7f2ad2ffd640 1 -- 172.21.15.17:0/324182002 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8030d30 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.929+0000 7f2ada683640 1 -- 172.21.15.17:0/324182002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad40ce9e0 msgr2=0x7f2ad40cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.929+0000 7f2ada683640 1 --2- 172.21.15.17:0/324182002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad40cee40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009870 tx=0x7f2ac802b980 comp rx=0 tx=0).stop 2023-08-09T12:40:11.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.929+0000 7f2ada683640 1 -- 172.21.15.17:0/324182002 shutdown_connections 2023-08-09T12:40:11.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.929+0000 7f2ada683640 1 --2- 172.21.15.17:0/324182002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad415b160 0x7f2ad415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.929+0000 7f2ada683640 1 --2- 172.21.15.17:0/324182002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad40cee40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.929+0000 7f2ada683640 1 -- 172.21.15.17:0/324182002 >> 172.21.15.17:0/324182002 conn(0x7f2ad4069be0 msgr2=0x7f2ad4069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.929+0000 7f2ada683640 1 -- 172.21.15.17:0/324182002 shutdown_connections 2023-08-09T12:40:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.929+0000 7f2ada683640 1 -- 172.21.15.17:0/324182002 wait complete. 2023-08-09T12:40:11.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.931+0000 7f2ada683640 1 Processor -- start 2023-08-09T12:40:11.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.932+0000 7f2ada683640 1 -- start start 2023-08-09T12:40:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ada683640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad4160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ada683640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad4158840 0x7f2ad414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ada683640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad415b160 0x7f2ad414cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ada683640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad414c490 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ada683640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad415c5e0 con 0x7f2ad415b160 2023-08-09T12:40:11.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ada683640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad414d810 con 0x7f2ad4158840 2023-08-09T12:40:11.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ad3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad4160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ad3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad4160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49682/0 (socket says 172.21.15.17:49682) 2023-08-09T12:40:11.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.933+0000 7f2ad3fff640 1 -- 172.21.15.17:0/581094057 learned_addr learned my addr 172.21.15.17:0/581094057 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:11.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.934+0000 7f2ad37fe640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad4158840 0x7f2ad414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.934+0000 7f2ad8c20640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad415b160 0x7f2ad414cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.934+0000 7f2ad3fff640 1 -- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad4158840 msgr2=0x7f2ad414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.934+0000 7f2ad3fff640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad4158840 0x7f2ad414bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.934+0000 7f2ad3fff640 1 -- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad415b160 msgr2=0x7f2ad414cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:11.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.934+0000 7f2ad3fff640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad415b160 0x7f2ad414cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:11.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.934+0000 7f2ad3fff640 1 -- 172.21.15.17:0/581094057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc009a70 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.934+0000 7f2ad3fff640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad4160580 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c400 tx=0x7f2ac400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.935+0000 7f2ad0ff9640 1 -- 172.21.15.17:0/581094057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40052d0 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.935+0000 7f2ad0ff9640 1 -- 172.21.15.17:0/581094057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4005450 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.935+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac80094d0 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.935+0000 7f2ad0ff9640 1 -- 172.21.15.17:0/581094057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4007260 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.935+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad415cb80 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.936+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad4067a80 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.937+0000 7f2ad0ff9640 1 -- 172.21.15.17:0/581094057 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ac40073c0 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.939+0000 7f2ad0ff9640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:11.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.939+0000 7f2ad0ff9640 1 -- 172.21.15.17:0/581094057 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2ac4087aa0 con 0x7f2ad40ce9e0 2023-08-09T12:40:11.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.940+0000 7f2ad37fe640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:11.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.941+0000 7f2ad37fe640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8036000 tx=0x7f2ac8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:11.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:11.944+0000 7f2ad0ff9640 1 -- 172.21.15.17:0/581094057 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2ac40530b0 con 0x7f2ad40ce9e0 2023-08-09T12:40:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.139+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ad415e450 con 0x7f2ad40ce9e0 2023-08-09T12:40:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.140+0000 7f2ad0ff9640 1 -- 172.21.15.17:0/581094057 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ac40566d0 con 0x7f2ad40ce9e0 2023-08-09T12:40:12.143 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:12.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.142+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 msgr2=0x7f2ac006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8036000 tx=0x7f2ac8008030 comp rx=0 tx=0).stop 2023-08-09T12:40:12.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ad40ce9e0 msgr2=0x7f2ad4160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad4160580 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c400 tx=0x7f2ac400c8c0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 shutdown_connections 2023-08-09T12:40:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ad415b160 0x7f2ad414cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ad4158840 0x7f2ad414bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 --2- 172.21.15.17:0/581094057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ad40ce9e0 0x7f2ad4160580 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 >> 172.21.15.17:0/581094057 conn(0x7f2ad4069be0 msgr2=0x7f2ad4069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 shutdown_connections 2023-08-09T12:40:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.143+0000 7f2ada683640 1 -- 172.21.15.17:0/581094057 wait complete. 2023-08-09T12:40:12.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:12.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.453+0000 7fc5e41b5640 1 Processor -- start 2023-08-09T12:40:12.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.453+0000 7fc5e41b5640 1 -- start start 2023-08-09T12:40:12.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e41b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc15ce90 0x7fc5dc1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e41b5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5dc0b6000 0x7fc5dc0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e41b5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc0b6460 con 0x7fc5dc0d29d0 2023-08-09T12:40:12.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e41b5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0cda40 con 0x7fc5dc0b6000 2023-08-09T12:40:12.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e41b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0cdd10 con 0x7fc5dc15ce90 2023-08-09T12:40:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e1750640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5dc0b6000 0x7fc5dc0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e1750640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5dc0b6000 0x7fc5dc0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49686/0 (socket says 172.21.15.17:49686) 2023-08-09T12:40:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e1750640 1 -- 172.21.15.17:0/4195919967 learned_addr learned my addr 172.21.15.17:0/4195919967 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.455+0000 7fc5e1f51640 1 --2- 172.21.15.17:0/4195919967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc15ce90 0x7fc5dc1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.456+0000 7fc5e1750640 1 -- 172.21.15.17:0/4195919967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc15ce90 msgr2=0x7fc5dc1616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.456+0000 7fc5e1750640 1 --2- 172.21.15.17:0/4195919967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc15ce90 0x7fc5dc1616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.456+0000 7fc5e1750640 1 -- 172.21.15.17:0/4195919967 >> v1:172.21.15.142:6789/0 conn(0x7fc5dc0d29d0 legacy=0x7fc5dc0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.456+0000 7fc5e1750640 1 -- 172.21.15.17:0/4195919967 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0cdff0 con 0x7fc5dc0b6000 2023-08-09T12:40:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.456+0000 7fc5e1f51640 1 --2- 172.21.15.17:0/4195919967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc15ce90 0x7fc5dc1616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:12.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.457+0000 7fc5e1750640 1 --2- 172.21.15.17:0/4195919967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0b6000 0x7fc5dc0cd500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009870 tx=0x7fc5cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb691e6cf707463 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:12.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.457+0000 7fc5e0f4f640 1 -- 172.21.15.17:0/4195919967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc030840 con 0x7fc5dc0b6000 2023-08-09T12:40:12.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e0f4f640 1 -- 172.21.15.17:0/4195919967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc0309a0 con 0x7fc5dc0b6000 2023-08-09T12:40:12.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e0f4f640 1 -- 172.21.15.17:0/4195919967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc030d30 con 0x7fc5dc0b6000 2023-08-09T12:40:12.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e41b5640 1 -- 172.21.15.17:0/4195919967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0b6000 msgr2=0x7fc5dc0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/4195919967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0b6000 0x7fc5dc0cd500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009870 tx=0x7fc5cc02b980 comp rx=0 tx=0).stop 2023-08-09T12:40:12.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e41b5640 1 -- 172.21.15.17:0/4195919967 shutdown_connections 2023-08-09T12:40:12.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/4195919967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0b6000 0x7fc5dc0cd500 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/4195919967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc15ce90 0x7fc5dc1616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e41b5640 1 -- 172.21.15.17:0/4195919967 >> 172.21.15.17:0/4195919967 conn(0x7fc5dc06fde0 msgr2=0x7fc5dc0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.458+0000 7fc5e41b5640 1 -- 172.21.15.17:0/4195919967 shutdown_connections 2023-08-09T12:40:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.459+0000 7fc5e41b5640 1 -- 172.21.15.17:0/4195919967 wait complete. 2023-08-09T12:40:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.460+0000 7fc5e41b5640 1 Processor -- start 2023-08-09T12:40:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.460+0000 7fc5e41b5640 1 -- start start 2023-08-09T12:40:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.461+0000 7fc5e41b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5dc0b6000 0x7fc5dc153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.461+0000 7fc5e41b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc0d29d0 0x7fc5dc15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.461+0000 7fc5e41b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc15ce90 0x7fc5dc1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.461+0000 7fc5e41b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b31a0 con 0x7fc5dc15ce90 2023-08-09T12:40:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.461+0000 7fc5e41b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b2590 con 0x7fc5dc0b6000 2023-08-09T12:40:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.461+0000 7fc5e41b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b2870 con 0x7fc5dc0d29d0 2023-08-09T12:40:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e2752640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc15ce90 0x7fc5dc1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e2752640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc15ce90 0x7fc5dc1571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49698/0 (socket says 172.21.15.17:49698) 2023-08-09T12:40:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e2752640 1 -- 172.21.15.17:0/3226259866 learned_addr learned my addr 172.21.15.17:0/3226259866 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e1750640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc0d29d0 0x7fc5dc15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e1f51640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5dc0b6000 0x7fc5dc153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e2752640 1 -- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc0d29d0 msgr2=0x7fc5dc15d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e2752640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc0d29d0 0x7fc5dc15d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e2752640 1 -- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5dc0b6000 msgr2=0x7fc5dc153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e2752640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5dc0b6000 0x7fc5dc153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.462+0000 7fc5e2752640 1 -- 172.21.15.17:0/3226259866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0094d0 con 0x7fc5dc15ce90 2023-08-09T12:40:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.463+0000 7fc5e2752640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc15ce90 0x7fc5dc1571e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400c7a0 tx=0x7fc5d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.463+0000 7fc5d27fc640 1 -- 172.21.15.17:0/3226259866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4003b70 con 0x7fc5dc15ce90 2023-08-09T12:40:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.463+0000 7fc5d27fc640 1 -- 172.21.15.17:0/3226259866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d4003cf0 con 0x7fc5dc15ce90 2023-08-09T12:40:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.463+0000 7fc5d27fc640 1 -- 172.21.15.17:0/3226259866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4003ea0 con 0x7fc5dc15ce90 2023-08-09T12:40:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.463+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc0b2b50 con 0x7fc5dc15ce90 2023-08-09T12:40:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.463+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc15dc30 con 0x7fc5dc15ce90 2023-08-09T12:40:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.464+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc0b3310 con 0x7fc5dc15ce90 2023-08-09T12:40:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.465+0000 7fc5d27fc640 1 -- 172.21.15.17:0/3226259866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5d400aa90 con 0x7fc5dc15ce90 2023-08-09T12:40:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.466+0000 7fc5d27fc640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5c006a050 0x7fc5c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.466+0000 7fc5d27fc640 1 -- 172.21.15.17:0/3226259866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc5d40884d0 con 0x7fc5dc15ce90 2023-08-09T12:40:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.467+0000 7fc5e1f51640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5c006a050 0x7fc5c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.468+0000 7fc5e1f51640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5c006a050 0x7fc5c006c510 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8006fd0 tx=0x7fc5d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:12.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.471+0000 7fc5d27fc640 1 -- 172.21.15.17:0/3226259866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc5d4053ae0 con 0x7fc5dc15ce90 2023-08-09T12:40:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.666+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5dc067a80 con 0x7fc5dc15ce90 2023-08-09T12:40:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.667+0000 7fc5d27fc640 1 -- 172.21.15.17:0/3226259866 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5d4057100 con 0x7fc5dc15ce90 2023-08-09T12:40:12.670 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.669+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5c006a050 msgr2=0x7fc5c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.669+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5c006a050 0x7fc5c006c510 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8006fd0 tx=0x7fc5d8008040 comp rx=0 tx=0).stop 2023-08-09T12:40:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.669+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc15ce90 msgr2=0x7fc5dc1571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.669+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc15ce90 0x7fc5dc1571e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400c7a0 tx=0x7fc5d400cc60 comp rx=0 tx=0).stop 2023-08-09T12:40:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.670+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 shutdown_connections 2023-08-09T12:40:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.670+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5c006a050 0x7fc5c006c510 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.670+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc15ce90 0x7fc5dc1571e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.670+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5dc0d29d0 0x7fc5dc15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.670+0000 7fc5e41b5640 1 --2- 172.21.15.17:0/3226259866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5dc0b6000 0x7fc5dc153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.670+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 >> 172.21.15.17:0/3226259866 conn(0x7fc5dc06fde0 msgr2=0x7fc5dc154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.670+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 shutdown_connections 2023-08-09T12:40:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.670+0000 7fc5e41b5640 1 -- 172.21.15.17:0/3226259866 wait complete. 2023-08-09T12:40:12.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:40:12.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.907+0000 7f8d24973640 1 Processor -- start 2023-08-09T12:40:12.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.907+0000 7f8d24973640 1 -- start start 2023-08-09T12:40:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.909+0000 7f8d24973640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20070f00 0x7f8d2015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.909+0000 7f8d24973640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d20071340 con 0x7f8d201587e0 2023-08-09T12:40:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.909+0000 7f8d24973640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d200715c0 con 0x7f8d2015bce0 2023-08-09T12:40:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.909+0000 7f8d24973640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200718a0 con 0x7f8d20070f00 2023-08-09T12:40:12.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.909+0000 7f8d1f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8d201587e0 0x7f8d200b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55296/0 (socket says 172.21.15.17:55296) 2023-08-09T12:40:12.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.909+0000 7f8d1f7fe640 1 -- 172.21.15.17:0/762468471 learned_addr learned my addr 172.21.15.17:0/762468471 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:12.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.909+0000 7f8d1effd640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20070f00 0x7f8d2015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788303106 0 0) 0x7f8d20071340 con 0x7f8d201587e0 2023-08-09T12:40:12.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d0c003520 con 0x7f8d201587e0 2023-08-09T12:40:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 819089953 0 0) 0x7f8d0c003520 con 0x7f8d201587e0 2023-08-09T12:40:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20070f00 msgr2=0x7f8d2015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20070f00 0x7f8d2015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 >> v1:172.21.15.142:6789/0 conn(0x7f8d2015bce0 legacy=0x7f8d200cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20071b80 con 0x7f8d201587e0 2023-08-09T12:40:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8d10001670 con 0x7f8d201587e0 2023-08-09T12:40:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 >> v1:172.21.15.17:6789/0 conn(0x7f8d201587e0 legacy=0x7f8d200b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20070f00 0x7f8d0c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c003f20 0x7f8d0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d0c004d00 0x7f8d0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200718a0 con 0x7f8d0c004d00 2023-08-09T12:40:12.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c00ba60 con 0x7f8d0c003f20 2023-08-09T12:40:12.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c00bc20 con 0x7f8d20070f00 2023-08-09T12:40:12.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.910+0000 7f8d1ffff640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d0c004d00 0x7f8d0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.911+0000 7f8d1effd640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c003f20 0x7f8d0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.911+0000 7f8d1ffff640 1 -- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20070f00 msgr2=0x7f8d0c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:12.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.911+0000 7f8d1ffff640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20070f00 0x7f8d0c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.911+0000 7f8d1ffff640 1 -- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c003f20 msgr2=0x7f8d0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:12.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.911+0000 7f8d1ffff640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c003f20 0x7f8d0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.911+0000 7f8d1ffff640 1 -- 172.21.15.17:0/762468471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c003520 con 0x7f8d0c004d00 2023-08-09T12:40:12.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.911+0000 7f8d1effd640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c003f20 0x7f8d0c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:12.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.912+0000 7f8d1ffff640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d0c004d00 0x7f8d0c005180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d200b42b0 tx=0x7f8d0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f635855e9228be server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:12.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.912+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18003b70 con 0x7f8d0c004d00 2023-08-09T12:40:12.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.912+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18003cd0 con 0x7f8d0c004d00 2023-08-09T12:40:12.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.912+0000 7f8d1e7fc640 1 -- 172.21.15.17:0/762468471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18005310 con 0x7f8d0c004d00 2023-08-09T12:40:12.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.913+0000 7f8d24973640 1 -- 172.21.15.17:0/762468471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d0c004d00 msgr2=0x7f8d0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.913+0000 7f8d24973640 1 --2- 172.21.15.17:0/762468471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d0c004d00 0x7f8d0c005180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d200b42b0 tx=0x7f8d0c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.913+0000 7f8d1ffff640 1 -- 172.21.15.17:0/762468471 reap_dead start 2023-08-09T12:40:12.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.913+0000 7f8d24973640 1 -- 172.21.15.17:0/762468471 shutdown_connections 2023-08-09T12:40:12.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.913+0000 7f8d24973640 1 -- 172.21.15.17:0/762468471 >> 172.21.15.17:0/762468471 conn(0x7f8d200b1d50 msgr2=0x7f8d2006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:12.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.913+0000 7f8d24973640 1 -- 172.21.15.17:0/762468471 shutdown_connections 2023-08-09T12:40:12.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.913+0000 7f8d24973640 1 -- 172.21.15.17:0/762468471 wait complete. 2023-08-09T12:40:12.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.915+0000 7f8d24973640 1 Processor -- start 2023-08-09T12:40:12.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.915+0000 7f8d24973640 1 -- start start 2023-08-09T12:40:12.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d24973640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c004d00 0x7f8d200af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d24973640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20146850 0x7f8d20149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d24973640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200c3b40 0x7f8d200b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d24973640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200accb0 con 0x7f8d200c3b40 2023-08-09T12:40:12.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d24973640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20149d50 con 0x7f8d0c004d00 2023-08-09T12:40:12.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d24973640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2014c740 con 0x7f8d20146850 2023-08-09T12:40:12.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d1ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200c3b40 0x7f8d200b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d1ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200c3b40 0x7f8d200b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49706/0 (socket says 172.21.15.17:49706) 2023-08-09T12:40:12.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.916+0000 7f8d1ffff640 1 -- 172.21.15.17:0/1869685521 learned_addr learned my addr 172.21.15.17:0/1869685521 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:12.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d1f7fe640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c004d00 0x7f8d200af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d1effd640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20146850 0x7f8d20149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d1ffff640 1 -- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20146850 msgr2=0x7f8d20149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d1ffff640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20146850 0x7f8d20149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d1ffff640 1 -- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c004d00 msgr2=0x7f8d200af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:12.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d1ffff640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c004d00 0x7f8d200af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:12.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d1ffff640 1 -- 172.21.15.17:0/1869685521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2014ca20 con 0x7f8d200c3b40 2023-08-09T12:40:12.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d1ffff640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200c3b40 0x7f8d200b2e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d1802c020 tx=0x7f8d180014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:12.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d17fff640 1 -- 172.21.15.17:0/1869685521 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1803e070 con 0x7f8d200c3b40 2023-08-09T12:40:12.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.917+0000 7f8d17fff640 1 -- 172.21.15.17:0/1869685521 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18003e40 con 0x7f8d200c3b40 2023-08-09T12:40:12.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.918+0000 7f8d17fff640 1 -- 172.21.15.17:0/1869685521 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18006d90 con 0x7f8d200c3b40 2023-08-09T12:40:12.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.918+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d200acf00 con 0x7f8d200c3b40 2023-08-09T12:40:12.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.918+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d200c3ff0 con 0x7f8d200c3b40 2023-08-09T12:40:12.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.919+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2004e390 con 0x7f8d200c3b40 2023-08-09T12:40:12.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.920+0000 7f8d17fff640 1 -- 172.21.15.17:0/1869685521 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8d18041070 con 0x7f8d200c3b40 2023-08-09T12:40:12.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.921+0000 7f8d17fff640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d0006a080 0x7f8d0006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:12.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.921+0000 7f8d17fff640 1 -- 172.21.15.17:0/1869685521 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8d180a97d0 con 0x7f8d200c3b40 2023-08-09T12:40:12.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.921+0000 7f8d1f7fe640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d0006a080 0x7f8d0006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:12.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.922+0000 7f8d1f7fe640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d0006a080 0x7f8d0006c540 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000fd0 tx=0x7f8d10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:12.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:12.925+0000 7f8d17fff640 1 -- 172.21.15.17:0/1869685521 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8d18074e60 con 0x7f8d200c3b40 2023-08-09T12:40:13.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.131+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d2006fa10 con 0x7f8d200c3b40 2023-08-09T12:40:13.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.132+0000 7f8d17fff640 1 -- 172.21.15.17:0/1869685521 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8d2006fa10 con 0x7f8d200c3b40 2023-08-09T12:40:13.135 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:40:13.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d0006a080 msgr2=0x7f8d0006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:13.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d0006a080 0x7f8d0006c540 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000fd0 tx=0x7f8d10009040 comp rx=0 tx=0).stop 2023-08-09T12:40:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200c3b40 msgr2=0x7f8d200b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200c3b40 0x7f8d200b2e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d1802c020 tx=0x7f8d180014a0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 shutdown_connections 2023-08-09T12:40:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d0006a080 0x7f8d0006c540 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200c3b40 0x7f8d200b2e60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d20146850 0x7f8d20149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 --2- 172.21.15.17:0/1869685521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d0c004d00 0x7f8d200af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 >> 172.21.15.17:0/1869685521 conn(0x7f8d200b1d50 msgr2=0x7f8d200b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:13.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 shutdown_connections 2023-08-09T12:40:13.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.135+0000 7f8d24973640 1 -- 172.21.15.17:0/1869685521 wait complete. 2023-08-09T12:40:13.157 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:40:13.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:13.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-09T12:40:13.286 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:40:13.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:13.287 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:40:13.351 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:40:13.351 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:13.411 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:40:13.411 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:13.467 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:40:13.468 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:13.525 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.766+0000 7f6f349b4640 1 Processor -- start 2023-08-09T12:40:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.766+0000 7f6f349b4640 1 -- start start 2023-08-09T12:40:13.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.767+0000 7f6f349b4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f301601f0 0x7f6f300b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.767+0000 7f6f349b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f300cb610 0x7f6f300c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.767+0000 7f6f349b4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f300b34a0 con 0x7f6f300b2ee0 2023-08-09T12:40:13.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.768+0000 7f6f349b4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f300b4120 con 0x7f6f301601f0 2023-08-09T12:40:13.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.768+0000 7f6f349b4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300b3780 con 0x7f6f300cb610 2023-08-09T12:40:13.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.768+0000 7f6f2e59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6f300b2ee0 0x7f6f300caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55302/0 (socket says 172.21.15.17:55302) 2023-08-09T12:40:13.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.768+0000 7f6f2e59c640 1 -- 172.21.15.17:0/1285400114 learned_addr learned my addr 172.21.15.17:0/1285400114 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:13.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.768+0000 7f6f2ed9d640 1 --2- 172.21.15.17:0/1285400114 >> v2:172.21.15.142:3300/0 conn(0x7f6f301601f0 0x7f6f300b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:13.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.768+0000 7f6f2f59e640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f300cb610 0x7f6f300c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:13.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.768+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902315206 0 0) 0x7f6f300b34a0 con 0x7f6f300b2ee0 2023-08-09T12:40:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.768+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f18003520 con 0x7f6f300b2ee0 2023-08-09T12:40:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 898250824 0 0) 0x7f6f18003520 con 0x7f6f300b2ee0 2023-08-09T12:40:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f300cb610 msgr2=0x7f6f300c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f300cb610 0x7f6f300c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 >> v2:172.21.15.142:3300/0 conn(0x7f6f301601f0 msgr2=0x7f6f300b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 --2- 172.21.15.17:0/1285400114 >> v2:172.21.15.142:3300/0 conn(0x7f6f301601f0 0x7f6f300b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300b3a60 con 0x7f6f300b2ee0 2023-08-09T12:40:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f6f24001670 con 0x7f6f300b2ee0 2023-08-09T12:40:13.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 >> v1:172.21.15.17:6789/0 conn(0x7f6f300b2ee0 legacy=0x7f6f300caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:13.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f18003970 0x7f6f18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f180047c0 0x7f6f18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f300cb610 0x7f6f18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300b4120 con 0x7f6f180047c0 2023-08-09T12:40:13.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300b3780 con 0x7f6f18003970 2023-08-09T12:40:13.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1800b980 con 0x7f6f300cb610 2023-08-09T12:40:13.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.769+0000 7f6f2e59c640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f180047c0 0x7f6f18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:13.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.770+0000 7f6f2ed9d640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f18003970 0x7f6f18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:13.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.770+0000 7f6f2e59c640 1 -- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f300cb610 msgr2=0x7f6f18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:13.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.770+0000 7f6f2e59c640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f300cb610 0x7f6f18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.770+0000 7f6f2e59c640 1 -- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f18003970 msgr2=0x7f6f18003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:13.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.770+0000 7f6f2e59c640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f18003970 0x7f6f18003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.770+0000 7f6f2e59c640 1 -- 172.21.15.17:0/1285400114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18003520 con 0x7f6f180047c0 2023-08-09T12:40:13.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.771+0000 7f6f2e59c640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f180047c0 0x7f6f18004c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c210 tx=0x7f6f180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3546eda5b21d5def server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.771+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2402cae0 con 0x7f6f180047c0 2023-08-09T12:40:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.771+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2402cc40 con 0x7f6f180047c0 2023-08-09T12:40:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.771+0000 7f6f2dd9b640 1 -- 172.21.15.17:0/1285400114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240058d0 con 0x7f6f180047c0 2023-08-09T12:40:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.772+0000 7f6f349b4640 1 -- 172.21.15.17:0/1285400114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f180047c0 msgr2=0x7f6f18004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.772+0000 7f6f349b4640 1 --2- 172.21.15.17:0/1285400114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f180047c0 0x7f6f18004c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c210 tx=0x7f6f180057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.772+0000 7f6f2f59e640 1 -- 172.21.15.17:0/1285400114 reap_dead start 2023-08-09T12:40:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.772+0000 7f6f349b4640 1 -- 172.21.15.17:0/1285400114 shutdown_connections 2023-08-09T12:40:13.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.772+0000 7f6f349b4640 1 -- 172.21.15.17:0/1285400114 >> 172.21.15.17:0/1285400114 conn(0x7f6f300b1d50 msgr2=0x7f6f3006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:13.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.772+0000 7f6f349b4640 1 -- 172.21.15.17:0/1285400114 shutdown_connections 2023-08-09T12:40:13.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.772+0000 7f6f349b4640 1 -- 172.21.15.17:0/1285400114 wait complete. 2023-08-09T12:40:13.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.774+0000 7f6f349b4640 1 Processor -- start 2023-08-09T12:40:13.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.774+0000 7f6f349b4640 1 -- start start 2023-08-09T12:40:13.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f349b4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f180047c0 0x7f6f30153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f349b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f3015be00 0x7f6f30158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f349b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f30158580 0x7f6f301f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f349b4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30153aa0 con 0x7f6f3015be00 2023-08-09T12:40:13.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f349b4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f301f23b0 con 0x7f6f180047c0 2023-08-09T12:40:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f349b4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30156490 con 0x7f6f30158580 2023-08-09T12:40:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f2e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f3015be00 0x7f6f30158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f2e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f3015be00 0x7f6f30158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49728/0 (socket says 172.21.15.17:49728) 2023-08-09T12:40:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.775+0000 7f6f2e59c640 1 -- 172.21.15.17:0/4245239956 learned_addr learned my addr 172.21.15.17:0/4245239956 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f2ed9d640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f180047c0 0x7f6f30153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f2e59c640 1 -- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f30158580 msgr2=0x7f6f301f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f2e59c640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f30158580 0x7f6f301f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f2e59c640 1 -- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f180047c0 msgr2=0x7f6f30153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f2e59c640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f180047c0 0x7f6f30153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f2e59c640 1 -- 172.21.15.17:0/4245239956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f30154630 con 0x7f6f3015be00 2023-08-09T12:40:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f2e59c640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f3015be00 0x7f6f30158040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c330 tx=0x7f6f300b4020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f177fe640 1 -- 172.21.15.17:0/4245239956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24039070 con 0x7f6f3015be00 2023-08-09T12:40:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f177fe640 1 -- 172.21.15.17:0/4245239956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24001630 con 0x7f6f3015be00 2023-08-09T12:40:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f177fe640 1 -- 172.21.15.17:0/4245239956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2403c040 con 0x7f6f3015be00 2023-08-09T12:40:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.776+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f301566e0 con 0x7f6f3015be00 2023-08-09T12:40:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.777+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f30154880 con 0x7f6f3015be00 2023-08-09T12:40:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.778+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f30156c00 con 0x7f6f3015be00 2023-08-09T12:40:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.779+0000 7f6f177fe640 1 -- 172.21.15.17:0/4245239956 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f24032070 con 0x7f6f3015be00 2023-08-09T12:40:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.780+0000 7f6f177fe640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1c06a080 0x7f6f1c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.780+0000 7f6f177fe640 1 -- 172.21.15.17:0/4245239956 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6f240a9b50 con 0x7f6f3015be00 2023-08-09T12:40:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.781+0000 7f6f2ed9d640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1c06a080 0x7f6f1c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.782+0000 7f6f2ed9d640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1c06a080 0x7f6f1c06c540 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009910 tx=0x7f6f20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.785+0000 7f6f177fe640 1 -- 172.21.15.17:0/4245239956 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6f24075280 con 0x7f6f3015be00 2023-08-09T12:40:13.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.979+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f3004e390 con 0x7f6f3015be00 2023-08-09T12:40:13.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.981+0000 7f6f177fe640 1 -- 172.21.15.17:0/4245239956 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f6f24046020 con 0x7f6f3015be00 2023-08-09T12:40:13.985 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:13.985 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:09.763656+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:13.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1c06a080 msgr2=0x7f6f1c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:13.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1c06a080 0x7f6f1c06c540 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009910 tx=0x7f6f20008040 comp rx=0 tx=0).stop 2023-08-09T12:40:13.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f3015be00 msgr2=0x7f6f30158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:13.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f3015be00 0x7f6f30158040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c330 tx=0x7f6f300b4020 comp rx=0 tx=0).stop 2023-08-09T12:40:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 shutdown_connections 2023-08-09T12:40:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1c06a080 0x7f6f1c06c540 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f30158580 0x7f6f301f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f3015be00 0x7f6f30158040 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 --2- 172.21.15.17:0/4245239956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f180047c0 0x7f6f30153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 >> 172.21.15.17:0/4245239956 conn(0x7f6f300b1d50 msgr2=0x7f6f300cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 shutdown_connections 2023-08-09T12:40:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:13.985+0000 7f6f349b4640 1 -- 172.21.15.17:0/4245239956 wait complete. 2023-08-09T12:40:14.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:14.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.235+0000 7f81f5cec640 1 Processor -- start 2023-08-09T12:40:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.236+0000 7f81f5cec640 1 -- start start 2023-08-09T12:40:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.237+0000 7f81f5cec640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81f0161280 0x7f81f00c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.237+0000 7f81f5cec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f81f00acfc0 0x7f81f00cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.237+0000 7f81f5cec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f015df30 con 0x7f81f0161660 2023-08-09T12:40:14.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.237+0000 7f81f5cec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f015d430 con 0x7f81f00acfc0 2023-08-09T12:40:14.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.237+0000 7f81f5cec640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00ca9d0 con 0x7f81f0161280 2023-08-09T12:40:14.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.238+0000 7f81effff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f81f00acfc0 0x7f81f00cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.238+0000 7f81effff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f81f00acfc0 0x7f81f00cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49734/0 (socket says 172.21.15.17:49734) 2023-08-09T12:40:14.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.238+0000 7f81effff640 1 -- 172.21.15.17:0/2545763762 learned_addr learned my addr 172.21.15.17:0/2545763762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:14.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.238+0000 7f81ef7fe640 1 --2- 172.21.15.17:0/2545763762 >> v2:172.21.15.142:3300/0 conn(0x7f81f0161280 0x7f81f00c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.238+0000 7f81effff640 1 -- 172.21.15.17:0/2545763762 >> v2:172.21.15.142:3300/0 conn(0x7f81f0161280 msgr2=0x7f81f00c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:14.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.238+0000 7f81effff640 1 --2- 172.21.15.17:0/2545763762 >> v2:172.21.15.142:3300/0 conn(0x7f81f0161280 0x7f81f00c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.238+0000 7f81effff640 1 -- 172.21.15.17:0/2545763762 >> v1:172.21.15.142:6789/0 conn(0x7f81f0161660 legacy=0x7f81f00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:14.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.238+0000 7f81effff640 1 -- 172.21.15.17:0/2545763762 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f015e3c0 con 0x7f81f00acfc0 2023-08-09T12:40:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.240+0000 7f81effff640 1 --2- 172.21.15.17:0/2545763762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f00acfc0 0x7f81f00cc630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f81f00ad990 tx=0x7f81e802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a52e88008f4ea7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.240+0000 7f81ee7fc640 1 -- 172.21.15.17:0/2545763762 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e802c9f0 con 0x7f81f00acfc0 2023-08-09T12:40:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.240+0000 7f81ee7fc640 1 -- 172.21.15.17:0/2545763762 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e802cb50 con 0x7f81f00acfc0 2023-08-09T12:40:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.240+0000 7f81ee7fc640 1 -- 172.21.15.17:0/2545763762 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e80343f0 con 0x7f81f00acfc0 2023-08-09T12:40:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.241+0000 7f81f5cec640 1 -- 172.21.15.17:0/2545763762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f00acfc0 msgr2=0x7f81f00cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.241+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2545763762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f00acfc0 0x7f81f00cc630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f81f00ad990 tx=0x7f81e802be50 comp rx=0 tx=0).stop 2023-08-09T12:40:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.241+0000 7f81f5cec640 1 -- 172.21.15.17:0/2545763762 shutdown_connections 2023-08-09T12:40:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.241+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2545763762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f00acfc0 0x7f81f00cc630 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.241+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2545763762 >> v2:172.21.15.142:3300/0 conn(0x7f81f0161280 0x7f81f00c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.241+0000 7f81f5cec640 1 -- 172.21.15.17:0/2545763762 >> 172.21.15.17:0/2545763762 conn(0x7f81f00cb1b0 msgr2=0x7f81f00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.241+0000 7f81f5cec640 1 -- 172.21.15.17:0/2545763762 shutdown_connections 2023-08-09T12:40:14.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.241+0000 7f81f5cec640 1 -- 172.21.15.17:0/2545763762 wait complete. 2023-08-09T12:40:14.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.243+0000 7f81f5cec640 1 Processor -- start 2023-08-09T12:40:14.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.243+0000 7f81f5cec640 1 -- start start 2023-08-09T12:40:14.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81f5cec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81f00acfc0 0x7f81f00c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81f5cec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81f0161280 0x7f81f0155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81f5cec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f0161660 0x7f81f0155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81f5cec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01f2310 con 0x7f81f0161660 2023-08-09T12:40:14.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81f5cec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f0156dc0 con 0x7f81f0161280 2023-08-09T12:40:14.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81f5cec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01561b0 con 0x7f81f00acfc0 2023-08-09T12:40:14.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f0161660 0x7f81f0155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f0161660 0x7f81f0155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49740/0 (socket says 172.21.15.17:49740) 2023-08-09T12:40:14.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.244+0000 7f81effff640 1 -- 172.21.15.17:0/2418087508 learned_addr learned my addr 172.21.15.17:0/2418087508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:14.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.245+0000 7f81eeffd640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81f0161280 0x7f81f0155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.245+0000 7f81effff640 1 -- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81f00acfc0 msgr2=0x7f81f00c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.245+0000 7f81effff640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81f00acfc0 0x7f81f00c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.245+0000 7f81effff640 1 -- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81f0161280 msgr2=0x7f81f0155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.245+0000 7f81effff640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81f0161280 0x7f81f0155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.245+0000 7f81effff640 1 -- 172.21.15.17:0/2418087508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8009b30 con 0x7f81f0161660 2023-08-09T12:40:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.245+0000 7f81effff640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f0161660 0x7f81f0155ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f81e8036040 tx=0x7f81e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.245+0000 7f81d7fff640 1 -- 172.21.15.17:0/2418087508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8009510 con 0x7f81f0161660 2023-08-09T12:40:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.246+0000 7f81d7fff640 1 -- 172.21.15.17:0/2418087508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e803e450 con 0x7f81f0161660 2023-08-09T12:40:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.246+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f0156490 con 0x7f81f0161660 2023-08-09T12:40:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.246+0000 7f81d7fff640 1 -- 172.21.15.17:0/2418087508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e803e7e0 con 0x7f81f0161660 2023-08-09T12:40:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.246+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f0156a50 con 0x7f81f0161660 2023-08-09T12:40:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.247+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f0067a80 con 0x7f81f0161660 2023-08-09T12:40:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.248+0000 7f81d7fff640 1 -- 172.21.15.17:0/2418087508 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81e803e940 con 0x7f81f0161660 2023-08-09T12:40:14.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.249+0000 7f81d7fff640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81dc06a080 0x7f81dc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.249+0000 7f81d7fff640 1 -- 172.21.15.17:0/2418087508 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f81e80ab6d0 con 0x7f81f0161660 2023-08-09T12:40:14.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.250+0000 7f81ef7fe640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81dc06a080 0x7f81dc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.251+0000 7f81ef7fe640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81dc06a080 0x7f81dc06c540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006fd0 tx=0x7f81e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:14.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.254+0000 7f81d7fff640 1 -- 172.21.15.17:0/2418087508 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f81e8076d70 con 0x7f81f0161660 2023-08-09T12:40:14.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.448+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81f00adc60 con 0x7f81f0161660 2023-08-09T12:40:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.448+0000 7f81d7fff640 1 -- 172.21.15.17:0/2418087508 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81e807a390 con 0x7f81f0161660 2023-08-09T12:40:14.452 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:14.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81dc06a080 msgr2=0x7f81dc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81dc06a080 0x7f81dc06c540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006fd0 tx=0x7f81e0008040 comp rx=0 tx=0).stop 2023-08-09T12:40:14.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f0161660 msgr2=0x7f81f0155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f0161660 0x7f81f0155ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f81e8036040 tx=0x7f81e8004a40 comp rx=0 tx=0).stop 2023-08-09T12:40:14.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 shutdown_connections 2023-08-09T12:40:14.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81dc06a080 0x7f81dc06c540 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f0161660 0x7f81f0155ac0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81f0161280 0x7f81f0155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 --2- 172.21.15.17:0/2418087508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81f00acfc0 0x7f81f00c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.451+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 >> 172.21.15.17:0/2418087508 conn(0x7f81f00cb1b0 msgr2=0x7f81f006bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:14.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.452+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 shutdown_connections 2023-08-09T12:40:14.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.452+0000 7f81f5cec640 1 -- 172.21.15.17:0/2418087508 wait complete. 2023-08-09T12:40:14.475 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:14.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.706+0000 7f43c2d76640 1 Processor -- start 2023-08-09T12:40:14.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.706+0000 7f43c2d76640 1 -- start start 2023-08-09T12:40:14.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c2d76640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43bc161280 0x7f43bc0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c2d76640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43bc161660 0x7f43bc0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c2d76640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 0x7f43bc0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c2d76640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc15d430 con 0x7f43bc161280 2023-08-09T12:40:14.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c2d76640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc15df30 con 0x7f43bc161660 2023-08-09T12:40:14.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c2d76640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0ca9d0 con 0x7f43bc0ca450 2023-08-09T12:40:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c0b12640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43bc161280 0x7f43bc0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c0b12640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43bc161280 0x7f43bc0c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49754/0 (socket says 172.21.15.17:49754) 2023-08-09T12:40:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c0b12640 1 -- 172.21.15.17:0/3074476949 learned_addr learned my addr 172.21.15.17:0/3074476949 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c0b12640 1 -- 172.21.15.17:0/3074476949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 msgr2=0x7f43bc0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c0b12640 1 --2- 172.21.15.17:0/3074476949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 0x7f43bc0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c0b12640 1 -- 172.21.15.17:0/3074476949 >> v2:172.21.15.142:3300/0 conn(0x7f43bc161660 msgr2=0x7f43bc0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c0b12640 1 --2- 172.21.15.17:0/3074476949 >> v2:172.21.15.142:3300/0 conn(0x7f43bc161660 0x7f43bc0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.708+0000 7f43c0b12640 1 -- 172.21.15.17:0/3074476949 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc15e3c0 con 0x7f43bc161280 2023-08-09T12:40:14.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.710+0000 7f43c0b12640 1 --2- 172.21.15.17:0/3074476949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc0c9f10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f43bc06ce30 tx=0x7f43b802b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0ec0b232e2e0cf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:14.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.710+0000 7f43b37fe640 1 -- 172.21.15.17:0/3074476949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8031760 con 0x7f43bc161280 2023-08-09T12:40:14.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.710+0000 7f43b37fe640 1 -- 172.21.15.17:0/3074476949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b80318c0 con 0x7f43bc161280 2023-08-09T12:40:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.710+0000 7f43b37fe640 1 -- 172.21.15.17:0/3074476949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8031c50 con 0x7f43bc161280 2023-08-09T12:40:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.710+0000 7f43c2d76640 1 -- 172.21.15.17:0/3074476949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 msgr2=0x7f43bc0c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.710+0000 7f43c2d76640 1 --2- 172.21.15.17:0/3074476949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc0c9f10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f43bc06ce30 tx=0x7f43b802b800 comp rx=0 tx=0).stop 2023-08-09T12:40:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.711+0000 7f43c2d76640 1 -- 172.21.15.17:0/3074476949 shutdown_connections 2023-08-09T12:40:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.711+0000 7f43c2d76640 1 --2- 172.21.15.17:0/3074476949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 0x7f43bc0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.711+0000 7f43c2d76640 1 --2- 172.21.15.17:0/3074476949 >> v2:172.21.15.142:3300/0 conn(0x7f43bc161660 0x7f43bc0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.711+0000 7f43c2d76640 1 --2- 172.21.15.17:0/3074476949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc0c9f10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.711+0000 7f43c2d76640 1 -- 172.21.15.17:0/3074476949 >> 172.21.15.17:0/3074476949 conn(0x7f43bc0cb1b0 msgr2=0x7f43bc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:14.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.711+0000 7f43c2d76640 1 -- 172.21.15.17:0/3074476949 shutdown_connections 2023-08-09T12:40:14.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.711+0000 7f43c2d76640 1 -- 172.21.15.17:0/3074476949 wait complete. 2023-08-09T12:40:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.712+0000 7f43c2d76640 1 Processor -- start 2023-08-09T12:40:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.713+0000 7f43c2d76640 1 -- start start 2023-08-09T12:40:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c2d76640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 0x7f43bc1f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c2d76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc1f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c2d76640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43bc161660 0x7f43bc0b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c2d76640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc155520 con 0x7f43bc161280 2023-08-09T12:40:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c2d76640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc1524b0 con 0x7f43bc161660 2023-08-09T12:40:14.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c2d76640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc154910 con 0x7f43bc0ca450 2023-08-09T12:40:14.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc1f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc1f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49760/0 (socket says 172.21.15.17:49760) 2023-08-09T12:40:14.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43b3fff640 1 -- 172.21.15.17:0/2831863494 learned_addr learned my addr 172.21.15.17:0/2831863494 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:14.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c1313640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43bc161660 0x7f43bc0b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43b3fff640 1 -- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 msgr2=0x7f43bc1f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c0b12640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 0x7f43bc1f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43b3fff640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 0x7f43bc1f31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43b3fff640 1 -- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43bc161660 msgr2=0x7f43bc0b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43b3fff640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43bc161660 0x7f43bc0b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43b3fff640 1 -- 172.21.15.17:0/2831863494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80094d0 con 0x7f43bc161280 2023-08-09T12:40:14.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.714+0000 7f43c1313640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43bc161660 0x7f43bc0b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:14.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.715+0000 7f43b3fff640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc1f2160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00b420 tx=0x7f43ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:14.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.715+0000 7f43b17fa640 1 -- 172.21.15.17:0/2831863494 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac015070 con 0x7f43bc161280 2023-08-09T12:40:14.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.715+0000 7f43b17fa640 1 -- 172.21.15.17:0/2831863494 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac005970 con 0x7f43bc161280 2023-08-09T12:40:14.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.715+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc154bf0 con 0x7f43bc161280 2023-08-09T12:40:14.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.715+0000 7f43b17fa640 1 -- 172.21.15.17:0/2831863494 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac005d20 con 0x7f43bc161280 2023-08-09T12:40:14.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.715+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc1551b0 con 0x7f43bc161280 2023-08-09T12:40:14.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.716+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc0c21d0 con 0x7f43bc161280 2023-08-09T12:40:14.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.717+0000 7f43b17fa640 1 -- 172.21.15.17:0/2831863494 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43ac011630 con 0x7f43bc161280 2023-08-09T12:40:14.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.718+0000 7f43b17fa640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43a806a050 0x7f43a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:14.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.718+0000 7f43b17fa640 1 -- 172.21.15.17:0/2831863494 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f43ac087cf0 con 0x7f43bc161280 2023-08-09T12:40:14.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.719+0000 7f43c0b12640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43a806a050 0x7f43a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:14.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.720+0000 7f43c0b12640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43a806a050 0x7f43a806c510 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f43b8036000 tx=0x7f43b803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:14.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.722+0000 7f43b17fa640 1 -- 172.21.15.17:0/2831863494 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f43bc0c21d0 con 0x7f43bc161280 2023-08-09T12:40:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.915+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43bc0c21d0 con 0x7f43bc161280 2023-08-09T12:40:14.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.916+0000 7f43b17fa640 1 -- 172.21.15.17:0/2831863494 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43bc0c21d0 con 0x7f43bc161280 2023-08-09T12:40:14.921 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43a806a050 msgr2=0x7f43a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43a806a050 0x7f43a806c510 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f43b8036000 tx=0x7f43b803d040 comp rx=0 tx=0).stop 2023-08-09T12:40:14.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 msgr2=0x7f43bc1f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:14.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc1f2160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00b420 tx=0x7f43ac00b8e0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 shutdown_connections 2023-08-09T12:40:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43a806a050 0x7f43a806c510 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43bc161660 0x7f43bc0b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43bc161280 0x7f43bc1f2160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 --2- 172.21.15.17:0/2831863494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43bc0ca450 0x7f43bc1f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 >> 172.21.15.17:0/2831863494 conn(0x7f43bc0cb1b0 msgr2=0x7f43bc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 shutdown_connections 2023-08-09T12:40:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:14.919+0000 7f43c2d76640 1 -- 172.21.15.17:0/2831863494 wait complete. 2023-08-09T12:40:14.941 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:15.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.173+0000 7fda7d914640 1 Processor -- start 2023-08-09T12:40:15.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.174+0000 7fda7d914640 1 -- start start 2023-08-09T12:40:15.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.175+0000 7fda7d914640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda780b44b0 0x7fda780b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.175+0000 7fda7d914640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780d09e0 con 0x7fda7815cac0 2023-08-09T12:40:15.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.175+0000 7fda7d914640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780b4e20 con 0x7fda780b1fc0 2023-08-09T12:40:15.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.175+0000 7fda7d914640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780d1010 con 0x7fda780b44b0 2023-08-09T12:40:15.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.176+0000 7fda7c912640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fda7815cac0 0x7fda780cd290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55316/0 (socket says 172.21.15.17:55316) 2023-08-09T12:40:15.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.176+0000 7fda7c912640 1 -- 172.21.15.17:0/3472625455 learned_addr learned my addr 172.21.15.17:0/3472625455 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:15.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.176+0000 7fda7d113640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda780b44b0 0x7fda780b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.176+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111020962 0 0) 0x7fda780d09e0 con 0x7fda7815cac0 2023-08-09T12:40:15.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.176+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda68003520 con 0x7fda7815cac0 2023-08-09T12:40:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1752941376 0 0) 0x7fda68003520 con 0x7fda7815cac0 2023-08-09T12:40:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda780b44b0 msgr2=0x7fda780b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda780b44b0 0x7fda780b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 >> v1:172.21.15.142:6789/0 conn(0x7fda780b1fc0 legacy=0x7fda780d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780cdb70 con 0x7fda7815cac0 2023-08-09T12:40:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fda6c001670 con 0x7fda7815cac0 2023-08-09T12:40:15.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 >> v1:172.21.15.17:6789/0 conn(0x7fda7815cac0 legacy=0x7fda780cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda680039a0 0x7fda68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda680047c0 0x7fda68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda780b44b0 0x7fda680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780d1010 con 0x7fda680039a0 2023-08-09T12:40:15.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800bab0 con 0x7fda680047c0 2023-08-09T12:40:15.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800bc70 con 0x7fda780b44b0 2023-08-09T12:40:15.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.177+0000 7fda7c912640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda680039a0 0x7fda68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.178+0000 7fda77fff640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda680047c0 0x7fda68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.178+0000 7fda7c912640 1 -- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda780b44b0 msgr2=0x7fda680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:15.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.178+0000 7fda7d113640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda780b44b0 0x7fda680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.178+0000 7fda7c912640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda780b44b0 0x7fda680051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.178+0000 7fda7c912640 1 -- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda680047c0 msgr2=0x7fda68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:15.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.178+0000 7fda7c912640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda680047c0 0x7fda68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.178+0000 7fda7c912640 1 -- 172.21.15.17:0/3472625455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68003520 con 0x7fda680039a0 2023-08-09T12:40:15.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.178+0000 7fda77fff640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda680047c0 0x7fda68004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:15.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.179+0000 7fda7c912640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda680039a0 0x7fda68003dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00c240 tx=0x7fda680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6312b76b377f202 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:15.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.179+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c005ad0 con 0x7fda680039a0 2023-08-09T12:40:15.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.179+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c005c30 con 0x7fda680039a0 2023-08-09T12:40:15.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.179+0000 7fda777fe640 1 -- 172.21.15.17:0/3472625455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c02c8b0 con 0x7fda680039a0 2023-08-09T12:40:15.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.180+0000 7fda7d914640 1 -- 172.21.15.17:0/3472625455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda680039a0 msgr2=0x7fda68003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.180+0000 7fda7d914640 1 --2- 172.21.15.17:0/3472625455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda680039a0 0x7fda68003dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00c240 tx=0x7fda680057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.180+0000 7fda7d113640 1 -- 172.21.15.17:0/3472625455 reap_dead start 2023-08-09T12:40:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.180+0000 7fda7d914640 1 -- 172.21.15.17:0/3472625455 shutdown_connections 2023-08-09T12:40:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.180+0000 7fda7d914640 1 -- 172.21.15.17:0/3472625455 >> 172.21.15.17:0/3472625455 conn(0x7fda780cf4b0 msgr2=0x7fda780cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.180+0000 7fda7d914640 1 -- 172.21.15.17:0/3472625455 shutdown_connections 2023-08-09T12:40:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.180+0000 7fda7d914640 1 -- 172.21.15.17:0/3472625455 wait complete. 2023-08-09T12:40:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.182+0000 7fda7d914640 1 Processor -- start 2023-08-09T12:40:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.182+0000 7fda7d914640 1 -- start start 2023-08-09T12:40:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda7d914640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680039a0 0x7fda781f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda7d914640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda780b3800 0x7fda780b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda7d914640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7814d8d0 0x7fda7814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda7d914640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780d1b40 con 0x7fda780b3800 2023-08-09T12:40:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda7d914640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78151cd0 con 0x7fda7814d8d0 2023-08-09T12:40:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda7d914640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780b41c0 con 0x7fda680039a0 2023-08-09T12:40:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda780b3800 0x7fda780b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda780b3800 0x7fda780b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49780/0 (socket says 172.21.15.17:49780) 2023-08-09T12:40:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.183+0000 7fda77fff640 1 -- 172.21.15.17:0/1547659251 learned_addr learned my addr 172.21.15.17:0/1547659251 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda77fff640 1 -- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680039a0 msgr2=0x7fda781f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda77fff640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680039a0 0x7fda781f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda77fff640 1 -- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7814d8d0 msgr2=0x7fda7814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda7d113640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7814d8d0 0x7fda7814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda77fff640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7814d8d0 0x7fda7814dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda77fff640 1 -- 172.21.15.17:0/1547659251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda781f2140 con 0x7fda780b3800 2023-08-09T12:40:15.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda7d113640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7814d8d0 0x7fda7814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:15.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda77fff640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda780b3800 0x7fda780b3c80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fda6400d7d0 tx=0x7fda6400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:15.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda757fa640 1 -- 172.21.15.17:0/1547659251 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64017070 con 0x7fda780b3800 2023-08-09T12:40:15.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda757fa640 1 -- 172.21.15.17:0/1547659251 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda64005070 con 0x7fda780b3800 2023-08-09T12:40:15.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda757fa640 1 -- 172.21.15.17:0/1547659251 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64005440 con 0x7fda780b3800 2023-08-09T12:40:15.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.184+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7814e840 con 0x7fda780b3800 2023-08-09T12:40:15.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.185+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7814e560 con 0x7fda780b3800 2023-08-09T12:40:15.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.186+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda780b33b0 con 0x7fda780b3800 2023-08-09T12:40:15.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.187+0000 7fda757fa640 1 -- 172.21.15.17:0/1547659251 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda64007030 con 0x7fda780b3800 2023-08-09T12:40:15.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.188+0000 7fda757fa640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5c06a050 0x7fda5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.188+0000 7fda757fa640 1 -- 172.21.15.17:0/1547659251 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fda64087e20 con 0x7fda780b3800 2023-08-09T12:40:15.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.189+0000 7fda7c912640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5c06a050 0x7fda5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.190+0000 7fda7c912640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5c06a050 0x7fda5c06c510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda6c034000 tx=0x7fda6c007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.192+0000 7fda757fa640 1 -- 172.21.15.17:0/1547659251 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fda640534c0 con 0x7fda780b3800 2023-08-09T12:40:15.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.384+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda7804e390 con 0x7fda780b3800 2023-08-09T12:40:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.385+0000 7fda757fa640 1 -- 172.21.15.17:0/1547659251 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda64056ae0 con 0x7fda780b3800 2023-08-09T12:40:15.388 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5c06a050 msgr2=0x7fda5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5c06a050 0x7fda5c06c510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda6c034000 tx=0x7fda6c007000 comp rx=0 tx=0).stop 2023-08-09T12:40:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda780b3800 msgr2=0x7fda780b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda780b3800 0x7fda780b3c80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fda6400d7d0 tx=0x7fda6400dc90 comp rx=0 tx=0).stop 2023-08-09T12:40:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 shutdown_connections 2023-08-09T12:40:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5c06a050 0x7fda5c06c510 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7814d8d0 0x7fda7814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda780b3800 0x7fda780b3c80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 --2- 172.21.15.17:0/1547659251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda680039a0 0x7fda781f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 >> 172.21.15.17:0/1547659251 conn(0x7fda780cf4b0 msgr2=0x7fda780cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:15.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 shutdown_connections 2023-08-09T12:40:15.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.388+0000 7fda7d914640 1 -- 172.21.15.17:0/1547659251 wait complete. 2023-08-09T12:40:15.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:15.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.645+0000 7fbb09d2f640 1 Processor -- start 2023-08-09T12:40:15.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.645+0000 7fbb09d2f640 1 -- start start 2023-08-09T12:40:15.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.646+0000 7fbb09d2f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb04159d80 0x7fbb040b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.646+0000 7fbb09d2f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb04070a90 0x7fbb040c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.646+0000 7fbb09d2f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb040b4630 con 0x7fbb040ad810 2023-08-09T12:40:15.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.646+0000 7fbb09d2f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0415a160 con 0x7fbb04070a90 2023-08-09T12:40:15.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.646+0000 7fbb09d2f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040b3ab0 con 0x7fbb04159d80 2023-08-09T12:40:15.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.647+0000 7fbb03fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb04070a90 0x7fbb040c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.647+0000 7fbb02ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbb040ad810 0x7fbb04070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:35100/0 (socket says 172.21.15.17:35100) 2023-08-09T12:40:15.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.647+0000 7fbb03fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb04070a90 0x7fbb040c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:35086/0 (socket says 172.21.15.17:35086) 2023-08-09T12:40:15.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.647+0000 7fbb02ffd640 1 -- 172.21.15.17:0/1628748389 learned_addr learned my addr 172.21.15.17:0/1628748389 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:15.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.647+0000 7fbb037fe640 1 --2- 172.21.15.17:0/1628748389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb04159d80 0x7fbb040b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.648+0000 7fbb03fff640 1 -- 172.21.15.17:0/1628748389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb04159d80 msgr2=0x7fbb040b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:15.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.648+0000 7fbb03fff640 1 --2- 172.21.15.17:0/1628748389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb04159d80 0x7fbb040b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.648+0000 7fbb03fff640 1 -- 172.21.15.17:0/1628748389 >> v1:172.21.15.142:6789/0 conn(0x7fbb040ad810 legacy=0x7fbb04070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.648+0000 7fbb027fc640 1 -- 172.21.15.17:0/1628748389 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871950065 0 0) 0x7fbb040b4630 con 0x7fbb040ad810 2023-08-09T12:40:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.648+0000 7fbb03fff640 1 -- 172.21.15.17:0/1628748389 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb040b3d90 con 0x7fbb04070a90 2023-08-09T12:40:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.650+0000 7fbb03fff640 1 --2- 172.21.15.17:0/1628748389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04070a90 0x7fbb040c8fd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009d90 tx=0x7fbafc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcaf70d65177303d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:15.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.650+0000 7fbb027fc640 1 -- 172.21.15.17:0/1628748389 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc02cc50 con 0x7fbb04070a90 2023-08-09T12:40:15.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.650+0000 7fbb027fc640 1 -- 172.21.15.17:0/1628748389 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc02cdb0 con 0x7fbb04070a90 2023-08-09T12:40:15.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.650+0000 7fbb027fc640 1 -- 172.21.15.17:0/1628748389 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc034660 con 0x7fbb04070a90 2023-08-09T12:40:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.651+0000 7fbb09d2f640 1 -- 172.21.15.17:0/1628748389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04070a90 msgr2=0x7fbb040c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.651+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/1628748389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04070a90 0x7fbb040c8fd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009d90 tx=0x7fbafc02bea0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.651+0000 7fbb09d2f640 1 -- 172.21.15.17:0/1628748389 shutdown_connections 2023-08-09T12:40:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.651+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/1628748389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04070a90 0x7fbb040c8fd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.651+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/1628748389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb04159d80 0x7fbb040b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.651+0000 7fbb09d2f640 1 -- 172.21.15.17:0/1628748389 >> 172.21.15.17:0/1628748389 conn(0x7fbb040cb1b0 msgr2=0x7fbb040cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:15.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.651+0000 7fbb09d2f640 1 -- 172.21.15.17:0/1628748389 shutdown_connections 2023-08-09T12:40:15.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.651+0000 7fbb09d2f640 1 -- 172.21.15.17:0/1628748389 wait complete. 2023-08-09T12:40:15.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.653+0000 7fbb09d2f640 1 Processor -- start 2023-08-09T12:40:15.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.653+0000 7fbb09d2f640 1 -- start start 2023-08-09T12:40:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb09d2f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb04070a90 0x7fbb0414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb09d2f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb040ad810 0x7fbb041505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb09d2f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04159d80 0x7fbb04150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb09d2f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb04158460 con 0x7fbb04070a90 2023-08-09T12:40:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb09d2f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb04158740 con 0x7fbb04159d80 2023-08-09T12:40:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb09d2f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb04158a20 con 0x7fbb040ad810 2023-08-09T12:40:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb04070a90 0x7fbb0414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb04070a90 0x7fbb0414f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49796/0 (socket says 172.21.15.17:49796) 2023-08-09T12:40:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.654+0000 7fbb037fe640 1 -- 172.21.15.17:0/4248088477 learned_addr learned my addr 172.21.15.17:0/4248088477 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.655+0000 7fbb03fff640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04159d80 0x7fbb04150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.655+0000 7fbb037fe640 1 -- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb040ad810 msgr2=0x7fbb041505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.655+0000 7fbb037fe640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb040ad810 0x7fbb041505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.655+0000 7fbb037fe640 1 -- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04159d80 msgr2=0x7fbb04150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.655+0000 7fbb037fe640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04159d80 0x7fbb04150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.655+0000 7fbb037fe640 1 -- 172.21.15.17:0/4248088477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc009a70 con 0x7fbb04070a90 2023-08-09T12:40:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.655+0000 7fbb03fff640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04159d80 0x7fbb04150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.655+0000 7fbb037fe640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb04070a90 0x7fbb0414f810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400e870 tx=0x7fbaf400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.656+0000 7fbaebfff640 1 -- 172.21.15.17:0/4248088477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40094f0 con 0x7fbb04070a90 2023-08-09T12:40:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.656+0000 7fbaebfff640 1 -- 172.21.15.17:0/4248088477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400c940 con 0x7fbb04070a90 2023-08-09T12:40:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.656+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb040c2ce0 con 0x7fbb04070a90 2023-08-09T12:40:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.656+0000 7fbaebfff640 1 -- 172.21.15.17:0/4248088477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400ccf0 con 0x7fbb04070a90 2023-08-09T12:40:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.656+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0414fd50 con 0x7fbb04070a90 2023-08-09T12:40:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.657+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb04067a80 con 0x7fbb04070a90 2023-08-09T12:40:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.658+0000 7fbaebfff640 1 -- 172.21.15.17:0/4248088477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbaf4013470 con 0x7fbb04070a90 2023-08-09T12:40:15.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.659+0000 7fbaebfff640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a080 0x7fbaf006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:15.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.659+0000 7fbaebfff640 1 -- 172.21.15.17:0/4248088477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbaf4088690 con 0x7fbb04070a90 2023-08-09T12:40:15.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.660+0000 7fbb02ffd640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a080 0x7fbaf006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:15.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.660+0000 7fbb02ffd640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a080 0x7fbaf006c540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8007fd0 tx=0x7fbaf8007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:15.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.663+0000 7fbaebfff640 1 -- 172.21.15.17:0/4248088477 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbaf4053d30 con 0x7fbb04070a90 2023-08-09T12:40:15.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.861+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb040c9900 con 0x7fbb04070a90 2023-08-09T12:40:15.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.862+0000 7fbaebfff640 1 -- 172.21.15.17:0/4248088477 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbaf4057350 con 0x7fbb04070a90 2023-08-09T12:40:15.866 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:15.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a080 msgr2=0x7fbaf006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a080 0x7fbaf006c540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8007fd0 tx=0x7fbaf8007900 comp rx=0 tx=0).stop 2023-08-09T12:40:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb04070a90 msgr2=0x7fbb0414f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb04070a90 0x7fbb0414f810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400e870 tx=0x7fbaf400ed30 comp rx=0 tx=0).stop 2023-08-09T12:40:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 shutdown_connections 2023-08-09T12:40:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a080 0x7fbaf006c540 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb04159d80 0x7fbb04150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb040ad810 0x7fbb041505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 --2- 172.21.15.17:0/4248088477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb04070a90 0x7fbb0414f810 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 >> 172.21.15.17:0/4248088477 conn(0x7fbb040cb1b0 msgr2=0x7fbb04070380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.865+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 shutdown_connections 2023-08-09T12:40:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:15.866+0000 7fbb09d2f640 1 -- 172.21.15.17:0/4248088477 wait complete. 2023-08-09T12:40:15.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:40:16.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.118+0000 7f5020399640 1 Processor -- start 2023-08-09T12:40:16.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.118+0000 7f5020399640 1 -- start start 2023-08-09T12:40:16.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.120+0000 7f5020399640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f501815ccf0 0x7f501806b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.120+0000 7f5020399640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50180cb630 0x7f50180cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.120+0000 7f5020399640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5018161390 con 0x7f50180ccc30 2023-08-09T12:40:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.120+0000 7f5020399640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50180cb3b0 con 0x7f50180cb630 2023-08-09T12:40:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.120+0000 7f5020399640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50180ad010 con 0x7f501815ccf0 2023-08-09T12:40:16.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.120+0000 7f501d934640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50180cb630 0x7f50180cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.120+0000 7f501d934640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50180cb630 0x7f50180cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49812/0 (socket says 172.21.15.17:49812) 2023-08-09T12:40:16.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.120+0000 7f501d934640 1 -- 172.21.15.17:0/2499447414 learned_addr learned my addr 172.21.15.17:0/2499447414 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:16.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.121+0000 7f501d934640 1 -- 172.21.15.17:0/2499447414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f501815ccf0 msgr2=0x7f501806b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:16.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.121+0000 7f501d934640 1 --2- 172.21.15.17:0/2499447414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f501815ccf0 0x7f501806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.121+0000 7f501d934640 1 -- 172.21.15.17:0/2499447414 >> v1:172.21.15.142:6789/0 conn(0x7f50180ccc30 legacy=0x7f50180ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:16.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.121+0000 7f501d934640 1 -- 172.21.15.17:0/2499447414 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50181618c0 con 0x7f50180cb630 2023-08-09T12:40:16.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.122+0000 7f501d934640 1 --2- 172.21.15.17:0/2499447414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f50180cae70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5008009870 tx=0x7f500802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e78f280d30ecf42 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:16.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f501d133640 1 -- 172.21.15.17:0/2499447414 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008031640 con 0x7f50180cb630 2023-08-09T12:40:16.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f501d133640 1 -- 172.21.15.17:0/2499447414 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50080317a0 con 0x7f50180cb630 2023-08-09T12:40:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f501d133640 1 -- 172.21.15.17:0/2499447414 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008031b30 con 0x7f50180cb630 2023-08-09T12:40:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f5020399640 1 -- 172.21.15.17:0/2499447414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 msgr2=0x7f50180cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f5020399640 1 --2- 172.21.15.17:0/2499447414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f50180cae70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5008009870 tx=0x7f500802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f5020399640 1 -- 172.21.15.17:0/2499447414 shutdown_connections 2023-08-09T12:40:16.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f5020399640 1 --2- 172.21.15.17:0/2499447414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f50180cae70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f5020399640 1 --2- 172.21.15.17:0/2499447414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f501815ccf0 0x7f501806b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f5020399640 1 -- 172.21.15.17:0/2499447414 >> 172.21.15.17:0/2499447414 conn(0x7f50180cf060 msgr2=0x7f50180cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:16.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.123+0000 7f5020399640 1 -- 172.21.15.17:0/2499447414 shutdown_connections 2023-08-09T12:40:16.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.124+0000 7f5020399640 1 -- 172.21.15.17:0/2499447414 wait complete. 2023-08-09T12:40:16.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.125+0000 7f5020399640 1 Processor -- start 2023-08-09T12:40:16.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.125+0000 7f5020399640 1 -- start start 2023-08-09T12:40:16.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.126+0000 7f5020399640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f5018071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.126+0000 7f5020399640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50180ccc30 0x7f50180c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.126+0000 7f5020399640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f501815ccf0 0x7f50180b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.126+0000 7f5020399640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50180c59d0 con 0x7f50180cb630 2023-08-09T12:40:16.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.126+0000 7f5020399640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50180c3540 con 0x7f50180ccc30 2023-08-09T12:40:16.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.126+0000 7f5020399640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50180c3820 con 0x7f501815ccf0 2023-08-09T12:40:16.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f5018071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f5018071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49814/0 (socket says 172.21.15.17:49814) 2023-08-09T12:40:16.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 -- 172.21.15.17:0/1362042740 learned_addr learned my addr 172.21.15.17:0/1362042740 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:16.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501d934640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50180ccc30 0x7f50180c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 -- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f501815ccf0 msgr2=0x7f50180b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:16.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f501815ccf0 0x7f50180b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 -- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50180ccc30 msgr2=0x7f50180c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:16.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50180ccc30 0x7f50180c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 -- 172.21.15.17:0/1362042740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080094d0 con 0x7f50180cb630 2023-08-09T12:40:16.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501d934640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50180ccc30 0x7f50180c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:16.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.127+0000 7f501e135640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f5018071570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f501400ba50 tx=0x7f501400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:16.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.128+0000 7f500effd640 1 -- 172.21.15.17:0/1362042740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400cbe0 con 0x7f50180cb630 2023-08-09T12:40:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.128+0000 7f500effd640 1 -- 172.21.15.17:0/1362042740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400cd60 con 0x7f50180cb630 2023-08-09T12:40:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.128+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50180c6260 con 0x7f50180cb630 2023-08-09T12:40:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.128+0000 7f500effd640 1 -- 172.21.15.17:0/1362042740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014014680 con 0x7f50180cb630 2023-08-09T12:40:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.128+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50180c3b00 con 0x7f50180cb630 2023-08-09T12:40:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.129+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50180c6780 con 0x7f50180cb630 2023-08-09T12:40:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.130+0000 7f500effd640 1 -- 172.21.15.17:0/1362042740 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f501401d3b0 con 0x7f50180cb630 2023-08-09T12:40:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.131+0000 7f500effd640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ffc06a050 0x7f4ffc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.131+0000 7f500effd640 1 -- 172.21.15.17:0/1362042740 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f50140885c0 con 0x7f50180cb630 2023-08-09T12:40:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.132+0000 7f501d934640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ffc06a050 0x7f4ffc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.133+0000 7f501d934640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ffc06a050 0x7f4ffc06c510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5008036000 tx=0x7f500803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:16.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.135+0000 7f500effd640 1 -- 172.21.15.17:0/1362042740 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5014053c60 con 0x7f50180cb630 2023-08-09T12:40:16.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.344+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5018067a80 con 0x7f50180cb630 2023-08-09T12:40:16.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.345+0000 7f500effd640 1 -- 172.21.15.17:0/1362042740 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5014057280 con 0x7f50180cb630 2023-08-09T12:40:16.349 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:40:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.347+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ffc06a050 msgr2=0x7f4ffc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.347+0000 7f5020399640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ffc06a050 0x7f4ffc06c510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5008036000 tx=0x7f500803c040 comp rx=0 tx=0).stop 2023-08-09T12:40:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.347+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 msgr2=0x7f5018071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.347+0000 7f5020399640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f5018071570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f501400ba50 tx=0x7f501400bf10 comp rx=0 tx=0).stop 2023-08-09T12:40:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.348+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 shutdown_connections 2023-08-09T12:40:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.348+0000 7f5020399640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ffc06a050 0x7f4ffc06c510 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.348+0000 7f5020399640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f501815ccf0 0x7f50180b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.348+0000 7f5020399640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50180ccc30 0x7f50180c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.348+0000 7f5020399640 1 --2- 172.21.15.17:0/1362042740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50180cb630 0x7f5018071570 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.348+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 >> 172.21.15.17:0/1362042740 conn(0x7f50180cf060 msgr2=0x7f50180cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.348+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 shutdown_connections 2023-08-09T12:40:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.348+0000 7f5020399640 1 -- 172.21.15.17:0/1362042740 wait complete. 2023-08-09T12:40:16.369 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:40:16.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:16.370 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-09T12:40:16.488 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:40:16.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:16.489 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:40:16.553 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:16.554 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:16.621 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:16.622 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:16.684 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:16.684 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:16.742 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:16.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.974+0000 7f03b2aad640 1 Processor -- start 2023-08-09T12:40:16.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.975+0000 7f03b2aad640 1 -- start start 2023-08-09T12:40:16.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.976+0000 7f03b2aad640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f03ac160030 0x7f03ac160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.976+0000 7f03b2aad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03ac0b86e0 0x7f03ac0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.976+0000 7f03b2aad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 0x7f03ac0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.976+0000 7f03b2aad640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac0d1110 con 0x7f03ac160030 2023-08-09T12:40:16.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.976+0000 7f03b2aad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac0ceac0 con 0x7f03ac0b86e0 2023-08-09T12:40:16.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.976+0000 7f03b2aad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0cfe10 con 0x7f03ac0cf980 2023-08-09T12:40:16.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.977+0000 7f03b1aab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f03ac160030 0x7f03ac160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.977+0000 7f03b1aab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f03ac160030 0x7f03ac160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49816/0 (socket says 172.21.15.17:49816) 2023-08-09T12:40:16.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.977+0000 7f03b1aab640 1 -- 172.21.15.17:0/3231443866 learned_addr learned my addr 172.21.15.17:0/3231443866 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:16.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.977+0000 7f03b1aab640 1 -- 172.21.15.17:0/3231443866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 msgr2=0x7f03ac0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:16.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.977+0000 7f03b1aab640 1 --2- 172.21.15.17:0/3231443866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 0x7f03ac0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.977+0000 7f03b1aab640 1 -- 172.21.15.17:0/3231443866 >> v2:172.21.15.142:3300/0 conn(0x7f03ac0b86e0 msgr2=0x7f03ac0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:16.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.977+0000 7f03b1aab640 1 --2- 172.21.15.17:0/3231443866 >> v2:172.21.15.142:3300/0 conn(0x7f03ac0b86e0 0x7f03ac0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.977+0000 7f03b1aab640 1 -- 172.21.15.17:0/3231443866 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0b5a30 con 0x7f03ac160030 2023-08-09T12:40:16.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.978+0000 7f03b1aab640 1 --2- 172.21.15.17:0/3231443866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac160740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0d3b70 tx=0x7f03a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4751718d4aa74982 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:16.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b0aa9640 1 -- 172.21.15.17:0/3231443866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8031870 con 0x7f03ac160030 2023-08-09T12:40:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b0aa9640 1 -- 172.21.15.17:0/3231443866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a80319d0 con 0x7f03ac160030 2023-08-09T12:40:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b0aa9640 1 -- 172.21.15.17:0/3231443866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8031d60 con 0x7f03ac160030 2023-08-09T12:40:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 -- 172.21.15.17:0/3231443866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 msgr2=0x7f03ac160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 --2- 172.21.15.17:0/3231443866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac160740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0d3b70 tx=0x7f03a802b910 comp rx=0 tx=0).stop 2023-08-09T12:40:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 -- 172.21.15.17:0/3231443866 shutdown_connections 2023-08-09T12:40:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 --2- 172.21.15.17:0/3231443866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 0x7f03ac0b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 --2- 172.21.15.17:0/3231443866 >> v2:172.21.15.142:3300/0 conn(0x7f03ac0b86e0 0x7f03ac0cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 --2- 172.21.15.17:0/3231443866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac160740 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 -- 172.21.15.17:0/3231443866 >> 172.21.15.17:0/3231443866 conn(0x7f03ac0697c0 msgr2=0x7f03ac069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 -- 172.21.15.17:0/3231443866 shutdown_connections 2023-08-09T12:40:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.979+0000 7f03b2aad640 1 -- 172.21.15.17:0/3231443866 wait complete. 2023-08-09T12:40:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.981+0000 7f03b2aad640 1 Processor -- start 2023-08-09T12:40:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.981+0000 7f03b2aad640 1 -- start start 2023-08-09T12:40:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.982+0000 7f03b2aad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03ac0b86e0 0x7f03ac0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.982+0000 7f03b2aad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 0x7f03ac1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.982+0000 7f03b2aad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac15d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.982+0000 7f03b2aad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac1538e0 con 0x7f03ac160030 2023-08-09T12:40:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.982+0000 7f03b2aad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac15d5a0 con 0x7f03ac0b86e0 2023-08-09T12:40:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.982+0000 7f03b2aad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0ca1d0 con 0x7f03ac0cf980 2023-08-09T12:40:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b22ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b22ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49828/0 (socket says 172.21.15.17:49828) 2023-08-09T12:40:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b22ac640 1 -- 172.21.15.17:0/552499906 learned_addr learned my addr 172.21.15.17:0/552499906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b1aab640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03ac0b86e0 0x7f03ac0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b12aa640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 0x7f03ac1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b22ac640 1 -- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 msgr2=0x7f03ac1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b22ac640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 0x7f03ac1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b22ac640 1 -- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03ac0b86e0 msgr2=0x7f03ac0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b22ac640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03ac0b86e0 0x7f03ac0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.983+0000 7f03b22ac640 1 -- 172.21.15.17:0/552499906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80094d0 con 0x7f03ac160030 2023-08-09T12:40:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.984+0000 7f03b22ac640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac15d060 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f03a400b970 tx=0x7f03a400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.984+0000 7f03a27fc640 1 -- 172.21.15.17:0/552499906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400cb40 con 0x7f03ac160030 2023-08-09T12:40:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.984+0000 7f03a27fc640 1 -- 172.21.15.17:0/552499906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a400ccc0 con 0x7f03ac160030 2023-08-09T12:40:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.984+0000 7f03a27fc640 1 -- 172.21.15.17:0/552499906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4014680 con 0x7f03ac160030 2023-08-09T12:40:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.984+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac0ca4b0 con 0x7f03ac160030 2023-08-09T12:40:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.984+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac0caa70 con 0x7f03ac160030 2023-08-09T12:40:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.986+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac04e390 con 0x7f03ac160030 2023-08-09T12:40:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.987+0000 7f03a27fc640 1 -- 172.21.15.17:0/552499906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f03a401d3b0 con 0x7f03ac160030 2023-08-09T12:40:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.988+0000 7f03a27fc640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f039006a050 0x7f039006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.988+0000 7f03a27fc640 1 -- 172.21.15.17:0/552499906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f03a4088690 con 0x7f03ac160030 2023-08-09T12:40:16.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.988+0000 7f03b1aab640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f039006a050 0x7f039006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:16.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.990+0000 7f03b1aab640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f039006a050 0x7f039006c510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03a8036000 tx=0x7f03a803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:16.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:16.992+0000 7f03a27fc640 1 -- 172.21.15.17:0/552499906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f03a4053c10 con 0x7f03ac160030 2023-08-09T12:40:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.191+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03ac0d0640 con 0x7f03ac160030 2023-08-09T12:40:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.193+0000 7f03a27fc640 1 -- 172.21.15.17:0/552499906 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f03a4019090 con 0x7f03ac160030 2023-08-09T12:40:17.197 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:17.197 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:09.763656+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:17.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f039006a050 msgr2=0x7f039006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f039006a050 0x7f039006c510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03a8036000 tx=0x7f03a803c040 comp rx=0 tx=0).stop 2023-08-09T12:40:17.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 msgr2=0x7f03ac15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac15d060 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f03a400b970 tx=0x7f03a400be30 comp rx=0 tx=0).stop 2023-08-09T12:40:17.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 shutdown_connections 2023-08-09T12:40:17.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f039006a050 0x7f039006c510 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03ac160030 0x7f03ac15d060 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03ac0cf980 0x7f03ac1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 --2- 172.21.15.17:0/552499906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03ac0b86e0 0x7f03ac0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 >> 172.21.15.17:0/552499906 conn(0x7f03ac0697c0 msgr2=0x7f03ac15db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:17.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 shutdown_connections 2023-08-09T12:40:17.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.196+0000 7f03b2aad640 1 -- 172.21.15.17:0/552499906 wait complete. 2023-08-09T12:40:17.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:17.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:17.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.446+0000 7f639046c640 1 Processor -- start 2023-08-09T12:40:17.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.446+0000 7f639046c640 1 -- start start 2023-08-09T12:40:17.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f639046c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63880adc40 0x7f638806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f639046c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f63880b3b40 0x7f63880b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f639046c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880b2250 con 0x7f638815e8f0 2023-08-09T12:40:17.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f639046c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63880ae020 con 0x7f63880b3b40 2023-08-09T12:40:17.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f639046c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63880b2530 con 0x7f63880adc40 2023-08-09T12:40:17.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f638da07640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f63880b3b40 0x7f63880b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f638ea09640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f638815e8f0 0x7f638815ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55318/0 (socket says 172.21.15.17:55318) 2023-08-09T12:40:17.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f638ea09640 1 -- 172.21.15.17:0/4031339245 learned_addr learned my addr 172.21.15.17:0/4031339245 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:17.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.448+0000 7f638e208640 1 --2- 172.21.15.17:0/4031339245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63880adc40 0x7f638806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.449+0000 7f638da07640 1 -- 172.21.15.17:0/4031339245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63880adc40 msgr2=0x7f638806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:17.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.449+0000 7f638da07640 1 --2- 172.21.15.17:0/4031339245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63880adc40 0x7f638806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.449+0000 7f638da07640 1 -- 172.21.15.17:0/4031339245 >> v1:172.21.15.17:6789/0 conn(0x7f638815e8f0 legacy=0x7f638815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.449+0000 7f638da07640 1 -- 172.21.15.17:0/4031339245 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638806fe80 con 0x7f63880b3b40 2023-08-09T12:40:17.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.449+0000 7f638d206640 1 -- 172.21.15.17:0/4031339245 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864056915 0 0) 0x7f63880b2250 con 0x7f638815e8f0 2023-08-09T12:40:17.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.450+0000 7f638da07640 1 --2- 172.21.15.17:0/4031339245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880b3b40 0x7f63880b3fa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6378009790 tx=0x7f637802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f22224617686de1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:17.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.450+0000 7f638d206640 1 -- 172.21.15.17:0/4031339245 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637802d040 con 0x7f63880b3b40 2023-08-09T12:40:17.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.450+0000 7f638d206640 1 -- 172.21.15.17:0/4031339245 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378031810 con 0x7f63880b3b40 2023-08-09T12:40:17.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.450+0000 7f638d206640 1 -- 172.21.15.17:0/4031339245 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378031ba0 con 0x7f63880b3b40 2023-08-09T12:40:17.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.451+0000 7f639046c640 1 -- 172.21.15.17:0/4031339245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880b3b40 msgr2=0x7f63880b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.451+0000 7f639046c640 1 --2- 172.21.15.17:0/4031339245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880b3b40 0x7f63880b3fa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6378009790 tx=0x7f637802b8b0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.451+0000 7f639046c640 1 -- 172.21.15.17:0/4031339245 shutdown_connections 2023-08-09T12:40:17.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.451+0000 7f639046c640 1 --2- 172.21.15.17:0/4031339245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880b3b40 0x7f63880b3fa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.451+0000 7f639046c640 1 --2- 172.21.15.17:0/4031339245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63880adc40 0x7f638806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.451+0000 7f639046c640 1 -- 172.21.15.17:0/4031339245 >> 172.21.15.17:0/4031339245 conn(0x7f63880cb1b0 msgr2=0x7f63880cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:17.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.451+0000 7f639046c640 1 -- 172.21.15.17:0/4031339245 shutdown_connections 2023-08-09T12:40:17.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.451+0000 7f639046c640 1 -- 172.21.15.17:0/4031339245 wait complete. 2023-08-09T12:40:17.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.453+0000 7f639046c640 1 Processor -- start 2023-08-09T12:40:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.453+0000 7f639046c640 1 -- start start 2023-08-09T12:40:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f639046c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880adc40 0x7f638815c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f639046c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63880b3b40 0x7f63880c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f639046c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f638815e8f0 0x7f6388153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f639046c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638806a370 con 0x7f63880adc40 2023-08-09T12:40:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f639046c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880697c0 con 0x7f63880b3b40 2023-08-09T12:40:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f639046c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63880cad10 con 0x7f638815e8f0 2023-08-09T12:40:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638e208640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880adc40 0x7f638815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638e208640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880adc40 0x7f638815c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49842/0 (socket says 172.21.15.17:49842) 2023-08-09T12:40:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638e208640 1 -- 172.21.15.17:0/1731880584 learned_addr learned my addr 172.21.15.17:0/1731880584 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638da07640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63880b3b40 0x7f63880c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638e208640 1 -- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f638815e8f0 msgr2=0x7f6388153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638e208640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f638815e8f0 0x7f6388153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638e208640 1 -- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63880b3b40 msgr2=0x7f63880c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638e208640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63880b3b40 0x7f63880c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.454+0000 7f638e208640 1 -- 172.21.15.17:0/1731880584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780093a0 con 0x7f63880adc40 2023-08-09T12:40:17.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.455+0000 7f638e208640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880adc40 0x7f638815c880 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f638400d800 tx=0x7f638400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.455+0000 7f637effd640 1 -- 172.21.15.17:0/1731880584 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400b6c0 con 0x7f63880adc40 2023-08-09T12:40:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.455+0000 7f637effd640 1 -- 172.21.15.17:0/1731880584 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638400b820 con 0x7f63880adc40 2023-08-09T12:40:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.455+0000 7f637effd640 1 -- 172.21.15.17:0/1731880584 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400bbb0 con 0x7f63880adc40 2023-08-09T12:40:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.455+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63880699d0 con 0x7f63880adc40 2023-08-09T12:40:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.455+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6388069f90 con 0x7f63880adc40 2023-08-09T12:40:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.457+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6388067a80 con 0x7f63880adc40 2023-08-09T12:40:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.458+0000 7f637effd640 1 -- 172.21.15.17:0/1731880584 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f638400bd10 con 0x7f63880adc40 2023-08-09T12:40:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.458+0000 7f637effd640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f636c06a050 0x7f636c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.459+0000 7f637effd640 1 -- 172.21.15.17:0/1731880584 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6384088ad0 con 0x7f63880adc40 2023-08-09T12:40:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.459+0000 7f638da07640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f636c06a050 0x7f636c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.460+0000 7f638da07640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f636c06a050 0x7f636c06c510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6378036000 tx=0x7f637803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:17.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.463+0000 7f637effd640 1 -- 172.21.15.17:0/1731880584 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6384054210 con 0x7f63880adc40 2023-08-09T12:40:17.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.656+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f638806ed40 con 0x7f63880adc40 2023-08-09T12:40:17.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.657+0000 7f637effd640 1 -- 172.21.15.17:0/1731880584 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6384057830 con 0x7f63880adc40 2023-08-09T12:40:17.661 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:17.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f636c06a050 msgr2=0x7f636c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f636c06a050 0x7f636c06c510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6378036000 tx=0x7f637803c040 comp rx=0 tx=0).stop 2023-08-09T12:40:17.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880adc40 msgr2=0x7f638815c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880adc40 0x7f638815c880 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f638400d800 tx=0x7f638400dcc0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 shutdown_connections 2023-08-09T12:40:17.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f636c06a050 0x7f636c06c510 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f638815e8f0 0x7f6388153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63880b3b40 0x7f63880c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 --2- 172.21.15.17:0/1731880584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63880adc40 0x7f638815c880 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 >> 172.21.15.17:0/1731880584 conn(0x7f63880cb1b0 msgr2=0x7f63880c21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 shutdown_connections 2023-08-09T12:40:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.660+0000 7f639046c640 1 -- 172.21.15.17:0/1731880584 wait complete. 2023-08-09T12:40:17.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.916+0000 7f75e010f640 1 Processor -- start 2023-08-09T12:40:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.916+0000 7f75e010f640 1 -- start start 2023-08-09T12:40:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75e010f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75e010f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f75d80b3b40 0x7f75d80b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75e010f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d80b2250 con 0x7f75d815e8f0 2023-08-09T12:40:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75e010f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d80ae020 con 0x7f75d80b3b40 2023-08-09T12:40:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75e010f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80b2530 con 0x7f75d80adc40 2023-08-09T12:40:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75dd6aa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f75d80b3b40 0x7f75d80b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75dd6aa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f75d80b3b40 0x7f75d80b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51968/0 (socket says 172.21.15.17:51968) 2023-08-09T12:40:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75dd6aa640 1 -- 172.21.15.17:0/3840829265 learned_addr learned my addr 172.21.15.17:0/3840829265 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.918+0000 7f75ddeab640 1 --2- 172.21.15.17:0/3840829265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.919+0000 7f75dd6aa640 1 -- 172.21.15.17:0/3840829265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 msgr2=0x7f75d806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.919+0000 7f75dd6aa640 1 --2- 172.21.15.17:0/3840829265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.919+0000 7f75dd6aa640 1 -- 172.21.15.17:0/3840829265 >> v1:172.21.15.142:6789/0 conn(0x7f75d815e8f0 legacy=0x7f75d815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.919+0000 7f75dd6aa640 1 -- 172.21.15.17:0/3840829265 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d806fe80 con 0x7f75d80b3b40 2023-08-09T12:40:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.921+0000 7f75dd6aa640 1 --2- 172.21.15.17:0/3840829265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d80b3fa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009860 tx=0x7f75c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c76b520192517f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.921+0000 7f75dcea9640 1 -- 172.21.15.17:0/3840829265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8030840 con 0x7f75d80b3b40 2023-08-09T12:40:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.921+0000 7f75dcea9640 1 -- 172.21.15.17:0/3840829265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c80309a0 con 0x7f75d80b3b40 2023-08-09T12:40:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.921+0000 7f75dcea9640 1 -- 172.21.15.17:0/3840829265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8030d30 con 0x7f75d80b3b40 2023-08-09T12:40:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.922+0000 7f75e010f640 1 -- 172.21.15.17:0/3840829265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 msgr2=0x7f75d80b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.922+0000 7f75e010f640 1 --2- 172.21.15.17:0/3840829265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d80b3fa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009860 tx=0x7f75c802b980 comp rx=0 tx=0).stop 2023-08-09T12:40:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.922+0000 7f75e010f640 1 -- 172.21.15.17:0/3840829265 shutdown_connections 2023-08-09T12:40:17.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.922+0000 7f75e010f640 1 --2- 172.21.15.17:0/3840829265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d80b3fa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.922+0000 7f75e010f640 1 --2- 172.21.15.17:0/3840829265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.922+0000 7f75e010f640 1 -- 172.21.15.17:0/3840829265 >> 172.21.15.17:0/3840829265 conn(0x7f75d80cb1b0 msgr2=0x7f75d80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:17.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.922+0000 7f75e010f640 1 -- 172.21.15.17:0/3840829265 shutdown_connections 2023-08-09T12:40:17.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.922+0000 7f75e010f640 1 -- 172.21.15.17:0/3840829265 wait complete. 2023-08-09T12:40:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.924+0000 7f75e010f640 1 Processor -- start 2023-08-09T12:40:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.924+0000 7f75e010f640 1 -- start start 2023-08-09T12:40:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.925+0000 7f75e010f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.925+0000 7f75e010f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.925+0000 7f75e010f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d815e8f0 0x7f75d806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.925+0000 7f75e010f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d815b8e0 con 0x7f75d80b3b40 2023-08-09T12:40:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.925+0000 7f75e010f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d806afe0 con 0x7f75d815e8f0 2023-08-09T12:40:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.925+0000 7f75e010f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d815c720 con 0x7f75d80adc40 2023-08-09T12:40:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.925+0000 7f75dd6aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75dd6aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51978/0 (socket says 172.21.15.17:51978) 2023-08-09T12:40:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75dd6aa640 1 -- 172.21.15.17:0/497346651 learned_addr learned my addr 172.21.15.17:0/497346651 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75ddeab640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75de6ac640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d815e8f0 0x7f75d806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75dd6aa640 1 -- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 msgr2=0x7f75d815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75dd6aa640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d815cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75dd6aa640 1 -- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d815e8f0 msgr2=0x7f75d806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75dd6aa640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d815e8f0 0x7f75d806aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75dd6aa640 1 -- 172.21.15.17:0/497346651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8009470 con 0x7f75d80b3b40 2023-08-09T12:40:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75ddeab640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.926+0000 7f75dd6aa640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d815b3a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009860 tx=0x7f75c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.927+0000 7f75ce7fc640 1 -- 172.21.15.17:0/497346651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8039c90 con 0x7f75d80b3b40 2023-08-09T12:40:17.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.927+0000 7f75ce7fc640 1 -- 172.21.15.17:0/497346651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8039df0 con 0x7f75d80b3b40 2023-08-09T12:40:17.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.927+0000 7f75ce7fc640 1 -- 172.21.15.17:0/497346651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8043620 con 0x7f75d80b3b40 2023-08-09T12:40:17.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.927+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d815bb10 con 0x7f75d80b3b40 2023-08-09T12:40:17.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.927+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d815c0d0 con 0x7f75d80b3b40 2023-08-09T12:40:17.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.928+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d80c5430 con 0x7f75d80b3b40 2023-08-09T12:40:17.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.929+0000 7f75ce7fc640 1 -- 172.21.15.17:0/497346651 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75c8043780 con 0x7f75d80b3b40 2023-08-09T12:40:17.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.930+0000 7f75ce7fc640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75bc06a050 0x7f75bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:17.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.930+0000 7f75ce7fc640 1 -- 172.21.15.17:0/497346651 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f75c803e070 con 0x7f75d80b3b40 2023-08-09T12:40:17.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.931+0000 7f75ddeab640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75bc06a050 0x7f75bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:17.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.932+0000 7f75ddeab640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75bc06a050 0x7f75bc06c510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75d4006fd0 tx=0x7f75d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:17.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:17.934+0000 7f75ce7fc640 1 -- 172.21.15.17:0/497346651 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f75c8076e00 con 0x7f75d80b3b40 2023-08-09T12:40:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.130+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75d8067a80 con 0x7f75d80b3b40 2023-08-09T12:40:18.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.131+0000 7f75ce7fc640 1 -- 172.21.15.17:0/497346651 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f75c807a420 con 0x7f75d80b3b40 2023-08-09T12:40:18.135 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75bc06a050 msgr2=0x7f75bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75bc06a050 0x7f75bc06c510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75d4006fd0 tx=0x7f75d4008040 comp rx=0 tx=0).stop 2023-08-09T12:40:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 msgr2=0x7f75d815b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d815b3a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009860 tx=0x7f75c8004730 comp rx=0 tx=0).stop 2023-08-09T12:40:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 shutdown_connections 2023-08-09T12:40:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75bc06a050 0x7f75bc06c510 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d815e8f0 0x7f75d806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d80b3b40 0x7f75d815b3a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 --2- 172.21.15.17:0/497346651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d80adc40 0x7f75d815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 >> 172.21.15.17:0/497346651 conn(0x7f75d80cb1b0 msgr2=0x7f75d80af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 shutdown_connections 2023-08-09T12:40:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.134+0000 7f75e010f640 1 -- 172.21.15.17:0/497346651 wait complete. 2023-08-09T12:40:18.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.386+0000 7f6ed1702640 1 Processor -- start 2023-08-09T12:40:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.386+0000 7f6ed1702640 1 -- start start 2023-08-09T12:40:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.388+0000 7f6ed1702640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc15cb40 0x7f6ecc1605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.388+0000 7f6ed1702640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6ecc0cfca0 0x7f6ecc06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.388+0000 7f6ed1702640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc06f010 con 0x7f6ecc06e670 2023-08-09T12:40:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.388+0000 7f6ed1702640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc15cf20 con 0x7f6ecc0cfca0 2023-08-09T12:40:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.388+0000 7f6ed1702640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc161510 con 0x7f6ecc15cb40 2023-08-09T12:40:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ed0f01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6ecc0cfca0 0x7f6ecc06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ed0f01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6ecc0cfca0 0x7f6ecc06ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51986/0 (socket says 172.21.15.17:51986) 2023-08-09T12:40:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ecb7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6ecc06e670 0x7f6ecc070cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39914/0 (socket says 172.21.15.17:39914) 2023-08-09T12:40:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ed0f01640 1 -- 172.21.15.17:0/3214332367 learned_addr learned my addr 172.21.15.17:0/3214332367 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ecbfff640 1 --2- 172.21.15.17:0/3214332367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc15cb40 0x7f6ecc1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ed0f01640 1 -- 172.21.15.17:0/3214332367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc15cb40 msgr2=0x7f6ecc1605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:18.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ed0f01640 1 --2- 172.21.15.17:0/3214332367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc15cb40 0x7f6ecc1605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ed0f01640 1 -- 172.21.15.17:0/3214332367 >> v1:172.21.15.17:6789/0 conn(0x7f6ecc06e670 legacy=0x7f6ecc070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.389+0000 7f6ed0f01640 1 -- 172.21.15.17:0/3214332367 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0ce800 con 0x7f6ecc0cfca0 2023-08-09T12:40:18.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.390+0000 7f6ed0f01640 1 --2- 172.21.15.17:0/3214332367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc0cfca0 0x7f6ecc06ead0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009870 tx=0x7f6ec402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0ecb6a0c5fb464 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.391+0000 7f6ecaffd640 1 -- 172.21.15.17:0/3214332367 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec40317c0 con 0x7f6ecc0cfca0 2023-08-09T12:40:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.391+0000 7f6ecaffd640 1 -- 172.21.15.17:0/3214332367 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec4031920 con 0x7f6ecc0cfca0 2023-08-09T12:40:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.391+0000 7f6ecaffd640 1 -- 172.21.15.17:0/3214332367 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4031cb0 con 0x7f6ecc0cfca0 2023-08-09T12:40:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.391+0000 7f6ed1702640 1 -- 172.21.15.17:0/3214332367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc0cfca0 msgr2=0x7f6ecc06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.391+0000 7f6ed1702640 1 --2- 172.21.15.17:0/3214332367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc0cfca0 0x7f6ecc06ead0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009870 tx=0x7f6ec402b860 comp rx=0 tx=0).stop 2023-08-09T12:40:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.391+0000 7f6ed1702640 1 -- 172.21.15.17:0/3214332367 shutdown_connections 2023-08-09T12:40:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.391+0000 7f6ed1702640 1 --2- 172.21.15.17:0/3214332367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc0cfca0 0x7f6ecc06ead0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.391+0000 7f6ed1702640 1 --2- 172.21.15.17:0/3214332367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc15cb40 0x7f6ecc1605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.392+0000 7f6ed1702640 1 -- 172.21.15.17:0/3214332367 >> 172.21.15.17:0/3214332367 conn(0x7f6ecc0d0790 msgr2=0x7f6ecc0d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.392+0000 7f6ed1702640 1 -- 172.21.15.17:0/3214332367 shutdown_connections 2023-08-09T12:40:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.392+0000 7f6ed1702640 1 -- 172.21.15.17:0/3214332367 wait complete. 2023-08-09T12:40:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.393+0000 7f6ed1702640 1 Processor -- start 2023-08-09T12:40:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.394+0000 7f6ed1702640 1 -- start start 2023-08-09T12:40:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.394+0000 7f6ed1702640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc06e670 0x7f6ecc1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.394+0000 7f6ed1702640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ecc0cfca0 0x7f6ecc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ed1702640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc15cb40 0x7f6ecc06b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ed1702640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc150f30 con 0x7f6ecc15cb40 2023-08-09T12:40:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ed1702640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c86b0 con 0x7f6ecc0cfca0 2023-08-09T12:40:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ed1702640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c8990 con 0x7f6ecc06e670 2023-08-09T12:40:18.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ed0f01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc15cb40 0x7f6ecc06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ed0f01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc15cb40 0x7f6ecc06b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51998/0 (socket says 172.21.15.17:51998) 2023-08-09T12:40:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ed0f01640 1 -- 172.21.15.17:0/2642444875 learned_addr learned my addr 172.21.15.17:0/2642444875 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ecbfff640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc06e670 0x7f6ecc1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.395+0000 7f6ecb7fe640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ecc0cfca0 0x7f6ecc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ed0f01640 1 -- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc06e670 msgr2=0x7f6ecc1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ed0f01640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc06e670 0x7f6ecc1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ed0f01640 1 -- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ecc0cfca0 msgr2=0x7f6ecc06b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ed0f01640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ecc0cfca0 0x7f6ecc06b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ed0f01640 1 -- 172.21.15.17:0/2642444875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec40094d0 con 0x7f6ecc15cb40 2023-08-09T12:40:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ed0f01640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc15cb40 0x7f6ecc06b960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40090b0 tx=0x7f6ec40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ec8ff9640 1 -- 172.21.15.17:0/2642444875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4032860 con 0x7f6ecc15cb40 2023-08-09T12:40:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ec8ff9640 1 -- 172.21.15.17:0/2642444875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec40329e0 con 0x7f6ecc15cb40 2023-08-09T12:40:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ec8ff9640 1 -- 172.21.15.17:0/2642444875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4032d90 con 0x7f6ecc15cb40 2023-08-09T12:40:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.396+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0c8c70 con 0x7f6ecc15cb40 2023-08-09T12:40:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.397+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc0c9230 con 0x7f6ecc15cb40 2023-08-09T12:40:18.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.398+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc0c9420 con 0x7f6ecc15cb40 2023-08-09T12:40:18.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.398+0000 7f6ec8ff9640 1 -- 172.21.15.17:0/2642444875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ec404e450 con 0x7f6ecc15cb40 2023-08-09T12:40:18.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.399+0000 7f6ec8ff9640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6eac06a080 0x7f6eac06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.400+0000 7f6ec8ff9640 1 -- 172.21.15.17:0/2642444875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6ec40aa6e0 con 0x7f6ecc15cb40 2023-08-09T12:40:18.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.400+0000 7f6ecbfff640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6eac06a080 0x7f6eac06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.401+0000 7f6ecbfff640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6eac06a080 0x7f6eac06c540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc003b80 tx=0x7f6ebc0098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:18.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.404+0000 7f6ec8ff9640 1 -- 172.21.15.17:0/2642444875 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6ec4075d00 con 0x7f6ecc15cb40 2023-08-09T12:40:18.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.598+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ecc04e390 con 0x7f6ecc15cb40 2023-08-09T12:40:18.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.599+0000 7f6ec8ff9640 1 -- 172.21.15.17:0/2642444875 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ec4079320 con 0x7f6ecc15cb40 2023-08-09T12:40:18.602 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.601+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6eac06a080 msgr2=0x7f6eac06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.601+0000 7f6ed1702640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6eac06a080 0x7f6eac06c540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc003b80 tx=0x7f6ebc0098d0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.601+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc15cb40 msgr2=0x7f6ecc06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.601+0000 7f6ed1702640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc15cb40 0x7f6ecc06b960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40090b0 tx=0x7f6ec40046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.602+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 shutdown_connections 2023-08-09T12:40:18.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.602+0000 7f6ed1702640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6eac06a080 0x7f6eac06c540 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.602+0000 7f6ed1702640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ecc15cb40 0x7f6ecc06b960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.602+0000 7f6ed1702640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ecc0cfca0 0x7f6ecc06b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.602+0000 7f6ed1702640 1 --2- 172.21.15.17:0/2642444875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ecc06e670 0x7f6ecc1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.602+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 >> 172.21.15.17:0/2642444875 conn(0x7f6ecc0d0790 msgr2=0x7f6ecc0b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.602+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 shutdown_connections 2023-08-09T12:40:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.602+0000 7f6ed1702640 1 -- 172.21.15.17:0/2642444875 wait complete. 2023-08-09T12:40:18.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.847+0000 7fac5907c640 1 Processor -- start 2023-08-09T12:40:18.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.847+0000 7fac5907c640 1 -- start start 2023-08-09T12:40:18.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.848+0000 7fac5907c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.848+0000 7fac5907c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac540b6000 0x7fac540cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.848+0000 7fac5907c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac540d29d0 0x7fac540d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.848+0000 7fac5907c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac540d33a0 con 0x7fac540b6000 2023-08-09T12:40:18.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.848+0000 7fac5907c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac540b6460 con 0x7fac540d29d0 2023-08-09T12:40:18.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.848+0000 7fac5907c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac540cda40 con 0x7fac5415ce90 2023-08-09T12:40:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.849+0000 7fac5259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac540b6000 0x7fac540cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.849+0000 7fac5259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac540b6000 0x7fac540cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52008/0 (socket says 172.21.15.17:52008) 2023-08-09T12:40:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.849+0000 7fac5259c640 1 -- 172.21.15.17:0/2820651655 learned_addr learned my addr 172.21.15.17:0/2820651655 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.849+0000 7fac52d9d640 1 --2- 172.21.15.17:0/2820651655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.849+0000 7fac5359e640 1 --2- 172.21.15.17:0/2820651655 >> v2:172.21.15.142:3300/0 conn(0x7fac540d29d0 0x7fac540d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.850+0000 7fac52d9d640 1 -- 172.21.15.17:0/2820651655 >> v2:172.21.15.142:3300/0 conn(0x7fac540d29d0 msgr2=0x7fac540d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:18.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.850+0000 7fac52d9d640 1 --2- 172.21.15.17:0/2820651655 >> v2:172.21.15.142:3300/0 conn(0x7fac540d29d0 0x7fac540d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.850+0000 7fac52d9d640 1 -- 172.21.15.17:0/2820651655 >> v2:172.21.15.17:3300/0 conn(0x7fac540b6000 msgr2=0x7fac540cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:18.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.850+0000 7fac52d9d640 1 --2- 172.21.15.17:0/2820651655 >> v2:172.21.15.17:3300/0 conn(0x7fac540b6000 0x7fac540cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.850+0000 7fac52d9d640 1 -- 172.21.15.17:0/2820651655 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540cdd10 con 0x7fac5415ce90 2023-08-09T12:40:18.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.850+0000 7fac5259c640 1 --2- 172.21.15.17:0/2820651655 >> v2:172.21.15.17:3300/0 conn(0x7fac540b6000 0x7fac540cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:40:18.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.852+0000 7fac52d9d640 1 --2- 172.21.15.17:0/2820651655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541616e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac540d0a70 tx=0x7fac4402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=210e1c65c69ccb0b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:18.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac51d9b640 1 -- 172.21.15.17:0/2820651655 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4402cbd0 con 0x7fac5415ce90 2023-08-09T12:40:18.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac51d9b640 1 -- 172.21.15.17:0/2820651655 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4402cd30 con 0x7fac5415ce90 2023-08-09T12:40:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac51d9b640 1 -- 172.21.15.17:0/2820651655 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4402cea0 con 0x7fac5415ce90 2023-08-09T12:40:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac5907c640 1 -- 172.21.15.17:0/2820651655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 msgr2=0x7fac541616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac5907c640 1 --2- 172.21.15.17:0/2820651655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541616e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac540d0a70 tx=0x7fac4402be20 comp rx=0 tx=0).stop 2023-08-09T12:40:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac5907c640 1 -- 172.21.15.17:0/2820651655 shutdown_connections 2023-08-09T12:40:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac5907c640 1 --2- 172.21.15.17:0/2820651655 >> v2:172.21.15.142:3300/0 conn(0x7fac540d29d0 0x7fac540d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac5907c640 1 --2- 172.21.15.17:0/2820651655 >> v2:172.21.15.17:3300/0 conn(0x7fac540b6000 0x7fac540cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac5907c640 1 --2- 172.21.15.17:0/2820651655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541616e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.853+0000 7fac5907c640 1 -- 172.21.15.17:0/2820651655 >> 172.21.15.17:0/2820651655 conn(0x7fac5406fde0 msgr2=0x7fac540701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:18.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.854+0000 7fac5907c640 1 -- 172.21.15.17:0/2820651655 shutdown_connections 2023-08-09T12:40:18.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.854+0000 7fac5907c640 1 -- 172.21.15.17:0/2820651655 wait complete. 2023-08-09T12:40:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.855+0000 7fac5907c640 1 Processor -- start 2023-08-09T12:40:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.856+0000 7fac5907c640 1 -- start start 2023-08-09T12:40:18.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5907c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540b6000 0x7fac540a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5907c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac540d29d0 0x7fac541e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5907c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541e6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5907c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac541e7900 con 0x7fac540d29d0 2023-08-09T12:40:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5907c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac541e6a50 con 0x7fac540b6000 2023-08-09T12:40:18.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5907c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac541e6c80 con 0x7fac5415ce90 2023-08-09T12:40:18.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac540d29d0 0x7fac541e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac540d29d0 0x7fac541e7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52018/0 (socket says 172.21.15.17:52018) 2023-08-09T12:40:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5259c640 1 -- 172.21.15.17:0/2290805319 learned_addr learned my addr 172.21.15.17:0/2290805319 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac52d9d640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540b6000 0x7fac540a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5359e640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5259c640 1 -- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 msgr2=0x7fac541e6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5259c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541e6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5259c640 1 -- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540b6000 msgr2=0x7fac540a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5259c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540b6000 0x7fac540a9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:18.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.857+0000 7fac5259c640 1 -- 172.21.15.17:0/2290805319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480094d0 con 0x7fac540d29d0 2023-08-09T12:40:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.858+0000 7fac5259c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac540d29d0 0x7fac541e7d20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac4800ea00 tx=0x7fac4800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.858+0000 7fac3b7fe640 1 -- 172.21.15.17:0/2290805319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800ca60 con 0x7fac540d29d0 2023-08-09T12:40:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.858+0000 7fac3b7fe640 1 -- 172.21.15.17:0/2290805319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4800cbc0 con 0x7fac540d29d0 2023-08-09T12:40:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.858+0000 7fac3b7fe640 1 -- 172.21.15.17:0/2290805319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48013470 con 0x7fac540d29d0 2023-08-09T12:40:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.858+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac44009a70 con 0x7fac540d29d0 2023-08-09T12:40:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.858+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac541e7240 con 0x7fac540d29d0 2023-08-09T12:40:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.859+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac540cebb0 con 0x7fac540d29d0 2023-08-09T12:40:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.861+0000 7fac3b7fe640 1 -- 172.21.15.17:0/2290805319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac480135d0 con 0x7fac540d29d0 2023-08-09T12:40:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.862+0000 7fac3b7fe640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4006a080 0x7fac4006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.862+0000 7fac3b7fe640 1 -- 172.21.15.17:0/2290805319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fac48088960 con 0x7fac540d29d0 2023-08-09T12:40:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.862+0000 7fac52d9d640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4006a080 0x7fac4006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.863+0000 7fac52d9d640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4006a080 0x7fac4006c540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac44036000 tx=0x7fac44030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:18.867+0000 7fac3b7fe640 1 -- 172.21.15.17:0/2290805319 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fac48053f70 con 0x7fac540d29d0 2023-08-09T12:40:19.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.066+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac54067a80 con 0x7fac540d29d0 2023-08-09T12:40:19.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.067+0000 7fac3b7fe640 1 -- 172.21.15.17:0/2290805319 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac48057590 con 0x7fac540d29d0 2023-08-09T12:40:19.070 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:19.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4006a080 msgr2=0x7fac4006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:19.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4006a080 0x7fac4006c540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac44036000 tx=0x7fac44030000 comp rx=0 tx=0).stop 2023-08-09T12:40:19.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac540d29d0 msgr2=0x7fac541e7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:19.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac540d29d0 0x7fac541e7d20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac4800ea00 tx=0x7fac4800eec0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 shutdown_connections 2023-08-09T12:40:19.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4006a080 0x7fac4006c540 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415ce90 0x7fac541e6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac540d29d0 0x7fac541e7d20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 --2- 172.21.15.17:0/2290805319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540b6000 0x7fac540a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 >> 172.21.15.17:0/2290805319 conn(0x7fac5406fde0 msgr2=0x7fac540d14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:19.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 shutdown_connections 2023-08-09T12:40:19.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.070+0000 7fac5907c640 1 -- 172.21.15.17:0/2290805319 wait complete. 2023-08-09T12:40:19.093 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:40:19.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.321+0000 7f78986da640 1 Processor -- start 2023-08-09T12:40:19.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.322+0000 7f78986da640 1 -- start start 2023-08-09T12:40:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.323+0000 7f78986da640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78900adc40 0x7f789006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.323+0000 7f78986da640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900b3b40 0x7f78900b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.323+0000 7f78986da640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78900b2250 con 0x7f789015e8f0 2023-08-09T12:40:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.323+0000 7f78986da640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900ae020 con 0x7f78900adc40 2023-08-09T12:40:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.323+0000 7f78986da640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b2530 con 0x7f78900b3b40 2023-08-09T12:40:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.324+0000 7f7896476640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78900adc40 0x7f789006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.324+0000 7f7896476640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78900adc40 0x7f789006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52024/0 (socket says 172.21.15.17:52024) 2023-08-09T12:40:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.324+0000 7f7896476640 1 -- 172.21.15.17:0/339155808 learned_addr learned my addr 172.21.15.17:0/339155808 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.324+0000 7f7895c75640 1 --2- 172.21.15.17:0/339155808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900b3b40 0x7f78900b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.324+0000 7f7896476640 1 -- 172.21.15.17:0/339155808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900b3b40 msgr2=0x7f78900b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.324+0000 7f7896476640 1 --2- 172.21.15.17:0/339155808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900b3b40 0x7f78900b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.324+0000 7f7896476640 1 -- 172.21.15.17:0/339155808 >> v1:172.21.15.142:6789/0 conn(0x7f789015e8f0 legacy=0x7f789015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.324+0000 7f7896476640 1 -- 172.21.15.17:0/339155808 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789006fe80 con 0x7f78900adc40 2023-08-09T12:40:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.326+0000 7f7896476640 1 --2- 172.21.15.17:0/339155808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78900adc40 0x7f789006c280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f788c009870 tx=0x7f788c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a589310e8dc550ae server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.326+0000 7f7895474640 1 -- 172.21.15.17:0/339155808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c030840 con 0x7f78900adc40 2023-08-09T12:40:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.326+0000 7f7895474640 1 -- 172.21.15.17:0/339155808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c0309a0 con 0x7f78900adc40 2023-08-09T12:40:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.326+0000 7f7895474640 1 -- 172.21.15.17:0/339155808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c030d30 con 0x7f78900adc40 2023-08-09T12:40:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.327+0000 7f78986da640 1 -- 172.21.15.17:0/339155808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78900adc40 msgr2=0x7f789006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.327+0000 7f78986da640 1 --2- 172.21.15.17:0/339155808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78900adc40 0x7f789006c280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f788c009870 tx=0x7f788c02b980 comp rx=0 tx=0).stop 2023-08-09T12:40:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.327+0000 7f78986da640 1 -- 172.21.15.17:0/339155808 shutdown_connections 2023-08-09T12:40:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.327+0000 7f78986da640 1 --2- 172.21.15.17:0/339155808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900b3b40 0x7f78900b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.327+0000 7f78986da640 1 --2- 172.21.15.17:0/339155808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78900adc40 0x7f789006c280 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.327+0000 7f78986da640 1 -- 172.21.15.17:0/339155808 >> 172.21.15.17:0/339155808 conn(0x7f78900cb1b0 msgr2=0x7f78900cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.327+0000 7f78986da640 1 -- 172.21.15.17:0/339155808 shutdown_connections 2023-08-09T12:40:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.327+0000 7f78986da640 1 -- 172.21.15.17:0/339155808 wait complete. 2023-08-09T12:40:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.328+0000 7f78986da640 1 Processor -- start 2023-08-09T12:40:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.329+0000 7f78986da640 1 -- start start 2023-08-09T12:40:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f78986da640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900adc40 0x7f78900c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f78986da640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78900b3b40 0x7f789006a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f78986da640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789015e8f0 0x7f789015c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f78986da640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c8330 con 0x7f789015e8f0 2023-08-09T12:40:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f78986da640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c7720 con 0x7f78900b3b40 2023-08-09T12:40:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f78986da640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c7a00 con 0x7f78900adc40 2023-08-09T12:40:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896c77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789015e8f0 0x7f789015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896c77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789015e8f0 0x7f789015c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52034/0 (socket says 172.21.15.17:52034) 2023-08-09T12:40:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896c77640 1 -- 172.21.15.17:0/1670117216 learned_addr learned my addr 172.21.15.17:0/1670117216 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896476640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900adc40 0x7f78900c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7895c75640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78900b3b40 0x7f789006a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896c77640 1 -- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900adc40 msgr2=0x7f78900c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896c77640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900adc40 0x7f78900c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896c77640 1 -- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78900b3b40 msgr2=0x7f789006a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896c77640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78900b3b40 0x7f789006a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7896c77640 1 -- 172.21.15.17:0/1670117216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0094d0 con 0x7f789015e8f0 2023-08-09T12:40:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.330+0000 7f7895c75640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78900b3b40 0x7f789006a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.331+0000 7f7896c77640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789015e8f0 0x7f789015c070 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f788800c6b0 tx=0x7f788800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.331+0000 7f7886ffd640 1 -- 172.21.15.17:0/1670117216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888003b70 con 0x7f789015e8f0 2023-08-09T12:40:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.331+0000 7f7886ffd640 1 -- 172.21.15.17:0/1670117216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888003cf0 con 0x7f789015e8f0 2023-08-09T12:40:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.331+0000 7f7886ffd640 1 -- 172.21.15.17:0/1670117216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888003ea0 con 0x7f789015e8f0 2023-08-09T12:40:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.331+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78900c7ce0 con 0x7f789015e8f0 2023-08-09T12:40:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.331+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789006ac70 con 0x7f789015e8f0 2023-08-09T12:40:19.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.332+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78900c84e0 con 0x7f789015e8f0 2023-08-09T12:40:19.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.333+0000 7f7886ffd640 1 -- 172.21.15.17:0/1670117216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7888005310 con 0x7f789015e8f0 2023-08-09T12:40:19.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.334+0000 7f7886ffd640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f787406a050 0x7f787406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.334+0000 7f7886ffd640 1 -- 172.21.15.17:0/1670117216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7888088400 con 0x7f789015e8f0 2023-08-09T12:40:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.335+0000 7f7896476640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f787406a050 0x7f787406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.336+0000 7f7896476640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f787406a050 0x7f787406c510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f788c036000 tx=0x7f788c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.339+0000 7f7886ffd640 1 -- 172.21.15.17:0/1670117216 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7888053a10 con 0x7f789015e8f0 2023-08-09T12:40:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.549+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7890067a80 con 0x7f789015e8f0 2023-08-09T12:40:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.550+0000 7f7886ffd640 1 -- 172.21.15.17:0/1670117216 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7888057030 con 0x7f789015e8f0 2023-08-09T12:40:19.554 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:40:19.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f787406a050 msgr2=0x7f787406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:19.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f787406a050 0x7f787406c510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f788c036000 tx=0x7f788c008030 comp rx=0 tx=0).stop 2023-08-09T12:40:19.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789015e8f0 msgr2=0x7f789015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:19.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789015e8f0 0x7f789015c070 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f788800c6b0 tx=0x7f788800cb70 comp rx=0 tx=0).stop 2023-08-09T12:40:19.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 shutdown_connections 2023-08-09T12:40:19.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f787406a050 0x7f787406c510 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789015e8f0 0x7f789015c070 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78900b3b40 0x7f789006a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 --2- 172.21.15.17:0/1670117216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78900adc40 0x7f78900c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 >> 172.21.15.17:0/1670117216 conn(0x7f78900cb1b0 msgr2=0x7f78900c2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 shutdown_connections 2023-08-09T12:40:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:19.553+0000 7f78986da640 1 -- 172.21.15.17:0/1670117216 wait complete. 2023-08-09T12:40:19.574 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-09T12:40:19.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:19.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-08-09T12:40:19.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:40:19.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:19.690 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-09T12:40:19.745 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:40:19.746 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:19.807 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:40:19.807 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:19.863 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:40:19.864 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:19.917 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.153+0000 7fed01a8c640 1 Processor -- start 2023-08-09T12:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.153+0000 7fed01a8c640 1 -- start start 2023-08-09T12:40:20.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.154+0000 7fed01a8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fecfc160030 0x7fecfc160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.154+0000 7fed01a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cfb50 0x7fecfc0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.154+0000 7fed01a8c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc0b5a30 con 0x7fecfc0b86e0 2023-08-09T12:40:20.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.155+0000 7fed01a8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc0d1110 con 0x7fecfc160030 2023-08-09T12:40:20.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.155+0000 7fed01a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0ceac0 con 0x7fecfc0cfb50 2023-08-09T12:40:20.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.155+0000 7fecfbfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fecfc0b86e0 0x7fecfc0cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39920/0 (socket says 172.21.15.17:39920) 2023-08-09T12:40:20.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.155+0000 7fecfbfff640 1 -- 172.21.15.17:0/3009678591 learned_addr learned my addr 172.21.15.17:0/3009678591 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.155+0000 7fed0128b640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cfb50 0x7fecfc0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.155+0000 7fed00a8a640 1 --2- 172.21.15.17:0/3009678591 >> v2:172.21.15.142:3300/0 conn(0x7fecfc160030 0x7fecfc160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.155+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855725053 0 0) 0x7fecfc0b5a30 con 0x7fecfc0b86e0 2023-08-09T12:40:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.155+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece8003520 con 0x7fecfc0b86e0 2023-08-09T12:40:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211718945 0 0) 0x7fece8003520 con 0x7fecfc0b86e0 2023-08-09T12:40:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cfb50 msgr2=0x7fecfc0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cfb50 0x7fecfc0d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 >> v2:172.21.15.142:3300/0 conn(0x7fecfc160030 msgr2=0x7fecfc160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 --2- 172.21.15.17:0/3009678591 >> v2:172.21.15.142:3300/0 conn(0x7fecfc160030 0x7fecfc160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0d0d70 con 0x7fecfc0b86e0 2023-08-09T12:40:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fece4001670 con 0x7fecfc0b86e0 2023-08-09T12:40:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fed00a8a640 1 --2- 172.21.15.17:0/3009678591 >> v2:172.21.15.142:3300/0 conn(0x7fecfc160030 0x7fecfc160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 >> v1:172.21.15.17:6789/0 conn(0x7fecfc0b86e0 legacy=0x7fecfc0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fece8003970 0x7fece8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cfb50 0x7fece80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fece8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0d1110 con 0x7fece8004d00 2023-08-09T12:40:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece800b980 con 0x7fece8003970 2023-08-09T12:40:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece800bb10 con 0x7fecfc0cfb50 2023-08-09T12:40:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.156+0000 7fed0128b640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fece8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.157+0000 7fed00a8a640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fece8003970 0x7fece8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.157+0000 7fecfbfff640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cfb50 0x7fece80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.157+0000 7fed0128b640 1 -- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cfb50 msgr2=0x7fece80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.157+0000 7fed0128b640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cfb50 0x7fece80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.157+0000 7fed0128b640 1 -- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fece8003970 msgr2=0x7fece8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.157+0000 7fed0128b640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fece8003970 0x7fece8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.157+0000 7fed0128b640 1 -- 172.21.15.17:0/3009678591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8003520 con 0x7fece8004d00 2023-08-09T12:40:20.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.158+0000 7fed0128b640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fece8005180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fecfc06a560 tx=0x7fece80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5708c8a4a737ce92 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:20.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.158+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf402c640 con 0x7fece8004d00 2023-08-09T12:40:20.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.158+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf402c7a0 con 0x7fece8004d00 2023-08-09T12:40:20.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.158+0000 7fecfb7fe640 1 -- 172.21.15.17:0/3009678591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf402cb30 con 0x7fece8004d00 2023-08-09T12:40:20.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.159+0000 7fed01a8c640 1 -- 172.21.15.17:0/3009678591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 msgr2=0x7fece8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.159+0000 7fed01a8c640 1 --2- 172.21.15.17:0/3009678591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fece8005180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fecfc06a560 tx=0x7fece80057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.159+0000 7fed0128b640 1 -- 172.21.15.17:0/3009678591 reap_dead start 2023-08-09T12:40:20.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.159+0000 7fed01a8c640 1 -- 172.21.15.17:0/3009678591 shutdown_connections 2023-08-09T12:40:20.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.159+0000 7fed01a8c640 1 -- 172.21.15.17:0/3009678591 >> 172.21.15.17:0/3009678591 conn(0x7fecfc0697c0 msgr2=0x7fecfc069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:20.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.159+0000 7fed01a8c640 1 -- 172.21.15.17:0/3009678591 shutdown_connections 2023-08-09T12:40:20.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.159+0000 7fed01a8c640 1 -- 172.21.15.17:0/3009678591 wait complete. 2023-08-09T12:40:20.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.161+0000 7fed01a8c640 1 Processor -- start 2023-08-09T12:40:20.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.161+0000 7fed01a8c640 1 -- start start 2023-08-09T12:40:20.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.162+0000 7fed01a8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fecfc0b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.162+0000 7fed01a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cab90 0x7fecfc14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.162+0000 7fed01a8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecfc0a93c0 0x7fecfc0a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.162+0000 7fed01a8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc14ebf0 con 0x7fece8004d00 2023-08-09T12:40:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.162+0000 7fed01a8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0a9d80 con 0x7fecfc0a93c0 2023-08-09T12:40:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.162+0000 7fed01a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0cb010 con 0x7fecfc0cab90 2023-08-09T12:40:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fed00a8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fecfc0b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fed00a8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fecfc0b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52052/0 (socket says 172.21.15.17:52052) 2023-08-09T12:40:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fed00a8a640 1 -- 172.21.15.17:0/2217090253 learned_addr learned my addr 172.21.15.17:0/2217090253 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fecfbfff640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cab90 0x7fecfc14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fed00a8a640 1 -- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cab90 msgr2=0x7fecfc14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fed00a8a640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cab90 0x7fecfc14e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fed00a8a640 1 -- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecfc0a93c0 msgr2=0x7fecfc0a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fed00a8a640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecfc0a93c0 0x7fecfc0a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fed00a8a640 1 -- 172.21.15.17:0/2217090253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0cb2c0 con 0x7fece8004d00 2023-08-09T12:40:20.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.163+0000 7fecfbfff640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cab90 0x7fecfc14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:20.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.164+0000 7fed00a8a640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fecfc0b1e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fecec0046b0 tx=0x7fecec007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:20.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.164+0000 7fecf97fa640 1 -- 172.21.15.17:0/2217090253 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec014610 con 0x7fece8004d00 2023-08-09T12:40:20.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.164+0000 7fecf97fa640 1 -- 172.21.15.17:0/2217090253 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec00f050 con 0x7fece8004d00 2023-08-09T12:40:20.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.164+0000 7fecf97fa640 1 -- 172.21.15.17:0/2217090253 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0149b0 con 0x7fece8004d00 2023-08-09T12:40:20.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.164+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc0cb5a0 con 0x7fece8004d00 2023-08-09T12:40:20.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.164+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc0cbb60 con 0x7fece8004d00 2023-08-09T12:40:20.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.165+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc04e390 con 0x7fece8004d00 2023-08-09T12:40:20.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.166+0000 7fecf97fa640 1 -- 172.21.15.17:0/2217090253 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fecec014b10 con 0x7fece8004d00 2023-08-09T12:40:20.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.167+0000 7fecf97fa640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecdc06a050 0x7fecdc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.167+0000 7fecf97fa640 1 -- 172.21.15.17:0/2217090253 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fecec088f40 con 0x7fece8004d00 2023-08-09T12:40:20.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.168+0000 7fecfbfff640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecdc06a050 0x7fecdc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.169+0000 7fecfbfff640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecdc06a050 0x7fecdc06c510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fece40017a0 tx=0x7fece4001c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:20.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.171+0000 7fecf97fa640 1 -- 172.21.15.17:0/2217090253 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fecec0545e0 con 0x7fece8004d00 2023-08-09T12:40:20.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.371+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecfc0d0640 con 0x7fece8004d00 2023-08-09T12:40:20.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.372+0000 7fecf97fa640 1 -- 172.21.15.17:0/2217090253 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fecec057c00 con 0x7fece8004d00 2023-08-09T12:40:20.376 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:20.376 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:09.763656+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:20.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecdc06a050 msgr2=0x7fecdc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecdc06a050 0x7fecdc06c510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fece40017a0 tx=0x7fece4001c70 comp rx=0 tx=0).stop 2023-08-09T12:40:20.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 msgr2=0x7fecfc0b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fecfc0b1e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fecec0046b0 tx=0x7fecec007700 comp rx=0 tx=0).stop 2023-08-09T12:40:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 shutdown_connections 2023-08-09T12:40:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecdc06a050 0x7fecdc06c510 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecfc0a93c0 0x7fecfc0a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecfc0cab90 0x7fecfc14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 --2- 172.21.15.17:0/2217090253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece8004d00 0x7fecfc0b1e90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 >> 172.21.15.17:0/2217090253 conn(0x7fecfc0697c0 msgr2=0x7fecfc0c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:20.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 shutdown_connections 2023-08-09T12:40:20.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.375+0000 7fed01a8c640 1 -- 172.21.15.17:0/2217090253 wait complete. 2023-08-09T12:40:20.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:20.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:20.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.621+0000 7f880344d640 1 Processor -- start 2023-08-09T12:40:20.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.621+0000 7f880344d640 1 -- start start 2023-08-09T12:40:20.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f880344d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f87fc070a90 0x7f87fc0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f880344d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc0ad810 0x7f87fc0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f880344d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc0b4630 con 0x7f87fc159d80 2023-08-09T12:40:20.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f880344d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87fc15a160 con 0x7f87fc070a90 2023-08-09T12:40:20.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f880344d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0b3ab0 con 0x7f87fc0ad810 2023-08-09T12:40:20.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f88009e8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f87fc070a90 0x7f87fc0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f88011e9640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f87fc159d80 0x7f87fc070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39922/0 (socket says 172.21.15.17:39922) 2023-08-09T12:40:20.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f88011e9640 1 -- 172.21.15.17:0/367690740 learned_addr learned my addr 172.21.15.17:0/367690740 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:20.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.623+0000 7f88019ea640 1 --2- 172.21.15.17:0/367690740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc0ad810 0x7f87fc0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.624+0000 7f88009e8640 1 -- 172.21.15.17:0/367690740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc0ad810 msgr2=0x7f87fc0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:20.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.624+0000 7f88009e8640 1 --2- 172.21.15.17:0/367690740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc0ad810 0x7f87fc0c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.624+0000 7f88009e8640 1 -- 172.21.15.17:0/367690740 >> v1:172.21.15.17:6789/0 conn(0x7f87fc159d80 legacy=0x7f87fc070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.624+0000 7f88009e8640 1 -- 172.21.15.17:0/367690740 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0b3d90 con 0x7f87fc070a90 2023-08-09T12:40:20.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.625+0000 7f88009e8640 1 --2- 172.21.15.17:0/367690740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0b34d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009790 tx=0x7f87ec02dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a5dd923655645a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:20.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.625+0000 7f87f3fff640 1 -- 172.21.15.17:0/367690740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec02f880 con 0x7f87fc070a90 2023-08-09T12:40:20.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.625+0000 7f87f3fff640 1 -- 172.21.15.17:0/367690740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec02f9e0 con 0x7f87fc070a90 2023-08-09T12:40:20.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.625+0000 7f87f3fff640 1 -- 172.21.15.17:0/367690740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec02fd70 con 0x7f87fc070a90 2023-08-09T12:40:20.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.626+0000 7f880344d640 1 -- 172.21.15.17:0/367690740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 msgr2=0x7f87fc0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.626+0000 7f880344d640 1 --2- 172.21.15.17:0/367690740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0b34d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009790 tx=0x7f87ec02dac0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.626+0000 7f880344d640 1 -- 172.21.15.17:0/367690740 shutdown_connections 2023-08-09T12:40:20.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.626+0000 7f880344d640 1 --2- 172.21.15.17:0/367690740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc0ad810 0x7f87fc0c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.626+0000 7f880344d640 1 --2- 172.21.15.17:0/367690740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0b34d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.626+0000 7f880344d640 1 -- 172.21.15.17:0/367690740 >> 172.21.15.17:0/367690740 conn(0x7f87fc0cb1b0 msgr2=0x7f87fc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.626+0000 7f880344d640 1 -- 172.21.15.17:0/367690740 shutdown_connections 2023-08-09T12:40:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.626+0000 7f880344d640 1 -- 172.21.15.17:0/367690740 wait complete. 2023-08-09T12:40:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.628+0000 7f880344d640 1 Processor -- start 2023-08-09T12:40:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.628+0000 7f880344d640 1 -- start start 2023-08-09T12:40:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.629+0000 7f880344d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.629+0000 7f880344d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc0ad810 0x7f87fc1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f880344d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc159d80 0x7f87fc06c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f880344d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc1f23f0 con 0x7f87fc070a90 2023-08-09T12:40:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f880344d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc06c720 con 0x7f87fc0ad810 2023-08-09T12:40:20.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f880344d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0c2260 con 0x7f87fc159d80 2023-08-09T12:40:20.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88011e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88011e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52082/0 (socket says 172.21.15.17:52082) 2023-08-09T12:40:20.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88011e9640 1 -- 172.21.15.17:0/618053484 learned_addr learned my addr 172.21.15.17:0/618053484 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88009e8640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc0ad810 0x7f87fc1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88011e9640 1 -- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc159d80 msgr2=0x7f87fc06c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88011e9640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc159d80 0x7f87fc06c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88011e9640 1 -- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc0ad810 msgr2=0x7f87fc1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88011e9640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc0ad810 0x7f87fc1537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.630+0000 7f88011e9640 1 -- 172.21.15.17:0/618053484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0093a0 con 0x7f87fc070a90 2023-08-09T12:40:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.631+0000 7f88011e9640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0ae190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f87f800c480 tx=0x7f87f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.631+0000 7f87f1ffb640 1 -- 172.21.15.17:0/618053484 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8005ce0 con 0x7f87fc070a90 2023-08-09T12:40:20.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.631+0000 7f87f1ffb640 1 -- 172.21.15.17:0/618053484 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8005e40 con 0x7f87fc070a90 2023-08-09T12:40:20.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.631+0000 7f87f1ffb640 1 -- 172.21.15.17:0/618053484 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80072f0 con 0x7f87fc070a90 2023-08-09T12:40:20.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.631+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc15a610 con 0x7f87fc070a90 2023-08-09T12:40:20.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.631+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc15abd0 con 0x7f87fc070a90 2023-08-09T12:40:20.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.633+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc067a80 con 0x7f87fc070a90 2023-08-09T12:40:20.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.633+0000 7f87f1ffb640 1 -- 172.21.15.17:0/618053484 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f87f8007450 con 0x7f87fc070a90 2023-08-09T12:40:20.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.634+0000 7f87f1ffb640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87e006a050 0x7f87e006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:20.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.635+0000 7f87f1ffb640 1 -- 172.21.15.17:0/618053484 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f87f8087a40 con 0x7f87fc070a90 2023-08-09T12:40:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.635+0000 7f88009e8640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87e006a050 0x7f87e006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.636+0000 7f88009e8640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87e006a050 0x7f87e006c510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87ec038000 tx=0x7f87ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.639+0000 7f87f1ffb640 1 -- 172.21.15.17:0/618053484 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f87f8053210 con 0x7f87fc070a90 2023-08-09T12:40:20.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.832+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87fc06d4a0 con 0x7f87fc070a90 2023-08-09T12:40:20.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.833+0000 7f87f1ffb640 1 -- 172.21.15.17:0/618053484 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87f80170a0 con 0x7f87fc070a90 2023-08-09T12:40:20.836 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:20.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87e006a050 msgr2=0x7f87e006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87e006a050 0x7f87e006c510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87ec038000 tx=0x7f87ec008030 comp rx=0 tx=0).stop 2023-08-09T12:40:20.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 msgr2=0x7f87fc0ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:20.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0ae190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f87f800c480 tx=0x7f87f800c940 comp rx=0 tx=0).stop 2023-08-09T12:40:20.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 shutdown_connections 2023-08-09T12:40:20.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87e006a050 0x7f87e006c510 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87fc159d80 0x7f87fc06c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc0ad810 0x7f87fc1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 --2- 172.21.15.17:0/618053484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87fc070a90 0x7f87fc0ae190 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:20.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.835+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 >> 172.21.15.17:0/618053484 conn(0x7f87fc0cb1b0 msgr2=0x7f87fc0cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:20.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.836+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 shutdown_connections 2023-08-09T12:40:20.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:20.836+0000 7f880344d640 1 -- 172.21.15.17:0/618053484 wait complete. 2023-08-09T12:40:20.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.070+0000 7f681e4e0640 1 Processor -- start 2023-08-09T12:40:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.070+0000 7f681e4e0640 1 -- start start 2023-08-09T12:40:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.071+0000 7f681e4e0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f681815cb40 0x7f68181609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.071+0000 7f681e4e0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f68180b8420 0x7f68180cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.071+0000 7f681e4e0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68180d0f00 con 0x7f681815cf20 2023-08-09T12:40:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.071+0000 7f681e4e0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68181611f0 con 0x7f68180b8420 2023-08-09T12:40:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.071+0000 7f681e4e0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68181614d0 con 0x7f681815cb40 2023-08-09T12:40:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681dcdf640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f681815cf20 0x7f68180697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39926/0 (socket says 172.21.15.17:39926) 2023-08-09T12:40:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681dcdf640 1 -- 172.21.15.17:0/300374459 learned_addr learned my addr 172.21.15.17:0/300374459 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681ccdd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f68180b8420 0x7f68180cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681d4de640 1 --2- 172.21.15.17:0/300374459 >> v2:172.21.15.142:3300/0 conn(0x7f681815cb40 0x7f68181609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681ccdd640 1 -- 172.21.15.17:0/300374459 >> v2:172.21.15.142:3300/0 conn(0x7f681815cb40 msgr2=0x7f68181609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681ccdd640 1 --2- 172.21.15.17:0/300374459 >> v2:172.21.15.142:3300/0 conn(0x7f681815cb40 0x7f68181609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681ccdd640 1 -- 172.21.15.17:0/300374459 >> v1:172.21.15.17:6789/0 conn(0x7f681815cf20 legacy=0x7f68180697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681ccdd640 1 -- 172.21.15.17:0/300374459 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68181617b0 con 0x7f68180b8420 2023-08-09T12:40:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f681d4de640 1 --2- 172.21.15.17:0/300374459 >> v2:172.21.15.142:3300/0 conn(0x7f681815cb40 0x7f68181609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.072+0000 7f680ffff640 1 -- 172.21.15.17:0/300374459 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862589237 0 0) 0x7f68180d0f00 con 0x7f681815cf20 2023-08-09T12:40:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.074+0000 7f681ccdd640 1 --2- 172.21.15.17:0/300374459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cd860 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f68180713f0 tx=0x7f680802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ead8f362e9e78 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.074+0000 7f680ffff640 1 -- 172.21.15.17:0/300374459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808030610 con 0x7f68180b8420 2023-08-09T12:40:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.074+0000 7f680ffff640 1 -- 172.21.15.17:0/300374459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808030770 con 0x7f68180b8420 2023-08-09T12:40:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.074+0000 7f680ffff640 1 -- 172.21.15.17:0/300374459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808030b00 con 0x7f68180b8420 2023-08-09T12:40:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.074+0000 7f681e4e0640 1 -- 172.21.15.17:0/300374459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 msgr2=0x7f68180cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.074+0000 7f681e4e0640 1 --2- 172.21.15.17:0/300374459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cd860 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f68180713f0 tx=0x7f680802b960 comp rx=0 tx=0).stop 2023-08-09T12:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.075+0000 7f681e4e0640 1 -- 172.21.15.17:0/300374459 shutdown_connections 2023-08-09T12:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.075+0000 7f681e4e0640 1 --2- 172.21.15.17:0/300374459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cd860 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.075+0000 7f681e4e0640 1 --2- 172.21.15.17:0/300374459 >> v2:172.21.15.142:3300/0 conn(0x7f681815cb40 0x7f68181609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.075+0000 7f681e4e0640 1 -- 172.21.15.17:0/300374459 >> 172.21.15.17:0/300374459 conn(0x7f68180d2ab0 msgr2=0x7f68180d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.075+0000 7f681e4e0640 1 -- 172.21.15.17:0/300374459 shutdown_connections 2023-08-09T12:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.075+0000 7f681e4e0640 1 -- 172.21.15.17:0/300374459 wait complete. 2023-08-09T12:40:21.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.076+0000 7f681e4e0640 1 Processor -- start 2023-08-09T12:40:21.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.077+0000 7f681e4e0640 1 -- start start 2023-08-09T12:40:21.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681e4e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681e4e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f681815cb40 0x7f68180c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681e4e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f681815cf20 0x7f6818153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681e4e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180c8700 con 0x7f68180b8420 2023-08-09T12:40:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681e4e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180cb980 con 0x7f681815cf20 2023-08-09T12:40:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681e4e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68180cbc60 con 0x7f681815cb40 2023-08-09T12:40:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681d4de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681d4de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52094/0 (socket says 172.21.15.17:52094) 2023-08-09T12:40:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681d4de640 1 -- 172.21.15.17:0/249641711 learned_addr learned my addr 172.21.15.17:0/249641711 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681dcdf640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f681815cf20 0x7f6818153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.078+0000 7f681ccdd640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f681815cb40 0x7f68180c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681d4de640 1 -- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f681815cb40 msgr2=0x7f68180c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681d4de640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f681815cb40 0x7f68180c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681d4de640 1 -- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f681815cf20 msgr2=0x7f6818153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681d4de640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f681815cf20 0x7f6818153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681d4de640 1 -- 172.21.15.17:0/249641711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808009400 con 0x7f68180b8420 2023-08-09T12:40:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681ccdd640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f681815cb40 0x7f68180c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681d4de640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cb2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f681400e7e0 tx=0x7f681400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f680dffb640 1 -- 172.21.15.17:0/249641711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814004030 con 0x7f68180b8420 2023-08-09T12:40:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f680dffb640 1 -- 172.21.15.17:0/249641711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6814004190 con 0x7f68180b8420 2023-08-09T12:40:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f680dffb640 1 -- 172.21.15.17:0/249641711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814004520 con 0x7f68180b8420 2023-08-09T12:40:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68180cbf40 con 0x7f68180b8420 2023-08-09T12:40:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.079+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68180cc590 con 0x7f68180b8420 2023-08-09T12:40:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.081+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681804e390 con 0x7f68180b8420 2023-08-09T12:40:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.082+0000 7f680dffb640 1 -- 172.21.15.17:0/249641711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f681400c6d0 con 0x7f68180b8420 2023-08-09T12:40:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.084+0000 7f680dffb640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67fc06a050 0x7f67fc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.084+0000 7f680dffb640 1 -- 172.21.15.17:0/249641711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6814088400 con 0x7f68180b8420 2023-08-09T12:40:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.084+0000 7f681ccdd640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67fc06a050 0x7f67fc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.086+0000 7f681ccdd640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67fc06a050 0x7f67fc06c510 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6808036000 tx=0x7f680803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:21.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.089+0000 7f680dffb640 1 -- 172.21.15.17:0/249641711 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6814053a10 con 0x7f68180b8420 2023-08-09T12:40:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.284+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f681815e280 con 0x7f68180b8420 2023-08-09T12:40:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.285+0000 7f680dffb640 1 -- 172.21.15.17:0/249641711 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6814057030 con 0x7f68180b8420 2023-08-09T12:40:21.289 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67fc06a050 msgr2=0x7f67fc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67fc06a050 0x7f67fc06c510 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6808036000 tx=0x7f680803b040 comp rx=0 tx=0).stop 2023-08-09T12:40:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 msgr2=0x7f68180cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cb2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f681400e7e0 tx=0x7f681400eca0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 shutdown_connections 2023-08-09T12:40:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67fc06a050 0x7f67fc06c510 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f681815cf20 0x7f6818153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f681815cb40 0x7f68180c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 --2- 172.21.15.17:0/249641711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68180b8420 0x7f68180cb2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.288+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 >> 172.21.15.17:0/249641711 conn(0x7f68180d2ab0 msgr2=0x7f6818154220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.289+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 shutdown_connections 2023-08-09T12:40:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.289+0000 7f681e4e0640 1 -- 172.21.15.17:0/249641711 wait complete. 2023-08-09T12:40:21.309 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.534+0000 7f2397fff640 1 Processor -- start 2023-08-09T12:40:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.534+0000 7f2397fff640 1 -- start start 2023-08-09T12:40:21.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.535+0000 7f2397fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23980cd270 0x7f239806a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.535+0000 7f2397fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 0x7f23980d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.535+0000 7f2397fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239806b170 con 0x7f23980b1d90 2023-08-09T12:40:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.535+0000 7f2397fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239806a8d0 con 0x7f23980cd270 2023-08-09T12:40:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.535+0000 7f2397fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239806abb0 con 0x7f23980d0ca0 2023-08-09T12:40:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.536+0000 7f23977fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 0x7f23980d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.536+0000 7f2396ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23980cd270 0x7f239806a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.536+0000 7f238e7fc640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f23980b1d90 0x7f23980cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:48410/0 (socket says 172.21.15.17:48410) 2023-08-09T12:40:21.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.536+0000 7f238e7fc640 1 -- 172.21.15.17:0/3898233815 learned_addr learned my addr 172.21.15.17:0/3898233815 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:21.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.537+0000 7f2396ffd640 1 -- 172.21.15.17:0/3898233815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 msgr2=0x7f23980d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:21.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.537+0000 7f2396ffd640 1 --2- 172.21.15.17:0/3898233815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 0x7f23980d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.537+0000 7f2396ffd640 1 -- 172.21.15.17:0/3898233815 >> v1:172.21.15.142:6789/0 conn(0x7f23980b1d90 legacy=0x7f23980cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.537+0000 7f2396ffd640 1 -- 172.21.15.17:0/3898233815 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239806ae90 con 0x7f23980cd270 2023-08-09T12:40:21.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.538+0000 7f2396ffd640 1 --2- 172.21.15.17:0/3898233815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 0x7f239806a1d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23880097a0 tx=0x7f238802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef77d4578a82b60 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:21.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.539+0000 7f23967fc640 1 -- 172.21.15.17:0/3898233815 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388031780 con 0x7f23980cd270 2023-08-09T12:40:21.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.539+0000 7f23967fc640 1 -- 172.21.15.17:0/3898233815 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23880318e0 con 0x7f23980cd270 2023-08-09T12:40:21.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.539+0000 7f23967fc640 1 -- 172.21.15.17:0/3898233815 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388031c70 con 0x7f23980cd270 2023-08-09T12:40:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.540+0000 7f2397fff640 1 -- 172.21.15.17:0/3898233815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 msgr2=0x7f239806a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.540+0000 7f2397fff640 1 --2- 172.21.15.17:0/3898233815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 0x7f239806a1d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23880097a0 tx=0x7f238802b820 comp rx=0 tx=0).stop 2023-08-09T12:40:21.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.540+0000 7f2397fff640 1 -- 172.21.15.17:0/3898233815 shutdown_connections 2023-08-09T12:40:21.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.540+0000 7f2397fff640 1 --2- 172.21.15.17:0/3898233815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 0x7f23980d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.540+0000 7f2397fff640 1 --2- 172.21.15.17:0/3898233815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 0x7f239806a1d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.540+0000 7f2397fff640 1 -- 172.21.15.17:0/3898233815 >> 172.21.15.17:0/3898233815 conn(0x7f23980d2a10 msgr2=0x7f23980d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:21.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.540+0000 7f2397fff640 1 -- 172.21.15.17:0/3898233815 shutdown_connections 2023-08-09T12:40:21.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.540+0000 7f2397fff640 1 -- 172.21.15.17:0/3898233815 wait complete. 2023-08-09T12:40:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.543+0000 7f2397fff640 1 Processor -- start 2023-08-09T12:40:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.543+0000 7f2397fff640 1 -- start start 2023-08-09T12:40:21.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.544+0000 7f2397fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980b1d90 0x7f23980aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.544+0000 7f2397fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 0x7f239815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.544+0000 7f2397fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 0x7f23980ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.544+0000 7f2397fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23980ccac0 con 0x7f23980b1d90 2023-08-09T12:40:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.544+0000 7f2397fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23980aaab0 con 0x7f23980cd270 2023-08-09T12:40:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.544+0000 7f2397fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23980aad90 con 0x7f23980d0ca0 2023-08-09T12:40:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f2396ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980b1d90 0x7f23980aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f2396ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980b1d90 0x7f23980aa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52098/0 (socket says 172.21.15.17:52098) 2023-08-09T12:40:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f2396ffd640 1 -- 172.21.15.17:0/1090562181 learned_addr learned my addr 172.21.15.17:0/1090562181 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f238e7fc640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 0x7f239815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f23977fe640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 0x7f23980ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f2396ffd640 1 -- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 msgr2=0x7f23980ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f2396ffd640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 0x7f23980ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f2396ffd640 1 -- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 msgr2=0x7f239815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f2396ffd640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 0x7f239815a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.545+0000 7f2396ffd640 1 -- 172.21.15.17:0/1090562181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388009400 con 0x7f23980b1d90 2023-08-09T12:40:21.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.546+0000 7f2396ffd640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980b1d90 0x7f23980aa0e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2388034040 tx=0x7f23880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:21.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.546+0000 7f2394ff9640 1 -- 172.21.15.17:0/1090562181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388032820 con 0x7f23980b1d90 2023-08-09T12:40:21.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.546+0000 7f2394ff9640 1 -- 172.21.15.17:0/1090562181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388032980 con 0x7f23980b1d90 2023-08-09T12:40:21.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.546+0000 7f2394ff9640 1 -- 172.21.15.17:0/1090562181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388032d30 con 0x7f23980b1d90 2023-08-09T12:40:21.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.546+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23980ab070 con 0x7f23980b1d90 2023-08-09T12:40:21.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.546+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23980aa620 con 0x7f23980b1d90 2023-08-09T12:40:21.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.547+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239804e390 con 0x7f23980b1d90 2023-08-09T12:40:21.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.548+0000 7f2394ff9640 1 -- 172.21.15.17:0/1090562181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f238804e440 con 0x7f23980b1d90 2023-08-09T12:40:21.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.549+0000 7f2394ff9640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f237806a050 0x7f237806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:21.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.549+0000 7f2394ff9640 1 -- 172.21.15.17:0/1090562181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f23880aa750 con 0x7f23980b1d90 2023-08-09T12:40:21.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.550+0000 7f238e7fc640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f237806a050 0x7f237806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:21.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.551+0000 7f238e7fc640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f237806a050 0x7f237806c510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f23980b0e30 tx=0x7f2380009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:21.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.553+0000 7f2394ff9640 1 -- 172.21.15.17:0/1090562181 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2388075d60 con 0x7f23980b1d90 2023-08-09T12:40:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.752+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f239808b980 con 0x7f23980b1d90 2023-08-09T12:40:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.753+0000 7f2394ff9640 1 -- 172.21.15.17:0/1090562181 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23880a8e60 con 0x7f23980b1d90 2023-08-09T12:40:21.757 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f237806a050 msgr2=0x7f237806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f237806a050 0x7f237806c510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f23980b0e30 tx=0x7f2380009040 comp rx=0 tx=0).stop 2023-08-09T12:40:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980b1d90 msgr2=0x7f23980aa0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980b1d90 0x7f23980aa0e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2388034040 tx=0x7f23880046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 shutdown_connections 2023-08-09T12:40:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f237806a050 0x7f237806c510 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23980d0ca0 0x7f23980ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23980cd270 0x7f239815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 --2- 172.21.15.17:0/1090562181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980b1d90 0x7f23980aa0e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.756+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 >> 172.21.15.17:0/1090562181 conn(0x7f23980d2a10 msgr2=0x7f23980b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.757+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 shutdown_connections 2023-08-09T12:40:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:21.757+0000 7f2397fff640 1 -- 172.21.15.17:0/1090562181 wait complete. 2023-08-09T12:40:21.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:22.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.005+0000 7f0f18dbe640 1 Processor -- start 2023-08-09T12:40:22.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.005+0000 7f0f18dbe640 1 -- start start 2023-08-09T12:40:22.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.007+0000 7f0f18dbe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f140adc40 0x7f0f1406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.007+0000 7f0f18dbe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140cc630 0x7f0f140ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.007+0000 7f0f18dbe640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f140b2250 con 0x7f0f140b3b40 2023-08-09T12:40:22.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.007+0000 7f0f18dbe640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f140ae020 con 0x7f0f140adc40 2023-08-09T12:40:22.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.007+0000 7f0f18dbe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140b2530 con 0x7f0f140cc630 2023-08-09T12:40:22.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.007+0000 7f0f1259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f140adc40 0x7f0f1406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.007+0000 7f0f1259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f140adc40 0x7f0f1406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52110/0 (socket says 172.21.15.17:52110) 2023-08-09T12:40:22.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.007+0000 7f0f1259c640 1 -- 172.21.15.17:0/816030261 learned_addr learned my addr 172.21.15.17:0/816030261 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:22.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.008+0000 7f0f12d9d640 1 --2- 172.21.15.17:0/816030261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140cc630 0x7f0f140ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.008+0000 7f0f1259c640 1 -- 172.21.15.17:0/816030261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140cc630 msgr2=0x7f0f140ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:22.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.008+0000 7f0f1259c640 1 --2- 172.21.15.17:0/816030261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140cc630 0x7f0f140ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.008+0000 7f0f1259c640 1 -- 172.21.15.17:0/816030261 >> v1:172.21.15.142:6789/0 conn(0x7f0f140b3b40 legacy=0x7f0f140b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:22.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.008+0000 7f0f1259c640 1 -- 172.21.15.17:0/816030261 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1406fe80 con 0x7f0f140adc40 2023-08-09T12:40:22.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.009+0000 7f0f1259c640 1 --2- 172.21.15.17:0/816030261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009870 tx=0x7f0f0402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c43cffa1f0b648 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:22.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.009+0000 7f0f1159a640 1 -- 172.21.15.17:0/816030261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f040317c0 con 0x7f0f140adc40 2023-08-09T12:40:22.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.009+0000 7f0f1159a640 1 -- 172.21.15.17:0/816030261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f04031920 con 0x7f0f140adc40 2023-08-09T12:40:22.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.009+0000 7f0f1159a640 1 -- 172.21.15.17:0/816030261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04031cb0 con 0x7f0f140adc40 2023-08-09T12:40:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.010+0000 7f0f18dbe640 1 -- 172.21.15.17:0/816030261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 msgr2=0x7f0f1406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.010+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/816030261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009870 tx=0x7f0f0402b860 comp rx=0 tx=0).stop 2023-08-09T12:40:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.010+0000 7f0f18dbe640 1 -- 172.21.15.17:0/816030261 shutdown_connections 2023-08-09T12:40:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.010+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/816030261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140cc630 0x7f0f140ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.010+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/816030261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c280 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.010+0000 7f0f18dbe640 1 -- 172.21.15.17:0/816030261 >> 172.21.15.17:0/816030261 conn(0x7f0f140cb1b0 msgr2=0x7f0f140cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.010+0000 7f0f18dbe640 1 -- 172.21.15.17:0/816030261 shutdown_connections 2023-08-09T12:40:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.010+0000 7f0f18dbe640 1 -- 172.21.15.17:0/816030261 wait complete. 2023-08-09T12:40:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.012+0000 7f0f18dbe640 1 Processor -- start 2023-08-09T12:40:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.012+0000 7f0f18dbe640 1 -- start start 2023-08-09T12:40:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.013+0000 7f0f18dbe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.013+0000 7f0f18dbe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140b3b40 0x7f0f141ee760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.013+0000 7f0f18dbe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f140cc630 0x7f0f14146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.013+0000 7f0f18dbe640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141562c0 con 0x7f0f140adc40 2023-08-09T12:40:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.013+0000 7f0f18dbe640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141565a0 con 0x7f0f140cc630 2023-08-09T12:40:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.013+0000 7f0f18dbe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14156880 con 0x7f0f140b3b40 2023-08-09T12:40:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.013+0000 7f0f1259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f1259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52114/0 (socket says 172.21.15.17:52114) 2023-08-09T12:40:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f1259c640 1 -- 172.21.15.17:0/3662163026 learned_addr learned my addr 172.21.15.17:0/3662163026 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f12d9d640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f140cc630 0x7f0f14146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f11d9b640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140b3b40 0x7f0f141ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f1259c640 1 -- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140b3b40 msgr2=0x7f0f141ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f1259c640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140b3b40 0x7f0f141ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f1259c640 1 -- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f140cc630 msgr2=0x7f0f14146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f1259c640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f140cc630 0x7f0f14146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f1259c640 1 -- 172.21.15.17:0/3662163026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040094d0 con 0x7f0f140adc40 2023-08-09T12:40:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.014+0000 7f0f11d9b640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140b3b40 0x7f0f141ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.015+0000 7f0f1259c640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c2a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f0402b8a0 tx=0x7f0f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.015+0000 7f0f02ffd640 1 -- 172.21.15.17:0/3662163026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f040329a0 con 0x7f0f140adc40 2023-08-09T12:40:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.015+0000 7f0f02ffd640 1 -- 172.21.15.17:0/3662163026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f04032b40 con 0x7f0f140adc40 2023-08-09T12:40:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.015+0000 7f0f02ffd640 1 -- 172.21.15.17:0/3662163026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f040453f0 con 0x7f0f140adc40 2023-08-09T12:40:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.015+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f14156b60 con 0x7f0f140adc40 2023-08-09T12:40:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.015+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f14152450 con 0x7f0f140adc40 2023-08-09T12:40:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.016+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f14067a80 con 0x7f0f140adc40 2023-08-09T12:40:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.017+0000 7f0f02ffd640 1 -- 172.21.15.17:0/3662163026 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f0404e450 con 0x7f0f140adc40 2023-08-09T12:40:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.018+0000 7f0f02ffd640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.018+0000 7f0f02ffd640 1 -- 172.21.15.17:0/3662163026 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0f040aaa10 con 0x7f0f140adc40 2023-08-09T12:40:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.019+0000 7f0f11d9b640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.020+0000 7f0f11d9b640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0f14155c10 tx=0x7f0f08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.023+0000 7f0f02ffd640 1 -- 172.21.15.17:0/3662163026 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0f04076020 con 0x7f0f140adc40 2023-08-09T12:40:22.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.216+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f1406f7b0 con 0x7f0f140adc40 2023-08-09T12:40:22.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.217+0000 7f0f02ffd640 1 -- 172.21.15.17:0/3662163026 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f04079640 con 0x7f0f140adc40 2023-08-09T12:40:22.220 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 msgr2=0x7f0ef406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0f14155c10 tx=0x7f0f08009040 comp rx=0 tx=0).stop 2023-08-09T12:40:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 msgr2=0x7f0f1406c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c2a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f0402b8a0 tx=0x7f0f040046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 shutdown_connections 2023-08-09T12:40:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f140cc630 0x7f0f14146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f140b3b40 0x7f0f141ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 --2- 172.21.15.17:0/3662163026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f140adc40 0x7f0f1406c2a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 >> 172.21.15.17:0/3662163026 conn(0x7f0f140cb1b0 msgr2=0x7f0f1415d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 shutdown_connections 2023-08-09T12:40:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.220+0000 7f0f18dbe640 1 -- 172.21.15.17:0/3662163026 wait complete. 2023-08-09T12:40:22.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:40:22.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.474+0000 7f8f9608a640 1 Processor -- start 2023-08-09T12:40:22.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.474+0000 7f8f9608a640 1 -- start start 2023-08-09T12:40:22.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f9608a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8f90159bd0 0x7f8f900ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f9608a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f900697c0 0x7f8f90069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f9608a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9006fe10 con 0x7f8f900b3fe0 2023-08-09T12:40:22.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f9608a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f900b11a0 con 0x7f8f90159bd0 2023-08-09T12:40:22.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f9608a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9006a190 con 0x7f8f900697c0 2023-08-09T12:40:22.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f95088640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8f90159bd0 0x7f8f900ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f95088640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8f90159bd0 0x7f8f900ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52126/0 (socket says 172.21.15.17:52126) 2023-08-09T12:40:22.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f95088640 1 -- 172.21.15.17:0/1221625547 learned_addr learned my addr 172.21.15.17:0/1221625547 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:22.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.476+0000 7f8f95889640 1 --2- 172.21.15.17:0/1221625547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f900697c0 0x7f8f90069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.477+0000 7f8f95088640 1 -- 172.21.15.17:0/1221625547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f900697c0 msgr2=0x7f8f90069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:22.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.477+0000 7f8f95088640 1 --2- 172.21.15.17:0/1221625547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f900697c0 0x7f8f90069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.477+0000 7f8f95088640 1 -- 172.21.15.17:0/1221625547 >> v1:172.21.15.142:6789/0 conn(0x7f8f900b3fe0 legacy=0x7f8f90070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.477+0000 7f8f95088640 1 -- 172.21.15.17:0/1221625547 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90159fb0 con 0x7f8f90159bd0 2023-08-09T12:40:22.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.478+0000 7f8f95088640 1 --2- 172.21.15.17:0/1221625547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f90159bd0 0x7f8f900ca730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009870 tx=0x7f8f8c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4251ee8f190ab8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:22.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.478+0000 7f8f87fff640 1 -- 172.21.15.17:0/1221625547 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c031640 con 0x7f8f90159bd0 2023-08-09T12:40:22.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.478+0000 7f8f87fff640 1 -- 172.21.15.17:0/1221625547 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c0317a0 con 0x7f8f90159bd0 2023-08-09T12:40:22.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.478+0000 7f8f87fff640 1 -- 172.21.15.17:0/1221625547 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c031b30 con 0x7f8f90159bd0 2023-08-09T12:40:22.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.479+0000 7f8f9608a640 1 -- 172.21.15.17:0/1221625547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f90159bd0 msgr2=0x7f8f900ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.479+0000 7f8f9608a640 1 --2- 172.21.15.17:0/1221625547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f90159bd0 0x7f8f900ca730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009870 tx=0x7f8f8c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.479+0000 7f8f9608a640 1 -- 172.21.15.17:0/1221625547 shutdown_connections 2023-08-09T12:40:22.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.479+0000 7f8f9608a640 1 --2- 172.21.15.17:0/1221625547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f900697c0 0x7f8f90069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.479+0000 7f8f9608a640 1 --2- 172.21.15.17:0/1221625547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f90159bd0 0x7f8f900ca730 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.479+0000 7f8f9608a640 1 -- 172.21.15.17:0/1221625547 >> 172.21.15.17:0/1221625547 conn(0x7f8f900b1d50 msgr2=0x7f8f9006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:22.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.479+0000 7f8f9608a640 1 -- 172.21.15.17:0/1221625547 shutdown_connections 2023-08-09T12:40:22.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.479+0000 7f8f9608a640 1 -- 172.21.15.17:0/1221625547 wait complete. 2023-08-09T12:40:22.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.481+0000 7f8f9608a640 1 Processor -- start 2023-08-09T12:40:22.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.481+0000 7f8f9608a640 1 -- start start 2023-08-09T12:40:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f9608a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f900697c0 0x7f8f90150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f9608a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f900b3fe0 0x7f8f900c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f9608a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f90159bd0 0x7f8f900c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f9608a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c4940 con 0x7f8f900b3fe0 2023-08-09T12:40:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f9608a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c2200 con 0x7f8f900697c0 2023-08-09T12:40:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f9608a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c24e0 con 0x7f8f90159bd0 2023-08-09T12:40:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f94887640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f900b3fe0 0x7f8f900c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f94887640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f900b3fe0 0x7f8f900c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52132/0 (socket says 172.21.15.17:52132) 2023-08-09T12:40:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.482+0000 7f8f94887640 1 -- 172.21.15.17:0/2357828446 learned_addr learned my addr 172.21.15.17:0/2357828446 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f95088640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f900697c0 0x7f8f90150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f95889640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f90159bd0 0x7f8f900c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f94887640 1 -- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f90159bd0 msgr2=0x7f8f900c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f94887640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f90159bd0 0x7f8f900c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f94887640 1 -- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f900697c0 msgr2=0x7f8f90150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f94887640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f900697c0 0x7f8f90150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f94887640 1 -- 172.21.15.17:0/2357828446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c0094d0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f95889640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f90159bd0 0x7f8f900c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f94887640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f900b3fe0 0x7f8f900c3ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c450 tx=0x7f8f8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.483+0000 7f8f85ffb640 1 -- 172.21.15.17:0/2357828446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800052d0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.484+0000 7f8f85ffb640 1 -- 172.21.15.17:0/2357828446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80005430 con 0x7f8f900b3fe0 2023-08-09T12:40:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.484+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f900c27c0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.484+0000 7f8f85ffb640 1 -- 172.21.15.17:0/2357828446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80012870 con 0x7f8f900b3fe0 2023-08-09T12:40:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.484+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f90156ba0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.485+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f900c2ce0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.486+0000 7f8f85ffb640 1 -- 172.21.15.17:0/2357828446 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8f800129d0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.487+0000 7f8f85ffb640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8f7406a050 0x7f8f7406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.487+0000 7f8f85ffb640 1 -- 172.21.15.17:0/2357828446 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8f80088120 con 0x7f8f900b3fe0 2023-08-09T12:40:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.488+0000 7f8f95088640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8f7406a050 0x7f8f7406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.489+0000 7f8f95088640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8f7406a050 0x7f8f7406c510 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c036000 tx=0x7f8f8c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.492+0000 7f8f85ffb640 1 -- 172.21.15.17:0/2357828446 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8f900c2ce0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.700+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f900c2ce0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.701+0000 7f8f85ffb640 1 -- 172.21.15.17:0/2357828446 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f900c2ce0 con 0x7f8f900b3fe0 2023-08-09T12:40:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:40:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8f7406a050 msgr2=0x7f8f7406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8f7406a050 0x7f8f7406c510 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c036000 tx=0x7f8f8c03c040 comp rx=0 tx=0).stop 2023-08-09T12:40:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f900b3fe0 msgr2=0x7f8f900c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f900b3fe0 0x7f8f900c3ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c450 tx=0x7f8f8000c910 comp rx=0 tx=0).stop 2023-08-09T12:40:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 shutdown_connections 2023-08-09T12:40:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8f7406a050 0x7f8f7406c510 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f90159bd0 0x7f8f900c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f900b3fe0 0x7f8f900c3ec0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 --2- 172.21.15.17:0/2357828446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f900697c0 0x7f8f90150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 >> 172.21.15.17:0/2357828446 conn(0x7f8f900b1d50 msgr2=0x7f8f900ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 shutdown_connections 2023-08-09T12:40:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:22.704+0000 7f8f9608a640 1 -- 172.21.15.17:0/2357828446 wait complete. 2023-08-09T12:40:22.727 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-09T12:40:22.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:22.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-08-09T12:40:22.844 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:40:22.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:22.845 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-09T12:40:22.896 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:40:22.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:40:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.135+0000 7fac26912640 1 Processor -- start 2023-08-09T12:40:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.135+0000 7fac26912640 1 -- start start 2023-08-09T12:40:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.137+0000 7fac26912640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac200b3b40 0x7fac200b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.137+0000 7fac26912640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac200cc630 0x7fac200ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.137+0000 7fac26912640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2006c990 con 0x7fac200adc40 2023-08-09T12:40:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.137+0000 7fac26912640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200ae020 con 0x7fac200cc630 2023-08-09T12:40:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.137+0000 7fac26912640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200b2250 con 0x7fac200b3b40 2023-08-09T12:40:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.137+0000 7fac24eaf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac200cc630 0x7fac200ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.137+0000 7fac24eaf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac200cc630 0x7fac200ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52144/0 (socket says 172.21.15.17:52144) 2023-08-09T12:40:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.137+0000 7fac24eaf640 1 -- 172.21.15.17:0/483678794 learned_addr learned my addr 172.21.15.17:0/483678794 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.138+0000 7fac24eaf640 1 -- 172.21.15.17:0/483678794 >> v2:172.21.15.142:3300/0 conn(0x7fac200b3b40 msgr2=0x7fac200b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.138+0000 7fac24eaf640 1 --2- 172.21.15.17:0/483678794 >> v2:172.21.15.142:3300/0 conn(0x7fac200b3b40 0x7fac200b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.138+0000 7fac24eaf640 1 -- 172.21.15.17:0/483678794 >> v1:172.21.15.142:6789/0 conn(0x7fac200adc40 legacy=0x7fac2006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.138+0000 7fac24eaf640 1 -- 172.21.15.17:0/483678794 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200b2530 con 0x7fac200cc630 2023-08-09T12:40:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.139+0000 7fac24eaf640 1 --2- 172.21.15.17:0/483678794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200cc630 0x7fac200ccaa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac200b48a0 tx=0x7fac1802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85c38d51bc0ca94 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.139+0000 7fac1effd640 1 -- 172.21.15.17:0/483678794 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18031870 con 0x7fac200cc630 2023-08-09T12:40:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.139+0000 7fac1effd640 1 -- 172.21.15.17:0/483678794 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180319d0 con 0x7fac200cc630 2023-08-09T12:40:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.139+0000 7fac1effd640 1 -- 172.21.15.17:0/483678794 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18031d60 con 0x7fac200cc630 2023-08-09T12:40:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.140+0000 7fac26912640 1 -- 172.21.15.17:0/483678794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200cc630 msgr2=0x7fac200ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.140+0000 7fac26912640 1 --2- 172.21.15.17:0/483678794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200cc630 0x7fac200ccaa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac200b48a0 tx=0x7fac1802b910 comp rx=0 tx=0).stop 2023-08-09T12:40:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.140+0000 7fac26912640 1 -- 172.21.15.17:0/483678794 shutdown_connections 2023-08-09T12:40:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.140+0000 7fac26912640 1 --2- 172.21.15.17:0/483678794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200cc630 0x7fac200ccaa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.140+0000 7fac26912640 1 --2- 172.21.15.17:0/483678794 >> v2:172.21.15.142:3300/0 conn(0x7fac200b3b40 0x7fac200b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.140+0000 7fac26912640 1 -- 172.21.15.17:0/483678794 >> 172.21.15.17:0/483678794 conn(0x7fac200cb1b0 msgr2=0x7fac200cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.140+0000 7fac26912640 1 -- 172.21.15.17:0/483678794 shutdown_connections 2023-08-09T12:40:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.140+0000 7fac26912640 1 -- 172.21.15.17:0/483678794 wait complete. 2023-08-09T12:40:23.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.142+0000 7fac26912640 1 Processor -- start 2023-08-09T12:40:23.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.142+0000 7fac26912640 1 -- start start 2023-08-09T12:40:23.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac26912640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac200adc40 0x7fac200c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac26912640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200b3b40 0x7fac200ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac26912640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac200cc630 0x7fac200c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac26912640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c5e60 con 0x7fac200b3b40 2023-08-09T12:40:23.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac26912640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c49d0 con 0x7fac200adc40 2023-08-09T12:40:23.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac26912640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c4c70 con 0x7fac200cc630 2023-08-09T12:40:23.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac1f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200b3b40 0x7fac200ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac1f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200b3b40 0x7fac200ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52154/0 (socket says 172.21.15.17:52154) 2023-08-09T12:40:23.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac1f7fe640 1 -- 172.21.15.17:0/384028502 learned_addr learned my addr 172.21.15.17:0/384028502 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:23.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.143+0000 7fac1ffff640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac200adc40 0x7fac200c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1f7fe640 1 -- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac200cc630 msgr2=0x7fac200c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1f7fe640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac200cc630 0x7fac200c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1f7fe640 1 -- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac200adc40 msgr2=0x7fac200c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1f7fe640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac200adc40 0x7fac200c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1f7fe640 1 -- 172.21.15.17:0/384028502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180094d0 con 0x7fac200b3b40 2023-08-09T12:40:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1ffff640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac200adc40 0x7fac200c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1f7fe640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200b3b40 0x7fac200ca1e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b4a0 tx=0x7fac1400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1cff9640 1 -- 172.21.15.17:0/384028502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14005a10 con 0x7fac200b3b40 2023-08-09T12:40:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1cff9640 1 -- 172.21.15.17:0/384028502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14005b70 con 0x7fac200b3b40 2023-08-09T12:40:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac200c5810 con 0x7fac200b3b40 2023-08-09T12:40:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac1cff9640 1 -- 172.21.15.17:0/384028502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14010610 con 0x7fac200b3b40 2023-08-09T12:40:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.144+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac200c4f50 con 0x7fac200b3b40 2023-08-09T12:40:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.146+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac200c6010 con 0x7fac200b3b40 2023-08-09T12:40:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.146+0000 7fac1cff9640 1 -- 172.21.15.17:0/384028502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac14010770 con 0x7fac200b3b40 2023-08-09T12:40:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.147+0000 7fac1cff9640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac0c06a080 0x7fac0c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.147+0000 7fac1cff9640 1 -- 172.21.15.17:0/384028502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fac14087e70 con 0x7fac200b3b40 2023-08-09T12:40:23.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.148+0000 7fac1ffff640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac0c06a080 0x7fac0c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.149+0000 7fac1ffff640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac0c06a080 0x7fac0c06c540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac10001dc0 tx=0x7fac10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:23.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.152+0000 7fac1cff9640 1 -- 172.21.15.17:0/384028502 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fac200c6010 con 0x7fac200b3b40 2023-08-09T12:40:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.384+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac20067a80 con 0x7fac200b3b40 2023-08-09T12:40:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.385+0000 7fac1cff9640 1 -- 172.21.15.17:0/384028502 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4872 (secure 0 0 0) 0x7fac14014090 con 0x7fac200b3b40 2023-08-09T12:40:23.388 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:23.389 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:39:25.114229+0000","modified":"2023-08-09T12:39:28.660973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T12:40:23.389 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-08-09T12:40:23.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac0c06a080 msgr2=0x7fac0c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac0c06a080 0x7fac0c06c540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac10001dc0 tx=0x7fac10009040 comp rx=0 tx=0).stop 2023-08-09T12:40:23.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200b3b40 msgr2=0x7fac200ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200b3b40 0x7fac200ca1e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b4a0 tx=0x7fac1400b960 comp rx=0 tx=0).stop 2023-08-09T12:40:23.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 shutdown_connections 2023-08-09T12:40:23.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac0c06a080 0x7fac0c06c540 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac200cc630 0x7fac200c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac200b3b40 0x7fac200ca1e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.387+0000 7fac26912640 1 --2- 172.21.15.17:0/384028502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac200adc40 0x7fac200c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.388+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 >> 172.21.15.17:0/384028502 conn(0x7fac200cb1b0 msgr2=0x7fac200ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:23.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.388+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 shutdown_connections 2023-08-09T12:40:23.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.388+0000 7fac26912640 1 -- 172.21.15.17:0/384028502 wait complete. 2023-08-09T12:40:23.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:23.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.627+0000 7f44505d6640 1 Processor -- start 2023-08-09T12:40:23.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.627+0000 7f44505d6640 1 -- start start 2023-08-09T12:40:23.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.629+0000 7f44505d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161280 0x7f44480c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.629+0000 7f44505d6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f44480acfc0 0x7f44480cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.629+0000 7f44505d6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444815df30 con 0x7f4448161660 2023-08-09T12:40:23.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.629+0000 7f44505d6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444815d430 con 0x7f44480acfc0 2023-08-09T12:40:23.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.629+0000 7f44505d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44480ca9d0 con 0x7f4448161280 2023-08-09T12:40:23.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.629+0000 7f444eb73640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f44480acfc0 0x7f44480cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.629+0000 7f444eb73640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f44480acfc0 0x7f44480cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52158/0 (socket says 172.21.15.17:52158) 2023-08-09T12:40:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.629+0000 7f444eb73640 1 -- 172.21.15.17:0/4023688648 learned_addr learned my addr 172.21.15.17:0/4023688648 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.630+0000 7f444e372640 1 --2- 172.21.15.17:0/4023688648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161280 0x7f44480c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.630+0000 7f444eb73640 1 -- 172.21.15.17:0/4023688648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161280 msgr2=0x7f44480c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.630+0000 7f444eb73640 1 --2- 172.21.15.17:0/4023688648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161280 0x7f44480c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.630+0000 7f444eb73640 1 -- 172.21.15.17:0/4023688648 >> v1:172.21.15.17:6789/0 conn(0x7f4448161660 legacy=0x7f44480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.630+0000 7f444eb73640 1 -- 172.21.15.17:0/4023688648 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444815e3c0 con 0x7f44480acfc0 2023-08-09T12:40:23.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.631+0000 7f444eb73640 1 --2- 172.21.15.17:0/4023688648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44480acfc0 0x7f44480cc630 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4440009e50 tx=0x7f444002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88230939c7db6e4e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:23.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.632+0000 7f444d370640 1 -- 172.21.15.17:0/4023688648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444002ca80 con 0x7f44480acfc0 2023-08-09T12:40:23.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.632+0000 7f444d370640 1 -- 172.21.15.17:0/4023688648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444002cbe0 con 0x7f44480acfc0 2023-08-09T12:40:23.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.632+0000 7f444d370640 1 -- 172.21.15.17:0/4023688648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44400343f0 con 0x7f44480acfc0 2023-08-09T12:40:23.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.632+0000 7f44505d6640 1 -- 172.21.15.17:0/4023688648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44480acfc0 msgr2=0x7f44480cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.632+0000 7f44505d6640 1 --2- 172.21.15.17:0/4023688648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44480acfc0 0x7f44480cc630 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4440009e50 tx=0x7f444002bee0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.633+0000 7f44505d6640 1 -- 172.21.15.17:0/4023688648 shutdown_connections 2023-08-09T12:40:23.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.633+0000 7f44505d6640 1 --2- 172.21.15.17:0/4023688648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44480acfc0 0x7f44480cc630 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.633+0000 7f44505d6640 1 --2- 172.21.15.17:0/4023688648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161280 0x7f44480c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.633+0000 7f44505d6640 1 -- 172.21.15.17:0/4023688648 >> 172.21.15.17:0/4023688648 conn(0x7f44480cb1b0 msgr2=0x7f44480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:23.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.633+0000 7f44505d6640 1 -- 172.21.15.17:0/4023688648 shutdown_connections 2023-08-09T12:40:23.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.633+0000 7f44505d6640 1 -- 172.21.15.17:0/4023688648 wait complete. 2023-08-09T12:40:23.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.635+0000 7f44505d6640 1 Processor -- start 2023-08-09T12:40:23.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.635+0000 7f44505d6640 1 -- start start 2023-08-09T12:40:23.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.636+0000 7f44505d6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44480acfc0 0x7f4448153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.636+0000 7f44505d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4448161280 0x7f44480c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.636+0000 7f44505d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161660 0x7f44480c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.636+0000 7f44505d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44480c6410 con 0x7f4448161280 2023-08-09T12:40:23.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.636+0000 7f44505d6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44480c4900 con 0x7f44480acfc0 2023-08-09T12:40:23.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.636+0000 7f44505d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44480c4be0 con 0x7f4448161660 2023-08-09T12:40:23.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.637+0000 7f444db71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4448161280 0x7f44480c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.637+0000 7f444db71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4448161280 0x7f44480c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52160/0 (socket says 172.21.15.17:52160) 2023-08-09T12:40:23.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.637+0000 7f444db71640 1 -- 172.21.15.17:0/4188576256 learned_addr learned my addr 172.21.15.17:0/4188576256 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:23.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.637+0000 7f444e372640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44480acfc0 0x7f4448153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.637+0000 7f444eb73640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161660 0x7f44480c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.637+0000 7f444db71640 1 -- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161660 msgr2=0x7f44480c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f444db71640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161660 0x7f44480c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f444db71640 1 -- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44480acfc0 msgr2=0x7f4448153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f444db71640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44480acfc0 0x7f4448153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f444db71640 1 -- 172.21.15.17:0/4188576256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440009b30 con 0x7f4448161280 2023-08-09T12:40:23.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f444db71640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4448161280 0x7f44480c3d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f443800c410 tx=0x7f443800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:23.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f443effd640 1 -- 172.21.15.17:0/4188576256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44380035f0 con 0x7f4448161280 2023-08-09T12:40:23.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f443effd640 1 -- 172.21.15.17:0/4188576256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438003770 con 0x7f4448161280 2023-08-09T12:40:23.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f443effd640 1 -- 172.21.15.17:0/4188576256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438003b60 con 0x7f4448161280 2023-08-09T12:40:23.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.638+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44480c4ec0 con 0x7f4448161280 2023-08-09T12:40:23.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.639+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44480c5480 con 0x7f4448161280 2023-08-09T12:40:23.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.640+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4448067a80 con 0x7f4448161280 2023-08-09T12:40:23.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.641+0000 7f443effd640 1 -- 172.21.15.17:0/4188576256 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4438003cc0 con 0x7f4448161280 2023-08-09T12:40:23.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.642+0000 7f443effd640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f442c06a020 0x7f442c06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.642+0000 7f443effd640 1 -- 172.21.15.17:0/4188576256 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4438087b50 con 0x7f4448161280 2023-08-09T12:40:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.642+0000 7f444e372640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f442c06a020 0x7f442c06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.644+0000 7f444e372640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f442c06a020 0x7f442c06c4e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4444009aa0 tx=0x7f4444009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.647+0000 7f443effd640 1 -- 172.21.15.17:0/4188576256 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4438053370 con 0x7f4448161280 2023-08-09T12:40:23.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.844+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44480adc60 con 0x7f4448161280 2023-08-09T12:40:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.846+0000 7f443effd640 1 -- 172.21.15.17:0/4188576256 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f4438017090 con 0x7f4448161280 2023-08-09T12:40:23.849 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:23.850 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:09.763656+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:23.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f442c06a020 msgr2=0x7f442c06c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f442c06a020 0x7f442c06c4e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4444009aa0 tx=0x7f4444009190 comp rx=0 tx=0).stop 2023-08-09T12:40:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4448161280 msgr2=0x7f44480c3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4448161280 0x7f44480c3d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f443800c410 tx=0x7f443800c8d0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 shutdown_connections 2023-08-09T12:40:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f442c06a020 0x7f442c06c4e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4448161660 0x7f44480c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4448161280 0x7f44480c3d90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 --2- 172.21.15.17:0/4188576256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44480acfc0 0x7f4448153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:23.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 >> 172.21.15.17:0/4188576256 conn(0x7f44480cb1b0 msgr2=0x7f444815ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:23.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 shutdown_connections 2023-08-09T12:40:23.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:23.849+0000 7f44505d6640 1 -- 172.21.15.17:0/4188576256 wait complete. 2023-08-09T12:40:23.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:39:23.544079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:39:24.140077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:23.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.104+0000 7fc66cd7f640 1 Processor -- start 2023-08-09T12:40:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.104+0000 7fc66cd7f640 1 -- start start 2023-08-09T12:40:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.105+0000 7fc66cd7f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc66815a8c0 0x7fc6680b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.105+0000 7fc66cd7f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc6680b13f0 0x7fc66815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.105+0000 7fc66cd7f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815f180 0x7fc6680b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.105+0000 7fc66cd7f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66815e7b0 con 0x7fc6680b13f0 2023-08-09T12:40:24.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.105+0000 7fc66cd7f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6680b1850 con 0x7fc66815a8c0 2023-08-09T12:40:24.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.105+0000 7fc66cd7f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815e460 con 0x7fc66815f180 2023-08-09T12:40:24.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc65effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc6680b13f0 0x7fc66815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc65effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc6680b13f0 0x7fc66815ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52162/0 (socket says 172.21.15.17:52162) 2023-08-09T12:40:24.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc65effd640 1 -- 172.21.15.17:0/2320565620 learned_addr learned my addr 172.21.15.17:0/2320565620 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:24.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc6677fe640 1 --2- 172.21.15.17:0/2320565620 >> v2:172.21.15.142:3300/0 conn(0x7fc66815a8c0 0x7fc6680b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc667fff640 1 --2- 172.21.15.17:0/2320565620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815f180 0x7fc6680b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc65effd640 1 -- 172.21.15.17:0/2320565620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815f180 msgr2=0x7fc6680b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:24.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc65effd640 1 --2- 172.21.15.17:0/2320565620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815f180 0x7fc6680b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc65effd640 1 -- 172.21.15.17:0/2320565620 >> v2:172.21.15.142:3300/0 conn(0x7fc66815a8c0 msgr2=0x7fc6680b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc65effd640 1 --2- 172.21.15.17:0/2320565620 >> v2:172.21.15.142:3300/0 conn(0x7fc66815a8c0 0x7fc6680b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.106+0000 7fc65effd640 1 -- 172.21.15.17:0/2320565620 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66815aca0 con 0x7fc6680b13f0 2023-08-09T12:40:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.108+0000 7fc65effd640 1 --2- 172.21.15.17:0/2320565620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6680b13f0 0x7fc66815ec40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc6680ce460 tx=0x7fc65002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c64004e811590c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.108+0000 7fc666ffd640 1 -- 172.21.15.17:0/2320565620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65002ca80 con 0x7fc6680b13f0 2023-08-09T12:40:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.108+0000 7fc666ffd640 1 -- 172.21.15.17:0/2320565620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65002cbe0 con 0x7fc6680b13f0 2023-08-09T12:40:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.108+0000 7fc666ffd640 1 -- 172.21.15.17:0/2320565620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6500343f0 con 0x7fc6680b13f0 2023-08-09T12:40:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 -- 172.21.15.17:0/2320565620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6680b13f0 msgr2=0x7fc66815ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/2320565620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6680b13f0 0x7fc66815ec40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc6680ce460 tx=0x7fc65002bee0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 -- 172.21.15.17:0/2320565620 shutdown_connections 2023-08-09T12:40:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/2320565620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815f180 0x7fc6680b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/2320565620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6680b13f0 0x7fc66815ec40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/2320565620 >> v2:172.21.15.142:3300/0 conn(0x7fc66815a8c0 0x7fc6680b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 -- 172.21.15.17:0/2320565620 >> 172.21.15.17:0/2320565620 conn(0x7fc6680cb020 msgr2=0x7fc6680cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 -- 172.21.15.17:0/2320565620 shutdown_connections 2023-08-09T12:40:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.109+0000 7fc66cd7f640 1 -- 172.21.15.17:0/2320565620 wait complete. 2023-08-09T12:40:24.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.111+0000 7fc66cd7f640 1 Processor -- start 2023-08-09T12:40:24.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.111+0000 7fc66cd7f640 1 -- start start 2023-08-09T12:40:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.112+0000 7fc66cd7f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6680b13f0 0x7fc66815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.112+0000 7fc66cd7f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815a8c0 0x7fc668070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.112+0000 7fc66cd7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc66815f180 0x7fc668070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.112+0000 7fc66cd7f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815c790 con 0x7fc66815f180 2023-08-09T12:40:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.112+0000 7fc66cd7f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815bb80 con 0x7fc6680b13f0 2023-08-09T12:40:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.112+0000 7fc66cd7f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815be60 con 0x7fc66815a8c0 2023-08-09T12:40:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc66815f180 0x7fc668070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc66815f180 0x7fc668070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52178/0 (socket says 172.21.15.17:52178) 2023-08-09T12:40:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 -- 172.21.15.17:0/4096439266 learned_addr learned my addr 172.21.15.17:0/4096439266 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc6677fe640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6680b13f0 0x7fc66815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc65effd640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815a8c0 0x7fc668070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 -- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815a8c0 msgr2=0x7fc668070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815a8c0 0x7fc668070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 -- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6680b13f0 msgr2=0x7fc66815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6680b13f0 0x7fc66815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 -- 172.21.15.17:0/4096439266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc650009b30 con 0x7fc66815f180 2023-08-09T12:40:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.113+0000 7fc667fff640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc66815f180 0x7fc668070c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc66000d5d0 tx=0x7fc66000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:24.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.114+0000 7fc664ff9640 1 -- 172.21.15.17:0/4096439266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600125f0 con 0x7fc66815f180 2023-08-09T12:40:24.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.114+0000 7fc664ff9640 1 -- 172.21.15.17:0/4096439266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc660012750 con 0x7fc66815f180 2023-08-09T12:40:24.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.114+0000 7fc664ff9640 1 -- 172.21.15.17:0/4096439266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660012b00 con 0x7fc66815f180 2023-08-09T12:40:24.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.114+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66815c140 con 0x7fc66815f180 2023-08-09T12:40:24.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.114+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66815db60 con 0x7fc66815f180 2023-08-09T12:40:24.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.115+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6681f1f90 con 0x7fc66815f180 2023-08-09T12:40:24.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.116+0000 7fc664ff9640 1 -- 172.21.15.17:0/4096439266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc660012c60 con 0x7fc66815f180 2023-08-09T12:40:24.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.117+0000 7fc664ff9640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc64806a050 0x7fc64806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.117+0000 7fc664ff9640 1 -- 172.21.15.17:0/4096439266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc660088b20 con 0x7fc66815f180 2023-08-09T12:40:24.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.118+0000 7fc6677fe640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc64806a050 0x7fc64806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.119+0000 7fc6677fe640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc64806a050 0x7fc64806c510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc658006fd0 tx=0x7fc658008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:24.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.122+0000 7fc664ff9640 1 -- 172.21.15.17:0/4096439266 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc66008ae60 con 0x7fc66815f180 2023-08-09T12:40:24.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.318+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc66804e390 con 0x7fc66815f180 2023-08-09T12:40:24.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.319+0000 7fc664ff9640 1 -- 172.21.15.17:0/4096439266 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc660054130 con 0x7fc66815f180 2023-08-09T12:40:24.322 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:24.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc64806a050 msgr2=0x7fc64806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc64806a050 0x7fc64806c510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc658006fd0 tx=0x7fc658008040 comp rx=0 tx=0).stop 2023-08-09T12:40:24.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc66815f180 msgr2=0x7fc668070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc66815f180 0x7fc668070c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc66000d5d0 tx=0x7fc66000da90 comp rx=0 tx=0).stop 2023-08-09T12:40:24.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 shutdown_connections 2023-08-09T12:40:24.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc64806a050 0x7fc64806c510 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc66815f180 0x7fc668070c60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66815a8c0 0x7fc668070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 --2- 172.21.15.17:0/4096439266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6680b13f0 0x7fc66815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 >> 172.21.15.17:0/4096439266 conn(0x7fc6680cb020 msgr2=0x7fc6680ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:24.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 shutdown_connections 2023-08-09T12:40:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.322+0000 7fc66cd7f640 1 -- 172.21.15.17:0/4096439266 wait complete. 2023-08-09T12:40:24.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:24.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.575+0000 7f0596dbd640 1 Processor -- start 2023-08-09T12:40:24.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.576+0000 7f0596dbd640 1 -- start start 2023-08-09T12:40:24.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.577+0000 7f0596dbd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0590159bd0 0x7f05900c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.577+0000 7f0596dbd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05900b3020 0x7f05900b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.577+0000 7f0596dbd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05900b2b90 con 0x7f05900b3d60 2023-08-09T12:40:24.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.577+0000 7f0596dbd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05900cabb0 con 0x7f05900b3020 2023-08-09T12:40:24.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.577+0000 7f0596dbd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05900b2580 con 0x7f0590159bd0 2023-08-09T12:40:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.578+0000 7f0595dbb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0590159bd0 0x7f05900c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.578+0000 7f05955ba640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f05900b3d60 0x7f05900cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:48442/0 (socket says 172.21.15.17:48442) 2023-08-09T12:40:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.578+0000 7f05955ba640 1 -- 172.21.15.17:0/2692077312 learned_addr learned my addr 172.21.15.17:0/2692077312 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.578+0000 7f05965bc640 1 --2- 172.21.15.17:0/2692077312 >> v2:172.21.15.142:3300/0 conn(0x7f05900b3020 0x7f05900b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.579+0000 7f0594db9640 1 -- 172.21.15.17:0/2692077312 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408040280 0 0) 0x7f05900b2b90 con 0x7f05900b3d60 2023-08-09T12:40:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.579+0000 7f0594db9640 1 -- 172.21.15.17:0/2692077312 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f057c003520 con 0x7f05900b3d60 2023-08-09T12:40:24.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.579+0000 7f05965bc640 1 -- 172.21.15.17:0/2692077312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0590159bd0 msgr2=0x7f05900c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:24.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.579+0000 7f05965bc640 1 --2- 172.21.15.17:0/2692077312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0590159bd0 0x7f05900c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.579+0000 7f05965bc640 1 -- 172.21.15.17:0/2692077312 >> v1:172.21.15.142:6789/0 conn(0x7f05900b3d60 legacy=0x7f05900cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.579+0000 7f05965bc640 1 -- 172.21.15.17:0/2692077312 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05900ca350 con 0x7f05900b3020 2023-08-09T12:40:24.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.579+0000 7f0595dbb640 1 --2- 172.21.15.17:0/2692077312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0590159bd0 0x7f05900c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:40:24.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.580+0000 7f05965bc640 1 --2- 172.21.15.17:0/2692077312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 0x7f05900b34b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0588009d90 tx=0x7f058802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b4a4f0d89f078b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:24.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.581+0000 7f0594db9640 1 -- 172.21.15.17:0/2692077312 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058802cc60 con 0x7f05900b3020 2023-08-09T12:40:24.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.581+0000 7f0594db9640 1 -- 172.21.15.17:0/2692077312 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058802cdc0 con 0x7f05900b3020 2023-08-09T12:40:24.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.581+0000 7f0594db9640 1 -- 172.21.15.17:0/2692077312 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588034640 con 0x7f05900b3020 2023-08-09T12:40:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.582+0000 7f0596dbd640 1 -- 172.21.15.17:0/2692077312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 msgr2=0x7f05900b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.582+0000 7f0596dbd640 1 --2- 172.21.15.17:0/2692077312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 0x7f05900b34b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0588009d90 tx=0x7f058802beb0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.582+0000 7f0596dbd640 1 -- 172.21.15.17:0/2692077312 shutdown_connections 2023-08-09T12:40:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.582+0000 7f0596dbd640 1 --2- 172.21.15.17:0/2692077312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 0x7f05900b34b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.582+0000 7f0596dbd640 1 --2- 172.21.15.17:0/2692077312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0590159bd0 0x7f05900c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.582+0000 7f0596dbd640 1 -- 172.21.15.17:0/2692077312 >> 172.21.15.17:0/2692077312 conn(0x7f05900cb020 msgr2=0x7f05900cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.582+0000 7f0596dbd640 1 -- 172.21.15.17:0/2692077312 shutdown_connections 2023-08-09T12:40:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.582+0000 7f0596dbd640 1 -- 172.21.15.17:0/2692077312 wait complete. 2023-08-09T12:40:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.584+0000 7f0596dbd640 1 Processor -- start 2023-08-09T12:40:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.584+0000 7f0596dbd640 1 -- start start 2023-08-09T12:40:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f0596dbd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 0x7f0590150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f0596dbd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05900b3d60 0x7f059015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f0596dbd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0590159bd0 0x7f05900c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f0596dbd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05900c69f0 con 0x7f0590159bd0 2023-08-09T12:40:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f0596dbd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0590151200 con 0x7f05900b3020 2023-08-09T12:40:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f0596dbd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059015cf80 con 0x7f05900b3d60 2023-08-09T12:40:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f05965bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0590159bd0 0x7f05900c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f05965bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0590159bd0 0x7f05900c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52192/0 (socket says 172.21.15.17:52192) 2023-08-09T12:40:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f05965bc640 1 -- 172.21.15.17:0/802341036 learned_addr learned my addr 172.21.15.17:0/802341036 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.585+0000 7f0595dbb640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 0x7f0590150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05955ba640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05900b3d60 0x7f059015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05965bc640 1 -- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05900b3d60 msgr2=0x7f059015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05965bc640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05900b3d60 0x7f059015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05965bc640 1 -- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 msgr2=0x7f0590150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05965bc640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 0x7f0590150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05965bc640 1 -- 172.21.15.17:0/802341036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c009400 con 0x7f0590159bd0 2023-08-09T12:40:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05965bc640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0590159bd0 0x7f05900c4590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0588009eb0 tx=0x7f0588004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05867fc640 1 -- 172.21.15.17:0/802341036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588004250 con 0x7f0590159bd0 2023-08-09T12:40:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05867fc640 1 -- 172.21.15.17:0/802341036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05880043b0 con 0x7f0590159bd0 2023-08-09T12:40:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0588009a70 con 0x7f0590159bd0 2023-08-09T12:40:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.586+0000 7f05867fc640 1 -- 172.21.15.17:0/802341036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05880047e0 con 0x7f0590159bd0 2023-08-09T12:40:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.587+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05900c5950 con 0x7f0590159bd0 2023-08-09T12:40:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.588+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059004e390 con 0x7f0590159bd0 2023-08-09T12:40:24.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.589+0000 7f05867fc640 1 -- 172.21.15.17:0/802341036 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0588034440 con 0x7f0590159bd0 2023-08-09T12:40:24.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.590+0000 7f05867fc640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057406a050 0x7f057406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:24.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.590+0000 7f05867fc640 1 -- 172.21.15.17:0/802341036 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f05880ab060 con 0x7f0590159bd0 2023-08-09T12:40:24.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.590+0000 7f0595dbb640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057406a050 0x7f057406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:24.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.591+0000 7f0595dbb640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057406a050 0x7f057406c510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f058c009c60 tx=0x7f058c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:24.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.594+0000 7f05867fc640 1 -- 172.21.15.17:0/802341036 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0588076690 con 0x7f0590159bd0 2023-08-09T12:40:24.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.788+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05900afca0 con 0x7f0590159bd0 2023-08-09T12:40:24.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.789+0000 7f05867fc640 1 -- 172.21.15.17:0/802341036 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0588079cb0 con 0x7f0590159bd0 2023-08-09T12:40:24.792 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:24.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057406a050 msgr2=0x7f057406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057406a050 0x7f057406c510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f058c009c60 tx=0x7f058c008040 comp rx=0 tx=0).stop 2023-08-09T12:40:24.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0590159bd0 msgr2=0x7f05900c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:24.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0590159bd0 0x7f05900c4590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0588009eb0 tx=0x7f0588004a40 comp rx=0 tx=0).stop 2023-08-09T12:40:24.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 shutdown_connections 2023-08-09T12:40:24.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057406a050 0x7f057406c510 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0590159bd0 0x7f05900c4590 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05900b3d60 0x7f059015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 --2- 172.21.15.17:0/802341036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05900b3020 0x7f0590150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:24.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 >> 172.21.15.17:0/802341036 conn(0x7f05900cb020 msgr2=0x7f05900b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:24.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 shutdown_connections 2023-08-09T12:40:24.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:24.792+0000 7f0596dbd640 1 -- 172.21.15.17:0/802341036 wait complete. 2023-08-09T12:40:24.815 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.036+0000 7f154b344640 1 Processor -- start 2023-08-09T12:40:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.036+0000 7f154b344640 1 -- start start 2023-08-09T12:40:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154b344640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f154415cac0 0x7f15440cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154b344640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15440b1fc0 0x7f15440d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154b344640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f15440b44b0 0x7f15440b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154b344640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15440d1010 con 0x7f15440b44b0 2023-08-09T12:40:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154b344640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15440b4e80 con 0x7f154415cac0 2023-08-09T12:40:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154b344640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15440d09e0 con 0x7f15440b1fc0 2023-08-09T12:40:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154ab43640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f15440b44b0 0x7f15440b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154ab43640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f15440b44b0 0x7f15440b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52208/0 (socket says 172.21.15.17:52208) 2023-08-09T12:40:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154ab43640 1 -- 172.21.15.17:0/2649322143 learned_addr learned my addr 172.21.15.17:0/2649322143 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f154a342640 1 --2- 172.21.15.17:0/2649322143 >> v2:172.21.15.142:3300/0 conn(0x7f154415cac0 0x7f15440cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.038+0000 7f1549b41640 1 --2- 172.21.15.17:0/2649322143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15440b1fc0 0x7f15440d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.039+0000 7f154ab43640 1 -- 172.21.15.17:0/2649322143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15440b1fc0 msgr2=0x7f15440d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.039+0000 7f154ab43640 1 --2- 172.21.15.17:0/2649322143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15440b1fc0 0x7f15440d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.039+0000 7f154ab43640 1 -- 172.21.15.17:0/2649322143 >> v2:172.21.15.142:3300/0 conn(0x7f154415cac0 msgr2=0x7f15440cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.039+0000 7f154ab43640 1 --2- 172.21.15.17:0/2649322143 >> v2:172.21.15.142:3300/0 conn(0x7f154415cac0 0x7f15440cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.039+0000 7f154ab43640 1 -- 172.21.15.17:0/2649322143 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15440cdb70 con 0x7f15440b44b0 2023-08-09T12:40:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.040+0000 7f154ab43640 1 --2- 172.21.15.17:0/2649322143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b44b0 0x7f15440b4940 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f154406a7f0 tx=0x7f153c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5941207e20758238 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.040+0000 7f1549340640 1 -- 172.21.15.17:0/2649322143 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c031860 con 0x7f15440b44b0 2023-08-09T12:40:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.040+0000 7f1549340640 1 -- 172.21.15.17:0/2649322143 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c0319c0 con 0x7f15440b44b0 2023-08-09T12:40:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.040+0000 7f1549340640 1 -- 172.21.15.17:0/2649322143 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c031d50 con 0x7f15440b44b0 2023-08-09T12:40:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 -- 172.21.15.17:0/2649322143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b44b0 msgr2=0x7f15440b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 --2- 172.21.15.17:0/2649322143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b44b0 0x7f15440b4940 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f154406a7f0 tx=0x7f153c02b900 comp rx=0 tx=0).stop 2023-08-09T12:40:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 -- 172.21.15.17:0/2649322143 shutdown_connections 2023-08-09T12:40:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 --2- 172.21.15.17:0/2649322143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b44b0 0x7f15440b4940 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 --2- 172.21.15.17:0/2649322143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15440b1fc0 0x7f15440d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 --2- 172.21.15.17:0/2649322143 >> v2:172.21.15.142:3300/0 conn(0x7f154415cac0 0x7f15440cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 -- 172.21.15.17:0/2649322143 >> 172.21.15.17:0/2649322143 conn(0x7f15440cf4b0 msgr2=0x7f15440cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:25.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 -- 172.21.15.17:0/2649322143 shutdown_connections 2023-08-09T12:40:25.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.041+0000 7f154b344640 1 -- 172.21.15.17:0/2649322143 wait complete. 2023-08-09T12:40:25.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.043+0000 7f154b344640 1 Processor -- start 2023-08-09T12:40:25.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.044+0000 7f154b344640 1 -- start start 2023-08-09T12:40:25.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154b344640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b1fc0 0x7f1544150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154b344640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15440b44b0 0x7f15440b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154b344640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f154415cac0 0x7f15440b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154b344640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1544150e40 con 0x7f15440b1fc0 2023-08-09T12:40:25.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154b344640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1544151090 con 0x7f15440b44b0 2023-08-09T12:40:25.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154b344640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1544151370 con 0x7f154415cac0 2023-08-09T12:40:25.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154a342640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b1fc0 0x7f1544150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154a342640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b1fc0 0x7f1544150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52222/0 (socket says 172.21.15.17:52222) 2023-08-09T12:40:25.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154a342640 1 -- 172.21.15.17:0/414754103 learned_addr learned my addr 172.21.15.17:0/414754103 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:25.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f1549b41640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15440b44b0 0x7f15440b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154ab43640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f154415cac0 0x7f15440b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154a342640 1 -- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f154415cac0 msgr2=0x7f15440b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154a342640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f154415cac0 0x7f15440b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154a342640 1 -- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15440b44b0 msgr2=0x7f15440b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154a342640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15440b44b0 0x7f15440b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154a342640 1 -- 172.21.15.17:0/414754103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0094d0 con 0x7f15440b1fc0 2023-08-09T12:40:25.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.045+0000 7f154ab43640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f154415cac0 0x7f15440b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.046+0000 7f154a342640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b1fc0 0x7f1544150820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1540007ef0 tx=0x7f154000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.046+0000 7f153affd640 1 -- 172.21.15.17:0/414754103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540014620 con 0x7f15440b1fc0 2023-08-09T12:40:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.046+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1544151650 con 0x7f15440b1fc0 2023-08-09T12:40:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.046+0000 7f153affd640 1 -- 172.21.15.17:0/414754103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1540014780 con 0x7f15440b1fc0 2023-08-09T12:40:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.046+0000 7f153affd640 1 -- 172.21.15.17:0/414754103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540014b30 con 0x7f15440b1fc0 2023-08-09T12:40:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.046+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1544151c10 con 0x7f15440b1fc0 2023-08-09T12:40:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.047+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1544151dd0 con 0x7f15440b1fc0 2023-08-09T12:40:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.048+0000 7f153affd640 1 -- 172.21.15.17:0/414754103 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1540014c90 con 0x7f15440b1fc0 2023-08-09T12:40:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.050+0000 7f153affd640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f152806a080 0x7f152806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.050+0000 7f153affd640 1 -- 172.21.15.17:0/414754103 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1540088f80 con 0x7f15440b1fc0 2023-08-09T12:40:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.050+0000 7f1549b41640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f152806a080 0x7f152806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.051+0000 7f1549b41640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f152806a080 0x7f152806c540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1534006fd0 tx=0x7f1534008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.054+0000 7f153affd640 1 -- 172.21.15.17:0/414754103 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1540054620 con 0x7f15440b1fc0 2023-08-09T12:40:25.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.247+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f154404e390 con 0x7f15440b1fc0 2023-08-09T12:40:25.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.248+0000 7f153affd640 1 -- 172.21.15.17:0/414754103 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1540057c40 con 0x7f15440b1fc0 2023-08-09T12:40:25.252 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:40:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f152806a080 msgr2=0x7f152806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f152806a080 0x7f152806c540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1534006fd0 tx=0x7f1534008040 comp rx=0 tx=0).stop 2023-08-09T12:40:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b1fc0 msgr2=0x7f1544150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b1fc0 0x7f1544150820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1540007ef0 tx=0x7f154000e4b0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 shutdown_connections 2023-08-09T12:40:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f152806a080 0x7f152806c540 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f154415cac0 0x7f15440b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15440b44b0 0x7f15440b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 --2- 172.21.15.17:0/414754103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15440b1fc0 0x7f1544150820 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 >> 172.21.15.17:0/414754103 conn(0x7f15440cf4b0 msgr2=0x7f15440b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 shutdown_connections 2023-08-09T12:40:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.251+0000 7f154b344640 1 -- 172.21.15.17:0/414754103 wait complete. 2023-08-09T12:40:25.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:40:25.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.496+0000 7fc4570f9640 1 Processor -- start 2023-08-09T12:40:25.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.496+0000 7fc4570f9640 1 -- start start 2023-08-09T12:40:25.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.498+0000 7fc4570f9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc450161280 0x7fc4500c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.498+0000 7fc4570f9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc450161660 0x7fc4500ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.498+0000 7fc4570f9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45015df30 con 0x7fc4500ca450 2023-08-09T12:40:25.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.498+0000 7fc4570f9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45015d430 con 0x7fc450161280 2023-08-09T12:40:25.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.498+0000 7fc4570f9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4500ca9d0 con 0x7fc450161660 2023-08-09T12:40:25.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.499+0000 7fc454e95640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc450161280 0x7fc4500c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.499+0000 7fc455696640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc4500ca450 0x7fc4500c8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39940/0 (socket says 172.21.15.17:39940) 2023-08-09T12:40:25.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.499+0000 7fc455696640 1 -- 172.21.15.17:0/4045450425 learned_addr learned my addr 172.21.15.17:0/4045450425 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:25.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.499+0000 7fc44ffff640 1 --2- 172.21.15.17:0/4045450425 >> v2:172.21.15.142:3300/0 conn(0x7fc450161660 0x7fc4500ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.500+0000 7fc454e95640 1 -- 172.21.15.17:0/4045450425 >> v2:172.21.15.142:3300/0 conn(0x7fc450161660 msgr2=0x7fc4500ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.500+0000 7fc454e95640 1 --2- 172.21.15.17:0/4045450425 >> v2:172.21.15.142:3300/0 conn(0x7fc450161660 0x7fc4500ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.500+0000 7fc454e95640 1 -- 172.21.15.17:0/4045450425 >> v1:172.21.15.17:6789/0 conn(0x7fc4500ca450 legacy=0x7fc4500c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.500+0000 7fc454e95640 1 -- 172.21.15.17:0/4045450425 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45015e3c0 con 0x7fc450161280 2023-08-09T12:40:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.500+0000 7fc44f7fe640 1 -- 172.21.15.17:0/4045450425 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706269112 0 0) 0x7fc45015df30 con 0x7fc4500ca450 2023-08-09T12:40:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.501+0000 7fc454e95640 1 --2- 172.21.15.17:0/4045450425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4500c9f10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc45006ce30 tx=0x7fc44002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1040ad23ceebd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc44f7fe640 1 -- 172.21.15.17:0/4045450425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440031710 con 0x7fc450161280 2023-08-09T12:40:25.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc44f7fe640 1 -- 172.21.15.17:0/4045450425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44002f050 con 0x7fc450161280 2023-08-09T12:40:25.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc44f7fe640 1 -- 172.21.15.17:0/4045450425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440031a90 con 0x7fc450161280 2023-08-09T12:40:25.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc4570f9640 1 -- 172.21.15.17:0/4045450425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 msgr2=0x7fc4500c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc4570f9640 1 --2- 172.21.15.17:0/4045450425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4500c9f10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc45006ce30 tx=0x7fc44002b7b0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc4570f9640 1 -- 172.21.15.17:0/4045450425 shutdown_connections 2023-08-09T12:40:25.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc4570f9640 1 --2- 172.21.15.17:0/4045450425 >> v2:172.21.15.142:3300/0 conn(0x7fc450161660 0x7fc4500ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc4570f9640 1 --2- 172.21.15.17:0/4045450425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4500c9f10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.502+0000 7fc4570f9640 1 -- 172.21.15.17:0/4045450425 >> 172.21.15.17:0/4045450425 conn(0x7fc4500cb1b0 msgr2=0x7fc4500cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:25.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.503+0000 7fc4570f9640 1 -- 172.21.15.17:0/4045450425 shutdown_connections 2023-08-09T12:40:25.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.503+0000 7fc4570f9640 1 -- 172.21.15.17:0/4045450425 wait complete. 2023-08-09T12:40:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.504+0000 7fc4570f9640 1 Processor -- start 2023-08-09T12:40:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.505+0000 7fc4570f9640 1 -- start start 2023-08-09T12:40:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.505+0000 7fc4570f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4500ca450 0x7fc4501f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.505+0000 7fc4570f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4501f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc4570f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc450161660 0x7fc4500b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc4570f9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4501f3540 con 0x7fc450161280 2023-08-09T12:40:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc4570f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500b16d0 con 0x7fc4500ca450 2023-08-09T12:40:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc4570f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500b19b0 con 0x7fc450161660 2023-08-09T12:40:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc44ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4501f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc44ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4501f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52248/0 (socket says 172.21.15.17:52248) 2023-08-09T12:40:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc44ffff640 1 -- 172.21.15.17:0/3734249097 learned_addr learned my addr 172.21.15.17:0/3734249097 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc454e95640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4500ca450 0x7fc4501f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.506+0000 7fc455696640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc450161660 0x7fc4500b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44ffff640 1 -- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc450161660 msgr2=0x7fc4500b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44ffff640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc450161660 0x7fc4500b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44ffff640 1 -- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4500ca450 msgr2=0x7fc4501f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44ffff640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4500ca450 0x7fc4501f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44ffff640 1 -- 172.21.15.17:0/3734249097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc440009400 con 0x7fc450161280 2023-08-09T12:40:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc455696640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc450161660 0x7fc4500b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44ffff640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4501f1e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc444007ef0 tx=0x7fc44400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44d7fa640 1 -- 172.21.15.17:0/3734249097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444014620 con 0x7fc450161280 2023-08-09T12:40:25.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44d7fa640 1 -- 172.21.15.17:0/3734249097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400ee90 con 0x7fc450161280 2023-08-09T12:40:25.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc44d7fa640 1 -- 172.21.15.17:0/3734249097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440149c0 con 0x7fc450161280 2023-08-09T12:40:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4500b1c90 con 0x7fc450161280 2023-08-09T12:40:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.507+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4500b2250 con 0x7fc450161280 2023-08-09T12:40:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.509+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc450067a80 con 0x7fc450161280 2023-08-09T12:40:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.509+0000 7fc44d7fa640 1 -- 172.21.15.17:0/3734249097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc444014b20 con 0x7fc450161280 2023-08-09T12:40:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.510+0000 7fc44d7fa640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc43c06a050 0x7fc43c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.510+0000 7fc44d7fa640 1 -- 172.21.15.17:0/3734249097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc444088f20 con 0x7fc450161280 2023-08-09T12:40:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.511+0000 7fc454e95640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc43c06a050 0x7fc43c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.512+0000 7fc454e95640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc43c06a050 0x7fc43c06c510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc440035000 tx=0x7fc440008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.515+0000 7fc44d7fa640 1 -- 172.21.15.17:0/3734249097 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc444058060 con 0x7fc450161280 2023-08-09T12:40:25.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.716+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4500adc60 con 0x7fc450161280 2023-08-09T12:40:25.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.717+0000 7fc44d7fa640 1 -- 172.21.15.17:0/3734249097 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc444057bf0 con 0x7fc450161280 2023-08-09T12:40:25.721 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:40:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc43c06a050 msgr2=0x7fc43c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc43c06a050 0x7fc43c06c510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc440035000 tx=0x7fc440008030 comp rx=0 tx=0).stop 2023-08-09T12:40:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 msgr2=0x7fc4501f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4501f1e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc444007ef0 tx=0x7fc44400e4b0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 shutdown_connections 2023-08-09T12:40:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc43c06a050 0x7fc43c06c510 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc450161660 0x7fc4500b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc450161280 0x7fc4501f1e10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 --2- 172.21.15.17:0/3734249097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4500ca450 0x7fc4501f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 >> 172.21.15.17:0/3734249097 conn(0x7fc4500cb1b0 msgr2=0x7fc45015e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.720+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 shutdown_connections 2023-08-09T12:40:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.721+0000 7fc4570f9640 1 -- 172.21.15.17:0/3734249097 wait complete. 2023-08-09T12:40:25.743 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:40:25.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.972+0000 7f91dd967640 1 Processor -- start 2023-08-09T12:40:25.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.972+0000 7f91dd967640 1 -- start start 2023-08-09T12:40:25.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.973+0000 7f91dd967640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91d80b3fe0 0x7f91d80ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91dd967640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80697c0 0x7f91d8069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91dd967640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d806fe10 con 0x7f91d8159bd0 2023-08-09T12:40:25.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91dd967640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d80b11a0 con 0x7f91d80b3fe0 2023-08-09T12:40:25.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91dd967640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d806a190 con 0x7f91d80697c0 2023-08-09T12:40:25.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91dc965640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f91d8159bd0 0x7f91d8070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39948/0 (socket says 172.21.15.17:39948) 2023-08-09T12:40:25.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91dc965640 1 -- 172.21.15.17:0/2054007153 learned_addr learned my addr 172.21.15.17:0/2054007153 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:25.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91cffff640 1 --2- 172.21.15.17:0/2054007153 >> v2:172.21.15.142:3300/0 conn(0x7f91d80b3fe0 0x7f91d80ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159812998 0 0) 0x7f91d806fe10 con 0x7f91d8159bd0 2023-08-09T12:40:25.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c0003520 con 0x7f91d8159bd0 2023-08-09T12:40:25.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.974+0000 7f91dd166640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80697c0 0x7f91d8069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4276658188 0 0) 0x7f91c0003520 con 0x7f91d8159bd0 2023-08-09T12:40:25.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80697c0 msgr2=0x7f91d8069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:25.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80697c0 0x7f91d8069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 >> v2:172.21.15.142:3300/0 conn(0x7f91d80b3fe0 msgr2=0x7f91d80ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:25.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 --2- 172.21.15.17:0/2054007153 >> v2:172.21.15.142:3300/0 conn(0x7f91d80b3fe0 0x7f91d80ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8159fb0 con 0x7f91d8159bd0 2023-08-09T12:40:25.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f91d40019f0 con 0x7f91d8159bd0 2023-08-09T12:40:25.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 >> v1:172.21.15.17:6789/0 conn(0x7f91d8159bd0 legacy=0x7f91d8070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80697c0 0x7f91c0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c0003ef0 0x7f91c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80b11a0 con 0x7f91c0004d00 2023-08-09T12:40:25.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d806a190 con 0x7f91c0003ef0 2023-08-09T12:40:25.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c000dc90 con 0x7f91d80697c0 2023-08-09T12:40:25.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.975+0000 7f91dd166640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.976+0000 7f91dc965640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80697c0 0x7f91c0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.976+0000 7f91cffff640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c0003ef0 0x7f91c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.976+0000 7f91dd166640 1 -- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80697c0 msgr2=0x7f91c0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:25.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.976+0000 7f91dd166640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80697c0 0x7f91c0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.976+0000 7f91dd166640 1 -- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c0003ef0 msgr2=0x7f91c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:25.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.976+0000 7f91dd166640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91c0003ef0 0x7f91c00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.976+0000 7f91dd166640 1 -- 172.21.15.17:0/2054007153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0003520 con 0x7f91c0004d00 2023-08-09T12:40:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.977+0000 7f91dd166640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91c0005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f91d000ba60 tx=0x7f91c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d897bba6c0e621ef server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.977+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0032630 con 0x7f91c0004d00 2023-08-09T12:40:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.977+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0032790 con 0x7f91c0004d00 2023-08-09T12:40:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.977+0000 7f91cf7fe640 1 -- 172.21.15.17:0/2054007153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0032b20 con 0x7f91c0004d00 2023-08-09T12:40:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.978+0000 7f91dd967640 1 -- 172.21.15.17:0/2054007153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 msgr2=0x7f91c0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.978+0000 7f91dd967640 1 --2- 172.21.15.17:0/2054007153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91c0005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f91d000ba60 tx=0x7f91c00057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.978+0000 7f91dd166640 1 -- 172.21.15.17:0/2054007153 reap_dead start 2023-08-09T12:40:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.978+0000 7f91dd967640 1 -- 172.21.15.17:0/2054007153 shutdown_connections 2023-08-09T12:40:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.978+0000 7f91dd967640 1 -- 172.21.15.17:0/2054007153 >> 172.21.15.17:0/2054007153 conn(0x7f91d80b1d50 msgr2=0x7f91d806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.978+0000 7f91dd967640 1 -- 172.21.15.17:0/2054007153 shutdown_connections 2023-08-09T12:40:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.978+0000 7f91dd967640 1 -- 172.21.15.17:0/2054007153 wait complete. 2023-08-09T12:40:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.980+0000 7f91dd967640 1 Processor -- start 2023-08-09T12:40:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.980+0000 7f91dd967640 1 -- start start 2023-08-09T12:40:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.981+0000 7f91dd967640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91d80c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.981+0000 7f91dd967640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d81f2b80 0x7f91d8156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.981+0000 7f91dd967640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80ce600 0x7f91d80cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.981+0000 7f91dd967640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80cefc0 con 0x7f91c0004d00 2023-08-09T12:40:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.981+0000 7f91dd967640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80c4c90 con 0x7f91d81f2b80 2023-08-09T12:40:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.981+0000 7f91dd967640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80c42c0 con 0x7f91d80ce600 2023-08-09T12:40:25.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91d80c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91d80c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52280/0 (socket says 172.21.15.17:52280) 2023-08-09T12:40:25.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 -- 172.21.15.17:0/2790414648 learned_addr learned my addr 172.21.15.17:0/2790414648 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:25.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dd166640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80ce600 0x7f91d80cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 -- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80ce600 msgr2=0x7f91d80cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91cffff640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d81f2b80 0x7f91d8156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80ce600 0x7f91d80cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 -- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d81f2b80 msgr2=0x7f91d8156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:25.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d81f2b80 0x7f91d8156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:25.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 -- 172.21.15.17:0/2790414648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d80c36b0 con 0x7f91c0004d00 2023-08-09T12:40:25.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91cffff640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d81f2b80 0x7f91d8156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:25.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.982+0000 7f91dc965640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91d80c4750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f91d40079f0 tx=0x7f91d400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.983+0000 7f91cd7fa640 1 -- 172.21.15.17:0/2790414648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d40133f0 con 0x7f91c0004d00 2023-08-09T12:40:25.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.983+0000 7f91cd7fa640 1 -- 172.21.15.17:0/2790414648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4013550 con 0x7f91c0004d00 2023-08-09T12:40:25.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.983+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d80c3990 con 0x7f91c0004d00 2023-08-09T12:40:25.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.983+0000 7f91cd7fa640 1 -- 172.21.15.17:0/2790414648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4013900 con 0x7f91c0004d00 2023-08-09T12:40:25.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.983+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d80c3f50 con 0x7f91c0004d00 2023-08-09T12:40:25.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.984+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d80c4110 con 0x7f91c0004d00 2023-08-09T12:40:25.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.985+0000 7f91cd7fa640 1 -- 172.21.15.17:0/2790414648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91d4013c70 con 0x7f91c0004d00 2023-08-09T12:40:25.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.986+0000 7f91cd7fa640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c406a080 0x7f91c406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:25.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.986+0000 7f91cd7fa640 1 -- 172.21.15.17:0/2790414648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f91d4089520 con 0x7f91c0004d00 2023-08-09T12:40:25.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.987+0000 7f91cffff640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c406a080 0x7f91c406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.988+0000 7f91cffff640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c406a080 0x7f91c406c540 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91d81595c0 tx=0x7f91c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:25.990+0000 7f91cd7fa640 1 -- 172.21.15.17:0/2790414648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f91d4054b30 con 0x7f91c0004d00 2023-08-09T12:40:26.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.222+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91d8159fb0 con 0x7f91c0004d00 2023-08-09T12:40:26.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.223+0000 7f91cd7fa640 1 -- 172.21.15.17:0/2790414648 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4872 (secure 0 0 0) 0x7f91d8159fb0 con 0x7f91c0004d00 2023-08-09T12:40:26.227 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:26.227 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:39:25.114229+0000","modified":"2023-08-09T12:39:28.660973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T12:40:26.228 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-08-09T12:40:26.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c406a080 msgr2=0x7f91c406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c406a080 0x7f91c406c540 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91d81595c0 tx=0x7f91c8008040 comp rx=0 tx=0).stop 2023-08-09T12:40:26.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 msgr2=0x7f91d80c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91d80c4750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f91d40079f0 tx=0x7f91d400a730 comp rx=0 tx=0).stop 2023-08-09T12:40:26.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 shutdown_connections 2023-08-09T12:40:26.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c406a080 0x7f91c406c540 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d80ce600 0x7f91d80cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d81f2b80 0x7f91d8156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 --2- 172.21.15.17:0/2790414648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0004d00 0x7f91d80c4750 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 >> 172.21.15.17:0/2790414648 conn(0x7f91d80b1d50 msgr2=0x7f91d8158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:26.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.226+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 shutdown_connections 2023-08-09T12:40:26.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.227+0000 7f91dd967640 1 -- 172.21.15.17:0/2790414648 wait complete. 2023-08-09T12:40:26.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.475+0000 7ff7de021640 1 Processor -- start 2023-08-09T12:40:26.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.475+0000 7ff7de021640 1 -- start start 2023-08-09T12:40:26.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.477+0000 7ff7de021640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d81587e0 0x7ff7d8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.477+0000 7ff7de021640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7d80cb070 0x7ff7d80cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.477+0000 7ff7de021640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d815beb0 con 0x7ff7d80b0b10 2023-08-09T12:40:26.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.477+0000 7ff7de021640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d80cba40 con 0x7ff7d80cb070 2023-08-09T12:40:26.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.477+0000 7ff7de021640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80715c0 con 0x7ff7d81587e0 2023-08-09T12:40:26.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.478+0000 7ff7dc81e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff7d80b0b10 0x7ff7d815b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39950/0 (socket says 172.21.15.17:39950) 2023-08-09T12:40:26.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.478+0000 7ff7dc81e640 1 -- 172.21.15.17:0/938845735 learned_addr learned my addr 172.21.15.17:0/938845735 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:26.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.478+0000 7ff7dd01f640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d81587e0 0x7ff7d8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.478+0000 7ff7dd820640 1 --2- 172.21.15.17:0/938845735 >> v2:172.21.15.142:3300/0 conn(0x7ff7d80cb070 0x7ff7d80cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.478+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378242488 0 0) 0x7ff7d815beb0 con 0x7ff7d80b0b10 2023-08-09T12:40:26.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.478+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c4003520 con 0x7ff7d80b0b10 2023-08-09T12:40:26.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083721874 0 0) 0x7ff7c4003520 con 0x7ff7d80b0b10 2023-08-09T12:40:26.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d81587e0 msgr2=0x7ff7d8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:26.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d81587e0 0x7ff7d8070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 >> v2:172.21.15.142:3300/0 conn(0x7ff7d80cb070 msgr2=0x7ff7d80cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:26.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 --2- 172.21.15.17:0/938845735 >> v2:172.21.15.142:3300/0 conn(0x7ff7d80cb070 0x7ff7d80cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80718a0 con 0x7ff7d80b0b10 2023-08-09T12:40:26.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff7c8001670 con 0x7ff7d80b0b10 2023-08-09T12:40:26.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 >> v1:172.21.15.17:6789/0 conn(0x7ff7d80b0b10 legacy=0x7ff7d815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40047c0 0x7ff7c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d81587e0 0x7ff7c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80cba40 con 0x7ff7c4003970 2023-08-09T12:40:26.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80715c0 con 0x7ff7c40047c0 2023-08-09T12:40:26.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c400b980 con 0x7ff7d81587e0 2023-08-09T12:40:26.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7dd01f640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7dc81e640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40047c0 0x7ff7c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.479+0000 7ff7dd820640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d81587e0 0x7ff7c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.480+0000 7ff7dd01f640 1 -- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d81587e0 msgr2=0x7ff7c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:26.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.480+0000 7ff7dd01f640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d81587e0 0x7ff7c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.480+0000 7ff7dd01f640 1 -- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40047c0 msgr2=0x7ff7c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:26.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.480+0000 7ff7dd01f640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40047c0 0x7ff7c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.480+0000 7ff7dd01f640 1 -- 172.21.15.17:0/938845735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4003520 con 0x7ff7c4003970 2023-08-09T12:40:26.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.480+0000 7ff7dc81e640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7c40047c0 0x7ff7c4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:26.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.481+0000 7ff7dd01f640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7c4003d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009ac0 tx=0x7ff7c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdef7a08f2aeb19e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:26.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.481+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d402c6b0 con 0x7ff7c4003970 2023-08-09T12:40:26.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.481+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d402c810 con 0x7ff7c4003970 2023-08-09T12:40:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.481+0000 7ff7cffff640 1 -- 172.21.15.17:0/938845735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d402cba0 con 0x7ff7c4003970 2023-08-09T12:40:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.482+0000 7ff7de021640 1 -- 172.21.15.17:0/938845735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 msgr2=0x7ff7c4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.482+0000 7ff7de021640 1 --2- 172.21.15.17:0/938845735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7c4003d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009ac0 tx=0x7ff7c40057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.482+0000 7ff7dd820640 1 -- 172.21.15.17:0/938845735 reap_dead start 2023-08-09T12:40:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.482+0000 7ff7de021640 1 -- 172.21.15.17:0/938845735 shutdown_connections 2023-08-09T12:40:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.482+0000 7ff7de021640 1 -- 172.21.15.17:0/938845735 >> 172.21.15.17:0/938845735 conn(0x7ff7d80b1d50 msgr2=0x7ff7d806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.482+0000 7ff7de021640 1 -- 172.21.15.17:0/938845735 shutdown_connections 2023-08-09T12:40:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.482+0000 7ff7de021640 1 -- 172.21.15.17:0/938845735 wait complete. 2023-08-09T12:40:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.484+0000 7ff7de021640 1 Processor -- start 2023-08-09T12:40:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.484+0000 7ff7de021640 1 -- start start 2023-08-09T12:40:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.485+0000 7ff7de021640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7d815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.485+0000 7ff7de021640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d80c2d30 0x7ff7d815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.485+0000 7ff7de021640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d8148dc0 0x7ff7d8149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.485+0000 7ff7de021640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d814a260 con 0x7ff7c4003970 2023-08-09T12:40:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.485+0000 7ff7de021640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8149ca0 con 0x7ff7d80c2d30 2023-08-09T12:40:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.485+0000 7ff7de021640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8149f80 con 0x7ff7d8148dc0 2023-08-09T12:40:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.485+0000 7ff7dd01f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7d815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd01f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7d815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52298/0 (socket says 172.21.15.17:52298) 2023-08-09T12:40:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd01f640 1 -- 172.21.15.17:0/2857232288 learned_addr learned my addr 172.21.15.17:0/2857232288 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dc81e640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d80c2d30 0x7ff7d815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd820640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d8148dc0 0x7ff7d8149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd01f640 1 -- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d8148dc0 msgr2=0x7ff7d8149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd01f640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d8148dc0 0x7ff7d8149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd01f640 1 -- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d80c2d30 msgr2=0x7ff7d815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd01f640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d80c2d30 0x7ff7d815d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd01f640 1 -- 172.21.15.17:0/2857232288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8159410 con 0x7ff7c4003970 2023-08-09T12:40:26.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd820640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d8148dc0 0x7ff7d8149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:26.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.486+0000 7ff7dd01f640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7d815cfe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009ac0 tx=0x7ff7d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:26.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.487+0000 7ff7cdffb640 1 -- 172.21.15.17:0/2857232288 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4003810 con 0x7ff7c4003970 2023-08-09T12:40:26.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.487+0000 7ff7cdffb640 1 -- 172.21.15.17:0/2857232288 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d4003970 con 0x7ff7c4003970 2023-08-09T12:40:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.487+0000 7ff7cdffb640 1 -- 172.21.15.17:0/2857232288 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4003d00 con 0x7ff7c4003970 2023-08-09T12:40:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.487+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d81596f0 con 0x7ff7c4003970 2023-08-09T12:40:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.487+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d8149780 con 0x7ff7c4003970 2023-08-09T12:40:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.488+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d8159270 con 0x7ff7c4003970 2023-08-09T12:40:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.489+0000 7ff7cdffb640 1 -- 172.21.15.17:0/2857232288 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff7d4040450 con 0x7ff7c4003970 2023-08-09T12:40:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.490+0000 7ff7cdffb640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff7bc06a080 0x7ff7bc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.490+0000 7ff7cdffb640 1 -- 172.21.15.17:0/2857232288 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff7d40aa550 con 0x7ff7c4003970 2023-08-09T12:40:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.491+0000 7ff7dc81e640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff7bc06a080 0x7ff7bc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.492+0000 7ff7dc81e640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff7bc06a080 0x7ff7bc06c540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000ff0 tx=0x7ff7c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.495+0000 7ff7cdffb640 1 -- 172.21.15.17:0/2857232288 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff7d8159270 con 0x7ff7c4003970 2023-08-09T12:40:26.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.688+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7d8159270 con 0x7ff7c4003970 2023-08-09T12:40:26.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.691+0000 7ff7cdffb640 1 -- 172.21.15.17:0/2857232288 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18351 (secure 0 0 0) 0x7ff7d8159270 con 0x7ff7c4003970 2023-08-09T12:40:26.695 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:26.696 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:09.763656+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff7bc06a080 msgr2=0x7ff7bc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff7bc06a080 0x7ff7bc06c540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000ff0 tx=0x7ff7c8009040 comp rx=0 tx=0).stop 2023-08-09T12:40:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 msgr2=0x7ff7d815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7d815cfe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009ac0 tx=0x7ff7d4004730 comp rx=0 tx=0).stop 2023-08-09T12:40:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 shutdown_connections 2023-08-09T12:40:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff7bc06a080 0x7ff7bc06c540 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7d8148dc0 0x7ff7d8149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7d80c2d30 0x7ff7d815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 --2- 172.21.15.17:0/2857232288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c4003970 0x7ff7d815cfe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 >> 172.21.15.17:0/2857232288 conn(0x7ff7d80b1d50 msgr2=0x7ff7d80b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.694+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 shutdown_connections 2023-08-09T12:40:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.695+0000 7ff7de021640 1 -- 172.21.15.17:0/2857232288 wait complete. 2023-08-09T12:40:26.717 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:40:26.717 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:40:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.938+0000 7f4fb0048640 1 Processor -- start 2023-08-09T12:40:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.938+0000 7f4fb0048640 1 -- start start 2023-08-09T12:40:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fb0048640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4fa80b3b40 0x7f4fa80b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fb0048640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80cc630 0x7f4fa80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fb0048640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa806c990 con 0x7f4fa80adc40 2023-08-09T12:40:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fb0048640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa80ae020 con 0x7f4fa80b3b40 2023-08-09T12:40:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fb0048640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80b2250 con 0x7f4fa80cc630 2023-08-09T12:40:26.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fadde4640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4fa80adc40 0x7f4fa806c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39964/0 (socket says 172.21.15.17:39964) 2023-08-09T12:40:26.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fadde4640 1 -- 172.21.15.17:0/1544015695 learned_addr learned my addr 172.21.15.17:0/1544015695 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:26.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fad5e3640 1 --2- 172.21.15.17:0/1544015695 >> v2:172.21.15.142:3300/0 conn(0x7f4fa80b3b40 0x7f4fa80b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.940+0000 7f4fae5e5640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80cc630 0x7f4fa80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660370235 0 0) 0x7f4fa806c990 con 0x7f4fa80adc40 2023-08-09T12:40:26.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f94003520 con 0x7f4fa80adc40 2023-08-09T12:40:26.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2896365881 0 0) 0x7f4f94003520 con 0x7f4fa80adc40 2023-08-09T12:40:26.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80cc630 msgr2=0x7f4fa80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:26.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80cc630 0x7f4fa80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 >> v2:172.21.15.142:3300/0 conn(0x7f4fa80b3b40 msgr2=0x7f4fa80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 --2- 172.21.15.17:0/1544015695 >> v2:172.21.15.142:3300/0 conn(0x7f4fa80b3b40 0x7f4fa80b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa80b2530 con 0x7f4fa80adc40 2023-08-09T12:40:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f4fa4001670 con 0x7f4fa80adc40 2023-08-09T12:40:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 >> v1:172.21.15.17:6789/0 conn(0x7f4fa80adc40 legacy=0x7f4fa806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f94003970 0x7f4f94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f94004360 0x7f4f94004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94004eb0 0x7f4f9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80ae020 con 0x7f4f94004eb0 2023-08-09T12:40:26.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80b2250 con 0x7f4f94004360 2023-08-09T12:40:26.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9400bec0 con 0x7f4f94003970 2023-08-09T12:40:26.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.941+0000 7f4fad5e3640 1 --2- 172.21.15.17:0/1544015695 >> v2:172.21.15.142:3300/0 conn(0x7f4fa80b3b40 0x7f4fa80b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:40:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.942+0000 7f4fae5e5640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94004eb0 0x7f4f9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.942+0000 7f4fadde4640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f94003970 0x7f4f94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.942+0000 7f4fae5e5640 1 -- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f94003970 msgr2=0x7f4f94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.942+0000 7f4fae5e5640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f94003970 0x7f4f94003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.942+0000 7f4fae5e5640 1 -- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f94004360 msgr2=0x7f4f94004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.942+0000 7f4fae5e5640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f94004360 0x7f4f94004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.942+0000 7f4fae5e5640 1 -- 172.21.15.17:0/1544015695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94003520 con 0x7f4f94004eb0 2023-08-09T12:40:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.943+0000 7f4fae5e5640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94004eb0 0x7f4f9400b980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80cca10 tx=0x7f4f940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38c1c1178dfc682 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa002cb70 con 0x7f4f94004eb0 2023-08-09T12:40:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000f040 con 0x7f4f94004eb0 2023-08-09T12:40:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4facde2640 1 -- 172.21.15.17:0/1544015695 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0034440 con 0x7f4f94004eb0 2023-08-09T12:40:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4fb0048640 1 -- 172.21.15.17:0/1544015695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94004eb0 msgr2=0x7f4f9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4fb0048640 1 --2- 172.21.15.17:0/1544015695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94004eb0 0x7f4f9400b980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80cca10 tx=0x7f4f940057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4fae5e5640 1 -- 172.21.15.17:0/1544015695 reap_dead start 2023-08-09T12:40:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4fb0048640 1 -- 172.21.15.17:0/1544015695 shutdown_connections 2023-08-09T12:40:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4fb0048640 1 -- 172.21.15.17:0/1544015695 >> 172.21.15.17:0/1544015695 conn(0x7f4fa80cb1b0 msgr2=0x7f4fa80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4fb0048640 1 -- 172.21.15.17:0/1544015695 shutdown_connections 2023-08-09T12:40:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.944+0000 7f4fb0048640 1 -- 172.21.15.17:0/1544015695 wait complete. 2023-08-09T12:40:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.946+0000 7f4fb0048640 1 Processor -- start 2023-08-09T12:40:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.946+0000 7f4fb0048640 1 -- start start 2023-08-09T12:40:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.947+0000 7f4fb0048640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f94004eb0 0x7f4fa814c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.947+0000 7f4fb0048640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fa814bc10 0x7f4fa80c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.947+0000 7f4fb0048640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80c6d00 0x7f4fa80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.947+0000 7f4fb0048640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80c7fb0 con 0x7f4fa814bc10 2023-08-09T12:40:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.947+0000 7f4fb0048640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa814c090 con 0x7f4f94004eb0 2023-08-09T12:40:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.947+0000 7f4fb0048640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80c7330 con 0x7f4fa80c6d00 2023-08-09T12:40:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fad5e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fa814bc10 0x7f4fa80c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fad5e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fa814bc10 0x7f4fa80c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52318/0 (socket says 172.21.15.17:52318) 2023-08-09T12:40:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fad5e3640 1 -- 172.21.15.17:0/249513213 learned_addr learned my addr 172.21.15.17:0/249513213 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fadde4640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f94004eb0 0x7f4fa814c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fae5e5640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80c6d00 0x7f4fa80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fad5e3640 1 -- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80c6d00 msgr2=0x7f4fa80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fad5e3640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80c6d00 0x7f4fa80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fad5e3640 1 -- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f94004eb0 msgr2=0x7f4fa814c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fad5e3640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f94004eb0 0x7f4fa814c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.948+0000 7f4fad5e3640 1 -- 172.21.15.17:0/249513213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa80c7610 con 0x7f4fa814bc10 2023-08-09T12:40:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.949+0000 7f4fad5e3640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fa814bc10 0x7f4fa80c67c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800e930 tx=0x7f4f9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.949+0000 7f4f9e7fc640 1 -- 172.21.15.17:0/249513213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980096b0 con 0x7f4fa814bc10 2023-08-09T12:40:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.949+0000 7f4f9e7fc640 1 -- 172.21.15.17:0/249513213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9800c9a0 con 0x7f4fa814bc10 2023-08-09T12:40:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.949+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa80c78f0 con 0x7f4fa814bc10 2023-08-09T12:40:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.949+0000 7f4f9e7fc640 1 -- 172.21.15.17:0/249513213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800cd30 con 0x7f4fa814bc10 2023-08-09T12:40:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.949+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa80c9870 con 0x7f4fa814bc10 2023-08-09T12:40:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.950+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa80c80f0 con 0x7f4fa814bc10 2023-08-09T12:40:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.951+0000 7f4f9e7fc640 1 -- 172.21.15.17:0/249513213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f98013470 con 0x7f4fa814bc10 2023-08-09T12:40:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.952+0000 7f4f9e7fc640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f8c06a050 0x7f4f8c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.952+0000 7f4f9e7fc640 1 -- 172.21.15.17:0/249513213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4f98088bc0 con 0x7f4fa814bc10 2023-08-09T12:40:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.953+0000 7f4fadde4640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f8c06a050 0x7f4f8c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.954+0000 7f4fadde4640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f8c06a050 0x7f4f8c06c510 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40017a0 tx=0x7f4fa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:26.957+0000 7f4f9e7fc640 1 -- 172.21.15.17:0/249513213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4fa80c80f0 con 0x7f4fa814bc10 2023-08-09T12:40:27.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.186+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fa80c70e0 con 0x7f4fa814bc10 2023-08-09T12:40:27.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.187+0000 7f4f9e7fc640 1 -- 172.21.15.17:0/249513213 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4872 (secure 0 0 0) 0x7f4f98054260 con 0x7f4fa814bc10 2023-08-09T12:40:27.190 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:27.191 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:39:25.114229+0000","modified":"2023-08-09T12:39:28.660973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T12:40:27.191 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-08-09T12:40:27.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.189+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f8c06a050 msgr2=0x7f4f8c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.189+0000 7f4fb0048640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f8c06a050 0x7f4f8c06c510 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40017a0 tx=0x7f4fa4009040 comp rx=0 tx=0).stop 2023-08-09T12:40:27.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.189+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fa814bc10 msgr2=0x7f4fa80c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.189+0000 7f4fb0048640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fa814bc10 0x7f4fa80c67c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800e930 tx=0x7f4f9800edf0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.190+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 shutdown_connections 2023-08-09T12:40:27.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.190+0000 7f4fb0048640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f8c06a050 0x7f4f8c06c510 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.190+0000 7f4fb0048640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fa80c6d00 0x7f4fa80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.190+0000 7f4fb0048640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fa814bc10 0x7f4fa80c67c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.190+0000 7f4fb0048640 1 --2- 172.21.15.17:0/249513213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f94004eb0 0x7f4fa814c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.190+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 >> 172.21.15.17:0/249513213 conn(0x7f4fa80cb1b0 msgr2=0x7f4fa806f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:27.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.190+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 shutdown_connections 2023-08-09T12:40:27.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.190+0000 7f4fb0048640 1 -- 172.21.15.17:0/249513213 wait complete. 2023-08-09T12:40:27.212 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:40:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.436+0000 7f855a364640 1 Processor -- start 2023-08-09T12:40:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.436+0000 7f855a364640 1 -- start start 2023-08-09T12:40:27.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.437+0000 7f855a364640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85541616e0 0x7f85540b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.437+0000 7f855a364640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540cdd10 con 0x7f85540d29d0 2023-08-09T12:40:27.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.437+0000 7f855a364640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540cdff0 con 0x7f855415ce90 2023-08-09T12:40:27.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.438+0000 7f855a364640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540b6540 con 0x7f85541616e0 2023-08-09T12:40:27.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.438+0000 7f8558901640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f85540d29d0 0x7f85540d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39968/0 (socket says 172.21.15.17:39968) 2023-08-09T12:40:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.438+0000 7f8558901640 1 -- 172.21.15.17:0/3415012749 learned_addr learned my addr 172.21.15.17:0/3415012749 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.438+0000 7f854b7fe640 1 --2- 172.21.15.17:0/3415012749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85541616e0 0x7f85540b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.438+0000 7f85537fe640 1 -- 172.21.15.17:0/3415012749 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815203633 0 0) 0x7f85540cdd10 con 0x7f85540d29d0 2023-08-09T12:40:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.439+0000 7f85537fe640 1 -- 172.21.15.17:0/3415012749 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8540003520 con 0x7f85540d29d0 2023-08-09T12:40:27.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.439+0000 7f85537fe640 1 -- 172.21.15.17:0/3415012749 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3863473123 0 0) 0x7f8540003520 con 0x7f85540d29d0 2023-08-09T12:40:27.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.439+0000 7f854b7fe640 1 -- 172.21.15.17:0/3415012749 >> v1:172.21.15.142:6789/0 conn(0x7f855415ce90 legacy=0x7f85540cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.439+0000 7f854b7fe640 1 -- 172.21.15.17:0/3415012749 >> v1:172.21.15.17:6789/0 conn(0x7f85540d29d0 legacy=0x7f85540d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.439+0000 7f854b7fe640 1 -- 172.21.15.17:0/3415012749 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540ce2d0 con 0x7f85541616e0 2023-08-09T12:40:27.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.440+0000 7f854b7fe640 1 --2- 172.21.15.17:0/3415012749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85541616e0 0x7f85540b6000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f853c0097d0 tx=0x7f853c02b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fc4016d7b63d463 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:27.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.441+0000 7f85537fe640 1 -- 172.21.15.17:0/3415012749 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c001670 con 0x7f85541616e0 2023-08-09T12:40:27.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.441+0000 7f85537fe640 1 -- 172.21.15.17:0/3415012749 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c02e050 con 0x7f85541616e0 2023-08-09T12:40:27.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.441+0000 7f85537fe640 1 -- 172.21.15.17:0/3415012749 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c030730 con 0x7f85541616e0 2023-08-09T12:40:27.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.442+0000 7f855a364640 1 -- 172.21.15.17:0/3415012749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85541616e0 msgr2=0x7f85540b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.442+0000 7f855a364640 1 --2- 172.21.15.17:0/3415012749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85541616e0 0x7f85540b6000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f853c0097d0 tx=0x7f853c02b660 comp rx=0 tx=0).stop 2023-08-09T12:40:27.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.442+0000 7f855a364640 1 -- 172.21.15.17:0/3415012749 shutdown_connections 2023-08-09T12:40:27.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.442+0000 7f855a364640 1 --2- 172.21.15.17:0/3415012749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85541616e0 0x7f85540b6000 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.442+0000 7f855a364640 1 -- 172.21.15.17:0/3415012749 >> 172.21.15.17:0/3415012749 conn(0x7f855406fde0 msgr2=0x7f85540701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:27.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.442+0000 7f855a364640 1 -- 172.21.15.17:0/3415012749 shutdown_connections 2023-08-09T12:40:27.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.442+0000 7f855a364640 1 -- 172.21.15.17:0/3415012749 wait complete. 2023-08-09T12:40:27.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.444+0000 7f855a364640 1 Processor -- start 2023-08-09T12:40:27.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.444+0000 7f855a364640 1 -- start start 2023-08-09T12:40:27.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.445+0000 7f855a364640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85540d29d0 0x7f8554151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.445+0000 7f855a364640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f855415ce90 0x7f85540b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.445+0000 7f855a364640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85541616e0 0x7f85540b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.445+0000 7f855a364640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855415e1f0 con 0x7f855415ce90 2023-08-09T12:40:27.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.445+0000 7f855a364640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855415e680 con 0x7f85541616e0 2023-08-09T12:40:27.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.445+0000 7f855a364640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855415d5e0 con 0x7f85540d29d0 2023-08-09T12:40:27.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.445+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f855415ce90 0x7f85540b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f855415ce90 0x7f85540b76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52332/0 (socket says 172.21.15.17:52332) 2023-08-09T12:40:27.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f854b7fe640 1 -- 172.21.15.17:0/947098849 learned_addr learned my addr 172.21.15.17:0/947098849 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:27.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f8553fff640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85540d29d0 0x7f8554151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f8558901640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85541616e0 0x7f85540b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f854b7fe640 1 -- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85540d29d0 msgr2=0x7f8554151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f854b7fe640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85540d29d0 0x7f8554151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f854b7fe640 1 -- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85541616e0 msgr2=0x7f85540b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f854b7fe640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85541616e0 0x7f85540b7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f854b7fe640 1 -- 172.21.15.17:0/947098849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c009400 con 0x7f855415ce90 2023-08-09T12:40:27.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.446+0000 7f854b7fe640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f855415ce90 0x7f85540b76d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f853c0097d0 tx=0x7f853c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:27.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.447+0000 7f85517fa640 1 -- 172.21.15.17:0/947098849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c03d950 con 0x7f855415ce90 2023-08-09T12:40:27.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.447+0000 7f85517fa640 1 -- 172.21.15.17:0/947098849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c03dab0 con 0x7f855415ce90 2023-08-09T12:40:27.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.447+0000 7f85517fa640 1 -- 172.21.15.17:0/947098849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c03de60 con 0x7f855415ce90 2023-08-09T12:40:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.447+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855415d8c0 con 0x7f855415ce90 2023-08-09T12:40:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.447+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855415de80 con 0x7f855415ce90 2023-08-09T12:40:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.448+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8554067400 con 0x7f855415ce90 2023-08-09T12:40:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.449+0000 7f85517fa640 1 -- 172.21.15.17:0/947098849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f853c039040 con 0x7f855415ce90 2023-08-09T12:40:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.450+0000 7f85517fa640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f853406a080 0x7f853406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.450+0000 7f85517fa640 1 -- 172.21.15.17:0/947098849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f853c0aa6c0 con 0x7f855415ce90 2023-08-09T12:40:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.451+0000 7f8553fff640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f853406a080 0x7f853406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.452+0000 7f8553fff640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f853406a080 0x7f853406c540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8544007fd0 tx=0x7f8544009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.456+0000 7f85517fa640 1 -- 172.21.15.17:0/947098849 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f853c075cd0 con 0x7f855415ce90 2023-08-09T12:40:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.687+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8554067a80 con 0x7f855415ce90 2023-08-09T12:40:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.688+0000 7f85517fa640 1 -- 172.21.15.17:0/947098849 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4872 (secure 0 0 0) 0x7f853c0792f0 con 0x7f855415ce90 2023-08-09T12:40:27.691 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:27.692 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3819870715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3819870715},{"type":"v1","addr":"172.21.15.142:6836","nonce":3819870715}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/209723410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":209723410},{"type":"v1","addr":"172.21.15.142:6837","nonce":209723410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/4086680999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4086680999},{"type":"v1","addr":"172.21.15.17:6833","nonce":4086680999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:39:25.114229+0000","modified":"2023-08-09T12:39:28.660973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2079787239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2079787239},{"type":"v1","addr":"172.21.15.17:6835","nonce":2079787239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-09T12:40:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-08-09T12:40:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.690+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f853406a080 msgr2=0x7f853406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.690+0000 7f855a364640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f853406a080 0x7f853406c540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8544007fd0 tx=0x7f8544009040 comp rx=0 tx=0).stop 2023-08-09T12:40:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.690+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f855415ce90 msgr2=0x7f85540b76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.690+0000 7f855a364640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f855415ce90 0x7f85540b76d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f853c0097d0 tx=0x7f853c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.691+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 shutdown_connections 2023-08-09T12:40:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.691+0000 7f855a364640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f853406a080 0x7f853406c540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.691+0000 7f855a364640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85541616e0 0x7f85540b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.691+0000 7f855a364640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f855415ce90 0x7f85540b76d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.691+0000 7f855a364640 1 --2- 172.21.15.17:0/947098849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85540d29d0 0x7f8554151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.691+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 >> 172.21.15.17:0/947098849 conn(0x7f855406fde0 msgr2=0x7f855415abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.691+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 shutdown_connections 2023-08-09T12:40:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.691+0000 7f855a364640 1 -- 172.21.15.17:0/947098849 wait complete. 2023-08-09T12:40:27.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:27.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.923+0000 7f61bb59e640 1 Processor -- start 2023-08-09T12:40:27.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.924+0000 7f61bb59e640 1 -- start start 2023-08-09T12:40:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.925+0000 7f61bb59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61bc1601f0 0x7f61bc0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.925+0000 7f61bb59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61bc0b2ee0 0x7f61bc0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.925+0000 7f61bb59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc0c3250 con 0x7f61bc0cb440 2023-08-09T12:40:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.925+0000 7f61bb59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc0b4120 con 0x7f61bc1601f0 2023-08-09T12:40:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.925+0000 7f61bb59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc0cb850 con 0x7f61bc0b2ee0 2023-08-09T12:40:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61ba59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61bc1601f0 0x7f61bc0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61bad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f61bc0cb440 0x7f61bc0697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49334/0 (socket says 172.21.15.17:49334) 2023-08-09T12:40:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61bad9d640 1 -- 172.21.15.17:0/3344775043 learned_addr learned my addr 172.21.15.17:0/3344775043 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61b3fff640 1 --2- 172.21.15.17:0/3344775043 >> v2:172.21.15.142:3300/0 conn(0x7f61bc0b2ee0 0x7f61bc0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61b9d9b640 1 -- 172.21.15.17:0/3344775043 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558416413 0 0) 0x7f61bc0c3250 con 0x7f61bc0cb440 2023-08-09T12:40:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61b9d9b640 1 -- 172.21.15.17:0/3344775043 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61a8003520 con 0x7f61bc0cb440 2023-08-09T12:40:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61ba59c640 1 -- 172.21.15.17:0/3344775043 >> v2:172.21.15.142:3300/0 conn(0x7f61bc0b2ee0 msgr2=0x7f61bc0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61ba59c640 1 --2- 172.21.15.17:0/3344775043 >> v2:172.21.15.142:3300/0 conn(0x7f61bc0b2ee0 0x7f61bc0caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61ba59c640 1 -- 172.21.15.17:0/3344775043 >> v1:172.21.15.17:6789/0 conn(0x7f61bc0cb440 legacy=0x7f61bc0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.926+0000 7f61ba59c640 1 -- 172.21.15.17:0/3344775043 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc0b34a0 con 0x7f61bc1601f0 2023-08-09T12:40:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.928+0000 7f61ba59c640 1 --2- 172.21.15.17:0/3344775043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc1601f0 0x7f61bc0b29a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0b12b0 tx=0x7f61ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a2e0df2628cbe8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.928+0000 7f61b9d9b640 1 -- 172.21.15.17:0/3344775043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac031830 con 0x7f61bc1601f0 2023-08-09T12:40:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.928+0000 7f61b9d9b640 1 -- 172.21.15.17:0/3344775043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac031990 con 0x7f61bc1601f0 2023-08-09T12:40:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.928+0000 7f61b9d9b640 1 -- 172.21.15.17:0/3344775043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac031d20 con 0x7f61bc1601f0 2023-08-09T12:40:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.929+0000 7f61bb59e640 1 -- 172.21.15.17:0/3344775043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc1601f0 msgr2=0x7f61bc0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.929+0000 7f61bb59e640 1 --2- 172.21.15.17:0/3344775043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc1601f0 0x7f61bc0b29a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0b12b0 tx=0x7f61ac02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.929+0000 7f61bb59e640 1 -- 172.21.15.17:0/3344775043 shutdown_connections 2023-08-09T12:40:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.929+0000 7f61bb59e640 1 --2- 172.21.15.17:0/3344775043 >> v2:172.21.15.142:3300/0 conn(0x7f61bc0b2ee0 0x7f61bc0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.929+0000 7f61bb59e640 1 --2- 172.21.15.17:0/3344775043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc1601f0 0x7f61bc0b29a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.929+0000 7f61bb59e640 1 -- 172.21.15.17:0/3344775043 >> 172.21.15.17:0/3344775043 conn(0x7f61bc0b1d50 msgr2=0x7f61bc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.929+0000 7f61bb59e640 1 -- 172.21.15.17:0/3344775043 shutdown_connections 2023-08-09T12:40:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.929+0000 7f61bb59e640 1 -- 172.21.15.17:0/3344775043 wait complete. 2023-08-09T12:40:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.931+0000 7f61bb59e640 1 Processor -- start 2023-08-09T12:40:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.931+0000 7f61bb59e640 1 -- start start 2023-08-09T12:40:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.932+0000 7f61bb59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61bc0b2ee0 0x7f61bc14a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.932+0000 7f61bb59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc0cb440 0x7f61bc06ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.932+0000 7f61bb59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc1601f0 0x7f61bc1474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.932+0000 7f61bb59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc06f1d0 con 0x7f61bc0cb440 2023-08-09T12:40:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.932+0000 7f61bb59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc14dd30 con 0x7f61bc1601f0 2023-08-09T12:40:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.932+0000 7f61bb59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc06f3c0 con 0x7f61bc0b2ee0 2023-08-09T12:40:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc0cb440 0x7f61bc06ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc0cb440 0x7f61bc06ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42848/0 (socket says 172.21.15.17:42848) 2023-08-09T12:40:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61b3fff640 1 -- 172.21.15.17:0/1651640747 learned_addr learned my addr 172.21.15.17:0/1651640747 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61ba59c640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61bc0b2ee0 0x7f61bc14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61b3fff640 1 -- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61bc0b2ee0 msgr2=0x7f61bc14a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61b3fff640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61bc0b2ee0 0x7f61bc14a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61b3fff640 1 -- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc1601f0 msgr2=0x7f61bc1474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61b3fff640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc1601f0 0x7f61bc1474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61b3fff640 1 -- 172.21.15.17:0/1651640747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac009400 con 0x7f61bc0cb440 2023-08-09T12:40:27.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.933+0000 7f61ba59c640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61bc0b2ee0 0x7f61bc14a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:27.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.934+0000 7f61b3fff640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc0cb440 0x7f61bc06ec90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f61a400d620 tx=0x7f61a400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.934+0000 7f61b2ffd640 1 -- 172.21.15.17:0/1651640747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400b620 con 0x7f61bc0cb440 2023-08-09T12:40:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.934+0000 7f61b2ffd640 1 -- 172.21.15.17:0/1651640747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a400b780 con 0x7f61bc0cb440 2023-08-09T12:40:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.934+0000 7f61b2ffd640 1 -- 172.21.15.17:0/1651640747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400bb30 con 0x7f61bc0cb440 2023-08-09T12:40:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.934+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc1f5880 con 0x7f61bc0cb440 2023-08-09T12:40:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.934+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc1f5e40 con 0x7f61bc0cb440 2023-08-09T12:40:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.935+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc04e390 con 0x7f61bc0cb440 2023-08-09T12:40:27.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.936+0000 7f61b2ffd640 1 -- 172.21.15.17:0/1651640747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f61a400bc90 con 0x7f61bc0cb440 2023-08-09T12:40:27.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.937+0000 7f61b2ffd640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f619c06a050 0x7f619c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:27.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.937+0000 7f61b2ffd640 1 -- 172.21.15.17:0/1651640747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f61a4088aa0 con 0x7f61bc0cb440 2023-08-09T12:40:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.938+0000 7f61ba59c640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f619c06a050 0x7f619c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.939+0000 7f61ba59c640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f619c06a050 0x7f619c06c510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61ac036000 tx=0x7f61ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:27.941+0000 7f61b2ffd640 1 -- 172.21.15.17:0/1651640747 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f61a4054140 con 0x7f61bc0cb440 2023-08-09T12:40:28.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.149+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61bc06b230 con 0x7f61bc0cb440 2023-08-09T12:40:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.151+0000 7f61b2ffd640 1 -- 172.21.15.17:0/1651640747 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f61a4057760 con 0x7f61bc0cb440 2023-08-09T12:40:28.154 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:28.154 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:09.763656+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:39:23.544079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-09T12:39:24.140077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:28.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f619c06a050 msgr2=0x7f619c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f619c06a050 0x7f619c06c510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61ac036000 tx=0x7f61ac008030 comp rx=0 tx=0).stop 2023-08-09T12:40:28.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc0cb440 msgr2=0x7f61bc06ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc0cb440 0x7f61bc06ec90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f61a400d620 tx=0x7f61a400dae0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 shutdown_connections 2023-08-09T12:40:28.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f619c06a050 0x7f619c06c510 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61bc1601f0 0x7f61bc1474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61bc0cb440 0x7f61bc06ec90 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f61a400d620 tx=0x7f61a400dae0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 --2- 172.21.15.17:0/1651640747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61bc0b2ee0 0x7f61bc14a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.153+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 >> 172.21.15.17:0/1651640747 conn(0x7f61bc0b1d50 msgr2=0x7f61bc15bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.154+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 shutdown_connections 2023-08-09T12:40:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.154+0000 7f61bb59e640 1 -- 172.21.15.17:0/1651640747 wait complete. 2023-08-09T12:40:28.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:40:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.388+0000 7f34312da640 1 Processor -- start 2023-08-09T12:40:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.388+0000 7f34312da640 1 -- start start 2023-08-09T12:40:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.390+0000 7f34312da640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 0x7f342c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.390+0000 7f34312da640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c15df30 con 0x7f342c0acfc0 2023-08-09T12:40:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.390+0000 7f34312da640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c0ca9d0 con 0x7f342c161660 2023-08-09T12:40:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.390+0000 7f34312da640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c15d430 con 0x7f342c161280 2023-08-09T12:40:28.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.391+0000 7f342b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f342c0acfc0 0x7f342c0cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49338/0 (socket says 172.21.15.17:49338) 2023-08-09T12:40:28.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.391+0000 7f342b7fe640 1 -- 172.21.15.17:0/1374081641 learned_addr learned my addr 172.21.15.17:0/1374081641 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:28.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.391+0000 7f342affd640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 0x7f342c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.391+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507089537 0 0) 0x7f342c15df30 con 0x7f342c0acfc0 2023-08-09T12:40:28.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.391+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3414003520 con 0x7f342c0acfc0 2023-08-09T12:40:28.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 170591610 0 0) 0x7f3414003520 con 0x7f342c0acfc0 2023-08-09T12:40:28.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 msgr2=0x7f342c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:28.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 0x7f342c0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 >> v1:172.21.15.142:6789/0 conn(0x7f342c161660 legacy=0x7f342c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c15e3c0 con 0x7f342c0acfc0 2023-08-09T12:40:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f34240019f0 con 0x7f342c0acfc0 2023-08-09T12:40:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 >> v1:172.21.15.17:6789/0 conn(0x7f342c0acfc0 legacy=0x7f342c0cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34140039a0 0x7f3414003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140047c0 0x7f3414004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 0x7f34140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341400ba80 con 0x7f34140047c0 2023-08-09T12:40:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341400bbf0 con 0x7f34140039a0 2023-08-09T12:40:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341400bdb0 con 0x7f342c161280 2023-08-09T12:40:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f342a7fc640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140047c0 0x7f3414004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.392+0000 7f342affd640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34140039a0 0x7f3414003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.393+0000 7f342b7fe640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 0x7f34140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.393+0000 7f342a7fc640 1 -- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 msgr2=0x7f34140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.393+0000 7f342a7fc640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 0x7f34140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.393+0000 7f342a7fc640 1 -- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34140039a0 msgr2=0x7f3414003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.393+0000 7f342a7fc640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34140039a0 0x7f3414003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.393+0000 7f342a7fc640 1 -- 172.21.15.17:0/1374081641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414003520 con 0x7f34140047c0 2023-08-09T12:40:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.393+0000 7f342b7fe640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f342c161280 0x7f34140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.394+0000 7f342a7fc640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140047c0 0x7f3414004c40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f342c161ac0 tx=0x7f34140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f91f2b64f63ee4a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.394+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200052d0 con 0x7f34140047c0 2023-08-09T12:40:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.394+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342002e050 con 0x7f34140047c0 2023-08-09T12:40:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.394+0000 7f3429ffb640 1 -- 172.21.15.17:0/1374081641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420003640 con 0x7f34140047c0 2023-08-09T12:40:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.395+0000 7f34312da640 1 -- 172.21.15.17:0/1374081641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140047c0 msgr2=0x7f3414004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.395+0000 7f34312da640 1 --2- 172.21.15.17:0/1374081641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140047c0 0x7f3414004c40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f342c161ac0 tx=0x7f34140057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.395+0000 7f342b7fe640 1 -- 172.21.15.17:0/1374081641 reap_dead start 2023-08-09T12:40:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.395+0000 7f34312da640 1 -- 172.21.15.17:0/1374081641 shutdown_connections 2023-08-09T12:40:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.395+0000 7f34312da640 1 -- 172.21.15.17:0/1374081641 >> 172.21.15.17:0/1374081641 conn(0x7f342c0cb1b0 msgr2=0x7f342c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.395+0000 7f34312da640 1 -- 172.21.15.17:0/1374081641 shutdown_connections 2023-08-09T12:40:28.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.395+0000 7f34312da640 1 -- 172.21.15.17:0/1374081641 wait complete. 2023-08-09T12:40:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.397+0000 7f34312da640 1 Processor -- start 2023-08-09T12:40:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.397+0000 7f34312da640 1 -- start start 2023-08-09T12:40:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.398+0000 7f34312da640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34140047c0 0x7f342c0c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.398+0000 7f34312da640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342c0c5160 0x7f342c0c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.398+0000 7f34312da640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342c153b70 0x7f342c156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.398+0000 7f34312da640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0c7c60 con 0x7f342c0c5160 2023-08-09T12:40:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.398+0000 7f34312da640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0c40c0 con 0x7f342c153b70 2023-08-09T12:40:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.398+0000 7f34312da640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0c43a0 con 0x7f34140047c0 2023-08-09T12:40:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342c0c5160 0x7f342c0c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342c0c5160 0x7f342c0c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42870/0 (socket says 172.21.15.17:42870) 2023-08-09T12:40:28.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 -- 172.21.15.17:0/1628708381 learned_addr learned my addr 172.21.15.17:0/1628708381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:28.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342b7fe640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342c153b70 0x7f342c156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342affd640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34140047c0 0x7f342c0c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 -- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34140047c0 msgr2=0x7f342c0c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34140047c0 0x7f342c0c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 -- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342c153b70 msgr2=0x7f342c156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342c153b70 0x7f342c156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 -- 172.21.15.17:0/1628708381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c0c4680 con 0x7f342c0c5160 2023-08-09T12:40:28.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342affd640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34140047c0 0x7f342c0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:28.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342b7fe640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342c153b70 0x7f342c156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:28.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.399+0000 7f342a7fc640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342c0c5160 0x7f342c0c3870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f342002bbc0 tx=0x7f3420001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:28.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.400+0000 7f34137fe640 1 -- 172.21.15.17:0/1628708381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420007240 con 0x7f342c0c5160 2023-08-09T12:40:28.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.400+0000 7f34137fe640 1 -- 172.21.15.17:0/1628708381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34200073a0 con 0x7f342c0c5160 2023-08-09T12:40:28.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.400+0000 7f34137fe640 1 -- 172.21.15.17:0/1628708381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420007a80 con 0x7f342c0c5160 2023-08-09T12:40:28.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.400+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c0c4960 con 0x7f342c0c5160 2023-08-09T12:40:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.400+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c0c3db0 con 0x7f342c0c5160 2023-08-09T12:40:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.401+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c067a80 con 0x7f342c0c5160 2023-08-09T12:40:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.402+0000 7f34137fe640 1 -- 172.21.15.17:0/1628708381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3420003640 con 0x7f342c0c5160 2023-08-09T12:40:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.403+0000 7f34137fe640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f341806a050 0x7f341806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.404+0000 7f34137fe640 1 -- 172.21.15.17:0/1628708381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f34200aa4b0 con 0x7f342c0c5160 2023-08-09T12:40:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.404+0000 7f342affd640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f341806a050 0x7f341806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.405+0000 7f342affd640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f341806a050 0x7f341806c510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f341c009a00 tx=0x7f341c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.408+0000 7f34137fe640 1 -- 172.21.15.17:0/1628708381 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3420075b50 con 0x7f342c0c5160 2023-08-09T12:40:28.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.644+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f342c15d8b0 con 0x7f342c0c5160 2023-08-09T12:40:28.647 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:40:28.645+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:40:28.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.653+0000 7f34137fe640 1 -- 172.21.15.17:0/1628708381 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3420006e60 con 0x7f342c0c5160 2023-08-09T12:40:28.657 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:40:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.656+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f341806a050 msgr2=0x7f341806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.656+0000 7f34312da640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f341806a050 0x7f341806c510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f341c009a00 tx=0x7f341c008040 comp rx=0 tx=0).stop 2023-08-09T12:40:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.656+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342c0c5160 msgr2=0x7f342c0c3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.656+0000 7f34312da640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342c0c5160 0x7f342c0c3870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f342002bbc0 tx=0x7f3420001170 comp rx=0 tx=0).stop 2023-08-09T12:40:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.657+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 shutdown_connections 2023-08-09T12:40:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.657+0000 7f34312da640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f341806a050 0x7f341806c510 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.657+0000 7f34312da640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f342c153b70 0x7f342c156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.657+0000 7f34312da640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342c0c5160 0x7f342c0c3870 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.657+0000 7f34312da640 1 --2- 172.21.15.17:0/1628708381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34140047c0 0x7f342c0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.657+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 >> 172.21.15.17:0/1628708381 conn(0x7f342c0cb1b0 msgr2=0x7f342c06bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.657+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 shutdown_connections 2023-08-09T12:40:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.657+0000 7f34312da640 1 -- 172.21.15.17:0/1628708381 wait complete. 2023-08-09T12:40:28.675 INFO:tasks.ceph.mds.c.smithi017.stderr: -7746> 2023-08-09T12:39:30.514+0000 7faa529fe640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:40:28.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:40:28.743 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:40:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.873+0000 7fe734f53640 1 Processor -- start 2023-08-09T12:40:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.874+0000 7fe734f53640 1 -- start start 2023-08-09T12:40:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.875+0000 7fe734f53640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7300b8420 0x7fe7300cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.875+0000 7fe734f53640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe73015cf20 0x7fe7300cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.875+0000 7fe734f53640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7300d0f00 con 0x7fe73015cb40 2023-08-09T12:40:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.875+0000 7fe734f53640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7301611f0 con 0x7fe7300b8420 2023-08-09T12:40:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.875+0000 7fe734f53640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7301614d0 con 0x7fe73015cf20 2023-08-09T12:40:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.876+0000 7fe72effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7300b8420 0x7fe7300cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.876+0000 7fe72effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7300b8420 0x7fe7300cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42904/0 (socket says 172.21.15.17:42904) 2023-08-09T12:40:28.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.876+0000 7fe72effd640 1 -- 172.21.15.17:0/3921075638 learned_addr learned my addr 172.21.15.17:0/3921075638 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.876+0000 7fe72effd640 1 -- 172.21.15.17:0/3921075638 >> v2:172.21.15.142:3300/0 conn(0x7fe73015cf20 msgr2=0x7fe7300cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.876+0000 7fe72effd640 1 --2- 172.21.15.17:0/3921075638 >> v2:172.21.15.142:3300/0 conn(0x7fe73015cf20 0x7fe7300cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.876+0000 7fe72effd640 1 -- 172.21.15.17:0/3921075638 >> v1:172.21.15.142:6789/0 conn(0x7fe73015cb40 legacy=0x7fe7301609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.876+0000 7fe72effd640 1 -- 172.21.15.17:0/3921075638 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7301617b0 con 0x7fe7300b8420 2023-08-09T12:40:28.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.877+0000 7fe72effd640 1 --2- 172.21.15.17:0/3921075638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7300b8420 0x7fe7300cd860 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe7300d0e50 tx=0x7fe72402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c5908084103de0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.877+0000 7fe72e7fc640 1 -- 172.21.15.17:0/3921075638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724030860 con 0x7fe7300b8420 2023-08-09T12:40:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.878+0000 7fe72e7fc640 1 -- 172.21.15.17:0/3921075638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7240309c0 con 0x7fe7300b8420 2023-08-09T12:40:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.878+0000 7fe72e7fc640 1 -- 172.21.15.17:0/3921075638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724030d50 con 0x7fe7300b8420 2023-08-09T12:40:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.878+0000 7fe734f53640 1 -- 172.21.15.17:0/3921075638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7300b8420 msgr2=0x7fe7300cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.878+0000 7fe734f53640 1 --2- 172.21.15.17:0/3921075638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7300b8420 0x7fe7300cd860 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe7300d0e50 tx=0x7fe72402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.878+0000 7fe734f53640 1 -- 172.21.15.17:0/3921075638 shutdown_connections 2023-08-09T12:40:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.878+0000 7fe734f53640 1 --2- 172.21.15.17:0/3921075638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7300b8420 0x7fe7300cd860 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.878+0000 7fe734f53640 1 --2- 172.21.15.17:0/3921075638 >> v2:172.21.15.142:3300/0 conn(0x7fe73015cf20 0x7fe7300cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.878+0000 7fe734f53640 1 -- 172.21.15.17:0/3921075638 >> 172.21.15.17:0/3921075638 conn(0x7fe7300d2ab0 msgr2=0x7fe7300d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.879+0000 7fe734f53640 1 -- 172.21.15.17:0/3921075638 shutdown_connections 2023-08-09T12:40:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.879+0000 7fe734f53640 1 -- 172.21.15.17:0/3921075638 wait complete. 2023-08-09T12:40:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.881+0000 7fe734f53640 1 Processor -- start 2023-08-09T12:40:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.881+0000 7fe734f53640 1 -- start start 2023-08-09T12:40:28.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.882+0000 7fe734f53640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7300b8420 0x7fe7301538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.882+0000 7fe734f53640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73015cb40 0x7fe73014b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.882+0000 7fe734f53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73015cf20 0x7fe730157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.882+0000 7fe734f53640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300c8590 con 0x7fe73015cf20 2023-08-09T12:40:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.882+0000 7fe734f53640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300c76e0 con 0x7fe73015cb40 2023-08-09T12:40:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.882+0000 7fe734f53640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300c8a20 con 0x7fe7300b8420 2023-08-09T12:40:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73015cf20 0x7fe730157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73015cf20 0x7fe730157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42910/0 (socket says 172.21.15.17:42910) 2023-08-09T12:40:28.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72ffff640 1 -- 172.21.15.17:0/1578017395 learned_addr learned my addr 172.21.15.17:0/1578017395 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:28.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72f7fe640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7300b8420 0x7fe7301538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72effd640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73015cb40 0x7fe73014b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72ffff640 1 -- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7300b8420 msgr2=0x7fe7301538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72ffff640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7300b8420 0x7fe7301538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72ffff640 1 -- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73015cb40 msgr2=0x7fe73014b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72ffff640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73015cb40 0x7fe73014b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72ffff640 1 -- 172.21.15.17:0/1578017395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240094d0 con 0x7fe73015cf20 2023-08-09T12:40:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.883+0000 7fe72effd640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73015cb40 0x7fe73014b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.884+0000 7fe72ffff640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73015cf20 0x7fe730157c00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b970 tx=0x7fe72800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.884+0000 7fe717fff640 1 -- 172.21.15.17:0/1578017395 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800cb40 con 0x7fe73015cf20 2023-08-09T12:40:28.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.884+0000 7fe717fff640 1 -- 172.21.15.17:0/1578017395 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72800ccc0 con 0x7fe73015cf20 2023-08-09T12:40:28.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.884+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7300c7980 con 0x7fe73015cf20 2023-08-09T12:40:28.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.884+0000 7fe717fff640 1 -- 172.21.15.17:0/1578017395 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728014680 con 0x7fe73015cf20 2023-08-09T12:40:28.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.884+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7300c7f40 con 0x7fe73015cf20 2023-08-09T12:40:28.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.885+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7300c8700 con 0x7fe73015cf20 2023-08-09T12:40:28.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.886+0000 7fe717fff640 1 -- 172.21.15.17:0/1578017395 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe72801d3b0 con 0x7fe73015cf20 2023-08-09T12:40:28.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.887+0000 7fe717fff640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe71c06a080 0x7fe71c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:28.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.887+0000 7fe717fff640 1 -- 172.21.15.17:0/1578017395 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fe728088640 con 0x7fe73015cf20 2023-08-09T12:40:28.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.888+0000 7fe72f7fe640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe71c06a080 0x7fe71c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:28.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.889+0000 7fe72f7fe640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe71c06a080 0x7fe71c06c540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe720004ea0 tx=0x7fe720009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:28.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:28.892+0000 7fe717fff640 1 -- 172.21.15.17:0/1578017395 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe728053c00 con 0x7fe73015cf20 2023-08-09T12:40:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.120+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe73004e390 con 0x7fe73015cf20 2023-08-09T12:40:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.672+0000 7fe717fff640 1 -- 172.21.15.17:0/1578017395 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe728057220 con 0x7fe73015cf20 2023-08-09T12:40:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe71c06a080 msgr2=0x7fe71c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe71c06a080 0x7fe71c06c540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe720004ea0 tx=0x7fe720009040 comp rx=0 tx=0).stop 2023-08-09T12:40:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73015cf20 msgr2=0x7fe730157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73015cf20 0x7fe730157c00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b970 tx=0x7fe72800be30 comp rx=0 tx=0).stop 2023-08-09T12:40:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 shutdown_connections 2023-08-09T12:40:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe71c06a080 0x7fe71c06c540 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe73015cf20 0x7fe730157c00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe73015cb40 0x7fe73014b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 --2- 172.21.15.17:0/1578017395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7300b8420 0x7fe7301538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.675+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 >> 172.21.15.17:0/1578017395 conn(0x7fe7300d2ab0 msgr2=0x7fe730069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.676+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 shutdown_connections 2023-08-09T12:40:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.676+0000 7fe734f53640 1 -- 172.21.15.17:0/1578017395 wait complete. 2023-08-09T12:40:29.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:40:29.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.928+0000 7f27d24cc640 1 Processor -- start 2023-08-09T12:40:29.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.929+0000 7f27d24cc640 1 -- start start 2023-08-09T12:40:29.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.930+0000 7f27d24cc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f27cc0add60 0x7f27cc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:29.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.931+0000 7f27d24cc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc0b4770 con 0x7f27cc0708a0 2023-08-09T12:40:29.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.931+0000 7f27d24cc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc0caa70 con 0x7f27cc15abe0 2023-08-09T12:40:29.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.931+0000 7f27d24cc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc0b41b0 con 0x7f27cc0add60 2023-08-09T12:40:29.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.931+0000 7f27cb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f27cc0add60 0x7f27cc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:29.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.931+0000 7f27cbfff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f27cc15abe0 0x7f27cc070190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:49004/0 (socket says 172.21.15.17:49004) 2023-08-09T12:40:29.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.931+0000 7f27cbfff640 1 -- 172.21.15.17:0/1931883832 learned_addr learned my addr 172.21.15.17:0/1931883832 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.932+0000 7f27cb7fe640 1 -- 172.21.15.17:0/1931883832 >> v1:172.21.15.142:6789/0 conn(0x7f27cc15abe0 legacy=0x7f27cc070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.932+0000 7f27cb7fe640 1 -- 172.21.15.17:0/1931883832 >> v1:172.21.15.17:6789/0 conn(0x7f27cc0708a0 legacy=0x7f27cc0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.932+0000 7f27cb7fe640 1 -- 172.21.15.17:0/1931883832 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc0b4490 con 0x7f27cc0add60 2023-08-09T12:40:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.933+0000 7f27cb7fe640 1 --2- 172.21.15.17:0/1931883832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0add60 0x7f27cc0c8e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27c00097a0 tx=0x7f27c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f5f6f8b87de5cd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:29.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.933+0000 7f27caffd640 1 -- 172.21.15.17:0/1931883832 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c002e070 con 0x7f27cc0add60 2023-08-09T12:40:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.933+0000 7f27caffd640 1 -- 172.21.15.17:0/1931883832 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c00315a0 con 0x7f27cc0add60 2023-08-09T12:40:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.933+0000 7f27caffd640 1 -- 172.21.15.17:0/1931883832 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0031930 con 0x7f27cc0add60 2023-08-09T12:40:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.934+0000 7f27d24cc640 1 -- 172.21.15.17:0/1931883832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0add60 msgr2=0x7f27cc0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.934+0000 7f27d24cc640 1 --2- 172.21.15.17:0/1931883832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0add60 0x7f27cc0c8e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27c00097a0 tx=0x7f27c002b840 comp rx=0 tx=0).stop 2023-08-09T12:40:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.934+0000 7f27d24cc640 1 -- 172.21.15.17:0/1931883832 shutdown_connections 2023-08-09T12:40:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.934+0000 7f27d24cc640 1 --2- 172.21.15.17:0/1931883832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0add60 0x7f27cc0c8e00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.934+0000 7f27d24cc640 1 -- 172.21.15.17:0/1931883832 >> 172.21.15.17:0/1931883832 conn(0x7f27cc0697c0 msgr2=0x7f27cc069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.934+0000 7f27d24cc640 1 -- 172.21.15.17:0/1931883832 shutdown_connections 2023-08-09T12:40:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.934+0000 7f27d24cc640 1 -- 172.21.15.17:0/1931883832 wait complete. 2023-08-09T12:40:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.936+0000 7f27d24cc640 1 Processor -- start 2023-08-09T12:40:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.936+0000 7f27d24cc640 1 -- start start 2023-08-09T12:40:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.937+0000 7f27d24cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0708a0 0x7f27cc151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.937+0000 7f27d24cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc0add60 0x7f27cc15de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.937+0000 7f27d24cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc15abe0 0x7f27cc0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.937+0000 7f27d24cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc1520d0 con 0x7f27cc0708a0 2023-08-09T12:40:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.937+0000 7f27d24cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0c8780 con 0x7f27cc15abe0 2023-08-09T12:40:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.937+0000 7f27d24cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0c64d0 con 0x7f27cc0add60 2023-08-09T12:40:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0708a0 0x7f27cc151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0708a0 0x7f27cc151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42928/0 (socket says 172.21.15.17:42928) 2023-08-09T12:40:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cbfff640 1 -- 172.21.15.17:0/3888072408 learned_addr learned my addr 172.21.15.17:0/3888072408 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27d0a69640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc15abe0 0x7f27cc0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cb7fe640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc0add60 0x7f27cc15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cbfff640 1 -- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc0add60 msgr2=0x7f27cc15de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cbfff640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc0add60 0x7f27cc15de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cbfff640 1 -- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc15abe0 msgr2=0x7f27cc0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cbfff640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc15abe0 0x7f27cc0c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.938+0000 7f27cbfff640 1 -- 172.21.15.17:0/3888072408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c0009400 con 0x7f27cc0708a0 2023-08-09T12:40:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.939+0000 7f27cbfff640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0708a0 0x7f27cc151850 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00c480 tx=0x7f27bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.939+0000 7f27c8ff9640 1 -- 172.21.15.17:0/3888072408 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc005ce0 con 0x7f27cc0708a0 2023-08-09T12:40:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.939+0000 7f27c8ff9640 1 -- 172.21.15.17:0/3888072408 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc005e40 con 0x7f27cc0708a0 2023-08-09T12:40:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.939+0000 7f27c8ff9640 1 -- 172.21.15.17:0/3888072408 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0072f0 con 0x7f27cc0708a0 2023-08-09T12:40:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.939+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc0c67b0 con 0x7f27cc0708a0 2023-08-09T12:40:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.939+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc0c41a0 con 0x7f27cc0708a0 2023-08-09T12:40:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.940+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc0c4390 con 0x7f27cc0708a0 2023-08-09T12:40:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.941+0000 7f27c8ff9640 1 -- 172.21.15.17:0/3888072408 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f27bc007510 con 0x7f27cc0708a0 2023-08-09T12:40:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.942+0000 7f27c8ff9640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27b806a050 0x7f27b806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.942+0000 7f27c8ff9640 1 -- 172.21.15.17:0/3888072408 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f27bc087ac0 con 0x7f27cc0708a0 2023-08-09T12:40:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.943+0000 7f27cb7fe640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27b806a050 0x7f27b806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.944+0000 7f27cb7fe640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27b806a050 0x7f27b806c510 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f27c0036000 tx=0x7f27c003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:29.947+0000 7f27c8ff9640 1 -- 172.21.15.17:0/3888072408 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f27bc053260 con 0x7f27cc0708a0 2023-08-09T12:40:30.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.142+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27cc067a80 con 0x7f27cc0708a0 2023-08-09T12:40:30.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.993+0000 7f27c8ff9640 1 -- 172.21.15.17:0/3888072408 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f27bc056880 con 0x7f27cc0708a0 2023-08-09T12:40:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:40:30.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.996+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27b806a050 msgr2=0x7f27b806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:30.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.996+0000 7f27d24cc640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27b806a050 0x7f27b806c510 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f27c0036000 tx=0x7f27c003d040 comp rx=0 tx=0).stop 2023-08-09T12:40:31.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.996+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0708a0 msgr2=0x7f27cc151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:31.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.996+0000 7f27d24cc640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0708a0 0x7f27cc151850 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00c480 tx=0x7f27bc00c940 comp rx=0 tx=0).stop 2023-08-09T12:40:31.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.997+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 shutdown_connections 2023-08-09T12:40:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.997+0000 7f27d24cc640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27b806a050 0x7f27b806c510 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.997+0000 7f27d24cc640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc15abe0 0x7f27cc0c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.997+0000 7f27d24cc640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc0add60 0x7f27cc15de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.997+0000 7f27d24cc640 1 --2- 172.21.15.17:0/3888072408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27cc0708a0 0x7f27cc151850 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.997+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 >> 172.21.15.17:0/3888072408 conn(0x7f27cc0697c0 msgr2=0x7f27cc0ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.997+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 shutdown_connections 2023-08-09T12:40:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:30.997+0000 7f27d24cc640 1 -- 172.21.15.17:0/3888072408 wait complete. 2023-08-09T12:40:31.020 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:40:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.250+0000 7fdbaa291640 1 Processor -- start 2023-08-09T12:40:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.251+0000 7fdbaa291640 1 -- start start 2023-08-09T12:40:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.252+0000 7fdbaa291640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdba40c9800 0x7fdba40c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.252+0000 7fdbaa291640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40b4100 0x7fdba40cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.252+0000 7fdbaa291640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba40cd570 con 0x7fdba40cdf40 2023-08-09T12:40:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.252+0000 7fdbaa291640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba4161630 con 0x7fdba40c9800 2023-08-09T12:40:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.252+0000 7fdbaa291640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40b4560 con 0x7fdba40b4100 2023-08-09T12:40:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.253+0000 7fdba9a90640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdba40cdf40 0x7fdba40affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49378/0 (socket says 172.21.15.17:49378) 2023-08-09T12:40:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.253+0000 7fdba9a90640 1 -- 172.21.15.17:0/2312733275 learned_addr learned my addr 172.21.15.17:0/2312733275 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.253+0000 7fdba8a8e640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40b4100 0x7fdba40cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.253+0000 7fdba928f640 1 --2- 172.21.15.17:0/2312733275 >> v2:172.21.15.142:3300/0 conn(0x7fdba40c9800 0x7fdba40c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.253+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748177489 0 0) 0x7fdba40cd570 con 0x7fdba40cdf40 2023-08-09T12:40:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.253+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb90003520 con 0x7fdba40cdf40 2023-08-09T12:40:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562471516 0 0) 0x7fdb90003520 con 0x7fdba40cdf40 2023-08-09T12:40:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40b4100 msgr2=0x7fdba40cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40b4100 0x7fdba40cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 >> v2:172.21.15.142:3300/0 conn(0x7fdba40c9800 msgr2=0x7fdba40c1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 --2- 172.21.15.17:0/2312733275 >> v2:172.21.15.142:3300/0 conn(0x7fdba40c9800 0x7fdba40c1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40cc680 con 0x7fdba40cdf40 2023-08-09T12:40:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fdb9c0019f0 con 0x7fdba40cdf40 2023-08-09T12:40:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 >> v1:172.21.15.17:6789/0 conn(0x7fdba40cdf40 legacy=0x7fdba40affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40b4100 0x7fdb90003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb90003ef0 0x7fdb900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90004d00 0x7fdb90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4161630 con 0x7fdb90004d00 2023-08-09T12:40:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40b4560 con 0x7fdb90003ef0 2023-08-09T12:40:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9000b9b0 con 0x7fdba40b4100 2023-08-09T12:40:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdba9a90640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90004d00 0x7fdb90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.254+0000 7fdba928f640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40b4100 0x7fdb90003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.255+0000 7fdba8a8e640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb90003ef0 0x7fdb900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.255+0000 7fdba9a90640 1 -- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40b4100 msgr2=0x7fdb90003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.255+0000 7fdba9a90640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40b4100 0x7fdb90003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.255+0000 7fdba9a90640 1 -- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb90003ef0 msgr2=0x7fdb900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.255+0000 7fdba9a90640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb90003ef0 0x7fdb900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.255+0000 7fdba9a90640 1 -- 172.21.15.17:0/2312733275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90003520 con 0x7fdb90004d00 2023-08-09T12:40:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.256+0000 7fdba9a90640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90004d00 0x7fdb90005180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00a860 tx=0x7fdb900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfba06039d0dd79 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.256+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c034630 con 0x7fdb90004d00 2023-08-09T12:40:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.256+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c02f070 con 0x7fdb90004d00 2023-08-09T12:40:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.256+0000 7fdb9bfff640 1 -- 172.21.15.17:0/2312733275 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c034a30 con 0x7fdb90004d00 2023-08-09T12:40:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.257+0000 7fdbaa291640 1 -- 172.21.15.17:0/2312733275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90004d00 msgr2=0x7fdb90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.257+0000 7fdbaa291640 1 --2- 172.21.15.17:0/2312733275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90004d00 0x7fdb90005180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00a860 tx=0x7fdb900057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.257+0000 7fdba9a90640 1 -- 172.21.15.17:0/2312733275 reap_dead start 2023-08-09T12:40:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.257+0000 7fdbaa291640 1 -- 172.21.15.17:0/2312733275 shutdown_connections 2023-08-09T12:40:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.257+0000 7fdbaa291640 1 -- 172.21.15.17:0/2312733275 >> 172.21.15.17:0/2312733275 conn(0x7fdba40cafa0 msgr2=0x7fdba40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.257+0000 7fdbaa291640 1 -- 172.21.15.17:0/2312733275 shutdown_connections 2023-08-09T12:40:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.257+0000 7fdbaa291640 1 -- 172.21.15.17:0/2312733275 wait complete. 2023-08-09T12:40:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.259+0000 7fdbaa291640 1 Processor -- start 2023-08-09T12:40:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.259+0000 7fdbaa291640 1 -- start start 2023-08-09T12:40:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdbaa291640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb90004d00 0x7fdba4152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdbaa291640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40c2050 0x7fdba40c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdbaa291640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba406f7f0 0x7fdba406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdbaa291640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40701c0 con 0x7fdba40c2050 2023-08-09T12:40:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdbaa291640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c3120 con 0x7fdb90004d00 2023-08-09T12:40:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdbaa291640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c2510 con 0x7fdba406f7f0 2023-08-09T12:40:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdba8a8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40c2050 0x7fdba40c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdba8a8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40c2050 0x7fdba40c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42932/0 (socket says 172.21.15.17:42932) 2023-08-09T12:40:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdba8a8e640 1 -- 172.21.15.17:0/205924017 learned_addr learned my addr 172.21.15.17:0/205924017 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdba8a8e640 1 -- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba406f7f0 msgr2=0x7fdba406fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdba8a8e640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba406f7f0 0x7fdba406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdba8a8e640 1 -- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb90004d00 msgr2=0x7fdba4152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdba8a8e640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb90004d00 0x7fdba4152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.260+0000 7fdba8a8e640 1 -- 172.21.15.17:0/205924017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40c27f0 con 0x7fdba40c2050 2023-08-09T12:40:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.261+0000 7fdba8a8e640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40c2050 0x7fdba40c7d20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdb94011540 tx=0x7fdb94011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.261+0000 7fdb99ffb640 1 -- 172.21.15.17:0/205924017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94015930 con 0x7fdba40c2050 2023-08-09T12:40:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.261+0000 7fdb99ffb640 1 -- 172.21.15.17:0/205924017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94015a90 con 0x7fdba40c2050 2023-08-09T12:40:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.261+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba40c2ad0 con 0x7fdba40c2050 2023-08-09T12:40:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.261+0000 7fdb99ffb640 1 -- 172.21.15.17:0/205924017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94015e40 con 0x7fdba40c2050 2023-08-09T12:40:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.261+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba4153250 con 0x7fdba40c2050 2023-08-09T12:40:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.262+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba404e390 con 0x7fdba40c2050 2023-08-09T12:40:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.263+0000 7fdb99ffb640 1 -- 172.21.15.17:0/205924017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb9401d400 con 0x7fdba40c2050 2023-08-09T12:40:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.264+0000 7fdb99ffb640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a050 0x7fdb8806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.264+0000 7fdb99ffb640 1 -- 172.21.15.17:0/205924017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fdb94088bd0 con 0x7fdba40c2050 2023-08-09T12:40:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.265+0000 7fdba928f640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a050 0x7fdb8806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.266+0000 7fdba928f640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a050 0x7fdb8806c510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009990 tx=0x7fdba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:31.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.269+0000 7fdb99ffb640 1 -- 172.21.15.17:0/205924017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdb94057dd0 con 0x7fdba40c2050 2023-08-09T12:40:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:31.467+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdba40c3260 con 0x7fdba40c2050 2023-08-09T12:40:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.001+0000 7fdb99ffb640 1 -- 172.21.15.17:0/205924017 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdb94057960 con 0x7fdba40c2050 2023-08-09T12:40:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:40:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a050 msgr2=0x7fdb8806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a050 0x7fdb8806c510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009990 tx=0x7fdba0008040 comp rx=0 tx=0).stop 2023-08-09T12:40:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40c2050 msgr2=0x7fdba40c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40c2050 0x7fdba40c7d20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdb94011540 tx=0x7fdb94011a00 comp rx=0 tx=0).stop 2023-08-09T12:40:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 shutdown_connections 2023-08-09T12:40:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a050 0x7fdb8806c510 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba406f7f0 0x7fdba406fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40c2050 0x7fdba40c7d20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 --2- 172.21.15.17:0/205924017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb90004d00 0x7fdba4152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.011+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 >> 172.21.15.17:0/205924017 conn(0x7fdba40cafa0 msgr2=0x7fdba40c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.012+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 shutdown_connections 2023-08-09T12:40:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.012+0000 7fdbaa291640 1 -- 172.21.15.17:0/205924017 wait complete. 2023-08-09T12:40:32.036 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:40:32.037 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:40:32.037 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:40:32.037 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:40:32.038 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:40:32.038 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:40:32.038 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:40:32.039 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:40:32.039 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:40:32.039 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:40:32.039 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:40:32.039 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:40:32.040 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:40:32.040 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:40:32.040 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:40:32.040 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:40:32.054 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:40:32.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:40:32.057 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:40:32.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:40:32.069 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:40:32.070 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:40:32.071 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:40:32.071 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:40:32.105 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:40:32.106 DEBUG:teuthology.parallel:result is None 2023-08-09T12:40:32.113 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:40:32.114 DEBUG:teuthology.parallel:result is None 2023-08-09T12:40:32.119 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:40:32.119 DEBUG:teuthology.parallel:result is None 2023-08-09T12:40:32.128 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:40:32.128 DEBUG:teuthology.parallel:result is None 2023-08-09T12:40:32.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:40:32.274 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:40:32.277 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:40:32.288 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:40:32.289 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:40:32.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.332+0000 7fc117322640 1 Processor -- start 2023-08-09T12:40:32.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.333+0000 7fc117322640 1 -- start start 2023-08-09T12:40:32.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc117322640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc110160030 0x7fc110160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:32.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc117322640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100b86e0 0x7fc1100cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:32.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc117322640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1100b5a30 con 0x7fc1100cf980 2023-08-09T12:40:32.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc117322640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100d1110 con 0x7fc110160030 2023-08-09T12:40:32.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc117322640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100ceac0 con 0x7fc1100b86e0 2023-08-09T12:40:32.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc116320640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc110160030 0x7fc110160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:32.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc116b21640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc1100cf980 0x7fc1100b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49398/0 (socket says 172.21.15.17:49398) 2023-08-09T12:40:32.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc116b21640 1 -- 172.21.15.17:0/2436366082 learned_addr learned my addr 172.21.15.17:0/2436366082 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:32.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.334+0000 7fc116320640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc110160030 0x7fc110160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42968/0 (socket says 172.21.15.17:42968) 2023-08-09T12:40:32.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.335+0000 7fc115b1f640 1 --2- 172.21.15.17:0/2436366082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100b86e0 0x7fc1100cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:32.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.335+0000 7fc116320640 1 -- 172.21.15.17:0/2436366082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100b86e0 msgr2=0x7fc1100cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:32.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.335+0000 7fc116320640 1 --2- 172.21.15.17:0/2436366082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100b86e0 0x7fc1100cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.335+0000 7fc116320640 1 -- 172.21.15.17:0/2436366082 >> v1:172.21.15.17:6789/0 conn(0x7fc1100cf980 legacy=0x7fc1100b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:32.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.335+0000 7fc116320640 1 -- 172.21.15.17:0/2436366082 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100d0d70 con 0x7fc110160030 2023-08-09T12:40:32.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.335+0000 7fc11531e640 1 -- 172.21.15.17:0/2436366082 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251780576 0 0) 0x7fc1100b5a30 con 0x7fc1100cf980 2023-08-09T12:40:32.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.335+0000 7fc115b1f640 1 --2- 172.21.15.17:0/2436366082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100b86e0 0x7fc1100cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:32.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.336+0000 7fc116320640 1 --2- 172.21.15.17:0/2436366082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc110160030 0x7fc110160740 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0097a0 tx=0x7fc10c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0197eb1335871c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:32.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.336+0000 7fc11531e640 1 -- 172.21.15.17:0/2436366082 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c02d040 con 0x7fc110160030 2023-08-09T12:40:32.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.336+0000 7fc11531e640 1 -- 172.21.15.17:0/2436366082 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c031810 con 0x7fc110160030 2023-08-09T12:40:32.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.336+0000 7fc11531e640 1 -- 172.21.15.17:0/2436366082 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c031ba0 con 0x7fc110160030 2023-08-09T12:40:32.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.337+0000 7fc117322640 1 -- 172.21.15.17:0/2436366082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc110160030 msgr2=0x7fc110160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:32.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.337+0000 7fc117322640 1 --2- 172.21.15.17:0/2436366082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc110160030 0x7fc110160740 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0097a0 tx=0x7fc10c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.337+0000 7fc117322640 1 -- 172.21.15.17:0/2436366082 shutdown_connections 2023-08-09T12:40:32.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.337+0000 7fc117322640 1 --2- 172.21.15.17:0/2436366082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1100b86e0 0x7fc1100cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.337+0000 7fc117322640 1 --2- 172.21.15.17:0/2436366082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc110160030 0x7fc110160740 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.337+0000 7fc117322640 1 -- 172.21.15.17:0/2436366082 >> 172.21.15.17:0/2436366082 conn(0x7fc1100697c0 msgr2=0x7fc110069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:32.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.337+0000 7fc117322640 1 -- 172.21.15.17:0/2436366082 shutdown_connections 2023-08-09T12:40:32.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.337+0000 7fc117322640 1 -- 172.21.15.17:0/2436366082 wait complete. 2023-08-09T12:40:32.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.339+0000 7fc117322640 1 Processor -- start 2023-08-09T12:40:32.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.339+0000 7fc117322640 1 -- start start 2023-08-09T12:40:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.340+0000 7fc117322640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1100b86e0 0x7fc1100cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.340+0000 7fc117322640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cf980 0x7fc1100c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.340+0000 7fc117322640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc110160030 0x7fc1100c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.340+0000 7fc117322640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110156140 con 0x7fc1100b86e0 2023-08-09T12:40:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.340+0000 7fc117322640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100ccaf0 con 0x7fc1100cf980 2023-08-09T12:40:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.340+0000 7fc117322640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc110155530 con 0x7fc110160030 2023-08-09T12:40:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116320640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1100b86e0 0x7fc1100cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116320640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1100b86e0 0x7fc1100cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42972/0 (socket says 172.21.15.17:42972) 2023-08-09T12:40:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116320640 1 -- 172.21.15.17:0/1709796925 learned_addr learned my addr 172.21.15.17:0/1709796925 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc115b1f640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cf980 0x7fc1100c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116b21640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc110160030 0x7fc1100c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:32.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116320640 1 -- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc110160030 msgr2=0x7fc1100c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:32.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116320640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc110160030 0x7fc1100c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116320640 1 -- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cf980 msgr2=0x7fc1100c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:32.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116320640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cf980 0x7fc1100c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:32.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116320640 1 -- 172.21.15.17:0/1709796925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009400 con 0x7fc1100b86e0 2023-08-09T12:40:32.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.341+0000 7fc116b21640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc110160030 0x7fc1100c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.342+0000 7fc116320640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1100b86e0 0x7fc1100cc5b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc10c034040 tx=0x7fc10c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.342+0000 7fc106ffd640 1 -- 172.21.15.17:0/1709796925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c03aad0 con 0x7fc1100b86e0 2023-08-09T12:40:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.342+0000 7fc106ffd640 1 -- 172.21.15.17:0/1709796925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c03ac30 con 0x7fc1100b86e0 2023-08-09T12:40:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.342+0000 7fc106ffd640 1 -- 172.21.15.17:0/1709796925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c004030 con 0x7fc1100b86e0 2023-08-09T12:40:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.342+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc110155810 con 0x7fc1100b86e0 2023-08-09T12:40:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.342+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc110155dd0 con 0x7fc1100b86e0 2023-08-09T12:40:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.343+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11004e390 con 0x7fc1100b86e0 2023-08-09T12:40:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.344+0000 7fc106ffd640 1 -- 172.21.15.17:0/1709796925 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc10c042070 con 0x7fc1100b86e0 2023-08-09T12:40:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.345+0000 7fc106ffd640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0f406a050 0x7fc0f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.345+0000 7fc106ffd640 1 -- 172.21.15.17:0/1709796925 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc10c0aa130 con 0x7fc1100b86e0 2023-08-09T12:40:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.346+0000 7fc115b1f640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0f406a050 0x7fc0f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.347+0000 7fc115b1f640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0f406a050 0x7fc0f406c510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc1100d39b0 tx=0x7fc100008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:32.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.349+0000 7fc106ffd640 1 -- 172.21.15.17:0/1709796925 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc10c075bc0 con 0x7fc1100b86e0 2023-08-09T12:40:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:32.554+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc1100d0640 con 0x7fc1100b86e0 2023-08-09T12:40:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.035+0000 7fc106ffd640 1 -- 172.21.15.17:0/1709796925 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc10c0791e0 con 0x7fc1100b86e0 2023-08-09T12:40:33.038 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:40:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.038+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0f406a050 msgr2=0x7fc0f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0f406a050 0x7fc0f406c510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc1100d39b0 tx=0x7fc100008040 comp rx=0 tx=0).stop 2023-08-09T12:40:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1100b86e0 msgr2=0x7fc1100cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1100b86e0 0x7fc1100cc5b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc10c034040 tx=0x7fc10c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 shutdown_connections 2023-08-09T12:40:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0f406a050 0x7fc0f406c510 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc110160030 0x7fc1100c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cf980 0x7fc1100c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 --2- 172.21.15.17:0/1709796925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1100b86e0 0x7fc1100cc5b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 >> 172.21.15.17:0/1709796925 conn(0x7fc1100697c0 msgr2=0x7fc110069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 shutdown_connections 2023-08-09T12:40:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.039+0000 7fc117322640 1 -- 172.21.15.17:0/1709796925 wait complete. 2023-08-09T12:40:33.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:40:33.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.293+0000 7f148aa0d640 1 Processor -- start 2023-08-09T12:40:33.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.293+0000 7f148aa0d640 1 -- start start 2023-08-09T12:40:33.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.294+0000 7f148aa0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f148415ce90 0x7f14841616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.294+0000 7f148aa0d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14840d29d0 0x7f14840d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.294+0000 7f148aa0d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14840b6460 con 0x7f14840b6000 2023-08-09T12:40:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.294+0000 7f148aa0d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14840d33a0 con 0x7f14840d29d0 2023-08-09T12:40:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.294+0000 7f148aa0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840cdd10 con 0x7f148415ce90 2023-08-09T12:40:33.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.295+0000 7f14837fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f14840b6000 0x7f14840cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49406/0 (socket says 172.21.15.17:49406) 2023-08-09T12:40:33.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.295+0000 7f14837fe640 1 -- 172.21.15.17:0/763251911 learned_addr learned my addr 172.21.15.17:0/763251911 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:33.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.295+0000 7f1483fff640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f148415ce90 0x7f14841616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.295+0000 7f1488faa640 1 --2- 172.21.15.17:0/763251911 >> v2:172.21.15.142:3300/0 conn(0x7f14840d29d0 0x7f14840d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.295+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114888009 0 0) 0x7f14840b6460 con 0x7f14840b6000 2023-08-09T12:40:33.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.295+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f146c003520 con 0x7f14840b6000 2023-08-09T12:40:33.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2605666680 0 0) 0x7f146c003520 con 0x7f14840b6000 2023-08-09T12:40:33.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f148415ce90 msgr2=0x7f14841616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f148415ce90 0x7f14841616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 >> v2:172.21.15.142:3300/0 conn(0x7f14840d29d0 msgr2=0x7f14840d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 --2- 172.21.15.17:0/763251911 >> v2:172.21.15.142:3300/0 conn(0x7f14840d29d0 0x7f14840d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840cdff0 con 0x7f14840b6000 2023-08-09T12:40:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1478001670 con 0x7f14840b6000 2023-08-09T12:40:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 >> v1:172.21.15.17:6789/0 conn(0x7f14840b6000 legacy=0x7f14840cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f148415ce90 0x7f146c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f146c003ef0 0x7f146c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c004d00 0x7f146c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840d33a0 con 0x7f146c004d00 2023-08-09T12:40:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840cdd10 con 0x7f146c003ef0 2023-08-09T12:40:33.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c00b980 con 0x7f148415ce90 2023-08-09T12:40:33.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1488faa640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c004d00 0x7f146c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.296+0000 7f1483fff640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f148415ce90 0x7f146c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.297+0000 7f14837fe640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f146c003ef0 0x7f146c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.297+0000 7f1488faa640 1 -- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f148415ce90 msgr2=0x7f146c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.297+0000 7f1488faa640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f148415ce90 0x7f146c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.297+0000 7f1488faa640 1 -- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f146c003ef0 msgr2=0x7f146c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.297+0000 7f1488faa640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f146c003ef0 0x7f146c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.297+0000 7f1488faa640 1 -- 172.21.15.17:0/763251911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c003520 con 0x7f146c004d00 2023-08-09T12:40:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.297+0000 7f14837fe640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f146c003ef0 0x7f146c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.298+0000 7f1488faa640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c004d00 0x7f146c005180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f147c009ac0 tx=0x7f146c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d4efda7a4de499 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.298+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c02c6d0 con 0x7f146c004d00 2023-08-09T12:40:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.298+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c02c830 con 0x7f146c004d00 2023-08-09T12:40:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.298+0000 7f1482ffd640 1 -- 172.21.15.17:0/763251911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c02cbc0 con 0x7f146c004d00 2023-08-09T12:40:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.299+0000 7f148aa0d640 1 -- 172.21.15.17:0/763251911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c004d00 msgr2=0x7f146c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.299+0000 7f148aa0d640 1 --2- 172.21.15.17:0/763251911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c004d00 0x7f146c005180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f147c009ac0 tx=0x7f146c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.299+0000 7f1488faa640 1 -- 172.21.15.17:0/763251911 reap_dead start 2023-08-09T12:40:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.299+0000 7f148aa0d640 1 -- 172.21.15.17:0/763251911 shutdown_connections 2023-08-09T12:40:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.299+0000 7f148aa0d640 1 -- 172.21.15.17:0/763251911 >> 172.21.15.17:0/763251911 conn(0x7f148406fde0 msgr2=0x7f14840701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.299+0000 7f148aa0d640 1 -- 172.21.15.17:0/763251911 shutdown_connections 2023-08-09T12:40:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.299+0000 7f148aa0d640 1 -- 172.21.15.17:0/763251911 wait complete. 2023-08-09T12:40:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.301+0000 7f148aa0d640 1 Processor -- start 2023-08-09T12:40:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.301+0000 7f148aa0d640 1 -- start start 2023-08-09T12:40:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f148aa0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f146c004d00 0x7f14841f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f148aa0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148414f290 0x7f148415fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f148aa0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f148415ff60 0x7f14840cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f148aa0d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1484160410 con 0x7f148414f290 2023-08-09T12:40:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f148aa0d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148415d560 con 0x7f148415ff60 2023-08-09T12:40:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f148aa0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148415d840 con 0x7f146c004d00 2023-08-09T12:40:33.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f14837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148414f290 0x7f148415fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f14837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148414f290 0x7f148415fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42978/0 (socket says 172.21.15.17:42978) 2023-08-09T12:40:33.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.302+0000 7f14837fe640 1 -- 172.21.15.17:0/1274527020 learned_addr learned my addr 172.21.15.17:0/1274527020 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:33.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f1483fff640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f146c004d00 0x7f14841f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f1488faa640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f148415ff60 0x7f14840cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f14837fe640 1 -- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f146c004d00 msgr2=0x7f14841f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f14837fe640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f146c004d00 0x7f14841f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f14837fe640 1 -- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f148415ff60 msgr2=0x7f14840cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f14837fe640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f148415ff60 0x7f14840cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f14837fe640 1 -- 172.21.15.17:0/1274527020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148415db20 con 0x7f148414f290 2023-08-09T12:40:33.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f14837fe640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148414f290 0x7f148415fa20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f14780018a0 tx=0x7f147800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:33.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f1480ff9640 1 -- 172.21.15.17:0/1274527020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780074e0 con 0x7f148414f290 2023-08-09T12:40:33.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f1480ff9640 1 -- 172.21.15.17:0/1274527020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478007640 con 0x7f148414f290 2023-08-09T12:40:33.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f1480ff9640 1 -- 172.21.15.17:0/1274527020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780049e0 con 0x7f148414f290 2023-08-09T12:40:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.303+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148415de00 con 0x7f148414f290 2023-08-09T12:40:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.304+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14840cc1f0 con 0x7f148414f290 2023-08-09T12:40:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.305+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148415e320 con 0x7f148414f290 2023-08-09T12:40:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.306+0000 7f1480ff9640 1 -- 172.21.15.17:0/1274527020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1478004b40 con 0x7f148414f290 2023-08-09T12:40:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.307+0000 7f1480ff9640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f147006a080 0x7f147006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.307+0000 7f1480ff9640 1 -- 172.21.15.17:0/1274527020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1478088120 con 0x7f148414f290 2023-08-09T12:40:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.308+0000 7f1483fff640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f147006a080 0x7f147006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.309+0000 7f1483fff640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f147006a080 0x7f147006c540 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14840b1f00 tx=0x7f147400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:33.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.311+0000 7f1480ff9640 1 -- 172.21.15.17:0/1274527020 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f148415e320 con 0x7f148414f290 2023-08-09T12:40:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.575+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f148415e320 con 0x7f148414f290 2023-08-09T12:40:33.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.576+0000 7f1480ff9640 1 -- 172.21.15.17:0/1274527020 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f148415e320 con 0x7f148414f290 2023-08-09T12:40:33.580 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:33.580 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:40:33.580 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:40:33.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.580 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:40:33.581 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:40:33.581 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.581 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:40:33.581 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:40:33.581 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:40:33.581 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.582 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:40:33.582 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:40:33.582 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.582 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:40:33.582 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:40:33.583 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:40:33.583 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.583 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:40:33.583 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:40:33.583 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.584 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:40:33.584 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:40:33.584 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:40:33.584 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.585 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:40:33.585 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:40:33.585 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.585 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:40:33.585 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:40:33.585 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:40:33.585 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.586 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:40:33.586 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:40:33.586 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:40:33.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:40:33.587 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.587 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:40:33.587 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:40:33.587 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.587 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:40:33.588 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:40:33.588 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.588 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:40:33.588 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:40:33.588 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.589 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:40:33.589 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:40:33.589 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.589 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:40:33.590 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:40:33.590 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.590 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:40:33.590 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:40:33.590 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.591 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:40:33.591 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:40:33.591 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.591 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:40:33.591 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:40:33.591 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.592 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:40:33.592 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:40:33.592 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.592 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:40:33.592 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:40:33.592 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.592 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.593 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:40:33.594 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:40:33.594 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.594 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:40:33.594 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:40:33.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.595 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:40:33.595 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:40:33.595 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.595 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:40:33.595 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:40:33.595 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.596 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:40:33.596 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:40:33.596 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.596 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:40:33.596 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:40:33.596 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:40:33.597 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:40:33.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.597 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:40:33.597 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:40:33.597 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.597 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:40:33.598 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:40:33.598 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:40:33.598 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:40:33.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.598 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:40:33.598 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:40:33.599 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:40:33.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:40:33.599 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:40:33.599 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:40:33.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.600 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:40:33.600 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:40:33.600 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:40:33.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:40:33.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:40:33.600 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:40:33.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.601 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:40:33.601 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:40:33.601 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:40:33.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:40:33.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:40:33.602 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.602 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.602 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-mds", 2023-08-09T12:40:33.602 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDniNNkhkJTKBAAhBBu/T8Y4Ny0WRtuumZdjg==", 2023-08-09T12:40:33.602 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-mds" 2023-08-09T12:40:33.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.603 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-mgr", 2023-08-09T12:40:33.603 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDniNNkAWBTKBAAEQM6mZq2DAh1EpU+zMZgqA==", 2023-08-09T12:40:33.603 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.603 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-09T12:40:33.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.605 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-osd", 2023-08-09T12:40:33.605 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDniNNkp3hTKBAAGcEPPcRWVHHMBVUyDVvkZg==", 2023-08-09T12:40:33.606 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.606 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-osd" 2023-08-09T12:40:33.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.606 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rbd", 2023-08-09T12:40:33.606 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDniNNkL5FTKBAATJvGcOSPkNPVGKhdSVKLxw==", 2023-08-09T12:40:33.606 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.607 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-09T12:40:33.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.607 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-09T12:40:33.607 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDniNNk+alTKBAA3kEVVykQBzfm13VURCa/2w==", 2023-08-09T12:40:33.607 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-09T12:40:33.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.608 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rgw", 2023-08-09T12:40:33.608 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDniNNkOMNTKBAA3S2HyxPZZ4aOk7bd27ydkA==", 2023-08-09T12:40:33.608 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-09T12:40:33.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.609 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:40:33.609 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:40:33.609 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:40:33.609 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:40:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:40:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:40:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:40:33.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:40:33.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:40:33.611 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:40:33.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:33.611 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:40:33.611 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:40:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f147006a080 msgr2=0x7f147006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f147006a080 0x7f147006c540 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14840b1f00 tx=0x7f147400b040 comp rx=0 tx=0).stop 2023-08-09T12:40:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148414f290 msgr2=0x7f148415fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148414f290 0x7f148415fa20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f14780018a0 tx=0x7f147800df70 comp rx=0 tx=0).stop 2023-08-09T12:40:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 shutdown_connections 2023-08-09T12:40:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f147006a080 0x7f147006c540 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f148415ff60 0x7f14840cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148414f290 0x7f148415fa20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 --2- 172.21.15.17:0/1274527020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f146c004d00 0x7f14841f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 >> 172.21.15.17:0/1274527020 conn(0x7f148406fde0 msgr2=0x7f14840cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 shutdown_connections 2023-08-09T12:40:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.579+0000 7f148aa0d640 1 -- 172.21.15.17:0/1274527020 wait complete. 2023-08-09T12:40:33.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-09T12:40:33.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.848+0000 7f79b9eec640 1 Processor -- start 2023-08-09T12:40:33.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.848+0000 7f79b9eec640 1 -- start start 2023-08-09T12:40:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.849+0000 7f79b9eec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79b40adc40 0x7f79b406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.849+0000 7f79b9eec640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3b40 0x7f79b40b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.850+0000 7f79b9eec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40b2250 con 0x7f79b415e8f0 2023-08-09T12:40:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.850+0000 7f79b9eec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40ae020 con 0x7f79b40adc40 2023-08-09T12:40:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.850+0000 7f79b9eec640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40b2530 con 0x7f79b40b3b40 2023-08-09T12:40:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.850+0000 7f79b37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79b40adc40 0x7f79b406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.850+0000 7f79b37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79b40adc40 0x7f79b406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42988/0 (socket says 172.21.15.17:42988) 2023-08-09T12:40:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.850+0000 7f79b37fe640 1 -- 172.21.15.17:0/1299696721 learned_addr learned my addr 172.21.15.17:0/1299696721 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.850+0000 7f79aaffd640 1 --2- 172.21.15.17:0/1299696721 >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3b40 0x7f79b40b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.851+0000 7f79b37fe640 1 -- 172.21.15.17:0/1299696721 >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3b40 msgr2=0x7f79b40b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.851+0000 7f79b37fe640 1 --2- 172.21.15.17:0/1299696721 >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3b40 0x7f79b40b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.851+0000 7f79b37fe640 1 -- 172.21.15.17:0/1299696721 >> v1:172.21.15.142:6789/0 conn(0x7f79b415e8f0 legacy=0x7f79b415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.851+0000 7f79b37fe640 1 -- 172.21.15.17:0/1299696721 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b406fe80 con 0x7f79b40adc40 2023-08-09T12:40:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.852+0000 7f79b37fe640 1 --2- 172.21.15.17:0/1299696721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b406c280 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b48a0 tx=0x7f79a402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4ea4136ab3228e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.852+0000 7f79b2ffd640 1 -- 172.21.15.17:0/1299696721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a402ca80 con 0x7f79b40adc40 2023-08-09T12:40:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.852+0000 7f79b2ffd640 1 -- 172.21.15.17:0/1299696721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a402cbe0 con 0x7f79b40adc40 2023-08-09T12:40:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.852+0000 7f79b2ffd640 1 -- 172.21.15.17:0/1299696721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a40343f0 con 0x7f79b40adc40 2023-08-09T12:40:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.853+0000 7f79b9eec640 1 -- 172.21.15.17:0/1299696721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 msgr2=0x7f79b406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.853+0000 7f79b9eec640 1 --2- 172.21.15.17:0/1299696721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b406c280 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b48a0 tx=0x7f79a402bee0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.853+0000 7f79b9eec640 1 -- 172.21.15.17:0/1299696721 shutdown_connections 2023-08-09T12:40:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.853+0000 7f79b9eec640 1 --2- 172.21.15.17:0/1299696721 >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3b40 0x7f79b40b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.853+0000 7f79b9eec640 1 --2- 172.21.15.17:0/1299696721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b406c280 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.853+0000 7f79b9eec640 1 -- 172.21.15.17:0/1299696721 >> 172.21.15.17:0/1299696721 conn(0x7f79b40cb1b0 msgr2=0x7f79b40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.853+0000 7f79b9eec640 1 -- 172.21.15.17:0/1299696721 shutdown_connections 2023-08-09T12:40:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.853+0000 7f79b9eec640 1 -- 172.21.15.17:0/1299696721 wait complete. 2023-08-09T12:40:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.855+0000 7f79b9eec640 1 Processor -- start 2023-08-09T12:40:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.855+0000 7f79b9eec640 1 -- start start 2023-08-09T12:40:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b9eec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b41f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b9eec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79b40b3b40 0x7f79b40af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b9eec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b415e8f0 0x7f79b40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b9eec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b41f2970 con 0x7f79b40adc40 2023-08-09T12:40:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b9eec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c8370 con 0x7f79b40b3b40 2023-08-09T12:40:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b9eec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c70e0 con 0x7f79b415e8f0 2023-08-09T12:40:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b41f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b41f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42996/0 (socket says 172.21.15.17:42996) 2023-08-09T12:40:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.856+0000 7f79b37fe640 1 -- 172.21.15.17:0/3847118614 learned_addr learned my addr 172.21.15.17:0/3847118614 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79aaffd640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79b40b3b40 0x7f79b40af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79b3fff640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b415e8f0 0x7f79b40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79b37fe640 1 -- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b415e8f0 msgr2=0x7f79b40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79b37fe640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b415e8f0 0x7f79b40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79b37fe640 1 -- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79b40b3b40 msgr2=0x7f79b40af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79b37fe640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79b40b3b40 0x7f79b40af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79b37fe640 1 -- 172.21.15.17:0/3847118614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4009b30 con 0x7f79b40adc40 2023-08-09T12:40:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79aaffd640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79b40b3b40 0x7f79b40af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79b3fff640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b415e8f0 0x7f79b40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.857+0000 7f79b37fe640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b41f2430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000f80 tx=0x7f79a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.858+0000 7f79b0ff9640 1 -- 172.21.15.17:0/3847118614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4009510 con 0x7f79b40adc40 2023-08-09T12:40:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.858+0000 7f79b0ff9640 1 -- 172.21.15.17:0/3847118614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a403e450 con 0x7f79b40adc40 2023-08-09T12:40:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.858+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40c73c0 con 0x7f79b40adc40 2023-08-09T12:40:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.858+0000 7f79b0ff9640 1 -- 172.21.15.17:0/3847118614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a403e800 con 0x7f79b40adc40 2023-08-09T12:40:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.858+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b40c7980 con 0x7f79b40adc40 2023-08-09T12:40:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.859+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b4067a80 con 0x7f79b40adc40 2023-08-09T12:40:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.860+0000 7f79b0ff9640 1 -- 172.21.15.17:0/3847118614 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79a402cd50 con 0x7f79b40adc40 2023-08-09T12:40:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.861+0000 7f79b0ff9640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f799406a050 0x7f799406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.861+0000 7f79b0ff9640 1 -- 172.21.15.17:0/3847118614 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f79a40aaef0 con 0x7f79b40adc40 2023-08-09T12:40:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.862+0000 7f79aaffd640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f799406a050 0x7f799406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.863+0000 7f79aaffd640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f799406a050 0x7f799406c510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79b41f5f10 tx=0x7f799c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:33.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:33.866+0000 7f79b0ff9640 1 -- 172.21.15.17:0/3847118614 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f79a4076810 con 0x7f79b40adc40 2023-08-09T12:40:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.135+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f79b40c8cf0 con 0x7f79b40adc40 2023-08-09T12:40:34.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.143+0000 7f79b0ff9640 1 -- 172.21.15.17:0/3847118614 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f79a4079e30 con 0x7f79b40adc40 2023-08-09T12:40:34.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f799406a050 msgr2=0x7f799406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f799406a050 0x7f799406c510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79b41f5f10 tx=0x7f799c008040 comp rx=0 tx=0).stop 2023-08-09T12:40:34.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 msgr2=0x7f79b41f2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b41f2430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000f80 tx=0x7f79a4004a40 comp rx=0 tx=0).stop 2023-08-09T12:40:34.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 shutdown_connections 2023-08-09T12:40:34.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f799406a050 0x7f799406c510 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b415e8f0 0x7f79b40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79b40b3b40 0x7f79b40af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 --2- 172.21.15.17:0/3847118614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b40adc40 0x7f79b41f2430 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.145+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 >> 172.21.15.17:0/3847118614 conn(0x7f79b40cb1b0 msgr2=0x7f79b415c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:34.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.146+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 shutdown_connections 2023-08-09T12:40:34.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.146+0000 7f79b9eec640 1 -- 172.21.15.17:0/3847118614 wait complete. 2023-08-09T12:40:34.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-09T12:40:34.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.382+0000 7f80f462d640 1 Processor -- start 2023-08-09T12:40:34.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.383+0000 7f80f462d640 1 -- start start 2023-08-09T12:40:34.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.384+0000 7f80f462d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80ec1616e0 0x7f80ec0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.384+0000 7f80f462d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80ec0d29d0 0x7f80ec0d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.384+0000 7f80f462d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec0d3360 con 0x7f80ec15ce90 2023-08-09T12:40:34.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.384+0000 7f80f462d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec0b6540 con 0x7f80ec0d29d0 2023-08-09T12:40:34.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.384+0000 7f80f462d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec0cdd10 con 0x7f80ec1616e0 2023-08-09T12:40:34.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.385+0000 7f80f2bca640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80ec0d29d0 0x7f80ec0d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.385+0000 7f80f2bca640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80ec0d29d0 0x7f80ec0d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43012/0 (socket says 172.21.15.17:43012) 2023-08-09T12:40:34.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.385+0000 7f80f2bca640 1 -- 172.21.15.17:0/3516350300 learned_addr learned my addr 172.21.15.17:0/3516350300 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:34.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.385+0000 7f80f1bc8640 1 --2- 172.21.15.17:0/3516350300 >> v2:172.21.15.142:3300/0 conn(0x7f80ec1616e0 0x7f80ec0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.385+0000 7f80f2bca640 1 -- 172.21.15.17:0/3516350300 >> v2:172.21.15.142:3300/0 conn(0x7f80ec1616e0 msgr2=0x7f80ec0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:34.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.385+0000 7f80f2bca640 1 --2- 172.21.15.17:0/3516350300 >> v2:172.21.15.142:3300/0 conn(0x7f80ec1616e0 0x7f80ec0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.385+0000 7f80f2bca640 1 -- 172.21.15.17:0/3516350300 >> v1:172.21.15.142:6789/0 conn(0x7f80ec15ce90 legacy=0x7f80ec0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:34.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.385+0000 7f80f2bca640 1 -- 172.21.15.17:0/3516350300 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0cdff0 con 0x7f80ec0d29d0 2023-08-09T12:40:34.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.387+0000 7f80f2bca640 1 --2- 172.21.15.17:0/3516350300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec0d2e20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0c9c00 tx=0x7f80e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e03ef88b0f1729 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:34.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.387+0000 7f80f13c7640 1 -- 172.21.15.17:0/3516350300 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4031870 con 0x7f80ec0d29d0 2023-08-09T12:40:34.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.387+0000 7f80f13c7640 1 -- 172.21.15.17:0/3516350300 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e40319d0 con 0x7f80ec0d29d0 2023-08-09T12:40:34.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.387+0000 7f80f13c7640 1 -- 172.21.15.17:0/3516350300 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4031d60 con 0x7f80ec0d29d0 2023-08-09T12:40:34.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.388+0000 7f80f462d640 1 -- 172.21.15.17:0/3516350300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 msgr2=0x7f80ec0d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.388+0000 7f80f462d640 1 --2- 172.21.15.17:0/3516350300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec0d2e20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0c9c00 tx=0x7f80e402b910 comp rx=0 tx=0).stop 2023-08-09T12:40:34.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.388+0000 7f80f462d640 1 -- 172.21.15.17:0/3516350300 shutdown_connections 2023-08-09T12:40:34.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.388+0000 7f80f462d640 1 --2- 172.21.15.17:0/3516350300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec0d2e20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.388+0000 7f80f462d640 1 --2- 172.21.15.17:0/3516350300 >> v2:172.21.15.142:3300/0 conn(0x7f80ec1616e0 0x7f80ec0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.388+0000 7f80f462d640 1 -- 172.21.15.17:0/3516350300 >> 172.21.15.17:0/3516350300 conn(0x7f80ec06fde0 msgr2=0x7f80ec0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:34.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.388+0000 7f80f462d640 1 -- 172.21.15.17:0/3516350300 shutdown_connections 2023-08-09T12:40:34.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.388+0000 7f80f462d640 1 -- 172.21.15.17:0/3516350300 wait complete. 2023-08-09T12:40:34.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.390+0000 7f80f462d640 1 Processor -- start 2023-08-09T12:40:34.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.390+0000 7f80f462d640 1 -- start start 2023-08-09T12:40:34.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f462d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f462d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80ec15ce90 0x7f80ec1e6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f462d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ec1616e0 0x7f80ec156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f462d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec1e7940 con 0x7f80ec0d29d0 2023-08-09T12:40:34.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f462d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec152870 con 0x7f80ec1616e0 2023-08-09T12:40:34.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f462d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0ca810 con 0x7f80ec15ce90 2023-08-09T12:40:34.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f23c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f23c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43016/0 (socket says 172.21.15.17:43016) 2023-08-09T12:40:34.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.391+0000 7f80f23c9640 1 -- 172.21.15.17:0/524013613 learned_addr learned my addr 172.21.15.17:0/524013613 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:34.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f1bc8640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80ec15ce90 0x7f80ec1e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f2bca640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ec1616e0 0x7f80ec156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f23c9640 1 -- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80ec15ce90 msgr2=0x7f80ec1e6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f23c9640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80ec15ce90 0x7f80ec1e6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f23c9640 1 -- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ec1616e0 msgr2=0x7f80ec156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f23c9640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ec1616e0 0x7f80ec156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f23c9640 1 -- 172.21.15.17:0/524013613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40094d0 con 0x7f80ec0d29d0 2023-08-09T12:40:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f1bc8640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80ec15ce90 0x7f80ec1e6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80f23c9640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec152330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c7c0 tx=0x7f80e800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.392+0000 7f80e2ffd640 1 -- 172.21.15.17:0/524013613 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800aa50 con 0x7f80ec0d29d0 2023-08-09T12:40:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.393+0000 7f80e2ffd640 1 -- 172.21.15.17:0/524013613 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e800abb0 con 0x7f80ec0d29d0 2023-08-09T12:40:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.393+0000 7f80e2ffd640 1 -- 172.21.15.17:0/524013613 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8012420 con 0x7f80ec0d29d0 2023-08-09T12:40:34.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.393+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec1e70a0 con 0x7f80ec0d29d0 2023-08-09T12:40:34.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.393+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec1e7660 con 0x7f80ec0d29d0 2023-08-09T12:40:34.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.394+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec067a80 con 0x7f80ec0d29d0 2023-08-09T12:40:34.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.395+0000 7f80e2ffd640 1 -- 172.21.15.17:0/524013613 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80e8012580 con 0x7f80ec0d29d0 2023-08-09T12:40:34.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.396+0000 7f80e2ffd640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80d006a050 0x7f80d006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.396+0000 7f80e2ffd640 1 -- 172.21.15.17:0/524013613 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f80e8088140 con 0x7f80ec0d29d0 2023-08-09T12:40:34.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.397+0000 7f80f1bc8640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80d006a050 0x7f80d006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.398+0000 7f80f1bc8640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80d006a050 0x7f80d006c510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f80dc006fd0 tx=0x7f80dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:34.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.401+0000 7f80e2ffd640 1 -- 172.21.15.17:0/524013613 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f80e8053c10 con 0x7f80ec0d29d0 2023-08-09T12:40:34.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.653+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f80ec0d0ad0 con 0x7f80ec0d29d0 2023-08-09T12:40:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.660+0000 7f80e2ffd640 1 -- 172.21.15.17:0/524013613 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f80e8057230 con 0x7f80ec0d29d0 2023-08-09T12:40:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80d006a050 msgr2=0x7f80d006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80d006a050 0x7f80d006c510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f80dc006fd0 tx=0x7f80dc008040 comp rx=0 tx=0).stop 2023-08-09T12:40:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 msgr2=0x7f80ec152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec152330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c7c0 tx=0x7f80e800cc80 comp rx=0 tx=0).stop 2023-08-09T12:40:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 shutdown_connections 2023-08-09T12:40:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80d006a050 0x7f80d006c510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ec1616e0 0x7f80ec156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80ec15ce90 0x7f80ec1e6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 --2- 172.21.15.17:0/524013613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ec0d29d0 0x7f80ec152330 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 >> 172.21.15.17:0/524013613 conn(0x7f80ec06fde0 msgr2=0x7f80ec0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.663+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 shutdown_connections 2023-08-09T12:40:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.664+0000 7f80f462d640 1 -- 172.21.15.17:0/524013613 wait complete. 2023-08-09T12:40:34.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-09T12:40:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.890+0000 7f4c58271640 1 Processor -- start 2023-08-09T12:40:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.890+0000 7f4c58271640 1 -- start start 2023-08-09T12:40:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.892+0000 7f4c58271640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500adc40 0x7f4c5006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.892+0000 7f4c58271640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c500cc630 0x7f4c500ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.892+0000 7f4c58271640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500b2250 con 0x7f4c500b3b40 2023-08-09T12:40:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.892+0000 7f4c58271640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500ae020 con 0x7f4c500cc630 2023-08-09T12:40:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.892+0000 7f4c58271640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500b2530 con 0x7f4c500adc40 2023-08-09T12:40:34.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.892+0000 7f4c5680e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c500cc630 0x7f4c500ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.892+0000 7f4c5680e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c500cc630 0x7f4c500ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43030/0 (socket says 172.21.15.17:43030) 2023-08-09T12:40:34.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.892+0000 7f4c5680e640 1 -- 172.21.15.17:0/1711239348 learned_addr learned my addr 172.21.15.17:0/1711239348 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:34.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.893+0000 7f4c5600d640 1 --2- 172.21.15.17:0/1711239348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500adc40 0x7f4c5006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.893+0000 7f4c5680e640 1 -- 172.21.15.17:0/1711239348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500adc40 msgr2=0x7f4c5006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:34.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.893+0000 7f4c5680e640 1 --2- 172.21.15.17:0/1711239348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500adc40 0x7f4c5006c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.893+0000 7f4c5680e640 1 -- 172.21.15.17:0/1711239348 >> v1:172.21.15.142:6789/0 conn(0x7f4c500b3b40 legacy=0x7f4c500b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:34.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.893+0000 7f4c5680e640 1 -- 172.21.15.17:0/1711239348 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5006fe80 con 0x7f4c500cc630 2023-08-09T12:40:34.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.894+0000 7f4c5680e640 1 --2- 172.21.15.17:0/1711239348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c500ccac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009e50 tx=0x7f4c4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9900fcedbf35fa server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:34.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c5500b640 1 -- 172.21.15.17:0/1711239348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4802ca70 con 0x7f4c500cc630 2023-08-09T12:40:34.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c5500b640 1 -- 172.21.15.17:0/1711239348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4802cbd0 con 0x7f4c500cc630 2023-08-09T12:40:34.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c5500b640 1 -- 172.21.15.17:0/1711239348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480343f0 con 0x7f4c500cc630 2023-08-09T12:40:34.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c58271640 1 -- 172.21.15.17:0/1711239348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 msgr2=0x7f4c500ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c58271640 1 --2- 172.21.15.17:0/1711239348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c500ccac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009e50 tx=0x7f4c4802bed0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c58271640 1 -- 172.21.15.17:0/1711239348 shutdown_connections 2023-08-09T12:40:34.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c58271640 1 --2- 172.21.15.17:0/1711239348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c500ccac0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c58271640 1 --2- 172.21.15.17:0/1711239348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500adc40 0x7f4c5006c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.895+0000 7f4c58271640 1 -- 172.21.15.17:0/1711239348 >> 172.21.15.17:0/1711239348 conn(0x7f4c500cb1b0 msgr2=0x7f4c500cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:34.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.896+0000 7f4c58271640 1 -- 172.21.15.17:0/1711239348 shutdown_connections 2023-08-09T12:40:34.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.896+0000 7f4c58271640 1 -- 172.21.15.17:0/1711239348 wait complete. 2023-08-09T12:40:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.898+0000 7f4c58271640 1 Processor -- start 2023-08-09T12:40:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.898+0000 7f4c58271640 1 -- start start 2023-08-09T12:40:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.899+0000 7f4c58271640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c500adc40 0x7f4c500ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.899+0000 7f4c58271640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500b3b40 0x7f4c500c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.899+0000 7f4c58271640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c50153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.899+0000 7f4c58271640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5015ce40 con 0x7f4c500cc630 2023-08-09T12:40:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.899+0000 7f4c58271640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500ab1c0 con 0x7f4c500adc40 2023-08-09T12:40:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.899+0000 7f4c58271640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500ab4a0 con 0x7f4c500b3b40 2023-08-09T12:40:34.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c50153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c50153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43032/0 (socket says 172.21.15.17:43032) 2023-08-09T12:40:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 -- 172.21.15.17:0/830345931 learned_addr learned my addr 172.21.15.17:0/830345931 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5600d640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c500adc40 0x7f4c500ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5580c640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500b3b40 0x7f4c500c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 -- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500b3b40 msgr2=0x7f4c500c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500b3b40 0x7f4c500c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 -- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c500adc40 msgr2=0x7f4c500ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c500adc40 0x7f4c500ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 -- 172.21.15.17:0/830345931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009b30 con 0x7f4c500cc630 2023-08-09T12:40:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5600d640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c500adc40 0x7f4c500ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.900+0000 7f4c5680e640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c50153860 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4c48036040 tx=0x7f4c48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.901+0000 7f4c46ffd640 1 -- 172.21.15.17:0/830345931 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4803e450 con 0x7f4c500cc630 2023-08-09T12:40:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.901+0000 7f4c46ffd640 1 -- 172.21.15.17:0/830345931 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4803e5d0 con 0x7f4c500cc630 2023-08-09T12:40:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.901+0000 7f4c46ffd640 1 -- 172.21.15.17:0/830345931 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4803e980 con 0x7f4c500cc630 2023-08-09T12:40:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.901+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c500ab780 con 0x7f4c500cc630 2023-08-09T12:40:34.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.901+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c500abd40 con 0x7f4c500cc630 2023-08-09T12:40:34.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.902+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c500abed0 con 0x7f4c500cc630 2023-08-09T12:40:34.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.903+0000 7f4c46ffd640 1 -- 172.21.15.17:0/830345931 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4c4803eae0 con 0x7f4c500cc630 2023-08-09T12:40:34.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.904+0000 7f4c46ffd640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c3406a050 0x7f4c3406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:34.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.904+0000 7f4c46ffd640 1 -- 172.21.15.17:0/830345931 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4c480ab0d0 con 0x7f4c500cc630 2023-08-09T12:40:34.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.905+0000 7f4c5600d640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c3406a050 0x7f4c3406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.906+0000 7f4c5600d640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c3406a050 0x7f4c3406c510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006fd0 tx=0x7f4c4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:34.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:34.909+0000 7f4c46ffd640 1 -- 172.21.15.17:0/830345931 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4c48076a70 con 0x7f4c500cc630 2023-08-09T12:40:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.162+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f4c50067a80 con 0x7f4c500cc630 2023-08-09T12:40:35.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.168+0000 7f4c46ffd640 1 -- 172.21.15.17:0/830345931 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4c4807a090 con 0x7f4c500cc630 2023-08-09T12:40:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c3406a050 msgr2=0x7f4c3406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c3406a050 0x7f4c3406c510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006fd0 tx=0x7f4c4c008040 comp rx=0 tx=0).stop 2023-08-09T12:40:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 msgr2=0x7f4c50153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c50153860 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4c48036040 tx=0x7f4c48004a40 comp rx=0 tx=0).stop 2023-08-09T12:40:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 shutdown_connections 2023-08-09T12:40:35.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c3406a050 0x7f4c3406c510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c500cc630 0x7f4c50153860 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c500b3b40 0x7f4c500c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 --2- 172.21.15.17:0/830345931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c500adc40 0x7f4c500ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 >> 172.21.15.17:0/830345931 conn(0x7f4c500cb1b0 msgr2=0x7f4c500af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:35.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 shutdown_connections 2023-08-09T12:40:35.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.171+0000 7f4c58271640 1 -- 172.21.15.17:0/830345931 wait complete. 2023-08-09T12:40:35.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-09T12:40:35.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.418+0000 7ff8b93ab640 1 Processor -- start 2023-08-09T12:40:35.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.418+0000 7ff8b93ab640 1 -- start start 2023-08-09T12:40:35.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.419+0000 7ff8b93ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b41616e0 0x7ff8b40b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.419+0000 7ff8b93ab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8b40d29d0 0x7ff8b40d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.419+0000 7ff8b93ab640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b40cdd10 con 0x7ff8b415ce90 2023-08-09T12:40:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.419+0000 7ff8b93ab640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40b6540 con 0x7ff8b40d29d0 2023-08-09T12:40:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.419+0000 7ff8b93ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40d33a0 con 0x7ff8b41616e0 2023-08-09T12:40:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8b40d29d0 0x7ff8b40d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8b40d29d0 0x7ff8b40d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43048/0 (socket says 172.21.15.17:43048) 2023-08-09T12:40:35.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b37fe640 1 -- 172.21.15.17:0/2796619057 learned_addr learned my addr 172.21.15.17:0/2796619057 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:35.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b2ffd640 1 --1- 172.21.15.17:0/2796619057 >> v1:172.21.15.17:6789/0 conn(0x7ff8b415ce90 0x7ff8b40cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49414/0 (socket says 172.21.15.17:49414) 2023-08-09T12:40:35.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b27fc640 1 --2- 172.21.15.17:0/2796619057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b41616e0 0x7ff8b40b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b37fe640 1 -- 172.21.15.17:0/2796619057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b41616e0 msgr2=0x7ff8b40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b37fe640 1 --2- 172.21.15.17:0/2796619057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b41616e0 0x7ff8b40b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b37fe640 1 -- 172.21.15.17:0/2796619057 >> v1:172.21.15.17:6789/0 conn(0x7ff8b415ce90 legacy=0x7ff8b40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.420+0000 7ff8b37fe640 1 -- 172.21.15.17:0/2796619057 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40cdff0 con 0x7ff8b40d29d0 2023-08-09T12:40:35.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.422+0000 7ff8b37fe640 1 --2- 172.21.15.17:0/2796619057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b40d29d0 0x7ff8b40d2e60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009870 tx=0x7ff8ac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2609498abf51cbd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.422+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2796619057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac030840 con 0x7ff8b40d29d0 2023-08-09T12:40:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.422+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2796619057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0309a0 con 0x7ff8b40d29d0 2023-08-09T12:40:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.422+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2796619057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac030d30 con 0x7ff8b40d29d0 2023-08-09T12:40:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.422+0000 7ff8b93ab640 1 -- 172.21.15.17:0/2796619057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b40d29d0 msgr2=0x7ff8b40d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.422+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/2796619057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b40d29d0 0x7ff8b40d2e60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009870 tx=0x7ff8ac02b980 comp rx=0 tx=0).stop 2023-08-09T12:40:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.423+0000 7ff8b93ab640 1 -- 172.21.15.17:0/2796619057 shutdown_connections 2023-08-09T12:40:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.423+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/2796619057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b40d29d0 0x7ff8b40d2e60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.423+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/2796619057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b41616e0 0x7ff8b40b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.423+0000 7ff8b93ab640 1 -- 172.21.15.17:0/2796619057 >> 172.21.15.17:0/2796619057 conn(0x7ff8b406fde0 msgr2=0x7ff8b40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.423+0000 7ff8b93ab640 1 -- 172.21.15.17:0/2796619057 shutdown_connections 2023-08-09T12:40:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.423+0000 7ff8b93ab640 1 -- 172.21.15.17:0/2796619057 wait complete. 2023-08-09T12:40:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.424+0000 7ff8b93ab640 1 Processor -- start 2023-08-09T12:40:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.425+0000 7ff8b93ab640 1 -- start start 2023-08-09T12:40:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b93ab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b40d29d0 0x7ff8b40cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b93ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b415ce90 0x7ff8b414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b93ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b41616e0 0x7ff8b414a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b93ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40cbe50 con 0x7ff8b41616e0 2023-08-09T12:40:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b93ab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b414a090 con 0x7ff8b40d29d0 2023-08-09T12:40:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b93ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4149480 con 0x7ff8b415ce90 2023-08-09T12:40:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b41616e0 0x7ff8b414a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b41616e0 0x7ff8b414a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43050/0 (socket says 172.21.15.17:43050) 2023-08-09T12:40:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b37fe640 1 -- 172.21.15.17:0/57082983 learned_addr learned my addr 172.21.15.17:0/57082983 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b2ffd640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b40d29d0 0x7ff8b40cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b37fe640 1 -- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b415ce90 msgr2=0x7ff8b414c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b37fe640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b415ce90 0x7ff8b414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b37fe640 1 -- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b40d29d0 msgr2=0x7ff8b40cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b37fe640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b40d29d0 0x7ff8b40cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b37fe640 1 -- 172.21.15.17:0/57082983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0094d0 con 0x7ff8b41616e0 2023-08-09T12:40:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.426+0000 7ff8b2ffd640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b40d29d0 0x7ff8b40cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.427+0000 7ff8b37fe640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b41616e0 0x7ff8b414a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009870 tx=0x7ff8ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.427+0000 7ff8ab7fe640 1 -- 172.21.15.17:0/57082983 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac039c90 con 0x7ff8b41616e0 2023-08-09T12:40:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.427+0000 7ff8ab7fe640 1 -- 172.21.15.17:0/57082983 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac039e10 con 0x7ff8b41616e0 2023-08-09T12:40:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.427+0000 7ff8ab7fe640 1 -- 172.21.15.17:0/57082983 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac043640 con 0x7ff8b41616e0 2023-08-09T12:40:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.427+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b4149760 con 0x7ff8b41616e0 2023-08-09T12:40:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.427+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b4149d20 con 0x7ff8b41616e0 2023-08-09T12:40:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.428+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b4067a80 con 0x7ff8b41616e0 2023-08-09T12:40:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.429+0000 7ff8ab7fe640 1 -- 172.21.15.17:0/57082983 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff8ac0437a0 con 0x7ff8b41616e0 2023-08-09T12:40:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.430+0000 7ff8ab7fe640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff89406a080 0x7ff89406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.430+0000 7ff8ab7fe640 1 -- 172.21.15.17:0/57082983 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff8ac03e070 con 0x7ff8b41616e0 2023-08-09T12:40:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.431+0000 7ff8b2ffd640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff89406a080 0x7ff89406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.432+0000 7ff8b2ffd640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff89406a080 0x7ff89406c540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4007fd0 tx=0x7ff8a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.435+0000 7ff8ab7fe640 1 -- 172.21.15.17:0/57082983 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff8ac076d50 con 0x7ff8b41616e0 2023-08-09T12:40:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.696+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff8b414a1d0 con 0x7ff8b41616e0 2023-08-09T12:40:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.703+0000 7ff8ab7fe640 1 -- 172.21.15.17:0/57082983 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff8ac034020 con 0x7ff8b41616e0 2023-08-09T12:40:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff89406a080 msgr2=0x7ff89406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff89406a080 0x7ff89406c540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4007fd0 tx=0x7ff8a4009040 comp rx=0 tx=0).stop 2023-08-09T12:40:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b41616e0 msgr2=0x7ff8b414a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b41616e0 0x7ff8b414a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009870 tx=0x7ff8ac004730 comp rx=0 tx=0).stop 2023-08-09T12:40:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 shutdown_connections 2023-08-09T12:40:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff89406a080 0x7ff89406c540 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b41616e0 0x7ff8b414a520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b415ce90 0x7ff8b414c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 --2- 172.21.15.17:0/57082983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b40d29d0 0x7ff8b40cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.705+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 >> 172.21.15.17:0/57082983 conn(0x7ff8b406fde0 msgr2=0x7ff8b40b8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.706+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 shutdown_connections 2023-08-09T12:40:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.706+0000 7ff8b93ab640 1 -- 172.21.15.17:0/57082983 wait complete. 2023-08-09T12:40:35.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-09T12:40:35.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.960+0000 7f8d4ecfb640 1 Processor -- start 2023-08-09T12:40:35.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.960+0000 7f8d4ecfb640 1 -- start start 2023-08-09T12:40:35.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.961+0000 7f8d4ecfb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8d48160030 0x7f8d48160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.962+0000 7f8d4ecfb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d480cfb50 0x7f8d480d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.962+0000 7f8d4ecfb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d480b5a30 con 0x7f8d480b86e0 2023-08-09T12:40:35.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.962+0000 7f8d4ecfb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d480d1110 con 0x7f8d48160030 2023-08-09T12:40:35.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.962+0000 7f8d4ecfb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d480ceac0 con 0x7f8d480cfb50 2023-08-09T12:40:35.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.962+0000 7f8d4d4f8640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8d480b86e0 0x7f8d480cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49422/0 (socket says 172.21.15.17:49422) 2023-08-09T12:40:35.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.962+0000 7f8d4d4f8640 1 -- 172.21.15.17:0/3647540555 learned_addr learned my addr 172.21.15.17:0/3647540555 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:35.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.962+0000 7f8d4dcf9640 1 --2- 172.21.15.17:0/3647540555 >> v2:172.21.15.17:3300/0 conn(0x7f8d48160030 0x7f8d48160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.962+0000 7f8d4e4fa640 1 --2- 172.21.15.17:0/3647540555 >> v2:172.21.15.142:3300/0 conn(0x7f8d480cfb50 0x7f8d480d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.963+0000 7f8d4ccf7640 1 -- 172.21.15.17:0/3647540555 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642981202 0 0) 0x7f8d480b5a30 con 0x7f8d480b86e0 2023-08-09T12:40:35.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.963+0000 7f8d4dcf9640 1 -- 172.21.15.17:0/3647540555 >> v2:172.21.15.142:3300/0 conn(0x7f8d480cfb50 msgr2=0x7f8d480d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:35.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.963+0000 7f8d4dcf9640 1 --2- 172.21.15.17:0/3647540555 >> v2:172.21.15.142:3300/0 conn(0x7f8d480cfb50 0x7f8d480d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.963+0000 7f8d4dcf9640 1 -- 172.21.15.17:0/3647540555 >> v1:172.21.15.17:6789/0 conn(0x7f8d480b86e0 legacy=0x7f8d480cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.963+0000 7f8d4dcf9640 1 -- 172.21.15.17:0/3647540555 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d480d0d70 con 0x7f8d48160030 2023-08-09T12:40:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.964+0000 7f8d4dcf9640 1 --2- 172.21.15.17:0/3647540555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d48160030 0x7f8d48160740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8d4806b980 tx=0x7f8d4402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dea73d09f13ce1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.964+0000 7f8d4ccf7640 1 -- 172.21.15.17:0/3647540555 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4402cc80 con 0x7f8d48160030 2023-08-09T12:40:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.965+0000 7f8d4ccf7640 1 -- 172.21.15.17:0/3647540555 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4402cde0 con 0x7f8d48160030 2023-08-09T12:40:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.965+0000 7f8d4ccf7640 1 -- 172.21.15.17:0/3647540555 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44034660 con 0x7f8d48160030 2023-08-09T12:40:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.965+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/3647540555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d48160030 msgr2=0x7f8d48160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.965+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/3647540555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d48160030 0x7f8d48160740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8d4806b980 tx=0x7f8d4402bed0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.965+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/3647540555 shutdown_connections 2023-08-09T12:40:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.965+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/3647540555 >> v2:172.21.15.142:3300/0 conn(0x7f8d480cfb50 0x7f8d480d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.965+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/3647540555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d48160030 0x7f8d48160740 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.966+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/3647540555 >> 172.21.15.17:0/3647540555 conn(0x7f8d480697c0 msgr2=0x7f8d48069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.966+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/3647540555 shutdown_connections 2023-08-09T12:40:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.966+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/3647540555 wait complete. 2023-08-09T12:40:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.967+0000 7f8d4ecfb640 1 Processor -- start 2023-08-09T12:40:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.968+0000 7f8d4ecfb640 1 -- start start 2023-08-09T12:40:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4ecfb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d480b86e0 0x7f8d480cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4ecfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d480cfb50 0x7f8d480d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4ecfb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48160030 0x7f8d480d3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4ecfb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480aae20 con 0x7f8d480cfb50 2023-08-09T12:40:35.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4ecfb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480ab100 con 0x7f8d48160030 2023-08-09T12:40:35.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4ecfb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480a94f0 con 0x7f8d480b86e0 2023-08-09T12:40:35.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4d4f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d480cfb50 0x7f8d480d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4d4f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d480cfb50 0x7f8d480d2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43082/0 (socket says 172.21.15.17:43082) 2023-08-09T12:40:35.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4d4f8640 1 -- 172.21.15.17:0/2604814892 learned_addr learned my addr 172.21.15.17:0/2604814892 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:35.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4dcf9640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d480b86e0 0x7f8d480cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4e4fa640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48160030 0x7f8d480d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4d4f8640 1 -- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d480b86e0 msgr2=0x7f8d480cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4d4f8640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d480b86e0 0x7f8d480cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.969+0000 7f8d4d4f8640 1 -- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48160030 msgr2=0x7f8d480d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d4d4f8640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48160030 0x7f8d480d3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d4d4f8640 1 -- 172.21.15.17:0/2604814892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44009a70 con 0x7f8d480cfb50 2023-08-09T12:40:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d4e4fa640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48160030 0x7f8d480d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d4d4f8640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d480cfb50 0x7f8d480d2ee0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800c4a0 tx=0x7f8d3800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d3e7fc640 1 -- 172.21.15.17:0/2604814892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38005ce0 con 0x7f8d480cfb50 2023-08-09T12:40:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d3e7fc640 1 -- 172.21.15.17:0/2604814892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d38005e40 con 0x7f8d480cfb50 2023-08-09T12:40:35.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d3e7fc640 1 -- 172.21.15.17:0/2604814892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d380072b0 con 0x7f8d480cfb50 2023-08-09T12:40:35.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d480a97d0 con 0x7f8d480cfb50 2023-08-09T12:40:35.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.970+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d480cbb50 con 0x7f8d480cfb50 2023-08-09T12:40:35.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.971+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4804e390 con 0x7f8d480cfb50 2023-08-09T12:40:35.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.972+0000 7f8d3e7fc640 1 -- 172.21.15.17:0/2604814892 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8d38007410 con 0x7f8d480cfb50 2023-08-09T12:40:35.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.973+0000 7f8d3e7fc640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d2c06a050 0x7f8d2c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:35.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.973+0000 7f8d3e7fc640 1 -- 172.21.15.17:0/2604814892 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8d38087840 con 0x7f8d480cfb50 2023-08-09T12:40:35.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.974+0000 7f8d4dcf9640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d2c06a050 0x7f8d2c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:35.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.975+0000 7f8d4dcf9640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d2c06a050 0x7f8d2c06c510 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d44036000 tx=0x7f8d44030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:35.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:35.978+0000 7f8d3e7fc640 1 -- 172.21.15.17:0/2604814892 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8d38053270 con 0x7f8d480cfb50 2023-08-09T12:40:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.244+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8d48161500 con 0x7f8d480cfb50 2023-08-09T12:40:36.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.251+0000 7f8d3e7fc640 1 -- 172.21.15.17:0/2604814892 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8d38056890 con 0x7f8d480cfb50 2023-08-09T12:40:36.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.254+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d2c06a050 msgr2=0x7f8d2c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.254+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d2c06a050 0x7f8d2c06c510 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d44036000 tx=0x7f8d44030000 comp rx=0 tx=0).stop 2023-08-09T12:40:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.254+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d480cfb50 msgr2=0x7f8d480d2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.254+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d480cfb50 0x7f8d480d2ee0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800c4a0 tx=0x7f8d3800c960 comp rx=0 tx=0).stop 2023-08-09T12:40:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.255+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 shutdown_connections 2023-08-09T12:40:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.255+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8d2c06a050 0x7f8d2c06c510 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.255+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48160030 0x7f8d480d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.255+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d480cfb50 0x7f8d480d2ee0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.255+0000 7f8d4ecfb640 1 --2- 172.21.15.17:0/2604814892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d480b86e0 0x7f8d480cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.255+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 >> 172.21.15.17:0/2604814892 conn(0x7f8d480697c0 msgr2=0x7f8d480c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.255+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 shutdown_connections 2023-08-09T12:40:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.255+0000 7f8d4ecfb640 1 -- 172.21.15.17:0/2604814892 wait complete. 2023-08-09T12:40:36.275 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-09T12:40:36.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.505+0000 7fafd9ea9640 1 Processor -- start 2023-08-09T12:40:36.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.505+0000 7fafd9ea9640 1 -- start start 2023-08-09T12:40:36.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.506+0000 7fafd9ea9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd41616e0 0x7fafd40b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.506+0000 7fafd9ea9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafd40d29d0 0x7fafd40d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.506+0000 7fafd9ea9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd40cdd10 con 0x7fafd415ce90 2023-08-09T12:40:36.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.506+0000 7fafd9ea9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40b6540 con 0x7fafd40d29d0 2023-08-09T12:40:36.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.506+0000 7fafd9ea9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40d33a0 con 0x7fafd41616e0 2023-08-09T12:40:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.507+0000 7fafd37fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fafd415ce90 0x7fafd40cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49424/0 (socket says 172.21.15.17:49424) 2023-08-09T12:40:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.507+0000 7fafd37fe640 1 -- 172.21.15.17:0/768999521 learned_addr learned my addr 172.21.15.17:0/768999521 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.507+0000 7fafcaffd640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd41616e0 0x7fafd40b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.507+0000 7fafd3fff640 1 --2- 172.21.15.17:0/768999521 >> v2:172.21.15.142:3300/0 conn(0x7fafd40d29d0 0x7fafd40d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.507+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795721540 0 0) 0x7fafd40cdd10 con 0x7fafd415ce90 2023-08-09T12:40:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.507+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc0003520 con 0x7fafd415ce90 2023-08-09T12:40:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 319024620 0 0) 0x7fafc0003520 con 0x7fafd415ce90 2023-08-09T12:40:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd41616e0 msgr2=0x7fafd40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd41616e0 0x7fafd40b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 >> v2:172.21.15.142:3300/0 conn(0x7fafd40d29d0 msgr2=0x7fafd40d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 --2- 172.21.15.17:0/768999521 >> v2:172.21.15.142:3300/0 conn(0x7fafd40d29d0 0x7fafd40d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40cdff0 con 0x7fafd415ce90 2023-08-09T12:40:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fafc4001670 con 0x7fafd415ce90 2023-08-09T12:40:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 >> v1:172.21.15.17:6789/0 conn(0x7fafd415ce90 legacy=0x7fafd40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003970 0x7fafc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd41616e0 0x7fafc00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0004d00 0x7fafc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40b6540 con 0x7fafc0004d00 2023-08-09T12:40:36.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40d33a0 con 0x7fafc0003970 2023-08-09T12:40:36.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc000b980 con 0x7fafd41616e0 2023-08-09T12:40:36.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd3fff640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0004d00 0x7fafc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.508+0000 7fafd37fe640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003970 0x7fafc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.509+0000 7fafd3fff640 1 -- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd41616e0 msgr2=0x7fafc00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:36.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.509+0000 7fafcaffd640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd41616e0 0x7fafc00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.509+0000 7fafd3fff640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd41616e0 0x7fafc00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.509+0000 7fafd3fff640 1 -- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003970 msgr2=0x7fafc0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.509+0000 7fafd3fff640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003970 0x7fafc0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.509+0000 7fafd3fff640 1 -- 172.21.15.17:0/768999521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0003520 con 0x7fafc0004d00 2023-08-09T12:40:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.509+0000 7fafd37fe640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0003970 0x7fafc0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:36.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.510+0000 7fafd3fff640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0004d00 0x7fafc0005180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009fc0 tx=0x7fafc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5160789fe3d8903 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:36.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.510+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc02cc60 con 0x7fafc0004d00 2023-08-09T12:40:36.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.510+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc00f040 con 0x7fafc0004d00 2023-08-09T12:40:36.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.510+0000 7fafd2ffd640 1 -- 172.21.15.17:0/768999521 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc034440 con 0x7fafc0004d00 2023-08-09T12:40:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.510+0000 7fafd9ea9640 1 -- 172.21.15.17:0/768999521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0004d00 msgr2=0x7fafc0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.510+0000 7fafd9ea9640 1 --2- 172.21.15.17:0/768999521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0004d00 0x7fafc0005180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009fc0 tx=0x7fafc00057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.510+0000 7fafd3fff640 1 -- 172.21.15.17:0/768999521 reap_dead start 2023-08-09T12:40:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.511+0000 7fafd9ea9640 1 -- 172.21.15.17:0/768999521 shutdown_connections 2023-08-09T12:40:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.511+0000 7fafd9ea9640 1 -- 172.21.15.17:0/768999521 >> 172.21.15.17:0/768999521 conn(0x7fafd406fde0 msgr2=0x7fafd40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.511+0000 7fafd9ea9640 1 -- 172.21.15.17:0/768999521 shutdown_connections 2023-08-09T12:40:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.511+0000 7fafd9ea9640 1 -- 172.21.15.17:0/768999521 wait complete. 2023-08-09T12:40:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.512+0000 7fafd9ea9640 1 Processor -- start 2023-08-09T12:40:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.513+0000 7fafd9ea9640 1 -- start start 2023-08-09T12:40:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafd9ea9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0004d00 0x7fafd415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafd9ea9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd4153e10 0x7fafd4153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafd9ea9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd415f3b0 0x7fafd41f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafd9ea9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd415ef20 con 0x7fafd4153e10 2023-08-09T12:40:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafd9ea9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd415e310 con 0x7fafc0004d00 2023-08-09T12:40:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafd9ea9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd415e5f0 con 0x7fafd415f3b0 2023-08-09T12:40:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafcaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd4153e10 0x7fafd4153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafcaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd4153e10 0x7fafd4153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43090/0 (socket says 172.21.15.17:43090) 2023-08-09T12:40:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafcaffd640 1 -- 172.21.15.17:0/2694140025 learned_addr learned my addr 172.21.15.17:0/2694140025 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafd37fe640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0004d00 0x7fafd415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafd3fff640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd415f3b0 0x7fafd41f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafcaffd640 1 -- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd415f3b0 msgr2=0x7fafd41f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafcaffd640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd415f3b0 0x7fafd41f2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafcaffd640 1 -- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0004d00 msgr2=0x7fafd415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafcaffd640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0004d00 0x7fafd415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.514+0000 7fafcaffd640 1 -- 172.21.15.17:0/2694140025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd415e8d0 con 0x7fafd4153e10 2023-08-09T12:40:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.515+0000 7fafcaffd640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd4153e10 0x7fafd4153600 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fafbc010860 tx=0x7fafbc010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.515+0000 7fafd0ff9640 1 -- 172.21.15.17:0/2694140025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc009610 con 0x7fafd4153e10 2023-08-09T12:40:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.515+0000 7fafd0ff9640 1 -- 172.21.15.17:0/2694140025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00eb60 con 0x7fafd4153e10 2023-08-09T12:40:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.515+0000 7fafd0ff9640 1 -- 172.21.15.17:0/2694140025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc01c400 con 0x7fafd4153e10 2023-08-09T12:40:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.515+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd415ebb0 con 0x7fafd4153e10 2023-08-09T12:40:36.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.515+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd4153b40 con 0x7fafd4153e10 2023-08-09T12:40:36.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.516+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd4067400 con 0x7fafd4153e10 2023-08-09T12:40:36.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.517+0000 7fafd0ff9640 1 -- 172.21.15.17:0/2694140025 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fafbc01c560 con 0x7fafd4153e10 2023-08-09T12:40:36.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.518+0000 7fafd0ff9640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fafb406a050 0x7fafb406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:36.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.518+0000 7fafd0ff9640 1 -- 172.21.15.17:0/2694140025 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fafbc088880 con 0x7fafd4153e10 2023-08-09T12:40:36.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.519+0000 7fafd37fe640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fafb406a050 0x7fafb406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:36.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.520+0000 7fafd37fe640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fafb406a050 0x7fafb406c510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fafc4007950 tx=0x7fafc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.523+0000 7fafd0ff9640 1 -- 172.21.15.17:0/2694140025 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fafbc0542d0 con 0x7fafd4153e10 2023-08-09T12:40:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.790+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fafd415e730 con 0x7fafd4153e10 2023-08-09T12:40:36.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.796+0000 7fafd0ff9640 1 -- 172.21.15.17:0/2694140025 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fafd415e730 con 0x7fafd4153e10 2023-08-09T12:40:36.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fafb406a050 msgr2=0x7fafb406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:36.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fafb406a050 0x7fafb406c510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fafc4007950 tx=0x7fafc4009040 comp rx=0 tx=0).stop 2023-08-09T12:40:36.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd4153e10 msgr2=0x7fafd4153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:36.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd4153e10 0x7fafd4153600 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fafbc010860 tx=0x7fafbc010d20 comp rx=0 tx=0).stop 2023-08-09T12:40:36.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 shutdown_connections 2023-08-09T12:40:36.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fafb406a050 0x7fafb406c510 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafd415f3b0 0x7fafd41f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd4153e10 0x7fafd4153600 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 --2- 172.21.15.17:0/2694140025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc0004d00 0x7fafd415dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:36.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 >> 172.21.15.17:0/2694140025 conn(0x7fafd406fde0 msgr2=0x7fafd40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:36.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 shutdown_connections 2023-08-09T12:40:36.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:36.799+0000 7fafd9ea9640 1 -- 172.21.15.17:0/2694140025 wait complete. 2023-08-09T12:40:36.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:37.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.045+0000 7f5b4d324640 1 Processor -- start 2023-08-09T12:40:37.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.045+0000 7f5b4d324640 1 -- start start 2023-08-09T12:40:37.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b4d324640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b48161660 0x7f5b480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b4d324640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b480acdf0 0x7f5b480cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b4d324640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4815df30 con 0x7f5b48161280 2023-08-09T12:40:37.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b4d324640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b480ad2a0 con 0x7f5b480acdf0 2023-08-09T12:40:37.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b4d324640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4815d430 con 0x7f5b48161660 2023-08-09T12:40:37.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b46ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5b48161280 0x7f5b480c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49430/0 (socket says 172.21.15.17:49430) 2023-08-09T12:40:37.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b46ffd640 1 -- 172.21.15.17:0/2802139008 learned_addr learned my addr 172.21.15.17:0/2802139008 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:37.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b477fe640 1 --2- 172.21.15.17:0/2802139008 >> v2:172.21.15.142:3300/0 conn(0x7f5b480acdf0 0x7f5b480cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.047+0000 7f5b467fc640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b48161660 0x7f5b480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161531046 0 0) 0x7f5b4815df30 con 0x7f5b48161280 2023-08-09T12:40:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b30003520 con 0x7f5b48161280 2023-08-09T12:40:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2021492871 0 0) 0x7f5b30003520 con 0x7f5b48161280 2023-08-09T12:40:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b48161660 msgr2=0x7f5b480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b48161660 0x7f5b480ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 >> v2:172.21.15.142:3300/0 conn(0x7f5b480acdf0 msgr2=0x7f5b480cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 --2- 172.21.15.17:0/2802139008 >> v2:172.21.15.142:3300/0 conn(0x7f5b480acdf0 0x7f5b480cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480ca9d0 con 0x7f5b48161280 2023-08-09T12:40:37.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f5b38001670 con 0x7f5b48161280 2023-08-09T12:40:37.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 >> v1:172.21.15.17:6789/0 conn(0x7f5b48161280 legacy=0x7f5b480c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b30003970 0x7f5b30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b300047c0 0x7f5b30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b30005180 0x7f5b3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480ad2a0 con 0x7f5b300047c0 2023-08-09T12:40:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3000bf20 con 0x7f5b30003970 2023-08-09T12:40:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.048+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3000c0e0 con 0x7f5b30005180 2023-08-09T12:40:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.049+0000 7f5b477fe640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b30005180 0x7f5b3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.049+0000 7f5b46ffd640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b30003970 0x7f5b30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.049+0000 7f5b467fc640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b300047c0 0x7f5b30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.049+0000 7f5b477fe640 1 -- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b30003970 msgr2=0x7f5b30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.049+0000 7f5b477fe640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b30003970 0x7f5b30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.049+0000 7f5b477fe640 1 -- 172.21.15.17:0/2802139008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b300047c0 msgr2=0x7f5b30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.050+0000 7f5b477fe640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b300047c0 0x7f5b30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.050+0000 7f5b477fe640 1 -- 172.21.15.17:0/2802139008 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30003520 con 0x7f5b30005180 2023-08-09T12:40:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.051+0000 7f5b477fe640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b30005180 0x7f5b3000b980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009fc0 tx=0x7f5b300057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dceefd04289c678 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.051+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4002cc30 con 0x7f5b30005180 2023-08-09T12:40:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.051+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4000f040 con 0x7f5b30005180 2023-08-09T12:40:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.052+0000 7f5b45ffb640 1 -- 172.21.15.17:0/2802139008 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40034440 con 0x7f5b30005180 2023-08-09T12:40:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.052+0000 7f5b4d324640 1 -- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b30005180 msgr2=0x7f5b3000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.052+0000 7f5b4d324640 1 --2- 172.21.15.17:0/2802139008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b30005180 0x7f5b3000b980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009fc0 tx=0x7f5b300057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.052+0000 7f5b477fe640 1 -- 172.21.15.17:0/2802139008 reap_dead start 2023-08-09T12:40:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.052+0000 7f5b4d324640 1 -- 172.21.15.17:0/2802139008 shutdown_connections 2023-08-09T12:40:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.052+0000 7f5b4d324640 1 -- 172.21.15.17:0/2802139008 >> 172.21.15.17:0/2802139008 conn(0x7f5b480cb1b0 msgr2=0x7f5b480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.052+0000 7f5b4d324640 1 -- 172.21.15.17:0/2802139008 shutdown_connections 2023-08-09T12:40:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.053+0000 7f5b4d324640 1 -- 172.21.15.17:0/2802139008 wait complete. 2023-08-09T12:40:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.054+0000 7f5b4d324640 1 Processor -- start 2023-08-09T12:40:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.055+0000 7f5b4d324640 1 -- start start 2023-08-09T12:40:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b4d324640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b30005180 0x7f5b481f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b4d324640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b481f2200 0x7f5b480b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b4d324640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b480b42e0 0x7f5b4806a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b4d324640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48145660 con 0x7f5b30005180 2023-08-09T12:40:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b4d324640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48144ae0 con 0x7f5b480b42e0 2023-08-09T12:40:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b4d324640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48144dc0 con 0x7f5b481f2200 2023-08-09T12:40:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b46ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b30005180 0x7f5b481f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b46ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b30005180 0x7f5b481f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43120/0 (socket says 172.21.15.17:43120) 2023-08-09T12:40:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b46ffd640 1 -- 172.21.15.17:0/3143701630 learned_addr learned my addr 172.21.15.17:0/3143701630 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b46ffd640 1 -- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b481f2200 msgr2=0x7f5b480b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b467fc640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b481f2200 0x7f5b480b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b477fe640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b480b42e0 0x7f5b4806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b46ffd640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b481f2200 0x7f5b480b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b46ffd640 1 -- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b480b42e0 msgr2=0x7f5b4806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b46ffd640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b480b42e0 0x7f5b4806a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b46ffd640 1 -- 172.21.15.17:0/3143701630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b481450a0 con 0x7f5b30005180 2023-08-09T12:40:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.056+0000 7f5b467fc640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b481f2200 0x7f5b480b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.057+0000 7f5b46ffd640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b30005180 0x7f5b481f1cc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b380072c0 tx=0x7f5b38007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.057+0000 7f5b2f7fe640 1 -- 172.21.15.17:0/3143701630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800f960 con 0x7f5b30005180 2023-08-09T12:40:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.057+0000 7f5b2f7fe640 1 -- 172.21.15.17:0/3143701630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3800fb00 con 0x7f5b30005180 2023-08-09T12:40:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.057+0000 7f5b2f7fe640 1 -- 172.21.15.17:0/3143701630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800feb0 con 0x7f5b30005180 2023-08-09T12:40:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.057+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b48145380 con 0x7f5b30005180 2023-08-09T12:40:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.057+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4806ac40 con 0x7f5b30005180 2023-08-09T12:40:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.058+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b48067a80 con 0x7f5b30005180 2023-08-09T12:40:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.059+0000 7f5b2f7fe640 1 -- 172.21.15.17:0/3143701630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b3801d460 con 0x7f5b30005180 2023-08-09T12:40:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.060+0000 7f5b2f7fe640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b3406a080 0x7f5b3406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.060+0000 7f5b2f7fe640 1 -- 172.21.15.17:0/3143701630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5b380884d0 con 0x7f5b30005180 2023-08-09T12:40:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.061+0000 7f5b467fc640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b3406a080 0x7f5b3406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.062+0000 7f5b467fc640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b3406a080 0x7f5b3406c540 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5b48142540 tx=0x7f5b3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.065+0000 7f5b2f7fe640 1 -- 172.21.15.17:0/3143701630 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5b38057a50 con 0x7f5b30005180 2023-08-09T12:40:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.258+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b48142700 con 0x7f5b30005180 2023-08-09T12:40:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.259+0000 7f5b2f7fe640 1 -- 172.21.15.17:0/3143701630 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f5b380575e0 con 0x7f5b30005180 2023-08-09T12:40:37.262 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:37.263 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":33,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:33.043162+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b3406a080 msgr2=0x7f5b3406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b3406a080 0x7f5b3406c540 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5b48142540 tx=0x7f5b3c008040 comp rx=0 tx=0).stop 2023-08-09T12:40:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b30005180 msgr2=0x7f5b481f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b30005180 0x7f5b481f1cc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b380072c0 tx=0x7f5b38007780 comp rx=0 tx=0).stop 2023-08-09T12:40:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 shutdown_connections 2023-08-09T12:40:37.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b3406a080 0x7f5b3406c540 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b480b42e0 0x7f5b4806a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b481f2200 0x7f5b480b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 --2- 172.21.15.17:0/3143701630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b30005180 0x7f5b481f1cc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 >> 172.21.15.17:0/3143701630 conn(0x7f5b480cb1b0 msgr2=0x7f5b480703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 shutdown_connections 2023-08-09T12:40:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.262+0000 7f5b4d324640 1 -- 172.21.15.17:0/3143701630 wait complete. 2023-08-09T12:40:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:37.286 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:37.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.521+0000 7f18ccd22640 1 Processor -- start 2023-08-09T12:40:37.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.521+0000 7f18ccd22640 1 -- start start 2023-08-09T12:40:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.522+0000 7f18ccd22640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18c815ce90 0x7f18c81616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.522+0000 7f18ccd22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c80b6000 0x7f18c80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.522+0000 7f18ccd22640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18c80d29d0 0x7f18c80d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.522+0000 7f18ccd22640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c80d33a0 con 0x7f18c815ce90 2023-08-09T12:40:37.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.522+0000 7f18ccd22640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c80b6460 con 0x7f18c80d29d0 2023-08-09T12:40:37.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.522+0000 7f18ccd22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80cda40 con 0x7f18c80b6000 2023-08-09T12:40:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18c815ce90 0x7f18c81616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18c815ce90 0x7f18c81616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43132/0 (socket says 172.21.15.17:43132) 2023-08-09T12:40:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c659c640 1 -- 172.21.15.17:0/2245113577 learned_addr learned my addr 172.21.15.17:0/2245113577 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c5d9b640 1 --2- 172.21.15.17:0/2245113577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c80b6000 0x7f18c80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c6d9d640 1 --2- 172.21.15.17:0/2245113577 >> v2:172.21.15.142:3300/0 conn(0x7f18c80d29d0 0x7f18c80d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c659c640 1 -- 172.21.15.17:0/2245113577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c80b6000 msgr2=0x7f18c80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c659c640 1 --2- 172.21.15.17:0/2245113577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c80b6000 0x7f18c80cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c659c640 1 -- 172.21.15.17:0/2245113577 >> v2:172.21.15.142:3300/0 conn(0x7f18c80d29d0 msgr2=0x7f18c80d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c659c640 1 --2- 172.21.15.17:0/2245113577 >> v2:172.21.15.142:3300/0 conn(0x7f18c80d29d0 0x7f18c80d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c659c640 1 -- 172.21.15.17:0/2245113577 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c80cdd10 con 0x7f18c815ce90 2023-08-09T12:40:37.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.523+0000 7f18c6d9d640 1 --2- 172.21.15.17:0/2245113577 >> v2:172.21.15.142:3300/0 conn(0x7f18c80d29d0 0x7f18c80d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:37.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.524+0000 7f18c659c640 1 --2- 172.21.15.17:0/2245113577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c815ce90 0x7f18c81616e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18c80d0a70 tx=0x7f18b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471fa18dbed16af4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.525+0000 7f18c559a640 1 -- 172.21.15.17:0/2245113577 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b802ca80 con 0x7f18c815ce90 2023-08-09T12:40:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.525+0000 7f18c559a640 1 -- 172.21.15.17:0/2245113577 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b802cbe0 con 0x7f18c815ce90 2023-08-09T12:40:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.525+0000 7f18c559a640 1 -- 172.21.15.17:0/2245113577 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b80343f0 con 0x7f18c815ce90 2023-08-09T12:40:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.525+0000 7f18ccd22640 1 -- 172.21.15.17:0/2245113577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c815ce90 msgr2=0x7f18c81616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.525+0000 7f18ccd22640 1 --2- 172.21.15.17:0/2245113577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c815ce90 0x7f18c81616e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18c80d0a70 tx=0x7f18b802bee0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.526+0000 7f18ccd22640 1 -- 172.21.15.17:0/2245113577 shutdown_connections 2023-08-09T12:40:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.526+0000 7f18ccd22640 1 --2- 172.21.15.17:0/2245113577 >> v2:172.21.15.142:3300/0 conn(0x7f18c80d29d0 0x7f18c80d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.526+0000 7f18ccd22640 1 --2- 172.21.15.17:0/2245113577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c80b6000 0x7f18c80cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.526+0000 7f18ccd22640 1 --2- 172.21.15.17:0/2245113577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c815ce90 0x7f18c81616e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.526+0000 7f18ccd22640 1 -- 172.21.15.17:0/2245113577 >> 172.21.15.17:0/2245113577 conn(0x7f18c806fde0 msgr2=0x7f18c80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:37.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.526+0000 7f18ccd22640 1 -- 172.21.15.17:0/2245113577 shutdown_connections 2023-08-09T12:40:37.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.526+0000 7f18ccd22640 1 -- 172.21.15.17:0/2245113577 wait complete. 2023-08-09T12:40:37.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.528+0000 7f18ccd22640 1 Processor -- start 2023-08-09T12:40:37.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.528+0000 7f18ccd22640 1 -- start start 2023-08-09T12:40:37.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18ccd22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18c80b6000 0x7f18c814c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18ccd22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c80d29d0 0x7f18c80a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18ccd22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c815ce90 0x7f18c80b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18ccd22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c81490f0 con 0x7f18c80d29d0 2023-08-09T12:40:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18ccd22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8149390 con 0x7f18c80b6000 2023-08-09T12:40:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18ccd22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8149670 con 0x7f18c815ce90 2023-08-09T12:40:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18c5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c80d29d0 0x7f18c80a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18c5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c80d29d0 0x7f18c80a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43138/0 (socket says 172.21.15.17:43138) 2023-08-09T12:40:37.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18c5d9b640 1 -- 172.21.15.17:0/814859900 learned_addr learned my addr 172.21.15.17:0/814859900 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:37.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18c659c640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18c80b6000 0x7f18c814c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.529+0000 7f18c6d9d640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c815ce90 0x7f18c80b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18c5d9b640 1 -- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c815ce90 msgr2=0x7f18c80b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18c5d9b640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c815ce90 0x7f18c80b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18c5d9b640 1 -- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18c80b6000 msgr2=0x7f18c814c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18c5d9b640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18c80b6000 0x7f18c814c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18c5d9b640 1 -- 172.21.15.17:0/814859900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8009b30 con 0x7f18c80d29d0 2023-08-09T12:40:37.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18c659c640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18c80b6000 0x7f18c814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:37.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18c5d9b640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c80d29d0 0x7f18c80a9560 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f18b000d800 tx=0x7f18b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18beffd640 1 -- 172.21.15.17:0/814859900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000b6c0 con 0x7f18c80d29d0 2023-08-09T12:40:37.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18beffd640 1 -- 172.21.15.17:0/814859900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b000b820 con 0x7f18c80d29d0 2023-08-09T12:40:37.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18beffd640 1 -- 172.21.15.17:0/814859900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000bbb0 con 0x7f18c80d29d0 2023-08-09T12:40:37.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.530+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c8149950 con 0x7f18c80d29d0 2023-08-09T12:40:37.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.531+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c80b1b20 con 0x7f18c80d29d0 2023-08-09T12:40:37.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.532+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c8067a80 con 0x7f18c80d29d0 2023-08-09T12:40:37.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.533+0000 7f18beffd640 1 -- 172.21.15.17:0/814859900 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f18b000bd10 con 0x7f18c80d29d0 2023-08-09T12:40:37.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.534+0000 7f18beffd640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a806a050 0x7f18a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.534+0000 7f18beffd640 1 -- 172.21.15.17:0/814859900 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f18b00887e0 con 0x7f18c80d29d0 2023-08-09T12:40:37.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.534+0000 7f18c659c640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a806a050 0x7f18a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.535+0000 7f18c659c640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a806a050 0x7f18a806c510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18b8035000 tx=0x7f18b8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.538+0000 7f18beffd640 1 -- 172.21.15.17:0/814859900 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f18b0054210 con 0x7f18c80d29d0 2023-08-09T12:40:37.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.731+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18c80d0ad0 con 0x7f18c80d29d0 2023-08-09T12:40:37.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.732+0000 7f18beffd640 1 -- 172.21.15.17:0/814859900 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18b0057830 con 0x7f18c80d29d0 2023-08-09T12:40:37.735 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a806a050 msgr2=0x7f18a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a806a050 0x7f18a806c510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18b8035000 tx=0x7f18b8030000 comp rx=0 tx=0).stop 2023-08-09T12:40:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c80d29d0 msgr2=0x7f18c80a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c80d29d0 0x7f18c80a9560 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f18b000d800 tx=0x7f18b000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 shutdown_connections 2023-08-09T12:40:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a806a050 0x7f18a806c510 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18c815ce90 0x7f18c80b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c80d29d0 0x7f18c80a9560 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 --2- 172.21.15.17:0/814859900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18c80b6000 0x7f18c814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 >> 172.21.15.17:0/814859900 conn(0x7f18c806fde0 msgr2=0x7f18c80b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 shutdown_connections 2023-08-09T12:40:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.735+0000 7f18ccd22640 1 -- 172.21.15.17:0/814859900 wait complete. 2023-08-09T12:40:37.759 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.979+0000 7eff1f4da640 1 Processor -- start 2023-08-09T12:40:37.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.979+0000 7eff1f4da640 1 -- start start 2023-08-09T12:40:37.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.981+0000 7eff1f4da640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff180acfc0 0x7eff18167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.981+0000 7eff1f4da640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1815df30 con 0x7eff18161660 2023-08-09T12:40:37.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.981+0000 7eff1f4da640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff180ca9d0 con 0x7eff18161280 2023-08-09T12:40:37.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.981+0000 7eff1f4da640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1815d430 con 0x7eff180acfc0 2023-08-09T12:40:37.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.981+0000 7eff1ca75640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7eff18161660 0x7eff180ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54446/0 (socket says 172.21.15.17:54446) 2023-08-09T12:40:37.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.981+0000 7eff1ca75640 1 -- 172.21.15.17:0/3310507625 learned_addr learned my addr 172.21.15.17:0/3310507625 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:37.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.982+0000 7eff1da77640 1 --2- 172.21.15.17:0/3310507625 >> v2:172.21.15.17:3300/0 conn(0x7eff180acfc0 0x7eff18167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.982+0000 7eff0ffff640 1 -- 172.21.15.17:0/3310507625 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27886741 0 0) 0x7eff1815df30 con 0x7eff18161660 2023-08-09T12:40:37.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.982+0000 7eff1da77640 1 -- 172.21.15.17:0/3310507625 >> v1:172.21.15.142:6789/0 conn(0x7eff18161280 legacy=0x7eff180c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.982+0000 7eff1da77640 1 -- 172.21.15.17:0/3310507625 >> v1:172.21.15.17:6789/0 conn(0x7eff18161660 legacy=0x7eff180ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.982+0000 7eff1da77640 1 -- 172.21.15.17:0/3310507625 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1815e3c0 con 0x7eff180acfc0 2023-08-09T12:40:37.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.983+0000 7eff1da77640 1 --2- 172.21.15.17:0/3310507625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff180acfc0 0x7eff18167db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7eff10009d90 tx=0x7eff1002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20dae4a18245602f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff0ffff640 1 -- 172.21.15.17:0/3310507625 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1002cc60 con 0x7eff180acfc0 2023-08-09T12:40:37.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff0ffff640 1 -- 172.21.15.17:0/3310507625 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1002cdc0 con 0x7eff180acfc0 2023-08-09T12:40:37.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff0ffff640 1 -- 172.21.15.17:0/3310507625 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10034660 con 0x7eff180acfc0 2023-08-09T12:40:37.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff1f4da640 1 -- 172.21.15.17:0/3310507625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff180acfc0 msgr2=0x7eff18167db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff1f4da640 1 --2- 172.21.15.17:0/3310507625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff180acfc0 0x7eff18167db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7eff10009d90 tx=0x7eff1002beb0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff1f4da640 1 -- 172.21.15.17:0/3310507625 shutdown_connections 2023-08-09T12:40:37.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff1f4da640 1 --2- 172.21.15.17:0/3310507625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff180acfc0 0x7eff18167db0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff1f4da640 1 -- 172.21.15.17:0/3310507625 >> 172.21.15.17:0/3310507625 conn(0x7eff180cb1b0 msgr2=0x7eff180cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:37.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff1f4da640 1 -- 172.21.15.17:0/3310507625 shutdown_connections 2023-08-09T12:40:37.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.984+0000 7eff1f4da640 1 -- 172.21.15.17:0/3310507625 wait complete. 2023-08-09T12:40:37.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.986+0000 7eff1f4da640 1 Processor -- start 2023-08-09T12:40:37.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.986+0000 7eff1f4da640 1 -- start start 2023-08-09T12:40:37.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.987+0000 7eff1f4da640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff180acfc0 0x7eff180ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.987+0000 7eff1f4da640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff18161280 0x7eff181f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.987+0000 7eff1f4da640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18161660 0x7eff181f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.987+0000 7eff1f4da640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff181f2260 con 0x7eff18161280 2023-08-09T12:40:37.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.987+0000 7eff1f4da640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff180c40c0 con 0x7eff18161660 2023-08-09T12:40:37.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.987+0000 7eff1f4da640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180c43a0 con 0x7eff180acfc0 2023-08-09T12:40:37.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff18161280 0x7eff181f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff18161280 0x7eff181f58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51428/0 (socket says 172.21.15.17:51428) 2023-08-09T12:40:37.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 -- 172.21.15.17:0/2803713192 learned_addr learned my addr 172.21.15.17:0/2803713192 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:37.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1da77640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18161660 0x7eff181f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1d276640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff180acfc0 0x7eff180ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 -- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff180acfc0 msgr2=0x7eff180ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff180acfc0 0x7eff180ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 -- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18161660 msgr2=0x7eff181f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:37.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18161660 0x7eff181f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:37.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 -- 172.21.15.17:0/2803713192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009a70 con 0x7eff18161280 2023-08-09T12:40:37.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.988+0000 7eff1ca75640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff18161280 0x7eff181f58f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c750 tx=0x7eff0800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.989+0000 7eff0dffb640 1 -- 172.21.15.17:0/2803713192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08007270 con 0x7eff18161280 2023-08-09T12:40:37.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.989+0000 7eff0dffb640 1 -- 172.21.15.17:0/2803713192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff080073d0 con 0x7eff18161280 2023-08-09T12:40:37.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.989+0000 7eff0dffb640 1 -- 172.21.15.17:0/2803713192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08001d20 con 0x7eff18161280 2023-08-09T12:40:37.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.989+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff180c4680 con 0x7eff18161280 2023-08-09T12:40:37.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.989+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff180ae5d0 con 0x7eff18161280 2023-08-09T12:40:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.990+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff18154900 con 0x7eff18161280 2023-08-09T12:40:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.991+0000 7eff0dffb640 1 -- 172.21.15.17:0/2803713192 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7eff080057a0 con 0x7eff18161280 2023-08-09T12:40:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.992+0000 7eff0dffb640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efefc06a080 0x7efefc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.992+0000 7eff0dffb640 1 -- 172.21.15.17:0/2803713192 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7eff08087ee0 con 0x7eff18161280 2023-08-09T12:40:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.993+0000 7eff1d276640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efefc06a080 0x7efefc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.994+0000 7eff1d276640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efefc06a080 0x7efefc06c540 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff14000f60 tx=0x7eff14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:37.996+0000 7eff0dffb640 1 -- 172.21.15.17:0/2803713192 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7eff18154900 con 0x7eff18161280 2023-08-09T12:40:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.189+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff18154900 con 0x7eff18161280 2023-08-09T12:40:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.190+0000 7eff0dffb640 1 -- 172.21.15.17:0/2803713192 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff18154900 con 0x7eff18161280 2023-08-09T12:40:38.193 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.192+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efefc06a080 msgr2=0x7efefc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.192+0000 7eff1f4da640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efefc06a080 0x7efefc06c540 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff14000f60 tx=0x7eff14009040 comp rx=0 tx=0).stop 2023-08-09T12:40:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.192+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff18161280 msgr2=0x7eff181f58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.192+0000 7eff1f4da640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff18161280 0x7eff181f58f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c750 tx=0x7eff0800cc10 comp rx=0 tx=0).stop 2023-08-09T12:40:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.192+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 shutdown_connections 2023-08-09T12:40:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.192+0000 7eff1f4da640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efefc06a080 0x7efefc06c540 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.193+0000 7eff1f4da640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff18161660 0x7eff181f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.193+0000 7eff1f4da640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff18161280 0x7eff181f58f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.193+0000 7eff1f4da640 1 --2- 172.21.15.17:0/2803713192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff180acfc0 0x7eff180ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.193+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 >> 172.21.15.17:0/2803713192 conn(0x7eff180cb1b0 msgr2=0x7eff1806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.193+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 shutdown_connections 2023-08-09T12:40:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.193+0000 7eff1f4da640 1 -- 172.21.15.17:0/2803713192 wait complete. 2023-08-09T12:40:38.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:40:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.428+0000 7fc91a52f640 1 Processor -- start 2023-08-09T12:40:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.428+0000 7fc91a52f640 1 -- start start 2023-08-09T12:40:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.430+0000 7fc91a52f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 0x7fc9140b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.430+0000 7fc91a52f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9140cc630 0x7fc9140ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.430+0000 7fc91a52f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91406c990 con 0x7fc9140adc40 2023-08-09T12:40:38.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.430+0000 7fc91a52f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9140ae020 con 0x7fc9140cc630 2023-08-09T12:40:38.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.430+0000 7fc91a52f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140b2250 con 0x7fc9140b3b40 2023-08-09T12:40:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.431+0000 7fc913fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc9140adc40 0x7fc91406c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54454/0 (socket says 172.21.15.17:54454) 2023-08-09T12:40:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.431+0000 7fc913fff640 1 -- 172.21.15.17:0/4286525367 learned_addr learned my addr 172.21.15.17:0/4286525367 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.431+0000 7fc9137fe640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 0x7fc9140b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.431+0000 7fc918acc640 1 --2- 172.21.15.17:0/4286525367 >> v2:172.21.15.142:3300/0 conn(0x7fc9140cc630 0x7fc9140ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.431+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697309158 0 0) 0x7fc91406c990 con 0x7fc9140adc40 2023-08-09T12:40:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.431+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8fc003520 con 0x7fc9140adc40 2023-08-09T12:40:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736474191 0 0) 0x7fc8fc003520 con 0x7fc9140adc40 2023-08-09T12:40:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 msgr2=0x7fc9140b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 0x7fc9140b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 >> v2:172.21.15.142:3300/0 conn(0x7fc9140cc630 msgr2=0x7fc9140ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 --2- 172.21.15.17:0/4286525367 >> v2:172.21.15.142:3300/0 conn(0x7fc9140cc630 0x7fc9140ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9140b2530 con 0x7fc9140adc40 2023-08-09T12:40:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc904001670 con 0x7fc9140adc40 2023-08-09T12:40:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 >> v1:172.21.15.17:6789/0 conn(0x7fc9140adc40 legacy=0x7fc91406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8fc003970 0x7fc8fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc8fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 0x7fc8fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140ae020 con 0x7fc8fc0047c0 2023-08-09T12:40:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140b2250 con 0x7fc8fc003970 2023-08-09T12:40:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc00fd90 con 0x7fc9140b3b40 2023-08-09T12:40:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc9137fe640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc8fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.432+0000 7fc913fff640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8fc003970 0x7fc8fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.433+0000 7fc918acc640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 0x7fc8fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.433+0000 7fc9137fe640 1 -- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 msgr2=0x7fc8fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.433+0000 7fc9137fe640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 0x7fc8fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.433+0000 7fc9137fe640 1 -- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8fc003970 msgr2=0x7fc8fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.433+0000 7fc9137fe640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8fc003970 0x7fc8fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.433+0000 7fc9137fe640 1 -- 172.21.15.17:0/4286525367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc003520 con 0x7fc8fc0047c0 2023-08-09T12:40:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.433+0000 7fc918acc640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140b3b40 0x7fc8fc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.434+0000 7fc9137fe640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc8fc004c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc908009ab0 tx=0x7fc8fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9513a5f62965d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.435+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908005990 con 0x7fc8fc0047c0 2023-08-09T12:40:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.435+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908005af0 con 0x7fc8fc0047c0 2023-08-09T12:40:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.435+0000 7fc912ffd640 1 -- 172.21.15.17:0/4286525367 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908005ea0 con 0x7fc8fc0047c0 2023-08-09T12:40:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.435+0000 7fc91a52f640 1 -- 172.21.15.17:0/4286525367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 msgr2=0x7fc8fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.435+0000 7fc91a52f640 1 --2- 172.21.15.17:0/4286525367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc8fc004c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc908009ab0 tx=0x7fc8fc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.435+0000 7fc918acc640 1 -- 172.21.15.17:0/4286525367 reap_dead start 2023-08-09T12:40:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.435+0000 7fc91a52f640 1 -- 172.21.15.17:0/4286525367 shutdown_connections 2023-08-09T12:40:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.435+0000 7fc91a52f640 1 -- 172.21.15.17:0/4286525367 >> 172.21.15.17:0/4286525367 conn(0x7fc9140cb1b0 msgr2=0x7fc9140cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.436+0000 7fc91a52f640 1 -- 172.21.15.17:0/4286525367 shutdown_connections 2023-08-09T12:40:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.436+0000 7fc91a52f640 1 -- 172.21.15.17:0/4286525367 wait complete. 2023-08-09T12:40:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.437+0000 7fc91a52f640 1 Processor -- start 2023-08-09T12:40:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.438+0000 7fc91a52f640 1 -- start start 2023-08-09T12:40:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc91a52f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc91414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc91a52f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140caa70 0x7fc91406ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc91a52f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9140abc70 0x7fc9140ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc91a52f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc914150190 con 0x7fc8fc0047c0 2023-08-09T12:40:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc91a52f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140ac630 con 0x7fc9140abc70 2023-08-09T12:40:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc91a52f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9141ee260 con 0x7fc9140caa70 2023-08-09T12:40:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc913fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc91414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc913fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc91414fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51450/0 (socket says 172.21.15.17:51450) 2023-08-09T12:40:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc913fff640 1 -- 172.21.15.17:0/14595943 learned_addr learned my addr 172.21.15.17:0/14595943 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc9137fe640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140caa70 0x7fc91406ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc918acc640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9140abc70 0x7fc9140ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc913fff640 1 -- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140caa70 msgr2=0x7fc91406ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc913fff640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140caa70 0x7fc91406ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.439+0000 7fc913fff640 1 -- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9140abc70 msgr2=0x7fc9140ac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc913fff640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9140abc70 0x7fc9140ac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc913fff640 1 -- 172.21.15.17:0/14595943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91406b520 con 0x7fc8fc0047c0 2023-08-09T12:40:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc918acc640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9140abc70 0x7fc9140ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc913fff640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc91414fc50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc90400e740 tx=0x7fc90400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc910ff9640 1 -- 172.21.15.17:0/14595943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400ee50 con 0x7fc8fc0047c0 2023-08-09T12:40:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc910ff9640 1 -- 172.21.15.17:0/14595943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90400c870 con 0x7fc8fc0047c0 2023-08-09T12:40:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc910ff9640 1 -- 172.21.15.17:0/14595943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400cc00 con 0x7fc8fc0047c0 2023-08-09T12:40:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91406b800 con 0x7fc8fc0047c0 2023-08-09T12:40:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.440+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9140a9e00 con 0x7fc8fc0047c0 2023-08-09T12:40:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.441+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc914067a80 con 0x7fc8fc0047c0 2023-08-09T12:40:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.442+0000 7fc910ff9640 1 -- 172.21.15.17:0/14595943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc90401d460 con 0x7fc8fc0047c0 2023-08-09T12:40:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.443+0000 7fc910ff9640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc90006a080 0x7fc90006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.443+0000 7fc910ff9640 1 -- 172.21.15.17:0/14595943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc904088220 con 0x7fc8fc0047c0 2023-08-09T12:40:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.444+0000 7fc9137fe640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc90006a080 0x7fc90006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.445+0000 7fc9137fe640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc90006a080 0x7fc90006c540 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc908035000 tx=0x7fc908030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.448+0000 7fc910ff9640 1 -- 172.21.15.17:0/14595943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc904053bc0 con 0x7fc8fc0047c0 2023-08-09T12:40:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.642+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc91406ed40 con 0x7fc8fc0047c0 2023-08-09T12:40:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.643+0000 7fc910ff9640 1 -- 172.21.15.17:0/14595943 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc9040571e0 con 0x7fc8fc0047c0 2023-08-09T12:40:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:38.646 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:40:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:40:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:40:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:40:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:40:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:38.647 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:40:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc90006a080 msgr2=0x7fc90006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc90006a080 0x7fc90006c540 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc908035000 tx=0x7fc908030000 comp rx=0 tx=0).stop 2023-08-09T12:40:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 msgr2=0x7fc91414fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc91414fc50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc90400e740 tx=0x7fc90400ec00 comp rx=0 tx=0).stop 2023-08-09T12:40:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 shutdown_connections 2023-08-09T12:40:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc90006a080 0x7fc90006c540 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9140abc70 0x7fc9140ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9140caa70 0x7fc91406ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 --2- 172.21.15.17:0/14595943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8fc0047c0 0x7fc91414fc50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.645+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 >> 172.21.15.17:0/14595943 conn(0x7fc9140cb1b0 msgr2=0x7fc91415d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.646+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 shutdown_connections 2023-08-09T12:40:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.646+0000 7fc91a52f640 1 -- 172.21.15.17:0/14595943 wait complete. 2023-08-09T12:40:38.667 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:40:38.668 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:40:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.902+0000 7f3c1250f640 1 Processor -- start 2023-08-09T12:40:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.903+0000 7f3c1250f640 1 -- start start 2023-08-09T12:40:38.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.904+0000 7f3c1250f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 0x7f3c0c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.904+0000 7f3c1250f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3c0c0708a0 0x7f3c0c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.904+0000 7f3c1250f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c15f6e0 con 0x7f3c0c0add60 2023-08-09T12:40:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.904+0000 7f3c1250f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c0b4770 con 0x7f3c0c0708a0 2023-08-09T12:40:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.904+0000 7f3c1250f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0caa70 con 0x7f3c0c15abe0 2023-08-09T12:40:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c037fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3c0c0add60 0x7f3c0c070190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54462/0 (socket says 172.21.15.17:54462) 2023-08-09T12:40:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c037fe640 1 -- 172.21.15.17:0/1458172892 learned_addr learned my addr 172.21.15.17:0/1458172892 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c10aac640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3c0c0708a0 0x7f3c0c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c0bfff640 1 --2- 172.21.15.17:0/1458172892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 0x7f3c0c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c10aac640 1 -- 172.21.15.17:0/1458172892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 msgr2=0x7f3c0c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c10aac640 1 --2- 172.21.15.17:0/1458172892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 0x7f3c0c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c10aac640 1 -- 172.21.15.17:0/1458172892 >> v1:172.21.15.17:6789/0 conn(0x7f3c0c0add60 legacy=0x7f3c0c070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c10aac640 1 -- 172.21.15.17:0/1458172892 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c0b41b0 con 0x7f3c0c0708a0 2023-08-09T12:40:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.905+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/1458172892 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650411250 0 0) 0x7f3bf4001110 con 0x7f3c0c0add60 2023-08-09T12:40:38.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c10aac640 1 --2- 172.21.15.17:0/1458172892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0708a0 0x7f3c0c15f1a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009d90 tx=0x7f3c0402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c156a5ad3c1322 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:38.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/1458172892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0402cb40 con 0x7f3c0c0708a0 2023-08-09T12:40:38.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/1458172892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0402cca0 con 0x7f3c0c0708a0 2023-08-09T12:40:38.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/1458172892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04034660 con 0x7f3c0c0708a0 2023-08-09T12:40:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c1250f640 1 -- 172.21.15.17:0/1458172892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0708a0 msgr2=0x7f3c0c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c1250f640 1 --2- 172.21.15.17:0/1458172892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0708a0 0x7f3c0c15f1a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009d90 tx=0x7f3c0402bd90 comp rx=0 tx=0).stop 2023-08-09T12:40:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c1250f640 1 -- 172.21.15.17:0/1458172892 shutdown_connections 2023-08-09T12:40:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c1250f640 1 --2- 172.21.15.17:0/1458172892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0708a0 0x7f3c0c15f1a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c1250f640 1 --2- 172.21.15.17:0/1458172892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 0x7f3c0c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.907+0000 7f3c1250f640 1 -- 172.21.15.17:0/1458172892 >> 172.21.15.17:0/1458172892 conn(0x7f3c0c0697c0 msgr2=0x7f3c0c069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.908+0000 7f3c1250f640 1 -- 172.21.15.17:0/1458172892 shutdown_connections 2023-08-09T12:40:38.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.908+0000 7f3c1250f640 1 -- 172.21.15.17:0/1458172892 wait complete. 2023-08-09T12:40:38.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.909+0000 7f3c1250f640 1 Processor -- start 2023-08-09T12:40:38.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.910+0000 7f3c1250f640 1 -- start start 2023-08-09T12:40:38.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c1250f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0c0708a0 0x7f3c0c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c1250f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0add60 0x7f3c0c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c1250f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 0x7f3c0c147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c1250f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c5f40 con 0x7f3c0c0add60 2023-08-09T12:40:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c1250f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c147300 con 0x7f3c0c0708a0 2023-08-09T12:40:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c1250f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c1475e0 con 0x7f3c0c15abe0 2023-08-09T12:40:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0add60 0x7f3c0c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0add60 0x7f3c0c0acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51470/0 (socket says 172.21.15.17:51470) 2023-08-09T12:40:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c037fe640 1 -- 172.21.15.17:0/4040301649 learned_addr learned my addr 172.21.15.17:0/4040301649 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:38.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c10aac640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 0x7f3c0c147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c0bfff640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0c0708a0 0x7f3c0c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.911+0000 7f3c037fe640 1 -- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 msgr2=0x7f3c0c147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c037fe640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 0x7f3c0c147940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c037fe640 1 -- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0c0708a0 msgr2=0x7f3c0c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:38.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c037fe640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0c0708a0 0x7f3c0c0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:38.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c037fe640 1 -- 172.21.15.17:0/4040301649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04009a70 con 0x7f3c0c0add60 2023-08-09T12:40:38.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c037fe640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0add60 0x7f3c0c0acdf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c410 tx=0x7f3bf400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:38.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c097fa640 1 -- 172.21.15.17:0/4040301649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40074e0 con 0x7f3c0c0add60 2023-08-09T12:40:38.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c097fa640 1 -- 172.21.15.17:0/4040301649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf4007660 con 0x7f3c0c0add60 2023-08-09T12:40:38.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c097fa640 1 -- 172.21.15.17:0/4040301649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4004a20 con 0x7f3c0c0add60 2023-08-09T12:40:38.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c0c5880 con 0x7f3c0c0add60 2023-08-09T12:40:38.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.912+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c147e80 con 0x7f3c0c0add60 2023-08-09T12:40:38.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.913+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c067a80 con 0x7f3c0c0add60 2023-08-09T12:40:38.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.914+0000 7f3c097fa640 1 -- 172.21.15.17:0/4040301649 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3bf4004b80 con 0x7f3c0c0add60 2023-08-09T12:40:38.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.915+0000 7f3c097fa640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3bec06a050 0x7f3bec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:38.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.916+0000 7f3c097fa640 1 -- 172.21.15.17:0/4040301649 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3bf4087eb0 con 0x7f3c0c0add60 2023-08-09T12:40:38.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.916+0000 7f3c0bfff640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3bec06a050 0x7f3bec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:38.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.917+0000 7f3c0bfff640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3bec06a050 0x7f3bec06c510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc006fd0 tx=0x7f3bfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:38.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:38.920+0000 7f3c097fa640 1 -- 172.21.15.17:0/4040301649 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3bf4057370 con 0x7f3c0c0add60 2023-08-09T12:40:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.116+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3c0c15f6e0 con 0x7f3c0c0add60 2023-08-09T12:40:39.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:40:39.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:40:39.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.680+0000 7f3c097fa640 1 -- 172.21.15.17:0/4040301649 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3c0c15f6e0 con 0x7f3c0c0add60 2023-08-09T12:40:39.685 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:40:39.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3bec06a050 msgr2=0x7f3bec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:39.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3bec06a050 0x7f3bec06c510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc006fd0 tx=0x7f3bfc008040 comp rx=0 tx=0).stop 2023-08-09T12:40:39.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0add60 msgr2=0x7f3c0c0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0add60 0x7f3c0c0acdf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c410 tx=0x7f3bf400c8d0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 shutdown_connections 2023-08-09T12:40:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3bec06a050 0x7f3bec06c510 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c0c15abe0 0x7f3c0c147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c0add60 0x7f3c0c0acdf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 --2- 172.21.15.17:0/4040301649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0c0708a0 0x7f3c0c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.687+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 >> 172.21.15.17:0/4040301649 conn(0x7f3c0c0697c0 msgr2=0x7f3c0c15dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:39.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.688+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 shutdown_connections 2023-08-09T12:40:39.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.689+0000 7f3c1250f640 1 -- 172.21.15.17:0/4040301649 wait complete. 2023-08-09T12:40:39.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:40:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.940+0000 7f298e774640 1 Processor -- start 2023-08-09T12:40:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.941+0000 7f298e774640 1 -- start start 2023-08-09T12:40:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.942+0000 7f298e774640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29880b8420 0x7f29880cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.942+0000 7f298e774640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880d0f00 con 0x7f298815cb40 2023-08-09T12:40:39.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.942+0000 7f298e774640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29881611f0 con 0x7f298815cf20 2023-08-09T12:40:39.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.942+0000 7f298e774640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29881614d0 con 0x7f29880b8420 2023-08-09T12:40:39.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.943+0000 7f298d772640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f298815cb40 0x7f29881609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54478/0 (socket says 172.21.15.17:54478) 2023-08-09T12:40:39.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.943+0000 7f298d772640 1 -- 172.21.15.17:0/973042658 learned_addr learned my addr 172.21.15.17:0/973042658 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:39.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.943+0000 7f298cf71640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29880b8420 0x7f29880cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:39.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.943+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226777731 0 0) 0x7f29880d0f00 con 0x7f298815cb40 2023-08-09T12:40:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.943+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2974003520 con 0x7f298815cb40 2023-08-09T12:40:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703536501 0 0) 0x7f2974003520 con 0x7f298815cb40 2023-08-09T12:40:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29880b8420 msgr2=0x7f29880cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29880b8420 0x7f29880cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 >> v1:172.21.15.142:6789/0 conn(0x7f298815cf20 legacy=0x7f29880d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29881617b0 con 0x7f298815cb40 2023-08-09T12:40:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f2984001670 con 0x7f298815cb40 2023-08-09T12:40:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 >> v1:172.21.15.17:6789/0 conn(0x7f298815cb40 legacy=0x7f29881609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29880b8420 0x7f29740039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2974003f20 0x7f29740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974004d00 0x7f2974005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29881614d0 con 0x7f2974004d00 2023-08-09T12:40:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297400baf0 con 0x7f2974003f20 2023-08-09T12:40:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297400bcb0 con 0x7f29880b8420 2023-08-09T12:40:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f298df73640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974004d00 0x7f2974005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f298cf71640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2974003f20 0x7f29740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.944+0000 7f298d772640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29880b8420 0x7f29740039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.945+0000 7f298df73640 1 -- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29880b8420 msgr2=0x7f29740039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.945+0000 7f298df73640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29880b8420 0x7f29740039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.945+0000 7f298df73640 1 -- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2974003f20 msgr2=0x7f29740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.945+0000 7f298df73640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2974003f20 0x7f29740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.945+0000 7f298df73640 1 -- 172.21.15.17:0/973042658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974003520 con 0x7f2974004d00 2023-08-09T12:40:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.946+0000 7f298df73640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974004d00 0x7f2974005180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2980001e50 tx=0x7f29740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d0fcb31fbc0024 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.947+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980003b70 con 0x7f2974004d00 2023-08-09T12:40:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.947+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2980003cd0 con 0x7f2974004d00 2023-08-09T12:40:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.947+0000 7f297ffff640 1 -- 172.21.15.17:0/973042658 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980005310 con 0x7f2974004d00 2023-08-09T12:40:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.947+0000 7f298e774640 1 -- 172.21.15.17:0/973042658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974004d00 msgr2=0x7f2974005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.947+0000 7f298e774640 1 --2- 172.21.15.17:0/973042658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974004d00 0x7f2974005180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2980001e50 tx=0x7f29740057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.947+0000 7f298df73640 1 -- 172.21.15.17:0/973042658 reap_dead start 2023-08-09T12:40:39.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.947+0000 7f298e774640 1 -- 172.21.15.17:0/973042658 shutdown_connections 2023-08-09T12:40:39.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.947+0000 7f298e774640 1 -- 172.21.15.17:0/973042658 >> 172.21.15.17:0/973042658 conn(0x7f29880d2ab0 msgr2=0x7f29880d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:39.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.948+0000 7f298e774640 1 -- 172.21.15.17:0/973042658 shutdown_connections 2023-08-09T12:40:39.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.948+0000 7f298e774640 1 -- 172.21.15.17:0/973042658 wait complete. 2023-08-09T12:40:39.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.949+0000 7f298e774640 1 Processor -- start 2023-08-09T12:40:39.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.950+0000 7f298e774640 1 -- start start 2023-08-09T12:40:39.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.950+0000 7f298e774640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2974004d00 0x7f29880c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:39.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.950+0000 7f298e774640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29881f2260 0x7f29881f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:39.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.950+0000 7f298e774640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29880d1d10 0x7f29880d2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:39.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298e774640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298815d300 con 0x7f29881f2260 2023-08-09T12:40:39.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298e774640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880d26b0 con 0x7f29880d1d10 2023-08-09T12:40:39.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298e774640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298815d880 con 0x7f2974004d00 2023-08-09T12:40:39.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298cf71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29881f2260 0x7f29881f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:39.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298cf71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29881f2260 0x7f29881f26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51496/0 (socket says 172.21.15.17:51496) 2023-08-09T12:40:39.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298cf71640 1 -- 172.21.15.17:0/1848725933 learned_addr learned my addr 172.21.15.17:0/1848725933 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:39.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298df73640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29880d1d10 0x7f29880d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:39.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298d772640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2974004d00 0x7f29880c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:39.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298cf71640 1 -- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2974004d00 msgr2=0x7f29880c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:39.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298cf71640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2974004d00 0x7f29880c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298cf71640 1 -- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29880d1d10 msgr2=0x7f29880d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:39.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298cf71640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29880d1d10 0x7f29880d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:39.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298cf71640 1 -- 172.21.15.17:0/1848725933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29881f2dd0 con 0x7f29881f2260 2023-08-09T12:40:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298d772640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2974004d00 0x7f29880c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.951+0000 7f298df73640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29880d1d10 0x7f29880d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.952+0000 7f298cf71640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29881f2260 0x7f29881f26e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f29780119d0 tx=0x7f2978011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.952+0000 7f297dffb640 1 -- 172.21.15.17:0/1848725933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297800fb50 con 0x7f29881f2260 2023-08-09T12:40:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.952+0000 7f297dffb640 1 -- 172.21.15.17:0/1848725933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297800fcb0 con 0x7f29881f2260 2023-08-09T12:40:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.952+0000 7f297dffb640 1 -- 172.21.15.17:0/1848725933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978014440 con 0x7f29881f2260 2023-08-09T12:40:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.952+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29881f30b0 con 0x7f29881f2260 2023-08-09T12:40:39.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.952+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29880b7260 con 0x7f29881f2260 2023-08-09T12:40:39.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.953+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29881f32a0 con 0x7f29881f2260 2023-08-09T12:40:39.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.955+0000 7f297dffb640 1 -- 172.21.15.17:0/1848725933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f29780145a0 con 0x7f29881f2260 2023-08-09T12:40:39.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.956+0000 7f297dffb640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f296c06a050 0x7f296c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:39.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.956+0000 7f297dffb640 1 -- 172.21.15.17:0/1848725933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2978088fd0 con 0x7f29881f2260 2023-08-09T12:40:39.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.956+0000 7f298d772640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f296c06a050 0x7f296c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:39.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.958+0000 7f298d772640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f296c06a050 0x7f296c06c510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2984001050 tx=0x7f2984009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:39.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:39.960+0000 7f297dffb640 1 -- 172.21.15.17:0/1848725933 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f29780549c0 con 0x7f29881f2260 2023-08-09T12:40:40.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.156+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f29881f32a0 con 0x7f29881f2260 2023-08-09T12:40:40.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.698+0000 7f297dffb640 1 -- 172.21.15.17:0/1848725933 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f29881f32a0 con 0x7f29881f2260 2023-08-09T12:40:40.703 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:40:40.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.709+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f296c06a050 msgr2=0x7f296c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:40.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.709+0000 7f298e774640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f296c06a050 0x7f296c06c510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2984001050 tx=0x7f2984009040 comp rx=0 tx=0).stop 2023-08-09T12:40:40.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.709+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29881f2260 msgr2=0x7f29881f26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:40.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.709+0000 7f298e774640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29881f2260 0x7f29881f26e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f29780119d0 tx=0x7f2978011e90 comp rx=0 tx=0).stop 2023-08-09T12:40:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.711+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 shutdown_connections 2023-08-09T12:40:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.711+0000 7f298e774640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f296c06a050 0x7f296c06c510 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.711+0000 7f298e774640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29880d1d10 0x7f29880d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.711+0000 7f298e774640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29881f2260 0x7f29881f26e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.711+0000 7f298e774640 1 --2- 172.21.15.17:0/1848725933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2974004d00 0x7f29880c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.711+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 >> 172.21.15.17:0/1848725933 conn(0x7f29880d2ab0 msgr2=0x7f29881598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:40.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.712+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 shutdown_connections 2023-08-09T12:40:40.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.712+0000 7f298e774640 1 -- 172.21.15.17:0/1848725933 wait complete. 2023-08-09T12:40:40.739 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:40:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.947+0000 7fe6b9f79640 1 Processor -- start 2023-08-09T12:40:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.947+0000 7fe6b9f79640 1 -- start start 2023-08-09T12:40:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.948+0000 7fe6b9f79640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6b415add0 0x7fe6b40b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.948+0000 7fe6b9f79640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe6b40b38a0 0x7fe6b40cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.948+0000 7fe6b9f79640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.948+0000 7fe6b9f79640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b40cdd60 con 0x7fe6b40b38a0 2023-08-09T12:40:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.948+0000 7fe6b9f79640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b40cc660 con 0x7fe6b415add0 2023-08-09T12:40:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.948+0000 7fe6b9f79640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40cc940 con 0x7fe6b40717e0 2023-08-09T12:40:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.948+0000 7fe6b2ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe6b40b38a0 0x7fe6b40cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b2ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe6b40b38a0 0x7fe6b40cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51510/0 (socket says 172.21.15.17:51510) 2023-08-09T12:40:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b2ffd640 1 -- 172.21.15.17:0/1357538583 learned_addr learned my addr 172.21.15.17:0/1357538583 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b3fff640 1 --2- 172.21.15.17:0/1357538583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b37fe640 1 --2- 172.21.15.17:0/1357538583 >> v2:172.21.15.142:3300/0 conn(0x7fe6b415add0 0x7fe6b40b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b2ffd640 1 -- 172.21.15.17:0/1357538583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 msgr2=0x7fe6b40cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b2ffd640 1 --2- 172.21.15.17:0/1357538583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b2ffd640 1 -- 172.21.15.17:0/1357538583 >> v2:172.21.15.142:3300/0 conn(0x7fe6b415add0 msgr2=0x7fe6b40b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b2ffd640 1 --2- 172.21.15.17:0/1357538583 >> v2:172.21.15.142:3300/0 conn(0x7fe6b415add0 0x7fe6b40b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b2ffd640 1 -- 172.21.15.17:0/1357538583 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40ccc20 con 0x7fe6b40b38a0 2023-08-09T12:40:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.949+0000 7fe6b3fff640 1 --2- 172.21.15.17:0/1357538583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.950+0000 7fe6b2ffd640 1 --2- 172.21.15.17:0/1357538583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40cd2e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40ce390 tx=0x7fe6a802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73a3e7664d00e9a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b27fc640 1 -- 172.21.15.17:0/1357538583 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8031740 con 0x7fe6b40b38a0 2023-08-09T12:40:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b27fc640 1 -- 172.21.15.17:0/1357538583 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a80318a0 con 0x7fe6b40b38a0 2023-08-09T12:40:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b27fc640 1 -- 172.21.15.17:0/1357538583 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8031c30 con 0x7fe6b40b38a0 2023-08-09T12:40:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b9f79640 1 -- 172.21.15.17:0/1357538583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 msgr2=0x7fe6b40cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/1357538583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40cd2e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40ce390 tx=0x7fe6a802b7e0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b9f79640 1 -- 172.21.15.17:0/1357538583 shutdown_connections 2023-08-09T12:40:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/1357538583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/1357538583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40cd2e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/1357538583 >> v2:172.21.15.142:3300/0 conn(0x7fe6b415add0 0x7fe6b40b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b9f79640 1 -- 172.21.15.17:0/1357538583 >> 172.21.15.17:0/1357538583 conn(0x7fe6b406b9d0 msgr2=0x7fe6b406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.951+0000 7fe6b9f79640 1 -- 172.21.15.17:0/1357538583 shutdown_connections 2023-08-09T12:40:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.952+0000 7fe6b9f79640 1 -- 172.21.15.17:0/1357538583 wait complete. 2023-08-09T12:40:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.953+0000 7fe6b9f79640 1 Processor -- start 2023-08-09T12:40:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.953+0000 7fe6b9f79640 1 -- start start 2023-08-09T12:40:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.954+0000 7fe6b9f79640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.954+0000 7fe6b9f79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.954+0000 7fe6b9f79640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b415add0 0x7fe6b40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.954+0000 7fe6b9f79640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40c9400 con 0x7fe6b40b38a0 2023-08-09T12:40:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.954+0000 7fe6b9f79640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40c87f0 con 0x7fe6b415add0 2023-08-09T12:40:40.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b9f79640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40c8ad0 con 0x7fe6b40717e0 2023-08-09T12:40:40.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:40.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51514/0 (socket says 172.21.15.17:51514) 2023-08-09T12:40:40.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b2ffd640 1 -- 172.21.15.17:0/2336989024 learned_addr learned my addr 172.21.15.17:0/2336989024 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:40.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b37fe640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:40.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b3fff640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b415add0 0x7fe6b40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b2ffd640 1 -- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 msgr2=0x7fe6b40c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b2ffd640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b2ffd640 1 -- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b415add0 msgr2=0x7fe6b40c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b2ffd640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b415add0 0x7fe6b40c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b2ffd640 1 -- 172.21.15.17:0/2336989024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a80094d0 con 0x7fe6b40b38a0 2023-08-09T12:40:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.955+0000 7fe6b3fff640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b415add0 0x7fe6b40c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.956+0000 7fe6b2ffd640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40c6c20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe6a802b820 tx=0x7fe6a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:40.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.956+0000 7fe69bfff640 1 -- 172.21.15.17:0/2336989024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8033c70 con 0x7fe6b40b38a0 2023-08-09T12:40:40.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.956+0000 7fe69bfff640 1 -- 172.21.15.17:0/2336989024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a8033df0 con 0x7fe6b40b38a0 2023-08-09T12:40:40.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.956+0000 7fe69bfff640 1 -- 172.21.15.17:0/2336989024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a803c640 con 0x7fe6b40b38a0 2023-08-09T12:40:40.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.956+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b40c8db0 con 0x7fe6b40b38a0 2023-08-09T12:40:40.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.956+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b40c8450 con 0x7fe6b40b38a0 2023-08-09T12:40:40.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.958+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b40c8c10 con 0x7fe6b40b38a0 2023-08-09T12:40:40.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.959+0000 7fe69bfff640 1 -- 172.21.15.17:0/2336989024 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe6a803a040 con 0x7fe6b40b38a0 2023-08-09T12:40:40.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.960+0000 7fe69bfff640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6a006a050 0x7fe6a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:40.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.960+0000 7fe69bfff640 1 -- 172.21.15.17:0/2336989024 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe6a80a9f60 con 0x7fe6b40b38a0 2023-08-09T12:40:40.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.961+0000 7fe6b37fe640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6a006a050 0x7fe6a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:40.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.962+0000 7fe6b37fe640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6a006a050 0x7fe6a006c510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009e90 tx=0x7fe6a400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:40.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:40.966+0000 7fe69bfff640 1 -- 172.21.15.17:0/2336989024 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe6b40c8c10 con 0x7fe6b40b38a0 2023-08-09T12:40:41.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.197+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe6b40c8c10 con 0x7fe6b40b38a0 2023-08-09T12:40:41.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.703+0000 7fe69bfff640 1 -- 172.21.15.17:0/2336989024 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe6b40c8c10 con 0x7fe6b40b38a0 2023-08-09T12:40:41.706 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 5 and data pool 6 2023-08-09T12:40:41.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.709+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6a006a050 msgr2=0x7fe6a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.710+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6a006a050 0x7fe6a006c510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009e90 tx=0x7fe6a400b040 comp rx=0 tx=0).stop 2023-08-09T12:40:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.710+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 msgr2=0x7fe6b40c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.710+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40c6c20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe6a802b820 tx=0x7fe6a80046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.712+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 shutdown_connections 2023-08-09T12:40:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.712+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6a006a050 0x7fe6a006c510 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.712+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b415add0 0x7fe6b40c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.712+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6b40b38a0 0x7fe6b40c6c20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.712+0000 7fe6b9f79640 1 --2- 172.21.15.17:0/2336989024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6b40717e0 0x7fe6b40c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.712+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 >> 172.21.15.17:0/2336989024 conn(0x7fe6b406b9d0 msgr2=0x7fe6b4065460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.714+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 shutdown_connections 2023-08-09T12:40:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.714+0000 7fe6b9f79640 1 -- 172.21.15.17:0/2336989024 wait complete. 2023-08-09T12:40:41.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.942+0000 7f09ab59e640 1 Processor -- start 2023-08-09T12:40:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.943+0000 7f09ab59e640 1 -- start start 2023-08-09T12:40:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.944+0000 7f09ab59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09ac0caf00 0x7f09ac0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.944+0000 7f09ab59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f09ac0c2240 0x7f09ac0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.944+0000 7f09ab59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ac0b34a0 con 0x7f09ac1601f0 2023-08-09T12:40:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.944+0000 7f09ab59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ac0b4120 con 0x7f09ac0c2240 2023-08-09T12:40:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.944+0000 7f09ab59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ac0cb8f0 con 0x7f09ac0caf00 2023-08-09T12:40:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.945+0000 7f09aad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f09ac0c2240 0x7f09ac0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:41.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.945+0000 7f09aad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f09ac0c2240 0x7f09ac0c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51520/0 (socket says 172.21.15.17:51520) 2023-08-09T12:40:41.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.945+0000 7f09aad9d640 1 -- 172.21.15.17:0/1181206974 learned_addr learned my addr 172.21.15.17:0/1181206974 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.945+0000 7f09a9d9b640 1 --2- 172.21.15.17:0/1181206974 >> v2:172.21.15.142:3300/0 conn(0x7f09ac0caf00 0x7f09ac0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.945+0000 7f09aad9d640 1 -- 172.21.15.17:0/1181206974 >> v2:172.21.15.142:3300/0 conn(0x7f09ac0caf00 msgr2=0x7f09ac0cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.945+0000 7f09aad9d640 1 --2- 172.21.15.17:0/1181206974 >> v2:172.21.15.142:3300/0 conn(0x7f09ac0caf00 0x7f09ac0cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.945+0000 7f09aad9d640 1 -- 172.21.15.17:0/1181206974 >> v1:172.21.15.142:6789/0 conn(0x7f09ac1601f0 legacy=0x7f09ac0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.945+0000 7f09aad9d640 1 -- 172.21.15.17:0/1181206974 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac0b3780 con 0x7f09ac0c2240 2023-08-09T12:40:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.946+0000 7f09aad9d640 1 --2- 172.21.15.17:0/1181206974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0c2240 0x7f09ac0c2650 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0b12b0 tx=0x7f09a402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e50d9d6e2d8c05e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09a959a640 1 -- 172.21.15.17:0/1181206974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a402ca80 con 0x7f09ac0c2240 2023-08-09T12:40:41.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09a959a640 1 -- 172.21.15.17:0/1181206974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a402cbe0 con 0x7f09ac0c2240 2023-08-09T12:40:41.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09a959a640 1 -- 172.21.15.17:0/1181206974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a40343f0 con 0x7f09ac0c2240 2023-08-09T12:40:41.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09ab59e640 1 -- 172.21.15.17:0/1181206974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0c2240 msgr2=0x7f09ac0c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09ab59e640 1 --2- 172.21.15.17:0/1181206974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0c2240 0x7f09ac0c2650 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0b12b0 tx=0x7f09a402bee0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09ab59e640 1 -- 172.21.15.17:0/1181206974 shutdown_connections 2023-08-09T12:40:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09ab59e640 1 --2- 172.21.15.17:0/1181206974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0c2240 0x7f09ac0c2650 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09ab59e640 1 --2- 172.21.15.17:0/1181206974 >> v2:172.21.15.142:3300/0 conn(0x7f09ac0caf00 0x7f09ac0cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09ab59e640 1 -- 172.21.15.17:0/1181206974 >> 172.21.15.17:0/1181206974 conn(0x7f09ac0b1d50 msgr2=0x7f09ac06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.947+0000 7f09ab59e640 1 -- 172.21.15.17:0/1181206974 shutdown_connections 2023-08-09T12:40:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.948+0000 7f09ab59e640 1 -- 172.21.15.17:0/1181206974 wait complete. 2023-08-09T12:40:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.949+0000 7f09ab59e640 1 Processor -- start 2023-08-09T12:40:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.949+0000 7f09ab59e640 1 -- start start 2023-08-09T12:40:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.950+0000 7f09ab59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ac0c2240 0x7f09ac0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.950+0000 7f09ab59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0caf00 0x7f09ac15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.950+0000 7f09ab59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ac1601f0 0x7f09ac0aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.950+0000 7f09ab59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac15c130 con 0x7f09ac0caf00 2023-08-09T12:40:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.950+0000 7f09ab59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac0af400 con 0x7f09ac0c2240 2023-08-09T12:40:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.950+0000 7f09ab59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac070570 con 0x7f09ac1601f0 2023-08-09T12:40:41.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09a9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0caf00 0x7f09ac15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:41.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09a9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0caf00 0x7f09ac15bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51530/0 (socket says 172.21.15.17:51530) 2023-08-09T12:40:41.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09a9d9b640 1 -- 172.21.15.17:0/3558551336 learned_addr learned my addr 172.21.15.17:0/3558551336 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:41.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09aa59c640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ac0c2240 0x7f09ac0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:41.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09aad9d640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ac1601f0 0x7f09ac0aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:41.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09a9d9b640 1 -- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ac1601f0 msgr2=0x7f09ac0aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:41.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09a9d9b640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ac1601f0 0x7f09ac0aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09a9d9b640 1 -- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ac0c2240 msgr2=0x7f09ac0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:41.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09a9d9b640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ac0c2240 0x7f09ac0ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:41.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09a9d9b640 1 -- 172.21.15.17:0/3558551336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a4009b30 con 0x7f09ac0caf00 2023-08-09T12:40:41.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.951+0000 7f09aa59c640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ac0c2240 0x7f09ac0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:41.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.952+0000 7f09a9d9b640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0caf00 0x7f09ac15bbf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f099400d800 tx=0x7f099400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:41.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.952+0000 7f09a2ffd640 1 -- 172.21.15.17:0/3558551336 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400b6c0 con 0x7f09ac0caf00 2023-08-09T12:40:41.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.952+0000 7f09a2ffd640 1 -- 172.21.15.17:0/3558551336 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400b820 con 0x7f09ac0caf00 2023-08-09T12:40:41.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.952+0000 7f09a2ffd640 1 -- 172.21.15.17:0/3558551336 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400bbb0 con 0x7f09ac0caf00 2023-08-09T12:40:41.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.952+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac06fe80 con 0x7f09ac0caf00 2023-08-09T12:40:41.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.952+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ac070af0 con 0x7f09ac0caf00 2023-08-09T12:40:41.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.953+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ac070cb0 con 0x7f09ac0caf00 2023-08-09T12:40:41.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.954+0000 7f09a2ffd640 1 -- 172.21.15.17:0/3558551336 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f099400bd10 con 0x7f09ac0caf00 2023-08-09T12:40:41.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.955+0000 7f09a2ffd640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f098c06a050 0x7f098c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:41.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.955+0000 7f09a2ffd640 1 -- 172.21.15.17:0/3558551336 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0994088ac0 con 0x7f09ac0caf00 2023-08-09T12:40:41.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.956+0000 7f09aa59c640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f098c06a050 0x7f098c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:41.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.957+0000 7f09aa59c640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f098c06a050 0x7f098c06c510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f099c00a830 tx=0x7f099c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:41.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:41.959+0000 7f09a2ffd640 1 -- 172.21.15.17:0/3558551336 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f09940541a0 con 0x7f09ac0caf00 2023-08-09T12:40:42.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.153+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09ac04e390 con 0x7f09ac0caf00 2023-08-09T12:40:42.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.156+0000 7f09a2ffd640 1 -- 172.21.15.17:0/3558551336 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f09940577c0 con 0x7f09ac0caf00 2023-08-09T12:40:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:42.161 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":36,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:41.199379+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:42.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f098c06a050 msgr2=0x7f098c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f098c06a050 0x7f098c06c510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f099c00a830 tx=0x7f099c008040 comp rx=0 tx=0).stop 2023-08-09T12:40:42.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0caf00 msgr2=0x7f09ac15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0caf00 0x7f09ac15bbf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f099400d800 tx=0x7f099400dcc0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 shutdown_connections 2023-08-09T12:40:42.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f098c06a050 0x7f098c06c510 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09ac1601f0 0x7f09ac0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09ac0caf00 0x7f09ac15bbf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 --2- 172.21.15.17:0/3558551336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09ac0c2240 0x7f09ac0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 >> 172.21.15.17:0/3558551336 conn(0x7f09ac0b1d50 msgr2=0x7f09ac15f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:42.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 shutdown_connections 2023-08-09T12:40:42.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.159+0000 7f09ab59e640 1 -- 172.21.15.17:0/3558551336 wait complete. 2023-08-09T12:40:42.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.399+0000 7fd42a312640 1 Processor -- start 2023-08-09T12:40:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.400+0000 7fd42a312640 1 -- start start 2023-08-09T12:40:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd42a312640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4240b3b40 0x7fd4240b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd42a312640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd4240cc630 0x7fd4240ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd42a312640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42406c990 con 0x7fd4240adc40 2023-08-09T12:40:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd42a312640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240ae020 con 0x7fd4240cc630 2023-08-09T12:40:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd42a312640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240b2250 con 0x7fd4240b3b40 2023-08-09T12:40:42.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd4288af640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd4240cc630 0x7fd4240ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd4288af640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd4240cc630 0x7fd4240ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51534/0 (socket says 172.21.15.17:51534) 2023-08-09T12:40:42.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd4288af640 1 -- 172.21.15.17:0/3807642847 learned_addr learned my addr 172.21.15.17:0/3807642847 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:42.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.401+0000 7fd423fff640 1 --1- 172.21.15.17:0/3807642847 >> v1:172.21.15.17:6789/0 conn(0x7fd4240adc40 0x7fd42406c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54492/0 (socket says 172.21.15.17:54492) 2023-08-09T12:40:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.402+0000 7fd4237fe640 1 --2- 172.21.15.17:0/3807642847 >> v2:172.21.15.142:3300/0 conn(0x7fd4240b3b40 0x7fd4240b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.402+0000 7fd4288af640 1 -- 172.21.15.17:0/3807642847 >> v2:172.21.15.142:3300/0 conn(0x7fd4240b3b40 msgr2=0x7fd4240b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.402+0000 7fd4288af640 1 --2- 172.21.15.17:0/3807642847 >> v2:172.21.15.142:3300/0 conn(0x7fd4240b3b40 0x7fd4240b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.402+0000 7fd4288af640 1 -- 172.21.15.17:0/3807642847 >> v1:172.21.15.17:6789/0 conn(0x7fd4240adc40 legacy=0x7fd42406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.402+0000 7fd4288af640 1 -- 172.21.15.17:0/3807642847 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240b2530 con 0x7fd4240cc630 2023-08-09T12:40:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.402+0000 7fd422ffd640 1 -- 172.21.15.17:0/3807642847 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766788668 0 0) 0x7fd42406c990 con 0x7fd4240adc40 2023-08-09T12:40:42.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.402+0000 7fd4237fe640 1 --2- 172.21.15.17:0/3807642847 >> v2:172.21.15.142:3300/0 conn(0x7fd4240b3b40 0x7fd4240b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.403+0000 7fd4288af640 1 --2- 172.21.15.17:0/3807642847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240cc630 0x7fd4240ccaa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd4240b48a0 tx=0x7fd41c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6020cd0c929c15d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.403+0000 7fd422ffd640 1 -- 172.21.15.17:0/3807642847 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c030860 con 0x7fd4240cc630 2023-08-09T12:40:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.403+0000 7fd422ffd640 1 -- 172.21.15.17:0/3807642847 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c0309c0 con 0x7fd4240cc630 2023-08-09T12:40:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.403+0000 7fd422ffd640 1 -- 172.21.15.17:0/3807642847 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c030d50 con 0x7fd4240cc630 2023-08-09T12:40:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.404+0000 7fd42a312640 1 -- 172.21.15.17:0/3807642847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240cc630 msgr2=0x7fd4240ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.404+0000 7fd42a312640 1 --2- 172.21.15.17:0/3807642847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240cc630 0x7fd4240ccaa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd4240b48a0 tx=0x7fd41c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.404+0000 7fd42a312640 1 -- 172.21.15.17:0/3807642847 shutdown_connections 2023-08-09T12:40:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.404+0000 7fd42a312640 1 --2- 172.21.15.17:0/3807642847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240cc630 0x7fd4240ccaa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.404+0000 7fd42a312640 1 --2- 172.21.15.17:0/3807642847 >> v2:172.21.15.142:3300/0 conn(0x7fd4240b3b40 0x7fd4240b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.404+0000 7fd42a312640 1 -- 172.21.15.17:0/3807642847 >> 172.21.15.17:0/3807642847 conn(0x7fd4240cb1b0 msgr2=0x7fd4240cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.404+0000 7fd42a312640 1 -- 172.21.15.17:0/3807642847 shutdown_connections 2023-08-09T12:40:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.404+0000 7fd42a312640 1 -- 172.21.15.17:0/3807642847 wait complete. 2023-08-09T12:40:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.406+0000 7fd42a312640 1 Processor -- start 2023-08-09T12:40:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.406+0000 7fd42a312640 1 -- start start 2023-08-09T12:40:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd42a312640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4240adc40 0x7fd424146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd42a312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240b3b40 0x7fd424143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd42a312640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4240cc630 0x7fd42415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd42a312640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424143ea0 con 0x7fd4240b3b40 2023-08-09T12:40:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd42a312640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424144250 con 0x7fd4240adc40 2023-08-09T12:40:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd42a312640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42415af00 con 0x7fd4240cc630 2023-08-09T12:40:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd4237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240b3b40 0x7fd424143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd4237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240b3b40 0x7fd424143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51540/0 (socket says 172.21.15.17:51540) 2023-08-09T12:40:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.407+0000 7fd4237fe640 1 -- 172.21.15.17:0/308775392 learned_addr learned my addr 172.21.15.17:0/308775392 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd4237fe640 1 -- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4240cc630 msgr2=0x7fd42415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd4237fe640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4240cc630 0x7fd42415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd4237fe640 1 -- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4240adc40 msgr2=0x7fd424146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd4237fe640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4240adc40 0x7fd424146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd4237fe640 1 -- 172.21.15.17:0/308775392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0094d0 con 0x7fd4240b3b40 2023-08-09T12:40:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd4237fe640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240b3b40 0x7fd424143960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c820 tx=0x7fd41800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd420ff9640 1 -- 172.21.15.17:0/308775392 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418005b90 con 0x7fd4240b3b40 2023-08-09T12:40:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd420ff9640 1 -- 172.21.15.17:0/308775392 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418005cf0 con 0x7fd4240b3b40 2023-08-09T12:40:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd420ff9640 1 -- 172.21.15.17:0/308775392 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418007a30 con 0x7fd4240b3b40 2023-08-09T12:40:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.408+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd424146800 con 0x7fd4240b3b40 2023-08-09T12:40:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.409+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd424146dc0 con 0x7fd4240b3b40 2023-08-09T12:40:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.410+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd424067a80 con 0x7fd4240b3b40 2023-08-09T12:40:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.411+0000 7fd420ff9640 1 -- 172.21.15.17:0/308775392 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd418007b90 con 0x7fd4240b3b40 2023-08-09T12:40:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.412+0000 7fd420ff9640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd41006a050 0x7fd41006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.412+0000 7fd420ff9640 1 -- 172.21.15.17:0/308775392 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4180884f0 con 0x7fd4240b3b40 2023-08-09T12:40:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.412+0000 7fd423fff640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd41006a050 0x7fd41006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.413+0000 7fd423fff640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd41006a050 0x7fd41006c510 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd414001560 tx=0x7fd414007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.416+0000 7fd420ff9640 1 -- 172.21.15.17:0/308775392 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd418053bd0 con 0x7fd4240b3b40 2023-08-09T12:40:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.606+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4241443c0 con 0x7fd4240b3b40 2023-08-09T12:40:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.609+0000 7fd420ff9640 1 -- 172.21.15.17:0/308775392 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18340 (secure 0 0 0) 0x7fd4180571f0 con 0x7fd4240b3b40 2023-08-09T12:40:42.613 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:42.613 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":36,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:41.199379+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.612+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd41006a050 msgr2=0x7fd41006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.612+0000 7fd42a312640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd41006a050 0x7fd41006c510 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd414001560 tx=0x7fd414007ca0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240b3b40 msgr2=0x7fd424143960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240b3b40 0x7fd424143960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c820 tx=0x7fd41800cc20 comp rx=0 tx=0).stop 2023-08-09T12:40:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 shutdown_connections 2023-08-09T12:40:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd41006a050 0x7fd41006c510 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4240cc630 0x7fd42415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4240b3b40 0x7fd424143960 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 --2- 172.21.15.17:0/308775392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4240adc40 0x7fd424146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 >> 172.21.15.17:0/308775392 conn(0x7fd4240cb1b0 msgr2=0x7fd4240ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 shutdown_connections 2023-08-09T12:40:42.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.613+0000 7fd42a312640 1 -- 172.21.15.17:0/308775392 wait complete. 2023-08-09T12:40:42.635 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:40:42.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.852+0000 7fc153fff640 1 Processor -- start 2023-08-09T12:40:42.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.853+0000 7fc153fff640 1 -- start start 2023-08-09T12:40:42.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.854+0000 7fc153fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc15415cac0 0x7fc1540cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.854+0000 7fc153fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1540b1fc0 0x7fc1540d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.854+0000 7fc153fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1540b44b0 0x7fc1540b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.854+0000 7fc153fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1540d1010 con 0x7fc15415cac0 2023-08-09T12:40:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.854+0000 7fc153fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1540d09e0 con 0x7fc1540b1fc0 2023-08-09T12:40:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.854+0000 7fc153fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1540b4e20 con 0x7fc1540b44b0 2023-08-09T12:40:42.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.855+0000 7fc152ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc15415cac0 0x7fc1540cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.855+0000 7fc152ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc15415cac0 0x7fc1540cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51554/0 (socket says 172.21.15.17:51554) 2023-08-09T12:40:42.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.855+0000 7fc152ffd640 1 -- 172.21.15.17:0/944155460 learned_addr learned my addr 172.21.15.17:0/944155460 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:42.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.855+0000 7fc1537fe640 1 --2- 172.21.15.17:0/944155460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1540b44b0 0x7fc1540b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.855+0000 7fc1527fc640 1 --2- 172.21.15.17:0/944155460 >> v2:172.21.15.142:3300/0 conn(0x7fc1540b1fc0 0x7fc1540d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.856+0000 7fc152ffd640 1 -- 172.21.15.17:0/944155460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1540b44b0 msgr2=0x7fc1540b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:42.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.856+0000 7fc152ffd640 1 --2- 172.21.15.17:0/944155460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1540b44b0 0x7fc1540b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.856+0000 7fc152ffd640 1 -- 172.21.15.17:0/944155460 >> v2:172.21.15.142:3300/0 conn(0x7fc1540b1fc0 msgr2=0x7fc1540d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:42.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.856+0000 7fc152ffd640 1 --2- 172.21.15.17:0/944155460 >> v2:172.21.15.142:3300/0 conn(0x7fc1540b1fc0 0x7fc1540d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.856+0000 7fc152ffd640 1 -- 172.21.15.17:0/944155460 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540cdb70 con 0x7fc15415cac0 2023-08-09T12:40:42.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.856+0000 7fc1527fc640 1 --2- 172.21.15.17:0/944155460 >> v2:172.21.15.142:3300/0 conn(0x7fc1540b1fc0 0x7fc1540d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:40:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.857+0000 7fc152ffd640 1 --2- 172.21.15.17:0/944155460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc15415cac0 0x7fc1540cd290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc1540b50e0 tx=0x7fc14402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c77f76c9e6828f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc151ffb640 1 -- 172.21.15.17:0/944155460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14402ca70 con 0x7fc15415cac0 2023-08-09T12:40:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc151ffb640 1 -- 172.21.15.17:0/944155460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14402cbd0 con 0x7fc15415cac0 2023-08-09T12:40:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc151ffb640 1 -- 172.21.15.17:0/944155460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440343f0 con 0x7fc15415cac0 2023-08-09T12:40:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc153fff640 1 -- 172.21.15.17:0/944155460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc15415cac0 msgr2=0x7fc1540cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc153fff640 1 --2- 172.21.15.17:0/944155460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc15415cac0 0x7fc1540cd290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc1540b50e0 tx=0x7fc14402bed0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc153fff640 1 -- 172.21.15.17:0/944155460 shutdown_connections 2023-08-09T12:40:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc153fff640 1 --2- 172.21.15.17:0/944155460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1540b44b0 0x7fc1540b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc153fff640 1 --2- 172.21.15.17:0/944155460 >> v2:172.21.15.142:3300/0 conn(0x7fc1540b1fc0 0x7fc1540d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.858+0000 7fc153fff640 1 --2- 172.21.15.17:0/944155460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc15415cac0 0x7fc1540cd290 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.859+0000 7fc153fff640 1 -- 172.21.15.17:0/944155460 >> 172.21.15.17:0/944155460 conn(0x7fc1540cf4b0 msgr2=0x7fc1540cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:42.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.859+0000 7fc153fff640 1 -- 172.21.15.17:0/944155460 shutdown_connections 2023-08-09T12:40:42.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.859+0000 7fc153fff640 1 -- 172.21.15.17:0/944155460 wait complete. 2023-08-09T12:40:42.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.860+0000 7fc153fff640 1 Processor -- start 2023-08-09T12:40:42.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.861+0000 7fc153fff640 1 -- start start 2023-08-09T12:40:42.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.861+0000 7fc153fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1540b1fc0 0x7fc15415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc153fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1540b44b0 0x7fc1540c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc153fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15415cac0 0x7fc1540cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc153fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1541f1f80 con 0x7fc1540b1fc0 2023-08-09T12:40:42.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc153fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1540c7590 con 0x7fc1540b44b0 2023-08-09T12:40:42.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc153fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15415f7f0 con 0x7fc15415cac0 2023-08-09T12:40:42.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc152ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1540b1fc0 0x7fc15415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc152ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1540b1fc0 0x7fc15415a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51558/0 (socket says 172.21.15.17:51558) 2023-08-09T12:40:42.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc152ffd640 1 -- 172.21.15.17:0/3720795926 learned_addr learned my addr 172.21.15.17:0/3720795926 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:42.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc1527fc640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1540b44b0 0x7fc1540c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc1537fe640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15415cac0 0x7fc1540cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc152ffd640 1 -- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15415cac0 msgr2=0x7fc1540cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc152ffd640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15415cac0 0x7fc1540cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc152ffd640 1 -- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1540b44b0 msgr2=0x7fc1540c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:42.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.862+0000 7fc152ffd640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1540b44b0 0x7fc1540c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:42.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.863+0000 7fc152ffd640 1 -- 172.21.15.17:0/3720795926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144009b30 con 0x7fc1540b1fc0 2023-08-09T12:40:42.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.863+0000 7fc1537fe640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15415cac0 0x7fc1540cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.863+0000 7fc152ffd640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1540b1fc0 0x7fc15415a630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc144000f80 tx=0x7fc144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.863+0000 7fc14b7fe640 1 -- 172.21.15.17:0/3720795926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144009510 con 0x7fc1540b1fc0 2023-08-09T12:40:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.863+0000 7fc14b7fe640 1 -- 172.21.15.17:0/3720795926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14403e450 con 0x7fc1540b1fc0 2023-08-09T12:40:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.863+0000 7fc14b7fe640 1 -- 172.21.15.17:0/3720795926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14403e7e0 con 0x7fc1540b1fc0 2023-08-09T12:40:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.863+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15415fad0 con 0x7fc1540b1fc0 2023-08-09T12:40:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.863+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1540c77e0 con 0x7fc1540b1fc0 2023-08-09T12:40:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.865+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15404e390 con 0x7fc1540b1fc0 2023-08-09T12:40:42.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.866+0000 7fc14b7fe640 1 -- 172.21.15.17:0/3720795926 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc14403e940 con 0x7fc1540b1fc0 2023-08-09T12:40:42.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.866+0000 7fc14b7fe640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc13406a050 0x7fc13406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:42.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.867+0000 7fc14b7fe640 1 -- 172.21.15.17:0/3720795926 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1440ab650 con 0x7fc1540b1fc0 2023-08-09T12:40:42.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.867+0000 7fc1527fc640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc13406a050 0x7fc13406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:42.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.868+0000 7fc1527fc640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc13406a050 0x7fc13406c510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc13c006fd0 tx=0x7fc13c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:42.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:42.871+0000 7fc14b7fe640 1 -- 172.21.15.17:0/3720795926 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc144076cb0 con 0x7fc1540b1fc0 2023-08-09T12:40:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.107+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc1540d26d0 con 0x7fc1540b1fc0 2023-08-09T12:40:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.739+0000 7fc14b7fe640 1 -- 172.21.15.17:0/3720795926 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc144033e80 con 0x7fc1540b1fc0 2023-08-09T12:40:43.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc13406a050 msgr2=0x7fc13406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:43.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc13406a050 0x7fc13406c510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc13c006fd0 tx=0x7fc13c008040 comp rx=0 tx=0).stop 2023-08-09T12:40:43.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1540b1fc0 msgr2=0x7fc15415a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:43.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1540b1fc0 0x7fc15415a630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc144000f80 tx=0x7fc144004a40 comp rx=0 tx=0).stop 2023-08-09T12:40:43.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 shutdown_connections 2023-08-09T12:40:43.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc13406a050 0x7fc13406c510 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:43.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15415cac0 0x7fc1540cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:43.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1540b44b0 0x7fc1540c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:43.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 --2- 172.21.15.17:0/3720795926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1540b1fc0 0x7fc15415a630 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:43.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 >> 172.21.15.17:0/3720795926 conn(0x7fc1540cf4b0 msgr2=0x7fc1540d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:43.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 shutdown_connections 2023-08-09T12:40:43.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.743+0000 7fc153fff640 1 -- 172.21.15.17:0/3720795926 wait complete. 2023-08-09T12:40:43.767 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:40:43.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:40:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.995+0000 7f12f92ec640 1 Processor -- start 2023-08-09T12:40:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.995+0000 7f12f92ec640 1 -- start start 2023-08-09T12:40:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.997+0000 7f12f92ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f40ce9e0 0x7f12f40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.997+0000 7f12f92ec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12f415b160 0x7f12f415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.997+0000 7f12f92ec640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f40cf380 con 0x7f12f4158840 2023-08-09T12:40:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.997+0000 7f12f92ec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f4158c20 con 0x7f12f415b160 2023-08-09T12:40:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.997+0000 7f12f92ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f40b0220 con 0x7f12f40ce9e0 2023-08-09T12:40:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.997+0000 7f12f37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12f415b160 0x7f12f415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.997+0000 7f12f2ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f12f4158840 0x7f12f40af7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54508/0 (socket says 172.21.15.17:54508) 2023-08-09T12:40:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.997+0000 7f12f2ffd640 1 -- 172.21.15.17:0/656851735 learned_addr learned my addr 172.21.15.17:0/656851735 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.998+0000 7f12ebfff640 1 --2- 172.21.15.17:0/656851735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f40ce9e0 0x7f12f40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.998+0000 7f12f37fe640 1 -- 172.21.15.17:0/656851735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f40ce9e0 msgr2=0x7f12f40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.998+0000 7f12f37fe640 1 --2- 172.21.15.17:0/656851735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f40ce9e0 0x7f12f40cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.998+0000 7f12f37fe640 1 -- 172.21.15.17:0/656851735 >> v1:172.21.15.17:6789/0 conn(0x7f12f4158840 legacy=0x7f12f40af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.998+0000 7f12f37fe640 1 -- 172.21.15.17:0/656851735 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f415e7f0 con 0x7f12f415b160 2023-08-09T12:40:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:43.999+0000 7f12f37fe640 1 --2- 172.21.15.17:0/656851735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f415b160 0x7f12f415b5f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009d90 tx=0x7f12ec02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26774e28ab7bfbf6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f27fc640 1 -- 172.21.15.17:0/656851735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec02cc50 con 0x7f12f415b160 2023-08-09T12:40:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f27fc640 1 -- 172.21.15.17:0/656851735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec02cdb0 con 0x7f12f415b160 2023-08-09T12:40:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f27fc640 1 -- 172.21.15.17:0/656851735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec034660 con 0x7f12f415b160 2023-08-09T12:40:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f92ec640 1 -- 172.21.15.17:0/656851735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f415b160 msgr2=0x7f12f415b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f92ec640 1 --2- 172.21.15.17:0/656851735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f415b160 0x7f12f415b5f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009d90 tx=0x7f12ec02bea0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f92ec640 1 -- 172.21.15.17:0/656851735 shutdown_connections 2023-08-09T12:40:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f92ec640 1 --2- 172.21.15.17:0/656851735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f415b160 0x7f12f415b5f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f92ec640 1 --2- 172.21.15.17:0/656851735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f40ce9e0 0x7f12f40cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.000+0000 7f12f92ec640 1 -- 172.21.15.17:0/656851735 >> 172.21.15.17:0/656851735 conn(0x7f12f4069be0 msgr2=0x7f12f4069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.001+0000 7f12f92ec640 1 -- 172.21.15.17:0/656851735 shutdown_connections 2023-08-09T12:40:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.001+0000 7f12f92ec640 1 -- 172.21.15.17:0/656851735 wait complete. 2023-08-09T12:40:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.002+0000 7f12f92ec640 1 Processor -- start 2023-08-09T12:40:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.003+0000 7f12f92ec640 1 -- start start 2023-08-09T12:40:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.003+0000 7f12f92ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f40ce9e0 0x7f12f41ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f92ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f4158840 0x7f12f40aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f92ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f415b160 0x7f12f4151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f92ec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f4156de0 con 0x7f12f40ce9e0 2023-08-09T12:40:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f92ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f41ef470 con 0x7f12f4158840 2023-08-09T12:40:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f92ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f4156760 con 0x7f12f415b160 2023-08-09T12:40:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f40ce9e0 0x7f12f41ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f40ce9e0 0x7f12f41ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51578/0 (socket says 172.21.15.17:51578) 2023-08-09T12:40:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f2ffd640 1 -- 172.21.15.17:0/746961265 learned_addr learned my addr 172.21.15.17:0/746961265 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f2ffd640 1 -- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f415b160 msgr2=0x7f12f4151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f37fe640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f415b160 0x7f12f4151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f2ffd640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f415b160 0x7f12f4151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12ebfff640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f4158840 0x7f12f40aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f2ffd640 1 -- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f4158840 msgr2=0x7f12f40aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f2ffd640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f4158840 0x7f12f40aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.004+0000 7f12f2ffd640 1 -- 172.21.15.17:0/746961265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec009a70 con 0x7f12f40ce9e0 2023-08-09T12:40:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.005+0000 7f12f2ffd640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f40ce9e0 0x7f12f41ef6f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f12e400c4d0 tx=0x7f12e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.005+0000 7f12eb7fe640 1 -- 172.21.15.17:0/746961265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4005ce0 con 0x7f12f40ce9e0 2023-08-09T12:40:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.005+0000 7f12eb7fe640 1 -- 172.21.15.17:0/746961265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e4005e40 con 0x7f12f40ce9e0 2023-08-09T12:40:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.005+0000 7f12eb7fe640 1 -- 172.21.15.17:0/746961265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4007270 con 0x7f12f40ce9e0 2023-08-09T12:40:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.005+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f41ef190 con 0x7f12f40ce9e0 2023-08-09T12:40:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.005+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f40af1e0 con 0x7f12f40ce9e0 2023-08-09T12:40:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.006+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f41565c0 con 0x7f12f40ce9e0 2023-08-09T12:40:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.007+0000 7f12eb7fe640 1 -- 172.21.15.17:0/746961265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f12e40073d0 con 0x7f12f40ce9e0 2023-08-09T12:40:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.008+0000 7f12eb7fe640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12d406a050 0x7f12d406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.008+0000 7f12eb7fe640 1 -- 172.21.15.17:0/746961265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12e4087a10 con 0x7f12f40ce9e0 2023-08-09T12:40:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.009+0000 7f12ebfff640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12d406a050 0x7f12d406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.010+0000 7f12ebfff640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12d406a050 0x7f12d406c510 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12f415ad90 tx=0x7f12dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.013+0000 7f12eb7fe640 1 -- 172.21.15.17:0/746961265 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f12f41565c0 con 0x7f12f40ce9e0 2023-08-09T12:40:44.044 INFO:tasks.ceph.mds.c.smithi017.stderr:2023-08-09T12:40:44.041+0000 7f7730dd0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:40:44.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.248+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f12f40af3d0 con 0x7f12f40ce9e0 2023-08-09T12:40:44.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.751+0000 7f12eb7fe640 1 -- 172.21.15.17:0/746961265 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f12f40af3d0 con 0x7f12f40ce9e0 2023-08-09T12:40:44.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12d406a050 msgr2=0x7f12d406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12d406a050 0x7f12d406c510 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12f415ad90 tx=0x7f12dc008040 comp rx=0 tx=0).stop 2023-08-09T12:40:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f40ce9e0 msgr2=0x7f12f41ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f40ce9e0 0x7f12f41ef6f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f12e400c4d0 tx=0x7f12e400c990 comp rx=0 tx=0).stop 2023-08-09T12:40:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 shutdown_connections 2023-08-09T12:40:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12d406a050 0x7f12d406c510 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f415b160 0x7f12f4151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f4158840 0x7f12f40aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 --2- 172.21.15.17:0/746961265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f40ce9e0 0x7f12f41ef6f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 >> 172.21.15.17:0/746961265 conn(0x7f12f4069be0 msgr2=0x7f12f40b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 shutdown_connections 2023-08-09T12:40:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:44.755+0000 7f12f92ec640 1 -- 172.21.15.17:0/746961265 wait complete. 2023-08-09T12:40:44.782 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:40:44.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:40:45.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.015+0000 7fea1f72f640 1 Processor -- start 2023-08-09T12:40:45.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.015+0000 7fea1f72f640 1 -- start start 2023-08-09T12:40:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.017+0000 7fea1f72f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea180acfc0 0x7fea18167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.017+0000 7fea1f72f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1815df30 con 0x7fea18161280 2023-08-09T12:40:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.017+0000 7fea1f72f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180ca9d0 con 0x7fea18161660 2023-08-09T12:40:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.017+0000 7fea1f72f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1815d430 con 0x7fea180acfc0 2023-08-09T12:40:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.017+0000 7fea1d4cb640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fea18161280 0x7fea180c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54522/0 (socket says 172.21.15.17:54522) 2023-08-09T12:40:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.017+0000 7fea1d4cb640 1 -- 172.21.15.17:0/406870748 learned_addr learned my addr 172.21.15.17:0/406870748 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:45.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.017+0000 7fea1dccc640 1 --2- 172.21.15.17:0/406870748 >> v2:172.21.15.142:3300/0 conn(0x7fea180acfc0 0x7fea18167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.017+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418940193 0 0) 0x7fea1815df30 con 0x7fea18161280 2023-08-09T12:40:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea04003520 con 0x7fea18161280 2023-08-09T12:40:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 803543495 0 0) 0x7fea04003520 con 0x7fea18161280 2023-08-09T12:40:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 >> v2:172.21.15.142:3300/0 conn(0x7fea180acfc0 msgr2=0x7fea18167db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 --2- 172.21.15.17:0/406870748 >> v2:172.21.15.142:3300/0 conn(0x7fea180acfc0 0x7fea18167db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 >> v1:172.21.15.142:6789/0 conn(0x7fea18161660 legacy=0x7fea180ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1815e3c0 con 0x7fea18161280 2023-08-09T12:40:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fea140019f0 con 0x7fea18161280 2023-08-09T12:40:45.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 >> v1:172.21.15.17:6789/0 conn(0x7fea18161280 legacy=0x7fea180c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea04003970 0x7fea04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea040047c0 0x7fea04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea04005180 0x7fea0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0400c0f0 con 0x7fea040047c0 2023-08-09T12:40:45.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0400c260 con 0x7fea04003970 2023-08-09T12:40:45.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0400c420 con 0x7fea04005180 2023-08-09T12:40:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.018+0000 7fea1ccca640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea040047c0 0x7fea04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.019+0000 7fea1d4cb640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea04003970 0x7fea04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.019+0000 7fea1ccca640 1 -- 172.21.15.17:0/406870748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea04005180 msgr2=0x7fea0400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.019+0000 7fea1ccca640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea04005180 0x7fea0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.019+0000 7fea1ccca640 1 -- 172.21.15.17:0/406870748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea04003970 msgr2=0x7fea04003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.019+0000 7fea1ccca640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea04003970 0x7fea04003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.019+0000 7fea1dccc640 1 -- 172.21.15.17:0/406870748 reap_dead start 2023-08-09T12:40:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.019+0000 7fea1ccca640 1 -- 172.21.15.17:0/406870748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04003520 con 0x7fea040047c0 2023-08-09T12:40:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.019+0000 7fea1d4cb640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea04003970 0x7fea04003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:45.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.020+0000 7fea1ccca640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea040047c0 0x7fea04004c40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fea08001770 tx=0x7fea040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c975ed75949d239a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.020+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080052d0 con 0x7fea040047c0 2023-08-09T12:40:45.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.020+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0802e050 con 0x7fea040047c0 2023-08-09T12:40:45.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.020+0000 7fea0ffff640 1 -- 172.21.15.17:0/406870748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08003640 con 0x7fea040047c0 2023-08-09T12:40:45.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.021+0000 7fea1f72f640 1 -- 172.21.15.17:0/406870748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea040047c0 msgr2=0x7fea04004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.021+0000 7fea1f72f640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea040047c0 0x7fea04004c40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fea08001770 tx=0x7fea040057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.021+0000 7fea1f72f640 1 -- 172.21.15.17:0/406870748 shutdown_connections 2023-08-09T12:40:45.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.021+0000 7fea1f72f640 1 --2- 172.21.15.17:0/406870748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea040047c0 0x7fea04004c40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.021+0000 7fea1f72f640 1 -- 172.21.15.17:0/406870748 >> 172.21.15.17:0/406870748 conn(0x7fea180cb1b0 msgr2=0x7fea180cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:45.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.021+0000 7fea1f72f640 1 -- 172.21.15.17:0/406870748 shutdown_connections 2023-08-09T12:40:45.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.021+0000 7fea1f72f640 1 -- 172.21.15.17:0/406870748 wait complete. 2023-08-09T12:40:45.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.023+0000 7fea1f72f640 1 Processor -- start 2023-08-09T12:40:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.023+0000 7fea1f72f640 1 -- start start 2023-08-09T12:40:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1f72f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea040047c0 0x7fea180b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1f72f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180b1d40 0x7fea1814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1f72f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea180af0e0 0x7fea180af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1f72f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180afaa0 con 0x7fea180b1d40 2023-08-09T12:40:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1f72f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180c34f0 con 0x7fea180af0e0 2023-08-09T12:40:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1f72f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180b1640 con 0x7fea040047c0 2023-08-09T12:40:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1ccca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180b1d40 0x7fea1814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1ccca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180b1d40 0x7fea1814ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51608/0 (socket says 172.21.15.17:51608) 2023-08-09T12:40:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.024+0000 7fea1ccca640 1 -- 172.21.15.17:0/264276917 learned_addr learned my addr 172.21.15.17:0/264276917 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:45.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1dccc640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea180af0e0 0x7fea180af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1d4cb640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea040047c0 0x7fea180b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1ccca640 1 -- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea040047c0 msgr2=0x7fea180b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1ccca640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea040047c0 0x7fea180b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1ccca640 1 -- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea180af0e0 msgr2=0x7fea180af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1ccca640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea180af0e0 0x7fea180af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1ccca640 1 -- 172.21.15.17:0/264276917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180c2ea0 con 0x7fea180b1d40 2023-08-09T12:40:45.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1dccc640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea180af0e0 0x7fea180af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:45.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea1ccca640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180b1d40 0x7fea1814ffe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fea08034040 tx=0x7fea08001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.025+0000 7fea0dffb640 1 -- 172.21.15.17:0/264276917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08006ea0 con 0x7fea180b1d40 2023-08-09T12:40:45.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.026+0000 7fea0dffb640 1 -- 172.21.15.17:0/264276917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08007a80 con 0x7fea180b1d40 2023-08-09T12:40:45.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.026+0000 7fea0dffb640 1 -- 172.21.15.17:0/264276917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08007450 con 0x7fea180b1d40 2023-08-09T12:40:45.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.026+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180c3180 con 0x7fea180b1d40 2023-08-09T12:40:45.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.026+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea180b12a0 con 0x7fea180b1d40 2023-08-09T12:40:45.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.027+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea18067a80 con 0x7fea180b1d40 2023-08-09T12:40:45.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.028+0000 7fea0dffb640 1 -- 172.21.15.17:0/264276917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea080075b0 con 0x7fea180b1d40 2023-08-09T12:40:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.029+0000 7fea0dffb640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9fc06a080 0x7fe9fc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.029+0000 7fea0dffb640 1 -- 172.21.15.17:0/264276917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea080aa5d0 con 0x7fea180b1d40 2023-08-09T12:40:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.029+0000 7fea1d4cb640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9fc06a080 0x7fe9fc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.031+0000 7fea1d4cb640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9fc06a080 0x7fe9fc06c540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea14001580 tx=0x7fea14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.033+0000 7fea0dffb640 1 -- 172.21.15.17:0/264276917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fea080796b0 con 0x7fea180b1d40 2023-08-09T12:40:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.264+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea180adc60 con 0x7fea180b1d40 2023-08-09T12:40:45.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.266+0000 7fea0dffb640 1 -- 172.21.15.17:0/264276917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4875 (secure 0 0 0) 0x7fea08079240 con 0x7fea180b1d40 2023-08-09T12:40:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:45.270 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:40:41.199722+0000","modified":"2023-08-09T12:40:44.738017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2993081476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2993081476},{"type":"v1","addr":"172.21.15.17:6835","nonce":2993081476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T12:40:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-08-09T12:40:45.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9fc06a080 msgr2=0x7fe9fc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9fc06a080 0x7fe9fc06c540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea14001580 tx=0x7fea14009040 comp rx=0 tx=0).stop 2023-08-09T12:40:45.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180b1d40 msgr2=0x7fea1814ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180b1d40 0x7fea1814ffe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fea08034040 tx=0x7fea08001170 comp rx=0 tx=0).stop 2023-08-09T12:40:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 shutdown_connections 2023-08-09T12:40:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9fc06a080 0x7fe9fc06c540 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea180af0e0 0x7fea180af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180b1d40 0x7fea1814ffe0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 --2- 172.21.15.17:0/264276917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea040047c0 0x7fea180b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 >> 172.21.15.17:0/264276917 conn(0x7fea180cb1b0 msgr2=0x7fea18070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:45.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 shutdown_connections 2023-08-09T12:40:45.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.269+0000 7fea1f72f640 1 -- 172.21.15.17:0/264276917 wait complete. 2023-08-09T12:40:45.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.507+0000 7fb5af59e640 1 Processor -- start 2023-08-09T12:40:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.507+0000 7fb5af59e640 1 -- start start 2023-08-09T12:40:45.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.508+0000 7fb5af59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5b00b3fe0 0x7fb5b00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.509+0000 7fb5af59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb5b00697c0 0x7fb5b0069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.509+0000 7fb5af59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b006fe10 con 0x7fb5b0159bd0 2023-08-09T12:40:45.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.509+0000 7fb5af59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b00b11a0 con 0x7fb5b00697c0 2023-08-09T12:40:45.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.509+0000 7fb5af59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b006a190 con 0x7fb5b00b3fe0 2023-08-09T12:40:45.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.509+0000 7fb5aed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb5b00697c0 0x7fb5b0069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.509+0000 7fb5ae59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb5b0159bd0 0x7fb5b0070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54538/0 (socket says 172.21.15.17:54538) 2023-08-09T12:40:45.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.509+0000 7fb5ae59c640 1 -- 172.21.15.17:0/3882507836 learned_addr learned my addr 172.21.15.17:0/3882507836 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.509+0000 7fb5a7fff640 1 --2- 172.21.15.17:0/3882507836 >> v2:172.21.15.142:3300/0 conn(0x7fb5b00b3fe0 0x7fb5b00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.510+0000 7fb5aed9d640 1 -- 172.21.15.17:0/3882507836 >> v2:172.21.15.142:3300/0 conn(0x7fb5b00b3fe0 msgr2=0x7fb5b00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.510+0000 7fb5aed9d640 1 --2- 172.21.15.17:0/3882507836 >> v2:172.21.15.142:3300/0 conn(0x7fb5b00b3fe0 0x7fb5b00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.510+0000 7fb5aed9d640 1 -- 172.21.15.17:0/3882507836 >> v1:172.21.15.17:6789/0 conn(0x7fb5b0159bd0 legacy=0x7fb5b0070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.510+0000 7fb5aed9d640 1 -- 172.21.15.17:0/3882507836 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b0159fb0 con 0x7fb5b00697c0 2023-08-09T12:40:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.510+0000 7fb5a7fff640 1 --2- 172.21.15.17:0/3882507836 >> v2:172.21.15.142:3300/0 conn(0x7fb5b00b3fe0 0x7fb5b00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.510+0000 7fb5add9b640 1 -- 172.21.15.17:0/3882507836 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416490225 0 0) 0x7fb5b006fe10 con 0x7fb5b0159bd0 2023-08-09T12:40:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.511+0000 7fb5aed9d640 1 --2- 172.21.15.17:0/3882507836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b00697c0 0x7fb5b0069c50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb5b006ce40 tx=0x7fb5a802be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c9bdf2d6880a5e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.511+0000 7fb5add9b640 1 -- 172.21.15.17:0/3882507836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a802cbe0 con 0x7fb5b00697c0 2023-08-09T12:40:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.511+0000 7fb5add9b640 1 -- 172.21.15.17:0/3882507836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a802cd40 con 0x7fb5b00697c0 2023-08-09T12:40:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.511+0000 7fb5add9b640 1 -- 172.21.15.17:0/3882507836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8034660 con 0x7fb5b00697c0 2023-08-09T12:40:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.512+0000 7fb5af59e640 1 -- 172.21.15.17:0/3882507836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b00697c0 msgr2=0x7fb5b0069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.512+0000 7fb5af59e640 1 --2- 172.21.15.17:0/3882507836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b00697c0 0x7fb5b0069c50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb5b006ce40 tx=0x7fb5a802be30 comp rx=0 tx=0).stop 2023-08-09T12:40:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.512+0000 7fb5af59e640 1 -- 172.21.15.17:0/3882507836 shutdown_connections 2023-08-09T12:40:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.512+0000 7fb5af59e640 1 --2- 172.21.15.17:0/3882507836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b00697c0 0x7fb5b0069c50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.512+0000 7fb5af59e640 1 --2- 172.21.15.17:0/3882507836 >> v2:172.21.15.142:3300/0 conn(0x7fb5b00b3fe0 0x7fb5b00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.512+0000 7fb5af59e640 1 -- 172.21.15.17:0/3882507836 >> 172.21.15.17:0/3882507836 conn(0x7fb5b00b1d50 msgr2=0x7fb5b006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:45.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.512+0000 7fb5af59e640 1 -- 172.21.15.17:0/3882507836 shutdown_connections 2023-08-09T12:40:45.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.512+0000 7fb5af59e640 1 -- 172.21.15.17:0/3882507836 wait complete. 2023-08-09T12:40:45.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.514+0000 7fb5af59e640 1 Processor -- start 2023-08-09T12:40:45.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.514+0000 7fb5af59e640 1 -- start start 2023-08-09T12:40:45.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5af59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5b00697c0 0x7fb5b0156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5af59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5b00b3fe0 0x7fb5b00c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5af59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b0159bd0 0x7fb5b00cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5af59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c73c0 con 0x7fb5b0159bd0 2023-08-09T12:40:45.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5af59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c76a0 con 0x7fb5b00b3fe0 2023-08-09T12:40:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5af59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c7980 con 0x7fb5b00697c0 2023-08-09T12:40:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5aed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b0159bd0 0x7fb5b00cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5aed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b0159bd0 0x7fb5b00cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51630/0 (socket says 172.21.15.17:51630) 2023-08-09T12:40:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5aed9d640 1 -- 172.21.15.17:0/2268352558 learned_addr learned my addr 172.21.15.17:0/2268352558 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5ae59c640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5b00697c0 0x7fb5b0156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.515+0000 7fb5a7fff640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5b00b3fe0 0x7fb5b00c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5aed9d640 1 -- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5b00697c0 msgr2=0x7fb5b0156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5aed9d640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5b00697c0 0x7fb5b0156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5aed9d640 1 -- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5b00b3fe0 msgr2=0x7fb5b00c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5aed9d640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5b00b3fe0 0x7fb5b00c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5aed9d640 1 -- 172.21.15.17:0/2268352558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8009a70 con 0x7fb5b0159bd0 2023-08-09T12:40:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5a7fff640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5b00b3fe0 0x7fb5b00c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5aed9d640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b0159bd0 0x7fb5b00cb170 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb5a802c440 tx=0x7fb5a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5a6ffd640 1 -- 172.21.15.17:0/2268352558 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a803e610 con 0x7fb5b0159bd0 2023-08-09T12:40:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5a6ffd640 1 -- 172.21.15.17:0/2268352558 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a803e770 con 0x7fb5b0159bd0 2023-08-09T12:40:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5a6ffd640 1 -- 172.21.15.17:0/2268352558 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a803eb20 con 0x7fb5b0159bd0 2023-08-09T12:40:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b00c7c60 con 0x7fb5b0159bd0 2023-08-09T12:40:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.516+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b0157150 con 0x7fb5b0159bd0 2023-08-09T12:40:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.517+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b00c8180 con 0x7fb5b0159bd0 2023-08-09T12:40:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.518+0000 7fb5a6ffd640 1 -- 172.21.15.17:0/2268352558 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb5a803b050 con 0x7fb5b0159bd0 2023-08-09T12:40:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.519+0000 7fb5a6ffd640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb59406a050 0x7fb59406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.519+0000 7fb5a6ffd640 1 -- 172.21.15.17:0/2268352558 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5a80aabd0 con 0x7fb5b0159bd0 2023-08-09T12:40:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.520+0000 7fb5ae59c640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb59406a050 0x7fb59406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.521+0000 7fb5ae59c640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb59406a050 0x7fb59406c510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0000f60 tx=0x7fb5a0007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.523+0000 7fb5a6ffd640 1 -- 172.21.15.17:0/2268352558 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb5b00c8180 con 0x7fb5b0159bd0 2023-08-09T12:40:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.718+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5b0159fb0 con 0x7fb5b0159bd0 2023-08-09T12:40:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.721+0000 7fb5a6ffd640 1 -- 172.21.15.17:0/2268352558 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fb5b0159fb0 con 0x7fb5b0159bd0 2023-08-09T12:40:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:45.725 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":37,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:42.695447+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb59406a050 msgr2=0x7fb59406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb59406a050 0x7fb59406c510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0000f60 tx=0x7fb5a0007c00 comp rx=0 tx=0).stop 2023-08-09T12:40:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b0159bd0 msgr2=0x7fb5b00cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b0159bd0 0x7fb5b00cb170 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb5a802c440 tx=0x7fb5a8004a40 comp rx=0 tx=0).stop 2023-08-09T12:40:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 shutdown_connections 2023-08-09T12:40:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb59406a050 0x7fb59406c510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b0159bd0 0x7fb5b00cb170 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5b00b3fe0 0x7fb5b00c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 --2- 172.21.15.17:0/2268352558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5b00697c0 0x7fb5b0156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 >> 172.21.15.17:0/2268352558 conn(0x7fb5b00b1d50 msgr2=0x7fb5b0158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 shutdown_connections 2023-08-09T12:40:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.724+0000 7fb5af59e640 1 -- 172.21.15.17:0/2268352558 wait complete. 2023-08-09T12:40:45.747 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:40:45.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:40:45.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.964+0000 7fab8dd24640 1 Processor -- start 2023-08-09T12:40:45.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.964+0000 7fab8dd24640 1 -- start start 2023-08-09T12:40:45.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.965+0000 7fab8dd24640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 0x7fab88070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.965+0000 7fab8dd24640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab880b0b10 0x7fab8815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab8dd24640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab880715c0 con 0x7fab8815bce0 2023-08-09T12:40:45.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab8dd24640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab880718a0 con 0x7fab880b0b10 2023-08-09T12:40:45.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab8dd24640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab88071b80 con 0x7fab881587e0 2023-08-09T12:40:45.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab87fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab880b0b10 0x7fab8815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab87fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab880b0b10 0x7fab8815b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51636/0 (socket says 172.21.15.17:51636) 2023-08-09T12:40:45.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab87fff640 1 -- 172.21.15.17:0/1676232368 learned_addr learned my addr 172.21.15.17:0/1676232368 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:45.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab87fff640 1 -- 172.21.15.17:0/1676232368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 msgr2=0x7fab88070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:45.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab87fff640 1 --2- 172.21.15.17:0/1676232368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 0x7fab88070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab87fff640 1 -- 172.21.15.17:0/1676232368 >> v1:172.21.15.17:6789/0 conn(0x7fab8815bce0 legacy=0x7fab880cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.966+0000 7fab87fff640 1 -- 172.21.15.17:0/1676232368 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8815b280 con 0x7fab880b0b10 2023-08-09T12:40:45.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.968+0000 7fab87fff640 1 --2- 172.21.15.17:0/1676232368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab8815b7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc706d88a0b2007 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.968+0000 7fab877fe640 1 -- 172.21.15.17:0/1676232368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74030840 con 0x7fab880b0b10 2023-08-09T12:40:45.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.968+0000 7fab877fe640 1 -- 172.21.15.17:0/1676232368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab740309a0 con 0x7fab880b0b10 2023-08-09T12:40:45.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.968+0000 7fab877fe640 1 -- 172.21.15.17:0/1676232368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74030d30 con 0x7fab880b0b10 2023-08-09T12:40:45.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.968+0000 7fab8dd24640 1 -- 172.21.15.17:0/1676232368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 msgr2=0x7fab8815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.968+0000 7fab8dd24640 1 --2- 172.21.15.17:0/1676232368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab8815b7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7402b980 comp rx=0 tx=0).stop 2023-08-09T12:40:45.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.969+0000 7fab8dd24640 1 -- 172.21.15.17:0/1676232368 shutdown_connections 2023-08-09T12:40:45.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.969+0000 7fab8dd24640 1 --2- 172.21.15.17:0/1676232368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab8815b7a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.969+0000 7fab8dd24640 1 --2- 172.21.15.17:0/1676232368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 0x7fab88070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.969+0000 7fab8dd24640 1 -- 172.21.15.17:0/1676232368 >> 172.21.15.17:0/1676232368 conn(0x7fab880b1d50 msgr2=0x7fab8806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:45.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.969+0000 7fab8dd24640 1 -- 172.21.15.17:0/1676232368 shutdown_connections 2023-08-09T12:40:45.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.969+0000 7fab8dd24640 1 -- 172.21.15.17:0/1676232368 wait complete. 2023-08-09T12:40:45.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.970+0000 7fab8dd24640 1 Processor -- start 2023-08-09T12:40:45.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.970+0000 7fab8dd24640 1 -- start start 2023-08-09T12:40:45.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.971+0000 7fab8dd24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab880c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.971+0000 7fab8dd24640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 0x7fab880c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.971+0000 7fab8dd24640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab880c57c0 0x7fab880c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.971+0000 7fab8dd24640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab880c61b0 con 0x7fab880b0b10 2023-08-09T12:40:45.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.971+0000 7fab8dd24640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab881f1490 con 0x7fab880c57c0 2023-08-09T12:40:45.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.971+0000 7fab8dd24640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab880c2630 con 0x7fab881587e0 2023-08-09T12:40:45.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8cd22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab880c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8cd22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab880c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51642/0 (socket says 172.21.15.17:51642) 2023-08-09T12:40:45.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8cd22640 1 -- 172.21.15.17:0/4118678208 learned_addr learned my addr 172.21.15.17:0/4118678208 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:45.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab87fff640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 0x7fab880c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8cd22640 1 -- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 msgr2=0x7fab880c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8cd22640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 0x7fab880c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8cd22640 1 -- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab880c57c0 msgr2=0x7fab880c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:45.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8d523640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab880c57c0 0x7fab880c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8cd22640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab880c57c0 0x7fab880c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.972+0000 7fab8cd22640 1 -- 172.21.15.17:0/4118678208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740094d0 con 0x7fab880b0b10 2023-08-09T12:40:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.973+0000 7fab8cd22640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab880c6ef0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00b4a0 tx=0x7fab7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.973+0000 7fab857fa640 1 -- 172.21.15.17:0/4118678208 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c010610 con 0x7fab880b0b10 2023-08-09T12:40:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.973+0000 7fab857fa640 1 -- 172.21.15.17:0/4118678208 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c010770 con 0x7fab880b0b10 2023-08-09T12:40:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.973+0000 7fab857fa640 1 -- 172.21.15.17:0/4118678208 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c010b20 con 0x7fab880b0b10 2023-08-09T12:40:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.973+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab880c42c0 con 0x7fab880b0b10 2023-08-09T12:40:45.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.973+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab880c63a0 con 0x7fab880b0b10 2023-08-09T12:40:45.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.974+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab880b07b0 con 0x7fab880b0b10 2023-08-09T12:40:45.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.975+0000 7fab857fa640 1 -- 172.21.15.17:0/4118678208 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab7c010c80 con 0x7fab880b0b10 2023-08-09T12:40:45.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.976+0000 7fab857fa640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab6c06a050 0x7fab6c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:45.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.976+0000 7fab857fa640 1 -- 172.21.15.17:0/4118678208 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab7c088280 con 0x7fab880b0b10 2023-08-09T12:40:45.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.977+0000 7fab87fff640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab6c06a050 0x7fab6c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:45.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.978+0000 7fab87fff640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab6c06a050 0x7fab6c06c510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fab74036000 tx=0x7fab7403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:45.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:45.981+0000 7fab857fa640 1 -- 172.21.15.17:0/4118678208 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fab7c0538d0 con 0x7fab880b0b10 2023-08-09T12:40:46.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.168+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab8815af70 con 0x7fab6c06a050 2023-08-09T12:40:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.198+0000 7fab857fa640 1 -- 172.21.15.17:0/4118678208 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301814 (secure 0 0 0) 0x7fab74030c10 con 0x7fab6c06a050 2023-08-09T12:40:46.203 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:40:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab6c06a050 msgr2=0x7fab6c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab6c06a050 0x7fab6c06c510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fab74036000 tx=0x7fab7403b040 comp rx=0 tx=0).stop 2023-08-09T12:40:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 msgr2=0x7fab880c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab880c6ef0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00b4a0 tx=0x7fab7c00b960 comp rx=0 tx=0).stop 2023-08-09T12:40:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 shutdown_connections 2023-08-09T12:40:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab6c06a050 0x7fab6c06c510 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab880c57c0 0x7fab880c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab881587e0 0x7fab880c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 --2- 172.21.15.17:0/4118678208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab880b0b10 0x7fab880c6ef0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 >> 172.21.15.17:0/4118678208 conn(0x7fab880b1d50 msgr2=0x7fab8806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 shutdown_connections 2023-08-09T12:40:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.205+0000 7fab8dd24640 1 -- 172.21.15.17:0/4118678208 wait complete. 2023-08-09T12:40:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-08-09T12:40:44.663146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2407,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560092,"statfs":{"total":1600000000,"available":1597534560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.983683"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.711202+0000","last_change":"2023-08-09T12:40:41.711077+0000","last_active":"2023-08-09T12:40:41.711202+0000","last_peered":"2023-08-09T12:40:41.711202+0000","last_clean":"2023-08-09T12:40:41.711202+0000","last_became_active":"2023-08-09T12:40:41.710825+0000","last_became_peered":"2023-08-09T12:40:41.710825+0000","last_unstale":"2023-08-09T12:40:41.711202+0000","last_undegraded":"2023-08-09T12:40:41.711202+0000","last_fullsized":"2023-08-09T12:40:41.711202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:25.809689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.709698+0000","last_change":"2023-08-09T12:40:41.709234+0000","last_active":"2023-08-09T12:40:41.709698+0000","last_peered":"2023-08-09T12:40:41.709698+0000","last_clean":"2023-08-09T12:40:41.709698+0000","last_became_active":"2023-08-09T12:40:41.708960+0000","last_became_peered":"2023-08-09T12:40:41.708960+0000","last_unstale":"2023-08-09T12:40:41.709698+0000","last_undegraded":"2023-08-09T12:40:41.709698+0000","last_fullsized":"2023-08-09T12:40:41.709698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:49:09.673721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.705790+0000","last_change":"2023-08-09T12:40:40.705790+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.705790+0000","last_undegraded":"2023-08-09T12:40:40.705790+0000","last_fullsized":"2023-08-09T12:40:40.705790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720284+0000","last_change":"2023-08-09T12:40:41.720168+0000","last_active":"2023-08-09T12:40:41.720284+0000","last_peered":"2023-08-09T12:40:41.720284+0000","last_clean":"2023-08-09T12:40:41.720284+0000","last_became_active":"2023-08-09T12:40:41.719705+0000","last_became_peered":"2023-08-09T12:40:41.719705+0000","last_unstale":"2023-08-09T12:40:41.720284+0000","last_undegraded":"2023-08-09T12:40:41.720284+0000","last_fullsized":"2023-08-09T12:40:41.720284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:29:42.416907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720252+0000","last_change":"2023-08-09T12:40:41.719746+0000","last_active":"2023-08-09T12:40:41.720252+0000","last_peered":"2023-08-09T12:40:41.720252+0000","last_clean":"2023-08-09T12:40:41.720252+0000","last_became_active":"2023-08-09T12:40:41.719490+0000","last_became_peered":"2023-08-09T12:40:41.719490+0000","last_unstale":"2023-08-09T12:40:41.720252+0000","last_undegraded":"2023-08-09T12:40:41.720252+0000","last_fullsized":"2023-08-09T12:40:41.720252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:36:48.840416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.713747+0000","last_change":"2023-08-09T12:40:40.713747+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.713747+0000","last_undegraded":"2023-08-09T12:40:40.713747+0000","last_fullsized":"2023-08-09T12:40:40.713747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728638+0000","last_change":"2023-08-09T12:40:41.727839+0000","last_active":"2023-08-09T12:40:41.728638+0000","last_peered":"2023-08-09T12:40:41.728638+0000","last_clean":"2023-08-09T12:40:41.728638+0000","last_became_active":"2023-08-09T12:40:41.727329+0000","last_became_peered":"2023-08-09T12:40:41.727329+0000","last_unstale":"2023-08-09T12:40:41.728638+0000","last_undegraded":"2023-08-09T12:40:41.728638+0000","last_fullsized":"2023-08-09T12:40:41.728638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:30.315499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726153+0000","last_change":"2023-08-09T12:40:41.722544+0000","last_active":"2023-08-09T12:40:41.726153+0000","last_peered":"2023-08-09T12:40:41.726153+0000","last_clean":"2023-08-09T12:40:41.726153+0000","last_became_active":"2023-08-09T12:40:41.721943+0000","last_became_peered":"2023-08-09T12:40:41.721943+0000","last_unstale":"2023-08-09T12:40:41.726153+0000","last_undegraded":"2023-08-09T12:40:41.726153+0000","last_fullsized":"2023-08-09T12:40:41.726153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:26.381844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.706334+0000","last_change":"2023-08-09T12:40:40.706334+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.706334+0000","last_undegraded":"2023-08-09T12:40:40.706334+0000","last_fullsized":"2023-08-09T12:40:40.706334+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723601+0000","last_change":"2023-08-09T12:40:41.723477+0000","last_active":"2023-08-09T12:40:41.723601+0000","last_peered":"2023-08-09T12:40:41.723601+0000","last_clean":"2023-08-09T12:40:41.723601+0000","last_became_active":"2023-08-09T12:40:41.723241+0000","last_became_peered":"2023-08-09T12:40:41.723241+0000","last_unstale":"2023-08-09T12:40:41.723601+0000","last_undegraded":"2023-08-09T12:40:41.723601+0000","last_fullsized":"2023-08-09T12:40:41.723601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:45:11.303794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732734+0000","last_change":"2023-08-09T12:40:41.732618+0000","last_active":"2023-08-09T12:40:41.732734+0000","last_peered":"2023-08-09T12:40:41.732734+0000","last_clean":"2023-08-09T12:40:41.732734+0000","last_became_active":"2023-08-09T12:40:41.732337+0000","last_became_peered":"2023-08-09T12:40:41.732337+0000","last_unstale":"2023-08-09T12:40:41.732734+0000","last_undegraded":"2023-08-09T12:40:41.732734+0000","last_fullsized":"2023-08-09T12:40:41.732734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:52:37.289595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.704231+0000","last_change":"2023-08-09T12:40:40.704231+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.704231+0000","last_undegraded":"2023-08-09T12:40:40.704231+0000","last_fullsized":"2023-08-09T12:40:40.704231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.731036+0000","last_change":"2023-08-09T12:40:41.730905+0000","last_active":"2023-08-09T12:40:41.731036+0000","last_peered":"2023-08-09T12:40:41.731036+0000","last_clean":"2023-08-09T12:40:41.731036+0000","last_became_active":"2023-08-09T12:40:41.730596+0000","last_became_peered":"2023-08-09T12:40:41.730596+0000","last_unstale":"2023-08-09T12:40:41.731036+0000","last_undegraded":"2023-08-09T12:40:41.731036+0000","last_fullsized":"2023-08-09T12:40:41.731036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:14.006945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726922+0000","last_change":"2023-08-09T12:40:41.726444+0000","last_active":"2023-08-09T12:40:41.726922+0000","last_peered":"2023-08-09T12:40:41.726922+0000","last_clean":"2023-08-09T12:40:41.726922+0000","last_became_active":"2023-08-09T12:40:41.725861+0000","last_became_peered":"2023-08-09T12:40:41.725861+0000","last_unstale":"2023-08-09T12:40:41.726922+0000","last_undegraded":"2023-08-09T12:40:41.726922+0000","last_fullsized":"2023-08-09T12:40:41.726922+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:12:48.064744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723553+0000","last_change":"2023-08-09T12:40:41.722094+0000","last_active":"2023-08-09T12:40:41.723553+0000","last_peered":"2023-08-09T12:40:41.723553+0000","last_clean":"2023-08-09T12:40:41.723553+0000","last_became_active":"2023-08-09T12:40:41.721838+0000","last_became_peered":"2023-08-09T12:40:41.721838+0000","last_unstale":"2023-08-09T12:40:41.723553+0000","last_undegraded":"2023-08-09T12:40:41.723553+0000","last_fullsized":"2023-08-09T12:40:41.723553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:57:00.255590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.735046+0000","last_change":"2023-08-09T12:40:41.734962+0000","last_active":"2023-08-09T12:40:41.735046+0000","last_peered":"2023-08-09T12:40:41.735046+0000","last_clean":"2023-08-09T12:40:41.735046+0000","last_became_active":"2023-08-09T12:40:41.734344+0000","last_became_peered":"2023-08-09T12:40:41.734344+0000","last_unstale":"2023-08-09T12:40:41.735046+0000","last_undegraded":"2023-08-09T12:40:41.735046+0000","last_fullsized":"2023-08-09T12:40:41.735046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:29:07.695784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723373+0000","last_change":"2023-08-09T12:40:41.722620+0000","last_active":"2023-08-09T12:40:41.723373+0000","last_peered":"2023-08-09T12:40:41.723373+0000","last_clean":"2023-08-09T12:40:41.723373+0000","last_became_active":"2023-08-09T12:40:41.722230+0000","last_became_peered":"2023-08-09T12:40:41.722230+0000","last_unstale":"2023-08-09T12:40:41.723373+0000","last_undegraded":"2023-08-09T12:40:41.723373+0000","last_fullsized":"2023-08-09T12:40:41.723373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:18.029300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728546+0000","last_change":"2023-08-09T12:40:41.723380+0000","last_active":"2023-08-09T12:40:41.728546+0000","last_peered":"2023-08-09T12:40:41.728546+0000","last_clean":"2023-08-09T12:40:41.728546+0000","last_became_active":"2023-08-09T12:40:41.723070+0000","last_became_peered":"2023-08-09T12:40:41.723070+0000","last_unstale":"2023-08-09T12:40:41.728546+0000","last_undegraded":"2023-08-09T12:40:41.728546+0000","last_fullsized":"2023-08-09T12:40:41.728546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:10.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728099+0000","last_change":"2023-08-09T12:40:41.727989+0000","last_active":"2023-08-09T12:40:41.728099+0000","last_peered":"2023-08-09T12:40:41.728099+0000","last_clean":"2023-08-09T12:40:41.728099+0000","last_became_active":"2023-08-09T12:40:41.727616+0000","last_became_peered":"2023-08-09T12:40:41.727616+0000","last_unstale":"2023-08-09T12:40:41.728099+0000","last_undegraded":"2023-08-09T12:40:41.728099+0000","last_fullsized":"2023-08-09T12:40:41.728099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:29:24.489108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.722725+0000","last_change":"2023-08-09T12:40:41.722621+0000","last_active":"2023-08-09T12:40:41.722725+0000","last_peered":"2023-08-09T12:40:41.722725+0000","last_clean":"2023-08-09T12:40:41.722725+0000","last_became_active":"2023-08-09T12:40:41.722393+0000","last_became_peered":"2023-08-09T12:40:41.722393+0000","last_unstale":"2023-08-09T12:40:41.722725+0000","last_undegraded":"2023-08-09T12:40:41.722725+0000","last_fullsized":"2023-08-09T12:40:41.722725+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:15:39.945454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728653+0000","last_change":"2023-08-09T12:40:41.728296+0000","last_active":"2023-08-09T12:40:41.728653+0000","last_peered":"2023-08-09T12:40:41.728653+0000","last_clean":"2023-08-09T12:40:41.728653+0000","last_became_active":"2023-08-09T12:40:41.727711+0000","last_became_peered":"2023-08-09T12:40:41.727711+0000","last_unstale":"2023-08-09T12:40:41.728653+0000","last_undegraded":"2023-08-09T12:40:41.728653+0000","last_fullsized":"2023-08-09T12:40:41.728653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:37:19.646777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.722724+0000","last_change":"2023-08-09T12:40:41.722620+0000","last_active":"2023-08-09T12:40:41.722724+0000","last_peered":"2023-08-09T12:40:41.722724+0000","last_clean":"2023-08-09T12:40:41.722724+0000","last_became_active":"2023-08-09T12:40:41.721627+0000","last_became_peered":"2023-08-09T12:40:41.721627+0000","last_unstale":"2023-08-09T12:40:41.722724+0000","last_undegraded":"2023-08-09T12:40:41.722724+0000","last_fullsized":"2023-08-09T12:40:41.722724+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:14:15.176206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723109+0000","last_change":"2023-08-09T12:40:41.722326+0000","last_active":"2023-08-09T12:40:41.723109+0000","last_peered":"2023-08-09T12:40:41.723109+0000","last_clean":"2023-08-09T12:40:41.723109+0000","last_became_active":"2023-08-09T12:40:41.719498+0000","last_became_peered":"2023-08-09T12:40:41.719498+0000","last_unstale":"2023-08-09T12:40:41.723109+0000","last_undegraded":"2023-08-09T12:40:41.723109+0000","last_fullsized":"2023-08-09T12:40:41.723109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:39:51.958086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723250+0000","last_change":"2023-08-09T12:40:41.723140+0000","last_active":"2023-08-09T12:40:41.723250+0000","last_peered":"2023-08-09T12:40:41.723250+0000","last_clean":"2023-08-09T12:40:41.723250+0000","last_became_active":"2023-08-09T12:40:41.722780+0000","last_became_peered":"2023-08-09T12:40:41.722780+0000","last_unstale":"2023-08-09T12:40:41.723250+0000","last_undegraded":"2023-08-09T12:40:41.723250+0000","last_fullsized":"2023-08-09T12:40:41.723250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:17:24.829466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716259+0000","last_change":"2023-08-09T12:40:41.716167+0000","last_active":"2023-08-09T12:40:41.716259+0000","last_peered":"2023-08-09T12:40:41.716259+0000","last_clean":"2023-08-09T12:40:41.716259+0000","last_became_active":"2023-08-09T12:40:41.715540+0000","last_became_peered":"2023-08-09T12:40:41.715540+0000","last_unstale":"2023-08-09T12:40:41.716259+0000","last_undegraded":"2023-08-09T12:40:41.716259+0000","last_fullsized":"2023-08-09T12:40:41.716259+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:09:49.855456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.713279+0000","last_change":"2023-08-09T12:40:40.713279+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.713279+0000","last_undegraded":"2023-08-09T12:40:40.713279+0000","last_fullsized":"2023-08-09T12:40:40.713279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.721483+0000","last_change":"2023-08-09T12:40:41.721378+0000","last_active":"2023-08-09T12:40:41.721483+0000","last_peered":"2023-08-09T12:40:41.721483+0000","last_clean":"2023-08-09T12:40:41.721483+0000","last_became_active":"2023-08-09T12:40:41.721064+0000","last_became_peered":"2023-08-09T12:40:41.721064+0000","last_unstale":"2023-08-09T12:40:41.721483+0000","last_undegraded":"2023-08-09T12:40:41.721483+0000","last_fullsized":"2023-08-09T12:40:41.721483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:40:11.371677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.722192+0000","last_change":"2023-08-09T12:40:41.720731+0000","last_active":"2023-08-09T12:40:41.722192+0000","last_peered":"2023-08-09T12:40:41.722192+0000","last_clean":"2023-08-09T12:40:41.722192+0000","last_became_active":"2023-08-09T12:40:41.720283+0000","last_became_peered":"2023-08-09T12:40:41.720283+0000","last_unstale":"2023-08-09T12:40:41.722192+0000","last_undegraded":"2023-08-09T12:40:41.722192+0000","last_fullsized":"2023-08-09T12:40:41.722192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:42.760968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.729760+0000","last_change":"2023-08-09T12:40:41.729685+0000","last_active":"2023-08-09T12:40:41.729760+0000","last_peered":"2023-08-09T12:40:41.729760+0000","last_clean":"2023-08-09T12:40:41.729760+0000","last_became_active":"2023-08-09T12:40:41.729453+0000","last_became_peered":"2023-08-09T12:40:41.729453+0000","last_unstale":"2023-08-09T12:40:41.729760+0000","last_undegraded":"2023-08-09T12:40:41.729760+0000","last_fullsized":"2023-08-09T12:40:41.729760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:57.421107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716241+0000","last_change":"2023-08-09T12:40:41.715872+0000","last_active":"2023-08-09T12:40:41.716241+0000","last_peered":"2023-08-09T12:40:41.716241+0000","last_clean":"2023-08-09T12:40:41.716241+0000","last_became_active":"2023-08-09T12:40:41.714991+0000","last_became_peered":"2023-08-09T12:40:41.714991+0000","last_unstale":"2023-08-09T12:40:41.716241+0000","last_undegraded":"2023-08-09T12:40:41.716241+0000","last_fullsized":"2023-08-09T12:40:41.716241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:04.836591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732031+0000","last_change":"2023-08-09T12:40:41.728131+0000","last_active":"2023-08-09T12:40:41.732031+0000","last_peered":"2023-08-09T12:40:41.732031+0000","last_clean":"2023-08-09T12:40:41.732031+0000","last_became_active":"2023-08-09T12:40:41.718552+0000","last_became_peered":"2023-08-09T12:40:41.718552+0000","last_unstale":"2023-08-09T12:40:41.732031+0000","last_undegraded":"2023-08-09T12:40:41.732031+0000","last_fullsized":"2023-08-09T12:40:41.732031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:01.603786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.709486+0000","last_change":"2023-08-09T12:40:40.709486+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.709486+0000","last_undegraded":"2023-08-09T12:40:40.709486+0000","last_fullsized":"2023-08-09T12:40:40.709486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.734812+0000","last_change":"2023-08-09T12:40:41.734725+0000","last_active":"2023-08-09T12:40:41.734812+0000","last_peered":"2023-08-09T12:40:41.734812+0000","last_clean":"2023-08-09T12:40:41.734812+0000","last_became_active":"2023-08-09T12:40:41.733962+0000","last_became_peered":"2023-08-09T12:40:41.733962+0000","last_unstale":"2023-08-09T12:40:41.734812+0000","last_undegraded":"2023-08-09T12:40:41.734812+0000","last_fullsized":"2023-08-09T12:40:41.734812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:23:47.307786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.738782+0000","last_change":"2023-08-09T12:40:40.715354+0000","last_active":"2023-08-09T12:40:41.738782+0000","last_peered":"2023-08-09T12:40:41.738782+0000","last_clean":"2023-08-09T12:40:41.738782+0000","last_became_active":"2023-08-09T12:40:40.715093+0000","last_became_peered":"2023-08-09T12:40:40.715093+0000","last_unstale":"2023-08-09T12:40:41.738782+0000","last_undegraded":"2023-08-09T12:40:41.738782+0000","last_fullsized":"2023-08-09T12:40:41.738782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:58:39.091519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.711017+0000","last_change":"2023-08-09T12:40:40.711017+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.711017+0000","last_undegraded":"2023-08-09T12:40:40.711017+0000","last_fullsized":"2023-08-09T12:40:40.711017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.716984+0000","last_change":"2023-08-09T12:40:40.716868+0000","last_active":"2023-08-09T12:40:40.716984+0000","last_peered":"2023-08-09T12:40:40.716984+0000","last_clean":"2023-08-09T12:40:40.716984+0000","last_became_active":"2023-08-09T12:40:40.716502+0000","last_became_peered":"2023-08-09T12:40:40.716502+0000","last_unstale":"2023-08-09T12:40:40.716984+0000","last_undegraded":"2023-08-09T12:40:40.716984+0000","last_fullsized":"2023-08-09T12:40:40.716984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:24.155747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726895+0000","last_change":"2023-08-09T12:40:41.726211+0000","last_active":"2023-08-09T12:40:41.726895+0000","last_peered":"2023-08-09T12:40:41.726895+0000","last_clean":"2023-08-09T12:40:41.726895+0000","last_became_active":"2023-08-09T12:40:41.725443+0000","last_became_peered":"2023-08-09T12:40:41.725443+0000","last_unstale":"2023-08-09T12:40:41.726895+0000","last_undegraded":"2023-08-09T12:40:41.726895+0000","last_fullsized":"2023-08-09T12:40:41.726895+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:39:51.958086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.721644+0000","last_change":"2023-08-09T12:40:40.721545+0000","last_active":"2023-08-09T12:40:40.721644+0000","last_peered":"2023-08-09T12:40:40.721644+0000","last_clean":"2023-08-09T12:40:40.721644+0000","last_became_active":"2023-08-09T12:40:40.720757+0000","last_became_peered":"2023-08-09T12:40:40.720757+0000","last_unstale":"2023-08-09T12:40:40.721644+0000","last_undegraded":"2023-08-09T12:40:40.721644+0000","last_fullsized":"2023-08-09T12:40:40.721644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:43:41.281151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726207+0000","last_change":"2023-08-09T12:40:41.725847+0000","last_active":"2023-08-09T12:40:41.726207+0000","last_peered":"2023-08-09T12:40:41.726207+0000","last_clean":"2023-08-09T12:40:41.726207+0000","last_became_active":"2023-08-09T12:40:41.725396+0000","last_became_peered":"2023-08-09T12:40:41.725396+0000","last_unstale":"2023-08-09T12:40:41.726207+0000","last_undegraded":"2023-08-09T12:40:41.726207+0000","last_fullsized":"2023-08-09T12:40:41.726207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:54.518860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.731174+0000","last_change":"2023-08-09T12:40:40.713746+0000","last_active":"2023-08-09T12:40:41.731174+0000","last_peered":"2023-08-09T12:40:41.731174+0000","last_clean":"2023-08-09T12:40:41.731174+0000","last_became_active":"2023-08-09T12:40:40.713425+0000","last_became_peered":"2023-08-09T12:40:40.713425+0000","last_unstale":"2023-08-09T12:40:41.731174+0000","last_undegraded":"2023-08-09T12:40:41.731174+0000","last_fullsized":"2023-08-09T12:40:41.731174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:06.823137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.705399+0000","last_change":"2023-08-09T12:40:40.705399+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.705399+0000","last_undegraded":"2023-08-09T12:40:40.705399+0000","last_fullsized":"2023-08-09T12:40:40.705399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730718+0000","last_change":"2023-08-09T12:40:40.723569+0000","last_active":"2023-08-09T12:40:41.730718+0000","last_peered":"2023-08-09T12:40:41.730718+0000","last_clean":"2023-08-09T12:40:41.730718+0000","last_became_active":"2023-08-09T12:40:40.722501+0000","last_became_peered":"2023-08-09T12:40:40.722501+0000","last_unstale":"2023-08-09T12:40:41.730718+0000","last_undegraded":"2023-08-09T12:40:41.730718+0000","last_fullsized":"2023-08-09T12:40:41.730718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:32.523017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730365+0000","last_change":"2023-08-09T12:40:41.729903+0000","last_active":"2023-08-09T12:40:41.730365+0000","last_peered":"2023-08-09T12:40:41.730365+0000","last_clean":"2023-08-09T12:40:41.730365+0000","last_became_active":"2023-08-09T12:40:41.729383+0000","last_became_peered":"2023-08-09T12:40:41.729383+0000","last_unstale":"2023-08-09T12:40:41.730365+0000","last_undegraded":"2023-08-09T12:40:41.730365+0000","last_fullsized":"2023-08-09T12:40:41.730365+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:23.809832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.739071+0000","last_change":"2023-08-09T12:40:40.718111+0000","last_active":"2023-08-09T12:40:41.739071+0000","last_peered":"2023-08-09T12:40:41.739071+0000","last_clean":"2023-08-09T12:40:41.739071+0000","last_became_active":"2023-08-09T12:40:40.717827+0000","last_became_peered":"2023-08-09T12:40:40.717827+0000","last_unstale":"2023-08-09T12:40:41.739071+0000","last_undegraded":"2023-08-09T12:40:41.739071+0000","last_fullsized":"2023-08-09T12:40:41.739071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:37:18.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.738933+0000","last_change":"2023-08-09T12:40:41.738835+0000","last_active":"2023-08-09T12:40:41.738933+0000","last_peered":"2023-08-09T12:40:41.738933+0000","last_clean":"2023-08-09T12:40:41.738933+0000","last_became_active":"2023-08-09T12:40:41.737538+0000","last_became_peered":"2023-08-09T12:40:41.737538+0000","last_unstale":"2023-08-09T12:40:41.738933+0000","last_undegraded":"2023-08-09T12:40:41.738933+0000","last_fullsized":"2023-08-09T12:40:41.738933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:02.722239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.721560+0000","last_change":"2023-08-09T12:40:40.721248+0000","last_active":"2023-08-09T12:40:40.721560+0000","last_peered":"2023-08-09T12:40:40.721560+0000","last_clean":"2023-08-09T12:40:40.721560+0000","last_became_active":"2023-08-09T12:40:40.720933+0000","last_became_peered":"2023-08-09T12:40:40.720933+0000","last_unstale":"2023-08-09T12:40:40.721560+0000","last_undegraded":"2023-08-09T12:40:40.721560+0000","last_fullsized":"2023-08-09T12:40:40.721560+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:24.155747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.708037+0000","last_change":"2023-08-09T12:40:41.705781+0000","last_active":"2023-08-09T12:40:41.708037+0000","last_peered":"2023-08-09T12:40:41.708037+0000","last_clean":"2023-08-09T12:40:41.708037+0000","last_became_active":"2023-08-09T12:40:41.705537+0000","last_became_peered":"2023-08-09T12:40:41.705537+0000","last_unstale":"2023-08-09T12:40:41.708037+0000","last_undegraded":"2023-08-09T12:40:41.708037+0000","last_fullsized":"2023-08-09T12:40:41.708037+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:28:35.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716948+0000","last_change":"2023-08-09T12:40:40.720171+0000","last_active":"2023-08-09T12:40:41.716948+0000","last_peered":"2023-08-09T12:40:41.716948+0000","last_clean":"2023-08-09T12:40:41.716948+0000","last_became_active":"2023-08-09T12:40:40.719797+0000","last_became_peered":"2023-08-09T12:40:40.719797+0000","last_unstale":"2023-08-09T12:40:41.716948+0000","last_undegraded":"2023-08-09T12:40:41.716948+0000","last_fullsized":"2023-08-09T12:40:41.716948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:26:31.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720269+0000","last_change":"2023-08-09T12:40:41.720003+0000","last_active":"2023-08-09T12:40:41.720269+0000","last_peered":"2023-08-09T12:40:41.720269+0000","last_clean":"2023-08-09T12:40:41.720269+0000","last_became_active":"2023-08-09T12:40:41.719288+0000","last_became_peered":"2023-08-09T12:40:41.719288+0000","last_unstale":"2023-08-09T12:40:41.720269+0000","last_undegraded":"2023-08-09T12:40:41.720269+0000","last_fullsized":"2023-08-09T12:40:41.720269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:28:25.800859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.700909+0000","last_change":"2023-08-09T12:40:40.715816+0000","last_active":"2023-08-09T12:40:41.700909+0000","last_peered":"2023-08-09T12:40:41.700909+0000","last_clean":"2023-08-09T12:40:41.700909+0000","last_became_active":"2023-08-09T12:40:40.715476+0000","last_became_peered":"2023-08-09T12:40:40.715476+0000","last_unstale":"2023-08-09T12:40:41.700909+0000","last_undegraded":"2023-08-09T12:40:41.700909+0000","last_fullsized":"2023-08-09T12:40:41.700909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:59.220107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.724630+0000","last_change":"2023-08-09T12:40:41.724541+0000","last_active":"2023-08-09T12:40:41.724630+0000","last_peered":"2023-08-09T12:40:41.724630+0000","last_clean":"2023-08-09T12:40:41.724630+0000","last_became_active":"2023-08-09T12:40:41.724262+0000","last_became_peered":"2023-08-09T12:40:41.724262+0000","last_unstale":"2023-08-09T12:40:41.724630+0000","last_undegraded":"2023-08-09T12:40:41.724630+0000","last_fullsized":"2023-08-09T12:40:41.724630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:45:11.303794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716390+0000","last_change":"2023-08-09T12:40:40.723734+0000","last_active":"2023-08-09T12:40:41.716390+0000","last_peered":"2023-08-09T12:40:41.716390+0000","last_clean":"2023-08-09T12:40:41.716390+0000","last_became_active":"2023-08-09T12:40:40.722863+0000","last_became_peered":"2023-08-09T12:40:40.722863+0000","last_unstale":"2023-08-09T12:40:41.716390+0000","last_undegraded":"2023-08-09T12:40:41.716390+0000","last_fullsized":"2023-08-09T12:40:41.716390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:06:33.331130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.703597+0000","last_change":"2023-08-09T12:40:40.703597+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.703597+0000","last_undegraded":"2023-08-09T12:40:40.703597+0000","last_fullsized":"2023-08-09T12:40:40.703597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.735233+0000","last_change":"2023-08-09T12:40:40.720289+0000","last_active":"2023-08-09T12:40:41.735233+0000","last_peered":"2023-08-09T12:40:41.735233+0000","last_clean":"2023-08-09T12:40:41.735233+0000","last_became_active":"2023-08-09T12:40:40.719047+0000","last_became_peered":"2023-08-09T12:40:40.719047+0000","last_unstale":"2023-08-09T12:40:41.735233+0000","last_undegraded":"2023-08-09T12:40:41.735233+0000","last_fullsized":"2023-08-09T12:40:41.735233+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:02:52.678732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720328+0000","last_change":"2023-08-09T12:40:41.720182+0000","last_active":"2023-08-09T12:40:41.720328+0000","last_peered":"2023-08-09T12:40:41.720328+0000","last_clean":"2023-08-09T12:40:41.720328+0000","last_became_active":"2023-08-09T12:40:41.719485+0000","last_became_peered":"2023-08-09T12:40:41.719485+0000","last_unstale":"2023-08-09T12:40:41.720328+0000","last_undegraded":"2023-08-09T12:40:41.720328+0000","last_fullsized":"2023-08-09T12:40:41.720328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:23:47.307786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732937+0000","last_change":"2023-08-09T12:40:40.701517+0000","last_active":"2023-08-09T12:40:41.732937+0000","last_peered":"2023-08-09T12:40:41.732937+0000","last_clean":"2023-08-09T12:40:41.732937+0000","last_became_active":"2023-08-09T12:40:40.701278+0000","last_became_peered":"2023-08-09T12:40:40.701278+0000","last_unstale":"2023-08-09T12:40:41.732937+0000","last_undegraded":"2023-08-09T12:40:41.732937+0000","last_fullsized":"2023-08-09T12:40:41.732937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:15:02.881774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.704850+0000","last_change":"2023-08-09T12:40:40.704850+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.704850+0000","last_undegraded":"2023-08-09T12:40:40.704850+0000","last_fullsized":"2023-08-09T12:40:40.704850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.717803+0000","last_change":"2023-08-09T12:40:40.708269+0000","last_active":"2023-08-09T12:40:41.717803+0000","last_peered":"2023-08-09T12:40:41.717803+0000","last_clean":"2023-08-09T12:40:41.717803+0000","last_became_active":"2023-08-09T12:40:40.708006+0000","last_became_peered":"2023-08-09T12:40:40.708006+0000","last_unstale":"2023-08-09T12:40:41.717803+0000","last_undegraded":"2023-08-09T12:40:41.717803+0000","last_fullsized":"2023-08-09T12:40:41.717803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:27:09.782457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.712593+0000","last_change":"2023-08-09T12:40:41.712216+0000","last_active":"2023-08-09T12:40:41.712593+0000","last_peered":"2023-08-09T12:40:41.712593+0000","last_clean":"2023-08-09T12:40:41.712593+0000","last_became_active":"2023-08-09T12:40:41.711886+0000","last_became_peered":"2023-08-09T12:40:41.711886+0000","last_unstale":"2023-08-09T12:40:41.712593+0000","last_undegraded":"2023-08-09T12:40:41.712593+0000","last_fullsized":"2023-08-09T12:40:41.712593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:42.760968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.722140+0000","last_change":"2023-08-09T12:40:40.721968+0000","last_active":"2023-08-09T12:40:40.722140+0000","last_peered":"2023-08-09T12:40:40.722140+0000","last_clean":"2023-08-09T12:40:40.722140+0000","last_became_active":"2023-08-09T12:40:40.721700+0000","last_became_peered":"2023-08-09T12:40:40.721700+0000","last_unstale":"2023-08-09T12:40:40.722140+0000","last_undegraded":"2023-08-09T12:40:40.722140+0000","last_fullsized":"2023-08-09T12:40:40.722140+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:45:00.214350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732318+0000","last_change":"2023-08-09T12:40:41.732203+0000","last_active":"2023-08-09T12:40:41.732318+0000","last_peered":"2023-08-09T12:40:41.732318+0000","last_clean":"2023-08-09T12:40:41.732318+0000","last_became_active":"2023-08-09T12:40:41.719580+0000","last_became_peered":"2023-08-09T12:40:41.719580+0000","last_unstale":"2023-08-09T12:40:41.732318+0000","last_undegraded":"2023-08-09T12:40:41.732318+0000","last_fullsized":"2023-08-09T12:40:41.732318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:21:17.060601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.708657+0000","last_change":"2023-08-09T12:40:40.716812+0000","last_active":"2023-08-09T12:40:41.708657+0000","last_peered":"2023-08-09T12:40:41.708657+0000","last_clean":"2023-08-09T12:40:41.708657+0000","last_became_active":"2023-08-09T12:40:40.716568+0000","last_became_peered":"2023-08-09T12:40:40.716568+0000","last_unstale":"2023-08-09T12:40:41.708657+0000","last_undegraded":"2023-08-09T12:40:41.708657+0000","last_fullsized":"2023-08-09T12:40:41.708657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:34:52.886963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.712612+0000","last_change":"2023-08-09T12:40:41.712519+0000","last_active":"2023-08-09T12:40:41.712612+0000","last_peered":"2023-08-09T12:40:41.712612+0000","last_clean":"2023-08-09T12:40:41.712612+0000","last_became_active":"2023-08-09T12:40:41.712290+0000","last_became_peered":"2023-08-09T12:40:41.712290+0000","last_unstale":"2023-08-09T12:40:41.712612+0000","last_undegraded":"2023-08-09T12:40:41.712612+0000","last_fullsized":"2023-08-09T12:40:41.712612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:04:33.339026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.738965+0000","last_change":"2023-08-09T12:40:40.714034+0000","last_active":"2023-08-09T12:40:41.738965+0000","last_peered":"2023-08-09T12:40:41.738965+0000","last_clean":"2023-08-09T12:40:41.738965+0000","last_became_active":"2023-08-09T12:40:40.713704+0000","last_became_peered":"2023-08-09T12:40:40.713704+0000","last_unstale":"2023-08-09T12:40:41.738965+0000","last_undegraded":"2023-08-09T12:40:41.738965+0000","last_fullsized":"2023-08-09T12:40:41.738965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:14:14.161996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726223+0000","last_change":"2023-08-09T12:40:41.725936+0000","last_active":"2023-08-09T12:40:41.726223+0000","last_peered":"2023-08-09T12:40:41.726223+0000","last_clean":"2023-08-09T12:40:41.726223+0000","last_became_active":"2023-08-09T12:40:41.725666+0000","last_became_peered":"2023-08-09T12:40:41.725666+0000","last_unstale":"2023-08-09T12:40:41.726223+0000","last_undegraded":"2023-08-09T12:40:41.726223+0000","last_fullsized":"2023-08-09T12:40:41.726223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:23.809832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.736503+0000","last_change":"2023-08-09T12:40:40.721673+0000","last_active":"2023-08-09T12:40:41.736503+0000","last_peered":"2023-08-09T12:40:41.736503+0000","last_clean":"2023-08-09T12:40:41.736503+0000","last_became_active":"2023-08-09T12:40:40.721337+0000","last_became_peered":"2023-08-09T12:40:40.721337+0000","last_unstale":"2023-08-09T12:40:41.736503+0000","last_undegraded":"2023-08-09T12:40:41.736503+0000","last_fullsized":"2023-08-09T12:40:41.736503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:57.149329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730390+0000","last_change":"2023-08-09T12:40:41.728438+0000","last_active":"2023-08-09T12:40:41.730390+0000","last_peered":"2023-08-09T12:40:41.730390+0000","last_clean":"2023-08-09T12:40:41.730390+0000","last_became_active":"2023-08-09T12:40:41.728041+0000","last_became_peered":"2023-08-09T12:40:41.728041+0000","last_unstale":"2023-08-09T12:40:41.730390+0000","last_undegraded":"2023-08-09T12:40:41.730390+0000","last_fullsized":"2023-08-09T12:40:41.730390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:18.029300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.736154+0000","last_change":"2023-08-09T12:40:40.721886+0000","last_active":"2023-08-09T12:40:41.736154+0000","last_peered":"2023-08-09T12:40:41.736154+0000","last_clean":"2023-08-09T12:40:41.736154+0000","last_became_active":"2023-08-09T12:40:40.721264+0000","last_became_peered":"2023-08-09T12:40:40.721264+0000","last_unstale":"2023-08-09T12:40:41.736154+0000","last_undegraded":"2023-08-09T12:40:41.736154+0000","last_fullsized":"2023-08-09T12:40:41.736154+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:02:01.785489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730789+0000","last_change":"2023-08-09T12:40:41.730672+0000","last_active":"2023-08-09T12:40:41.730789+0000","last_peered":"2023-08-09T12:40:41.730789+0000","last_clean":"2023-08-09T12:40:41.730789+0000","last_became_active":"2023-08-09T12:40:41.730464+0000","last_became_peered":"2023-08-09T12:40:41.730464+0000","last_unstale":"2023-08-09T12:40:41.730789+0000","last_undegraded":"2023-08-09T12:40:41.730789+0000","last_fullsized":"2023-08-09T12:40:41.730789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:21:17.060601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.722783+0000","last_change":"2023-08-09T12:40:40.716595+0000","last_active":"2023-08-09T12:40:41.722783+0000","last_peered":"2023-08-09T12:40:41.722783+0000","last_clean":"2023-08-09T12:40:41.722783+0000","last_became_active":"2023-08-09T12:40:40.716375+0000","last_became_peered":"2023-08-09T12:40:40.716375+0000","last_unstale":"2023-08-09T12:40:41.722783+0000","last_undegraded":"2023-08-09T12:40:41.722783+0000","last_fullsized":"2023-08-09T12:40:41.722783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:38:58.901244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.711804+0000","last_change":"2023-08-09T12:40:41.711692+0000","last_active":"2023-08-09T12:40:41.711804+0000","last_peered":"2023-08-09T12:40:41.711804+0000","last_clean":"2023-08-09T12:40:41.711804+0000","last_became_active":"2023-08-09T12:40:41.711458+0000","last_became_peered":"2023-08-09T12:40:41.711458+0000","last_unstale":"2023-08-09T12:40:41.711804+0000","last_undegraded":"2023-08-09T12:40:41.711804+0000","last_fullsized":"2023-08-09T12:40:41.711804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:51.606272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.719197+0000","last_change":"2023-08-09T12:40:40.719109+0000","last_active":"2023-08-09T12:40:40.719197+0000","last_peered":"2023-08-09T12:40:40.719197+0000","last_clean":"2023-08-09T12:40:40.719197+0000","last_became_active":"2023-08-09T12:40:40.718822+0000","last_became_peered":"2023-08-09T12:40:40.718822+0000","last_unstale":"2023-08-09T12:40:40.719197+0000","last_undegraded":"2023-08-09T12:40:40.719197+0000","last_fullsized":"2023-08-09T12:40:40.719197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:24:36.055644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732711+0000","last_change":"2023-08-09T12:40:41.732468+0000","last_active":"2023-08-09T12:40:41.732711+0000","last_peered":"2023-08-09T12:40:41.732711+0000","last_clean":"2023-08-09T12:40:41.732711+0000","last_became_active":"2023-08-09T12:40:41.720508+0000","last_became_peered":"2023-08-09T12:40:41.720508+0000","last_unstale":"2023-08-09T12:40:41.732711+0000","last_undegraded":"2023-08-09T12:40:41.732711+0000","last_fullsized":"2023-08-09T12:40:41.732711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:07.837347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.718501+0000","last_change":"2023-08-09T12:40:40.712539+0000","last_active":"2023-08-09T12:40:41.718501+0000","last_peered":"2023-08-09T12:40:41.718501+0000","last_clean":"2023-08-09T12:40:41.718501+0000","last_became_active":"2023-08-09T12:40:40.711884+0000","last_became_peered":"2023-08-09T12:40:40.711884+0000","last_unstale":"2023-08-09T12:40:41.718501+0000","last_undegraded":"2023-08-09T12:40:41.718501+0000","last_fullsized":"2023-08-09T12:40:41.718501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:11:57.216279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.704829+0000","last_change":"2023-08-09T12:40:40.704829+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.704829+0000","last_undegraded":"2023-08-09T12:40:40.704829+0000","last_fullsized":"2023-08-09T12:40:40.704829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.706911+0000","last_change":"2023-08-09T12:40:40.714241+0000","last_active":"2023-08-09T12:40:41.706911+0000","last_peered":"2023-08-09T12:40:41.706911+0000","last_clean":"2023-08-09T12:40:41.706911+0000","last_became_active":"2023-08-09T12:40:40.713614+0000","last_became_peered":"2023-08-09T12:40:40.713614+0000","last_unstale":"2023-08-09T12:40:41.706911+0000","last_undegraded":"2023-08-09T12:40:41.706911+0000","last_fullsized":"2023-08-09T12:40:41.706911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:41:56.789039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.725219+0000","last_change":"2023-08-09T12:40:41.725132+0000","last_active":"2023-08-09T12:40:41.725219+0000","last_peered":"2023-08-09T12:40:41.725219+0000","last_clean":"2023-08-09T12:40:41.725219+0000","last_became_active":"2023-08-09T12:40:41.724901+0000","last_became_peered":"2023-08-09T12:40:41.724901+0000","last_unstale":"2023-08-09T12:40:41.725219+0000","last_undegraded":"2023-08-09T12:40:41.725219+0000","last_fullsized":"2023-08-09T12:40:41.725219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:27:10.796667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.698982+0000","last_change":"2023-08-09T12:40:40.701004+0000","last_active":"2023-08-09T12:40:41.698982+0000","last_peered":"2023-08-09T12:40:41.698982+0000","last_clean":"2023-08-09T12:40:41.698982+0000","last_became_active":"2023-08-09T12:40:40.700293+0000","last_became_peered":"2023-08-09T12:40:40.700293+0000","last_unstale":"2023-08-09T12:40:41.698982+0000","last_undegraded":"2023-08-09T12:40:41.698982+0000","last_fullsized":"2023-08-09T12:40:41.698982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:06:33.331130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.705215+0000","last_change":"2023-08-09T12:40:41.705122+0000","last_active":"2023-08-09T12:40:41.705215+0000","last_peered":"2023-08-09T12:40:41.705215+0000","last_clean":"2023-08-09T12:40:41.705215+0000","last_became_active":"2023-08-09T12:40:41.704863+0000","last_became_peered":"2023-08-09T12:40:41.704863+0000","last_unstale":"2023-08-09T12:40:41.705215+0000","last_undegraded":"2023-08-09T12:40:41.705215+0000","last_fullsized":"2023-08-09T12:40:41.705215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:31:01.896896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.707898+0000","last_change":"2023-08-09T12:40:40.709014+0000","last_active":"2023-08-09T12:40:41.707898+0000","last_peered":"2023-08-09T12:40:41.707898+0000","last_clean":"2023-08-09T12:40:41.707898+0000","last_became_active":"2023-08-09T12:40:40.708776+0000","last_became_peered":"2023-08-09T12:40:40.708776+0000","last_unstale":"2023-08-09T12:40:41.707898+0000","last_undegraded":"2023-08-09T12:40:41.707898+0000","last_fullsized":"2023-08-09T12:40:41.707898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:03.822381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728610+0000","last_change":"2023-08-09T12:40:41.727588+0000","last_active":"2023-08-09T12:40:41.728610+0000","last_peered":"2023-08-09T12:40:41.728610+0000","last_clean":"2023-08-09T12:40:41.728610+0000","last_became_active":"2023-08-09T12:40:41.726821+0000","last_became_peered":"2023-08-09T12:40:41.726821+0000","last_unstale":"2023-08-09T12:40:41.728610+0000","last_undegraded":"2023-08-09T12:40:41.728610+0000","last_fullsized":"2023-08-09T12:40:41.728610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:06.597719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.699400+0000","last_change":"2023-08-09T12:40:40.702944+0000","last_active":"2023-08-09T12:40:41.699400+0000","last_peered":"2023-08-09T12:40:41.699400+0000","last_clean":"2023-08-09T12:40:41.699400+0000","last_became_active":"2023-08-09T12:40:40.702327+0000","last_became_peered":"2023-08-09T12:40:40.702327+0000","last_unstale":"2023-08-09T12:40:41.699400+0000","last_undegraded":"2023-08-09T12:40:41.699400+0000","last_fullsized":"2023-08-09T12:40:41.699400+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:00:25.184442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.700502+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:40:41.700502+0000","last_peered":"2023-08-09T12:40:41.700502+0000","last_clean":"2023-08-09T12:40:41.700502+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:40:41.700502+0000","last_undegraded":"2023-08-09T12:40:41.700502+0000","last_fullsized":"2023-08-09T12:40:41.700502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:20.533378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723381+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:40:41.723381+0000","last_peered":"2023-08-09T12:40:41.723381+0000","last_clean":"2023-08-09T12:40:41.723381+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:40:41.723381+0000","last_undegraded":"2023-08-09T12:40:41.723381+0000","last_fullsized":"2023-08-09T12:40:41.723381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:05.831906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.710361+0000","last_change":"2023-08-09T12:40:40.710361+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.710361+0000","last_undegraded":"2023-08-09T12:40:40.710361+0000","last_fullsized":"2023-08-09T12:40:40.710361+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730570+0000","last_change":"2023-08-09T12:40:40.721320+0000","last_active":"2023-08-09T12:40:41.730570+0000","last_peered":"2023-08-09T12:40:41.730570+0000","last_clean":"2023-08-09T12:40:41.730570+0000","last_became_active":"2023-08-09T12:40:40.720285+0000","last_became_peered":"2023-08-09T12:40:40.720285+0000","last_unstale":"2023-08-09T12:40:41.730570+0000","last_undegraded":"2023-08-09T12:40:41.730570+0000","last_fullsized":"2023-08-09T12:40:41.730570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:00:25.184442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.699958+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:40:41.699958+0000","last_peered":"2023-08-09T12:40:41.699958+0000","last_clean":"2023-08-09T12:40:41.699958+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:40:41.699958+0000","last_undegraded":"2023-08-09T12:40:41.699958+0000","last_fullsized":"2023-08-09T12:40:41.699958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:05.831906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.725058+0000","last_change":"2023-08-09T12:40:41.724875+0000","last_active":"2023-08-09T12:40:41.725058+0000","last_peered":"2023-08-09T12:40:41.725058+0000","last_clean":"2023-08-09T12:40:41.725058+0000","last_became_active":"2023-08-09T12:40:41.724147+0000","last_became_peered":"2023-08-09T12:40:41.724147+0000","last_unstale":"2023-08-09T12:40:41.725058+0000","last_undegraded":"2023-08-09T12:40:41.725058+0000","last_fullsized":"2023-08-09T12:40:41.725058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:33.537227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.706631+0000","last_change":"2023-08-09T12:40:40.719789+0000","last_active":"2023-08-09T12:40:41.706631+0000","last_peered":"2023-08-09T12:40:41.706631+0000","last_clean":"2023-08-09T12:40:41.706631+0000","last_became_active":"2023-08-09T12:40:40.719536+0000","last_became_peered":"2023-08-09T12:40:40.719536+0000","last_unstale":"2023-08-09T12:40:41.706631+0000","last_undegraded":"2023-08-09T12:40:41.706631+0000","last_fullsized":"2023-08-09T12:40:41.706631+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:50.864610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.706709+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:40:41.706709+0000","last_peered":"2023-08-09T12:40:41.706709+0000","last_clean":"2023-08-09T12:40:41.706709+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:40:41.706709+0000","last_undegraded":"2023-08-09T12:40:41.706709+0000","last_fullsized":"2023-08-09T12:40:41.706709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:33.666985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726190+0000","last_change":"2023-08-09T12:40:41.725676+0000","last_active":"2023-08-09T12:40:41.726190+0000","last_peered":"2023-08-09T12:40:41.726190+0000","last_clean":"2023-08-09T12:40:41.726190+0000","last_became_active":"2023-08-09T12:40:41.725020+0000","last_became_peered":"2023-08-09T12:40:41.725020+0000","last_unstale":"2023-08-09T12:40:41.726190+0000","last_undegraded":"2023-08-09T12:40:41.726190+0000","last_fullsized":"2023-08-09T12:40:41.726190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:14.006945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.712901+0000","last_change":"2023-08-09T12:40:40.711527+0000","last_active":"2023-08-09T12:40:40.712901+0000","last_peered":"2023-08-09T12:40:40.712901+0000","last_clean":"2023-08-09T12:40:40.712901+0000","last_became_active":"2023-08-09T12:40:40.710971+0000","last_became_peered":"2023-08-09T12:40:40.710971+0000","last_unstale":"2023-08-09T12:40:40.712901+0000","last_undegraded":"2023-08-09T12:40:40.712901+0000","last_fullsized":"2023-08-09T12:40:40.712901+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:34:31.516987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716620+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:40:41.716620+0000","last_peered":"2023-08-09T12:40:41.716620+0000","last_clean":"2023-08-09T12:40:41.716620+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:40:41.716620+0000","last_undegraded":"2023-08-09T12:40:41.716620+0000","last_fullsized":"2023-08-09T12:40:41.716620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:27:45.281230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.705476+0000","last_change":"2023-08-09T12:40:40.705476+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.705476+0000","last_undegraded":"2023-08-09T12:40:40.705476+0000","last_fullsized":"2023-08-09T12:40:40.705476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.712928+0000","last_change":"2023-08-09T12:40:40.712554+0000","last_active":"2023-08-09T12:40:40.712928+0000","last_peered":"2023-08-09T12:40:40.712928+0000","last_clean":"2023-08-09T12:40:40.712928+0000","last_became_active":"2023-08-09T12:40:40.712290+0000","last_became_peered":"2023-08-09T12:40:40.712290+0000","last_unstale":"2023-08-09T12:40:40.712928+0000","last_undegraded":"2023-08-09T12:40:40.712928+0000","last_fullsized":"2023-08-09T12:40:40.712928+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:20.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.711411+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:40:40.711411+0000","last_peered":"2023-08-09T12:40:40.711411+0000","last_clean":"2023-08-09T12:40:40.711411+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:40:40.711411+0000","last_undegraded":"2023-08-09T12:40:40.711411+0000","last_fullsized":"2023-08-09T12:40:40.711411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:29.354234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-09T12:40:40.708025+0000","last_change":"2023-08-09T12:40:40.708025+0000","last_active":"2023-08-09T12:40:40.677865+0000","last_peered":"2023-08-09T12:40:40.677865+0000","last_clean":"2023-08-09T12:40:40.677865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:40:40.708025+0000","last_undegraded":"2023-08-09T12:40:40.708025+0000","last_fullsized":"2023-08-09T12:40:40.708025+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.708973+0000","last_change":"2023-08-09T12:40:40.710209+0000","last_active":"2023-08-09T12:40:41.708973+0000","last_peered":"2023-08-09T12:40:41.708973+0000","last_clean":"2023-08-09T12:40:41.708973+0000","last_became_active":"2023-08-09T12:40:40.709688+0000","last_became_peered":"2023-08-09T12:40:40.709688+0000","last_unstale":"2023-08-09T12:40:41.708973+0000","last_undegraded":"2023-08-09T12:40:41.708973+0000","last_fullsized":"2023-08-09T12:40:41.708973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:30.570505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.699645+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:40:41.699645+0000","last_peered":"2023-08-09T12:40:41.699645+0000","last_clean":"2023-08-09T12:40:41.699645+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:40:41.699645+0000","last_undegraded":"2023-08-09T12:40:41.699645+0000","last_fullsized":"2023-08-09T12:40:41.699645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:14.875042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723093+0000","last_change":"2023-08-09T12:40:41.722863+0000","last_active":"2023-08-09T12:40:41.723093+0000","last_peered":"2023-08-09T12:40:41.723093+0000","last_clean":"2023-08-09T12:40:41.723093+0000","last_became_active":"2023-08-09T12:40:41.722230+0000","last_became_peered":"2023-08-09T12:40:41.722230+0000","last_unstale":"2023-08-09T12:40:41.723093+0000","last_undegraded":"2023-08-09T12:40:41.723093+0000","last_fullsized":"2023-08-09T12:40:41.723093+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:01.603786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720575+0000","last_change":"2023-08-09T12:40:40.716754+0000","last_active":"2023-08-09T12:40:41.720575+0000","last_peered":"2023-08-09T12:40:41.720575+0000","last_clean":"2023-08-09T12:40:41.720575+0000","last_became_active":"2023-08-09T12:40:40.716061+0000","last_became_peered":"2023-08-09T12:40:40.716061+0000","last_unstale":"2023-08-09T12:40:41.720575+0000","last_undegraded":"2023-08-09T12:40:41.720575+0000","last_fullsized":"2023-08-09T12:40:41.720575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:45.266395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-09T12:40:40.708512+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:40:40.708512+0000","last_peered":"2023-08-09T12:40:40.708512+0000","last_clean":"2023-08-09T12:40:40.708512+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:40:40.708512+0000","last_undegraded":"2023-08-09T12:40:40.708512+0000","last_fullsized":"2023-08-09T12:40:40.708512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:33:10.116644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.734634+0000","last_change":"2023-08-09T12:40:41.734549+0000","last_active":"2023-08-09T12:40:41.734634+0000","last_peered":"2023-08-09T12:40:41.734634+0000","last_clean":"2023-08-09T12:40:41.734634+0000","last_became_active":"2023-08-09T12:40:41.733268+0000","last_became_peered":"2023-08-09T12:40:41.733268+0000","last_unstale":"2023-08-09T12:40:41.734634+0000","last_undegraded":"2023-08-09T12:40:41.734634+0000","last_fullsized":"2023-08-09T12:40:41.734634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:26:32.439590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.700544+0000","last_change":"2023-08-09T12:40:40.710190+0000","last_active":"2023-08-09T12:40:41.700544+0000","last_peered":"2023-08-09T12:40:41.700544+0000","last_clean":"2023-08-09T12:40:41.700544+0000","last_became_active":"2023-08-09T12:40:40.709897+0000","last_became_peered":"2023-08-09T12:40:40.709897+0000","last_unstale":"2023-08-09T12:40:41.700544+0000","last_undegraded":"2023-08-09T12:40:41.700544+0000","last_fullsized":"2023-08-09T12:40:41.700544+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:25.402733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.709190+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:40:41.709190+0000","last_peered":"2023-08-09T12:40:41.709190+0000","last_clean":"2023-08-09T12:40:41.709190+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:40:41.709190+0000","last_undegraded":"2023-08-09T12:40:41.709190+0000","last_fullsized":"2023-08-09T12:40:41.709190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:37:39.653081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":733,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194579,"statfs":{"total":200000000,"available":199249182,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.0209999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.5549999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.194},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.238}]},{"osd":3,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.288}]},{"osd":4,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.7070000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":3.3580000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.5089999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.387},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.762}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.163}]},{"osd":1,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.6659999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.369},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.4390000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.5},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.5369999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.5800000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.6279999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.7070000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.284},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96099999999999997}]},{"osd":1,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.226},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1899999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.89500000000000002}]},{"osd":3,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.5660000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.004},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.327}]},{"osd":6,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.651},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.145}]},{"osd":7,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.431},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.478}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195148,"statfs":{"total":200000000,"available":199831818,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.202}]},{"osd":1,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.4430000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.48},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5109999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.373}]},{"osd":5,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.3460000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.2450000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.2729999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.633},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.52}]},{"osd":2,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.4159999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.758}]},{"osd":6,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.456}]},{"osd":7,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.71},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.1499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.67700000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.96799999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.109}]},{"osd":4,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.8180000000000001,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.518}]},{"osd":5,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.454},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.381}]},{"osd":6,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.248},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.046}]},{"osd":7,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.409},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.1930000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.321},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.80300000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.569}]},{"osd":3,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.177},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.4319999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.111}]},{"osd":6,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.29},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.2430000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.0649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194585,"statfs":{"total":200000000,"available":199255810,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.71699999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.091},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.89100000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.3680000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.2410000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:40:46.237 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:40:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.504+0000 7ff040ef9640 1 Processor -- start 2023-08-09T12:40:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.504+0000 7ff040ef9640 1 -- start start 2023-08-09T12:40:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.506+0000 7ff040ef9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff03c0adc40 0x7ff03c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.506+0000 7ff040ef9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c0b2250 con 0x7ff03c0cc630 2023-08-09T12:40:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.506+0000 7ff040ef9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c0b2530 con 0x7ff03c0b3b40 2023-08-09T12:40:46.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.506+0000 7ff040ef9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03c0ae020 con 0x7ff03c0adc40 2023-08-09T12:40:46.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.506+0000 7ff03a59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff03c0adc40 0x7ff03c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:46.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.507+0000 7ff03a59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff03c0adc40 0x7ff03c06c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51648/0 (socket says 172.21.15.17:51648) 2023-08-09T12:40:46.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.507+0000 7ff03a59c640 1 -- 172.21.15.17:0/682745155 learned_addr learned my addr 172.21.15.17:0/682745155 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:46.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.507+0000 7ff03a59c640 1 -- 172.21.15.17:0/682745155 >> v1:172.21.15.142:6789/0 conn(0x7ff03c0b3b40 legacy=0x7ff03c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:46.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.507+0000 7ff03a59c640 1 -- 172.21.15.17:0/682745155 >> v1:172.21.15.17:6789/0 conn(0x7ff03c0cc630 legacy=0x7ff03c0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:46.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.507+0000 7ff03a59c640 1 -- 172.21.15.17:0/682745155 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c06fe80 con 0x7ff03c0adc40 2023-08-09T12:40:46.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.508+0000 7ff03a59c640 1 --2- 172.21.15.17:0/682745155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0adc40 0x7ff03c06c280 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009870 tx=0x7ff02c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60680dfa9d3ce50b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:46.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff03959a640 1 -- 172.21.15.17:0/682745155 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c031870 con 0x7ff03c0adc40 2023-08-09T12:40:46.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff03959a640 1 -- 172.21.15.17:0/682745155 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c0319d0 con 0x7ff03c0adc40 2023-08-09T12:40:46.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff03959a640 1 -- 172.21.15.17:0/682745155 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c031d60 con 0x7ff03c0adc40 2023-08-09T12:40:46.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff040ef9640 1 -- 172.21.15.17:0/682745155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0adc40 msgr2=0x7ff03c06c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:46.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff040ef9640 1 --2- 172.21.15.17:0/682745155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0adc40 0x7ff03c06c280 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009870 tx=0x7ff02c02b910 comp rx=0 tx=0).stop 2023-08-09T12:40:46.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff040ef9640 1 -- 172.21.15.17:0/682745155 shutdown_connections 2023-08-09T12:40:46.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff040ef9640 1 --2- 172.21.15.17:0/682745155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0adc40 0x7ff03c06c280 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff040ef9640 1 -- 172.21.15.17:0/682745155 >> 172.21.15.17:0/682745155 conn(0x7ff03c0cb1b0 msgr2=0x7ff03c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff040ef9640 1 -- 172.21.15.17:0/682745155 shutdown_connections 2023-08-09T12:40:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.509+0000 7ff040ef9640 1 -- 172.21.15.17:0/682745155 wait complete. 2023-08-09T12:40:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.511+0000 7ff040ef9640 1 Processor -- start 2023-08-09T12:40:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.511+0000 7ff040ef9640 1 -- start start 2023-08-09T12:40:46.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.512+0000 7ff040ef9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff03c0adc40 0x7ff03c145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:46.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.512+0000 7ff040ef9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff03c0b3b40 0x7ff03c0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:46.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.512+0000 7ff040ef9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0cc630 0x7ff03c0c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:46.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.512+0000 7ff040ef9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c146110 con 0x7ff03c0cc630 2023-08-09T12:40:46.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.512+0000 7ff040ef9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c0c6920 con 0x7ff03c0adc40 2023-08-09T12:40:46.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.512+0000 7ff040ef9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c0c5d10 con 0x7ff03c0b3b40 2023-08-09T12:40:46.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0cc630 0x7ff03c0c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0cc630 0x7ff03c0c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51658/0 (socket says 172.21.15.17:51658) 2023-08-09T12:40:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03ad9d640 1 -- 172.21.15.17:0/3494282210 learned_addr learned my addr 172.21.15.17:0/3494282210 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03a59c640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff03c0adc40 0x7ff03c145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03ad9d640 1 -- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff03c0b3b40 msgr2=0x7ff03c0c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff039d9b640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff03c0b3b40 0x7ff03c0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03ad9d640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff03c0b3b40 0x7ff03c0c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03ad9d640 1 -- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff03c0adc40 msgr2=0x7ff03c145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03ad9d640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff03c0adc40 0x7ff03c145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff03ad9d640 1 -- 172.21.15.17:0/3494282210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0094d0 con 0x7ff03c0cc630 2023-08-09T12:40:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.513+0000 7ff039d9b640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff03c0b3b40 0x7ff03c0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.514+0000 7ff03ad9d640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0cc630 0x7ff03c0c6db0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff03400c6b0 tx=0x7ff03400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.514+0000 7ff02affd640 1 -- 172.21.15.17:0/3494282210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034003b70 con 0x7ff03c0cc630 2023-08-09T12:40:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.514+0000 7ff02affd640 1 -- 172.21.15.17:0/3494282210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034003cf0 con 0x7ff03c0cc630 2023-08-09T12:40:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.514+0000 7ff02affd640 1 -- 172.21.15.17:0/3494282210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034003ea0 con 0x7ff03c0cc630 2023-08-09T12:40:46.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.514+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c0c5ff0 con 0x7ff03c0cc630 2023-08-09T12:40:46.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.514+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c0c65b0 con 0x7ff03c0cc630 2023-08-09T12:40:46.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.515+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c067a80 con 0x7ff03c0cc630 2023-08-09T12:40:46.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.516+0000 7ff02affd640 1 -- 172.21.15.17:0/3494282210 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff034005310 con 0x7ff03c0cc630 2023-08-09T12:40:46.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.518+0000 7ff02affd640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff01c06a050 0x7ff01c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:46.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.518+0000 7ff02affd640 1 -- 172.21.15.17:0/3494282210 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff034088340 con 0x7ff03c0cc630 2023-08-09T12:40:46.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.518+0000 7ff03a59c640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff01c06a050 0x7ff01c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:46.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.520+0000 7ff03a59c640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff01c06a050 0x7ff01c06c510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff02c036000 tx=0x7ff02c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:46.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.522+0000 7ff02affd640 1 -- 172.21.15.17:0/3494282210 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff034053a30 con 0x7ff03c0cc630 2023-08-09T12:40:46.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.710+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff03c070440 con 0x7ff01c06a050 2023-08-09T12:40:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.733+0000 7ff02affd640 1 -- 172.21.15.17:0/3494282210 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302916 (secure 0 0 0) 0x7ff02c031810 con 0x7ff01c06a050 2023-08-09T12:40:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:46.741 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:40:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.738+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff01c06a050 msgr2=0x7ff01c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.738+0000 7ff040ef9640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff01c06a050 0x7ff01c06c510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff02c036000 tx=0x7ff02c03c040 comp rx=0 tx=0).stop 2023-08-09T12:40:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.738+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0cc630 msgr2=0x7ff03c0c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.738+0000 7ff040ef9640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0cc630 0x7ff03c0c6db0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff03400c6b0 tx=0x7ff03400cb70 comp rx=0 tx=0).stop 2023-08-09T12:40:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.738+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 shutdown_connections 2023-08-09T12:40:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.738+0000 7ff040ef9640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff01c06a050 0x7ff01c06c510 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.738+0000 7ff040ef9640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff03c0cc630 0x7ff03c0c6db0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.739+0000 7ff040ef9640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff03c0b3b40 0x7ff03c0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.739+0000 7ff040ef9640 1 --2- 172.21.15.17:0/3494282210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff03c0adc40 0x7ff03c145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.739+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 >> 172.21.15.17:0/3494282210 conn(0x7ff03c0cb1b0 msgr2=0x7ff03c0ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.739+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 shutdown_connections 2023-08-09T12:40:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:46.739+0000 7ff040ef9640 1 -- 172.21.15.17:0/3494282210 wait complete. 2023-08-09T12:40:46.765 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-08-09T12:40:46.663778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2441,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560058,"statfs":{"total":1600000000,"available":1597500246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002185"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.711202+0000","last_change":"2023-08-09T12:40:41.711077+0000","last_active":"2023-08-09T12:40:41.711202+0000","last_peered":"2023-08-09T12:40:41.711202+0000","last_clean":"2023-08-09T12:40:41.711202+0000","last_became_active":"2023-08-09T12:40:41.710825+0000","last_became_peered":"2023-08-09T12:40:41.710825+0000","last_unstale":"2023-08-09T12:40:41.711202+0000","last_undegraded":"2023-08-09T12:40:41.711202+0000","last_fullsized":"2023-08-09T12:40:41.711202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:25.809689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.709698+0000","last_change":"2023-08-09T12:40:41.709234+0000","last_active":"2023-08-09T12:40:41.709698+0000","last_peered":"2023-08-09T12:40:41.709698+0000","last_clean":"2023-08-09T12:40:41.709698+0000","last_became_active":"2023-08-09T12:40:41.708960+0000","last_became_peered":"2023-08-09T12:40:41.708960+0000","last_unstale":"2023-08-09T12:40:41.709698+0000","last_undegraded":"2023-08-09T12:40:41.709698+0000","last_fullsized":"2023-08-09T12:40:41.709698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:49:09.673721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.911569+0000","last_change":"2023-08-09T12:40:41.721628+0000","last_active":"2023-08-09T12:40:43.911569+0000","last_peered":"2023-08-09T12:40:43.911569+0000","last_clean":"2023-08-09T12:40:43.911569+0000","last_became_active":"2023-08-09T12:40:41.721196+0000","last_became_peered":"2023-08-09T12:40:41.721196+0000","last_unstale":"2023-08-09T12:40:43.911569+0000","last_undegraded":"2023-08-09T12:40:43.911569+0000","last_fullsized":"2023-08-09T12:40:43.911569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:31:01.896896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720284+0000","last_change":"2023-08-09T12:40:41.720168+0000","last_active":"2023-08-09T12:40:41.720284+0000","last_peered":"2023-08-09T12:40:41.720284+0000","last_clean":"2023-08-09T12:40:41.720284+0000","last_became_active":"2023-08-09T12:40:41.719705+0000","last_became_peered":"2023-08-09T12:40:41.719705+0000","last_unstale":"2023-08-09T12:40:41.720284+0000","last_undegraded":"2023-08-09T12:40:41.720284+0000","last_fullsized":"2023-08-09T12:40:41.720284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:29:42.416907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720252+0000","last_change":"2023-08-09T12:40:41.719746+0000","last_active":"2023-08-09T12:40:41.720252+0000","last_peered":"2023-08-09T12:40:41.720252+0000","last_clean":"2023-08-09T12:40:41.720252+0000","last_became_active":"2023-08-09T12:40:41.719490+0000","last_became_peered":"2023-08-09T12:40:41.719490+0000","last_unstale":"2023-08-09T12:40:41.720252+0000","last_undegraded":"2023-08-09T12:40:41.720252+0000","last_fullsized":"2023-08-09T12:40:41.720252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:36:48.840416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203573+0000","last_change":"2023-08-09T12:40:41.726950+0000","last_active":"2023-08-09T12:40:44.203573+0000","last_peered":"2023-08-09T12:40:44.203573+0000","last_clean":"2023-08-09T12:40:44.203573+0000","last_became_active":"2023-08-09T12:40:41.726700+0000","last_became_peered":"2023-08-09T12:40:41.726700+0000","last_unstale":"2023-08-09T12:40:44.203573+0000","last_undegraded":"2023-08-09T12:40:44.203573+0000","last_fullsized":"2023-08-09T12:40:44.203573+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:02:53.692943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728638+0000","last_change":"2023-08-09T12:40:41.727839+0000","last_active":"2023-08-09T12:40:41.728638+0000","last_peered":"2023-08-09T12:40:41.728638+0000","last_clean":"2023-08-09T12:40:41.728638+0000","last_became_active":"2023-08-09T12:40:41.727329+0000","last_became_peered":"2023-08-09T12:40:41.727329+0000","last_unstale":"2023-08-09T12:40:41.728638+0000","last_undegraded":"2023-08-09T12:40:41.728638+0000","last_fullsized":"2023-08-09T12:40:41.728638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:30.315499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726153+0000","last_change":"2023-08-09T12:40:41.722544+0000","last_active":"2023-08-09T12:40:41.726153+0000","last_peered":"2023-08-09T12:40:41.726153+0000","last_clean":"2023-08-09T12:40:41.726153+0000","last_became_active":"2023-08-09T12:40:41.721943+0000","last_became_peered":"2023-08-09T12:40:41.721943+0000","last_unstale":"2023-08-09T12:40:41.726153+0000","last_undegraded":"2023-08-09T12:40:41.726153+0000","last_fullsized":"2023-08-09T12:40:41.726153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:26.381844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.911483+0000","last_change":"2023-08-09T12:40:41.715337+0000","last_active":"2023-08-09T12:40:43.911483+0000","last_peered":"2023-08-09T12:40:43.911483+0000","last_clean":"2023-08-09T12:40:43.911483+0000","last_became_active":"2023-08-09T12:40:41.715090+0000","last_became_peered":"2023-08-09T12:40:41.715090+0000","last_unstale":"2023-08-09T12:40:43.911483+0000","last_undegraded":"2023-08-09T12:40:43.911483+0000","last_fullsized":"2023-08-09T12:40:43.911483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:29:00.234317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723601+0000","last_change":"2023-08-09T12:40:41.723477+0000","last_active":"2023-08-09T12:40:41.723601+0000","last_peered":"2023-08-09T12:40:41.723601+0000","last_clean":"2023-08-09T12:40:41.723601+0000","last_became_active":"2023-08-09T12:40:41.723241+0000","last_became_peered":"2023-08-09T12:40:41.723241+0000","last_unstale":"2023-08-09T12:40:41.723601+0000","last_undegraded":"2023-08-09T12:40:41.723601+0000","last_fullsized":"2023-08-09T12:40:41.723601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:45:11.303794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732734+0000","last_change":"2023-08-09T12:40:41.732618+0000","last_active":"2023-08-09T12:40:41.732734+0000","last_peered":"2023-08-09T12:40:41.732734+0000","last_clean":"2023-08-09T12:40:41.732734+0000","last_became_active":"2023-08-09T12:40:41.732337+0000","last_became_peered":"2023-08-09T12:40:41.732337+0000","last_unstale":"2023-08-09T12:40:41.732734+0000","last_undegraded":"2023-08-09T12:40:41.732734+0000","last_fullsized":"2023-08-09T12:40:41.732734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:52:37.289595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.911669+0000","last_change":"2023-08-09T12:40:41.711474+0000","last_active":"2023-08-09T12:40:43.911669+0000","last_peered":"2023-08-09T12:40:43.911669+0000","last_clean":"2023-08-09T12:40:43.911669+0000","last_became_active":"2023-08-09T12:40:41.711241+0000","last_became_peered":"2023-08-09T12:40:41.711241+0000","last_unstale":"2023-08-09T12:40:43.911669+0000","last_undegraded":"2023-08-09T12:40:43.911669+0000","last_fullsized":"2023-08-09T12:40:43.911669+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:42.760968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.731036+0000","last_change":"2023-08-09T12:40:41.730905+0000","last_active":"2023-08-09T12:40:41.731036+0000","last_peered":"2023-08-09T12:40:41.731036+0000","last_clean":"2023-08-09T12:40:41.731036+0000","last_became_active":"2023-08-09T12:40:41.730596+0000","last_became_peered":"2023-08-09T12:40:41.730596+0000","last_unstale":"2023-08-09T12:40:41.731036+0000","last_undegraded":"2023-08-09T12:40:41.731036+0000","last_fullsized":"2023-08-09T12:40:41.731036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:14.006945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726922+0000","last_change":"2023-08-09T12:40:41.726444+0000","last_active":"2023-08-09T12:40:41.726922+0000","last_peered":"2023-08-09T12:40:41.726922+0000","last_clean":"2023-08-09T12:40:41.726922+0000","last_became_active":"2023-08-09T12:40:41.725861+0000","last_became_peered":"2023-08-09T12:40:41.725861+0000","last_unstale":"2023-08-09T12:40:41.726922+0000","last_undegraded":"2023-08-09T12:40:41.726922+0000","last_fullsized":"2023-08-09T12:40:41.726922+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:12:48.064744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723553+0000","last_change":"2023-08-09T12:40:41.722094+0000","last_active":"2023-08-09T12:40:41.723553+0000","last_peered":"2023-08-09T12:40:41.723553+0000","last_clean":"2023-08-09T12:40:41.723553+0000","last_became_active":"2023-08-09T12:40:41.721838+0000","last_became_peered":"2023-08-09T12:40:41.721838+0000","last_unstale":"2023-08-09T12:40:41.723553+0000","last_undegraded":"2023-08-09T12:40:41.723553+0000","last_fullsized":"2023-08-09T12:40:41.723553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:57:00.255590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.735046+0000","last_change":"2023-08-09T12:40:41.734962+0000","last_active":"2023-08-09T12:40:41.735046+0000","last_peered":"2023-08-09T12:40:41.735046+0000","last_clean":"2023-08-09T12:40:41.735046+0000","last_became_active":"2023-08-09T12:40:41.734344+0000","last_became_peered":"2023-08-09T12:40:41.734344+0000","last_unstale":"2023-08-09T12:40:41.735046+0000","last_undegraded":"2023-08-09T12:40:41.735046+0000","last_fullsized":"2023-08-09T12:40:41.735046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:29:07.695784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723373+0000","last_change":"2023-08-09T12:40:41.722620+0000","last_active":"2023-08-09T12:40:41.723373+0000","last_peered":"2023-08-09T12:40:41.723373+0000","last_clean":"2023-08-09T12:40:41.723373+0000","last_became_active":"2023-08-09T12:40:41.722230+0000","last_became_peered":"2023-08-09T12:40:41.722230+0000","last_unstale":"2023-08-09T12:40:41.723373+0000","last_undegraded":"2023-08-09T12:40:41.723373+0000","last_fullsized":"2023-08-09T12:40:41.723373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:18.029300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728546+0000","last_change":"2023-08-09T12:40:41.723380+0000","last_active":"2023-08-09T12:40:41.728546+0000","last_peered":"2023-08-09T12:40:41.728546+0000","last_clean":"2023-08-09T12:40:41.728546+0000","last_became_active":"2023-08-09T12:40:41.723070+0000","last_became_peered":"2023-08-09T12:40:41.723070+0000","last_unstale":"2023-08-09T12:40:41.728546+0000","last_undegraded":"2023-08-09T12:40:41.728546+0000","last_fullsized":"2023-08-09T12:40:41.728546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:10.120886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728099+0000","last_change":"2023-08-09T12:40:41.727989+0000","last_active":"2023-08-09T12:40:41.728099+0000","last_peered":"2023-08-09T12:40:41.728099+0000","last_clean":"2023-08-09T12:40:41.728099+0000","last_became_active":"2023-08-09T12:40:41.727616+0000","last_became_peered":"2023-08-09T12:40:41.727616+0000","last_unstale":"2023-08-09T12:40:41.728099+0000","last_undegraded":"2023-08-09T12:40:41.728099+0000","last_fullsized":"2023-08-09T12:40:41.728099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:29:24.489108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.722725+0000","last_change":"2023-08-09T12:40:41.722621+0000","last_active":"2023-08-09T12:40:41.722725+0000","last_peered":"2023-08-09T12:40:41.722725+0000","last_clean":"2023-08-09T12:40:41.722725+0000","last_became_active":"2023-08-09T12:40:41.722393+0000","last_became_peered":"2023-08-09T12:40:41.722393+0000","last_unstale":"2023-08-09T12:40:41.722725+0000","last_undegraded":"2023-08-09T12:40:41.722725+0000","last_fullsized":"2023-08-09T12:40:41.722725+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:15:39.945454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728653+0000","last_change":"2023-08-09T12:40:41.728296+0000","last_active":"2023-08-09T12:40:41.728653+0000","last_peered":"2023-08-09T12:40:41.728653+0000","last_clean":"2023-08-09T12:40:41.728653+0000","last_became_active":"2023-08-09T12:40:41.727711+0000","last_became_peered":"2023-08-09T12:40:41.727711+0000","last_unstale":"2023-08-09T12:40:41.728653+0000","last_undegraded":"2023-08-09T12:40:41.728653+0000","last_fullsized":"2023-08-09T12:40:41.728653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:37:19.646777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.722724+0000","last_change":"2023-08-09T12:40:41.722620+0000","last_active":"2023-08-09T12:40:41.722724+0000","last_peered":"2023-08-09T12:40:41.722724+0000","last_clean":"2023-08-09T12:40:41.722724+0000","last_became_active":"2023-08-09T12:40:41.721627+0000","last_became_peered":"2023-08-09T12:40:41.721627+0000","last_unstale":"2023-08-09T12:40:41.722724+0000","last_undegraded":"2023-08-09T12:40:41.722724+0000","last_fullsized":"2023-08-09T12:40:41.722724+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:14:15.176206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723109+0000","last_change":"2023-08-09T12:40:41.722326+0000","last_active":"2023-08-09T12:40:41.723109+0000","last_peered":"2023-08-09T12:40:41.723109+0000","last_clean":"2023-08-09T12:40:41.723109+0000","last_became_active":"2023-08-09T12:40:41.719498+0000","last_became_peered":"2023-08-09T12:40:41.719498+0000","last_unstale":"2023-08-09T12:40:41.723109+0000","last_undegraded":"2023-08-09T12:40:41.723109+0000","last_fullsized":"2023-08-09T12:40:41.723109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:39:51.958086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723250+0000","last_change":"2023-08-09T12:40:41.723140+0000","last_active":"2023-08-09T12:40:41.723250+0000","last_peered":"2023-08-09T12:40:41.723250+0000","last_clean":"2023-08-09T12:40:41.723250+0000","last_became_active":"2023-08-09T12:40:41.722780+0000","last_became_peered":"2023-08-09T12:40:41.722780+0000","last_unstale":"2023-08-09T12:40:41.723250+0000","last_undegraded":"2023-08-09T12:40:41.723250+0000","last_fullsized":"2023-08-09T12:40:41.723250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:17:24.829466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716259+0000","last_change":"2023-08-09T12:40:41.716167+0000","last_active":"2023-08-09T12:40:41.716259+0000","last_peered":"2023-08-09T12:40:41.716259+0000","last_clean":"2023-08-09T12:40:41.716259+0000","last_became_active":"2023-08-09T12:40:41.715540+0000","last_became_peered":"2023-08-09T12:40:41.715540+0000","last_unstale":"2023-08-09T12:40:41.716259+0000","last_undegraded":"2023-08-09T12:40:41.716259+0000","last_fullsized":"2023-08-09T12:40:41.716259+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:09:49.855456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203882+0000","last_change":"2023-08-09T12:40:41.730732+0000","last_active":"2023-08-09T12:40:44.203882+0000","last_peered":"2023-08-09T12:40:44.203882+0000","last_clean":"2023-08-09T12:40:44.203882+0000","last_became_active":"2023-08-09T12:40:41.730581+0000","last_became_peered":"2023-08-09T12:40:41.730581+0000","last_unstale":"2023-08-09T12:40:44.203882+0000","last_undegraded":"2023-08-09T12:40:44.203882+0000","last_fullsized":"2023-08-09T12:40:44.203882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:18.029300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.721483+0000","last_change":"2023-08-09T12:40:41.721378+0000","last_active":"2023-08-09T12:40:41.721483+0000","last_peered":"2023-08-09T12:40:41.721483+0000","last_clean":"2023-08-09T12:40:41.721483+0000","last_became_active":"2023-08-09T12:40:41.721064+0000","last_became_peered":"2023-08-09T12:40:41.721064+0000","last_unstale":"2023-08-09T12:40:41.721483+0000","last_undegraded":"2023-08-09T12:40:41.721483+0000","last_fullsized":"2023-08-09T12:40:41.721483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:40:11.371677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.722192+0000","last_change":"2023-08-09T12:40:41.720731+0000","last_active":"2023-08-09T12:40:41.722192+0000","last_peered":"2023-08-09T12:40:41.722192+0000","last_clean":"2023-08-09T12:40:41.722192+0000","last_became_active":"2023-08-09T12:40:41.720283+0000","last_became_peered":"2023-08-09T12:40:41.720283+0000","last_unstale":"2023-08-09T12:40:41.722192+0000","last_undegraded":"2023-08-09T12:40:41.722192+0000","last_fullsized":"2023-08-09T12:40:41.722192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:42.760968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.729760+0000","last_change":"2023-08-09T12:40:41.729685+0000","last_active":"2023-08-09T12:40:41.729760+0000","last_peered":"2023-08-09T12:40:41.729760+0000","last_clean":"2023-08-09T12:40:41.729760+0000","last_became_active":"2023-08-09T12:40:41.729453+0000","last_became_peered":"2023-08-09T12:40:41.729453+0000","last_unstale":"2023-08-09T12:40:41.729760+0000","last_undegraded":"2023-08-09T12:40:41.729760+0000","last_fullsized":"2023-08-09T12:40:41.729760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:57.421107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716241+0000","last_change":"2023-08-09T12:40:41.715872+0000","last_active":"2023-08-09T12:40:41.716241+0000","last_peered":"2023-08-09T12:40:41.716241+0000","last_clean":"2023-08-09T12:40:41.716241+0000","last_became_active":"2023-08-09T12:40:41.714991+0000","last_became_peered":"2023-08-09T12:40:41.714991+0000","last_unstale":"2023-08-09T12:40:41.716241+0000","last_undegraded":"2023-08-09T12:40:41.716241+0000","last_fullsized":"2023-08-09T12:40:41.716241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:04.836591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732031+0000","last_change":"2023-08-09T12:40:41.728131+0000","last_active":"2023-08-09T12:40:41.732031+0000","last_peered":"2023-08-09T12:40:41.732031+0000","last_clean":"2023-08-09T12:40:41.732031+0000","last_became_active":"2023-08-09T12:40:41.718552+0000","last_became_peered":"2023-08-09T12:40:41.718552+0000","last_unstale":"2023-08-09T12:40:41.732031+0000","last_undegraded":"2023-08-09T12:40:41.732031+0000","last_fullsized":"2023-08-09T12:40:41.732031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:01.603786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203352+0000","last_change":"2023-08-09T12:40:41.727212+0000","last_active":"2023-08-09T12:40:44.203352+0000","last_peered":"2023-08-09T12:40:44.203352+0000","last_clean":"2023-08-09T12:40:44.203352+0000","last_became_active":"2023-08-09T12:40:41.726643+0000","last_became_peered":"2023-08-09T12:40:41.726643+0000","last_unstale":"2023-08-09T12:40:44.203352+0000","last_undegraded":"2023-08-09T12:40:44.203352+0000","last_fullsized":"2023-08-09T12:40:44.203352+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:06.597719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.734812+0000","last_change":"2023-08-09T12:40:41.734725+0000","last_active":"2023-08-09T12:40:41.734812+0000","last_peered":"2023-08-09T12:40:41.734812+0000","last_clean":"2023-08-09T12:40:41.734812+0000","last_became_active":"2023-08-09T12:40:41.733962+0000","last_became_peered":"2023-08-09T12:40:41.733962+0000","last_unstale":"2023-08-09T12:40:41.734812+0000","last_undegraded":"2023-08-09T12:40:41.734812+0000","last_fullsized":"2023-08-09T12:40:41.734812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:23:47.307786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.738782+0000","last_change":"2023-08-09T12:40:40.715354+0000","last_active":"2023-08-09T12:40:41.738782+0000","last_peered":"2023-08-09T12:40:41.738782+0000","last_clean":"2023-08-09T12:40:41.738782+0000","last_became_active":"2023-08-09T12:40:40.715093+0000","last_became_peered":"2023-08-09T12:40:40.715093+0000","last_unstale":"2023-08-09T12:40:41.738782+0000","last_undegraded":"2023-08-09T12:40:41.738782+0000","last_fullsized":"2023-08-09T12:40:41.738782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:58:39.091519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203643+0000","last_change":"2023-08-09T12:40:41.729964+0000","last_active":"2023-08-09T12:40:44.203643+0000","last_peered":"2023-08-09T12:40:44.203643+0000","last_clean":"2023-08-09T12:40:44.203643+0000","last_became_active":"2023-08-09T12:40:41.729571+0000","last_became_peered":"2023-08-09T12:40:41.729571+0000","last_unstale":"2023-08-09T12:40:44.203643+0000","last_undegraded":"2023-08-09T12:40:44.203643+0000","last_fullsized":"2023-08-09T12:40:44.203643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:30.315499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.912430+0000","last_change":"2023-08-09T12:40:40.716868+0000","last_active":"2023-08-09T12:40:43.912430+0000","last_peered":"2023-08-09T12:40:43.912430+0000","last_clean":"2023-08-09T12:40:43.912430+0000","last_became_active":"2023-08-09T12:40:40.716502+0000","last_became_peered":"2023-08-09T12:40:40.716502+0000","last_unstale":"2023-08-09T12:40:43.912430+0000","last_undegraded":"2023-08-09T12:40:43.912430+0000","last_fullsized":"2023-08-09T12:40:43.912430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:02:52.678732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726895+0000","last_change":"2023-08-09T12:40:41.726211+0000","last_active":"2023-08-09T12:40:41.726895+0000","last_peered":"2023-08-09T12:40:41.726895+0000","last_clean":"2023-08-09T12:40:41.726895+0000","last_became_active":"2023-08-09T12:40:41.725443+0000","last_became_peered":"2023-08-09T12:40:41.725443+0000","last_unstale":"2023-08-09T12:40:41.726895+0000","last_undegraded":"2023-08-09T12:40:41.726895+0000","last_fullsized":"2023-08-09T12:40:41.726895+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:39:51.958086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203920+0000","last_change":"2023-08-09T12:40:40.721545+0000","last_active":"2023-08-09T12:40:44.203920+0000","last_peered":"2023-08-09T12:40:44.203920+0000","last_clean":"2023-08-09T12:40:44.203920+0000","last_became_active":"2023-08-09T12:40:40.720757+0000","last_became_peered":"2023-08-09T12:40:40.720757+0000","last_unstale":"2023-08-09T12:40:44.203920+0000","last_undegraded":"2023-08-09T12:40:44.203920+0000","last_fullsized":"2023-08-09T12:40:44.203920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:00:25.184442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726207+0000","last_change":"2023-08-09T12:40:41.725847+0000","last_active":"2023-08-09T12:40:41.726207+0000","last_peered":"2023-08-09T12:40:41.726207+0000","last_clean":"2023-08-09T12:40:41.726207+0000","last_became_active":"2023-08-09T12:40:41.725396+0000","last_became_peered":"2023-08-09T12:40:41.725396+0000","last_unstale":"2023-08-09T12:40:41.726207+0000","last_undegraded":"2023-08-09T12:40:41.726207+0000","last_fullsized":"2023-08-09T12:40:41.726207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:54.518860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.731174+0000","last_change":"2023-08-09T12:40:40.713746+0000","last_active":"2023-08-09T12:40:41.731174+0000","last_peered":"2023-08-09T12:40:41.731174+0000","last_clean":"2023-08-09T12:40:41.731174+0000","last_became_active":"2023-08-09T12:40:40.713425+0000","last_became_peered":"2023-08-09T12:40:40.713425+0000","last_unstale":"2023-08-09T12:40:41.731174+0000","last_undegraded":"2023-08-09T12:40:41.731174+0000","last_fullsized":"2023-08-09T12:40:41.731174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:06.823137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.912273+0000","last_change":"2023-08-09T12:40:41.728515+0000","last_active":"2023-08-09T12:40:43.912273+0000","last_peered":"2023-08-09T12:40:43.912273+0000","last_clean":"2023-08-09T12:40:43.912273+0000","last_became_active":"2023-08-09T12:40:41.728283+0000","last_became_peered":"2023-08-09T12:40:41.728283+0000","last_unstale":"2023-08-09T12:40:43.912273+0000","last_undegraded":"2023-08-09T12:40:43.912273+0000","last_fullsized":"2023-08-09T12:40:43.912273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:06.597719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730718+0000","last_change":"2023-08-09T12:40:40.723569+0000","last_active":"2023-08-09T12:40:41.730718+0000","last_peered":"2023-08-09T12:40:41.730718+0000","last_clean":"2023-08-09T12:40:41.730718+0000","last_became_active":"2023-08-09T12:40:40.722501+0000","last_became_peered":"2023-08-09T12:40:40.722501+0000","last_unstale":"2023-08-09T12:40:41.730718+0000","last_undegraded":"2023-08-09T12:40:41.730718+0000","last_fullsized":"2023-08-09T12:40:41.730718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:32.523017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730365+0000","last_change":"2023-08-09T12:40:41.729903+0000","last_active":"2023-08-09T12:40:41.730365+0000","last_peered":"2023-08-09T12:40:41.730365+0000","last_clean":"2023-08-09T12:40:41.730365+0000","last_became_active":"2023-08-09T12:40:41.729383+0000","last_became_peered":"2023-08-09T12:40:41.729383+0000","last_unstale":"2023-08-09T12:40:41.730365+0000","last_undegraded":"2023-08-09T12:40:41.730365+0000","last_fullsized":"2023-08-09T12:40:41.730365+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:23.809832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.739071+0000","last_change":"2023-08-09T12:40:40.718111+0000","last_active":"2023-08-09T12:40:41.739071+0000","last_peered":"2023-08-09T12:40:41.739071+0000","last_clean":"2023-08-09T12:40:41.739071+0000","last_became_active":"2023-08-09T12:40:40.717827+0000","last_became_peered":"2023-08-09T12:40:40.717827+0000","last_unstale":"2023-08-09T12:40:41.739071+0000","last_undegraded":"2023-08-09T12:40:41.739071+0000","last_fullsized":"2023-08-09T12:40:41.739071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:37:18.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.738933+0000","last_change":"2023-08-09T12:40:41.738835+0000","last_active":"2023-08-09T12:40:41.738933+0000","last_peered":"2023-08-09T12:40:41.738933+0000","last_clean":"2023-08-09T12:40:41.738933+0000","last_became_active":"2023-08-09T12:40:41.737538+0000","last_became_peered":"2023-08-09T12:40:41.737538+0000","last_unstale":"2023-08-09T12:40:41.738933+0000","last_undegraded":"2023-08-09T12:40:41.738933+0000","last_fullsized":"2023-08-09T12:40:41.738933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:02.722239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203239+0000","last_change":"2023-08-09T12:40:40.721248+0000","last_active":"2023-08-09T12:40:44.203239+0000","last_peered":"2023-08-09T12:40:44.203239+0000","last_clean":"2023-08-09T12:40:44.203239+0000","last_became_active":"2023-08-09T12:40:40.720933+0000","last_became_peered":"2023-08-09T12:40:40.720933+0000","last_unstale":"2023-08-09T12:40:44.203239+0000","last_undegraded":"2023-08-09T12:40:44.203239+0000","last_fullsized":"2023-08-09T12:40:44.203239+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:57.149329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.708037+0000","last_change":"2023-08-09T12:40:41.705781+0000","last_active":"2023-08-09T12:40:41.708037+0000","last_peered":"2023-08-09T12:40:41.708037+0000","last_clean":"2023-08-09T12:40:41.708037+0000","last_became_active":"2023-08-09T12:40:41.705537+0000","last_became_peered":"2023-08-09T12:40:41.705537+0000","last_unstale":"2023-08-09T12:40:41.708037+0000","last_undegraded":"2023-08-09T12:40:41.708037+0000","last_fullsized":"2023-08-09T12:40:41.708037+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:28:35.562737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716948+0000","last_change":"2023-08-09T12:40:40.720171+0000","last_active":"2023-08-09T12:40:41.716948+0000","last_peered":"2023-08-09T12:40:41.716948+0000","last_clean":"2023-08-09T12:40:41.716948+0000","last_became_active":"2023-08-09T12:40:40.719797+0000","last_became_peered":"2023-08-09T12:40:40.719797+0000","last_unstale":"2023-08-09T12:40:41.716948+0000","last_undegraded":"2023-08-09T12:40:41.716948+0000","last_fullsized":"2023-08-09T12:40:41.716948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:26:31.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720269+0000","last_change":"2023-08-09T12:40:41.720003+0000","last_active":"2023-08-09T12:40:41.720269+0000","last_peered":"2023-08-09T12:40:41.720269+0000","last_clean":"2023-08-09T12:40:41.720269+0000","last_became_active":"2023-08-09T12:40:41.719288+0000","last_became_peered":"2023-08-09T12:40:41.719288+0000","last_unstale":"2023-08-09T12:40:41.720269+0000","last_undegraded":"2023-08-09T12:40:41.720269+0000","last_fullsized":"2023-08-09T12:40:41.720269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:28:25.800859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.700909+0000","last_change":"2023-08-09T12:40:40.715816+0000","last_active":"2023-08-09T12:40:41.700909+0000","last_peered":"2023-08-09T12:40:41.700909+0000","last_clean":"2023-08-09T12:40:41.700909+0000","last_became_active":"2023-08-09T12:40:40.715476+0000","last_became_peered":"2023-08-09T12:40:40.715476+0000","last_unstale":"2023-08-09T12:40:41.700909+0000","last_undegraded":"2023-08-09T12:40:41.700909+0000","last_fullsized":"2023-08-09T12:40:41.700909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:59.220107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.724630+0000","last_change":"2023-08-09T12:40:41.724541+0000","last_active":"2023-08-09T12:40:41.724630+0000","last_peered":"2023-08-09T12:40:41.724630+0000","last_clean":"2023-08-09T12:40:41.724630+0000","last_became_active":"2023-08-09T12:40:41.724262+0000","last_became_peered":"2023-08-09T12:40:41.724262+0000","last_unstale":"2023-08-09T12:40:41.724630+0000","last_undegraded":"2023-08-09T12:40:41.724630+0000","last_fullsized":"2023-08-09T12:40:41.724630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:45:11.303794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716390+0000","last_change":"2023-08-09T12:40:40.723734+0000","last_active":"2023-08-09T12:40:41.716390+0000","last_peered":"2023-08-09T12:40:41.716390+0000","last_clean":"2023-08-09T12:40:41.716390+0000","last_became_active":"2023-08-09T12:40:40.722863+0000","last_became_peered":"2023-08-09T12:40:40.722863+0000","last_unstale":"2023-08-09T12:40:41.716390+0000","last_undegraded":"2023-08-09T12:40:41.716390+0000","last_fullsized":"2023-08-09T12:40:41.716390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:06:33.331130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.911831+0000","last_change":"2023-08-09T12:40:41.713243+0000","last_active":"2023-08-09T12:40:43.911831+0000","last_peered":"2023-08-09T12:40:43.911831+0000","last_clean":"2023-08-09T12:40:43.911831+0000","last_became_active":"2023-08-09T12:40:41.712982+0000","last_became_peered":"2023-08-09T12:40:41.712982+0000","last_unstale":"2023-08-09T12:40:43.911831+0000","last_undegraded":"2023-08-09T12:40:43.911831+0000","last_fullsized":"2023-08-09T12:40:43.911831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:27:10.796667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.735233+0000","last_change":"2023-08-09T12:40:40.720289+0000","last_active":"2023-08-09T12:40:41.735233+0000","last_peered":"2023-08-09T12:40:41.735233+0000","last_clean":"2023-08-09T12:40:41.735233+0000","last_became_active":"2023-08-09T12:40:40.719047+0000","last_became_peered":"2023-08-09T12:40:40.719047+0000","last_unstale":"2023-08-09T12:40:41.735233+0000","last_undegraded":"2023-08-09T12:40:41.735233+0000","last_fullsized":"2023-08-09T12:40:41.735233+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:02:52.678732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720328+0000","last_change":"2023-08-09T12:40:41.720182+0000","last_active":"2023-08-09T12:40:41.720328+0000","last_peered":"2023-08-09T12:40:41.720328+0000","last_clean":"2023-08-09T12:40:41.720328+0000","last_became_active":"2023-08-09T12:40:41.719485+0000","last_became_peered":"2023-08-09T12:40:41.719485+0000","last_unstale":"2023-08-09T12:40:41.720328+0000","last_undegraded":"2023-08-09T12:40:41.720328+0000","last_fullsized":"2023-08-09T12:40:41.720328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:23:47.307786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732937+0000","last_change":"2023-08-09T12:40:40.701517+0000","last_active":"2023-08-09T12:40:41.732937+0000","last_peered":"2023-08-09T12:40:41.732937+0000","last_clean":"2023-08-09T12:40:41.732937+0000","last_became_active":"2023-08-09T12:40:40.701278+0000","last_became_peered":"2023-08-09T12:40:40.701278+0000","last_unstale":"2023-08-09T12:40:41.732937+0000","last_undegraded":"2023-08-09T12:40:41.732937+0000","last_fullsized":"2023-08-09T12:40:41.732937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:15:02.881774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.911966+0000","last_change":"2023-08-09T12:40:41.721467+0000","last_active":"2023-08-09T12:40:43.911966+0000","last_peered":"2023-08-09T12:40:43.911966+0000","last_clean":"2023-08-09T12:40:43.911966+0000","last_became_active":"2023-08-09T12:40:41.720710+0000","last_became_peered":"2023-08-09T12:40:41.720710+0000","last_unstale":"2023-08-09T12:40:43.911966+0000","last_undegraded":"2023-08-09T12:40:43.911966+0000","last_fullsized":"2023-08-09T12:40:43.911966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:23.809832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.717803+0000","last_change":"2023-08-09T12:40:40.708269+0000","last_active":"2023-08-09T12:40:41.717803+0000","last_peered":"2023-08-09T12:40:41.717803+0000","last_clean":"2023-08-09T12:40:41.717803+0000","last_became_active":"2023-08-09T12:40:40.708006+0000","last_became_peered":"2023-08-09T12:40:40.708006+0000","last_unstale":"2023-08-09T12:40:41.717803+0000","last_undegraded":"2023-08-09T12:40:41.717803+0000","last_fullsized":"2023-08-09T12:40:41.717803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:27:09.782457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.712593+0000","last_change":"2023-08-09T12:40:41.712216+0000","last_active":"2023-08-09T12:40:41.712593+0000","last_peered":"2023-08-09T12:40:41.712593+0000","last_clean":"2023-08-09T12:40:41.712593+0000","last_became_active":"2023-08-09T12:40:41.711886+0000","last_became_peered":"2023-08-09T12:40:41.711886+0000","last_unstale":"2023-08-09T12:40:41.712593+0000","last_undegraded":"2023-08-09T12:40:41.712593+0000","last_fullsized":"2023-08-09T12:40:41.712593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:42.760968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.204171+0000","last_change":"2023-08-09T12:40:40.721968+0000","last_active":"2023-08-09T12:40:44.204171+0000","last_peered":"2023-08-09T12:40:44.204171+0000","last_clean":"2023-08-09T12:40:44.204171+0000","last_became_active":"2023-08-09T12:40:40.721700+0000","last_became_peered":"2023-08-09T12:40:40.721700+0000","last_unstale":"2023-08-09T12:40:44.204171+0000","last_undegraded":"2023-08-09T12:40:44.204171+0000","last_fullsized":"2023-08-09T12:40:44.204171+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:37:18.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732318+0000","last_change":"2023-08-09T12:40:41.732203+0000","last_active":"2023-08-09T12:40:41.732318+0000","last_peered":"2023-08-09T12:40:41.732318+0000","last_clean":"2023-08-09T12:40:41.732318+0000","last_became_active":"2023-08-09T12:40:41.719580+0000","last_became_peered":"2023-08-09T12:40:41.719580+0000","last_unstale":"2023-08-09T12:40:41.732318+0000","last_undegraded":"2023-08-09T12:40:41.732318+0000","last_fullsized":"2023-08-09T12:40:41.732318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:21:17.060601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.708657+0000","last_change":"2023-08-09T12:40:40.716812+0000","last_active":"2023-08-09T12:40:41.708657+0000","last_peered":"2023-08-09T12:40:41.708657+0000","last_clean":"2023-08-09T12:40:41.708657+0000","last_became_active":"2023-08-09T12:40:40.716568+0000","last_became_peered":"2023-08-09T12:40:40.716568+0000","last_unstale":"2023-08-09T12:40:41.708657+0000","last_undegraded":"2023-08-09T12:40:41.708657+0000","last_fullsized":"2023-08-09T12:40:41.708657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:34:52.886963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.712612+0000","last_change":"2023-08-09T12:40:41.712519+0000","last_active":"2023-08-09T12:40:41.712612+0000","last_peered":"2023-08-09T12:40:41.712612+0000","last_clean":"2023-08-09T12:40:41.712612+0000","last_became_active":"2023-08-09T12:40:41.712290+0000","last_became_peered":"2023-08-09T12:40:41.712290+0000","last_unstale":"2023-08-09T12:40:41.712612+0000","last_undegraded":"2023-08-09T12:40:41.712612+0000","last_fullsized":"2023-08-09T12:40:41.712612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:04:33.339026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.738965+0000","last_change":"2023-08-09T12:40:40.714034+0000","last_active":"2023-08-09T12:40:41.738965+0000","last_peered":"2023-08-09T12:40:41.738965+0000","last_clean":"2023-08-09T12:40:41.738965+0000","last_became_active":"2023-08-09T12:40:40.713704+0000","last_became_peered":"2023-08-09T12:40:40.713704+0000","last_unstale":"2023-08-09T12:40:41.738965+0000","last_undegraded":"2023-08-09T12:40:41.738965+0000","last_fullsized":"2023-08-09T12:40:41.738965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:14:14.161996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726223+0000","last_change":"2023-08-09T12:40:41.725936+0000","last_active":"2023-08-09T12:40:41.726223+0000","last_peered":"2023-08-09T12:40:41.726223+0000","last_clean":"2023-08-09T12:40:41.726223+0000","last_became_active":"2023-08-09T12:40:41.725666+0000","last_became_peered":"2023-08-09T12:40:41.725666+0000","last_unstale":"2023-08-09T12:40:41.726223+0000","last_undegraded":"2023-08-09T12:40:41.726223+0000","last_fullsized":"2023-08-09T12:40:41.726223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:23.809832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.736503+0000","last_change":"2023-08-09T12:40:40.721673+0000","last_active":"2023-08-09T12:40:41.736503+0000","last_peered":"2023-08-09T12:40:41.736503+0000","last_clean":"2023-08-09T12:40:41.736503+0000","last_became_active":"2023-08-09T12:40:40.721337+0000","last_became_peered":"2023-08-09T12:40:40.721337+0000","last_unstale":"2023-08-09T12:40:41.736503+0000","last_undegraded":"2023-08-09T12:40:41.736503+0000","last_fullsized":"2023-08-09T12:40:41.736503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:57.149329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730390+0000","last_change":"2023-08-09T12:40:41.728438+0000","last_active":"2023-08-09T12:40:41.730390+0000","last_peered":"2023-08-09T12:40:41.730390+0000","last_clean":"2023-08-09T12:40:41.730390+0000","last_became_active":"2023-08-09T12:40:41.728041+0000","last_became_peered":"2023-08-09T12:40:41.728041+0000","last_unstale":"2023-08-09T12:40:41.730390+0000","last_undegraded":"2023-08-09T12:40:41.730390+0000","last_fullsized":"2023-08-09T12:40:41.730390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:18.029300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.736154+0000","last_change":"2023-08-09T12:40:40.721886+0000","last_active":"2023-08-09T12:40:41.736154+0000","last_peered":"2023-08-09T12:40:41.736154+0000","last_clean":"2023-08-09T12:40:41.736154+0000","last_became_active":"2023-08-09T12:40:40.721264+0000","last_became_peered":"2023-08-09T12:40:40.721264+0000","last_unstale":"2023-08-09T12:40:41.736154+0000","last_undegraded":"2023-08-09T12:40:41.736154+0000","last_fullsized":"2023-08-09T12:40:41.736154+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:02:01.785489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730789+0000","last_change":"2023-08-09T12:40:41.730672+0000","last_active":"2023-08-09T12:40:41.730789+0000","last_peered":"2023-08-09T12:40:41.730789+0000","last_clean":"2023-08-09T12:40:41.730789+0000","last_became_active":"2023-08-09T12:40:41.730464+0000","last_became_peered":"2023-08-09T12:40:41.730464+0000","last_unstale":"2023-08-09T12:40:41.730789+0000","last_undegraded":"2023-08-09T12:40:41.730789+0000","last_fullsized":"2023-08-09T12:40:41.730789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:21:17.060601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.722783+0000","last_change":"2023-08-09T12:40:40.716595+0000","last_active":"2023-08-09T12:40:41.722783+0000","last_peered":"2023-08-09T12:40:41.722783+0000","last_clean":"2023-08-09T12:40:41.722783+0000","last_became_active":"2023-08-09T12:40:40.716375+0000","last_became_peered":"2023-08-09T12:40:40.716375+0000","last_unstale":"2023-08-09T12:40:41.722783+0000","last_undegraded":"2023-08-09T12:40:41.722783+0000","last_fullsized":"2023-08-09T12:40:41.722783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:38:58.901244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.711804+0000","last_change":"2023-08-09T12:40:41.711692+0000","last_active":"2023-08-09T12:40:41.711804+0000","last_peered":"2023-08-09T12:40:41.711804+0000","last_clean":"2023-08-09T12:40:41.711804+0000","last_became_active":"2023-08-09T12:40:41.711458+0000","last_became_peered":"2023-08-09T12:40:41.711458+0000","last_unstale":"2023-08-09T12:40:41.711804+0000","last_undegraded":"2023-08-09T12:40:41.711804+0000","last_fullsized":"2023-08-09T12:40:41.711804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:51.606272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203662+0000","last_change":"2023-08-09T12:40:40.719109+0000","last_active":"2023-08-09T12:40:44.203662+0000","last_peered":"2023-08-09T12:40:44.203662+0000","last_clean":"2023-08-09T12:40:44.203662+0000","last_became_active":"2023-08-09T12:40:40.718822+0000","last_became_peered":"2023-08-09T12:40:40.718822+0000","last_unstale":"2023-08-09T12:40:44.203662+0000","last_undegraded":"2023-08-09T12:40:44.203662+0000","last_fullsized":"2023-08-09T12:40:44.203662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:32.523017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.732711+0000","last_change":"2023-08-09T12:40:41.732468+0000","last_active":"2023-08-09T12:40:41.732711+0000","last_peered":"2023-08-09T12:40:41.732711+0000","last_clean":"2023-08-09T12:40:41.732711+0000","last_became_active":"2023-08-09T12:40:41.720508+0000","last_became_peered":"2023-08-09T12:40:41.720508+0000","last_unstale":"2023-08-09T12:40:41.732711+0000","last_undegraded":"2023-08-09T12:40:41.732711+0000","last_fullsized":"2023-08-09T12:40:41.732711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:07.837347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.718501+0000","last_change":"2023-08-09T12:40:40.712539+0000","last_active":"2023-08-09T12:40:41.718501+0000","last_peered":"2023-08-09T12:40:41.718501+0000","last_clean":"2023-08-09T12:40:41.718501+0000","last_became_active":"2023-08-09T12:40:40.711884+0000","last_became_peered":"2023-08-09T12:40:40.711884+0000","last_unstale":"2023-08-09T12:40:41.718501+0000","last_undegraded":"2023-08-09T12:40:41.718501+0000","last_fullsized":"2023-08-09T12:40:41.718501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:11:57.216279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.912621+0000","last_change":"2023-08-09T12:40:41.713155+0000","last_active":"2023-08-09T12:40:43.912621+0000","last_peered":"2023-08-09T12:40:43.912621+0000","last_clean":"2023-08-09T12:40:43.912621+0000","last_became_active":"2023-08-09T12:40:41.712918+0000","last_became_peered":"2023-08-09T12:40:41.712918+0000","last_unstale":"2023-08-09T12:40:43.912621+0000","last_undegraded":"2023-08-09T12:40:43.912621+0000","last_fullsized":"2023-08-09T12:40:43.912621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:30.315499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.706911+0000","last_change":"2023-08-09T12:40:40.714241+0000","last_active":"2023-08-09T12:40:41.706911+0000","last_peered":"2023-08-09T12:40:41.706911+0000","last_clean":"2023-08-09T12:40:41.706911+0000","last_became_active":"2023-08-09T12:40:40.713614+0000","last_became_peered":"2023-08-09T12:40:40.713614+0000","last_unstale":"2023-08-09T12:40:41.706911+0000","last_undegraded":"2023-08-09T12:40:41.706911+0000","last_fullsized":"2023-08-09T12:40:41.706911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:41:56.789039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.725219+0000","last_change":"2023-08-09T12:40:41.725132+0000","last_active":"2023-08-09T12:40:41.725219+0000","last_peered":"2023-08-09T12:40:41.725219+0000","last_clean":"2023-08-09T12:40:41.725219+0000","last_became_active":"2023-08-09T12:40:41.724901+0000","last_became_peered":"2023-08-09T12:40:41.724901+0000","last_unstale":"2023-08-09T12:40:41.725219+0000","last_undegraded":"2023-08-09T12:40:41.725219+0000","last_fullsized":"2023-08-09T12:40:41.725219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:27:10.796667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.698982+0000","last_change":"2023-08-09T12:40:40.701004+0000","last_active":"2023-08-09T12:40:41.698982+0000","last_peered":"2023-08-09T12:40:41.698982+0000","last_clean":"2023-08-09T12:40:41.698982+0000","last_became_active":"2023-08-09T12:40:40.700293+0000","last_became_peered":"2023-08-09T12:40:40.700293+0000","last_unstale":"2023-08-09T12:40:41.698982+0000","last_undegraded":"2023-08-09T12:40:41.698982+0000","last_fullsized":"2023-08-09T12:40:41.698982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:06:33.331130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.705215+0000","last_change":"2023-08-09T12:40:41.705122+0000","last_active":"2023-08-09T12:40:41.705215+0000","last_peered":"2023-08-09T12:40:41.705215+0000","last_clean":"2023-08-09T12:40:41.705215+0000","last_became_active":"2023-08-09T12:40:41.704863+0000","last_became_peered":"2023-08-09T12:40:41.704863+0000","last_unstale":"2023-08-09T12:40:41.705215+0000","last_undegraded":"2023-08-09T12:40:41.705215+0000","last_fullsized":"2023-08-09T12:40:41.705215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:31:01.896896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.707898+0000","last_change":"2023-08-09T12:40:40.709014+0000","last_active":"2023-08-09T12:40:41.707898+0000","last_peered":"2023-08-09T12:40:41.707898+0000","last_clean":"2023-08-09T12:40:41.707898+0000","last_became_active":"2023-08-09T12:40:40.708776+0000","last_became_peered":"2023-08-09T12:40:40.708776+0000","last_unstale":"2023-08-09T12:40:41.707898+0000","last_undegraded":"2023-08-09T12:40:41.707898+0000","last_fullsized":"2023-08-09T12:40:41.707898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:03.822381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.728610+0000","last_change":"2023-08-09T12:40:41.727588+0000","last_active":"2023-08-09T12:40:41.728610+0000","last_peered":"2023-08-09T12:40:41.728610+0000","last_clean":"2023-08-09T12:40:41.728610+0000","last_became_active":"2023-08-09T12:40:41.726821+0000","last_became_peered":"2023-08-09T12:40:41.726821+0000","last_unstale":"2023-08-09T12:40:41.728610+0000","last_undegraded":"2023-08-09T12:40:41.728610+0000","last_fullsized":"2023-08-09T12:40:41.728610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:06.597719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.699400+0000","last_change":"2023-08-09T12:40:40.702944+0000","last_active":"2023-08-09T12:40:41.699400+0000","last_peered":"2023-08-09T12:40:41.699400+0000","last_clean":"2023-08-09T12:40:41.699400+0000","last_became_active":"2023-08-09T12:40:40.702327+0000","last_became_peered":"2023-08-09T12:40:40.702327+0000","last_unstale":"2023-08-09T12:40:41.699400+0000","last_undegraded":"2023-08-09T12:40:41.699400+0000","last_fullsized":"2023-08-09T12:40:41.699400+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:00:25.184442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.700502+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:40:41.700502+0000","last_peered":"2023-08-09T12:40:41.700502+0000","last_clean":"2023-08-09T12:40:41.700502+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:40:41.700502+0000","last_undegraded":"2023-08-09T12:40:41.700502+0000","last_fullsized":"2023-08-09T12:40:41.700502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:20.533378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723381+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:40:41.723381+0000","last_peered":"2023-08-09T12:40:41.723381+0000","last_clean":"2023-08-09T12:40:41.723381+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:40:41.723381+0000","last_undegraded":"2023-08-09T12:40:41.723381+0000","last_fullsized":"2023-08-09T12:40:41.723381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:05.831906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203783+0000","last_change":"2023-08-09T12:40:41.729821+0000","last_active":"2023-08-09T12:40:44.203783+0000","last_peered":"2023-08-09T12:40:44.203783+0000","last_clean":"2023-08-09T12:40:44.203783+0000","last_became_active":"2023-08-09T12:40:41.729274+0000","last_became_peered":"2023-08-09T12:40:41.729274+0000","last_unstale":"2023-08-09T12:40:44.203783+0000","last_undegraded":"2023-08-09T12:40:44.203783+0000","last_fullsized":"2023-08-09T12:40:44.203783+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:45:11.303794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.730570+0000","last_change":"2023-08-09T12:40:40.721320+0000","last_active":"2023-08-09T12:40:41.730570+0000","last_peered":"2023-08-09T12:40:41.730570+0000","last_clean":"2023-08-09T12:40:41.730570+0000","last_became_active":"2023-08-09T12:40:40.720285+0000","last_became_peered":"2023-08-09T12:40:40.720285+0000","last_unstale":"2023-08-09T12:40:41.730570+0000","last_undegraded":"2023-08-09T12:40:41.730570+0000","last_fullsized":"2023-08-09T12:40:41.730570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:00:25.184442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.699958+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:40:41.699958+0000","last_peered":"2023-08-09T12:40:41.699958+0000","last_clean":"2023-08-09T12:40:41.699958+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:40:41.699958+0000","last_undegraded":"2023-08-09T12:40:41.699958+0000","last_fullsized":"2023-08-09T12:40:41.699958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:05.831906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.725058+0000","last_change":"2023-08-09T12:40:41.724875+0000","last_active":"2023-08-09T12:40:41.725058+0000","last_peered":"2023-08-09T12:40:41.725058+0000","last_clean":"2023-08-09T12:40:41.725058+0000","last_became_active":"2023-08-09T12:40:41.724147+0000","last_became_peered":"2023-08-09T12:40:41.724147+0000","last_unstale":"2023-08-09T12:40:41.725058+0000","last_undegraded":"2023-08-09T12:40:41.725058+0000","last_fullsized":"2023-08-09T12:40:41.725058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:33.537227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.706631+0000","last_change":"2023-08-09T12:40:40.719789+0000","last_active":"2023-08-09T12:40:41.706631+0000","last_peered":"2023-08-09T12:40:41.706631+0000","last_clean":"2023-08-09T12:40:41.706631+0000","last_became_active":"2023-08-09T12:40:40.719536+0000","last_became_peered":"2023-08-09T12:40:40.719536+0000","last_unstale":"2023-08-09T12:40:41.706631+0000","last_undegraded":"2023-08-09T12:40:41.706631+0000","last_fullsized":"2023-08-09T12:40:41.706631+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:30:50.864610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.706709+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:40:41.706709+0000","last_peered":"2023-08-09T12:40:41.706709+0000","last_clean":"2023-08-09T12:40:41.706709+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:40:41.706709+0000","last_undegraded":"2023-08-09T12:40:41.706709+0000","last_fullsized":"2023-08-09T12:40:41.706709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:54:33.666985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.726190+0000","last_change":"2023-08-09T12:40:41.725676+0000","last_active":"2023-08-09T12:40:41.726190+0000","last_peered":"2023-08-09T12:40:41.726190+0000","last_clean":"2023-08-09T12:40:41.726190+0000","last_became_active":"2023-08-09T12:40:41.725020+0000","last_became_peered":"2023-08-09T12:40:41.725020+0000","last_unstale":"2023-08-09T12:40:41.726190+0000","last_undegraded":"2023-08-09T12:40:41.726190+0000","last_fullsized":"2023-08-09T12:40:41.726190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:14.006945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.912174+0000","last_change":"2023-08-09T12:40:40.711527+0000","last_active":"2023-08-09T12:40:43.912174+0000","last_peered":"2023-08-09T12:40:43.912174+0000","last_clean":"2023-08-09T12:40:43.912174+0000","last_became_active":"2023-08-09T12:40:40.710971+0000","last_became_peered":"2023-08-09T12:40:40.710971+0000","last_unstale":"2023-08-09T12:40:43.912174+0000","last_undegraded":"2023-08-09T12:40:43.912174+0000","last_fullsized":"2023-08-09T12:40:43.912174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:57.149329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.716620+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:40:41.716620+0000","last_peered":"2023-08-09T12:40:41.716620+0000","last_clean":"2023-08-09T12:40:41.716620+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:40:41.716620+0000","last_undegraded":"2023-08-09T12:40:41.716620+0000","last_fullsized":"2023-08-09T12:40:41.716620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:27:45.281230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.911873+0000","last_change":"2023-08-09T12:40:41.712366+0000","last_active":"2023-08-09T12:40:43.911873+0000","last_peered":"2023-08-09T12:40:43.911873+0000","last_clean":"2023-08-09T12:40:43.911873+0000","last_became_active":"2023-08-09T12:40:41.712032+0000","last_became_peered":"2023-08-09T12:40:41.712032+0000","last_unstale":"2023-08-09T12:40:43.911873+0000","last_undegraded":"2023-08-09T12:40:43.911873+0000","last_fullsized":"2023-08-09T12:40:43.911873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:14.006945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:43.912235+0000","last_change":"2023-08-09T12:40:40.712554+0000","last_active":"2023-08-09T12:40:43.912235+0000","last_peered":"2023-08-09T12:40:43.912235+0000","last_clean":"2023-08-09T12:40:43.912235+0000","last_became_active":"2023-08-09T12:40:40.712290+0000","last_became_peered":"2023-08-09T12:40:40.712290+0000","last_unstale":"2023-08-09T12:40:43.912235+0000","last_undegraded":"2023-08-09T12:40:43.912235+0000","last_fullsized":"2023-08-09T12:40:43.912235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:56:59.241380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.204054+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:40:44.204054+0000","last_peered":"2023-08-09T12:40:44.204054+0000","last_clean":"2023-08-09T12:40:44.204054+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:40:44.204054+0000","last_undegraded":"2023-08-09T12:40:44.204054+0000","last_fullsized":"2023-08-09T12:40:44.204054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:27:45.281230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203329+0000","last_change":"2023-08-09T12:40:41.731096+0000","last_active":"2023-08-09T12:40:44.203329+0000","last_peered":"2023-08-09T12:40:44.203329+0000","last_clean":"2023-08-09T12:40:44.203329+0000","last_became_active":"2023-08-09T12:40:41.730921+0000","last_became_peered":"2023-08-09T12:40:41.730921+0000","last_unstale":"2023-08-09T12:40:44.203329+0000","last_undegraded":"2023-08-09T12:40:44.203329+0000","last_fullsized":"2023-08-09T12:40:44.203329+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:57:00.255590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.708973+0000","last_change":"2023-08-09T12:40:40.710209+0000","last_active":"2023-08-09T12:40:41.708973+0000","last_peered":"2023-08-09T12:40:41.708973+0000","last_clean":"2023-08-09T12:40:41.708973+0000","last_became_active":"2023-08-09T12:40:40.709688+0000","last_became_peered":"2023-08-09T12:40:40.709688+0000","last_unstale":"2023-08-09T12:40:41.708973+0000","last_undegraded":"2023-08-09T12:40:41.708973+0000","last_fullsized":"2023-08-09T12:40:41.708973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:30.570505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.699645+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:40:41.699645+0000","last_peered":"2023-08-09T12:40:41.699645+0000","last_clean":"2023-08-09T12:40:41.699645+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:40:41.699645+0000","last_undegraded":"2023-08-09T12:40:41.699645+0000","last_fullsized":"2023-08-09T12:40:41.699645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:14.875042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.723093+0000","last_change":"2023-08-09T12:40:41.722863+0000","last_active":"2023-08-09T12:40:41.723093+0000","last_peered":"2023-08-09T12:40:41.723093+0000","last_clean":"2023-08-09T12:40:41.723093+0000","last_became_active":"2023-08-09T12:40:41.722230+0000","last_became_peered":"2023-08-09T12:40:41.722230+0000","last_unstale":"2023-08-09T12:40:41.723093+0000","last_undegraded":"2023-08-09T12:40:41.723093+0000","last_fullsized":"2023-08-09T12:40:41.723093+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:01.603786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.720575+0000","last_change":"2023-08-09T12:40:40.716754+0000","last_active":"2023-08-09T12:40:41.720575+0000","last_peered":"2023-08-09T12:40:41.720575+0000","last_clean":"2023-08-09T12:40:41.720575+0000","last_became_active":"2023-08-09T12:40:40.716061+0000","last_became_peered":"2023-08-09T12:40:40.716061+0000","last_unstale":"2023-08-09T12:40:41.720575+0000","last_undegraded":"2023-08-09T12:40:41.720575+0000","last_fullsized":"2023-08-09T12:40:41.720575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:45.266395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-09T12:40:44.203662+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:40:44.203662+0000","last_peered":"2023-08-09T12:40:44.203662+0000","last_clean":"2023-08-09T12:40:44.203662+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:40:44.203662+0000","last_undegraded":"2023-08-09T12:40:44.203662+0000","last_fullsized":"2023-08-09T12:40:44.203662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:05:11.930787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.734634+0000","last_change":"2023-08-09T12:40:41.734549+0000","last_active":"2023-08-09T12:40:41.734634+0000","last_peered":"2023-08-09T12:40:41.734634+0000","last_clean":"2023-08-09T12:40:41.734634+0000","last_became_active":"2023-08-09T12:40:41.733268+0000","last_became_peered":"2023-08-09T12:40:41.733268+0000","last_unstale":"2023-08-09T12:40:41.734634+0000","last_undegraded":"2023-08-09T12:40:41.734634+0000","last_fullsized":"2023-08-09T12:40:41.734634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:40.677865+0000","last_clean_scrub_stamp":"2023-08-09T12:40:40.677865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:26:32.439590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.700544+0000","last_change":"2023-08-09T12:40:40.710190+0000","last_active":"2023-08-09T12:40:41.700544+0000","last_peered":"2023-08-09T12:40:41.700544+0000","last_clean":"2023-08-09T12:40:41.700544+0000","last_became_active":"2023-08-09T12:40:40.709897+0000","last_became_peered":"2023-08-09T12:40:40.709897+0000","last_unstale":"2023-08-09T12:40:41.700544+0000","last_undegraded":"2023-08-09T12:40:41.700544+0000","last_fullsized":"2023-08-09T12:40:41.700544+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:40:39.663654+0000","last_clean_scrub_stamp":"2023-08-09T12:40:39.663654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:25.402733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-09T12:40:41.709190+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:40:41.709190+0000","last_peered":"2023-08-09T12:40:41.709190+0000","last_clean":"2023-08-09T12:40:41.709190+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:40:41.709190+0000","last_undegraded":"2023-08-09T12:40:41.709190+0000","last_fullsized":"2023-08-09T12:40:41.709190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:37:39.653081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":733,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194579,"statfs":{"total":200000000,"available":199249182,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.0209999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.5549999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.194},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.238}]},{"osd":3,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.288}]},{"osd":4,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.7070000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":3.3580000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.5089999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.387},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.762}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.163}]},{"osd":1,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.6659999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.369},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.4390000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.5},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.5369999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.5800000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.6279999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.7070000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.284},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96099999999999997}]},{"osd":1,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.226},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1899999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.89500000000000002}]},{"osd":3,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.5660000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.004},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.327}]},{"osd":6,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.651},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.145}]},{"osd":7,"last update":"Wed Aug 9 12:40:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.431},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.478}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":164,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195148,"statfs":{"total":200000000,"available":199831818,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.202}]},{"osd":1,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.4430000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.48},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5109999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.373}]},{"osd":5,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.3460000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.2450000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:40:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.2729999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.633},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.52}]},{"osd":2,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.4159999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.758}]},{"osd":6,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.456}]},{"osd":7,"last update":"Wed Aug 9 12:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.71},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.1499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195155,"statfs":{"total":200000000,"available":199839550,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.67700000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.96799999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.109}]},{"osd":4,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.8180000000000001,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.518}]},{"osd":5,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.454},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.381}]},{"osd":6,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.248},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.046}]},{"osd":7,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.409},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.1930000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":170,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195142,"statfs":{"total":200000000,"available":199825679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.77700000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.034},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0049999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.96799999999999997}]},{"osd":4,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.9059999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.5509999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.724}]},{"osd":6,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.508},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.839}]},{"osd":7,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.8720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199235367,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.76300000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.298},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.93600000000000005}]},{"osd":3,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.417}]},{"osd":4,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.52}]},{"osd":5,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.8129999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.369}]},{"osd":6,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.544},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":2.008}]},{"osd":7,"last update":"Wed Aug 9 12:40:11 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.7150000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:40:46.773 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:40:46.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:40:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.051+0000 7fc9c1687640 1 Processor -- start 2023-08-09T12:40:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.051+0000 7fc9c1687640 1 -- start start 2023-08-09T12:40:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9c1687640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9bc15ab70 0x7fc9bc0697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9c1687640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 0x7fc9bc072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9c1687640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9bc06cd60 0x7fc9bc072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9c1687640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc0af240 con 0x7fc9bc06cd60 2023-08-09T12:40:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9c1687640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc15c040 con 0x7fc9bc15ab70 2023-08-09T12:40:47.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9c1687640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc15b430 con 0x7fc9bc15af50 2023-08-09T12:40:47.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9bb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9bc06cd60 0x7fc9bc072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9bb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9bc06cd60 0x7fc9bc072d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51674/0 (socket says 172.21.15.17:51674) 2023-08-09T12:40:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.053+0000 7fc9bb7fe640 1 -- 172.21.15.17:0/3073074210 learned_addr learned my addr 172.21.15.17:0/3073074210 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.054+0000 7fc9baffd640 1 --2- 172.21.15.17:0/3073074210 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc15ab70 0x7fc9bc0697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.054+0000 7fc9b27fc640 1 --2- 172.21.15.17:0/3073074210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 0x7fc9bc072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.054+0000 7fc9bb7fe640 1 -- 172.21.15.17:0/3073074210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 msgr2=0x7fc9bc072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.054+0000 7fc9bb7fe640 1 --2- 172.21.15.17:0/3073074210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 0x7fc9bc072850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.054+0000 7fc9bb7fe640 1 -- 172.21.15.17:0/3073074210 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc15ab70 msgr2=0x7fc9bc0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:47.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.054+0000 7fc9bb7fe640 1 --2- 172.21.15.17:0/3073074210 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc15ab70 0x7fc9bc0697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.054+0000 7fc9bb7fe640 1 -- 172.21.15.17:0/3073074210 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc15b710 con 0x7fc9bc06cd60 2023-08-09T12:40:47.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.054+0000 7fc9baffd640 1 --2- 172.21.15.17:0/3073074210 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc15ab70 0x7fc9bc0697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:47.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.055+0000 7fc9bb7fe640 1 --2- 172.21.15.17:0/3073074210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc06cd60 0x7fc9bc072d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc070e10 tx=0x7fc9b402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccfe3dcb5b35aaf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:47.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.055+0000 7fc9ba7fc640 1 -- 172.21.15.17:0/3073074210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4031880 con 0x7fc9bc06cd60 2023-08-09T12:40:47.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.055+0000 7fc9ba7fc640 1 -- 172.21.15.17:0/3073074210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b40319e0 con 0x7fc9bc06cd60 2023-08-09T12:40:47.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.055+0000 7fc9ba7fc640 1 -- 172.21.15.17:0/3073074210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4031d70 con 0x7fc9bc06cd60 2023-08-09T12:40:47.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 -- 172.21.15.17:0/3073074210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc06cd60 msgr2=0x7fc9bc072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 --2- 172.21.15.17:0/3073074210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc06cd60 0x7fc9bc072d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc070e10 tx=0x7fc9b402b920 comp rx=0 tx=0).stop 2023-08-09T12:40:47.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 -- 172.21.15.17:0/3073074210 shutdown_connections 2023-08-09T12:40:47.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 --2- 172.21.15.17:0/3073074210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc06cd60 0x7fc9bc072d90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 --2- 172.21.15.17:0/3073074210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 0x7fc9bc072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 --2- 172.21.15.17:0/3073074210 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc15ab70 0x7fc9bc0697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 -- 172.21.15.17:0/3073074210 >> 172.21.15.17:0/3073074210 conn(0x7fc9bc0cc3d0 msgr2=0x7fc9bc0cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:47.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 -- 172.21.15.17:0/3073074210 shutdown_connections 2023-08-09T12:40:47.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.056+0000 7fc9c1687640 1 -- 172.21.15.17:0/3073074210 wait complete. 2023-08-09T12:40:47.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.058+0000 7fc9c1687640 1 Processor -- start 2023-08-09T12:40:47.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.059+0000 7fc9c1687640 1 -- start start 2023-08-09T12:40:47.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9c1687640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9bc06cd60 0x7fc9bc1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9c1687640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc15ab70 0x7fc9bc154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9c1687640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 0x7fc9bc1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9c1687640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b3bd0 con 0x7fc9bc15ab70 2023-08-09T12:40:47.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9c1687640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0ae1e0 con 0x7fc9bc06cd60 2023-08-09T12:40:47.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9c1687640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc1f6a70 con 0x7fc9bc15af50 2023-08-09T12:40:47.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9b27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc15ab70 0x7fc9bc154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9b27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc15ab70 0x7fc9bc154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51686/0 (socket says 172.21.15.17:51686) 2023-08-09T12:40:47.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9b27fc640 1 -- 172.21.15.17:0/616456540 learned_addr learned my addr 172.21.15.17:0/616456540 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:47.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9b27fc640 1 -- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 msgr2=0x7fc9bc1f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9b27fc640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 0x7fc9bc1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9b27fc640 1 -- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9bc06cd60 msgr2=0x7fc9bc1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9b27fc640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9bc06cd60 0x7fc9bc1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.060+0000 7fc9b27fc640 1 -- 172.21.15.17:0/616456540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b40094d0 con 0x7fc9bc15ab70 2023-08-09T12:40:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.061+0000 7fc9b27fc640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc15ab70 0x7fc9bc154be0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400ccd0 tx=0x7fc9a400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.061+0000 7fc9b3fff640 1 -- 172.21.15.17:0/616456540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4003990 con 0x7fc9bc15ab70 2023-08-09T12:40:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.061+0000 7fc9b3fff640 1 -- 172.21.15.17:0/616456540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4003af0 con 0x7fc9bc15ab70 2023-08-09T12:40:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.061+0000 7fc9b3fff640 1 -- 172.21.15.17:0/616456540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4003e80 con 0x7fc9bc15ab70 2023-08-09T12:40:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.061+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc0adc20 con 0x7fc9bc15ab70 2023-08-09T12:40:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.061+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc0b37f0 con 0x7fc9bc15ab70 2023-08-09T12:40:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.063+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc0b3d10 con 0x7fc9bc15ab70 2023-08-09T12:40:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.064+0000 7fc9b3fff640 1 -- 172.21.15.17:0/616456540 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc9a4004020 con 0x7fc9bc15ab70 2023-08-09T12:40:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.065+0000 7fc9b3fff640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc99c06a050 0x7fc99c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.065+0000 7fc9b3fff640 1 -- 172.21.15.17:0/616456540 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9a40888f0 con 0x7fc9bc15ab70 2023-08-09T12:40:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.066+0000 7fc9baffd640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc99c06a050 0x7fc99c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.067+0000 7fc9baffd640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc99c06a050 0x7fc99c06c510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac006fd0 tx=0x7fc9ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.070+0000 7fc9b3fff640 1 -- 172.21.15.17:0/616456540 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc9bc0b3d10 con 0x7fc9bc15ab70 2023-08-09T12:40:47.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.335+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc9bc0b3d10 con 0x7fc9bc15ab70 2023-08-09T12:40:47.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.343+0000 7fc9b3fff640 1 -- 172.21.15.17:0/616456540 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc9bc0b3d10 con 0x7fc9bc15ab70 2023-08-09T12:40:47.346 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:40:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:40:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:40:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:40:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:40:47.347 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:40:47.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc99c06a050 msgr2=0x7fc99c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc99c06a050 0x7fc99c06c510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac006fd0 tx=0x7fc9ac008040 comp rx=0 tx=0).stop 2023-08-09T12:40:47.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc15ab70 msgr2=0x7fc9bc154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc15ab70 0x7fc9bc154be0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400ccd0 tx=0x7fc9a400a5c0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 shutdown_connections 2023-08-09T12:40:47.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc99c06a050 0x7fc99c06c510 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15af50 0x7fc9bc1f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc15ab70 0x7fc9bc154be0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 --2- 172.21.15.17:0/616456540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9bc06cd60 0x7fc9bc1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 >> 172.21.15.17:0/616456540 conn(0x7fc9bc0cc3d0 msgr2=0x7fc9bc06fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:47.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 shutdown_connections 2023-08-09T12:40:47.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.346+0000 7fc9c1687640 1 -- 172.21.15.17:0/616456540 wait complete. 2023-08-09T12:40:47.368 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:40:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.583+0000 7f4cae03f640 1 Processor -- start 2023-08-09T12:40:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.584+0000 7f4cae03f640 1 -- start start 2023-08-09T12:40:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.585+0000 7f4cae03f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca815ce90 0x7f4ca81616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.585+0000 7f4cae03f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4ca80b6000 0x7f4ca80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.585+0000 7f4cae03f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ca80d29d0 0x7f4ca80d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.585+0000 7f4cae03f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80d33a0 con 0x7f4ca80d29d0 2023-08-09T12:40:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.585+0000 7f4cae03f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80b6460 con 0x7f4ca80b6000 2023-08-09T12:40:47.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.585+0000 7f4cae03f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80cda40 con 0x7f4ca815ce90 2023-08-09T12:40:47.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ca80d29d0 0x7f4ca80d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ca80d29d0 0x7f4ca80d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51690/0 (socket says 172.21.15.17:51690) 2023-08-09T12:40:47.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca7fff640 1 -- 172.21.15.17:0/502607826 learned_addr learned my addr 172.21.15.17:0/502607826 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:47.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca77fe640 1 --2- 172.21.15.17:0/502607826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca815ce90 0x7f4ca81616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca6ffd640 1 --2- 172.21.15.17:0/502607826 >> v2:172.21.15.142:3300/0 conn(0x7f4ca80b6000 0x7f4ca80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca7fff640 1 -- 172.21.15.17:0/502607826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca815ce90 msgr2=0x7f4ca81616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca7fff640 1 --2- 172.21.15.17:0/502607826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca815ce90 0x7f4ca81616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca7fff640 1 -- 172.21.15.17:0/502607826 >> v2:172.21.15.142:3300/0 conn(0x7f4ca80b6000 msgr2=0x7f4ca80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca7fff640 1 --2- 172.21.15.17:0/502607826 >> v2:172.21.15.142:3300/0 conn(0x7f4ca80b6000 0x7f4ca80cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.586+0000 7f4ca7fff640 1 -- 172.21.15.17:0/502607826 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80cdd10 con 0x7f4ca80d29d0 2023-08-09T12:40:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.588+0000 7f4ca7fff640 1 --2- 172.21.15.17:0/502607826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca80d29d0 0x7f4ca80d2e60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80d3c80 tx=0x7f4ca002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feedc75c5dc3cdde server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.588+0000 7f4ca67fc640 1 -- 172.21.15.17:0/502607826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca002ca70 con 0x7f4ca80d29d0 2023-08-09T12:40:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.588+0000 7f4ca67fc640 1 -- 172.21.15.17:0/502607826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca002cbd0 con 0x7f4ca80d29d0 2023-08-09T12:40:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.588+0000 7f4ca67fc640 1 -- 172.21.15.17:0/502607826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00343f0 con 0x7f4ca80d29d0 2023-08-09T12:40:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 -- 172.21.15.17:0/502607826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca80d29d0 msgr2=0x7f4ca80d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 --2- 172.21.15.17:0/502607826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca80d29d0 0x7f4ca80d2e60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80d3c80 tx=0x7f4ca002bed0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 -- 172.21.15.17:0/502607826 shutdown_connections 2023-08-09T12:40:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 --2- 172.21.15.17:0/502607826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca80d29d0 0x7f4ca80d2e60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 --2- 172.21.15.17:0/502607826 >> v2:172.21.15.142:3300/0 conn(0x7f4ca80b6000 0x7f4ca80cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 --2- 172.21.15.17:0/502607826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca815ce90 0x7f4ca81616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 -- 172.21.15.17:0/502607826 >> 172.21.15.17:0/502607826 conn(0x7f4ca806fde0 msgr2=0x7f4ca80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 -- 172.21.15.17:0/502607826 shutdown_connections 2023-08-09T12:40:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.589+0000 7f4cae03f640 1 -- 172.21.15.17:0/502607826 wait complete. 2023-08-09T12:40:47.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.591+0000 7f4cae03f640 1 Processor -- start 2023-08-09T12:40:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.591+0000 7f4cae03f640 1 -- start start 2023-08-09T12:40:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4cae03f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca80b6000 0x7f4ca814ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4cae03f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca80d29d0 0x7f4ca81e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4cae03f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca815ce90 0x7f4ca81e8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4cae03f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81f2ba0 con 0x7f4ca815ce90 2023-08-09T12:40:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4cae03f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca815c410 con 0x7f4ca80d29d0 2023-08-09T12:40:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4cae03f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81f70e0 con 0x7f4ca80b6000 2023-08-09T12:40:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca815ce90 0x7f4ca81e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca815ce90 0x7f4ca81e8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51696/0 (socket says 172.21.15.17:51696) 2023-08-09T12:40:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.592+0000 7f4ca7fff640 1 -- 172.21.15.17:0/1699227693 learned_addr learned my addr 172.21.15.17:0/1699227693 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4ca7fff640 1 -- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca80b6000 msgr2=0x7f4ca814ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4ca7fff640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca80b6000 0x7f4ca814ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4ca7fff640 1 -- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca80d29d0 msgr2=0x7f4ca81e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4ca7fff640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca80d29d0 0x7f4ca81e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4ca7fff640 1 -- 172.21.15.17:0/1699227693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0009b30 con 0x7f4ca815ce90 2023-08-09T12:40:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4ca7fff640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca815ce90 0x7f4ca81e8940 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009f40 tx=0x7f4ca0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4c8ffff640 1 -- 172.21.15.17:0/1699227693 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0009510 con 0x7f4ca815ce90 2023-08-09T12:40:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4c8ffff640 1 -- 172.21.15.17:0/1699227693 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca003e450 con 0x7f4ca815ce90 2023-08-09T12:40:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4c8ffff640 1 -- 172.21.15.17:0/1699227693 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca003e7e0 con 0x7f4ca815ce90 2023-08-09T12:40:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.593+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca81f6e00 con 0x7f4ca815ce90 2023-08-09T12:40:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.594+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca80ca060 con 0x7f4ca815ce90 2023-08-09T12:40:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.595+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca8067a80 con 0x7f4ca815ce90 2023-08-09T12:40:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.596+0000 7f4c8ffff640 1 -- 172.21.15.17:0/1699227693 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ca003e940 con 0x7f4ca815ce90 2023-08-09T12:40:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.597+0000 7f4c8ffff640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c9406a050 0x7f4c9406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.597+0000 7f4c8ffff640 1 -- 172.21.15.17:0/1699227693 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ca00ab640 con 0x7f4ca815ce90 2023-08-09T12:40:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.597+0000 7f4ca77fe640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c9406a050 0x7f4c9406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.598+0000 7f4ca77fe640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c9406a050 0x7f4c9406c510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b7f0 tx=0x7f4c98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:47.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.601+0000 7f4c8ffff640 1 -- 172.21.15.17:0/1699227693 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4ca0076d20 con 0x7f4ca815ce90 2023-08-09T12:40:47.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.832+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ca80d0ad0 con 0x7f4ca815ce90 2023-08-09T12:40:47.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.833+0000 7f4c8ffff640 1 -- 172.21.15.17:0/1699227693 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f4ca0047e90 con 0x7f4ca815ce90 2023-08-09T12:40:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:47.837 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:40:41.199722+0000","modified":"2023-08-09T12:40:44.738017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2993081476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2993081476},{"type":"v1","addr":"172.21.15.17:6835","nonce":2993081476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T12:40:47.837 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-08-09T12:40:47.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c9406a050 msgr2=0x7f4c9406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c9406a050 0x7f4c9406c510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b7f0 tx=0x7f4c98008040 comp rx=0 tx=0).stop 2023-08-09T12:40:47.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca815ce90 msgr2=0x7f4ca81e8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:47.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca815ce90 0x7f4ca81e8940 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009f40 tx=0x7f4ca0004a40 comp rx=0 tx=0).stop 2023-08-09T12:40:47.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 shutdown_connections 2023-08-09T12:40:47.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c9406a050 0x7f4c9406c510 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ca815ce90 0x7f4ca81e8940 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca80d29d0 0x7f4ca81e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 --2- 172.21.15.17:0/1699227693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca80b6000 0x7f4ca814ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:47.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 >> 172.21.15.17:0/1699227693 conn(0x7f4ca806fde0 msgr2=0x7f4ca80b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:47.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 shutdown_connections 2023-08-09T12:40:47.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:47.836+0000 7f4cae03f640 1 -- 172.21.15.17:0/1699227693 wait complete. 2023-08-09T12:40:48.259 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:40:41.199722+0000', 'modified': '2023-08-09T12:40:44.738017+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5148}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5148': {'gid': 5148, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.17:6835/2993081476', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 2993081476}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2993081476}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:40:48.260 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:40:48.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-09T12:40:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.497+0000 7feea70aa640 1 Processor -- start 2023-08-09T12:40:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.497+0000 7feea70aa640 1 -- start start 2023-08-09T12:40:48.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.498+0000 7feea70aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 0x7feea0160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.498+0000 7feea70aa640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feea00cfb50 0x7feea00d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.498+0000 7feea70aa640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea00b5a30 con 0x7feea00b86e0 2023-08-09T12:40:48.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.498+0000 7feea70aa640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea00d1110 con 0x7feea00cfb50 2023-08-09T12:40:48.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.498+0000 7feea70aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea00ceac0 con 0x7feea0160030 2023-08-09T12:40:48.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.499+0000 7feea68a9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feea00cfb50 0x7feea00d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.499+0000 7feea68a9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feea00cfb50 0x7feea00d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:58244/0 (socket says 172.21.15.17:58244) 2023-08-09T12:40:48.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.499+0000 7feea60a8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 0x7feea0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.499+0000 7feea68a9640 1 -- 172.21.15.17:0/3309063722 learned_addr learned my addr 172.21.15.17:0/3309063722 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:48.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.500+0000 7feea68a9640 1 -- 172.21.15.17:0/3309063722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 msgr2=0x7feea0160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.500+0000 7feea68a9640 1 --2- 172.21.15.17:0/3309063722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 0x7feea0160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.500+0000 7feea68a9640 1 -- 172.21.15.17:0/3309063722 >> v1:172.21.15.142:6789/0 conn(0x7feea00b86e0 legacy=0x7feea00cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.500+0000 7feea68a9640 1 -- 172.21.15.17:0/3309063722 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00d0d70 con 0x7feea00cfb50 2023-08-09T12:40:48.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.501+0000 7feea68a9640 1 --2- 172.21.15.17:0/3309063722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 0x7feea00d1530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee98009e50 tx=0x7fee9802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2facf88ecb31ba8a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.502+0000 7feea50a6640 1 -- 172.21.15.17:0/3309063722 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9802cb00 con 0x7feea00cfb50 2023-08-09T12:40:48.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.502+0000 7feea50a6640 1 -- 172.21.15.17:0/3309063722 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9802cc60 con 0x7feea00cfb50 2023-08-09T12:40:48.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.502+0000 7feea50a6640 1 -- 172.21.15.17:0/3309063722 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980343f0 con 0x7feea00cfb50 2023-08-09T12:40:48.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.503+0000 7feea70aa640 1 -- 172.21.15.17:0/3309063722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 msgr2=0x7feea00d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.503+0000 7feea70aa640 1 --2- 172.21.15.17:0/3309063722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 0x7feea00d1530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee98009e50 tx=0x7fee9802bf60 comp rx=0 tx=0).stop 2023-08-09T12:40:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.503+0000 7feea70aa640 1 -- 172.21.15.17:0/3309063722 shutdown_connections 2023-08-09T12:40:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.503+0000 7feea70aa640 1 --2- 172.21.15.17:0/3309063722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 0x7feea00d1530 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.503+0000 7feea70aa640 1 --2- 172.21.15.17:0/3309063722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 0x7feea0160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.503+0000 7feea70aa640 1 -- 172.21.15.17:0/3309063722 >> 172.21.15.17:0/3309063722 conn(0x7feea00697c0 msgr2=0x7feea0069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.503+0000 7feea70aa640 1 -- 172.21.15.17:0/3309063722 shutdown_connections 2023-08-09T12:40:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.503+0000 7feea70aa640 1 -- 172.21.15.17:0/3309063722 wait complete. 2023-08-09T12:40:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.505+0000 7feea70aa640 1 Processor -- start 2023-08-09T12:40:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.505+0000 7feea70aa640 1 -- start start 2023-08-09T12:40:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea70aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea00b86e0 0x7feea01f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea70aa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 0x7feea01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea70aa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 0x7feea01f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea70aa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea01509c0 con 0x7feea00b86e0 2023-08-09T12:40:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea70aa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea00cc4d0 con 0x7feea00cfb50 2023-08-09T12:40:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea70aa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea00cbf80 con 0x7feea0160030 2023-08-09T12:40:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea60a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea00b86e0 0x7feea01f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea60a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea00b86e0 0x7feea01f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58776/0 (socket says 172.21.15.17:58776) 2023-08-09T12:40:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea60a8640 1 -- 172.21.15.17:0/3728076083 learned_addr learned my addr 172.21.15.17:0/3728076083 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:48.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea58a7640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 0x7feea01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea60a8640 1 -- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 msgr2=0x7feea01f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea60a8640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 0x7feea01f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.506+0000 7feea60a8640 1 -- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 msgr2=0x7feea01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.507+0000 7feea60a8640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 0x7feea01594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.507+0000 7feea60a8640 1 -- 172.21.15.17:0/3728076083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009b30 con 0x7feea00b86e0 2023-08-09T12:40:48.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.507+0000 7feea60a8640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea00b86e0 0x7feea01f2e60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00e8a0 tx=0x7fee9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.507+0000 7fee96ffd640 1 -- 172.21.15.17:0/3728076083 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0094f0 con 0x7feea00b86e0 2023-08-09T12:40:48.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.507+0000 7fee96ffd640 1 -- 172.21.15.17:0/3728076083 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00c940 con 0x7feea00b86e0 2023-08-09T12:40:48.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.507+0000 7fee96ffd640 1 -- 172.21.15.17:0/3728076083 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00ccf0 con 0x7feea00b86e0 2023-08-09T12:40:48.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.507+0000 7feea70aa640 1 -- 172.21.15.17:0/3728076083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea0159a00 con 0x7feea00b86e0 2023-08-09T12:40:48.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.507+0000 7feea70aa640 1 -- 172.21.15.17:0/3728076083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea00cc1f0 con 0x7feea00b86e0 2023-08-09T12:40:48.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.511+0000 7fee96ffd640 1 -- 172.21.15.17:0/3728076083 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fee9c013470 con 0x7feea00b86e0 2023-08-09T12:40:48.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.512+0000 7fee96ffd640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee8406a050 0x7fee8406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.512+0000 7fee96ffd640 1 -- 172.21.15.17:0/3728076083 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee9c0886e0 con 0x7feea00b86e0 2023-08-09T12:40:48.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.512+0000 7feeaae7b740 1 Processor -- start 2023-08-09T12:40:48.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.512+0000 7feeaae7b740 1 -- start start 2023-08-09T12:40:48.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.512+0000 7feea58a7640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee8406a050 0x7fee8406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e61e30 0x561d11e62210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e359b0 0x561d11e5f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feeaae7b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11da38f0 con 0x561d11e359b0 2023-08-09T12:40:48.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feeaae7b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11da0fe0 con 0x561d11e31db0 2023-08-09T12:40:48.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feeaae7b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d11d9c8d0 con 0x561d11e61e30 2023-08-09T12:40:48.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feea68a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e359b0 0x561d11e5f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feea68a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e359b0 0x561d11e5f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58778/0 (socket says 172.21.15.17:58778) 2023-08-09T12:40:48.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feea68a9640 1 -- 172.21.15.17:0/2747306685 learned_addr learned my addr 172.21.15.17:0/2747306685 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:48.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.513+0000 7feea58a7640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee8406a050 0x7fee8406c510 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feea00b7400 tx=0x7fee90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7feea58a7640 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7feea60a8640 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e61e30 0x561d11e62210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7feea68a9640 1 -- 172.21.15.17:0/2747306685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e61e30 msgr2=0x561d11e62210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7feea68a9640 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e61e30 0x561d11e62210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7feea68a9640 1 -- 172.21.15.17:0/2747306685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 msgr2=0x561d11e5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7feea68a9640 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e5f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7feea68a9640 1 -- 172.21.15.17:0/2747306685 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d11d55ac0 con 0x561d11e359b0 2023-08-09T12:40:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7feea68a9640 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e359b0 0x561d11e5f5e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fee98036040 tx=0x7fee9802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289d34772f4abc5b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.514+0000 7fee83fff640 1 -- 172.21.15.17:0/2747306685 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98009510 con 0x561d11e359b0 2023-08-09T12:40:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7fee83fff640 1 -- 172.21.15.17:0/2747306685 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9802c900 con 0x561d11e359b0 2023-08-09T12:40:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7fee83fff640 1 -- 172.21.15.17:0/2747306685 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9803e670 con 0x561d11e359b0 2023-08-09T12:40:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 -- 172.21.15.17:0/2747306685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e359b0 msgr2=0x561d11e5f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e359b0 0x561d11e5f5e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fee98036040 tx=0x7fee9802e070 comp rx=0 tx=0).stop 2023-08-09T12:40:48.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 -- 172.21.15.17:0/2747306685 shutdown_connections 2023-08-09T12:40:48.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e359b0 0x561d11e5f5e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 --2- 172.21.15.17:0/2747306685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e61e30 0x561d11e62210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 -- 172.21.15.17:0/2747306685 >> 172.21.15.17:0/2747306685 conn(0x561d11e340c0 msgr2=0x561d11e7cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:48.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 -- 172.21.15.17:0/2747306685 shutdown_connections 2023-08-09T12:40:48.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.515+0000 7feeaae7b740 1 -- 172.21.15.17:0/2747306685 wait complete. 2023-08-09T12:40:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.516+0000 7feeaae7b740 1 -- start start 2023-08-09T12:40:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.516+0000 7feeaae7b740 1 Processor -- start 2023-08-09T12:40:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.517+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e5c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.517+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.517+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e46630 0x561d11e62770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.517+0000 7feeaae7b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11d3cd40 con 0x561d11e61e30 2023-08-09T12:40:48.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.517+0000 7feeaae7b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11d3c9e0 con 0x561d11e46630 2023-08-09T12:40:48.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.517+0000 7feeaae7b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d11b02f20 con 0x561d11e359b0 2023-08-09T12:40:48.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.517+0000 7feeaae7b740 10 client.0 _ll_register_callbacks cb 0x561d11d55160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:40:48.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.517+0000 7feea58a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea58a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58784/0 (socket says 172.21.15.17:58784) 2023-08-09T12:40:48.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea58a7640 1 -- 172.21.15.17:0/664687319 learned_addr learned my addr 172.21.15.17:0/664687319 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:48.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea58a7640 1 -- 172.21.15.17:0/664687319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 msgr2=0x561d11e5c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea60a8640 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e5c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea58a7640 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e5c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea68a9640 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e46630 0x561d11e62770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea58a7640 1 -- 172.21.15.17:0/664687319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e46630 msgr2=0x561d11e62770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea58a7640 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e46630 0x561d11e62770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea58a7640 1 -- 172.21.15.17:0/664687319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea00d0d70 con 0x561d11e61e30 2023-08-09T12:40:48.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7feea58a7640 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e460f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fee9000d9a0 tx=0x7fee90001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadfe9b73955947c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.518+0000 7fee817fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:40:48.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7fee817fa640 1 -- 172.21.15.17:0/664687319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900054a0 con 0x561d11e61e30 2023-08-09T12:40:48.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7fee817fa640 1 -- 172.21.15.17:0/664687319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee90020b00 con 0x561d11e61e30 2023-08-09T12:40:48.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 1 -- 172.21.15.17:0/664687319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d11d74500 con 0x561d11e61e30 2023-08-09T12:40:48.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7fee817fa640 1 -- 172.21.15.17:0/664687319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee90020cc0 con 0x561d11e61e30 2023-08-09T12:40:48.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 10 client.5346 fetch_fsmap learned FSMap version 17 2023-08-09T12:40:48.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 1 -- 172.21.15.17:0/664687319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561d11d9af50 con 0x561d11e61e30 2023-08-09T12:40:48.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7fee817fa640 1 -- 172.21.15.17:0/664687319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d11d74500 con 0x561d11e61e30 2023-08-09T12:40:48.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7fee817fa640 1 -- 172.21.15.17:0/664687319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fee90020340 con 0x561d11e61e30 2023-08-09T12:40:48.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 10 client.5346 fetch_fsmap finished waiting for FSMap version 17 2023-08-09T12:40:48.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 10 client.5346 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T12:40:48.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 20 client.5346 populate_metadata read hostname 'smithi017' 2023-08-09T12:40:48.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] conn(0x561d11e48140 0x561d11e48520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 4 client.5346 mds_command: new command op to 5148 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:40:48.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.519+0000 7feeaae7b740 1 -- 172.21.15.17:0/664687319 --> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d11d71bc0 con 0x561d11e48140 2023-08-09T12:40:48.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.520+0000 7feea60a8640 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] conn(0x561d11e48140 0x561d11e48520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.520+0000 7feea60a8640 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] conn(0x561d11e48140 0x561d11e48520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a50a65b70710c261 server_cookie=d8e0c236345d7635 in_seq=0 out_seq=0 2023-08-09T12:40:48.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.520+0000 7fee817fa640 10 client.5346 ms_handle_connect on v2:172.21.15.17:6834/2993081476 2023-08-09T12:40:48.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7fee817fa640 1 -- 172.21.15.17:0/664687319 <== mds.0 v2:172.21.15.17:6834/2993081476 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561d11d71bc0 con 0x561d11e48140 2023-08-09T12:40:48.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7fee817fa640 10 client.5346 handle_command_reply: tid=0 2023-08-09T12:40:48.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 client.5346 shutdown 2023-08-09T12:40:48.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 -- 172.21.15.17:0/664687319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 msgr2=0x561d11e460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e460f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fee9000d9a0 tx=0x7fee90001120 comp rx=0 tx=0).stop 2023-08-09T12:40:48.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 -- 172.21.15.17:0/664687319 shutdown_connections 2023-08-09T12:40:48.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] conn(0x561d11e48140 0x561d11e48520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e46630 0x561d11e62770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e460f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 --2- 172.21.15.17:0/664687319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e5c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7fee817fa640 0 client.5346 ms_handle_reset on v2:172.21.15.17:6834/2993081476 2023-08-09T12:40:48.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 -- 172.21.15.17:0/664687319 >> 172.21.15.17:0/664687319 conn(0x561d11e31db0 msgr2=0x561d11e362d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:48.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 -- 172.21.15.17:0/664687319 shutdown_connections 2023-08-09T12:40:48.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.521+0000 7feeaae7b740 1 -- 172.21.15.17:0/664687319 wait complete. 2023-08-09T12:40:48.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.522+0000 7feeaae7b740 20 client.5346 trim_cache size 0 max 16384 2023-08-09T12:40:48.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.538+0000 7feeaae7b740 1 Processor -- start 2023-08-09T12:40:48.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.538+0000 7feeaae7b740 1 -- start start 2023-08-09T12:40:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e801e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e35f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e36490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feeaae7b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11e33960 con 0x561d11e61e30 2023-08-09T12:40:48.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feeaae7b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11e490b0 con 0x561d11e31db0 2023-08-09T12:40:48.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feeaae7b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d11e31030 con 0x561d11e359b0 2023-08-09T12:40:48.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feea68a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e36490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feea68a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e36490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58798/0 (socket says 172.21.15.17:58798) 2023-08-09T12:40:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feea68a9640 1 -- 172.21.15.17:0/770643586 learned_addr learned my addr 172.21.15.17:0/770643586 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.539+0000 7feea58a7640 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e35f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea60a8640 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e801e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea68a9640 1 -- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 msgr2=0x561d11e35f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea68a9640 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e35f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea68a9640 1 -- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 msgr2=0x561d11e801e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea68a9640 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e801e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea68a9640 1 -- 172.21.15.17:0/770643586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d11dce300 con 0x561d11e61e30 2023-08-09T12:40:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea58a7640 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e35f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea60a8640 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e801e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.540+0000 7feea68a9640 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e36490 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fee9802c570 tx=0x7fee98030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbc92b93798cd48 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7fee94e1c640 1 -- 172.21.15.17:0/770643586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9802cb00 con 0x561d11e61e30 2023-08-09T12:40:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7fee94e1c640 1 -- 172.21.15.17:0/770643586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98003990 con 0x561d11e61e30 2023-08-09T12:40:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7fee94e1c640 1 -- 172.21.15.17:0/770643586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98003d40 con 0x561d11e61e30 2023-08-09T12:40:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 -- 172.21.15.17:0/770643586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 msgr2=0x561d11e36490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e36490 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fee9802c570 tx=0x7fee98030000 comp rx=0 tx=0).stop 2023-08-09T12:40:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 -- 172.21.15.17:0/770643586 shutdown_connections 2023-08-09T12:40:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e61e30 0x561d11e36490 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e35f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 --2- 172.21.15.17:0/770643586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e31db0 0x561d11e801e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 -- 172.21.15.17:0/770643586 >> 172.21.15.17:0/770643586 conn(0x561d11e2d9c0 msgr2=0x561d11e313f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 -- 172.21.15.17:0/770643586 shutdown_connections 2023-08-09T12:40:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.541+0000 7feeaae7b740 1 -- 172.21.15.17:0/770643586 wait complete. 2023-08-09T12:40:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.542+0000 7feeaae7b740 1 -- start start 2023-08-09T12:40:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.542+0000 7feeaae7b740 1 Processor -- start 2023-08-09T12:40:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e31db0 0x561d11e59bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e5a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feeaae7b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e61e30 0x561d11e5cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feeaae7b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11e7cd50 con 0x561d11e31db0 2023-08-09T12:40:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feeaae7b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11e7dc90 con 0x561d11e61e30 2023-08-09T12:40:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feeaae7b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d11e39520 con 0x561d11e359b0 2023-08-09T12:40:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feeaae7b740 10 client.0 _ll_register_callbacks cb 0x7fee90001c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:40:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feea60a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e31db0 0x561d11e59bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.543+0000 7feea60a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e31db0 0x561d11e59bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58802/0 (socket says 172.21.15.17:58802) 2023-08-09T12:40:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7feea60a8640 1 -- 172.21.15.17:0/1598427357 learned_addr learned my addr 172.21.15.17:0/1598427357 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7feea60a8640 1 -- 172.21.15.17:0/1598427357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 msgr2=0x561d11e5a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7feea60a8640 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e5a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7feea60a8640 1 -- 172.21.15.17:0/1598427357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e61e30 msgr2=0x561d11e5cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7feea60a8640 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e61e30 0x561d11e5cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7feea60a8640 1 -- 172.21.15.17:0/1598427357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d11d55ac0 con 0x561d11e31db0 2023-08-09T12:40:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7feea60a8640 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e31db0 0x561d11e59bf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fee9c086a10 tx=0x7fee9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e035d059d92fbe7d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7fee817fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:40:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7fee817fa640 1 -- 172.21.15.17:0/1598427357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c080b50 con 0x561d11e31db0 2023-08-09T12:40:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7fee817fa640 1 -- 172.21.15.17:0/1598427357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee9c0537e0 con 0x561d11e31db0 2023-08-09T12:40:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7feeaae7b740 1 -- 172.21.15.17:0/1598427357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d11dc4800 con 0x561d11e31db0 2023-08-09T12:40:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.544+0000 7fee817fa640 1 -- 172.21.15.17:0/1598427357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee9c0539a0 con 0x561d11e31db0 2023-08-09T12:40:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feeaae7b740 10 client.5352 fetch_fsmap learned FSMap version 17 2023-08-09T12:40:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feeaae7b740 1 -- 172.21.15.17:0/1598427357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561d11d3ba10 con 0x561d11e31db0 2023-08-09T12:40:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7fee817fa640 1 -- 172.21.15.17:0/1598427357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d11dc4800 con 0x561d11e31db0 2023-08-09T12:40:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7fee817fa640 1 -- 172.21.15.17:0/1598427357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fee9c011070 con 0x561d11e31db0 2023-08-09T12:40:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feeaae7b740 10 client.5352 fetch_fsmap finished waiting for FSMap version 17 2023-08-09T12:40:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feeaae7b740 10 client.5352 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T12:40:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feeaae7b740 20 client.5352 populate_metadata read hostname 'smithi017' 2023-08-09T12:40:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feeaae7b740 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] conn(0x561d11e5d430 0x561d11e8e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feeaae7b740 4 client.5352 mds_command: new command op to 5148 tid=0[{"prefix": "status"}] 2023-08-09T12:40:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feeaae7b740 1 -- 172.21.15.17:0/1598427357 --> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d11d958b0 con 0x561d11e5d430 2023-08-09T12:40:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.545+0000 7feea58a7640 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] conn(0x561d11e5d430 0x561d11e8e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feea58a7640 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] conn(0x561d11e5d430 0x561d11e8e890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2caccb5d562c123 server_cookie=256ce64f8b55eb2b in_seq=0 out_seq=0 2023-08-09T12:40:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7fee817fa640 10 client.5352 ms_handle_connect on v2:172.21.15.17:6834/2993081476 2023-08-09T12:40:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7fee817fa640 1 -- 172.21.15.17:0/1598427357 <== mds.0 v2:172.21.15.17:6834/2993081476 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561d11d958b0 con 0x561d11e5d430 2023-08-09T12:40:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7fee817fa640 10 client.5352 handle_command_reply: tid=0 2023-08-09T12:40:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 client.5352 shutdown 2023-08-09T12:40:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 -- 172.21.15.17:0/1598427357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e31db0 msgr2=0x561d11e59bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e31db0 0x561d11e59bf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fee9c086a10 tx=0x7fee9c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 -- 172.21.15.17:0/1598427357 shutdown_connections 2023-08-09T12:40:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.17:6834/2993081476,v1:172.21.15.17:6835/2993081476] conn(0x561d11e5d430 0x561d11e8e890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561d11e61e30 0x561d11e5cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561d11e359b0 0x561d11e5a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 --2- 172.21.15.17:0/1598427357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d11e31db0 0x561d11e59bf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7fee817fa640 0 client.5352 ms_handle_reset on v2:172.21.15.17:6834/2993081476 2023-08-09T12:40:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 -- 172.21.15.17:0/1598427357 >> 172.21.15.17:0/1598427357 conn(0x561d11e2d9c0 msgr2=0x561d11e5ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 -- 172.21.15.17:0/1598427357 shutdown_connections 2023-08-09T12:40:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.546+0000 7feeaae7b740 1 -- 172.21.15.17:0/1598427357 wait complete. 2023-08-09T12:40:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feeaae7b740 20 client.5352 trim_cache size 0 max 16384 2023-08-09T12:40:48.558 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:40:48.558 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:40:48.558 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:40:48.558 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 5148, 2023-08-09T12:40:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:40:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:40:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:40:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.849964537, 2023-08-09T12:40:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 17, 2023-08-09T12:40:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 37, 2023-08-09T12:40:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 37, 2023-08-09T12:40:48.559 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 16.266180727999998 2023-08-09T12:40:48.560 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:40:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 -- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee8406a050 msgr2=0x7fee8406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee8406a050 0x7fee8406c510 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feea00b7400 tx=0x7fee90009040 comp rx=0 tx=0).stop 2023-08-09T12:40:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 -- 172.21.15.17:0/3728076083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea00b86e0 msgr2=0x7feea01f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea00b86e0 0x7feea01f2e60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00e8a0 tx=0x7fee9c00ed60 comp rx=0 tx=0).stop 2023-08-09T12:40:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 -- 172.21.15.17:0/3728076083 shutdown_connections 2023-08-09T12:40:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee8406a050 0x7fee8406c510 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea0160030 0x7feea01f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feea00cfb50 0x7feea01594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 --2- 172.21.15.17:0/3728076083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea00b86e0 0x7feea01f2e60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 -- 172.21.15.17:0/3728076083 >> 172.21.15.17:0/3728076083 conn(0x7feea00697c0 msgr2=0x7feea00d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:48.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 -- 172.21.15.17:0/3728076083 shutdown_connections 2023-08-09T12:40:48.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.547+0000 7feea70aa640 1 -- 172.21.15.17:0/3728076083 wait complete. 2023-08-09T12:40:48.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:40:48.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.777+0000 7f65069d6640 1 Processor -- start 2023-08-09T12:40:48.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.778+0000 7f65069d6640 1 -- start start 2023-08-09T12:40:48.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.779+0000 7f65069d6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f65000adc40 0x7f650006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.779+0000 7f65069d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000b3b40 0x7f65000b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.779+0000 7f65069d6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f650015e8f0 0x7f650015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.779+0000 7f65069d6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65000ae020 con 0x7f65000adc40 2023-08-09T12:40:48.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.779+0000 7f65069d6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65000b2250 con 0x7f650015e8f0 2023-08-09T12:40:48.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.779+0000 7f65069d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65000b2530 con 0x7f65000b3b40 2023-08-09T12:40:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.780+0000 7f64fffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f65000adc40 0x7f650006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.780+0000 7f64fffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f65000adc40 0x7f650006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58810/0 (socket says 172.21.15.17:58810) 2023-08-09T12:40:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.780+0000 7f64fffff640 1 -- 172.21.15.17:0/2935811943 learned_addr learned my addr 172.21.15.17:0/2935811943 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.780+0000 7f64fffff640 1 -- 172.21.15.17:0/2935811943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000b3b40 msgr2=0x7f65000b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.780+0000 7f64fffff640 1 --2- 172.21.15.17:0/2935811943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000b3b40 0x7f65000b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.780+0000 7f64fffff640 1 -- 172.21.15.17:0/2935811943 >> v2:172.21.15.142:3300/0 conn(0x7f650015e8f0 msgr2=0x7f650015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.780+0000 7f64fffff640 1 --2- 172.21.15.17:0/2935811943 >> v2:172.21.15.142:3300/0 conn(0x7f650015e8f0 0x7f650015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.780+0000 7f64fffff640 1 -- 172.21.15.17:0/2935811943 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650006fe80 con 0x7f65000adc40 2023-08-09T12:40:48.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.781+0000 7f64fffff640 1 --2- 172.21.15.17:0/2935811943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000adc40 0x7f650006c280 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f65000cf780 tx=0x7f64f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5504ac02f7609fac server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f64feffd640 1 -- 172.21.15.17:0/2935811943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0031870 con 0x7f65000adc40 2023-08-09T12:40:48.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f64feffd640 1 -- 172.21.15.17:0/2935811943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f00319d0 con 0x7f65000adc40 2023-08-09T12:40:48.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f64feffd640 1 -- 172.21.15.17:0/2935811943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0031d60 con 0x7f65000adc40 2023-08-09T12:40:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 -- 172.21.15.17:0/2935811943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000adc40 msgr2=0x7f650006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 --2- 172.21.15.17:0/2935811943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000adc40 0x7f650006c280 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f65000cf780 tx=0x7f64f002b910 comp rx=0 tx=0).stop 2023-08-09T12:40:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 -- 172.21.15.17:0/2935811943 shutdown_connections 2023-08-09T12:40:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 --2- 172.21.15.17:0/2935811943 >> v2:172.21.15.142:3300/0 conn(0x7f650015e8f0 0x7f650015ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 --2- 172.21.15.17:0/2935811943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000b3b40 0x7f65000b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 --2- 172.21.15.17:0/2935811943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000adc40 0x7f650006c280 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 -- 172.21.15.17:0/2935811943 >> 172.21.15.17:0/2935811943 conn(0x7f65000cb1b0 msgr2=0x7f65000cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 -- 172.21.15.17:0/2935811943 shutdown_connections 2023-08-09T12:40:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.782+0000 7f65069d6640 1 -- 172.21.15.17:0/2935811943 wait complete. 2023-08-09T12:40:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.784+0000 7f65069d6640 1 Processor -- start 2023-08-09T12:40:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.784+0000 7f65069d6640 1 -- start start 2023-08-09T12:40:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.785+0000 7f65069d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000adc40 0x7f6500159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.785+0000 7f65069d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000b3b40 0x7f650015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f65069d6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f650015e8f0 0x7f650014f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f65069d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650015a570 con 0x7f65000b3b40 2023-08-09T12:40:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f65069d6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65000c3720 con 0x7f650015e8f0 2023-08-09T12:40:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f65069d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65000c2d80 con 0x7f65000adc40 2023-08-09T12:40:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64ff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000b3b40 0x7f650015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64ff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000b3b40 0x7f650015cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58824/0 (socket says 172.21.15.17:58824) 2023-08-09T12:40:48.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64ff7fe640 1 -- 172.21.15.17:0/1252693526 learned_addr learned my addr 172.21.15.17:0/1252693526 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:48.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64ff7fe640 1 -- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000adc40 msgr2=0x7f6500159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f6504f73640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f650015e8f0 0x7f650014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64fffff640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000adc40 0x7f6500159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64ff7fe640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000adc40 0x7f6500159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64ff7fe640 1 -- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f650015e8f0 msgr2=0x7f650014f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:48.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64ff7fe640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f650015e8f0 0x7f650014f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:48.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f64ff7fe640 1 -- 172.21.15.17:0/1252693526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f00094d0 con 0x7f65000b3b40 2023-08-09T12:40:48.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.786+0000 7f6504f73640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f650015e8f0 0x7f650014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:48.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.787+0000 7f64ff7fe640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000b3b40 0x7f650015cff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64f400b4a0 tx=0x7f64f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.787+0000 7f64fcff9640 1 -- 172.21.15.17:0/1252693526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4005a10 con 0x7f65000b3b40 2023-08-09T12:40:48.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.787+0000 7f64fcff9640 1 -- 172.21.15.17:0/1252693526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f4005b70 con 0x7f65000b3b40 2023-08-09T12:40:48.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.787+0000 7f64fcff9640 1 -- 172.21.15.17:0/1252693526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4010610 con 0x7f65000b3b40 2023-08-09T12:40:48.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.787+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65000c3060 con 0x7f65000b3b40 2023-08-09T12:40:48.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.787+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650015a280 con 0x7f65000b3b40 2023-08-09T12:40:48.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.788+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65000c3860 con 0x7f65000b3b40 2023-08-09T12:40:48.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.789+0000 7f64fcff9640 1 -- 172.21.15.17:0/1252693526 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f64f4010770 con 0x7f65000b3b40 2023-08-09T12:40:48.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.790+0000 7f64fcff9640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ec06a050 0x7f64ec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:48.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.790+0000 7f64fcff9640 1 -- 172.21.15.17:0/1252693526 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64f4087f30 con 0x7f65000b3b40 2023-08-09T12:40:48.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.791+0000 7f64fffff640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ec06a050 0x7f64ec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:48.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.792+0000 7f64fffff640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ec06a050 0x7f64ec06c510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f64f0036000 tx=0x7f64f003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:48.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:48.795+0000 7f64fcff9640 1 -- 172.21.15.17:0/1252693526 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f65000c3860 con 0x7f65000b3b40 2023-08-09T12:40:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.031+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f65000c3860 con 0x7f65000b3b40 2023-08-09T12:40:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.032+0000 7f64fcff9640 1 -- 172.21.15.17:0/1252693526 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f65000c3860 con 0x7f65000b3b40 2023-08-09T12:40:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:40:49.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ec06a050 msgr2=0x7f64ec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:49.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ec06a050 0x7f64ec06c510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f64f0036000 tx=0x7f64f003c040 comp rx=0 tx=0).stop 2023-08-09T12:40:49.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000b3b40 msgr2=0x7f650015cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:49.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000b3b40 0x7f650015cff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64f400b4a0 tx=0x7f64f400b960 comp rx=0 tx=0).stop 2023-08-09T12:40:49.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 shutdown_connections 2023-08-09T12:40:49.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ec06a050 0x7f64ec06c510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:49.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f650015e8f0 0x7f650014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:49.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65000b3b40 0x7f650015cff0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:49.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 --2- 172.21.15.17:0/1252693526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65000adc40 0x7f6500159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:49.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 >> 172.21.15.17:0/1252693526 conn(0x7f65000cb1b0 msgr2=0x7f65000c1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:49.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 shutdown_connections 2023-08-09T12:40:49.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:49.035+0000 7f65069d6640 1 -- 172.21.15.17:0/1252693526 wait complete. 2023-08-09T12:40:49.055 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:40:49.056 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:40:49.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:40:49.057 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:40:49.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:40:49.058 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:40:49.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:40:49.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:40:49.058 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:40:49.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:49.059 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:40:49.114 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:40:49.114 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:40:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:40:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:40:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:49.115 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:40:49.115 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:40:49.116 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:40:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:40:49.116 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:40:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:49.116 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:40:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:40:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42131sec preferred_lft 42131sec 2023-08-09T12:40:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:40:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:49.117 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:40:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:49.117 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:40:49.117 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:40:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:40:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:40:49.118 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:49.118 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:40:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:40:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:40:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:49.119 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:40:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:40:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:40:49.119 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:49.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:49.121 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:40:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:40:49.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:49.221 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:40:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:40:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:40:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:40:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:40:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:40:49.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:49.280 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:40:49.280 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:40:49.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:40:49.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:40:49.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:40:49.282 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:40:49.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:49.488 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:40:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:40:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:40:49.547 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:40:49.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:49.552 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:40:49.664 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:40:49.665 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:40:49.724 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:40:49.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:40:49.725 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:40:49.786 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:40:49.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:49.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:40:49.932 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:40:49.932 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:40:49.932 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:40:49.952 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:40:49.952 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:40:49.952 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:40:49.952 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:40:49.952 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:40:49.975 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:40:49.975 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:40:49.975 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:40:49.976 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:40:49.976 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:40:49.976 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:40:49.976 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:40:49.976 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:40:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:40:49.978 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:40:49.978 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:40:49.978 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:40:49.978 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:40:49.981 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:40:49.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:49.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:40:50.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:50.065 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:40:50.128 INFO:teuthology.orchestra.run.smithi017.stdout:client5361 2023-08-09T12:40:50.129 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:50.129 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:50.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:40:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.413+0000 7f1be7976640 1 Processor -- start 2023-08-09T12:40:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.413+0000 7f1be7976640 1 -- start start 2023-08-09T12:40:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.414+0000 7f1be7976640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1be00adc40 0x7f1be006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.414+0000 7f1be7976640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1be00b3b40 0x7f1be00b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.414+0000 7f1be7976640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00b2250 con 0x7f1be015e8f0 2023-08-09T12:40:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.414+0000 7f1be7976640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be00ae020 con 0x7f1be00adc40 2023-08-09T12:40:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.414+0000 7f1be7976640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be00b2530 con 0x7f1be00b3b40 2023-08-09T12:40:50.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.414+0000 7f1be5f13640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1be015e8f0 0x7f1be015ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59010/0 (socket says 172.21.15.17:59010) 2023-08-09T12:40:50.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.414+0000 7f1be5f13640 1 -- 172.21.15.17:0/2945357614 learned_addr learned my addr 172.21.15.17:0/2945357614 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:50.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.415+0000 7f1be5712640 1 --2- 172.21.15.17:0/2945357614 >> v2:172.21.15.17:3300/0 conn(0x7f1be00adc40 0x7f1be006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:50.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.415+0000 7f1be4f11640 1 --2- 172.21.15.17:0/2945357614 >> v2:172.21.15.142:3300/0 conn(0x7f1be00b3b40 0x7f1be00b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:50.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.415+0000 7f1bd7fff640 1 -- 172.21.15.17:0/2945357614 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259789322 0 0) 0x7f1be00b2250 con 0x7f1be015e8f0 2023-08-09T12:40:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.415+0000 7f1bd7fff640 1 -- 172.21.15.17:0/2945357614 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bcc003520 con 0x7f1be015e8f0 2023-08-09T12:40:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.415+0000 7f1be5712640 1 -- 172.21.15.17:0/2945357614 >> v2:172.21.15.142:3300/0 conn(0x7f1be00b3b40 msgr2=0x7f1be00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.415+0000 7f1be5712640 1 --2- 172.21.15.17:0/2945357614 >> v2:172.21.15.142:3300/0 conn(0x7f1be00b3b40 0x7f1be00b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.415+0000 7f1be5712640 1 -- 172.21.15.17:0/2945357614 >> v1:172.21.15.17:6789/0 conn(0x7f1be015e8f0 legacy=0x7f1be015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.415+0000 7f1be5712640 1 -- 172.21.15.17:0/2945357614 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be006fe80 con 0x7f1be00adc40 2023-08-09T12:40:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.417+0000 7f1be5712640 1 --2- 172.21.15.17:0/2945357614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00adc40 0x7f1be006c280 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1be00b48a0 tx=0x7f1bdc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56fd9f3aedfa3d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.417+0000 7f1bd7fff640 1 -- 172.21.15.17:0/2945357614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc031830 con 0x7f1be00adc40 2023-08-09T12:40:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.417+0000 7f1bd7fff640 1 -- 172.21.15.17:0/2945357614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc031990 con 0x7f1be00adc40 2023-08-09T12:40:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.417+0000 7f1bd7fff640 1 -- 172.21.15.17:0/2945357614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc031d00 con 0x7f1be00adc40 2023-08-09T12:40:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.417+0000 7f1be7976640 1 -- 172.21.15.17:0/2945357614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00adc40 msgr2=0x7f1be006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.417+0000 7f1be7976640 1 --2- 172.21.15.17:0/2945357614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00adc40 0x7f1be006c280 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1be00b48a0 tx=0x7f1bdc02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.418+0000 7f1be7976640 1 -- 172.21.15.17:0/2945357614 shutdown_connections 2023-08-09T12:40:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.418+0000 7f1be7976640 1 --2- 172.21.15.17:0/2945357614 >> v2:172.21.15.142:3300/0 conn(0x7f1be00b3b40 0x7f1be00b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.418+0000 7f1be7976640 1 --2- 172.21.15.17:0/2945357614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00adc40 0x7f1be006c280 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.418+0000 7f1be7976640 1 -- 172.21.15.17:0/2945357614 >> 172.21.15.17:0/2945357614 conn(0x7f1be00cb1b0 msgr2=0x7f1be00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:50.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.418+0000 7f1be7976640 1 -- 172.21.15.17:0/2945357614 shutdown_connections 2023-08-09T12:40:50.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.418+0000 7f1be7976640 1 -- 172.21.15.17:0/2945357614 wait complete. 2023-08-09T12:40:50.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.419+0000 7f1be7976640 1 Processor -- start 2023-08-09T12:40:50.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.420+0000 7f1be7976640 1 -- start start 2023-08-09T12:40:50.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be7976640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00adc40 0x7f1be0156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:50.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be7976640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00b3b40 0x7f1be006a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be7976640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be015e8f0 0x7f1be006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be7976640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be006b810 con 0x7f1be00b3b40 2023-08-09T12:40:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be7976640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00c1be0 con 0x7f1be015e8f0 2023-08-09T12:40:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be7976640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be015b120 con 0x7f1be00adc40 2023-08-09T12:40:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be4f11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00b3b40 0x7f1be006a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be4f11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00b3b40 0x7f1be006a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58840/0 (socket says 172.21.15.17:58840) 2023-08-09T12:40:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be4f11640 1 -- 172.21.15.17:0/1897608945 learned_addr learned my addr 172.21.15.17:0/1897608945 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:50.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be5f13640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be015e8f0 0x7f1be006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:50.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be5712640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00adc40 0x7f1be0156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:50.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be4f11640 1 -- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00adc40 msgr2=0x7f1be0156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:50.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be4f11640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00adc40 0x7f1be0156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be4f11640 1 -- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be015e8f0 msgr2=0x7f1be006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be4f11640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be015e8f0 0x7f1be006bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be4f11640 1 -- 172.21.15.17:0/1897608945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009400 con 0x7f1be00b3b40 2023-08-09T12:40:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.421+0000 7f1be5f13640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be015e8f0 0x7f1be006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.422+0000 7f1be4f11640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00b3b40 0x7f1be006a1d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000d800 tx=0x7f1bd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.422+0000 7f1bd5ffb640 1 -- 172.21.15.17:0/1897608945 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000b6c0 con 0x7f1be00b3b40 2023-08-09T12:40:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.422+0000 7f1bd5ffb640 1 -- 172.21.15.17:0/1897608945 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd000b820 con 0x7f1be00b3b40 2023-08-09T12:40:50.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.422+0000 7f1bd5ffb640 1 -- 172.21.15.17:0/1897608945 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000bbd0 con 0x7f1be00b3b40 2023-08-09T12:40:50.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.422+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be015b400 con 0x7f1be00b3b40 2023-08-09T12:40:50.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.422+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be015b9c0 con 0x7f1be00b3b40 2023-08-09T12:40:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.423+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be015bee0 con 0x7f1be00b3b40 2023-08-09T12:40:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.424+0000 7f1bd5ffb640 1 -- 172.21.15.17:0/1897608945 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1bd000bd30 con 0x7f1be00b3b40 2023-08-09T12:40:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.425+0000 7f1bd5ffb640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc406a050 0x7f1bc406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.425+0000 7f1bd5ffb640 1 -- 172.21.15.17:0/1897608945 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bd0088a70 con 0x7f1be00b3b40 2023-08-09T12:40:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.426+0000 7f1be5712640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc406a050 0x7f1bc406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:50.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.427+0000 7f1be5712640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc406a050 0x7f1bc406c510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc036000 tx=0x7f1bdc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:50.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.430+0000 7f1bd5ffb640 1 -- 172.21.15.17:0/1897608945 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1bd0054150 con 0x7f1be00b3b40 2023-08-09T12:40:50.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.664+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1be0067a80 con 0x7f1be00b3b40 2023-08-09T12:40:50.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.665+0000 7f1bd5ffb640 1 -- 172.21.15.17:0/1897608945 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1bd0057770 con 0x7f1be00b3b40 2023-08-09T12:40:50.669 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:40:50.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc406a050 msgr2=0x7f1bc406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:50.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc406a050 0x7f1bc406c510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc036000 tx=0x7f1bdc008030 comp rx=0 tx=0).stop 2023-08-09T12:40:50.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00b3b40 msgr2=0x7f1be006a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:50.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00b3b40 0x7f1be006a1d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000d800 tx=0x7f1bd000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 shutdown_connections 2023-08-09T12:40:50.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc406a050 0x7f1bc406c510 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be015e8f0 0x7f1be006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00b3b40 0x7f1be006a1d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 --2- 172.21.15.17:0/1897608945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00adc40 0x7f1be0156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 >> 172.21.15.17:0/1897608945 conn(0x7f1be00cb1b0 msgr2=0x7f1be00c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 shutdown_connections 2023-08-09T12:40:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:50.668+0000 7f1be7976640 1 -- 172.21.15.17:0/1897608945 wait complete. 2023-08-09T12:40:50.689 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:40:50.690 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:40:50.690 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:40:50.690 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:40:50.691 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:40:50.691 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:40:50.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:40:50.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:40:50.692 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:40:50.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:50.692 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:40:50.753 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:40:50.753 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:40:50.753 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:40:50.753 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:50.754 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:40:50.754 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:50.756 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:40:50.756 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:50.756 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:40:50.757 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:40:50.757 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:50.757 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:40:50.757 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:40:50.757 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:50.757 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:40:50.758 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:50.758 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:40:50.758 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42117sec preferred_lft 42117sec 2023-08-09T12:40:50.758 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:40:50.758 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:50.758 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:40:50.759 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:40:50.759 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:40:50.759 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:50.759 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:40:50.759 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:50.759 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:40:50.760 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:40:50.760 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:40:50.760 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:50.760 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:40:50.760 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:40:50.760 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:40:50.760 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:40:50.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:50.762 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:40:50.858 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:40:50.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:50.862 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:40:50.920 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:40:50.920 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:40:50.921 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:40:50.921 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:40:50.921 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:40:50.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:50.922 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:40:50.922 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:40:50.922 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:40:50.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:40:50.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:40:50.923 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:40:51.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:51.106 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:40:51.154 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:40:51.154 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:40:51.155 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:40:51.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:51.156 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:40:51.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:40:51.241 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:40:51.297 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:40:51.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:40:51.299 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:40:51.348 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:40:51.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:51.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:40:51.484 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:40:51.484 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:40:51.484 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:40:51.506 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:40:51.506 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:40:51.506 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:40:51.506 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:40:51.506 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:40:51.534 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:40:51.534 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:40:51.535 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:40:51.535 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:40:51.535 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:40:51.535 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:40:51.535 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:40:51.535 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:40:51.539 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:40:51.539 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:40:51.539 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:40:51.539 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:40:51.539 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:40:51.543 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:40:51.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:51.544 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:40:51.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:51.627 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:40:51.686 INFO:teuthology.orchestra.run.smithi142.stdout:client4709 2023-08-09T12:40:51.687 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:40:51.687 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:51.741 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:40:51.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.974+0000 7f1f467dd640 1 Processor -- start 2023-08-09T12:40:51.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.974+0000 7f1f467dd640 1 -- start start 2023-08-09T12:40:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f467dd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f400b86e0 0x7f1f400cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f467dd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 0x7f1f400d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f467dd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f400b5a30 con 0x7f1f40160030 2023-08-09T12:40:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f467dd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f400d1110 con 0x7f1f400b86e0 2023-08-09T12:40:51.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f467dd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400ceac0 con 0x7f1f400cf980 2023-08-09T12:40:51.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f44fda640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f400b86e0 0x7f1f400cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:51.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f44fda640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f400b86e0 0x7f1f400cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58846/0 (socket says 172.21.15.17:58846) 2023-08-09T12:40:51.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f44fda640 1 -- 172.21.15.17:0/1726509633 learned_addr learned my addr 172.21.15.17:0/1726509633 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:51.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f44fda640 1 -- 172.21.15.17:0/1726509633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 msgr2=0x7f1f400d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:51.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.976+0000 7f1f45fdc640 1 --2- 172.21.15.17:0/1726509633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 0x7f1f400d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.977+0000 7f1f44fda640 1 --2- 172.21.15.17:0/1726509633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 0x7f1f400d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.977+0000 7f1f44fda640 1 -- 172.21.15.17:0/1726509633 >> v1:172.21.15.142:6789/0 conn(0x7f1f40160030 legacy=0x7f1f40160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.977+0000 7f1f44fda640 1 -- 172.21.15.17:0/1726509633 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f400d0d70 con 0x7f1f400b86e0 2023-08-09T12:40:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.978+0000 7f1f44fda640 1 --2- 172.21.15.17:0/1726509633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cf440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009870 tx=0x7f1f3002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb21316154129d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.978+0000 7f1f37fff640 1 -- 172.21.15.17:0/1726509633 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30031640 con 0x7f1f400b86e0 2023-08-09T12:40:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.978+0000 7f1f37fff640 1 -- 172.21.15.17:0/1726509633 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f300317a0 con 0x7f1f400b86e0 2023-08-09T12:40:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.978+0000 7f1f37fff640 1 -- 172.21.15.17:0/1726509633 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30031b30 con 0x7f1f400b86e0 2023-08-09T12:40:51.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.979+0000 7f1f467dd640 1 -- 172.21.15.17:0/1726509633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 msgr2=0x7f1f400cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:51.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.979+0000 7f1f467dd640 1 --2- 172.21.15.17:0/1726509633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cf440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009870 tx=0x7f1f3002b8f0 comp rx=0 tx=0).stop 2023-08-09T12:40:51.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.979+0000 7f1f467dd640 1 -- 172.21.15.17:0/1726509633 shutdown_connections 2023-08-09T12:40:51.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.979+0000 7f1f467dd640 1 --2- 172.21.15.17:0/1726509633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 0x7f1f400d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.979+0000 7f1f467dd640 1 --2- 172.21.15.17:0/1726509633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cf440 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.979+0000 7f1f467dd640 1 -- 172.21.15.17:0/1726509633 >> 172.21.15.17:0/1726509633 conn(0x7f1f400697c0 msgr2=0x7f1f40069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.979+0000 7f1f467dd640 1 -- 172.21.15.17:0/1726509633 shutdown_connections 2023-08-09T12:40:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.979+0000 7f1f467dd640 1 -- 172.21.15.17:0/1726509633 wait complete. 2023-08-09T12:40:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.981+0000 7f1f467dd640 1 Processor -- start 2023-08-09T12:40:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.981+0000 7f1f467dd640 1 -- start start 2023-08-09T12:40:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f467dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f467dd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 0x7f1f40153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f467dd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f40160030 0x7f1f401f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f467dd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40158210 con 0x7f1f400b86e0 2023-08-09T12:40:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f467dd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400cbb10 con 0x7f1f40160030 2023-08-09T12:40:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f467dd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400ccaa0 con 0x7f1f400cf980 2023-08-09T12:40:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f457db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f457db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58862/0 (socket says 172.21.15.17:58862) 2023-08-09T12:40:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f457db640 1 -- 172.21.15.17:0/4208510361 learned_addr learned my addr 172.21.15.17:0/4208510361 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f457db640 1 -- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 msgr2=0x7f1f40153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f44fda640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 0x7f1f40153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f457db640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 0x7f1f40153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f457db640 1 -- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f40160030 msgr2=0x7f1f401f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.982+0000 7f1f45fdc640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f40160030 0x7f1f401f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f457db640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f40160030 0x7f1f401f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f457db640 1 -- 172.21.15.17:0/4208510361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300094d0 con 0x7f1f400b86e0 2023-08-09T12:40:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f45fdc640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f40160030 0x7f1f401f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f457db640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cc560 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00b420 tx=0x7f1f3c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f35ffb640 1 -- 172.21.15.17:0/4208510361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c011830 con 0x7f1f400b86e0 2023-08-09T12:40:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f35ffb640 1 -- 172.21.15.17:0/4208510361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c011990 con 0x7f1f400b86e0 2023-08-09T12:40:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f35ffb640 1 -- 172.21.15.17:0/4208510361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c011d40 con 0x7f1f400b86e0 2023-08-09T12:40:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f401f61a0 con 0x7f1f400b86e0 2023-08-09T12:40:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.983+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f400cbd60 con 0x7f1f400b86e0 2023-08-09T12:40:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.985+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4004e390 con 0x7f1f400b86e0 2023-08-09T12:40:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.986+0000 7f1f35ffb640 1 -- 172.21.15.17:0/4208510361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f3c01b460 con 0x7f1f400b86e0 2023-08-09T12:40:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.986+0000 7f1f35ffb640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f2406a050 0x7f1f2406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.987+0000 7f1f35ffb640 1 -- 172.21.15.17:0/4208510361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f3c088220 con 0x7f1f400b86e0 2023-08-09T12:40:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.987+0000 7f1f44fda640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f2406a050 0x7f1f2406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.989+0000 7f1f44fda640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f2406a050 0x7f1f2406c510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f30036000 tx=0x7f1f3003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:51.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:51.991+0000 7f1f35ffb640 1 -- 172.21.15.17:0/4208510361 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1f3c053870 con 0x7f1f400b86e0 2023-08-09T12:40:52.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.227+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f400d0640 con 0x7f1f400b86e0 2023-08-09T12:40:52.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.228+0000 7f1f35ffb640 1 -- 172.21.15.17:0/4208510361 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f1f3c056e90 con 0x7f1f400b86e0 2023-08-09T12:40:52.232 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:52.232 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:40:41.199722+0000","modified":"2023-08-09T12:40:44.738017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2993081476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2993081476},{"type":"v1","addr":"172.21.15.17:6835","nonce":2993081476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T12:40:52.232 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-08-09T12:40:52.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f2406a050 msgr2=0x7f1f2406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:52.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f2406a050 0x7f1f2406c510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f30036000 tx=0x7f1f3003c040 comp rx=0 tx=0).stop 2023-08-09T12:40:52.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 msgr2=0x7f1f400cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:52.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cc560 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00b420 tx=0x7f1f3c00b8e0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 shutdown_connections 2023-08-09T12:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f2406a050 0x7f1f2406c510 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f40160030 0x7f1f401f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f400cf980 0x7f1f40153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.231+0000 7f1f467dd640 1 --2- 172.21.15.17:0/4208510361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f400b86e0 0x7f1f400cc560 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.232+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 >> 172.21.15.17:0/4208510361 conn(0x7f1f400697c0 msgr2=0x7f1f4015f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.232+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 shutdown_connections 2023-08-09T12:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.232+0000 7f1f467dd640 1 -- 172.21.15.17:0/4208510361 wait complete. 2023-08-09T12:40:52.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-09T12:40:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":5148,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.783533569999999,"mdsmap_epoch":17,"osdmap_epoch":37,"osdmap_epoch_barrier":37,"uptime":20.199761857999999} 2023-08-09T12:40:52.499 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 5148, "mdsmap_epoch": 17, "osdmap_epoch": 37, "osdmap_epoch_barrier": 37, "rank_uptime": 10.78353357, "state": "up:active", "uptime": 20.199761858, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:40:52.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-08-09T12:40:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.728+0000 7f6c0cc71640 1 Processor -- start 2023-08-09T12:40:52.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.728+0000 7f6c0cc71640 1 -- start start 2023-08-09T12:40:52.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.729+0000 7f6c0cc71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 0x7f6c080cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:52.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.729+0000 7f6c0cc71640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c080cffd0 0x7f6c080b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:52.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.729+0000 7f6c0cc71640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c080b8030 con 0x7f6c0815cea0 2023-08-09T12:40:52.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.729+0000 7f6c0cc71640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c080d0440 con 0x7f6c080cffd0 2023-08-09T12:40:52.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.729+0000 7f6c0cc71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080b7790 con 0x7f6c0815cac0 2023-08-09T12:40:52.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.730+0000 7f6c06d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c080cffd0 0x7f6c080b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:52.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.730+0000 7f6c06d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c080cffd0 0x7f6c080b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58864/0 (socket says 172.21.15.17:58864) 2023-08-09T12:40:52.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.730+0000 7f6c06d9d640 1 -- 172.21.15.17:0/1441932023 learned_addr learned my addr 172.21.15.17:0/1441932023 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:52.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.730+0000 7f6c0659c640 1 --2- 172.21.15.17:0/1441932023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 0x7f6c080cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:52.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.731+0000 7f6c06d9d640 1 -- 172.21.15.17:0/1441932023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 msgr2=0x7f6c080cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:52.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.731+0000 7f6c06d9d640 1 --2- 172.21.15.17:0/1441932023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 0x7f6c080cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.731+0000 7f6c06d9d640 1 -- 172.21.15.17:0/1441932023 >> v1:172.21.15.142:6789/0 conn(0x7f6c0815cea0 legacy=0x7f6c080d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:52.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.731+0000 7f6c06d9d640 1 -- 172.21.15.17:0/1441932023 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c080b7a70 con 0x7f6c080cffd0 2023-08-09T12:40:52.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.732+0000 7f6c06d9d640 1 --2- 172.21.15.17:0/1441932023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c080b6bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009e50 tx=0x7f6c0002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dc5962b372370 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:52.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.733+0000 7f6c05d9b640 1 -- 172.21.15.17:0/1441932023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0002ca70 con 0x7f6c080cffd0 2023-08-09T12:40:52.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.733+0000 7f6c05d9b640 1 -- 172.21.15.17:0/1441932023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0002cbd0 con 0x7f6c080cffd0 2023-08-09T12:40:52.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.733+0000 7f6c05d9b640 1 -- 172.21.15.17:0/1441932023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000343f0 con 0x7f6c080cffd0 2023-08-09T12:40:52.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.734+0000 7f6c0cc71640 1 -- 172.21.15.17:0/1441932023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 msgr2=0x7f6c080b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:52.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.734+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/1441932023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c080b6bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009e50 tx=0x7f6c0002bed0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.734+0000 7f6c0cc71640 1 -- 172.21.15.17:0/1441932023 shutdown_connections 2023-08-09T12:40:52.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.734+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/1441932023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c080b6bf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.734+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/1441932023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 0x7f6c080cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.734+0000 7f6c0cc71640 1 -- 172.21.15.17:0/1441932023 >> 172.21.15.17:0/1441932023 conn(0x7f6c080699a0 msgr2=0x7f6c08069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:52.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.734+0000 7f6c0cc71640 1 -- 172.21.15.17:0/1441932023 shutdown_connections 2023-08-09T12:40:52.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.734+0000 7f6c0cc71640 1 -- 172.21.15.17:0/1441932023 wait complete. 2023-08-09T12:40:52.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.736+0000 7f6c0cc71640 1 Processor -- start 2023-08-09T12:40:52.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.736+0000 7f6c0cc71640 1 -- start start 2023-08-09T12:40:52.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.737+0000 7f6c0cc71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c081f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:52.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.737+0000 7f6c0cc71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 0x7f6c080b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:52.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.737+0000 7f6c0cc71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c0815cea0 0x7f6c0814ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:52.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.737+0000 7f6c0cc71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c081601c0 con 0x7f6c080cffd0 2023-08-09T12:40:52.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.737+0000 7f6c0cc71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c081f6770 con 0x7f6c0815cea0 2023-08-09T12:40:52.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.737+0000 7f6c0cc71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0814bd20 con 0x7f6c0815cac0 2023-08-09T12:40:52.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.737+0000 7f6c0659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c081f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:52.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6c0659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c081f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58866/0 (socket says 172.21.15.17:58866) 2023-08-09T12:40:52.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6c0659c640 1 -- 172.21.15.17:0/2767288516 learned_addr learned my addr 172.21.15.17:0/2767288516 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:52.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6c0659c640 1 -- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 msgr2=0x7f6c080b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:52.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6c0659c640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 0x7f6c080b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6c0659c640 1 -- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c0815cea0 msgr2=0x7f6c0814ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:52.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6c0659c640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c0815cea0 0x7f6c0814ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:52.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6c0659c640 1 -- 172.21.15.17:0/2767288516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009b30 con 0x7f6c080cffd0 2023-08-09T12:40:52.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6c0659c640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c081f6230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c7f0 tx=0x7f6bf800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:52.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.738+0000 7f6bff7fe640 1 -- 172.21.15.17:0/2767288516 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8004220 con 0x7f6c080cffd0 2023-08-09T12:40:52.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.739+0000 7f6bff7fe640 1 -- 172.21.15.17:0/2767288516 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf80043a0 con 0x7f6c080cffd0 2023-08-09T12:40:52.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.739+0000 7f6bff7fe640 1 -- 172.21.15.17:0/2767288516 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8007860 con 0x7f6c080cffd0 2023-08-09T12:40:52.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.739+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0814c000 con 0x7f6c080cffd0 2023-08-09T12:40:52.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.739+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0814c5c0 con 0x7f6c080cffd0 2023-08-09T12:40:52.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.740+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c08067a80 con 0x7f6c080cffd0 2023-08-09T12:40:52.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.741+0000 7f6bff7fe640 1 -- 172.21.15.17:0/2767288516 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6bf8007bd0 con 0x7f6c080cffd0 2023-08-09T12:40:52.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.742+0000 7f6bff7fe640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6be806a050 0x7f6be806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:52.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.742+0000 7f6bff7fe640 1 -- 172.21.15.17:0/2767288516 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bf8088610 con 0x7f6c080cffd0 2023-08-09T12:40:52.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.743+0000 7f6bfdd9b640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6be806a050 0x7f6be806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:52.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.744+0000 7f6bfdd9b640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6be806a050 0x7f6be806c510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6c0815acc0 tx=0x7f6bf00079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:52.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:52.747+0000 7f6bff7fe640 1 -- 172.21.15.17:0/2767288516 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6bf8053c60 con 0x7f6c080cffd0 2023-08-09T12:40:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.016+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f6c080ced30 con 0x7f6c080cffd0 2023-08-09T12:40:53.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.017+0000 7f6bff7fe640 1 -- 172.21.15.17:0/2767288516 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1922 (secure 0 0 0) 0x7f6bf801e7a0 con 0x7f6c080cffd0 2023-08-09T12:40:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:53.020 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:40:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "stats": { 2023-08-09T12:40:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "total_bytes": 1600000000, 2023-08-09T12:40:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "total_avail_bytes": 1597420596, 2023-08-09T12:40:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "total_used_bytes": 2579404, 2023-08-09T12:40:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "total_used_raw_bytes": 2579404, 2023-08-09T12:40:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "total_used_raw_ratio": 0.0016121275257319212, 2023-08-09T12:40:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "num_osds": 8, 2023-08-09T12:40:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "num_per_pool_osds": 0, 2023-08-09T12:40:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "num_per_pool_omap_osds": 0 2023-08-09T12:40:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "stats_by_class": { 2023-08-09T12:40:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "hdd": { 2023-08-09T12:40:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "total_bytes": 1600000000, 2023-08-09T12:40:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "total_avail_bytes": 1597420596, 2023-08-09T12:40:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "total_used_bytes": 2579404, 2023-08-09T12:40:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "total_used_raw_bytes": 2579404, 2023-08-09T12:40:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "total_used_raw_ratio": 0.0016121275257319212 2023-08-09T12:40:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:40:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": ".mgr", 2023-08-09T12:40:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1, 2023-08-09T12:40:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "stats": { 2023-08-09T12:40:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "stored": 590368, 2023-08-09T12:40:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "objects": 2, 2023-08-09T12:40:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "kb_used": 577, 2023-08-09T12:40:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "bytes_used": 590368, 2023-08-09T12:40:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "percent_used": 0.00052973470883443952, 2023-08-09T12:40:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max_avail": 556934720 2023-08-09T12:40:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd", 2023-08-09T12:40:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2, 2023-08-09T12:40:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "stats": { 2023-08-09T12:40:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "stored": 0, 2023-08-09T12:40:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "objects": 0, 2023-08-09T12:40:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "kb_used": 0, 2023-08-09T12:40:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "bytes_used": 0, 2023-08-09T12:40:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "percent_used": 0, 2023-08-09T12:40:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max_avail": 556934720 2023-08-09T12:40:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephfs_metadata", 2023-08-09T12:40:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 5, 2023-08-09T12:40:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "stats": { 2023-08-09T12:40:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "stored": 2410, 2023-08-09T12:40:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "objects": 21, 2023-08-09T12:40:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "kb_used": 3, 2023-08-09T12:40:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "bytes_used": 2410, 2023-08-09T12:40:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "percent_used": 2.1636240035149967e-06, 2023-08-09T12:40:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max_avail": 556934720 2023-08-09T12:40:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:40:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:40:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephfs_data", 2023-08-09T12:40:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 6, 2023-08-09T12:40:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "stats": { 2023-08-09T12:40:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "stored": 0, 2023-08-09T12:40:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "objects": 0, 2023-08-09T12:40:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "kb_used": 0, 2023-08-09T12:40:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "bytes_used": 0, 2023-08-09T12:40:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "percent_used": 0, 2023-08-09T12:40:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max_avail": 556934720 2023-08-09T12:40:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:40:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:40:53.031 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:40:53.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6be806a050 msgr2=0x7f6be806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:53.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6be806a050 0x7f6be806c510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6c0815acc0 tx=0x7f6bf00079b0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 msgr2=0x7f6c081f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:53.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c081f6230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c7f0 tx=0x7f6bf800ccb0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 shutdown_connections 2023-08-09T12:40:53.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6be806a050 0x7f6be806c510 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c0815cea0 0x7f6c0814ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c0815cac0 0x7f6c080b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 --2- 172.21.15.17:0/2767288516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c080cffd0 0x7f6c081f6230 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 >> 172.21.15.17:0/2767288516 conn(0x7f6c080699a0 msgr2=0x7f6c080b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:53.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 shutdown_connections 2023-08-09T12:40:53.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.019+0000 7f6c0cc71640 1 -- 172.21.15.17:0/2767288516 wait complete. 2023-08-09T12:40:53.040 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:40:53.041 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:40:53.041 DEBUG:teuthology.orchestra.run.smithi017:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-09T12:40:53.041 DEBUG:teuthology.orchestra.run.smithi017:> os.fchmod(fd, 0O666) 2023-08-09T12:40:53.041 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(fd) 2023-08-09T12:40:53.042 DEBUG:teuthology.orchestra.run.smithi017:> os.close(fd) 2023-08-09T12:40:53.042 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:40:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:40:53.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:53.222 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:40:53.332 INFO:teuthology.orchestra.run.smithi017.stdout:client5361 2023-08-09T12:40:53.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:53.333 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client5361/osdmap') 2023-08-09T12:40:53.437 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 37 barrier 37 flags 0x588000 2023-08-09T12:40:53.437 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:53.437 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:53.438 INFO:teuthology.orchestra.run.smithi017.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:53.438 INFO:teuthology.orchestra.run.smithi017.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:53.438 INFO:teuthology.orchestra.run.smithi017.stdout:osd0 (1)172.21.15.17:6809 100% (exists, up) 100% -1 2023-08-09T12:40:53.438 INFO:teuthology.orchestra.run.smithi017.stdout:osd1 (1)172.21.15.17:6817 100% (exists, up) 100% -1 2023-08-09T12:40:53.438 INFO:teuthology.orchestra.run.smithi017.stdout:osd2 (1)172.21.15.17:6801 100% (exists, up) 100% -1 2023-08-09T12:40:53.438 INFO:teuthology.orchestra.run.smithi017.stdout:osd3 (1)172.21.15.17:6825 100% (exists, up) 100% -1 2023-08-09T12:40:53.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd4 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-08-09T12:40:53.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd5 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-08-09T12:40:53.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd6 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-08-09T12:40:53.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd7 (1)172.21.15.142:6817 100% (exists, up) 100% -1 2023-08-09T12:40:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records in 2023-08-09T12:40:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records out 2023-08-09T12:40:53.440 INFO:teuthology.orchestra.run.smithi017.stderr:900 bytes copied, 0.000138256 s, 6.5 MB/s 2023-08-09T12:40:53.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-08-09T12:40:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.664+0000 7f385cfc4640 1 Processor -- start 2023-08-09T12:40:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.664+0000 7f385cfc4640 1 -- start start 2023-08-09T12:40:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.665+0000 7f385cfc4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 0x7f38580ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.665+0000 7f385cfc4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385806fe10 con 0x7f38580b3fe0 2023-08-09T12:40:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.665+0000 7f385cfc4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3858159fb0 con 0x7f3858159bd0 2023-08-09T12:40:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.665+0000 7f385cfc4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580b11a0 con 0x7f3858069ed0 2023-08-09T12:40:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.666+0000 7f3856ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f38580b3fe0 0x7f38580697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59026/0 (socket says 172.21.15.17:59026) 2023-08-09T12:40:53.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.666+0000 7f3856ffd640 1 -- 172.21.15.17:0/4266984167 learned_addr learned my addr 172.21.15.17:0/4266984167 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:53.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.666+0000 7f3857fff640 1 --2- 172.21.15.17:0/4266984167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 0x7f38580ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:53.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.667+0000 7f3857fff640 1 -- 172.21.15.17:0/4266984167 >> v1:172.21.15.142:6789/0 conn(0x7f3858159bd0 legacy=0x7f3858070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:53.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.667+0000 7f3857fff640 1 -- 172.21.15.17:0/4266984167 >> v1:172.21.15.17:6789/0 conn(0x7f38580b3fe0 legacy=0x7f38580697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:53.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.667+0000 7f3857fff640 1 -- 172.21.15.17:0/4266984167 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858070970 con 0x7f3858069ed0 2023-08-09T12:40:53.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.668+0000 7f3857fff640 1 --2- 172.21.15.17:0/4266984167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 0x7f38580ca730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f38500097d0 tx=0x7f385002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940d9725c04bdbe server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:53.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f38567fc640 1 -- 172.21.15.17:0/4266984167 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850031800 con 0x7f3858069ed0 2023-08-09T12:40:53.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f38567fc640 1 -- 172.21.15.17:0/4266984167 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850031960 con 0x7f3858069ed0 2023-08-09T12:40:53.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f38567fc640 1 -- 172.21.15.17:0/4266984167 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850031cf0 con 0x7f3858069ed0 2023-08-09T12:40:53.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f385cfc4640 1 -- 172.21.15.17:0/4266984167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 msgr2=0x7f38580ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:53.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f385cfc4640 1 --2- 172.21.15.17:0/4266984167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 0x7f38580ca730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f38500097d0 tx=0x7f385002b8a0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f385cfc4640 1 -- 172.21.15.17:0/4266984167 shutdown_connections 2023-08-09T12:40:53.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f385cfc4640 1 --2- 172.21.15.17:0/4266984167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 0x7f38580ca730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f385cfc4640 1 -- 172.21.15.17:0/4266984167 >> 172.21.15.17:0/4266984167 conn(0x7f38580b1d50 msgr2=0x7f385806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:53.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f385cfc4640 1 -- 172.21.15.17:0/4266984167 shutdown_connections 2023-08-09T12:40:53.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.672+0000 7f385cfc4640 1 -- 172.21.15.17:0/4266984167 wait complete. 2023-08-09T12:40:53.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.674+0000 7f385cfc4640 1 Processor -- start 2023-08-09T12:40:53.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.674+0000 7f385cfc4640 1 -- start start 2023-08-09T12:40:53.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f385cfc4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 0x7f3858153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:53.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f385cfc4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38580b3fe0 0x7f38580c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:53.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f385cfc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3858159bd0 0x7f385815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:53.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f385cfc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38581541c0 con 0x7f3858159bd0 2023-08-09T12:40:53.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f385cfc4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580c3630 con 0x7f38580b3fe0 2023-08-09T12:40:53.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f385cfc4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580c3910 con 0x7f3858069ed0 2023-08-09T12:40:53.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f3857fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3858159bd0 0x7f385815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:53.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f3857fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3858159bd0 0x7f385815c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58872/0 (socket says 172.21.15.17:58872) 2023-08-09T12:40:53.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.675+0000 7f3857fff640 1 -- 172.21.15.17:0/2137781152 learned_addr learned my addr 172.21.15.17:0/2137781152 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:53.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f3857fff640 1 -- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 msgr2=0x7f3858153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:53.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f3857fff640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 0x7f3858153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f3856ffd640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38580b3fe0 0x7f38580c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:53.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f3857fff640 1 -- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38580b3fe0 msgr2=0x7f38580c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:53.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f3857fff640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38580b3fe0 0x7f38580c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:53.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f3857fff640 1 -- 172.21.15.17:0/2137781152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850009400 con 0x7f3858159bd0 2023-08-09T12:40:53.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f3857fff640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3858159bd0 0x7f385815c160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f38500098f0 tx=0x7f38500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:53.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f383ffff640 1 -- 172.21.15.17:0/2137781152 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385003bc40 con 0x7f3858159bd0 2023-08-09T12:40:53.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f383ffff640 1 -- 172.21.15.17:0/2137781152 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385003bda0 con 0x7f3858159bd0 2023-08-09T12:40:53.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580c3bf0 con 0x7f3858159bd0 2023-08-09T12:40:53.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.676+0000 7f383ffff640 1 -- 172.21.15.17:0/2137781152 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850045630 con 0x7f3858159bd0 2023-08-09T12:40:53.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.677+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580c3250 con 0x7f3858159bd0 2023-08-09T12:40:53.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.678+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38580c33e0 con 0x7f3858159bd0 2023-08-09T12:40:53.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.678+0000 7f383ffff640 1 -- 172.21.15.17:0/2137781152 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3850045790 con 0x7f3858159bd0 2023-08-09T12:40:53.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.679+0000 7f383ffff640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384406a050 0x7f384406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:53.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.679+0000 7f383ffff640 1 -- 172.21.15.17:0/2137781152 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f385002e070 con 0x7f3858159bd0 2023-08-09T12:40:53.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.680+0000 7f38577fe640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384406a050 0x7f384406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:53.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.681+0000 7f38577fe640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384406a050 0x7f384406c510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3848000f60 tx=0x7f38480079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:53.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.684+0000 7f383ffff640 1 -- 172.21.15.17:0/2137781152 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3850076160 con 0x7f3858159bd0 2023-08-09T12:40:53.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:53.886+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f38580cac40 con 0x7f3858159bd0 2023-08-09T12:40:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.686+0000 7f383ffff640 1 -- 172.21.15.17:0/2137781152 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v38) v1 ==== 93+0+0 (secure 0 0 0) 0x7f3850079780 con 0x7f3858159bd0 2023-08-09T12:40:54.690 INFO:teuthology.orchestra.run.smithi017.stderr:pauserd,pausewr is set 2023-08-09T12:40:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384406a050 msgr2=0x7f384406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384406a050 0x7f384406c510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3848000f60 tx=0x7f38480079b0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3858159bd0 msgr2=0x7f385815c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3858159bd0 0x7f385815c160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f38500098f0 tx=0x7f38500046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 shutdown_connections 2023-08-09T12:40:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384406a050 0x7f384406c510 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3858159bd0 0x7f385815c160 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38580b3fe0 0x7f38580c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 --2- 172.21.15.17:0/2137781152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3858069ed0 0x7f3858153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.689+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 >> 172.21.15.17:0/2137781152 conn(0x7f38580b1d50 msgr2=0x7f38580cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:54.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.690+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 shutdown_connections 2023-08-09T12:40:54.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.690+0000 7f385cfc4640 1 -- 172.21.15.17:0/2137781152 wait complete. 2023-08-09T12:40:54.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-08-09T12:40:54.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.943+0000 7f0167fff640 1 Processor -- start 2023-08-09T12:40:54.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.943+0000 7f0167fff640 1 -- start start 2023-08-09T12:40:54.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0167fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f01680b0ac0 0x7f01680b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:54.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0167fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b0ea0 0x7f01680caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:54.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0167fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680b3b60 con 0x7f01680c8d40 2023-08-09T12:40:54.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0167fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01681617b0 con 0x7f01680b0ac0 2023-08-09T12:40:54.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0167fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680b3550 con 0x7f01680b0ea0 2023-08-09T12:40:54.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0166ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f01680b0ac0 0x7f01680b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:54.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0166ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f01680b0ac0 0x7f01680b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58888/0 (socket says 172.21.15.17:58888) 2023-08-09T12:40:54.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f01677fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f01680c8d40 0x7f016806ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59034/0 (socket says 172.21.15.17:59034) 2023-08-09T12:40:54.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f01677fe640 1 -- 172.21.15.17:0/185026773 learned_addr learned my addr 172.21.15.17:0/185026773 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:54.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f015ffff640 1 --2- 172.21.15.17:0/185026773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b0ea0 0x7f01680caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:54.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0166ffd640 1 -- 172.21.15.17:0/185026773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b0ea0 msgr2=0x7f01680caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:54.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0166ffd640 1 --2- 172.21.15.17:0/185026773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b0ea0 0x7f01680caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0166ffd640 1 -- 172.21.15.17:0/185026773 >> v1:172.21.15.17:6789/0 conn(0x7f01680c8d40 legacy=0x7f016806ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:54.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.945+0000 7f0166ffd640 1 -- 172.21.15.17:0/185026773 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680c9e10 con 0x7f01680b0ac0 2023-08-09T12:40:54.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.946+0000 7f0166ffd640 1 --2- 172.21.15.17:0/185026773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ac0 0x7f01680b3ff0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f01580097a0 tx=0x7f015802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a7311ca8772217 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:54.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.946+0000 7f01667fc640 1 -- 172.21.15.17:0/185026773 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015802d040 con 0x7f01680b0ac0 2023-08-09T12:40:54.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.946+0000 7f01667fc640 1 -- 172.21.15.17:0/185026773 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158031810 con 0x7f01680b0ac0 2023-08-09T12:40:54.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.946+0000 7f01667fc640 1 -- 172.21.15.17:0/185026773 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158031ba0 con 0x7f01680b0ac0 2023-08-09T12:40:54.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.947+0000 7f0167fff640 1 -- 172.21.15.17:0/185026773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ac0 msgr2=0x7f01680b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:54.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.947+0000 7f0167fff640 1 --2- 172.21.15.17:0/185026773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ac0 0x7f01680b3ff0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f01580097a0 tx=0x7f015802b8b0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.947+0000 7f0167fff640 1 -- 172.21.15.17:0/185026773 shutdown_connections 2023-08-09T12:40:54.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.947+0000 7f0167fff640 1 --2- 172.21.15.17:0/185026773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680b0ea0 0x7f01680caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.947+0000 7f0167fff640 1 --2- 172.21.15.17:0/185026773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ac0 0x7f01680b3ff0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.947+0000 7f0167fff640 1 -- 172.21.15.17:0/185026773 >> 172.21.15.17:0/185026773 conn(0x7f01680b1d50 msgr2=0x7f016806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:54.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.947+0000 7f0167fff640 1 -- 172.21.15.17:0/185026773 shutdown_connections 2023-08-09T12:40:54.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.947+0000 7f0167fff640 1 -- 172.21.15.17:0/185026773 wait complete. 2023-08-09T12:40:54.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.949+0000 7f0167fff640 1 Processor -- start 2023-08-09T12:40:54.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.949+0000 7f0167fff640 1 -- start start 2023-08-09T12:40:54.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f0167fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01680b0ac0 0x7f016815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:54.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f0167fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ea0 0x7f01680c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:54.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f0167fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680c8d40 0x7f01680bf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:54.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f0167fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680be100 con 0x7f01680b0ea0 2023-08-09T12:40:54.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f0167fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016815e5c0 con 0x7f01680b0ac0 2023-08-09T12:40:54.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f0167fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680c7730 con 0x7f01680c8d40 2023-08-09T12:40:54.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f015ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ea0 0x7f01680c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:54.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f015ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ea0 0x7f01680c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58896/0 (socket says 172.21.15.17:58896) 2023-08-09T12:40:54.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.950+0000 7f015ffff640 1 -- 172.21.15.17:0/4018627079 learned_addr learned my addr 172.21.15.17:0/4018627079 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:54.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.951+0000 7f015ffff640 1 -- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680c8d40 msgr2=0x7f01680bf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:54.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.951+0000 7f015ffff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680c8d40 0x7f01680bf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.951+0000 7f015ffff640 1 -- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01680b0ac0 msgr2=0x7f016815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:54.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.951+0000 7f0166ffd640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01680b0ac0 0x7f016815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:54.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.951+0000 7f015ffff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01680b0ac0 0x7f016815e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:54.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.951+0000 7f015ffff640 1 -- 172.21.15.17:0/4018627079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009400 con 0x7f01680b0ea0 2023-08-09T12:40:54.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.951+0000 7f015ffff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ea0 0x7f01680c71f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f015000d800 tx=0x7f015000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:54.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.951+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000b6c0 con 0x7f01680b0ea0 2023-08-09T12:40:54.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.952+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015000b820 con 0x7f01680b0ea0 2023-08-09T12:40:54.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.952+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000bbb0 con 0x7f01680b0ea0 2023-08-09T12:40:54.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.952+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0168162ac0 con 0x7f01680b0ea0 2023-08-09T12:40:54.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.952+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0168163080 con 0x7f01680b0ea0 2023-08-09T12:40:54.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.953+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016804e390 con 0x7f01680b0ea0 2023-08-09T12:40:54.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.954+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f015000bd10 con 0x7f01680b0ea0 2023-08-09T12:40:54.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.955+0000 7f0164ff9640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014806a050 0x7f014806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:54.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.955+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0150088b30 con 0x7f01680b0ea0 2023-08-09T12:40:54.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.955+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=39+}) v3 -- 0x7f01480721a0 con 0x7f01680b0ea0 2023-08-09T12:40:54.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.955+0000 7f0166ffd640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014806a050 0x7f014806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:54.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.957+0000 7f0166ffd640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014806a050 0x7f014806c510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0158036000 tx=0x7f015803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:54.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:54.960+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0150054210 con 0x7f01680b0ea0 2023-08-09T12:40:55.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.161+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f01680b2da0 con 0x7f01680b0ea0 2023-08-09T12:40:55.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.727+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(39..39 src has 1..39) v4 ==== 288+0+0 (secure 0 0 0) 0x7f0150058560 con 0x7f01680b0ea0 2023-08-09T12:40:55.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.727+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=40}) v3 -- 0x7f0148072a50 con 0x7f01680b0ea0 2023-08-09T12:40:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.733+0000 7f0164ff9640 1 -- 172.21.15.17:0/4018627079 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0150057830 con 0x7f01680b0ea0 2023-08-09T12:40:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:pauserd,pausewr is unset 2023-08-09T12:40:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014806a050 msgr2=0x7f014806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014806a050 0x7f014806c510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0158036000 tx=0x7f015803c040 comp rx=0 tx=0).stop 2023-08-09T12:40:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ea0 msgr2=0x7f01680c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ea0 0x7f01680c71f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f015000d800 tx=0x7f015000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:40:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 shutdown_connections 2023-08-09T12:40:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f014806a050 0x7f014806c510 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01680c8d40 0x7f01680bf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01680b0ea0 0x7f01680c71f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 --2- 172.21.15.17:0/4018627079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01680b0ac0 0x7f016815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.739+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 >> 172.21.15.17:0/4018627079 conn(0x7f01680b1d50 msgr2=0x7f016806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.740+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 shutdown_connections 2023-08-09T12:40:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.740+0000 7f0167fff640 1 -- 172.21.15.17:0/4018627079 wait complete. 2023-08-09T12:40:55.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:55.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.990+0000 7fa8292fb640 1 Processor -- start 2023-08-09T12:40:55.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.990+0000 7fa8292fb640 1 -- start start 2023-08-09T12:40:55.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.992+0000 7fa8292fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa824070f00 0x7fa82415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:55.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.992+0000 7fa8292fb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa824071340 con 0x7fa82415bce0 2023-08-09T12:40:55.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.992+0000 7fa8292fb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8240715c0 con 0x7fa8241587e0 2023-08-09T12:40:55.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.992+0000 7fa8292fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240718a0 con 0x7fa824070f00 2023-08-09T12:40:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa828afa640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa82415bce0 0x7fa8240cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59050/0 (socket says 172.21.15.17:59050) 2023-08-09T12:40:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa828afa640 1 -- 172.21.15.17:0/3907637659 learned_addr learned my addr 172.21.15.17:0/3907637659 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa81bfff640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa824070f00 0x7fa82415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115763378 0 0) 0x7fa824071340 con 0x7fa82415bce0 2023-08-09T12:40:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa810003520 con 0x7fa82415bce0 2023-08-09T12:40:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1961031758 0 0) 0x7fa810003520 con 0x7fa82415bce0 2023-08-09T12:40:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa824070f00 msgr2=0x7fa82415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa8237fe640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa824070f00 0x7fa82415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 >> v1:172.21.15.142:6789/0 conn(0x7fa8241587e0 legacy=0x7fa8240b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa824071b80 con 0x7fa82415bce0 2023-08-09T12:40:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.993+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa81c0019f0 con 0x7fa82415bce0 2023-08-09T12:40:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 >> v1:172.21.15.17:6789/0 conn(0x7fa82415bce0 legacy=0x7fa8240cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa8237fe640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8100039a0 0x7fa810003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa8237fe640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa824070f00 0x7fa8100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa8237fe640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa810004d00 0x7fa810005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240718a0 con 0x7fa810004d00 2023-08-09T12:40:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81000ba30 con 0x7fa8100039a0 2023-08-09T12:40:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81000bbf0 con 0x7fa824070f00 2023-08-09T12:40:55.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa828afa640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa810004d00 0x7fa810005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:55.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa823fff640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8100039a0 0x7fa810003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa81bfff640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa824070f00 0x7fa8100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa828afa640 1 -- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa824070f00 msgr2=0x7fa8100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:56.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa828afa640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa824070f00 0x7fa8100047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa828afa640 1 -- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8100039a0 msgr2=0x7fa810003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa828afa640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8100039a0 0x7fa810003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.994+0000 7fa828afa640 1 -- 172.21.15.17:0/3907637659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810003520 con 0x7fa810004d00 2023-08-09T12:40:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.996+0000 7fa828afa640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa810004d00 0x7fa810005180 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa8240b0740 tx=0x7fa8100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b50872d3a8ba31 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.996+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0072d0 con 0x7fa810004d00 2023-08-09T12:40:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.996+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c02f070 con 0x7fa810004d00 2023-08-09T12:40:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.996+0000 7fa8237fe640 1 -- 172.21.15.17:0/3907637659 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0076b0 con 0x7fa810004d00 2023-08-09T12:40:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.996+0000 7fa8292fb640 1 -- 172.21.15.17:0/3907637659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa810004d00 msgr2=0x7fa810005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.996+0000 7fa8292fb640 1 --2- 172.21.15.17:0/3907637659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa810004d00 0x7fa810005180 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa8240b0740 tx=0x7fa8100057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.996+0000 7fa828afa640 1 -- 172.21.15.17:0/3907637659 reap_dead start 2023-08-09T12:40:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.996+0000 7fa8292fb640 1 -- 172.21.15.17:0/3907637659 shutdown_connections 2023-08-09T12:40:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.997+0000 7fa8292fb640 1 -- 172.21.15.17:0/3907637659 >> 172.21.15.17:0/3907637659 conn(0x7fa8240b1d50 msgr2=0x7fa82406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.997+0000 7fa8292fb640 1 -- 172.21.15.17:0/3907637659 shutdown_connections 2023-08-09T12:40:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.997+0000 7fa8292fb640 1 -- 172.21.15.17:0/3907637659 wait complete. 2023-08-09T12:40:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.998+0000 7fa8292fb640 1 Processor -- start 2023-08-09T12:40:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.999+0000 7fa8292fb640 1 -- start start 2023-08-09T12:40:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.999+0000 7fa8292fb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810004d00 0x7fa8240c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.999+0000 7fa8292fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240c9520 0x7fa8240ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:55.999+0000 7fa8292fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240caa20 0x7fa8240b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa8292fb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240c4e50 con 0x7fa8240caa20 2023-08-09T12:40:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa8292fb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8241571d0 con 0x7fa810004d00 2023-08-09T12:40:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa8292fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8241574b0 con 0x7fa8240c9520 2023-08-09T12:40:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa828afa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240caa20 0x7fa8240b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa828afa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240caa20 0x7fa8240b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58908/0 (socket says 172.21.15.17:58908) 2023-08-09T12:40:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa828afa640 1 -- 172.21.15.17:0/3529637838 learned_addr learned my addr 172.21.15.17:0/3529637838 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa823fff640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810004d00 0x7fa8240c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa81bfff640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240c9520 0x7fa8240ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa828afa640 1 -- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240c9520 msgr2=0x7fa8240ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa828afa640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240c9520 0x7fa8240ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa828afa640 1 -- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810004d00 msgr2=0x7fa8240c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa828afa640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810004d00 0x7fa8240c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa828afa640 1 -- 172.21.15.17:0/3529637838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa824157790 con 0x7fa8240caa20 2023-08-09T12:40:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.000+0000 7fa823fff640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810004d00 0x7fa8240c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.001+0000 7fa828afa640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240caa20 0x7fa8240b28c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa81c02caf0 tx=0x7fa81c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.001+0000 7fa8217fa640 1 -- 172.21.15.17:0/3529637838 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0019b0 con 0x7fa8240caa20 2023-08-09T12:40:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.001+0000 7fa8217fa640 1 -- 172.21.15.17:0/3529637838 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c004e10 con 0x7fa8240caa20 2023-08-09T12:40:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.001+0000 7fa8217fa640 1 -- 172.21.15.17:0/3529637838 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0072d0 con 0x7fa8240caa20 2023-08-09T12:40:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.001+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8240c8d20 con 0x7fa8240caa20 2023-08-09T12:40:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.001+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824156e60 con 0x7fa8240caa20 2023-08-09T12:40:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.002+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82404e390 con 0x7fa8240caa20 2023-08-09T12:40:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.003+0000 7fa8217fa640 1 -- 172.21.15.17:0/3529637838 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa81c031030 con 0x7fa8240caa20 2023-08-09T12:40:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.004+0000 7fa8217fa640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80406a080 0x7fa80406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.004+0000 7fa8217fa640 1 -- 172.21.15.17:0/3529637838 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa81c0aa170 con 0x7fa8240caa20 2023-08-09T12:40:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.005+0000 7fa823fff640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80406a080 0x7fa80406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.006+0000 7fa823fff640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80406a080 0x7fa80406c540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa82414f3d0 tx=0x7fa814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.008+0000 7fa8217fa640 1 -- 172.21.15.17:0/3529637838 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa81c075850 con 0x7fa8240caa20 2023-08-09T12:40:56.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.202+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa82404e390 con 0x7fa8240caa20 2023-08-09T12:40:56.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.205+0000 7fa8217fa640 1 -- 172.21.15.17:0/3529637838 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fa81c078e70 con 0x7fa8240caa20 2023-08-09T12:40:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:56.208 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:55.723309+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80406a080 msgr2=0x7fa80406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80406a080 0x7fa80406c540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa82414f3d0 tx=0x7fa814009040 comp rx=0 tx=0).stop 2023-08-09T12:40:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240caa20 msgr2=0x7fa8240b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240caa20 0x7fa8240b28c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa81c02caf0 tx=0x7fa81c001d80 comp rx=0 tx=0).stop 2023-08-09T12:40:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 shutdown_connections 2023-08-09T12:40:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80406a080 0x7fa80406c540 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240caa20 0x7fa8240b28c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240c9520 0x7fa8240ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 --2- 172.21.15.17:0/3529637838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810004d00 0x7fa8240c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 >> 172.21.15.17:0/3529637838 conn(0x7fa8240b1d50 msgr2=0x7fa82406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 shutdown_connections 2023-08-09T12:40:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.208+0000 7fa8292fb640 1 -- 172.21.15.17:0/3529637838 wait complete. 2023-08-09T12:40:56.230 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:40:56.230 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:40:56.230 DEBUG:teuthology.orchestra.run.smithi017:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-09T12:40:56.231 DEBUG:teuthology.orchestra.run.smithi017:> os.fchmod(fd, 0O666) 2023-08-09T12:40:56.231 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(fd) 2023-08-09T12:40:56.231 DEBUG:teuthology.orchestra.run.smithi017:> os.close(fd) 2023-08-09T12:40:56.232 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:40:56.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:40:56.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:56.400 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:40:56.507 INFO:teuthology.orchestra.run.smithi017.stdout:client5361 2023-08-09T12:40:56.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:56.508 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client5361/osdmap') 2023-08-09T12:40:56.614 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 37 barrier 37 flags 0x588000 2023-08-09T12:40:56.614 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:56.614 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:56.615 INFO:teuthology.orchestra.run.smithi017.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:56.615 INFO:teuthology.orchestra.run.smithi017.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:56.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd0 (1)172.21.15.17:6809 100% (exists, up) 100% -1 2023-08-09T12:40:56.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd1 (1)172.21.15.17:6817 100% (exists, up) 100% -1 2023-08-09T12:40:56.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd2 (1)172.21.15.17:6801 100% (exists, up) 100% -1 2023-08-09T12:40:56.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd3 (1)172.21.15.17:6825 100% (exists, up) 100% -1 2023-08-09T12:40:56.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd4 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-08-09T12:40:56.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd5 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-08-09T12:40:56.616 INFO:teuthology.orchestra.run.smithi017.stdout:osd6 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-08-09T12:40:56.616 INFO:teuthology.orchestra.run.smithi017.stdout:osd7 (1)172.21.15.142:6817 100% (exists, up) 100% -1 2023-08-09T12:40:56.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records in 2023-08-09T12:40:56.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records out 2023-08-09T12:40:56.617 INFO:teuthology.orchestra.run.smithi017.stderr:900 bytes copied, 9.8712e-05 s, 9.1 MB/s 2023-08-09T12:40:56.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:40:56.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.848+0000 7fb395937640 1 Processor -- start 2023-08-09T12:40:56.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.848+0000 7fb395937640 1 -- start start 2023-08-09T12:40:56.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.849+0000 7fb395937640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3901587e0 0x7fb390070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.849+0000 7fb395937640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900cb070 0x7fb3900cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.849+0000 7fb395937640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39015beb0 con 0x7fb3900b0b10 2023-08-09T12:40:56.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.849+0000 7fb395937640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900cba20 con 0x7fb3901587e0 2023-08-09T12:40:56.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.849+0000 7fb395937640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900715c0 con 0x7fb3900cb070 2023-08-09T12:40:56.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.850+0000 7fb394935640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3901587e0 0x7fb390070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.850+0000 7fb394935640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3901587e0 0x7fb390070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58918/0 (socket says 172.21.15.17:58918) 2023-08-09T12:40:56.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.850+0000 7fb394935640 1 -- 172.21.15.17:0/2969115076 learned_addr learned my addr 172.21.15.17:0/2969115076 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:56.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.850+0000 7fb395136640 1 --2- 172.21.15.17:0/2969115076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900cb070 0x7fb3900cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.850+0000 7fb394935640 1 -- 172.21.15.17:0/2969115076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900cb070 msgr2=0x7fb3900cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:56.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.850+0000 7fb394935640 1 --2- 172.21.15.17:0/2969115076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900cb070 0x7fb3900cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.850+0000 7fb394935640 1 -- 172.21.15.17:0/2969115076 >> v1:172.21.15.17:6789/0 conn(0x7fb3900b0b10 legacy=0x7fb39015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.851+0000 7fb394935640 1 -- 172.21.15.17:0/2969115076 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3900718a0 con 0x7fb3901587e0 2023-08-09T12:40:56.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.850+0000 7fb38f7fe640 1 -- 172.21.15.17:0/2969115076 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335980790 0 0) 0x7fb39015beb0 con 0x7fb3900b0b10 2023-08-09T12:40:56.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.852+0000 7fb394935640 1 --2- 172.21.15.17:0/2969115076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb390070f00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb384009870 tx=0x7fb38402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9445e0de9e473f73 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:56.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.852+0000 7fb38f7fe640 1 -- 172.21.15.17:0/2969115076 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384030840 con 0x7fb3901587e0 2023-08-09T12:40:56.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.852+0000 7fb38f7fe640 1 -- 172.21.15.17:0/2969115076 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3840309a0 con 0x7fb3901587e0 2023-08-09T12:40:56.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.852+0000 7fb38f7fe640 1 -- 172.21.15.17:0/2969115076 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384030d30 con 0x7fb3901587e0 2023-08-09T12:40:56.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.853+0000 7fb395937640 1 -- 172.21.15.17:0/2969115076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 msgr2=0x7fb390070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.853+0000 7fb395937640 1 --2- 172.21.15.17:0/2969115076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb390070f00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb384009870 tx=0x7fb38402b980 comp rx=0 tx=0).stop 2023-08-09T12:40:56.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.853+0000 7fb395937640 1 -- 172.21.15.17:0/2969115076 shutdown_connections 2023-08-09T12:40:56.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.853+0000 7fb395937640 1 --2- 172.21.15.17:0/2969115076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900cb070 0x7fb3900cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.853+0000 7fb395937640 1 --2- 172.21.15.17:0/2969115076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb390070f00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.853+0000 7fb395937640 1 -- 172.21.15.17:0/2969115076 >> 172.21.15.17:0/2969115076 conn(0x7fb3900b1d50 msgr2=0x7fb39006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:56.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.853+0000 7fb395937640 1 -- 172.21.15.17:0/2969115076 shutdown_connections 2023-08-09T12:40:56.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.853+0000 7fb395937640 1 -- 172.21.15.17:0/2969115076 wait complete. 2023-08-09T12:40:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.855+0000 7fb395937640 1 Processor -- start 2023-08-09T12:40:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.855+0000 7fb395937640 1 -- start start 2023-08-09T12:40:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395937640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900b0b10 0x7fb3901f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395937640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3900cb070 0x7fb3900c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395937640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb3901f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395937640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c2350 con 0x7fb3901587e0 2023-08-09T12:40:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395937640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c8610 con 0x7fb3900cb070 2023-08-09T12:40:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395937640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901f27c0 con 0x7fb3900b0b10 2023-08-09T12:40:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395136640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb3901f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395136640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb3901f32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58926/0 (socket says 172.21.15.17:58926) 2023-08-09T12:40:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.856+0000 7fb395136640 1 -- 172.21.15.17:0/121625014 learned_addr learned my addr 172.21.15.17:0/121625014 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb394935640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900b0b10 0x7fb3901f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb38ffff640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3900cb070 0x7fb3900c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb395136640 1 -- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900b0b10 msgr2=0x7fb3901f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb395136640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900b0b10 0x7fb3901f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb395136640 1 -- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3900cb070 msgr2=0x7fb3900c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb395136640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3900cb070 0x7fb3900c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb395136640 1 -- 172.21.15.17:0/121625014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840094d0 con 0x7fb3901587e0 2023-08-09T12:40:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb38ffff640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3900cb070 0x7fb3900c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb395136640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb3901f32c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb388007e70 tx=0x7fb38800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb38d7fa640 1 -- 172.21.15.17:0/121625014 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388014620 con 0x7fb3901587e0 2023-08-09T12:40:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb38d7fa640 1 -- 172.21.15.17:0/121625014 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3880147a0 con 0x7fb3901587e0 2023-08-09T12:40:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb38d7fa640 1 -- 172.21.15.17:0/121625014 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388014b50 con 0x7fb3901587e0 2023-08-09T12:40:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.857+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3901f2aa0 con 0x7fb3901587e0 2023-08-09T12:40:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.858+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3901f3060 con 0x7fb3901587e0 2023-08-09T12:40:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.859+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39004e390 con 0x7fb3901587e0 2023-08-09T12:40:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.860+0000 7fb38d7fa640 1 -- 172.21.15.17:0/121625014 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb388014cb0 con 0x7fb3901587e0 2023-08-09T12:40:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.860+0000 7fb38d7fa640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb37c06a050 0x7fb37c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.861+0000 7fb38d7fa640 1 -- 172.21.15.17:0/121625014 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb388088ff0 con 0x7fb3901587e0 2023-08-09T12:40:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.861+0000 7fb394935640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb37c06a050 0x7fb37c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:56.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.863+0000 7fb394935640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb37c06a050 0x7fb37c06c510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb384036000 tx=0x7fb384008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:56.865+0000 7fb38d7fa640 1 -- 172.21.15.17:0/121625014 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb3880bb7b0 con 0x7fb3901587e0 2023-08-09T12:40:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.097+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb39006b8d0 con 0x7fb3901587e0 2023-08-09T12:40:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.098+0000 7fb38d7fa640 1 -- 172.21.15.17:0/121625014 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4875 (secure 0 0 0) 0x7fb3880580f0 con 0x7fb3901587e0 2023-08-09T12:40:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:57.101 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:40:41.199722+0000","modified":"2023-08-09T12:40:44.738017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2993081476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2993081476},{"type":"v1","addr":"172.21.15.17:6835","nonce":2993081476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T12:40:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-08-09T12:40:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb37c06a050 msgr2=0x7fb37c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb37c06a050 0x7fb37c06c510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb384036000 tx=0x7fb384008030 comp rx=0 tx=0).stop 2023-08-09T12:40:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 msgr2=0x7fb3901f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb3901f32c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb388007e70 tx=0x7fb38800e4b0 comp rx=0 tx=0).stop 2023-08-09T12:40:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 shutdown_connections 2023-08-09T12:40:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb37c06a050 0x7fb37c06c510 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901587e0 0x7fb3901f32c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3900cb070 0x7fb3900c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:57.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 --2- 172.21.15.17:0/121625014 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3900b0b10 0x7fb3901f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:57.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.100+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 >> 172.21.15.17:0/121625014 conn(0x7fb3900b1d50 msgr2=0x7fb3900cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:57.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.101+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 shutdown_connections 2023-08-09T12:40:57.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57.101+0000 7fb395937640 1 -- 172.21.15.17:0/121625014 wait complete. 2023-08-09T12:40:57.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 39 2023-08-09T12:40:57.361 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-08-09T12:40:57.362 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:40:57.362 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:40:57.363 DEBUG:teuthology.orchestra.run.smithi017:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-09T12:40:57.363 DEBUG:teuthology.orchestra.run.smithi017:> os.fchmod(fd, 0O666) 2023-08-09T12:40:57.363 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(fd) 2023-08-09T12:40:57.363 DEBUG:teuthology.orchestra.run.smithi017:> os.close(fd) 2023-08-09T12:40:57.364 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:40:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:40:57.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:57.540 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:40:57.651 INFO:teuthology.orchestra.run.smithi017.stdout:client5361 2023-08-09T12:40:57.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:57.652 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client5361/osdmap') 2023-08-09T12:40:57.759 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 39 barrier 39 flags 0x588000 2023-08-09T12:40:57.759 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:57.759 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:57.760 INFO:teuthology.orchestra.run.smithi017.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:57.760 INFO:teuthology.orchestra.run.smithi017.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:57.760 INFO:teuthology.orchestra.run.smithi017.stdout:osd0 (1)172.21.15.17:6809 100% (exists, up) 100% -1 2023-08-09T12:40:57.760 INFO:teuthology.orchestra.run.smithi017.stdout:osd1 (1)172.21.15.17:6817 100% (exists, up) 100% -1 2023-08-09T12:40:57.760 INFO:teuthology.orchestra.run.smithi017.stdout:osd2 (1)172.21.15.17:6801 100% (exists, up) 100% -1 2023-08-09T12:40:57.760 INFO:teuthology.orchestra.run.smithi017.stdout:osd3 (1)172.21.15.17:6825 100% (exists, up) 100% -1 2023-08-09T12:40:57.761 INFO:teuthology.orchestra.run.smithi017.stdout:osd4 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-08-09T12:40:57.761 INFO:teuthology.orchestra.run.smithi017.stdout:osd5 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-08-09T12:40:57.761 INFO:teuthology.orchestra.run.smithi017.stdout:osd6 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-08-09T12:40:57.761 INFO:teuthology.orchestra.run.smithi017.stdout:osd7 (1)172.21.15.142:6817 100% (exists, up) 100% -1 2023-08-09T12:40:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records in 2023-08-09T12:40:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records out 2023-08-09T12:40:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:900 bytes copied, 0.000110181 s, 8.2 MB/s 2023-08-09T12:40:57.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:57.764 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:40:57.823 INFO:teuthology.orchestra.run.smithi017.stdout:client5361 2023-08-09T12:40:57.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:40:57.824 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client5361/osdmap') 2023-08-09T12:40:57.924 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 39 barrier 39 flags 0x588000 2023-08-09T12:40:57.924 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:57.924 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:57.924 INFO:teuthology.orchestra.run.smithi017.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:57.924 INFO:teuthology.orchestra.run.smithi017.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:40:57.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd0 (1)172.21.15.17:6809 100% (exists, up) 100% -1 2023-08-09T12:40:57.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd1 (1)172.21.15.17:6817 100% (exists, up) 100% -1 2023-08-09T12:40:57.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd2 (1)172.21.15.17:6801 100% (exists, up) 100% -1 2023-08-09T12:40:57.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd3 (1)172.21.15.17:6825 100% (exists, up) 100% -1 2023-08-09T12:40:57.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd4 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-08-09T12:40:57.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd5 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-08-09T12:40:57.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd6 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-08-09T12:40:57.926 INFO:teuthology.orchestra.run.smithi017.stdout:osd7 (1)172.21.15.142:6817 100% (exists, up) 100% -1 2023-08-09T12:40:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records in 2023-08-09T12:40:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records out 2023-08-09T12:40:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:900 bytes copied, 0.00012308 s, 7.3 MB/s 2023-08-09T12:40:57.928 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:40:57.928 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:40:57.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:40:58.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:40:58.176 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:40:58.177 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:58.177 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:58.243 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:40:58.244 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:40:58.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:40:58.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.534+0000 7f9b1f1cb640 1 Processor -- start 2023-08-09T12:40:58.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.534+0000 7f9b1f1cb640 1 -- start start 2023-08-09T12:40:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.535+0000 7f9b1f1cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b181587e0 0x7f9b18070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.535+0000 7f9b1f1cb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9b180b0b10 0x7f9b1815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.535+0000 7f9b1f1cb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b1815bce0 0x7f9b180cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.535+0000 7f9b1f1cb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b180715c0 con 0x7f9b180b0b10 2023-08-09T12:40:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.535+0000 7f9b1f1cb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b180718a0 con 0x7f9b1815bce0 2023-08-09T12:40:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.535+0000 7f9b1f1cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18071b80 con 0x7f9b181587e0 2023-08-09T12:40:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.535+0000 7f9b1d9c8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9b180b0b10 0x7f9b1815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1d9c8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9b180b0b10 0x7f9b1815b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45052/0 (socket says 172.21.15.17:45052) 2023-08-09T12:40:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1d9c8640 1 -- 172.21.15.17:0/4003038255 learned_addr learned my addr 172.21.15.17:0/4003038255 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:58.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1e1c9640 1 --2- 172.21.15.17:0/4003038255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b181587e0 0x7f9b18070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:58.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1d9c8640 1 -- 172.21.15.17:0/4003038255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b181587e0 msgr2=0x7f9b18070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:58.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1d9c8640 1 --2- 172.21.15.17:0/4003038255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b181587e0 0x7f9b18070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1d9c8640 1 -- 172.21.15.17:0/4003038255 >> v2:172.21.15.142:3300/0 conn(0x7f9b1815bce0 msgr2=0x7f9b180cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:58.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1d9c8640 1 --2- 172.21.15.17:0/4003038255 >> v2:172.21.15.142:3300/0 conn(0x7f9b1815bce0 0x7f9b180cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1d9c8640 1 -- 172.21.15.17:0/4003038255 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1815b280 con 0x7f9b180b0b10 2023-08-09T12:40:58.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.536+0000 7f9b1e1c9640 1 --2- 172.21.15.17:0/4003038255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b181587e0 0x7f9b18070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:58.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.537+0000 7f9b1d9c8640 1 --2- 172.21.15.17:0/4003038255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b180b0b10 0x7f9b1815b7a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b18070790 tx=0x7f9b0802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7317a2ac5d52120 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1d1c7640 1 -- 172.21.15.17:0/4003038255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08031890 con 0x7f9b180b0b10 2023-08-09T12:40:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1d1c7640 1 -- 172.21.15.17:0/4003038255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b080319f0 con 0x7f9b180b0b10 2023-08-09T12:40:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1d1c7640 1 -- 172.21.15.17:0/4003038255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08031d80 con 0x7f9b180b0b10 2023-08-09T12:40:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/4003038255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b180b0b10 msgr2=0x7f9b1815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/4003038255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b180b0b10 0x7f9b1815b7a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b18070790 tx=0x7f9b0802b930 comp rx=0 tx=0).stop 2023-08-09T12:40:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/4003038255 shutdown_connections 2023-08-09T12:40:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/4003038255 >> v2:172.21.15.142:3300/0 conn(0x7f9b1815bce0 0x7f9b180cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/4003038255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b180b0b10 0x7f9b1815b7a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/4003038255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b181587e0 0x7f9b18070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.538+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/4003038255 >> 172.21.15.17:0/4003038255 conn(0x7f9b180b1d50 msgr2=0x7f9b1806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.539+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/4003038255 shutdown_connections 2023-08-09T12:40:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.539+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/4003038255 wait complete. 2023-08-09T12:40:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.540+0000 7f9b1f1cb640 1 Processor -- start 2023-08-09T12:40:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.541+0000 7f9b1f1cb640 1 -- start start 2023-08-09T12:40:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.541+0000 7f9b1f1cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b180b0b10 0x7f9b180c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.541+0000 7f9b1f1cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b181587e0 0x7f9b180c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.541+0000 7f9b1f1cb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180cde10 0x7f9b181f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1f1cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180ce2a0 con 0x7f9b181587e0 2023-08-09T12:40:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1f1cb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180c7680 con 0x7f9b180cde10 2023-08-09T12:40:58.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1f1cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180c7960 con 0x7f9b180b0b10 2023-08-09T12:40:58.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1d9c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b181587e0 0x7f9b180c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:58.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1d9c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b181587e0 0x7f9b180c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45064/0 (socket says 172.21.15.17:45064) 2023-08-09T12:40:58.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1d9c8640 1 -- 172.21.15.17:0/21635051 learned_addr learned my addr 172.21.15.17:0/21635051 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:58.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1e1c9640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b180b0b10 0x7f9b180c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:58.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1e9ca640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180cde10 0x7f9b181f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:58.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1d9c8640 1 -- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b180b0b10 msgr2=0x7f9b180c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1d9c8640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b180b0b10 0x7f9b180c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1d9c8640 1 -- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180cde10 msgr2=0x7f9b181f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1d9c8640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180cde10 0x7f9b181f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.542+0000 7f9b1d9c8640 1 -- 172.21.15.17:0/21635051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b080094d0 con 0x7f9b181587e0 2023-08-09T12:40:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.543+0000 7f9b1d9c8640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b181587e0 0x7f9b180c5d00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000c00 tx=0x7f9b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.543+0000 7f9b0effd640 1 -- 172.21.15.17:0/21635051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08031820 con 0x7f9b181587e0 2023-08-09T12:40:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.543+0000 7f9b0effd640 1 -- 172.21.15.17:0/21635051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b080443f0 con 0x7f9b181587e0 2023-08-09T12:40:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.543+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b180c7c40 con 0x7f9b181587e0 2023-08-09T12:40:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.543+0000 7f9b0effd640 1 -- 172.21.15.17:0/21635051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080447a0 con 0x7f9b181587e0 2023-08-09T12:40:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.543+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b18154000 con 0x7f9b181587e0 2023-08-09T12:40:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.545+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b18154250 con 0x7f9b181587e0 2023-08-09T12:40:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.545+0000 7f9b0effd640 1 -- 172.21.15.17:0/21635051 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b0804d450 con 0x7f9b181587e0 2023-08-09T12:40:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.546+0000 7f9b0effd640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9afc06a050 0x7f9afc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.546+0000 7f9b0effd640 1 -- 172.21.15.17:0/21635051 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b080aaf10 con 0x7f9b181587e0 2023-08-09T12:40:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.547+0000 7f9b1e1c9640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9afc06a050 0x7f9afc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:58.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.548+0000 7f9b1e1c9640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9afc06a050 0x7f9afc06c510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b14008850 tx=0x7f9b14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:58.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.551+0000 7f9b0effd640 1 -- 172.21.15.17:0/21635051 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9b08076560 con 0x7f9b181587e0 2023-08-09T12:40:58.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.745+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b1806fa10 con 0x7f9b181587e0 2023-08-09T12:40:58.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.747+0000 7f9b0effd640 1 -- 172.21.15.17:0/21635051 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f9b1806fa10 con 0x7f9b181587e0 2023-08-09T12:40:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:40:58.750 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:55.723309+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:40:58.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9afc06a050 msgr2=0x7f9afc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:58.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9afc06a050 0x7f9afc06c510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b14008850 tx=0x7f9b14008040 comp rx=0 tx=0).stop 2023-08-09T12:40:58.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b181587e0 msgr2=0x7f9b180c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:58.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b181587e0 0x7f9b180c5d00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000c00 tx=0x7f9b080046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 shutdown_connections 2023-08-09T12:40:58.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9afc06a050 0x7f9afc06c510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180cde10 0x7f9b181f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b181587e0 0x7f9b180c5d00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 --2- 172.21.15.17:0/21635051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b180b0b10 0x7f9b180c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:58.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 >> 172.21.15.17:0/21635051 conn(0x7f9b180b1d50 msgr2=0x7f9b180697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:58.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 shutdown_connections 2023-08-09T12:40:58.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:58.750+0000 7f9b1f1cb640 1 -- 172.21.15.17:0/21635051 wait complete. 2023-08-09T12:40:58.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:40:39.173972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:40:40.213212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:40:58.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:40:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.008+0000 7fb692724640 1 Processor -- start 2023-08-09T12:40:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.009+0000 7fb692724640 1 -- start start 2023-08-09T12:40:59.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.010+0000 7fb692724640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb68c161280 0x7fb68c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.010+0000 7fb692724640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb68c161660 0x7fb68c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb692724640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c0ca450 0x7fb68c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb692724640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c15d430 con 0x7fb68c161660 2023-08-09T12:40:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb692724640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c15df30 con 0x7fb68c161280 2023-08-09T12:40:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb692724640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0ca9d0 con 0x7fb68c0ca450 2023-08-09T12:40:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb68b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb68c161660 0x7fb68c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb68b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb68c161660 0x7fb68c0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45080/0 (socket says 172.21.15.17:45080) 2023-08-09T12:40:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb68b7fe640 1 -- 172.21.15.17:0/3895667450 learned_addr learned my addr 172.21.15.17:0/3895667450 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb68b7fe640 1 -- 172.21.15.17:0/3895667450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c0ca450 msgr2=0x7fb68c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb68b7fe640 1 --2- 172.21.15.17:0/3895667450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c0ca450 0x7fb68c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb68b7fe640 1 -- 172.21.15.17:0/3895667450 >> v2:172.21.15.142:3300/0 conn(0x7fb68c161280 msgr2=0x7fb68c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:59.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb68b7fe640 1 --2- 172.21.15.17:0/3895667450 >> v2:172.21.15.142:3300/0 conn(0x7fb68c161280 0x7fb68c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.011+0000 7fb68b7fe640 1 -- 172.21.15.17:0/3895667450 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c15e3c0 con 0x7fb68c161660 2023-08-09T12:40:59.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.013+0000 7fb68b7fe640 1 --2- 172.21.15.17:0/3895667450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c161660 0x7fb68c0ac8b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ad990 tx=0x7fb68002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2e06e566d82eb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.013+0000 7fb68affd640 1 -- 172.21.15.17:0/3895667450 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680004030 con 0x7fb68c161660 2023-08-09T12:40:59.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.013+0000 7fb68affd640 1 -- 172.21.15.17:0/3895667450 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680004190 con 0x7fb68c161660 2023-08-09T12:40:59.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.013+0000 7fb68affd640 1 -- 172.21.15.17:0/3895667450 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680003610 con 0x7fb68c161660 2023-08-09T12:40:59.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 -- 172.21.15.17:0/3895667450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c161660 msgr2=0x7fb68c0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 --2- 172.21.15.17:0/3895667450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c161660 0x7fb68c0ac8b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ad990 tx=0x7fb68002b7c0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 -- 172.21.15.17:0/3895667450 shutdown_connections 2023-08-09T12:40:59.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 --2- 172.21.15.17:0/3895667450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c0ca450 0x7fb68c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 --2- 172.21.15.17:0/3895667450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c161660 0x7fb68c0ac8b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 --2- 172.21.15.17:0/3895667450 >> v2:172.21.15.142:3300/0 conn(0x7fb68c161280 0x7fb68c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 -- 172.21.15.17:0/3895667450 >> 172.21.15.17:0/3895667450 conn(0x7fb68c0cb1b0 msgr2=0x7fb68c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 -- 172.21.15.17:0/3895667450 shutdown_connections 2023-08-09T12:40:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.014+0000 7fb692724640 1 -- 172.21.15.17:0/3895667450 wait complete. 2023-08-09T12:40:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.016+0000 7fb692724640 1 Processor -- start 2023-08-09T12:40:59.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.017+0000 7fb692724640 1 -- start start 2023-08-09T12:40:59.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb692724640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c0ca450 0x7fb68c14fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb692724640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c161280 0x7fb68c154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb692724640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb68c161660 0x7fb68c156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb692724640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c154f30 con 0x7fb68c0ca450 2023-08-09T12:40:59.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb692724640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c155210 con 0x7fb68c161660 2023-08-09T12:40:59.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb692724640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c1554f0 con 0x7fb68c161280 2023-08-09T12:40:59.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb68bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c0ca450 0x7fb68c14fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb68bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c0ca450 0x7fb68c14fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45086/0 (socket says 172.21.15.17:45086) 2023-08-09T12:40:59.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.018+0000 7fb68bfff640 1 -- 172.21.15.17:0/4173381013 learned_addr learned my addr 172.21.15.17:0/4173381013 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:59.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb68bfff640 1 -- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c161280 msgr2=0x7fb68c154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb68b7fe640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c161280 0x7fb68c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb690cc1640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb68c161660 0x7fb68c156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb68bfff640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c161280 0x7fb68c154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb68bfff640 1 -- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb68c161660 msgr2=0x7fb68c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb68bfff640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb68c161660 0x7fb68c156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb68bfff640 1 -- 172.21.15.17:0/4173381013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680009460 con 0x7fb68c0ca450 2023-08-09T12:40:59.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb68bfff640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c0ca450 0x7fb68c14fde0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00ba50 tx=0x7fb67c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb688ff9640 1 -- 172.21.15.17:0/4173381013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00cbe0 con 0x7fb68c0ca450 2023-08-09T12:40:59.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb688ff9640 1 -- 172.21.15.17:0/4173381013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c00cd60 con 0x7fb68c0ca450 2023-08-09T12:40:59.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb688ff9640 1 -- 172.21.15.17:0/4173381013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c014680 con 0x7fb68c0ca450 2023-08-09T12:40:59.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.019+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c1557d0 con 0x7fb68c0ca450 2023-08-09T12:40:59.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.020+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c0b0e10 con 0x7fb68c0ca450 2023-08-09T12:40:59.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.021+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c067a80 con 0x7fb68c0ca450 2023-08-09T12:40:59.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.022+0000 7fb688ff9640 1 -- 172.21.15.17:0/4173381013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb67c01d3b0 con 0x7fb68c0ca450 2023-08-09T12:40:59.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.023+0000 7fb688ff9640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb67806a050 0x7fb67806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.023+0000 7fb688ff9640 1 -- 172.21.15.17:0/4173381013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb67c088580 con 0x7fb68c0ca450 2023-08-09T12:40:59.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.024+0000 7fb68b7fe640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb67806a050 0x7fb67806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.025+0000 7fb68b7fe640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb67806a050 0x7fb67806c510 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb680035000 tx=0x7fb680030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.029+0000 7fb688ff9640 1 -- 172.21.15.17:0/4173381013 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb67c053c60 con 0x7fb68c0ca450 2023-08-09T12:40:59.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.220+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb68c156740 con 0x7fb68c0ca450 2023-08-09T12:40:59.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.221+0000 7fb688ff9640 1 -- 172.21.15.17:0/4173381013 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb67c057280 con 0x7fb68c0ca450 2023-08-09T12:40:59.223 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:40:59.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb67806a050 msgr2=0x7fb67806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb67806a050 0x7fb67806c510 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb680035000 tx=0x7fb680030000 comp rx=0 tx=0).stop 2023-08-09T12:40:59.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c0ca450 msgr2=0x7fb68c14fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c0ca450 0x7fb68c14fde0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00ba50 tx=0x7fb67c00bf10 comp rx=0 tx=0).stop 2023-08-09T12:40:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 shutdown_connections 2023-08-09T12:40:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb67806a050 0x7fb67806c510 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb68c161660 0x7fb68c156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb68c161280 0x7fb68c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 --2- 172.21.15.17:0/4173381013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb68c0ca450 0x7fb68c14fde0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 >> 172.21.15.17:0/4173381013 conn(0x7fb68c0cb1b0 msgr2=0x7fb68c1527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:59.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 shutdown_connections 2023-08-09T12:40:59.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.224+0000 7fb692724640 1 -- 172.21.15.17:0/4173381013 wait complete. 2023-08-09T12:40:59.244 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:40:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.475+0000 7f7835d84640 1 Processor -- start 2023-08-09T12:40:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.475+0000 7f7835d84640 1 -- start start 2023-08-09T12:40:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.476+0000 7f7835d84640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7830070a90 0x7f78300b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f7835d84640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78300ad810 0x7f78300c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f7835d84640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78300b4630 con 0x7f7830159d80 2023-08-09T12:40:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f7835d84640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783015a160 con 0x7f7830070a90 2023-08-09T12:40:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f7835d84640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78300b3ab0 con 0x7f78300ad810 2023-08-09T12:40:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f782f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7830159d80 0x7f7830070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44930/0 (socket says 172.21.15.17:44930) 2023-08-09T12:40:59.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f782f7fe640 1 -- 172.21.15.17:0/181118090 learned_addr learned my addr 172.21.15.17:0/181118090 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:59.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f782effd640 1 --2- 172.21.15.17:0/181118090 >> v2:172.21.15.17:3300/0 conn(0x7f7830070a90 0x7f78300b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f782ffff640 1 --2- 172.21.15.17:0/181118090 >> v2:172.21.15.142:3300/0 conn(0x7f78300ad810 0x7f78300c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.477+0000 7f782e7fc640 1 -- 172.21.15.17:0/181118090 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405509642 0 0) 0x7f78300b4630 con 0x7f7830159d80 2023-08-09T12:40:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.478+0000 7f782e7fc640 1 -- 172.21.15.17:0/181118090 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7818003520 con 0x7f7830159d80 2023-08-09T12:40:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.478+0000 7f782effd640 1 -- 172.21.15.17:0/181118090 >> v2:172.21.15.142:3300/0 conn(0x7f78300ad810 msgr2=0x7f78300c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.478+0000 7f782effd640 1 --2- 172.21.15.17:0/181118090 >> v2:172.21.15.142:3300/0 conn(0x7f78300ad810 0x7f78300c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.478+0000 7f782effd640 1 -- 172.21.15.17:0/181118090 >> v1:172.21.15.17:6789/0 conn(0x7f7830159d80 legacy=0x7f7830070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.478+0000 7f782effd640 1 -- 172.21.15.17:0/181118090 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300b3d90 con 0x7f7830070a90 2023-08-09T12:40:59.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.479+0000 7f782effd640 1 --2- 172.21.15.17:0/181118090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7830070a90 0x7f78300b34d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f78300c5700 tx=0x7f782402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b2752f0b8f4352 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.479+0000 7f782e7fc640 1 -- 172.21.15.17:0/181118090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824031830 con 0x7f7830070a90 2023-08-09T12:40:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.479+0000 7f782e7fc640 1 -- 172.21.15.17:0/181118090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824031990 con 0x7f7830070a90 2023-08-09T12:40:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.479+0000 7f782e7fc640 1 -- 172.21.15.17:0/181118090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824031d20 con 0x7f7830070a90 2023-08-09T12:40:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.480+0000 7f7835d84640 1 -- 172.21.15.17:0/181118090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7830070a90 msgr2=0x7f78300b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.480+0000 7f7835d84640 1 --2- 172.21.15.17:0/181118090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7830070a90 0x7f78300b34d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f78300c5700 tx=0x7f782402b8d0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.480+0000 7f7835d84640 1 -- 172.21.15.17:0/181118090 shutdown_connections 2023-08-09T12:40:59.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.480+0000 7f7835d84640 1 --2- 172.21.15.17:0/181118090 >> v2:172.21.15.142:3300/0 conn(0x7f78300ad810 0x7f78300c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.480+0000 7f7835d84640 1 --2- 172.21.15.17:0/181118090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7830070a90 0x7f78300b34d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.480+0000 7f7835d84640 1 -- 172.21.15.17:0/181118090 >> 172.21.15.17:0/181118090 conn(0x7f78300cb1b0 msgr2=0x7f78300cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.480+0000 7f7835d84640 1 -- 172.21.15.17:0/181118090 shutdown_connections 2023-08-09T12:40:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.480+0000 7f7835d84640 1 -- 172.21.15.17:0/181118090 wait complete. 2023-08-09T12:40:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.482+0000 7f7835d84640 1 Processor -- start 2023-08-09T12:40:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.482+0000 7f7835d84640 1 -- start start 2023-08-09T12:40:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f7835d84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7830070a90 0x7f78300ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f7835d84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78300ad810 0x7f7830156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f7835d84640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7830159d80 0x7f783015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f7835d84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7830157320 con 0x7f78300ad810 2023-08-09T12:40:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f7835d84640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783015a820 con 0x7f7830070a90 2023-08-09T12:40:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f7835d84640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78300c6820 con 0x7f7830159d80 2023-08-09T12:40:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f782effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78300ad810 0x7f7830156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f782effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78300ad810 0x7f7830156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45112/0 (socket says 172.21.15.17:45112) 2023-08-09T12:40:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f782effd640 1 -- 172.21.15.17:0/512364652 learned_addr learned my addr 172.21.15.17:0/512364652 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f782f7fe640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7830070a90 0x7f78300ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f782ffff640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7830159d80 0x7f783015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.483+0000 7f782effd640 1 -- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7830159d80 msgr2=0x7f783015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f782effd640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7830159d80 0x7f783015a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f782effd640 1 -- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7830070a90 msgr2=0x7f78300ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f782effd640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7830070a90 0x7f78300ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f782effd640 1 -- 172.21.15.17:0/512364652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78240093a0 con 0x7f78300ad810 2023-08-09T12:40:59.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f782f7fe640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7830070a90 0x7f78300ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:40:59.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f782effd640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78300ad810 0x7f7830156de0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7824000c00 tx=0x7f78240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f7817fff640 1 -- 172.21.15.17:0/512364652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782403a8f0 con 0x7f78300ad810 2023-08-09T12:40:59.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f7817fff640 1 -- 172.21.15.17:0/512364652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782403aa70 con 0x7f78300ad810 2023-08-09T12:40:59.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f7817fff640 1 -- 172.21.15.17:0/512364652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782403ae20 con 0x7f78300ad810 2023-08-09T12:40:59.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.484+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783015aa30 con 0x7f78300ad810 2023-08-09T12:40:59.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.485+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78300c6ac0 con 0x7f78300ad810 2023-08-09T12:40:59.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.486+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78300b34d0 con 0x7f78300ad810 2023-08-09T12:40:59.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.487+0000 7f7817fff640 1 -- 172.21.15.17:0/512364652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f782404d450 con 0x7f78300ad810 2023-08-09T12:40:59.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.488+0000 7f7817fff640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781c06a050 0x7f781c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.488+0000 7f7817fff640 1 -- 172.21.15.17:0/512364652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78240aa740 con 0x7f78300ad810 2023-08-09T12:40:59.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.488+0000 7f782f7fe640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781c06a050 0x7f781c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.489+0000 7f782f7fe640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781c06a050 0x7f781c06c510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7820001560 tx=0x7f7820009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.492+0000 7f7817fff640 1 -- 172.21.15.17:0/512364652 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7824075d90 con 0x7f78300ad810 2023-08-09T12:40:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.688+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78300ccbe0 con 0x7f78300ad810 2023-08-09T12:40:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.689+0000 7f7817fff640 1 -- 172.21.15.17:0/512364652 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78240793b0 con 0x7f78300ad810 2023-08-09T12:40:59.691 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:40:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781c06a050 msgr2=0x7f781c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781c06a050 0x7f781c06c510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7820001560 tx=0x7f7820009040 comp rx=0 tx=0).stop 2023-08-09T12:40:59.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78300ad810 msgr2=0x7f7830156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78300ad810 0x7f7830156de0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7824000c00 tx=0x7f78240046c0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 shutdown_connections 2023-08-09T12:40:59.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781c06a050 0x7f781c06c510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7830159d80 0x7f783015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78300ad810 0x7f7830156de0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 --2- 172.21.15.17:0/512364652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7830070a90 0x7f78300ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.691+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 >> 172.21.15.17:0/512364652 conn(0x7f78300cb1b0 msgr2=0x7f78300ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:59.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.692+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 shutdown_connections 2023-08-09T12:40:59.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.692+0000 7f7835d84640 1 -- 172.21.15.17:0/512364652 wait complete. 2023-08-09T12:40:59.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:40:59.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.942+0000 7f7769f0f640 1 Processor -- start 2023-08-09T12:40:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.942+0000 7f7769f0f640 1 -- start start 2023-08-09T12:40:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f7769f0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f776415ab80 0x7f77640b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f7769f0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f776406c0e0 0x7f77640cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f7769f0f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77640cd240 con 0x7f77640b66b0 2023-08-09T12:40:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f7769f0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77640ce6e0 con 0x7f776415ab80 2023-08-09T12:40:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f7769f0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77640ce9c0 con 0x7f776406c0e0 2023-08-09T12:40:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f7762ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f77640b66b0 0x7f776406b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44932/0 (socket says 172.21.15.17:44932) 2023-08-09T12:40:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f7762ffd640 1 -- 172.21.15.17:0/917529315 learned_addr learned my addr 172.21.15.17:0/917529315 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:40:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f77637fe640 1 --2- 172.21.15.17:0/917529315 >> v2:172.21.15.142:3300/0 conn(0x7f776415ab80 0x7f77640b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f7763fff640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f776406c0e0 0x7f77640cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.944+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458915342 0 0) 0x7f77640cd240 con 0x7f77640b66b0 2023-08-09T12:40:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7750003520 con 0x7f77640b66b0 2023-08-09T12:40:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4270261488 0 0) 0x7f7750003520 con 0x7f77640b66b0 2023-08-09T12:40:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f776406c0e0 msgr2=0x7f77640cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f776406c0e0 0x7f77640cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 >> v2:172.21.15.142:3300/0 conn(0x7f776415ab80 msgr2=0x7f77640b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 --2- 172.21.15.17:0/917529315 >> v2:172.21.15.142:3300/0 conn(0x7f776415ab80 0x7f77640b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640ceca0 con 0x7f77640b66b0 2023-08-09T12:40:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f774c0019f0 con 0x7f77640b66b0 2023-08-09T12:40:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 >> v1:172.21.15.17:6789/0 conn(0x7f77640b66b0 legacy=0x7f776406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f776406c0e0 0x7f7750003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7750003ef0 0x7f77500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750004d00 0x7f7750005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640ce6e0 con 0x7f7750003ef0 2023-08-09T12:40:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640ce9c0 con 0x7f7750004d00 2023-08-09T12:40:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775000b980 con 0x7f776406c0e0 2023-08-09T12:40:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.945+0000 7f7762ffd640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7750003ef0 0x7f77500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.946+0000 7f7763fff640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750004d00 0x7f7750005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.946+0000 7f7762ffd640 1 -- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f776406c0e0 msgr2=0x7f7750003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:59.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.946+0000 7f7762ffd640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f776406c0e0 0x7f7750003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.946+0000 7f7762ffd640 1 -- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750004d00 msgr2=0x7f7750005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:40:59.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.946+0000 7f7762ffd640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750004d00 0x7f7750005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.946+0000 7f7762ffd640 1 -- 172.21.15.17:0/917529315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750003520 con 0x7f7750003ef0 2023-08-09T12:40:59.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.947+0000 7f7762ffd640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7750003ef0 0x7f77500047c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f774c00a860 tx=0x7f77500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2261fa9c13c8d31 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.947+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c034630 con 0x7f7750003ef0 2023-08-09T12:40:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.947+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c02f070 con 0x7f7750003ef0 2023-08-09T12:40:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.947+0000 7f77627fc640 1 -- 172.21.15.17:0/917529315 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c034a30 con 0x7f7750003ef0 2023-08-09T12:40:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.948+0000 7f7769f0f640 1 -- 172.21.15.17:0/917529315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7750003ef0 msgr2=0x7f77500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.948+0000 7f7769f0f640 1 --2- 172.21.15.17:0/917529315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7750003ef0 0x7f77500047c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f774c00a860 tx=0x7f77500057f0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.948+0000 7f7763fff640 1 -- 172.21.15.17:0/917529315 reap_dead start 2023-08-09T12:40:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.948+0000 7f7769f0f640 1 -- 172.21.15.17:0/917529315 shutdown_connections 2023-08-09T12:40:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.948+0000 7f7769f0f640 1 -- 172.21.15.17:0/917529315 >> 172.21.15.17:0/917529315 conn(0x7f77640cd8a0 msgr2=0x7f77640cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:40:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.948+0000 7f7769f0f640 1 -- 172.21.15.17:0/917529315 shutdown_connections 2023-08-09T12:40:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.948+0000 7f7769f0f640 1 -- 172.21.15.17:0/917529315 wait complete. 2023-08-09T12:40:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.950+0000 7f7769f0f640 1 Processor -- start 2023-08-09T12:40:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.950+0000 7f7769f0f640 1 -- start start 2023-08-09T12:40:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.951+0000 7f7769f0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750003ef0 0x7f77641571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.951+0000 7f7769f0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77640c8810 0x7f77641f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.951+0000 7f7769f0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77640ca7f0 0x7f77640cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.951+0000 7f7769f0f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640cb1b0 con 0x7f77640c8810 2023-08-09T12:40:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.951+0000 7f7769f0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640c98e0 con 0x7f7750003ef0 2023-08-09T12:40:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.951+0000 7f7769f0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77641f0f60 con 0x7f77640ca7f0 2023-08-09T12:40:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.951+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77640c8810 0x7f77641f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77640c8810 0x7f77641f0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45136/0 (socket says 172.21.15.17:45136) 2023-08-09T12:40:59.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f7762ffd640 1 -- 172.21.15.17:0/3043300374 learned_addr learned my addr 172.21.15.17:0/3043300374 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:40:59.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f77637fe640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750003ef0 0x7f77641571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f7762ffd640 1 -- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77640ca7f0 msgr2=0x7f77640cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f7762ffd640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77640ca7f0 0x7f77640cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f7762ffd640 1 -- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750003ef0 msgr2=0x7f77641571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:40:59.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f7762ffd640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750003ef0 0x7f77641571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:40:59.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f7762ffd640 1 -- 172.21.15.17:0/3043300374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640c81b0 con 0x7f77640c8810 2023-08-09T12:40:59.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.952+0000 7f7762ffd640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77640c8810 0x7f77641f0a20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f774c00a860 tx=0x7f774c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.953+0000 7f775bfff640 1 -- 172.21.15.17:0/3043300374 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c034840 con 0x7f77640c8810 2023-08-09T12:40:59.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.953+0000 7f775bfff640 1 -- 172.21.15.17:0/3043300374 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c0349c0 con 0x7f77640c8810 2023-08-09T12:40:59.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.953+0000 7f775bfff640 1 -- 172.21.15.17:0/3043300374 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c034d70 con 0x7f77640c8810 2023-08-09T12:40:59.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.953+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77640c8d60 con 0x7f77640c8810 2023-08-09T12:40:59.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.953+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77640c9320 con 0x7f77640c8810 2023-08-09T12:40:59.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.954+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7764067a80 con 0x7f77640c8810 2023-08-09T12:40:59.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.955+0000 7f775bfff640 1 -- 172.21.15.17:0/3043300374 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f774c031030 con 0x7f77640c8810 2023-08-09T12:40:59.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.956+0000 7f775bfff640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f774406a080 0x7f774406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:40:59.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.956+0000 7f775bfff640 1 -- 172.21.15.17:0/3043300374 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f774c0a9d60 con 0x7f77640c8810 2023-08-09T12:40:59.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.957+0000 7f77637fe640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f774406a080 0x7f774406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:40:59.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.958+0000 7f77637fe640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f774406a080 0x7f774406c540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7754009ad0 tx=0x7f7754008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:40:59.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:40:59.960+0000 7f775bfff640 1 -- 172.21.15.17:0/3043300374 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f774c075440 con 0x7f77640c8810 2023-08-09T12:41:00.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.152+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77640c85f0 con 0x7f77640c8810 2023-08-09T12:41:00.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.153+0000 7f775bfff640 1 -- 172.21.15.17:0/3043300374 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f774c046020 con 0x7f77640c8810 2023-08-09T12:41:00.155 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:41:00.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.155+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f774406a080 msgr2=0x7f774406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.155+0000 7f7769f0f640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f774406a080 0x7f774406c540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7754009ad0 tx=0x7f7754008040 comp rx=0 tx=0).stop 2023-08-09T12:41:00.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.155+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77640c8810 msgr2=0x7f77641f0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.155+0000 7f7769f0f640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77640c8810 0x7f77641f0a20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f774c00a860 tx=0x7f774c001d80 comp rx=0 tx=0).stop 2023-08-09T12:41:00.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.156+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 shutdown_connections 2023-08-09T12:41:00.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.156+0000 7f7769f0f640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f774406a080 0x7f774406c540 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.156+0000 7f7769f0f640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77640ca7f0 0x7f77640cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.156+0000 7f7769f0f640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77640c8810 0x7f77641f0a20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.156+0000 7f7769f0f640 1 --2- 172.21.15.17:0/3043300374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7750003ef0 0x7f77641571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.156+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 >> 172.21.15.17:0/3043300374 conn(0x7f77640cd8a0 msgr2=0x7f77640d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:00.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.156+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 shutdown_connections 2023-08-09T12:41:00.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.156+0000 7f7769f0f640 1 -- 172.21.15.17:0/3043300374 wait complete. 2023-08-09T12:41:00.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:41:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.411+0000 7f059bd5b640 1 Processor -- start 2023-08-09T12:41:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.412+0000 7f059bd5b640 1 -- start start 2023-08-09T12:41:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.413+0000 7f059bd5b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05940d30e0 0x7f05940b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.413+0000 7f059bd5b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05940cdd10 con 0x7f05941616e0 2023-08-09T12:41:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.414+0000 7f059bd5b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05940cdff0 con 0x7f059415ce90 2023-08-09T12:41:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.414+0000 7f059bd5b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05940b6540 con 0x7f05940d30e0 2023-08-09T12:41:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.414+0000 7f05992f6640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f05941616e0 0x7f05940d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44944/0 (socket says 172.21.15.17:44944) 2023-08-09T12:41:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.414+0000 7f05992f6640 1 -- 172.21.15.17:0/2536642435 learned_addr learned my addr 172.21.15.17:0/2536642435 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.414+0000 7f059a2f8640 1 --2- 172.21.15.17:0/2536642435 >> v2:172.21.15.142:3300/0 conn(0x7f05940d30e0 0x7f05940b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.414+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566326744 0 0) 0x7f05940cdd10 con 0x7f05941616e0 2023-08-09T12:41:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.414+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0580003520 con 0x7f05941616e0 2023-08-09T12:41:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 864596626 0 0) 0x7f0580003520 con 0x7f05941616e0 2023-08-09T12:41:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 >> v2:172.21.15.142:3300/0 conn(0x7f05940d30e0 msgr2=0x7f05940b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 --2- 172.21.15.17:0/2536642435 >> v2:172.21.15.142:3300/0 conn(0x7f05940d30e0 0x7f05940b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 >> v1:172.21.15.142:6789/0 conn(0x7f059415ce90 legacy=0x7f05940cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940ce2d0 con 0x7f05941616e0 2023-08-09T12:41:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0584001670 con 0x7f05941616e0 2023-08-09T12:41:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 >> v1:172.21.15.17:6789/0 conn(0x7f05941616e0 legacy=0x7f05940d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0580003970 0x7f0580003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05800047c0 0x7f0580004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580005180 0x7f058000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05940b6540 con 0x7f0580005180 2023-08-09T12:41:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058000c020 con 0x7f0580003970 2023-08-09T12:41:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058000c1e0 con 0x7f05800047c0 2023-08-09T12:41:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.415+0000 7f059a2f8640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580005180 0x7f058000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.416+0000 7f0599af7640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0580003970 0x7f0580003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.416+0000 7f059a2f8640 1 -- 172.21.15.17:0/2536642435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05800047c0 msgr2=0x7f0580004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.416+0000 7f059a2f8640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05800047c0 0x7f0580004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.416+0000 7f059a2f8640 1 -- 172.21.15.17:0/2536642435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0580003970 msgr2=0x7f0580003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.416+0000 7f059a2f8640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0580003970 0x7f0580003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.416+0000 7f059a2f8640 1 -- 172.21.15.17:0/2536642435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580003520 con 0x7f0580005180 2023-08-09T12:41:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.417+0000 7f059a2f8640 1 -- 172.21.15.17:0/2536642435 reap_dead start 2023-08-09T12:41:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.417+0000 7f059a2f8640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580005180 0x7f058000b980 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f058c009f90 tx=0x7f05800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611b93912e7d86c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.417+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c02cc20 con 0x7f0580005180 2023-08-09T12:41:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.417+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00f040 con 0x7f0580005180 2023-08-09T12:41:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.417+0000 7f0598af5640 1 -- 172.21.15.17:0/2536642435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c003990 con 0x7f0580005180 2023-08-09T12:41:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.418+0000 7f059bd5b640 1 -- 172.21.15.17:0/2536642435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580005180 msgr2=0x7f058000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.418+0000 7f059bd5b640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580005180 0x7f058000b980 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f058c009f90 tx=0x7f05800057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.418+0000 7f059bd5b640 1 -- 172.21.15.17:0/2536642435 shutdown_connections 2023-08-09T12:41:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.418+0000 7f059bd5b640 1 --2- 172.21.15.17:0/2536642435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580005180 0x7f058000b980 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.418+0000 7f059bd5b640 1 -- 172.21.15.17:0/2536642435 >> 172.21.15.17:0/2536642435 conn(0x7f059406fde0 msgr2=0x7f05940701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.418+0000 7f059bd5b640 1 -- 172.21.15.17:0/2536642435 shutdown_connections 2023-08-09T12:41:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.418+0000 7f059bd5b640 1 -- 172.21.15.17:0/2536642435 wait complete. 2023-08-09T12:41:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.420+0000 7f059bd5b640 1 Processor -- start 2023-08-09T12:41:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.420+0000 7f059bd5b640 1 -- start start 2023-08-09T12:41:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f059bd5b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0580005180 0x7f059415d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f059bd5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05940ca610 0x7f05940b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f059bd5b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05940caa90 0x7f05940b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f059bd5b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059415df30 con 0x7f05940ca610 2023-08-09T12:41:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f059bd5b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059415e210 con 0x7f0580005180 2023-08-09T12:41:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f059bd5b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059415e4f0 con 0x7f05940caa90 2023-08-09T12:41:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f05992f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05940ca610 0x7f05940b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f05992f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05940ca610 0x7f05940b6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45150/0 (socket says 172.21.15.17:45150) 2023-08-09T12:41:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.421+0000 7f05992f6640 1 -- 172.21.15.17:0/3942168823 learned_addr learned my addr 172.21.15.17:0/3942168823 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f059a2f8640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05940caa90 0x7f05940b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f05992f6640 1 -- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05940caa90 msgr2=0x7f05940b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f05992f6640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05940caa90 0x7f05940b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f05992f6640 1 -- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0580005180 msgr2=0x7f059415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f05992f6640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0580005180 0x7f059415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f05992f6640 1 -- 172.21.15.17:0/3942168823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059415e7d0 con 0x7f05940ca610 2023-08-09T12:41:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f05992f6640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05940ca610 0x7f05940b6de0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f058400c730 tx=0x7f058400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f058a7fc640 1 -- 172.21.15.17:0/3942168823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840072d0 con 0x7f05940ca610 2023-08-09T12:41:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f058a7fc640 1 -- 172.21.15.17:0/3942168823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584007470 con 0x7f05940ca610 2023-08-09T12:41:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059415eab0 con 0x7f05940ca610 2023-08-09T12:41:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f058a7fc640 1 -- 172.21.15.17:0/3942168823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840047e0 con 0x7f05940ca610 2023-08-09T12:41:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.422+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0594156e20 con 0x7f05940ca610 2023-08-09T12:41:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.424+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0594067a80 con 0x7f05940ca610 2023-08-09T12:41:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.424+0000 7f058a7fc640 1 -- 172.21.15.17:0/3942168823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0584004b50 con 0x7f05940ca610 2023-08-09T12:41:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.425+0000 7f058a7fc640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057806a080 0x7f057806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.425+0000 7f058a7fc640 1 -- 172.21.15.17:0/3942168823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0584087fc0 con 0x7f05940ca610 2023-08-09T12:41:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.426+0000 7f0599af7640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057806a080 0x7f057806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.427+0000 7f0599af7640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057806a080 0x7f057806c540 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f05940c9350 tx=0x7f0590009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.429+0000 7f058a7fc640 1 -- 172.21.15.17:0/3942168823 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f05840536a0 con 0x7f05940ca610 2023-08-09T12:41:00.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.621+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05940d0ad0 con 0x7f05940ca610 2023-08-09T12:41:00.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.622+0000 7f058a7fc640 1 -- 172.21.15.17:0/3942168823 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0584018020 con 0x7f05940ca610 2023-08-09T12:41:00.625 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:41:00.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.624+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057806a080 msgr2=0x7f057806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.624+0000 7f059bd5b640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057806a080 0x7f057806c540 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f05940c9350 tx=0x7f0590009040 comp rx=0 tx=0).stop 2023-08-09T12:41:00.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.624+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05940ca610 msgr2=0x7f05940b6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.624+0000 7f059bd5b640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05940ca610 0x7f05940b6de0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f058400c730 tx=0x7f058400cbf0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.624+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 shutdown_connections 2023-08-09T12:41:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.624+0000 7f059bd5b640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f057806a080 0x7f057806c540 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.624+0000 7f059bd5b640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05940caa90 0x7f05940b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.624+0000 7f059bd5b640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05940ca610 0x7f05940b6de0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.625+0000 7f059bd5b640 1 --2- 172.21.15.17:0/3942168823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0580005180 0x7f059415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.625+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 >> 172.21.15.17:0/3942168823 conn(0x7f059406fde0 msgr2=0x7f059415ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.625+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 shutdown_connections 2023-08-09T12:41:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.625+0000 7f059bd5b640 1 -- 172.21.15.17:0/3942168823 wait complete. 2023-08-09T12:41:00.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:41:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.873+0000 7f69f2324640 1 Processor -- start 2023-08-09T12:41:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.873+0000 7f69f2324640 1 -- start start 2023-08-09T12:41:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.875+0000 7f69f2324640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0b3b40 0x7f69ec0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.875+0000 7f69f2324640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69ec0cc630 0x7f69ec0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.875+0000 7f69f2324640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec06c990 con 0x7f69ec0adc40 2023-08-09T12:41:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.875+0000 7f69f2324640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec0ae020 con 0x7f69ec0cc630 2023-08-09T12:41:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.875+0000 7f69f2324640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0b2250 con 0x7f69ec0b3b40 2023-08-09T12:41:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.875+0000 7f69f08c1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69ec0cc630 0x7f69ec0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.875+0000 7f69f08c1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69ec0cc630 0x7f69ec0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45152/0 (socket says 172.21.15.17:45152) 2023-08-09T12:41:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.875+0000 7f69f08c1640 1 -- 172.21.15.17:0/3649275058 learned_addr learned my addr 172.21.15.17:0/3649275058 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.876+0000 7f69e3fff640 1 --2- 172.21.15.17:0/3649275058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0b3b40 0x7f69ec0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.876+0000 7f69f08c1640 1 -- 172.21.15.17:0/3649275058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0b3b40 msgr2=0x7f69ec0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.876+0000 7f69f08c1640 1 --2- 172.21.15.17:0/3649275058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0b3b40 0x7f69ec0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.876+0000 7f69f08c1640 1 -- 172.21.15.17:0/3649275058 >> v1:172.21.15.142:6789/0 conn(0x7f69ec0adc40 legacy=0x7f69ec06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.876+0000 7f69f08c1640 1 -- 172.21.15.17:0/3649275058 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec0b2530 con 0x7f69ec0cc630 2023-08-09T12:41:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.877+0000 7f69f08c1640 1 --2- 172.21.15.17:0/3649275058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0cc630 0x7f69ec0ccac0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009e50 tx=0x7f69e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa208449511a53cc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.878+0000 7f69eb7fe640 1 -- 172.21.15.17:0/3649275058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e402ca70 con 0x7f69ec0cc630 2023-08-09T12:41:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.878+0000 7f69eb7fe640 1 -- 172.21.15.17:0/3649275058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e402cbd0 con 0x7f69ec0cc630 2023-08-09T12:41:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.878+0000 7f69eb7fe640 1 -- 172.21.15.17:0/3649275058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40343f0 con 0x7f69ec0cc630 2023-08-09T12:41:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.879+0000 7f69f2324640 1 -- 172.21.15.17:0/3649275058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0cc630 msgr2=0x7f69ec0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.879+0000 7f69f2324640 1 --2- 172.21.15.17:0/3649275058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0cc630 0x7f69ec0ccac0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009e50 tx=0x7f69e402bed0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.879+0000 7f69f2324640 1 -- 172.21.15.17:0/3649275058 shutdown_connections 2023-08-09T12:41:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.879+0000 7f69f2324640 1 --2- 172.21.15.17:0/3649275058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0cc630 0x7f69ec0ccac0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.879+0000 7f69f2324640 1 --2- 172.21.15.17:0/3649275058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0b3b40 0x7f69ec0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.879+0000 7f69f2324640 1 -- 172.21.15.17:0/3649275058 >> 172.21.15.17:0/3649275058 conn(0x7f69ec0cb1b0 msgr2=0x7f69ec0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.879+0000 7f69f2324640 1 -- 172.21.15.17:0/3649275058 shutdown_connections 2023-08-09T12:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.879+0000 7f69f2324640 1 -- 172.21.15.17:0/3649275058 wait complete. 2023-08-09T12:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.881+0000 7f69f2324640 1 Processor -- start 2023-08-09T12:41:00.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.881+0000 7f69f2324640 1 -- start start 2023-08-09T12:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69f2324640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ec0adc40 0x7f69ec0c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69f2324640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0b3b40 0x7f69ec0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69f2324640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0cc630 0x7f69ec1eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69f2324640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec149030 con 0x7f69ec0b3b40 2023-08-09T12:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69f2324640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec1f0450 con 0x7f69ec0adc40 2023-08-09T12:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69f2324640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0c5de0 con 0x7f69ec0cc630 2023-08-09T12:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0b3b40 0x7f69ec0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0b3b40 0x7f69ec0c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45164/0 (socket says 172.21.15.17:45164) 2023-08-09T12:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.882+0000 7f69e3fff640 1 -- 172.21.15.17:0/3675574183 learned_addr learned my addr 172.21.15.17:0/3675574183 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e3fff640 1 -- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0cc630 msgr2=0x7f69ec1eff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e3fff640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0cc630 0x7f69ec1eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e3fff640 1 -- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ec0adc40 msgr2=0x7f69ec0c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e3fff640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ec0adc40 0x7f69ec0c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e3fff640 1 -- 172.21.15.17:0/3675574183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4009b30 con 0x7f69ec0b3b40 2023-08-09T12:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e3fff640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0b3b40 0x7f69ec0c81b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f69d400d800 tx=0x7f69d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e97fa640 1 -- 172.21.15.17:0/3675574183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400b6c0 con 0x7f69ec0b3b40 2023-08-09T12:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e97fa640 1 -- 172.21.15.17:0/3675574183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d400b820 con 0x7f69ec0b3b40 2023-08-09T12:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69e97fa640 1 -- 172.21.15.17:0/3675574183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400bbd0 con 0x7f69ec0b3b40 2023-08-09T12:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec0c60c0 con 0x7f69ec0b3b40 2023-08-09T12:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.883+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec0c6680 con 0x7f69ec0b3b40 2023-08-09T12:41:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.884+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec0ad610 con 0x7f69ec0b3b40 2023-08-09T12:41:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.885+0000 7f69e97fa640 1 -- 172.21.15.17:0/3675574183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f69d400bd30 con 0x7f69ec0b3b40 2023-08-09T12:41:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.886+0000 7f69e97fa640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69cc06a050 0x7f69cc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:00.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.886+0000 7f69e97fa640 1 -- 172.21.15.17:0/3675574183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69d4088a80 con 0x7f69ec0b3b40 2023-08-09T12:41:00.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.887+0000 7f69ebfff640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69cc06a050 0x7f69cc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:00.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.888+0000 7f69ebfff640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69cc06a050 0x7f69cc06c510 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69dc003cc0 tx=0x7f69dc0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:00.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:00.891+0000 7f69e97fa640 1 -- 172.21.15.17:0/3675574183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f69d4054160 con 0x7f69ec0b3b40 2023-08-09T12:41:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.099+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69ec067a80 con 0x7f69ec0b3b40 2023-08-09T12:41:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.100+0000 7f69e97fa640 1 -- 172.21.15.17:0/3675574183 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69d4057780 con 0x7f69ec0b3b40 2023-08-09T12:41:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:41:01.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.102+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69cc06a050 msgr2=0x7f69cc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:01.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.102+0000 7f69f2324640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69cc06a050 0x7f69cc06c510 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69dc003cc0 tx=0x7f69dc0079b0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.102+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0b3b40 msgr2=0x7f69ec0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:01.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.102+0000 7f69f2324640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0b3b40 0x7f69ec0c81b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f69d400d800 tx=0x7f69d400dcc0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.103+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 shutdown_connections 2023-08-09T12:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.103+0000 7f69f2324640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69cc06a050 0x7f69cc06c510 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.103+0000 7f69f2324640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69ec0cc630 0x7f69ec1eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.103+0000 7f69f2324640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69ec0b3b40 0x7f69ec0c81b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.103+0000 7f69f2324640 1 --2- 172.21.15.17:0/3675574183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69ec0adc40 0x7f69ec0c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.103+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 >> 172.21.15.17:0/3675574183 conn(0x7f69ec0cb1b0 msgr2=0x7f69ec15dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.103+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 shutdown_connections 2023-08-09T12:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.103+0000 7f69f2324640 1 -- 172.21.15.17:0/3675574183 wait complete. 2023-08-09T12:41:01.126 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:41:01.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:01.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:41:01.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:41:01.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:01.285 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:41:01.327 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:41:01.327 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:01.376 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:41:01.377 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:01.473 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:01.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.706+0000 7f24551cb640 1 Processor -- start 2023-08-09T12:41:01.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.707+0000 7f24551cb640 1 -- start start 2023-08-09T12:41:01.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.708+0000 7f24551cb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2450159d80 0x7f24500b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:01.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.708+0000 7f24551cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500ad810 0x7f2450070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:01.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.708+0000 7f24551cb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f24500708c0 0x7f245006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:01.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.708+0000 7f24551cb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245015a160 con 0x7f24500708c0 2023-08-09T12:41:01.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.708+0000 7f24551cb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2450070d20 con 0x7f2450159d80 2023-08-09T12:41:01.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.708+0000 7f24551cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24500b4630 con 0x7f24500ad810 2023-08-09T12:41:01.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244f59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f24500708c0 0x7f245006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:01.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244f59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f24500708c0 0x7f245006eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45174/0 (socket says 172.21.15.17:45174) 2023-08-09T12:41:01.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244f59e640 1 -- 172.21.15.17:0/2892540233 learned_addr learned my addr 172.21.15.17:0/2892540233 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244ed9d640 1 --2- 172.21.15.17:0/2892540233 >> v2:172.21.15.142:3300/0 conn(0x7f2450159d80 0x7f24500b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244e59c640 1 --2- 172.21.15.17:0/2892540233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500ad810 0x7f2450070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244f59e640 1 -- 172.21.15.17:0/2892540233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500ad810 msgr2=0x7f2450070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244f59e640 1 --2- 172.21.15.17:0/2892540233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500ad810 0x7f2450070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244f59e640 1 -- 172.21.15.17:0/2892540233 >> v2:172.21.15.142:3300/0 conn(0x7f2450159d80 msgr2=0x7f24500b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244f59e640 1 --2- 172.21.15.17:0/2892540233 >> v2:172.21.15.142:3300/0 conn(0x7f2450159d80 0x7f24500b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244f59e640 1 -- 172.21.15.17:0/2892540233 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500b3ab0 con 0x7f24500708c0 2023-08-09T12:41:01.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.709+0000 7f244e59c640 1 --2- 172.21.15.17:0/2892540233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500ad810 0x7f2450070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:41:01.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.711+0000 7f244f59e640 1 --2- 172.21.15.17:0/2892540233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500708c0 0x7f245006eb90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f24500cb110 tx=0x7f244802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0f2b39d582f33d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:01.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.711+0000 7f244dd9b640 1 -- 172.21.15.17:0/2892540233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448031640 con 0x7f24500708c0 2023-08-09T12:41:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.711+0000 7f244dd9b640 1 -- 172.21.15.17:0/2892540233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480317a0 con 0x7f24500708c0 2023-08-09T12:41:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.711+0000 7f244dd9b640 1 -- 172.21.15.17:0/2892540233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448031b30 con 0x7f24500708c0 2023-08-09T12:41:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 -- 172.21.15.17:0/2892540233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500708c0 msgr2=0x7f245006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 --2- 172.21.15.17:0/2892540233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500708c0 0x7f245006eb90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f24500cb110 tx=0x7f244802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 -- 172.21.15.17:0/2892540233 shutdown_connections 2023-08-09T12:41:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 --2- 172.21.15.17:0/2892540233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500708c0 0x7f245006eb90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 --2- 172.21.15.17:0/2892540233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500ad810 0x7f2450070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 --2- 172.21.15.17:0/2892540233 >> v2:172.21.15.142:3300/0 conn(0x7f2450159d80 0x7f24500b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 -- 172.21.15.17:0/2892540233 >> 172.21.15.17:0/2892540233 conn(0x7f24500cb1b0 msgr2=0x7f24500cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 -- 172.21.15.17:0/2892540233 shutdown_connections 2023-08-09T12:41:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.712+0000 7f24551cb640 1 -- 172.21.15.17:0/2892540233 wait complete. 2023-08-09T12:41:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.714+0000 7f24551cb640 1 Processor -- start 2023-08-09T12:41:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.714+0000 7f24551cb640 1 -- start start 2023-08-09T12:41:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f24551cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500708c0 0x7f24500c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f24551cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500ad810 0x7f245014bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f24551cb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2450159d80 0x7f24500c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f24551cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24500c6110 con 0x7f24500ad810 2023-08-09T12:41:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f24551cb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24500c7d70 con 0x7f2450159d80 2023-08-09T12:41:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f24551cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24500c5770 con 0x7f24500708c0 2023-08-09T12:41:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f244e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500ad810 0x7f245014bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f244e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500ad810 0x7f245014bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45176/0 (socket says 172.21.15.17:45176) 2023-08-09T12:41:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.715+0000 7f244e59c640 1 -- 172.21.15.17:0/347910103 learned_addr learned my addr 172.21.15.17:0/347910103 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f244f59e640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2450159d80 0x7f24500c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f244ed9d640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500708c0 0x7f24500c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:01.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f244e59c640 1 -- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500708c0 msgr2=0x7f24500c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:01.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f244e59c640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500708c0 0x7f24500c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f244e59c640 1 -- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2450159d80 msgr2=0x7f24500c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:01.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f244e59c640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2450159d80 0x7f24500c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f244e59c640 1 -- 172.21.15.17:0/347910103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480094d0 con 0x7f24500ad810 2023-08-09T12:41:01.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f244e59c640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500ad810 0x7f245014bb10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f244400e810 tx=0x7f244400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:01.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f24377fe640 1 -- 172.21.15.17:0/347910103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444004030 con 0x7f24500ad810 2023-08-09T12:41:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f24377fe640 1 -- 172.21.15.17:0/347910103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444004190 con 0x7f24500ad810 2023-08-09T12:41:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f24377fe640 1 -- 172.21.15.17:0/347910103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444005990 con 0x7f24500ad810 2023-08-09T12:41:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.716+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24500c5a50 con 0x7f24500ad810 2023-08-09T12:41:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.717+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24500c6a70 con 0x7f24500ad810 2023-08-09T12:41:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.718+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2450067a80 con 0x7f24500ad810 2023-08-09T12:41:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.719+0000 7f24377fe640 1 -- 172.21.15.17:0/347910103 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2444005af0 con 0x7f24500ad810 2023-08-09T12:41:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.720+0000 7f24377fe640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f243c06a050 0x7f243c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.720+0000 7f24377fe640 1 -- 172.21.15.17:0/347910103 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2444088590 con 0x7f24500ad810 2023-08-09T12:41:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.720+0000 7f244ed9d640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f243c06a050 0x7f243c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.721+0000 7f244ed9d640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f243c06a050 0x7f243c06c510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2440009fd0 tx=0x7f244000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:01.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.724+0000 7f24377fe640 1 -- 172.21.15.17:0/347910103 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2444053c70 con 0x7f24500ad810 2023-08-09T12:41:01.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.918+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f245006fcb0 con 0x7f24500ad810 2023-08-09T12:41:01.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.921+0000 7f24377fe640 1 -- 172.21.15.17:0/347910103 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f24440093a0 con 0x7f24500ad810 2023-08-09T12:41:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:01.925 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:55.723309+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.923+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f243c06a050 msgr2=0x7f243c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.923+0000 7f24551cb640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f243c06a050 0x7f243c06c510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2440009fd0 tx=0x7f244000b040 comp rx=0 tx=0).stop 2023-08-09T12:41:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.923+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500ad810 msgr2=0x7f245014bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.923+0000 7f24551cb640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500ad810 0x7f245014bb10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f244400e810 tx=0x7f244400ecd0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.924+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 shutdown_connections 2023-08-09T12:41:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.924+0000 7f24551cb640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f243c06a050 0x7f243c06c510 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.924+0000 7f24551cb640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2450159d80 0x7f24500c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.924+0000 7f24551cb640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24500ad810 0x7f245014bb10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.924+0000 7f24551cb640 1 --2- 172.21.15.17:0/347910103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24500708c0 0x7f24500c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.924+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 >> 172.21.15.17:0/347910103 conn(0x7f24500cb1b0 msgr2=0x7f24500cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.924+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 shutdown_connections 2023-08-09T12:41:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:01.924+0000 7f24551cb640 1 -- 172.21.15.17:0/347910103 wait complete. 2023-08-09T12:41:01.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:40:39.173972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:40:40.213212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:41:01.948 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:41:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.178+0000 7f9a819b7640 1 Processor -- start 2023-08-09T12:41:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.178+0000 7f9a819b7640 1 -- start start 2023-08-09T12:41:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.179+0000 7f9a819b7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9a7c163c10 0x7f9a7c166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.179+0000 7f9a819b7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c06c990 con 0x7f9a7c0b3b40 2023-08-09T12:41:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.179+0000 7f9a819b7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c0b2250 con 0x7f9a7c0adc40 2023-08-09T12:41:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.179+0000 7f9a819b7640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c0ae020 con 0x7f9a7c163c10 2023-08-09T12:41:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.180+0000 7f9a7a7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9a7c0b3b40 0x7f9a7c0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44960/0 (socket says 172.21.15.17:44960) 2023-08-09T12:41:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.180+0000 7f9a7a7fc640 1 -- 172.21.15.17:0/2042390350 learned_addr learned my addr 172.21.15.17:0/2042390350 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.180+0000 7f9a7b7fe640 1 --2- 172.21.15.17:0/2042390350 >> v2:172.21.15.17:3300/0 conn(0x7f9a7c163c10 0x7f9a7c166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.180+0000 7f9a79ffb640 1 -- 172.21.15.17:0/2042390350 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215957154 0 0) 0x7f9a7c06c990 con 0x7f9a7c0b3b40 2023-08-09T12:41:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.180+0000 7f9a7b7fe640 1 -- 172.21.15.17:0/2042390350 >> v1:172.21.15.142:6789/0 conn(0x7f9a7c0adc40 legacy=0x7f9a7c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.180+0000 7f9a7b7fe640 1 -- 172.21.15.17:0/2042390350 >> v1:172.21.15.17:6789/0 conn(0x7f9a7c0b3b40 legacy=0x7f9a7c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.180+0000 7f9a7b7fe640 1 -- 172.21.15.17:0/2042390350 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c0b2530 con 0x7f9a7c163c10 2023-08-09T12:41:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.181+0000 7f9a7b7fe640 1 --2- 172.21.15.17:0/2042390350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c163c10 0x7f9a7c166000 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a740097a0 tx=0x7f9a7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308b6288dbb74bb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a79ffb640 1 -- 172.21.15.17:0/2042390350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74031830 con 0x7f9a7c163c10 2023-08-09T12:41:02.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a79ffb640 1 -- 172.21.15.17:0/2042390350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74031990 con 0x7f9a7c163c10 2023-08-09T12:41:02.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a79ffb640 1 -- 172.21.15.17:0/2042390350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74031d20 con 0x7f9a7c163c10 2023-08-09T12:41:02.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a819b7640 1 -- 172.21.15.17:0/2042390350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c163c10 msgr2=0x7f9a7c166000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a819b7640 1 --2- 172.21.15.17:0/2042390350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c163c10 0x7f9a7c166000 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a740097a0 tx=0x7f9a7402b8d0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a819b7640 1 -- 172.21.15.17:0/2042390350 shutdown_connections 2023-08-09T12:41:02.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a819b7640 1 --2- 172.21.15.17:0/2042390350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c163c10 0x7f9a7c166000 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a819b7640 1 -- 172.21.15.17:0/2042390350 >> 172.21.15.17:0/2042390350 conn(0x7f9a7c0cb1b0 msgr2=0x7f9a7c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:02.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a819b7640 1 -- 172.21.15.17:0/2042390350 shutdown_connections 2023-08-09T12:41:02.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.182+0000 7f9a819b7640 1 -- 172.21.15.17:0/2042390350 wait complete. 2023-08-09T12:41:02.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.184+0000 7f9a819b7640 1 Processor -- start 2023-08-09T12:41:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.184+0000 7f9a819b7640 1 -- start start 2023-08-09T12:41:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.185+0000 7f9a819b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0adc40 0x7f9a7c1518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.185+0000 7f9a819b7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a7c0b3b40 0x7f9a7c1f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.185+0000 7f9a819b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a7c163c10 0x7f9a7c0c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.185+0000 7f9a819b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c156e70 con 0x7f9a7c0adc40 2023-08-09T12:41:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.185+0000 7f9a819b7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c157bd0 con 0x7f9a7c163c10 2023-08-09T12:41:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.185+0000 7f9a819b7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c151e10 con 0x7f9a7c0b3b40 2023-08-09T12:41:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.185+0000 7f9a7affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0adc40 0x7f9a7c1518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.185+0000 7f9a7affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0adc40 0x7f9a7c1518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45180/0 (socket says 172.21.15.17:45180) 2023-08-09T12:41:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7affd640 1 -- 172.21.15.17:0/2513714278 learned_addr learned my addr 172.21.15.17:0/2513714278 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7b7fe640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a7c163c10 0x7f9a7c0c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7a7fc640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a7c0b3b40 0x7f9a7c1f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7affd640 1 -- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a7c0b3b40 msgr2=0x7f9a7c1f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7affd640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a7c0b3b40 0x7f9a7c1f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7affd640 1 -- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a7c163c10 msgr2=0x7f9a7c0c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7affd640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a7c163c10 0x7f9a7c0c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7affd640 1 -- 172.21.15.17:0/2513714278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74009400 con 0x7f9a7c0adc40 2023-08-09T12:41:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.186+0000 7f9a7affd640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0adc40 0x7f9a7c1518d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00c450 tx=0x7f9a6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.187+0000 7f9a73fff640 1 -- 172.21.15.17:0/2513714278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0052d0 con 0x7f9a7c0adc40 2023-08-09T12:41:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.187+0000 7f9a73fff640 1 -- 172.21.15.17:0/2513714278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c005430 con 0x7f9a7c0adc40 2023-08-09T12:41:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.187+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c157050 con 0x7f9a7c0adc40 2023-08-09T12:41:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.187+0000 7f9a73fff640 1 -- 172.21.15.17:0/2513714278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c012870 con 0x7f9a7c0adc40 2023-08-09T12:41:02.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.187+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c157610 con 0x7f9a7c0adc40 2023-08-09T12:41:02.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.188+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c067a80 con 0x7f9a7c0adc40 2023-08-09T12:41:02.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.189+0000 7f9a73fff640 1 -- 172.21.15.17:0/2513714278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a6c0129d0 con 0x7f9a7c0adc40 2023-08-09T12:41:02.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.190+0000 7f9a73fff640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a5c06a050 0x7f9a5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.190+0000 7f9a73fff640 1 -- 172.21.15.17:0/2513714278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a6c0880e0 con 0x7f9a7c0adc40 2023-08-09T12:41:02.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.191+0000 7f9a7a7fc640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a5c06a050 0x7f9a5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.192+0000 7f9a7a7fc640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a5c06a050 0x7f9a5c06c510 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0c1e80 tx=0x7f9a64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:02.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.195+0000 7f9a73fff640 1 -- 172.21.15.17:0/2513714278 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9a6c0537c0 con 0x7f9a7c0adc40 2023-08-09T12:41:02.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.388+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a7c0b41e0 con 0x7f9a7c0adc40 2023-08-09T12:41:02.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.389+0000 7f9a73fff640 1 -- 172.21.15.17:0/2513714278 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a6c056de0 con 0x7f9a7c0adc40 2023-08-09T12:41:02.393 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:41:02.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a5c06a050 msgr2=0x7f9a5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a5c06a050 0x7f9a5c06c510 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0c1e80 tx=0x7f9a64009040 comp rx=0 tx=0).stop 2023-08-09T12:41:02.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0adc40 msgr2=0x7f9a7c1518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0adc40 0x7f9a7c1518d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00c450 tx=0x7f9a6c00c910 comp rx=0 tx=0).stop 2023-08-09T12:41:02.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 shutdown_connections 2023-08-09T12:41:02.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a5c06a050 0x7f9a5c06c510 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a7c163c10 0x7f9a7c0c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a7c0b3b40 0x7f9a7c1f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 --2- 172.21.15.17:0/2513714278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0adc40 0x7f9a7c1518d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 >> 172.21.15.17:0/2513714278 conn(0x7f9a7c0cb1b0 msgr2=0x7f9a7c158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 shutdown_connections 2023-08-09T12:41:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.392+0000 7f9a819b7640 1 -- 172.21.15.17:0/2513714278 wait complete. 2023-08-09T12:41:02.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:41:02.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.633+0000 7fa5c1bfc640 1 Processor -- start 2023-08-09T12:41:02.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.633+0000 7fa5c1bfc640 1 -- start start 2023-08-09T12:41:02.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.635+0000 7fa5c1bfc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5bc0b3020 0x7fa5bc0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.635+0000 7fa5c1bfc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0b2b90 con 0x7fa5bc0b3d60 2023-08-09T12:41:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.635+0000 7fa5c1bfc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0b2580 con 0x7fa5bc159bd0 2023-08-09T12:41:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.635+0000 7fa5c1bfc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc0cabb0 con 0x7fa5bc0b3020 2023-08-09T12:41:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.635+0000 7fa5bbfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa5bc0b3d60 0x7fa5bc0cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44974/0 (socket says 172.21.15.17:44974) 2023-08-09T12:41:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.635+0000 7fa5bbfff640 1 -- 172.21.15.17:0/2772098522 learned_addr learned my addr 172.21.15.17:0/2772098522 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5c13fb640 1 --2- 172.21.15.17:0/2772098522 >> v2:172.21.15.142:3300/0 conn(0x7fa5bc0b3020 0x7fa5bc0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410844608 0 0) 0x7fa5bc0b2b90 con 0x7fa5bc0b3d60 2023-08-09T12:41:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a4003520 con 0x7fa5bc0b3d60 2023-08-09T12:41:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3430564500 0 0) 0x7fa5a4003520 con 0x7fa5bc0b3d60 2023-08-09T12:41:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 >> v2:172.21.15.142:3300/0 conn(0x7fa5bc0b3020 msgr2=0x7fa5bc0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 --2- 172.21.15.17:0/2772098522 >> v2:172.21.15.142:3300/0 conn(0x7fa5bc0b3020 0x7fa5bc0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 >> v1:172.21.15.142:6789/0 conn(0x7fa5bc159bd0 legacy=0x7fa5bc0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0ca5f0 con 0x7fa5bc0b3d60 2023-08-09T12:41:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa5ac001670 con 0x7fa5bc0b3d60 2023-08-09T12:41:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 >> v1:172.21.15.17:6789/0 conn(0x7fa5bc0b3d60 legacy=0x7fa5bc0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5a40047c0 0x7fa5a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5a4005180 0x7fa5a400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0cabb0 con 0x7fa5a4003970 2023-08-09T12:41:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a400e230 con 0x7fa5a4005180 2023-08-09T12:41:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.636+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a400e3f0 con 0x7fa5a40047c0 2023-08-09T12:41:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5c0bfa640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5bbfff640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5a40047c0 0x7fa5a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5c0bfa640 1 -- 172.21.15.17:0/2772098522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5a40047c0 msgr2=0x7fa5a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5c0bfa640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5a40047c0 0x7fa5a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5c13fb640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5a4005180 0x7fa5a400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5c0bfa640 1 -- 172.21.15.17:0/2772098522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5a4005180 msgr2=0x7fa5a400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:02.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5c0bfa640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5a4005180 0x7fa5a400db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5c0bfa640 1 -- 172.21.15.17:0/2772098522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4003520 con 0x7fa5a4003970 2023-08-09T12:41:02.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.637+0000 7fa5c13fb640 1 -- 172.21.15.17:0/2772098522 reap_dead start 2023-08-09T12:41:02.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.638+0000 7fa5c0bfa640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5a4003d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0001750 tx=0x7fa5a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03b93bc8dd57fa9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.639+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00052d0 con 0x7fa5a4003970 2023-08-09T12:41:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.639+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b002e050 con 0x7fa5a4003970 2023-08-09T12:41:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.639+0000 7fa5bb7fe640 1 -- 172.21.15.17:0/2772098522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0003830 con 0x7fa5a4003970 2023-08-09T12:41:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.639+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/2772098522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 msgr2=0x7fa5a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.639+0000 7fa5c1bfc640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5a4003d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0001750 tx=0x7fa5a40057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.640+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/2772098522 shutdown_connections 2023-08-09T12:41:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.640+0000 7fa5c1bfc640 1 --2- 172.21.15.17:0/2772098522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5a4003d90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.640+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/2772098522 >> 172.21.15.17:0/2772098522 conn(0x7fa5bc0cb020 msgr2=0x7fa5bc0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:02.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.640+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/2772098522 shutdown_connections 2023-08-09T12:41:02.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.640+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/2772098522 wait complete. 2023-08-09T12:41:02.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.641+0000 7fa5c1bfc640 1 Processor -- start 2023-08-09T12:41:02.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.642+0000 7fa5c1bfc640 1 -- start start 2023-08-09T12:41:02.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c1bfc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5bc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c1bfc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5bc0c4cd0 0x7fa5bc14f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c1bfc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5bc14e430 0x7fa5bc14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c1bfc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0c4840 con 0x7fa5a4003970 2023-08-09T12:41:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c1bfc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0af9e0 con 0x7fa5bc0c4cd0 2023-08-09T12:41:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c1bfc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0c8480 con 0x7fa5bc14e430 2023-08-09T12:41:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c0bfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5bc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c0bfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5bc0af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45202/0 (socket says 172.21.15.17:45202) 2023-08-09T12:41:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c0bfa640 1 -- 172.21.15.17:0/1203722273 learned_addr learned my addr 172.21.15.17:0/1203722273 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c0bfa640 1 -- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5bc14e430 msgr2=0x7fa5bc14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c0bfa640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5bc14e430 0x7fa5bc14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5bbfff640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5bc0c4cd0 0x7fa5bc14f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c0bfa640 1 -- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5bc0c4cd0 msgr2=0x7fa5bc14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c0bfa640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5bc0c4cd0 0x7fa5bc14f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.643+0000 7fa5c0bfa640 1 -- 172.21.15.17:0/1203722273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0c81a0 con 0x7fa5a4003970 2023-08-09T12:41:02.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.644+0000 7fa5c0bfa640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5bc0af4a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa5b002bc00 tx=0x7fa5b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:02.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.644+0000 7fa5b97fa640 1 -- 172.21.15.17:0/1203722273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0007a30 con 0x7fa5a4003970 2023-08-09T12:41:02.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.644+0000 7fa5b97fa640 1 -- 172.21.15.17:0/1203722273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0007640 con 0x7fa5a4003970 2023-08-09T12:41:02.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.644+0000 7fa5b97fa640 1 -- 172.21.15.17:0/1203722273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0006c00 con 0x7fa5a4003970 2023-08-09T12:41:02.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.644+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc0c44d0 con 0x7fa5a4003970 2023-08-09T12:41:02.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.644+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc0c2300 con 0x7fa5a4003970 2023-08-09T12:41:02.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.645+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc0cd620 con 0x7fa5a4003970 2023-08-09T12:41:02.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.647+0000 7fa5b97fa640 1 -- 172.21.15.17:0/1203722273 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa5b00035f0 con 0x7fa5a4003970 2023-08-09T12:41:02.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.647+0000 7fa5b97fa640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5a806a080 0x7fa5a806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:02.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.648+0000 7fa5b97fa640 1 -- 172.21.15.17:0/1203722273 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5b00aa380 con 0x7fa5a4003970 2023-08-09T12:41:02.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.648+0000 7fa5bbfff640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5a806a080 0x7fa5a806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.649+0000 7fa5bbfff640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5a806a080 0x7fa5a806c540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001200 tx=0x7fa5ac000f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.652+0000 7fa5b97fa640 1 -- 172.21.15.17:0/1203722273 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa5b0075af0 con 0x7fa5a4003970 2023-08-09T12:41:02.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.852+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa5bc04e390 con 0x7fa5a4003970 2023-08-09T12:41:02.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.853+0000 7fa5b97fa640 1 -- 172.21.15.17:0/1203722273 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa5b0079110 con 0x7fa5a4003970 2023-08-09T12:41:02.856 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:41:02.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5a806a080 msgr2=0x7fa5a806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5a806a080 0x7fa5a806c540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001200 tx=0x7fa5ac000f30 comp rx=0 tx=0).stop 2023-08-09T12:41:02.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 msgr2=0x7fa5bc0af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:02.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5bc0af4a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa5b002bc00 tx=0x7fa5b0001120 comp rx=0 tx=0).stop 2023-08-09T12:41:02.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 shutdown_connections 2023-08-09T12:41:02.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5a806a080 0x7fa5a806c540 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5bc14e430 0x7fa5bc14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5bc0c4cd0 0x7fa5bc14f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 --2- 172.21.15.17:0/1203722273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4003970 0x7fa5bc0af4a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:02.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 >> 172.21.15.17:0/1203722273 conn(0x7fa5bc0cb020 msgr2=0x7fa5bc0cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:02.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 shutdown_connections 2023-08-09T12:41:02.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:02.856+0000 7fa5c1bfc640 1 -- 172.21.15.17:0/1203722273 wait complete. 2023-08-09T12:41:02.877 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:41:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.106+0000 7f77dce60640 1 Processor -- start 2023-08-09T12:41:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.106+0000 7f77dce60640 1 -- start start 2023-08-09T12:41:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.108+0000 7f77dce60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 0x7f77d80ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.108+0000 7f77dce60640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d80cf380 con 0x7f77d80cef20 2023-08-09T12:41:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.108+0000 7f77dce60640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d806bbb0 con 0x7f77d8161130 2023-08-09T12:41:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.108+0000 7f77dce60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8164cc0 con 0x7f77d8165710 2023-08-09T12:41:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.108+0000 7f77d6d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f77d80cef20 0x7f77d80c8df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44978/0 (socket says 172.21.15.17:44978) 2023-08-09T12:41:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.108+0000 7f77d6d9d640 1 -- 172.21.15.17:0/1081147954 learned_addr learned my addr 172.21.15.17:0/1081147954 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:03.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d5d9b640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 0x7f77d80ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271408656 0 0) 0x7f77d80cf380 con 0x7f77d80cef20 2023-08-09T12:41:03.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c0003520 con 0x7f77d80cef20 2023-08-09T12:41:03.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1586194463 0 0) 0x7f77c0003520 con 0x7f77d80cef20 2023-08-09T12:41:03.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 msgr2=0x7f77d80ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:03.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 0x7f77d80ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 >> v1:172.21.15.142:6789/0 conn(0x7f77d8161130 legacy=0x7f77d80afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d80b02d0 con 0x7f77d80cef20 2023-08-09T12:41:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f77d00019f0 con 0x7f77d80cef20 2023-08-09T12:41:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 >> v1:172.21.15.17:6789/0 conn(0x7f77d80cef20 legacy=0x7f77d80c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 0x7f77c00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.109+0000 7f77d559a640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77c0003fd0 0x7f77c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d559a640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77c0004d00 0x7f77c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8164cc0 con 0x7f77c0004d00 2023-08-09T12:41:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c000bbc0 con 0x7f77c0003fd0 2023-08-09T12:41:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c000bd80 con 0x7f77d8165710 2023-08-09T12:41:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d6d9d640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77c0004d00 0x7f77c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d5d9b640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77c0003fd0 0x7f77c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d659c640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 0x7f77c00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d6d9d640 1 -- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 msgr2=0x7f77c00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d6d9d640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 0x7f77c00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d6d9d640 1 -- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77c0003fd0 msgr2=0x7f77c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d6d9d640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77c0003fd0 0x7f77c00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d6d9d640 1 -- 172.21.15.17:0/1081147954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0003520 con 0x7f77c0004d00 2023-08-09T12:41:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d5d9b640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77c0003fd0 0x7f77c00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.110+0000 7f77d659c640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77d8165710 0x7f77c00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.112+0000 7f77d6d9d640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77c0004d00 0x7f77c0005180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f77d000a820 tx=0x7f77c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a468247ad284dd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.112+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00072d0 con 0x7f77c0004d00 2023-08-09T12:41:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.112+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d002f070 con 0x7f77c0004d00 2023-08-09T12:41:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.112+0000 7f77d559a640 1 -- 172.21.15.17:0/1081147954 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00076f0 con 0x7f77c0004d00 2023-08-09T12:41:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.112+0000 7f77dce60640 1 -- 172.21.15.17:0/1081147954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77c0004d00 msgr2=0x7f77c0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.112+0000 7f77dce60640 1 --2- 172.21.15.17:0/1081147954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77c0004d00 0x7f77c0005180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f77d000a820 tx=0x7f77c00057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.112+0000 7f77d6d9d640 1 -- 172.21.15.17:0/1081147954 reap_dead start 2023-08-09T12:41:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.113+0000 7f77dce60640 1 -- 172.21.15.17:0/1081147954 shutdown_connections 2023-08-09T12:41:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.113+0000 7f77dce60640 1 -- 172.21.15.17:0/1081147954 >> 172.21.15.17:0/1081147954 conn(0x7f77d8069be0 msgr2=0x7f77d8069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.113+0000 7f77dce60640 1 -- 172.21.15.17:0/1081147954 shutdown_connections 2023-08-09T12:41:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.113+0000 7f77dce60640 1 -- 172.21.15.17:0/1081147954 wait complete. 2023-08-09T12:41:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.114+0000 7f77dce60640 1 Processor -- start 2023-08-09T12:41:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.115+0000 7f77dce60640 1 -- start start 2023-08-09T12:41:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77dce60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77c0004d00 0x7f77d81461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77dce60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d8155b50 0x7f77d8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77dce60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77d81580b0 0x7f77d80cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77dce60640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8158530 con 0x7f77d8155b50 2023-08-09T12:41:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77dce60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8162490 con 0x7f77d81580b0 2023-08-09T12:41:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77dce60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d81618c0 con 0x7f77c0004d00 2023-08-09T12:41:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d8155b50 0x7f77d8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d8155b50 0x7f77d8157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45220/0 (socket says 172.21.15.17:45220) 2023-08-09T12:41:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d5d9b640 1 -- 172.21.15.17:0/3460584689 learned_addr learned my addr 172.21.15.17:0/3460584689 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d5d9b640 1 -- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77c0004d00 msgr2=0x7f77d81461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d5d9b640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77c0004d00 0x7f77d81461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d5d9b640 1 -- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77d81580b0 msgr2=0x7f77d80cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d6d9d640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77d81580b0 0x7f77d80cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d5d9b640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77d81580b0 0x7f77d80cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.116+0000 7f77d5d9b640 1 -- 172.21.15.17:0/3460584689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8161b60 con 0x7f77d8155b50 2023-08-09T12:41:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.117+0000 7f77d5d9b640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d8155b50 0x7f77d8157b70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00e7e0 tx=0x7f77cc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.117+0000 7f77c6ffd640 1 -- 172.21.15.17:0/3460584689 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00c6d0 con 0x7f77d8155b50 2023-08-09T12:41:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.117+0000 7f77c6ffd640 1 -- 172.21.15.17:0/3460584689 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc00c830 con 0x7f77d8155b50 2023-08-09T12:41:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.117+0000 7f77c6ffd640 1 -- 172.21.15.17:0/3460584689 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00cba0 con 0x7f77d8155b50 2023-08-09T12:41:03.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.117+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d8161e40 con 0x7f77d8155b50 2023-08-09T12:41:03.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.117+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d8155fd0 con 0x7f77d8155b50 2023-08-09T12:41:03.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.118+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d8067a80 con 0x7f77d8155b50 2023-08-09T12:41:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.119+0000 7f77c6ffd640 1 -- 172.21.15.17:0/3460584689 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f77cc00cd00 con 0x7f77d8155b50 2023-08-09T12:41:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.120+0000 7f77c6ffd640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77b806a050 0x7f77b806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.120+0000 7f77c6ffd640 1 -- 172.21.15.17:0/3460584689 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f77cc088440 con 0x7f77d8155b50 2023-08-09T12:41:03.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.121+0000 7f77d659c640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77b806a050 0x7f77b806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.122+0000 7f77d659c640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77b806a050 0x7f77b806c510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77c80016d0 tx=0x7f77c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:03.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.124+0000 7f77c6ffd640 1 -- 172.21.15.17:0/3460584689 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f77cc053a90 con 0x7f77d8155b50 2023-08-09T12:41:03.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.318+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77d815ca20 con 0x7f77d8155b50 2023-08-09T12:41:03.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.319+0000 7f77c6ffd640 1 -- 172.21.15.17:0/3460584689 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77cc0570b0 con 0x7f77d8155b50 2023-08-09T12:41:03.322 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:41:03.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.321+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77b806a050 msgr2=0x7f77b806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.321+0000 7f77dce60640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77b806a050 0x7f77b806c510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77c80016d0 tx=0x7f77c8009040 comp rx=0 tx=0).stop 2023-08-09T12:41:03.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.321+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d8155b50 msgr2=0x7f77d8157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.321+0000 7f77dce60640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d8155b50 0x7f77d8157b70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00e7e0 tx=0x7f77cc00eca0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.322+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 shutdown_connections 2023-08-09T12:41:03.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.322+0000 7f77dce60640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77b806a050 0x7f77b806c510 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.322+0000 7f77dce60640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77d81580b0 0x7f77d80cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.322+0000 7f77dce60640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d8155b50 0x7f77d8157b70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.322+0000 7f77dce60640 1 --2- 172.21.15.17:0/3460584689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77c0004d00 0x7f77d81461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.322+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 >> 172.21.15.17:0/3460584689 conn(0x7f77d8069be0 msgr2=0x7f77d80b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:03.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.322+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 shutdown_connections 2023-08-09T12:41:03.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.322+0000 7f77dce60640 1 -- 172.21.15.17:0/3460584689 wait complete. 2023-08-09T12:41:03.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:41:03.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.581+0000 7fabd17d2640 1 Processor -- start 2023-08-09T12:41:03.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.581+0000 7fabd17d2640 1 -- start start 2023-08-09T12:41:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.582+0000 7fabd17d2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fabcc15cb40 0x7fabcc1609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.582+0000 7fabd17d2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fabcc0b8420 0x7fabcc0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.582+0000 7fabd17d2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc0d0f00 con 0x7fabcc15cf20 2023-08-09T12:41:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.582+0000 7fabd17d2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc1611f0 con 0x7fabcc0b8420 2023-08-09T12:41:03.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.582+0000 7fabd17d2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc1614d0 con 0x7fabcc15cb40 2023-08-09T12:41:03.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabc37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fabcc0b8420 0x7fabcc0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabc37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fabcc0b8420 0x7fabcc0cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45222/0 (socket says 172.21.15.17:45222) 2023-08-09T12:41:03.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabc37fe640 1 -- 172.21.15.17:0/3368450149 learned_addr learned my addr 172.21.15.17:0/3368450149 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:03.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabcbfff640 1 --2- 172.21.15.17:0/3368450149 >> v2:172.21.15.142:3300/0 conn(0x7fabcc15cb40 0x7fabcc1609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabc37fe640 1 -- 172.21.15.17:0/3368450149 >> v2:172.21.15.142:3300/0 conn(0x7fabcc15cb40 msgr2=0x7fabcc1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:03.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabc37fe640 1 --2- 172.21.15.17:0/3368450149 >> v2:172.21.15.142:3300/0 conn(0x7fabcc15cb40 0x7fabcc1609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabc37fe640 1 -- 172.21.15.17:0/3368450149 >> v1:172.21.15.17:6789/0 conn(0x7fabcc15cf20 legacy=0x7fabcc0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabc37fe640 1 -- 172.21.15.17:0/3368450149 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc1617b0 con 0x7fabcc0b8420 2023-08-09T12:41:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabcb7fe640 1 -- 172.21.15.17:0/3368450149 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134881759 0 0) 0x7fabcc0d0f00 con 0x7fabcc15cf20 2023-08-09T12:41:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.583+0000 7fabcbfff640 1 --2- 172.21.15.17:0/3368450149 >> v2:172.21.15.142:3300/0 conn(0x7fabcc15cb40 0x7fabcc1609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:41:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.585+0000 7fabc37fe640 1 --2- 172.21.15.17:0/3368450149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc0b8420 0x7fabcc0cd860 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0713f0 tx=0x7fabb402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529a7e3fef4499d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.585+0000 7fabcb7fe640 1 -- 172.21.15.17:0/3368450149 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb402cbb0 con 0x7fabcc0b8420 2023-08-09T12:41:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.585+0000 7fabcb7fe640 1 -- 172.21.15.17:0/3368450149 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb402cd10 con 0x7fabcc0b8420 2023-08-09T12:41:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.585+0000 7fabcb7fe640 1 -- 172.21.15.17:0/3368450149 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4034610 con 0x7fabcc0b8420 2023-08-09T12:41:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.586+0000 7fabd17d2640 1 -- 172.21.15.17:0/3368450149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc0b8420 msgr2=0x7fabcc0cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.586+0000 7fabd17d2640 1 --2- 172.21.15.17:0/3368450149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc0b8420 0x7fabcc0cd860 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0713f0 tx=0x7fabb402c010 comp rx=0 tx=0).stop 2023-08-09T12:41:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.586+0000 7fabd17d2640 1 -- 172.21.15.17:0/3368450149 shutdown_connections 2023-08-09T12:41:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.586+0000 7fabd17d2640 1 --2- 172.21.15.17:0/3368450149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc0b8420 0x7fabcc0cd860 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.586+0000 7fabd17d2640 1 --2- 172.21.15.17:0/3368450149 >> v2:172.21.15.142:3300/0 conn(0x7fabcc15cb40 0x7fabcc1609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.586+0000 7fabd17d2640 1 -- 172.21.15.17:0/3368450149 >> 172.21.15.17:0/3368450149 conn(0x7fabcc0d2ab0 msgr2=0x7fabcc0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.586+0000 7fabd17d2640 1 -- 172.21.15.17:0/3368450149 shutdown_connections 2023-08-09T12:41:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.586+0000 7fabd17d2640 1 -- 172.21.15.17:0/3368450149 wait complete. 2023-08-09T12:41:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.588+0000 7fabd17d2640 1 Processor -- start 2023-08-09T12:41:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.588+0000 7fabd17d2640 1 -- start start 2023-08-09T12:41:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd17d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabcc0b8420 0x7fabcc153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd17d2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabcc15cb40 0x7fabcc0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd17d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc15cf20 0x7fabcc0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd17d2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1f5b90 con 0x7fabcc15cf20 2023-08-09T12:41:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd17d2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1f5e30 con 0x7fabcc0b8420 2023-08-09T12:41:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd17d2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1f6110 con 0x7fabcc15cb40 2023-08-09T12:41:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd0fd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc15cf20 0x7fabcc0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd0fd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc15cf20 0x7fabcc0b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45224/0 (socket says 172.21.15.17:45224) 2023-08-09T12:41:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabd0fd1640 1 -- 172.21.15.17:0/1812079842 learned_addr learned my addr 172.21.15.17:0/1812079842 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabc37fe640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabcc15cb40 0x7fabcc0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.589+0000 7fabcbfff640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabcc0b8420 0x7fabcc153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabd0fd1640 1 -- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabcc15cb40 msgr2=0x7fabcc0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabd0fd1640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabcc15cb40 0x7fabcc0c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabd0fd1640 1 -- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabcc0b8420 msgr2=0x7fabcc153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabd0fd1640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabcc0b8420 0x7fabcc153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabd0fd1640 1 -- 172.21.15.17:0/1812079842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009b30 con 0x7fabcc15cf20 2023-08-09T12:41:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabd0fd1640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc15cf20 0x7fabcc0b6c80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fabc400c3e0 tx=0x7fabc400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:03.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabc97fa640 1 -- 172.21.15.17:0/1812079842 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc40035f0 con 0x7fabcc15cf20 2023-08-09T12:41:03.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabc97fa640 1 -- 172.21.15.17:0/1812079842 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4003750 con 0x7fabcc15cf20 2023-08-09T12:41:03.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabc97fa640 1 -- 172.21.15.17:0/1812079842 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4003b00 con 0x7fabcc15cf20 2023-08-09T12:41:03.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc1f63f0 con 0x7fabcc15cf20 2023-08-09T12:41:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.590+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc154410 con 0x7fabcc15cf20 2023-08-09T12:41:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.592+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc1f6910 con 0x7fabcc15cf20 2023-08-09T12:41:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.593+0000 7fabc97fa640 1 -- 172.21.15.17:0/1812079842 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fabc4003c60 con 0x7fabcc15cf20 2023-08-09T12:41:03.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.594+0000 7fabc97fa640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fabac06a080 0x7fabac06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:03.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.594+0000 7fabc97fa640 1 -- 172.21.15.17:0/1812079842 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabc4087a80 con 0x7fabcc15cf20 2023-08-09T12:41:03.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.595+0000 7fabcbfff640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fabac06a080 0x7fabac06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.596+0000 7fabcbfff640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fabac06a080 0x7fabac06c540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fabbc006fd0 tx=0x7fabbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:03.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.599+0000 7fabc97fa640 1 -- 172.21.15.17:0/1812079842 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fabcc1f6910 con 0x7fabcc15cf20 2023-08-09T12:41:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.796+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabcc1f6910 con 0x7fabcc15cf20 2023-08-09T12:41:03.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.797+0000 7fabc97fa640 1 -- 172.21.15.17:0/1812079842 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabc4017020 con 0x7fabcc15cf20 2023-08-09T12:41:03.800 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:41:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fabac06a080 msgr2=0x7fabac06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fabac06a080 0x7fabac06c540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fabbc006fd0 tx=0x7fabbc008040 comp rx=0 tx=0).stop 2023-08-09T12:41:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc15cf20 msgr2=0x7fabcc0b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc15cf20 0x7fabcc0b6c80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fabc400c3e0 tx=0x7fabc400c8a0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 shutdown_connections 2023-08-09T12:41:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fabac06a080 0x7fabac06c540 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabcc15cf20 0x7fabcc0b6c80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fabcc15cb40 0x7fabcc0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 --2- 172.21.15.17:0/1812079842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabcc0b8420 0x7fabcc153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 >> 172.21.15.17:0/1812079842 conn(0x7fabcc0d2ab0 msgr2=0x7fabcc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 shutdown_connections 2023-08-09T12:41:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:03.800+0000 7fabd17d2640 1 -- 172.21.15.17:0/1812079842 wait complete. 2023-08-09T12:41:03.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:41:04.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.049+0000 7f888d729640 1 Processor -- start 2023-08-09T12:41:04.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.049+0000 7f888d729640 1 -- start start 2023-08-09T12:41:04.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f888d729640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8888159bd0 0x7f88880ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f888d729640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888806fe10 con 0x7f88880b3fe0 2023-08-09T12:41:04.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f888d729640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8888159fb0 con 0x7f88880697c0 2023-08-09T12:41:04.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f888d729640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88880b11a0 con 0x7f8888159bd0 2023-08-09T12:41:04.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f887f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f88880b3fe0 0x7f8888070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45000/0 (socket says 172.21.15.17:45000) 2023-08-09T12:41:04.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f887f7fe640 1 -- 172.21.15.17:0/3920211379 learned_addr learned my addr 172.21.15.17:0/3920211379 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:04.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201669590 0 0) 0x7f888806fe10 con 0x7f88880b3fe0 2023-08-09T12:41:04.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f8887fff640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8888159bd0 0x7f88880ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.051+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8874003520 con 0x7f88880b3fe0 2023-08-09T12:41:04.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949891660 0 0) 0x7f8874003520 con 0x7f88880b3fe0 2023-08-09T12:41:04.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8888159bd0 msgr2=0x7f88880ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:04.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8888159bd0 0x7f88880ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 >> v1:172.21.15.142:6789/0 conn(0x7f88880697c0 legacy=0x7f88880b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888070970 con 0x7f88880b3fe0 2023-08-09T12:41:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8870001670 con 0x7f88880b3fe0 2023-08-09T12:41:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 >> v1:172.21.15.17:6789/0 conn(0x7f88880b3fe0 legacy=0x7f8888070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88740039a0 0x7f8874003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88740047c0 0x7f8874004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8888159bd0 0x7f887400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88880b11a0 con 0x7f88740039a0 2023-08-09T12:41:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88740054e0 con 0x7f88740047c0 2023-08-09T12:41:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887400bec0 con 0x7f8888159bd0 2023-08-09T12:41:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.052+0000 7f8887fff640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88740039a0 0x7f8874003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.053+0000 7f887f7fe640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88740047c0 0x7f8874004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.053+0000 7f8887fff640 1 -- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8888159bd0 msgr2=0x7f887400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.053+0000 7f8887fff640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8888159bd0 0x7f887400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.053+0000 7f8887fff640 1 -- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88740047c0 msgr2=0x7f8874004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.053+0000 7f8887fff640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88740047c0 0x7f8874004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.053+0000 7f8887fff640 1 -- 172.21.15.17:0/3920211379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8874003520 con 0x7f88740039a0 2023-08-09T12:41:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.054+0000 7f8887fff640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88740039a0 0x7f8874003dc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8878007360 tx=0x7f88740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61ba9d4cbe9de8f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.054+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887802ccf0 con 0x7f88740039a0 2023-08-09T12:41:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.054+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887802ce50 con 0x7f88740039a0 2023-08-09T12:41:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.054+0000 7f88877fe640 1 -- 172.21.15.17:0/3920211379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878034660 con 0x7f88740039a0 2023-08-09T12:41:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.055+0000 7f888d729640 1 -- 172.21.15.17:0/3920211379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88740039a0 msgr2=0x7f8874003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.055+0000 7f888d729640 1 --2- 172.21.15.17:0/3920211379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88740039a0 0x7f8874003dc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8878007360 tx=0x7f88740057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.055+0000 7f888cf28640 1 -- 172.21.15.17:0/3920211379 reap_dead start 2023-08-09T12:41:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.055+0000 7f888d729640 1 -- 172.21.15.17:0/3920211379 shutdown_connections 2023-08-09T12:41:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.055+0000 7f888d729640 1 -- 172.21.15.17:0/3920211379 >> 172.21.15.17:0/3920211379 conn(0x7f88880b1d50 msgr2=0x7f888806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.055+0000 7f888d729640 1 -- 172.21.15.17:0/3920211379 shutdown_connections 2023-08-09T12:41:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.055+0000 7f888d729640 1 -- 172.21.15.17:0/3920211379 wait complete. 2023-08-09T12:41:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.057+0000 7f888d729640 1 Processor -- start 2023-08-09T12:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.057+0000 7f888d729640 1 -- start start 2023-08-09T12:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888d729640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88740039a0 0x7f88880c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888d729640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88881591a0 0x7f88881517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888d729640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888151cf0 0x7f8888148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888d729640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8888157220 con 0x7f8888151cf0 2023-08-09T12:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888d729640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8888157490 con 0x7f88740039a0 2023-08-09T12:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888d729640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8888157770 con 0x7f88881591a0 2023-08-09T12:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888cf28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888151cf0 0x7f8888148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888cf28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888151cf0 0x7f8888148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45230/0 (socket says 172.21.15.17:45230) 2023-08-09T12:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888cf28640 1 -- 172.21.15.17:0/3844579787 learned_addr learned my addr 172.21.15.17:0/3844579787 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888cf28640 1 -- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88881591a0 msgr2=0x7f88881517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888cf28640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88881591a0 0x7f88881517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888cf28640 1 -- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88740039a0 msgr2=0x7f88880c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888cf28640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88740039a0 0x7f88880c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.058+0000 7f888cf28640 1 -- 172.21.15.17:0/3844579787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888157a50 con 0x7f8888151cf0 2023-08-09T12:41:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.059+0000 7f888cf28640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888151cf0 0x7f8888148c50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f88880715c0 tx=0x7f888000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.059+0000 7f88857fa640 1 -- 172.21.15.17:0/3844579787 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88800074e0 con 0x7f8888151cf0 2023-08-09T12:41:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.059+0000 7f88857fa640 1 -- 172.21.15.17:0/3844579787 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8880007660 con 0x7f8888151cf0 2023-08-09T12:41:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.059+0000 7f88857fa640 1 -- 172.21.15.17:0/3844579787 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880004260 con 0x7f8888151cf0 2023-08-09T12:41:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.059+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8888157d30 con 0x7f8888151cf0 2023-08-09T12:41:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.059+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88880c9540 con 0x7f8888151cf0 2023-08-09T12:41:04.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.060+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8888157f50 con 0x7f8888151cf0 2023-08-09T12:41:04.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.061+0000 7f88857fa640 1 -- 172.21.15.17:0/3844579787 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f88800057c0 con 0x7f8888151cf0 2023-08-09T12:41:04.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.062+0000 7f88857fa640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f886806a050 0x7f886806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.062+0000 7f88857fa640 1 -- 172.21.15.17:0/3844579787 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88800873c0 con 0x7f8888151cf0 2023-08-09T12:41:04.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.063+0000 7f8887fff640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f886806a050 0x7f886806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.064+0000 7f8887fff640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f886806a050 0x7f886806c510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8878036000 tx=0x7f887802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.067+0000 7f88857fa640 1 -- 172.21.15.17:0/3844579787 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8880052a10 con 0x7f8888151cf0 2023-08-09T12:41:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.276+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8888159fb0 con 0x7f8888151cf0 2023-08-09T12:41:04.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.277+0000 7f88857fa640 1 -- 172.21.15.17:0/3844579787 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8888159fb0 con 0x7f8888151cf0 2023-08-09T12:41:04.280 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:41:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.279+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f886806a050 msgr2=0x7f886806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.279+0000 7f888d729640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f886806a050 0x7f886806c510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8878036000 tx=0x7f887802e000 comp rx=0 tx=0).stop 2023-08-09T12:41:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.279+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888151cf0 msgr2=0x7f8888148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.279+0000 7f888d729640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888151cf0 0x7f8888148c50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f88880715c0 tx=0x7f888000c760 comp rx=0 tx=0).stop 2023-08-09T12:41:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.280+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 shutdown_connections 2023-08-09T12:41:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.280+0000 7f888d729640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f886806a050 0x7f886806c510 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.280+0000 7f888d729640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888151cf0 0x7f8888148c50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.280+0000 7f888d729640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88881591a0 0x7f88881517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.280+0000 7f888d729640 1 --2- 172.21.15.17:0/3844579787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88740039a0 0x7f88880c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.280+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 >> 172.21.15.17:0/3844579787 conn(0x7f88880b1d50 msgr2=0x7f8888065460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.280+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 shutdown_connections 2023-08-09T12:41:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.280+0000 7f888d729640 1 -- 172.21.15.17:0/3844579787 wait complete. 2023-08-09T12:41:04.303 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:41:04.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:04.304 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:41:04.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:41:04.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:04.438 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:41:04.492 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:41:04.492 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:04.554 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:41:04.555 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:41:04.555 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:04.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:41:04.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:04.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.851+0000 7f6b2c858640 1 Processor -- start 2023-08-09T12:41:04.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.851+0000 7f6b2c858640 1 -- start start 2023-08-09T12:41:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b2c858640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b28160030 0x7f6b28160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b2c858640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b280cfb50 0x7f6b280d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b2c858640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280b5a30 con 0x7f6b280b86e0 2023-08-09T12:41:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b2c858640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b280d1110 con 0x7f6b280cfb50 2023-08-09T12:41:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b2c858640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b280ceac0 con 0x7f6b28160030 2023-08-09T12:41:04.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b27fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b280cfb50 0x7f6b280d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b1effd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6b280b86e0 0x7f6b280cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45016/0 (socket says 172.21.15.17:45016) 2023-08-09T12:41:04.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b1effd640 1 -- 172.21.15.17:0/976889803 learned_addr learned my addr 172.21.15.17:0/976889803 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.853+0000 7f6b277fe640 1 --2- 172.21.15.17:0/976889803 >> v2:172.21.15.142:3300/0 conn(0x7f6b28160030 0x7f6b28160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.854+0000 7f6b27fff640 1 -- 172.21.15.17:0/976889803 >> v2:172.21.15.142:3300/0 conn(0x7f6b28160030 msgr2=0x7f6b28160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.854+0000 7f6b27fff640 1 --2- 172.21.15.17:0/976889803 >> v2:172.21.15.142:3300/0 conn(0x7f6b28160030 0x7f6b28160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.854+0000 7f6b27fff640 1 -- 172.21.15.17:0/976889803 >> v1:172.21.15.17:6789/0 conn(0x7f6b280b86e0 legacy=0x7f6b280cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.854+0000 7f6b27fff640 1 -- 172.21.15.17:0/976889803 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280d0d70 con 0x7f6b280cfb50 2023-08-09T12:41:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.854+0000 7f6b26ffd640 1 -- 172.21.15.17:0/976889803 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476807905 0 0) 0x7f6b280b5a30 con 0x7f6b280b86e0 2023-08-09T12:41:04.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.855+0000 7f6b27fff640 1 --2- 172.21.15.17:0/976889803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b280cfb50 0x7f6b280d1530 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6b28065f60 tx=0x7f6b2002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce88c2632f043df5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:04.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.855+0000 7f6b26ffd640 1 -- 172.21.15.17:0/976889803 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2002cc70 con 0x7f6b280cfb50 2023-08-09T12:41:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.855+0000 7f6b26ffd640 1 -- 172.21.15.17:0/976889803 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2002cdd0 con 0x7f6b280cfb50 2023-08-09T12:41:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.855+0000 7f6b26ffd640 1 -- 172.21.15.17:0/976889803 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20034660 con 0x7f6b280cfb50 2023-08-09T12:41:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.856+0000 7f6b2c858640 1 -- 172.21.15.17:0/976889803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b280cfb50 msgr2=0x7f6b280d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.856+0000 7f6b2c858640 1 --2- 172.21.15.17:0/976889803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b280cfb50 0x7f6b280d1530 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6b28065f60 tx=0x7f6b2002bec0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.856+0000 7f6b2c858640 1 -- 172.21.15.17:0/976889803 shutdown_connections 2023-08-09T12:41:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.856+0000 7f6b2c858640 1 --2- 172.21.15.17:0/976889803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b280cfb50 0x7f6b280d1530 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.856+0000 7f6b2c858640 1 --2- 172.21.15.17:0/976889803 >> v2:172.21.15.142:3300/0 conn(0x7f6b28160030 0x7f6b28160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.856+0000 7f6b2c858640 1 -- 172.21.15.17:0/976889803 >> 172.21.15.17:0/976889803 conn(0x7f6b280697c0 msgr2=0x7f6b28069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.856+0000 7f6b2c858640 1 -- 172.21.15.17:0/976889803 shutdown_connections 2023-08-09T12:41:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.856+0000 7f6b2c858640 1 -- 172.21.15.17:0/976889803 wait complete. 2023-08-09T12:41:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.858+0000 7f6b2c858640 1 Processor -- start 2023-08-09T12:41:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.858+0000 7f6b2c858640 1 -- start start 2023-08-09T12:41:04.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.859+0000 7f6b2c858640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b86e0 0x7f6b28159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.859+0000 7f6b2c858640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280cfb50 0x7f6b28148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.859+0000 7f6b2c858640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b28160030 0x7f6b281f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.859+0000 7f6b2c858640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28157430 con 0x7f6b28160030 2023-08-09T12:41:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.859+0000 7f6b2c858640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b281493b0 con 0x7f6b280cfb50 2023-08-09T12:41:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.859+0000 7f6b2c858640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280c9b40 con 0x7f6b280b86e0 2023-08-09T12:41:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b28160030 0x7f6b281f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b28160030 0x7f6b281f25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45258/0 (socket says 172.21.15.17:45258) 2023-08-09T12:41:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 -- 172.21.15.17:0/3455128667 learned_addr learned my addr 172.21.15.17:0/3455128667 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b1effd640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280cfb50 0x7f6b28148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 -- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b86e0 msgr2=0x7f6b28159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b86e0 0x7f6b28159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 -- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280cfb50 msgr2=0x7f6b28148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280cfb50 0x7f6b28148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 -- 172.21.15.17:0/3455128667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20009a70 con 0x7f6b28160030 2023-08-09T12:41:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.860+0000 7f6b27fff640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b28160030 0x7f6b281f25d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009e80 tx=0x7f6b20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.861+0000 7f6b24ff9640 1 -- 172.21.15.17:0/3455128667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20040650 con 0x7f6b28160030 2023-08-09T12:41:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.861+0000 7f6b24ff9640 1 -- 172.21.15.17:0/3455128667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b200407d0 con 0x7f6b28160030 2023-08-09T12:41:04.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.861+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b281f2e00 con 0x7f6b28160030 2023-08-09T12:41:04.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.861+0000 7f6b24ff9640 1 -- 172.21.15.17:0/3455128667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20040b80 con 0x7f6b28160030 2023-08-09T12:41:04.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.861+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b281f33c0 con 0x7f6b28160030 2023-08-09T12:41:04.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.862+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b280caac0 con 0x7f6b28160030 2023-08-09T12:41:04.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.863+0000 7f6b24ff9640 1 -- 172.21.15.17:0/3455128667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6b20040ce0 con 0x7f6b28160030 2023-08-09T12:41:04.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.864+0000 7f6b24ff9640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6b0806a050 0x7f6b0806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:04.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.864+0000 7f6b24ff9640 1 -- 172.21.15.17:0/3455128667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b200ab3d0 con 0x7f6b28160030 2023-08-09T12:41:04.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.865+0000 7f6b277fe640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6b0806a050 0x7f6b0806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:04.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.866+0000 7f6b277fe640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6b0806a050 0x7f6b0806c510 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b18006fd0 tx=0x7f6b18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:04.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:04.868+0000 7f6b24ff9640 1 -- 172.21.15.17:0/3455128667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6b20076a20 con 0x7f6b28160030 2023-08-09T12:41:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.106+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b2804e390 con 0x7f6b28160030 2023-08-09T12:41:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.106+0000 7f6b24ff9640 1 -- 172.21.15.17:0/3455128667 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f6b2007a040 con 0x7f6b28160030 2023-08-09T12:41:05.110 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:05.110 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:40:41.199722+0000","modified":"2023-08-09T12:40:44.738017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2993081476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2993081476},{"type":"v1","addr":"172.21.15.17:6835","nonce":2993081476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T12:41:05.110 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-08-09T12:41:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6b0806a050 msgr2=0x7f6b0806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6b0806a050 0x7f6b0806c510 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b18006fd0 tx=0x7f6b18008040 comp rx=0 tx=0).stop 2023-08-09T12:41:05.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b28160030 msgr2=0x7f6b281f25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b28160030 0x7f6b281f25d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009e80 tx=0x7f6b20004a40 comp rx=0 tx=0).stop 2023-08-09T12:41:05.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 shutdown_connections 2023-08-09T12:41:05.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6b0806a050 0x7f6b0806c510 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b28160030 0x7f6b281f25d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280cfb50 0x7f6b28148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 --2- 172.21.15.17:0/3455128667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b86e0 0x7f6b28159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.109+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 >> 172.21.15.17:0/3455128667 conn(0x7f6b280697c0 msgr2=0x7f6b2815d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:05.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.110+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 shutdown_connections 2023-08-09T12:41:05.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.110+0000 7f6b2c858640 1 -- 172.21.15.17:0/3455128667 wait complete. 2023-08-09T12:41:05.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:05.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.361+0000 7fd12c45e640 1 Processor -- start 2023-08-09T12:41:05.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.361+0000 7fd12c45e640 1 -- start start 2023-08-09T12:41:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12c45e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd124159d80 0x7fd1240b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12c45e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1240ad810 0x7fd124070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12c45e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240708c0 0x7fd12406eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12c45e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd124070d50 con 0x7fd124159d80 2023-08-09T12:41:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12c45e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12415a160 con 0x7fd1240ad810 2023-08-09T12:41:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12c45e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240b4630 con 0x7fd1240708c0 2023-08-09T12:41:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12a1fa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd124159d80 0x7fd1240b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12a1fa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd124159d80 0x7fd1240b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45262/0 (socket says 172.21.15.17:45262) 2023-08-09T12:41:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.363+0000 7fd12a1fa640 1 -- 172.21.15.17:0/4233941612 learned_addr learned my addr 172.21.15.17:0/4233941612 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:05.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.364+0000 7fd12a9fb640 1 --2- 172.21.15.17:0/4233941612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240708c0 0x7fd12406eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.364+0000 7fd1299f9640 1 --2- 172.21.15.17:0/4233941612 >> v2:172.21.15.142:3300/0 conn(0x7fd1240ad810 0x7fd124070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.364+0000 7fd12a1fa640 1 -- 172.21.15.17:0/4233941612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240708c0 msgr2=0x7fd12406eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.364+0000 7fd12a1fa640 1 --2- 172.21.15.17:0/4233941612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240708c0 0x7fd12406eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.364+0000 7fd12a1fa640 1 -- 172.21.15.17:0/4233941612 >> v2:172.21.15.142:3300/0 conn(0x7fd1240ad810 msgr2=0x7fd124070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.364+0000 7fd12a1fa640 1 --2- 172.21.15.17:0/4233941612 >> v2:172.21.15.142:3300/0 conn(0x7fd1240ad810 0x7fd124070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.364+0000 7fd12a1fa640 1 -- 172.21.15.17:0/4233941612 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240b3ab0 con 0x7fd124159d80 2023-08-09T12:41:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.364+0000 7fd1299f9640 1 --2- 172.21.15.17:0/4233941612 >> v2:172.21.15.142:3300/0 conn(0x7fd1240ad810 0x7fd124070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.365+0000 7fd12a1fa640 1 --2- 172.21.15.17:0/4233941612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240b34d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd1240b1270 tx=0x7fd12002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97d22c466fa09e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.365+0000 7fd1291f8640 1 -- 172.21.15.17:0/4233941612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120031640 con 0x7fd124159d80 2023-08-09T12:41:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.365+0000 7fd1291f8640 1 -- 172.21.15.17:0/4233941612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1200317a0 con 0x7fd124159d80 2023-08-09T12:41:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd1291f8640 1 -- 172.21.15.17:0/4233941612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120031b30 con 0x7fd124159d80 2023-08-09T12:41:05.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 -- 172.21.15.17:0/4233941612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 msgr2=0x7fd1240b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 --2- 172.21.15.17:0/4233941612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240b34d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd1240b1270 tx=0x7fd12002b8f0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 -- 172.21.15.17:0/4233941612 shutdown_connections 2023-08-09T12:41:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 --2- 172.21.15.17:0/4233941612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240708c0 0x7fd12406eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 --2- 172.21.15.17:0/4233941612 >> v2:172.21.15.142:3300/0 conn(0x7fd1240ad810 0x7fd124070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 --2- 172.21.15.17:0/4233941612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240b34d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 -- 172.21.15.17:0/4233941612 >> 172.21.15.17:0/4233941612 conn(0x7fd1240cb1b0 msgr2=0x7fd1240cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 -- 172.21.15.17:0/4233941612 shutdown_connections 2023-08-09T12:41:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.366+0000 7fd12c45e640 1 -- 172.21.15.17:0/4233941612 wait complete. 2023-08-09T12:41:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.368+0000 7fd12c45e640 1 Processor -- start 2023-08-09T12:41:05.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.368+0000 7fd12c45e640 1 -- start start 2023-08-09T12:41:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.369+0000 7fd12c45e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1240708c0 0x7fd12415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.369+0000 7fd12c45e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240ad810 0x7fd12415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.369+0000 7fd12c45e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.369+0000 7fd12c45e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240c28b0 con 0x7fd124159d80 2023-08-09T12:41:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.369+0000 7fd12c45e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12415d0f0 con 0x7fd1240708c0 2023-08-09T12:41:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.369+0000 7fd12c45e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12415d5b0 con 0x7fd1240ad810 2023-08-09T12:41:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45274/0 (socket says 172.21.15.17:45274) 2023-08-09T12:41:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 -- 172.21.15.17:0/1280887260 learned_addr learned my addr 172.21.15.17:0/1280887260 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a1fa640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1240708c0 0x7fd12415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 -- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240ad810 msgr2=0x7fd12415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd1299f9640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240ad810 0x7fd12415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240ad810 0x7fd12415a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 -- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1240708c0 msgr2=0x7fd12415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1240708c0 0x7fd12415cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 -- 172.21.15.17:0/1280887260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200094d0 con 0x7fd124159d80 2023-08-09T12:41:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a1fa640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1240708c0 0x7fd12415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.370+0000 7fd12a9fb640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240c9300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd11c007e60 tx=0x7fd11c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.371+0000 7fd11affd640 1 -- 172.21.15.17:0/1280887260 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c014620 con 0x7fd124159d80 2023-08-09T12:41:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.371+0000 7fd11affd640 1 -- 172.21.15.17:0/1280887260 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00ee90 con 0x7fd124159d80 2023-08-09T12:41:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.371+0000 7fd11affd640 1 -- 172.21.15.17:0/1280887260 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0149e0 con 0x7fd124159d80 2023-08-09T12:41:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.371+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12415a9b0 con 0x7fd124159d80 2023-08-09T12:41:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.371+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1241f1120 con 0x7fd124159d80 2023-08-09T12:41:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.372+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd124067a80 con 0x7fd124159d80 2023-08-09T12:41:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.373+0000 7fd11affd640 1 -- 172.21.15.17:0/1280887260 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd11c014b40 con 0x7fd124159d80 2023-08-09T12:41:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.374+0000 7fd11affd640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd10806a080 0x7fd10806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.375+0000 7fd11affd640 1 -- 172.21.15.17:0/1280887260 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd11c088f40 con 0x7fd124159d80 2023-08-09T12:41:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.375+0000 7fd12a1fa640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd10806a080 0x7fd10806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.376+0000 7fd12a1fa640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd10806a080 0x7fd10806c540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd120036000 tx=0x7fd12003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.379+0000 7fd11affd640 1 -- 172.21.15.17:0/1280887260 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd11c054590 con 0x7fd124159d80 2023-08-09T12:41:05.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.571+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1240caef0 con 0x7fd124159d80 2023-08-09T12:41:05.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.573+0000 7fd11affd640 1 -- 172.21.15.17:0/1280887260 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fd11c057bb0 con 0x7fd124159d80 2023-08-09T12:41:05.577 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:05.577 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:55.723309+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:05.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd10806a080 msgr2=0x7fd10806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd10806a080 0x7fd10806c540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd120036000 tx=0x7fd12003c040 comp rx=0 tx=0).stop 2023-08-09T12:41:05.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 msgr2=0x7fd1240c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240c9300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd11c007e60 tx=0x7fd11c00e4b0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 shutdown_connections 2023-08-09T12:41:05.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd10806a080 0x7fd10806c540 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd124159d80 0x7fd1240c9300 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1240ad810 0x7fd12415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 --2- 172.21.15.17:0/1280887260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1240708c0 0x7fd12415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 >> 172.21.15.17:0/1280887260 conn(0x7fd1240cb1b0 msgr2=0x7fd1240cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:05.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 shutdown_connections 2023-08-09T12:41:05.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.576+0000 7fd12c45e640 1 -- 172.21.15.17:0/1280887260 wait complete. 2023-08-09T12:41:05.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:40:39.173972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:40:40.213212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:41:05.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:41:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.830+0000 7f10ef59e640 1 Processor -- start 2023-08-09T12:41:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.830+0000 7f10ef59e640 1 -- start start 2023-08-09T12:41:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.831+0000 7f10ef59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f10f00b0020 0x7f10f00b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.832+0000 7f10ef59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f10f00cdb00 0x7f10f00acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.832+0000 7f10ef59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f0157580 con 0x7f10f0160640 2023-08-09T12:41:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.832+0000 7f10ef59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f015d1c0 con 0x7f10f00b0020 2023-08-09T12:41:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.832+0000 7f10ef59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f00b0940 con 0x7f10f00cdb00 2023-08-09T12:41:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.832+0000 7f10eed9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f10f0160640 0x7f10f015d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45026/0 (socket says 172.21.15.17:45026) 2023-08-09T12:41:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.832+0000 7f10eed9d640 1 -- 172.21.15.17:0/2364840603 learned_addr learned my addr 172.21.15.17:0/2364840603 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.832+0000 7f10ee59c640 1 --2- 172.21.15.17:0/2364840603 >> v2:172.21.15.17:3300/0 conn(0x7f10f00b0020 0x7f10f00b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.832+0000 7f10edd9b640 1 --2- 172.21.15.17:0/2364840603 >> v2:172.21.15.142:3300/0 conn(0x7f10f00cdb00 0x7f10f00acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.833+0000 7f10ed59a640 1 -- 172.21.15.17:0/2364840603 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355962958 0 0) 0x7f10f0157580 con 0x7f10f0160640 2023-08-09T12:41:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.833+0000 7f10ed59a640 1 -- 172.21.15.17:0/2364840603 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10dc003520 con 0x7f10f0160640 2023-08-09T12:41:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.833+0000 7f10ee59c640 1 -- 172.21.15.17:0/2364840603 >> v2:172.21.15.142:3300/0 conn(0x7f10f00cdb00 msgr2=0x7f10f00acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.833+0000 7f10ee59c640 1 --2- 172.21.15.17:0/2364840603 >> v2:172.21.15.142:3300/0 conn(0x7f10f00cdb00 0x7f10f00acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.833+0000 7f10ee59c640 1 -- 172.21.15.17:0/2364840603 >> v1:172.21.15.17:6789/0 conn(0x7f10f0160640 legacy=0x7f10f015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.833+0000 7f10ee59c640 1 -- 172.21.15.17:0/2364840603 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f0160b90 con 0x7f10f00b0020 2023-08-09T12:41:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.834+0000 7f10ee59c640 1 --2- 172.21.15.17:0/2364840603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f00b0020 0x7f10f00b0400 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f10f0073fc0 tx=0x7f10e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae02ad21ab8932b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.834+0000 7f10ed59a640 1 -- 172.21.15.17:0/2364840603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0031830 con 0x7f10f00b0020 2023-08-09T12:41:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ed59a640 1 -- 172.21.15.17:0/2364840603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e0031990 con 0x7f10f00b0020 2023-08-09T12:41:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ed59a640 1 -- 172.21.15.17:0/2364840603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0031d00 con 0x7f10f00b0020 2023-08-09T12:41:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ef59e640 1 -- 172.21.15.17:0/2364840603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f00b0020 msgr2=0x7f10f00b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ef59e640 1 --2- 172.21.15.17:0/2364840603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f00b0020 0x7f10f00b0400 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f10f0073fc0 tx=0x7f10e002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ef59e640 1 -- 172.21.15.17:0/2364840603 shutdown_connections 2023-08-09T12:41:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ef59e640 1 --2- 172.21.15.17:0/2364840603 >> v2:172.21.15.142:3300/0 conn(0x7f10f00cdb00 0x7f10f00acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ef59e640 1 --2- 172.21.15.17:0/2364840603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f00b0020 0x7f10f00b0400 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ef59e640 1 -- 172.21.15.17:0/2364840603 >> 172.21.15.17:0/2364840603 conn(0x7f10f00cb020 msgr2=0x7f10f00cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ef59e640 1 -- 172.21.15.17:0/2364840603 shutdown_connections 2023-08-09T12:41:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.835+0000 7f10ef59e640 1 -- 172.21.15.17:0/2364840603 wait complete. 2023-08-09T12:41:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.838+0000 7f10ef59e640 1 Processor -- start 2023-08-09T12:41:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.838+0000 7f10ef59e640 1 -- start start 2023-08-09T12:41:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.839+0000 7f10ef59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10f00b0020 0x7f10f015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.839+0000 7f10ef59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10f00cdb00 0x7f10f0155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.839+0000 7f10ef59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f0160640 0x7f10f01ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.839+0000 7f10ef59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f015eba0 con 0x7f10f0160640 2023-08-09T12:41:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.839+0000 7f10ef59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f015ee20 con 0x7f10f00b0020 2023-08-09T12:41:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.839+0000 7f10ef59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f015f100 con 0x7f10f00cdb00 2023-08-09T12:41:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10eed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f0160640 0x7f10f01ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10eed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f0160640 0x7f10f01ef4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45294/0 (socket says 172.21.15.17:45294) 2023-08-09T12:41:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10eed9d640 1 -- 172.21.15.17:0/1604793854 learned_addr learned my addr 172.21.15.17:0/1604793854 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10ee59c640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10f00b0020 0x7f10f015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10edd9b640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10f00cdb00 0x7f10f0155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10eed9d640 1 -- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10f00cdb00 msgr2=0x7f10f0155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10eed9d640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10f00cdb00 0x7f10f0155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10eed9d640 1 -- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10f00b0020 msgr2=0x7f10f015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10eed9d640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10f00b0020 0x7f10f015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.840+0000 7f10eed9d640 1 -- 172.21.15.17:0/1604793854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0009400 con 0x7f10f0160640 2023-08-09T12:41:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.841+0000 7f10eed9d640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f0160640 0x7f10f01ef4e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f10e800c390 tx=0x7f10e800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.841+0000 7f10e6ffd640 1 -- 172.21.15.17:0/1604793854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8005ce0 con 0x7f10f0160640 2023-08-09T12:41:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.841+0000 7f10e6ffd640 1 -- 172.21.15.17:0/1604793854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8005e40 con 0x7f10f0160640 2023-08-09T12:41:05.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.841+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f015f3e0 con 0x7f10f0160640 2023-08-09T12:41:05.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.841+0000 7f10e6ffd640 1 -- 172.21.15.17:0/1604793854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8007310 con 0x7f10f0160640 2023-08-09T12:41:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.841+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f00c7350 con 0x7f10f0160640 2023-08-09T12:41:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.843+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f004e390 con 0x7f10f0160640 2023-08-09T12:41:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.844+0000 7f10e6ffd640 1 -- 172.21.15.17:0/1604793854 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f10e8007470 con 0x7f10f0160640 2023-08-09T12:41:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.844+0000 7f10e6ffd640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10d006a050 0x7f10d006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.845+0000 7f10e6ffd640 1 -- 172.21.15.17:0/1604793854 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10e8087c60 con 0x7f10f0160640 2023-08-09T12:41:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.845+0000 7f10ee59c640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10d006a050 0x7f10d006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.847+0000 7f10ee59c640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10d006a050 0x7f10d006c510 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f10e0036000 tx=0x7f10e003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:05.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:05.850+0000 7f10e6ffd640 1 -- 172.21.15.17:0/1604793854 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f10e80532b0 con 0x7f10f0160640 2023-08-09T12:41:06.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.045+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10f00aeea0 con 0x7f10f0160640 2023-08-09T12:41:06.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.046+0000 7f10e6ffd640 1 -- 172.21.15.17:0/1604793854 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10e80568d0 con 0x7f10f0160640 2023-08-09T12:41:06.049 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:41:06.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.048+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10d006a050 msgr2=0x7f10d006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.048+0000 7f10ef59e640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10d006a050 0x7f10d006c510 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f10e0036000 tx=0x7f10e003c040 comp rx=0 tx=0).stop 2023-08-09T12:41:06.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.048+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f0160640 msgr2=0x7f10f01ef4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.048+0000 7f10ef59e640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f0160640 0x7f10f01ef4e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f10e800c390 tx=0x7f10e800c850 comp rx=0 tx=0).stop 2023-08-09T12:41:06.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.049+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 shutdown_connections 2023-08-09T12:41:06.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.049+0000 7f10ef59e640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10d006a050 0x7f10d006c510 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.049+0000 7f10ef59e640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f0160640 0x7f10f01ef4e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.049+0000 7f10ef59e640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10f00cdb00 0x7f10f0155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.049+0000 7f10ef59e640 1 --2- 172.21.15.17:0/1604793854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10f00b0020 0x7f10f015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.049+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 >> 172.21.15.17:0/1604793854 conn(0x7f10f00cb020 msgr2=0x7f10f00ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:06.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.049+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 shutdown_connections 2023-08-09T12:41:06.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.049+0000 7f10ef59e640 1 -- 172.21.15.17:0/1604793854 wait complete. 2023-08-09T12:41:06.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:41:06.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.299+0000 7f378a683640 1 Processor -- start 2023-08-09T12:41:06.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.299+0000 7f378a683640 1 -- start start 2023-08-09T12:41:06.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.301+0000 7f378a683640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f378415ce90 0x7f37841616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.301+0000 7f378a683640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37840d29d0 0x7f37840d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.301+0000 7f378a683640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840d3360 con 0x7f37840b6000 2023-08-09T12:41:06.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.301+0000 7f378a683640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840b6460 con 0x7f37840d29d0 2023-08-09T12:41:06.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.301+0000 7f378a683640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840cdd10 con 0x7f378415ce90 2023-08-09T12:41:06.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.301+0000 7f37837fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f37840b6000 0x7f37840cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45040/0 (socket says 172.21.15.17:45040) 2023-08-09T12:41:06.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.301+0000 7f37837fe640 1 -- 172.21.15.17:0/1440046149 learned_addr learned my addr 172.21.15.17:0/1440046149 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:06.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.301+0000 7f3788c20640 1 --2- 172.21.15.17:0/1440046149 >> v2:172.21.15.17:3300/0 conn(0x7f37840d29d0 0x7f37840d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.302+0000 7f3783fff640 1 --2- 172.21.15.17:0/1440046149 >> v2:172.21.15.142:3300/0 conn(0x7f378415ce90 0x7f37841616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.302+0000 7f3782ffd640 1 -- 172.21.15.17:0/1440046149 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912094493 0 0) 0x7f3778001110 con 0x7f37840b6000 2023-08-09T12:41:06.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.302+0000 7f3782ffd640 1 -- 172.21.15.17:0/1440046149 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f376c003520 con 0x7f37840b6000 2023-08-09T12:41:06.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.302+0000 7f3788c20640 1 -- 172.21.15.17:0/1440046149 >> v2:172.21.15.142:3300/0 conn(0x7f378415ce90 msgr2=0x7f37841616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:06.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.302+0000 7f3788c20640 1 --2- 172.21.15.17:0/1440046149 >> v2:172.21.15.142:3300/0 conn(0x7f378415ce90 0x7f37841616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.302+0000 7f3788c20640 1 -- 172.21.15.17:0/1440046149 >> v1:172.21.15.17:6789/0 conn(0x7f37840b6000 legacy=0x7f37840cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.302+0000 7f3788c20640 1 -- 172.21.15.17:0/1440046149 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840cdff0 con 0x7f37840d29d0 2023-08-09T12:41:06.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.303+0000 7f3788c20640 1 --2- 172.21.15.17:0/1440046149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840d29d0 0x7f37840d2e20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f37840d0690 tx=0x7f377c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e168e68ad64f3ce2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:06.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.303+0000 7f3782ffd640 1 -- 172.21.15.17:0/1440046149 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c031830 con 0x7f37840d29d0 2023-08-09T12:41:06.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.303+0000 7f3782ffd640 1 -- 172.21.15.17:0/1440046149 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c031990 con 0x7f37840d29d0 2023-08-09T12:41:06.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.303+0000 7f3782ffd640 1 -- 172.21.15.17:0/1440046149 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c031d20 con 0x7f37840d29d0 2023-08-09T12:41:06.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.304+0000 7f378a683640 1 -- 172.21.15.17:0/1440046149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840d29d0 msgr2=0x7f37840d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.304+0000 7f378a683640 1 --2- 172.21.15.17:0/1440046149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840d29d0 0x7f37840d2e20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f37840d0690 tx=0x7f377c02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.304+0000 7f378a683640 1 -- 172.21.15.17:0/1440046149 shutdown_connections 2023-08-09T12:41:06.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.304+0000 7f378a683640 1 --2- 172.21.15.17:0/1440046149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840d29d0 0x7f37840d2e20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.304+0000 7f378a683640 1 --2- 172.21.15.17:0/1440046149 >> v2:172.21.15.142:3300/0 conn(0x7f378415ce90 0x7f37841616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.304+0000 7f378a683640 1 -- 172.21.15.17:0/1440046149 >> 172.21.15.17:0/1440046149 conn(0x7f378406fde0 msgr2=0x7f37840701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:06.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.304+0000 7f378a683640 1 -- 172.21.15.17:0/1440046149 shutdown_connections 2023-08-09T12:41:06.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.304+0000 7f378a683640 1 -- 172.21.15.17:0/1440046149 wait complete. 2023-08-09T12:41:06.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.306+0000 7f378a683640 1 Processor -- start 2023-08-09T12:41:06.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.306+0000 7f378a683640 1 -- start start 2023-08-09T12:41:06.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f378a683640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840b6000 0x7f378415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f378a683640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37840d29d0 0x7f37840cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f378a683640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378415ce90 0x7f37841e8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f378a683640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378415d270 con 0x7f37840b6000 2023-08-09T12:41:06.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f378a683640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37841f40d0 con 0x7f37840d29d0 2023-08-09T12:41:06.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f378a683640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37841f43b0 con 0x7f378415ce90 2023-08-09T12:41:06.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f3783fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840b6000 0x7f378415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f3783fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840b6000 0x7f378415a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45314/0 (socket says 172.21.15.17:45314) 2023-08-09T12:41:06.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.307+0000 7f3783fff640 1 -- 172.21.15.17:0/3940221475 learned_addr learned my addr 172.21.15.17:0/3940221475 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:06.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3783fff640 1 -- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378415ce90 msgr2=0x7f37841e8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3783fff640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378415ce90 0x7f37841e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3783fff640 1 -- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37840d29d0 msgr2=0x7f37840cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3783fff640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37840d29d0 0x7f37840cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3783fff640 1 -- 172.21.15.17:0/3940221475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c009400 con 0x7f37840b6000 2023-08-09T12:41:06.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3783fff640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840b6000 0x7f378415a420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3774007e40 tx=0x7f377400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:06.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3780ff9640 1 -- 172.21.15.17:0/3940221475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774014620 con 0x7f37840b6000 2023-08-09T12:41:06.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3780ff9640 1 -- 172.21.15.17:0/3940221475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400ee90 con 0x7f37840b6000 2023-08-09T12:41:06.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37841f4690 con 0x7f37840b6000 2023-08-09T12:41:06.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.308+0000 7f3780ff9640 1 -- 172.21.15.17:0/3940221475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740149c0 con 0x7f37840b6000 2023-08-09T12:41:06.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.309+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37841f4c50 con 0x7f37840b6000 2023-08-09T12:41:06.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.310+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37841f4e10 con 0x7f37840b6000 2023-08-09T12:41:06.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.311+0000 7f3780ff9640 1 -- 172.21.15.17:0/3940221475 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3774014b20 con 0x7f37840b6000 2023-08-09T12:41:06.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.312+0000 7f3780ff9640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f377006a050 0x7f377006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.312+0000 7f3780ff9640 1 -- 172.21.15.17:0/3940221475 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3774088fc0 con 0x7f37840b6000 2023-08-09T12:41:06.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.312+0000 7f37837fe640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f377006a050 0x7f377006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.314+0000 7f37837fe640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f377006a050 0x7f377006c510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3778005880 tx=0x7f3778001150 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:06.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.316+0000 7f3780ff9640 1 -- 172.21.15.17:0/3940221475 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3774054610 con 0x7f37840b6000 2023-08-09T12:41:06.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.506+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3784067a80 con 0x7f37840b6000 2023-08-09T12:41:06.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.507+0000 7f3780ff9640 1 -- 172.21.15.17:0/3940221475 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3774057c30 con 0x7f37840b6000 2023-08-09T12:41:06.512 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:41:06.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f377006a050 msgr2=0x7f377006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f377006a050 0x7f377006c510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3778005880 tx=0x7f3778001150 comp rx=0 tx=0).stop 2023-08-09T12:41:06.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840b6000 msgr2=0x7f378415a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840b6000 0x7f378415a420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3774007e40 tx=0x7f377400e4b0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 shutdown_connections 2023-08-09T12:41:06.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f377006a050 0x7f377006c510 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378415ce90 0x7f37841e8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37840d29d0 0x7f37840cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 --2- 172.21.15.17:0/3940221475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37840b6000 0x7f378415a420 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 >> 172.21.15.17:0/3940221475 conn(0x7f378406fde0 msgr2=0x7f37840b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:06.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 shutdown_connections 2023-08-09T12:41:06.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.510+0000 7f378a683640 1 -- 172.21.15.17:0/3940221475 wait complete. 2023-08-09T12:41:06.532 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:41:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.750+0000 7f4abcb91640 1 Processor -- start 2023-08-09T12:41:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.751+0000 7f4abcb91640 1 -- start start 2023-08-09T12:41:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.752+0000 7f4abcb91640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ab80ce9e0 0x7f4ab80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.752+0000 7f4abcb91640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80cf380 con 0x7f4ab8158840 2023-08-09T12:41:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.752+0000 7f4abcb91640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80b0220 con 0x7f4ab815b160 2023-08-09T12:41:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.752+0000 7f4abcb91640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab8158c20 con 0x7f4ab80ce9e0 2023-08-09T12:41:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.753+0000 7f4ab659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4ab8158840 0x7f4ab80af7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45042/0 (socket says 172.21.15.17:45042) 2023-08-09T12:41:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.753+0000 7f4ab659c640 1 -- 172.21.15.17:0/839048034 learned_addr learned my addr 172.21.15.17:0/839048034 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.753+0000 7f4ab5d9b640 1 --2- 172.21.15.17:0/839048034 >> v2:172.21.15.17:3300/0 conn(0x7f4ab80ce9e0 0x7f4ab80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.753+0000 7f4ab5d9b640 1 -- 172.21.15.17:0/839048034 >> v1:172.21.15.142:6789/0 conn(0x7f4ab815b160 legacy=0x7f4ab815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.753+0000 7f4ab559a640 1 -- 172.21.15.17:0/839048034 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295099241 0 0) 0x7f4ab80cf380 con 0x7f4ab8158840 2023-08-09T12:41:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.753+0000 7f4ab5d9b640 1 -- 172.21.15.17:0/839048034 >> v1:172.21.15.17:6789/0 conn(0x7f4ab8158840 legacy=0x7f4ab80af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.753+0000 7f4ab5d9b640 1 -- 172.21.15.17:0/839048034 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab815e7f0 con 0x7f4ab80ce9e0 2023-08-09T12:41:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.755+0000 7f4ab5d9b640 1 --2- 172.21.15.17:0/839048034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab80ce9e0 0x7f4ab80cee40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0097a0 tx=0x7f4aac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df72a7ea431a61a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.755+0000 7f4ab559a640 1 -- 172.21.15.17:0/839048034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac031830 con 0x7f4ab80ce9e0 2023-08-09T12:41:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.755+0000 7f4ab559a640 1 -- 172.21.15.17:0/839048034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac031990 con 0x7f4ab80ce9e0 2023-08-09T12:41:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.755+0000 7f4ab559a640 1 -- 172.21.15.17:0/839048034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac031d20 con 0x7f4ab80ce9e0 2023-08-09T12:41:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.756+0000 7f4abcb91640 1 -- 172.21.15.17:0/839048034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab80ce9e0 msgr2=0x7f4ab80cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.756+0000 7f4abcb91640 1 --2- 172.21.15.17:0/839048034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab80ce9e0 0x7f4ab80cee40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0097a0 tx=0x7f4aac02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.756+0000 7f4abcb91640 1 -- 172.21.15.17:0/839048034 shutdown_connections 2023-08-09T12:41:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.756+0000 7f4abcb91640 1 --2- 172.21.15.17:0/839048034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab80ce9e0 0x7f4ab80cee40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.756+0000 7f4abcb91640 1 -- 172.21.15.17:0/839048034 >> 172.21.15.17:0/839048034 conn(0x7f4ab8069be0 msgr2=0x7f4ab8069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.756+0000 7f4abcb91640 1 -- 172.21.15.17:0/839048034 shutdown_connections 2023-08-09T12:41:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.756+0000 7f4abcb91640 1 -- 172.21.15.17:0/839048034 wait complete. 2023-08-09T12:41:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.758+0000 7f4abcb91640 1 Processor -- start 2023-08-09T12:41:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.758+0000 7f4abcb91640 1 -- start start 2023-08-09T12:41:06.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4abcb91640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ab80ce9e0 0x7f4ab80c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4abcb91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab8158840 0x7f4ab814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4abcb91640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ab815b160 0x7f4ab8158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4abcb91640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80cc290 con 0x7f4ab8158840 2023-08-09T12:41:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4abcb91640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab814eb00 con 0x7f4ab80ce9e0 2023-08-09T12:41:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4abcb91640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80cc4e0 con 0x7f4ab815b160 2023-08-09T12:41:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab8158840 0x7f4ab814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab8158840 0x7f4ab814e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45332/0 (socket says 172.21.15.17:45332) 2023-08-09T12:41:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab5d9b640 1 -- 172.21.15.17:0/2721358496 learned_addr learned my addr 172.21.15.17:0/2721358496 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab659c640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ab80ce9e0 0x7f4ab80c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab6d9d640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ab815b160 0x7f4ab8158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab5d9b640 1 -- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ab815b160 msgr2=0x7f4ab8158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab5d9b640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ab815b160 0x7f4ab8158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab5d9b640 1 -- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ab80ce9e0 msgr2=0x7f4ab80c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab5d9b640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ab80ce9e0 0x7f4ab80c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.759+0000 7f4ab5d9b640 1 -- 172.21.15.17:0/2721358496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac009400 con 0x7f4ab8158840 2023-08-09T12:41:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.760+0000 7f4ab5d9b640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab8158840 0x7f4ab814e5c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0098c0 tx=0x7f4aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.760+0000 7f4aa6ffd640 1 -- 172.21.15.17:0/2721358496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac03ba70 con 0x7f4ab8158840 2023-08-09T12:41:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.760+0000 7f4aa6ffd640 1 -- 172.21.15.17:0/2721358496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac03bbf0 con 0x7f4ab8158840 2023-08-09T12:41:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.760+0000 7f4aa6ffd640 1 -- 172.21.15.17:0/2721358496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0453f0 con 0x7f4ab8158840 2023-08-09T12:41:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.760+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab80cc7c0 con 0x7f4ab8158840 2023-08-09T12:41:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.760+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab80ccd80 con 0x7f4ab8158840 2023-08-09T12:41:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.762+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab8067a80 con 0x7f4ab8158840 2023-08-09T12:41:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.762+0000 7f4aa6ffd640 1 -- 172.21.15.17:0/2721358496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4aac04e450 con 0x7f4ab8158840 2023-08-09T12:41:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.763+0000 7f4aa6ffd640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a9806a050 0x7f4a9806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.763+0000 7f4aa6ffd640 1 -- 172.21.15.17:0/2721358496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4aac0aa7f0 con 0x7f4ab8158840 2023-08-09T12:41:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.764+0000 7f4ab659c640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a9806a050 0x7f4a9806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.765+0000 7f4ab659c640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a9806a050 0x7f4a9806c510 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000f60 tx=0x7f4aa8007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.767+0000 7f4aa6ffd640 1 -- 172.21.15.17:0/2721358496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4aac075f70 con 0x7f4ab8158840 2023-08-09T12:41:06.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.955+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ab815ed80 con 0x7f4ab8158840 2023-08-09T12:41:06.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.956+0000 7f4aa6ffd640 1 -- 172.21.15.17:0/2721358496 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4aac079590 con 0x7f4ab8158840 2023-08-09T12:41:06.961 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:41:06.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.958+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a9806a050 msgr2=0x7f4a9806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.958+0000 7f4abcb91640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a9806a050 0x7f4a9806c510 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000f60 tx=0x7f4aa8007b70 comp rx=0 tx=0).stop 2023-08-09T12:41:06.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab8158840 msgr2=0x7f4ab814e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:06.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab8158840 0x7f4ab814e5c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0098c0 tx=0x7f4aac0046c0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 shutdown_connections 2023-08-09T12:41:06.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a9806a050 0x7f4a9806c510 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ab815b160 0x7f4ab8158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ab8158840 0x7f4ab814e5c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 --2- 172.21.15.17:0/2721358496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ab80ce9e0 0x7f4ab80c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:06.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 >> 172.21.15.17:0/2721358496 conn(0x7f4ab8069be0 msgr2=0x7f4ab80c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:06.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 shutdown_connections 2023-08-09T12:41:06.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:06.959+0000 7f4abcb91640 1 -- 172.21.15.17:0/2721358496 wait complete. 2023-08-09T12:41:06.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:41:07.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.187+0000 7f192f90f640 1 Processor -- start 2023-08-09T12:41:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.188+0000 7f192f90f640 1 -- start start 2023-08-09T12:41:07.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.189+0000 7f192f90f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19280b3b40 0x7f19280b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.189+0000 7f192f90f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19280cc630 0x7f19280ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.189+0000 7f192f90f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192806c990 con 0x7f19280adc40 2023-08-09T12:41:07.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.189+0000 7f192f90f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280ae020 con 0x7f19280cc630 2023-08-09T12:41:07.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.189+0000 7f192f90f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280b2250 con 0x7f19280b3b40 2023-08-09T12:41:07.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.190+0000 7f192d6ab640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f19280adc40 0x7f192806c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45052/0 (socket says 172.21.15.17:45052) 2023-08-09T12:41:07.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.190+0000 7f192d6ab640 1 -- 172.21.15.17:0/1451513655 learned_addr learned my addr 172.21.15.17:0/1451513655 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.190+0000 7f192deac640 1 --2- 172.21.15.17:0/1451513655 >> v2:172.21.15.142:3300/0 conn(0x7f19280cc630 0x7f19280ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.190+0000 7f192ceaa640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19280b3b40 0x7f19280b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.190+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894634811 0 0) 0x7f192806c990 con 0x7f19280adc40 2023-08-09T12:41:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.190+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1914003520 con 0x7f19280adc40 2023-08-09T12:41:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823607238 0 0) 0x7f1914003520 con 0x7f19280adc40 2023-08-09T12:41:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19280b3b40 msgr2=0x7f19280b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19280b3b40 0x7f19280b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 >> v2:172.21.15.142:3300/0 conn(0x7f19280cc630 msgr2=0x7f19280ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:07.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 --2- 172.21.15.17:0/1451513655 >> v2:172.21.15.142:3300/0 conn(0x7f19280cc630 0x7f19280ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280b2530 con 0x7f19280adc40 2023-08-09T12:41:07.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1924001670 con 0x7f19280adc40 2023-08-09T12:41:07.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 >> v1:172.21.15.17:6789/0 conn(0x7f19280adc40 legacy=0x7f192806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1914003970 0x7f1914003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140047c0 0x7f1914004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19280b3b40 0x7f1914005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280ae020 con 0x7f1914003970 2023-08-09T12:41:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280b2250 con 0x7f19140047c0 2023-08-09T12:41:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191400b980 con 0x7f19280b3b40 2023-08-09T12:41:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.191+0000 7f192d6ab640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1914003970 0x7f1914003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.192+0000 7f192ceaa640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140047c0 0x7f1914004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.192+0000 7f192deac640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19280b3b40 0x7f1914005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.192+0000 7f192d6ab640 1 -- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19280b3b40 msgr2=0x7f1914005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.192+0000 7f192d6ab640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19280b3b40 0x7f1914005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.192+0000 7f192d6ab640 1 -- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140047c0 msgr2=0x7f1914004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.192+0000 7f192d6ab640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140047c0 0x7f1914004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.192+0000 7f192d6ab640 1 -- 172.21.15.17:0/1451513655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914003520 con 0x7f1914003970 2023-08-09T12:41:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.192+0000 7f192ceaa640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19140047c0 0x7f1914004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.193+0000 7f192d6ab640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1914003970 0x7f1914003d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f192400c240 tx=0x7f19140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4164885258d2a760 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.193+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192402cb00 con 0x7f1914003970 2023-08-09T12:41:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.193+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192402cc60 con 0x7f1914003970 2023-08-09T12:41:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.193+0000 7f191ffff640 1 -- 172.21.15.17:0/1451513655 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924005af0 con 0x7f1914003970 2023-08-09T12:41:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.194+0000 7f192f90f640 1 -- 172.21.15.17:0/1451513655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1914003970 msgr2=0x7f1914003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.194+0000 7f192f90f640 1 --2- 172.21.15.17:0/1451513655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1914003970 0x7f1914003d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f192400c240 tx=0x7f19140057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.194+0000 7f192deac640 1 -- 172.21.15.17:0/1451513655 reap_dead start 2023-08-09T12:41:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.194+0000 7f192f90f640 1 -- 172.21.15.17:0/1451513655 shutdown_connections 2023-08-09T12:41:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.194+0000 7f192f90f640 1 -- 172.21.15.17:0/1451513655 >> 172.21.15.17:0/1451513655 conn(0x7f19280cb1b0 msgr2=0x7f19280cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.194+0000 7f192f90f640 1 -- 172.21.15.17:0/1451513655 shutdown_connections 2023-08-09T12:41:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.194+0000 7f192f90f640 1 -- 172.21.15.17:0/1451513655 wait complete. 2023-08-09T12:41:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.196+0000 7f192f90f640 1 Processor -- start 2023-08-09T12:41:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.196+0000 7f192f90f640 1 -- start start 2023-08-09T12:41:07.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192f90f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1914003970 0x7f1928158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192f90f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19280c67c0 0x7f19280c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192f90f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19280c29e0 0x7f19280c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192f90f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192815a880 con 0x7f19280c67c0 2023-08-09T12:41:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192f90f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280c7330 con 0x7f19280c29e0 2023-08-09T12:41:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192f90f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280c7610 con 0x7f1914003970 2023-08-09T12:41:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192ceaa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19280c67c0 0x7f19280c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192ceaa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19280c67c0 0x7f19280c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45344/0 (socket says 172.21.15.17:45344) 2023-08-09T12:41:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.197+0000 7f192ceaa640 1 -- 172.21.15.17:0/367083123 learned_addr learned my addr 172.21.15.17:0/367083123 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f192deac640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19280c29e0 0x7f19280c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f192ceaa640 1 -- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1914003970 msgr2=0x7f1928158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f192ceaa640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1914003970 0x7f1928158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f192ceaa640 1 -- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19280c29e0 msgr2=0x7f19280c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f192ceaa640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19280c29e0 0x7f19280c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f192ceaa640 1 -- 172.21.15.17:0/367083123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280c78f0 con 0x7f19280c67c0 2023-08-09T12:41:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f192ceaa640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19280c67c0 0x7f19280c6c40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1918010820 tx=0x7f1918010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f191dffb640 1 -- 172.21.15.17:0/367083123 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918004220 con 0x7f19280c67c0 2023-08-09T12:41:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f191dffb640 1 -- 172.21.15.17:0/367083123 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918004380 con 0x7f19280c67c0 2023-08-09T12:41:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f191dffb640 1 -- 172.21.15.17:0/367083123 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800eb80 con 0x7f19280c67c0 2023-08-09T12:41:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.198+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19280c7bd0 con 0x7f19280c67c0 2023-08-09T12:41:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.199+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1928158bc0 con 0x7f19280c67c0 2023-08-09T12:41:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.200+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1928158db0 con 0x7f19280c67c0 2023-08-09T12:41:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.201+0000 7f191dffb640 1 -- 172.21.15.17:0/367083123 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f191800ece0 con 0x7f19280c67c0 2023-08-09T12:41:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.201+0000 7f191dffb640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f190c06a080 0x7f190c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.202+0000 7f191dffb640 1 -- 172.21.15.17:0/367083123 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19180888b0 con 0x7f19280c67c0 2023-08-09T12:41:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.202+0000 7f192d6ab640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f190c06a080 0x7f190c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.203+0000 7f192d6ab640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f190c06a080 0x7f190c06c540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1924034000 tx=0x7f192402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.206+0000 7f191dffb640 1 -- 172.21.15.17:0/367083123 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1918053f00 con 0x7f19280c67c0 2023-08-09T12:41:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.401+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1928067a80 con 0x7f19280c67c0 2023-08-09T12:41:07.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.402+0000 7f191dffb640 1 -- 172.21.15.17:0/367083123 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1918057520 con 0x7f19280c67c0 2023-08-09T12:41:07.405 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:41:07.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f190c06a080 msgr2=0x7f190c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f190c06a080 0x7f190c06c540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1924034000 tx=0x7f192402e000 comp rx=0 tx=0).stop 2023-08-09T12:41:07.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19280c67c0 msgr2=0x7f19280c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19280c67c0 0x7f19280c6c40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1918010820 tx=0x7f1918010ce0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 shutdown_connections 2023-08-09T12:41:07.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f190c06a080 0x7f190c06c540 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19280c29e0 0x7f19280c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19280c67c0 0x7f19280c6c40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 --2- 172.21.15.17:0/367083123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1914003970 0x7f1928158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 >> 172.21.15.17:0/367083123 conn(0x7f19280cb1b0 msgr2=0x7f192806f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:07.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 shutdown_connections 2023-08-09T12:41:07.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.405+0000 7f192f90f640 1 -- 172.21.15.17:0/367083123 wait complete. 2023-08-09T12:41:07.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.654+0000 7f8a3c9b2640 1 Processor -- start 2023-08-09T12:41:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.654+0000 7f8a3c9b2640 1 -- start start 2023-08-09T12:41:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.655+0000 7f8a3c9b2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8a38160030 0x7f8a38160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.655+0000 7f8a3c9b2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380b86e0 0x7f8a380cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.655+0000 7f8a3c9b2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a380b5a30 con 0x7f8a380cf980 2023-08-09T12:41:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.655+0000 7f8a3c9b2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a380d1110 con 0x7f8a38160030 2023-08-09T12:41:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.655+0000 7f8a3c9b2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380ceac0 con 0x7f8a380b86e0 2023-08-09T12:41:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.656+0000 7f8a377fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8a38160030 0x7f8a38160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.656+0000 7f8a377fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8a38160030 0x7f8a38160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45358/0 (socket says 172.21.15.17:45358) 2023-08-09T12:41:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.656+0000 7f8a377fe640 1 -- 172.21.15.17:0/3727811681 learned_addr learned my addr 172.21.15.17:0/3727811681 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.656+0000 7f8a36ffd640 1 --2- 172.21.15.17:0/3727811681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380b86e0 0x7f8a380cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.656+0000 7f8a377fe640 1 -- 172.21.15.17:0/3727811681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380b86e0 msgr2=0x7f8a380cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:07.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.656+0000 7f8a377fe640 1 --2- 172.21.15.17:0/3727811681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380b86e0 0x7f8a380cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.656+0000 7f8a377fe640 1 -- 172.21.15.17:0/3727811681 >> v1:172.21.15.142:6789/0 conn(0x7f8a380cf980 legacy=0x7f8a380b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:07.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.656+0000 7f8a377fe640 1 -- 172.21.15.17:0/3727811681 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380d0d70 con 0x7f8a38160030 2023-08-09T12:41:07.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.658+0000 7f8a377fe640 1 --2- 172.21.15.17:0/3727811681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38160030 0x7f8a38160740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009e50 tx=0x7f8a2802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee888220ce3806e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:07.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.658+0000 7f8a367fc640 1 -- 172.21.15.17:0/3727811681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2802ca70 con 0x7f8a38160030 2023-08-09T12:41:07.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.658+0000 7f8a367fc640 1 -- 172.21.15.17:0/3727811681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2802cbd0 con 0x7f8a38160030 2023-08-09T12:41:07.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.658+0000 7f8a367fc640 1 -- 172.21.15.17:0/3727811681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a280343f0 con 0x7f8a38160030 2023-08-09T12:41:07.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.659+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/3727811681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38160030 msgr2=0x7f8a38160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.659+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/3727811681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38160030 0x7f8a38160740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009e50 tx=0x7f8a2802bed0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.659+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/3727811681 shutdown_connections 2023-08-09T12:41:07.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.659+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/3727811681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380b86e0 0x7f8a380cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.659+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/3727811681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38160030 0x7f8a38160740 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.659+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/3727811681 >> 172.21.15.17:0/3727811681 conn(0x7f8a380697c0 msgr2=0x7f8a38069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:07.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.659+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/3727811681 shutdown_connections 2023-08-09T12:41:07.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.659+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/3727811681 wait complete. 2023-08-09T12:41:07.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.661+0000 7f8a3c9b2640 1 Processor -- start 2023-08-09T12:41:07.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.661+0000 7f8a3c9b2640 1 -- start start 2023-08-09T12:41:07.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a3c9b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a380b86e0 0x7f8a380cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a3c9b2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380cf980 0x7f8a38157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a3c9b2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a38160030 0x7f8a38148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a3c9b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a38157c60 con 0x7f8a380b86e0 2023-08-09T12:41:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a3c9b2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380cc3c0 con 0x7f8a38160030 2023-08-09T12:41:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a3c9b2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380cb7b0 con 0x7f8a380cf980 2023-08-09T12:41:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a380b86e0 0x7f8a380cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a380b86e0 0x7f8a380cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45370/0 (socket says 172.21.15.17:45370) 2023-08-09T12:41:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.662+0000 7f8a377fe640 1 -- 172.21.15.17:0/2704907803 learned_addr learned my addr 172.21.15.17:0/2704907803 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a377fe640 1 -- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380cf980 msgr2=0x7f8a38157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a377fe640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380cf980 0x7f8a38157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a377fe640 1 -- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a38160030 msgr2=0x7f8a38148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a37fff640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a38160030 0x7f8a38148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a377fe640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a38160030 0x7f8a38148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a377fe640 1 -- 172.21.15.17:0/2704907803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a28009b30 con 0x7f8a380b86e0 2023-08-09T12:41:07.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a37fff640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a38160030 0x7f8a38148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:07.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a377fe640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a380b86e0 0x7f8a380cb0b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009e50 tx=0x7f8a28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:07.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a1ffff640 1 -- 172.21.15.17:0/2704907803 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28009510 con 0x7f8a380b86e0 2023-08-09T12:41:07.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.663+0000 7f8a1ffff640 1 -- 172.21.15.17:0/2704907803 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2803e450 con 0x7f8a380b86e0 2023-08-09T12:41:07.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.664+0000 7f8a1ffff640 1 -- 172.21.15.17:0/2704907803 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2803e800 con 0x7f8a380b86e0 2023-08-09T12:41:07.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.664+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a380cba90 con 0x7f8a380b86e0 2023-08-09T12:41:07.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.664+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a380cc050 con 0x7f8a380b86e0 2023-08-09T12:41:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.665+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a380c7070 con 0x7f8a380b86e0 2023-08-09T12:41:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.666+0000 7f8a1ffff640 1 -- 172.21.15.17:0/2704907803 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8a2803e960 con 0x7f8a380b86e0 2023-08-09T12:41:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.667+0000 7f8a1ffff640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a2406a050 0x7f8a2406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.667+0000 7f8a1ffff640 1 -- 172.21.15.17:0/2704907803 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a280ab510 con 0x7f8a380b86e0 2023-08-09T12:41:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.667+0000 7f8a36ffd640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a2406a050 0x7f8a2406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.669+0000 7f8a36ffd640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a2406a050 0x7f8a2406c510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a38158010 tx=0x7f8a2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.671+0000 7f8a1ffff640 1 -- 172.21.15.17:0/2704907803 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8a28076ad0 con 0x7f8a380b86e0 2023-08-09T12:41:07.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.905+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a3804e390 con 0x7f8a380b86e0 2023-08-09T12:41:07.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.906+0000 7f8a1ffff640 1 -- 172.21.15.17:0/2704907803 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f8a2807a0f0 con 0x7f8a380b86e0 2023-08-09T12:41:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:07.912 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:40:41.199722+0000","modified":"2023-08-09T12:40:44.738017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2993081476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2993081476},{"type":"v1","addr":"172.21.15.17:6835","nonce":2993081476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T12:41:07.913 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-08-09T12:41:07.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.908+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a2406a050 msgr2=0x7f8a2406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.908+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a2406a050 0x7f8a2406c510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a38158010 tx=0x7f8a2c008040 comp rx=0 tx=0).stop 2023-08-09T12:41:07.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.908+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a380b86e0 msgr2=0x7f8a380cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:07.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.908+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a380b86e0 0x7f8a380cb0b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009e50 tx=0x7f8a28004a40 comp rx=0 tx=0).stop 2023-08-09T12:41:07.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.909+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 shutdown_connections 2023-08-09T12:41:07.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.909+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a2406a050 0x7f8a2406c510 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.909+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a38160030 0x7f8a38148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.909+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a380cf980 0x7f8a38157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.909+0000 7f8a3c9b2640 1 --2- 172.21.15.17:0/2704907803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a380b86e0 0x7f8a380cb0b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:07.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.909+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 >> 172.21.15.17:0/2704907803 conn(0x7f8a380697c0 msgr2=0x7f8a380c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:07.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.909+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 shutdown_connections 2023-08-09T12:41:07.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:07.909+0000 7f8a3c9b2640 1 -- 172.21.15.17:0/2704907803 wait complete. 2023-08-09T12:41:07.932 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:08.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.162+0000 7ff5b1aba640 1 Processor -- start 2023-08-09T12:41:08.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.162+0000 7ff5b1aba640 1 -- start start 2023-08-09T12:41:08.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.163+0000 7ff5b1aba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff5ac15ce90 0x7ff5ac1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.163+0000 7ff5b1aba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac0b6000 0x7ff5ac0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5b1aba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5ac0d29d0 0x7ff5ac0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5b1aba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0d33a0 con 0x7ff5ac15ce90 2023-08-09T12:41:08.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5b1aba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0b6460 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5b1aba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0cda40 con 0x7ff5ac0b6000 2023-08-09T12:41:08.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5ab7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff5ac15ce90 0x7ff5ac1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5ab7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff5ac15ce90 0x7ff5ac1616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34200/0 (socket says 172.21.15.17:34200) 2023-08-09T12:41:08.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5ab7fe640 1 -- 172.21.15.17:0/2148538474 learned_addr learned my addr 172.21.15.17:0/2148538474 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:08.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5aaffd640 1 --2- 172.21.15.17:0/2148538474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac0b6000 0x7ff5ac0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5abfff640 1 --2- 172.21.15.17:0/2148538474 >> v2:172.21.15.142:3300/0 conn(0x7ff5ac0d29d0 0x7ff5ac0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5ab7fe640 1 -- 172.21.15.17:0/2148538474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac0b6000 msgr2=0x7ff5ac0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:08.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5ab7fe640 1 --2- 172.21.15.17:0/2148538474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac0b6000 0x7ff5ac0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5ab7fe640 1 -- 172.21.15.17:0/2148538474 >> v2:172.21.15.142:3300/0 conn(0x7ff5ac0d29d0 msgr2=0x7ff5ac0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:08.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5ab7fe640 1 --2- 172.21.15.17:0/2148538474 >> v2:172.21.15.142:3300/0 conn(0x7ff5ac0d29d0 0x7ff5ac0d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.164+0000 7ff5ab7fe640 1 -- 172.21.15.17:0/2148538474 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0cdd10 con 0x7ff5ac15ce90 2023-08-09T12:41:08.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.166+0000 7ff5ab7fe640 1 --2- 172.21.15.17:0/2148538474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac15ce90 0x7ff5ac1616e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0d0a70 tx=0x7ff59c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97fc6cf41af1612 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:08.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.166+0000 7ff5aa7fc640 1 -- 172.21.15.17:0/2148538474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c02ca80 con 0x7ff5ac15ce90 2023-08-09T12:41:08.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.166+0000 7ff5aa7fc640 1 -- 172.21.15.17:0/2148538474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c02cbe0 con 0x7ff5ac15ce90 2023-08-09T12:41:08.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.166+0000 7ff5aa7fc640 1 -- 172.21.15.17:0/2148538474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0343f0 con 0x7ff5ac15ce90 2023-08-09T12:41:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 -- 172.21.15.17:0/2148538474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac15ce90 msgr2=0x7ff5ac1616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/2148538474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac15ce90 0x7ff5ac1616e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0d0a70 tx=0x7ff59c02bee0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 -- 172.21.15.17:0/2148538474 shutdown_connections 2023-08-09T12:41:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/2148538474 >> v2:172.21.15.142:3300/0 conn(0x7ff5ac0d29d0 0x7ff5ac0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/2148538474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac0b6000 0x7ff5ac0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/2148538474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac15ce90 0x7ff5ac1616e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 -- 172.21.15.17:0/2148538474 >> 172.21.15.17:0/2148538474 conn(0x7ff5ac06fde0 msgr2=0x7ff5ac0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 -- 172.21.15.17:0/2148538474 shutdown_connections 2023-08-09T12:41:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.167+0000 7ff5b1aba640 1 -- 172.21.15.17:0/2148538474 wait complete. 2023-08-09T12:41:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.169+0000 7ff5b1aba640 1 Processor -- start 2023-08-09T12:41:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.169+0000 7ff5b1aba640 1 -- start start 2023-08-09T12:41:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5b1aba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac0b6000 0x7ff5ac0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5b1aba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac0d29d0 0x7ff5ac15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5b1aba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac15ce90 0x7ff5ac147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5b1aba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1e8a00 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5b1aba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15d310 con 0x7ff5ac0b6000 2023-08-09T12:41:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5b1aba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15d5b0 con 0x7ff5ac15ce90 2023-08-09T12:41:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5aaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac0d29d0 0x7ff5ac15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5aaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac0d29d0 0x7ff5ac15f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34204/0 (socket says 172.21.15.17:34204) 2023-08-09T12:41:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.170+0000 7ff5aaffd640 1 -- 172.21.15.17:0/1253135049 learned_addr learned my addr 172.21.15.17:0/1253135049 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5abfff640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac15ce90 0x7ff5ac147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5ab7fe640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac0b6000 0x7ff5ac0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5aaffd640 1 -- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac15ce90 msgr2=0x7ff5ac147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5aaffd640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac15ce90 0x7ff5ac147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5aaffd640 1 -- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac0b6000 msgr2=0x7ff5ac0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5aaffd640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac0b6000 0x7ff5ac0ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5aaffd640 1 -- 172.21.15.17:0/1253135049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c009b30 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5aaffd640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac0d29d0 0x7ff5ac15f1e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c7f0 tx=0x7ff5a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff593fff640 1 -- 172.21.15.17:0/1253135049 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0004220 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff593fff640 1 -- 172.21.15.17:0/1253135049 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a00043a0 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac1e8620 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.171+0000 7ff593fff640 1 -- 172.21.15.17:0/1253135049 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0007860 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.172+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac0ca580 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.173+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac067400 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.174+0000 7ff593fff640 1 -- 172.21.15.17:0/1253135049 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff5a0007bd0 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.175+0000 7ff593fff640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff59806a050 0x7ff59806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.175+0000 7ff593fff640 1 -- 172.21.15.17:0/1253135049 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5a0088610 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.175+0000 7ff5ab7fe640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff59806a050 0x7ff59806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.177+0000 7ff5ab7fe640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff59806a050 0x7ff59806c510 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff59c035000 tx=0x7ff59c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:08.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.180+0000 7ff593fff640 1 -- 172.21.15.17:0/1253135049 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff5a0053c60 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.381+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5ac1e8b40 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.384+0000 7ff593fff640 1 -- 172.21.15.17:0/1253135049 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18327 (secure 0 0 0) 0x7ff5ac1e8b40 con 0x7ff5ac0d29d0 2023-08-09T12:41:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:08.388 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:40:55.723309+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:08.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.386+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff59806a050 msgr2=0x7ff59806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.386+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff59806a050 0x7ff59806c510 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff59c035000 tx=0x7ff59c030000 comp rx=0 tx=0).stop 2023-08-09T12:41:08.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.386+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac0d29d0 msgr2=0x7ff5ac15f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.386+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac0d29d0 0x7ff5ac15f1e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c7f0 tx=0x7ff5a000ccb0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.387+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 shutdown_connections 2023-08-09T12:41:08.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.387+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff59806a050 0x7ff59806c510 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.387+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac15ce90 0x7ff5ac147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.387+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5ac0d29d0 0x7ff5ac15f1e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.387+0000 7ff5b1aba640 1 --2- 172.21.15.17:0/1253135049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac0b6000 0x7ff5ac0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.387+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 >> 172.21.15.17:0/1253135049 conn(0x7ff5ac06fde0 msgr2=0x7ff5ac0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:08.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.387+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 shutdown_connections 2023-08-09T12:41:08.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.387+0000 7ff5b1aba640 1 -- 172.21.15.17:0/1253135049 wait complete. 2023-08-09T12:41:08.410 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:41:08.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:08.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.635+0000 7f358921f640 1 Processor -- start 2023-08-09T12:41:08.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.635+0000 7f358921f640 1 -- start start 2023-08-09T12:41:08.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.636+0000 7f358921f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35840b3b40 0x7f35840b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.637+0000 7f358921f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358406c990 con 0x7f35840adc40 2023-08-09T12:41:08.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.637+0000 7f358921f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35840b2250 con 0x7f35840cc630 2023-08-09T12:41:08.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.637+0000 7f358921f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35840ae020 con 0x7f35840b3b40 2023-08-09T12:41:08.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.637+0000 7f3582d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f35840adc40 0x7f358406c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60982/0 (socket says 172.21.15.17:60982) 2023-08-09T12:41:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.637+0000 7f3582d9d640 1 -- 172.21.15.17:0/3524352439 learned_addr learned my addr 172.21.15.17:0/3524352439 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.637+0000 7f357a59c640 1 --2- 172.21.15.17:0/3524352439 >> v2:172.21.15.142:3300/0 conn(0x7f35840b3b40 0x7f35840b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.637+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821108649 0 0) 0x7f358406c990 con 0x7f35840adc40 2023-08-09T12:41:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.637+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3570003520 con 0x7f35840adc40 2023-08-09T12:41:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882989583 0 0) 0x7f3570003520 con 0x7f35840adc40 2023-08-09T12:41:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 >> v2:172.21.15.142:3300/0 conn(0x7f35840b3b40 msgr2=0x7f35840b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 --2- 172.21.15.17:0/3524352439 >> v2:172.21.15.142:3300/0 conn(0x7f35840b3b40 0x7f35840b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 >> v1:172.21.15.142:6789/0 conn(0x7f35840cc630 legacy=0x7f35840ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840b2530 con 0x7f35840adc40 2023-08-09T12:41:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f3574001670 con 0x7f35840adc40 2023-08-09T12:41:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 >> v1:172.21.15.17:6789/0 conn(0x7f35840adc40 legacy=0x7f358406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3570003970 0x7f3570003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35700047c0 0x7f3570004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570005180 0x7f357000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840ae020 con 0x7f35700047c0 2023-08-09T12:41:08.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357000c020 con 0x7f3570005180 2023-08-09T12:41:08.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357000c1e0 con 0x7f3570003970 2023-08-09T12:41:08.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.638+0000 7f357a59c640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35700047c0 0x7f3570004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.639+0000 7f358359e640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570005180 0x7f357000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.639+0000 7f3582d9d640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3570003970 0x7f3570003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.639+0000 7f357a59c640 1 -- 172.21.15.17:0/3524352439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3570003970 msgr2=0x7f3570003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:08.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.639+0000 7f357a59c640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3570003970 0x7f3570003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.639+0000 7f357a59c640 1 -- 172.21.15.17:0/3524352439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570005180 msgr2=0x7f357000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:08.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.639+0000 7f357a59c640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570005180 0x7f357000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.639+0000 7f357a59c640 1 -- 172.21.15.17:0/3524352439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570003520 con 0x7f35700047c0 2023-08-09T12:41:08.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.639+0000 7f358359e640 1 -- 172.21.15.17:0/3524352439 reap_dead start 2023-08-09T12:41:08.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.640+0000 7f357a59c640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35700047c0 0x7f3570004c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f356c00e170 tx=0x7f35700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8805b7e5bec3efe8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:08.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.640+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c02cc60 con 0x7f35700047c0 2023-08-09T12:41:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.640+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c00f040 con 0x7f35700047c0 2023-08-09T12:41:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.640+0000 7f358259c640 1 -- 172.21.15.17:0/3524352439 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c034440 con 0x7f35700047c0 2023-08-09T12:41:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.641+0000 7f358921f640 1 -- 172.21.15.17:0/3524352439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35700047c0 msgr2=0x7f3570004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.641+0000 7f358921f640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35700047c0 0x7f3570004c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f356c00e170 tx=0x7f35700057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.641+0000 7f358921f640 1 -- 172.21.15.17:0/3524352439 shutdown_connections 2023-08-09T12:41:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.641+0000 7f358921f640 1 --2- 172.21.15.17:0/3524352439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35700047c0 0x7f3570004c40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.641+0000 7f358921f640 1 -- 172.21.15.17:0/3524352439 >> 172.21.15.17:0/3524352439 conn(0x7f35840cb1b0 msgr2=0x7f35840cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:08.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.641+0000 7f358921f640 1 -- 172.21.15.17:0/3524352439 shutdown_connections 2023-08-09T12:41:08.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.641+0000 7f358921f640 1 -- 172.21.15.17:0/3524352439 wait complete. 2023-08-09T12:41:08.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.643+0000 7f358921f640 1 Processor -- start 2023-08-09T12:41:08.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.643+0000 7f358921f640 1 -- start start 2023-08-09T12:41:08.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.644+0000 7f358921f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35700047c0 0x7f358415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.644+0000 7f358921f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35840c9670 0x7f35840c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.644+0000 7f358921f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840c43a0 0x7f35840c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.644+0000 7f358921f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840ca1e0 con 0x7f35840c43a0 2023-08-09T12:41:08.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.644+0000 7f358921f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840c4d60 con 0x7f35840c9670 2023-08-09T12:41:08.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.644+0000 7f358921f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840c66d0 con 0x7f35700047c0 2023-08-09T12:41:08.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840c43a0 0x7f35840c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840c43a0 0x7f35840c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34224/0 (socket says 172.21.15.17:34224) 2023-08-09T12:41:08.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 -- 172.21.15.17:0/3577308878 learned_addr learned my addr 172.21.15.17:0/3577308878 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:08.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f357a59c640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35840c9670 0x7f35840c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f3582d9d640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35700047c0 0x7f358415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 -- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35700047c0 msgr2=0x7f358415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35700047c0 0x7f358415cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 -- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35840c9670 msgr2=0x7f35840c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35840c9670 0x7f35840c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 -- 172.21.15.17:0/3577308878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35841f6700 con 0x7f35840c43a0 2023-08-09T12:41:08.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f3582d9d640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35700047c0 0x7f358415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:08.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.645+0000 7f358359e640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840c43a0 0x7f35840c4820 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f35840cf780 tx=0x7f357c00e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:08.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.646+0000 7f357bfff640 1 -- 172.21.15.17:0/3577308878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c005110 con 0x7f35840c43a0 2023-08-09T12:41:08.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.646+0000 7f357bfff640 1 -- 172.21.15.17:0/3577308878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c005290 con 0x7f35840c43a0 2023-08-09T12:41:08.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.646+0000 7f357bfff640 1 -- 172.21.15.17:0/3577308878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c007030 con 0x7f35840c43a0 2023-08-09T12:41:08.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.646+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35840c5910 con 0x7f35840c43a0 2023-08-09T12:41:08.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.646+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35840c5ed0 con 0x7f35840c43a0 2023-08-09T12:41:08.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.647+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3584067a80 con 0x7f35840c43a0 2023-08-09T12:41:08.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.648+0000 7f357bfff640 1 -- 172.21.15.17:0/3577308878 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f357c0071b0 con 0x7f35840c43a0 2023-08-09T12:41:08.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.649+0000 7f357bfff640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f356406a080 0x7f356406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:08.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.649+0000 7f357bfff640 1 -- 172.21.15.17:0/3577308878 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f357c0877b0 con 0x7f35840c43a0 2023-08-09T12:41:08.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.650+0000 7f3582d9d640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f356406a080 0x7f356406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:08.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.651+0000 7f3582d9d640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f356406a080 0x7f356406c540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3574001050 tx=0x7f3574001d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:08.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.653+0000 7f357bfff640 1 -- 172.21.15.17:0/3577308878 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f357c052e00 con 0x7f35840c43a0 2023-08-09T12:41:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.884+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3584070130 con 0x7f35840c43a0 2023-08-09T12:41:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.885+0000 7f357bfff640 1 -- 172.21.15.17:0/3577308878 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f357c056420 con 0x7f35840c43a0 2023-08-09T12:41:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:08.889 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:40:41.199722+0000","modified":"2023-08-09T12:40:44.738017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2993081476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2993081476},{"type":"v1","addr":"172.21.15.17:6835","nonce":2993081476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T12:41:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-08-09T12:41:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f356406a080 msgr2=0x7f356406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f356406a080 0x7f356406c540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3574001050 tx=0x7f3574001d40 comp rx=0 tx=0).stop 2023-08-09T12:41:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840c43a0 msgr2=0x7f35840c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840c43a0 0x7f35840c4820 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f35840cf780 tx=0x7f357c00e5f0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 shutdown_connections 2023-08-09T12:41:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f356406a080 0x7f356406c540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840c43a0 0x7f35840c4820 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35840c9670 0x7f35840c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 --2- 172.21.15.17:0/3577308878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35700047c0 0x7f358415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:08.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 >> 172.21.15.17:0/3577308878 conn(0x7f35840cb1b0 msgr2=0x7f358406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:08.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 shutdown_connections 2023-08-09T12:41:08.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:08.888+0000 7f358921f640 1 -- 172.21.15.17:0/3577308878 wait complete. 2023-08-09T12:41:08.913 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.136+0000 7fe861a60640 1 Processor -- start 2023-08-09T12:41:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.136+0000 7fe861a60640 1 -- start start 2023-08-09T12:41:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe861a60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c161280 0x7fe85c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe861a60640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe85c161660 0x7fe85c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe861a60640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe85c0ca450 0x7fe85c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe861a60640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c15d430 con 0x7fe85c0ca450 2023-08-09T12:41:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe861a60640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c15df30 con 0x7fe85c161660 2023-08-09T12:41:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe861a60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0ca9d0 con 0x7fe85c161280 2023-08-09T12:41:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe85b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe85c0ca450 0x7fe85c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe85b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe85c0ca450 0x7fe85c0acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34234/0 (socket says 172.21.15.17:34234) 2023-08-09T12:41:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.138+0000 7fe85b7fe640 1 -- 172.21.15.17:0/2715559539 learned_addr learned my addr 172.21.15.17:0/2715559539 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:09.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.139+0000 7fe85affd640 1 --2- 172.21.15.17:0/2715559539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c161280 0x7fe85c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.139+0000 7fe85a7fc640 1 --2- 172.21.15.17:0/2715559539 >> v2:172.21.15.142:3300/0 conn(0x7fe85c161660 0x7fe85c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.139+0000 7fe85b7fe640 1 -- 172.21.15.17:0/2715559539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c161280 msgr2=0x7fe85c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:09.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.139+0000 7fe85b7fe640 1 --2- 172.21.15.17:0/2715559539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c161280 0x7fe85c0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.139+0000 7fe85b7fe640 1 -- 172.21.15.17:0/2715559539 >> v2:172.21.15.142:3300/0 conn(0x7fe85c161660 msgr2=0x7fe85c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.139+0000 7fe85b7fe640 1 --2- 172.21.15.17:0/2715559539 >> v2:172.21.15.142:3300/0 conn(0x7fe85c161660 0x7fe85c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.139+0000 7fe85b7fe640 1 -- 172.21.15.17:0/2715559539 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c15e3c0 con 0x7fe85c0ca450 2023-08-09T12:41:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.140+0000 7fe85b7fe640 1 --2- 172.21.15.17:0/2715559539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c0ca450 0x7fe85c0acdf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe85c06cdb0 tx=0x7fe85402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a8841c76543db2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.140+0000 7fe859ffb640 1 -- 172.21.15.17:0/2715559539 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8540317d0 con 0x7fe85c0ca450 2023-08-09T12:41:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.140+0000 7fe859ffb640 1 -- 172.21.15.17:0/2715559539 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854031930 con 0x7fe85c0ca450 2023-08-09T12:41:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.140+0000 7fe859ffb640 1 -- 172.21.15.17:0/2715559539 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854031cc0 con 0x7fe85c0ca450 2023-08-09T12:41:09.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 -- 172.21.15.17:0/2715559539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c0ca450 msgr2=0x7fe85c0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 --2- 172.21.15.17:0/2715559539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c0ca450 0x7fe85c0acdf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe85c06cdb0 tx=0x7fe85402b870 comp rx=0 tx=0).stop 2023-08-09T12:41:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 -- 172.21.15.17:0/2715559539 shutdown_connections 2023-08-09T12:41:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 --2- 172.21.15.17:0/2715559539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c0ca450 0x7fe85c0acdf0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 --2- 172.21.15.17:0/2715559539 >> v2:172.21.15.142:3300/0 conn(0x7fe85c161660 0x7fe85c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 --2- 172.21.15.17:0/2715559539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c161280 0x7fe85c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 -- 172.21.15.17:0/2715559539 >> 172.21.15.17:0/2715559539 conn(0x7fe85c0cb1b0 msgr2=0x7fe85c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 -- 172.21.15.17:0/2715559539 shutdown_connections 2023-08-09T12:41:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.141+0000 7fe861a60640 1 -- 172.21.15.17:0/2715559539 wait complete. 2023-08-09T12:41:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.143+0000 7fe861a60640 1 Processor -- start 2023-08-09T12:41:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.143+0000 7fe861a60640 1 -- start start 2023-08-09T12:41:09.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe861a60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c0ca450 0x7fe85c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe861a60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85c161280 0x7fe85c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe861a60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c161660 0x7fe85c1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe861a60640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c1574a0 con 0x7fe85c161660 2023-08-09T12:41:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe861a60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c1f2480 con 0x7fe85c161280 2023-08-09T12:41:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe861a60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c1f6050 con 0x7fe85c0ca450 2023-08-09T12:41:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe85b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c161660 0x7fe85c1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe85b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c161660 0x7fe85c1454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34238/0 (socket says 172.21.15.17:34238) 2023-08-09T12:41:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.144+0000 7fe85b7fe640 1 -- 172.21.15.17:0/1352453511 learned_addr learned my addr 172.21.15.17:0/1352453511 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.145+0000 7fe85affd640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c0ca450 0x7fe85c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.145+0000 7fe85b7fe640 1 -- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c0ca450 msgr2=0x7fe85c0cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.145+0000 7fe85b7fe640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c0ca450 0x7fe85c0cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.145+0000 7fe85b7fe640 1 -- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85c161280 msgr2=0x7fe85c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.145+0000 7fe85b7fe640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85c161280 0x7fe85c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.145+0000 7fe85b7fe640 1 -- 172.21.15.17:0/1352453511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8540094d0 con 0x7fe85c161660 2023-08-09T12:41:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.145+0000 7fe85b7fe640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c161660 0x7fe85c1454c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe8540090b0 tx=0x7fe8540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.145+0000 7fe843fff640 1 -- 172.21.15.17:0/1352453511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854032870 con 0x7fe85c161660 2023-08-09T12:41:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.146+0000 7fe843fff640 1 -- 172.21.15.17:0/1352453511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854032a10 con 0x7fe85c161660 2023-08-09T12:41:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.146+0000 7fe843fff640 1 -- 172.21.15.17:0/1352453511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854032dc0 con 0x7fe85c161660 2023-08-09T12:41:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.146+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85c1f6330 con 0x7fe85c161660 2023-08-09T12:41:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.146+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c1f68f0 con 0x7fe85c161660 2023-08-09T12:41:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.147+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c067a80 con 0x7fe85c161660 2023-08-09T12:41:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.148+0000 7fe843fff640 1 -- 172.21.15.17:0/1352453511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe854030070 con 0x7fe85c161660 2023-08-09T12:41:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.149+0000 7fe843fff640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe84806a080 0x7fe84806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.149+0000 7fe843fff640 1 -- 172.21.15.17:0/1352453511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8540aa4e0 con 0x7fe85c161660 2023-08-09T12:41:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.149+0000 7fe85affd640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe84806a080 0x7fe84806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.150+0000 7fe85affd640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe84806a080 0x7fe84806c540 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe84c006fd0 tx=0x7fe84c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:09.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.154+0000 7fe843fff640 1 -- 172.21.15.17:0/1352453511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe854075b30 con 0x7fe85c161660 2023-08-09T12:41:09.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:41:09.333 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:41:09.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.385+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe85c160b50 con 0x7fe85c161660 2023-08-09T12:41:09.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.385+0000 7fe843fff640 1 -- 172.21.15.17:0/1352453511 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4875 (secure 0 0 0) 0x7fe854079150 con 0x7fe85c161660 2023-08-09T12:41:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:09.390 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:40:41.199722+0000","modified":"2023-08-09T12:40:44.738017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2993081476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2993081476},{"type":"v1","addr":"172.21.15.17:6835","nonce":2993081476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-09T12:41:09.390 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-08-09T12:41:09.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe84806a080 msgr2=0x7fe84806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe84806a080 0x7fe84806c540 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe84c006fd0 tx=0x7fe84c008040 comp rx=0 tx=0).stop 2023-08-09T12:41:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c161660 msgr2=0x7fe85c1454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c161660 0x7fe85c1454c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe8540090b0 tx=0x7fe8540046c0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 shutdown_connections 2023-08-09T12:41:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe84806a080 0x7fe84806c540 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe85c161660 0x7fe85c1454c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85c161280 0x7fe85c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 --2- 172.21.15.17:0/1352453511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe85c0ca450 0x7fe85c0cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 >> 172.21.15.17:0/1352453511 conn(0x7fe85c0cb1b0 msgr2=0x7fe85c06a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 shutdown_connections 2023-08-09T12:41:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.388+0000 7fe861a60640 1 -- 172.21.15.17:0/1352453511 wait complete. 2023-08-09T12:41:09.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.640+0000 7f6299502640 1 Processor -- start 2023-08-09T12:41:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.640+0000 7f6299502640 1 -- start start 2023-08-09T12:41:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.641+0000 7f6299502640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6294160030 0x7f6294160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.642+0000 7f6299502640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62940b5a30 con 0x7f62940b86e0 2023-08-09T12:41:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.642+0000 7f6299502640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62940d0d70 con 0x7f62940cfb50 2023-08-09T12:41:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.642+0000 7f6299502640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62940d1110 con 0x7f6294160030 2023-08-09T12:41:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.642+0000 7f6293fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6294160030 0x7f6294160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.642+0000 7f6293fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6294160030 0x7f6294160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34242/0 (socket says 172.21.15.17:34242) 2023-08-09T12:41:09.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.642+0000 7f6293fff640 1 -- 172.21.15.17:0/870309041 learned_addr learned my addr 172.21.15.17:0/870309041 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:09.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.642+0000 7f62937fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f62940b86e0 0x7f62940cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60992/0 (socket says 172.21.15.17:60992) 2023-08-09T12:41:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.642+0000 7f6293fff640 1 -- 172.21.15.17:0/870309041 >> v1:172.21.15.142:6789/0 conn(0x7f62940cfb50 legacy=0x7f62940d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.643+0000 7f6293fff640 1 -- 172.21.15.17:0/870309041 >> v1:172.21.15.17:6789/0 conn(0x7f62940b86e0 legacy=0x7f62940cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.643+0000 7f6293fff640 1 -- 172.21.15.17:0/870309041 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294160f70 con 0x7f6294160030 2023-08-09T12:41:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.644+0000 7f6293fff640 1 --2- 172.21.15.17:0/870309041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6294160030 0x7f6294160740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6284009e50 tx=0x7f628402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d38bd09fb252fb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.644+0000 7f6292ffd640 1 -- 172.21.15.17:0/870309041 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628402cb10 con 0x7f6294160030 2023-08-09T12:41:09.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.644+0000 7f6292ffd640 1 -- 172.21.15.17:0/870309041 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628402cc70 con 0x7f6294160030 2023-08-09T12:41:09.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.644+0000 7f6292ffd640 1 -- 172.21.15.17:0/870309041 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62840343f0 con 0x7f6294160030 2023-08-09T12:41:09.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.645+0000 7f6299502640 1 -- 172.21.15.17:0/870309041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6294160030 msgr2=0x7f6294160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.645+0000 7f6299502640 1 --2- 172.21.15.17:0/870309041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6294160030 0x7f6294160740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6284009e50 tx=0x7f628402bf70 comp rx=0 tx=0).stop 2023-08-09T12:41:09.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.645+0000 7f6299502640 1 -- 172.21.15.17:0/870309041 shutdown_connections 2023-08-09T12:41:09.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.645+0000 7f6299502640 1 --2- 172.21.15.17:0/870309041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6294160030 0x7f6294160740 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.645+0000 7f6299502640 1 -- 172.21.15.17:0/870309041 >> 172.21.15.17:0/870309041 conn(0x7f62940697c0 msgr2=0x7f6294069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:09.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.645+0000 7f6299502640 1 -- 172.21.15.17:0/870309041 shutdown_connections 2023-08-09T12:41:09.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.645+0000 7f6299502640 1 -- 172.21.15.17:0/870309041 wait complete. 2023-08-09T12:41:09.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.647+0000 7f6299502640 1 Processor -- start 2023-08-09T12:41:09.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.647+0000 7f6299502640 1 -- start start 2023-08-09T12:41:09.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f6299502640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62940b86e0 0x7f62940c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f6299502640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62940cfb50 0x7f629414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f6299502640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6294160030 0x7f629414afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f6299502640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940ccc20 con 0x7f62940cfb50 2023-08-09T12:41:09.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f6299502640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940cc010 con 0x7f62940b86e0 2023-08-09T12:41:09.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f6299502640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62940cc2f0 con 0x7f6294160030 2023-08-09T12:41:09.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f62937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62940cfb50 0x7f629414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f62937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62940cfb50 0x7f629414aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34246/0 (socket says 172.21.15.17:34246) 2023-08-09T12:41:09.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f62937fe640 1 -- 172.21.15.17:0/3734546337 learned_addr learned my addr 172.21.15.17:0/3734546337 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:09.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f6293fff640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62940b86e0 0x7f62940c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f62937fe640 1 -- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6294160030 msgr2=0x7f629414afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f62937fe640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6294160030 0x7f629414afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f62937fe640 1 -- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62940b86e0 msgr2=0x7f62940c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f62937fe640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62940b86e0 0x7f62940c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.648+0000 7f62937fe640 1 -- 172.21.15.17:0/3734546337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284009b30 con 0x7f62940cfb50 2023-08-09T12:41:09.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.649+0000 7f62937fe640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62940cfb50 0x7f629414aa80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f627c00c3c0 tx=0x7f627c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:09.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.649+0000 7f6290ff9640 1 -- 172.21.15.17:0/3734546337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c0074e0 con 0x7f62940cfb50 2023-08-09T12:41:09.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.649+0000 7f6290ff9640 1 -- 172.21.15.17:0/3734546337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c007660 con 0x7f62940cfb50 2023-08-09T12:41:09.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.649+0000 7f6290ff9640 1 -- 172.21.15.17:0/3734546337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c004a20 con 0x7f62940cfb50 2023-08-09T12:41:09.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.649+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62940cc5d0 con 0x7f62940cfb50 2023-08-09T12:41:09.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.649+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62940cbba0 con 0x7f62940cfb50 2023-08-09T12:41:09.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.650+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629404e390 con 0x7f62940cfb50 2023-08-09T12:41:09.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.651+0000 7f6290ff9640 1 -- 172.21.15.17:0/3734546337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f627c004b80 con 0x7f62940cfb50 2023-08-09T12:41:09.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.652+0000 7f6290ff9640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f627406a050 0x7f627406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:09.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.652+0000 7f6290ff9640 1 -- 172.21.15.17:0/3734546337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f627c087f90 con 0x7f62940cfb50 2023-08-09T12:41:09.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.653+0000 7f6293fff640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f627406a050 0x7f627406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:09.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.654+0000 7f6293fff640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f627406a050 0x7f627406c510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6284035000 tx=0x7f6284030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.656+0000 7f6290ff9640 1 -- 172.21.15.17:0/3734546337 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f627c0ba7b0 con 0x7f62940cfb50 2023-08-09T12:41:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.858+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62940ccd60 con 0x7f62940cfb50 2023-08-09T12:41:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.860+0000 7f6290ff9640 1 -- 172.21.15.17:0/3734546337 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f62940ccd60 con 0x7f62940cfb50 2023-08-09T12:41:09.864 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:09.864 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:41:09.739141+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:40:39.173972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-09T12:40:40.213212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f627406a050 msgr2=0x7f627406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f627406a050 0x7f627406c510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6284035000 tx=0x7f6284030000 comp rx=0 tx=0).stop 2023-08-09T12:41:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62940cfb50 msgr2=0x7f629414aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62940cfb50 0x7f629414aa80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f627c00c3c0 tx=0x7f627c00c880 comp rx=0 tx=0).stop 2023-08-09T12:41:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 shutdown_connections 2023-08-09T12:41:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f627406a050 0x7f627406c510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6294160030 0x7f629414afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62940cfb50 0x7f629414aa80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 --2- 172.21.15.17:0/3734546337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62940b86e0 0x7f62940c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 >> 172.21.15.17:0/3734546337 conn(0x7f62940697c0 msgr2=0x7f6294160410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 shutdown_connections 2023-08-09T12:41:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:09.863+0000 7f6299502640 1 -- 172.21.15.17:0/3734546337 wait complete. 2023-08-09T12:41:09.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:41:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.104+0000 7f4ba0634640 1 Processor -- start 2023-08-09T12:41:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.104+0000 7f4ba0634640 1 -- start start 2023-08-09T12:41:10.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.106+0000 7f4ba0634640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b980acfc0 0x7f4b98167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.106+0000 7f4ba0634640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9815df30 con 0x7f4b98161660 2023-08-09T12:41:10.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.106+0000 7f4ba0634640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980ca9d0 con 0x7f4b98161280 2023-08-09T12:41:10.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.106+0000 7f4ba0634640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9815d430 con 0x7f4b980acfc0 2023-08-09T12:41:10.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.106+0000 7f4b9dbcf640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4b98161660 0x7f4b980ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60996/0 (socket says 172.21.15.17:60996) 2023-08-09T12:41:10.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.106+0000 7f4b9dbcf640 1 -- 172.21.15.17:0/4219462405 learned_addr learned my addr 172.21.15.17:0/4219462405 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9ebd1640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b980acfc0 0x7f4b98167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991633897 0 0) 0x7f4b9815df30 con 0x7f4b98161660 2023-08-09T12:41:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84003520 con 0x7f4b98161660 2023-08-09T12:41:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1137046014 0 0) 0x7f4b84003520 con 0x7f4b98161660 2023-08-09T12:41:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b980acfc0 msgr2=0x7f4b98167db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:10.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b980acfc0 0x7f4b98167db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 >> v1:172.21.15.142:6789/0 conn(0x7f4b98161280 legacy=0x7f4b980c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9815e3c0 con 0x7f4b98161660 2023-08-09T12:41:10.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f4b880017f0 con 0x7f4b98161660 2023-08-09T12:41:10.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 >> v1:172.21.15.17:6789/0 conn(0x7f4b98161660 legacy=0x7f4b980ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.107+0000 7f4b9d3ce640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b980acfc0 0x7f4b840039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9d3ce640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b84003f20 0x7f4b840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9d3ce640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b84004d00 0x7f4b84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400bb10 con 0x7f4b84004d00 2023-08-09T12:41:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400bc50 con 0x7f4b84003f20 2023-08-09T12:41:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400be10 con 0x7f4b980acfc0 2023-08-09T12:41:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9ebd1640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b84004d00 0x7f4b84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9e3d0640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b980acfc0 0x7f4b840039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9dbcf640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b84003f20 0x7f4b840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9ebd1640 1 -- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b980acfc0 msgr2=0x7f4b840039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9ebd1640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b980acfc0 0x7f4b840039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9ebd1640 1 -- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b84003f20 msgr2=0x7f4b840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9ebd1640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b84003f20 0x7f4b840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.108+0000 7f4b9ebd1640 1 -- 172.21.15.17:0/4219462405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84003520 con 0x7f4b84004d00 2023-08-09T12:41:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4b9ebd1640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b84004d00 0x7f4b84005180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009fc0 tx=0x7f4b840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb0fd1d3ab2b8f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9002cc20 con 0x7f4b84004d00 2023-08-09T12:41:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9000f040 con 0x7f4b84004d00 2023-08-09T12:41:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4b9d3ce640 1 -- 172.21.15.17:0/4219462405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90034440 con 0x7f4b84004d00 2023-08-09T12:41:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4ba0634640 1 -- 172.21.15.17:0/4219462405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b84004d00 msgr2=0x7f4b84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4ba0634640 1 --2- 172.21.15.17:0/4219462405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b84004d00 0x7f4b84005180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009fc0 tx=0x7f4b840057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4b9ebd1640 1 -- 172.21.15.17:0/4219462405 reap_dead start 2023-08-09T12:41:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4ba0634640 1 -- 172.21.15.17:0/4219462405 shutdown_connections 2023-08-09T12:41:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.110+0000 7f4ba0634640 1 -- 172.21.15.17:0/4219462405 >> 172.21.15.17:0/4219462405 conn(0x7f4b980cb1b0 msgr2=0x7f4b980cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.111+0000 7f4ba0634640 1 -- 172.21.15.17:0/4219462405 shutdown_connections 2023-08-09T12:41:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.111+0000 7f4ba0634640 1 -- 172.21.15.17:0/4219462405 wait complete. 2023-08-09T12:41:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.112+0000 7f4ba0634640 1 Processor -- start 2023-08-09T12:41:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.113+0000 7f4ba0634640 1 -- start start 2023-08-09T12:41:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.113+0000 7f4ba0634640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b84004d00 0x7f4b980aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4ba0634640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b98150c80 0x7f4b980c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4ba0634640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b98155580 0x7f4b98155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4ba0634640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98155f40 con 0x7f4b98150c80 2023-08-09T12:41:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4ba0634640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980af010 con 0x7f4b98155580 2023-08-09T12:41:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4ba0634640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980c4a80 con 0x7f4b84004d00 2023-08-09T12:41:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9dbcf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b98150c80 0x7f4b980c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9dbcf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b98150c80 0x7f4b980c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34274/0 (socket says 172.21.15.17:34274) 2023-08-09T12:41:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9dbcf640 1 -- 172.21.15.17:0/4145007712 learned_addr learned my addr 172.21.15.17:0/4145007712 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9e3d0640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b84004d00 0x7f4b980aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9ebd1640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b98155580 0x7f4b98155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9dbcf640 1 -- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b84004d00 msgr2=0x7f4b980aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9dbcf640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b84004d00 0x7f4b980aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9dbcf640 1 -- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b98155580 msgr2=0x7f4b98155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9dbcf640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b98155580 0x7f4b98155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9dbcf640 1 -- 172.21.15.17:0/4145007712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980c4d60 con 0x7f4b98150c80 2023-08-09T12:41:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.114+0000 7f4b9ebd1640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b98155580 0x7f4b98155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.115+0000 7f4b9dbcf640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b98150c80 0x7f4b980c3f20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800e780 tx=0x7f4b8800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.115+0000 7f4b8effd640 1 -- 172.21.15.17:0/4145007712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800ee90 con 0x7f4b98150c80 2023-08-09T12:41:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.115+0000 7f4b8effd640 1 -- 172.21.15.17:0/4145007712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880072e0 con 0x7f4b98150c80 2023-08-09T12:41:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.115+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b980c1f20 con 0x7f4b98150c80 2023-08-09T12:41:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.115+0000 7f4b8effd640 1 -- 172.21.15.17:0/4145007712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880057a0 con 0x7f4b98150c80 2023-08-09T12:41:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.115+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b98156a60 con 0x7f4b98150c80 2023-08-09T12:41:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.116+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b980c4fa0 con 0x7f4b98150c80 2023-08-09T12:41:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.117+0000 7f4b8effd640 1 -- 172.21.15.17:0/4145007712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b88005900 con 0x7f4b98150c80 2023-08-09T12:41:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.118+0000 7f4b8effd640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b7c06a080 0x7f4b7c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.118+0000 7f4b8effd640 1 -- 172.21.15.17:0/4145007712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f4b88088720 con 0x7f4b98150c80 2023-08-09T12:41:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.119+0000 7f4b9e3d0640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b7c06a080 0x7f4b7c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.120+0000 7f4b9e3d0640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b7c06a080 0x7f4b7c06c540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4b94007fd0 tx=0x7f4b94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:10.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.123+0000 7f4b8effd640 1 -- 172.21.15.17:0/4145007712 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4b980c4fa0 con 0x7f4b98150c80 2023-08-09T12:41:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.351+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b980c2160 con 0x7f4b98150c80 2023-08-09T12:41:10.356 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:41:10.353+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:41:10.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.361+0000 7f4b8effd640 1 -- 172.21.15.17:0/4145007712 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b980c2160 con 0x7f4b98150c80 2023-08-09T12:41:10.364 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:41:10.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b7c06a080 msgr2=0x7f4b7c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b7c06a080 0x7f4b7c06c540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4b94007fd0 tx=0x7f4b94009040 comp rx=0 tx=0).stop 2023-08-09T12:41:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b98150c80 msgr2=0x7f4b980c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b98150c80 0x7f4b980c3f20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800e780 tx=0x7f4b8800ec40 comp rx=0 tx=0).stop 2023-08-09T12:41:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 shutdown_connections 2023-08-09T12:41:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b7c06a080 0x7f4b7c06c540 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b98155580 0x7f4b98155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b98150c80 0x7f4b980c3f20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 --2- 172.21.15.17:0/4145007712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b84004d00 0x7f4b980aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.364+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 >> 172.21.15.17:0/4145007712 conn(0x7f4b980cb1b0 msgr2=0x7f4b980cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.365+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 shutdown_connections 2023-08-09T12:41:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.365+0000 7f4ba0634640 1 -- 172.21.15.17:0/4145007712 wait complete. 2023-08-09T12:41:10.377 INFO:tasks.ceph.mds.c.smithi017.stderr: -5012> 2023-08-09T12:40:44.041+0000 7f7730dd0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:41:10.395 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:41:10.440 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:41:10.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.596+0000 7fd8eee2c640 1 Processor -- start 2023-08-09T12:41:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.597+0000 7fd8eee2c640 1 -- start start 2023-08-09T12:41:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.598+0000 7fd8eee2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e8161000 0x7fd8e80b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.598+0000 7fd8eee2c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8e80b41c0 0x7fd8e80b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.598+0000 7fd8eee2c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e80cc170 con 0x7fd8e80c14c0 2023-08-09T12:41:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.598+0000 7fd8eee2c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e80cc450 con 0x7fd8e80b41c0 2023-08-09T12:41:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.598+0000 7fd8eee2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80cc730 con 0x7fd8e8161000 2023-08-09T12:41:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ed629640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8e80b41c0 0x7fd8e80b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ee62b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd8e80c14c0 0x7fd8e80697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32782/0 (socket says 172.21.15.17:32782) 2023-08-09T12:41:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ee62b640 1 -- 172.21.15.17:0/3039766889 learned_addr learned my addr 172.21.15.17:0/3039766889 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ede2a640 1 --2- 172.21.15.17:0/3039766889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e8161000 0x7fd8e80b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ece28640 1 -- 172.21.15.17:0/3039766889 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753213137 0 0) 0x7fd8e80cc170 con 0x7fd8e80c14c0 2023-08-09T12:41:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ece28640 1 -- 172.21.15.17:0/3039766889 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d4003520 con 0x7fd8e80c14c0 2023-08-09T12:41:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ed629640 1 -- 172.21.15.17:0/3039766889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e8161000 msgr2=0x7fd8e80b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ed629640 1 --2- 172.21.15.17:0/3039766889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e8161000 0x7fd8e80b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ed629640 1 -- 172.21.15.17:0/3039766889 >> v1:172.21.15.17:6789/0 conn(0x7fd8e80c14c0 legacy=0x7fd8e80697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.599+0000 7fd8ed629640 1 -- 172.21.15.17:0/3039766889 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80cca10 con 0x7fd8e80b41c0 2023-08-09T12:41:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.600+0000 7fd8ed629640 1 --2- 172.21.15.17:0/3039766889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e80b41c0 0x7fd8e80b0560 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80097a0 tx=0x7fd8d802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a106462ac1c6c7a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8ece28640 1 -- 172.21.15.17:0/3039766889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8031780 con 0x7fd8e80b41c0 2023-08-09T12:41:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8ece28640 1 -- 172.21.15.17:0/3039766889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d80318e0 con 0x7fd8e80b41c0 2023-08-09T12:41:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8ece28640 1 -- 172.21.15.17:0/3039766889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8031c50 con 0x7fd8e80b41c0 2023-08-09T12:41:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8eee2c640 1 -- 172.21.15.17:0/3039766889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e80b41c0 msgr2=0x7fd8e80b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/3039766889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e80b41c0 0x7fd8e80b0560 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80097a0 tx=0x7fd8d802b820 comp rx=0 tx=0).stop 2023-08-09T12:41:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8eee2c640 1 -- 172.21.15.17:0/3039766889 shutdown_connections 2023-08-09T12:41:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/3039766889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e80b41c0 0x7fd8e80b0560 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/3039766889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e8161000 0x7fd8e80b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.601+0000 7fd8eee2c640 1 -- 172.21.15.17:0/3039766889 >> 172.21.15.17:0/3039766889 conn(0x7fd8e80cb020 msgr2=0x7fd8e80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.602+0000 7fd8eee2c640 1 -- 172.21.15.17:0/3039766889 shutdown_connections 2023-08-09T12:41:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.602+0000 7fd8eee2c640 1 -- 172.21.15.17:0/3039766889 wait complete. 2023-08-09T12:41:10.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.603+0000 7fd8eee2c640 1 Processor -- start 2023-08-09T12:41:10.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.603+0000 7fd8eee2c640 1 -- start start 2023-08-09T12:41:10.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.604+0000 7fd8eee2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e80b41c0 0x7fd8e80c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.604+0000 7fd8eee2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e80c14c0 0x7fd8e80c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.604+0000 7fd8eee2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e8161000 0x7fd8e8159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8eee2c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8161580 con 0x7fd8e8161000 2023-08-09T12:41:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8eee2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80c25c0 con 0x7fd8e80c14c0 2023-08-09T12:41:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8eee2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80c2820 con 0x7fd8e80b41c0 2023-08-09T12:41:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e8161000 0x7fd8e8159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e8161000 0x7fd8e8159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34310/0 (socket says 172.21.15.17:34310) 2023-08-09T12:41:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 -- 172.21.15.17:0/57996828 learned_addr learned my addr 172.21.15.17:0/57996828 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ede2a640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e80b41c0 0x7fd8e80c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 -- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e80b41c0 msgr2=0x7fd8e80c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e80b41c0 0x7fd8e80c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 -- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e80c14c0 msgr2=0x7fd8e80c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ed629640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e80c14c0 0x7fd8e80c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e80c14c0 0x7fd8e80c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 -- 172.21.15.17:0/57996828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8009400 con 0x7fd8e8161000 2023-08-09T12:41:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.605+0000 7fd8ee62b640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e8161000 0x7fd8e8159d10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000cb40 tx=0x7fd8e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.606+0000 7fd8de7fc640 1 -- 172.21.15.17:0/57996828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e000aca0 con 0x7fd8e8161000 2023-08-09T12:41:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.606+0000 7fd8de7fc640 1 -- 172.21.15.17:0/57996828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e000ae00 con 0x7fd8e8161000 2023-08-09T12:41:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.606+0000 7fd8de7fc640 1 -- 172.21.15.17:0/57996828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0012620 con 0x7fd8e8161000 2023-08-09T12:41:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.606+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e80c2b00 con 0x7fd8e8161000 2023-08-09T12:41:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.606+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e80c30c0 con 0x7fd8e8161000 2023-08-09T12:41:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.607+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e81616c0 con 0x7fd8e8161000 2023-08-09T12:41:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.608+0000 7fd8de7fc640 1 -- 172.21.15.17:0/57996828 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd8e0007070 con 0x7fd8e8161000 2023-08-09T12:41:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.609+0000 7fd8de7fc640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8cc06a050 0x7fd8cc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.609+0000 7fd8de7fc640 1 -- 172.21.15.17:0/57996828 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd8e0088680 con 0x7fd8e8161000 2023-08-09T12:41:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.609+0000 7fd8ede2a640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8cc06a050 0x7fd8cc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.611+0000 7fd8ede2a640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8cc06a050 0x7fd8cc06c510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4006fd0 tx=0x7fd8e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:10.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.613+0000 7fd8de7fc640 1 -- 172.21.15.17:0/57996828 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd8e81616c0 con 0x7fd8e8161000 2023-08-09T12:41:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:10.842+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd8e81616c0 con 0x7fd8e8161000 2023-08-09T12:41:11.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.364+0000 7fd8de7fc640 1 -- 172.21.15.17:0/57996828 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd8e81616c0 con 0x7fd8e8161000 2023-08-09T12:41:11.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.367+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8cc06a050 msgr2=0x7fd8cc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:11.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.367+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8cc06a050 0x7fd8cc06c510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4006fd0 tx=0x7fd8e4008040 comp rx=0 tx=0).stop 2023-08-09T12:41:11.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.367+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e8161000 msgr2=0x7fd8e8159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:11.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.367+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e8161000 0x7fd8e8159d10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000cb40 tx=0x7fd8e000a060 comp rx=0 tx=0).stop 2023-08-09T12:41:11.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.368+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 shutdown_connections 2023-08-09T12:41:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.368+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8cc06a050 0x7fd8cc06c510 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.368+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e8161000 0x7fd8e8159d10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.368+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e80c14c0 0x7fd8e80c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.368+0000 7fd8eee2c640 1 --2- 172.21.15.17:0/57996828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e80b41c0 0x7fd8e80c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.368+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 >> 172.21.15.17:0/57996828 conn(0x7fd8e80cb020 msgr2=0x7fd8e815e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.368+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 shutdown_connections 2023-08-09T12:41:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.368+0000 7fd8eee2c640 1 -- 172.21.15.17:0/57996828 wait complete. 2023-08-09T12:41:11.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:41:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.666+0000 7f6c90b22640 1 Processor -- start 2023-08-09T12:41:11.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.667+0000 7f6c90b22640 1 -- start start 2023-08-09T12:41:11.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.668+0000 7f6c90b22640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c8c159880 0x7f6c8c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:11.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.668+0000 7f6c90b22640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c8c06d330 0x7f6c8c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.668+0000 7f6c90b22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c0cdb20 0x7f6c8c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.668+0000 7f6c90b22640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0cdf90 con 0x7f6c8c06d330 2023-08-09T12:41:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.668+0000 7f6c90b22640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0ca450 con 0x7f6c8c159880 2023-08-09T12:41:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.668+0000 7f6c90b22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0ca730 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8affd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c8c06d330 0x7f6c8c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8affd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c8c06d330 0x7f6c8c0cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34320/0 (socket says 172.21.15.17:34320) 2023-08-09T12:41:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8affd640 1 -- 172.21.15.17:0/1453618321 learned_addr learned my addr 172.21.15.17:0/1453618321 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8bfff640 1 --2- 172.21.15.17:0/1453618321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c0cdb20 0x7f6c8c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8b7fe640 1 --2- 172.21.15.17:0/1453618321 >> v2:172.21.15.142:3300/0 conn(0x7f6c8c159880 0x7f6c8c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8affd640 1 -- 172.21.15.17:0/1453618321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c0cdb20 msgr2=0x7f6c8c15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8affd640 1 --2- 172.21.15.17:0/1453618321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c0cdb20 0x7f6c8c15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8affd640 1 -- 172.21.15.17:0/1453618321 >> v2:172.21.15.142:3300/0 conn(0x7f6c8c159880 msgr2=0x7f6c8c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8affd640 1 --2- 172.21.15.17:0/1453618321 >> v2:172.21.15.142:3300/0 conn(0x7f6c8c159880 0x7f6c8c0c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8affd640 1 -- 172.21.15.17:0/1453618321 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0caa10 con 0x7f6c8c06d330 2023-08-09T12:41:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.669+0000 7f6c8bfff640 1 --2- 172.21.15.17:0/1453618321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c0cdb20 0x7f6c8c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.670+0000 7f6c8affd640 1 --2- 172.21.15.17:0/1453618321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c06d330 0x7f6c8c0cd5e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c066410 tx=0x7f6c8002e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bc14bf5affce1b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c8a7fc640 1 -- 172.21.15.17:0/1453618321 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8002ee80 con 0x7f6c8c06d330 2023-08-09T12:41:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c8a7fc640 1 -- 172.21.15.17:0/1453618321 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80036440 con 0x7f6c8c06d330 2023-08-09T12:41:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c8a7fc640 1 -- 172.21.15.17:0/1453618321 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800367b0 con 0x7f6c8c06d330 2023-08-09T12:41:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c90b22640 1 -- 172.21.15.17:0/1453618321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c06d330 msgr2=0x7f6c8c0cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c90b22640 1 --2- 172.21.15.17:0/1453618321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c06d330 0x7f6c8c0cd5e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c066410 tx=0x7f6c8002e0d0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c90b22640 1 -- 172.21.15.17:0/1453618321 shutdown_connections 2023-08-09T12:41:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c90b22640 1 --2- 172.21.15.17:0/1453618321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c0cdb20 0x7f6c8c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c90b22640 1 --2- 172.21.15.17:0/1453618321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c06d330 0x7f6c8c0cd5e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c90b22640 1 --2- 172.21.15.17:0/1453618321 >> v2:172.21.15.142:3300/0 conn(0x7f6c8c159880 0x7f6c8c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.671+0000 7f6c90b22640 1 -- 172.21.15.17:0/1453618321 >> 172.21.15.17:0/1453618321 conn(0x7f6c8c0b1180 msgr2=0x7f6c8c0b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:11.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.672+0000 7f6c90b22640 1 -- 172.21.15.17:0/1453618321 shutdown_connections 2023-08-09T12:41:11.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.672+0000 7f6c90b22640 1 -- 172.21.15.17:0/1453618321 wait complete. 2023-08-09T12:41:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.673+0000 7f6c90b22640 1 Processor -- start 2023-08-09T12:41:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.673+0000 7f6c90b22640 1 -- start start 2023-08-09T12:41:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.674+0000 7f6c90b22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c06d330 0x7f6c8c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.674+0000 7f6c90b22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c0cdb20 0x7f6c8c143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.674+0000 7f6c90b22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c8c159880 0x7f6c8c0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.674+0000 7f6c90b22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0af990 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.674+0000 7f6c90b22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c1f5ec0 con 0x7f6c8c159880 2023-08-09T12:41:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.674+0000 7f6c90b22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c1f61a0 con 0x7f6c8c06d330 2023-08-09T12:41:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c0cdb20 0x7f6c8c143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c0cdb20 0x7f6c8c143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34326/0 (socket says 172.21.15.17:34326) 2023-08-09T12:41:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 -- 172.21.15.17:0/2120340175 learned_addr learned my addr 172.21.15.17:0/2120340175 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8b7fe640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c06d330 0x7f6c8c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 -- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c06d330 msgr2=0x7f6c8c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c06d330 0x7f6c8c0c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 -- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c8c159880 msgr2=0x7f6c8c0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c8c159880 0x7f6c8c0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 -- 172.21.15.17:0/2120340175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8000b770 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.675+0000 7f6c8affd640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c0cdb20 0x7f6c8c143540 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6c8002e110 tx=0x7f6c800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.676+0000 7f6c73fff640 1 -- 172.21.15.17:0/2120340175 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80034b80 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.676+0000 7f6c73fff640 1 -- 172.21.15.17:0/2120340175 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80036e90 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.676+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c1f6480 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.676+0000 7f6c73fff640 1 -- 172.21.15.17:0/2120340175 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80041460 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.676+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c143a80 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.677+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c0c8990 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.678+0000 7f6c73fff640 1 -- 172.21.15.17:0/2120340175 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6c80049360 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.679+0000 7f6c73fff640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6c7806a050 0x7f6c7806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.679+0000 7f6c73fff640 1 -- 172.21.15.17:0/2120340175 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f6c800aab60 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.679+0000 7f6c8b7fe640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6c7806a050 0x7f6c7806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.680+0000 7f6c8b7fe640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6c7806a050 0x7f6c7806c510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00b7c0 tx=0x7f6c7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:11.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.683+0000 7f6c73fff640 1 -- 172.21.15.17:0/2120340175 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6c8c0c8990 con 0x7f6c8c0cdb20 2023-08-09T12:41:11.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:11.881+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c8c0c8990 con 0x7f6c8c0cdb20 2023-08-09T12:41:12.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.772+0000 7f6c73fff640 1 -- 172.21.15.17:0/2120340175 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6c8c0c8990 con 0x7f6c8c0cdb20 2023-08-09T12:41:12.776 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:41:12.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6c7806a050 msgr2=0x7f6c7806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:12.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6c7806a050 0x7f6c7806c510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00b7c0 tx=0x7f6c7c008040 comp rx=0 tx=0).stop 2023-08-09T12:41:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c0cdb20 msgr2=0x7f6c8c143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c0cdb20 0x7f6c8c143540 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6c8002e110 tx=0x7f6c800046c0 comp rx=0 tx=0).stop 2023-08-09T12:41:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 shutdown_connections 2023-08-09T12:41:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6c7806a050 0x7f6c7806c510 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c8c159880 0x7f6c8c0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8c0cdb20 0x7f6c8c143540 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 --2- 172.21.15.17:0/2120340175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c8c06d330 0x7f6c8c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 >> 172.21.15.17:0/2120340175 conn(0x7f6c8c0b1180 msgr2=0x7f6c8c0ac940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 shutdown_connections 2023-08-09T12:41:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:12.776+0000 7f6c90b22640 1 -- 172.21.15.17:0/2120340175 wait complete. 2023-08-09T12:41:12.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:41:13.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.040+0000 7f13ad555640 1 Processor -- start 2023-08-09T12:41:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.040+0000 7f13ad555640 1 -- start start 2023-08-09T12:41:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.042+0000 7f13ad555640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13a80cb8d0 0x7f13a8070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.042+0000 7f13ad555640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a80cd030 con 0x7f13a80ca850 2023-08-09T12:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.042+0000 7f13ad555640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a80cc420 con 0x7f13a80cd4c0 2023-08-09T12:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.042+0000 7f13ad555640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a80cc700 con 0x7f13a80cb8d0 2023-08-09T12:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.042+0000 7f13a6ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f13a80ca850 0x7f13a80cb1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32786/0 (socket says 172.21.15.17:32786) 2023-08-09T12:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.042+0000 7f13a6ffd640 1 -- 172.21.15.17:0/3467812526 learned_addr learned my addr 172.21.15.17:0/3467812526 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:13.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a77fe640 1 --2- 172.21.15.17:0/3467812526 >> v2:172.21.15.142:3300/0 conn(0x7f13a80cb8d0 0x7f13a8070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:13.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391644380 0 0) 0x7f13a80cd030 con 0x7f13a80ca850 2023-08-09T12:41:13.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1394003520 con 0x7f13a80ca850 2023-08-09T12:41:13.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 691673341 0 0) 0x7f1394003520 con 0x7f13a80ca850 2023-08-09T12:41:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 >> v2:172.21.15.142:3300/0 conn(0x7f13a80cb8d0 msgr2=0x7f13a8070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 --2- 172.21.15.17:0/3467812526 >> v2:172.21.15.142:3300/0 conn(0x7f13a80cb8d0 0x7f13a8070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 >> v1:172.21.15.142:6789/0 conn(0x7f13a80cd4c0 legacy=0x7f13a80ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80cc9e0 con 0x7f13a80ca850 2023-08-09T12:41:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1398001670 con 0x7f13a80ca850 2023-08-09T12:41:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 >> v1:172.21.15.17:6789/0 conn(0x7f13a80ca850 legacy=0x7f13a80cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.043+0000 7f13a67fc640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1394003970 0x7f1394003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:13.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a67fc640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13940047c0 0x7f1394004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:13.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a67fc640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394005180 0x7f139400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:13.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80cc700 con 0x7f1394003970 2023-08-09T12:41:13.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139400c020 con 0x7f1394005180 2023-08-09T12:41:13.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139400c1e0 con 0x7f13940047c0 2023-08-09T12:41:13.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a6ffd640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1394003970 0x7f1394003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:13.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a77fe640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394005180 0x7f139400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:13.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f139e7fc640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13940047c0 0x7f1394004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:13.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a6ffd640 1 -- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13940047c0 msgr2=0x7f1394004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:13.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a6ffd640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13940047c0 0x7f1394004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a6ffd640 1 -- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394005180 msgr2=0x7f139400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:13.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a6ffd640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394005180 0x7f139400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a6ffd640 1 -- 172.21.15.17:0/3467812526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394003520 con 0x7f1394003970 2023-08-09T12:41:13.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a77fe640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394005180 0x7f139400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:13.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.044+0000 7f13a77fe640 1 -- 172.21.15.17:0/3467812526 reap_dead start 2023-08-09T12:41:13.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.046+0000 7f13a6ffd640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1394003970 0x7f1394003d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f139800c240 tx=0x7f13940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48249f491819b6b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:13.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.046+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398005ad0 con 0x7f1394003970 2023-08-09T12:41:13.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.046+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398005c30 con 0x7f1394003970 2023-08-09T12:41:13.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.046+0000 7f13a67fc640 1 -- 172.21.15.17:0/3467812526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139802ca90 con 0x7f1394003970 2023-08-09T12:41:13.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.046+0000 7f13ad555640 1 -- 172.21.15.17:0/3467812526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1394003970 msgr2=0x7f1394003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:13.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.046+0000 7f13ad555640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1394003970 0x7f1394003d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f139800c240 tx=0x7f13940057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.047+0000 7f13ad555640 1 -- 172.21.15.17:0/3467812526 shutdown_connections 2023-08-09T12:41:13.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.047+0000 7f13ad555640 1 --2- 172.21.15.17:0/3467812526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1394003970 0x7f1394003d90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.047+0000 7f13ad555640 1 -- 172.21.15.17:0/3467812526 >> 172.21.15.17:0/3467812526 conn(0x7f13a80697c0 msgr2=0x7f13a8069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:13.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.047+0000 7f13ad555640 1 -- 172.21.15.17:0/3467812526 shutdown_connections 2023-08-09T12:41:13.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.047+0000 7f13ad555640 1 -- 172.21.15.17:0/3467812526 wait complete. 2023-08-09T12:41:13.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.048+0000 7f13ad555640 1 Processor -- start 2023-08-09T12:41:13.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.049+0000 7f13ad555640 1 -- start start 2023-08-09T12:41:13.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f13ad555640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394003970 0x7f13a80b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:13.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f13ad555640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a80c32d0 0x7f13a80b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:13.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f13ad555640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a80b3800 0x7f13a80c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:13.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f13ad555640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80b3c80 con 0x7f13a80c32d0 2023-08-09T12:41:13.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f13ad555640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80c3ae0 con 0x7f1394003970 2023-08-09T12:41:13.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f13ad555640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80c3dc0 con 0x7f13a80b3800 2023-08-09T12:41:13.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f139e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a80c32d0 0x7f13a80b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:13.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f139e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a80c32d0 0x7f13a80b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34348/0 (socket says 172.21.15.17:34348) 2023-08-09T12:41:13.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f139e7fc640 1 -- 172.21.15.17:0/3144235646 learned_addr learned my addr 172.21.15.17:0/3144235646 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:13.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f13a77fe640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a80b3800 0x7f13a80c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:13.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.050+0000 7f13a6ffd640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394003970 0x7f13a80b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:13.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139e7fc640 1 -- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a80b3800 msgr2=0x7f13a80c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:13.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139e7fc640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a80b3800 0x7f13a80c4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139e7fc640 1 -- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394003970 msgr2=0x7f13a80b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:13.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139e7fc640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394003970 0x7f13a80b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139e7fc640 1 -- 172.21.15.17:0/3144235646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80c40a0 con 0x7f13a80c32d0 2023-08-09T12:41:13.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f13a6ffd640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394003970 0x7f13a80b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:13.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139e7fc640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a80c32d0 0x7f13a80b32c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f139000d4c0 tx=0x7f139000d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:13.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139ffff640 1 -- 172.21.15.17:0/3144235646 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390005480 con 0x7f13a80c32d0 2023-08-09T12:41:13.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139ffff640 1 -- 172.21.15.17:0/3144235646 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13900035f0 con 0x7f13a80c32d0 2023-08-09T12:41:13.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f139ffff640 1 -- 172.21.15.17:0/3144235646 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13900039e0 con 0x7f13a80c32d0 2023-08-09T12:41:13.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a80c4380 con 0x7f13a80c32d0 2023-08-09T12:41:13.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.051+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a80c3750 con 0x7f13a80c32d0 2023-08-09T12:41:13.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.053+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a8067a80 con 0x7f13a80c32d0 2023-08-09T12:41:13.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.053+0000 7f139ffff640 1 -- 172.21.15.17:0/3144235646 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1390003b40 con 0x7f13a80c32d0 2023-08-09T12:41:13.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.054+0000 7f139ffff640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f138806a050 0x7f138806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:13.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.055+0000 7f139ffff640 1 -- 172.21.15.17:0/3144235646 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f1390088370 con 0x7f13a80c32d0 2023-08-09T12:41:13.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.055+0000 7f13a6ffd640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f138806a050 0x7f138806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:13.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.056+0000 7f13a6ffd640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f138806a050 0x7f138806c510 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1398034000 tx=0x7f1398009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:13.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.060+0000 7f139ffff640 1 -- 172.21.15.17:0/3144235646 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1390053b00 con 0x7f13a80c32d0 2023-08-09T12:41:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.254+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f13a806b5e0 con 0x7f13a80c32d0 2023-08-09T12:41:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.782+0000 7f139ffff640 1 -- 172.21.15.17:0/3144235646 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1390057120 con 0x7f13a80c32d0 2023-08-09T12:41:13.790 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:41:13.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.793+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f138806a050 msgr2=0x7f138806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:13.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.793+0000 7f13ad555640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f138806a050 0x7f138806c510 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1398034000 tx=0x7f1398009030 comp rx=0 tx=0).stop 2023-08-09T12:41:13.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.794+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a80c32d0 msgr2=0x7f13a80b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:13.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.794+0000 7f13ad555640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a80c32d0 0x7f13a80b32c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f139000d4c0 tx=0x7f139000d980 comp rx=0 tx=0).stop 2023-08-09T12:41:13.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.795+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 shutdown_connections 2023-08-09T12:41:13.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.795+0000 7f13ad555640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f138806a050 0x7f138806c510 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.795+0000 7f13ad555640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a80b3800 0x7f13a80c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.795+0000 7f13ad555640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a80c32d0 0x7f13a80b32c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.795+0000 7f13ad555640 1 --2- 172.21.15.17:0/3144235646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1394003970 0x7f13a80b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.795+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 >> 172.21.15.17:0/3144235646 conn(0x7f13a80697c0 msgr2=0x7f13a80cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.795+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 shutdown_connections 2023-08-09T12:41:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:13.796+0000 7f13ad555640 1 -- 172.21.15.17:0/3144235646 wait complete. 2023-08-09T12:41:13.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:41:14.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.032+0000 7f449bde8640 1 Processor -- start 2023-08-09T12:41:14.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.032+0000 7f449bde8640 1 -- start start 2023-08-09T12:41:14.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f449bde8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f44940adc40 0x7f449406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f449bde8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f44940b3b40 0x7f44940b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f449bde8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449415e8f0 0x7f449415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f449bde8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940ae020 con 0x7f44940b3b40 2023-08-09T12:41:14.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f449bde8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940b2250 con 0x7f44940adc40 2023-08-09T12:41:14.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f449bde8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b2530 con 0x7f449415e8f0 2023-08-09T12:41:14.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f4499383640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f44940b3b40 0x7f44940b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f4499383640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f44940b3b40 0x7f44940b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34356/0 (socket says 172.21.15.17:34356) 2023-08-09T12:41:14.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.034+0000 7f4499383640 1 -- 172.21.15.17:0/1468831995 learned_addr learned my addr 172.21.15.17:0/1468831995 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:14.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f4499383640 1 -- 172.21.15.17:0/1468831995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449415e8f0 msgr2=0x7f449415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:14.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f4499b84640 1 --2- 172.21.15.17:0/1468831995 >> v2:172.21.15.142:3300/0 conn(0x7f44940adc40 0x7f449406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f449a385640 1 --2- 172.21.15.17:0/1468831995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449415e8f0 0x7f449415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f4499383640 1 --2- 172.21.15.17:0/1468831995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449415e8f0 0x7f449415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f4499383640 1 -- 172.21.15.17:0/1468831995 >> v2:172.21.15.142:3300/0 conn(0x7f44940adc40 msgr2=0x7f449406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:14.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f4499383640 1 --2- 172.21.15.17:0/1468831995 >> v2:172.21.15.142:3300/0 conn(0x7f44940adc40 0x7f449406c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f4499383640 1 -- 172.21.15.17:0/1468831995 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449406fe80 con 0x7f44940b3b40 2023-08-09T12:41:14.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f4499b84640 1 --2- 172.21.15.17:0/1468831995 >> v2:172.21.15.142:3300/0 conn(0x7f44940adc40 0x7f449406c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:14.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.035+0000 7f449a385640 1 --2- 172.21.15.17:0/1468831995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449415e8f0 0x7f449415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:14.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.036+0000 7f4499383640 1 --2- 172.21.15.17:0/1468831995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940b3b40 0x7f44940b3fd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f44940b1320 tx=0x7f448402b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adf306dba4d097c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f4498b82640 1 -- 172.21.15.17:0/1468831995 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484004030 con 0x7f44940b3b40 2023-08-09T12:41:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f4498b82640 1 -- 172.21.15.17:0/1468831995 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484004190 con 0x7f44940b3b40 2023-08-09T12:41:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f4498b82640 1 -- 172.21.15.17:0/1468831995 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484031640 con 0x7f44940b3b40 2023-08-09T12:41:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 -- 172.21.15.17:0/1468831995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940b3b40 msgr2=0x7f44940b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 --2- 172.21.15.17:0/1468831995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940b3b40 0x7f44940b3fd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f44940b1320 tx=0x7f448402b8e0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 -- 172.21.15.17:0/1468831995 shutdown_connections 2023-08-09T12:41:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 --2- 172.21.15.17:0/1468831995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449415e8f0 0x7f449415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 --2- 172.21.15.17:0/1468831995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940b3b40 0x7f44940b3fd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 --2- 172.21.15.17:0/1468831995 >> v2:172.21.15.142:3300/0 conn(0x7f44940adc40 0x7f449406c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 -- 172.21.15.17:0/1468831995 >> 172.21.15.17:0/1468831995 conn(0x7f44940cb1b0 msgr2=0x7f44940cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:14.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 -- 172.21.15.17:0/1468831995 shutdown_connections 2023-08-09T12:41:14.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.037+0000 7f449bde8640 1 -- 172.21.15.17:0/1468831995 wait complete. 2023-08-09T12:41:14.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.039+0000 7f449bde8640 1 Processor -- start 2023-08-09T12:41:14.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.039+0000 7f449bde8640 1 -- start start 2023-08-09T12:41:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.040+0000 7f449bde8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940adc40 0x7f44941e5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.040+0000 7f449bde8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44940b3b40 0x7f44940c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.040+0000 7f449bde8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449415e8f0 0x7f44940b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.040+0000 7f449bde8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940c37b0 con 0x7f44940adc40 2023-08-09T12:41:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.040+0000 7f449bde8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44941e5c60 con 0x7f449415e8f0 2023-08-09T12:41:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.040+0000 7f449bde8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b0bc0 con 0x7f44940b3b40 2023-08-09T12:41:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940adc40 0x7f44941e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940adc40 0x7f44941e5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34370/0 (socket says 172.21.15.17:34370) 2023-08-09T12:41:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 -- 172.21.15.17:0/1214471733 learned_addr learned my addr 172.21.15.17:0/1214471733 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f449a385640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449415e8f0 0x7f44940b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499383640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44940b3b40 0x7f44940c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 -- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44940b3b40 msgr2=0x7f44940c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44940b3b40 0x7f44940c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 -- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449415e8f0 msgr2=0x7f44940b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449415e8f0 0x7f44940b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 -- 172.21.15.17:0/1214471733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484009460 con 0x7f44940adc40 2023-08-09T12:41:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.041+0000 7f4499b84640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940adc40 0x7f44941e5720 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f449000c7c0 tx=0x7f449000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.042+0000 7f448a7fc640 1 -- 172.21.15.17:0/1214471733 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490007a30 con 0x7f44940adc40 2023-08-09T12:41:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.042+0000 7f448a7fc640 1 -- 172.21.15.17:0/1214471733 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490007b90 con 0x7f44940adc40 2023-08-09T12:41:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.042+0000 7f448a7fc640 1 -- 172.21.15.17:0/1214471733 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000ce70 con 0x7f44940adc40 2023-08-09T12:41:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.042+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940b0ea0 con 0x7f44940adc40 2023-08-09T12:41:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.042+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940c3ce0 con 0x7f44940adc40 2023-08-09T12:41:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.043+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4494070140 con 0x7f44940adc40 2023-08-09T12:41:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.044+0000 7f448a7fc640 1 -- 172.21.15.17:0/1214471733 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44900113f0 con 0x7f44940adc40 2023-08-09T12:41:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.045+0000 7f448a7fc640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f447806a050 0x7f447806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.045+0000 7f448a7fc640 1 -- 172.21.15.17:0/1214471733 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4490088490 con 0x7f44940adc40 2023-08-09T12:41:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.046+0000 7f4499383640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f447806a050 0x7f447806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.047+0000 7f4499383640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f447806a050 0x7f447806c510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4484035000 tx=0x7f4484008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:14.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.050+0000 7f448a7fc640 1 -- 172.21.15.17:0/1214471733 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4494070140 con 0x7f44940adc40 2023-08-09T12:41:14.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.245+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4494070110 con 0x7f44940adc40 2023-08-09T12:41:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.254+0000 7f448a7fc640 1 -- 172.21.15.17:0/1214471733 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4490053df0 con 0x7f44940adc40 2023-08-09T12:41:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f447806a050 msgr2=0x7f447806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f447806a050 0x7f447806c510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4484035000 tx=0x7f4484008030 comp rx=0 tx=0).stop 2023-08-09T12:41:14.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940adc40 msgr2=0x7f44941e5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940adc40 0x7f44941e5720 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f449000c7c0 tx=0x7f449000cc80 comp rx=0 tx=0).stop 2023-08-09T12:41:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 shutdown_connections 2023-08-09T12:41:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f447806a050 0x7f447806c510 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449415e8f0 0x7f44940b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44940b3b40 0x7f44940c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 --2- 172.21.15.17:0/1214471733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44940adc40 0x7f44941e5720 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.257+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 >> 172.21.15.17:0/1214471733 conn(0x7f44940cb1b0 msgr2=0x7f4494069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:14.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.258+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 shutdown_connections 2023-08-09T12:41:14.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.258+0000 7f449bde8640 1 -- 172.21.15.17:0/1214471733 wait complete. 2023-08-09T12:41:14.279 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-08-09T12:41:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.506+0000 7fc146a0f640 1 Processor -- start 2023-08-09T12:41:14.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.506+0000 7fc146a0f640 1 -- start start 2023-08-09T12:41:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.507+0000 7fc146a0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc140160030 0x7fc140160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.507+0000 7fc146a0f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc1400cfb50 0x7fc1400d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.507+0000 7fc146a0f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400b5a30 con 0x7fc1400b86e0 2023-08-09T12:41:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.507+0000 7fc146a0f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400d1110 con 0x7fc1400cfb50 2023-08-09T12:41:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.507+0000 7fc146a0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400ceac0 con 0x7fc140160030 2023-08-09T12:41:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.508+0000 7fc14520c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc1400b86e0 0x7fc1400cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32798/0 (socket says 172.21.15.17:32798) 2023-08-09T12:41:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.508+0000 7fc14520c640 1 -- 172.21.15.17:0/2876735426 learned_addr learned my addr 172.21.15.17:0/2876735426 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.508+0000 7fc14620e640 1 --2- 172.21.15.17:0/2876735426 >> v2:172.21.15.17:3300/0 conn(0x7fc1400cfb50 0x7fc1400d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.508+0000 7fc145a0d640 1 --2- 172.21.15.17:0/2876735426 >> v2:172.21.15.142:3300/0 conn(0x7fc140160030 0x7fc140160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.508+0000 7fc144a0b640 1 -- 172.21.15.17:0/2876735426 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556113470 0 0) 0x7fc1400b5a30 con 0x7fc1400b86e0 2023-08-09T12:41:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.508+0000 7fc144a0b640 1 -- 172.21.15.17:0/2876735426 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc12c003520 con 0x7fc1400b86e0 2023-08-09T12:41:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.509+0000 7fc14620e640 1 -- 172.21.15.17:0/2876735426 >> v2:172.21.15.142:3300/0 conn(0x7fc140160030 msgr2=0x7fc140160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.509+0000 7fc14620e640 1 --2- 172.21.15.17:0/2876735426 >> v2:172.21.15.142:3300/0 conn(0x7fc140160030 0x7fc140160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.509+0000 7fc14620e640 1 -- 172.21.15.17:0/2876735426 >> v1:172.21.15.17:6789/0 conn(0x7fc1400b86e0 legacy=0x7fc1400cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.509+0000 7fc14620e640 1 -- 172.21.15.17:0/2876735426 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400d0d70 con 0x7fc1400cfb50 2023-08-09T12:41:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.510+0000 7fc14620e640 1 --2- 172.21.15.17:0/2876735426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400cfb50 0x7fc1400d1530 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc140065f60 tx=0x7fc13802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5725152f2acc8e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.510+0000 7fc144a0b640 1 -- 172.21.15.17:0/2876735426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138031830 con 0x7fc1400cfb50 2023-08-09T12:41:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.510+0000 7fc144a0b640 1 -- 172.21.15.17:0/2876735426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138031990 con 0x7fc1400cfb50 2023-08-09T12:41:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.510+0000 7fc144a0b640 1 -- 172.21.15.17:0/2876735426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138031d00 con 0x7fc1400cfb50 2023-08-09T12:41:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.511+0000 7fc146a0f640 1 -- 172.21.15.17:0/2876735426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400cfb50 msgr2=0x7fc1400d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.511+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2876735426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400cfb50 0x7fc1400d1530 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc140065f60 tx=0x7fc13802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.511+0000 7fc146a0f640 1 -- 172.21.15.17:0/2876735426 shutdown_connections 2023-08-09T12:41:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.511+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2876735426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400cfb50 0x7fc1400d1530 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.511+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2876735426 >> v2:172.21.15.142:3300/0 conn(0x7fc140160030 0x7fc140160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.511+0000 7fc146a0f640 1 -- 172.21.15.17:0/2876735426 >> 172.21.15.17:0/2876735426 conn(0x7fc1400697c0 msgr2=0x7fc140069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.511+0000 7fc146a0f640 1 -- 172.21.15.17:0/2876735426 shutdown_connections 2023-08-09T12:41:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.511+0000 7fc146a0f640 1 -- 172.21.15.17:0/2876735426 wait complete. 2023-08-09T12:41:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.514+0000 7fc146a0f640 1 Processor -- start 2023-08-09T12:41:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.514+0000 7fc146a0f640 1 -- start start 2023-08-09T12:41:14.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.515+0000 7fc146a0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400b86e0 0x7fc14014de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.515+0000 7fc146a0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400cfb50 0x7fc1400a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.515+0000 7fc146a0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc140160030 0x7fc14014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.515+0000 7fc146a0f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400aaa90 con 0x7fc1400b86e0 2023-08-09T12:41:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.515+0000 7fc146a0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400a9e80 con 0x7fc140160030 2023-08-09T12:41:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.515+0000 7fc146a0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400aa160 con 0x7fc1400cfb50 2023-08-09T12:41:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.515+0000 7fc145a0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400b86e0 0x7fc14014de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.515+0000 7fc145a0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400b86e0 0x7fc14014de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34382/0 (socket says 172.21.15.17:34382) 2023-08-09T12:41:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc145a0d640 1 -- 172.21.15.17:0/2359045876 learned_addr learned my addr 172.21.15.17:0/2359045876 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:14.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc14620e640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc140160030 0x7fc14014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc14520c640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400cfb50 0x7fc1400a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc145a0d640 1 -- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400cfb50 msgr2=0x7fc1400a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc145a0d640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400cfb50 0x7fc1400a9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc145a0d640 1 -- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc140160030 msgr2=0x7fc14014e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc145a0d640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc140160030 0x7fc14014e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc145a0d640 1 -- 172.21.15.17:0/2359045876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc138009400 con 0x7fc1400b86e0 2023-08-09T12:41:14.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc14620e640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc140160030 0x7fc14014e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:14.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.516+0000 7fc145a0d640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400b86e0 0x7fc14014de30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc13c007e40 tx=0x7fc13c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:14.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.517+0000 7fc1367fc640 1 -- 172.21.15.17:0/2359045876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c014620 con 0x7fc1400b86e0 2023-08-09T12:41:14.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.517+0000 7fc1367fc640 1 -- 172.21.15.17:0/2359045876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c00ee90 con 0x7fc1400b86e0 2023-08-09T12:41:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.517+0000 7fc1367fc640 1 -- 172.21.15.17:0/2359045876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0149c0 con 0x7fc1400b86e0 2023-08-09T12:41:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.517+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1400aa440 con 0x7fc1400b86e0 2023-08-09T12:41:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.517+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14014e370 con 0x7fc1400b86e0 2023-08-09T12:41:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.518+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14004e390 con 0x7fc1400b86e0 2023-08-09T12:41:14.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.520+0000 7fc1367fc640 1 -- 172.21.15.17:0/2359045876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc13c014b20 con 0x7fc1400b86e0 2023-08-09T12:41:14.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.521+0000 7fc1367fc640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12406a050 0x7fc12406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:14.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.521+0000 7fc1367fc640 1 -- 172.21.15.17:0/2359045876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc13c088cc0 con 0x7fc1400b86e0 2023-08-09T12:41:14.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.522+0000 7fc14520c640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12406a050 0x7fc12406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:14.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.523+0000 7fc14520c640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12406a050 0x7fc12406c510 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc1400c6530 tx=0x7fc130009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:14.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.526+0000 7fc1367fc640 1 -- 172.21.15.17:0/2359045876 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc13c08f080 con 0x7fc1400b86e0 2023-08-09T12:41:14.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:14.799+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fc1400b7090 con 0x7fc1400b86e0 2023-08-09T12:41:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.801+0000 7fc1367fc640 1 -- 172.21.15.17:0/2359045876 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v123) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc13c0580c0 con 0x7fc1400b86e0 2023-08-09T12:41:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12406a050 msgr2=0x7fc12406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12406a050 0x7fc12406c510 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc1400c6530 tx=0x7fc130009040 comp rx=0 tx=0).stop 2023-08-09T12:41:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400b86e0 msgr2=0x7fc14014de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400b86e0 0x7fc14014de30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc13c007e40 tx=0x7fc13c00e4b0 comp rx=0 tx=0).stop 2023-08-09T12:41:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 shutdown_connections 2023-08-09T12:41:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12406a050 0x7fc12406c510 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc140160030 0x7fc14014e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1400cfb50 0x7fc1400a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 --2- 172.21.15.17:0/2359045876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1400b86e0 0x7fc14014de30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.804+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 >> 172.21.15.17:0/2359045876 conn(0x7fc1400697c0 msgr2=0x7fc14015d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.805+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 shutdown_connections 2023-08-09T12:41:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:15.805+0000 7fc146a0f640 1 -- 172.21.15.17:0/2359045876 wait complete. 2023-08-09T12:41:15.828 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-09T12:41:15.828 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-08-09T12:41:15.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-08-09T12:41:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.054+0000 7fd9bce8a640 1 Processor -- start 2023-08-09T12:41:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.054+0000 7fd9bce8a640 1 -- start start 2023-08-09T12:41:16.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.055+0000 7fd9bce8a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 0x7fd9b8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:16.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.055+0000 7fd9bce8a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd9b80cfb50 0x7fd9b80d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:16.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.055+0000 7fd9bce8a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b80b5a30 con 0x7fd9b80b86e0 2023-08-09T12:41:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.055+0000 7fd9bce8a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b80d1110 con 0x7fd9b80cfb50 2023-08-09T12:41:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.055+0000 7fd9bce8a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80ceac0 con 0x7fd9b8160030 2023-08-09T12:41:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.056+0000 7fd9b7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd9b80cfb50 0x7fd9b80d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.056+0000 7fd9b77fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 0x7fd9b8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.056+0000 7fd9b7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd9b80cfb50 0x7fd9b80d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:47396/0 (socket says 172.21.15.17:47396) 2023-08-09T12:41:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.056+0000 7fd9b7fff640 1 -- 172.21.15.17:0/4272276568 learned_addr learned my addr 172.21.15.17:0/4272276568 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.057+0000 7fd9b7fff640 1 -- 172.21.15.17:0/4272276568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 msgr2=0x7fd9b8160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.057+0000 7fd9b7fff640 1 --2- 172.21.15.17:0/4272276568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 0x7fd9b8160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.057+0000 7fd9b7fff640 1 -- 172.21.15.17:0/4272276568 >> v1:172.21.15.142:6789/0 conn(0x7fd9b80b86e0 legacy=0x7fd9b80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.057+0000 7fd9b7fff640 1 -- 172.21.15.17:0/4272276568 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b80d0d70 con 0x7fd9b80cfb50 2023-08-09T12:41:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.058+0000 7fd9b7fff640 1 --2- 172.21.15.17:0/4272276568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80cfb50 0x7fd9b80d1530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009870 tx=0x7fd9b002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3508b32cc8348bb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9b67fc640 1 -- 172.21.15.17:0/4272276568 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0030840 con 0x7fd9b80cfb50 2023-08-09T12:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9b67fc640 1 -- 172.21.15.17:0/4272276568 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b00309a0 con 0x7fd9b80cfb50 2023-08-09T12:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9b67fc640 1 -- 172.21.15.17:0/4272276568 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0030d30 con 0x7fd9b80cfb50 2023-08-09T12:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9bce8a640 1 -- 172.21.15.17:0/4272276568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80cfb50 msgr2=0x7fd9b80d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/4272276568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80cfb50 0x7fd9b80d1530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009870 tx=0x7fd9b002b980 comp rx=0 tx=0).stop 2023-08-09T12:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9bce8a640 1 -- 172.21.15.17:0/4272276568 shutdown_connections 2023-08-09T12:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/4272276568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80cfb50 0x7fd9b80d1530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/4272276568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 0x7fd9b8160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9bce8a640 1 -- 172.21.15.17:0/4272276568 >> 172.21.15.17:0/4272276568 conn(0x7fd9b80697c0 msgr2=0x7fd9b8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.059+0000 7fd9bce8a640 1 -- 172.21.15.17:0/4272276568 shutdown_connections 2023-08-09T12:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.060+0000 7fd9bce8a640 1 -- 172.21.15.17:0/4272276568 wait complete. 2023-08-09T12:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.061+0000 7fd9bce8a640 1 Processor -- start 2023-08-09T12:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.061+0000 7fd9bce8a640 1 -- start start 2023-08-09T12:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.062+0000 7fd9bce8a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80b86e0 0x7fd9b81f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.062+0000 7fd9bce8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b80cfb50 0x7fd9b81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.062+0000 7fd9bce8a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 0x7fd9b81f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.062+0000 7fd9bce8a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b81509c0 con 0x7fd9b80cfb50 2023-08-09T12:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.062+0000 7fd9bce8a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80cc4d0 con 0x7fd9b80b86e0 2023-08-09T12:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.062+0000 7fd9bce8a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80cbf80 con 0x7fd9b8160030 2023-08-09T12:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b80cfb50 0x7fd9b81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b80cfb50 0x7fd9b81594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34390/0 (socket says 172.21.15.17:34390) 2023-08-09T12:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b6ffd640 1 -- 172.21.15.17:0/149953894 learned_addr learned my addr 172.21.15.17:0/149953894 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b77fe640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80b86e0 0x7fd9b81f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b7fff640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 0x7fd9b81f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b6ffd640 1 -- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 msgr2=0x7fd9b81f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b6ffd640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 0x7fd9b81f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b6ffd640 1 -- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80b86e0 msgr2=0x7fd9b81f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b6ffd640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80b86e0 0x7fd9b81f2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.063+0000 7fd9b6ffd640 1 -- 172.21.15.17:0/149953894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00094d0 con 0x7fd9b80cfb50 2023-08-09T12:41:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.064+0000 7fd9b6ffd640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b80cfb50 0x7fd9b81594c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c480 tx=0x7fd9ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.064+0000 7fd99ffff640 1 -- 172.21.15.17:0/149953894 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0052d0 con 0x7fd9b80cfb50 2023-08-09T12:41:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.064+0000 7fd99ffff640 1 -- 172.21.15.17:0/149953894 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac005430 con 0x7fd9b80cfb50 2023-08-09T12:41:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.064+0000 7fd99ffff640 1 -- 172.21.15.17:0/149953894 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac012870 con 0x7fd9b80cfb50 2023-08-09T12:41:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.064+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b8159a00 con 0x7fd9b80cfb50 2023-08-09T12:41:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.064+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b80cc1f0 con 0x7fd9b80cfb50 2023-08-09T12:41:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.065+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b81f5900 con 0x7fd9b80cfb50 2023-08-09T12:41:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.066+0000 7fd99ffff640 1 -- 172.21.15.17:0/149953894 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd9ac0129d0 con 0x7fd9b80cfb50 2023-08-09T12:41:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.067+0000 7fd99ffff640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9a406a050 0x7fd9a406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.067+0000 7fd99ffff640 1 -- 172.21.15.17:0/149953894 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd9ac087e50 con 0x7fd9b80cfb50 2023-08-09T12:41:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.068+0000 7fd9b77fe640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9a406a050 0x7fd9a406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.069+0000 7fd9b77fe640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9a406a050 0x7fd9a406c510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80b5cc0 tx=0x7fd9a800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.072+0000 7fd99ffff640 1 -- 172.21.15.17:0/149953894 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd9b81f5900 con 0x7fd9b80cfb50 2023-08-09T12:41:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.333+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7fd9b81f5900 con 0x7fd9b80cfb50 2023-08-09T12:41:16.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.810+0000 7fd99ffff640 1 -- 172.21.15.17:0/149953894 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v124) v1 ==== 145+0+0 (secure 0 0 0) 0x7fd9b81f5900 con 0x7fd9b80cfb50 2023-08-09T12:41:16.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9a406a050 msgr2=0x7fd9a406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:16.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9a406a050 0x7fd9a406c510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80b5cc0 tx=0x7fd9a800b040 comp rx=0 tx=0).stop 2023-08-09T12:41:16.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b80cfb50 msgr2=0x7fd9b81594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:16.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b80cfb50 0x7fd9b81594c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c480 tx=0x7fd9ac00c940 comp rx=0 tx=0).stop 2023-08-09T12:41:16.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 shutdown_connections 2023-08-09T12:41:16.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9a406a050 0x7fd9a406c510 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9b8160030 0x7fd9b81f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b80cfb50 0x7fd9b81594c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 --2- 172.21.15.17:0/149953894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9b80b86e0 0x7fd9b81f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:16.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.813+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 >> 172.21.15.17:0/149953894 conn(0x7fd9b80697c0 msgr2=0x7fd9b80d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:16.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.814+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 shutdown_connections 2023-08-09T12:41:16.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:16.814+0000 7fd9bce8a640 1 -- 172.21.15.17:0/149953894 wait complete. 2023-08-09T12:41:16.837 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-09T12:41:17.080 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_objectstore":"memstore"} 2023-08-09T12:41:17.080 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-09T12:41:17.081 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.308+0000 7f2e494b0640 1 Processor -- start 2023-08-09T12:41:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.308+0000 7f2e494b0640 1 -- start start 2023-08-09T12:41:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.309+0000 7f2e494b0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e44160030 0x7f2e44160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.309+0000 7f2e494b0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e440b86e0 0x7f2e440cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.309+0000 7f2e494b0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e440b5a30 con 0x7f2e440cf980 2023-08-09T12:41:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.309+0000 7f2e494b0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e440d1110 con 0x7f2e440b86e0 2023-08-09T12:41:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.309+0000 7f2e494b0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e440ceac0 con 0x7f2e44160030 2023-08-09T12:41:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.309+0000 7f2e3b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e440b86e0 0x7f2e440cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.309+0000 7f2e3b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e440b86e0 0x7f2e440cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34396/0 (socket says 172.21.15.17:34396) 2023-08-09T12:41:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.309+0000 7f2e3b7fe640 1 -- 172.21.15.17:0/2422916576 learned_addr learned my addr 172.21.15.17:0/2422916576 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.310+0000 7f2e43fff640 1 --2- 172.21.15.17:0/2422916576 >> v2:172.21.15.142:3300/0 conn(0x7f2e44160030 0x7f2e44160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.310+0000 7f2e3b7fe640 1 -- 172.21.15.17:0/2422916576 >> v2:172.21.15.142:3300/0 conn(0x7f2e44160030 msgr2=0x7f2e44160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.310+0000 7f2e3b7fe640 1 --2- 172.21.15.17:0/2422916576 >> v2:172.21.15.142:3300/0 conn(0x7f2e44160030 0x7f2e44160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.310+0000 7f2e3b7fe640 1 -- 172.21.15.17:0/2422916576 >> v1:172.21.15.142:6789/0 conn(0x7f2e440cf980 legacy=0x7f2e440b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:17.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.310+0000 7f2e3b7fe640 1 -- 172.21.15.17:0/2422916576 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e440cfdd0 con 0x7f2e440b86e0 2023-08-09T12:41:17.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.311+0000 7f2e3b7fe640 1 --2- 172.21.15.17:0/2422916576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e440cf440 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2e440d3b70 tx=0x7f2e2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f08ce223a21230 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:17.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.312+0000 7f2e437fe640 1 -- 172.21.15.17:0/2422916576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c031870 con 0x7f2e440b86e0 2023-08-09T12:41:17.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.312+0000 7f2e437fe640 1 -- 172.21.15.17:0/2422916576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c0319d0 con 0x7f2e440b86e0 2023-08-09T12:41:17.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.312+0000 7f2e437fe640 1 -- 172.21.15.17:0/2422916576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c031d60 con 0x7f2e440b86e0 2023-08-09T12:41:17.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.312+0000 7f2e494b0640 1 -- 172.21.15.17:0/2422916576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 msgr2=0x7f2e440cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.312+0000 7f2e494b0640 1 --2- 172.21.15.17:0/2422916576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e440cf440 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2e440d3b70 tx=0x7f2e2c02b910 comp rx=0 tx=0).stop 2023-08-09T12:41:17.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.313+0000 7f2e494b0640 1 -- 172.21.15.17:0/2422916576 shutdown_connections 2023-08-09T12:41:17.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.313+0000 7f2e494b0640 1 --2- 172.21.15.17:0/2422916576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e440cf440 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.313+0000 7f2e494b0640 1 --2- 172.21.15.17:0/2422916576 >> v2:172.21.15.142:3300/0 conn(0x7f2e44160030 0x7f2e44160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.313+0000 7f2e494b0640 1 -- 172.21.15.17:0/2422916576 >> 172.21.15.17:0/2422916576 conn(0x7f2e440697c0 msgr2=0x7f2e44069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.313+0000 7f2e494b0640 1 -- 172.21.15.17:0/2422916576 shutdown_connections 2023-08-09T12:41:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.313+0000 7f2e494b0640 1 -- 172.21.15.17:0/2422916576 wait complete. 2023-08-09T12:41:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.314+0000 7f2e494b0640 1 Processor -- start 2023-08-09T12:41:17.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.315+0000 7f2e494b0640 1 -- start start 2023-08-09T12:41:17.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e494b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e4415de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e494b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e440cf980 0x7f2e440ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e494b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e44160030 0x7f2e440abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e494b0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440ad120 con 0x7f2e440b86e0 2023-08-09T12:41:17.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e494b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440ac510 con 0x7f2e44160030 2023-08-09T12:41:17.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e494b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440ac7f0 con 0x7f2e440cf980 2023-08-09T12:41:17.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e43fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e4415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e43fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e4415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34406/0 (socket says 172.21.15.17:34406) 2023-08-09T12:41:17.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e43fff640 1 -- 172.21.15.17:0/1178874187 learned_addr learned my addr 172.21.15.17:0/1178874187 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:17.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e43fff640 1 -- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e440cf980 msgr2=0x7f2e440ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e3b7fe640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e440cf980 0x7f2e440ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e48caf640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e44160030 0x7f2e440abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e43fff640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e440cf980 0x7f2e440ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e43fff640 1 -- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e44160030 msgr2=0x7f2e440abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e43fff640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e44160030 0x7f2e440abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.316+0000 7f2e43fff640 1 -- 172.21.15.17:0/1178874187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c0094d0 con 0x7f2e440b86e0 2023-08-09T12:41:17.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.317+0000 7f2e43fff640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e4415de00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400d5f0 tx=0x7f2e3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:17.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.317+0000 7f2e417fa640 1 -- 172.21.15.17:0/1178874187 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340125f0 con 0x7f2e440b86e0 2023-08-09T12:41:17.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.317+0000 7f2e417fa640 1 -- 172.21.15.17:0/1178874187 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34012750 con 0x7f2e440b86e0 2023-08-09T12:41:17.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.317+0000 7f2e417fa640 1 -- 172.21.15.17:0/1178874187 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34012b00 con 0x7f2e440b86e0 2023-08-09T12:41:17.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.317+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e440acad0 con 0x7f2e440b86e0 2023-08-09T12:41:17.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.317+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e441f2a30 con 0x7f2e440b86e0 2023-08-09T12:41:17.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.318+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e440d0cf0 con 0x7f2e440b86e0 2023-08-09T12:41:17.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.319+0000 7f2e417fa640 1 -- 172.21.15.17:0/1178874187 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2e34012c60 con 0x7f2e440b86e0 2023-08-09T12:41:17.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.320+0000 7f2e417fa640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2e2406a050 0x7f2e2406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.320+0000 7f2e417fa640 1 -- 172.21.15.17:0/1178874187 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2e34088740 con 0x7f2e440b86e0 2023-08-09T12:41:17.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.321+0000 7f2e3b7fe640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2e2406a050 0x7f2e2406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.322+0000 7f2e3b7fe640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2e2406a050 0x7f2e2406c510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c036000 tx=0x7f2e2c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:17.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.325+0000 7f2e417fa640 1 -- 172.21.15.17:0/1178874187 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2e34054140 con 0x7f2e440b86e0 2023-08-09T12:41:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.521+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4404e390 con 0x7f2e440b86e0 2023-08-09T12:41:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.523+0000 7f2e417fa640 1 -- 172.21.15.17:0/1178874187 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14744 (secure 0 0 0) 0x7f2e34057760 con 0x7f2e440b86e0 2023-08-09T12:41:17.527 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:17.527 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:41:13.768459+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/2993081476":"2023-08-10T12:41:10.353597+0000","172.21.15.17:6834/2993081476":"2023-08-10T12:41:10.353597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:17.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2e2406a050 msgr2=0x7f2e2406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2e2406a050 0x7f2e2406c510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c036000 tx=0x7f2e2c03c040 comp rx=0 tx=0).stop 2023-08-09T12:41:17.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 msgr2=0x7f2e4415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e4415de00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400d5f0 tx=0x7f2e3400dab0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 shutdown_connections 2023-08-09T12:41:17.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2e2406a050 0x7f2e2406c510 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e44160030 0x7f2e440abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e440cf980 0x7f2e440ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 --2- 172.21.15.17:0/1178874187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e440b86e0 0x7f2e4415de00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 >> 172.21.15.17:0/1178874187 conn(0x7f2e440697c0 msgr2=0x7f2e440d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:17.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 shutdown_connections 2023-08-09T12:41:17.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.526+0000 7f2e494b0640 1 -- 172.21.15.17:0/1178874187 wait complete. 2023-08-09T12:41:17.548 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:41:17.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:41:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.778+0000 7fe28e97f640 1 Processor -- start 2023-08-09T12:41:17.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.778+0000 7fe28e97f640 1 -- start start 2023-08-09T12:41:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.780+0000 7fe28e97f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe28815a8c0 0x7fe2880b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.780+0000 7fe28e97f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28815e7b0 con 0x7fe2880b13f0 2023-08-09T12:41:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.780+0000 7fe28e97f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2880b1850 con 0x7fe2880b0020 2023-08-09T12:41:17.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.780+0000 7fe28e97f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28815e460 con 0x7fe28815a8c0 2023-08-09T12:41:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.780+0000 7fe28d17c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe2880b13f0 0x7fe28815ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32804/0 (socket says 172.21.15.17:32804) 2023-08-09T12:41:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.780+0000 7fe28d17c640 1 -- 172.21.15.17:0/1927028487 learned_addr learned my addr 172.21.15.17:0/1927028487 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28d97d640 1 --2- 172.21.15.17:0/1927028487 >> v2:172.21.15.142:3300/0 conn(0x7fe28815a8c0 0x7fe2880b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942235392 0 0) 0x7fe28815e7b0 con 0x7fe2880b13f0 2023-08-09T12:41:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe274003520 con 0x7fe2880b13f0 2023-08-09T12:41:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 447949598 0 0) 0x7fe274003520 con 0x7fe2880b13f0 2023-08-09T12:41:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 >> v2:172.21.15.142:3300/0 conn(0x7fe28815a8c0 msgr2=0x7fe2880b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28c97b640 1 --2- 172.21.15.17:0/1927028487 >> v2:172.21.15.142:3300/0 conn(0x7fe28815a8c0 0x7fe2880b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 >> v1:172.21.15.142:6789/0 conn(0x7fe2880b0020 legacy=0x7fe2880c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28815aca0 con 0x7fe2880b13f0 2023-08-09T12:41:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.781+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe278001670 con 0x7fe2880b13f0 2023-08-09T12:41:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 >> v1:172.21.15.17:6789/0 conn(0x7fe2880b13f0 legacy=0x7fe28815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28c97b640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe274003970 0x7fe274003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28c97b640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2740047c0 0x7fe274004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28c97b640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe274005180 0x7fe27400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28815e460 con 0x7fe2740047c0 2023-08-09T12:41:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27400c020 con 0x7fe274005180 2023-08-09T12:41:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27400c1e0 con 0x7fe274003970 2023-08-09T12:41:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28d17c640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2740047c0 0x7fe274004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28d97d640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe274003970 0x7fe274003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28d17c640 1 -- 172.21.15.17:0/1927028487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe274003970 msgr2=0x7fe274003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28d17c640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe274003970 0x7fe274003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28d17c640 1 -- 172.21.15.17:0/1927028487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe274005180 msgr2=0x7fe27400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28d17c640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe274005180 0x7fe27400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28d17c640 1 -- 172.21.15.17:0/1927028487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274003520 con 0x7fe2740047c0 2023-08-09T12:41:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.782+0000 7fe28e17e640 1 -- 172.21.15.17:0/1927028487 reap_dead start 2023-08-09T12:41:17.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.783+0000 7fe28d17c640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2740047c0 0x7fe274004c40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe27800c240 tx=0x7fe2740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5deb96a3b430de58 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:17.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.784+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278005ad0 con 0x7fe2740047c0 2023-08-09T12:41:17.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.784+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe278005c30 con 0x7fe2740047c0 2023-08-09T12:41:17.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.784+0000 7fe28c97b640 1 -- 172.21.15.17:0/1927028487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27802caf0 con 0x7fe2740047c0 2023-08-09T12:41:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.784+0000 7fe28e97f640 1 -- 172.21.15.17:0/1927028487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2740047c0 msgr2=0x7fe274004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.784+0000 7fe28e97f640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2740047c0 0x7fe274004c40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe27800c240 tx=0x7fe2740057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.784+0000 7fe28e97f640 1 -- 172.21.15.17:0/1927028487 shutdown_connections 2023-08-09T12:41:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.784+0000 7fe28e97f640 1 --2- 172.21.15.17:0/1927028487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2740047c0 0x7fe274004c40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.784+0000 7fe28e97f640 1 -- 172.21.15.17:0/1927028487 >> 172.21.15.17:0/1927028487 conn(0x7fe2880cb020 msgr2=0x7fe2880cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.785+0000 7fe28e97f640 1 -- 172.21.15.17:0/1927028487 shutdown_connections 2023-08-09T12:41:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.785+0000 7fe28e97f640 1 -- 172.21.15.17:0/1927028487 wait complete. 2023-08-09T12:41:17.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.786+0000 7fe28e97f640 1 Processor -- start 2023-08-09T12:41:17.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.786+0000 7fe28e97f640 1 -- start start 2023-08-09T12:41:17.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.787+0000 7fe28e97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2740047c0 0x7fe28815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28e97f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe28815b160 0x7fe288159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28e97f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2881596a0 0x7fe2880ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28e97f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2880cc170 con 0x7fe2881596a0 2023-08-09T12:41:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28e97f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28815d060 con 0x7fe2740047c0 2023-08-09T12:41:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28e97f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28815d300 con 0x7fe28815b160 2023-08-09T12:41:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28e17e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2881596a0 0x7fe2880ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28e17e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2881596a0 0x7fe2880ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34424/0 (socket says 172.21.15.17:34424) 2023-08-09T12:41:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28e17e640 1 -- 172.21.15.17:0/1093939221 learned_addr learned my addr 172.21.15.17:0/1093939221 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28d97d640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2740047c0 0x7fe28815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.788+0000 7fe28d17c640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe28815b160 0x7fe288159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28e17e640 1 -- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe28815b160 msgr2=0x7fe288159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28e17e640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe28815b160 0x7fe288159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28e17e640 1 -- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2740047c0 msgr2=0x7fe28815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28e17e640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2740047c0 0x7fe28815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28e17e640 1 -- 172.21.15.17:0/1093939221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28815d5e0 con 0x7fe2881596a0 2023-08-09T12:41:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28d97d640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2740047c0 0x7fe28815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:41:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28e17e640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2881596a0 0x7fe2880ac8b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe2880adfd0 tx=0x7fe28000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe27e7fc640 1 -- 172.21.15.17:0/1093939221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280007070 con 0x7fe2881596a0 2023-08-09T12:41:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe27e7fc640 1 -- 172.21.15.17:0/1093939221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2800071d0 con 0x7fe2881596a0 2023-08-09T12:41:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe27e7fc640 1 -- 172.21.15.17:0/1093939221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280007560 con 0x7fe2881596a0 2023-08-09T12:41:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28815d8c0 con 0x7fe2881596a0 2023-08-09T12:41:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.789+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28815b5c0 con 0x7fe2881596a0 2023-08-09T12:41:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.790+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2880cc2e0 con 0x7fe2881596a0 2023-08-09T12:41:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.792+0000 7fe27e7fc640 1 -- 172.21.15.17:0/1093939221 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2800076c0 con 0x7fe2881596a0 2023-08-09T12:41:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.793+0000 7fe27e7fc640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe26c06a080 0x7fe26c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.793+0000 7fe27e7fc640 1 -- 172.21.15.17:0/1093939221 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe2800876b0 con 0x7fe2881596a0 2023-08-09T12:41:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.793+0000 7fe28d97d640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe26c06a080 0x7fe26c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.794+0000 7fe28d97d640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe26c06a080 0x7fe26c06c540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe28804f440 tx=0x7fe284008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:17.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.797+0000 7fe27e7fc640 1 -- 172.21.15.17:0/1093939221 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe2800530b0 con 0x7fe2881596a0 2023-08-09T12:41:17.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.991+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe28804e390 con 0x7fe2881596a0 2023-08-09T12:41:17.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.992+0000 7fe27e7fc640 1 -- 172.21.15.17:0/1093939221 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2800170a0 con 0x7fe2881596a0 2023-08-09T12:41:17.996 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:41:17.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe26c06a080 msgr2=0x7fe26c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe26c06a080 0x7fe26c06c540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe28804f440 tx=0x7fe284008040 comp rx=0 tx=0).stop 2023-08-09T12:41:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2881596a0 msgr2=0x7fe2880ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2881596a0 0x7fe2880ac8b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe2880adfd0 tx=0x7fe28000c960 comp rx=0 tx=0).stop 2023-08-09T12:41:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 shutdown_connections 2023-08-09T12:41:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe26c06a080 0x7fe26c06c540 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2881596a0 0x7fe2880ac8b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe28815b160 0x7fe288159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 --2- 172.21.15.17:0/1093939221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2740047c0 0x7fe28815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:17.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.994+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 >> 172.21.15.17:0/1093939221 conn(0x7fe2880cb020 msgr2=0x7fe288159c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:17.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.995+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 shutdown_connections 2023-08-09T12:41:17.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:17.995+0000 7fe28e97f640 1 -- 172.21.15.17:0/1093939221 wait complete. 2023-08-09T12:41:18.017 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:41:18.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.247+0000 7efd4e786640 1 Processor -- start 2023-08-09T12:41:18.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.247+0000 7efd4e786640 1 -- start start 2023-08-09T12:41:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.248+0000 7efd4e786640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.249+0000 7efd4e786640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd480cdb00 0x7efd480acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.249+0000 7efd4e786640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd48157580 con 0x7efd48160640 2023-08-09T12:41:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.249+0000 7efd4e786640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4815d1c0 con 0x7efd480cdb00 2023-08-09T12:41:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.249+0000 7efd4e786640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd480b0940 con 0x7efd480b0020 2023-08-09T12:41:18.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.249+0000 7efd4df85640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7efd48160640 0x7efd4815d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60962/0 (socket says 172.21.15.17:60962) 2023-08-09T12:41:18.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.249+0000 7efd4df85640 1 -- 172.21.15.17:0/3079756697 learned_addr learned my addr 172.21.15.17:0/3079756697 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:18.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.249+0000 7efd4cf83640 1 --2- 172.21.15.17:0/3079756697 >> v2:172.21.15.142:3300/0 conn(0x7efd480cdb00 0x7efd480acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.249+0000 7efd4d784640 1 --2- 172.21.15.17:0/3079756697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.250+0000 7efd3ffff640 1 -- 172.21.15.17:0/3079756697 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548041010 0 0) 0x7efd48157580 con 0x7efd48160640 2023-08-09T12:41:18.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.250+0000 7efd3ffff640 1 -- 172.21.15.17:0/3079756697 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd34003520 con 0x7efd48160640 2023-08-09T12:41:18.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.250+0000 7efd3ffff640 1 -- 172.21.15.17:0/3079756697 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672272751 0 0) 0x7efd34003520 con 0x7efd48160640 2023-08-09T12:41:18.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.250+0000 7efd4cf83640 1 -- 172.21.15.17:0/3079756697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 msgr2=0x7efd480b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:18.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.250+0000 7efd4cf83640 1 --2- 172.21.15.17:0/3079756697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.250+0000 7efd4cf83640 1 -- 172.21.15.17:0/3079756697 >> v1:172.21.15.17:6789/0 conn(0x7efd48160640 legacy=0x7efd4815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.250+0000 7efd4cf83640 1 -- 172.21.15.17:0/3079756697 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48160b90 con 0x7efd480cdb00 2023-08-09T12:41:18.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.252+0000 7efd4cf83640 1 --2- 172.21.15.17:0/3079756697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd480cdb00 0x7efd480acd80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd380097a0 tx=0x7efd3802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cb481946a7d33fe server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:18.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.252+0000 7efd3ffff640 1 -- 172.21.15.17:0/3079756697 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400019f0 con 0x7efd480cdb00 2023-08-09T12:41:18.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.252+0000 7efd3ffff640 1 -- 172.21.15.17:0/3079756697 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3802e050 con 0x7efd480cdb00 2023-08-09T12:41:18.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.252+0000 7efd3ffff640 1 -- 172.21.15.17:0/3079756697 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38030730 con 0x7efd480cdb00 2023-08-09T12:41:18.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.253+0000 7efd4e786640 1 -- 172.21.15.17:0/3079756697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd480cdb00 msgr2=0x7efd480acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.253+0000 7efd4e786640 1 --2- 172.21.15.17:0/3079756697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd480cdb00 0x7efd480acd80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd380097a0 tx=0x7efd3802b790 comp rx=0 tx=0).stop 2023-08-09T12:41:18.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.253+0000 7efd4e786640 1 -- 172.21.15.17:0/3079756697 shutdown_connections 2023-08-09T12:41:18.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.253+0000 7efd4e786640 1 --2- 172.21.15.17:0/3079756697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd480cdb00 0x7efd480acd80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.253+0000 7efd4e786640 1 --2- 172.21.15.17:0/3079756697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.253+0000 7efd4e786640 1 -- 172.21.15.17:0/3079756697 >> 172.21.15.17:0/3079756697 conn(0x7efd480cb020 msgr2=0x7efd480cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:18.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.253+0000 7efd4e786640 1 -- 172.21.15.17:0/3079756697 shutdown_connections 2023-08-09T12:41:18.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.253+0000 7efd4e786640 1 -- 172.21.15.17:0/3079756697 wait complete. 2023-08-09T12:41:18.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.255+0000 7efd4e786640 1 Processor -- start 2023-08-09T12:41:18.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.255+0000 7efd4e786640 1 -- start start 2023-08-09T12:41:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4e786640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4e786640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd480cdb00 0x7efd481543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48160640 0x7efd48154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4e786640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481f6880 con 0x7efd480cdb00 2023-08-09T12:41:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4e786640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480ae900 con 0x7efd48160640 2023-08-09T12:41:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4e786640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd480aebe0 con 0x7efd480b0020 2023-08-09T12:41:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4cf83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd480cdb00 0x7efd481543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4cf83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd480cdb00 0x7efd481543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40650/0 (socket says 172.21.15.17:40650) 2023-08-09T12:41:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4cf83640 1 -- 172.21.15.17:0/2943788948 learned_addr learned my addr 172.21.15.17:0/2943788948 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4d784640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4df85640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48160640 0x7efd48154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.256+0000 7efd4cf83640 1 -- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 msgr2=0x7efd480af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd4cf83640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd4cf83640 1 -- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48160640 msgr2=0x7efd48154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd4cf83640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48160640 0x7efd48154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd4cf83640 1 -- 172.21.15.17:0/2943788948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd38009400 con 0x7efd480cdb00 2023-08-09T12:41:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd4d784640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd4cf83640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd480cdb00 0x7efd481543c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efd380098c0 tx=0x7efd380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd3dffb640 1 -- 172.21.15.17:0/2943788948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3803d890 con 0x7efd480cdb00 2023-08-09T12:41:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd3dffb640 1 -- 172.21.15.17:0/2943788948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3803d9f0 con 0x7efd480cdb00 2023-08-09T12:41:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd3dffb640 1 -- 172.21.15.17:0/2943788948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3803dd80 con 0x7efd480cdb00 2023-08-09T12:41:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.257+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd480aeec0 con 0x7efd480cdb00 2023-08-09T12:41:18.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.258+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd480af480 con 0x7efd480cdb00 2023-08-09T12:41:18.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.259+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4804e390 con 0x7efd480cdb00 2023-08-09T12:41:18.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.260+0000 7efd3dffb640 1 -- 172.21.15.17:0/2943788948 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd38039040 con 0x7efd480cdb00 2023-08-09T12:41:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.261+0000 7efd3dffb640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd2c06a050 0x7efd2c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.261+0000 7efd3dffb640 1 -- 172.21.15.17:0/2943788948 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7efd380aa1f0 con 0x7efd480cdb00 2023-08-09T12:41:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.261+0000 7efd4d784640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd2c06a050 0x7efd2c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.262+0000 7efd4d784640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd2c06a050 0x7efd2c06c510 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efd44009a20 tx=0x7efd44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:18.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.265+0000 7efd3dffb640 1 -- 172.21.15.17:0/2943788948 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efd38075d10 con 0x7efd480cdb00 2023-08-09T12:41:18.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.457+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd480cb620 con 0x7efd480cdb00 2023-08-09T12:41:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.458+0000 7efd3dffb640 1 -- 172.21.15.17:0/2943788948 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd38079330 con 0x7efd480cdb00 2023-08-09T12:41:18.461 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:41:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd2c06a050 msgr2=0x7efd2c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd2c06a050 0x7efd2c06c510 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efd44009a20 tx=0x7efd44008040 comp rx=0 tx=0).stop 2023-08-09T12:41:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd480cdb00 msgr2=0x7efd481543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd480cdb00 0x7efd481543c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efd380098c0 tx=0x7efd380046c0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 shutdown_connections 2023-08-09T12:41:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd2c06a050 0x7efd2c06c510 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd48160640 0x7efd48154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd480cdb00 0x7efd481543c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 --2- 172.21.15.17:0/2943788948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd480b0020 0x7efd480af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 >> 172.21.15.17:0/2943788948 conn(0x7efd480cb020 msgr2=0x7efd480cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:18.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.461+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 shutdown_connections 2023-08-09T12:41:18.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.462+0000 7efd4e786640 1 -- 172.21.15.17:0/2943788948 wait complete. 2023-08-09T12:41:18.483 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:41:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.714+0000 7f60cb8ee640 1 Processor -- start 2023-08-09T12:41:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.714+0000 7f60cb8ee640 1 -- start start 2023-08-09T12:41:18.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.716+0000 7f60cb8ee640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60c40ce9e0 0x7f60c40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.716+0000 7f60cb8ee640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f60c415b160 0x7f60c415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.716+0000 7f60cb8ee640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c40cf380 con 0x7f60c4158840 2023-08-09T12:41:18.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.716+0000 7f60cb8ee640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c4158c20 con 0x7f60c415b160 2023-08-09T12:41:18.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.716+0000 7f60cb8ee640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c40b0220 con 0x7f60c40ce9e0 2023-08-09T12:41:18.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.716+0000 7f60c9e8b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f60c415b160 0x7f60c415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.716+0000 7f60c9e8b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f60c415b160 0x7f60c415b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40664/0 (socket says 172.21.15.17:40664) 2023-08-09T12:41:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.716+0000 7f60c9e8b640 1 -- 172.21.15.17:0/3262477549 learned_addr learned my addr 172.21.15.17:0/3262477549 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.717+0000 7f60c8e89640 1 --2- 172.21.15.17:0/3262477549 >> v2:172.21.15.142:3300/0 conn(0x7f60c40ce9e0 0x7f60c40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.717+0000 7f60c9e8b640 1 -- 172.21.15.17:0/3262477549 >> v2:172.21.15.142:3300/0 conn(0x7f60c40ce9e0 msgr2=0x7f60c40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.717+0000 7f60c9e8b640 1 --2- 172.21.15.17:0/3262477549 >> v2:172.21.15.142:3300/0 conn(0x7f60c40ce9e0 0x7f60c40cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.717+0000 7f60c9e8b640 1 -- 172.21.15.17:0/3262477549 >> v1:172.21.15.142:6789/0 conn(0x7f60c4158840 legacy=0x7f60c40af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.717+0000 7f60c9e8b640 1 -- 172.21.15.17:0/3262477549 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c415e7f0 con 0x7f60c415b160 2023-08-09T12:41:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.717+0000 7f60c8e89640 1 --2- 172.21.15.17:0/3262477549 >> v2:172.21.15.142:3300/0 conn(0x7f60c40ce9e0 0x7f60c40cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:18.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.718+0000 7f60c9e8b640 1 --2- 172.21.15.17:0/3262477549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c415b160 0x7f60c415b5f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f60c40cc2c0 tx=0x7f60bc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acc2f15bb2048b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:18.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.718+0000 7f60bbfff640 1 -- 172.21.15.17:0/3262477549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc02ca80 con 0x7f60c415b160 2023-08-09T12:41:18.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.718+0000 7f60bbfff640 1 -- 172.21.15.17:0/3262477549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc02cbe0 con 0x7f60c415b160 2023-08-09T12:41:18.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.718+0000 7f60bbfff640 1 -- 172.21.15.17:0/3262477549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0343f0 con 0x7f60c415b160 2023-08-09T12:41:18.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.719+0000 7f60cb8ee640 1 -- 172.21.15.17:0/3262477549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c415b160 msgr2=0x7f60c415b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.719+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/3262477549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c415b160 0x7f60c415b5f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f60c40cc2c0 tx=0x7f60bc02bee0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.719+0000 7f60cb8ee640 1 -- 172.21.15.17:0/3262477549 shutdown_connections 2023-08-09T12:41:18.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.719+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/3262477549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c415b160 0x7f60c415b5f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.719+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/3262477549 >> v2:172.21.15.142:3300/0 conn(0x7f60c40ce9e0 0x7f60c40cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.719+0000 7f60cb8ee640 1 -- 172.21.15.17:0/3262477549 >> 172.21.15.17:0/3262477549 conn(0x7f60c4069be0 msgr2=0x7f60c4069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:18.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.719+0000 7f60cb8ee640 1 -- 172.21.15.17:0/3262477549 shutdown_connections 2023-08-09T12:41:18.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.719+0000 7f60cb8ee640 1 -- 172.21.15.17:0/3262477549 wait complete. 2023-08-09T12:41:18.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.721+0000 7f60cb8ee640 1 Processor -- start 2023-08-09T12:41:18.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.721+0000 7f60cb8ee640 1 -- start start 2023-08-09T12:41:18.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.722+0000 7f60cb8ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c40ce9e0 0x7f60c40cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.722+0000 7f60cb8ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c4158840 0x7f60c414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.722+0000 7f60cb8ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c415b160 0x7f60c40cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.722+0000 7f60cb8ee640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40cc330 con 0x7f60c40ce9e0 2023-08-09T12:41:18.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.722+0000 7f60cb8ee640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40cc5a0 con 0x7f60c4158840 2023-08-09T12:41:18.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.722+0000 7f60cb8ee640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40cc880 con 0x7f60c415b160 2023-08-09T12:41:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c968a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c40ce9e0 0x7f60c40cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c968a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c40ce9e0 0x7f60c40cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40678/0 (socket says 172.21.15.17:40678) 2023-08-09T12:41:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c968a640 1 -- 172.21.15.17:0/4268623681 learned_addr learned my addr 172.21.15.17:0/4268623681 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c8e89640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c4158840 0x7f60c414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c968a640 1 -- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c415b160 msgr2=0x7f60c40cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c968a640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c415b160 0x7f60c40cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c968a640 1 -- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c4158840 msgr2=0x7f60c414b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c968a640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c4158840 0x7f60c414b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.723+0000 7f60c968a640 1 -- 172.21.15.17:0/4268623681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc009b30 con 0x7f60c40ce9e0 2023-08-09T12:41:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.724+0000 7f60c968a640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c40ce9e0 0x7f60c40cd080 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c410 tx=0x7f60c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.724+0000 7f60b9ffb640 1 -- 172.21.15.17:0/4268623681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00035f0 con 0x7f60c40ce9e0 2023-08-09T12:41:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.724+0000 7f60b9ffb640 1 -- 172.21.15.17:0/4268623681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0003750 con 0x7f60c40ce9e0 2023-08-09T12:41:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.724+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c40ccb60 con 0x7f60c40ce9e0 2023-08-09T12:41:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.724+0000 7f60b9ffb640 1 -- 172.21.15.17:0/4268623681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0003b40 con 0x7f60c40ce9e0 2023-08-09T12:41:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.724+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c40cdff0 con 0x7f60c40ce9e0 2023-08-09T12:41:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.725+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c40ccda0 con 0x7f60c40ce9e0 2023-08-09T12:41:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.726+0000 7f60b9ffb640 1 -- 172.21.15.17:0/4268623681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60c0003ca0 con 0x7f60c40ce9e0 2023-08-09T12:41:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.727+0000 7f60b9ffb640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f60a806a050 0x7f60a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.727+0000 7f60b9ffb640 1 -- 172.21.15.17:0/4268623681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f60c0087570 con 0x7f60c40ce9e0 2023-08-09T12:41:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.728+0000 7f60c8e89640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f60a806a050 0x7f60a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.729+0000 7f60c8e89640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f60a806a050 0x7f60a806c510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f60c4071060 tx=0x7f60b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:18.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.732+0000 7f60b9ffb640 1 -- 172.21.15.17:0/4268623681 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f60c40ccda0 con 0x7f60c40ce9e0 2023-08-09T12:41:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.926+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f60c40ccda0 con 0x7f60c40ce9e0 2023-08-09T12:41:18.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.935+0000 7f60b9ffb640 1 -- 172.21.15.17:0/4268623681 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f60c0052ee0 con 0x7f60c40ce9e0 2023-08-09T12:41:18.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.937+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f60a806a050 msgr2=0x7f60a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.937+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f60a806a050 0x7f60a806c510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f60c4071060 tx=0x7f60b4008040 comp rx=0 tx=0).stop 2023-08-09T12:41:18.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.937+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c40ce9e0 msgr2=0x7f60c40cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:18.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.937+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c40ce9e0 0x7f60c40cd080 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c410 tx=0x7f60c000c8d0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.938+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 shutdown_connections 2023-08-09T12:41:18.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.938+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f60a806a050 0x7f60a806c510 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.938+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c415b160 0x7f60c40cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.938+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c4158840 0x7f60c414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.938+0000 7f60cb8ee640 1 --2- 172.21.15.17:0/4268623681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c40ce9e0 0x7f60c40cd080 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:18.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.938+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 >> 172.21.15.17:0/4268623681 conn(0x7f60c4069be0 msgr2=0x7f60c40b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:18.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.938+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 shutdown_connections 2023-08-09T12:41:18.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:18.938+0000 7f60cb8ee640 1 -- 172.21.15.17:0/4268623681 wait complete. 2023-08-09T12:41:18.960 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:41:18.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:41:19.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:41:19.226 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:41:19.227 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:41:19.227 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:19.293 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:41:19.293 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:41:19.294 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:19.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:41:19.356 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:41:19.356 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:19.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:41:19.422 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:41:19.422 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:19.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:41:19.484 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:41:19.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:19.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.717+0000 7f3d51e7c640 1 Processor -- start 2023-08-09T12:41:19.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.717+0000 7f3d51e7c640 1 -- start start 2023-08-09T12:41:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.718+0000 7f3d51e7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d4c0b3b40 0x7f3d4c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d51e7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0cc630 0x7f3d4c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d51e7c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c06c990 con 0x7f3d4c0adc40 2023-08-09T12:41:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d51e7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c0ae020 con 0x7f3d4c0b3b40 2023-08-09T12:41:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d51e7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b2250 con 0x7f3d4c0cc630 2023-08-09T12:41:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d4b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3d4c0adc40 0x7f3d4c06c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60970/0 (socket says 172.21.15.17:60970) 2023-08-09T12:41:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d4b7fe640 1 -- 172.21.15.17:0/3415336391 learned_addr learned my addr 172.21.15.17:0/3415336391 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:19.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995135751 0 0) 0x7f3d4c06c990 con 0x7f3d4c0adc40 2023-08-09T12:41:19.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d38003520 con 0x7f3d4c0adc40 2023-08-09T12:41:19.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d4bfff640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0cc630 0x7f3d4c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.719+0000 7f3d42ffd640 1 --2- 172.21.15.17:0/3415336391 >> v2:172.21.15.142:3300/0 conn(0x7f3d4c0b3b40 0x7f3d4c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901297371 0 0) 0x7f3d38003520 con 0x7f3d4c0adc40 2023-08-09T12:41:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0cc630 msgr2=0x7f3d4c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0cc630 0x7f3d4c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 >> v2:172.21.15.142:3300/0 conn(0x7f3d4c0b3b40 msgr2=0x7f3d4c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 --2- 172.21.15.17:0/3415336391 >> v2:172.21.15.142:3300/0 conn(0x7f3d4c0b3b40 0x7f3d4c0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0b2530 con 0x7f3d4c0adc40 2023-08-09T12:41:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f3d3c001670 con 0x7f3d4c0adc40 2023-08-09T12:41:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 >> v1:172.21.15.17:6789/0 conn(0x7f3d4c0adc40 legacy=0x7f3d4c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38003970 0x7f3d38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0cc630 0x7f3d380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d38004d00 0x7f3d38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0ae020 con 0x7f3d38004d00 2023-08-09T12:41:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b2250 con 0x7f3d38003970 2023-08-09T12:41:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3800ba30 con 0x7f3d4c0cc630 2023-08-09T12:41:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4bfff640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d38004d00 0x7f3d38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.720+0000 7f3d4b7fe640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38003970 0x7f3d38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.721+0000 7f3d42ffd640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0cc630 0x7f3d380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.721+0000 7f3d4bfff640 1 -- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0cc630 msgr2=0x7f3d380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.721+0000 7f3d4bfff640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0cc630 0x7f3d380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.721+0000 7f3d4bfff640 1 -- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38003970 msgr2=0x7f3d38003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.721+0000 7f3d4bfff640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38003970 0x7f3d38003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.721+0000 7f3d4bfff640 1 -- 172.21.15.17:0/3415336391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38003520 con 0x7f3d38004d00 2023-08-09T12:41:19.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.722+0000 7f3d4bfff640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d38004d00 0x7f3d38005180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400ba60 tx=0x7f3d380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a004490a72c6e6d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:19.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.722+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44032630 con 0x7f3d38004d00 2023-08-09T12:41:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.722+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d44032790 con 0x7f3d38004d00 2023-08-09T12:41:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.722+0000 7f3d4affd640 1 -- 172.21.15.17:0/3415336391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44032b20 con 0x7f3d38004d00 2023-08-09T12:41:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.723+0000 7f3d51e7c640 1 -- 172.21.15.17:0/3415336391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d38004d00 msgr2=0x7f3d38005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.723+0000 7f3d51e7c640 1 --2- 172.21.15.17:0/3415336391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d38004d00 0x7f3d38005180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400ba60 tx=0x7f3d380057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.723+0000 7f3d4bfff640 1 -- 172.21.15.17:0/3415336391 reap_dead start 2023-08-09T12:41:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.723+0000 7f3d51e7c640 1 -- 172.21.15.17:0/3415336391 shutdown_connections 2023-08-09T12:41:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.723+0000 7f3d51e7c640 1 -- 172.21.15.17:0/3415336391 >> 172.21.15.17:0/3415336391 conn(0x7f3d4c0cb1b0 msgr2=0x7f3d4c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.723+0000 7f3d51e7c640 1 -- 172.21.15.17:0/3415336391 shutdown_connections 2023-08-09T12:41:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.723+0000 7f3d51e7c640 1 -- 172.21.15.17:0/3415336391 wait complete. 2023-08-09T12:41:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.725+0000 7f3d51e7c640 1 Processor -- start 2023-08-09T12:41:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.725+0000 7f3d51e7c640 1 -- start start 2023-08-09T12:41:19.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d51e7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38004d00 0x7f3d4c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d51e7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d4c0c21d0 0x7f3d4c0c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d51e7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c14c280 0x7f3d4c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d51e7c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c2670 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d51e7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c2950 con 0x7f3d38004d00 2023-08-09T12:41:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d51e7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0c2c30 con 0x7f3d4c14c280 2023-08-09T12:41:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d4c0c21d0 0x7f3d4c0c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d4c0c21d0 0x7f3d4c0c4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40702/0 (socket says 172.21.15.17:40702) 2023-08-09T12:41:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.726+0000 7f3d42ffd640 1 -- 172.21.15.17:0/2723044697 learned_addr learned my addr 172.21.15.17:0/2723044697 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d4b7fe640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38004d00 0x7f3d4c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d4bfff640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c14c280 0x7f3d4c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d42ffd640 1 -- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c14c280 msgr2=0x7f3d4c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d42ffd640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c14c280 0x7f3d4c0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d42ffd640 1 -- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38004d00 msgr2=0x7f3d4c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d42ffd640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38004d00 0x7f3d4c0c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d42ffd640 1 -- 172.21.15.17:0/2723044697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0c2f10 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d4bfff640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c14c280 0x7f3d4c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d4b7fe640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38004d00 0x7f3d4c0c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d42ffd640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d4c0c21d0 0x7f3d4c0c4c20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3d34004670 tx=0x7f3d34007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d48ff9640 1 -- 172.21.15.17:0/2723044697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34014610 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d48ff9640 1 -- 172.21.15.17:0/2723044697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400f050 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.727+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c0c31f0 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.728+0000 7f3d48ff9640 1 -- 172.21.15.17:0/2723044697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34014990 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.728+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c14c730 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.729+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c067a80 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.730+0000 7f3d48ff9640 1 -- 172.21.15.17:0/2723044697 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d34014af0 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.730+0000 7f3d48ff9640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d2c06a050 0x7f3d2c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.731+0000 7f3d48ff9640 1 -- 172.21.15.17:0/2723044697 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3d34088da0 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.731+0000 7f3d4b7fe640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d2c06a050 0x7f3d2c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.732+0000 7f3d4b7fe640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d2c06a050 0x7f3d2c06c510 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c005990 tx=0x7f3d3c000f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.735+0000 7f3d48ff9640 1 -- 172.21.15.17:0/2723044697 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3d340547d0 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.968+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d4c0ce000 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.969+0000 7f3d48ff9640 1 -- 172.21.15.17:0/2723044697 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f3d34057df0 con 0x7f3d4c0c21d0 2023-08-09T12:41:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:19.973 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3935417097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3935417097},{"type":"v1","addr":"172.21.15.142:6837","nonce":3935417097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/79653418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":79653418},{"type":"v1","addr":"172.21.15.142:6836","nonce":79653418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2709020958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2709020958},{"type":"v1","addr":"172.21.15.17:6833","nonce":2709020958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5586,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3418601090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3418601090},{"type":"v1","addr":"172.21.15.17:6835","nonce":3418601090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-08-09T12:41:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 19 2023-08-09T12:41:19.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d2c06a050 msgr2=0x7f3d2c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:19.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d2c06a050 0x7f3d2c06c510 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c005990 tx=0x7f3d3c000f50 comp rx=0 tx=0).stop 2023-08-09T12:41:19.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d4c0c21d0 msgr2=0x7f3d4c0c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:19.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d4c0c21d0 0x7f3d4c0c4c20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3d34004670 tx=0x7f3d34007700 comp rx=0 tx=0).stop 2023-08-09T12:41:19.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 shutdown_connections 2023-08-09T12:41:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d2c06a050 0x7f3d2c06c510 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c14c280 0x7f3d4c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d4c0c21d0 0x7f3d4c0c4c20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.972+0000 7f3d51e7c640 1 --2- 172.21.15.17:0/2723044697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d38004d00 0x7f3d4c0c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.973+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 >> 172.21.15.17:0/2723044697 conn(0x7f3d4c0cb1b0 msgr2=0x7f3d4c0acfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.973+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 shutdown_connections 2023-08-09T12:41:19.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:19.973+0000 7f3d51e7c640 1 -- 172.21.15.17:0/2723044697 wait complete. 2023-08-09T12:41:19.994 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:41:19.994 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:41:19.995 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:41:19.995 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:41:19.995 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:41:19.995 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:41:19.995 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:41:19.996 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:41:19.996 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:41:19.996 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:41:19.996 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:41:19.997 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:41:19.997 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:41:19.997 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:41:19.997 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:41:19.997 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:41:20.010 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:41:20.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:41:20.012 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:41:20.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:41:20.020 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:41:20.020 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:41:20.022 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:41:20.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:41:20.061 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:41:20.061 DEBUG:teuthology.parallel:result is None 2023-08-09T12:41:20.069 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:41:20.069 DEBUG:teuthology.parallel:result is None 2023-08-09T12:41:20.070 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:41:20.070 DEBUG:teuthology.parallel:result is None 2023-08-09T12:41:20.077 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:41:20.077 DEBUG:teuthology.parallel:result is None 2023-08-09T12:41:20.078 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:41:20.225 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:41:20.234 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:41:20.235 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:41:20.247 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:41:20.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.271+0000 7fe40c1c8640 1 Processor -- start 2023-08-09T12:41:20.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.271+0000 7fe40c1c8640 1 -- start start 2023-08-09T12:41:20.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.272+0000 7fe40c1c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4041616e0 0x7fe4040b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:20.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.272+0000 7fe40c1c8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4040cdd10 con 0x7fe4040d29d0 2023-08-09T12:41:20.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.272+0000 7fe40c1c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4040cdff0 con 0x7fe40415ce90 2023-08-09T12:41:20.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.272+0000 7fe40c1c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040b6540 con 0x7fe4041616e0 2023-08-09T12:41:20.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe40a765640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe4040d29d0 0x7fe4040d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60986/0 (socket says 172.21.15.17:60986) 2023-08-09T12:41:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe40a765640 1 -- 172.21.15.17:0/713743344 learned_addr learned my addr 172.21.15.17:0/713743344 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe409763640 1 --2- 172.21.15.17:0/713743344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4041616e0 0x7fe4040b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe408f62640 1 -- 172.21.15.17:0/713743344 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944545804 0 0) 0x7fe4040cdd10 con 0x7fe4040d29d0 2023-08-09T12:41:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe408f62640 1 -- 172.21.15.17:0/713743344 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f0003520 con 0x7fe4040d29d0 2023-08-09T12:41:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe408f62640 1 -- 172.21.15.17:0/713743344 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179996136 0 0) 0x7fe4040cdff0 con 0x7fe40415ce90 2023-08-09T12:41:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe408f62640 1 -- 172.21.15.17:0/713743344 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4040cdd10 con 0x7fe40415ce90 2023-08-09T12:41:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe409763640 1 -- 172.21.15.17:0/713743344 >> v1:172.21.15.142:6789/0 conn(0x7fe40415ce90 legacy=0x7fe4040cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:20.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe409763640 1 -- 172.21.15.17:0/713743344 >> v1:172.21.15.17:6789/0 conn(0x7fe4040d29d0 legacy=0x7fe4040d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:20.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.273+0000 7fe409763640 1 -- 172.21.15.17:0/713743344 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040ce2d0 con 0x7fe4041616e0 2023-08-09T12:41:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.275+0000 7fe409763640 1 --2- 172.21.15.17:0/713743344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4041616e0 0x7fe4040b6000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40097d0 tx=0x7fe3f402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33cbf648d7fd4488 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.275+0000 7fe408f62640 1 -- 172.21.15.17:0/713743344 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4031890 con 0x7fe4041616e0 2023-08-09T12:41:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.275+0000 7fe408f62640 1 -- 172.21.15.17:0/713743344 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f40319f0 con 0x7fe4041616e0 2023-08-09T12:41:20.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.275+0000 7fe408f62640 1 -- 172.21.15.17:0/713743344 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4031d80 con 0x7fe4041616e0 2023-08-09T12:41:20.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.275+0000 7fe40c1c8640 1 -- 172.21.15.17:0/713743344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4041616e0 msgr2=0x7fe4040b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:20.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.275+0000 7fe40c1c8640 1 --2- 172.21.15.17:0/713743344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4041616e0 0x7fe4040b6000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40097d0 tx=0x7fe3f402b930 comp rx=0 tx=0).stop 2023-08-09T12:41:20.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.276+0000 7fe40c1c8640 1 -- 172.21.15.17:0/713743344 shutdown_connections 2023-08-09T12:41:20.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.276+0000 7fe40c1c8640 1 --2- 172.21.15.17:0/713743344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4041616e0 0x7fe4040b6000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:20.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.276+0000 7fe40c1c8640 1 -- 172.21.15.17:0/713743344 >> 172.21.15.17:0/713743344 conn(0x7fe40406fde0 msgr2=0x7fe4040701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:20.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.276+0000 7fe40c1c8640 1 -- 172.21.15.17:0/713743344 shutdown_connections 2023-08-09T12:41:20.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.276+0000 7fe40c1c8640 1 -- 172.21.15.17:0/713743344 wait complete. 2023-08-09T12:41:20.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.277+0000 7fe40c1c8640 1 Processor -- start 2023-08-09T12:41:20.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.278+0000 7fe40c1c8640 1 -- start start 2023-08-09T12:41:20.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.278+0000 7fe40c1c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4040d29d0 0x7fe40415f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe40c1c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe40415ce90 0x7fe4040b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe40c1c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4041616e0 0x7fe404156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:20.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe40c1c8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040a9670 con 0x7fe4040d29d0 2023-08-09T12:41:20.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe40c1c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040b4300 con 0x7fe4041616e0 2023-08-09T12:41:20.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe40c1c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040b3000 con 0x7fe40415ce90 2023-08-09T12:41:20.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409f64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4040d29d0 0x7fe40415f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:20.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409f64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4040d29d0 0x7fe40415f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40748/0 (socket says 172.21.15.17:40748) 2023-08-09T12:41:20.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409f64640 1 -- 172.21.15.17:0/158056101 learned_addr learned my addr 172.21.15.17:0/158056101 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe40a765640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4041616e0 0x7fe404156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409763640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe40415ce90 0x7fe4040b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409f64640 1 -- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe40415ce90 msgr2=0x7fe4040b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409f64640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe40415ce90 0x7fe4040b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409f64640 1 -- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4041616e0 msgr2=0x7fe404156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409f64640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4041616e0 0x7fe404156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.279+0000 7fe409f64640 1 -- 172.21.15.17:0/158056101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f4009400 con 0x7fe4040d29d0 2023-08-09T12:41:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.280+0000 7fe409f64640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4040d29d0 0x7fe40415f3c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe40000c490 tx=0x7fe40000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:20.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.280+0000 7fe3fa7fc640 1 -- 172.21.15.17:0/158056101 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000052d0 con 0x7fe4040d29d0 2023-08-09T12:41:20.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.280+0000 7fe3fa7fc640 1 -- 172.21.15.17:0/158056101 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe400005430 con 0x7fe4040d29d0 2023-08-09T12:41:20.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.280+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4040b32e0 con 0x7fe4040d29d0 2023-08-09T12:41:20.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.280+0000 7fe3fa7fc640 1 -- 172.21.15.17:0/158056101 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400012870 con 0x7fe4040d29d0 2023-08-09T12:41:20.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.280+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4040b38a0 con 0x7fe4040d29d0 2023-08-09T12:41:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.281+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4040b3a90 con 0x7fe4040d29d0 2023-08-09T12:41:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.282+0000 7fe3fa7fc640 1 -- 172.21.15.17:0/158056101 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4000129d0 con 0x7fe4040d29d0 2023-08-09T12:41:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.284+0000 7fe3fa7fc640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe3e806a050 0x7fe3e806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.284+0000 7fe3fa7fc640 1 -- 172.21.15.17:0/158056101 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe400087e80 con 0x7fe4040d29d0 2023-08-09T12:41:20.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.285+0000 7fe409763640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe3e806a050 0x7fe3e806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:20.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.286+0000 7fe409763640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe3e806a050 0x7fe3e806c510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4036000 tx=0x7fe3f403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.288+0000 7fe3fa7fc640 1 -- 172.21.15.17:0/158056101 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe400053810 con 0x7fe4040d29d0 2023-08-09T12:41:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.493+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe404067a80 con 0x7fe4040d29d0 2023-08-09T12:41:20.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.960+0000 7fe3fa7fc640 1 -- 172.21.15.17:0/158056101 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe400056e30 con 0x7fe4040d29d0 2023-08-09T12:41:20.964 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:41:20.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe3e806a050 msgr2=0x7fe3e806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:20.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe3e806a050 0x7fe3e806c510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4036000 tx=0x7fe3f403c040 comp rx=0 tx=0).stop 2023-08-09T12:41:20.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4040d29d0 msgr2=0x7fe40415f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:20.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4040d29d0 0x7fe40415f3c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe40000c490 tx=0x7fe40000c950 comp rx=0 tx=0).stop 2023-08-09T12:41:20.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 shutdown_connections 2023-08-09T12:41:20.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe3e806a050 0x7fe3e806c510 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:20.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4041616e0 0x7fe404156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:20.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe40415ce90 0x7fe4040b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:20.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 --2- 172.21.15.17:0/158056101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4040d29d0 0x7fe40415f3c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:20.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 >> 172.21.15.17:0/158056101 conn(0x7fe40406fde0 msgr2=0x7fe4040d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:20.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.964+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 shutdown_connections 2023-08-09T12:41:20.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:20.965+0000 7fe40c1c8640 1 -- 172.21.15.17:0/158056101 wait complete. 2023-08-09T12:41:20.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:41:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.215+0000 7f1f1c999640 1 Processor -- start 2023-08-09T12:41:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.215+0000 7f1f1c999640 1 -- start start 2023-08-09T12:41:21.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.216+0000 7f1f1c999640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f18161280 0x7f1f180c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.216+0000 7f1f1c999640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f18161660 0x7f1f180ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.216+0000 7f1f1c999640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1815df30 con 0x7f1f180ca450 2023-08-09T12:41:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.216+0000 7f1f1c999640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1815d430 con 0x7f1f18161280 2023-08-09T12:41:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.216+0000 7f1f1c999640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180ca9d0 con 0x7f1f18161660 2023-08-09T12:41:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.217+0000 7f1f16d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1f180ca450 0x7f1f180c8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60998/0 (socket says 172.21.15.17:60998) 2023-08-09T12:41:21.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.217+0000 7f1f16d9d640 1 -- 172.21.15.17:0/2352388314 learned_addr learned my addr 172.21.15.17:0/2352388314 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.217+0000 7f1f15d9b640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f18161660 0x7f1f180ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.217+0000 7f1f1659c640 1 --2- 172.21.15.17:0/2352388314 >> v2:172.21.15.142:3300/0 conn(0x7f1f18161280 0x7f1f180c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.217+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865938780 0 0) 0x7f1f1815df30 con 0x7f1f180ca450 2023-08-09T12:41:21.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.217+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f04003520 con 0x7f1f180ca450 2023-08-09T12:41:21.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3293198727 0 0) 0x7f1f04003520 con 0x7f1f180ca450 2023-08-09T12:41:21.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f18161660 msgr2=0x7f1f180ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:21.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f18161660 0x7f1f180ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 >> v2:172.21.15.142:3300/0 conn(0x7f1f18161280 msgr2=0x7f1f180c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:21.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 --2- 172.21.15.17:0/2352388314 >> v2:172.21.15.142:3300/0 conn(0x7f1f18161280 0x7f1f180c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1815e3c0 con 0x7f1f180ca450 2023-08-09T12:41:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1f10001670 con 0x7f1f180ca450 2023-08-09T12:41:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 >> v1:172.21.15.17:6789/0 conn(0x7f1f180ca450 legacy=0x7f1f180c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f04003970 0x7f1f04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f18161660 0x7f1f040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04004d00 0x7f1f04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180ca9d0 con 0x7f1f04004d00 2023-08-09T12:41:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0400b980 con 0x7f1f04003970 2023-08-09T12:41:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.218+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0400baf0 con 0x7f1f18161660 2023-08-09T12:41:21.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.219+0000 7f1f16d9d640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04004d00 0x7f1f04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.219+0000 7f1f15d9b640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f18161660 0x7f1f040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.219+0000 7f1f16d9d640 1 -- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f18161660 msgr2=0x7f1f040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:21.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.219+0000 7f1f16d9d640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f18161660 0x7f1f040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.219+0000 7f1f16d9d640 1 -- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f04003970 msgr2=0x7f1f04003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:21.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.219+0000 7f1f16d9d640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f04003970 0x7f1f04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.219+0000 7f1f16d9d640 1 -- 172.21.15.17:0/2352388314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04003520 con 0x7f1f04004d00 2023-08-09T12:41:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.220+0000 7f1f16d9d640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04004d00 0x7f1f04005180 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000c210 tx=0x7f1f040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd0898c0aadd975 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.221+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10005ad0 con 0x7f1f04004d00 2023-08-09T12:41:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.221+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f10005c30 con 0x7f1f04004d00 2023-08-09T12:41:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.221+0000 7f1f1559a640 1 -- 172.21.15.17:0/2352388314 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1002c8d0 con 0x7f1f04004d00 2023-08-09T12:41:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.221+0000 7f1f1c999640 1 -- 172.21.15.17:0/2352388314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04004d00 msgr2=0x7f1f04005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.221+0000 7f1f1c999640 1 --2- 172.21.15.17:0/2352388314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04004d00 0x7f1f04005180 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000c210 tx=0x7f1f040057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.221+0000 7f1f16d9d640 1 -- 172.21.15.17:0/2352388314 reap_dead start 2023-08-09T12:41:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.222+0000 7f1f1c999640 1 -- 172.21.15.17:0/2352388314 shutdown_connections 2023-08-09T12:41:21.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.222+0000 7f1f1c999640 1 -- 172.21.15.17:0/2352388314 >> 172.21.15.17:0/2352388314 conn(0x7f1f180cb1b0 msgr2=0x7f1f180cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:21.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.222+0000 7f1f1c999640 1 -- 172.21.15.17:0/2352388314 shutdown_connections 2023-08-09T12:41:21.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.222+0000 7f1f1c999640 1 -- 172.21.15.17:0/2352388314 wait complete. 2023-08-09T12:41:21.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.224+0000 7f1f1c999640 1 Processor -- start 2023-08-09T12:41:21.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.224+0000 7f1f1c999640 1 -- start start 2023-08-09T12:41:21.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f1c999640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04004d00 0x7f1f18150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f1c999640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f181f3070 0x7f1f181f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f1c999640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f181f5f50 0x7f1f181f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f1c999640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1814a660 con 0x7f1f181f3070 2023-08-09T12:41:21.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f1c999640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1814cdd0 con 0x7f1f181f5f50 2023-08-09T12:41:21.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f1c999640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1814d0b0 con 0x7f1f04004d00 2023-08-09T12:41:21.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f15d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f181f3070 0x7f1f181f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f15d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f181f3070 0x7f1f181f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40760/0 (socket says 172.21.15.17:40760) 2023-08-09T12:41:21.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f15d9b640 1 -- 172.21.15.17:0/373333713 learned_addr learned my addr 172.21.15.17:0/373333713 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:21.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f15d9b640 1 -- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04004d00 msgr2=0x7f1f18150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.225+0000 7f1f1659c640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04004d00 0x7f1f18150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f15d9b640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04004d00 0x7f1f18150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f15d9b640 1 -- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f181f5f50 msgr2=0x7f1f181f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f16d9d640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f181f5f50 0x7f1f181f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f15d9b640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f181f5f50 0x7f1f181f63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f15d9b640 1 -- 172.21.15.17:0/373333713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1814d390 con 0x7f1f181f3070 2023-08-09T12:41:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f1659c640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04004d00 0x7f1f18150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f15d9b640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f181f3070 0x7f1f181f5a10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1f08007f30 tx=0x7f1f08011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f0effd640 1 -- 172.21.15.17:0/373333713 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800e030 con 0x7f1f181f3070 2023-08-09T12:41:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f0effd640 1 -- 172.21.15.17:0/373333713 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f08016470 con 0x7f1f181f3070 2023-08-09T12:41:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1814d670 con 0x7f1f181f3070 2023-08-09T12:41:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f0effd640 1 -- 172.21.15.17:0/373333713 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08016820 con 0x7f1f181f3070 2023-08-09T12:41:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.226+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f181f1ee0 con 0x7f1f181f3070 2023-08-09T12:41:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.228+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f18067a80 con 0x7f1f181f3070 2023-08-09T12:41:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.228+0000 7f1f0effd640 1 -- 172.21.15.17:0/373333713 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f08016980 con 0x7f1f181f3070 2023-08-09T12:41:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.230+0000 7f1f0effd640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ef806a080 0x7f1ef806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.230+0000 7f1f0effd640 1 -- 172.21.15.17:0/373333713 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1f0800f070 con 0x7f1f181f3070 2023-08-09T12:41:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.231+0000 7f1f1659c640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ef806a080 0x7f1ef806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.232+0000 7f1f1659c640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ef806a080 0x7f1ef806c540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009a40 tx=0x7f1f00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.235+0000 7f1f0effd640 1 -- 172.21.15.17:0/373333713 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1f08058780 con 0x7f1f181f3070 2023-08-09T12:41:21.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.495+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1f18069f20 con 0x7f1f181f3070 2023-08-09T12:41:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.496+0000 7f1f0effd640 1 -- 172.21.15.17:0/373333713 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1f08058310 con 0x7f1f181f3070 2023-08-09T12:41:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:21.500 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:41:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:41:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:41:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:41:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:41:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:41:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:41:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:41:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:41:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:41:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:41:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:41:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:41:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:41:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:41:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:41:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:41:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:41:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:41:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:41:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:41:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:41:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:41:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:41:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:41:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:41:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:41:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:41:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:41:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:41:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:41:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:41:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:41:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:41:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:41:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:41:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:41:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:41:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:41:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:41:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:41:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:41:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:41:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:41:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:41:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:41:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:41:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:41:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:41:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:41:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:41:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:41:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:41:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:41:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:41:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:41:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:41:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:41:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:41:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:41:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:41:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:41:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:41:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:41:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:41:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:41:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:41:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:41:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:41:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:41:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:41:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:41:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:41:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:41:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:41:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:41:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:41:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:41:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:41:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:41:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:41:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:41:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:41:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:41:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:41:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:41:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:41:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:41:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:41:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:41:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:41:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:41:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:21.532 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:41:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.498+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ef806a080 msgr2=0x7f1ef806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.498+0000 7f1f1c999640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ef806a080 0x7f1ef806c540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009a40 tx=0x7f1f00008040 comp rx=0 tx=0).stop 2023-08-09T12:41:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.498+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f181f3070 msgr2=0x7f1f181f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.498+0000 7f1f1c999640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f181f3070 0x7f1f181f5a10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1f08007f30 tx=0x7f1f08011660 comp rx=0 tx=0).stop 2023-08-09T12:41:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.499+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 shutdown_connections 2023-08-09T12:41:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.499+0000 7f1f1c999640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ef806a080 0x7f1ef806c540 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.499+0000 7f1f1c999640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f181f5f50 0x7f1f181f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.499+0000 7f1f1c999640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f181f3070 0x7f1f181f5a10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.499+0000 7f1f1c999640 1 --2- 172.21.15.17:0/373333713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04004d00 0x7f1f18150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.499+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 >> 172.21.15.17:0/373333713 conn(0x7f1f180cb1b0 msgr2=0x7f1f180cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:21.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.499+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 shutdown_connections 2023-08-09T12:41:21.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.499+0000 7f1f1c999640 1 -- 172.21.15.17:0/373333713 wait complete. 2023-08-09T12:41:21.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.762+0000 7f1999fc4640 1 Processor -- start 2023-08-09T12:41:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.762+0000 7f1999fc4640 1 -- start start 2023-08-09T12:41:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.764+0000 7f1999fc4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1994160030 0x7f1994160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.764+0000 7f1999fc4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940cfb50 0x7f19940d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.764+0000 7f1999fc4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19940b5a30 con 0x7f19940b86e0 2023-08-09T12:41:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.764+0000 7f1999fc4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19940d1110 con 0x7f1994160030 2023-08-09T12:41:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.764+0000 7f1999fc4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19940ceac0 con 0x7f19940cfb50 2023-08-09T12:41:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.765+0000 7f19997c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940cfb50 0x7f19940d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.765+0000 7f19997c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940cfb50 0x7f19940d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:59090/0 (socket says 172.21.15.17:59090) 2023-08-09T12:41:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.765+0000 7f19997c3640 1 -- 172.21.15.17:0/3792309518 learned_addr learned my addr 172.21.15.17:0/3792309518 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.765+0000 7f1998fc2640 1 --2- 172.21.15.17:0/3792309518 >> v2:172.21.15.142:3300/0 conn(0x7f1994160030 0x7f1994160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.766+0000 7f19997c3640 1 -- 172.21.15.17:0/3792309518 >> v2:172.21.15.142:3300/0 conn(0x7f1994160030 msgr2=0x7f1994160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.766+0000 7f19997c3640 1 --2- 172.21.15.17:0/3792309518 >> v2:172.21.15.142:3300/0 conn(0x7f1994160030 0x7f1994160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.766+0000 7f19997c3640 1 -- 172.21.15.17:0/3792309518 >> v1:172.21.15.142:6789/0 conn(0x7f19940b86e0 legacy=0x7f19940cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.766+0000 7f19997c3640 1 -- 172.21.15.17:0/3792309518 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19940d0d70 con 0x7f19940cfb50 2023-08-09T12:41:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.767+0000 7f19997c3640 1 --2- 172.21.15.17:0/3792309518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940cfb50 0x7f19940d1530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f198c009e50 tx=0x7f198c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe77452396df3f90 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.768+0000 7f19937fe640 1 -- 172.21.15.17:0/3792309518 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c02cb00 con 0x7f19940cfb50 2023-08-09T12:41:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.768+0000 7f19937fe640 1 -- 172.21.15.17:0/3792309518 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c02cc60 con 0x7f19940cfb50 2023-08-09T12:41:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.768+0000 7f19937fe640 1 -- 172.21.15.17:0/3792309518 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0343f0 con 0x7f19940cfb50 2023-08-09T12:41:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.768+0000 7f1999fc4640 1 -- 172.21.15.17:0/3792309518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940cfb50 msgr2=0x7f19940d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.768+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3792309518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940cfb50 0x7f19940d1530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f198c009e50 tx=0x7f198c02bf60 comp rx=0 tx=0).stop 2023-08-09T12:41:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.768+0000 7f1999fc4640 1 -- 172.21.15.17:0/3792309518 shutdown_connections 2023-08-09T12:41:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.769+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3792309518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940cfb50 0x7f19940d1530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.769+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3792309518 >> v2:172.21.15.142:3300/0 conn(0x7f1994160030 0x7f1994160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.769+0000 7f1999fc4640 1 -- 172.21.15.17:0/3792309518 >> 172.21.15.17:0/3792309518 conn(0x7f19940697c0 msgr2=0x7f1994069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:21.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.769+0000 7f1999fc4640 1 -- 172.21.15.17:0/3792309518 shutdown_connections 2023-08-09T12:41:21.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.769+0000 7f1999fc4640 1 -- 172.21.15.17:0/3792309518 wait complete. 2023-08-09T12:41:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.770+0000 7f1999fc4640 1 Processor -- start 2023-08-09T12:41:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.770+0000 7f1999fc4640 1 -- start start 2023-08-09T12:41:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.771+0000 7f1999fc4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940b86e0 0x7f19940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.771+0000 7f1999fc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19940cfb50 0x7f199414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.771+0000 7f1999fc4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1994160030 0x7f199414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.771+0000 7f1999fc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19940b5410 con 0x7f19940cfb50 2023-08-09T12:41:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.771+0000 7f1999fc4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199414fba0 con 0x7f1994160030 2023-08-09T12:41:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.771+0000 7f1999fc4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199414d130 con 0x7f19940b86e0 2023-08-09T12:41:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1993fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19940cfb50 0x7f199414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1993fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19940cfb50 0x7f199414f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40768/0 (socket says 172.21.15.17:40768) 2023-08-09T12:41:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1993fff640 1 -- 172.21.15.17:0/3990011099 learned_addr learned my addr 172.21.15.17:0/3990011099 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1998fc2640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940b86e0 0x7f19940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f19997c3640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1994160030 0x7f199414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1993fff640 1 -- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940b86e0 msgr2=0x7f19940b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1993fff640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940b86e0 0x7f19940b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1993fff640 1 -- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1994160030 msgr2=0x7f199414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1993fff640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1994160030 0x7f199414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.772+0000 7f1993fff640 1 -- 172.21.15.17:0/3990011099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009b30 con 0x7f19940cfb50 2023-08-09T12:41:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.773+0000 7f1993fff640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19940cfb50 0x7f199414f660 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f198000c450 tx=0x7f198000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.773+0000 7f19917fa640 1 -- 172.21.15.17:0/3990011099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800052d0 con 0x7f19940cfb50 2023-08-09T12:41:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.773+0000 7f19917fa640 1 -- 172.21.15.17:0/3990011099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980005430 con 0x7f19940cfb50 2023-08-09T12:41:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.773+0000 7f19917fa640 1 -- 172.21.15.17:0/3990011099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980012870 con 0x7f19940cfb50 2023-08-09T12:41:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.773+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199414d410 con 0x7f19940cfb50 2023-08-09T12:41:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.773+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199414d9d0 con 0x7f19940cfb50 2023-08-09T12:41:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.774+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199404e390 con 0x7f19940cfb50 2023-08-09T12:41:21.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.775+0000 7f19917fa640 1 -- 172.21.15.17:0/3990011099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f19800129d0 con 0x7f19940cfb50 2023-08-09T12:41:21.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.776+0000 7f19917fa640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f197806a080 0x7f197806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:21.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.776+0000 7f19917fa640 1 -- 172.21.15.17:0/3990011099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1980087c90 con 0x7f19940cfb50 2023-08-09T12:41:21.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.777+0000 7f1998fc2640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f197806a080 0x7f197806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:21.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.778+0000 7f1998fc2640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f197806a080 0x7f197806c540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1988009aa0 tx=0x7f1988009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.781+0000 7f19917fa640 1 -- 172.21.15.17:0/3990011099 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f19800536c0 con 0x7f19940cfb50 2023-08-09T12:41:21.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.967+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f199415d1e0 con 0x7f19940cfb50 2023-08-09T12:41:21.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.970+0000 7f19917fa640 1 -- 172.21.15.17:0/3990011099 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f1980056ce0 con 0x7f19940cfb50 2023-08-09T12:41:21.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:21.974 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:41:20.972547+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f197806a080 msgr2=0x7f197806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f197806a080 0x7f197806c540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1988009aa0 tx=0x7f1988009190 comp rx=0 tx=0).stop 2023-08-09T12:41:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19940cfb50 msgr2=0x7f199414f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:21.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19940cfb50 0x7f199414f660 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f198000c450 tx=0x7f198000c910 comp rx=0 tx=0).stop 2023-08-09T12:41:21.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 shutdown_connections 2023-08-09T12:41:21.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f197806a080 0x7f197806c540 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1994160030 0x7f199414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19940cfb50 0x7f199414f660 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 --2- 172.21.15.17:0/3990011099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19940b86e0 0x7f19940b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:21.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 >> 172.21.15.17:0/3990011099 conn(0x7f19940697c0 msgr2=0x7f199415db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:21.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 shutdown_connections 2023-08-09T12:41:21.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:21.973+0000 7f1999fc4640 1 -- 172.21.15.17:0/3990011099 wait complete. 2023-08-09T12:41:21.993 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:41:21.994 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.207+0000 7f96a0d67640 1 Processor -- start 2023-08-09T12:41:22.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.207+0000 7f96a0d67640 1 -- start start 2023-08-09T12:41:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.208+0000 7f96a0d67640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cb40 0x7f969c1609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.208+0000 7f96a0d67640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f969c0b8420 0x7f969c0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.208+0000 7f96a0d67640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c0d0f00 con 0x7f969c15cf20 2023-08-09T12:41:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.208+0000 7f96a0d67640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c1611f0 con 0x7f969c0b8420 2023-08-09T12:41:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.208+0000 7f96a0d67640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1614d0 con 0x7f969c15cb40 2023-08-09T12:41:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.208+0000 7f9692ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f969c0b8420 0x7f969c0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.208+0000 7f9692ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f969c0b8420 0x7f969c0cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40780/0 (socket says 172.21.15.17:40780) 2023-08-09T12:41:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.208+0000 7f9692ffd640 1 -- 172.21.15.17:0/188069192 learned_addr learned my addr 172.21.15.17:0/188069192 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.209+0000 7f969b7fe640 1 --2- 172.21.15.17:0/188069192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cb40 0x7f969c1609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.209+0000 7f9692ffd640 1 -- 172.21.15.17:0/188069192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cb40 msgr2=0x7f969c1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.209+0000 7f9692ffd640 1 --2- 172.21.15.17:0/188069192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cb40 0x7f969c1609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.209+0000 7f9692ffd640 1 -- 172.21.15.17:0/188069192 >> v1:172.21.15.142:6789/0 conn(0x7f969c15cf20 legacy=0x7f969c0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.209+0000 7f9692ffd640 1 -- 172.21.15.17:0/188069192 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c1617b0 con 0x7f969c0b8420 2023-08-09T12:41:22.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.210+0000 7f9692ffd640 1 --2- 172.21.15.17:0/188069192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c0cd860 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9684009e50 tx=0x7f968402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69150c5c25c97f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:22.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f969affd640 1 -- 172.21.15.17:0/188069192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968402cb90 con 0x7f969c0b8420 2023-08-09T12:41:22.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f969affd640 1 -- 172.21.15.17:0/188069192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968402ccf0 con 0x7f969c0b8420 2023-08-09T12:41:22.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f969affd640 1 -- 172.21.15.17:0/188069192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684034610 con 0x7f969c0b8420 2023-08-09T12:41:22.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f96a0d67640 1 -- 172.21.15.17:0/188069192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 msgr2=0x7f969c0cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f96a0d67640 1 --2- 172.21.15.17:0/188069192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c0cd860 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9684009e50 tx=0x7f968402bff0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f96a0d67640 1 -- 172.21.15.17:0/188069192 shutdown_connections 2023-08-09T12:41:22.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f96a0d67640 1 --2- 172.21.15.17:0/188069192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c0cd860 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f96a0d67640 1 --2- 172.21.15.17:0/188069192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cb40 0x7f969c1609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.211+0000 7f96a0d67640 1 -- 172.21.15.17:0/188069192 >> 172.21.15.17:0/188069192 conn(0x7f969c0d2ab0 msgr2=0x7f969c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:22.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.212+0000 7f96a0d67640 1 -- 172.21.15.17:0/188069192 shutdown_connections 2023-08-09T12:41:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.212+0000 7f96a0d67640 1 -- 172.21.15.17:0/188069192 wait complete. 2023-08-09T12:41:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.213+0000 7f96a0d67640 1 Processor -- start 2023-08-09T12:41:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.213+0000 7f96a0d67640 1 -- start start 2023-08-09T12:41:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.214+0000 7f96a0d67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c1fab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.214+0000 7f96a0d67640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c15cb40 0x7f969c14e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.214+0000 7f96a0d67640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cf20 0x7f969c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.214+0000 7f96a0d67640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c15eea0 con 0x7f969c0b8420 2023-08-09T12:41:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.214+0000 7f96a0d67640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1fb040 con 0x7f969c15cb40 2023-08-09T12:41:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.214+0000 7f96a0d67640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c15d6f0 con 0x7f969c15cf20 2023-08-09T12:41:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c1fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c1fab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40794/0 (socket says 172.21.15.17:40794) 2023-08-09T12:41:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 -- 172.21.15.17:0/711701003 learned_addr learned my addr 172.21.15.17:0/711701003 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 -- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cf20 msgr2=0x7f969c15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cf20 0x7f969c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 -- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c15cb40 msgr2=0x7f969c14e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c15cb40 0x7f969c14e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 -- 172.21.15.17:0/711701003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009b30 con 0x7f969c0b8420 2023-08-09T12:41:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.215+0000 7f969b7fe640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c1fab00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f968c00d800 tx=0x7f968c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:22.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.216+0000 7f9698ff9640 1 -- 172.21.15.17:0/711701003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00b6c0 con 0x7f969c0b8420 2023-08-09T12:41:22.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.216+0000 7f9698ff9640 1 -- 172.21.15.17:0/711701003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c00b820 con 0x7f969c0b8420 2023-08-09T12:41:22.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.216+0000 7f9698ff9640 1 -- 172.21.15.17:0/711701003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00bbb0 con 0x7f969c0b8420 2023-08-09T12:41:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.216+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c15e320 con 0x7f969c0b8420 2023-08-09T12:41:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.216+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c15e8e0 con 0x7f969c0b8420 2023-08-09T12:41:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.217+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c04e390 con 0x7f969c0b8420 2023-08-09T12:41:22.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.218+0000 7f9698ff9640 1 -- 172.21.15.17:0/711701003 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f968c00bd10 con 0x7f969c0b8420 2023-08-09T12:41:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.219+0000 7f9698ff9640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f967c06a050 0x7f967c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.219+0000 7f9698ff9640 1 -- 172.21.15.17:0/711701003 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f968c088870 con 0x7f969c0b8420 2023-08-09T12:41:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.219+0000 7f9692ffd640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f967c06a050 0x7f967c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.221+0000 7f9692ffd640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f967c06a050 0x7f967c06c510 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9684035000 tx=0x7f968402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.223+0000 7f9698ff9640 1 -- 172.21.15.17:0/711701003 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f968c054210 con 0x7f969c0b8420 2023-08-09T12:41:22.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.417+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f969c0b2d70 con 0x7f969c0b8420 2023-08-09T12:41:22.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.418+0000 7f9698ff9640 1 -- 172.21.15.17:0/711701003 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f968c057830 con 0x7f969c0b8420 2023-08-09T12:41:22.421 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:41:22.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.420+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f967c06a050 msgr2=0x7f967c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.420+0000 7f96a0d67640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f967c06a050 0x7f967c06c510 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9684035000 tx=0x7f968402e000 comp rx=0 tx=0).stop 2023-08-09T12:41:22.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 msgr2=0x7f969c1fab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c1fab00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f968c00d800 tx=0x7f968c00dcc0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 shutdown_connections 2023-08-09T12:41:22.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f967c06a050 0x7f967c06c510 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969c15cf20 0x7f969c15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f969c15cb40 0x7f969c14e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 --2- 172.21.15.17:0/711701003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f969c0b8420 0x7f969c1fab00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 >> 172.21.15.17:0/711701003 conn(0x7f969c0d2ab0 msgr2=0x7f969c0b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:22.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 shutdown_connections 2023-08-09T12:41:22.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.421+0000 7f96a0d67640 1 -- 172.21.15.17:0/711701003 wait complete. 2023-08-09T12:41:22.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:41:22.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.657+0000 7faf31ea6640 1 Processor -- start 2023-08-09T12:41:22.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.657+0000 7faf31ea6640 1 -- start start 2023-08-09T12:41:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf31ea6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf2c159250 0x7faf2c0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf31ea6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf31ea6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf2c070060 0x7faf2c159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf31ea6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c070890 con 0x7faf2c070060 2023-08-09T12:41:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf31ea6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c0cd860 con 0x7faf2c159250 2023-08-09T12:41:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf31ea6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c15a940 con 0x7faf2c0cd400 2023-08-09T12:41:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf2bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf2c070060 0x7faf2c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf2bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf2c070060 0x7faf2c159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40802/0 (socket says 172.21.15.17:40802) 2023-08-09T12:41:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf2bfff640 1 -- 172.21.15.17:0/3979578024 learned_addr learned my addr 172.21.15.17:0/3979578024 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf2b7fe640 1 --2- 172.21.15.17:0/3979578024 >> v2:172.21.15.142:3300/0 conn(0x7faf2c159250 0x7faf2c0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.659+0000 7faf22ffd640 1 --2- 172.21.15.17:0/3979578024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.660+0000 7faf2bfff640 1 -- 172.21.15.17:0/3979578024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 msgr2=0x7faf2c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.660+0000 7faf2bfff640 1 --2- 172.21.15.17:0/3979578024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.660+0000 7faf2bfff640 1 -- 172.21.15.17:0/3979578024 >> v2:172.21.15.142:3300/0 conn(0x7faf2c159250 msgr2=0x7faf2c0ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.660+0000 7faf2bfff640 1 --2- 172.21.15.17:0/3979578024 >> v2:172.21.15.142:3300/0 conn(0x7faf2c159250 0x7faf2c0ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.660+0000 7faf2bfff640 1 -- 172.21.15.17:0/3979578024 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c15ab90 con 0x7faf2c070060 2023-08-09T12:41:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.661+0000 7faf2bfff640 1 --2- 172.21.15.17:0/3979578024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c159630 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0b1320 tx=0x7faf2402e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c358c2b1634c3307 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.661+0000 7faf2affd640 1 -- 172.21.15.17:0/3979578024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2402ea70 con 0x7faf2c070060 2023-08-09T12:41:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.661+0000 7faf2affd640 1 -- 172.21.15.17:0/3979578024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2402ebd0 con 0x7faf2c070060 2023-08-09T12:41:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.661+0000 7faf2affd640 1 -- 172.21.15.17:0/3979578024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24009600 con 0x7faf2c070060 2023-08-09T12:41:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 -- 172.21.15.17:0/3979578024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 msgr2=0x7faf2c159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 --2- 172.21.15.17:0/3979578024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c159630 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0b1320 tx=0x7faf2402e0d0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 -- 172.21.15.17:0/3979578024 shutdown_connections 2023-08-09T12:41:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 --2- 172.21.15.17:0/3979578024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c159630 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 --2- 172.21.15.17:0/3979578024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 --2- 172.21.15.17:0/3979578024 >> v2:172.21.15.142:3300/0 conn(0x7faf2c159250 0x7faf2c0ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 -- 172.21.15.17:0/3979578024 >> 172.21.15.17:0/3979578024 conn(0x7faf2c0cb1b0 msgr2=0x7faf2c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 -- 172.21.15.17:0/3979578024 shutdown_connections 2023-08-09T12:41:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.662+0000 7faf31ea6640 1 -- 172.21.15.17:0/3979578024 wait complete. 2023-08-09T12:41:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.664+0000 7faf31ea6640 1 Processor -- start 2023-08-09T12:41:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.664+0000 7faf31ea6640 1 -- start start 2023-08-09T12:41:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf31ea6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf31ea6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c1433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf31ea6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c159250 0x7faf2c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf31ea6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c144d40 con 0x7faf2c070060 2023-08-09T12:41:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf31ea6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c144130 con 0x7faf2c159250 2023-08-09T12:41:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf31ea6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c144410 con 0x7faf2c0cd400 2023-08-09T12:41:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf2b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf2b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40816/0 (socket says 172.21.15.17:40816) 2023-08-09T12:41:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.665+0000 7faf2b7fe640 1 -- 172.21.15.17:0/958463116 learned_addr learned my addr 172.21.15.17:0/958463116 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf22ffd640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c1433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf2bfff640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c159250 0x7faf2c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf2b7fe640 1 -- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 msgr2=0x7faf2c1433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf2b7fe640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c1433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf2b7fe640 1 -- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c159250 msgr2=0x7faf2c1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf2b7fe640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c159250 0x7faf2c1438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf2b7fe640 1 -- 172.21.15.17:0/958463116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2400bd40 con 0x7faf2c070060 2023-08-09T12:41:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf22ffd640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c1433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf2bfff640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c159250 0x7faf2c1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf2b7fe640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c0c49b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00d5f0 tx=0x7faf1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.666+0000 7faf28ff9640 1 -- 172.21.15.17:0/958463116 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0125f0 con 0x7faf2c070060 2023-08-09T12:41:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.667+0000 7faf28ff9640 1 -- 172.21.15.17:0/958463116 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c012750 con 0x7faf2c070060 2023-08-09T12:41:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.667+0000 7faf28ff9640 1 -- 172.21.15.17:0/958463116 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c012b00 con 0x7faf2c070060 2023-08-09T12:41:22.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.667+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c1446f0 con 0x7faf2c070060 2023-08-09T12:41:22.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.667+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c143e30 con 0x7faf2c070060 2023-08-09T12:41:22.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.668+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c0cd220 con 0x7faf2c070060 2023-08-09T12:41:22.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.669+0000 7faf28ff9640 1 -- 172.21.15.17:0/958463116 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf1c012c60 con 0x7faf2c070060 2023-08-09T12:41:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.670+0000 7faf28ff9640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf0c06a050 0x7faf0c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:22.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.671+0000 7faf28ff9640 1 -- 172.21.15.17:0/958463116 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faf1c088760 con 0x7faf2c070060 2023-08-09T12:41:22.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.671+0000 7faf22ffd640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf0c06a050 0x7faf0c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:22.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.672+0000 7faf22ffd640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf0c06a050 0x7faf0c06c510 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0ad4c0 tx=0x7faf14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:22.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.675+0000 7faf28ff9640 1 -- 172.21.15.17:0/958463116 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7faf1c054100 con 0x7faf2c070060 2023-08-09T12:41:22.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.872+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf2c067a80 con 0x7faf2c070060 2023-08-09T12:41:22.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.873+0000 7faf28ff9640 1 -- 172.21.15.17:0/958463116 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf1c057720 con 0x7faf2c070060 2023-08-09T12:41:22.876 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:41:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf0c06a050 msgr2=0x7faf0c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf0c06a050 0x7faf0c06c510 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0ad4c0 tx=0x7faf14008040 comp rx=0 tx=0).stop 2023-08-09T12:41:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 msgr2=0x7faf2c0c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c0c49b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00d5f0 tx=0x7faf1c00dab0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 shutdown_connections 2023-08-09T12:41:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf0c06a050 0x7faf0c06c510 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c159250 0x7faf2c1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf2c0cd400 0x7faf2c1433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 --2- 172.21.15.17:0/958463116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf2c070060 0x7faf2c0c49b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 >> 172.21.15.17:0/958463116 conn(0x7faf2c0cb1b0 msgr2=0x7faf2c0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 shutdown_connections 2023-08-09T12:41:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:22.876+0000 7faf31ea6640 1 -- 172.21.15.17:0/958463116 wait complete. 2023-08-09T12:41:22.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:41:23.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.130+0000 7fab63fff640 1 Processor -- start 2023-08-09T12:41:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.130+0000 7fab63fff640 1 -- start start 2023-08-09T12:41:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.131+0000 7fab63fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.131+0000 7fab63fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab640b0b10 0x7fab6415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.131+0000 7fab63fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab640715c0 con 0x7fab6415bce0 2023-08-09T12:41:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.131+0000 7fab63fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab640718a0 con 0x7fab640b0b10 2023-08-09T12:41:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.131+0000 7fab63fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab64071b80 con 0x7fab641587e0 2023-08-09T12:41:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.132+0000 7fab62ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.132+0000 7fab62ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:59158/0 (socket says 172.21.15.17:59158) 2023-08-09T12:41:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.132+0000 7fab62ffd640 1 -- 172.21.15.17:0/1710959691 learned_addr learned my addr 172.21.15.17:0/1710959691 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.132+0000 7fab637fe640 1 --1- 172.21.15.17:0/1710959691 >> v1:172.21.15.142:6789/0 conn(0x7fab6415bce0 0x7fab640cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:53664/0 (socket says 172.21.15.17:53664) 2023-08-09T12:41:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.132+0000 7fab5a7fc640 1 --2- 172.21.15.17:0/1710959691 >> v2:172.21.15.142:3300/0 conn(0x7fab640b0b10 0x7fab6415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.133+0000 7fab62ffd640 1 -- 172.21.15.17:0/1710959691 >> v2:172.21.15.142:3300/0 conn(0x7fab640b0b10 msgr2=0x7fab6415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.133+0000 7fab62ffd640 1 --2- 172.21.15.17:0/1710959691 >> v2:172.21.15.142:3300/0 conn(0x7fab640b0b10 0x7fab6415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.133+0000 7fab62ffd640 1 -- 172.21.15.17:0/1710959691 >> v1:172.21.15.142:6789/0 conn(0x7fab6415bce0 legacy=0x7fab640cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.133+0000 7fab62ffd640 1 -- 172.21.15.17:0/1710959691 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6415b280 con 0x7fab641587e0 2023-08-09T12:41:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.134+0000 7fab62ffd640 1 --2- 172.21.15.17:0/1710959691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64070f00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fab54009870 tx=0x7fab5402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc0285a743227906 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.135+0000 7fab627fc640 1 -- 172.21.15.17:0/1710959691 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54030840 con 0x7fab641587e0 2023-08-09T12:41:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.135+0000 7fab627fc640 1 -- 172.21.15.17:0/1710959691 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540309a0 con 0x7fab641587e0 2023-08-09T12:41:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.135+0000 7fab627fc640 1 -- 172.21.15.17:0/1710959691 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54030d30 con 0x7fab641587e0 2023-08-09T12:41:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.135+0000 7fab63fff640 1 -- 172.21.15.17:0/1710959691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 msgr2=0x7fab64070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.135+0000 7fab63fff640 1 --2- 172.21.15.17:0/1710959691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64070f00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fab54009870 tx=0x7fab5402b980 comp rx=0 tx=0).stop 2023-08-09T12:41:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.136+0000 7fab63fff640 1 -- 172.21.15.17:0/1710959691 shutdown_connections 2023-08-09T12:41:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.136+0000 7fab63fff640 1 --2- 172.21.15.17:0/1710959691 >> v2:172.21.15.142:3300/0 conn(0x7fab640b0b10 0x7fab6415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.136+0000 7fab63fff640 1 --2- 172.21.15.17:0/1710959691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64070f00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.136+0000 7fab63fff640 1 -- 172.21.15.17:0/1710959691 >> 172.21.15.17:0/1710959691 conn(0x7fab640b1d50 msgr2=0x7fab6406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.136+0000 7fab63fff640 1 -- 172.21.15.17:0/1710959691 shutdown_connections 2023-08-09T12:41:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.136+0000 7fab63fff640 1 -- 172.21.15.17:0/1710959691 wait complete. 2023-08-09T12:41:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.137+0000 7fab63fff640 1 Processor -- start 2023-08-09T12:41:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.138+0000 7fab63fff640 1 -- start start 2023-08-09T12:41:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab63fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab640b0b10 0x7fab640c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab63fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab63fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab640c7ed0 0x7fab64157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab63fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6415cb40 con 0x7fab640b0b10 2023-08-09T12:41:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab63fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab640c8720 con 0x7fab640c7ed0 2023-08-09T12:41:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab63fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640c8440 con 0x7fab641587e0 2023-08-09T12:41:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab62ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab640b0b10 0x7fab640c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab62ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab640b0b10 0x7fab640c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40820/0 (socket says 172.21.15.17:40820) 2023-08-09T12:41:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab62ffd640 1 -- 172.21.15.17:0/4928437 learned_addr learned my addr 172.21.15.17:0/4928437 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab5a7fc640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.139+0000 7fab637fe640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab640c7ed0 0x7fab64157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab62ffd640 1 -- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 msgr2=0x7fab64156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab62ffd640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab62ffd640 1 -- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab640c7ed0 msgr2=0x7fab64157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab62ffd640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab640c7ed0 0x7fab64157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab62ffd640 1 -- 172.21.15.17:0/4928437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540094d0 con 0x7fab640b0b10 2023-08-09T12:41:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab62ffd640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab640b0b10 0x7fab640c4df0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fab54000c00 tx=0x7fab54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab5bfff640 1 -- 172.21.15.17:0/4928437 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54039c90 con 0x7fab640b0b10 2023-08-09T12:41:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab5bfff640 1 -- 172.21.15.17:0/4928437 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54039e10 con 0x7fab640b0b10 2023-08-09T12:41:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab5bfff640 1 -- 172.21.15.17:0/4928437 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54043640 con 0x7fab640b0b10 2023-08-09T12:41:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.140+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6415c480 con 0x7fab640b0b10 2023-08-09T12:41:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.141+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6415ed90 con 0x7fab640b0b10 2023-08-09T12:41:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.142+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6406fa10 con 0x7fab640b0b10 2023-08-09T12:41:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.142+0000 7fab5bfff640 1 -- 172.21.15.17:0/4928437 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab540437a0 con 0x7fab640b0b10 2023-08-09T12:41:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.143+0000 7fab5bfff640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab4406a050 0x7fab4406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.143+0000 7fab5bfff640 1 -- 172.21.15.17:0/4928437 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab5403e070 con 0x7fab640b0b10 2023-08-09T12:41:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.144+0000 7fab5a7fc640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab4406a050 0x7fab4406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.145+0000 7fab5a7fc640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab4406a050 0x7fab4406c510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab640b1540 tx=0x7fab4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:23.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.148+0000 7fab5bfff640 1 -- 172.21.15.17:0/4928437 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fab6406fa10 con 0x7fab640b0b10 2023-08-09T12:41:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.345+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fab6406fa10 con 0x7fab640b0b10 2023-08-09T12:41:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.346+0000 7fab5bfff640 1 -- 172.21.15.17:0/4928437 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+126 (secure 0 0 0) 0x7fab54034090 con 0x7fab640b0b10 2023-08-09T12:41:23.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:23.350 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:41:23.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:23.350 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:41:23.350 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:41:23.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:23.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:23.351 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:41:23.351 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:41:23.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:23.351 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:41:23.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab4406a050 msgr2=0x7fab4406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab4406a050 0x7fab4406c510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab640b1540 tx=0x7fab4c008040 comp rx=0 tx=0).stop 2023-08-09T12:41:23.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab640b0b10 msgr2=0x7fab640c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab640b0b10 0x7fab640c4df0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fab54000c00 tx=0x7fab54004730 comp rx=0 tx=0).stop 2023-08-09T12:41:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 shutdown_connections 2023-08-09T12:41:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab4406a050 0x7fab4406c510 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab640c7ed0 0x7fab64157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab641587e0 0x7fab64156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 --2- 172.21.15.17:0/4928437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab640b0b10 0x7fab640c4df0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 >> 172.21.15.17:0/4928437 conn(0x7fab640b1d50 msgr2=0x7fab6406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 shutdown_connections 2023-08-09T12:41:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.349+0000 7fab63fff640 1 -- 172.21.15.17:0/4928437 wait complete. 2023-08-09T12:41:23.372 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:41:23.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:41:23.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.598+0000 7f8994bd6640 1 Processor -- start 2023-08-09T12:41:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.599+0000 7f8994bd6640 1 -- start start 2023-08-09T12:41:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.600+0000 7f8994bd6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89900ce6f0 0x7f89900ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.600+0000 7f8994bd6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89900cf070 con 0x7f899006f110 2023-08-09T12:41:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.600+0000 7f8994bd6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8990159e90 con 0x7f8990159ab0 2023-08-09T12:41:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.600+0000 7f8994bd6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89900ccab0 con 0x7f89900ce6f0 2023-08-09T12:41:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.600+0000 7f8987fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89900ce6f0 0x7f89900ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.600+0000 7f898ed9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f899006f110 0x7f89900c96f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32770/0 (socket says 172.21.15.17:32770) 2023-08-09T12:41:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.600+0000 7f898ed9d640 1 -- 172.21.15.17:0/2309519072 learned_addr learned my addr 172.21.15.17:0/2309519072 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.601+0000 7f8987fff640 1 -- 172.21.15.17:0/2309519072 >> v1:172.21.15.142:6789/0 conn(0x7f8990159ab0 legacy=0x7f89900cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.601+0000 7f8987fff640 1 -- 172.21.15.17:0/2309519072 >> v1:172.21.15.17:6789/0 conn(0x7f899006f110 legacy=0x7f89900c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.601+0000 7f8987fff640 1 -- 172.21.15.17:0/2309519072 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900ccd90 con 0x7f89900ce6f0 2023-08-09T12:41:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.601+0000 7f898dd9b640 1 -- 172.21.15.17:0/2309519072 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194435047 0 0) 0x7f89900cf070 con 0x7f899006f110 2023-08-09T12:41:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.602+0000 7f8987fff640 1 --2- 172.21.15.17:0/2309519072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f89900ceb30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f89780097a0 tx=0x7f897802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d6234e43f9735f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.602+0000 7f898dd9b640 1 -- 172.21.15.17:0/2309519072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897802f810 con 0x7f89900ce6f0 2023-08-09T12:41:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.602+0000 7f898dd9b640 1 -- 172.21.15.17:0/2309519072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897802f970 con 0x7f89900ce6f0 2023-08-09T12:41:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.602+0000 7f898dd9b640 1 -- 172.21.15.17:0/2309519072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897802fd00 con 0x7f89900ce6f0 2023-08-09T12:41:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.603+0000 7f8994bd6640 1 -- 172.21.15.17:0/2309519072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 msgr2=0x7f89900ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.603+0000 7f8994bd6640 1 --2- 172.21.15.17:0/2309519072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f89900ceb30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f89780097a0 tx=0x7f897802b9f0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.603+0000 7f8994bd6640 1 -- 172.21.15.17:0/2309519072 shutdown_connections 2023-08-09T12:41:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.603+0000 7f8994bd6640 1 --2- 172.21.15.17:0/2309519072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f89900ceb30 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.603+0000 7f8994bd6640 1 -- 172.21.15.17:0/2309519072 >> 172.21.15.17:0/2309519072 conn(0x7f89900697c0 msgr2=0x7f8990069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:23.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.603+0000 7f8994bd6640 1 -- 172.21.15.17:0/2309519072 shutdown_connections 2023-08-09T12:41:23.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.603+0000 7f8994bd6640 1 -- 172.21.15.17:0/2309519072 wait complete. 2023-08-09T12:41:23.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.605+0000 7f8994bd6640 1 Processor -- start 2023-08-09T12:41:23.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.605+0000 7f8994bd6640 1 -- start start 2023-08-09T12:41:23.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.606+0000 7f8994bd6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899006f110 0x7f89900c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.606+0000 7f8994bd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f8990157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.606+0000 7f8994bd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8990159ab0 0x7f89900af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.606+0000 7f8994bd6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89901506d0 con 0x7f89900ce6f0 2023-08-09T12:41:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.606+0000 7f8994bd6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89901509b0 con 0x7f899006f110 2023-08-09T12:41:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.606+0000 7f8994bd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8990150c90 con 0x7f8990159ab0 2023-08-09T12:41:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f8987fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f8990157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f8987fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f8990157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40834/0 (socket says 172.21.15.17:40834) 2023-08-09T12:41:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f8987fff640 1 -- 172.21.15.17:0/911497264 learned_addr learned my addr 172.21.15.17:0/911497264 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f898ed9d640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8990159ab0 0x7f89900af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f898e59c640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899006f110 0x7f89900c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f8987fff640 1 -- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8990159ab0 msgr2=0x7f89900af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f8987fff640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8990159ab0 0x7f89900af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f8987fff640 1 -- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899006f110 msgr2=0x7f89900c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f8987fff640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899006f110 0x7f89900c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.607+0000 7f8987fff640 1 -- 172.21.15.17:0/911497264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009400 con 0x7f89900ce6f0 2023-08-09T12:41:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.608+0000 7f8987fff640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f8990157ab0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f89780098c0 tx=0x7f8978004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.608+0000 7f8986ffd640 1 -- 172.21.15.17:0/911497264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897803c040 con 0x7f89900ce6f0 2023-08-09T12:41:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.608+0000 7f8986ffd640 1 -- 172.21.15.17:0/911497264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89780379f0 con 0x7f89900ce6f0 2023-08-09T12:41:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.608+0000 7f8986ffd640 1 -- 172.21.15.17:0/911497264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978037da0 con 0x7f89900ce6f0 2023-08-09T12:41:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.608+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8990150f70 con 0x7f89900ce6f0 2023-08-09T12:41:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.608+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8990157ff0 con 0x7f89900ce6f0 2023-08-09T12:41:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.609+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990067a80 con 0x7f89900ce6f0 2023-08-09T12:41:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.610+0000 7f8986ffd640 1 -- 172.21.15.17:0/911497264 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f897802d3a0 con 0x7f89900ce6f0 2023-08-09T12:41:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.611+0000 7f8986ffd640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897006a080 0x7f897006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.611+0000 7f8986ffd640 1 -- 172.21.15.17:0/911497264 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f89780aa080 con 0x7f89900ce6f0 2023-08-09T12:41:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.612+0000 7f898e59c640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897006a080 0x7f897006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.613+0000 7f898e59c640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897006a080 0x7f897006c540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8980000f60 tx=0x7f8980009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.616+0000 7f8986ffd640 1 -- 172.21.15.17:0/911497264 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f89780dc7b0 con 0x7f89900ce6f0 2023-08-09T12:41:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:23.810+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8990150810 con 0x7f89900ce6f0 2023-08-09T12:41:24.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.688+0000 7f8986ffd640 1 -- 172.21.15.17:0/911497264 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8990150810 con 0x7f89900ce6f0 2023-08-09T12:41:24.693 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:41:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897006a080 msgr2=0x7f897006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897006a080 0x7f897006c540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8980000f60 tx=0x7f8980009040 comp rx=0 tx=0).stop 2023-08-09T12:41:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 msgr2=0x7f8990157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f8990157ab0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f89780098c0 tx=0x7f8978004730 comp rx=0 tx=0).stop 2023-08-09T12:41:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 shutdown_connections 2023-08-09T12:41:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897006a080 0x7f897006c540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8990159ab0 0x7f89900af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89900ce6f0 0x7f8990157ab0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.695+0000 7f8994bd6640 1 --2- 172.21.15.17:0/911497264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f899006f110 0x7f89900c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.696+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 >> 172.21.15.17:0/911497264 conn(0x7f89900697c0 msgr2=0x7f89900cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.696+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 shutdown_connections 2023-08-09T12:41:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.696+0000 7f8994bd6640 1 -- 172.21.15.17:0/911497264 wait complete. 2023-08-09T12:41:24.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:41:24.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.957+0000 7f1332cf3640 1 Processor -- start 2023-08-09T12:41:24.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.957+0000 7f1332cf3640 1 -- start start 2023-08-09T12:41:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.959+0000 7f1332cf3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c0ca9c0 0x7f132c0cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.959+0000 7f1332cf3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f132c0cada0 0x7f132c0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.959+0000 7f1332cf3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132c0b02b0 con 0x7f132c15ca40 2023-08-09T12:41:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.959+0000 7f1332cf3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c0cd390 con 0x7f132c0cada0 2023-08-09T12:41:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.959+0000 7f1332cf3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0ce410 con 0x7f132c0ca9c0 2023-08-09T12:41:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.960+0000 7f1330a8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c0ca9c0 0x7f132c0cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.960+0000 7f1331290640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f132c15ca40 0x7f132c15ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:53682/0 (socket says 172.21.15.17:53682) 2023-08-09T12:41:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.960+0000 7f1331290640 1 -- 172.21.15.17:0/2057442453 learned_addr learned my addr 172.21.15.17:0/2057442453 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.960+0000 7f1330a8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c0ca9c0 0x7f132c0cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:59186/0 (socket says 172.21.15.17:59186) 2023-08-09T12:41:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.960+0000 7f1323fff640 1 --2- 172.21.15.17:0/2057442453 >> v2:172.21.15.142:3300/0 conn(0x7f132c0cada0 0x7f132c0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.961+0000 7f1330a8f640 1 -- 172.21.15.17:0/2057442453 >> v2:172.21.15.142:3300/0 conn(0x7f132c0cada0 msgr2=0x7f132c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.961+0000 7f1330a8f640 1 --2- 172.21.15.17:0/2057442453 >> v2:172.21.15.142:3300/0 conn(0x7f132c0cada0 0x7f132c0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.961+0000 7f1330a8f640 1 -- 172.21.15.17:0/2057442453 >> v1:172.21.15.142:6789/0 conn(0x7f132c15ca40 legacy=0x7f132c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.961+0000 7f1330a8f640 1 -- 172.21.15.17:0/2057442453 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c160ae0 con 0x7f132c0ca9c0 2023-08-09T12:41:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.961+0000 7f1323fff640 1 --2- 172.21.15.17:0/2057442453 >> v2:172.21.15.142:3300/0 conn(0x7f132c0cada0 0x7f132c0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:41:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.962+0000 7f1330a8f640 1 --2- 172.21.15.17:0/2057442453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c0ca9c0 0x7f132c0cddc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13280097a0 tx=0x7f132802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e8dafd5d601270 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.963+0000 7f13237fe640 1 -- 172.21.15.17:0/2057442453 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132802d040 con 0x7f132c0ca9c0 2023-08-09T12:41:24.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.963+0000 7f13237fe640 1 -- 172.21.15.17:0/2057442453 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1328031810 con 0x7f132c0ca9c0 2023-08-09T12:41:24.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.963+0000 7f13237fe640 1 -- 172.21.15.17:0/2057442453 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328031ba0 con 0x7f132c0ca9c0 2023-08-09T12:41:24.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.964+0000 7f1332cf3640 1 -- 172.21.15.17:0/2057442453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c0ca9c0 msgr2=0x7f132c0cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:24.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.964+0000 7f1332cf3640 1 --2- 172.21.15.17:0/2057442453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c0ca9c0 0x7f132c0cddc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13280097a0 tx=0x7f132802b8b0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.964+0000 7f1332cf3640 1 -- 172.21.15.17:0/2057442453 shutdown_connections 2023-08-09T12:41:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.964+0000 7f1332cf3640 1 --2- 172.21.15.17:0/2057442453 >> v2:172.21.15.142:3300/0 conn(0x7f132c0cada0 0x7f132c0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.964+0000 7f1332cf3640 1 --2- 172.21.15.17:0/2057442453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c0ca9c0 0x7f132c0cddc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.964+0000 7f1332cf3640 1 -- 172.21.15.17:0/2057442453 >> 172.21.15.17:0/2057442453 conn(0x7f132c0ce840 msgr2=0x7f132c0cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.964+0000 7f1332cf3640 1 -- 172.21.15.17:0/2057442453 shutdown_connections 2023-08-09T12:41:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.964+0000 7f1332cf3640 1 -- 172.21.15.17:0/2057442453 wait complete. 2023-08-09T12:41:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.967+0000 7f1332cf3640 1 Processor -- start 2023-08-09T12:41:24.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.967+0000 7f1332cf3640 1 -- start start 2023-08-09T12:41:24.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1332cf3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f132c0ca9c0 0x7f132c1f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:24.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1332cf3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f132c0cada0 0x7f132c1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:24.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1332cf3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c15ca40 0x7f132c15a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:24.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1332cf3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c15aeb0 con 0x7f132c0ca9c0 2023-08-09T12:41:24.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1332cf3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c15b190 con 0x7f132c0cada0 2023-08-09T12:41:24.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1332cf3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c15b470 con 0x7f132c15ca40 2023-08-09T12:41:24.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1330a8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f132c0ca9c0 0x7f132c1f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:24.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1330a8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f132c0ca9c0 0x7f132c1f3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40850/0 (socket says 172.21.15.17:40850) 2023-08-09T12:41:24.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.968+0000 7f1330a8f640 1 -- 172.21.15.17:0/612346302 learned_addr learned my addr 172.21.15.17:0/612346302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:24.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.969+0000 7f1331290640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c15ca40 0x7f132c15a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:24.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.969+0000 7f1323fff640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f132c0cada0 0x7f132c1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:24.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.969+0000 7f1330a8f640 1 -- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c15ca40 msgr2=0x7f132c15a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:24.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.969+0000 7f1330a8f640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c15ca40 0x7f132c15a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.969+0000 7f1330a8f640 1 -- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f132c0cada0 msgr2=0x7f132c1f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:24.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.969+0000 7f1330a8f640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f132c0cada0 0x7f132c1f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:24.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.969+0000 7f1330a8f640 1 -- 172.21.15.17:0/612346302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c009400 con 0x7f132c0ca9c0 2023-08-09T12:41:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.969+0000 7f1330a8f640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f132c0ca9c0 0x7f132c1f3ad0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1328000c00 tx=0x7f13280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.970+0000 7f13217fa640 1 -- 172.21.15.17:0/612346302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132803ace0 con 0x7f132c0ca9c0 2023-08-09T12:41:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.970+0000 7f13217fa640 1 -- 172.21.15.17:0/612346302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132803ae40 con 0x7f132c0ca9c0 2023-08-09T12:41:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.970+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1328009400 con 0x7f132c0ca9c0 2023-08-09T12:41:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.970+0000 7f13217fa640 1 -- 172.21.15.17:0/612346302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328044630 con 0x7f132c0ca9c0 2023-08-09T12:41:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.970+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c15ab10 con 0x7f132c0ca9c0 2023-08-09T12:41:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.971+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c067a80 con 0x7f132c0ca9c0 2023-08-09T12:41:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.972+0000 7f13217fa640 1 -- 172.21.15.17:0/612346302 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f132804d450 con 0x7f132c0ca9c0 2023-08-09T12:41:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.973+0000 7f13217fa640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f131806a050 0x7f131806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.973+0000 7f13217fa640 1 -- 172.21.15.17:0/612346302 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f13280aa640 con 0x7f132c0ca9c0 2023-08-09T12:41:24.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.974+0000 7f1323fff640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f131806a050 0x7f131806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:24.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.975+0000 7f1323fff640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f131806a050 0x7f131806c510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f132c15be50 tx=0x7f131c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:24.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:24.980+0000 7f13217fa640 1 -- 172.21.15.17:0/612346302 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f13280760c0 con 0x7f132c0ca9c0 2023-08-09T12:41:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.191+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f132c15aff0 con 0x7f132c0ca9c0 2023-08-09T12:41:25.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.712+0000 7f13217fa640 1 -- 172.21.15.17:0/612346302 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7f132c15aff0 con 0x7f132c0ca9c0 2023-08-09T12:41:25.719 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:41:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f131806a050 msgr2=0x7f131806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:25.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f131806a050 0x7f131806c510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f132c15be50 tx=0x7f131c008040 comp rx=0 tx=0).stop 2023-08-09T12:41:25.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f132c0ca9c0 msgr2=0x7f132c1f3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:25.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f132c0ca9c0 0x7f132c1f3ad0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1328000c00 tx=0x7f13280046c0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 shutdown_connections 2023-08-09T12:41:25.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f131806a050 0x7f131806c510 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f132c15ca40 0x7f132c15a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f132c0cada0 0x7f132c1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 --2- 172.21.15.17:0/612346302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f132c0ca9c0 0x7f132c1f3ad0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 >> 172.21.15.17:0/612346302 conn(0x7f132c0ce840 msgr2=0x7f132c1576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:25.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 shutdown_connections 2023-08-09T12:41:25.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.723+0000 7f1332cf3640 1 -- 172.21.15.17:0/612346302 wait complete. 2023-08-09T12:41:25.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:41:25.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.949+0000 7f0f5b04d640 1 Processor -- start 2023-08-09T12:41:25.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.949+0000 7f0f5b04d640 1 -- start start 2023-08-09T12:41:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.951+0000 7f0f5b04d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f540adc40 0x7f0f5406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:25.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.951+0000 7f0f5b04d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f540b3b40 0x7f0f540b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:25.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.951+0000 7f0f5b04d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f540b2250 con 0x7f0f5415e8f0 2023-08-09T12:41:25.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.951+0000 7f0f5b04d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540ae020 con 0x7f0f540adc40 2023-08-09T12:41:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.951+0000 7f0f5b04d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540b2530 con 0x7f0f540b3b40 2023-08-09T12:41:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.951+0000 7f0f58de9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f540adc40 0x7f0f5406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.951+0000 7f0f58de9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f540adc40 0x7f0f5406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40866/0 (socket says 172.21.15.17:40866) 2023-08-09T12:41:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.951+0000 7f0f58de9640 1 -- 172.21.15.17:0/33557448 learned_addr learned my addr 172.21.15.17:0/33557448 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.952+0000 7f0f53fff640 1 --2- 172.21.15.17:0/33557448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f540b3b40 0x7f0f540b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.952+0000 7f0f58de9640 1 -- 172.21.15.17:0/33557448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f540b3b40 msgr2=0x7f0f540b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.952+0000 7f0f58de9640 1 --2- 172.21.15.17:0/33557448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f540b3b40 0x7f0f540b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.952+0000 7f0f58de9640 1 -- 172.21.15.17:0/33557448 >> v1:172.21.15.142:6789/0 conn(0x7f0f5415e8f0 legacy=0x7f0f5415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.952+0000 7f0f58de9640 1 -- 172.21.15.17:0/33557448 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5406fe80 con 0x7f0f540adc40 2023-08-09T12:41:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.952+0000 7f0f53fff640 1 --2- 172.21.15.17:0/33557448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f540b3b40 0x7f0f540b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:41:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.953+0000 7f0f58de9640 1 --2- 172.21.15.17:0/33557448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5406c280 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009870 tx=0x7f0f4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153e3e3bfdd708c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.954+0000 7f0f537fe640 1 -- 172.21.15.17:0/33557448 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48030840 con 0x7f0f540adc40 2023-08-09T12:41:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.954+0000 7f0f537fe640 1 -- 172.21.15.17:0/33557448 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f480309a0 con 0x7f0f540adc40 2023-08-09T12:41:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.954+0000 7f0f537fe640 1 -- 172.21.15.17:0/33557448 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48030d30 con 0x7f0f540adc40 2023-08-09T12:41:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.954+0000 7f0f5b04d640 1 -- 172.21.15.17:0/33557448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 msgr2=0x7f0f5406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.954+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/33557448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5406c280 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009870 tx=0x7f0f4802b980 comp rx=0 tx=0).stop 2023-08-09T12:41:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.954+0000 7f0f5b04d640 1 -- 172.21.15.17:0/33557448 shutdown_connections 2023-08-09T12:41:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.954+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/33557448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f540b3b40 0x7f0f540b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.954+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/33557448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5406c280 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.955+0000 7f0f5b04d640 1 -- 172.21.15.17:0/33557448 >> 172.21.15.17:0/33557448 conn(0x7f0f540cb1b0 msgr2=0x7f0f540cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.955+0000 7f0f5b04d640 1 -- 172.21.15.17:0/33557448 shutdown_connections 2023-08-09T12:41:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.955+0000 7f0f5b04d640 1 -- 172.21.15.17:0/33557448 wait complete. 2023-08-09T12:41:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.957+0000 7f0f5b04d640 1 Processor -- start 2023-08-09T12:41:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.957+0000 7f0f5b04d640 1 -- start start 2023-08-09T12:41:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f5b04d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5414b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f5b04d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540b3b40 0x7f0f540c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f5b04d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f5415e8f0 0x7f0f5414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f5b04d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5414b810 con 0x7f0f540adc40 2023-08-09T12:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f5b04d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540c5d20 con 0x7f0f540b3b40 2023-08-09T12:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f5b04d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5414c610 con 0x7f0f5415e8f0 2023-08-09T12:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f58de9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5414b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f58de9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5414b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40878/0 (socket says 172.21.15.17:40878) 2023-08-09T12:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f58de9640 1 -- 172.21.15.17:0/3285771239 learned_addr learned my addr 172.21.15.17:0/3285771239 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f58de9640 1 -- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f5415e8f0 msgr2=0x7f0f5414caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f58de9640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f5415e8f0 0x7f0f5414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f58de9640 1 -- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540b3b40 msgr2=0x7f0f540c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.958+0000 7f0f58de9640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540b3b40 0x7f0f540c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.959+0000 7f0f58de9640 1 -- 172.21.15.17:0/3285771239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f480094d0 con 0x7f0f540adc40 2023-08-09T12:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.959+0000 7f0f58de9640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5414b2d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009870 tx=0x7f0f48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.959+0000 7f0f517fa640 1 -- 172.21.15.17:0/3285771239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48039c90 con 0x7f0f540adc40 2023-08-09T12:41:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.959+0000 7f0f517fa640 1 -- 172.21.15.17:0/3285771239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f48039df0 con 0x7f0f540adc40 2023-08-09T12:41:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.959+0000 7f0f517fa640 1 -- 172.21.15.17:0/3285771239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48043620 con 0x7f0f540adc40 2023-08-09T12:41:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.959+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5414ba00 con 0x7f0f540adc40 2023-08-09T12:41:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.960+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5414bfc0 con 0x7f0f540adc40 2023-08-09T12:41:25.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.961+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f54067a80 con 0x7f0f540adc40 2023-08-09T12:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.962+0000 7f0f517fa640 1 -- 172.21.15.17:0/3285771239 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f48043780 con 0x7f0f540adc40 2023-08-09T12:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.963+0000 7f0f517fa640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f3806a050 0x7f0f3806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.963+0000 7f0f517fa640 1 -- 172.21.15.17:0/3285771239 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0f4803e070 con 0x7f0f540adc40 2023-08-09T12:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.964+0000 7f0f53fff640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f3806a050 0x7f0f3806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.965+0000 7f0f53fff640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f3806a050 0x7f0f3806c510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0f40006ea0 tx=0x7f0f40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:25.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:25.968+0000 7f0f517fa640 1 -- 172.21.15.17:0/3285771239 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0f48076de0 con 0x7f0f540adc40 2023-08-09T12:41:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.201+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0f5406ed40 con 0x7f0f540adc40 2023-08-09T12:41:26.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.762+0000 7f0f517fa640 1 -- 172.21.15.17:0/3285771239 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0f4807a400 con 0x7f0f540adc40 2023-08-09T12:41:26.767 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 7 and data pool 8 2023-08-09T12:41:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.769+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f3806a050 msgr2=0x7f0f3806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.769+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f3806a050 0x7f0f3806c510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0f40006ea0 tx=0x7f0f40008040 comp rx=0 tx=0).stop 2023-08-09T12:41:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.769+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 msgr2=0x7f0f5414b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.769+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5414b2d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009870 tx=0x7f0f48004730 comp rx=0 tx=0).stop 2023-08-09T12:41:26.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.769+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 shutdown_connections 2023-08-09T12:41:26.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.770+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f3806a050 0x7f0f3806c510 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:26.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.770+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f5415e8f0 0x7f0f5414caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:26.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.770+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540b3b40 0x7f0f540c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:26.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.770+0000 7f0f5b04d640 1 --2- 172.21.15.17:0/3285771239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f540adc40 0x7f0f5414b2d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:26.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.770+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 >> 172.21.15.17:0/3285771239 conn(0x7f0f540cb1b0 msgr2=0x7f0f5415dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:26.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.770+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 shutdown_connections 2023-08-09T12:41:26.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.771+0000 7f0f5b04d640 1 -- 172.21.15.17:0/3285771239 wait complete. 2023-08-09T12:41:26.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.990+0000 7f2e09a26640 1 Processor -- start 2023-08-09T12:41:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.990+0000 7f2e09a26640 1 -- start start 2023-08-09T12:41:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.991+0000 7f2e09a26640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04070a90 0x7f2e040b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.991+0000 7f2e09a26640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e040ad810 0x7f2e040c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.991+0000 7f2e09a26640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e040b4630 con 0x7f2e04159d80 2023-08-09T12:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.991+0000 7f2e09a26640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0415a160 con 0x7f2e040ad810 2023-08-09T12:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.991+0000 7f2e09a26640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040b3ab0 con 0x7f2e04070a90 2023-08-09T12:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.991+0000 7f2e037fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e040ad810 0x7f2e040c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.992+0000 7f2e037fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e040ad810 0x7f2e040c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40894/0 (socket says 172.21.15.17:40894) 2023-08-09T12:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.992+0000 7f2e037fe640 1 -- 172.21.15.17:0/1741267353 learned_addr learned my addr 172.21.15.17:0/1741267353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.992+0000 7f2e027fc640 1 --2- 172.21.15.17:0/1741267353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04070a90 0x7f2e040b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.992+0000 7f2e037fe640 1 -- 172.21.15.17:0/1741267353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04070a90 msgr2=0x7f2e040b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.992+0000 7f2e037fe640 1 --2- 172.21.15.17:0/1741267353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04070a90 0x7f2e040b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.992+0000 7f2e037fe640 1 -- 172.21.15.17:0/1741267353 >> v1:172.21.15.142:6789/0 conn(0x7f2e04159d80 legacy=0x7f2e04070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.992+0000 7f2e037fe640 1 -- 172.21.15.17:0/1741267353 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040b3d90 con 0x7f2e040ad810 2023-08-09T12:41:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.992+0000 7f2e027fc640 1 --2- 172.21.15.17:0/1741267353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04070a90 0x7f2e040b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.993+0000 7f2e037fe640 1 --2- 172.21.15.17:0/1741267353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e040ad810 0x7f2e040c8fd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009870 tx=0x7f2dfc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb0e72bf1700e74 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.993+0000 7f2e01ffb640 1 -- 172.21.15.17:0/1741267353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc031640 con 0x7f2e040ad810 2023-08-09T12:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.993+0000 7f2e01ffb640 1 -- 172.21.15.17:0/1741267353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0317a0 con 0x7f2e040ad810 2023-08-09T12:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e01ffb640 1 -- 172.21.15.17:0/1741267353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc031b30 con 0x7f2e040ad810 2023-08-09T12:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e09a26640 1 -- 172.21.15.17:0/1741267353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e040ad810 msgr2=0x7f2e040c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e09a26640 1 --2- 172.21.15.17:0/1741267353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e040ad810 0x7f2e040c8fd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009870 tx=0x7f2dfc02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e09a26640 1 -- 172.21.15.17:0/1741267353 shutdown_connections 2023-08-09T12:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e09a26640 1 --2- 172.21.15.17:0/1741267353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e040ad810 0x7f2e040c8fd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e09a26640 1 --2- 172.21.15.17:0/1741267353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04070a90 0x7f2e040b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e09a26640 1 -- 172.21.15.17:0/1741267353 >> 172.21.15.17:0/1741267353 conn(0x7f2e040cb1b0 msgr2=0x7f2e040cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e09a26640 1 -- 172.21.15.17:0/1741267353 shutdown_connections 2023-08-09T12:41:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.994+0000 7f2e09a26640 1 -- 172.21.15.17:0/1741267353 wait complete. 2023-08-09T12:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.996+0000 7f2e09a26640 1 Processor -- start 2023-08-09T12:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.996+0000 7f2e09a26640 1 -- start start 2023-08-09T12:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e09a26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e04070a90 0x7f2e040c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e09a26640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e040ad810 0x7f2e040c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e09a26640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04159d80 0x7f2e04149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e09a26640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0414ad70 con 0x7f2e04070a90 2023-08-09T12:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e09a26640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040c6ec0 con 0x7f2e040ad810 2023-08-09T12:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e09a26640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040c71a0 con 0x7f2e04159d80 2023-08-09T12:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e02ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e04070a90 0x7f2e040c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e02ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e04070a90 0x7f2e040c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40898/0 (socket says 172.21.15.17:40898) 2023-08-09T12:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.997+0000 7f2e02ffd640 1 -- 172.21.15.17:0/2199971781 learned_addr learned my addr 172.21.15.17:0/2199971781 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:27.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e037fe640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04159d80 0x7f2e04149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e027fc640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e040ad810 0x7f2e040c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e02ffd640 1 -- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04159d80 msgr2=0x7f2e04149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e02ffd640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04159d80 0x7f2e04149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e02ffd640 1 -- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e040ad810 msgr2=0x7f2e040c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e02ffd640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e040ad810 0x7f2e040c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e02ffd640 1 -- 172.21.15.17:0/2199971781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0094d0 con 0x7f2e04070a90 2023-08-09T12:41:27.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e027fc640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e040ad810 0x7f2e040c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:27.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.998+0000 7f2e02ffd640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e04070a90 0x7f2e040c67c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2df400ba50 tx=0x7f2df400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:27.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.999+0000 7f2dfbfff640 1 -- 172.21.15.17:0/2199971781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400cbe0 con 0x7f2e04070a90 2023-08-09T12:41:27.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.999+0000 7f2dfbfff640 1 -- 172.21.15.17:0/2199971781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df400cd80 con 0x7f2e04070a90 2023-08-09T12:41:27.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.999+0000 7f2dfbfff640 1 -- 172.21.15.17:0/2199971781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4014680 con 0x7f2e04070a90 2023-08-09T12:41:27.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.999+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e040c7480 con 0x7f2e04070a90 2023-08-09T12:41:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:26.999+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e040c7a40 con 0x7f2e04070a90 2023-08-09T12:41:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.000+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04067a80 con 0x7f2e04070a90 2023-08-09T12:41:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.001+0000 7f2dfbfff640 1 -- 172.21.15.17:0/2199971781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2df40147e0 con 0x7f2e04070a90 2023-08-09T12:41:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.002+0000 7f2dfbfff640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2de406a050 0x7f2de406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.002+0000 7f2dfbfff640 1 -- 172.21.15.17:0/2199971781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2df4088530 con 0x7f2e04070a90 2023-08-09T12:41:27.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.003+0000 7f2e027fc640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2de406a050 0x7f2de406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.004+0000 7f2e027fc640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2de406a050 0x7f2de406c510 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2e0414ab40 tx=0x7f2dec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:27.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.006+0000 7f2dfbfff640 1 -- 172.21.15.17:0/2199971781 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2df4053c30 con 0x7f2e04070a90 2023-08-09T12:41:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.199+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e040b2d20 con 0x7f2e04070a90 2023-08-09T12:41:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.203+0000 7f2dfbfff640 1 -- 172.21.15.17:0/2199971781 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f2df4057250 con 0x7f2e04070a90 2023-08-09T12:41:27.207 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:27.207 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":50,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:41:26.202841+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:41:23.866427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-09T12:41:25.245820+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:27.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2de406a050 msgr2=0x7f2de406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2de406a050 0x7f2de406c510 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2e0414ab40 tx=0x7f2dec008040 comp rx=0 tx=0).stop 2023-08-09T12:41:27.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e04070a90 msgr2=0x7f2e040c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e04070a90 0x7f2e040c67c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2df400ba50 tx=0x7f2df400bf10 comp rx=0 tx=0).stop 2023-08-09T12:41:27.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 shutdown_connections 2023-08-09T12:41:27.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2de406a050 0x7f2de406c510 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e04159d80 0x7f2e04149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e040ad810 0x7f2e040c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 --2- 172.21.15.17:0/2199971781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e04070a90 0x7f2e040c67c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.205+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 >> 172.21.15.17:0/2199971781 conn(0x7f2e040cb1b0 msgr2=0x7f2e040cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:27.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.206+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 shutdown_connections 2023-08-09T12:41:27.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.206+0000 7f2e09a26640 1 -- 172.21.15.17:0/2199971781 wait complete. 2023-08-09T12:41:27.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:27.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.452+0000 7f02ec964640 1 Processor -- start 2023-08-09T12:41:27.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.452+0000 7f02ec964640 1 -- start start 2023-08-09T12:41:27.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02ec964640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f02e815ce90 0x7f02e81616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02ec964640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02e80b6000 0x7f02e80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02ec964640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e80d29d0 0x7f02e80d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02ec964640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80d33a0 con 0x7f02e815ce90 2023-08-09T12:41:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02ec964640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80b6460 con 0x7f02e80b6000 2023-08-09T12:41:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02ec964640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80cda40 con 0x7f02e80d29d0 2023-08-09T12:41:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02e659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f02e815ce90 0x7f02e81616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02e659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f02e815ce90 0x7f02e81616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40906/0 (socket says 172.21.15.17:40906) 2023-08-09T12:41:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02e659c640 1 -- 172.21.15.17:0/1476687142 learned_addr learned my addr 172.21.15.17:0/1476687142 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02e6d9d640 1 --2- 172.21.15.17:0/1476687142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e80d29d0 0x7f02e80d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.455+0000 7f02e659c640 1 -- 172.21.15.17:0/1476687142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e80d29d0 msgr2=0x7f02e80d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.454+0000 7f02e5d9b640 1 --2- 172.21.15.17:0/1476687142 >> v2:172.21.15.142:3300/0 conn(0x7f02e80b6000 0x7f02e80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.455+0000 7f02e659c640 1 --2- 172.21.15.17:0/1476687142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e80d29d0 0x7f02e80d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.455+0000 7f02e659c640 1 -- 172.21.15.17:0/1476687142 >> v2:172.21.15.142:3300/0 conn(0x7f02e80b6000 msgr2=0x7f02e80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.455+0000 7f02e659c640 1 --2- 172.21.15.17:0/1476687142 >> v2:172.21.15.142:3300/0 conn(0x7f02e80b6000 0x7f02e80cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.455+0000 7f02e659c640 1 -- 172.21.15.17:0/1476687142 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80cdd10 con 0x7f02e815ce90 2023-08-09T12:41:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.455+0000 7f02e6d9d640 1 --2- 172.21.15.17:0/1476687142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e80d29d0 0x7f02e80d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.455+0000 7f02e5d9b640 1 --2- 172.21.15.17:0/1476687142 >> v2:172.21.15.142:3300/0 conn(0x7f02e80b6000 0x7f02e80cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.456+0000 7f02e659c640 1 --2- 172.21.15.17:0/1476687142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e815ce90 0x7f02e81616e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f02e80c9c00 tx=0x7f02d802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcb98c16c07ebe5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.456+0000 7f02e559a640 1 -- 172.21.15.17:0/1476687142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d802ca80 con 0x7f02e815ce90 2023-08-09T12:41:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.456+0000 7f02e559a640 1 -- 172.21.15.17:0/1476687142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d802cbe0 con 0x7f02e815ce90 2023-08-09T12:41:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.456+0000 7f02e559a640 1 -- 172.21.15.17:0/1476687142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80343f0 con 0x7f02e815ce90 2023-08-09T12:41:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 -- 172.21.15.17:0/1476687142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e815ce90 msgr2=0x7f02e81616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 --2- 172.21.15.17:0/1476687142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e815ce90 0x7f02e81616e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f02e80c9c00 tx=0x7f02d802bee0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 -- 172.21.15.17:0/1476687142 shutdown_connections 2023-08-09T12:41:27.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 --2- 172.21.15.17:0/1476687142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e80d29d0 0x7f02e80d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 --2- 172.21.15.17:0/1476687142 >> v2:172.21.15.142:3300/0 conn(0x7f02e80b6000 0x7f02e80cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 --2- 172.21.15.17:0/1476687142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e815ce90 0x7f02e81616e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 -- 172.21.15.17:0/1476687142 >> 172.21.15.17:0/1476687142 conn(0x7f02e806fde0 msgr2=0x7f02e80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:27.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 -- 172.21.15.17:0/1476687142 shutdown_connections 2023-08-09T12:41:27.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.457+0000 7f02ec964640 1 -- 172.21.15.17:0/1476687142 wait complete. 2023-08-09T12:41:27.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.459+0000 7f02ec964640 1 Processor -- start 2023-08-09T12:41:27.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.459+0000 7f02ec964640 1 -- start start 2023-08-09T12:41:27.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.460+0000 7f02ec964640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02e80b6000 0x7f02e815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.460+0000 7f02ec964640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e80d29d0 0x7f02e815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.460+0000 7f02ec964640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e815ce90 0x7f02e80aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.460+0000 7f02ec964640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e815d850 con 0x7f02e80d29d0 2023-08-09T12:41:27.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.460+0000 7f02ec964640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e815db30 con 0x7f02e80b6000 2023-08-09T12:41:27.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.460+0000 7f02ec964640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e815de10 con 0x7f02e815ce90 2023-08-09T12:41:27.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e80d29d0 0x7f02e815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e80d29d0 0x7f02e815e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40910/0 (socket says 172.21.15.17:40910) 2023-08-09T12:41:27.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e5d9b640 1 -- 172.21.15.17:0/795656668 learned_addr learned my addr 172.21.15.17:0/795656668 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:27.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e6d9d640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e815ce90 0x7f02e80aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e659c640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02e80b6000 0x7f02e815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e5d9b640 1 -- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e815ce90 msgr2=0x7f02e80aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e5d9b640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e815ce90 0x7f02e80aa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e5d9b640 1 -- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02e80b6000 msgr2=0x7f02e815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e5d9b640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02e80b6000 0x7f02e815d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e5d9b640 1 -- 172.21.15.17:0/795656668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009b30 con 0x7f02e80d29d0 2023-08-09T12:41:27.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.461+0000 7f02e659c640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02e80b6000 0x7f02e815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:27.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.462+0000 7f02e5d9b640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e80d29d0 0x7f02e815e8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f02d000c7f0 tx=0x7f02d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:27.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.462+0000 7f02deffd640 1 -- 172.21.15.17:0/795656668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0007a30 con 0x7f02e80d29d0 2023-08-09T12:41:27.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.462+0000 7f02deffd640 1 -- 172.21.15.17:0/795656668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d0007b90 con 0x7f02e80d29d0 2023-08-09T12:41:27.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.462+0000 7f02deffd640 1 -- 172.21.15.17:0/795656668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d000ce40 con 0x7f02e80d29d0 2023-08-09T12:41:27.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.462+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e815e0f0 con 0x7f02e80d29d0 2023-08-09T12:41:27.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.462+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e80aad50 con 0x7f02e80d29d0 2023-08-09T12:41:27.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.463+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e8160940 con 0x7f02e80d29d0 2023-08-09T12:41:27.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.464+0000 7f02deffd640 1 -- 172.21.15.17:0/795656668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f02d00113f0 con 0x7f02e80d29d0 2023-08-09T12:41:27.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.466+0000 7f02deffd640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f02c806a050 0x7f02c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.466+0000 7f02deffd640 1 -- 172.21.15.17:0/795656668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02d0088780 con 0x7f02e80d29d0 2023-08-09T12:41:27.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.467+0000 7f02e659c640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f02c806a050 0x7f02c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.468+0000 7f02e659c640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f02c806a050 0x7f02c806c510 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f02d8035000 tx=0x7f02d8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:27.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.471+0000 7f02deffd640 1 -- 172.21.15.17:0/795656668 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f02d0053dd0 con 0x7f02e80d29d0 2023-08-09T12:41:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.669+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02e815e610 con 0x7f02e80d29d0 2023-08-09T12:41:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.673+0000 7f02deffd640 1 -- 172.21.15.17:0/795656668 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f02e815e610 con 0x7f02e80d29d0 2023-08-09T12:41:27.677 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:27.677 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":50,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:41:26.202841+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:41:23.866427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-09T12:41:25.245820+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f02c806a050 msgr2=0x7f02c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f02c806a050 0x7f02c806c510 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f02d8035000 tx=0x7f02d8030000 comp rx=0 tx=0).stop 2023-08-09T12:41:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e80d29d0 msgr2=0x7f02e815e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e80d29d0 0x7f02e815e8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f02d000c7f0 tx=0x7f02d000cbf0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 shutdown_connections 2023-08-09T12:41:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f02c806a050 0x7f02c806c510 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02e815ce90 0x7f02e80aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02e80d29d0 0x7f02e815e8f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 --2- 172.21.15.17:0/795656668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02e80b6000 0x7f02e815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.675+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 >> 172.21.15.17:0/795656668 conn(0x7f02e806fde0 msgr2=0x7f02e80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.676+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 shutdown_connections 2023-08-09T12:41:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.676+0000 7f02ec964640 1 -- 172.21.15.17:0/795656668 wait complete. 2023-08-09T12:41:27.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:41:27.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.920+0000 7f059deec640 1 Processor -- start 2023-08-09T12:41:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.920+0000 7f059deec640 1 -- start start 2023-08-09T12:41:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.922+0000 7f059deec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05980ce9e0 0x7f05980cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.922+0000 7f059deec640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f059815b160 0x7f059815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.922+0000 7f059deec640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05980cf380 con 0x7f0598158840 2023-08-09T12:41:27.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.922+0000 7f059deec640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0598158c20 con 0x7f059815b160 2023-08-09T12:41:27.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.922+0000 7f059deec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b0220 con 0x7f05980ce9e0 2023-08-09T12:41:27.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.922+0000 7f05977fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0598158840 0x7f05980af7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55258/0 (socket says 172.21.15.17:55258) 2023-08-09T12:41:27.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.922+0000 7f05977fe640 1 -- 172.21.15.17:0/671601840 learned_addr learned my addr 172.21.15.17:0/671601840 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f0597fff640 1 --2- 172.21.15.17:0/671601840 >> v2:172.21.15.142:3300/0 conn(0x7f059815b160 0x7f059815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f0596ffd640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05980ce9e0 0x7f05980cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780822589 0 0) 0x7f05980cf380 con 0x7f0598158840 2023-08-09T12:41:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0580003520 con 0x7f0598158840 2023-08-09T12:41:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1813708249 0 0) 0x7f0580003520 con 0x7f0598158840 2023-08-09T12:41:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05980ce9e0 msgr2=0x7f05980cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f05967fc640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05980ce9e0 0x7f05980cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 >> v2:172.21.15.142:3300/0 conn(0x7f059815b160 msgr2=0x7f059815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f05967fc640 1 --2- 172.21.15.17:0/671601840 >> v2:172.21.15.142:3300/0 conn(0x7f059815b160 0x7f059815b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.923+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059815e7f0 con 0x7f0598158840 2023-08-09T12:41:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0588001670 con 0x7f0598158840 2023-08-09T12:41:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 >> v1:172.21.15.17:6789/0 conn(0x7f0598158840 legacy=0x7f05980af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05967fc640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580003970 0x7f0580003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05967fc640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05800047c0 0x7f0580004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05967fc640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05980ce9e0 0x7f0580005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598158c20 con 0x7f0580003970 2023-08-09T12:41:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b0220 con 0x7f05800047c0 2023-08-09T12:41:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058000b980 con 0x7f05980ce9e0 2023-08-09T12:41:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05977fe640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580003970 0x7f0580003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f0596ffd640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05800047c0 0x7f0580004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f0597fff640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05980ce9e0 0x7f0580005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.924+0000 7f05977fe640 1 -- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05980ce9e0 msgr2=0x7f0580005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.925+0000 7f05977fe640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05980ce9e0 0x7f0580005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.925+0000 7f05977fe640 1 -- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05800047c0 msgr2=0x7f0580004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.925+0000 7f05977fe640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05800047c0 0x7f0580004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.925+0000 7f05977fe640 1 -- 172.21.15.17:0/671601840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580003520 con 0x7f0580003970 2023-08-09T12:41:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.925+0000 7f0596ffd640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05800047c0 0x7f0580004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:41:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.926+0000 7f05977fe640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580003970 0x7f0580003d90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f058800c290 tx=0x7f05800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84dea36856357ad server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.926+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588005ad0 con 0x7f0580003970 2023-08-09T12:41:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.926+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588005c30 con 0x7f0580003970 2023-08-09T12:41:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.926+0000 7f05967fc640 1 -- 172.21.15.17:0/671601840 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058802c8d0 con 0x7f0580003970 2023-08-09T12:41:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.926+0000 7f059deec640 1 -- 172.21.15.17:0/671601840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580003970 msgr2=0x7f0580003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.926+0000 7f059deec640 1 --2- 172.21.15.17:0/671601840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0580003970 0x7f0580003d90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f058800c290 tx=0x7f05800057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.926+0000 7f0597fff640 1 -- 172.21.15.17:0/671601840 reap_dead start 2023-08-09T12:41:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.927+0000 7f059deec640 1 -- 172.21.15.17:0/671601840 shutdown_connections 2023-08-09T12:41:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.927+0000 7f059deec640 1 -- 172.21.15.17:0/671601840 >> 172.21.15.17:0/671601840 conn(0x7f0598069be0 msgr2=0x7f0598069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.927+0000 7f059deec640 1 -- 172.21.15.17:0/671601840 shutdown_connections 2023-08-09T12:41:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.927+0000 7f059deec640 1 -- 172.21.15.17:0/671601840 wait complete. 2023-08-09T12:41:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.929+0000 7f059deec640 1 Processor -- start 2023-08-09T12:41:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.929+0000 7f059deec640 1 -- start start 2023-08-09T12:41:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f059deec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0580003970 0x7f05981491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f059deec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05980cbfa0 0x7f05980cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f059deec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05980cc420 0x7f05980cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f059deec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598149720 con 0x7f05980cbfa0 2023-08-09T12:41:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f059deec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980cd9b0 con 0x7f05980cc420 2023-08-09T12:41:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f059deec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980cb1e0 con 0x7f0580003970 2023-08-09T12:41:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05980cbfa0 0x7f05980cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05980cbfa0 0x7f05980cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51972/0 (socket says 172.21.15.17:51972) 2023-08-09T12:41:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f0596ffd640 1 -- 172.21.15.17:0/357223652 learned_addr learned my addr 172.21.15.17:0/357223652 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f05977fe640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0580003970 0x7f05981491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f0597fff640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05980cc420 0x7f05980cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f0596ffd640 1 -- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0580003970 msgr2=0x7f05981491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.930+0000 7f0596ffd640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0580003970 0x7f05981491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f0596ffd640 1 -- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05980cc420 msgr2=0x7f05980cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f0596ffd640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05980cc420 0x7f05980cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f0596ffd640 1 -- 172.21.15.17:0/357223652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980cb4c0 con 0x7f05980cbfa0 2023-08-09T12:41:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f0596ffd640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05980cbfa0 0x7f05980cce40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f058c011540 tx=0x7f058c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f057ffff640 1 -- 172.21.15.17:0/357223652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c015870 con 0x7f05980cbfa0 2023-08-09T12:41:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f057ffff640 1 -- 172.21.15.17:0/357223652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c0159d0 con 0x7f05980cbfa0 2023-08-09T12:41:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f057ffff640 1 -- 172.21.15.17:0/357223652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c015d40 con 0x7f05980cbfa0 2023-08-09T12:41:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05980cb7a0 con 0x7f05980cbfa0 2023-08-09T12:41:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.931+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05981516f0 con 0x7f05980cbfa0 2023-08-09T12:41:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.933+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0598067a80 con 0x7f05980cbfa0 2023-08-09T12:41:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.934+0000 7f057ffff640 1 -- 172.21.15.17:0/357223652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f058c00f460 con 0x7f05980cbfa0 2023-08-09T12:41:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.935+0000 7f057ffff640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f058406a050 0x7f058406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:27.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.935+0000 7f057ffff640 1 -- 172.21.15.17:0/357223652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f058c088d50 con 0x7f05980cbfa0 2023-08-09T12:41:27.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.935+0000 7f05977fe640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f058406a050 0x7f058406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:27.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.936+0000 7f05977fe640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f058406a050 0x7f058406c510 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0588034000 tx=0x7f0588007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:27.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:27.939+0000 7f057ffff640 1 -- 172.21.15.17:0/357223652 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f058c08c030 con 0x7f05980cbfa0 2023-08-09T12:41:28.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.171+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0598152990 con 0x7f05980cbfa0 2023-08-09T12:41:28.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.771+0000 7f057ffff640 1 -- 172.21.15.17:0/357223652 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f058c057ed0 con 0x7f05980cbfa0 2023-08-09T12:41:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.774+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f058406a050 msgr2=0x7f058406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.774+0000 7f059deec640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f058406a050 0x7f058406c510 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0588034000 tx=0x7f0588007000 comp rx=0 tx=0).stop 2023-08-09T12:41:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05980cbfa0 msgr2=0x7f05980cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05980cbfa0 0x7f05980cce40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f058c011540 tx=0x7f058c011a00 comp rx=0 tx=0).stop 2023-08-09T12:41:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 shutdown_connections 2023-08-09T12:41:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f058406a050 0x7f058406c510 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05980cc420 0x7f05980cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05980cbfa0 0x7f05980cce40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 --2- 172.21.15.17:0/357223652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0580003970 0x7f05981491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 >> 172.21.15.17:0/357223652 conn(0x7f0598069be0 msgr2=0x7f05980b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 shutdown_connections 2023-08-09T12:41:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:28.775+0000 7f059deec640 1 -- 172.21.15.17:0/357223652 wait complete. 2023-08-09T12:41:28.799 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:41:28.800 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:41:29.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.012+0000 7fe6559d2640 1 Processor -- start 2023-08-09T12:41:29.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.012+0000 7fe6559d2640 1 -- start start 2023-08-09T12:41:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.014+0000 7fe6559d2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe650069ed0 0x7fe6500c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.014+0000 7fe6559d2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6500ccbc0 0x7fe6500ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.014+0000 7fe6559d2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6500cdd40 con 0x7fe65015ca30 2023-08-09T12:41:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.014+0000 7fe6559d2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6500cd130 con 0x7fe6500ccbc0 2023-08-09T12:41:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.014+0000 7fe6559d2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500cd410 con 0x7fe650069ed0 2023-08-09T12:41:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.015+0000 7fe6549d0640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe65015ca30 0x7fe6500697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55268/0 (socket says 172.21.15.17:55268) 2023-08-09T12:41:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.015+0000 7fe6549d0640 1 -- 172.21.15.17:0/1474371598 learned_addr learned my addr 172.21.15.17:0/1474371598 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.015+0000 7fe64ffff640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe650069ed0 0x7fe6500c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.015+0000 7fe6551d1640 1 --2- 172.21.15.17:0/1474371598 >> v2:172.21.15.142:3300/0 conn(0x7fe6500ccbc0 0x7fe6500ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.015+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306252408 0 0) 0x7fe6500cdd40 con 0x7fe65015ca30 2023-08-09T12:41:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.015+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe640003520 con 0x7fe65015ca30 2023-08-09T12:41:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2990448541 0 0) 0x7fe640003520 con 0x7fe65015ca30 2023-08-09T12:41:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe650069ed0 msgr2=0x7fe6500c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe650069ed0 0x7fe6500c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 >> v2:172.21.15.142:3300/0 conn(0x7fe6500ccbc0 msgr2=0x7fe6500ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 --2- 172.21.15.17:0/1474371598 >> v2:172.21.15.142:3300/0 conn(0x7fe6500ccbc0 0x7fe6500ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6500cd6f0 con 0x7fe65015ca30 2023-08-09T12:41:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe644001670 con 0x7fe65015ca30 2023-08-09T12:41:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 >> v1:172.21.15.17:6789/0 conn(0x7fe65015ca30 legacy=0x7fe6500697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe640003970 0x7fe640003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe640004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe650069ed0 0x7fe640005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500cd130 con 0x7fe6400047c0 2023-08-09T12:41:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500cd410 con 0x7fe640003970 2023-08-09T12:41:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64000b980 con 0x7fe650069ed0 2023-08-09T12:41:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64ffff640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe640004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64ffff640 1 -- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe650069ed0 msgr2=0x7fe640005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64ffff640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe650069ed0 0x7fe640005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64ffff640 1 -- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe640003970 msgr2=0x7fe640003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64ffff640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe640003970 0x7fe640003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.016+0000 7fe64ffff640 1 -- 172.21.15.17:0/1474371598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640003520 con 0x7fe6400047c0 2023-08-09T12:41:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.017+0000 7fe64ffff640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe640004c40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009ac0 tx=0x7fe6400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcb29eb47306216 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c02c710 con 0x7fe6400047c0 2023-08-09T12:41:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c02c870 con 0x7fe6400047c0 2023-08-09T12:41:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe64f7fe640 1 -- 172.21.15.17:0/1474371598 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c02cc00 con 0x7fe6400047c0 2023-08-09T12:41:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe6559d2640 1 -- 172.21.15.17:0/1474371598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 msgr2=0x7fe640004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe6559d2640 1 --2- 172.21.15.17:0/1474371598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe640004c40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009ac0 tx=0x7fe6400057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe6551d1640 1 -- 172.21.15.17:0/1474371598 reap_dead start 2023-08-09T12:41:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe6559d2640 1 -- 172.21.15.17:0/1474371598 shutdown_connections 2023-08-09T12:41:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe6559d2640 1 -- 172.21.15.17:0/1474371598 >> 172.21.15.17:0/1474371598 conn(0x7fe65006abd0 msgr2=0x7fe65006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe6559d2640 1 -- 172.21.15.17:0/1474371598 shutdown_connections 2023-08-09T12:41:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.018+0000 7fe6559d2640 1 -- 172.21.15.17:0/1474371598 wait complete. 2023-08-09T12:41:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.020+0000 7fe6559d2640 1 Processor -- start 2023-08-09T12:41:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.020+0000 7fe6559d2640 1 -- start start 2023-08-09T12:41:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6559d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe650154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6559d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe65006fa00 0x7fe650150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6559d2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6501425c0 0x7fe650142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6559d2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe650142fb0 con 0x7fe6400047c0 2023-08-09T12:41:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6559d2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500701e0 con 0x7fe65006fa00 2023-08-09T12:41:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6559d2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6500704c0 con 0x7fe6501425c0 2023-08-09T12:41:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6549d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe650154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6549d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe650154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51984/0 (socket says 172.21.15.17:51984) 2023-08-09T12:41:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.021+0000 7fe6549d0640 1 -- 172.21.15.17:0/3931581634 learned_addr learned my addr 172.21.15.17:0/3931581634 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe6551d1640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6501425c0 0x7fe650142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe6549d0640 1 -- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6501425c0 msgr2=0x7fe650142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe6549d0640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6501425c0 0x7fe650142a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe6549d0640 1 -- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe65006fa00 msgr2=0x7fe650150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe6549d0640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe65006fa00 0x7fe650150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe6549d0640 1 -- 172.21.15.17:0/3931581634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6500707a0 con 0x7fe6400047c0 2023-08-09T12:41:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe6549d0640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe650154500 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe644001eb0 tx=0x7fe64400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe64d7fa640 1 -- 172.21.15.17:0/3931581634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440074e0 con 0x7fe6400047c0 2023-08-09T12:41:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe64d7fa640 1 -- 172.21.15.17:0/3931581634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644007640 con 0x7fe6400047c0 2023-08-09T12:41:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe64d7fa640 1 -- 172.21.15.17:0/3931581634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644004a20 con 0x7fe6400047c0 2023-08-09T12:41:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.022+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe650070a80 con 0x7fe6400047c0 2023-08-09T12:41:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.023+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe650150970 con 0x7fe6400047c0 2023-08-09T12:41:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.024+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe650070fa0 con 0x7fe6400047c0 2023-08-09T12:41:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.025+0000 7fe64d7fa640 1 -- 172.21.15.17:0/3931581634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe644004b80 con 0x7fe6400047c0 2023-08-09T12:41:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.026+0000 7fe64d7fa640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe63406a050 0x7fe63406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.026+0000 7fe64d7fa640 1 -- 172.21.15.17:0/3931581634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe644087b20 con 0x7fe6400047c0 2023-08-09T12:41:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.026+0000 7fe64ffff640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe63406a050 0x7fe63406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.028+0000 7fe64ffff640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe63406a050 0x7fe63406c510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe63c036000 tx=0x7fe63c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.031+0000 7fe64d7fa640 1 -- 172.21.15.17:0/3931581634 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe650070fa0 con 0x7fe6400047c0 2023-08-09T12:41:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.260+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe650070fa0 con 0x7fe6400047c0 2023-08-09T12:41:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.775+0000 7fe64d7fa640 1 -- 172.21.15.17:0/3931581634 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe650070fa0 con 0x7fe6400047c0 2023-08-09T12:41:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe63406a050 msgr2=0x7fe63406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe63406a050 0x7fe63406c510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe63c036000 tx=0x7fe63c02e000 comp rx=0 tx=0).stop 2023-08-09T12:41:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 msgr2=0x7fe650154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:29.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe650154500 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe644001eb0 tx=0x7fe64400ccd0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 shutdown_connections 2023-08-09T12:41:29.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe63406a050 0x7fe63406c510 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6501425c0 0x7fe650142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe65006fa00 0x7fe650150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 --2- 172.21.15.17:0/3931581634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6400047c0 0x7fe650154500 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:29.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.778+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 >> 172.21.15.17:0/3931581634 conn(0x7fe65006abd0 msgr2=0x7fe65015bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:29.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.779+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 shutdown_connections 2023-08-09T12:41:29.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:29.779+0000 7fe6559d2640 1 -- 172.21.15.17:0/3931581634 wait complete. 2023-08-09T12:41:29.803 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:41:29.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.032+0000 7fc2871c9640 1 Processor -- start 2023-08-09T12:41:30.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.032+0000 7fc2871c9640 1 -- start start 2023-08-09T12:41:30.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.034+0000 7fc2871c9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2800adc40 0x7fc28006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.034+0000 7fc2871c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800cc630 0x7fc2800ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.034+0000 7fc2871c9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2800b2250 con 0x7fc2800b3b40 2023-08-09T12:41:30.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.034+0000 7fc2871c9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2800ae020 con 0x7fc2800adc40 2023-08-09T12:41:30.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.034+0000 7fc2871c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2800b2530 con 0x7fc2800cc630 2023-08-09T12:41:30.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.035+0000 7fc284f65640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2800adc40 0x7fc28006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.035+0000 7fc285766640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800cc630 0x7fc2800ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.035+0000 7fc27ffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc2800b3b40 0x7fc2800b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:54848/0 (socket says 172.21.15.17:54848) 2023-08-09T12:41:30.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.035+0000 7fc27ffff640 1 -- 172.21.15.17:0/3874541636 learned_addr learned my addr 172.21.15.17:0/3874541636 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:30.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.036+0000 7fc284f65640 1 -- 172.21.15.17:0/3874541636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800cc630 msgr2=0x7fc2800ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:30.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.036+0000 7fc284f65640 1 --2- 172.21.15.17:0/3874541636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800cc630 0x7fc2800ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.036+0000 7fc284f65640 1 -- 172.21.15.17:0/3874541636 >> v1:172.21.15.142:6789/0 conn(0x7fc2800b3b40 legacy=0x7fc2800b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.036+0000 7fc284f65640 1 -- 172.21.15.17:0/3874541636 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28006fe80 con 0x7fc2800adc40 2023-08-09T12:41:30.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.038+0000 7fc284f65640 1 --2- 172.21.15.17:0/3874541636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800adc40 0x7fc28006c280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2740097a0 tx=0x7fc27402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71bd3097b08f4f34 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:30.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.038+0000 7fc27f7fe640 1 -- 172.21.15.17:0/3874541636 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274031780 con 0x7fc2800adc40 2023-08-09T12:41:30.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.038+0000 7fc27f7fe640 1 -- 172.21.15.17:0/3874541636 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2740318e0 con 0x7fc2800adc40 2023-08-09T12:41:30.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.038+0000 7fc27f7fe640 1 -- 172.21.15.17:0/3874541636 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274031c70 con 0x7fc2800adc40 2023-08-09T12:41:30.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.039+0000 7fc2871c9640 1 -- 172.21.15.17:0/3874541636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800adc40 msgr2=0x7fc28006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.039+0000 7fc2871c9640 1 --2- 172.21.15.17:0/3874541636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800adc40 0x7fc28006c280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2740097a0 tx=0x7fc27402b820 comp rx=0 tx=0).stop 2023-08-09T12:41:30.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.039+0000 7fc2871c9640 1 -- 172.21.15.17:0/3874541636 shutdown_connections 2023-08-09T12:41:30.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.039+0000 7fc2871c9640 1 --2- 172.21.15.17:0/3874541636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800cc630 0x7fc2800ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.039+0000 7fc2871c9640 1 --2- 172.21.15.17:0/3874541636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800adc40 0x7fc28006c280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.039+0000 7fc2871c9640 1 -- 172.21.15.17:0/3874541636 >> 172.21.15.17:0/3874541636 conn(0x7fc2800cb1b0 msgr2=0x7fc2800cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:30.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.039+0000 7fc2871c9640 1 -- 172.21.15.17:0/3874541636 shutdown_connections 2023-08-09T12:41:30.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.039+0000 7fc2871c9640 1 -- 172.21.15.17:0/3874541636 wait complete. 2023-08-09T12:41:30.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.041+0000 7fc2871c9640 1 Processor -- start 2023-08-09T12:41:30.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.041+0000 7fc2871c9640 1 -- start start 2023-08-09T12:41:30.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.042+0000 7fc2871c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800adc40 0x7fc280149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.042+0000 7fc2871c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800b3b40 0x7fc2800c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.042+0000 7fc2871c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800cc630 0x7fc2800c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.042+0000 7fc2871c9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc280157630 con 0x7fc2800adc40 2023-08-09T12:41:30.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.042+0000 7fc2871c9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc280157910 con 0x7fc2800cc630 2023-08-09T12:41:30.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.042+0000 7fc2871c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc280157bf0 con 0x7fc2800b3b40 2023-08-09T12:41:30.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.042+0000 7fc284f65640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800adc40 0x7fc280149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc284f65640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800adc40 0x7fc280149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51990/0 (socket says 172.21.15.17:51990) 2023-08-09T12:41:30.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc284f65640 1 -- 172.21.15.17:0/1919359296 learned_addr learned my addr 172.21.15.17:0/1919359296 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:30.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc27ffff640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800b3b40 0x7fc2800c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc285766640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800cc630 0x7fc2800c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc284f65640 1 -- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800b3b40 msgr2=0x7fc2800c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc284f65640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800b3b40 0x7fc2800c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc284f65640 1 -- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800cc630 msgr2=0x7fc2800c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc284f65640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800cc630 0x7fc2800c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc284f65640 1 -- 172.21.15.17:0/1919359296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274009400 con 0x7fc2800adc40 2023-08-09T12:41:30.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.043+0000 7fc284f65640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800adc40 0x7fc280149a30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc274034040 tx=0x7fc2740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:30.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.044+0000 7fc27d7fa640 1 -- 172.21.15.17:0/1919359296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274032820 con 0x7fc2800adc40 2023-08-09T12:41:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.044+0000 7fc27d7fa640 1 -- 172.21.15.17:0/1919359296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274032980 con 0x7fc2800adc40 2023-08-09T12:41:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.044+0000 7fc27d7fa640 1 -- 172.21.15.17:0/1919359296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274032d30 con 0x7fc2800adc40 2023-08-09T12:41:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.044+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc280157ed0 con 0x7fc2800adc40 2023-08-09T12:41:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.044+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc280149f70 con 0x7fc2800adc40 2023-08-09T12:41:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.045+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28014a100 con 0x7fc2800adc40 2023-08-09T12:41:30.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.046+0000 7fc27d7fa640 1 -- 172.21.15.17:0/1919359296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc27404e440 con 0x7fc2800adc40 2023-08-09T12:41:30.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.047+0000 7fc27d7fa640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc26406a050 0x7fc26406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.047+0000 7fc27d7fa640 1 -- 172.21.15.17:0/1919359296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2740aa6b0 con 0x7fc2800adc40 2023-08-09T12:41:30.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.048+0000 7fc27ffff640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc26406a050 0x7fc26406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.049+0000 7fc27ffff640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc26406a050 0x7fc26406c510 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc2801574d0 tx=0x7fc26c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:30.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.051+0000 7fc27d7fa640 1 -- 172.21.15.17:0/1919359296 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc28014a100 con 0x7fc2800adc40 2023-08-09T12:41:30.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.284+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc28014a100 con 0x7fc2800adc40 2023-08-09T12:41:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.285+0000 7fc27d7fa640 1 -- 172.21.15.17:0/1919359296 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7fc28014a100 con 0x7fc2800adc40 2023-08-09T12:41:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:41:30.289 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:41:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc26406a050 msgr2=0x7fc26406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc26406a050 0x7fc26406c510 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc2801574d0 tx=0x7fc26c009040 comp rx=0 tx=0).stop 2023-08-09T12:41:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800adc40 msgr2=0x7fc280149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800adc40 0x7fc280149a30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc274034040 tx=0x7fc2740046c0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 shutdown_connections 2023-08-09T12:41:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc26406a050 0x7fc26406c510 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2800cc630 0x7fc2800c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2800b3b40 0x7fc2800c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 --2- 172.21.15.17:0/1919359296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800adc40 0x7fc280149a30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.288+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 >> 172.21.15.17:0/1919359296 conn(0x7fc2800cb1b0 msgr2=0x7fc2800ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:30.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.289+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 shutdown_connections 2023-08-09T12:41:30.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.289+0000 7fc2871c9640 1 -- 172.21.15.17:0/1919359296 wait complete. 2023-08-09T12:41:30.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:41:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.528+0000 7fa757164640 1 Processor -- start 2023-08-09T12:41:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.528+0000 7fa757164640 1 -- start start 2023-08-09T12:41:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.530+0000 7fa757164640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa750161280 0x7fa7500c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.530+0000 7fa757164640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7500acfc0 0x7fa7500cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.530+0000 7fa757164640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75015df30 con 0x7fa750161660 2023-08-09T12:41:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.530+0000 7fa757164640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75015d430 con 0x7fa750161280 2023-08-09T12:41:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.530+0000 7fa757164640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500ca9d0 con 0x7fa7500acfc0 2023-08-09T12:41:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.531+0000 7fa755701640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7500acfc0 0x7fa7500cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.531+0000 7fa754f00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa750161280 0x7fa7500c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.531+0000 7fa74ffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa750161660 0x7fa7500ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:54856/0 (socket says 172.21.15.17:54856) 2023-08-09T12:41:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.531+0000 7fa74ffff640 1 -- 172.21.15.17:0/1140588750 learned_addr learned my addr 172.21.15.17:0/1140588750 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.532+0000 7fa755701640 1 -- 172.21.15.17:0/1140588750 >> v2:172.21.15.142:3300/0 conn(0x7fa750161280 msgr2=0x7fa7500c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.532+0000 7fa755701640 1 --2- 172.21.15.17:0/1140588750 >> v2:172.21.15.142:3300/0 conn(0x7fa750161280 0x7fa7500c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.532+0000 7fa755701640 1 -- 172.21.15.17:0/1140588750 >> v1:172.21.15.142:6789/0 conn(0x7fa750161660 legacy=0x7fa7500ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.532+0000 7fa755701640 1 -- 172.21.15.17:0/1140588750 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75015e3c0 con 0x7fa7500acfc0 2023-08-09T12:41:30.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.533+0000 7fa755701640 1 --2- 172.21.15.17:0/1140588750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7500acfc0 0x7fa7500cc630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa748009d90 tx=0x7fa74802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b95f8a8d79a1274 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:30.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.534+0000 7fa74f7fe640 1 -- 172.21.15.17:0/1140588750 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74802cbd0 con 0x7fa7500acfc0 2023-08-09T12:41:30.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.534+0000 7fa74f7fe640 1 -- 172.21.15.17:0/1140588750 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74802cd30 con 0x7fa7500acfc0 2023-08-09T12:41:30.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.534+0000 7fa74f7fe640 1 -- 172.21.15.17:0/1140588750 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74802cea0 con 0x7fa7500acfc0 2023-08-09T12:41:30.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.535+0000 7fa757164640 1 -- 172.21.15.17:0/1140588750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7500acfc0 msgr2=0x7fa7500cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.535+0000 7fa757164640 1 --2- 172.21.15.17:0/1140588750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7500acfc0 0x7fa7500cc630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa748009d90 tx=0x7fa74802be20 comp rx=0 tx=0).stop 2023-08-09T12:41:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.535+0000 7fa757164640 1 -- 172.21.15.17:0/1140588750 shutdown_connections 2023-08-09T12:41:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.535+0000 7fa757164640 1 --2- 172.21.15.17:0/1140588750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7500acfc0 0x7fa7500cc630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.535+0000 7fa757164640 1 --2- 172.21.15.17:0/1140588750 >> v2:172.21.15.142:3300/0 conn(0x7fa750161280 0x7fa7500c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.535+0000 7fa757164640 1 -- 172.21.15.17:0/1140588750 >> 172.21.15.17:0/1140588750 conn(0x7fa7500cb1b0 msgr2=0x7fa7500cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.535+0000 7fa757164640 1 -- 172.21.15.17:0/1140588750 shutdown_connections 2023-08-09T12:41:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.535+0000 7fa757164640 1 -- 172.21.15.17:0/1140588750 wait complete. 2023-08-09T12:41:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.537+0000 7fa757164640 1 Processor -- start 2023-08-09T12:41:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.537+0000 7fa757164640 1 -- start start 2023-08-09T12:41:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.538+0000 7fa757164640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500acfc0 0x7fa7500af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.538+0000 7fa757164640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa750161280 0x7fa750150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.538+0000 7fa757164640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa750161660 0x7fa7501511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.538+0000 7fa757164640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500aedb0 con 0x7fa7500acfc0 2023-08-09T12:41:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.538+0000 7fa757164640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500ae130 con 0x7fa750161280 2023-08-09T12:41:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.538+0000 7fa757164640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500ae410 con 0x7fa750161660 2023-08-09T12:41:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500acfc0 0x7fa7500af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500acfc0 0x7fa7500af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51998/0 (socket says 172.21.15.17:51998) 2023-08-09T12:41:30.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 -- 172.21.15.17:0/2962941135 learned_addr learned my addr 172.21.15.17:0/2962941135 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:30.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa755701640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa750161660 0x7fa7501511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa74ffff640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa750161280 0x7fa750150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 -- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa750161660 msgr2=0x7fa7501511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa750161660 0x7fa7501511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 -- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa750161280 msgr2=0x7fa750150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa750161280 0x7fa750150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 -- 172.21.15.17:0/2962941135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009a70 con 0x7fa7500acfc0 2023-08-09T12:41:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa755701640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa750161660 0x7fa7501511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa74ffff640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa750161280 0x7fa750150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.539+0000 7fa754f00640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500acfc0 0x7fa7500af7e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e870 tx=0x7fa74400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.540+0000 7fa74d7fa640 1 -- 172.21.15.17:0/2962941135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440094f0 con 0x7fa7500acfc0 2023-08-09T12:41:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.540+0000 7fa74d7fa640 1 -- 172.21.15.17:0/2962941135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400c940 con 0x7fa7500acfc0 2023-08-09T12:41:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.540+0000 7fa74d7fa640 1 -- 172.21.15.17:0/2962941135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400ccf0 con 0x7fa7500acfc0 2023-08-09T12:41:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.540+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7500ae6f0 con 0x7fa7500acfc0 2023-08-09T12:41:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.540+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7500af1d0 con 0x7fa7500acfc0 2023-08-09T12:41:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.541+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7500af020 con 0x7fa7500acfc0 2023-08-09T12:41:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.542+0000 7fa74d7fa640 1 -- 172.21.15.17:0/2962941135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa744013470 con 0x7fa7500acfc0 2023-08-09T12:41:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.543+0000 7fa74d7fa640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa73406a050 0x7fa73406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.543+0000 7fa74d7fa640 1 -- 172.21.15.17:0/2962941135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7440886f0 con 0x7fa7500acfc0 2023-08-09T12:41:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.544+0000 7fa74ffff640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa73406a050 0x7fa73406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.545+0000 7fa74ffff640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa73406a050 0x7fa73406c510 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa7500b11f0 tx=0x7fa73c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.547+0000 7fa74d7fa640 1 -- 172.21.15.17:0/2962941135 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa744053dd0 con 0x7fa7500acfc0 2023-08-09T12:41:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.745+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa750067a80 con 0x7fa7500acfc0 2023-08-09T12:41:30.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.747+0000 7fa74d7fa640 1 -- 172.21.15.17:0/2962941135 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fa7440573f0 con 0x7fa7500acfc0 2023-08-09T12:41:30.751 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:30.752 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:41:27.727631+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:41:23.866427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-09T12:41:25.245820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:41:30.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa73406a050 msgr2=0x7fa73406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa73406a050 0x7fa73406c510 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa7500b11f0 tx=0x7fa73c009040 comp rx=0 tx=0).stop 2023-08-09T12:41:30.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500acfc0 msgr2=0x7fa7500af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:30.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500acfc0 0x7fa7500af7e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e870 tx=0x7fa74400ed30 comp rx=0 tx=0).stop 2023-08-09T12:41:30.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 shutdown_connections 2023-08-09T12:41:30.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa73406a050 0x7fa73406c510 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa750161660 0x7fa7501511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa750161280 0x7fa750150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 --2- 172.21.15.17:0/2962941135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500acfc0 0x7fa7500af7e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:30.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 >> 172.21.15.17:0/2962941135 conn(0x7fa7500cb1b0 msgr2=0x7fa75006bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:30.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 shutdown_connections 2023-08-09T12:41:30.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.750+0000 7fa757164640 1 -- 172.21.15.17:0/2962941135 wait complete. 2023-08-09T12:41:30.773 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:41:30.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:41:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.998+0000 7fe0b66f9640 1 Processor -- start 2023-08-09T12:41:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:30.999+0000 7fe0b66f9640 1 -- start start 2023-08-09T12:41:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.000+0000 7fe0b66f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00ad810 0x7fe0b00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.000+0000 7fe0b66f9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b00b4630 con 0x7fe0b0070a90 2023-08-09T12:41:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.000+0000 7fe0b66f9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b00b3ab0 con 0x7fe0b0159d80 2023-08-09T12:41:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.000+0000 7fe0b66f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b015a160 con 0x7fe0b00ad810 2023-08-09T12:41:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.001+0000 7fe0a77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe0b0070a90 0x7fe0b00c8fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55272/0 (socket says 172.21.15.17:55272) 2023-08-09T12:41:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.001+0000 7fe0a77fe640 1 -- 172.21.15.17:0/1707627331 learned_addr learned my addr 172.21.15.17:0/1707627331 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.001+0000 7fe0b4c96640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00ad810 0x7fe0b00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.001+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752841149 0 0) 0x7fe0b00b4630 con 0x7fe0b0070a90 2023-08-09T12:41:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.001+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe09c003520 con 0x7fe0b0070a90 2023-08-09T12:41:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.001+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3844726033 0 0) 0x7fe09c003520 con 0x7fe0b0070a90 2023-08-09T12:41:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.001+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00ad810 msgr2=0x7fe0b00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.001+0000 7fe0af7fe640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00ad810 0x7fe0b00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 >> v1:172.21.15.142:6789/0 conn(0x7fe0b0159d80 legacy=0x7fe0b0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00b3d90 con 0x7fe0b0070a90 2023-08-09T12:41:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe0980017f0 con 0x7fe0b0070a90 2023-08-09T12:41:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 >> v1:172.21.15.17:6789/0 conn(0x7fe0b0070a90 legacy=0x7fe0b00c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00ad810 0x7fe09c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c003f20 0x7fe09c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09c004d00 0x7fe09c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b015a160 con 0x7fe09c004d00 2023-08-09T12:41:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c00ba60 con 0x7fe09c003f20 2023-08-09T12:41:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c00de30 con 0x7fe0b00ad810 2023-08-09T12:41:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0b4c96640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09c004d00 0x7fe09c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0affff640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00ad810 0x7fe09c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0a77fe640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c003f20 0x7fe09c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0b4c96640 1 -- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00ad810 msgr2=0x7fe09c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0b4c96640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00ad810 0x7fe09c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0b4c96640 1 -- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c003f20 msgr2=0x7fe09c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.002+0000 7fe0b4c96640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c003f20 0x7fe09c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.003+0000 7fe0b4c96640 1 -- 172.21.15.17:0/1707627331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c003520 con 0x7fe09c004d00 2023-08-09T12:41:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.004+0000 7fe0b4c96640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09c004d00 0x7fe09c005180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009fc0 tx=0x7fe09c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a498e383d1ee66 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.004+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a802cc20 con 0x7fe09c004d00 2023-08-09T12:41:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.004+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800f040 con 0x7fe09c004d00 2023-08-09T12:41:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.004+0000 7fe0af7fe640 1 -- 172.21.15.17:0/1707627331 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8034440 con 0x7fe09c004d00 2023-08-09T12:41:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.004+0000 7fe0b66f9640 1 -- 172.21.15.17:0/1707627331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09c004d00 msgr2=0x7fe09c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.004+0000 7fe0b66f9640 1 --2- 172.21.15.17:0/1707627331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09c004d00 0x7fe09c005180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009fc0 tx=0x7fe09c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.004+0000 7fe0b4c96640 1 -- 172.21.15.17:0/1707627331 reap_dead start 2023-08-09T12:41:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.005+0000 7fe0b66f9640 1 -- 172.21.15.17:0/1707627331 shutdown_connections 2023-08-09T12:41:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.005+0000 7fe0b66f9640 1 -- 172.21.15.17:0/1707627331 >> 172.21.15.17:0/1707627331 conn(0x7fe0b00cb1b0 msgr2=0x7fe0b00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.005+0000 7fe0b66f9640 1 -- 172.21.15.17:0/1707627331 shutdown_connections 2023-08-09T12:41:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.005+0000 7fe0b66f9640 1 -- 172.21.15.17:0/1707627331 wait complete. 2023-08-09T12:41:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.007+0000 7fe0b66f9640 1 Processor -- start 2023-08-09T12:41:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.007+0000 7fe0b66f9640 1 -- start start 2023-08-09T12:41:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0b66f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c004d00 0x7fe0b0154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0b66f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0b01e4fb0 0x7fe0b00ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0b66f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00aed40 0x7fe0b00ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0b66f9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b01e5470 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0b66f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b01e5750 con 0x7fe09c004d00 2023-08-09T12:41:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0b66f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b01e5a30 con 0x7fe0b00aed40 2023-08-09T12:41:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0b01e4fb0 0x7fe0b00ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0b01e4fb0 0x7fe0b00ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52016/0 (socket says 172.21.15.17:52016) 2023-08-09T12:41:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0a77fe640 1 -- 172.21.15.17:0/445913283 learned_addr learned my addr 172.21.15.17:0/445913283 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0affff640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c004d00 0x7fe0b0154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.008+0000 7fe0b4c96640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00aed40 0x7fe0b00ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0a77fe640 1 -- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00aed40 msgr2=0x7fe0b00ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0a77fe640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00aed40 0x7fe0b00ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0a77fe640 1 -- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c004d00 msgr2=0x7fe0b0154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0a77fe640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c004d00 0x7fe0b0154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0a77fe640 1 -- 172.21.15.17:0/445913283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b01e5d10 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0a77fe640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0b01e4fb0 0x7fe0b00ae160 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe09800e6d0 tx=0x7fe09800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0ad7fa640 1 -- 172.21.15.17:0/445913283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980070d0 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0ad7fa640 1 -- 172.21.15.17:0/445913283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098007250 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0ad7fa640 1 -- 172.21.15.17:0/445913283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098007600 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b01e5ff0 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.009+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b01e6b80 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.011+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b0067a80 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.011+0000 7fe0ad7fa640 1 -- 172.21.15.17:0/445913283 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe0980059b0 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.012+0000 7fe0ad7fa640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe09006a050 0x7fe09006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.012+0000 7fe0ad7fa640 1 -- 172.21.15.17:0/445913283 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe098088910 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.013+0000 7fe0affff640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe09006a050 0x7fe09006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.014+0000 7fe0affff640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe09006a050 0x7fe09006c510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0007fd0 tx=0x7fe0a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:31.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.016+0000 7fe0ad7fa640 1 -- 172.21.15.17:0/445913283 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe098053f60 con 0x7fe0b01e4fb0 2023-08-09T12:41:31.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.203+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0b00b4350 con 0x7fe09006a050 2023-08-09T12:41:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.229+0000 7fe0ad7fa640 1 -- 172.21.15.17:0/445913283 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300732 (secure 0 0 0) 0x7fe0a000d050 con 0x7fe09006a050 2023-08-09T12:41:31.237 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:41:31.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe09006a050 msgr2=0x7fe09006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe09006a050 0x7fe09006c510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0007fd0 tx=0x7fe0a0009040 comp rx=0 tx=0).stop 2023-08-09T12:41:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0b01e4fb0 msgr2=0x7fe0b00ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0b01e4fb0 0x7fe0b00ae160 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe09800e6d0 tx=0x7fe09800eb90 comp rx=0 tx=0).stop 2023-08-09T12:41:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 shutdown_connections 2023-08-09T12:41:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe09006a050 0x7fe09006c510 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0b00aed40 0x7fe0b00ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0b01e4fb0 0x7fe0b00ae160 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 --2- 172.21.15.17:0/445913283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe09c004d00 0x7fe0b0154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.234+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 >> 172.21.15.17:0/445913283 conn(0x7fe0b00cb1b0 msgr2=0x7fe0b00ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.235+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 shutdown_connections 2023-08-09T12:41:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.235+0000 7fe0b66f9640 1 -- 172.21.15.17:0/445913283 wait complete. 2023-08-09T12:41:31.256 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-08-09T12:41:30.679852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3095,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559404,"statfs":{"total":1600000000,"available":1596830628,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994474"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.708068+0000","last_change":"2023-08-09T12:41:25.708068+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.708068+0000","last_undegraded":"2023-08-09T12:41:25.708068+0000","last_fullsized":"2023-08-09T12:41:25.708068+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754794+0000","last_change":"2023-08-09T12:41:26.754678+0000","last_active":"2023-08-09T12:41:26.754794+0000","last_peered":"2023-08-09T12:41:26.754794+0000","last_clean":"2023-08-09T12:41:26.754794+0000","last_became_active":"2023-08-09T12:41:26.754276+0000","last_became_peered":"2023-08-09T12:41:26.754276+0000","last_unstale":"2023-08-09T12:41:26.754794+0000","last_undegraded":"2023-08-09T12:41:26.754794+0000","last_fullsized":"2023-08-09T12:41:26.754794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:53:52.596963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700690+0000","last_change":"2023-08-09T12:41:25.700690+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700690+0000","last_undegraded":"2023-08-09T12:41:25.700690+0000","last_fullsized":"2023-08-09T12:41:25.700690+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.749039+0000","last_change":"2023-08-09T12:41:26.748928+0000","last_active":"2023-08-09T12:41:26.749039+0000","last_peered":"2023-08-09T12:41:26.749039+0000","last_clean":"2023-08-09T12:41:26.749039+0000","last_became_active":"2023-08-09T12:41:26.748363+0000","last_became_peered":"2023-08-09T12:41:26.748363+0000","last_unstale":"2023-08-09T12:41:26.749039+0000","last_undegraded":"2023-08-09T12:41:26.749039+0000","last_fullsized":"2023-08-09T12:41:26.749039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:14.075784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754016+0000","last_change":"2023-08-09T12:41:26.753475+0000","last_active":"2023-08-09T12:41:26.754016+0000","last_peered":"2023-08-09T12:41:26.754016+0000","last_clean":"2023-08-09T12:41:26.754016+0000","last_became_active":"2023-08-09T12:41:26.753219+0000","last_became_peered":"2023-08-09T12:41:26.753219+0000","last_unstale":"2023-08-09T12:41:26.754016+0000","last_undegraded":"2023-08-09T12:41:26.754016+0000","last_fullsized":"2023-08-09T12:41:26.754016+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.707203+0000","last_change":"2023-08-09T12:41:25.707203+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.707203+0000","last_undegraded":"2023-08-09T12:41:25.707203+0000","last_fullsized":"2023-08-09T12:41:25.707203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.703555+0000","last_change":"2023-08-09T12:41:25.703555+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.703555+0000","last_undegraded":"2023-08-09T12:41:25.703555+0000","last_fullsized":"2023-08-09T12:41:25.703555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.765244+0000","last_change":"2023-08-09T12:41:26.764924+0000","last_active":"2023-08-09T12:41:26.765244+0000","last_peered":"2023-08-09T12:41:26.765244+0000","last_clean":"2023-08-09T12:41:26.765244+0000","last_became_active":"2023-08-09T12:41:26.764684+0000","last_became_peered":"2023-08-09T12:41:26.764684+0000","last_unstale":"2023-08-09T12:41:26.765244+0000","last_undegraded":"2023-08-09T12:41:26.765244+0000","last_fullsized":"2023-08-09T12:41:26.765244+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:35:48.443783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.766472+0000","last_change":"2023-08-09T12:41:26.766387+0000","last_active":"2023-08-09T12:41:26.766472+0000","last_peered":"2023-08-09T12:41:26.766472+0000","last_clean":"2023-08-09T12:41:26.766472+0000","last_became_active":"2023-08-09T12:41:26.765392+0000","last_became_peered":"2023-08-09T12:41:26.765392+0000","last_unstale":"2023-08-09T12:41:26.766472+0000","last_undegraded":"2023-08-09T12:41:26.766472+0000","last_fullsized":"2023-08-09T12:41:26.766472+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:48.342228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.704905+0000","last_change":"2023-08-09T12:41:25.704905+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.704905+0000","last_undegraded":"2023-08-09T12:41:25.704905+0000","last_fullsized":"2023-08-09T12:41:25.704905+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753006+0000","last_change":"2023-08-09T12:41:26.751660+0000","last_active":"2023-08-09T12:41:26.753006+0000","last_peered":"2023-08-09T12:41:26.753006+0000","last_clean":"2023-08-09T12:41:26.753006+0000","last_became_active":"2023-08-09T12:41:26.751076+0000","last_became_peered":"2023-08-09T12:41:26.751076+0000","last_unstale":"2023-08-09T12:41:26.753006+0000","last_undegraded":"2023-08-09T12:41:26.753006+0000","last_fullsized":"2023-08-09T12:41:26.753006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:28:29.430515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744213+0000","last_change":"2023-08-09T12:41:26.744068+0000","last_active":"2023-08-09T12:41:26.744213+0000","last_peered":"2023-08-09T12:41:26.744213+0000","last_clean":"2023-08-09T12:41:26.744213+0000","last_became_active":"2023-08-09T12:41:26.742814+0000","last_became_peered":"2023-08-09T12:41:26.742814+0000","last_unstale":"2023-08-09T12:41:26.744213+0000","last_undegraded":"2023-08-09T12:41:26.744213+0000","last_fullsized":"2023-08-09T12:41:26.744213+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:13:01.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.706498+0000","last_change":"2023-08-09T12:41:25.706498+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.706498+0000","last_undegraded":"2023-08-09T12:41:25.706498+0000","last_fullsized":"2023-08-09T12:41:25.706498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.701414+0000","last_change":"2023-08-09T12:41:25.701414+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.701414+0000","last_undegraded":"2023-08-09T12:41:25.701414+0000","last_fullsized":"2023-08-09T12:41:25.701414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.747123+0000","last_change":"2023-08-09T12:41:26.741311+0000","last_active":"2023-08-09T12:41:26.747123+0000","last_peered":"2023-08-09T12:41:26.747123+0000","last_clean":"2023-08-09T12:41:26.747123+0000","last_became_active":"2023-08-09T12:41:26.740668+0000","last_became_peered":"2023-08-09T12:41:26.740668+0000","last_unstale":"2023-08-09T12:41:26.747123+0000","last_undegraded":"2023-08-09T12:41:26.747123+0000","last_fullsized":"2023-08-09T12:41:26.747123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:48.189765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.706144+0000","last_change":"2023-08-09T12:41:25.706144+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.706144+0000","last_undegraded":"2023-08-09T12:41:25.706144+0000","last_fullsized":"2023-08-09T12:41:25.706144+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700012+0000","last_change":"2023-08-09T12:41:25.700012+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700012+0000","last_undegraded":"2023-08-09T12:41:25.700012+0000","last_fullsized":"2023-08-09T12:41:25.700012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753924+0000","last_change":"2023-08-09T12:41:26.752877+0000","last_active":"2023-08-09T12:41:26.753924+0000","last_peered":"2023-08-09T12:41:26.753924+0000","last_clean":"2023-08-09T12:41:26.753924+0000","last_became_active":"2023-08-09T12:41:26.752230+0000","last_became_peered":"2023-08-09T12:41:26.752230+0000","last_unstale":"2023-08-09T12:41:26.753924+0000","last_undegraded":"2023-08-09T12:41:26.753924+0000","last_fullsized":"2023-08-09T12:41:26.753924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:47:13.757008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702258+0000","last_change":"2023-08-09T12:41:25.702258+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702258+0000","last_undegraded":"2023-08-09T12:41:25.702258+0000","last_fullsized":"2023-08-09T12:41:25.702258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.755461+0000","last_change":"2023-08-09T12:41:26.755290+0000","last_active":"2023-08-09T12:41:26.755461+0000","last_peered":"2023-08-09T12:41:26.755461+0000","last_clean":"2023-08-09T12:41:26.755461+0000","last_became_active":"2023-08-09T12:41:26.753410+0000","last_became_peered":"2023-08-09T12:41:26.753410+0000","last_unstale":"2023-08-09T12:41:26.755461+0000","last_undegraded":"2023-08-09T12:41:26.755461+0000","last_fullsized":"2023-08-09T12:41:26.755461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:20.535847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758524+0000","last_change":"2023-08-09T12:41:26.758273+0000","last_active":"2023-08-09T12:41:26.758524+0000","last_peered":"2023-08-09T12:41:26.758524+0000","last_clean":"2023-08-09T12:41:26.758524+0000","last_became_active":"2023-08-09T12:41:26.753618+0000","last_became_peered":"2023-08-09T12:41:26.753618+0000","last_unstale":"2023-08-09T12:41:26.758524+0000","last_undegraded":"2023-08-09T12:41:26.758524+0000","last_fullsized":"2023-08-09T12:41:26.758524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:18.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.762564+0000","last_change":"2023-08-09T12:41:26.762381+0000","last_active":"2023-08-09T12:41:26.762564+0000","last_peered":"2023-08-09T12:41:26.762564+0000","last_clean":"2023-08-09T12:41:26.762564+0000","last_became_active":"2023-08-09T12:41:26.761594+0000","last_became_peered":"2023-08-09T12:41:26.761594+0000","last_unstale":"2023-08-09T12:41:26.762564+0000","last_undegraded":"2023-08-09T12:41:26.762564+0000","last_fullsized":"2023-08-09T12:41:26.762564+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:34.790459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754310+0000","last_change":"2023-08-09T12:41:26.753387+0000","last_active":"2023-08-09T12:41:26.754310+0000","last_peered":"2023-08-09T12:41:26.754310+0000","last_clean":"2023-08-09T12:41:26.754310+0000","last_became_active":"2023-08-09T12:41:26.752651+0000","last_became_peered":"2023-08-09T12:41:26.752651+0000","last_unstale":"2023-08-09T12:41:26.754310+0000","last_undegraded":"2023-08-09T12:41:26.754310+0000","last_fullsized":"2023-08-09T12:41:26.754310+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:05.292154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700584+0000","last_change":"2023-08-09T12:41:25.700584+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700584+0000","last_undegraded":"2023-08-09T12:41:25.700584+0000","last_fullsized":"2023-08-09T12:41:25.700584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.708070+0000","last_change":"2023-08-09T12:41:25.708070+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.708070+0000","last_undegraded":"2023-08-09T12:41:25.708070+0000","last_fullsized":"2023-08-09T12:41:25.708070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743932+0000","last_change":"2023-08-09T12:41:26.742962+0000","last_active":"2023-08-09T12:41:26.743932+0000","last_peered":"2023-08-09T12:41:26.743932+0000","last_clean":"2023-08-09T12:41:26.743932+0000","last_became_active":"2023-08-09T12:41:26.742314+0000","last_became_peered":"2023-08-09T12:41:26.742314+0000","last_unstale":"2023-08-09T12:41:26.743932+0000","last_undegraded":"2023-08-09T12:41:26.743932+0000","last_fullsized":"2023-08-09T12:41:26.743932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:03:40.448213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.705108+0000","last_change":"2023-08-09T12:41:25.705108+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.705108+0000","last_undegraded":"2023-08-09T12:41:25.705108+0000","last_fullsized":"2023-08-09T12:41:25.705108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743241+0000","last_change":"2023-08-09T12:41:26.742817+0000","last_active":"2023-08-09T12:41:26.743241+0000","last_peered":"2023-08-09T12:41:26.743241+0000","last_clean":"2023-08-09T12:41:26.743241+0000","last_became_active":"2023-08-09T12:41:26.742199+0000","last_became_peered":"2023-08-09T12:41:26.742199+0000","last_unstale":"2023-08-09T12:41:26.743241+0000","last_undegraded":"2023-08-09T12:41:26.743241+0000","last_fullsized":"2023-08-09T12:41:26.743241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:38.407498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699671+0000","last_change":"2023-08-09T12:41:25.699671+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699671+0000","last_undegraded":"2023-08-09T12:41:25.699671+0000","last_fullsized":"2023-08-09T12:41:25.699671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.759692+0000","last_change":"2023-08-09T12:41:26.759612+0000","last_active":"2023-08-09T12:41:26.759692+0000","last_peered":"2023-08-09T12:41:26.759692+0000","last_clean":"2023-08-09T12:41:26.759692+0000","last_became_active":"2023-08-09T12:41:26.759326+0000","last_became_peered":"2023-08-09T12:41:26.759326+0000","last_unstale":"2023-08-09T12:41:26.759692+0000","last_undegraded":"2023-08-09T12:41:26.759692+0000","last_fullsized":"2023-08-09T12:41:26.759692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:51.748893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699396+0000","last_change":"2023-08-09T12:41:25.699396+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699396+0000","last_undegraded":"2023-08-09T12:41:25.699396+0000","last_fullsized":"2023-08-09T12:41:25.699396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.760804+0000","last_change":"2023-08-09T12:41:26.760698+0000","last_active":"2023-08-09T12:41:26.760804+0000","last_peered":"2023-08-09T12:41:26.760804+0000","last_clean":"2023-08-09T12:41:26.760804+0000","last_became_active":"2023-08-09T12:41:26.760285+0000","last_became_peered":"2023-08-09T12:41:26.760285+0000","last_unstale":"2023-08-09T12:41:26.760804+0000","last_undegraded":"2023-08-09T12:41:26.760804+0000","last_fullsized":"2023-08-09T12:41:26.760804+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:37.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754195+0000","last_change":"2023-08-09T12:41:26.754093+0000","last_active":"2023-08-09T12:41:26.754195+0000","last_peered":"2023-08-09T12:41:26.754195+0000","last_clean":"2023-08-09T12:41:26.754195+0000","last_became_active":"2023-08-09T12:41:26.752605+0000","last_became_peered":"2023-08-09T12:41:26.752605+0000","last_unstale":"2023-08-09T12:41:26.754195+0000","last_undegraded":"2023-08-09T12:41:26.754195+0000","last_fullsized":"2023-08-09T12:41:26.754195+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:56:34.930871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.775310+0000","last_change":"2023-08-09T12:41:25.721830+0000","last_active":"2023-08-09T12:41:26.775310+0000","last_peered":"2023-08-09T12:41:26.775310+0000","last_clean":"2023-08-09T12:41:26.775310+0000","last_became_active":"2023-08-09T12:41:25.721477+0000","last_became_peered":"2023-08-09T12:41:25.721477+0000","last_unstale":"2023-08-09T12:41:26.775310+0000","last_undegraded":"2023-08-09T12:41:26.775310+0000","last_fullsized":"2023-08-09T12:41:26.775310+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:17:17.790512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.752846+0000","last_change":"2023-08-09T12:41:26.752060+0000","last_active":"2023-08-09T12:41:26.752846+0000","last_peered":"2023-08-09T12:41:26.752846+0000","last_clean":"2023-08-09T12:41:26.752846+0000","last_became_active":"2023-08-09T12:41:26.751292+0000","last_became_peered":"2023-08-09T12:41:26.751292+0000","last_unstale":"2023-08-09T12:41:26.752846+0000","last_undegraded":"2023-08-09T12:41:26.752846+0000","last_fullsized":"2023-08-09T12:41:26.752846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:12:09.364968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.718335+0000","last_change":"2023-08-09T12:41:25.718240+0000","last_active":"2023-08-09T12:41:25.718335+0000","last_peered":"2023-08-09T12:41:25.718335+0000","last_clean":"2023-08-09T12:41:25.718335+0000","last_became_active":"2023-08-09T12:41:25.717916+0000","last_became_peered":"2023-08-09T12:41:25.717916+0000","last_unstale":"2023-08-09T12:41:25.718335+0000","last_undegraded":"2023-08-09T12:41:25.718335+0000","last_fullsized":"2023-08-09T12:41:25.718335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:30:50.797135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758137+0000","last_change":"2023-08-09T12:41:26.754052+0000","last_active":"2023-08-09T12:41:26.758137+0000","last_peered":"2023-08-09T12:41:26.758137+0000","last_clean":"2023-08-09T12:41:26.758137+0000","last_became_active":"2023-08-09T12:41:26.752928+0000","last_became_peered":"2023-08-09T12:41:26.752928+0000","last_unstale":"2023-08-09T12:41:26.758137+0000","last_undegraded":"2023-08-09T12:41:26.758137+0000","last_fullsized":"2023-08-09T12:41:26.758137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:38:59.971994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.719460+0000","last_change":"2023-08-09T12:41:25.719346+0000","last_active":"2023-08-09T12:41:25.719460+0000","last_peered":"2023-08-09T12:41:25.719460+0000","last_clean":"2023-08-09T12:41:25.719460+0000","last_became_active":"2023-08-09T12:41:25.719015+0000","last_became_peered":"2023-08-09T12:41:25.719015+0000","last_unstale":"2023-08-09T12:41:25.719460+0000","last_undegraded":"2023-08-09T12:41:25.719460+0000","last_fullsized":"2023-08-09T12:41:25.719460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:29:52.920254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743989+0000","last_change":"2023-08-09T12:41:26.743217+0000","last_active":"2023-08-09T12:41:26.743989+0000","last_peered":"2023-08-09T12:41:26.743989+0000","last_clean":"2023-08-09T12:41:26.743989+0000","last_became_active":"2023-08-09T12:41:26.742517+0000","last_became_peered":"2023-08-09T12:41:26.742517+0000","last_unstale":"2023-08-09T12:41:26.743989+0000","last_undegraded":"2023-08-09T12:41:26.743989+0000","last_fullsized":"2023-08-09T12:41:26.743989+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:34.058833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776911+0000","last_change":"2023-08-09T12:41:25.722114+0000","last_active":"2023-08-09T12:41:26.776911+0000","last_peered":"2023-08-09T12:41:26.776911+0000","last_clean":"2023-08-09T12:41:26.776911+0000","last_became_active":"2023-08-09T12:41:25.721669+0000","last_became_peered":"2023-08-09T12:41:25.721669+0000","last_unstale":"2023-08-09T12:41:26.776911+0000","last_undegraded":"2023-08-09T12:41:26.776911+0000","last_fullsized":"2023-08-09T12:41:26.776911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:17.540738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.770166+0000","last_change":"2023-08-09T12:41:26.770070+0000","last_active":"2023-08-09T12:41:26.770166+0000","last_peered":"2023-08-09T12:41:26.770166+0000","last_clean":"2023-08-09T12:41:26.770166+0000","last_became_active":"2023-08-09T12:41:26.769738+0000","last_became_peered":"2023-08-09T12:41:26.769738+0000","last_unstale":"2023-08-09T12:41:26.770166+0000","last_undegraded":"2023-08-09T12:41:26.770166+0000","last_fullsized":"2023-08-09T12:41:26.770166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:47.795643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.722227+0000","last_change":"2023-08-09T12:41:25.722107+0000","last_active":"2023-08-09T12:41:25.722227+0000","last_peered":"2023-08-09T12:41:25.722227+0000","last_clean":"2023-08-09T12:41:25.722227+0000","last_became_active":"2023-08-09T12:41:25.721515+0000","last_became_peered":"2023-08-09T12:41:25.721515+0000","last_unstale":"2023-08-09T12:41:25.722227+0000","last_undegraded":"2023-08-09T12:41:25.722227+0000","last_fullsized":"2023-08-09T12:41:25.722227+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:37.179674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761806+0000","last_change":"2023-08-09T12:41:26.761679+0000","last_active":"2023-08-09T12:41:26.761806+0000","last_peered":"2023-08-09T12:41:26.761806+0000","last_clean":"2023-08-09T12:41:26.761806+0000","last_became_active":"2023-08-09T12:41:26.761434+0000","last_became_peered":"2023-08-09T12:41:26.761434+0000","last_unstale":"2023-08-09T12:41:26.761806+0000","last_undegraded":"2023-08-09T12:41:26.761806+0000","last_fullsized":"2023-08-09T12:41:26.761806+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:07:29.451454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.775777+0000","last_change":"2023-08-09T12:41:25.720698+0000","last_active":"2023-08-09T12:41:26.775777+0000","last_peered":"2023-08-09T12:41:26.775777+0000","last_clean":"2023-08-09T12:41:26.775777+0000","last_became_active":"2023-08-09T12:41:25.720198+0000","last_became_peered":"2023-08-09T12:41:25.720198+0000","last_unstale":"2023-08-09T12:41:26.775777+0000","last_undegraded":"2023-08-09T12:41:26.775777+0000","last_fullsized":"2023-08-09T12:41:26.775777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:03.256797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744033+0000","last_change":"2023-08-09T12:41:26.743459+0000","last_active":"2023-08-09T12:41:26.744033+0000","last_peered":"2023-08-09T12:41:26.744033+0000","last_clean":"2023-08-09T12:41:26.744033+0000","last_became_active":"2023-08-09T12:41:26.741850+0000","last_became_peered":"2023-08-09T12:41:26.741850+0000","last_unstale":"2023-08-09T12:41:26.744033+0000","last_undegraded":"2023-08-09T12:41:26.744033+0000","last_fullsized":"2023-08-09T12:41:26.744033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:47.795643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738984+0000","last_change":"2023-08-09T12:41:25.718176+0000","last_active":"2023-08-09T12:41:26.738984+0000","last_peered":"2023-08-09T12:41:26.738984+0000","last_clean":"2023-08-09T12:41:26.738984+0000","last_became_active":"2023-08-09T12:41:25.717644+0000","last_became_peered":"2023-08-09T12:41:25.717644+0000","last_unstale":"2023-08-09T12:41:26.738984+0000","last_undegraded":"2023-08-09T12:41:26.738984+0000","last_fullsized":"2023-08-09T12:41:26.738984+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:22:25.646805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.756590+0000","last_change":"2023-08-09T12:41:26.756431+0000","last_active":"2023-08-09T12:41:26.756590+0000","last_peered":"2023-08-09T12:41:26.756590+0000","last_clean":"2023-08-09T12:41:26.756590+0000","last_became_active":"2023-08-09T12:41:26.755532+0000","last_became_peered":"2023-08-09T12:41:26.755532+0000","last_unstale":"2023-08-09T12:41:26.756590+0000","last_undegraded":"2023-08-09T12:41:26.756590+0000","last_fullsized":"2023-08-09T12:41:26.756590+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:08:32.383305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.722268+0000","last_change":"2023-08-09T12:41:25.722201+0000","last_active":"2023-08-09T12:41:25.722268+0000","last_peered":"2023-08-09T12:41:25.722268+0000","last_clean":"2023-08-09T12:41:25.722268+0000","last_became_active":"2023-08-09T12:41:25.721923+0000","last_became_peered":"2023-08-09T12:41:25.721923+0000","last_unstale":"2023-08-09T12:41:25.722268+0000","last_undegraded":"2023-08-09T12:41:25.722268+0000","last_fullsized":"2023-08-09T12:41:25.722268+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:54.880610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758159+0000","last_change":"2023-08-09T12:41:26.757770+0000","last_active":"2023-08-09T12:41:26.758159+0000","last_peered":"2023-08-09T12:41:26.758159+0000","last_clean":"2023-08-09T12:41:26.758159+0000","last_became_active":"2023-08-09T12:41:26.757533+0000","last_became_peered":"2023-08-09T12:41:26.757533+0000","last_unstale":"2023-08-09T12:41:26.758159+0000","last_undegraded":"2023-08-09T12:41:26.758159+0000","last_fullsized":"2023-08-09T12:41:26.758159+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731870+0000","last_change":"2023-08-09T12:41:25.709057+0000","last_active":"2023-08-09T12:41:26.731870+0000","last_peered":"2023-08-09T12:41:26.731870+0000","last_clean":"2023-08-09T12:41:26.731870+0000","last_became_active":"2023-08-09T12:41:25.708378+0000","last_became_peered":"2023-08-09T12:41:25.708378+0000","last_unstale":"2023-08-09T12:41:26.731870+0000","last_undegraded":"2023-08-09T12:41:26.731870+0000","last_fullsized":"2023-08-09T12:41:26.731870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:47:39.880663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.752876+0000","last_change":"2023-08-09T12:41:26.752598+0000","last_active":"2023-08-09T12:41:26.752876+0000","last_peered":"2023-08-09T12:41:26.752876+0000","last_clean":"2023-08-09T12:41:26.752876+0000","last_became_active":"2023-08-09T12:41:26.752197+0000","last_became_peered":"2023-08-09T12:41:26.752197+0000","last_unstale":"2023-08-09T12:41:26.752876+0000","last_undegraded":"2023-08-09T12:41:26.752876+0000","last_fullsized":"2023-08-09T12:41:26.752876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:21.832052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.746841+0000","last_change":"2023-08-09T12:41:25.710502+0000","last_active":"2023-08-09T12:41:26.746841+0000","last_peered":"2023-08-09T12:41:26.746841+0000","last_clean":"2023-08-09T12:41:26.746841+0000","last_became_active":"2023-08-09T12:41:25.709843+0000","last_became_peered":"2023-08-09T12:41:25.709843+0000","last_unstale":"2023-08-09T12:41:26.746841+0000","last_undegraded":"2023-08-09T12:41:26.746841+0000","last_fullsized":"2023-08-09T12:41:26.746841+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:47.337548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.701483+0000","last_change":"2023-08-09T12:41:25.701483+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.701483+0000","last_undegraded":"2023-08-09T12:41:25.701483+0000","last_fullsized":"2023-08-09T12:41:25.701483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776412+0000","last_change":"2023-08-09T12:41:25.719290+0000","last_active":"2023-08-09T12:41:26.776412+0000","last_peered":"2023-08-09T12:41:26.776412+0000","last_clean":"2023-08-09T12:41:26.776412+0000","last_became_active":"2023-08-09T12:41:25.718919+0000","last_became_peered":"2023-08-09T12:41:25.718919+0000","last_unstale":"2023-08-09T12:41:26.776412+0000","last_undegraded":"2023-08-09T12:41:26.776412+0000","last_fullsized":"2023-08-09T12:41:26.776412+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:33.297308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761037+0000","last_change":"2023-08-09T12:41:26.760937+0000","last_active":"2023-08-09T12:41:26.761037+0000","last_peered":"2023-08-09T12:41:26.761037+0000","last_clean":"2023-08-09T12:41:26.761037+0000","last_became_active":"2023-08-09T12:41:26.760393+0000","last_became_peered":"2023-08-09T12:41:26.760393+0000","last_unstale":"2023-08-09T12:41:26.761037+0000","last_undegraded":"2023-08-09T12:41:26.761037+0000","last_fullsized":"2023-08-09T12:41:26.761037+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:41.857557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.780748+0000","last_change":"2023-08-09T12:41:25.720123+0000","last_active":"2023-08-09T12:41:26.780748+0000","last_peered":"2023-08-09T12:41:26.780748+0000","last_clean":"2023-08-09T12:41:26.780748+0000","last_became_active":"2023-08-09T12:41:25.719183+0000","last_became_peered":"2023-08-09T12:41:25.719183+0000","last_unstale":"2023-08-09T12:41:26.780748+0000","last_undegraded":"2023-08-09T12:41:26.780748+0000","last_fullsized":"2023-08-09T12:41:26.780748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:56.678204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758850+0000","last_change":"2023-08-09T12:41:26.758726+0000","last_active":"2023-08-09T12:41:26.758850+0000","last_peered":"2023-08-09T12:41:26.758850+0000","last_clean":"2023-08-09T12:41:26.758850+0000","last_became_active":"2023-08-09T12:41:26.757570+0000","last_became_peered":"2023-08-09T12:41:26.757570+0000","last_unstale":"2023-08-09T12:41:26.758850+0000","last_undegraded":"2023-08-09T12:41:26.758850+0000","last_fullsized":"2023-08-09T12:41:26.758850+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:02:45.834158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.716371+0000","last_change":"2023-08-09T12:41:25.716255+0000","last_active":"2023-08-09T12:41:25.716371+0000","last_peered":"2023-08-09T12:41:25.716371+0000","last_clean":"2023-08-09T12:41:25.716371+0000","last_became_active":"2023-08-09T12:41:25.714648+0000","last_became_peered":"2023-08-09T12:41:25.714648+0000","last_unstale":"2023-08-09T12:41:25.716371+0000","last_undegraded":"2023-08-09T12:41:25.716371+0000","last_fullsized":"2023-08-09T12:41:25.716371+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:26.550315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.707272+0000","last_change":"2023-08-09T12:41:25.707272+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.707272+0000","last_undegraded":"2023-08-09T12:41:25.707272+0000","last_fullsized":"2023-08-09T12:41:25.707272+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738127+0000","last_change":"2023-08-09T12:41:25.723688+0000","last_active":"2023-08-09T12:41:26.738127+0000","last_peered":"2023-08-09T12:41:26.738127+0000","last_clean":"2023-08-09T12:41:26.738127+0000","last_became_active":"2023-08-09T12:41:25.723451+0000","last_became_peered":"2023-08-09T12:41:25.723451+0000","last_unstale":"2023-08-09T12:41:26.738127+0000","last_undegraded":"2023-08-09T12:41:26.738127+0000","last_fullsized":"2023-08-09T12:41:26.738127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:32:35.893052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744105+0000","last_change":"2023-08-09T12:41:26.743468+0000","last_active":"2023-08-09T12:41:26.744105+0000","last_peered":"2023-08-09T12:41:26.744105+0000","last_clean":"2023-08-09T12:41:26.744105+0000","last_became_active":"2023-08-09T12:41:26.742242+0000","last_became_peered":"2023-08-09T12:41:26.742242+0000","last_unstale":"2023-08-09T12:41:26.744105+0000","last_undegraded":"2023-08-09T12:41:26.744105+0000","last_fullsized":"2023-08-09T12:41:26.744105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731611+0000","last_change":"2023-08-09T12:41:25.722103+0000","last_active":"2023-08-09T12:41:26.731611+0000","last_peered":"2023-08-09T12:41:26.731611+0000","last_clean":"2023-08-09T12:41:26.731611+0000","last_became_active":"2023-08-09T12:41:25.721815+0000","last_became_peered":"2023-08-09T12:41:25.721815+0000","last_unstale":"2023-08-09T12:41:26.731611+0000","last_undegraded":"2023-08-09T12:41:26.731611+0000","last_fullsized":"2023-08-09T12:41:26.731611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:54:46.850648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702253+0000","last_change":"2023-08-09T12:41:25.702253+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702253+0000","last_undegraded":"2023-08-09T12:41:25.702253+0000","last_fullsized":"2023-08-09T12:41:25.702253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.779665+0000","last_change":"2023-08-09T12:41:25.719684+0000","last_active":"2023-08-09T12:41:26.779665+0000","last_peered":"2023-08-09T12:41:26.779665+0000","last_clean":"2023-08-09T12:41:26.779665+0000","last_became_active":"2023-08-09T12:41:25.719316+0000","last_became_peered":"2023-08-09T12:41:25.719316+0000","last_unstale":"2023-08-09T12:41:26.779665+0000","last_undegraded":"2023-08-09T12:41:26.779665+0000","last_fullsized":"2023-08-09T12:41:26.779665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:48:02.235976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758788+0000","last_change":"2023-08-09T12:41:26.758613+0000","last_active":"2023-08-09T12:41:26.758788+0000","last_peered":"2023-08-09T12:41:26.758788+0000","last_clean":"2023-08-09T12:41:26.758788+0000","last_became_active":"2023-08-09T12:41:26.758211+0000","last_became_peered":"2023-08-09T12:41:26.758211+0000","last_unstale":"2023-08-09T12:41:26.758788+0000","last_undegraded":"2023-08-09T12:41:26.758788+0000","last_fullsized":"2023-08-09T12:41:26.758788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:09.252796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.721874+0000","last_change":"2023-08-09T12:41:25.721784+0000","last_active":"2023-08-09T12:41:25.721874+0000","last_peered":"2023-08-09T12:41:25.721874+0000","last_clean":"2023-08-09T12:41:25.721874+0000","last_became_active":"2023-08-09T12:41:25.721531+0000","last_became_peered":"2023-08-09T12:41:25.721531+0000","last_unstale":"2023-08-09T12:41:25.721874+0000","last_undegraded":"2023-08-09T12:41:25.721874+0000","last_fullsized":"2023-08-09T12:41:25.721874+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:52.643529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696206+0000","last_change":"2023-08-09T12:41:25.696206+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696206+0000","last_undegraded":"2023-08-09T12:41:25.696206+0000","last_fullsized":"2023-08-09T12:41:25.696206+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.777344+0000","last_change":"2023-08-09T12:41:25.709300+0000","last_active":"2023-08-09T12:41:26.777344+0000","last_peered":"2023-08-09T12:41:26.777344+0000","last_clean":"2023-08-09T12:41:26.777344+0000","last_became_active":"2023-08-09T12:41:25.708777+0000","last_became_peered":"2023-08-09T12:41:25.708777+0000","last_unstale":"2023-08-09T12:41:26.777344+0000","last_undegraded":"2023-08-09T12:41:26.777344+0000","last_fullsized":"2023-08-09T12:41:26.777344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:47.305579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758125+0000","last_change":"2023-08-09T12:41:26.757742+0000","last_active":"2023-08-09T12:41:26.758125+0000","last_peered":"2023-08-09T12:41:26.758125+0000","last_clean":"2023-08-09T12:41:26.758125+0000","last_became_active":"2023-08-09T12:41:26.757342+0000","last_became_peered":"2023-08-09T12:41:26.757342+0000","last_unstale":"2023-08-09T12:41:26.758125+0000","last_undegraded":"2023-08-09T12:41:26.758125+0000","last_fullsized":"2023-08-09T12:41:26.758125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:38.646768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776113+0000","last_change":"2023-08-09T12:41:25.719868+0000","last_active":"2023-08-09T12:41:26.776113+0000","last_peered":"2023-08-09T12:41:26.776113+0000","last_clean":"2023-08-09T12:41:26.776113+0000","last_became_active":"2023-08-09T12:41:25.719554+0000","last_became_peered":"2023-08-09T12:41:25.719554+0000","last_unstale":"2023-08-09T12:41:26.776113+0000","last_undegraded":"2023-08-09T12:41:26.776113+0000","last_fullsized":"2023-08-09T12:41:26.776113+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:38:39.040223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696110+0000","last_change":"2023-08-09T12:41:25.696110+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696110+0000","last_undegraded":"2023-08-09T12:41:25.696110+0000","last_fullsized":"2023-08-09T12:41:25.696110+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738629+0000","last_change":"2023-08-09T12:41:25.723181+0000","last_active":"2023-08-09T12:41:26.738629+0000","last_peered":"2023-08-09T12:41:26.738629+0000","last_clean":"2023-08-09T12:41:26.738629+0000","last_became_active":"2023-08-09T12:41:25.722598+0000","last_became_peered":"2023-08-09T12:41:25.722598+0000","last_unstale":"2023-08-09T12:41:26.738629+0000","last_undegraded":"2023-08-09T12:41:26.738629+0000","last_fullsized":"2023-08-09T12:41:26.738629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:38.626616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754788+0000","last_change":"2023-08-09T12:41:26.753949+0000","last_active":"2023-08-09T12:41:26.754788+0000","last_peered":"2023-08-09T12:41:26.754788+0000","last_clean":"2023-08-09T12:41:26.754788+0000","last_became_active":"2023-08-09T12:41:26.753622+0000","last_became_peered":"2023-08-09T12:41:26.753622+0000","last_unstale":"2023-08-09T12:41:26.754788+0000","last_undegraded":"2023-08-09T12:41:26.754788+0000","last_fullsized":"2023-08-09T12:41:26.754788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:46.872566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.709228+0000","last_change":"2023-08-09T12:41:25.708766+0000","last_active":"2023-08-09T12:41:25.709228+0000","last_peered":"2023-08-09T12:41:25.709228+0000","last_clean":"2023-08-09T12:41:25.709228+0000","last_became_active":"2023-08-09T12:41:25.707255+0000","last_became_peered":"2023-08-09T12:41:25.707255+0000","last_unstale":"2023-08-09T12:41:25.709228+0000","last_undegraded":"2023-08-09T12:41:25.709228+0000","last_fullsized":"2023-08-09T12:41:25.709228+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:08:12.653133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753241+0000","last_change":"2023-08-09T12:41:26.752241+0000","last_active":"2023-08-09T12:41:26.753241+0000","last_peered":"2023-08-09T12:41:26.753241+0000","last_clean":"2023-08-09T12:41:26.753241+0000","last_became_active":"2023-08-09T12:41:26.751882+0000","last_became_peered":"2023-08-09T12:41:26.751882+0000","last_unstale":"2023-08-09T12:41:26.753241+0000","last_undegraded":"2023-08-09T12:41:26.753241+0000","last_fullsized":"2023-08-09T12:41:26.753241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:59.216428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740913+0000","last_change":"2023-08-09T12:41:25.719956+0000","last_active":"2023-08-09T12:41:26.740913+0000","last_peered":"2023-08-09T12:41:26.740913+0000","last_clean":"2023-08-09T12:41:26.740913+0000","last_became_active":"2023-08-09T12:41:25.718827+0000","last_became_peered":"2023-08-09T12:41:25.718827+0000","last_unstale":"2023-08-09T12:41:26.740913+0000","last_undegraded":"2023-08-09T12:41:26.740913+0000","last_fullsized":"2023-08-09T12:41:26.740913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:54.138658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699913+0000","last_change":"2023-08-09T12:41:25.699913+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699913+0000","last_undegraded":"2023-08-09T12:41:25.699913+0000","last_fullsized":"2023-08-09T12:41:25.699913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.721313+0000","last_change":"2023-08-09T12:41:25.716973+0000","last_active":"2023-08-09T12:41:25.721313+0000","last_peered":"2023-08-09T12:41:25.721313+0000","last_clean":"2023-08-09T12:41:25.721313+0000","last_became_active":"2023-08-09T12:41:25.715880+0000","last_became_peered":"2023-08-09T12:41:25.715880+0000","last_unstale":"2023-08-09T12:41:25.721313+0000","last_undegraded":"2023-08-09T12:41:25.721313+0000","last_fullsized":"2023-08-09T12:41:25.721313+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:09:16.682395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.704075+0000","last_change":"2023-08-09T12:41:25.704075+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.704075+0000","last_undegraded":"2023-08-09T12:41:25.704075+0000","last_fullsized":"2023-08-09T12:41:25.704075+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740848+0000","last_change":"2023-08-09T12:41:25.709666+0000","last_active":"2023-08-09T12:41:26.740848+0000","last_peered":"2023-08-09T12:41:26.740848+0000","last_clean":"2023-08-09T12:41:26.740848+0000","last_became_active":"2023-08-09T12:41:25.708958+0000","last_became_peered":"2023-08-09T12:41:25.708958+0000","last_unstale":"2023-08-09T12:41:26.740848+0000","last_undegraded":"2023-08-09T12:41:26.740848+0000","last_fullsized":"2023-08-09T12:41:26.740848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:11:27.015801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.755138+0000","last_change":"2023-08-09T12:41:26.753676+0000","last_active":"2023-08-09T12:41:26.755138+0000","last_peered":"2023-08-09T12:41:26.755138+0000","last_clean":"2023-08-09T12:41:26.755138+0000","last_became_active":"2023-08-09T12:41:26.752998+0000","last_became_peered":"2023-08-09T12:41:26.752998+0000","last_unstale":"2023-08-09T12:41:26.755138+0000","last_undegraded":"2023-08-09T12:41:26.755138+0000","last_fullsized":"2023-08-09T12:41:26.755138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:54:39.014147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.717010+0000","last_change":"2023-08-09T12:41:25.716719+0000","last_active":"2023-08-09T12:41:25.717010+0000","last_peered":"2023-08-09T12:41:25.717010+0000","last_clean":"2023-08-09T12:41:25.717010+0000","last_became_active":"2023-08-09T12:41:25.715489+0000","last_became_peered":"2023-08-09T12:41:25.715489+0000","last_unstale":"2023-08-09T12:41:25.717010+0000","last_undegraded":"2023-08-09T12:41:25.717010+0000","last_fullsized":"2023-08-09T12:41:25.717010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:12.934546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":224,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.732256+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:41:26.732256+0000","last_peered":"2023-08-09T12:41:26.732256+0000","last_clean":"2023-08-09T12:41:26.732256+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:41:26.732256+0000","last_undegraded":"2023-08-09T12:41:26.732256+0000","last_fullsized":"2023-08-09T12:41:26.732256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:01:34.343333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.751118+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:41:26.751118+0000","last_peered":"2023-08-09T12:41:26.751118+0000","last_clean":"2023-08-09T12:41:26.751118+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:41:26.751118+0000","last_undegraded":"2023-08-09T12:41:26.751118+0000","last_fullsized":"2023-08-09T12:41:26.751118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:14:32.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696149+0000","last_change":"2023-08-09T12:41:25.696149+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696149+0000","last_undegraded":"2023-08-09T12:41:25.696149+0000","last_fullsized":"2023-08-09T12:41:25.696149+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731668+0000","last_change":"2023-08-09T12:41:25.713983+0000","last_active":"2023-08-09T12:41:26.731668+0000","last_peered":"2023-08-09T12:41:26.731668+0000","last_clean":"2023-08-09T12:41:26.731668+0000","last_became_active":"2023-08-09T12:41:25.713370+0000","last_became_peered":"2023-08-09T12:41:25.713370+0000","last_unstale":"2023-08-09T12:41:26.731668+0000","last_undegraded":"2023-08-09T12:41:26.731668+0000","last_fullsized":"2023-08-09T12:41:26.731668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:55:29.675233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731892+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:41:26.731892+0000","last_peered":"2023-08-09T12:41:26.731892+0000","last_clean":"2023-08-09T12:41:26.731892+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:41:26.731892+0000","last_undegraded":"2023-08-09T12:41:26.731892+0000","last_fullsized":"2023-08-09T12:41:26.731892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:46.369931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754637+0000","last_change":"2023-08-09T12:41:26.754103+0000","last_active":"2023-08-09T12:41:26.754637+0000","last_peered":"2023-08-09T12:41:26.754637+0000","last_clean":"2023-08-09T12:41:26.754637+0000","last_became_active":"2023-08-09T12:41:26.753433+0000","last_became_peered":"2023-08-09T12:41:26.753433+0000","last_unstale":"2023-08-09T12:41:26.754637+0000","last_undegraded":"2023-08-09T12:41:26.754637+0000","last_fullsized":"2023-08-09T12:41:26.754637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:38.646768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.716611+0000","last_change":"2023-08-09T12:41:25.716511+0000","last_active":"2023-08-09T12:41:25.716611+0000","last_peered":"2023-08-09T12:41:25.716611+0000","last_clean":"2023-08-09T12:41:25.716611+0000","last_became_active":"2023-08-09T12:41:25.715140+0000","last_became_peered":"2023-08-09T12:41:25.715140+0000","last_unstale":"2023-08-09T12:41:25.716611+0000","last_undegraded":"2023-08-09T12:41:25.716611+0000","last_fullsized":"2023-08-09T12:41:25.716611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.253017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740410+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:41:26.740410+0000","last_peered":"2023-08-09T12:41:26.740410+0000","last_clean":"2023-08-09T12:41:26.740410+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:41:26.740410+0000","last_undegraded":"2023-08-09T12:41:26.740410+0000","last_fullsized":"2023-08-09T12:41:26.740410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:26:07.633953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761560+0000","last_change":"2023-08-09T12:41:26.761325+0000","last_active":"2023-08-09T12:41:26.761560+0000","last_peered":"2023-08-09T12:41:26.761560+0000","last_clean":"2023-08-09T12:41:26.761560+0000","last_became_active":"2023-08-09T12:41:26.760426+0000","last_became_peered":"2023-08-09T12:41:26.760426+0000","last_unstale":"2023-08-09T12:41:26.761560+0000","last_undegraded":"2023-08-09T12:41:26.761560+0000","last_fullsized":"2023-08-09T12:41:26.761560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:51.292745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776050+0000","last_change":"2023-08-09T12:41:25.723888+0000","last_active":"2023-08-09T12:41:26.776050+0000","last_peered":"2023-08-09T12:41:26.776050+0000","last_clean":"2023-08-09T12:41:26.776050+0000","last_became_active":"2023-08-09T12:41:25.723572+0000","last_became_peered":"2023-08-09T12:41:25.723572+0000","last_unstale":"2023-08-09T12:41:26.776050+0000","last_undegraded":"2023-08-09T12:41:26.776050+0000","last_fullsized":"2023-08-09T12:41:26.776050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:36.973105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.750783+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:41:26.750783+0000","last_peered":"2023-08-09T12:41:26.750783+0000","last_clean":"2023-08-09T12:41:26.750783+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:41:26.750783+0000","last_undegraded":"2023-08-09T12:41:26.750783+0000","last_fullsized":"2023-08-09T12:41:26.750783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:55.321046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699507+0000","last_change":"2023-08-09T12:41:25.699507+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699507+0000","last_undegraded":"2023-08-09T12:41:25.699507+0000","last_fullsized":"2023-08-09T12:41:25.699507+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744593+0000","last_change":"2023-08-09T12:41:25.714321+0000","last_active":"2023-08-09T12:41:26.744593+0000","last_peered":"2023-08-09T12:41:26.744593+0000","last_clean":"2023-08-09T12:41:26.744593+0000","last_became_active":"2023-08-09T12:41:25.713760+0000","last_became_peered":"2023-08-09T12:41:25.713760+0000","last_unstale":"2023-08-09T12:41:26.744593+0000","last_undegraded":"2023-08-09T12:41:26.744593+0000","last_fullsized":"2023-08-09T12:41:26.744593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:33.785779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.695353+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:41:25.695353+0000","last_peered":"2023-08-09T12:41:25.695353+0000","last_clean":"2023-08-09T12:41:25.695353+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:41:25.695353+0000","last_undegraded":"2023-08-09T12:41:25.695353+0000","last_fullsized":"2023-08-09T12:41:25.695353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:30:16.096590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.746290+0000","last_change":"2023-08-09T12:41:26.745215+0000","last_active":"2023-08-09T12:41:26.746290+0000","last_peered":"2023-08-09T12:41:26.746290+0000","last_clean":"2023-08-09T12:41:26.746290+0000","last_became_active":"2023-08-09T12:41:26.744468+0000","last_became_peered":"2023-08-09T12:41:26.744468+0000","last_unstale":"2023-08-09T12:41:26.746290+0000","last_undegraded":"2023-08-09T12:41:26.746290+0000","last_fullsized":"2023-08-09T12:41:26.746290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.745677+0000","last_change":"2023-08-09T12:41:25.708106+0000","last_active":"2023-08-09T12:41:26.745677+0000","last_peered":"2023-08-09T12:41:26.745677+0000","last_clean":"2023-08-09T12:41:26.745677+0000","last_became_active":"2023-08-09T12:41:25.707382+0000","last_became_peered":"2023-08-09T12:41:25.707382+0000","last_unstale":"2023-08-09T12:41:26.745677+0000","last_undegraded":"2023-08-09T12:41:26.745677+0000","last_fullsized":"2023-08-09T12:41:26.745677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:39:40.360527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731288+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:41:26.731288+0000","last_peered":"2023-08-09T12:41:26.731288+0000","last_clean":"2023-08-09T12:41:26.731288+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:41:26.731288+0000","last_undegraded":"2023-08-09T12:41:26.731288+0000","last_fullsized":"2023-08-09T12:41:26.731288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:14:06.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702093+0000","last_change":"2023-08-09T12:41:25.702093+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702093+0000","last_undegraded":"2023-08-09T12:41:25.702093+0000","last_fullsized":"2023-08-09T12:41:25.702093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.734384+0000","last_change":"2023-08-09T12:41:25.717417+0000","last_active":"2023-08-09T12:41:26.734384+0000","last_peered":"2023-08-09T12:41:26.734384+0000","last_clean":"2023-08-09T12:41:26.734384+0000","last_became_active":"2023-08-09T12:41:25.717148+0000","last_became_peered":"2023-08-09T12:41:25.717148+0000","last_unstale":"2023-08-09T12:41:26.734384+0000","last_undegraded":"2023-08-09T12:41:26.734384+0000","last_fullsized":"2023-08-09T12:41:26.734384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:03.256797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.695344+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:41:25.695344+0000","last_peered":"2023-08-09T12:41:25.695344+0000","last_clean":"2023-08-09T12:41:25.695344+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:41:25.695344+0000","last_undegraded":"2023-08-09T12:41:25.695344+0000","last_fullsized":"2023-08-09T12:41:25.695344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:00:41.973400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758833+0000","last_change":"2023-08-09T12:41:26.758588+0000","last_active":"2023-08-09T12:41:26.758833+0000","last_peered":"2023-08-09T12:41:26.758833+0000","last_clean":"2023-08-09T12:41:26.758833+0000","last_became_active":"2023-08-09T12:41:26.757232+0000","last_became_peered":"2023-08-09T12:41:26.757232+0000","last_unstale":"2023-08-09T12:41:26.758833+0000","last_undegraded":"2023-08-09T12:41:26.758833+0000","last_fullsized":"2023-08-09T12:41:26.758833+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:56.335865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.736204+0000","last_change":"2023-08-09T12:41:25.717713+0000","last_active":"2023-08-09T12:41:26.736204+0000","last_peered":"2023-08-09T12:41:26.736204+0000","last_clean":"2023-08-09T12:41:26.736204+0000","last_became_active":"2023-08-09T12:41:25.717257+0000","last_became_peered":"2023-08-09T12:41:25.717257+0000","last_unstale":"2023-08-09T12:41:26.736204+0000","last_undegraded":"2023-08-09T12:41:26.736204+0000","last_fullsized":"2023-08-09T12:41:26.736204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:40.852877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.739235+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:41:26.739235+0000","last_peered":"2023-08-09T12:41:26.739235+0000","last_clean":"2023-08-09T12:41:26.739235+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:41:26.739235+0000","last_undegraded":"2023-08-09T12:41:26.739235+0000","last_fullsized":"2023-08-09T12:41:26.739235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:31.379260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":824,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194488,"statfs":{"total":200000000,"available":199155862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.095,"15min":1.093},"min":{"1min":0.70599999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.454,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.079,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.105,"15min":1.081},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8959999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.502},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0960000000000001,"15min":1.0820000000000001},"min":{"1min":0.747,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.079}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6259999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.153,"15min":1.131},"min":{"1min":0.92500000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.107}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2310000000000001,"15min":1.2150000000000001},"min":{"1min":0.93500000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.784,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.373},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2589999999999999,"15min":1.246},"min":{"1min":0.94699999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.696,"5min":1.96,"15min":1.96},"last":1.343}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.2250000000000001,"15min":1.1990000000000001},"min":{"1min":0.92300000000000004,"5min":0.505,"15min":0.505},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.2749999999999999,"15min":1.2470000000000001},"min":{"1min":0.876,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.145}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.284,"15min":1.2589999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.4910000000000001,"15min":1.4790000000000001},"min":{"1min":0.85999999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":3.1400000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.403}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.488,"15min":1.47},"min":{"1min":1.27,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.266,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":1.1160000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.093,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.5489999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":247,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195064,"statfs":{"total":200000000,"available":199746354,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.137,"15min":1.113},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.173,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.133}]},{"osd":1,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.228,"15min":1.222},"min":{"1min":0.88800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.0009999999999999,"5min":2.306,"15min":2.306},"last":1.181},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3220000000000001,"15min":1.3089999999999999},"min":{"1min":0.91400000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.5820000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.0960000000000001,"15min":1.083},"min":{"1min":0.83099999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.2729999999999999,"15min":1.2629999999999999},"min":{"1min":0.97699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.073}]},{"osd":3,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":1.0249999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2749999999999999,"15min":1.268},"min":{"1min":0.86199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.732,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.226}]},{"osd":4,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.296,"15min":1.282},"min":{"1min":0.88900000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.327,"15min":1.3169999999999999},"min":{"1min":0.99399999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4299999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.298,"15min":1.2989999999999999},"min":{"1min":0.96999999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.462,"15min":1.45},"min":{"1min":1.1899999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7160000000000002,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.274}]},{"osd":7,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.409,"15min":1.377},"min":{"1min":1.1180000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.401,"15min":1.385},"min":{"1min":1.083,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.6299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.111,"15min":1.1100000000000001},"min":{"1min":0.75600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4930000000000001,"5min":2.427,"15min":2.427},"last":1.157},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0509999999999999,"15min":1.0349999999999999},"min":{"1min":0.73499999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.0649999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.278,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.748,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.238,"15min":1.232},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6399999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.105}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1830000000000001,"15min":1.1930000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.446,"5min":1.591,"15min":1.591},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.175,"15min":1.1830000000000001},"min":{"1min":0.78400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.728,"15min":1.728},"last":1.3540000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.181,"15min":1.1699999999999999},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.26},{"interface":"front","average":{"1min":1.29,"5min":1.3620000000000001,"15min":1.3740000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.607,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.4690000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.621,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1619999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.357,"15min":1.371},"min":{"1min":0.71999999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.921,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.863,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.948,"15min":2.948},"last":1.599}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.524},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.097,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.405},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.974,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.298}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.69199999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.72,"5min":1.77,"15min":1.77},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.0860000000000001,"15min":1.075},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.589,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.298}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.3320000000000001,"15min":1.363},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.589,"5min":1.97,"15min":1.97},"last":1.347},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.3420000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.411}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3320000000000001,"15min":1.327},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.079},{"interface":"front","average":{"1min":1.353,"5min":1.3160000000000001,"15min":1.3100000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5620000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.163},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3320000000000001,"15min":1.3380000000000001},"min":{"1min":0.97299999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6990000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.401,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.847,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3680000000000001,"15min":1.3779999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7629999999999999,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.365}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.5009999999999999,"15min":1.52},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.8080000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.397},{"interface":"front","average":{"1min":1.49,"5min":1.5349999999999999,"15min":1.5429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.95,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.694}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.516,"15min":1.516},"min":{"1min":1.0169999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8839999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.48},{"interface":"front","average":{"1min":1.538,"5min":1.6299999999999999,"15min":1.645},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0089999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.5169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.85599999999999998,"15min":0.85199999999999998},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.90600000000000003}]},{"osd":1,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3759999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.875,"15min":0.85699999999999998},"min":{"1min":0.52000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.1160000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.5680000000000001,"5min":1.893,"15min":1.893},"last":0.996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.55400000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6499999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.94199999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.84399999999999997,"5min":0.745,"15min":0.745},"max":{"1min":1.883,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.212},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3160000000000001,"15min":1.3380000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.708,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.2889999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.355,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.6870000000000001,"5min":2.157,"15min":2.157},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2589999999999999,"15min":1.2490000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.331}]},{"osd":6,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3169999999999999,"15min":1.3220000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.7649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7729999999999999,"5min":2.589,"15min":2.589},"last":1.3620000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.369,"15min":1.3700000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.776,"5min":1.78,"15min":1.78},"last":1.5269999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":249,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195063,"statfs":{"total":200000000,"available":199744742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5329999999999999,"5min":1.716,"15min":1.716},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0349999999999999,"15min":1.054},"min":{"1min":0.61199999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.782,"5min":1.869,"15min":1.869},"last":0.50700000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.242,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.69199999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.403,"15min":1.4039999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.2869999999999999,"15min":1.2569999999999999},"min":{"1min":0.83199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.3660000000000001,"15min":1.3420000000000001},"min":{"1min":0.98199999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":5.0140000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.498,"15min":1.486},"min":{"1min":0.879,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":1.04}]},{"osd":6,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.298,"15min":1.288},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.0669999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.351,"15min":1.347},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5269999999999999,"15min":1.5249999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.25}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.881},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85099999999999998,"15min":0.85399999999999998},"min":{"1min":0.48899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.232,"5min":1.24,"15min":1.24},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.679,"5min":1.774,"15min":1.774},"last":1.569}]},{"osd":3,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.046},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6559999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.008,"5min":0.90100000000000002,"15min":0.88300000000000001},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.238}]},{"osd":4,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2669999999999999,"15min":1.264},"min":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6799999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.4059999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2609999999999999,"15min":1.2629999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.02,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.2589999999999999,"15min":1.2450000000000001},"min":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.206}]},{"osd":6,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.373,"15min":1.373},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2210000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3520000000000001,"15min":1.341},"min":{"1min":0.999,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.839,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.631}]},{"osd":7,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.8049999999999999,"5min":2.294,"15min":2.294},"last":1.8140000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.413,"15min":1.413},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.1280000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.754}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2729999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.819},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.90100000000000002},"min":{"1min":0.57199999999999995,"5min":0.436,"15min":0.436},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.88700000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92800000000000005,"15min":0.92900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.373,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.59199999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.484,"5min":1.607,"15min":1.607},"last":1.6040000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86899999999999999,"15min":0.873},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.196,"5min":1.952,"15min":1.952},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.153,"15min":1.161},"min":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5860000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4650000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2829999999999999,"15min":1.302},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6080000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.147},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.6970000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.7110000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2509999999999999,"15min":1.2589999999999999},"min":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3540000000000001,"15min":1.3600000000000001},"min":{"1min":0.89100000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8100000000000001,"5min":2.161,"15min":2.161},"last":1.909}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3109999999999999,"15min":1.3},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.373,"15min":1.3819999999999999},"min":{"1min":0.90100000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.008,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.399}]},{"osd":7,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3680000000000001,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.3959999999999999,"15min":1.4059999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.7150000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4510000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:41:31.264 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:41:31.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.528+0000 7f85eb137640 1 Processor -- start 2023-08-09T12:41:31.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.528+0000 7f85eb137640 1 -- start start 2023-08-09T12:41:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.529+0000 7f85eb137640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e4160030 0x7f85e4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.529+0000 7f85eb137640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f85e40cfb50 0x7f85e40d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.529+0000 7f85eb137640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e40b5a30 con 0x7f85e40b86e0 2023-08-09T12:41:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.529+0000 7f85eb137640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40d1110 con 0x7f85e40cfb50 2023-08-09T12:41:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.529+0000 7f85eb137640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40ceac0 con 0x7f85e4160030 2023-08-09T12:41:31.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.530+0000 7f85e9934640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f85e40b86e0 0x7f85e40cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:54872/0 (socket says 172.21.15.17:54872) 2023-08-09T12:41:31.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.530+0000 7f85e9934640 1 -- 172.21.15.17:0/824078142 learned_addr learned my addr 172.21.15.17:0/824078142 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:31.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.530+0000 7f85ea135640 1 --2- 172.21.15.17:0/824078142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e4160030 0x7f85e4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.530+0000 7f85ea936640 1 --2- 172.21.15.17:0/824078142 >> v2:172.21.15.142:3300/0 conn(0x7f85e40cfb50 0x7f85e40d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.531+0000 7f85ea135640 1 -- 172.21.15.17:0/824078142 >> v2:172.21.15.142:3300/0 conn(0x7f85e40cfb50 msgr2=0x7f85e40d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:31.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.531+0000 7f85ea135640 1 --2- 172.21.15.17:0/824078142 >> v2:172.21.15.142:3300/0 conn(0x7f85e40cfb50 0x7f85e40d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.531+0000 7f85ea135640 1 -- 172.21.15.17:0/824078142 >> v1:172.21.15.142:6789/0 conn(0x7f85e40b86e0 legacy=0x7f85e40cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.531+0000 7f85ea135640 1 -- 172.21.15.17:0/824078142 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40d0d70 con 0x7f85e4160030 2023-08-09T12:41:31.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.532+0000 7f85ea135640 1 --2- 172.21.15.17:0/824078142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e4160030 0x7f85e4160740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85e00097a0 tx=0x7f85e002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a83c4dc6fd3e0a48 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:31.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.533+0000 7f85e9133640 1 -- 172.21.15.17:0/824078142 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e002d040 con 0x7f85e4160030 2023-08-09T12:41:31.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.533+0000 7f85e9133640 1 -- 172.21.15.17:0/824078142 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0031810 con 0x7f85e4160030 2023-08-09T12:41:31.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.533+0000 7f85e9133640 1 -- 172.21.15.17:0/824078142 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0031ba0 con 0x7f85e4160030 2023-08-09T12:41:31.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.533+0000 7f85eb137640 1 -- 172.21.15.17:0/824078142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e4160030 msgr2=0x7f85e4160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.533+0000 7f85eb137640 1 --2- 172.21.15.17:0/824078142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e4160030 0x7f85e4160740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85e00097a0 tx=0x7f85e002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.534+0000 7f85eb137640 1 -- 172.21.15.17:0/824078142 shutdown_connections 2023-08-09T12:41:31.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.534+0000 7f85eb137640 1 --2- 172.21.15.17:0/824078142 >> v2:172.21.15.142:3300/0 conn(0x7f85e40cfb50 0x7f85e40d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.534+0000 7f85eb137640 1 --2- 172.21.15.17:0/824078142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e4160030 0x7f85e4160740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.534+0000 7f85eb137640 1 -- 172.21.15.17:0/824078142 >> 172.21.15.17:0/824078142 conn(0x7f85e40697c0 msgr2=0x7f85e4069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:31.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.534+0000 7f85eb137640 1 -- 172.21.15.17:0/824078142 shutdown_connections 2023-08-09T12:41:31.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.534+0000 7f85eb137640 1 -- 172.21.15.17:0/824078142 wait complete. 2023-08-09T12:41:31.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.535+0000 7f85eb137640 1 Processor -- start 2023-08-09T12:41:31.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.536+0000 7f85eb137640 1 -- start start 2023-08-09T12:41:31.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.536+0000 7f85eb137640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e40b86e0 0x7f85e40ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85eb137640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e40cfb50 0x7f85e414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85eb137640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e4160030 0x7f85e40cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85eb137640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e41584b0 con 0x7f85e40b86e0 2023-08-09T12:41:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85eb137640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40cba00 con 0x7f85e4160030 2023-08-09T12:41:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85eb137640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40cbce0 con 0x7f85e40cfb50 2023-08-09T12:41:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea135640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e40b86e0 0x7f85e40ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea135640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e40b86e0 0x7f85e40ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52020/0 (socket says 172.21.15.17:52020) 2023-08-09T12:41:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea135640 1 -- 172.21.15.17:0/1049225510 learned_addr learned my addr 172.21.15.17:0/1049225510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85e9934640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e40cfb50 0x7f85e414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea936640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e4160030 0x7f85e40cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea135640 1 -- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e40cfb50 msgr2=0x7f85e414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea135640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e40cfb50 0x7f85e414ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea135640 1 -- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e4160030 msgr2=0x7f85e40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea135640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e4160030 0x7f85e40cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea135640 1 -- 172.21.15.17:0/1049225510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009400 con 0x7f85e40b86e0 2023-08-09T12:41:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.537+0000 7f85ea936640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e4160030 0x7f85e40cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.538+0000 7f85ea135640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e40b86e0 0x7f85e40ccaa0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c00 tx=0x7f85e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.538+0000 7f85daffd640 1 -- 172.21.15.17:0/1049225510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0006e10 con 0x7f85e40b86e0 2023-08-09T12:41:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.538+0000 7f85daffd640 1 -- 172.21.15.17:0/1049225510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e003ad60 con 0x7f85e40b86e0 2023-08-09T12:41:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.538+0000 7f85daffd640 1 -- 172.21.15.17:0/1049225510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0044630 con 0x7f85e40b86e0 2023-08-09T12:41:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.538+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e40cbfc0 con 0x7f85e40b86e0 2023-08-09T12:41:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.538+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e40cc580 con 0x7f85e40b86e0 2023-08-09T12:41:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.540+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e404e390 con 0x7f85e40b86e0 2023-08-09T12:41:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.540+0000 7f85daffd640 1 -- 172.21.15.17:0/1049225510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f85e004d450 con 0x7f85e40b86e0 2023-08-09T12:41:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.541+0000 7f85daffd640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85c806a050 0x7f85c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.541+0000 7f85daffd640 1 -- 172.21.15.17:0/1049225510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85e00aa860 con 0x7f85e40b86e0 2023-08-09T12:41:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.542+0000 7f85e9934640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85c806a050 0x7f85c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:31.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.543+0000 7f85e9934640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85c806a050 0x7f85c806c510 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f85e40b74c0 tx=0x7f85d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:31.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.546+0000 7f85daffd640 1 -- 172.21.15.17:0/1049225510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f85e0075ea0 con 0x7f85e40b86e0 2023-08-09T12:41:31.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.733+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85e4161250 con 0x7f85c806a050 2023-08-09T12:41:31.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.756+0000 7f85daffd640 1 -- 172.21.15.17:0/1049225510 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300732 (secure 0 0 0) 0x7f85d4001c50 con 0x7f85c806a050 2023-08-09T12:41:31.764 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:41:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85c806a050 msgr2=0x7f85c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85c806a050 0x7f85c806c510 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f85e40b74c0 tx=0x7f85d4009040 comp rx=0 tx=0).stop 2023-08-09T12:41:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e40b86e0 msgr2=0x7f85e40ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e40b86e0 0x7f85e40ccaa0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c00 tx=0x7f85e00046c0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 shutdown_connections 2023-08-09T12:41:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85c806a050 0x7f85c806c510 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85e4160030 0x7f85e40cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85e40cfb50 0x7f85e414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 --2- 172.21.15.17:0/1049225510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e40b86e0 0x7f85e40ccaa0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 >> 172.21.15.17:0/1049225510 conn(0x7f85e40697c0 msgr2=0x7f85e415f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 shutdown_connections 2023-08-09T12:41:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:31.763+0000 7f85eb137640 1 -- 172.21.15.17:0/1049225510 wait complete. 2023-08-09T12:41:31.785 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-08-09T12:41:30.679852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3095,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559404,"statfs":{"total":1600000000,"available":1596830628,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994474"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.708068+0000","last_change":"2023-08-09T12:41:25.708068+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.708068+0000","last_undegraded":"2023-08-09T12:41:25.708068+0000","last_fullsized":"2023-08-09T12:41:25.708068+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754794+0000","last_change":"2023-08-09T12:41:26.754678+0000","last_active":"2023-08-09T12:41:26.754794+0000","last_peered":"2023-08-09T12:41:26.754794+0000","last_clean":"2023-08-09T12:41:26.754794+0000","last_became_active":"2023-08-09T12:41:26.754276+0000","last_became_peered":"2023-08-09T12:41:26.754276+0000","last_unstale":"2023-08-09T12:41:26.754794+0000","last_undegraded":"2023-08-09T12:41:26.754794+0000","last_fullsized":"2023-08-09T12:41:26.754794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:53:52.596963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700690+0000","last_change":"2023-08-09T12:41:25.700690+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700690+0000","last_undegraded":"2023-08-09T12:41:25.700690+0000","last_fullsized":"2023-08-09T12:41:25.700690+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.749039+0000","last_change":"2023-08-09T12:41:26.748928+0000","last_active":"2023-08-09T12:41:26.749039+0000","last_peered":"2023-08-09T12:41:26.749039+0000","last_clean":"2023-08-09T12:41:26.749039+0000","last_became_active":"2023-08-09T12:41:26.748363+0000","last_became_peered":"2023-08-09T12:41:26.748363+0000","last_unstale":"2023-08-09T12:41:26.749039+0000","last_undegraded":"2023-08-09T12:41:26.749039+0000","last_fullsized":"2023-08-09T12:41:26.749039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:14.075784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754016+0000","last_change":"2023-08-09T12:41:26.753475+0000","last_active":"2023-08-09T12:41:26.754016+0000","last_peered":"2023-08-09T12:41:26.754016+0000","last_clean":"2023-08-09T12:41:26.754016+0000","last_became_active":"2023-08-09T12:41:26.753219+0000","last_became_peered":"2023-08-09T12:41:26.753219+0000","last_unstale":"2023-08-09T12:41:26.754016+0000","last_undegraded":"2023-08-09T12:41:26.754016+0000","last_fullsized":"2023-08-09T12:41:26.754016+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.707203+0000","last_change":"2023-08-09T12:41:25.707203+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.707203+0000","last_undegraded":"2023-08-09T12:41:25.707203+0000","last_fullsized":"2023-08-09T12:41:25.707203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.703555+0000","last_change":"2023-08-09T12:41:25.703555+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.703555+0000","last_undegraded":"2023-08-09T12:41:25.703555+0000","last_fullsized":"2023-08-09T12:41:25.703555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.765244+0000","last_change":"2023-08-09T12:41:26.764924+0000","last_active":"2023-08-09T12:41:26.765244+0000","last_peered":"2023-08-09T12:41:26.765244+0000","last_clean":"2023-08-09T12:41:26.765244+0000","last_became_active":"2023-08-09T12:41:26.764684+0000","last_became_peered":"2023-08-09T12:41:26.764684+0000","last_unstale":"2023-08-09T12:41:26.765244+0000","last_undegraded":"2023-08-09T12:41:26.765244+0000","last_fullsized":"2023-08-09T12:41:26.765244+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:35:48.443783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.766472+0000","last_change":"2023-08-09T12:41:26.766387+0000","last_active":"2023-08-09T12:41:26.766472+0000","last_peered":"2023-08-09T12:41:26.766472+0000","last_clean":"2023-08-09T12:41:26.766472+0000","last_became_active":"2023-08-09T12:41:26.765392+0000","last_became_peered":"2023-08-09T12:41:26.765392+0000","last_unstale":"2023-08-09T12:41:26.766472+0000","last_undegraded":"2023-08-09T12:41:26.766472+0000","last_fullsized":"2023-08-09T12:41:26.766472+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:48.342228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.704905+0000","last_change":"2023-08-09T12:41:25.704905+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.704905+0000","last_undegraded":"2023-08-09T12:41:25.704905+0000","last_fullsized":"2023-08-09T12:41:25.704905+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753006+0000","last_change":"2023-08-09T12:41:26.751660+0000","last_active":"2023-08-09T12:41:26.753006+0000","last_peered":"2023-08-09T12:41:26.753006+0000","last_clean":"2023-08-09T12:41:26.753006+0000","last_became_active":"2023-08-09T12:41:26.751076+0000","last_became_peered":"2023-08-09T12:41:26.751076+0000","last_unstale":"2023-08-09T12:41:26.753006+0000","last_undegraded":"2023-08-09T12:41:26.753006+0000","last_fullsized":"2023-08-09T12:41:26.753006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:28:29.430515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744213+0000","last_change":"2023-08-09T12:41:26.744068+0000","last_active":"2023-08-09T12:41:26.744213+0000","last_peered":"2023-08-09T12:41:26.744213+0000","last_clean":"2023-08-09T12:41:26.744213+0000","last_became_active":"2023-08-09T12:41:26.742814+0000","last_became_peered":"2023-08-09T12:41:26.742814+0000","last_unstale":"2023-08-09T12:41:26.744213+0000","last_undegraded":"2023-08-09T12:41:26.744213+0000","last_fullsized":"2023-08-09T12:41:26.744213+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:13:01.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.706498+0000","last_change":"2023-08-09T12:41:25.706498+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.706498+0000","last_undegraded":"2023-08-09T12:41:25.706498+0000","last_fullsized":"2023-08-09T12:41:25.706498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.701414+0000","last_change":"2023-08-09T12:41:25.701414+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.701414+0000","last_undegraded":"2023-08-09T12:41:25.701414+0000","last_fullsized":"2023-08-09T12:41:25.701414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.747123+0000","last_change":"2023-08-09T12:41:26.741311+0000","last_active":"2023-08-09T12:41:26.747123+0000","last_peered":"2023-08-09T12:41:26.747123+0000","last_clean":"2023-08-09T12:41:26.747123+0000","last_became_active":"2023-08-09T12:41:26.740668+0000","last_became_peered":"2023-08-09T12:41:26.740668+0000","last_unstale":"2023-08-09T12:41:26.747123+0000","last_undegraded":"2023-08-09T12:41:26.747123+0000","last_fullsized":"2023-08-09T12:41:26.747123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:48.189765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.706144+0000","last_change":"2023-08-09T12:41:25.706144+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.706144+0000","last_undegraded":"2023-08-09T12:41:25.706144+0000","last_fullsized":"2023-08-09T12:41:25.706144+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700012+0000","last_change":"2023-08-09T12:41:25.700012+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700012+0000","last_undegraded":"2023-08-09T12:41:25.700012+0000","last_fullsized":"2023-08-09T12:41:25.700012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753924+0000","last_change":"2023-08-09T12:41:26.752877+0000","last_active":"2023-08-09T12:41:26.753924+0000","last_peered":"2023-08-09T12:41:26.753924+0000","last_clean":"2023-08-09T12:41:26.753924+0000","last_became_active":"2023-08-09T12:41:26.752230+0000","last_became_peered":"2023-08-09T12:41:26.752230+0000","last_unstale":"2023-08-09T12:41:26.753924+0000","last_undegraded":"2023-08-09T12:41:26.753924+0000","last_fullsized":"2023-08-09T12:41:26.753924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:47:13.757008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702258+0000","last_change":"2023-08-09T12:41:25.702258+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702258+0000","last_undegraded":"2023-08-09T12:41:25.702258+0000","last_fullsized":"2023-08-09T12:41:25.702258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.755461+0000","last_change":"2023-08-09T12:41:26.755290+0000","last_active":"2023-08-09T12:41:26.755461+0000","last_peered":"2023-08-09T12:41:26.755461+0000","last_clean":"2023-08-09T12:41:26.755461+0000","last_became_active":"2023-08-09T12:41:26.753410+0000","last_became_peered":"2023-08-09T12:41:26.753410+0000","last_unstale":"2023-08-09T12:41:26.755461+0000","last_undegraded":"2023-08-09T12:41:26.755461+0000","last_fullsized":"2023-08-09T12:41:26.755461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:20.535847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758524+0000","last_change":"2023-08-09T12:41:26.758273+0000","last_active":"2023-08-09T12:41:26.758524+0000","last_peered":"2023-08-09T12:41:26.758524+0000","last_clean":"2023-08-09T12:41:26.758524+0000","last_became_active":"2023-08-09T12:41:26.753618+0000","last_became_peered":"2023-08-09T12:41:26.753618+0000","last_unstale":"2023-08-09T12:41:26.758524+0000","last_undegraded":"2023-08-09T12:41:26.758524+0000","last_fullsized":"2023-08-09T12:41:26.758524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:18.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.762564+0000","last_change":"2023-08-09T12:41:26.762381+0000","last_active":"2023-08-09T12:41:26.762564+0000","last_peered":"2023-08-09T12:41:26.762564+0000","last_clean":"2023-08-09T12:41:26.762564+0000","last_became_active":"2023-08-09T12:41:26.761594+0000","last_became_peered":"2023-08-09T12:41:26.761594+0000","last_unstale":"2023-08-09T12:41:26.762564+0000","last_undegraded":"2023-08-09T12:41:26.762564+0000","last_fullsized":"2023-08-09T12:41:26.762564+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:34.790459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754310+0000","last_change":"2023-08-09T12:41:26.753387+0000","last_active":"2023-08-09T12:41:26.754310+0000","last_peered":"2023-08-09T12:41:26.754310+0000","last_clean":"2023-08-09T12:41:26.754310+0000","last_became_active":"2023-08-09T12:41:26.752651+0000","last_became_peered":"2023-08-09T12:41:26.752651+0000","last_unstale":"2023-08-09T12:41:26.754310+0000","last_undegraded":"2023-08-09T12:41:26.754310+0000","last_fullsized":"2023-08-09T12:41:26.754310+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:05.292154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700584+0000","last_change":"2023-08-09T12:41:25.700584+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700584+0000","last_undegraded":"2023-08-09T12:41:25.700584+0000","last_fullsized":"2023-08-09T12:41:25.700584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.708070+0000","last_change":"2023-08-09T12:41:25.708070+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.708070+0000","last_undegraded":"2023-08-09T12:41:25.708070+0000","last_fullsized":"2023-08-09T12:41:25.708070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743932+0000","last_change":"2023-08-09T12:41:26.742962+0000","last_active":"2023-08-09T12:41:26.743932+0000","last_peered":"2023-08-09T12:41:26.743932+0000","last_clean":"2023-08-09T12:41:26.743932+0000","last_became_active":"2023-08-09T12:41:26.742314+0000","last_became_peered":"2023-08-09T12:41:26.742314+0000","last_unstale":"2023-08-09T12:41:26.743932+0000","last_undegraded":"2023-08-09T12:41:26.743932+0000","last_fullsized":"2023-08-09T12:41:26.743932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:03:40.448213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.705108+0000","last_change":"2023-08-09T12:41:25.705108+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.705108+0000","last_undegraded":"2023-08-09T12:41:25.705108+0000","last_fullsized":"2023-08-09T12:41:25.705108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743241+0000","last_change":"2023-08-09T12:41:26.742817+0000","last_active":"2023-08-09T12:41:26.743241+0000","last_peered":"2023-08-09T12:41:26.743241+0000","last_clean":"2023-08-09T12:41:26.743241+0000","last_became_active":"2023-08-09T12:41:26.742199+0000","last_became_peered":"2023-08-09T12:41:26.742199+0000","last_unstale":"2023-08-09T12:41:26.743241+0000","last_undegraded":"2023-08-09T12:41:26.743241+0000","last_fullsized":"2023-08-09T12:41:26.743241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:38.407498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699671+0000","last_change":"2023-08-09T12:41:25.699671+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699671+0000","last_undegraded":"2023-08-09T12:41:25.699671+0000","last_fullsized":"2023-08-09T12:41:25.699671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.759692+0000","last_change":"2023-08-09T12:41:26.759612+0000","last_active":"2023-08-09T12:41:26.759692+0000","last_peered":"2023-08-09T12:41:26.759692+0000","last_clean":"2023-08-09T12:41:26.759692+0000","last_became_active":"2023-08-09T12:41:26.759326+0000","last_became_peered":"2023-08-09T12:41:26.759326+0000","last_unstale":"2023-08-09T12:41:26.759692+0000","last_undegraded":"2023-08-09T12:41:26.759692+0000","last_fullsized":"2023-08-09T12:41:26.759692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:51.748893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699396+0000","last_change":"2023-08-09T12:41:25.699396+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699396+0000","last_undegraded":"2023-08-09T12:41:25.699396+0000","last_fullsized":"2023-08-09T12:41:25.699396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.760804+0000","last_change":"2023-08-09T12:41:26.760698+0000","last_active":"2023-08-09T12:41:26.760804+0000","last_peered":"2023-08-09T12:41:26.760804+0000","last_clean":"2023-08-09T12:41:26.760804+0000","last_became_active":"2023-08-09T12:41:26.760285+0000","last_became_peered":"2023-08-09T12:41:26.760285+0000","last_unstale":"2023-08-09T12:41:26.760804+0000","last_undegraded":"2023-08-09T12:41:26.760804+0000","last_fullsized":"2023-08-09T12:41:26.760804+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:37.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754195+0000","last_change":"2023-08-09T12:41:26.754093+0000","last_active":"2023-08-09T12:41:26.754195+0000","last_peered":"2023-08-09T12:41:26.754195+0000","last_clean":"2023-08-09T12:41:26.754195+0000","last_became_active":"2023-08-09T12:41:26.752605+0000","last_became_peered":"2023-08-09T12:41:26.752605+0000","last_unstale":"2023-08-09T12:41:26.754195+0000","last_undegraded":"2023-08-09T12:41:26.754195+0000","last_fullsized":"2023-08-09T12:41:26.754195+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:56:34.930871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.775310+0000","last_change":"2023-08-09T12:41:25.721830+0000","last_active":"2023-08-09T12:41:26.775310+0000","last_peered":"2023-08-09T12:41:26.775310+0000","last_clean":"2023-08-09T12:41:26.775310+0000","last_became_active":"2023-08-09T12:41:25.721477+0000","last_became_peered":"2023-08-09T12:41:25.721477+0000","last_unstale":"2023-08-09T12:41:26.775310+0000","last_undegraded":"2023-08-09T12:41:26.775310+0000","last_fullsized":"2023-08-09T12:41:26.775310+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:17:17.790512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.752846+0000","last_change":"2023-08-09T12:41:26.752060+0000","last_active":"2023-08-09T12:41:26.752846+0000","last_peered":"2023-08-09T12:41:26.752846+0000","last_clean":"2023-08-09T12:41:26.752846+0000","last_became_active":"2023-08-09T12:41:26.751292+0000","last_became_peered":"2023-08-09T12:41:26.751292+0000","last_unstale":"2023-08-09T12:41:26.752846+0000","last_undegraded":"2023-08-09T12:41:26.752846+0000","last_fullsized":"2023-08-09T12:41:26.752846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:12:09.364968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.718335+0000","last_change":"2023-08-09T12:41:25.718240+0000","last_active":"2023-08-09T12:41:25.718335+0000","last_peered":"2023-08-09T12:41:25.718335+0000","last_clean":"2023-08-09T12:41:25.718335+0000","last_became_active":"2023-08-09T12:41:25.717916+0000","last_became_peered":"2023-08-09T12:41:25.717916+0000","last_unstale":"2023-08-09T12:41:25.718335+0000","last_undegraded":"2023-08-09T12:41:25.718335+0000","last_fullsized":"2023-08-09T12:41:25.718335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:30:50.797135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758137+0000","last_change":"2023-08-09T12:41:26.754052+0000","last_active":"2023-08-09T12:41:26.758137+0000","last_peered":"2023-08-09T12:41:26.758137+0000","last_clean":"2023-08-09T12:41:26.758137+0000","last_became_active":"2023-08-09T12:41:26.752928+0000","last_became_peered":"2023-08-09T12:41:26.752928+0000","last_unstale":"2023-08-09T12:41:26.758137+0000","last_undegraded":"2023-08-09T12:41:26.758137+0000","last_fullsized":"2023-08-09T12:41:26.758137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:38:59.971994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.719460+0000","last_change":"2023-08-09T12:41:25.719346+0000","last_active":"2023-08-09T12:41:25.719460+0000","last_peered":"2023-08-09T12:41:25.719460+0000","last_clean":"2023-08-09T12:41:25.719460+0000","last_became_active":"2023-08-09T12:41:25.719015+0000","last_became_peered":"2023-08-09T12:41:25.719015+0000","last_unstale":"2023-08-09T12:41:25.719460+0000","last_undegraded":"2023-08-09T12:41:25.719460+0000","last_fullsized":"2023-08-09T12:41:25.719460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:29:52.920254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743989+0000","last_change":"2023-08-09T12:41:26.743217+0000","last_active":"2023-08-09T12:41:26.743989+0000","last_peered":"2023-08-09T12:41:26.743989+0000","last_clean":"2023-08-09T12:41:26.743989+0000","last_became_active":"2023-08-09T12:41:26.742517+0000","last_became_peered":"2023-08-09T12:41:26.742517+0000","last_unstale":"2023-08-09T12:41:26.743989+0000","last_undegraded":"2023-08-09T12:41:26.743989+0000","last_fullsized":"2023-08-09T12:41:26.743989+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:34.058833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776911+0000","last_change":"2023-08-09T12:41:25.722114+0000","last_active":"2023-08-09T12:41:26.776911+0000","last_peered":"2023-08-09T12:41:26.776911+0000","last_clean":"2023-08-09T12:41:26.776911+0000","last_became_active":"2023-08-09T12:41:25.721669+0000","last_became_peered":"2023-08-09T12:41:25.721669+0000","last_unstale":"2023-08-09T12:41:26.776911+0000","last_undegraded":"2023-08-09T12:41:26.776911+0000","last_fullsized":"2023-08-09T12:41:26.776911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:17.540738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.770166+0000","last_change":"2023-08-09T12:41:26.770070+0000","last_active":"2023-08-09T12:41:26.770166+0000","last_peered":"2023-08-09T12:41:26.770166+0000","last_clean":"2023-08-09T12:41:26.770166+0000","last_became_active":"2023-08-09T12:41:26.769738+0000","last_became_peered":"2023-08-09T12:41:26.769738+0000","last_unstale":"2023-08-09T12:41:26.770166+0000","last_undegraded":"2023-08-09T12:41:26.770166+0000","last_fullsized":"2023-08-09T12:41:26.770166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:47.795643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.722227+0000","last_change":"2023-08-09T12:41:25.722107+0000","last_active":"2023-08-09T12:41:25.722227+0000","last_peered":"2023-08-09T12:41:25.722227+0000","last_clean":"2023-08-09T12:41:25.722227+0000","last_became_active":"2023-08-09T12:41:25.721515+0000","last_became_peered":"2023-08-09T12:41:25.721515+0000","last_unstale":"2023-08-09T12:41:25.722227+0000","last_undegraded":"2023-08-09T12:41:25.722227+0000","last_fullsized":"2023-08-09T12:41:25.722227+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:37.179674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761806+0000","last_change":"2023-08-09T12:41:26.761679+0000","last_active":"2023-08-09T12:41:26.761806+0000","last_peered":"2023-08-09T12:41:26.761806+0000","last_clean":"2023-08-09T12:41:26.761806+0000","last_became_active":"2023-08-09T12:41:26.761434+0000","last_became_peered":"2023-08-09T12:41:26.761434+0000","last_unstale":"2023-08-09T12:41:26.761806+0000","last_undegraded":"2023-08-09T12:41:26.761806+0000","last_fullsized":"2023-08-09T12:41:26.761806+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:07:29.451454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.775777+0000","last_change":"2023-08-09T12:41:25.720698+0000","last_active":"2023-08-09T12:41:26.775777+0000","last_peered":"2023-08-09T12:41:26.775777+0000","last_clean":"2023-08-09T12:41:26.775777+0000","last_became_active":"2023-08-09T12:41:25.720198+0000","last_became_peered":"2023-08-09T12:41:25.720198+0000","last_unstale":"2023-08-09T12:41:26.775777+0000","last_undegraded":"2023-08-09T12:41:26.775777+0000","last_fullsized":"2023-08-09T12:41:26.775777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:03.256797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744033+0000","last_change":"2023-08-09T12:41:26.743459+0000","last_active":"2023-08-09T12:41:26.744033+0000","last_peered":"2023-08-09T12:41:26.744033+0000","last_clean":"2023-08-09T12:41:26.744033+0000","last_became_active":"2023-08-09T12:41:26.741850+0000","last_became_peered":"2023-08-09T12:41:26.741850+0000","last_unstale":"2023-08-09T12:41:26.744033+0000","last_undegraded":"2023-08-09T12:41:26.744033+0000","last_fullsized":"2023-08-09T12:41:26.744033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:47.795643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738984+0000","last_change":"2023-08-09T12:41:25.718176+0000","last_active":"2023-08-09T12:41:26.738984+0000","last_peered":"2023-08-09T12:41:26.738984+0000","last_clean":"2023-08-09T12:41:26.738984+0000","last_became_active":"2023-08-09T12:41:25.717644+0000","last_became_peered":"2023-08-09T12:41:25.717644+0000","last_unstale":"2023-08-09T12:41:26.738984+0000","last_undegraded":"2023-08-09T12:41:26.738984+0000","last_fullsized":"2023-08-09T12:41:26.738984+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:22:25.646805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.756590+0000","last_change":"2023-08-09T12:41:26.756431+0000","last_active":"2023-08-09T12:41:26.756590+0000","last_peered":"2023-08-09T12:41:26.756590+0000","last_clean":"2023-08-09T12:41:26.756590+0000","last_became_active":"2023-08-09T12:41:26.755532+0000","last_became_peered":"2023-08-09T12:41:26.755532+0000","last_unstale":"2023-08-09T12:41:26.756590+0000","last_undegraded":"2023-08-09T12:41:26.756590+0000","last_fullsized":"2023-08-09T12:41:26.756590+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:08:32.383305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.722268+0000","last_change":"2023-08-09T12:41:25.722201+0000","last_active":"2023-08-09T12:41:25.722268+0000","last_peered":"2023-08-09T12:41:25.722268+0000","last_clean":"2023-08-09T12:41:25.722268+0000","last_became_active":"2023-08-09T12:41:25.721923+0000","last_became_peered":"2023-08-09T12:41:25.721923+0000","last_unstale":"2023-08-09T12:41:25.722268+0000","last_undegraded":"2023-08-09T12:41:25.722268+0000","last_fullsized":"2023-08-09T12:41:25.722268+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:54.880610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758159+0000","last_change":"2023-08-09T12:41:26.757770+0000","last_active":"2023-08-09T12:41:26.758159+0000","last_peered":"2023-08-09T12:41:26.758159+0000","last_clean":"2023-08-09T12:41:26.758159+0000","last_became_active":"2023-08-09T12:41:26.757533+0000","last_became_peered":"2023-08-09T12:41:26.757533+0000","last_unstale":"2023-08-09T12:41:26.758159+0000","last_undegraded":"2023-08-09T12:41:26.758159+0000","last_fullsized":"2023-08-09T12:41:26.758159+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731870+0000","last_change":"2023-08-09T12:41:25.709057+0000","last_active":"2023-08-09T12:41:26.731870+0000","last_peered":"2023-08-09T12:41:26.731870+0000","last_clean":"2023-08-09T12:41:26.731870+0000","last_became_active":"2023-08-09T12:41:25.708378+0000","last_became_peered":"2023-08-09T12:41:25.708378+0000","last_unstale":"2023-08-09T12:41:26.731870+0000","last_undegraded":"2023-08-09T12:41:26.731870+0000","last_fullsized":"2023-08-09T12:41:26.731870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:47:39.880663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.752876+0000","last_change":"2023-08-09T12:41:26.752598+0000","last_active":"2023-08-09T12:41:26.752876+0000","last_peered":"2023-08-09T12:41:26.752876+0000","last_clean":"2023-08-09T12:41:26.752876+0000","last_became_active":"2023-08-09T12:41:26.752197+0000","last_became_peered":"2023-08-09T12:41:26.752197+0000","last_unstale":"2023-08-09T12:41:26.752876+0000","last_undegraded":"2023-08-09T12:41:26.752876+0000","last_fullsized":"2023-08-09T12:41:26.752876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:21.832052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.746841+0000","last_change":"2023-08-09T12:41:25.710502+0000","last_active":"2023-08-09T12:41:26.746841+0000","last_peered":"2023-08-09T12:41:26.746841+0000","last_clean":"2023-08-09T12:41:26.746841+0000","last_became_active":"2023-08-09T12:41:25.709843+0000","last_became_peered":"2023-08-09T12:41:25.709843+0000","last_unstale":"2023-08-09T12:41:26.746841+0000","last_undegraded":"2023-08-09T12:41:26.746841+0000","last_fullsized":"2023-08-09T12:41:26.746841+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:47.337548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.701483+0000","last_change":"2023-08-09T12:41:25.701483+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.701483+0000","last_undegraded":"2023-08-09T12:41:25.701483+0000","last_fullsized":"2023-08-09T12:41:25.701483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776412+0000","last_change":"2023-08-09T12:41:25.719290+0000","last_active":"2023-08-09T12:41:26.776412+0000","last_peered":"2023-08-09T12:41:26.776412+0000","last_clean":"2023-08-09T12:41:26.776412+0000","last_became_active":"2023-08-09T12:41:25.718919+0000","last_became_peered":"2023-08-09T12:41:25.718919+0000","last_unstale":"2023-08-09T12:41:26.776412+0000","last_undegraded":"2023-08-09T12:41:26.776412+0000","last_fullsized":"2023-08-09T12:41:26.776412+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:33.297308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761037+0000","last_change":"2023-08-09T12:41:26.760937+0000","last_active":"2023-08-09T12:41:26.761037+0000","last_peered":"2023-08-09T12:41:26.761037+0000","last_clean":"2023-08-09T12:41:26.761037+0000","last_became_active":"2023-08-09T12:41:26.760393+0000","last_became_peered":"2023-08-09T12:41:26.760393+0000","last_unstale":"2023-08-09T12:41:26.761037+0000","last_undegraded":"2023-08-09T12:41:26.761037+0000","last_fullsized":"2023-08-09T12:41:26.761037+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:41.857557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.780748+0000","last_change":"2023-08-09T12:41:25.720123+0000","last_active":"2023-08-09T12:41:26.780748+0000","last_peered":"2023-08-09T12:41:26.780748+0000","last_clean":"2023-08-09T12:41:26.780748+0000","last_became_active":"2023-08-09T12:41:25.719183+0000","last_became_peered":"2023-08-09T12:41:25.719183+0000","last_unstale":"2023-08-09T12:41:26.780748+0000","last_undegraded":"2023-08-09T12:41:26.780748+0000","last_fullsized":"2023-08-09T12:41:26.780748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:56.678204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758850+0000","last_change":"2023-08-09T12:41:26.758726+0000","last_active":"2023-08-09T12:41:26.758850+0000","last_peered":"2023-08-09T12:41:26.758850+0000","last_clean":"2023-08-09T12:41:26.758850+0000","last_became_active":"2023-08-09T12:41:26.757570+0000","last_became_peered":"2023-08-09T12:41:26.757570+0000","last_unstale":"2023-08-09T12:41:26.758850+0000","last_undegraded":"2023-08-09T12:41:26.758850+0000","last_fullsized":"2023-08-09T12:41:26.758850+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:02:45.834158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.716371+0000","last_change":"2023-08-09T12:41:25.716255+0000","last_active":"2023-08-09T12:41:25.716371+0000","last_peered":"2023-08-09T12:41:25.716371+0000","last_clean":"2023-08-09T12:41:25.716371+0000","last_became_active":"2023-08-09T12:41:25.714648+0000","last_became_peered":"2023-08-09T12:41:25.714648+0000","last_unstale":"2023-08-09T12:41:25.716371+0000","last_undegraded":"2023-08-09T12:41:25.716371+0000","last_fullsized":"2023-08-09T12:41:25.716371+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:26.550315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.707272+0000","last_change":"2023-08-09T12:41:25.707272+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.707272+0000","last_undegraded":"2023-08-09T12:41:25.707272+0000","last_fullsized":"2023-08-09T12:41:25.707272+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738127+0000","last_change":"2023-08-09T12:41:25.723688+0000","last_active":"2023-08-09T12:41:26.738127+0000","last_peered":"2023-08-09T12:41:26.738127+0000","last_clean":"2023-08-09T12:41:26.738127+0000","last_became_active":"2023-08-09T12:41:25.723451+0000","last_became_peered":"2023-08-09T12:41:25.723451+0000","last_unstale":"2023-08-09T12:41:26.738127+0000","last_undegraded":"2023-08-09T12:41:26.738127+0000","last_fullsized":"2023-08-09T12:41:26.738127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:32:35.893052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744105+0000","last_change":"2023-08-09T12:41:26.743468+0000","last_active":"2023-08-09T12:41:26.744105+0000","last_peered":"2023-08-09T12:41:26.744105+0000","last_clean":"2023-08-09T12:41:26.744105+0000","last_became_active":"2023-08-09T12:41:26.742242+0000","last_became_peered":"2023-08-09T12:41:26.742242+0000","last_unstale":"2023-08-09T12:41:26.744105+0000","last_undegraded":"2023-08-09T12:41:26.744105+0000","last_fullsized":"2023-08-09T12:41:26.744105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731611+0000","last_change":"2023-08-09T12:41:25.722103+0000","last_active":"2023-08-09T12:41:26.731611+0000","last_peered":"2023-08-09T12:41:26.731611+0000","last_clean":"2023-08-09T12:41:26.731611+0000","last_became_active":"2023-08-09T12:41:25.721815+0000","last_became_peered":"2023-08-09T12:41:25.721815+0000","last_unstale":"2023-08-09T12:41:26.731611+0000","last_undegraded":"2023-08-09T12:41:26.731611+0000","last_fullsized":"2023-08-09T12:41:26.731611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:54:46.850648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702253+0000","last_change":"2023-08-09T12:41:25.702253+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702253+0000","last_undegraded":"2023-08-09T12:41:25.702253+0000","last_fullsized":"2023-08-09T12:41:25.702253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.779665+0000","last_change":"2023-08-09T12:41:25.719684+0000","last_active":"2023-08-09T12:41:26.779665+0000","last_peered":"2023-08-09T12:41:26.779665+0000","last_clean":"2023-08-09T12:41:26.779665+0000","last_became_active":"2023-08-09T12:41:25.719316+0000","last_became_peered":"2023-08-09T12:41:25.719316+0000","last_unstale":"2023-08-09T12:41:26.779665+0000","last_undegraded":"2023-08-09T12:41:26.779665+0000","last_fullsized":"2023-08-09T12:41:26.779665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:48:02.235976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758788+0000","last_change":"2023-08-09T12:41:26.758613+0000","last_active":"2023-08-09T12:41:26.758788+0000","last_peered":"2023-08-09T12:41:26.758788+0000","last_clean":"2023-08-09T12:41:26.758788+0000","last_became_active":"2023-08-09T12:41:26.758211+0000","last_became_peered":"2023-08-09T12:41:26.758211+0000","last_unstale":"2023-08-09T12:41:26.758788+0000","last_undegraded":"2023-08-09T12:41:26.758788+0000","last_fullsized":"2023-08-09T12:41:26.758788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:09.252796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.721874+0000","last_change":"2023-08-09T12:41:25.721784+0000","last_active":"2023-08-09T12:41:25.721874+0000","last_peered":"2023-08-09T12:41:25.721874+0000","last_clean":"2023-08-09T12:41:25.721874+0000","last_became_active":"2023-08-09T12:41:25.721531+0000","last_became_peered":"2023-08-09T12:41:25.721531+0000","last_unstale":"2023-08-09T12:41:25.721874+0000","last_undegraded":"2023-08-09T12:41:25.721874+0000","last_fullsized":"2023-08-09T12:41:25.721874+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:52.643529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696206+0000","last_change":"2023-08-09T12:41:25.696206+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696206+0000","last_undegraded":"2023-08-09T12:41:25.696206+0000","last_fullsized":"2023-08-09T12:41:25.696206+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.777344+0000","last_change":"2023-08-09T12:41:25.709300+0000","last_active":"2023-08-09T12:41:26.777344+0000","last_peered":"2023-08-09T12:41:26.777344+0000","last_clean":"2023-08-09T12:41:26.777344+0000","last_became_active":"2023-08-09T12:41:25.708777+0000","last_became_peered":"2023-08-09T12:41:25.708777+0000","last_unstale":"2023-08-09T12:41:26.777344+0000","last_undegraded":"2023-08-09T12:41:26.777344+0000","last_fullsized":"2023-08-09T12:41:26.777344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:47.305579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758125+0000","last_change":"2023-08-09T12:41:26.757742+0000","last_active":"2023-08-09T12:41:26.758125+0000","last_peered":"2023-08-09T12:41:26.758125+0000","last_clean":"2023-08-09T12:41:26.758125+0000","last_became_active":"2023-08-09T12:41:26.757342+0000","last_became_peered":"2023-08-09T12:41:26.757342+0000","last_unstale":"2023-08-09T12:41:26.758125+0000","last_undegraded":"2023-08-09T12:41:26.758125+0000","last_fullsized":"2023-08-09T12:41:26.758125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:38.646768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776113+0000","last_change":"2023-08-09T12:41:25.719868+0000","last_active":"2023-08-09T12:41:26.776113+0000","last_peered":"2023-08-09T12:41:26.776113+0000","last_clean":"2023-08-09T12:41:26.776113+0000","last_became_active":"2023-08-09T12:41:25.719554+0000","last_became_peered":"2023-08-09T12:41:25.719554+0000","last_unstale":"2023-08-09T12:41:26.776113+0000","last_undegraded":"2023-08-09T12:41:26.776113+0000","last_fullsized":"2023-08-09T12:41:26.776113+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:38:39.040223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696110+0000","last_change":"2023-08-09T12:41:25.696110+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696110+0000","last_undegraded":"2023-08-09T12:41:25.696110+0000","last_fullsized":"2023-08-09T12:41:25.696110+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738629+0000","last_change":"2023-08-09T12:41:25.723181+0000","last_active":"2023-08-09T12:41:26.738629+0000","last_peered":"2023-08-09T12:41:26.738629+0000","last_clean":"2023-08-09T12:41:26.738629+0000","last_became_active":"2023-08-09T12:41:25.722598+0000","last_became_peered":"2023-08-09T12:41:25.722598+0000","last_unstale":"2023-08-09T12:41:26.738629+0000","last_undegraded":"2023-08-09T12:41:26.738629+0000","last_fullsized":"2023-08-09T12:41:26.738629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:38.626616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754788+0000","last_change":"2023-08-09T12:41:26.753949+0000","last_active":"2023-08-09T12:41:26.754788+0000","last_peered":"2023-08-09T12:41:26.754788+0000","last_clean":"2023-08-09T12:41:26.754788+0000","last_became_active":"2023-08-09T12:41:26.753622+0000","last_became_peered":"2023-08-09T12:41:26.753622+0000","last_unstale":"2023-08-09T12:41:26.754788+0000","last_undegraded":"2023-08-09T12:41:26.754788+0000","last_fullsized":"2023-08-09T12:41:26.754788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:46.872566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.709228+0000","last_change":"2023-08-09T12:41:25.708766+0000","last_active":"2023-08-09T12:41:25.709228+0000","last_peered":"2023-08-09T12:41:25.709228+0000","last_clean":"2023-08-09T12:41:25.709228+0000","last_became_active":"2023-08-09T12:41:25.707255+0000","last_became_peered":"2023-08-09T12:41:25.707255+0000","last_unstale":"2023-08-09T12:41:25.709228+0000","last_undegraded":"2023-08-09T12:41:25.709228+0000","last_fullsized":"2023-08-09T12:41:25.709228+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:08:12.653133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753241+0000","last_change":"2023-08-09T12:41:26.752241+0000","last_active":"2023-08-09T12:41:26.753241+0000","last_peered":"2023-08-09T12:41:26.753241+0000","last_clean":"2023-08-09T12:41:26.753241+0000","last_became_active":"2023-08-09T12:41:26.751882+0000","last_became_peered":"2023-08-09T12:41:26.751882+0000","last_unstale":"2023-08-09T12:41:26.753241+0000","last_undegraded":"2023-08-09T12:41:26.753241+0000","last_fullsized":"2023-08-09T12:41:26.753241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:59.216428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740913+0000","last_change":"2023-08-09T12:41:25.719956+0000","last_active":"2023-08-09T12:41:26.740913+0000","last_peered":"2023-08-09T12:41:26.740913+0000","last_clean":"2023-08-09T12:41:26.740913+0000","last_became_active":"2023-08-09T12:41:25.718827+0000","last_became_peered":"2023-08-09T12:41:25.718827+0000","last_unstale":"2023-08-09T12:41:26.740913+0000","last_undegraded":"2023-08-09T12:41:26.740913+0000","last_fullsized":"2023-08-09T12:41:26.740913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:54.138658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699913+0000","last_change":"2023-08-09T12:41:25.699913+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699913+0000","last_undegraded":"2023-08-09T12:41:25.699913+0000","last_fullsized":"2023-08-09T12:41:25.699913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.721313+0000","last_change":"2023-08-09T12:41:25.716973+0000","last_active":"2023-08-09T12:41:25.721313+0000","last_peered":"2023-08-09T12:41:25.721313+0000","last_clean":"2023-08-09T12:41:25.721313+0000","last_became_active":"2023-08-09T12:41:25.715880+0000","last_became_peered":"2023-08-09T12:41:25.715880+0000","last_unstale":"2023-08-09T12:41:25.721313+0000","last_undegraded":"2023-08-09T12:41:25.721313+0000","last_fullsized":"2023-08-09T12:41:25.721313+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:09:16.682395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.704075+0000","last_change":"2023-08-09T12:41:25.704075+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.704075+0000","last_undegraded":"2023-08-09T12:41:25.704075+0000","last_fullsized":"2023-08-09T12:41:25.704075+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740848+0000","last_change":"2023-08-09T12:41:25.709666+0000","last_active":"2023-08-09T12:41:26.740848+0000","last_peered":"2023-08-09T12:41:26.740848+0000","last_clean":"2023-08-09T12:41:26.740848+0000","last_became_active":"2023-08-09T12:41:25.708958+0000","last_became_peered":"2023-08-09T12:41:25.708958+0000","last_unstale":"2023-08-09T12:41:26.740848+0000","last_undegraded":"2023-08-09T12:41:26.740848+0000","last_fullsized":"2023-08-09T12:41:26.740848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:11:27.015801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.755138+0000","last_change":"2023-08-09T12:41:26.753676+0000","last_active":"2023-08-09T12:41:26.755138+0000","last_peered":"2023-08-09T12:41:26.755138+0000","last_clean":"2023-08-09T12:41:26.755138+0000","last_became_active":"2023-08-09T12:41:26.752998+0000","last_became_peered":"2023-08-09T12:41:26.752998+0000","last_unstale":"2023-08-09T12:41:26.755138+0000","last_undegraded":"2023-08-09T12:41:26.755138+0000","last_fullsized":"2023-08-09T12:41:26.755138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:54:39.014147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.717010+0000","last_change":"2023-08-09T12:41:25.716719+0000","last_active":"2023-08-09T12:41:25.717010+0000","last_peered":"2023-08-09T12:41:25.717010+0000","last_clean":"2023-08-09T12:41:25.717010+0000","last_became_active":"2023-08-09T12:41:25.715489+0000","last_became_peered":"2023-08-09T12:41:25.715489+0000","last_unstale":"2023-08-09T12:41:25.717010+0000","last_undegraded":"2023-08-09T12:41:25.717010+0000","last_fullsized":"2023-08-09T12:41:25.717010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:12.934546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":224,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.732256+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:41:26.732256+0000","last_peered":"2023-08-09T12:41:26.732256+0000","last_clean":"2023-08-09T12:41:26.732256+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:41:26.732256+0000","last_undegraded":"2023-08-09T12:41:26.732256+0000","last_fullsized":"2023-08-09T12:41:26.732256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:01:34.343333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.751118+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:41:26.751118+0000","last_peered":"2023-08-09T12:41:26.751118+0000","last_clean":"2023-08-09T12:41:26.751118+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:41:26.751118+0000","last_undegraded":"2023-08-09T12:41:26.751118+0000","last_fullsized":"2023-08-09T12:41:26.751118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:14:32.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696149+0000","last_change":"2023-08-09T12:41:25.696149+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696149+0000","last_undegraded":"2023-08-09T12:41:25.696149+0000","last_fullsized":"2023-08-09T12:41:25.696149+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731668+0000","last_change":"2023-08-09T12:41:25.713983+0000","last_active":"2023-08-09T12:41:26.731668+0000","last_peered":"2023-08-09T12:41:26.731668+0000","last_clean":"2023-08-09T12:41:26.731668+0000","last_became_active":"2023-08-09T12:41:25.713370+0000","last_became_peered":"2023-08-09T12:41:25.713370+0000","last_unstale":"2023-08-09T12:41:26.731668+0000","last_undegraded":"2023-08-09T12:41:26.731668+0000","last_fullsized":"2023-08-09T12:41:26.731668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:55:29.675233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731892+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:41:26.731892+0000","last_peered":"2023-08-09T12:41:26.731892+0000","last_clean":"2023-08-09T12:41:26.731892+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:41:26.731892+0000","last_undegraded":"2023-08-09T12:41:26.731892+0000","last_fullsized":"2023-08-09T12:41:26.731892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:46.369931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754637+0000","last_change":"2023-08-09T12:41:26.754103+0000","last_active":"2023-08-09T12:41:26.754637+0000","last_peered":"2023-08-09T12:41:26.754637+0000","last_clean":"2023-08-09T12:41:26.754637+0000","last_became_active":"2023-08-09T12:41:26.753433+0000","last_became_peered":"2023-08-09T12:41:26.753433+0000","last_unstale":"2023-08-09T12:41:26.754637+0000","last_undegraded":"2023-08-09T12:41:26.754637+0000","last_fullsized":"2023-08-09T12:41:26.754637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:38.646768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.716611+0000","last_change":"2023-08-09T12:41:25.716511+0000","last_active":"2023-08-09T12:41:25.716611+0000","last_peered":"2023-08-09T12:41:25.716611+0000","last_clean":"2023-08-09T12:41:25.716611+0000","last_became_active":"2023-08-09T12:41:25.715140+0000","last_became_peered":"2023-08-09T12:41:25.715140+0000","last_unstale":"2023-08-09T12:41:25.716611+0000","last_undegraded":"2023-08-09T12:41:25.716611+0000","last_fullsized":"2023-08-09T12:41:25.716611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.253017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740410+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:41:26.740410+0000","last_peered":"2023-08-09T12:41:26.740410+0000","last_clean":"2023-08-09T12:41:26.740410+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:41:26.740410+0000","last_undegraded":"2023-08-09T12:41:26.740410+0000","last_fullsized":"2023-08-09T12:41:26.740410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:26:07.633953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761560+0000","last_change":"2023-08-09T12:41:26.761325+0000","last_active":"2023-08-09T12:41:26.761560+0000","last_peered":"2023-08-09T12:41:26.761560+0000","last_clean":"2023-08-09T12:41:26.761560+0000","last_became_active":"2023-08-09T12:41:26.760426+0000","last_became_peered":"2023-08-09T12:41:26.760426+0000","last_unstale":"2023-08-09T12:41:26.761560+0000","last_undegraded":"2023-08-09T12:41:26.761560+0000","last_fullsized":"2023-08-09T12:41:26.761560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:51.292745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776050+0000","last_change":"2023-08-09T12:41:25.723888+0000","last_active":"2023-08-09T12:41:26.776050+0000","last_peered":"2023-08-09T12:41:26.776050+0000","last_clean":"2023-08-09T12:41:26.776050+0000","last_became_active":"2023-08-09T12:41:25.723572+0000","last_became_peered":"2023-08-09T12:41:25.723572+0000","last_unstale":"2023-08-09T12:41:26.776050+0000","last_undegraded":"2023-08-09T12:41:26.776050+0000","last_fullsized":"2023-08-09T12:41:26.776050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:36.973105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.750783+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:41:26.750783+0000","last_peered":"2023-08-09T12:41:26.750783+0000","last_clean":"2023-08-09T12:41:26.750783+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:41:26.750783+0000","last_undegraded":"2023-08-09T12:41:26.750783+0000","last_fullsized":"2023-08-09T12:41:26.750783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:55.321046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699507+0000","last_change":"2023-08-09T12:41:25.699507+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699507+0000","last_undegraded":"2023-08-09T12:41:25.699507+0000","last_fullsized":"2023-08-09T12:41:25.699507+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744593+0000","last_change":"2023-08-09T12:41:25.714321+0000","last_active":"2023-08-09T12:41:26.744593+0000","last_peered":"2023-08-09T12:41:26.744593+0000","last_clean":"2023-08-09T12:41:26.744593+0000","last_became_active":"2023-08-09T12:41:25.713760+0000","last_became_peered":"2023-08-09T12:41:25.713760+0000","last_unstale":"2023-08-09T12:41:26.744593+0000","last_undegraded":"2023-08-09T12:41:26.744593+0000","last_fullsized":"2023-08-09T12:41:26.744593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:33.785779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.695353+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:41:25.695353+0000","last_peered":"2023-08-09T12:41:25.695353+0000","last_clean":"2023-08-09T12:41:25.695353+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:41:25.695353+0000","last_undegraded":"2023-08-09T12:41:25.695353+0000","last_fullsized":"2023-08-09T12:41:25.695353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:30:16.096590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.746290+0000","last_change":"2023-08-09T12:41:26.745215+0000","last_active":"2023-08-09T12:41:26.746290+0000","last_peered":"2023-08-09T12:41:26.746290+0000","last_clean":"2023-08-09T12:41:26.746290+0000","last_became_active":"2023-08-09T12:41:26.744468+0000","last_became_peered":"2023-08-09T12:41:26.744468+0000","last_unstale":"2023-08-09T12:41:26.746290+0000","last_undegraded":"2023-08-09T12:41:26.746290+0000","last_fullsized":"2023-08-09T12:41:26.746290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.745677+0000","last_change":"2023-08-09T12:41:25.708106+0000","last_active":"2023-08-09T12:41:26.745677+0000","last_peered":"2023-08-09T12:41:26.745677+0000","last_clean":"2023-08-09T12:41:26.745677+0000","last_became_active":"2023-08-09T12:41:25.707382+0000","last_became_peered":"2023-08-09T12:41:25.707382+0000","last_unstale":"2023-08-09T12:41:26.745677+0000","last_undegraded":"2023-08-09T12:41:26.745677+0000","last_fullsized":"2023-08-09T12:41:26.745677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:39:40.360527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731288+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:41:26.731288+0000","last_peered":"2023-08-09T12:41:26.731288+0000","last_clean":"2023-08-09T12:41:26.731288+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:41:26.731288+0000","last_undegraded":"2023-08-09T12:41:26.731288+0000","last_fullsized":"2023-08-09T12:41:26.731288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:14:06.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702093+0000","last_change":"2023-08-09T12:41:25.702093+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702093+0000","last_undegraded":"2023-08-09T12:41:25.702093+0000","last_fullsized":"2023-08-09T12:41:25.702093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.734384+0000","last_change":"2023-08-09T12:41:25.717417+0000","last_active":"2023-08-09T12:41:26.734384+0000","last_peered":"2023-08-09T12:41:26.734384+0000","last_clean":"2023-08-09T12:41:26.734384+0000","last_became_active":"2023-08-09T12:41:25.717148+0000","last_became_peered":"2023-08-09T12:41:25.717148+0000","last_unstale":"2023-08-09T12:41:26.734384+0000","last_undegraded":"2023-08-09T12:41:26.734384+0000","last_fullsized":"2023-08-09T12:41:26.734384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:03.256797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.695344+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:41:25.695344+0000","last_peered":"2023-08-09T12:41:25.695344+0000","last_clean":"2023-08-09T12:41:25.695344+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:41:25.695344+0000","last_undegraded":"2023-08-09T12:41:25.695344+0000","last_fullsized":"2023-08-09T12:41:25.695344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:00:41.973400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758833+0000","last_change":"2023-08-09T12:41:26.758588+0000","last_active":"2023-08-09T12:41:26.758833+0000","last_peered":"2023-08-09T12:41:26.758833+0000","last_clean":"2023-08-09T12:41:26.758833+0000","last_became_active":"2023-08-09T12:41:26.757232+0000","last_became_peered":"2023-08-09T12:41:26.757232+0000","last_unstale":"2023-08-09T12:41:26.758833+0000","last_undegraded":"2023-08-09T12:41:26.758833+0000","last_fullsized":"2023-08-09T12:41:26.758833+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:56.335865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.736204+0000","last_change":"2023-08-09T12:41:25.717713+0000","last_active":"2023-08-09T12:41:26.736204+0000","last_peered":"2023-08-09T12:41:26.736204+0000","last_clean":"2023-08-09T12:41:26.736204+0000","last_became_active":"2023-08-09T12:41:25.717257+0000","last_became_peered":"2023-08-09T12:41:25.717257+0000","last_unstale":"2023-08-09T12:41:26.736204+0000","last_undegraded":"2023-08-09T12:41:26.736204+0000","last_fullsized":"2023-08-09T12:41:26.736204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:40.852877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.739235+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:41:26.739235+0000","last_peered":"2023-08-09T12:41:26.739235+0000","last_clean":"2023-08-09T12:41:26.739235+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:41:26.739235+0000","last_undegraded":"2023-08-09T12:41:26.739235+0000","last_fullsized":"2023-08-09T12:41:26.739235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:31.379260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":824,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194488,"statfs":{"total":200000000,"available":199155862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.095,"15min":1.093},"min":{"1min":0.70599999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.454,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.079,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.105,"15min":1.081},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8959999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.502},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0960000000000001,"15min":1.0820000000000001},"min":{"1min":0.747,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.079}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6259999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.153,"15min":1.131},"min":{"1min":0.92500000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.107}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2310000000000001,"15min":1.2150000000000001},"min":{"1min":0.93500000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.784,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.373},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2589999999999999,"15min":1.246},"min":{"1min":0.94699999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.696,"5min":1.96,"15min":1.96},"last":1.343}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.2250000000000001,"15min":1.1990000000000001},"min":{"1min":0.92300000000000004,"5min":0.505,"15min":0.505},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.2749999999999999,"15min":1.2470000000000001},"min":{"1min":0.876,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.145}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.284,"15min":1.2589999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.4910000000000001,"15min":1.4790000000000001},"min":{"1min":0.85999999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":3.1400000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.403}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.488,"15min":1.47},"min":{"1min":1.27,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.266,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":1.1160000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.093,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.5489999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":247,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195064,"statfs":{"total":200000000,"available":199746354,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.137,"15min":1.113},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.173,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.133}]},{"osd":1,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.228,"15min":1.222},"min":{"1min":0.88800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.0009999999999999,"5min":2.306,"15min":2.306},"last":1.181},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3220000000000001,"15min":1.3089999999999999},"min":{"1min":0.91400000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.5820000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.0960000000000001,"15min":1.083},"min":{"1min":0.83099999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.2729999999999999,"15min":1.2629999999999999},"min":{"1min":0.97699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.073}]},{"osd":3,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":1.0249999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2749999999999999,"15min":1.268},"min":{"1min":0.86199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.732,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.226}]},{"osd":4,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.296,"15min":1.282},"min":{"1min":0.88900000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.327,"15min":1.3169999999999999},"min":{"1min":0.99399999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4299999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.298,"15min":1.2989999999999999},"min":{"1min":0.96999999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.462,"15min":1.45},"min":{"1min":1.1899999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7160000000000002,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.274}]},{"osd":7,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.409,"15min":1.377},"min":{"1min":1.1180000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.401,"15min":1.385},"min":{"1min":1.083,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.6299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.111,"15min":1.1100000000000001},"min":{"1min":0.75600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4930000000000001,"5min":2.427,"15min":2.427},"last":1.157},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0509999999999999,"15min":1.0349999999999999},"min":{"1min":0.73499999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.0649999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.278,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.748,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.238,"15min":1.232},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6399999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.105}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1830000000000001,"15min":1.1930000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.446,"5min":1.591,"15min":1.591},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.175,"15min":1.1830000000000001},"min":{"1min":0.78400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.728,"15min":1.728},"last":1.3540000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.181,"15min":1.1699999999999999},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.26},{"interface":"front","average":{"1min":1.29,"5min":1.3620000000000001,"15min":1.3740000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.607,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.4690000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.621,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1619999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.357,"15min":1.371},"min":{"1min":0.71999999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.921,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.863,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.948,"15min":2.948},"last":1.599}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.524},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.097,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.405},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.974,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.298}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.69199999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.72,"5min":1.77,"15min":1.77},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.0860000000000001,"15min":1.075},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.589,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.298}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.3320000000000001,"15min":1.363},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.589,"5min":1.97,"15min":1.97},"last":1.347},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.3420000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.411}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3320000000000001,"15min":1.327},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.079},{"interface":"front","average":{"1min":1.353,"5min":1.3160000000000001,"15min":1.3100000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5620000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.163},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3320000000000001,"15min":1.3380000000000001},"min":{"1min":0.97299999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6990000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.401,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.847,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3680000000000001,"15min":1.3779999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7629999999999999,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.365}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.5009999999999999,"15min":1.52},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.8080000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.397},{"interface":"front","average":{"1min":1.49,"5min":1.5349999999999999,"15min":1.5429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.95,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.694}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.516,"15min":1.516},"min":{"1min":1.0169999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8839999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.48},{"interface":"front","average":{"1min":1.538,"5min":1.6299999999999999,"15min":1.645},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0089999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.5169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.85599999999999998,"15min":0.85199999999999998},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.90600000000000003}]},{"osd":1,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3759999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.875,"15min":0.85699999999999998},"min":{"1min":0.52000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.1160000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.5680000000000001,"5min":1.893,"15min":1.893},"last":0.996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.55400000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6499999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.94199999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.84399999999999997,"5min":0.745,"15min":0.745},"max":{"1min":1.883,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.212},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3160000000000001,"15min":1.3380000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.708,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.2889999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.355,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.6870000000000001,"5min":2.157,"15min":2.157},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2589999999999999,"15min":1.2490000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.331}]},{"osd":6,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3169999999999999,"15min":1.3220000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.7649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7729999999999999,"5min":2.589,"15min":2.589},"last":1.3620000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.369,"15min":1.3700000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.776,"5min":1.78,"15min":1.78},"last":1.5269999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":249,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195063,"statfs":{"total":200000000,"available":199744742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5329999999999999,"5min":1.716,"15min":1.716},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0349999999999999,"15min":1.054},"min":{"1min":0.61199999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.782,"5min":1.869,"15min":1.869},"last":0.50700000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.242,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.69199999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.403,"15min":1.4039999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.2869999999999999,"15min":1.2569999999999999},"min":{"1min":0.83199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.3660000000000001,"15min":1.3420000000000001},"min":{"1min":0.98199999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":5.0140000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.498,"15min":1.486},"min":{"1min":0.879,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":1.04}]},{"osd":6,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.298,"15min":1.288},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.0669999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.351,"15min":1.347},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5269999999999999,"15min":1.5249999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.25}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.881},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85099999999999998,"15min":0.85399999999999998},"min":{"1min":0.48899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.232,"5min":1.24,"15min":1.24},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.679,"5min":1.774,"15min":1.774},"last":1.569}]},{"osd":3,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.046},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6559999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.008,"5min":0.90100000000000002,"15min":0.88300000000000001},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.238}]},{"osd":4,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2669999999999999,"15min":1.264},"min":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6799999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.4059999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2609999999999999,"15min":1.2629999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.02,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.2589999999999999,"15min":1.2450000000000001},"min":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.206}]},{"osd":6,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.373,"15min":1.373},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2210000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3520000000000001,"15min":1.341},"min":{"1min":0.999,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.839,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.631}]},{"osd":7,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.8049999999999999,"5min":2.294,"15min":2.294},"last":1.8140000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.413,"15min":1.413},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.1280000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.754}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2729999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.819},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.90100000000000002},"min":{"1min":0.57199999999999995,"5min":0.436,"15min":0.436},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.88700000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92800000000000005,"15min":0.92900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.373,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.59199999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.484,"5min":1.607,"15min":1.607},"last":1.6040000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86899999999999999,"15min":0.873},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.196,"5min":1.952,"15min":1.952},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.153,"15min":1.161},"min":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5860000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4650000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2829999999999999,"15min":1.302},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6080000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.147},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.6970000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.7110000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2509999999999999,"15min":1.2589999999999999},"min":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3540000000000001,"15min":1.3600000000000001},"min":{"1min":0.89100000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8100000000000001,"5min":2.161,"15min":2.161},"last":1.909}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3109999999999999,"15min":1.3},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.373,"15min":1.3819999999999999},"min":{"1min":0.90100000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.008,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.399}]},{"osd":7,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3680000000000001,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.3959999999999999,"15min":1.4059999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.7150000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4510000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:41:31.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:41:31.979 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-08-09T12:41:31.976+0000 7f44e4d53640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:41:32.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.065+0000 7efe63901640 1 Processor -- start 2023-08-09T12:41:32.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.066+0000 7efe63901640 1 -- start start 2023-08-09T12:41:32.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.067+0000 7efe63901640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efe5c15ce90 0x7efe5c1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.067+0000 7efe63901640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0d29d0 0x7efe5c0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.067+0000 7efe63901640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c0b6460 con 0x7efe5c0b6000 2023-08-09T12:41:32.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.067+0000 7efe63901640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c0d33a0 con 0x7efe5c15ce90 2023-08-09T12:41:32.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.067+0000 7efe63901640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c0cdd10 con 0x7efe5c0d29d0 2023-08-09T12:41:32.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.068+0000 7efe6169d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efe5c15ce90 0x7efe5c1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.068+0000 7efe60e9c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7efe5c0b6000 0x7efe5c0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55282/0 (socket says 172.21.15.17:55282) 2023-08-09T12:41:32.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.068+0000 7efe60e9c640 1 -- 172.21.15.17:0/1133710911 learned_addr learned my addr 172.21.15.17:0/1133710911 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:32.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.068+0000 7efe6169d640 1 -- 172.21.15.17:0/1133710911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0d29d0 msgr2=0x7efe5c0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:32.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.068+0000 7efe6169d640 1 --2- 172.21.15.17:0/1133710911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0d29d0 0x7efe5c0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.068+0000 7efe6169d640 1 -- 172.21.15.17:0/1133710911 >> v1:172.21.15.17:6789/0 conn(0x7efe5c0b6000 legacy=0x7efe5c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.068+0000 7efe6169d640 1 -- 172.21.15.17:0/1133710911 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c0cdff0 con 0x7efe5c15ce90 2023-08-09T12:41:32.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.069+0000 7efe6169d640 1 --2- 172.21.15.17:0/1133710911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c1616e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efe58009d90 tx=0x7efe5802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221419b222f8ba4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:32.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe53fff640 1 -- 172.21.15.17:0/1133710911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5802cc50 con 0x7efe5c15ce90 2023-08-09T12:41:32.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe53fff640 1 -- 172.21.15.17:0/1133710911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5802cdb0 con 0x7efe5c15ce90 2023-08-09T12:41:32.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe53fff640 1 -- 172.21.15.17:0/1133710911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58034660 con 0x7efe5c15ce90 2023-08-09T12:41:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe63901640 1 -- 172.21.15.17:0/1133710911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 msgr2=0x7efe5c1616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe63901640 1 --2- 172.21.15.17:0/1133710911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c1616e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efe58009d90 tx=0x7efe5802bea0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe63901640 1 -- 172.21.15.17:0/1133710911 shutdown_connections 2023-08-09T12:41:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe63901640 1 --2- 172.21.15.17:0/1133710911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0d29d0 0x7efe5c0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe63901640 1 --2- 172.21.15.17:0/1133710911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c1616e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.070+0000 7efe63901640 1 -- 172.21.15.17:0/1133710911 >> 172.21.15.17:0/1133710911 conn(0x7efe5c06fde0 msgr2=0x7efe5c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.071+0000 7efe63901640 1 -- 172.21.15.17:0/1133710911 shutdown_connections 2023-08-09T12:41:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.071+0000 7efe63901640 1 -- 172.21.15.17:0/1133710911 wait complete. 2023-08-09T12:41:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.072+0000 7efe63901640 1 Processor -- start 2023-08-09T12:41:32.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.072+0000 7efe63901640 1 -- start start 2023-08-09T12:41:32.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.073+0000 7efe63901640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0b6000 0x7efe5c15d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.073+0000 7efe63901640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe5c0d29d0 0x7efe5c0b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.073+0000 7efe63901640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.073+0000 7efe63901640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1e7880 con 0x7efe5c15ce90 2023-08-09T12:41:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe63901640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1e7b60 con 0x7efe5c0d29d0 2023-08-09T12:41:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe63901640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1e7e40 con 0x7efe5c0b6000 2023-08-09T12:41:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe61e9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe61e9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c15fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52024/0 (socket says 172.21.15.17:52024) 2023-08-09T12:41:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe61e9e640 1 -- 172.21.15.17:0/1610250404 learned_addr learned my addr 172.21.15.17:0/1610250404 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe6169d640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0b6000 0x7efe5c15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe60e9c640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe5c0d29d0 0x7efe5c0b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe61e9e640 1 -- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0b6000 msgr2=0x7efe5c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe61e9e640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0b6000 0x7efe5c15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe61e9e640 1 -- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe5c0d29d0 msgr2=0x7efe5c0b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe61e9e640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe5c0d29d0 0x7efe5c0b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe61e9e640 1 -- 172.21.15.17:0/1610250404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009a70 con 0x7efe5c15ce90 2023-08-09T12:41:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe6169d640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0b6000 0x7efe5c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.074+0000 7efe60e9c640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe5c0d29d0 0x7efe5c0b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.075+0000 7efe61e9e640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c15fc60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efe54009fd0 tx=0x7efe5400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.075+0000 7efe51ffb640 1 -- 172.21.15.17:0/1610250404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54011830 con 0x7efe5c15ce90 2023-08-09T12:41:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.075+0000 7efe51ffb640 1 -- 172.21.15.17:0/1610250404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54011990 con 0x7efe5c15ce90 2023-08-09T12:41:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.075+0000 7efe51ffb640 1 -- 172.21.15.17:0/1610250404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54011d20 con 0x7efe5c15ce90 2023-08-09T12:41:32.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.075+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c1e8120 con 0x7efe5c15ce90 2023-08-09T12:41:32.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.075+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c1601a0 con 0x7efe5c15ce90 2023-08-09T12:41:32.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.076+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c0d0fa0 con 0x7efe5c15ce90 2023-08-09T12:41:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.077+0000 7efe51ffb640 1 -- 172.21.15.17:0/1610250404 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efe5401b460 con 0x7efe5c15ce90 2023-08-09T12:41:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.078+0000 7efe51ffb640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe4006a050 0x7efe4006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.078+0000 7efe51ffb640 1 -- 172.21.15.17:0/1610250404 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe54088440 con 0x7efe5c15ce90 2023-08-09T12:41:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.079+0000 7efe6169d640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe4006a050 0x7efe4006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.080+0000 7efe6169d640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe4006a050 0x7efe4006c510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efe58036000 tx=0x7efe58030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:32.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.083+0000 7efe51ffb640 1 -- 172.21.15.17:0/1610250404 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efe5c0d0fa0 con 0x7efe5c15ce90 2023-08-09T12:41:32.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.271+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe5c0ce2d0 con 0x7efe4006a050 2023-08-09T12:41:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.294+0000 7efe51ffb640 1 -- 172.21.15.17:0/1610250404 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300732 (secure 0 0 0) 0x7efe58034540 con 0x7efe4006a050 2023-08-09T12:41:32.301 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:32.303 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:41:32.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe4006a050 msgr2=0x7efe4006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe4006a050 0x7efe4006c510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efe58036000 tx=0x7efe58030000 comp rx=0 tx=0).stop 2023-08-09T12:41:32.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 msgr2=0x7efe5c15fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c15fc60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efe54009fd0 tx=0x7efe5400b8e0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 shutdown_connections 2023-08-09T12:41:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe4006a050 0x7efe4006c510 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe5c15ce90 0x7efe5c15fc60 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe5c0d29d0 0x7efe5c0b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 --2- 172.21.15.17:0/1610250404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe5c0b6000 0x7efe5c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 >> 172.21.15.17:0/1610250404 conn(0x7efe5c06fde0 msgr2=0x7efe5c0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 shutdown_connections 2023-08-09T12:41:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.300+0000 7efe63901640 1 -- 172.21.15.17:0/1610250404 wait complete. 2023-08-09T12:41:32.323 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-08-09T12:41:30.679852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3095,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559404,"statfs":{"total":1600000000,"available":1596830628,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994474"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.708068+0000","last_change":"2023-08-09T12:41:25.708068+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.708068+0000","last_undegraded":"2023-08-09T12:41:25.708068+0000","last_fullsized":"2023-08-09T12:41:25.708068+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754794+0000","last_change":"2023-08-09T12:41:26.754678+0000","last_active":"2023-08-09T12:41:26.754794+0000","last_peered":"2023-08-09T12:41:26.754794+0000","last_clean":"2023-08-09T12:41:26.754794+0000","last_became_active":"2023-08-09T12:41:26.754276+0000","last_became_peered":"2023-08-09T12:41:26.754276+0000","last_unstale":"2023-08-09T12:41:26.754794+0000","last_undegraded":"2023-08-09T12:41:26.754794+0000","last_fullsized":"2023-08-09T12:41:26.754794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:53:52.596963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700690+0000","last_change":"2023-08-09T12:41:25.700690+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700690+0000","last_undegraded":"2023-08-09T12:41:25.700690+0000","last_fullsized":"2023-08-09T12:41:25.700690+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.749039+0000","last_change":"2023-08-09T12:41:26.748928+0000","last_active":"2023-08-09T12:41:26.749039+0000","last_peered":"2023-08-09T12:41:26.749039+0000","last_clean":"2023-08-09T12:41:26.749039+0000","last_became_active":"2023-08-09T12:41:26.748363+0000","last_became_peered":"2023-08-09T12:41:26.748363+0000","last_unstale":"2023-08-09T12:41:26.749039+0000","last_undegraded":"2023-08-09T12:41:26.749039+0000","last_fullsized":"2023-08-09T12:41:26.749039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:14.075784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754016+0000","last_change":"2023-08-09T12:41:26.753475+0000","last_active":"2023-08-09T12:41:26.754016+0000","last_peered":"2023-08-09T12:41:26.754016+0000","last_clean":"2023-08-09T12:41:26.754016+0000","last_became_active":"2023-08-09T12:41:26.753219+0000","last_became_peered":"2023-08-09T12:41:26.753219+0000","last_unstale":"2023-08-09T12:41:26.754016+0000","last_undegraded":"2023-08-09T12:41:26.754016+0000","last_fullsized":"2023-08-09T12:41:26.754016+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.707203+0000","last_change":"2023-08-09T12:41:25.707203+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.707203+0000","last_undegraded":"2023-08-09T12:41:25.707203+0000","last_fullsized":"2023-08-09T12:41:25.707203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.703555+0000","last_change":"2023-08-09T12:41:25.703555+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.703555+0000","last_undegraded":"2023-08-09T12:41:25.703555+0000","last_fullsized":"2023-08-09T12:41:25.703555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.765244+0000","last_change":"2023-08-09T12:41:26.764924+0000","last_active":"2023-08-09T12:41:26.765244+0000","last_peered":"2023-08-09T12:41:26.765244+0000","last_clean":"2023-08-09T12:41:26.765244+0000","last_became_active":"2023-08-09T12:41:26.764684+0000","last_became_peered":"2023-08-09T12:41:26.764684+0000","last_unstale":"2023-08-09T12:41:26.765244+0000","last_undegraded":"2023-08-09T12:41:26.765244+0000","last_fullsized":"2023-08-09T12:41:26.765244+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:35:48.443783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.766472+0000","last_change":"2023-08-09T12:41:26.766387+0000","last_active":"2023-08-09T12:41:26.766472+0000","last_peered":"2023-08-09T12:41:26.766472+0000","last_clean":"2023-08-09T12:41:26.766472+0000","last_became_active":"2023-08-09T12:41:26.765392+0000","last_became_peered":"2023-08-09T12:41:26.765392+0000","last_unstale":"2023-08-09T12:41:26.766472+0000","last_undegraded":"2023-08-09T12:41:26.766472+0000","last_fullsized":"2023-08-09T12:41:26.766472+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:48.342228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.704905+0000","last_change":"2023-08-09T12:41:25.704905+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.704905+0000","last_undegraded":"2023-08-09T12:41:25.704905+0000","last_fullsized":"2023-08-09T12:41:25.704905+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753006+0000","last_change":"2023-08-09T12:41:26.751660+0000","last_active":"2023-08-09T12:41:26.753006+0000","last_peered":"2023-08-09T12:41:26.753006+0000","last_clean":"2023-08-09T12:41:26.753006+0000","last_became_active":"2023-08-09T12:41:26.751076+0000","last_became_peered":"2023-08-09T12:41:26.751076+0000","last_unstale":"2023-08-09T12:41:26.753006+0000","last_undegraded":"2023-08-09T12:41:26.753006+0000","last_fullsized":"2023-08-09T12:41:26.753006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:28:29.430515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744213+0000","last_change":"2023-08-09T12:41:26.744068+0000","last_active":"2023-08-09T12:41:26.744213+0000","last_peered":"2023-08-09T12:41:26.744213+0000","last_clean":"2023-08-09T12:41:26.744213+0000","last_became_active":"2023-08-09T12:41:26.742814+0000","last_became_peered":"2023-08-09T12:41:26.742814+0000","last_unstale":"2023-08-09T12:41:26.744213+0000","last_undegraded":"2023-08-09T12:41:26.744213+0000","last_fullsized":"2023-08-09T12:41:26.744213+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:13:01.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.706498+0000","last_change":"2023-08-09T12:41:25.706498+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.706498+0000","last_undegraded":"2023-08-09T12:41:25.706498+0000","last_fullsized":"2023-08-09T12:41:25.706498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.701414+0000","last_change":"2023-08-09T12:41:25.701414+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.701414+0000","last_undegraded":"2023-08-09T12:41:25.701414+0000","last_fullsized":"2023-08-09T12:41:25.701414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.747123+0000","last_change":"2023-08-09T12:41:26.741311+0000","last_active":"2023-08-09T12:41:26.747123+0000","last_peered":"2023-08-09T12:41:26.747123+0000","last_clean":"2023-08-09T12:41:26.747123+0000","last_became_active":"2023-08-09T12:41:26.740668+0000","last_became_peered":"2023-08-09T12:41:26.740668+0000","last_unstale":"2023-08-09T12:41:26.747123+0000","last_undegraded":"2023-08-09T12:41:26.747123+0000","last_fullsized":"2023-08-09T12:41:26.747123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:48.189765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.706144+0000","last_change":"2023-08-09T12:41:25.706144+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.706144+0000","last_undegraded":"2023-08-09T12:41:25.706144+0000","last_fullsized":"2023-08-09T12:41:25.706144+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700012+0000","last_change":"2023-08-09T12:41:25.700012+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700012+0000","last_undegraded":"2023-08-09T12:41:25.700012+0000","last_fullsized":"2023-08-09T12:41:25.700012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753924+0000","last_change":"2023-08-09T12:41:26.752877+0000","last_active":"2023-08-09T12:41:26.753924+0000","last_peered":"2023-08-09T12:41:26.753924+0000","last_clean":"2023-08-09T12:41:26.753924+0000","last_became_active":"2023-08-09T12:41:26.752230+0000","last_became_peered":"2023-08-09T12:41:26.752230+0000","last_unstale":"2023-08-09T12:41:26.753924+0000","last_undegraded":"2023-08-09T12:41:26.753924+0000","last_fullsized":"2023-08-09T12:41:26.753924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:47:13.757008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702258+0000","last_change":"2023-08-09T12:41:25.702258+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702258+0000","last_undegraded":"2023-08-09T12:41:25.702258+0000","last_fullsized":"2023-08-09T12:41:25.702258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.755461+0000","last_change":"2023-08-09T12:41:26.755290+0000","last_active":"2023-08-09T12:41:26.755461+0000","last_peered":"2023-08-09T12:41:26.755461+0000","last_clean":"2023-08-09T12:41:26.755461+0000","last_became_active":"2023-08-09T12:41:26.753410+0000","last_became_peered":"2023-08-09T12:41:26.753410+0000","last_unstale":"2023-08-09T12:41:26.755461+0000","last_undegraded":"2023-08-09T12:41:26.755461+0000","last_fullsized":"2023-08-09T12:41:26.755461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:20.535847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758524+0000","last_change":"2023-08-09T12:41:26.758273+0000","last_active":"2023-08-09T12:41:26.758524+0000","last_peered":"2023-08-09T12:41:26.758524+0000","last_clean":"2023-08-09T12:41:26.758524+0000","last_became_active":"2023-08-09T12:41:26.753618+0000","last_became_peered":"2023-08-09T12:41:26.753618+0000","last_unstale":"2023-08-09T12:41:26.758524+0000","last_undegraded":"2023-08-09T12:41:26.758524+0000","last_fullsized":"2023-08-09T12:41:26.758524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:18.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.762564+0000","last_change":"2023-08-09T12:41:26.762381+0000","last_active":"2023-08-09T12:41:26.762564+0000","last_peered":"2023-08-09T12:41:26.762564+0000","last_clean":"2023-08-09T12:41:26.762564+0000","last_became_active":"2023-08-09T12:41:26.761594+0000","last_became_peered":"2023-08-09T12:41:26.761594+0000","last_unstale":"2023-08-09T12:41:26.762564+0000","last_undegraded":"2023-08-09T12:41:26.762564+0000","last_fullsized":"2023-08-09T12:41:26.762564+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:34.790459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754310+0000","last_change":"2023-08-09T12:41:26.753387+0000","last_active":"2023-08-09T12:41:26.754310+0000","last_peered":"2023-08-09T12:41:26.754310+0000","last_clean":"2023-08-09T12:41:26.754310+0000","last_became_active":"2023-08-09T12:41:26.752651+0000","last_became_peered":"2023-08-09T12:41:26.752651+0000","last_unstale":"2023-08-09T12:41:26.754310+0000","last_undegraded":"2023-08-09T12:41:26.754310+0000","last_fullsized":"2023-08-09T12:41:26.754310+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:05.292154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.700584+0000","last_change":"2023-08-09T12:41:25.700584+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.700584+0000","last_undegraded":"2023-08-09T12:41:25.700584+0000","last_fullsized":"2023-08-09T12:41:25.700584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.708070+0000","last_change":"2023-08-09T12:41:25.708070+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.708070+0000","last_undegraded":"2023-08-09T12:41:25.708070+0000","last_fullsized":"2023-08-09T12:41:25.708070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743932+0000","last_change":"2023-08-09T12:41:26.742962+0000","last_active":"2023-08-09T12:41:26.743932+0000","last_peered":"2023-08-09T12:41:26.743932+0000","last_clean":"2023-08-09T12:41:26.743932+0000","last_became_active":"2023-08-09T12:41:26.742314+0000","last_became_peered":"2023-08-09T12:41:26.742314+0000","last_unstale":"2023-08-09T12:41:26.743932+0000","last_undegraded":"2023-08-09T12:41:26.743932+0000","last_fullsized":"2023-08-09T12:41:26.743932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:03:40.448213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.705108+0000","last_change":"2023-08-09T12:41:25.705108+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.705108+0000","last_undegraded":"2023-08-09T12:41:25.705108+0000","last_fullsized":"2023-08-09T12:41:25.705108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743241+0000","last_change":"2023-08-09T12:41:26.742817+0000","last_active":"2023-08-09T12:41:26.743241+0000","last_peered":"2023-08-09T12:41:26.743241+0000","last_clean":"2023-08-09T12:41:26.743241+0000","last_became_active":"2023-08-09T12:41:26.742199+0000","last_became_peered":"2023-08-09T12:41:26.742199+0000","last_unstale":"2023-08-09T12:41:26.743241+0000","last_undegraded":"2023-08-09T12:41:26.743241+0000","last_fullsized":"2023-08-09T12:41:26.743241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:38.407498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699671+0000","last_change":"2023-08-09T12:41:25.699671+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699671+0000","last_undegraded":"2023-08-09T12:41:25.699671+0000","last_fullsized":"2023-08-09T12:41:25.699671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.759692+0000","last_change":"2023-08-09T12:41:26.759612+0000","last_active":"2023-08-09T12:41:26.759692+0000","last_peered":"2023-08-09T12:41:26.759692+0000","last_clean":"2023-08-09T12:41:26.759692+0000","last_became_active":"2023-08-09T12:41:26.759326+0000","last_became_peered":"2023-08-09T12:41:26.759326+0000","last_unstale":"2023-08-09T12:41:26.759692+0000","last_undegraded":"2023-08-09T12:41:26.759692+0000","last_fullsized":"2023-08-09T12:41:26.759692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:51.748893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699396+0000","last_change":"2023-08-09T12:41:25.699396+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699396+0000","last_undegraded":"2023-08-09T12:41:25.699396+0000","last_fullsized":"2023-08-09T12:41:25.699396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.760804+0000","last_change":"2023-08-09T12:41:26.760698+0000","last_active":"2023-08-09T12:41:26.760804+0000","last_peered":"2023-08-09T12:41:26.760804+0000","last_clean":"2023-08-09T12:41:26.760804+0000","last_became_active":"2023-08-09T12:41:26.760285+0000","last_became_peered":"2023-08-09T12:41:26.760285+0000","last_unstale":"2023-08-09T12:41:26.760804+0000","last_undegraded":"2023-08-09T12:41:26.760804+0000","last_fullsized":"2023-08-09T12:41:26.760804+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:37.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754195+0000","last_change":"2023-08-09T12:41:26.754093+0000","last_active":"2023-08-09T12:41:26.754195+0000","last_peered":"2023-08-09T12:41:26.754195+0000","last_clean":"2023-08-09T12:41:26.754195+0000","last_became_active":"2023-08-09T12:41:26.752605+0000","last_became_peered":"2023-08-09T12:41:26.752605+0000","last_unstale":"2023-08-09T12:41:26.754195+0000","last_undegraded":"2023-08-09T12:41:26.754195+0000","last_fullsized":"2023-08-09T12:41:26.754195+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:56:34.930871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.775310+0000","last_change":"2023-08-09T12:41:25.721830+0000","last_active":"2023-08-09T12:41:26.775310+0000","last_peered":"2023-08-09T12:41:26.775310+0000","last_clean":"2023-08-09T12:41:26.775310+0000","last_became_active":"2023-08-09T12:41:25.721477+0000","last_became_peered":"2023-08-09T12:41:25.721477+0000","last_unstale":"2023-08-09T12:41:26.775310+0000","last_undegraded":"2023-08-09T12:41:26.775310+0000","last_fullsized":"2023-08-09T12:41:26.775310+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:17:17.790512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.752846+0000","last_change":"2023-08-09T12:41:26.752060+0000","last_active":"2023-08-09T12:41:26.752846+0000","last_peered":"2023-08-09T12:41:26.752846+0000","last_clean":"2023-08-09T12:41:26.752846+0000","last_became_active":"2023-08-09T12:41:26.751292+0000","last_became_peered":"2023-08-09T12:41:26.751292+0000","last_unstale":"2023-08-09T12:41:26.752846+0000","last_undegraded":"2023-08-09T12:41:26.752846+0000","last_fullsized":"2023-08-09T12:41:26.752846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:12:09.364968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.718335+0000","last_change":"2023-08-09T12:41:25.718240+0000","last_active":"2023-08-09T12:41:25.718335+0000","last_peered":"2023-08-09T12:41:25.718335+0000","last_clean":"2023-08-09T12:41:25.718335+0000","last_became_active":"2023-08-09T12:41:25.717916+0000","last_became_peered":"2023-08-09T12:41:25.717916+0000","last_unstale":"2023-08-09T12:41:25.718335+0000","last_undegraded":"2023-08-09T12:41:25.718335+0000","last_fullsized":"2023-08-09T12:41:25.718335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:30:50.797135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758137+0000","last_change":"2023-08-09T12:41:26.754052+0000","last_active":"2023-08-09T12:41:26.758137+0000","last_peered":"2023-08-09T12:41:26.758137+0000","last_clean":"2023-08-09T12:41:26.758137+0000","last_became_active":"2023-08-09T12:41:26.752928+0000","last_became_peered":"2023-08-09T12:41:26.752928+0000","last_unstale":"2023-08-09T12:41:26.758137+0000","last_undegraded":"2023-08-09T12:41:26.758137+0000","last_fullsized":"2023-08-09T12:41:26.758137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:38:59.971994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.719460+0000","last_change":"2023-08-09T12:41:25.719346+0000","last_active":"2023-08-09T12:41:25.719460+0000","last_peered":"2023-08-09T12:41:25.719460+0000","last_clean":"2023-08-09T12:41:25.719460+0000","last_became_active":"2023-08-09T12:41:25.719015+0000","last_became_peered":"2023-08-09T12:41:25.719015+0000","last_unstale":"2023-08-09T12:41:25.719460+0000","last_undegraded":"2023-08-09T12:41:25.719460+0000","last_fullsized":"2023-08-09T12:41:25.719460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:29:52.920254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.743989+0000","last_change":"2023-08-09T12:41:26.743217+0000","last_active":"2023-08-09T12:41:26.743989+0000","last_peered":"2023-08-09T12:41:26.743989+0000","last_clean":"2023-08-09T12:41:26.743989+0000","last_became_active":"2023-08-09T12:41:26.742517+0000","last_became_peered":"2023-08-09T12:41:26.742517+0000","last_unstale":"2023-08-09T12:41:26.743989+0000","last_undegraded":"2023-08-09T12:41:26.743989+0000","last_fullsized":"2023-08-09T12:41:26.743989+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:34.058833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776911+0000","last_change":"2023-08-09T12:41:25.722114+0000","last_active":"2023-08-09T12:41:26.776911+0000","last_peered":"2023-08-09T12:41:26.776911+0000","last_clean":"2023-08-09T12:41:26.776911+0000","last_became_active":"2023-08-09T12:41:25.721669+0000","last_became_peered":"2023-08-09T12:41:25.721669+0000","last_unstale":"2023-08-09T12:41:26.776911+0000","last_undegraded":"2023-08-09T12:41:26.776911+0000","last_fullsized":"2023-08-09T12:41:26.776911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:17.540738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.770166+0000","last_change":"2023-08-09T12:41:26.770070+0000","last_active":"2023-08-09T12:41:26.770166+0000","last_peered":"2023-08-09T12:41:26.770166+0000","last_clean":"2023-08-09T12:41:26.770166+0000","last_became_active":"2023-08-09T12:41:26.769738+0000","last_became_peered":"2023-08-09T12:41:26.769738+0000","last_unstale":"2023-08-09T12:41:26.770166+0000","last_undegraded":"2023-08-09T12:41:26.770166+0000","last_fullsized":"2023-08-09T12:41:26.770166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:47.795643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.722227+0000","last_change":"2023-08-09T12:41:25.722107+0000","last_active":"2023-08-09T12:41:25.722227+0000","last_peered":"2023-08-09T12:41:25.722227+0000","last_clean":"2023-08-09T12:41:25.722227+0000","last_became_active":"2023-08-09T12:41:25.721515+0000","last_became_peered":"2023-08-09T12:41:25.721515+0000","last_unstale":"2023-08-09T12:41:25.722227+0000","last_undegraded":"2023-08-09T12:41:25.722227+0000","last_fullsized":"2023-08-09T12:41:25.722227+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:37.179674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761806+0000","last_change":"2023-08-09T12:41:26.761679+0000","last_active":"2023-08-09T12:41:26.761806+0000","last_peered":"2023-08-09T12:41:26.761806+0000","last_clean":"2023-08-09T12:41:26.761806+0000","last_became_active":"2023-08-09T12:41:26.761434+0000","last_became_peered":"2023-08-09T12:41:26.761434+0000","last_unstale":"2023-08-09T12:41:26.761806+0000","last_undegraded":"2023-08-09T12:41:26.761806+0000","last_fullsized":"2023-08-09T12:41:26.761806+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:07:29.451454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.775777+0000","last_change":"2023-08-09T12:41:25.720698+0000","last_active":"2023-08-09T12:41:26.775777+0000","last_peered":"2023-08-09T12:41:26.775777+0000","last_clean":"2023-08-09T12:41:26.775777+0000","last_became_active":"2023-08-09T12:41:25.720198+0000","last_became_peered":"2023-08-09T12:41:25.720198+0000","last_unstale":"2023-08-09T12:41:26.775777+0000","last_undegraded":"2023-08-09T12:41:26.775777+0000","last_fullsized":"2023-08-09T12:41:26.775777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:03.256797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744033+0000","last_change":"2023-08-09T12:41:26.743459+0000","last_active":"2023-08-09T12:41:26.744033+0000","last_peered":"2023-08-09T12:41:26.744033+0000","last_clean":"2023-08-09T12:41:26.744033+0000","last_became_active":"2023-08-09T12:41:26.741850+0000","last_became_peered":"2023-08-09T12:41:26.741850+0000","last_unstale":"2023-08-09T12:41:26.744033+0000","last_undegraded":"2023-08-09T12:41:26.744033+0000","last_fullsized":"2023-08-09T12:41:26.744033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:47.795643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738984+0000","last_change":"2023-08-09T12:41:25.718176+0000","last_active":"2023-08-09T12:41:26.738984+0000","last_peered":"2023-08-09T12:41:26.738984+0000","last_clean":"2023-08-09T12:41:26.738984+0000","last_became_active":"2023-08-09T12:41:25.717644+0000","last_became_peered":"2023-08-09T12:41:25.717644+0000","last_unstale":"2023-08-09T12:41:26.738984+0000","last_undegraded":"2023-08-09T12:41:26.738984+0000","last_fullsized":"2023-08-09T12:41:26.738984+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:22:25.646805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.756590+0000","last_change":"2023-08-09T12:41:26.756431+0000","last_active":"2023-08-09T12:41:26.756590+0000","last_peered":"2023-08-09T12:41:26.756590+0000","last_clean":"2023-08-09T12:41:26.756590+0000","last_became_active":"2023-08-09T12:41:26.755532+0000","last_became_peered":"2023-08-09T12:41:26.755532+0000","last_unstale":"2023-08-09T12:41:26.756590+0000","last_undegraded":"2023-08-09T12:41:26.756590+0000","last_fullsized":"2023-08-09T12:41:26.756590+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:08:32.383305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.722268+0000","last_change":"2023-08-09T12:41:25.722201+0000","last_active":"2023-08-09T12:41:25.722268+0000","last_peered":"2023-08-09T12:41:25.722268+0000","last_clean":"2023-08-09T12:41:25.722268+0000","last_became_active":"2023-08-09T12:41:25.721923+0000","last_became_peered":"2023-08-09T12:41:25.721923+0000","last_unstale":"2023-08-09T12:41:25.722268+0000","last_undegraded":"2023-08-09T12:41:25.722268+0000","last_fullsized":"2023-08-09T12:41:25.722268+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:54.880610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758159+0000","last_change":"2023-08-09T12:41:26.757770+0000","last_active":"2023-08-09T12:41:26.758159+0000","last_peered":"2023-08-09T12:41:26.758159+0000","last_clean":"2023-08-09T12:41:26.758159+0000","last_became_active":"2023-08-09T12:41:26.757533+0000","last_became_peered":"2023-08-09T12:41:26.757533+0000","last_unstale":"2023-08-09T12:41:26.758159+0000","last_undegraded":"2023-08-09T12:41:26.758159+0000","last_fullsized":"2023-08-09T12:41:26.758159+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731870+0000","last_change":"2023-08-09T12:41:25.709057+0000","last_active":"2023-08-09T12:41:26.731870+0000","last_peered":"2023-08-09T12:41:26.731870+0000","last_clean":"2023-08-09T12:41:26.731870+0000","last_became_active":"2023-08-09T12:41:25.708378+0000","last_became_peered":"2023-08-09T12:41:25.708378+0000","last_unstale":"2023-08-09T12:41:26.731870+0000","last_undegraded":"2023-08-09T12:41:26.731870+0000","last_fullsized":"2023-08-09T12:41:26.731870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:47:39.880663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.752876+0000","last_change":"2023-08-09T12:41:26.752598+0000","last_active":"2023-08-09T12:41:26.752876+0000","last_peered":"2023-08-09T12:41:26.752876+0000","last_clean":"2023-08-09T12:41:26.752876+0000","last_became_active":"2023-08-09T12:41:26.752197+0000","last_became_peered":"2023-08-09T12:41:26.752197+0000","last_unstale":"2023-08-09T12:41:26.752876+0000","last_undegraded":"2023-08-09T12:41:26.752876+0000","last_fullsized":"2023-08-09T12:41:26.752876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:21.832052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.746841+0000","last_change":"2023-08-09T12:41:25.710502+0000","last_active":"2023-08-09T12:41:26.746841+0000","last_peered":"2023-08-09T12:41:26.746841+0000","last_clean":"2023-08-09T12:41:26.746841+0000","last_became_active":"2023-08-09T12:41:25.709843+0000","last_became_peered":"2023-08-09T12:41:25.709843+0000","last_unstale":"2023-08-09T12:41:26.746841+0000","last_undegraded":"2023-08-09T12:41:26.746841+0000","last_fullsized":"2023-08-09T12:41:26.746841+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:47.337548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.701483+0000","last_change":"2023-08-09T12:41:25.701483+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.701483+0000","last_undegraded":"2023-08-09T12:41:25.701483+0000","last_fullsized":"2023-08-09T12:41:25.701483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776412+0000","last_change":"2023-08-09T12:41:25.719290+0000","last_active":"2023-08-09T12:41:26.776412+0000","last_peered":"2023-08-09T12:41:26.776412+0000","last_clean":"2023-08-09T12:41:26.776412+0000","last_became_active":"2023-08-09T12:41:25.718919+0000","last_became_peered":"2023-08-09T12:41:25.718919+0000","last_unstale":"2023-08-09T12:41:26.776412+0000","last_undegraded":"2023-08-09T12:41:26.776412+0000","last_fullsized":"2023-08-09T12:41:26.776412+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:57:33.297308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761037+0000","last_change":"2023-08-09T12:41:26.760937+0000","last_active":"2023-08-09T12:41:26.761037+0000","last_peered":"2023-08-09T12:41:26.761037+0000","last_clean":"2023-08-09T12:41:26.761037+0000","last_became_active":"2023-08-09T12:41:26.760393+0000","last_became_peered":"2023-08-09T12:41:26.760393+0000","last_unstale":"2023-08-09T12:41:26.761037+0000","last_undegraded":"2023-08-09T12:41:26.761037+0000","last_fullsized":"2023-08-09T12:41:26.761037+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:41.857557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.780748+0000","last_change":"2023-08-09T12:41:25.720123+0000","last_active":"2023-08-09T12:41:26.780748+0000","last_peered":"2023-08-09T12:41:26.780748+0000","last_clean":"2023-08-09T12:41:26.780748+0000","last_became_active":"2023-08-09T12:41:25.719183+0000","last_became_peered":"2023-08-09T12:41:25.719183+0000","last_unstale":"2023-08-09T12:41:26.780748+0000","last_undegraded":"2023-08-09T12:41:26.780748+0000","last_fullsized":"2023-08-09T12:41:26.780748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:56.678204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758850+0000","last_change":"2023-08-09T12:41:26.758726+0000","last_active":"2023-08-09T12:41:26.758850+0000","last_peered":"2023-08-09T12:41:26.758850+0000","last_clean":"2023-08-09T12:41:26.758850+0000","last_became_active":"2023-08-09T12:41:26.757570+0000","last_became_peered":"2023-08-09T12:41:26.757570+0000","last_unstale":"2023-08-09T12:41:26.758850+0000","last_undegraded":"2023-08-09T12:41:26.758850+0000","last_fullsized":"2023-08-09T12:41:26.758850+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:02:45.834158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.716371+0000","last_change":"2023-08-09T12:41:25.716255+0000","last_active":"2023-08-09T12:41:25.716371+0000","last_peered":"2023-08-09T12:41:25.716371+0000","last_clean":"2023-08-09T12:41:25.716371+0000","last_became_active":"2023-08-09T12:41:25.714648+0000","last_became_peered":"2023-08-09T12:41:25.714648+0000","last_unstale":"2023-08-09T12:41:25.716371+0000","last_undegraded":"2023-08-09T12:41:25.716371+0000","last_fullsized":"2023-08-09T12:41:25.716371+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:26.550315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.707272+0000","last_change":"2023-08-09T12:41:25.707272+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.707272+0000","last_undegraded":"2023-08-09T12:41:25.707272+0000","last_fullsized":"2023-08-09T12:41:25.707272+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738127+0000","last_change":"2023-08-09T12:41:25.723688+0000","last_active":"2023-08-09T12:41:26.738127+0000","last_peered":"2023-08-09T12:41:26.738127+0000","last_clean":"2023-08-09T12:41:26.738127+0000","last_became_active":"2023-08-09T12:41:25.723451+0000","last_became_peered":"2023-08-09T12:41:25.723451+0000","last_unstale":"2023-08-09T12:41:26.738127+0000","last_undegraded":"2023-08-09T12:41:26.738127+0000","last_fullsized":"2023-08-09T12:41:26.738127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:32:35.893052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744105+0000","last_change":"2023-08-09T12:41:26.743468+0000","last_active":"2023-08-09T12:41:26.744105+0000","last_peered":"2023-08-09T12:41:26.744105+0000","last_clean":"2023-08-09T12:41:26.744105+0000","last_became_active":"2023-08-09T12:41:26.742242+0000","last_became_peered":"2023-08-09T12:41:26.742242+0000","last_unstale":"2023-08-09T12:41:26.744105+0000","last_undegraded":"2023-08-09T12:41:26.744105+0000","last_fullsized":"2023-08-09T12:41:26.744105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731611+0000","last_change":"2023-08-09T12:41:25.722103+0000","last_active":"2023-08-09T12:41:26.731611+0000","last_peered":"2023-08-09T12:41:26.731611+0000","last_clean":"2023-08-09T12:41:26.731611+0000","last_became_active":"2023-08-09T12:41:25.721815+0000","last_became_peered":"2023-08-09T12:41:25.721815+0000","last_unstale":"2023-08-09T12:41:26.731611+0000","last_undegraded":"2023-08-09T12:41:26.731611+0000","last_fullsized":"2023-08-09T12:41:26.731611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:54:46.850648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702253+0000","last_change":"2023-08-09T12:41:25.702253+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702253+0000","last_undegraded":"2023-08-09T12:41:25.702253+0000","last_fullsized":"2023-08-09T12:41:25.702253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.779665+0000","last_change":"2023-08-09T12:41:25.719684+0000","last_active":"2023-08-09T12:41:26.779665+0000","last_peered":"2023-08-09T12:41:26.779665+0000","last_clean":"2023-08-09T12:41:26.779665+0000","last_became_active":"2023-08-09T12:41:25.719316+0000","last_became_peered":"2023-08-09T12:41:25.719316+0000","last_unstale":"2023-08-09T12:41:26.779665+0000","last_undegraded":"2023-08-09T12:41:26.779665+0000","last_fullsized":"2023-08-09T12:41:26.779665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:48:02.235976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758788+0000","last_change":"2023-08-09T12:41:26.758613+0000","last_active":"2023-08-09T12:41:26.758788+0000","last_peered":"2023-08-09T12:41:26.758788+0000","last_clean":"2023-08-09T12:41:26.758788+0000","last_became_active":"2023-08-09T12:41:26.758211+0000","last_became_peered":"2023-08-09T12:41:26.758211+0000","last_unstale":"2023-08-09T12:41:26.758788+0000","last_undegraded":"2023-08-09T12:41:26.758788+0000","last_fullsized":"2023-08-09T12:41:26.758788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:09.252796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.721874+0000","last_change":"2023-08-09T12:41:25.721784+0000","last_active":"2023-08-09T12:41:25.721874+0000","last_peered":"2023-08-09T12:41:25.721874+0000","last_clean":"2023-08-09T12:41:25.721874+0000","last_became_active":"2023-08-09T12:41:25.721531+0000","last_became_peered":"2023-08-09T12:41:25.721531+0000","last_unstale":"2023-08-09T12:41:25.721874+0000","last_undegraded":"2023-08-09T12:41:25.721874+0000","last_fullsized":"2023-08-09T12:41:25.721874+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:52.643529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696206+0000","last_change":"2023-08-09T12:41:25.696206+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696206+0000","last_undegraded":"2023-08-09T12:41:25.696206+0000","last_fullsized":"2023-08-09T12:41:25.696206+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.777344+0000","last_change":"2023-08-09T12:41:25.709300+0000","last_active":"2023-08-09T12:41:26.777344+0000","last_peered":"2023-08-09T12:41:26.777344+0000","last_clean":"2023-08-09T12:41:26.777344+0000","last_became_active":"2023-08-09T12:41:25.708777+0000","last_became_peered":"2023-08-09T12:41:25.708777+0000","last_unstale":"2023-08-09T12:41:26.777344+0000","last_undegraded":"2023-08-09T12:41:26.777344+0000","last_fullsized":"2023-08-09T12:41:26.777344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:47.305579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758125+0000","last_change":"2023-08-09T12:41:26.757742+0000","last_active":"2023-08-09T12:41:26.758125+0000","last_peered":"2023-08-09T12:41:26.758125+0000","last_clean":"2023-08-09T12:41:26.758125+0000","last_became_active":"2023-08-09T12:41:26.757342+0000","last_became_peered":"2023-08-09T12:41:26.757342+0000","last_unstale":"2023-08-09T12:41:26.758125+0000","last_undegraded":"2023-08-09T12:41:26.758125+0000","last_fullsized":"2023-08-09T12:41:26.758125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:38.646768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776113+0000","last_change":"2023-08-09T12:41:25.719868+0000","last_active":"2023-08-09T12:41:26.776113+0000","last_peered":"2023-08-09T12:41:26.776113+0000","last_clean":"2023-08-09T12:41:26.776113+0000","last_became_active":"2023-08-09T12:41:25.719554+0000","last_became_peered":"2023-08-09T12:41:25.719554+0000","last_unstale":"2023-08-09T12:41:26.776113+0000","last_undegraded":"2023-08-09T12:41:26.776113+0000","last_fullsized":"2023-08-09T12:41:26.776113+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:38:39.040223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696110+0000","last_change":"2023-08-09T12:41:25.696110+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696110+0000","last_undegraded":"2023-08-09T12:41:25.696110+0000","last_fullsized":"2023-08-09T12:41:25.696110+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.738629+0000","last_change":"2023-08-09T12:41:25.723181+0000","last_active":"2023-08-09T12:41:26.738629+0000","last_peered":"2023-08-09T12:41:26.738629+0000","last_clean":"2023-08-09T12:41:26.738629+0000","last_became_active":"2023-08-09T12:41:25.722598+0000","last_became_peered":"2023-08-09T12:41:25.722598+0000","last_unstale":"2023-08-09T12:41:26.738629+0000","last_undegraded":"2023-08-09T12:41:26.738629+0000","last_fullsized":"2023-08-09T12:41:26.738629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:38.626616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754788+0000","last_change":"2023-08-09T12:41:26.753949+0000","last_active":"2023-08-09T12:41:26.754788+0000","last_peered":"2023-08-09T12:41:26.754788+0000","last_clean":"2023-08-09T12:41:26.754788+0000","last_became_active":"2023-08-09T12:41:26.753622+0000","last_became_peered":"2023-08-09T12:41:26.753622+0000","last_unstale":"2023-08-09T12:41:26.754788+0000","last_undegraded":"2023-08-09T12:41:26.754788+0000","last_fullsized":"2023-08-09T12:41:26.754788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:46.872566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.709228+0000","last_change":"2023-08-09T12:41:25.708766+0000","last_active":"2023-08-09T12:41:25.709228+0000","last_peered":"2023-08-09T12:41:25.709228+0000","last_clean":"2023-08-09T12:41:25.709228+0000","last_became_active":"2023-08-09T12:41:25.707255+0000","last_became_peered":"2023-08-09T12:41:25.707255+0000","last_unstale":"2023-08-09T12:41:25.709228+0000","last_undegraded":"2023-08-09T12:41:25.709228+0000","last_fullsized":"2023-08-09T12:41:25.709228+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:08:12.653133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.753241+0000","last_change":"2023-08-09T12:41:26.752241+0000","last_active":"2023-08-09T12:41:26.753241+0000","last_peered":"2023-08-09T12:41:26.753241+0000","last_clean":"2023-08-09T12:41:26.753241+0000","last_became_active":"2023-08-09T12:41:26.751882+0000","last_became_peered":"2023-08-09T12:41:26.751882+0000","last_unstale":"2023-08-09T12:41:26.753241+0000","last_undegraded":"2023-08-09T12:41:26.753241+0000","last_fullsized":"2023-08-09T12:41:26.753241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:59.216428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740913+0000","last_change":"2023-08-09T12:41:25.719956+0000","last_active":"2023-08-09T12:41:26.740913+0000","last_peered":"2023-08-09T12:41:26.740913+0000","last_clean":"2023-08-09T12:41:26.740913+0000","last_became_active":"2023-08-09T12:41:25.718827+0000","last_became_peered":"2023-08-09T12:41:25.718827+0000","last_unstale":"2023-08-09T12:41:26.740913+0000","last_undegraded":"2023-08-09T12:41:26.740913+0000","last_fullsized":"2023-08-09T12:41:26.740913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:54.138658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699913+0000","last_change":"2023-08-09T12:41:25.699913+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699913+0000","last_undegraded":"2023-08-09T12:41:25.699913+0000","last_fullsized":"2023-08-09T12:41:25.699913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.721313+0000","last_change":"2023-08-09T12:41:25.716973+0000","last_active":"2023-08-09T12:41:25.721313+0000","last_peered":"2023-08-09T12:41:25.721313+0000","last_clean":"2023-08-09T12:41:25.721313+0000","last_became_active":"2023-08-09T12:41:25.715880+0000","last_became_peered":"2023-08-09T12:41:25.715880+0000","last_unstale":"2023-08-09T12:41:25.721313+0000","last_undegraded":"2023-08-09T12:41:25.721313+0000","last_fullsized":"2023-08-09T12:41:25.721313+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:09:16.682395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.704075+0000","last_change":"2023-08-09T12:41:25.704075+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.704075+0000","last_undegraded":"2023-08-09T12:41:25.704075+0000","last_fullsized":"2023-08-09T12:41:25.704075+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740848+0000","last_change":"2023-08-09T12:41:25.709666+0000","last_active":"2023-08-09T12:41:26.740848+0000","last_peered":"2023-08-09T12:41:26.740848+0000","last_clean":"2023-08-09T12:41:26.740848+0000","last_became_active":"2023-08-09T12:41:25.708958+0000","last_became_peered":"2023-08-09T12:41:25.708958+0000","last_unstale":"2023-08-09T12:41:26.740848+0000","last_undegraded":"2023-08-09T12:41:26.740848+0000","last_fullsized":"2023-08-09T12:41:26.740848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:11:27.015801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.755138+0000","last_change":"2023-08-09T12:41:26.753676+0000","last_active":"2023-08-09T12:41:26.755138+0000","last_peered":"2023-08-09T12:41:26.755138+0000","last_clean":"2023-08-09T12:41:26.755138+0000","last_became_active":"2023-08-09T12:41:26.752998+0000","last_became_peered":"2023-08-09T12:41:26.752998+0000","last_unstale":"2023-08-09T12:41:26.755138+0000","last_undegraded":"2023-08-09T12:41:26.755138+0000","last_fullsized":"2023-08-09T12:41:26.755138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:54:39.014147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.717010+0000","last_change":"2023-08-09T12:41:25.716719+0000","last_active":"2023-08-09T12:41:25.717010+0000","last_peered":"2023-08-09T12:41:25.717010+0000","last_clean":"2023-08-09T12:41:25.717010+0000","last_became_active":"2023-08-09T12:41:25.715489+0000","last_became_peered":"2023-08-09T12:41:25.715489+0000","last_unstale":"2023-08-09T12:41:25.717010+0000","last_undegraded":"2023-08-09T12:41:25.717010+0000","last_fullsized":"2023-08-09T12:41:25.717010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:12.934546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":224,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.732256+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:41:26.732256+0000","last_peered":"2023-08-09T12:41:26.732256+0000","last_clean":"2023-08-09T12:41:26.732256+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:41:26.732256+0000","last_undegraded":"2023-08-09T12:41:26.732256+0000","last_fullsized":"2023-08-09T12:41:26.732256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:01:34.343333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.751118+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:41:26.751118+0000","last_peered":"2023-08-09T12:41:26.751118+0000","last_clean":"2023-08-09T12:41:26.751118+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:41:26.751118+0000","last_undegraded":"2023-08-09T12:41:26.751118+0000","last_fullsized":"2023-08-09T12:41:26.751118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:14:32.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.696149+0000","last_change":"2023-08-09T12:41:25.696149+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.696149+0000","last_undegraded":"2023-08-09T12:41:25.696149+0000","last_fullsized":"2023-08-09T12:41:25.696149+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731668+0000","last_change":"2023-08-09T12:41:25.713983+0000","last_active":"2023-08-09T12:41:26.731668+0000","last_peered":"2023-08-09T12:41:26.731668+0000","last_clean":"2023-08-09T12:41:26.731668+0000","last_became_active":"2023-08-09T12:41:25.713370+0000","last_became_peered":"2023-08-09T12:41:25.713370+0000","last_unstale":"2023-08-09T12:41:26.731668+0000","last_undegraded":"2023-08-09T12:41:26.731668+0000","last_fullsized":"2023-08-09T12:41:26.731668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:55:29.675233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731892+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:41:26.731892+0000","last_peered":"2023-08-09T12:41:26.731892+0000","last_clean":"2023-08-09T12:41:26.731892+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:41:26.731892+0000","last_undegraded":"2023-08-09T12:41:26.731892+0000","last_fullsized":"2023-08-09T12:41:26.731892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:46.369931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.754637+0000","last_change":"2023-08-09T12:41:26.754103+0000","last_active":"2023-08-09T12:41:26.754637+0000","last_peered":"2023-08-09T12:41:26.754637+0000","last_clean":"2023-08-09T12:41:26.754637+0000","last_became_active":"2023-08-09T12:41:26.753433+0000","last_became_peered":"2023-08-09T12:41:26.753433+0000","last_unstale":"2023-08-09T12:41:26.754637+0000","last_undegraded":"2023-08-09T12:41:26.754637+0000","last_fullsized":"2023-08-09T12:41:26.754637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:38.646768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.716611+0000","last_change":"2023-08-09T12:41:25.716511+0000","last_active":"2023-08-09T12:41:25.716611+0000","last_peered":"2023-08-09T12:41:25.716611+0000","last_clean":"2023-08-09T12:41:25.716611+0000","last_became_active":"2023-08-09T12:41:25.715140+0000","last_became_peered":"2023-08-09T12:41:25.715140+0000","last_unstale":"2023-08-09T12:41:25.716611+0000","last_undegraded":"2023-08-09T12:41:25.716611+0000","last_fullsized":"2023-08-09T12:41:25.716611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.253017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.740410+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:41:26.740410+0000","last_peered":"2023-08-09T12:41:26.740410+0000","last_clean":"2023-08-09T12:41:26.740410+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:41:26.740410+0000","last_undegraded":"2023-08-09T12:41:26.740410+0000","last_fullsized":"2023-08-09T12:41:26.740410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:26:07.633953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.761560+0000","last_change":"2023-08-09T12:41:26.761325+0000","last_active":"2023-08-09T12:41:26.761560+0000","last_peered":"2023-08-09T12:41:26.761560+0000","last_clean":"2023-08-09T12:41:26.761560+0000","last_became_active":"2023-08-09T12:41:26.760426+0000","last_became_peered":"2023-08-09T12:41:26.760426+0000","last_unstale":"2023-08-09T12:41:26.761560+0000","last_undegraded":"2023-08-09T12:41:26.761560+0000","last_fullsized":"2023-08-09T12:41:26.761560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:51.292745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.776050+0000","last_change":"2023-08-09T12:41:25.723888+0000","last_active":"2023-08-09T12:41:26.776050+0000","last_peered":"2023-08-09T12:41:26.776050+0000","last_clean":"2023-08-09T12:41:26.776050+0000","last_became_active":"2023-08-09T12:41:25.723572+0000","last_became_peered":"2023-08-09T12:41:25.723572+0000","last_unstale":"2023-08-09T12:41:26.776050+0000","last_undegraded":"2023-08-09T12:41:26.776050+0000","last_fullsized":"2023-08-09T12:41:26.776050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:36.973105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.750783+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:41:26.750783+0000","last_peered":"2023-08-09T12:41:26.750783+0000","last_clean":"2023-08-09T12:41:26.750783+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:41:26.750783+0000","last_undegraded":"2023-08-09T12:41:26.750783+0000","last_fullsized":"2023-08-09T12:41:26.750783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:14:55.321046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.699507+0000","last_change":"2023-08-09T12:41:25.699507+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.699507+0000","last_undegraded":"2023-08-09T12:41:25.699507+0000","last_fullsized":"2023-08-09T12:41:25.699507+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.744593+0000","last_change":"2023-08-09T12:41:25.714321+0000","last_active":"2023-08-09T12:41:26.744593+0000","last_peered":"2023-08-09T12:41:26.744593+0000","last_clean":"2023-08-09T12:41:26.744593+0000","last_became_active":"2023-08-09T12:41:25.713760+0000","last_became_peered":"2023-08-09T12:41:25.713760+0000","last_unstale":"2023-08-09T12:41:26.744593+0000","last_undegraded":"2023-08-09T12:41:26.744593+0000","last_fullsized":"2023-08-09T12:41:26.744593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:33.785779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.695353+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:41:25.695353+0000","last_peered":"2023-08-09T12:41:25.695353+0000","last_clean":"2023-08-09T12:41:25.695353+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:41:25.695353+0000","last_undegraded":"2023-08-09T12:41:25.695353+0000","last_fullsized":"2023-08-09T12:41:25.695353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:30:16.096590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.746290+0000","last_change":"2023-08-09T12:41:26.745215+0000","last_active":"2023-08-09T12:41:26.746290+0000","last_peered":"2023-08-09T12:41:26.746290+0000","last_clean":"2023-08-09T12:41:26.746290+0000","last_became_active":"2023-08-09T12:41:26.744468+0000","last_became_peered":"2023-08-09T12:41:26.744468+0000","last_unstale":"2023-08-09T12:41:26.746290+0000","last_undegraded":"2023-08-09T12:41:26.746290+0000","last_fullsized":"2023-08-09T12:41:26.746290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.745677+0000","last_change":"2023-08-09T12:41:25.708106+0000","last_active":"2023-08-09T12:41:26.745677+0000","last_peered":"2023-08-09T12:41:26.745677+0000","last_clean":"2023-08-09T12:41:26.745677+0000","last_became_active":"2023-08-09T12:41:25.707382+0000","last_became_peered":"2023-08-09T12:41:25.707382+0000","last_unstale":"2023-08-09T12:41:26.745677+0000","last_undegraded":"2023-08-09T12:41:26.745677+0000","last_fullsized":"2023-08-09T12:41:26.745677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:39:40.360527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.731288+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:41:26.731288+0000","last_peered":"2023-08-09T12:41:26.731288+0000","last_clean":"2023-08-09T12:41:26.731288+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:41:26.731288+0000","last_undegraded":"2023-08-09T12:41:26.731288+0000","last_fullsized":"2023-08-09T12:41:26.731288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:14:06.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-08-09T12:41:25.702093+0000","last_change":"2023-08-09T12:41:25.702093+0000","last_active":"2023-08-09T12:41:25.682645+0000","last_peered":"2023-08-09T12:41:25.682645+0000","last_clean":"2023-08-09T12:41:25.682645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:41:25.702093+0000","last_undegraded":"2023-08-09T12:41:25.702093+0000","last_fullsized":"2023-08-09T12:41:25.702093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.734384+0000","last_change":"2023-08-09T12:41:25.717417+0000","last_active":"2023-08-09T12:41:26.734384+0000","last_peered":"2023-08-09T12:41:26.734384+0000","last_clean":"2023-08-09T12:41:26.734384+0000","last_became_active":"2023-08-09T12:41:25.717148+0000","last_became_peered":"2023-08-09T12:41:25.717148+0000","last_unstale":"2023-08-09T12:41:26.734384+0000","last_undegraded":"2023-08-09T12:41:26.734384+0000","last_fullsized":"2023-08-09T12:41:26.734384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:03.256797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-09T12:41:25.695344+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:41:25.695344+0000","last_peered":"2023-08-09T12:41:25.695344+0000","last_clean":"2023-08-09T12:41:25.695344+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:41:25.695344+0000","last_undegraded":"2023-08-09T12:41:25.695344+0000","last_fullsized":"2023-08-09T12:41:25.695344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:00:41.973400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.758833+0000","last_change":"2023-08-09T12:41:26.758588+0000","last_active":"2023-08-09T12:41:26.758833+0000","last_peered":"2023-08-09T12:41:26.758833+0000","last_clean":"2023-08-09T12:41:26.758833+0000","last_became_active":"2023-08-09T12:41:26.757232+0000","last_became_peered":"2023-08-09T12:41:26.757232+0000","last_unstale":"2023-08-09T12:41:26.758833+0000","last_undegraded":"2023-08-09T12:41:26.758833+0000","last_fullsized":"2023-08-09T12:41:26.758833+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:56.335865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.736204+0000","last_change":"2023-08-09T12:41:25.717713+0000","last_active":"2023-08-09T12:41:26.736204+0000","last_peered":"2023-08-09T12:41:26.736204+0000","last_clean":"2023-08-09T12:41:26.736204+0000","last_became_active":"2023-08-09T12:41:25.717257+0000","last_became_peered":"2023-08-09T12:41:25.717257+0000","last_unstale":"2023-08-09T12:41:26.736204+0000","last_undegraded":"2023-08-09T12:41:26.736204+0000","last_fullsized":"2023-08-09T12:41:26.736204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:40.852877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-08-09T12:41:26.739235+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:41:26.739235+0000","last_peered":"2023-08-09T12:41:26.739235+0000","last_clean":"2023-08-09T12:41:26.739235+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:41:26.739235+0000","last_undegraded":"2023-08-09T12:41:26.739235+0000","last_fullsized":"2023-08-09T12:41:26.739235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:31.379260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":824,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194488,"statfs":{"total":200000000,"available":199155862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.095,"15min":1.093},"min":{"1min":0.70599999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.454,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.079,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.105,"15min":1.081},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8959999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.502},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0960000000000001,"15min":1.0820000000000001},"min":{"1min":0.747,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.079}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6259999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.153,"15min":1.131},"min":{"1min":0.92500000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.107}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2310000000000001,"15min":1.2150000000000001},"min":{"1min":0.93500000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.784,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.373},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2589999999999999,"15min":1.246},"min":{"1min":0.94699999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.696,"5min":1.96,"15min":1.96},"last":1.343}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.2250000000000001,"15min":1.1990000000000001},"min":{"1min":0.92300000000000004,"5min":0.505,"15min":0.505},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.2749999999999999,"15min":1.2470000000000001},"min":{"1min":0.876,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.145}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.284,"15min":1.2589999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.4910000000000001,"15min":1.4790000000000001},"min":{"1min":0.85999999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":3.1400000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.403}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.488,"15min":1.47},"min":{"1min":1.27,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.266,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":1.1160000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.093,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.5489999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":247,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195064,"statfs":{"total":200000000,"available":199746354,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.137,"15min":1.113},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.173,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.133}]},{"osd":1,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.228,"15min":1.222},"min":{"1min":0.88800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.0009999999999999,"5min":2.306,"15min":2.306},"last":1.181},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3220000000000001,"15min":1.3089999999999999},"min":{"1min":0.91400000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.5820000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.0960000000000001,"15min":1.083},"min":{"1min":0.83099999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.2729999999999999,"15min":1.2629999999999999},"min":{"1min":0.97699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.073}]},{"osd":3,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":1.0249999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2749999999999999,"15min":1.268},"min":{"1min":0.86199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.732,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.226}]},{"osd":4,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.296,"15min":1.282},"min":{"1min":0.88900000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.327,"15min":1.3169999999999999},"min":{"1min":0.99399999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4299999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.298,"15min":1.2989999999999999},"min":{"1min":0.96999999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.462,"15min":1.45},"min":{"1min":1.1899999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7160000000000002,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.274}]},{"osd":7,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.409,"15min":1.377},"min":{"1min":1.1180000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.401,"15min":1.385},"min":{"1min":1.083,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.6299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.111,"15min":1.1100000000000001},"min":{"1min":0.75600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4930000000000001,"5min":2.427,"15min":2.427},"last":1.157},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0509999999999999,"15min":1.0349999999999999},"min":{"1min":0.73499999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.0649999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.278,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.748,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.238,"15min":1.232},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6399999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.105}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1830000000000001,"15min":1.1930000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.446,"5min":1.591,"15min":1.591},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.175,"15min":1.1830000000000001},"min":{"1min":0.78400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.728,"15min":1.728},"last":1.3540000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.181,"15min":1.1699999999999999},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.26},{"interface":"front","average":{"1min":1.29,"5min":1.3620000000000001,"15min":1.3740000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.607,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.4690000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.621,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1619999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.357,"15min":1.371},"min":{"1min":0.71999999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.921,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.863,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.948,"15min":2.948},"last":1.599}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.524},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.097,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.405},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.974,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.298}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.69199999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.72,"5min":1.77,"15min":1.77},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.0860000000000001,"15min":1.075},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.589,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.298}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.3320000000000001,"15min":1.363},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.589,"5min":1.97,"15min":1.97},"last":1.347},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.3420000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.411}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3320000000000001,"15min":1.327},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.079},{"interface":"front","average":{"1min":1.353,"5min":1.3160000000000001,"15min":1.3100000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5620000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.163},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3320000000000001,"15min":1.3380000000000001},"min":{"1min":0.97299999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6990000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.401,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.847,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3680000000000001,"15min":1.3779999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7629999999999999,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.365}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.5009999999999999,"15min":1.52},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.8080000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.397},{"interface":"front","average":{"1min":1.49,"5min":1.5349999999999999,"15min":1.5429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.95,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.694}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.516,"15min":1.516},"min":{"1min":1.0169999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8839999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.48},{"interface":"front","average":{"1min":1.538,"5min":1.6299999999999999,"15min":1.645},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0089999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.5169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.85599999999999998,"15min":0.85199999999999998},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.90600000000000003}]},{"osd":1,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3759999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.875,"15min":0.85699999999999998},"min":{"1min":0.52000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.1160000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.5680000000000001,"5min":1.893,"15min":1.893},"last":0.996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.55400000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6499999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.94199999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.84399999999999997,"5min":0.745,"15min":0.745},"max":{"1min":1.883,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.212},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3160000000000001,"15min":1.3380000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.708,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.2889999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.355,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.6870000000000001,"5min":2.157,"15min":2.157},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2589999999999999,"15min":1.2490000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.331}]},{"osd":6,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3169999999999999,"15min":1.3220000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.7649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7729999999999999,"5min":2.589,"15min":2.589},"last":1.3620000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.369,"15min":1.3700000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.776,"5min":1.78,"15min":1.78},"last":1.5269999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":249,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195063,"statfs":{"total":200000000,"available":199744742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5329999999999999,"5min":1.716,"15min":1.716},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0349999999999999,"15min":1.054},"min":{"1min":0.61199999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.782,"5min":1.869,"15min":1.869},"last":0.50700000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.242,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.69199999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.403,"15min":1.4039999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.2869999999999999,"15min":1.2569999999999999},"min":{"1min":0.83199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.3660000000000001,"15min":1.3420000000000001},"min":{"1min":0.98199999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":5.0140000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.498,"15min":1.486},"min":{"1min":0.879,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":1.04}]},{"osd":6,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.298,"15min":1.288},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.0669999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.351,"15min":1.347},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5269999999999999,"15min":1.5249999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.25}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195071,"statfs":{"total":200000000,"available":199753482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.881},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85099999999999998,"15min":0.85399999999999998},"min":{"1min":0.48899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.232,"5min":1.24,"15min":1.24},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.679,"5min":1.774,"15min":1.774},"last":1.569}]},{"osd":3,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.046},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6559999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.008,"5min":0.90100000000000002,"15min":0.88300000000000001},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.238}]},{"osd":4,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2669999999999999,"15min":1.264},"min":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6799999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.4059999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2609999999999999,"15min":1.2629999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.02,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.2589999999999999,"15min":1.2450000000000001},"min":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.206}]},{"osd":6,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.373,"15min":1.373},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2210000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3520000000000001,"15min":1.341},"min":{"1min":0.999,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.839,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.631}]},{"osd":7,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.8049999999999999,"5min":2.294,"15min":2.294},"last":1.8140000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.413,"15min":1.413},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.1280000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.754}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2729999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.819},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.90100000000000002},"min":{"1min":0.57199999999999995,"5min":0.436,"15min":0.436},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.88700000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92800000000000005,"15min":0.92900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.373,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.59199999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.484,"5min":1.607,"15min":1.607},"last":1.6040000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86899999999999999,"15min":0.873},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.196,"5min":1.952,"15min":1.952},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.153,"15min":1.161},"min":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5860000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4650000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2829999999999999,"15min":1.302},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6080000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.147},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.6970000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.7110000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2509999999999999,"15min":1.2589999999999999},"min":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3540000000000001,"15min":1.3600000000000001},"min":{"1min":0.89100000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8100000000000001,"5min":2.161,"15min":2.161},"last":1.909}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3109999999999999,"15min":1.3},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.373,"15min":1.3819999999999999},"min":{"1min":0.90100000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.008,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.399}]},{"osd":7,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3680000000000001,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.3959999999999999,"15min":1.4059999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.7150000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4510000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:41:32.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-08-09T12:41:32.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.708068+0000', 'last_change': '2023-08-09T12:41:25.708068+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.708068+0000', 'last_undegraded': '2023-08-09T12:41:25.708068+0000', 'last_fullsized': '2023-08-09T12:41:25.708068+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-08-09T12:41:32.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.700690+0000', 'last_change': '2023-08-09T12:41:25.700690+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.700690+0000', 'last_undegraded': '2023-08-09T12:41:25.700690+0000', 'last_fullsized': '2023-08-09T12:41:25.700690+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-08-09T12:41:32.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.707203+0000', 'last_change': '2023-08-09T12:41:25.707203+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.707203+0000', 'last_undegraded': '2023-08-09T12:41:25.707203+0000', 'last_fullsized': '2023-08-09T12:41:25.707203+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-08-09T12:41:32.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.703555+0000', 'last_change': '2023-08-09T12:41:25.703555+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.703555+0000', 'last_undegraded': '2023-08-09T12:41:25.703555+0000', 'last_fullsized': '2023-08-09T12:41:25.703555+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-08-09T12:41:32.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.704905+0000', 'last_change': '2023-08-09T12:41:25.704905+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.704905+0000', 'last_undegraded': '2023-08-09T12:41:25.704905+0000', 'last_fullsized': '2023-08-09T12:41:25.704905+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-08-09T12:41:32.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.706498+0000', 'last_change': '2023-08-09T12:41:25.706498+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.706498+0000', 'last_undegraded': '2023-08-09T12:41:25.706498+0000', 'last_fullsized': '2023-08-09T12:41:25.706498+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-08-09T12:41:32.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.701414+0000', 'last_change': '2023-08-09T12:41:25.701414+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.701414+0000', 'last_undegraded': '2023-08-09T12:41:25.701414+0000', 'last_fullsized': '2023-08-09T12:41:25.701414+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-08-09T12:41:32.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.706144+0000', 'last_change': '2023-08-09T12:41:25.706144+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.706144+0000', 'last_undegraded': '2023-08-09T12:41:25.706144+0000', 'last_fullsized': '2023-08-09T12:41:25.706144+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-08-09T12:41:32.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.700012+0000', 'last_change': '2023-08-09T12:41:25.700012+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.700012+0000', 'last_undegraded': '2023-08-09T12:41:25.700012+0000', 'last_fullsized': '2023-08-09T12:41:25.700012+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-08-09T12:41:32.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.702258+0000', 'last_change': '2023-08-09T12:41:25.702258+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.702258+0000', 'last_undegraded': '2023-08-09T12:41:25.702258+0000', 'last_fullsized': '2023-08-09T12:41:25.702258+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-08-09T12:41:32.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.700584+0000', 'last_change': '2023-08-09T12:41:25.700584+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.700584+0000', 'last_undegraded': '2023-08-09T12:41:25.700584+0000', 'last_fullsized': '2023-08-09T12:41:25.700584+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-08-09T12:41:32.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.708070+0000', 'last_change': '2023-08-09T12:41:25.708070+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.708070+0000', 'last_undegraded': '2023-08-09T12:41:25.708070+0000', 'last_fullsized': '2023-08-09T12:41:25.708070+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-08-09T12:41:32.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.705108+0000', 'last_change': '2023-08-09T12:41:25.705108+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.705108+0000', 'last_undegraded': '2023-08-09T12:41:25.705108+0000', 'last_fullsized': '2023-08-09T12:41:25.705108+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-08-09T12:41:32.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.699671+0000', 'last_change': '2023-08-09T12:41:25.699671+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.699671+0000', 'last_undegraded': '2023-08-09T12:41:25.699671+0000', 'last_fullsized': '2023-08-09T12:41:25.699671+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-08-09T12:41:32.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.699396+0000', 'last_change': '2023-08-09T12:41:25.699396+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.699396+0000', 'last_undegraded': '2023-08-09T12:41:25.699396+0000', 'last_fullsized': '2023-08-09T12:41:25.699396+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-08-09T12:41:32.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.701483+0000', 'last_change': '2023-08-09T12:41:25.701483+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.701483+0000', 'last_undegraded': '2023-08-09T12:41:25.701483+0000', 'last_fullsized': '2023-08-09T12:41:25.701483+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-08-09T12:41:32.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.707272+0000', 'last_change': '2023-08-09T12:41:25.707272+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.707272+0000', 'last_undegraded': '2023-08-09T12:41:25.707272+0000', 'last_fullsized': '2023-08-09T12:41:25.707272+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-08-09T12:41:32.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.702253+0000', 'last_change': '2023-08-09T12:41:25.702253+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.702253+0000', 'last_undegraded': '2023-08-09T12:41:25.702253+0000', 'last_fullsized': '2023-08-09T12:41:25.702253+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-08-09T12:41:32.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.696206+0000', 'last_change': '2023-08-09T12:41:25.696206+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.696206+0000', 'last_undegraded': '2023-08-09T12:41:25.696206+0000', 'last_fullsized': '2023-08-09T12:41:25.696206+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-08-09T12:41:32.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.696110+0000', 'last_change': '2023-08-09T12:41:25.696110+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.696110+0000', 'last_undegraded': '2023-08-09T12:41:25.696110+0000', 'last_fullsized': '2023-08-09T12:41:25.696110+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-08-09T12:41:32.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.699913+0000', 'last_change': '2023-08-09T12:41:25.699913+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.699913+0000', 'last_undegraded': '2023-08-09T12:41:25.699913+0000', 'last_fullsized': '2023-08-09T12:41:25.699913+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-08-09T12:41:32.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.704075+0000', 'last_change': '2023-08-09T12:41:25.704075+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.704075+0000', 'last_undegraded': '2023-08-09T12:41:25.704075+0000', 'last_fullsized': '2023-08-09T12:41:25.704075+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-08-09T12:41:32.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.696149+0000', 'last_change': '2023-08-09T12:41:25.696149+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.696149+0000', 'last_undegraded': '2023-08-09T12:41:25.696149+0000', 'last_fullsized': '2023-08-09T12:41:25.696149+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:41:32.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-08-09T12:41:32.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.699507+0000', 'last_change': '2023-08-09T12:41:25.699507+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.699507+0000', 'last_undegraded': '2023-08-09T12:41:25.699507+0000', 'last_fullsized': '2023-08-09T12:41:25.699507+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-08-09T12:41:32.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:41:25.702093+0000', 'last_change': '2023-08-09T12:41:25.702093+0000', 'last_active': '2023-08-09T12:41:25.682645+0000', 'last_peered': '2023-08-09T12:41:25.682645+0000', 'last_clean': '2023-08-09T12:41:25.682645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:41:25.702093+0000', 'last_undegraded': '2023-08-09T12:41:25.702093+0000', 'last_fullsized': '2023-08-09T12:41:25.702093+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'last_clean_scrub_stamp': '2023-08-09T12:41:25.682645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:41:32.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-09T12:41:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.602+0000 7fd2bf399640 1 Processor -- start 2023-08-09T12:41:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.602+0000 7fd2bf399640 1 -- start start 2023-08-09T12:41:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.604+0000 7fd2bf399640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.604+0000 7fd2bf399640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2b80cab50 0x7fd2b80b0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.604+0000 7fd2bf399640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b80cb010 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.604+0000 7fd2bf399640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b81617a0 con 0x7fd2b80cab50 2023-08-09T12:41:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.604+0000 7fd2bf399640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8160620 con 0x7fd2b8160240 2023-08-09T12:41:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.604+0000 7fd2bc934640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2b80cab50 0x7fd2b80b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.604+0000 7fd2bc934640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2b80cab50 0x7fd2b80b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52030/0 (socket says 172.21.15.17:52030) 2023-08-09T12:41:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.604+0000 7fd2bc934640 1 -- 172.21.15.17:0/2103034067 learned_addr learned my addr 172.21.15.17:0/2103034067 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.605+0000 7fd2bd135640 1 --2- 172.21.15.17:0/2103034067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.605+0000 7fd2bc934640 1 -- 172.21.15.17:0/2103034067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 msgr2=0x7fd2b80b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.605+0000 7fd2bc934640 1 --2- 172.21.15.17:0/2103034067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.605+0000 7fd2bc934640 1 -- 172.21.15.17:0/2103034067 >> v1:172.21.15.142:6789/0 conn(0x7fd2b80cd0e0 legacy=0x7fd2b80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.605+0000 7fd2bc934640 1 -- 172.21.15.17:0/2103034067 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b81609e0 con 0x7fd2b80cab50 2023-08-09T12:41:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.605+0000 7fd2bd135640 1 --2- 172.21.15.17:0/2103034067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.606+0000 7fd2bc934640 1 --2- 172.21.15.17:0/2103034067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cab50 0x7fd2b80b0790 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009870 tx=0x7fd2a802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a041eb448e74c0e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.606+0000 7fd2affff640 1 -- 172.21.15.17:0/2103034067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8033620 con 0x7fd2b80cab50 2023-08-09T12:41:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.606+0000 7fd2affff640 1 -- 172.21.15.17:0/2103034067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8033780 con 0x7fd2b80cab50 2023-08-09T12:41:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2affff640 1 -- 172.21.15.17:0/2103034067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8033b10 con 0x7fd2b80cab50 2023-08-09T12:41:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2bf399640 1 -- 172.21.15.17:0/2103034067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cab50 msgr2=0x7fd2b80b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2103034067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cab50 0x7fd2b80b0790 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009870 tx=0x7fd2a802b7d0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2bf399640 1 -- 172.21.15.17:0/2103034067 shutdown_connections 2023-08-09T12:41:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2103034067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cab50 0x7fd2b80b0790 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2103034067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2bf399640 1 -- 172.21.15.17:0/2103034067 >> 172.21.15.17:0/2103034067 conn(0x7fd2b80cb250 msgr2=0x7fd2b80cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2bf399640 1 -- 172.21.15.17:0/2103034067 shutdown_connections 2023-08-09T12:41:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.607+0000 7fd2bf399640 1 -- 172.21.15.17:0/2103034067 wait complete. 2023-08-09T12:41:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.609+0000 7fd2bf399640 1 Processor -- start 2023-08-09T12:41:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.609+0000 7fd2bf399640 1 -- start start 2023-08-09T12:41:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bf399640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b80cab50 0x7fd2b806ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bf399640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cd0e0 0x7fd2b81f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bf399640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bf399640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b80b2330 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bf399640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b81f2420 con 0x7fd2b80cab50 2023-08-09T12:41:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bf399640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b806b2e0 con 0x7fd2b8160240 2023-08-09T12:41:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bc934640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cd0e0 0x7fd2b81f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bc934640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cd0e0 0x7fd2b81f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52044/0 (socket says 172.21.15.17:52044) 2023-08-09T12:41:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.610+0000 7fd2bc934640 1 -- 172.21.15.17:0/2634131089 learned_addr learned my addr 172.21.15.17:0/2634131089 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.611+0000 7fd2bc934640 1 -- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 msgr2=0x7fd2b80c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.611+0000 7fd2bd936640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.611+0000 7fd2bc934640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.611+0000 7fd2bc934640 1 -- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b80cab50 msgr2=0x7fd2b806ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.611+0000 7fd2bc934640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b80cab50 0x7fd2b806ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.611+0000 7fd2bc934640 1 -- 172.21.15.17:0/2634131089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80094d0 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.611+0000 7fd2bc934640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cd0e0 0x7fd2b81f1ee0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009870 tx=0x7fd2a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.612+0000 7fd2adffb640 1 -- 172.21.15.17:0/2634131089 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8032c00 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.612+0000 7fd2adffb640 1 -- 172.21.15.17:0/2634131089 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8032d80 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.612+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b806b5c0 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.612+0000 7fd2adffb640 1 -- 172.21.15.17:0/2634131089 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a803c640 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.612+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b806bb80 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.613+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b8160f80 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.614+0000 7fd2adffb640 1 -- 172.21.15.17:0/2634131089 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd2a803a040 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.615+0000 7fd2adffb640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd29c06a050 0x7fd29c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.615+0000 7fd2adffb640 1 -- 172.21.15.17:0/2634131089 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2a80a9fe0 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.615+0000 7fd2bd135640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd29c06a050 0x7fd29c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.616+0000 7fd2bd135640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd29c06a050 0x7fd29c06c510 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4008e00 tx=0x7fd2b4008330 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.619+0000 7fd2adffb640 1 -- 172.21.15.17:0/2634131089 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd2b8160f80 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.894+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd2b8160f80 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.895+0000 7fd2adffb640 1 -- 172.21.15.17:0/2634131089 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1427 (secure 0 0 0) 0x7fd2a80385b0 con 0x7fd2b80cd0e0 2023-08-09T12:41:32.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:32.899 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1691584751,"num_in_osds":8,"osd_in_since":1691584748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592778,"bytes_used":3267948,"bytes_avail":1596732052,"bytes_total":1600000000,"write_bytes_sec":2051,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":4936}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-09T12:41:10.673390+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-09T12:41:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd29c06a050 msgr2=0x7fd29c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd29c06a050 0x7fd29c06c510 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4008e00 tx=0x7fd2b4008330 comp rx=0 tx=0).stop 2023-08-09T12:41:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cd0e0 msgr2=0x7fd2b81f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cd0e0 0x7fd2b81f1ee0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009870 tx=0x7fd2a80046c0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 shutdown_connections 2023-08-09T12:41:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd29c06a050 0x7fd29c06c510 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b8160240 0x7fd2b80c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b80cd0e0 0x7fd2b81f1ee0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 --2- 172.21.15.17:0/2634131089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b80cab50 0x7fd2b806ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 >> 172.21.15.17:0/2634131089 conn(0x7fd2b80cb250 msgr2=0x7fd2b80b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 shutdown_connections 2023-08-09T12:41:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:32.898+0000 7fd2bf399640 1 -- 172.21.15.17:0/2634131089 wait complete. 2023-08-09T12:41:32.922 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-09T12:41:32.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:41:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.146+0000 7ff379171640 1 Processor -- start 2023-08-09T12:41:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.146+0000 7ff379171640 1 -- start start 2023-08-09T12:41:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.148+0000 7ff379171640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff3740cfce0 0x7ff3740afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.148+0000 7ff379171640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff374071700 0x7ff3741608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.148+0000 7ff379171640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff374071270 con 0x7ff3740cdf60 2023-08-09T12:41:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.148+0000 7ff379171640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37406b7d0 con 0x7ff3740cfce0 2023-08-09T12:41:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.148+0000 7ff379171640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740b2f70 con 0x7ff374071700 2023-08-09T12:41:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.148+0000 7ff372d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff3740cfce0 0x7ff3740afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.148+0000 7ff37259c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff3740cdf60 0x7ff3740d00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55296/0 (socket says 172.21.15.17:55296) 2023-08-09T12:41:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.148+0000 7ff37259c640 1 -- 172.21.15.17:0/1856042820 learned_addr learned my addr 172.21.15.17:0/1856042820 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.149+0000 7ff37359e640 1 --2- 172.21.15.17:0/1856042820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff374071700 0x7ff3741608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.149+0000 7ff372d9d640 1 -- 172.21.15.17:0/1856042820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff374071700 msgr2=0x7ff3741608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.149+0000 7ff372d9d640 1 --2- 172.21.15.17:0/1856042820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff374071700 0x7ff3741608b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.149+0000 7ff372d9d640 1 -- 172.21.15.17:0/1856042820 >> v1:172.21.15.17:6789/0 conn(0x7ff3740cdf60 legacy=0x7ff3740d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.149+0000 7ff372d9d640 1 -- 172.21.15.17:0/1856042820 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37406b210 con 0x7ff3740cfce0 2023-08-09T12:41:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.149+0000 7ff371d9b640 1 -- 172.21.15.17:0/1856042820 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382847938 0 0) 0x7ff374071270 con 0x7ff3740cdf60 2023-08-09T12:41:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.150+0000 7ff372d9d640 1 --2- 172.21.15.17:0/1856042820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3740afdb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff364009d90 tx=0x7ff36402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3febe0fe2e5209ef server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.150+0000 7ff371d9b640 1 -- 172.21.15.17:0/1856042820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36402cc60 con 0x7ff3740cfce0 2023-08-09T12:41:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff371d9b640 1 -- 172.21.15.17:0/1856042820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36402cdc0 con 0x7ff3740cfce0 2023-08-09T12:41:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff371d9b640 1 -- 172.21.15.17:0/1856042820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364034660 con 0x7ff3740cfce0 2023-08-09T12:41:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff379171640 1 -- 172.21.15.17:0/1856042820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 msgr2=0x7ff3740afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff379171640 1 --2- 172.21.15.17:0/1856042820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3740afdb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff364009d90 tx=0x7ff36402beb0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff379171640 1 -- 172.21.15.17:0/1856042820 shutdown_connections 2023-08-09T12:41:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff379171640 1 --2- 172.21.15.17:0/1856042820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff374071700 0x7ff3741608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff379171640 1 --2- 172.21.15.17:0/1856042820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3740afdb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff379171640 1 -- 172.21.15.17:0/1856042820 >> 172.21.15.17:0/1856042820 conn(0x7ff3740cd440 msgr2=0x7ff3740cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff379171640 1 -- 172.21.15.17:0/1856042820 shutdown_connections 2023-08-09T12:41:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.151+0000 7ff379171640 1 -- 172.21.15.17:0/1856042820 wait complete. 2023-08-09T12:41:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.153+0000 7ff379171640 1 Processor -- start 2023-08-09T12:41:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.153+0000 7ff379171640 1 -- start start 2023-08-09T12:41:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.154+0000 7ff379171640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff374071700 0x7ff37414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.154+0000 7ff379171640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3740cdf60 0x7ff3741e29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.154+0000 7ff379171640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3741f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.154+0000 7ff379171640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741f3410 con 0x7ff3740cfce0 2023-08-09T12:41:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.154+0000 7ff379171640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741f36f0 con 0x7ff374071700 2023-08-09T12:41:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.154+0000 7ff379171640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741e21c0 con 0x7ff3740cdf60 2023-08-09T12:41:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3741f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3741f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52060/0 (socket says 172.21.15.17:52060) 2023-08-09T12:41:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37359e640 1 -- 172.21.15.17:0/3607339233 learned_addr learned my addr 172.21.15.17:0/3607339233 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff372d9d640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff374071700 0x7ff37414dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37259c640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3740cdf60 0x7ff3741e29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37359e640 1 -- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3740cdf60 msgr2=0x7ff3741e29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37359e640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3740cdf60 0x7ff3741e29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37359e640 1 -- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff374071700 msgr2=0x7ff37414dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37359e640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff374071700 0x7ff37414dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37359e640 1 -- 172.21.15.17:0/3607339233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364009a70 con 0x7ff3740cfce0 2023-08-09T12:41:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.155+0000 7ff37259c640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3740cdf60 0x7ff3741e29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.156+0000 7ff37359e640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3741f2910 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00c7f0 tx=0x7ff36c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.156+0000 7ff35b7fe640 1 -- 172.21.15.17:0/3607339233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c004220 con 0x7ff3740cfce0 2023-08-09T12:41:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.156+0000 7ff35b7fe640 1 -- 172.21.15.17:0/3607339233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c004380 con 0x7ff3740cfce0 2023-08-09T12:41:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.156+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3741e24a0 con 0x7ff3740cfce0 2023-08-09T12:41:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.156+0000 7ff35b7fe640 1 -- 172.21.15.17:0/3607339233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c007860 con 0x7ff3740cfce0 2023-08-09T12:41:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.156+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3741e2f00 con 0x7ff3740cfce0 2023-08-09T12:41:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.157+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3741e26e0 con 0x7ff3740cfce0 2023-08-09T12:41:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.158+0000 7ff35b7fe640 1 -- 172.21.15.17:0/3607339233 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff36c007bd0 con 0x7ff3740cfce0 2023-08-09T12:41:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.159+0000 7ff35b7fe640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff36006a050 0x7ff36006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.159+0000 7ff35b7fe640 1 -- 172.21.15.17:0/3607339233 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff36c0884c0 con 0x7ff3740cfce0 2023-08-09T12:41:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.160+0000 7ff372d9d640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff36006a050 0x7ff36006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.161+0000 7ff372d9d640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff36006a050 0x7ff36006c510 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff364036000 tx=0x7ff364030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.164+0000 7ff35b7fe640 1 -- 172.21.15.17:0/3607339233 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff3741e26e0 con 0x7ff3740cfce0 2023-08-09T12:41:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.350+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff374070f00 con 0x7ff36006a050 2023-08-09T12:41:33.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.374+0000 7ff35b7fe640 1 -- 172.21.15.17:0/3607339233 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302825 (secure 0 0 0) 0x7ff364034660 con 0x7ff36006a050 2023-08-09T12:41:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:41:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff36006a050 msgr2=0x7ff36006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff36006a050 0x7ff36006c510 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff364036000 tx=0x7ff364030000 comp rx=0 tx=0).stop 2023-08-09T12:41:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 msgr2=0x7ff3741f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3741f2910 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00c7f0 tx=0x7ff36c00ccb0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 shutdown_connections 2023-08-09T12:41:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff36006a050 0x7ff36006c510 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3740cfce0 0x7ff3741f2910 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3740cdf60 0x7ff3741e29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 --2- 172.21.15.17:0/3607339233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff374071700 0x7ff37414dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.381+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 >> 172.21.15.17:0/3607339233 conn(0x7ff3740cd440 msgr2=0x7ff3740c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.382+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 shutdown_connections 2023-08-09T12:41:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:33.382+0000 7ff379171640 1 -- 172.21.15.17:0/3607339233 wait complete. 2023-08-09T12:41:33.405 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-08-09T12:41:32.680618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559308,"statfs":{"total":1600000000,"available":1596732052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.987032"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.743985+0000","last_change":"2023-08-09T12:41:26.764950+0000","last_active":"2023-08-09T12:41:27.743985+0000","last_peered":"2023-08-09T12:41:27.743985+0000","last_clean":"2023-08-09T12:41:27.743985+0000","last_became_active":"2023-08-09T12:41:26.761904+0000","last_became_peered":"2023-08-09T12:41:26.761904+0000","last_unstale":"2023-08-09T12:41:27.743985+0000","last_undegraded":"2023-08-09T12:41:27.743985+0000","last_fullsized":"2023-08-09T12:41:27.743985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746558+0000","last_change":"2023-08-09T12:41:26.754678+0000","last_active":"2023-08-09T12:41:27.746558+0000","last_peered":"2023-08-09T12:41:27.746558+0000","last_clean":"2023-08-09T12:41:27.746558+0000","last_became_active":"2023-08-09T12:41:26.754276+0000","last_became_peered":"2023-08-09T12:41:26.754276+0000","last_unstale":"2023-08-09T12:41:27.746558+0000","last_undegraded":"2023-08-09T12:41:27.746558+0000","last_fullsized":"2023-08-09T12:41:27.746558+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:30.451415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745316+0000","last_change":"2023-08-09T12:41:26.771899+0000","last_active":"2023-08-09T12:41:27.745316+0000","last_peered":"2023-08-09T12:41:27.745316+0000","last_clean":"2023-08-09T12:41:27.745316+0000","last_became_active":"2023-08-09T12:41:26.768798+0000","last_became_peered":"2023-08-09T12:41:26.768798+0000","last_unstale":"2023-08-09T12:41:27.745316+0000","last_undegraded":"2023-08-09T12:41:27.745316+0000","last_fullsized":"2023-08-09T12:41:27.745316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:48:03.240657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748449+0000","last_change":"2023-08-09T12:41:26.748928+0000","last_active":"2023-08-09T12:41:27.748449+0000","last_peered":"2023-08-09T12:41:27.748449+0000","last_clean":"2023-08-09T12:41:27.748449+0000","last_became_active":"2023-08-09T12:41:26.748363+0000","last_became_peered":"2023-08-09T12:41:26.748363+0000","last_unstale":"2023-08-09T12:41:27.748449+0000","last_undegraded":"2023-08-09T12:41:27.748449+0000","last_fullsized":"2023-08-09T12:41:27.748449+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:41:42.640344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735674+0000","last_change":"2023-08-09T12:41:26.753475+0000","last_active":"2023-08-09T12:41:27.735674+0000","last_peered":"2023-08-09T12:41:27.735674+0000","last_clean":"2023-08-09T12:41:27.735674+0000","last_became_active":"2023-08-09T12:41:26.753219+0000","last_became_peered":"2023-08-09T12:41:26.753219+0000","last_unstale":"2023-08-09T12:41:27.735674+0000","last_undegraded":"2023-08-09T12:41:27.735674+0000","last_fullsized":"2023-08-09T12:41:27.735674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:21.262487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744410+0000","last_change":"2023-08-09T12:41:26.765111+0000","last_active":"2023-08-09T12:41:27.744410+0000","last_peered":"2023-08-09T12:41:27.744410+0000","last_clean":"2023-08-09T12:41:27.744410+0000","last_became_active":"2023-08-09T12:41:26.764512+0000","last_became_peered":"2023-08-09T12:41:26.764512+0000","last_unstale":"2023-08-09T12:41:27.744410+0000","last_undegraded":"2023-08-09T12:41:27.744410+0000","last_fullsized":"2023-08-09T12:41:27.744410+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:30.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745760+0000","last_change":"2023-08-09T12:41:26.760310+0000","last_active":"2023-08-09T12:41:27.745760+0000","last_peered":"2023-08-09T12:41:27.745760+0000","last_clean":"2023-08-09T12:41:27.745760+0000","last_became_active":"2023-08-09T12:41:26.759886+0000","last_became_peered":"2023-08-09T12:41:26.759886+0000","last_unstale":"2023-08-09T12:41:27.745760+0000","last_undegraded":"2023-08-09T12:41:27.745760+0000","last_fullsized":"2023-08-09T12:41:27.745760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:48.342228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745937+0000","last_change":"2023-08-09T12:41:26.764924+0000","last_active":"2023-08-09T12:41:27.745937+0000","last_peered":"2023-08-09T12:41:27.745937+0000","last_clean":"2023-08-09T12:41:27.745937+0000","last_became_active":"2023-08-09T12:41:26.764684+0000","last_became_peered":"2023-08-09T12:41:26.764684+0000","last_unstale":"2023-08-09T12:41:27.745937+0000","last_undegraded":"2023-08-09T12:41:27.745937+0000","last_fullsized":"2023-08-09T12:41:27.745937+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:55.797229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744863+0000","last_change":"2023-08-09T12:41:26.766387+0000","last_active":"2023-08-09T12:41:27.744863+0000","last_peered":"2023-08-09T12:41:27.744863+0000","last_clean":"2023-08-09T12:41:27.744863+0000","last_became_active":"2023-08-09T12:41:26.765392+0000","last_became_peered":"2023-08-09T12:41:26.765392+0000","last_unstale":"2023-08-09T12:41:27.744863+0000","last_undegraded":"2023-08-09T12:41:27.744863+0000","last_fullsized":"2023-08-09T12:41:27.744863+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:30.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744912+0000","last_change":"2023-08-09T12:41:26.763625+0000","last_active":"2023-08-09T12:41:27.744912+0000","last_peered":"2023-08-09T12:41:27.744912+0000","last_clean":"2023-08-09T12:41:27.744912+0000","last_became_active":"2023-08-09T12:41:26.761764+0000","last_became_peered":"2023-08-09T12:41:26.761764+0000","last_unstale":"2023-08-09T12:41:27.744912+0000","last_undegraded":"2023-08-09T12:41:27.744912+0000","last_fullsized":"2023-08-09T12:41:27.744912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:42:19.095765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.732582+0000","last_change":"2023-08-09T12:41:26.751660+0000","last_active":"2023-08-09T12:41:27.732582+0000","last_peered":"2023-08-09T12:41:27.732582+0000","last_clean":"2023-08-09T12:41:27.732582+0000","last_became_active":"2023-08-09T12:41:26.751076+0000","last_became_peered":"2023-08-09T12:41:26.751076+0000","last_unstale":"2023-08-09T12:41:27.732582+0000","last_undegraded":"2023-08-09T12:41:27.732582+0000","last_fullsized":"2023-08-09T12:41:27.732582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:38:59.971994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746489+0000","last_change":"2023-08-09T12:41:26.744068+0000","last_active":"2023-08-09T12:41:27.746489+0000","last_peered":"2023-08-09T12:41:27.746489+0000","last_clean":"2023-08-09T12:41:27.746489+0000","last_became_active":"2023-08-09T12:41:26.742814+0000","last_became_peered":"2023-08-09T12:41:26.742814+0000","last_unstale":"2023-08-09T12:41:27.746489+0000","last_undegraded":"2023-08-09T12:41:27.746489+0000","last_fullsized":"2023-08-09T12:41:27.746489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:05.468987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744234+0000","last_change":"2023-08-09T12:41:26.761316+0000","last_active":"2023-08-09T12:41:27.744234+0000","last_peered":"2023-08-09T12:41:27.744234+0000","last_clean":"2023-08-09T12:41:27.744234+0000","last_became_active":"2023-08-09T12:41:26.761042+0000","last_became_peered":"2023-08-09T12:41:26.761042+0000","last_unstale":"2023-08-09T12:41:27.744234+0000","last_undegraded":"2023-08-09T12:41:27.744234+0000","last_fullsized":"2023-08-09T12:41:27.744234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:55.143338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745170+0000","last_change":"2023-08-09T12:41:26.770725+0000","last_active":"2023-08-09T12:41:27.745170+0000","last_peered":"2023-08-09T12:41:27.745170+0000","last_clean":"2023-08-09T12:41:27.745170+0000","last_became_active":"2023-08-09T12:41:26.769312+0000","last_became_peered":"2023-08-09T12:41:26.769312+0000","last_unstale":"2023-08-09T12:41:27.745170+0000","last_undegraded":"2023-08-09T12:41:27.745170+0000","last_fullsized":"2023-08-09T12:41:27.745170+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:34.058833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747875+0000","last_change":"2023-08-09T12:41:26.741311+0000","last_active":"2023-08-09T12:41:27.747875+0000","last_peered":"2023-08-09T12:41:27.747875+0000","last_clean":"2023-08-09T12:41:27.747875+0000","last_became_active":"2023-08-09T12:41:26.740668+0000","last_became_peered":"2023-08-09T12:41:26.740668+0000","last_unstale":"2023-08-09T12:41:27.747875+0000","last_undegraded":"2023-08-09T12:41:27.747875+0000","last_fullsized":"2023-08-09T12:41:27.747875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:31:35.468025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744179+0000","last_change":"2023-08-09T12:41:26.759774+0000","last_active":"2023-08-09T12:41:27.744179+0000","last_peered":"2023-08-09T12:41:27.744179+0000","last_clean":"2023-08-09T12:41:27.744179+0000","last_became_active":"2023-08-09T12:41:26.759517+0000","last_became_peered":"2023-08-09T12:41:26.759517+0000","last_unstale":"2023-08-09T12:41:27.744179+0000","last_undegraded":"2023-08-09T12:41:27.744179+0000","last_fullsized":"2023-08-09T12:41:27.744179+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:57.682884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746304+0000","last_change":"2023-08-09T12:41:26.757501+0000","last_active":"2023-08-09T12:41:27.746304+0000","last_peered":"2023-08-09T12:41:27.746304+0000","last_clean":"2023-08-09T12:41:27.746304+0000","last_became_active":"2023-08-09T12:41:26.757260+0000","last_became_peered":"2023-08-09T12:41:26.757260+0000","last_unstale":"2023-08-09T12:41:27.746304+0000","last_undegraded":"2023-08-09T12:41:27.746304+0000","last_fullsized":"2023-08-09T12:41:27.746304+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:55.143338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747023+0000","last_change":"2023-08-09T12:41:26.752877+0000","last_active":"2023-08-09T12:41:27.747023+0000","last_peered":"2023-08-09T12:41:27.747023+0000","last_clean":"2023-08-09T12:41:27.747023+0000","last_became_active":"2023-08-09T12:41:26.752230+0000","last_became_peered":"2023-08-09T12:41:26.752230+0000","last_unstale":"2023-08-09T12:41:27.747023+0000","last_undegraded":"2023-08-09T12:41:27.747023+0000","last_fullsized":"2023-08-09T12:41:27.747023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:25:34.295755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744994+0000","last_change":"2023-08-09T12:41:26.770453+0000","last_active":"2023-08-09T12:41:27.744994+0000","last_peered":"2023-08-09T12:41:27.744994+0000","last_clean":"2023-08-09T12:41:27.744994+0000","last_became_active":"2023-08-09T12:41:26.765123+0000","last_became_peered":"2023-08-09T12:41:26.765123+0000","last_unstale":"2023-08-09T12:41:27.744994+0000","last_undegraded":"2023-08-09T12:41:27.744994+0000","last_fullsized":"2023-08-09T12:41:27.744994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:35:48.443783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736471+0000","last_change":"2023-08-09T12:41:26.755290+0000","last_active":"2023-08-09T12:41:27.736471+0000","last_peered":"2023-08-09T12:41:27.736471+0000","last_clean":"2023-08-09T12:41:27.736471+0000","last_became_active":"2023-08-09T12:41:26.753410+0000","last_became_peered":"2023-08-09T12:41:26.753410+0000","last_unstale":"2023-08-09T12:41:27.736471+0000","last_undegraded":"2023-08-09T12:41:27.736471+0000","last_fullsized":"2023-08-09T12:41:27.736471+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:06:35.056746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735925+0000","last_change":"2023-08-09T12:41:26.758273+0000","last_active":"2023-08-09T12:41:27.735925+0000","last_peered":"2023-08-09T12:41:27.735925+0000","last_clean":"2023-08-09T12:41:27.735925+0000","last_became_active":"2023-08-09T12:41:26.753618+0000","last_became_peered":"2023-08-09T12:41:26.753618+0000","last_unstale":"2023-08-09T12:41:27.735925+0000","last_undegraded":"2023-08-09T12:41:27.735925+0000","last_fullsized":"2023-08-09T12:41:27.735925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:36:01.417546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746658+0000","last_change":"2023-08-09T12:41:26.762381+0000","last_active":"2023-08-09T12:41:27.746658+0000","last_peered":"2023-08-09T12:41:27.746658+0000","last_clean":"2023-08-09T12:41:27.746658+0000","last_became_active":"2023-08-09T12:41:26.761594+0000","last_became_peered":"2023-08-09T12:41:26.761594+0000","last_unstale":"2023-08-09T12:41:27.746658+0000","last_undegraded":"2023-08-09T12:41:27.746658+0000","last_fullsized":"2023-08-09T12:41:27.746658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:59.796627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.732505+0000","last_change":"2023-08-09T12:41:26.753387+0000","last_active":"2023-08-09T12:41:27.732505+0000","last_peered":"2023-08-09T12:41:27.732505+0000","last_clean":"2023-08-09T12:41:27.732505+0000","last_became_active":"2023-08-09T12:41:26.752651+0000","last_became_peered":"2023-08-09T12:41:26.752651+0000","last_unstale":"2023-08-09T12:41:27.732505+0000","last_undegraded":"2023-08-09T12:41:27.732505+0000","last_fullsized":"2023-08-09T12:41:27.732505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:38.407498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745316+0000","last_change":"2023-08-09T12:41:26.769784+0000","last_active":"2023-08-09T12:41:27.745316+0000","last_peered":"2023-08-09T12:41:27.745316+0000","last_clean":"2023-08-09T12:41:27.745316+0000","last_became_active":"2023-08-09T12:41:26.764774+0000","last_became_peered":"2023-08-09T12:41:26.764774+0000","last_unstale":"2023-08-09T12:41:27.745316+0000","last_undegraded":"2023-08-09T12:41:27.745316+0000","last_fullsized":"2023-08-09T12:41:27.745316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:03:40.448213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745915+0000","last_change":"2023-08-09T12:41:26.758794+0000","last_active":"2023-08-09T12:41:27.745915+0000","last_peered":"2023-08-09T12:41:27.745915+0000","last_clean":"2023-08-09T12:41:27.745915+0000","last_became_active":"2023-08-09T12:41:26.758550+0000","last_became_peered":"2023-08-09T12:41:26.758550+0000","last_unstale":"2023-08-09T12:41:27.745915+0000","last_undegraded":"2023-08-09T12:41:27.745915+0000","last_fullsized":"2023-08-09T12:41:27.745915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745952+0000","last_change":"2023-08-09T12:41:26.742962+0000","last_active":"2023-08-09T12:41:27.745952+0000","last_peered":"2023-08-09T12:41:27.745952+0000","last_clean":"2023-08-09T12:41:27.745952+0000","last_became_active":"2023-08-09T12:41:26.742314+0000","last_became_peered":"2023-08-09T12:41:26.742314+0000","last_unstale":"2023-08-09T12:41:27.745952+0000","last_undegraded":"2023-08-09T12:41:27.745952+0000","last_fullsized":"2023-08-09T12:41:27.745952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:43.131822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.743905+0000","last_change":"2023-08-09T12:41:26.758675+0000","last_active":"2023-08-09T12:41:27.743905+0000","last_peered":"2023-08-09T12:41:27.743905+0000","last_clean":"2023-08-09T12:41:27.743905+0000","last_became_active":"2023-08-09T12:41:26.758428+0000","last_became_peered":"2023-08-09T12:41:26.758428+0000","last_unstale":"2023-08-09T12:41:27.743905+0000","last_undegraded":"2023-08-09T12:41:27.743905+0000","last_fullsized":"2023-08-09T12:41:27.743905+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:48.342228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.737139+0000","last_change":"2023-08-09T12:41:26.742817+0000","last_active":"2023-08-09T12:41:27.737139+0000","last_peered":"2023-08-09T12:41:27.737139+0000","last_clean":"2023-08-09T12:41:27.737139+0000","last_became_active":"2023-08-09T12:41:26.742199+0000","last_became_peered":"2023-08-09T12:41:26.742199+0000","last_unstale":"2023-08-09T12:41:27.737139+0000","last_undegraded":"2023-08-09T12:41:27.737139+0000","last_fullsized":"2023-08-09T12:41:27.737139+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:13.939226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745460+0000","last_change":"2023-08-09T12:41:26.769569+0000","last_active":"2023-08-09T12:41:27.745460+0000","last_peered":"2023-08-09T12:41:27.745460+0000","last_clean":"2023-08-09T12:41:27.745460+0000","last_became_active":"2023-08-09T12:41:26.764108+0000","last_became_peered":"2023-08-09T12:41:26.764108+0000","last_unstale":"2023-08-09T12:41:27.745460+0000","last_undegraded":"2023-08-09T12:41:27.745460+0000","last_fullsized":"2023-08-09T12:41:27.745460+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:04.261477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748245+0000","last_change":"2023-08-09T12:41:26.759612+0000","last_active":"2023-08-09T12:41:27.748245+0000","last_peered":"2023-08-09T12:41:27.748245+0000","last_clean":"2023-08-09T12:41:27.748245+0000","last_became_active":"2023-08-09T12:41:26.759326+0000","last_became_peered":"2023-08-09T12:41:26.759326+0000","last_unstale":"2023-08-09T12:41:27.748245+0000","last_undegraded":"2023-08-09T12:41:27.748245+0000","last_fullsized":"2023-08-09T12:41:27.748245+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:35:31.854435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745766+0000","last_change":"2023-08-09T12:41:26.762947+0000","last_active":"2023-08-09T12:41:27.745766+0000","last_peered":"2023-08-09T12:41:27.745766+0000","last_clean":"2023-08-09T12:41:27.745766+0000","last_became_active":"2023-08-09T12:41:26.762680+0000","last_became_peered":"2023-08-09T12:41:26.762680+0000","last_unstale":"2023-08-09T12:41:27.745766+0000","last_undegraded":"2023-08-09T12:41:27.745766+0000","last_fullsized":"2023-08-09T12:41:27.745766+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:41.857557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745592+0000","last_change":"2023-08-09T12:41:26.760698+0000","last_active":"2023-08-09T12:41:27.745592+0000","last_peered":"2023-08-09T12:41:27.745592+0000","last_clean":"2023-08-09T12:41:27.745592+0000","last_became_active":"2023-08-09T12:41:26.760285+0000","last_became_peered":"2023-08-09T12:41:26.760285+0000","last_unstale":"2023-08-09T12:41:27.745592+0000","last_undegraded":"2023-08-09T12:41:27.745592+0000","last_fullsized":"2023-08-09T12:41:27.745592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:39:40.762939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747738+0000","last_change":"2023-08-09T12:41:26.754093+0000","last_active":"2023-08-09T12:41:27.747738+0000","last_peered":"2023-08-09T12:41:27.747738+0000","last_clean":"2023-08-09T12:41:27.747738+0000","last_became_active":"2023-08-09T12:41:26.752605+0000","last_became_peered":"2023-08-09T12:41:26.752605+0000","last_unstale":"2023-08-09T12:41:27.747738+0000","last_undegraded":"2023-08-09T12:41:27.747738+0000","last_fullsized":"2023-08-09T12:41:27.747738+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:46:54.447247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.737556+0000","last_change":"2023-08-09T12:41:25.721830+0000","last_active":"2023-08-09T12:41:27.737556+0000","last_peered":"2023-08-09T12:41:27.737556+0000","last_clean":"2023-08-09T12:41:27.737556+0000","last_became_active":"2023-08-09T12:41:25.721477+0000","last_became_peered":"2023-08-09T12:41:25.721477+0000","last_unstale":"2023-08-09T12:41:27.737556+0000","last_undegraded":"2023-08-09T12:41:27.737556+0000","last_fullsized":"2023-08-09T12:41:27.737556+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.253017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745997+0000","last_change":"2023-08-09T12:41:26.752060+0000","last_active":"2023-08-09T12:41:27.745997+0000","last_peered":"2023-08-09T12:41:27.745997+0000","last_clean":"2023-08-09T12:41:27.745997+0000","last_became_active":"2023-08-09T12:41:26.751292+0000","last_became_peered":"2023-08-09T12:41:26.751292+0000","last_unstale":"2023-08-09T12:41:27.745997+0000","last_undegraded":"2023-08-09T12:41:27.745997+0000","last_fullsized":"2023-08-09T12:41:27.745997+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:14.075784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.743840+0000","last_change":"2023-08-09T12:41:25.718240+0000","last_active":"2023-08-09T12:41:27.743840+0000","last_peered":"2023-08-09T12:41:27.743840+0000","last_clean":"2023-08-09T12:41:27.743840+0000","last_became_active":"2023-08-09T12:41:25.717916+0000","last_became_peered":"2023-08-09T12:41:25.717916+0000","last_unstale":"2023-08-09T12:41:27.743840+0000","last_undegraded":"2023-08-09T12:41:27.743840+0000","last_fullsized":"2023-08-09T12:41:27.743840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:40.852877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736303+0000","last_change":"2023-08-09T12:41:26.754052+0000","last_active":"2023-08-09T12:41:27.736303+0000","last_peered":"2023-08-09T12:41:27.736303+0000","last_clean":"2023-08-09T12:41:27.736303+0000","last_became_active":"2023-08-09T12:41:26.752928+0000","last_became_peered":"2023-08-09T12:41:26.752928+0000","last_unstale":"2023-08-09T12:41:27.736303+0000","last_undegraded":"2023-08-09T12:41:27.736303+0000","last_fullsized":"2023-08-09T12:41:27.736303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:49:42.178293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745092+0000","last_change":"2023-08-09T12:41:25.719346+0000","last_active":"2023-08-09T12:41:27.745092+0000","last_peered":"2023-08-09T12:41:27.745092+0000","last_clean":"2023-08-09T12:41:27.745092+0000","last_became_active":"2023-08-09T12:41:25.719015+0000","last_became_peered":"2023-08-09T12:41:25.719015+0000","last_unstale":"2023-08-09T12:41:27.745092+0000","last_undegraded":"2023-08-09T12:41:27.745092+0000","last_fullsized":"2023-08-09T12:41:27.745092+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:54.792549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746484+0000","last_change":"2023-08-09T12:41:26.743217+0000","last_active":"2023-08-09T12:41:27.746484+0000","last_peered":"2023-08-09T12:41:27.746484+0000","last_clean":"2023-08-09T12:41:27.746484+0000","last_became_active":"2023-08-09T12:41:26.742517+0000","last_became_peered":"2023-08-09T12:41:26.742517+0000","last_unstale":"2023-08-09T12:41:27.746484+0000","last_undegraded":"2023-08-09T12:41:27.746484+0000","last_fullsized":"2023-08-09T12:41:27.746484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:03.385956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747908+0000","last_change":"2023-08-09T12:41:25.722114+0000","last_active":"2023-08-09T12:41:27.747908+0000","last_peered":"2023-08-09T12:41:27.747908+0000","last_clean":"2023-08-09T12:41:27.747908+0000","last_became_active":"2023-08-09T12:41:25.721669+0000","last_became_peered":"2023-08-09T12:41:25.721669+0000","last_unstale":"2023-08-09T12:41:27.747908+0000","last_undegraded":"2023-08-09T12:41:27.747908+0000","last_fullsized":"2023-08-09T12:41:27.747908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:54:46.850648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735417+0000","last_change":"2023-08-09T12:41:26.770070+0000","last_active":"2023-08-09T12:41:27.735417+0000","last_peered":"2023-08-09T12:41:27.735417+0000","last_clean":"2023-08-09T12:41:27.735417+0000","last_became_active":"2023-08-09T12:41:26.769738+0000","last_became_peered":"2023-08-09T12:41:26.769738+0000","last_unstale":"2023-08-09T12:41:27.735417+0000","last_undegraded":"2023-08-09T12:41:27.735417+0000","last_fullsized":"2023-08-09T12:41:27.735417+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:55.143338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746469+0000","last_change":"2023-08-09T12:41:25.722107+0000","last_active":"2023-08-09T12:41:27.746469+0000","last_peered":"2023-08-09T12:41:27.746469+0000","last_clean":"2023-08-09T12:41:27.746469+0000","last_became_active":"2023-08-09T12:41:25.721515+0000","last_became_peered":"2023-08-09T12:41:25.721515+0000","last_unstale":"2023-08-09T12:41:27.746469+0000","last_undegraded":"2023-08-09T12:41:27.746469+0000","last_fullsized":"2023-08-09T12:41:27.746469+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:29.146917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747398+0000","last_change":"2023-08-09T12:41:26.761679+0000","last_active":"2023-08-09T12:41:27.747398+0000","last_peered":"2023-08-09T12:41:27.747398+0000","last_clean":"2023-08-09T12:41:27.747398+0000","last_became_active":"2023-08-09T12:41:26.761434+0000","last_became_peered":"2023-08-09T12:41:26.761434+0000","last_unstale":"2023-08-09T12:41:27.747398+0000","last_undegraded":"2023-08-09T12:41:27.747398+0000","last_fullsized":"2023-08-09T12:41:27.747398+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:25:56.061494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735521+0000","last_change":"2023-08-09T12:41:25.720698+0000","last_active":"2023-08-09T12:41:27.735521+0000","last_peered":"2023-08-09T12:41:27.735521+0000","last_clean":"2023-08-09T12:41:27.735521+0000","last_became_active":"2023-08-09T12:41:25.720198+0000","last_became_peered":"2023-08-09T12:41:25.720198+0000","last_unstale":"2023-08-09T12:41:27.735521+0000","last_undegraded":"2023-08-09T12:41:27.735521+0000","last_fullsized":"2023-08-09T12:41:27.735521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:29.146917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746927+0000","last_change":"2023-08-09T12:41:26.743459+0000","last_active":"2023-08-09T12:41:27.746927+0000","last_peered":"2023-08-09T12:41:27.746927+0000","last_clean":"2023-08-09T12:41:27.746927+0000","last_became_active":"2023-08-09T12:41:26.741850+0000","last_became_peered":"2023-08-09T12:41:26.741850+0000","last_unstale":"2023-08-09T12:41:27.746927+0000","last_undegraded":"2023-08-09T12:41:27.746927+0000","last_fullsized":"2023-08-09T12:41:27.746927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:26.147074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736362+0000","last_change":"2023-08-09T12:41:25.718176+0000","last_active":"2023-08-09T12:41:27.736362+0000","last_peered":"2023-08-09T12:41:27.736362+0000","last_clean":"2023-08-09T12:41:27.736362+0000","last_became_active":"2023-08-09T12:41:25.717644+0000","last_became_peered":"2023-08-09T12:41:25.717644+0000","last_unstale":"2023-08-09T12:41:27.736362+0000","last_undegraded":"2023-08-09T12:41:27.736362+0000","last_fullsized":"2023-08-09T12:41:27.736362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:33.908881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747397+0000","last_change":"2023-08-09T12:41:26.756431+0000","last_active":"2023-08-09T12:41:27.747397+0000","last_peered":"2023-08-09T12:41:27.747397+0000","last_clean":"2023-08-09T12:41:27.747397+0000","last_became_active":"2023-08-09T12:41:26.755532+0000","last_became_peered":"2023-08-09T12:41:26.755532+0000","last_unstale":"2023-08-09T12:41:27.747397+0000","last_undegraded":"2023-08-09T12:41:27.747397+0000","last_fullsized":"2023-08-09T12:41:27.747397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:55:58.410290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746268+0000","last_change":"2023-08-09T12:41:25.722201+0000","last_active":"2023-08-09T12:41:27.746268+0000","last_peered":"2023-08-09T12:41:27.746268+0000","last_clean":"2023-08-09T12:41:27.746268+0000","last_became_active":"2023-08-09T12:41:25.721923+0000","last_became_peered":"2023-08-09T12:41:25.721923+0000","last_unstale":"2023-08-09T12:41:27.746268+0000","last_undegraded":"2023-08-09T12:41:27.746268+0000","last_fullsized":"2023-08-09T12:41:27.746268+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:56.678204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736198+0000","last_change":"2023-08-09T12:41:26.757770+0000","last_active":"2023-08-09T12:41:27.736198+0000","last_peered":"2023-08-09T12:41:27.736198+0000","last_clean":"2023-08-09T12:41:27.736198+0000","last_became_active":"2023-08-09T12:41:26.757533+0000","last_became_peered":"2023-08-09T12:41:26.757533+0000","last_unstale":"2023-08-09T12:41:27.736198+0000","last_undegraded":"2023-08-09T12:41:27.736198+0000","last_fullsized":"2023-08-09T12:41:27.736198+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:42:19.095765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747865+0000","last_change":"2023-08-09T12:41:25.709057+0000","last_active":"2023-08-09T12:41:27.747865+0000","last_peered":"2023-08-09T12:41:27.747865+0000","last_clean":"2023-08-09T12:41:27.747865+0000","last_became_active":"2023-08-09T12:41:25.708378+0000","last_became_peered":"2023-08-09T12:41:25.708378+0000","last_unstale":"2023-08-09T12:41:27.747865+0000","last_undegraded":"2023-08-09T12:41:27.747865+0000","last_fullsized":"2023-08-09T12:41:27.747865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:00:16.246754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745465+0000","last_change":"2023-08-09T12:41:26.752598+0000","last_active":"2023-08-09T12:41:27.745465+0000","last_peered":"2023-08-09T12:41:27.745465+0000","last_clean":"2023-08-09T12:41:27.745465+0000","last_became_active":"2023-08-09T12:41:26.752197+0000","last_became_peered":"2023-08-09T12:41:26.752197+0000","last_unstale":"2023-08-09T12:41:27.745465+0000","last_undegraded":"2023-08-09T12:41:27.745465+0000","last_fullsized":"2023-08-09T12:41:27.745465+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:22:35.994574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735815+0000","last_change":"2023-08-09T12:41:25.710502+0000","last_active":"2023-08-09T12:41:27.735815+0000","last_peered":"2023-08-09T12:41:27.735815+0000","last_clean":"2023-08-09T12:41:27.735815+0000","last_became_active":"2023-08-09T12:41:25.709843+0000","last_became_peered":"2023-08-09T12:41:25.709843+0000","last_unstale":"2023-08-09T12:41:27.735815+0000","last_undegraded":"2023-08-09T12:41:27.735815+0000","last_fullsized":"2023-08-09T12:41:27.735815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:54:31.082481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745170+0000","last_change":"2023-08-09T12:41:26.770395+0000","last_active":"2023-08-09T12:41:27.745170+0000","last_peered":"2023-08-09T12:41:27.745170+0000","last_clean":"2023-08-09T12:41:27.745170+0000","last_became_active":"2023-08-09T12:41:26.768369+0000","last_became_peered":"2023-08-09T12:41:26.768369+0000","last_unstale":"2023-08-09T12:41:27.745170+0000","last_undegraded":"2023-08-09T12:41:27.745170+0000","last_fullsized":"2023-08-09T12:41:27.745170+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:13:01.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748039+0000","last_change":"2023-08-09T12:41:25.719290+0000","last_active":"2023-08-09T12:41:27.748039+0000","last_peered":"2023-08-09T12:41:27.748039+0000","last_clean":"2023-08-09T12:41:27.748039+0000","last_became_active":"2023-08-09T12:41:25.718919+0000","last_became_peered":"2023-08-09T12:41:25.718919+0000","last_unstale":"2023-08-09T12:41:27.748039+0000","last_undegraded":"2023-08-09T12:41:27.748039+0000","last_fullsized":"2023-08-09T12:41:27.748039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:46.305340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735230+0000","last_change":"2023-08-09T12:41:26.760937+0000","last_active":"2023-08-09T12:41:27.735230+0000","last_peered":"2023-08-09T12:41:27.735230+0000","last_clean":"2023-08-09T12:41:27.735230+0000","last_became_active":"2023-08-09T12:41:26.760393+0000","last_became_peered":"2023-08-09T12:41:26.760393+0000","last_unstale":"2023-08-09T12:41:27.735230+0000","last_undegraded":"2023-08-09T12:41:27.735230+0000","last_fullsized":"2023-08-09T12:41:27.735230+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:57.682884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745720+0000","last_change":"2023-08-09T12:41:25.720123+0000","last_active":"2023-08-09T12:41:27.745720+0000","last_peered":"2023-08-09T12:41:27.745720+0000","last_clean":"2023-08-09T12:41:27.745720+0000","last_became_active":"2023-08-09T12:41:25.719183+0000","last_became_peered":"2023-08-09T12:41:25.719183+0000","last_unstale":"2023-08-09T12:41:27.745720+0000","last_undegraded":"2023-08-09T12:41:27.745720+0000","last_fullsized":"2023-08-09T12:41:27.745720+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:42:18.091085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746938+0000","last_change":"2023-08-09T12:41:26.758726+0000","last_active":"2023-08-09T12:41:27.746938+0000","last_peered":"2023-08-09T12:41:27.746938+0000","last_clean":"2023-08-09T12:41:27.746938+0000","last_became_active":"2023-08-09T12:41:26.757570+0000","last_became_peered":"2023-08-09T12:41:26.757570+0000","last_unstale":"2023-08-09T12:41:27.746938+0000","last_undegraded":"2023-08-09T12:41:27.746938+0000","last_fullsized":"2023-08-09T12:41:27.746938+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:08:32.383305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746399+0000","last_change":"2023-08-09T12:41:25.716255+0000","last_active":"2023-08-09T12:41:27.746399+0000","last_peered":"2023-08-09T12:41:27.746399+0000","last_clean":"2023-08-09T12:41:27.746399+0000","last_became_active":"2023-08-09T12:41:25.714648+0000","last_became_peered":"2023-08-09T12:41:25.714648+0000","last_unstale":"2023-08-09T12:41:27.746399+0000","last_undegraded":"2023-08-09T12:41:27.746399+0000","last_fullsized":"2023-08-09T12:41:27.746399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:27:43.107314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746140+0000","last_change":"2023-08-09T12:41:26.768542+0000","last_active":"2023-08-09T12:41:27.746140+0000","last_peered":"2023-08-09T12:41:27.746140+0000","last_clean":"2023-08-09T12:41:27.746140+0000","last_became_active":"2023-08-09T12:41:26.764590+0000","last_became_peered":"2023-08-09T12:41:26.764590+0000","last_unstale":"2023-08-09T12:41:27.746140+0000","last_undegraded":"2023-08-09T12:41:27.746140+0000","last_fullsized":"2023-08-09T12:41:27.746140+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:09.252796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736636+0000","last_change":"2023-08-09T12:41:25.723688+0000","last_active":"2023-08-09T12:41:27.736636+0000","last_peered":"2023-08-09T12:41:27.736636+0000","last_clean":"2023-08-09T12:41:27.736636+0000","last_became_active":"2023-08-09T12:41:25.723451+0000","last_became_peered":"2023-08-09T12:41:25.723451+0000","last_unstale":"2023-08-09T12:41:27.736636+0000","last_undegraded":"2023-08-09T12:41:27.736636+0000","last_fullsized":"2023-08-09T12:41:27.736636+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:39.093221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745035+0000","last_change":"2023-08-09T12:41:26.743468+0000","last_active":"2023-08-09T12:41:27.745035+0000","last_peered":"2023-08-09T12:41:27.745035+0000","last_clean":"2023-08-09T12:41:27.745035+0000","last_became_active":"2023-08-09T12:41:26.742242+0000","last_became_peered":"2023-08-09T12:41:26.742242+0000","last_unstale":"2023-08-09T12:41:27.745035+0000","last_undegraded":"2023-08-09T12:41:27.745035+0000","last_fullsized":"2023-08-09T12:41:27.745035+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:21.262487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746885+0000","last_change":"2023-08-09T12:41:25.722103+0000","last_active":"2023-08-09T12:41:27.746885+0000","last_peered":"2023-08-09T12:41:27.746885+0000","last_clean":"2023-08-09T12:41:27.746885+0000","last_became_active":"2023-08-09T12:41:25.721815+0000","last_became_peered":"2023-08-09T12:41:25.721815+0000","last_unstale":"2023-08-09T12:41:27.746885+0000","last_undegraded":"2023-08-09T12:41:27.746885+0000","last_fullsized":"2023-08-09T12:41:27.746885+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:26.752391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744994+0000","last_change":"2023-08-09T12:41:26.772127+0000","last_active":"2023-08-09T12:41:27.744994+0000","last_peered":"2023-08-09T12:41:27.744994+0000","last_clean":"2023-08-09T12:41:27.744994+0000","last_became_active":"2023-08-09T12:41:26.769642+0000","last_became_peered":"2023-08-09T12:41:26.769642+0000","last_unstale":"2023-08-09T12:41:27.744994+0000","last_undegraded":"2023-08-09T12:41:27.744994+0000","last_fullsized":"2023-08-09T12:41:27.744994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:40:26.483781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746159+0000","last_change":"2023-08-09T12:41:25.719684+0000","last_active":"2023-08-09T12:41:27.746159+0000","last_peered":"2023-08-09T12:41:27.746159+0000","last_clean":"2023-08-09T12:41:27.746159+0000","last_became_active":"2023-08-09T12:41:25.719316+0000","last_became_peered":"2023-08-09T12:41:25.719316+0000","last_unstale":"2023-08-09T12:41:27.746159+0000","last_undegraded":"2023-08-09T12:41:27.746159+0000","last_fullsized":"2023-08-09T12:41:27.746159+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:12:41.280334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745474+0000","last_change":"2023-08-09T12:41:26.758613+0000","last_active":"2023-08-09T12:41:27.745474+0000","last_peered":"2023-08-09T12:41:27.745474+0000","last_clean":"2023-08-09T12:41:27.745474+0000","last_became_active":"2023-08-09T12:41:26.758211+0000","last_became_peered":"2023-08-09T12:41:26.758211+0000","last_unstale":"2023-08-09T12:41:27.745474+0000","last_undegraded":"2023-08-09T12:41:27.745474+0000","last_fullsized":"2023-08-09T12:41:27.745474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:58.393906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745600+0000","last_change":"2023-08-09T12:41:25.721784+0000","last_active":"2023-08-09T12:41:27.745600+0000","last_peered":"2023-08-09T12:41:27.745600+0000","last_clean":"2023-08-09T12:41:27.745600+0000","last_became_active":"2023-08-09T12:41:25.721531+0000","last_became_peered":"2023-08-09T12:41:25.721531+0000","last_unstale":"2023-08-09T12:41:27.745600+0000","last_undegraded":"2023-08-09T12:41:27.745600+0000","last_fullsized":"2023-08-09T12:41:27.745600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:46.790963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744386+0000","last_change":"2023-08-09T12:41:26.771737+0000","last_active":"2023-08-09T12:41:27.744386+0000","last_peered":"2023-08-09T12:41:27.744386+0000","last_clean":"2023-08-09T12:41:27.744386+0000","last_became_active":"2023-08-09T12:41:26.771488+0000","last_became_peered":"2023-08-09T12:41:26.771488+0000","last_unstale":"2023-08-09T12:41:27.744386+0000","last_undegraded":"2023-08-09T12:41:27.744386+0000","last_fullsized":"2023-08-09T12:41:27.744386+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:27:44.111994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.732870+0000","last_change":"2023-08-09T12:41:25.709300+0000","last_active":"2023-08-09T12:41:27.732870+0000","last_peered":"2023-08-09T12:41:27.732870+0000","last_clean":"2023-08-09T12:41:27.732870+0000","last_became_active":"2023-08-09T12:41:25.708777+0000","last_became_peered":"2023-08-09T12:41:25.708777+0000","last_unstale":"2023-08-09T12:41:27.732870+0000","last_undegraded":"2023-08-09T12:41:27.732870+0000","last_fullsized":"2023-08-09T12:41:27.732870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:17.072619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735501+0000","last_change":"2023-08-09T12:41:26.757742+0000","last_active":"2023-08-09T12:41:27.735501+0000","last_peered":"2023-08-09T12:41:27.735501+0000","last_clean":"2023-08-09T12:41:27.735501+0000","last_became_active":"2023-08-09T12:41:26.757342+0000","last_became_peered":"2023-08-09T12:41:26.757342+0000","last_unstale":"2023-08-09T12:41:27.735501+0000","last_undegraded":"2023-08-09T12:41:27.735501+0000","last_fullsized":"2023-08-09T12:41:27.735501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:27:44.111994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736981+0000","last_change":"2023-08-09T12:41:25.719868+0000","last_active":"2023-08-09T12:41:27.736981+0000","last_peered":"2023-08-09T12:41:27.736981+0000","last_clean":"2023-08-09T12:41:27.736981+0000","last_became_active":"2023-08-09T12:41:25.719554+0000","last_became_peered":"2023-08-09T12:41:25.719554+0000","last_unstale":"2023-08-09T12:41:27.736981+0000","last_undegraded":"2023-08-09T12:41:27.736981+0000","last_fullsized":"2023-08-09T12:41:27.736981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:01:48.708767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744579+0000","last_change":"2023-08-09T12:41:26.764776+0000","last_active":"2023-08-09T12:41:27.744579+0000","last_peered":"2023-08-09T12:41:27.744579+0000","last_clean":"2023-08-09T12:41:27.744579+0000","last_became_active":"2023-08-09T12:41:26.761557+0000","last_became_peered":"2023-08-09T12:41:26.761557+0000","last_unstale":"2023-08-09T12:41:27.744579+0000","last_undegraded":"2023-08-09T12:41:27.744579+0000","last_fullsized":"2023-08-09T12:41:27.744579+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:54:32.087161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736711+0000","last_change":"2023-08-09T12:41:25.723181+0000","last_active":"2023-08-09T12:41:27.736711+0000","last_peered":"2023-08-09T12:41:27.736711+0000","last_clean":"2023-08-09T12:41:27.736711+0000","last_became_active":"2023-08-09T12:41:25.722598+0000","last_became_peered":"2023-08-09T12:41:25.722598+0000","last_unstale":"2023-08-09T12:41:27.736711+0000","last_undegraded":"2023-08-09T12:41:27.736711+0000","last_fullsized":"2023-08-09T12:41:27.736711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:02:50.449385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745815+0000","last_change":"2023-08-09T12:41:26.753949+0000","last_active":"2023-08-09T12:41:27.745815+0000","last_peered":"2023-08-09T12:41:27.745815+0000","last_clean":"2023-08-09T12:41:27.745815+0000","last_became_active":"2023-08-09T12:41:26.753622+0000","last_became_peered":"2023-08-09T12:41:26.753622+0000","last_unstale":"2023-08-09T12:41:27.745815+0000","last_undegraded":"2023-08-09T12:41:27.745815+0000","last_fullsized":"2023-08-09T12:41:27.745815+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:53:52.596963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744513+0000","last_change":"2023-08-09T12:41:25.708766+0000","last_active":"2023-08-09T12:41:27.744513+0000","last_peered":"2023-08-09T12:41:27.744513+0000","last_clean":"2023-08-09T12:41:27.744513+0000","last_became_active":"2023-08-09T12:41:25.707255+0000","last_became_peered":"2023-08-09T12:41:25.707255+0000","last_unstale":"2023-08-09T12:41:27.744513+0000","last_undegraded":"2023-08-09T12:41:27.744513+0000","last_fullsized":"2023-08-09T12:41:27.744513+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:20.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735687+0000","last_change":"2023-08-09T12:41:26.752241+0000","last_active":"2023-08-09T12:41:27.735687+0000","last_peered":"2023-08-09T12:41:27.735687+0000","last_clean":"2023-08-09T12:41:27.735687+0000","last_became_active":"2023-08-09T12:41:26.751882+0000","last_became_peered":"2023-08-09T12:41:26.751882+0000","last_unstale":"2023-08-09T12:41:27.735687+0000","last_undegraded":"2023-08-09T12:41:27.735687+0000","last_fullsized":"2023-08-09T12:41:27.735687+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:57.396775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745994+0000","last_change":"2023-08-09T12:41:25.719956+0000","last_active":"2023-08-09T12:41:27.745994+0000","last_peered":"2023-08-09T12:41:27.745994+0000","last_clean":"2023-08-09T12:41:27.745994+0000","last_became_active":"2023-08-09T12:41:25.718827+0000","last_became_peered":"2023-08-09T12:41:25.718827+0000","last_unstale":"2023-08-09T12:41:27.745994+0000","last_undegraded":"2023-08-09T12:41:27.745994+0000","last_fullsized":"2023-08-09T12:41:27.745994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:04:25.155238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745463+0000","last_change":"2023-08-09T12:41:26.769981+0000","last_active":"2023-08-09T12:41:27.745463+0000","last_peered":"2023-08-09T12:41:27.745463+0000","last_clean":"2023-08-09T12:41:27.745463+0000","last_became_active":"2023-08-09T12:41:26.764025+0000","last_became_peered":"2023-08-09T12:41:26.764025+0000","last_unstale":"2023-08-09T12:41:27.745463+0000","last_undegraded":"2023-08-09T12:41:27.745463+0000","last_fullsized":"2023-08-09T12:41:27.745463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:34.790459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746526+0000","last_change":"2023-08-09T12:41:25.716973+0000","last_active":"2023-08-09T12:41:27.746526+0000","last_peered":"2023-08-09T12:41:27.746526+0000","last_clean":"2023-08-09T12:41:27.746526+0000","last_became_active":"2023-08-09T12:41:25.715880+0000","last_became_peered":"2023-08-09T12:41:25.715880+0000","last_unstale":"2023-08-09T12:41:27.746526+0000","last_undegraded":"2023-08-09T12:41:27.746526+0000","last_fullsized":"2023-08-09T12:41:27.746526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:20.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744139+0000","last_change":"2023-08-09T12:41:26.764083+0000","last_active":"2023-08-09T12:41:27.744139+0000","last_peered":"2023-08-09T12:41:27.744139+0000","last_clean":"2023-08-09T12:41:27.744139+0000","last_became_active":"2023-08-09T12:41:26.763662+0000","last_became_peered":"2023-08-09T12:41:26.763662+0000","last_unstale":"2023-08-09T12:41:27.744139+0000","last_undegraded":"2023-08-09T12:41:27.744139+0000","last_fullsized":"2023-08-09T12:41:27.744139+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:09.252796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.733061+0000","last_change":"2023-08-09T12:41:25.709666+0000","last_active":"2023-08-09T12:41:27.733061+0000","last_peered":"2023-08-09T12:41:27.733061+0000","last_clean":"2023-08-09T12:41:27.733061+0000","last_became_active":"2023-08-09T12:41:25.708958+0000","last_became_peered":"2023-08-09T12:41:25.708958+0000","last_unstale":"2023-08-09T12:41:27.733061+0000","last_undegraded":"2023-08-09T12:41:27.733061+0000","last_fullsized":"2023-08-09T12:41:27.733061+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:32:35.893052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736843+0000","last_change":"2023-08-09T12:41:26.753676+0000","last_active":"2023-08-09T12:41:27.736843+0000","last_peered":"2023-08-09T12:41:27.736843+0000","last_clean":"2023-08-09T12:41:27.736843+0000","last_became_active":"2023-08-09T12:41:26.752998+0000","last_became_peered":"2023-08-09T12:41:26.752998+0000","last_unstale":"2023-08-09T12:41:27.736843+0000","last_undegraded":"2023-08-09T12:41:27.736843+0000","last_fullsized":"2023-08-09T12:41:27.736843+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:08:27.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745638+0000","last_change":"2023-08-09T12:41:25.716719+0000","last_active":"2023-08-09T12:41:27.745638+0000","last_peered":"2023-08-09T12:41:27.745638+0000","last_clean":"2023-08-09T12:41:27.745638+0000","last_became_active":"2023-08-09T12:41:25.715489+0000","last_became_peered":"2023-08-09T12:41:25.715489+0000","last_unstale":"2023-08-09T12:41:27.745638+0000","last_undegraded":"2023-08-09T12:41:27.745638+0000","last_fullsized":"2023-08-09T12:41:27.745638+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:37.642088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.749262+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:41:27.749262+0000","last_peered":"2023-08-09T12:41:27.749262+0000","last_clean":"2023-08-09T12:41:27.749262+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:41:27.749262+0000","last_undegraded":"2023-08-09T12:41:27.749262+0000","last_fullsized":"2023-08-09T12:41:27.749262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:11:12.000099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748215+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:41:27.748215+0000","last_peered":"2023-08-09T12:41:27.748215+0000","last_clean":"2023-08-09T12:41:27.748215+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:41:27.748215+0000","last_undegraded":"2023-08-09T12:41:27.748215+0000","last_fullsized":"2023-08-09T12:41:27.748215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:23.260579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744003+0000","last_change":"2023-08-09T12:41:26.756024+0000","last_active":"2023-08-09T12:41:27.744003+0000","last_peered":"2023-08-09T12:41:27.744003+0000","last_clean":"2023-08-09T12:41:27.744003+0000","last_became_active":"2023-08-09T12:41:26.755595+0000","last_became_peered":"2023-08-09T12:41:26.755595+0000","last_unstale":"2023-08-09T12:41:27.744003+0000","last_undegraded":"2023-08-09T12:41:27.744003+0000","last_fullsized":"2023-08-09T12:41:27.744003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748820+0000","last_change":"2023-08-09T12:41:25.713983+0000","last_active":"2023-08-09T12:41:27.748820+0000","last_peered":"2023-08-09T12:41:27.748820+0000","last_clean":"2023-08-09T12:41:27.748820+0000","last_became_active":"2023-08-09T12:41:25.713370+0000","last_became_peered":"2023-08-09T12:41:25.713370+0000","last_unstale":"2023-08-09T12:41:27.748820+0000","last_undegraded":"2023-08-09T12:41:27.748820+0000","last_fullsized":"2023-08-09T12:41:27.748820+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:45.930068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.749060+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:41:27.749060+0000","last_peered":"2023-08-09T12:41:27.749060+0000","last_clean":"2023-08-09T12:41:27.749060+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:41:27.749060+0000","last_undegraded":"2023-08-09T12:41:27.749060+0000","last_fullsized":"2023-08-09T12:41:27.749060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:45.592041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746294+0000","last_change":"2023-08-09T12:41:26.754103+0000","last_active":"2023-08-09T12:41:27.746294+0000","last_peered":"2023-08-09T12:41:27.746294+0000","last_clean":"2023-08-09T12:41:27.746294+0000","last_became_active":"2023-08-09T12:41:26.753433+0000","last_became_peered":"2023-08-09T12:41:26.753433+0000","last_unstale":"2023-08-09T12:41:27.746294+0000","last_undegraded":"2023-08-09T12:41:27.746294+0000","last_fullsized":"2023-08-09T12:41:27.746294+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:58.995511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746612+0000","last_change":"2023-08-09T12:41:25.716511+0000","last_active":"2023-08-09T12:41:27.746612+0000","last_peered":"2023-08-09T12:41:27.746612+0000","last_clean":"2023-08-09T12:41:27.746612+0000","last_became_active":"2023-08-09T12:41:25.715140+0000","last_became_peered":"2023-08-09T12:41:25.715140+0000","last_unstale":"2023-08-09T12:41:27.746612+0000","last_undegraded":"2023-08-09T12:41:27.746612+0000","last_fullsized":"2023-08-09T12:41:27.746612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:54:31.082481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.732806+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:41:27.732806+0000","last_peered":"2023-08-09T12:41:27.732806+0000","last_clean":"2023-08-09T12:41:27.732806+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:41:27.732806+0000","last_undegraded":"2023-08-09T12:41:27.732806+0000","last_fullsized":"2023-08-09T12:41:27.732806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:23:13.116513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747606+0000","last_change":"2023-08-09T12:41:26.761325+0000","last_active":"2023-08-09T12:41:27.747606+0000","last_peered":"2023-08-09T12:41:27.747606+0000","last_clean":"2023-08-09T12:41:27.747606+0000","last_became_active":"2023-08-09T12:41:26.760426+0000","last_became_peered":"2023-08-09T12:41:26.760426+0000","last_unstale":"2023-08-09T12:41:27.747606+0000","last_undegraded":"2023-08-09T12:41:27.747606+0000","last_fullsized":"2023-08-09T12:41:27.747606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:16:14.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.737043+0000","last_change":"2023-08-09T12:41:25.723888+0000","last_active":"2023-08-09T12:41:27.737043+0000","last_peered":"2023-08-09T12:41:27.737043+0000","last_clean":"2023-08-09T12:41:27.737043+0000","last_became_active":"2023-08-09T12:41:25.723572+0000","last_became_peered":"2023-08-09T12:41:25.723572+0000","last_unstale":"2023-08-09T12:41:27.737043+0000","last_undegraded":"2023-08-09T12:41:27.737043+0000","last_fullsized":"2023-08-09T12:41:27.737043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:52.643529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746513+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:41:27.746513+0000","last_peered":"2023-08-09T12:41:27.746513+0000","last_clean":"2023-08-09T12:41:27.746513+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:41:27.746513+0000","last_undegraded":"2023-08-09T12:41:27.746513+0000","last_fullsized":"2023-08-09T12:41:27.746513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:45:06.337674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746680+0000","last_change":"2023-08-09T12:41:26.768812+0000","last_active":"2023-08-09T12:41:27.746680+0000","last_peered":"2023-08-09T12:41:27.746680+0000","last_clean":"2023-08-09T12:41:27.746680+0000","last_became_active":"2023-08-09T12:41:26.764927+0000","last_became_peered":"2023-08-09T12:41:26.764927+0000","last_unstale":"2023-08-09T12:41:27.746680+0000","last_undegraded":"2023-08-09T12:41:27.746680+0000","last_fullsized":"2023-08-09T12:41:27.746680+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:58.393906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735874+0000","last_change":"2023-08-09T12:41:25.714321+0000","last_active":"2023-08-09T12:41:27.735874+0000","last_peered":"2023-08-09T12:41:27.735874+0000","last_clean":"2023-08-09T12:41:27.735874+0000","last_became_active":"2023-08-09T12:41:25.713760+0000","last_became_peered":"2023-08-09T12:41:25.713760+0000","last_unstale":"2023-08-09T12:41:27.735874+0000","last_undegraded":"2023-08-09T12:41:27.735874+0000","last_fullsized":"2023-08-09T12:41:27.735874+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:57.389225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745242+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:41:27.745242+0000","last_peered":"2023-08-09T12:41:27.745242+0000","last_clean":"2023-08-09T12:41:27.745242+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:41:27.745242+0000","last_undegraded":"2023-08-09T12:41:27.745242+0000","last_fullsized":"2023-08-09T12:41:27.745242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:47:35.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745216+0000","last_change":"2023-08-09T12:41:26.745215+0000","last_active":"2023-08-09T12:41:27.745216+0000","last_peered":"2023-08-09T12:41:27.745216+0000","last_clean":"2023-08-09T12:41:27.745216+0000","last_became_active":"2023-08-09T12:41:26.744468+0000","last_became_peered":"2023-08-09T12:41:26.744468+0000","last_unstale":"2023-08-09T12:41:27.745216+0000","last_undegraded":"2023-08-09T12:41:27.745216+0000","last_fullsized":"2023-08-09T12:41:27.745216+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:54:32.087161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745797+0000","last_change":"2023-08-09T12:41:25.708106+0000","last_active":"2023-08-09T12:41:27.745797+0000","last_peered":"2023-08-09T12:41:27.745797+0000","last_clean":"2023-08-09T12:41:27.745797+0000","last_became_active":"2023-08-09T12:41:25.707382+0000","last_became_peered":"2023-08-09T12:41:25.707382+0000","last_unstale":"2023-08-09T12:41:27.745797+0000","last_undegraded":"2023-08-09T12:41:27.745797+0000","last_fullsized":"2023-08-09T12:41:27.745797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:12:35.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748596+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:41:27.748596+0000","last_peered":"2023-08-09T12:41:27.748596+0000","last_clean":"2023-08-09T12:41:27.748596+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:41:27.748596+0000","last_undegraded":"2023-08-09T12:41:27.748596+0000","last_fullsized":"2023-08-09T12:41:27.748596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:50.202615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745937+0000","last_change":"2023-08-09T12:41:26.764567+0000","last_active":"2023-08-09T12:41:27.745937+0000","last_peered":"2023-08-09T12:41:27.745937+0000","last_clean":"2023-08-09T12:41:27.745937+0000","last_became_active":"2023-08-09T12:41:26.764132+0000","last_became_peered":"2023-08-09T12:41:26.764132+0000","last_unstale":"2023-08-09T12:41:27.745937+0000","last_undegraded":"2023-08-09T12:41:27.745937+0000","last_fullsized":"2023-08-09T12:41:27.745937+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746105+0000","last_change":"2023-08-09T12:41:25.717417+0000","last_active":"2023-08-09T12:41:27.746105+0000","last_peered":"2023-08-09T12:41:27.746105+0000","last_clean":"2023-08-09T12:41:27.746105+0000","last_became_active":"2023-08-09T12:41:25.717148+0000","last_became_peered":"2023-08-09T12:41:25.717148+0000","last_unstale":"2023-08-09T12:41:27.746105+0000","last_undegraded":"2023-08-09T12:41:27.746105+0000","last_fullsized":"2023-08-09T12:41:27.746105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:27.876718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744674+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:41:27.744674+0000","last_peered":"2023-08-09T12:41:27.744674+0000","last_clean":"2023-08-09T12:41:27.744674+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:41:27.744674+0000","last_undegraded":"2023-08-09T12:41:27.744674+0000","last_fullsized":"2023-08-09T12:41:27.744674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:50:50.974572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747292+0000","last_change":"2023-08-09T12:41:26.758588+0000","last_active":"2023-08-09T12:41:27.747292+0000","last_peered":"2023-08-09T12:41:27.747292+0000","last_clean":"2023-08-09T12:41:27.747292+0000","last_became_active":"2023-08-09T12:41:26.757232+0000","last_became_peered":"2023-08-09T12:41:26.757232+0000","last_unstale":"2023-08-09T12:41:27.747292+0000","last_undegraded":"2023-08-09T12:41:27.747292+0000","last_fullsized":"2023-08-09T12:41:27.747292+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:48.189765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747092+0000","last_change":"2023-08-09T12:41:25.717713+0000","last_active":"2023-08-09T12:41:27.747092+0000","last_peered":"2023-08-09T12:41:27.747092+0000","last_clean":"2023-08-09T12:41:27.747092+0000","last_became_active":"2023-08-09T12:41:25.717257+0000","last_became_peered":"2023-08-09T12:41:25.717257+0000","last_unstale":"2023-08-09T12:41:27.747092+0000","last_undegraded":"2023-08-09T12:41:27.747092+0000","last_fullsized":"2023-08-09T12:41:27.747092+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:27:40.149989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.737433+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:41:27.737433+0000","last_peered":"2023-08-09T12:41:27.737433+0000","last_clean":"2023-08-09T12:41:27.737433+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:41:27.737433+0000","last_undegraded":"2023-08-09T12:41:27.737433+0000","last_fullsized":"2023-08-09T12:41:27.737433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:27:30.765020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.095,"15min":1.093},"min":{"1min":0.70599999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.454,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.079,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.1779999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.105,"15min":1.081},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8959999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0960000000000001,"15min":1.0820000000000001},"min":{"1min":0.747,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.1419999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6259999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.256},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.153,"15min":1.131},"min":{"1min":0.92500000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.637}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2310000000000001,"15min":1.2150000000000001},"min":{"1min":0.93500000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.784,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2589999999999999,"15min":1.246},"min":{"1min":0.94699999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.696,"5min":1.96,"15min":1.96},"last":1.016}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.2250000000000001,"15min":1.1990000000000001},"min":{"1min":0.92300000000000004,"5min":0.505,"15min":0.505},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.2749999999999999,"15min":1.2470000000000001},"min":{"1min":0.876,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.296}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.284,"15min":1.2589999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.4910000000000001,"15min":1.4790000000000001},"min":{"1min":0.85999999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":3.1400000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.5700000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.488,"15min":1.47},"min":{"1min":1.27,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.266,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.444},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":1.1160000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.093,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0640000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":254,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195057,"statfs":{"total":200000000,"available":199739049,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.137,"15min":1.113},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.173,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.69199999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.228,"15min":1.222},"min":{"1min":0.88800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.0009999999999999,"5min":2.306,"15min":2.306},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3220000000000001,"15min":1.3089999999999999},"min":{"1min":0.91400000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.0089999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.0960000000000001,"15min":1.083},"min":{"1min":0.83099999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.2729999999999999,"15min":1.2629999999999999},"min":{"1min":0.97699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.218}]},{"osd":3,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":1.0249999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.103},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2749999999999999,"15min":1.268},"min":{"1min":0.86199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.732,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.296,"15min":1.282},"min":{"1min":0.88900000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.327,"15min":1.3169999999999999},"min":{"1min":0.99399999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.284}]},{"osd":5,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.298,"15min":1.2989999999999999},"min":{"1min":0.96999999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.379},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.462,"15min":1.45},"min":{"1min":1.1899999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7160000000000002,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.6180000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.409,"15min":1.377},"min":{"1min":1.1180000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.579},{"interface":"front","average":{"1min":1.498,"5min":1.401,"15min":1.385},"min":{"1min":1.083,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.482}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":254,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195058,"statfs":{"total":200000000,"available":199739701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.111,"15min":1.1100000000000001},"min":{"1min":0.75600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4930000000000001,"5min":2.427,"15min":2.427},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0509999999999999,"15min":1.0349999999999999},"min":{"1min":0.73499999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.274}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.278,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.748,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.238,"15min":1.232},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6399999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1830000000000001,"15min":1.1930000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.446,"5min":1.591,"15min":1.591},"last":1.117},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.175,"15min":1.1830000000000001},"min":{"1min":0.78400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.728,"15min":1.728},"last":1.2170000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.181,"15min":1.1699999999999999},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.29,"5min":1.3620000000000001,"15min":1.3740000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.607,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.466}]},{"osd":4,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.621,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1619999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.357,"15min":1.371},"min":{"1min":0.71999999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.921,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.173}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.863,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.948,"15min":2.948},"last":1.51}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.524},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.097,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.363},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.974,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.663}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":254,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195057,"statfs":{"total":200000000,"available":199739119,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.69199999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.72,"5min":1.77,"15min":1.77},"last":1.345},{"interface":"front","average":{"1min":1.151,"5min":1.0860000000000001,"15min":1.075},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.589,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.296}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.3320000000000001,"15min":1.363},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.589,"5min":1.97,"15min":1.97},"last":1.141},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.3420000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.478}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3320000000000001,"15min":1.327},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3160000000000001,"15min":1.3100000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.611}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3320000000000001,"15min":1.3380000000000001},"min":{"1min":0.97299999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6990000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.401,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.847,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.194},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3680000000000001,"15min":1.3779999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7629999999999999,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.385}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.5009999999999999,"15min":1.52},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.8080000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.046},{"interface":"front","average":{"1min":1.49,"5min":1.5349999999999999,"15min":1.5429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.95,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.516,"15min":1.516},"min":{"1min":1.0169999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8839999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.6299999999999999,"15min":1.645},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0089999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.4199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195056,"statfs":{"total":200000000,"available":199738067,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.502},{"interface":"front","average":{"1min":0.877,"5min":0.85599999999999998,"15min":0.85199999999999998},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3759999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.875,"15min":0.85699999999999998},"min":{"1min":0.52000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.71499999999999997}]},{"osd":2,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.5680000000000001,"5min":1.893,"15min":1.893},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.55400000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6499999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.88100000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.84399999999999997,"5min":0.745,"15min":0.745},"max":{"1min":1.883,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3160000000000001,"15min":1.3380000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.708,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.355,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.6870000000000001,"5min":2.157,"15min":2.157},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2589999999999999,"15min":1.2490000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.96099999999999997}]},{"osd":6,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3169999999999999,"15min":1.3220000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.7649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7729999999999999,"5min":2.589,"15min":2.589},"last":1.2130000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.369,"15min":1.3700000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.234},{"interface":"front","average":{"1min":1.351,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.776,"5min":1.78,"15min":1.78},"last":1.008}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195056,"statfs":{"total":200000000,"available":199738089,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5329999999999999,"5min":1.716,"15min":1.716},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.179}]},{"osd":1,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0349999999999999,"15min":1.054},"min":{"1min":0.61199999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.782,"5min":1.869,"15min":1.869},"last":1.4319999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.242,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.7350000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.403,"15min":1.4039999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.2869999999999999,"15min":1.2569999999999999},"min":{"1min":0.83199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.5649999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.3660000000000001,"15min":1.3420000000000001},"min":{"1min":0.98199999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":5.0140000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.498,"15min":1.486},"min":{"1min":0.879,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":1.804}]},{"osd":6,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.298,"15min":1.288},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.27},{"interface":"front","average":{"1min":1.429,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.361}]},{"osd":7,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.351,"15min":1.347},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5269999999999999,"15min":1.5249999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.5}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":254,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195058,"statfs":{"total":200000000,"available":199739541,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85099999999999998,"15min":0.85399999999999998},"min":{"1min":0.48899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.232,"5min":1.24,"15min":1.24},"last":1.0620000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.679,"5min":1.774,"15min":1.774},"last":1.1279999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.046},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6559999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.995},{"interface":"front","average":{"1min":1.008,"5min":0.90100000000000002,"15min":0.88300000000000001},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.86199999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2669999999999999,"15min":1.264},"min":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6799999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.246}]},{"osd":5,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2609999999999999,"15min":1.2629999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.02,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.218},{"interface":"front","average":{"1min":1.343,"5min":1.2589999999999999,"15min":1.2450000000000001},"min":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.3260000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.373,"15min":1.373},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2210000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.476},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3520000000000001,"15min":1.341},"min":{"1min":0.999,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.839,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.2749999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.8049999999999999,"5min":2.294,"15min":2.294},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.413,"15min":1.413},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.1280000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.29}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149277,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2729999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.90100000000000002},"min":{"1min":0.57199999999999995,"5min":0.436,"15min":0.436},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.90900000000000003}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92800000000000005,"15min":0.92900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.373,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.59199999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.484,"5min":1.607,"15min":1.607},"last":0.76600000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86899999999999999,"15min":0.873},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.196,"5min":1.952,"15min":1.952},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.153,"15min":1.161},"min":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5860000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.002}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2829999999999999,"15min":1.302},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6080000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.6970000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2509999999999999,"15min":1.2589999999999999},"min":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3540000000000001,"15min":1.3600000000000001},"min":{"1min":0.89100000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8100000000000001,"5min":2.161,"15min":2.161},"last":1.2769999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3109999999999999,"15min":1.3},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.373,"15min":1.3819999999999999},"min":{"1min":0.90100000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.008,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.2170000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3680000000000001,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.333},{"interface":"front","average":{"1min":1.335,"5min":1.3959999999999999,"15min":1.4059999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.7150000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4119999999999999}]}]}],"pool_statfs":[]}} 2023-08-09T12:41:36.415 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:41:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.657+0000 7f80cbfff640 1 Processor -- start 2023-08-09T12:41:36.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.657+0000 7f80cbfff640 1 -- start start 2023-08-09T12:41:36.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cbfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80cc1587e0 0x7f80cc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:36.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0b0b10 0x7f80cc15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:36.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80cc15bce0 0x7f80cc0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:36.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cbfff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0715c0 con 0x7f80cc15bce0 2023-08-09T12:41:36.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cbfff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0718a0 con 0x7f80cc1587e0 2023-08-09T12:41:36.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cbfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc071b80 con 0x7f80cc0b0b10 2023-08-09T12:41:36.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80cc15bce0 0x7f80cc0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80cc15bce0 0x7f80cc0cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52068/0 (socket says 172.21.15.17:52068) 2023-08-09T12:41:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.659+0000 7f80cb7fe640 1 -- 172.21.15.17:0/3990652224 learned_addr learned my addr 172.21.15.17:0/3990652224 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.660+0000 7f80c27fc640 1 --2- 172.21.15.17:0/3990652224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0b0b10 0x7f80cc15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.660+0000 7f80caffd640 1 --2- 172.21.15.17:0/3990652224 >> v2:172.21.15.142:3300/0 conn(0x7f80cc1587e0 0x7f80cc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.660+0000 7f80cb7fe640 1 -- 172.21.15.17:0/3990652224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0b0b10 msgr2=0x7f80cc15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.660+0000 7f80cb7fe640 1 --2- 172.21.15.17:0/3990652224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0b0b10 0x7f80cc15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.660+0000 7f80cb7fe640 1 -- 172.21.15.17:0/3990652224 >> v2:172.21.15.142:3300/0 conn(0x7f80cc1587e0 msgr2=0x7f80cc070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.660+0000 7f80cb7fe640 1 --2- 172.21.15.17:0/3990652224 >> v2:172.21.15.142:3300/0 conn(0x7f80cc1587e0 0x7f80cc070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.660+0000 7f80cb7fe640 1 -- 172.21.15.17:0/3990652224 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc15b280 con 0x7f80cc15bce0 2023-08-09T12:41:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.660+0000 7f80caffd640 1 --2- 172.21.15.17:0/3990652224 >> v2:172.21.15.142:3300/0 conn(0x7f80cc1587e0 0x7f80cc070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.661+0000 7f80cb7fe640 1 --2- 172.21.15.17:0/3990652224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15bce0 0x7f80cc0cb070 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f80cc06cc50 tx=0x7f80c402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305a6b38bf01de60 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.661+0000 7f80ca7fc640 1 -- 172.21.15.17:0/3990652224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4031860 con 0x7f80cc15bce0 2023-08-09T12:41:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80ca7fc640 1 -- 172.21.15.17:0/3990652224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c40319c0 con 0x7f80cc15bce0 2023-08-09T12:41:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80ca7fc640 1 -- 172.21.15.17:0/3990652224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4031d50 con 0x7f80cc15bce0 2023-08-09T12:41:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80cbfff640 1 -- 172.21.15.17:0/3990652224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15bce0 msgr2=0x7f80cc0cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80cbfff640 1 --2- 172.21.15.17:0/3990652224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15bce0 0x7f80cc0cb070 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f80cc06cc50 tx=0x7f80c402b900 comp rx=0 tx=0).stop 2023-08-09T12:41:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80cbfff640 1 -- 172.21.15.17:0/3990652224 shutdown_connections 2023-08-09T12:41:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80cbfff640 1 --2- 172.21.15.17:0/3990652224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15bce0 0x7f80cc0cb070 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80cbfff640 1 --2- 172.21.15.17:0/3990652224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0b0b10 0x7f80cc15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80cbfff640 1 --2- 172.21.15.17:0/3990652224 >> v2:172.21.15.142:3300/0 conn(0x7f80cc1587e0 0x7f80cc070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.662+0000 7f80cbfff640 1 -- 172.21.15.17:0/3990652224 >> 172.21.15.17:0/3990652224 conn(0x7f80cc0b1d50 msgr2=0x7f80cc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.663+0000 7f80cbfff640 1 -- 172.21.15.17:0/3990652224 shutdown_connections 2023-08-09T12:41:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.663+0000 7f80cbfff640 1 -- 172.21.15.17:0/3990652224 wait complete. 2023-08-09T12:41:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.665+0000 7f80cbfff640 1 Processor -- start 2023-08-09T12:41:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.665+0000 7f80cbfff640 1 -- start start 2023-08-09T12:41:36.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.666+0000 7f80cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc0b0b10 0x7f80cc0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:36.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.666+0000 7f80cbfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80cc1587e0 0x7f80cc14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:36.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.666+0000 7f80cbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0c9d90 0x7f80cc0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:36.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.666+0000 7f80cbfff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0ca780 con 0x7f80cc0b0b10 2023-08-09T12:41:36.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.666+0000 7f80cbfff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc1f58e0 con 0x7f80cc1587e0 2023-08-09T12:41:36.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.666+0000 7f80cbfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c7580 con 0x7f80cc0c9d90 2023-08-09T12:41:36.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc0b0b10 0x7f80cc0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:36.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc0b0b10 0x7f80cc0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52084/0 (socket says 172.21.15.17:52084) 2023-08-09T12:41:36.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 -- 172.21.15.17:0/417918904 learned_addr learned my addr 172.21.15.17:0/417918904 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80c27fc640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80cc1587e0 0x7f80cc14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80cb7fe640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0c9d90 0x7f80cc0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 -- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0c9d90 msgr2=0x7f80cc0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0c9d90 0x7f80cc0ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 -- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80cc1587e0 msgr2=0x7f80cc14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80cc1587e0 0x7f80cc14cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 -- 172.21.15.17:0/417918904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40094d0 con 0x7f80cc0b0b10 2023-08-09T12:41:36.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80c27fc640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80cc1587e0 0x7f80cc14cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:36.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.667+0000 7f80caffd640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc0b0b10 0x7f80cc0c82d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00cf90 tx=0x7f80bc00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:36.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.668+0000 7f80c3fff640 1 -- 172.21.15.17:0/417918904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00d840 con 0x7f80cc0b0b10 2023-08-09T12:41:36.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.668+0000 7f80c3fff640 1 -- 172.21.15.17:0/417918904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc00d9a0 con 0x7f80cc0b0b10 2023-08-09T12:41:36.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.668+0000 7f80c3fff640 1 -- 172.21.15.17:0/417918904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00dd30 con 0x7f80cc0b0b10 2023-08-09T12:41:36.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.668+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc14d1b0 con 0x7f80cc0b0b10 2023-08-09T12:41:36.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.668+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc0c77f0 con 0x7f80cc0b0b10 2023-08-09T12:41:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.669+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc04e390 con 0x7f80cc0b0b10 2023-08-09T12:41:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.670+0000 7f80c3fff640 1 -- 172.21.15.17:0/417918904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80bc015440 con 0x7f80cc0b0b10 2023-08-09T12:41:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.672+0000 7f80c3fff640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ac06a050 0x7f80ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.672+0000 7f80c3fff640 1 -- 172.21.15.17:0/417918904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80bc088f40 con 0x7f80cc0b0b10 2023-08-09T12:41:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.672+0000 7f80c27fc640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ac06a050 0x7f80ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:36.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.673+0000 7f80c27fc640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ac06a050 0x7f80ac06c510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f80b4006fd0 tx=0x7f80b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:36.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.676+0000 7f80c3fff640 1 -- 172.21.15.17:0/417918904 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f80bc0546d0 con 0x7f80cc0b0b10 2023-08-09T12:41:36.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.870+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80cc15af70 con 0x7f80ac06a050 2023-08-09T12:41:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.893+0000 7f80c3fff640 1 -- 172.21.15.17:0/417918904 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302778 (secure 0 0 0) 0x7f80b400c040 con 0x7f80ac06a050 2023-08-09T12:41:36.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:41:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ac06a050 msgr2=0x7f80ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ac06a050 0x7f80ac06c510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f80b4006fd0 tx=0x7f80b4008040 comp rx=0 tx=0).stop 2023-08-09T12:41:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc0b0b10 msgr2=0x7f80cc0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc0b0b10 0x7f80cc0c82d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00cf90 tx=0x7f80bc00a7d0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 shutdown_connections 2023-08-09T12:41:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ac06a050 0x7f80ac06c510 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80cc0c9d90 0x7f80cc0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80cc1587e0 0x7f80cc14cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 --2- 172.21.15.17:0/417918904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc0b0b10 0x7f80cc0c82d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 >> 172.21.15.17:0/417918904 conn(0x7f80cc0b1d50 msgr2=0x7f80cc0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 shutdown_connections 2023-08-09T12:41:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:36.900+0000 7f80cbfff640 1 -- 172.21.15.17:0/417918904 wait complete. 2023-08-09T12:41:36.926 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-08-09T12:41:36.682211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559308,"statfs":{"total":1600000000,"available":1596732052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.948238"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.743985+0000","last_change":"2023-08-09T12:41:26.764950+0000","last_active":"2023-08-09T12:41:27.743985+0000","last_peered":"2023-08-09T12:41:27.743985+0000","last_clean":"2023-08-09T12:41:27.743985+0000","last_became_active":"2023-08-09T12:41:26.761904+0000","last_became_peered":"2023-08-09T12:41:26.761904+0000","last_unstale":"2023-08-09T12:41:27.743985+0000","last_undegraded":"2023-08-09T12:41:27.743985+0000","last_fullsized":"2023-08-09T12:41:27.743985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746558+0000","last_change":"2023-08-09T12:41:26.754678+0000","last_active":"2023-08-09T12:41:27.746558+0000","last_peered":"2023-08-09T12:41:27.746558+0000","last_clean":"2023-08-09T12:41:27.746558+0000","last_became_active":"2023-08-09T12:41:26.754276+0000","last_became_peered":"2023-08-09T12:41:26.754276+0000","last_unstale":"2023-08-09T12:41:27.746558+0000","last_undegraded":"2023-08-09T12:41:27.746558+0000","last_fullsized":"2023-08-09T12:41:27.746558+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:30.451415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745316+0000","last_change":"2023-08-09T12:41:26.771899+0000","last_active":"2023-08-09T12:41:27.745316+0000","last_peered":"2023-08-09T12:41:27.745316+0000","last_clean":"2023-08-09T12:41:27.745316+0000","last_became_active":"2023-08-09T12:41:26.768798+0000","last_became_peered":"2023-08-09T12:41:26.768798+0000","last_unstale":"2023-08-09T12:41:27.745316+0000","last_undegraded":"2023-08-09T12:41:27.745316+0000","last_fullsized":"2023-08-09T12:41:27.745316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:48:03.240657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748449+0000","last_change":"2023-08-09T12:41:26.748928+0000","last_active":"2023-08-09T12:41:27.748449+0000","last_peered":"2023-08-09T12:41:27.748449+0000","last_clean":"2023-08-09T12:41:27.748449+0000","last_became_active":"2023-08-09T12:41:26.748363+0000","last_became_peered":"2023-08-09T12:41:26.748363+0000","last_unstale":"2023-08-09T12:41:27.748449+0000","last_undegraded":"2023-08-09T12:41:27.748449+0000","last_fullsized":"2023-08-09T12:41:27.748449+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:41:42.640344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735674+0000","last_change":"2023-08-09T12:41:26.753475+0000","last_active":"2023-08-09T12:41:27.735674+0000","last_peered":"2023-08-09T12:41:27.735674+0000","last_clean":"2023-08-09T12:41:27.735674+0000","last_became_active":"2023-08-09T12:41:26.753219+0000","last_became_peered":"2023-08-09T12:41:26.753219+0000","last_unstale":"2023-08-09T12:41:27.735674+0000","last_undegraded":"2023-08-09T12:41:27.735674+0000","last_fullsized":"2023-08-09T12:41:27.735674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:21.262487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744410+0000","last_change":"2023-08-09T12:41:26.765111+0000","last_active":"2023-08-09T12:41:27.744410+0000","last_peered":"2023-08-09T12:41:27.744410+0000","last_clean":"2023-08-09T12:41:27.744410+0000","last_became_active":"2023-08-09T12:41:26.764512+0000","last_became_peered":"2023-08-09T12:41:26.764512+0000","last_unstale":"2023-08-09T12:41:27.744410+0000","last_undegraded":"2023-08-09T12:41:27.744410+0000","last_fullsized":"2023-08-09T12:41:27.744410+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:30.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745760+0000","last_change":"2023-08-09T12:41:26.760310+0000","last_active":"2023-08-09T12:41:27.745760+0000","last_peered":"2023-08-09T12:41:27.745760+0000","last_clean":"2023-08-09T12:41:27.745760+0000","last_became_active":"2023-08-09T12:41:26.759886+0000","last_became_peered":"2023-08-09T12:41:26.759886+0000","last_unstale":"2023-08-09T12:41:27.745760+0000","last_undegraded":"2023-08-09T12:41:27.745760+0000","last_fullsized":"2023-08-09T12:41:27.745760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:48.342228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745937+0000","last_change":"2023-08-09T12:41:26.764924+0000","last_active":"2023-08-09T12:41:27.745937+0000","last_peered":"2023-08-09T12:41:27.745937+0000","last_clean":"2023-08-09T12:41:27.745937+0000","last_became_active":"2023-08-09T12:41:26.764684+0000","last_became_peered":"2023-08-09T12:41:26.764684+0000","last_unstale":"2023-08-09T12:41:27.745937+0000","last_undegraded":"2023-08-09T12:41:27.745937+0000","last_fullsized":"2023-08-09T12:41:27.745937+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:55.797229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744863+0000","last_change":"2023-08-09T12:41:26.766387+0000","last_active":"2023-08-09T12:41:27.744863+0000","last_peered":"2023-08-09T12:41:27.744863+0000","last_clean":"2023-08-09T12:41:27.744863+0000","last_became_active":"2023-08-09T12:41:26.765392+0000","last_became_peered":"2023-08-09T12:41:26.765392+0000","last_unstale":"2023-08-09T12:41:27.744863+0000","last_undegraded":"2023-08-09T12:41:27.744863+0000","last_fullsized":"2023-08-09T12:41:27.744863+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:30.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744912+0000","last_change":"2023-08-09T12:41:26.763625+0000","last_active":"2023-08-09T12:41:27.744912+0000","last_peered":"2023-08-09T12:41:27.744912+0000","last_clean":"2023-08-09T12:41:27.744912+0000","last_became_active":"2023-08-09T12:41:26.761764+0000","last_became_peered":"2023-08-09T12:41:26.761764+0000","last_unstale":"2023-08-09T12:41:27.744912+0000","last_undegraded":"2023-08-09T12:41:27.744912+0000","last_fullsized":"2023-08-09T12:41:27.744912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:42:19.095765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.732582+0000","last_change":"2023-08-09T12:41:26.751660+0000","last_active":"2023-08-09T12:41:27.732582+0000","last_peered":"2023-08-09T12:41:27.732582+0000","last_clean":"2023-08-09T12:41:27.732582+0000","last_became_active":"2023-08-09T12:41:26.751076+0000","last_became_peered":"2023-08-09T12:41:26.751076+0000","last_unstale":"2023-08-09T12:41:27.732582+0000","last_undegraded":"2023-08-09T12:41:27.732582+0000","last_fullsized":"2023-08-09T12:41:27.732582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:38:59.971994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746489+0000","last_change":"2023-08-09T12:41:26.744068+0000","last_active":"2023-08-09T12:41:27.746489+0000","last_peered":"2023-08-09T12:41:27.746489+0000","last_clean":"2023-08-09T12:41:27.746489+0000","last_became_active":"2023-08-09T12:41:26.742814+0000","last_became_peered":"2023-08-09T12:41:26.742814+0000","last_unstale":"2023-08-09T12:41:27.746489+0000","last_undegraded":"2023-08-09T12:41:27.746489+0000","last_fullsized":"2023-08-09T12:41:27.746489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:05.468987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744234+0000","last_change":"2023-08-09T12:41:26.761316+0000","last_active":"2023-08-09T12:41:27.744234+0000","last_peered":"2023-08-09T12:41:27.744234+0000","last_clean":"2023-08-09T12:41:27.744234+0000","last_became_active":"2023-08-09T12:41:26.761042+0000","last_became_peered":"2023-08-09T12:41:26.761042+0000","last_unstale":"2023-08-09T12:41:27.744234+0000","last_undegraded":"2023-08-09T12:41:27.744234+0000","last_fullsized":"2023-08-09T12:41:27.744234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:55.143338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745170+0000","last_change":"2023-08-09T12:41:26.770725+0000","last_active":"2023-08-09T12:41:27.745170+0000","last_peered":"2023-08-09T12:41:27.745170+0000","last_clean":"2023-08-09T12:41:27.745170+0000","last_became_active":"2023-08-09T12:41:26.769312+0000","last_became_peered":"2023-08-09T12:41:26.769312+0000","last_unstale":"2023-08-09T12:41:27.745170+0000","last_undegraded":"2023-08-09T12:41:27.745170+0000","last_fullsized":"2023-08-09T12:41:27.745170+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:34.058833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747875+0000","last_change":"2023-08-09T12:41:26.741311+0000","last_active":"2023-08-09T12:41:27.747875+0000","last_peered":"2023-08-09T12:41:27.747875+0000","last_clean":"2023-08-09T12:41:27.747875+0000","last_became_active":"2023-08-09T12:41:26.740668+0000","last_became_peered":"2023-08-09T12:41:26.740668+0000","last_unstale":"2023-08-09T12:41:27.747875+0000","last_undegraded":"2023-08-09T12:41:27.747875+0000","last_fullsized":"2023-08-09T12:41:27.747875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:31:35.468025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744179+0000","last_change":"2023-08-09T12:41:26.759774+0000","last_active":"2023-08-09T12:41:27.744179+0000","last_peered":"2023-08-09T12:41:27.744179+0000","last_clean":"2023-08-09T12:41:27.744179+0000","last_became_active":"2023-08-09T12:41:26.759517+0000","last_became_peered":"2023-08-09T12:41:26.759517+0000","last_unstale":"2023-08-09T12:41:27.744179+0000","last_undegraded":"2023-08-09T12:41:27.744179+0000","last_fullsized":"2023-08-09T12:41:27.744179+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:57.682884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746304+0000","last_change":"2023-08-09T12:41:26.757501+0000","last_active":"2023-08-09T12:41:27.746304+0000","last_peered":"2023-08-09T12:41:27.746304+0000","last_clean":"2023-08-09T12:41:27.746304+0000","last_became_active":"2023-08-09T12:41:26.757260+0000","last_became_peered":"2023-08-09T12:41:26.757260+0000","last_unstale":"2023-08-09T12:41:27.746304+0000","last_undegraded":"2023-08-09T12:41:27.746304+0000","last_fullsized":"2023-08-09T12:41:27.746304+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:55.143338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747023+0000","last_change":"2023-08-09T12:41:26.752877+0000","last_active":"2023-08-09T12:41:27.747023+0000","last_peered":"2023-08-09T12:41:27.747023+0000","last_clean":"2023-08-09T12:41:27.747023+0000","last_became_active":"2023-08-09T12:41:26.752230+0000","last_became_peered":"2023-08-09T12:41:26.752230+0000","last_unstale":"2023-08-09T12:41:27.747023+0000","last_undegraded":"2023-08-09T12:41:27.747023+0000","last_fullsized":"2023-08-09T12:41:27.747023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:25:34.295755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744994+0000","last_change":"2023-08-09T12:41:26.770453+0000","last_active":"2023-08-09T12:41:27.744994+0000","last_peered":"2023-08-09T12:41:27.744994+0000","last_clean":"2023-08-09T12:41:27.744994+0000","last_became_active":"2023-08-09T12:41:26.765123+0000","last_became_peered":"2023-08-09T12:41:26.765123+0000","last_unstale":"2023-08-09T12:41:27.744994+0000","last_undegraded":"2023-08-09T12:41:27.744994+0000","last_fullsized":"2023-08-09T12:41:27.744994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:35:48.443783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736471+0000","last_change":"2023-08-09T12:41:26.755290+0000","last_active":"2023-08-09T12:41:27.736471+0000","last_peered":"2023-08-09T12:41:27.736471+0000","last_clean":"2023-08-09T12:41:27.736471+0000","last_became_active":"2023-08-09T12:41:26.753410+0000","last_became_peered":"2023-08-09T12:41:26.753410+0000","last_unstale":"2023-08-09T12:41:27.736471+0000","last_undegraded":"2023-08-09T12:41:27.736471+0000","last_fullsized":"2023-08-09T12:41:27.736471+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:06:35.056746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735925+0000","last_change":"2023-08-09T12:41:26.758273+0000","last_active":"2023-08-09T12:41:27.735925+0000","last_peered":"2023-08-09T12:41:27.735925+0000","last_clean":"2023-08-09T12:41:27.735925+0000","last_became_active":"2023-08-09T12:41:26.753618+0000","last_became_peered":"2023-08-09T12:41:26.753618+0000","last_unstale":"2023-08-09T12:41:27.735925+0000","last_undegraded":"2023-08-09T12:41:27.735925+0000","last_fullsized":"2023-08-09T12:41:27.735925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:36:01.417546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746658+0000","last_change":"2023-08-09T12:41:26.762381+0000","last_active":"2023-08-09T12:41:27.746658+0000","last_peered":"2023-08-09T12:41:27.746658+0000","last_clean":"2023-08-09T12:41:27.746658+0000","last_became_active":"2023-08-09T12:41:26.761594+0000","last_became_peered":"2023-08-09T12:41:26.761594+0000","last_unstale":"2023-08-09T12:41:27.746658+0000","last_undegraded":"2023-08-09T12:41:27.746658+0000","last_fullsized":"2023-08-09T12:41:27.746658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:59.796627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.732505+0000","last_change":"2023-08-09T12:41:26.753387+0000","last_active":"2023-08-09T12:41:27.732505+0000","last_peered":"2023-08-09T12:41:27.732505+0000","last_clean":"2023-08-09T12:41:27.732505+0000","last_became_active":"2023-08-09T12:41:26.752651+0000","last_became_peered":"2023-08-09T12:41:26.752651+0000","last_unstale":"2023-08-09T12:41:27.732505+0000","last_undegraded":"2023-08-09T12:41:27.732505+0000","last_fullsized":"2023-08-09T12:41:27.732505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:38.407498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745316+0000","last_change":"2023-08-09T12:41:26.769784+0000","last_active":"2023-08-09T12:41:27.745316+0000","last_peered":"2023-08-09T12:41:27.745316+0000","last_clean":"2023-08-09T12:41:27.745316+0000","last_became_active":"2023-08-09T12:41:26.764774+0000","last_became_peered":"2023-08-09T12:41:26.764774+0000","last_unstale":"2023-08-09T12:41:27.745316+0000","last_undegraded":"2023-08-09T12:41:27.745316+0000","last_fullsized":"2023-08-09T12:41:27.745316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:03:40.448213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745915+0000","last_change":"2023-08-09T12:41:26.758794+0000","last_active":"2023-08-09T12:41:27.745915+0000","last_peered":"2023-08-09T12:41:27.745915+0000","last_clean":"2023-08-09T12:41:27.745915+0000","last_became_active":"2023-08-09T12:41:26.758550+0000","last_became_peered":"2023-08-09T12:41:26.758550+0000","last_unstale":"2023-08-09T12:41:27.745915+0000","last_undegraded":"2023-08-09T12:41:27.745915+0000","last_fullsized":"2023-08-09T12:41:27.745915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:54:26.183011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745952+0000","last_change":"2023-08-09T12:41:26.742962+0000","last_active":"2023-08-09T12:41:27.745952+0000","last_peered":"2023-08-09T12:41:27.745952+0000","last_clean":"2023-08-09T12:41:27.745952+0000","last_became_active":"2023-08-09T12:41:26.742314+0000","last_became_peered":"2023-08-09T12:41:26.742314+0000","last_unstale":"2023-08-09T12:41:27.745952+0000","last_undegraded":"2023-08-09T12:41:27.745952+0000","last_fullsized":"2023-08-09T12:41:27.745952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:43.131822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.743905+0000","last_change":"2023-08-09T12:41:26.758675+0000","last_active":"2023-08-09T12:41:27.743905+0000","last_peered":"2023-08-09T12:41:27.743905+0000","last_clean":"2023-08-09T12:41:27.743905+0000","last_became_active":"2023-08-09T12:41:26.758428+0000","last_became_peered":"2023-08-09T12:41:26.758428+0000","last_unstale":"2023-08-09T12:41:27.743905+0000","last_undegraded":"2023-08-09T12:41:27.743905+0000","last_fullsized":"2023-08-09T12:41:27.743905+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:48.342228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.737139+0000","last_change":"2023-08-09T12:41:26.742817+0000","last_active":"2023-08-09T12:41:27.737139+0000","last_peered":"2023-08-09T12:41:27.737139+0000","last_clean":"2023-08-09T12:41:27.737139+0000","last_became_active":"2023-08-09T12:41:26.742199+0000","last_became_peered":"2023-08-09T12:41:26.742199+0000","last_unstale":"2023-08-09T12:41:27.737139+0000","last_undegraded":"2023-08-09T12:41:27.737139+0000","last_fullsized":"2023-08-09T12:41:27.737139+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:13.939226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745460+0000","last_change":"2023-08-09T12:41:26.769569+0000","last_active":"2023-08-09T12:41:27.745460+0000","last_peered":"2023-08-09T12:41:27.745460+0000","last_clean":"2023-08-09T12:41:27.745460+0000","last_became_active":"2023-08-09T12:41:26.764108+0000","last_became_peered":"2023-08-09T12:41:26.764108+0000","last_unstale":"2023-08-09T12:41:27.745460+0000","last_undegraded":"2023-08-09T12:41:27.745460+0000","last_fullsized":"2023-08-09T12:41:27.745460+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:21:04.261477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748245+0000","last_change":"2023-08-09T12:41:26.759612+0000","last_active":"2023-08-09T12:41:27.748245+0000","last_peered":"2023-08-09T12:41:27.748245+0000","last_clean":"2023-08-09T12:41:27.748245+0000","last_became_active":"2023-08-09T12:41:26.759326+0000","last_became_peered":"2023-08-09T12:41:26.759326+0000","last_unstale":"2023-08-09T12:41:27.748245+0000","last_undegraded":"2023-08-09T12:41:27.748245+0000","last_fullsized":"2023-08-09T12:41:27.748245+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:35:31.854435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745766+0000","last_change":"2023-08-09T12:41:26.762947+0000","last_active":"2023-08-09T12:41:27.745766+0000","last_peered":"2023-08-09T12:41:27.745766+0000","last_clean":"2023-08-09T12:41:27.745766+0000","last_became_active":"2023-08-09T12:41:26.762680+0000","last_became_peered":"2023-08-09T12:41:26.762680+0000","last_unstale":"2023-08-09T12:41:27.745766+0000","last_undegraded":"2023-08-09T12:41:27.745766+0000","last_fullsized":"2023-08-09T12:41:27.745766+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:41.857557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745592+0000","last_change":"2023-08-09T12:41:26.760698+0000","last_active":"2023-08-09T12:41:27.745592+0000","last_peered":"2023-08-09T12:41:27.745592+0000","last_clean":"2023-08-09T12:41:27.745592+0000","last_became_active":"2023-08-09T12:41:26.760285+0000","last_became_peered":"2023-08-09T12:41:26.760285+0000","last_unstale":"2023-08-09T12:41:27.745592+0000","last_undegraded":"2023-08-09T12:41:27.745592+0000","last_fullsized":"2023-08-09T12:41:27.745592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:39:40.762939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747738+0000","last_change":"2023-08-09T12:41:26.754093+0000","last_active":"2023-08-09T12:41:27.747738+0000","last_peered":"2023-08-09T12:41:27.747738+0000","last_clean":"2023-08-09T12:41:27.747738+0000","last_became_active":"2023-08-09T12:41:26.752605+0000","last_became_peered":"2023-08-09T12:41:26.752605+0000","last_unstale":"2023-08-09T12:41:27.747738+0000","last_undegraded":"2023-08-09T12:41:27.747738+0000","last_fullsized":"2023-08-09T12:41:27.747738+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:46:54.447247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.737556+0000","last_change":"2023-08-09T12:41:25.721830+0000","last_active":"2023-08-09T12:41:27.737556+0000","last_peered":"2023-08-09T12:41:27.737556+0000","last_clean":"2023-08-09T12:41:27.737556+0000","last_became_active":"2023-08-09T12:41:25.721477+0000","last_became_peered":"2023-08-09T12:41:25.721477+0000","last_unstale":"2023-08-09T12:41:27.737556+0000","last_undegraded":"2023-08-09T12:41:27.737556+0000","last_fullsized":"2023-08-09T12:41:27.737556+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:32.253017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745997+0000","last_change":"2023-08-09T12:41:26.752060+0000","last_active":"2023-08-09T12:41:27.745997+0000","last_peered":"2023-08-09T12:41:27.745997+0000","last_clean":"2023-08-09T12:41:27.745997+0000","last_became_active":"2023-08-09T12:41:26.751292+0000","last_became_peered":"2023-08-09T12:41:26.751292+0000","last_unstale":"2023-08-09T12:41:27.745997+0000","last_undegraded":"2023-08-09T12:41:27.745997+0000","last_fullsized":"2023-08-09T12:41:27.745997+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:14.075784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.743840+0000","last_change":"2023-08-09T12:41:25.718240+0000","last_active":"2023-08-09T12:41:27.743840+0000","last_peered":"2023-08-09T12:41:27.743840+0000","last_clean":"2023-08-09T12:41:27.743840+0000","last_became_active":"2023-08-09T12:41:25.717916+0000","last_became_peered":"2023-08-09T12:41:25.717916+0000","last_unstale":"2023-08-09T12:41:27.743840+0000","last_undegraded":"2023-08-09T12:41:27.743840+0000","last_fullsized":"2023-08-09T12:41:27.743840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:40.852877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736303+0000","last_change":"2023-08-09T12:41:26.754052+0000","last_active":"2023-08-09T12:41:27.736303+0000","last_peered":"2023-08-09T12:41:27.736303+0000","last_clean":"2023-08-09T12:41:27.736303+0000","last_became_active":"2023-08-09T12:41:26.752928+0000","last_became_peered":"2023-08-09T12:41:26.752928+0000","last_unstale":"2023-08-09T12:41:27.736303+0000","last_undegraded":"2023-08-09T12:41:27.736303+0000","last_fullsized":"2023-08-09T12:41:27.736303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:49:42.178293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745092+0000","last_change":"2023-08-09T12:41:25.719346+0000","last_active":"2023-08-09T12:41:27.745092+0000","last_peered":"2023-08-09T12:41:27.745092+0000","last_clean":"2023-08-09T12:41:27.745092+0000","last_became_active":"2023-08-09T12:41:25.719015+0000","last_became_peered":"2023-08-09T12:41:25.719015+0000","last_unstale":"2023-08-09T12:41:27.745092+0000","last_undegraded":"2023-08-09T12:41:27.745092+0000","last_fullsized":"2023-08-09T12:41:27.745092+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:54.792549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746484+0000","last_change":"2023-08-09T12:41:26.743217+0000","last_active":"2023-08-09T12:41:27.746484+0000","last_peered":"2023-08-09T12:41:27.746484+0000","last_clean":"2023-08-09T12:41:27.746484+0000","last_became_active":"2023-08-09T12:41:26.742517+0000","last_became_peered":"2023-08-09T12:41:26.742517+0000","last_unstale":"2023-08-09T12:41:27.746484+0000","last_undegraded":"2023-08-09T12:41:27.746484+0000","last_fullsized":"2023-08-09T12:41:27.746484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:03.385956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747908+0000","last_change":"2023-08-09T12:41:25.722114+0000","last_active":"2023-08-09T12:41:27.747908+0000","last_peered":"2023-08-09T12:41:27.747908+0000","last_clean":"2023-08-09T12:41:27.747908+0000","last_became_active":"2023-08-09T12:41:25.721669+0000","last_became_peered":"2023-08-09T12:41:25.721669+0000","last_unstale":"2023-08-09T12:41:27.747908+0000","last_undegraded":"2023-08-09T12:41:27.747908+0000","last_fullsized":"2023-08-09T12:41:27.747908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:54:46.850648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735417+0000","last_change":"2023-08-09T12:41:26.770070+0000","last_active":"2023-08-09T12:41:27.735417+0000","last_peered":"2023-08-09T12:41:27.735417+0000","last_clean":"2023-08-09T12:41:27.735417+0000","last_became_active":"2023-08-09T12:41:26.769738+0000","last_became_peered":"2023-08-09T12:41:26.769738+0000","last_unstale":"2023-08-09T12:41:27.735417+0000","last_undegraded":"2023-08-09T12:41:27.735417+0000","last_fullsized":"2023-08-09T12:41:27.735417+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:01:55.143338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746469+0000","last_change":"2023-08-09T12:41:25.722107+0000","last_active":"2023-08-09T12:41:27.746469+0000","last_peered":"2023-08-09T12:41:27.746469+0000","last_clean":"2023-08-09T12:41:27.746469+0000","last_became_active":"2023-08-09T12:41:25.721515+0000","last_became_peered":"2023-08-09T12:41:25.721515+0000","last_unstale":"2023-08-09T12:41:27.746469+0000","last_undegraded":"2023-08-09T12:41:27.746469+0000","last_fullsized":"2023-08-09T12:41:27.746469+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:29.146917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747398+0000","last_change":"2023-08-09T12:41:26.761679+0000","last_active":"2023-08-09T12:41:27.747398+0000","last_peered":"2023-08-09T12:41:27.747398+0000","last_clean":"2023-08-09T12:41:27.747398+0000","last_became_active":"2023-08-09T12:41:26.761434+0000","last_became_peered":"2023-08-09T12:41:26.761434+0000","last_unstale":"2023-08-09T12:41:27.747398+0000","last_undegraded":"2023-08-09T12:41:27.747398+0000","last_fullsized":"2023-08-09T12:41:27.747398+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:25:56.061494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735521+0000","last_change":"2023-08-09T12:41:25.720698+0000","last_active":"2023-08-09T12:41:27.735521+0000","last_peered":"2023-08-09T12:41:27.735521+0000","last_clean":"2023-08-09T12:41:27.735521+0000","last_became_active":"2023-08-09T12:41:25.720198+0000","last_became_peered":"2023-08-09T12:41:25.720198+0000","last_unstale":"2023-08-09T12:41:27.735521+0000","last_undegraded":"2023-08-09T12:41:27.735521+0000","last_fullsized":"2023-08-09T12:41:27.735521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:29.146917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746927+0000","last_change":"2023-08-09T12:41:26.743459+0000","last_active":"2023-08-09T12:41:27.746927+0000","last_peered":"2023-08-09T12:41:27.746927+0000","last_clean":"2023-08-09T12:41:27.746927+0000","last_became_active":"2023-08-09T12:41:26.741850+0000","last_became_peered":"2023-08-09T12:41:26.741850+0000","last_unstale":"2023-08-09T12:41:27.746927+0000","last_undegraded":"2023-08-09T12:41:27.746927+0000","last_fullsized":"2023-08-09T12:41:27.746927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:26.147074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736362+0000","last_change":"2023-08-09T12:41:25.718176+0000","last_active":"2023-08-09T12:41:27.736362+0000","last_peered":"2023-08-09T12:41:27.736362+0000","last_clean":"2023-08-09T12:41:27.736362+0000","last_became_active":"2023-08-09T12:41:25.717644+0000","last_became_peered":"2023-08-09T12:41:25.717644+0000","last_unstale":"2023-08-09T12:41:27.736362+0000","last_undegraded":"2023-08-09T12:41:27.736362+0000","last_fullsized":"2023-08-09T12:41:27.736362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:33.908881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747397+0000","last_change":"2023-08-09T12:41:26.756431+0000","last_active":"2023-08-09T12:41:27.747397+0000","last_peered":"2023-08-09T12:41:27.747397+0000","last_clean":"2023-08-09T12:41:27.747397+0000","last_became_active":"2023-08-09T12:41:26.755532+0000","last_became_peered":"2023-08-09T12:41:26.755532+0000","last_unstale":"2023-08-09T12:41:27.747397+0000","last_undegraded":"2023-08-09T12:41:27.747397+0000","last_fullsized":"2023-08-09T12:41:27.747397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:55:58.410290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746268+0000","last_change":"2023-08-09T12:41:25.722201+0000","last_active":"2023-08-09T12:41:27.746268+0000","last_peered":"2023-08-09T12:41:27.746268+0000","last_clean":"2023-08-09T12:41:27.746268+0000","last_became_active":"2023-08-09T12:41:25.721923+0000","last_became_peered":"2023-08-09T12:41:25.721923+0000","last_unstale":"2023-08-09T12:41:27.746268+0000","last_undegraded":"2023-08-09T12:41:27.746268+0000","last_fullsized":"2023-08-09T12:41:27.746268+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:56.678204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736198+0000","last_change":"2023-08-09T12:41:26.757770+0000","last_active":"2023-08-09T12:41:27.736198+0000","last_peered":"2023-08-09T12:41:27.736198+0000","last_clean":"2023-08-09T12:41:27.736198+0000","last_became_active":"2023-08-09T12:41:26.757533+0000","last_became_peered":"2023-08-09T12:41:26.757533+0000","last_unstale":"2023-08-09T12:41:27.736198+0000","last_undegraded":"2023-08-09T12:41:27.736198+0000","last_fullsized":"2023-08-09T12:41:27.736198+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:42:19.095765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747865+0000","last_change":"2023-08-09T12:41:25.709057+0000","last_active":"2023-08-09T12:41:27.747865+0000","last_peered":"2023-08-09T12:41:27.747865+0000","last_clean":"2023-08-09T12:41:27.747865+0000","last_became_active":"2023-08-09T12:41:25.708378+0000","last_became_peered":"2023-08-09T12:41:25.708378+0000","last_unstale":"2023-08-09T12:41:27.747865+0000","last_undegraded":"2023-08-09T12:41:27.747865+0000","last_fullsized":"2023-08-09T12:41:27.747865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:00:16.246754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745465+0000","last_change":"2023-08-09T12:41:26.752598+0000","last_active":"2023-08-09T12:41:27.745465+0000","last_peered":"2023-08-09T12:41:27.745465+0000","last_clean":"2023-08-09T12:41:27.745465+0000","last_became_active":"2023-08-09T12:41:26.752197+0000","last_became_peered":"2023-08-09T12:41:26.752197+0000","last_unstale":"2023-08-09T12:41:27.745465+0000","last_undegraded":"2023-08-09T12:41:27.745465+0000","last_fullsized":"2023-08-09T12:41:27.745465+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:22:35.994574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735815+0000","last_change":"2023-08-09T12:41:25.710502+0000","last_active":"2023-08-09T12:41:27.735815+0000","last_peered":"2023-08-09T12:41:27.735815+0000","last_clean":"2023-08-09T12:41:27.735815+0000","last_became_active":"2023-08-09T12:41:25.709843+0000","last_became_peered":"2023-08-09T12:41:25.709843+0000","last_unstale":"2023-08-09T12:41:27.735815+0000","last_undegraded":"2023-08-09T12:41:27.735815+0000","last_fullsized":"2023-08-09T12:41:27.735815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:54:31.082481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745170+0000","last_change":"2023-08-09T12:41:26.770395+0000","last_active":"2023-08-09T12:41:27.745170+0000","last_peered":"2023-08-09T12:41:27.745170+0000","last_clean":"2023-08-09T12:41:27.745170+0000","last_became_active":"2023-08-09T12:41:26.768369+0000","last_became_peered":"2023-08-09T12:41:26.768369+0000","last_unstale":"2023-08-09T12:41:27.745170+0000","last_undegraded":"2023-08-09T12:41:27.745170+0000","last_fullsized":"2023-08-09T12:41:27.745170+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:13:01.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748039+0000","last_change":"2023-08-09T12:41:25.719290+0000","last_active":"2023-08-09T12:41:27.748039+0000","last_peered":"2023-08-09T12:41:27.748039+0000","last_clean":"2023-08-09T12:41:27.748039+0000","last_became_active":"2023-08-09T12:41:25.718919+0000","last_became_peered":"2023-08-09T12:41:25.718919+0000","last_unstale":"2023-08-09T12:41:27.748039+0000","last_undegraded":"2023-08-09T12:41:27.748039+0000","last_fullsized":"2023-08-09T12:41:27.748039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:46.305340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735230+0000","last_change":"2023-08-09T12:41:26.760937+0000","last_active":"2023-08-09T12:41:27.735230+0000","last_peered":"2023-08-09T12:41:27.735230+0000","last_clean":"2023-08-09T12:41:27.735230+0000","last_became_active":"2023-08-09T12:41:26.760393+0000","last_became_peered":"2023-08-09T12:41:26.760393+0000","last_unstale":"2023-08-09T12:41:27.735230+0000","last_undegraded":"2023-08-09T12:41:27.735230+0000","last_fullsized":"2023-08-09T12:41:27.735230+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:57.682884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745720+0000","last_change":"2023-08-09T12:41:25.720123+0000","last_active":"2023-08-09T12:41:27.745720+0000","last_peered":"2023-08-09T12:41:27.745720+0000","last_clean":"2023-08-09T12:41:27.745720+0000","last_became_active":"2023-08-09T12:41:25.719183+0000","last_became_peered":"2023-08-09T12:41:25.719183+0000","last_unstale":"2023-08-09T12:41:27.745720+0000","last_undegraded":"2023-08-09T12:41:27.745720+0000","last_fullsized":"2023-08-09T12:41:27.745720+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:42:18.091085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746938+0000","last_change":"2023-08-09T12:41:26.758726+0000","last_active":"2023-08-09T12:41:27.746938+0000","last_peered":"2023-08-09T12:41:27.746938+0000","last_clean":"2023-08-09T12:41:27.746938+0000","last_became_active":"2023-08-09T12:41:26.757570+0000","last_became_peered":"2023-08-09T12:41:26.757570+0000","last_unstale":"2023-08-09T12:41:27.746938+0000","last_undegraded":"2023-08-09T12:41:27.746938+0000","last_fullsized":"2023-08-09T12:41:27.746938+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:08:32.383305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746399+0000","last_change":"2023-08-09T12:41:25.716255+0000","last_active":"2023-08-09T12:41:27.746399+0000","last_peered":"2023-08-09T12:41:27.746399+0000","last_clean":"2023-08-09T12:41:27.746399+0000","last_became_active":"2023-08-09T12:41:25.714648+0000","last_became_peered":"2023-08-09T12:41:25.714648+0000","last_unstale":"2023-08-09T12:41:27.746399+0000","last_undegraded":"2023-08-09T12:41:27.746399+0000","last_fullsized":"2023-08-09T12:41:27.746399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:27:43.107314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746140+0000","last_change":"2023-08-09T12:41:26.768542+0000","last_active":"2023-08-09T12:41:27.746140+0000","last_peered":"2023-08-09T12:41:27.746140+0000","last_clean":"2023-08-09T12:41:27.746140+0000","last_became_active":"2023-08-09T12:41:26.764590+0000","last_became_peered":"2023-08-09T12:41:26.764590+0000","last_unstale":"2023-08-09T12:41:27.746140+0000","last_undegraded":"2023-08-09T12:41:27.746140+0000","last_fullsized":"2023-08-09T12:41:27.746140+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:09.252796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736636+0000","last_change":"2023-08-09T12:41:25.723688+0000","last_active":"2023-08-09T12:41:27.736636+0000","last_peered":"2023-08-09T12:41:27.736636+0000","last_clean":"2023-08-09T12:41:27.736636+0000","last_became_active":"2023-08-09T12:41:25.723451+0000","last_became_peered":"2023-08-09T12:41:25.723451+0000","last_unstale":"2023-08-09T12:41:27.736636+0000","last_undegraded":"2023-08-09T12:41:27.736636+0000","last_fullsized":"2023-08-09T12:41:27.736636+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:39.093221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745035+0000","last_change":"2023-08-09T12:41:26.743468+0000","last_active":"2023-08-09T12:41:27.745035+0000","last_peered":"2023-08-09T12:41:27.745035+0000","last_clean":"2023-08-09T12:41:27.745035+0000","last_became_active":"2023-08-09T12:41:26.742242+0000","last_became_peered":"2023-08-09T12:41:26.742242+0000","last_unstale":"2023-08-09T12:41:27.745035+0000","last_undegraded":"2023-08-09T12:41:27.745035+0000","last_fullsized":"2023-08-09T12:41:27.745035+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:21.262487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746885+0000","last_change":"2023-08-09T12:41:25.722103+0000","last_active":"2023-08-09T12:41:27.746885+0000","last_peered":"2023-08-09T12:41:27.746885+0000","last_clean":"2023-08-09T12:41:27.746885+0000","last_became_active":"2023-08-09T12:41:25.721815+0000","last_became_peered":"2023-08-09T12:41:25.721815+0000","last_unstale":"2023-08-09T12:41:27.746885+0000","last_undegraded":"2023-08-09T12:41:27.746885+0000","last_fullsized":"2023-08-09T12:41:27.746885+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:33:26.752391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744994+0000","last_change":"2023-08-09T12:41:26.772127+0000","last_active":"2023-08-09T12:41:27.744994+0000","last_peered":"2023-08-09T12:41:27.744994+0000","last_clean":"2023-08-09T12:41:27.744994+0000","last_became_active":"2023-08-09T12:41:26.769642+0000","last_became_peered":"2023-08-09T12:41:26.769642+0000","last_unstale":"2023-08-09T12:41:27.744994+0000","last_undegraded":"2023-08-09T12:41:27.744994+0000","last_fullsized":"2023-08-09T12:41:27.744994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:40:26.483781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746159+0000","last_change":"2023-08-09T12:41:25.719684+0000","last_active":"2023-08-09T12:41:27.746159+0000","last_peered":"2023-08-09T12:41:27.746159+0000","last_clean":"2023-08-09T12:41:27.746159+0000","last_became_active":"2023-08-09T12:41:25.719316+0000","last_became_peered":"2023-08-09T12:41:25.719316+0000","last_unstale":"2023-08-09T12:41:27.746159+0000","last_undegraded":"2023-08-09T12:41:27.746159+0000","last_fullsized":"2023-08-09T12:41:27.746159+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:12:41.280334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745474+0000","last_change":"2023-08-09T12:41:26.758613+0000","last_active":"2023-08-09T12:41:27.745474+0000","last_peered":"2023-08-09T12:41:27.745474+0000","last_clean":"2023-08-09T12:41:27.745474+0000","last_became_active":"2023-08-09T12:41:26.758211+0000","last_became_peered":"2023-08-09T12:41:26.758211+0000","last_unstale":"2023-08-09T12:41:27.745474+0000","last_undegraded":"2023-08-09T12:41:27.745474+0000","last_fullsized":"2023-08-09T12:41:27.745474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:58.393906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745600+0000","last_change":"2023-08-09T12:41:25.721784+0000","last_active":"2023-08-09T12:41:27.745600+0000","last_peered":"2023-08-09T12:41:27.745600+0000","last_clean":"2023-08-09T12:41:27.745600+0000","last_became_active":"2023-08-09T12:41:25.721531+0000","last_became_peered":"2023-08-09T12:41:25.721531+0000","last_unstale":"2023-08-09T12:41:27.745600+0000","last_undegraded":"2023-08-09T12:41:27.745600+0000","last_fullsized":"2023-08-09T12:41:27.745600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:46.790963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744386+0000","last_change":"2023-08-09T12:41:26.771737+0000","last_active":"2023-08-09T12:41:27.744386+0000","last_peered":"2023-08-09T12:41:27.744386+0000","last_clean":"2023-08-09T12:41:27.744386+0000","last_became_active":"2023-08-09T12:41:26.771488+0000","last_became_peered":"2023-08-09T12:41:26.771488+0000","last_unstale":"2023-08-09T12:41:27.744386+0000","last_undegraded":"2023-08-09T12:41:27.744386+0000","last_fullsized":"2023-08-09T12:41:27.744386+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:27:44.111994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.732870+0000","last_change":"2023-08-09T12:41:25.709300+0000","last_active":"2023-08-09T12:41:27.732870+0000","last_peered":"2023-08-09T12:41:27.732870+0000","last_clean":"2023-08-09T12:41:27.732870+0000","last_became_active":"2023-08-09T12:41:25.708777+0000","last_became_peered":"2023-08-09T12:41:25.708777+0000","last_unstale":"2023-08-09T12:41:27.732870+0000","last_undegraded":"2023-08-09T12:41:27.732870+0000","last_fullsized":"2023-08-09T12:41:27.732870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:32:17.072619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735501+0000","last_change":"2023-08-09T12:41:26.757742+0000","last_active":"2023-08-09T12:41:27.735501+0000","last_peered":"2023-08-09T12:41:27.735501+0000","last_clean":"2023-08-09T12:41:27.735501+0000","last_became_active":"2023-08-09T12:41:26.757342+0000","last_became_peered":"2023-08-09T12:41:26.757342+0000","last_unstale":"2023-08-09T12:41:27.735501+0000","last_undegraded":"2023-08-09T12:41:27.735501+0000","last_fullsized":"2023-08-09T12:41:27.735501+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:27:44.111994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736981+0000","last_change":"2023-08-09T12:41:25.719868+0000","last_active":"2023-08-09T12:41:27.736981+0000","last_peered":"2023-08-09T12:41:27.736981+0000","last_clean":"2023-08-09T12:41:27.736981+0000","last_became_active":"2023-08-09T12:41:25.719554+0000","last_became_peered":"2023-08-09T12:41:25.719554+0000","last_unstale":"2023-08-09T12:41:27.736981+0000","last_undegraded":"2023-08-09T12:41:27.736981+0000","last_fullsized":"2023-08-09T12:41:27.736981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:01:48.708767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744579+0000","last_change":"2023-08-09T12:41:26.764776+0000","last_active":"2023-08-09T12:41:27.744579+0000","last_peered":"2023-08-09T12:41:27.744579+0000","last_clean":"2023-08-09T12:41:27.744579+0000","last_became_active":"2023-08-09T12:41:26.761557+0000","last_became_peered":"2023-08-09T12:41:26.761557+0000","last_unstale":"2023-08-09T12:41:27.744579+0000","last_undegraded":"2023-08-09T12:41:27.744579+0000","last_fullsized":"2023-08-09T12:41:27.744579+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:54:32.087161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736711+0000","last_change":"2023-08-09T12:41:25.723181+0000","last_active":"2023-08-09T12:41:27.736711+0000","last_peered":"2023-08-09T12:41:27.736711+0000","last_clean":"2023-08-09T12:41:27.736711+0000","last_became_active":"2023-08-09T12:41:25.722598+0000","last_became_peered":"2023-08-09T12:41:25.722598+0000","last_unstale":"2023-08-09T12:41:27.736711+0000","last_undegraded":"2023-08-09T12:41:27.736711+0000","last_fullsized":"2023-08-09T12:41:27.736711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:02:50.449385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745815+0000","last_change":"2023-08-09T12:41:26.753949+0000","last_active":"2023-08-09T12:41:27.745815+0000","last_peered":"2023-08-09T12:41:27.745815+0000","last_clean":"2023-08-09T12:41:27.745815+0000","last_became_active":"2023-08-09T12:41:26.753622+0000","last_became_peered":"2023-08-09T12:41:26.753622+0000","last_unstale":"2023-08-09T12:41:27.745815+0000","last_undegraded":"2023-08-09T12:41:27.745815+0000","last_fullsized":"2023-08-09T12:41:27.745815+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:53:52.596963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744513+0000","last_change":"2023-08-09T12:41:25.708766+0000","last_active":"2023-08-09T12:41:27.744513+0000","last_peered":"2023-08-09T12:41:27.744513+0000","last_clean":"2023-08-09T12:41:27.744513+0000","last_became_active":"2023-08-09T12:41:25.707255+0000","last_became_peered":"2023-08-09T12:41:25.707255+0000","last_unstale":"2023-08-09T12:41:27.744513+0000","last_undegraded":"2023-08-09T12:41:27.744513+0000","last_fullsized":"2023-08-09T12:41:27.744513+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:20.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735687+0000","last_change":"2023-08-09T12:41:26.752241+0000","last_active":"2023-08-09T12:41:27.735687+0000","last_peered":"2023-08-09T12:41:27.735687+0000","last_clean":"2023-08-09T12:41:27.735687+0000","last_became_active":"2023-08-09T12:41:26.751882+0000","last_became_peered":"2023-08-09T12:41:26.751882+0000","last_unstale":"2023-08-09T12:41:27.735687+0000","last_undegraded":"2023-08-09T12:41:27.735687+0000","last_fullsized":"2023-08-09T12:41:27.735687+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:57.396775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745994+0000","last_change":"2023-08-09T12:41:25.719956+0000","last_active":"2023-08-09T12:41:27.745994+0000","last_peered":"2023-08-09T12:41:27.745994+0000","last_clean":"2023-08-09T12:41:27.745994+0000","last_became_active":"2023-08-09T12:41:25.718827+0000","last_became_peered":"2023-08-09T12:41:25.718827+0000","last_unstale":"2023-08-09T12:41:27.745994+0000","last_undegraded":"2023-08-09T12:41:27.745994+0000","last_fullsized":"2023-08-09T12:41:27.745994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:04:25.155238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745463+0000","last_change":"2023-08-09T12:41:26.769981+0000","last_active":"2023-08-09T12:41:27.745463+0000","last_peered":"2023-08-09T12:41:27.745463+0000","last_clean":"2023-08-09T12:41:27.745463+0000","last_became_active":"2023-08-09T12:41:26.764025+0000","last_became_peered":"2023-08-09T12:41:26.764025+0000","last_unstale":"2023-08-09T12:41:27.745463+0000","last_undegraded":"2023-08-09T12:41:27.745463+0000","last_fullsized":"2023-08-09T12:41:27.745463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:34.790459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746526+0000","last_change":"2023-08-09T12:41:25.716973+0000","last_active":"2023-08-09T12:41:27.746526+0000","last_peered":"2023-08-09T12:41:27.746526+0000","last_clean":"2023-08-09T12:41:27.746526+0000","last_became_active":"2023-08-09T12:41:25.715880+0000","last_became_peered":"2023-08-09T12:41:25.715880+0000","last_unstale":"2023-08-09T12:41:27.746526+0000","last_undegraded":"2023-08-09T12:41:27.746526+0000","last_fullsized":"2023-08-09T12:41:27.746526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:20.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744139+0000","last_change":"2023-08-09T12:41:26.764083+0000","last_active":"2023-08-09T12:41:27.744139+0000","last_peered":"2023-08-09T12:41:27.744139+0000","last_clean":"2023-08-09T12:41:27.744139+0000","last_became_active":"2023-08-09T12:41:26.763662+0000","last_became_peered":"2023-08-09T12:41:26.763662+0000","last_unstale":"2023-08-09T12:41:27.744139+0000","last_undegraded":"2023-08-09T12:41:27.744139+0000","last_fullsized":"2023-08-09T12:41:27.744139+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:09.252796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.733061+0000","last_change":"2023-08-09T12:41:25.709666+0000","last_active":"2023-08-09T12:41:27.733061+0000","last_peered":"2023-08-09T12:41:27.733061+0000","last_clean":"2023-08-09T12:41:27.733061+0000","last_became_active":"2023-08-09T12:41:25.708958+0000","last_became_peered":"2023-08-09T12:41:25.708958+0000","last_unstale":"2023-08-09T12:41:27.733061+0000","last_undegraded":"2023-08-09T12:41:27.733061+0000","last_fullsized":"2023-08-09T12:41:27.733061+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:32:35.893052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.736843+0000","last_change":"2023-08-09T12:41:26.753676+0000","last_active":"2023-08-09T12:41:27.736843+0000","last_peered":"2023-08-09T12:41:27.736843+0000","last_clean":"2023-08-09T12:41:27.736843+0000","last_became_active":"2023-08-09T12:41:26.752998+0000","last_became_peered":"2023-08-09T12:41:26.752998+0000","last_unstale":"2023-08-09T12:41:27.736843+0000","last_undegraded":"2023-08-09T12:41:27.736843+0000","last_fullsized":"2023-08-09T12:41:27.736843+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:08:27.103054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745638+0000","last_change":"2023-08-09T12:41:25.716719+0000","last_active":"2023-08-09T12:41:27.745638+0000","last_peered":"2023-08-09T12:41:27.745638+0000","last_clean":"2023-08-09T12:41:27.745638+0000","last_became_active":"2023-08-09T12:41:25.715489+0000","last_became_peered":"2023-08-09T12:41:25.715489+0000","last_unstale":"2023-08-09T12:41:27.745638+0000","last_undegraded":"2023-08-09T12:41:27.745638+0000","last_fullsized":"2023-08-09T12:41:27.745638+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:37.642088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.749262+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:41:27.749262+0000","last_peered":"2023-08-09T12:41:27.749262+0000","last_clean":"2023-08-09T12:41:27.749262+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:41:27.749262+0000","last_undegraded":"2023-08-09T12:41:27.749262+0000","last_fullsized":"2023-08-09T12:41:27.749262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:11:12.000099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748215+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:41:27.748215+0000","last_peered":"2023-08-09T12:41:27.748215+0000","last_clean":"2023-08-09T12:41:27.748215+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:41:27.748215+0000","last_undegraded":"2023-08-09T12:41:27.748215+0000","last_fullsized":"2023-08-09T12:41:27.748215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:23.260579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744003+0000","last_change":"2023-08-09T12:41:26.756024+0000","last_active":"2023-08-09T12:41:27.744003+0000","last_peered":"2023-08-09T12:41:27.744003+0000","last_clean":"2023-08-09T12:41:27.744003+0000","last_became_active":"2023-08-09T12:41:26.755595+0000","last_became_peered":"2023-08-09T12:41:26.755595+0000","last_unstale":"2023-08-09T12:41:27.744003+0000","last_undegraded":"2023-08-09T12:41:27.744003+0000","last_fullsized":"2023-08-09T12:41:27.744003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748820+0000","last_change":"2023-08-09T12:41:25.713983+0000","last_active":"2023-08-09T12:41:27.748820+0000","last_peered":"2023-08-09T12:41:27.748820+0000","last_clean":"2023-08-09T12:41:27.748820+0000","last_became_active":"2023-08-09T12:41:25.713370+0000","last_became_peered":"2023-08-09T12:41:25.713370+0000","last_unstale":"2023-08-09T12:41:27.748820+0000","last_undegraded":"2023-08-09T12:41:27.748820+0000","last_fullsized":"2023-08-09T12:41:27.748820+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:45.930068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.749060+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:41:27.749060+0000","last_peered":"2023-08-09T12:41:27.749060+0000","last_clean":"2023-08-09T12:41:27.749060+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:41:27.749060+0000","last_undegraded":"2023-08-09T12:41:27.749060+0000","last_fullsized":"2023-08-09T12:41:27.749060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:45.592041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746294+0000","last_change":"2023-08-09T12:41:26.754103+0000","last_active":"2023-08-09T12:41:27.746294+0000","last_peered":"2023-08-09T12:41:27.746294+0000","last_clean":"2023-08-09T12:41:27.746294+0000","last_became_active":"2023-08-09T12:41:26.753433+0000","last_became_peered":"2023-08-09T12:41:26.753433+0000","last_unstale":"2023-08-09T12:41:27.746294+0000","last_undegraded":"2023-08-09T12:41:27.746294+0000","last_fullsized":"2023-08-09T12:41:27.746294+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:58.995511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746612+0000","last_change":"2023-08-09T12:41:25.716511+0000","last_active":"2023-08-09T12:41:27.746612+0000","last_peered":"2023-08-09T12:41:27.746612+0000","last_clean":"2023-08-09T12:41:27.746612+0000","last_became_active":"2023-08-09T12:41:25.715140+0000","last_became_peered":"2023-08-09T12:41:25.715140+0000","last_unstale":"2023-08-09T12:41:27.746612+0000","last_undegraded":"2023-08-09T12:41:27.746612+0000","last_fullsized":"2023-08-09T12:41:27.746612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:54:31.082481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.732806+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:41:27.732806+0000","last_peered":"2023-08-09T12:41:27.732806+0000","last_clean":"2023-08-09T12:41:27.732806+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:41:27.732806+0000","last_undegraded":"2023-08-09T12:41:27.732806+0000","last_fullsized":"2023-08-09T12:41:27.732806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:23:13.116513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747606+0000","last_change":"2023-08-09T12:41:26.761325+0000","last_active":"2023-08-09T12:41:27.747606+0000","last_peered":"2023-08-09T12:41:27.747606+0000","last_clean":"2023-08-09T12:41:27.747606+0000","last_became_active":"2023-08-09T12:41:26.760426+0000","last_became_peered":"2023-08-09T12:41:26.760426+0000","last_unstale":"2023-08-09T12:41:27.747606+0000","last_undegraded":"2023-08-09T12:41:27.747606+0000","last_fullsized":"2023-08-09T12:41:27.747606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:16:14.221437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.737043+0000","last_change":"2023-08-09T12:41:25.723888+0000","last_active":"2023-08-09T12:41:27.737043+0000","last_peered":"2023-08-09T12:41:27.737043+0000","last_clean":"2023-08-09T12:41:27.737043+0000","last_became_active":"2023-08-09T12:41:25.723572+0000","last_became_peered":"2023-08-09T12:41:25.723572+0000","last_unstale":"2023-08-09T12:41:27.737043+0000","last_undegraded":"2023-08-09T12:41:27.737043+0000","last_fullsized":"2023-08-09T12:41:27.737043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:52.643529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746513+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:41:27.746513+0000","last_peered":"2023-08-09T12:41:27.746513+0000","last_clean":"2023-08-09T12:41:27.746513+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:41:27.746513+0000","last_undegraded":"2023-08-09T12:41:27.746513+0000","last_fullsized":"2023-08-09T12:41:27.746513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:45:06.337674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746680+0000","last_change":"2023-08-09T12:41:26.768812+0000","last_active":"2023-08-09T12:41:27.746680+0000","last_peered":"2023-08-09T12:41:27.746680+0000","last_clean":"2023-08-09T12:41:27.746680+0000","last_became_active":"2023-08-09T12:41:26.764927+0000","last_became_peered":"2023-08-09T12:41:26.764927+0000","last_unstale":"2023-08-09T12:41:27.746680+0000","last_undegraded":"2023-08-09T12:41:27.746680+0000","last_fullsized":"2023-08-09T12:41:27.746680+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:58.393906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.735874+0000","last_change":"2023-08-09T12:41:25.714321+0000","last_active":"2023-08-09T12:41:27.735874+0000","last_peered":"2023-08-09T12:41:27.735874+0000","last_clean":"2023-08-09T12:41:27.735874+0000","last_became_active":"2023-08-09T12:41:25.713760+0000","last_became_peered":"2023-08-09T12:41:25.713760+0000","last_unstale":"2023-08-09T12:41:27.735874+0000","last_undegraded":"2023-08-09T12:41:27.735874+0000","last_fullsized":"2023-08-09T12:41:27.735874+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:57.389225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745242+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:41:27.745242+0000","last_peered":"2023-08-09T12:41:27.745242+0000","last_clean":"2023-08-09T12:41:27.745242+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:41:27.745242+0000","last_undegraded":"2023-08-09T12:41:27.745242+0000","last_fullsized":"2023-08-09T12:41:27.745242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:47:35.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745216+0000","last_change":"2023-08-09T12:41:26.745215+0000","last_active":"2023-08-09T12:41:27.745216+0000","last_peered":"2023-08-09T12:41:27.745216+0000","last_clean":"2023-08-09T12:41:27.745216+0000","last_became_active":"2023-08-09T12:41:26.744468+0000","last_became_peered":"2023-08-09T12:41:26.744468+0000","last_unstale":"2023-08-09T12:41:27.745216+0000","last_undegraded":"2023-08-09T12:41:27.745216+0000","last_fullsized":"2023-08-09T12:41:27.745216+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:54:32.087161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745797+0000","last_change":"2023-08-09T12:41:25.708106+0000","last_active":"2023-08-09T12:41:27.745797+0000","last_peered":"2023-08-09T12:41:27.745797+0000","last_clean":"2023-08-09T12:41:27.745797+0000","last_became_active":"2023-08-09T12:41:25.707382+0000","last_became_peered":"2023-08-09T12:41:25.707382+0000","last_unstale":"2023-08-09T12:41:27.745797+0000","last_undegraded":"2023-08-09T12:41:27.745797+0000","last_fullsized":"2023-08-09T12:41:27.745797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:12:35.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.748596+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:41:27.748596+0000","last_peered":"2023-08-09T12:41:27.748596+0000","last_clean":"2023-08-09T12:41:27.748596+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:41:27.748596+0000","last_undegraded":"2023-08-09T12:41:27.748596+0000","last_fullsized":"2023-08-09T12:41:27.748596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:50.202615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.745937+0000","last_change":"2023-08-09T12:41:26.764567+0000","last_active":"2023-08-09T12:41:27.745937+0000","last_peered":"2023-08-09T12:41:27.745937+0000","last_clean":"2023-08-09T12:41:27.745937+0000","last_became_active":"2023-08-09T12:41:26.764132+0000","last_became_peered":"2023-08-09T12:41:26.764132+0000","last_unstale":"2023-08-09T12:41:27.745937+0000","last_undegraded":"2023-08-09T12:41:27.745937+0000","last_fullsized":"2023-08-09T12:41:27.745937+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:41.319329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.746105+0000","last_change":"2023-08-09T12:41:25.717417+0000","last_active":"2023-08-09T12:41:27.746105+0000","last_peered":"2023-08-09T12:41:27.746105+0000","last_clean":"2023-08-09T12:41:27.746105+0000","last_became_active":"2023-08-09T12:41:25.717148+0000","last_became_peered":"2023-08-09T12:41:25.717148+0000","last_unstale":"2023-08-09T12:41:27.746105+0000","last_undegraded":"2023-08-09T12:41:27.746105+0000","last_fullsized":"2023-08-09T12:41:27.746105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:27.876718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.744674+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:41:27.744674+0000","last_peered":"2023-08-09T12:41:27.744674+0000","last_clean":"2023-08-09T12:41:27.744674+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:41:27.744674+0000","last_undegraded":"2023-08-09T12:41:27.744674+0000","last_fullsized":"2023-08-09T12:41:27.744674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:50:50.974572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747292+0000","last_change":"2023-08-09T12:41:26.758588+0000","last_active":"2023-08-09T12:41:27.747292+0000","last_peered":"2023-08-09T12:41:27.747292+0000","last_clean":"2023-08-09T12:41:27.747292+0000","last_became_active":"2023-08-09T12:41:26.757232+0000","last_became_peered":"2023-08-09T12:41:26.757232+0000","last_unstale":"2023-08-09T12:41:27.747292+0000","last_undegraded":"2023-08-09T12:41:27.747292+0000","last_fullsized":"2023-08-09T12:41:27.747292+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:25.682645+0000","last_clean_scrub_stamp":"2023-08-09T12:41:25.682645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:48.189765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.747092+0000","last_change":"2023-08-09T12:41:25.717713+0000","last_active":"2023-08-09T12:41:27.747092+0000","last_peered":"2023-08-09T12:41:27.747092+0000","last_clean":"2023-08-09T12:41:27.747092+0000","last_became_active":"2023-08-09T12:41:25.717257+0000","last_became_peered":"2023-08-09T12:41:25.717257+0000","last_unstale":"2023-08-09T12:41:27.747092+0000","last_undegraded":"2023-08-09T12:41:27.747092+0000","last_fullsized":"2023-08-09T12:41:27.747092+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:41:24.677965+0000","last_clean_scrub_stamp":"2023-08-09T12:41:24.677965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:27:40.149989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-09T12:41:27.737433+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:41:27.737433+0000","last_peered":"2023-08-09T12:41:27.737433+0000","last_clean":"2023-08-09T12:41:27.737433+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:41:27.737433+0000","last_undegraded":"2023-08-09T12:41:27.737433+0000","last_fullsized":"2023-08-09T12:41:27.737433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:27:30.765020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.095,"15min":1.093},"min":{"1min":0.70599999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.454,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.079,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.1779999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.105,"15min":1.081},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8959999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0960000000000001,"15min":1.0820000000000001},"min":{"1min":0.747,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.1419999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6259999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.256},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.153,"15min":1.131},"min":{"1min":0.92500000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.637}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2310000000000001,"15min":1.2150000000000001},"min":{"1min":0.93500000000000005,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.784,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.2589999999999999,"15min":1.246},"min":{"1min":0.94699999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.696,"5min":1.96,"15min":1.96},"last":1.016}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.2250000000000001,"15min":1.1990000000000001},"min":{"1min":0.92300000000000004,"5min":0.505,"15min":0.505},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.2749999999999999,"15min":1.2470000000000001},"min":{"1min":0.876,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.296}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.284,"15min":1.2589999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.4910000000000001,"15min":1.4790000000000001},"min":{"1min":0.85999999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":3.1400000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.5700000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.488,"15min":1.47},"min":{"1min":1.27,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.266,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.444},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":1.1160000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.093,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0640000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":254,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195057,"statfs":{"total":200000000,"available":199739049,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.137,"15min":1.113},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.173,"5min":1.0700000000000001,"15min":1.0529999999999999},"min":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.69199999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.228,"15min":1.222},"min":{"1min":0.88800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.0009999999999999,"5min":2.306,"15min":2.306},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3220000000000001,"15min":1.3089999999999999},"min":{"1min":0.91400000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.0089999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.0960000000000001,"15min":1.083},"min":{"1min":0.83099999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.2729999999999999,"15min":1.2629999999999999},"min":{"1min":0.97699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.218}]},{"osd":3,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":1.0249999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.103},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2749999999999999,"15min":1.268},"min":{"1min":0.86199999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.732,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.296,"15min":1.282},"min":{"1min":0.88900000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.327,"15min":1.3169999999999999},"min":{"1min":0.99399999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.284}]},{"osd":5,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.298,"15min":1.2989999999999999},"min":{"1min":0.96999999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.379},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.462,"15min":1.45},"min":{"1min":1.1899999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7160000000000002,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.6180000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.409,"15min":1.377},"min":{"1min":1.1180000000000001,"5min":0.752,"15min":0.752},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.579},{"interface":"front","average":{"1min":1.498,"5min":1.401,"15min":1.385},"min":{"1min":1.083,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.482}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":254,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195058,"statfs":{"total":200000000,"available":199739701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.111,"15min":1.1100000000000001},"min":{"1min":0.75600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4930000000000001,"5min":2.427,"15min":2.427},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0509999999999999,"15min":1.0349999999999999},"min":{"1min":0.73499999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.274}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.278,"15min":1.272},"min":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.748,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.238,"15min":1.232},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6399999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1830000000000001,"15min":1.1930000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.446,"5min":1.591,"15min":1.591},"last":1.117},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.175,"15min":1.1830000000000001},"min":{"1min":0.78400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.728,"15min":1.728},"last":1.2170000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.181,"15min":1.1699999999999999},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.29,"5min":1.3620000000000001,"15min":1.3740000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.607,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.466}]},{"osd":4,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.621,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.1619999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.357,"15min":1.371},"min":{"1min":0.71999999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.921,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.173}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3280000000000001,"15min":1.3240000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.863,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4770000000000001,"15min":1.506},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.948,"15min":2.948},"last":1.51}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.512,"15min":1.524},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.097,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.363},{"interface":"front","average":{"1min":1.488,"5min":1.4990000000000001,"15min":1.5009999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.974,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.663}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":254,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195057,"statfs":{"total":200000000,"available":199739119,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.69199999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.72,"5min":1.77,"15min":1.77},"last":1.345},{"interface":"front","average":{"1min":1.151,"5min":1.0860000000000001,"15min":1.075},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.589,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.296}]},{"osd":1,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.3320000000000001,"15min":1.363},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.589,"5min":1.97,"15min":1.97},"last":1.141},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3400000000000001,"15min":1.3420000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.478}]},{"osd":2,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3320000000000001,"15min":1.327},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.3160000000000001,"15min":1.3100000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.611}]},{"osd":3,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.196,"15min":1.2},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3320000000000001,"15min":1.3380000000000001},"min":{"1min":0.97299999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6990000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.401,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.847,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.194},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3680000000000001,"15min":1.3779999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7629999999999999,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.385}]},{"osd":6,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.5009999999999999,"15min":1.52},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.8080000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.046},{"interface":"front","average":{"1min":1.49,"5min":1.5349999999999999,"15min":1.5429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.95,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.516,"15min":1.516},"min":{"1min":1.0169999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8839999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.6299999999999999,"15min":1.645},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0089999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.4199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195056,"statfs":{"total":200000000,"available":199738067,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.502},{"interface":"front","average":{"1min":0.877,"5min":0.85599999999999998,"15min":0.85199999999999998},"min":{"1min":0.45400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3759999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.875,"15min":0.85699999999999998},"min":{"1min":0.52000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.71499999999999997}]},{"osd":2,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"min":{"1min":0.48199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.5680000000000001,"5min":1.893,"15min":1.893},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.55400000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6499999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.88100000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.84399999999999997,"5min":0.745,"15min":0.745},"max":{"1min":1.883,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3160000000000001,"15min":1.3380000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.708,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.98699999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.355,"15min":1.3700000000000001},"min":{"1min":0.85899999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.6870000000000001,"5min":2.157,"15min":2.157},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2589999999999999,"15min":1.2490000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.96099999999999997}]},{"osd":6,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3169999999999999,"15min":1.3220000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.7649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.456,"15min":1.476},"min":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.7729999999999999,"5min":2.589,"15min":2.589},"last":1.2130000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.369,"15min":1.3700000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.234},{"interface":"front","average":{"1min":1.351,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.776,"5min":1.78,"15min":1.78},"last":1.008}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195056,"statfs":{"total":200000000,"available":199738089,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5329999999999999,"5min":1.716,"15min":1.716},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4790000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.179}]},{"osd":1,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0349999999999999,"15min":1.054},"min":{"1min":0.61199999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.782,"5min":1.869,"15min":1.869},"last":1.4319999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1619999999999999,"15min":1.171},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.1379999999999999,"15min":1.1419999999999999},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.242,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.7350000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.403,"15min":1.4039999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.2869999999999999,"15min":1.2569999999999999},"min":{"1min":0.83199999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.5649999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.3660000000000001,"15min":1.3420000000000001},"min":{"1min":0.98199999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":5.0140000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.498,"15min":1.486},"min":{"1min":0.879,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":4.806,"5min":4.806,"15min":4.806},"last":1.804}]},{"osd":6,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.298,"15min":1.288},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.27},{"interface":"front","average":{"1min":1.429,"5min":1.4119999999999999,"15min":1.409},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.361}]},{"osd":7,"last update":"Wed Aug 9 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.351,"15min":1.347},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5269999999999999,"15min":1.5249999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.5}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":254,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195058,"statfs":{"total":200000000,"available":199739541,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.149},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85099999999999998,"15min":0.85399999999999998},"min":{"1min":0.48899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.232,"5min":1.24,"15min":1.24},"last":1.4770000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.679,"5min":1.774,"15min":1.774},"last":1.2250000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.046},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6559999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.335},{"interface":"front","average":{"1min":1.008,"5min":0.90100000000000002,"15min":0.88300000000000001},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2889999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.258},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2669999999999999,"15min":1.264},"min":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6799999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.4219999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2609999999999999,"15min":1.2629999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.02,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.2589999999999999,"15min":1.2450000000000001},"min":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.3839999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.373,"15min":1.373},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2210000000000001,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3520000000000001,"15min":1.341},"min":{"1min":0.999,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.839,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.4590000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:41:16 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.96899999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.8049999999999999,"5min":2.294,"15min":2.294},"last":1.53},{"interface":"front","average":{"1min":1.409,"5min":1.413,"15min":1.413},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.1280000000000001,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.617}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149277,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2729999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.873},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.90100000000000002},"min":{"1min":0.57199999999999995,"5min":0.436,"15min":0.436},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.04}]},{"osd":2,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92800000000000005,"15min":0.92900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.373,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.59199999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.484,"5min":1.607,"15min":1.607},"last":0.93100000000000005}]},{"osd":3,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86899999999999999,"15min":0.873},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.196,"5min":1.952,"15min":1.952},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.153,"15min":1.161},"min":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5860000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.546}]},{"osd":4,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.2829999999999999,"15min":1.302},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.6080000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.6970000000000001,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2509999999999999,"15min":1.2589999999999999},"min":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3540000000000001,"15min":1.3600000000000001},"min":{"1min":0.89100000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8100000000000001,"5min":2.161,"15min":2.161},"last":1.371}]},{"osd":6,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3109999999999999,"15min":1.3},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.373,"15min":1.3819999999999999},"min":{"1min":0.90100000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.008,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":2.0790000000000002}]},{"osd":7,"last update":"Wed Aug 9 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3680000000000001,"15min":1.359},"min":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.506},{"interface":"front","average":{"1min":1.335,"5min":1.3959999999999999,"15min":1.4059999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.7150000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":2.1960000000000002}]}]}],"pool_statfs":[]}} 2023-08-09T12:41:36.933 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:41:36.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:41:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.207+0000 7fc39b59e640 1 Processor -- start 2023-08-09T12:41:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.207+0000 7fc39b59e640 1 -- start start 2023-08-09T12:41:37.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.208+0000 7fc39b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cb40 0x7fc39c1609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.208+0000 7fc39b59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc39c0b8420 0x7fc39c0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc39b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc39c15cf20 0x7fc39c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc39b59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c0d0f00 con 0x7fc39c0b8420 2023-08-09T12:41:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc39b59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c1611f0 con 0x7fc39c15cf20 2023-08-09T12:41:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc39b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c1614d0 con 0x7fc39c15cb40 2023-08-09T12:41:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc399d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc39c0b8420 0x7fc39c0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc399d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc39c0b8420 0x7fc39c0cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52086/0 (socket says 172.21.15.17:52086) 2023-08-09T12:41:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc399d9b640 1 -- 172.21.15.17:0/2199745136 learned_addr learned my addr 172.21.15.17:0/2199745136 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc39ad9d640 1 --2- 172.21.15.17:0/2199745136 >> v2:172.21.15.142:3300/0 conn(0x7fc39c15cf20 0x7fc39c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.209+0000 7fc39a59c640 1 --2- 172.21.15.17:0/2199745136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cb40 0x7fc39c1609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.210+0000 7fc399d9b640 1 -- 172.21.15.17:0/2199745136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cb40 msgr2=0x7fc39c1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.210+0000 7fc399d9b640 1 --2- 172.21.15.17:0/2199745136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cb40 0x7fc39c1609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.210+0000 7fc399d9b640 1 -- 172.21.15.17:0/2199745136 >> v2:172.21.15.142:3300/0 conn(0x7fc39c15cf20 msgr2=0x7fc39c0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.210+0000 7fc399d9b640 1 --2- 172.21.15.17:0/2199745136 >> v2:172.21.15.142:3300/0 conn(0x7fc39c15cf20 0x7fc39c0cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.210+0000 7fc399d9b640 1 -- 172.21.15.17:0/2199745136 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c1617b0 con 0x7fc39c0b8420 2023-08-09T12:41:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.211+0000 7fc399d9b640 1 --2- 172.21.15.17:0/2199745136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c0b8420 0x7fc39c0cd860 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0b88b0 tx=0x7fc39002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9a86229752845d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.211+0000 7fc39959a640 1 -- 172.21.15.17:0/2199745136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390030850 con 0x7fc39c0b8420 2023-08-09T12:41:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.211+0000 7fc39959a640 1 -- 172.21.15.17:0/2199745136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3900309b0 con 0x7fc39c0b8420 2023-08-09T12:41:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.211+0000 7fc39959a640 1 -- 172.21.15.17:0/2199745136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390030d40 con 0x7fc39c0b8420 2023-08-09T12:41:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 -- 172.21.15.17:0/2199745136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c0b8420 msgr2=0x7fc39c0cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 --2- 172.21.15.17:0/2199745136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c0b8420 0x7fc39c0cd860 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0b88b0 tx=0x7fc39002b990 comp rx=0 tx=0).stop 2023-08-09T12:41:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 -- 172.21.15.17:0/2199745136 shutdown_connections 2023-08-09T12:41:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 --2- 172.21.15.17:0/2199745136 >> v2:172.21.15.142:3300/0 conn(0x7fc39c15cf20 0x7fc39c0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 --2- 172.21.15.17:0/2199745136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c0b8420 0x7fc39c0cd860 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 --2- 172.21.15.17:0/2199745136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cb40 0x7fc39c1609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 -- 172.21.15.17:0/2199745136 >> 172.21.15.17:0/2199745136 conn(0x7fc39c0d2ab0 msgr2=0x7fc39c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 -- 172.21.15.17:0/2199745136 shutdown_connections 2023-08-09T12:41:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.212+0000 7fc39b59e640 1 -- 172.21.15.17:0/2199745136 wait complete. 2023-08-09T12:41:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.214+0000 7fc39b59e640 1 Processor -- start 2023-08-09T12:41:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.214+0000 7fc39b59e640 1 -- start start 2023-08-09T12:41:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc39b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc39c0b8420 0x7fc39c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc39b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c15cb40 0x7fc39c15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc39b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cf20 0x7fc39c145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc39b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c160450 con 0x7fc39c15cb40 2023-08-09T12:41:37.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc39b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c15f7d0 con 0x7fc39c0b8420 2023-08-09T12:41:37.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc39b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c15fab0 con 0x7fc39c15cf20 2023-08-09T12:41:37.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc399d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c15cb40 0x7fc39c15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc399d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c15cb40 0x7fc39c15eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52098/0 (socket says 172.21.15.17:52098) 2023-08-09T12:41:37.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.215+0000 7fc399d9b640 1 -- 172.21.15.17:0/4128706207 learned_addr learned my addr 172.21.15.17:0/4128706207 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:37.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc39a59c640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc39c0b8420 0x7fc39c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc39ad9d640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cf20 0x7fc39c145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc399d9b640 1 -- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cf20 msgr2=0x7fc39c145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc399d9b640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cf20 0x7fc39c145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc399d9b640 1 -- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc39c0b8420 msgr2=0x7fc39c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc399d9b640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc39c0b8420 0x7fc39c147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc399d9b640 1 -- 172.21.15.17:0/4128706207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3900094d0 con 0x7fc39c15cb40 2023-08-09T12:41:37.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc39ad9d640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cf20 0x7fc39c145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.216+0000 7fc399d9b640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c15cb40 0x7fc39c15eef0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc39002b9d0 tx=0x7fc390004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.217+0000 7fc38affd640 1 -- 172.21.15.17:0/4128706207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390039d60 con 0x7fc39c15cb40 2023-08-09T12:41:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.217+0000 7fc38affd640 1 -- 172.21.15.17:0/4128706207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc390043400 con 0x7fc39c15cb40 2023-08-09T12:41:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.217+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c15fd90 con 0x7fc39c15cb40 2023-08-09T12:41:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.217+0000 7fc38affd640 1 -- 172.21.15.17:0/4128706207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900437b0 con 0x7fc39c15cb40 2023-08-09T12:41:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.217+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c1481a0 con 0x7fc39c15cb40 2023-08-09T12:41:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.218+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c145e20 con 0x7fc39c15cb40 2023-08-09T12:41:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.219+0000 7fc38affd640 1 -- 172.21.15.17:0/4128706207 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc39002e070 con 0x7fc39c15cb40 2023-08-09T12:41:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.220+0000 7fc38affd640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37c06a080 0x7fc37c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.220+0000 7fc38affd640 1 -- 172.21.15.17:0/4128706207 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc39003e070 con 0x7fc39c15cb40 2023-08-09T12:41:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.221+0000 7fc39a59c640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37c06a080 0x7fc37c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.222+0000 7fc39a59c640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37c06a080 0x7fc37c06c540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc38c004410 tx=0x7fc38c0039f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.225+0000 7fc38affd640 1 -- 172.21.15.17:0/4128706207 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc390076ae0 con 0x7fc39c15cb40 2023-08-09T12:41:37.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.490+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc39c04e390 con 0x7fc39c15cb40 2023-08-09T12:41:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.499+0000 7fc38affd640 1 -- 172.21.15.17:0/4128706207 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc39007a100 con 0x7fc39c15cb40 2023-08-09T12:41:37.503 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:41:37.504 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:41:37.504 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:41:37.504 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:41:37.504 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:41:37.504 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:41:37.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37c06a080 msgr2=0x7fc37c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37c06a080 0x7fc37c06c540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc38c004410 tx=0x7fc38c0039f0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c15cb40 msgr2=0x7fc39c15eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c15cb40 0x7fc39c15eef0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc39002b9d0 tx=0x7fc390004730 comp rx=0 tx=0).stop 2023-08-09T12:41:37.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 shutdown_connections 2023-08-09T12:41:37.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37c06a080 0x7fc37c06c540 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39c15cf20 0x7fc39c145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc39c15cb40 0x7fc39c15eef0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 --2- 172.21.15.17:0/4128706207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc39c0b8420 0x7fc39c147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.502+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 >> 172.21.15.17:0/4128706207 conn(0x7fc39c0d2ab0 msgr2=0x7fc39c0cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:37.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.503+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 shutdown_connections 2023-08-09T12:41:37.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.503+0000 7fc39b59e640 1 -- 172.21.15.17:0/4128706207 wait complete. 2023-08-09T12:41:37.524 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.745+0000 7f8cba15d640 1 Processor -- start 2023-08-09T12:41:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.745+0000 7f8cba15d640 1 -- start start 2023-08-09T12:41:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cba15d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8cb40b38a0 0x7f8cb40cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cba15d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb40717e0 0x7f8cb40cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cba15d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40cdd60 con 0x7f8cb415add0 2023-08-09T12:41:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cba15d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40cc660 con 0x7f8cb40b38a0 2023-08-09T12:41:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cba15d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40cc940 con 0x7f8cb40717e0 2023-08-09T12:41:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cb2ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8cb40b38a0 0x7f8cb40cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cb2ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8cb40b38a0 0x7f8cb40cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52114/0 (socket says 172.21.15.17:52114) 2023-08-09T12:41:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cb2ffd640 1 -- 172.21.15.17:0/73752872 learned_addr learned my addr 172.21.15.17:0/73752872 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.747+0000 7f8cb3fff640 1 --2- 172.21.15.17:0/73752872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb40717e0 0x7f8cb40cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.748+0000 7f8cb2ffd640 1 -- 172.21.15.17:0/73752872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb40717e0 msgr2=0x7f8cb40cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.748+0000 7f8cb2ffd640 1 --2- 172.21.15.17:0/73752872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb40717e0 0x7f8cb40cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.748+0000 7f8cb2ffd640 1 -- 172.21.15.17:0/73752872 >> v1:172.21.15.142:6789/0 conn(0x7f8cb415add0 legacy=0x7f8cb40b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.748+0000 7f8cb2ffd640 1 -- 172.21.15.17:0/73752872 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40ccc20 con 0x7f8cb40b38a0 2023-08-09T12:41:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.749+0000 7f8cb2ffd640 1 --2- 172.21.15.17:0/73752872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40b38a0 0x7f8cb40cd2e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009870 tx=0x7f8ca802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215f91680d08e598 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.749+0000 7f8cb27fc640 1 -- 172.21.15.17:0/73752872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80317c0 con 0x7f8cb40b38a0 2023-08-09T12:41:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.749+0000 7f8cb27fc640 1 -- 172.21.15.17:0/73752872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8031920 con 0x7f8cb40b38a0 2023-08-09T12:41:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.749+0000 7f8cb27fc640 1 -- 172.21.15.17:0/73752872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8031cb0 con 0x7f8cb40b38a0 2023-08-09T12:41:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.750+0000 7f8cba15d640 1 -- 172.21.15.17:0/73752872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40b38a0 msgr2=0x7f8cb40cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.750+0000 7f8cba15d640 1 --2- 172.21.15.17:0/73752872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40b38a0 0x7f8cb40cd2e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009870 tx=0x7f8ca802b860 comp rx=0 tx=0).stop 2023-08-09T12:41:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.750+0000 7f8cba15d640 1 -- 172.21.15.17:0/73752872 shutdown_connections 2023-08-09T12:41:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.750+0000 7f8cba15d640 1 --2- 172.21.15.17:0/73752872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb40717e0 0x7f8cb40cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.750+0000 7f8cba15d640 1 --2- 172.21.15.17:0/73752872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40b38a0 0x7f8cb40cd2e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.750+0000 7f8cba15d640 1 -- 172.21.15.17:0/73752872 >> 172.21.15.17:0/73752872 conn(0x7f8cb406b9d0 msgr2=0x7f8cb406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.750+0000 7f8cba15d640 1 -- 172.21.15.17:0/73752872 shutdown_connections 2023-08-09T12:41:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.750+0000 7f8cba15d640 1 -- 172.21.15.17:0/73752872 wait complete. 2023-08-09T12:41:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.752+0000 7f8cba15d640 1 Processor -- start 2023-08-09T12:41:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.752+0000 7f8cba15d640 1 -- start start 2023-08-09T12:41:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cba15d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40717e0 0x7f8cb41574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cba15d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40b38a0 0x7f8cb40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cba15d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb415add0 0x7f8cb4158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cba15d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb406a5e0 con 0x7f8cb40717e0 2023-08-09T12:41:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cba15d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb41579e0 con 0x7f8cb40b38a0 2023-08-09T12:41:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cba15d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb406aa00 con 0x7f8cb415add0 2023-08-09T12:41:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40717e0 0x7f8cb41574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40717e0 0x7f8cb41574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52124/0 (socket says 172.21.15.17:52124) 2023-08-09T12:41:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb37fe640 1 -- 172.21.15.17:0/1438921213 learned_addr learned my addr 172.21.15.17:0/1438921213 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb2ffd640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40b38a0 0x7f8cb40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb3fff640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb415add0 0x7f8cb4158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb37fe640 1 -- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb415add0 msgr2=0x7f8cb4158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb37fe640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb415add0 0x7f8cb4158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb37fe640 1 -- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40b38a0 msgr2=0x7f8cb40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb37fe640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40b38a0 0x7f8cb40c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb37fe640 1 -- 172.21.15.17:0/1438921213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca80094d0 con 0x7f8cb40717e0 2023-08-09T12:41:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.753+0000 7f8cb2ffd640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40b38a0 0x7f8cb40c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.754+0000 7f8cb37fe640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40717e0 0x7f8cb41574a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c400 tx=0x7f8ca400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.754+0000 7f8c9bfff640 1 -- 172.21.15.17:0/1438921213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40052d0 con 0x7f8cb40717e0 2023-08-09T12:41:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.754+0000 7f8c9bfff640 1 -- 172.21.15.17:0/1438921213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4005430 con 0x7f8cb40717e0 2023-08-09T12:41:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.754+0000 7f8c9bfff640 1 -- 172.21.15.17:0/1438921213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4003830 con 0x7f8cb40717e0 2023-08-09T12:41:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.754+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb4069960 con 0x7f8cb40717e0 2023-08-09T12:41:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.754+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb4069f20 con 0x7f8cb40717e0 2023-08-09T12:41:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.755+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb40cae60 con 0x7f8cb40717e0 2023-08-09T12:41:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.756+0000 7f8c9bfff640 1 -- 172.21.15.17:0/1438921213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ca4003990 con 0x7f8cb40717e0 2023-08-09T12:41:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.758+0000 7f8c9bfff640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ca006a050 0x7f8ca006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.758+0000 7f8c9bfff640 1 -- 172.21.15.17:0/1438921213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ca4087b30 con 0x7f8cb40717e0 2023-08-09T12:41:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.758+0000 7f8cb2ffd640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ca006a050 0x7f8ca006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.759+0000 7f8cb2ffd640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ca006a050 0x7f8ca006c510 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8036000 tx=0x7f8ca803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.762+0000 7f8c9bfff640 1 -- 172.21.15.17:0/1438921213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8ca4053210 con 0x7f8cb40717e0 2023-08-09T12:41:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.994+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cb406a720 con 0x7f8cb40717e0 2023-08-09T12:41:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.995+0000 7f8c9bfff640 1 -- 172.21.15.17:0/1438921213 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f8cb406a720 con 0x7f8cb40717e0 2023-08-09T12:41:37.999 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:37.999 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:41:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:41:38.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ca006a050 msgr2=0x7f8ca006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ca006a050 0x7f8ca006c510 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8036000 tx=0x7f8ca803d040 comp rx=0 tx=0).stop 2023-08-09T12:41:38.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40717e0 msgr2=0x7f8cb41574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40717e0 0x7f8cb41574a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c400 tx=0x7f8ca400c8c0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 shutdown_connections 2023-08-09T12:41:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ca006a050 0x7f8ca006c510 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb415add0 0x7f8cb4158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40b38a0 0x7f8cb40c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 --2- 172.21.15.17:0/1438921213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40717e0 0x7f8cb41574a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.998+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 >> 172.21.15.17:0/1438921213 conn(0x7f8cb406b9d0 msgr2=0x7f8cb40b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.999+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 shutdown_connections 2023-08-09T12:41:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:37.999+0000 7f8cba15d640 1 -- 172.21.15.17:0/1438921213 wait complete. 2023-08-09T12:41:38.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:41:26.203485+0000', 'modified': '2023-08-09T12:41:29.769328+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4936': {'gid': 4936, 'name': 'b', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/2725761547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6836', 'nonce': 2725761547}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 2725761547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:41:38.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:41:38.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-09T12:41:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.660+0000 7fbcdc9f4640 1 Processor -- start 2023-08-09T12:41:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.660+0000 7fbcdc9f4640 1 -- start start 2023-08-09T12:41:38.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.661+0000 7fbcdc9f4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbcd8160030 0x7fbcd8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.662+0000 7fbcdc9f4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd80b5a30 con 0x7fbcd80cfb50 2023-08-09T12:41:38.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.662+0000 7fbcdc9f4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd80d0d70 con 0x7fbcd80b86e0 2023-08-09T12:41:38.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.662+0000 7fbcdc9f4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd80d1110 con 0x7fbcd8160030 2023-08-09T12:41:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.662+0000 7fbcd6d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbcd8160030 0x7fbcd8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.662+0000 7fbcd759e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fbcd80cfb50 0x7fbcd80d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57688/0 (socket says 172.21.15.17:57688) 2023-08-09T12:41:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.662+0000 7fbcd759e640 1 -- 172.21.15.17:0/602769979 learned_addr learned my addr 172.21.15.17:0/602769979 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.663+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/602769979 >> v1:172.21.15.142:6789/0 conn(0x7fbcd80b86e0 legacy=0x7fbcd80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.663+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/602769979 >> v1:172.21.15.17:6789/0 conn(0x7fbcd80cfb50 legacy=0x7fbcd80d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.663+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/602769979 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd8160f70 con 0x7fbcd8160030 2023-08-09T12:41:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.663+0000 7fbcd5d9b640 1 -- 172.21.15.17:0/602769979 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237658937 0 0) 0x7fbcd80b5a30 con 0x7fbcd80cfb50 2023-08-09T12:41:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.664+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/602769979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd8160740 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009d90 tx=0x7fbcc802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d632313919b5d1ad server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.664+0000 7fbcd5d9b640 1 -- 172.21.15.17:0/602769979 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc802cd00 con 0x7fbcd8160030 2023-08-09T12:41:38.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.664+0000 7fbcd5d9b640 1 -- 172.21.15.17:0/602769979 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc802ce60 con 0x7fbcd8160030 2023-08-09T12:41:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.664+0000 7fbcd5d9b640 1 -- 172.21.15.17:0/602769979 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8034660 con 0x7fbcd8160030 2023-08-09T12:41:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.665+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/602769979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 msgr2=0x7fbcd8160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.665+0000 7fbcdc9f4640 1 --2- 172.21.15.17:0/602769979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd8160740 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009d90 tx=0x7fbcc802bf50 comp rx=0 tx=0).stop 2023-08-09T12:41:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.665+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/602769979 shutdown_connections 2023-08-09T12:41:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.665+0000 7fbcdc9f4640 1 --2- 172.21.15.17:0/602769979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd8160740 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.665+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/602769979 >> 172.21.15.17:0/602769979 conn(0x7fbcd80697c0 msgr2=0x7fbcd8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.665+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/602769979 shutdown_connections 2023-08-09T12:41:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.665+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/602769979 wait complete. 2023-08-09T12:41:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.667+0000 7fbcdc9f4640 1 Processor -- start 2023-08-09T12:41:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.667+0000 7fbcdc9f4640 1 -- start start 2023-08-09T12:41:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcdc9f4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd80b86e0 0x7fbcd81f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcdc9f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcd80cfb50 0x7fbcd80cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcdc9f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd80d2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcdc9f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80cbb70 con 0x7fbcd8160030 2023-08-09T12:41:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcdc9f4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80ca5a0 con 0x7fbcd80b86e0 2023-08-09T12:41:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcdc9f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80cb8f0 con 0x7fbcd80cfb50 2023-08-09T12:41:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcd759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd80d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcd759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd80d2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58108/0 (socket says 172.21.15.17:58108) 2023-08-09T12:41:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcd759e640 1 -- 172.21.15.17:0/4239248733 learned_addr learned my addr 172.21.15.17:0/4239248733 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcd659c640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcd80cfb50 0x7fbcd80cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.668+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd80b86e0 0x7fbcd81f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcd759e640 1 -- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcd80cfb50 msgr2=0x7fbcd80cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcd759e640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcd80cfb50 0x7fbcd80cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcd759e640 1 -- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd80b86e0 msgr2=0x7fbcd81f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcd759e640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd80b86e0 0x7fbcd81f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcd759e640 1 -- 172.21.15.17:0/4239248733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8009a70 con 0x7fbcd8160030 2023-08-09T12:41:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcd759e640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd80d2760 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c4b0 tx=0x7fbcd000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcbf7fe640 1 -- 172.21.15.17:0/4239248733 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0007ea0 con 0x7fbcd8160030 2023-08-09T12:41:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcbf7fe640 1 -- 172.21.15.17:0/4239248733 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd0005ce0 con 0x7fbcd8160030 2023-08-09T12:41:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcbf7fe640 1 -- 172.21.15.17:0/4239248733 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd00072b0 con 0x7fbcd8160030 2023-08-09T12:41:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.669+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/4239248733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd80c9c70 con 0x7fbcd8160030 2023-08-09T12:41:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.670+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/4239248733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd80ca230 con 0x7fbcd8160030 2023-08-09T12:41:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.673+0000 7fbcbf7fe640 1 -- 172.21.15.17:0/4239248733 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbcd0007410 con 0x7fbcd8160030 2023-08-09T12:41:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.674+0000 7fbcbf7fe640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbcc406a050 0x7fbcc406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.674+0000 7fbcbf7fe640 1 -- 172.21.15.17:0/4239248733 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbcd00880a0 con 0x7fbcd8160030 2023-08-09T12:41:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.674+0000 7fbcdfd65740 1 Processor -- start 2023-08-09T12:41:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.674+0000 7fbcdfd65740 1 -- start start 2023-08-09T12:41:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.675+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbcc406a050 0x7fbcc406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.675+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb35a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.675+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb329db0 0x55e5cb3570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.675+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb3575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.675+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb29b8f0 con 0x55e5cb32d9b0 2023-08-09T12:41:38.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.675+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb298fe0 con 0x55e5cb359e30 2023-08-09T12:41:38.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.675+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb2948d0 con 0x55e5cb329db0 2023-08-09T12:41:38.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb3575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb3575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58118/0 (socket says 172.21.15.17:58118) 2023-08-09T12:41:38.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 -- 172.21.15.17:0/31086005 learned_addr learned my addr 172.21.15.17:0/31086005 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:38.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbcc406a050 0x7fbcc406c510 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8036000 tx=0x7fbcc8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 -- 172.21.15.17:0/31086005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb329db0 msgr2=0x55e5cb3570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 --2- 172.21.15.17:0/31086005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb329db0 0x55e5cb3570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 -- 172.21.15.17:0/31086005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 msgr2=0x55e5cb35a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 --2- 172.21.15.17:0/31086005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb35a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 -- 172.21.15.17:0/31086005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5cb24dac0 con 0x55e5cb32d9b0 2023-08-09T12:41:38.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcd759e640 1 --2- 172.21.15.17:0/31086005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb3575e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbcd005ec20 tx=0x7fbcd0056ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e36ad51d67fc268 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcbcff9640 1 -- 172.21.15.17:0/31086005 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd005b200 con 0x55e5cb32d9b0 2023-08-09T12:41:38.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcbcff9640 1 -- 172.21.15.17:0/31086005 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd005f150 con 0x55e5cb32d9b0 2023-08-09T12:41:38.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.676+0000 7fbcbcff9640 1 -- 172.21.15.17:0/31086005 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd00557e0 con 0x55e5cb32d9b0 2023-08-09T12:41:38.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 -- 172.21.15.17:0/31086005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 msgr2=0x55e5cb3575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/31086005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb3575e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbcd005ec20 tx=0x7fbcd0056ed0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 -- 172.21.15.17:0/31086005 shutdown_connections 2023-08-09T12:41:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/31086005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb3575e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/31086005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb329db0 0x55e5cb3570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/31086005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb35a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 -- 172.21.15.17:0/31086005 >> 172.21.15.17:0/31086005 conn(0x55e5cb32c0c0 msgr2=0x55e5cb374c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 -- 172.21.15.17:0/31086005 shutdown_connections 2023-08-09T12:41:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.677+0000 7fbcdfd65740 1 -- 172.21.15.17:0/31086005 wait complete. 2023-08-09T12:41:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.678+0000 7fbcdfd65740 1 -- start start 2023-08-09T12:41:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.678+0000 7fbcdfd65740 1 Processor -- start 2023-08-09T12:41:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.679+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb343cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.679+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb359e30 0x55e5cb35ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.679+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb35bf80 0x55e5cb3463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.679+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb234d40 con 0x55e5cb32d9b0 2023-08-09T12:41:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.679+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb2349e0 con 0x55e5cb35bf80 2023-08-09T12:41:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.679+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5caffaf20 con 0x55e5cb359e30 2023-08-09T12:41:38.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.679+0000 7fbcdfd65740 10 client.0 _ll_register_callbacks cb 0x55e5cb24d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:41:38.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.679+0000 7fbcd6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb343cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb343cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58132/0 (socket says 172.21.15.17:58132) 2023-08-09T12:41:38.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/2293890704 learned_addr learned my addr 172.21.15.17:0/2293890704 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:38.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd659c640 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb359e30 0x55e5cb35ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd759e640 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb35bf80 0x55e5cb3463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb359e30 msgr2=0x55e5cb35ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb359e30 0x55e5cb35ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb35bf80 msgr2=0x55e5cb3463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb35bf80 0x55e5cb3463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/2293890704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd80ca230 con 0x55e5cb32d9b0 2023-08-09T12:41:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb343cb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8034da0 tx=0x7fbcc8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b67091de573bce7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.680+0000 7fbcb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:41:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/2293890704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8034e90 con 0x55e5cb32d9b0 2023-08-09T12:41:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 1 -- 172.21.15.17:0/2293890704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5cb26c500 con 0x55e5cb32d9b0 2023-08-09T12:41:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/2293890704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbcc803fb60 con 0x55e5cb32d9b0 2023-08-09T12:41:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/2293890704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcc803fd20 con 0x55e5cb32d9b0 2023-08-09T12:41:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 10 client.5826 fetch_fsmap learned FSMap version 26 2023-08-09T12:41:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 1 -- 172.21.15.17:0/2293890704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55e5cb292f50 con 0x55e5cb32d9b0 2023-08-09T12:41:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/2293890704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e5cb26c500 con 0x55e5cb32d9b0 2023-08-09T12:41:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/2293890704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbcc8047050 con 0x55e5cb32d9b0 2023-08-09T12:41:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 10 client.5826 fetch_fsmap finished waiting for FSMap version 26 2023-08-09T12:41:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 10 client.5826 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-09T12:41:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 20 client.5826 populate_metadata read hostname 'smithi017' 2023-08-09T12:41:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] conn(0x55e5cb388610 0x55e5cb3889f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 4 client.5826 mds_command: new command op to 4936 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:41:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.681+0000 7fbcdfd65740 1 -- 172.21.15.17:0/2293890704 --> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5cb269bc0 con 0x55e5cb388610 2023-08-09T12:41:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.682+0000 7fbcd659c640 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] conn(0x55e5cb388610 0x55e5cb3889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.684+0000 7fbcd659c640 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] conn(0x55e5cb388610 0x55e5cb3889f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54c856fb066e7d1 server_cookie=f06e8c7c91dc1a3f in_seq=0 out_seq=0 2023-08-09T12:41:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.684+0000 7fbcb5ffb640 10 client.5826 ms_handle_connect on v2:172.21.15.142:6836/2725761547 2023-08-09T12:41:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/2293890704 <== mds.0 v2:172.21.15.142:6836/2725761547 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e5cb269bc0 con 0x55e5cb388610 2023-08-09T12:41:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcb5ffb640 10 client.5826 handle_command_reply: tid=0 2023-08-09T12:41:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 client.5826 shutdown 2023-08-09T12:41:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 -- 172.21.15.17:0/2293890704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 msgr2=0x55e5cb343cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb343cb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8034da0 tx=0x7fbcc8004ab0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 -- 172.21.15.17:0/2293890704 shutdown_connections 2023-08-09T12:41:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] conn(0x55e5cb388610 0x55e5cb3889f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb35bf80 0x55e5cb3463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb359e30 0x55e5cb35ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/2293890704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb343cb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcb5ffb640 0 client.5826 ms_handle_reset on v2:172.21.15.142:6836/2725761547 2023-08-09T12:41:38.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 -- 172.21.15.17:0/2293890704 >> 172.21.15.17:0/2293890704 conn(0x55e5cb329db0 msgr2=0x55e5cb32e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:38.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 -- 172.21.15.17:0/2293890704 shutdown_connections 2023-08-09T12:41:38.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.687+0000 7fbcdfd65740 1 -- 172.21.15.17:0/2293890704 wait complete. 2023-08-09T12:41:38.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.688+0000 7fbcdfd65740 20 client.5826 trim_cache size 0 max 16384 2023-08-09T12:41:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.704+0000 7fbcdfd65740 1 Processor -- start 2023-08-09T12:41:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.704+0000 7fbcdfd65740 1 -- start start 2023-08-09T12:41:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb36ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb378150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 0x55e5cb378690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb32a380 con 0x55e5cb32d9b0 2023-08-09T12:41:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb346f30 con 0x55e5cb359e30 2023-08-09T12:41:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb387550 con 0x55e5cb35bf80 2023-08-09T12:41:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcd6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb36ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcd6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb36ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58142/0 (socket says 172.21.15.17:58142) 2023-08-09T12:41:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/652893949 learned_addr learned my addr 172.21.15.17:0/652893949 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.705+0000 7fbcd659c640 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb378150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcd759e640 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 0x55e5cb378690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/652893949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 msgr2=0x55e5cb378690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 0x55e5cb378690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/652893949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 msgr2=0x55e5cb378150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb378150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcd6d9d640 1 -- 172.21.15.17:0/652893949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5cb2c6300 con 0x55e5cb32d9b0 2023-08-09T12:41:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb36ea30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80344f0 tx=0x7fbcc8041070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdff3e8d28cd9f8c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/652893949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc804a440 con 0x55e5cb32d9b0 2023-08-09T12:41:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/652893949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc803fb60 con 0x55e5cb32d9b0 2023-08-09T12:41:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.706+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/652893949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc804a8f0 con 0x55e5cb32d9b0 2023-08-09T12:41:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 -- 172.21.15.17:0/652893949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 msgr2=0x55e5cb36ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb36ea30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80344f0 tx=0x7fbcc8041070 comp rx=0 tx=0).stop 2023-08-09T12:41:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 -- 172.21.15.17:0/652893949 shutdown_connections 2023-08-09T12:41:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 0x55e5cb378690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb378150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/652893949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb32d9b0 0x55e5cb36ea30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 -- 172.21.15.17:0/652893949 >> 172.21.15.17:0/652893949 conn(0x55e5cb329db0 msgr2=0x55e5cb343ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 -- 172.21.15.17:0/652893949 shutdown_connections 2023-08-09T12:41:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.707+0000 7fbcdfd65740 1 -- 172.21.15.17:0/652893949 wait complete. 2023-08-09T12:41:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.708+0000 7fbcdfd65740 1 -- start start 2023-08-09T12:41:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.708+0000 7fbcdfd65740 1 Processor -- start 2023-08-09T12:41:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb378150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 0x55e5cb378690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcdfd65740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb3cbdd0 0x55e5cb3555f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb376f90 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb3cc710 con 0x55e5cb359e30 2023-08-09T12:41:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcdfd65740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5cb3292c0 con 0x55e5cb35bf80 2023-08-09T12:41:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcdfd65740 10 client.0 _ll_register_callbacks cb 0x7fbcc8043050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:41:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcd759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb3cbdd0 0x55e5cb3555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcd759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb3cbdd0 0x55e5cb3555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58156/0 (socket says 172.21.15.17:58156) 2023-08-09T12:41:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.709+0000 7fbcd759e640 1 -- 172.21.15.17:0/246655865 learned_addr learned my addr 172.21.15.17:0/246655865 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb378150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcd659c640 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 0x55e5cb378690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcd759e640 1 -- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 msgr2=0x55e5cb378690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcd759e640 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 0x55e5cb378690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcd759e640 1 -- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 msgr2=0x55e5cb378150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcd759e640 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb378150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcd759e640 1 -- 172.21.15.17:0/246655865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5cb292f50 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcd759e640 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb3cbdd0 0x55e5cb3555f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00573d0 tx=0x7fbcd005b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f6513506c50134 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:41:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/246655865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd005b200 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/246655865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbcd005f150 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.710+0000 7fbcdfd65740 1 -- 172.21.15.17:0/246655865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5cb2bc800 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/246655865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcd005ecc0 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcdfd65740 10 client.5832 fetch_fsmap learned FSMap version 26 2023-08-09T12:41:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcdfd65740 1 -- 172.21.15.17:0/246655865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55e5cb233a10 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/246655865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e5cb2bc800 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/246655865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbcd0019020 con 0x55e5cb3cbdd0 2023-08-09T12:41:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcdfd65740 10 client.5832 fetch_fsmap finished waiting for FSMap version 26 2023-08-09T12:41:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcdfd65740 10 client.5832 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-09T12:41:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcdfd65740 20 client.5832 populate_metadata read hostname 'smithi017' 2023-08-09T12:41:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] conn(0x55e5cb355e30 0x55e5cb35d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcdfd65740 4 client.5832 mds_command: new command op to 4936 tid=0[{"prefix": "status"}] 2023-08-09T12:41:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.711+0000 7fbcdfd65740 1 -- 172.21.15.17:0/246655865 --> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e5cb28d8b0 con 0x55e5cb355e30 2023-08-09T12:41:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.712+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] conn(0x55e5cb355e30 0x55e5cb35d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcb5ffb640 10 client.5832 ms_handle_connect on v2:172.21.15.142:6836/2725761547 2023-08-09T12:41:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcd6d9d640 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] conn(0x55e5cb355e30 0x55e5cb35d180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=316b29c71f5b9e83 server_cookie=7ab65e4a4af92727 in_seq=0 out_seq=0 2023-08-09T12:41:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcb5ffb640 1 -- 172.21.15.17:0/246655865 <== mds.0 v2:172.21.15.142:6836/2725761547 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e5cb28d8b0 con 0x55e5cb355e30 2023-08-09T12:41:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcb5ffb640 10 client.5832 handle_command_reply: tid=0 2023-08-09T12:41:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcdfd65740 1 client.5832 shutdown 2023-08-09T12:41:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcdfd65740 1 -- 172.21.15.17:0/246655865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb3cbdd0 msgr2=0x55e5cb3555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb3cbdd0 0x55e5cb3555f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00573d0 tx=0x7fbcd005b000 comp rx=0 tx=0).stop 2023-08-09T12:41:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcdfd65740 1 -- 172.21.15.17:0/246655865 shutdown_connections 2023-08-09T12:41:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:6836/2725761547,v1:172.21.15.142:6837/2725761547] conn(0x55e5cb355e30 0x55e5cb35d180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.713+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5cb3cbdd0 0x55e5cb3555f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e5cb35bf80 0x55e5cb378690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcb5ffb640 0 client.5832 ms_handle_reset on v2:172.21.15.142:6836/2725761547 2023-08-09T12:41:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdfd65740 1 --2- 172.21.15.17:0/246655865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5cb359e30 0x55e5cb378150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdfd65740 1 -- 172.21.15.17:0/246655865 >> 172.21.15.17:0/246655865 conn(0x55e5cb329db0 msgr2=0x55e5cb36e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdfd65740 1 -- 172.21.15.17:0/246655865 shutdown_connections 2023-08-09T12:41:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdfd65740 1 -- 172.21.15.17:0/246655865 wait complete. 2023-08-09T12:41:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdfd65740 20 client.5832 trim_cache size 0 max 16384 2023-08-09T12:41:38.731 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:41:38.731 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:41:38.732 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:41:38.732 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4936, 2023-08-09T12:41:38.732 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:41:38.732 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:41:38.732 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:41:38.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 11.951375999, 2023-08-09T12:41:38.733 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2023-08-09T12:41:38.733 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 51, 2023-08-09T12:41:38.733 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 51, 2023-08-09T12:41:38.733 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 18.464642682000001 2023-08-09T12:41:38.733 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:41:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbcc406a050 msgr2=0x7fbcc406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbcc406a050 0x7fbcc406c510 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8036000 tx=0x7fbcc8030000 comp rx=0 tx=0).stop 2023-08-09T12:41:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/4239248733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 msgr2=0x7fbcd80d2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd80d2760 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c4b0 tx=0x7fbcd000c970 comp rx=0 tx=0).stop 2023-08-09T12:41:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/4239248733 shutdown_connections 2023-08-09T12:41:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbcc406a050 0x7fbcc406c510 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd8160030 0x7fbcd80d2760 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcd80cfb50 0x7fbcd80cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 --2- 172.21.15.17:0/4239248733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd80b86e0 0x7fbcd81f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.714+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/4239248733 >> 172.21.15.17:0/4239248733 conn(0x7fbcd80697c0 msgr2=0x7fbcd80c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.715+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/4239248733 shutdown_connections 2023-08-09T12:41:38.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.715+0000 7fbcdc9f4640 1 -- 172.21.15.17:0/4239248733 wait complete. 2023-08-09T12:41:38.736 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:41:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.942+0000 7f6598988640 1 Processor -- start 2023-08-09T12:41:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.942+0000 7f6598988640 1 -- start start 2023-08-09T12:41:38.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.943+0000 7f6598988640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6594159bd0 0x7f65940ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.943+0000 7f6598988640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f65940697c0 0x7f6594069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.943+0000 7f6598988640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659406fe10 con 0x7f65940b3fe0 2023-08-09T12:41:38.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.943+0000 7f6598988640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940b11a0 con 0x7f65940697c0 2023-08-09T12:41:38.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.943+0000 7f6598988640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659406a190 con 0x7f6594159bd0 2023-08-09T12:41:38.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.943+0000 7f6593fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f65940697c0 0x7f6594069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f6592ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f65940b3fe0 0x7f6594070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57694/0 (socket says 172.21.15.17:57694) 2023-08-09T12:41:38.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f6592ffd640 1 -- 172.21.15.17:0/72088670 learned_addr learned my addr 172.21.15.17:0/72088670 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:38.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f65937fe640 1 --2- 172.21.15.17:0/72088670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6594159bd0 0x7f65940ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f6593fff640 1 -- 172.21.15.17:0/72088670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6594159bd0 msgr2=0x7f65940ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:38.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f6593fff640 1 --2- 172.21.15.17:0/72088670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6594159bd0 0x7f65940ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f6593fff640 1 -- 172.21.15.17:0/72088670 >> v1:172.21.15.17:6789/0 conn(0x7f65940b3fe0 legacy=0x7f6594070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f6593fff640 1 -- 172.21.15.17:0/72088670 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594159fb0 con 0x7f65940697c0 2023-08-09T12:41:38.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f65927fc640 1 -- 172.21.15.17:0/72088670 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699796532 0 0) 0x7f659406fe10 con 0x7f65940b3fe0 2023-08-09T12:41:38.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.944+0000 7f65937fe640 1 --2- 172.21.15.17:0/72088670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6594159bd0 0x7f65940ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:38.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.945+0000 7f6593fff640 1 --2- 172.21.15.17:0/72088670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65940697c0 0x7f6594069c50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f658c009d90 tx=0x7f658c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d7eb3317c77c03 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.945+0000 7f65927fc640 1 -- 172.21.15.17:0/72088670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c02cbd0 con 0x7f65940697c0 2023-08-09T12:41:38.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.945+0000 7f65927fc640 1 -- 172.21.15.17:0/72088670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c02cd30 con 0x7f65940697c0 2023-08-09T12:41:38.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.945+0000 7f65927fc640 1 -- 172.21.15.17:0/72088670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c02cea0 con 0x7f65940697c0 2023-08-09T12:41:38.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.946+0000 7f6598988640 1 -- 172.21.15.17:0/72088670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65940697c0 msgr2=0x7f6594069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.946+0000 7f6598988640 1 --2- 172.21.15.17:0/72088670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65940697c0 0x7f6594069c50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f658c009d90 tx=0x7f658c02be20 comp rx=0 tx=0).stop 2023-08-09T12:41:38.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.946+0000 7f6598988640 1 -- 172.21.15.17:0/72088670 shutdown_connections 2023-08-09T12:41:38.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.946+0000 7f6598988640 1 --2- 172.21.15.17:0/72088670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65940697c0 0x7f6594069c50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.946+0000 7f6598988640 1 --2- 172.21.15.17:0/72088670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6594159bd0 0x7f65940ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.946+0000 7f6598988640 1 -- 172.21.15.17:0/72088670 >> 172.21.15.17:0/72088670 conn(0x7f65940b1d50 msgr2=0x7f659406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:38.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.946+0000 7f6598988640 1 -- 172.21.15.17:0/72088670 shutdown_connections 2023-08-09T12:41:38.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.946+0000 7f6598988640 1 -- 172.21.15.17:0/72088670 wait complete. 2023-08-09T12:41:38.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.948+0000 7f6598988640 1 Processor -- start 2023-08-09T12:41:38.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.948+0000 7f6598988640 1 -- start start 2023-08-09T12:41:38.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6598988640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65940697c0 0x7f65940cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6598988640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65940b3fe0 0x7f65940ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6598988640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6594159bd0 0x7f65940cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6598988640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659415c220 con 0x7f6594159bd0 2023-08-09T12:41:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6598988640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6594151230 con 0x7f65940697c0 2023-08-09T12:41:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6598988640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659415c4c0 con 0x7f65940b3fe0 2023-08-09T12:41:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6593fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6594159bd0 0x7f65940cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6593fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6594159bd0 0x7f65940cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58180/0 (socket says 172.21.15.17:58180) 2023-08-09T12:41:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.949+0000 7f6593fff640 1 -- 172.21.15.17:0/356285156 learned_addr learned my addr 172.21.15.17:0/356285156 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f65937fe640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65940697c0 0x7f65940cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f6593fff640 1 -- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65940b3fe0 msgr2=0x7f65940ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f6593fff640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65940b3fe0 0x7f65940ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f6593fff640 1 -- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65940697c0 msgr2=0x7f65940cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f6593fff640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65940697c0 0x7f65940cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f6593fff640 1 -- 172.21.15.17:0/356285156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c009a70 con 0x7f6594159bd0 2023-08-09T12:41:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f6593fff640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6594159bd0 0x7f65940cd810 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f658c009d90 tx=0x7f658c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f657bfff640 1 -- 172.21.15.17:0/356285156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c02cea0 con 0x7f6594159bd0 2023-08-09T12:41:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f657bfff640 1 -- 172.21.15.17:0/356285156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c003b90 con 0x7f6594159bd0 2023-08-09T12:41:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f657bfff640 1 -- 172.21.15.17:0/356285156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c004030 con 0x7f6594159bd0 2023-08-09T12:41:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.950+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65941514d0 con 0x7f6594159bd0 2023-08-09T12:41:38.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.951+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65941519d0 con 0x7f6594159bd0 2023-08-09T12:41:38.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.952+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6594151660 con 0x7f6594159bd0 2023-08-09T12:41:38.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.953+0000 7f657bfff640 1 -- 172.21.15.17:0/356285156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f658c03b050 con 0x7f6594159bd0 2023-08-09T12:41:38.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.954+0000 7f657bfff640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f658006a050 0x7f658006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.954+0000 7f657bfff640 1 -- 172.21.15.17:0/356285156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f658c0aa970 con 0x7f6594159bd0 2023-08-09T12:41:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.954+0000 7f65937fe640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f658006a050 0x7f658006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.956+0000 7f65937fe640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f658006a050 0x7f658006c510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f658400b840 tx=0x7f6584008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:38.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:38.961+0000 7f657bfff640 1 -- 172.21.15.17:0/356285156 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f658c075fc0 con 0x7f6594159bd0 2023-08-09T12:41:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.192+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f659404e390 con 0x7f6594159bd0 2023-08-09T12:41:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.193+0000 7f657bfff640 1 -- 172.21.15.17:0/356285156 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f658c039020 con 0x7f6594159bd0 2023-08-09T12:41:39.196 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:41:39.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f658006a050 msgr2=0x7f658006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:39.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f658006a050 0x7f658006c510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f658400b840 tx=0x7f6584008040 comp rx=0 tx=0).stop 2023-08-09T12:41:39.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6594159bd0 msgr2=0x7f65940cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:39.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6594159bd0 0x7f65940cd810 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f658c009d90 tx=0x7f658c004a40 comp rx=0 tx=0).stop 2023-08-09T12:41:39.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 shutdown_connections 2023-08-09T12:41:39.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f658006a050 0x7f658006c510 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:39.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6594159bd0 0x7f65940cd810 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:39.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65940b3fe0 0x7f65940ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:39.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.195+0000 7f6598988640 1 --2- 172.21.15.17:0/356285156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65940697c0 0x7f65940cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:39.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.196+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 >> 172.21.15.17:0/356285156 conn(0x7f65940b1d50 msgr2=0x7f65940c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:39.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.196+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 shutdown_connections 2023-08-09T12:41:39.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:39.196+0000 7f6598988640 1 -- 172.21.15.17:0/356285156 wait complete. 2023-08-09T12:41:39.218 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:41:39.219 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:41:39.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:41:39.221 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:41:39.221 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:41:39.222 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:41:39.223 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:41:39.223 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:41:39.224 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:41:39.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:39.226 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:41:39.282 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:41:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:41:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:41:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:41:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:39.283 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:41:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:41:39.283 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:41:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:41:39.284 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:41:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:41:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:41:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42081sec preferred_lft 42081sec 2023-08-09T12:41:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:41:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:39.285 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:41:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:41:39.285 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:41:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:41:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:41:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:39.286 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:41:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:41:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:41:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:39.287 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:41:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:41:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:41:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:39.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:39.289 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:41:39.390 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:41:39.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:39.397 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:41:39.458 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:41:39.458 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:41:39.458 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:41:39.459 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:41:39.459 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:41:39.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:39.459 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:41:39.460 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:41:39.460 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:41:39.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:41:39.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:41:39.461 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:41:39.480 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:41:39.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:41:39.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:39.665 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:41:39.770 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:41:39.770 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:41:39.771 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:41:39.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:39.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:41:39.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:41:39.879 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:41:39.937 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:41:39.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:41:39.938 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:41:39.997 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:41:39.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:39.998 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:41:40.161 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:41:40.162 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:41:40.162 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:41:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:41:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:41:40.185 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:41:40.185 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:41:40.185 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:41:40.211 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:41:40.211 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:41:40.212 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:41:40.212 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:41:40.212 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:41:40.212 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:41:40.212 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:41:40.212 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:41:40.213 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:41:40.213 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:41:40.214 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:41:40.214 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:41:40.214 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:41:40.215 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:41:40.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:40.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:41:40.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:40.336 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:41:40.425 INFO:teuthology.orchestra.run.smithi017.stdout:client5844 2023-08-09T12:41:40.426 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:41:40.427 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:40.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:41:40.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.721+0000 7f279737f640 1 Processor -- start 2023-08-09T12:41:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.721+0000 7f279737f640 1 -- start start 2023-08-09T12:41:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.723+0000 7f279737f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2790070f00 0x7f279015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.723+0000 7f279737f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f279015bce0 0x7f27900cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.723+0000 7f279737f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2790071340 con 0x7f27901587e0 2023-08-09T12:41:40.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.723+0000 7f279737f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27900715c0 con 0x7f279015bce0 2023-08-09T12:41:40.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.723+0000 7f279737f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27900718a0 con 0x7f2790070f00 2023-08-09T12:41:40.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.723+0000 7f2796b7e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f279015bce0 0x7f27900cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:40.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.724+0000 7f2796b7e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f279015bce0 0x7f27900cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58184/0 (socket says 172.21.15.17:58184) 2023-08-09T12:41:40.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.724+0000 7f2796b7e640 1 -- 172.21.15.17:0/54948022 learned_addr learned my addr 172.21.15.17:0/54948022 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:40.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.724+0000 7f2795b7c640 1 --2- 172.21.15.17:0/54948022 >> v2:172.21.15.142:3300/0 conn(0x7f2790070f00 0x7f279015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:40.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.724+0000 7f2796b7e640 1 -- 172.21.15.17:0/54948022 >> v2:172.21.15.142:3300/0 conn(0x7f2790070f00 msgr2=0x7f279015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:40.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.724+0000 7f2796b7e640 1 --2- 172.21.15.17:0/54948022 >> v2:172.21.15.142:3300/0 conn(0x7f2790070f00 0x7f279015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.724+0000 7f2796b7e640 1 -- 172.21.15.17:0/54948022 >> v1:172.21.15.142:6789/0 conn(0x7f27901587e0 legacy=0x7f27900b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:40.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.724+0000 7f2796b7e640 1 -- 172.21.15.17:0/54948022 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2790071b80 con 0x7f279015bce0 2023-08-09T12:41:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.725+0000 7f2796b7e640 1 --2- 172.21.15.17:0/54948022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f279015bce0 0x7f27900cb070 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f279006b8a0 tx=0x7f278802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27c63a4bef60790 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279537b640 1 -- 172.21.15.17:0/54948022 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278802ca80 con 0x7f279015bce0 2023-08-09T12:41:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279537b640 1 -- 172.21.15.17:0/54948022 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278802cbe0 con 0x7f279015bce0 2023-08-09T12:41:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279537b640 1 -- 172.21.15.17:0/54948022 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880343f0 con 0x7f279015bce0 2023-08-09T12:41:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279737f640 1 -- 172.21.15.17:0/54948022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f279015bce0 msgr2=0x7f27900cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279737f640 1 --2- 172.21.15.17:0/54948022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f279015bce0 0x7f27900cb070 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f279006b8a0 tx=0x7f278802bee0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279737f640 1 -- 172.21.15.17:0/54948022 shutdown_connections 2023-08-09T12:41:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279737f640 1 --2- 172.21.15.17:0/54948022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f279015bce0 0x7f27900cb070 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279737f640 1 --2- 172.21.15.17:0/54948022 >> v2:172.21.15.142:3300/0 conn(0x7f2790070f00 0x7f279015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279737f640 1 -- 172.21.15.17:0/54948022 >> 172.21.15.17:0/54948022 conn(0x7f27900b1d50 msgr2=0x7f279006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279737f640 1 -- 172.21.15.17:0/54948022 shutdown_connections 2023-08-09T12:41:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.726+0000 7f279737f640 1 -- 172.21.15.17:0/54948022 wait complete. 2023-08-09T12:41:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.728+0000 7f279737f640 1 Processor -- start 2023-08-09T12:41:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.728+0000 7f279737f640 1 -- start start 2023-08-09T12:41:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.729+0000 7f279737f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2790070f00 0x7f2790150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.729+0000 7f279737f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27901587e0 0x7f279014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.729+0000 7f279737f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f279014d460 0x7f279015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.729+0000 7f279737f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279014cfd0 con 0x7f2790070f00 2023-08-09T12:41:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.729+0000 7f279737f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279014dfd0 con 0x7f27901587e0 2023-08-09T12:41:40.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.729+0000 7f279737f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279014c400 con 0x7f279014d460 2023-08-09T12:41:40.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f279637d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2790070f00 0x7f2790150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:40.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f279637d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2790070f00 0x7f2790150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58200/0 (socket says 172.21.15.17:58200) 2023-08-09T12:41:40.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f2795b7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27901587e0 0x7f279014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:40.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f279637d640 1 -- 172.21.15.17:0/2864008412 learned_addr learned my addr 172.21.15.17:0/2864008412 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:40.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f2796b7e640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f279014d460 0x7f279015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:40.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f279637d640 1 -- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f279014d460 msgr2=0x7f279015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:40.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f279637d640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f279014d460 0x7f279015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f279637d640 1 -- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27901587e0 msgr2=0x7f279014ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:40.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f279637d640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27901587e0 0x7f279014ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.730+0000 7f279637d640 1 -- 172.21.15.17:0/2864008412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2788009b30 con 0x7f2790070f00 2023-08-09T12:41:40.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.731+0000 7f279637d640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2790070f00 0x7f2790150590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c430 tx=0x7f278c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:40.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.731+0000 7f2786ffd640 1 -- 172.21.15.17:0/2864008412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c011790 con 0x7f2790070f00 2023-08-09T12:41:40.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.731+0000 7f2786ffd640 1 -- 172.21.15.17:0/2864008412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c0118f0 con 0x7f2790070f00 2023-08-09T12:41:40.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.731+0000 7f2786ffd640 1 -- 172.21.15.17:0/2864008412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c011ce0 con 0x7f2790070f00 2023-08-09T12:41:40.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.731+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279014c6a0 con 0x7f2790070f00 2023-08-09T12:41:40.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.731+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279014cc60 con 0x7f2790070f00 2023-08-09T12:41:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.732+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279006fa10 con 0x7f2790070f00 2023-08-09T12:41:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.733+0000 7f2786ffd640 1 -- 172.21.15.17:0/2864008412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f278c01c460 con 0x7f2790070f00 2023-08-09T12:41:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.734+0000 7f2786ffd640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f277406a050 0x7f277406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.734+0000 7f2786ffd640 1 -- 172.21.15.17:0/2864008412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f278c0884c0 con 0x7f2790070f00 2023-08-09T12:41:40.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.735+0000 7f2795b7c640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f277406a050 0x7f277406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:40.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.736+0000 7f2795b7c640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f277406a050 0x7f277406c510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f27900b06f0 tx=0x7f2780008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.739+0000 7f2786ffd640 1 -- 172.21.15.17:0/2864008412 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f279006fa10 con 0x7f2790070f00 2023-08-09T12:41:40.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.969+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f279006fa10 con 0x7f2790070f00 2023-08-09T12:41:40.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.970+0000 7f2786ffd640 1 -- 172.21.15.17:0/2864008412 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f279006fa10 con 0x7f2790070f00 2023-08-09T12:41:40.973 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:41:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f277406a050 msgr2=0x7f277406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f277406a050 0x7f277406c510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f27900b06f0 tx=0x7f2780008040 comp rx=0 tx=0).stop 2023-08-09T12:41:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2790070f00 msgr2=0x7f2790150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2790070f00 0x7f2790150590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c430 tx=0x7f278c00c8f0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 shutdown_connections 2023-08-09T12:41:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f277406a050 0x7f277406c510 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f279014d460 0x7f279015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27901587e0 0x7f279014ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 --2- 172.21.15.17:0/2864008412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2790070f00 0x7f2790150590 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 >> 172.21.15.17:0/2864008412 conn(0x7f27900b1d50 msgr2=0x7f27900b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 shutdown_connections 2023-08-09T12:41:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:40.973+0000 7f279737f640 1 -- 172.21.15.17:0/2864008412 wait complete. 2023-08-09T12:41:40.997 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:41:40.997 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:41:40.998 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:41:40.998 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:41:40.998 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:41:40.999 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:41:40.999 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:41:40.999 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:41:41.000 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:41:41.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.000 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:41:41.062 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:41:41.062 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:41:41.062 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:41:41.062 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:41.062 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:41:41.063 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:41.063 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:41:41.063 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:41.063 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:41:41.064 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:41:41.064 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:41.064 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:41:41.064 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:41:41.064 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:41.064 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:41:41.064 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:41.065 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:41:41.065 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42067sec preferred_lft 42067sec 2023-08-09T12:41:41.065 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:41:41.065 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:41.065 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:41:41.065 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:41:41.065 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:41:41.065 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:41.066 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:41:41.066 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:41.066 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:41:41.066 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:41:41.066 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:41:41.066 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:41.067 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:41:41.067 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:41:41.067 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:41:41.067 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:41:41.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.068 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:41:41.161 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:41:41.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.165 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:41:41.219 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:41:41.219 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:41:41.220 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:41:41.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:41:41.220 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:41:41.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.221 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:41:41.221 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:41:41.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:41:41.222 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:41:41.222 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:41:41.222 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:41:41.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.407 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:41:41.459 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:41:41.460 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:41:41.461 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:41:41.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.462 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:41:41.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:41:41.553 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:41:41.610 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:41:41.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:41:41.612 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:41:41.663 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:41:41.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:41:41.806 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:41:41.806 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:41:41.806 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:41:41.827 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:41:41.827 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:41:41.828 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:41:41.828 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:41:41.828 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:41:41.851 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:41:41.852 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:41:41.852 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:41:41.852 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:41:41.852 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:41:41.852 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:41:41.852 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:41:41.853 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:41:41.853 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:41:41.853 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:41:41.854 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:41:41.854 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:41:41.854 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:41:41.858 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:41:41.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:41:41.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:41.937 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:41:41.989 INFO:teuthology.orchestra.run.smithi142.stdout:client5853 2023-08-09T12:41:41.989 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:41:41.990 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:42.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:42.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.284+0000 7f85af566640 1 Processor -- start 2023-08-09T12:41:42.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.284+0000 7f85af566640 1 -- start start 2023-08-09T12:41:42.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.285+0000 7f85af566640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85a8160030 0x7f85a8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:42.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.285+0000 7f85af566640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a80b86e0 0x7f85a80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:42.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.285+0000 7f85af566640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a80b5a30 con 0x7f85a80cf980 2023-08-09T12:41:42.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.285+0000 7f85af566640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80d1110 con 0x7f85a8160030 2023-08-09T12:41:42.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.285+0000 7f85af566640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80ceac0 con 0x7f85a80b86e0 2023-08-09T12:41:42.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.286+0000 7f85ae564640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85a8160030 0x7f85a8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:42.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.286+0000 7f85ae564640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85a8160030 0x7f85a8160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58206/0 (socket says 172.21.15.17:58206) 2023-08-09T12:41:42.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.286+0000 7f85ae564640 1 -- 172.21.15.17:0/573262325 learned_addr learned my addr 172.21.15.17:0/573262325 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:42.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.286+0000 7f85add63640 1 --2- 172.21.15.17:0/573262325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a80b86e0 0x7f85a80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:42.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.286+0000 7f85ae564640 1 -- 172.21.15.17:0/573262325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a80b86e0 msgr2=0x7f85a80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:42.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.286+0000 7f85ae564640 1 --2- 172.21.15.17:0/573262325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a80b86e0 0x7f85a80cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.286+0000 7f85ae564640 1 -- 172.21.15.17:0/573262325 >> v1:172.21.15.142:6789/0 conn(0x7f85a80cf980 legacy=0x7f85a80b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:42.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.286+0000 7f85ae564640 1 -- 172.21.15.17:0/573262325 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80d0d70 con 0x7f85a8160030 2023-08-09T12:41:42.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.288+0000 7f85ae564640 1 --2- 172.21.15.17:0/573262325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a8160030 0x7f85a8160740 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009e50 tx=0x7f85a402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eab0881c2cc1139 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:42.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.288+0000 7f85ad562640 1 -- 172.21.15.17:0/573262325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a402cb00 con 0x7f85a8160030 2023-08-09T12:41:42.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.288+0000 7f85ad562640 1 -- 172.21.15.17:0/573262325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a402cc60 con 0x7f85a8160030 2023-08-09T12:41:42.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.288+0000 7f85ad562640 1 -- 172.21.15.17:0/573262325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40343f0 con 0x7f85a8160030 2023-08-09T12:41:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.288+0000 7f85af566640 1 -- 172.21.15.17:0/573262325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a8160030 msgr2=0x7f85a8160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.288+0000 7f85af566640 1 --2- 172.21.15.17:0/573262325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a8160030 0x7f85a8160740 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009e50 tx=0x7f85a402bf60 comp rx=0 tx=0).stop 2023-08-09T12:41:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.289+0000 7f85af566640 1 -- 172.21.15.17:0/573262325 shutdown_connections 2023-08-09T12:41:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.289+0000 7f85af566640 1 --2- 172.21.15.17:0/573262325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a80b86e0 0x7f85a80cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.289+0000 7f85af566640 1 --2- 172.21.15.17:0/573262325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a8160030 0x7f85a8160740 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.289+0000 7f85af566640 1 -- 172.21.15.17:0/573262325 >> 172.21.15.17:0/573262325 conn(0x7f85a80697c0 msgr2=0x7f85a8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.289+0000 7f85af566640 1 -- 172.21.15.17:0/573262325 shutdown_connections 2023-08-09T12:41:42.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.289+0000 7f85af566640 1 -- 172.21.15.17:0/573262325 wait complete. 2023-08-09T12:41:42.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.290+0000 7f85af566640 1 Processor -- start 2023-08-09T12:41:42.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.291+0000 7f85af566640 1 -- start start 2023-08-09T12:41:42.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85af566640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a80b86e0 0x7f85a81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:42.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85af566640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85a80cf980 0x7f85a814d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:42.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85af566640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a8160030 0x7f85a80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:42.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85af566640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81f5940 con 0x7f85a80b86e0 2023-08-09T12:41:42.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85af566640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81f5be0 con 0x7f85a80cf980 2023-08-09T12:41:42.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85af566640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81f5ec0 con 0x7f85a8160030 2023-08-09T12:41:42.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85ae564640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a80b86e0 0x7f85a81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:42.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85ae564640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a80b86e0 0x7f85a81530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58214/0 (socket says 172.21.15.17:58214) 2023-08-09T12:41:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85ae564640 1 -- 172.21.15.17:0/537444123 learned_addr learned my addr 172.21.15.17:0/537444123 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85add63640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85a80cf980 0x7f85a814d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85aed65640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a8160030 0x7f85a80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85ae564640 1 -- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a8160030 msgr2=0x7f85a80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85ae564640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a8160030 0x7f85a80cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85ae564640 1 -- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85a80cf980 msgr2=0x7f85a814d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85ae564640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85a80cf980 0x7f85a814d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85ae564640 1 -- 172.21.15.17:0/537444123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a4009b30 con 0x7f85a80b86e0 2023-08-09T12:41:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.292+0000 7f85add63640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85a80cf980 0x7f85a814d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.293+0000 7f85ae564640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a80b86e0 0x7f85a81530f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f85a4000f80 tx=0x7f85a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.293+0000 7f859effd640 1 -- 172.21.15.17:0/537444123 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a403e450 con 0x7f85a80b86e0 2023-08-09T12:41:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.293+0000 7f859effd640 1 -- 172.21.15.17:0/537444123 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a403e5f0 con 0x7f85a80b86e0 2023-08-09T12:41:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.293+0000 7f859effd640 1 -- 172.21.15.17:0/537444123 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a403e9a0 con 0x7f85a80b86e0 2023-08-09T12:41:42.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.293+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a81f61a0 con 0x7f85a80b86e0 2023-08-09T12:41:42.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.293+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a8153630 con 0x7f85a80b86e0 2023-08-09T12:41:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.294+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a81f66c0 con 0x7f85a80b86e0 2023-08-09T12:41:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.295+0000 7f859effd640 1 -- 172.21.15.17:0/537444123 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f85a403eb00 con 0x7f85a80b86e0 2023-08-09T12:41:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.296+0000 7f859effd640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f858c06a050 0x7f858c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.296+0000 7f859effd640 1 -- 172.21.15.17:0/537444123 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85a40ab600 con 0x7f85a80b86e0 2023-08-09T12:41:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.297+0000 7f85add63640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f858c06a050 0x7f858c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.298+0000 7f85add63640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f858c06a050 0x7f858c06c510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f85a80cc280 tx=0x7f8598008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:42.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.301+0000 7f859effd640 1 -- 172.21.15.17:0/537444123 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f85a81f66c0 con 0x7f85a80b86e0 2023-08-09T12:41:42.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.531+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85a81f66c0 con 0x7f85a80b86e0 2023-08-09T12:41:42.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.533+0000 7f859effd640 1 -- 172.21.15.17:0/537444123 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f85a81f66c0 con 0x7f85a80b86e0 2023-08-09T12:41:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:42.536 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:41:42.537 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:41:42.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f858c06a050 msgr2=0x7f858c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:42.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f858c06a050 0x7f858c06c510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f85a80cc280 tx=0x7f8598008040 comp rx=0 tx=0).stop 2023-08-09T12:41:42.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a80b86e0 msgr2=0x7f85a81530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a80b86e0 0x7f85a81530f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f85a4000f80 tx=0x7f85a4004a40 comp rx=0 tx=0).stop 2023-08-09T12:41:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 shutdown_connections 2023-08-09T12:41:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f858c06a050 0x7f858c06c510 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85a8160030 0x7f85a80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85a80cf980 0x7f85a814d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 --2- 172.21.15.17:0/537444123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a80b86e0 0x7f85a81530f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.535+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 >> 172.21.15.17:0/537444123 conn(0x7f85a80697c0 msgr2=0x7f85a80c6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:42.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.536+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 shutdown_connections 2023-08-09T12:41:42.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:42.536+0000 7f85af566640 1 -- 172.21.15.17:0/537444123 wait complete. 2023-08-09T12:41:42.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-08-09T12:41:42.813 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":4936,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.032639570000001,"mdsmap_epoch":26,"osdmap_epoch":51,"osdmap_epoch_barrier":51,"uptime":22.545967346000001} 2023-08-09T12:41:42.813 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 4936, "mdsmap_epoch": 26, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "rank_uptime": 16.03263957, "state": "up:active", "uptime": 22.545967346, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:41:42.814 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-09T12:41:43.069 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_mon_report_interval":"5"} 2023-08-09T12:41:43.069 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-09T12:41:43.070 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-08-09T12:41:43.070 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:41:43.070 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:43.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:43.123 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-08-09T12:41:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:265+0 records in 2023-08-09T12:41:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:265+0 records out 2023-08-09T12:41:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.90619 s, 146 MB/s 2023-08-09T12:41:45.095 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:41:45.095 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:45.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:45.139 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-08-09T12:41:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:292+0 records in 2023-08-09T12:41:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:292+0 records out 2023-08-09T12:41:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.08539 s, 147 MB/s 2023-08-09T12:41:47.328 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-08-09T12:41:47.329 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:41:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.521+0000 7f4fc2404640 1 Processor -- start 2023-08-09T12:41:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.521+0000 7f4fc2404640 1 -- start start 2023-08-09T12:41:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.522+0000 7f4fc2404640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4fbc1616e0 0x7f4fbc0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.522+0000 7f4fc2404640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc0d29d0 0x7f4fbc0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.522+0000 7f4fc2404640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc0cdd10 con 0x7f4fbc15ce90 2023-08-09T12:41:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.522+0000 7f4fc2404640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc0b6540 con 0x7f4fbc1616e0 2023-08-09T12:41:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.522+0000 7f4fc2404640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0d33a0 con 0x7f4fbc0d29d0 2023-08-09T12:41:47.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.523+0000 7f4fc09a1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc0d29d0 0x7f4fbc0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:47.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.523+0000 7f4fc09a1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc0d29d0 0x7f4fbc0d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:39712/0 (socket says 172.21.15.17:39712) 2023-08-09T12:41:47.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.523+0000 7f4fc09a1640 1 -- 172.21.15.17:0/2072553626 learned_addr learned my addr 172.21.15.17:0/2072553626 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:47.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.523+0000 7f4fbb7fe640 1 --2- 172.21.15.17:0/2072553626 >> v2:172.21.15.142:3300/0 conn(0x7f4fbc1616e0 0x7f4fbc0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.524+0000 7f4fbaffd640 1 -- 172.21.15.17:0/2072553626 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802475808 0 0) 0x7f4fbc0cdd10 con 0x7f4fbc15ce90 2023-08-09T12:41:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.524+0000 7f4fbaffd640 1 -- 172.21.15.17:0/2072553626 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa8003520 con 0x7f4fbc15ce90 2023-08-09T12:41:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.524+0000 7f4fc09a1640 1 -- 172.21.15.17:0/2072553626 >> v2:172.21.15.142:3300/0 conn(0x7f4fbc1616e0 msgr2=0x7f4fbc0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.524+0000 7f4fc09a1640 1 --2- 172.21.15.17:0/2072553626 >> v2:172.21.15.142:3300/0 conn(0x7f4fbc1616e0 0x7f4fbc0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.524+0000 7f4fc09a1640 1 -- 172.21.15.17:0/2072553626 >> v1:172.21.15.142:6789/0 conn(0x7f4fbc15ce90 legacy=0x7f4fbc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.524+0000 7f4fc09a1640 1 -- 172.21.15.17:0/2072553626 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0cdff0 con 0x7f4fbc0d29d0 2023-08-09T12:41:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.526+0000 7f4fc09a1640 1 --2- 172.21.15.17:0/2072553626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc0d29d0 0x7f4fbc0d2e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009870 tx=0x7f4fb402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6dde6ef4953c670 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.526+0000 7f4fbaffd640 1 -- 172.21.15.17:0/2072553626 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4030840 con 0x7f4fbc0d29d0 2023-08-09T12:41:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.526+0000 7f4fbaffd640 1 -- 172.21.15.17:0/2072553626 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb40309a0 con 0x7f4fbc0d29d0 2023-08-09T12:41:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.526+0000 7f4fbaffd640 1 -- 172.21.15.17:0/2072553626 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4030d30 con 0x7f4fbc0d29d0 2023-08-09T12:41:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.527+0000 7f4fc2404640 1 -- 172.21.15.17:0/2072553626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc0d29d0 msgr2=0x7f4fbc0d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.527+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2072553626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc0d29d0 0x7f4fbc0d2e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009870 tx=0x7f4fb402b980 comp rx=0 tx=0).stop 2023-08-09T12:41:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.527+0000 7f4fc2404640 1 -- 172.21.15.17:0/2072553626 shutdown_connections 2023-08-09T12:41:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.527+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2072553626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc0d29d0 0x7f4fbc0d2e60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.527+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2072553626 >> v2:172.21.15.142:3300/0 conn(0x7f4fbc1616e0 0x7f4fbc0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.527+0000 7f4fc2404640 1 -- 172.21.15.17:0/2072553626 >> 172.21.15.17:0/2072553626 conn(0x7f4fbc06fde0 msgr2=0x7f4fbc0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.527+0000 7f4fc2404640 1 -- 172.21.15.17:0/2072553626 shutdown_connections 2023-08-09T12:41:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.527+0000 7f4fc2404640 1 -- 172.21.15.17:0/2072553626 wait complete. 2023-08-09T12:41:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.529+0000 7f4fc2404640 1 Processor -- start 2023-08-09T12:41:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.529+0000 7f4fc2404640 1 -- start start 2023-08-09T12:41:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fc2404640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc0d29d0 0x7f4fbc1f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fc2404640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fbc15ce90 0x7f4fbc0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fc2404640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc1616e0 0x7f4fbc0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fc2404640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc1f36f0 con 0x7f4fbc15ce90 2023-08-09T12:41:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fc2404640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc1f6df0 con 0x7f4fbc0d29d0 2023-08-09T12:41:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fc2404640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc1f2a70 con 0x7f4fbc1616e0 2023-08-09T12:41:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fbb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fbc15ce90 0x7f4fbc0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fbb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fbc15ce90 0x7f4fbc0cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58226/0 (socket says 172.21.15.17:58226) 2023-08-09T12:41:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fbb7fe640 1 -- 172.21.15.17:0/2111456426 learned_addr learned my addr 172.21.15.17:0/2111456426 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fc09a1640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc1616e0 0x7f4fbc0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.530+0000 7f4fbbfff640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc0d29d0 0x7f4fbc1f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:47.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fbb7fe640 1 -- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc1616e0 msgr2=0x7f4fbc0cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:47.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fbb7fe640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc1616e0 0x7f4fbc0cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fbb7fe640 1 -- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc0d29d0 msgr2=0x7f4fbc1f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:47.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fbb7fe640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc0d29d0 0x7f4fbc1f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fbb7fe640 1 -- 172.21.15.17:0/2111456426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb40094d0 con 0x7f4fbc15ce90 2023-08-09T12:41:47.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fbbfff640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc0d29d0 0x7f4fbc1f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:47.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fbb7fe640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fbc15ce90 0x7f4fbc0cb860 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400efc0 tx=0x7f4fa400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:47.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fb8ff9640 1 -- 172.21.15.17:0/2111456426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4009b80 con 0x7f4fbc15ce90 2023-08-09T12:41:47.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fb8ff9640 1 -- 172.21.15.17:0/2111456426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa400f040 con 0x7f4fbc15ce90 2023-08-09T12:41:47.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fb8ff9640 1 -- 172.21.15.17:0/2111456426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40146a0 con 0x7f4fbc15ce90 2023-08-09T12:41:47.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc1f2d50 con 0x7f4fbc15ce90 2023-08-09T12:41:47.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.531+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc1f3310 con 0x7f4fbc15ce90 2023-08-09T12:41:47.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.533+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc067a80 con 0x7f4fbc15ce90 2023-08-09T12:41:47.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.533+0000 7f4fb8ff9640 1 -- 172.21.15.17:0/2111456426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4fa4014800 con 0x7f4fbc15ce90 2023-08-09T12:41:47.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.534+0000 7f4fb8ff9640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f9c06a050 0x7f4f9c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:47.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.534+0000 7f4fb8ff9640 1 -- 172.21.15.17:0/2111456426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fa40891c0 con 0x7f4fbc15ce90 2023-08-09T12:41:47.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.535+0000 7f4fbbfff640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f9c06a050 0x7f4f9c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:47.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.536+0000 7f4fbbfff640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f9c06a050 0x7f4f9c06c510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0011e0 tx=0x7f4fac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:47.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.539+0000 7f4fb8ff9640 1 -- 172.21.15.17:0/2111456426 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4fa4058330 con 0x7f4fbc15ce90 2023-08-09T12:41:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.731+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4fbc0d0ad0 con 0x7f4fbc15ce90 2023-08-09T12:41:47.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.733+0000 7f4fb8ff9640 1 -- 172.21.15.17:0/2111456426 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+36974 (secure 0 0 0) 0x7f4fa4057ec0 con 0x7f4fbc15ce90 2023-08-09T12:41:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:47.737 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:41:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 51, 2023-08-09T12:41:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:41:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:41:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:41:27.727631+0000", 2023-08-09T12:41:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:41:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:41:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:41:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:41:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:41:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:41:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:41:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:41:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:41:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:41:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:41:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:41:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:41:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:41:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 8, 2023-08-09T12:41:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:41:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:41:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:41:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:41:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:41:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:41:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:41:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:41:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:41:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:41:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:41:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:41:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:41:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:41:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:41:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:41:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "17", 2023-08-09T12:41:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:41:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:41:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:41:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:41:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:41:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:41:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:41:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:41:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:41:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:41:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:41:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:41:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:41:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:41:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:41:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:41:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:41:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:41:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "20", 2023-08-09T12:41:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:41:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:41:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:41:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:41:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:41:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:41:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:41:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-08-09T12:41:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:41:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:23.866427+0000", 2023-08-09T12:41:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:41:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:41:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:41:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:41:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:41:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:41:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:41:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "50", 2023-08-09T12:41:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:41:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:41:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:41:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 8, 2023-08-09T12:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:25.245820+0000", 2023-08-09T12:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:41:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:41:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:41:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:41:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:41:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "51", 2023-08-09T12:41:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:41:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:41:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:41:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:41:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.8799999952316284, 2023-08-09T12:41:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.8799999952316284, 2023-08-09T12:41:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:41:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-09T12:41:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-09T12:41:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:41:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:41:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:41:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:41:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:41:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:41:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:41:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:41:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:41:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:41:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:41:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:41:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:41:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:41:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:41:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:41:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:41:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:41:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:41:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:41:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:41:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:41:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:41:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:41:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:41:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:41:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:41:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:41:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:41:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:41:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:41:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:41:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:41:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:41:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:41:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:41:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:41:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:41:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:41:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:41:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:41:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:41:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:41:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:41:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:41:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:41:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:41:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:41:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:41:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:41:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:41:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:41:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:41:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:41:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:41:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:41:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:41:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:41:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:41:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:41:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:41:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:41:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:41:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:41:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:41:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:41:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:41:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:41:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:41:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:41:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:41:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:41:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:41:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:41:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:41:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:41:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:41:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:41:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:41:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:41:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:41:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:41:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:41:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:41:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:41:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:41:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:41:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:41:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:41:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:41:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:41:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:41:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:41:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:41:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:41:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:41:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:41:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:41:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:41:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:41:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:41:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:41:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:41:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:41:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:41:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:41:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:41:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:41:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:41:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:41:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:41:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:41:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:41:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:41:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:41:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:41:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:41:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:41:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:41:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:41:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:41:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:41:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:41:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:41:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:41:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:41:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:41:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:41:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:41:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:41:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:41:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:41:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:41:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:41:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:41:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:41:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:41:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:41:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:41:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:41:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:41:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:41:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:41:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:41:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:41:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:41:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:47.892 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:41:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.735+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f9c06a050 msgr2=0x7f4f9c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.735+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f9c06a050 0x7f4f9c06c510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0011e0 tx=0x7f4fac009040 comp rx=0 tx=0).stop 2023-08-09T12:41:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.735+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fbc15ce90 msgr2=0x7f4fbc0cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.735+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fbc15ce90 0x7f4fbc0cb860 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400efc0 tx=0x7f4fa400c490 comp rx=0 tx=0).stop 2023-08-09T12:41:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.736+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 shutdown_connections 2023-08-09T12:41:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.736+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f9c06a050 0x7f4f9c06c510 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.736+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fbc1616e0 0x7f4fbc0cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.736+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fbc15ce90 0x7f4fbc0cb860 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.736+0000 7f4fc2404640 1 --2- 172.21.15.17:0/2111456426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc0d29d0 0x7f4fbc1f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.736+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 >> 172.21.15.17:0/2111456426 conn(0x7f4fbc06fde0 msgr2=0x7f4fbc0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.736+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 shutdown_connections 2023-08-09T12:41:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:47.736+0000 7f4fc2404640 1 -- 172.21.15.17:0/2111456426 wait complete. 2023-08-09T12:41:47.896 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:41:49.691 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:41:49.688+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check failed: 3 full osd(s) (OSD_FULL) 2023-08-09T12:41:52.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:41:53.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.130+0000 7fa8b52f3640 1 Processor -- start 2023-08-09T12:41:53.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.130+0000 7fa8b52f3640 1 -- start start 2023-08-09T12:41:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.132+0000 7fa8b52f3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8b00cb070 0x7fa8b00cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.132+0000 7fa8b52f3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00cb9e0 con 0x7fa8b01587e0 2023-08-09T12:41:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.132+0000 7fa8b52f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b0071340 con 0x7fa8b0070f00 2023-08-09T12:41:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.132+0000 7fa8b52f3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b015beb0 con 0x7fa8b00cb070 2023-08-09T12:41:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.132+0000 7fa8affff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa8b01587e0 0x7fa8b00b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41608/0 (socket says 172.21.15.17:41608) 2023-08-09T12:41:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.132+0000 7fa8affff640 1 -- 172.21.15.17:0/1956659040 learned_addr learned my addr 172.21.15.17:0/1956659040 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.133+0000 7fa8b4af2640 1 --2- 172.21.15.17:0/1956659040 >> v2:172.21.15.142:3300/0 conn(0x7fa8b00cb070 0x7fa8b00cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.133+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704852227 0 0) 0x7fa8b00cb9e0 con 0x7fa8b01587e0 2023-08-09T12:41:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.133+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa898003520 con 0x7fa8b01587e0 2023-08-09T12:41:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589252288 0 0) 0x7fa898003520 con 0x7fa8b01587e0 2023-08-09T12:41:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 >> v2:172.21.15.142:3300/0 conn(0x7fa8b00cb070 msgr2=0x7fa8b00cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 --2- 172.21.15.17:0/1956659040 >> v2:172.21.15.142:3300/0 conn(0x7fa8b00cb070 0x7fa8b00cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 >> v1:172.21.15.142:6789/0 conn(0x7fa8b0070f00 legacy=0x7fa8b015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00715c0 con 0x7fa8b01587e0 2023-08-09T12:41:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa8a0001670 con 0x7fa8b01587e0 2023-08-09T12:41:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 >> v1:172.21.15.17:6789/0 conn(0x7fa8b01587e0 legacy=0x7fa8b00b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa898003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980047c0 0x7fa898004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898005180 0x7fa89800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b015beb0 con 0x7fa8980039c0 2023-08-09T12:41:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa898010490 con 0x7fa8980047c0 2023-08-09T12:41:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa898010650 con 0x7fa898005180 2023-08-09T12:41:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8affff640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa898003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.134+0000 7fa8af7fe640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980047c0 0x7fa898004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.135+0000 7fa8b4af2640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898005180 0x7fa89800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.135+0000 7fa8affff640 1 -- 172.21.15.17:0/1956659040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898005180 msgr2=0x7fa89800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.135+0000 7fa8affff640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898005180 0x7fa89800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.135+0000 7fa8affff640 1 -- 172.21.15.17:0/1956659040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980047c0 msgr2=0x7fa898004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.135+0000 7fa8affff640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8980047c0 0x7fa898004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.135+0000 7fa8affff640 1 -- 172.21.15.17:0/1956659040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898003520 con 0x7fa8980039c0 2023-08-09T12:41:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.135+0000 7fa8b4af2640 1 -- 172.21.15.17:0/1956659040 reap_dead start 2023-08-09T12:41:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.136+0000 7fa8affff640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa898003de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c0e0 tx=0x7fa8980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1fc23ecb982894 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0005ad0 con 0x7fa8980039c0 2023-08-09T12:41:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0005c30 con 0x7fa8980039c0 2023-08-09T12:41:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8aeffd640 1 -- 172.21.15.17:0/1956659040 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0007070 con 0x7fa8980039c0 2023-08-09T12:41:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8b52f3640 1 -- 172.21.15.17:0/1956659040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 msgr2=0x7fa898003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8b52f3640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa898003de0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c0e0 tx=0x7fa8980057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8b52f3640 1 -- 172.21.15.17:0/1956659040 shutdown_connections 2023-08-09T12:41:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8b52f3640 1 --2- 172.21.15.17:0/1956659040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa898003de0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8b52f3640 1 -- 172.21.15.17:0/1956659040 >> 172.21.15.17:0/1956659040 conn(0x7fa8b00b1d50 msgr2=0x7fa8b006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8b52f3640 1 -- 172.21.15.17:0/1956659040 shutdown_connections 2023-08-09T12:41:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.137+0000 7fa8b52f3640 1 -- 172.21.15.17:0/1956659040 wait complete. 2023-08-09T12:41:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.139+0000 7fa8b52f3640 1 Processor -- start 2023-08-09T12:41:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.139+0000 7fa8b52f3640 1 -- start start 2023-08-09T12:41:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.140+0000 7fa8b52f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa8b01523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.140+0000 7fa8b52f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8b0159c30 0x7fa8b015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.140+0000 7fa8b52f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8b01550d0 0x7fa8b0155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.140+0000 7fa8b52f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00c2b00 con 0x7fa8980039c0 2023-08-09T12:41:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.140+0000 7fa8b52f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b015a5f0 con 0x7fa8b01550d0 2023-08-09T12:41:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.140+0000 7fa8b52f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00c2900 con 0x7fa8b0159c30 2023-08-09T12:41:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa8b01523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa8b01523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44386/0 (socket says 172.21.15.17:44386) 2023-08-09T12:41:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8affff640 1 -- 172.21.15.17:0/3938085079 learned_addr learned my addr 172.21.15.17:0/3938085079 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8af7fe640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8b0159c30 0x7fa8b015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8affff640 1 -- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8b0159c30 msgr2=0x7fa8b015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8affff640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8b0159c30 0x7fa8b015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8affff640 1 -- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8b01550d0 msgr2=0x7fa8b0155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8affff640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8b01550d0 0x7fa8b0155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.141+0000 7fa8affff640 1 -- 172.21.15.17:0/3938085079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b0155eb0 con 0x7fa8980039c0 2023-08-09T12:41:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.142+0000 7fa8affff640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa8b01523a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa8a002c310 tx=0x7fa8a0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.142+0000 7fa8acff9640 1 -- 172.21.15.17:0/3938085079 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a003c070 con 0x7fa8980039c0 2023-08-09T12:41:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.142+0000 7fa8acff9640 1 -- 172.21.15.17:0/3938085079 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0007280 con 0x7fa8980039c0 2023-08-09T12:41:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.142+0000 7fa8acff9640 1 -- 172.21.15.17:0/3938085079 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00075f0 con 0x7fa8980039c0 2023-08-09T12:41:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.142+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b0156190 con 0x7fa8980039c0 2023-08-09T12:41:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.142+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b0156750 con 0x7fa8980039c0 2023-08-09T12:41:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.143+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b00662a0 con 0x7fa8980039c0 2023-08-09T12:41:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.145+0000 7fa8acff9640 1 -- 172.21.15.17:0/3938085079 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa8a0032070 con 0x7fa8980039c0 2023-08-09T12:41:53.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.146+0000 7fa8acff9640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa89c06a080 0x7fa89c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:53.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.146+0000 7fa8acff9640 1 -- 172.21.15.17:0/3938085079 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8a00a8e20 con 0x7fa8980039c0 2023-08-09T12:41:53.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.146+0000 7fa8acff9640 1 -- 172.21.15.17:0/3938085079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7fa89c0721d0 con 0x7fa8980039c0 2023-08-09T12:41:53.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.146+0000 7fa8af7fe640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa89c06a080 0x7fa89c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:53.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.147+0000 7fa8af7fe640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa89c06a080 0x7fa89c06c540 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4000c00 tx=0x7fa8a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.153+0000 7fa8acff9640 1 -- 172.21.15.17:0/3938085079 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa8a0045070 con 0x7fa8980039c0 2023-08-09T12:41:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.350+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa8b004e390 con 0x7fa8980039c0 2023-08-09T12:41:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.352+0000 7fa8acff9640 1 -- 172.21.15.17:0/3938085079 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+37090 (secure 0 0 0) 0x7fa8a00746d0 con 0x7fa8980039c0 2023-08-09T12:41:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:53.357 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:41:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 53, 2023-08-09T12:41:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:41:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:41:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:41:50.699382+0000", 2023-08-09T12:41:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:41:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:41:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:41:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:41:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:41:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:41:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:41:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:41:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:41:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:41:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:41:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:41:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:41:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:41:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 8, 2023-08-09T12:41:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:41:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:41:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:41:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:41:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:41:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:41:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:41:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:41:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:41:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:41:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:41:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:41:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:41:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:41:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:41:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:41:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:41:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:41:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:41:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:41:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:41:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:41:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:41:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:41:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:41:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:41:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:41:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:41:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:41:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:41:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:41:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:41:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:41:53.396 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:41:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:41:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:41:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:41:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-08-09T12:41:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:41:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:23.866427+0000", 2023-08-09T12:41:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:53.398 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:53.399 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:41:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:41:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:41:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:41:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:41:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.403 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:53.404 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:53.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:53.406 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:53.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:53.408 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:41:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:41:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:41:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:41:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:41:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:53.410 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:41:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:41:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:41:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:41:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:41:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:53.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 8, 2023-08-09T12:41:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:41:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:25.245820+0000", 2023-08-09T12:41:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:41:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:41:53.414 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:41:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:41:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:41:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:53.416 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:53.418 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:53.419 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:53.420 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:53.421 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:53.422 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:41:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:41:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:41:53.423 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:41:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.8799999952316284, 2023-08-09T12:41:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.8799999952316284, 2023-08-09T12:41:53.424 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:41:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-09T12:41:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-09T12:41:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:53.425 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:41:53.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:41:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:53.427 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:53.428 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:53.429 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.430 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:41:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:41:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:53.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:41:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:53.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:41:53.435 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:41:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:41:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:41:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:41:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:53.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:41:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:41:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:41:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:41:53.440 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:41:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:53.441 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:53.442 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:41:53.443 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:41:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:41:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:53.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:41:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.446 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:41:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:41:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:53.448 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:41:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.449 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:41:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:41:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:41:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:41:53.450 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:41:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:41:53.451 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:53.452 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.453 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:41:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:41:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:41:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:41:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:41:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:41:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:53.458 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:41:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.459 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:41:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:41:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:41:53.460 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:41:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:41:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:41:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:53.462 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:53.463 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:41:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:41:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:41:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:41:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:41:53.468 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:41:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:41:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:41:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:53.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.472 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.472 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:41:53.473 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:41:53.473 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:41:53.473 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:41:53.473 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:53.473 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:53.474 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:53.474 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:53.474 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.475 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:41:53.475 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:53.475 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:53.475 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:53.475 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:53.475 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:53.475 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:53.476 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:53.476 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:53.476 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:53.476 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:53.476 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:53.476 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:53.476 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.477 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:41:53.477 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:53.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.478 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:41:53.478 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:53.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.479 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.479 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:53.480 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.480 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:41:53.481 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:53.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.482 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:41:53.482 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:53.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.483 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.483 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:53.483 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.484 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:41:53.484 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:53.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.486 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:41:53.486 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:53.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.486 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:53.487 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.487 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:41:53.487 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:53.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.488 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:41:53.488 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:53.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.488 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.489 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:41:53.489 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:41:53.489 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:41:53.490 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:41:53.490 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:53.490 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:53.490 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:53.491 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.491 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:41:53.492 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:53.492 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:53.492 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:53.492 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:53.493 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:53.493 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:53.493 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:41:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:41:53.496 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:53.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.497 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:53.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:41:53.497 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:53.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:41:53.498 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:53.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.498 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.498 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:53.499 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.499 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:41:53.499 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:53.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.500 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:41:53.500 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:53.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.500 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.500 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:41:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:41:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:41:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:41:53.502 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:41:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:41:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:41:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:53.504 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:53.505 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:41:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:41:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:53.507 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:41:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:41:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:53.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:41:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:41:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:41:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:41:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:41:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:41:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:41:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:41:53.513 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:41:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:53.515 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:41:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:41:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:53.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:41:53.518 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:41:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:41:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:53.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:41:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.521 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:41:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:41:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:41:53.523 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:41:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:41:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:41:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:41:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:41:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:53.525 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:41:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:41:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:53.527 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:41:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:41:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:41:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:41:53.529 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:41:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:41:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:41:53.531 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:41:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:53.532 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:41:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:41:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:53.533 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:41:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:41:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:41:53.535 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:41:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:41:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:41:53.536 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:41:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:41:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:41:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:41:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:41:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:41:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:41:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:41:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:41:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:41:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:41:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:41:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:41:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:41:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:41:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:41:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:41:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:41:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:41:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:41:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:41:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:41:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:41:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa89c06a080 msgr2=0x7fa89c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa89c06a080 0x7fa89c06c540 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4000c00 tx=0x7fa8a4009040 comp rx=0 tx=0).stop 2023-08-09T12:41:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 msgr2=0x7fa8b01523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa8b01523a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa8a002c310 tx=0x7fa8a0001930 comp rx=0 tx=0).stop 2023-08-09T12:41:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 shutdown_connections 2023-08-09T12:41:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa89c06a080 0x7fa89c06c540 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8b01550d0 0x7fa8b0155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8b0159c30 0x7fa8b015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 --2- 172.21.15.17:0/3938085079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8980039c0 0x7fa8b01523a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.355+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 >> 172.21.15.17:0/3938085079 conn(0x7fa8b00b1d50 msgr2=0x7fa8b015ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:53.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.356+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 shutdown_connections 2023-08-09T12:41:53.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:53.356+0000 7fa8b52f3640 1 -- 172.21.15.17:0/3938085079 wait complete. 2023-08-09T12:41:53.543 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-09T12:41:53.544 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:41:53.544 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:53.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:53.608 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-08-09T12:41:54.071 INFO:teuthology.orchestra.run.smithi017.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-08-09T12:41:54.071 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records in 2023-08-09T12:41:54.071 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records out 2023-08-09T12:41:54.071 INFO:teuthology.orchestra.run.smithi017.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.386999 s, 135 MB/s 2023-08-09T12:41:54.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:41:54.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:41:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.291+0000 7f1f97eba640 1 Processor -- start 2023-08-09T12:41:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.291+0000 7f1f97eba640 1 -- start start 2023-08-09T12:41:54.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.293+0000 7f1f97eba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f900adc40 0x7f1f9006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.293+0000 7f1f97eba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900cc630 0x7f1f900ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.293+0000 7f1f97eba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f900b2250 con 0x7f1f900b3b40 2023-08-09T12:41:54.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.293+0000 7f1f97eba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f900ae020 con 0x7f1f900adc40 2023-08-09T12:41:54.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.293+0000 7f1f97eba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900b2530 con 0x7f1f900cc630 2023-08-09T12:41:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.293+0000 7f1f95c56640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f900adc40 0x7f1f9006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.293+0000 7f1f95c56640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f900adc40 0x7f1f9006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44392/0 (socket says 172.21.15.17:44392) 2023-08-09T12:41:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.293+0000 7f1f95c56640 1 -- 172.21.15.17:0/527895892 learned_addr learned my addr 172.21.15.17:0/527895892 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:54.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.294+0000 7f1f96457640 1 --2- 172.21.15.17:0/527895892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900cc630 0x7f1f900ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.294+0000 7f1f95c56640 1 -- 172.21.15.17:0/527895892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900cc630 msgr2=0x7f1f900ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:54.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.294+0000 7f1f95c56640 1 --2- 172.21.15.17:0/527895892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900cc630 0x7f1f900ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.294+0000 7f1f95c56640 1 -- 172.21.15.17:0/527895892 >> v1:172.21.15.17:6789/0 conn(0x7f1f900b3b40 legacy=0x7f1f900b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.294+0000 7f1f95c56640 1 -- 172.21.15.17:0/527895892 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9006fe80 con 0x7f1f900adc40 2023-08-09T12:41:54.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.295+0000 7f1f95c56640 1 --2- 172.21.15.17:0/527895892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900adc40 0x7f1f9006c280 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009870 tx=0x7f1f8c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dd5bf0200abc55 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:54.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.295+0000 7f1f94c54640 1 -- 172.21.15.17:0/527895892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c031640 con 0x7f1f900adc40 2023-08-09T12:41:54.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.295+0000 7f1f94c54640 1 -- 172.21.15.17:0/527895892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c0317a0 con 0x7f1f900adc40 2023-08-09T12:41:54.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.295+0000 7f1f94c54640 1 -- 172.21.15.17:0/527895892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c031b30 con 0x7f1f900adc40 2023-08-09T12:41:54.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.296+0000 7f1f97eba640 1 -- 172.21.15.17:0/527895892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900adc40 msgr2=0x7f1f9006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.296+0000 7f1f97eba640 1 --2- 172.21.15.17:0/527895892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900adc40 0x7f1f9006c280 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009870 tx=0x7f1f8c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.296+0000 7f1f97eba640 1 -- 172.21.15.17:0/527895892 shutdown_connections 2023-08-09T12:41:54.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.296+0000 7f1f97eba640 1 --2- 172.21.15.17:0/527895892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900cc630 0x7f1f900ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.296+0000 7f1f97eba640 1 --2- 172.21.15.17:0/527895892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900adc40 0x7f1f9006c280 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.296+0000 7f1f97eba640 1 -- 172.21.15.17:0/527895892 >> 172.21.15.17:0/527895892 conn(0x7f1f900cb1b0 msgr2=0x7f1f900cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:54.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.296+0000 7f1f97eba640 1 -- 172.21.15.17:0/527895892 shutdown_connections 2023-08-09T12:41:54.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.296+0000 7f1f97eba640 1 -- 172.21.15.17:0/527895892 wait complete. 2023-08-09T12:41:54.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.298+0000 7f1f97eba640 1 Processor -- start 2023-08-09T12:41:54.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.298+0000 7f1f97eba640 1 -- start start 2023-08-09T12:41:54.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f97eba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f900adc40 0x7f1f900ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f97eba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900b3b40 0x7f1f900acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f97eba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900cc630 0x7f1f900c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f97eba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900ca3c0 con 0x7f1f900cc630 2023-08-09T12:41:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f97eba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900c9b20 con 0x7f1f900adc40 2023-08-09T12:41:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f97eba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900c9e00 con 0x7f1f900b3b40 2023-08-09T12:41:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f96457640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900cc630 0x7f1f900c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f96457640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900cc630 0x7f1f900c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44400/0 (socket says 172.21.15.17:44400) 2023-08-09T12:41:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.299+0000 7f1f96457640 1 -- 172.21.15.17:0/2108012811 learned_addr learned my addr 172.21.15.17:0/2108012811 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f95c56640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f900adc40 0x7f1f900ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f95455640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900b3b40 0x7f1f900acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f96457640 1 -- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900b3b40 msgr2=0x7f1f900acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f96457640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900b3b40 0x7f1f900acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f96457640 1 -- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f900adc40 msgr2=0x7f1f900ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f96457640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f900adc40 0x7f1f900ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f96457640 1 -- 172.21.15.17:0/2108012811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0094d0 con 0x7f1f900cc630 2023-08-09T12:41:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f95455640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900b3b40 0x7f1f900acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f96457640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900cc630 0x7f1f900c8d80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800cc30 tx=0x7f1f8800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f867fc640 1 -- 172.21.15.17:0/2108012811 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800ce40 con 0x7f1f900cc630 2023-08-09T12:41:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f867fc640 1 -- 172.21.15.17:0/2108012811 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88003990 con 0x7f1f900cc630 2023-08-09T12:41:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f867fc640 1 -- 172.21.15.17:0/2108012811 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88003d20 con 0x7f1f900cc630 2023-08-09T12:41:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.300+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f900ca0e0 con 0x7f1f900cc630 2023-08-09T12:41:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.301+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f900c94a0 con 0x7f1f900cc630 2023-08-09T12:41:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.302+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f900b1e20 con 0x7f1f900cc630 2023-08-09T12:41:54.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.303+0000 7f1f867fc640 1 -- 172.21.15.17:0/2108012811 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f88003e80 con 0x7f1f900cc630 2023-08-09T12:41:54.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.304+0000 7f1f867fc640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f7406a050 0x7f1f7406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.304+0000 7f1f867fc640 1 -- 172.21.15.17:0/2108012811 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f88088990 con 0x7f1f900cc630 2023-08-09T12:41:54.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.304+0000 7f1f867fc640 1 -- 172.21.15.17:0/2108012811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=55}) v3 -- 0x7f1f740721a0 con 0x7f1f900cc630 2023-08-09T12:41:54.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.304+0000 7f1f95c56640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f7406a050 0x7f1f7406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.306+0000 7f1f95c56640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f7406a050 0x7f1f7406c510 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c036000 tx=0x7f1f8c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:54.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.308+0000 7f1f867fc640 1 -- 172.21.15.17:0/2108012811 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1f88053fe0 con 0x7f1f900cc630 2023-08-09T12:41:54.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.504+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1f90067a80 con 0x7f1f900cc630 2023-08-09T12:41:54.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.508+0000 7f1f867fc640 1 -- 172.21.15.17:0/2108012811 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+37114 (secure 0 0 0) 0x7f1f8801d070 con 0x7f1f900cc630 2023-08-09T12:41:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:54.512 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:41:54.512 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 54, 2023-08-09T12:41:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:41:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:41:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:41:53.715185+0000", 2023-08-09T12:41:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:41:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:41:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:41:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:41:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:41:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:41:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:41:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:41:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:41:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:41:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:41:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:41:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:41:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:41:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 8, 2023-08-09T12:41:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:41:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:41:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:41:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:41:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:41:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:41:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:41:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:41:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:41:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:41:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:41:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:41:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:41:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:41:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:41:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:41:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:41:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:41:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:41:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:41:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:41:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:41:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:41:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:41:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:41:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:41:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:41:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:41:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:41:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:41:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:54.536 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:54.536 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:54.536 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:54.536 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:54.536 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:54.536 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:54.536 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:54.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:54.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.537 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:54.537 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:54.537 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:54.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:54.538 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:54.538 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:54.538 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:54.538 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:54.538 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:54.538 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:54.538 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:54.538 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:41:54.539 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:54.539 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:41:54.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.539 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:54.539 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:41:54.539 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:41:54.539 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:41:54.540 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:41:54.540 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:41:54.540 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:54.540 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:54.540 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:54.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.541 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-08-09T12:41:54.541 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:41:54.541 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:23.866427+0000", 2023-08-09T12:41:54.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:54.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:54.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:54.542 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:54.542 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:54.542 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:54.542 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:54.542 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:54.542 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:54.542 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:54.543 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:54.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:54.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:41:54.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:41:54.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:41:54.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:41:54.543 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:41:54.544 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:54.544 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:54.544 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:54.544 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:54.544 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:54.544 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:54.544 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:54.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:54.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:54.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:54.545 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:54.545 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:54.545 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:54.546 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:54.546 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:54.546 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:54.546 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:54.546 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:54.546 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:54.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:54.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:54.547 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:54.547 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:54.547 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:54.547 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:54.547 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:54.547 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:54.548 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:54.548 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:54.548 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:54.548 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:54.548 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:54.548 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:54.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:54.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.549 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:54.549 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:54.549 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:54.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:54.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:54.549 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:54.550 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:54.550 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:54.550 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:54.550 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:54.550 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:54.550 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:54.550 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:41:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:41:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:41:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:41:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:41:54.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:41:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:41:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:41:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:41:54.552 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:41:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.553 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 8, 2023-08-09T12:41:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:41:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:25.245820+0000", 2023-08-09T12:41:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:54.555 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:41:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:41:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:41:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:41:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:41:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:54.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:54.558 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:54.559 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:54.560 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.561 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:54.562 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:41:54.563 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:41:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:41:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:41:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.564 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.8799999952316284, 2023-08-09T12:41:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.8799999952316284, 2023-08-09T12:41:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:41:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-09T12:41:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-09T12:41:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:54.565 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:41:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.566 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:41:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:54.567 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:41:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:41:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:41:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:41:54.571 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:41:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:41:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:54.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.574 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:41:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:41:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:54.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:41:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:41:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:41:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:41:54.576 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.577 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:41:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:54.578 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:41:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.580 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:41:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:41:54.583 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:41:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.584 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:41:54.585 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:41:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.586 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:41:54.587 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:41:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.588 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:41:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:41:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:41:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:41:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:54.589 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:41:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:54.590 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:54.591 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.592 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:41:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:41:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:54.593 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:41:54.594 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:41:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.595 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:41:54.596 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:41:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:41:54.598 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:41:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:41:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:41:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:41:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:41:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:54.600 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:41:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:54.601 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:54.602 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.603 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:41:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:41:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:54.604 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:41:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:41:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.606 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:41:54.607 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:41:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.608 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:41:54.609 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:41:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.610 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:41:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:41:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:41:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:41:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:41:54.612 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:54.613 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.614 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:41:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:41:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:54.615 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.616 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:41:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:41:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:54.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.618 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:41:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:41:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.619 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:41:54.620 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:41:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.621 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:41:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:41:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:41:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:41:54.622 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:41:54.623 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:54.624 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.625 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:41:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:41:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:54.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.627 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:41:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:41:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:54.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.629 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:41:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:41:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:54.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.631 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:41:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:41:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:41:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:41:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:41:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:41:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:54.633 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:41:54.634 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:54.635 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:41:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:41:54.637 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.638 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:41:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:41:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:54.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.640 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:41:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:41:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:54.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.642 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:41:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:41:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:54.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:41:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:41:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:41:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:41:54.644 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:41:54.645 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:41:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:41:54.648 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:41:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:41:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:41:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.652 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:41:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:54.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:41:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:54.654 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:41:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:41:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:41:54.655 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:41:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:41:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:54.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:41:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:41:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:54.657 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:41:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:41:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:41:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:54.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:41:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:54.660 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:41:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:41:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:54.661 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:41:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:41:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:54.663 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:41:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:41:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:54.664 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:41:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:41:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:41:54.666 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:41:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:54.667 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:41:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:41:54.668 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:41:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:41:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:41:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:41:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:41:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:41:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:41:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:41:54.669 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:41:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:41:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:41:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:41:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:41:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:54.670 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:41:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:41:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:41:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:41:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:41:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:41:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:41:54.671 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:41:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:41:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:41:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:41:54.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:54.672 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:41:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.510+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f7406a050 msgr2=0x7f1f7406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.510+0000 7f1f97eba640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f7406a050 0x7f1f7406c510 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c036000 tx=0x7f1f8c03c040 comp rx=0 tx=0).stop 2023-08-09T12:41:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900cc630 msgr2=0x7f1f900c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900cc630 0x7f1f900c8d80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800cc30 tx=0x7f1f8800a5c0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 shutdown_connections 2023-08-09T12:41:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1f7406a050 0x7f1f7406c510 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f900cc630 0x7f1f900c8d80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f900b3b40 0x7f1f900acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 --2- 172.21.15.17:0/2108012811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f900adc40 0x7f1f900ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 >> 172.21.15.17:0/2108012811 conn(0x7f1f900cb1b0 msgr2=0x7f1f900ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 shutdown_connections 2023-08-09T12:41:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.511+0000 7f1f97eba640 1 -- 172.21.15.17:0/2108012811 wait complete. 2023-08-09T12:41:54.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:41:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.903+0000 7f76ef59e640 1 Processor -- start 2023-08-09T12:41:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.904+0000 7f76ef59e640 1 -- start start 2023-08-09T12:41:54.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.905+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f0070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.905+0000 7f76ef59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76f00cb070 0x7f76f00cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.905+0000 7f76ef59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f015beb0 con 0x7f76f00b0b10 2023-08-09T12:41:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.905+0000 7f76ef59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f00cba40 con 0x7f76f00cb070 2023-08-09T12:41:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.905+0000 7f76ef59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f00715c0 con 0x7f76f01587e0 2023-08-09T12:41:54.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.906+0000 7f76ee59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f0070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.906+0000 7f76ee59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f0070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38186/0 (socket says 172.21.15.17:38186) 2023-08-09T12:41:54.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.906+0000 7f76ee59c640 1 -- 172.21.15.17:0/2472495615 learned_addr learned my addr 172.21.15.17:0/2472495615 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:54.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.906+0000 7f76eed9d640 1 --2- 172.21.15.17:0/2472495615 >> v2:172.21.15.142:3300/0 conn(0x7f76f00cb070 0x7f76f00cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.907+0000 7f76eed9d640 1 -- 172.21.15.17:0/2472495615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 msgr2=0x7f76f0070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:54.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.907+0000 7f76eed9d640 1 --2- 172.21.15.17:0/2472495615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f0070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.907+0000 7f76eed9d640 1 -- 172.21.15.17:0/2472495615 >> v1:172.21.15.142:6789/0 conn(0x7f76f00b0b10 legacy=0x7f76f015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.907+0000 7f76eed9d640 1 -- 172.21.15.17:0/2472495615 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00718a0 con 0x7f76f00cb070 2023-08-09T12:41:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.908+0000 7f76eed9d640 1 --2- 172.21.15.17:0/2472495615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00cb070 0x7f76f00cb500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009d90 tx=0x7f76e802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ffed997e94074a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.909+0000 7f76edd9b640 1 -- 172.21.15.17:0/2472495615 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e802cc60 con 0x7f76f00cb070 2023-08-09T12:41:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.909+0000 7f76edd9b640 1 -- 172.21.15.17:0/2472495615 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e802cdc0 con 0x7f76f00cb070 2023-08-09T12:41:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.909+0000 7f76edd9b640 1 -- 172.21.15.17:0/2472495615 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8034660 con 0x7f76f00cb070 2023-08-09T12:41:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.909+0000 7f76ef59e640 1 -- 172.21.15.17:0/2472495615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00cb070 msgr2=0x7f76f00cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.909+0000 7f76ef59e640 1 --2- 172.21.15.17:0/2472495615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00cb070 0x7f76f00cb500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009d90 tx=0x7f76e802beb0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.910+0000 7f76ef59e640 1 -- 172.21.15.17:0/2472495615 shutdown_connections 2023-08-09T12:41:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.910+0000 7f76ef59e640 1 --2- 172.21.15.17:0/2472495615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00cb070 0x7f76f00cb500 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.910+0000 7f76ef59e640 1 --2- 172.21.15.17:0/2472495615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f0070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.910+0000 7f76ef59e640 1 -- 172.21.15.17:0/2472495615 >> 172.21.15.17:0/2472495615 conn(0x7f76f00b1d50 msgr2=0x7f76f006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.910+0000 7f76ef59e640 1 -- 172.21.15.17:0/2472495615 shutdown_connections 2023-08-09T12:41:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.910+0000 7f76ef59e640 1 -- 172.21.15.17:0/2472495615 wait complete. 2023-08-09T12:41:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.912+0000 7f76ef59e640 1 Processor -- start 2023-08-09T12:41:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.912+0000 7f76ef59e640 1 -- start start 2023-08-09T12:41:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00b0b10 0x7f76f00c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f00cb070 0x7f76f00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76ef59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f00b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76ef59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f00c2f40 con 0x7f76f00cb070 2023-08-09T12:41:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76ef59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f00c99e0 con 0x7f76f00b0b10 2023-08-09T12:41:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76ef59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f01f3250 con 0x7f76f01587e0 2023-08-09T12:41:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76e5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f00cb070 0x7f76f00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76e5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f00cb070 0x7f76f00c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44416/0 (socket says 172.21.15.17:44416) 2023-08-09T12:41:54.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76e5d9b640 1 -- 172.21.15.17:0/1140455257 learned_addr learned my addr 172.21.15.17:0/1140455257 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:54.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76ee59c640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00b0b10 0x7f76f00c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.913+0000 7f76eed9d640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f00b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e5d9b640 1 -- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 msgr2=0x7f76f00b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e5d9b640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f00b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e5d9b640 1 -- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00b0b10 msgr2=0x7f76f00c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:54.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e5d9b640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00b0b10 0x7f76f00c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:54.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e5d9b640 1 -- 172.21.15.17:0/1140455257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8009a70 con 0x7f76f00cb070 2023-08-09T12:41:54.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e5d9b640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f00cb070 0x7f76f00c94a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c450 tx=0x7f76d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:54.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e77fe640 1 -- 172.21.15.17:0/1140455257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80052d0 con 0x7f76f00cb070 2023-08-09T12:41:54.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e77fe640 1 -- 172.21.15.17:0/1140455257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d8005430 con 0x7f76f00cb070 2023-08-09T12:41:54.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f01f2640 con 0x7f76f00cb070 2023-08-09T12:41:54.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76e77fe640 1 -- 172.21.15.17:0/1140455257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d8012870 con 0x7f76f00cb070 2023-08-09T12:41:54.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.914+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f01f2c00 con 0x7f76f00cb070 2023-08-09T12:41:54.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.916+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f006fa10 con 0x7f76f00cb070 2023-08-09T12:41:54.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.916+0000 7f76e77fe640 1 -- 172.21.15.17:0/1140455257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f76d80129d0 con 0x7f76f00cb070 2023-08-09T12:41:54.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.917+0000 7f76e77fe640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f76d006a050 0x7f76d006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:54.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.918+0000 7f76e77fe640 1 -- 172.21.15.17:0/1140455257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76d80880d0 con 0x7f76f00cb070 2023-08-09T12:41:54.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.918+0000 7f76e77fe640 1 -- 172.21.15.17:0/1140455257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=55}) v3 -- 0x7f76d00721a0 con 0x7f76f00cb070 2023-08-09T12:41:54.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.918+0000 7f76ee59c640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f76d006a050 0x7f76d006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:54.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.919+0000 7f76ee59c640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f76d006a050 0x7f76d006c510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009ac0 tx=0x7f76e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:54.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:54.922+0000 7f76e77fe640 1 -- 172.21.15.17:0/1140455257 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f76f006fa10 con 0x7f76f00cb070 2023-08-09T12:41:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.155+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76f006fa10 con 0x7f76f00cb070 2023-08-09T12:41:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.156+0000 7f76e77fe640 1 -- 172.21.15.17:0/1140455257 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f76f006fa10 con 0x7f76f00cb070 2023-08-09T12:41:55.160 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:55.160 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:41:55.161 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:41:55.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f76d006a050 msgr2=0x7f76d006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:55.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f76d006a050 0x7f76d006c510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009ac0 tx=0x7f76e0008040 comp rx=0 tx=0).stop 2023-08-09T12:41:55.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f00cb070 msgr2=0x7f76f00c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:55.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f00cb070 0x7f76f00c94a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c450 tx=0x7f76d800c910 comp rx=0 tx=0).stop 2023-08-09T12:41:55.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 shutdown_connections 2023-08-09T12:41:55.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f76d006a050 0x7f76d006c510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76f01587e0 0x7f76f00b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f00cb070 0x7f76f00c94a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.159+0000 7f76ef59e640 1 --2- 172.21.15.17:0/1140455257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f00b0b10 0x7f76f00c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.160+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 >> 172.21.15.17:0/1140455257 conn(0x7f76f00b1d50 msgr2=0x7f76f015e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:55.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.160+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 shutdown_connections 2023-08-09T12:41:55.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.160+0000 7f76ef59e640 1 -- 172.21.15.17:0/1140455257 wait complete. 2023-08-09T12:41:55.183 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-08-09T12:41:55.424 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":4936,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.64330648,"mdsmap_epoch":26,"osdmap_epoch":54,"osdmap_epoch_barrier":54,"uptime":35.156567219999999} 2023-08-09T12:41:55.424 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 4936, "mdsmap_epoch": 26, "osdmap_epoch": 54, "osdmap_epoch_barrier": 54, "rank_uptime": 28.64330648, "state": "up:active", "uptime": 35.15656722, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:41:55.425 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:41:55.425 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:41:55.426 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:41:55.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:55.493 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-08-09T12:41:55.555 INFO:teuthology.orchestra.run.smithi017.stderr:dd: failed to open 'small_file_1': Permission denied 2023-08-09T12:41:55.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:41:55.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:55.557 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-08-09T12:41:55.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:41:55.625 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-08-09T12:41:55.696 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:41:55.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.928+0000 7f244634f640 1 Processor -- start 2023-08-09T12:41:55.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.928+0000 7f244634f640 1 -- start start 2023-08-09T12:41:55.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.929+0000 7f244634f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24401601f0 0x7f24400b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:55.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.929+0000 7f244634f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24400b34a0 con 0x7f24400b2ee0 2023-08-09T12:41:55.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.930+0000 7f244634f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24400b3780 con 0x7f24400cb610 2023-08-09T12:41:55.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.930+0000 7f244634f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24400b4120 con 0x7f24401601f0 2023-08-09T12:41:55.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.930+0000 7f2444b4c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f24400b2ee0 0x7f24400caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41628/0 (socket says 172.21.15.17:41628) 2023-08-09T12:41:55.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.930+0000 7f2444b4c640 1 -- 172.21.15.17:0/1510803826 learned_addr learned my addr 172.21.15.17:0/1510803826 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:41:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.930+0000 7f244534d640 1 --2- 172.21.15.17:0/1510803826 >> v2:172.21.15.142:3300/0 conn(0x7f24401601f0 0x7f24400b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.930+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522859656 0 0) 0x7f24400b34a0 con 0x7f24400b2ee0 2023-08-09T12:41:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.930+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f242c003520 con 0x7f24400b2ee0 2023-08-09T12:41:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2565241367 0 0) 0x7f242c003520 con 0x7f24400b2ee0 2023-08-09T12:41:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 >> v2:172.21.15.142:3300/0 conn(0x7f24401601f0 msgr2=0x7f24400b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 --2- 172.21.15.17:0/1510803826 >> v2:172.21.15.142:3300/0 conn(0x7f24401601f0 0x7f24400b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 >> v1:172.21.15.142:6789/0 conn(0x7f24400cb610 legacy=0x7f24400c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400b3a60 con 0x7f24400b2ee0 2023-08-09T12:41:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f2430001670 con 0x7f24400b2ee0 2023-08-09T12:41:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 >> v1:172.21.15.17:6789/0 conn(0x7f24400b2ee0 legacy=0x7f24400caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c003970 0x7f242c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:55.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:55.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c005180 0x7f242c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:55.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400b4120 con 0x7f242c003970 2023-08-09T12:41:55.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c00c0d0 con 0x7f242c0047c0 2023-08-09T12:41:55.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c00c290 con 0x7f242c005180 2023-08-09T12:41:55.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.931+0000 7f244534d640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c003970 0x7f242c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:55.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.932+0000 7f2444b4c640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:55.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.932+0000 7f244534d640 1 -- 172.21.15.17:0/1510803826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c005180 msgr2=0x7f242c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:55.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.932+0000 7f244534d640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c005180 0x7f242c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.932+0000 7f244534d640 1 -- 172.21.15.17:0/1510803826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c0047c0 msgr2=0x7f242c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:41:55.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.932+0000 7f244534d640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.932+0000 7f244534d640 1 -- 172.21.15.17:0/1510803826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c003520 con 0x7f242c003970 2023-08-09T12:41:55.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.932+0000 7f2444b4c640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:41:55.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.932+0000 7f2445b4e640 1 -- 172.21.15.17:0/1510803826 reap_dead start 2023-08-09T12:41:55.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.933+0000 7f244534d640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c003970 0x7f242c003d90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f243c00ba30 tx=0x7f242c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6d3b58d0f472d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:55.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.933+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c032680 con 0x7f242c003970 2023-08-09T12:41:55.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.933+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c0327e0 con 0x7f242c003970 2023-08-09T12:41:55.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.933+0000 7f2437fff640 1 -- 172.21.15.17:0/1510803826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c032b70 con 0x7f242c003970 2023-08-09T12:41:55.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.934+0000 7f244634f640 1 -- 172.21.15.17:0/1510803826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c003970 msgr2=0x7f242c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:55.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.934+0000 7f244634f640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c003970 0x7f242c003d90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f243c00ba30 tx=0x7f242c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.934+0000 7f244634f640 1 -- 172.21.15.17:0/1510803826 shutdown_connections 2023-08-09T12:41:55.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.934+0000 7f244634f640 1 --2- 172.21.15.17:0/1510803826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c003970 0x7f242c003d90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.934+0000 7f244634f640 1 -- 172.21.15.17:0/1510803826 >> 172.21.15.17:0/1510803826 conn(0x7f24400b1d50 msgr2=0x7f244006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:55.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.934+0000 7f244634f640 1 -- 172.21.15.17:0/1510803826 shutdown_connections 2023-08-09T12:41:55.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.934+0000 7f244634f640 1 -- 172.21.15.17:0/1510803826 wait complete. 2023-08-09T12:41:55.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.936+0000 7f244634f640 1 Processor -- start 2023-08-09T12:41:55.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.936+0000 7f244634f640 1 -- start start 2023-08-09T12:41:55.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.937+0000 7f244634f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c003970 0x7f2440071340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:55.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.937+0000 7f244634f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440159830 0x7f244015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:55.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f244634f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2440159cb0 0x7f244015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:55.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f244634f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244015b020 con 0x7f2440159830 2023-08-09T12:41:55.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f244634f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24401f2440 con 0x7f2440159cb0 2023-08-09T12:41:55.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f244634f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24401f2720 con 0x7f242c003970 2023-08-09T12:41:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2444b4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440159830 0x7f244015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2444b4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440159830 0x7f244015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44440/0 (socket says 172.21.15.17:44440) 2023-08-09T12:41:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2444b4c640 1 -- 172.21.15.17:0/444546896 learned_addr learned my addr 172.21.15.17:0/444546896 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:41:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f244534d640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c003970 0x7f2440071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:55.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2445b4e640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2440159cb0 0x7f244015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:55.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2444b4c640 1 -- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c003970 msgr2=0x7f2440071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:55.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2444b4c640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c003970 0x7f2440071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2444b4c640 1 -- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2440159cb0 msgr2=0x7f244015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:55.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2444b4c640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2440159cb0 0x7f244015a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:55.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.938+0000 7f2444b4c640 1 -- 172.21.15.17:0/444546896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24401f2a00 con 0x7f2440159830 2023-08-09T12:41:55.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.939+0000 7f2444b4c640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440159830 0x7f244015a1c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f243000d700 tx=0x7f243000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.939+0000 7f2435ffb640 1 -- 172.21.15.17:0/444546896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300074e0 con 0x7f2440159830 2023-08-09T12:41:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.939+0000 7f2435ffb640 1 -- 172.21.15.17:0/444546896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430007640 con 0x7f2440159830 2023-08-09T12:41:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.939+0000 7f2435ffb640 1 -- 172.21.15.17:0/444546896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430004a00 con 0x7f2440159830 2023-08-09T12:41:55.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.939+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24401f2ce0 con 0x7f2440159830 2023-08-09T12:41:55.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.939+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24401f32a0 con 0x7f2440159830 2023-08-09T12:41:55.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.940+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2440157800 con 0x7f2440159830 2023-08-09T12:41:55.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.941+0000 7f2435ffb640 1 -- 172.21.15.17:0/444546896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2430004b60 con 0x7f2440159830 2023-08-09T12:41:55.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.942+0000 7f2435ffb640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242406a050 0x7f242406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:41:55.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.942+0000 7f2435ffb640 1 -- 172.21.15.17:0/444546896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2430088190 con 0x7f2440159830 2023-08-09T12:41:55.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.943+0000 7f2435ffb640 1 -- 172.21.15.17:0/444546896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=55}) v3 -- 0x7f24240721a0 con 0x7f2440159830 2023-08-09T12:41:55.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.943+0000 7f244534d640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242406a050 0x7f242406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:41:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.944+0000 7f244534d640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242406a050 0x7f242406c510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f243c00ba00 tx=0x7f243c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:41:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:55.947+0000 7f2435ffb640 1 -- 172.21.15.17:0/444546896 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2430053890 con 0x7f2440159830 2023-08-09T12:41:56.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.145+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f244004e390 con 0x7f2440159830 2023-08-09T12:41:56.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.147+0000 7f2435ffb640 1 -- 172.21.15.17:0/444546896 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+37114 (secure 0 0 0) 0x7f2430019070 con 0x7f2440159830 2023-08-09T12:41:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:41:56.152 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:41:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 54, 2023-08-09T12:41:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:41:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:41:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:41:53.715185+0000", 2023-08-09T12:41:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:41:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:41:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:41:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:41:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:41:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:41:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:41:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:41:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:41:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:41:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:41:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:41:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:41:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:41:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 8, 2023-08-09T12:41:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:41:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:41:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:41:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:41:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:41:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:41:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:41:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:41:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:41:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:41:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:41:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:41:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:41:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:41:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:41:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:41:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:41:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:41:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:41:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:41:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:41:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:41:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:41:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:41:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:41:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:41:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:41:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:41:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:41:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:41:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:41:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:41:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:41:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:41:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:41:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:41:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:41:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-08-09T12:41:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:41:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:23.866427+0000", 2023-08-09T12:41:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:41:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:41:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:41:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:41:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:41:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:41:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:41:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:41:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:41:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:41:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:41:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:41:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:41:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:41:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:41:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 8, 2023-08-09T12:41:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:41:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:25.245820+0000", 2023-08-09T12:41:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:41:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:41:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:41:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:41:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:41:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:41:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:41:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:41:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:41:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:41:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:41:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:41:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:41:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:41:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:41:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:41:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:41:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:41:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:41:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:41:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:41:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:41:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:41:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:41:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:41:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:41:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:41:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:41:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:41:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:41:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:41:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:41:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:41:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:41:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:41:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:41:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:41:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:41:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:41:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:41:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:41:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:41:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:41:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:41:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:41:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:41:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:41:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:41:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:41:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:41:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:41:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:41:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:41:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:41:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:41:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:41:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:41:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:41:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:41:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:41:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:41:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:41:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:41:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:41:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:41:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:41:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:41:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:41:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:41:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.8799999952316284, 2023-08-09T12:41:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.8799999952316284, 2023-08-09T12:41:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:41:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-09T12:41:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-09T12:41:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:41:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:41:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:41:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:41:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:41:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:41:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:41:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:41:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:41:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:41:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:41:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:41:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:41:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:41:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:41:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:41:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:41:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:41:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:41:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:41:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:41:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:41:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:41:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:41:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:41:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:41:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:41:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:41:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:41:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:41:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:41:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:41:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:41:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:41:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:41:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:41:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:41:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:41:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:41:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:41:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:41:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:41:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:41:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:41:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:41:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:41:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:41:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:41:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:41:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:41:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:41:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:41:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:41:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:41:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:41:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:41:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:41:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:41:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:41:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:41:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:41:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:41:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:41:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:41:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:41:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:41:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:41:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:41:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:41:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:41:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:41:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:41:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:41:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:41:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:41:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:41:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:41:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:41:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:41:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:41:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:41:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:41:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:41:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:41:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:41:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:41:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:41:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:41:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:41:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:41:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:41:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:41:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:41:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:41:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:41:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:41:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:41:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:41:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:41:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:41:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:41:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:41:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:41:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:41:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:41:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:41:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:41:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:41:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:41:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:41:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:41:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:41:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:41:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:41:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:41:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:41:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:41:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:41:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:41:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:41:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:41:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:41:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:41:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:41:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:41:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:41:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:41:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:41:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:41:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:41:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:41:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:41:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:41:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:41:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:41:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:41:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:41:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:41:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:41:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:41:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:41:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:41:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:41:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:41:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:41:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:41:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:41:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:41:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:41:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:41:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:41:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:41:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:41:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:41:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:41:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:41:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:41:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:41:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:41:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:41:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:41:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:41:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:41:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:41:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:41:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:41:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:41:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:41:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:41:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:41:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:41:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:41:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:41:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:41:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:41:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:41:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:41:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:41:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:41:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:41:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:41:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:41:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:41:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:41:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:41:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:41:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:41:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:41:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:41:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:41:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:41:56.315 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:41:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242406a050 msgr2=0x7f242406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242406a050 0x7f242406c510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f243c00ba00 tx=0x7f243c03d040 comp rx=0 tx=0).stop 2023-08-09T12:41:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440159830 msgr2=0x7f244015a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:41:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440159830 0x7f244015a1c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f243000d700 tx=0x7f243000dbc0 comp rx=0 tx=0).stop 2023-08-09T12:41:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 shutdown_connections 2023-08-09T12:41:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242406a050 0x7f242406c510 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2440159cb0 0x7f244015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:56.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440159830 0x7f244015a1c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:56.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 --2- 172.21.15.17:0/444546896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c003970 0x7f2440071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:41:56.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 >> 172.21.15.17:0/444546896 conn(0x7f24400b1d50 msgr2=0x7f244006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:41:56.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 shutdown_connections 2023-08-09T12:41:56.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:41:56.151+0000 7f244634f640 1 -- 172.21.15.17:0/444546896 wait complete. 2023-08-09T12:41:56.319 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:41:58.690 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:41:58.688+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-08-09T12:42:01.320 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:42:01.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.554+0000 7f971f626640 1 Processor -- start 2023-08-09T12:42:01.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.555+0000 7f971f626640 1 -- start start 2023-08-09T12:42:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.556+0000 7f971f626640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9718159d80 0x7f97180b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.556+0000 7f971f626640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180ad810 0x7f9718070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.556+0000 7f971f626640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97180708c0 0x7f971806eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.556+0000 7f971f626640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971815a160 con 0x7f97180708c0 2023-08-09T12:42:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.556+0000 7f971f626640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9718070d20 con 0x7f9718159d80 2023-08-09T12:42:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.556+0000 7f971f626640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97180b4630 con 0x7f97180ad810 2023-08-09T12:42:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.557+0000 7f971dbc3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97180708c0 0x7f971806eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.557+0000 7f971dbc3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97180708c0 0x7f971806eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40184/0 (socket says 172.21.15.17:40184) 2023-08-09T12:42:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.557+0000 7f971dbc3640 1 -- 172.21.15.17:0/3507372790 learned_addr learned my addr 172.21.15.17:0/3507372790 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.557+0000 7f971d3c2640 1 --2- 172.21.15.17:0/3507372790 >> v2:172.21.15.142:3300/0 conn(0x7f9718159d80 0x7f97180b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.557+0000 7f971cbc1640 1 --2- 172.21.15.17:0/3507372790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180ad810 0x7f9718070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.558+0000 7f971dbc3640 1 -- 172.21.15.17:0/3507372790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180ad810 msgr2=0x7f9718070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.558+0000 7f971dbc3640 1 --2- 172.21.15.17:0/3507372790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180ad810 0x7f9718070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.558+0000 7f971dbc3640 1 -- 172.21.15.17:0/3507372790 >> v2:172.21.15.142:3300/0 conn(0x7f9718159d80 msgr2=0x7f97180b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.558+0000 7f971dbc3640 1 --2- 172.21.15.17:0/3507372790 >> v2:172.21.15.142:3300/0 conn(0x7f9718159d80 0x7f97180b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.558+0000 7f971dbc3640 1 -- 172.21.15.17:0/3507372790 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180b3ab0 con 0x7f97180708c0 2023-08-09T12:42:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.559+0000 7f971dbc3640 1 --2- 172.21.15.17:0/3507372790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97180708c0 0x7f971806eb90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f97180cb110 tx=0x7f971002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e140c62345c71e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.559+0000 7f970ffff640 1 -- 172.21.15.17:0/3507372790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971002ca70 con 0x7f97180708c0 2023-08-09T12:42:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.559+0000 7f970ffff640 1 -- 172.21.15.17:0/3507372790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971002cbd0 con 0x7f97180708c0 2023-08-09T12:42:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.559+0000 7f970ffff640 1 -- 172.21.15.17:0/3507372790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97100343f0 con 0x7f97180708c0 2023-08-09T12:42:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 -- 172.21.15.17:0/3507372790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97180708c0 msgr2=0x7f971806eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 --2- 172.21.15.17:0/3507372790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97180708c0 0x7f971806eb90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f97180cb110 tx=0x7f971002bed0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 -- 172.21.15.17:0/3507372790 shutdown_connections 2023-08-09T12:42:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 --2- 172.21.15.17:0/3507372790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97180708c0 0x7f971806eb90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 --2- 172.21.15.17:0/3507372790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180ad810 0x7f9718070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 --2- 172.21.15.17:0/3507372790 >> v2:172.21.15.142:3300/0 conn(0x7f9718159d80 0x7f97180b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 -- 172.21.15.17:0/3507372790 >> 172.21.15.17:0/3507372790 conn(0x7f97180cb1b0 msgr2=0x7f97180cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 -- 172.21.15.17:0/3507372790 shutdown_connections 2023-08-09T12:42:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.560+0000 7f971f626640 1 -- 172.21.15.17:0/3507372790 wait complete. 2023-08-09T12:42:01.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.562+0000 7f971f626640 1 Processor -- start 2023-08-09T12:42:01.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.562+0000 7f971f626640 1 -- start start 2023-08-09T12:42:01.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.563+0000 7f971f626640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180708c0 0x7f97181e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:01.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.563+0000 7f971f626640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97180ad810 0x7f97180ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:01.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.563+0000 7f971f626640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9718159d80 0x7f97180acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:01.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.563+0000 7f971f626640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718149c90 con 0x7f9718159d80 2023-08-09T12:42:01.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.563+0000 7f971f626640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97181493a0 con 0x7f97180ad810 2023-08-09T12:42:01.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.563+0000 7f971f626640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9718149640 con 0x7f97180708c0 2023-08-09T12:42:01.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9718159d80 0x7f97180acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:01.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9718159d80 0x7f97180acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40198/0 (socket says 172.21.15.17:40198) 2023-08-09T12:42:01.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 -- 172.21.15.17:0/91209501 learned_addr learned my addr 172.21.15.17:0/91209501 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:01.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971d3c2640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180708c0 0x7f97181e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:01.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971cbc1640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97180ad810 0x7f97180ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:01.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 -- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180708c0 msgr2=0x7f97181e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:01.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180708c0 0x7f97181e3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 -- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97180ad810 msgr2=0x7f97180ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:01.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97180ad810 0x7f97180ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 -- 172.21.15.17:0/91209501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710009b30 con 0x7f9718159d80 2023-08-09T12:42:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971cbc1640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97180ad810 0x7f97180ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.564+0000 7f971dbc3640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9718159d80 0x7f97180acdf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9710009e50 tx=0x7f9710004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.565+0000 7f970dffb640 1 -- 172.21.15.17:0/91209501 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710009510 con 0x7f9718159d80 2023-08-09T12:42:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.565+0000 7f970dffb640 1 -- 172.21.15.17:0/91209501 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971003e450 con 0x7f9718159d80 2023-08-09T12:42:01.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.565+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9718149920 con 0x7f9718159d80 2023-08-09T12:42:01.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.565+0000 7f970dffb640 1 -- 172.21.15.17:0/91209501 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971003e800 con 0x7f9718159d80 2023-08-09T12:42:01.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.565+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971814a120 con 0x7f9718159d80 2023-08-09T12:42:01.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.566+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9718149e40 con 0x7f9718159d80 2023-08-09T12:42:01.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.567+0000 7f970dffb640 1 -- 172.21.15.17:0/91209501 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f971003e960 con 0x7f9718159d80 2023-08-09T12:42:01.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.568+0000 7f970dffb640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96fc06a050 0x7f96fc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:01.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.568+0000 7f970dffb640 1 -- 172.21.15.17:0/91209501 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97100ab170 con 0x7f9718159d80 2023-08-09T12:42:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.568+0000 7f970dffb640 1 -- 172.21.15.17:0/91209501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f96fc0721a0 con 0x7f9718159d80 2023-08-09T12:42:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.569+0000 7f971d3c2640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96fc06a050 0x7f96fc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.570+0000 7f971d3c2640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96fc06a050 0x7f96fc06c510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9714009a10 tx=0x7f9714008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.573+0000 7f970dffb640 1 -- 172.21.15.17:0/91209501 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f97100768f0 con 0x7f9718159d80 2023-08-09T12:42:01.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.766+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9718067a80 con 0x7f9718159d80 2023-08-09T12:42:01.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.770+0000 7f970dffb640 1 -- 172.21.15.17:0/91209501 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+37090 (secure 0 0 0) 0x7f9710043020 con 0x7f9718159d80 2023-08-09T12:42:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:01.774 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:42:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 55, 2023-08-09T12:42:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:42:01.774 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:42:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:41:59.763121+0000", 2023-08-09T12:42:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:42:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:42:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:42:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:42:01.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:42:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:42:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:42:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:42:01.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:42:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:42:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:42:01.777 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:42:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:42:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:42:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 8, 2023-08-09T12:42:01.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:42:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:42:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:42:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:42:01.779 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:42:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:42:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.780 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:42:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:42:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:42:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:42:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:42:01.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:01.782 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:01.783 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:42:01.784 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:42:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:42:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:42:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:42:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:01.785 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:01.786 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:42:01.787 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:01.788 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:01.789 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:01.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:01.791 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:01.792 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:01.793 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:01.794 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:01.795 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:01.796 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:42:01.797 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:42:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:42:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.798 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:42:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:42:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:42:01.799 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:42:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:42:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:42:01.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:42:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:42:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:42:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:42:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:01.802 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:01.803 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:01.804 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:42:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:42:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:42:01.805 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:42:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:42:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:01.806 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:01.807 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:42:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:01.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:01.809 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:01.810 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:01.811 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:01.812 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:01.813 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:01.814 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:01.815 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:01.816 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:42:01.817 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:42:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:01.818 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:42:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:42:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:42:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:42:01.819 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:42:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:01.820 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-08-09T12:42:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:42:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:23.866427+0000", 2023-08-09T12:42:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:42:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:42:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:42:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:42:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:42:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:42:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:42:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:01.826 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:01.827 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:42:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:01.828 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:01.829 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:01.830 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:01.831 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:01.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:42:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:42:01.834 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:42:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:42:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:42:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:42:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:42:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:42:01.836 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:42:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:42:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:01.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 8, 2023-08-09T12:42:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:42:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:25.245820+0000", 2023-08-09T12:42:01.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:42:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:42:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:01.839 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:42:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:42:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:42:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:42:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:42:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:01.841 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "52", 2023-08-09T12:42:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:01.843 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:01.844 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:01.846 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.847 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:01.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:01.849 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:42:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:42:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:42:01.850 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:42:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.8799999952316284, 2023-08-09T12:42:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.8799999952316284, 2023-08-09T12:42:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:42:01.851 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-09T12:42:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-09T12:42:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.852 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:42:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:42:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:01.853 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:01.854 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.855 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:42:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:42:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:01.856 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:42:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:42:01.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:01.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:42:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:42:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:01.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:42:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:42:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:42:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:42:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:42:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:42:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:01.864 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:42:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:42:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:01.866 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:01.867 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:01.868 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:42:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:01.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:42:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:01.873 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:42:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:42:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:01.875 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.876 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:42:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:42:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:01.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:42:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:42:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:42:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:42:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:42:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:42:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:42:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:01.883 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:42:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:42:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.885 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:42:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:42:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:42:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.888 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:42:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:42:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:42:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.891 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:42:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:42:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:42:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:42:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:42:01.892 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:42:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:01.894 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:42:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:42:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:01.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:42:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:42:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.898 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:42:01.899 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:42:01.900 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:42:01.902 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:42:01.903 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.904 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:42:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:42:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:42:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:42:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:01.905 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:42:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:42:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:01.906 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:01.907 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:42:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:01.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:42:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:42:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:42:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:01.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:42:01.912 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:42:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:42:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:42:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:42:01.915 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:42:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:42:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:42:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:42:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:01.917 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:42:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.919 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:42:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.920 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:42:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:42:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:01.922 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:42:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.923 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:42:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:42:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:42:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:01.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:42:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:42:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:42:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:42:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:01.926 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:42:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:01.927 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:01.928 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:42:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:42:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.930 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:42:01.931 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:42:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:42:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:01.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:42:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.934 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:42:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:42:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:42:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:42:01.936 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:42:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:42:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.938 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:42:01.938 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:01.938 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:01.938 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:01.938 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:01.938 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:01.938 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:01.938 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:01.939 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:01.939 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:01.939 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:01.939 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:01.939 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:01.939 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:42:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:42:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:01.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:42:01.941 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:42:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.942 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:42:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:01.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:42:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.944 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:42:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:42:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:42:01.946 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:42:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:42:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:42:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:42:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:01.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:42:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:42:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:01.948 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:42:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:42:01.949 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:42:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:42:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:42:01.951 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:42:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:01.952 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:42:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:42:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:01.953 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:42:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:42:01.954 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:42:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:42:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:01.956 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:42:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:42:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:01.957 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:42:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:42:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:42:01.958 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:42:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:42:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:42:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:42:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:42:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:42:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:42:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:42:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:42:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:42:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:42:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:42:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:42:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:42:01.960 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:42:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:42:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:42:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:42:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:42:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:42:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:42:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:42:01.961 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:42:01.962 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:01.962 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:42:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.772+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96fc06a050 msgr2=0x7f96fc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.772+0000 7f971f626640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96fc06a050 0x7f96fc06c510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9714009a10 tx=0x7f9714008040 comp rx=0 tx=0).stop 2023-08-09T12:42:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.772+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9718159d80 msgr2=0x7f97180acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.772+0000 7f971f626640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9718159d80 0x7f97180acdf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9710009e50 tx=0x7f9710004a40 comp rx=0 tx=0).stop 2023-08-09T12:42:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.773+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 shutdown_connections 2023-08-09T12:42:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.773+0000 7f971f626640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96fc06a050 0x7f96fc06c510 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.773+0000 7f971f626640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9718159d80 0x7f97180acdf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.773+0000 7f971f626640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97180ad810 0x7f97180ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.773+0000 7f971f626640 1 --2- 172.21.15.17:0/91209501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97180708c0 0x7f97181e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.773+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 >> 172.21.15.17:0/91209501 conn(0x7f97180cb1b0 msgr2=0x7f971806c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.773+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 shutdown_connections 2023-08-09T12:42:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:01.773+0000 7f971f626640 1 -- 172.21.15.17:0/91209501 wait complete. 2023-08-09T12:42:01.965 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:42:06.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:42:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.204+0000 7f499be01640 1 Processor -- start 2023-08-09T12:42:07.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.204+0000 7f499be01640 1 -- start start 2023-08-09T12:42:07.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.205+0000 7f499be01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 0x7f49941616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.205+0000 7f499be01640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940b6460 con 0x7f49940b6000 2023-08-09T12:42:07.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.205+0000 7f499be01640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940cdd10 con 0x7f49940d29d0 2023-08-09T12:42:07.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.205+0000 7f499be01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49940cdff0 con 0x7f499415ce90 2023-08-09T12:42:07.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.206+0000 7f499939c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f49940b6000 0x7f49940cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58300/0 (socket says 172.21.15.17:58300) 2023-08-09T12:42:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.206+0000 7f499939c640 1 -- 172.21.15.17:0/2317143265 learned_addr learned my addr 172.21.15.17:0/2317143265 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.206+0000 7f4999b9d640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 0x7f49941616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.206+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225033343 0 0) 0x7f49940b6460 con 0x7f49940b6000 2023-08-09T12:42:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4980003520 con 0x7f49940b6000 2023-08-09T12:42:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 300006436 0 0) 0x7f4980003520 con 0x7f49940b6000 2023-08-09T12:42:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 msgr2=0x7f49941616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 0x7f49941616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 >> v1:172.21.15.142:6789/0 conn(0x7f49940d29d0 legacy=0x7f49940d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940ce2d0 con 0x7f49940b6000 2023-08-09T12:42:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f4984001670 con 0x7f49940b6000 2023-08-09T12:42:07.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 >> v1:172.21.15.17:6789/0 conn(0x7f49940b6000 legacy=0x7f49940cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49800039a0 0x7f4980003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 0x7f49800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4980004d00 0x7f4980005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49940cdff0 con 0x7f49800039a0 2023-08-09T12:42:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498000ba30 con 0x7f4980004d00 2023-08-09T12:42:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498000bba0 con 0x7f499415ce90 2023-08-09T12:42:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.207+0000 7f4999b9d640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49800039a0 0x7f4980003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f499939c640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 0x7f49800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f4999b9d640 1 -- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 msgr2=0x7f49800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f499a39e640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4980004d00 0x7f4980005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f4999b9d640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 0x7f49800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f4999b9d640 1 -- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4980004d00 msgr2=0x7f4980005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f4999b9d640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4980004d00 0x7f4980005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f4999b9d640 1 -- 172.21.15.17:0/2317143265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4980003520 con 0x7f49800039a0 2023-08-09T12:42:07.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f499a39e640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4980004d00 0x7f4980005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:07.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.208+0000 7f499939c640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499415ce90 0x7f49800047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:07.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.209+0000 7f4999b9d640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49800039a0 0x7f4980003d80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4990009fc0 tx=0x7f49800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a17a8a20646195 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:07.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.209+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499002cc20 con 0x7f49800039a0 2023-08-09T12:42:07.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.209+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000f040 con 0x7f49800039a0 2023-08-09T12:42:07.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.209+0000 7f4998b9b640 1 -- 172.21.15.17:0/2317143265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990034440 con 0x7f49800039a0 2023-08-09T12:42:07.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.210+0000 7f499be01640 1 -- 172.21.15.17:0/2317143265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49800039a0 msgr2=0x7f4980003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.210+0000 7f499be01640 1 --2- 172.21.15.17:0/2317143265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49800039a0 0x7f4980003d80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4990009fc0 tx=0x7f49800057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.210+0000 7f499a39e640 1 -- 172.21.15.17:0/2317143265 reap_dead start 2023-08-09T12:42:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.210+0000 7f499be01640 1 -- 172.21.15.17:0/2317143265 shutdown_connections 2023-08-09T12:42:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.210+0000 7f499be01640 1 -- 172.21.15.17:0/2317143265 >> 172.21.15.17:0/2317143265 conn(0x7f499406fde0 msgr2=0x7f49940701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.210+0000 7f499be01640 1 -- 172.21.15.17:0/2317143265 shutdown_connections 2023-08-09T12:42:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.210+0000 7f499be01640 1 -- 172.21.15.17:0/2317143265 wait complete. 2023-08-09T12:42:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.212+0000 7f499be01640 1 Processor -- start 2023-08-09T12:42:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.212+0000 7f499be01640 1 -- start start 2023-08-09T12:42:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499be01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49800039a0 0x7f4994157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499be01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49940d19f0 0x7f49941f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499be01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f499415d610 0x7f49940b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499be01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499415db10 con 0x7f499415d610 2023-08-09T12:42:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499be01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499415ddf0 con 0x7f49800039a0 2023-08-09T12:42:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499be01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499415e0d0 con 0x7f49940d19f0 2023-08-09T12:42:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499a39e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f499415d610 0x7f49940b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499a39e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f499415d610 0x7f49940b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40218/0 (socket says 172.21.15.17:40218) 2023-08-09T12:42:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.213+0000 7f499a39e640 1 -- 172.21.15.17:0/2218649122 learned_addr learned my addr 172.21.15.17:0/2218649122 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:07.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f4999b9d640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49800039a0 0x7f4994157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499939c640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49940d19f0 0x7f49941f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499a39e640 1 -- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49940d19f0 msgr2=0x7f49941f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499a39e640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49940d19f0 0x7f49941f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499a39e640 1 -- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49800039a0 msgr2=0x7f4994157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499a39e640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49800039a0 0x7f4994157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499a39e640 1 -- 172.21.15.17:0/2218649122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499415e3b0 con 0x7f499415d610 2023-08-09T12:42:07.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499939c640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49940d19f0 0x7f49941f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:07.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499a39e640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f499415d610 0x7f49940b41f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f49940cd160 tx=0x7f498c00d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:07.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f498a7fc640 1 -- 172.21.15.17:0/2218649122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c00b070 con 0x7f499415d610 2023-08-09T12:42:07.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f498a7fc640 1 -- 172.21.15.17:0/2218649122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c0035f0 con 0x7f499415d610 2023-08-09T12:42:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f498a7fc640 1 -- 172.21.15.17:0/2218649122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0039a0 con 0x7f499415d610 2023-08-09T12:42:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.214+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499415e690 con 0x7f499415d610 2023-08-09T12:42:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.215+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49941f32b0 con 0x7f499415d610 2023-08-09T12:42:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.216+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499415e880 con 0x7f499415d610 2023-08-09T12:42:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.217+0000 7f498a7fc640 1 -- 172.21.15.17:0/2218649122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f498c003b00 con 0x7f499415d610 2023-08-09T12:42:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.218+0000 7f498a7fc640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f497806a050 0x7f497806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.218+0000 7f498a7fc640 1 -- 172.21.15.17:0/2218649122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f498c087a80 con 0x7f499415d610 2023-08-09T12:42:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.218+0000 7f4999b9d640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f497806a050 0x7f497806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.219+0000 7f4999b9d640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f497806a050 0x7f497806c510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4990036000 tx=0x7f499002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.222+0000 7f498a7fc640 1 -- 172.21.15.17:0/2218649122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f498c0530d0 con 0x7f499415d610 2023-08-09T12:42:07.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.420+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f49941f32b0 con 0x7f499415d610 2023-08-09T12:42:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.423+0000 7f498a7fc640 1 -- 172.21.15.17:0/2218649122 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v57) v1 ==== 81+0+36974 (secure 0 0 0) 0x7f49941f32b0 con 0x7f499415d610 2023-08-09T12:42:07.427 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:07.427 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:42:07.427 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 57, 2023-08-09T12:42:07.428 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:42:07.428 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:42:07.428 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:42:02.799970+0000", 2023-08-09T12:42:07.428 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:42:07.428 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:42:07.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:42:07.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:42:07.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:42:07.430 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:42:07.430 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:42:07.430 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:42:07.430 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:42:07.430 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:07.431 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:42:07.431 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:42:07.431 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:42:07.431 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:42:07.431 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:42:07.431 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 8, 2023-08-09T12:42:07.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:42:07.432 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:42:07.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:42:07.432 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:42:07.432 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:42:07.432 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:42:07.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.433 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:42:07.433 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:42:07.433 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:42:07.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:42:07.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:42:07.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:07.433 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:07.434 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:07.434 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:07.434 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:07.434 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:07.434 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:07.434 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:07.434 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:07.435 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:07.435 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:42:07.435 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:42:07.435 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:42:07.435 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:42:07.435 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:42:07.435 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:07.435 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:07.436 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:07.436 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:07.436 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:07.436 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:07.436 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:07.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.437 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "57", 2023-08-09T12:42:07.437 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:07.437 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:07.437 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:07.437 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:07.437 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:07.437 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:07.438 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:07.438 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:07.438 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:07.438 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:07.438 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:07.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:07.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:07.439 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:07.439 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:07.439 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:07.439 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:07.439 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:07.439 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:07.440 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:07.440 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:07.440 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:07.440 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:07.440 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:07.440 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:07.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:07.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.441 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:07.441 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:07.441 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:07.442 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:07.442 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:07.442 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:07.442 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:07.442 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:07.442 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:07.442 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:07.443 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:07.443 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:07.443 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:42:07.443 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:42:07.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.443 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:07.443 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:42:07.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.444 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:07.444 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:42:07.444 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:42:07.444 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:42:07.444 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:42:07.444 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:42:07.445 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:07.445 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:07.445 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:07.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.445 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:42:07.446 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:42:07.446 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:42:07.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:42:07.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:42:07.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:07.446 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:07.446 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:07.447 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:07.447 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:07.447 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:07.447 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:07.447 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:07.447 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:07.448 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:07.448 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:42:07.448 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:42:07.448 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:42:07.448 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:42:07.449 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:42:07.449 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:07.449 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:07.449 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:07.449 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:07.449 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:07.449 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:07.450 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:07.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.450 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "57", 2023-08-09T12:42:07.450 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:07.450 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:07.450 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:07.451 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:07.451 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:07.451 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:07.451 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:07.451 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:07.451 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:07.451 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:07.452 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:07.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:07.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:07.453 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:07.453 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:07.453 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:07.453 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:07.454 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:07.454 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:07.454 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:07.454 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:07.454 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:07.454 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:07.454 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:07.455 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:07.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:07.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.455 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:07.455 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:07.455 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:07.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:07.456 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:07.456 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:07.456 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:07.456 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:07.456 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:07.457 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:07.457 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:07.457 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:42:07.457 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:07.457 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:42:07.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.457 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:07.458 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:42:07.458 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:42:07.458 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:42:07.458 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:42:07.458 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:42:07.458 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:07.458 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:07.459 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:07.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-08-09T12:42:07.460 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:42:07.460 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:23.866427+0000", 2023-08-09T12:42:07.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:42:07.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:42:07.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:07.460 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:07.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:07.461 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:07.461 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:07.461 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:07.461 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:07.461 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:07.461 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:07.461 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:07.462 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:42:07.462 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:42:07.462 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:42:07.462 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:42:07.462 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:42:07.462 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:07.463 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:07.463 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:07.463 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:07.463 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:07.463 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:07.464 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:07.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.464 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "57", 2023-08-09T12:42:07.464 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:07.464 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:07.464 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:07.465 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:07.465 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:07.465 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:07.465 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:07.465 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:07.465 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:07.466 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:07.466 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:07.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:07.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:07.466 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:07.466 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:07.467 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:07.467 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:07.467 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:07.467 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:07.467 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:07.467 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:07.468 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:07.468 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:07.468 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:07.468 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:07.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:07.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.469 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:07.469 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:07.469 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:07.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:07.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:07.469 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:07.470 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:07.470 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:07.470 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:07.470 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:07.470 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:07.470 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:07.471 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:42:07.471 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:42:07.471 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:42:07.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.471 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:07.471 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:42:07.471 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:42:07.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.472 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:07.472 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:42:07.472 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:42:07.472 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:42:07.472 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:42:07.473 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:42:07.473 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:07.473 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:07.473 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:07.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.474 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 8, 2023-08-09T12:42:07.475 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:42:07.475 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:25.245820+0000", 2023-08-09T12:42:07.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:42:07.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:42:07.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:07.476 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:07.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:07.477 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:07.477 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:07.477 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:07.478 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:07.478 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:07.478 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:07.479 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:07.479 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:42:07.479 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:42:07.479 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:42:07.479 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:42:07.479 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:42:07.480 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:07.480 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:07.480 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:07.480 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:07.480 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:07.480 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:07.481 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:07.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.481 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "57", 2023-08-09T12:42:07.481 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:07.481 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:07.481 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:07.481 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:07.482 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:07.482 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:07.482 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:07.482 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:07.482 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:07.482 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:07.482 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:07.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:07.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:07.483 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:07.483 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:07.483 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:07.483 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:07.483 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:07.483 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:07.484 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:07.484 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:07.484 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:07.484 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:07.484 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:07.484 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:07.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:07.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.485 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:07.485 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:07.485 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:07.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:07.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:07.486 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:07.486 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:07.486 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:07.486 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:07.486 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:07.486 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:07.486 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:07.487 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:42:07.487 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:42:07.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.487 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:07.487 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:42:07.487 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:42:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.8799999952316284, 2023-08-09T12:42:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.8799999952316284, 2023-08-09T12:42:07.488 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:42:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-09T12:42:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-09T12:42:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:42:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:42:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:07.490 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:07.491 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:42:07.492 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:42:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:42:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:42:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:07.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:42:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:42:07.497 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:07.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:42:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:42:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:42:07.500 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:42:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:42:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:42:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:42:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:07.502 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:07.503 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:42:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:42:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.506 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:07.506 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.507 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:42:07.507 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:07.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.508 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:42:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:42:07.511 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:07.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:42:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.513 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:42:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:07.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.516 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:42:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:42:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:42:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:42:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:42:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:07.518 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:42:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:07.519 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:07.520 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:42:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:42:07.522 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:42:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:42:07.524 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:42:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:42:07.526 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:42:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:42:07.528 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:42:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:42:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:42:07.529 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:42:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:42:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:07.531 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:07.532 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:42:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:42:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:07.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:42:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:42:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:07.536 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:42:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:42:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:42:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:42:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:42:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:42:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:42:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:42:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:42:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:42:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:42:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:42:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:42:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:42:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:42:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:42:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:42:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:42:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:42:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:42:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:42:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:42:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:42:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:42:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:42:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:42:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:42:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:42:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:42:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:42:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:42:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:42:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:42:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:42:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:42:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:42:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:42:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:42:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:42:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:42:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:42:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:42:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:42:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:42:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:42:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:42:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:42:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:42:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:42:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:42:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:42:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:42:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:42:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:42:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:42:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:42:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:42:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:42:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:42:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:42:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:42:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:42:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:42:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:42:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:42:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:42:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:42:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:42:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:42:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:42:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:42:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:42:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:42:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:42:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:42:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:42:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:42:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:42:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:42:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:42:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:42:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:42:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:42:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:42:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:42:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:42:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:42:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:42:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:42:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:42:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:42:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:42:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:42:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:42:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:42:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:42:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:42:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:42:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:42:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:42:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:42:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:42:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:07.614 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:42:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.425+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f497806a050 msgr2=0x7f497806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.425+0000 7f499be01640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f497806a050 0x7f497806c510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4990036000 tx=0x7f499002e000 comp rx=0 tx=0).stop 2023-08-09T12:42:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.425+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f499415d610 msgr2=0x7f49940b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.425+0000 7f499be01640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f499415d610 0x7f49940b41f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f49940cd160 tx=0x7f498c00d890 comp rx=0 tx=0).stop 2023-08-09T12:42:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.426+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 shutdown_connections 2023-08-09T12:42:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.426+0000 7f499be01640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f497806a050 0x7f497806c510 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.426+0000 7f499be01640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f499415d610 0x7f49940b41f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.426+0000 7f499be01640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49940d19f0 0x7f49941f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.426+0000 7f499be01640 1 --2- 172.21.15.17:0/2218649122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49800039a0 0x7f4994157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.426+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 >> 172.21.15.17:0/2218649122 conn(0x7f499406fde0 msgr2=0x7f49940d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:07.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.426+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 shutdown_connections 2023-08-09T12:42:07.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.426+0000 7f499be01640 1 -- 172.21.15.17:0/2218649122 wait complete. 2023-08-09T12:42:07.618 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-09T12:42:07.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:42:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.853+0000 7fb925d53640 1 Processor -- start 2023-08-09T12:42:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.853+0000 7fb925d53640 1 -- start start 2023-08-09T12:42:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.855+0000 7fb925d53640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9200caf00 0x7fb9200cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.855+0000 7fb925d53640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9200c2240 0x7fb9200c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.855+0000 7fb925d53640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9200b34a0 con 0x7fb9201601f0 2023-08-09T12:42:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.855+0000 7fb925d53640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9200b4120 con 0x7fb9200caf00 2023-08-09T12:42:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.855+0000 7fb925d53640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200cb8f0 con 0x7fb9200c2240 2023-08-09T12:42:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.856+0000 7fb924d51640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb9201601f0 0x7fb9200b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58314/0 (socket says 172.21.15.17:58314) 2023-08-09T12:42:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.856+0000 7fb924d51640 1 -- 172.21.15.17:0/1941175294 learned_addr learned my addr 172.21.15.17:0/1941175294 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.856+0000 7fb91ffff640 1 --2- 172.21.15.17:0/1941175294 >> v2:172.21.15.142:3300/0 conn(0x7fb9200caf00 0x7fb9200cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.856+0000 7fb925552640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9200c2240 0x7fb9200c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.856+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805295419 0 0) 0x7fb9200b34a0 con 0x7fb9201601f0 2023-08-09T12:42:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.856+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb910003520 con 0x7fb9201601f0 2023-08-09T12:42:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2332016713 0 0) 0x7fb910003520 con 0x7fb9201601f0 2023-08-09T12:42:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9200c2240 msgr2=0x7fb9200c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9200c2240 0x7fb9200c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 >> v2:172.21.15.142:3300/0 conn(0x7fb9200caf00 msgr2=0x7fb9200cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 --2- 172.21.15.17:0/1941175294 >> v2:172.21.15.142:3300/0 conn(0x7fb9200caf00 0x7fb9200cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200b3780 con 0x7fb9201601f0 2023-08-09T12:42:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fb914001670 con 0x7fb9201601f0 2023-08-09T12:42:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 >> v1:172.21.15.17:6789/0 conn(0x7fb9201601f0 legacy=0x7fb9200b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9200c2240 0x7fb910003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb910003ef0 0x7fb9100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb910004d00 0x7fb910005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200b4120 con 0x7fb910003ef0 2023-08-09T12:42:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200cb8f0 con 0x7fb910004d00 2023-08-09T12:42:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91000b980 con 0x7fb9200c2240 2023-08-09T12:42:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb91ffff640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb910003ef0 0x7fb9100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.857+0000 7fb925552640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb910004d00 0x7fb910005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.858+0000 7fb924d51640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9200c2240 0x7fb910003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.858+0000 7fb91ffff640 1 -- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9200c2240 msgr2=0x7fb910003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.858+0000 7fb91ffff640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9200c2240 0x7fb910003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.858+0000 7fb91ffff640 1 -- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb910004d00 msgr2=0x7fb910005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.858+0000 7fb91ffff640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb910004d00 0x7fb910005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.858+0000 7fb91ffff640 1 -- 172.21.15.17:0/1941175294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910003520 con 0x7fb910003ef0 2023-08-09T12:42:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.858+0000 7fb925552640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb910004d00 0x7fb910005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.859+0000 7fb91ffff640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb910003ef0 0x7fb9100047c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009ac0 tx=0x7fb9100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe89573e5b5c0acb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.859+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c02c6d0 con 0x7fb910003ef0 2023-08-09T12:42:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.859+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c02c830 con 0x7fb910003ef0 2023-08-09T12:42:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.859+0000 7fb91f7fe640 1 -- 172.21.15.17:0/1941175294 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c02cbc0 con 0x7fb910003ef0 2023-08-09T12:42:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.860+0000 7fb925d53640 1 -- 172.21.15.17:0/1941175294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb910003ef0 msgr2=0x7fb9100047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.860+0000 7fb925d53640 1 --2- 172.21.15.17:0/1941175294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb910003ef0 0x7fb9100047c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009ac0 tx=0x7fb9100057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.860+0000 7fb925552640 1 -- 172.21.15.17:0/1941175294 reap_dead start 2023-08-09T12:42:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.860+0000 7fb925d53640 1 -- 172.21.15.17:0/1941175294 shutdown_connections 2023-08-09T12:42:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.860+0000 7fb925d53640 1 -- 172.21.15.17:0/1941175294 >> 172.21.15.17:0/1941175294 conn(0x7fb9200b1d50 msgr2=0x7fb92006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.860+0000 7fb925d53640 1 -- 172.21.15.17:0/1941175294 shutdown_connections 2023-08-09T12:42:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.860+0000 7fb925d53640 1 -- 172.21.15.17:0/1941175294 wait complete. 2023-08-09T12:42:07.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.862+0000 7fb925d53640 1 Processor -- start 2023-08-09T12:42:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.862+0000 7fb925d53640 1 -- start start 2023-08-09T12:42:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.863+0000 7fb925d53640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb910003ef0 0x7fb9200c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.863+0000 7fb925d53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92015bf60 0x7fb9200c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.863+0000 7fb925d53640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9200af110 0x7fb9200af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.863+0000 7fb925d53640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200afad0 con 0x7fb92015bf60 2023-08-09T12:42:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.863+0000 7fb925d53640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200afd60 con 0x7fb9200af110 2023-08-09T12:42:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.863+0000 7fb925d53640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200b0040 con 0x7fb910003ef0 2023-08-09T12:42:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.863+0000 7fb91ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92015bf60 0x7fb9200c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb91ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92015bf60 0x7fb9200c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40234/0 (socket says 172.21.15.17:40234) 2023-08-09T12:42:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb91ffff640 1 -- 172.21.15.17:0/1399302307 learned_addr learned my addr 172.21.15.17:0/1399302307 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb925552640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9200af110 0x7fb9200af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb924d51640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb910003ef0 0x7fb9200c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb91ffff640 1 -- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb910003ef0 msgr2=0x7fb9200c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb91ffff640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb910003ef0 0x7fb9200c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb91ffff640 1 -- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9200af110 msgr2=0x7fb9200af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb91ffff640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9200af110 0x7fb9200af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.864+0000 7fb91ffff640 1 -- 172.21.15.17:0/1399302307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200b0320 con 0x7fb92015bf60 2023-08-09T12:42:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.865+0000 7fb91ffff640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92015bf60 0x7fb9200c44e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009ac0 tx=0x7fb90c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.865+0000 7fb91d7fa640 1 -- 172.21.15.17:0/1399302307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c003810 con 0x7fb92015bf60 2023-08-09T12:42:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.865+0000 7fb91d7fa640 1 -- 172.21.15.17:0/1399302307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c003970 con 0x7fb92015bf60 2023-08-09T12:42:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.865+0000 7fb91d7fa640 1 -- 172.21.15.17:0/1399302307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c003d00 con 0x7fb92015bf60 2023-08-09T12:42:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.865+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9200b0600 con 0x7fb92015bf60 2023-08-09T12:42:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.865+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9200acb70 con 0x7fb92015bf60 2023-08-09T12:42:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.866+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92004e390 con 0x7fb92015bf60 2023-08-09T12:42:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.867+0000 7fb91d7fa640 1 -- 172.21.15.17:0/1399302307 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb90c040450 con 0x7fb92015bf60 2023-08-09T12:42:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.868+0000 7fb91d7fa640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb90406a080 0x7fb90406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.868+0000 7fb91d7fa640 1 -- 172.21.15.17:0/1399302307 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb90c0aa5a0 con 0x7fb92015bf60 2023-08-09T12:42:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.869+0000 7fb924d51640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb90406a080 0x7fb90406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.870+0000 7fb924d51640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb90406a080 0x7fb90406c540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb9200b0860 tx=0x7fb914009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:07.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:07.873+0000 7fb91d7fa640 1 -- 172.21.15.17:0/1399302307 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb90c075bf0 con 0x7fb92015bf60 2023-08-09T12:42:08.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.065+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb9200c2020 con 0x7fb92015bf60 2023-08-09T12:42:08.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.069+0000 7fb91d7fa640 1 -- 172.21.15.17:0/1399302307 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v57) v1 ==== 81+0+36974 (secure 0 0 0) 0x7fb90c0044e0 con 0x7fb92015bf60 2023-08-09T12:42:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:08.074 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:42:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 57, 2023-08-09T12:42:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:42:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:42:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:42:02.799970+0000", 2023-08-09T12:42:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:42:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:42:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:42:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:42:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:42:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:42:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:42:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:42:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:42:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:42:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:42:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:42:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:42:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:42:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 8, 2023-08-09T12:42:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:42:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:42:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:42:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:42:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:42:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:42:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:42:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:42:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:42:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:42:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:42:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:42:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:42:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:42:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:42:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:42:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "57", 2023-08-09T12:42:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:42:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:42:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:42:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:42:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:42:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:42:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:42:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:42:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:42:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:42:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:42:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:42:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:42:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "57", 2023-08-09T12:42:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:42:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:42:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:42:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:42:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:42:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:42:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:42:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-08-09T12:42:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:42:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:23.866427+0000", 2023-08-09T12:42:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:42:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:42:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:42:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:42:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:42:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:42:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:42:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "57", 2023-08-09T12:42:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:42:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:42:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:42:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:42:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:42:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:42:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:42:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:42:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:42:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:42:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 8, 2023-08-09T12:42:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:42:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:41:25.245820+0000", 2023-08-09T12:42:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:42:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:42:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:42:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:42:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:42:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:42:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:42:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:42:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:42:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:42:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:42:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:42:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:42:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:42:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:42:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:42:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:42:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:42:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:42:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:42:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:42:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:42:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:42:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:42:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "57", 2023-08-09T12:42:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:42:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:42:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:42:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:42:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:42:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:42:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:42:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:42:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:42:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:42:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:42:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:42:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:42:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:42:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:42:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:42:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:42:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:42:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:42:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:42:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:42:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:42:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:42:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:42:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:42:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:42:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:42:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:42:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:42:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:42:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:42:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:42:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:42:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:42:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:42:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:42:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:42:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:42:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:42:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:42:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:42:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:42:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:42:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:42:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.8799999952316284, 2023-08-09T12:42:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.8799999952316284, 2023-08-09T12:42:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:42:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.8799999952316284, 2023-08-09T12:42:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.8799999952316284, 2023-08-09T12:42:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:42:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:42:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:42:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:42:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:42:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:42:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:42:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:42:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:42:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:42:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:42:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:42:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:42:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:42:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:42:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:42:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:42:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:42:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:42:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:42:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:42:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:42:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:42:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:42:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:42:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:42:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:42:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:42:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:42:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:42:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:42:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:42:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:42:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:42:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:42:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:42:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:42:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:42:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:42:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:42:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:42:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:42:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:42:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:42:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:42:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:42:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:42:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:42:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:42:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:42:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:42:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:42:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:42:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:42:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:42:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:42:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:42:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:42:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:42:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:42:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:42:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:42:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:42:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:42:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:42:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:42:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:42:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:42:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:42:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:42:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:42:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:42:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:42:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:42:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:42:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:42:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:42:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:42:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:42:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:42:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:42:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:42:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:42:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:42:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:42:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:42:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:42:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:42:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:42:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:42:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:42:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:42:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:42:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:42:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:42:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:42:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:42:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:42:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:42:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:42:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:42:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:42:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:42:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:42:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:42:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:42:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:42:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:42:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:42:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:42:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:42:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 49, 2023-08-09T12:42:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:42:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:42:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:42:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:42:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:42:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:42:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:42:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:42:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:42:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:42:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:42:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:42:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:42:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:42:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:42:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:42:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:42:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:42:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:42:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:42:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:42:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:42:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:42:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:42:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:42:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:42:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:42:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:42:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:42:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:42:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:42:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:42:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:42:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:42:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:42:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:42:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:42:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:42:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:42:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:42:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:42:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:42:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:42:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:42:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:42:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:42:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:42:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:42:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:42:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:42:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:42:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:42:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:42:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:42:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:42:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:42:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:42:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:42:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:42:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:42:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:42:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:42:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:42:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:42:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:42:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:42:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:42:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:42:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:42:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:42:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:42:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:42:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:42:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:42:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:08.259 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:42:08.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.071+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb90406a080 msgr2=0x7fb90406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:08.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.071+0000 7fb925d53640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb90406a080 0x7fb90406c540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb9200b0860 tx=0x7fb914009040 comp rx=0 tx=0).stop 2023-08-09T12:42:08.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.071+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92015bf60 msgr2=0x7fb9200c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:08.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.071+0000 7fb925d53640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92015bf60 0x7fb9200c44e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009ac0 tx=0x7fb90c004730 comp rx=0 tx=0).stop 2023-08-09T12:42:08.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.072+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 shutdown_connections 2023-08-09T12:42:08.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.072+0000 7fb925d53640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb90406a080 0x7fb90406c540 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.072+0000 7fb925d53640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9200af110 0x7fb9200af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.072+0000 7fb925d53640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92015bf60 0x7fb9200c44e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.072+0000 7fb925d53640 1 --2- 172.21.15.17:0/1399302307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb910003ef0 0x7fb9200c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.072+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 >> 172.21.15.17:0/1399302307 conn(0x7fb9200b1d50 msgr2=0x7fb9200c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:08.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.072+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 shutdown_connections 2023-08-09T12:42:08.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.072+0000 7fb925d53640 1 -- 172.21.15.17:0/1399302307 wait complete. 2023-08-09T12:42:08.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.501+0000 7faea62ad640 1 Processor -- start 2023-08-09T12:42:08.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.501+0000 7faea62ad640 1 -- start start 2023-08-09T12:42:08.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.502+0000 7faea62ad640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faea0159250 0x7faea00ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:08.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.502+0000 7faea62ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faea0070230 0x7faea015b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:08.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.502+0000 7faea62ad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea0070650 con 0x7faea00cd400 2023-08-09T12:42:08.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.502+0000 7faea62ad640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea00cd890 con 0x7faea0159250 2023-08-09T12:42:08.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.502+0000 7faea62ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea0070890 con 0x7faea0070230 2023-08-09T12:42:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.503+0000 7fae9ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faea0159250 0x7faea00ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.503+0000 7fae9ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faea0159250 0x7faea00ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57684/0 (socket says 172.21.15.17:57684) 2023-08-09T12:42:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.503+0000 7fae9ffff640 1 -- 172.21.15.17:0/2044044459 learned_addr learned my addr 172.21.15.17:0/2044044459 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.503+0000 7fae9ffff640 1 -- 172.21.15.17:0/2044044459 >> v2:172.21.15.142:3300/0 conn(0x7faea0070230 msgr2=0x7faea015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.503+0000 7fae9ffff640 1 --2- 172.21.15.17:0/2044044459 >> v2:172.21.15.142:3300/0 conn(0x7faea0070230 0x7faea015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.503+0000 7fae9ffff640 1 -- 172.21.15.17:0/2044044459 >> v1:172.21.15.142:6789/0 conn(0x7faea00cd400 legacy=0x7faea006fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.503+0000 7fae9ffff640 1 -- 172.21.15.17:0/2044044459 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea015a940 con 0x7faea0159250 2023-08-09T12:42:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.504+0000 7fae9ffff640 1 --2- 172.21.15.17:0/2044044459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0159250 0x7faea00ccec0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7faea00ce450 tx=0x7fae9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc01c611c0e24bd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.505+0000 7fae9f7fe640 1 -- 172.21.15.17:0/2044044459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90031870 con 0x7faea0159250 2023-08-09T12:42:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.505+0000 7fae9f7fe640 1 -- 172.21.15.17:0/2044044459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae900319d0 con 0x7faea0159250 2023-08-09T12:42:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.505+0000 7fae9f7fe640 1 -- 172.21.15.17:0/2044044459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90031d60 con 0x7faea0159250 2023-08-09T12:42:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.505+0000 7faea62ad640 1 -- 172.21.15.17:0/2044044459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0159250 msgr2=0x7faea00ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.505+0000 7faea62ad640 1 --2- 172.21.15.17:0/2044044459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0159250 0x7faea00ccec0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7faea00ce450 tx=0x7fae9002b910 comp rx=0 tx=0).stop 2023-08-09T12:42:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.506+0000 7faea62ad640 1 -- 172.21.15.17:0/2044044459 shutdown_connections 2023-08-09T12:42:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.506+0000 7faea62ad640 1 --2- 172.21.15.17:0/2044044459 >> v2:172.21.15.142:3300/0 conn(0x7faea0070230 0x7faea015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.506+0000 7faea62ad640 1 --2- 172.21.15.17:0/2044044459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0159250 0x7faea00ccec0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.506+0000 7faea62ad640 1 -- 172.21.15.17:0/2044044459 >> 172.21.15.17:0/2044044459 conn(0x7faea00cb1b0 msgr2=0x7faea00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.506+0000 7faea62ad640 1 -- 172.21.15.17:0/2044044459 shutdown_connections 2023-08-09T12:42:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.506+0000 7faea62ad640 1 -- 172.21.15.17:0/2044044459 wait complete. 2023-08-09T12:42:08.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.507+0000 7faea62ad640 1 Processor -- start 2023-08-09T12:42:08.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.508+0000 7faea62ad640 1 -- start start 2023-08-09T12:42:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7faea62ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0070230 0x7faea01467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7faea62ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faea00cd400 0x7faea00c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7faea62ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea0159250 0x7faea00c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7faea62ad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00c7370 con 0x7faea0070230 2023-08-09T12:42:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7faea62ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00c7600 con 0x7faea00cd400 2023-08-09T12:42:08.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7faea62ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea00c78e0 con 0x7faea0159250 2023-08-09T12:42:08.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0070230 0x7faea01467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:08.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0070230 0x7faea01467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57686/0 (socket says 172.21.15.17:57686) 2023-08-09T12:42:08.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae9ffff640 1 -- 172.21.15.17:0/3772809703 learned_addr learned my addr 172.21.15.17:0/3772809703 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:08.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae97fff640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faea00cd400 0x7faea00c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:08.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7faea484a640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea0159250 0x7faea00c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:08.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae9ffff640 1 -- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea0159250 msgr2=0x7faea00c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:08.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae9ffff640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea0159250 0x7faea00c6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae9ffff640 1 -- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faea00cd400 msgr2=0x7faea00c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:08.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae9ffff640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faea00cd400 0x7faea00c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae9ffff640 1 -- 172.21.15.17:0/3772809703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900094d0 con 0x7faea0070230 2023-08-09T12:42:08.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.509+0000 7fae97fff640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faea00cd400 0x7faea00c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:08.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.510+0000 7fae9ffff640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0070230 0x7faea01467e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fae900097f0 tx=0x7fae900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:08.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.510+0000 7fae9d7fa640 1 -- 172.21.15.17:0/3772809703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90031820 con 0x7faea0070230 2023-08-09T12:42:08.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.510+0000 7fae9d7fa640 1 -- 172.21.15.17:0/3772809703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae900443f0 con 0x7faea0070230 2023-08-09T12:42:08.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.510+0000 7fae9d7fa640 1 -- 172.21.15.17:0/3772809703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae900447a0 con 0x7faea0070230 2023-08-09T12:42:08.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.510+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea00c7bc0 con 0x7faea0070230 2023-08-09T12:42:08.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.510+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea00c8180 con 0x7faea0070230 2023-08-09T12:42:08.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.511+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea0067a80 con 0x7faea0070230 2023-08-09T12:42:08.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.512+0000 7fae9d7fa640 1 -- 172.21.15.17:0/3772809703 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fae9004d450 con 0x7faea0070230 2023-08-09T12:42:08.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.514+0000 7fae9d7fa640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae8006a050 0x7fae8006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:08.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.514+0000 7fae9d7fa640 1 -- 172.21.15.17:0/3772809703 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae9002d040 con 0x7faea0070230 2023-08-09T12:42:08.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.514+0000 7fae97fff640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae8006a050 0x7fae8006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:08.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.515+0000 7fae97fff640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae8006a050 0x7fae8006c510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faea0150540 tx=0x7fae88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:08.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.518+0000 7fae9d7fa640 1 -- 172.21.15.17:0/3772809703 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fae90076240 con 0x7faea0070230 2023-08-09T12:42:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.748+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faea0070650 con 0x7faea0070230 2023-08-09T12:42:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.750+0000 7fae9d7fa640 1 -- 172.21.15.17:0/3772809703 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7faea0070650 con 0x7faea0070230 2023-08-09T12:42:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:08.753 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:42:08.753 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:42:08.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae8006a050 msgr2=0x7fae8006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:08.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae8006a050 0x7fae8006c510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faea0150540 tx=0x7fae88009040 comp rx=0 tx=0).stop 2023-08-09T12:42:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0070230 msgr2=0x7faea01467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0070230 0x7faea01467e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fae900097f0 tx=0x7fae900046c0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 shutdown_connections 2023-08-09T12:42:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae8006a050 0x7fae8006c510 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea0159250 0x7faea00c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faea00cd400 0x7faea00c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 --2- 172.21.15.17:0/3772809703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea0070230 0x7faea01467e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.752+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 >> 172.21.15.17:0/3772809703 conn(0x7faea00cb1b0 msgr2=0x7faea00b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.753+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 shutdown_connections 2023-08-09T12:42:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:08.753+0000 7faea62ad640 1 -- 172.21.15.17:0/3772809703 wait complete. 2023-08-09T12:42:08.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-08-09T12:42:09.018 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":4936,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":42.237564247999998,"mdsmap_epoch":26,"osdmap_epoch":57,"osdmap_epoch_barrier":54,"uptime":48.750830665000002} 2023-08-09T12:42:09.019 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 4936, "mdsmap_epoch": 26, "osdmap_epoch": 57, "osdmap_epoch_barrier": 54, "rank_uptime": 42.237564248, "state": "up:active", "uptime": 48.750830665, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:42:09.019 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:42:09.020 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:42:09.020 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:09.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:09.086 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-08-09T12:42:09.583 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records in 2023-08-09T12:42:09.583 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records out 2023-08-09T12:42:09.583 INFO:teuthology.orchestra.run.smithi017.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.435988 s, 120 MB/s 2023-08-09T12:42:09.584 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:42:09.585 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:42:09.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:42:09.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:42:09.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:42:09.840 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:42:09.841 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:42:09.841 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:09.903 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:42:09.903 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:09.958 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:10.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.184+0000 7f090a937640 1 Processor -- start 2023-08-09T12:42:10.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.184+0000 7f090a937640 1 -- start start 2023-08-09T12:42:10.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.185+0000 7f090a937640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0904160030 0x7f0904160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.185+0000 7f090a937640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09040b5a30 con 0x7f09040b86e0 2023-08-09T12:42:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.185+0000 7f090a937640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09040d0d70 con 0x7f09040cfb50 2023-08-09T12:42:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.185+0000 7f090a937640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09040d1110 con 0x7f0904160030 2023-08-09T12:42:10.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.186+0000 7f0909134640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f09040b86e0 0x7f09040cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35566/0 (socket says 172.21.15.17:35566) 2023-08-09T12:42:10.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.186+0000 7f0909134640 1 -- 172.21.15.17:0/1159916717 learned_addr learned my addr 172.21.15.17:0/1159916717 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.186+0000 7f0909935640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0904160030 0x7f0904160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.186+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609173930 0 0) 0x7f09040b5a30 con 0x7f09040b86e0 2023-08-09T12:42:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08f0003520 con 0x7f09040b86e0 2023-08-09T12:42:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 977590342 0 0) 0x7f08f0003520 con 0x7f09040b86e0 2023-08-09T12:42:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0904160030 msgr2=0x7f0904160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0904160030 0x7f0904160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 >> v1:172.21.15.142:6789/0 conn(0x7f09040cfb50 legacy=0x7f09040d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904160f70 con 0x7f09040b86e0 2023-08-09T12:42:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f08f4001670 con 0x7f09040b86e0 2023-08-09T12:42:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 >> v1:172.21.15.17:6789/0 conn(0x7f09040b86e0 legacy=0x7f09040cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f00039a0 0x7f08f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f00047c0 0x7f08f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f08f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040d1110 con 0x7f08f0005180 2023-08-09T12:42:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f000c050 con 0x7f08f00047c0 2023-08-09T12:42:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f000c210 con 0x7f08f00039a0 2023-08-09T12:42:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.187+0000 7f090a136640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f08f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.188+0000 7f0909935640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f00039a0 0x7f08f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.188+0000 7f0909134640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f00047c0 0x7f08f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.188+0000 7f090a136640 1 -- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f00039a0 msgr2=0x7f08f0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.188+0000 7f090a136640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f00039a0 0x7f08f0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.188+0000 7f090a136640 1 -- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f00047c0 msgr2=0x7f08f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.188+0000 7f090a136640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f00047c0 0x7f08f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.188+0000 7f090a136640 1 -- 172.21.15.17:0/1159916717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0003520 con 0x7f08f0005180 2023-08-09T12:42:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.188+0000 7f0909935640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f00039a0 0x7f08f0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.189+0000 7f090a136640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f08f000b980 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f090406a560 tx=0x7f08f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55e070aeacc6797 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.189+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc0052d0 con 0x7f08f0005180 2023-08-09T12:42:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.189+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc02e050 con 0x7f08f0005180 2023-08-09T12:42:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.189+0000 7f0908933640 1 -- 172.21.15.17:0/1159916717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc0035f0 con 0x7f08f0005180 2023-08-09T12:42:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.190+0000 7f090a937640 1 -- 172.21.15.17:0/1159916717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 msgr2=0x7f08f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.190+0000 7f090a937640 1 --2- 172.21.15.17:0/1159916717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f08f000b980 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f090406a560 tx=0x7f08f00057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.190+0000 7f090a136640 1 -- 172.21.15.17:0/1159916717 reap_dead start 2023-08-09T12:42:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.190+0000 7f090a937640 1 -- 172.21.15.17:0/1159916717 shutdown_connections 2023-08-09T12:42:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.190+0000 7f090a937640 1 -- 172.21.15.17:0/1159916717 >> 172.21.15.17:0/1159916717 conn(0x7f09040697c0 msgr2=0x7f0904069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.190+0000 7f090a937640 1 -- 172.21.15.17:0/1159916717 shutdown_connections 2023-08-09T12:42:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.190+0000 7f090a937640 1 -- 172.21.15.17:0/1159916717 wait complete. 2023-08-09T12:42:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.192+0000 7f090a937640 1 Processor -- start 2023-08-09T12:42:10.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.192+0000 7f090a937640 1 -- start start 2023-08-09T12:42:10.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f090a937640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f0904150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f090a937640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09040cb9b0 0x7f09040cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f090a937640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09040d27e0 0x7f09040d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f090a937640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040d31a0 con 0x7f08f0005180 2023-08-09T12:42:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f090a937640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040b4410 con 0x7f09040cb9b0 2023-08-09T12:42:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f090a937640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0904151100 con 0x7f09040d27e0 2023-08-09T12:42:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f0909935640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f0904150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f0909935640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f0904150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57702/0 (socket says 172.21.15.17:57702) 2023-08-09T12:42:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.193+0000 7f0909935640 1 -- 172.21.15.17:0/4059095350 learned_addr learned my addr 172.21.15.17:0/4059095350 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f0909134640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09040cb9b0 0x7f09040cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f090a136640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09040d27e0 0x7f09040d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f0909935640 1 -- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09040d27e0 msgr2=0x7f09040d2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f0909935640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09040d27e0 0x7f09040d2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f0909935640 1 -- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09040cb9b0 msgr2=0x7f09040cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f0909935640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09040cb9b0 0x7f09040cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f0909935640 1 -- 172.21.15.17:0/4059095350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040b3650 con 0x7f08f0005180 2023-08-09T12:42:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f0909935640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f0904150bc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0900007ea0 tx=0x7f0900007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.194+0000 7f08fa7fc640 1 -- 172.21.15.17:0/4059095350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000145f0 con 0x7f08f0005180 2023-08-09T12:42:10.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.195+0000 7f08fa7fc640 1 -- 172.21.15.17:0/4059095350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0900014750 con 0x7f08f0005180 2023-08-09T12:42:10.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.195+0000 7f08fa7fc640 1 -- 172.21.15.17:0/4059095350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900014b00 con 0x7f08f0005180 2023-08-09T12:42:10.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.195+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09040b3930 con 0x7f08f0005180 2023-08-09T12:42:10.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.195+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09040cc470 con 0x7f08f0005180 2023-08-09T12:42:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.196+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090404e390 con 0x7f08f0005180 2023-08-09T12:42:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.197+0000 7f08fa7fc640 1 -- 172.21.15.17:0/4059095350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0900014c60 con 0x7f08f0005180 2023-08-09T12:42:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.198+0000 7f08fa7fc640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f08e806a080 0x7f08e806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.198+0000 7f08fa7fc640 1 -- 172.21.15.17:0/4059095350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09000892c0 con 0x7f08f0005180 2023-08-09T12:42:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.198+0000 7f0909134640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f08e806a080 0x7f08e806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.200+0000 7f0909134640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f08e806a080 0x7f08e806c540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f08f4001eb0 tx=0x7f08f4001d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:10.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.202+0000 7f08fa7fc640 1 -- 172.21.15.17:0/4059095350 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f09000549a0 con 0x7f08f0005180 2023-08-09T12:42:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.400+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09040d0640 con 0x7f08f0005180 2023-08-09T12:42:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.403+0000 7f08fa7fc640 1 -- 172.21.15.17:0/4059095350 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f0900057fc0 con 0x7f08f0005180 2023-08-09T12:42:10.406 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:10.407 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":57,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:02.799970+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:41:23.866427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-09T12:41:25.245820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f08e806a080 msgr2=0x7f08e806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f08e806a080 0x7f08e806c540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f08f4001eb0 tx=0x7f08f4001d60 comp rx=0 tx=0).stop 2023-08-09T12:42:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 msgr2=0x7f0904150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f0904150bc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0900007ea0 tx=0x7f0900007f90 comp rx=0 tx=0).stop 2023-08-09T12:42:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 shutdown_connections 2023-08-09T12:42:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f08e806a080 0x7f08e806c540 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09040d27e0 0x7f09040d2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09040cb9b0 0x7f09040cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 --2- 172.21.15.17:0/4059095350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f0005180 0x7f0904150bc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 >> 172.21.15.17:0/4059095350 conn(0x7f09040697c0 msgr2=0x7f09040c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 shutdown_connections 2023-08-09T12:42:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.406+0000 7f090a937640 1 -- 172.21.15.17:0/4059095350 wait complete. 2023-08-09T12:42:10.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:41:23.866427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:41:25.245820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:42:10.430 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:42:10.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.666+0000 7f06c4e37640 1 Processor -- start 2023-08-09T12:42:10.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.666+0000 7f06c4e37640 1 -- start start 2023-08-09T12:42:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.667+0000 7f06c4e37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 0x7f06c00cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.667+0000 7f06c4e37640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f06c015cf20 0x7f06c00cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.667+0000 7f06c4e37640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00d0f00 con 0x7f06c015cb40 2023-08-09T12:42:10.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.667+0000 7f06c4e37640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c01611f0 con 0x7f06c015cf20 2023-08-09T12:42:10.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.667+0000 7f06c4e37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c01614d0 con 0x7f06c00b8420 2023-08-09T12:42:10.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.668+0000 7f06bffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f06c015cf20 0x7f06c00cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.668+0000 7f06bffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f06c015cf20 0x7f06c00cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57708/0 (socket says 172.21.15.17:57708) 2023-08-09T12:42:10.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.668+0000 7f06bffff640 1 -- 172.21.15.17:0/195581176 learned_addr learned my addr 172.21.15.17:0/195581176 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:10.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.668+0000 7f06beffd640 1 --2- 172.21.15.17:0/195581176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 0x7f06c00cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.668+0000 7f06bffff640 1 -- 172.21.15.17:0/195581176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 msgr2=0x7f06c00cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:10.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.669+0000 7f06bffff640 1 --2- 172.21.15.17:0/195581176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 0x7f06c00cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.669+0000 7f06bffff640 1 -- 172.21.15.17:0/195581176 >> v1:172.21.15.142:6789/0 conn(0x7f06c015cb40 legacy=0x7f06c01609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.669+0000 7f06bffff640 1 -- 172.21.15.17:0/195581176 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c01617b0 con 0x7f06c015cf20 2023-08-09T12:42:10.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.670+0000 7f06bffff640 1 --2- 172.21.15.17:0/195581176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c00cdda0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009870 tx=0x7f06b802ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac64bc13615f1629 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:10.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.670+0000 7f06be7fc640 1 -- 172.21.15.17:0/195581176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b802f830 con 0x7f06c015cf20 2023-08-09T12:42:10.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.671+0000 7f06be7fc640 1 -- 172.21.15.17:0/195581176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b802f990 con 0x7f06c015cf20 2023-08-09T12:42:10.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.671+0000 7f06be7fc640 1 -- 172.21.15.17:0/195581176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b802fd20 con 0x7f06c015cf20 2023-08-09T12:42:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.671+0000 7f06c4e37640 1 -- 172.21.15.17:0/195581176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 msgr2=0x7f06c00cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.671+0000 7f06c4e37640 1 --2- 172.21.15.17:0/195581176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c00cdda0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009870 tx=0x7f06b802ba10 comp rx=0 tx=0).stop 2023-08-09T12:42:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.671+0000 7f06c4e37640 1 -- 172.21.15.17:0/195581176 shutdown_connections 2023-08-09T12:42:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.671+0000 7f06c4e37640 1 --2- 172.21.15.17:0/195581176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c00cdda0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.671+0000 7f06c4e37640 1 --2- 172.21.15.17:0/195581176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 0x7f06c00cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.671+0000 7f06c4e37640 1 -- 172.21.15.17:0/195581176 >> 172.21.15.17:0/195581176 conn(0x7f06c00d2ab0 msgr2=0x7f06c00d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.672+0000 7f06c4e37640 1 -- 172.21.15.17:0/195581176 shutdown_connections 2023-08-09T12:42:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.672+0000 7f06c4e37640 1 -- 172.21.15.17:0/195581176 wait complete. 2023-08-09T12:42:10.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.673+0000 7f06c4e37640 1 Processor -- start 2023-08-09T12:42:10.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.674+0000 7f06c4e37640 1 -- start start 2023-08-09T12:42:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.674+0000 7f06c4e37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 0x7f06c00cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06c4e37640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c015cb40 0x7f06c015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06c4e37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06c4e37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00ca850 con 0x7f06c015cf20 2023-08-09T12:42:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06c4e37640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00cca20 con 0x7f06c015cb40 2023-08-09T12:42:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06c4e37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0154d90 con 0x7f06c00b8420 2023-08-09T12:42:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c015bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57722/0 (socket says 172.21.15.17:57722) 2023-08-09T12:42:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bffff640 1 -- 172.21.15.17:0/1993485437 learned_addr learned my addr 172.21.15.17:0/1993485437 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:10.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bf7fe640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 0x7f06c00cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06beffd640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c015cb40 0x7f06c015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bffff640 1 -- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 msgr2=0x7f06c00cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bffff640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 0x7f06c00cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bffff640 1 -- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c015cb40 msgr2=0x7f06c015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bffff640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c015cb40 0x7f06c015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.675+0000 7f06bffff640 1 -- 172.21.15.17:0/1993485437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80094d0 con 0x7f06c015cf20 2023-08-09T12:42:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.676+0000 7f06beffd640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c015cb40 0x7f06c015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.676+0000 7f06bffff640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c015bbc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f06b80090b0 tx=0x7f06b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.676+0000 7f06a7fff640 1 -- 172.21.15.17:0/1993485437 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b803c040 con 0x7f06c015cf20 2023-08-09T12:42:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.676+0000 7f06a7fff640 1 -- 172.21.15.17:0/1993485437 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b8037bc0 con 0x7f06c015cf20 2023-08-09T12:42:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.676+0000 7f06a7fff640 1 -- 172.21.15.17:0/1993485437 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80423f0 con 0x7f06c015cf20 2023-08-09T12:42:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.676+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c00c9fb0 con 0x7f06c015cf20 2023-08-09T12:42:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.676+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c00ca570 con 0x7f06c015cf20 2023-08-09T12:42:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.678+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c0154af0 con 0x7f06c015cf20 2023-08-09T12:42:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.679+0000 7f06a7fff640 1 -- 172.21.15.17:0/1993485437 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f06b802d3c0 con 0x7f06c015cf20 2023-08-09T12:42:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.680+0000 7f06a7fff640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f06ac06a050 0x7f06ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.680+0000 7f06a7fff640 1 -- 172.21.15.17:0/1993485437 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06b80aa620 con 0x7f06c015cf20 2023-08-09T12:42:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.680+0000 7f06bf7fe640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f06ac06a050 0x7f06ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.681+0000 7f06bf7fe640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f06ac06a050 0x7f06ac06c510 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f06b00012e0 tx=0x7f06b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:10.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.684+0000 7f06a7fff640 1 -- 172.21.15.17:0/1993485437 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f06c0154af0 con 0x7f06c015cf20 2023-08-09T12:42:10.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.890+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06c0154ed0 con 0x7f06c015cf20 2023-08-09T12:42:10.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.891+0000 7f06a7fff640 1 -- 172.21.15.17:0/1993485437 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06c0154ed0 con 0x7f06c015cf20 2023-08-09T12:42:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:42:10.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f06ac06a050 msgr2=0x7f06ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f06ac06a050 0x7f06ac06c510 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f06b00012e0 tx=0x7f06b0009040 comp rx=0 tx=0).stop 2023-08-09T12:42:10.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 msgr2=0x7f06c015bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:10.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c015bbc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f06b80090b0 tx=0x7f06b8004730 comp rx=0 tx=0).stop 2023-08-09T12:42:10.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 shutdown_connections 2023-08-09T12:42:10.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f06ac06a050 0x7f06ac06c510 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c015cf20 0x7f06c015bbc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c015cb40 0x7f06c015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 --2- 172.21.15.17:0/1993485437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c00b8420 0x7f06c00cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:10.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 >> 172.21.15.17:0/1993485437 conn(0x7f06c00d2ab0 msgr2=0x7f06c00cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:10.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 shutdown_connections 2023-08-09T12:42:10.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:10.894+0000 7f06c4e37640 1 -- 172.21.15.17:0/1993485437 wait complete. 2023-08-09T12:42:10.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:42:11.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.145+0000 7f744d06c640 1 Processor -- start 2023-08-09T12:42:11.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.145+0000 7f744d06c640 1 -- start start 2023-08-09T12:42:11.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.146+0000 7f744d06c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f744815ce90 0x7f74481616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f744d06c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480d29d0 0x7f74480d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f744d06c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480b6460 con 0x7f74480b6000 2023-08-09T12:42:11.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f744d06c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480d33a0 con 0x7f744815ce90 2023-08-09T12:42:11.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f744d06c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74480cdd10 con 0x7f74480d29d0 2023-08-09T12:42:11.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f7446d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f744815ce90 0x7f74481616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f7446d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f744815ce90 0x7f74481616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57732/0 (socket says 172.21.15.17:57732) 2023-08-09T12:42:11.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f744659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f74480b6000 0x7f74480cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35572/0 (socket says 172.21.15.17:35572) 2023-08-09T12:42:11.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f7446d9d640 1 -- 172.21.15.17:0/2726666764 learned_addr learned my addr 172.21.15.17:0/2726666764 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:11.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.147+0000 7f744759e640 1 --2- 172.21.15.17:0/2726666764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480d29d0 0x7f74480d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.148+0000 7f7446d9d640 1 -- 172.21.15.17:0/2726666764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480d29d0 msgr2=0x7f74480d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:11.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.148+0000 7f7446d9d640 1 --2- 172.21.15.17:0/2726666764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480d29d0 0x7f74480d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.148+0000 7f7446d9d640 1 -- 172.21.15.17:0/2726666764 >> v1:172.21.15.17:6789/0 conn(0x7f74480b6000 legacy=0x7f74480cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.148+0000 7f7446d9d640 1 -- 172.21.15.17:0/2726666764 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480cdff0 con 0x7f744815ce90 2023-08-09T12:42:11.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.148+0000 7f7445d9b640 1 -- 172.21.15.17:0/2726666764 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710459616 0 0) 0x7f74480b6460 con 0x7f74480b6000 2023-08-09T12:42:11.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.149+0000 7f7446d9d640 1 --2- 172.21.15.17:0/2726666764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f74481616e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7438009e50 tx=0x7f743802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4392cd40a778a20e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:11.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.149+0000 7f7445d9b640 1 -- 172.21.15.17:0/2726666764 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743802caf0 con 0x7f744815ce90 2023-08-09T12:42:11.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.149+0000 7f7445d9b640 1 -- 172.21.15.17:0/2726666764 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743802cc50 con 0x7f744815ce90 2023-08-09T12:42:11.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.149+0000 7f7445d9b640 1 -- 172.21.15.17:0/2726666764 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380343f0 con 0x7f744815ce90 2023-08-09T12:42:11.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.150+0000 7f744d06c640 1 -- 172.21.15.17:0/2726666764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 msgr2=0x7f74481616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.150+0000 7f744d06c640 1 --2- 172.21.15.17:0/2726666764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f74481616e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7438009e50 tx=0x7f743802bf50 comp rx=0 tx=0).stop 2023-08-09T12:42:11.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.150+0000 7f744d06c640 1 -- 172.21.15.17:0/2726666764 shutdown_connections 2023-08-09T12:42:11.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.150+0000 7f744d06c640 1 --2- 172.21.15.17:0/2726666764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480d29d0 0x7f74480d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.150+0000 7f744d06c640 1 --2- 172.21.15.17:0/2726666764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f74481616e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.150+0000 7f744d06c640 1 -- 172.21.15.17:0/2726666764 >> 172.21.15.17:0/2726666764 conn(0x7f744806fde0 msgr2=0x7f74480701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:11.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.150+0000 7f744d06c640 1 -- 172.21.15.17:0/2726666764 shutdown_connections 2023-08-09T12:42:11.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.150+0000 7f744d06c640 1 -- 172.21.15.17:0/2726666764 wait complete. 2023-08-09T12:42:11.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.152+0000 7f744d06c640 1 Processor -- start 2023-08-09T12:42:11.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.152+0000 7f744d06c640 1 -- start start 2023-08-09T12:42:11.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744d06c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480b6000 0x7f7448152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744d06c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74480d29d0 0x7f744815e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744d06c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f744815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744d06c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7448153430 con 0x7f744815ce90 2023-08-09T12:42:11.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744d06c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7448153990 con 0x7f74480d29d0 2023-08-09T12:42:11.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744d06c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7448153c70 con 0x7f74480b6000 2023-08-09T12:42:11.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f744815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f744815eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57734/0 (socket says 172.21.15.17:57734) 2023-08-09T12:42:11.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.153+0000 7f744759e640 1 -- 172.21.15.17:0/3095536200 learned_addr learned my addr 172.21.15.17:0/3095536200 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:11.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f744659c640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74480d29d0 0x7f744815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f7446d9d640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480b6000 0x7f7448152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f744759e640 1 -- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480b6000 msgr2=0x7f7448152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f744759e640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480b6000 0x7f7448152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f744759e640 1 -- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74480d29d0 msgr2=0x7f744815e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f744759e640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74480d29d0 0x7f744815e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f744759e640 1 -- 172.21.15.17:0/3095536200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438009b30 con 0x7f744815ce90 2023-08-09T12:42:11.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f7446d9d640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480b6000 0x7f7448152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:11.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f744759e640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f744815eda0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f744000d800 tx=0x7f744000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:11.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f742f7fe640 1 -- 172.21.15.17:0/3095536200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000b6c0 con 0x7f744815ce90 2023-08-09T12:42:11.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.154+0000 7f742f7fe640 1 -- 172.21.15.17:0/3095536200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744000b840 con 0x7f744815ce90 2023-08-09T12:42:11.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.155+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7448153f50 con 0x7f744815ce90 2023-08-09T12:42:11.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.155+0000 7f742f7fe640 1 -- 172.21.15.17:0/3095536200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000bbf0 con 0x7f744815ce90 2023-08-09T12:42:11.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.155+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7448154510 con 0x7f744815ce90 2023-08-09T12:42:11.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.156+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7448154730 con 0x7f744815ce90 2023-08-09T12:42:11.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.157+0000 7f742f7fe640 1 -- 172.21.15.17:0/3095536200 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f744000bd50 con 0x7f744815ce90 2023-08-09T12:42:11.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.158+0000 7f742f7fe640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f743406a050 0x7f743406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.158+0000 7f742f7fe640 1 -- 172.21.15.17:0/3095536200 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7440088b50 con 0x7f744815ce90 2023-08-09T12:42:11.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.158+0000 7f7446d9d640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f743406a050 0x7f743406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.159+0000 7f7446d9d640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f743406a050 0x7f743406c510 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7438035000 tx=0x7f7438030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:11.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.162+0000 7f742f7fe640 1 -- 172.21.15.17:0/3095536200 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f74400541f0 con 0x7f744815ce90 2023-08-09T12:42:11.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.354+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74480ce2a0 con 0x7f744815ce90 2023-08-09T12:42:11.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.355+0000 7f742f7fe640 1 -- 172.21.15.17:0/3095536200 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7440057810 con 0x7f744815ce90 2023-08-09T12:42:11.358 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:42:11.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f743406a050 msgr2=0x7f743406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f743406a050 0x7f743406c510 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7438035000 tx=0x7f7438030000 comp rx=0 tx=0).stop 2023-08-09T12:42:11.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 msgr2=0x7f744815eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f744815eda0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f744000d800 tx=0x7f744000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 shutdown_connections 2023-08-09T12:42:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f743406a050 0x7f743406c510 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744815ce90 0x7f744815eda0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74480d29d0 0x7f744815e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 --2- 172.21.15.17:0/3095536200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74480b6000 0x7f7448152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 >> 172.21.15.17:0/3095536200 conn(0x7f744806fde0 msgr2=0x7f74480b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:11.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 shutdown_connections 2023-08-09T12:42:11.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.358+0000 7f744d06c640 1 -- 172.21.15.17:0/3095536200 wait complete. 2023-08-09T12:42:11.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:42:11.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.616+0000 7f885eca6640 1 Processor -- start 2023-08-09T12:42:11.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.616+0000 7f885eca6640 1 -- start start 2023-08-09T12:42:11.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.618+0000 7f885eca6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8858160260 0x7f88580b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.618+0000 7f885eca6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f885806fde0 0x7f8858070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.618+0000 7f885eca6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8858160640 con 0x7f88580b1dc0 2023-08-09T12:42:11.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.618+0000 7f885eca6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8858070770 con 0x7f885806fde0 2023-08-09T12:42:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.618+0000 7f885eca6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580d0d40 con 0x7f8858160260 2023-08-09T12:42:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.618+0000 7f885d243640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f885806fde0 0x7f8858070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.618+0000 7f885d243640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f885806fde0 0x7f8858070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57742/0 (socket says 172.21.15.17:57742) 2023-08-09T12:42:11.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.618+0000 7f885d243640 1 -- 172.21.15.17:0/2126206744 learned_addr learned my addr 172.21.15.17:0/2126206744 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.619+0000 7f885ca42640 1 --2- 172.21.15.17:0/2126206744 >> v2:172.21.15.142:3300/0 conn(0x7f8858160260 0x7f88580b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.619+0000 7f885d243640 1 -- 172.21.15.17:0/2126206744 >> v2:172.21.15.142:3300/0 conn(0x7f8858160260 msgr2=0x7f88580b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.619+0000 7f885d243640 1 --2- 172.21.15.17:0/2126206744 >> v2:172.21.15.142:3300/0 conn(0x7f8858160260 0x7f88580b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.619+0000 7f885d243640 1 -- 172.21.15.17:0/2126206744 >> v1:172.21.15.142:6789/0 conn(0x7f88580b1dc0 legacy=0x7f88580b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.619+0000 7f885d243640 1 -- 172.21.15.17:0/2126206744 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580d1020 con 0x7f885806fde0 2023-08-09T12:42:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.620+0000 7f885d243640 1 --2- 172.21.15.17:0/2126206744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885806fde0 0x7f8858070230 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f88580cd3b0 tx=0x7f885002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14bccbda9b17e0a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.621+0000 7f88577fe640 1 -- 172.21.15.17:0/2126206744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850030860 con 0x7f885806fde0 2023-08-09T12:42:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.621+0000 7f88577fe640 1 -- 172.21.15.17:0/2126206744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88500309c0 con 0x7f885806fde0 2023-08-09T12:42:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.621+0000 7f88577fe640 1 -- 172.21.15.17:0/2126206744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850030d50 con 0x7f885806fde0 2023-08-09T12:42:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.621+0000 7f885eca6640 1 -- 172.21.15.17:0/2126206744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885806fde0 msgr2=0x7f8858070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.621+0000 7f885eca6640 1 --2- 172.21.15.17:0/2126206744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885806fde0 0x7f8858070230 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f88580cd3b0 tx=0x7f885002b9a0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.622+0000 7f885eca6640 1 -- 172.21.15.17:0/2126206744 shutdown_connections 2023-08-09T12:42:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.622+0000 7f885eca6640 1 --2- 172.21.15.17:0/2126206744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885806fde0 0x7f8858070230 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.622+0000 7f885eca6640 1 --2- 172.21.15.17:0/2126206744 >> v2:172.21.15.142:3300/0 conn(0x7f8858160260 0x7f88580b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.622+0000 7f885eca6640 1 -- 172.21.15.17:0/2126206744 >> 172.21.15.17:0/2126206744 conn(0x7f8858069be0 msgr2=0x7f8858069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.622+0000 7f885eca6640 1 -- 172.21.15.17:0/2126206744 shutdown_connections 2023-08-09T12:42:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.622+0000 7f885eca6640 1 -- 172.21.15.17:0/2126206744 wait complete. 2023-08-09T12:42:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.623+0000 7f885eca6640 1 Processor -- start 2023-08-09T12:42:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.624+0000 7f885eca6640 1 -- start start 2023-08-09T12:42:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.624+0000 7f885eca6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f885806fde0 0x7f88580cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f885eca6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88580b1dc0 0x7f88580c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f885eca6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8858160260 0x7f88580b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f885eca6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885815b7c0 con 0x7f88580b1dc0 2023-08-09T12:42:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f885eca6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b1300 con 0x7f885806fde0 2023-08-09T12:42:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f885eca6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580cda40 con 0x7f8858160260 2023-08-09T12:42:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f8857fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88580b1dc0 0x7f88580c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f8857fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88580b1dc0 0x7f88580c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57756/0 (socket says 172.21.15.17:57756) 2023-08-09T12:42:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f8857fff640 1 -- 172.21.15.17:0/686637719 learned_addr learned my addr 172.21.15.17:0/686637719 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f885ca42640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f885806fde0 0x7f88580cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f885d243640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8858160260 0x7f88580b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f8857fff640 1 -- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8858160260 msgr2=0x7f88580b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f8857fff640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8858160260 0x7f88580b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f8857fff640 1 -- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f885806fde0 msgr2=0x7f88580cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f8857fff640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f885806fde0 0x7f88580cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.625+0000 7f8857fff640 1 -- 172.21.15.17:0/686637719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88500094d0 con 0x7f88580b1dc0 2023-08-09T12:42:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.626+0000 7f8857fff640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88580b1dc0 0x7f88580c9060 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c430 tx=0x7f884c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.626+0000 7f88557fa640 1 -- 172.21.15.17:0/686637719 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c011790 con 0x7f88580b1dc0 2023-08-09T12:42:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.626+0000 7f88557fa640 1 -- 172.21.15.17:0/686637719 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c0118f0 con 0x7f88580b1dc0 2023-08-09T12:42:11.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.626+0000 7f88557fa640 1 -- 172.21.15.17:0/686637719 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c011ce0 con 0x7f88580b1dc0 2023-08-09T12:42:11.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.626+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88580c9cd0 con 0x7f88580b1dc0 2023-08-09T12:42:11.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.626+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88580ca290 con 0x7f88580b1dc0 2023-08-09T12:42:11.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.627+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858067a80 con 0x7f88580b1dc0 2023-08-09T12:42:11.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.628+0000 7f88557fa640 1 -- 172.21.15.17:0/686637719 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f884c01c460 con 0x7f88580b1dc0 2023-08-09T12:42:11.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.629+0000 7f88557fa640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f884406a050 0x7f884406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:11.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.629+0000 7f88557fa640 1 -- 172.21.15.17:0/686637719 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f884c0885b0 con 0x7f88580b1dc0 2023-08-09T12:42:11.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.630+0000 7f885ca42640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f884406a050 0x7f884406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:11.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.631+0000 7f885ca42640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f884406a050 0x7f884406c510 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f88480099c0 tx=0x7f8848003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:11.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.633+0000 7f88557fa640 1 -- 172.21.15.17:0/686637719 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f884c053c50 con 0x7f88580b1dc0 2023-08-09T12:42:11.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.830+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88580008d0 con 0x7f88580b1dc0 2023-08-09T12:42:11.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.831+0000 7f88557fa640 1 -- 172.21.15.17:0/686637719 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f884c057270 con 0x7f88580b1dc0 2023-08-09T12:42:11.834 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:42:11.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.833+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f884406a050 msgr2=0x7f884406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.833+0000 7f885eca6640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f884406a050 0x7f884406c510 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f88480099c0 tx=0x7f8848003990 comp rx=0 tx=0).stop 2023-08-09T12:42:11.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.833+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88580b1dc0 msgr2=0x7f88580c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:11.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.833+0000 7f885eca6640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88580b1dc0 0x7f88580c9060 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c430 tx=0x7f884c00c8f0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.834+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 shutdown_connections 2023-08-09T12:42:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.834+0000 7f885eca6640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f884406a050 0x7f884406c510 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.834+0000 7f885eca6640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8858160260 0x7f88580b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.834+0000 7f885eca6640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88580b1dc0 0x7f88580c9060 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.834+0000 7f885eca6640 1 --2- 172.21.15.17:0/686637719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f885806fde0 0x7f88580cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:11.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.834+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 >> 172.21.15.17:0/686637719 conn(0x7f8858069be0 msgr2=0x7f88580b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:11.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.834+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 shutdown_connections 2023-08-09T12:42:11.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:11.834+0000 7f885eca6640 1 -- 172.21.15.17:0/686637719 wait complete. 2023-08-09T12:42:11.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:42:12.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.083+0000 7f953b138640 1 Processor -- start 2023-08-09T12:42:12.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.083+0000 7f953b138640 1 -- start start 2023-08-09T12:42:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.085+0000 7f953b138640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340adc40 0x7f953406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.085+0000 7f953b138640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95340cc630 0x7f95340ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.085+0000 7f953b138640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340b2250 con 0x7f95340b3b40 2023-08-09T12:42:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.085+0000 7f953b138640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95340ae020 con 0x7f95340cc630 2023-08-09T12:42:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.085+0000 7f953b138640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95340b2530 con 0x7f95340adc40 2023-08-09T12:42:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.086+0000 7f9538ed4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340adc40 0x7f953406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.086+0000 7f9533fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f95340b3b40 0x7f95340b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:55908/0 (socket says 172.21.15.17:55908) 2023-08-09T12:42:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.086+0000 7f9533fff640 1 -- 172.21.15.17:0/4207696096 learned_addr learned my addr 172.21.15.17:0/4207696096 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.086+0000 7f95396d5640 1 --2- 172.21.15.17:0/4207696096 >> v2:172.21.15.142:3300/0 conn(0x7f95340cc630 0x7f95340ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.087+0000 7f9538ed4640 1 -- 172.21.15.17:0/4207696096 >> v2:172.21.15.142:3300/0 conn(0x7f95340cc630 msgr2=0x7f95340ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:12.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.087+0000 7f9538ed4640 1 --2- 172.21.15.17:0/4207696096 >> v2:172.21.15.142:3300/0 conn(0x7f95340cc630 0x7f95340ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.087+0000 7f9538ed4640 1 -- 172.21.15.17:0/4207696096 >> v1:172.21.15.142:6789/0 conn(0x7f95340b3b40 legacy=0x7f95340b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.087+0000 7f9538ed4640 1 -- 172.21.15.17:0/4207696096 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953406fe80 con 0x7f95340adc40 2023-08-09T12:42:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.088+0000 7f9538ed4640 1 --2- 172.21.15.17:0/4207696096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340adc40 0x7f953406c280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95280097a0 tx=0x7f952802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56657684e5284f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:12.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.089+0000 7f95337fe640 1 -- 172.21.15.17:0/4207696096 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952802d040 con 0x7f95340adc40 2023-08-09T12:42:12.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.089+0000 7f95337fe640 1 -- 172.21.15.17:0/4207696096 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9528031810 con 0x7f95340adc40 2023-08-09T12:42:12.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.089+0000 7f95337fe640 1 -- 172.21.15.17:0/4207696096 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528031ba0 con 0x7f95340adc40 2023-08-09T12:42:12.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.090+0000 7f953b138640 1 -- 172.21.15.17:0/4207696096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340adc40 msgr2=0x7f953406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.090+0000 7f953b138640 1 --2- 172.21.15.17:0/4207696096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340adc40 0x7f953406c280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95280097a0 tx=0x7f952802b8b0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.090+0000 7f953b138640 1 -- 172.21.15.17:0/4207696096 shutdown_connections 2023-08-09T12:42:12.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.090+0000 7f953b138640 1 --2- 172.21.15.17:0/4207696096 >> v2:172.21.15.142:3300/0 conn(0x7f95340cc630 0x7f95340ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.090+0000 7f953b138640 1 --2- 172.21.15.17:0/4207696096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340adc40 0x7f953406c280 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.090+0000 7f953b138640 1 -- 172.21.15.17:0/4207696096 >> 172.21.15.17:0/4207696096 conn(0x7f95340cb1b0 msgr2=0x7f95340cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:12.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.090+0000 7f953b138640 1 -- 172.21.15.17:0/4207696096 shutdown_connections 2023-08-09T12:42:12.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.090+0000 7f953b138640 1 -- 172.21.15.17:0/4207696096 wait complete. 2023-08-09T12:42:12.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.092+0000 7f953b138640 1 Processor -- start 2023-08-09T12:42:12.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.093+0000 7f953b138640 1 -- start start 2023-08-09T12:42:12.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f953b138640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340adc40 0x7f95340ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f953b138640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95340b3b40 0x7f953406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f953b138640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340cc630 0x7f953406c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f953b138640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95341f17c0 con 0x7f95340adc40 2023-08-09T12:42:12.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f953b138640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95341f1a30 con 0x7f95340b3b40 2023-08-09T12:42:12.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f953b138640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95341f1d10 con 0x7f95340cc630 2023-08-09T12:42:12.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f9538ed4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340adc40 0x7f95340ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f9538ed4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340adc40 0x7f95340ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57760/0 (socket says 172.21.15.17:57760) 2023-08-09T12:42:12.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.094+0000 7f9538ed4640 1 -- 172.21.15.17:0/4257995427 learned_addr learned my addr 172.21.15.17:0/4257995427 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:12.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f9533fff640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95340b3b40 0x7f953406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f95396d5640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340cc630 0x7f953406c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f9538ed4640 1 -- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340cc630 msgr2=0x7f953406c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f9538ed4640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340cc630 0x7f953406c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f9538ed4640 1 -- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95340b3b40 msgr2=0x7f953406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f9538ed4640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95340b3b40 0x7f953406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f9538ed4640 1 -- 172.21.15.17:0/4257995427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009400 con 0x7f95340adc40 2023-08-09T12:42:12.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f95396d5640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340cc630 0x7f953406c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:12.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.095+0000 7f9538ed4640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340adc40 0x7f95340ac320 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f95280098c0 tx=0x7f95280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:12.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.096+0000 7f95317fa640 1 -- 172.21.15.17:0/4257995427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528006e10 con 0x7f95340adc40 2023-08-09T12:42:12.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.096+0000 7f95317fa640 1 -- 172.21.15.17:0/4257995427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952803ad60 con 0x7f95340adc40 2023-08-09T12:42:12.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.096+0000 7f95317fa640 1 -- 172.21.15.17:0/4257995427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528044630 con 0x7f95340adc40 2023-08-09T12:42:12.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.096+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95341f1ff0 con 0x7f95340adc40 2023-08-09T12:42:12.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.096+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95340abc00 con 0x7f95340adc40 2023-08-09T12:42:12.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.097+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95340abdf0 con 0x7f95340adc40 2023-08-09T12:42:12.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.098+0000 7f95317fa640 1 -- 172.21.15.17:0/4257995427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f952804d450 con 0x7f95340adc40 2023-08-09T12:42:12.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.099+0000 7f95317fa640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f951806a050 0x7f951806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.099+0000 7f95317fa640 1 -- 172.21.15.17:0/4257995427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f95280aa980 con 0x7f95340adc40 2023-08-09T12:42:12.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.099+0000 7f9533fff640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f951806a050 0x7f951806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.101+0000 7f9533fff640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f951806a050 0x7f951806c510 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f95340a9d10 tx=0x7f9520009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:12.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.103+0000 7f95317fa640 1 -- 172.21.15.17:0/4257995427 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9528075f90 con 0x7f95340adc40 2023-08-09T12:42:12.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.301+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9534067a80 con 0x7f95340adc40 2023-08-09T12:42:12.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.302+0000 7f95317fa640 1 -- 172.21.15.17:0/4257995427 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95280795b0 con 0x7f95340adc40 2023-08-09T12:42:12.305 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:42:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.304+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f951806a050 msgr2=0x7f951806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.304+0000 7f953b138640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f951806a050 0x7f951806c510 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f95340a9d10 tx=0x7f9520009040 comp rx=0 tx=0).stop 2023-08-09T12:42:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.304+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340adc40 msgr2=0x7f95340ac320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.304+0000 7f953b138640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340adc40 0x7f95340ac320 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f95280098c0 tx=0x7f95280046c0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.305+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 shutdown_connections 2023-08-09T12:42:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.305+0000 7f953b138640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f951806a050 0x7f951806c510 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.305+0000 7f953b138640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95340cc630 0x7f953406c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.305+0000 7f953b138640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95340b3b40 0x7f953406bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.305+0000 7f953b138640 1 --2- 172.21.15.17:0/4257995427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340adc40 0x7f95340ac320 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.305+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 >> 172.21.15.17:0/4257995427 conn(0x7f95340cb1b0 msgr2=0x7f95340ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.305+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 shutdown_connections 2023-08-09T12:42:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.305+0000 7f953b138640 1 -- 172.21.15.17:0/4257995427 wait complete. 2023-08-09T12:42:12.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:42:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.545+0000 7f4fe23a4640 1 Processor -- start 2023-08-09T12:42:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.546+0000 7f4fe23a4640 1 -- start start 2023-08-09T12:42:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.547+0000 7f4fe23a4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4fdc072ac0 0x7f4fdc15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.547+0000 7f4fe23a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc0cce70 0x7f4fdc15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.547+0000 7f4fe23a4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc0b4980 con 0x7f4fdc072ea0 2023-08-09T12:42:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.547+0000 7f4fe23a4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc0b4770 con 0x7f4fdc072ac0 2023-08-09T12:42:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.547+0000 7f4fe23a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0b4c60 con 0x7f4fdc0cce70 2023-08-09T12:42:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.548+0000 7f4fe0941640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4fdc072ea0 0x7f4fdc06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35580/0 (socket says 172.21.15.17:35580) 2023-08-09T12:42:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.548+0000 7f4fe0941640 1 -- 172.21.15.17:0/2607679768 learned_addr learned my addr 172.21.15.17:0/2607679768 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.548+0000 7f4fdbfff640 1 --2- 172.21.15.17:0/2607679768 >> v2:172.21.15.17:3300/0 conn(0x7f4fdc072ac0 0x7f4fdc15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.548+0000 7f4fd37fe640 1 --2- 172.21.15.17:0/2607679768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc0cce70 0x7f4fdc15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.548+0000 7f4fdb7fe640 1 -- 172.21.15.17:0/2607679768 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010591152 0 0) 0x7f4fdc0b4980 con 0x7f4fdc072ea0 2023-08-09T12:42:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.549+0000 7f4fdb7fe640 1 -- 172.21.15.17:0/2607679768 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc8003520 con 0x7f4fdc072ea0 2023-08-09T12:42:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.549+0000 7f4fdbfff640 1 -- 172.21.15.17:0/2607679768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc0cce70 msgr2=0x7f4fdc15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.549+0000 7f4fdbfff640 1 --2- 172.21.15.17:0/2607679768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc0cce70 0x7f4fdc15afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.549+0000 7f4fdbfff640 1 -- 172.21.15.17:0/2607679768 >> v1:172.21.15.17:6789/0 conn(0x7f4fdc072ea0 legacy=0x7f4fdc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.549+0000 7f4fdbfff640 1 -- 172.21.15.17:0/2607679768 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc0b4f40 con 0x7f4fdc072ac0 2023-08-09T12:42:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.550+0000 7f4fdbfff640 1 --2- 172.21.15.17:0/2607679768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc072ac0 0x7f4fdc15aa80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0097a0 tx=0x7f4fcc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0f2dabb4c40145 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.550+0000 7f4fdb7fe640 1 -- 172.21.15.17:0/2607679768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc02d040 con 0x7f4fdc072ac0 2023-08-09T12:42:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.550+0000 7f4fdb7fe640 1 -- 172.21.15.17:0/2607679768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc031810 con 0x7f4fdc072ac0 2023-08-09T12:42:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.550+0000 7f4fdb7fe640 1 -- 172.21.15.17:0/2607679768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc031ba0 con 0x7f4fdc072ac0 2023-08-09T12:42:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.550+0000 7f4fe23a4640 1 -- 172.21.15.17:0/2607679768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc072ac0 msgr2=0x7f4fdc15aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.551+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/2607679768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc072ac0 0x7f4fdc15aa80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0097a0 tx=0x7f4fcc02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.551+0000 7f4fe23a4640 1 -- 172.21.15.17:0/2607679768 shutdown_connections 2023-08-09T12:42:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.551+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/2607679768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc0cce70 0x7f4fdc15afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.551+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/2607679768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc072ac0 0x7f4fdc15aa80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.551+0000 7f4fe23a4640 1 -- 172.21.15.17:0/2607679768 >> 172.21.15.17:0/2607679768 conn(0x7f4fdc0cc350 msgr2=0x7f4fdc0cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:12.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.551+0000 7f4fe23a4640 1 -- 172.21.15.17:0/2607679768 shutdown_connections 2023-08-09T12:42:12.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.551+0000 7f4fe23a4640 1 -- 172.21.15.17:0/2607679768 wait complete. 2023-08-09T12:42:12.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.552+0000 7f4fe23a4640 1 Processor -- start 2023-08-09T12:42:12.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.553+0000 7f4fe23a4640 1 -- start start 2023-08-09T12:42:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe23a4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc072ac0 0x7f4fdc15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe23a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc072ea0 0x7f4fdc0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe23a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0cce70 0x7f4fdc0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe23a4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0c6ff0 con 0x7f4fdc0cce70 2023-08-09T12:42:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe23a4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0c7b70 con 0x7f4fdc072ac0 2023-08-09T12:42:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe23a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0c7240 con 0x7f4fdc072ea0 2023-08-09T12:42:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe0941640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0cce70 0x7f4fdc0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe0941640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0cce70 0x7f4fdc0ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57774/0 (socket says 172.21.15.17:57774) 2023-08-09T12:42:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fe0941640 1 -- 172.21.15.17:0/4181214375 learned_addr learned my addr 172.21.15.17:0/4181214375 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fdbfff640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc072ac0 0x7f4fdc15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.554+0000 7f4fd37fe640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc072ea0 0x7f4fdc0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fe0941640 1 -- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc072ea0 msgr2=0x7f4fdc0ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fe0941640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc072ea0 0x7f4fdc0ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fe0941640 1 -- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc072ac0 msgr2=0x7f4fdc15ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fe0941640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc072ac0 0x7f4fdc15ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fe0941640 1 -- 172.21.15.17:0/4181214375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc009400 con 0x7f4fdc0cce70 2023-08-09T12:42:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fd37fe640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc072ea0 0x7f4fdc0ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fe0941640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0cce70 0x7f4fdc0ce750 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400ca70 tx=0x7f4fd400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fd97fa640 1 -- 172.21.15.17:0/4181214375 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400abd0 con 0x7f4fdc0cce70 2023-08-09T12:42:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fd97fa640 1 -- 172.21.15.17:0/4181214375 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd400ad30 con 0x7f4fdc0cce70 2023-08-09T12:42:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fd97fa640 1 -- 172.21.15.17:0/4181214375 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400aea0 con 0x7f4fdc0cce70 2023-08-09T12:42:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc0c9d70 con 0x7f4fdc0cce70 2023-08-09T12:42:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.555+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc0c7800 con 0x7f4fdc0cce70 2023-08-09T12:42:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.557+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fdc067a80 con 0x7f4fdc0cce70 2023-08-09T12:42:12.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.557+0000 7f4fd97fa640 1 -- 172.21.15.17:0/4181214375 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4fd401b3b0 con 0x7f4fdc0cce70 2023-08-09T12:42:12.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.558+0000 7f4fd97fa640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4fbc06a080 0x7f4fbc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:12.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.558+0000 7f4fd97fa640 1 -- 172.21.15.17:0/4181214375 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4fd40884c0 con 0x7f4fdc0cce70 2023-08-09T12:42:12.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.559+0000 7f4fdbfff640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4fbc06a080 0x7f4fbc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:12.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.560+0000 7f4fdbfff640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4fbc06a080 0x7f4fbc06c540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc036000 tx=0x7f4fcc03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:12.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.563+0000 7f4fd97fa640 1 -- 172.21.15.17:0/4181214375 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4fd4053ad0 con 0x7f4fdc0cce70 2023-08-09T12:42:12.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.773+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4fdc0c9bc0 con 0x7f4fdc0cce70 2023-08-09T12:42:12.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.774+0000 7f4fd97fa640 1 -- 172.21.15.17:0/4181214375 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4fd40570f0 con 0x7f4fdc0cce70 2023-08-09T12:42:12.777 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:42:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4fbc06a080 msgr2=0x7f4fbc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4fbc06a080 0x7f4fbc06c540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc036000 tx=0x7f4fcc03c040 comp rx=0 tx=0).stop 2023-08-09T12:42:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0cce70 msgr2=0x7f4fdc0ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0cce70 0x7f4fdc0ce750 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400ca70 tx=0x7f4fd400cf30 comp rx=0 tx=0).stop 2023-08-09T12:42:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 shutdown_connections 2023-08-09T12:42:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4fbc06a080 0x7f4fbc06c540 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0cce70 0x7f4fdc0ce750 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fdc072ea0 0x7f4fdc0ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 --2- 172.21.15.17:0/4181214375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc072ac0 0x7f4fdc15ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:12.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 >> 172.21.15.17:0/4181214375 conn(0x7f4fdc0cc350 msgr2=0x7f4fdc06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:12.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 shutdown_connections 2023-08-09T12:42:12.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:12.777+0000 7f4fe23a4640 1 -- 172.21.15.17:0/4181214375 wait complete. 2023-08-09T12:42:12.801 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:42:12.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:12.802 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:42:12.976 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:42:12.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:12.977 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:42:13.018 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:42:13.019 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:13.065 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:42:13.065 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:13.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.392+0000 7fa8b17fc640 1 Processor -- start 2023-08-09T12:42:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.392+0000 7fa8b17fc640 1 -- start start 2023-08-09T12:42:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.393+0000 7fa8b17fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8ac1587e0 0x7fa8ac070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.394+0000 7fa8b17fc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac15beb0 con 0x7fa8ac0b0b10 2023-08-09T12:42:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.394+0000 7fa8b17fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac0715c0 con 0x7fa8ac0cb070 2023-08-09T12:42:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.394+0000 7fa8b17fc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0718a0 con 0x7fa8ac1587e0 2023-08-09T12:42:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.394+0000 7fa8a3fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa8ac0b0b10 0x7fa8ac15b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35596/0 (socket says 172.21.15.17:35596) 2023-08-09T12:42:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.394+0000 7fa8a3fff640 1 -- 172.21.15.17:0/2049832285 learned_addr learned my addr 172.21.15.17:0/2049832285 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.394+0000 7fa8abfff640 1 --2- 172.21.15.17:0/2049832285 >> v2:172.21.15.142:3300/0 conn(0x7fa8ac1587e0 0x7fa8ac070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.394+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923035904 0 0) 0x7fa8ac15beb0 con 0x7fa8ac0b0b10 2023-08-09T12:42:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.394+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa898003520 con 0x7fa8ac0b0b10 2023-08-09T12:42:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256984604 0 0) 0x7fa898003520 con 0x7fa8ac0b0b10 2023-08-09T12:42:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 >> v2:172.21.15.142:3300/0 conn(0x7fa8ac1587e0 msgr2=0x7fa8ac070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 --2- 172.21.15.17:0/2049832285 >> v2:172.21.15.142:3300/0 conn(0x7fa8ac1587e0 0x7fa8ac070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 >> v1:172.21.15.142:6789/0 conn(0x7fa8ac0cb070 legacy=0x7fa8ac15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac071b80 con 0x7fa8ac0b0b10 2023-08-09T12:42:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa894001670 con 0x7fa8ac0b0b10 2023-08-09T12:42:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 >> v1:172.21.15.17:6789/0 conn(0x7fa8ac0b0b10 legacy=0x7fa8ac15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa898003970 0x7fa898003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980047c0 0x7fa898004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa898005180 0x7fa89800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0718a0 con 0x7fa898003970 2023-08-09T12:42:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89800c0d0 con 0x7fa898005180 2023-08-09T12:42:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89800c290 con 0x7fa8980047c0 2023-08-09T12:42:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8abfff640 1 --2- 172.21.15.17:0/2049832285 >> v2:172.21.15.142:3300/0 conn(0x7fa8ac1587e0 0x7fa8ac070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:42:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.395+0000 7fa8abfff640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa898003970 0x7fa898003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8a3fff640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980047c0 0x7fa898004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8abfff640 1 -- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980047c0 msgr2=0x7fa898004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8b0ffb640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa898005180 0x7fa89800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8abfff640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8980047c0 0x7fa898004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8abfff640 1 -- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa898005180 msgr2=0x7fa89800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8abfff640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa898005180 0x7fa89800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8abfff640 1 -- 172.21.15.17:0/2049832285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898003520 con 0x7fa898003970 2023-08-09T12:42:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8b0ffb640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa898005180 0x7fa89800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.396+0000 7fa8b0ffb640 1 -- 172.21.15.17:0/2049832285 reap_dead start 2023-08-09T12:42:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.397+0000 7fa8abfff640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa898003970 0x7fa898003d90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0098a0 tx=0x7fa8980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7225fb366eb3d04 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.397+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c030630 con 0x7fa898003970 2023-08-09T12:42:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.397+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c030790 con 0x7fa898003970 2023-08-09T12:42:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.397+0000 7fa8ab7fe640 1 -- 172.21.15.17:0/2049832285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c030b00 con 0x7fa898003970 2023-08-09T12:42:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.398+0000 7fa8b17fc640 1 -- 172.21.15.17:0/2049832285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa898003970 msgr2=0x7fa898003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.398+0000 7fa8b17fc640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa898003970 0x7fa898003d90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0098a0 tx=0x7fa8980057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.398+0000 7fa8b17fc640 1 -- 172.21.15.17:0/2049832285 shutdown_connections 2023-08-09T12:42:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.398+0000 7fa8b17fc640 1 --2- 172.21.15.17:0/2049832285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa898003970 0x7fa898003d90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.398+0000 7fa8b17fc640 1 -- 172.21.15.17:0/2049832285 >> 172.21.15.17:0/2049832285 conn(0x7fa8ac0b1d50 msgr2=0x7fa8ac06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.398+0000 7fa8b17fc640 1 -- 172.21.15.17:0/2049832285 shutdown_connections 2023-08-09T12:42:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.398+0000 7fa8b17fc640 1 -- 172.21.15.17:0/2049832285 wait complete. 2023-08-09T12:42:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.400+0000 7fa8b17fc640 1 Processor -- start 2023-08-09T12:42:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.400+0000 7fa8b17fc640 1 -- start start 2023-08-09T12:42:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8b17fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898003970 0x7fa8ac0c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8b17fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8ac14da50 0x7fa8ac155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8b17fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac1560e0 0x7fa8ac0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8b17fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c9e30 con 0x7fa8ac14da50 2023-08-09T12:42:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8b17fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c91b0 con 0x7fa8ac1560e0 2023-08-09T12:42:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8b17fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c9490 con 0x7fa898003970 2023-08-09T12:42:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8ac14da50 0x7fa8ac155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8ac14da50 0x7fa8ac155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57786/0 (socket says 172.21.15.17:57786) 2023-08-09T12:42:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.401+0000 7fa8a3fff640 1 -- 172.21.15.17:0/3478009204 learned_addr learned my addr 172.21.15.17:0/3478009204 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8abfff640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898003970 0x7fa8ac0c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8b0ffb640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac1560e0 0x7fa8ac0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a3fff640 1 -- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898003970 msgr2=0x7fa8ac0c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a3fff640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898003970 0x7fa8ac0c2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a3fff640 1 -- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac1560e0 msgr2=0x7fa8ac0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a3fff640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac1560e0 0x7fa8ac0c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a3fff640 1 -- 172.21.15.17:0/3478009204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0c9770 con 0x7fa8ac14da50 2023-08-09T12:42:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a3fff640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8ac14da50 0x7fa8ac155ba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa89400d7e0 tx=0x7fa89400dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a97fa640 1 -- 172.21.15.17:0/3478009204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940074e0 con 0x7fa8ac14da50 2023-08-09T12:42:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a97fa640 1 -- 172.21.15.17:0/3478009204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894007640 con 0x7fa8ac14da50 2023-08-09T12:42:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac0c9a50 con 0x7fa8ac14da50 2023-08-09T12:42:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8a97fa640 1 -- 172.21.15.17:0/3478009204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940049e0 con 0x7fa8ac14da50 2023-08-09T12:42:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.402+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac0c86a0 con 0x7fa8ac14da50 2023-08-09T12:42:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.403+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0c9f70 con 0x7fa8ac14da50 2023-08-09T12:42:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.404+0000 7fa8a97fa640 1 -- 172.21.15.17:0/3478009204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa894004b40 con 0x7fa8ac14da50 2023-08-09T12:42:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.405+0000 7fa8a97fa640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88c06a080 0x7fa88c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.406+0000 7fa8a97fa640 1 -- 172.21.15.17:0/3478009204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa894088310 con 0x7fa8ac14da50 2023-08-09T12:42:13.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.406+0000 7fa8abfff640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88c06a080 0x7fa88c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.407+0000 7fa8abfff640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88c06a080 0x7fa88c06c540 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa89c036000 tx=0x7fa89c031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.410+0000 7fa8a97fa640 1 -- 172.21.15.17:0/3478009204 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa8ac0c9f70 con 0x7fa8ac14da50 2023-08-09T12:42:13.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.604+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8ac0c9f70 con 0x7fa8ac14da50 2023-08-09T12:42:13.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.606+0000 7fa8a97fa640 1 -- 172.21.15.17:0/3478009204 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+18422 (secure 0 0 0) 0x7fa8ac0c9f70 con 0x7fa8ac14da50 2023-08-09T12:42:13.610 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:11.769329+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:41:23.866427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-09T12:41:25.245820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:13.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88c06a080 msgr2=0x7fa88c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88c06a080 0x7fa88c06c540 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa89c036000 tx=0x7fa89c031000 comp rx=0 tx=0).stop 2023-08-09T12:42:13.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8ac14da50 msgr2=0x7fa8ac155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8ac14da50 0x7fa8ac155ba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa89400d7e0 tx=0x7fa89400dca0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 shutdown_connections 2023-08-09T12:42:13.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa88c06a080 0x7fa88c06c540 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac1560e0 0x7fa8ac0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8ac14da50 0x7fa8ac155ba0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 --2- 172.21.15.17:0/3478009204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa898003970 0x7fa8ac0c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 >> 172.21.15.17:0/3478009204 conn(0x7fa8ac0b1d50 msgr2=0x7fa8ac0b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:13.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 shutdown_connections 2023-08-09T12:42:13.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.609+0000 7fa8b17fc640 1 -- 172.21.15.17:0/3478009204 wait complete. 2023-08-09T12:42:13.633 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:41:23.866427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:41:25.245820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:42:13.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:42:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.868+0000 7ff974d37640 1 Processor -- start 2023-08-09T12:42:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.869+0000 7ff974d37640 1 -- start start 2023-08-09T12:42:13.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.870+0000 7ff974d37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff97015a8c0 0x7ff9700b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.870+0000 7ff974d37640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff9700b0020 0x7ff9700b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.870+0000 7ff974d37640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97015e7b0 con 0x7ff9700b13f0 2023-08-09T12:42:13.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.870+0000 7ff974d37640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9700b09f0 con 0x7ff9700b0020 2023-08-09T12:42:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.870+0000 7ff974d37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700b1850 con 0x7ff97015a8c0 2023-08-09T12:42:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.871+0000 7ff96effd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff9700b13f0 0x7ff97015ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35598/0 (socket says 172.21.15.17:35598) 2023-08-09T12:42:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.871+0000 7ff96effd640 1 -- 172.21.15.17:0/453217837 learned_addr learned my addr 172.21.15.17:0/453217837 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.871+0000 7ff96ffff640 1 --2- 172.21.15.17:0/453217837 >> v2:172.21.15.17:3300/0 conn(0x7ff9700b0020 0x7ff9700b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.871+0000 7ff96f7fe640 1 --2- 172.21.15.17:0/453217837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff97015a8c0 0x7ff9700b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.871+0000 7ff96e7fc640 1 -- 172.21.15.17:0/453217837 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696419031 0 0) 0x7ff97015e7b0 con 0x7ff9700b13f0 2023-08-09T12:42:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.871+0000 7ff96e7fc640 1 -- 172.21.15.17:0/453217837 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff958003520 con 0x7ff9700b13f0 2023-08-09T12:42:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.872+0000 7ff96ffff640 1 -- 172.21.15.17:0/453217837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff97015a8c0 msgr2=0x7ff9700b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.872+0000 7ff96ffff640 1 --2- 172.21.15.17:0/453217837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff97015a8c0 0x7ff9700b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.872+0000 7ff96ffff640 1 -- 172.21.15.17:0/453217837 >> v1:172.21.15.17:6789/0 conn(0x7ff9700b13f0 legacy=0x7ff97015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.872+0000 7ff96ffff640 1 -- 172.21.15.17:0/453217837 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97015e460 con 0x7ff9700b0020 2023-08-09T12:42:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.873+0000 7ff96ffff640 1 --2- 172.21.15.17:0/453217837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9700b0020 0x7ff9700b04b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff968009d90 tx=0x7ff96802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a34510c18cc589 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.873+0000 7ff96e7fc640 1 -- 172.21.15.17:0/453217837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96802cc60 con 0x7ff9700b0020 2023-08-09T12:42:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.873+0000 7ff96e7fc640 1 -- 172.21.15.17:0/453217837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96802cdc0 con 0x7ff9700b0020 2023-08-09T12:42:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.873+0000 7ff96e7fc640 1 -- 172.21.15.17:0/453217837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968034660 con 0x7ff9700b0020 2023-08-09T12:42:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.874+0000 7ff974d37640 1 -- 172.21.15.17:0/453217837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9700b0020 msgr2=0x7ff9700b04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.874+0000 7ff974d37640 1 --2- 172.21.15.17:0/453217837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9700b0020 0x7ff9700b04b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff968009d90 tx=0x7ff96802beb0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.874+0000 7ff974d37640 1 -- 172.21.15.17:0/453217837 shutdown_connections 2023-08-09T12:42:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.874+0000 7ff974d37640 1 --2- 172.21.15.17:0/453217837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9700b0020 0x7ff9700b04b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.874+0000 7ff974d37640 1 --2- 172.21.15.17:0/453217837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff97015a8c0 0x7ff9700b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.874+0000 7ff974d37640 1 -- 172.21.15.17:0/453217837 >> 172.21.15.17:0/453217837 conn(0x7ff9700cb020 msgr2=0x7ff9700cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.874+0000 7ff974d37640 1 -- 172.21.15.17:0/453217837 shutdown_connections 2023-08-09T12:42:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.874+0000 7ff974d37640 1 -- 172.21.15.17:0/453217837 wait complete. 2023-08-09T12:42:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.876+0000 7ff974d37640 1 Processor -- start 2023-08-09T12:42:13.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.876+0000 7ff974d37640 1 -- start start 2023-08-09T12:42:13.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff974d37640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9700b0020 0x7ff9700adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff974d37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9700b13f0 0x7ff97015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff974d37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff97015a8c0 0x7ff970146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff974d37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff970147180 con 0x7ff97015a8c0 2023-08-09T12:42:13.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff974d37640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700ae3c0 con 0x7ff9700b0020 2023-08-09T12:42:13.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff974d37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700ae6a0 con 0x7ff9700b13f0 2023-08-09T12:42:13.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff96ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff97015a8c0 0x7ff970146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff96ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff97015a8c0 0x7ff970146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57796/0 (socket says 172.21.15.17:57796) 2023-08-09T12:42:13.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.877+0000 7ff96ffff640 1 -- 172.21.15.17:0/2565959140 learned_addr learned my addr 172.21.15.17:0/2565959140 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:13.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96f7fe640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9700b0020 0x7ff9700adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96effd640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9700b13f0 0x7ff97015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96ffff640 1 -- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9700b13f0 msgr2=0x7ff97015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96ffff640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9700b13f0 0x7ff97015c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96ffff640 1 -- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9700b0020 msgr2=0x7ff9700adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:13.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96ffff640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9700b0020 0x7ff9700adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:13.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96ffff640 1 -- 172.21.15.17:0/2565959140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff968009a70 con 0x7ff97015a8c0 2023-08-09T12:42:13.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96f7fe640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9700b0020 0x7ff9700adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:13.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff96ffff640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff97015a8c0 0x7ff970146c40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff968009d90 tx=0x7ff968004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:13.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff957fff640 1 -- 172.21.15.17:0/2565959140 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968040650 con 0x7ff97015a8c0 2023-08-09T12:42:13.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff957fff640 1 -- 172.21.15.17:0/2565959140 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9680407b0 con 0x7ff97015a8c0 2023-08-09T12:42:13.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.878+0000 7ff957fff640 1 -- 172.21.15.17:0/2565959140 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968040b60 con 0x7ff97015a8c0 2023-08-09T12:42:13.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.879+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9700ae980 con 0x7ff97015a8c0 2023-08-09T12:42:13.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.879+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9700aef40 con 0x7ff97015a8c0 2023-08-09T12:42:13.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.880+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97004e390 con 0x7ff97015a8c0 2023-08-09T12:42:13.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.881+0000 7ff957fff640 1 -- 172.21.15.17:0/2565959140 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff968040cc0 con 0x7ff97015a8c0 2023-08-09T12:42:13.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.882+0000 7ff957fff640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff95c06a080 0x7ff95c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:13.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.882+0000 7ff957fff640 1 -- 172.21.15.17:0/2565959140 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff9680ab0f0 con 0x7ff97015a8c0 2023-08-09T12:42:13.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.882+0000 7ff96f7fe640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff95c06a080 0x7ff95c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:13.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.883+0000 7ff96f7fe640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff95c06a080 0x7ff95c06c540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff97006f360 tx=0x7ff960008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:13.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:13.886+0000 7ff957fff640 1 -- 172.21.15.17:0/2565959140 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff968076700 con 0x7ff97015a8c0 2023-08-09T12:42:14.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.079+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9700cbd50 con 0x7ff97015a8c0 2023-08-09T12:42:14.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.080+0000 7ff957fff640 1 -- 172.21.15.17:0/2565959140 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff968009450 con 0x7ff97015a8c0 2023-08-09T12:42:14.084 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:42:14.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff95c06a080 msgr2=0x7ff95c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff95c06a080 0x7ff95c06c540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff97006f360 tx=0x7ff960008040 comp rx=0 tx=0).stop 2023-08-09T12:42:14.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff97015a8c0 msgr2=0x7ff970146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff97015a8c0 0x7ff970146c40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff968009d90 tx=0x7ff968004a40 comp rx=0 tx=0).stop 2023-08-09T12:42:14.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 shutdown_connections 2023-08-09T12:42:14.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff95c06a080 0x7ff95c06c540 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff97015a8c0 0x7ff970146c40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9700b13f0 0x7ff97015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 --2- 172.21.15.17:0/2565959140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9700b0020 0x7ff9700adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 >> 172.21.15.17:0/2565959140 conn(0x7ff9700cb020 msgr2=0x7ff9700c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:14.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 shutdown_connections 2023-08-09T12:42:14.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.083+0000 7ff974d37640 1 -- 172.21.15.17:0/2565959140 wait complete. 2023-08-09T12:42:14.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:42:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.332+0000 7f7c5eaf5640 1 Processor -- start 2023-08-09T12:42:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.333+0000 7f7c5eaf5640 1 -- start start 2023-08-09T12:42:14.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.334+0000 7f7c5eaf5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c5815cb40 0x7f7c581609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.334+0000 7f7c5eaf5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c580cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.334+0000 7f7c5eaf5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580d0f00 con 0x7f7c5815cf20 2023-08-09T12:42:14.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.334+0000 7f7c5eaf5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c581611f0 con 0x7f7c5815cb40 2023-08-09T12:42:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.334+0000 7f7c5eaf5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c581614d0 con 0x7f7c580b8420 2023-08-09T12:42:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5d2f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c580cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5daf3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c5815cb40 0x7f7c581609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5e2f4640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7c5815cf20 0x7f7c580697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:55936/0 (socket says 172.21.15.17:55936) 2023-08-09T12:42:14.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5e2f4640 1 -- 172.21.15.17:0/638407636 learned_addr learned my addr 172.21.15.17:0/638407636 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:14.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5d2f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c580cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:37316/0 (socket says 172.21.15.17:37316) 2023-08-09T12:42:14.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5daf3640 1 -- 172.21.15.17:0/638407636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 msgr2=0x7f7c580cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:14.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5daf3640 1 --2- 172.21.15.17:0/638407636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c580cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5daf3640 1 -- 172.21.15.17:0/638407636 >> v1:172.21.15.142:6789/0 conn(0x7f7c5815cf20 legacy=0x7f7c580697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.335+0000 7f7c5daf3640 1 -- 172.21.15.17:0/638407636 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c581617b0 con 0x7f7c5815cb40 2023-08-09T12:42:14.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.337+0000 7f7c5daf3640 1 --2- 172.21.15.17:0/638407636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cb40 0x7f7c581609a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097a0 tx=0x7f7c5402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c46d4030af70b97e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:14.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.337+0000 7f7c5caf1640 1 -- 172.21.15.17:0/638407636 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54030800 con 0x7f7c5815cb40 2023-08-09T12:42:14.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.337+0000 7f7c5caf1640 1 -- 172.21.15.17:0/638407636 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54030960 con 0x7f7c5815cb40 2023-08-09T12:42:14.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.337+0000 7f7c5caf1640 1 -- 172.21.15.17:0/638407636 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54030cf0 con 0x7f7c5815cb40 2023-08-09T12:42:14.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.338+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/638407636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cb40 msgr2=0x7f7c581609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.338+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/638407636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cb40 0x7f7c581609a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097a0 tx=0x7f7c5402b940 comp rx=0 tx=0).stop 2023-08-09T12:42:14.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.338+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/638407636 shutdown_connections 2023-08-09T12:42:14.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.338+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/638407636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c580cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.338+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/638407636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cb40 0x7f7c581609a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.338+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/638407636 >> 172.21.15.17:0/638407636 conn(0x7f7c580d2ab0 msgr2=0x7f7c580d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:14.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.338+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/638407636 shutdown_connections 2023-08-09T12:42:14.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.338+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/638407636 wait complete. 2023-08-09T12:42:14.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.340+0000 7f7c5eaf5640 1 Processor -- start 2023-08-09T12:42:14.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.340+0000 7f7c5eaf5640 1 -- start start 2023-08-09T12:42:14.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.341+0000 7f7c5eaf5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c581557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.341+0000 7f7c5eaf5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c5815cb40 0x7f7c5815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.341+0000 7f7c5eaf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cf20 0x7f7c58158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.341+0000 7f7c5eaf5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58155cf0 con 0x7f7c5815cb40 2023-08-09T12:42:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.341+0000 7f7c5eaf5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5815dee0 con 0x7f7c5815cf20 2023-08-09T12:42:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.341+0000 7f7c5eaf5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5815e1c0 con 0x7f7c580b8420 2023-08-09T12:42:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5d2f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c5815cb40 0x7f7c5815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5d2f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c5815cb40 0x7f7c5815d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57810/0 (socket says 172.21.15.17:57810) 2023-08-09T12:42:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5d2f2640 1 -- 172.21.15.17:0/2485647184 learned_addr learned my addr 172.21.15.17:0/2485647184 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:14.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5e2f4640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cf20 0x7f7c58158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5daf3640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c581557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5d2f2640 1 -- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 msgr2=0x7f7c581557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5d2f2640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c581557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5d2f2640 1 -- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cf20 msgr2=0x7f7c58158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5d2f2640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cf20 0x7f7c58158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.342+0000 7f7c5d2f2640 1 -- 172.21.15.17:0/2485647184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54009400 con 0x7f7c5815cb40 2023-08-09T12:42:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.343+0000 7f7c5d2f2640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c5815cb40 0x7f7c5815d440 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800e9b0 tx=0x7f7c4800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.343+0000 7f7c4e7fc640 1 -- 172.21.15.17:0/2485647184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48009670 con 0x7f7c5815cb40 2023-08-09T12:42:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.343+0000 7f7c4e7fc640 1 -- 172.21.15.17:0/2485647184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800c9a0 con 0x7f7c5815cb40 2023-08-09T12:42:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.343+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5815e4a0 con 0x7f7c5815cb40 2023-08-09T12:42:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.343+0000 7f7c4e7fc640 1 -- 172.21.15.17:0/2485647184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800cd50 con 0x7f7c5815cb40 2023-08-09T12:42:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.343+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5815ea60 con 0x7f7c5815cb40 2023-08-09T12:42:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.344+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5804e390 con 0x7f7c5815cb40 2023-08-09T12:42:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.345+0000 7f7c4e7fc640 1 -- 172.21.15.17:0/2485647184 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c48013470 con 0x7f7c5815cb40 2023-08-09T12:42:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.346+0000 7f7c4e7fc640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c3c06a050 0x7f7c3c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.346+0000 7f7c4e7fc640 1 -- 172.21.15.17:0/2485647184 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7c48088920 con 0x7f7c5815cb40 2023-08-09T12:42:14.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.347+0000 7f7c5daf3640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c3c06a050 0x7f7c3c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.348+0000 7f7c5daf3640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c3c06a050 0x7f7c3c06c510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c54036000 tx=0x7f7c54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:14.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.351+0000 7f7c4e7fc640 1 -- 172.21.15.17:0/2485647184 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7c48053f30 con 0x7f7c5815cb40 2023-08-09T12:42:14.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.542+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c580ce470 con 0x7f7c5815cb40 2023-08-09T12:42:14.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.543+0000 7f7c4e7fc640 1 -- 172.21.15.17:0/2485647184 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7c48057550 con 0x7f7c5815cb40 2023-08-09T12:42:14.547 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:42:14.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c3c06a050 msgr2=0x7f7c3c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c3c06a050 0x7f7c3c06c510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c54036000 tx=0x7f7c54008030 comp rx=0 tx=0).stop 2023-08-09T12:42:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c5815cb40 msgr2=0x7f7c5815d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c5815cb40 0x7f7c5815d440 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800e9b0 tx=0x7f7c4800ee70 comp rx=0 tx=0).stop 2023-08-09T12:42:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 shutdown_connections 2023-08-09T12:42:14.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c3c06a050 0x7f7c3c06c510 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c5815cf20 0x7f7c58158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c5815cb40 0x7f7c5815d440 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 --2- 172.21.15.17:0/2485647184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c580b8420 0x7f7c581557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.546+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 >> 172.21.15.17:0/2485647184 conn(0x7f7c580d2ab0 msgr2=0x7f7c580b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:14.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.547+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 shutdown_connections 2023-08-09T12:42:14.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.547+0000 7f7c5eaf5640 1 -- 172.21.15.17:0/2485647184 wait complete. 2023-08-09T12:42:14.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:42:14.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.798+0000 7f1ced3f5640 1 Processor -- start 2023-08-09T12:42:14.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.798+0000 7f1ced3f5640 1 -- start start 2023-08-09T12:42:14.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.799+0000 7f1ced3f5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1ce815cef0 0x7f1ce80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.799+0000 7f1ced3f5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ce815d2d0 0x7f1ce80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.799+0000 7f1ced3f5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.799+0000 7f1ced3f5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80cdee0 con 0x7f1ce815cef0 2023-08-09T12:42:14.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.799+0000 7f1ced3f5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80b2010 con 0x7f1ce815d2d0 2023-08-09T12:42:14.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.799+0000 7f1ced3f5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80b1d30 con 0x7f1ce81616b0 2023-08-09T12:42:14.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1ce815cef0 0x7f1ce80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1ce815cef0 0x7f1ce80b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57822/0 (socket says 172.21.15.17:57822) 2023-08-09T12:42:14.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce6ffd640 1 -- 172.21.15.17:0/2047186412 learned_addr learned my addr 172.21.15.17:0/2047186412 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:14.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce77fe640 1 --2- 172.21.15.17:0/2047186412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1cde7fc640 1 --2- 172.21.15.17:0/2047186412 >> v2:172.21.15.142:3300/0 conn(0x7f1ce815d2d0 0x7f1ce80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce6ffd640 1 -- 172.21.15.17:0/2047186412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 msgr2=0x7f1ce80cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:14.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce6ffd640 1 --2- 172.21.15.17:0/2047186412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce6ffd640 1 -- 172.21.15.17:0/2047186412 >> v2:172.21.15.142:3300/0 conn(0x7f1ce815d2d0 msgr2=0x7f1ce80ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:14.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce6ffd640 1 --2- 172.21.15.17:0/2047186412 >> v2:172.21.15.142:3300/0 conn(0x7f1ce815d2d0 0x7f1ce80ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1ce6ffd640 1 -- 172.21.15.17:0/2047186412 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80cd820 con 0x7f1ce815cef0 2023-08-09T12:42:14.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.800+0000 7f1cde7fc640 1 --2- 172.21.15.17:0/2047186412 >> v2:172.21.15.142:3300/0 conn(0x7f1ce815d2d0 0x7f1ce80ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:14.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.802+0000 7f1ce6ffd640 1 --2- 172.21.15.17:0/2047186412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815cef0 0x7f1ce80b1750 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8071ab0 tx=0x7f1cd802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e36f05ab90aed3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:14.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.802+0000 7f1ce67fc640 1 -- 172.21.15.17:0/2047186412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8031750 con 0x7f1ce815cef0 2023-08-09T12:42:14.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.802+0000 7f1ce67fc640 1 -- 172.21.15.17:0/2047186412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd80318b0 con 0x7f1ce815cef0 2023-08-09T12:42:14.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.802+0000 7f1ce67fc640 1 -- 172.21.15.17:0/2047186412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8031c40 con 0x7f1ce815cef0 2023-08-09T12:42:14.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2047186412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815cef0 msgr2=0x7f1ce80b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2047186412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815cef0 0x7f1ce80b1750 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8071ab0 tx=0x7f1cd802b7f0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2047186412 shutdown_connections 2023-08-09T12:42:14.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2047186412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2047186412 >> v2:172.21.15.142:3300/0 conn(0x7f1ce815d2d0 0x7f1ce80ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2047186412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815cef0 0x7f1ce80b1750 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2047186412 >> 172.21.15.17:0/2047186412 conn(0x7f1ce806fde0 msgr2=0x7f1ce80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:14.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2047186412 shutdown_connections 2023-08-09T12:42:14.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.803+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2047186412 wait complete. 2023-08-09T12:42:14.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.805+0000 7f1ced3f5640 1 Processor -- start 2023-08-09T12:42:14.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.805+0000 7f1ced3f5640 1 -- start start 2023-08-09T12:42:14.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1ced3f5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ce815cef0 0x7f1ce81f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1ced3f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815d2d0 0x7f1ce81f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1ced3f5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1ced3f5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce81f28b0 con 0x7f1ce815d2d0 2023-08-09T12:42:14.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1ced3f5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce81f6e50 con 0x7f1ce815cef0 2023-08-09T12:42:14.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1ced3f5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80b2ab0 con 0x7f1ce81616b0 2023-08-09T12:42:14.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1cde7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815d2d0 0x7f1ce81f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1cde7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815d2d0 0x7f1ce81f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57834/0 (socket says 172.21.15.17:57834) 2023-08-09T12:42:14.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1cde7fc640 1 -- 172.21.15.17:0/2358955395 learned_addr learned my addr 172.21.15.17:0/2358955395 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:14.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.807+0000 7f1ce6ffd640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ce815cef0 0x7f1ce81f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1ce77fe640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1cde7fc640 1 -- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 msgr2=0x7f1ce80cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1cde7fc640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1cde7fc640 1 -- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ce815cef0 msgr2=0x7f1ce81f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1cde7fc640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ce815cef0 0x7f1ce81f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1cde7fc640 1 -- 172.21.15.17:0/2358955395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80094d0 con 0x7f1ce815d2d0 2023-08-09T12:42:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1ce6ffd640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ce815cef0 0x7f1ce81f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:42:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1ce77fe640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.808+0000 7f1cde7fc640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815d2d0 0x7f1ce81f6910 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c7c0 tx=0x7f1cd000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.809+0000 7f1cdffff640 1 -- 172.21.15.17:0/2358955395 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00079d0 con 0x7f1ce815d2d0 2023-08-09T12:42:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.809+0000 7f1cdffff640 1 -- 172.21.15.17:0/2358955395 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd0007b30 con 0x7f1ce815d2d0 2023-08-09T12:42:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.809+0000 7f1cdffff640 1 -- 172.21.15.17:0/2358955395 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000ce70 con 0x7f1ce815d2d0 2023-08-09T12:42:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.809+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce80b2d90 con 0x7f1ce815d2d0 2023-08-09T12:42:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.809+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce80b3350 con 0x7f1ce815d2d0 2023-08-09T12:42:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.810+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce80b3ad0 con 0x7f1ce815d2d0 2023-08-09T12:42:14.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.811+0000 7f1cdffff640 1 -- 172.21.15.17:0/2358955395 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1cd00113f0 con 0x7f1ce815d2d0 2023-08-09T12:42:14.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.812+0000 7f1cdffff640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1cc806a080 0x7f1cc806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:14.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.812+0000 7f1cdffff640 1 -- 172.21.15.17:0/2358955395 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1cd0088700 con 0x7f1ce815d2d0 2023-08-09T12:42:14.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.813+0000 7f1ce6ffd640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1cc806a080 0x7f1cc806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.814+0000 7f1ce6ffd640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1cc806a080 0x7f1cc806c540 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8035000 tx=0x7f1cd8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:14.817+0000 7f1cdffff640 1 -- 172.21.15.17:0/2358955395 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1ce80b3ad0 con 0x7f1ce815d2d0 2023-08-09T12:42:15.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.009+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ce80b3ad0 con 0x7f1ce815d2d0 2023-08-09T12:42:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.010+0000 7f1cdffff640 1 -- 172.21.15.17:0/2358955395 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ce80b3ad0 con 0x7f1ce815d2d0 2023-08-09T12:42:15.013 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:42:15.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1cc806a080 msgr2=0x7f1cc806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1cc806a080 0x7f1cc806c540 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8035000 tx=0x7f1cd8008030 comp rx=0 tx=0).stop 2023-08-09T12:42:15.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815d2d0 msgr2=0x7f1ce81f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815d2d0 0x7f1ce81f6910 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c7c0 tx=0x7f1cd000cc80 comp rx=0 tx=0).stop 2023-08-09T12:42:15.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 shutdown_connections 2023-08-09T12:42:15.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1cc806a080 0x7f1cc806c540 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ce81616b0 0x7f1ce80cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ce815d2d0 0x7f1ce81f6910 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 --2- 172.21.15.17:0/2358955395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ce815cef0 0x7f1ce81f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 >> 172.21.15.17:0/2358955395 conn(0x7f1ce806fde0 msgr2=0x7f1ce80d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 shutdown_connections 2023-08-09T12:42:15.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.013+0000 7f1ced3f5640 1 -- 172.21.15.17:0/2358955395 wait complete. 2023-08-09T12:42:15.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:42:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.261+0000 7f6af6c26640 1 Processor -- start 2023-08-09T12:42:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.262+0000 7f6af6c26640 1 -- start start 2023-08-09T12:42:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.264+0000 7f6af6c26640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af015ce90 0x7f6af01616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.264+0000 7f6af6c26640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6af00d29d0 0x7f6af00d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.264+0000 7f6af6c26640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af00b6460 con 0x7f6af00b6000 2023-08-09T12:42:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.264+0000 7f6af6c26640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af00d33a0 con 0x7f6af00d29d0 2023-08-09T12:42:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.264+0000 7f6af6c26640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00cdd10 con 0x7f6af015ce90 2023-08-09T12:42:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.264+0000 7f6aeffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6af00b6000 0x7f6af00cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35606/0 (socket says 172.21.15.17:35606) 2023-08-09T12:42:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.264+0000 7f6aeffff640 1 -- 172.21.15.17:0/521767034 learned_addr learned my addr 172.21.15.17:0/521767034 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.264+0000 7f6af49c2640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af015ce90 0x7f6af01616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6af51c3640 1 --2- 172.21.15.17:0/521767034 >> v2:172.21.15.142:3300/0 conn(0x7f6af00d29d0 0x7f6af00d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398700927 0 0) 0x7f6af00b6460 con 0x7f6af00b6000 2023-08-09T12:42:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003520 con 0x7f6af00b6000 2023-08-09T12:42:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981757767 0 0) 0x7f6adc003520 con 0x7f6af00b6000 2023-08-09T12:42:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af015ce90 msgr2=0x7f6af01616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af015ce90 0x7f6af01616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 >> v2:172.21.15.142:3300/0 conn(0x7f6af00d29d0 msgr2=0x7f6af00d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 --2- 172.21.15.17:0/521767034 >> v2:172.21.15.142:3300/0 conn(0x7f6af00d29d0 0x7f6af00d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af00cdff0 con 0x7f6af00b6000 2023-08-09T12:42:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f6ad8001670 con 0x7f6af00b6000 2023-08-09T12:42:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 >> v1:172.21.15.17:6789/0 conn(0x7f6af00b6000 legacy=0x7f6af00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6adc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6adc0047c0 0x7f6adc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6adc005180 0x7f6adc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00d33a0 con 0x7f6adc003970 2023-08-09T12:42:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00cdd10 con 0x7f6adc0047c0 2023-08-09T12:42:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc00bec0 con 0x7f6adc005180 2023-08-09T12:42:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.265+0000 7f6af49c2640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af015ce90 0x7f6af01616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:42:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.266+0000 7f6af49c2640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6adc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.266+0000 7f6af51c3640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6adc005180 0x7f6adc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.266+0000 7f6af49c2640 1 -- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6adc005180 msgr2=0x7f6adc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.266+0000 7f6af49c2640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6adc005180 0x7f6adc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.266+0000 7f6af49c2640 1 -- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6adc0047c0 msgr2=0x7f6adc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.266+0000 7f6af49c2640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6adc0047c0 0x7f6adc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.266+0000 7f6af49c2640 1 -- 172.21.15.17:0/521767034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc003520 con 0x7f6adc003970 2023-08-09T12:42:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.267+0000 7f6af49c2640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6adc003d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000e1f0 tx=0x7f6adc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c70766e851d88bc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae002cce0 con 0x7f6adc003970 2023-08-09T12:42:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae000f040 con 0x7f6adc003970 2023-08-09T12:42:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6aef7fe640 1 -- 172.21.15.17:0/521767034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0003bb0 con 0x7f6adc003970 2023-08-09T12:42:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6af6c26640 1 -- 172.21.15.17:0/521767034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 msgr2=0x7f6adc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6af6c26640 1 --2- 172.21.15.17:0/521767034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6adc003d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000e1f0 tx=0x7f6adc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6af51c3640 1 -- 172.21.15.17:0/521767034 reap_dead start 2023-08-09T12:42:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6af6c26640 1 -- 172.21.15.17:0/521767034 shutdown_connections 2023-08-09T12:42:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6af6c26640 1 -- 172.21.15.17:0/521767034 >> 172.21.15.17:0/521767034 conn(0x7f6af006fde0 msgr2=0x7f6af00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6af6c26640 1 -- 172.21.15.17:0/521767034 shutdown_connections 2023-08-09T12:42:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.268+0000 7f6af6c26640 1 -- 172.21.15.17:0/521767034 wait complete. 2023-08-09T12:42:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.270+0000 7f6af6c26640 1 Processor -- start 2023-08-09T12:42:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.270+0000 7f6af6c26640 1 -- start start 2023-08-09T12:42:15.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.271+0000 7f6af6c26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6af00b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.271+0000 7f6af6c26640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6af00b11a0 0x7f6af00cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.271+0000 7f6af6c26640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af00cbb90 0x7f6af015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.271+0000 7f6af6c26640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af01f6750 con 0x7f6adc003970 2023-08-09T12:42:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.271+0000 7f6af6c26640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af01f6a30 con 0x7f6af00b11a0 2023-08-09T12:42:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.271+0000 7f6af6c26640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af01f6d10 con 0x7f6af00cbb90 2023-08-09T12:42:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.271+0000 7f6af49c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6af00b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af49c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6af00b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57856/0 (socket says 172.21.15.17:57856) 2023-08-09T12:42:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af49c2640 1 -- 172.21.15.17:0/1174844510 learned_addr learned my addr 172.21.15.17:0/1174844510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af51c3640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af00cbb90 0x7f6af015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af49c2640 1 -- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af00cbb90 msgr2=0x7f6af015ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af49c2640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af00cbb90 0x7f6af015ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af49c2640 1 -- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6af00b11a0 msgr2=0x7f6af00cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af49c2640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6af00b11a0 0x7f6af00cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af49c2640 1 -- 172.21.15.17:0/1174844510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af01f6ff0 con 0x7f6adc003970 2023-08-09T12:42:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.272+0000 7f6af49c2640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6af00b0c60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6ae002c640 tx=0x7f6ae0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.273+0000 7f6aed7fa640 1 -- 172.21.15.17:0/1174844510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00042c0 con 0x7f6adc003970 2023-08-09T12:42:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.273+0000 7f6aed7fa640 1 -- 172.21.15.17:0/1174844510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0004420 con 0x7f6adc003970 2023-08-09T12:42:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.273+0000 7f6aed7fa640 1 -- 172.21.15.17:0/1174844510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00047b0 con 0x7f6adc003970 2023-08-09T12:42:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.273+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af00cc910 con 0x7f6adc003970 2023-08-09T12:42:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.273+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af015f340 con 0x7f6adc003970 2023-08-09T12:42:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.274+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af01f7180 con 0x7f6adc003970 2023-08-09T12:42:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.275+0000 7f6aed7fa640 1 -- 172.21.15.17:0/1174844510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ae003f430 con 0x7f6adc003970 2023-08-09T12:42:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.276+0000 7f6aed7fa640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ad006a080 0x7f6ad006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.276+0000 7f6aed7fa640 1 -- 172.21.15.17:0/1174844510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6ae00ab6b0 con 0x7f6adc003970 2023-08-09T12:42:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.277+0000 7f6aeffff640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ad006a080 0x7f6ad006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.278+0000 7f6aeffff640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ad006a080 0x7f6ad006c540 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6af015abb0 tx=0x7f6ad8001b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:15.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.280+0000 7f6aed7fa640 1 -- 172.21.15.17:0/1174844510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6ae0076d50 con 0x7f6adc003970 2023-08-09T12:42:15.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.471+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6af0067a80 con 0x7f6adc003970 2023-08-09T12:42:15.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.472+0000 7f6aed7fa640 1 -- 172.21.15.17:0/1174844510 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ae004d0a0 con 0x7f6adc003970 2023-08-09T12:42:15.476 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:42:15.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ad006a080 msgr2=0x7f6ad006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ad006a080 0x7f6ad006c540 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6af015abb0 tx=0x7f6ad8001b40 comp rx=0 tx=0).stop 2023-08-09T12:42:15.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 msgr2=0x7f6af00b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6af00b0c60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6ae002c640 tx=0x7f6ae0009750 comp rx=0 tx=0).stop 2023-08-09T12:42:15.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 shutdown_connections 2023-08-09T12:42:15.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ad006a080 0x7f6ad006c540 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6af00cbb90 0x7f6af015ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6af00b11a0 0x7f6af00cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 --2- 172.21.15.17:0/1174844510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc003970 0x7f6af00b0c60 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 >> 172.21.15.17:0/1174844510 conn(0x7f6af006fde0 msgr2=0x7f6af00cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:15.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 shutdown_connections 2023-08-09T12:42:15.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.475+0000 7f6af6c26640 1 -- 172.21.15.17:0/1174844510 wait complete. 2023-08-09T12:42:15.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:42:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.726+0000 7f7208be8640 1 Processor -- start 2023-08-09T12:42:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.726+0000 7f7208be8640 1 -- start start 2023-08-09T12:42:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.727+0000 7f7208be8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f720415ce90 0x7f72041616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f7208be8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72040b6000 0x7f72040cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f7208be8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040b6460 con 0x7f72040d29d0 2023-08-09T12:42:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f7208be8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040cda40 con 0x7f720415ce90 2023-08-09T12:42:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f7208be8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040cdd10 con 0x7f72040b6000 2023-08-09T12:42:15.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f720259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f720415ce90 0x7f72041616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f720259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f720415ce90 0x7f72041616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57858/0 (socket says 172.21.15.17:57858) 2023-08-09T12:42:15.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f720259c640 1 -- 172.21.15.17:0/1163539524 learned_addr learned my addr 172.21.15.17:0/1163539524 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:15.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f7202d9d640 1 --1- 172.21.15.17:0/1163539524 >> v1:172.21.15.17:6789/0 conn(0x7f72040d29d0 0x7f72040d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35612/0 (socket says 172.21.15.17:35612) 2023-08-09T12:42:15.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.728+0000 7f7201d9b640 1 --2- 172.21.15.17:0/1163539524 >> v2:172.21.15.142:3300/0 conn(0x7f72040b6000 0x7f72040cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.729+0000 7f720259c640 1 -- 172.21.15.17:0/1163539524 >> v2:172.21.15.142:3300/0 conn(0x7f72040b6000 msgr2=0x7f72040cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:15.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.729+0000 7f720259c640 1 --2- 172.21.15.17:0/1163539524 >> v2:172.21.15.142:3300/0 conn(0x7f72040b6000 0x7f72040cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.729+0000 7f720259c640 1 -- 172.21.15.17:0/1163539524 >> v1:172.21.15.17:6789/0 conn(0x7f72040d29d0 legacy=0x7f72040d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.729+0000 7f720259c640 1 -- 172.21.15.17:0/1163539524 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040cdff0 con 0x7f720415ce90 2023-08-09T12:42:15.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.729+0000 7f720159a640 1 -- 172.21.15.17:0/1163539524 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950043263 0 0) 0x7f72040b6460 con 0x7f72040d29d0 2023-08-09T12:42:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.730+0000 7f720259c640 1 --2- 172.21.15.17:0/1163539524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f720415ce90 0x7f72041616e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f72040c9c00 tx=0x7f71f402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23c2aa14f38c1cb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.730+0000 7f720159a640 1 -- 172.21.15.17:0/1163539524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f402cb20 con 0x7f720415ce90 2023-08-09T12:42:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.730+0000 7f720159a640 1 -- 172.21.15.17:0/1163539524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f402cc80 con 0x7f720415ce90 2023-08-09T12:42:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.730+0000 7f720159a640 1 -- 172.21.15.17:0/1163539524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f40343f0 con 0x7f720415ce90 2023-08-09T12:42:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.731+0000 7f7208be8640 1 -- 172.21.15.17:0/1163539524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f720415ce90 msgr2=0x7f72041616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.731+0000 7f7208be8640 1 --2- 172.21.15.17:0/1163539524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f720415ce90 0x7f72041616e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f72040c9c00 tx=0x7f71f402bf80 comp rx=0 tx=0).stop 2023-08-09T12:42:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.731+0000 7f7208be8640 1 -- 172.21.15.17:0/1163539524 shutdown_connections 2023-08-09T12:42:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.731+0000 7f7208be8640 1 --2- 172.21.15.17:0/1163539524 >> v2:172.21.15.142:3300/0 conn(0x7f72040b6000 0x7f72040cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.731+0000 7f7208be8640 1 --2- 172.21.15.17:0/1163539524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f720415ce90 0x7f72041616e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.731+0000 7f7208be8640 1 -- 172.21.15.17:0/1163539524 >> 172.21.15.17:0/1163539524 conn(0x7f720406fde0 msgr2=0x7f72040701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.731+0000 7f7208be8640 1 -- 172.21.15.17:0/1163539524 shutdown_connections 2023-08-09T12:42:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.731+0000 7f7208be8640 1 -- 172.21.15.17:0/1163539524 wait complete. 2023-08-09T12:42:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.733+0000 7f7208be8640 1 Processor -- start 2023-08-09T12:42:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.733+0000 7f7208be8640 1 -- start start 2023-08-09T12:42:15.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7208be8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72040b6000 0x7f720415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7208be8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72040d29d0 0x7f72040cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7208be8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f720415ce90 0x7f72041580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7208be8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72040cb5b0 con 0x7f72040d29d0 2023-08-09T12:42:15.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7208be8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72041f6ac0 con 0x7f72040b6000 2023-08-09T12:42:15.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7208be8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7204158600 con 0x7f720415ce90 2023-08-09T12:42:15.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7201d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72040d29d0 0x7f72040cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7201d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72040d29d0 0x7f72040cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57868/0 (socket says 172.21.15.17:57868) 2023-08-09T12:42:15.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7201d9b640 1 -- 172.21.15.17:0/1255409847 learned_addr learned my addr 172.21.15.17:0/1255409847 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:15.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f720259c640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72040b6000 0x7f720415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7201d9b640 1 -- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f720415ce90 msgr2=0x7f72041580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7201d9b640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f720415ce90 0x7f72041580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7201d9b640 1 -- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72040b6000 msgr2=0x7f720415d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7201d9b640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72040b6000 0x7f720415d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f7201d9b640 1 -- 172.21.15.17:0/1255409847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f4009b30 con 0x7f72040d29d0 2023-08-09T12:42:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.734+0000 7f720259c640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72040b6000 0x7f720415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.735+0000 7f7201d9b640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72040d29d0 0x7f72040cb070 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00d830 tx=0x7f71ec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.735+0000 7f71faffd640 1 -- 172.21.15.17:0/1255409847 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00b6c0 con 0x7f72040d29d0 2023-08-09T12:42:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.735+0000 7f71faffd640 1 -- 172.21.15.17:0/1255409847 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00b820 con 0x7f72040d29d0 2023-08-09T12:42:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.735+0000 7f71faffd640 1 -- 172.21.15.17:0/1255409847 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00bbb0 con 0x7f72040d29d0 2023-08-09T12:42:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.735+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72040cb7e0 con 0x7f72040d29d0 2023-08-09T12:42:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.735+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72041f6d30 con 0x7f72040d29d0 2023-08-09T12:42:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.736+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72040cbd00 con 0x7f72040d29d0 2023-08-09T12:42:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.737+0000 7f71faffd640 1 -- 172.21.15.17:0/1255409847 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f71ec01e460 con 0x7f72040d29d0 2023-08-09T12:42:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.738+0000 7f71faffd640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71e406a050 0x7f71e406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.738+0000 7f71faffd640 1 -- 172.21.15.17:0/1255409847 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f71ec088e10 con 0x7f72040d29d0 2023-08-09T12:42:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.739+0000 7f720259c640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71e406a050 0x7f71e406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.740+0000 7f720259c640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71e406a050 0x7f71e406c510 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71f4035000 tx=0x7f71f4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:15.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.743+0000 7f71faffd640 1 -- 172.21.15.17:0/1255409847 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f71ec08c030 con 0x7f72040d29d0 2023-08-09T12:42:15.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.949+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7204067a80 con 0x7f72040d29d0 2023-08-09T12:42:15.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.950+0000 7f71faffd640 1 -- 172.21.15.17:0/1255409847 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f71ec054420 con 0x7f72040d29d0 2023-08-09T12:42:15.953 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:42:15.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71e406a050 msgr2=0x7f71e406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71e406a050 0x7f71e406c510 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71f4035000 tx=0x7f71f4030000 comp rx=0 tx=0).stop 2023-08-09T12:42:15.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72040d29d0 msgr2=0x7f72040cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:15.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72040d29d0 0x7f72040cb070 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00d830 tx=0x7f71ec00dcf0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 shutdown_connections 2023-08-09T12:42:15.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71e406a050 0x7f71e406c510 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f720415ce90 0x7f72041580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72040d29d0 0x7f72040cb070 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 --2- 172.21.15.17:0/1255409847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72040b6000 0x7f720415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:15.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.952+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 >> 172.21.15.17:0/1255409847 conn(0x7f720406fde0 msgr2=0x7f72040d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:15.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.953+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 shutdown_connections 2023-08-09T12:42:15.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:15.953+0000 7f7208be8640 1 -- 172.21.15.17:0/1255409847 wait complete. 2023-08-09T12:42:15.974 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:42:15.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:15.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:42:16.102 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:42:16.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:16.103 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:42:16.153 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:42:16.153 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:16.219 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:42:16.219 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:42:16.220 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:16.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:42:16.279 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:16.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.510+0000 7f99cd793640 1 Processor -- start 2023-08-09T12:42:16.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.510+0000 7f99cd793640 1 -- start start 2023-08-09T12:42:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.511+0000 7f99cd793640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99c80cb070 0x7f99c80cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.511+0000 7f99cd793640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c80cb9e0 con 0x7f99c8070f00 2023-08-09T12:42:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.512+0000 7f99cd793640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c8071340 con 0x7f99c81587e0 2023-08-09T12:42:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.512+0000 7f99cd793640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c815beb0 con 0x7f99c80cb070 2023-08-09T12:42:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.512+0000 7f99c77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f99c8070f00 0x7f99c815b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35626/0 (socket says 172.21.15.17:35626) 2023-08-09T12:42:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.512+0000 7f99c77fe640 1 -- 172.21.15.17:0/2413039205 learned_addr learned my addr 172.21.15.17:0/2413039205 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:16.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.512+0000 7f99ccf92640 1 --2- 172.21.15.17:0/2413039205 >> v2:172.21.15.142:3300/0 conn(0x7f99c80cb070 0x7f99c80cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:16.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.512+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739763461 0 0) 0x7f99c80cb9e0 con 0x7f99c8070f00 2023-08-09T12:42:16.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.512+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b0003520 con 0x7f99c8070f00 2023-08-09T12:42:16.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3520817323 0 0) 0x7f99b0003520 con 0x7f99c8070f00 2023-08-09T12:42:16.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 >> v2:172.21.15.142:3300/0 conn(0x7f99c80cb070 msgr2=0x7f99c80cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 --2- 172.21.15.17:0/2413039205 >> v2:172.21.15.142:3300/0 conn(0x7f99c80cb070 0x7f99c80cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 >> v1:172.21.15.142:6789/0 conn(0x7f99c81587e0 legacy=0x7f99c80b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c80715c0 con 0x7f99c8070f00 2023-08-09T12:42:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f99bc001670 con 0x7f99c8070f00 2023-08-09T12:42:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 >> v1:172.21.15.17:6789/0 conn(0x7f99c8070f00 legacy=0x7f99c815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0003970 0x7f99b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99b0005180 0x7f99b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c815beb0 con 0x7f99b0005180 2023-08-09T12:42:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b000c020 con 0x7f99b00047c0 2023-08-09T12:42:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b000c1e0 con 0x7f99b0003970 2023-08-09T12:42:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.513+0000 7f99ccf92640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99b0005180 0x7f99b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.514+0000 7f99c7fff640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0003970 0x7f99b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.514+0000 7f99c77fe640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.514+0000 7f99ccf92640 1 -- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0003970 msgr2=0x7f99b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.514+0000 7f99ccf92640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0003970 0x7f99b0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.514+0000 7f99ccf92640 1 -- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b00047c0 msgr2=0x7f99b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.514+0000 7f99ccf92640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.514+0000 7f99ccf92640 1 -- 172.21.15.17:0/2413039205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0003520 con 0x7f99b0005180 2023-08-09T12:42:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.514+0000 7f99c77fe640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99b00047c0 0x7f99b0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:16.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.515+0000 7f99ccf92640 1 -- 172.21.15.17:0/2413039205 reap_dead start 2023-08-09T12:42:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.515+0000 7f99ccf92640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99b0005180 0x7f99b000b980 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009fc0 tx=0x7f99b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f41100dd4062fc2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.515+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c002cc60 con 0x7f99b0005180 2023-08-09T12:42:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.515+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c000f040 con 0x7f99b0005180 2023-08-09T12:42:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.515+0000 7f99c6ffd640 1 -- 172.21.15.17:0/2413039205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0003990 con 0x7f99b0005180 2023-08-09T12:42:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.516+0000 7f99cd793640 1 -- 172.21.15.17:0/2413039205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99b0005180 msgr2=0x7f99b000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.516+0000 7f99cd793640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99b0005180 0x7f99b000b980 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009fc0 tx=0x7f99b00057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.516+0000 7f99cd793640 1 -- 172.21.15.17:0/2413039205 shutdown_connections 2023-08-09T12:42:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.516+0000 7f99cd793640 1 --2- 172.21.15.17:0/2413039205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99b0005180 0x7f99b000b980 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.516+0000 7f99cd793640 1 -- 172.21.15.17:0/2413039205 >> 172.21.15.17:0/2413039205 conn(0x7f99c80b1d50 msgr2=0x7f99c806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.516+0000 7f99cd793640 1 -- 172.21.15.17:0/2413039205 shutdown_connections 2023-08-09T12:42:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.516+0000 7f99cd793640 1 -- 172.21.15.17:0/2413039205 wait complete. 2023-08-09T12:42:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.518+0000 7f99cd793640 1 Processor -- start 2023-08-09T12:42:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.518+0000 7f99cd793640 1 -- start start 2023-08-09T12:42:16.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.519+0000 7f99cd793640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0005180 0x7f99c80ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.519+0000 7f99cd793640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c80ca000 0x7f99c81f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.519+0000 7f99cd793640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c80ca480 0x7f99c8155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.519+0000 7f99cd793640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c81f64a0 con 0x7f99c80ca000 2023-08-09T12:42:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.519+0000 7f99cd793640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c81f6780 con 0x7f99c80ca480 2023-08-09T12:42:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.519+0000 7f99cd793640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c80ac8b0 con 0x7f99b0005180 2023-08-09T12:42:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c80ca000 0x7f99c81f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c80ca000 0x7f99c81f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57880/0 (socket says 172.21.15.17:57880) 2023-08-09T12:42:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c77fe640 1 -- 172.21.15.17:0/1924162467 learned_addr learned my addr 172.21.15.17:0/1924162467 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99ccf92640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c80ca480 0x7f99c8155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0005180 0x7f99c80ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c77fe640 1 -- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0005180 msgr2=0x7f99c80ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c77fe640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0005180 0x7f99c80ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c77fe640 1 -- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c80ca480 msgr2=0x7f99c8155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c77fe640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c80ca480 0x7f99c8155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c77fe640 1 -- 172.21.15.17:0/1924162467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c80acb90 con 0x7f99c80ca000 2023-08-09T12:42:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.520+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0005180 0x7f99c80ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.521+0000 7f99c77fe640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c80ca000 0x7f99c81f5a00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f99bc000ff0 tx=0x7f99bc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.521+0000 7f99c4ff9640 1 -- 172.21.15.17:0/1924162467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0074e0 con 0x7f99c80ca000 2023-08-09T12:42:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.521+0000 7f99c4ff9640 1 -- 172.21.15.17:0/1924162467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc007640 con 0x7f99c80ca000 2023-08-09T12:42:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.521+0000 7f99c4ff9640 1 -- 172.21.15.17:0/1924162467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0049e0 con 0x7f99c80ca000 2023-08-09T12:42:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.521+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c80ace70 con 0x7f99c80ca000 2023-08-09T12:42:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.521+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c81f5f40 con 0x7f99c80ca000 2023-08-09T12:42:16.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.522+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c804e390 con 0x7f99c80ca000 2023-08-09T12:42:16.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.523+0000 7f99c4ff9640 1 -- 172.21.15.17:0/1924162467 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f99bc004b40 con 0x7f99c80ca000 2023-08-09T12:42:16.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.524+0000 7f99c4ff9640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f99b406a050 0x7f99b406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:16.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.524+0000 7f99c4ff9640 1 -- 172.21.15.17:0/1924162467 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f99bc087e80 con 0x7f99c80ca000 2023-08-09T12:42:16.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.525+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f99b406a050 0x7f99b406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:16.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.526+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f99b406a050 0x7f99b406c510 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f99b8000c00 tx=0x7f99b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:16.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.528+0000 7f99c4ff9640 1 -- 172.21.15.17:0/1924162467 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f99bc0535d0 con 0x7f99c80ca000 2023-08-09T12:42:16.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.753+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99c806b8d0 con 0x7f99c80ca000 2023-08-09T12:42:16.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.754+0000 7f99c4ff9640 1 -- 172.21.15.17:0/1924162467 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f99bc019020 con 0x7f99c80ca000 2023-08-09T12:42:16.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:42:16.758 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:42:16.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f99b406a050 msgr2=0x7f99b406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:16.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f99b406a050 0x7f99b406c510 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f99b8000c00 tx=0x7f99b8009040 comp rx=0 tx=0).stop 2023-08-09T12:42:16.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c80ca000 msgr2=0x7f99c81f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:16.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c80ca000 0x7f99c81f5a00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f99bc000ff0 tx=0x7f99bc00dd40 comp rx=0 tx=0).stop 2023-08-09T12:42:16.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 shutdown_connections 2023-08-09T12:42:16.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f99b406a050 0x7f99b406c510 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c80ca480 0x7f99c8155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c80ca000 0x7f99c81f5a00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 --2- 172.21.15.17:0/1924162467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99b0005180 0x7f99c80ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:16.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 >> 172.21.15.17:0/1924162467 conn(0x7f99c80b1d50 msgr2=0x7f99c8157070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:16.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 shutdown_connections 2023-08-09T12:42:16.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:16.757+0000 7f99cd793640 1 -- 172.21.15.17:0/1924162467 wait complete. 2023-08-09T12:42:16.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:17.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.003+0000 7fcacd72f640 1 Processor -- start 2023-08-09T12:42:17.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.003+0000 7fcacd72f640 1 -- start start 2023-08-09T12:42:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.005+0000 7fcacd72f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcac815e350 0x7fcac80b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.005+0000 7fcacd72f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac80b0710 0x7fcac815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.005+0000 7fcacd72f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac8070fa0 con 0x7fcac815df70 2023-08-09T12:42:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.005+0000 7fcacd72f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac806c180 con 0x7fcac815e350 2023-08-09T12:42:17.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.005+0000 7fcacd72f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac806ccc0 con 0x7fcac80b0710 2023-08-09T12:42:17.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.005+0000 7fcac67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcac815e350 0x7fcac80b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.005+0000 7fcac67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcac815e350 0x7fcac80b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57888/0 (socket says 172.21.15.17:57888) 2023-08-09T12:42:17.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.005+0000 7fcac67fc640 1 -- 172.21.15.17:0/1017500533 learned_addr learned my addr 172.21.15.17:0/1017500533 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:17.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.006+0000 7fcac67fc640 1 -- 172.21.15.17:0/1017500533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac80b0710 msgr2=0x7fcac815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:17.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.006+0000 7fcac67fc640 1 --2- 172.21.15.17:0/1017500533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac80b0710 0x7fcac815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.006+0000 7fcac67fc640 1 -- 172.21.15.17:0/1017500533 >> v1:172.21.15.142:6789/0 conn(0x7fcac815df70 legacy=0x7fcac80704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:17.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.006+0000 7fcac67fc640 1 -- 172.21.15.17:0/1017500533 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac80b0b50 con 0x7fcac815e350 2023-08-09T12:42:17.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.007+0000 7fcac67fc640 1 --2- 172.21.15.17:0/1017500533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b01d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009870 tx=0x7fcabc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60817739a5708e5b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.007+0000 7fcac5ffb640 1 -- 172.21.15.17:0/1017500533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc031640 con 0x7fcac815e350 2023-08-09T12:42:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.007+0000 7fcac5ffb640 1 -- 172.21.15.17:0/1017500533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc0317a0 con 0x7fcac815e350 2023-08-09T12:42:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.007+0000 7fcac5ffb640 1 -- 172.21.15.17:0/1017500533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc031b30 con 0x7fcac815e350 2023-08-09T12:42:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.008+0000 7fcacd72f640 1 -- 172.21.15.17:0/1017500533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 msgr2=0x7fcac80b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.008+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1017500533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b01d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009870 tx=0x7fcabc02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.008+0000 7fcacd72f640 1 -- 172.21.15.17:0/1017500533 shutdown_connections 2023-08-09T12:42:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.008+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1017500533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac80b0710 0x7fcac815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.008+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1017500533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b01d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.008+0000 7fcacd72f640 1 -- 172.21.15.17:0/1017500533 >> 172.21.15.17:0/1017500533 conn(0x7fcac80cb1d0 msgr2=0x7fcac80cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.008+0000 7fcacd72f640 1 -- 172.21.15.17:0/1017500533 shutdown_connections 2023-08-09T12:42:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.008+0000 7fcacd72f640 1 -- 172.21.15.17:0/1017500533 wait complete. 2023-08-09T12:42:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.010+0000 7fcacd72f640 1 Processor -- start 2023-08-09T12:42:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.010+0000 7fcacd72f640 1 -- start start 2023-08-09T12:42:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.011+0000 7fcacd72f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac80b0710 0x7fcac814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.011+0000 7fcacd72f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac815df70 0x7fcac80b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.011+0000 7fcacd72f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.011+0000 7fcacd72f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80b27d0 con 0x7fcac815e350 2023-08-09T12:42:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.011+0000 7fcacd72f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac814d330 con 0x7fcac80b0710 2023-08-09T12:42:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.011+0000 7fcacd72f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80b1b50 con 0x7fcac815df70 2023-08-09T12:42:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.011+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.011+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57904/0 (socket says 172.21.15.17:57904) 2023-08-09T12:42:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac77fe640 1 -- 172.21.15.17:0/1385437025 learned_addr learned my addr 172.21.15.17:0/1385437025 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac67fc640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac815df70 0x7fcac80b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac77fe640 1 -- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac815df70 msgr2=0x7fcac80b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac77fe640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac815df70 0x7fcac80b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac77fe640 1 -- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac80b0710 msgr2=0x7fcac814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac77fe640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac80b0710 0x7fcac814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac77fe640 1 -- 172.21.15.17:0/1385437025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc0094d0 con 0x7fcac815e350 2023-08-09T12:42:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac67fc640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac815df70 0x7fcac80b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.012+0000 7fcac77fe640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b1100 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fcac000b970 tx=0x7fcac000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.013+0000 7fcaaf7fe640 1 -- 172.21.15.17:0/1385437025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000cb40 con 0x7fcac815e350 2023-08-09T12:42:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.013+0000 7fcaaf7fe640 1 -- 172.21.15.17:0/1385437025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000ccc0 con 0x7fcac815e350 2023-08-09T12:42:17.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.013+0000 7fcaaf7fe640 1 -- 172.21.15.17:0/1385437025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0014680 con 0x7fcac815e350 2023-08-09T12:42:17.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.013+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac80b1e30 con 0x7fcac815e350 2023-08-09T12:42:17.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.013+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac80b23f0 con 0x7fcac815e350 2023-08-09T12:42:17.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.014+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac8067a80 con 0x7fcac815e350 2023-08-09T12:42:17.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.015+0000 7fcaaf7fe640 1 -- 172.21.15.17:0/1385437025 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcac001d3b0 con 0x7fcac815e350 2023-08-09T12:42:17.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.016+0000 7fcaaf7fe640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcab406a050 0x7fcab406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.016+0000 7fcaaf7fe640 1 -- 172.21.15.17:0/1385437025 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcac0088570 con 0x7fcac815e350 2023-08-09T12:42:17.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.017+0000 7fcac6ffd640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcab406a050 0x7fcab406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.018+0000 7fcac6ffd640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcab406a050 0x7fcab406c510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcac8158a00 tx=0x7fcab80079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.020+0000 7fcaaf7fe640 1 -- 172.21.15.17:0/1385437025 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcac0053c10 con 0x7fcac815e350 2023-08-09T12:42:17.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.213+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcac80b2910 con 0x7fcac815e350 2023-08-09T12:42:17.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.215+0000 7fcaaf7fe640 1 -- 172.21.15.17:0/1385437025 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+18422 (secure 0 0 0) 0x7fcac80b2910 con 0x7fcac815e350 2023-08-09T12:42:17.219 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:17.219 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:11.769329+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:41:23.866427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-09T12:41:25.245820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:17.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcab406a050 msgr2=0x7fcab406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcab406a050 0x7fcab406c510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcac8158a00 tx=0x7fcab80079b0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 msgr2=0x7fcac80b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b1100 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fcac000b970 tx=0x7fcac000be30 comp rx=0 tx=0).stop 2023-08-09T12:42:17.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 shutdown_connections 2023-08-09T12:42:17.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcab406a050 0x7fcab406c510 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac815e350 0x7fcac80b1100 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac815df70 0x7fcac80b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 --2- 172.21.15.17:0/1385437025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac80b0710 0x7fcac814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 >> 172.21.15.17:0/1385437025 conn(0x7fcac80cb1d0 msgr2=0x7fcac80cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:17.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 shutdown_connections 2023-08-09T12:42:17.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.218+0000 7fcacd72f640 1 -- 172.21.15.17:0/1385437025 wait complete. 2023-08-09T12:42:17.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:41:23.866427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:41:25.245820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:42:17.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:42:17.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.454+0000 7fbfc5942640 1 Processor -- start 2023-08-09T12:42:17.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.454+0000 7fbfc5942640 1 -- start start 2023-08-09T12:42:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.455+0000 7fbfc5942640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc00adc40 0x7fbfc006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.455+0000 7fbfc5942640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfc00b3b40 0x7fbfc00b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.455+0000 7fbfc5942640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbfc015e8f0 0x7fbfc015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.455+0000 7fbfc5942640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc00ae020 con 0x7fbfc00b3b40 2023-08-09T12:42:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.455+0000 7fbfc5942640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc00b2250 con 0x7fbfc015e8f0 2023-08-09T12:42:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.456+0000 7fbfc5942640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00b2530 con 0x7fbfc00adc40 2023-08-09T12:42:17.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.456+0000 7fbfbe7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfc00b3b40 0x7fbfc00b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.456+0000 7fbfbeffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc00adc40 0x7fbfc006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.456+0000 7fbfbe7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfc00b3b40 0x7fbfc00b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57910/0 (socket says 172.21.15.17:57910) 2023-08-09T12:42:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.456+0000 7fbfbe7fc640 1 -- 172.21.15.17:0/4179779273 learned_addr learned my addr 172.21.15.17:0/4179779273 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.456+0000 7fbfbf7fe640 1 --2- 172.21.15.17:0/4179779273 >> v2:172.21.15.142:3300/0 conn(0x7fbfc015e8f0 0x7fbfc015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.457+0000 7fbfbe7fc640 1 -- 172.21.15.17:0/4179779273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc00adc40 msgr2=0x7fbfc006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.457+0000 7fbfbe7fc640 1 --2- 172.21.15.17:0/4179779273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc00adc40 0x7fbfc006c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.457+0000 7fbfbe7fc640 1 -- 172.21.15.17:0/4179779273 >> v2:172.21.15.142:3300/0 conn(0x7fbfc015e8f0 msgr2=0x7fbfc015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.457+0000 7fbfbe7fc640 1 --2- 172.21.15.17:0/4179779273 >> v2:172.21.15.142:3300/0 conn(0x7fbfc015e8f0 0x7fbfc015ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.457+0000 7fbfbe7fc640 1 -- 172.21.15.17:0/4179779273 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc006fe80 con 0x7fbfc00b3b40 2023-08-09T12:42:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.458+0000 7fbfbe7fc640 1 --2- 172.21.15.17:0/4179779273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc00b3fa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00cf780 tx=0x7fbfb402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cf81bafd619cdc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.458+0000 7fbfbdffb640 1 -- 172.21.15.17:0/4179779273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4004230 con 0x7fbfc00b3b40 2023-08-09T12:42:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfbdffb640 1 -- 172.21.15.17:0/4179779273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4004390 con 0x7fbfc00b3b40 2023-08-09T12:42:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfbdffb640 1 -- 172.21.15.17:0/4179779273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4003810 con 0x7fbfc00b3b40 2023-08-09T12:42:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 -- 172.21.15.17:0/4179779273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 msgr2=0x7fbfc00b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 --2- 172.21.15.17:0/4179779273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc00b3fa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00cf780 tx=0x7fbfb402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 -- 172.21.15.17:0/4179779273 shutdown_connections 2023-08-09T12:42:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 --2- 172.21.15.17:0/4179779273 >> v2:172.21.15.142:3300/0 conn(0x7fbfc015e8f0 0x7fbfc015ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 --2- 172.21.15.17:0/4179779273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc00b3fa0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 --2- 172.21.15.17:0/4179779273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc00adc40 0x7fbfc006c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 -- 172.21.15.17:0/4179779273 >> 172.21.15.17:0/4179779273 conn(0x7fbfc00cb1b0 msgr2=0x7fbfc00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 -- 172.21.15.17:0/4179779273 shutdown_connections 2023-08-09T12:42:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.459+0000 7fbfc5942640 1 -- 172.21.15.17:0/4179779273 wait complete. 2023-08-09T12:42:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.461+0000 7fbfc5942640 1 Processor -- start 2023-08-09T12:42:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.461+0000 7fbfc5942640 1 -- start start 2023-08-09T12:42:17.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.462+0000 7fbfc5942640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc00adc40 0x7fbfc0152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.462+0000 7fbfc5942640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc0156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.462+0000 7fbfc5942640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc015e8f0 0x7fbfc006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.462+0000 7fbfc5942640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc0152a40 con 0x7fbfc00b3b40 2023-08-09T12:42:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.462+0000 7fbfc5942640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc01573d0 con 0x7fbfc00adc40 2023-08-09T12:42:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.462+0000 7fbfc5942640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc01576b0 con 0x7fbfc015e8f0 2023-08-09T12:42:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc0156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc0156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57916/0 (socket says 172.21.15.17:57916) 2023-08-09T12:42:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 -- 172.21.15.17:0/3483394944 learned_addr learned my addr 172.21.15.17:0/3483394944 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 -- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc015e8f0 msgr2=0x7fbfc006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc015e8f0 0x7fbfc006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 -- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc00adc40 msgr2=0x7fbfc0152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbeffd640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc00adc40 0x7fbfc0152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc00adc40 0x7fbfc0152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 -- 172.21.15.17:0/3483394944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4009460 con 0x7fbfc00b3b40 2023-08-09T12:42:17.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.463+0000 7fbfbe7fc640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc0156a60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbfb402b930 tx=0x7fbfb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.464+0000 7fbfa7fff640 1 -- 172.21.15.17:0/3483394944 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4003c40 con 0x7fbfc00b3b40 2023-08-09T12:42:17.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.464+0000 7fbfa7fff640 1 -- 172.21.15.17:0/3483394944 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb403f070 con 0x7fbfc00b3b40 2023-08-09T12:42:17.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.464+0000 7fbfa7fff640 1 -- 172.21.15.17:0/3483394944 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4004500 con 0x7fbfc00b3b40 2023-08-09T12:42:17.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.464+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc0157990 con 0x7fbfc00b3b40 2023-08-09T12:42:17.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.464+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc0157f50 con 0x7fbfc00b3b40 2023-08-09T12:42:17.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.465+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc0067a80 con 0x7fbfc00b3b40 2023-08-09T12:42:17.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.466+0000 7fbfa7fff640 1 -- 172.21.15.17:0/3483394944 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbfb4041030 con 0x7fbfc00b3b40 2023-08-09T12:42:17.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.467+0000 7fbfa7fff640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfac06a050 0x7fbfac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.468+0000 7fbfa7fff640 1 -- 172.21.15.17:0/3483394944 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbfb40aa740 con 0x7fbfc00b3b40 2023-08-09T12:42:17.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.468+0000 7fbfbeffd640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfac06a050 0x7fbfac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.469+0000 7fbfbeffd640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfac06a050 0x7fbfac06c510 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbfc015d940 tx=0x7fbfb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.472+0000 7fbfa7fff640 1 -- 172.21.15.17:0/3483394944 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbfb4075e70 con 0x7fbfc00b3b40 2023-08-09T12:42:17.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.664+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfc00b1e60 con 0x7fbfc00b3b40 2023-08-09T12:42:17.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.665+0000 7fbfa7fff640 1 -- 172.21.15.17:0/3483394944 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfb4079490 con 0x7fbfc00b3b40 2023-08-09T12:42:17.669 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:42:17.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfac06a050 msgr2=0x7fbfac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfac06a050 0x7fbfac06c510 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbfc015d940 tx=0x7fbfb0008040 comp rx=0 tx=0).stop 2023-08-09T12:42:17.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 msgr2=0x7fbfc0156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc0156a60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbfb402b930 tx=0x7fbfb40046c0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 shutdown_connections 2023-08-09T12:42:17.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfac06a050 0x7fbfac06c510 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc015e8f0 0x7fbfc006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfc00b3b40 0x7fbfc0156a60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 --2- 172.21.15.17:0/3483394944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc00adc40 0x7fbfc0152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 >> 172.21.15.17:0/3483394944 conn(0x7fbfc00cb1b0 msgr2=0x7fbfc015dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:17.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 shutdown_connections 2023-08-09T12:42:17.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.668+0000 7fbfc5942640 1 -- 172.21.15.17:0/3483394944 wait complete. 2023-08-09T12:42:17.688 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:42:17.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.909+0000 7fd4ac84b640 1 Processor -- start 2023-08-09T12:42:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.910+0000 7fd4ac84b640 1 -- start start 2023-08-09T12:42:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.911+0000 7fd4ac84b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd4a80b0020 0x7fd4a80b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.911+0000 7fd4ac84b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a80cdb00 0x7fd4a80acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.911+0000 7fd4ac84b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a8157580 con 0x7fd4a8160640 2023-08-09T12:42:17.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.911+0000 7fd4ac84b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a815d1c0 con 0x7fd4a80b0020 2023-08-09T12:42:17.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.911+0000 7fd4ac84b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80b0940 con 0x7fd4a80cdb00 2023-08-09T12:42:17.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.912+0000 7fd4a6d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd4a80b0020 0x7fd4a80b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.912+0000 7fd4a6d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd4a80b0020 0x7fd4a80b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54578/0 (socket says 172.21.15.17:54578) 2023-08-09T12:42:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.912+0000 7fd4a6d9d640 1 -- 172.21.15.17:0/2614589680 learned_addr learned my addr 172.21.15.17:0/2614589680 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.912+0000 7fd49e59c640 1 --2- 172.21.15.17:0/2614589680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a80cdb00 0x7fd4a80acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.912+0000 7fd4a6d9d640 1 -- 172.21.15.17:0/2614589680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a80cdb00 msgr2=0x7fd4a80acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.912+0000 7fd4a6d9d640 1 --2- 172.21.15.17:0/2614589680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a80cdb00 0x7fd4a80acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.912+0000 7fd4a6d9d640 1 -- 172.21.15.17:0/2614589680 >> v1:172.21.15.142:6789/0 conn(0x7fd4a8160640 legacy=0x7fd4a815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.912+0000 7fd4a6d9d640 1 -- 172.21.15.17:0/2614589680 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a8160b90 con 0x7fd4a80b0020 2023-08-09T12:42:17.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.913+0000 7fd4a6d9d640 1 --2- 172.21.15.17:0/2614589680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80b0020 0x7fd4a80b0400 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd498009870 tx=0x7fd49802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371d63d77896dea0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.914+0000 7fd4a659c640 1 -- 172.21.15.17:0/2614589680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498031640 con 0x7fd4a80b0020 2023-08-09T12:42:17.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.914+0000 7fd4a659c640 1 -- 172.21.15.17:0/2614589680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980317a0 con 0x7fd4a80b0020 2023-08-09T12:42:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.914+0000 7fd4a659c640 1 -- 172.21.15.17:0/2614589680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498031b30 con 0x7fd4a80b0020 2023-08-09T12:42:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.914+0000 7fd4ac84b640 1 -- 172.21.15.17:0/2614589680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80b0020 msgr2=0x7fd4a80b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.914+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/2614589680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80b0020 0x7fd4a80b0400 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd498009870 tx=0x7fd49802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.915+0000 7fd4ac84b640 1 -- 172.21.15.17:0/2614589680 shutdown_connections 2023-08-09T12:42:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.915+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/2614589680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a80cdb00 0x7fd4a80acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.915+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/2614589680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80b0020 0x7fd4a80b0400 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.915+0000 7fd4ac84b640 1 -- 172.21.15.17:0/2614589680 >> 172.21.15.17:0/2614589680 conn(0x7fd4a80cb020 msgr2=0x7fd4a80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.915+0000 7fd4ac84b640 1 -- 172.21.15.17:0/2614589680 shutdown_connections 2023-08-09T12:42:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.915+0000 7fd4ac84b640 1 -- 172.21.15.17:0/2614589680 wait complete. 2023-08-09T12:42:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.917+0000 7fd4ac84b640 1 Processor -- start 2023-08-09T12:42:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.917+0000 7fd4ac84b640 1 -- start start 2023-08-09T12:42:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.918+0000 7fd4ac84b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a80b0020 0x7fd4a80b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.918+0000 7fd4ac84b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80cdb00 0x7fd4a81f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.918+0000 7fd4ac84b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a8160640 0x7fd4a81f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.918+0000 7fd4ac84b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a81f2300 con 0x7fd4a80cdb00 2023-08-09T12:42:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.918+0000 7fd4ac84b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8071150 con 0x7fd4a80b0020 2023-08-09T12:42:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.918+0000 7fd4ac84b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8071940 con 0x7fd4a8160640 2023-08-09T12:42:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80cdb00 0x7fd4a81f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80cdb00 0x7fd4a81f1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54590/0 (socket says 172.21.15.17:54590) 2023-08-09T12:42:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 -- 172.21.15.17:0/494198245 learned_addr learned my addr 172.21.15.17:0/494198245 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd4a6d9d640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a80b0020 0x7fd4a80b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd4a759e640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a8160640 0x7fd4a81f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 -- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a8160640 msgr2=0x7fd4a81f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a8160640 0x7fd4a81f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 -- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a80b0020 msgr2=0x7fd4a80b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a80b0020 0x7fd4a80b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 -- 172.21.15.17:0/494198245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980094d0 con 0x7fd4a80cdb00 2023-08-09T12:42:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd4a6d9d640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a80b0020 0x7fd4a80b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd4a759e640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a8160640 0x7fd4a81f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.919+0000 7fd49e59c640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80cdb00 0x7fd4a81f1dc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd49000d7d0 tx=0x7fd49000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.920+0000 7fd49ffff640 1 -- 172.21.15.17:0/494198245 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000b660 con 0x7fd4a80cdb00 2023-08-09T12:42:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.920+0000 7fd49ffff640 1 -- 172.21.15.17:0/494198245 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000b7c0 con 0x7fd4a80cdb00 2023-08-09T12:42:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.920+0000 7fd49ffff640 1 -- 172.21.15.17:0/494198245 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000bb50 con 0x7fd4a80cdb00 2023-08-09T12:42:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.920+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a81f6920 con 0x7fd4a80cdb00 2023-08-09T12:42:17.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.920+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a8071660 con 0x7fd4a80cdb00 2023-08-09T12:42:17.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.921+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a804e390 con 0x7fd4a80cdb00 2023-08-09T12:42:17.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.922+0000 7fd49ffff640 1 -- 172.21.15.17:0/494198245 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd49000bcb0 con 0x7fd4a80cdb00 2023-08-09T12:42:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.923+0000 7fd49ffff640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48c06a050 0x7fd48c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.923+0000 7fd49ffff640 1 -- 172.21.15.17:0/494198245 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd490088a70 con 0x7fd4a80cdb00 2023-08-09T12:42:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.924+0000 7fd4a6d9d640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48c06a050 0x7fd48c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:17.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.925+0000 7fd4a6d9d640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48c06a050 0x7fd48c06c510 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd498036000 tx=0x7fd49803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:17.928+0000 7fd49ffff640 1 -- 172.21.15.17:0/494198245 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd490057ba0 con 0x7fd4a80cdb00 2023-08-09T12:42:18.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.120+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4a80b4520 con 0x7fd4a80cdb00 2023-08-09T12:42:18.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.121+0000 7fd49ffff640 1 -- 172.21.15.17:0/494198245 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd490057730 con 0x7fd4a80cdb00 2023-08-09T12:42:18.124 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:42:18.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.123+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48c06a050 msgr2=0x7fd48c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.123+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48c06a050 0x7fd48c06c510 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd498036000 tx=0x7fd49803c040 comp rx=0 tx=0).stop 2023-08-09T12:42:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80cdb00 msgr2=0x7fd4a81f1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80cdb00 0x7fd4a81f1dc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd49000d7d0 tx=0x7fd49000dc90 comp rx=0 tx=0).stop 2023-08-09T12:42:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 shutdown_connections 2023-08-09T12:42:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48c06a050 0x7fd48c06c510 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a8160640 0x7fd4a81f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a80cdb00 0x7fd4a81f1dc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 --2- 172.21.15.17:0/494198245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a80b0020 0x7fd4a80b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 >> 172.21.15.17:0/494198245 conn(0x7fd4a80cb020 msgr2=0x7fd4a80ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 shutdown_connections 2023-08-09T12:42:18.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.124+0000 7fd4ac84b640 1 -- 172.21.15.17:0/494198245 wait complete. 2023-08-09T12:42:18.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:42:18.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.373+0000 7f764ffff640 1 Processor -- start 2023-08-09T12:42:18.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.373+0000 7f764ffff640 1 -- start start 2023-08-09T12:42:18.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.374+0000 7f764ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f76500cd270 0x7f765006a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.374+0000 7f764ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76500d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.374+0000 7f764ffff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765006b170 con 0x7f76500b1d90 2023-08-09T12:42:18.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.374+0000 7f764ffff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765006a8d0 con 0x7f76500cd270 2023-08-09T12:42:18.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.374+0000 7f764ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765006abb0 con 0x7f76500d0ca0 2023-08-09T12:42:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.375+0000 7f764effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f76500cd270 0x7f765006a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.375+0000 7f764effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f76500cd270 0x7f765006a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54598/0 (socket says 172.21.15.17:54598) 2023-08-09T12:42:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.375+0000 7f764effd640 1 -- 172.21.15.17:0/702784505 learned_addr learned my addr 172.21.15.17:0/702784505 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.375+0000 7f764f7fe640 1 --2- 172.21.15.17:0/702784505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76500d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.375+0000 7f764effd640 1 -- 172.21.15.17:0/702784505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 msgr2=0x7f76500d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.375+0000 7f764effd640 1 --2- 172.21.15.17:0/702784505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76500d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.375+0000 7f764effd640 1 -- 172.21.15.17:0/702784505 >> v1:172.21.15.142:6789/0 conn(0x7f76500b1d90 legacy=0x7f76500cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.376+0000 7f764effd640 1 -- 172.21.15.17:0/702784505 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765006ae90 con 0x7f76500cd270 2023-08-09T12:42:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.377+0000 7f764effd640 1 --2- 172.21.15.17:0/702784505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500cd270 0x7f765006a1d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7640009870 tx=0x7f764002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bfb10e7f045733 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.377+0000 7f764e7fc640 1 -- 172.21.15.17:0/702784505 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640031640 con 0x7f76500cd270 2023-08-09T12:42:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.377+0000 7f764e7fc640 1 -- 172.21.15.17:0/702784505 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76400317a0 con 0x7f76500cd270 2023-08-09T12:42:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.377+0000 7f764e7fc640 1 -- 172.21.15.17:0/702784505 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640031b30 con 0x7f76500cd270 2023-08-09T12:42:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.378+0000 7f764ffff640 1 -- 172.21.15.17:0/702784505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500cd270 msgr2=0x7f765006a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.378+0000 7f764ffff640 1 --2- 172.21.15.17:0/702784505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500cd270 0x7f765006a1d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7640009870 tx=0x7f764002b8f0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.378+0000 7f764ffff640 1 -- 172.21.15.17:0/702784505 shutdown_connections 2023-08-09T12:42:18.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.378+0000 7f764ffff640 1 --2- 172.21.15.17:0/702784505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76500d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.378+0000 7f764ffff640 1 --2- 172.21.15.17:0/702784505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500cd270 0x7f765006a1d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.378+0000 7f764ffff640 1 -- 172.21.15.17:0/702784505 >> 172.21.15.17:0/702784505 conn(0x7f76500d2a10 msgr2=0x7f76500d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:18.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.378+0000 7f764ffff640 1 -- 172.21.15.17:0/702784505 shutdown_connections 2023-08-09T12:42:18.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.378+0000 7f764ffff640 1 -- 172.21.15.17:0/702784505 wait complete. 2023-08-09T12:42:18.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.380+0000 7f764ffff640 1 Processor -- start 2023-08-09T12:42:18.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.380+0000 7f764ffff640 1 -- start start 2023-08-09T12:42:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500b1d90 0x7f7650159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76500cd270 0x7f76501f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76501f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764ffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500aa760 con 0x7f76500b1d90 2023-08-09T12:42:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500a9e30 con 0x7f76500cd270 2023-08-09T12:42:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500aa110 con 0x7f76500d0ca0 2023-08-09T12:42:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500b1d90 0x7f7650159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500b1d90 0x7f7650159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54602/0 (socket says 172.21.15.17:54602) 2023-08-09T12:42:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764effd640 1 -- 172.21.15.17:0/3293711735 learned_addr learned my addr 172.21.15.17:0/3293711735 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:18.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764effd640 1 -- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 msgr2=0x7f76501f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.381+0000 7f764f7fe640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76501f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f7647fff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76500cd270 0x7f76501f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f764effd640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76501f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f764effd640 1 -- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76500cd270 msgr2=0x7f76501f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f764effd640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76500cd270 0x7f76501f5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f764effd640 1 -- 172.21.15.17:0/3293711735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76400094d0 con 0x7f76500b1d90 2023-08-09T12:42:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f764f7fe640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76501f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f764effd640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500b1d90 0x7f7650159d70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7640000c00 tx=0x7f76400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f76477fe640 1 -- 172.21.15.17:0/3293711735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764003ac60 con 0x7f76500b1d90 2023-08-09T12:42:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f76477fe640 1 -- 172.21.15.17:0/3293711735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764003adc0 con 0x7f76500b1d90 2023-08-09T12:42:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f76477fe640 1 -- 172.21.15.17:0/3293711735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640044630 con 0x7f76500b1d90 2023-08-09T12:42:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.382+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500aa3f0 con 0x7f76500b1d90 2023-08-09T12:42:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.383+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765015a870 con 0x7f76500b1d90 2023-08-09T12:42:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.384+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765004e390 con 0x7f76500b1d90 2023-08-09T12:42:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.385+0000 7f76477fe640 1 -- 172.21.15.17:0/3293711735 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f764002f050 con 0x7f76500b1d90 2023-08-09T12:42:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.386+0000 7f76477fe640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f763006a080 0x7f763006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.386+0000 7f76477fe640 1 -- 172.21.15.17:0/3293711735 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f76400aa4b0 con 0x7f76500b1d90 2023-08-09T12:42:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.386+0000 7f7647fff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f763006a080 0x7f763006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.387+0000 7f7647fff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f763006a080 0x7f763006c540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f76501f5f50 tx=0x7f7638009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.390+0000 7f76477fe640 1 -- 172.21.15.17:0/3293711735 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7640075ac0 con 0x7f76500b1d90 2023-08-09T12:42:18.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.582+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7650065820 con 0x7f76500b1d90 2023-08-09T12:42:18.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.583+0000 7f76477fe640 1 -- 172.21.15.17:0/3293711735 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7640031e60 con 0x7f76500b1d90 2023-08-09T12:42:18.586 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:42:18.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f763006a080 msgr2=0x7f763006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f763006a080 0x7f763006c540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f76501f5f50 tx=0x7f7638009040 comp rx=0 tx=0).stop 2023-08-09T12:42:18.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500b1d90 msgr2=0x7f7650159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500b1d90 0x7f7650159d70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7640000c00 tx=0x7f76400046c0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 shutdown_connections 2023-08-09T12:42:18.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f763006a080 0x7f763006c540 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76500d0ca0 0x7f76501f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76500cd270 0x7f76501f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 --2- 172.21.15.17:0/3293711735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76500b1d90 0x7f7650159d70 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.585+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 >> 172.21.15.17:0/3293711735 conn(0x7f76500d2a10 msgr2=0x7f76500cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:18.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.586+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 shutdown_connections 2023-08-09T12:42:18.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.586+0000 7f764ffff640 1 -- 172.21.15.17:0/3293711735 wait complete. 2023-08-09T12:42:18.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:42:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.836+0000 7fcea9f99640 1 Processor -- start 2023-08-09T12:42:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.837+0000 7fcea9f99640 1 -- start start 2023-08-09T12:42:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.838+0000 7fcea9f99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea40adc40 0x7fcea406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.838+0000 7fcea9f99640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcea40cc630 0x7fcea40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.838+0000 7fcea9f99640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea40b2250 con 0x7fcea40b3b40 2023-08-09T12:42:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.838+0000 7fcea9f99640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea40ae020 con 0x7fcea40cc630 2023-08-09T12:42:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.838+0000 7fcea9f99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40b2530 con 0x7fcea40adc40 2023-08-09T12:42:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.839+0000 7fce9affd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcea40b3b40 0x7fcea40b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48382/0 (socket says 172.21.15.17:48382) 2023-08-09T12:42:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.839+0000 7fce9affd640 1 -- 172.21.15.17:0/1753345120 learned_addr learned my addr 172.21.15.17:0/1753345120 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:18.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.839+0000 7fcea37fe640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea40adc40 0x7fcea406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.839+0000 7fcea3fff640 1 --2- 172.21.15.17:0/1753345120 >> v2:172.21.15.142:3300/0 conn(0x7fcea40cc630 0x7fcea40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.839+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867480187 0 0) 0x7fcea40b2250 con 0x7fcea40b3b40 2023-08-09T12:42:18.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.839+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce90003520 con 0x7fcea40b3b40 2023-08-09T12:42:18.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018455657 0 0) 0x7fce90003520 con 0x7fcea40b3b40 2023-08-09T12:42:18.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea40adc40 msgr2=0x7fcea406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:18.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea40adc40 0x7fcea406c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 >> v2:172.21.15.142:3300/0 conn(0x7fcea40cc630 msgr2=0x7fcea40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:18.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 --2- 172.21.15.17:0/1753345120 >> v2:172.21.15.142:3300/0 conn(0x7fcea40cc630 0x7fcea40ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea406fe80 con 0x7fcea40b3b40 2023-08-09T12:42:18.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fce8c0017f0 con 0x7fcea40b3b40 2023-08-09T12:42:18.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 >> v1:172.21.15.17:6789/0 conn(0x7fcea40b3b40 legacy=0x7fcea40b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea40adc40 0x7fce90003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90003ef0 0x7fce900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90004d00 0x7fce90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40ae020 con 0x7fce90003ef0 2023-08-09T12:42:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40b2530 con 0x7fce90004d00 2023-08-09T12:42:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9000b980 con 0x7fcea40adc40 2023-08-09T12:42:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fce9affd640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90003ef0 0x7fce900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea37fe640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea40adc40 0x7fce90003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fcea3fff640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90004d00 0x7fce90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.840+0000 7fce9affd640 1 -- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea40adc40 msgr2=0x7fce90003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.841+0000 7fce9affd640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea40adc40 0x7fce90003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.841+0000 7fce9affd640 1 -- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90004d00 msgr2=0x7fce90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.841+0000 7fce9affd640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90004d00 0x7fce90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.841+0000 7fce9affd640 1 -- 172.21.15.17:0/1753345120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90003520 con 0x7fce90003ef0 2023-08-09T12:42:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.841+0000 7fcea3fff640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90004d00 0x7fce90005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.842+0000 7fce9affd640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90003ef0 0x7fce900047c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c240 tx=0x7fce900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1189af9786a79bef server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.842+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c02cae0 con 0x7fce90003ef0 2023-08-09T12:42:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.842+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c02cc60 con 0x7fce90003ef0 2023-08-09T12:42:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.842+0000 7fcea2ffd640 1 -- 172.21.15.17:0/1753345120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c0072b0 con 0x7fce90003ef0 2023-08-09T12:42:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.842+0000 7fcea9f99640 1 -- 172.21.15.17:0/1753345120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90003ef0 msgr2=0x7fce900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.842+0000 7fcea9f99640 1 --2- 172.21.15.17:0/1753345120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90003ef0 0x7fce900047c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c240 tx=0x7fce900057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.843+0000 7fcea3fff640 1 -- 172.21.15.17:0/1753345120 reap_dead start 2023-08-09T12:42:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.843+0000 7fcea9f99640 1 -- 172.21.15.17:0/1753345120 shutdown_connections 2023-08-09T12:42:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.843+0000 7fcea9f99640 1 -- 172.21.15.17:0/1753345120 >> 172.21.15.17:0/1753345120 conn(0x7fcea40cb1b0 msgr2=0x7fcea40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.843+0000 7fcea9f99640 1 -- 172.21.15.17:0/1753345120 shutdown_connections 2023-08-09T12:42:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.843+0000 7fcea9f99640 1 -- 172.21.15.17:0/1753345120 wait complete. 2023-08-09T12:42:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.845+0000 7fcea9f99640 1 Processor -- start 2023-08-09T12:42:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.845+0000 7fcea9f99640 1 -- start start 2023-08-09T12:42:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea9f99640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90003ef0 0x7fcea4158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea9f99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea41499e0 0x7fcea40c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea9f99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea4149e60 0x7fcea406b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea9f99640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40c5090 con 0x7fcea4149e60 2023-08-09T12:42:18.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea9f99640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4158980 con 0x7fce90003ef0 2023-08-09T12:42:18.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea9f99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40c4db0 con 0x7fcea41499e0 2023-08-09T12:42:18.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea4149e60 0x7fcea406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea4149e60 0x7fcea406b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54620/0 (socket says 172.21.15.17:54620) 2023-08-09T12:42:18.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea3fff640 1 -- 172.21.15.17:0/1681602684 learned_addr learned my addr 172.21.15.17:0/1681602684 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:18.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fcea37fe640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90003ef0 0x7fcea4158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.846+0000 7fce9affd640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea41499e0 0x7fcea40c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea3fff640 1 -- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea41499e0 msgr2=0x7fcea40c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea3fff640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea41499e0 0x7fcea40c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea3fff640 1 -- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90003ef0 msgr2=0x7fcea4158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea3fff640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90003ef0 0x7fcea4158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea3fff640 1 -- 172.21.15.17:0/1681602684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4157960 con 0x7fcea4149e60 2023-08-09T12:42:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fce9affd640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea41499e0 0x7fcea40c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea3fff640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea4149e60 0x7fcea406b290 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcea40cca10 tx=0x7fce9c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea0ff9640 1 -- 172.21.15.17:0/1681602684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c016620 con 0x7fcea4149e60 2023-08-09T12:42:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea0ff9640 1 -- 172.21.15.17:0/1681602684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c016780 con 0x7fcea4149e60 2023-08-09T12:42:18.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea0ff9640 1 -- 172.21.15.17:0/1681602684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c016b10 con 0x7fcea4149e60 2023-08-09T12:42:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea4157c40 con 0x7fcea4149e60 2023-08-09T12:42:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.847+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea4156fa0 con 0x7fcea4149e60 2023-08-09T12:42:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.849+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea41577c0 con 0x7fcea4149e60 2023-08-09T12:42:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.849+0000 7fcea0ff9640 1 -- 172.21.15.17:0/1681602684 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce9c016c70 con 0x7fcea4149e60 2023-08-09T12:42:18.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.850+0000 7fcea0ff9640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8406a050 0x7fce8406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:18.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.850+0000 7fcea0ff9640 1 -- 172.21.15.17:0/1681602684 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fce9c089450 con 0x7fcea4149e60 2023-08-09T12:42:18.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.851+0000 7fcea37fe640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8406a050 0x7fce8406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:18.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.852+0000 7fcea37fe640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8406a050 0x7fce8406c510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcea4158dd0 tx=0x7fce94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:18.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:18.855+0000 7fcea0ff9640 1 -- 172.21.15.17:0/1681602684 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcea41577c0 con 0x7fcea4149e60 2023-08-09T12:42:19.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.043+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcea4158160 con 0x7fcea4149e60 2023-08-09T12:42:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.044+0000 7fcea0ff9640 1 -- 172.21.15.17:0/1681602684 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcea4158160 con 0x7fcea4149e60 2023-08-09T12:42:19.047 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:42:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8406a050 msgr2=0x7fce8406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8406a050 0x7fce8406c510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcea4158dd0 tx=0x7fce94008040 comp rx=0 tx=0).stop 2023-08-09T12:42:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea4149e60 msgr2=0x7fcea406b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea4149e60 0x7fcea406b290 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcea40cca10 tx=0x7fce9c00f520 comp rx=0 tx=0).stop 2023-08-09T12:42:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 shutdown_connections 2023-08-09T12:42:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8406a050 0x7fce8406c510 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea4149e60 0x7fcea406b290 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea41499e0 0x7fcea40c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 --2- 172.21.15.17:0/1681602684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce90003ef0 0x7fcea4158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 >> 172.21.15.17:0/1681602684 conn(0x7fcea40cb1b0 msgr2=0x7fcea40ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.046+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 shutdown_connections 2023-08-09T12:42:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.047+0000 7fcea9f99640 1 -- 172.21.15.17:0/1681602684 wait complete. 2023-08-09T12:42:19.067 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:19.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.280+0000 7f5883c4d640 1 Processor -- start 2023-08-09T12:42:19.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.280+0000 7f5883c4d640 1 -- start start 2023-08-09T12:42:19.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.282+0000 7f5883c4d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.282+0000 7f5883c4d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c06c990 con 0x7f587c0cc630 2023-08-09T12:42:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.282+0000 7f5883c4d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0b2250 con 0x7f587c0adc40 2023-08-09T12:42:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.282+0000 7f5883c4d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0ae020 con 0x7f587c0b3b40 2023-08-09T12:42:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.282+0000 7f58821ea640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f587c0cc630 0x7f587c0ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48396/0 (socket says 172.21.15.17:48396) 2023-08-09T12:42:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.282+0000 7f58821ea640 1 -- 172.21.15.17:0/746433192 learned_addr learned my addr 172.21.15.17:0/746433192 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:19.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.283+0000 7f58811e8640 1 --2- 172.21.15.17:0/746433192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.283+0000 7f58809e7640 1 -- 172.21.15.17:0/746433192 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625140372 0 0) 0x7f587c06c990 con 0x7f587c0cc630 2023-08-09T12:42:19.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.283+0000 7f58809e7640 1 -- 172.21.15.17:0/746433192 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5868003520 con 0x7f587c0cc630 2023-08-09T12:42:19.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.283+0000 7f58811e8640 1 -- 172.21.15.17:0/746433192 >> v1:172.21.15.142:6789/0 conn(0x7f587c0adc40 legacy=0x7f587c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.284+0000 7f58811e8640 1 -- 172.21.15.17:0/746433192 >> v1:172.21.15.17:6789/0 conn(0x7f587c0cc630 legacy=0x7f587c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.283+0000 7f58809e7640 1 -- 172.21.15.17:0/746433192 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515573020 0 0) 0x7f587c0b2250 con 0x7f587c0adc40 2023-08-09T12:42:19.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.284+0000 7f58811e8640 1 -- 172.21.15.17:0/746433192 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0b2530 con 0x7f587c0b3b40 2023-08-09T12:42:19.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.285+0000 7f58811e8640 1 --2- 172.21.15.17:0/746433192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0b3fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f586c0097c0 tx=0x7f586c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec323cb7fb9b799a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:19.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.285+0000 7f58809e7640 1 -- 172.21.15.17:0/746433192 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c030800 con 0x7f587c0b3b40 2023-08-09T12:42:19.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f58809e7640 1 -- 172.21.15.17:0/746433192 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c030960 con 0x7f587c0b3b40 2023-08-09T12:42:19.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f58809e7640 1 -- 172.21.15.17:0/746433192 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c030cd0 con 0x7f587c0b3b40 2023-08-09T12:42:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f5883c4d640 1 -- 172.21.15.17:0/746433192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 msgr2=0x7f587c0b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f5883c4d640 1 --2- 172.21.15.17:0/746433192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0b3fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f586c0097c0 tx=0x7f586c02b940 comp rx=0 tx=0).stop 2023-08-09T12:42:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f5883c4d640 1 -- 172.21.15.17:0/746433192 shutdown_connections 2023-08-09T12:42:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f5883c4d640 1 --2- 172.21.15.17:0/746433192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0b3fa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f5883c4d640 1 -- 172.21.15.17:0/746433192 >> 172.21.15.17:0/746433192 conn(0x7f587c0cb1b0 msgr2=0x7f587c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f5883c4d640 1 -- 172.21.15.17:0/746433192 shutdown_connections 2023-08-09T12:42:19.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.286+0000 7f5883c4d640 1 -- 172.21.15.17:0/746433192 wait complete. 2023-08-09T12:42:19.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.288+0000 7f5883c4d640 1 Processor -- start 2023-08-09T12:42:19.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.288+0000 7f5883c4d640 1 -- start start 2023-08-09T12:42:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.289+0000 7f5883c4d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f587c0adc40 0x7f587c156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.289+0000 7f5883c4d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.289+0000 7f5883c4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587c0cc630 0x7f587c0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.289+0000 7f5883c4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0c3cc0 con 0x7f587c0cc630 2023-08-09T12:42:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.289+0000 7f5883c4d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0c2c20 con 0x7f587c0adc40 2023-08-09T12:42:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.289+0000 7f5883c4d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0c2f00 con 0x7f587c0b3b40 2023-08-09T12:42:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58821ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587c0cc630 0x7f587c0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58821ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587c0cc630 0x7f587c0c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54622/0 (socket says 172.21.15.17:54622) 2023-08-09T12:42:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58821ea640 1 -- 172.21.15.17:0/2109202341 learned_addr learned my addr 172.21.15.17:0/2109202341 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58811e8640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58819e9640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f587c0adc40 0x7f587c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58821ea640 1 -- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 msgr2=0x7f587c0c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58821ea640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58821ea640 1 -- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f587c0adc40 msgr2=0x7f587c156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58821ea640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f587c0adc40 0x7f587c156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.290+0000 7f58821ea640 1 -- 172.21.15.17:0/2109202341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c0093a0 con 0x7f587c0cc630 2023-08-09T12:42:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.291+0000 7f58821ea640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587c0cc630 0x7f587c0c4670 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f587400caa0 tx=0x7f587400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.291+0000 7f58727fc640 1 -- 172.21.15.17:0/2109202341 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400ac00 con 0x7f587c0cc630 2023-08-09T12:42:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.291+0000 7f58727fc640 1 -- 172.21.15.17:0/2109202341 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400ad60 con 0x7f587c0cc630 2023-08-09T12:42:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.291+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0c31e0 con 0x7f587c0cc630 2023-08-09T12:42:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.291+0000 7f58727fc640 1 -- 172.21.15.17:0/2109202341 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874012620 con 0x7f587c0cc630 2023-08-09T12:42:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.291+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c0c37a0 con 0x7f587c0cc630 2023-08-09T12:42:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.292+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c067a80 con 0x7f587c0cc630 2023-08-09T12:42:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.293+0000 7f58727fc640 1 -- 172.21.15.17:0/2109202341 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5874007070 con 0x7f587c0cc630 2023-08-09T12:42:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.294+0000 7f58727fc640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f586006a050 0x7f586006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.294+0000 7f58727fc640 1 -- 172.21.15.17:0/2109202341 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5874088580 con 0x7f587c0cc630 2023-08-09T12:42:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.295+0000 7f58819e9640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f586006a050 0x7f586006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.296+0000 7f58819e9640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f586006a050 0x7f586006c510 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5878000f60 tx=0x7f5878009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:19.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.299+0000 7f58727fc640 1 -- 172.21.15.17:0/2109202341 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5874053c20 con 0x7f587c0cc630 2023-08-09T12:42:19.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.526+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f587c0c3990 con 0x7f587c0cc630 2023-08-09T12:42:19.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.527+0000 7f58727fc640 1 -- 172.21.15.17:0/2109202341 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f5874057240 con 0x7f587c0cc630 2023-08-09T12:42:19.531 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:19.531 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:42:19.531 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:42:19.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f586006a050 msgr2=0x7f586006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f586006a050 0x7f586006c510 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5878000f60 tx=0x7f5878009040 comp rx=0 tx=0).stop 2023-08-09T12:42:19.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587c0cc630 msgr2=0x7f587c0c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587c0cc630 0x7f587c0c4670 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f587400caa0 tx=0x7f587400cf60 comp rx=0 tx=0).stop 2023-08-09T12:42:19.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 shutdown_connections 2023-08-09T12:42:19.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f586006a050 0x7f586006c510 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587c0cc630 0x7f587c0c4670 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f587c0b3b40 0x7f587c0c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 --2- 172.21.15.17:0/2109202341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f587c0adc40 0x7f587c156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 >> 172.21.15.17:0/2109202341 conn(0x7f587c0cb1b0 msgr2=0x7f587c0cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 shutdown_connections 2023-08-09T12:42:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.530+0000 7f5883c4d640 1 -- 172.21.15.17:0/2109202341 wait complete. 2023-08-09T12:42:19.553 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:19.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.767+0000 7f2299c39640 1 Processor -- start 2023-08-09T12:42:19.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.767+0000 7f2299c39640 1 -- start start 2023-08-09T12:42:19.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.768+0000 7f2299c39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2294160030 0x7f2294160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.768+0000 7f2299c39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f22940b86e0 0x7f22940cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.768+0000 7f2299c39640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940b5a30 con 0x7f22940cf980 2023-08-09T12:42:19.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.769+0000 7f2299c39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940d1110 con 0x7f22940b86e0 2023-08-09T12:42:19.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.769+0000 7f2299c39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940ceac0 con 0x7f2294160030 2023-08-09T12:42:19.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.769+0000 7f2299438640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f22940cf980 0x7f22940b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48402/0 (socket says 172.21.15.17:48402) 2023-08-09T12:42:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.769+0000 7f2299438640 1 -- 172.21.15.17:0/3986206395 learned_addr learned my addr 172.21.15.17:0/3986206395 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.769+0000 7f2298c37640 1 --2- 172.21.15.17:0/3986206395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2294160030 0x7f2294160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.769+0000 7f228bfff640 1 --2- 172.21.15.17:0/3986206395 >> v2:172.21.15.142:3300/0 conn(0x7f22940b86e0 0x7f22940cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.770+0000 7f228b7fe640 1 -- 172.21.15.17:0/3986206395 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826667556 0 0) 0x7f22940b5a30 con 0x7f22940cf980 2023-08-09T12:42:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.770+0000 7f228b7fe640 1 -- 172.21.15.17:0/3986206395 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f227c003520 con 0x7f22940cf980 2023-08-09T12:42:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.770+0000 7f2298c37640 1 -- 172.21.15.17:0/3986206395 >> v2:172.21.15.142:3300/0 conn(0x7f22940b86e0 msgr2=0x7f22940cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:19.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.770+0000 7f2298c37640 1 --2- 172.21.15.17:0/3986206395 >> v2:172.21.15.142:3300/0 conn(0x7f22940b86e0 0x7f22940cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.770+0000 7f2298c37640 1 -- 172.21.15.17:0/3986206395 >> v1:172.21.15.17:6789/0 conn(0x7f22940cf980 legacy=0x7f22940b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.770+0000 7f228b7fe640 1 -- 172.21.15.17:0/3986206395 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4220290417 0 0) 0x7f227c003520 con 0x7f22940cf980 2023-08-09T12:42:19.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.770+0000 7f2298c37640 1 -- 172.21.15.17:0/3986206395 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940d0d70 con 0x7f2294160030 2023-08-09T12:42:19.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.772+0000 7f2298c37640 1 --2- 172.21.15.17:0/3986206395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2294160030 0x7f2294160740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22900097a0 tx=0x7f229002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=590c39dc7f25f12d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:19.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.772+0000 7f228b7fe640 1 -- 172.21.15.17:0/3986206395 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0019f0 con 0x7f2294160030 2023-08-09T12:42:19.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.772+0000 7f228b7fe640 1 -- 172.21.15.17:0/3986206395 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229002e050 con 0x7f2294160030 2023-08-09T12:42:19.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.772+0000 7f228b7fe640 1 -- 172.21.15.17:0/3986206395 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290030730 con 0x7f2294160030 2023-08-09T12:42:19.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.773+0000 7f2299c39640 1 -- 172.21.15.17:0/3986206395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2294160030 msgr2=0x7f2294160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.773+0000 7f2299c39640 1 --2- 172.21.15.17:0/3986206395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2294160030 0x7f2294160740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22900097a0 tx=0x7f229002b790 comp rx=0 tx=0).stop 2023-08-09T12:42:19.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.773+0000 7f2299c39640 1 -- 172.21.15.17:0/3986206395 shutdown_connections 2023-08-09T12:42:19.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.773+0000 7f2299c39640 1 --2- 172.21.15.17:0/3986206395 >> v2:172.21.15.142:3300/0 conn(0x7f22940b86e0 0x7f22940cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.773+0000 7f2299c39640 1 --2- 172.21.15.17:0/3986206395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2294160030 0x7f2294160740 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.773+0000 7f2299c39640 1 -- 172.21.15.17:0/3986206395 >> 172.21.15.17:0/3986206395 conn(0x7f22940697c0 msgr2=0x7f2294069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:19.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.773+0000 7f2299c39640 1 -- 172.21.15.17:0/3986206395 shutdown_connections 2023-08-09T12:42:19.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.773+0000 7f2299c39640 1 -- 172.21.15.17:0/3986206395 wait complete. 2023-08-09T12:42:19.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.775+0000 7f2299c39640 1 Processor -- start 2023-08-09T12:42:19.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.775+0000 7f2299c39640 1 -- start start 2023-08-09T12:42:19.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.776+0000 7f2299c39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22940b86e0 0x7f2294150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.776+0000 7f2299c39640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22940cf980 0x7f22941517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.776+0000 7f2299c39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2294160030 0x7f229415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.776+0000 7f2299c39640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22941f3540 con 0x7f22940cf980 2023-08-09T12:42:19.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.776+0000 7f2299c39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294152ae0 con 0x7f2294160030 2023-08-09T12:42:19.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.776+0000 7f2299c39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294152240 con 0x7f22940b86e0 2023-08-09T12:42:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.776+0000 7f228bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22940cf980 0x7f22941517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f228bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22940cf980 0x7f22941517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54628/0 (socket says 172.21.15.17:54628) 2023-08-09T12:42:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f228bfff640 1 -- 172.21.15.17:0/253871964 learned_addr learned my addr 172.21.15.17:0/253871964 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f2298c37640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22940b86e0 0x7f2294150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f2299438640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2294160030 0x7f229415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f228bfff640 1 -- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22940b86e0 msgr2=0x7f2294150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f228bfff640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22940b86e0 0x7f2294150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f228bfff640 1 -- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2294160030 msgr2=0x7f229415c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f228bfff640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2294160030 0x7f229415c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f228bfff640 1 -- 172.21.15.17:0/253871964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290009400 con 0x7f22940cf980 2023-08-09T12:42:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f2298c37640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22940b86e0 0x7f2294150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.777+0000 7f228bfff640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22940cf980 0x7f22941517a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f228400e9b0 tx=0x7f228400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.778+0000 7f22897fa640 1 -- 172.21.15.17:0/253871964 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284009670 con 0x7f22940cf980 2023-08-09T12:42:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.778+0000 7f22897fa640 1 -- 172.21.15.17:0/253871964 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228400c9a0 con 0x7f22940cf980 2023-08-09T12:42:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.778+0000 7f22897fa640 1 -- 172.21.15.17:0/253871964 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400cd50 con 0x7f22940cf980 2023-08-09T12:42:19.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.778+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2294152520 con 0x7f22940cf980 2023-08-09T12:42:19.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.778+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22941514a0 con 0x7f22940cf980 2023-08-09T12:42:19.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.779+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22941f36f0 con 0x7f22940cf980 2023-08-09T12:42:19.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.780+0000 7f22897fa640 1 -- 172.21.15.17:0/253871964 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2284013470 con 0x7f22940cf980 2023-08-09T12:42:19.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.781+0000 7f22897fa640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228006a080 0x7f228006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:19.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.781+0000 7f22897fa640 1 -- 172.21.15.17:0/253871964 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2284088850 con 0x7f22940cf980 2023-08-09T12:42:19.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.782+0000 7f2298c37640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228006a080 0x7f228006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:19.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.783+0000 7f2298c37640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228006a080 0x7f228006c540 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2290034000 tx=0x7f229002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:19.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.786+0000 7f22897fa640 1 -- 172.21.15.17:0/253871964 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2284053e70 con 0x7f22940cf980 2023-08-09T12:42:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.979+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f229404e390 con 0x7f22940cf980 2023-08-09T12:42:19.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.982+0000 7f22897fa640 1 -- 172.21.15.17:0/253871964 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+18422 (secure 0 0 0) 0x7f2284057490 con 0x7f22940cf980 2023-08-09T12:42:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:11.769329+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:41:23.866427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-09T12:41:25.245820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228006a080 msgr2=0x7f228006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228006a080 0x7f228006c540 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2290034000 tx=0x7f229002f000 comp rx=0 tx=0).stop 2023-08-09T12:42:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22940cf980 msgr2=0x7f22941517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22940cf980 0x7f22941517a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f228400e9b0 tx=0x7f228400ee70 comp rx=0 tx=0).stop 2023-08-09T12:42:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 shutdown_connections 2023-08-09T12:42:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228006a080 0x7f228006c540 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2294160030 0x7f229415c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22940cf980 0x7f22941517a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 --2- 172.21.15.17:0/253871964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22940b86e0 0x7f2294150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 >> 172.21.15.17:0/253871964 conn(0x7f22940697c0 msgr2=0x7f22940c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.984+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 shutdown_connections 2023-08-09T12:42:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:19.985+0000 7f2299c39640 1 -- 172.21.15.17:0/253871964 wait complete. 2023-08-09T12:42:20.007 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:42:20.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.231+0000 7fa89b59e640 1 Processor -- start 2023-08-09T12:42:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.231+0000 7fa89b59e640 1 -- start start 2023-08-09T12:42:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.233+0000 7fa89b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0b3fe0 0x7fa89c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.233+0000 7fa89b59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c06fe10 con 0x7fa89c0697c0 2023-08-09T12:42:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.233+0000 7fa89b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c159fb0 con 0x7fa89c159bd0 2023-08-09T12:42:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.233+0000 7fa89b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0b11a0 con 0x7fa89c0b3fe0 2023-08-09T12:42:20.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.233+0000 7fa89ad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa89c0697c0 0x7fa89c0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48416/0 (socket says 172.21.15.17:48416) 2023-08-09T12:42:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.233+0000 7fa89ad9d640 1 -- 172.21.15.17:0/756408641 learned_addr learned my addr 172.21.15.17:0/756408641 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa891d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0b3fe0 0x7fa89c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602060862 0 0) 0x7fa89c06fe10 con 0x7fa89c0697c0 2023-08-09T12:42:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa888003520 con 0x7fa89c0697c0 2023-08-09T12:42:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3324602902 0 0) 0x7fa888003520 con 0x7fa89c0697c0 2023-08-09T12:42:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0b3fe0 msgr2=0x7fa89c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0b3fe0 0x7fa89c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 >> v1:172.21.15.142:6789/0 conn(0x7fa89c159bd0 legacy=0x7fa89c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c070970 con 0x7fa89c0697c0 2023-08-09T12:42:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa894001670 con 0x7fa89c0697c0 2023-08-09T12:42:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 >> v1:172.21.15.17:6789/0 conn(0x7fa89c0697c0 legacy=0x7fa89c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0b3fe0 0x7fa8880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa8880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa888004d00 0x7fa888005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0b11a0 con 0x7fa888003f20 2023-08-09T12:42:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88800bb10 con 0x7fa888004d00 2023-08-09T12:42:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.234+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88800bcd0 con 0x7fa89c0b3fe0 2023-08-09T12:42:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.235+0000 7fa891d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa8880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.235+0000 7fa89a59c640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0b3fe0 0x7fa8880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.235+0000 7fa891d9b640 1 -- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0b3fe0 msgr2=0x7fa8880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:20.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.235+0000 7fa891d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0b3fe0 0x7fa8880039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.235+0000 7fa891d9b640 1 -- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa888004d00 msgr2=0x7fa888005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:20.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.235+0000 7fa891d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa888004d00 0x7fa888005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.235+0000 7fa891d9b640 1 -- 172.21.15.17:0/756408641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888003520 con 0x7fa888003f20 2023-08-09T12:42:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.236+0000 7fa891d9b640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa8880047c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa884009650 tx=0x7fa8880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74359a7305c0e37 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88402e8c0 con 0x7fa888003f20 2023-08-09T12:42:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88402ea20 con 0x7fa888003f20 2023-08-09T12:42:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa899d9b640 1 -- 172.21.15.17:0/756408641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88402edb0 con 0x7fa888003f20 2023-08-09T12:42:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa89b59e640 1 -- 172.21.15.17:0/756408641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 msgr2=0x7fa8880047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa89b59e640 1 --2- 172.21.15.17:0/756408641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa8880047c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa884009650 tx=0x7fa8880057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa89ad9d640 1 -- 172.21.15.17:0/756408641 reap_dead start 2023-08-09T12:42:20.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa89b59e640 1 -- 172.21.15.17:0/756408641 shutdown_connections 2023-08-09T12:42:20.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa89b59e640 1 -- 172.21.15.17:0/756408641 >> 172.21.15.17:0/756408641 conn(0x7fa89c0b1d50 msgr2=0x7fa89c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:20.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa89b59e640 1 -- 172.21.15.17:0/756408641 shutdown_connections 2023-08-09T12:42:20.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.237+0000 7fa89b59e640 1 -- 172.21.15.17:0/756408641 wait complete. 2023-08-09T12:42:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.239+0000 7fa89b59e640 1 Processor -- start 2023-08-09T12:42:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.239+0000 7fa89b59e640 1 -- start start 2023-08-09T12:42:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.240+0000 7fa89b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa89c1f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.240+0000 7fa89b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c1f5ef0 0x7fa89c0c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.240+0000 7fa89b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0c3480 0x7fa89c1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f6370 con 0x7fa888003f20 2023-08-09T12:42:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f3a00 con 0x7fa89c1f5ef0 2023-08-09T12:42:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0c4280 con 0x7fa89c0c3480 2023-08-09T12:42:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa89c1f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa89c1f59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54646/0 (socket says 172.21.15.17:54646) 2023-08-09T12:42:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89a59c640 1 -- 172.21.15.17:0/2873030324 learned_addr learned my addr 172.21.15.17:0/2873030324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89ad9d640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0c3480 0x7fa89c1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa891d9b640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c1f5ef0 0x7fa89c0c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89a59c640 1 -- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0c3480 msgr2=0x7fa89c1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89a59c640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0c3480 0x7fa89c1532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89a59c640 1 -- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c1f5ef0 msgr2=0x7fa89c0c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89a59c640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c1f5ef0 0x7fa89c0c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89a59c640 1 -- 172.21.15.17:0/2873030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0c3cc0 con 0x7fa888003f20 2023-08-09T12:42:20.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa89ad9d640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0c3480 0x7fa89c1532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:20.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.241+0000 7fa891d9b640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c1f5ef0 0x7fa89c0c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:20.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.242+0000 7fa89a59c640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa89c1f59b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00e840 tx=0x7fa88c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:20.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.242+0000 7fa8937fe640 1 -- 172.21.15.17:0/2873030324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c003b80 con 0x7fa888003f20 2023-08-09T12:42:20.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.242+0000 7fa8937fe640 1 -- 172.21.15.17:0/2873030324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c003ce0 con 0x7fa888003f20 2023-08-09T12:42:20.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.242+0000 7fa8937fe640 1 -- 172.21.15.17:0/2873030324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0052f0 con 0x7fa888003f20 2023-08-09T12:42:20.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.242+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c0c3fa0 con 0x7fa888003f20 2023-08-09T12:42:20.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.242+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c0c3900 con 0x7fa888003f20 2023-08-09T12:42:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.243+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c1f34d0 con 0x7fa888003f20 2023-08-09T12:42:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.244+0000 7fa8937fe640 1 -- 172.21.15.17:0/2873030324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa88c005450 con 0x7fa888003f20 2023-08-09T12:42:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.245+0000 7fa8937fe640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa87c06a080 0x7fa87c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.245+0000 7fa8937fe640 1 -- 172.21.15.17:0/2873030324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa88c088590 con 0x7fa888003f20 2023-08-09T12:42:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.246+0000 7fa891d9b640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa87c06a080 0x7fa87c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.247+0000 7fa891d9b640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa87c06a080 0x7fa87c06c540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0c6ab0 tx=0x7fa884032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.250+0000 7fa8937fe640 1 -- 172.21.15.17:0/2873030324 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa88c057630 con 0x7fa888003f20 2023-08-09T12:42:20.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.482+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa89c159fb0 con 0x7fa888003f20 2023-08-09T12:42:20.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.483+0000 7fa8937fe640 1 -- 172.21.15.17:0/2873030324 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7fa89c159fb0 con 0x7fa888003f20 2023-08-09T12:42:20.486 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:20.486 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:42:20.487 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:42:20.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa87c06a080 msgr2=0x7fa87c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa87c06a080 0x7fa87c06c540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0c6ab0 tx=0x7fa884032000 comp rx=0 tx=0).stop 2023-08-09T12:42:20.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 msgr2=0x7fa89c1f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa89c1f59b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00e840 tx=0x7fa88c00ed00 comp rx=0 tx=0).stop 2023-08-09T12:42:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 shutdown_connections 2023-08-09T12:42:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa87c06a080 0x7fa87c06c540 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89c0c3480 0x7fa89c1532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa89c1f5ef0 0x7fa89c0c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 --2- 172.21.15.17:0/2873030324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa888003f20 0x7fa89c1f59b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 >> 172.21.15.17:0/2873030324 conn(0x7fa89c0b1d50 msgr2=0x7fa89c0c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 shutdown_connections 2023-08-09T12:42:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.486+0000 7fa89b59e640 1 -- 172.21.15.17:0/2873030324 wait complete. 2023-08-09T12:42:20.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:20.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.739+0000 7f54efc8e640 1 Processor -- start 2023-08-09T12:42:20.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.740+0000 7f54efc8e640 1 -- start start 2023-08-09T12:42:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.741+0000 7f54efc8e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f54e80adc40 0x7f54e806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.741+0000 7f54efc8e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e80b2250 con 0x7f54e80b3b40 2023-08-09T12:42:20.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.741+0000 7f54efc8e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e80b2530 con 0x7f54e80cc630 2023-08-09T12:42:20.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.741+0000 7f54efc8e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e80ae020 con 0x7f54e80adc40 2023-08-09T12:42:20.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.742+0000 7f54eda2a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f54e80adc40 0x7f54e806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.742+0000 7f54eda2a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f54e80adc40 0x7f54e806c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54654/0 (socket says 172.21.15.17:54654) 2023-08-09T12:42:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.742+0000 7f54eda2a640 1 -- 172.21.15.17:0/3158610042 learned_addr learned my addr 172.21.15.17:0/3158610042 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.742+0000 7f54eda2a640 1 -- 172.21.15.17:0/3158610042 >> v1:172.21.15.142:6789/0 conn(0x7f54e80cc630 legacy=0x7f54e80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.742+0000 7f54eda2a640 1 -- 172.21.15.17:0/3158610042 >> v1:172.21.15.17:6789/0 conn(0x7f54e80b3b40 legacy=0x7f54e80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.742+0000 7f54eda2a640 1 -- 172.21.15.17:0/3158610042 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e806fe80 con 0x7f54e80adc40 2023-08-09T12:42:20.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.743+0000 7f54eda2a640 1 --2- 172.21.15.17:0/3158610042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80adc40 0x7f54e806c280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009870 tx=0x7f54e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152207d305d79352 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:20.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.744+0000 7f54eca28640 1 -- 172.21.15.17:0/3158610042 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4031870 con 0x7f54e80adc40 2023-08-09T12:42:20.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.744+0000 7f54eca28640 1 -- 172.21.15.17:0/3158610042 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e40319d0 con 0x7f54e80adc40 2023-08-09T12:42:20.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.744+0000 7f54eca28640 1 -- 172.21.15.17:0/3158610042 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4031d60 con 0x7f54e80adc40 2023-08-09T12:42:20.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.744+0000 7f54efc8e640 1 -- 172.21.15.17:0/3158610042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80adc40 msgr2=0x7f54e806c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.744+0000 7f54efc8e640 1 --2- 172.21.15.17:0/3158610042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80adc40 0x7f54e806c280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009870 tx=0x7f54e402b910 comp rx=0 tx=0).stop 2023-08-09T12:42:20.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.745+0000 7f54efc8e640 1 -- 172.21.15.17:0/3158610042 shutdown_connections 2023-08-09T12:42:20.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.745+0000 7f54efc8e640 1 --2- 172.21.15.17:0/3158610042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80adc40 0x7f54e806c280 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.745+0000 7f54efc8e640 1 -- 172.21.15.17:0/3158610042 >> 172.21.15.17:0/3158610042 conn(0x7f54e80cb1b0 msgr2=0x7f54e80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:20.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.745+0000 7f54efc8e640 1 -- 172.21.15.17:0/3158610042 shutdown_connections 2023-08-09T12:42:20.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.745+0000 7f54efc8e640 1 -- 172.21.15.17:0/3158610042 wait complete. 2023-08-09T12:42:20.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.747+0000 7f54efc8e640 1 Processor -- start 2023-08-09T12:42:20.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.747+0000 7f54efc8e640 1 -- start start 2023-08-09T12:42:20.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54efc8e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e80adc40 0x7f54e80c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54efc8e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e80b3b40 0x7f54e80c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54efc8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80cc630 0x7f54e8149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54efc8e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80c3430 con 0x7f54e80cc630 2023-08-09T12:42:20.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54efc8e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80c3d90 con 0x7f54e80b3b40 2023-08-09T12:42:20.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54efc8e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80c27b0 con 0x7f54e80adc40 2023-08-09T12:42:20.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54ee22b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80cc630 0x7f54e8149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54ee22b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80cc630 0x7f54e8149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54662/0 (socket says 172.21.15.17:54662) 2023-08-09T12:42:20.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54ee22b640 1 -- 172.21.15.17:0/2495846062 learned_addr learned my addr 172.21.15.17:0/2495846062 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:20.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.748+0000 7f54eda2a640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e80adc40 0x7f54e80c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54ed229640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e80b3b40 0x7f54e80c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54ee22b640 1 -- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e80adc40 msgr2=0x7f54e80c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54ee22b640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e80adc40 0x7f54e80c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54ee22b640 1 -- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e80b3b40 msgr2=0x7f54e80c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:20.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54ee22b640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e80b3b40 0x7f54e80c3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:20.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54ee22b640 1 -- 172.21.15.17:0/2495846062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e40094d0 con 0x7f54e80cc630 2023-08-09T12:42:20.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54eda2a640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e80adc40 0x7f54e80c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:20.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54ee22b640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80cc630 0x7f54e8149c10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f54e000b970 tx=0x7f54e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:20.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54de7fc640 1 -- 172.21.15.17:0/2495846062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e000cb40 con 0x7f54e80cc630 2023-08-09T12:42:20.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54de7fc640 1 -- 172.21.15.17:0/2495846062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e000cca0 con 0x7f54e80cc630 2023-08-09T12:42:20.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54de7fc640 1 -- 172.21.15.17:0/2495846062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0014680 con 0x7f54e80cc630 2023-08-09T12:42:20.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.749+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e80c2a90 con 0x7f54e80cc630 2023-08-09T12:42:20.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.750+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e80c3050 con 0x7f54e80cc630 2023-08-09T12:42:20.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.751+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e80c3570 con 0x7f54e80cc630 2023-08-09T12:42:20.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.752+0000 7f54de7fc640 1 -- 172.21.15.17:0/2495846062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f54e001d3b0 con 0x7f54e80cc630 2023-08-09T12:42:20.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.752+0000 7f54de7fc640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54cc06a050 0x7f54cc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:20.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.753+0000 7f54de7fc640 1 -- 172.21.15.17:0/2495846062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f54e0088410 con 0x7f54e80cc630 2023-08-09T12:42:20.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.753+0000 7f54eda2a640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54cc06a050 0x7f54cc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:20.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.754+0000 7f54eda2a640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54cc06a050 0x7f54cc06c510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f54e4036000 tx=0x7f54e403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:20.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.757+0000 7f54de7fc640 1 -- 172.21.15.17:0/2495846062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f54e80c3570 con 0x7f54e80cc630 2023-08-09T12:42:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.992+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54e80c3570 con 0x7f54e80cc630 2023-08-09T12:42:20.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.994+0000 7f54de7fc640 1 -- 172.21.15.17:0/2495846062 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f54e80c3570 con 0x7f54e80cc630 2023-08-09T12:42:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:20.997 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:41:26.203485+0000","modified":"2023-08-09T12:41:29.769328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4936":{"gid":4936,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2725761547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2725761547},{"type":"v1","addr":"172.21.15.142:6837","nonce":2725761547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-09T12:42:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-08-09T12:42:21.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54cc06a050 msgr2=0x7f54cc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54cc06a050 0x7f54cc06c510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f54e4036000 tx=0x7f54e403c040 comp rx=0 tx=0).stop 2023-08-09T12:42:21.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80cc630 msgr2=0x7f54e8149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80cc630 0x7f54e8149c10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f54e000b970 tx=0x7f54e000be30 comp rx=0 tx=0).stop 2023-08-09T12:42:21.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 shutdown_connections 2023-08-09T12:42:21.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54cc06a050 0x7f54cc06c510 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e80cc630 0x7f54e8149c10 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e80b3b40 0x7f54e80c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.996+0000 7f54efc8e640 1 --2- 172.21.15.17:0/2495846062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e80adc40 0x7f54e80c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.997+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 >> 172.21.15.17:0/2495846062 conn(0x7f54e80cb1b0 msgr2=0x7f54e806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:21.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.997+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 shutdown_connections 2023-08-09T12:42:21.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:20.997+0000 7f54efc8e640 1 -- 172.21.15.17:0/2495846062 wait complete. 2023-08-09T12:42:21.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.243+0000 7f857d86a640 1 Processor -- start 2023-08-09T12:42:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.243+0000 7f857d86a640 1 -- start start 2023-08-09T12:42:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.244+0000 7f857d86a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 0x7f8578160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.244+0000 7f857d86a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85780cfb50 0x7f85780d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f857d86a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85780b5a30 con 0x7f85780b86e0 2023-08-09T12:42:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f857d86a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85780d1110 con 0x7f85780cfb50 2023-08-09T12:42:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f857d86a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780ceac0 con 0x7f8578160030 2023-08-09T12:42:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f8577fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f85780b86e0 0x7f85780cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48424/0 (socket says 172.21.15.17:48424) 2023-08-09T12:42:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f8577fff640 1 -- 172.21.15.17:0/1045814050 learned_addr learned my addr 172.21.15.17:0/1045814050 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f857d069640 1 --2- 172.21.15.17:0/1045814050 >> v2:172.21.15.17:3300/0 conn(0x7f85780cfb50 0x7f85780d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f857c868640 1 --2- 172.21.15.17:0/1045814050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 0x7f8578160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f85777fe640 1 -- 172.21.15.17:0/1045814050 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841208138 0 0) 0x7f85780b5a30 con 0x7f85780b86e0 2023-08-09T12:42:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.245+0000 7f857d069640 1 -- 172.21.15.17:0/1045814050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 msgr2=0x7f8578160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.246+0000 7f857d069640 1 --2- 172.21.15.17:0/1045814050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 0x7f8578160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.246+0000 7f857d069640 1 -- 172.21.15.17:0/1045814050 >> v1:172.21.15.17:6789/0 conn(0x7f85780b86e0 legacy=0x7f85780cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.246+0000 7f857d069640 1 -- 172.21.15.17:0/1045814050 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780d0d70 con 0x7f85780cfb50 2023-08-09T12:42:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.247+0000 7f857d069640 1 --2- 172.21.15.17:0/1045814050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780cfb50 0x7f85780d1530 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f85700097a0 tx=0x7f857002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b0c6e6dae52fde server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.247+0000 7f85777fe640 1 -- 172.21.15.17:0/1045814050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857002d040 con 0x7f85780cfb50 2023-08-09T12:42:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.247+0000 7f85777fe640 1 -- 172.21.15.17:0/1045814050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570031810 con 0x7f85780cfb50 2023-08-09T12:42:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.247+0000 7f85777fe640 1 -- 172.21.15.17:0/1045814050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570031ba0 con 0x7f85780cfb50 2023-08-09T12:42:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.247+0000 7f857d86a640 1 -- 172.21.15.17:0/1045814050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780cfb50 msgr2=0x7f85780d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.247+0000 7f857d86a640 1 --2- 172.21.15.17:0/1045814050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780cfb50 0x7f85780d1530 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f85700097a0 tx=0x7f857002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.248+0000 7f857d86a640 1 -- 172.21.15.17:0/1045814050 shutdown_connections 2023-08-09T12:42:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.248+0000 7f857d86a640 1 --2- 172.21.15.17:0/1045814050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780cfb50 0x7f85780d1530 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.248+0000 7f857d86a640 1 --2- 172.21.15.17:0/1045814050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 0x7f8578160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.248+0000 7f857d86a640 1 -- 172.21.15.17:0/1045814050 >> 172.21.15.17:0/1045814050 conn(0x7f85780697c0 msgr2=0x7f8578069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.248+0000 7f857d86a640 1 -- 172.21.15.17:0/1045814050 shutdown_connections 2023-08-09T12:42:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.248+0000 7f857d86a640 1 -- 172.21.15.17:0/1045814050 wait complete. 2023-08-09T12:42:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.249+0000 7f857d86a640 1 Processor -- start 2023-08-09T12:42:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.250+0000 7f857d86a640 1 -- start start 2023-08-09T12:42:21.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857d86a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780b86e0 0x7f85781f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857d86a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85780cfb50 0x7f85780cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857d86a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 0x7f85780b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857d86a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578151830 con 0x7f85780b86e0 2023-08-09T12:42:21.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857d86a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780cc270 con 0x7f85780cfb50 2023-08-09T12:42:21.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857d86a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85781f2d40 con 0x7f8578160030 2023-08-09T12:42:21.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857c868640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780b86e0 0x7f85781f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857c868640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780b86e0 0x7f85781f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54682/0 (socket says 172.21.15.17:54682) 2023-08-09T12:42:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857c868640 1 -- 172.21.15.17:0/3640268142 learned_addr learned my addr 172.21.15.17:0/3640268142 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f8577fff640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85780cfb50 0x7f85780cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857d069640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 0x7f85780b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857c868640 1 -- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 msgr2=0x7f85780b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857c868640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 0x7f85780b72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857c868640 1 -- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85780cfb50 msgr2=0x7f85780cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857c868640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85780cfb50 0x7f85780cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f857c868640 1 -- 172.21.15.17:0/3640268142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8570009400 con 0x7f85780b86e0 2023-08-09T12:42:21.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.251+0000 7f8577fff640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85780cfb50 0x7f85780cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:21.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.252+0000 7f857c868640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780b86e0 0x7f85781f2680 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f856800d5f0 tx=0x7f856800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:21.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.252+0000 7f85757fa640 1 -- 172.21.15.17:0/3640268142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680125f0 con 0x7f85780b86e0 2023-08-09T12:42:21.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.252+0000 7f85757fa640 1 -- 172.21.15.17:0/3640268142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568012750 con 0x7f85780b86e0 2023-08-09T12:42:21.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.252+0000 7f85757fa640 1 -- 172.21.15.17:0/3640268142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568012b00 con 0x7f85780b86e0 2023-08-09T12:42:21.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.252+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85781f3020 con 0x7f85780b86e0 2023-08-09T12:42:21.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.252+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85781f35e0 con 0x7f85780b86e0 2023-08-09T12:42:21.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.253+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857804e390 con 0x7f85780b86e0 2023-08-09T12:42:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.254+0000 7f85757fa640 1 -- 172.21.15.17:0/3640268142 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8568012c60 con 0x7f85780b86e0 2023-08-09T12:42:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.255+0000 7f85757fa640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f856406a050 0x7f856406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.255+0000 7f85757fa640 1 -- 172.21.15.17:0/3640268142 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8568088a10 con 0x7f85780b86e0 2023-08-09T12:42:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.256+0000 7f8577fff640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f856406a050 0x7f856406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.257+0000 7f8577fff640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f856406a050 0x7f856406c510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8578154340 tx=0x7f856c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.260+0000 7f85757fa640 1 -- 172.21.15.17:0/3640268142 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f85680540c0 con 0x7f85780b86e0 2023-08-09T12:42:21.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.453+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85780d0640 con 0x7f85780b86e0 2023-08-09T12:42:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.456+0000 7f85757fa640 1 -- 172.21.15.17:0/3640268142 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+18422 (secure 0 0 0) 0x7f85680576e0 con 0x7f85780b86e0 2023-08-09T12:42:21.460 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:21.460 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:11.769329+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:41:23.866427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-09T12:41:25.245820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:21.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.458+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f856406a050 msgr2=0x7f856406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f856406a050 0x7f856406c510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8578154340 tx=0x7f856c009040 comp rx=0 tx=0).stop 2023-08-09T12:42:21.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780b86e0 msgr2=0x7f85781f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780b86e0 0x7f85781f2680 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f856800d5f0 tx=0x7f856800dab0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 shutdown_connections 2023-08-09T12:42:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f856406a050 0x7f856406c510 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8578160030 0x7f85780b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85780cfb50 0x7f85780cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 --2- 172.21.15.17:0/3640268142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85780b86e0 0x7f85781f2680 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 >> 172.21.15.17:0/3640268142 conn(0x7f85780697c0 msgr2=0x7f85780d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 shutdown_connections 2023-08-09T12:42:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.459+0000 7f857d86a640 1 -- 172.21.15.17:0/3640268142 wait complete. 2023-08-09T12:42:21.480 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:42:21.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.699+0000 7fddb5cec640 1 Processor -- start 2023-08-09T12:42:21.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.699+0000 7fddb5cec640 1 -- start start 2023-08-09T12:42:21.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.700+0000 7fddb5cec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161660 0x7fddb00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.700+0000 7fddb5cec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddb00acdf0 0x7fddb00cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.700+0000 7fddb5cec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb015df30 con 0x7fddb0161280 2023-08-09T12:42:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.700+0000 7fddb5cec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb00ad2a0 con 0x7fddb00acdf0 2023-08-09T12:42:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.700+0000 7fddb5cec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb015d430 con 0x7fddb0161660 2023-08-09T12:42:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.700+0000 7fddaffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddb00acdf0 0x7fddb00cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.701+0000 7fddaffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddb00acdf0 0x7fddb00cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54692/0 (socket says 172.21.15.17:54692) 2023-08-09T12:42:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.701+0000 7fddaffff640 1 -- 172.21.15.17:0/3177134874 learned_addr learned my addr 172.21.15.17:0/3177134874 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.701+0000 7fddaffff640 1 -- 172.21.15.17:0/3177134874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161660 msgr2=0x7fddb00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.701+0000 7fddaffff640 1 --2- 172.21.15.17:0/3177134874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161660 0x7fddb00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.701+0000 7fddaffff640 1 -- 172.21.15.17:0/3177134874 >> v1:172.21.15.142:6789/0 conn(0x7fddb0161280 legacy=0x7fddb00c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.701+0000 7fddaffff640 1 -- 172.21.15.17:0/3177134874 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00ca9d0 con 0x7fddb00acdf0 2023-08-09T12:42:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.702+0000 7fddaffff640 1 --2- 172.21.15.17:0/3177134874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb00cc630 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009870 tx=0x7fdda802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9eb5b8eade5703c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:21.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.702+0000 7fddae7fc640 1 -- 172.21.15.17:0/3177134874 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80317c0 con 0x7fddb00acdf0 2023-08-09T12:42:21.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddae7fc640 1 -- 172.21.15.17:0/3177134874 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8031920 con 0x7fddb00acdf0 2023-08-09T12:42:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddae7fc640 1 -- 172.21.15.17:0/3177134874 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8031cb0 con 0x7fddb00acdf0 2023-08-09T12:42:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddb5cec640 1 -- 172.21.15.17:0/3177134874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 msgr2=0x7fddb00cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3177134874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb00cc630 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009870 tx=0x7fdda802b860 comp rx=0 tx=0).stop 2023-08-09T12:42:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddb5cec640 1 -- 172.21.15.17:0/3177134874 shutdown_connections 2023-08-09T12:42:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3177134874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb00cc630 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3177134874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161660 0x7fddb00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddb5cec640 1 -- 172.21.15.17:0/3177134874 >> 172.21.15.17:0/3177134874 conn(0x7fddb00cb1b0 msgr2=0x7fddb00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:21.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddb5cec640 1 -- 172.21.15.17:0/3177134874 shutdown_connections 2023-08-09T12:42:21.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.703+0000 7fddb5cec640 1 -- 172.21.15.17:0/3177134874 wait complete. 2023-08-09T12:42:21.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.705+0000 7fddb5cec640 1 Processor -- start 2023-08-09T12:42:21.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.705+0000 7fddb5cec640 1 -- start start 2023-08-09T12:42:21.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddb5cec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb0151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddb5cec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161280 0x7fddb0156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddb5cec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddb0161660 0x7fddb00afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddb5cec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00c3f50 con 0x7fddb00acdf0 2023-08-09T12:42:21.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddb5cec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb01523d0 con 0x7fddb0161660 2023-08-09T12:42:21.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddb5cec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00c3340 con 0x7fddb0161280 2023-08-09T12:42:21.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddaf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb0151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddaf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb0151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54704/0 (socket says 172.21.15.17:54704) 2023-08-09T12:42:21.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.706+0000 7fddaf7fe640 1 -- 172.21.15.17:0/3944087888 learned_addr learned my addr 172.21.15.17:0/3944087888 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:21.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fddaf7fe640 1 -- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161280 msgr2=0x7fddb0156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fddaeffd640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161280 0x7fddb0156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fddaf7fe640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161280 0x7fddb0156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fddaf7fe640 1 -- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddb0161660 msgr2=0x7fddb00afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fddaf7fe640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddb0161660 0x7fddb00afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fddaf7fe640 1 -- 172.21.15.17:0/3944087888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80094d0 con 0x7fddb00acdf0 2023-08-09T12:42:21.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fddaeffd640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161280 0x7fddb0156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:21.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fddaf7fe640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb0151e90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdda000c7c0 tx=0x7fdda000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.707+0000 7fdd97fff640 1 -- 172.21.15.17:0/3944087888 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda000aa50 con 0x7fddb00acdf0 2023-08-09T12:42:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.708+0000 7fdd97fff640 1 -- 172.21.15.17:0/3944087888 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda000abb0 con 0x7fddb00acdf0 2023-08-09T12:42:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.708+0000 7fdd97fff640 1 -- 172.21.15.17:0/3944087888 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda0012420 con 0x7fddb00acdf0 2023-08-09T12:42:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.708+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb00c3620 con 0x7fddb00acdf0 2023-08-09T12:42:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.708+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb00c3be0 con 0x7fddb00acdf0 2023-08-09T12:42:21.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.709+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb015e3a0 con 0x7fddb00acdf0 2023-08-09T12:42:21.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.710+0000 7fdd97fff640 1 -- 172.21.15.17:0/3944087888 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdda0012580 con 0x7fddb00acdf0 2023-08-09T12:42:21.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.711+0000 7fdd97fff640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdd9c06a050 0x7fdd9c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:21.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.711+0000 7fdd97fff640 1 -- 172.21.15.17:0/3944087888 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdda00888c0 con 0x7fddb00acdf0 2023-08-09T12:42:21.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.712+0000 7fddaeffd640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdd9c06a050 0x7fdd9c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:21.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.713+0000 7fddaeffd640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdd9c06a050 0x7fdd9c06c510 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fddb0160dc0 tx=0x7fdda4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:21.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.716+0000 7fdd97fff640 1 -- 172.21.15.17:0/3944087888 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fddb015e3a0 con 0x7fddb00acdf0 2023-08-09T12:42:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.952+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fddb015e3a0 con 0x7fddb00acdf0 2023-08-09T12:42:21.956 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:42:21.952+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:42:21.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.960+0000 7fdd97fff640 1 -- 172.21.15.17:0/3944087888 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fddb015e3a0 con 0x7fddb00acdf0 2023-08-09T12:42:21.964 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:42:21.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdd9c06a050 msgr2=0x7fdd9c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdd9c06a050 0x7fdd9c06c510 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fddb0160dc0 tx=0x7fdda4008040 comp rx=0 tx=0).stop 2023-08-09T12:42:21.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 msgr2=0x7fddb0151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:21.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb0151e90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdda000c7c0 tx=0x7fdda000cc80 comp rx=0 tx=0).stop 2023-08-09T12:42:21.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 shutdown_connections 2023-08-09T12:42:21.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdd9c06a050 0x7fdd9c06c510 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddb0161660 0x7fddb00afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fddb0161280 0x7fddb0156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 --2- 172.21.15.17:0/3944087888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb00acdf0 0x7fddb0151e90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:21.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 >> 172.21.15.17:0/3944087888 conn(0x7fddb00cb1b0 msgr2=0x7fddb006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:21.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 shutdown_connections 2023-08-09T12:42:21.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:21.963+0000 7fddb5cec640 1 -- 172.21.15.17:0/3944087888 wait complete. 2023-08-09T12:42:21.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:42:22.094 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:42:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.219+0000 7f6f04938640 1 Processor -- start 2023-08-09T12:42:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.220+0000 7f6f04938640 1 -- start start 2023-08-09T12:42:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.221+0000 7f6f04938640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6f000b4170 0x7f6f000b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.221+0000 7f6f04938640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f000b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.221+0000 7f6f04938640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0015e7b0 con 0x7f6f0015a8c0 2023-08-09T12:42:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.221+0000 7f6f04938640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f000b09d0 con 0x7f6f000b4170 2023-08-09T12:42:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.221+0000 7f6f04938640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0015e460 con 0x7f6f000b0020 2023-08-09T12:42:22.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6efe59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6f000b4170 0x7f6f000b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:22.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6efe59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6f000b4170 0x7f6f000b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54714/0 (socket says 172.21.15.17:54714) 2023-08-09T12:42:22.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6efe59c640 1 -- 172.21.15.17:0/10485155 learned_addr learned my addr 172.21.15.17:0/10485155 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6efe59c640 1 -- 172.21.15.17:0/10485155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 msgr2=0x7f6f000b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6eff59e640 1 --2- 172.21.15.17:0/10485155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f000b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6efe59c640 1 --2- 172.21.15.17:0/10485155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f000b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6efe59c640 1 -- 172.21.15.17:0/10485155 >> v1:172.21.15.142:6789/0 conn(0x7f6f0015a8c0 legacy=0x7f6f0015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6efe59c640 1 -- 172.21.15.17:0/10485155 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0015aca0 con 0x7f6f000b4170 2023-08-09T12:42:22.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.222+0000 7f6eff59e640 1 --2- 172.21.15.17:0/10485155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f000b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:22.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.223+0000 7f6efe59c640 1 --2- 172.21.15.17:0/10485155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f000b13f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009870 tx=0x7f6ee802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0e6e9354c42dca server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:22.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.224+0000 7f6efdd9b640 1 -- 172.21.15.17:0/10485155 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8030840 con 0x7f6f000b4170 2023-08-09T12:42:22.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.224+0000 7f6efdd9b640 1 -- 172.21.15.17:0/10485155 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee80309a0 con 0x7f6f000b4170 2023-08-09T12:42:22.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.224+0000 7f6efdd9b640 1 -- 172.21.15.17:0/10485155 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8030d30 con 0x7f6f000b4170 2023-08-09T12:42:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.224+0000 7f6f04938640 1 -- 172.21.15.17:0/10485155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 msgr2=0x7f6f000b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.224+0000 7f6f04938640 1 --2- 172.21.15.17:0/10485155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f000b13f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009870 tx=0x7f6ee802b980 comp rx=0 tx=0).stop 2023-08-09T12:42:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.225+0000 7f6f04938640 1 -- 172.21.15.17:0/10485155 shutdown_connections 2023-08-09T12:42:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.225+0000 7f6f04938640 1 --2- 172.21.15.17:0/10485155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f000b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.225+0000 7f6f04938640 1 --2- 172.21.15.17:0/10485155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f000b13f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.225+0000 7f6f04938640 1 -- 172.21.15.17:0/10485155 >> 172.21.15.17:0/10485155 conn(0x7f6f000cb020 msgr2=0x7f6f000cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:22.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.225+0000 7f6f04938640 1 -- 172.21.15.17:0/10485155 shutdown_connections 2023-08-09T12:42:22.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.225+0000 7f6f04938640 1 -- 172.21.15.17:0/10485155 wait complete. 2023-08-09T12:42:22.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.226+0000 7f6f04938640 1 Processor -- start 2023-08-09T12:42:22.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.227+0000 7f6f04938640 1 -- start start 2023-08-09T12:42:22.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6f04938640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f0015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:22.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6f04938640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f0015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:22.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6f04938640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f0015a8c0 0x7f6f0014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:22.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6f04938640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001e4f40 con 0x7f6f000b4170 2023-08-09T12:42:22.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6f04938640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0015bc00 con 0x7f6f0015a8c0 2023-08-09T12:42:22.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6f04938640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001e45e0 con 0x7f6f000b0020 2023-08-09T12:42:22.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6efe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f0015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:22.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6efe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f0015aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54716/0 (socket says 172.21.15.17:54716) 2023-08-09T12:42:22.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6efe59c640 1 -- 172.21.15.17:0/261116768 learned_addr learned my addr 172.21.15.17:0/261116768 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:22.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6efe59c640 1 -- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 msgr2=0x7f6f0015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:22.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6eff59e640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f0015a8c0 0x7f6f0014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:22.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.228+0000 7f6efed9d640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f0015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:22.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6efe59c640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f0015b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6efe59c640 1 -- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f0015a8c0 msgr2=0x7f6f0014f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:22.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6efe59c640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f0015a8c0 0x7f6f0014f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6efe59c640 1 -- 172.21.15.17:0/261116768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee80094d0 con 0x7f6f000b4170 2023-08-09T12:42:22.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6efe59c640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f0015aee0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6ee802b9c0 tx=0x7f6ee8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:22.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6ef77fe640 1 -- 172.21.15.17:0/261116768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8030810 con 0x7f6f000b4170 2023-08-09T12:42:22.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6ef77fe640 1 -- 172.21.15.17:0/261116768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee8044480 con 0x7f6f000b4170 2023-08-09T12:42:22.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6ef77fe640 1 -- 172.21.15.17:0/261116768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8044850 con 0x7f6f000b4170 2023-08-09T12:42:22.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0015b420 con 0x7f6f000b4170 2023-08-09T12:42:22.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.229+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f001e4b60 con 0x7f6f000b4170 2023-08-09T12:42:22.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.231+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f001e5080 con 0x7f6f000b4170 2023-08-09T12:42:22.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.231+0000 7f6ef77fe640 1 -- 172.21.15.17:0/261116768 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ee802f390 con 0x7f6f000b4170 2023-08-09T12:42:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.232+0000 7f6ef77fe640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ee006a080 0x7f6ee006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.232+0000 7f6ef77fe640 1 -- 172.21.15.17:0/261116768 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f6ee803e070 con 0x7f6f000b4170 2023-08-09T12:42:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.233+0000 7f6efed9d640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ee006a080 0x7f6ee006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:22.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.234+0000 7f6efed9d640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ee006a080 0x7f6ee006c540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0007fd0 tx=0x7f6ef0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:22.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.237+0000 7f6ef77fe640 1 -- 172.21.15.17:0/261116768 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6f001e5080 con 0x7f6f000b4170 2023-08-09T12:42:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.467+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6f001e5080 con 0x7f6f000b4170 2023-08-09T12:42:22.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.970+0000 7f6ef77fe640 1 -- 172.21.15.17:0/261116768 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6f001e5080 con 0x7f6f000b4170 2023-08-09T12:42:22.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.973+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ee006a080 msgr2=0x7f6ee006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.973+0000 7f6f04938640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ee006a080 0x7f6ee006c540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0007fd0 tx=0x7f6ef0009040 comp rx=0 tx=0).stop 2023-08-09T12:42:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.973+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 msgr2=0x7f6f0015aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.973+0000 7f6f04938640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f0015aee0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6ee802b9c0 tx=0x7f6ee8004730 comp rx=0 tx=0).stop 2023-08-09T12:42:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.974+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 shutdown_connections 2023-08-09T12:42:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.974+0000 7f6f04938640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ee006a080 0x7f6ee006c540 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.974+0000 7f6f04938640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f0015a8c0 0x7f6f0014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.974+0000 7f6f04938640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f000b4170 0x7f6f0015aee0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.974+0000 7f6f04938640 1 --2- 172.21.15.17:0/261116768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f000b0020 0x7f6f0015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.974+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 >> 172.21.15.17:0/261116768 conn(0x7f6f000cb020 msgr2=0x7f6f000707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.974+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 shutdown_connections 2023-08-09T12:42:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:22.974+0000 7f6f04938640 1 -- 172.21.15.17:0/261116768 wait complete. 2023-08-09T12:42:22.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:42:23.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.229+0000 7f614d374640 1 Processor -- start 2023-08-09T12:42:23.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.229+0000 7f614d374640 1 -- start start 2023-08-09T12:42:23.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.230+0000 7f614d374640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:23.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.230+0000 7f614d374640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61480c8240 0x7f61480affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:23.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.230+0000 7f614d374640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61480b18b0 con 0x7f61480b3dd0 2023-08-09T12:42:23.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.230+0000 7f614d374640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480b1b10 con 0x7f61480c8240 2023-08-09T12:42:23.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.230+0000 7f614d374640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480b1df0 con 0x7f61480b41b0 2023-08-09T12:42:23.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.231+0000 7f6147fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f61480b3dd0 0x7f614815eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48426/0 (socket says 172.21.15.17:48426) 2023-08-09T12:42:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.231+0000 7f6147fff640 1 -- 172.21.15.17:0/414612675 learned_addr learned my addr 172.21.15.17:0/414612675 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.231+0000 7f61477fe640 1 --2- 172.21.15.17:0/414612675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:23.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.231+0000 7f614cb73640 1 --2- 172.21.15.17:0/414612675 >> v2:172.21.15.17:3300/0 conn(0x7f61480c8240 0x7f61480affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:23.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.231+0000 7f6146ffd640 1 -- 172.21.15.17:0/414612675 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607805285 0 0) 0x7f61480b18b0 con 0x7f61480b3dd0 2023-08-09T12:42:23.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.231+0000 7f6146ffd640 1 -- 172.21.15.17:0/414612675 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6130003520 con 0x7f61480b3dd0 2023-08-09T12:42:23.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.232+0000 7f6146ffd640 1 -- 172.21.15.17:0/414612675 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3003618751 0 0) 0x7f6130003520 con 0x7f61480b3dd0 2023-08-09T12:42:23.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.232+0000 7f614cb73640 1 -- 172.21.15.17:0/414612675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 msgr2=0x7f61480b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:23.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.232+0000 7f614cb73640 1 --2- 172.21.15.17:0/414612675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.232+0000 7f614cb73640 1 -- 172.21.15.17:0/414612675 >> v1:172.21.15.17:6789/0 conn(0x7f61480b3dd0 legacy=0x7f614815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:23.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.232+0000 7f614cb73640 1 -- 172.21.15.17:0/414612675 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61480b20d0 con 0x7f61480c8240 2023-08-09T12:42:23.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.233+0000 7f614cb73640 1 --2- 172.21.15.17:0/414612675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480affa0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6140009d90 tx=0x7f614002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8be50c4ca5bf93b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:23.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.233+0000 7f6146ffd640 1 -- 172.21.15.17:0/414612675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138001670 con 0x7f61480c8240 2023-08-09T12:42:23.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.233+0000 7f6146ffd640 1 -- 172.21.15.17:0/414612675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614002c8a0 con 0x7f61480c8240 2023-08-09T12:42:23.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.233+0000 7f6146ffd640 1 -- 172.21.15.17:0/414612675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614002cc30 con 0x7f61480c8240 2023-08-09T12:42:23.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.234+0000 7f614d374640 1 -- 172.21.15.17:0/414612675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 msgr2=0x7f61480affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:23.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.234+0000 7f614d374640 1 --2- 172.21.15.17:0/414612675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480affa0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6140009d90 tx=0x7f614002bd70 comp rx=0 tx=0).stop 2023-08-09T12:42:23.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.234+0000 7f614d374640 1 -- 172.21.15.17:0/414612675 shutdown_connections 2023-08-09T12:42:23.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.234+0000 7f614d374640 1 --2- 172.21.15.17:0/414612675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480affa0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.234+0000 7f614d374640 1 --2- 172.21.15.17:0/414612675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.234+0000 7f614d374640 1 -- 172.21.15.17:0/414612675 >> 172.21.15.17:0/414612675 conn(0x7f61480cafa0 msgr2=0x7f61480cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:23.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.234+0000 7f614d374640 1 -- 172.21.15.17:0/414612675 shutdown_connections 2023-08-09T12:42:23.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.234+0000 7f614d374640 1 -- 172.21.15.17:0/414612675 wait complete. 2023-08-09T12:42:23.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.236+0000 7f614d374640 1 Processor -- start 2023-08-09T12:42:23.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.236+0000 7f614d374640 1 -- start start 2023-08-09T12:42:23.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.237+0000 7f614d374640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61480b3dd0 0x7f6148144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:23.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.237+0000 7f614d374640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:23.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.237+0000 7f614d374640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:23.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.237+0000 7f614d374640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6148147ad0 con 0x7f61480c8240 2023-08-09T12:42:23.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.237+0000 7f614d374640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6148144770 con 0x7f61480b3dd0 2023-08-09T12:42:23.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.237+0000 7f614d374640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480c5790 con 0x7f61480b41b0 2023-08-09T12:42:23.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.237+0000 7f614cb73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:23.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f614cb73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54740/0 (socket says 172.21.15.17:54740) 2023-08-09T12:42:23.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f614cb73640 1 -- 172.21.15.17:0/3366955978 learned_addr learned my addr 172.21.15.17:0/3366955978 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:23.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f61477fe640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:23.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f6147fff640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61480b3dd0 0x7f6148144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:23.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f614cb73640 1 -- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 msgr2=0x7f61480adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:23.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f614cb73640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f614cb73640 1 -- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61480b3dd0 msgr2=0x7f6148144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:23.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f614cb73640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61480b3dd0 0x7f6148144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f614cb73640 1 -- 172.21.15.17:0/3366955978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140009a70 con 0x7f61480c8240 2023-08-09T12:42:23.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f61477fe640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:42:23.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.238+0000 7f614cb73640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480ae230 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f614002c380 tx=0x7f6140004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:23.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.239+0000 7f6144ff9640 1 -- 172.21.15.17:0/3366955978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140035e60 con 0x7f61480c8240 2023-08-09T12:42:23.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.239+0000 7f6144ff9640 1 -- 172.21.15.17:0/3366955978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614002ce90 con 0x7f61480c8240 2023-08-09T12:42:23.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.239+0000 7f6144ff9640 1 -- 172.21.15.17:0/3366955978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614003e650 con 0x7f61480c8240 2023-08-09T12:42:23.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.239+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61480c5a70 con 0x7f61480c8240 2023-08-09T12:42:23.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.239+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61480c6030 con 0x7f61480c8240 2023-08-09T12:42:23.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.240+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614815e380 con 0x7f61480c8240 2023-08-09T12:42:23.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.241+0000 7f6144ff9640 1 -- 172.21.15.17:0/3366955978 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f614003b050 con 0x7f61480c8240 2023-08-09T12:42:23.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.243+0000 7f6144ff9640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f613406a050 0x7f613406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.243+0000 7f6144ff9640 1 -- 172.21.15.17:0/3366955978 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f61400aa760 con 0x7f61480c8240 2023-08-09T12:42:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.243+0000 7f6147fff640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f613406a050 0x7f613406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.244+0000 7f6147fff640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f613406a050 0x7f613406c510 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6138007a00 tx=0x7f6138009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:23.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.247+0000 7f6144ff9640 1 -- 172.21.15.17:0/3366955978 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6140075ef0 con 0x7f61480c8240 2023-08-09T12:42:23.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.440+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f614804e390 con 0x7f61480c8240 2023-08-09T12:42:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:42:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.978+0000 7f6144ff9640 1 -- 172.21.15.17:0/3366955978 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6140009450 con 0x7f61480c8240 2023-08-09T12:42:23.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.984+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f613406a050 msgr2=0x7f613406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:23.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.984+0000 7f614d374640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f613406a050 0x7f613406c510 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6138007a00 tx=0x7f6138009040 comp rx=0 tx=0).stop 2023-08-09T12:42:23.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.984+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 msgr2=0x7f61480ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:23.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.984+0000 7f614d374640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480ae230 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f614002c380 tx=0x7f6140004a40 comp rx=0 tx=0).stop 2023-08-09T12:42:23.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.986+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 shutdown_connections 2023-08-09T12:42:23.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.986+0000 7f614d374640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f613406a050 0x7f613406c510 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.986+0000 7f614d374640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61480c8240 0x7f61480ae230 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.986+0000 7f614d374640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61480b41b0 0x7f61480adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.986+0000 7f614d374640 1 --2- 172.21.15.17:0/3366955978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61480b3dd0 0x7f6148144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:23.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.986+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 >> 172.21.15.17:0/3366955978 conn(0x7f61480cafa0 msgr2=0x7f61480cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:23.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.986+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 shutdown_connections 2023-08-09T12:42:23.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:23.986+0000 7f614d374640 1 -- 172.21.15.17:0/3366955978 wait complete. 2023-08-09T12:42:24.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:42:24.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.239+0000 7f21a4cbf640 1 Processor -- start 2023-08-09T12:42:24.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.239+0000 7f21a4cbf640 1 -- start start 2023-08-09T12:42:24.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.240+0000 7f21a4cbf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015cdc0 0x7f21a00697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:24.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.240+0000 7f21a4cbf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21a00b2b60 0x7f21a00d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.240+0000 7f21a4cbf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a00cfc20 con 0x7f21a015d1a0 2023-08-09T12:42:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.240+0000 7f21a4cbf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a006ab40 con 0x7f21a00b2b60 2023-08-09T12:42:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.240+0000 7f21a4cbf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a006a2a0 con 0x7f21a015cdc0 2023-08-09T12:42:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.241+0000 7f219ed9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21a00b2b60 0x7f21a00d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.241+0000 7f219ed9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21a00b2b60 0x7f21a00d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:45996/0 (socket says 172.21.15.17:45996) 2023-08-09T12:42:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.241+0000 7f219ed9d640 1 -- 172.21.15.17:0/2171452184 learned_addr learned my addr 172.21.15.17:0/2171452184 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.241+0000 7f219e59c640 1 --2- 172.21.15.17:0/2171452184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015cdc0 0x7f21a00697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.242+0000 7f219ed9d640 1 -- 172.21.15.17:0/2171452184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015cdc0 msgr2=0x7f21a00697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.242+0000 7f219ed9d640 1 --2- 172.21.15.17:0/2171452184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015cdc0 0x7f21a00697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.242+0000 7f219ed9d640 1 -- 172.21.15.17:0/2171452184 >> v1:172.21.15.142:6789/0 conn(0x7f21a015d1a0 legacy=0x7f21a00b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.242+0000 7f219ed9d640 1 -- 172.21.15.17:0/2171452184 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a006a580 con 0x7f21a00b2b60 2023-08-09T12:42:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.244+0000 7f219ed9d640 1 --2- 172.21.15.17:0/2171452184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 0x7f21a00d0370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2198009e50 tx=0x7f219802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122baa5f18ce30c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.244+0000 7f219d59a640 1 -- 172.21.15.17:0/2171452184 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219802cb00 con 0x7f21a00b2b60 2023-08-09T12:42:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.244+0000 7f219d59a640 1 -- 172.21.15.17:0/2171452184 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219802cc60 con 0x7f21a00b2b60 2023-08-09T12:42:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.244+0000 7f219d59a640 1 -- 172.21.15.17:0/2171452184 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980343f0 con 0x7f21a00b2b60 2023-08-09T12:42:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.245+0000 7f21a4cbf640 1 -- 172.21.15.17:0/2171452184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 msgr2=0x7f21a00d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.245+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/2171452184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 0x7f21a00d0370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2198009e50 tx=0x7f219802bf60 comp rx=0 tx=0).stop 2023-08-09T12:42:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.245+0000 7f21a4cbf640 1 -- 172.21.15.17:0/2171452184 shutdown_connections 2023-08-09T12:42:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.245+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/2171452184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 0x7f21a00d0370 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.245+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/2171452184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015cdc0 0x7f21a00697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.245+0000 7f21a4cbf640 1 -- 172.21.15.17:0/2171452184 >> 172.21.15.17:0/2171452184 conn(0x7f21a006cf40 msgr2=0x7f21a006d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.245+0000 7f21a4cbf640 1 -- 172.21.15.17:0/2171452184 shutdown_connections 2023-08-09T12:42:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.245+0000 7f21a4cbf640 1 -- 172.21.15.17:0/2171452184 wait complete. 2023-08-09T12:42:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.247+0000 7f21a4cbf640 1 Processor -- start 2023-08-09T12:42:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.248+0000 7f21a4cbf640 1 -- start start 2023-08-09T12:42:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f21a4cbf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 0x7f21a0150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f21a4cbf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21a015cdc0 0x7f21a00c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f21a4cbf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015d1a0 0x7f21a00cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f21a4cbf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a00c8b90 con 0x7f21a015cdc0 2023-08-09T12:42:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f21a4cbf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a00c8e70 con 0x7f21a00b2b60 2023-08-09T12:42:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f21a4cbf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a00c9150 con 0x7f21a015d1a0 2023-08-09T12:42:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f219dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21a015cdc0 0x7f21a00c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f219dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21a015cdc0 0x7f21a00c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54746/0 (socket says 172.21.15.17:54746) 2023-08-09T12:42:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f219dd9b640 1 -- 172.21.15.17:0/3840449686 learned_addr learned my addr 172.21.15.17:0/3840449686 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.249+0000 7f219ed9d640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015d1a0 0x7f21a00cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.250+0000 7f219e59c640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 0x7f21a0150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.250+0000 7f219dd9b640 1 -- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015d1a0 msgr2=0x7f21a00cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.250+0000 7f219dd9b640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015d1a0 0x7f21a00cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.250+0000 7f219dd9b640 1 -- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 msgr2=0x7f21a0150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.250+0000 7f219dd9b640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 0x7f21a0150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.250+0000 7f219dd9b640 1 -- 172.21.15.17:0/3840449686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009b30 con 0x7f21a015cdc0 2023-08-09T12:42:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.250+0000 7f219dd9b640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21a015cdc0 0x7f21a00c9f10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f219400c400 tx=0x7f219400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.251+0000 7f218effd640 1 -- 172.21.15.17:0/3840449686 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940052d0 con 0x7f21a015cdc0 2023-08-09T12:42:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.251+0000 7f218effd640 1 -- 172.21.15.17:0/3840449686 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2194005430 con 0x7f21a015cdc0 2023-08-09T12:42:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.251+0000 7f218effd640 1 -- 172.21.15.17:0/3840449686 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194003830 con 0x7f21a015cdc0 2023-08-09T12:42:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.251+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a00c9430 con 0x7f21a015cdc0 2023-08-09T12:42:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.251+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a00c99f0 con 0x7f21a015cdc0 2023-08-09T12:42:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.252+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a00afd10 con 0x7f21a015cdc0 2023-08-09T12:42:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.253+0000 7f218effd640 1 -- 172.21.15.17:0/3840449686 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2194003990 con 0x7f21a015cdc0 2023-08-09T12:42:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.254+0000 7f218effd640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f218006a050 0x7f218006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.254+0000 7f218effd640 1 -- 172.21.15.17:0/3840449686 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f2194087a00 con 0x7f21a015cdc0 2023-08-09T12:42:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.255+0000 7f219e59c640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f218006a050 0x7f218006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:24.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.256+0000 7f219e59c640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f218006a050 0x7f218006c510 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2190009b40 tx=0x7f2190009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:24.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.259+0000 7f218effd640 1 -- 172.21.15.17:0/3840449686 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2194053220 con 0x7f21a015cdc0 2023-08-09T12:42:24.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.454+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21a0067a80 con 0x7f21a015cdc0 2023-08-09T12:42:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.986+0000 7f218effd640 1 -- 172.21.15.17:0/3840449686 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2194056840 con 0x7f21a015cdc0 2023-08-09T12:42:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:42:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f218006a050 msgr2=0x7f218006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f218006a050 0x7f218006c510 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2190009b40 tx=0x7f2190009190 comp rx=0 tx=0).stop 2023-08-09T12:42:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21a015cdc0 msgr2=0x7f21a00c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21a015cdc0 0x7f21a00c9f10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f219400c400 tx=0x7f219400c8c0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 shutdown_connections 2023-08-09T12:42:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f218006a050 0x7f218006c510 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21a015d1a0 0x7f21a00cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21a015cdc0 0x7f21a00c9f10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 --2- 172.21.15.17:0/3840449686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21a00b2b60 0x7f21a0150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 >> 172.21.15.17:0/3840449686 conn(0x7f21a006cf40 msgr2=0x7f21a00b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 shutdown_connections 2023-08-09T12:42:24.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:24.990+0000 7f21a4cbf640 1 -- 172.21.15.17:0/3840449686 wait complete. 2023-08-09T12:42:25.018 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:42:25.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.240+0000 7fe277fff640 1 Processor -- start 2023-08-09T12:42:25.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.240+0000 7fe277fff640 1 -- start start 2023-08-09T12:42:25.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.241+0000 7fe277fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780b0020 0x7fe2780b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.241+0000 7fe277fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe278160640 0x7fe27815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.241+0000 7fe277fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe278157580 con 0x7fe2780cdb00 2023-08-09T12:42:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.241+0000 7fe277fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27815d1c0 con 0x7fe278160640 2023-08-09T12:42:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.241+0000 7fe277fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780ad490 con 0x7fe2780b0020 2023-08-09T12:42:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.242+0000 7fe2777fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe278160640 0x7fe27815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.242+0000 7fe2767fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe2780cdb00 0x7fe2780acd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48438/0 (socket says 172.21.15.17:48438) 2023-08-09T12:42:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.242+0000 7fe2767fc640 1 -- 172.21.15.17:0/35985817 learned_addr learned my addr 172.21.15.17:0/35985817 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.242+0000 7fe276ffd640 1 --2- 172.21.15.17:0/35985817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780b0020 0x7fe2780b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.243+0000 7fe2777fe640 1 -- 172.21.15.17:0/35985817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780b0020 msgr2=0x7fe2780b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:25.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.243+0000 7fe2777fe640 1 --2- 172.21.15.17:0/35985817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780b0020 0x7fe2780b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.243+0000 7fe2777fe640 1 -- 172.21.15.17:0/35985817 >> v1:172.21.15.17:6789/0 conn(0x7fe2780cdb00 legacy=0x7fe2780acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.243+0000 7fe2777fe640 1 -- 172.21.15.17:0/35985817 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2780b0940 con 0x7fe278160640 2023-08-09T12:42:25.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.243+0000 7fe275ffb640 1 -- 172.21.15.17:0/35985817 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668570613 0 0) 0x7fe278157580 con 0x7fe2780cdb00 2023-08-09T12:42:25.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.244+0000 7fe2777fe640 1 --2- 172.21.15.17:0/35985817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe27815d5e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe270009d90 tx=0x7fe27002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bf824055030e77 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:25.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.244+0000 7fe275ffb640 1 -- 172.21.15.17:0/35985817 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27002cc50 con 0x7fe278160640 2023-08-09T12:42:25.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.244+0000 7fe275ffb640 1 -- 172.21.15.17:0/35985817 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27002cdb0 con 0x7fe278160640 2023-08-09T12:42:25.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.244+0000 7fe275ffb640 1 -- 172.21.15.17:0/35985817 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270034660 con 0x7fe278160640 2023-08-09T12:42:25.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.245+0000 7fe277fff640 1 -- 172.21.15.17:0/35985817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 msgr2=0x7fe27815d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.245+0000 7fe277fff640 1 --2- 172.21.15.17:0/35985817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe27815d5e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe270009d90 tx=0x7fe27002bea0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.245+0000 7fe277fff640 1 -- 172.21.15.17:0/35985817 shutdown_connections 2023-08-09T12:42:25.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.245+0000 7fe277fff640 1 --2- 172.21.15.17:0/35985817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe27815d5e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.245+0000 7fe277fff640 1 --2- 172.21.15.17:0/35985817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780b0020 0x7fe2780b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.245+0000 7fe277fff640 1 -- 172.21.15.17:0/35985817 >> 172.21.15.17:0/35985817 conn(0x7fe2780cb020 msgr2=0x7fe2780cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:25.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.245+0000 7fe277fff640 1 -- 172.21.15.17:0/35985817 shutdown_connections 2023-08-09T12:42:25.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.245+0000 7fe277fff640 1 -- 172.21.15.17:0/35985817 wait complete. 2023-08-09T12:42:25.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.247+0000 7fe277fff640 1 Processor -- start 2023-08-09T12:42:25.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.247+0000 7fe277fff640 1 -- start start 2023-08-09T12:42:25.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe277fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780b0020 0x7fe2781f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe277fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780cdb00 0x7fe2780c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe277fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe2780c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe277fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780b15b0 con 0x7fe278160640 2023-08-09T12:42:25.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe277fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2781f2040 con 0x7fe2780b0020 2023-08-09T12:42:25.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe277fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780c7ef0 con 0x7fe2780cdb00 2023-08-09T12:42:25.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe2777fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe2780c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe2777fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe2780c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54758/0 (socket says 172.21.15.17:54758) 2023-08-09T12:42:25.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.248+0000 7fe2777fe640 1 -- 172.21.15.17:0/2347481352 learned_addr learned my addr 172.21.15.17:0/2347481352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:25.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe2767fc640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780cdb00 0x7fe2780c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe276ffd640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780b0020 0x7fe2781f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe2777fe640 1 -- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780cdb00 msgr2=0x7fe2780c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe2777fe640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780cdb00 0x7fe2780c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe2777fe640 1 -- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780b0020 msgr2=0x7fe2781f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe2777fe640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780b0020 0x7fe2781f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe2777fe640 1 -- 172.21.15.17:0/2347481352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270009a70 con 0x7fe278160640 2023-08-09T12:42:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe276ffd640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780b0020 0x7fe2781f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:25.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.249+0000 7fe2777fe640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe2780c79b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe27002c4b0 tx=0x7fe270004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.250+0000 7fe26f7fe640 1 -- 172.21.15.17:0/2347481352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27003f420 con 0x7fe278160640 2023-08-09T12:42:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.250+0000 7fe26f7fe640 1 -- 172.21.15.17:0/2347481352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27003f580 con 0x7fe278160640 2023-08-09T12:42:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.250+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2780717a0 con 0x7fe278160640 2023-08-09T12:42:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.250+0000 7fe26f7fe640 1 -- 172.21.15.17:0/2347481352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27003f8f0 con 0x7fe278160640 2023-08-09T12:42:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.250+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27806ec90 con 0x7fe278160640 2023-08-09T12:42:25.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.251+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27804e390 con 0x7fe278160640 2023-08-09T12:42:25.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.252+0000 7fe26f7fe640 1 -- 172.21.15.17:0/2347481352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe27003fa50 con 0x7fe278160640 2023-08-09T12:42:25.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.253+0000 7fe26f7fe640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe25806a050 0x7fe25806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.253+0000 7fe26f7fe640 1 -- 172.21.15.17:0/2347481352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe2700aaf20 con 0x7fe278160640 2023-08-09T12:42:25.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.254+0000 7fe276ffd640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe25806a050 0x7fe25806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.255+0000 7fe276ffd640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe25806a050 0x7fe25806c510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe260006fd0 tx=0x7fe260008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:25.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.257+0000 7fe26f7fe640 1 -- 172.21.15.17:0/2347481352 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe270076920 con 0x7fe278160640 2023-08-09T12:42:25.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.452+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe2780b4520 con 0x7fe278160640 2023-08-09T12:42:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.460+0000 7fe26f7fe640 1 -- 172.21.15.17:0/2347481352 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe270079f40 con 0x7fe278160640 2023-08-09T12:42:25.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.462+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe25806a050 msgr2=0x7fe25806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.462+0000 7fe277fff640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe25806a050 0x7fe25806c510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe260006fd0 tx=0x7fe260008040 comp rx=0 tx=0).stop 2023-08-09T12:42:25.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.462+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 msgr2=0x7fe2780c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.462+0000 7fe277fff640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe2780c79b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe27002c4b0 tx=0x7fe270004a40 comp rx=0 tx=0).stop 2023-08-09T12:42:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.463+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 shutdown_connections 2023-08-09T12:42:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.463+0000 7fe277fff640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe25806a050 0x7fe25806c510 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.463+0000 7fe277fff640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe278160640 0x7fe2780c79b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.463+0000 7fe277fff640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2780cdb00 0x7fe2780c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.463+0000 7fe277fff640 1 --2- 172.21.15.17:0/2347481352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2780b0020 0x7fe2781f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.463+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 >> 172.21.15.17:0/2347481352 conn(0x7fe2780cb020 msgr2=0x7fe2780acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.463+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 shutdown_connections 2023-08-09T12:42:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.463+0000 7fe277fff640 1 -- 172.21.15.17:0/2347481352 wait complete. 2023-08-09T12:42:25.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-08-09T12:42:25.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.716+0000 7fc3b9bc9640 1 Processor -- start 2023-08-09T12:42:25.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.716+0000 7fc3b9bc9640 1 -- start start 2023-08-09T12:42:25.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.717+0000 7fc3b9bc9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc3b41616e0 0x7fc3b40b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.718+0000 7fc3b9bc9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b40cdd10 con 0x7fc3b415ce90 2023-08-09T12:42:25.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.718+0000 7fc3b9bc9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b40cdff0 con 0x7fc3b40d29d0 2023-08-09T12:42:25.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.718+0000 7fc3b9bc9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40b6540 con 0x7fc3b41616e0 2023-08-09T12:42:25.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.718+0000 7fc3b37fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc3b415ce90 0x7fc3b40cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48454/0 (socket says 172.21.15.17:48454) 2023-08-09T12:42:25.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.718+0000 7fc3b37fe640 1 -- 172.21.15.17:0/2479441509 learned_addr learned my addr 172.21.15.17:0/2479441509 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:25.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.718+0000 7fc3aaffd640 1 --2- 172.21.15.17:0/2479441509 >> v2:172.21.15.142:3300/0 conn(0x7fc3b41616e0 0x7fc3b40b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655371342 0 0) 0x7fc3b40cdd10 con 0x7fc3b415ce90 2023-08-09T12:42:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a0003520 con 0x7fc3b415ce90 2023-08-09T12:42:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142236409 0 0) 0x7fc3a0003520 con 0x7fc3b415ce90 2023-08-09T12:42:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 >> v2:172.21.15.142:3300/0 conn(0x7fc3b41616e0 msgr2=0x7fc3b40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 --2- 172.21.15.17:0/2479441509 >> v2:172.21.15.142:3300/0 conn(0x7fc3b41616e0 0x7fc3b40b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 >> v1:172.21.15.142:6789/0 conn(0x7fc3b40d29d0 legacy=0x7fc3b40d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40ce2d0 con 0x7fc3b415ce90 2023-08-09T12:42:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc3a4001670 con 0x7fc3b415ce90 2023-08-09T12:42:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3aaffd640 1 --2- 172.21.15.17:0/2479441509 >> v2:172.21.15.142:3300/0 conn(0x7fc3b41616e0 0x7fc3b40b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:42:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 >> v1:172.21.15.17:6789/0 conn(0x7fc3b415ce90 legacy=0x7fc3b40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3a00047c0 0x7fc3a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3a0005180 0x7fc3a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40b6540 con 0x7fc3a0003970 2023-08-09T12:42:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a000c020 con 0x7fc3a0005180 2023-08-09T12:42:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.719+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a000c1e0 con 0x7fc3a00047c0 2023-08-09T12:42:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3b37fe640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3aaffd640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3a00047c0 0x7fc3a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3b37fe640 1 -- 172.21.15.17:0/2479441509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3a00047c0 msgr2=0x7fc3a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3b37fe640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3a00047c0 0x7fc3a0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3b3fff640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3a0005180 0x7fc3a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3b37fe640 1 -- 172.21.15.17:0/2479441509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3a0005180 msgr2=0x7fc3a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:25.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3b37fe640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3a0005180 0x7fc3a000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3b37fe640 1 -- 172.21.15.17:0/2479441509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a0003520 con 0x7fc3a0003970 2023-08-09T12:42:25.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.720+0000 7fc3b3fff640 1 -- 172.21.15.17:0/2479441509 reap_dead start 2023-08-09T12:42:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.721+0000 7fc3b37fe640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3a0003d90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c240 tx=0x7fc3a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57617c2c24e1ca2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.721+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4005ad0 con 0x7fc3a0003970 2023-08-09T12:42:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.721+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a4005c30 con 0x7fc3a0003970 2023-08-09T12:42:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.721+0000 7fc3b2ffd640 1 -- 172.21.15.17:0/2479441509 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a402caf0 con 0x7fc3a0003970 2023-08-09T12:42:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.722+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/2479441509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 msgr2=0x7fc3a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.722+0000 7fc3b9bc9640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3a0003d90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c240 tx=0x7fc3a00057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.722+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/2479441509 shutdown_connections 2023-08-09T12:42:25.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.722+0000 7fc3b9bc9640 1 --2- 172.21.15.17:0/2479441509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3a0003d90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.722+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/2479441509 >> 172.21.15.17:0/2479441509 conn(0x7fc3b406fde0 msgr2=0x7fc3b40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:25.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.722+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/2479441509 shutdown_connections 2023-08-09T12:42:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.722+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/2479441509 wait complete. 2023-08-09T12:42:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.724+0000 7fc3b9bc9640 1 Processor -- start 2023-08-09T12:42:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.724+0000 7fc3b9bc9640 1 -- start start 2023-08-09T12:42:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b9bc9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3b415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b9bc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40cbba0 0x7fc3b4151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b9bc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b415d600 0x7fc3b40b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b9bc9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b415eb80 con 0x7fc3a0003970 2023-08-09T12:42:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b9bc9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b415f4e0 con 0x7fc3b415d600 2023-08-09T12:42:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b9bc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b415df00 con 0x7fc3b40cbba0 2023-08-09T12:42:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3b415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3b415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54782/0 (socket says 172.21.15.17:54782) 2023-08-09T12:42:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.725+0000 7fc3b37fe640 1 -- 172.21.15.17:0/1536806216 learned_addr learned my addr 172.21.15.17:0/1536806216 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3aaffd640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40cbba0 0x7fc3b4151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3b3fff640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b415d600 0x7fc3b40b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3b37fe640 1 -- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40cbba0 msgr2=0x7fc3b4151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3b37fe640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40cbba0 0x7fc3b4151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3b37fe640 1 -- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b415d600 msgr2=0x7fc3b40b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3b37fe640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b415d600 0x7fc3b40b7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3b37fe640 1 -- 172.21.15.17:0/1536806216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b415e1e0 con 0x7fc3a0003970 2023-08-09T12:42:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3aaffd640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40cbba0 0x7fc3b4151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3b37fe640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3b415efa0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4001930 tx=0x7fc3a402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.726+0000 7fc3b0ff9640 1 -- 172.21.15.17:0/1536806216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a403c040 con 0x7fc3a0003970 2023-08-09T12:42:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.727+0000 7fc3b0ff9640 1 -- 172.21.15.17:0/1536806216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a402ccc0 con 0x7fc3a0003970 2023-08-09T12:42:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.727+0000 7fc3b0ff9640 1 -- 172.21.15.17:0/1536806216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4007290 con 0x7fc3a0003970 2023-08-09T12:42:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.727+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b415e4c0 con 0x7fc3a0003970 2023-08-09T12:42:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.727+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b41515d0 con 0x7fc3a0003970 2023-08-09T12:42:25.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.728+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b4067a80 con 0x7fc3a0003970 2023-08-09T12:42:25.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.729+0000 7fc3b0ff9640 1 -- 172.21.15.17:0/1536806216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc3a4032070 con 0x7fc3a0003970 2023-08-09T12:42:25.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.730+0000 7fc3b0ff9640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a080 0x7fc39406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:25.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.730+0000 7fc3b0ff9640 1 -- 172.21.15.17:0/1536806216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc3a40a98e0 con 0x7fc3a0003970 2023-08-09T12:42:25.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.731+0000 7fc3aaffd640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a080 0x7fc39406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:25.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.732+0000 7fc3aaffd640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a080 0x7fc39406c540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40d14c0 tx=0x7fc39c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:25.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:25.734+0000 7fc3b0ff9640 1 -- 172.21.15.17:0/1536806216 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc3a40752e0 con 0x7fc3a0003970 2023-08-09T12:42:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:26.010+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7fc3b40d0ad0 con 0x7fc3a0003970 2023-08-09T12:42:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:26.998+0000 7fc3b0ff9640 1 -- 172.21.15.17:0/1536806216 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v184) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc3a4078900 con 0x7fc3a0003970 2023-08-09T12:42:27.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.001+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a080 msgr2=0x7fc39406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:27.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.001+0000 7fc3b9bc9640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a080 0x7fc39406c540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40d14c0 tx=0x7fc39c008040 comp rx=0 tx=0).stop 2023-08-09T12:42:27.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.001+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 msgr2=0x7fc3b415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:27.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.001+0000 7fc3b9bc9640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3b415efa0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4001930 tx=0x7fc3a402e070 comp rx=0 tx=0).stop 2023-08-09T12:42:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.002+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 shutdown_connections 2023-08-09T12:42:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.002+0000 7fc3b9bc9640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a080 0x7fc39406c540 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.002+0000 7fc3b9bc9640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b415d600 0x7fc3b40b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.002+0000 7fc3b9bc9640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40cbba0 0x7fc3b4151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.002+0000 7fc3b9bc9640 1 --2- 172.21.15.17:0/1536806216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a0003970 0x7fc3b415efa0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.002+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 >> 172.21.15.17:0/1536806216 conn(0x7fc3b406fde0 msgr2=0x7fc3b415ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:27.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.002+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 shutdown_connections 2023-08-09T12:42:27.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.002+0000 7fc3b9bc9640 1 -- 172.21.15.17:0/1536806216 wait complete. 2023-08-09T12:42:27.025 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-09T12:42:27.026 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-08-09T12:42:27.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-08-09T12:42:27.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.254+0000 7f7f2759e640 1 Processor -- start 2023-08-09T12:42:27.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.254+0000 7f7f2759e640 1 -- start start 2023-08-09T12:42:27.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.255+0000 7f7f2759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7f28159980 0x7f7f280ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:27.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.255+0000 7f7f2759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f280ce0c0 0x7f7f280ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:27.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.255+0000 7f7f2759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280cd3e0 con 0x7f7f280b2630 2023-08-09T12:42:27.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.255+0000 7f7f2759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280ac6a0 con 0x7f7f28159980 2023-08-09T12:42:27.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.255+0000 7f7f2759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280ac980 con 0x7f7f280ce0c0 2023-08-09T12:42:27.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.256+0000 7f7f26d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7f280b2630 0x7f7f2815af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48456/0 (socket says 172.21.15.17:48456) 2023-08-09T12:42:27.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.256+0000 7f7f26d9d640 1 -- 172.21.15.17:0/38550642 learned_addr learned my addr 172.21.15.17:0/38550642 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:27.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.256+0000 7f7f2659c640 1 --2- 172.21.15.17:0/38550642 >> v2:172.21.15.17:3300/0 conn(0x7f7f28159980 0x7f7f280ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:27.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.256+0000 7f7f1ffff640 1 --2- 172.21.15.17:0/38550642 >> v2:172.21.15.142:3300/0 conn(0x7f7f280ce0c0 0x7f7f280ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:27.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.256+0000 7f7f25d9b640 1 -- 172.21.15.17:0/38550642 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642044093 0 0) 0x7f7f280cd3e0 con 0x7f7f280b2630 2023-08-09T12:42:27.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.256+0000 7f7f25d9b640 1 -- 172.21.15.17:0/38550642 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f14003520 con 0x7f7f280b2630 2023-08-09T12:42:27.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.257+0000 7f7f2659c640 1 -- 172.21.15.17:0/38550642 >> v2:172.21.15.142:3300/0 conn(0x7f7f280ce0c0 msgr2=0x7f7f280ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:27.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.257+0000 7f7f2659c640 1 --2- 172.21.15.17:0/38550642 >> v2:172.21.15.142:3300/0 conn(0x7f7f280ce0c0 0x7f7f280ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.257+0000 7f7f25d9b640 1 -- 172.21.15.17:0/38550642 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009996455 0 0) 0x7f7f14003520 con 0x7f7f280b2630 2023-08-09T12:42:27.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.257+0000 7f7f2659c640 1 -- 172.21.15.17:0/38550642 >> v1:172.21.15.17:6789/0 conn(0x7f7f280b2630 legacy=0x7f7f2815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:27.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.257+0000 7f7f2659c640 1 -- 172.21.15.17:0/38550642 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280acc60 con 0x7f7f28159980 2023-08-09T12:42:27.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.258+0000 7f7f2659c640 1 --2- 172.21.15.17:0/38550642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f280ad460 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7f2806e910 tx=0x7f7f1802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ecc155a5614e4b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:27.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.258+0000 7f7f25d9b640 1 -- 172.21.15.17:0/38550642 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200019f0 con 0x7f7f28159980 2023-08-09T12:42:27.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.258+0000 7f7f25d9b640 1 -- 172.21.15.17:0/38550642 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1802e050 con 0x7f7f28159980 2023-08-09T12:42:27.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.258+0000 7f7f25d9b640 1 -- 172.21.15.17:0/38550642 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18030710 con 0x7f7f28159980 2023-08-09T12:42:27.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.259+0000 7f7f2759e640 1 -- 172.21.15.17:0/38550642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 msgr2=0x7f7f280ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:27.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.259+0000 7f7f2759e640 1 --2- 172.21.15.17:0/38550642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f280ad460 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7f2806e910 tx=0x7f7f1802b790 comp rx=0 tx=0).stop 2023-08-09T12:42:27.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.259+0000 7f7f2759e640 1 -- 172.21.15.17:0/38550642 shutdown_connections 2023-08-09T12:42:27.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.259+0000 7f7f2759e640 1 --2- 172.21.15.17:0/38550642 >> v2:172.21.15.142:3300/0 conn(0x7f7f280ce0c0 0x7f7f280ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.259+0000 7f7f2759e640 1 --2- 172.21.15.17:0/38550642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f280ad460 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.259+0000 7f7f2759e640 1 -- 172.21.15.17:0/38550642 >> 172.21.15.17:0/38550642 conn(0x7f7f280cec00 msgr2=0x7f7f280b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:27.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.259+0000 7f7f2759e640 1 -- 172.21.15.17:0/38550642 shutdown_connections 2023-08-09T12:42:27.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.259+0000 7f7f2759e640 1 -- 172.21.15.17:0/38550642 wait complete. 2023-08-09T12:42:27.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.261+0000 7f7f2759e640 1 Processor -- start 2023-08-09T12:42:27.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.261+0000 7f7f2759e640 1 -- start start 2023-08-09T12:42:27.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.262+0000 7f7f2759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f280b2630 0x7f7f2806c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:27.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.262+0000 7f7f2759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f280ce0c0 0x7f7f28158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:27.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.262+0000 7f7f2759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f281f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:27.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.262+0000 7f7f2759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c3e30 con 0x7f7f28159980 2023-08-09T12:42:27.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.262+0000 7f7f2759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281589d0 con 0x7f7f280b2630 2023-08-09T12:42:27.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.262+0000 7f7f2759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2806f010 con 0x7f7f280ce0c0 2023-08-09T12:42:27.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.262+0000 7f7f26d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f281f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:27.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.262+0000 7f7f26d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f281f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54800/0 (socket says 172.21.15.17:54800) 2023-08-09T12:42:27.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f26d9d640 1 -- 172.21.15.17:0/1054862814 learned_addr learned my addr 172.21.15.17:0/1054862814 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:27.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f2659c640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f280b2630 0x7f7f2806c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:27.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f1ffff640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f280ce0c0 0x7f7f28158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:27.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f26d9d640 1 -- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f280ce0c0 msgr2=0x7f7f28158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:27.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f26d9d640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f280ce0c0 0x7f7f28158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f26d9d640 1 -- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f280b2630 msgr2=0x7f7f2806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:27.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f26d9d640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f280b2630 0x7f7f2806c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:27.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f26d9d640 1 -- 172.21.15.17:0/1054862814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180093a0 con 0x7f7f28159980 2023-08-09T12:42:27.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f2659c640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f280b2630 0x7f7f2806c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:27.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.263+0000 7f7f26d9d640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f281f5740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7f20001830 tx=0x7f7f2000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:27.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.264+0000 7f7f1effd640 1 -- 172.21.15.17:0/1054862814 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20012400 con 0x7f7f28159980 2023-08-09T12:42:27.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.264+0000 7f7f1effd640 1 -- 172.21.15.17:0/1054862814 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f20012560 con 0x7f7f28159980 2023-08-09T12:42:27.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.264+0000 7f7f1effd640 1 -- 172.21.15.17:0/1054862814 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20012910 con 0x7f7f28159980 2023-08-09T12:42:27.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.264+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2806ed30 con 0x7f7f28159980 2023-08-09T12:42:27.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.264+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f280c43b0 con 0x7f7f28159980 2023-08-09T12:42:27.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.265+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f280c3c90 con 0x7f7f28159980 2023-08-09T12:42:27.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.266+0000 7f7f1effd640 1 -- 172.21.15.17:0/1054862814 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f20012a70 con 0x7f7f28159980 2023-08-09T12:42:27.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.267+0000 7f7f1effd640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f0806a080 0x7f7f0806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:27.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.267+0000 7f7f1effd640 1 -- 172.21.15.17:0/1054862814 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7f20088a10 con 0x7f7f28159980 2023-08-09T12:42:27.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.268+0000 7f7f2659c640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f0806a080 0x7f7f0806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:27.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.269+0000 7f7f2659c640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f0806a080 0x7f7f0806c540 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7f18034000 tx=0x7f7f1802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.271+0000 7f7f1effd640 1 -- 172.21.15.17:0/1054862814 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7f280c3c90 con 0x7f7f28159980 2023-08-09T12:42:27.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:27.538+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f7f280c3c90 con 0x7f7f28159980 2023-08-09T12:42:28.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.002+0000 7f7f1effd640 1 -- 172.21.15.17:0/1054862814 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v185) v1 ==== 137+0+0 (secure 0 0 0) 0x7f7f280c3c90 con 0x7f7f28159980 2023-08-09T12:42:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.006+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f0806a080 msgr2=0x7f7f0806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.006+0000 7f7f2759e640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f0806a080 0x7f7f0806c540 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7f18034000 tx=0x7f7f1802f000 comp rx=0 tx=0).stop 2023-08-09T12:42:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.006+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 msgr2=0x7f7f281f5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.006+0000 7f7f2759e640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f281f5740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7f20001830 tx=0x7f7f2000a430 comp rx=0 tx=0).stop 2023-08-09T12:42:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.007+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 shutdown_connections 2023-08-09T12:42:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.007+0000 7f7f2759e640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f0806a080 0x7f7f0806c540 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.007+0000 7f7f2759e640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f28159980 0x7f7f281f5740 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.007+0000 7f7f2759e640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f280ce0c0 0x7f7f28158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.007+0000 7f7f2759e640 1 --2- 172.21.15.17:0/1054862814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f280b2630 0x7f7f2806c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.007+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 >> 172.21.15.17:0/1054862814 conn(0x7f7f280cec00 msgr2=0x7f7f280b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:28.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.007+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 shutdown_connections 2023-08-09T12:42:28.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.007+0000 7f7f2759e640 1 -- 172.21.15.17:0/1054862814 wait complete. 2023-08-09T12:42:28.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-09T12:42:28.281 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_objectstore":"memstore"} 2023-08-09T12:42:28.281 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-09T12:42:28.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:28.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.508+0000 7fe897d47640 1 Processor -- start 2023-08-09T12:42:28.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.508+0000 7fe897d47640 1 -- start start 2023-08-09T12:42:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.509+0000 7fe897d47640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe8901608c0 0x7fe89006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.509+0000 7fe897d47640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe8900cc7a0 0x7fe8900ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.509+0000 7fe897d47640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe890157780 con 0x7fe8901573a0 2023-08-09T12:42:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.510+0000 7fe897d47640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89015d4e0 con 0x7fe8900cc7a0 2023-08-09T12:42:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.510+0000 7fe897d47640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900cd150 con 0x7fe8901608c0 2023-08-09T12:42:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.510+0000 7fe8962e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe8900cc7a0 0x7fe8900ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.510+0000 7fe8962e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe8900cc7a0 0x7fe8900ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50882/0 (socket says 172.21.15.17:50882) 2023-08-09T12:42:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.510+0000 7fe8962e4640 1 -- 172.21.15.17:0/1946291444 learned_addr learned my addr 172.21.15.17:0/1946291444 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:28.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.510+0000 7fe8952e2640 1 --2- 172.21.15.17:0/1946291444 >> v2:172.21.15.142:3300/0 conn(0x7fe8901608c0 0x7fe89006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.510+0000 7fe8962e4640 1 -- 172.21.15.17:0/1946291444 >> v2:172.21.15.142:3300/0 conn(0x7fe8901608c0 msgr2=0x7fe89006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.510+0000 7fe8962e4640 1 --2- 172.21.15.17:0/1946291444 >> v2:172.21.15.142:3300/0 conn(0x7fe8901608c0 0x7fe89006abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.511+0000 7fe8962e4640 1 -- 172.21.15.17:0/1946291444 >> v1:172.21.15.142:6789/0 conn(0x7fe8901573a0 legacy=0x7fe89006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.511+0000 7fe8962e4640 1 -- 172.21.15.17:0/1946291444 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890160e80 con 0x7fe8900cc7a0 2023-08-09T12:42:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.512+0000 7fe8962e4640 1 --2- 172.21.15.17:0/1946291444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8900cc7a0 0x7fe8900ccc10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe890066900 tx=0x7fe88802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7965bfce2a0098 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.512+0000 7fe894ae1640 1 -- 172.21.15.17:0/1946291444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88802c960 con 0x7fe8900cc7a0 2023-08-09T12:42:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.512+0000 7fe894ae1640 1 -- 172.21.15.17:0/1946291444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88802cac0 con 0x7fe8900cc7a0 2023-08-09T12:42:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.512+0000 7fe894ae1640 1 -- 172.21.15.17:0/1946291444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88802ce50 con 0x7fe8900cc7a0 2023-08-09T12:42:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.513+0000 7fe897d47640 1 -- 172.21.15.17:0/1946291444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8900cc7a0 msgr2=0x7fe8900ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.513+0000 7fe897d47640 1 --2- 172.21.15.17:0/1946291444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8900cc7a0 0x7fe8900ccc10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe890066900 tx=0x7fe88802bdc0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.513+0000 7fe897d47640 1 -- 172.21.15.17:0/1946291444 shutdown_connections 2023-08-09T12:42:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.513+0000 7fe897d47640 1 --2- 172.21.15.17:0/1946291444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8900cc7a0 0x7fe8900ccc10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.513+0000 7fe897d47640 1 --2- 172.21.15.17:0/1946291444 >> v2:172.21.15.142:3300/0 conn(0x7fe8901608c0 0x7fe89006abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.513+0000 7fe897d47640 1 -- 172.21.15.17:0/1946291444 >> 172.21.15.17:0/1946291444 conn(0x7fe8900cec60 msgr2=0x7fe8900cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.513+0000 7fe897d47640 1 -- 172.21.15.17:0/1946291444 shutdown_connections 2023-08-09T12:42:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.513+0000 7fe897d47640 1 -- 172.21.15.17:0/1946291444 wait complete. 2023-08-09T12:42:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.515+0000 7fe897d47640 1 Processor -- start 2023-08-09T12:42:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.515+0000 7fe897d47640 1 -- start start 2023-08-09T12:42:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe897d47640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8900cc7a0 0x7fe890153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe897d47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8901573a0 0x7fe8900b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe897d47640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8901608c0 0x7fe8900b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe897d47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe890154a80 con 0x7fe8901573a0 2023-08-09T12:42:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe897d47640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900c6fe0 con 0x7fe8901608c0 2023-08-09T12:42:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe897d47640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900afb80 con 0x7fe8900cc7a0 2023-08-09T12:42:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe8952e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8901573a0 0x7fe8900b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe8952e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8901573a0 0x7fe8900b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50896/0 (socket says 172.21.15.17:50896) 2023-08-09T12:42:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.516+0000 7fe8952e2640 1 -- 172.21.15.17:0/3765155553 learned_addr learned my addr 172.21.15.17:0/3765155553 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:28.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8952e2640 1 -- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8900cc7a0 msgr2=0x7fe890153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8952e2640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8900cc7a0 0x7fe890153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8952e2640 1 -- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8901608c0 msgr2=0x7fe8900b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8962e4640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8901608c0 0x7fe8900b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8952e2640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8901608c0 0x7fe8900b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8952e2640 1 -- 172.21.15.17:0/3765155553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888009b30 con 0x7fe8901573a0 2023-08-09T12:42:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8952e2640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8901573a0 0x7fe8900b05c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d5f0 tx=0x7fe88000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8867fc640 1 -- 172.21.15.17:0/3765155553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8800125f0 con 0x7fe8901573a0 2023-08-09T12:42:28.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8867fc640 1 -- 172.21.15.17:0/3765155553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe880012750 con 0x7fe8901573a0 2023-08-09T12:42:28.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe8867fc640 1 -- 172.21.15.17:0/3765155553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880012b00 con 0x7fe8901573a0 2023-08-09T12:42:28.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.517+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8900c66b0 con 0x7fe8901573a0 2023-08-09T12:42:28.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.518+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8900c6c70 con 0x7fe8901573a0 2023-08-09T12:42:28.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.519+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8901606b0 con 0x7fe8901573a0 2023-08-09T12:42:28.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.520+0000 7fe8867fc640 1 -- 172.21.15.17:0/3765155553 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe880012c60 con 0x7fe8901573a0 2023-08-09T12:42:28.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.521+0000 7fe8867fc640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe87406a080 0x7fe87406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.521+0000 7fe8867fc640 1 -- 172.21.15.17:0/3765155553 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe880088790 con 0x7fe8901573a0 2023-08-09T12:42:28.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.521+0000 7fe895ae3640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe87406a080 0x7fe87406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.523+0000 7fe895ae3640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe87406a080 0x7fe87406c540 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009650 tx=0x7fe88c006bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.525+0000 7fe8867fc640 1 -- 172.21.15.17:0/3765155553 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe880054100 con 0x7fe8901573a0 2023-08-09T12:42:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.719+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe890067a80 con 0x7fe8901573a0 2023-08-09T12:42:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.721+0000 7fe8867fc640 1 -- 172.21.15.17:0/3765155553 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+14746 (secure 0 0 0) 0x7fe880057720 con 0x7fe8901573a0 2023-08-09T12:42:28.724 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":62,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:24.971611+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6837/2725761547":"2023-08-10T12:42:21.953621+0000","172.21.15.142:6836/2725761547":"2023-08-10T12:42:21.953621+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:28.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe87406a080 msgr2=0x7fe87406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe87406a080 0x7fe87406c540 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009650 tx=0x7fe88c006bb0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8901573a0 msgr2=0x7fe8900b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8901573a0 0x7fe8900b05c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d5f0 tx=0x7fe88000dab0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 shutdown_connections 2023-08-09T12:42:28.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe87406a080 0x7fe87406c540 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8901608c0 0x7fe8900b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8901573a0 0x7fe8900b05c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 --2- 172.21.15.17:0/3765155553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8900cc7a0 0x7fe890153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 >> 172.21.15.17:0/3765155553 conn(0x7fe8900cec60 msgr2=0x7fe8900caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:28.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 shutdown_connections 2023-08-09T12:42:28.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.724+0000 7fe897d47640 1 -- 172.21.15.17:0/3765155553 wait complete. 2023-08-09T12:42:28.747 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:42:28.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:42:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.980+0000 7f28b2557640 1 Processor -- start 2023-08-09T12:42:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.980+0000 7f28b2557640 1 -- start start 2023-08-09T12:42:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.982+0000 7f28b2557640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.982+0000 7f28b2557640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28ac0cd400 0x7f28ac06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.982+0000 7f28b2557640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0cd860 con 0x7f28ac070060 2023-08-09T12:42:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.982+0000 7f28b2557640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac070890 con 0x7f28ac0cd400 2023-08-09T12:42:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.982+0000 7f28b2557640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac15a940 con 0x7f28ac159250 2023-08-09T12:42:28.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.983+0000 7f28a3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28ac0cd400 0x7f28ac06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.983+0000 7f28abfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.983+0000 7f28abfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:43710/0 (socket says 172.21.15.17:43710) 2023-08-09T12:42:28.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.983+0000 7f28abfff640 1 -- 172.21.15.17:0/721808300 learned_addr learned my addr 172.21.15.17:0/721808300 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.983+0000 7f28a3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28ac0cd400 0x7f28ac06fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:46656/0 (socket says 172.21.15.17:46656) 2023-08-09T12:42:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.984+0000 7f28a3fff640 1 -- 172.21.15.17:0/721808300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 msgr2=0x7f28ac0ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.984+0000 7f28a3fff640 1 --2- 172.21.15.17:0/721808300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.984+0000 7f28a3fff640 1 -- 172.21.15.17:0/721808300 >> v1:172.21.15.142:6789/0 conn(0x7f28ac070060 legacy=0x7f28ac159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.984+0000 7f28a3fff640 1 -- 172.21.15.17:0/721808300 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac15ab90 con 0x7f28ac0cd400 2023-08-09T12:42:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.984+0000 7f28abfff640 1 --2- 172.21.15.17:0/721808300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:42:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.985+0000 7f28a3fff640 1 --2- 172.21.15.17:0/721808300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 0x7f28ac06fb20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2894009790 tx=0x7f289402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fce3b947a1c01c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.986+0000 7f28ab7fe640 1 -- 172.21.15.17:0/721808300 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289402d040 con 0x7f28ac0cd400 2023-08-09T12:42:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.986+0000 7f28ab7fe640 1 -- 172.21.15.17:0/721808300 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2894031810 con 0x7f28ac0cd400 2023-08-09T12:42:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.986+0000 7f28ab7fe640 1 -- 172.21.15.17:0/721808300 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894031ba0 con 0x7f28ac0cd400 2023-08-09T12:42:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.986+0000 7f28b2557640 1 -- 172.21.15.17:0/721808300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 msgr2=0x7f28ac06fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.986+0000 7f28b2557640 1 --2- 172.21.15.17:0/721808300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 0x7f28ac06fb20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2894009790 tx=0x7f289402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.987+0000 7f28b2557640 1 -- 172.21.15.17:0/721808300 shutdown_connections 2023-08-09T12:42:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.987+0000 7f28b2557640 1 --2- 172.21.15.17:0/721808300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 0x7f28ac06fb20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.987+0000 7f28b2557640 1 --2- 172.21.15.17:0/721808300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.987+0000 7f28b2557640 1 -- 172.21.15.17:0/721808300 >> 172.21.15.17:0/721808300 conn(0x7f28ac0cb1b0 msgr2=0x7f28ac0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:28.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.987+0000 7f28b2557640 1 -- 172.21.15.17:0/721808300 shutdown_connections 2023-08-09T12:42:28.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.987+0000 7f28b2557640 1 -- 172.21.15.17:0/721808300 wait complete. 2023-08-09T12:42:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.989+0000 7f28b2557640 1 Processor -- start 2023-08-09T12:42:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.989+0000 7f28b2557640 1 -- start start 2023-08-09T12:42:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.990+0000 7f28b2557640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28ac070060 0x7f28ac0b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.990+0000 7f28b2557640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 0x7f28ac154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.990+0000 7f28b2557640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.990+0000 7f28b2557640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0c7340 con 0x7f28ac070060 2023-08-09T12:42:28.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.990+0000 7f28b2557640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0c75b0 con 0x7f28ac0cd400 2023-08-09T12:42:28.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.990+0000 7f28b2557640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0c7890 con 0x7f28ac159250 2023-08-09T12:42:28.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28ac070060 0x7f28ac0b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28ac070060 0x7f28ac0b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50906/0 (socket says 172.21.15.17:50906) 2023-08-09T12:42:28.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28abfff640 1 -- 172.21.15.17:0/3759104356 learned_addr learned my addr 172.21.15.17:0/3759104356 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:28.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28b0af4640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28a3fff640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 0x7f28ac154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:28.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28abfff640 1 -- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 msgr2=0x7f28ac0ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28abfff640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28abfff640 1 -- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 msgr2=0x7f28ac154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:28.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28abfff640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 0x7f28ac154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:28.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.991+0000 7f28abfff640 1 -- 172.21.15.17:0/3759104356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c00b770 con 0x7f28ac070060 2023-08-09T12:42:28.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.992+0000 7f28abfff640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28ac070060 0x7f28ac0b0110 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f289c00ed40 tx=0x7f289c00d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:28.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.992+0000 7f28a97fa640 1 -- 172.21.15.17:0/3759104356 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c019680 con 0x7f28ac070060 2023-08-09T12:42:28.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.992+0000 7f28a97fa640 1 -- 172.21.15.17:0/3759104356 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c0197e0 con 0x7f28ac070060 2023-08-09T12:42:28.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.992+0000 7f28a97fa640 1 -- 172.21.15.17:0/3759104356 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c019b50 con 0x7f28ac070060 2023-08-09T12:42:28.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.992+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28940093a0 con 0x7f28ac070060 2023-08-09T12:42:28.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.992+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac0ade20 con 0x7f28ac070060 2023-08-09T12:42:28.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.993+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac067a80 con 0x7f28ac070060 2023-08-09T12:42:28.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.995+0000 7f28a97fa640 1 -- 172.21.15.17:0/3759104356 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f289c010440 con 0x7f28ac070060 2023-08-09T12:42:28.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.996+0000 7f28a97fa640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f288c06a050 0x7f288c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.996+0000 7f28a97fa640 1 -- 172.21.15.17:0/3759104356 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f289c014070 con 0x7f28ac070060 2023-08-09T12:42:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.996+0000 7f28a3fff640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f288c06a050 0x7f288c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:28.998+0000 7f28a3fff640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f288c06a050 0x7f288c06c510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2894036000 tx=0x7f289403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:29.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.001+0000 7f28a97fa640 1 -- 172.21.15.17:0/3759104356 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f289c054870 con 0x7f28ac070060 2023-08-09T12:42:29.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.193+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28ac06f670 con 0x7f28ac070060 2023-08-09T12:42:29.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.194+0000 7f28a97fa640 1 -- 172.21.15.17:0/3759104356 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f289c057e90 con 0x7f28ac070060 2023-08-09T12:42:29.201 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:42:29.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f288c06a050 msgr2=0x7f288c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f288c06a050 0x7f288c06c510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2894036000 tx=0x7f289403c040 comp rx=0 tx=0).stop 2023-08-09T12:42:29.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28ac070060 msgr2=0x7f28ac0b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28ac070060 0x7f28ac0b0110 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f289c00ed40 tx=0x7f289c00d720 comp rx=0 tx=0).stop 2023-08-09T12:42:29.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 shutdown_connections 2023-08-09T12:42:29.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f288c06a050 0x7f288c06c510 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28ac159250 0x7f28ac0ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac0cd400 0x7f28ac154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 --2- 172.21.15.17:0/3759104356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28ac070060 0x7f28ac0b0110 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 >> 172.21.15.17:0/3759104356 conn(0x7f28ac0cb1b0 msgr2=0x7f28ac0c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:29.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 shutdown_connections 2023-08-09T12:42:29.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.197+0000 7f28b2557640 1 -- 172.21.15.17:0/3759104356 wait complete. 2023-08-09T12:42:29.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:42:29.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.454+0000 7fda11071640 1 Processor -- start 2023-08-09T12:42:29.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.454+0000 7fda11071640 1 -- start start 2023-08-09T12:42:29.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda11071640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda0c163c10 0x7fda0c166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda11071640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c06c990 con 0x7fda0c0adc40 2023-08-09T12:42:29.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda11071640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c0b2250 con 0x7fda0c0b3b40 2023-08-09T12:42:29.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda11071640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0ae020 con 0x7fda0c163c10 2023-08-09T12:42:29.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda0ad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fda0c0adc40 0x7fda0c06c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59396/0 (socket says 172.21.15.17:59396) 2023-08-09T12:42:29.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda0ad9d640 1 -- 172.21.15.17:0/2229297157 learned_addr learned my addr 172.21.15.17:0/2229297157 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:29.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda0b59e640 1 --2- 172.21.15.17:0/2229297157 >> v2:172.21.15.142:3300/0 conn(0x7fda0c163c10 0x7fda0c166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063374052 0 0) 0x7fda0c06c990 con 0x7fda0c0adc40 2023-08-09T12:42:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f4003520 con 0x7fda0c0adc40 2023-08-09T12:42:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3943239465 0 0) 0x7fd9f4003520 con 0x7fda0c0adc40 2023-08-09T12:42:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 >> v2:172.21.15.142:3300/0 conn(0x7fda0c163c10 msgr2=0x7fda0c166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.456+0000 7fda09d9b640 1 --2- 172.21.15.17:0/2229297157 >> v2:172.21.15.142:3300/0 conn(0x7fda0c163c10 0x7fda0c166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 >> v1:172.21.15.142:6789/0 conn(0x7fda0c0b3b40 legacy=0x7fda0c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0b2530 con 0x7fda0c0adc40 2023-08-09T12:42:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fd9fc001670 con 0x7fda0c0adc40 2023-08-09T12:42:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 >> v1:172.21.15.17:6789/0 conn(0x7fda0c0adc40 legacy=0x7fda0c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fd9f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40047c0 0x7fd9f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4005180 0x7fd9f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0ae020 con 0x7fd9f4003970 2023-08-09T12:42:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f400c120 con 0x7fd9f4005180 2023-08-09T12:42:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f400c2e0 con 0x7fd9f40047c0 2023-08-09T12:42:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda0ad9d640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fd9f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda0b59e640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4005180 0x7fd9f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.457+0000 7fda0a59c640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40047c0 0x7fd9f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.458+0000 7fda0ad9d640 1 -- 172.21.15.17:0/2229297157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40047c0 msgr2=0x7fd9f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.458+0000 7fda0ad9d640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40047c0 0x7fd9f4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.458+0000 7fda0ad9d640 1 -- 172.21.15.17:0/2229297157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4005180 msgr2=0x7fd9f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.458+0000 7fda0ad9d640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4005180 0x7fd9f400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.458+0000 7fda0ad9d640 1 -- 172.21.15.17:0/2229297157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4003520 con 0x7fd9f4003970 2023-08-09T12:42:29.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.458+0000 7fda0b59e640 1 -- 172.21.15.17:0/2229297157 reap_dead start 2023-08-09T12:42:29.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda0ad9d640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fd9f4003d90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c240 tx=0x7fd9f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7914fadabfe4cf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:29.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc005ad0 con 0x7fd9f4003970 2023-08-09T12:42:29.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc005c50 con 0x7fd9f4003970 2023-08-09T12:42:29.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda09d9b640 1 -- 172.21.15.17:0/2229297157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc02c830 con 0x7fd9f4003970 2023-08-09T12:42:29.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda11071640 1 -- 172.21.15.17:0/2229297157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 msgr2=0x7fd9f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda11071640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fd9f4003d90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c240 tx=0x7fd9f40057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda11071640 1 -- 172.21.15.17:0/2229297157 shutdown_connections 2023-08-09T12:42:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda11071640 1 --2- 172.21.15.17:0/2229297157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fd9f4003d90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda11071640 1 -- 172.21.15.17:0/2229297157 >> 172.21.15.17:0/2229297157 conn(0x7fda0c0cb1b0 msgr2=0x7fda0c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda11071640 1 -- 172.21.15.17:0/2229297157 shutdown_connections 2023-08-09T12:42:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.460+0000 7fda11071640 1 -- 172.21.15.17:0/2229297157 wait complete. 2023-08-09T12:42:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.462+0000 7fda11071640 1 Processor -- start 2023-08-09T12:42:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.462+0000 7fda11071640 1 -- start start 2023-08-09T12:42:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda11071640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fda0c1627c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda11071640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda0c162d00 0x7fda0c0c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda11071640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda0c0c3800 0x7fda0c0c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda11071640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c1567b0 con 0x7fd9f4003970 2023-08-09T12:42:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda11071640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c15f570 con 0x7fda0c162d00 2023-08-09T12:42:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda11071640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c15e960 con 0x7fda0c0c3800 2023-08-09T12:42:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda0ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fda0c1627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda0ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fda0c1627c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50932/0 (socket says 172.21.15.17:50932) 2023-08-09T12:42:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.463+0000 7fda0ad9d640 1 -- 172.21.15.17:0/2731165485 learned_addr learned my addr 172.21.15.17:0/2731165485 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0a59c640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda0c162d00 0x7fda0c0c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0b59e640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda0c0c3800 0x7fda0c0c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0ad9d640 1 -- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda0c0c3800 msgr2=0x7fda0c0c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0ad9d640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda0c0c3800 0x7fda0c0c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0ad9d640 1 -- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda0c162d00 msgr2=0x7fda0c0c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0ad9d640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda0c162d00 0x7fda0c0c32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0ad9d640 1 -- 172.21.15.17:0/2731165485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c15ec40 con 0x7fd9f4003970 2023-08-09T12:42:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0a59c640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda0c162d00 0x7fda0c0c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fda0ad9d640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fda0c1627c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc02c3d0 tx=0x7fd9fc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.464+0000 7fd9f37fe640 1 -- 172.21.15.17:0/2731165485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc03c040 con 0x7fd9f4003970 2023-08-09T12:42:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.465+0000 7fd9f37fe640 1 -- 172.21.15.17:0/2731165485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc02cc40 con 0x7fd9f4003970 2023-08-09T12:42:29.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.465+0000 7fd9f37fe640 1 -- 172.21.15.17:0/2731165485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc007070 con 0x7fd9f4003970 2023-08-09T12:42:29.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.465+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c15ef20 con 0x7fd9f4003970 2023-08-09T12:42:29.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.465+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c163180 con 0x7fd9f4003970 2023-08-09T12:42:29.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.466+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c06fe60 con 0x7fd9f4003970 2023-08-09T12:42:29.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.467+0000 7fd9f37fe640 1 -- 172.21.15.17:0/2731165485 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd9fc032070 con 0x7fd9f4003970 2023-08-09T12:42:29.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.468+0000 7fd9f37fe640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9f806a080 0x7fd9f806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.468+0000 7fd9f37fe640 1 -- 172.21.15.17:0/2731165485 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd9fc0a8f60 con 0x7fd9f4003970 2023-08-09T12:42:29.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.469+0000 7fda0a59c640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9f806a080 0x7fd9f806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.470+0000 7fda0a59c640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9f806a080 0x7fd9f806c540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda0c1f15a0 tx=0x7fda00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.473+0000 7fd9f37fe640 1 -- 172.21.15.17:0/2731165485 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fda0c06fe60 con 0x7fd9f4003970 2023-08-09T12:42:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.670+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda0c06fe60 con 0x7fd9f4003970 2023-08-09T12:42:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.672+0000 7fd9f37fe640 1 -- 172.21.15.17:0/2731165485 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda0c06fe60 con 0x7fd9f4003970 2023-08-09T12:42:29.675 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:42:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.674+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9f806a080 msgr2=0x7fd9f806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.674+0000 7fda11071640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9f806a080 0x7fd9f806c540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda0c1f15a0 tx=0x7fda00009040 comp rx=0 tx=0).stop 2023-08-09T12:42:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.674+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 msgr2=0x7fda0c1627c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.674+0000 7fda11071640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fda0c1627c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc02c3d0 tx=0x7fd9fc02e070 comp rx=0 tx=0).stop 2023-08-09T12:42:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.674+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 shutdown_connections 2023-08-09T12:42:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.674+0000 7fda11071640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9f806a080 0x7fd9f806c540 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.675+0000 7fda11071640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda0c0c3800 0x7fda0c0c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.675+0000 7fda11071640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda0c162d00 0x7fda0c0c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.675+0000 7fda11071640 1 --2- 172.21.15.17:0/2731165485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f4003970 0x7fda0c1627c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.675+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 >> 172.21.15.17:0/2731165485 conn(0x7fda0c0cb1b0 msgr2=0x7fda0c15db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.675+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 shutdown_connections 2023-08-09T12:42:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.675+0000 7fda11071640 1 -- 172.21.15.17:0/2731165485 wait complete. 2023-08-09T12:42:29.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:42:29.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.930+0000 7fa82aef5640 1 Processor -- start 2023-08-09T12:42:29.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.930+0000 7fa82aef5640 1 -- start start 2023-08-09T12:42:29.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa82aef5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8240cd270 0x7fa82406a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa82aef5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240b1d90 0x7fa8240cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa82aef5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82406b170 con 0x7fa82415ce30 2023-08-09T12:42:29.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa82aef5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8240cdb90 con 0x7fa8240cd270 2023-08-09T12:42:29.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa82aef5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82406a8d0 con 0x7fa8240b1d90 2023-08-09T12:42:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa82a6f4640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa82415ce30 0x7fa82415d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59406/0 (socket says 172.21.15.17:59406) 2023-08-09T12:42:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa82a6f4640 1 -- 172.21.15.17:0/1752983863 learned_addr learned my addr 172.21.15.17:0/1752983863 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa829ef3640 1 --2- 172.21.15.17:0/1752983863 >> v2:172.21.15.142:3300/0 conn(0x7fa8240cd270 0x7fa82406a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa8296f2640 1 --2- 172.21.15.17:0/1752983863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240b1d90 0x7fa8240cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa828ef1640 1 -- 172.21.15.17:0/1752983863 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118952630 0 0) 0x7fa82406b170 con 0x7fa82415ce30 2023-08-09T12:42:29.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.932+0000 7fa828ef1640 1 -- 172.21.15.17:0/1752983863 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa810003520 con 0x7fa82415ce30 2023-08-09T12:42:29.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.933+0000 7fa829ef3640 1 -- 172.21.15.17:0/1752983863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240b1d90 msgr2=0x7fa8240cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:29.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.933+0000 7fa829ef3640 1 --2- 172.21.15.17:0/1752983863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240b1d90 0x7fa8240cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.933+0000 7fa828ef1640 1 -- 172.21.15.17:0/1752983863 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978450211 0 0) 0x7fa810003520 con 0x7fa82415ce30 2023-08-09T12:42:29.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.933+0000 7fa829ef3640 1 -- 172.21.15.17:0/1752983863 >> v1:172.21.15.17:6789/0 conn(0x7fa82415ce30 legacy=0x7fa82415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.933+0000 7fa829ef3640 1 -- 172.21.15.17:0/1752983863 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82406abb0 con 0x7fa8240cd270 2023-08-09T12:42:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.934+0000 7fa829ef3640 1 --2- 172.21.15.17:0/1752983863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240cd270 0x7fa82406a1d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa820009d90 tx=0x7fa82002bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63fa69a90a75b4a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa828ef1640 1 -- 172.21.15.17:0/1752983863 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c001670 con 0x7fa8240cd270 2023-08-09T12:42:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa828ef1640 1 -- 172.21.15.17:0/1752983863 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82002c810 con 0x7fa8240cd270 2023-08-09T12:42:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa828ef1640 1 -- 172.21.15.17:0/1752983863 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82002cb80 con 0x7fa8240cd270 2023-08-09T12:42:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa82aef5640 1 -- 172.21.15.17:0/1752983863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240cd270 msgr2=0x7fa82406a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa82aef5640 1 --2- 172.21.15.17:0/1752983863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240cd270 0x7fa82406a1d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa820009d90 tx=0x7fa82002bce0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa82aef5640 1 -- 172.21.15.17:0/1752983863 shutdown_connections 2023-08-09T12:42:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa82aef5640 1 --2- 172.21.15.17:0/1752983863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240b1d90 0x7fa8240cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa82aef5640 1 --2- 172.21.15.17:0/1752983863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240cd270 0x7fa82406a1d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.935+0000 7fa82aef5640 1 -- 172.21.15.17:0/1752983863 >> 172.21.15.17:0/1752983863 conn(0x7fa8240d2a10 msgr2=0x7fa8240d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.936+0000 7fa82aef5640 1 -- 172.21.15.17:0/1752983863 shutdown_connections 2023-08-09T12:42:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.936+0000 7fa82aef5640 1 -- 172.21.15.17:0/1752983863 wait complete. 2023-08-09T12:42:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.938+0000 7fa82aef5640 1 Processor -- start 2023-08-09T12:42:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.938+0000 7fa82aef5640 1 -- start start 2023-08-09T12:42:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.938+0000 7fa82aef5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240b1d90 0x7fa8241f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.938+0000 7fa82aef5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240cd270 0x7fa8241f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.938+0000 7fa82aef5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82415ce30 0x7fa82415f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.938+0000 7fa82aef5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240a9380 con 0x7fa82415ce30 2023-08-09T12:42:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.938+0000 7fa82aef5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8241f30f0 con 0x7fa8240b1d90 2023-08-09T12:42:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.938+0000 7fa82aef5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8241f5b20 con 0x7fa8240cd270 2023-08-09T12:42:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82415ce30 0x7fa82415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82415ce30 0x7fa82415f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50942/0 (socket says 172.21.15.17:50942) 2023-08-09T12:42:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 -- 172.21.15.17:0/2553898932 learned_addr learned my addr 172.21.15.17:0/2553898932 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa8296f2640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240cd270 0x7fa8241f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa829ef3640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240b1d90 0x7fa8241f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 -- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240cd270 msgr2=0x7fa8241f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240cd270 0x7fa8241f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 -- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240b1d90 msgr2=0x7fa8241f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240b1d90 0x7fa8241f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 -- 172.21.15.17:0/2553898932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa820009a70 con 0x7fa82415ce30 2023-08-09T12:42:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa829ef3640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240b1d90 0x7fa8241f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.939+0000 7fa82a6f4640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82415ce30 0x7fa82415f300 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa81c007fd0 tx=0x7fa81c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.940+0000 7fa81a7fc640 1 -- 172.21.15.17:0/2553898932 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c005ce0 con 0x7fa82415ce30 2023-08-09T12:42:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.940+0000 7fa81a7fc640 1 -- 172.21.15.17:0/2553898932 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c005e40 con 0x7fa82415ce30 2023-08-09T12:42:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.940+0000 7fa81a7fc640 1 -- 172.21.15.17:0/2553898932 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c007290 con 0x7fa82415ce30 2023-08-09T12:42:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.940+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8241f5e00 con 0x7fa82415ce30 2023-08-09T12:42:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.940+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8241f63c0 con 0x7fa82415ce30 2023-08-09T12:42:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.941+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8240a94c0 con 0x7fa82415ce30 2023-08-09T12:42:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.942+0000 7fa81a7fc640 1 -- 172.21.15.17:0/2553898932 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa81c0073f0 con 0x7fa82415ce30 2023-08-09T12:42:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.943+0000 7fa81a7fc640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80806a050 0x7fa80806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.943+0000 7fa81a7fc640 1 -- 172.21.15.17:0/2553898932 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa81c087f80 con 0x7fa82415ce30 2023-08-09T12:42:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.944+0000 7fa829ef3640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80806a050 0x7fa80806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.945+0000 7fa829ef3640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80806a050 0x7fa80806c510 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa820036000 tx=0x7fa820030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:29.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:29.947+0000 7fa81a7fc640 1 -- 172.21.15.17:0/2553898932 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa8240a94c0 con 0x7fa82415ce30 2023-08-09T12:42:30.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.143+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa8240a94c0 con 0x7fa82415ce30 2023-08-09T12:42:30.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.150+0000 7fa81a7fc640 1 -- 172.21.15.17:0/2553898932 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8240a94c0 con 0x7fa82415ce30 2023-08-09T12:42:30.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80806a050 msgr2=0x7fa80806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:30.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80806a050 0x7fa80806c510 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa820036000 tx=0x7fa820030000 comp rx=0 tx=0).stop 2023-08-09T12:42:30.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82415ce30 msgr2=0x7fa82415f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:30.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82415ce30 0x7fa82415f300 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa81c007fd0 tx=0x7fa81c00c9b0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 shutdown_connections 2023-08-09T12:42:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80806a050 0x7fa80806c510 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82415ce30 0x7fa82415f300 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8240cd270 0x7fa8241f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 --2- 172.21.15.17:0/2553898932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8240b1d90 0x7fa8241f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 >> 172.21.15.17:0/2553898932 conn(0x7fa8240d2a10 msgr2=0x7fa8240b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 shutdown_connections 2023-08-09T12:42:30.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.152+0000 7fa82aef5640 1 -- 172.21.15.17:0/2553898932 wait complete. 2023-08-09T12:42:30.173 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:42:30.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:42:30.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:42:30.426 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:42:30.426 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:42:30.427 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:30.492 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:42:30.493 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:42:30.493 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:30.553 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:42:30.554 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:42:30.554 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:30.619 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:42:30.619 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:42:30.620 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:30.678 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:42:30.678 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:42:30.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:30.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.920+0000 7f8dd1f0f640 1 Processor -- start 2023-08-09T12:42:30.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.920+0000 7f8dd1f0f640 1 -- start start 2023-08-09T12:42:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.921+0000 7f8dd1f0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161280 0x7f8dcc0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.921+0000 7f8dd1f0f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8dcc161660 0x7f8dcc0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.921+0000 7f8dd1f0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc15df30 con 0x7f8dcc0ca450 2023-08-09T12:42:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.921+0000 7f8dd1f0f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dcc15d430 con 0x7f8dcc161660 2023-08-09T12:42:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.921+0000 7f8dd1f0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0ca9d0 con 0x7f8dcc161280 2023-08-09T12:42:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.921+0000 7f8dc3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8dcc161660 0x7f8dcc0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.922+0000 7f8dc3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8dcc161660 0x7f8dcc0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50954/0 (socket says 172.21.15.17:50954) 2023-08-09T12:42:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.922+0000 7f8dc3fff640 1 -- 172.21.15.17:0/192884357 learned_addr learned my addr 172.21.15.17:0/192884357 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.922+0000 7f8dcb7fe640 1 --2- 172.21.15.17:0/192884357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161280 0x7f8dcc0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.922+0000 7f8dc3fff640 1 -- 172.21.15.17:0/192884357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161280 msgr2=0x7f8dcc0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.922+0000 7f8dc3fff640 1 --2- 172.21.15.17:0/192884357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161280 0x7f8dcc0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.922+0000 7f8dc3fff640 1 -- 172.21.15.17:0/192884357 >> v1:172.21.15.142:6789/0 conn(0x7f8dcc0ca450 legacy=0x7f8dcc0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:30.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.922+0000 7f8dc3fff640 1 -- 172.21.15.17:0/192884357 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc15e3c0 con 0x7f8dcc161660 2023-08-09T12:42:30.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.922+0000 7f8dcb7fe640 1 --2- 172.21.15.17:0/192884357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161280 0x7f8dcc0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.923+0000 7f8dc3fff640 1 --2- 172.21.15.17:0/192884357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc161660 0x7f8dcc0ac8b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009850 tx=0x7f8db402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9500c2a075fcd6a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.924+0000 7f8dcaffd640 1 -- 172.21.15.17:0/192884357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db402e070 con 0x7f8dcc161660 2023-08-09T12:42:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.924+0000 7f8dcaffd640 1 -- 172.21.15.17:0/192884357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db4004030 con 0x7f8dcc161660 2023-08-09T12:42:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.924+0000 7f8dcaffd640 1 -- 172.21.15.17:0/192884357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4004420 con 0x7f8dcc161660 2023-08-09T12:42:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.924+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/192884357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc161660 msgr2=0x7f8dcc0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.924+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/192884357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc161660 0x7f8dcc0ac8b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009850 tx=0x7f8db402b840 comp rx=0 tx=0).stop 2023-08-09T12:42:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.925+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/192884357 shutdown_connections 2023-08-09T12:42:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.925+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/192884357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc161660 0x7f8dcc0ac8b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.925+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/192884357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161280 0x7f8dcc0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.925+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/192884357 >> 172.21.15.17:0/192884357 conn(0x7f8dcc0cb1b0 msgr2=0x7f8dcc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.925+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/192884357 shutdown_connections 2023-08-09T12:42:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.925+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/192884357 wait complete. 2023-08-09T12:42:30.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.928+0000 7f8dd1f0f640 1 Processor -- start 2023-08-09T12:42:30.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.928+0000 7f8dd1f0f640 1 -- start start 2023-08-09T12:42:30.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dd1f0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc0ca450 0x7f8dcc14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:30.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dd1f0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc161280 0x7f8dcc152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:30.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dd1f0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161660 0x7f8dcc15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dd1f0f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0c4180 con 0x7f8dcc0ca450 2023-08-09T12:42:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dd1f0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc150190 con 0x7f8dcc161280 2023-08-09T12:42:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dd1f0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0c3570 con 0x7f8dcc161660 2023-08-09T12:42:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc0ca450 0x7f8dcc14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc0ca450 0x7f8dcc14fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50966/0 (socket says 172.21.15.17:50966) 2023-08-09T12:42:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 -- 172.21.15.17:0/2017217729 learned_addr learned my addr 172.21.15.17:0/2017217729 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 -- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161660 msgr2=0x7f8dcc15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161660 0x7f8dcc15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 -- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc161280 msgr2=0x7f8dcc152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc161280 0x7f8dcc152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 -- 172.21.15.17:0/2017217729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4009460 con 0x7f8dcc0ca450 2023-08-09T12:42:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dcb7fe640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc0ca450 0x7f8dcc14fc50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00c820 tx=0x7f8dbc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dc8ff9640 1 -- 172.21.15.17:0/2017217729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc007a30 con 0x7f8dcc0ca450 2023-08-09T12:42:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dc8ff9640 1 -- 172.21.15.17:0/2017217729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc007b90 con 0x7f8dcc0ca450 2023-08-09T12:42:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dc8ff9640 1 -- 172.21.15.17:0/2017217729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00ce10 con 0x7f8dcc0ca450 2023-08-09T12:42:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc0c3850 con 0x7f8dcc0ca450 2023-08-09T12:42:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.929+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc0c3e10 con 0x7f8dcc0ca450 2023-08-09T12:42:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.930+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc1550d0 con 0x7f8dcc0ca450 2023-08-09T12:42:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.931+0000 7f8dc8ff9640 1 -- 172.21.15.17:0/2017217729 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8dbc0113f0 con 0x7f8dcc0ca450 2023-08-09T12:42:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.932+0000 7f8dc8ff9640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8dac06a050 0x7f8dac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.932+0000 7f8dc8ff9640 1 -- 172.21.15.17:0/2017217729 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8dbc088450 con 0x7f8dcc0ca450 2023-08-09T12:42:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.933+0000 7f8dc3fff640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8dac06a050 0x7f8dac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.934+0000 7f8dc3fff640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8dac06a050 0x7f8dac06c510 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8db4034000 tx=0x7f8db4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:30.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:30.937+0000 7f8dc8ff9640 1 -- 172.21.15.17:0/2017217729 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8dbc053dc0 con 0x7f8dcc0ca450 2023-08-09T12:42:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.173+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dcc067a80 con 0x7f8dcc0ca450 2023-08-09T12:42:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.174+0000 7f8dc8ff9640 1 -- 172.21.15.17:0/2017217729 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f8dbc01fe90 con 0x7f8dcc0ca450 2023-08-09T12:42:31.177 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:31.177 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4796,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1878733458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1878733458},{"type":"v1","addr":"172.21.15.17:6835","nonce":1878733458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2439385905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2439385905},{"type":"v1","addr":"172.21.15.17:6833","nonce":2439385905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":4930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/525435683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":525435683},{"type":"v1","addr":"172.21.15.142:6835","nonce":525435683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2307614689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2307614689},{"type":"v1","addr":"172.21.15.142:6837","nonce":2307614689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-08-09T12:42:31.177 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2023-08-09T12:42:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8dac06a050 msgr2=0x7f8dac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8dac06a050 0x7f8dac06c510 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8db4034000 tx=0x7f8db4030000 comp rx=0 tx=0).stop 2023-08-09T12:42:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc0ca450 msgr2=0x7f8dcc14fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc0ca450 0x7f8dcc14fc50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00c820 tx=0x7f8dbc00cce0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 shutdown_connections 2023-08-09T12:42:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8dac06a050 0x7f8dac06c510 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc161660 0x7f8dcc15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc161280 0x7f8dcc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 --2- 172.21.15.17:0/2017217729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc0ca450 0x7f8dcc14fc50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 >> 172.21.15.17:0/2017217729 conn(0x7f8dcc0cb1b0 msgr2=0x7f8dcc0697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.178+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 shutdown_connections 2023-08-09T12:42:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.179+0000 7f8dd1f0f640 1 -- 172.21.15.17:0/2017217729 wait complete. 2023-08-09T12:42:31.199 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:42:31.199 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:42:31.199 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:42:31.200 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:42:31.200 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:42:31.200 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:42:31.200 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:42:31.201 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:42:31.201 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:42:31.201 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:42:31.201 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:42:31.201 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:42:31.202 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:42:31.202 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:42:31.202 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:42:31.202 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:42:31.221 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:42:31.222 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:42:31.223 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:42:31.223 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:42:31.228 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:42:31.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:42:31.231 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:42:31.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:42:31.276 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:42:31.277 DEBUG:teuthology.parallel:result is None 2023-08-09T12:42:31.279 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:42:31.279 DEBUG:teuthology.parallel:result is None 2023-08-09T12:42:31.283 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:42:31.284 DEBUG:teuthology.parallel:result is None 2023-08-09T12:42:31.287 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:42:31.288 DEBUG:teuthology.parallel:result is None 2023-08-09T12:42:31.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:42:31.444 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:42:31.446 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:42:31.447 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:42:31.448 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:42:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.490+0000 7f5a7e799640 1 Processor -- start 2023-08-09T12:42:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.491+0000 7f5a7e799640 1 -- start start 2023-08-09T12:42:31.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.492+0000 7f5a7e799640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a781616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:31.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.492+0000 7f5a7e799640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a780b6000 0x7f5a780cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:31.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.492+0000 7f5a7e799640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780b6460 con 0x7f5a780d29d0 2023-08-09T12:42:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.492+0000 7f5a7e799640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a780cda40 con 0x7f5a780b6000 2023-08-09T12:42:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.492+0000 7f5a7e799640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780cdd10 con 0x7f5a7815ce90 2023-08-09T12:42:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a6ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a780b6000 0x7f5a780cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a781616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a6ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a780b6000 0x7f5a780cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:46762/0 (socket says 172.21.15.17:46762) 2023-08-09T12:42:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a781616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:43826/0 (socket says 172.21.15.17:43826) 2023-08-09T12:42:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a6ffff640 1 -- 172.21.15.17:0/634867551 learned_addr learned my addr 172.21.15.17:0/634867551 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a6ffff640 1 -- 172.21.15.17:0/634867551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 msgr2=0x7f5a781616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a6ffff640 1 --2- 172.21.15.17:0/634867551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a781616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a6ffff640 1 -- 172.21.15.17:0/634867551 >> v1:172.21.15.142:6789/0 conn(0x7f5a780d29d0 legacy=0x7f5a780d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:31.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a6ffff640 1 -- 172.21.15.17:0/634867551 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780cdff0 con 0x7f5a780b6000 2023-08-09T12:42:31.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.493+0000 7f5a77fff640 1 --2- 172.21.15.17:0/634867551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a781616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:42:31.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.495+0000 7f5a6ffff640 1 --2- 172.21.15.17:0/634867551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780b6000 0x7f5a780cd500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009870 tx=0x7f5a6002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a743c2b2066110d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:31.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.495+0000 7f5a777fe640 1 -- 172.21.15.17:0/634867551 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60030840 con 0x7f5a780b6000 2023-08-09T12:42:31.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.495+0000 7f5a777fe640 1 -- 172.21.15.17:0/634867551 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a600309a0 con 0x7f5a780b6000 2023-08-09T12:42:31.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.495+0000 7f5a777fe640 1 -- 172.21.15.17:0/634867551 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60030d30 con 0x7f5a780b6000 2023-08-09T12:42:31.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.496+0000 7f5a7e799640 1 -- 172.21.15.17:0/634867551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780b6000 msgr2=0x7f5a780cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.496+0000 7f5a7e799640 1 --2- 172.21.15.17:0/634867551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780b6000 0x7f5a780cd500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009870 tx=0x7f5a6002b980 comp rx=0 tx=0).stop 2023-08-09T12:42:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.496+0000 7f5a7e799640 1 -- 172.21.15.17:0/634867551 shutdown_connections 2023-08-09T12:42:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.496+0000 7f5a7e799640 1 --2- 172.21.15.17:0/634867551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780b6000 0x7f5a780cd500 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.496+0000 7f5a7e799640 1 --2- 172.21.15.17:0/634867551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a781616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.496+0000 7f5a7e799640 1 -- 172.21.15.17:0/634867551 >> 172.21.15.17:0/634867551 conn(0x7f5a7806fde0 msgr2=0x7f5a780701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.496+0000 7f5a7e799640 1 -- 172.21.15.17:0/634867551 shutdown_connections 2023-08-09T12:42:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.496+0000 7f5a7e799640 1 -- 172.21.15.17:0/634867551 wait complete. 2023-08-09T12:42:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.498+0000 7f5a7e799640 1 Processor -- start 2023-08-09T12:42:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.498+0000 7f5a7e799640 1 -- start start 2023-08-09T12:42:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a7e799640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a780b6000 0x7f5a780ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a7e799640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780d29d0 0x7f5a78151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a7e799640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a78154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a7e799640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78156a20 con 0x7f5a780b6000 2023-08-09T12:42:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a7e799640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780caeb0 con 0x7f5a780d29d0 2023-08-09T12:42:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a7e799640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780cb190 con 0x7f5a7815ce90 2023-08-09T12:42:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a780b6000 0x7f5a780ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a780b6000 0x7f5a780ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50996/0 (socket says 172.21.15.17:50996) 2023-08-09T12:42:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a77fff640 1 -- 172.21.15.17:0/1388348357 learned_addr learned my addr 172.21.15.17:0/1388348357 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a7cd36640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a78154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a6ffff640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780d29d0 0x7f5a78151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:31.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a77fff640 1 -- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 msgr2=0x7f5a78154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a77fff640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a78154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a77fff640 1 -- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780d29d0 msgr2=0x7f5a78151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.499+0000 7f5a77fff640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780d29d0 0x7f5a78151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.500+0000 7f5a77fff640 1 -- 172.21.15.17:0/1388348357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68009400 con 0x7f5a780b6000 2023-08-09T12:42:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.500+0000 7f5a77fff640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a780b6000 0x7f5a780ca660 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800e960 tx=0x7f5a6800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.500+0000 7f5a757fa640 1 -- 172.21.15.17:0/1388348357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800ca00 con 0x7f5a780b6000 2023-08-09T12:42:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.500+0000 7f5a757fa640 1 -- 172.21.15.17:0/1388348357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6800cb60 con 0x7f5a780b6000 2023-08-09T12:42:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.500+0000 7f5a757fa640 1 -- 172.21.15.17:0/1388348357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68013470 con 0x7f5a780b6000 2023-08-09T12:42:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.500+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a600094d0 con 0x7f5a780b6000 2023-08-09T12:42:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.500+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a780caba0 con 0x7f5a780b6000 2023-08-09T12:42:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.501+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a78067a80 con 0x7f5a780b6000 2023-08-09T12:42:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.502+0000 7f5a757fa640 1 -- 172.21.15.17:0/1388348357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a680135d0 con 0x7f5a780b6000 2023-08-09T12:42:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.503+0000 7f5a757fa640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5a5806a050 0x7f5a5806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.503+0000 7f5a757fa640 1 -- 172.21.15.17:0/1388348357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5a680884b0 con 0x7f5a780b6000 2023-08-09T12:42:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.504+0000 7f5a6ffff640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5a5806a050 0x7f5a5806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.505+0000 7f5a6ffff640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5a5806a050 0x7f5a5806c510 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5a60036000 tx=0x7f5a60008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:31.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.508+0000 7f5a757fa640 1 -- 172.21.15.17:0/1388348357 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5a68053eb0 con 0x7f5a780b6000 2023-08-09T12:42:31.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:31.715+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5a780ce2a0 con 0x7f5a780b6000 2023-08-09T12:42:32.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.186+0000 7f5a757fa640 1 -- 172.21.15.17:0/1388348357 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5a680574d0 con 0x7f5a780b6000 2023-08-09T12:42:32.189 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:42:32.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.190+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5a5806a050 msgr2=0x7f5a5806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.190+0000 7f5a7e799640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5a5806a050 0x7f5a5806c510 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5a60036000 tx=0x7f5a60008030 comp rx=0 tx=0).stop 2023-08-09T12:42:32.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.190+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a780b6000 msgr2=0x7f5a780ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.190+0000 7f5a7e799640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a780b6000 0x7f5a780ca660 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800e960 tx=0x7f5a6800ee20 comp rx=0 tx=0).stop 2023-08-09T12:42:32.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.191+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 shutdown_connections 2023-08-09T12:42:32.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.191+0000 7f5a7e799640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5a5806a050 0x7f5a5806c510 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.191+0000 7f5a7e799640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a7815ce90 0x7f5a78154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.191+0000 7f5a7e799640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a780d29d0 0x7f5a78151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.191+0000 7f5a7e799640 1 --2- 172.21.15.17:0/1388348357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a780b6000 0x7f5a780ca660 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.191+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 >> 172.21.15.17:0/1388348357 conn(0x7f5a7806fde0 msgr2=0x7f5a78151940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:32.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.191+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 shutdown_connections 2023-08-09T12:42:32.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.191+0000 7f5a7e799640 1 -- 172.21.15.17:0/1388348357 wait complete. 2023-08-09T12:42:32.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:42:32.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.444+0000 7f6765b31640 1 Processor -- start 2023-08-09T12:42:32.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.444+0000 7f6765b31640 1 -- start start 2023-08-09T12:42:32.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.446+0000 7f6765b31640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67600ad810 0x7f67600b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.446+0000 7f6765b31640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67600b4630 con 0x7f6760070a90 2023-08-09T12:42:32.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.446+0000 7f6765b31640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67600b3ab0 con 0x7f6760159d80 2023-08-09T12:42:32.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.446+0000 7f6765b31640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676015a160 con 0x7f67600ad810 2023-08-09T12:42:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.446+0000 7f6757fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6760070a90 0x7f67600c8fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59420/0 (socket says 172.21.15.17:59420) 2023-08-09T12:42:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f6757fff640 1 -- 172.21.15.17:0/245311351 learned_addr learned my addr 172.21.15.17:0/245311351 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675ffff640 1 --2- 172.21.15.17:0/245311351 >> v2:172.21.15.142:3300/0 conn(0x7f67600ad810 0x7f67600b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295133229 0 0) 0x7f67600b4630 con 0x7f6760070a90 2023-08-09T12:42:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f674c005730 con 0x7f6760070a90 2023-08-09T12:42:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945903779 0 0) 0x7f674c005730 con 0x7f6760070a90 2023-08-09T12:42:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 >> v2:172.21.15.142:3300/0 conn(0x7f67600ad810 msgr2=0x7f67600b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675effd640 1 --2- 172.21.15.17:0/245311351 >> v2:172.21.15.142:3300/0 conn(0x7f67600ad810 0x7f67600b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 >> v1:172.21.15.142:6789/0 conn(0x7f6760159d80 legacy=0x7f6760070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67600b3d90 con 0x7f6760070a90 2023-08-09T12:42:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.447+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f67480017f0 con 0x7f6760070a90 2023-08-09T12:42:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 >> v1:172.21.15.17:6789/0 conn(0x7f6760070a90 legacy=0x7f67600c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f675effd640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c005b80 0x7f674c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f675effd640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674c0069d0 0x7f674c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f675effd640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c007390 0x7f674c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676015a160 con 0x7f674c0069d0 2023-08-09T12:42:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c00e230 con 0x7f674c005b80 2023-08-09T12:42:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c00e3f0 con 0x7f674c007390 2023-08-09T12:42:32.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f6757fff640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674c0069d0 0x7f674c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f6757fff640 1 -- 172.21.15.17:0/245311351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c007390 msgr2=0x7f674c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f6757fff640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c007390 0x7f674c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f6757fff640 1 -- 172.21.15.17:0/245311351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c005b80 msgr2=0x7f674c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f6757fff640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c005b80 0x7f674c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f6757fff640 1 -- 172.21.15.17:0/245311351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c005730 con 0x7f674c0069d0 2023-08-09T12:42:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.448+0000 7f675ffff640 1 -- 172.21.15.17:0/245311351 reap_dead start 2023-08-09T12:42:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.450+0000 7f6757fff640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674c0069d0 0x7f674c006e50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f674800c190 tx=0x7f674c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aade7ff4bfcdd6a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.450+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748007270 con 0x7f674c0069d0 2023-08-09T12:42:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.450+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67480073f0 con 0x7f674c0069d0 2023-08-09T12:42:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.450+0000 7f675effd640 1 -- 172.21.15.17:0/245311351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674802c870 con 0x7f674c0069d0 2023-08-09T12:42:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.450+0000 7f6765b31640 1 -- 172.21.15.17:0/245311351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674c0069d0 msgr2=0x7f674c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.450+0000 7f6765b31640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674c0069d0 0x7f674c006e50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f674800c190 tx=0x7f674c007a00 comp rx=0 tx=0).stop 2023-08-09T12:42:32.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.451+0000 7f6765b31640 1 -- 172.21.15.17:0/245311351 shutdown_connections 2023-08-09T12:42:32.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.451+0000 7f6765b31640 1 --2- 172.21.15.17:0/245311351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674c0069d0 0x7f674c006e50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.451+0000 7f6765b31640 1 -- 172.21.15.17:0/245311351 >> 172.21.15.17:0/245311351 conn(0x7f67600cb1b0 msgr2=0x7f67600cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:32.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.451+0000 7f6765b31640 1 -- 172.21.15.17:0/245311351 shutdown_connections 2023-08-09T12:42:32.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.451+0000 7f6765b31640 1 -- 172.21.15.17:0/245311351 wait complete. 2023-08-09T12:42:32.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.453+0000 7f6765b31640 1 Processor -- start 2023-08-09T12:42:32.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.453+0000 7f6765b31640 1 -- start start 2023-08-09T12:42:32.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f6765b31640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c0069d0 0x7f6760158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f6765b31640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67601e4890 0x7f67600c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f6765b31640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67600c7450 0x7f67600c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f6765b31640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760158cd0 con 0x7f67600c7450 2023-08-09T12:42:32.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f6765b31640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600c7e10 con 0x7f674c0069d0 2023-08-09T12:42:32.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f6765b31640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676015cc30 con 0x7f67601e4890 2023-08-09T12:42:32.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f675ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67600c7450 0x7f67600c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:32.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f675ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67600c7450 0x7f67600c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51010/0 (socket says 172.21.15.17:51010) 2023-08-09T12:42:32.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f675ffff640 1 -- 172.21.15.17:0/164012033 learned_addr learned my addr 172.21.15.17:0/164012033 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f675ffff640 1 -- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67601e4890 msgr2=0x7f67600c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f675ffff640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67601e4890 0x7f67600c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f675ffff640 1 -- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c0069d0 msgr2=0x7f6760158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f675ffff640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c0069d0 0x7f6760158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.454+0000 7f675ffff640 1 -- 172.21.15.17:0/164012033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676015c950 con 0x7f67600c7450 2023-08-09T12:42:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.455+0000 7f675ffff640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67600c7450 0x7f67600c78d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f67600c8c80 tx=0x7f675800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.455+0000 7f675cff9640 1 -- 172.21.15.17:0/164012033 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758010040 con 0x7f67600c7450 2023-08-09T12:42:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.455+0000 7f675cff9640 1 -- 172.21.15.17:0/164012033 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675800bb10 con 0x7f67600c7450 2023-08-09T12:42:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.455+0000 7f675cff9640 1 -- 172.21.15.17:0/164012033 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758014400 con 0x7f67600c7450 2023-08-09T12:42:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.455+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67600ae610 con 0x7f67600c7450 2023-08-09T12:42:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.455+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67600aebd0 con 0x7f67600c7450 2023-08-09T12:42:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.457+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67600aedf0 con 0x7f67600c7450 2023-08-09T12:42:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.457+0000 7f675cff9640 1 -- 172.21.15.17:0/164012033 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6758014560 con 0x7f67600c7450 2023-08-09T12:42:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.458+0000 7f675cff9640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674006a080 0x7f674006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.458+0000 7f675cff9640 1 -- 172.21.15.17:0/164012033 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6758088900 con 0x7f67600c7450 2023-08-09T12:42:32.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.459+0000 7f675f7fe640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674006a080 0x7f674006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:32.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.460+0000 7f675f7fe640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674006a080 0x7f674006c540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f67600c1d40 tx=0x7f6750007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:32.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.463+0000 7f675cff9640 1 -- 172.21.15.17:0/164012033 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6758054330 con 0x7f67600c7450 2023-08-09T12:42:32.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.733+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f67601e7b30 con 0x7f67600c7450 2023-08-09T12:42:32.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.734+0000 7f675cff9640 1 -- 172.21.15.17:0/164012033 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6758018090 con 0x7f67600c7450 2023-08-09T12:42:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:32.736 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:42:32.736 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:42:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:42:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:42:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:42:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:42:32.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:42:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:42:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:42:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:42:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:42:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:42:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.739 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:42:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:42:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:42:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:42:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:42:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:42:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:42:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:42:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:42:32.741 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:42:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:42:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:42:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:42:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:42:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:42:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:42:32.743 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:42:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:42:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:42:32.744 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:42:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:42:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:42:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.745 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:42:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:42:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:42:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:42:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:42:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:42:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:42:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:42:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:42:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:42:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:42:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:42:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:42:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:42:32.749 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:42:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:42:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:42:32.750 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:42:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:42:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:42:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.751 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:42:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:42:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:42:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:42:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:42:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:42:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:42:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:42:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:42:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:42:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:42:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:42:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:42:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:42:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:42:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:42:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:42:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:42:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:42:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:42:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:42:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:42:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:42:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.756 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:42:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:42:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:42:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:42:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:42:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:42:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:42:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:42:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:42:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:42:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:42:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:42:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:42:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:42:32.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:42:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:32.760 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:42:32.760 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:42:32.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.736+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674006a080 msgr2=0x7f674006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.736+0000 7f6765b31640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674006a080 0x7f674006c540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f67600c1d40 tx=0x7f6750007990 comp rx=0 tx=0).stop 2023-08-09T12:42:32.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.736+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67600c7450 msgr2=0x7f67600c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.736+0000 7f6765b31640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67600c7450 0x7f67600c78d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f67600c8c80 tx=0x7f675800eec0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.737+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 shutdown_connections 2023-08-09T12:42:32.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.737+0000 7f6765b31640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674006a080 0x7f674006c540 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.737+0000 7f6765b31640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67600c7450 0x7f67600c78d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.737+0000 7f6765b31640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67601e4890 0x7f67600c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.737+0000 7f6765b31640 1 --2- 172.21.15.17:0/164012033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c0069d0 0x7f6760158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.737+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 >> 172.21.15.17:0/164012033 conn(0x7f67600cb1b0 msgr2=0x7f6760158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:32.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.737+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 shutdown_connections 2023-08-09T12:42:32.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.737+0000 7f6765b31640 1 -- 172.21.15.17:0/164012033 wait complete. 2023-08-09T12:42:32.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:32.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.992+0000 7f0142657640 1 Processor -- start 2023-08-09T12:42:32.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.992+0000 7f0142657640 1 -- start start 2023-08-09T12:42:32.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.993+0000 7f0142657640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f013c15ce90 0x7f013c1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.993+0000 7f0142657640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0b6000 0x7f013c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:32.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.994+0000 7f0142657640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c0b6460 con 0x7f013c0d29d0 2023-08-09T12:42:32.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.994+0000 7f0142657640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c0cda40 con 0x7f013c15ce90 2023-08-09T12:42:32.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.994+0000 7f0142657640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0cdd10 con 0x7f013c0b6000 2023-08-09T12:42:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.994+0000 7f013bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f013c15ce90 0x7f013c1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.994+0000 7f0140bf4640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f013c0d29d0 0x7f013c0d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59426/0 (socket says 172.21.15.17:59426) 2023-08-09T12:42:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.994+0000 7f0140bf4640 1 -- 172.21.15.17:0/3744958842 learned_addr learned my addr 172.21.15.17:0/3744958842 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.994+0000 7f013b7fe640 1 --2- 172.21.15.17:0/3744958842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0b6000 0x7f013c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.995+0000 7f013bfff640 1 -- 172.21.15.17:0/3744958842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0b6000 msgr2=0x7f013c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.995+0000 7f013bfff640 1 --2- 172.21.15.17:0/3744958842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0b6000 0x7f013c0cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.995+0000 7f013bfff640 1 -- 172.21.15.17:0/3744958842 >> v1:172.21.15.17:6789/0 conn(0x7f013c0d29d0 legacy=0x7f013c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.995+0000 7f013bfff640 1 -- 172.21.15.17:0/3744958842 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0cdff0 con 0x7f013c15ce90 2023-08-09T12:42:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.995+0000 7f013affd640 1 -- 172.21.15.17:0/3744958842 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935329985 0 0) 0x7f013c0b6460 con 0x7f013c0d29d0 2023-08-09T12:42:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.996+0000 7f013bfff640 1 --2- 172.21.15.17:0/3744958842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c1616e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f012c009d90 tx=0x7f012c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aee0a9d783efd7c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.996+0000 7f013affd640 1 -- 172.21.15.17:0/3744958842 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c02cc50 con 0x7f013c15ce90 2023-08-09T12:42:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f013affd640 1 -- 172.21.15.17:0/3744958842 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c02cdb0 con 0x7f013c15ce90 2023-08-09T12:42:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f013affd640 1 -- 172.21.15.17:0/3744958842 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c034660 con 0x7f013c15ce90 2023-08-09T12:42:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f0142657640 1 -- 172.21.15.17:0/3744958842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 msgr2=0x7f013c1616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f0142657640 1 --2- 172.21.15.17:0/3744958842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c1616e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f012c009d90 tx=0x7f012c02bea0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f0142657640 1 -- 172.21.15.17:0/3744958842 shutdown_connections 2023-08-09T12:42:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f0142657640 1 --2- 172.21.15.17:0/3744958842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0b6000 0x7f013c0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f0142657640 1 --2- 172.21.15.17:0/3744958842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c1616e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f0142657640 1 -- 172.21.15.17:0/3744958842 >> 172.21.15.17:0/3744958842 conn(0x7f013c06fde0 msgr2=0x7f013c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:33.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f0142657640 1 -- 172.21.15.17:0/3744958842 shutdown_connections 2023-08-09T12:42:33.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.997+0000 7f0142657640 1 -- 172.21.15.17:0/3744958842 wait complete. 2023-08-09T12:42:33.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.999+0000 7f0142657640 1 Processor -- start 2023-08-09T12:42:33.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:32.999+0000 7f0142657640 1 -- start start 2023-08-09T12:42:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.000+0000 7f0142657640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0b6000 0x7f013c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.000+0000 7f0142657640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0d29d0 0x7f013c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.000+0000 7f0142657640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c0d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.000+0000 7f0142657640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c15dfa0 con 0x7f013c15ce90 2023-08-09T12:42:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.000+0000 7f0142657640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c15e280 con 0x7f013c0b6000 2023-08-09T12:42:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.000+0000 7f0142657640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c15e560 con 0x7f013c0d29d0 2023-08-09T12:42:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c0d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c0d13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51040/0 (socket says 172.21.15.17:51040) 2023-08-09T12:42:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 -- 172.21.15.17:0/2897566766 learned_addr learned my addr 172.21.15.17:0/2897566766 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f013bfff640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0b6000 0x7f013c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f013b7fe640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0d29d0 0x7f013c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 -- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0d29d0 msgr2=0x7f013c14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0d29d0 0x7f013c14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 -- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0b6000 msgr2=0x7f013c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0b6000 0x7f013c15f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 -- 172.21.15.17:0/2897566766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c009a70 con 0x7f013c15ce90 2023-08-09T12:42:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f013bfff640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0b6000 0x7f013c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.001+0000 7f0140bf4640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c0d13e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f013400c450 tx=0x7f013400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.002+0000 7f0138ff9640 1 -- 172.21.15.17:0/2897566766 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01340074e0 con 0x7f013c15ce90 2023-08-09T12:42:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.002+0000 7f0138ff9640 1 -- 172.21.15.17:0/2897566766 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134007660 con 0x7f013c15ce90 2023-08-09T12:42:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.002+0000 7f0138ff9640 1 -- 172.21.15.17:0/2897566766 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134004a20 con 0x7f013c15ce90 2023-08-09T12:42:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.002+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c15e840 con 0x7f013c15ce90 2023-08-09T12:42:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.002+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c14b470 con 0x7f013c15ce90 2023-08-09T12:42:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.003+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c15ed60 con 0x7f013c15ce90 2023-08-09T12:42:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.004+0000 7f0138ff9640 1 -- 172.21.15.17:0/2897566766 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0134004b80 con 0x7f013c15ce90 2023-08-09T12:42:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.005+0000 7f0138ff9640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f012806a050 0x7f012806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.005+0000 7f0138ff9640 1 -- 172.21.15.17:0/2897566766 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0134087400 con 0x7f013c15ce90 2023-08-09T12:42:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.006+0000 7f013bfff640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f012806a050 0x7f012806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.007+0000 7f013bfff640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f012806a050 0x7f012806c510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f012c036000 tx=0x7f012c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.009+0000 7f0138ff9640 1 -- 172.21.15.17:0/2897566766 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f013c15ed60 con 0x7f013c15ce90 2023-08-09T12:42:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.206+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f013c15ed60 con 0x7f013c15ce90 2023-08-09T12:42:33.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.208+0000 7f0138ff9640 1 -- 172.21.15.17:0/2897566766 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f013c15ed60 con 0x7f013c15ce90 2023-08-09T12:42:33.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:33.211 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":66,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:32.193870+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:33.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f012806a050 msgr2=0x7f012806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f012806a050 0x7f012806c510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f012c036000 tx=0x7f012c030000 comp rx=0 tx=0).stop 2023-08-09T12:42:33.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 msgr2=0x7f013c0d13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c0d13e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f013400c450 tx=0x7f013400c910 comp rx=0 tx=0).stop 2023-08-09T12:42:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 shutdown_connections 2023-08-09T12:42:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f012806a050 0x7f012806c510 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f013c15ce90 0x7f013c0d13e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c0d29d0 0x7f013c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 --2- 172.21.15.17:0/2897566766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0b6000 0x7f013c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 >> 172.21.15.17:0/2897566766 conn(0x7f013c06fde0 msgr2=0x7f013c0d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 shutdown_connections 2023-08-09T12:42:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.211+0000 7f0142657640 1 -- 172.21.15.17:0/2897566766 wait complete. 2023-08-09T12:42:33.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:42:33.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:42:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.461+0000 7f1f088e0640 1 Processor -- start 2023-08-09T12:42:33.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.461+0000 7f1f088e0640 1 -- start start 2023-08-09T12:42:33.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.463+0000 7f1f088e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04160640 0x7f1f0415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.463+0000 7f1f088e0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f04157580 con 0x7f1f040b0020 2023-08-09T12:42:33.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.463+0000 7f1f088e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f040ad490 con 0x7f1f040cdb00 2023-08-09T12:42:33.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.463+0000 7f1f088e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0415d1c0 con 0x7f1f04160640 2023-08-09T12:42:33.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.464+0000 7f1f02d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1f040b0020 0x7f1f040b0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59436/0 (socket says 172.21.15.17:59436) 2023-08-09T12:42:33.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.464+0000 7f1f02d9d640 1 -- 172.21.15.17:0/829353068 learned_addr learned my addr 172.21.15.17:0/829353068 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:33.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.464+0000 7f1f0359e640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04160640 0x7f1f0415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.464+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164879861 0 0) 0x7f1f04157580 con 0x7f1f040b0020 2023-08-09T12:42:33.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.464+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef0003520 con 0x7f1f040b0020 2023-08-09T12:42:33.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1892492188 0 0) 0x7f1ef0003520 con 0x7f1f040b0020 2023-08-09T12:42:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04160640 msgr2=0x7f1f0415d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04160640 0x7f1f0415d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 >> v1:172.21.15.142:6789/0 conn(0x7f1f040cdb00 legacy=0x7f1f040acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04160b90 con 0x7f1f040b0020 2023-08-09T12:42:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1ef40019f0 con 0x7f1f040b0020 2023-08-09T12:42:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 >> v1:172.21.15.17:6789/0 conn(0x7f1f040b0020 legacy=0x7f1f040b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef00039a0 0x7f1ef0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0004390 0x7f1ef0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef0005060 0x7f1ef000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0415d1c0 con 0x7f1ef0005060 2023-08-09T12:42:33.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef000bf70 con 0x7f1ef0004390 2023-08-09T12:42:33.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef000c130 con 0x7f1ef00039a0 2023-08-09T12:42:33.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.465+0000 7f1f0359e640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef0005060 0x7f1ef000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1efa59c640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0004390 0x7f1ef0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1f0359e640 1 -- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef00039a0 msgr2=0x7f1ef0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1f02d9d640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef00039a0 0x7f1ef0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1f0359e640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef00039a0 0x7f1ef0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1f0359e640 1 -- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0004390 msgr2=0x7f1ef0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1f0359e640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0004390 0x7f1ef0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1f0359e640 1 -- 172.21.15.17:0/829353068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef0003520 con 0x7f1ef0005060 2023-08-09T12:42:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1efa59c640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0004390 0x7f1ef0004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.466+0000 7f1f02d9d640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef00039a0 0x7f1ef0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:33.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.467+0000 7f1f0359e640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef0005060 0x7f1ef000b980 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f1f04160a20 tx=0x7f1ef00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e68c2d466345dc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:33.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.468+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc02c580 con 0x7f1ef0005060 2023-08-09T12:42:33.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.468+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc02c6e0 con 0x7f1ef0005060 2023-08-09T12:42:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.468+0000 7f1f0259c640 1 -- 172.21.15.17:0/829353068 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc02ca50 con 0x7f1ef0005060 2023-08-09T12:42:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.468+0000 7f1f088e0640 1 -- 172.21.15.17:0/829353068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef0005060 msgr2=0x7f1ef000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.468+0000 7f1f088e0640 1 --2- 172.21.15.17:0/829353068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ef0005060 0x7f1ef000b980 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f1f04160a20 tx=0x7f1ef00057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.469+0000 7f1f0359e640 1 -- 172.21.15.17:0/829353068 reap_dead start 2023-08-09T12:42:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.469+0000 7f1f088e0640 1 -- 172.21.15.17:0/829353068 shutdown_connections 2023-08-09T12:42:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.469+0000 7f1f088e0640 1 -- 172.21.15.17:0/829353068 >> 172.21.15.17:0/829353068 conn(0x7f1f040cb020 msgr2=0x7f1f040cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.469+0000 7f1f088e0640 1 -- 172.21.15.17:0/829353068 shutdown_connections 2023-08-09T12:42:33.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.469+0000 7f1f088e0640 1 -- 172.21.15.17:0/829353068 wait complete. 2023-08-09T12:42:33.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.471+0000 7f1f088e0640 1 Processor -- start 2023-08-09T12:42:33.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.471+0000 7f1f088e0640 1 -- start start 2023-08-09T12:42:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.472+0000 7f1f088e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0005060 0x7f1f040b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1f088e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04070390 0x7f1f04069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1f088e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04150d20 0x7f1f041511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1f088e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f041516e0 con 0x7f1f04070390 2023-08-09T12:42:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1f088e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040b3c50 con 0x7f1ef0005060 2023-08-09T12:42:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1f088e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040b2370 con 0x7f1f04150d20 2023-08-09T12:42:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1efa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04070390 0x7f1f04069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1efa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04070390 0x7f1f04069a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51062/0 (socket says 172.21.15.17:51062) 2023-08-09T12:42:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1efa59c640 1 -- 172.21.15.17:0/3891524803 learned_addr learned my addr 172.21.15.17:0/3891524803 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1f02d9d640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0005060 0x7f1f040b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1f0359e640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04150d20 0x7f1f041511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1efa59c640 1 -- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04150d20 msgr2=0x7f1f041511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1efa59c640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04150d20 0x7f1f041511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1efa59c640 1 -- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0005060 msgr2=0x7f1f040b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1efa59c640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0005060 0x7f1f040b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1efa59c640 1 -- 172.21.15.17:0/3891524803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040b2650 con 0x7f1f04070390 2023-08-09T12:42:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.473+0000 7f1f02d9d640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0005060 0x7f1f040b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.474+0000 7f1efa59c640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04070390 0x7f1f04069a30 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00d7a0 tx=0x7f1eec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.474+0000 7f1efbfff640 1 -- 172.21.15.17:0/3891524803 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec017070 con 0x7f1f04070390 2023-08-09T12:42:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.474+0000 7f1efbfff640 1 -- 172.21.15.17:0/3891524803 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec005070 con 0x7f1f04070390 2023-08-09T12:42:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.474+0000 7f1efbfff640 1 -- 172.21.15.17:0/3891524803 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec005420 con 0x7f1f04070390 2023-08-09T12:42:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.474+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f040b2930 con 0x7f1f04070390 2023-08-09T12:42:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.474+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f040b3f30 con 0x7f1f04070390 2023-08-09T12:42:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.475+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0404e390 con 0x7f1f04070390 2023-08-09T12:42:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.476+0000 7f1efbfff640 1 -- 172.21.15.17:0/3891524803 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1eec007030 con 0x7f1f04070390 2023-08-09T12:42:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.478+0000 7f1efbfff640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ee406a080 0x7f1ee406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.478+0000 7f1efbfff640 1 -- 172.21.15.17:0/3891524803 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1eec087bc0 con 0x7f1f04070390 2023-08-09T12:42:33.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.478+0000 7f1f02d9d640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ee406a080 0x7f1ee406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.480+0000 7f1f02d9d640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ee406a080 0x7f1ee406c540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400e2e0 tx=0x7f1ef40017f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.482+0000 7f1efbfff640 1 -- 172.21.15.17:0/3891524803 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1eec053620 con 0x7f1f04070390 2023-08-09T12:42:33.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.665+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f040b4520 con 0x7f1f04070390 2023-08-09T12:42:33.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.666+0000 7f1efbfff640 1 -- 172.21.15.17:0/3891524803 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1eec056c40 con 0x7f1f04070390 2023-08-09T12:42:33.669 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:42:33.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ee406a080 msgr2=0x7f1ee406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ee406a080 0x7f1ee406c540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400e2e0 tx=0x7f1ef40017f0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04070390 msgr2=0x7f1f04069a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04070390 0x7f1f04069a30 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00d7a0 tx=0x7f1eec00dc60 comp rx=0 tx=0).stop 2023-08-09T12:42:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 shutdown_connections 2023-08-09T12:42:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ee406a080 0x7f1ee406c540 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f04150d20 0x7f1f041511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f04070390 0x7f1f04069a30 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 --2- 172.21.15.17:0/3891524803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef0005060 0x7f1f040b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 >> 172.21.15.17:0/3891524803 conn(0x7f1f040cb020 msgr2=0x7f1f040ca430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:33.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 shutdown_connections 2023-08-09T12:42:33.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.669+0000 7f1f088e0640 1 -- 172.21.15.17:0/3891524803 wait complete. 2023-08-09T12:42:33.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:42:33.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.920+0000 7f8e5545e640 1 Processor -- start 2023-08-09T12:42:33.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.920+0000 7f8e5545e640 1 -- start start 2023-08-09T12:42:33.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.921+0000 7f8e5545e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e500adc40 0x7f8e5006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.921+0000 7f8e5545e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e500cc630 0x7f8e500ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.921+0000 7f8e5545e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e500b2250 con 0x7f8e500b3b40 2023-08-09T12:42:33.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.921+0000 7f8e5545e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e500ae020 con 0x7f8e500cc630 2023-08-09T12:42:33.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.921+0000 7f8e5545e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500b2530 con 0x7f8e500adc40 2023-08-09T12:42:33.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.921+0000 7f8e4e7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8e500b3b40 0x7f8e500b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59450/0 (socket says 172.21.15.17:59450) 2023-08-09T12:42:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.921+0000 7f8e4e7fc640 1 -- 172.21.15.17:0/2257338357 learned_addr learned my addr 172.21.15.17:0/2257338357 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4f7fe640 1 --2- 172.21.15.17:0/2257338357 >> v2:172.21.15.142:3300/0 conn(0x7f8e500cc630 0x7f8e500ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4effd640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e500adc40 0x7f8e5006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984865781 0 0) 0x7f8e500b2250 con 0x7f8e500b3b40 2023-08-09T12:42:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e38003520 con 0x7f8e500b3b40 2023-08-09T12:42:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1379582732 0 0) 0x7f8e38003520 con 0x7f8e500b3b40 2023-08-09T12:42:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e500adc40 msgr2=0x7f8e5006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e500adc40 0x7f8e5006c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 >> v2:172.21.15.142:3300/0 conn(0x7f8e500cc630 msgr2=0x7f8e500ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 --2- 172.21.15.17:0/2257338357 >> v2:172.21.15.142:3300/0 conn(0x7f8e500cc630 0x7f8e500ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5006fe80 con 0x7f8e500b3b40 2023-08-09T12:42:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.922+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8e440017f0 con 0x7f8e500b3b40 2023-08-09T12:42:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 >> v1:172.21.15.17:6789/0 conn(0x7f8e500b3b40 legacy=0x7f8e500b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4dffb640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e38003970 0x7f8e38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4dffb640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e380047c0 0x7f8e38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4dffb640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e500adc40 0x7f8e38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500ae020 con 0x7f8e380047c0 2023-08-09T12:42:33.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500b2530 con 0x7f8e38003970 2023-08-09T12:42:33.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3800b980 con 0x7f8e500adc40 2023-08-09T12:42:33.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4e7fc640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e380047c0 0x7f8e38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4effd640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e38003970 0x7f8e38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4e7fc640 1 -- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e500adc40 msgr2=0x7f8e38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:33.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4e7fc640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e500adc40 0x7f8e38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4e7fc640 1 -- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e38003970 msgr2=0x7f8e38003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:33.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4e7fc640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e38003970 0x7f8e38003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.923+0000 7f8e4e7fc640 1 -- 172.21.15.17:0/2257338357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38003520 con 0x7f8e380047c0 2023-08-09T12:42:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e4e7fc640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e380047c0 0x7f8e38004c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c210 tx=0x7f8e380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df584fd7c0661206 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4402cad0 con 0x7f8e380047c0 2023-08-09T12:42:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4402cc30 con 0x7f8e380047c0 2023-08-09T12:42:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e4dffb640 1 -- 172.21.15.17:0/2257338357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44007070 con 0x7f8e380047c0 2023-08-09T12:42:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e5545e640 1 -- 172.21.15.17:0/2257338357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e380047c0 msgr2=0x7f8e38004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e5545e640 1 --2- 172.21.15.17:0/2257338357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e380047c0 0x7f8e38004c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c210 tx=0x7f8e380057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e4f7fe640 1 -- 172.21.15.17:0/2257338357 reap_dead start 2023-08-09T12:42:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e5545e640 1 -- 172.21.15.17:0/2257338357 shutdown_connections 2023-08-09T12:42:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.925+0000 7f8e5545e640 1 -- 172.21.15.17:0/2257338357 >> 172.21.15.17:0/2257338357 conn(0x7f8e500cb1b0 msgr2=0x7f8e500cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.926+0000 7f8e5545e640 1 -- 172.21.15.17:0/2257338357 shutdown_connections 2023-08-09T12:42:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.926+0000 7f8e5545e640 1 -- 172.21.15.17:0/2257338357 wait complete. 2023-08-09T12:42:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.927+0000 7f8e5545e640 1 Processor -- start 2023-08-09T12:42:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.928+0000 7f8e5545e640 1 -- start start 2023-08-09T12:42:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e5545e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e380047c0 0x7f8e500c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e5545e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e500c9be0 0x7f8e500ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e5545e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e500acb20 0x7f8e5014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e5545e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500ca7e0 con 0x7f8e500acb20 2023-08-09T12:42:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e5545e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500ca580 con 0x7f8e500c9be0 2023-08-09T12:42:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e5545e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500c8e20 con 0x7f8e380047c0 2023-08-09T12:42:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e500acb20 0x7f8e5014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e500acb20 0x7f8e5014a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51090/0 (socket says 172.21.15.17:51090) 2023-08-09T12:42:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4f7fe640 1 -- 172.21.15.17:0/70826791 learned_addr learned my addr 172.21.15.17:0/70826791 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4effd640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e380047c0 0x7f8e500c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4e7fc640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e500c9be0 0x7f8e500ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4f7fe640 1 -- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e380047c0 msgr2=0x7f8e500c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4f7fe640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e380047c0 0x7f8e500c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4f7fe640 1 -- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e500c9be0 msgr2=0x7f8e500ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4f7fe640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e500c9be0 0x7f8e500ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4f7fe640 1 -- 172.21.15.17:0/70826791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500c9100 con 0x7f8e500acb20 2023-08-09T12:42:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.929+0000 7f8e4effd640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e380047c0 0x7f8e500c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.930+0000 7f8e4f7fe640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e500acb20 0x7f8e5014a760 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8e500cca10 tx=0x7f8e4800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.930+0000 7f8e377fe640 1 -- 172.21.15.17:0/70826791 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48010040 con 0x7f8e500acb20 2023-08-09T12:42:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.930+0000 7f8e377fe640 1 -- 172.21.15.17:0/70826791 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800bce0 con 0x7f8e500acb20 2023-08-09T12:42:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.930+0000 7f8e377fe640 1 -- 172.21.15.17:0/70826791 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48014640 con 0x7f8e500acb20 2023-08-09T12:42:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.930+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e500c93e0 con 0x7f8e500acb20 2023-08-09T12:42:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.930+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e500acfd0 con 0x7f8e500acb20 2023-08-09T12:42:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.931+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e500c9900 con 0x7f8e500acb20 2023-08-09T12:42:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.933+0000 7f8e377fe640 1 -- 172.21.15.17:0/70826791 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e480147a0 con 0x7f8e500acb20 2023-08-09T12:42:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.933+0000 7f8e377fe640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e3c06a050 0x7f8e3c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.934+0000 7f8e377fe640 1 -- 172.21.15.17:0/70826791 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8e48088a90 con 0x7f8e500acb20 2023-08-09T12:42:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.934+0000 7f8e4effd640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e3c06a050 0x7f8e3c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.935+0000 7f8e4effd640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e3c06a050 0x7f8e3c06c510 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8e500c51f0 tx=0x7f8e40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:33.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:33.939+0000 7f8e377fe640 1 -- 172.21.15.17:0/70826791 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8e500c9900 con 0x7f8e500acb20 2023-08-09T12:42:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.126+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e500c9900 con 0x7f8e500acb20 2023-08-09T12:42:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.127+0000 7f8e377fe640 1 -- 172.21.15.17:0/70826791 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e48018020 con 0x7f8e500acb20 2023-08-09T12:42:34.129 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:42:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.129+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e3c06a050 msgr2=0x7f8e3c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.129+0000 7f8e5545e640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e3c06a050 0x7f8e3c06c510 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8e500c51f0 tx=0x7f8e40008040 comp rx=0 tx=0).stop 2023-08-09T12:42:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e500acb20 msgr2=0x7f8e5014a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e500acb20 0x7f8e5014a760 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8e500cca10 tx=0x7f8e4800b480 comp rx=0 tx=0).stop 2023-08-09T12:42:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 shutdown_connections 2023-08-09T12:42:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e3c06a050 0x7f8e3c06c510 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e500acb20 0x7f8e5014a760 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e500c9be0 0x7f8e500ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 --2- 172.21.15.17:0/70826791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e380047c0 0x7f8e500c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 >> 172.21.15.17:0/70826791 conn(0x7f8e500cb1b0 msgr2=0x7f8e500ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 shutdown_connections 2023-08-09T12:42:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.130+0000 7f8e5545e640 1 -- 172.21.15.17:0/70826791 wait complete. 2023-08-09T12:42:34.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:42:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.359+0000 7f8cbaf8c640 1 Processor -- start 2023-08-09T12:42:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.359+0000 7f8cbaf8c640 1 -- start start 2023-08-09T12:42:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.361+0000 7f8cbaf8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8cb40cb070 0x7f8cb40cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.361+0000 7f8cbaf8c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40cb9e0 con 0x7f8cb41587e0 2023-08-09T12:42:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.361+0000 7f8cbaf8c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb4071340 con 0x7f8cb4070f00 2023-08-09T12:42:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.361+0000 7f8cbaf8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb415beb0 con 0x7f8cb40cb070 2023-08-09T12:42:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.361+0000 7f8cb9f8a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8cb41587e0 0x7f8cb40b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59454/0 (socket says 172.21.15.17:59454) 2023-08-09T12:42:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.361+0000 7f8cb9f8a640 1 -- 172.21.15.17:0/2574953977 learned_addr learned my addr 172.21.15.17:0/2574953977 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.361+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200937429 0 0) 0x7f8cb40cb9e0 con 0x7f8cb41587e0 2023-08-09T12:42:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.361+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca0003520 con 0x7f8cb41587e0 2023-08-09T12:42:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cba78b640 1 --2- 172.21.15.17:0/2574953977 >> v2:172.21.15.142:3300/0 conn(0x7f8cb40cb070 0x7f8cb40cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2712555231 0 0) 0x7f8ca0003520 con 0x7f8cb41587e0 2023-08-09T12:42:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 >> v2:172.21.15.142:3300/0 conn(0x7f8cb40cb070 msgr2=0x7f8cb40cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 --2- 172.21.15.17:0/2574953977 >> v2:172.21.15.142:3300/0 conn(0x7f8cb40cb070 0x7f8cb40cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 >> v1:172.21.15.142:6789/0 conn(0x7f8cb4070f00 legacy=0x7f8cb415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40715c0 con 0x7f8cb41587e0 2023-08-09T12:42:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8cb00019f0 con 0x7f8cb41587e0 2023-08-09T12:42:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 >> v1:172.21.15.17:6789/0 conn(0x7f8cb41587e0 legacy=0x7f8cb40b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8ca0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca00047c0 0x7f8ca0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ca0005180 0x7f8ca000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb415beb0 con 0x7f8ca0003970 2023-08-09T12:42:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca000c0d0 con 0x7f8ca00047c0 2023-08-09T12:42:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca000c290 con 0x7f8ca0005180 2023-08-09T12:42:34.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.362+0000 7f8cb9f8a640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8ca0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.363+0000 7f8cb9789640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca00047c0 0x7f8ca0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.363+0000 7f8cba78b640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ca0005180 0x7f8ca000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.363+0000 7f8cb9f8a640 1 -- 172.21.15.17:0/2574953977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ca0005180 msgr2=0x7f8ca000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:34.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.363+0000 7f8cb9f8a640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ca0005180 0x7f8ca000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.363+0000 7f8cb9f8a640 1 -- 172.21.15.17:0/2574953977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca00047c0 msgr2=0x7f8ca0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.363+0000 7f8cb9f8a640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca00047c0 0x7f8ca0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.363+0000 7f8cb9f8a640 1 -- 172.21.15.17:0/2574953977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca0003520 con 0x7f8ca0003970 2023-08-09T12:42:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.363+0000 7f8cba78b640 1 -- 172.21.15.17:0/2574953977 reap_dead start 2023-08-09T12:42:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.364+0000 7f8cb9f8a640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8ca0003d90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000a830 tx=0x7f8ca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34be3b159739ce1d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.364+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00072d0 con 0x7f8ca0003970 2023-08-09T12:42:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.364+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb002f070 con 0x7f8ca0003970 2023-08-09T12:42:34.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.364+0000 7f8cb8f88640 1 -- 172.21.15.17:0/2574953977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00076f0 con 0x7f8ca0003970 2023-08-09T12:42:34.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.365+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/2574953977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 msgr2=0x7f8ca0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.365+0000 7f8cbaf8c640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8ca0003d90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000a830 tx=0x7f8ca00057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.365+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/2574953977 shutdown_connections 2023-08-09T12:42:34.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.365+0000 7f8cbaf8c640 1 --2- 172.21.15.17:0/2574953977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8ca0003d90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.365+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/2574953977 >> 172.21.15.17:0/2574953977 conn(0x7f8cb40b1d50 msgr2=0x7f8cb406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.365+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/2574953977 shutdown_connections 2023-08-09T12:42:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.365+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/2574953977 wait complete. 2023-08-09T12:42:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.367+0000 7f8cbaf8c640 1 Processor -- start 2023-08-09T12:42:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.367+0000 7f8cbaf8c640 1 -- start start 2023-08-09T12:42:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.368+0000 7f8cbaf8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8cb414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.368+0000 7f8cbaf8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40c3ea0 0x7f8cb406ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.368+0000 7f8cbaf8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb406b1b0 0x7f8cb40c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.368+0000 7f8cbaf8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb406b630 con 0x7f8ca0003970 2023-08-09T12:42:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.368+0000 7f8cbaf8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4156f70 con 0x7f8cb40c3ea0 2023-08-09T12:42:34.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.368+0000 7f8cbaf8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40c2e00 con 0x7f8cb406b1b0 2023-08-09T12:42:34.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.368+0000 7f8cb9f8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8cb414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9f8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8cb414e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51102/0 (socket says 172.21.15.17:51102) 2023-08-09T12:42:34.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9f8a640 1 -- 172.21.15.17:0/4069127709 learned_addr learned my addr 172.21.15.17:0/4069127709 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:34.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9789640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40c3ea0 0x7f8cb406ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cba78b640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb406b1b0 0x7f8cb40c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9f8a640 1 -- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb406b1b0 msgr2=0x7f8cb40c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9f8a640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb406b1b0 0x7f8cb40c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9f8a640 1 -- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40c3ea0 msgr2=0x7f8cb406ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9f8a640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40c3ea0 0x7f8cb406ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9f8a640 1 -- 172.21.15.17:0/4069127709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40c30e0 con 0x7f8ca0003970 2023-08-09T12:42:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.369+0000 7f8cb9f8a640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8cb414e940 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8cb002cb40 tx=0x7f8cb0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:34.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.370+0000 7f8caa7fc640 1 -- 172.21.15.17:0/4069127709 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00070d0 con 0x7f8ca0003970 2023-08-09T12:42:34.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.370+0000 7f8caa7fc640 1 -- 172.21.15.17:0/4069127709 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb0007230 con 0x7f8ca0003970 2023-08-09T12:42:34.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.370+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb40c33c0 con 0x7f8ca0003970 2023-08-09T12:42:34.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.370+0000 7f8caa7fc640 1 -- 172.21.15.17:0/4069127709 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00075a0 con 0x7f8ca0003970 2023-08-09T12:42:34.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.370+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb40c3980 con 0x7f8ca0003970 2023-08-09T12:42:34.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.371+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb40ce460 con 0x7f8ca0003970 2023-08-09T12:42:34.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.372+0000 7f8caa7fc640 1 -- 172.21.15.17:0/4069127709 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8cb0031030 con 0x7f8ca0003970 2023-08-09T12:42:34.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.373+0000 7f8caa7fc640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c9806a080 0x7f8c9806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.373+0000 7f8caa7fc640 1 -- 172.21.15.17:0/4069127709 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8cb00aa420 con 0x7f8ca0003970 2023-08-09T12:42:34.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.374+0000 7f8cb9789640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c9806a080 0x7f8c9806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.375+0000 7f8cb9789640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c9806a080 0x7f8c9806c540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4007fd0 tx=0x7f8ca4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:34.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.377+0000 7f8caa7fc640 1 -- 172.21.15.17:0/4069127709 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8cb0075dc0 con 0x7f8ca0003970 2023-08-09T12:42:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.574+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8cb40ce460 con 0x7f8ca0003970 2023-08-09T12:42:34.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.575+0000 7f8caa7fc640 1 -- 172.21.15.17:0/4069127709 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8cb0007700 con 0x7f8ca0003970 2023-08-09T12:42:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:34.578 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:42:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:42:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:42:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:42:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:42:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:42:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:42:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:42:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:42:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c9806a080 msgr2=0x7f8c9806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c9806a080 0x7f8c9806c540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4007fd0 tx=0x7f8ca4009040 comp rx=0 tx=0).stop 2023-08-09T12:42:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 msgr2=0x7f8cb414e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8cb414e940 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8cb002cb40 tx=0x7f8cb0001d80 comp rx=0 tx=0).stop 2023-08-09T12:42:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 shutdown_connections 2023-08-09T12:42:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c9806a080 0x7f8c9806c540 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cb406b1b0 0x7f8cb40c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cb40c3ea0 0x7f8cb406ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 --2- 172.21.15.17:0/4069127709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca0003970 0x7f8cb414e940 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 >> 172.21.15.17:0/4069127709 conn(0x7f8cb40b1d50 msgr2=0x7f8cb40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 shutdown_connections 2023-08-09T12:42:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.578+0000 7f8cbaf8c640 1 -- 172.21.15.17:0/4069127709 wait complete. 2023-08-09T12:42:34.600 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:42:34.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:42:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.834+0000 7f7ac6337640 1 Processor -- start 2023-08-09T12:42:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.834+0000 7f7ac6337640 1 -- start start 2023-08-09T12:42:34.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.836+0000 7f7ac6337640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7ac015d000 0x7f7ac0160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.836+0000 7f7ac6337640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ac00b06b0 0x7f7ac015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.836+0000 7f7ac6337640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac0161490 con 0x7f7ac00cc0f0 2023-08-09T12:42:34.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.836+0000 7f7ac6337640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac00c9990 con 0x7f7ac015d000 2023-08-09T12:42:34.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.836+0000 7f7ac6337640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00cc560 con 0x7f7ac00b06b0 2023-08-09T12:42:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.836+0000 7f7ac5335640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7ac015d000 0x7f7ac0160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.836+0000 7f7ac4b34640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7ac00cc0f0 0x7f7ac00affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59466/0 (socket says 172.21.15.17:59466) 2023-08-09T12:42:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.836+0000 7f7ac4b34640 1 -- 172.21.15.17:0/3518158041 learned_addr learned my addr 172.21.15.17:0/3518158041 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.837+0000 7f7ab7fff640 1 -- 172.21.15.17:0/3518158041 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222613716 0 0) 0x7f7ac0161490 con 0x7f7ac00cc0f0 2023-08-09T12:42:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.837+0000 7f7ac5335640 1 -- 172.21.15.17:0/3518158041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ac00b06b0 msgr2=0x7f7ac015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.837+0000 7f7ac5335640 1 --2- 172.21.15.17:0/3518158041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ac00b06b0 0x7f7ac015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.837+0000 7f7ac5335640 1 -- 172.21.15.17:0/3518158041 >> v1:172.21.15.17:6789/0 conn(0x7f7ac00cc0f0 legacy=0x7f7ac00affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.837+0000 7f7ac5335640 1 -- 172.21.15.17:0/3518158041 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0160bf0 con 0x7f7ac015d000 2023-08-09T12:42:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.838+0000 7f7ac5335640 1 --2- 172.21.15.17:0/3518158041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac015d000 0x7f7ac0160580 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0097a0 tx=0x7f7abc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47be5056a020ccb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.838+0000 7f7ab7fff640 1 -- 172.21.15.17:0/3518158041 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc031780 con 0x7f7ac015d000 2023-08-09T12:42:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.838+0000 7f7ab7fff640 1 -- 172.21.15.17:0/3518158041 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc0318e0 con 0x7f7ac015d000 2023-08-09T12:42:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.838+0000 7f7ab7fff640 1 -- 172.21.15.17:0/3518158041 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc031c70 con 0x7f7ac015d000 2023-08-09T12:42:34.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.839+0000 7f7ac6337640 1 -- 172.21.15.17:0/3518158041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac015d000 msgr2=0x7f7ac0160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.839+0000 7f7ac6337640 1 --2- 172.21.15.17:0/3518158041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac015d000 0x7f7ac0160580 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0097a0 tx=0x7f7abc02b820 comp rx=0 tx=0).stop 2023-08-09T12:42:34.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.839+0000 7f7ac6337640 1 -- 172.21.15.17:0/3518158041 shutdown_connections 2023-08-09T12:42:34.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.839+0000 7f7ac6337640 1 --2- 172.21.15.17:0/3518158041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ac00b06b0 0x7f7ac015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.839+0000 7f7ac6337640 1 --2- 172.21.15.17:0/3518158041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac015d000 0x7f7ac0160580 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.839+0000 7f7ac6337640 1 -- 172.21.15.17:0/3518158041 >> 172.21.15.17:0/3518158041 conn(0x7f7ac00cafa0 msgr2=0x7f7ac00cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:34.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.839+0000 7f7ac6337640 1 -- 172.21.15.17:0/3518158041 shutdown_connections 2023-08-09T12:42:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.839+0000 7f7ac6337640 1 -- 172.21.15.17:0/3518158041 wait complete. 2023-08-09T12:42:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.841+0000 7f7ac6337640 1 Processor -- start 2023-08-09T12:42:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.841+0000 7f7ac6337640 1 -- start start 2023-08-09T12:42:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.842+0000 7f7ac6337640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac00b06b0 0x7f7ac0153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.842+0000 7f7ac6337640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ac00cc0f0 0x7f7ac00c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.842+0000 7f7ac6337640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac015d000 0x7f7ac00c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.842+0000 7f7ac6337640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0070fe0 con 0x7f7ac00b06b0 2023-08-09T12:42:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.842+0000 7f7ac6337640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00703d0 con 0x7f7ac015d000 2023-08-09T12:42:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.842+0000 7f7ac6337640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00706b0 con 0x7f7ac00cc0f0 2023-08-09T12:42:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac00b06b0 0x7f7ac0153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac00b06b0 0x7f7ac0153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51118/0 (socket says 172.21.15.17:51118) 2023-08-09T12:42:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 -- 172.21.15.17:0/1270539974 learned_addr learned my addr 172.21.15.17:0/1270539974 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 -- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ac00cc0f0 msgr2=0x7f7ac00c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ac00cc0f0 0x7f7ac00c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 -- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac015d000 msgr2=0x7f7ac00c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5b36640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac015d000 0x7f7ac00c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac015d000 0x7f7ac00c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 -- 172.21.15.17:0/1270539974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc009400 con 0x7f7ac00b06b0 2023-08-09T12:42:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5b36640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac015d000 0x7f7ac00c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.843+0000 7f7ac5335640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac00b06b0 0x7f7ac0153db0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0097a0 tx=0x7f7abc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.844+0000 7f7ab5ffb640 1 -- 172.21.15.17:0/1270539974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0328a0 con 0x7f7ac00b06b0 2023-08-09T12:42:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.844+0000 7f7ab5ffb640 1 -- 172.21.15.17:0/1270539974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc032a00 con 0x7f7ac00b06b0 2023-08-09T12:42:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.844+0000 7f7ab5ffb640 1 -- 172.21.15.17:0/1270539974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc032db0 con 0x7f7ac00b06b0 2023-08-09T12:42:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.844+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac0070990 con 0x7f7ac00b06b0 2023-08-09T12:42:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.844+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac01542f0 con 0x7f7ac00b06b0 2023-08-09T12:42:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.845+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac0071150 con 0x7f7ac00b06b0 2023-08-09T12:42:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.846+0000 7f7ab5ffb640 1 -- 172.21.15.17:0/1270539974 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7abc04d3f0 con 0x7f7ac00b06b0 2023-08-09T12:42:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.847+0000 7f7ab5ffb640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7aa406a050 0x7f7aa406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.847+0000 7f7ab5ffb640 1 -- 172.21.15.17:0/1270539974 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7abc0aa1a0 con 0x7f7ac00b06b0 2023-08-09T12:42:34.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.848+0000 7f7ac4b34640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7aa406a050 0x7f7aa406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:34.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.849+0000 7f7ac4b34640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7aa406a050 0x7f7aa406c510 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0007fd0 tx=0x7f7ab0007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:34.851+0000 7f7ab5ffb640 1 -- 172.21.15.17:0/1270539974 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7abc075b40 con 0x7f7ac00b06b0 2023-08-09T12:42:35.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.043+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7ac004e390 con 0x7f7ac00b06b0 2023-08-09T12:42:35.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.207+0000 7f7ab5ffb640 1 -- 172.21.15.17:0/1270539974 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7abc079160 con 0x7f7ac00b06b0 2023-08-09T12:42:35.210 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:42:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.211+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7aa406a050 msgr2=0x7f7aa406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.211+0000 7f7ac6337640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7aa406a050 0x7f7aa406c510 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0007fd0 tx=0x7f7ab0007920 comp rx=0 tx=0).stop 2023-08-09T12:42:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.212+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac00b06b0 msgr2=0x7f7ac0153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.212+0000 7f7ac6337640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac00b06b0 0x7f7ac0153db0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0097a0 tx=0x7f7abc0046c0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.213+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 shutdown_connections 2023-08-09T12:42:35.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.213+0000 7f7ac6337640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7aa406a050 0x7f7aa406c510 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.213+0000 7f7ac6337640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac015d000 0x7f7ac00c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.213+0000 7f7ac6337640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ac00cc0f0 0x7f7ac00c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.213+0000 7f7ac6337640 1 --2- 172.21.15.17:0/1270539974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ac00b06b0 0x7f7ac0153db0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.213+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 >> 172.21.15.17:0/1270539974 conn(0x7f7ac00cafa0 msgr2=0x7f7ac00cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:35.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.214+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 shutdown_connections 2023-08-09T12:42:35.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.214+0000 7f7ac6337640 1 -- 172.21.15.17:0/1270539974 wait complete. 2023-08-09T12:42:35.239 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:42:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.470+0000 7f5229052640 1 Processor -- start 2023-08-09T12:42:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.471+0000 7f5229052640 1 -- start start 2023-08-09T12:42:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.472+0000 7f5229052640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f522415cb40 0x7f52241609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.472+0000 7f5229052640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f52240d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.472+0000 7f5229052640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52240d0f00 con 0x7f52240b8420 2023-08-09T12:42:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.472+0000 7f5229052640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52241611f0 con 0x7f522415cb40 2023-08-09T12:42:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.472+0000 7f5229052640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52241614d0 con 0x7f52240cdf70 2023-08-09T12:42:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.473+0000 7f5228851640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f52240d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.473+0000 7f5223fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f522415cb40 0x7f52241609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.473+0000 7f5228851640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f52240d16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:43968/0 (socket says 172.21.15.17:43968) 2023-08-09T12:42:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.473+0000 7f5228851640 1 -- 172.21.15.17:0/3952698387 learned_addr learned my addr 172.21.15.17:0/3952698387 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.474+0000 7f5228851640 1 -- 172.21.15.17:0/3952698387 >> v2:172.21.15.142:3300/0 conn(0x7f522415cb40 msgr2=0x7f52241609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.474+0000 7f5228851640 1 --2- 172.21.15.17:0/3952698387 >> v2:172.21.15.142:3300/0 conn(0x7f522415cb40 0x7f52241609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.474+0000 7f5228851640 1 -- 172.21.15.17:0/3952698387 >> v1:172.21.15.142:6789/0 conn(0x7f52240b8420 legacy=0x7f52240cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.474+0000 7f5228851640 1 -- 172.21.15.17:0/3952698387 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52241617b0 con 0x7f52240cdf70 2023-08-09T12:42:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.475+0000 7f5228851640 1 --2- 172.21.15.17:0/3952698387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f52240d16c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f521c009e50 tx=0x7f521c02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fc7c734eab223c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.476+0000 7f52237fe640 1 -- 172.21.15.17:0/3952698387 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c02cb90 con 0x7f52240cdf70 2023-08-09T12:42:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.476+0000 7f52237fe640 1 -- 172.21.15.17:0/3952698387 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c02ccf0 con 0x7f52240cdf70 2023-08-09T12:42:35.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.476+0000 7f52237fe640 1 -- 172.21.15.17:0/3952698387 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c034610 con 0x7f52240cdf70 2023-08-09T12:42:35.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.476+0000 7f5229052640 1 -- 172.21.15.17:0/3952698387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 msgr2=0x7f52240d16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:35.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.476+0000 7f5229052640 1 --2- 172.21.15.17:0/3952698387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f52240d16c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f521c009e50 tx=0x7f521c02bff0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.477+0000 7f5229052640 1 -- 172.21.15.17:0/3952698387 shutdown_connections 2023-08-09T12:42:35.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.477+0000 7f5229052640 1 --2- 172.21.15.17:0/3952698387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f52240d16c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.477+0000 7f5229052640 1 --2- 172.21.15.17:0/3952698387 >> v2:172.21.15.142:3300/0 conn(0x7f522415cb40 0x7f52241609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.477+0000 7f5229052640 1 -- 172.21.15.17:0/3952698387 >> 172.21.15.17:0/3952698387 conn(0x7f52240d2ab0 msgr2=0x7f52240d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:35.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.477+0000 7f5229052640 1 -- 172.21.15.17:0/3952698387 shutdown_connections 2023-08-09T12:42:35.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.477+0000 7f5229052640 1 -- 172.21.15.17:0/3952698387 wait complete. 2023-08-09T12:42:35.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.478+0000 7f5229052640 1 Processor -- start 2023-08-09T12:42:35.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.479+0000 7f5229052640 1 -- start start 2023-08-09T12:42:35.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.479+0000 7f5229052640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52240b8420 0x7f522415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5229052640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f5224153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5229052640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f522415cb40 0x7f52240cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5229052640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522415e630 con 0x7f52240b8420 2023-08-09T12:42:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5229052640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52240cc070 con 0x7f522415cb40 2023-08-09T12:42:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5229052640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52240cc350 con 0x7f52240cdf70 2023-08-09T12:42:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5223fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52240b8420 0x7f522415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5223fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52240b8420 0x7f522415e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51120/0 (socket says 172.21.15.17:51120) 2023-08-09T12:42:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5223fff640 1 -- 172.21.15.17:0/2012760391 learned_addr learned my addr 172.21.15.17:0/2012760391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f521bfff640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f5224153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5228851640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f522415cb40 0x7f52240cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5223fff640 1 -- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 msgr2=0x7f5224153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5223fff640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f5224153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5223fff640 1 -- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f522415cb40 msgr2=0x7f52240cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5223fff640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f522415cb40 0x7f52240cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.480+0000 7f5223fff640 1 -- 172.21.15.17:0/2012760391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c009b30 con 0x7f52240b8420 2023-08-09T12:42:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.481+0000 7f5223fff640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52240b8420 0x7f522415e0f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f521400e870 tx=0x7f521400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.481+0000 7f52217fa640 1 -- 172.21.15.17:0/2012760391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140094f0 con 0x7f52240b8420 2023-08-09T12:42:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.481+0000 7f52217fa640 1 -- 172.21.15.17:0/2012760391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521400c940 con 0x7f52240b8420 2023-08-09T12:42:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.481+0000 7f52217fa640 1 -- 172.21.15.17:0/2012760391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521400ccf0 con 0x7f52240b8420 2023-08-09T12:42:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.481+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52240cc630 con 0x7f52240b8420 2023-08-09T12:42:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.481+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5224153550 con 0x7f52240b8420 2023-08-09T12:42:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.483+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522404e390 con 0x7f52240b8420 2023-08-09T12:42:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.484+0000 7f52217fa640 1 -- 172.21.15.17:0/2012760391 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5214013470 con 0x7f52240b8420 2023-08-09T12:42:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.485+0000 7f52217fa640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f520406a080 0x7f520406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:35.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.485+0000 7f52217fa640 1 -- 172.21.15.17:0/2012760391 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5214088ca0 con 0x7f52240b8420 2023-08-09T12:42:35.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.486+0000 7f521bfff640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f520406a080 0x7f520406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:35.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.487+0000 7f521bfff640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f520406a080 0x7f520406c540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5224160940 tx=0x7f520c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.489+0000 7f52217fa640 1 -- 172.21.15.17:0/2012760391 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5214054550 con 0x7f52240b8420 2023-08-09T12:42:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:35.683+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f52240b7be0 con 0x7f52240b8420 2023-08-09T12:42:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.226+0000 7f52217fa640 1 -- 172.21.15.17:0/2012760391 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) v1 ==== 170+0+0 (secure 0 0 0) 0x7f52140170d0 con 0x7f52240b8420 2023-08-09T12:42:36.231 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:42:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f520406a080 msgr2=0x7f520406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f520406a080 0x7f520406c540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5224160940 tx=0x7f520c009040 comp rx=0 tx=0).stop 2023-08-09T12:42:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52240b8420 msgr2=0x7f522415e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52240b8420 0x7f522415e0f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f521400e870 tx=0x7f521400ed30 comp rx=0 tx=0).stop 2023-08-09T12:42:36.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 shutdown_connections 2023-08-09T12:42:36.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f520406a080 0x7f520406c540 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5224160940 tx=0x7f520c009040 comp rx=0 tx=0).stop 2023-08-09T12:42:36.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f522415cb40 0x7f52240cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:36.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240cdf70 0x7f5224153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:36.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 --2- 172.21.15.17:0/2012760391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52240b8420 0x7f522415e0f0 secure :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f521400e870 tx=0x7f521400ed30 comp rx=0 tx=0).stop 2023-08-09T12:42:36.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.232+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 >> 172.21.15.17:0/2012760391 conn(0x7f52240d2ab0 msgr2=0x7f52240d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:36.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.234+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 shutdown_connections 2023-08-09T12:42:36.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.234+0000 7f5229052640 1 -- 172.21.15.17:0/2012760391 wait complete. 2023-08-09T12:42:36.264 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:42:36.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.458+0000 7fa775425640 1 Processor -- start 2023-08-09T12:42:36.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.458+0000 7fa775425640 1 -- start start 2023-08-09T12:42:36.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.460+0000 7fa775425640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 0x7fa7700b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:36.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.460+0000 7fa775425640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa770160640 0x7fa77015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:36.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.460+0000 7fa775425640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa770157580 con 0x7fa7700cdb00 2023-08-09T12:42:36.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.460+0000 7fa775425640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77015d1c0 con 0x7fa770160640 2023-08-09T12:42:36.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.460+0000 7fa775425640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700ad490 con 0x7fa7700b0020 2023-08-09T12:42:36.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.460+0000 7fa774c24640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa770160640 0x7fa77015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:36.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.460+0000 7fa774c24640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa770160640 0x7fa77015d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51130/0 (socket says 172.21.15.17:51130) 2023-08-09T12:42:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.460+0000 7fa774c24640 1 -- 172.21.15.17:0/1435435029 learned_addr learned my addr 172.21.15.17:0/1435435029 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.461+0000 7fa76ffff640 1 --2- 172.21.15.17:0/1435435029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 0x7fa7700b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.461+0000 7fa774c24640 1 -- 172.21.15.17:0/1435435029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 msgr2=0x7fa7700b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.461+0000 7fa774c24640 1 --2- 172.21.15.17:0/1435435029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 0x7fa7700b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.461+0000 7fa774c24640 1 -- 172.21.15.17:0/1435435029 >> v1:172.21.15.142:6789/0 conn(0x7fa7700cdb00 legacy=0x7fa7700acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.461+0000 7fa774c24640 1 -- 172.21.15.17:0/1435435029 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700b0940 con 0x7fa770160640 2023-08-09T12:42:36.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.462+0000 7fa774c24640 1 --2- 172.21.15.17:0/1435435029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa770160640 0x7fa77015d5e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa768009870 tx=0x7fa76802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb6d3bf5935eeb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:36.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.462+0000 7fa76effd640 1 -- 172.21.15.17:0/1435435029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768031640 con 0x7fa770160640 2023-08-09T12:42:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.462+0000 7fa76effd640 1 -- 172.21.15.17:0/1435435029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7680317a0 con 0x7fa770160640 2023-08-09T12:42:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.462+0000 7fa76effd640 1 -- 172.21.15.17:0/1435435029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768031b30 con 0x7fa770160640 2023-08-09T12:42:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.463+0000 7fa775425640 1 -- 172.21.15.17:0/1435435029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa770160640 msgr2=0x7fa77015d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.463+0000 7fa775425640 1 --2- 172.21.15.17:0/1435435029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa770160640 0x7fa77015d5e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa768009870 tx=0x7fa76802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:42:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.463+0000 7fa775425640 1 -- 172.21.15.17:0/1435435029 shutdown_connections 2023-08-09T12:42:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.463+0000 7fa775425640 1 --2- 172.21.15.17:0/1435435029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa770160640 0x7fa77015d5e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.463+0000 7fa775425640 1 --2- 172.21.15.17:0/1435435029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 0x7fa7700b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.463+0000 7fa775425640 1 -- 172.21.15.17:0/1435435029 >> 172.21.15.17:0/1435435029 conn(0x7fa7700cb020 msgr2=0x7fa7700cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.463+0000 7fa775425640 1 -- 172.21.15.17:0/1435435029 shutdown_connections 2023-08-09T12:42:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.463+0000 7fa775425640 1 -- 172.21.15.17:0/1435435029 wait complete. 2023-08-09T12:42:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.465+0000 7fa775425640 1 Processor -- start 2023-08-09T12:42:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.465+0000 7fa775425640 1 -- start start 2023-08-09T12:42:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa775425640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 0x7fa77006f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa775425640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7700cdb00 0x7fa770071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa775425640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa770160640 0x7fa77015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa775425640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700c4cd0 con 0x7fa7700cdb00 2023-08-09T12:42:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa775425640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77006f8d0 con 0x7fa770160640 2023-08-09T12:42:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa775425640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa770071960 con 0x7fa7700b0020 2023-08-09T12:42:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa76f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7700cdb00 0x7fa770071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa76f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7700cdb00 0x7fa770071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51140/0 (socket says 172.21.15.17:51140) 2023-08-09T12:42:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.466+0000 7fa76f7fe640 1 -- 172.21.15.17:0/2193716069 learned_addr learned my addr 172.21.15.17:0/2193716069 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:36.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76ffff640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 0x7fa77006f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:36.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76f7fe640 1 -- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 msgr2=0x7fa77006f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76f7fe640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 0x7fa77006f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa774c24640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa770160640 0x7fa77015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76f7fe640 1 -- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa770160640 msgr2=0x7fa77015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76f7fe640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa770160640 0x7fa77015e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76f7fe640 1 -- 172.21.15.17:0/2193716069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680094d0 con 0x7fa7700cdb00 2023-08-09T12:42:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76f7fe640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7700cdb00 0x7fa770071420 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa76400c7e0 tx=0x7fa76400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76cff9640 1 -- 172.21.15.17:0/2193716069 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400a9f0 con 0x7fa7700cdb00 2023-08-09T12:42:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76cff9640 1 -- 172.21.15.17:0/2193716069 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400ab50 con 0x7fa7700cdb00 2023-08-09T12:42:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.467+0000 7fa76cff9640 1 -- 172.21.15.17:0/2193716069 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764012420 con 0x7fa7700cdb00 2023-08-09T12:42:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.468+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7700b29b0 con 0x7fa7700cdb00 2023-08-09T12:42:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.468+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77006fdd0 con 0x7fa7700cdb00 2023-08-09T12:42:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.469+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7700662a0 con 0x7fa7700cdb00 2023-08-09T12:42:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.470+0000 7fa76cff9640 1 -- 172.21.15.17:0/2193716069 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa764006b50 con 0x7fa7700cdb00 2023-08-09T12:42:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.471+0000 7fa76cff9640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa75c06a050 0x7fa75c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.471+0000 7fa76cff9640 1 -- 172.21.15.17:0/2193716069 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fa764088c60 con 0x7fa7700cdb00 2023-08-09T12:42:36.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.472+0000 7fa76ffff640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa75c06a050 0x7fa75c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:36.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.473+0000 7fa76ffff640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa75c06a050 0x7fa75c06c510 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa760006fd0 tx=0x7fa760008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.475+0000 7fa76cff9640 1 -- 172.21.15.17:0/2193716069 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa764054390 con 0x7fa7700cdb00 2023-08-09T12:42:36.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:36.708+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa77006fff0 con 0x7fa7700cdb00 2023-08-09T12:42:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.230+0000 7fa76cff9640 1 -- 172.21.15.17:0/2193716069 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v31) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa764016020 con 0x7fa7700cdb00 2023-08-09T12:42:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 9 and data pool 10 2023-08-09T12:42:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.235+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa75c06a050 msgr2=0x7fa75c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.235+0000 7fa775425640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa75c06a050 0x7fa75c06c510 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa760006fd0 tx=0x7fa760008040 comp rx=0 tx=0).stop 2023-08-09T12:42:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.235+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7700cdb00 msgr2=0x7fa770071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.235+0000 7fa775425640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7700cdb00 0x7fa770071420 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa76400c7e0 tx=0x7fa76400cca0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.238+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 shutdown_connections 2023-08-09T12:42:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.238+0000 7fa775425640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa75c06a050 0x7fa75c06c510 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.238+0000 7fa775425640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa770160640 0x7fa77015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.238+0000 7fa775425640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7700cdb00 0x7fa770071420 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.238+0000 7fa775425640 1 --2- 172.21.15.17:0/2193716069 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7700b0020 0x7fa77006f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.238+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 >> 172.21.15.17:0/2193716069 conn(0x7fa7700cb020 msgr2=0x7fa7700af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.243+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 shutdown_connections 2023-08-09T12:42:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.243+0000 7fa775425640 1 -- 172.21.15.17:0/2193716069 wait complete. 2023-08-09T12:42:37.273 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:37.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.461+0000 7fd1cb584640 1 Processor -- start 2023-08-09T12:42:37.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.461+0000 7fd1cb584640 1 -- start start 2023-08-09T12:42:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.463+0000 7fd1cb584640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c4161660 0x7fd1c40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.463+0000 7fd1cb584640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1c40acdf0 0x7fd1c40cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.463+0000 7fd1cb584640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c415df30 con 0x7fd1c4161280 2023-08-09T12:42:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.463+0000 7fd1cb584640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c40ad2a0 con 0x7fd1c40acdf0 2023-08-09T12:42:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.463+0000 7fd1cb584640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c415d430 con 0x7fd1c4161660 2023-08-09T12:42:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.464+0000 7fd1c9320640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd1c4161280 0x7fd1c40c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:57120/0 (socket says 172.21.15.17:57120) 2023-08-09T12:42:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.464+0000 7fd1c9320640 1 -- 172.21.15.17:0/196082777 learned_addr learned my addr 172.21.15.17:0/196082777 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.464+0000 7fd1c8b1f640 1 --2- 172.21.15.17:0/196082777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c4161660 0x7fd1c40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.464+0000 7fd1c9b21640 1 --2- 172.21.15.17:0/196082777 >> v2:172.21.15.142:3300/0 conn(0x7fd1c40acdf0 0x7fd1c40cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.464+0000 7fd1bbfff640 1 -- 172.21.15.17:0/196082777 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353034519 0 0) 0x7fd1c415df30 con 0x7fd1c4161280 2023-08-09T12:42:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.465+0000 7fd1bbfff640 1 -- 172.21.15.17:0/196082777 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b0003520 con 0x7fd1c4161280 2023-08-09T12:42:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.465+0000 7fd1c8b1f640 1 -- 172.21.15.17:0/196082777 >> v2:172.21.15.142:3300/0 conn(0x7fd1c40acdf0 msgr2=0x7fd1c40cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.465+0000 7fd1c8b1f640 1 --2- 172.21.15.17:0/196082777 >> v2:172.21.15.142:3300/0 conn(0x7fd1c40acdf0 0x7fd1c40cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.465+0000 7fd1c8b1f640 1 -- 172.21.15.17:0/196082777 >> v1:172.21.15.142:6789/0 conn(0x7fd1c4161280 legacy=0x7fd1c40c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.465+0000 7fd1c8b1f640 1 -- 172.21.15.17:0/196082777 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40ca9d0 con 0x7fd1c4161660 2023-08-09T12:42:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.466+0000 7fd1c8b1f640 1 --2- 172.21.15.17:0/196082777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c4161660 0x7fd1c40ac8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009790 tx=0x7fd1b402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899ec97689003876 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1bbfff640 1 -- 172.21.15.17:0/196082777 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4031770 con 0x7fd1c4161660 2023-08-09T12:42:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1bbfff640 1 -- 172.21.15.17:0/196082777 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b40318d0 con 0x7fd1c4161660 2023-08-09T12:42:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1bbfff640 1 -- 172.21.15.17:0/196082777 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4031c60 con 0x7fd1c4161660 2023-08-09T12:42:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1cb584640 1 -- 172.21.15.17:0/196082777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c4161660 msgr2=0x7fd1c40ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1cb584640 1 --2- 172.21.15.17:0/196082777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c4161660 0x7fd1c40ac8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009790 tx=0x7fd1b402b810 comp rx=0 tx=0).stop 2023-08-09T12:42:37.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1cb584640 1 -- 172.21.15.17:0/196082777 shutdown_connections 2023-08-09T12:42:37.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1cb584640 1 --2- 172.21.15.17:0/196082777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c4161660 0x7fd1c40ac8b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1cb584640 1 --2- 172.21.15.17:0/196082777 >> v2:172.21.15.142:3300/0 conn(0x7fd1c40acdf0 0x7fd1c40cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1cb584640 1 -- 172.21.15.17:0/196082777 >> 172.21.15.17:0/196082777 conn(0x7fd1c40cb1b0 msgr2=0x7fd1c40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:37.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1cb584640 1 -- 172.21.15.17:0/196082777 shutdown_connections 2023-08-09T12:42:37.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.467+0000 7fd1cb584640 1 -- 172.21.15.17:0/196082777 wait complete. 2023-08-09T12:42:37.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.469+0000 7fd1cb584640 1 Processor -- start 2023-08-09T12:42:37.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.469+0000 7fd1cb584640 1 -- start start 2023-08-09T12:42:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.470+0000 7fd1cb584640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c40acdf0 0x7fd1c40b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.470+0000 7fd1cb584640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1c4161280 0x7fd1c4154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.470+0000 7fd1cb584640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1c4161660 0x7fd1c41569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.470+0000 7fd1cb584640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40c4620 con 0x7fd1c4161660 2023-08-09T12:42:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.470+0000 7fd1cb584640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c41513d0 con 0x7fd1c4161280 2023-08-09T12:42:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.470+0000 7fd1cb584640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4155900 con 0x7fd1c40acdf0 2023-08-09T12:42:37.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9b21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1c4161660 0x7fd1c41569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9b21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1c4161660 0x7fd1c41569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51150/0 (socket says 172.21.15.17:51150) 2023-08-09T12:42:37.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9b21640 1 -- 172.21.15.17:0/2820735535 learned_addr learned my addr 172.21.15.17:0/2820735535 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:37.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c8b1f640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1c4161280 0x7fd1c4154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9320640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c40acdf0 0x7fd1c40b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9b21640 1 -- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c40acdf0 msgr2=0x7fd1c40b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9b21640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c40acdf0 0x7fd1c40b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9b21640 1 -- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1c4161280 msgr2=0x7fd1c4154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9b21640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1c4161280 0x7fd1c4154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.471+0000 7fd1c9b21640 1 -- 172.21.15.17:0/2820735535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40093a0 con 0x7fd1c4161660 2023-08-09T12:42:37.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.472+0000 7fd1c9b21640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1c4161660 0x7fd1c41569a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00efc0 tx=0x7fd1bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:37.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.472+0000 7fd1b9ffb640 1 -- 172.21.15.17:0/2820735535 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc009ba0 con 0x7fd1c4161660 2023-08-09T12:42:37.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.472+0000 7fd1b9ffb640 1 -- 172.21.15.17:0/2820735535 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00f040 con 0x7fd1c4161660 2023-08-09T12:42:37.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.472+0000 7fd1b9ffb640 1 -- 172.21.15.17:0/2820735535 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0146c0 con 0x7fd1c4161660 2023-08-09T12:42:37.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.472+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c4155be0 con 0x7fd1c4161660 2023-08-09T12:42:37.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.472+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c41561a0 con 0x7fd1c4161660 2023-08-09T12:42:37.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.473+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c4067a80 con 0x7fd1c4161660 2023-08-09T12:42:37.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.474+0000 7fd1b9ffb640 1 -- 172.21.15.17:0/2820735535 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd1bc014820 con 0x7fd1c4161660 2023-08-09T12:42:37.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.475+0000 7fd1b9ffb640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1a806a050 0x7fd1a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.475+0000 7fd1b9ffb640 1 -- 172.21.15.17:0/2820735535 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1bc089140 con 0x7fd1c4161660 2023-08-09T12:42:37.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.476+0000 7fd1c9320640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1a806a050 0x7fd1a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.477+0000 7fd1c9320640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1a806a050 0x7fd1a806c510 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0005880 tx=0x7fd1c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:37.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.480+0000 7fd1b9ffb640 1 -- 172.21.15.17:0/2820735535 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd1bc054790 con 0x7fd1c4161660 2023-08-09T12:42:37.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.677+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1c40adc60 con 0x7fd1c4161660 2023-08-09T12:42:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.680+0000 7fd1b9ffb640 1 -- 172.21.15.17:0/2820735535 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18282 (secure 0 0 0) 0x7fd1bc057db0 con 0x7fd1c4161660 2023-08-09T12:42:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:37.685 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":69,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:36.709905+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:42:35.097822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-09T12:42:35.735356+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:37.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.683+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1a806a050 msgr2=0x7fd1a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.683+0000 7fd1cb584640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1a806a050 0x7fd1a806c510 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0005880 tx=0x7fd1c0009040 comp rx=0 tx=0).stop 2023-08-09T12:42:37.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.683+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1c4161660 msgr2=0x7fd1c41569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.683+0000 7fd1cb584640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1c4161660 0x7fd1c41569a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00efc0 tx=0x7fd1bc00c490 comp rx=0 tx=0).stop 2023-08-09T12:42:37.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.683+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 shutdown_connections 2023-08-09T12:42:37.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.684+0000 7fd1cb584640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1a806a050 0x7fd1a806c510 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.684+0000 7fd1cb584640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1c4161660 0x7fd1c41569a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.684+0000 7fd1cb584640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1c4161280 0x7fd1c4154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.684+0000 7fd1cb584640 1 --2- 172.21.15.17:0/2820735535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c40acdf0 0x7fd1c40b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.684+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 >> 172.21.15.17:0/2820735535 conn(0x7fd1c40cb1b0 msgr2=0x7fd1c40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:37.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.684+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 shutdown_connections 2023-08-09T12:42:37.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.684+0000 7fd1cb584640 1 -- 172.21.15.17:0/2820735535 wait complete. 2023-08-09T12:42:37.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:37.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.936+0000 7efeb781f640 1 Processor -- start 2023-08-09T12:42:37.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.936+0000 7efeb781f640 1 -- start start 2023-08-09T12:42:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb781f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb015ac50 0x7efeb006a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb781f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efeb006a720 0x7efeb006ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb781f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00cc210 con 0x7efeb00cb4d0 2023-08-09T12:42:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb781f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb006a590 con 0x7efeb006a720 2023-08-09T12:42:37.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb781f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb015b030 con 0x7efeb015ac50 2023-08-09T12:42:37.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb55bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb015ac50 0x7efeb006a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb55bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb015ac50 0x7efeb006a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:42914/0 (socket says 172.21.15.17:42914) 2023-08-09T12:42:37.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb55bb640 1 -- 172.21.15.17:0/3945503509 learned_addr learned my addr 172.21.15.17:0/3945503509 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:37.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.938+0000 7efeb5dbc640 1 --2- 172.21.15.17:0/3945503509 >> v2:172.21.15.142:3300/0 conn(0x7efeb006a720 0x7efeb006ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.939+0000 7efeb55bb640 1 -- 172.21.15.17:0/3945503509 >> v2:172.21.15.142:3300/0 conn(0x7efeb006a720 msgr2=0x7efeb006ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.939+0000 7efeb55bb640 1 --2- 172.21.15.17:0/3945503509 >> v2:172.21.15.142:3300/0 conn(0x7efeb006a720 0x7efeb006ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.939+0000 7efeb55bb640 1 -- 172.21.15.17:0/3945503509 >> v1:172.21.15.142:6789/0 conn(0x7efeb00cb4d0 legacy=0x7efeb006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.939+0000 7efeb55bb640 1 -- 172.21.15.17:0/3945503509 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb006b060 con 0x7efeb015ac50 2023-08-09T12:42:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.940+0000 7efeb55bb640 1 --2- 172.21.15.17:0/3945503509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb015ac50 0x7efeb006a050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efeac009870 tx=0x7efeac02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52ab23e178d61f14 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.941+0000 7efea7fff640 1 -- 172.21.15.17:0/3945503509 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac031640 con 0x7efeb015ac50 2023-08-09T12:42:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.941+0000 7efea7fff640 1 -- 172.21.15.17:0/3945503509 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac0317a0 con 0x7efeb015ac50 2023-08-09T12:42:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.941+0000 7efea7fff640 1 -- 172.21.15.17:0/3945503509 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac031b30 con 0x7efeb015ac50 2023-08-09T12:42:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.942+0000 7efeb781f640 1 -- 172.21.15.17:0/3945503509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb015ac50 msgr2=0x7efeb006a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.942+0000 7efeb781f640 1 --2- 172.21.15.17:0/3945503509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb015ac50 0x7efeb006a050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efeac009870 tx=0x7efeac02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.942+0000 7efeb781f640 1 -- 172.21.15.17:0/3945503509 shutdown_connections 2023-08-09T12:42:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.942+0000 7efeb781f640 1 --2- 172.21.15.17:0/3945503509 >> v2:172.21.15.142:3300/0 conn(0x7efeb006a720 0x7efeb006ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.942+0000 7efeb781f640 1 --2- 172.21.15.17:0/3945503509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb015ac50 0x7efeb006a050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.942+0000 7efeb781f640 1 -- 172.21.15.17:0/3945503509 >> 172.21.15.17:0/3945503509 conn(0x7efeb00cf930 msgr2=0x7efeb00cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.942+0000 7efeb781f640 1 -- 172.21.15.17:0/3945503509 shutdown_connections 2023-08-09T12:42:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.942+0000 7efeb781f640 1 -- 172.21.15.17:0/3945503509 wait complete. 2023-08-09T12:42:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.944+0000 7efeb781f640 1 Processor -- start 2023-08-09T12:42:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.944+0000 7efeb781f640 1 -- start start 2023-08-09T12:42:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.945+0000 7efeb781f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb006a720 0x7efeb01506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.945+0000 7efeb781f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb00cb4d0 0x7efeb0156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.945+0000 7efeb781f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeb015ac50 0x7efeb0156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.945+0000 7efeb781f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0155e40 con 0x7efeb015ac50 2023-08-09T12:42:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.945+0000 7efeb781f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01f0fa0 con 0x7efeb006a720 2023-08-09T12:42:37.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.945+0000 7efeb781f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0155780 con 0x7efeb00cb4d0 2023-08-09T12:42:37.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb5dbc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeb015ac50 0x7efeb0156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb5dbc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeb015ac50 0x7efeb0156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39044/0 (socket says 172.21.15.17:39044) 2023-08-09T12:42:37.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb5dbc640 1 -- 172.21.15.17:0/3647374670 learned_addr learned my addr 172.21.15.17:0/3647374670 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:37.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb55bb640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb006a720 0x7efeb01506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb4dba640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb00cb4d0 0x7efeb0156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb5dbc640 1 -- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb00cb4d0 msgr2=0x7efeb0156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb5dbc640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb00cb4d0 0x7efeb0156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb5dbc640 1 -- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb006a720 msgr2=0x7efeb01506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:37.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb5dbc640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb006a720 0x7efeb01506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:37.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.946+0000 7efeb5dbc640 1 -- 172.21.15.17:0/3647374670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0094d0 con 0x7efeb015ac50 2023-08-09T12:42:37.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.947+0000 7efeb5dbc640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeb015ac50 0x7efeb0156cc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7efea800efc0 tx=0x7efea800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:37.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.947+0000 7efea5ffb640 1 -- 172.21.15.17:0/3647374670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8014480 con 0x7efeb015ac50 2023-08-09T12:42:37.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.947+0000 7efea5ffb640 1 -- 172.21.15.17:0/3647374670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800f040 con 0x7efeb015ac50 2023-08-09T12:42:37.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.947+0000 7efea5ffb640 1 -- 172.21.15.17:0/3647374670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8014820 con 0x7efeb015ac50 2023-08-09T12:42:37.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.947+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb0155a60 con 0x7efeb015ac50 2023-08-09T12:42:37.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.947+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0155450 con 0x7efeb015ac50 2023-08-09T12:42:37.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.949+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0155f80 con 0x7efeb015ac50 2023-08-09T12:42:37.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.949+0000 7efea5ffb640 1 -- 172.21.15.17:0/3647374670 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efea8014980 con 0x7efeb015ac50 2023-08-09T12:42:37.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.950+0000 7efea5ffb640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe9406a050 0x7efe9406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:37.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.951+0000 7efea5ffb640 1 -- 172.21.15.17:0/3647374670 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efea8089390 con 0x7efeb015ac50 2023-08-09T12:42:37.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.951+0000 7efeb55bb640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe9406a050 0x7efe9406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.952+0000 7efeb55bb640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe9406a050 0x7efe9406c510 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efeac036000 tx=0x7efeac03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:37.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:37.955+0000 7efea5ffb640 1 -- 172.21.15.17:0/3647374670 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efeb0155f80 con 0x7efeb015ac50 2023-08-09T12:42:38.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.146+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb0155f80 con 0x7efeb015ac50 2023-08-09T12:42:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.148+0000 7efea5ffb640 1 -- 172.21.15.17:0/3647374670 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18282 (secure 0 0 0) 0x7efeb0155f80 con 0x7efeb015ac50 2023-08-09T12:42:38.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:38.152 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":69,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:36.709905+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:42:35.097822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-09T12:42:35.735356+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:38.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe9406a050 msgr2=0x7efe9406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:38.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe9406a050 0x7efe9406c510 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efeac036000 tx=0x7efeac03c040 comp rx=0 tx=0).stop 2023-08-09T12:42:38.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeb015ac50 msgr2=0x7efeb0156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:38.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeb015ac50 0x7efeb0156cc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7efea800efc0 tx=0x7efea800c490 comp rx=0 tx=0).stop 2023-08-09T12:42:38.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 shutdown_connections 2023-08-09T12:42:38.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efe9406a050 0x7efe9406c510 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeb015ac50 0x7efeb0156cc0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb00cb4d0 0x7efeb0156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 --2- 172.21.15.17:0/3647374670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb006a720 0x7efeb01506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 >> 172.21.15.17:0/3647374670 conn(0x7efeb00cf930 msgr2=0x7efeb0072850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:38.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 shutdown_connections 2023-08-09T12:42:38.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.151+0000 7efeb781f640 1 -- 172.21.15.17:0/3647374670 wait complete. 2023-08-09T12:42:38.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:42:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.408+0000 7f67f9887640 1 Processor -- start 2023-08-09T12:42:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.408+0000 7f67f9887640 1 -- start start 2023-08-09T12:42:38.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f9887640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f40af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:38.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f9887640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67f40afce0 0x7f67f40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:38.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f9887640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67f40cef20 0x7f67f406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:38.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f9887640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f4158c20 con 0x7f67f40afce0 2023-08-09T12:42:38.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f9887640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f40cf3b0 con 0x7f67f40cef20 2023-08-09T12:42:38.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f9887640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40b0220 con 0x7f67f4158840 2023-08-09T12:42:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f27fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67f40afce0 0x7f67f40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f27fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67f40afce0 0x7f67f40ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39054/0 (socket says 172.21.15.17:39054) 2023-08-09T12:42:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f27fc640 1 -- 172.21.15.17:0/4276414604 learned_addr learned my addr 172.21.15.17:0/4276414604 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f2ffd640 1 --2- 172.21.15.17:0/4276414604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f40af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.410+0000 7f67f37fe640 1 --2- 172.21.15.17:0/4276414604 >> v2:172.21.15.142:3300/0 conn(0x7f67f40cef20 0x7f67f406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.411+0000 7f67f27fc640 1 -- 172.21.15.17:0/4276414604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 msgr2=0x7f67f40af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.411+0000 7f67f27fc640 1 --2- 172.21.15.17:0/4276414604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f40af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.411+0000 7f67f27fc640 1 -- 172.21.15.17:0/4276414604 >> v2:172.21.15.142:3300/0 conn(0x7f67f40cef20 msgr2=0x7f67f406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.411+0000 7f67f27fc640 1 --2- 172.21.15.17:0/4276414604 >> v2:172.21.15.142:3300/0 conn(0x7f67f40cef20 0x7f67f406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.411+0000 7f67f27fc640 1 -- 172.21.15.17:0/4276414604 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f415e7f0 con 0x7f67f40afce0 2023-08-09T12:42:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.412+0000 7f67f27fc640 1 --2- 172.21.15.17:0/4276414604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40ce9e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f67f40c8da0 tx=0x7f67dc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9131e9d9831a45d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.412+0000 7f67f1ffb640 1 -- 172.21.15.17:0/4276414604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc031860 con 0x7f67f40afce0 2023-08-09T12:42:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.412+0000 7f67f1ffb640 1 -- 172.21.15.17:0/4276414604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc0319c0 con 0x7f67f40afce0 2023-08-09T12:42:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.412+0000 7f67f1ffb640 1 -- 172.21.15.17:0/4276414604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc031d50 con 0x7f67f40afce0 2023-08-09T12:42:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 -- 172.21.15.17:0/4276414604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 msgr2=0x7f67f40ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 --2- 172.21.15.17:0/4276414604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40ce9e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f67f40c8da0 tx=0x7f67dc02b900 comp rx=0 tx=0).stop 2023-08-09T12:42:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 -- 172.21.15.17:0/4276414604 shutdown_connections 2023-08-09T12:42:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 --2- 172.21.15.17:0/4276414604 >> v2:172.21.15.142:3300/0 conn(0x7f67f40cef20 0x7f67f406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 --2- 172.21.15.17:0/4276414604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40ce9e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 --2- 172.21.15.17:0/4276414604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f40af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 -- 172.21.15.17:0/4276414604 >> 172.21.15.17:0/4276414604 conn(0x7f67f4069be0 msgr2=0x7f67f4069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 -- 172.21.15.17:0/4276414604 shutdown_connections 2023-08-09T12:42:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.413+0000 7f67f9887640 1 -- 172.21.15.17:0/4276414604 wait complete. 2023-08-09T12:42:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.415+0000 7f67f9887640 1 Processor -- start 2023-08-09T12:42:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.415+0000 7f67f9887640 1 -- start start 2023-08-09T12:42:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.416+0000 7f67f9887640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.416+0000 7f67f9887640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f40cef20 0x7f67f41f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.416+0000 7f67f9887640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f9887640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f41f3480 con 0x7f67f40afce0 2023-08-09T12:42:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f9887640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f41f2ec0 con 0x7f67f40cef20 2023-08-09T12:42:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f9887640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f41f31a0 con 0x7f67f4158840 2023-08-09T12:42:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39056/0 (socket says 172.21.15.17:39056) 2023-08-09T12:42:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f2ffd640 1 -- 172.21.15.17:0/1444277546 learned_addr learned my addr 172.21.15.17:0/1444277546 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f37fe640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f27fc640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f40cef20 0x7f67f41f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f2ffd640 1 -- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 msgr2=0x7f67f415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f2ffd640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f2ffd640 1 -- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f40cef20 msgr2=0x7f67f41f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f2ffd640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f40cef20 0x7f67f41f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f2ffd640 1 -- 172.21.15.17:0/1444277546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0094d0 con 0x7f67f40afce0 2023-08-09T12:42:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.417+0000 7f67f37fe640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.418+0000 7f67f2ffd640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40c9720 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f67e400d5f0 tx=0x7f67e400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.418+0000 7f67ebfff640 1 -- 172.21.15.17:0/1444277546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e40125f0 con 0x7f67f40afce0 2023-08-09T12:42:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.418+0000 7f67ebfff640 1 -- 172.21.15.17:0/1444277546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4012750 con 0x7f67f40afce0 2023-08-09T12:42:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.418+0000 7f67ebfff640 1 -- 172.21.15.17:0/1444277546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4012b00 con 0x7f67f40afce0 2023-08-09T12:42:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.418+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f40c8f20 con 0x7f67f40afce0 2023-08-09T12:42:38.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.418+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f40c9c60 con 0x7f67f40afce0 2023-08-09T12:42:38.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.419+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f40c9df0 con 0x7f67f40afce0 2023-08-09T12:42:38.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.420+0000 7f67ebfff640 1 -- 172.21.15.17:0/1444277546 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f67e4012c60 con 0x7f67f40afce0 2023-08-09T12:42:38.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.421+0000 7f67ebfff640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67d406a050 0x7f67d406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:38.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.421+0000 7f67ebfff640 1 -- 172.21.15.17:0/1444277546 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67e4088a60 con 0x7f67f40afce0 2023-08-09T12:42:38.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.422+0000 7f67f27fc640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67d406a050 0x7f67d406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:38.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.423+0000 7f67f27fc640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67d406a050 0x7f67d406c510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f67dc036000 tx=0x7f67dc03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.426+0000 7f67ebfff640 1 -- 172.21.15.17:0/1444277546 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f67e4054140 con 0x7f67f40afce0 2023-08-09T12:42:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:38.658+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f67f4067a80 con 0x7f67f40afce0 2023-08-09T12:42:39.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.278+0000 7f67ebfff640 1 -- 172.21.15.17:0/1444277546 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f67e4057760 con 0x7f67f40afce0 2023-08-09T12:42:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.281+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67d406a050 msgr2=0x7f67d406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.281+0000 7f67f9887640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67d406a050 0x7f67d406c510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f67dc036000 tx=0x7f67dc03c040 comp rx=0 tx=0).stop 2023-08-09T12:42:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.281+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 msgr2=0x7f67f40c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.281+0000 7f67f9887640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40c9720 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f67e400d5f0 tx=0x7f67e400dab0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.282+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 shutdown_connections 2023-08-09T12:42:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.282+0000 7f67f9887640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f67d406a050 0x7f67d406c510 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.282+0000 7f67f9887640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67f4158840 0x7f67f415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.282+0000 7f67f9887640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67f40cef20 0x7f67f41f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.282+0000 7f67f9887640 1 --2- 172.21.15.17:0/1444277546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67f40afce0 0x7f67f40c9720 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.282+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 >> 172.21.15.17:0/1444277546 conn(0x7f67f4069be0 msgr2=0x7f67f4152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.282+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 shutdown_connections 2023-08-09T12:42:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.282+0000 7f67f9887640 1 -- 172.21.15.17:0/1444277546 wait complete. 2023-08-09T12:42:39.306 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:42:39.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:42:39.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.536+0000 7f426c4ad640 1 Processor -- start 2023-08-09T12:42:39.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.536+0000 7f426c4ad640 1 -- start start 2023-08-09T12:42:39.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.537+0000 7f426c4ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f42640ce9e0 0x7f426415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.537+0000 7f426c4ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4264159b70 0x7f42640cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.538+0000 7f426c4ad640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426415af00 con 0x7f426406f900 2023-08-09T12:42:39.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.538+0000 7f426c4ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640caf20 con 0x7f42640ce9e0 2023-08-09T12:42:39.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.538+0000 7f426c4ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640cf300 con 0x7f4264159b70 2023-08-09T12:42:39.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.538+0000 7f426aa4a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f426406f900 0x7f426406ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48970/0 (socket says 172.21.15.17:48970) 2023-08-09T12:42:39.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.538+0000 7f426aa4a640 1 -- 172.21.15.17:0/4176724942 learned_addr learned my addr 172.21.15.17:0/4176724942 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:39.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.538+0000 7f4269a48640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4264159b70 0x7f42640cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.538+0000 7f426a249640 1 --2- 172.21.15.17:0/4176724942 >> v2:172.21.15.142:3300/0 conn(0x7f42640ce9e0 0x7f426415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.538+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889054786 0 0) 0x7f426415af00 con 0x7f426406f900 2023-08-09T12:42:39.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4250003520 con 0x7f426406f900 2023-08-09T12:42:39.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442495474 0 0) 0x7f4250003520 con 0x7f426406f900 2023-08-09T12:42:39.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4264159b70 msgr2=0x7f42640cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:39.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4264159b70 0x7f42640cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 >> v2:172.21.15.142:3300/0 conn(0x7f42640ce9e0 msgr2=0x7f426415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:39.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 --2- 172.21.15.17:0/4176724942 >> v2:172.21.15.142:3300/0 conn(0x7f42640ce9e0 0x7f426415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640afc40 con 0x7f426406f900 2023-08-09T12:42:39.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f425c001670 con 0x7f426406f900 2023-08-09T12:42:39.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 >> v1:172.21.15.17:6789/0 conn(0x7f426406f900 legacy=0x7f426406ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:39.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4264159b70 0x7f4250003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4250003ef0 0x7f42500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250004d00 0x7f4250005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640caf20 con 0x7f4250004d00 2023-08-09T12:42:39.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640cf300 con 0x7f4250003ef0 2023-08-09T12:42:39.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425000dbe0 con 0x7f4264159b70 2023-08-09T12:42:39.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.539+0000 7f426aa4a640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250004d00 0x7f4250005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.540+0000 7f426a249640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4264159b70 0x7f4250003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.540+0000 7f4269a48640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4250003ef0 0x7f42500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.540+0000 7f426aa4a640 1 -- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4264159b70 msgr2=0x7f4250003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:39.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.540+0000 7f426aa4a640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4264159b70 0x7f4250003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.540+0000 7f426aa4a640 1 -- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4250003ef0 msgr2=0x7f42500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:39.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.540+0000 7f426aa4a640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4250003ef0 0x7f42500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.540+0000 7f426aa4a640 1 -- 172.21.15.17:0/4176724942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250003520 con 0x7f4250004d00 2023-08-09T12:42:39.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.540+0000 7f4269a48640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4250003ef0 0x7f42500047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:39.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.541+0000 7f426aa4a640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250004d00 0x7f4250005180 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f425c00c270 tx=0x7f42500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ff000b5abcef7f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:39.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.541+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c02cae0 con 0x7f4250004d00 2023-08-09T12:42:39.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.541+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c02cc40 con 0x7f4250004d00 2023-08-09T12:42:39.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.541+0000 7f4269247640 1 -- 172.21.15.17:0/4176724942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c005af0 con 0x7f4250004d00 2023-08-09T12:42:39.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.542+0000 7f426c4ad640 1 -- 172.21.15.17:0/4176724942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250004d00 msgr2=0x7f4250005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:39.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.542+0000 7f426c4ad640 1 --2- 172.21.15.17:0/4176724942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250004d00 0x7f4250005180 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f425c00c270 tx=0x7f42500057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.542+0000 7f426aa4a640 1 -- 172.21.15.17:0/4176724942 reap_dead start 2023-08-09T12:42:39.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.542+0000 7f426c4ad640 1 -- 172.21.15.17:0/4176724942 shutdown_connections 2023-08-09T12:42:39.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.542+0000 7f426c4ad640 1 -- 172.21.15.17:0/4176724942 >> 172.21.15.17:0/4176724942 conn(0x7f4264069be0 msgr2=0x7f4264069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:39.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.542+0000 7f426c4ad640 1 -- 172.21.15.17:0/4176724942 shutdown_connections 2023-08-09T12:42:39.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.542+0000 7f426c4ad640 1 -- 172.21.15.17:0/4176724942 wait complete. 2023-08-09T12:42:39.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.544+0000 7f426c4ad640 1 Processor -- start 2023-08-09T12:42:39.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.544+0000 7f426c4ad640 1 -- start start 2023-08-09T12:42:39.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.545+0000 7f426c4ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250004d00 0x7f42641edc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.545+0000 7f426c4ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4264144680 0x7f426415dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.545+0000 7f426c4ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42640b2b50 0x7f42640b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.545+0000 7f426c4ad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b3540 con 0x7f4264144680 2023-08-09T12:42:39.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.545+0000 7f426c4ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640c9cf0 con 0x7f42640b2b50 2023-08-09T12:42:39.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.545+0000 7f426c4ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640c9fd0 con 0x7f4250004d00 2023-08-09T12:42:39.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.545+0000 7f4269a48640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4264144680 0x7f426415dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f4269a48640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4264144680 0x7f426415dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39072/0 (socket says 172.21.15.17:39072) 2023-08-09T12:42:39.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f4269a48640 1 -- 172.21.15.17:0/495433530 learned_addr learned my addr 172.21.15.17:0/495433530 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:39.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f426a249640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250004d00 0x7f42641edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f426aa4a640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42640b2b50 0x7f42640b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f4269a48640 1 -- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250004d00 msgr2=0x7f42641edc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:39.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f4269a48640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250004d00 0x7f42641edc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f4269a48640 1 -- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42640b2b50 msgr2=0x7f42640b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f4269a48640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42640b2b50 0x7f42640b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f4269a48640 1 -- 172.21.15.17:0/495433530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640ca2b0 con 0x7f4264144680 2023-08-09T12:42:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f426aa4a640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42640b2b50 0x7f42640b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f4269a48640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4264144680 0x7f426415dd30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4254010890 tx=0x7f4254010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.546+0000 7f425affd640 1 -- 172.21.15.17:0/495433530 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425400eb00 con 0x7f4264144680 2023-08-09T12:42:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.547+0000 7f425affd640 1 -- 172.21.15.17:0/495433530 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425400ec60 con 0x7f4264144680 2023-08-09T12:42:39.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.547+0000 7f425affd640 1 -- 172.21.15.17:0/495433530 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425401c400 con 0x7f4264144680 2023-08-09T12:42:39.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.547+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426413eb60 con 0x7f4264144680 2023-08-09T12:42:39.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.547+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426415e270 con 0x7f4264144680 2023-08-09T12:42:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.548+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42640ca4f0 con 0x7f4264144680 2023-08-09T12:42:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.549+0000 7f425affd640 1 -- 172.21.15.17:0/495433530 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f425401c560 con 0x7f4264144680 2023-08-09T12:42:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.550+0000 7f425affd640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f424806a080 0x7f424806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.550+0000 7f425affd640 1 -- 172.21.15.17:0/495433530 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4254088ae0 con 0x7f4264144680 2023-08-09T12:42:39.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.550+0000 7f426a249640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f424806a080 0x7f424806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:39.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.552+0000 7f426a249640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f424806a080 0x7f424806c540 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4260007520 tx=0x7f426000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:39.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.554+0000 7f425affd640 1 -- 172.21.15.17:0/495433530 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f42540541e0 con 0x7f4264144680 2023-08-09T12:42:39.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:39.787+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4264067a80 con 0x7f4264144680 2023-08-09T12:42:39.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:42:39.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:42:40.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.717+0000 7f425affd640 1 -- 172.21.15.17:0/495433530 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4254057800 con 0x7f4264144680 2023-08-09T12:42:40.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.720+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f424806a080 msgr2=0x7f424806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:40.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.720+0000 7f426c4ad640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f424806a080 0x7f424806c540 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4260007520 tx=0x7f426000b040 comp rx=0 tx=0).stop 2023-08-09T12:42:40.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4264144680 msgr2=0x7f426415dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4264144680 0x7f426415dd30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4254010890 tx=0x7f4254010d50 comp rx=0 tx=0).stop 2023-08-09T12:42:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 shutdown_connections 2023-08-09T12:42:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f424806a080 0x7f424806c540 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42640b2b50 0x7f42640b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4264144680 0x7f426415dd30 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 --2- 172.21.15.17:0/495433530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4250004d00 0x7f42641edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 >> 172.21.15.17:0/495433530 conn(0x7f4264069be0 msgr2=0x7f426415c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 shutdown_connections 2023-08-09T12:42:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.721+0000 7f426c4ad640 1 -- 172.21.15.17:0/495433530 wait complete. 2023-08-09T12:42:40.747 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:42:40.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.974+0000 7fae54d57640 1 Processor -- start 2023-08-09T12:42:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.974+0000 7fae54d57640 1 -- start start 2023-08-09T12:42:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.975+0000 7fae54d57640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae500c9c40 0x7fae5015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.975+0000 7fae54d57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 0x7fae500ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.975+0000 7fae54d57640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5015d680 con 0x7fae5006fa40 2023-08-09T12:42:40.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.975+0000 7fae54d57640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500ca1b0 con 0x7fae500c9c40 2023-08-09T12:42:40.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.975+0000 7fae54d57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500ca490 con 0x7fae5015d270 2023-08-09T12:42:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.976+0000 7fae4e59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fae5006fa40 0x7fae5006fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48972/0 (socket says 172.21.15.17:48972) 2023-08-09T12:42:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.976+0000 7fae4e59c640 1 -- 172.21.15.17:0/3538479909 learned_addr learned my addr 172.21.15.17:0/3538479909 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.976+0000 7fae4ed9d640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 0x7fae500ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.976+0000 7fae4dd9b640 1 --2- 172.21.15.17:0/3538479909 >> v2:172.21.15.142:3300/0 conn(0x7fae500c9c40 0x7fae5015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.976+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654189142 0 0) 0x7fae5015d680 con 0x7fae5006fa40 2023-08-09T12:42:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.976+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae38005730 con 0x7fae5006fa40 2023-08-09T12:42:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350135159 0 0) 0x7fae38005730 con 0x7fae5006fa40 2023-08-09T12:42:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 msgr2=0x7fae500ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 0x7fae500ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 >> v2:172.21.15.142:3300/0 conn(0x7fae500c9c40 msgr2=0x7fae5015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 --2- 172.21.15.17:0/3538479909 >> v2:172.21.15.142:3300/0 conn(0x7fae500c9c40 0x7fae5015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500ca770 con 0x7fae5006fa40 2023-08-09T12:42:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fae400019f0 con 0x7fae5006fa40 2023-08-09T12:42:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 >> v1:172.21.15.17:6789/0 conn(0x7fae5006fa40 legacy=0x7fae5006fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38005b80 0x7fae38005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 0x7fae380069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae38006f10 0x7fae38007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500ca1b0 con 0x7fae38006f10 2023-08-09T12:42:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500ca490 con 0x7fae38005b80 2023-08-09T12:42:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3800db90 con 0x7fae5015d270 2023-08-09T12:42:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.977+0000 7fae4ed9d640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae38006f10 0x7fae38007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.978+0000 7fae4e59c640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38005b80 0x7fae38005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.978+0000 7fae4dd9b640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 0x7fae380069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.978+0000 7fae4ed9d640 1 -- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 msgr2=0x7fae380069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.978+0000 7fae4ed9d640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 0x7fae380069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.978+0000 7fae4ed9d640 1 -- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38005b80 msgr2=0x7fae38005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.978+0000 7fae4ed9d640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38005b80 0x7fae38005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.978+0000 7fae4ed9d640 1 -- 172.21.15.17:0/3538479909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38005730 con 0x7fae38006f10 2023-08-09T12:42:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.978+0000 7fae4dd9b640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5015d270 0x7fae380069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.979+0000 7fae4ed9d640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae38006f10 0x7fae38007390 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fae48009ac0 tx=0x7fae38007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae4bcc0f2b60216 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.979+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4802c6b0 con 0x7fae38006f10 2023-08-09T12:42:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.979+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4802c810 con 0x7fae38006f10 2023-08-09T12:42:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.979+0000 7fae4d59a640 1 -- 172.21.15.17:0/3538479909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4802cba0 con 0x7fae38006f10 2023-08-09T12:42:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.980+0000 7fae54d57640 1 -- 172.21.15.17:0/3538479909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae38006f10 msgr2=0x7fae38007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.980+0000 7fae54d57640 1 --2- 172.21.15.17:0/3538479909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae38006f10 0x7fae38007390 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fae48009ac0 tx=0x7fae38007a00 comp rx=0 tx=0).stop 2023-08-09T12:42:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.980+0000 7fae4ed9d640 1 -- 172.21.15.17:0/3538479909 reap_dead start 2023-08-09T12:42:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.980+0000 7fae54d57640 1 -- 172.21.15.17:0/3538479909 shutdown_connections 2023-08-09T12:42:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.980+0000 7fae54d57640 1 -- 172.21.15.17:0/3538479909 >> 172.21.15.17:0/3538479909 conn(0x7fae500cf060 msgr2=0x7fae500cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:40.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.980+0000 7fae54d57640 1 -- 172.21.15.17:0/3538479909 shutdown_connections 2023-08-09T12:42:40.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.980+0000 7fae54d57640 1 -- 172.21.15.17:0/3538479909 wait complete. 2023-08-09T12:42:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.982+0000 7fae54d57640 1 Processor -- start 2023-08-09T12:42:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.982+0000 7fae54d57640 1 -- start start 2023-08-09T12:42:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae54d57640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38006f10 0x7fae5015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae54d57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500b4250 0x7fae500b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae54d57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae5014c110 0x7fae5014c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae54d57640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5015bdb0 con 0x7fae5014c110 2023-08-09T12:42:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae54d57640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500b4bd0 con 0x7fae38006f10 2023-08-09T12:42:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae54d57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5015b1a0 con 0x7fae500b4250 2023-08-09T12:42:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae5014c110 0x7fae5014c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae4ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae5014c110 0x7fae5014c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39092/0 (socket says 172.21.15.17:39092) 2023-08-09T12:42:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.983+0000 7fae4ed9d640 1 -- 172.21.15.17:0/401504111 learned_addr learned my addr 172.21.15.17:0/401504111 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.984+0000 7fae4e59c640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38006f10 0x7fae5015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.984+0000 7fae4dd9b640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500b4250 0x7fae500b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.984+0000 7fae4ed9d640 1 -- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500b4250 msgr2=0x7fae500b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.984+0000 7fae4ed9d640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500b4250 0x7fae500b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.984+0000 7fae4ed9d640 1 -- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38006f10 msgr2=0x7fae5015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.984+0000 7fae4ed9d640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38006f10 0x7fae5015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.984+0000 7fae4ed9d640 1 -- 172.21.15.17:0/401504111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5015b480 con 0x7fae5014c110 2023-08-09T12:42:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.984+0000 7fae4ed9d640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae5014c110 0x7fae5014c590 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fae48009ac0 tx=0x7fae48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.985+0000 7fae3effd640 1 -- 172.21.15.17:0/401504111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4802c6b0 con 0x7fae5014c110 2023-08-09T12:42:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.985+0000 7fae3effd640 1 -- 172.21.15.17:0/401504111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae48003830 con 0x7fae5014c110 2023-08-09T12:42:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.985+0000 7fae3effd640 1 -- 172.21.15.17:0/401504111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48003be0 con 0x7fae5014c110 2023-08-09T12:42:40.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.985+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5015b760 con 0x7fae5014c110 2023-08-09T12:42:40.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.985+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5014cad0 con 0x7fae5014c110 2023-08-09T12:42:40.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.986+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5015bf20 con 0x7fae5014c110 2023-08-09T12:42:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.987+0000 7fae3effd640 1 -- 172.21.15.17:0/401504111 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fae48003d40 con 0x7fae5014c110 2023-08-09T12:42:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.988+0000 7fae3effd640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae3006a0d0 0x7fae3006c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.988+0000 7fae3effd640 1 -- 172.21.15.17:0/401504111 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae48000e40 con 0x7fae5014c110 2023-08-09T12:42:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.989+0000 7fae4e59c640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae3006a0d0 0x7fae3006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.990+0000 7fae4e59c640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae3006a0d0 0x7fae3006c590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fae40005df0 tx=0x7fae40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:40.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:40.993+0000 7fae3effd640 1 -- 172.21.15.17:0/401504111 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fae48075500 con 0x7fae5014c110 2023-08-09T12:42:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.225+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae50067a80 con 0x7fae5014c110 2023-08-09T12:42:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.226+0000 7fae3effd640 1 -- 172.21.15.17:0/401504111 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4879 (secure 0 0 0) 0x7fae48039020 con 0x7fae5014c110 2023-08-09T12:42:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:41.229 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2314028117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2314028117},{"type":"v1","addr":"172.21.15.142:6837","nonce":2314028117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3413359063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3413359063},{"type":"v1","addr":"172.21.15.142:6835","nonce":3413359063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/295901720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":295901720},{"type":"v1","addr":"172.21.15.17:6834","nonce":295901720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:42:36.710411+0000","modified":"2023-08-09T12:42:40.710471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1591311172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1591311172},{"type":"v1","addr":"172.21.15.17:6835","nonce":1591311172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-09T12:42:41.230 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2023-08-09T12:42:41.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae3006a0d0 msgr2=0x7fae3006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae3006a0d0 0x7fae3006c590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fae40005df0 tx=0x7fae40009040 comp rx=0 tx=0).stop 2023-08-09T12:42:41.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae5014c110 msgr2=0x7fae5014c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae5014c110 0x7fae5014c590 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fae48009ac0 tx=0x7fae48004730 comp rx=0 tx=0).stop 2023-08-09T12:42:41.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 shutdown_connections 2023-08-09T12:42:41.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fae3006a0d0 0x7fae3006c590 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae5014c110 0x7fae5014c590 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500b4250 0x7fae500b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 --2- 172.21.15.17:0/401504111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae38006f10 0x7fae5015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 >> 172.21.15.17:0/401504111 conn(0x7fae500cf060 msgr2=0x7fae500afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.228+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 shutdown_connections 2023-08-09T12:42:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.229+0000 7fae54d57640 1 -- 172.21.15.17:0/401504111 wait complete. 2023-08-09T12:42:41.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:42:41.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.461+0000 7fcfbb2c9640 1 Processor -- start 2023-08-09T12:42:41.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.461+0000 7fcfbb2c9640 1 -- start start 2023-08-09T12:42:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.463+0000 7fcfbb2c9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcfb41587e0 0x7fcfb4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.463+0000 7fcfbb2c9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb415beb0 con 0x7fcfb40cb070 2023-08-09T12:42:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.463+0000 7fcfbb2c9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb40715c0 con 0x7fcfb40b0b10 2023-08-09T12:42:41.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.463+0000 7fcfbb2c9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40718a0 con 0x7fcfb41587e0 2023-08-09T12:42:41.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.463+0000 7fcfbaac8640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcfb40cb070 0x7fcfb415e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48984/0 (socket says 172.21.15.17:48984) 2023-08-09T12:42:41.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.463+0000 7fcfba2c7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcfb41587e0 0x7fcfb4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.463+0000 7fcfbaac8640 1 -- 172.21.15.17:0/2036374905 learned_addr learned my addr 172.21.15.17:0/2036374905 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:41.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.464+0000 7fcfba2c7640 1 -- 172.21.15.17:0/2036374905 >> v1:172.21.15.142:6789/0 conn(0x7fcfb40b0b10 legacy=0x7fcfb415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:41.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.464+0000 7fcfba2c7640 1 -- 172.21.15.17:0/2036374905 >> v1:172.21.15.17:6789/0 conn(0x7fcfb40cb070 legacy=0x7fcfb415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.464+0000 7fcfb92c5640 1 -- 172.21.15.17:0/2036374905 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387848644 0 0) 0x7fcfb415beb0 con 0x7fcfb40cb070 2023-08-09T12:42:41.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.464+0000 7fcfba2c7640 1 -- 172.21.15.17:0/2036374905 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4071b80 con 0x7fcfb41587e0 2023-08-09T12:42:41.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.465+0000 7fcfba2c7640 1 --2- 172.21.15.17:0/2036374905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb4070f00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00097a0 tx=0x7fcfb002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d136358938cb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:41.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.465+0000 7fcfb92c5640 1 -- 172.21.15.17:0/2036374905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0031830 con 0x7fcfb41587e0 2023-08-09T12:42:41.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.465+0000 7fcfb92c5640 1 -- 172.21.15.17:0/2036374905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0031990 con 0x7fcfb41587e0 2023-08-09T12:42:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.465+0000 7fcfb92c5640 1 -- 172.21.15.17:0/2036374905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0031d20 con 0x7fcfb41587e0 2023-08-09T12:42:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.466+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/2036374905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 msgr2=0x7fcfb4070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.466+0000 7fcfbb2c9640 1 --2- 172.21.15.17:0/2036374905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb4070f00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00097a0 tx=0x7fcfb002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.466+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/2036374905 shutdown_connections 2023-08-09T12:42:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.466+0000 7fcfbb2c9640 1 --2- 172.21.15.17:0/2036374905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb4070f00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.466+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/2036374905 >> 172.21.15.17:0/2036374905 conn(0x7fcfb40b1d50 msgr2=0x7fcfb406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:41.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.466+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/2036374905 shutdown_connections 2023-08-09T12:42:41.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.466+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/2036374905 wait complete. 2023-08-09T12:42:41.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.468+0000 7fcfbb2c9640 1 Processor -- start 2023-08-09T12:42:41.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.468+0000 7fcfbb2c9640 1 -- start start 2023-08-09T12:42:41.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbb2c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb40b0b10 0x7fcfb414c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbb2c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb40cb070 0x7fcfb40c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbb2c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb41f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbb2c9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb4158be0 con 0x7fcfb41587e0 2023-08-09T12:42:41.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbb2c9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40c4f70 con 0x7fcfb40b0b10 2023-08-09T12:42:41.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbb2c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb415d200 con 0x7fcfb40cb070 2023-08-09T12:42:41.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbaac8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb41f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbaac8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb41f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39118/0 (socket says 172.21.15.17:39118) 2023-08-09T12:42:41.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbaac8640 1 -- 172.21.15.17:0/1388030261 learned_addr learned my addr 172.21.15.17:0/1388030261 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:41.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfba2c7640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb40b0b10 0x7fcfb414c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfbaac8640 1 -- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb40cb070 msgr2=0x7fcfb40c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.469+0000 7fcfb9ac6640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb40cb070 0x7fcfb40c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfbaac8640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb40cb070 0x7fcfb40c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfbaac8640 1 -- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb40b0b10 msgr2=0x7fcfb414c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfbaac8640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb40b0b10 0x7fcfb414c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfbaac8640 1 -- 172.21.15.17:0/1388030261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009400 con 0x7fcfb41587e0 2023-08-09T12:42:41.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfba2c7640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb40b0b10 0x7fcfb414c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:41.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfbaac8640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb41f3770 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c7e0 tx=0x7fcfac00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:41.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfaaffd640 1 -- 172.21.15.17:0/1388030261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00a640 con 0x7fcfb41587e0 2023-08-09T12:42:41.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfaaffd640 1 -- 172.21.15.17:0/1388030261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00a7c0 con 0x7fcfb41587e0 2023-08-09T12:42:41.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfaaffd640 1 -- 172.21.15.17:0/1388030261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00ab70 con 0x7fcfb41587e0 2023-08-09T12:42:41.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb415d4e0 con 0x7fcfb41587e0 2023-08-09T12:42:41.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.470+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb41f3cb0 con 0x7fcfb41587e0 2023-08-09T12:42:41.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.471+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb4158d90 con 0x7fcfb41587e0 2023-08-09T12:42:41.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.472+0000 7fcfaaffd640 1 -- 172.21.15.17:0/1388030261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcfac00acd0 con 0x7fcfb41587e0 2023-08-09T12:42:41.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.473+0000 7fcfaaffd640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf9806a050 0x7fcf9806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.473+0000 7fcfaaffd640 1 -- 172.21.15.17:0/1388030261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfac087c00 con 0x7fcfb41587e0 2023-08-09T12:42:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.474+0000 7fcfba2c7640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf9806a050 0x7fcf9806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.475+0000 7fcfba2c7640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf9806a050 0x7fcf9806c510 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0036000 tx=0x7fcfb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:41.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.477+0000 7fcfaaffd640 1 -- 172.21.15.17:0/1388030261 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcfb4158d90 con 0x7fcfb41587e0 2023-08-09T12:42:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.661+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb406fa10 con 0x7fcfb41587e0 2023-08-09T12:42:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.662+0000 7fcfaaffd640 1 -- 172.21.15.17:0/1388030261 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fcfb406fa10 con 0x7fcfb41587e0 2023-08-09T12:42:41.666 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:41.666 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":70,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:42:38.223366+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:42:35.097822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-09T12:42:35.735356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:42:41.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf9806a050 msgr2=0x7fcf9806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf9806a050 0x7fcf9806c510 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0036000 tx=0x7fcfb0008030 comp rx=0 tx=0).stop 2023-08-09T12:42:41.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 msgr2=0x7fcfb41f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb41f3770 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c7e0 tx=0x7fcfac00cca0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 shutdown_connections 2023-08-09T12:42:41.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf9806a050 0x7fcf9806c510 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb41587e0 0x7fcfb41f3770 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb40cb070 0x7fcfb40c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 --2- 172.21.15.17:0/1388030261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb40b0b10 0x7fcfb414c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 >> 172.21.15.17:0/1388030261 conn(0x7fcfb40b1d50 msgr2=0x7fcfb406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 shutdown_connections 2023-08-09T12:42:41.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.665+0000 7fcfbb2c9640 1 -- 172.21.15.17:0/1388030261 wait complete. 2023-08-09T12:42:41.688 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:42:41.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:42:41.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.906+0000 7fcd9726c640 1 Processor -- start 2023-08-09T12:42:41.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.906+0000 7fcd9726c640 1 -- start start 2023-08-09T12:42:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.907+0000 7fcd9726c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 0x7fcd901616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.907+0000 7fcd9726c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd900b6000 0x7fcd900cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.907+0000 7fcd9726c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd900b6460 con 0x7fcd900d29d0 2023-08-09T12:42:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.907+0000 7fcd9726c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900cda40 con 0x7fcd900b6000 2023-08-09T12:42:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.907+0000 7fcd9726c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900cdd10 con 0x7fcd9015ce90 2023-08-09T12:42:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.907+0000 7fcd94807640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd900b6000 0x7fcd900cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd95809640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcd900d29d0 0x7fcd900d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48992/0 (socket says 172.21.15.17:48992) 2023-08-09T12:42:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd95809640 1 -- 172.21.15.17:0/1192467341 learned_addr learned my addr 172.21.15.17:0/1192467341 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd95008640 1 --2- 172.21.15.17:0/1192467341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 0x7fcd901616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd94807640 1 -- 172.21.15.17:0/1192467341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 msgr2=0x7fcd901616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd94807640 1 --2- 172.21.15.17:0/1192467341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 0x7fcd901616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd94807640 1 -- 172.21.15.17:0/1192467341 >> v1:172.21.15.17:6789/0 conn(0x7fcd900d29d0 legacy=0x7fcd900d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd87fff640 1 -- 172.21.15.17:0/1192467341 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897742523 0 0) 0x7fcd900b6460 con 0x7fcd900d29d0 2023-08-09T12:42:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd94807640 1 -- 172.21.15.17:0/1192467341 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900cdff0 con 0x7fcd900b6000 2023-08-09T12:42:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.908+0000 7fcd95008640 1 --2- 172.21.15.17:0/1192467341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 0x7fcd901616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:42:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.910+0000 7fcd94807640 1 --2- 172.21.15.17:0/1192467341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd900cd500 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fcd800097a0 tx=0x7fcd8002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad0271f6432236a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.910+0000 7fcd87fff640 1 -- 172.21.15.17:0/1192467341 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8002d040 con 0x7fcd900b6000 2023-08-09T12:42:41.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.910+0000 7fcd87fff640 1 -- 172.21.15.17:0/1192467341 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd80031810 con 0x7fcd900b6000 2023-08-09T12:42:41.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.910+0000 7fcd87fff640 1 -- 172.21.15.17:0/1192467341 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd80031ba0 con 0x7fcd900b6000 2023-08-09T12:42:41.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.911+0000 7fcd9726c640 1 -- 172.21.15.17:0/1192467341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 msgr2=0x7fcd900cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.911+0000 7fcd9726c640 1 --2- 172.21.15.17:0/1192467341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd900cd500 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fcd800097a0 tx=0x7fcd8002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.911+0000 7fcd9726c640 1 -- 172.21.15.17:0/1192467341 shutdown_connections 2023-08-09T12:42:41.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.911+0000 7fcd9726c640 1 --2- 172.21.15.17:0/1192467341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd900cd500 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.911+0000 7fcd9726c640 1 --2- 172.21.15.17:0/1192467341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 0x7fcd901616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.911+0000 7fcd9726c640 1 -- 172.21.15.17:0/1192467341 >> 172.21.15.17:0/1192467341 conn(0x7fcd9006fde0 msgr2=0x7fcd900701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:41.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.911+0000 7fcd9726c640 1 -- 172.21.15.17:0/1192467341 shutdown_connections 2023-08-09T12:42:41.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.911+0000 7fcd9726c640 1 -- 172.21.15.17:0/1192467341 wait complete. 2023-08-09T12:42:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.913+0000 7fcd9726c640 1 Processor -- start 2023-08-09T12:42:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.913+0000 7fcd9726c640 1 -- start start 2023-08-09T12:42:41.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd9726c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd901510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd9726c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd900d29d0 0x7fcd90150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd9726c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 0x7fcd901561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd9726c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90153eb0 con 0x7fcd900b6000 2023-08-09T12:42:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd9726c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90153880 con 0x7fcd900d29d0 2023-08-09T12:42:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd9726c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90153090 con 0x7fcd9015ce90 2023-08-09T12:42:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd95008640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd901510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd95008640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd901510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39134/0 (socket says 172.21.15.17:39134) 2023-08-09T12:42:41.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.914+0000 7fcd95008640 1 -- 172.21.15.17:0/3967060154 learned_addr learned my addr 172.21.15.17:0/3967060154 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd95008640 1 -- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 msgr2=0x7fcd901561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd95008640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 0x7fcd901561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd95008640 1 -- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd900d29d0 msgr2=0x7fcd90150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd94807640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd900d29d0 0x7fcd90150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd95008640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd900d29d0 0x7fcd90150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:41.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd95008640 1 -- 172.21.15.17:0/3967060154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80009400 con 0x7fcd900b6000 2023-08-09T12:42:41.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd95008640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd901510a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009fa0 tx=0x7fcd8c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:41.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd85ffb640 1 -- 172.21.15.17:0/3967060154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c003b90 con 0x7fcd900b6000 2023-08-09T12:42:41.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd85ffb640 1 -- 172.21.15.17:0/3967060154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c00f040 con 0x7fcd900b6000 2023-08-09T12:42:41.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.915+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd90153370 con 0x7fcd900b6000 2023-08-09T12:42:41.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.916+0000 7fcd85ffb640 1 -- 172.21.15.17:0/3967060154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c004030 con 0x7fcd900b6000 2023-08-09T12:42:41.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.916+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd901515e0 con 0x7fcd900b6000 2023-08-09T12:42:41.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.917+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd90067a80 con 0x7fcd900b6000 2023-08-09T12:42:41.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.918+0000 7fcd85ffb640 1 -- 172.21.15.17:0/3967060154 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd8c004190 con 0x7fcd900b6000 2023-08-09T12:42:41.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.918+0000 7fcd85ffb640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd7406a050 0x7fcd7406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:41.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.919+0000 7fcd85ffb640 1 -- 172.21.15.17:0/3967060154 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd8c088860 con 0x7fcd900b6000 2023-08-09T12:42:41.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.919+0000 7fcd94807640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd7406a050 0x7fcd7406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:41.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.920+0000 7fcd94807640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd7406a050 0x7fcd7406c510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcd80036000 tx=0x7fcd8003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:41.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:41.923+0000 7fcd85ffb640 1 -- 172.21.15.17:0/3967060154 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcd8c053f60 con 0x7fcd900b6000 2023-08-09T12:42:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.103+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd900d0fc0 con 0x7fcd7406a050 2023-08-09T12:42:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.129+0000 7fcd85ffb640 1 -- 172.21.15.17:0/3967060154 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296269 (secure 0 0 0) 0x7fcd8003a420 con 0x7fcd7406a050 2023-08-09T12:42:42.135 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:42.136 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:42:42.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd7406a050 msgr2=0x7fcd7406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd7406a050 0x7fcd7406c510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcd80036000 tx=0x7fcd8003c040 comp rx=0 tx=0).stop 2023-08-09T12:42:42.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 msgr2=0x7fcd901510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd901510a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009fa0 tx=0x7fcd8c00d560 comp rx=0 tx=0).stop 2023-08-09T12:42:42.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 shutdown_connections 2023-08-09T12:42:42.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd7406a050 0x7fcd7406c510 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd9015ce90 0x7fcd901561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd900d29d0 0x7fcd90150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 --2- 172.21.15.17:0/3967060154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900b6000 0x7fcd901510a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 >> 172.21.15.17:0/3967060154 conn(0x7fcd9006fde0 msgr2=0x7fcd900b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:42.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 shutdown_connections 2023-08-09T12:42:42.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.134+0000 7fcd9726c640 1 -- 172.21.15.17:0/3967060154 wait complete. 2023-08-09T12:42:42.155 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2023-08-09T12:42:40.707187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":184,"acting":184,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4009,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558490,"statfs":{"total":1600000000,"available":1595894144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.500529"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.230975+0000","last_change":"2023-08-09T12:42:36.230975+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.230975+0000","last_undegraded":"2023-08-09T12:42:36.230975+0000","last_fullsized":"2023-08-09T12:42:36.230975+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231023+0000","last_change":"2023-08-09T12:42:36.231023+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231023+0000","last_undegraded":"2023-08-09T12:42:36.231023+0000","last_fullsized":"2023-08-09T12:42:36.231023+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.230357+0000","last_change":"2023-08-09T12:42:36.230357+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.230357+0000","last_undegraded":"2023-08-09T12:42:36.230357+0000","last_fullsized":"2023-08-09T12:42:36.230357+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233379+0000","last_change":"2023-08-09T12:42:36.233379+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233379+0000","last_undegraded":"2023-08-09T12:42:36.233379+0000","last_fullsized":"2023-08-09T12:42:36.233379+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.242936+0000","last_change":"2023-08-09T12:42:36.242936+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.242936+0000","last_undegraded":"2023-08-09T12:42:36.242936+0000","last_fullsized":"2023-08-09T12:42:36.242936+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233359+0000","last_change":"2023-08-09T12:42:36.233359+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233359+0000","last_undegraded":"2023-08-09T12:42:36.233359+0000","last_fullsized":"2023-08-09T12:42:36.233359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231289+0000","last_change":"2023-08-09T12:42:36.231289+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231289+0000","last_undegraded":"2023-08-09T12:42:36.231289+0000","last_fullsized":"2023-08-09T12:42:36.231289+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233831+0000","last_change":"2023-08-09T12:42:36.233831+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233831+0000","last_undegraded":"2023-08-09T12:42:36.233831+0000","last_fullsized":"2023-08-09T12:42:36.233831+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.238618+0000","last_change":"2023-08-09T12:42:36.238618+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.238618+0000","last_undegraded":"2023-08-09T12:42:36.238618+0000","last_fullsized":"2023-08-09T12:42:36.238618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.242474+0000","last_change":"2023-08-09T12:42:36.242474+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.242474+0000","last_undegraded":"2023-08-09T12:42:36.242474+0000","last_fullsized":"2023-08-09T12:42:36.242474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232578+0000","last_change":"2023-08-09T12:42:36.232578+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232578+0000","last_undegraded":"2023-08-09T12:42:36.232578+0000","last_fullsized":"2023-08-09T12:42:36.232578+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229903+0000","last_change":"2023-08-09T12:42:36.229903+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229903+0000","last_undegraded":"2023-08-09T12:42:36.229903+0000","last_fullsized":"2023-08-09T12:42:36.229903+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233872+0000","last_change":"2023-08-09T12:42:36.233872+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233872+0000","last_undegraded":"2023-08-09T12:42:36.233872+0000","last_fullsized":"2023-08-09T12:42:36.233872+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.240728+0000","last_change":"2023-08-09T12:42:36.240728+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.240728+0000","last_undegraded":"2023-08-09T12:42:36.240728+0000","last_fullsized":"2023-08-09T12:42:36.240728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232914+0000","last_change":"2023-08-09T12:42:36.232914+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232914+0000","last_undegraded":"2023-08-09T12:42:36.232914+0000","last_fullsized":"2023-08-09T12:42:36.232914+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.226242+0000","last_change":"2023-08-09T12:42:36.226242+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.226242+0000","last_undegraded":"2023-08-09T12:42:36.226242+0000","last_fullsized":"2023-08-09T12:42:36.226242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.241008+0000","last_change":"2023-08-09T12:42:36.241008+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.241008+0000","last_undegraded":"2023-08-09T12:42:36.241008+0000","last_fullsized":"2023-08-09T12:42:36.241008+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229321+0000","last_change":"2023-08-09T12:42:36.229321+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229321+0000","last_undegraded":"2023-08-09T12:42:36.229321+0000","last_fullsized":"2023-08-09T12:42:36.229321+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.227213+0000","last_change":"2023-08-09T12:42:36.227213+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.227213+0000","last_undegraded":"2023-08-09T12:42:36.227213+0000","last_fullsized":"2023-08-09T12:42:36.227213+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231806+0000","last_change":"2023-08-09T12:42:36.231806+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231806+0000","last_undegraded":"2023-08-09T12:42:36.231806+0000","last_fullsized":"2023-08-09T12:42:36.231806+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.236473+0000","last_change":"2023-08-09T12:42:36.236473+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.236473+0000","last_undegraded":"2023-08-09T12:42:36.236473+0000","last_fullsized":"2023-08-09T12:42:36.236473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.240694+0000","last_change":"2023-08-09T12:42:36.240694+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.240694+0000","last_undegraded":"2023-08-09T12:42:36.240694+0000","last_fullsized":"2023-08-09T12:42:36.240694+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.239689+0000","last_change":"2023-08-09T12:42:36.239689+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.239689+0000","last_undegraded":"2023-08-09T12:42:36.239689+0000","last_fullsized":"2023-08-09T12:42:36.239689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231013+0000","last_change":"2023-08-09T12:42:36.231013+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231013+0000","last_undegraded":"2023-08-09T12:42:36.231013+0000","last_fullsized":"2023-08-09T12:42:36.231013+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.235403+0000","last_change":"2023-08-09T12:42:36.235403+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.235403+0000","last_undegraded":"2023-08-09T12:42:36.235403+0000","last_fullsized":"2023-08-09T12:42:36.235403+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233105+0000","last_change":"2023-08-09T12:42:36.233105+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233105+0000","last_undegraded":"2023-08-09T12:42:36.233105+0000","last_fullsized":"2023-08-09T12:42:36.233105+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229971+0000","last_change":"2023-08-09T12:42:36.229971+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229971+0000","last_undegraded":"2023-08-09T12:42:36.229971+0000","last_fullsized":"2023-08-09T12:42:36.229971+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.212655+0000","last_change":"2023-08-09T12:42:35.212655+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.212655+0000","last_undegraded":"2023-08-09T12:42:35.212655+0000","last_fullsized":"2023-08-09T12:42:35.212655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.237328+0000","last_change":"2023-08-09T12:42:36.237328+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.237328+0000","last_undegraded":"2023-08-09T12:42:36.237328+0000","last_fullsized":"2023-08-09T12:42:36.237328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.215073+0000","last_change":"2023-08-09T12:42:35.215073+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.215073+0000","last_undegraded":"2023-08-09T12:42:35.215073+0000","last_fullsized":"2023-08-09T12:42:35.215073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.215950+0000","last_change":"2023-08-09T12:42:35.215950+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.215950+0000","last_undegraded":"2023-08-09T12:42:35.215950+0000","last_fullsized":"2023-08-09T12:42:35.215950+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229850+0000","last_change":"2023-08-09T12:42:36.229850+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229850+0000","last_undegraded":"2023-08-09T12:42:36.229850+0000","last_fullsized":"2023-08-09T12:42:36.229850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.214411+0000","last_change":"2023-08-09T12:42:35.214411+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.214411+0000","last_undegraded":"2023-08-09T12:42:35.214411+0000","last_fullsized":"2023-08-09T12:42:35.214411+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.234101+0000","last_change":"2023-08-09T12:42:36.234101+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.234101+0000","last_undegraded":"2023-08-09T12:42:36.234101+0000","last_fullsized":"2023-08-09T12:42:36.234101+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249447+0000","last_change":"2023-08-09T12:42:36.249304+0000","last_active":"2023-08-09T12:42:36.249447+0000","last_peered":"2023-08-09T12:42:36.249447+0000","last_clean":"2023-08-09T12:42:36.249447+0000","last_became_active":"2023-08-09T12:42:36.244419+0000","last_became_peered":"2023-08-09T12:42:36.244419+0000","last_unstale":"2023-08-09T12:42:36.249447+0000","last_undegraded":"2023-08-09T12:42:36.249447+0000","last_fullsized":"2023-08-09T12:42:36.249447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:44:35.236852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240203+0000","last_change":"2023-08-09T12:42:36.239590+0000","last_active":"2023-08-09T12:42:36.240203+0000","last_peered":"2023-08-09T12:42:36.240203+0000","last_clean":"2023-08-09T12:42:36.240203+0000","last_became_active":"2023-08-09T12:42:36.238193+0000","last_became_peered":"2023-08-09T12:42:36.238193+0000","last_unstale":"2023-08-09T12:42:36.240203+0000","last_undegraded":"2023-08-09T12:42:36.240203+0000","last_fullsized":"2023-08-09T12:42:36.240203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:28:51.225785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.236050+0000","last_change":"2023-08-09T12:42:36.236050+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.236050+0000","last_undegraded":"2023-08-09T12:42:36.236050+0000","last_fullsized":"2023-08-09T12:42:36.236050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246463+0000","last_change":"2023-08-09T12:42:36.246355+0000","last_active":"2023-08-09T12:42:36.246463+0000","last_peered":"2023-08-09T12:42:36.246463+0000","last_clean":"2023-08-09T12:42:36.246463+0000","last_became_active":"2023-08-09T12:42:36.246037+0000","last_became_peered":"2023-08-09T12:42:36.246037+0000","last_unstale":"2023-08-09T12:42:36.246463+0000","last_undegraded":"2023-08-09T12:42:36.246463+0000","last_fullsized":"2023-08-09T12:42:36.246463+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:43.648463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.227995+0000","last_change":"2023-08-09T12:42:36.227995+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.227995+0000","last_undegraded":"2023-08-09T12:42:36.227995+0000","last_fullsized":"2023-08-09T12:42:36.227995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240861+0000","last_change":"2023-08-09T12:42:36.240311+0000","last_active":"2023-08-09T12:42:36.240861+0000","last_peered":"2023-08-09T12:42:36.240861+0000","last_clean":"2023-08-09T12:42:36.240861+0000","last_became_active":"2023-08-09T12:42:36.239717+0000","last_became_peered":"2023-08-09T12:42:36.239717+0000","last_unstale":"2023-08-09T12:42:36.240861+0000","last_undegraded":"2023-08-09T12:42:36.240861+0000","last_fullsized":"2023-08-09T12:42:36.240861+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:00:49.296058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249585+0000","last_change":"2023-08-09T12:42:36.249493+0000","last_active":"2023-08-09T12:42:36.249585+0000","last_peered":"2023-08-09T12:42:36.249585+0000","last_clean":"2023-08-09T12:42:36.249585+0000","last_became_active":"2023-08-09T12:42:36.247921+0000","last_became_peered":"2023-08-09T12:42:36.247921+0000","last_unstale":"2023-08-09T12:42:36.249585+0000","last_undegraded":"2023-08-09T12:42:36.249585+0000","last_fullsized":"2023-08-09T12:42:36.249585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:37:32.804373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.226196+0000","last_change":"2023-08-09T12:42:36.226196+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.226196+0000","last_undegraded":"2023-08-09T12:42:36.226196+0000","last_fullsized":"2023-08-09T12:42:36.226196+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.247715+0000","last_change":"2023-08-09T12:42:36.247625+0000","last_active":"2023-08-09T12:42:36.247715+0000","last_peered":"2023-08-09T12:42:36.247715+0000","last_clean":"2023-08-09T12:42:36.247715+0000","last_became_active":"2023-08-09T12:42:36.247369+0000","last_became_peered":"2023-08-09T12:42:36.247369+0000","last_unstale":"2023-08-09T12:42:36.247715+0000","last_undegraded":"2023-08-09T12:42:36.247715+0000","last_fullsized":"2023-08-09T12:42:36.247715+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:58:23.386987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232117+0000","last_change":"2023-08-09T12:42:36.232117+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232117+0000","last_undegraded":"2023-08-09T12:42:36.232117+0000","last_fullsized":"2023-08-09T12:42:36.232117+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246625+0000","last_change":"2023-08-09T12:42:36.246431+0000","last_active":"2023-08-09T12:42:36.246625+0000","last_peered":"2023-08-09T12:42:36.246625+0000","last_clean":"2023-08-09T12:42:36.246625+0000","last_became_active":"2023-08-09T12:42:36.245840+0000","last_became_peered":"2023-08-09T12:42:36.245840+0000","last_unstale":"2023-08-09T12:42:36.246625+0000","last_undegraded":"2023-08-09T12:42:36.246625+0000","last_fullsized":"2023-08-09T12:42:36.246625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:14:29.938260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232043+0000","last_change":"2023-08-09T12:42:36.232043+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232043+0000","last_undegraded":"2023-08-09T12:42:36.232043+0000","last_fullsized":"2023-08-09T12:42:36.232043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.213109+0000","last_change":"2023-08-09T12:42:35.213109+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.213109+0000","last_undegraded":"2023-08-09T12:42:35.213109+0000","last_fullsized":"2023-08-09T12:42:35.213109+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.240275+0000","last_change":"2023-08-09T12:42:36.240275+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.240275+0000","last_undegraded":"2023-08-09T12:42:36.240275+0000","last_fullsized":"2023-08-09T12:42:36.240275+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.245933+0000","last_change":"2023-08-09T12:42:36.245706+0000","last_active":"2023-08-09T12:42:36.245933+0000","last_peered":"2023-08-09T12:42:36.245933+0000","last_clean":"2023-08-09T12:42:36.245933+0000","last_became_active":"2023-08-09T12:42:36.245288+0000","last_became_peered":"2023-08-09T12:42:36.245288+0000","last_unstale":"2023-08-09T12:42:36.245933+0000","last_undegraded":"2023-08-09T12:42:36.245933+0000","last_fullsized":"2023-08-09T12:42:36.245933+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:23:22.961857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.237978+0000","last_change":"2023-08-09T12:42:36.237978+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.237978+0000","last_undegraded":"2023-08-09T12:42:36.237978+0000","last_fullsized":"2023-08-09T12:42:36.237978+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249498+0000","last_change":"2023-08-09T12:42:36.249379+0000","last_active":"2023-08-09T12:42:36.249498+0000","last_peered":"2023-08-09T12:42:36.249498+0000","last_clean":"2023-08-09T12:42:36.249498+0000","last_became_active":"2023-08-09T12:42:36.249139+0000","last_became_peered":"2023-08-09T12:42:36.249139+0000","last_unstale":"2023-08-09T12:42:36.249498+0000","last_undegraded":"2023-08-09T12:42:36.249498+0000","last_fullsized":"2023-08-09T12:42:36.249498+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:43:13.986798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229210+0000","last_change":"2023-08-09T12:42:36.229210+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229210+0000","last_undegraded":"2023-08-09T12:42:36.229210+0000","last_fullsized":"2023-08-09T12:42:36.229210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240983+0000","last_change":"2023-08-09T12:42:36.240822+0000","last_active":"2023-08-09T12:42:36.240983+0000","last_peered":"2023-08-09T12:42:36.240983+0000","last_clean":"2023-08-09T12:42:36.240983+0000","last_became_active":"2023-08-09T12:42:36.239779+0000","last_became_peered":"2023-08-09T12:42:36.239779+0000","last_unstale":"2023-08-09T12:42:36.240983+0000","last_undegraded":"2023-08-09T12:42:36.240983+0000","last_fullsized":"2023-08-09T12:42:36.240983+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:53:44.415681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246810+0000","last_change":"2023-08-09T12:42:36.246725+0000","last_active":"2023-08-09T12:42:36.246810+0000","last_peered":"2023-08-09T12:42:36.246810+0000","last_clean":"2023-08-09T12:42:36.246810+0000","last_became_active":"2023-08-09T12:42:36.246443+0000","last_became_peered":"2023-08-09T12:42:36.246443+0000","last_unstale":"2023-08-09T12:42:36.246810+0000","last_undegraded":"2023-08-09T12:42:36.246810+0000","last_fullsized":"2023-08-09T12:42:36.246810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:45.911239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246228+0000","last_change":"2023-08-09T12:42:36.246114+0000","last_active":"2023-08-09T12:42:36.246228+0000","last_peered":"2023-08-09T12:42:36.246228+0000","last_clean":"2023-08-09T12:42:36.246228+0000","last_became_active":"2023-08-09T12:42:36.243762+0000","last_became_peered":"2023-08-09T12:42:36.243762+0000","last_unstale":"2023-08-09T12:42:36.246228+0000","last_undegraded":"2023-08-09T12:42:36.246228+0000","last_fullsized":"2023-08-09T12:42:36.246228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:39:30.410136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233170+0000","last_change":"2023-08-09T12:42:36.233170+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233170+0000","last_undegraded":"2023-08-09T12:42:36.233170+0000","last_fullsized":"2023-08-09T12:42:36.233170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.248702+0000","last_change":"2023-08-09T12:42:36.248626+0000","last_active":"2023-08-09T12:42:36.248702+0000","last_peered":"2023-08-09T12:42:36.248702+0000","last_clean":"2023-08-09T12:42:36.248702+0000","last_became_active":"2023-08-09T12:42:36.248040+0000","last_became_peered":"2023-08-09T12:42:36.248040+0000","last_unstale":"2023-08-09T12:42:36.248702+0000","last_undegraded":"2023-08-09T12:42:36.248702+0000","last_fullsized":"2023-08-09T12:42:36.248702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:32:44.210755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.241784+0000","last_change":"2023-08-09T12:42:36.241784+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.241784+0000","last_undegraded":"2023-08-09T12:42:36.241784+0000","last_fullsized":"2023-08-09T12:42:36.241784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.214431+0000","last_change":"2023-08-09T12:42:35.214431+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.214431+0000","last_undegraded":"2023-08-09T12:42:35.214431+0000","last_fullsized":"2023-08-09T12:42:35.214431+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231254+0000","last_change":"2023-08-09T12:42:36.231254+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231254+0000","last_undegraded":"2023-08-09T12:42:36.231254+0000","last_fullsized":"2023-08-09T12:42:36.231254+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.213568+0000","last_change":"2023-08-09T12:42:35.213568+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.213568+0000","last_undegraded":"2023-08-09T12:42:35.213568+0000","last_fullsized":"2023-08-09T12:42:35.213568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231427+0000","last_change":"2023-08-09T12:42:36.231427+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231427+0000","last_undegraded":"2023-08-09T12:42:36.231427+0000","last_fullsized":"2023-08-09T12:42:36.231427+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.234724+0000","last_change":"2023-08-09T12:42:36.234581+0000","last_active":"2023-08-09T12:42:36.234724+0000","last_peered":"2023-08-09T12:42:36.234724+0000","last_clean":"2023-08-09T12:42:36.234724+0000","last_became_active":"2023-08-09T12:42:36.233897+0000","last_became_peered":"2023-08-09T12:42:36.233897+0000","last_unstale":"2023-08-09T12:42:36.234724+0000","last_undegraded":"2023-08-09T12:42:36.234724+0000","last_fullsized":"2023-08-09T12:42:36.234724+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:00:33.646433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.239884+0000","last_change":"2023-08-09T12:42:36.239884+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.239884+0000","last_undegraded":"2023-08-09T12:42:36.239884+0000","last_fullsized":"2023-08-09T12:42:36.239884+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240162+0000","last_change":"2023-08-09T12:42:36.238369+0000","last_active":"2023-08-09T12:42:36.240162+0000","last_peered":"2023-08-09T12:42:36.240162+0000","last_clean":"2023-08-09T12:42:36.240162+0000","last_became_active":"2023-08-09T12:42:36.238090+0000","last_became_peered":"2023-08-09T12:42:36.238090+0000","last_unstale":"2023-08-09T12:42:36.240162+0000","last_undegraded":"2023-08-09T12:42:36.240162+0000","last_fullsized":"2023-08-09T12:42:36.240162+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:36:15.175493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240241+0000","last_change":"2023-08-09T12:42:36.239973+0000","last_active":"2023-08-09T12:42:36.240241+0000","last_peered":"2023-08-09T12:42:36.240241+0000","last_clean":"2023-08-09T12:42:36.240241+0000","last_became_active":"2023-08-09T12:42:36.238975+0000","last_became_peered":"2023-08-09T12:42:36.238975+0000","last_unstale":"2023-08-09T12:42:36.240241+0000","last_undegraded":"2023-08-09T12:42:36.240241+0000","last_fullsized":"2023-08-09T12:42:36.240241+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:03:46.233188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233266+0000","last_change":"2023-08-09T12:42:36.233266+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233266+0000","last_undegraded":"2023-08-09T12:42:36.233266+0000","last_fullsized":"2023-08-09T12:42:36.233266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.212558+0000","last_change":"2023-08-09T12:42:35.212558+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.212558+0000","last_undegraded":"2023-08-09T12:42:35.212558+0000","last_fullsized":"2023-08-09T12:42:35.212558+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229199+0000","last_change":"2023-08-09T12:42:36.229199+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229199+0000","last_undegraded":"2023-08-09T12:42:36.229199+0000","last_fullsized":"2023-08-09T12:42:36.229199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246442+0000","last_change":"2023-08-09T12:42:36.246012+0000","last_active":"2023-08-09T12:42:36.246442+0000","last_peered":"2023-08-09T12:42:36.246442+0000","last_clean":"2023-08-09T12:42:36.246442+0000","last_became_active":"2023-08-09T12:42:36.245659+0000","last_became_peered":"2023-08-09T12:42:36.245659+0000","last_unstale":"2023-08-09T12:42:36.246442+0000","last_undegraded":"2023-08-09T12:42:36.246442+0000","last_fullsized":"2023-08-09T12:42:36.246442+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:10:51.732853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":260,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.222650+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:42:36.222650+0000","last_peered":"2023-08-09T12:42:36.222650+0000","last_clean":"2023-08-09T12:42:36.222650+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:42:36.222650+0000","last_undegraded":"2023-08-09T12:42:36.222650+0000","last_fullsized":"2023-08-09T12:42:36.222650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:15:25.035101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.243970+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:42:36.243970+0000","last_peered":"2023-08-09T12:42:36.243970+0000","last_clean":"2023-08-09T12:42:36.243970+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:42:36.243970+0000","last_undegraded":"2023-08-09T12:42:36.243970+0000","last_fullsized":"2023-08-09T12:42:36.243970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:20:29.691031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.214510+0000","last_change":"2023-08-09T12:42:35.214510+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.214510+0000","last_undegraded":"2023-08-09T12:42:35.214510+0000","last_fullsized":"2023-08-09T12:42:35.214510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.222345+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:42:36.222345+0000","last_peered":"2023-08-09T12:42:36.222345+0000","last_clean":"2023-08-09T12:42:36.222345+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:42:36.222345+0000","last_undegraded":"2023-08-09T12:42:36.222345+0000","last_fullsized":"2023-08-09T12:42:36.222345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:35.321214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.234477+0000","last_change":"2023-08-09T12:42:36.234477+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.234477+0000","last_undegraded":"2023-08-09T12:42:36.234477+0000","last_fullsized":"2023-08-09T12:42:36.234477+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249799+0000","last_change":"2023-08-09T12:42:36.249723+0000","last_active":"2023-08-09T12:42:36.249799+0000","last_peered":"2023-08-09T12:42:36.249799+0000","last_clean":"2023-08-09T12:42:36.249799+0000","last_became_active":"2023-08-09T12:42:36.249183+0000","last_became_peered":"2023-08-09T12:42:36.249183+0000","last_unstale":"2023-08-09T12:42:36.249799+0000","last_undegraded":"2023-08-09T12:42:36.249799+0000","last_fullsized":"2023-08-09T12:42:36.249799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:40.200707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.233668+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:42:36.233668+0000","last_peered":"2023-08-09T12:42:36.233668+0000","last_clean":"2023-08-09T12:42:36.233668+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:42:36.233668+0000","last_undegraded":"2023-08-09T12:42:36.233668+0000","last_fullsized":"2023-08-09T12:42:36.233668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:55.412940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232152+0000","last_change":"2023-08-09T12:42:36.232152+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232152+0000","last_undegraded":"2023-08-09T12:42:36.232152+0000","last_fullsized":"2023-08-09T12:42:36.232152+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.215465+0000","last_change":"2023-08-09T12:42:35.215465+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.215465+0000","last_undegraded":"2023-08-09T12:42:35.215465+0000","last_fullsized":"2023-08-09T12:42:35.215465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.238910+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:42:36.238910+0000","last_peered":"2023-08-09T12:42:36.238910+0000","last_clean":"2023-08-09T12:42:36.238910+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:42:36.238910+0000","last_undegraded":"2023-08-09T12:42:36.238910+0000","last_fullsized":"2023-08-09T12:42:36.238910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:30:45.466626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229949+0000","last_change":"2023-08-09T12:42:36.229949+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229949+0000","last_undegraded":"2023-08-09T12:42:36.229949+0000","last_fullsized":"2023-08-09T12:42:36.229949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249949+0000","last_change":"2023-08-09T12:42:36.249872+0000","last_active":"2023-08-09T12:42:36.249949+0000","last_peered":"2023-08-09T12:42:36.249949+0000","last_clean":"2023-08-09T12:42:36.249949+0000","last_became_active":"2023-08-09T12:42:36.249491+0000","last_became_peered":"2023-08-09T12:42:36.249491+0000","last_unstale":"2023-08-09T12:42:36.249949+0000","last_undegraded":"2023-08-09T12:42:36.249949+0000","last_fullsized":"2023-08-09T12:42:36.249949+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:40:17.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-09T12:42:35.213994+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:42:35.213994+0000","last_peered":"2023-08-09T12:42:35.213994+0000","last_clean":"2023-08-09T12:42:35.213994+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:42:35.213994+0000","last_undegraded":"2023-08-09T12:42:35.213994+0000","last_fullsized":"2023-08-09T12:42:35.213994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:47:28.619991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.228264+0000","last_change":"2023-08-09T12:42:36.228264+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.228264+0000","last_undegraded":"2023-08-09T12:42:36.228264+0000","last_fullsized":"2023-08-09T12:42:36.228264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246647+0000","last_change":"2023-08-09T12:42:36.246540+0000","last_active":"2023-08-09T12:42:36.246647+0000","last_peered":"2023-08-09T12:42:36.246647+0000","last_clean":"2023-08-09T12:42:36.246647+0000","last_became_active":"2023-08-09T12:42:36.246233+0000","last_became_peered":"2023-08-09T12:42:36.246233+0000","last_unstale":"2023-08-09T12:42:36.246647+0000","last_undegraded":"2023-08-09T12:42:36.246647+0000","last_fullsized":"2023-08-09T12:42:36.246647+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:20:58.738101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.221992+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:42:36.221992+0000","last_peered":"2023-08-09T12:42:36.221992+0000","last_clean":"2023-08-09T12:42:36.221992+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:42:36.221992+0000","last_undegraded":"2023-08-09T12:42:36.221992+0000","last_fullsized":"2023-08-09T12:42:36.221992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:34:28.408185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.236655+0000","last_change":"2023-08-09T12:42:36.236655+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.236655+0000","last_undegraded":"2023-08-09T12:42:36.236655+0000","last_fullsized":"2023-08-09T12:42:36.236655+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249356+0000","last_change":"2023-08-09T12:42:36.248225+0000","last_active":"2023-08-09T12:42:36.249356+0000","last_peered":"2023-08-09T12:42:36.249356+0000","last_clean":"2023-08-09T12:42:36.249356+0000","last_became_active":"2023-08-09T12:42:36.245387+0000","last_became_peered":"2023-08-09T12:42:36.245387+0000","last_unstale":"2023-08-09T12:42:36.249356+0000","last_undegraded":"2023-08-09T12:42:36.249356+0000","last_fullsized":"2023-08-09T12:42:36.249356+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:02:04.640277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-09T12:42:35.213485+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:42:35.213485+0000","last_peered":"2023-08-09T12:42:35.213485+0000","last_clean":"2023-08-09T12:42:35.213485+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:42:35.213485+0000","last_undegraded":"2023-08-09T12:42:35.213485+0000","last_fullsized":"2023-08-09T12:42:35.213485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:43.831281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233661+0000","last_change":"2023-08-09T12:42:36.233661+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233661+0000","last_undegraded":"2023-08-09T12:42:36.233661+0000","last_fullsized":"2023-08-09T12:42:36.233661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249902+0000","last_change":"2023-08-09T12:42:36.249795+0000","last_active":"2023-08-09T12:42:36.249902+0000","last_peered":"2023-08-09T12:42:36.249902+0000","last_clean":"2023-08-09T12:42:36.249902+0000","last_became_active":"2023-08-09T12:42:36.248860+0000","last_became_peered":"2023-08-09T12:42:36.248860+0000","last_unstale":"2023-08-09T12:42:36.249902+0000","last_undegraded":"2023-08-09T12:42:36.249902+0000","last_fullsized":"2023-08-09T12:42:36.249902+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:59.821983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.238524+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:42:36.238524+0000","last_peered":"2023-08-09T12:42:36.238524+0000","last_clean":"2023-08-09T12:42:36.238524+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:42:36.238524+0000","last_undegraded":"2023-08-09T12:42:36.238524+0000","last_fullsized":"2023-08-09T12:42:36.238524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:17:29.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.619,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0940000000000001,"15min":1.0660000000000001},"min":{"1min":0.70799999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.601,"5min":1.843,"15min":1.843},"last":1.01}]},{"osd":1,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1180000000000001,"15min":1.0860000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.708,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.361},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7030000000000001,"5min":1.734,"15min":1.734},"last":1.4259999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.1739999999999999,"15min":1.1399999999999999},"min":{"1min":0.85299999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.625,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.167,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.637,"5min":2.173,"15min":2.173},"last":0.878}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2210000000000001,"15min":1.212},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5860000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.2689999999999999,"15min":1.2490000000000001},"min":{"1min":0.91600000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":1.589}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.224,"15min":1.1990000000000001},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.5509999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.206},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.274,"15min":1.2470000000000001},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.615,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.264}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3140000000000001,"15min":1.2689999999999999},"min":{"1min":0.751,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7849999999999999,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4790000000000001,"15min":1.4750000000000001},"min":{"1min":0.90100000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5980000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.393}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4710000000000001,"15min":1.464},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.788,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.83699999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.6779999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.48}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.1120000000000001},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5449999999999999,"5min":2.54,"15min":2.54},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0760000000000001,"15min":1.0549999999999999},"min":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0740000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.246,"15min":1.228},"min":{"1min":0.874,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7210000000000001,"5min":2.306,"15min":2.306},"last":1.278},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3280000000000001,"15min":1.3109999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.671,"5min":1.829,"15min":1.829},"last":1.4099999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.093,"15min":1.0820000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4490000000000001,"5min":1.554,"15min":1.554},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2809999999999999,"15min":1.2649999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.923,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.5389999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":0.86799999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7150000000000001,"5min":2.004,"15min":2.004},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.27},"min":{"1min":0.84599999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6579999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.4830000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.319,"15min":1.2889999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0590000000000002,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.353,"15min":1.325},"min":{"1min":1.056,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1059999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.631}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.327,"15min":1.3089999999999999},"min":{"1min":1.022,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.8240000000000001,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.496,"15min":1.462},"min":{"1min":1.1830000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.4350000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.6719999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.4570000000000001,"15min":1.393},"min":{"1min":1.145,"5min":0.752,"15min":0.752},"max":{"1min":2.2610000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.446,"15min":1.3999999999999999},"min":{"1min":1.0509999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.161,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.7609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1120000000000001,"15min":1.1100000000000001},"min":{"1min":0.67600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.649,"5min":2.427,"15min":2.427},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.073,"15min":1.0429999999999999},"min":{"1min":0.71699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.575,"5min":1.851,"15min":1.851},"last":0.999}]},{"osd":1,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2909999999999999,"15min":1.276},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.766,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2569999999999999,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.75600000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.88500000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.554},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.95299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.5449999999999999,"5min":1.728,"15min":1.728},"last":1.2250000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2030000000000001,"15min":1.177},"min":{"1min":0.86499999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.373},"min":{"1min":0.879,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7050000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.304}]},{"osd":4,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.228,"15min":1.224},"min":{"1min":0.85899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.94099999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.7450000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.3620000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.339,"15min":1.3280000000000001},"min":{"1min":0.96699999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.804,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.468},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.458,"15min":1.5},"min":{"1min":1.0920000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.8029999999999999,"5min":2.948,"15min":2.948},"last":1.5}]},{"osd":7,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":1.111,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7969999999999999,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5089999999999999,"15min":1.504},"min":{"1min":1.1060000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.6080000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.0940000000000001,"15min":1.071},"min":{"1min":0.81999999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6439999999999999,"5min":1.77,"15min":1.77},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.103,"15min":1.081},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.1559999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3069999999999999,"15min":1.355},"min":{"1min":0.83199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.897,"5min":1.97,"15min":1.97},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.335,"15min":1.3400000000000001},"min":{"1min":0.95699999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6359999999999999,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":2.2040000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.3140000000000001,"15min":1.321},"min":{"1min":0.88100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5329999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.325,"15min":1.3129999999999999},"min":{"1min":0.90200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7270000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.929}]},{"osd":3,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.204},"min":{"1min":0.79200000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.337},"min":{"1min":0.97899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.091}]},{"osd":5,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3819999999999999,"15min":1.4039999999999999},"min":{"1min":0.92500000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.853,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.482},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.371,"15min":1.379},"min":{"1min":0.98799999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.556}]},{"osd":6,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4610000000000001,"15min":1.5069999999999999},"min":{"1min":0.93200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.554,"5min":1.5369999999999999,"15min":1.5429999999999999},"min":{"1min":1.278,"5min":0.755,"15min":0.755},"max":{"1min":1.9570000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":2.036}]},{"osd":7,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.518,"15min":1.5169999999999999},"min":{"1min":1.085,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.605,"15min":1.637},"min":{"1min":1.1319999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.839}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.82599999999999996},"min":{"1min":0.44400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.4109999999999996,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.89200000000000002,"15min":0.86399999999999999},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3049999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.159,"5min":0.93700000000000006,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.373,"15min":0.373},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.2490000000000001,"15min":1.0900000000000001},"min":{"1min":0.47299999999999998,"5min":0.433,"15min":0.433},"max":{"1min":18.145,"5min":18.145,"15min":18.145},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.222,"5min":1.1759999999999999,"15min":1.1910000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.7050000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.95399999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.972,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.874},{"interface":"front","average":{"1min":1.456,"5min":1.337,"15min":1.345},"min":{"1min":0.751,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.5960000000000001,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.014}]},{"osd":5,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.4769999999999999,"5min":1.5740000000000001,"15min":1.4430000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":18.094000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":2.181,"5min":1.446,"15min":1.3120000000000001},"min":{"1min":0.96099999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":14.105,"5min":14.105,"15min":14.105},"last":0.83499999999999996}]},{"osd":6,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.357,"15min":1.335},"min":{"1min":0.99399999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.93999999999999995}]},{"osd":7,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3740000000000001,"15min":1.3720000000000001},"min":{"1min":1.0740000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.806,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.3859999999999999,"15min":1.365},"min":{"1min":1.008,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.1459999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4570000000000001,"5min":1.716,"15min":1.716},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.46700000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4830000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.80300000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.504,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1339999999999999,"5min":1.466,"15min":1.466},"last":0.873},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.024,"15min":1.05},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6200000000000001,"5min":1.869,"15min":1.869},"last":1.3899999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.73899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5489999999999999,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1419999999999999,"15min":1.143},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.5589999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.399,"15min":1.403},"min":{"1min":0.93200000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.897,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.296,"15min":1.26},"min":{"1min":0.90600000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.819,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.4950000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.381,"15min":1.347},"min":{"1min":1.0580000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0539999999999998,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.333},{"interface":"front","average":{"1min":1.407,"5min":1.484,"15min":1.482},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.804,"5min":4.806,"15min":4.806},"last":1.829}]},{"osd":6,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3049999999999999,"15min":1.29},"min":{"1min":0.83999999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.744,"5min":2.323,"15min":2.323},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":1.0620000000000001,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9319999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.613}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.353,"15min":1.3480000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6759999999999999,"5min":2.218,"15min":2.218},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5209999999999999,"15min":1.5229999999999999},"min":{"1min":1.032,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.1949999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.7709999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":352,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194960,"statfs":{"total":200000000,"available":199639325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89400000000000002},"min":{"1min":0.64400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.873},{"interface":"front","average":{"1min":6.1859999999999999,"5min":1.917,"15min":1.2090000000000001},"min":{"1min":0.47799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":88.254999999999995,"5min":88.254999999999995,"15min":88.254999999999995},"last":1.3500000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.96399999999999997,"15min":0.92800000000000005},"min":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.022},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.127,"15min":1.087},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.1859999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.369,"5min":1,"15min":0.91600000000000004},"min":{"1min":0.53900000000000003,"5min":0.503,"15min":0.503},"max":{"1min":5.4320000000000004,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.4850000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":1.4810000000000001,"15min":1.268},"min":{"1min":0.93899999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":25.172000000000001,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.268},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.2869999999999999,"15min":1.2709999999999999},"min":{"1min":1.0289999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.3140000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.96,"5min":1.6000000000000001,"15min":1.3759999999999999},"min":{"1min":0.90700000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":28.710000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3,"15min":1.258},"min":{"1min":0.91600000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.417}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.4510000000000001,"15min":1.399},"min":{"1min":1.0860000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":6.0460000000000003,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.748},{"interface":"front","average":{"1min":1.423,"5min":1.3700000000000001,"15min":1.347},"min":{"1min":0.91300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.863,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.639}]},{"osd":7,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":3.0259999999999998,"5min":1.768,"15min":1.5549999999999999},"min":{"1min":0.98699999999999999,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":26.975999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.546},{"interface":"front","average":{"1min":3.1640000000000001,"5min":1.7629999999999999,"15min":1.53},"min":{"1min":1.052,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":28.765000000000001,"5min":28.765000000000001,"15min":28.765000000000001},"last":2.2200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194383,"statfs":{"total":200000000,"available":199048957,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.50900000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":0.98599999999999999,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":6.1749999999999998,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.89400000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.95099999999999996,"15min":0.93700000000000006},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.657,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.101},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.0629999999999999,"15min":1.0049999999999999},"min":{"1min":0.59899999999999998,"5min":0.5,"15min":0.5},"max":{"1min":6.2549999999999999,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":1.252}]},{"osd":3,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":0.98399999999999999,"15min":0.91200000000000003},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1679999999999999,"15min":1.1659999999999999},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6000000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.83699999999999997}]},{"osd":4,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.3660000000000001,"15min":1.3300000000000001},"min":{"1min":0.96299999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":9.9629999999999992,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.288,"15min":1.264},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.4199999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.3420000000000001,"15min":1.29},"min":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":10.004,"5min":10.004,"15min":10.004},"last":1.159},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.369,"15min":1.365},"min":{"1min":0.87,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.909,"5min":2.161,"15min":2.161},"last":1.526}]},{"osd":6,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.377,"15min":1.3220000000000001},"min":{"1min":0.83699999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.4290000000000003,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.881,"5min":1.472,"15min":1.415},"min":{"1min":1.093,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":9.9190000000000005,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.337}]},{"osd":7,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":1.552,"15min":1.4199999999999999},"min":{"1min":0.89300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":18.114000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.897,"5min":1.4930000000000001,"15min":1.4390000000000001},"min":{"1min":1.052,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":9.5640000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.5649999999999999}]}]}],"pool_statfs":[]}} 2023-08-09T12:42:42.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:42:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.420+0000 7fce5b056640 1 Processor -- start 2023-08-09T12:42:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.421+0000 7fce5b056640 1 -- start start 2023-08-09T12:42:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.422+0000 7fce5b056640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fce5406ad60 0x7fce5406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.422+0000 7fce5b056640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5415c000 con 0x7fce5406b7c0 2023-08-09T12:42:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.422+0000 7fce5b056640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5415ba40 con 0x7fce54158720 2023-08-09T12:42:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.422+0000 7fce5b056640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5406a230 con 0x7fce5406ad60 2023-08-09T12:42:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.422+0000 7fce59853640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fce5406b7c0 0x7fce5406a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49000/0 (socket says 172.21.15.17:49000) 2023-08-09T12:42:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.422+0000 7fce59853640 1 -- 172.21.15.17:0/3655186856 learned_addr learned my addr 172.21.15.17:0/3655186856 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.422+0000 7fce5a855640 1 --2- 172.21.15.17:0/3655186856 >> v2:172.21.15.142:3300/0 conn(0x7fce5406ad60 0x7fce5406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698047969 0 0) 0x7fce5415c000 con 0x7fce5406b7c0 2023-08-09T12:42:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce40003520 con 0x7fce5406b7c0 2023-08-09T12:42:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43566718 0 0) 0x7fce40003520 con 0x7fce5406b7c0 2023-08-09T12:42:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 >> v2:172.21.15.142:3300/0 conn(0x7fce5406ad60 msgr2=0x7fce5406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 --2- 172.21.15.17:0/3655186856 >> v2:172.21.15.142:3300/0 conn(0x7fce5406ad60 0x7fce5406bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 >> v1:172.21.15.142:6789/0 conn(0x7fce54158720 legacy=0x7fce5415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5415bd20 con 0x7fce5406b7c0 2023-08-09T12:42:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fce44001670 con 0x7fce5406b7c0 2023-08-09T12:42:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 >> v1:172.21.15.17:6789/0 conn(0x7fce5406b7c0 legacy=0x7fce5406a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40003970 0x7fce40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce400047c0 0x7fce40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce40005180 0x7fce4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5406a230 con 0x7fce40005180 2023-08-09T12:42:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4000c020 con 0x7fce40003970 2023-08-09T12:42:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.423+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4000c1e0 con 0x7fce400047c0 2023-08-09T12:42:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.424+0000 7fce5a855640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce40005180 0x7fce4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.424+0000 7fce5a054640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40003970 0x7fce40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.424+0000 7fce5a855640 1 -- 172.21.15.17:0/3655186856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce400047c0 msgr2=0x7fce40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.424+0000 7fce5a855640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce400047c0 0x7fce40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.424+0000 7fce5a855640 1 -- 172.21.15.17:0/3655186856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40003970 msgr2=0x7fce40003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.424+0000 7fce5a855640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40003970 0x7fce40003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.424+0000 7fce5a855640 1 -- 172.21.15.17:0/3655186856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40003520 con 0x7fce40005180 2023-08-09T12:42:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.424+0000 7fce5a054640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40003970 0x7fce40003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.425+0000 7fce5a855640 1 -- 172.21.15.17:0/3655186856 reap_dead start 2023-08-09T12:42:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.425+0000 7fce5a855640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce40005180 0x7fce4000b980 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009f90 tx=0x7fce400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fb6d9b37c4ac1d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.425+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c02cc20 con 0x7fce40005180 2023-08-09T12:42:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.425+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c00f040 con 0x7fce40005180 2023-08-09T12:42:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.425+0000 7fce59052640 1 -- 172.21.15.17:0/3655186856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c003990 con 0x7fce40005180 2023-08-09T12:42:42.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.426+0000 7fce5b056640 1 -- 172.21.15.17:0/3655186856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce40005180 msgr2=0x7fce4000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.426+0000 7fce5b056640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce40005180 0x7fce4000b980 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009f90 tx=0x7fce400057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.426+0000 7fce5b056640 1 -- 172.21.15.17:0/3655186856 shutdown_connections 2023-08-09T12:42:42.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.426+0000 7fce5b056640 1 --2- 172.21.15.17:0/3655186856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce40005180 0x7fce4000b980 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.426+0000 7fce5b056640 1 -- 172.21.15.17:0/3655186856 >> 172.21.15.17:0/3655186856 conn(0x7fce540cc430 msgr2=0x7fce540cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:42.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.426+0000 7fce5b056640 1 -- 172.21.15.17:0/3655186856 shutdown_connections 2023-08-09T12:42:42.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.426+0000 7fce5b056640 1 -- 172.21.15.17:0/3655186856 wait complete. 2023-08-09T12:42:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.428+0000 7fce5b056640 1 Processor -- start 2023-08-09T12:42:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.428+0000 7fce5b056640 1 -- start start 2023-08-09T12:42:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.429+0000 7fce5b056640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40005180 0x7fce5414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.429+0000 7fce5b056640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce540c6db0 0x7fce540b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.429+0000 7fce5b056640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce540b30b0 0x7fce540ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.429+0000 7fce5b056640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540b3530 con 0x7fce540c6db0 2023-08-09T12:42:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.429+0000 7fce5b056640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540b3b10 con 0x7fce40005180 2023-08-09T12:42:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.429+0000 7fce5b056640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce54159090 con 0x7fce540b30b0 2023-08-09T12:42:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce59853640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce540c6db0 0x7fce540b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce59853640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce540c6db0 0x7fce540b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39148/0 (socket says 172.21.15.17:39148) 2023-08-09T12:42:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce59853640 1 -- 172.21.15.17:0/1549824487 learned_addr learned my addr 172.21.15.17:0/1549824487 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce5a855640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce540b30b0 0x7fce540ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce5a054640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40005180 0x7fce5414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce59853640 1 -- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce540b30b0 msgr2=0x7fce540ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce59853640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce540b30b0 0x7fce540ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce59853640 1 -- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40005180 msgr2=0x7fce5414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce59853640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40005180 0x7fce5414fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce59853640 1 -- 172.21.15.17:0/1549824487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce54159c10 con 0x7fce540c6db0 2023-08-09T12:42:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.430+0000 7fce5a855640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce540b30b0 0x7fce540ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.431+0000 7fce59853640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce540c6db0 0x7fce540b2b70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c790 tx=0x7fce4400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:42.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.431+0000 7fce4affd640 1 -- 172.21.15.17:0/1549824487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440074e0 con 0x7fce540c6db0 2023-08-09T12:42:42.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.431+0000 7fce4affd640 1 -- 172.21.15.17:0/1549824487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce44007640 con 0x7fce540c6db0 2023-08-09T12:42:42.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.431+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce541592e0 con 0x7fce540c6db0 2023-08-09T12:42:42.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.431+0000 7fce4affd640 1 -- 172.21.15.17:0/1549824487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44004a20 con 0x7fce540c6db0 2023-08-09T12:42:42.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.431+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce541598a0 con 0x7fce540c6db0 2023-08-09T12:42:42.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.432+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5404e390 con 0x7fce540c6db0 2023-08-09T12:42:42.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.433+0000 7fce4affd640 1 -- 172.21.15.17:0/1549824487 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce44004b80 con 0x7fce540c6db0 2023-08-09T12:42:42.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.434+0000 7fce4affd640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce3806a080 0x7fce3806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.434+0000 7fce4affd640 1 -- 172.21.15.17:0/1549824487 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce44087960 con 0x7fce540c6db0 2023-08-09T12:42:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.435+0000 7fce5a054640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce3806a080 0x7fce3806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.436+0000 7fce5a054640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce3806a080 0x7fce3806c540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce50000f60 tx=0x7fce50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.438+0000 7fce4affd640 1 -- 172.21.15.17:0/1549824487 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fce44052f30 con 0x7fce540c6db0 2023-08-09T12:42:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.619+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce54069e50 con 0x7fce3806a080 2023-08-09T12:42:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.642+0000 7fce4affd640 1 -- 172.21.15.17:0/1549824487 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296269 (secure 0 0 0) 0x7fce5000d050 con 0x7fce3806a080 2023-08-09T12:42:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:42.650 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:42:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce3806a080 msgr2=0x7fce3806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce3806a080 0x7fce3806c540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce50000f60 tx=0x7fce50009040 comp rx=0 tx=0).stop 2023-08-09T12:42:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce540c6db0 msgr2=0x7fce540b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce540c6db0 0x7fce540b2b70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c790 tx=0x7fce4400cc50 comp rx=0 tx=0).stop 2023-08-09T12:42:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 shutdown_connections 2023-08-09T12:42:42.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce3806a080 0x7fce3806c540 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce540b30b0 0x7fce540ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce540c6db0 0x7fce540b2b70 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 --2- 172.21.15.17:0/1549824487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce40005180 0x7fce5414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 >> 172.21.15.17:0/1549824487 conn(0x7fce540cc430 msgr2=0x7fce5406c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:42.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 shutdown_connections 2023-08-09T12:42:42.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.648+0000 7fce5b056640 1 -- 172.21.15.17:0/1549824487 wait complete. 2023-08-09T12:42:42.671 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2023-08-09T12:42:40.707187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":184,"acting":184,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4009,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558490,"statfs":{"total":1600000000,"available":1595894144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.500529"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.230975+0000","last_change":"2023-08-09T12:42:36.230975+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.230975+0000","last_undegraded":"2023-08-09T12:42:36.230975+0000","last_fullsized":"2023-08-09T12:42:36.230975+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231023+0000","last_change":"2023-08-09T12:42:36.231023+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231023+0000","last_undegraded":"2023-08-09T12:42:36.231023+0000","last_fullsized":"2023-08-09T12:42:36.231023+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.230357+0000","last_change":"2023-08-09T12:42:36.230357+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.230357+0000","last_undegraded":"2023-08-09T12:42:36.230357+0000","last_fullsized":"2023-08-09T12:42:36.230357+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233379+0000","last_change":"2023-08-09T12:42:36.233379+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233379+0000","last_undegraded":"2023-08-09T12:42:36.233379+0000","last_fullsized":"2023-08-09T12:42:36.233379+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.242936+0000","last_change":"2023-08-09T12:42:36.242936+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.242936+0000","last_undegraded":"2023-08-09T12:42:36.242936+0000","last_fullsized":"2023-08-09T12:42:36.242936+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233359+0000","last_change":"2023-08-09T12:42:36.233359+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233359+0000","last_undegraded":"2023-08-09T12:42:36.233359+0000","last_fullsized":"2023-08-09T12:42:36.233359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231289+0000","last_change":"2023-08-09T12:42:36.231289+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231289+0000","last_undegraded":"2023-08-09T12:42:36.231289+0000","last_fullsized":"2023-08-09T12:42:36.231289+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233831+0000","last_change":"2023-08-09T12:42:36.233831+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233831+0000","last_undegraded":"2023-08-09T12:42:36.233831+0000","last_fullsized":"2023-08-09T12:42:36.233831+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.238618+0000","last_change":"2023-08-09T12:42:36.238618+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.238618+0000","last_undegraded":"2023-08-09T12:42:36.238618+0000","last_fullsized":"2023-08-09T12:42:36.238618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.242474+0000","last_change":"2023-08-09T12:42:36.242474+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.242474+0000","last_undegraded":"2023-08-09T12:42:36.242474+0000","last_fullsized":"2023-08-09T12:42:36.242474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232578+0000","last_change":"2023-08-09T12:42:36.232578+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232578+0000","last_undegraded":"2023-08-09T12:42:36.232578+0000","last_fullsized":"2023-08-09T12:42:36.232578+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229903+0000","last_change":"2023-08-09T12:42:36.229903+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229903+0000","last_undegraded":"2023-08-09T12:42:36.229903+0000","last_fullsized":"2023-08-09T12:42:36.229903+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233872+0000","last_change":"2023-08-09T12:42:36.233872+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233872+0000","last_undegraded":"2023-08-09T12:42:36.233872+0000","last_fullsized":"2023-08-09T12:42:36.233872+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.240728+0000","last_change":"2023-08-09T12:42:36.240728+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.240728+0000","last_undegraded":"2023-08-09T12:42:36.240728+0000","last_fullsized":"2023-08-09T12:42:36.240728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232914+0000","last_change":"2023-08-09T12:42:36.232914+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232914+0000","last_undegraded":"2023-08-09T12:42:36.232914+0000","last_fullsized":"2023-08-09T12:42:36.232914+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.226242+0000","last_change":"2023-08-09T12:42:36.226242+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.226242+0000","last_undegraded":"2023-08-09T12:42:36.226242+0000","last_fullsized":"2023-08-09T12:42:36.226242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.241008+0000","last_change":"2023-08-09T12:42:36.241008+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.241008+0000","last_undegraded":"2023-08-09T12:42:36.241008+0000","last_fullsized":"2023-08-09T12:42:36.241008+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229321+0000","last_change":"2023-08-09T12:42:36.229321+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229321+0000","last_undegraded":"2023-08-09T12:42:36.229321+0000","last_fullsized":"2023-08-09T12:42:36.229321+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.227213+0000","last_change":"2023-08-09T12:42:36.227213+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.227213+0000","last_undegraded":"2023-08-09T12:42:36.227213+0000","last_fullsized":"2023-08-09T12:42:36.227213+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231806+0000","last_change":"2023-08-09T12:42:36.231806+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231806+0000","last_undegraded":"2023-08-09T12:42:36.231806+0000","last_fullsized":"2023-08-09T12:42:36.231806+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.236473+0000","last_change":"2023-08-09T12:42:36.236473+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.236473+0000","last_undegraded":"2023-08-09T12:42:36.236473+0000","last_fullsized":"2023-08-09T12:42:36.236473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.240694+0000","last_change":"2023-08-09T12:42:36.240694+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.240694+0000","last_undegraded":"2023-08-09T12:42:36.240694+0000","last_fullsized":"2023-08-09T12:42:36.240694+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.239689+0000","last_change":"2023-08-09T12:42:36.239689+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.239689+0000","last_undegraded":"2023-08-09T12:42:36.239689+0000","last_fullsized":"2023-08-09T12:42:36.239689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231013+0000","last_change":"2023-08-09T12:42:36.231013+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231013+0000","last_undegraded":"2023-08-09T12:42:36.231013+0000","last_fullsized":"2023-08-09T12:42:36.231013+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.235403+0000","last_change":"2023-08-09T12:42:36.235403+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.235403+0000","last_undegraded":"2023-08-09T12:42:36.235403+0000","last_fullsized":"2023-08-09T12:42:36.235403+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233105+0000","last_change":"2023-08-09T12:42:36.233105+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233105+0000","last_undegraded":"2023-08-09T12:42:36.233105+0000","last_fullsized":"2023-08-09T12:42:36.233105+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229971+0000","last_change":"2023-08-09T12:42:36.229971+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229971+0000","last_undegraded":"2023-08-09T12:42:36.229971+0000","last_fullsized":"2023-08-09T12:42:36.229971+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.212655+0000","last_change":"2023-08-09T12:42:35.212655+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.212655+0000","last_undegraded":"2023-08-09T12:42:35.212655+0000","last_fullsized":"2023-08-09T12:42:35.212655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.237328+0000","last_change":"2023-08-09T12:42:36.237328+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.237328+0000","last_undegraded":"2023-08-09T12:42:36.237328+0000","last_fullsized":"2023-08-09T12:42:36.237328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.215073+0000","last_change":"2023-08-09T12:42:35.215073+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.215073+0000","last_undegraded":"2023-08-09T12:42:35.215073+0000","last_fullsized":"2023-08-09T12:42:35.215073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.215950+0000","last_change":"2023-08-09T12:42:35.215950+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.215950+0000","last_undegraded":"2023-08-09T12:42:35.215950+0000","last_fullsized":"2023-08-09T12:42:35.215950+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229850+0000","last_change":"2023-08-09T12:42:36.229850+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229850+0000","last_undegraded":"2023-08-09T12:42:36.229850+0000","last_fullsized":"2023-08-09T12:42:36.229850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.214411+0000","last_change":"2023-08-09T12:42:35.214411+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.214411+0000","last_undegraded":"2023-08-09T12:42:35.214411+0000","last_fullsized":"2023-08-09T12:42:35.214411+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.234101+0000","last_change":"2023-08-09T12:42:36.234101+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.234101+0000","last_undegraded":"2023-08-09T12:42:36.234101+0000","last_fullsized":"2023-08-09T12:42:36.234101+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249447+0000","last_change":"2023-08-09T12:42:36.249304+0000","last_active":"2023-08-09T12:42:36.249447+0000","last_peered":"2023-08-09T12:42:36.249447+0000","last_clean":"2023-08-09T12:42:36.249447+0000","last_became_active":"2023-08-09T12:42:36.244419+0000","last_became_peered":"2023-08-09T12:42:36.244419+0000","last_unstale":"2023-08-09T12:42:36.249447+0000","last_undegraded":"2023-08-09T12:42:36.249447+0000","last_fullsized":"2023-08-09T12:42:36.249447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:44:35.236852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240203+0000","last_change":"2023-08-09T12:42:36.239590+0000","last_active":"2023-08-09T12:42:36.240203+0000","last_peered":"2023-08-09T12:42:36.240203+0000","last_clean":"2023-08-09T12:42:36.240203+0000","last_became_active":"2023-08-09T12:42:36.238193+0000","last_became_peered":"2023-08-09T12:42:36.238193+0000","last_unstale":"2023-08-09T12:42:36.240203+0000","last_undegraded":"2023-08-09T12:42:36.240203+0000","last_fullsized":"2023-08-09T12:42:36.240203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:28:51.225785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.236050+0000","last_change":"2023-08-09T12:42:36.236050+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.236050+0000","last_undegraded":"2023-08-09T12:42:36.236050+0000","last_fullsized":"2023-08-09T12:42:36.236050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246463+0000","last_change":"2023-08-09T12:42:36.246355+0000","last_active":"2023-08-09T12:42:36.246463+0000","last_peered":"2023-08-09T12:42:36.246463+0000","last_clean":"2023-08-09T12:42:36.246463+0000","last_became_active":"2023-08-09T12:42:36.246037+0000","last_became_peered":"2023-08-09T12:42:36.246037+0000","last_unstale":"2023-08-09T12:42:36.246463+0000","last_undegraded":"2023-08-09T12:42:36.246463+0000","last_fullsized":"2023-08-09T12:42:36.246463+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:21:43.648463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.227995+0000","last_change":"2023-08-09T12:42:36.227995+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.227995+0000","last_undegraded":"2023-08-09T12:42:36.227995+0000","last_fullsized":"2023-08-09T12:42:36.227995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240861+0000","last_change":"2023-08-09T12:42:36.240311+0000","last_active":"2023-08-09T12:42:36.240861+0000","last_peered":"2023-08-09T12:42:36.240861+0000","last_clean":"2023-08-09T12:42:36.240861+0000","last_became_active":"2023-08-09T12:42:36.239717+0000","last_became_peered":"2023-08-09T12:42:36.239717+0000","last_unstale":"2023-08-09T12:42:36.240861+0000","last_undegraded":"2023-08-09T12:42:36.240861+0000","last_fullsized":"2023-08-09T12:42:36.240861+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:00:49.296058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249585+0000","last_change":"2023-08-09T12:42:36.249493+0000","last_active":"2023-08-09T12:42:36.249585+0000","last_peered":"2023-08-09T12:42:36.249585+0000","last_clean":"2023-08-09T12:42:36.249585+0000","last_became_active":"2023-08-09T12:42:36.247921+0000","last_became_peered":"2023-08-09T12:42:36.247921+0000","last_unstale":"2023-08-09T12:42:36.249585+0000","last_undegraded":"2023-08-09T12:42:36.249585+0000","last_fullsized":"2023-08-09T12:42:36.249585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:37:32.804373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.226196+0000","last_change":"2023-08-09T12:42:36.226196+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.226196+0000","last_undegraded":"2023-08-09T12:42:36.226196+0000","last_fullsized":"2023-08-09T12:42:36.226196+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.247715+0000","last_change":"2023-08-09T12:42:36.247625+0000","last_active":"2023-08-09T12:42:36.247715+0000","last_peered":"2023-08-09T12:42:36.247715+0000","last_clean":"2023-08-09T12:42:36.247715+0000","last_became_active":"2023-08-09T12:42:36.247369+0000","last_became_peered":"2023-08-09T12:42:36.247369+0000","last_unstale":"2023-08-09T12:42:36.247715+0000","last_undegraded":"2023-08-09T12:42:36.247715+0000","last_fullsized":"2023-08-09T12:42:36.247715+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:58:23.386987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232117+0000","last_change":"2023-08-09T12:42:36.232117+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232117+0000","last_undegraded":"2023-08-09T12:42:36.232117+0000","last_fullsized":"2023-08-09T12:42:36.232117+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246625+0000","last_change":"2023-08-09T12:42:36.246431+0000","last_active":"2023-08-09T12:42:36.246625+0000","last_peered":"2023-08-09T12:42:36.246625+0000","last_clean":"2023-08-09T12:42:36.246625+0000","last_became_active":"2023-08-09T12:42:36.245840+0000","last_became_peered":"2023-08-09T12:42:36.245840+0000","last_unstale":"2023-08-09T12:42:36.246625+0000","last_undegraded":"2023-08-09T12:42:36.246625+0000","last_fullsized":"2023-08-09T12:42:36.246625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:14:29.938260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232043+0000","last_change":"2023-08-09T12:42:36.232043+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232043+0000","last_undegraded":"2023-08-09T12:42:36.232043+0000","last_fullsized":"2023-08-09T12:42:36.232043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.213109+0000","last_change":"2023-08-09T12:42:35.213109+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.213109+0000","last_undegraded":"2023-08-09T12:42:35.213109+0000","last_fullsized":"2023-08-09T12:42:35.213109+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.240275+0000","last_change":"2023-08-09T12:42:36.240275+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.240275+0000","last_undegraded":"2023-08-09T12:42:36.240275+0000","last_fullsized":"2023-08-09T12:42:36.240275+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.245933+0000","last_change":"2023-08-09T12:42:36.245706+0000","last_active":"2023-08-09T12:42:36.245933+0000","last_peered":"2023-08-09T12:42:36.245933+0000","last_clean":"2023-08-09T12:42:36.245933+0000","last_became_active":"2023-08-09T12:42:36.245288+0000","last_became_peered":"2023-08-09T12:42:36.245288+0000","last_unstale":"2023-08-09T12:42:36.245933+0000","last_undegraded":"2023-08-09T12:42:36.245933+0000","last_fullsized":"2023-08-09T12:42:36.245933+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:23:22.961857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.237978+0000","last_change":"2023-08-09T12:42:36.237978+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.237978+0000","last_undegraded":"2023-08-09T12:42:36.237978+0000","last_fullsized":"2023-08-09T12:42:36.237978+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249498+0000","last_change":"2023-08-09T12:42:36.249379+0000","last_active":"2023-08-09T12:42:36.249498+0000","last_peered":"2023-08-09T12:42:36.249498+0000","last_clean":"2023-08-09T12:42:36.249498+0000","last_became_active":"2023-08-09T12:42:36.249139+0000","last_became_peered":"2023-08-09T12:42:36.249139+0000","last_unstale":"2023-08-09T12:42:36.249498+0000","last_undegraded":"2023-08-09T12:42:36.249498+0000","last_fullsized":"2023-08-09T12:42:36.249498+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:43:13.986798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229210+0000","last_change":"2023-08-09T12:42:36.229210+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229210+0000","last_undegraded":"2023-08-09T12:42:36.229210+0000","last_fullsized":"2023-08-09T12:42:36.229210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240983+0000","last_change":"2023-08-09T12:42:36.240822+0000","last_active":"2023-08-09T12:42:36.240983+0000","last_peered":"2023-08-09T12:42:36.240983+0000","last_clean":"2023-08-09T12:42:36.240983+0000","last_became_active":"2023-08-09T12:42:36.239779+0000","last_became_peered":"2023-08-09T12:42:36.239779+0000","last_unstale":"2023-08-09T12:42:36.240983+0000","last_undegraded":"2023-08-09T12:42:36.240983+0000","last_fullsized":"2023-08-09T12:42:36.240983+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:53:44.415681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246810+0000","last_change":"2023-08-09T12:42:36.246725+0000","last_active":"2023-08-09T12:42:36.246810+0000","last_peered":"2023-08-09T12:42:36.246810+0000","last_clean":"2023-08-09T12:42:36.246810+0000","last_became_active":"2023-08-09T12:42:36.246443+0000","last_became_peered":"2023-08-09T12:42:36.246443+0000","last_unstale":"2023-08-09T12:42:36.246810+0000","last_undegraded":"2023-08-09T12:42:36.246810+0000","last_fullsized":"2023-08-09T12:42:36.246810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:45.911239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246228+0000","last_change":"2023-08-09T12:42:36.246114+0000","last_active":"2023-08-09T12:42:36.246228+0000","last_peered":"2023-08-09T12:42:36.246228+0000","last_clean":"2023-08-09T12:42:36.246228+0000","last_became_active":"2023-08-09T12:42:36.243762+0000","last_became_peered":"2023-08-09T12:42:36.243762+0000","last_unstale":"2023-08-09T12:42:36.246228+0000","last_undegraded":"2023-08-09T12:42:36.246228+0000","last_fullsized":"2023-08-09T12:42:36.246228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:39:30.410136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233170+0000","last_change":"2023-08-09T12:42:36.233170+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233170+0000","last_undegraded":"2023-08-09T12:42:36.233170+0000","last_fullsized":"2023-08-09T12:42:36.233170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.248702+0000","last_change":"2023-08-09T12:42:36.248626+0000","last_active":"2023-08-09T12:42:36.248702+0000","last_peered":"2023-08-09T12:42:36.248702+0000","last_clean":"2023-08-09T12:42:36.248702+0000","last_became_active":"2023-08-09T12:42:36.248040+0000","last_became_peered":"2023-08-09T12:42:36.248040+0000","last_unstale":"2023-08-09T12:42:36.248702+0000","last_undegraded":"2023-08-09T12:42:36.248702+0000","last_fullsized":"2023-08-09T12:42:36.248702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:32:44.210755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.241784+0000","last_change":"2023-08-09T12:42:36.241784+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.241784+0000","last_undegraded":"2023-08-09T12:42:36.241784+0000","last_fullsized":"2023-08-09T12:42:36.241784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.214431+0000","last_change":"2023-08-09T12:42:35.214431+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.214431+0000","last_undegraded":"2023-08-09T12:42:35.214431+0000","last_fullsized":"2023-08-09T12:42:35.214431+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231254+0000","last_change":"2023-08-09T12:42:36.231254+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231254+0000","last_undegraded":"2023-08-09T12:42:36.231254+0000","last_fullsized":"2023-08-09T12:42:36.231254+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.213568+0000","last_change":"2023-08-09T12:42:35.213568+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.213568+0000","last_undegraded":"2023-08-09T12:42:35.213568+0000","last_fullsized":"2023-08-09T12:42:35.213568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.231427+0000","last_change":"2023-08-09T12:42:36.231427+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.231427+0000","last_undegraded":"2023-08-09T12:42:36.231427+0000","last_fullsized":"2023-08-09T12:42:36.231427+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.234724+0000","last_change":"2023-08-09T12:42:36.234581+0000","last_active":"2023-08-09T12:42:36.234724+0000","last_peered":"2023-08-09T12:42:36.234724+0000","last_clean":"2023-08-09T12:42:36.234724+0000","last_became_active":"2023-08-09T12:42:36.233897+0000","last_became_peered":"2023-08-09T12:42:36.233897+0000","last_unstale":"2023-08-09T12:42:36.234724+0000","last_undegraded":"2023-08-09T12:42:36.234724+0000","last_fullsized":"2023-08-09T12:42:36.234724+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:00:33.646433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.239884+0000","last_change":"2023-08-09T12:42:36.239884+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.239884+0000","last_undegraded":"2023-08-09T12:42:36.239884+0000","last_fullsized":"2023-08-09T12:42:36.239884+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240162+0000","last_change":"2023-08-09T12:42:36.238369+0000","last_active":"2023-08-09T12:42:36.240162+0000","last_peered":"2023-08-09T12:42:36.240162+0000","last_clean":"2023-08-09T12:42:36.240162+0000","last_became_active":"2023-08-09T12:42:36.238090+0000","last_became_peered":"2023-08-09T12:42:36.238090+0000","last_unstale":"2023-08-09T12:42:36.240162+0000","last_undegraded":"2023-08-09T12:42:36.240162+0000","last_fullsized":"2023-08-09T12:42:36.240162+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:36:15.175493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.240241+0000","last_change":"2023-08-09T12:42:36.239973+0000","last_active":"2023-08-09T12:42:36.240241+0000","last_peered":"2023-08-09T12:42:36.240241+0000","last_clean":"2023-08-09T12:42:36.240241+0000","last_became_active":"2023-08-09T12:42:36.238975+0000","last_became_peered":"2023-08-09T12:42:36.238975+0000","last_unstale":"2023-08-09T12:42:36.240241+0000","last_undegraded":"2023-08-09T12:42:36.240241+0000","last_fullsized":"2023-08-09T12:42:36.240241+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:03:46.233188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233266+0000","last_change":"2023-08-09T12:42:36.233266+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233266+0000","last_undegraded":"2023-08-09T12:42:36.233266+0000","last_fullsized":"2023-08-09T12:42:36.233266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.212558+0000","last_change":"2023-08-09T12:42:35.212558+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.212558+0000","last_undegraded":"2023-08-09T12:42:35.212558+0000","last_fullsized":"2023-08-09T12:42:35.212558+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229199+0000","last_change":"2023-08-09T12:42:36.229199+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229199+0000","last_undegraded":"2023-08-09T12:42:36.229199+0000","last_fullsized":"2023-08-09T12:42:36.229199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246442+0000","last_change":"2023-08-09T12:42:36.246012+0000","last_active":"2023-08-09T12:42:36.246442+0000","last_peered":"2023-08-09T12:42:36.246442+0000","last_clean":"2023-08-09T12:42:36.246442+0000","last_became_active":"2023-08-09T12:42:36.245659+0000","last_became_peered":"2023-08-09T12:42:36.245659+0000","last_unstale":"2023-08-09T12:42:36.246442+0000","last_undegraded":"2023-08-09T12:42:36.246442+0000","last_fullsized":"2023-08-09T12:42:36.246442+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:10:51.732853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":260,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.222650+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:42:36.222650+0000","last_peered":"2023-08-09T12:42:36.222650+0000","last_clean":"2023-08-09T12:42:36.222650+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:42:36.222650+0000","last_undegraded":"2023-08-09T12:42:36.222650+0000","last_fullsized":"2023-08-09T12:42:36.222650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:15:25.035101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.243970+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:42:36.243970+0000","last_peered":"2023-08-09T12:42:36.243970+0000","last_clean":"2023-08-09T12:42:36.243970+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:42:36.243970+0000","last_undegraded":"2023-08-09T12:42:36.243970+0000","last_fullsized":"2023-08-09T12:42:36.243970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:20:29.691031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:42:36.203423+0000","last_change":"2023-08-09T12:42:36.203423+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.203423+0000","last_undegraded":"2023-08-09T12:42:36.203423+0000","last_fullsized":"2023-08-09T12:42:36.203423+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.214510+0000","last_change":"2023-08-09T12:42:35.214510+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.214510+0000","last_undegraded":"2023-08-09T12:42:35.214510+0000","last_fullsized":"2023-08-09T12:42:35.214510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.222345+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:42:36.222345+0000","last_peered":"2023-08-09T12:42:36.222345+0000","last_clean":"2023-08-09T12:42:36.222345+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:42:36.222345+0000","last_undegraded":"2023-08-09T12:42:36.222345+0000","last_fullsized":"2023-08-09T12:42:36.222345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:35.321214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.234477+0000","last_change":"2023-08-09T12:42:36.234477+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.234477+0000","last_undegraded":"2023-08-09T12:42:36.234477+0000","last_fullsized":"2023-08-09T12:42:36.234477+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249799+0000","last_change":"2023-08-09T12:42:36.249723+0000","last_active":"2023-08-09T12:42:36.249799+0000","last_peered":"2023-08-09T12:42:36.249799+0000","last_clean":"2023-08-09T12:42:36.249799+0000","last_became_active":"2023-08-09T12:42:36.249183+0000","last_became_peered":"2023-08-09T12:42:36.249183+0000","last_unstale":"2023-08-09T12:42:36.249799+0000","last_undegraded":"2023-08-09T12:42:36.249799+0000","last_fullsized":"2023-08-09T12:42:36.249799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:40.200707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.233668+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:42:36.233668+0000","last_peered":"2023-08-09T12:42:36.233668+0000","last_clean":"2023-08-09T12:42:36.233668+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:42:36.233668+0000","last_undegraded":"2023-08-09T12:42:36.233668+0000","last_fullsized":"2023-08-09T12:42:36.233668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:55.412940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.232152+0000","last_change":"2023-08-09T12:42:36.232152+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.232152+0000","last_undegraded":"2023-08-09T12:42:36.232152+0000","last_fullsized":"2023-08-09T12:42:36.232152+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-08-09T12:42:35.215465+0000","last_change":"2023-08-09T12:42:35.215465+0000","last_active":"2023-08-09T12:42:35.189682+0000","last_peered":"2023-08-09T12:42:35.189682+0000","last_clean":"2023-08-09T12:42:35.189682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:35.215465+0000","last_undegraded":"2023-08-09T12:42:35.215465+0000","last_fullsized":"2023-08-09T12:42:35.215465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.238910+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:42:36.238910+0000","last_peered":"2023-08-09T12:42:36.238910+0000","last_clean":"2023-08-09T12:42:36.238910+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:42:36.238910+0000","last_undegraded":"2023-08-09T12:42:36.238910+0000","last_fullsized":"2023-08-09T12:42:36.238910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:30:45.466626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.229949+0000","last_change":"2023-08-09T12:42:36.229949+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.229949+0000","last_undegraded":"2023-08-09T12:42:36.229949+0000","last_fullsized":"2023-08-09T12:42:36.229949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249949+0000","last_change":"2023-08-09T12:42:36.249872+0000","last_active":"2023-08-09T12:42:36.249949+0000","last_peered":"2023-08-09T12:42:36.249949+0000","last_clean":"2023-08-09T12:42:36.249949+0000","last_became_active":"2023-08-09T12:42:36.249491+0000","last_became_peered":"2023-08-09T12:42:36.249491+0000","last_unstale":"2023-08-09T12:42:36.249949+0000","last_undegraded":"2023-08-09T12:42:36.249949+0000","last_fullsized":"2023-08-09T12:42:36.249949+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:40:17.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-09T12:42:35.213994+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:42:35.213994+0000","last_peered":"2023-08-09T12:42:35.213994+0000","last_clean":"2023-08-09T12:42:35.213994+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:42:35.213994+0000","last_undegraded":"2023-08-09T12:42:35.213994+0000","last_fullsized":"2023-08-09T12:42:35.213994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:47:28.619991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.228264+0000","last_change":"2023-08-09T12:42:36.228264+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.228264+0000","last_undegraded":"2023-08-09T12:42:36.228264+0000","last_fullsized":"2023-08-09T12:42:36.228264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.246647+0000","last_change":"2023-08-09T12:42:36.246540+0000","last_active":"2023-08-09T12:42:36.246647+0000","last_peered":"2023-08-09T12:42:36.246647+0000","last_clean":"2023-08-09T12:42:36.246647+0000","last_became_active":"2023-08-09T12:42:36.246233+0000","last_became_peered":"2023-08-09T12:42:36.246233+0000","last_unstale":"2023-08-09T12:42:36.246647+0000","last_undegraded":"2023-08-09T12:42:36.246647+0000","last_fullsized":"2023-08-09T12:42:36.246647+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:20:58.738101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.221992+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:42:36.221992+0000","last_peered":"2023-08-09T12:42:36.221992+0000","last_clean":"2023-08-09T12:42:36.221992+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:42:36.221992+0000","last_undegraded":"2023-08-09T12:42:36.221992+0000","last_fullsized":"2023-08-09T12:42:36.221992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:34:28.408185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.236655+0000","last_change":"2023-08-09T12:42:36.236655+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.236655+0000","last_undegraded":"2023-08-09T12:42:36.236655+0000","last_fullsized":"2023-08-09T12:42:36.236655+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249356+0000","last_change":"2023-08-09T12:42:36.248225+0000","last_active":"2023-08-09T12:42:36.249356+0000","last_peered":"2023-08-09T12:42:36.249356+0000","last_clean":"2023-08-09T12:42:36.249356+0000","last_became_active":"2023-08-09T12:42:36.245387+0000","last_became_peered":"2023-08-09T12:42:36.245387+0000","last_unstale":"2023-08-09T12:42:36.249356+0000","last_undegraded":"2023-08-09T12:42:36.249356+0000","last_fullsized":"2023-08-09T12:42:36.249356+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:02:04.640277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-09T12:42:35.213485+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:42:35.213485+0000","last_peered":"2023-08-09T12:42:35.213485+0000","last_clean":"2023-08-09T12:42:35.213485+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:42:35.213485+0000","last_undegraded":"2023-08-09T12:42:35.213485+0000","last_fullsized":"2023-08-09T12:42:35.213485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:43.831281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2023-08-09T12:42:36.233661+0000","last_change":"2023-08-09T12:42:36.233661+0000","last_active":"2023-08-09T12:42:36.203423+0000","last_peered":"2023-08-09T12:42:36.203423+0000","last_clean":"2023-08-09T12:42:36.203423+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:42:36.233661+0000","last_undegraded":"2023-08-09T12:42:36.233661+0000","last_fullsized":"2023-08-09T12:42:36.233661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.249902+0000","last_change":"2023-08-09T12:42:36.249795+0000","last_active":"2023-08-09T12:42:36.249902+0000","last_peered":"2023-08-09T12:42:36.249902+0000","last_clean":"2023-08-09T12:42:36.249902+0000","last_became_active":"2023-08-09T12:42:36.248860+0000","last_became_peered":"2023-08-09T12:42:36.248860+0000","last_unstale":"2023-08-09T12:42:36.249902+0000","last_undegraded":"2023-08-09T12:42:36.249902+0000","last_fullsized":"2023-08-09T12:42:36.249902+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:59.821983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-09T12:42:36.238524+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:42:36.238524+0000","last_peered":"2023-08-09T12:42:36.238524+0000","last_clean":"2023-08-09T12:42:36.238524+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:42:36.238524+0000","last_undegraded":"2023-08-09T12:42:36.238524+0000","last_fullsized":"2023-08-09T12:42:36.238524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:17:29.607908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.619,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0940000000000001,"15min":1.0660000000000001},"min":{"1min":0.70799999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.601,"5min":1.843,"15min":1.843},"last":1.01}]},{"osd":1,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1180000000000001,"15min":1.0860000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.708,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.361},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7030000000000001,"5min":1.734,"15min":1.734},"last":1.4259999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.1739999999999999,"15min":1.1399999999999999},"min":{"1min":0.85299999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.625,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.167,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.637,"5min":2.173,"15min":2.173},"last":0.878}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2210000000000001,"15min":1.212},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5860000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.2689999999999999,"15min":1.2490000000000001},"min":{"1min":0.91600000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":1.589}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.224,"15min":1.1990000000000001},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.5509999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.206},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.274,"15min":1.2470000000000001},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.615,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.264}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3140000000000001,"15min":1.2689999999999999},"min":{"1min":0.751,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7849999999999999,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4790000000000001,"15min":1.4750000000000001},"min":{"1min":0.90100000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5980000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.393}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4710000000000001,"15min":1.464},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.788,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.83699999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.6779999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.48}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.1120000000000001},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5449999999999999,"5min":2.54,"15min":2.54},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0760000000000001,"15min":1.0549999999999999},"min":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0740000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.246,"15min":1.228},"min":{"1min":0.874,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7210000000000001,"5min":2.306,"15min":2.306},"last":1.278},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3280000000000001,"15min":1.3109999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.671,"5min":1.829,"15min":1.829},"last":1.4099999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.093,"15min":1.0820000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4490000000000001,"5min":1.554,"15min":1.554},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2809999999999999,"15min":1.2649999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.923,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.5389999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":0.86799999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7150000000000001,"5min":2.004,"15min":2.004},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.27},"min":{"1min":0.84599999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6579999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.4830000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.319,"15min":1.2889999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0590000000000002,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.353,"15min":1.325},"min":{"1min":1.056,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1059999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.631}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.327,"15min":1.3089999999999999},"min":{"1min":1.022,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.8240000000000001,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.496,"15min":1.462},"min":{"1min":1.1830000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.4350000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.6719999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.4570000000000001,"15min":1.393},"min":{"1min":1.145,"5min":0.752,"15min":0.752},"max":{"1min":2.2610000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.446,"15min":1.3999999999999999},"min":{"1min":1.0509999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.161,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.7609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1120000000000001,"15min":1.1100000000000001},"min":{"1min":0.67600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.649,"5min":2.427,"15min":2.427},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.073,"15min":1.0429999999999999},"min":{"1min":0.71699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.575,"5min":1.851,"15min":1.851},"last":0.999}]},{"osd":1,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2909999999999999,"15min":1.276},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.766,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2569999999999999,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.75600000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.88500000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.554},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.95299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.5449999999999999,"5min":1.728,"15min":1.728},"last":1.2250000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2030000000000001,"15min":1.177},"min":{"1min":0.86499999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.373},"min":{"1min":0.879,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7050000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.304}]},{"osd":4,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.228,"15min":1.224},"min":{"1min":0.85899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.94099999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.7450000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.3620000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.339,"15min":1.3280000000000001},"min":{"1min":0.96699999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.804,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.468},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.458,"15min":1.5},"min":{"1min":1.0920000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.8029999999999999,"5min":2.948,"15min":2.948},"last":1.5}]},{"osd":7,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":1.111,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7969999999999999,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5089999999999999,"15min":1.504},"min":{"1min":1.1060000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.6080000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.0940000000000001,"15min":1.071},"min":{"1min":0.81999999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6439999999999999,"5min":1.77,"15min":1.77},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.103,"15min":1.081},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.1559999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3069999999999999,"15min":1.355},"min":{"1min":0.83199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.897,"5min":1.97,"15min":1.97},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.335,"15min":1.3400000000000001},"min":{"1min":0.95699999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6359999999999999,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":2.2040000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.3140000000000001,"15min":1.321},"min":{"1min":0.88100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5329999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.325,"15min":1.3129999999999999},"min":{"1min":0.90200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7270000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.929}]},{"osd":3,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.204},"min":{"1min":0.79200000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.337},"min":{"1min":0.97899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.091}]},{"osd":5,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3819999999999999,"15min":1.4039999999999999},"min":{"1min":0.92500000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.853,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.482},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.371,"15min":1.379},"min":{"1min":0.98799999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.556}]},{"osd":6,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4610000000000001,"15min":1.5069999999999999},"min":{"1min":0.93200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.554,"5min":1.5369999999999999,"15min":1.5429999999999999},"min":{"1min":1.278,"5min":0.755,"15min":0.755},"max":{"1min":1.9570000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":2.036}]},{"osd":7,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.518,"15min":1.5169999999999999},"min":{"1min":1.085,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.605,"15min":1.637},"min":{"1min":1.1319999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.839}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.82599999999999996},"min":{"1min":0.44400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.4109999999999996,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.03,"5min":0.89200000000000002,"15min":0.86399999999999999},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3049999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.159,"5min":0.93700000000000006,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.373,"15min":0.373},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.2490000000000001,"15min":1.0900000000000001},"min":{"1min":0.47299999999999998,"5min":0.433,"15min":0.433},"max":{"1min":18.145,"5min":18.145,"15min":18.145},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.222,"5min":1.1759999999999999,"15min":1.1910000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.7050000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.95399999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.972,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.874},{"interface":"front","average":{"1min":1.456,"5min":1.337,"15min":1.345},"min":{"1min":0.751,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.5960000000000001,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.014}]},{"osd":5,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.4769999999999999,"5min":1.5740000000000001,"15min":1.4430000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":18.094000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":2.181,"5min":1.446,"15min":1.3120000000000001},"min":{"1min":0.96099999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":14.105,"5min":14.105,"15min":14.105},"last":0.83499999999999996}]},{"osd":6,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.357,"15min":1.335},"min":{"1min":0.99399999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":0.93999999999999995}]},{"osd":7,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3740000000000001,"15min":1.3720000000000001},"min":{"1min":1.0740000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.806,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.3859999999999999,"15min":1.365},"min":{"1min":1.008,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.1459999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194953,"statfs":{"total":200000000,"available":199632705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4570000000000001,"5min":1.716,"15min":1.716},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.46700000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4830000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.80300000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.504,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1339999999999999,"5min":1.466,"15min":1.466},"last":0.873},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.024,"15min":1.05},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6200000000000001,"5min":1.869,"15min":1.869},"last":1.3899999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.73899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5489999999999999,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1419999999999999,"15min":1.143},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.5589999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.399,"15min":1.403},"min":{"1min":0.93200000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.897,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.296,"15min":1.26},"min":{"1min":0.90600000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.819,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.4950000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.381,"15min":1.347},"min":{"1min":1.0580000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0539999999999998,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.333},{"interface":"front","average":{"1min":1.407,"5min":1.484,"15min":1.482},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.804,"5min":4.806,"15min":4.806},"last":1.829}]},{"osd":6,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3049999999999999,"15min":1.29},"min":{"1min":0.83999999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.744,"5min":2.323,"15min":2.323},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":1.0620000000000001,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9319999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.613}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.353,"15min":1.3480000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6759999999999999,"5min":2.218,"15min":2.218},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5209999999999999,"15min":1.5229999999999999},"min":{"1min":1.032,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.1949999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.7709999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":352,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194960,"statfs":{"total":200000000,"available":199639325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89400000000000002},"min":{"1min":0.64400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.873},{"interface":"front","average":{"1min":6.1859999999999999,"5min":1.917,"15min":1.2090000000000001},"min":{"1min":0.47799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":88.254999999999995,"5min":88.254999999999995,"15min":88.254999999999995},"last":1.3500000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.96399999999999997,"15min":0.92800000000000005},"min":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.022},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.127,"15min":1.087},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.1859999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.369,"5min":1,"15min":0.91600000000000004},"min":{"1min":0.53900000000000003,"5min":0.503,"15min":0.503},"max":{"1min":5.4320000000000004,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.4850000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":1.4810000000000001,"15min":1.268},"min":{"1min":0.93899999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":25.172000000000001,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.268},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.2869999999999999,"15min":1.2709999999999999},"min":{"1min":1.0289999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.3140000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.96,"5min":1.6000000000000001,"15min":1.3759999999999999},"min":{"1min":0.90700000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":28.710000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3,"15min":1.258},"min":{"1min":0.91600000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.417}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.4510000000000001,"15min":1.399},"min":{"1min":1.0860000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":6.0460000000000003,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.748},{"interface":"front","average":{"1min":1.423,"5min":1.3700000000000001,"15min":1.347},"min":{"1min":0.91300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.863,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.639}]},{"osd":7,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":3.0259999999999998,"5min":1.768,"15min":1.5549999999999999},"min":{"1min":0.98699999999999999,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":26.975999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.546},{"interface":"front","average":{"1min":3.1640000000000001,"5min":1.7629999999999999,"15min":1.53},"min":{"1min":1.052,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":28.765000000000001,"5min":28.765000000000001,"15min":28.765000000000001},"last":2.2200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194383,"statfs":{"total":200000000,"available":199048957,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.50900000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":0.98599999999999999,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":6.1749999999999998,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.89400000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.95099999999999996,"15min":0.93700000000000006},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.657,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.101},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.0629999999999999,"15min":1.0049999999999999},"min":{"1min":0.59899999999999998,"5min":0.5,"15min":0.5},"max":{"1min":6.2549999999999999,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":1.252}]},{"osd":3,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":0.98399999999999999,"15min":0.91200000000000003},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1679999999999999,"15min":1.1659999999999999},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6000000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.83699999999999997}]},{"osd":4,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.3660000000000001,"15min":1.3300000000000001},"min":{"1min":0.96299999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":9.9629999999999992,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.288,"15min":1.264},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.4199999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.3420000000000001,"15min":1.29},"min":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":10.004,"5min":10.004,"15min":10.004},"last":1.159},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.369,"15min":1.365},"min":{"1min":0.87,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.909,"5min":2.161,"15min":2.161},"last":1.526}]},{"osd":6,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.377,"15min":1.3220000000000001},"min":{"1min":0.83699999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.4290000000000003,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.881,"5min":1.472,"15min":1.415},"min":{"1min":1.093,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":9.9190000000000005,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.337}]},{"osd":7,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":1.552,"15min":1.4199999999999999},"min":{"1min":0.89300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":18.114000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.897,"5min":1.4930000000000001,"15min":1.4390000000000001},"min":{"1min":1.052,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":9.5640000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.5649999999999999}]}]}],"pool_statfs":[]}} 2023-08-09T12:42:42.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:42:42.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.941+0000 7f5439e0d640 1 Processor -- start 2023-08-09T12:42:42.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.941+0000 7f5439e0d640 1 -- start start 2023-08-09T12:42:42.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.943+0000 7f5439e0d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5434161280 0x7f54340c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.943+0000 7f5439e0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54340acfc0 0x7f54340cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.943+0000 7f5439e0d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543415df30 con 0x7f5434161660 2023-08-09T12:42:42.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.943+0000 7f5439e0d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543415d430 con 0x7f5434161280 2023-08-09T12:42:42.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.943+0000 7f5439e0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54340ca9d0 con 0x7f54340acfc0 2023-08-09T12:42:42.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.944+0000 7f5433fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54340acfc0 0x7f54340cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.944+0000 7f5433fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54340acfc0 0x7f54340cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:43064/0 (socket says 172.21.15.17:43064) 2023-08-09T12:42:42.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.944+0000 7f5433fff640 1 -- 172.21.15.17:0/1095687048 learned_addr learned my addr 172.21.15.17:0/1095687048 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:42.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.944+0000 7f54337fe640 1 --2- 172.21.15.17:0/1095687048 >> v2:172.21.15.142:3300/0 conn(0x7f5434161280 0x7f54340c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.945+0000 7f5433fff640 1 -- 172.21.15.17:0/1095687048 >> v2:172.21.15.142:3300/0 conn(0x7f5434161280 msgr2=0x7f54340c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:42.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.945+0000 7f5433fff640 1 --2- 172.21.15.17:0/1095687048 >> v2:172.21.15.142:3300/0 conn(0x7f5434161280 0x7f54340c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.945+0000 7f5433fff640 1 -- 172.21.15.17:0/1095687048 >> v1:172.21.15.142:6789/0 conn(0x7f5434161660 legacy=0x7f54340ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.945+0000 7f5433fff640 1 -- 172.21.15.17:0/1095687048 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543415e3c0 con 0x7f54340acfc0 2023-08-09T12:42:42.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.947+0000 7f5433fff640 1 --2- 172.21.15.17:0/1095687048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54340acfc0 0x7f54340cc630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f542c009e50 tx=0x7f542c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2312b112b6bb00 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:42.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.947+0000 7f54327fc640 1 -- 172.21.15.17:0/1095687048 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c02ca70 con 0x7f54340acfc0 2023-08-09T12:42:42.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.947+0000 7f54327fc640 1 -- 172.21.15.17:0/1095687048 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c02cbd0 con 0x7f54340acfc0 2023-08-09T12:42:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.947+0000 7f54327fc640 1 -- 172.21.15.17:0/1095687048 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c0343f0 con 0x7f54340acfc0 2023-08-09T12:42:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.948+0000 7f5439e0d640 1 -- 172.21.15.17:0/1095687048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54340acfc0 msgr2=0x7f54340cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.948+0000 7f5439e0d640 1 --2- 172.21.15.17:0/1095687048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54340acfc0 0x7f54340cc630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f542c009e50 tx=0x7f542c02bed0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.948+0000 7f5439e0d640 1 -- 172.21.15.17:0/1095687048 shutdown_connections 2023-08-09T12:42:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.948+0000 7f5439e0d640 1 --2- 172.21.15.17:0/1095687048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54340acfc0 0x7f54340cc630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.948+0000 7f5439e0d640 1 --2- 172.21.15.17:0/1095687048 >> v2:172.21.15.142:3300/0 conn(0x7f5434161280 0x7f54340c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.948+0000 7f5439e0d640 1 -- 172.21.15.17:0/1095687048 >> 172.21.15.17:0/1095687048 conn(0x7f54340cb1b0 msgr2=0x7f54340cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.948+0000 7f5439e0d640 1 -- 172.21.15.17:0/1095687048 shutdown_connections 2023-08-09T12:42:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.948+0000 7f5439e0d640 1 -- 172.21.15.17:0/1095687048 wait complete. 2023-08-09T12:42:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.950+0000 7f5439e0d640 1 Processor -- start 2023-08-09T12:42:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.950+0000 7f5439e0d640 1 -- start start 2023-08-09T12:42:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f5439e0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54340acfc0 0x7f5434150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f5439e0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5434161280 0x7f54340b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f5439e0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5434161660 0x7f5434154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f5439e0d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54341511c0 con 0x7f54340acfc0 2023-08-09T12:42:42.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f5439e0d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54340c3650 con 0x7f5434161660 2023-08-09T12:42:42.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f5439e0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54340c3930 con 0x7f5434161280 2023-08-09T12:42:42.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f54337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54340acfc0 0x7f5434150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f54337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54340acfc0 0x7f5434150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39158/0 (socket says 172.21.15.17:39158) 2023-08-09T12:42:42.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.951+0000 7f54337fe640 1 -- 172.21.15.17:0/848970952 learned_addr learned my addr 172.21.15.17:0/848970952 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f5432ffd640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5434161280 0x7f54340b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f54337fe640 1 -- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5434161280 msgr2=0x7f54340b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f54337fe640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5434161280 0x7f54340b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f54337fe640 1 -- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5434161660 msgr2=0x7f5434154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f54337fe640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5434161660 0x7f5434154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f54337fe640 1 -- 172.21.15.17:0/848970952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c009b30 con 0x7f54340acfc0 2023-08-09T12:42:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f5432ffd640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5434161280 0x7f54340b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f54337fe640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54340acfc0 0x7f5434150c80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f542400e870 tx=0x7f542400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f541bfff640 1 -- 172.21.15.17:0/848970952 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240094f0 con 0x7f54340acfc0 2023-08-09T12:42:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.952+0000 7f541bfff640 1 -- 172.21.15.17:0/848970952 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542400c940 con 0x7f54340acfc0 2023-08-09T12:42:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.953+0000 7f541bfff640 1 -- 172.21.15.17:0/848970952 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542400ccf0 con 0x7f54340acfc0 2023-08-09T12:42:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.953+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54340c3c10 con 0x7f54340acfc0 2023-08-09T12:42:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.953+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54340c41d0 con 0x7f54340acfc0 2023-08-09T12:42:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.954+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5434067a80 con 0x7f54340acfc0 2023-08-09T12:42:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.955+0000 7f541bfff640 1 -- 172.21.15.17:0/848970952 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5424013470 con 0x7f54340acfc0 2023-08-09T12:42:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.955+0000 7f541bfff640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f542006a050 0x7f542006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.956+0000 7f541bfff640 1 -- 172.21.15.17:0/848970952 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5424088650 con 0x7f54340acfc0 2023-08-09T12:42:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.956+0000 7f5432ffd640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f542006a050 0x7f542006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:42.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.957+0000 7f5432ffd640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f542006a050 0x7f542006c510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f543415cf90 tx=0x7f5428009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:42.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:42.960+0000 7f541bfff640 1 -- 172.21.15.17:0/848970952 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5424053d30 con 0x7f54340acfc0 2023-08-09T12:42:43.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.141+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f543415d8e0 con 0x7f542006a050 2023-08-09T12:42:43.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.164+0000 7f541bfff640 1 -- 172.21.15.17:0/848970952 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302794 (secure 0 0 0) 0x7f5428001d00 con 0x7f542006a050 2023-08-09T12:42:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:43.172 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:42:43.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f542006a050 msgr2=0x7f542006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f542006a050 0x7f542006c510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f543415cf90 tx=0x7f5428009040 comp rx=0 tx=0).stop 2023-08-09T12:42:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54340acfc0 msgr2=0x7f5434150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54340acfc0 0x7f5434150c80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f542400e870 tx=0x7f542400ed30 comp rx=0 tx=0).stop 2023-08-09T12:42:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 shutdown_connections 2023-08-09T12:42:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f542006a050 0x7f542006c510 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5434161660 0x7f5434154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5434161280 0x7f54340b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 --2- 172.21.15.17:0/848970952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54340acfc0 0x7f5434150c80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 >> 172.21.15.17:0/848970952 conn(0x7f54340cb1b0 msgr2=0x7f54340cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 shutdown_connections 2023-08-09T12:42:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.170+0000 7f5439e0d640 1 -- 172.21.15.17:0/848970952 wait complete. 2023-08-09T12:42:43.191 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-08-09T12:42:42.707784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558365,"statfs":{"total":1600000000,"available":1595765836,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.481897"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231498+0000","last_change":"2023-08-09T12:42:37.257690+0000","last_active":"2023-08-09T12:42:38.231498+0000","last_peered":"2023-08-09T12:42:38.231498+0000","last_clean":"2023-08-09T12:42:38.231498+0000","last_became_active":"2023-08-09T12:42:37.257349+0000","last_became_peered":"2023-08-09T12:42:37.257349+0000","last_unstale":"2023-08-09T12:42:38.231498+0000","last_undegraded":"2023-08-09T12:42:38.231498+0000","last_fullsized":"2023-08-09T12:42:38.231498+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231473+0000","last_change":"2023-08-09T12:42:37.244290+0000","last_active":"2023-08-09T12:42:38.231473+0000","last_peered":"2023-08-09T12:42:38.231473+0000","last_clean":"2023-08-09T12:42:38.231473+0000","last_became_active":"2023-08-09T12:42:37.243902+0000","last_became_peered":"2023-08-09T12:42:37.243902+0000","last_unstale":"2023-08-09T12:42:38.231473+0000","last_undegraded":"2023-08-09T12:42:38.231473+0000","last_fullsized":"2023-08-09T12:42:38.231473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:26.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229660+0000","last_change":"2023-08-09T12:42:37.255754+0000","last_active":"2023-08-09T12:42:38.229660+0000","last_peered":"2023-08-09T12:42:38.229660+0000","last_clean":"2023-08-09T12:42:38.229660+0000","last_became_active":"2023-08-09T12:42:37.252509+0000","last_became_peered":"2023-08-09T12:42:37.252509+0000","last_unstale":"2023-08-09T12:42:38.229660+0000","last_undegraded":"2023-08-09T12:42:38.229660+0000","last_fullsized":"2023-08-09T12:42:38.229660+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:27:16.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233149+0000","last_change":"2023-08-09T12:42:37.262202+0000","last_active":"2023-08-09T12:42:38.233149+0000","last_peered":"2023-08-09T12:42:38.233149+0000","last_clean":"2023-08-09T12:42:38.233149+0000","last_became_active":"2023-08-09T12:42:37.259309+0000","last_became_peered":"2023-08-09T12:42:37.259309+0000","last_unstale":"2023-08-09T12:42:38.233149+0000","last_undegraded":"2023-08-09T12:42:38.233149+0000","last_fullsized":"2023-08-09T12:42:38.233149+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:08:52.077433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256898+0000","last_change":"2023-08-09T12:42:37.263229+0000","last_active":"2023-08-09T12:42:38.256898+0000","last_peered":"2023-08-09T12:42:38.256898+0000","last_clean":"2023-08-09T12:42:38.256898+0000","last_became_active":"2023-08-09T12:42:37.262833+0000","last_became_peered":"2023-08-09T12:42:37.262833+0000","last_unstale":"2023-08-09T12:42:38.256898+0000","last_undegraded":"2023-08-09T12:42:38.256898+0000","last_fullsized":"2023-08-09T12:42:38.256898+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:11:43.623157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254678+0000","last_change":"2023-08-09T12:42:37.252942+0000","last_active":"2023-08-09T12:42:38.254678+0000","last_peered":"2023-08-09T12:42:38.254678+0000","last_clean":"2023-08-09T12:42:38.254678+0000","last_became_active":"2023-08-09T12:42:37.252758+0000","last_became_peered":"2023-08-09T12:42:37.252758+0000","last_unstale":"2023-08-09T12:42:38.254678+0000","last_undegraded":"2023-08-09T12:42:38.254678+0000","last_fullsized":"2023-08-09T12:42:38.254678+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:26.801124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253758+0000","last_change":"2023-08-09T12:42:37.249929+0000","last_active":"2023-08-09T12:42:38.253758+0000","last_peered":"2023-08-09T12:42:38.253758+0000","last_clean":"2023-08-09T12:42:38.253758+0000","last_became_active":"2023-08-09T12:42:37.249679+0000","last_became_peered":"2023-08-09T12:42:37.249679+0000","last_unstale":"2023-08-09T12:42:38.253758+0000","last_undegraded":"2023-08-09T12:42:38.253758+0000","last_fullsized":"2023-08-09T12:42:38.253758+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:46:50.211162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254268+0000","last_change":"2023-08-09T12:42:37.255116+0000","last_active":"2023-08-09T12:42:38.254268+0000","last_peered":"2023-08-09T12:42:38.254268+0000","last_clean":"2023-08-09T12:42:38.254268+0000","last_became_active":"2023-08-09T12:42:37.254523+0000","last_became_peered":"2023-08-09T12:42:37.254523+0000","last_unstale":"2023-08-09T12:42:38.254268+0000","last_undegraded":"2023-08-09T12:42:38.254268+0000","last_fullsized":"2023-08-09T12:42:38.254268+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:23.535166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228334+0000","last_change":"2023-08-09T12:42:37.261563+0000","last_active":"2023-08-09T12:42:38.228334+0000","last_peered":"2023-08-09T12:42:38.228334+0000","last_clean":"2023-08-09T12:42:38.228334+0000","last_became_active":"2023-08-09T12:42:37.260798+0000","last_became_peered":"2023-08-09T12:42:37.260798+0000","last_unstale":"2023-08-09T12:42:38.228334+0000","last_undegraded":"2023-08-09T12:42:38.228334+0000","last_fullsized":"2023-08-09T12:42:38.228334+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:52:40.793910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229128+0000","last_change":"2023-08-09T12:42:37.251847+0000","last_active":"2023-08-09T12:42:38.229128+0000","last_peered":"2023-08-09T12:42:38.229128+0000","last_clean":"2023-08-09T12:42:38.229128+0000","last_became_active":"2023-08-09T12:42:37.251188+0000","last_became_peered":"2023-08-09T12:42:37.251188+0000","last_unstale":"2023-08-09T12:42:38.229128+0000","last_undegraded":"2023-08-09T12:42:38.229128+0000","last_fullsized":"2023-08-09T12:42:38.229128+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:24.349252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233723+0000","last_change":"2023-08-09T12:42:37.265000+0000","last_active":"2023-08-09T12:42:38.233723+0000","last_peered":"2023-08-09T12:42:38.233723+0000","last_clean":"2023-08-09T12:42:38.233723+0000","last_became_active":"2023-08-09T12:42:37.264693+0000","last_became_peered":"2023-08-09T12:42:37.264693+0000","last_unstale":"2023-08-09T12:42:38.233723+0000","last_undegraded":"2023-08-09T12:42:38.233723+0000","last_fullsized":"2023-08-09T12:42:38.233723+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:24.809472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254607+0000","last_change":"2023-08-09T12:42:37.256388+0000","last_active":"2023-08-09T12:42:38.254607+0000","last_peered":"2023-08-09T12:42:38.254607+0000","last_clean":"2023-08-09T12:42:38.254607+0000","last_became_active":"2023-08-09T12:42:37.255695+0000","last_became_peered":"2023-08-09T12:42:37.255695+0000","last_unstale":"2023-08-09T12:42:38.254607+0000","last_undegraded":"2023-08-09T12:42:38.254607+0000","last_fullsized":"2023-08-09T12:42:38.254607+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254807+0000","last_change":"2023-08-09T12:42:37.266385+0000","last_active":"2023-08-09T12:42:38.254807+0000","last_peered":"2023-08-09T12:42:38.254807+0000","last_clean":"2023-08-09T12:42:38.254807+0000","last_became_active":"2023-08-09T12:42:37.266135+0000","last_became_peered":"2023-08-09T12:42:37.266135+0000","last_unstale":"2023-08-09T12:42:38.254807+0000","last_undegraded":"2023-08-09T12:42:38.254807+0000","last_fullsized":"2023-08-09T12:42:38.254807+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:16.980624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228698+0000","last_change":"2023-08-09T12:42:37.254661+0000","last_active":"2023-08-09T12:42:38.228698+0000","last_peered":"2023-08-09T12:42:38.228698+0000","last_clean":"2023-08-09T12:42:38.228698+0000","last_became_active":"2023-08-09T12:42:37.253898+0000","last_became_peered":"2023-08-09T12:42:37.253898+0000","last_unstale":"2023-08-09T12:42:38.228698+0000","last_undegraded":"2023-08-09T12:42:38.228698+0000","last_fullsized":"2023-08-09T12:42:38.228698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:42:36.577077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229793+0000","last_change":"2023-08-09T12:42:37.251997+0000","last_active":"2023-08-09T12:42:38.229793+0000","last_peered":"2023-08-09T12:42:38.229793+0000","last_clean":"2023-08-09T12:42:38.229793+0000","last_became_active":"2023-08-09T12:42:37.251539+0000","last_became_peered":"2023-08-09T12:42:37.251539+0000","last_unstale":"2023-08-09T12:42:38.229793+0000","last_undegraded":"2023-08-09T12:42:38.229793+0000","last_fullsized":"2023-08-09T12:42:38.229793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:58:06.404500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254145+0000","last_change":"2023-08-09T12:42:37.254562+0000","last_active":"2023-08-09T12:42:38.254145+0000","last_peered":"2023-08-09T12:42:38.254145+0000","last_clean":"2023-08-09T12:42:38.254145+0000","last_became_active":"2023-08-09T12:42:37.254071+0000","last_became_peered":"2023-08-09T12:42:37.254071+0000","last_unstale":"2023-08-09T12:42:38.254145+0000","last_undegraded":"2023-08-09T12:42:38.254145+0000","last_fullsized":"2023-08-09T12:42:38.254145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:18:55.787676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231237+0000","last_change":"2023-08-09T12:42:37.261069+0000","last_active":"2023-08-09T12:42:38.231237+0000","last_peered":"2023-08-09T12:42:38.231237+0000","last_clean":"2023-08-09T12:42:38.231237+0000","last_became_active":"2023-08-09T12:42:37.260489+0000","last_became_peered":"2023-08-09T12:42:37.260489+0000","last_unstale":"2023-08-09T12:42:38.231237+0000","last_undegraded":"2023-08-09T12:42:38.231237+0000","last_fullsized":"2023-08-09T12:42:38.231237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.232630+0000","last_change":"2023-08-09T12:42:37.265525+0000","last_active":"2023-08-09T12:42:38.232630+0000","last_peered":"2023-08-09T12:42:38.232630+0000","last_clean":"2023-08-09T12:42:38.232630+0000","last_became_active":"2023-08-09T12:42:37.263159+0000","last_became_peered":"2023-08-09T12:42:37.263159+0000","last_unstale":"2023-08-09T12:42:38.232630+0000","last_undegraded":"2023-08-09T12:42:38.232630+0000","last_fullsized":"2023-08-09T12:42:38.232630+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:06:44.414616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254890+0000","last_change":"2023-08-09T12:42:37.237052+0000","last_active":"2023-08-09T12:42:38.254890+0000","last_peered":"2023-08-09T12:42:38.254890+0000","last_clean":"2023-08-09T12:42:38.254890+0000","last_became_active":"2023-08-09T12:42:37.235462+0000","last_became_peered":"2023-08-09T12:42:37.235462+0000","last_unstale":"2023-08-09T12:42:38.254890+0000","last_undegraded":"2023-08-09T12:42:38.254890+0000","last_fullsized":"2023-08-09T12:42:38.254890+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:51.561653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256691+0000","last_change":"2023-08-09T12:42:37.235114+0000","last_active":"2023-08-09T12:42:38.256691+0000","last_peered":"2023-08-09T12:42:38.256691+0000","last_clean":"2023-08-09T12:42:38.256691+0000","last_became_active":"2023-08-09T12:42:37.234851+0000","last_became_peered":"2023-08-09T12:42:37.234851+0000","last_unstale":"2023-08-09T12:42:38.256691+0000","last_undegraded":"2023-08-09T12:42:38.256691+0000","last_fullsized":"2023-08-09T12:42:38.256691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:50:54.810271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255004+0000","last_change":"2023-08-09T12:42:37.257315+0000","last_active":"2023-08-09T12:42:38.255004+0000","last_peered":"2023-08-09T12:42:38.255004+0000","last_clean":"2023-08-09T12:42:38.255004+0000","last_became_active":"2023-08-09T12:42:37.256728+0000","last_became_peered":"2023-08-09T12:42:37.256728+0000","last_unstale":"2023-08-09T12:42:38.255004+0000","last_undegraded":"2023-08-09T12:42:38.255004+0000","last_fullsized":"2023-08-09T12:42:38.255004+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:12.688961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255330+0000","last_change":"2023-08-09T12:42:37.252932+0000","last_active":"2023-08-09T12:42:38.255330+0000","last_peered":"2023-08-09T12:42:38.255330+0000","last_clean":"2023-08-09T12:42:38.255330+0000","last_became_active":"2023-08-09T12:42:37.252653+0000","last_became_peered":"2023-08-09T12:42:37.252653+0000","last_unstale":"2023-08-09T12:42:38.255330+0000","last_undegraded":"2023-08-09T12:42:38.255330+0000","last_fullsized":"2023-08-09T12:42:38.255330+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256190+0000","last_change":"2023-08-09T12:42:37.252813+0000","last_active":"2023-08-09T12:42:38.256190+0000","last_peered":"2023-08-09T12:42:38.256190+0000","last_clean":"2023-08-09T12:42:38.256190+0000","last_became_active":"2023-08-09T12:42:37.252548+0000","last_became_peered":"2023-08-09T12:42:37.252548+0000","last_unstale":"2023-08-09T12:42:38.256190+0000","last_undegraded":"2023-08-09T12:42:38.256190+0000","last_fullsized":"2023-08-09T12:42:38.256190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:26.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229098+0000","last_change":"2023-08-09T12:42:37.254862+0000","last_active":"2023-08-09T12:42:38.229098+0000","last_peered":"2023-08-09T12:42:38.229098+0000","last_clean":"2023-08-09T12:42:38.229098+0000","last_became_active":"2023-08-09T12:42:37.254345+0000","last_became_peered":"2023-08-09T12:42:37.254345+0000","last_unstale":"2023-08-09T12:42:38.229098+0000","last_undegraded":"2023-08-09T12:42:38.229098+0000","last_fullsized":"2023-08-09T12:42:38.229098+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:24:35.542487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255836+0000","last_change":"2023-08-09T12:42:37.257761+0000","last_active":"2023-08-09T12:42:38.255836+0000","last_peered":"2023-08-09T12:42:38.255836+0000","last_clean":"2023-08-09T12:42:38.255836+0000","last_became_active":"2023-08-09T12:42:37.256710+0000","last_became_peered":"2023-08-09T12:42:37.256710+0000","last_unstale":"2023-08-09T12:42:38.255836+0000","last_undegraded":"2023-08-09T12:42:38.255836+0000","last_fullsized":"2023-08-09T12:42:38.255836+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:50:54.810271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255369+0000","last_change":"2023-08-09T12:42:37.250443+0000","last_active":"2023-08-09T12:42:38.255369+0000","last_peered":"2023-08-09T12:42:38.255369+0000","last_clean":"2023-08-09T12:42:38.255369+0000","last_became_active":"2023-08-09T12:42:37.250067+0000","last_became_peered":"2023-08-09T12:42:37.250067+0000","last_unstale":"2023-08-09T12:42:38.255369+0000","last_undegraded":"2023-08-09T12:42:38.255369+0000","last_fullsized":"2023-08-09T12:42:38.255369+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233541+0000","last_change":"2023-08-09T12:42:37.262983+0000","last_active":"2023-08-09T12:42:38.233541+0000","last_peered":"2023-08-09T12:42:38.233541+0000","last_clean":"2023-08-09T12:42:38.233541+0000","last_became_active":"2023-08-09T12:42:37.262584+0000","last_became_peered":"2023-08-09T12:42:37.262584+0000","last_unstale":"2023-08-09T12:42:38.233541+0000","last_undegraded":"2023-08-09T12:42:38.233541+0000","last_fullsized":"2023-08-09T12:42:38.233541+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:25.440968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231169+0000","last_change":"2023-08-09T12:42:37.251672+0000","last_active":"2023-08-09T12:42:38.231169+0000","last_peered":"2023-08-09T12:42:38.231169+0000","last_clean":"2023-08-09T12:42:38.231169+0000","last_became_active":"2023-08-09T12:42:37.251006+0000","last_became_peered":"2023-08-09T12:42:37.251006+0000","last_unstale":"2023-08-09T12:42:38.231169+0000","last_undegraded":"2023-08-09T12:42:38.231169+0000","last_fullsized":"2023-08-09T12:42:38.231169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:23.535166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229732+0000","last_change":"2023-08-09T12:42:37.261725+0000","last_active":"2023-08-09T12:42:38.229732+0000","last_peered":"2023-08-09T12:42:38.229732+0000","last_clean":"2023-08-09T12:42:38.229732+0000","last_became_active":"2023-08-09T12:42:37.261351+0000","last_became_peered":"2023-08-09T12:42:37.261351+0000","last_unstale":"2023-08-09T12:42:38.229732+0000","last_undegraded":"2023-08-09T12:42:38.229732+0000","last_fullsized":"2023-08-09T12:42:38.229732+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:27:02.589200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256190+0000","last_change":"2023-08-09T12:42:37.258260+0000","last_active":"2023-08-09T12:42:38.256190+0000","last_peered":"2023-08-09T12:42:38.256190+0000","last_clean":"2023-08-09T12:42:38.256190+0000","last_became_active":"2023-08-09T12:42:37.257476+0000","last_became_peered":"2023-08-09T12:42:37.257476+0000","last_unstale":"2023-08-09T12:42:38.256190+0000","last_undegraded":"2023-08-09T12:42:38.256190+0000","last_fullsized":"2023-08-09T12:42:38.256190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:29:05.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234031+0000","last_change":"2023-08-09T12:42:37.262864+0000","last_active":"2023-08-09T12:42:38.234031+0000","last_peered":"2023-08-09T12:42:38.234031+0000","last_clean":"2023-08-09T12:42:38.234031+0000","last_became_active":"2023-08-09T12:42:37.262462+0000","last_became_peered":"2023-08-09T12:42:37.262462+0000","last_unstale":"2023-08-09T12:42:38.234031+0000","last_undegraded":"2023-08-09T12:42:38.234031+0000","last_fullsized":"2023-08-09T12:42:38.234031+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:55:01.843450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254314+0000","last_change":"2023-08-09T12:42:37.245820+0000","last_active":"2023-08-09T12:42:38.254314+0000","last_peered":"2023-08-09T12:42:38.254314+0000","last_clean":"2023-08-09T12:42:38.254314+0000","last_became_active":"2023-08-09T12:42:37.245517+0000","last_became_peered":"2023-08-09T12:42:37.245517+0000","last_unstale":"2023-08-09T12:42:38.254314+0000","last_undegraded":"2023-08-09T12:42:38.254314+0000","last_fullsized":"2023-08-09T12:42:38.254314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:16:28.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256433+0000","last_change":"2023-08-09T12:42:37.245182+0000","last_active":"2023-08-09T12:42:38.256433+0000","last_peered":"2023-08-09T12:42:38.256433+0000","last_clean":"2023-08-09T12:42:38.256433+0000","last_became_active":"2023-08-09T12:42:37.244705+0000","last_became_peered":"2023-08-09T12:42:37.244705+0000","last_unstale":"2023-08-09T12:42:38.256433+0000","last_undegraded":"2023-08-09T12:42:38.256433+0000","last_fullsized":"2023-08-09T12:42:38.256433+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:46.925490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"69'4","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231421+0000","last_change":"2023-08-09T12:42:36.248006+0000","last_active":"2023-08-09T12:42:38.231421+0000","last_peered":"2023-08-09T12:42:38.231421+0000","last_clean":"2023-08-09T12:42:38.231421+0000","last_became_active":"2023-08-09T12:42:36.247672+0000","last_became_peered":"2023-08-09T12:42:36.247672+0000","last_unstale":"2023-08-09T12:42:38.231421+0000","last_undegraded":"2023-08-09T12:42:38.231421+0000","last_fullsized":"2023-08-09T12:42:38.231421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:11.675220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233322+0000","last_change":"2023-08-09T12:42:37.264456+0000","last_active":"2023-08-09T12:42:38.233322+0000","last_peered":"2023-08-09T12:42:38.233322+0000","last_clean":"2023-08-09T12:42:38.233322+0000","last_became_active":"2023-08-09T12:42:37.263053+0000","last_became_peered":"2023-08-09T12:42:37.263053+0000","last_unstale":"2023-08-09T12:42:38.233322+0000","last_undegraded":"2023-08-09T12:42:38.233322+0000","last_fullsized":"2023-08-09T12:42:38.233322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:34.183173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254777+0000","last_change":"2023-08-09T12:42:36.244595+0000","last_active":"2023-08-09T12:42:38.254777+0000","last_peered":"2023-08-09T12:42:38.254777+0000","last_clean":"2023-08-09T12:42:38.254777+0000","last_became_active":"2023-08-09T12:42:36.244171+0000","last_became_peered":"2023-08-09T12:42:36.244171+0000","last_unstale":"2023-08-09T12:42:38.254777+0000","last_undegraded":"2023-08-09T12:42:38.254777+0000","last_fullsized":"2023-08-09T12:42:38.254777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:54:34.665925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255521+0000","last_change":"2023-08-09T12:42:37.244971+0000","last_active":"2023-08-09T12:42:38.255521+0000","last_peered":"2023-08-09T12:42:38.255521+0000","last_clean":"2023-08-09T12:42:38.255521+0000","last_became_active":"2023-08-09T12:42:37.244585+0000","last_became_peered":"2023-08-09T12:42:37.244585+0000","last_unstale":"2023-08-09T12:42:38.255521+0000","last_undegraded":"2023-08-09T12:42:38.255521+0000","last_fullsized":"2023-08-09T12:42:38.255521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:40:53.261326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255407+0000","last_change":"2023-08-09T12:42:36.247995+0000","last_active":"2023-08-09T12:42:38.255407+0000","last_peered":"2023-08-09T12:42:38.255407+0000","last_clean":"2023-08-09T12:42:38.255407+0000","last_became_active":"2023-08-09T12:42:36.247723+0000","last_became_peered":"2023-08-09T12:42:36.247723+0000","last_unstale":"2023-08-09T12:42:38.255407+0000","last_undegraded":"2023-08-09T12:42:38.255407+0000","last_fullsized":"2023-08-09T12:42:38.255407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:37:45.334556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230002+0000","last_change":"2023-08-09T12:42:37.253969+0000","last_active":"2023-08-09T12:42:38.230002+0000","last_peered":"2023-08-09T12:42:38.230002+0000","last_clean":"2023-08-09T12:42:38.230002+0000","last_became_active":"2023-08-09T12:42:37.251738+0000","last_became_peered":"2023-08-09T12:42:37.251738+0000","last_unstale":"2023-08-09T12:42:38.230002+0000","last_undegraded":"2023-08-09T12:42:38.230002+0000","last_fullsized":"2023-08-09T12:42:38.230002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:46.938046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255118+0000","last_change":"2023-08-09T12:42:36.243673+0000","last_active":"2023-08-09T12:42:38.255118+0000","last_peered":"2023-08-09T12:42:38.255118+0000","last_clean":"2023-08-09T12:42:38.255118+0000","last_became_active":"2023-08-09T12:42:36.242905+0000","last_became_peered":"2023-08-09T12:42:36.242905+0000","last_unstale":"2023-08-09T12:42:38.255118+0000","last_undegraded":"2023-08-09T12:42:38.255118+0000","last_fullsized":"2023-08-09T12:42:38.255118+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:40.755933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256768+0000","last_change":"2023-08-09T12:42:37.243362+0000","last_active":"2023-08-09T12:42:38.256768+0000","last_peered":"2023-08-09T12:42:38.256768+0000","last_clean":"2023-08-09T12:42:38.256768+0000","last_became_active":"2023-08-09T12:42:37.243127+0000","last_became_peered":"2023-08-09T12:42:37.243127+0000","last_unstale":"2023-08-09T12:42:38.256768+0000","last_undegraded":"2023-08-09T12:42:38.256768+0000","last_fullsized":"2023-08-09T12:42:38.256768+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:52:18.975764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255676+0000","last_change":"2023-08-09T12:42:36.249304+0000","last_active":"2023-08-09T12:42:38.255676+0000","last_peered":"2023-08-09T12:42:38.255676+0000","last_clean":"2023-08-09T12:42:38.255676+0000","last_became_active":"2023-08-09T12:42:36.244419+0000","last_became_peered":"2023-08-09T12:42:36.244419+0000","last_unstale":"2023-08-09T12:42:38.255676+0000","last_undegraded":"2023-08-09T12:42:38.255676+0000","last_fullsized":"2023-08-09T12:42:38.255676+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:15.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231164+0000","last_change":"2023-08-09T12:42:37.260175+0000","last_active":"2023-08-09T12:42:38.231164+0000","last_peered":"2023-08-09T12:42:38.231164+0000","last_clean":"2023-08-09T12:42:38.231164+0000","last_became_active":"2023-08-09T12:42:37.259927+0000","last_became_peered":"2023-08-09T12:42:37.259927+0000","last_unstale":"2023-08-09T12:42:38.231164+0000","last_undegraded":"2023-08-09T12:42:38.231164+0000","last_fullsized":"2023-08-09T12:42:38.231164+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:59:21.760170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256550+0000","last_change":"2023-08-09T12:42:36.239590+0000","last_active":"2023-08-09T12:42:38.256550+0000","last_peered":"2023-08-09T12:42:38.256550+0000","last_clean":"2023-08-09T12:42:38.256550+0000","last_became_active":"2023-08-09T12:42:36.238193+0000","last_became_peered":"2023-08-09T12:42:36.238193+0000","last_unstale":"2023-08-09T12:42:38.256550+0000","last_undegraded":"2023-08-09T12:42:38.256550+0000","last_fullsized":"2023-08-09T12:42:38.256550+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:48:53.749361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256573+0000","last_change":"2023-08-09T12:42:37.244814+0000","last_active":"2023-08-09T12:42:38.256573+0000","last_peered":"2023-08-09T12:42:38.256573+0000","last_clean":"2023-08-09T12:42:38.256573+0000","last_became_active":"2023-08-09T12:42:37.243517+0000","last_became_peered":"2023-08-09T12:42:37.243517+0000","last_unstale":"2023-08-09T12:42:38.256573+0000","last_undegraded":"2023-08-09T12:42:38.256573+0000","last_fullsized":"2023-08-09T12:42:38.256573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:09:23.914696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256583+0000","last_change":"2023-08-09T12:42:36.246355+0000","last_active":"2023-08-09T12:42:38.256583+0000","last_peered":"2023-08-09T12:42:38.256583+0000","last_clean":"2023-08-09T12:42:38.256583+0000","last_became_active":"2023-08-09T12:42:36.246037+0000","last_became_peered":"2023-08-09T12:42:36.246037+0000","last_unstale":"2023-08-09T12:42:38.256583+0000","last_undegraded":"2023-08-09T12:42:38.256583+0000","last_fullsized":"2023-08-09T12:42:38.256583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:36.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255505+0000","last_change":"2023-08-09T12:42:37.249061+0000","last_active":"2023-08-09T12:42:38.255505+0000","last_peered":"2023-08-09T12:42:38.255505+0000","last_clean":"2023-08-09T12:42:38.255505+0000","last_became_active":"2023-08-09T12:42:37.248755+0000","last_became_peered":"2023-08-09T12:42:37.248755+0000","last_unstale":"2023-08-09T12:42:38.255505+0000","last_undegraded":"2023-08-09T12:42:38.255505+0000","last_fullsized":"2023-08-09T12:42:38.255505+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:33.891845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257633+0000","last_change":"2023-08-09T12:42:36.240311+0000","last_active":"2023-08-09T12:42:38.257633+0000","last_peered":"2023-08-09T12:42:38.257633+0000","last_clean":"2023-08-09T12:42:38.257633+0000","last_became_active":"2023-08-09T12:42:36.239717+0000","last_became_peered":"2023-08-09T12:42:36.239717+0000","last_unstale":"2023-08-09T12:42:38.257633+0000","last_undegraded":"2023-08-09T12:42:38.257633+0000","last_fullsized":"2023-08-09T12:42:38.257633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:24:13.940215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230988+0000","last_change":"2023-08-09T12:42:37.242895+0000","last_active":"2023-08-09T12:42:38.230988+0000","last_peered":"2023-08-09T12:42:38.230988+0000","last_clean":"2023-08-09T12:42:38.230988+0000","last_became_active":"2023-08-09T12:42:37.242665+0000","last_became_peered":"2023-08-09T12:42:37.242665+0000","last_unstale":"2023-08-09T12:42:38.230988+0000","last_undegraded":"2023-08-09T12:42:38.230988+0000","last_fullsized":"2023-08-09T12:42:38.230988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:51.102811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228850+0000","last_change":"2023-08-09T12:42:36.249493+0000","last_active":"2023-08-09T12:42:38.228850+0000","last_peered":"2023-08-09T12:42:38.228850+0000","last_clean":"2023-08-09T12:42:38.228850+0000","last_became_active":"2023-08-09T12:42:36.247921+0000","last_became_peered":"2023-08-09T12:42:36.247921+0000","last_unstale":"2023-08-09T12:42:38.228850+0000","last_undegraded":"2023-08-09T12:42:38.228850+0000","last_fullsized":"2023-08-09T12:42:38.228850+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:22:15.550584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256367+0000","last_change":"2023-08-09T12:42:37.256381+0000","last_active":"2023-08-09T12:42:38.256367+0000","last_peered":"2023-08-09T12:42:38.256367+0000","last_clean":"2023-08-09T12:42:38.256367+0000","last_became_active":"2023-08-09T12:42:37.256112+0000","last_became_peered":"2023-08-09T12:42:37.256112+0000","last_unstale":"2023-08-09T12:42:38.256367+0000","last_undegraded":"2023-08-09T12:42:38.256367+0000","last_fullsized":"2023-08-09T12:42:38.256367+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234030+0000","last_change":"2023-08-09T12:42:36.247625+0000","last_active":"2023-08-09T12:42:38.234030+0000","last_peered":"2023-08-09T12:42:38.234030+0000","last_clean":"2023-08-09T12:42:38.234030+0000","last_became_active":"2023-08-09T12:42:36.247369+0000","last_became_peered":"2023-08-09T12:42:36.247369+0000","last_unstale":"2023-08-09T12:42:38.234030+0000","last_undegraded":"2023-08-09T12:42:38.234030+0000","last_fullsized":"2023-08-09T12:42:38.234030+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:49:49.885647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256867+0000","last_change":"2023-08-09T12:42:37.252587+0000","last_active":"2023-08-09T12:42:38.256867+0000","last_peered":"2023-08-09T12:42:38.256867+0000","last_clean":"2023-08-09T12:42:38.256867+0000","last_became_active":"2023-08-09T12:42:37.252346+0000","last_became_peered":"2023-08-09T12:42:37.252346+0000","last_unstale":"2023-08-09T12:42:38.256867+0000","last_undegraded":"2023-08-09T12:42:38.256867+0000","last_fullsized":"2023-08-09T12:42:38.256867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:40.114216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"69'3","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230989+0000","last_change":"2023-08-09T12:42:36.246431+0000","last_active":"2023-08-09T12:42:38.230989+0000","last_peered":"2023-08-09T12:42:38.230989+0000","last_clean":"2023-08-09T12:42:38.230989+0000","last_became_active":"2023-08-09T12:42:36.245840+0000","last_became_peered":"2023-08-09T12:42:36.245840+0000","last_unstale":"2023-08-09T12:42:38.230989+0000","last_undegraded":"2023-08-09T12:42:38.230989+0000","last_fullsized":"2023-08-09T12:42:38.230989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:42:31.943095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234235+0000","last_change":"2023-08-09T12:42:37.258874+0000","last_active":"2023-08-09T12:42:38.234235+0000","last_peered":"2023-08-09T12:42:38.234235+0000","last_clean":"2023-08-09T12:42:38.234235+0000","last_became_active":"2023-08-09T12:42:37.258612+0000","last_became_peered":"2023-08-09T12:42:37.258612+0000","last_unstale":"2023-08-09T12:42:38.234235+0000","last_undegraded":"2023-08-09T12:42:38.234235+0000","last_fullsized":"2023-08-09T12:42:38.234235+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:38.405159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"69'6","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231262+0000","last_change":"2023-08-09T12:42:36.248155+0000","last_active":"2023-08-09T12:42:38.231262+0000","last_peered":"2023-08-09T12:42:38.231262+0000","last_clean":"2023-08-09T12:42:38.231262+0000","last_became_active":"2023-08-09T12:42:36.247743+0000","last_became_peered":"2023-08-09T12:42:36.247743+0000","last_unstale":"2023-08-09T12:42:38.231262+0000","last_undegraded":"2023-08-09T12:42:38.231262+0000","last_fullsized":"2023-08-09T12:42:38.231262+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:32.878105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.232986+0000","last_change":"2023-08-09T12:42:37.265931+0000","last_active":"2023-08-09T12:42:38.232986+0000","last_peered":"2023-08-09T12:42:38.232986+0000","last_clean":"2023-08-09T12:42:38.232986+0000","last_became_active":"2023-08-09T12:42:37.264827+0000","last_became_peered":"2023-08-09T12:42:37.264827+0000","last_unstale":"2023-08-09T12:42:38.232986+0000","last_undegraded":"2023-08-09T12:42:38.232986+0000","last_fullsized":"2023-08-09T12:42:38.232986+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:50.058728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229457+0000","last_change":"2023-08-09T12:42:36.245706+0000","last_active":"2023-08-09T12:42:38.229457+0000","last_peered":"2023-08-09T12:42:38.229457+0000","last_clean":"2023-08-09T12:42:38.229457+0000","last_became_active":"2023-08-09T12:42:36.245288+0000","last_became_peered":"2023-08-09T12:42:36.245288+0000","last_unstale":"2023-08-09T12:42:38.229457+0000","last_undegraded":"2023-08-09T12:42:38.229457+0000","last_fullsized":"2023-08-09T12:42:38.229457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:20:56.533915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254961+0000","last_change":"2023-08-09T12:42:37.250535+0000","last_active":"2023-08-09T12:42:38.254961+0000","last_peered":"2023-08-09T12:42:38.254961+0000","last_clean":"2023-08-09T12:42:38.254961+0000","last_became_active":"2023-08-09T12:42:37.250315+0000","last_became_peered":"2023-08-09T12:42:37.250315+0000","last_unstale":"2023-08-09T12:42:38.254961+0000","last_undegraded":"2023-08-09T12:42:38.254961+0000","last_fullsized":"2023-08-09T12:42:38.254961+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:35.083219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255850+0000","last_change":"2023-08-09T12:42:36.249379+0000","last_active":"2023-08-09T12:42:38.255850+0000","last_peered":"2023-08-09T12:42:38.255850+0000","last_clean":"2023-08-09T12:42:38.255850+0000","last_became_active":"2023-08-09T12:42:36.249139+0000","last_became_peered":"2023-08-09T12:42:36.249139+0000","last_unstale":"2023-08-09T12:42:38.255850+0000","last_undegraded":"2023-08-09T12:42:38.255850+0000","last_fullsized":"2023-08-09T12:42:38.255850+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:52.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256800+0000","last_change":"2023-08-09T12:42:37.239032+0000","last_active":"2023-08-09T12:42:38.256800+0000","last_peered":"2023-08-09T12:42:38.256800+0000","last_clean":"2023-08-09T12:42:38.256800+0000","last_became_active":"2023-08-09T12:42:37.238305+0000","last_became_peered":"2023-08-09T12:42:37.238305+0000","last_unstale":"2023-08-09T12:42:38.256800+0000","last_undegraded":"2023-08-09T12:42:38.256800+0000","last_fullsized":"2023-08-09T12:42:38.256800+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:36:19.643134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229362+0000","last_change":"2023-08-09T12:42:36.240822+0000","last_active":"2023-08-09T12:42:38.229362+0000","last_peered":"2023-08-09T12:42:38.229362+0000","last_clean":"2023-08-09T12:42:38.229362+0000","last_became_active":"2023-08-09T12:42:36.239779+0000","last_became_peered":"2023-08-09T12:42:36.239779+0000","last_unstale":"2023-08-09T12:42:38.229362+0000","last_undegraded":"2023-08-09T12:42:38.229362+0000","last_fullsized":"2023-08-09T12:42:38.229362+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:18:20.950202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231482+0000","last_change":"2023-08-09T12:42:37.252422+0000","last_active":"2023-08-09T12:42:38.231482+0000","last_peered":"2023-08-09T12:42:38.231482+0000","last_clean":"2023-08-09T12:42:38.231482+0000","last_became_active":"2023-08-09T12:42:37.251894+0000","last_became_peered":"2023-08-09T12:42:37.251894+0000","last_unstale":"2023-08-09T12:42:38.231482+0000","last_undegraded":"2023-08-09T12:42:38.231482+0000","last_fullsized":"2023-08-09T12:42:38.231482+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:35.083219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"69'8","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233708+0000","last_change":"2023-08-09T12:42:36.246725+0000","last_active":"2023-08-09T12:42:38.233708+0000","last_peered":"2023-08-09T12:42:38.233708+0000","last_clean":"2023-08-09T12:42:38.233708+0000","last_became_active":"2023-08-09T12:42:36.246443+0000","last_became_peered":"2023-08-09T12:42:36.246443+0000","last_unstale":"2023-08-09T12:42:38.233708+0000","last_undegraded":"2023-08-09T12:42:38.233708+0000","last_fullsized":"2023-08-09T12:42:38.233708+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:10.026311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255160+0000","last_change":"2023-08-09T12:42:37.265369+0000","last_active":"2023-08-09T12:42:38.255160+0000","last_peered":"2023-08-09T12:42:38.255160+0000","last_clean":"2023-08-09T12:42:38.255160+0000","last_became_active":"2023-08-09T12:42:37.265086+0000","last_became_peered":"2023-08-09T12:42:37.265086+0000","last_unstale":"2023-08-09T12:42:38.255160+0000","last_undegraded":"2023-08-09T12:42:38.255160+0000","last_fullsized":"2023-08-09T12:42:38.255160+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:35:19.472757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255330+0000","last_change":"2023-08-09T12:42:36.246114+0000","last_active":"2023-08-09T12:42:38.255330+0000","last_peered":"2023-08-09T12:42:38.255330+0000","last_clean":"2023-08-09T12:42:38.255330+0000","last_became_active":"2023-08-09T12:42:36.243762+0000","last_became_peered":"2023-08-09T12:42:36.243762+0000","last_unstale":"2023-08-09T12:42:38.255330+0000","last_undegraded":"2023-08-09T12:42:38.255330+0000","last_fullsized":"2023-08-09T12:42:38.255330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:24.987935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253453+0000","last_change":"2023-08-09T12:42:37.244546+0000","last_active":"2023-08-09T12:42:38.253453+0000","last_peered":"2023-08-09T12:42:38.253453+0000","last_clean":"2023-08-09T12:42:38.253453+0000","last_became_active":"2023-08-09T12:42:37.244085+0000","last_became_peered":"2023-08-09T12:42:37.244085+0000","last_unstale":"2023-08-09T12:42:38.253453+0000","last_undegraded":"2023-08-09T12:42:38.253453+0000","last_fullsized":"2023-08-09T12:42:38.253453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:32.254878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"70'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255755+0000","last_change":"2023-08-09T12:42:36.248626+0000","last_active":"2023-08-09T12:42:38.255755+0000","last_peered":"2023-08-09T12:42:38.255755+0000","last_clean":"2023-08-09T12:42:38.255755+0000","last_became_active":"2023-08-09T12:42:36.248040+0000","last_became_peered":"2023-08-09T12:42:36.248040+0000","last_unstale":"2023-08-09T12:42:38.255755+0000","last_undegraded":"2023-08-09T12:42:38.255755+0000","last_fullsized":"2023-08-09T12:42:38.255755+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:00:47.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255390+0000","last_change":"2023-08-09T12:42:37.254881+0000","last_active":"2023-08-09T12:42:38.255390+0000","last_peered":"2023-08-09T12:42:38.255390+0000","last_clean":"2023-08-09T12:42:38.255390+0000","last_became_active":"2023-08-09T12:42:37.254041+0000","last_became_peered":"2023-08-09T12:42:37.254041+0000","last_unstale":"2023-08-09T12:42:38.255390+0000","last_undegraded":"2023-08-09T12:42:38.255390+0000","last_fullsized":"2023-08-09T12:42:38.255390+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:48:54.763101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255145+0000","last_change":"2023-08-09T12:42:36.245523+0000","last_active":"2023-08-09T12:42:38.255145+0000","last_peered":"2023-08-09T12:42:38.255145+0000","last_clean":"2023-08-09T12:42:38.255145+0000","last_became_active":"2023-08-09T12:42:36.245182+0000","last_became_peered":"2023-08-09T12:42:36.245182+0000","last_unstale":"2023-08-09T12:42:38.255145+0000","last_undegraded":"2023-08-09T12:42:38.255145+0000","last_fullsized":"2023-08-09T12:42:38.255145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:20:34.684149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257284+0000","last_change":"2023-08-09T12:42:37.237192+0000","last_active":"2023-08-09T12:42:38.257284+0000","last_peered":"2023-08-09T12:42:38.257284+0000","last_clean":"2023-08-09T12:42:38.257284+0000","last_became_active":"2023-08-09T12:42:37.236530+0000","last_became_peered":"2023-08-09T12:42:37.236530+0000","last_unstale":"2023-08-09T12:42:38.257284+0000","last_undegraded":"2023-08-09T12:42:38.257284+0000","last_fullsized":"2023-08-09T12:42:38.257284+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:12:20.303269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231601+0000","last_change":"2023-08-09T12:42:36.245731+0000","last_active":"2023-08-09T12:42:38.231601+0000","last_peered":"2023-08-09T12:42:38.231601+0000","last_clean":"2023-08-09T12:42:38.231601+0000","last_became_active":"2023-08-09T12:42:36.245407+0000","last_became_peered":"2023-08-09T12:42:36.245407+0000","last_unstale":"2023-08-09T12:42:38.231601+0000","last_undegraded":"2023-08-09T12:42:38.231601+0000","last_fullsized":"2023-08-09T12:42:38.231601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:36.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256937+0000","last_change":"2023-08-09T12:42:37.247730+0000","last_active":"2023-08-09T12:42:38.256937+0000","last_peered":"2023-08-09T12:42:38.256937+0000","last_clean":"2023-08-09T12:42:38.256937+0000","last_became_active":"2023-08-09T12:42:37.243233+0000","last_became_peered":"2023-08-09T12:42:37.243233+0000","last_unstale":"2023-08-09T12:42:38.256937+0000","last_undegraded":"2023-08-09T12:42:38.256937+0000","last_fullsized":"2023-08-09T12:42:38.256937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:19.372664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229729+0000","last_change":"2023-08-09T12:42:36.234581+0000","last_active":"2023-08-09T12:42:38.229729+0000","last_peered":"2023-08-09T12:42:38.229729+0000","last_clean":"2023-08-09T12:42:38.229729+0000","last_became_active":"2023-08-09T12:42:36.233897+0000","last_became_peered":"2023-08-09T12:42:36.233897+0000","last_unstale":"2023-08-09T12:42:38.229729+0000","last_undegraded":"2023-08-09T12:42:38.229729+0000","last_fullsized":"2023-08-09T12:42:38.229729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:37:29.459073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233375+0000","last_change":"2023-08-09T12:42:37.265768+0000","last_active":"2023-08-09T12:42:38.233375+0000","last_peered":"2023-08-09T12:42:38.233375+0000","last_clean":"2023-08-09T12:42:38.233375+0000","last_became_active":"2023-08-09T12:42:37.264478+0000","last_became_peered":"2023-08-09T12:42:37.264478+0000","last_unstale":"2023-08-09T12:42:38.233375+0000","last_undegraded":"2023-08-09T12:42:38.233375+0000","last_fullsized":"2023-08-09T12:42:38.233375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:02.490679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256097+0000","last_change":"2023-08-09T12:42:36.238369+0000","last_active":"2023-08-09T12:42:38.256097+0000","last_peered":"2023-08-09T12:42:38.256097+0000","last_clean":"2023-08-09T12:42:38.256097+0000","last_became_active":"2023-08-09T12:42:36.238090+0000","last_became_peered":"2023-08-09T12:42:36.238090+0000","last_unstale":"2023-08-09T12:42:38.256097+0000","last_undegraded":"2023-08-09T12:42:38.256097+0000","last_fullsized":"2023-08-09T12:42:38.256097+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:11.675220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231081+0000","last_change":"2023-08-09T12:42:37.261187+0000","last_active":"2023-08-09T12:42:38.231081+0000","last_peered":"2023-08-09T12:42:38.231081+0000","last_clean":"2023-08-09T12:42:38.231081+0000","last_became_active":"2023-08-09T12:42:37.260814+0000","last_became_peered":"2023-08-09T12:42:37.260814+0000","last_unstale":"2023-08-09T12:42:38.231081+0000","last_undegraded":"2023-08-09T12:42:38.231081+0000","last_fullsized":"2023-08-09T12:42:38.231081+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:15:42.311935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256710+0000","last_change":"2023-08-09T12:42:36.239973+0000","last_active":"2023-08-09T12:42:38.256710+0000","last_peered":"2023-08-09T12:42:38.256710+0000","last_clean":"2023-08-09T12:42:38.256710+0000","last_became_active":"2023-08-09T12:42:36.238975+0000","last_became_peered":"2023-08-09T12:42:36.238975+0000","last_unstale":"2023-08-09T12:42:38.256710+0000","last_undegraded":"2023-08-09T12:42:38.256710+0000","last_fullsized":"2023-08-09T12:42:38.256710+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:52.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254326+0000","last_change":"2023-08-09T12:42:37.254391+0000","last_active":"2023-08-09T12:42:38.254326+0000","last_peered":"2023-08-09T12:42:38.254326+0000","last_clean":"2023-08-09T12:42:38.254326+0000","last_became_active":"2023-08-09T12:42:37.253699+0000","last_became_peered":"2023-08-09T12:42:37.253699+0000","last_unstale":"2023-08-09T12:42:38.254326+0000","last_undegraded":"2023-08-09T12:42:38.254326+0000","last_fullsized":"2023-08-09T12:42:38.254326+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:46:04.982543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231340+0000","last_change":"2023-08-09T12:42:36.240867+0000","last_active":"2023-08-09T12:42:38.231340+0000","last_peered":"2023-08-09T12:42:38.231340+0000","last_clean":"2023-08-09T12:42:38.231340+0000","last_became_active":"2023-08-09T12:42:36.240311+0000","last_became_peered":"2023-08-09T12:42:36.240311+0000","last_unstale":"2023-08-09T12:42:38.231340+0000","last_undegraded":"2023-08-09T12:42:38.231340+0000","last_fullsized":"2023-08-09T12:42:38.231340+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:15.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256923+0000","last_change":"2023-08-09T12:42:37.246164+0000","last_active":"2023-08-09T12:42:38.256923+0000","last_peered":"2023-08-09T12:42:38.256923+0000","last_clean":"2023-08-09T12:42:38.256923+0000","last_became_active":"2023-08-09T12:42:37.245810+0000","last_became_peered":"2023-08-09T12:42:37.245810+0000","last_unstale":"2023-08-09T12:42:38.256923+0000","last_undegraded":"2023-08-09T12:42:38.256923+0000","last_fullsized":"2023-08-09T12:42:38.256923+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:39:51.487806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256605+0000","last_change":"2023-08-09T12:42:36.246012+0000","last_active":"2023-08-09T12:42:38.256605+0000","last_peered":"2023-08-09T12:42:38.256605+0000","last_clean":"2023-08-09T12:42:38.256605+0000","last_became_active":"2023-08-09T12:42:36.245659+0000","last_became_peered":"2023-08-09T12:42:36.245659+0000","last_unstale":"2023-08-09T12:42:38.256605+0000","last_undegraded":"2023-08-09T12:42:38.256605+0000","last_fullsized":"2023-08-09T12:42:38.256605+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:00:47.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":264,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230364+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:42:38.230364+0000","last_peered":"2023-08-09T12:42:38.230364+0000","last_clean":"2023-08-09T12:42:38.230364+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:42:38.230364+0000","last_undegraded":"2023-08-09T12:42:38.230364+0000","last_fullsized":"2023-08-09T12:42:38.230364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:14.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256167+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:42:38.256167+0000","last_peered":"2023-08-09T12:42:38.256167+0000","last_clean":"2023-08-09T12:42:38.256167+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:42:38.256167+0000","last_undegraded":"2023-08-09T12:42:38.256167+0000","last_fullsized":"2023-08-09T12:42:38.256167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:01.502439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254867+0000","last_change":"2023-08-09T12:42:37.244813+0000","last_active":"2023-08-09T12:42:38.254867+0000","last_peered":"2023-08-09T12:42:38.254867+0000","last_clean":"2023-08-09T12:42:38.254867+0000","last_became_active":"2023-08-09T12:42:37.244595+0000","last_became_peered":"2023-08-09T12:42:37.244595+0000","last_unstale":"2023-08-09T12:42:38.254867+0000","last_undegraded":"2023-08-09T12:42:38.254867+0000","last_fullsized":"2023-08-09T12:42:38.254867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:56.691180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254583+0000","last_change":"2023-08-09T12:42:36.246929+0000","last_active":"2023-08-09T12:42:38.254583+0000","last_peered":"2023-08-09T12:42:38.254583+0000","last_clean":"2023-08-09T12:42:38.254583+0000","last_became_active":"2023-08-09T12:42:36.246532+0000","last_became_peered":"2023-08-09T12:42:36.246532+0000","last_unstale":"2023-08-09T12:42:38.254583+0000","last_undegraded":"2023-08-09T12:42:38.254583+0000","last_fullsized":"2023-08-09T12:42:38.254583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:41:26.943555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230026+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:42:38.230026+0000","last_peered":"2023-08-09T12:42:38.230026+0000","last_clean":"2023-08-09T12:42:38.230026+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:42:38.230026+0000","last_undegraded":"2023-08-09T12:42:38.230026+0000","last_fullsized":"2023-08-09T12:42:38.230026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:17:55.155222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256527+0000","last_change":"2023-08-09T12:42:37.256965+0000","last_active":"2023-08-09T12:42:38.256527+0000","last_peered":"2023-08-09T12:42:38.256527+0000","last_clean":"2023-08-09T12:42:38.256527+0000","last_became_active":"2023-08-09T12:42:37.249660+0000","last_became_peered":"2023-08-09T12:42:37.249660+0000","last_unstale":"2023-08-09T12:42:38.256527+0000","last_undegraded":"2023-08-09T12:42:38.256527+0000","last_fullsized":"2023-08-09T12:42:38.256527+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:04.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254696+0000","last_change":"2023-08-09T12:42:36.249723+0000","last_active":"2023-08-09T12:42:38.254696+0000","last_peered":"2023-08-09T12:42:38.254696+0000","last_clean":"2023-08-09T12:42:38.254696+0000","last_became_active":"2023-08-09T12:42:36.249183+0000","last_became_peered":"2023-08-09T12:42:36.249183+0000","last_unstale":"2023-08-09T12:42:38.254696+0000","last_undegraded":"2023-08-09T12:42:38.254696+0000","last_fullsized":"2023-08-09T12:42:38.254696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:32.878105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253354+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:42:38.253354+0000","last_peered":"2023-08-09T12:42:38.253354+0000","last_clean":"2023-08-09T12:42:38.253354+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:42:38.253354+0000","last_undegraded":"2023-08-09T12:42:38.253354+0000","last_fullsized":"2023-08-09T12:42:38.253354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:07.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255244+0000","last_change":"2023-08-09T12:42:37.248058+0000","last_active":"2023-08-09T12:42:38.255244+0000","last_peered":"2023-08-09T12:42:38.255244+0000","last_clean":"2023-08-09T12:42:38.255244+0000","last_became_active":"2023-08-09T12:42:37.245837+0000","last_became_peered":"2023-08-09T12:42:37.245837+0000","last_unstale":"2023-08-09T12:42:38.255244+0000","last_undegraded":"2023-08-09T12:42:38.255244+0000","last_fullsized":"2023-08-09T12:42:38.255244+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:13:55.262326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255712+0000","last_change":"2023-08-09T12:42:36.242087+0000","last_active":"2023-08-09T12:42:38.255712+0000","last_peered":"2023-08-09T12:42:38.255712+0000","last_clean":"2023-08-09T12:42:38.255712+0000","last_became_active":"2023-08-09T12:42:36.241640+0000","last_became_peered":"2023-08-09T12:42:36.241640+0000","last_unstale":"2023-08-09T12:42:38.255712+0000","last_undegraded":"2023-08-09T12:42:38.255712+0000","last_fullsized":"2023-08-09T12:42:38.255712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:53:44.415681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255635+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:42:38.255635+0000","last_peered":"2023-08-09T12:42:38.255635+0000","last_clean":"2023-08-09T12:42:38.255635+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:42:38.255635+0000","last_undegraded":"2023-08-09T12:42:38.255635+0000","last_fullsized":"2023-08-09T12:42:38.255635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:19.489283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229156+0000","last_change":"2023-08-09T12:42:37.261247+0000","last_active":"2023-08-09T12:42:38.229156+0000","last_peered":"2023-08-09T12:42:38.229156+0000","last_clean":"2023-08-09T12:42:38.229156+0000","last_became_active":"2023-08-09T12:42:37.260975+0000","last_became_peered":"2023-08-09T12:42:37.260975+0000","last_unstale":"2023-08-09T12:42:38.229156+0000","last_undegraded":"2023-08-09T12:42:38.229156+0000","last_fullsized":"2023-08-09T12:42:38.229156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:28.452927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254355+0000","last_change":"2023-08-09T12:42:36.249872+0000","last_active":"2023-08-09T12:42:38.254355+0000","last_peered":"2023-08-09T12:42:38.254355+0000","last_clean":"2023-08-09T12:42:38.254355+0000","last_became_active":"2023-08-09T12:42:36.249491+0000","last_became_peered":"2023-08-09T12:42:36.249491+0000","last_unstale":"2023-08-09T12:42:38.254355+0000","last_undegraded":"2023-08-09T12:42:38.254355+0000","last_fullsized":"2023-08-09T12:42:38.254355+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:59:20.746429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231734+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:42:38.231734+0000","last_peered":"2023-08-09T12:42:38.231734+0000","last_clean":"2023-08-09T12:42:38.231734+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:42:38.231734+0000","last_undegraded":"2023-08-09T12:42:38.231734+0000","last_fullsized":"2023-08-09T12:42:38.231734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:57:30.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257183+0000","last_change":"2023-08-09T12:42:37.259218+0000","last_active":"2023-08-09T12:42:38.257183+0000","last_peered":"2023-08-09T12:42:38.257183+0000","last_clean":"2023-08-09T12:42:38.257183+0000","last_became_active":"2023-08-09T12:42:37.258966+0000","last_became_peered":"2023-08-09T12:42:37.258966+0000","last_unstale":"2023-08-09T12:42:38.257183+0000","last_undegraded":"2023-08-09T12:42:38.257183+0000","last_fullsized":"2023-08-09T12:42:38.257183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:00.847580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230119+0000","last_change":"2023-08-09T12:42:36.246540+0000","last_active":"2023-08-09T12:42:38.230119+0000","last_peered":"2023-08-09T12:42:38.230119+0000","last_clean":"2023-08-09T12:42:38.230119+0000","last_became_active":"2023-08-09T12:42:36.246233+0000","last_became_peered":"2023-08-09T12:42:36.246233+0000","last_unstale":"2023-08-09T12:42:38.230119+0000","last_undegraded":"2023-08-09T12:42:38.230119+0000","last_fullsized":"2023-08-09T12:42:38.230119+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:59:26.390587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229402+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:42:38.229402+0000","last_peered":"2023-08-09T12:42:38.229402+0000","last_clean":"2023-08-09T12:42:38.229402+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:42:38.229402+0000","last_undegraded":"2023-08-09T12:42:38.229402+0000","last_fullsized":"2023-08-09T12:42:38.229402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:39.963390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233650+0000","last_change":"2023-08-09T12:42:37.263524+0000","last_active":"2023-08-09T12:42:38.233650+0000","last_peered":"2023-08-09T12:42:38.233650+0000","last_clean":"2023-08-09T12:42:38.233650+0000","last_became_active":"2023-08-09T12:42:37.262444+0000","last_became_peered":"2023-08-09T12:42:37.262444+0000","last_unstale":"2023-08-09T12:42:38.233650+0000","last_undegraded":"2023-08-09T12:42:38.233650+0000","last_fullsized":"2023-08-09T12:42:38.233650+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:12.375809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229273+0000","last_change":"2023-08-09T12:42:36.248225+0000","last_active":"2023-08-09T12:42:38.229273+0000","last_peered":"2023-08-09T12:42:38.229273+0000","last_clean":"2023-08-09T12:42:38.229273+0000","last_became_active":"2023-08-09T12:42:36.245387+0000","last_became_peered":"2023-08-09T12:42:36.245387+0000","last_unstale":"2023-08-09T12:42:38.229273+0000","last_undegraded":"2023-08-09T12:42:38.229273+0000","last_fullsized":"2023-08-09T12:42:38.229273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:58.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231601+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:42:38.231601+0000","last_peered":"2023-08-09T12:42:38.231601+0000","last_clean":"2023-08-09T12:42:38.231601+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:42:38.231601+0000","last_undegraded":"2023-08-09T12:42:38.231601+0000","last_fullsized":"2023-08-09T12:42:38.231601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:36.822990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254547+0000","last_change":"2023-08-09T12:42:37.237486+0000","last_active":"2023-08-09T12:42:38.254547+0000","last_peered":"2023-08-09T12:42:38.254547+0000","last_clean":"2023-08-09T12:42:38.254547+0000","last_became_active":"2023-08-09T12:42:37.236380+0000","last_became_peered":"2023-08-09T12:42:37.236380+0000","last_unstale":"2023-08-09T12:42:38.254547+0000","last_undegraded":"2023-08-09T12:42:38.254547+0000","last_fullsized":"2023-08-09T12:42:38.254547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:26.602443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255841+0000","last_change":"2023-08-09T12:42:36.249795+0000","last_active":"2023-08-09T12:42:38.255841+0000","last_peered":"2023-08-09T12:42:38.255841+0000","last_clean":"2023-08-09T12:42:38.255841+0000","last_became_active":"2023-08-09T12:42:36.248860+0000","last_became_peered":"2023-08-09T12:42:36.248860+0000","last_unstale":"2023-08-09T12:42:38.255841+0000","last_undegraded":"2023-08-09T12:42:38.255841+0000","last_fullsized":"2023-08-09T12:42:38.255841+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:34.069478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257590+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:42:38.257590+0000","last_peered":"2023-08-09T12:42:38.257590+0000","last_clean":"2023-08-09T12:42:38.257590+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:42:38.257590+0000","last_undegraded":"2023-08-09T12:42:38.257590+0000","last_fullsized":"2023-08-09T12:42:38.257590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:34:45.359471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194363,"statfs":{"total":200000000,"available":199027780,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.619,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0940000000000001,"15min":1.0660000000000001},"min":{"1min":0.70799999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.601,"5min":1.843,"15min":1.843},"last":1.1990000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1180000000000001,"15min":1.0860000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.708,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7030000000000001,"5min":1.734,"15min":1.734},"last":0.81399999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.1739999999999999,"15min":1.1399999999999999},"min":{"1min":0.85299999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.625,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.167,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.637,"5min":2.173,"15min":2.173},"last":1.3220000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2210000000000001,"15min":1.212},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5860000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.115},{"interface":"front","average":{"1min":1.292,"5min":1.2689999999999999,"15min":1.2490000000000001},"min":{"1min":0.91600000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":1.03}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.224,"15min":1.1990000000000001},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.5509999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.274,"15min":1.2470000000000001},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.615,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.25}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3140000000000001,"15min":1.2689999999999999},"min":{"1min":0.751,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7849999999999999,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.7},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4790000000000001,"15min":1.4750000000000001},"min":{"1min":0.90100000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5980000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.53}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4710000000000001,"15min":1.464},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.788,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.83699999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.6779999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.575}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.1120000000000001},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5449999999999999,"5min":2.54,"15min":2.54},"last":1.466},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0760000000000001,"15min":1.0549999999999999},"min":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.7010000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.246,"15min":1.228},"min":{"1min":0.874,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7210000000000001,"5min":2.306,"15min":2.306},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3280000000000001,"15min":1.3109999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.671,"5min":1.829,"15min":1.829},"last":1.167}]},{"osd":2,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.093,"15min":1.0820000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4490000000000001,"5min":1.554,"15min":1.554},"last":1.409},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2809999999999999,"15min":1.2649999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.923,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.5940000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":0.86799999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7150000000000001,"5min":2.004,"15min":2.004},"last":1.8240000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.27},"min":{"1min":0.84599999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6579999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.268}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.319,"15min":1.2889999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0590000000000002,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.353,"15min":1.325},"min":{"1min":1.056,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1059999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.9399999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.327,"15min":1.3089999999999999},"min":{"1min":1.022,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.8240000000000001,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.496,"15min":1.462},"min":{"1min":1.1830000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.4350000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":2.1240000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.4570000000000001,"15min":1.393},"min":{"1min":1.145,"5min":0.752,"15min":0.752},"max":{"1min":2.2610000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":2.0840000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.446,"15min":1.3999999999999999},"min":{"1min":1.0509999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.161,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":2.0459999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1120000000000001,"15min":1.1100000000000001},"min":{"1min":0.67600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.649,"5min":2.427,"15min":2.427},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.073,"15min":1.0429999999999999},"min":{"1min":0.71699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.575,"5min":1.851,"15min":1.851},"last":1.0169999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2909999999999999,"15min":1.276},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.766,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2569999999999999,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.298}]},{"osd":2,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.88500000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.427},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.95299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.5449999999999999,"5min":1.728,"15min":1.728},"last":1.1040000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2030000000000001,"15min":1.177},"min":{"1min":0.86499999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.373},"min":{"1min":0.879,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7050000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.5109999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.228,"15min":1.224},"min":{"1min":0.85899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.343},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.94099999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.7450000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1910000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.339,"15min":1.3280000000000001},"min":{"1min":0.96699999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.804,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.571},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.458,"15min":1.5},"min":{"1min":1.0920000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.8029999999999999,"5min":2.948,"15min":2.948},"last":1.2549999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":1.111,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7969999999999999,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5089999999999999,"15min":1.504},"min":{"1min":1.1060000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.623}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":373,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199617312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.0940000000000001,"15min":1.071},"min":{"1min":0.81999999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6439999999999999,"5min":1.77,"15min":1.77},"last":1.8520000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.103,"15min":1.081},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.72}]},{"osd":1,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3069999999999999,"15min":1.355},"min":{"1min":0.83199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.897,"5min":1.97,"15min":1.97},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.335,"15min":1.3400000000000001},"min":{"1min":0.95699999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6359999999999999,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.758}]},{"osd":2,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.3140000000000001,"15min":1.321},"min":{"1min":0.88100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5329999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.325,"15min":1.3129999999999999},"min":{"1min":0.90200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7270000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5720000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.204},"min":{"1min":0.79200000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.49},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.337},"min":{"1min":0.97899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.3500000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3819999999999999,"15min":1.4039999999999999},"min":{"1min":0.92500000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.853,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.073},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.371,"15min":1.379},"min":{"1min":0.98799999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.216}]},{"osd":6,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4610000000000001,"15min":1.5069999999999999},"min":{"1min":0.93200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.151},{"interface":"front","average":{"1min":1.554,"5min":1.5369999999999999,"15min":1.5429999999999999},"min":{"1min":1.278,"5min":0.755,"15min":0.755},"max":{"1min":1.9570000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.518,"15min":1.5169999999999999},"min":{"1min":1.085,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.605,"15min":1.637},"min":{"1min":1.1319999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.804}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.82599999999999996},"min":{"1min":0.44400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.4109999999999996,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.03,"5min":0.89200000000000002,"15min":0.86399999999999999},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.331}]},{"osd":1,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3049999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.159,"5min":0.93700000000000006,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.373,"15min":0.373},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.1220000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.2490000000000001,"15min":1.0900000000000001},"min":{"1min":0.47299999999999998,"5min":0.433,"15min":0.433},"max":{"1min":18.145,"5min":18.145,"15min":18.145},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.1759999999999999,"15min":1.1910000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.7050000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.95399999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.972,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.337,"15min":1.345},"min":{"1min":0.751,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.5960000000000001,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.026}]},{"osd":5,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.4769999999999999,"5min":1.5740000000000001,"15min":1.4430000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":18.094000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.3},{"interface":"front","average":{"1min":2.181,"5min":1.446,"15min":1.3120000000000001},"min":{"1min":0.96099999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":14.105,"5min":14.105,"15min":14.105},"last":1.4610000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.357,"15min":1.335},"min":{"1min":0.99399999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.3640000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3740000000000001,"15min":1.3720000000000001},"min":{"1min":1.0740000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.806,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.3859999999999999,"15min":1.365},"min":{"1min":1.008,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.429}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4570000000000001,"5min":1.716,"15min":1.716},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.46700000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4830000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.0880000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.504,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1339999999999999,"5min":1.466,"15min":1.466},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.024,"15min":1.05},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6200000000000001,"5min":1.869,"15min":1.869},"last":1.177}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.73899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5489999999999999,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1419999999999999,"15min":1.143},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.3560000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.399,"15min":1.403},"min":{"1min":0.93200000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.897,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.486},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.296,"15min":1.26},"min":{"1min":0.90600000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.819,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.7669999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.381,"15min":1.347},"min":{"1min":1.0580000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0539999999999998,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.484,"15min":1.482},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.804,"5min":4.806,"15min":4.806},"last":1.5800000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3049999999999999,"15min":1.29},"min":{"1min":0.83999999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.744,"5min":2.323,"15min":2.323},"last":1.863},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":1.0620000000000001,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9319999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.6140000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.353,"15min":1.3480000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6759999999999999,"5min":2.218,"15min":2.218},"last":1.97},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5209999999999999,"15min":1.5229999999999999},"min":{"1min":1.032,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.1949999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.9039999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89400000000000002},"min":{"1min":0.64400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.49399999999999999},{"interface":"front","average":{"1min":6.1859999999999999,"5min":1.917,"15min":1.2090000000000001},"min":{"1min":0.47799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":88.254999999999995,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.96399999999999997,"15min":0.92800000000000005},"min":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.127,"15min":1.087},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.016}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.238},{"interface":"front","average":{"1min":1.369,"5min":1,"15min":0.91600000000000004},"min":{"1min":0.53900000000000003,"5min":0.503,"15min":0.503},"max":{"1min":5.4320000000000004,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.80800000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":1.4810000000000001,"15min":1.268},"min":{"1min":0.93899999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":25.172000000000001,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.2869999999999999,"15min":1.2709999999999999},"min":{"1min":1.0289999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.534}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.96,"5min":1.6000000000000001,"15min":1.3759999999999999},"min":{"1min":0.90700000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":28.710000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3,"15min":1.258},"min":{"1min":0.91600000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.1739999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.4510000000000001,"15min":1.399},"min":{"1min":1.0860000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":6.0460000000000003,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.399},{"interface":"front","average":{"1min":1.423,"5min":1.3700000000000001,"15min":1.347},"min":{"1min":0.91300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.863,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.379}]},{"osd":7,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":3.0259999999999998,"5min":1.768,"15min":1.5549999999999999},"min":{"1min":0.98699999999999999,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":26.975999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.6499999999999999},{"interface":"front","average":{"1min":3.1640000000000001,"5min":1.7629999999999999,"15min":1.53},"min":{"1min":1.052,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":28.765000000000001,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.5129999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":948,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194363,"statfs":{"total":200000000,"available":199028556,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.50900000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":0.98599999999999999,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":6.1749999999999998,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":1.147}]},{"osd":2,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.95099999999999996,"15min":0.93700000000000006},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.657,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.538},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.0629999999999999,"15min":1.0049999999999999},"min":{"1min":0.59899999999999998,"5min":0.5,"15min":0.5},"max":{"1min":6.2549999999999999,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":0.98799999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":0.98399999999999999,"15min":0.91200000000000003},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1679999999999999,"15min":1.1659999999999999},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6000000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.2729999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.3660000000000001,"15min":1.3300000000000001},"min":{"1min":0.96299999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":9.9629999999999992,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.288,"15min":1.264},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.4330000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.3420000000000001,"15min":1.29},"min":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":10.004,"5min":10.004,"15min":10.004},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.369,"15min":1.365},"min":{"1min":0.87,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.909,"5min":2.161,"15min":2.161},"last":1.611}]},{"osd":6,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.377,"15min":1.3220000000000001},"min":{"1min":0.83699999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.4290000000000003,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.385},{"interface":"front","average":{"1min":1.881,"5min":1.472,"15min":1.415},"min":{"1min":1.093,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":9.9190000000000005,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.3200000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":1.552,"15min":1.4199999999999999},"min":{"1min":0.89300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":18.114000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.897,"5min":1.4930000000000001,"15min":1.4390000000000001},"min":{"1min":1.052,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":9.5640000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.5800000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:42:43.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-09T12:42:43.203 INFO:tasks.ceph.mds.c.smithi017.stderr:2023-08-09T12:42:43.199+0000 7fa9171a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:42:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.417+0000 7f70eef01640 1 Processor -- start 2023-08-09T12:42:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.418+0000 7f70eef01640 1 -- start start 2023-08-09T12:42:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.419+0000 7f70eef01640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f70e815cac0 0x7f70e80cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.419+0000 7f70eef01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f70e80cffd0 0x7f70e80b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.419+0000 7f70eef01640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e80b8030 con 0x7f70e815cea0 2023-08-09T12:42:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.419+0000 7f70eef01640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80d0440 con 0x7f70e80cffd0 2023-08-09T12:42:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.419+0000 7f70eef01640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80b7790 con 0x7f70e815cac0 2023-08-09T12:42:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.420+0000 7f70ed49e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f70e80cffd0 0x7f70e80b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.420+0000 7f70ed49e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f70e80cffd0 0x7f70e80b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39168/0 (socket says 172.21.15.17:39168) 2023-08-09T12:42:43.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.420+0000 7f70ed49e640 1 -- 172.21.15.17:0/2358128687 learned_addr learned my addr 172.21.15.17:0/2358128687 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:43.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.420+0000 7f70ecc9d640 1 --2- 172.21.15.17:0/2358128687 >> v2:172.21.15.142:3300/0 conn(0x7f70e815cac0 0x7f70e80cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.420+0000 7f70ed49e640 1 -- 172.21.15.17:0/2358128687 >> v2:172.21.15.142:3300/0 conn(0x7f70e815cac0 msgr2=0x7f70e80cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.420+0000 7f70ed49e640 1 --2- 172.21.15.17:0/2358128687 >> v2:172.21.15.142:3300/0 conn(0x7f70e815cac0 0x7f70e80cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.420+0000 7f70ed49e640 1 -- 172.21.15.17:0/2358128687 >> v1:172.21.15.142:6789/0 conn(0x7f70e815cea0 legacy=0x7f70e80d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.420+0000 7f70ed49e640 1 -- 172.21.15.17:0/2358128687 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80b7a70 con 0x7f70e80cffd0 2023-08-09T12:42:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.421+0000 7f70ed49e640 1 --2- 172.21.15.17:0/2358128687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e80cffd0 0x7f70e80b6bf0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f70e80b5520 tx=0x7f70e002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b196a92371c8ac server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.422+0000 7f70df7fe640 1 -- 172.21.15.17:0/2358128687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e002ca80 con 0x7f70e80cffd0 2023-08-09T12:42:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.422+0000 7f70df7fe640 1 -- 172.21.15.17:0/2358128687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e002cbe0 con 0x7f70e80cffd0 2023-08-09T12:42:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.422+0000 7f70df7fe640 1 -- 172.21.15.17:0/2358128687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00343f0 con 0x7f70e80cffd0 2023-08-09T12:42:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.422+0000 7f70eef01640 1 -- 172.21.15.17:0/2358128687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e80cffd0 msgr2=0x7f70e80b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.422+0000 7f70eef01640 1 --2- 172.21.15.17:0/2358128687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e80cffd0 0x7f70e80b6bf0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f70e80b5520 tx=0x7f70e002bee0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.422+0000 7f70eef01640 1 -- 172.21.15.17:0/2358128687 shutdown_connections 2023-08-09T12:42:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.422+0000 7f70eef01640 1 --2- 172.21.15.17:0/2358128687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e80cffd0 0x7f70e80b6bf0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.422+0000 7f70eef01640 1 --2- 172.21.15.17:0/2358128687 >> v2:172.21.15.142:3300/0 conn(0x7f70e815cac0 0x7f70e80cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.423+0000 7f70eef01640 1 -- 172.21.15.17:0/2358128687 >> 172.21.15.17:0/2358128687 conn(0x7f70e80699a0 msgr2=0x7f70e8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:43.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.423+0000 7f70eef01640 1 -- 172.21.15.17:0/2358128687 shutdown_connections 2023-08-09T12:42:43.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.423+0000 7f70eef01640 1 -- 172.21.15.17:0/2358128687 wait complete. 2023-08-09T12:42:43.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.424+0000 7f70eef01640 1 Processor -- start 2023-08-09T12:42:43.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.424+0000 7f70eef01640 1 -- start start 2023-08-09T12:42:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.425+0000 7f70eef01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e80cffd0 0x7f70e8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.425+0000 7f70eef01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e815cac0 0x7f70e81f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.425+0000 7f70eef01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e815cea0 0x7f70e81f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.425+0000 7f70eef01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e815e7c0 con 0x7f70e815cac0 2023-08-09T12:42:43.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.425+0000 7f70eef01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8155780 con 0x7f70e80cffd0 2023-08-09T12:42:43.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.425+0000 7f70eef01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8155a60 con 0x7f70e815cea0 2023-08-09T12:42:43.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e815cac0 0x7f70e81f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e815cac0 0x7f70e81f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39184/0 (socket says 172.21.15.17:39184) 2023-08-09T12:42:43.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 -- 172.21.15.17:0/2523156435 learned_addr learned my addr 172.21.15.17:0/2523156435 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:43.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70ed49e640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e815cea0 0x7f70e81f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 -- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e815cea0 msgr2=0x7f70e81f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70ecc9d640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e80cffd0 0x7f70e8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e815cea0 0x7f70e81f6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 -- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e80cffd0 msgr2=0x7f70e8152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e80cffd0 0x7f70e8152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 -- 172.21.15.17:0/2523156435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0009b30 con 0x7f70e815cac0 2023-08-09T12:42:43.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dffff640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e815cac0 0x7f70e81f5ce0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c430 tx=0x7f70d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:43.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.426+0000 7f70dd7fa640 1 -- 172.21.15.17:0/2523156435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8011790 con 0x7f70e815cac0 2023-08-09T12:42:43.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.427+0000 7f70dd7fa640 1 -- 172.21.15.17:0/2523156435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d80118f0 con 0x7f70e815cac0 2023-08-09T12:42:43.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.427+0000 7f70dd7fa640 1 -- 172.21.15.17:0/2523156435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8011ce0 con 0x7f70e815cac0 2023-08-09T12:42:43.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.427+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e8155d40 con 0x7f70e815cac0 2023-08-09T12:42:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.427+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e80cce60 con 0x7f70e815cac0 2023-08-09T12:42:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.428+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e815e970 con 0x7f70e815cac0 2023-08-09T12:42:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.429+0000 7f70dd7fa640 1 -- 172.21.15.17:0/2523156435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f70d801c460 con 0x7f70e815cac0 2023-08-09T12:42:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.430+0000 7f70dd7fa640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f70d406a050 0x7f70d406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.430+0000 7f70dd7fa640 1 -- 172.21.15.17:0/2523156435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70d80885b0 con 0x7f70e815cac0 2023-08-09T12:42:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.430+0000 7f70ecc9d640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f70d406a050 0x7f70d406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.431+0000 7f70ecc9d640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f70d406a050 0x7f70d406c510 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f70e4006fd0 tx=0x7f70e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:43.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.434+0000 7f70dd7fa640 1 -- 172.21.15.17:0/2523156435 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f70e815e970 con 0x7f70e815cac0 2023-08-09T12:42:43.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.699+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f70e8067a80 con 0x7f70e815cac0 2023-08-09T12:42:43.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.701+0000 7f70dd7fa640 1 -- 172.21.15.17:0/2523156435 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1008 (secure 0 0 0) 0x7f70d8057690 con 0x7f70e815cac0 2023-08-09T12:42:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:43.704 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":220,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":70,"num_osds":8,"num_up_osds":8,"osd_up_since":1691584751,"num_in_osds":8,"osd_in_since":1691584748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592778,"bytes_used":4234164,"bytes_avail":1595765836,"bytes_total":1600000000,"write_bytes_sec":2211,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":35,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6159}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-08-09T12:42:22.701649+0000","services":{}},"progress_events":{}} 2023-08-09T12:42:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.703+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f70d406a050 msgr2=0x7f70d406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.703+0000 7f70eef01640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f70d406a050 0x7f70d406c510 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f70e4006fd0 tx=0x7f70e4008040 comp rx=0 tx=0).stop 2023-08-09T12:42:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.703+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e815cac0 msgr2=0x7f70e81f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.703+0000 7f70eef01640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e815cac0 0x7f70e81f5ce0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c430 tx=0x7f70d800c8f0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.704+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 shutdown_connections 2023-08-09T12:42:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.704+0000 7f70eef01640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f70d406a050 0x7f70d406c510 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.704+0000 7f70eef01640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70e815cea0 0x7f70e81f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.704+0000 7f70eef01640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e815cac0 0x7f70e81f5ce0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.704+0000 7f70eef01640 1 --2- 172.21.15.17:0/2523156435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70e80cffd0 0x7f70e8152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.704+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 >> 172.21.15.17:0/2523156435 conn(0x7f70e80699a0 msgr2=0x7f70e80d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.704+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 shutdown_connections 2023-08-09T12:42:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.704+0000 7f70eef01640 1 -- 172.21.15.17:0/2523156435 wait complete. 2023-08-09T12:42:43.729 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-09T12:42:43.730 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:42:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.957+0000 7f8e7dc6a640 1 Processor -- start 2023-08-09T12:42:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.958+0000 7f8e7dc6a640 1 -- start start 2023-08-09T12:42:43.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.959+0000 7f8e7dc6a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e780cfb50 0x7f8e78167a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.959+0000 7f8e7dc6a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780b5a30 con 0x7f8e780b86e0 2023-08-09T12:42:43.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.959+0000 7f8e7dc6a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780d0d70 con 0x7f8e78160030 2023-08-09T12:42:43.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.959+0000 7f8e7dc6a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e780d1110 con 0x7f8e780cfb50 2023-08-09T12:42:43.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.960+0000 7f8e6ffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8e780b86e0 0x7f8e780cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49008/0 (socket says 172.21.15.17:49008) 2023-08-09T12:42:43.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.960+0000 7f8e6ffff640 1 -- 172.21.15.17:0/3223504405 learned_addr learned my addr 172.21.15.17:0/3223504405 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.960+0000 7f8e7d469640 1 --2- 172.21.15.17:0/3223504405 >> v2:172.21.15.142:3300/0 conn(0x7f8e780cfb50 0x7f8e78167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.960+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197455791 0 0) 0x7f8e780b5a30 con 0x7f8e780b86e0 2023-08-09T12:42:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.960+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e60003520 con 0x7f8e780b86e0 2023-08-09T12:42:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2698794076 0 0) 0x7f8e60003520 con 0x7f8e780b86e0 2023-08-09T12:42:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 >> v2:172.21.15.142:3300/0 conn(0x7f8e780cfb50 msgr2=0x7f8e78167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 --2- 172.21.15.17:0/3223504405 >> v2:172.21.15.142:3300/0 conn(0x7f8e780cfb50 0x7f8e78167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 >> v1:172.21.15.142:6789/0 conn(0x7f8e78160030 legacy=0x7f8e78160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e78160f70 con 0x7f8e780b86e0 2023-08-09T12:42:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8e68001690 con 0x7f8e780b86e0 2023-08-09T12:42:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 >> v1:172.21.15.17:6789/0 conn(0x7f8e780b86e0 legacy=0x7f8e780cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e60003970 0x7f8e60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e600047c0 0x7f8e60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e60005180 0x7f8e6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780d1110 con 0x7f8e600047c0 2023-08-09T12:42:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6000c020 con 0x7f8e60003970 2023-08-09T12:42:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6000c1e0 con 0x7f8e60005180 2023-08-09T12:42:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e600047c0 0x7f8e60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.961+0000 7f8e7cc68640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e60003970 0x7f8e60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.962+0000 7f8e7d469640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e60005180 0x7f8e6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.962+0000 7f8e6ffff640 1 -- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e60005180 msgr2=0x7f8e6000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.962+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e60005180 0x7f8e6000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.962+0000 7f8e6ffff640 1 -- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e60003970 msgr2=0x7f8e60003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.962+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e60003970 0x7f8e60003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.962+0000 7f8e6ffff640 1 -- 172.21.15.17:0/3223504405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60003520 con 0x7f8e600047c0 2023-08-09T12:42:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.962+0000 7f8e7d469640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e60005180 0x7f8e6000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.962+0000 7f8e7d469640 1 -- 172.21.15.17:0/3223504405 reap_dead start 2023-08-09T12:42:43.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.963+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e600047c0 0x7f8e60004c40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800c210 tx=0x7f8e600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bf30987f2570e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.963+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68005ad0 con 0x7f8e600047c0 2023-08-09T12:42:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.963+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e68005c30 con 0x7f8e600047c0 2023-08-09T12:42:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.963+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3223504405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6802c790 con 0x7f8e600047c0 2023-08-09T12:42:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.964+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/3223504405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e600047c0 msgr2=0x7f8e60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.964+0000 7f8e7dc6a640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e600047c0 0x7f8e60004c40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800c210 tx=0x7f8e600057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.964+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/3223504405 shutdown_connections 2023-08-09T12:42:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.964+0000 7f8e7dc6a640 1 --2- 172.21.15.17:0/3223504405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e600047c0 0x7f8e60004c40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.964+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/3223504405 >> 172.21.15.17:0/3223504405 conn(0x7f8e780697c0 msgr2=0x7f8e78069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.964+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/3223504405 shutdown_connections 2023-08-09T12:42:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.964+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/3223504405 wait complete. 2023-08-09T12:42:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.966+0000 7f8e7dc6a640 1 Processor -- start 2023-08-09T12:42:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.966+0000 7f8e7dc6a640 1 -- start start 2023-08-09T12:42:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7dc6a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e600047c0 0x7f8e780cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7dc6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e780c7e00 0x7f8e780c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7dc6a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e78148580 0x7f8e78148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7dc6a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780cb740 con 0x7f8e78148580 2023-08-09T12:42:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7dc6a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780c87c0 con 0x7f8e780c7e00 2023-08-09T12:42:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7dc6a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780b34a0 con 0x7f8e600047c0 2023-08-09T12:42:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7d469640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e78148580 0x7f8e78148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7d469640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e78148580 0x7f8e78148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39198/0 (socket says 172.21.15.17:39198) 2023-08-09T12:42:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.967+0000 7f8e7d469640 1 -- 172.21.15.17:0/2203153380 learned_addr learned my addr 172.21.15.17:0/2203153380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e7cc68640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e600047c0 0x7f8e780cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e780c7e00 0x7f8e780c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e7d469640 1 -- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e600047c0 msgr2=0x7f8e780cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e7d469640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e600047c0 0x7f8e780cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e7d469640 1 -- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e780c7e00 msgr2=0x7f8e780c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e7d469640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e780c7e00 0x7f8e780c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e7d469640 1 -- 172.21.15.17:0/2203153380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780c9de0 con 0x7f8e78148580 2023-08-09T12:42:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e7d469640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e78148580 0x7f8e78148a00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8e780cd2c0 tx=0x7f8e7000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/2203153380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70016620 con 0x7f8e78148580 2023-08-09T12:42:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/2203153380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70016780 con 0x7f8e78148580 2023-08-09T12:42:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/2203153380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70016af0 con 0x7f8e78148580 2023-08-09T12:42:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.968+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e780b2890 con 0x7f8e78148580 2023-08-09T12:42:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.969+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e780b2e50 con 0x7f8e78148580 2023-08-09T12:42:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.970+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7804e390 con 0x7f8e78148580 2023-08-09T12:42:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.971+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/2203153380 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e70016c50 con 0x7f8e78148580 2023-08-09T12:42:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.972+0000 7f8e6d7fa640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6406a050 0x7f8e6406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.972+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/2203153380 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e70089350 con 0x7f8e78148580 2023-08-09T12:42:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.973+0000 7f8e7cc68640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6406a050 0x7f8e6406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.974+0000 7f8e7cc68640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6406a050 0x7f8e6406c510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000c00 tx=0x7f8e74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:43.977+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/2203153380 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8e70054a40 con 0x7f8e78148580 2023-08-09T12:42:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.168+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e78161530 con 0x7f8e6406a050 2023-08-09T12:42:44.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.192+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/2203153380 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302794 (secure 0 0 0) 0x7f8e74001350 con 0x7f8e6406a050 2023-08-09T12:42:44.197 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:44.201 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:42:44.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6406a050 msgr2=0x7f8e6406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:44.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6406a050 0x7f8e6406c510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000c00 tx=0x7f8e74009040 comp rx=0 tx=0).stop 2023-08-09T12:42:44.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e78148580 msgr2=0x7f8e78148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:44.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e78148580 0x7f8e78148a00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8e780cd2c0 tx=0x7f8e7000f520 comp rx=0 tx=0).stop 2023-08-09T12:42:44.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 shutdown_connections 2023-08-09T12:42:44.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6406a050 0x7f8e6406c510 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:44.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e78148580 0x7f8e78148a00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:44.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e780c7e00 0x7f8e780c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:44.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 --2- 172.21.15.17:0/2203153380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e600047c0 0x7f8e780cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:44.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 >> 172.21.15.17:0/2203153380 conn(0x7f8e780697c0 msgr2=0x7f8e780c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:44.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.200+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 shutdown_connections 2023-08-09T12:42:44.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:44.201+0000 7f8e7dc6a640 1 -- 172.21.15.17:0/2203153380 wait complete. 2023-08-09T12:42:44.225 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-08-09T12:42:42.707784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558365,"statfs":{"total":1600000000,"available":1595765836,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.481897"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231498+0000","last_change":"2023-08-09T12:42:37.257690+0000","last_active":"2023-08-09T12:42:38.231498+0000","last_peered":"2023-08-09T12:42:38.231498+0000","last_clean":"2023-08-09T12:42:38.231498+0000","last_became_active":"2023-08-09T12:42:37.257349+0000","last_became_peered":"2023-08-09T12:42:37.257349+0000","last_unstale":"2023-08-09T12:42:38.231498+0000","last_undegraded":"2023-08-09T12:42:38.231498+0000","last_fullsized":"2023-08-09T12:42:38.231498+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231473+0000","last_change":"2023-08-09T12:42:37.244290+0000","last_active":"2023-08-09T12:42:38.231473+0000","last_peered":"2023-08-09T12:42:38.231473+0000","last_clean":"2023-08-09T12:42:38.231473+0000","last_became_active":"2023-08-09T12:42:37.243902+0000","last_became_peered":"2023-08-09T12:42:37.243902+0000","last_unstale":"2023-08-09T12:42:38.231473+0000","last_undegraded":"2023-08-09T12:42:38.231473+0000","last_fullsized":"2023-08-09T12:42:38.231473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:26.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229660+0000","last_change":"2023-08-09T12:42:37.255754+0000","last_active":"2023-08-09T12:42:38.229660+0000","last_peered":"2023-08-09T12:42:38.229660+0000","last_clean":"2023-08-09T12:42:38.229660+0000","last_became_active":"2023-08-09T12:42:37.252509+0000","last_became_peered":"2023-08-09T12:42:37.252509+0000","last_unstale":"2023-08-09T12:42:38.229660+0000","last_undegraded":"2023-08-09T12:42:38.229660+0000","last_fullsized":"2023-08-09T12:42:38.229660+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:27:16.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233149+0000","last_change":"2023-08-09T12:42:37.262202+0000","last_active":"2023-08-09T12:42:38.233149+0000","last_peered":"2023-08-09T12:42:38.233149+0000","last_clean":"2023-08-09T12:42:38.233149+0000","last_became_active":"2023-08-09T12:42:37.259309+0000","last_became_peered":"2023-08-09T12:42:37.259309+0000","last_unstale":"2023-08-09T12:42:38.233149+0000","last_undegraded":"2023-08-09T12:42:38.233149+0000","last_fullsized":"2023-08-09T12:42:38.233149+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:08:52.077433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256898+0000","last_change":"2023-08-09T12:42:37.263229+0000","last_active":"2023-08-09T12:42:38.256898+0000","last_peered":"2023-08-09T12:42:38.256898+0000","last_clean":"2023-08-09T12:42:38.256898+0000","last_became_active":"2023-08-09T12:42:37.262833+0000","last_became_peered":"2023-08-09T12:42:37.262833+0000","last_unstale":"2023-08-09T12:42:38.256898+0000","last_undegraded":"2023-08-09T12:42:38.256898+0000","last_fullsized":"2023-08-09T12:42:38.256898+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:11:43.623157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254678+0000","last_change":"2023-08-09T12:42:37.252942+0000","last_active":"2023-08-09T12:42:38.254678+0000","last_peered":"2023-08-09T12:42:38.254678+0000","last_clean":"2023-08-09T12:42:38.254678+0000","last_became_active":"2023-08-09T12:42:37.252758+0000","last_became_peered":"2023-08-09T12:42:37.252758+0000","last_unstale":"2023-08-09T12:42:38.254678+0000","last_undegraded":"2023-08-09T12:42:38.254678+0000","last_fullsized":"2023-08-09T12:42:38.254678+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:26.801124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253758+0000","last_change":"2023-08-09T12:42:37.249929+0000","last_active":"2023-08-09T12:42:38.253758+0000","last_peered":"2023-08-09T12:42:38.253758+0000","last_clean":"2023-08-09T12:42:38.253758+0000","last_became_active":"2023-08-09T12:42:37.249679+0000","last_became_peered":"2023-08-09T12:42:37.249679+0000","last_unstale":"2023-08-09T12:42:38.253758+0000","last_undegraded":"2023-08-09T12:42:38.253758+0000","last_fullsized":"2023-08-09T12:42:38.253758+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:46:50.211162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254268+0000","last_change":"2023-08-09T12:42:37.255116+0000","last_active":"2023-08-09T12:42:38.254268+0000","last_peered":"2023-08-09T12:42:38.254268+0000","last_clean":"2023-08-09T12:42:38.254268+0000","last_became_active":"2023-08-09T12:42:37.254523+0000","last_became_peered":"2023-08-09T12:42:37.254523+0000","last_unstale":"2023-08-09T12:42:38.254268+0000","last_undegraded":"2023-08-09T12:42:38.254268+0000","last_fullsized":"2023-08-09T12:42:38.254268+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:23.535166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228334+0000","last_change":"2023-08-09T12:42:37.261563+0000","last_active":"2023-08-09T12:42:38.228334+0000","last_peered":"2023-08-09T12:42:38.228334+0000","last_clean":"2023-08-09T12:42:38.228334+0000","last_became_active":"2023-08-09T12:42:37.260798+0000","last_became_peered":"2023-08-09T12:42:37.260798+0000","last_unstale":"2023-08-09T12:42:38.228334+0000","last_undegraded":"2023-08-09T12:42:38.228334+0000","last_fullsized":"2023-08-09T12:42:38.228334+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:52:40.793910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229128+0000","last_change":"2023-08-09T12:42:37.251847+0000","last_active":"2023-08-09T12:42:38.229128+0000","last_peered":"2023-08-09T12:42:38.229128+0000","last_clean":"2023-08-09T12:42:38.229128+0000","last_became_active":"2023-08-09T12:42:37.251188+0000","last_became_peered":"2023-08-09T12:42:37.251188+0000","last_unstale":"2023-08-09T12:42:38.229128+0000","last_undegraded":"2023-08-09T12:42:38.229128+0000","last_fullsized":"2023-08-09T12:42:38.229128+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:24.349252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233723+0000","last_change":"2023-08-09T12:42:37.265000+0000","last_active":"2023-08-09T12:42:38.233723+0000","last_peered":"2023-08-09T12:42:38.233723+0000","last_clean":"2023-08-09T12:42:38.233723+0000","last_became_active":"2023-08-09T12:42:37.264693+0000","last_became_peered":"2023-08-09T12:42:37.264693+0000","last_unstale":"2023-08-09T12:42:38.233723+0000","last_undegraded":"2023-08-09T12:42:38.233723+0000","last_fullsized":"2023-08-09T12:42:38.233723+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:24.809472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254607+0000","last_change":"2023-08-09T12:42:37.256388+0000","last_active":"2023-08-09T12:42:38.254607+0000","last_peered":"2023-08-09T12:42:38.254607+0000","last_clean":"2023-08-09T12:42:38.254607+0000","last_became_active":"2023-08-09T12:42:37.255695+0000","last_became_peered":"2023-08-09T12:42:37.255695+0000","last_unstale":"2023-08-09T12:42:38.254607+0000","last_undegraded":"2023-08-09T12:42:38.254607+0000","last_fullsized":"2023-08-09T12:42:38.254607+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254807+0000","last_change":"2023-08-09T12:42:37.266385+0000","last_active":"2023-08-09T12:42:38.254807+0000","last_peered":"2023-08-09T12:42:38.254807+0000","last_clean":"2023-08-09T12:42:38.254807+0000","last_became_active":"2023-08-09T12:42:37.266135+0000","last_became_peered":"2023-08-09T12:42:37.266135+0000","last_unstale":"2023-08-09T12:42:38.254807+0000","last_undegraded":"2023-08-09T12:42:38.254807+0000","last_fullsized":"2023-08-09T12:42:38.254807+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:16.980624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228698+0000","last_change":"2023-08-09T12:42:37.254661+0000","last_active":"2023-08-09T12:42:38.228698+0000","last_peered":"2023-08-09T12:42:38.228698+0000","last_clean":"2023-08-09T12:42:38.228698+0000","last_became_active":"2023-08-09T12:42:37.253898+0000","last_became_peered":"2023-08-09T12:42:37.253898+0000","last_unstale":"2023-08-09T12:42:38.228698+0000","last_undegraded":"2023-08-09T12:42:38.228698+0000","last_fullsized":"2023-08-09T12:42:38.228698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:42:36.577077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229793+0000","last_change":"2023-08-09T12:42:37.251997+0000","last_active":"2023-08-09T12:42:38.229793+0000","last_peered":"2023-08-09T12:42:38.229793+0000","last_clean":"2023-08-09T12:42:38.229793+0000","last_became_active":"2023-08-09T12:42:37.251539+0000","last_became_peered":"2023-08-09T12:42:37.251539+0000","last_unstale":"2023-08-09T12:42:38.229793+0000","last_undegraded":"2023-08-09T12:42:38.229793+0000","last_fullsized":"2023-08-09T12:42:38.229793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:58:06.404500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254145+0000","last_change":"2023-08-09T12:42:37.254562+0000","last_active":"2023-08-09T12:42:38.254145+0000","last_peered":"2023-08-09T12:42:38.254145+0000","last_clean":"2023-08-09T12:42:38.254145+0000","last_became_active":"2023-08-09T12:42:37.254071+0000","last_became_peered":"2023-08-09T12:42:37.254071+0000","last_unstale":"2023-08-09T12:42:38.254145+0000","last_undegraded":"2023-08-09T12:42:38.254145+0000","last_fullsized":"2023-08-09T12:42:38.254145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:18:55.787676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231237+0000","last_change":"2023-08-09T12:42:37.261069+0000","last_active":"2023-08-09T12:42:38.231237+0000","last_peered":"2023-08-09T12:42:38.231237+0000","last_clean":"2023-08-09T12:42:38.231237+0000","last_became_active":"2023-08-09T12:42:37.260489+0000","last_became_peered":"2023-08-09T12:42:37.260489+0000","last_unstale":"2023-08-09T12:42:38.231237+0000","last_undegraded":"2023-08-09T12:42:38.231237+0000","last_fullsized":"2023-08-09T12:42:38.231237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.232630+0000","last_change":"2023-08-09T12:42:37.265525+0000","last_active":"2023-08-09T12:42:38.232630+0000","last_peered":"2023-08-09T12:42:38.232630+0000","last_clean":"2023-08-09T12:42:38.232630+0000","last_became_active":"2023-08-09T12:42:37.263159+0000","last_became_peered":"2023-08-09T12:42:37.263159+0000","last_unstale":"2023-08-09T12:42:38.232630+0000","last_undegraded":"2023-08-09T12:42:38.232630+0000","last_fullsized":"2023-08-09T12:42:38.232630+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:06:44.414616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254890+0000","last_change":"2023-08-09T12:42:37.237052+0000","last_active":"2023-08-09T12:42:38.254890+0000","last_peered":"2023-08-09T12:42:38.254890+0000","last_clean":"2023-08-09T12:42:38.254890+0000","last_became_active":"2023-08-09T12:42:37.235462+0000","last_became_peered":"2023-08-09T12:42:37.235462+0000","last_unstale":"2023-08-09T12:42:38.254890+0000","last_undegraded":"2023-08-09T12:42:38.254890+0000","last_fullsized":"2023-08-09T12:42:38.254890+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:51.561653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256691+0000","last_change":"2023-08-09T12:42:37.235114+0000","last_active":"2023-08-09T12:42:38.256691+0000","last_peered":"2023-08-09T12:42:38.256691+0000","last_clean":"2023-08-09T12:42:38.256691+0000","last_became_active":"2023-08-09T12:42:37.234851+0000","last_became_peered":"2023-08-09T12:42:37.234851+0000","last_unstale":"2023-08-09T12:42:38.256691+0000","last_undegraded":"2023-08-09T12:42:38.256691+0000","last_fullsized":"2023-08-09T12:42:38.256691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:50:54.810271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255004+0000","last_change":"2023-08-09T12:42:37.257315+0000","last_active":"2023-08-09T12:42:38.255004+0000","last_peered":"2023-08-09T12:42:38.255004+0000","last_clean":"2023-08-09T12:42:38.255004+0000","last_became_active":"2023-08-09T12:42:37.256728+0000","last_became_peered":"2023-08-09T12:42:37.256728+0000","last_unstale":"2023-08-09T12:42:38.255004+0000","last_undegraded":"2023-08-09T12:42:38.255004+0000","last_fullsized":"2023-08-09T12:42:38.255004+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:12.688961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255330+0000","last_change":"2023-08-09T12:42:37.252932+0000","last_active":"2023-08-09T12:42:38.255330+0000","last_peered":"2023-08-09T12:42:38.255330+0000","last_clean":"2023-08-09T12:42:38.255330+0000","last_became_active":"2023-08-09T12:42:37.252653+0000","last_became_peered":"2023-08-09T12:42:37.252653+0000","last_unstale":"2023-08-09T12:42:38.255330+0000","last_undegraded":"2023-08-09T12:42:38.255330+0000","last_fullsized":"2023-08-09T12:42:38.255330+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256190+0000","last_change":"2023-08-09T12:42:37.252813+0000","last_active":"2023-08-09T12:42:38.256190+0000","last_peered":"2023-08-09T12:42:38.256190+0000","last_clean":"2023-08-09T12:42:38.256190+0000","last_became_active":"2023-08-09T12:42:37.252548+0000","last_became_peered":"2023-08-09T12:42:37.252548+0000","last_unstale":"2023-08-09T12:42:38.256190+0000","last_undegraded":"2023-08-09T12:42:38.256190+0000","last_fullsized":"2023-08-09T12:42:38.256190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:26.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229098+0000","last_change":"2023-08-09T12:42:37.254862+0000","last_active":"2023-08-09T12:42:38.229098+0000","last_peered":"2023-08-09T12:42:38.229098+0000","last_clean":"2023-08-09T12:42:38.229098+0000","last_became_active":"2023-08-09T12:42:37.254345+0000","last_became_peered":"2023-08-09T12:42:37.254345+0000","last_unstale":"2023-08-09T12:42:38.229098+0000","last_undegraded":"2023-08-09T12:42:38.229098+0000","last_fullsized":"2023-08-09T12:42:38.229098+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:24:35.542487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255836+0000","last_change":"2023-08-09T12:42:37.257761+0000","last_active":"2023-08-09T12:42:38.255836+0000","last_peered":"2023-08-09T12:42:38.255836+0000","last_clean":"2023-08-09T12:42:38.255836+0000","last_became_active":"2023-08-09T12:42:37.256710+0000","last_became_peered":"2023-08-09T12:42:37.256710+0000","last_unstale":"2023-08-09T12:42:38.255836+0000","last_undegraded":"2023-08-09T12:42:38.255836+0000","last_fullsized":"2023-08-09T12:42:38.255836+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:50:54.810271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255369+0000","last_change":"2023-08-09T12:42:37.250443+0000","last_active":"2023-08-09T12:42:38.255369+0000","last_peered":"2023-08-09T12:42:38.255369+0000","last_clean":"2023-08-09T12:42:38.255369+0000","last_became_active":"2023-08-09T12:42:37.250067+0000","last_became_peered":"2023-08-09T12:42:37.250067+0000","last_unstale":"2023-08-09T12:42:38.255369+0000","last_undegraded":"2023-08-09T12:42:38.255369+0000","last_fullsized":"2023-08-09T12:42:38.255369+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233541+0000","last_change":"2023-08-09T12:42:37.262983+0000","last_active":"2023-08-09T12:42:38.233541+0000","last_peered":"2023-08-09T12:42:38.233541+0000","last_clean":"2023-08-09T12:42:38.233541+0000","last_became_active":"2023-08-09T12:42:37.262584+0000","last_became_peered":"2023-08-09T12:42:37.262584+0000","last_unstale":"2023-08-09T12:42:38.233541+0000","last_undegraded":"2023-08-09T12:42:38.233541+0000","last_fullsized":"2023-08-09T12:42:38.233541+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:25.440968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231169+0000","last_change":"2023-08-09T12:42:37.251672+0000","last_active":"2023-08-09T12:42:38.231169+0000","last_peered":"2023-08-09T12:42:38.231169+0000","last_clean":"2023-08-09T12:42:38.231169+0000","last_became_active":"2023-08-09T12:42:37.251006+0000","last_became_peered":"2023-08-09T12:42:37.251006+0000","last_unstale":"2023-08-09T12:42:38.231169+0000","last_undegraded":"2023-08-09T12:42:38.231169+0000","last_fullsized":"2023-08-09T12:42:38.231169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:23.535166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229732+0000","last_change":"2023-08-09T12:42:37.261725+0000","last_active":"2023-08-09T12:42:38.229732+0000","last_peered":"2023-08-09T12:42:38.229732+0000","last_clean":"2023-08-09T12:42:38.229732+0000","last_became_active":"2023-08-09T12:42:37.261351+0000","last_became_peered":"2023-08-09T12:42:37.261351+0000","last_unstale":"2023-08-09T12:42:38.229732+0000","last_undegraded":"2023-08-09T12:42:38.229732+0000","last_fullsized":"2023-08-09T12:42:38.229732+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:27:02.589200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256190+0000","last_change":"2023-08-09T12:42:37.258260+0000","last_active":"2023-08-09T12:42:38.256190+0000","last_peered":"2023-08-09T12:42:38.256190+0000","last_clean":"2023-08-09T12:42:38.256190+0000","last_became_active":"2023-08-09T12:42:37.257476+0000","last_became_peered":"2023-08-09T12:42:37.257476+0000","last_unstale":"2023-08-09T12:42:38.256190+0000","last_undegraded":"2023-08-09T12:42:38.256190+0000","last_fullsized":"2023-08-09T12:42:38.256190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:29:05.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234031+0000","last_change":"2023-08-09T12:42:37.262864+0000","last_active":"2023-08-09T12:42:38.234031+0000","last_peered":"2023-08-09T12:42:38.234031+0000","last_clean":"2023-08-09T12:42:38.234031+0000","last_became_active":"2023-08-09T12:42:37.262462+0000","last_became_peered":"2023-08-09T12:42:37.262462+0000","last_unstale":"2023-08-09T12:42:38.234031+0000","last_undegraded":"2023-08-09T12:42:38.234031+0000","last_fullsized":"2023-08-09T12:42:38.234031+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:55:01.843450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254314+0000","last_change":"2023-08-09T12:42:37.245820+0000","last_active":"2023-08-09T12:42:38.254314+0000","last_peered":"2023-08-09T12:42:38.254314+0000","last_clean":"2023-08-09T12:42:38.254314+0000","last_became_active":"2023-08-09T12:42:37.245517+0000","last_became_peered":"2023-08-09T12:42:37.245517+0000","last_unstale":"2023-08-09T12:42:38.254314+0000","last_undegraded":"2023-08-09T12:42:38.254314+0000","last_fullsized":"2023-08-09T12:42:38.254314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:16:28.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256433+0000","last_change":"2023-08-09T12:42:37.245182+0000","last_active":"2023-08-09T12:42:38.256433+0000","last_peered":"2023-08-09T12:42:38.256433+0000","last_clean":"2023-08-09T12:42:38.256433+0000","last_became_active":"2023-08-09T12:42:37.244705+0000","last_became_peered":"2023-08-09T12:42:37.244705+0000","last_unstale":"2023-08-09T12:42:38.256433+0000","last_undegraded":"2023-08-09T12:42:38.256433+0000","last_fullsized":"2023-08-09T12:42:38.256433+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:46.925490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"69'4","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231421+0000","last_change":"2023-08-09T12:42:36.248006+0000","last_active":"2023-08-09T12:42:38.231421+0000","last_peered":"2023-08-09T12:42:38.231421+0000","last_clean":"2023-08-09T12:42:38.231421+0000","last_became_active":"2023-08-09T12:42:36.247672+0000","last_became_peered":"2023-08-09T12:42:36.247672+0000","last_unstale":"2023-08-09T12:42:38.231421+0000","last_undegraded":"2023-08-09T12:42:38.231421+0000","last_fullsized":"2023-08-09T12:42:38.231421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:11.675220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233322+0000","last_change":"2023-08-09T12:42:37.264456+0000","last_active":"2023-08-09T12:42:38.233322+0000","last_peered":"2023-08-09T12:42:38.233322+0000","last_clean":"2023-08-09T12:42:38.233322+0000","last_became_active":"2023-08-09T12:42:37.263053+0000","last_became_peered":"2023-08-09T12:42:37.263053+0000","last_unstale":"2023-08-09T12:42:38.233322+0000","last_undegraded":"2023-08-09T12:42:38.233322+0000","last_fullsized":"2023-08-09T12:42:38.233322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:34.183173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254777+0000","last_change":"2023-08-09T12:42:36.244595+0000","last_active":"2023-08-09T12:42:38.254777+0000","last_peered":"2023-08-09T12:42:38.254777+0000","last_clean":"2023-08-09T12:42:38.254777+0000","last_became_active":"2023-08-09T12:42:36.244171+0000","last_became_peered":"2023-08-09T12:42:36.244171+0000","last_unstale":"2023-08-09T12:42:38.254777+0000","last_undegraded":"2023-08-09T12:42:38.254777+0000","last_fullsized":"2023-08-09T12:42:38.254777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:54:34.665925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255521+0000","last_change":"2023-08-09T12:42:37.244971+0000","last_active":"2023-08-09T12:42:38.255521+0000","last_peered":"2023-08-09T12:42:38.255521+0000","last_clean":"2023-08-09T12:42:38.255521+0000","last_became_active":"2023-08-09T12:42:37.244585+0000","last_became_peered":"2023-08-09T12:42:37.244585+0000","last_unstale":"2023-08-09T12:42:38.255521+0000","last_undegraded":"2023-08-09T12:42:38.255521+0000","last_fullsized":"2023-08-09T12:42:38.255521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:40:53.261326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255407+0000","last_change":"2023-08-09T12:42:36.247995+0000","last_active":"2023-08-09T12:42:38.255407+0000","last_peered":"2023-08-09T12:42:38.255407+0000","last_clean":"2023-08-09T12:42:38.255407+0000","last_became_active":"2023-08-09T12:42:36.247723+0000","last_became_peered":"2023-08-09T12:42:36.247723+0000","last_unstale":"2023-08-09T12:42:38.255407+0000","last_undegraded":"2023-08-09T12:42:38.255407+0000","last_fullsized":"2023-08-09T12:42:38.255407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:37:45.334556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230002+0000","last_change":"2023-08-09T12:42:37.253969+0000","last_active":"2023-08-09T12:42:38.230002+0000","last_peered":"2023-08-09T12:42:38.230002+0000","last_clean":"2023-08-09T12:42:38.230002+0000","last_became_active":"2023-08-09T12:42:37.251738+0000","last_became_peered":"2023-08-09T12:42:37.251738+0000","last_unstale":"2023-08-09T12:42:38.230002+0000","last_undegraded":"2023-08-09T12:42:38.230002+0000","last_fullsized":"2023-08-09T12:42:38.230002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:46.938046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255118+0000","last_change":"2023-08-09T12:42:36.243673+0000","last_active":"2023-08-09T12:42:38.255118+0000","last_peered":"2023-08-09T12:42:38.255118+0000","last_clean":"2023-08-09T12:42:38.255118+0000","last_became_active":"2023-08-09T12:42:36.242905+0000","last_became_peered":"2023-08-09T12:42:36.242905+0000","last_unstale":"2023-08-09T12:42:38.255118+0000","last_undegraded":"2023-08-09T12:42:38.255118+0000","last_fullsized":"2023-08-09T12:42:38.255118+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:40.755933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256768+0000","last_change":"2023-08-09T12:42:37.243362+0000","last_active":"2023-08-09T12:42:38.256768+0000","last_peered":"2023-08-09T12:42:38.256768+0000","last_clean":"2023-08-09T12:42:38.256768+0000","last_became_active":"2023-08-09T12:42:37.243127+0000","last_became_peered":"2023-08-09T12:42:37.243127+0000","last_unstale":"2023-08-09T12:42:38.256768+0000","last_undegraded":"2023-08-09T12:42:38.256768+0000","last_fullsized":"2023-08-09T12:42:38.256768+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:52:18.975764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255676+0000","last_change":"2023-08-09T12:42:36.249304+0000","last_active":"2023-08-09T12:42:38.255676+0000","last_peered":"2023-08-09T12:42:38.255676+0000","last_clean":"2023-08-09T12:42:38.255676+0000","last_became_active":"2023-08-09T12:42:36.244419+0000","last_became_peered":"2023-08-09T12:42:36.244419+0000","last_unstale":"2023-08-09T12:42:38.255676+0000","last_undegraded":"2023-08-09T12:42:38.255676+0000","last_fullsized":"2023-08-09T12:42:38.255676+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:15.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231164+0000","last_change":"2023-08-09T12:42:37.260175+0000","last_active":"2023-08-09T12:42:38.231164+0000","last_peered":"2023-08-09T12:42:38.231164+0000","last_clean":"2023-08-09T12:42:38.231164+0000","last_became_active":"2023-08-09T12:42:37.259927+0000","last_became_peered":"2023-08-09T12:42:37.259927+0000","last_unstale":"2023-08-09T12:42:38.231164+0000","last_undegraded":"2023-08-09T12:42:38.231164+0000","last_fullsized":"2023-08-09T12:42:38.231164+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:59:21.760170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256550+0000","last_change":"2023-08-09T12:42:36.239590+0000","last_active":"2023-08-09T12:42:38.256550+0000","last_peered":"2023-08-09T12:42:38.256550+0000","last_clean":"2023-08-09T12:42:38.256550+0000","last_became_active":"2023-08-09T12:42:36.238193+0000","last_became_peered":"2023-08-09T12:42:36.238193+0000","last_unstale":"2023-08-09T12:42:38.256550+0000","last_undegraded":"2023-08-09T12:42:38.256550+0000","last_fullsized":"2023-08-09T12:42:38.256550+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:48:53.749361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256573+0000","last_change":"2023-08-09T12:42:37.244814+0000","last_active":"2023-08-09T12:42:38.256573+0000","last_peered":"2023-08-09T12:42:38.256573+0000","last_clean":"2023-08-09T12:42:38.256573+0000","last_became_active":"2023-08-09T12:42:37.243517+0000","last_became_peered":"2023-08-09T12:42:37.243517+0000","last_unstale":"2023-08-09T12:42:38.256573+0000","last_undegraded":"2023-08-09T12:42:38.256573+0000","last_fullsized":"2023-08-09T12:42:38.256573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:09:23.914696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256583+0000","last_change":"2023-08-09T12:42:36.246355+0000","last_active":"2023-08-09T12:42:38.256583+0000","last_peered":"2023-08-09T12:42:38.256583+0000","last_clean":"2023-08-09T12:42:38.256583+0000","last_became_active":"2023-08-09T12:42:36.246037+0000","last_became_peered":"2023-08-09T12:42:36.246037+0000","last_unstale":"2023-08-09T12:42:38.256583+0000","last_undegraded":"2023-08-09T12:42:38.256583+0000","last_fullsized":"2023-08-09T12:42:38.256583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:36.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255505+0000","last_change":"2023-08-09T12:42:37.249061+0000","last_active":"2023-08-09T12:42:38.255505+0000","last_peered":"2023-08-09T12:42:38.255505+0000","last_clean":"2023-08-09T12:42:38.255505+0000","last_became_active":"2023-08-09T12:42:37.248755+0000","last_became_peered":"2023-08-09T12:42:37.248755+0000","last_unstale":"2023-08-09T12:42:38.255505+0000","last_undegraded":"2023-08-09T12:42:38.255505+0000","last_fullsized":"2023-08-09T12:42:38.255505+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:33.891845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257633+0000","last_change":"2023-08-09T12:42:36.240311+0000","last_active":"2023-08-09T12:42:38.257633+0000","last_peered":"2023-08-09T12:42:38.257633+0000","last_clean":"2023-08-09T12:42:38.257633+0000","last_became_active":"2023-08-09T12:42:36.239717+0000","last_became_peered":"2023-08-09T12:42:36.239717+0000","last_unstale":"2023-08-09T12:42:38.257633+0000","last_undegraded":"2023-08-09T12:42:38.257633+0000","last_fullsized":"2023-08-09T12:42:38.257633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:24:13.940215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230988+0000","last_change":"2023-08-09T12:42:37.242895+0000","last_active":"2023-08-09T12:42:38.230988+0000","last_peered":"2023-08-09T12:42:38.230988+0000","last_clean":"2023-08-09T12:42:38.230988+0000","last_became_active":"2023-08-09T12:42:37.242665+0000","last_became_peered":"2023-08-09T12:42:37.242665+0000","last_unstale":"2023-08-09T12:42:38.230988+0000","last_undegraded":"2023-08-09T12:42:38.230988+0000","last_fullsized":"2023-08-09T12:42:38.230988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:51.102811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228850+0000","last_change":"2023-08-09T12:42:36.249493+0000","last_active":"2023-08-09T12:42:38.228850+0000","last_peered":"2023-08-09T12:42:38.228850+0000","last_clean":"2023-08-09T12:42:38.228850+0000","last_became_active":"2023-08-09T12:42:36.247921+0000","last_became_peered":"2023-08-09T12:42:36.247921+0000","last_unstale":"2023-08-09T12:42:38.228850+0000","last_undegraded":"2023-08-09T12:42:38.228850+0000","last_fullsized":"2023-08-09T12:42:38.228850+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:22:15.550584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256367+0000","last_change":"2023-08-09T12:42:37.256381+0000","last_active":"2023-08-09T12:42:38.256367+0000","last_peered":"2023-08-09T12:42:38.256367+0000","last_clean":"2023-08-09T12:42:38.256367+0000","last_became_active":"2023-08-09T12:42:37.256112+0000","last_became_peered":"2023-08-09T12:42:37.256112+0000","last_unstale":"2023-08-09T12:42:38.256367+0000","last_undegraded":"2023-08-09T12:42:38.256367+0000","last_fullsized":"2023-08-09T12:42:38.256367+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234030+0000","last_change":"2023-08-09T12:42:36.247625+0000","last_active":"2023-08-09T12:42:38.234030+0000","last_peered":"2023-08-09T12:42:38.234030+0000","last_clean":"2023-08-09T12:42:38.234030+0000","last_became_active":"2023-08-09T12:42:36.247369+0000","last_became_peered":"2023-08-09T12:42:36.247369+0000","last_unstale":"2023-08-09T12:42:38.234030+0000","last_undegraded":"2023-08-09T12:42:38.234030+0000","last_fullsized":"2023-08-09T12:42:38.234030+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:49:49.885647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256867+0000","last_change":"2023-08-09T12:42:37.252587+0000","last_active":"2023-08-09T12:42:38.256867+0000","last_peered":"2023-08-09T12:42:38.256867+0000","last_clean":"2023-08-09T12:42:38.256867+0000","last_became_active":"2023-08-09T12:42:37.252346+0000","last_became_peered":"2023-08-09T12:42:37.252346+0000","last_unstale":"2023-08-09T12:42:38.256867+0000","last_undegraded":"2023-08-09T12:42:38.256867+0000","last_fullsized":"2023-08-09T12:42:38.256867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:40.114216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"69'3","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230989+0000","last_change":"2023-08-09T12:42:36.246431+0000","last_active":"2023-08-09T12:42:38.230989+0000","last_peered":"2023-08-09T12:42:38.230989+0000","last_clean":"2023-08-09T12:42:38.230989+0000","last_became_active":"2023-08-09T12:42:36.245840+0000","last_became_peered":"2023-08-09T12:42:36.245840+0000","last_unstale":"2023-08-09T12:42:38.230989+0000","last_undegraded":"2023-08-09T12:42:38.230989+0000","last_fullsized":"2023-08-09T12:42:38.230989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:42:31.943095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234235+0000","last_change":"2023-08-09T12:42:37.258874+0000","last_active":"2023-08-09T12:42:38.234235+0000","last_peered":"2023-08-09T12:42:38.234235+0000","last_clean":"2023-08-09T12:42:38.234235+0000","last_became_active":"2023-08-09T12:42:37.258612+0000","last_became_peered":"2023-08-09T12:42:37.258612+0000","last_unstale":"2023-08-09T12:42:38.234235+0000","last_undegraded":"2023-08-09T12:42:38.234235+0000","last_fullsized":"2023-08-09T12:42:38.234235+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:38.405159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"69'6","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231262+0000","last_change":"2023-08-09T12:42:36.248155+0000","last_active":"2023-08-09T12:42:38.231262+0000","last_peered":"2023-08-09T12:42:38.231262+0000","last_clean":"2023-08-09T12:42:38.231262+0000","last_became_active":"2023-08-09T12:42:36.247743+0000","last_became_peered":"2023-08-09T12:42:36.247743+0000","last_unstale":"2023-08-09T12:42:38.231262+0000","last_undegraded":"2023-08-09T12:42:38.231262+0000","last_fullsized":"2023-08-09T12:42:38.231262+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:32.878105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.232986+0000","last_change":"2023-08-09T12:42:37.265931+0000","last_active":"2023-08-09T12:42:38.232986+0000","last_peered":"2023-08-09T12:42:38.232986+0000","last_clean":"2023-08-09T12:42:38.232986+0000","last_became_active":"2023-08-09T12:42:37.264827+0000","last_became_peered":"2023-08-09T12:42:37.264827+0000","last_unstale":"2023-08-09T12:42:38.232986+0000","last_undegraded":"2023-08-09T12:42:38.232986+0000","last_fullsized":"2023-08-09T12:42:38.232986+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:50.058728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229457+0000","last_change":"2023-08-09T12:42:36.245706+0000","last_active":"2023-08-09T12:42:38.229457+0000","last_peered":"2023-08-09T12:42:38.229457+0000","last_clean":"2023-08-09T12:42:38.229457+0000","last_became_active":"2023-08-09T12:42:36.245288+0000","last_became_peered":"2023-08-09T12:42:36.245288+0000","last_unstale":"2023-08-09T12:42:38.229457+0000","last_undegraded":"2023-08-09T12:42:38.229457+0000","last_fullsized":"2023-08-09T12:42:38.229457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:20:56.533915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254961+0000","last_change":"2023-08-09T12:42:37.250535+0000","last_active":"2023-08-09T12:42:38.254961+0000","last_peered":"2023-08-09T12:42:38.254961+0000","last_clean":"2023-08-09T12:42:38.254961+0000","last_became_active":"2023-08-09T12:42:37.250315+0000","last_became_peered":"2023-08-09T12:42:37.250315+0000","last_unstale":"2023-08-09T12:42:38.254961+0000","last_undegraded":"2023-08-09T12:42:38.254961+0000","last_fullsized":"2023-08-09T12:42:38.254961+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:35.083219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255850+0000","last_change":"2023-08-09T12:42:36.249379+0000","last_active":"2023-08-09T12:42:38.255850+0000","last_peered":"2023-08-09T12:42:38.255850+0000","last_clean":"2023-08-09T12:42:38.255850+0000","last_became_active":"2023-08-09T12:42:36.249139+0000","last_became_peered":"2023-08-09T12:42:36.249139+0000","last_unstale":"2023-08-09T12:42:38.255850+0000","last_undegraded":"2023-08-09T12:42:38.255850+0000","last_fullsized":"2023-08-09T12:42:38.255850+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:52.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256800+0000","last_change":"2023-08-09T12:42:37.239032+0000","last_active":"2023-08-09T12:42:38.256800+0000","last_peered":"2023-08-09T12:42:38.256800+0000","last_clean":"2023-08-09T12:42:38.256800+0000","last_became_active":"2023-08-09T12:42:37.238305+0000","last_became_peered":"2023-08-09T12:42:37.238305+0000","last_unstale":"2023-08-09T12:42:38.256800+0000","last_undegraded":"2023-08-09T12:42:38.256800+0000","last_fullsized":"2023-08-09T12:42:38.256800+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:36:19.643134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229362+0000","last_change":"2023-08-09T12:42:36.240822+0000","last_active":"2023-08-09T12:42:38.229362+0000","last_peered":"2023-08-09T12:42:38.229362+0000","last_clean":"2023-08-09T12:42:38.229362+0000","last_became_active":"2023-08-09T12:42:36.239779+0000","last_became_peered":"2023-08-09T12:42:36.239779+0000","last_unstale":"2023-08-09T12:42:38.229362+0000","last_undegraded":"2023-08-09T12:42:38.229362+0000","last_fullsized":"2023-08-09T12:42:38.229362+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:18:20.950202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231482+0000","last_change":"2023-08-09T12:42:37.252422+0000","last_active":"2023-08-09T12:42:38.231482+0000","last_peered":"2023-08-09T12:42:38.231482+0000","last_clean":"2023-08-09T12:42:38.231482+0000","last_became_active":"2023-08-09T12:42:37.251894+0000","last_became_peered":"2023-08-09T12:42:37.251894+0000","last_unstale":"2023-08-09T12:42:38.231482+0000","last_undegraded":"2023-08-09T12:42:38.231482+0000","last_fullsized":"2023-08-09T12:42:38.231482+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:35.083219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"69'8","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233708+0000","last_change":"2023-08-09T12:42:36.246725+0000","last_active":"2023-08-09T12:42:38.233708+0000","last_peered":"2023-08-09T12:42:38.233708+0000","last_clean":"2023-08-09T12:42:38.233708+0000","last_became_active":"2023-08-09T12:42:36.246443+0000","last_became_peered":"2023-08-09T12:42:36.246443+0000","last_unstale":"2023-08-09T12:42:38.233708+0000","last_undegraded":"2023-08-09T12:42:38.233708+0000","last_fullsized":"2023-08-09T12:42:38.233708+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:10.026311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255160+0000","last_change":"2023-08-09T12:42:37.265369+0000","last_active":"2023-08-09T12:42:38.255160+0000","last_peered":"2023-08-09T12:42:38.255160+0000","last_clean":"2023-08-09T12:42:38.255160+0000","last_became_active":"2023-08-09T12:42:37.265086+0000","last_became_peered":"2023-08-09T12:42:37.265086+0000","last_unstale":"2023-08-09T12:42:38.255160+0000","last_undegraded":"2023-08-09T12:42:38.255160+0000","last_fullsized":"2023-08-09T12:42:38.255160+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:35:19.472757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255330+0000","last_change":"2023-08-09T12:42:36.246114+0000","last_active":"2023-08-09T12:42:38.255330+0000","last_peered":"2023-08-09T12:42:38.255330+0000","last_clean":"2023-08-09T12:42:38.255330+0000","last_became_active":"2023-08-09T12:42:36.243762+0000","last_became_peered":"2023-08-09T12:42:36.243762+0000","last_unstale":"2023-08-09T12:42:38.255330+0000","last_undegraded":"2023-08-09T12:42:38.255330+0000","last_fullsized":"2023-08-09T12:42:38.255330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:24.987935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253453+0000","last_change":"2023-08-09T12:42:37.244546+0000","last_active":"2023-08-09T12:42:38.253453+0000","last_peered":"2023-08-09T12:42:38.253453+0000","last_clean":"2023-08-09T12:42:38.253453+0000","last_became_active":"2023-08-09T12:42:37.244085+0000","last_became_peered":"2023-08-09T12:42:37.244085+0000","last_unstale":"2023-08-09T12:42:38.253453+0000","last_undegraded":"2023-08-09T12:42:38.253453+0000","last_fullsized":"2023-08-09T12:42:38.253453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:32.254878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"70'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255755+0000","last_change":"2023-08-09T12:42:36.248626+0000","last_active":"2023-08-09T12:42:38.255755+0000","last_peered":"2023-08-09T12:42:38.255755+0000","last_clean":"2023-08-09T12:42:38.255755+0000","last_became_active":"2023-08-09T12:42:36.248040+0000","last_became_peered":"2023-08-09T12:42:36.248040+0000","last_unstale":"2023-08-09T12:42:38.255755+0000","last_undegraded":"2023-08-09T12:42:38.255755+0000","last_fullsized":"2023-08-09T12:42:38.255755+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:00:47.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255390+0000","last_change":"2023-08-09T12:42:37.254881+0000","last_active":"2023-08-09T12:42:38.255390+0000","last_peered":"2023-08-09T12:42:38.255390+0000","last_clean":"2023-08-09T12:42:38.255390+0000","last_became_active":"2023-08-09T12:42:37.254041+0000","last_became_peered":"2023-08-09T12:42:37.254041+0000","last_unstale":"2023-08-09T12:42:38.255390+0000","last_undegraded":"2023-08-09T12:42:38.255390+0000","last_fullsized":"2023-08-09T12:42:38.255390+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:48:54.763101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255145+0000","last_change":"2023-08-09T12:42:36.245523+0000","last_active":"2023-08-09T12:42:38.255145+0000","last_peered":"2023-08-09T12:42:38.255145+0000","last_clean":"2023-08-09T12:42:38.255145+0000","last_became_active":"2023-08-09T12:42:36.245182+0000","last_became_peered":"2023-08-09T12:42:36.245182+0000","last_unstale":"2023-08-09T12:42:38.255145+0000","last_undegraded":"2023-08-09T12:42:38.255145+0000","last_fullsized":"2023-08-09T12:42:38.255145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:20:34.684149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257284+0000","last_change":"2023-08-09T12:42:37.237192+0000","last_active":"2023-08-09T12:42:38.257284+0000","last_peered":"2023-08-09T12:42:38.257284+0000","last_clean":"2023-08-09T12:42:38.257284+0000","last_became_active":"2023-08-09T12:42:37.236530+0000","last_became_peered":"2023-08-09T12:42:37.236530+0000","last_unstale":"2023-08-09T12:42:38.257284+0000","last_undegraded":"2023-08-09T12:42:38.257284+0000","last_fullsized":"2023-08-09T12:42:38.257284+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:12:20.303269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231601+0000","last_change":"2023-08-09T12:42:36.245731+0000","last_active":"2023-08-09T12:42:38.231601+0000","last_peered":"2023-08-09T12:42:38.231601+0000","last_clean":"2023-08-09T12:42:38.231601+0000","last_became_active":"2023-08-09T12:42:36.245407+0000","last_became_peered":"2023-08-09T12:42:36.245407+0000","last_unstale":"2023-08-09T12:42:38.231601+0000","last_undegraded":"2023-08-09T12:42:38.231601+0000","last_fullsized":"2023-08-09T12:42:38.231601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:36.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256937+0000","last_change":"2023-08-09T12:42:37.247730+0000","last_active":"2023-08-09T12:42:38.256937+0000","last_peered":"2023-08-09T12:42:38.256937+0000","last_clean":"2023-08-09T12:42:38.256937+0000","last_became_active":"2023-08-09T12:42:37.243233+0000","last_became_peered":"2023-08-09T12:42:37.243233+0000","last_unstale":"2023-08-09T12:42:38.256937+0000","last_undegraded":"2023-08-09T12:42:38.256937+0000","last_fullsized":"2023-08-09T12:42:38.256937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:19.372664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229729+0000","last_change":"2023-08-09T12:42:36.234581+0000","last_active":"2023-08-09T12:42:38.229729+0000","last_peered":"2023-08-09T12:42:38.229729+0000","last_clean":"2023-08-09T12:42:38.229729+0000","last_became_active":"2023-08-09T12:42:36.233897+0000","last_became_peered":"2023-08-09T12:42:36.233897+0000","last_unstale":"2023-08-09T12:42:38.229729+0000","last_undegraded":"2023-08-09T12:42:38.229729+0000","last_fullsized":"2023-08-09T12:42:38.229729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:37:29.459073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233375+0000","last_change":"2023-08-09T12:42:37.265768+0000","last_active":"2023-08-09T12:42:38.233375+0000","last_peered":"2023-08-09T12:42:38.233375+0000","last_clean":"2023-08-09T12:42:38.233375+0000","last_became_active":"2023-08-09T12:42:37.264478+0000","last_became_peered":"2023-08-09T12:42:37.264478+0000","last_unstale":"2023-08-09T12:42:38.233375+0000","last_undegraded":"2023-08-09T12:42:38.233375+0000","last_fullsized":"2023-08-09T12:42:38.233375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:02.490679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256097+0000","last_change":"2023-08-09T12:42:36.238369+0000","last_active":"2023-08-09T12:42:38.256097+0000","last_peered":"2023-08-09T12:42:38.256097+0000","last_clean":"2023-08-09T12:42:38.256097+0000","last_became_active":"2023-08-09T12:42:36.238090+0000","last_became_peered":"2023-08-09T12:42:36.238090+0000","last_unstale":"2023-08-09T12:42:38.256097+0000","last_undegraded":"2023-08-09T12:42:38.256097+0000","last_fullsized":"2023-08-09T12:42:38.256097+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:11.675220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231081+0000","last_change":"2023-08-09T12:42:37.261187+0000","last_active":"2023-08-09T12:42:38.231081+0000","last_peered":"2023-08-09T12:42:38.231081+0000","last_clean":"2023-08-09T12:42:38.231081+0000","last_became_active":"2023-08-09T12:42:37.260814+0000","last_became_peered":"2023-08-09T12:42:37.260814+0000","last_unstale":"2023-08-09T12:42:38.231081+0000","last_undegraded":"2023-08-09T12:42:38.231081+0000","last_fullsized":"2023-08-09T12:42:38.231081+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:15:42.311935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256710+0000","last_change":"2023-08-09T12:42:36.239973+0000","last_active":"2023-08-09T12:42:38.256710+0000","last_peered":"2023-08-09T12:42:38.256710+0000","last_clean":"2023-08-09T12:42:38.256710+0000","last_became_active":"2023-08-09T12:42:36.238975+0000","last_became_peered":"2023-08-09T12:42:36.238975+0000","last_unstale":"2023-08-09T12:42:38.256710+0000","last_undegraded":"2023-08-09T12:42:38.256710+0000","last_fullsized":"2023-08-09T12:42:38.256710+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:52.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254326+0000","last_change":"2023-08-09T12:42:37.254391+0000","last_active":"2023-08-09T12:42:38.254326+0000","last_peered":"2023-08-09T12:42:38.254326+0000","last_clean":"2023-08-09T12:42:38.254326+0000","last_became_active":"2023-08-09T12:42:37.253699+0000","last_became_peered":"2023-08-09T12:42:37.253699+0000","last_unstale":"2023-08-09T12:42:38.254326+0000","last_undegraded":"2023-08-09T12:42:38.254326+0000","last_fullsized":"2023-08-09T12:42:38.254326+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:46:04.982543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231340+0000","last_change":"2023-08-09T12:42:36.240867+0000","last_active":"2023-08-09T12:42:38.231340+0000","last_peered":"2023-08-09T12:42:38.231340+0000","last_clean":"2023-08-09T12:42:38.231340+0000","last_became_active":"2023-08-09T12:42:36.240311+0000","last_became_peered":"2023-08-09T12:42:36.240311+0000","last_unstale":"2023-08-09T12:42:38.231340+0000","last_undegraded":"2023-08-09T12:42:38.231340+0000","last_fullsized":"2023-08-09T12:42:38.231340+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:15.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256923+0000","last_change":"2023-08-09T12:42:37.246164+0000","last_active":"2023-08-09T12:42:38.256923+0000","last_peered":"2023-08-09T12:42:38.256923+0000","last_clean":"2023-08-09T12:42:38.256923+0000","last_became_active":"2023-08-09T12:42:37.245810+0000","last_became_peered":"2023-08-09T12:42:37.245810+0000","last_unstale":"2023-08-09T12:42:38.256923+0000","last_undegraded":"2023-08-09T12:42:38.256923+0000","last_fullsized":"2023-08-09T12:42:38.256923+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:39:51.487806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256605+0000","last_change":"2023-08-09T12:42:36.246012+0000","last_active":"2023-08-09T12:42:38.256605+0000","last_peered":"2023-08-09T12:42:38.256605+0000","last_clean":"2023-08-09T12:42:38.256605+0000","last_became_active":"2023-08-09T12:42:36.245659+0000","last_became_peered":"2023-08-09T12:42:36.245659+0000","last_unstale":"2023-08-09T12:42:38.256605+0000","last_undegraded":"2023-08-09T12:42:38.256605+0000","last_fullsized":"2023-08-09T12:42:38.256605+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:00:47.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":264,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230364+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:42:38.230364+0000","last_peered":"2023-08-09T12:42:38.230364+0000","last_clean":"2023-08-09T12:42:38.230364+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:42:38.230364+0000","last_undegraded":"2023-08-09T12:42:38.230364+0000","last_fullsized":"2023-08-09T12:42:38.230364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:14.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256167+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:42:38.256167+0000","last_peered":"2023-08-09T12:42:38.256167+0000","last_clean":"2023-08-09T12:42:38.256167+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:42:38.256167+0000","last_undegraded":"2023-08-09T12:42:38.256167+0000","last_fullsized":"2023-08-09T12:42:38.256167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:01.502439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254867+0000","last_change":"2023-08-09T12:42:37.244813+0000","last_active":"2023-08-09T12:42:38.254867+0000","last_peered":"2023-08-09T12:42:38.254867+0000","last_clean":"2023-08-09T12:42:38.254867+0000","last_became_active":"2023-08-09T12:42:37.244595+0000","last_became_peered":"2023-08-09T12:42:37.244595+0000","last_unstale":"2023-08-09T12:42:38.254867+0000","last_undegraded":"2023-08-09T12:42:38.254867+0000","last_fullsized":"2023-08-09T12:42:38.254867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:56.691180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254583+0000","last_change":"2023-08-09T12:42:36.246929+0000","last_active":"2023-08-09T12:42:38.254583+0000","last_peered":"2023-08-09T12:42:38.254583+0000","last_clean":"2023-08-09T12:42:38.254583+0000","last_became_active":"2023-08-09T12:42:36.246532+0000","last_became_peered":"2023-08-09T12:42:36.246532+0000","last_unstale":"2023-08-09T12:42:38.254583+0000","last_undegraded":"2023-08-09T12:42:38.254583+0000","last_fullsized":"2023-08-09T12:42:38.254583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:41:26.943555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230026+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:42:38.230026+0000","last_peered":"2023-08-09T12:42:38.230026+0000","last_clean":"2023-08-09T12:42:38.230026+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:42:38.230026+0000","last_undegraded":"2023-08-09T12:42:38.230026+0000","last_fullsized":"2023-08-09T12:42:38.230026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:17:55.155222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256527+0000","last_change":"2023-08-09T12:42:37.256965+0000","last_active":"2023-08-09T12:42:38.256527+0000","last_peered":"2023-08-09T12:42:38.256527+0000","last_clean":"2023-08-09T12:42:38.256527+0000","last_became_active":"2023-08-09T12:42:37.249660+0000","last_became_peered":"2023-08-09T12:42:37.249660+0000","last_unstale":"2023-08-09T12:42:38.256527+0000","last_undegraded":"2023-08-09T12:42:38.256527+0000","last_fullsized":"2023-08-09T12:42:38.256527+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:04.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254696+0000","last_change":"2023-08-09T12:42:36.249723+0000","last_active":"2023-08-09T12:42:38.254696+0000","last_peered":"2023-08-09T12:42:38.254696+0000","last_clean":"2023-08-09T12:42:38.254696+0000","last_became_active":"2023-08-09T12:42:36.249183+0000","last_became_peered":"2023-08-09T12:42:36.249183+0000","last_unstale":"2023-08-09T12:42:38.254696+0000","last_undegraded":"2023-08-09T12:42:38.254696+0000","last_fullsized":"2023-08-09T12:42:38.254696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:32.878105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253354+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:42:38.253354+0000","last_peered":"2023-08-09T12:42:38.253354+0000","last_clean":"2023-08-09T12:42:38.253354+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:42:38.253354+0000","last_undegraded":"2023-08-09T12:42:38.253354+0000","last_fullsized":"2023-08-09T12:42:38.253354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:07.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255244+0000","last_change":"2023-08-09T12:42:37.248058+0000","last_active":"2023-08-09T12:42:38.255244+0000","last_peered":"2023-08-09T12:42:38.255244+0000","last_clean":"2023-08-09T12:42:38.255244+0000","last_became_active":"2023-08-09T12:42:37.245837+0000","last_became_peered":"2023-08-09T12:42:37.245837+0000","last_unstale":"2023-08-09T12:42:38.255244+0000","last_undegraded":"2023-08-09T12:42:38.255244+0000","last_fullsized":"2023-08-09T12:42:38.255244+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:13:55.262326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255712+0000","last_change":"2023-08-09T12:42:36.242087+0000","last_active":"2023-08-09T12:42:38.255712+0000","last_peered":"2023-08-09T12:42:38.255712+0000","last_clean":"2023-08-09T12:42:38.255712+0000","last_became_active":"2023-08-09T12:42:36.241640+0000","last_became_peered":"2023-08-09T12:42:36.241640+0000","last_unstale":"2023-08-09T12:42:38.255712+0000","last_undegraded":"2023-08-09T12:42:38.255712+0000","last_fullsized":"2023-08-09T12:42:38.255712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:53:44.415681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255635+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:42:38.255635+0000","last_peered":"2023-08-09T12:42:38.255635+0000","last_clean":"2023-08-09T12:42:38.255635+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:42:38.255635+0000","last_undegraded":"2023-08-09T12:42:38.255635+0000","last_fullsized":"2023-08-09T12:42:38.255635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:19.489283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229156+0000","last_change":"2023-08-09T12:42:37.261247+0000","last_active":"2023-08-09T12:42:38.229156+0000","last_peered":"2023-08-09T12:42:38.229156+0000","last_clean":"2023-08-09T12:42:38.229156+0000","last_became_active":"2023-08-09T12:42:37.260975+0000","last_became_peered":"2023-08-09T12:42:37.260975+0000","last_unstale":"2023-08-09T12:42:38.229156+0000","last_undegraded":"2023-08-09T12:42:38.229156+0000","last_fullsized":"2023-08-09T12:42:38.229156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:28.452927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254355+0000","last_change":"2023-08-09T12:42:36.249872+0000","last_active":"2023-08-09T12:42:38.254355+0000","last_peered":"2023-08-09T12:42:38.254355+0000","last_clean":"2023-08-09T12:42:38.254355+0000","last_became_active":"2023-08-09T12:42:36.249491+0000","last_became_peered":"2023-08-09T12:42:36.249491+0000","last_unstale":"2023-08-09T12:42:38.254355+0000","last_undegraded":"2023-08-09T12:42:38.254355+0000","last_fullsized":"2023-08-09T12:42:38.254355+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:59:20.746429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231734+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:42:38.231734+0000","last_peered":"2023-08-09T12:42:38.231734+0000","last_clean":"2023-08-09T12:42:38.231734+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:42:38.231734+0000","last_undegraded":"2023-08-09T12:42:38.231734+0000","last_fullsized":"2023-08-09T12:42:38.231734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:57:30.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257183+0000","last_change":"2023-08-09T12:42:37.259218+0000","last_active":"2023-08-09T12:42:38.257183+0000","last_peered":"2023-08-09T12:42:38.257183+0000","last_clean":"2023-08-09T12:42:38.257183+0000","last_became_active":"2023-08-09T12:42:37.258966+0000","last_became_peered":"2023-08-09T12:42:37.258966+0000","last_unstale":"2023-08-09T12:42:38.257183+0000","last_undegraded":"2023-08-09T12:42:38.257183+0000","last_fullsized":"2023-08-09T12:42:38.257183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:00.847580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230119+0000","last_change":"2023-08-09T12:42:36.246540+0000","last_active":"2023-08-09T12:42:38.230119+0000","last_peered":"2023-08-09T12:42:38.230119+0000","last_clean":"2023-08-09T12:42:38.230119+0000","last_became_active":"2023-08-09T12:42:36.246233+0000","last_became_peered":"2023-08-09T12:42:36.246233+0000","last_unstale":"2023-08-09T12:42:38.230119+0000","last_undegraded":"2023-08-09T12:42:38.230119+0000","last_fullsized":"2023-08-09T12:42:38.230119+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:59:26.390587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229402+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:42:38.229402+0000","last_peered":"2023-08-09T12:42:38.229402+0000","last_clean":"2023-08-09T12:42:38.229402+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:42:38.229402+0000","last_undegraded":"2023-08-09T12:42:38.229402+0000","last_fullsized":"2023-08-09T12:42:38.229402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:39.963390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233650+0000","last_change":"2023-08-09T12:42:37.263524+0000","last_active":"2023-08-09T12:42:38.233650+0000","last_peered":"2023-08-09T12:42:38.233650+0000","last_clean":"2023-08-09T12:42:38.233650+0000","last_became_active":"2023-08-09T12:42:37.262444+0000","last_became_peered":"2023-08-09T12:42:37.262444+0000","last_unstale":"2023-08-09T12:42:38.233650+0000","last_undegraded":"2023-08-09T12:42:38.233650+0000","last_fullsized":"2023-08-09T12:42:38.233650+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:12.375809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229273+0000","last_change":"2023-08-09T12:42:36.248225+0000","last_active":"2023-08-09T12:42:38.229273+0000","last_peered":"2023-08-09T12:42:38.229273+0000","last_clean":"2023-08-09T12:42:38.229273+0000","last_became_active":"2023-08-09T12:42:36.245387+0000","last_became_peered":"2023-08-09T12:42:36.245387+0000","last_unstale":"2023-08-09T12:42:38.229273+0000","last_undegraded":"2023-08-09T12:42:38.229273+0000","last_fullsized":"2023-08-09T12:42:38.229273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:58.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231601+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:42:38.231601+0000","last_peered":"2023-08-09T12:42:38.231601+0000","last_clean":"2023-08-09T12:42:38.231601+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:42:38.231601+0000","last_undegraded":"2023-08-09T12:42:38.231601+0000","last_fullsized":"2023-08-09T12:42:38.231601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:36.822990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254547+0000","last_change":"2023-08-09T12:42:37.237486+0000","last_active":"2023-08-09T12:42:38.254547+0000","last_peered":"2023-08-09T12:42:38.254547+0000","last_clean":"2023-08-09T12:42:38.254547+0000","last_became_active":"2023-08-09T12:42:37.236380+0000","last_became_peered":"2023-08-09T12:42:37.236380+0000","last_unstale":"2023-08-09T12:42:38.254547+0000","last_undegraded":"2023-08-09T12:42:38.254547+0000","last_fullsized":"2023-08-09T12:42:38.254547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:26.602443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255841+0000","last_change":"2023-08-09T12:42:36.249795+0000","last_active":"2023-08-09T12:42:38.255841+0000","last_peered":"2023-08-09T12:42:38.255841+0000","last_clean":"2023-08-09T12:42:38.255841+0000","last_became_active":"2023-08-09T12:42:36.248860+0000","last_became_peered":"2023-08-09T12:42:36.248860+0000","last_unstale":"2023-08-09T12:42:38.255841+0000","last_undegraded":"2023-08-09T12:42:38.255841+0000","last_fullsized":"2023-08-09T12:42:38.255841+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:34.069478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257590+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:42:38.257590+0000","last_peered":"2023-08-09T12:42:38.257590+0000","last_clean":"2023-08-09T12:42:38.257590+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:42:38.257590+0000","last_undegraded":"2023-08-09T12:42:38.257590+0000","last_fullsized":"2023-08-09T12:42:38.257590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:34:45.359471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194363,"statfs":{"total":200000000,"available":199027780,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.619,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0940000000000001,"15min":1.0660000000000001},"min":{"1min":0.70799999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.601,"5min":1.843,"15min":1.843},"last":1.1990000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1180000000000001,"15min":1.0860000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.708,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7030000000000001,"5min":1.734,"15min":1.734},"last":0.81399999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.1739999999999999,"15min":1.1399999999999999},"min":{"1min":0.85299999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.625,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.167,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.637,"5min":2.173,"15min":2.173},"last":1.3220000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2210000000000001,"15min":1.212},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5860000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.115},{"interface":"front","average":{"1min":1.292,"5min":1.2689999999999999,"15min":1.2490000000000001},"min":{"1min":0.91600000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":1.03}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.224,"15min":1.1990000000000001},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.5509999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.274,"15min":1.2470000000000001},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.615,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.25}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3140000000000001,"15min":1.2689999999999999},"min":{"1min":0.751,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7849999999999999,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.7},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4790000000000001,"15min":1.4750000000000001},"min":{"1min":0.90100000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5980000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.53}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4710000000000001,"15min":1.464},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.788,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.83699999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.6779999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.575}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.1120000000000001},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5449999999999999,"5min":2.54,"15min":2.54},"last":1.466},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0760000000000001,"15min":1.0549999999999999},"min":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.7010000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.246,"15min":1.228},"min":{"1min":0.874,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7210000000000001,"5min":2.306,"15min":2.306},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3280000000000001,"15min":1.3109999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.671,"5min":1.829,"15min":1.829},"last":1.167}]},{"osd":2,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.093,"15min":1.0820000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4490000000000001,"5min":1.554,"15min":1.554},"last":1.409},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2809999999999999,"15min":1.2649999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.923,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.5940000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":0.86799999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7150000000000001,"5min":2.004,"15min":2.004},"last":1.8240000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.27},"min":{"1min":0.84599999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6579999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.268}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.319,"15min":1.2889999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0590000000000002,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.353,"15min":1.325},"min":{"1min":1.056,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1059999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.9399999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.327,"15min":1.3089999999999999},"min":{"1min":1.022,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.8240000000000001,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.496,"15min":1.462},"min":{"1min":1.1830000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.4350000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":2.1240000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.4570000000000001,"15min":1.393},"min":{"1min":1.145,"5min":0.752,"15min":0.752},"max":{"1min":2.2610000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":2.0840000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.446,"15min":1.3999999999999999},"min":{"1min":1.0509999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.161,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":2.0459999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1120000000000001,"15min":1.1100000000000001},"min":{"1min":0.67600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.649,"5min":2.427,"15min":2.427},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.073,"15min":1.0429999999999999},"min":{"1min":0.71699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.575,"5min":1.851,"15min":1.851},"last":1.0169999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2909999999999999,"15min":1.276},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.766,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2569999999999999,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.298}]},{"osd":2,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.88500000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.427},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.95299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.5449999999999999,"5min":1.728,"15min":1.728},"last":1.1040000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2030000000000001,"15min":1.177},"min":{"1min":0.86499999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.373},"min":{"1min":0.879,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7050000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.5109999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.228,"15min":1.224},"min":{"1min":0.85899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.343},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.94099999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.7450000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1910000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.339,"15min":1.3280000000000001},"min":{"1min":0.96699999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.804,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.571},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.458,"15min":1.5},"min":{"1min":1.0920000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.8029999999999999,"5min":2.948,"15min":2.948},"last":1.2549999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":1.111,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7969999999999999,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5089999999999999,"15min":1.504},"min":{"1min":1.1060000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.623}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":373,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199617312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.0940000000000001,"15min":1.071},"min":{"1min":0.81999999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6439999999999999,"5min":1.77,"15min":1.77},"last":1.8520000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.103,"15min":1.081},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.72}]},{"osd":1,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3069999999999999,"15min":1.355},"min":{"1min":0.83199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.897,"5min":1.97,"15min":1.97},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.335,"15min":1.3400000000000001},"min":{"1min":0.95699999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6359999999999999,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.758}]},{"osd":2,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.3140000000000001,"15min":1.321},"min":{"1min":0.88100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5329999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.325,"15min":1.3129999999999999},"min":{"1min":0.90200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7270000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5720000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.204},"min":{"1min":0.79200000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.49},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.337},"min":{"1min":0.97899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.3500000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3819999999999999,"15min":1.4039999999999999},"min":{"1min":0.92500000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.853,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.073},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.371,"15min":1.379},"min":{"1min":0.98799999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.216}]},{"osd":6,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4610000000000001,"15min":1.5069999999999999},"min":{"1min":0.93200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.151},{"interface":"front","average":{"1min":1.554,"5min":1.5369999999999999,"15min":1.5429999999999999},"min":{"1min":1.278,"5min":0.755,"15min":0.755},"max":{"1min":1.9570000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.518,"15min":1.5169999999999999},"min":{"1min":1.085,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.605,"15min":1.637},"min":{"1min":1.1319999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.804}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.82599999999999996},"min":{"1min":0.44400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.4109999999999996,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.03,"5min":0.89200000000000002,"15min":0.86399999999999999},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.331}]},{"osd":1,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3049999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.159,"5min":0.93700000000000006,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.373,"15min":0.373},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.1220000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.2490000000000001,"15min":1.0900000000000001},"min":{"1min":0.47299999999999998,"5min":0.433,"15min":0.433},"max":{"1min":18.145,"5min":18.145,"15min":18.145},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.1759999999999999,"15min":1.1910000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.7050000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.95399999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.972,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.337,"15min":1.345},"min":{"1min":0.751,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.5960000000000001,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.026}]},{"osd":5,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.4769999999999999,"5min":1.5740000000000001,"15min":1.4430000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":18.094000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.3},{"interface":"front","average":{"1min":2.181,"5min":1.446,"15min":1.3120000000000001},"min":{"1min":0.96099999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":14.105,"5min":14.105,"15min":14.105},"last":1.4610000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.357,"15min":1.335},"min":{"1min":0.99399999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.3640000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3740000000000001,"15min":1.3720000000000001},"min":{"1min":1.0740000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.806,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.3859999999999999,"15min":1.365},"min":{"1min":1.008,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.429}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4570000000000001,"5min":1.716,"15min":1.716},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.46700000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4830000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.0880000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.504,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1339999999999999,"5min":1.466,"15min":1.466},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.024,"15min":1.05},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6200000000000001,"5min":1.869,"15min":1.869},"last":1.177}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.73899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5489999999999999,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1419999999999999,"15min":1.143},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.3560000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.399,"15min":1.403},"min":{"1min":0.93200000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.897,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.486},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.296,"15min":1.26},"min":{"1min":0.90600000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.819,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.7669999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.381,"15min":1.347},"min":{"1min":1.0580000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0539999999999998,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.484,"15min":1.482},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.804,"5min":4.806,"15min":4.806},"last":1.5800000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3049999999999999,"15min":1.29},"min":{"1min":0.83999999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.744,"5min":2.323,"15min":2.323},"last":1.863},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":1.0620000000000001,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9319999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.6140000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.353,"15min":1.3480000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6759999999999999,"5min":2.218,"15min":2.218},"last":1.97},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5209999999999999,"15min":1.5229999999999999},"min":{"1min":1.032,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.1949999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.9039999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89400000000000002},"min":{"1min":0.64400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.49399999999999999},{"interface":"front","average":{"1min":6.1859999999999999,"5min":1.917,"15min":1.2090000000000001},"min":{"1min":0.47799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":88.254999999999995,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.96399999999999997,"15min":0.92800000000000005},"min":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.127,"15min":1.087},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.016}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.238},{"interface":"front","average":{"1min":1.369,"5min":1,"15min":0.91600000000000004},"min":{"1min":0.53900000000000003,"5min":0.503,"15min":0.503},"max":{"1min":5.4320000000000004,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.80800000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":1.4810000000000001,"15min":1.268},"min":{"1min":0.93899999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":25.172000000000001,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.2869999999999999,"15min":1.2709999999999999},"min":{"1min":1.0289999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.534}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.96,"5min":1.6000000000000001,"15min":1.3759999999999999},"min":{"1min":0.90700000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":28.710000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3,"15min":1.258},"min":{"1min":0.91600000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.1739999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.4510000000000001,"15min":1.399},"min":{"1min":1.0860000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":6.0460000000000003,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.399},{"interface":"front","average":{"1min":1.423,"5min":1.3700000000000001,"15min":1.347},"min":{"1min":0.91300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.863,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.379}]},{"osd":7,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":3.0259999999999998,"5min":1.768,"15min":1.5549999999999999},"min":{"1min":0.98699999999999999,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":26.975999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.6499999999999999},{"interface":"front","average":{"1min":3.1640000000000001,"5min":1.7629999999999999,"15min":1.53},"min":{"1min":1.052,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":28.765000000000001,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.5129999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":948,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194363,"statfs":{"total":200000000,"available":199028556,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.50900000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":0.98599999999999999,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":6.1749999999999998,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":1.147}]},{"osd":2,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.95099999999999996,"15min":0.93700000000000006},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.657,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.538},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.0629999999999999,"15min":1.0049999999999999},"min":{"1min":0.59899999999999998,"5min":0.5,"15min":0.5},"max":{"1min":6.2549999999999999,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":0.98799999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":0.98399999999999999,"15min":0.91200000000000003},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1679999999999999,"15min":1.1659999999999999},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6000000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.2729999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.3660000000000001,"15min":1.3300000000000001},"min":{"1min":0.96299999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":9.9629999999999992,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.288,"15min":1.264},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.4330000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.3420000000000001,"15min":1.29},"min":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":10.004,"5min":10.004,"15min":10.004},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.369,"15min":1.365},"min":{"1min":0.87,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.909,"5min":2.161,"15min":2.161},"last":1.611}]},{"osd":6,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.377,"15min":1.3220000000000001},"min":{"1min":0.83699999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.4290000000000003,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.385},{"interface":"front","average":{"1min":1.881,"5min":1.472,"15min":1.415},"min":{"1min":1.093,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":9.9190000000000005,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.3200000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":1.552,"15min":1.4199999999999999},"min":{"1min":0.89300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":18.114000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.897,"5min":1.4930000000000001,"15min":1.4390000000000001},"min":{"1min":1.052,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":9.5640000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.5800000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:42:47.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:42:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.468+0000 7f924ee7c640 1 Processor -- start 2023-08-09T12:42:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.468+0000 7f924ee7c640 1 -- start start 2023-08-09T12:42:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.470+0000 7f924ee7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92480d30e0 0x7f92480b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.470+0000 7f924ee7c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480cdd10 con 0x7f924815ce90 2023-08-09T12:42:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.470+0000 7f924ee7c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480cdff0 con 0x7f92481616e0 2023-08-09T12:42:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.470+0000 7f924ee7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b6540 con 0x7f92480d30e0 2023-08-09T12:42:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.470+0000 7f924cc18640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f924815ce90 0x7f92480cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49012/0 (socket says 172.21.15.17:49012) 2023-08-09T12:42:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.470+0000 7f924cc18640 1 -- 172.21.15.17:0/1688444959 learned_addr learned my addr 172.21.15.17:0/1688444959 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f924d419640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92480d30e0 0x7f92480b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083864322 0 0) 0x7f92480cdd10 con 0x7f924815ce90 2023-08-09T12:42:47.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9230003520 con 0x7f924815ce90 2023-08-09T12:42:47.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1116138402 0 0) 0x7f9230003520 con 0x7f924815ce90 2023-08-09T12:42:47.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92480d30e0 msgr2=0x7f92480b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:47.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92480d30e0 0x7f92480b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 >> v1:172.21.15.142:6789/0 conn(0x7f92481616e0 legacy=0x7f92480d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:47.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480ce2d0 con 0x7f924815ce90 2023-08-09T12:42:47.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f9244001690 con 0x7f924815ce90 2023-08-09T12:42:47.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 >> v1:172.21.15.17:6789/0 conn(0x7f924815ce90 legacy=0x7f92480cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:47.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92300039a0 0x7f9230003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:47.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92300047c0 0x7f9230004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:47.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92480d30e0 0x7f9230005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b6540 con 0x7f92300047c0 2023-08-09T12:42:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923000ba60 con 0x7f92300039a0 2023-08-09T12:42:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.471+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923000bc20 con 0x7f92480d30e0 2023-08-09T12:42:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.472+0000 7f923ffff640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92300047c0 0x7f9230004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.472+0000 7f924cc18640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92300039a0 0x7f9230003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.472+0000 7f923ffff640 1 -- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92480d30e0 msgr2=0x7f9230005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.472+0000 7f923ffff640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92480d30e0 0x7f9230005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.472+0000 7f923ffff640 1 -- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92300039a0 msgr2=0x7f9230003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.472+0000 7f923ffff640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92300039a0 0x7f9230003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.472+0000 7f923ffff640 1 -- 172.21.15.17:0/1688444959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230003520 con 0x7f92300047c0 2023-08-09T12:42:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.472+0000 7f924cc18640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92300039a0 0x7f9230003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.473+0000 7f923ffff640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92300047c0 0x7f9230004c40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9238001720 tx=0x7f92300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d44de0a3388f4ce server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380052d0 con 0x7f92300047c0 2023-08-09T12:42:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923802e050 con 0x7f92300047c0 2023-08-09T12:42:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f923f7fe640 1 -- 172.21.15.17:0/1688444959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238003830 con 0x7f92300047c0 2023-08-09T12:42:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f924ee7c640 1 -- 172.21.15.17:0/1688444959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92300047c0 msgr2=0x7f9230004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f924ee7c640 1 --2- 172.21.15.17:0/1688444959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92300047c0 0x7f9230004c40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9238001720 tx=0x7f92300057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f924d419640 1 -- 172.21.15.17:0/1688444959 reap_dead start 2023-08-09T12:42:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f924ee7c640 1 -- 172.21.15.17:0/1688444959 shutdown_connections 2023-08-09T12:42:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f924ee7c640 1 -- 172.21.15.17:0/1688444959 >> 172.21.15.17:0/1688444959 conn(0x7f924806fde0 msgr2=0x7f92480701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f924ee7c640 1 -- 172.21.15.17:0/1688444959 shutdown_connections 2023-08-09T12:42:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.474+0000 7f924ee7c640 1 -- 172.21.15.17:0/1688444959 wait complete. 2023-08-09T12:42:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.476+0000 7f924ee7c640 1 Processor -- start 2023-08-09T12:42:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.476+0000 7f924ee7c640 1 -- start start 2023-08-09T12:42:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.477+0000 7f924ee7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92300047c0 0x7f92481e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.477+0000 7f924ee7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9248151190 0x7f92480cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.477+0000 7f924ee7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92480b7e30 0x7f92480b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.477+0000 7f924ee7c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b87f0 con 0x7f92480b7e30 2023-08-09T12:42:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.477+0000 7f924ee7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480cb7b0 con 0x7f9248151190 2023-08-09T12:42:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.477+0000 7f924ee7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92480cba30 con 0x7f92300047c0 2023-08-09T12:42:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924d419640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92480b7e30 0x7f92480b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924d419640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92480b7e30 0x7f92480b82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39218/0 (socket says 172.21.15.17:39218) 2023-08-09T12:42:47.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924d419640 1 -- 172.21.15.17:0/1498345405 learned_addr learned my addr 172.21.15.17:0/1498345405 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f923ffff640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9248151190 0x7f92480cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924cc18640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92300047c0 0x7f92481e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924d419640 1 -- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92300047c0 msgr2=0x7f92481e8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924d419640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92300047c0 0x7f92481e8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924d419640 1 -- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9248151190 msgr2=0x7f92480cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924d419640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9248151190 0x7f92480cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.478+0000 7f924d419640 1 -- 172.21.15.17:0/1498345405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480cbd10 con 0x7f92480b7e30 2023-08-09T12:42:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.479+0000 7f924d419640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92480b7e30 0x7f92480b82b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f92480d0800 tx=0x7f924000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.479+0000 7f923d7fa640 1 -- 172.21.15.17:0/1498345405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240010040 con 0x7f92480b7e30 2023-08-09T12:42:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.479+0000 7f923d7fa640 1 -- 172.21.15.17:0/1498345405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000bae0 con 0x7f92480b7e30 2023-08-09T12:42:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.479+0000 7f923d7fa640 1 -- 172.21.15.17:0/1498345405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000be70 con 0x7f92480b7e30 2023-08-09T12:42:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.479+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92480cbff0 con 0x7f92480b7e30 2023-08-09T12:42:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.479+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92480cc5b0 con 0x7f92480b7e30 2023-08-09T12:42:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.480+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9248067a80 con 0x7f92480b7e30 2023-08-09T12:42:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.481+0000 7f923d7fa640 1 -- 172.21.15.17:0/1498345405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f924001d400 con 0x7f92480b7e30 2023-08-09T12:42:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.483+0000 7f923d7fa640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f923406a050 0x7f923406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.483+0000 7f923d7fa640 1 -- 172.21.15.17:0/1498345405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9240088c50 con 0x7f92480b7e30 2023-08-09T12:42:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.484+0000 7f924cc18640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f923406a050 0x7f923406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.485+0000 7f924cc18640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f923406a050 0x7f923406c510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9244001200 tx=0x7f9244001b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:47.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.487+0000 7f923d7fa640 1 -- 172.21.15.17:0/1498345405 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9240057dc0 con 0x7f92480b7e30 2023-08-09T12:42:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.676+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92480ce5b0 con 0x7f923406a050 2023-08-09T12:42:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.701+0000 7f923d7fa640 1 -- 172.21.15.17:0/1498345405 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302790 (secure 0 0 0) 0x7f924400d040 con 0x7f923406a050 2023-08-09T12:42:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:47.710 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:42:47.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f923406a050 msgr2=0x7f923406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:47.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f923406a050 0x7f923406c510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9244001200 tx=0x7f9244001b40 comp rx=0 tx=0).stop 2023-08-09T12:42:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92480b7e30 msgr2=0x7f92480b82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92480b7e30 0x7f92480b82b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f92480d0800 tx=0x7f924000b480 comp rx=0 tx=0).stop 2023-08-09T12:42:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 shutdown_connections 2023-08-09T12:42:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f923406a050 0x7f923406c510 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92480b7e30 0x7f92480b82b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9248151190 0x7f92480cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.706+0000 7f924ee7c640 1 --2- 172.21.15.17:0/1498345405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92300047c0 0x7f92481e8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:47.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.707+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 >> 172.21.15.17:0/1498345405 conn(0x7f924806fde0 msgr2=0x7f92480b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:47.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.707+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 shutdown_connections 2023-08-09T12:42:47.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:47.707+0000 7f924ee7c640 1 -- 172.21.15.17:0/1498345405 wait complete. 2023-08-09T12:42:47.730 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2023-08-09T12:42:46.709403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558365,"statfs":{"total":1600000000,"available":1595765836,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.482462"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231498+0000","last_change":"2023-08-09T12:42:37.257690+0000","last_active":"2023-08-09T12:42:38.231498+0000","last_peered":"2023-08-09T12:42:38.231498+0000","last_clean":"2023-08-09T12:42:38.231498+0000","last_became_active":"2023-08-09T12:42:37.257349+0000","last_became_peered":"2023-08-09T12:42:37.257349+0000","last_unstale":"2023-08-09T12:42:38.231498+0000","last_undegraded":"2023-08-09T12:42:38.231498+0000","last_fullsized":"2023-08-09T12:42:38.231498+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231473+0000","last_change":"2023-08-09T12:42:37.244290+0000","last_active":"2023-08-09T12:42:38.231473+0000","last_peered":"2023-08-09T12:42:38.231473+0000","last_clean":"2023-08-09T12:42:38.231473+0000","last_became_active":"2023-08-09T12:42:37.243902+0000","last_became_peered":"2023-08-09T12:42:37.243902+0000","last_unstale":"2023-08-09T12:42:38.231473+0000","last_undegraded":"2023-08-09T12:42:38.231473+0000","last_fullsized":"2023-08-09T12:42:38.231473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:26.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229660+0000","last_change":"2023-08-09T12:42:37.255754+0000","last_active":"2023-08-09T12:42:38.229660+0000","last_peered":"2023-08-09T12:42:38.229660+0000","last_clean":"2023-08-09T12:42:38.229660+0000","last_became_active":"2023-08-09T12:42:37.252509+0000","last_became_peered":"2023-08-09T12:42:37.252509+0000","last_unstale":"2023-08-09T12:42:38.229660+0000","last_undegraded":"2023-08-09T12:42:38.229660+0000","last_fullsized":"2023-08-09T12:42:38.229660+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:27:16.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233149+0000","last_change":"2023-08-09T12:42:37.262202+0000","last_active":"2023-08-09T12:42:38.233149+0000","last_peered":"2023-08-09T12:42:38.233149+0000","last_clean":"2023-08-09T12:42:38.233149+0000","last_became_active":"2023-08-09T12:42:37.259309+0000","last_became_peered":"2023-08-09T12:42:37.259309+0000","last_unstale":"2023-08-09T12:42:38.233149+0000","last_undegraded":"2023-08-09T12:42:38.233149+0000","last_fullsized":"2023-08-09T12:42:38.233149+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:08:52.077433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256898+0000","last_change":"2023-08-09T12:42:37.263229+0000","last_active":"2023-08-09T12:42:38.256898+0000","last_peered":"2023-08-09T12:42:38.256898+0000","last_clean":"2023-08-09T12:42:38.256898+0000","last_became_active":"2023-08-09T12:42:37.262833+0000","last_became_peered":"2023-08-09T12:42:37.262833+0000","last_unstale":"2023-08-09T12:42:38.256898+0000","last_undegraded":"2023-08-09T12:42:38.256898+0000","last_fullsized":"2023-08-09T12:42:38.256898+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:11:43.623157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254678+0000","last_change":"2023-08-09T12:42:37.252942+0000","last_active":"2023-08-09T12:42:38.254678+0000","last_peered":"2023-08-09T12:42:38.254678+0000","last_clean":"2023-08-09T12:42:38.254678+0000","last_became_active":"2023-08-09T12:42:37.252758+0000","last_became_peered":"2023-08-09T12:42:37.252758+0000","last_unstale":"2023-08-09T12:42:38.254678+0000","last_undegraded":"2023-08-09T12:42:38.254678+0000","last_fullsized":"2023-08-09T12:42:38.254678+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:26.801124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253758+0000","last_change":"2023-08-09T12:42:37.249929+0000","last_active":"2023-08-09T12:42:38.253758+0000","last_peered":"2023-08-09T12:42:38.253758+0000","last_clean":"2023-08-09T12:42:38.253758+0000","last_became_active":"2023-08-09T12:42:37.249679+0000","last_became_peered":"2023-08-09T12:42:37.249679+0000","last_unstale":"2023-08-09T12:42:38.253758+0000","last_undegraded":"2023-08-09T12:42:38.253758+0000","last_fullsized":"2023-08-09T12:42:38.253758+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:46:50.211162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254268+0000","last_change":"2023-08-09T12:42:37.255116+0000","last_active":"2023-08-09T12:42:38.254268+0000","last_peered":"2023-08-09T12:42:38.254268+0000","last_clean":"2023-08-09T12:42:38.254268+0000","last_became_active":"2023-08-09T12:42:37.254523+0000","last_became_peered":"2023-08-09T12:42:37.254523+0000","last_unstale":"2023-08-09T12:42:38.254268+0000","last_undegraded":"2023-08-09T12:42:38.254268+0000","last_fullsized":"2023-08-09T12:42:38.254268+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:23.535166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228334+0000","last_change":"2023-08-09T12:42:37.261563+0000","last_active":"2023-08-09T12:42:38.228334+0000","last_peered":"2023-08-09T12:42:38.228334+0000","last_clean":"2023-08-09T12:42:38.228334+0000","last_became_active":"2023-08-09T12:42:37.260798+0000","last_became_peered":"2023-08-09T12:42:37.260798+0000","last_unstale":"2023-08-09T12:42:38.228334+0000","last_undegraded":"2023-08-09T12:42:38.228334+0000","last_fullsized":"2023-08-09T12:42:38.228334+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:52:40.793910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229128+0000","last_change":"2023-08-09T12:42:37.251847+0000","last_active":"2023-08-09T12:42:38.229128+0000","last_peered":"2023-08-09T12:42:38.229128+0000","last_clean":"2023-08-09T12:42:38.229128+0000","last_became_active":"2023-08-09T12:42:37.251188+0000","last_became_peered":"2023-08-09T12:42:37.251188+0000","last_unstale":"2023-08-09T12:42:38.229128+0000","last_undegraded":"2023-08-09T12:42:38.229128+0000","last_fullsized":"2023-08-09T12:42:38.229128+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:24.349252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233723+0000","last_change":"2023-08-09T12:42:37.265000+0000","last_active":"2023-08-09T12:42:38.233723+0000","last_peered":"2023-08-09T12:42:38.233723+0000","last_clean":"2023-08-09T12:42:38.233723+0000","last_became_active":"2023-08-09T12:42:37.264693+0000","last_became_peered":"2023-08-09T12:42:37.264693+0000","last_unstale":"2023-08-09T12:42:38.233723+0000","last_undegraded":"2023-08-09T12:42:38.233723+0000","last_fullsized":"2023-08-09T12:42:38.233723+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:24.809472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254607+0000","last_change":"2023-08-09T12:42:37.256388+0000","last_active":"2023-08-09T12:42:38.254607+0000","last_peered":"2023-08-09T12:42:38.254607+0000","last_clean":"2023-08-09T12:42:38.254607+0000","last_became_active":"2023-08-09T12:42:37.255695+0000","last_became_peered":"2023-08-09T12:42:37.255695+0000","last_unstale":"2023-08-09T12:42:38.254607+0000","last_undegraded":"2023-08-09T12:42:38.254607+0000","last_fullsized":"2023-08-09T12:42:38.254607+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254807+0000","last_change":"2023-08-09T12:42:37.266385+0000","last_active":"2023-08-09T12:42:38.254807+0000","last_peered":"2023-08-09T12:42:38.254807+0000","last_clean":"2023-08-09T12:42:38.254807+0000","last_became_active":"2023-08-09T12:42:37.266135+0000","last_became_peered":"2023-08-09T12:42:37.266135+0000","last_unstale":"2023-08-09T12:42:38.254807+0000","last_undegraded":"2023-08-09T12:42:38.254807+0000","last_fullsized":"2023-08-09T12:42:38.254807+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:16.980624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228698+0000","last_change":"2023-08-09T12:42:37.254661+0000","last_active":"2023-08-09T12:42:38.228698+0000","last_peered":"2023-08-09T12:42:38.228698+0000","last_clean":"2023-08-09T12:42:38.228698+0000","last_became_active":"2023-08-09T12:42:37.253898+0000","last_became_peered":"2023-08-09T12:42:37.253898+0000","last_unstale":"2023-08-09T12:42:38.228698+0000","last_undegraded":"2023-08-09T12:42:38.228698+0000","last_fullsized":"2023-08-09T12:42:38.228698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:42:36.577077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229793+0000","last_change":"2023-08-09T12:42:37.251997+0000","last_active":"2023-08-09T12:42:38.229793+0000","last_peered":"2023-08-09T12:42:38.229793+0000","last_clean":"2023-08-09T12:42:38.229793+0000","last_became_active":"2023-08-09T12:42:37.251539+0000","last_became_peered":"2023-08-09T12:42:37.251539+0000","last_unstale":"2023-08-09T12:42:38.229793+0000","last_undegraded":"2023-08-09T12:42:38.229793+0000","last_fullsized":"2023-08-09T12:42:38.229793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:58:06.404500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254145+0000","last_change":"2023-08-09T12:42:37.254562+0000","last_active":"2023-08-09T12:42:38.254145+0000","last_peered":"2023-08-09T12:42:38.254145+0000","last_clean":"2023-08-09T12:42:38.254145+0000","last_became_active":"2023-08-09T12:42:37.254071+0000","last_became_peered":"2023-08-09T12:42:37.254071+0000","last_unstale":"2023-08-09T12:42:38.254145+0000","last_undegraded":"2023-08-09T12:42:38.254145+0000","last_fullsized":"2023-08-09T12:42:38.254145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:18:55.787676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231237+0000","last_change":"2023-08-09T12:42:37.261069+0000","last_active":"2023-08-09T12:42:38.231237+0000","last_peered":"2023-08-09T12:42:38.231237+0000","last_clean":"2023-08-09T12:42:38.231237+0000","last_became_active":"2023-08-09T12:42:37.260489+0000","last_became_peered":"2023-08-09T12:42:37.260489+0000","last_unstale":"2023-08-09T12:42:38.231237+0000","last_undegraded":"2023-08-09T12:42:38.231237+0000","last_fullsized":"2023-08-09T12:42:38.231237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.232630+0000","last_change":"2023-08-09T12:42:37.265525+0000","last_active":"2023-08-09T12:42:38.232630+0000","last_peered":"2023-08-09T12:42:38.232630+0000","last_clean":"2023-08-09T12:42:38.232630+0000","last_became_active":"2023-08-09T12:42:37.263159+0000","last_became_peered":"2023-08-09T12:42:37.263159+0000","last_unstale":"2023-08-09T12:42:38.232630+0000","last_undegraded":"2023-08-09T12:42:38.232630+0000","last_fullsized":"2023-08-09T12:42:38.232630+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:06:44.414616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254890+0000","last_change":"2023-08-09T12:42:37.237052+0000","last_active":"2023-08-09T12:42:38.254890+0000","last_peered":"2023-08-09T12:42:38.254890+0000","last_clean":"2023-08-09T12:42:38.254890+0000","last_became_active":"2023-08-09T12:42:37.235462+0000","last_became_peered":"2023-08-09T12:42:37.235462+0000","last_unstale":"2023-08-09T12:42:38.254890+0000","last_undegraded":"2023-08-09T12:42:38.254890+0000","last_fullsized":"2023-08-09T12:42:38.254890+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:51.561653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256691+0000","last_change":"2023-08-09T12:42:37.235114+0000","last_active":"2023-08-09T12:42:38.256691+0000","last_peered":"2023-08-09T12:42:38.256691+0000","last_clean":"2023-08-09T12:42:38.256691+0000","last_became_active":"2023-08-09T12:42:37.234851+0000","last_became_peered":"2023-08-09T12:42:37.234851+0000","last_unstale":"2023-08-09T12:42:38.256691+0000","last_undegraded":"2023-08-09T12:42:38.256691+0000","last_fullsized":"2023-08-09T12:42:38.256691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:50:54.810271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255004+0000","last_change":"2023-08-09T12:42:37.257315+0000","last_active":"2023-08-09T12:42:38.255004+0000","last_peered":"2023-08-09T12:42:38.255004+0000","last_clean":"2023-08-09T12:42:38.255004+0000","last_became_active":"2023-08-09T12:42:37.256728+0000","last_became_peered":"2023-08-09T12:42:37.256728+0000","last_unstale":"2023-08-09T12:42:38.255004+0000","last_undegraded":"2023-08-09T12:42:38.255004+0000","last_fullsized":"2023-08-09T12:42:38.255004+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:12.688961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255330+0000","last_change":"2023-08-09T12:42:37.252932+0000","last_active":"2023-08-09T12:42:38.255330+0000","last_peered":"2023-08-09T12:42:38.255330+0000","last_clean":"2023-08-09T12:42:38.255330+0000","last_became_active":"2023-08-09T12:42:37.252653+0000","last_became_peered":"2023-08-09T12:42:37.252653+0000","last_unstale":"2023-08-09T12:42:38.255330+0000","last_undegraded":"2023-08-09T12:42:38.255330+0000","last_fullsized":"2023-08-09T12:42:38.255330+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:07.879884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256190+0000","last_change":"2023-08-09T12:42:37.252813+0000","last_active":"2023-08-09T12:42:38.256190+0000","last_peered":"2023-08-09T12:42:38.256190+0000","last_clean":"2023-08-09T12:42:38.256190+0000","last_became_active":"2023-08-09T12:42:37.252548+0000","last_became_peered":"2023-08-09T12:42:37.252548+0000","last_unstale":"2023-08-09T12:42:38.256190+0000","last_undegraded":"2023-08-09T12:42:38.256190+0000","last_fullsized":"2023-08-09T12:42:38.256190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:26.001676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229098+0000","last_change":"2023-08-09T12:42:37.254862+0000","last_active":"2023-08-09T12:42:38.229098+0000","last_peered":"2023-08-09T12:42:38.229098+0000","last_clean":"2023-08-09T12:42:38.229098+0000","last_became_active":"2023-08-09T12:42:37.254345+0000","last_became_peered":"2023-08-09T12:42:37.254345+0000","last_unstale":"2023-08-09T12:42:38.229098+0000","last_undegraded":"2023-08-09T12:42:38.229098+0000","last_fullsized":"2023-08-09T12:42:38.229098+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:24:35.542487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255836+0000","last_change":"2023-08-09T12:42:37.257761+0000","last_active":"2023-08-09T12:42:38.255836+0000","last_peered":"2023-08-09T12:42:38.255836+0000","last_clean":"2023-08-09T12:42:38.255836+0000","last_became_active":"2023-08-09T12:42:37.256710+0000","last_became_peered":"2023-08-09T12:42:37.256710+0000","last_unstale":"2023-08-09T12:42:38.255836+0000","last_undegraded":"2023-08-09T12:42:38.255836+0000","last_fullsized":"2023-08-09T12:42:38.255836+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:50:54.810271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255369+0000","last_change":"2023-08-09T12:42:37.250443+0000","last_active":"2023-08-09T12:42:38.255369+0000","last_peered":"2023-08-09T12:42:38.255369+0000","last_clean":"2023-08-09T12:42:38.255369+0000","last_became_active":"2023-08-09T12:42:37.250067+0000","last_became_peered":"2023-08-09T12:42:37.250067+0000","last_unstale":"2023-08-09T12:42:38.255369+0000","last_undegraded":"2023-08-09T12:42:38.255369+0000","last_fullsized":"2023-08-09T12:42:38.255369+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233541+0000","last_change":"2023-08-09T12:42:37.262983+0000","last_active":"2023-08-09T12:42:38.233541+0000","last_peered":"2023-08-09T12:42:38.233541+0000","last_clean":"2023-08-09T12:42:38.233541+0000","last_became_active":"2023-08-09T12:42:37.262584+0000","last_became_peered":"2023-08-09T12:42:37.262584+0000","last_unstale":"2023-08-09T12:42:38.233541+0000","last_undegraded":"2023-08-09T12:42:38.233541+0000","last_fullsized":"2023-08-09T12:42:38.233541+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:37:25.440968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231169+0000","last_change":"2023-08-09T12:42:37.251672+0000","last_active":"2023-08-09T12:42:38.231169+0000","last_peered":"2023-08-09T12:42:38.231169+0000","last_clean":"2023-08-09T12:42:38.231169+0000","last_became_active":"2023-08-09T12:42:37.251006+0000","last_became_peered":"2023-08-09T12:42:37.251006+0000","last_unstale":"2023-08-09T12:42:38.231169+0000","last_undegraded":"2023-08-09T12:42:38.231169+0000","last_fullsized":"2023-08-09T12:42:38.231169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:23.535166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229732+0000","last_change":"2023-08-09T12:42:37.261725+0000","last_active":"2023-08-09T12:42:38.229732+0000","last_peered":"2023-08-09T12:42:38.229732+0000","last_clean":"2023-08-09T12:42:38.229732+0000","last_became_active":"2023-08-09T12:42:37.261351+0000","last_became_peered":"2023-08-09T12:42:37.261351+0000","last_unstale":"2023-08-09T12:42:38.229732+0000","last_undegraded":"2023-08-09T12:42:38.229732+0000","last_fullsized":"2023-08-09T12:42:38.229732+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:27:02.589200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256190+0000","last_change":"2023-08-09T12:42:37.258260+0000","last_active":"2023-08-09T12:42:38.256190+0000","last_peered":"2023-08-09T12:42:38.256190+0000","last_clean":"2023-08-09T12:42:38.256190+0000","last_became_active":"2023-08-09T12:42:37.257476+0000","last_became_peered":"2023-08-09T12:42:37.257476+0000","last_unstale":"2023-08-09T12:42:38.256190+0000","last_undegraded":"2023-08-09T12:42:38.256190+0000","last_fullsized":"2023-08-09T12:42:38.256190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:29:05.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234031+0000","last_change":"2023-08-09T12:42:37.262864+0000","last_active":"2023-08-09T12:42:38.234031+0000","last_peered":"2023-08-09T12:42:38.234031+0000","last_clean":"2023-08-09T12:42:38.234031+0000","last_became_active":"2023-08-09T12:42:37.262462+0000","last_became_peered":"2023-08-09T12:42:37.262462+0000","last_unstale":"2023-08-09T12:42:38.234031+0000","last_undegraded":"2023-08-09T12:42:38.234031+0000","last_fullsized":"2023-08-09T12:42:38.234031+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:55:01.843450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254314+0000","last_change":"2023-08-09T12:42:37.245820+0000","last_active":"2023-08-09T12:42:38.254314+0000","last_peered":"2023-08-09T12:42:38.254314+0000","last_clean":"2023-08-09T12:42:38.254314+0000","last_became_active":"2023-08-09T12:42:37.245517+0000","last_became_peered":"2023-08-09T12:42:37.245517+0000","last_unstale":"2023-08-09T12:42:38.254314+0000","last_undegraded":"2023-08-09T12:42:38.254314+0000","last_fullsized":"2023-08-09T12:42:38.254314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:16:28.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256433+0000","last_change":"2023-08-09T12:42:37.245182+0000","last_active":"2023-08-09T12:42:38.256433+0000","last_peered":"2023-08-09T12:42:38.256433+0000","last_clean":"2023-08-09T12:42:38.256433+0000","last_became_active":"2023-08-09T12:42:37.244705+0000","last_became_peered":"2023-08-09T12:42:37.244705+0000","last_unstale":"2023-08-09T12:42:38.256433+0000","last_undegraded":"2023-08-09T12:42:38.256433+0000","last_fullsized":"2023-08-09T12:42:38.256433+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:46.925490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"69'4","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231421+0000","last_change":"2023-08-09T12:42:36.248006+0000","last_active":"2023-08-09T12:42:38.231421+0000","last_peered":"2023-08-09T12:42:38.231421+0000","last_clean":"2023-08-09T12:42:38.231421+0000","last_became_active":"2023-08-09T12:42:36.247672+0000","last_became_peered":"2023-08-09T12:42:36.247672+0000","last_unstale":"2023-08-09T12:42:38.231421+0000","last_undegraded":"2023-08-09T12:42:38.231421+0000","last_fullsized":"2023-08-09T12:42:38.231421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:11.675220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233322+0000","last_change":"2023-08-09T12:42:37.264456+0000","last_active":"2023-08-09T12:42:38.233322+0000","last_peered":"2023-08-09T12:42:38.233322+0000","last_clean":"2023-08-09T12:42:38.233322+0000","last_became_active":"2023-08-09T12:42:37.263053+0000","last_became_peered":"2023-08-09T12:42:37.263053+0000","last_unstale":"2023-08-09T12:42:38.233322+0000","last_undegraded":"2023-08-09T12:42:38.233322+0000","last_fullsized":"2023-08-09T12:42:38.233322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:34.183173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254777+0000","last_change":"2023-08-09T12:42:36.244595+0000","last_active":"2023-08-09T12:42:38.254777+0000","last_peered":"2023-08-09T12:42:38.254777+0000","last_clean":"2023-08-09T12:42:38.254777+0000","last_became_active":"2023-08-09T12:42:36.244171+0000","last_became_peered":"2023-08-09T12:42:36.244171+0000","last_unstale":"2023-08-09T12:42:38.254777+0000","last_undegraded":"2023-08-09T12:42:38.254777+0000","last_fullsized":"2023-08-09T12:42:38.254777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:54:34.665925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255521+0000","last_change":"2023-08-09T12:42:37.244971+0000","last_active":"2023-08-09T12:42:38.255521+0000","last_peered":"2023-08-09T12:42:38.255521+0000","last_clean":"2023-08-09T12:42:38.255521+0000","last_became_active":"2023-08-09T12:42:37.244585+0000","last_became_peered":"2023-08-09T12:42:37.244585+0000","last_unstale":"2023-08-09T12:42:38.255521+0000","last_undegraded":"2023-08-09T12:42:38.255521+0000","last_fullsized":"2023-08-09T12:42:38.255521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:40:53.261326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255407+0000","last_change":"2023-08-09T12:42:36.247995+0000","last_active":"2023-08-09T12:42:38.255407+0000","last_peered":"2023-08-09T12:42:38.255407+0000","last_clean":"2023-08-09T12:42:38.255407+0000","last_became_active":"2023-08-09T12:42:36.247723+0000","last_became_peered":"2023-08-09T12:42:36.247723+0000","last_unstale":"2023-08-09T12:42:38.255407+0000","last_undegraded":"2023-08-09T12:42:38.255407+0000","last_fullsized":"2023-08-09T12:42:38.255407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:37:45.334556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230002+0000","last_change":"2023-08-09T12:42:37.253969+0000","last_active":"2023-08-09T12:42:38.230002+0000","last_peered":"2023-08-09T12:42:38.230002+0000","last_clean":"2023-08-09T12:42:38.230002+0000","last_became_active":"2023-08-09T12:42:37.251738+0000","last_became_peered":"2023-08-09T12:42:37.251738+0000","last_unstale":"2023-08-09T12:42:38.230002+0000","last_undegraded":"2023-08-09T12:42:38.230002+0000","last_fullsized":"2023-08-09T12:42:38.230002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:46.938046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255118+0000","last_change":"2023-08-09T12:42:36.243673+0000","last_active":"2023-08-09T12:42:38.255118+0000","last_peered":"2023-08-09T12:42:38.255118+0000","last_clean":"2023-08-09T12:42:38.255118+0000","last_became_active":"2023-08-09T12:42:36.242905+0000","last_became_peered":"2023-08-09T12:42:36.242905+0000","last_unstale":"2023-08-09T12:42:38.255118+0000","last_undegraded":"2023-08-09T12:42:38.255118+0000","last_fullsized":"2023-08-09T12:42:38.255118+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:40.755933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256768+0000","last_change":"2023-08-09T12:42:37.243362+0000","last_active":"2023-08-09T12:42:38.256768+0000","last_peered":"2023-08-09T12:42:38.256768+0000","last_clean":"2023-08-09T12:42:38.256768+0000","last_became_active":"2023-08-09T12:42:37.243127+0000","last_became_peered":"2023-08-09T12:42:37.243127+0000","last_unstale":"2023-08-09T12:42:38.256768+0000","last_undegraded":"2023-08-09T12:42:38.256768+0000","last_fullsized":"2023-08-09T12:42:38.256768+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:52:18.975764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255676+0000","last_change":"2023-08-09T12:42:36.249304+0000","last_active":"2023-08-09T12:42:38.255676+0000","last_peered":"2023-08-09T12:42:38.255676+0000","last_clean":"2023-08-09T12:42:38.255676+0000","last_became_active":"2023-08-09T12:42:36.244419+0000","last_became_peered":"2023-08-09T12:42:36.244419+0000","last_unstale":"2023-08-09T12:42:38.255676+0000","last_undegraded":"2023-08-09T12:42:38.255676+0000","last_fullsized":"2023-08-09T12:42:38.255676+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:15.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231164+0000","last_change":"2023-08-09T12:42:37.260175+0000","last_active":"2023-08-09T12:42:38.231164+0000","last_peered":"2023-08-09T12:42:38.231164+0000","last_clean":"2023-08-09T12:42:38.231164+0000","last_became_active":"2023-08-09T12:42:37.259927+0000","last_became_peered":"2023-08-09T12:42:37.259927+0000","last_unstale":"2023-08-09T12:42:38.231164+0000","last_undegraded":"2023-08-09T12:42:38.231164+0000","last_fullsized":"2023-08-09T12:42:38.231164+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:59:21.760170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256550+0000","last_change":"2023-08-09T12:42:36.239590+0000","last_active":"2023-08-09T12:42:38.256550+0000","last_peered":"2023-08-09T12:42:38.256550+0000","last_clean":"2023-08-09T12:42:38.256550+0000","last_became_active":"2023-08-09T12:42:36.238193+0000","last_became_peered":"2023-08-09T12:42:36.238193+0000","last_unstale":"2023-08-09T12:42:38.256550+0000","last_undegraded":"2023-08-09T12:42:38.256550+0000","last_fullsized":"2023-08-09T12:42:38.256550+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:48:53.749361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256573+0000","last_change":"2023-08-09T12:42:37.244814+0000","last_active":"2023-08-09T12:42:38.256573+0000","last_peered":"2023-08-09T12:42:38.256573+0000","last_clean":"2023-08-09T12:42:38.256573+0000","last_became_active":"2023-08-09T12:42:37.243517+0000","last_became_peered":"2023-08-09T12:42:37.243517+0000","last_unstale":"2023-08-09T12:42:38.256573+0000","last_undegraded":"2023-08-09T12:42:38.256573+0000","last_fullsized":"2023-08-09T12:42:38.256573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:09:23.914696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256583+0000","last_change":"2023-08-09T12:42:36.246355+0000","last_active":"2023-08-09T12:42:38.256583+0000","last_peered":"2023-08-09T12:42:38.256583+0000","last_clean":"2023-08-09T12:42:38.256583+0000","last_became_active":"2023-08-09T12:42:36.246037+0000","last_became_peered":"2023-08-09T12:42:36.246037+0000","last_unstale":"2023-08-09T12:42:38.256583+0000","last_undegraded":"2023-08-09T12:42:38.256583+0000","last_fullsized":"2023-08-09T12:42:38.256583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:36.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255505+0000","last_change":"2023-08-09T12:42:37.249061+0000","last_active":"2023-08-09T12:42:38.255505+0000","last_peered":"2023-08-09T12:42:38.255505+0000","last_clean":"2023-08-09T12:42:38.255505+0000","last_became_active":"2023-08-09T12:42:37.248755+0000","last_became_peered":"2023-08-09T12:42:37.248755+0000","last_unstale":"2023-08-09T12:42:38.255505+0000","last_undegraded":"2023-08-09T12:42:38.255505+0000","last_fullsized":"2023-08-09T12:42:38.255505+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:33.891845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257633+0000","last_change":"2023-08-09T12:42:36.240311+0000","last_active":"2023-08-09T12:42:38.257633+0000","last_peered":"2023-08-09T12:42:38.257633+0000","last_clean":"2023-08-09T12:42:38.257633+0000","last_became_active":"2023-08-09T12:42:36.239717+0000","last_became_peered":"2023-08-09T12:42:36.239717+0000","last_unstale":"2023-08-09T12:42:38.257633+0000","last_undegraded":"2023-08-09T12:42:38.257633+0000","last_fullsized":"2023-08-09T12:42:38.257633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:24:13.940215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230988+0000","last_change":"2023-08-09T12:42:37.242895+0000","last_active":"2023-08-09T12:42:38.230988+0000","last_peered":"2023-08-09T12:42:38.230988+0000","last_clean":"2023-08-09T12:42:38.230988+0000","last_became_active":"2023-08-09T12:42:37.242665+0000","last_became_peered":"2023-08-09T12:42:37.242665+0000","last_unstale":"2023-08-09T12:42:38.230988+0000","last_undegraded":"2023-08-09T12:42:38.230988+0000","last_fullsized":"2023-08-09T12:42:38.230988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:51.102811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.228850+0000","last_change":"2023-08-09T12:42:36.249493+0000","last_active":"2023-08-09T12:42:38.228850+0000","last_peered":"2023-08-09T12:42:38.228850+0000","last_clean":"2023-08-09T12:42:38.228850+0000","last_became_active":"2023-08-09T12:42:36.247921+0000","last_became_peered":"2023-08-09T12:42:36.247921+0000","last_unstale":"2023-08-09T12:42:38.228850+0000","last_undegraded":"2023-08-09T12:42:38.228850+0000","last_fullsized":"2023-08-09T12:42:38.228850+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:22:15.550584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256367+0000","last_change":"2023-08-09T12:42:37.256381+0000","last_active":"2023-08-09T12:42:38.256367+0000","last_peered":"2023-08-09T12:42:38.256367+0000","last_clean":"2023-08-09T12:42:38.256367+0000","last_became_active":"2023-08-09T12:42:37.256112+0000","last_became_peered":"2023-08-09T12:42:37.256112+0000","last_unstale":"2023-08-09T12:42:38.256367+0000","last_undegraded":"2023-08-09T12:42:38.256367+0000","last_fullsized":"2023-08-09T12:42:38.256367+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:21:40.094243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234030+0000","last_change":"2023-08-09T12:42:36.247625+0000","last_active":"2023-08-09T12:42:38.234030+0000","last_peered":"2023-08-09T12:42:38.234030+0000","last_clean":"2023-08-09T12:42:38.234030+0000","last_became_active":"2023-08-09T12:42:36.247369+0000","last_became_peered":"2023-08-09T12:42:36.247369+0000","last_unstale":"2023-08-09T12:42:38.234030+0000","last_undegraded":"2023-08-09T12:42:38.234030+0000","last_fullsized":"2023-08-09T12:42:38.234030+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:49:49.885647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256867+0000","last_change":"2023-08-09T12:42:37.252587+0000","last_active":"2023-08-09T12:42:38.256867+0000","last_peered":"2023-08-09T12:42:38.256867+0000","last_clean":"2023-08-09T12:42:38.256867+0000","last_became_active":"2023-08-09T12:42:37.252346+0000","last_became_peered":"2023-08-09T12:42:37.252346+0000","last_unstale":"2023-08-09T12:42:38.256867+0000","last_undegraded":"2023-08-09T12:42:38.256867+0000","last_fullsized":"2023-08-09T12:42:38.256867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:40.114216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"69'3","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230989+0000","last_change":"2023-08-09T12:42:36.246431+0000","last_active":"2023-08-09T12:42:38.230989+0000","last_peered":"2023-08-09T12:42:38.230989+0000","last_clean":"2023-08-09T12:42:38.230989+0000","last_became_active":"2023-08-09T12:42:36.245840+0000","last_became_peered":"2023-08-09T12:42:36.245840+0000","last_unstale":"2023-08-09T12:42:38.230989+0000","last_undegraded":"2023-08-09T12:42:38.230989+0000","last_fullsized":"2023-08-09T12:42:38.230989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:42:31.943095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.234235+0000","last_change":"2023-08-09T12:42:37.258874+0000","last_active":"2023-08-09T12:42:38.234235+0000","last_peered":"2023-08-09T12:42:38.234235+0000","last_clean":"2023-08-09T12:42:38.234235+0000","last_became_active":"2023-08-09T12:42:37.258612+0000","last_became_peered":"2023-08-09T12:42:37.258612+0000","last_unstale":"2023-08-09T12:42:38.234235+0000","last_undegraded":"2023-08-09T12:42:38.234235+0000","last_fullsized":"2023-08-09T12:42:38.234235+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:38.405159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"69'6","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231262+0000","last_change":"2023-08-09T12:42:36.248155+0000","last_active":"2023-08-09T12:42:38.231262+0000","last_peered":"2023-08-09T12:42:38.231262+0000","last_clean":"2023-08-09T12:42:38.231262+0000","last_became_active":"2023-08-09T12:42:36.247743+0000","last_became_peered":"2023-08-09T12:42:36.247743+0000","last_unstale":"2023-08-09T12:42:38.231262+0000","last_undegraded":"2023-08-09T12:42:38.231262+0000","last_fullsized":"2023-08-09T12:42:38.231262+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:32.878105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.232986+0000","last_change":"2023-08-09T12:42:37.265931+0000","last_active":"2023-08-09T12:42:38.232986+0000","last_peered":"2023-08-09T12:42:38.232986+0000","last_clean":"2023-08-09T12:42:38.232986+0000","last_became_active":"2023-08-09T12:42:37.264827+0000","last_became_peered":"2023-08-09T12:42:37.264827+0000","last_unstale":"2023-08-09T12:42:38.232986+0000","last_undegraded":"2023-08-09T12:42:38.232986+0000","last_fullsized":"2023-08-09T12:42:38.232986+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:50.058728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229457+0000","last_change":"2023-08-09T12:42:36.245706+0000","last_active":"2023-08-09T12:42:38.229457+0000","last_peered":"2023-08-09T12:42:38.229457+0000","last_clean":"2023-08-09T12:42:38.229457+0000","last_became_active":"2023-08-09T12:42:36.245288+0000","last_became_peered":"2023-08-09T12:42:36.245288+0000","last_unstale":"2023-08-09T12:42:38.229457+0000","last_undegraded":"2023-08-09T12:42:38.229457+0000","last_fullsized":"2023-08-09T12:42:38.229457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:20:56.533915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254961+0000","last_change":"2023-08-09T12:42:37.250535+0000","last_active":"2023-08-09T12:42:38.254961+0000","last_peered":"2023-08-09T12:42:38.254961+0000","last_clean":"2023-08-09T12:42:38.254961+0000","last_became_active":"2023-08-09T12:42:37.250315+0000","last_became_peered":"2023-08-09T12:42:37.250315+0000","last_unstale":"2023-08-09T12:42:38.254961+0000","last_undegraded":"2023-08-09T12:42:38.254961+0000","last_fullsized":"2023-08-09T12:42:38.254961+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:35.083219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255850+0000","last_change":"2023-08-09T12:42:36.249379+0000","last_active":"2023-08-09T12:42:38.255850+0000","last_peered":"2023-08-09T12:42:38.255850+0000","last_clean":"2023-08-09T12:42:38.255850+0000","last_became_active":"2023-08-09T12:42:36.249139+0000","last_became_peered":"2023-08-09T12:42:36.249139+0000","last_unstale":"2023-08-09T12:42:38.255850+0000","last_undegraded":"2023-08-09T12:42:38.255850+0000","last_fullsized":"2023-08-09T12:42:38.255850+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:52.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256800+0000","last_change":"2023-08-09T12:42:37.239032+0000","last_active":"2023-08-09T12:42:38.256800+0000","last_peered":"2023-08-09T12:42:38.256800+0000","last_clean":"2023-08-09T12:42:38.256800+0000","last_became_active":"2023-08-09T12:42:37.238305+0000","last_became_peered":"2023-08-09T12:42:37.238305+0000","last_unstale":"2023-08-09T12:42:38.256800+0000","last_undegraded":"2023-08-09T12:42:38.256800+0000","last_fullsized":"2023-08-09T12:42:38.256800+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:36:19.643134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229362+0000","last_change":"2023-08-09T12:42:36.240822+0000","last_active":"2023-08-09T12:42:38.229362+0000","last_peered":"2023-08-09T12:42:38.229362+0000","last_clean":"2023-08-09T12:42:38.229362+0000","last_became_active":"2023-08-09T12:42:36.239779+0000","last_became_peered":"2023-08-09T12:42:36.239779+0000","last_unstale":"2023-08-09T12:42:38.229362+0000","last_undegraded":"2023-08-09T12:42:38.229362+0000","last_fullsized":"2023-08-09T12:42:38.229362+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:18:20.950202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231482+0000","last_change":"2023-08-09T12:42:37.252422+0000","last_active":"2023-08-09T12:42:38.231482+0000","last_peered":"2023-08-09T12:42:38.231482+0000","last_clean":"2023-08-09T12:42:38.231482+0000","last_became_active":"2023-08-09T12:42:37.251894+0000","last_became_peered":"2023-08-09T12:42:37.251894+0000","last_unstale":"2023-08-09T12:42:38.231482+0000","last_undegraded":"2023-08-09T12:42:38.231482+0000","last_fullsized":"2023-08-09T12:42:38.231482+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:35.083219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"69'8","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233708+0000","last_change":"2023-08-09T12:42:36.246725+0000","last_active":"2023-08-09T12:42:38.233708+0000","last_peered":"2023-08-09T12:42:38.233708+0000","last_clean":"2023-08-09T12:42:38.233708+0000","last_became_active":"2023-08-09T12:42:36.246443+0000","last_became_peered":"2023-08-09T12:42:36.246443+0000","last_unstale":"2023-08-09T12:42:38.233708+0000","last_undegraded":"2023-08-09T12:42:38.233708+0000","last_fullsized":"2023-08-09T12:42:38.233708+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:10.026311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255160+0000","last_change":"2023-08-09T12:42:37.265369+0000","last_active":"2023-08-09T12:42:38.255160+0000","last_peered":"2023-08-09T12:42:38.255160+0000","last_clean":"2023-08-09T12:42:38.255160+0000","last_became_active":"2023-08-09T12:42:37.265086+0000","last_became_peered":"2023-08-09T12:42:37.265086+0000","last_unstale":"2023-08-09T12:42:38.255160+0000","last_undegraded":"2023-08-09T12:42:38.255160+0000","last_fullsized":"2023-08-09T12:42:38.255160+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:35:19.472757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255330+0000","last_change":"2023-08-09T12:42:36.246114+0000","last_active":"2023-08-09T12:42:38.255330+0000","last_peered":"2023-08-09T12:42:38.255330+0000","last_clean":"2023-08-09T12:42:38.255330+0000","last_became_active":"2023-08-09T12:42:36.243762+0000","last_became_peered":"2023-08-09T12:42:36.243762+0000","last_unstale":"2023-08-09T12:42:38.255330+0000","last_undegraded":"2023-08-09T12:42:38.255330+0000","last_fullsized":"2023-08-09T12:42:38.255330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:46:24.987935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253453+0000","last_change":"2023-08-09T12:42:37.244546+0000","last_active":"2023-08-09T12:42:38.253453+0000","last_peered":"2023-08-09T12:42:38.253453+0000","last_clean":"2023-08-09T12:42:38.253453+0000","last_became_active":"2023-08-09T12:42:37.244085+0000","last_became_peered":"2023-08-09T12:42:37.244085+0000","last_unstale":"2023-08-09T12:42:38.253453+0000","last_undegraded":"2023-08-09T12:42:38.253453+0000","last_fullsized":"2023-08-09T12:42:38.253453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:32.254878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"70'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255755+0000","last_change":"2023-08-09T12:42:36.248626+0000","last_active":"2023-08-09T12:42:38.255755+0000","last_peered":"2023-08-09T12:42:38.255755+0000","last_clean":"2023-08-09T12:42:38.255755+0000","last_became_active":"2023-08-09T12:42:36.248040+0000","last_became_peered":"2023-08-09T12:42:36.248040+0000","last_unstale":"2023-08-09T12:42:38.255755+0000","last_undegraded":"2023-08-09T12:42:38.255755+0000","last_fullsized":"2023-08-09T12:42:38.255755+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:00:47.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255390+0000","last_change":"2023-08-09T12:42:37.254881+0000","last_active":"2023-08-09T12:42:38.255390+0000","last_peered":"2023-08-09T12:42:38.255390+0000","last_clean":"2023-08-09T12:42:38.255390+0000","last_became_active":"2023-08-09T12:42:37.254041+0000","last_became_peered":"2023-08-09T12:42:37.254041+0000","last_unstale":"2023-08-09T12:42:38.255390+0000","last_undegraded":"2023-08-09T12:42:38.255390+0000","last_fullsized":"2023-08-09T12:42:38.255390+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:48:54.763101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255145+0000","last_change":"2023-08-09T12:42:36.245523+0000","last_active":"2023-08-09T12:42:38.255145+0000","last_peered":"2023-08-09T12:42:38.255145+0000","last_clean":"2023-08-09T12:42:38.255145+0000","last_became_active":"2023-08-09T12:42:36.245182+0000","last_became_peered":"2023-08-09T12:42:36.245182+0000","last_unstale":"2023-08-09T12:42:38.255145+0000","last_undegraded":"2023-08-09T12:42:38.255145+0000","last_fullsized":"2023-08-09T12:42:38.255145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:20:34.684149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257284+0000","last_change":"2023-08-09T12:42:37.237192+0000","last_active":"2023-08-09T12:42:38.257284+0000","last_peered":"2023-08-09T12:42:38.257284+0000","last_clean":"2023-08-09T12:42:38.257284+0000","last_became_active":"2023-08-09T12:42:37.236530+0000","last_became_peered":"2023-08-09T12:42:37.236530+0000","last_unstale":"2023-08-09T12:42:38.257284+0000","last_undegraded":"2023-08-09T12:42:38.257284+0000","last_fullsized":"2023-08-09T12:42:38.257284+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:12:20.303269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231601+0000","last_change":"2023-08-09T12:42:36.245731+0000","last_active":"2023-08-09T12:42:38.231601+0000","last_peered":"2023-08-09T12:42:38.231601+0000","last_clean":"2023-08-09T12:42:38.231601+0000","last_became_active":"2023-08-09T12:42:36.245407+0000","last_became_peered":"2023-08-09T12:42:36.245407+0000","last_unstale":"2023-08-09T12:42:38.231601+0000","last_undegraded":"2023-08-09T12:42:38.231601+0000","last_fullsized":"2023-08-09T12:42:38.231601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:36.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256937+0000","last_change":"2023-08-09T12:42:37.247730+0000","last_active":"2023-08-09T12:42:38.256937+0000","last_peered":"2023-08-09T12:42:38.256937+0000","last_clean":"2023-08-09T12:42:38.256937+0000","last_became_active":"2023-08-09T12:42:37.243233+0000","last_became_peered":"2023-08-09T12:42:37.243233+0000","last_unstale":"2023-08-09T12:42:38.256937+0000","last_undegraded":"2023-08-09T12:42:38.256937+0000","last_fullsized":"2023-08-09T12:42:38.256937+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:07:19.372664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229729+0000","last_change":"2023-08-09T12:42:36.234581+0000","last_active":"2023-08-09T12:42:38.229729+0000","last_peered":"2023-08-09T12:42:38.229729+0000","last_clean":"2023-08-09T12:42:38.229729+0000","last_became_active":"2023-08-09T12:42:36.233897+0000","last_became_peered":"2023-08-09T12:42:36.233897+0000","last_unstale":"2023-08-09T12:42:38.229729+0000","last_undegraded":"2023-08-09T12:42:38.229729+0000","last_fullsized":"2023-08-09T12:42:38.229729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:37:29.459073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233375+0000","last_change":"2023-08-09T12:42:37.265768+0000","last_active":"2023-08-09T12:42:38.233375+0000","last_peered":"2023-08-09T12:42:38.233375+0000","last_clean":"2023-08-09T12:42:38.233375+0000","last_became_active":"2023-08-09T12:42:37.264478+0000","last_became_peered":"2023-08-09T12:42:37.264478+0000","last_unstale":"2023-08-09T12:42:38.233375+0000","last_undegraded":"2023-08-09T12:42:38.233375+0000","last_fullsized":"2023-08-09T12:42:38.233375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:02.490679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256097+0000","last_change":"2023-08-09T12:42:36.238369+0000","last_active":"2023-08-09T12:42:38.256097+0000","last_peered":"2023-08-09T12:42:38.256097+0000","last_clean":"2023-08-09T12:42:38.256097+0000","last_became_active":"2023-08-09T12:42:36.238090+0000","last_became_peered":"2023-08-09T12:42:36.238090+0000","last_unstale":"2023-08-09T12:42:38.256097+0000","last_undegraded":"2023-08-09T12:42:38.256097+0000","last_fullsized":"2023-08-09T12:42:38.256097+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:11.675220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231081+0000","last_change":"2023-08-09T12:42:37.261187+0000","last_active":"2023-08-09T12:42:38.231081+0000","last_peered":"2023-08-09T12:42:38.231081+0000","last_clean":"2023-08-09T12:42:38.231081+0000","last_became_active":"2023-08-09T12:42:37.260814+0000","last_became_peered":"2023-08-09T12:42:37.260814+0000","last_unstale":"2023-08-09T12:42:38.231081+0000","last_undegraded":"2023-08-09T12:42:38.231081+0000","last_fullsized":"2023-08-09T12:42:38.231081+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:15:42.311935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256710+0000","last_change":"2023-08-09T12:42:36.239973+0000","last_active":"2023-08-09T12:42:38.256710+0000","last_peered":"2023-08-09T12:42:38.256710+0000","last_clean":"2023-08-09T12:42:38.256710+0000","last_became_active":"2023-08-09T12:42:36.238975+0000","last_became_peered":"2023-08-09T12:42:36.238975+0000","last_unstale":"2023-08-09T12:42:38.256710+0000","last_undegraded":"2023-08-09T12:42:38.256710+0000","last_fullsized":"2023-08-09T12:42:38.256710+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:52.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254326+0000","last_change":"2023-08-09T12:42:37.254391+0000","last_active":"2023-08-09T12:42:38.254326+0000","last_peered":"2023-08-09T12:42:38.254326+0000","last_clean":"2023-08-09T12:42:38.254326+0000","last_became_active":"2023-08-09T12:42:37.253699+0000","last_became_peered":"2023-08-09T12:42:37.253699+0000","last_unstale":"2023-08-09T12:42:38.254326+0000","last_undegraded":"2023-08-09T12:42:38.254326+0000","last_fullsized":"2023-08-09T12:42:38.254326+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:46:04.982543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231340+0000","last_change":"2023-08-09T12:42:36.240867+0000","last_active":"2023-08-09T12:42:38.231340+0000","last_peered":"2023-08-09T12:42:38.231340+0000","last_clean":"2023-08-09T12:42:38.231340+0000","last_became_active":"2023-08-09T12:42:36.240311+0000","last_became_peered":"2023-08-09T12:42:36.240311+0000","last_unstale":"2023-08-09T12:42:38.231340+0000","last_undegraded":"2023-08-09T12:42:38.231340+0000","last_fullsized":"2023-08-09T12:42:38.231340+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:15.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256923+0000","last_change":"2023-08-09T12:42:37.246164+0000","last_active":"2023-08-09T12:42:38.256923+0000","last_peered":"2023-08-09T12:42:38.256923+0000","last_clean":"2023-08-09T12:42:38.256923+0000","last_became_active":"2023-08-09T12:42:37.245810+0000","last_became_peered":"2023-08-09T12:42:37.245810+0000","last_unstale":"2023-08-09T12:42:38.256923+0000","last_undegraded":"2023-08-09T12:42:38.256923+0000","last_fullsized":"2023-08-09T12:42:38.256923+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:39:51.487806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256605+0000","last_change":"2023-08-09T12:42:36.246012+0000","last_active":"2023-08-09T12:42:38.256605+0000","last_peered":"2023-08-09T12:42:38.256605+0000","last_clean":"2023-08-09T12:42:38.256605+0000","last_became_active":"2023-08-09T12:42:36.245659+0000","last_became_peered":"2023-08-09T12:42:36.245659+0000","last_unstale":"2023-08-09T12:42:38.256605+0000","last_undegraded":"2023-08-09T12:42:38.256605+0000","last_fullsized":"2023-08-09T12:42:38.256605+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:00:47.539263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":264,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230364+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:42:38.230364+0000","last_peered":"2023-08-09T12:42:38.230364+0000","last_clean":"2023-08-09T12:42:38.230364+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:42:38.230364+0000","last_undegraded":"2023-08-09T12:42:38.230364+0000","last_fullsized":"2023-08-09T12:42:38.230364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:14.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256167+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:42:38.256167+0000","last_peered":"2023-08-09T12:42:38.256167+0000","last_clean":"2023-08-09T12:42:38.256167+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:42:38.256167+0000","last_undegraded":"2023-08-09T12:42:38.256167+0000","last_fullsized":"2023-08-09T12:42:38.256167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:01.502439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254867+0000","last_change":"2023-08-09T12:42:37.244813+0000","last_active":"2023-08-09T12:42:38.254867+0000","last_peered":"2023-08-09T12:42:38.254867+0000","last_clean":"2023-08-09T12:42:38.254867+0000","last_became_active":"2023-08-09T12:42:37.244595+0000","last_became_peered":"2023-08-09T12:42:37.244595+0000","last_unstale":"2023-08-09T12:42:38.254867+0000","last_undegraded":"2023-08-09T12:42:38.254867+0000","last_fullsized":"2023-08-09T12:42:38.254867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:56.691180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254583+0000","last_change":"2023-08-09T12:42:36.246929+0000","last_active":"2023-08-09T12:42:38.254583+0000","last_peered":"2023-08-09T12:42:38.254583+0000","last_clean":"2023-08-09T12:42:38.254583+0000","last_became_active":"2023-08-09T12:42:36.246532+0000","last_became_peered":"2023-08-09T12:42:36.246532+0000","last_unstale":"2023-08-09T12:42:38.254583+0000","last_undegraded":"2023-08-09T12:42:38.254583+0000","last_fullsized":"2023-08-09T12:42:38.254583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:41:26.943555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230026+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:42:38.230026+0000","last_peered":"2023-08-09T12:42:38.230026+0000","last_clean":"2023-08-09T12:42:38.230026+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:42:38.230026+0000","last_undegraded":"2023-08-09T12:42:38.230026+0000","last_fullsized":"2023-08-09T12:42:38.230026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:17:55.155222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.256527+0000","last_change":"2023-08-09T12:42:37.256965+0000","last_active":"2023-08-09T12:42:38.256527+0000","last_peered":"2023-08-09T12:42:38.256527+0000","last_clean":"2023-08-09T12:42:38.256527+0000","last_became_active":"2023-08-09T12:42:37.249660+0000","last_became_peered":"2023-08-09T12:42:37.249660+0000","last_unstale":"2023-08-09T12:42:38.256527+0000","last_undegraded":"2023-08-09T12:42:38.256527+0000","last_fullsized":"2023-08-09T12:42:38.256527+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:04.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254696+0000","last_change":"2023-08-09T12:42:36.249723+0000","last_active":"2023-08-09T12:42:38.254696+0000","last_peered":"2023-08-09T12:42:38.254696+0000","last_clean":"2023-08-09T12:42:38.254696+0000","last_became_active":"2023-08-09T12:42:36.249183+0000","last_became_peered":"2023-08-09T12:42:36.249183+0000","last_unstale":"2023-08-09T12:42:38.254696+0000","last_undegraded":"2023-08-09T12:42:38.254696+0000","last_fullsized":"2023-08-09T12:42:38.254696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:50:32.878105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.253354+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:42:38.253354+0000","last_peered":"2023-08-09T12:42:38.253354+0000","last_clean":"2023-08-09T12:42:38.253354+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:42:38.253354+0000","last_undegraded":"2023-08-09T12:42:38.253354+0000","last_fullsized":"2023-08-09T12:42:38.253354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:07.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255244+0000","last_change":"2023-08-09T12:42:37.248058+0000","last_active":"2023-08-09T12:42:38.255244+0000","last_peered":"2023-08-09T12:42:38.255244+0000","last_clean":"2023-08-09T12:42:38.255244+0000","last_became_active":"2023-08-09T12:42:37.245837+0000","last_became_peered":"2023-08-09T12:42:37.245837+0000","last_unstale":"2023-08-09T12:42:38.255244+0000","last_undegraded":"2023-08-09T12:42:38.255244+0000","last_fullsized":"2023-08-09T12:42:38.255244+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:13:55.262326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255712+0000","last_change":"2023-08-09T12:42:36.242087+0000","last_active":"2023-08-09T12:42:38.255712+0000","last_peered":"2023-08-09T12:42:38.255712+0000","last_clean":"2023-08-09T12:42:38.255712+0000","last_became_active":"2023-08-09T12:42:36.241640+0000","last_became_peered":"2023-08-09T12:42:36.241640+0000","last_unstale":"2023-08-09T12:42:38.255712+0000","last_undegraded":"2023-08-09T12:42:38.255712+0000","last_fullsized":"2023-08-09T12:42:38.255712+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:53:44.415681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255635+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:42:38.255635+0000","last_peered":"2023-08-09T12:42:38.255635+0000","last_clean":"2023-08-09T12:42:38.255635+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:42:38.255635+0000","last_undegraded":"2023-08-09T12:42:38.255635+0000","last_fullsized":"2023-08-09T12:42:38.255635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:24:19.489283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229156+0000","last_change":"2023-08-09T12:42:37.261247+0000","last_active":"2023-08-09T12:42:38.229156+0000","last_peered":"2023-08-09T12:42:38.229156+0000","last_clean":"2023-08-09T12:42:38.229156+0000","last_became_active":"2023-08-09T12:42:37.260975+0000","last_became_peered":"2023-08-09T12:42:37.260975+0000","last_unstale":"2023-08-09T12:42:38.229156+0000","last_undegraded":"2023-08-09T12:42:38.229156+0000","last_fullsized":"2023-08-09T12:42:38.229156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:28.452927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254355+0000","last_change":"2023-08-09T12:42:36.249872+0000","last_active":"2023-08-09T12:42:38.254355+0000","last_peered":"2023-08-09T12:42:38.254355+0000","last_clean":"2023-08-09T12:42:38.254355+0000","last_became_active":"2023-08-09T12:42:36.249491+0000","last_became_peered":"2023-08-09T12:42:36.249491+0000","last_unstale":"2023-08-09T12:42:38.254355+0000","last_undegraded":"2023-08-09T12:42:38.254355+0000","last_fullsized":"2023-08-09T12:42:38.254355+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:59:20.746429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231734+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:42:38.231734+0000","last_peered":"2023-08-09T12:42:38.231734+0000","last_clean":"2023-08-09T12:42:38.231734+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:42:38.231734+0000","last_undegraded":"2023-08-09T12:42:38.231734+0000","last_fullsized":"2023-08-09T12:42:38.231734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:57:30.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257183+0000","last_change":"2023-08-09T12:42:37.259218+0000","last_active":"2023-08-09T12:42:38.257183+0000","last_peered":"2023-08-09T12:42:38.257183+0000","last_clean":"2023-08-09T12:42:38.257183+0000","last_became_active":"2023-08-09T12:42:37.258966+0000","last_became_peered":"2023-08-09T12:42:37.258966+0000","last_unstale":"2023-08-09T12:42:38.257183+0000","last_undegraded":"2023-08-09T12:42:38.257183+0000","last_fullsized":"2023-08-09T12:42:38.257183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:00.847580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"69'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.230119+0000","last_change":"2023-08-09T12:42:36.246540+0000","last_active":"2023-08-09T12:42:38.230119+0000","last_peered":"2023-08-09T12:42:38.230119+0000","last_clean":"2023-08-09T12:42:38.230119+0000","last_became_active":"2023-08-09T12:42:36.246233+0000","last_became_peered":"2023-08-09T12:42:36.246233+0000","last_unstale":"2023-08-09T12:42:38.230119+0000","last_undegraded":"2023-08-09T12:42:38.230119+0000","last_fullsized":"2023-08-09T12:42:38.230119+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:59:26.390587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229402+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:42:38.229402+0000","last_peered":"2023-08-09T12:42:38.229402+0000","last_clean":"2023-08-09T12:42:38.229402+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:42:38.229402+0000","last_undegraded":"2023-08-09T12:42:38.229402+0000","last_fullsized":"2023-08-09T12:42:38.229402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:39.963390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.233650+0000","last_change":"2023-08-09T12:42:37.263524+0000","last_active":"2023-08-09T12:42:38.233650+0000","last_peered":"2023-08-09T12:42:38.233650+0000","last_clean":"2023-08-09T12:42:38.233650+0000","last_became_active":"2023-08-09T12:42:37.262444+0000","last_became_peered":"2023-08-09T12:42:37.262444+0000","last_unstale":"2023-08-09T12:42:38.233650+0000","last_undegraded":"2023-08-09T12:42:38.233650+0000","last_fullsized":"2023-08-09T12:42:38.233650+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:12.375809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"69'1","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.229273+0000","last_change":"2023-08-09T12:42:36.248225+0000","last_active":"2023-08-09T12:42:38.229273+0000","last_peered":"2023-08-09T12:42:38.229273+0000","last_clean":"2023-08-09T12:42:38.229273+0000","last_became_active":"2023-08-09T12:42:36.245387+0000","last_became_peered":"2023-08-09T12:42:36.245387+0000","last_unstale":"2023-08-09T12:42:38.229273+0000","last_undegraded":"2023-08-09T12:42:38.229273+0000","last_fullsized":"2023-08-09T12:42:38.229273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:58.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.231601+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:42:38.231601+0000","last_peered":"2023-08-09T12:42:38.231601+0000","last_clean":"2023-08-09T12:42:38.231601+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:42:38.231601+0000","last_undegraded":"2023-08-09T12:42:38.231601+0000","last_fullsized":"2023-08-09T12:42:38.231601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:36.822990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.254547+0000","last_change":"2023-08-09T12:42:37.237486+0000","last_active":"2023-08-09T12:42:38.254547+0000","last_peered":"2023-08-09T12:42:38.254547+0000","last_clean":"2023-08-09T12:42:38.254547+0000","last_became_active":"2023-08-09T12:42:37.236380+0000","last_became_peered":"2023-08-09T12:42:37.236380+0000","last_unstale":"2023-08-09T12:42:38.254547+0000","last_undegraded":"2023-08-09T12:42:38.254547+0000","last_fullsized":"2023-08-09T12:42:38.254547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:36.203423+0000","last_clean_scrub_stamp":"2023-08-09T12:42:36.203423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:26.602443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.255841+0000","last_change":"2023-08-09T12:42:36.249795+0000","last_active":"2023-08-09T12:42:38.255841+0000","last_peered":"2023-08-09T12:42:38.255841+0000","last_clean":"2023-08-09T12:42:38.255841+0000","last_became_active":"2023-08-09T12:42:36.248860+0000","last_became_peered":"2023-08-09T12:42:36.248860+0000","last_unstale":"2023-08-09T12:42:38.255841+0000","last_undegraded":"2023-08-09T12:42:38.255841+0000","last_fullsized":"2023-08-09T12:42:38.255841+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:42:35.189682+0000","last_clean_scrub_stamp":"2023-08-09T12:42:35.189682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:34.069478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-08-09T12:42:38.257590+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:42:38.257590+0000","last_peered":"2023-08-09T12:42:38.257590+0000","last_clean":"2023-08-09T12:42:38.257590+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:42:38.257590+0000","last_undegraded":"2023-08-09T12:42:38.257590+0000","last_fullsized":"2023-08-09T12:42:38.257590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:34:45.359471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":949,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194363,"statfs":{"total":200000000,"available":199027780,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.619,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0940000000000001,"15min":1.0660000000000001},"min":{"1min":0.70799999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.601,"5min":1.843,"15min":1.843},"last":1.1990000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1180000000000001,"15min":1.0860000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.708,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7030000000000001,"5min":1.734,"15min":1.734},"last":0.81399999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.1739999999999999,"15min":1.1399999999999999},"min":{"1min":0.85299999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.625,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.167,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.637,"5min":2.173,"15min":2.173},"last":1.3220000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2210000000000001,"15min":1.212},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5860000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.115},{"interface":"front","average":{"1min":1.292,"5min":1.2689999999999999,"15min":1.2490000000000001},"min":{"1min":0.91600000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8009999999999999,"5min":1.96,"15min":1.96},"last":1.03}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.224,"15min":1.1990000000000001},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.5509999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.274,"15min":1.2470000000000001},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.615,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.25}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3140000000000001,"15min":1.2689999999999999},"min":{"1min":0.751,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7849999999999999,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.7},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4790000000000001,"15min":1.4750000000000001},"min":{"1min":0.90100000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5980000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.53}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4710000000000001,"15min":1.464},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.788,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.83699999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.6779999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.575}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.1120000000000001},"min":{"1min":0.78200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5449999999999999,"5min":2.54,"15min":2.54},"last":1.466},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0760000000000001,"15min":1.0549999999999999},"min":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.7010000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.246,"15min":1.228},"min":{"1min":0.874,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7210000000000001,"5min":2.306,"15min":2.306},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3280000000000001,"15min":1.3109999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.671,"5min":1.829,"15min":1.829},"last":1.167}]},{"osd":2,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.093,"15min":1.0820000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4490000000000001,"5min":1.554,"15min":1.554},"last":1.409},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2809999999999999,"15min":1.2649999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.923,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.5940000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.28,"15min":1.2529999999999999},"min":{"1min":0.86799999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7150000000000001,"5min":2.004,"15min":2.004},"last":1.8240000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.27},"min":{"1min":0.84599999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6579999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.268}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.319,"15min":1.2889999999999999},"min":{"1min":0.85299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.0590000000000002,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.353,"15min":1.325},"min":{"1min":1.056,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1059999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.9399999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.327,"15min":1.3089999999999999},"min":{"1min":1.022,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.8240000000000001,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.496,"15min":1.462},"min":{"1min":1.1830000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.4350000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":2.1240000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.4570000000000001,"15min":1.393},"min":{"1min":1.145,"5min":0.752,"15min":0.752},"max":{"1min":2.2610000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":2.0840000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.446,"15min":1.3999999999999999},"min":{"1min":1.0509999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.161,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":2.0459999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1120000000000001,"15min":1.1100000000000001},"min":{"1min":0.67600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.649,"5min":2.427,"15min":2.427},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.073,"15min":1.0429999999999999},"min":{"1min":0.71699999999999997,"5min":0.625,"15min":0.625},"max":{"1min":1.575,"5min":1.851,"15min":1.851},"last":1.0169999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2909999999999999,"15min":1.276},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.766,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2569999999999999,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.298}]},{"osd":2,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.88500000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.427},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1839999999999999,"15min":1.1859999999999999},"min":{"1min":0.95299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.5449999999999999,"5min":1.728,"15min":1.728},"last":1.1040000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2030000000000001,"15min":1.177},"min":{"1min":0.86499999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.363,"5min":1.359,"15min":1.373},"min":{"1min":0.879,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7050000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.5109999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.228,"15min":1.224},"min":{"1min":0.85899999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.343},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.353,"15min":1.3700000000000001},"min":{"1min":0.94099999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.7450000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1910000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.339,"15min":1.3280000000000001},"min":{"1min":0.96699999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.804,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.571},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.458,"15min":1.5},"min":{"1min":1.0920000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.8029999999999999,"5min":2.948,"15min":2.948},"last":1.2549999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":1.111,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7969999999999999,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5089999999999999,"15min":1.504},"min":{"1min":1.1060000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.623}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":373,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199617312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.0940000000000001,"15min":1.071},"min":{"1min":0.81999999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6439999999999999,"5min":1.77,"15min":1.77},"last":1.8520000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.103,"15min":1.081},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.72}]},{"osd":1,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3069999999999999,"15min":1.355},"min":{"1min":0.83199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.897,"5min":1.97,"15min":1.97},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.335,"15min":1.3400000000000001},"min":{"1min":0.95699999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6359999999999999,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.758}]},{"osd":2,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.3140000000000001,"15min":1.321},"min":{"1min":0.88100000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5329999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.325,"15min":1.3129999999999999},"min":{"1min":0.90200000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7270000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5720000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.21,"15min":1.204},"min":{"1min":0.79200000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.49},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.337},"min":{"1min":0.97899999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":1.3500000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3819999999999999,"15min":1.4039999999999999},"min":{"1min":0.92500000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.853,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.073},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.371,"15min":1.379},"min":{"1min":0.98799999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.216}]},{"osd":6,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4610000000000001,"15min":1.5069999999999999},"min":{"1min":0.93200000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.151},{"interface":"front","average":{"1min":1.554,"5min":1.5369999999999999,"15min":1.5429999999999999},"min":{"1min":1.278,"5min":0.755,"15min":0.755},"max":{"1min":1.9570000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.518,"15min":1.5169999999999999},"min":{"1min":1.085,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.53,"5min":1.605,"15min":1.637},"min":{"1min":1.1319999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.804}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":0.86199999999999999,"15min":0.82599999999999996},"min":{"1min":0.44400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.4109999999999996,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.03,"5min":0.89200000000000002,"15min":0.86399999999999999},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.331}]},{"osd":1,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3049999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.159,"5min":0.93700000000000006,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.373,"15min":0.373},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.1220000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.206,"5min":1.2490000000000001,"15min":1.0900000000000001},"min":{"1min":0.47299999999999998,"5min":0.433,"15min":0.433},"max":{"1min":18.145,"5min":18.145,"15min":18.145},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.1759999999999999,"15min":1.1910000000000001},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.7050000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.95399999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.972,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.337,"15min":1.345},"min":{"1min":0.751,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.5960000000000001,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.026}]},{"osd":5,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":2.4769999999999999,"5min":1.5740000000000001,"15min":1.4430000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":18.094000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.3},{"interface":"front","average":{"1min":2.181,"5min":1.446,"15min":1.3120000000000001},"min":{"1min":0.96099999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":14.105,"5min":14.105,"15min":14.105},"last":1.4610000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.357,"15min":1.335},"min":{"1min":0.99399999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":4.0220000000000002,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.3640000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3740000000000001,"15min":1.3720000000000001},"min":{"1min":1.0740000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.806,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.3859999999999999,"15min":1.365},"min":{"1min":1.008,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.429}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194940,"statfs":{"total":200000000,"available":199618924,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4570000000000001,"5min":1.716,"15min":1.716},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.92000000000000004,"15min":0.94799999999999995},"min":{"1min":0.46700000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4830000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.0880000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.504,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1339999999999999,"5min":1.466,"15min":1.466},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.024,"15min":1.05},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6200000000000001,"5min":1.869,"15min":1.869},"last":1.177}]},{"osd":3,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1359999999999999,"15min":1.1619999999999999},"min":{"1min":0.73899999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5489999999999999,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1419999999999999,"15min":1.143},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.3560000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.399,"15min":1.403},"min":{"1min":0.93200000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.897,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.486},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.296,"15min":1.26},"min":{"1min":0.90600000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.819,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.7669999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.381,"15min":1.347},"min":{"1min":1.0580000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.0539999999999998,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.484,"15min":1.482},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.804,"5min":4.806,"15min":4.806},"last":1.5800000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3049999999999999,"15min":1.29},"min":{"1min":0.83999999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.744,"5min":2.323,"15min":2.323},"last":1.863},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":1.0620000000000001,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9319999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.6140000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.353,"15min":1.3480000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6759999999999999,"5min":2.218,"15min":2.218},"last":1.97},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.5209999999999999,"15min":1.5229999999999999},"min":{"1min":1.032,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.1949999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.9039999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194938,"statfs":{"total":200000000,"available":199616548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89400000000000002},"min":{"1min":0.64400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.69399999999999995},{"interface":"front","average":{"1min":6.1859999999999999,"5min":1.917,"15min":1.2090000000000001},"min":{"1min":0.47799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":88.254999999999995,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.75900000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.96399999999999997,"15min":0.92800000000000005},"min":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.127,"15min":1.087},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.617}]},{"osd":3,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7150000000000001,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.343},{"interface":"front","average":{"1min":1.369,"5min":1,"15min":0.91600000000000004},"min":{"1min":0.53900000000000003,"5min":0.503,"15min":0.503},"max":{"1min":5.4320000000000004,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.157}]},{"osd":4,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":1.4810000000000001,"15min":1.268},"min":{"1min":0.93899999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":25.172000000000001,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.2869999999999999,"15min":1.2709999999999999},"min":{"1min":1.0289999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.5069999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":2.96,"5min":1.6000000000000001,"15min":1.3759999999999999},"min":{"1min":0.90700000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":28.710000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3,"15min":1.258},"min":{"1min":0.91600000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.5700000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.4510000000000001,"15min":1.399},"min":{"1min":1.0860000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":6.0460000000000003,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.423,"5min":1.3700000000000001,"15min":1.347},"min":{"1min":0.91300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.863,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.667}]},{"osd":7,"last update":"Wed Aug 9 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":3.0259999999999998,"5min":1.768,"15min":1.5549999999999999},"min":{"1min":0.98699999999999999,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":26.975999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.728},{"interface":"front","average":{"1min":3.1640000000000001,"5min":1.7629999999999999,"15min":1.53},"min":{"1min":1.052,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":28.765000000000001,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.6850000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":948,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194363,"statfs":{"total":200000000,"available":199028556,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.50900000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":0.98599999999999999,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":6.1749999999999998,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.93700000000000006}]},{"osd":2,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.95099999999999996,"15min":0.93700000000000006},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.657,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.0629999999999999,"15min":1.0049999999999999},"min":{"1min":0.59899999999999998,"5min":0.5,"15min":0.5},"max":{"1min":6.2549999999999999,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":1.141}]},{"osd":3,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":0.98399999999999999,"15min":0.91200000000000003},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.1679999999999999,"15min":1.1659999999999999},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.6000000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4810000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.3660000000000001,"15min":1.3300000000000001},"min":{"1min":0.96299999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":9.9629999999999992,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.288,"15min":1.264},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.5920000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.3420000000000001,"15min":1.29},"min":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":10.004,"5min":10.004,"15min":10.004},"last":1.53},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.369,"15min":1.365},"min":{"1min":0.87,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.909,"5min":2.161,"15min":2.161},"last":1.712}]},{"osd":6,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.377,"15min":1.3220000000000001},"min":{"1min":0.83699999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.4290000000000003,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.881,"5min":1.472,"15min":1.415},"min":{"1min":1.093,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":9.9190000000000005,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.784}]},{"osd":7,"last update":"Wed Aug 9 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":1.552,"15min":1.4199999999999999},"min":{"1min":0.89300000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":18.114000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.897,"5min":1.4930000000000001,"15min":1.4390000000000001},"min":{"1min":1.052,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":9.5640000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.6559999999999999}]}]}],"pool_statfs":[]}} 2023-08-09T12:42:47.740 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:42:47.740 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:42:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.013+0000 7fd198d74640 1 Processor -- start 2023-08-09T12:42:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.013+0000 7fd198d74640 1 -- start start 2023-08-09T12:42:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.015+0000 7fd198d74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194159bd0 0x7fd1940c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.015+0000 7fd198d74640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1940b3020 0x7fd1940b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.015+0000 7fd198d74640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940b2b90 con 0x7fd1940b3d60 2023-08-09T12:42:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.015+0000 7fd198d74640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1940cabb0 con 0x7fd1940b3020 2023-08-09T12:42:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.015+0000 7fd198d74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940b2580 con 0x7fd194159bd0 2023-08-09T12:42:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.015+0000 7fd18affd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd1940b3d60 0x7fd1940cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49254/0 (socket says 172.21.15.17:49254) 2023-08-09T12:42:48.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.015+0000 7fd18affd640 1 -- 172.21.15.17:0/782557200 learned_addr learned my addr 172.21.15.17:0/782557200 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:48.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd1937fe640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194159bd0 0x7fd1940c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd193fff640 1 --2- 172.21.15.17:0/782557200 >> v2:172.21.15.142:3300/0 conn(0x7fd1940b3020 0x7fd1940b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541054033 0 0) 0x7fd1940b2b90 con 0x7fd1940b3d60 2023-08-09T12:42:48.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd174003520 con 0x7fd1940b3d60 2023-08-09T12:42:48.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4216954097 0 0) 0x7fd174003520 con 0x7fd1940b3d60 2023-08-09T12:42:48.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194159bd0 msgr2=0x7fd1940c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:48.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194159bd0 0x7fd1940c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 >> v2:172.21.15.142:3300/0 conn(0x7fd1940b3020 msgr2=0x7fd1940b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:48.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 --2- 172.21.15.17:0/782557200 >> v2:172.21.15.142:3300/0 conn(0x7fd1940b3020 0x7fd1940b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940ca350 con 0x7fd1940b3d60 2023-08-09T12:42:48.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fd17c001670 con 0x7fd1940b3d60 2023-08-09T12:42:48.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.016+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 >> v1:172.21.15.17:6789/0 conn(0x7fd1940b3d60 legacy=0x7fd1940cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd192ffd640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd174003970 0x7fd174003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd192ffd640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194159bd0 0x7fd1740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd192ffd640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd174005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940cabb0 con 0x7fd174004d00 2023-08-09T12:42:48.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940b2580 con 0x7fd174003970 2023-08-09T12:42:48.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17400b980 con 0x7fd194159bd0 2023-08-09T12:42:48.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd193fff640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd174005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd1937fe640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd174003970 0x7fd174003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd18affd640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194159bd0 0x7fd1740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd193fff640 1 -- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194159bd0 msgr2=0x7fd1740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd193fff640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194159bd0 0x7fd1740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd193fff640 1 -- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd174003970 msgr2=0x7fd174003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd193fff640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd174003970 0x7fd174003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.017+0000 7fd193fff640 1 -- 172.21.15.17:0/782557200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174003520 con 0x7fd174004d00 2023-08-09T12:42:48.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.018+0000 7fd1937fe640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd174003970 0x7fd174003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:42:48.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.019+0000 7fd193fff640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd174005180 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009fc0 tx=0x7fd1740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f9c1c8605ca615 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:48.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.019+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c02cc60 con 0x7fd174004d00 2023-08-09T12:42:48.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.019+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00f040 con 0x7fd174004d00 2023-08-09T12:42:48.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.019+0000 7fd192ffd640 1 -- 172.21.15.17:0/782557200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c034440 con 0x7fd174004d00 2023-08-09T12:42:48.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.020+0000 7fd198d74640 1 -- 172.21.15.17:0/782557200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 msgr2=0x7fd174005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.020+0000 7fd198d74640 1 --2- 172.21.15.17:0/782557200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd174005180 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009fc0 tx=0x7fd1740057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.020+0000 7fd193fff640 1 -- 172.21.15.17:0/782557200 reap_dead start 2023-08-09T12:42:48.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.020+0000 7fd198d74640 1 -- 172.21.15.17:0/782557200 shutdown_connections 2023-08-09T12:42:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.020+0000 7fd198d74640 1 -- 172.21.15.17:0/782557200 >> 172.21.15.17:0/782557200 conn(0x7fd1940cb020 msgr2=0x7fd1940cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.020+0000 7fd198d74640 1 -- 172.21.15.17:0/782557200 shutdown_connections 2023-08-09T12:42:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.020+0000 7fd198d74640 1 -- 172.21.15.17:0/782557200 wait complete. 2023-08-09T12:42:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.022+0000 7fd198d74640 1 Processor -- start 2023-08-09T12:42:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.022+0000 7fd198d74640 1 -- start start 2023-08-09T12:42:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd198d74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd19414b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd198d74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1941f3ba0 0x7fd194151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd198d74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194151e60 0x7fd1941ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd198d74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194152310 con 0x7fd174004d00 2023-08-09T12:42:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd198d74640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941f2e70 con 0x7fd1941f3ba0 2023-08-09T12:42:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd198d74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941f0660 con 0x7fd194151e60 2023-08-09T12:42:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd19414b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd19414b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42612/0 (socket says 172.21.15.17:42612) 2023-08-09T12:42:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd1937fe640 1 -- 172.21.15.17:0/3572486263 learned_addr learned my addr 172.21.15.17:0/3572486263 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd1937fe640 1 -- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194151e60 msgr2=0x7fd1941ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd1937fe640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194151e60 0x7fd1941ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd1937fe640 1 -- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1941f3ba0 msgr2=0x7fd194151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd18affd640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1941f3ba0 0x7fd194151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd1937fe640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1941f3ba0 0x7fd194151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.023+0000 7fd1937fe640 1 -- 172.21.15.17:0/3572486263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1941f30c0 con 0x7fd174004d00 2023-08-09T12:42:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.024+0000 7fd1937fe640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd19414b240 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd184011580 tx=0x7fd184011a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.024+0000 7fd190ff9640 1 -- 172.21.15.17:0/3572486263 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184015870 con 0x7fd174004d00 2023-08-09T12:42:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.024+0000 7fd190ff9640 1 -- 172.21.15.17:0/3572486263 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1840159d0 con 0x7fd174004d00 2023-08-09T12:42:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.024+0000 7fd190ff9640 1 -- 172.21.15.17:0/3572486263 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184015d60 con 0x7fd174004d00 2023-08-09T12:42:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.024+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1941f33a0 con 0x7fd174004d00 2023-08-09T12:42:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.024+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1941efdb0 con 0x7fd174004d00 2023-08-09T12:42:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.026+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19404e390 con 0x7fd174004d00 2023-08-09T12:42:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.027+0000 7fd190ff9640 1 -- 172.21.15.17:0/3572486263 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd18400f460 con 0x7fd174004d00 2023-08-09T12:42:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.028+0000 7fd190ff9640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd17806a050 0x7fd17806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.028+0000 7fd190ff9640 1 -- 172.21.15.17:0/3572486263 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd184088d30 con 0x7fd174004d00 2023-08-09T12:42:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.028+0000 7fd18affd640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd17806a050 0x7fd17806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.030+0000 7fd18affd640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd17806a050 0x7fd17806c510 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd17c001eb0 tx=0x7fd17c001150 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:48.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.032+0000 7fd190ff9640 1 -- 172.21.15.17:0/3572486263 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd184057ec0 con 0x7fd174004d00 2023-08-09T12:42:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.293+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd1940b04c0 con 0x7fd174004d00 2023-08-09T12:42:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.299+0000 7fd190ff9640 1 -- 172.21.15.17:0/3572486263 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd184057a50 con 0x7fd174004d00 2023-08-09T12:42:48.302 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:42:48.302 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:42:48.302 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:42:48.303 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:42:48.303 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:42:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:42:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd17806a050 msgr2=0x7fd17806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd17806a050 0x7fd17806c510 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd17c001eb0 tx=0x7fd17c001150 comp rx=0 tx=0).stop 2023-08-09T12:42:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 msgr2=0x7fd19414b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd19414b240 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd184011580 tx=0x7fd184011a40 comp rx=0 tx=0).stop 2023-08-09T12:42:48.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 shutdown_connections 2023-08-09T12:42:48.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd17806a050 0x7fd17806c510 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd194151e60 0x7fd1941ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1941f3ba0 0x7fd194151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 --2- 172.21.15.17:0/3572486263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd174004d00 0x7fd19414b240 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 >> 172.21.15.17:0/3572486263 conn(0x7fd1940cb020 msgr2=0x7fd1940afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:48.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 shutdown_connections 2023-08-09T12:42:48.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.302+0000 7fd198d74640 1 -- 172.21.15.17:0/3572486263 wait complete. 2023-08-09T12:42:48.324 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.550+0000 7f6273d76640 1 Processor -- start 2023-08-09T12:42:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.550+0000 7f6273d76640 1 -- start start 2023-08-09T12:42:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.552+0000 7f6273d76640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c161280 0x7f626c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.552+0000 7f6273d76640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f626c0acfc0 0x7f626c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.552+0000 7f6273d76640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626c15df30 con 0x7f626c161660 2023-08-09T12:42:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.552+0000 7f6273d76640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626c15d430 con 0x7f626c0acfc0 2023-08-09T12:42:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.552+0000 7f6273d76640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c0ca9d0 con 0x7f626c161280 2023-08-09T12:42:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.553+0000 7f6272313640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f626c0acfc0 0x7f626c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.553+0000 7f6272313640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f626c0acfc0 0x7f626c0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42622/0 (socket says 172.21.15.17:42622) 2023-08-09T12:42:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.553+0000 7f6272313640 1 -- 172.21.15.17:0/3369169426 learned_addr learned my addr 172.21.15.17:0/3369169426 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.553+0000 7f6271b12640 1 --2- 172.21.15.17:0/3369169426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c161280 0x7f626c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.553+0000 7f6272313640 1 -- 172.21.15.17:0/3369169426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c161280 msgr2=0x7f626c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.553+0000 7f6272313640 1 --2- 172.21.15.17:0/3369169426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c161280 0x7f626c0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.553+0000 7f6272313640 1 -- 172.21.15.17:0/3369169426 >> v1:172.21.15.142:6789/0 conn(0x7f626c161660 legacy=0x7f626c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.553+0000 7f6272313640 1 -- 172.21.15.17:0/3369169426 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c15e3c0 con 0x7f626c0acfc0 2023-08-09T12:42:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.554+0000 7f6272313640 1 --2- 172.21.15.17:0/3369169426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c0acfc0 0x7f626c0cc630 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6264009e50 tx=0x7f626402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9980ddd750c7cfcb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6270b10640 1 -- 172.21.15.17:0/3369169426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626402c9e0 con 0x7f626c0acfc0 2023-08-09T12:42:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6270b10640 1 -- 172.21.15.17:0/3369169426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626402cb40 con 0x7f626c0acfc0 2023-08-09T12:42:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6270b10640 1 -- 172.21.15.17:0/3369169426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640343f0 con 0x7f626c0acfc0 2023-08-09T12:42:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6273d76640 1 -- 172.21.15.17:0/3369169426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c0acfc0 msgr2=0x7f626c0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6273d76640 1 --2- 172.21.15.17:0/3369169426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c0acfc0 0x7f626c0cc630 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6264009e50 tx=0x7f626402be40 comp rx=0 tx=0).stop 2023-08-09T12:42:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6273d76640 1 -- 172.21.15.17:0/3369169426 shutdown_connections 2023-08-09T12:42:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6273d76640 1 --2- 172.21.15.17:0/3369169426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c0acfc0 0x7f626c0cc630 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6273d76640 1 --2- 172.21.15.17:0/3369169426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c161280 0x7f626c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.555+0000 7f6273d76640 1 -- 172.21.15.17:0/3369169426 >> 172.21.15.17:0/3369169426 conn(0x7f626c0cb1b0 msgr2=0x7f626c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.556+0000 7f6273d76640 1 -- 172.21.15.17:0/3369169426 shutdown_connections 2023-08-09T12:42:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.556+0000 7f6273d76640 1 -- 172.21.15.17:0/3369169426 wait complete. 2023-08-09T12:42:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.557+0000 7f6273d76640 1 Processor -- start 2023-08-09T12:42:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.558+0000 7f6273d76640 1 -- start start 2023-08-09T12:42:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.558+0000 7f6273d76640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c0acfc0 0x7f626c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6273d76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c161280 0x7f626c0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6273d76640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f626c161660 0x7f626c0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6273d76640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1541d0 con 0x7f626c161280 2023-08-09T12:42:48.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6273d76640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c157890 con 0x7f626c161660 2023-08-09T12:42:48.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6273d76640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1545d0 con 0x7f626c0acfc0 2023-08-09T12:42:48.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6271311640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c161280 0x7f626c0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6271311640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c161280 0x7f626c0c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42630/0 (socket says 172.21.15.17:42630) 2023-08-09T12:42:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6271311640 1 -- 172.21.15.17:0/705030324 learned_addr learned my addr 172.21.15.17:0/705030324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6271311640 1 -- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c0acfc0 msgr2=0x7f626c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6271311640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c0acfc0 0x7f626c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6271311640 1 -- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f626c161660 msgr2=0x7f626c0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6272313640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f626c161660 0x7f626c0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6271311640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f626c161660 0x7f626c0c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.559+0000 7f6271311640 1 -- 172.21.15.17:0/705030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009b30 con 0x7f626c161280 2023-08-09T12:42:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.560+0000 7f6271311640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c161280 0x7f626c0c8090 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c3f0 tx=0x7f625c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.560+0000 7f62627fc640 1 -- 172.21.15.17:0/705030324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c011790 con 0x7f626c161280 2023-08-09T12:42:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.560+0000 7f62627fc640 1 -- 172.21.15.17:0/705030324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c011910 con 0x7f626c161280 2023-08-09T12:42:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.560+0000 7f62627fc640 1 -- 172.21.15.17:0/705030324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c011cc0 con 0x7f626c161280 2023-08-09T12:42:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.560+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c1548b0 con 0x7f626c161280 2023-08-09T12:42:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.560+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c154e70 con 0x7f626c161280 2023-08-09T12:42:48.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.562+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c067a80 con 0x7f626c161280 2023-08-09T12:42:48.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.562+0000 7f62627fc640 1 -- 172.21.15.17:0/705030324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f625c012420 con 0x7f626c161280 2023-08-09T12:42:48.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.563+0000 7f62627fc640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f625006a050 0x7f625006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:48.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.564+0000 7f62627fc640 1 -- 172.21.15.17:0/705030324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f625c088300 con 0x7f626c161280 2023-08-09T12:42:48.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.564+0000 7f6271b12640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f625006a050 0x7f625006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:48.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.565+0000 7f6271b12640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f625006a050 0x7f625006c510 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6268006fd0 tx=0x7f6268008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:48.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.568+0000 7f62627fc640 1 -- 172.21.15.17:0/705030324 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f625c053950 con 0x7f626c161280 2023-08-09T12:42:48.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.806+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f626c0adc60 con 0x7f626c161280 2023-08-09T12:42:48.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.807+0000 7f62627fc640 1 -- 172.21.15.17:0/705030324 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f625c056f70 con 0x7f626c161280 2023-08-09T12:42:48.810 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:48.811 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2314028117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2314028117},{"type":"v1","addr":"172.21.15.142:6837","nonce":2314028117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3413359063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3413359063},{"type":"v1","addr":"172.21.15.142:6835","nonce":3413359063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/295901720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":295901720},{"type":"v1","addr":"172.21.15.17:6834","nonce":295901720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:42:36.710411+0000","modified":"2023-08-09T12:42:40.710471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1591311172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1591311172},{"type":"v1","addr":"172.21.15.17:6835","nonce":1591311172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-09T12:42:48.811 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2023-08-09T12:42:48.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f625006a050 msgr2=0x7f625006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f625006a050 0x7f625006c510 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6268006fd0 tx=0x7f6268008040 comp rx=0 tx=0).stop 2023-08-09T12:42:48.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c161280 msgr2=0x7f626c0c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c161280 0x7f626c0c8090 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c3f0 tx=0x7f625c00c8b0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 shutdown_connections 2023-08-09T12:42:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f625006a050 0x7f625006c510 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f626c161660 0x7f626c0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626c161280 0x7f626c0c8090 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 --2- 172.21.15.17:0/705030324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f626c0acfc0 0x7f626c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 >> 172.21.15.17:0/705030324 conn(0x7f626c0cb1b0 msgr2=0x7f626c06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:48.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 shutdown_connections 2023-08-09T12:42:48.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:48.810+0000 7f6273d76640 1 -- 172.21.15.17:0/705030324 wait complete. 2023-08-09T12:42:49.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:42:36.710411+0000', 'modified': '2023-08-09T12:42:40.710471+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6159}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6159': {'gid': 6159, 'name': 'c', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/1591311172', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6832', 'nonce': 1591311172}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 1591311172}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:42:49.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:42:49.234 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-09T12:42:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.474+0000 7fe6dd7a4640 1 Processor -- start 2023-08-09T12:42:49.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.474+0000 7fe6dd7a4640 1 -- start start 2023-08-09T12:42:49.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.476+0000 7fe6dd7a4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6d8161660 0x7fe6d80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.476+0000 7fe6dd7a4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80ad240 con 0x7fe6d80acdf0 2023-08-09T12:42:49.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.476+0000 7fe6dd7a4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d815df30 con 0x7fe6d8161280 2023-08-09T12:42:49.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.476+0000 7fe6dd7a4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d815d430 con 0x7fe6d8161660 2023-08-09T12:42:49.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.476+0000 7fe6d77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe6d80acdf0 0x7fe6d80cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49264/0 (socket says 172.21.15.17:49264) 2023-08-09T12:42:49.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.476+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3081724337 learned_addr learned my addr 172.21.15.17:0/3081724337 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:49.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6cffff640 1 --2- 172.21.15.17:0/3081724337 >> v2:172.21.15.142:3300/0 conn(0x7fe6d8161660 0x7fe6d80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389060024 0 0) 0x7fe6d0001490 con 0x7fe6d80acdf0 2023-08-09T12:42:49.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c4003520 con 0x7fe6d80acdf0 2023-08-09T12:42:49.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645649112 0 0) 0x7fe6c4003520 con 0x7fe6d80acdf0 2023-08-09T12:42:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 >> v2:172.21.15.142:3300/0 conn(0x7fe6d8161660 msgr2=0x7fe6d80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 --2- 172.21.15.17:0/3081724337 >> v2:172.21.15.142:3300/0 conn(0x7fe6d8161660 0x7fe6d80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 >> v1:172.21.15.142:6789/0 conn(0x7fe6d8161280 legacy=0x7fe6d80c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d80ca9d0 con 0x7fe6d80acdf0 2023-08-09T12:42:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe6d0001b80 con 0x7fe6d80acdf0 2023-08-09T12:42:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 >> v1:172.21.15.17:6789/0 conn(0x7fe6d80acdf0 legacy=0x7fe6d80cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.477+0000 7fe6d67fc640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6c4003970 0x7fe6c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d67fc640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c40047c0 0x7fe6c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d67fc640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c400c0f0 con 0x7fe6c4005180 2023-08-09T12:42:49.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c400c260 con 0x7fe6c40047c0 2023-08-09T12:42:49.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c400c420 con 0x7fe6c4003970 2023-08-09T12:42:49.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6cffff640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c40047c0 0x7fe6c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6c4003970 0x7fe6c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6c4003970 msgr2=0x7fe6c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6c4003970 0x7fe6c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c40047c0 msgr2=0x7fe6c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c40047c0 0x7fe6c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3081724337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c4003520 con 0x7fe6c4005180 2023-08-09T12:42:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6cffff640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c40047c0 0x7fe6c4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.478+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6c4003970 0x7fe6c4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.479+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3081724337 reap_dead start 2023-08-09T12:42:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.479+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6c400b980 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000a830 tx=0x7fe6c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cc33eab99b5789 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.480+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0034630 con 0x7fe6c4005180 2023-08-09T12:42:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.480+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d002f070 con 0x7fe6c4005180 2023-08-09T12:42:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.480+0000 7fe6d67fc640 1 -- 172.21.15.17:0/3081724337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00349f0 con 0x7fe6c4005180 2023-08-09T12:42:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.480+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/3081724337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 msgr2=0x7fe6c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.480+0000 7fe6dd7a4640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6c400b980 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000a830 tx=0x7fe6c40057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.480+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/3081724337 shutdown_connections 2023-08-09T12:42:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.480+0000 7fe6dd7a4640 1 --2- 172.21.15.17:0/3081724337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6c400b980 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.480+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/3081724337 >> 172.21.15.17:0/3081724337 conn(0x7fe6d80cb1b0 msgr2=0x7fe6d80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.481+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/3081724337 shutdown_connections 2023-08-09T12:42:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.481+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/3081724337 wait complete. 2023-08-09T12:42:49.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.482+0000 7fe6dd7a4640 1 Processor -- start 2023-08-09T12:42:49.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.483+0000 7fe6dd7a4640 1 -- start start 2023-08-09T12:42:49.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6dd7a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6d814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6dd7a4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6d80c6e30 0x7fe6d8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6dd7a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d81510b0 0x7fe6d81f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6dd7a4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8151540 con 0x7fe6c4005180 2023-08-09T12:42:49.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6dd7a4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80c69a0 con 0x7fe6d80c6e30 2023-08-09T12:42:49.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6dd7a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d814f180 con 0x7fe6d81510b0 2023-08-09T12:42:49.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6d814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6d814ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42634/0 (socket says 172.21.15.17:42634) 2023-08-09T12:42:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d6ffd640 1 -- 172.21.15.17:0/662164108 learned_addr learned my addr 172.21.15.17:0/662164108 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6cffff640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6d80c6e30 0x7fe6d8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d81510b0 0x7fe6d81f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d6ffd640 1 -- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d81510b0 msgr2=0x7fe6d81f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d81510b0 0x7fe6d81f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d6ffd640 1 -- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6d80c6e30 msgr2=0x7fe6d8150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6d80c6e30 0x7fe6d8150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6d6ffd640 1 -- 172.21.15.17:0/662164108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d81f6990 con 0x7fe6c4005180 2023-08-09T12:42:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.484+0000 7fe6cffff640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6d80c6e30 0x7fe6d8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.485+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6d814ec40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800d770 tx=0x7fe6c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.485+0000 7fe6cf7fe640 1 -- 172.21.15.17:0/662164108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8005270 con 0x7fe6c4005180 2023-08-09T12:42:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.485+0000 7fe6cf7fe640 1 -- 172.21.15.17:0/662164108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c80053d0 con 0x7fe6c4005180 2023-08-09T12:42:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.485+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/662164108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d80c6070 con 0x7fe6c4005180 2023-08-09T12:42:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.485+0000 7fe6cf7fe640 1 -- 172.21.15.17:0/662164108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800b8f0 con 0x7fe6c4005180 2023-08-09T12:42:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.485+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/662164108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d80c6630 con 0x7fe6c4005180 2023-08-09T12:42:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.488+0000 7fe6cf7fe640 1 -- 172.21.15.17:0/662164108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe6c800ba50 con 0x7fe6c4005180 2023-08-09T12:42:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.489+0000 7fe6cf7fe640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6b806a050 0x7fe6b806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.489+0000 7fe6cf7fe640 1 -- 172.21.15.17:0/662164108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6c8088590 con 0x7fe6c4005180 2023-08-09T12:42:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.489+0000 7fe6cffff640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6b806a050 0x7fe6b806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.490+0000 7fe6e03ef740 1 Processor -- start 2023-08-09T12:42:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.490+0000 7fe6e03ef740 1 -- start start 2023-08-09T12:42:49.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.490+0000 7fe6cffff640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6b806a050 0x7fe6b806c510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80cbbc0 tx=0x7fe6c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 0x55665ec51030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec20bd0 0x55665ec4dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec247d0 0x55665ec4e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665eb928f0 con 0x55665ec247d0 2023-08-09T12:42:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665eb8ffe0 con 0x55665ec20bd0 2023-08-09T12:42:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55665eb8b8d0 con 0x55665ec50c50 2023-08-09T12:42:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec247d0 0x55665ec4e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec247d0 0x55665ec4e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42636/0 (socket says 172.21.15.17:42636) 2023-08-09T12:42:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3108289176 learned_addr learned my addr 172.21.15.17:0/3108289176 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6cffff640 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec20bd0 0x55665ec4dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 0x55665ec51030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3108289176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 msgr2=0x55665ec51030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 0x55665ec51030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3108289176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec20bd0 msgr2=0x55665ec4dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec20bd0 0x55665ec4dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.491+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3108289176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55665eb44ac0 con 0x55665ec247d0 2023-08-09T12:42:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.492+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec247d0 0x55665ec4e400 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe6d002cc50 tx=0x7fe6d0009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58ea263d8569245 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.492+0000 7fe6ccff9640 1 -- 172.21.15.17:0/3108289176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0001ac0 con 0x55665ec247d0 2023-08-09T12:42:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.492+0000 7fe6ccff9640 1 -- 172.21.15.17:0/3108289176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d0001250 con 0x55665ec247d0 2023-08-09T12:42:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.492+0000 7fe6ccff9640 1 -- 172.21.15.17:0/3108289176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0004da0 con 0x55665ec247d0 2023-08-09T12:42:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3108289176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec247d0 msgr2=0x55665ec4e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec247d0 0x55665ec4e400 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe6d002cc50 tx=0x7fe6d0009030 comp rx=0 tx=0).stop 2023-08-09T12:42:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3108289176 shutdown_connections 2023-08-09T12:42:49.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec247d0 0x55665ec4e400 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec20bd0 0x55665ec4dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3108289176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 0x55665ec51030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3108289176 >> 172.21.15.17:0/3108289176 conn(0x55665ec22ee0 msgr2=0x55665ec6ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:49.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3108289176 shutdown_connections 2023-08-09T12:42:49.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.493+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3108289176 wait complete. 2023-08-09T12:42:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.494+0000 7fe6e03ef740 1 -- start start 2023-08-09T12:42:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.494+0000 7fe6e03ef740 1 Processor -- start 2023-08-09T12:42:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec3d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 0x55665ec56150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec3d930 0x55665ec537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665eb2bd40 con 0x55665ec3d930 2023-08-09T12:42:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665eb2b9e0 con 0x55665ec247d0 2023-08-09T12:42:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55665e8f1f20 con 0x55665ec50c50 2023-08-09T12:42:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6e03ef740 10 client.0 _ll_register_callbacks cb 0x55665eb44160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:42:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec3d930 0x55665ec537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec3d930 0x55665ec537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42644/0 (socket says 172.21.15.17:42644) 2023-08-09T12:42:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.495+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3807880235 learned_addr learned my addr 172.21.15.17:0/3807880235 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec3d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6cffff640 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 0x55665ec56150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 msgr2=0x55665ec56150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 0x55665ec56150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 msgr2=0x55665ec3d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec3d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6d77fe640 1 -- 172.21.15.17:0/3807880235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c4003520 con 0x55665ec3d930 2023-08-09T12:42:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec3d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec3d930 0x55665ec537d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000a0b0 tx=0x7fe6d0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c334596436e35ba0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:42:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.496+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/3807880235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0004b60 con 0x55665ec3d930 2023-08-09T12:42:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3807880235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55665eb63500 con 0x55665ec3d930 2023-08-09T12:42:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/3807880235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6d0004cc0 con 0x55665ec3d930 2023-08-09T12:42:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/3807880235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6d0004e80 con 0x55665ec3d930 2023-08-09T12:42:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 10 client.6306 fetch_fsmap learned FSMap version 35 2023-08-09T12:42:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3807880235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55665eb89f50 con 0x55665ec3d930 2023-08-09T12:42:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/3807880235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55665eb63500 con 0x55665ec3d930 2023-08-09T12:42:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/3807880235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe6d0034430 con 0x55665ec3d930 2023-08-09T12:42:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 10 client.6306 fetch_fsmap finished waiting for FSMap version 35 2023-08-09T12:42:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 10 client.6306 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T12:42:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 20 client.6306 populate_metadata read hostname 'smithi017' 2023-08-09T12:42:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] conn(0x55665ec6e5e0 0x55665ec51590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 4 client.6306 mds_command: new command op to 6159 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:42:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.497+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3807880235 --> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55665eb60bc0 con 0x55665ec6e5e0 2023-08-09T12:42:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.498+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] conn(0x55665ec6e5e0 0x55665ec51590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.498+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] conn(0x55665ec6e5e0 0x55665ec51590 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2854227535f4817c server_cookie=a0b031741c3f598c in_seq=0 out_seq=0 2023-08-09T12:42:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.498+0000 7fe6b5ffb640 10 client.6306 ms_handle_connect on v2:172.21.15.17:6832/1591311172 2023-08-09T12:42:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.499+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/3807880235 <== mds.0 v2:172.21.15.17:6832/1591311172 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55665eb60bc0 con 0x55665ec6e5e0 2023-08-09T12:42:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.499+0000 7fe6b5ffb640 10 client.6306 handle_command_reply: tid=0 2023-08-09T12:42:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.499+0000 7fe6e03ef740 1 client.6306 shutdown 2023-08-09T12:42:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.499+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3807880235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec3d930 msgr2=0x55665ec537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.499+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec3d930 0x55665ec537d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000a0b0 tx=0x7fe6d0007000 comp rx=0 tx=0).stop 2023-08-09T12:42:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3807880235 shutdown_connections 2023-08-09T12:42:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] conn(0x55665ec6e5e0 0x55665ec51590 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec3d930 0x55665ec537d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec50c50 0x55665ec56150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/3807880235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec3d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6b5ffb640 0 client.6306 ms_handle_reset on v2:172.21.15.17:6832/1591311172 2023-08-09T12:42:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3807880235 >> 172.21.15.17:0/3807880235 conn(0x55665ec20bd0 msgr2=0x55665ec54860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3807880235 shutdown_connections 2023-08-09T12:42:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 1 -- 172.21.15.17:0/3807880235 wait complete. 2023-08-09T12:42:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.500+0000 7fe6e03ef740 20 client.6306 trim_cache size 0 max 16384 2023-08-09T12:42:49.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.517+0000 7fe6e03ef740 1 Processor -- start 2023-08-09T12:42:49.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.517+0000 7fe6e03ef740 1 -- start start 2023-08-09T12:42:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec84bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec3d930 0x55665ec4bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665ec857e0 con 0x55665ec50c50 2023-08-09T12:42:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665ec3e140 con 0x55665ec247d0 2023-08-09T12:42:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55665ec219f0 con 0x55665ec3d930 2023-08-09T12:42:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42646/0 (socket says 172.21.15.17:42646) 2023-08-09T12:42:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.518+0000 7fe6d77fe640 1 -- 172.21.15.17:0/1150225093 learned_addr learned my addr 172.21.15.17:0/1150225093 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:49.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/1150225093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec84bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6d77fe640 1 -- 172.21.15.17:0/1150225093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec3d930 msgr2=0x55665ec4bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/1150225093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec3d930 0x55665ec4bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6d77fe640 1 -- 172.21.15.17:0/1150225093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 msgr2=0x55665ec84bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/1150225093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec84bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6d77fe640 1 -- 172.21.15.17:0/1150225093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55665ebbd300 con 0x55665ec50c50 2023-08-09T12:42:49.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/1150225093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c4a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe6d002cc50 tx=0x7fe6d003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dd5552caa6873c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6cd7fa640 1 -- 172.21.15.17:0/1150225093 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0001b90 con 0x55665ec50c50 2023-08-09T12:42:49.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6cd7fa640 1 -- 172.21.15.17:0/1150225093 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d00348a0 con 0x55665ec50c50 2023-08-09T12:42:49.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.519+0000 7fe6cd7fa640 1 -- 172.21.15.17:0/1150225093 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0004d60 con 0x55665ec50c50 2023-08-09T12:42:49.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1150225093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 msgr2=0x55665ec4c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1150225093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c4a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe6d002cc50 tx=0x7fe6d003e000 comp rx=0 tx=0).stop 2023-08-09T12:42:49.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1150225093 shutdown_connections 2023-08-09T12:42:49.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1150225093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c4a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1150225093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec3d930 0x55665ec4bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1150225093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec247d0 0x55665ec84bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1150225093 >> 172.21.15.17:0/1150225093 conn(0x55665ec20bd0 msgr2=0x55665ec6ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:49.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1150225093 shutdown_connections 2023-08-09T12:42:49.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.520+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1150225093 wait complete. 2023-08-09T12:42:49.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.521+0000 7fe6e03ef740 1 -- start start 2023-08-09T12:42:49.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.521+0000 7fe6e03ef740 1 Processor -- start 2023-08-09T12:42:49.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.522+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec247d0 0x55665ec4b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.522+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec3d930 0x55665ec7a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.522+0000 7fe6e03ef740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.522+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665ec6c540 con 0x55665ec50c50 2023-08-09T12:42:49.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.522+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55665ec6c180 con 0x55665ec3d930 2023-08-09T12:42:49.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.522+0000 7fe6e03ef740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55665ec7abc0 con 0x55665ec247d0 2023-08-09T12:42:49.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.522+0000 7fe6e03ef740 10 client.0 _ll_register_callbacks cb 0x7fe6d0042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:42:49.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42658/0 (socket says 172.21.15.17:42658) 2023-08-09T12:42:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 -- 172.21.15.17:0/1034800253 learned_addr learned my addr 172.21.15.17:0/1034800253 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec247d0 0x55665ec4b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6cffff640 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec3d930 0x55665ec7a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 -- 172.21.15.17:0/1034800253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec247d0 msgr2=0x55665ec4b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec247d0 0x55665ec4b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 -- 172.21.15.17:0/1034800253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec3d930 msgr2=0x55665ec7a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec3d930 0x55665ec7a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 -- 172.21.15.17:0/1034800253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55665eb89f50 con 0x55665ec50c50 2023-08-09T12:42:49.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6d77fe640 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c5b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0042040 tx=0x7fe6d002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de35b809b8b7c550 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.523+0000 7fe6b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:42:49.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/1034800253 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0060070 con 0x55665ec50c50 2023-08-09T12:42:49.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/1034800253 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6d0004b60 con 0x55665ec50c50 2023-08-09T12:42:49.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1034800253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55665ebb3800 con 0x55665ec50c50 2023-08-09T12:42:49.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/1034800253 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6d0004d20 con 0x55665ec50c50 2023-08-09T12:42:49.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 10 client.6312 fetch_fsmap learned FSMap version 35 2023-08-09T12:42:49.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1034800253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55665eb2aa10 con 0x55665ec50c50 2023-08-09T12:42:49.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/1034800253 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55665ebb3800 con 0x55665ec50c50 2023-08-09T12:42:49.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/1034800253 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe6d0053640 con 0x55665ec50c50 2023-08-09T12:42:49.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 10 client.6312 fetch_fsmap finished waiting for FSMap version 35 2023-08-09T12:42:49.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 10 client.6312 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T12:42:49.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 20 client.6312 populate_metadata read hostname 'smithi017' 2023-08-09T12:42:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] conn(0x55665ec3d4f0 0x55665ec4caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 4 client.6312 mds_command: new command op to 6159 tid=0[{"prefix": "status"}] 2023-08-09T12:42:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.524+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1034800253 --> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55665eb848b0 con 0x55665ec3d4f0 2023-08-09T12:42:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.525+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] conn(0x55665ec3d4f0 0x55665ec4caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.525+0000 7fe6d6ffd640 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] conn(0x55665ec3d4f0 0x55665ec4caf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e44e3971060529fc server_cookie=acc948b17264963c in_seq=0 out_seq=0 2023-08-09T12:42:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.525+0000 7fe6b5ffb640 10 client.6312 ms_handle_connect on v2:172.21.15.17:6832/1591311172 2023-08-09T12:42:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6b5ffb640 1 -- 172.21.15.17:0/1034800253 <== mds.0 v2:172.21.15.17:6832/1591311172 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55665eb848b0 con 0x55665ec3d4f0 2023-08-09T12:42:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6b5ffb640 10 client.6312 handle_command_reply: tid=0 2023-08-09T12:42:49.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 client.6312 shutdown 2023-08-09T12:42:49.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1034800253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 msgr2=0x55665ec4c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c5b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0042040 tx=0x7fe6d002e000 comp rx=0 tx=0).stop 2023-08-09T12:42:49.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1034800253 shutdown_connections 2023-08-09T12:42:49.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.17:6832/1591311172,v1:172.21.15.17:6835/1591311172] conn(0x55665ec3d4f0 0x55665ec4caf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55665ec50c50 0x55665ec4c5b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55665ec3d930 0x55665ec7a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 --2- 172.21.15.17:0/1034800253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55665ec247d0 0x55665ec4b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6b5ffb640 0 client.6312 ms_handle_reset on v2:172.21.15.17:6832/1591311172 2023-08-09T12:42:49.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1034800253 >> 172.21.15.17:0/1034800253 conn(0x55665ec20bd0 msgr2=0x55665ec56af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:49.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1034800253 shutdown_connections 2023-08-09T12:42:49.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 1 -- 172.21.15.17:0/1034800253 wait complete. 2023-08-09T12:42:49.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.526+0000 7fe6e03ef740 20 client.6312 trim_cache size 0 max 16384 2023-08-09T12:42:49.537 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:42:49.537 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:42:49.537 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:42:49.537 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 6159, 2023-08-09T12:42:49.537 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:42:49.537 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:42:49.537 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:42:49.538 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 12.301628155, 2023-08-09T12:42:49.538 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 35, 2023-08-09T12:42:49.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 70, 2023-08-09T12:42:49.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 70, 2023-08-09T12:42:49.538 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 18.075705612 2023-08-09T12:42:49.538 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:42:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6b806a050 msgr2=0x7fe6b806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6b806a050 0x7fe6b806c510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80cbbc0 tx=0x7fe6c0008040 comp rx=0 tx=0).stop 2023-08-09T12:42:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/662164108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 msgr2=0x7fe6d814ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6d814ec40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800d770 tx=0x7fe6c800dc30 comp rx=0 tx=0).stop 2023-08-09T12:42:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/662164108 shutdown_connections 2023-08-09T12:42:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe6b806a050 0x7fe6b806c510 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d81510b0 0x7fe6d81f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6d80c6e30 0x7fe6d8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 --2- 172.21.15.17:0/662164108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6c4005180 0x7fe6d814ec40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/662164108 >> 172.21.15.17:0/662164108 conn(0x7fe6d80cb1b0 msgr2=0x7fe6d8153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/662164108 shutdown_connections 2023-08-09T12:42:49.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.527+0000 7fe6dd7a4640 1 -- 172.21.15.17:0/662164108 wait complete. 2023-08-09T12:42:49.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:42:49.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.768+0000 7ffb8aba2640 1 Processor -- start 2023-08-09T12:42:49.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.768+0000 7ffb8aba2640 1 -- start start 2023-08-09T12:42:49.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.769+0000 7ffb8aba2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb84158720 0x7ffb8415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.770+0000 7ffb8aba2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8415c000 con 0x7ffb8415b530 2023-08-09T12:42:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.770+0000 7ffb8aba2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8415ba40 con 0x7ffb8406a650 2023-08-09T12:42:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.770+0000 7ffb8aba2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8406a230 con 0x7ffb84158720 2023-08-09T12:42:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.770+0000 7ffb8939f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ffb8415b530 0x7ffb8406b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49280/0 (socket says 172.21.15.17:49280) 2023-08-09T12:42:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.770+0000 7ffb8939f640 1 -- 172.21.15.17:0/2979469769 learned_addr learned my addr 172.21.15.17:0/2979469769 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:42:49.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.770+0000 7ffb89ba0640 1 --2- 172.21.15.17:0/2979469769 >> v2:172.21.15.142:3300/0 conn(0x7ffb84158720 0x7ffb8415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126223578 0 0) 0x7ffb8415c000 con 0x7ffb8415b530 2023-08-09T12:42:49.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb70003520 con 0x7ffb8415b530 2023-08-09T12:42:49.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3552593332 0 0) 0x7ffb70003520 con 0x7ffb8415b530 2023-08-09T12:42:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 >> v2:172.21.15.142:3300/0 conn(0x7ffb84158720 msgr2=0x7ffb8415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 --2- 172.21.15.17:0/2979469769 >> v2:172.21.15.142:3300/0 conn(0x7ffb84158720 0x7ffb8415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 >> v1:172.21.15.142:6789/0 conn(0x7ffb8406a650 legacy=0x7ffb84072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8415bd20 con 0x7ffb8415b530 2023-08-09T12:42:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ffb74001670 con 0x7ffb8415b530 2023-08-09T12:42:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb89ba0640 1 --2- 172.21.15.17:0/2979469769 >> v2:172.21.15.142:3300/0 conn(0x7ffb84158720 0x7ffb8415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:42:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 >> v1:172.21.15.17:6789/0 conn(0x7ffb8415b530 legacy=0x7ffb8406b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb70003970 0x7ffb70003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb700047c0 0x7ffb70004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb70005180 0x7ffb7000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8406a230 con 0x7ffb700047c0 2023-08-09T12:42:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7000c020 con 0x7ffb70005180 2023-08-09T12:42:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.771+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7000c1e0 con 0x7ffb70003970 2023-08-09T12:42:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb8939f640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb700047c0 0x7ffb70004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb89ba0640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb70003970 0x7ffb70003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb8a3a1640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb70005180 0x7ffb7000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb8939f640 1 -- 172.21.15.17:0/2979469769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb70003970 msgr2=0x7ffb70003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb8939f640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb70003970 0x7ffb70003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb8939f640 1 -- 172.21.15.17:0/2979469769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb70005180 msgr2=0x7ffb7000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb8939f640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb70005180 0x7ffb7000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb8939f640 1 -- 172.21.15.17:0/2979469769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70003520 con 0x7ffb700047c0 2023-08-09T12:42:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.772+0000 7ffb8a3a1640 1 -- 172.21.15.17:0/2979469769 reap_dead start 2023-08-09T12:42:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.773+0000 7ffb8939f640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb700047c0 0x7ffb70004c40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c210 tx=0x7ffb700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f592af500c206b28 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74005ad0 con 0x7ffb700047c0 2023-08-09T12:42:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74005c30 con 0x7ffb700047c0 2023-08-09T12:42:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb88b9e640 1 -- 172.21.15.17:0/2979469769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7402cad0 con 0x7ffb700047c0 2023-08-09T12:42:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb8aba2640 1 -- 172.21.15.17:0/2979469769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb700047c0 msgr2=0x7ffb70004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb8aba2640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb700047c0 0x7ffb70004c40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c210 tx=0x7ffb700057f0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb8aba2640 1 -- 172.21.15.17:0/2979469769 shutdown_connections 2023-08-09T12:42:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb8aba2640 1 --2- 172.21.15.17:0/2979469769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb700047c0 0x7ffb70004c40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb8aba2640 1 -- 172.21.15.17:0/2979469769 >> 172.21.15.17:0/2979469769 conn(0x7ffb840cc430 msgr2=0x7ffb840cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb8aba2640 1 -- 172.21.15.17:0/2979469769 shutdown_connections 2023-08-09T12:42:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.774+0000 7ffb8aba2640 1 -- 172.21.15.17:0/2979469769 wait complete. 2023-08-09T12:42:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.776+0000 7ffb8aba2640 1 Processor -- start 2023-08-09T12:42:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.776+0000 7ffb8aba2640 1 -- start start 2023-08-09T12:42:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.777+0000 7ffb8aba2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb700047c0 0x7ffb841538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.777+0000 7ffb8aba2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb8415bf60 0x7ffb8415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.777+0000 7ffb8aba2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb8415cb90 0x7ffb84154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.777+0000 7ffb8aba2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840b2b30 con 0x7ffb8415cb90 2023-08-09T12:42:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.777+0000 7ffb8aba2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840b3430 con 0x7ffb8415bf60 2023-08-09T12:42:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.777+0000 7ffb8aba2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840b3150 con 0x7ffb700047c0 2023-08-09T12:42:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb8415cb90 0x7ffb84154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb8415cb90 0x7ffb84154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42680/0 (socket says 172.21.15.17:42680) 2023-08-09T12:42:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 -- 172.21.15.17:0/1473004277 learned_addr learned my addr 172.21.15.17:0/1473004277 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb89ba0640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb700047c0 0x7ffb841538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8939f640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb8415bf60 0x7ffb8415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 -- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb700047c0 msgr2=0x7ffb841538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb700047c0 0x7ffb841538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 -- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb8415bf60 msgr2=0x7ffb8415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb8415bf60 0x7ffb8415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 -- 172.21.15.17:0/1473004277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb840b2570 con 0x7ffb8415cb90 2023-08-09T12:42:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.778+0000 7ffb8a3a1640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb8415cb90 0x7ffb84154c70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ffb840d0840 tx=0x7ffb7c002040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.779+0000 7ffb7a7fc640 1 -- 172.21.15.17:0/1473004277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c015070 con 0x7ffb8415cb90 2023-08-09T12:42:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.779+0000 7ffb7a7fc640 1 -- 172.21.15.17:0/1473004277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c010290 con 0x7ffb8415cb90 2023-08-09T12:42:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.779+0000 7ffb7a7fc640 1 -- 172.21.15.17:0/1473004277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c006e20 con 0x7ffb8415cb90 2023-08-09T12:42:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.779+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb840b2850 con 0x7ffb8415cb90 2023-08-09T12:42:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.779+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb840c9400 con 0x7ffb8415cb90 2023-08-09T12:42:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.780+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8404e390 con 0x7ffb8415cb90 2023-08-09T12:42:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.781+0000 7ffb7a7fc640 1 -- 172.21.15.17:0/1473004277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffb7c003970 con 0x7ffb8415cb90 2023-08-09T12:42:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.782+0000 7ffb7a7fc640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb6806a080 0x7ffb6806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.782+0000 7ffb7a7fc640 1 -- 172.21.15.17:0/1473004277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb7c08bc30 con 0x7ffb8415cb90 2023-08-09T12:42:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.783+0000 7ffb89ba0640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb6806a080 0x7ffb6806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.784+0000 7ffb89ba0640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb6806a080 0x7ffb6806c540 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009b60 tx=0x7ffb80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:49.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:49.787+0000 7ffb7a7fc640 1 -- 172.21.15.17:0/1473004277 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ffb7c05ada0 con 0x7ffb8415cb90 2023-08-09T12:42:50.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.020+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb84073850 con 0x7ffb8415cb90 2023-08-09T12:42:50.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.021+0000 7ffb7a7fc640 1 -- 172.21.15.17:0/1473004277 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb7c020060 con 0x7ffb8415cb90 2023-08-09T12:42:50.024 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:42:50.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb6806a080 msgr2=0x7ffb6806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb6806a080 0x7ffb6806c540 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009b60 tx=0x7ffb80008040 comp rx=0 tx=0).stop 2023-08-09T12:42:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb8415cb90 msgr2=0x7ffb84154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb8415cb90 0x7ffb84154c70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ffb840d0840 tx=0x7ffb7c002040 comp rx=0 tx=0).stop 2023-08-09T12:42:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 shutdown_connections 2023-08-09T12:42:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb6806a080 0x7ffb6806c540 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb8415cb90 0x7ffb84154c70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb8415bf60 0x7ffb8415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 --2- 172.21.15.17:0/1473004277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb700047c0 0x7ffb841538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 >> 172.21.15.17:0/1473004277 conn(0x7ffb840cc430 msgr2=0x7ffb84157990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 shutdown_connections 2023-08-09T12:42:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:50.024+0000 7ffb8aba2640 1 -- 172.21.15.17:0/1473004277 wait complete. 2023-08-09T12:42:50.046 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:42:50.047 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:42:50.047 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:42:50.047 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:42:50.048 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:42:50.048 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:42:50.048 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:42:50.049 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:42:50.049 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:42:50.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:50.050 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:42:50.104 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:42:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:42:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:42:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:42:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:42:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:42:50.106 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:42:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:42:50.106 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:42:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:42:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:42:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42010sec preferred_lft 42010sec 2023-08-09T12:42:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:42:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:50.107 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:42:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:42:50.108 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:42:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:42:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:42:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:50.108 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:42:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:42:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:42:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:50.109 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:42:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:42:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:42:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:50.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:50.110 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:42:50.209 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:42:50.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:50.213 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:42:50.271 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:42:50.271 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:42:50.271 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:42:50.271 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:42:50.271 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:42:50.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:50.273 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:42:50.273 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:42:50.273 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:42:50.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:42:50.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:42:50.274 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:42:50.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:50.480 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:42:50.534 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:42:50.535 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:42:50.536 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:42:50.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:50.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:42:50.638 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:42:50.639 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:42:50.701 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:42:50.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:42:50.702 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:42:50.759 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:42:50.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:50.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:42:50.909 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:42:50.910 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:42:50.910 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:42:50.932 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:42:50.932 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:42:50.932 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:42:50.933 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:42:50.933 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:42:50.959 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:42:50.959 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:42:50.959 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:42:50.959 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:42:50.959 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:42:50.959 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:42:50.960 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:42:50.960 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:42:50.962 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:42:50.962 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:42:50.962 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:42:50.963 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:42:50.963 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:42:50.966 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:42:50.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:50.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:42:51.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:51.063 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:42:51.132 INFO:teuthology.orchestra.run.smithi017.stdout:client5114 2023-08-09T12:42:51.132 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:42:51.133 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:51.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:42:51.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.410+0000 7f73d359e640 1 Processor -- start 2023-08-09T12:42:51.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.410+0000 7f73d359e640 1 -- start start 2023-08-09T12:42:51.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73d359e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73d4071450 0x7f73d40cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:51.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73d359e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f73d415cd80 0x7f73d406f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:51.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73d359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40c98f0 0x7f73d40c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:51.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73d359e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d4159710 con 0x7f73d415cd80 2023-08-09T12:42:51.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73d359e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d406fab0 con 0x7f73d4071450 2023-08-09T12:42:51.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73d359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40ca260 con 0x7f73d40c98f0 2023-08-09T12:42:51.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73cbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f73d415cd80 0x7f73d406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:51.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73cbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f73d415cd80 0x7f73d406f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42694/0 (socket says 172.21.15.17:42694) 2023-08-09T12:42:51.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.412+0000 7f73cbfff640 1 -- 172.21.15.17:0/3072271816 learned_addr learned my addr 172.21.15.17:0/3072271816 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:51.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73d2d9d640 1 --2- 172.21.15.17:0/3072271816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40c98f0 0x7f73d40c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:51.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73d259c640 1 --2- 172.21.15.17:0/3072271816 >> v2:172.21.15.142:3300/0 conn(0x7f73d4071450 0x7f73d40cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:51.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73cbfff640 1 -- 172.21.15.17:0/3072271816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40c98f0 msgr2=0x7f73d40c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:51.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73cbfff640 1 --2- 172.21.15.17:0/3072271816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40c98f0 0x7f73d40c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73cbfff640 1 -- 172.21.15.17:0/3072271816 >> v2:172.21.15.142:3300/0 conn(0x7f73d4071450 msgr2=0x7f73d40cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:51.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73cbfff640 1 --2- 172.21.15.17:0/3072271816 >> v2:172.21.15.142:3300/0 conn(0x7f73d4071450 0x7f73d40cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73cbfff640 1 -- 172.21.15.17:0/3072271816 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d415d4f0 con 0x7f73d415cd80 2023-08-09T12:42:51.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73d2d9d640 1 --2- 172.21.15.17:0/3072271816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40c98f0 0x7f73d40c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:51.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.413+0000 7f73d259c640 1 --2- 172.21.15.17:0/3072271816 >> v2:172.21.15.142:3300/0 conn(0x7f73d4071450 0x7f73d40cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:42:51.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.414+0000 7f73cbfff640 1 --2- 172.21.15.17:0/3072271816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d415cd80 0x7f73d406f570 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f73d40cc230 tx=0x7f73bc02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4155bd9c42d0ecb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:51.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d1d9b640 1 -- 172.21.15.17:0/3072271816 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0317d0 con 0x7f73d415cd80 2023-08-09T12:42:51.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d1d9b640 1 -- 172.21.15.17:0/3072271816 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc031930 con 0x7f73d415cd80 2023-08-09T12:42:51.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d1d9b640 1 -- 172.21.15.17:0/3072271816 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc031cc0 con 0x7f73d415cd80 2023-08-09T12:42:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d359e640 1 -- 172.21.15.17:0/3072271816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d415cd80 msgr2=0x7f73d406f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d359e640 1 --2- 172.21.15.17:0/3072271816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d415cd80 0x7f73d406f570 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f73d40cc230 tx=0x7f73bc02b870 comp rx=0 tx=0).stop 2023-08-09T12:42:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d359e640 1 -- 172.21.15.17:0/3072271816 shutdown_connections 2023-08-09T12:42:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d359e640 1 --2- 172.21.15.17:0/3072271816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40c98f0 0x7f73d40c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d359e640 1 --2- 172.21.15.17:0/3072271816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d415cd80 0x7f73d406f570 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d359e640 1 --2- 172.21.15.17:0/3072271816 >> v2:172.21.15.142:3300/0 conn(0x7f73d4071450 0x7f73d40cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.415+0000 7f73d359e640 1 -- 172.21.15.17:0/3072271816 >> 172.21.15.17:0/3072271816 conn(0x7f73d40b1d50 msgr2=0x7f73d406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:51.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.416+0000 7f73d359e640 1 -- 172.21.15.17:0/3072271816 shutdown_connections 2023-08-09T12:42:51.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.416+0000 7f73d359e640 1 -- 172.21.15.17:0/3072271816 wait complete. 2023-08-09T12:42:51.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.417+0000 7f73d359e640 1 Processor -- start 2023-08-09T12:42:51.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.417+0000 7f73d359e640 1 -- start start 2023-08-09T12:42:51.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.418+0000 7f73d359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d4071450 0x7f73d41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:51.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.418+0000 7f73d359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d40c98f0 0x7f73d4155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:51.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.418+0000 7f73d359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d415cd80 0x7f73d415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:51.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.418+0000 7f73d359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40c7e00 con 0x7f73d4071450 2023-08-09T12:42:51.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.418+0000 7f73d359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4155550 con 0x7f73d40c98f0 2023-08-09T12:42:51.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.418+0000 7f73d359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4156340 con 0x7f73d415cd80 2023-08-09T12:42:51.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d4071450 0x7f73d41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:51.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d4071450 0x7f73d41573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42702/0 (socket says 172.21.15.17:42702) 2023-08-09T12:42:51.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 -- 172.21.15.17:0/2432205351 learned_addr learned my addr 172.21.15.17:0/2432205351 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:51.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 -- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d415cd80 msgr2=0x7f73d415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:51.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d415cd80 0x7f73d415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 -- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d40c98f0 msgr2=0x7f73d4155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:51.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d40c98f0 0x7f73d4155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 -- 172.21.15.17:0/2432205351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc0094d0 con 0x7f73d4071450 2023-08-09T12:42:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.419+0000 7f73d259c640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d4071450 0x7f73d41573e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f73c400c7f0 tx=0x7f73c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.420+0000 7f73caffd640 1 -- 172.21.15.17:0/2432205351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c400cea0 con 0x7f73d4071450 2023-08-09T12:42:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.420+0000 7f73caffd640 1 -- 172.21.15.17:0/2432205351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c4007a30 con 0x7f73d4071450 2023-08-09T12:42:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.420+0000 7f73caffd640 1 -- 172.21.15.17:0/2432205351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4007dc0 con 0x7f73d4071450 2023-08-09T12:42:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.420+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d4156620 con 0x7f73d4071450 2023-08-09T12:42:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.420+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d4156be0 con 0x7f73d4071450 2023-08-09T12:42:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.421+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d4070e20 con 0x7f73d4071450 2023-08-09T12:42:51.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.422+0000 7f73caffd640 1 -- 172.21.15.17:0/2432205351 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f73c40113f0 con 0x7f73d4071450 2023-08-09T12:42:51.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.423+0000 7f73caffd640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f73b406a050 0x7f73b406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:51.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.423+0000 7f73caffd640 1 -- 172.21.15.17:0/2432205351 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73c40886c0 con 0x7f73d4071450 2023-08-09T12:42:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.424+0000 7f73cbfff640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f73b406a050 0x7f73b406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.425+0000 7f73cbfff640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f73b406a050 0x7f73b406c510 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f73bc036000 tx=0x7f73bc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.427+0000 7f73caffd640 1 -- 172.21.15.17:0/2432205351 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f73c4053da0 con 0x7f73d4071450 2023-08-09T12:42:51.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.658+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f73d404e390 con 0x7f73d4071450 2023-08-09T12:42:51.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.659+0000 7f73caffd640 1 -- 172.21.15.17:0/2432205351 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f73c40573c0 con 0x7f73d4071450 2023-08-09T12:42:51.662 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:42:51.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.661+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f73b406a050 msgr2=0x7f73b406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:51.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.661+0000 7f73d359e640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f73b406a050 0x7f73b406c510 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f73bc036000 tx=0x7f73bc030000 comp rx=0 tx=0).stop 2023-08-09T12:42:51.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.661+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d4071450 msgr2=0x7f73d41573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:51.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.661+0000 7f73d359e640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d4071450 0x7f73d41573e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f73c400c7f0 tx=0x7f73c400ccb0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.662+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 shutdown_connections 2023-08-09T12:42:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.662+0000 7f73d359e640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f73b406a050 0x7f73b406c510 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.662+0000 7f73d359e640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d415cd80 0x7f73d415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.662+0000 7f73d359e640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d40c98f0 0x7f73d4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.662+0000 7f73d359e640 1 --2- 172.21.15.17:0/2432205351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73d4071450 0x7f73d41573e0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.662+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 >> 172.21.15.17:0/2432205351 conn(0x7f73d40b1d50 msgr2=0x7f73d40cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.662+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 shutdown_connections 2023-08-09T12:42:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:51.662+0000 7f73d359e640 1 -- 172.21.15.17:0/2432205351 wait complete. 2023-08-09T12:42:51.683 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:42:51.683 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:42:51.684 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:42:51.684 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:42:51.684 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:42:51.685 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:42:51.685 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:42:51.685 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:42:51.685 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:42:51.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:51.686 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:42:51.748 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:42:51.748 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:42:51.748 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:42:51.748 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:51.749 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:42:51.749 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:51.749 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:42:51.749 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:51.749 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:42:51.749 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:42:51.749 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:51.750 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:42:51.750 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:42:51.750 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:51.750 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:42:51.750 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:51.750 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:42:51.750 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41996sec preferred_lft 41996sec 2023-08-09T12:42:51.750 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:42:51.751 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:51.751 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:42:51.751 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:42:51.751 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:42:51.751 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:51.751 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:42:51.751 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:51.752 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:42:51.752 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:42:51.752 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:42:51.752 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:51.752 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:42:51.752 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:42:51.752 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:42:51.752 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:42:51.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:51.754 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:42:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:42:51.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:51.850 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:42:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:42:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:42:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:42:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:42:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:42:51.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:51.904 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:42:51.905 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:42:51.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:42:51.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:42:51.907 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:42:51.908 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:42:52.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:52.092 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:42:52.142 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:42:52.142 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:42:52.143 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:42:52.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:52.144 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:42:52.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:42:52.243 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:42:52.299 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:42:52.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:42:52.300 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:42:52.350 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:42:52.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:52.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:42:52.490 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:42:52.491 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:42:52.491 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:42:52.512 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:42:52.512 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:42:52.512 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:42:52.512 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:42:52.513 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:42:52.537 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:42:52.537 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:42:52.537 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:42:52.537 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:42:52.537 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:42:52.537 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:42:52.538 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:42:52.538 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:42:52.539 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:42:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:42:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:42:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:42:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:42:52.543 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:42:52.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:52.544 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:42:52.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:42:52.621 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:42:52.678 INFO:teuthology.orchestra.run.smithi142.stdout:client5365 2023-08-09T12:42:52.679 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:42:52.679 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:42:52.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:42:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.952+0000 7f51593eb640 1 Processor -- start 2023-08-09T12:42:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.953+0000 7f51593eb640 1 -- start start 2023-08-09T12:42:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.954+0000 7f51593eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540b86e0 0x7f51540cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.954+0000 7f51593eb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51540cf980 0x7f51540d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.954+0000 7f51593eb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51540b5a30 con 0x7f5154160030 2023-08-09T12:42:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.954+0000 7f51593eb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51540d1110 con 0x7f51540cf980 2023-08-09T12:42:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.954+0000 7f51593eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51540ceac0 con 0x7f51540b86e0 2023-08-09T12:42:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.955+0000 7f5158bea640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51540cf980 0x7f51540d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:52.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.955+0000 7f5158bea640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51540cf980 0x7f51540d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42704/0 (socket says 172.21.15.17:42704) 2023-08-09T12:42:52.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.955+0000 7f5158bea640 1 -- 172.21.15.17:0/2080468815 learned_addr learned my addr 172.21.15.17:0/2080468815 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:52.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.955+0000 7f514bfff640 1 --2- 172.21.15.17:0/2080468815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540b86e0 0x7f51540cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:52.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.955+0000 7f5158bea640 1 -- 172.21.15.17:0/2080468815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540b86e0 msgr2=0x7f51540cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:52.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.955+0000 7f5158bea640 1 --2- 172.21.15.17:0/2080468815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540b86e0 0x7f51540cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:52.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.955+0000 7f5158bea640 1 -- 172.21.15.17:0/2080468815 >> v1:172.21.15.142:6789/0 conn(0x7f5154160030 legacy=0x7f5154160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:42:52.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.955+0000 7f5158bea640 1 -- 172.21.15.17:0/2080468815 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540d0d70 con 0x7f51540cf980 2023-08-09T12:42:52.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.956+0000 7f5158bea640 1 --2- 172.21.15.17:0/2080468815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540cf980 0x7f51540d1530 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f514c009e50 tx=0x7f514c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0486c87647c2c37 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:52.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.957+0000 7f51537fe640 1 -- 172.21.15.17:0/2080468815 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c02ca70 con 0x7f51540cf980 2023-08-09T12:42:52.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.957+0000 7f51537fe640 1 -- 172.21.15.17:0/2080468815 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c02cbd0 con 0x7f51540cf980 2023-08-09T12:42:52.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.957+0000 7f51537fe640 1 -- 172.21.15.17:0/2080468815 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c0343f0 con 0x7f51540cf980 2023-08-09T12:42:52.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.957+0000 7f51593eb640 1 -- 172.21.15.17:0/2080468815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540cf980 msgr2=0x7f51540d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:52.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.957+0000 7f51593eb640 1 --2- 172.21.15.17:0/2080468815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540cf980 0x7f51540d1530 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f514c009e50 tx=0x7f514c02bed0 comp rx=0 tx=0).stop 2023-08-09T12:42:52.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.957+0000 7f51593eb640 1 -- 172.21.15.17:0/2080468815 shutdown_connections 2023-08-09T12:42:52.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.957+0000 7f51593eb640 1 --2- 172.21.15.17:0/2080468815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540cf980 0x7f51540d1530 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:52.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.958+0000 7f51593eb640 1 --2- 172.21.15.17:0/2080468815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540b86e0 0x7f51540cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:52.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.958+0000 7f51593eb640 1 -- 172.21.15.17:0/2080468815 >> 172.21.15.17:0/2080468815 conn(0x7f51540697c0 msgr2=0x7f5154069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:52.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.958+0000 7f51593eb640 1 -- 172.21.15.17:0/2080468815 shutdown_connections 2023-08-09T12:42:52.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.958+0000 7f51593eb640 1 -- 172.21.15.17:0/2080468815 wait complete. 2023-08-09T12:42:52.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.960+0000 7f51593eb640 1 Processor -- start 2023-08-09T12:42:52.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.960+0000 7f51593eb640 1 -- start start 2023-08-09T12:42:52.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.961+0000 7f51593eb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51540b86e0 0x7f5154154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:52.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.961+0000 7f51593eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540cf980 0x7f51540cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:52.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.961+0000 7f51593eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154160030 0x7f51541455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:52.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.961+0000 7f51593eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51540c9b40 con 0x7f5154160030 2023-08-09T12:42:52.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.961+0000 7f51593eb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5154155040 con 0x7f51540b86e0 2023-08-09T12:42:52.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.961+0000 7f51593eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51540c9d90 con 0x7f51540cf980 2023-08-09T12:42:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5158bea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154160030 0x7f51541455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:52.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5158bea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154160030 0x7f51541455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42720/0 (socket says 172.21.15.17:42720) 2023-08-09T12:42:52.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5158bea640 1 -- 172.21.15.17:0/3739117027 learned_addr learned my addr 172.21.15.17:0/3739117027 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:42:52.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5153fff640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51540b86e0 0x7f5154154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:52.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f514bfff640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540cf980 0x7f51540cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:52.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5158bea640 1 -- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540cf980 msgr2=0x7f51540cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:52.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5158bea640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540cf980 0x7f51540cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:52.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5158bea640 1 -- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51540b86e0 msgr2=0x7f5154154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:52.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5158bea640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51540b86e0 0x7f5154154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:52.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f5158bea640 1 -- 172.21.15.17:0/3739117027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c009b30 con 0x7f5154160030 2023-08-09T12:42:52.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.962+0000 7f514bfff640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540cf980 0x7f51540cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:42:52.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.963+0000 7f5158bea640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154160030 0x7f51541455c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f514c009e50 tx=0x7f514c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:52.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.963+0000 7f51517fa640 1 -- 172.21.15.17:0/3739117027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c009510 con 0x7f5154160030 2023-08-09T12:42:52.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.963+0000 7f51517fa640 1 -- 172.21.15.17:0/3739117027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c03e450 con 0x7f5154160030 2023-08-09T12:42:52.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.963+0000 7f51517fa640 1 -- 172.21.15.17:0/3739117027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c03e7e0 con 0x7f5154160030 2023-08-09T12:42:52.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.963+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51540ca070 con 0x7f5154160030 2023-08-09T12:42:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.963+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51540ca630 con 0x7f5154160030 2023-08-09T12:42:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.965+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515404e390 con 0x7f5154160030 2023-08-09T12:42:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.966+0000 7f51517fa640 1 -- 172.21.15.17:0/3739117027 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f514c03e940 con 0x7f5154160030 2023-08-09T12:42:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.966+0000 7f51517fa640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f513406a050 0x7f513406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:42:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.967+0000 7f51517fa640 1 -- 172.21.15.17:0/3739117027 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f514c0ab310 con 0x7f5154160030 2023-08-09T12:42:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.967+0000 7f5153fff640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f513406a050 0x7f513406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:42:52.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.969+0000 7f5153fff640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f513406a050 0x7f513406c510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5144006fd0 tx=0x7f5144009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:42:52.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:52.971+0000 7f51517fa640 1 -- 172.21.15.17:0/3739117027 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f514c076970 con 0x7f5154160030 2023-08-09T12:42:53.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.203+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51540d0640 con 0x7f5154160030 2023-08-09T12:42:53.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.205+0000 7f51517fa640 1 -- 172.21.15.17:0/3739117027 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f514c079f90 con 0x7f5154160030 2023-08-09T12:42:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:42:53.208 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2314028117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2314028117},{"type":"v1","addr":"172.21.15.142:6837","nonce":2314028117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3413359063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3413359063},{"type":"v1","addr":"172.21.15.142:6835","nonce":3413359063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/295901720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":295901720},{"type":"v1","addr":"172.21.15.17:6834","nonce":295901720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:42:36.710411+0000","modified":"2023-08-09T12:42:40.710471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1591311172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1591311172},{"type":"v1","addr":"172.21.15.17:6835","nonce":1591311172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-09T12:42:53.208 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2023-08-09T12:42:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.207+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f513406a050 msgr2=0x7f513406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.207+0000 7f51593eb640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f513406a050 0x7f513406c510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5144006fd0 tx=0x7f5144009060 comp rx=0 tx=0).stop 2023-08-09T12:42:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.207+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154160030 msgr2=0x7f51541455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:42:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.207+0000 7f51593eb640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154160030 0x7f51541455c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f514c009e50 tx=0x7f514c004a40 comp rx=0 tx=0).stop 2023-08-09T12:42:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.208+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 shutdown_connections 2023-08-09T12:42:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.208+0000 7f51593eb640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f513406a050 0x7f513406c510 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.208+0000 7f51593eb640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154160030 0x7f51541455c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.208+0000 7f51593eb640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51540cf980 0x7f51540cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.208+0000 7f51593eb640 1 --2- 172.21.15.17:0/3739117027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51540b86e0 0x7f5154154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:42:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.208+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 >> 172.21.15.17:0/3739117027 conn(0x7f51540697c0 msgr2=0x7f51540d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:42:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.208+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 shutdown_connections 2023-08-09T12:42:53.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:42:53.208+0000 7f51593eb640 1 -- 172.21.15.17:0/3739117027 wait complete. 2023-08-09T12:42:53.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-09T12:42:53.479 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":6159,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.236807840000001,"mdsmap_epoch":35,"osdmap_epoch":70,"osdmap_epoch_barrier":70,"uptime":22.010906203000001} 2023-08-09T12:42:53.480 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 6159, "mdsmap_epoch": 35, "osdmap_epoch": 70, "osdmap_epoch_barrier": 70, "rank_uptime": 16.23680784, "state": "up:active", "uptime": 22.010906203, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:42:53.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-09T12:42:53.726 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_mon_report_interval":"5"} 2023-08-09T12:42:53.727 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-09T12:42:53.727 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-08-09T12:42:53.963 INFO:teuthology.orchestra.run.smithi017.stdout:{"mon_tick_interval":"5"} 2023-08-09T12:42:53.964 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-08-09T12:42:53.964 INFO:tasks.cephfs.test_full:pool capacity 556934720, 531MB should be enough to fill it 2023-08-09T12:42:53.965 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:42:53.965 DEBUG:teuthology.orchestra.run.smithi017:> import time 2023-08-09T12:42:53.965 DEBUG:teuthology.orchestra.run.smithi017:> import datetime 2023-08-09T12:42:53.966 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2023-08-09T12:42:53.966 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:42:53.966 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.966 DEBUG:teuthology.orchestra.run.smithi017:> # Write some buffered data through before going full, all should be well 2023-08-09T12:42:53.967 DEBUG:teuthology.orchestra.run.smithi017:> print("writing some data through which we expect to succeed") 2023-08-09T12:42:53.967 DEBUG:teuthology.orchestra.run.smithi017:> bytes = 0 2023-08-09T12:42:53.967 DEBUG:teuthology.orchestra.run.smithi017:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-08-09T12:42:53.968 DEBUG:teuthology.orchestra.run.smithi017:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-08-09T12:42:53.968 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-08-09T12:42:53.968 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f) 2023-08-09T12:42:53.968 DEBUG:teuthology.orchestra.run.smithi017:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-08-09T12:42:53.969 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.969 DEBUG:teuthology.orchestra.run.smithi017:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-08-09T12:42:53.969 DEBUG:teuthology.orchestra.run.smithi017:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-08-09T12:42:53.970 DEBUG:teuthology.orchestra.run.smithi017:> # buffered IO, the error should always only appear from fsync and not 2023-08-09T12:42:53.970 DEBUG:teuthology.orchestra.run.smithi017:> # from write 2023-08-09T12:42:53.970 DEBUG:teuthology.orchestra.run.smithi017:> full = False 2023-08-09T12:42:53.970 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.971 DEBUG:teuthology.orchestra.run.smithi017:> for n in range(0, int(531 * 0.9)): 2023-08-09T12:42:53.971 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-09T12:42:53.971 DEBUG:teuthology.orchestra.run.smithi017:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-08-09T12:42:53.971 DEBUG:teuthology.orchestra.run.smithi017:> print("done writing {0} bytes".format(bytes)) 2023-08-09T12:42:53.972 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.972 DEBUG:teuthology.orchestra.run.smithi017:> # OK, now we should sneak in under the full condition 2023-08-09T12:42:53.972 DEBUG:teuthology.orchestra.run.smithi017:> # due to the time it takes the OSDs to report to the 2023-08-09T12:42:53.973 DEBUG:teuthology.orchestra.run.smithi017:> # mons, and get a successful fsync on our full-making data 2023-08-09T12:42:53.973 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f) 2023-08-09T12:42:53.973 DEBUG:teuthology.orchestra.run.smithi017:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-08-09T12:42:53.973 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.974 DEBUG:teuthology.orchestra.run.smithi017:> # buffered write, add more dirty data to the buffer 2023-08-09T12:42:53.974 DEBUG:teuthology.orchestra.run.smithi017:> print("starting buffered write") 2023-08-09T12:42:53.974 DEBUG:teuthology.orchestra.run.smithi017:> try: 2023-08-09T12:42:53.975 DEBUG:teuthology.orchestra.run.smithi017:> for n in range(0, int(531 * 0.2)): 2023-08-09T12:42:53.975 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-09T12:42:53.975 DEBUG:teuthology.orchestra.run.smithi017:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-08-09T12:42:53.975 DEBUG:teuthology.orchestra.run.smithi017:> time.sleep(15.0) 2023-08-09T12:42:53.976 DEBUG:teuthology.orchestra.run.smithi017:> except OSError: 2023-08-09T12:42:53.976 DEBUG:teuthology.orchestra.run.smithi017:> pass; 2023-08-09T12:42:53.976 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.976 DEBUG:teuthology.orchestra.run.smithi017:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-08-09T12:42:53.977 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.977 DEBUG:teuthology.orchestra.run.smithi017:> # Wait long enough for a background flush that should fail 2023-08-09T12:42:53.977 DEBUG:teuthology.orchestra.run.smithi017:> time.sleep(30) 2023-08-09T12:42:53.978 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.978 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2023-08-09T12:42:53.978 DEBUG:teuthology.orchestra.run.smithi017:> # ...and check that the failed background flush is reflected in fclose 2023-08-09T12:42:53.978 DEBUG:teuthology.orchestra.run.smithi017:> try: 2023-08-09T12:42:53.979 DEBUG:teuthology.orchestra.run.smithi017:> os.close(f) 2023-08-09T12:42:53.979 DEBUG:teuthology.orchestra.run.smithi017:> except OSError: 2023-08-09T12:42:53.979 DEBUG:teuthology.orchestra.run.smithi017:> print("close() returned an error as expected") 2023-08-09T12:42:53.979 DEBUG:teuthology.orchestra.run.smithi017:> else: 2023-08-09T12:42:53.980 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("close() failed to raise error") 2023-08-09T12:42:53.980 DEBUG:teuthology.orchestra.run.smithi017:> else: 2023-08-09T12:42:53.980 DEBUG:teuthology.orchestra.run.smithi017:> # The kernel cephfs client does not raise errors on fclose 2023-08-09T12:42:53.981 DEBUG:teuthology.orchestra.run.smithi017:> os.close(f) 2023-08-09T12:42:53.981 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:42:53.981 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-08-09T12:42:53.981 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:42:56.712 INFO:teuthology.orchestra.run.smithi017.stdout:writing some data through which we expect to succeed 2023-08-09T12:42:56.713 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-08-09T12:42:56.713 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-08-09T12:42:56.713 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-08-09T12:42:56.713 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-08-09T12:42:56.713 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-08-09T12:42:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-08-09T12:42:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-08-09T12:42:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-08-09T12:42:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-08-09T12:42:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-08-09T12:42:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-08-09T12:42:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-08-09T12:42:56.714 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-08-09T12:42:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-08-09T12:42:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-08-09T12:42:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-08-09T12:42:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-08-09T12:42:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-08-09T12:42:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-08-09T12:42:56.715 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-08-09T12:42:56.716 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-08-09T12:42:56.716 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-08-09T12:42:56.716 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-08-09T12:42:56.716 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-08-09T12:42:56.716 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-08-09T12:42:56.716 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-08-09T12:42:56.716 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-08-09T12:42:56.716 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-08-09T12:42:56.717 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-08-09T12:42:56.717 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-08-09T12:42:56.717 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-08-09T12:42:56.717 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-08-09T12:42:56.717 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-08-09T12:42:56.717 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-08-09T12:42:56.717 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-08-09T12:42:56.717 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-08-09T12:42:56.718 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-08-09T12:42:56.718 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-08-09T12:42:56.718 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-08-09T12:42:56.718 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-08-09T12:42:56.718 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-08-09T12:42:56.718 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-08-09T12:42:56.718 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-08-09T12:42:56.718 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-08-09T12:42:56.719 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-08-09T12:42:56.719 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-08-09T12:42:56.719 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-08-09T12:42:56.719 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-08-09T12:42:56.719 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-08-09T12:42:56.719 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-08-09T12:42:56.719 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-08-09T12:42:56.719 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-08-09T12:42:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-08-09T12:42:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-08-09T12:42:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-08-09T12:42:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-08-09T12:42:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-08-09T12:42:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-08-09T12:42:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-08-09T12:42:56.721 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-08-09T12:42:56.721 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-08-09T12:42:56.721 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-08-09T12:42:56.721 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-08-09T12:42:56.721 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-08-09T12:42:56.721 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-08-09T12:42:56.721 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-08-09T12:42:56.721 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-08-09T12:42:56.722 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-08-09T12:42:56.722 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-08-09T12:42:56.722 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-08-09T12:42:56.722 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-08-09T12:42:56.722 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-08-09T12:42:56.722 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-08-09T12:42:56.722 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-08-09T12:42:56.722 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-08-09T12:42:56.723 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-08-09T12:42:56.723 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-08-09T12:42:56.723 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-08-09T12:42:56.723 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-08-09T12:42:56.723 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-08-09T12:42:56.723 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-08-09T12:42:56.723 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-08-09T12:42:56.723 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-08-09T12:42:56.724 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-08-09T12:42:56.724 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-08-09T12:42:56.724 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-08-09T12:42:56.724 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-08-09T12:42:56.724 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-08-09T12:42:56.724 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-08-09T12:42:56.724 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-08-09T12:42:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-08-09T12:42:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-08-09T12:42:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-08-09T12:42:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-08-09T12:42:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-08-09T12:42:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-08-09T12:42:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-08-09T12:42:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-08-09T12:42:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-08-09T12:42:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-08-09T12:42:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-08-09T12:42:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-08-09T12:42:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-08-09T12:42:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-08-09T12:42:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-08-09T12:42:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-08-09T12:42:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-08-09T12:42:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-08-09T12:42:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-08-09T12:42:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-08-09T12:42:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-08-09T12:42:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-08-09T12:42:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-08-09T12:42:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-08-09T12:42:56.728 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-08-09T12:42:56.728 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-08-09T12:42:56.728 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-08-09T12:42:56.728 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-08-09T12:42:56.728 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-08-09T12:42:56.728 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-08-09T12:42:56.728 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-08-09T12:42:56.729 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-08-09T12:42:56.729 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-08-09T12:42:56.729 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-08-09T12:42:56.729 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-08-09T12:42:56.729 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-08-09T12:42:56.729 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-08-09T12:42:56.729 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-08-09T12:42:56.729 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-08-09T12:42:56.730 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-08-09T12:42:56.730 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-08-09T12:42:56.730 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-08-09T12:42:56.730 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-08-09T12:42:56.730 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-08-09T12:42:56.730 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-08-09T12:42:56.730 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-08-09T12:42:56.730 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-08-09T12:42:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-08-09T12:42:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-08-09T12:42:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-08-09T12:42:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-08-09T12:42:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-08-09T12:42:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-08-09T12:42:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-08-09T12:42:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-08-09T12:42:56.732 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-08-09T12:42:56.732 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-08-09T12:42:56.732 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-08-09T12:42:56.732 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-08-09T12:42:56.732 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-08-09T12:42:56.732 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-08-09T12:42:56.732 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-08-09T12:42:56.732 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-08-09T12:42:56.733 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-08-09T12:42:56.733 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-08-09T12:42:56.905 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-08-09T12:42:56.905 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-08-09T12:42:56.905 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-08-09T12:42:56.905 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-08-09T12:42:56.905 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-08-09T12:42:56.905 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-08-09T12:42:56.906 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-08-09T12:42:56.906 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-08-09T12:42:56.906 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-08-09T12:42:56.906 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-08-09T12:42:56.906 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-08-09T12:42:56.906 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-08-09T12:42:56.906 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-08-09T12:42:56.906 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-08-09T12:42:56.907 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-08-09T12:42:56.907 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-08-09T12:42:56.907 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-08-09T12:42:56.907 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-08-09T12:42:56.907 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-08-09T12:42:56.907 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-08-09T12:42:56.907 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-08-09T12:42:56.908 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-08-09T12:42:56.908 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-08-09T12:42:56.908 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-08-09T12:42:56.908 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-08-09T12:42:56.908 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-08-09T12:42:56.908 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-08-09T12:42:56.908 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-08-09T12:42:56.908 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-08-09T12:42:56.909 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-08-09T12:42:56.909 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-08-09T12:42:56.909 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-08-09T12:42:56.909 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-08-09T12:42:56.909 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-08-09T12:42:56.909 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-08-09T12:42:56.909 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-08-09T12:42:56.909 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-08-09T12:42:56.910 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-08-09T12:42:56.910 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-08-09T12:42:56.910 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-08-09T12:42:56.910 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-08-09T12:42:56.910 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-08-09T12:42:56.910 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-08-09T12:42:56.910 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-08-09T12:42:56.910 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-08-09T12:42:56.911 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-08-09T12:42:56.911 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-08-09T12:42:56.911 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-08-09T12:42:56.911 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-08-09T12:42:56.911 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-08-09T12:42:56.911 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-08-09T12:42:56.911 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-08-09T12:42:56.912 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-08-09T12:42:56.912 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-08-09T12:42:56.912 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-08-09T12:42:56.912 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-08-09T12:42:56.912 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-08-09T12:42:56.912 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-08-09T12:42:56.912 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-08-09T12:42:56.912 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-08-09T12:42:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-08-09T12:42:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-08-09T12:42:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-08-09T12:42:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-08-09T12:42:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-08-09T12:42:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-08-09T12:42:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-08-09T12:42:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-08-09T12:42:56.914 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-08-09T12:42:56.914 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-08-09T12:42:56.914 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-08-09T12:42:56.914 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-08-09T12:42:56.914 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-08-09T12:42:56.914 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-08-09T12:42:56.914 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-08-09T12:42:56.914 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-08-09T12:42:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-08-09T12:42:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-08-09T12:42:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-08-09T12:42:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-08-09T12:42:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-08-09T12:42:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-08-09T12:42:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-08-09T12:42:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-08-09T12:42:56.916 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-08-09T12:42:56.916 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-08-09T12:42:56.916 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-08-09T12:42:56.916 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-08-09T12:42:56.916 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-08-09T12:42:56.916 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-08-09T12:42:56.916 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-08-09T12:42:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-08-09T12:42:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-08-09T12:42:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-08-09T12:42:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-08-09T12:42:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-08-09T12:42:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-08-09T12:42:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-08-09T12:42:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-08-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-08-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-08-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-08-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-08-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-08-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-08-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-08-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-08-09T12:42:56.919 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-08-09T12:42:56.919 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-08-09T12:42:56.919 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-08-09T12:42:56.919 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-08-09T12:42:56.919 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-08-09T12:42:56.919 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-08-09T12:42:56.919 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-08-09T12:42:56.919 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-08-09T12:42:56.920 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-08-09T12:42:56.920 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-08-09T12:42:56.920 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-08-09T12:42:56.920 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-08-09T12:42:56.920 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-08-09T12:42:56.920 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-08-09T12:42:56.920 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-08-09T12:42:56.920 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-08-09T12:42:56.921 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-08-09T12:42:56.921 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-08-09T12:42:56.921 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-08-09T12:42:56.921 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-08-09T12:42:56.921 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-08-09T12:42:56.921 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-08-09T12:42:56.921 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-08-09T12:42:56.921 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-08-09T12:42:56.922 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-08-09T12:42:56.922 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-08-09T12:42:56.922 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-08-09T12:42:56.922 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-08-09T12:42:56.922 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-08-09T12:42:56.922 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-08-09T12:42:56.922 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-08-09T12:42:56.922 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-08-09T12:42:56.923 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-08-09T12:42:56.923 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-08-09T12:42:56.923 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-08-09T12:42:56.923 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-08-09T12:42:56.923 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-08-09T12:42:56.923 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-08-09T12:42:56.923 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-08-09T12:42:56.923 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-08-09T12:42:56.924 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-08-09T12:42:56.924 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-08-09T12:42:56.924 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-08-09T12:42:56.924 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-08-09T12:42:56.924 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-08-09T12:42:56.924 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-08-09T12:42:56.924 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-08-09T12:42:57.096 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-08-09T12:42:57.097 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-08-09T12:42:57.097 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-08-09T12:42:57.097 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-08-09T12:42:57.097 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-08-09T12:42:57.097 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-08-09T12:42:57.097 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-08-09T12:42:57.097 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-08-09T12:42:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-08-09T12:42:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-08-09T12:42:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-08-09T12:42:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-08-09T12:42:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-08-09T12:42:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-08-09T12:42:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-08-09T12:42:57.098 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-08-09T12:42:57.099 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-08-09T12:42:57.099 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-08-09T12:42:57.099 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-08-09T12:42:57.099 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-08-09T12:42:57.099 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-08-09T12:42:57.099 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-08-09T12:42:57.099 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-08-09T12:42:57.099 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-08-09T12:42:57.100 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-08-09T12:42:57.100 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-08-09T12:42:57.100 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-08-09T12:42:57.100 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-08-09T12:42:57.100 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-08-09T12:42:57.100 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-08-09T12:42:57.100 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-08-09T12:42:57.100 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-08-09T12:42:57.101 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-08-09T12:42:57.101 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-08-09T12:42:57.101 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-08-09T12:42:57.101 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-08-09T12:42:57.101 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-08-09T12:42:57.101 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-08-09T12:42:57.101 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-08-09T12:42:57.102 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-08-09T12:42:57.102 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-08-09T12:42:57.102 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-08-09T12:42:57.102 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-08-09T12:42:57.102 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-08-09T12:42:57.102 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-08-09T12:42:57.102 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-08-09T12:42:57.102 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-08-09T12:42:57.103 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-08-09T12:42:57.103 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-08-09T12:42:57.103 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-08-09T12:42:57.103 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-08-09T12:42:57.103 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-08-09T12:42:57.103 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-08-09T12:42:57.103 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-08-09T12:42:57.103 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-08-09T12:42:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-08-09T12:42:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-08-09T12:42:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-08-09T12:42:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-08-09T12:42:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-08-09T12:42:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-08-09T12:42:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-08-09T12:42:57.104 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-08-09T12:42:57.105 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-08-09T12:42:57.105 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-08-09T12:42:57.105 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-08-09T12:42:57.105 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-08-09T12:42:57.105 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-08-09T12:42:57.105 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-08-09T12:42:57.105 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-08-09T12:42:57.105 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-08-09T12:42:57.106 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-08-09T12:42:57.106 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-08-09T12:42:57.106 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-08-09T12:42:57.106 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-08-09T12:42:57.106 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-08-09T12:42:57.106 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-08-09T12:42:57.106 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-08-09T12:42:57.106 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-08-09T12:42:57.107 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-08-09T12:42:57.107 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-08-09T12:42:57.107 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-08-09T12:42:57.107 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-08-09T12:42:57.107 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-08-09T12:42:57.107 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-08-09T12:42:57.107 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-08-09T12:42:57.108 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-08-09T12:42:57.108 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-08-09T12:42:57.108 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-08-09T12:42:57.108 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-08-09T12:42:57.108 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-08-09T12:42:57.108 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-08-09T12:42:57.108 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-08-09T12:42:57.108 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-08-09T12:42:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-08-09T12:42:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-08-09T12:42:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-08-09T12:42:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-08-09T12:42:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-08-09T12:42:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-08-09T12:42:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-08-09T12:42:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-08-09T12:42:57.110 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-08-09T12:42:57.110 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-08-09T12:42:57.110 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-08-09T12:42:57.110 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-08-09T12:42:57.110 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-08-09T12:42:57.110 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-08-09T12:42:57.110 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-08-09T12:42:57.110 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-08-09T12:42:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-08-09T12:42:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-08-09T12:42:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-08-09T12:42:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-08-09T12:42:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-08-09T12:42:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-08-09T12:42:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-08-09T12:42:57.111 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-08-09T12:42:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-08-09T12:42:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-08-09T12:42:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-08-09T12:42:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-08-09T12:42:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-08-09T12:42:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-08-09T12:42:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-08-09T12:42:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-08-09T12:42:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-08-09T12:42:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-08-09T12:42:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-08-09T12:42:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-08-09T12:42:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-08-09T12:42:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-08-09T12:42:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-08-09T12:42:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-08-09T12:42:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-08-09T12:42:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-08-09T12:42:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-08-09T12:42:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-08-09T12:42:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-08-09T12:42:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-08-09T12:42:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-08-09T12:42:57.114 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-08-09T12:42:57.115 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-08-09T12:42:57.115 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-08-09T12:42:57.115 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-08-09T12:42:57.115 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-08-09T12:42:57.115 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-08-09T12:42:57.115 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-08-09T12:42:57.115 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-08-09T12:42:57.116 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-08-09T12:42:57.116 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-08-09T12:42:57.116 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-08-09T12:42:57.116 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-08-09T12:42:57.116 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-08-09T12:42:59.718 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:42:59.714+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-08-09T12:43:04.803 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:43:04.800+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-08-09T12:43:09.972 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:43:09.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:43:19.724 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:43:19.721+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL) 2023-08-09T12:43:40.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:43:40.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:43:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-08-09T12:43:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-08-09T12:43:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-08-09T12:43:58.360 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-08-09T12:43:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-08-09T12:43:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-08-09T12:43:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-08-09T12:43:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-08-09T12:43:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-08-09T12:43:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-08-09T12:43:58.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-08-09T12:43:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-08-09T12:43:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-08-09T12:43:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-08-09T12:43:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-08-09T12:43:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:done writing 500695040 bytes 2023-08-09T12:43:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:successfully fsync'ed prior to getting full state reported 2023-08-09T12:43:58.362 INFO:teuthology.orchestra.run.smithi017.stdout:starting buffered write 2023-08-09T12:43:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:43:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:43:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-08-09T12:43:58.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:43:58.384 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:43:58.385 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:43:58.510 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:43:58.636 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:43:58.637 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:43:58.637 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:43:58.701 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:43:58.702 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:43:58.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:43:58.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.986+0000 7f4ad6f5b640 1 Processor -- start 2023-08-09T12:43:58.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.986+0000 7f4ad6f5b640 1 -- start start 2023-08-09T12:43:58.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.988+0000 7f4ad6f5b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ad00b3b40 0x7f4ad00b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:58.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.988+0000 7f4ad6f5b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad006c990 con 0x7f4ad00adc40 2023-08-09T12:43:58.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.988+0000 7f4ad6f5b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00b2250 con 0x7f4ad00cc630 2023-08-09T12:43:58.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.988+0000 7f4ad6f5b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00ae020 con 0x7f4ad00b3b40 2023-08-09T12:43:58.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.988+0000 7f4acffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ad00b3b40 0x7f4ad00b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:58.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.988+0000 7f4ad4cf7640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4ad00adc40 0x7f4ad006c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53606/0 (socket says 172.21.15.17:53606) 2023-08-09T12:43:58.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.988+0000 7f4ad4cf7640 1 -- 172.21.15.17:0/3926894984 learned_addr learned my addr 172.21.15.17:0/3926894984 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:43:58.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.989+0000 7f4acffff640 1 -- 172.21.15.17:0/3926894984 >> v1:172.21.15.142:6789/0 conn(0x7f4ad00cc630 legacy=0x7f4ad00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:43:58.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.989+0000 7f4acffff640 1 -- 172.21.15.17:0/3926894984 >> v1:172.21.15.17:6789/0 conn(0x7f4ad00adc40 legacy=0x7f4ad006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:58.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.989+0000 7f4acf7fe640 1 -- 172.21.15.17:0/3926894984 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594054868 0 0) 0x7f4ad006c990 con 0x7f4ad00adc40 2023-08-09T12:43:58.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.989+0000 7f4acffff640 1 -- 172.21.15.17:0/3926894984 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00b2530 con 0x7f4ad00b3b40 2023-08-09T12:43:58.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.990+0000 7f4acffff640 1 --2- 172.21.15.17:0/3926894984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00b3b40 0x7f4ad00b3fd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009790 tx=0x7f4abc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb58e8e006e1b44b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:58.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.991+0000 7f4acf7fe640 1 -- 172.21.15.17:0/3926894984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc031830 con 0x7f4ad00b3b40 2023-08-09T12:43:58.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.991+0000 7f4acf7fe640 1 -- 172.21.15.17:0/3926894984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc031990 con 0x7f4ad00b3b40 2023-08-09T12:43:58.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.991+0000 7f4acf7fe640 1 -- 172.21.15.17:0/3926894984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc031d20 con 0x7f4ad00b3b40 2023-08-09T12:43:58.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.991+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/3926894984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00b3b40 msgr2=0x7f4ad00b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:58.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.991+0000 7f4ad6f5b640 1 --2- 172.21.15.17:0/3926894984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00b3b40 0x7f4ad00b3fd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009790 tx=0x7f4abc02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:43:58.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.992+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/3926894984 shutdown_connections 2023-08-09T12:43:58.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.992+0000 7f4ad6f5b640 1 --2- 172.21.15.17:0/3926894984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00b3b40 0x7f4ad00b3fd0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:58.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.992+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/3926894984 >> 172.21.15.17:0/3926894984 conn(0x7f4ad00cb1b0 msgr2=0x7f4ad00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:43:58.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.992+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/3926894984 shutdown_connections 2023-08-09T12:43:58.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.992+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/3926894984 wait complete. 2023-08-09T12:43:58.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.993+0000 7f4ad6f5b640 1 Processor -- start 2023-08-09T12:43:58.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.994+0000 7f4ad6f5b640 1 -- start start 2023-08-09T12:43:58.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad6f5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00adc40 0x7f4ad00c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:58.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad6f5b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ad00b3b40 0x7f4ad00c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:58.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad6f5b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad00cc630 0x7f4ad00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:58.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad6f5b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00c33c0 con 0x7f4ad00adc40 2023-08-09T12:43:58.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad6f5b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00c6560 con 0x7f4ad00cc630 2023-08-09T12:43:58.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad6f5b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00c5cc0 con 0x7f4ad00b3b40 2023-08-09T12:43:58.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad4cf7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00adc40 0x7f4ad00c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:58.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad4cf7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00adc40 0x7f4ad00c38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59376/0 (socket says 172.21.15.17:59376) 2023-08-09T12:43:58.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad4cf7640 1 -- 172.21.15.17:0/2362595379 learned_addr learned my addr 172.21.15.17:0/2362595379 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:43:59.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad4cf7640 1 -- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ad00b3b40 msgr2=0x7f4ad00c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad4cf7640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ad00b3b40 0x7f4ad00c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad4cf7640 1 -- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad00cc630 msgr2=0x7f4ad00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad4cf7640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad00cc630 0x7f4ad00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.995+0000 7f4ad4cf7640 1 -- 172.21.15.17:0/2362595379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc0093a0 con 0x7f4ad00adc40 2023-08-09T12:43:59.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.996+0000 7f4ad4cf7640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00adc40 0x7f4ad00c38a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400c4d0 tx=0x7f4ac400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:59.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.996+0000 7f4acd7fa640 1 -- 172.21.15.17:0/2362595379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40074e0 con 0x7f4ad00adc40 2023-08-09T12:43:59.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.996+0000 7f4acd7fa640 1 -- 172.21.15.17:0/2362595379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac4007640 con 0x7f4ad00adc40 2023-08-09T12:43:59.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.996+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad00c5fa0 con 0x7f4ad00adc40 2023-08-09T12:43:59.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.996+0000 7f4acd7fa640 1 -- 172.21.15.17:0/2362595379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4004a20 con 0x7f4ad00adc40 2023-08-09T12:43:59.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.996+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad0153860 con 0x7f4ad00adc40 2023-08-09T12:43:59.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.997+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad00c3220 con 0x7f4ad00adc40 2023-08-09T12:43:59.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.998+0000 7f4acd7fa640 1 -- 172.21.15.17:0/2362595379 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ac4004b80 con 0x7f4ad00adc40 2023-08-09T12:43:59.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.999+0000 7f4acd7fa640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ab406a050 0x7f4ab406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:58.999+0000 7f4acd7fa640 1 -- 172.21.15.17:0/2362595379 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4ac4087b90 con 0x7f4ad00adc40 2023-08-09T12:43:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.000+0000 7f4acd7fa640 1 -- 172.21.15.17:0/2362595379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f4ab4072380 con 0x7f4ad00adc40 2023-08-09T12:43:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.000+0000 7f4acffff640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ab406a050 0x7f4ab406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.001+0000 7f4acffff640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ab406a050 0x7f4ab406c510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4abc036000 tx=0x7f4abc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.004+0000 7f4acd7fa640 1 -- 172.21.15.17:0/2362595379 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4ac4018060 con 0x7f4ad00adc40 2023-08-09T12:43:59.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.196+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad0067a80 con 0x7f4ad00adc40 2023-08-09T12:43:59.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.197+0000 7f4acd7fa640 1 -- 172.21.15.17:0/2362595379 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18580 (secure 0 0 0) 0x7f4ad00c3220 con 0x7f4ad00adc40 2023-08-09T12:43:59.201 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:43:59.201 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:43:12.748465+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:42:35.097822+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-09T12:42:35.735356+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.17","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:43:59.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.200+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ab406a050 msgr2=0x7f4ab406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.200+0000 7f4ad6f5b640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ab406a050 0x7f4ab406c510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4abc036000 tx=0x7f4abc030000 comp rx=0 tx=0).stop 2023-08-09T12:43:59.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.200+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00adc40 msgr2=0x7f4ad00c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.200+0000 7f4ad6f5b640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00adc40 0x7f4ad00c38a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400c4d0 tx=0x7f4ac400c990 comp rx=0 tx=0).stop 2023-08-09T12:43:59.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.201+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 shutdown_connections 2023-08-09T12:43:59.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.201+0000 7f4ad6f5b640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ab406a050 0x7f4ab406c510 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.201+0000 7f4ad6f5b640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad00cc630 0x7f4ad00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.201+0000 7f4ad6f5b640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ad00b3b40 0x7f4ad00c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.201+0000 7f4ad6f5b640 1 --2- 172.21.15.17:0/2362595379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad00adc40 0x7f4ad00c38a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.201+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 >> 172.21.15.17:0/2362595379 conn(0x7f4ad00cb1b0 msgr2=0x7f4ad0069970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:43:59.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.201+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 shutdown_connections 2023-08-09T12:43:59.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.201+0000 7f4ad6f5b640 1 -- 172.21.15.17:0/2362595379 wait complete. 2023-08-09T12:43:59.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:42:35.097822+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:42:35.735356+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:43:59.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:43:59.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.446+0000 7fcf25b84640 1 Processor -- start 2023-08-09T12:43:59.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.446+0000 7fcf25b84640 1 -- start start 2023-08-09T12:43:59.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.447+0000 7fcf25b84640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015ce90 0x7fcf201616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.447+0000 7fcf25b84640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf200d29d0 0x7fcf200d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.447+0000 7fcf25b84640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf200b6460 con 0x7fcf200b6000 2023-08-09T12:43:59.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.447+0000 7fcf25b84640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf200d33a0 con 0x7fcf200d29d0 2023-08-09T12:43:59.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.447+0000 7fcf25b84640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200cdd10 con 0x7fcf2015ce90 2023-08-09T12:43:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.448+0000 7fcf17fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcf200b6000 0x7fcf200cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53620/0 (socket says 172.21.15.17:53620) 2023-08-09T12:43:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.448+0000 7fcf17fff640 1 -- 172.21.15.17:0/2661442537 learned_addr learned my addr 172.21.15.17:0/2661442537 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:43:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.448+0000 7fcf1f7fe640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015ce90 0x7fcf201616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.448+0000 7fcf1ffff640 1 --2- 172.21.15.17:0/2661442537 >> v2:172.21.15.142:3300/0 conn(0x7fcf200d29d0 0x7fcf200d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.448+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620061807 0 0) 0x7fcf200b6460 con 0x7fcf200b6000 2023-08-09T12:43:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.448+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf0c003520 con 0x7fcf200b6000 2023-08-09T12:43:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3527203642 0 0) 0x7fcf0c003520 con 0x7fcf200b6000 2023-08-09T12:43:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015ce90 msgr2=0x7fcf201616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:43:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015ce90 0x7fcf201616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 >> v2:172.21.15.142:3300/0 conn(0x7fcf200d29d0 msgr2=0x7fcf200d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:43:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 --2- 172.21.15.17:0/2661442537 >> v2:172.21.15.142:3300/0 conn(0x7fcf200d29d0 0x7fcf200d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf200cdff0 con 0x7fcf200b6000 2023-08-09T12:43:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fcf08001670 con 0x7fcf200b6000 2023-08-09T12:43:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 >> v1:172.21.15.17:6789/0 conn(0x7fcf200b6000 legacy=0x7fcf200cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf0c0047c0 0x7fcf0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015ce90 0x7fcf0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200d33a0 con 0x7fcf0c003970 2023-08-09T12:43:59.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200cdd10 con 0x7fcf0c0047c0 2023-08-09T12:43:59.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c00b980 con 0x7fcf2015ce90 2023-08-09T12:43:59.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.449+0000 7fcf1f7fe640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.450+0000 7fcf17fff640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf0c0047c0 0x7fcf0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.450+0000 7fcf1f7fe640 1 -- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015ce90 msgr2=0x7fcf0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:43:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.450+0000 7fcf1f7fe640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015ce90 0x7fcf0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.450+0000 7fcf1f7fe640 1 -- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf0c0047c0 msgr2=0x7fcf0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:43:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.450+0000 7fcf1f7fe640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf0c0047c0 0x7fcf0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.450+0000 7fcf1f7fe640 1 -- 172.21.15.17:0/2661442537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c003520 con 0x7fcf0c003970 2023-08-09T12:43:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.450+0000 7fcf17fff640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf0c0047c0 0x7fcf0c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:43:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.451+0000 7fcf1f7fe640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf0c003d90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009ac0 tx=0x7fcf0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4258e84dac94198e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.451+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1002c710 con 0x7fcf0c003970 2023-08-09T12:43:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.451+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1002c870 con 0x7fcf0c003970 2023-08-09T12:43:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.451+0000 7fcf1effd640 1 -- 172.21.15.17:0/2661442537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1002cc00 con 0x7fcf0c003970 2023-08-09T12:43:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.452+0000 7fcf25b84640 1 -- 172.21.15.17:0/2661442537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 msgr2=0x7fcf0c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.452+0000 7fcf25b84640 1 --2- 172.21.15.17:0/2661442537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf0c003d90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009ac0 tx=0x7fcf0c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.452+0000 7fcf1ffff640 1 -- 172.21.15.17:0/2661442537 reap_dead start 2023-08-09T12:43:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.452+0000 7fcf25b84640 1 -- 172.21.15.17:0/2661442537 shutdown_connections 2023-08-09T12:43:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.452+0000 7fcf25b84640 1 -- 172.21.15.17:0/2661442537 >> 172.21.15.17:0/2661442537 conn(0x7fcf2006fde0 msgr2=0x7fcf200701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:43:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.452+0000 7fcf25b84640 1 -- 172.21.15.17:0/2661442537 shutdown_connections 2023-08-09T12:43:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.452+0000 7fcf25b84640 1 -- 172.21.15.17:0/2661442537 wait complete. 2023-08-09T12:43:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.454+0000 7fcf25b84640 1 Processor -- start 2023-08-09T12:43:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.454+0000 7fcf25b84640 1 -- start start 2023-08-09T12:43:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf25b84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf2015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf25b84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf20159c40 0x7fcf20158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf25b84640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf200ca340 0x7fcf200ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf25b84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200cad00 con 0x7fcf0c003970 2023-08-09T12:43:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf25b84640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2015f7b0 con 0x7fcf20159c40 2023-08-09T12:43:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf25b84640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2015eba0 con 0x7fcf200ca340 2023-08-09T12:43:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf1f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf2015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf1f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf2015e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59384/0 (socket says 172.21.15.17:59384) 2023-08-09T12:43:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf1f7fe640 1 -- 172.21.15.17:0/2098556249 learned_addr learned my addr 172.21.15.17:0/2098556249 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:43:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf1f7fe640 1 -- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf200ca340 msgr2=0x7fcf200ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf1f7fe640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf200ca340 0x7fcf200ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf1f7fe640 1 -- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf20159c40 msgr2=0x7fcf20158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf1f7fe640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf20159c40 0x7fcf20158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.455+0000 7fcf1f7fe640 1 -- 172.21.15.17:0/2098556249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2015ee80 con 0x7fcf0c003970 2023-08-09T12:43:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.456+0000 7fcf1f7fe640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf2015e2c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcf1002c2b0 tx=0x7fcf10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.456+0000 7fcf1cff9640 1 -- 172.21.15.17:0/2098556249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10003810 con 0x7fcf0c003970 2023-08-09T12:43:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.456+0000 7fcf1cff9640 1 -- 172.21.15.17:0/2098556249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1002de90 con 0x7fcf0c003970 2023-08-09T12:43:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.456+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2015f160 con 0x7fcf0c003970 2023-08-09T12:43:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.456+0000 7fcf1cff9640 1 -- 172.21.15.17:0/2098556249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10003b70 con 0x7fcf0c003970 2023-08-09T12:43:59.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.456+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2015e800 con 0x7fcf0c003970 2023-08-09T12:43:59.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.457+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20067400 con 0x7fcf0c003970 2023-08-09T12:43:59.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.458+0000 7fcf1cff9640 1 -- 172.21.15.17:0/2098556249 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf10003cd0 con 0x7fcf0c003970 2023-08-09T12:43:59.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.459+0000 7fcf1cff9640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf0006a050 0x7fcf0006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.459+0000 7fcf1cff9640 1 -- 172.21.15.17:0/2098556249 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fcf100aa500 con 0x7fcf0c003970 2023-08-09T12:43:59.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.460+0000 7fcf1cff9640 1 -- 172.21.15.17:0/2098556249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fcf00072380 con 0x7fcf0c003970 2023-08-09T12:43:59.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.460+0000 7fcf17fff640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf0006a050 0x7fcf0006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.461+0000 7fcf17fff640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf0006a050 0x7fcf0006c510 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf08000f60 tx=0x7fcf08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:59.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.464+0000 7fcf1cff9640 1 -- 172.21.15.17:0/2098556249 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcf10075ac0 con 0x7fcf0c003970 2023-08-09T12:43:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.657+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf200d0fa0 con 0x7fcf0c003970 2023-08-09T12:43:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.658+0000 7fcf1cff9640 1 -- 172.21.15.17:0/2098556249 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf200d0fa0 con 0x7fcf0c003970 2023-08-09T12:43:59.662 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:43:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.660+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf0006a050 msgr2=0x7fcf0006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.660+0000 7fcf25b84640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf0006a050 0x7fcf0006c510 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf08000f60 tx=0x7fcf08009040 comp rx=0 tx=0).stop 2023-08-09T12:43:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.660+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 msgr2=0x7fcf2015e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.660+0000 7fcf25b84640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf2015e2c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcf1002c2b0 tx=0x7fcf10004730 comp rx=0 tx=0).stop 2023-08-09T12:43:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.661+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 shutdown_connections 2023-08-09T12:43:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.661+0000 7fcf25b84640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf0006a050 0x7fcf0006c510 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.661+0000 7fcf25b84640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf200ca340 0x7fcf200ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.661+0000 7fcf25b84640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf20159c40 0x7fcf20158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.661+0000 7fcf25b84640 1 --2- 172.21.15.17:0/2098556249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf0c003970 0x7fcf2015e2c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.661+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 >> 172.21.15.17:0/2098556249 conn(0x7fcf2006fde0 msgr2=0x7fcf200b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:43:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.661+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 shutdown_connections 2023-08-09T12:43:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.661+0000 7fcf25b84640 1 -- 172.21.15.17:0/2098556249 wait complete. 2023-08-09T12:43:59.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:43:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.909+0000 7fb408dfd640 1 Processor -- start 2023-08-09T12:43:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.909+0000 7fb408dfd640 1 -- start start 2023-08-09T12:43:59.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.910+0000 7fb408dfd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4041616e0 0x7fb4040b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.911+0000 7fb408dfd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4040d29d0 0x7fb4040d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.911+0000 7fb408dfd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4040d3360 con 0x7fb40415ce90 2023-08-09T12:43:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.911+0000 7fb408dfd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040b6540 con 0x7fb4041616e0 2023-08-09T12:43:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.911+0000 7fb408dfd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040cdd10 con 0x7fb4040d29d0 2023-08-09T12:43:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.911+0000 7fb401d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4041616e0 0x7fb4040b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.911+0000 7fb40259c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb40415ce90 0x7fb4040cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53632/0 (socket says 172.21.15.17:53632) 2023-08-09T12:43:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.911+0000 7fb40259c640 1 -- 172.21.15.17:0/802745047 learned_addr learned my addr 172.21.15.17:0/802745047 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:43:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.911+0000 7fb402d9d640 1 --2- 172.21.15.17:0/802745047 >> v2:172.21.15.142:3300/0 conn(0x7fb4040d29d0 0x7fb4040d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.912+0000 7fb40159a640 1 -- 172.21.15.17:0/802745047 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407442709 0 0) 0x7fb3f4001110 con 0x7fb40415ce90 2023-08-09T12:43:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.912+0000 7fb40159a640 1 -- 172.21.15.17:0/802745047 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f0003520 con 0x7fb40415ce90 2023-08-09T12:43:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.912+0000 7fb401d9b640 1 -- 172.21.15.17:0/802745047 >> v2:172.21.15.142:3300/0 conn(0x7fb4040d29d0 msgr2=0x7fb4040d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:43:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.912+0000 7fb401d9b640 1 --2- 172.21.15.17:0/802745047 >> v2:172.21.15.142:3300/0 conn(0x7fb4040d29d0 0x7fb4040d2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.912+0000 7fb401d9b640 1 -- 172.21.15.17:0/802745047 >> v1:172.21.15.17:6789/0 conn(0x7fb40415ce90 legacy=0x7fb4040cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.912+0000 7fb401d9b640 1 -- 172.21.15.17:0/802745047 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040cdff0 con 0x7fb4041616e0 2023-08-09T12:43:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.913+0000 7fb401d9b640 1 --2- 172.21.15.17:0/802745047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4041616e0 0x7fb4040b6000 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb4040d07e0 tx=0x7fb3ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09b907367e6425b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.913+0000 7fb40159a640 1 -- 172.21.15.17:0/802745047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec02cc80 con 0x7fb4041616e0 2023-08-09T12:43:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.913+0000 7fb40159a640 1 -- 172.21.15.17:0/802745047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec02cde0 con 0x7fb4041616e0 2023-08-09T12:43:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.913+0000 7fb40159a640 1 -- 172.21.15.17:0/802745047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec034640 con 0x7fb4041616e0 2023-08-09T12:43:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.914+0000 7fb408dfd640 1 -- 172.21.15.17:0/802745047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4041616e0 msgr2=0x7fb4040b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.914+0000 7fb408dfd640 1 --2- 172.21.15.17:0/802745047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4041616e0 0x7fb4040b6000 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb4040d07e0 tx=0x7fb3ec02bed0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.914+0000 7fb408dfd640 1 -- 172.21.15.17:0/802745047 shutdown_connections 2023-08-09T12:43:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.914+0000 7fb408dfd640 1 --2- 172.21.15.17:0/802745047 >> v2:172.21.15.142:3300/0 conn(0x7fb4040d29d0 0x7fb4040d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.914+0000 7fb408dfd640 1 --2- 172.21.15.17:0/802745047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4041616e0 0x7fb4040b6000 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.914+0000 7fb408dfd640 1 -- 172.21.15.17:0/802745047 >> 172.21.15.17:0/802745047 conn(0x7fb40406fde0 msgr2=0x7fb4040701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:43:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.914+0000 7fb408dfd640 1 -- 172.21.15.17:0/802745047 shutdown_connections 2023-08-09T12:43:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.914+0000 7fb408dfd640 1 -- 172.21.15.17:0/802745047 wait complete. 2023-08-09T12:43:59.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.916+0000 7fb408dfd640 1 Processor -- start 2023-08-09T12:43:59.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.916+0000 7fb408dfd640 1 -- start start 2023-08-09T12:43:59.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.917+0000 7fb408dfd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4040d29d0 0x7fb4040abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.917+0000 7fb408dfd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb40415ce90 0x7fb4040a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.917+0000 7fb408dfd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4041616e0 0x7fb4041f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.917+0000 7fb408dfd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040aa9c0 con 0x7fb40415ce90 2023-08-09T12:43:59.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.917+0000 7fb408dfd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040a9aa0 con 0x7fb4040d29d0 2023-08-09T12:43:59.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.917+0000 7fb408dfd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4041f26b0 con 0x7fb4041616e0 2023-08-09T12:43:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb401d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb40415ce90 0x7fb4040a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb40259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4040d29d0 0x7fb4040abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb401d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb40415ce90 0x7fb4040a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59400/0 (socket says 172.21.15.17:59400) 2023-08-09T12:43:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb401d9b640 1 -- 172.21.15.17:0/264777805 learned_addr learned my addr 172.21.15.17:0/264777805 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:43:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb402d9d640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4041616e0 0x7fb4041f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb401d9b640 1 -- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4041616e0 msgr2=0x7fb4041f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb401d9b640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4041616e0 0x7fb4041f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb401d9b640 1 -- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4040d29d0 msgr2=0x7fb4040abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:43:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb401d9b640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4040d29d0 0x7fb4040abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:43:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.918+0000 7fb401d9b640 1 -- 172.21.15.17:0/264777805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec009a70 con 0x7fb40415ce90 2023-08-09T12:43:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.919+0000 7fb401d9b640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb40415ce90 0x7fb4040a9560 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000f80 tx=0x7fb3ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.919+0000 7fb3faffd640 1 -- 172.21.15.17:0/264777805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec009450 con 0x7fb40415ce90 2023-08-09T12:43:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.919+0000 7fb3faffd640 1 -- 172.21.15.17:0/264777805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec003e10 con 0x7fb40415ce90 2023-08-09T12:43:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.919+0000 7fb3faffd640 1 -- 172.21.15.17:0/264777805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec004820 con 0x7fb40415ce90 2023-08-09T12:43:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.919+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040a9d40 con 0x7fb40415ce90 2023-08-09T12:43:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.919+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040aa300 con 0x7fb40415ce90 2023-08-09T12:43:59.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.921+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb404067a80 con 0x7fb40415ce90 2023-08-09T12:43:59.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.922+0000 7fb3faffd640 1 -- 172.21.15.17:0/264777805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb3ec03b070 con 0x7fb40415ce90 2023-08-09T12:43:59.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.922+0000 7fb3faffd640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3e406a050 0x7fb3e406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:43:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.923+0000 7fb3faffd640 1 -- 172.21.15.17:0/264777805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb3ec0aab80 con 0x7fb40415ce90 2023-08-09T12:43:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.923+0000 7fb3faffd640 1 -- 172.21.15.17:0/264777805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fb3e4072380 con 0x7fb40415ce90 2023-08-09T12:43:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.923+0000 7fb40259c640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3e406a050 0x7fb3e406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:43:59.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.924+0000 7fb40259c640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3e406a050 0x7fb3e406c510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4005880 tx=0x7fb3f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:43:59.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:43:59.927+0000 7fb3faffd640 1 -- 172.21.15.17:0/264777805 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb3ec042060 con 0x7fb40415ce90 2023-08-09T12:44:00.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.124+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb4040d0ad0 con 0x7fb40415ce90 2023-08-09T12:44:00.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.125+0000 7fb3faffd640 1 -- 172.21.15.17:0/264777805 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb3ec0aae60 con 0x7fb40415ce90 2023-08-09T12:44:00.128 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:44:00.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3e406a050 msgr2=0x7fb3e406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3e406a050 0x7fb3e406c510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4005880 tx=0x7fb3f4009040 comp rx=0 tx=0).stop 2023-08-09T12:44:00.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb40415ce90 msgr2=0x7fb4040a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb40415ce90 0x7fb4040a9560 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000f80 tx=0x7fb3ec004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:00.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 shutdown_connections 2023-08-09T12:44:00.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3e406a050 0x7fb3e406c510 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4041616e0 0x7fb4041f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb40415ce90 0x7fb4040a9560 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.127+0000 7fb408dfd640 1 --2- 172.21.15.17:0/264777805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4040d29d0 0x7fb4040abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.128+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 >> 172.21.15.17:0/264777805 conn(0x7fb40406fde0 msgr2=0x7fb4040d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:00.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.128+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 shutdown_connections 2023-08-09T12:44:00.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.128+0000 7fb408dfd640 1 -- 172.21.15.17:0/264777805 wait complete. 2023-08-09T12:44:00.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:44:00.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.377+0000 7f5cd95b5640 1 Processor -- start 2023-08-09T12:44:00.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.377+0000 7f5cd95b5640 1 -- start start 2023-08-09T12:44:00.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.379+0000 7f5cd95b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 0x7f5cd40af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.379+0000 7f5cd95b5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5cd40afce0 0x7f5cd40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.379+0000 7f5cd95b5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5cd40cef20 0x7f5cd406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.379+0000 7f5cd95b5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd4158c20 con 0x7f5cd40afce0 2023-08-09T12:44:00.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.379+0000 7f5cd95b5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd40cf3b0 con 0x7f5cd40cef20 2023-08-09T12:44:00.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.379+0000 7f5cd95b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40b0220 con 0x7f5cd4158840 2023-08-09T12:44:00.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5ccbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5cd40afce0 0x7f5cd40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5ccbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5cd40afce0 0x7f5cd40ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59404/0 (socket says 172.21.15.17:59404) 2023-08-09T12:44:00.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5ccbfff640 1 -- 172.21.15.17:0/2750413312 learned_addr learned my addr 172.21.15.17:0/2750413312 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:00.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5cd2ffd640 1 --2- 172.21.15.17:0/2750413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 0x7f5cd40af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5ccbfff640 1 -- 172.21.15.17:0/2750413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 msgr2=0x7f5cd40af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:00.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5ccbfff640 1 --2- 172.21.15.17:0/2750413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 0x7f5cd40af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5ccbfff640 1 -- 172.21.15.17:0/2750413312 >> v2:172.21.15.142:3300/0 conn(0x7f5cd40cef20 msgr2=0x7f5cd406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5cd37fe640 1 --2- 172.21.15.17:0/2750413312 >> v2:172.21.15.142:3300/0 conn(0x7f5cd40cef20 0x7f5cd406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5ccbfff640 1 --2- 172.21.15.17:0/2750413312 >> v2:172.21.15.142:3300/0 conn(0x7f5cd40cef20 0x7f5cd406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5ccbfff640 1 -- 172.21.15.17:0/2750413312 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd415e7f0 con 0x7f5cd40afce0 2023-08-09T12:44:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.380+0000 7f5cd37fe640 1 --2- 172.21.15.17:0/2750413312 >> v2:172.21.15.142:3300/0 conn(0x7f5cd40cef20 0x7f5cd406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.382+0000 7f5ccbfff640 1 --2- 172.21.15.17:0/2750413312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd40ce9e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40c8da0 tx=0x7f5cbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ddb938f3e17492 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.382+0000 7f5cd27fc640 1 -- 172.21.15.17:0/2750413312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc031870 con 0x7f5cd40afce0 2023-08-09T12:44:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.382+0000 7f5cd27fc640 1 -- 172.21.15.17:0/2750413312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0319d0 con 0x7f5cd40afce0 2023-08-09T12:44:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.382+0000 7f5cd27fc640 1 -- 172.21.15.17:0/2750413312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc031d60 con 0x7f5cd40afce0 2023-08-09T12:44:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 -- 172.21.15.17:0/2750413312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 msgr2=0x7f5cd40ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/2750413312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd40ce9e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40c8da0 tx=0x7f5cbc02b910 comp rx=0 tx=0).stop 2023-08-09T12:44:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 -- 172.21.15.17:0/2750413312 shutdown_connections 2023-08-09T12:44:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/2750413312 >> v2:172.21.15.142:3300/0 conn(0x7f5cd40cef20 0x7f5cd406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/2750413312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd40ce9e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/2750413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 0x7f5cd40af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 -- 172.21.15.17:0/2750413312 >> 172.21.15.17:0/2750413312 conn(0x7f5cd4069be0 msgr2=0x7f5cd4069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 -- 172.21.15.17:0/2750413312 shutdown_connections 2023-08-09T12:44:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.383+0000 7f5cd95b5640 1 -- 172.21.15.17:0/2750413312 wait complete. 2023-08-09T12:44:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.385+0000 7f5cd95b5640 1 Processor -- start 2023-08-09T12:44:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.385+0000 7f5cd95b5640 1 -- start start 2023-08-09T12:44:00.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd95b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd95b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cd40cef20 0x7f5cd414dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd95b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 0x7f5cd414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd95b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd414e2b0 con 0x7f5cd40afce0 2023-08-09T12:44:00.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd95b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd414e530 con 0x7f5cd40cef20 2023-08-09T12:44:00.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd95b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd414e810 con 0x7f5cd4158840 2023-08-09T12:44:00.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd414b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59418/0 (socket says 172.21.15.17:59418) 2023-08-09T12:44:00.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.386+0000 7f5cd2ffd640 1 -- 172.21.15.17:0/3117327763 learned_addr learned my addr 172.21.15.17:0/3117327763 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:00.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5cd2ffd640 1 -- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 msgr2=0x7f5cd414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5cd2ffd640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 0x7f5cd414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5cd2ffd640 1 -- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cd40cef20 msgr2=0x7f5cd414dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5cd2ffd640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cd40cef20 0x7f5cd414dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5cd2ffd640 1 -- 172.21.15.17:0/3117327763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc0094d0 con 0x7f5cd40afce0 2023-08-09T12:44:00.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5cd2ffd640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd414b070 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400c7f0 tx=0x7f5cc400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:00.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5ccb7fe640 1 -- 172.21.15.17:0/3117327763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4004220 con 0x7f5cd40afce0 2023-08-09T12:44:00.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5ccb7fe640 1 -- 172.21.15.17:0/3117327763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc4004380 con 0x7f5cd40afce0 2023-08-09T12:44:00.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5ccb7fe640 1 -- 172.21.15.17:0/3117327763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4007860 con 0x7f5cd40afce0 2023-08-09T12:44:00.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.387+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd40c7c90 con 0x7f5cd40afce0 2023-08-09T12:44:00.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.388+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd414ad80 con 0x7f5cd40afce0 2023-08-09T12:44:00.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.389+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd40664b0 con 0x7f5cd40afce0 2023-08-09T12:44:00.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.390+0000 7f5ccb7fe640 1 -- 172.21.15.17:0/3117327763 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5cc4007bd0 con 0x7f5cd40afce0 2023-08-09T12:44:00.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.391+0000 7f5ccb7fe640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5cb406a050 0x7f5cb406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.391+0000 7f5ccb7fe640 1 -- 172.21.15.17:0/3117327763 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5cc40885d0 con 0x7f5cd40afce0 2023-08-09T12:44:00.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.391+0000 7f5ccb7fe640 1 -- 172.21.15.17:0/3117327763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f5cb4072380 con 0x7f5cd40afce0 2023-08-09T12:44:00.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.391+0000 7f5ccbfff640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5cb406a050 0x7f5cb406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.393+0000 7f5ccbfff640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5cb406a050 0x7f5cb406c510 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc036000 tx=0x7f5cbc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.395+0000 7f5ccb7fe640 1 -- 172.21.15.17:0/3117327763 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5cc4053c30 con 0x7f5cd40afce0 2023-08-09T12:44:00.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.590+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5cd40c81b0 con 0x7f5cd40afce0 2023-08-09T12:44:00.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.591+0000 7f5ccb7fe640 1 -- 172.21.15.17:0/3117327763 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5cd40c81b0 con 0x7f5cd40afce0 2023-08-09T12:44:00.594 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:44:00.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5cb406a050 msgr2=0x7f5cb406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5cb406a050 0x7f5cb406c510 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc036000 tx=0x7f5cbc030000 comp rx=0 tx=0).stop 2023-08-09T12:44:00.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 msgr2=0x7f5cd414b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd414b070 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400c7f0 tx=0x7f5cc400ccb0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 shutdown_connections 2023-08-09T12:44:00.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5cb406a050 0x7f5cb406c510 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5cd4158840 0x7f5cd414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cd40cef20 0x7f5cd414dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 --2- 172.21.15.17:0/3117327763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd40afce0 0x7f5cd414b070 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 >> 172.21.15.17:0/3117327763 conn(0x7f5cd4069be0 msgr2=0x7f5cd40cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:00.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 shutdown_connections 2023-08-09T12:44:00.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.594+0000 7f5cd95b5640 1 -- 172.21.15.17:0/3117327763 wait complete. 2023-08-09T12:44:00.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:44:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.854+0000 7f856359e640 1 Processor -- start 2023-08-09T12:44:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.855+0000 7f856359e640 1 -- start start 2023-08-09T12:44:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.856+0000 7f856359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85640b8420 0x7f85640cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.856+0000 7f856359e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85640d0f00 con 0x7f856415cf20 2023-08-09T12:44:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.856+0000 7f856359e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85641611f0 con 0x7f856415cb40 2023-08-09T12:44:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.856+0000 7f856359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85641614d0 con 0x7f85640b8420 2023-08-09T12:44:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8562d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f856415cf20 0x7f85640d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53640/0 (socket says 172.21.15.17:53640) 2023-08-09T12:44:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8562d9d640 1 -- 172.21.15.17:0/1482038483 learned_addr learned my addr 172.21.15.17:0/1482038483 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f855bfff640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85640b8420 0x7f85640cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374105723 0 0) 0x7f85640d0f00 con 0x7f856415cf20 2023-08-09T12:44:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8550003520 con 0x7f856415cf20 2023-08-09T12:44:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 417246842 0 0) 0x7f8550003520 con 0x7f856415cf20 2023-08-09T12:44:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85640b8420 msgr2=0x7f85640cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85640b8420 0x7f85640cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 >> v1:172.21.15.142:6789/0 conn(0x7f856415cb40 legacy=0x7f85641609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85641617b0 con 0x7f856415cf20 2023-08-09T12:44:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f855c0019f0 con 0x7f856415cf20 2023-08-09T12:44:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.857+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 >> v1:172.21.15.17:6789/0 conn(0x7f856415cf20 legacy=0x7f85640d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f8561d9b640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85500039a0 0x7f8550003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f8561d9b640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8550004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f8561d9b640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85640b8420 0x7f8550005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85641614d0 con 0x7f85500047c0 2023-08-09T12:44:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855000baf0 con 0x7f85500039a0 2023-08-09T12:44:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855000bcb0 con 0x7f85640b8420 2023-08-09T12:44:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f855bfff640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8550004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f856259c640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85500039a0 0x7f8550003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f8562d9d640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85640b8420 0x7f8550005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f855bfff640 1 -- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85640b8420 msgr2=0x7f8550005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f855bfff640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85640b8420 0x7f8550005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f855bfff640 1 -- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85500039a0 msgr2=0x7f8550003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f855bfff640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85500039a0 0x7f8550003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.858+0000 7f855bfff640 1 -- 172.21.15.17:0/1482038483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550003520 con 0x7f85500047c0 2023-08-09T12:44:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.860+0000 7f855bfff640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8550004c40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f854c009a90 tx=0x7f85500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761862a19d86e890 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.860+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c02c680 con 0x7f85500047c0 2023-08-09T12:44:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.860+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c02c7e0 con 0x7f85500047c0 2023-08-09T12:44:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.860+0000 7f8561d9b640 1 -- 172.21.15.17:0/1482038483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c02cb70 con 0x7f85500047c0 2023-08-09T12:44:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.860+0000 7f856359e640 1 -- 172.21.15.17:0/1482038483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 msgr2=0x7f8550004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.860+0000 7f856359e640 1 --2- 172.21.15.17:0/1482038483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8550004c40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f854c009a90 tx=0x7f85500057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.860+0000 7f8562d9d640 1 -- 172.21.15.17:0/1482038483 reap_dead start 2023-08-09T12:44:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.861+0000 7f856359e640 1 -- 172.21.15.17:0/1482038483 shutdown_connections 2023-08-09T12:44:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.861+0000 7f856359e640 1 -- 172.21.15.17:0/1482038483 >> 172.21.15.17:0/1482038483 conn(0x7f85640d2ab0 msgr2=0x7f85640d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.861+0000 7f856359e640 1 -- 172.21.15.17:0/1482038483 shutdown_connections 2023-08-09T12:44:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.861+0000 7f856359e640 1 -- 172.21.15.17:0/1482038483 wait complete. 2023-08-09T12:44:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.862+0000 7f856359e640 1 Processor -- start 2023-08-09T12:44:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.863+0000 7f856359e640 1 -- start start 2023-08-09T12:44:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8564154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856415afa0 0x7f856415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856415fbb0 0x7f8564160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8564154690 con 0x7f85500047c0 2023-08-09T12:44:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85641f29c0 con 0x7f856415fbb0 2023-08-09T12:44:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85641f3740 con 0x7f856415afa0 2023-08-09T12:44:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8564154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8564154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59432/0 (socket says 172.21.15.17:59432) 2023-08-09T12:44:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856259c640 1 -- 172.21.15.17:0/3596233380 learned_addr learned my addr 172.21.15.17:0/3596233380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f855bfff640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856415afa0 0x7f856415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856259c640 1 -- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856415afa0 msgr2=0x7f856415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f8562d9d640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856415fbb0 0x7f8564160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856259c640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856415afa0 0x7f856415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856259c640 1 -- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856415fbb0 msgr2=0x7f8564160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856259c640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856415fbb0 0x7f8564160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.864+0000 7f856259c640 1 -- 172.21.15.17:0/3596233380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85641f2c60 con 0x7f85500047c0 2023-08-09T12:44:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.865+0000 7f856259c640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8564154150 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f855400e550 tx=0x7f855400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:00.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.865+0000 7f855affd640 1 -- 172.21.15.17:0/3596233380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540052e0 con 0x7f85500047c0 2023-08-09T12:44:00.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.865+0000 7f855affd640 1 -- 172.21.15.17:0/3596233380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8554005440 con 0x7f85500047c0 2023-08-09T12:44:00.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.865+0000 7f855affd640 1 -- 172.21.15.17:0/3596233380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554003810 con 0x7f85500047c0 2023-08-09T12:44:00.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.865+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85641f2f40 con 0x7f85500047c0 2023-08-09T12:44:00.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.865+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856415d5c0 con 0x7f85500047c0 2023-08-09T12:44:00.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.866+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856404e390 con 0x7f85500047c0 2023-08-09T12:44:00.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.867+0000 7f855affd640 1 -- 172.21.15.17:0/3596233380 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8554003970 con 0x7f85500047c0 2023-08-09T12:44:00.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.869+0000 7f855affd640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f854406a050 0x7f854406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:00.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.869+0000 7f855affd640 1 -- 172.21.15.17:0/3596233380 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f85540883c0 con 0x7f85500047c0 2023-08-09T12:44:00.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.869+0000 7f855affd640 1 -- 172.21.15.17:0/3596233380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f8544072370 con 0x7f85500047c0 2023-08-09T12:44:00.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.869+0000 7f855bfff640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f854406a050 0x7f854406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:00.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.871+0000 7f855bfff640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f854406a050 0x7f854406c510 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f854c036000 tx=0x7f854c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:00.873+0000 7f855affd640 1 -- 172.21.15.17:0/3596233380 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8554053a10 con 0x7f85500047c0 2023-08-09T12:44:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.069+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8564156930 con 0x7f85500047c0 2023-08-09T12:44:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.070+0000 7f855affd640 1 -- 172.21.15.17:0/3596233380 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8554057030 con 0x7f85500047c0 2023-08-09T12:44:01.073 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:44:01.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f854406a050 msgr2=0x7f854406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:01.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f854406a050 0x7f854406c510 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f854c036000 tx=0x7f854c030000 comp rx=0 tx=0).stop 2023-08-09T12:44:01.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 msgr2=0x7f8564154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:01.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8564154150 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f855400e550 tx=0x7f855400ea10 comp rx=0 tx=0).stop 2023-08-09T12:44:01.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 shutdown_connections 2023-08-09T12:44:01.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f854406a050 0x7f854406c510 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856415fbb0 0x7f8564160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856415afa0 0x7f856415b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 --2- 172.21.15.17:0/3596233380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85500047c0 0x7f8564154150 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.072+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 >> 172.21.15.17:0/3596233380 conn(0x7f85640d2ab0 msgr2=0x7f85640ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.073+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 shutdown_connections 2023-08-09T12:44:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.073+0000 7f856359e640 1 -- 172.21.15.17:0/3596233380 wait complete. 2023-08-09T12:44:01.096 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:44:01.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.328+0000 7fb776bc9640 1 Processor -- start 2023-08-09T12:44:01.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.328+0000 7fb776bc9640 1 -- start start 2023-08-09T12:44:01.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.329+0000 7fb776bc9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb770161280 0x7fb7700c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:01.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.329+0000 7fb776bc9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb7700acfc0 0x7fb7700cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:01.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.329+0000 7fb776bc9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77015df30 con 0x7fb770161660 2023-08-09T12:44:01.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb776bc9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77015d430 con 0x7fb7700acfc0 2023-08-09T12:44:01.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb776bc9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7700ca9d0 con 0x7fb770161280 2023-08-09T12:44:01.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb775166640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb7700acfc0 0x7fb7700cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:01.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb775166640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb7700acfc0 0x7fb7700cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59440/0 (socket says 172.21.15.17:59440) 2023-08-09T12:44:01.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb775166640 1 -- 172.21.15.17:0/2339309412 learned_addr learned my addr 172.21.15.17:0/2339309412 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:01.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb774965640 1 --2- 172.21.15.17:0/2339309412 >> v2:172.21.15.142:3300/0 conn(0x7fb770161280 0x7fb7700c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:01.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb775166640 1 -- 172.21.15.17:0/2339309412 >> v2:172.21.15.142:3300/0 conn(0x7fb770161280 msgr2=0x7fb7700c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:01.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb775166640 1 --2- 172.21.15.17:0/2339309412 >> v2:172.21.15.142:3300/0 conn(0x7fb770161280 0x7fb7700c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb775166640 1 -- 172.21.15.17:0/2339309412 >> v1:172.21.15.142:6789/0 conn(0x7fb770161660 legacy=0x7fb7700ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:01.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb775166640 1 -- 172.21.15.17:0/2339309412 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77015e3c0 con 0x7fb7700acfc0 2023-08-09T12:44:01.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.330+0000 7fb774965640 1 --2- 172.21.15.17:0/2339309412 >> v2:172.21.15.142:3300/0 conn(0x7fb770161280 0x7fb7700c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:01.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.332+0000 7fb775166640 1 --2- 172.21.15.17:0/2339309412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7700acfc0 0x7fb7700cc630 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ad990 tx=0x7fb76802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebdd59f0731c663 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:01.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.332+0000 7fb7677fe640 1 -- 172.21.15.17:0/2339309412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680317e0 con 0x7fb7700acfc0 2023-08-09T12:44:01.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.332+0000 7fb7677fe640 1 -- 172.21.15.17:0/2339309412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768031940 con 0x7fb7700acfc0 2023-08-09T12:44:01.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.332+0000 7fb7677fe640 1 -- 172.21.15.17:0/2339309412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768031cd0 con 0x7fb7700acfc0 2023-08-09T12:44:01.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.333+0000 7fb776bc9640 1 -- 172.21.15.17:0/2339309412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7700acfc0 msgr2=0x7fb7700cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:01.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.333+0000 7fb776bc9640 1 --2- 172.21.15.17:0/2339309412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7700acfc0 0x7fb7700cc630 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ad990 tx=0x7fb76802b880 comp rx=0 tx=0).stop 2023-08-09T12:44:01.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.333+0000 7fb776bc9640 1 -- 172.21.15.17:0/2339309412 shutdown_connections 2023-08-09T12:44:01.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.333+0000 7fb776bc9640 1 --2- 172.21.15.17:0/2339309412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7700acfc0 0x7fb7700cc630 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.333+0000 7fb776bc9640 1 --2- 172.21.15.17:0/2339309412 >> v2:172.21.15.142:3300/0 conn(0x7fb770161280 0x7fb7700c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.333+0000 7fb776bc9640 1 -- 172.21.15.17:0/2339309412 >> 172.21.15.17:0/2339309412 conn(0x7fb7700cb1b0 msgr2=0x7fb7700cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:01.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.333+0000 7fb776bc9640 1 -- 172.21.15.17:0/2339309412 shutdown_connections 2023-08-09T12:44:01.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.333+0000 7fb776bc9640 1 -- 172.21.15.17:0/2339309412 wait complete. 2023-08-09T12:44:01.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.335+0000 7fb776bc9640 1 Processor -- start 2023-08-09T12:44:01.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.335+0000 7fb776bc9640 1 -- start start 2023-08-09T12:44:01.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb776bc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7700acfc0 0x7fb7701f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:01.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb776bc9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb770161280 0x7fb770154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:01.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb776bc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb770161660 0x7fb7700b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:01.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb776bc9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700af260 con 0x7fb770161280 2023-08-09T12:44:01.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb776bc9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700af540 con 0x7fb770161660 2023-08-09T12:44:01.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb776bc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700af820 con 0x7fb7700acfc0 2023-08-09T12:44:01.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb767fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb770161280 0x7fb770154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:01.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb767fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb770161280 0x7fb770154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59442/0 (socket says 172.21.15.17:59442) 2023-08-09T12:44:01.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb767fff640 1 -- 172.21.15.17:0/3509104032 learned_addr learned my addr 172.21.15.17:0/3509104032 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:01.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb774965640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7700acfc0 0x7fb7701f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:01.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.336+0000 7fb775166640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb770161660 0x7fb7700b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:01.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb767fff640 1 -- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7700acfc0 msgr2=0x7fb7701f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:01.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb767fff640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7700acfc0 0x7fb7701f6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb767fff640 1 -- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb770161660 msgr2=0x7fb7700b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:01.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb767fff640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb770161660 0x7fb7700b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb767fff640 1 -- 172.21.15.17:0/3509104032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680094d0 con 0x7fb770161280 2023-08-09T12:44:01.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb775166640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb770161660 0x7fb7700b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb767fff640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb770161280 0x7fb770154ef0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb76000c400 tx=0x7fb76000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb7657fa640 1 -- 172.21.15.17:0/3509104032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600054e0 con 0x7fb770161280 2023-08-09T12:44:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb7657fa640 1 -- 172.21.15.17:0/3509104032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760003640 con 0x7fb770161280 2023-08-09T12:44:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb7657fa640 1 -- 172.21.15.17:0/3509104032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600039f0 con 0x7fb770161280 2023-08-09T12:44:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700afb00 con 0x7fb770161280 2023-08-09T12:44:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.337+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7701572c0 con 0x7fb770161280 2023-08-09T12:44:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.339+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700afcf0 con 0x7fb770161280 2023-08-09T12:44:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.340+0000 7fb7657fa640 1 -- 172.21.15.17:0/3509104032 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb760003b50 con 0x7fb770161280 2023-08-09T12:44:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.341+0000 7fb7657fa640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb75c06a050 0x7fb75c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:01.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.341+0000 7fb7657fa640 1 -- 172.21.15.17:0/3509104032 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb760087770 con 0x7fb770161280 2023-08-09T12:44:01.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.341+0000 7fb7657fa640 1 -- 172.21.15.17:0/3509104032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fb75c072380 con 0x7fb770161280 2023-08-09T12:44:01.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.341+0000 7fb774965640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb75c06a050 0x7fb75c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:01.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.343+0000 7fb774965640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb75c06a050 0x7fb75c06c510 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb76c008ee0 tx=0x7fb76c008430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.345+0000 7fb7657fa640 1 -- 172.21.15.17:0/3509104032 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb760052e80 con 0x7fb770161280 2023-08-09T12:44:01.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.555+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb7700af3a0 con 0x7fb770161280 2023-08-09T12:44:01.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.555+0000 7fb7657fa640 1 -- 172.21.15.17:0/3509104032 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb7700af3a0 con 0x7fb770161280 2023-08-09T12:44:01.558 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:44:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb75c06a050 msgr2=0x7fb75c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb75c06a050 0x7fb75c06c510 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb76c008ee0 tx=0x7fb76c008430 comp rx=0 tx=0).stop 2023-08-09T12:44:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb770161280 msgr2=0x7fb770154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb770161280 0x7fb770154ef0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb76000c400 tx=0x7fb76000c8c0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 shutdown_connections 2023-08-09T12:44:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb75c06a050 0x7fb75c06c510 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb770161660 0x7fb7700b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb770161280 0x7fb770154ef0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 --2- 172.21.15.17:0/3509104032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7700acfc0 0x7fb7701f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 >> 172.21.15.17:0/3509104032 conn(0x7fb7700cb1b0 msgr2=0x7fb77006bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 shutdown_connections 2023-08-09T12:44:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:01.558+0000 7fb776bc9640 1 -- 172.21.15.17:0/3509104032 wait complete. 2023-08-09T12:44:01.579 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:44:01.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:01.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:44:01.702 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:44:01.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:01.703 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:44:01.756 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:44:01.756 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:01.817 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:44:01.818 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:01.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:02.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.107+0000 7f594db8b640 1 Processor -- start 2023-08-09T12:44:02.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.107+0000 7f594db8b640 1 -- start start 2023-08-09T12:44:02.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.108+0000 7f594db8b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59481616e0 0x7f59480b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.108+0000 7f594db8b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59480d29d0 0x7f59480d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.108+0000 7f594db8b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59480cdd10 con 0x7f594815ce90 2023-08-09T12:44:02.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.108+0000 7f594db8b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59480b6540 con 0x7f59480d29d0 2023-08-09T12:44:02.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.108+0000 7f594db8b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59480d33a0 con 0x7f59481616e0 2023-08-09T12:44:02.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.109+0000 7f5947fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59480d29d0 0x7f59480d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.109+0000 7f5946ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59481616e0 0x7f59480b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.109+0000 7f5946ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59481616e0 0x7f59480b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:45622/0 (socket says 172.21.15.17:45622) 2023-08-09T12:44:02.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.109+0000 7f5946ffd640 1 -- 172.21.15.17:0/3133804096 learned_addr learned my addr 172.21.15.17:0/3133804096 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:02.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.110+0000 7f5947fff640 1 -- 172.21.15.17:0/3133804096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59481616e0 msgr2=0x7f59480b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:02.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.110+0000 7f5947fff640 1 --2- 172.21.15.17:0/3133804096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59481616e0 0x7f59480b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.110+0000 7f5947fff640 1 -- 172.21.15.17:0/3133804096 >> v1:172.21.15.142:6789/0 conn(0x7f594815ce90 legacy=0x7f59480cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.110+0000 7f5947fff640 1 -- 172.21.15.17:0/3133804096 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480cdff0 con 0x7f59480d29d0 2023-08-09T12:44:02.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.110+0000 7f5946ffd640 1 --2- 172.21.15.17:0/3133804096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59481616e0 0x7f59480b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:44:02.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.111+0000 7f5947fff640 1 --2- 172.21.15.17:0/3133804096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 0x7f59480d2e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f59400097a0 tx=0x7f594002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14134facaf5aa39b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:02.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.112+0000 7f59467fc640 1 -- 172.21.15.17:0/3133804096 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594002d040 con 0x7f59480d29d0 2023-08-09T12:44:02.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.112+0000 7f59467fc640 1 -- 172.21.15.17:0/3133804096 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5940031810 con 0x7f59480d29d0 2023-08-09T12:44:02.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.112+0000 7f59467fc640 1 -- 172.21.15.17:0/3133804096 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940031ba0 con 0x7f59480d29d0 2023-08-09T12:44:02.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.113+0000 7f594db8b640 1 -- 172.21.15.17:0/3133804096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 msgr2=0x7f59480d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.113+0000 7f594db8b640 1 --2- 172.21.15.17:0/3133804096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 0x7f59480d2e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f59400097a0 tx=0x7f594002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.113+0000 7f594db8b640 1 -- 172.21.15.17:0/3133804096 shutdown_connections 2023-08-09T12:44:02.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.113+0000 7f594db8b640 1 --2- 172.21.15.17:0/3133804096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59481616e0 0x7f59480b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.113+0000 7f594db8b640 1 --2- 172.21.15.17:0/3133804096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 0x7f59480d2e60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.113+0000 7f594db8b640 1 -- 172.21.15.17:0/3133804096 >> 172.21.15.17:0/3133804096 conn(0x7f594806fde0 msgr2=0x7f59480701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.113+0000 7f594db8b640 1 -- 172.21.15.17:0/3133804096 shutdown_connections 2023-08-09T12:44:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.113+0000 7f594db8b640 1 -- 172.21.15.17:0/3133804096 wait complete. 2023-08-09T12:44:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.115+0000 7f594db8b640 1 Processor -- start 2023-08-09T12:44:02.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.115+0000 7f594db8b640 1 -- start start 2023-08-09T12:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f594db8b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 0x7f594814ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f594db8b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594815ce90 0x7f59480b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f594db8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59481616e0 0x7f59480b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f594db8b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59480ca700 con 0x7f59481616e0 2023-08-09T12:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f594db8b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59480ca9e0 con 0x7f59480d29d0 2023-08-09T12:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f594db8b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59480cacc0 con 0x7f594815ce90 2023-08-09T12:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f5947fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59481616e0 0x7f59480b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f5947fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59481616e0 0x7f59480b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59452/0 (socket says 172.21.15.17:59452) 2023-08-09T12:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f5947fff640 1 -- 172.21.15.17:0/1716969380 learned_addr learned my addr 172.21.15.17:0/1716969380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f5946ffd640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594815ce90 0x7f59480b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.116+0000 7f59477fe640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 0x7f594814ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.117+0000 7f5947fff640 1 -- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594815ce90 msgr2=0x7f59480b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.117+0000 7f5947fff640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594815ce90 0x7f59480b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.117+0000 7f5947fff640 1 -- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 msgr2=0x7f594814ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.117+0000 7f5947fff640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 0x7f594814ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.117+0000 7f5947fff640 1 -- 172.21.15.17:0/1716969380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c009b30 con 0x7f59481616e0 2023-08-09T12:44:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.117+0000 7f5947fff640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59481616e0 0x7f59480b2b60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f594002b8f0 tx=0x7f59400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.117+0000 7f592ffff640 1 -- 172.21.15.17:0/1716969380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940006e10 con 0x7f59481616e0 2023-08-09T12:44:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.117+0000 7f592ffff640 1 -- 172.21.15.17:0/1716969380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594003ad60 con 0x7f59481616e0 2023-08-09T12:44:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.118+0000 7f592ffff640 1 -- 172.21.15.17:0/1716969380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940044630 con 0x7f59481616e0 2023-08-09T12:44:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.118+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5940009400 con 0x7f59481616e0 2023-08-09T12:44:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.118+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59480cb280 con 0x7f59481616e0 2023-08-09T12:44:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.119+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5948067a80 con 0x7f59481616e0 2023-08-09T12:44:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.120+0000 7f592ffff640 1 -- 172.21.15.17:0/1716969380 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5940044790 con 0x7f59481616e0 2023-08-09T12:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.121+0000 7f592ffff640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f593406a080 0x7f593406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.121+0000 7f592ffff640 1 -- 172.21.15.17:0/1716969380 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f59400aaa50 con 0x7f59481616e0 2023-08-09T12:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.121+0000 7f592ffff640 1 -- 172.21.15.17:0/1716969380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f5934072430 con 0x7f59481616e0 2023-08-09T12:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.122+0000 7f59477fe640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f593406a080 0x7f593406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.123+0000 7f59477fe640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f593406a080 0x7f593406c540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5938001620 tx=0x7f5938009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:02.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.125+0000 7f592ffff640 1 -- 172.21.15.17:0/1716969380 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5940076130 con 0x7f59481616e0 2023-08-09T12:44:02.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.321+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59480d0ad0 con 0x7f59481616e0 2023-08-09T12:44:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.323+0000 7f592ffff640 1 -- 172.21.15.17:0/1716969380 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18580 (secure 0 0 0) 0x7f5940035070 con 0x7f59481616e0 2023-08-09T12:44:02.327 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:02.328 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:43:12.748465+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:42:35.097822+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-09T12:42:35.735356+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.17","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:02.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.325+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f593406a080 msgr2=0x7f593406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.325+0000 7f594db8b640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f593406a080 0x7f593406c540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5938001620 tx=0x7f5938009040 comp rx=0 tx=0).stop 2023-08-09T12:44:02.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59481616e0 msgr2=0x7f59480b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59481616e0 0x7f59480b2b60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f594002b8f0 tx=0x7f59400046c0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 shutdown_connections 2023-08-09T12:44:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f593406a080 0x7f593406c540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59481616e0 0x7f59480b2b60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594815ce90 0x7f59480b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 --2- 172.21.15.17:0/1716969380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59480d29d0 0x7f594814ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 >> 172.21.15.17:0/1716969380 conn(0x7f594806fde0 msgr2=0x7f59480701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:02.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 shutdown_connections 2023-08-09T12:44:02.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.326+0000 7f594db8b640 1 -- 172.21.15.17:0/1716969380 wait complete. 2023-08-09T12:44:02.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:42:35.097822+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:42:35.735356+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:44:02.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:44:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.622+0000 7f351a6cc640 1 Processor -- start 2023-08-09T12:44:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.622+0000 7f351a6cc640 1 -- start start 2023-08-09T12:44:02.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.623+0000 7f351a6cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35140acfc0 0x7f3514167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.623+0000 7f351a6cc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351415df30 con 0x7f3514161280 2023-08-09T12:44:02.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.623+0000 7f351a6cc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35140ca9d0 con 0x7f3514161660 2023-08-09T12:44:02.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.623+0000 7f351a6cc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351415d430 con 0x7f35140acfc0 2023-08-09T12:44:02.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.623+0000 7f3513fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3514161280 0x7f35140c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53652/0 (socket says 172.21.15.17:53652) 2023-08-09T12:44:02.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.623+0000 7f3513fff640 1 -- 172.21.15.17:0/589619042 learned_addr learned my addr 172.21.15.17:0/589619042 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:02.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.624+0000 7f3518c69640 1 --2- 172.21.15.17:0/589619042 >> v2:172.21.15.142:3300/0 conn(0x7f35140acfc0 0x7f3514167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.624+0000 7f35137fe640 1 -- 172.21.15.17:0/589619042 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237636956 0 0) 0x7f351415df30 con 0x7f3514161280 2023-08-09T12:44:02.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.624+0000 7f35137fe640 1 -- 172.21.15.17:0/589619042 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3500003520 con 0x7f3514161280 2023-08-09T12:44:02.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.624+0000 7f3518c69640 1 -- 172.21.15.17:0/589619042 >> v1:172.21.15.142:6789/0 conn(0x7f3514161660 legacy=0x7f35140ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.624+0000 7f3518c69640 1 -- 172.21.15.17:0/589619042 >> v1:172.21.15.17:6789/0 conn(0x7f3514161280 legacy=0x7f35140c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.624+0000 7f3518c69640 1 -- 172.21.15.17:0/589619042 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351415e3c0 con 0x7f35140acfc0 2023-08-09T12:44:02.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.626+0000 7f3518c69640 1 --2- 172.21.15.17:0/589619042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35140acfc0 0x7f3514167db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f350c009d90 tx=0x7f350c02bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85a6f0bd0faabe2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:02.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.626+0000 7f35137fe640 1 -- 172.21.15.17:0/589619042 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c02cc70 con 0x7f35140acfc0 2023-08-09T12:44:02.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.626+0000 7f35137fe640 1 -- 172.21.15.17:0/589619042 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c02cdd0 con 0x7f35140acfc0 2023-08-09T12:44:02.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.626+0000 7f35137fe640 1 -- 172.21.15.17:0/589619042 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c034660 con 0x7f35140acfc0 2023-08-09T12:44:02.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.627+0000 7f351a6cc640 1 -- 172.21.15.17:0/589619042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35140acfc0 msgr2=0x7f3514167db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.627+0000 7f351a6cc640 1 --2- 172.21.15.17:0/589619042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35140acfc0 0x7f3514167db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f350c009d90 tx=0x7f350c02bec0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.627+0000 7f351a6cc640 1 -- 172.21.15.17:0/589619042 shutdown_connections 2023-08-09T12:44:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.627+0000 7f351a6cc640 1 --2- 172.21.15.17:0/589619042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35140acfc0 0x7f3514167db0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.627+0000 7f351a6cc640 1 -- 172.21.15.17:0/589619042 >> 172.21.15.17:0/589619042 conn(0x7f35140cb1b0 msgr2=0x7f35140cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.627+0000 7f351a6cc640 1 -- 172.21.15.17:0/589619042 shutdown_connections 2023-08-09T12:44:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.627+0000 7f351a6cc640 1 -- 172.21.15.17:0/589619042 wait complete. 2023-08-09T12:44:02.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.629+0000 7f351a6cc640 1 Processor -- start 2023-08-09T12:44:02.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.629+0000 7f351a6cc640 1 -- start start 2023-08-09T12:44:02.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f351a6cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35140acfc0 0x7f3514150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f351a6cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3514161280 0x7f35140c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f351a6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3514161660 0x7f35140c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f351a6cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35141510c0 con 0x7f3514161280 2023-08-09T12:44:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f351a6cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35141f2440 con 0x7f3514161660 2023-08-09T12:44:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f351a6cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35141f2720 con 0x7f35140acfc0 2023-08-09T12:44:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f350bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3514161280 0x7f35140c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f350bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3514161280 0x7f35140c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59460/0 (socket says 172.21.15.17:59460) 2023-08-09T12:44:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f350bfff640 1 -- 172.21.15.17:0/142625773 learned_addr learned my addr 172.21.15.17:0/142625773 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.630+0000 7f3518c69640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3514161660 0x7f35140c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f350bfff640 1 -- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35140acfc0 msgr2=0x7f3514150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f350bfff640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35140acfc0 0x7f3514150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f350bfff640 1 -- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3514161660 msgr2=0x7f35140c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f350bfff640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3514161660 0x7f35140c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f350bfff640 1 -- 172.21.15.17:0/142625773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009a70 con 0x7f3514161280 2023-08-09T12:44:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f3518c69640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3514161660 0x7f35140c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f350bfff640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3514161280 0x7f35140c4850 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00c450 tx=0x7f34fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f35117fa640 1 -- 172.21.15.17:0/142625773 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0052d0 con 0x7f3514161280 2023-08-09T12:44:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f35117fa640 1 -- 172.21.15.17:0/142625773 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc005450 con 0x7f3514161280 2023-08-09T12:44:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f35117fa640 1 -- 172.21.15.17:0/142625773 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc003880 con 0x7f3514161280 2023-08-09T12:44:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35141f2a00 con 0x7f3514161280 2023-08-09T12:44:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.631+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35141f2fc0 con 0x7f3514161280 2023-08-09T12:44:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.633+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3514067a80 con 0x7f3514161280 2023-08-09T12:44:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.634+0000 7f35117fa640 1 -- 172.21.15.17:0/142625773 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f34fc0039e0 con 0x7f3514161280 2023-08-09T12:44:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.635+0000 7f35117fa640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f34f406a050 0x7f34f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.635+0000 7f35117fa640 1 -- 172.21.15.17:0/142625773 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f34fc0881c0 con 0x7f3514161280 2023-08-09T12:44:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.635+0000 7f35117fa640 1 -- 172.21.15.17:0/142625773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f34f4072380 con 0x7f3514161280 2023-08-09T12:44:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.635+0000 7f3513fff640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f34f406a050 0x7f34f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.636+0000 7f3513fff640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f34f406a050 0x7f34f406c510 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f351406c020 tx=0x7f3504007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:02.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.639+0000 7f35117fa640 1 -- 172.21.15.17:0/142625773 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f34fc053820 con 0x7f3514161280 2023-08-09T12:44:02.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.832+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35140adc60 con 0x7f3514161280 2023-08-09T12:44:02.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.833+0000 7f35117fa640 1 -- 172.21.15.17:0/142625773 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34fc056e40 con 0x7f3514161280 2023-08-09T12:44:02.836 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:44:02.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f34f406a050 msgr2=0x7f34f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f34f406a050 0x7f34f406c510 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f351406c020 tx=0x7f3504007930 comp rx=0 tx=0).stop 2023-08-09T12:44:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3514161280 msgr2=0x7f35140c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3514161280 0x7f35140c4850 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00c450 tx=0x7f34fc00c910 comp rx=0 tx=0).stop 2023-08-09T12:44:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 shutdown_connections 2023-08-09T12:44:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f34f406a050 0x7f34f406c510 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3514161660 0x7f35140c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3514161280 0x7f35140c4850 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 --2- 172.21.15.17:0/142625773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35140acfc0 0x7f3514150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.835+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 >> 172.21.15.17:0/142625773 conn(0x7f35140cb1b0 msgr2=0x7f35140cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.836+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 shutdown_connections 2023-08-09T12:44:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:02.836+0000 7f351a6cc640 1 -- 172.21.15.17:0/142625773 wait complete. 2023-08-09T12:44:02.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:44:03.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.084+0000 7fa67759e640 1 Processor -- start 2023-08-09T12:44:03.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.084+0000 7fa67759e640 1 -- start start 2023-08-09T12:44:03.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.085+0000 7fa67759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6780b8420 0x7fa6780cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.085+0000 7fa67759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa67815cf20 0x7fa6780cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.085+0000 7fa67759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6780d0f00 con 0x7fa67815cb40 2023-08-09T12:44:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.085+0000 7fa67759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6781611f0 con 0x7fa6780b8420 2023-08-09T12:44:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.085+0000 7fa67759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6781614d0 con 0x7fa67815cf20 2023-08-09T12:44:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.086+0000 7fa67659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa67815cb40 0x7fa6781609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53662/0 (socket says 172.21.15.17:53662) 2023-08-09T12:44:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.086+0000 7fa67659c640 1 -- 172.21.15.17:0/3705978547 learned_addr learned my addr 172.21.15.17:0/3705978547 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.086+0000 7fa675d9b640 1 --2- 172.21.15.17:0/3705978547 >> v2:172.21.15.142:3300/0 conn(0x7fa6780b8420 0x7fa6780cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.086+0000 7fa676d9d640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa67815cf20 0x7fa6780cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.086+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613061310 0 0) 0x7fa6780d0f00 con 0x7fa67815cb40 2023-08-09T12:44:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.086+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa660003520 con 0x7fa67815cb40 2023-08-09T12:44:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3496550394 0 0) 0x7fa660003520 con 0x7fa67815cb40 2023-08-09T12:44:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa67815cf20 msgr2=0x7fa6780cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa67815cf20 0x7fa6780cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 >> v2:172.21.15.142:3300/0 conn(0x7fa6780b8420 msgr2=0x7fa6780cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 --2- 172.21.15.17:0/3705978547 >> v2:172.21.15.142:3300/0 conn(0x7fa6780b8420 0x7fa6780cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6781617b0 con 0x7fa67815cb40 2023-08-09T12:44:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa668001670 con 0x7fa67815cb40 2023-08-09T12:44:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 >> v1:172.21.15.17:6789/0 conn(0x7fa67815cb40 legacy=0x7fa6781609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa660003970 0x7fa660003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa660004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa67815cf20 0x7fa660005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6781611f0 con 0x7fa6600047c0 2023-08-09T12:44:03.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6781614d0 con 0x7fa660003970 2023-08-09T12:44:03.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66000b9b0 con 0x7fa67815cf20 2023-08-09T12:44:03.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.087+0000 7fa675d9b640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa660004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.088+0000 7fa675d9b640 1 -- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa67815cf20 msgr2=0x7fa660005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.088+0000 7fa67659c640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa660003970 0x7fa660003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.088+0000 7fa675d9b640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa67815cf20 0x7fa660005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.088+0000 7fa675d9b640 1 -- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa660003970 msgr2=0x7fa660003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.088+0000 7fa675d9b640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa660003970 0x7fa660003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.088+0000 7fa675d9b640 1 -- 172.21.15.17:0/3705978547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa660003520 con 0x7fa6600047c0 2023-08-09T12:44:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.088+0000 7fa67659c640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa660003970 0x7fa660003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.089+0000 7fa675d9b640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa660004c40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009ac0 tx=0x7fa6600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46eaabdf95ca5c72 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.089+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c02c710 con 0x7fa6600047c0 2023-08-09T12:44:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.089+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c02c870 con 0x7fa6600047c0 2023-08-09T12:44:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.089+0000 7fa67559a640 1 -- 172.21.15.17:0/3705978547 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c02cc00 con 0x7fa6600047c0 2023-08-09T12:44:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.090+0000 7fa67759e640 1 -- 172.21.15.17:0/3705978547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 msgr2=0x7fa660004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.090+0000 7fa67759e640 1 --2- 172.21.15.17:0/3705978547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa660004c40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009ac0 tx=0x7fa6600057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.090+0000 7fa676d9d640 1 -- 172.21.15.17:0/3705978547 reap_dead start 2023-08-09T12:44:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.090+0000 7fa67759e640 1 -- 172.21.15.17:0/3705978547 shutdown_connections 2023-08-09T12:44:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.090+0000 7fa67759e640 1 -- 172.21.15.17:0/3705978547 >> 172.21.15.17:0/3705978547 conn(0x7fa6780d2ab0 msgr2=0x7fa6780d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.090+0000 7fa67759e640 1 -- 172.21.15.17:0/3705978547 shutdown_connections 2023-08-09T12:44:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.090+0000 7fa67759e640 1 -- 172.21.15.17:0/3705978547 wait complete. 2023-08-09T12:44:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.092+0000 7fa67759e640 1 Processor -- start 2023-08-09T12:44:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.092+0000 7fa67759e640 1 -- start start 2023-08-09T12:44:03.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa6780cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6780b6ff0 0x7fa6780b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6781f1df0 0x7fa6781f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6780cca40 con 0x7fa6600047c0 2023-08-09T12:44:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6780b79b0 con 0x7fa6781f1df0 2023-08-09T12:44:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6780cb080 con 0x7fa6780b6ff0 2023-08-09T12:44:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa6780cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa6780cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59492/0 (socket says 172.21.15.17:59492) 2023-08-09T12:44:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.093+0000 7fa67659c640 1 -- 172.21.15.17:0/67419836 learned_addr learned my addr 172.21.15.17:0/67419836 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa676d9d640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6781f1df0 0x7fa6781f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa67659c640 1 -- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6780b6ff0 msgr2=0x7fa6780b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa675d9b640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6780b6ff0 0x7fa6780b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa67659c640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6780b6ff0 0x7fa6780b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa67659c640 1 -- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6781f1df0 msgr2=0x7fa6781f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa67659c640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6781f1df0 0x7fa6781f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa67659c640 1 -- 172.21.15.17:0/67419836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6780cbec0 con 0x7fa6600047c0 2023-08-09T12:44:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa676d9d640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6781f1df0 0x7fa6781f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa67659c640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa6780cab40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa66800d8e0 tx=0x7fa66800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa666ffd640 1 -- 172.21.15.17:0/67419836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680074e0 con 0x7fa6600047c0 2023-08-09T12:44:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa666ffd640 1 -- 172.21.15.17:0/67419836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa668007640 con 0x7fa6600047c0 2023-08-09T12:44:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6780cb2b0 con 0x7fa6600047c0 2023-08-09T12:44:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.094+0000 7fa666ffd640 1 -- 172.21.15.17:0/67419836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680049e0 con 0x7fa6600047c0 2023-08-09T12:44:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.095+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6780cb870 con 0x7fa6600047c0 2023-08-09T12:44:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.096+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67804e390 con 0x7fa6600047c0 2023-08-09T12:44:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.097+0000 7fa666ffd640 1 -- 172.21.15.17:0/67419836 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa668004b40 con 0x7fa6600047c0 2023-08-09T12:44:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.098+0000 7fa666ffd640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa65806a080 0x7fa65806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.098+0000 7fa666ffd640 1 -- 172.21.15.17:0/67419836 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fa668088180 con 0x7fa6600047c0 2023-08-09T12:44:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.099+0000 7fa666ffd640 1 -- 172.21.15.17:0/67419836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fa6580723b0 con 0x7fa6600047c0 2023-08-09T12:44:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.099+0000 7fa675d9b640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa65806a080 0x7fa65806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.100+0000 7fa675d9b640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa65806a080 0x7fa65806c540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa66c036000 tx=0x7fa66c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.103+0000 7fa666ffd640 1 -- 172.21.15.17:0/67419836 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa668053740 con 0x7fa6600047c0 2023-08-09T12:44:03.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.287+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa678156950 con 0x7fa6600047c0 2023-08-09T12:44:03.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.288+0000 7fa666ffd640 1 -- 172.21.15.17:0/67419836 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa668019070 con 0x7fa6600047c0 2023-08-09T12:44:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:44:03.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.290+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa65806a080 msgr2=0x7fa65806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.290+0000 7fa67759e640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa65806a080 0x7fa65806c540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa66c036000 tx=0x7fa66c030000 comp rx=0 tx=0).stop 2023-08-09T12:44:03.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.290+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 msgr2=0x7fa6780cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.290+0000 7fa67759e640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa6780cab40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa66800d8e0 tx=0x7fa66800dda0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.291+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 shutdown_connections 2023-08-09T12:44:03.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.291+0000 7fa67759e640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa65806a080 0x7fa65806c540 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.291+0000 7fa67759e640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6781f1df0 0x7fa6781f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.291+0000 7fa67759e640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6780b6ff0 0x7fa6780b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.291+0000 7fa67759e640 1 --2- 172.21.15.17:0/67419836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6600047c0 0x7fa6780cab40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.291+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 >> 172.21.15.17:0/67419836 conn(0x7fa6780d2ab0 msgr2=0x7fa678156240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:03.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.291+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 shutdown_connections 2023-08-09T12:44:03.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.291+0000 7fa67759e640 1 -- 172.21.15.17:0/67419836 wait complete. 2023-08-09T12:44:03.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:44:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.534+0000 7fbbee337640 1 Processor -- start 2023-08-09T12:44:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.535+0000 7fbbee337640 1 -- start start 2023-08-09T12:44:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.536+0000 7fbbee337640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbe8159650 0x7fbbe80b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.536+0000 7fbbee337640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbbe8159a30 0x7fbbe80b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.536+0000 7fbbee337640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe80c9a80 con 0x7fbbe80c8c30 2023-08-09T12:44:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.536+0000 7fbbee337640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe80ca010 con 0x7fbbe8159a30 2023-08-09T12:44:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.536+0000 7fbbee337640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe80ca2f0 con 0x7fbbe8159650 2023-08-09T12:44:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbecb34640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbbe8159a30 0x7fbbe80b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbecb34640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbbe8159a30 0x7fbbe80b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59508/0 (socket says 172.21.15.17:59508) 2023-08-09T12:44:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbecb34640 1 -- 172.21.15.17:0/4026385679 learned_addr learned my addr 172.21.15.17:0/4026385679 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbed335640 1 --2- 172.21.15.17:0/4026385679 >> v2:172.21.15.142:3300/0 conn(0x7fbbe8159650 0x7fbbe80b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbecb34640 1 -- 172.21.15.17:0/4026385679 >> v2:172.21.15.142:3300/0 conn(0x7fbbe8159650 msgr2=0x7fbbe80b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbecb34640 1 --2- 172.21.15.17:0/4026385679 >> v2:172.21.15.142:3300/0 conn(0x7fbbe8159650 0x7fbbe80b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbecb34640 1 -- 172.21.15.17:0/4026385679 >> v1:172.21.15.142:6789/0 conn(0x7fbbe80c8c30 legacy=0x7fbbe80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbecb34640 1 -- 172.21.15.17:0/4026385679 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe80ca5d0 con 0x7fbbe8159a30 2023-08-09T12:44:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.537+0000 7fbbed335640 1 --2- 172.21.15.17:0/4026385679 >> v2:172.21.15.142:3300/0 conn(0x7fbbe8159650 0x7fbbe80b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.538+0000 7fbbecb34640 1 --2- 172.21.15.17:0/4026385679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159a30 0x7fbbe80b3860 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806aa80 tx=0x7fbbd802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1319e037c62c8e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.539+0000 7fbbdffff640 1 -- 172.21.15.17:0/4026385679 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8031860 con 0x7fbbe8159a30 2023-08-09T12:44:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.539+0000 7fbbdffff640 1 -- 172.21.15.17:0/4026385679 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd80319c0 con 0x7fbbe8159a30 2023-08-09T12:44:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.539+0000 7fbbdffff640 1 -- 172.21.15.17:0/4026385679 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8031d50 con 0x7fbbe8159a30 2023-08-09T12:44:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.539+0000 7fbbee337640 1 -- 172.21.15.17:0/4026385679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159a30 msgr2=0x7fbbe80b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.539+0000 7fbbee337640 1 --2- 172.21.15.17:0/4026385679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159a30 0x7fbbe80b3860 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806aa80 tx=0x7fbbd802b900 comp rx=0 tx=0).stop 2023-08-09T12:44:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.540+0000 7fbbee337640 1 -- 172.21.15.17:0/4026385679 shutdown_connections 2023-08-09T12:44:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.540+0000 7fbbee337640 1 --2- 172.21.15.17:0/4026385679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159a30 0x7fbbe80b3860 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.540+0000 7fbbee337640 1 --2- 172.21.15.17:0/4026385679 >> v2:172.21.15.142:3300/0 conn(0x7fbbe8159650 0x7fbbe80b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.540+0000 7fbbee337640 1 -- 172.21.15.17:0/4026385679 >> 172.21.15.17:0/4026385679 conn(0x7fbbe806abd0 msgr2=0x7fbbe806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.540+0000 7fbbee337640 1 -- 172.21.15.17:0/4026385679 shutdown_connections 2023-08-09T12:44:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.540+0000 7fbbee337640 1 -- 172.21.15.17:0/4026385679 wait complete. 2023-08-09T12:44:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.542+0000 7fbbee337640 1 Processor -- start 2023-08-09T12:44:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.542+0000 7fbbee337640 1 -- start start 2023-08-09T12:44:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.543+0000 7fbbee337640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbe80c8c30 0x7fbbe80c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.543+0000 7fbbee337640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159650 0x7fbbe8149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.543+0000 7fbbee337640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbe8149e50 0x7fbbe8151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.543+0000 7fbbee337640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe8154650 con 0x7fbbe8159650 2023-08-09T12:44:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.543+0000 7fbbee337640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe814ac00 con 0x7fbbe8149e50 2023-08-09T12:44:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.543+0000 7fbbee337640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe814a360 con 0x7fbbe80c8c30 2023-08-09T12:44:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbecb34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159650 0x7fbbe8149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbecb34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159650 0x7fbbe8149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59510/0 (socket says 172.21.15.17:59510) 2023-08-09T12:44:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbecb34640 1 -- 172.21.15.17:0/2614389671 learned_addr learned my addr 172.21.15.17:0/2614389671 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbedb36640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbe8149e50 0x7fbbe8151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbed335640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbe80c8c30 0x7fbbe80c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbecb34640 1 -- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbe80c8c30 msgr2=0x7fbbe80c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbecb34640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbe80c8c30 0x7fbbe80c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbecb34640 1 -- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbe8149e50 msgr2=0x7fbbe8151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbecb34640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbe8149e50 0x7fbbe8151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.544+0000 7fbbecb34640 1 -- 172.21.15.17:0/2614389671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80094d0 con 0x7fbbe8159650 2023-08-09T12:44:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.545+0000 7fbbecb34640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159650 0x7fbbe8149910 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8000c00 tx=0x7fbbd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.545+0000 7fbbddffb640 1 -- 172.21.15.17:0/2614389671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8031810 con 0x7fbbe8159650 2023-08-09T12:44:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.545+0000 7fbbddffb640 1 -- 172.21.15.17:0/2614389671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd80443f0 con 0x7fbbe8159650 2023-08-09T12:44:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.545+0000 7fbbddffb640 1 -- 172.21.15.17:0/2614389671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80447a0 con 0x7fbbe8159650 2023-08-09T12:44:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.545+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe814a640 con 0x7fbbe8159650 2023-08-09T12:44:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.545+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe814b030 con 0x7fbbe8159650 2023-08-09T12:44:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.546+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe80ad570 con 0x7fbbe8159650 2023-08-09T12:44:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.548+0000 7fbbddffb640 1 -- 172.21.15.17:0/2614389671 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbbd804d450 con 0x7fbbe8159650 2023-08-09T12:44:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.549+0000 7fbbddffb640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbcc06a080 0x7fbbcc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.549+0000 7fbbddffb640 1 -- 172.21.15.17:0/2614389671 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fbbd80aad30 con 0x7fbbe8159650 2023-08-09T12:44:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.549+0000 7fbbddffb640 1 -- 172.21.15.17:0/2614389671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fbbcc0723b0 con 0x7fbbe8159650 2023-08-09T12:44:03.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.549+0000 7fbbed335640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbcc06a080 0x7fbbcc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.551+0000 7fbbed335640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbcc06a080 0x7fbbcc06c540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400a990 tx=0x7fbbe4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.553+0000 7fbbddffb640 1 -- 172.21.15.17:0/2614389671 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbbd8035070 con 0x7fbbe8159650 2023-08-09T12:44:03.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.744+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbe8154420 con 0x7fbbe8159650 2023-08-09T12:44:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.745+0000 7fbbddffb640 1 -- 172.21.15.17:0/2614389671 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbe8154420 con 0x7fbbe8159650 2023-08-09T12:44:03.748 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:44:03.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.747+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbcc06a080 msgr2=0x7fbbcc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.747+0000 7fbbee337640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbcc06a080 0x7fbbcc06c540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400a990 tx=0x7fbbe4008040 comp rx=0 tx=0).stop 2023-08-09T12:44:03.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.747+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159650 msgr2=0x7fbbe8149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.747+0000 7fbbee337640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159650 0x7fbbe8149910 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8000c00 tx=0x7fbbd80046c0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.748+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 shutdown_connections 2023-08-09T12:44:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.748+0000 7fbbee337640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbcc06a080 0x7fbbcc06c540 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.748+0000 7fbbee337640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbe8149e50 0x7fbbe8151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.748+0000 7fbbee337640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8159650 0x7fbbe8149910 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.748+0000 7fbbee337640 1 --2- 172.21.15.17:0/2614389671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbe80c8c30 0x7fbbe80c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:03.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.748+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 >> 172.21.15.17:0/2614389671 conn(0x7fbbe806abd0 msgr2=0x7fbbe80cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.748+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 shutdown_connections 2023-08-09T12:44:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.748+0000 7fbbee337640 1 -- 172.21.15.17:0/2614389671 wait complete. 2023-08-09T12:44:03.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:44:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.991+0000 7f4d9af62640 1 Processor -- start 2023-08-09T12:44:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.991+0000 7f4d9af62640 1 -- start start 2023-08-09T12:44:03.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.992+0000 7f4d9af62640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4d940d26d0 0x7f4d94167b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:03.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.992+0000 7f4d9af62640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d940d0f00 con 0x7f4d9415cb40 2023-08-09T12:44:03.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.993+0000 7f4d9af62640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d941611f0 con 0x7f4d940b8420 2023-08-09T12:44:03.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.993+0000 7f4d9af62640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d941614d0 con 0x7f4d940d26d0 2023-08-09T12:44:03.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.993+0000 7f4d99f60640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4d9415cb40 0x7f4d941609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53674/0 (socket says 172.21.15.17:53674) 2023-08-09T12:44:03.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.993+0000 7f4d99f60640 1 -- 172.21.15.17:0/1456114920 learned_addr learned my addr 172.21.15.17:0/1456114920 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:03.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.993+0000 7f4d9a761640 1 --2- 172.21.15.17:0/1456114920 >> v2:172.21.15.17:3300/0 conn(0x7f4d940d26d0 0x7f4d94167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:03.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.994+0000 7f4d98f5e640 1 -- 172.21.15.17:0/1456114920 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999647076 0 0) 0x7f4d940d0f00 con 0x7f4d9415cb40 2023-08-09T12:44:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.994+0000 7f4d98f5e640 1 -- 172.21.15.17:0/1456114920 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d7c003520 con 0x7f4d9415cb40 2023-08-09T12:44:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.994+0000 7f4d9a761640 1 -- 172.21.15.17:0/1456114920 >> v1:172.21.15.142:6789/0 conn(0x7f4d940b8420 legacy=0x7f4d940cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.994+0000 7f4d9a761640 1 -- 172.21.15.17:0/1456114920 >> v1:172.21.15.17:6789/0 conn(0x7f4d9415cb40 legacy=0x7f4d941609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.994+0000 7f4d9a761640 1 -- 172.21.15.17:0/1456114920 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d941617b0 con 0x7f4d940d26d0 2023-08-09T12:44:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.995+0000 7f4d9a761640 1 --2- 172.21.15.17:0/1456114920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940d26d0 0x7f4d94167b20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009d90 tx=0x7f4d8c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faefd251c1f6953d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.995+0000 7f4d98f5e640 1 -- 172.21.15.17:0/1456114920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c02cd80 con 0x7f4d940d26d0 2023-08-09T12:44:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.995+0000 7f4d98f5e640 1 -- 172.21.15.17:0/1456114920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c034440 con 0x7f4d940d26d0 2023-08-09T12:44:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.995+0000 7f4d98f5e640 1 -- 172.21.15.17:0/1456114920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0347d0 con 0x7f4d940d26d0 2023-08-09T12:44:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.996+0000 7f4d9af62640 1 -- 172.21.15.17:0/1456114920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940d26d0 msgr2=0x7f4d94167b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.996+0000 7f4d9af62640 1 --2- 172.21.15.17:0/1456114920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940d26d0 0x7f4d94167b20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009d90 tx=0x7f4d8c02bfd0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.996+0000 7f4d9af62640 1 -- 172.21.15.17:0/1456114920 shutdown_connections 2023-08-09T12:44:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.996+0000 7f4d9af62640 1 --2- 172.21.15.17:0/1456114920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940d26d0 0x7f4d94167b20 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.996+0000 7f4d9af62640 1 -- 172.21.15.17:0/1456114920 >> 172.21.15.17:0/1456114920 conn(0x7f4d940d2ab0 msgr2=0x7f4d940d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.996+0000 7f4d9af62640 1 -- 172.21.15.17:0/1456114920 shutdown_connections 2023-08-09T12:44:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.996+0000 7f4d9af62640 1 -- 172.21.15.17:0/1456114920 wait complete. 2023-08-09T12:44:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.998+0000 7f4d9af62640 1 Processor -- start 2023-08-09T12:44:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.998+0000 7f4d9af62640 1 -- start start 2023-08-09T12:44:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.999+0000 7f4d9af62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940b8420 0x7f4d94158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.999+0000 7f4d9af62640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d940d26d0 0x7f4d940cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.999+0000 7f4d9af62640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d9415cb40 0x7f4d941549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.999+0000 7f4d9af62640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d941f2cc0 con 0x7f4d940b8420 2023-08-09T12:44:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.999+0000 7f4d9af62640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d94156ce0 con 0x7f4d9415cb40 2023-08-09T12:44:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.999+0000 7f4d9af62640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d94159450 con 0x7f4d940d26d0 2023-08-09T12:44:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:03.999+0000 7f4d99f60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940b8420 0x7f4d94158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d99f60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940b8420 0x7f4d94158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59528/0 (socket says 172.21.15.17:59528) 2023-08-09T12:44:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d99f60640 1 -- 172.21.15.17:0/2030478442 learned_addr learned my addr 172.21.15.17:0/2030478442 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d9a761640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d9415cb40 0x7f4d941549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d99f60640 1 -- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d940d26d0 msgr2=0x7f4d940cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d99f60640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d940d26d0 0x7f4d940cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d99f60640 1 -- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d9415cb40 msgr2=0x7f4d941549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d99f60640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d9415cb40 0x7f4d941549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d99f60640 1 -- 172.21.15.17:0/2030478442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c009a70 con 0x7f4d940b8420 2023-08-09T12:44:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.000+0000 7f4d99f60640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940b8420 0x7f4d94158dc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c410 tx=0x7f4d8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.001+0000 7f4d927fc640 1 -- 172.21.15.17:0/2030478442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84005ce0 con 0x7f4d940b8420 2023-08-09T12:44:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.001+0000 7f4d927fc640 1 -- 172.21.15.17:0/2030478442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d84005e40 con 0x7f4d940b8420 2023-08-09T12:44:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.001+0000 7f4d927fc640 1 -- 172.21.15.17:0/2030478442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d840072f0 con 0x7f4d940b8420 2023-08-09T12:44:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.001+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d94159730 con 0x7f4d940b8420 2023-08-09T12:44:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.001+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d94159a10 con 0x7f4d940b8420 2023-08-09T12:44:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.002+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9404e390 con 0x7f4d940b8420 2023-08-09T12:44:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.003+0000 7f4d927fc640 1 -- 172.21.15.17:0/2030478442 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d84007510 con 0x7f4d940b8420 2023-08-09T12:44:04.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.004+0000 7f4d927fc640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d8006a050 0x7f4d8006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.004+0000 7f4d927fc640 1 -- 172.21.15.17:0/2030478442 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4d84087cf0 con 0x7f4d940b8420 2023-08-09T12:44:04.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.004+0000 7f4d927fc640 1 -- 172.21.15.17:0/2030478442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f4d80072380 con 0x7f4d940b8420 2023-08-09T12:44:04.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.005+0000 7f4d9975f640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d8006a050 0x7f4d8006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.006+0000 7f4d9975f640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d8006a050 0x7f4d8006c510 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d88000f60 tx=0x7f4d880079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:04.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.009+0000 7f4d927fc640 1 -- 172.21.15.17:0/2030478442 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4d84017060 con 0x7f4d940b8420 2023-08-09T12:44:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.196+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d9415bdf0 con 0x7f4d940b8420 2023-08-09T12:44:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.196+0000 7f4d927fc640 1 -- 172.21.15.17:0/2030478442 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d84053400 con 0x7f4d940b8420 2023-08-09T12:44:04.200 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:44:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d8006a050 msgr2=0x7f4d8006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d8006a050 0x7f4d8006c510 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d88000f60 tx=0x7f4d880079b0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940b8420 msgr2=0x7f4d94158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940b8420 0x7f4d94158dc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c410 tx=0x7f4d8400c8d0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 shutdown_connections 2023-08-09T12:44:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d8006a050 0x7f4d8006c510 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d9415cb40 0x7f4d941549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d940d26d0 0x7f4d940cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 --2- 172.21.15.17:0/2030478442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d940b8420 0x7f4d94158dc0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 >> 172.21.15.17:0/2030478442 conn(0x7f4d940d2ab0 msgr2=0x7f4d94156340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 shutdown_connections 2023-08-09T12:44:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.199+0000 7f4d9af62640 1 -- 172.21.15.17:0/2030478442 wait complete. 2023-08-09T12:44:04.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:44:04.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.443+0000 7f1beb5cf640 1 Processor -- start 2023-08-09T12:44:04.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.443+0000 7f1beb5cf640 1 -- start start 2023-08-09T12:44:04.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.444+0000 7f1beb5cf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1be40b3b40 0x7f1be40b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.444+0000 7f1beb5cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1be40cc630 0x7f1be40ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.444+0000 7f1beb5cf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be406c990 con 0x7f1be40adc40 2023-08-09T12:44:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.444+0000 7f1beb5cf640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be40ae020 con 0x7f1be40b3b40 2023-08-09T12:44:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.444+0000 7f1beb5cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be40b2250 con 0x7f1be40cc630 2023-08-09T12:44:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be8b6a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1be40b3b40 0x7f1be40b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be8b6a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1be40b3b40 0x7f1be40b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59538/0 (socket says 172.21.15.17:59538) 2023-08-09T12:44:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be8b6a640 1 -- 172.21.15.17:0/2860192620 learned_addr learned my addr 172.21.15.17:0/2860192620 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be9b6c640 1 --2- 172.21.15.17:0/2860192620 >> v2:172.21.15.142:3300/0 conn(0x7f1be40cc630 0x7f1be40ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be8b6a640 1 -- 172.21.15.17:0/2860192620 >> v2:172.21.15.142:3300/0 conn(0x7f1be40cc630 msgr2=0x7f1be40ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be8b6a640 1 --2- 172.21.15.17:0/2860192620 >> v2:172.21.15.142:3300/0 conn(0x7f1be40cc630 0x7f1be40ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be8b6a640 1 -- 172.21.15.17:0/2860192620 >> v1:172.21.15.142:6789/0 conn(0x7f1be40adc40 legacy=0x7f1be406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be8b6a640 1 -- 172.21.15.17:0/2860192620 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be40b2530 con 0x7f1be40b3b40 2023-08-09T12:44:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.445+0000 7f1be9b6c640 1 --2- 172.21.15.17:0/2860192620 >> v2:172.21.15.142:3300/0 conn(0x7f1be40cc630 0x7f1be40ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:44:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.446+0000 7f1be8b6a640 1 --2- 172.21.15.17:0/2860192620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40b3b40 0x7f1be40b3fd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1be40caff0 tx=0x7f1bd402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf867d49cf27f8a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1bdbfff640 1 -- 172.21.15.17:0/2860192620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4031860 con 0x7f1be40b3b40 2023-08-09T12:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1bdbfff640 1 -- 172.21.15.17:0/2860192620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd40319c0 con 0x7f1be40b3b40 2023-08-09T12:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1bdbfff640 1 -- 172.21.15.17:0/2860192620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4031d50 con 0x7f1be40b3b40 2023-08-09T12:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2860192620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40b3b40 msgr2=0x7f1be40b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2860192620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40b3b40 0x7f1be40b3fd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1be40caff0 tx=0x7f1bd402b900 comp rx=0 tx=0).stop 2023-08-09T12:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2860192620 shutdown_connections 2023-08-09T12:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2860192620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40b3b40 0x7f1be40b3fd0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2860192620 >> v2:172.21.15.142:3300/0 conn(0x7f1be40cc630 0x7f1be40ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2860192620 >> 172.21.15.17:0/2860192620 conn(0x7f1be40cb1b0 msgr2=0x7f1be40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:04.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.447+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2860192620 shutdown_connections 2023-08-09T12:44:04.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.448+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2860192620 wait complete. 2023-08-09T12:44:04.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.449+0000 7f1beb5cf640 1 Processor -- start 2023-08-09T12:44:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.449+0000 7f1beb5cf640 1 -- start start 2023-08-09T12:44:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.450+0000 7f1beb5cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be40adc40 0x7f1be40a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.450+0000 7f1beb5cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be40b3b40 0x7f1be40aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.450+0000 7f1beb5cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40cc630 0x7f1be40ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.450+0000 7f1beb5cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40ad3f0 con 0x7f1be40cc630 2023-08-09T12:44:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.450+0000 7f1beb5cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40a8ba0 con 0x7f1be40b3b40 2023-08-09T12:44:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.450+0000 7f1beb5cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40a8e80 con 0x7f1be40adc40 2023-08-09T12:44:04.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be9b6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40cc630 0x7f1be40ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be9b6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40cc630 0x7f1be40ab100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59544/0 (socket says 172.21.15.17:59544) 2023-08-09T12:44:04.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be9b6c640 1 -- 172.21.15.17:0/2426900615 learned_addr learned my addr 172.21.15.17:0/2426900615 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:04.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be8b6a640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be40b3b40 0x7f1be40aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be936b640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be40adc40 0x7f1be40a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be9b6c640 1 -- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be40adc40 msgr2=0x7f1be40a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be9b6c640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be40adc40 0x7f1be40a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be9b6c640 1 -- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be40b3b40 msgr2=0x7f1be40aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be9b6c640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be40b3b40 0x7f1be40aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be9b6c640 1 -- 172.21.15.17:0/2426900615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4009470 con 0x7f1be40cc630 2023-08-09T12:44:04.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be936b640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be40adc40 0x7f1be40a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:04.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.451+0000 7f1be8b6a640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be40b3b40 0x7f1be40aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:44:04.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.452+0000 7f1be9b6c640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40cc630 0x7f1be40ab100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00d7d0 tx=0x7f1bdc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:04.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.452+0000 7f1bd9ffb640 1 -- 172.21.15.17:0/2426900615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc004030 con 0x7f1be40cc630 2023-08-09T12:44:04.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.452+0000 7f1bd9ffb640 1 -- 172.21.15.17:0/2426900615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc004190 con 0x7f1be40cc630 2023-08-09T12:44:04.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.452+0000 7f1bd9ffb640 1 -- 172.21.15.17:0/2426900615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc004500 con 0x7f1be40cc630 2023-08-09T12:44:04.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.452+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be40a9160 con 0x7f1be40cc630 2023-08-09T12:44:04.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.452+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be40a9720 con 0x7f1be40cc630 2023-08-09T12:44:04.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.453+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be40a9910 con 0x7f1be40cc630 2023-08-09T12:44:04.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.454+0000 7f1bd9ffb640 1 -- 172.21.15.17:0/2426900615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1bdc0096a0 con 0x7f1be40cc630 2023-08-09T12:44:04.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.455+0000 7f1bd9ffb640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc806a050 0x7f1bc806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.455+0000 7f1bd9ffb640 1 -- 172.21.15.17:0/2426900615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f1bdc0888e0 con 0x7f1be40cc630 2023-08-09T12:44:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.456+0000 7f1bd9ffb640 1 -- 172.21.15.17:0/2426900615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f1bc8072380 con 0x7f1be40cc630 2023-08-09T12:44:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.456+0000 7f1be936b640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc806a050 0x7f1bc806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:04.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.458+0000 7f1be936b640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc806a050 0x7f1bc806c510 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1be0004520 tx=0x7f1be0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.460+0000 7f1bd9ffb640 1 -- 172.21.15.17:0/2426900615 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1bdc053ea0 con 0x7f1be40cc630 2023-08-09T12:44:04.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.666+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1be4067a80 con 0x7f1be40cc630 2023-08-09T12:44:04.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.667+0000 7f1bd9ffb640 1 -- 172.21.15.17:0/2426900615 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1bdc0574c0 con 0x7f1be40cc630 2023-08-09T12:44:04.671 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:44:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.670+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc806a050 msgr2=0x7f1bc806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.670+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc806a050 0x7f1bc806c510 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1be0004520 tx=0x7f1be0009040 comp rx=0 tx=0).stop 2023-08-09T12:44:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.670+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40cc630 msgr2=0x7f1be40ab100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:04.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.670+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40cc630 0x7f1be40ab100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00d7d0 tx=0x7f1bdc00dc90 comp rx=0 tx=0).stop 2023-08-09T12:44:04.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.670+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 shutdown_connections 2023-08-09T12:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.670+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1bc806a050 0x7f1bc806c510 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.671+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be40cc630 0x7f1be40ab100 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.671+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be40b3b40 0x7f1be40aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.671+0000 7f1beb5cf640 1 --2- 172.21.15.17:0/2426900615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be40adc40 0x7f1be40a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.671+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 >> 172.21.15.17:0/2426900615 conn(0x7f1be40cb1b0 msgr2=0x7f1be40ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.671+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 shutdown_connections 2023-08-09T12:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:04.671+0000 7f1beb5cf640 1 -- 172.21.15.17:0/2426900615 wait complete. 2023-08-09T12:44:04.694 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:44:04.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:04.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:44:04.775 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:44:04.772+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-08-09T12:44:04.834 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:44:04.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:04.835 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:44:04.884 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:44:04.885 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:04.952 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:44:04.952 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:44:04.953 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:05.011 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:44:05.012 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:44:05.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.234+0000 7fc1291e8640 1 Processor -- start 2023-08-09T12:44:05.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.234+0000 7fc1291e8640 1 -- start start 2023-08-09T12:44:05.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.235+0000 7fc1291e8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc1241616e0 0x7fc1240b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc1291e8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1240cdd10 con 0x7fc12415ce90 2023-08-09T12:44:05.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc1291e8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1240cdff0 con 0x7fc1240d29d0 2023-08-09T12:44:05.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc1291e8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1240b6540 con 0x7fc1241616e0 2023-08-09T12:44:05.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc11a59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc1241616e0 0x7fc1240b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc122d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc12415ce90 0x7fc1240cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53678/0 (socket says 172.21.15.17:53678) 2023-08-09T12:44:05.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc122d9d640 1 -- 172.21.15.17:0/1796886820 learned_addr learned my addr 172.21.15.17:0/1796886820 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:05.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc11a59c640 1 -- 172.21.15.17:0/1796886820 >> v1:172.21.15.142:6789/0 conn(0x7fc1240d29d0 legacy=0x7fc1240d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:05.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc11a59c640 1 -- 172.21.15.17:0/1796886820 >> v1:172.21.15.17:6789/0 conn(0x7fc12415ce90 legacy=0x7fc1240cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.236+0000 7fc11a59c640 1 -- 172.21.15.17:0/1796886820 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1240ce2d0 con 0x7fc1241616e0 2023-08-09T12:44:05.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.238+0000 7fc11a59c640 1 --2- 172.21.15.17:0/1796886820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1241616e0 0x7fc1240b6000 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0097a0 tx=0x7fc10c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ef39c53fba4303 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:05.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.238+0000 7fc12259c640 1 -- 172.21.15.17:0/1796886820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c031830 con 0x7fc1241616e0 2023-08-09T12:44:05.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.238+0000 7fc12259c640 1 -- 172.21.15.17:0/1796886820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c031990 con 0x7fc1241616e0 2023-08-09T12:44:05.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.238+0000 7fc12259c640 1 -- 172.21.15.17:0/1796886820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c031d20 con 0x7fc1241616e0 2023-08-09T12:44:05.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.239+0000 7fc1291e8640 1 -- 172.21.15.17:0/1796886820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1241616e0 msgr2=0x7fc1240b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.239+0000 7fc1291e8640 1 --2- 172.21.15.17:0/1796886820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1241616e0 0x7fc1240b6000 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0097a0 tx=0x7fc10c02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.239+0000 7fc1291e8640 1 -- 172.21.15.17:0/1796886820 shutdown_connections 2023-08-09T12:44:05.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.239+0000 7fc1291e8640 1 --2- 172.21.15.17:0/1796886820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1241616e0 0x7fc1240b6000 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.239+0000 7fc1291e8640 1 -- 172.21.15.17:0/1796886820 >> 172.21.15.17:0/1796886820 conn(0x7fc12406fde0 msgr2=0x7fc1240701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:05.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.239+0000 7fc1291e8640 1 -- 172.21.15.17:0/1796886820 shutdown_connections 2023-08-09T12:44:05.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.239+0000 7fc1291e8640 1 -- 172.21.15.17:0/1796886820 wait complete. 2023-08-09T12:44:05.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.241+0000 7fc1291e8640 1 Processor -- start 2023-08-09T12:44:05.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.241+0000 7fc1291e8640 1 -- start start 2023-08-09T12:44:05.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc1291e8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1240d29d0 0x7fc1240ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc1291e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12415ce90 0x7fc1240b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc1291e8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241616e0 0x7fc12415e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc1291e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240cc5e0 con 0x7fc12415ce90 2023-08-09T12:44:05.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc1291e8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240cb9d0 con 0x7fc1241616e0 2023-08-09T12:44:05.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc1291e8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240cbcb0 con 0x7fc1240d29d0 2023-08-09T12:44:05.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc11a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12415ce90 0x7fc1240b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc11a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12415ce90 0x7fc1240b7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59568/0 (socket says 172.21.15.17:59568) 2023-08-09T12:44:05.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.242+0000 7fc11a59c640 1 -- 172.21.15.17:0/2519638645 learned_addr learned my addr 172.21.15.17:0/2519638645 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:05.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc122d9d640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1240d29d0 0x7fc1240ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc12359e640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241616e0 0x7fc12415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc11a59c640 1 -- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1240d29d0 msgr2=0x7fc1240ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc11a59c640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1240d29d0 0x7fc1240ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc11a59c640 1 -- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241616e0 msgr2=0x7fc12415e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc11a59c640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241616e0 0x7fc12415e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc11a59c640 1 -- 172.21.15.17:0/2519638645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009400 con 0x7fc12415ce90 2023-08-09T12:44:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc122d9d640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1240d29d0 0x7fc1240ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc12359e640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241616e0 0x7fc12415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc11a59c640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12415ce90 0x7fc1240b7a70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0098c0 tx=0x7fc10c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.243+0000 7fc11bfff640 1 -- 172.21.15.17:0/2519638645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c03ba70 con 0x7fc12415ce90 2023-08-09T12:44:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.244+0000 7fc11bfff640 1 -- 172.21.15.17:0/2519638645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c03bbf0 con 0x7fc12415ce90 2023-08-09T12:44:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.244+0000 7fc11bfff640 1 -- 172.21.15.17:0/2519638645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0453f0 con 0x7fc12415ce90 2023-08-09T12:44:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.244+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1240cbf90 con 0x7fc12415ce90 2023-08-09T12:44:05.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.244+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1240caba0 con 0x7fc12415ce90 2023-08-09T12:44:05.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.245+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1240cc750 con 0x7fc12415ce90 2023-08-09T12:44:05.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.246+0000 7fc11bfff640 1 -- 172.21.15.17:0/2519638645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc10c04e450 con 0x7fc12415ce90 2023-08-09T12:44:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.247+0000 7fc11bfff640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc10406a050 0x7fc10406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.247+0000 7fc11bfff640 1 -- 172.21.15.17:0/2519638645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fc10c0aaa40 con 0x7fc12415ce90 2023-08-09T12:44:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.247+0000 7fc11bfff640 1 -- 172.21.15.17:0/2519638645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7fc104072380 con 0x7fc12415ce90 2023-08-09T12:44:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.248+0000 7fc122d9d640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc10406a050 0x7fc10406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.249+0000 7fc122d9d640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc10406a050 0x7fc10406c510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc114005c00 tx=0x7fc114009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:05.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.253+0000 7fc11bfff640 1 -- 172.21.15.17:0/2519638645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc10c075f70 con 0x7fc12415ce90 2023-08-09T12:44:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.487+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc124067a80 con 0x7fc12415ce90 2023-08-09T12:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.489+0000 7fc11bfff640 1 -- 172.21.15.17:0/2519638645 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4879 (secure 0 0 0) 0x7fc10c079590 con 0x7fc12415ce90 2023-08-09T12:44:05.492 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:05.492 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2314028117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2314028117},{"type":"v1","addr":"172.21.15.142:6837","nonce":2314028117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3413359063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3413359063},{"type":"v1","addr":"172.21.15.142:6835","nonce":3413359063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/295901720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":295901720},{"type":"v1","addr":"172.21.15.17:6834","nonce":295901720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:42:36.710411+0000","modified":"2023-08-09T12:42:40.710471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1591311172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1591311172},{"type":"v1","addr":"172.21.15.17:6835","nonce":1591311172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-09T12:44:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2023-08-09T12:44:05.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc10406a050 msgr2=0x7fc10406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc10406a050 0x7fc10406c510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc114005c00 tx=0x7fc114009040 comp rx=0 tx=0).stop 2023-08-09T12:44:05.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12415ce90 msgr2=0x7fc1240b7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12415ce90 0x7fc1240b7a70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0098c0 tx=0x7fc10c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 shutdown_connections 2023-08-09T12:44:05.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc10406a050 0x7fc10406c510 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241616e0 0x7fc12415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12415ce90 0x7fc1240b7a70 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 --2- 172.21.15.17:0/2519638645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1240d29d0 0x7fc1240ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 >> 172.21.15.17:0/2519638645 conn(0x7fc12406fde0 msgr2=0x7fc1240b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:05.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 shutdown_connections 2023-08-09T12:44:05.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.491+0000 7fc1291e8640 1 -- 172.21.15.17:0/2519638645 wait complete. 2023-08-09T12:44:05.512 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:05.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.744+0000 7ff4e7f71640 1 Processor -- start 2023-08-09T12:44:05.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.746+0000 7ff4e7f71640 1 -- start start 2023-08-09T12:44:05.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.746+0000 7ff4e7f71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e0159d80 0x7ff4e00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.746+0000 7ff4e7f71640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff4e0070a90 0x7ff4e00c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e7f71640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e00b4630 con 0x7ff4e00ad810 2023-08-09T12:44:05.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e7f71640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e015a160 con 0x7ff4e0070a90 2023-08-09T12:44:05.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e7f71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e00b3ab0 con 0x7ff4e0159d80 2023-08-09T12:44:05.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e550c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff4e00ad810 0x7ff4e0070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53682/0 (socket says 172.21.15.17:53682) 2023-08-09T12:44:05.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e550c640 1 -- 172.21.15.17:0/2480037468 learned_addr learned my addr 172.21.15.17:0/2480037468 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:05.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e650e640 1 --2- 172.21.15.17:0/2480037468 >> v2:172.21.15.17:3300/0 conn(0x7ff4e0070a90 0x7ff4e00c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e5d0d640 1 --2- 172.21.15.17:0/2480037468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e0159d80 0x7ff4e00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e4d0b640 1 -- 172.21.15.17:0/2480037468 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186062986 0 0) 0x7ff4e00b4630 con 0x7ff4e00ad810 2023-08-09T12:44:05.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e4d0b640 1 -- 172.21.15.17:0/2480037468 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4cc003520 con 0x7ff4e00ad810 2023-08-09T12:44:05.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.747+0000 7ff4e650e640 1 -- 172.21.15.17:0/2480037468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e0159d80 msgr2=0x7ff4e00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:05.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.748+0000 7ff4e650e640 1 --2- 172.21.15.17:0/2480037468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e0159d80 0x7ff4e00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.748+0000 7ff4e650e640 1 -- 172.21.15.17:0/2480037468 >> v1:172.21.15.17:6789/0 conn(0x7ff4e00ad810 legacy=0x7ff4e0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.748+0000 7ff4e650e640 1 -- 172.21.15.17:0/2480037468 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e00b3d90 con 0x7ff4e0070a90 2023-08-09T12:44:05.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.749+0000 7ff4e650e640 1 --2- 172.21.15.17:0/2480037468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e00c8fd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009d90 tx=0x7ff4d802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1619723068ca2bd7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:05.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.749+0000 7ff4e4d0b640 1 -- 172.21.15.17:0/2480037468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d802cc50 con 0x7ff4e0070a90 2023-08-09T12:44:05.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.749+0000 7ff4e4d0b640 1 -- 172.21.15.17:0/2480037468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d802cdb0 con 0x7ff4e0070a90 2023-08-09T12:44:05.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.749+0000 7ff4e4d0b640 1 -- 172.21.15.17:0/2480037468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8034660 con 0x7ff4e0070a90 2023-08-09T12:44:05.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.750+0000 7ff4e7f71640 1 -- 172.21.15.17:0/2480037468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 msgr2=0x7ff4e00c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.750+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/2480037468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e00c8fd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009d90 tx=0x7ff4d802bea0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.750+0000 7ff4e7f71640 1 -- 172.21.15.17:0/2480037468 shutdown_connections 2023-08-09T12:44:05.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.750+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/2480037468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e00c8fd0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.750+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/2480037468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e0159d80 0x7ff4e00b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.750+0000 7ff4e7f71640 1 -- 172.21.15.17:0/2480037468 >> 172.21.15.17:0/2480037468 conn(0x7ff4e00cb1b0 msgr2=0x7ff4e00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:05.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.750+0000 7ff4e7f71640 1 -- 172.21.15.17:0/2480037468 shutdown_connections 2023-08-09T12:44:05.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.750+0000 7ff4e7f71640 1 -- 172.21.15.17:0/2480037468 wait complete. 2023-08-09T12:44:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.753+0000 7ff4e7f71640 1 Processor -- start 2023-08-09T12:44:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.753+0000 7ff4e7f71640 1 -- start start 2023-08-09T12:44:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e7f71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e01424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e7f71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e00ad810 0x7ff4e00c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e7f71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e0159d80 0x7ff4e00c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e7f71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0144bf0 con 0x7ff4e0070a90 2023-08-09T12:44:05.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e7f71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0144e90 con 0x7ff4e0159d80 2023-08-09T12:44:05.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e7f71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0145170 con 0x7ff4e00ad810 2023-08-09T12:44:05.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e01424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e01424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59592/0 (socket says 172.21.15.17:59592) 2023-08-09T12:44:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 -- 172.21.15.17:0/1186879353 learned_addr learned my addr 172.21.15.17:0/1186879353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e550c640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e00ad810 0x7ff4e00c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e650e640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e0159d80 0x7ff4e00c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 -- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e00ad810 msgr2=0x7ff4e00c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e00ad810 0x7ff4e00c14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 -- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e0159d80 msgr2=0x7ff4e00c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e0159d80 0x7ff4e00c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 -- 172.21.15.17:0/1186879353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8009a70 con 0x7ff4e0070a90 2023-08-09T12:44:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e5d0d640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e01424d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00e870 tx=0x7ff4dc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0094f0 con 0x7ff4e0070a90 2023-08-09T12:44:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc00c940 con 0x7ff4e0070a90 2023-08-09T12:44:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00ccf0 con 0x7ff4e0070a90 2023-08-09T12:44:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e0145450 con 0x7ff4e0070a90 2023-08-09T12:44:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.754+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e0143430 con 0x7ff4e0070a90 2023-08-09T12:44:05.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.755+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e00cc630 con 0x7ff4e0070a90 2023-08-09T12:44:05.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.756+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff4dc013470 con 0x7ff4e0070a90 2023-08-09T12:44:05.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.757+0000 7ff4d67fc640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff4c406a050 0x7ff4c406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:05.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.757+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff4dc0887a0 con 0x7ff4e0070a90 2023-08-09T12:44:05.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.758+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7ff4c4072380 con 0x7ff4e0070a90 2023-08-09T12:44:05.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.758+0000 7ff4e550c640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff4c406a050 0x7ff4c406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:05.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.760+0000 7ff4e550c640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff4c406a050 0x7ff4c406c510 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00cb970 tx=0x7ff4d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:05.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.762+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff4dc086e60 con 0x7ff4e0070a90 2023-08-09T12:44:05.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.788+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(78..78 src has 1..78) v4 ==== 441+0+0 (secure 0 0 0) 0x7ff4dc0580b0 con 0x7ff4e0070a90 2023-08-09T12:44:05.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.788+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7ff4c4072d10 con 0x7ff4e0070a90 2023-08-09T12:44:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.966+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4e0067a80 con 0x7ff4e0070a90 2023-08-09T12:44:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.970+0000 7ff4d67fc640 1 -- 172.21.15.17:0/1186879353 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18543 (secure 0 0 0) 0x7ff4dc021070 con 0x7ff4e0070a90 2023-08-09T12:44:05.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:05.973 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":78,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:05.783444+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:42:35.097822+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-09T12:42:35.735356+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.17","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff4c406a050 msgr2=0x7ff4c406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff4c406a050 0x7ff4c406c510 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00cb970 tx=0x7ff4d0009040 comp rx=0 tx=0).stop 2023-08-09T12:44:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 msgr2=0x7ff4e01424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e01424d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00e870 tx=0x7ff4dc00ed30 comp rx=0 tx=0).stop 2023-08-09T12:44:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 shutdown_connections 2023-08-09T12:44:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff4c406a050 0x7ff4c406c510 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4e0159d80 0x7ff4e00c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4e00ad810 0x7ff4e00c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 --2- 172.21.15.17:0/1186879353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e0070a90 0x7ff4e01424d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 >> 172.21.15.17:0/1186879353 conn(0x7ff4e00cb1b0 msgr2=0x7ff4e00cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:05.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 shutdown_connections 2023-08-09T12:44:05.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:05.973+0000 7ff4e7f71640 1 -- 172.21.15.17:0/1186879353 wait complete. 2023-08-09T12:44:05.995 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:42:35.097822+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:42:35.735356+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:44:05.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:44:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.227+0000 7f1652ea9640 1 Processor -- start 2023-08-09T12:44:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.227+0000 7f1652ea9640 1 -- start start 2023-08-09T12:44:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.228+0000 7f1652ea9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f164c0b3b40 0x7f164c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.228+0000 7f1652ea9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f164c0cc630 0x7f164c0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.228+0000 7f1652ea9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c06c990 con 0x7f164c0adc40 2023-08-09T12:44:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.228+0000 7f1652ea9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0ae020 con 0x7f164c0cc630 2023-08-09T12:44:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.229+0000 7f1652ea9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0b2250 con 0x7f164c0b3b40 2023-08-09T12:44:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.229+0000 7f1651446640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f164c0cc630 0x7f164c0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.229+0000 7f1651446640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f164c0cc630 0x7f164c0ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59594/0 (socket says 172.21.15.17:59594) 2023-08-09T12:44:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.229+0000 7f1651446640 1 -- 172.21.15.17:0/3872356159 learned_addr learned my addr 172.21.15.17:0/3872356159 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.229+0000 7f1643fff640 1 --2- 172.21.15.17:0/3872356159 >> v2:172.21.15.142:3300/0 conn(0x7f164c0b3b40 0x7f164c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.230+0000 7f1651446640 1 -- 172.21.15.17:0/3872356159 >> v2:172.21.15.142:3300/0 conn(0x7f164c0b3b40 msgr2=0x7f164c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.230+0000 7f1651446640 1 --2- 172.21.15.17:0/3872356159 >> v2:172.21.15.142:3300/0 conn(0x7f164c0b3b40 0x7f164c0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.230+0000 7f1651446640 1 -- 172.21.15.17:0/3872356159 >> v1:172.21.15.142:6789/0 conn(0x7f164c0adc40 legacy=0x7f164c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.230+0000 7f1651446640 1 -- 172.21.15.17:0/3872356159 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0b2530 con 0x7f164c0cc630 2023-08-09T12:44:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.231+0000 7f1651446640 1 --2- 172.21.15.17:0/3872356159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ccaa0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f164c0b48a0 tx=0x7f164402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c30c8e01d21d60 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.231+0000 7f16437fe640 1 -- 172.21.15.17:0/3872356159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164402cb10 con 0x7f164c0cc630 2023-08-09T12:44:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.231+0000 7f16437fe640 1 -- 172.21.15.17:0/3872356159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164402cc70 con 0x7f164c0cc630 2023-08-09T12:44:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.231+0000 7f16437fe640 1 -- 172.21.15.17:0/3872356159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440343f0 con 0x7f164c0cc630 2023-08-09T12:44:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.232+0000 7f1652ea9640 1 -- 172.21.15.17:0/3872356159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 msgr2=0x7f164c0ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.232+0000 7f1652ea9640 1 --2- 172.21.15.17:0/3872356159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ccaa0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f164c0b48a0 tx=0x7f164402bf70 comp rx=0 tx=0).stop 2023-08-09T12:44:06.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.232+0000 7f1652ea9640 1 -- 172.21.15.17:0/3872356159 shutdown_connections 2023-08-09T12:44:06.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.232+0000 7f1652ea9640 1 --2- 172.21.15.17:0/3872356159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ccaa0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.232+0000 7f1652ea9640 1 --2- 172.21.15.17:0/3872356159 >> v2:172.21.15.142:3300/0 conn(0x7f164c0b3b40 0x7f164c0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.232+0000 7f1652ea9640 1 -- 172.21.15.17:0/3872356159 >> 172.21.15.17:0/3872356159 conn(0x7f164c0cb1b0 msgr2=0x7f164c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:06.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.232+0000 7f1652ea9640 1 -- 172.21.15.17:0/3872356159 shutdown_connections 2023-08-09T12:44:06.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.232+0000 7f1652ea9640 1 -- 172.21.15.17:0/3872356159 wait complete. 2023-08-09T12:44:06.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.234+0000 7f1652ea9640 1 Processor -- start 2023-08-09T12:44:06.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.234+0000 7f1652ea9640 1 -- start start 2023-08-09T12:44:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.235+0000 7f1652ea9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0adc40 0x7f164c159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.235+0000 7f1652ea9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0b3b40 0x7f164c15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.235+0000 7f1652ea9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.235+0000 7f1652ea9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c06a810 con 0x7f164c0cc630 2023-08-09T12:44:06.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.235+0000 7f1652ea9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1f49d0 con 0x7f164c0adc40 2023-08-09T12:44:06.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.235+0000 7f1652ea9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c15a9e0 con 0x7f164c0b3b40 2023-08-09T12:44:06.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.235+0000 7f1651446640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1651446640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59598/0 (socket says 172.21.15.17:59598) 2023-08-09T12:44:06.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1651446640 1 -- 172.21.15.17:0/2330945676 learned_addr learned my addr 172.21.15.17:0/2330945676 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:06.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1650c45640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0adc40 0x7f164c159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1643fff640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0b3b40 0x7f164c15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1651446640 1 -- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0b3b40 msgr2=0x7f164c15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1651446640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0b3b40 0x7f164c15a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1651446640 1 -- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0adc40 msgr2=0x7f164c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1651446640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0adc40 0x7f164c159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1651446640 1 -- 172.21.15.17:0/2330945676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009b30 con 0x7f164c0cc630 2023-08-09T12:44:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.236+0000 7f1651446640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ae160 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1644036040 tx=0x7f1644004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.237+0000 7f16417fa640 1 -- 172.21.15.17:0/2330945676 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644009510 con 0x7f164c0cc630 2023-08-09T12:44:06.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.237+0000 7f16417fa640 1 -- 172.21.15.17:0/2330945676 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164403e450 con 0x7f164c0cc630 2023-08-09T12:44:06.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.237+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c06aa60 con 0x7f164c0cc630 2023-08-09T12:44:06.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.237+0000 7f16417fa640 1 -- 172.21.15.17:0/2330945676 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164403e800 con 0x7f164c0cc630 2023-08-09T12:44:06.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.237+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c06b020 con 0x7f164c0cc630 2023-08-09T12:44:06.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.238+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c06b240 con 0x7f164c0cc630 2023-08-09T12:44:06.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.239+0000 7f16417fa640 1 -- 172.21.15.17:0/2330945676 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f164403e960 con 0x7f164c0cc630 2023-08-09T12:44:06.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.240+0000 7f16417fa640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f163806a080 0x7f163806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.240+0000 7f16417fa640 1 -- 172.21.15.17:0/2330945676 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f16440ab430 con 0x7f164c0cc630 2023-08-09T12:44:06.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.240+0000 7f16417fa640 1 -- 172.21.15.17:0/2330945676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f16380723b0 con 0x7f164c0cc630 2023-08-09T12:44:06.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.241+0000 7f1650c45640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f163806a080 0x7f163806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.242+0000 7f1650c45640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f163806a080 0x7f163806c540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1648000f60 tx=0x7f1648009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.244+0000 7f16417fa640 1 -- 172.21.15.17:0/2330945676 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f16440769f0 con 0x7f164c0cc630 2023-08-09T12:44:06.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.437+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f164c067a80 con 0x7f164c0cc630 2023-08-09T12:44:06.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.438+0000 7f16417fa640 1 -- 172.21.15.17:0/2330945676 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1644043070 con 0x7f164c0cc630 2023-08-09T12:44:06.441 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:44:06.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f163806a080 msgr2=0x7f163806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f163806a080 0x7f163806c540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1648000f60 tx=0x7f1648009040 comp rx=0 tx=0).stop 2023-08-09T12:44:06.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 msgr2=0x7f164c0ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ae160 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1644036040 tx=0x7f1644004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:06.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 shutdown_connections 2023-08-09T12:44:06.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f163806a080 0x7f163806c540 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f164c0cc630 0x7f164c0ae160 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0b3b40 0x7f164c15a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 --2- 172.21.15.17:0/2330945676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0adc40 0x7f164c159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 >> 172.21.15.17:0/2330945676 conn(0x7f164c0cb1b0 msgr2=0x7f164c0c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:06.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 shutdown_connections 2023-08-09T12:44:06.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.441+0000 7f1652ea9640 1 -- 172.21.15.17:0/2330945676 wait complete. 2023-08-09T12:44:06.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:44:06.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.682+0000 7f4113786640 1 Processor -- start 2023-08-09T12:44:06.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.682+0000 7f4113786640 1 -- start start 2023-08-09T12:44:06.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.683+0000 7f4113786640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f410c0d30e0 0x7f410c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.683+0000 7f4113786640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0cdd10 con 0x7f410c1616e0 2023-08-09T12:44:06.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.683+0000 7f4113786640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0cdff0 con 0x7f410c15ce90 2023-08-09T12:44:06.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.683+0000 7f4113786640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c0b6540 con 0x7f410c0d30e0 2023-08-09T12:44:06.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.684+0000 7f4110d21640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f410c1616e0 0x7f410c0d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53698/0 (socket says 172.21.15.17:53698) 2023-08-09T12:44:06.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.684+0000 7f4110d21640 1 -- 172.21.15.17:0/22044542 learned_addr learned my addr 172.21.15.17:0/22044542 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:06.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.684+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916778086 0 0) 0x7f410c0cdd10 con 0x7f410c1616e0 2023-08-09T12:44:06.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.684+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f8003520 con 0x7f410c1616e0 2023-08-09T12:44:06.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.684+0000 7f4111d23640 1 --2- 172.21.15.17:0/22044542 >> v2:172.21.15.142:3300/0 conn(0x7f410c0d30e0 0x7f410c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1387611880 0 0) 0x7f40f8003520 con 0x7f410c1616e0 2023-08-09T12:44:06.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 >> v2:172.21.15.142:3300/0 conn(0x7f410c0d30e0 msgr2=0x7f410c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:06.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 --2- 172.21.15.17:0/22044542 >> v2:172.21.15.142:3300/0 conn(0x7f410c0d30e0 0x7f410c0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 >> v1:172.21.15.142:6789/0 conn(0x7f410c15ce90 legacy=0x7f410c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0ce2d0 con 0x7f410c1616e0 2023-08-09T12:44:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f40fc001670 con 0x7f410c1616e0 2023-08-09T12:44:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 >> v1:172.21.15.17:6789/0 conn(0x7f410c1616e0 legacy=0x7f410c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8003970 0x7f40f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40f80047c0 0x7f40f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f8005180 0x7f40f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0b6540 con 0x7f40f8003970 2023-08-09T12:44:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f800c0d0 con 0x7f40f8005180 2023-08-09T12:44:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f800c290 con 0x7f40f80047c0 2023-08-09T12:44:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.685+0000 7f4111522640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8003970 0x7f40f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.686+0000 7f4111d23640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f8005180 0x7f40f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.686+0000 7f4111522640 1 -- 172.21.15.17:0/22044542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40f80047c0 msgr2=0x7f40f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.686+0000 7f4111522640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40f80047c0 0x7f40f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.686+0000 7f4111522640 1 -- 172.21.15.17:0/22044542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f8005180 msgr2=0x7f40f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.686+0000 7f4111522640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f8005180 0x7f40f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.686+0000 7f4111522640 1 -- 172.21.15.17:0/22044542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8003520 con 0x7f40f8003970 2023-08-09T12:44:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.686+0000 7f4111d23640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f8005180 0x7f40f800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.686+0000 7f4111d23640 1 -- 172.21.15.17:0/22044542 reap_dead start 2023-08-09T12:44:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.687+0000 7f4111522640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8003970 0x7f40f8003d90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4108001e50 tx=0x7f40f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ef59c4be20180c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.687+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108003b70 con 0x7f40f8003970 2023-08-09T12:44:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.687+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4108003cd0 con 0x7f40f8003970 2023-08-09T12:44:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.687+0000 7f4103fff640 1 -- 172.21.15.17:0/22044542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108005310 con 0x7f40f8003970 2023-08-09T12:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.688+0000 7f4113786640 1 -- 172.21.15.17:0/22044542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8003970 msgr2=0x7f40f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.688+0000 7f4113786640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8003970 0x7f40f8003d90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4108001e50 tx=0x7f40f80057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.688+0000 7f4113786640 1 -- 172.21.15.17:0/22044542 shutdown_connections 2023-08-09T12:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.688+0000 7f4113786640 1 --2- 172.21.15.17:0/22044542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8003970 0x7f40f8003d90 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.688+0000 7f4113786640 1 -- 172.21.15.17:0/22044542 >> 172.21.15.17:0/22044542 conn(0x7f410c06fde0 msgr2=0x7f410c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.688+0000 7f4113786640 1 -- 172.21.15.17:0/22044542 shutdown_connections 2023-08-09T12:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.688+0000 7f4113786640 1 -- 172.21.15.17:0/22044542 wait complete. 2023-08-09T12:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.690+0000 7f4113786640 1 Processor -- start 2023-08-09T12:44:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.690+0000 7f4113786640 1 -- start start 2023-08-09T12:44:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4113786640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40f8003970 0x7f410c156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4113786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f410c156900 0x7f410c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4113786640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0caca0 0x7f410c0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4113786640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c156770 con 0x7f410c0caca0 2023-08-09T12:44:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4113786640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0cb660 con 0x7f410c156900 2023-08-09T12:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4113786640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1572a0 con 0x7f40f8003970 2023-08-09T12:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4111d23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0caca0 0x7f410c0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4111d23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0caca0 0x7f410c0cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59614/0 (socket says 172.21.15.17:59614) 2023-08-09T12:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4111d23640 1 -- 172.21.15.17:0/988065909 learned_addr learned my addr 172.21.15.17:0/988065909 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4111d23640 1 -- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40f8003970 msgr2=0x7f410c156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4111d23640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40f8003970 0x7f410c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4111d23640 1 -- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f410c156900 msgr2=0x7f410c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4111d23640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f410c156900 0x7f410c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.691+0000 7f4111d23640 1 -- 172.21.15.17:0/988065909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0cc490 con 0x7f410c0caca0 2023-08-09T12:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.692+0000 7f4111d23640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0caca0 0x7f410c0cb120 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f410c0cd180 tx=0x7f410400e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.692+0000 7f4101ffb640 1 -- 172.21.15.17:0/988065909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040042f0 con 0x7f410c0caca0 2023-08-09T12:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.692+0000 7f4101ffb640 1 -- 172.21.15.17:0/988065909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4104004470 con 0x7f410c0caca0 2023-08-09T12:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.692+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c0b3fb0 con 0x7f410c0caca0 2023-08-09T12:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.692+0000 7f4101ffb640 1 -- 172.21.15.17:0/988065909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104003850 con 0x7f410c0caca0 2023-08-09T12:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.692+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c0cbb60 con 0x7f410c0caca0 2023-08-09T12:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.694+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c067a80 con 0x7f410c0caca0 2023-08-09T12:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.694+0000 7f4101ffb640 1 -- 172.21.15.17:0/988065909 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f41040039b0 con 0x7f410c0caca0 2023-08-09T12:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.695+0000 7f4101ffb640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40f006a050 0x7f40f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.696+0000 7f4101ffb640 1 -- 172.21.15.17:0/988065909 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4104087ad0 con 0x7f410c0caca0 2023-08-09T12:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.696+0000 7f4101ffb640 1 -- 172.21.15.17:0/988065909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f40f0072380 con 0x7f410c0caca0 2023-08-09T12:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.696+0000 7f4111522640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40f006a050 0x7f40f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.697+0000 7f4111522640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40f006a050 0x7f40f006c510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4108034000 tx=0x7f4108030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.699+0000 7f4101ffb640 1 -- 172.21.15.17:0/988065909 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4104053000 con 0x7f410c0caca0 2023-08-09T12:44:06.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.897+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f410c0ccc80 con 0x7f410c0caca0 2023-08-09T12:44:06.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.898+0000 7f4101ffb640 1 -- 172.21.15.17:0/988065909 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7f410400c070 con 0x7f410c0caca0 2023-08-09T12:44:06.901 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:44:06.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40f006a050 msgr2=0x7f40f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40f006a050 0x7f40f006c510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4108034000 tx=0x7f4108030000 comp rx=0 tx=0).stop 2023-08-09T12:44:06.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0caca0 msgr2=0x7f410c0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:06.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0caca0 0x7f410c0cb120 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f410c0cd180 tx=0x7f410400e8b0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 shutdown_connections 2023-08-09T12:44:06.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40f006a050 0x7f40f006c510 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0caca0 0x7f410c0cb120 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f410c156900 0x7f410c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 --2- 172.21.15.17:0/988065909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40f8003970 0x7f410c156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 >> 172.21.15.17:0/988065909 conn(0x7f410c06fde0 msgr2=0x7f410c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 shutdown_connections 2023-08-09T12:44:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:06.901+0000 7f4113786640 1 -- 172.21.15.17:0/988065909 wait complete. 2023-08-09T12:44:06.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:44:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.145+0000 7fa06583d640 1 Processor -- start 2023-08-09T12:44:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.145+0000 7fa06583d640 1 -- start start 2023-08-09T12:44:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.146+0000 7fa06583d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa06015cef0 0x7fa0600b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.146+0000 7fa06583d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa06015d2d0 0x7fa0600ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.146+0000 7fa06583d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0601616b0 0x7fa0600cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.146+0000 7fa06583d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600cdee0 con 0x7fa06015d2d0 2023-08-09T12:44:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.146+0000 7fa06583d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600b2010 con 0x7fa0601616b0 2023-08-09T12:44:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.146+0000 7fa06583d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600b1d30 con 0x7fa06015cef0 2023-08-09T12:44:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05e7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa06015d2d0 0x7fa0600ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05e7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa06015d2d0 0x7fa0600ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59620/0 (socket says 172.21.15.17:59620) 2023-08-09T12:44:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05e7fc640 1 -- 172.21.15.17:0/2599223580 learned_addr learned my addr 172.21.15.17:0/2599223580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05f7fe640 1 --2- 172.21.15.17:0/2599223580 >> v2:172.21.15.142:3300/0 conn(0x7fa0601616b0 0x7fa0600cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05effd640 1 --2- 172.21.15.17:0/2599223580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa06015cef0 0x7fa0600b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05e7fc640 1 -- 172.21.15.17:0/2599223580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa06015cef0 msgr2=0x7fa0600b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05e7fc640 1 --2- 172.21.15.17:0/2599223580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa06015cef0 0x7fa0600b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05e7fc640 1 -- 172.21.15.17:0/2599223580 >> v2:172.21.15.142:3300/0 conn(0x7fa0601616b0 msgr2=0x7fa0600cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05e7fc640 1 --2- 172.21.15.17:0/2599223580 >> v2:172.21.15.142:3300/0 conn(0x7fa0601616b0 0x7fa0600cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.147+0000 7fa05e7fc640 1 -- 172.21.15.17:0/2599223580 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600cd820 con 0x7fa06015d2d0 2023-08-09T12:44:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.148+0000 7fa05e7fc640 1 --2- 172.21.15.17:0/2599223580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600ce300 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa0600b2680 tx=0x7fa04802b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62adad2b660541b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa05dffb640 1 -- 172.21.15.17:0/2599223580 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048031760 con 0x7fa06015d2d0 2023-08-09T12:44:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa05dffb640 1 -- 172.21.15.17:0/2599223580 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0480318c0 con 0x7fa06015d2d0 2023-08-09T12:44:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa05dffb640 1 -- 172.21.15.17:0/2599223580 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048031c50 con 0x7fa06015d2d0 2023-08-09T12:44:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa06583d640 1 -- 172.21.15.17:0/2599223580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 msgr2=0x7fa0600ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa06583d640 1 --2- 172.21.15.17:0/2599223580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600ce300 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa0600b2680 tx=0x7fa04802b800 comp rx=0 tx=0).stop 2023-08-09T12:44:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa06583d640 1 -- 172.21.15.17:0/2599223580 shutdown_connections 2023-08-09T12:44:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa06583d640 1 --2- 172.21.15.17:0/2599223580 >> v2:172.21.15.142:3300/0 conn(0x7fa0601616b0 0x7fa0600cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa06583d640 1 --2- 172.21.15.17:0/2599223580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600ce300 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa06583d640 1 --2- 172.21.15.17:0/2599223580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa06015cef0 0x7fa0600b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.149+0000 7fa06583d640 1 -- 172.21.15.17:0/2599223580 >> 172.21.15.17:0/2599223580 conn(0x7fa06006fde0 msgr2=0x7fa0600701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.150+0000 7fa06583d640 1 -- 172.21.15.17:0/2599223580 shutdown_connections 2023-08-09T12:44:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.150+0000 7fa06583d640 1 -- 172.21.15.17:0/2599223580 wait complete. 2023-08-09T12:44:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.151+0000 7fa06583d640 1 Processor -- start 2023-08-09T12:44:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.152+0000 7fa06583d640 1 -- start start 2023-08-09T12:44:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa06583d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa06015cef0 0x7fa060160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa06583d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa06583d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0601616b0 0x7fa0600d1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa06583d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601605b0 con 0x7fa06015d2d0 2023-08-09T12:44:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa06583d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c7540 con 0x7fa06015cef0 2023-08-09T12:44:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa06583d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c8ce0 con 0x7fa0601616b0 2023-08-09T12:44:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa05e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa05e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59628/0 (socket says 172.21.15.17:59628) 2023-08-09T12:44:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa05e7fc640 1 -- 172.21.15.17:0/2912013075 learned_addr learned my addr 172.21.15.17:0/2912013075 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa05effd640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa06015cef0 0x7fa060160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa05f7fe640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0601616b0 0x7fa0600d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa05e7fc640 1 -- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0601616b0 msgr2=0x7fa0600d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.153+0000 7fa05e7fc640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0601616b0 0x7fa0600d1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa05e7fc640 1 -- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa06015cef0 msgr2=0x7fa060160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa05e7fc640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa06015cef0 0x7fa060160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa05e7fc640 1 -- 172.21.15.17:0/2912013075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480094d0 con 0x7fa06015d2d0 2023-08-09T12:44:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa05e7fc640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600c7000 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa048000c00 tx=0x7fa0480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa057fff640 1 -- 172.21.15.17:0/2912013075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04803b800 con 0x7fa06015d2d0 2023-08-09T12:44:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa057fff640 1 -- 172.21.15.17:0/2912013075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04803b980 con 0x7fa06015d2d0 2023-08-09T12:44:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa057fff640 1 -- 172.21.15.17:0/2912013075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04803bd30 con 0x7fa06015d2d0 2023-08-09T12:44:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600c8fc0 con 0x7fa06015d2d0 2023-08-09T12:44:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.154+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0600c9580 con 0x7fa06015d2d0 2023-08-09T12:44:07.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.156+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa060067a80 con 0x7fa06015d2d0 2023-08-09T12:44:07.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.157+0000 7fa057fff640 1 -- 172.21.15.17:0/2912013075 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0480453f0 con 0x7fa06015d2d0 2023-08-09T12:44:07.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.158+0000 7fa057fff640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa04006a050 0x7fa04006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.158+0000 7fa057fff640 1 -- 172.21.15.17:0/2912013075 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fa04802f050 con 0x7fa06015d2d0 2023-08-09T12:44:07.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.158+0000 7fa057fff640 1 -- 172.21.15.17:0/2912013075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fa040072380 con 0x7fa06015d2d0 2023-08-09T12:44:07.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.159+0000 7fa05effd640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa04006a050 0x7fa04006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.160+0000 7fa05effd640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa04006a050 0x7fa04006c510 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa058004410 tx=0x7fa0580039f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.162+0000 7fa057fff640 1 -- 172.21.15.17:0/2912013075 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa048075b50 con 0x7fa06015d2d0 2023-08-09T12:44:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.356+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0600d0ae0 con 0x7fa06015d2d0 2023-08-09T12:44:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.357+0000 7fa057fff640 1 -- 172.21.15.17:0/2912013075 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa048079170 con 0x7fa06015d2d0 2023-08-09T12:44:07.359 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:44:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa04006a050 msgr2=0x7fa04006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa04006a050 0x7fa04006c510 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa058004410 tx=0x7fa0580039f0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 msgr2=0x7fa0600c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600c7000 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa048000c00 tx=0x7fa0480046c0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 shutdown_connections 2023-08-09T12:44:07.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa04006a050 0x7fa04006c510 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0601616b0 0x7fa0600d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa06015d2d0 0x7fa0600c7000 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 --2- 172.21.15.17:0/2912013075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa06015cef0 0x7fa060160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.359+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 >> 172.21.15.17:0/2912013075 conn(0x7fa06006fde0 msgr2=0x7fa0600cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.360+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 shutdown_connections 2023-08-09T12:44:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.360+0000 7fa06583d640 1 -- 172.21.15.17:0/2912013075 wait complete. 2023-08-09T12:44:07.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:44:07.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.619+0000 7f2811f55640 1 Processor -- start 2023-08-09T12:44:07.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.620+0000 7f2811f55640 1 -- start start 2023-08-09T12:44:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.621+0000 7f2811f55640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f280c0cdb00 0x7f280c0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.621+0000 7f2811f55640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c157580 con 0x7f280c160640 2023-08-09T12:44:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.621+0000 7f2811f55640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c160b90 con 0x7f280c0b0020 2023-08-09T12:44:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.621+0000 7f2811f55640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c15d1c0 con 0x7f280c0cdb00 2023-08-09T12:44:07.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.622+0000 7f2811754640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f280c160640 0x7f280c15d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53706/0 (socket says 172.21.15.17:53706) 2023-08-09T12:44:07.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.622+0000 7f2811754640 1 -- 172.21.15.17:0/334757176 learned_addr learned my addr 172.21.15.17:0/334757176 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:07.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.622+0000 7f280bfff640 1 --2- 172.21.15.17:0/334757176 >> v2:172.21.15.142:3300/0 conn(0x7f280c0cdb00 0x7f280c0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.622+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164289956 0 0) 0x7f280c157580 con 0x7f280c160640 2023-08-09T12:44:07.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.622+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27fc003520 con 0x7f280c160640 2023-08-09T12:44:07.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2514061798 0 0) 0x7f27fc003520 con 0x7f280c160640 2023-08-09T12:44:07.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 >> v2:172.21.15.142:3300/0 conn(0x7f280c0cdb00 msgr2=0x7f280c0acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:07.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 --2- 172.21.15.17:0/334757176 >> v2:172.21.15.142:3300/0 conn(0x7f280c0cdb00 0x7f280c0acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 >> v1:172.21.15.142:6789/0 conn(0x7f280c0b0020 legacy=0x7f280c0b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c160e70 con 0x7f280c160640 2023-08-09T12:44:07.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f28040019f0 con 0x7f280c160640 2023-08-09T12:44:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 >> v1:172.21.15.17:6789/0 conn(0x7f280c160640 legacy=0x7f280c15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27fc0047c0 0x7f27fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc005180 0x7f27fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15d1c0 con 0x7f27fc003970 2023-08-09T12:44:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc00c020 con 0x7f27fc005180 2023-08-09T12:44:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc00c1e0 con 0x7f27fc0047c0 2023-08-09T12:44:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.623+0000 7f2810f53640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.624+0000 7f280bfff640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27fc0047c0 0x7f27fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.624+0000 7f2811754640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc005180 0x7f27fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.624+0000 7f2810f53640 1 -- 172.21.15.17:0/334757176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27fc0047c0 msgr2=0x7f27fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.624+0000 7f2810f53640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27fc0047c0 0x7f27fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.624+0000 7f2810f53640 1 -- 172.21.15.17:0/334757176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc005180 msgr2=0x7f27fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.624+0000 7f2810f53640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc005180 0x7f27fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.624+0000 7f2810f53640 1 -- 172.21.15.17:0/334757176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc003520 con 0x7f27fc003970 2023-08-09T12:44:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.624+0000 7f2811754640 1 -- 172.21.15.17:0/334757176 reap_dead start 2023-08-09T12:44:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.625+0000 7f2810f53640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2800001750 tx=0x7f27fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b3d36e7730758e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.625+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000052d0 con 0x7f27fc003970 2023-08-09T12:44:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.625+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280002e050 con 0x7f27fc003970 2023-08-09T12:44:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.625+0000 7f280b7fe640 1 -- 172.21.15.17:0/334757176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800003830 con 0x7f27fc003970 2023-08-09T12:44:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.626+0000 7f2811f55640 1 -- 172.21.15.17:0/334757176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 msgr2=0x7f27fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.626+0000 7f2811f55640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2800001750 tx=0x7f27fc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.626+0000 7f2811f55640 1 -- 172.21.15.17:0/334757176 shutdown_connections 2023-08-09T12:44:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.626+0000 7f2811f55640 1 --2- 172.21.15.17:0/334757176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.626+0000 7f2811f55640 1 -- 172.21.15.17:0/334757176 >> 172.21.15.17:0/334757176 conn(0x7f280c0cb020 msgr2=0x7f280c0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.626+0000 7f2811f55640 1 -- 172.21.15.17:0/334757176 shutdown_connections 2023-08-09T12:44:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.626+0000 7f2811f55640 1 -- 172.21.15.17:0/334757176 wait complete. 2023-08-09T12:44:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.628+0000 7f2811f55640 1 Processor -- start 2023-08-09T12:44:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.628+0000 7f2811f55640 1 -- start start 2023-08-09T12:44:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.629+0000 7f2811f55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f280c1f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.629+0000 7f2811f55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ad1a0 0x7f280c0c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.629+0000 7f2811f55640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c06ff00 0x7f280c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.629+0000 7f2811f55640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0b11c0 con 0x7f27fc003970 2023-08-09T12:44:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.629+0000 7f2811f55640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0c3dc0 con 0x7f280c06ff00 2023-08-09T12:44:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.629+0000 7f2811f55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0b13d0 con 0x7f280c0ad1a0 2023-08-09T12:44:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.629+0000 7f2810f53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f280c1f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.629+0000 7f2810f53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f280c1f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59638/0 (socket says 172.21.15.17:59638) 2023-08-09T12:44:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f2810f53640 1 -- 172.21.15.17:0/2256045037 learned_addr learned my addr 172.21.15.17:0/2256045037 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f280bfff640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ad1a0 0x7f280c0c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f2810f53640 1 -- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ad1a0 msgr2=0x7f280c0c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f2810f53640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ad1a0 0x7f280c0c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f2810f53640 1 -- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c06ff00 msgr2=0x7f280c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f2810f53640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c06ff00 0x7f280c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f2810f53640 1 -- 172.21.15.17:0/2256045037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0b16b0 con 0x7f27fc003970 2023-08-09T12:44:07.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f280bfff640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ad1a0 0x7f280c0c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:07.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.630+0000 7f2810f53640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f280c1f1c90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f280002bc00 tx=0x7f2800001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:07.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.631+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800007a30 con 0x7f27fc003970 2023-08-09T12:44:07.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.631+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800007640 con 0x7f27fc003970 2023-08-09T12:44:07.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.631+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c0b1990 con 0x7f27fc003970 2023-08-09T12:44:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.631+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800006c00 con 0x7f27fc003970 2023-08-09T12:44:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.631+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c15f180 con 0x7f27fc003970 2023-08-09T12:44:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.632+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c04e390 con 0x7f27fc003970 2023-08-09T12:44:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.633+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f28000035f0 con 0x7f27fc003970 2023-08-09T12:44:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.634+0000 7f28097fa640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27f006a080 0x7f27f006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.635+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f28000aa190 con 0x7f27fc003970 2023-08-09T12:44:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.635+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f27f00723b0 con 0x7f27fc003970 2023-08-09T12:44:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.635+0000 7f280bfff640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27f006a080 0x7f27f006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.636+0000 7f280bfff640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27f006a080 0x7f27f006c540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f280c0c4e20 tx=0x7f27f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.639+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2800079270 con 0x7f27fc003970 2023-08-09T12:44:07.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.796+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(79..79 src has 1..79) v4 ==== 441+0+0 (secure 0 0 0) 0x7f2800079b30 con 0x7f27fc003970 2023-08-09T12:44:07.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.796+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7f27f0072ce0 con 0x7f27fc003970 2023-08-09T12:44:07.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.834+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f280c0b4520 con 0x7f27fc003970 2023-08-09T12:44:07.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.835+0000 7f28097fa640 1 -- 172.21.15.17:0/2256045037 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2800041060 con 0x7f27fc003970 2023-08-09T12:44:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:44:07.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27f006a080 msgr2=0x7f27f006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27f006a080 0x7f27f006c540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f280c0c4e20 tx=0x7f27f8008040 comp rx=0 tx=0).stop 2023-08-09T12:44:07.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 msgr2=0x7f280c1f1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:07.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f280c1f1c90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f280002bc00 tx=0x7f2800001120 comp rx=0 tx=0).stop 2023-08-09T12:44:07.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 shutdown_connections 2023-08-09T12:44:07.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27f006a080 0x7f27f006c540 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c06ff00 0x7f280c15ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ad1a0 0x7f280c0c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 --2- 172.21.15.17:0/2256045037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27fc003970 0x7f280c1f1c90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:07.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 >> 172.21.15.17:0/2256045037 conn(0x7f280c0cb020 msgr2=0x7f280c0ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:07.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.837+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 shutdown_connections 2023-08-09T12:44:07.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:07.838+0000 7f2811f55640 1 -- 172.21.15.17:0/2256045037 wait complete. 2023-08-09T12:44:07.858 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:44:08.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.081+0000 7f74b27fc640 1 Processor -- start 2023-08-09T12:44:08.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.082+0000 7f74b27fc640 1 -- start start 2023-08-09T12:44:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.083+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac160030 0x7f74ac160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.083+0000 7f74b27fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74ac0cfb50 0x7f74ac0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.083+0000 7f74b27fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0b5a30 con 0x7f74ac0b86e0 2023-08-09T12:44:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.083+0000 7f74b27fc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ac0d1110 con 0x7f74ac0cfb50 2023-08-09T12:44:08.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.083+0000 7f74b27fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0ceac0 con 0x7f74ac160030 2023-08-09T12:44:08.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.083+0000 7f74b1ffb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74ac0cfb50 0x7f74ac0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.083+0000 7f74b1ffb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74ac0cfb50 0x7f74ac0d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58284/0 (socket says 172.21.15.17:58284) 2023-08-09T12:44:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.083+0000 7f74b1ffb640 1 -- 172.21.15.17:0/3753670190 learned_addr learned my addr 172.21.15.17:0/3753670190 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.084+0000 7f74b17fa640 1 --2- 172.21.15.17:0/3753670190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac160030 0x7f74ac160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.084+0000 7f74b1ffb640 1 -- 172.21.15.17:0/3753670190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac160030 msgr2=0x7f74ac160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.084+0000 7f74b1ffb640 1 --2- 172.21.15.17:0/3753670190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac160030 0x7f74ac160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.084+0000 7f74b1ffb640 1 -- 172.21.15.17:0/3753670190 >> v1:172.21.15.142:6789/0 conn(0x7f74ac0b86e0 legacy=0x7f74ac0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.084+0000 7f74b1ffb640 1 -- 172.21.15.17:0/3753670190 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0d0d70 con 0x7f74ac0cfb50 2023-08-09T12:44:08.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.085+0000 7f74b1ffb640 1 --2- 172.21.15.17:0/3753670190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0cfb50 0x7f74ac0d1530 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009e50 tx=0x7f74a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cdd3e8aaf037de server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.085+0000 7f74a3fff640 1 -- 172.21.15.17:0/3753670190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a402ca70 con 0x7f74ac0cfb50 2023-08-09T12:44:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.085+0000 7f74a3fff640 1 -- 172.21.15.17:0/3753670190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a402cbd0 con 0x7f74ac0cfb50 2023-08-09T12:44:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74a3fff640 1 -- 172.21.15.17:0/3753670190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40343f0 con 0x7f74ac0cfb50 2023-08-09T12:44:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74b27fc640 1 -- 172.21.15.17:0/3753670190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0cfb50 msgr2=0x7f74ac0d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74b27fc640 1 --2- 172.21.15.17:0/3753670190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0cfb50 0x7f74ac0d1530 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009e50 tx=0x7f74a402bed0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74b27fc640 1 -- 172.21.15.17:0/3753670190 shutdown_connections 2023-08-09T12:44:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74b27fc640 1 --2- 172.21.15.17:0/3753670190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0cfb50 0x7f74ac0d1530 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74b27fc640 1 --2- 172.21.15.17:0/3753670190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac160030 0x7f74ac160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74b27fc640 1 -- 172.21.15.17:0/3753670190 >> 172.21.15.17:0/3753670190 conn(0x7f74ac0697c0 msgr2=0x7f74ac069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:08.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74b27fc640 1 -- 172.21.15.17:0/3753670190 shutdown_connections 2023-08-09T12:44:08.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.086+0000 7f74b27fc640 1 -- 172.21.15.17:0/3753670190 wait complete. 2023-08-09T12:44:08.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.088+0000 7f74b27fc640 1 Processor -- start 2023-08-09T12:44:08.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.088+0000 7f74b27fc640 1 -- start start 2023-08-09T12:44:08.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.089+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0b86e0 0x7f74ac0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.089+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac0cfb50 0x7f74ac15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.089+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ac160030 0x7f74ac148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.089+0000 7f74b27fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0cb770 con 0x7f74ac0b86e0 2023-08-09T12:44:08.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.089+0000 7f74b27fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0cba50 con 0x7f74ac160030 2023-08-09T12:44:08.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.089+0000 7f74b27fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0cbd30 con 0x7f74ac0cfb50 2023-08-09T12:44:08.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0b86e0 0x7f74ac0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0b86e0 0x7f74ac0cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58300/0 (socket says 172.21.15.17:58300) 2023-08-09T12:44:08.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 -- 172.21.15.17:0/2136234618 learned_addr learned my addr 172.21.15.17:0/2136234618 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b0ff9640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac0cfb50 0x7f74ac15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 -- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac0cfb50 msgr2=0x7f74ac15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac0cfb50 0x7f74ac15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 -- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ac160030 msgr2=0x7f74ac148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ac160030 0x7f74ac148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 -- 172.21.15.17:0/2136234618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4009b30 con 0x7f74ac0b86e0 2023-08-09T12:44:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b0ff9640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac0cfb50 0x7f74ac15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.090+0000 7f74b17fa640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0b86e0 0x7f74ac0cae90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f74a800d5f0 tx=0x7f74a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.091+0000 7f74a1ffb640 1 -- 172.21.15.17:0/2136234618 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80125f0 con 0x7f74ac0b86e0 2023-08-09T12:44:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.091+0000 7f74a1ffb640 1 -- 172.21.15.17:0/2136234618 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8012750 con 0x7f74ac0b86e0 2023-08-09T12:44:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.091+0000 7f74a1ffb640 1 -- 172.21.15.17:0/2136234618 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8012b00 con 0x7f74ac0b86e0 2023-08-09T12:44:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.091+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac0cc010 con 0x7f74ac0b86e0 2023-08-09T12:44:08.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.091+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ac0cb3d0 con 0x7f74ac0b86e0 2023-08-09T12:44:08.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.092+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ac04e390 con 0x7f74ac0b86e0 2023-08-09T12:44:08.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.093+0000 7f74a1ffb640 1 -- 172.21.15.17:0/2136234618 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f74a8012c60 con 0x7f74ac0b86e0 2023-08-09T12:44:08.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.094+0000 7f74a1ffb640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f749006a050 0x7f749006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.094+0000 7f74a1ffb640 1 -- 172.21.15.17:0/2136234618 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f74a8088ab0 con 0x7f74ac0b86e0 2023-08-09T12:44:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.094+0000 7f74a1ffb640 1 -- 172.21.15.17:0/2136234618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7f7490072380 con 0x7f74ac0b86e0 2023-08-09T12:44:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.095+0000 7f74b0ff9640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f749006a050 0x7f749006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.096+0000 7f74b0ff9640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f749006a050 0x7f749006c510 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f74ac154560 tx=0x7f749c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:08.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.098+0000 7f74a1ffb640 1 -- 172.21.15.17:0/2136234618 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f74a8088030 con 0x7f74ac0b86e0 2023-08-09T12:44:08.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.328+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74ac0d0640 con 0x7f74ac0b86e0 2023-08-09T12:44:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.330+0000 7f74a1ffb640 1 -- 172.21.15.17:0/2136234618 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f74a8088030 con 0x7f74ac0b86e0 2023-08-09T12:44:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:08.332 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2314028117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2314028117},{"type":"v1","addr":"172.21.15.142:6837","nonce":2314028117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3413359063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3413359063},{"type":"v1","addr":"172.21.15.142:6835","nonce":3413359063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/295901720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":295901720},{"type":"v1","addr":"172.21.15.17:6834","nonce":295901720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:42:36.710411+0000","modified":"2023-08-09T12:42:40.710471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1591311172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1591311172},{"type":"v1","addr":"172.21.15.17:6835","nonce":1591311172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-09T12:44:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2023-08-09T12:44:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f749006a050 msgr2=0x7f749006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f749006a050 0x7f749006c510 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f74ac154560 tx=0x7f749c009040 comp rx=0 tx=0).stop 2023-08-09T12:44:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0b86e0 msgr2=0x7f74ac0cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0b86e0 0x7f74ac0cae90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f74a800d5f0 tx=0x7f74a800dab0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 shutdown_connections 2023-08-09T12:44:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f749006a050 0x7f749006c510 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ac160030 0x7f74ac148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74ac0cfb50 0x7f74ac15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 --2- 172.21.15.17:0/2136234618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74ac0b86e0 0x7f74ac0cae90 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 >> 172.21.15.17:0/2136234618 conn(0x7f74ac0697c0 msgr2=0x7f74ac0c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 shutdown_connections 2023-08-09T12:44:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.332+0000 7f74b27fc640 1 -- 172.21.15.17:0/2136234618 wait complete. 2023-08-09T12:44:08.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.580+0000 7f22b0d0f640 1 Processor -- start 2023-08-09T12:44:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.580+0000 7f22b0d0f640 1 -- start start 2023-08-09T12:44:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22b0d0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 0x7f22ac1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22b0d0f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f22ac0b6000 0x7f22ac0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22b0d0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0b6460 con 0x7f22ac0d29d0 2023-08-09T12:44:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22b0d0f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0cda40 con 0x7f22ac0b6000 2023-08-09T12:44:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22b0d0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0cdd10 con 0x7f22ac15ce90 2023-08-09T12:44:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22a3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f22ac0b6000 0x7f22ac0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22a3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f22ac0b6000 0x7f22ac0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58308/0 (socket says 172.21.15.17:58308) 2023-08-09T12:44:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22a3fff640 1 -- 172.21.15.17:0/1600212462 learned_addr learned my addr 172.21.15.17:0/1600212462 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.582+0000 7f22aa59c640 1 --2- 172.21.15.17:0/1600212462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 0x7f22ac1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.583+0000 7f22a3fff640 1 -- 172.21.15.17:0/1600212462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 msgr2=0x7f22ac1616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.583+0000 7f22a3fff640 1 --2- 172.21.15.17:0/1600212462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 0x7f22ac1616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.583+0000 7f22a3fff640 1 -- 172.21.15.17:0/1600212462 >> v1:172.21.15.142:6789/0 conn(0x7f22ac0d29d0 legacy=0x7f22ac0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.583+0000 7f22a3fff640 1 -- 172.21.15.17:0/1600212462 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0cdff0 con 0x7f22ac0b6000 2023-08-09T12:44:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.584+0000 7f22a3fff640 1 --2- 172.21.15.17:0/1600212462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac0cd500 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2294009870 tx=0x7f229402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdb5b2fd5134463 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.584+0000 7f22a9d9b640 1 -- 172.21.15.17:0/1600212462 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294031640 con 0x7f22ac0b6000 2023-08-09T12:44:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.584+0000 7f22a9d9b640 1 -- 172.21.15.17:0/1600212462 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22940317a0 con 0x7f22ac0b6000 2023-08-09T12:44:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.584+0000 7f22a9d9b640 1 -- 172.21.15.17:0/1600212462 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294031b30 con 0x7f22ac0b6000 2023-08-09T12:44:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.585+0000 7f22b0d0f640 1 -- 172.21.15.17:0/1600212462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 msgr2=0x7f22ac0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.585+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/1600212462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac0cd500 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2294009870 tx=0x7f229402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.585+0000 7f22b0d0f640 1 -- 172.21.15.17:0/1600212462 shutdown_connections 2023-08-09T12:44:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.585+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/1600212462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac0cd500 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.585+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/1600212462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 0x7f22ac1616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.585+0000 7f22b0d0f640 1 -- 172.21.15.17:0/1600212462 >> 172.21.15.17:0/1600212462 conn(0x7f22ac06fde0 msgr2=0x7f22ac0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.585+0000 7f22b0d0f640 1 -- 172.21.15.17:0/1600212462 shutdown_connections 2023-08-09T12:44:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.585+0000 7f22b0d0f640 1 -- 172.21.15.17:0/1600212462 wait complete. 2023-08-09T12:44:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.587+0000 7f22b0d0f640 1 Processor -- start 2023-08-09T12:44:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.587+0000 7f22b0d0f640 1 -- start start 2023-08-09T12:44:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22b0d0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22b0d0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0d29d0 0x7f22ac0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22b0d0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 0x7f22ac1e8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22b0d0f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c9dd0 con 0x7f22ac0b6000 2023-08-09T12:44:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22b0d0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0ca0b0 con 0x7f22ac0d29d0 2023-08-09T12:44:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22b0d0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0ca390 con 0x7f22ac15ce90 2023-08-09T12:44:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58320/0 (socket says 172.21.15.17:58320) 2023-08-09T12:44:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.588+0000 7f22aa59c640 1 -- 172.21.15.17:0/899380589 learned_addr learned my addr 172.21.15.17:0/899380589 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22aa59c640 1 -- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 msgr2=0x7f22ac1e8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22aa59c640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 0x7f22ac1e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22aa59c640 1 -- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0d29d0 msgr2=0x7f22ac0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22aa59c640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0d29d0 0x7f22ac0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22aa59c640 1 -- 172.21.15.17:0/899380589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940094d0 con 0x7f22ac0b6000 2023-08-09T12:44:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22aa59c640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac157c20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f229c00c5e0 tx=0x7f229c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:08.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22a2ffd640 1 -- 172.21.15.17:0/899380589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c004220 con 0x7f22ac0b6000 2023-08-09T12:44:08.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22a2ffd640 1 -- 172.21.15.17:0/899380589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c0043c0 con 0x7f22ac0b6000 2023-08-09T12:44:08.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22a2ffd640 1 -- 172.21.15.17:0/899380589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c003850 con 0x7f22ac0b6000 2023-08-09T12:44:08.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.589+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0ca670 con 0x7f22ac0b6000 2023-08-09T12:44:08.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.590+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac158560 con 0x7f22ac0b6000 2023-08-09T12:44:08.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.591+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac0cab90 con 0x7f22ac0b6000 2023-08-09T12:44:08.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.591+0000 7f22a2ffd640 1 -- 172.21.15.17:0/899380589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f229c0039b0 con 0x7f22ac0b6000 2023-08-09T12:44:08.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.592+0000 7f22a2ffd640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228c06a050 0x7f228c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:08.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.593+0000 7f22a2ffd640 1 -- 172.21.15.17:0/899380589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f229c088440 con 0x7f22ac0b6000 2023-08-09T12:44:08.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.593+0000 7f22a2ffd640 1 -- 172.21.15.17:0/899380589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7f228c072380 con 0x7f22ac0b6000 2023-08-09T12:44:08.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.593+0000 7f22a3fff640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228c06a050 0x7f228c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:08.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.594+0000 7f22a3fff640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228c06a050 0x7f228c06c510 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2294036000 tx=0x7f2294030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:08.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.597+0000 7f22a2ffd640 1 -- 172.21.15.17:0/899380589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f22ac0cab90 con 0x7f22ac0b6000 2023-08-09T12:44:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.792+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22ac0cab90 con 0x7f22ac0b6000 2023-08-09T12:44:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.794+0000 7f22a2ffd640 1 -- 172.21.15.17:0/899380589 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18536 (secure 0 0 0) 0x7f229c053a00 con 0x7f22ac0b6000 2023-08-09T12:44:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:08.797 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":79,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:07.791654+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:42:35.097822+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-09T12:42:35.735356+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.17","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:08.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228c06a050 msgr2=0x7f228c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228c06a050 0x7f228c06c510 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2294036000 tx=0x7f2294030000 comp rx=0 tx=0).stop 2023-08-09T12:44:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 msgr2=0x7f22ac157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac157c20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f229c00c5e0 tx=0x7f229c00caa0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 shutdown_connections 2023-08-09T12:44:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f228c06a050 0x7f228c06c510 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac15ce90 0x7f22ac1e8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0d29d0 0x7f22ac0cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.797+0000 7f22b0d0f640 1 --2- 172.21.15.17:0/899380589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22ac0b6000 0x7f22ac157c20 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.798+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 >> 172.21.15.17:0/899380589 conn(0x7f22ac06fde0 msgr2=0x7f22ac0b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.798+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 shutdown_connections 2023-08-09T12:44:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:08.798+0000 7f22b0d0f640 1 -- 172.21.15.17:0/899380589 wait complete. 2023-08-09T12:44:08.821 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:44:08.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:44:09.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.050+0000 7f4d52b42640 1 Processor -- start 2023-08-09T12:44:09.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.050+0000 7f4d52b42640 1 -- start start 2023-08-09T12:44:09.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.052+0000 7f4d52b42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c1616e0 0x7f4d4c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.052+0000 7f4d52b42640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c0cdd10 con 0x7f4d4c0d29d0 2023-08-09T12:44:09.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.052+0000 7f4d52b42640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c0cdff0 con 0x7f4d4c15ce90 2023-08-09T12:44:09.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.052+0000 7f4d52b42640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0b6540 con 0x7f4d4c1616e0 2023-08-09T12:44:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.052+0000 7f4d510df640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4d4c0d29d0 0x7f4d4c0d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33752/0 (socket says 172.21.15.17:33752) 2023-08-09T12:44:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.052+0000 7f4d510df640 1 -- 172.21.15.17:0/3371044993 learned_addr learned my addr 172.21.15.17:0/3371044993 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.053+0000 7f4d4bfff640 1 --2- 172.21.15.17:0/3371044993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c1616e0 0x7f4d4c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.053+0000 7f4d4b7fe640 1 -- 172.21.15.17:0/3371044993 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711862279 0 0) 0x7f4d4c0cdd10 con 0x7f4d4c0d29d0 2023-08-09T12:44:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.053+0000 7f4d4b7fe640 1 -- 172.21.15.17:0/3371044993 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d34003520 con 0x7f4d4c0d29d0 2023-08-09T12:44:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.053+0000 7f4d4bfff640 1 -- 172.21.15.17:0/3371044993 >> v1:172.21.15.142:6789/0 conn(0x7f4d4c15ce90 legacy=0x7f4d4c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.053+0000 7f4d4b7fe640 1 -- 172.21.15.17:0/3371044993 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4252948332 0 0) 0x7f4d34003520 con 0x7f4d4c0d29d0 2023-08-09T12:44:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.053+0000 7f4d4bfff640 1 -- 172.21.15.17:0/3371044993 >> v1:172.21.15.17:6789/0 conn(0x7f4d4c0d29d0 legacy=0x7f4d4c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.053+0000 7f4d4bfff640 1 -- 172.21.15.17:0/3371044993 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0ce2d0 con 0x7f4d4c1616e0 2023-08-09T12:44:09.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.055+0000 7f4d4bfff640 1 --2- 172.21.15.17:0/3371044993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c1616e0 0x7f4d4c0b6000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d400097d0 tx=0x7f4d4002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46f4b9fbbe1d496 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:09.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.056+0000 7f4d4b7fe640 1 -- 172.21.15.17:0/3371044993 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40031890 con 0x7f4d4c1616e0 2023-08-09T12:44:09.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.056+0000 7f4d4b7fe640 1 -- 172.21.15.17:0/3371044993 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d400319f0 con 0x7f4d4c1616e0 2023-08-09T12:44:09.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.056+0000 7f4d4b7fe640 1 -- 172.21.15.17:0/3371044993 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40031d80 con 0x7f4d4c1616e0 2023-08-09T12:44:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.056+0000 7f4d52b42640 1 -- 172.21.15.17:0/3371044993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c1616e0 msgr2=0x7f4d4c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.057+0000 7f4d52b42640 1 --2- 172.21.15.17:0/3371044993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c1616e0 0x7f4d4c0b6000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d400097d0 tx=0x7f4d4002b930 comp rx=0 tx=0).stop 2023-08-09T12:44:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.057+0000 7f4d52b42640 1 -- 172.21.15.17:0/3371044993 shutdown_connections 2023-08-09T12:44:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.057+0000 7f4d52b42640 1 --2- 172.21.15.17:0/3371044993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c1616e0 0x7f4d4c0b6000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.057+0000 7f4d52b42640 1 -- 172.21.15.17:0/3371044993 >> 172.21.15.17:0/3371044993 conn(0x7f4d4c06fde0 msgr2=0x7f4d4c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.057+0000 7f4d52b42640 1 -- 172.21.15.17:0/3371044993 shutdown_connections 2023-08-09T12:44:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.057+0000 7f4d52b42640 1 -- 172.21.15.17:0/3371044993 wait complete. 2023-08-09T12:44:09.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.058+0000 7f4d52b42640 1 Processor -- start 2023-08-09T12:44:09.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.059+0000 7f4d52b42640 1 -- start start 2023-08-09T12:44:09.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d52b42640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4c0d29d0 0x7f4d4c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d52b42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c15ce90 0x7f4d4c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d52b42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4c1616e0 0x7f4d4c15da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d52b42640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0ccaa0 con 0x7f4d4c1616e0 2023-08-09T12:44:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d52b42640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0cb1e0 con 0x7f4d4c0d29d0 2023-08-09T12:44:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d52b42640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0cb4c0 con 0x7f4d4c15ce90 2023-08-09T12:44:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d510df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4c1616e0 0x7f4d4c15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d510df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4c1616e0 0x7f4d4c15da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58328/0 (socket says 172.21.15.17:58328) 2023-08-09T12:44:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d510df640 1 -- 172.21.15.17:0/1676070781 learned_addr learned my addr 172.21.15.17:0/1676070781 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d4bfff640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c15ce90 0x7f4d4c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d510df640 1 -- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c15ce90 msgr2=0x7f4d4c150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d510df640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c15ce90 0x7f4d4c150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d508de640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4c0d29d0 0x7f4d4c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d510df640 1 -- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4c0d29d0 msgr2=0x7f4d4c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d510df640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4c0d29d0 0x7f4d4c0cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.060+0000 7f4d510df640 1 -- 172.21.15.17:0/1676070781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40009400 con 0x7f4d4c1616e0 2023-08-09T12:44:09.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.061+0000 7f4d4bfff640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c15ce90 0x7f4d4c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.061+0000 7f4d510df640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4c1616e0 0x7f4d4c15da60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c450 tx=0x7f4d4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.061+0000 7f4d497fa640 1 -- 172.21.15.17:0/1676070781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44005ce0 con 0x7f4d4c1616e0 2023-08-09T12:44:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.061+0000 7f4d497fa640 1 -- 172.21.15.17:0/1676070781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d44005e40 con 0x7f4d4c1616e0 2023-08-09T12:44:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.061+0000 7f4d497fa640 1 -- 172.21.15.17:0/1676070781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44007270 con 0x7f4d4c1616e0 2023-08-09T12:44:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.061+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c0cb7a0 con 0x7f4d4c1616e0 2023-08-09T12:44:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.061+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c0cbd60 con 0x7f4d4c1616e0 2023-08-09T12:44:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.062+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c067a80 con 0x7f4d4c1616e0 2023-08-09T12:44:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.063+0000 7f4d497fa640 1 -- 172.21.15.17:0/1676070781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d440073d0 con 0x7f4d4c1616e0 2023-08-09T12:44:09.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.064+0000 7f4d497fa640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d3806a050 0x7f4d3806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.064+0000 7f4d497fa640 1 -- 172.21.15.17:0/1676070781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4d44088260 con 0x7f4d4c1616e0 2023-08-09T12:44:09.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.065+0000 7f4d497fa640 1 -- 172.21.15.17:0/1676070781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7f4d38072380 con 0x7f4d4c1616e0 2023-08-09T12:44:09.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.065+0000 7f4d508de640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d3806a050 0x7f4d3806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.066+0000 7f4d508de640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d3806a050 0x7f4d3806c510 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c007fd0 tx=0x7f4d3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:09.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.069+0000 7f4d497fa640 1 -- 172.21.15.17:0/1676070781 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4d44053820 con 0x7f4d4c1616e0 2023-08-09T12:44:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.298+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d4c0ccc80 con 0x7f4d4c1616e0 2023-08-09T12:44:09.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.299+0000 7f4d497fa640 1 -- 172.21.15.17:0/1676070781 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f4d44056e40 con 0x7f4d4c1616e0 2023-08-09T12:44:09.302 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2314028117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2314028117},{"type":"v1","addr":"172.21.15.142:6837","nonce":2314028117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3413359063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3413359063},{"type":"v1","addr":"172.21.15.142:6835","nonce":3413359063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/295901720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":295901720},{"type":"v1","addr":"172.21.15.17:6834","nonce":295901720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:42:36.710411+0000","modified":"2023-08-09T12:42:40.710471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1591311172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1591311172},{"type":"v1","addr":"172.21.15.17:6835","nonce":1591311172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-09T12:44:09.302 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2023-08-09T12:44:09.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d3806a050 msgr2=0x7f4d3806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d3806a050 0x7f4d3806c510 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c007fd0 tx=0x7f4d3c009040 comp rx=0 tx=0).stop 2023-08-09T12:44:09.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4c1616e0 msgr2=0x7f4d4c15da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4c1616e0 0x7f4d4c15da60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c450 tx=0x7f4d4400c910 comp rx=0 tx=0).stop 2023-08-09T12:44:09.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 shutdown_connections 2023-08-09T12:44:09.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4d3806a050 0x7f4d3806c510 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4c1616e0 0x7f4d4c15da60 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d4c15ce90 0x7f4d4c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 --2- 172.21.15.17:0/1676070781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4c0d29d0 0x7f4d4c0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 >> 172.21.15.17:0/1676070781 conn(0x7f4d4c06fde0 msgr2=0x7f4d4c15c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:09.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 shutdown_connections 2023-08-09T12:44:09.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.302+0000 7f4d52b42640 1 -- 172.21.15.17:0/1676070781 wait complete. 2023-08-09T12:44:09.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:44:09.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.527+0000 7ff833574640 1 Processor -- start 2023-08-09T12:44:09.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.527+0000 7ff833574640 1 -- start start 2023-08-09T12:44:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.528+0000 7ff833574640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff82c0b86e0 0x7ff82c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.529+0000 7ff833574640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0b5a30 con 0x7ff82c160030 2023-08-09T12:44:09.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.529+0000 7ff833574640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0d0d70 con 0x7ff82c0cf980 2023-08-09T12:44:09.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.529+0000 7ff833574640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0d1110 con 0x7ff82c0b86e0 2023-08-09T12:44:09.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.529+0000 7ff832572640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff82c160030 0x7ff82c160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33760/0 (socket says 172.21.15.17:33760) 2023-08-09T12:44:09.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.529+0000 7ff832572640 1 -- 172.21.15.17:0/4011032484 learned_addr learned my addr 172.21.15.17:0/4011032484 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:09.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.529+0000 7ff831d71640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff82c0b86e0 0x7ff82c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.529+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968477350 0 0) 0x7ff82c0b5a30 con 0x7ff82c160030 2023-08-09T12:44:09.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff818003520 con 0x7ff82c160030 2023-08-09T12:44:09.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605557381 0 0) 0x7ff818003520 con 0x7ff82c160030 2023-08-09T12:44:09.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff82c0b86e0 msgr2=0x7ff82c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:09.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff82c0b86e0 0x7ff82c0cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 >> v1:172.21.15.142:6789/0 conn(0x7ff82c0cf980 legacy=0x7ff82c0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:09.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c160f70 con 0x7ff82c160030 2023-08-09T12:44:09.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff8280019f0 con 0x7ff82c160030 2023-08-09T12:44:09.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 >> v1:172.21.15.17:6789/0 conn(0x7ff82c160030 legacy=0x7ff82c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff82c0b86e0 0x7ff8180039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff818003f00 0x7ff8180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff818004d00 0x7ff818005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0d1110 con 0x7ff818003f00 2023-08-09T12:44:09.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81800ba60 con 0x7ff818004d00 2023-08-09T12:44:09.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81800bc20 con 0x7ff82c0b86e0 2023-08-09T12:44:09.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.530+0000 7ff831d71640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff818003f00 0x7ff8180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.531+0000 7ff831d71640 1 -- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff82c0b86e0 msgr2=0x7ff8180039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:09.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.531+0000 7ff831d71640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff82c0b86e0 0x7ff8180039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.531+0000 7ff831d71640 1 -- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff818004d00 msgr2=0x7ff818005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:09.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.531+0000 7ff831d71640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff818004d00 0x7ff818005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.531+0000 7ff831d71640 1 -- 172.21.15.17:0/4011032484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff818003520 con 0x7ff818003f00 2023-08-09T12:44:09.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.532+0000 7ff831d71640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff818003f00 0x7ff8180047c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009ac0 tx=0x7ff8180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9395b986c73a18f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:09.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.532+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c02c710 con 0x7ff818003f00 2023-08-09T12:44:09.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.532+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c02c870 con 0x7ff818003f00 2023-08-09T12:44:09.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.532+0000 7ff831570640 1 -- 172.21.15.17:0/4011032484 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c02cc00 con 0x7ff818003f00 2023-08-09T12:44:09.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.533+0000 7ff833574640 1 -- 172.21.15.17:0/4011032484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff818003f00 msgr2=0x7ff8180047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.533+0000 7ff833574640 1 --2- 172.21.15.17:0/4011032484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff818003f00 0x7ff8180047c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009ac0 tx=0x7ff8180057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.533+0000 7ff832d73640 1 -- 172.21.15.17:0/4011032484 reap_dead start 2023-08-09T12:44:09.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.533+0000 7ff833574640 1 -- 172.21.15.17:0/4011032484 shutdown_connections 2023-08-09T12:44:09.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.533+0000 7ff833574640 1 -- 172.21.15.17:0/4011032484 >> 172.21.15.17:0/4011032484 conn(0x7ff82c0697c0 msgr2=0x7ff82c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:09.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.533+0000 7ff833574640 1 -- 172.21.15.17:0/4011032484 shutdown_connections 2023-08-09T12:44:09.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.533+0000 7ff833574640 1 -- 172.21.15.17:0/4011032484 wait complete. 2023-08-09T12:44:09.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.535+0000 7ff833574640 1 Processor -- start 2023-08-09T12:44:09.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.535+0000 7ff833574640 1 -- start start 2023-08-09T12:44:09.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff833574640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff818003f00 0x7ff82c151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff833574640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0c8080 0x7ff82c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff833574640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff82c0a93c0 0x7ff82c0a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff833574640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0a9d60 con 0x7ff82c0c8080 2023-08-09T12:44:09.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff833574640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0b2290 con 0x7ff82c0a93c0 2023-08-09T12:44:09.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff833574640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1f20e0 con 0x7ff818003f00 2023-08-09T12:44:09.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff831d71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0c8080 0x7ff82c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff831d71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0c8080 0x7ff82c0c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58350/0 (socket says 172.21.15.17:58350) 2023-08-09T12:44:09.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.536+0000 7ff831d71640 1 -- 172.21.15.17:0/157807036 learned_addr learned my addr 172.21.15.17:0/157807036 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:09.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff832572640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff818003f00 0x7ff82c151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff831d71640 1 -- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff818003f00 msgr2=0x7ff82c151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff831d71640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff818003f00 0x7ff82c151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff831d71640 1 -- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff82c0a93c0 msgr2=0x7ff82c0a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff831d71640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff82c0a93c0 0x7ff82c0a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff831d71640 1 -- 172.21.15.17:0/157807036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c151dc0 con 0x7ff82c0c8080 2023-08-09T12:44:09.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff832572640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff818003f00 0x7ff82c151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:09.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff831d71640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0c8080 0x7ff82c0c8500 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009ac0 tx=0x7ff81c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:09.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff822ffd640 1 -- 172.21.15.17:0/157807036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c003810 con 0x7ff82c0c8080 2023-08-09T12:44:09.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff822ffd640 1 -- 172.21.15.17:0/157807036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c003970 con 0x7ff82c0c8080 2023-08-09T12:44:09.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff822ffd640 1 -- 172.21.15.17:0/157807036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c003d00 con 0x7ff82c0c8080 2023-08-09T12:44:09.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.537+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c0c9b40 con 0x7ff82c0c8080 2023-08-09T12:44:09.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.538+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c0ca100 con 0x7ff82c0c8080 2023-08-09T12:44:09.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.539+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c04e390 con 0x7ff82c0c8080 2023-08-09T12:44:09.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.540+0000 7ff822ffd640 1 -- 172.21.15.17:0/157807036 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff81c040450 con 0x7ff82c0c8080 2023-08-09T12:44:09.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.540+0000 7ff822ffd640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff81006a050 0x7ff81006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:09.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.541+0000 7ff822ffd640 1 -- 172.21.15.17:0/157807036 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff81c0aa680 con 0x7ff82c0c8080 2023-08-09T12:44:09.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.541+0000 7ff822ffd640 1 -- 172.21.15.17:0/157807036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7ff810072380 con 0x7ff82c0c8080 2023-08-09T12:44:09.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.541+0000 7ff832572640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff81006a050 0x7ff81006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:09.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.542+0000 7ff832572640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff81006a050 0x7ff81006c510 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff828001ba0 tx=0x7ff828009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:09.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.545+0000 7ff822ffd640 1 -- 172.21.15.17:0/157807036 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff81c075c40 con 0x7ff82c0c8080 2023-08-09T12:44:09.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.776+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff82c0d0640 con 0x7ff82c0c8080 2023-08-09T12:44:09.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.777+0000 7ff822ffd640 1 -- 172.21.15.17:0/157807036 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4879 (secure 0 0 0) 0x7ff81c003e60 con 0x7ff82c0c8080 2023-08-09T12:44:09.780 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:09.780 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2314028117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2314028117},{"type":"v1","addr":"172.21.15.142:6837","nonce":2314028117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3413359063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3413359063},{"type":"v1","addr":"172.21.15.142:6835","nonce":3413359063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/295901720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":295901720},{"type":"v1","addr":"172.21.15.17:6834","nonce":295901720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:42:36.710411+0000","modified":"2023-08-09T12:42:40.710471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1591311172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1591311172},{"type":"v1","addr":"172.21.15.17:6835","nonce":1591311172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-09T12:44:09.781 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2023-08-09T12:44:09.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff81006a050 msgr2=0x7ff81006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff81006a050 0x7ff81006c510 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff828001ba0 tx=0x7ff828009040 comp rx=0 tx=0).stop 2023-08-09T12:44:09.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0c8080 msgr2=0x7ff82c0c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:09.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0c8080 0x7ff82c0c8500 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009ac0 tx=0x7ff81c004730 comp rx=0 tx=0).stop 2023-08-09T12:44:09.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 shutdown_connections 2023-08-09T12:44:09.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff81006a050 0x7ff81006c510 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff82c0a93c0 0x7ff82c0a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0c8080 0x7ff82c0c8500 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 --2- 172.21.15.17:0/157807036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff818003f00 0x7ff82c151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:09.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 >> 172.21.15.17:0/157807036 conn(0x7ff82c0697c0 msgr2=0x7ff82c15dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:09.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 shutdown_connections 2023-08-09T12:44:09.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:09.780+0000 7ff833574640 1 -- 172.21.15.17:0/157807036 wait complete. 2023-08-09T12:44:09.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:10.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.023+0000 7f6fe5471640 1 Processor -- start 2023-08-09T12:44:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.023+0000 7f6fe5471640 1 -- start start 2023-08-09T12:44:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.024+0000 7f6fe5471640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6fe0159d80 0x7f6fe00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.024+0000 7f6fe5471640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 0x7f6fe00c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fe5471640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe00b4630 con 0x7f6fe00ad810 2023-08-09T12:44:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fe5471640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe015a160 con 0x7f6fe0159d80 2023-08-09T12:44:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fe5471640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00b3ab0 con 0x7f6fe0070a90 2023-08-09T12:44:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fdeffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6fe0159d80 0x7f6fe00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fde7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6fe00ad810 0x7f6fe0070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33762/0 (socket says 172.21.15.17:33762) 2023-08-09T12:44:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fde7fc640 1 -- 172.21.15.17:0/351149415 learned_addr learned my addr 172.21.15.17:0/351149415 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fdeffd640 1 -- 172.21.15.17:0/351149415 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 msgr2=0x7f6fe00c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fdeffd640 1 --2- 172.21.15.17:0/351149415 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 0x7f6fe00c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.025+0000 7f6fdeffd640 1 -- 172.21.15.17:0/351149415 >> v1:172.21.15.17:6789/0 conn(0x7f6fe00ad810 legacy=0x7f6fe0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.026+0000 7f6fdeffd640 1 -- 172.21.15.17:0/351149415 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00b3d90 con 0x7f6fe0159d80 2023-08-09T12:44:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.026+0000 7f6fddffb640 1 -- 172.21.15.17:0/351149415 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327783485 0 0) 0x7f6fe00b4630 con 0x7f6fe00ad810 2023-08-09T12:44:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.027+0000 7f6fdeffd640 1 --2- 172.21.15.17:0/351149415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0159d80 0x7f6fe00b34d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00097a0 tx=0x7f6fd002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad227636ae76ce09 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.027+0000 7f6fddffb640 1 -- 172.21.15.17:0/351149415 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0031830 con 0x7f6fe0159d80 2023-08-09T12:44:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.027+0000 7f6fddffb640 1 -- 172.21.15.17:0/351149415 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0031990 con 0x7f6fe0159d80 2023-08-09T12:44:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.027+0000 7f6fddffb640 1 -- 172.21.15.17:0/351149415 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0031d20 con 0x7f6fe0159d80 2023-08-09T12:44:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.028+0000 7f6fe5471640 1 -- 172.21.15.17:0/351149415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0159d80 msgr2=0x7f6fe00b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.028+0000 7f6fe5471640 1 --2- 172.21.15.17:0/351149415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0159d80 0x7f6fe00b34d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00097a0 tx=0x7f6fd002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.028+0000 7f6fe5471640 1 -- 172.21.15.17:0/351149415 shutdown_connections 2023-08-09T12:44:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.028+0000 7f6fe5471640 1 --2- 172.21.15.17:0/351149415 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 0x7f6fe00c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.028+0000 7f6fe5471640 1 --2- 172.21.15.17:0/351149415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0159d80 0x7f6fe00b34d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.028+0000 7f6fe5471640 1 -- 172.21.15.17:0/351149415 >> 172.21.15.17:0/351149415 conn(0x7f6fe00cb1b0 msgr2=0x7f6fe00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.028+0000 7f6fe5471640 1 -- 172.21.15.17:0/351149415 shutdown_connections 2023-08-09T12:44:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.028+0000 7f6fe5471640 1 -- 172.21.15.17:0/351149415 wait complete. 2023-08-09T12:44:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.030+0000 7f6fe5471640 1 Processor -- start 2023-08-09T12:44:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.030+0000 7f6fe5471640 1 -- start start 2023-08-09T12:44:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fe5471640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 0x7f6fe00c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fe5471640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe00ad810 0x7f6fe01f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fe5471640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fe0159d80 0x7f6fe00af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fe5471640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00c3550 con 0x7f6fe00ad810 2023-08-09T12:44:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fe5471640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe01f3590 con 0x7f6fe0159d80 2023-08-09T12:44:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fe5471640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00c28d0 con 0x7f6fe0070a90 2023-08-09T12:44:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fde7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe00ad810 0x7f6fe01f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fde7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe00ad810 0x7f6fe01f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58376/0 (socket says 172.21.15.17:58376) 2023-08-09T12:44:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.031+0000 7f6fde7fc640 1 -- 172.21.15.17:0/2322816727 learned_addr learned my addr 172.21.15.17:0/2322816727 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fdeffd640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 0x7f6fe00c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fdf7fe640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fe0159d80 0x7f6fe00af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fde7fc640 1 -- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 msgr2=0x7f6fe00c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fde7fc640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 0x7f6fe00c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fde7fc640 1 -- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fe0159d80 msgr2=0x7f6fe00af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fde7fc640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fe0159d80 0x7f6fe00af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fde7fc640 1 -- 172.21.15.17:0/2322816727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009400 con 0x7f6fe00ad810 2023-08-09T12:44:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fde7fc640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe00ad810 0x7f6fe01f3050 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400c410 tx=0x7f6fd400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fc77fe640 1 -- 172.21.15.17:0/2322816727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40074e0 con 0x7f6fe00ad810 2023-08-09T12:44:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fc77fe640 1 -- 172.21.15.17:0/2322816727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd40057a0 con 0x7f6fe00ad810 2023-08-09T12:44:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fc77fe640 1 -- 172.21.15.17:0/2322816727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4007660 con 0x7f6fe00ad810 2023-08-09T12:44:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.032+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe00c2bb0 con 0x7f6fe00ad810 2023-08-09T12:44:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.033+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe00c3170 con 0x7f6fe00ad810 2023-08-09T12:44:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.034+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe00c3690 con 0x7f6fe00ad810 2023-08-09T12:44:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.035+0000 7f6fc77fe640 1 -- 172.21.15.17:0/2322816727 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6fd4005b90 con 0x7f6fe00ad810 2023-08-09T12:44:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.036+0000 7f6fc77fe640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6fcc06a050 0x7f6fcc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.036+0000 7f6fc77fe640 1 -- 172.21.15.17:0/2322816727 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f6fd4087cd0 con 0x7f6fe00ad810 2023-08-09T12:44:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.036+0000 7f6fdeffd640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6fcc06a050 0x7f6fcc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.038+0000 7f6fdeffd640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6fcc06a050 0x7f6fcc06c510 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0036000 tx=0x7f6fd003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.040+0000 7f6fc77fe640 1 -- 172.21.15.17:0/2322816727 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6fe00c3690 con 0x7f6fe00ad810 2023-08-09T12:44:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.234+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fe00c3690 con 0x7f6fe00ad810 2023-08-09T12:44:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.237+0000 7f6fc77fe640 1 -- 172.21.15.17:0/2322816727 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18509 (secure 0 0 0) 0x7f6fe00c3690 con 0x7f6fe00ad810 2023-08-09T12:44:10.239 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:10.240 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:09.798412+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:42:35.097822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-09T12:42:35.735356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.17","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:10.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.239+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6fcc06a050 msgr2=0x7f6fcc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.239+0000 7f6fe5471640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6fcc06a050 0x7f6fcc06c510 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0036000 tx=0x7f6fd003c040 comp rx=0 tx=0).stop 2023-08-09T12:44:10.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.239+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe00ad810 msgr2=0x7f6fe01f3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.239+0000 7f6fe5471640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe00ad810 0x7f6fe01f3050 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400c410 tx=0x7f6fd400c8d0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.240+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 shutdown_connections 2023-08-09T12:44:10.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.240+0000 7f6fe5471640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6fcc06a050 0x7f6fcc06c510 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.240+0000 7f6fe5471640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fe0159d80 0x7f6fe00af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.240+0000 7f6fe5471640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe00ad810 0x7f6fe01f3050 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.240+0000 7f6fe5471640 1 --2- 172.21.15.17:0/2322816727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fe0070a90 0x7f6fe00c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.240+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 >> 172.21.15.17:0/2322816727 conn(0x7f6fe00cb1b0 msgr2=0x7f6fe00ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:10.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.240+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 shutdown_connections 2023-08-09T12:44:10.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.240+0000 7f6fe5471640 1 -- 172.21.15.17:0/2322816727 wait complete. 2023-08-09T12:44:10.262 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:44:10.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:44:10.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:44:10.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.484+0000 7f1c3759e640 1 Processor -- start 2023-08-09T12:44:10.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.484+0000 7f1c3759e640 1 -- start start 2023-08-09T12:44:10.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.486+0000 7f1c3759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c380b0ac0 0x7f1c380b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.486+0000 7f1c3759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c380b3b60 con 0x7f1c380b0ea0 2023-08-09T12:44:10.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.486+0000 7f1c3759e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c380b3550 con 0x7f1c380cb610 2023-08-09T12:44:10.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.486+0000 7f1c3759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381617b0 con 0x7f1c380b0ac0 2023-08-09T12:44:10.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.486+0000 7f1c2dd9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1c380b0ea0 0x7f1c380caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33768/0 (socket says 172.21.15.17:33768) 2023-08-09T12:44:10.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.486+0000 7f1c2dd9b640 1 -- 172.21.15.17:0/3158691723 learned_addr learned my addr 172.21.15.17:0/3158691723 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c3659c640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c380b0ac0 0x7f1c380b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837151297 0 0) 0x7f1c380b3b60 con 0x7f1c380b0ea0 2023-08-09T12:44:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c24003520 con 0x7f1c380b0ea0 2023-08-09T12:44:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389053574 0 0) 0x7f1c24003520 con 0x7f1c380b0ea0 2023-08-09T12:44:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c380b0ac0 msgr2=0x7f1c380b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c380b0ac0 0x7f1c380b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 >> v1:172.21.15.142:6789/0 conn(0x7f1c380cb610 legacy=0x7f1c3806ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c380c9e10 con 0x7f1c380b0ea0 2023-08-09T12:44:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1c20001670 con 0x7f1c380b0ea0 2023-08-09T12:44:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 >> v1:172.21.15.17:6789/0 conn(0x7f1c380b0ea0 legacy=0x7f1c380caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240039a0 0x7f1c24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240047c0 0x7f1c24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c380b0ac0 0x7f1c240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381617b0 con 0x7f1c240039a0 2023-08-09T12:44:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2400bab0 con 0x7f1c240047c0 2023-08-09T12:44:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.487+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2400bc70 con 0x7f1c380b0ac0 2023-08-09T12:44:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.488+0000 7f1c3659c640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240039a0 0x7f1c24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.488+0000 7f1c2dd9b640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240047c0 0x7f1c24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.488+0000 7f1c3659c640 1 -- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c380b0ac0 msgr2=0x7f1c240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:10.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.488+0000 7f1c3659c640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c380b0ac0 0x7f1c240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.488+0000 7f1c3659c640 1 -- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240047c0 msgr2=0x7f1c24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:10.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.488+0000 7f1c3659c640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240047c0 0x7f1c24004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.488+0000 7f1c3659c640 1 -- 172.21.15.17:0/3158691723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24003520 con 0x7f1c240039a0 2023-08-09T12:44:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.489+0000 7f1c3659c640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240039a0 0x7f1c24003dc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1c28007360 tx=0x7f1c240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8f3c24593069b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.489+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2802ccf0 con 0x7f1c240039a0 2023-08-09T12:44:10.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.489+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2802ce50 con 0x7f1c240039a0 2023-08-09T12:44:10.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.489+0000 7f1c35d9b640 1 -- 172.21.15.17:0/3158691723 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28034660 con 0x7f1c240039a0 2023-08-09T12:44:10.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.490+0000 7f1c3759e640 1 -- 172.21.15.17:0/3158691723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240039a0 msgr2=0x7f1c24003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.490+0000 7f1c3759e640 1 --2- 172.21.15.17:0/3158691723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240039a0 0x7f1c24003dc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1c28007360 tx=0x7f1c240057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.490+0000 7f1c36d9d640 1 -- 172.21.15.17:0/3158691723 reap_dead start 2023-08-09T12:44:10.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.490+0000 7f1c3759e640 1 -- 172.21.15.17:0/3158691723 shutdown_connections 2023-08-09T12:44:10.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.490+0000 7f1c3759e640 1 -- 172.21.15.17:0/3158691723 >> 172.21.15.17:0/3158691723 conn(0x7f1c380b1d50 msgr2=0x7f1c3806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.490+0000 7f1c3759e640 1 -- 172.21.15.17:0/3158691723 shutdown_connections 2023-08-09T12:44:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.490+0000 7f1c3759e640 1 -- 172.21.15.17:0/3158691723 wait complete. 2023-08-09T12:44:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.492+0000 7f1c3759e640 1 Processor -- start 2023-08-09T12:44:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.492+0000 7f1c3759e640 1 -- start start 2023-08-09T12:44:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.493+0000 7f1c3759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240039a0 0x7f1c381f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.493+0000 7f1c3759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c380c4a50 0x7f1c381fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.493+0000 7f1c3759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c38158960 0x7f1c38158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.493+0000 7f1c3759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381599c0 con 0x7f1c38158960 2023-08-09T12:44:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.493+0000 7f1c3759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3806f950 con 0x7f1c380c4a50 2023-08-09T12:44:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.493+0000 7f1c3759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3806f340 con 0x7f1c240039a0 2023-08-09T12:44:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.493+0000 7f1c36d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c38158960 0x7f1c38158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.493+0000 7f1c36d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c38158960 0x7f1c38158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58388/0 (socket says 172.21.15.17:58388) 2023-08-09T12:44:10.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c36d9d640 1 -- 172.21.15.17:0/1060266661 learned_addr learned my addr 172.21.15.17:0/1060266661 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:10.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c3659c640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240039a0 0x7f1c381f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c2dd9b640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c380c4a50 0x7f1c381fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c36d9d640 1 -- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240039a0 msgr2=0x7f1c381f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c36d9d640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240039a0 0x7f1c381f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c36d9d640 1 -- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c380c4a50 msgr2=0x7f1c381fa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c36d9d640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c380c4a50 0x7f1c381fa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c36d9d640 1 -- 172.21.15.17:0/1060266661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c381596e0 con 0x7f1c38158960 2023-08-09T12:44:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c3659c640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240039a0 0x7f1c381f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c2dd9b640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c380c4a50 0x7f1c381fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c36d9d640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c38158960 0x7f1c38158df0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1c380c8cd0 tx=0x7f1c3000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.494+0000 7f1c2f7fe640 1 -- 172.21.15.17:0/1060266661 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c300072e0 con 0x7f1c38158960 2023-08-09T12:44:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.495+0000 7f1c2f7fe640 1 -- 172.21.15.17:0/1060266661 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c30007440 con 0x7f1c38158960 2023-08-09T12:44:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.495+0000 7f1c2f7fe640 1 -- 172.21.15.17:0/1060266661 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30004020 con 0x7f1c38158960 2023-08-09T12:44:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.495+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3806f5e0 con 0x7f1c38158960 2023-08-09T12:44:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.495+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c381f5920 con 0x7f1c38158960 2023-08-09T12:44:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.496+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3806f1a0 con 0x7f1c38158960 2023-08-09T12:44:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.497+0000 7f1c2f7fe640 1 -- 172.21.15.17:0/1060266661 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1c300041a0 con 0x7f1c38158960 2023-08-09T12:44:10.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.498+0000 7f1c2f7fe640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1c1806a080 0x7f1c1806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:10.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.498+0000 7f1c2f7fe640 1 -- 172.21.15.17:0/1060266661 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f1c300877f0 con 0x7f1c38158960 2023-08-09T12:44:10.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.499+0000 7f1c3659c640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1c1806a080 0x7f1c1806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:10.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.500+0000 7f1c3659c640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1c1806a080 0x7f1c1806c540 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1c28036000 tx=0x7f1c28030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.502+0000 7f1c2f7fe640 1 -- 172.21.15.17:0/1060266661 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1c3806f1a0 con 0x7f1c38158960 2023-08-09T12:44:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.732+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1c3806f1a0 con 0x7f1c38158960 2023-08-09T12:44:10.736 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:44:10.733+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:44:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.743+0000 7f1c2f7fe640 1 -- 172.21.15.17:0/1060266661 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1c3806f1a0 con 0x7f1c38158960 2023-08-09T12:44:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:44:10.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1c1806a080 msgr2=0x7f1c1806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1c1806a080 0x7f1c1806c540 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1c28036000 tx=0x7f1c28030000 comp rx=0 tx=0).stop 2023-08-09T12:44:10.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c38158960 msgr2=0x7f1c38158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:10.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c38158960 0x7f1c38158df0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1c380c8cd0 tx=0x7f1c3000c820 comp rx=0 tx=0).stop 2023-08-09T12:44:10.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 shutdown_connections 2023-08-09T12:44:10.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1c1806a080 0x7f1c1806c540 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c38158960 0x7f1c38158df0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c380c4a50 0x7f1c381fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 --2- 172.21.15.17:0/1060266661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240039a0 0x7f1c381f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:10.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 >> 172.21.15.17:0/1060266661 conn(0x7f1c380b1d50 msgr2=0x7f1c380c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:10.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 shutdown_connections 2023-08-09T12:44:10.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:10.747+0000 7f1c3759e640 1 -- 172.21.15.17:0/1060266661 wait complete. 2023-08-09T12:44:10.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:44:10.818 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:44:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.008+0000 7febed64b640 1 Processor -- start 2023-08-09T12:44:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.008+0000 7febed64b640 1 -- start start 2023-08-09T12:44:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febed64b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7febe815a8c0 0x7febe80b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febed64b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7febe80b13f0 0x7febe815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febed64b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815f180 0x7febe80b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febed64b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe815e7b0 con 0x7febe815a8c0 2023-08-09T12:44:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febed64b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80b1850 con 0x7febe80b13f0 2023-08-09T12:44:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febed64b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe815e460 con 0x7febe815f180 2023-08-09T12:44:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febe7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7febe815a8c0 0x7febe80b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febe7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7febe815a8c0 0x7febe80b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58406/0 (socket says 172.21.15.17:58406) 2023-08-09T12:44:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.010+0000 7febe7fff640 1 -- 172.21.15.17:0/3049839107 learned_addr learned my addr 172.21.15.17:0/3049839107 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.011+0000 7febe7fff640 1 -- 172.21.15.17:0/3049839107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815f180 msgr2=0x7febe80b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.011+0000 7febe7fff640 1 --2- 172.21.15.17:0/3049839107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815f180 0x7febe80b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.011+0000 7febe7fff640 1 -- 172.21.15.17:0/3049839107 >> v2:172.21.15.142:3300/0 conn(0x7febe80b13f0 msgr2=0x7febe815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.011+0000 7febe7fff640 1 --2- 172.21.15.17:0/3049839107 >> v2:172.21.15.142:3300/0 conn(0x7febe80b13f0 0x7febe815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.011+0000 7febe7fff640 1 -- 172.21.15.17:0/3049839107 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe815aca0 con 0x7febe815a8c0 2023-08-09T12:44:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.012+0000 7febe7fff640 1 --2- 172.21.15.17:0/3049839107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815a8c0 0x7febe80b4170 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7febe815e3c0 tx=0x7febd802b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c201aef2f11cd3d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.012+0000 7febe6ffd640 1 -- 172.21.15.17:0/3049839107 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8031880 con 0x7febe815a8c0 2023-08-09T12:44:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febe6ffd640 1 -- 172.21.15.17:0/3049839107 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd80319e0 con 0x7febe815a8c0 2023-08-09T12:44:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febe6ffd640 1 -- 172.21.15.17:0/3049839107 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8031d70 con 0x7febe815a8c0 2023-08-09T12:44:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febed64b640 1 -- 172.21.15.17:0/3049839107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815a8c0 msgr2=0x7febe80b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febed64b640 1 --2- 172.21.15.17:0/3049839107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815a8c0 0x7febe80b4170 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7febe815e3c0 tx=0x7febd802b920 comp rx=0 tx=0).stop 2023-08-09T12:44:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febed64b640 1 -- 172.21.15.17:0/3049839107 shutdown_connections 2023-08-09T12:44:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febed64b640 1 --2- 172.21.15.17:0/3049839107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815f180 0x7febe80b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febed64b640 1 --2- 172.21.15.17:0/3049839107 >> v2:172.21.15.142:3300/0 conn(0x7febe80b13f0 0x7febe815ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febed64b640 1 --2- 172.21.15.17:0/3049839107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815a8c0 0x7febe80b4170 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.013+0000 7febed64b640 1 -- 172.21.15.17:0/3049839107 >> 172.21.15.17:0/3049839107 conn(0x7febe80cb020 msgr2=0x7febe80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.014+0000 7febed64b640 1 -- 172.21.15.17:0/3049839107 shutdown_connections 2023-08-09T12:44:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.014+0000 7febed64b640 1 -- 172.21.15.17:0/3049839107 wait complete. 2023-08-09T12:44:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.015+0000 7febed64b640 1 Processor -- start 2023-08-09T12:44:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.015+0000 7febed64b640 1 -- start start 2023-08-09T12:44:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.016+0000 7febed64b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe80b13f0 0x7febe80c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.016+0000 7febed64b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815a8c0 0x7febe8147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.016+0000 7febed64b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815f180 0x7febe8148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.016+0000 7febed64b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe814fda0 con 0x7febe815f180 2023-08-09T12:44:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.016+0000 7febed64b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe81527c0 con 0x7febe80b13f0 2023-08-09T12:44:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.016+0000 7febed64b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8152aa0 con 0x7febe815a8c0 2023-08-09T12:44:11.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febece4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815f180 0x7febe8148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:11.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febece4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815f180 0x7febe8148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58422/0 (socket says 172.21.15.17:58422) 2023-08-09T12:44:11.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febece4a640 1 -- 172.21.15.17:0/3910420515 learned_addr learned my addr 172.21.15.17:0/3910420515 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:11.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febe77fe640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815a8c0 0x7febe8147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:11.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febe7fff640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe80b13f0 0x7febe80c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:11.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febece4a640 1 -- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815a8c0 msgr2=0x7febe8147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:11.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febece4a640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815a8c0 0x7febe8147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febece4a640 1 -- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe80b13f0 msgr2=0x7febe80c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:11.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febece4a640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe80b13f0 0x7febe80c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.017+0000 7febece4a640 1 -- 172.21.15.17:0/3910420515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80094d0 con 0x7febe815f180 2023-08-09T12:44:11.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.018+0000 7febece4a640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815f180 0x7febe8148090 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7febe000b9e0 tx=0x7febe000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:11.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.018+0000 7febe4ff9640 1 -- 172.21.15.17:0/3910420515 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000cb20 con 0x7febe815f180 2023-08-09T12:44:11.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.018+0000 7febe4ff9640 1 -- 172.21.15.17:0/3910420515 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000cca0 con 0x7febe815f180 2023-08-09T12:44:11.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.018+0000 7febe4ff9640 1 -- 172.21.15.17:0/3910420515 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0014680 con 0x7febe815f180 2023-08-09T12:44:11.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.018+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80c4d80 con 0x7febe815f180 2023-08-09T12:44:11.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.018+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe814fb30 con 0x7febe815f180 2023-08-09T12:44:11.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.019+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe804e390 con 0x7febe815f180 2023-08-09T12:44:11.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.020+0000 7febe4ff9640 1 -- 172.21.15.17:0/3910420515 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7febe001d3b0 con 0x7febe815f180 2023-08-09T12:44:11.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.021+0000 7febe4ff9640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7febd406a050 0x7febd406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:11.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.021+0000 7febe4ff9640 1 -- 172.21.15.17:0/3910420515 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6293+0+0 (secure 0 0 0) 0x7febe0088650 con 0x7febe815f180 2023-08-09T12:44:11.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.022+0000 7febe7fff640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7febd406a050 0x7febd406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:11.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.023+0000 7febe7fff640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7febd406a050 0x7febd406c510 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7febd8036000 tx=0x7febd803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:11.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.026+0000 7febe4ff9640 1 -- 172.21.15.17:0/3910420515 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7febe0053bb0 con 0x7febe815f180 2023-08-09T12:44:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.258+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7febe80cbd50 con 0x7febe815f180 2023-08-09T12:44:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.811+0000 7febe4ff9640 1 -- 172.21.15.17:0/3910420515 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7febe00571d0 con 0x7febe815f180 2023-08-09T12:44:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.815+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7febd406a050 msgr2=0x7febd406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.815+0000 7febed64b640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7febd406a050 0x7febd406c510 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7febd8036000 tx=0x7febd803c040 comp rx=0 tx=0).stop 2023-08-09T12:44:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.815+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815f180 msgr2=0x7febe8148090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.815+0000 7febed64b640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815f180 0x7febe8148090 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7febe000b9e0 tx=0x7febe000bea0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.816+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 shutdown_connections 2023-08-09T12:44:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.816+0000 7febed64b640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7febd406a050 0x7febd406c510 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.816+0000 7febed64b640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe815f180 0x7febe8148090 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.816+0000 7febed64b640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe815a8c0 0x7febe8147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.816+0000 7febed64b640 1 --2- 172.21.15.17:0/3910420515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe80b13f0 0x7febe80c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.816+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 >> 172.21.15.17:0/3910420515 conn(0x7febe80cb020 msgr2=0x7febe80af780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.816+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 shutdown_connections 2023-08-09T12:44:11.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:11.816+0000 7febed64b640 1 -- 172.21.15.17:0/3910420515 wait complete. 2023-08-09T12:44:11.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:44:12.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.128+0000 7fed18a4d640 1 Processor -- start 2023-08-09T12:44:12.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.128+0000 7fed18a4d640 1 -- start start 2023-08-09T12:44:12.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.129+0000 7fed18a4d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fed1415abe0 0x7fed140c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:12.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed18a4d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fed140add60 0x7fed1415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:12.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed18a4d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1415f6e0 con 0x7fed14070190 2023-08-09T12:44:12.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed18a4d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed140b4770 con 0x7fed140add60 2023-08-09T12:44:12.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed18a4d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed140caa70 con 0x7fed1415abe0 2023-08-09T12:44:12.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed11d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fed140add60 0x7fed1415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:12.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed11d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fed140add60 0x7fed1415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58436/0 (socket says 172.21.15.17:58436) 2023-08-09T12:44:12.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed11d9b640 1 -- 172.21.15.17:0/3329977339 learned_addr learned my addr 172.21.15.17:0/3329977339 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:12.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed1259c640 1 --2- 172.21.15.17:0/3329977339 >> v2:172.21.15.142:3300/0 conn(0x7fed1415abe0 0x7fed140c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:12.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed11d9b640 1 -- 172.21.15.17:0/3329977339 >> v2:172.21.15.142:3300/0 conn(0x7fed1415abe0 msgr2=0x7fed140c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:12.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed11d9b640 1 --2- 172.21.15.17:0/3329977339 >> v2:172.21.15.142:3300/0 conn(0x7fed1415abe0 0x7fed140c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed11d9b640 1 -- 172.21.15.17:0/3329977339 >> v1:172.21.15.142:6789/0 conn(0x7fed14070190 legacy=0x7fed14070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:12.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.130+0000 7fed11d9b640 1 -- 172.21.15.17:0/3329977339 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed140b41b0 con 0x7fed140add60 2023-08-09T12:44:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.132+0000 7fed11d9b640 1 --2- 172.21.15.17:0/3329977339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed1415f1a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fed14071100 tx=0x7fed0802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d0e1ce87f379a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.132+0000 7fed1159a640 1 -- 172.21.15.17:0/3329977339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08031750 con 0x7fed140add60 2023-08-09T12:44:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.132+0000 7fed1159a640 1 -- 172.21.15.17:0/3329977339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed080318b0 con 0x7fed140add60 2023-08-09T12:44:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.132+0000 7fed1159a640 1 -- 172.21.15.17:0/3329977339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08031c40 con 0x7fed140add60 2023-08-09T12:44:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.133+0000 7fed18a4d640 1 -- 172.21.15.17:0/3329977339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 msgr2=0x7fed1415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.133+0000 7fed18a4d640 1 --2- 172.21.15.17:0/3329977339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed1415f1a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fed14071100 tx=0x7fed0802b7f0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.133+0000 7fed18a4d640 1 -- 172.21.15.17:0/3329977339 shutdown_connections 2023-08-09T12:44:12.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.133+0000 7fed18a4d640 1 --2- 172.21.15.17:0/3329977339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed1415f1a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.133+0000 7fed18a4d640 1 --2- 172.21.15.17:0/3329977339 >> v2:172.21.15.142:3300/0 conn(0x7fed1415abe0 0x7fed140c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.133+0000 7fed18a4d640 1 -- 172.21.15.17:0/3329977339 >> 172.21.15.17:0/3329977339 conn(0x7fed140697c0 msgr2=0x7fed14069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:12.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.133+0000 7fed18a4d640 1 -- 172.21.15.17:0/3329977339 shutdown_connections 2023-08-09T12:44:12.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.133+0000 7fed18a4d640 1 -- 172.21.15.17:0/3329977339 wait complete. 2023-08-09T12:44:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.135+0000 7fed18a4d640 1 Processor -- start 2023-08-09T12:44:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.135+0000 7fed18a4d640 1 -- start start 2023-08-09T12:44:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed18a4d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed14070190 0x7fed140c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed18a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed141505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed18a4d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1415abe0 0x7fed141f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed18a4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed141f3970 con 0x7fed140add60 2023-08-09T12:44:12.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed18a4d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140c4d10 con 0x7fed14070190 2023-08-09T12:44:12.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed18a4d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed140c4450 con 0x7fed1415abe0 2023-08-09T12:44:12.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed11d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed141505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:12.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed11d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed141505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58446/0 (socket says 172.21.15.17:58446) 2023-08-09T12:44:12.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed11d9b640 1 -- 172.21.15.17:0/1724804222 learned_addr learned my addr 172.21.15.17:0/1724804222 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:12.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed1259c640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed14070190 0x7fed140c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:12.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed12d9d640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1415abe0 0x7fed141f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed11d9b640 1 -- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1415abe0 msgr2=0x7fed141f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.136+0000 7fed11d9b640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1415abe0 0x7fed141f02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed11d9b640 1 -- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed14070190 msgr2=0x7fed140c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed11d9b640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed14070190 0x7fed140c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed11d9b640 1 -- 172.21.15.17:0/1724804222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed080094d0 con 0x7fed140add60 2023-08-09T12:44:12.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed11d9b640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed141505f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fed08000c00 tx=0x7fed080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed02ffd640 1 -- 172.21.15.17:0/1724804222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08033c80 con 0x7fed140add60 2023-08-09T12:44:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed02ffd640 1 -- 172.21.15.17:0/1724804222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08033de0 con 0x7fed140add60 2023-08-09T12:44:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed02ffd640 1 -- 172.21.15.17:0/1724804222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0803c640 con 0x7fed140add60 2023-08-09T12:44:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed140c2770 con 0x7fed140add60 2023-08-09T12:44:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.137+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed140c2d30 con 0x7fed140add60 2023-08-09T12:44:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.139+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed14067a80 con 0x7fed140add60 2023-08-09T12:44:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.140+0000 7fed02ffd640 1 -- 172.21.15.17:0/1724804222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fed0803a040 con 0x7fed140add60 2023-08-09T12:44:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.141+0000 7fed02ffd640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecf406a050 0x7fecf406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.141+0000 7fed02ffd640 1 -- 172.21.15.17:0/1724804222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fed080aa210 con 0x7fed140add60 2023-08-09T12:44:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.141+0000 7fed1259c640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecf406a050 0x7fecf406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:12.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.143+0000 7fed1259c640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecf406a050 0x7fecf406c510 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fed0400b7c0 tx=0x7fed04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:12.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.145+0000 7fed02ffd640 1 -- 172.21.15.17:0/1724804222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fed08075800 con 0x7fed140add60 2023-08-09T12:44:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.343+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed1415f6e0 con 0x7fed140add60 2023-08-09T12:44:12.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.834+0000 7fed02ffd640 1 -- 172.21.15.17:0/1724804222 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) v1 ==== 181+0+0 (secure 0 0 0) 0x7fed1415f6e0 con 0x7fed140add60 2023-08-09T12:44:12.838 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:44:12.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecf406a050 msgr2=0x7fecf406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:12.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecf406a050 0x7fecf406c510 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fed0400b7c0 tx=0x7fed04008040 comp rx=0 tx=0).stop 2023-08-09T12:44:12.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 msgr2=0x7fed141505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:12.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed141505f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fed08000c00 tx=0x7fed080046c0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 shutdown_connections 2023-08-09T12:44:12.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fecf406a050 0x7fecf406c510 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1415abe0 0x7fed141f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed140add60 0x7fed141505f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 --2- 172.21.15.17:0/1724804222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed14070190 0x7fed140c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:12.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.838+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 >> 172.21.15.17:0/1724804222 conn(0x7fed140697c0 msgr2=0x7fed1415dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:12.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.839+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 shutdown_connections 2023-08-09T12:44:12.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:12.839+0000 7fed18a4d640 1 -- 172.21.15.17:0/1724804222 wait complete. 2023-08-09T12:44:12.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:44:13.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.098+0000 7fe20f799640 1 Processor -- start 2023-08-09T12:44:13.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.098+0000 7fe20f799640 1 -- start start 2023-08-09T12:44:13.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.100+0000 7fe20f799640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2080704f0 0x7fe208160e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:13.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.100+0000 7fe20f799640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2081613a0 0x7fe2080d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:13.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.100+0000 7fe20f799640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20815b1b0 con 0x7fe20815add0 2023-08-09T12:44:13.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.100+0000 7fe20f799640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2080cd6e0 con 0x7fe2081613a0 2023-08-09T12:44:13.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.100+0000 7fe20f799640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080cd9c0 con 0x7fe2080704f0 2023-08-09T12:44:13.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20d535640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe20815add0 0x7fe20806fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33782/0 (socket says 172.21.15.17:33782) 2023-08-09T12:44:13.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20d535640 1 -- 172.21.15.17:0/571220450 learned_addr learned my addr 172.21.15.17:0/571220450 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:13.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20dd36640 1 --2- 172.21.15.17:0/571220450 >> v2:172.21.15.17:3300/0 conn(0x7fe2081613a0 0x7fe2080d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20cd34640 1 --2- 172.21.15.17:0/571220450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2080704f0 0x7fe208160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe1fffff640 1 -- 172.21.15.17:0/571220450 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641749703 0 0) 0x7fe20815b1b0 con 0x7fe20815add0 2023-08-09T12:44:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20dd36640 1 -- 172.21.15.17:0/571220450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2080704f0 msgr2=0x7fe208160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20dd36640 1 --2- 172.21.15.17:0/571220450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2080704f0 0x7fe208160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20dd36640 1 -- 172.21.15.17:0/571220450 >> v1:172.21.15.17:6789/0 conn(0x7fe20815add0 legacy=0x7fe20806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20dd36640 1 -- 172.21.15.17:0/571220450 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080cdca0 con 0x7fe2081613a0 2023-08-09T12:44:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.101+0000 7fe20cd34640 1 --2- 172.21.15.17:0/571220450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2080704f0 0x7fe208160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:44:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.102+0000 7fe20dd36640 1 --2- 172.21.15.17:0/571220450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2081613a0 0x7fe2080d1110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe200009d90 tx=0x7fe20002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f0e39daa1ecad6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.103+0000 7fe1fffff640 1 -- 172.21.15.17:0/571220450 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20002cc60 con 0x7fe2081613a0 2023-08-09T12:44:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.103+0000 7fe1fffff640 1 -- 172.21.15.17:0/571220450 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20002cdc0 con 0x7fe2081613a0 2023-08-09T12:44:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.103+0000 7fe1fffff640 1 -- 172.21.15.17:0/571220450 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200034660 con 0x7fe2081613a0 2023-08-09T12:44:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.103+0000 7fe20f799640 1 -- 172.21.15.17:0/571220450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2081613a0 msgr2=0x7fe2080d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.103+0000 7fe20f799640 1 --2- 172.21.15.17:0/571220450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2081613a0 0x7fe2080d1110 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe200009d90 tx=0x7fe20002beb0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.104+0000 7fe20f799640 1 -- 172.21.15.17:0/571220450 shutdown_connections 2023-08-09T12:44:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.104+0000 7fe20f799640 1 --2- 172.21.15.17:0/571220450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2081613a0 0x7fe2080d1110 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.104+0000 7fe20f799640 1 --2- 172.21.15.17:0/571220450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2080704f0 0x7fe208160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.104+0000 7fe20f799640 1 -- 172.21.15.17:0/571220450 >> 172.21.15.17:0/571220450 conn(0x7fe2080d2b50 msgr2=0x7fe2080d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:13.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.104+0000 7fe20f799640 1 -- 172.21.15.17:0/571220450 shutdown_connections 2023-08-09T12:44:13.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.104+0000 7fe20f799640 1 -- 172.21.15.17:0/571220450 wait complete. 2023-08-09T12:44:13.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.106+0000 7fe20f799640 1 Processor -- start 2023-08-09T12:44:13.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.106+0000 7fe20f799640 1 -- start start 2023-08-09T12:44:13.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20f799640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2080704f0 0x7fe2081f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:13.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20f799640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe20815add0 0x7fe208154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:13.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20f799640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2081613a0 0x7fe2081551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:13.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20f799640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080c65d0 con 0x7fe2080704f0 2023-08-09T12:44:13.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20f799640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080c6820 con 0x7fe2081613a0 2023-08-09T12:44:13.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20f799640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080c6b00 con 0x7fe20815add0 2023-08-09T12:44:13.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20d535640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2080704f0 0x7fe2081f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:13.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20d535640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2080704f0 0x7fe2081f01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58454/0 (socket says 172.21.15.17:58454) 2023-08-09T12:44:13.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20d535640 1 -- 172.21.15.17:0/882694267 learned_addr learned my addr 172.21.15.17:0/882694267 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:13.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20d535640 1 -- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe20815add0 msgr2=0x7fe208154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:13.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20d535640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe20815add0 0x7fe208154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20d535640 1 -- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2081613a0 msgr2=0x7fe2081551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:13.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20d535640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2081613a0 0x7fe2081551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.108+0000 7fe20d535640 1 -- 172.21.15.17:0/882694267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200009a70 con 0x7fe2080704f0 2023-08-09T12:44:13.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.109+0000 7fe20d535640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2080704f0 0x7fe2081f01a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe20400c4d0 tx=0x7fe20400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:13.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.109+0000 7fe1fdffb640 1 -- 172.21.15.17:0/882694267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040074e0 con 0x7fe2080704f0 2023-08-09T12:44:13.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.109+0000 7fe1fdffb640 1 -- 172.21.15.17:0/882694267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe204007660 con 0x7fe2080704f0 2023-08-09T12:44:13.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.109+0000 7fe1fdffb640 1 -- 172.21.15.17:0/882694267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204004a20 con 0x7fe2080704f0 2023-08-09T12:44:13.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.109+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2080c6de0 con 0x7fe2080704f0 2023-08-09T12:44:13.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.109+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2081f06e0 con 0x7fe2080704f0 2023-08-09T12:44:13.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.110+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2080c7300 con 0x7fe2080704f0 2023-08-09T12:44:13.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.111+0000 7fe1fdffb640 1 -- 172.21.15.17:0/882694267 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe204004b80 con 0x7fe2080704f0 2023-08-09T12:44:13.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.113+0000 7fe1fdffb640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe1ec06a080 0x7fe1ec06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:13.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.113+0000 7fe1fdffb640 1 -- 172.21.15.17:0/882694267 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5826+0+0 (secure 0 0 0) 0x7fe204087710 con 0x7fe2080704f0 2023-08-09T12:44:13.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.114+0000 7fe20cd34640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe1ec06a080 0x7fe1ec06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.115+0000 7fe20cd34640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe1ec06a080 0x7fe1ec06c540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8006fd0 tx=0x7fe1f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:13.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.117+0000 7fe1fdffb640 1 -- 172.21.15.17:0/882694267 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe2080c7300 con 0x7fe2080704f0 2023-08-09T12:44:13.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.313+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe2080c7300 con 0x7fe2080704f0 2023-08-09T12:44:13.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.835+0000 7fe1fdffb640 1 -- 172.21.15.17:0/882694267 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe2080c7300 con 0x7fe2080704f0 2023-08-09T12:44:13.839 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:44:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe1ec06a080 msgr2=0x7fe1ec06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe1ec06a080 0x7fe1ec06c540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8006fd0 tx=0x7fe1f8008040 comp rx=0 tx=0).stop 2023-08-09T12:44:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2080704f0 msgr2=0x7fe2081f01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2080704f0 0x7fe2081f01a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe20400c4d0 tx=0x7fe20400c990 comp rx=0 tx=0).stop 2023-08-09T12:44:13.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 shutdown_connections 2023-08-09T12:44:13.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe1ec06a080 0x7fe1ec06c540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2081613a0 0x7fe2081551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe20815add0 0x7fe208154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 --2- 172.21.15.17:0/882694267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2080704f0 0x7fe2081f01a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:13.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 >> 172.21.15.17:0/882694267 conn(0x7fe2080d2b50 msgr2=0x7fe20806fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:13.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 shutdown_connections 2023-08-09T12:44:13.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:13.839+0000 7fe20f799640 1 -- 172.21.15.17:0/882694267 wait complete. 2023-08-09T12:44:13.866 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:44:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.094+0000 7fcd0d347640 1 Processor -- start 2023-08-09T12:44:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.094+0000 7fcd0d347640 1 -- start start 2023-08-09T12:44:14.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.095+0000 7fcd0d347640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd0815ce90 0x7fcd081616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.095+0000 7fcd0d347640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd080d29d0 0x7fcd080d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.095+0000 7fcd0d347640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd080b6460 con 0x7fcd080b6000 2023-08-09T12:44:14.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.095+0000 7fcd0d347640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080d33a0 con 0x7fcd0815ce90 2023-08-09T12:44:14.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.095+0000 7fcd0d347640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080cdd10 con 0x7fcd080d29d0 2023-08-09T12:44:14.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.096+0000 7fcd067fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcd080b6000 0x7fcd080cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33792/0 (socket says 172.21.15.17:33792) 2023-08-09T12:44:14.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.096+0000 7fcd067fc640 1 -- 172.21.15.17:0/1910023620 learned_addr learned my addr 172.21.15.17:0/1910023620 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:14.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.096+0000 7fcd06ffd640 1 --2- 172.21.15.17:0/1910023620 >> v2:172.21.15.142:3300/0 conn(0x7fcd0815ce90 0x7fcd081616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.096+0000 7fcd077fe640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd080d29d0 0x7fcd080d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.096+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419086944 0 0) 0x7fcd080b6460 con 0x7fcd080b6000 2023-08-09T12:44:14.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.096+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf0003520 con 0x7fcd080b6000 2023-08-09T12:44:14.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 435834941 0 0) 0x7fccf0003520 con 0x7fcd080b6000 2023-08-09T12:44:14.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd080d29d0 msgr2=0x7fcd080d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:14.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd080d29d0 0x7fcd080d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 >> v2:172.21.15.142:3300/0 conn(0x7fcd0815ce90 msgr2=0x7fcd081616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 --2- 172.21.15.17:0/1910023620 >> v2:172.21.15.142:3300/0 conn(0x7fcd0815ce90 0x7fcd081616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080cdff0 con 0x7fcd080b6000 2023-08-09T12:44:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fccfc001670 con 0x7fcd080b6000 2023-08-09T12:44:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 >> v1:172.21.15.17:6789/0 conn(0x7fcd080b6000 legacy=0x7fcd080cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd080d29d0 0x7fccf0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf0003ef0 0x7fccf00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf0004d00 0x7fccf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080d33a0 con 0x7fccf0004d00 2023-08-09T12:44:14.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080cdd10 con 0x7fccf0003ef0 2023-08-09T12:44:14.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf000b980 con 0x7fcd080d29d0 2023-08-09T12:44:14.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.097+0000 7fcd077fe640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf0004d00 0x7fccf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.098+0000 7fcd067fc640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf0003ef0 0x7fccf00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.098+0000 7fcd06ffd640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd080d29d0 0x7fccf0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.098+0000 7fcd077fe640 1 -- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd080d29d0 msgr2=0x7fccf0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:14.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.098+0000 7fcd077fe640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd080d29d0 0x7fccf0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.098+0000 7fcd077fe640 1 -- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf0003ef0 msgr2=0x7fccf00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:14.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.098+0000 7fcd077fe640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf0003ef0 0x7fccf00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.098+0000 7fcd077fe640 1 -- 172.21.15.17:0/1910023620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0003520 con 0x7fccf0004d00 2023-08-09T12:44:14.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.099+0000 7fcd077fe640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf0004d00 0x7fccf0005180 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009fc0 tx=0x7fccf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862446015651146d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:14.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.099+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0002cc00 con 0x7fccf0004d00 2023-08-09T12:44:14.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.099+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0000f040 con 0x7fccf0004d00 2023-08-09T12:44:14.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.099+0000 7fcd05ffb640 1 -- 172.21.15.17:0/1910023620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00034440 con 0x7fccf0004d00 2023-08-09T12:44:14.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.100+0000 7fcd0d347640 1 -- 172.21.15.17:0/1910023620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf0004d00 msgr2=0x7fccf0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.100+0000 7fcd0d347640 1 --2- 172.21.15.17:0/1910023620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf0004d00 0x7fccf0005180 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009fc0 tx=0x7fccf00057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.100+0000 7fcd077fe640 1 -- 172.21.15.17:0/1910023620 reap_dead start 2023-08-09T12:44:14.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.100+0000 7fcd0d347640 1 -- 172.21.15.17:0/1910023620 shutdown_connections 2023-08-09T12:44:14.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.100+0000 7fcd0d347640 1 -- 172.21.15.17:0/1910023620 >> 172.21.15.17:0/1910023620 conn(0x7fcd0806fde0 msgr2=0x7fcd080701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:14.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.100+0000 7fcd0d347640 1 -- 172.21.15.17:0/1910023620 shutdown_connections 2023-08-09T12:44:14.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.100+0000 7fcd0d347640 1 -- 172.21.15.17:0/1910023620 wait complete. 2023-08-09T12:44:14.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.102+0000 7fcd0d347640 1 Processor -- start 2023-08-09T12:44:14.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.102+0000 7fcd0d347640 1 -- start start 2023-08-09T12:44:14.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd0d347640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf0004d00 0x7fcd0815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd0d347640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd081f6750 0x7fcd0815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd0d347640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd081e8910 0x7fcd081e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd0d347640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd081e92d0 con 0x7fcd081e8910 2023-08-09T12:44:14.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd0d347640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080aa710 con 0x7fcd081f6750 2023-08-09T12:44:14.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd0d347640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0815f7c0 con 0x7fccf0004d00 2023-08-09T12:44:14.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd081e8910 0x7fcd081e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd081e8910 0x7fcd081e8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58474/0 (socket says 172.21.15.17:58474) 2023-08-09T12:44:14.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.103+0000 7fcd077fe640 1 -- 172.21.15.17:0/2650360956 learned_addr learned my addr 172.21.15.17:0/2650360956 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:14.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd067fc640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd081f6750 0x7fcd0815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd06ffd640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf0004d00 0x7fcd0815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd077fe640 1 -- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf0004d00 msgr2=0x7fcd0815f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd077fe640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf0004d00 0x7fcd0815f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd077fe640 1 -- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd081f6750 msgr2=0x7fcd0815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd077fe640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd081f6750 0x7fcd0815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd077fe640 1 -- 172.21.15.17:0/2650360956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0815faa0 con 0x7fcd081e8910 2023-08-09T12:44:14.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd067fc640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd081f6750 0x7fcd0815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:14.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fcd077fe640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd081e8910 0x7fcd081e8d90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcd00037040 tx=0x7fcd00009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:14.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fccef7fe640 1 -- 172.21.15.17:0/2650360956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd000349c0 con 0x7fcd081e8910 2023-08-09T12:44:14.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fccef7fe640 1 -- 172.21.15.17:0/2650360956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd00034b20 con 0x7fcd081e8910 2023-08-09T12:44:14.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.104+0000 7fccef7fe640 1 -- 172.21.15.17:0/2650360956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00003990 con 0x7fcd081e8910 2023-08-09T12:44:14.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.105+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0815fd80 con 0x7fcd081e8910 2023-08-09T12:44:14.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.105+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd081f6bd0 con 0x7fcd081e8910 2023-08-09T12:44:14.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.106+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0815d4b0 con 0x7fcd081e8910 2023-08-09T12:44:14.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.107+0000 7fccef7fe640 1 -- 172.21.15.17:0/2650360956 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd0003e440 con 0x7fcd081e8910 2023-08-09T12:44:14.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.108+0000 7fccef7fe640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccf406a080 0x7fccf406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.108+0000 7fccef7fe640 1 -- 172.21.15.17:0/2650360956 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcd000aa070 con 0x7fcd081e8910 2023-08-09T12:44:14.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.108+0000 7fcd06ffd640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccf406a080 0x7fccf406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.109+0000 7fcd06ffd640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccf406a080 0x7fccf406c540 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcd080d2220 tx=0x7fccf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:14.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.112+0000 7fccef7fe640 1 -- 172.21.15.17:0/2650360956 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcd0815d4b0 con 0x7fcd081e8910 2023-08-09T12:44:14.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.308+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcd0815d4b0 con 0x7fcd081e8910 2023-08-09T12:44:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.317+0000 7fccef7fe640 1 -- 172.21.15.17:0/2650360956 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd0815d4b0 con 0x7fcd081e8910 2023-08-09T12:44:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccf406a080 msgr2=0x7fccf406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccf406a080 0x7fccf406c540 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcd080d2220 tx=0x7fccf8008040 comp rx=0 tx=0).stop 2023-08-09T12:44:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd081e8910 msgr2=0x7fcd081e8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd081e8910 0x7fcd081e8d90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcd00037040 tx=0x7fcd00009750 comp rx=0 tx=0).stop 2023-08-09T12:44:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 shutdown_connections 2023-08-09T12:44:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccf406a080 0x7fccf406c540 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd081e8910 0x7fcd081e8d90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd081f6750 0x7fcd0815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 --2- 172.21.15.17:0/2650360956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf0004d00 0x7fcd0815f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.320+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 >> 172.21.15.17:0/2650360956 conn(0x7fcd0806fde0 msgr2=0x7fcd080d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.321+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 shutdown_connections 2023-08-09T12:44:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.321+0000 7fcd0d347640 1 -- 172.21.15.17:0/2650360956 wait complete. 2023-08-09T12:44:14.343 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-08-09T12:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.556+0000 7f0777a5e640 1 Processor -- start 2023-08-09T12:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.556+0000 7f0777a5e640 1 -- start start 2023-08-09T12:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0777a5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700cab00 0x7f07700b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0777a5e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07700b0790 0x7f077006b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0777a5e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07700c9a60 con 0x7f077015cf70 2023-08-09T12:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0777a5e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07700b0c40 con 0x7f07700b0790 2023-08-09T12:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0777a5e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07700c9d40 con 0x7f07700cab00 2023-08-09T12:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0775ffb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07700b0790 0x7f077006b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0774ff9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700cab00 0x7f07700b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0775ffb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07700b0790 0x7f077006b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:41188/0 (socket says 172.21.15.17:41188) 2023-08-09T12:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.558+0000 7f0775ffb640 1 -- 172.21.15.17:0/3422046676 learned_addr learned my addr 172.21.15.17:0/3422046676 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.559+0000 7f0774ff9640 1 -- 172.21.15.17:0/3422046676 >> v2:172.21.15.142:3300/0 conn(0x7f07700b0790 msgr2=0x7f077006b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.559+0000 7f0774ff9640 1 --2- 172.21.15.17:0/3422046676 >> v2:172.21.15.142:3300/0 conn(0x7f07700b0790 0x7f077006b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.559+0000 7f0774ff9640 1 -- 172.21.15.17:0/3422046676 >> v1:172.21.15.142:6789/0 conn(0x7f077015cf70 legacy=0x7f077006fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.559+0000 7f0774ff9640 1 -- 172.21.15.17:0/3422046676 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700ca020 con 0x7f07700cab00 2023-08-09T12:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.561+0000 7f0774ff9640 1 --2- 172.21.15.17:0/3422046676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700cab00 0x7f07700b0250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07600097a0 tx=0x7f076002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=386ea9ee70f2e7a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.561+0000 7f0767fff640 1 -- 172.21.15.17:0/3422046676 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760031830 con 0x7f07700cab00 2023-08-09T12:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.561+0000 7f0767fff640 1 -- 172.21.15.17:0/3422046676 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760031990 con 0x7f07700cab00 2023-08-09T12:44:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.561+0000 7f0767fff640 1 -- 172.21.15.17:0/3422046676 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760031d20 con 0x7f07700cab00 2023-08-09T12:44:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.562+0000 7f0777a5e640 1 -- 172.21.15.17:0/3422046676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700cab00 msgr2=0x7f07700b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.562+0000 7f0777a5e640 1 --2- 172.21.15.17:0/3422046676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700cab00 0x7f07700b0250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07600097a0 tx=0x7f076002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.562+0000 7f0777a5e640 1 -- 172.21.15.17:0/3422046676 shutdown_connections 2023-08-09T12:44:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.562+0000 7f0777a5e640 1 --2- 172.21.15.17:0/3422046676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700cab00 0x7f07700b0250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.562+0000 7f0777a5e640 1 --2- 172.21.15.17:0/3422046676 >> v2:172.21.15.142:3300/0 conn(0x7f07700b0790 0x7f077006b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.562+0000 7f0777a5e640 1 -- 172.21.15.17:0/3422046676 >> 172.21.15.17:0/3422046676 conn(0x7f07700cb250 msgr2=0x7f07700cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.562+0000 7f0777a5e640 1 -- 172.21.15.17:0/3422046676 shutdown_connections 2023-08-09T12:44:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.563+0000 7f0777a5e640 1 -- 172.21.15.17:0/3422046676 wait complete. 2023-08-09T12:44:14.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.565+0000 7f0777a5e640 1 Processor -- start 2023-08-09T12:44:14.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.565+0000 7f0777a5e640 1 -- start start 2023-08-09T12:44:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.566+0000 7f0777a5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700b0790 0x7f077014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.566+0000 7f0777a5e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07700cab00 0x7f0770151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.566+0000 7f0777a5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f077015cf70 0x7f0770152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.566+0000 7f0777a5e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07700c3a60 con 0x7f077015cf70 2023-08-09T12:44:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.566+0000 7f0777a5e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0770153bc0 con 0x7f07700cab00 2023-08-09T12:44:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.566+0000 7f0777a5e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0770153ea0 con 0x7f07700b0790 2023-08-09T12:44:14.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0775ffb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f077015cf70 0x7f0770152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0775ffb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f077015cf70 0x7f0770152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58482/0 (socket says 172.21.15.17:58482) 2023-08-09T12:44:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0775ffb640 1 -- 172.21.15.17:0/2449376692 learned_addr learned my addr 172.21.15.17:0/2449376692 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0774ff9640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07700cab00 0x7f0770151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f07757fa640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700b0790 0x7f077014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0775ffb640 1 -- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700b0790 msgr2=0x7f077014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0775ffb640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700b0790 0x7f077014e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0775ffb640 1 -- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07700cab00 msgr2=0x7f0770151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0775ffb640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07700cab00 0x7f0770151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0775ffb640 1 -- 172.21.15.17:0/2449376692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760009400 con 0x7f077015cf70 2023-08-09T12:44:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.567+0000 7f0774ff9640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07700cab00 0x7f0770151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:44:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.568+0000 7f0775ffb640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f077015cf70 0x7f0770152440 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f076800efc0 tx=0x7f076800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.568+0000 7f0765ffb640 1 -- 172.21.15.17:0/2449376692 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800cd20 con 0x7f077015cf70 2023-08-09T12:44:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.568+0000 7f0765ffb640 1 -- 172.21.15.17:0/2449376692 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076800f040 con 0x7f077015cf70 2023-08-09T12:44:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.568+0000 7f0765ffb640 1 -- 172.21.15.17:0/2449376692 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768003bd0 con 0x7f077015cf70 2023-08-09T12:44:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.568+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0770154180 con 0x7f077015cf70 2023-08-09T12:44:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.568+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07700c42c0 con 0x7f077015cf70 2023-08-09T12:44:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.569+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0770153a20 con 0x7f077015cf70 2023-08-09T12:44:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.570+0000 7f0765ffb640 1 -- 172.21.15.17:0/2449376692 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0768003d30 con 0x7f077015cf70 2023-08-09T12:44:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.571+0000 7f0765ffb640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f075406a050 0x7f075406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.571+0000 7f0765ffb640 1 -- 172.21.15.17:0/2449376692 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f07680888d0 con 0x7f077015cf70 2023-08-09T12:44:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.572+0000 7f07757fa640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f075406a050 0x7f075406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:14.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.573+0000 7f07757fa640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f075406a050 0x7f075406c510 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f07700b0760 tx=0x7f076c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.576+0000 7f0765ffb640 1 -- 172.21.15.17:0/2449376692 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0770153a20 con 0x7f077015cf70 2023-08-09T12:44:14.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.842+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f0770153a20 con 0x7f077015cf70 2023-08-09T12:44:14.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.854+0000 7f0765ffb640 1 -- 172.21.15.17:0/2449376692 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v259) v1 ==== 134+0+0 (secure 0 0 0) 0x7f0770153a20 con 0x7f077015cf70 2023-08-09T12:44:14.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.858+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f075406a050 msgr2=0x7f075406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.858+0000 7f0777a5e640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f075406a050 0x7f075406c510 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f07700b0760 tx=0x7f076c009040 comp rx=0 tx=0).stop 2023-08-09T12:44:14.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.858+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f077015cf70 msgr2=0x7f0770152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:14.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.858+0000 7f0777a5e640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f077015cf70 0x7f0770152440 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f076800efc0 tx=0x7f076800c490 comp rx=0 tx=0).stop 2023-08-09T12:44:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.859+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 shutdown_connections 2023-08-09T12:44:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.859+0000 7f0777a5e640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f075406a050 0x7f075406c510 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.859+0000 7f0777a5e640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f077015cf70 0x7f0770152440 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.859+0000 7f0777a5e640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07700cab00 0x7f0770151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.859+0000 7f0777a5e640 1 --2- 172.21.15.17:0/2449376692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07700b0790 0x7f077014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.859+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 >> 172.21.15.17:0/2449376692 conn(0x7f07700cb250 msgr2=0x7f07700cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:14.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.859+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 shutdown_connections 2023-08-09T12:44:14.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:14.859+0000 7f0777a5e640 1 -- 172.21.15.17:0/2449376692 wait complete. 2023-08-09T12:44:14.882 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-09T12:44:14.883 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-08-09T12:44:14.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-08-09T12:44:15.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.102+0000 7f26e080f640 1 Processor -- start 2023-08-09T12:44:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.102+0000 7f26e080f640 1 -- start start 2023-08-09T12:44:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.103+0000 7f26e080f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f26dc15aa70 0x7f26dc0ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.103+0000 7f26e080f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ca5a0 0x7f26dc0ab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.103+0000 7f26e080f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26dc0ab970 0x7f26dc15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.103+0000 7f26e080f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc0cadf0 con 0x7f26dc15aa70 2023-08-09T12:44:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.103+0000 7f26e080f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc0c99a0 con 0x7f26dc0ab970 2023-08-09T12:44:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.103+0000 7f26e080f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0abe00 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26db7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f26dc15aa70 0x7f26dc0ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26db7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f26dc15aa70 0x7f26dc0ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58492/0 (socket says 172.21.15.17:58492) 2023-08-09T12:44:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26db7fe640 1 -- 172.21.15.17:0/1137354388 learned_addr learned my addr 172.21.15.17:0/1137354388 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26dbfff640 1 --2- 172.21.15.17:0/1137354388 >> v2:172.21.15.142:3300/0 conn(0x7f26dc0ab970 0x7f26dc15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26daffd640 1 --2- 172.21.15.17:0/1137354388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ca5a0 0x7f26dc0ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26db7fe640 1 -- 172.21.15.17:0/1137354388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ca5a0 msgr2=0x7f26dc0ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:15.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26db7fe640 1 --2- 172.21.15.17:0/1137354388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ca5a0 0x7f26dc0ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26db7fe640 1 -- 172.21.15.17:0/1137354388 >> v2:172.21.15.142:3300/0 conn(0x7f26dc0ab970 msgr2=0x7f26dc15ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:15.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26db7fe640 1 --2- 172.21.15.17:0/1137354388 >> v2:172.21.15.142:3300/0 conn(0x7f26dc0ab970 0x7f26dc15ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26db7fe640 1 -- 172.21.15.17:0/1137354388 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc0ca1e0 con 0x7f26dc15aa70 2023-08-09T12:44:15.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26daffd640 1 --2- 172.21.15.17:0/1137354388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ca5a0 0x7f26dc0ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:15.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.104+0000 7f26dbfff640 1 --2- 172.21.15.17:0/1137354388 >> v2:172.21.15.142:3300/0 conn(0x7f26dc0ab970 0x7f26dc15ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:15.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.105+0000 7f26db7fe640 1 --2- 172.21.15.17:0/1137354388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc15aa70 0x7f26dc0ad660 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0adfe0 tx=0x7f26cc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40b7c3b2be7840c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.106+0000 7f26da7fc640 1 -- 172.21.15.17:0/1137354388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc004230 con 0x7f26dc15aa70 2023-08-09T12:44:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.106+0000 7f26da7fc640 1 -- 172.21.15.17:0/1137354388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc004390 con 0x7f26dc15aa70 2023-08-09T12:44:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.106+0000 7f26da7fc640 1 -- 172.21.15.17:0/1137354388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc003810 con 0x7f26dc15aa70 2023-08-09T12:44:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.106+0000 7f26e080f640 1 -- 172.21.15.17:0/1137354388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc15aa70 msgr2=0x7f26dc0ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.106+0000 7f26e080f640 1 --2- 172.21.15.17:0/1137354388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc15aa70 0x7f26dc0ad660 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0adfe0 tx=0x7f26cc02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.106+0000 7f26e080f640 1 -- 172.21.15.17:0/1137354388 shutdown_connections 2023-08-09T12:44:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.106+0000 7f26e080f640 1 --2- 172.21.15.17:0/1137354388 >> v2:172.21.15.142:3300/0 conn(0x7f26dc0ab970 0x7f26dc15ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.106+0000 7f26e080f640 1 --2- 172.21.15.17:0/1137354388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ca5a0 0x7f26dc0ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.107+0000 7f26e080f640 1 --2- 172.21.15.17:0/1137354388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc15aa70 0x7f26dc0ad660 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.107+0000 7f26e080f640 1 -- 172.21.15.17:0/1137354388 >> 172.21.15.17:0/1137354388 conn(0x7f26dc0cec00 msgr2=0x7f26dc0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:15.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.107+0000 7f26e080f640 1 -- 172.21.15.17:0/1137354388 shutdown_connections 2023-08-09T12:44:15.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.107+0000 7f26e080f640 1 -- 172.21.15.17:0/1137354388 wait complete. 2023-08-09T12:44:15.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.108+0000 7f26e080f640 1 Processor -- start 2023-08-09T12:44:15.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.109+0000 7f26e080f640 1 -- start start 2023-08-09T12:44:15.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.109+0000 7f26e080f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ab970 0x7f26dc071400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:15.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.109+0000 7f26e080f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc0ca5a0 0x7f26dc1f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:15.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26e080f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26dc15aa70 0x7f26dc158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:15.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26e080f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc1f5620 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26e080f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc1f52d0 con 0x7f26dc15aa70 2023-08-09T12:44:15.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26e080f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc1f2550 con 0x7f26dc0ab970 2023-08-09T12:44:15.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc0ca5a0 0x7f26dc1f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:15.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc0ca5a0 0x7f26dc1f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58498/0 (socket says 172.21.15.17:58498) 2023-08-09T12:44:15.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26daffd640 1 -- 172.21.15.17:0/3554228717 learned_addr learned my addr 172.21.15.17:0/3554228717 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:15.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26dbfff640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26dc15aa70 0x7f26dc158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:15.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26db7fe640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ab970 0x7f26dc071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:15.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26daffd640 1 -- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ab970 msgr2=0x7f26dc071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:15.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26daffd640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ab970 0x7f26dc071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26daffd640 1 -- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26dc15aa70 msgr2=0x7f26dc158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:15.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26daffd640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26dc15aa70 0x7f26dc158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26daffd640 1 -- 172.21.15.17:0/3554228717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc009460 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.110+0000 7f26db7fe640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ab970 0x7f26dc071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:15.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.111+0000 7f26daffd640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc0ca5a0 0x7f26dc1f1d00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c820 tx=0x7f26d000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:15.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.111+0000 7f26c3fff640 1 -- 172.21.15.17:0/3554228717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0007a30 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.111+0000 7f26c3fff640 1 -- 172.21.15.17:0/3554228717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d0007b90 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.111+0000 7f26c3fff640 1 -- 172.21.15.17:0/3554228717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000ce70 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.111+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc1f2830 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.111+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc1f2240 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.112+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc1f5760 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.113+0000 7f26c3fff640 1 -- 172.21.15.17:0/3554228717 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f26d00113f0 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.114+0000 7f26c3fff640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f26c806a050 0x7f26c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:15.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.114+0000 7f26c3fff640 1 -- 172.21.15.17:0/3554228717 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f26d0088420 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.115+0000 7f26db7fe640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f26c806a050 0x7f26c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:15.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.116+0000 7f26db7fe640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f26c806a050 0x7f26c806c510 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26cc035000 tx=0x7f26cc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:15.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.119+0000 7f26c3fff640 1 -- 172.21.15.17:0/3554228717 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f26dc1f5760 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.386+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f26dc1f5760 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.861+0000 7f26c3fff640 1 -- 172.21.15.17:0/3554228717 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v260) v1 ==== 136+0+0 (secure 0 0 0) 0x7f26dc1f5760 con 0x7f26dc0ca5a0 2023-08-09T12:44:15.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.864+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f26c806a050 msgr2=0x7f26c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:15.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.864+0000 7f26e080f640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f26c806a050 0x7f26c806c510 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26cc035000 tx=0x7f26cc008030 comp rx=0 tx=0).stop 2023-08-09T12:44:15.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.864+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc0ca5a0 msgr2=0x7f26dc1f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.864+0000 7f26e080f640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc0ca5a0 0x7f26dc1f1d00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c820 tx=0x7f26d000cc20 comp rx=0 tx=0).stop 2023-08-09T12:44:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.865+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 shutdown_connections 2023-08-09T12:44:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.865+0000 7f26e080f640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f26c806a050 0x7f26c806c510 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.865+0000 7f26e080f640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26dc15aa70 0x7f26dc158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.865+0000 7f26e080f640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26dc0ca5a0 0x7f26dc1f1d00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.865+0000 7f26e080f640 1 --2- 172.21.15.17:0/3554228717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26dc0ab970 0x7f26dc071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.865+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 >> 172.21.15.17:0/3554228717 conn(0x7f26dc0cec00 msgr2=0x7f26dc06b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.865+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 shutdown_connections 2023-08-09T12:44:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:15.865+0000 7f26e080f640 1 -- 172.21.15.17:0/3554228717 wait complete. 2023-08-09T12:44:15.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-09T12:44:16.126 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_objectstore":"memstore"} 2023-08-09T12:44:16.127 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-09T12:44:16.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:16.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.358+0000 7ff94a2ad640 1 Processor -- start 2023-08-09T12:44:16.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.358+0000 7ff94a2ad640 1 -- start start 2023-08-09T12:44:16.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.359+0000 7ff94a2ad640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff94415ce90 0x7ff9441616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.359+0000 7ff94a2ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9440cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.359+0000 7ff94a2ad640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9440b6460 con 0x7ff9440d29d0 2023-08-09T12:44:16.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.359+0000 7ff94a2ad640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9440cda40 con 0x7ff94415ce90 2023-08-09T12:44:16.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.359+0000 7ff94a2ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440cdd10 con 0x7ff9440b6000 2023-08-09T12:44:16.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.359+0000 7ff943fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff94415ce90 0x7ff9441616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff943fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff94415ce90 0x7ff9441616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58512/0 (socket says 172.21.15.17:58512) 2023-08-09T12:44:16.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff943fff640 1 -- 172.21.15.17:0/4249128540 learned_addr learned my addr 172.21.15.17:0/4249128540 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:16.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff9437fe640 1 --2- 172.21.15.17:0/4249128540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9440cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff943fff640 1 -- 172.21.15.17:0/4249128540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 msgr2=0x7ff9440cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff943fff640 1 --2- 172.21.15.17:0/4249128540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9440cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff943fff640 1 -- 172.21.15.17:0/4249128540 >> v1:172.21.15.17:6789/0 conn(0x7ff9440d29d0 legacy=0x7ff9440d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff943fff640 1 -- 172.21.15.17:0/4249128540 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440cdff0 con 0x7ff94415ce90 2023-08-09T12:44:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff942ffd640 1 -- 172.21.15.17:0/4249128540 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783111634 0 0) 0x7ff9440b6460 con 0x7ff9440d29d0 2023-08-09T12:44:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.360+0000 7ff9437fe640 1 --2- 172.21.15.17:0/4249128540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9440cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:16.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.361+0000 7ff943fff640 1 --2- 172.21.15.17:0/4249128540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff9441616e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff934009870 tx=0x7ff93402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4edfb903488c21d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:16.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff942ffd640 1 -- 172.21.15.17:0/4249128540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934030840 con 0x7ff94415ce90 2023-08-09T12:44:16.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff942ffd640 1 -- 172.21.15.17:0/4249128540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9340309a0 con 0x7ff94415ce90 2023-08-09T12:44:16.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff942ffd640 1 -- 172.21.15.17:0/4249128540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934030d30 con 0x7ff94415ce90 2023-08-09T12:44:16.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff94a2ad640 1 -- 172.21.15.17:0/4249128540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 msgr2=0x7ff9441616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/4249128540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff9441616e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff934009870 tx=0x7ff93402b980 comp rx=0 tx=0).stop 2023-08-09T12:44:16.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff94a2ad640 1 -- 172.21.15.17:0/4249128540 shutdown_connections 2023-08-09T12:44:16.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/4249128540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9440cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/4249128540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff9441616e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff94a2ad640 1 -- 172.21.15.17:0/4249128540 >> 172.21.15.17:0/4249128540 conn(0x7ff94406fde0 msgr2=0x7ff9440701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:16.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff94a2ad640 1 -- 172.21.15.17:0/4249128540 shutdown_connections 2023-08-09T12:44:16.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.362+0000 7ff94a2ad640 1 -- 172.21.15.17:0/4249128540 wait complete. 2023-08-09T12:44:16.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.364+0000 7ff94a2ad640 1 Processor -- start 2023-08-09T12:44:16.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.364+0000 7ff94a2ad640 1 -- start start 2023-08-09T12:44:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.365+0000 7ff94a2ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9441e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.365+0000 7ff94a2ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9440d29d0 0x7ff94415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.365+0000 7ff94a2ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff94415f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.365+0000 7ff94a2ad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440cb140 con 0x7ff94415ce90 2023-08-09T12:44:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.365+0000 7ff94a2ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94415d270 con 0x7ff9440d29d0 2023-08-09T12:44:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.365+0000 7ff94a2ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94415d550 con 0x7ff9440b6000 2023-08-09T12:44:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff94415f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff94415f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58520/0 (socket says 172.21.15.17:58520) 2023-08-09T12:44:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 -- 172.21.15.17:0/484416221 learned_addr learned my addr 172.21.15.17:0/484416221 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff943fff640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9441e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff9437fe640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9440d29d0 0x7ff94415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 -- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 msgr2=0x7ff9441e6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9441e6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 -- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9440d29d0 msgr2=0x7ff94415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9440d29d0 0x7ff94415ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 -- 172.21.15.17:0/484416221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340094d0 con 0x7ff94415ce90 2023-08-09T12:44:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.366+0000 7ff94884a640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff94415f2a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00c480 tx=0x7ff93c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.367+0000 7ff940ff9640 1 -- 172.21.15.17:0/484416221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c005480 con 0x7ff94415ce90 2023-08-09T12:44:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.367+0000 7ff940ff9640 1 -- 172.21.15.17:0/484416221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c0035f0 con 0x7ff94415ce90 2023-08-09T12:44:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.367+0000 7ff940ff9640 1 -- 172.21.15.17:0/484416221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0039a0 con 0x7ff94415ce90 2023-08-09T12:44:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.367+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9440cadd0 con 0x7ff94415ce90 2023-08-09T12:44:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.367+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94415f7e0 con 0x7ff94415ce90 2023-08-09T12:44:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.368+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944067400 con 0x7ff94415ce90 2023-08-09T12:44:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.369+0000 7ff940ff9640 1 -- 172.21.15.17:0/484416221 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff93c003b00 con 0x7ff94415ce90 2023-08-09T12:44:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.370+0000 7ff940ff9640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff92406a080 0x7ff92406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.370+0000 7ff940ff9640 1 -- 172.21.15.17:0/484416221 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff93c087e10 con 0x7ff94415ce90 2023-08-09T12:44:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.371+0000 7ff943fff640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff92406a080 0x7ff92406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.372+0000 7ff943fff640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff92406a080 0x7ff92406c540 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff934036000 tx=0x7ff934008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.375+0000 7ff940ff9640 1 -- 172.21.15.17:0/484416221 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff93c08b030 con 0x7ff94415ce90 2023-08-09T12:44:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.574+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9440cb2f0 con 0x7ff94415ce90 2023-08-09T12:44:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.576+0000 7ff940ff9640 1 -- 172.21.15.17:0/484416221 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+14745 (secure 0 0 0) 0x7ff9440cb2f0 con 0x7ff94415ce90 2023-08-09T12:44:16.580 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:16.580 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":83,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:13.829164+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/1591311172":"2023-08-10T12:44:10.734043+0000","172.21.15.17:6832/1591311172":"2023-08-10T12:44:10.734043+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff92406a080 msgr2=0x7ff92406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff92406a080 0x7ff92406c540 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff934036000 tx=0x7ff934008030 comp rx=0 tx=0).stop 2023-08-09T12:44:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 msgr2=0x7ff94415f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff94415f2a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00c480 tx=0x7ff93c00c940 comp rx=0 tx=0).stop 2023-08-09T12:44:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 shutdown_connections 2023-08-09T12:44:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff92406a080 0x7ff92406c540 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94415ce90 0x7ff94415f2a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9440d29d0 0x7ff94415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 --2- 172.21.15.17:0/484416221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9440b6000 0x7ff9441e6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 >> 172.21.15.17:0/484416221 conn(0x7ff94406fde0 msgr2=0x7ff9440b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 shutdown_connections 2023-08-09T12:44:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.579+0000 7ff94a2ad640 1 -- 172.21.15.17:0/484416221 wait complete. 2023-08-09T12:44:16.603 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:44:16.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:44:16.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.835+0000 7f239d86a640 1 Processor -- start 2023-08-09T12:44:16.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.835+0000 7f239d86a640 1 -- start start 2023-08-09T12:44:16.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.836+0000 7f239d86a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f239815cb40 0x7f23981609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.837+0000 7f239d86a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23980d0f00 con 0x7f23980b8420 2023-08-09T12:44:16.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.837+0000 7f239d86a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23981611f0 con 0x7f23980cdf70 2023-08-09T12:44:16.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.837+0000 7f239d86a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23981614d0 con 0x7f239815cb40 2023-08-09T12:44:16.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.837+0000 7f238ffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f23980b8420 0x7f23980cd860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33802/0 (socket says 172.21.15.17:33802) 2023-08-09T12:44:16.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.837+0000 7f238ffff640 1 -- 172.21.15.17:0/2837518756 learned_addr learned my addr 172.21.15.17:0/2837518756 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:16.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.837+0000 7f239c868640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f239815cb40 0x7f23981609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.837+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595536096 0 0) 0x7f23980d0f00 con 0x7f23980b8420 2023-08-09T12:44:16.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.837+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2380003520 con 0x7f23980b8420 2023-08-09T12:44:16.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3058844469 0 0) 0x7f2380003520 con 0x7f23980b8420 2023-08-09T12:44:16.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f239815cb40 msgr2=0x7f23981609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:16.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f239815cb40 0x7f23981609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 >> v1:172.21.15.142:6789/0 conn(0x7f23980cdf70 legacy=0x7f23980d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23981617b0 con 0x7f23980b8420 2023-08-09T12:44:16.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f2388001670 con 0x7f23980b8420 2023-08-09T12:44:16.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 >> v1:172.21.15.17:6789/0 conn(0x7f23980b8420 legacy=0x7f23980cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23800039a0 0x7f2380003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23800047c0 0x7f2380004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f239815cb40 0x7f2380005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23981614d0 con 0x7f23800039a0 2023-08-09T12:44:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238000bac0 con 0x7f23800047c0 2023-08-09T12:44:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238000bc80 con 0x7f239815cb40 2023-08-09T12:44:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.838+0000 7f239c868640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23800039a0 0x7f2380003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.839+0000 7f238ffff640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23800047c0 0x7f2380004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.839+0000 7f239c868640 1 -- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f239815cb40 msgr2=0x7f2380005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.839+0000 7f239c868640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f239815cb40 0x7f2380005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.839+0000 7f239c868640 1 -- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23800047c0 msgr2=0x7f2380004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.839+0000 7f239c868640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23800047c0 0x7f2380004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.839+0000 7f239c868640 1 -- 172.21.15.17:0/2837518756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380003520 con 0x7f23800039a0 2023-08-09T12:44:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.839+0000 7f238ffff640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23800047c0 0x7f2380004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.840+0000 7f239c868640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23800039a0 0x7f2380003dc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2394009f90 tx=0x7f23800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bcfcf2761199db server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.840+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239402cbf0 con 0x7f23800039a0 2023-08-09T12:44:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.840+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239400f040 con 0x7f23800039a0 2023-08-09T12:44:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.840+0000 7f238f7fe640 1 -- 172.21.15.17:0/2837518756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394034440 con 0x7f23800039a0 2023-08-09T12:44:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.841+0000 7f239d86a640 1 -- 172.21.15.17:0/2837518756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23800039a0 msgr2=0x7f2380003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.841+0000 7f239d86a640 1 --2- 172.21.15.17:0/2837518756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23800039a0 0x7f2380003dc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2394009f90 tx=0x7f23800057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.841+0000 7f239d069640 1 -- 172.21.15.17:0/2837518756 reap_dead start 2023-08-09T12:44:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.841+0000 7f239d86a640 1 -- 172.21.15.17:0/2837518756 shutdown_connections 2023-08-09T12:44:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.841+0000 7f239d86a640 1 -- 172.21.15.17:0/2837518756 >> 172.21.15.17:0/2837518756 conn(0x7f23980d2ab0 msgr2=0x7f23980d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:16.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.841+0000 7f239d86a640 1 -- 172.21.15.17:0/2837518756 shutdown_connections 2023-08-09T12:44:16.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.841+0000 7f239d86a640 1 -- 172.21.15.17:0/2837518756 wait complete. 2023-08-09T12:44:16.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.843+0000 7f239d86a640 1 Processor -- start 2023-08-09T12:44:16.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.843+0000 7f239d86a640 1 -- start start 2023-08-09T12:44:16.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.844+0000 7f239d86a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23800039a0 0x7f2398149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.844+0000 7f239d86a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2398157670 0x7f239814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.844+0000 7f239d86a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980c89b0 0x7f23981597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.844+0000 7f239d86a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239815f170 con 0x7f23980c89b0 2023-08-09T12:44:16.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.844+0000 7f239d86a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239814cb70 con 0x7f2398157670 2023-08-09T12:44:16.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.844+0000 7f239d86a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239815e4f0 con 0x7f23800039a0 2023-08-09T12:44:16.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.844+0000 7f239d069640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980c89b0 0x7f23981597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239d069640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980c89b0 0x7f23981597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58532/0 (socket says 172.21.15.17:58532) 2023-08-09T12:44:16.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239d069640 1 -- 172.21.15.17:0/2750054126 learned_addr learned my addr 172.21.15.17:0/2750054126 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f238ffff640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2398157670 0x7f239814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239c868640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23800039a0 0x7f2398149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239d069640 1 -- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23800039a0 msgr2=0x7f2398149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239d069640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23800039a0 0x7f2398149b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239d069640 1 -- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2398157670 msgr2=0x7f239814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239d069640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2398157670 0x7f239814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239d069640 1 -- 172.21.15.17:0/2750054126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239815e7d0 con 0x7f23980c89b0 2023-08-09T12:44:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.845+0000 7f239d069640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980c89b0 0x7f23981597d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f23980b5600 tx=0x7f239000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.846+0000 7f238d7fa640 1 -- 172.21.15.17:0/2750054126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390007540 con 0x7f23980c89b0 2023-08-09T12:44:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.846+0000 7f238d7fa640 1 -- 172.21.15.17:0/2750054126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390004020 con 0x7f23980c89b0 2023-08-09T12:44:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.846+0000 7f238d7fa640 1 -- 172.21.15.17:0/2750054126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900076c0 con 0x7f23980c89b0 2023-08-09T12:44:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.846+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239815eab0 con 0x7f23980c89b0 2023-08-09T12:44:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.846+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23980c8e30 con 0x7f23980c89b0 2023-08-09T12:44:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.847+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23980c9050 con 0x7f23980c89b0 2023-08-09T12:44:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.848+0000 7f238d7fa640 1 -- 172.21.15.17:0/2750054126 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f23900057c0 con 0x7f23980c89b0 2023-08-09T12:44:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.849+0000 7f238d7fa640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f238406a050 0x7f238406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.849+0000 7f238d7fa640 1 -- 172.21.15.17:0/2750054126 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f23900874f0 con 0x7f23980c89b0 2023-08-09T12:44:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.850+0000 7f239c868640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f238406a050 0x7f238406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:16.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.851+0000 7f239c868640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f238406a050 0x7f238406c510 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2394036000 tx=0x7f239402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:16.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:16.853+0000 7f238d7fa640 1 -- 172.21.15.17:0/2750054126 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2390052dd0 con 0x7f23980c89b0 2023-08-09T12:44:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.053+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f239804e390 con 0x7f23980c89b0 2023-08-09T12:44:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.054+0000 7f238d7fa640 1 -- 172.21.15.17:0/2750054126 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23900563f0 con 0x7f23980c89b0 2023-08-09T12:44:17.057 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:44:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.056+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f238406a050 msgr2=0x7f238406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.056+0000 7f239d86a640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f238406a050 0x7f238406c510 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2394036000 tx=0x7f239402e000 comp rx=0 tx=0).stop 2023-08-09T12:44:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.056+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980c89b0 msgr2=0x7f23981597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.056+0000 7f239d86a640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980c89b0 0x7f23981597d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f23980b5600 tx=0x7f239000c820 comp rx=0 tx=0).stop 2023-08-09T12:44:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.057+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 shutdown_connections 2023-08-09T12:44:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.057+0000 7f239d86a640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f238406a050 0x7f238406c510 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.057+0000 7f239d86a640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23980c89b0 0x7f23981597d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.057+0000 7f239d86a640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2398157670 0x7f239814c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.057+0000 7f239d86a640 1 --2- 172.21.15.17:0/2750054126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23800039a0 0x7f2398149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.057+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 >> 172.21.15.17:0/2750054126 conn(0x7f23980d2ab0 msgr2=0x7f2398158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.057+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 shutdown_connections 2023-08-09T12:44:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.057+0000 7f239d86a640 1 -- 172.21.15.17:0/2750054126 wait complete. 2023-08-09T12:44:17.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:44:17.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.298+0000 7f3a17fff640 1 Processor -- start 2023-08-09T12:44:17.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.298+0000 7f3a17fff640 1 -- start start 2023-08-09T12:44:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.300+0000 7f3a17fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3a1815a8c0 0x7f3a180b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.300+0000 7f3a17fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a180b0020 0x7f3a180b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.300+0000 7f3a17fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1815e7b0 con 0x7f3a180b13f0 2023-08-09T12:44:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.300+0000 7f3a17fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180b0990 con 0x7f3a180b0020 2023-08-09T12:44:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.300+0000 7f3a17fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180b1850 con 0x7f3a1815a8c0 2023-08-09T12:44:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.300+0000 7f3a177fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a180b0020 0x7f3a180b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.300+0000 7f3a177fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a180b0020 0x7f3a180b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58548/0 (socket says 172.21.15.17:58548) 2023-08-09T12:44:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.300+0000 7f3a177fe640 1 -- 172.21.15.17:0/1165404981 learned_addr learned my addr 172.21.15.17:0/1165404981 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.301+0000 7f3a16ffd640 1 --2- 172.21.15.17:0/1165404981 >> v2:172.21.15.142:3300/0 conn(0x7f3a1815a8c0 0x7f3a180b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.301+0000 7f3a177fe640 1 -- 172.21.15.17:0/1165404981 >> v2:172.21.15.142:3300/0 conn(0x7f3a1815a8c0 msgr2=0x7f3a180b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.301+0000 7f3a177fe640 1 --2- 172.21.15.17:0/1165404981 >> v2:172.21.15.142:3300/0 conn(0x7f3a1815a8c0 0x7f3a180b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.301+0000 7f3a177fe640 1 -- 172.21.15.17:0/1165404981 >> v1:172.21.15.142:6789/0 conn(0x7f3a180b13f0 legacy=0x7f3a1815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.301+0000 7f3a177fe640 1 -- 172.21.15.17:0/1165404981 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1815e460 con 0x7f3a180b0020 2023-08-09T12:44:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.302+0000 7f3a177fe640 1 --2- 172.21.15.17:0/1165404981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a180b0020 0x7f3a180b0450 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3a180ce460 tx=0x7f3a1002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98d7d98ea2e5456 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.302+0000 7f3a15ffb640 1 -- 172.21.15.17:0/1165404981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1002ca80 con 0x7f3a180b0020 2023-08-09T12:44:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.302+0000 7f3a15ffb640 1 -- 172.21.15.17:0/1165404981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1002cbe0 con 0x7f3a180b0020 2023-08-09T12:44:17.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.302+0000 7f3a15ffb640 1 -- 172.21.15.17:0/1165404981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a100343f0 con 0x7f3a180b0020 2023-08-09T12:44:17.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.303+0000 7f3a17fff640 1 -- 172.21.15.17:0/1165404981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a180b0020 msgr2=0x7f3a180b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.303+0000 7f3a17fff640 1 --2- 172.21.15.17:0/1165404981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a180b0020 0x7f3a180b0450 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3a180ce460 tx=0x7f3a1002bee0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.303+0000 7f3a17fff640 1 -- 172.21.15.17:0/1165404981 shutdown_connections 2023-08-09T12:44:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.303+0000 7f3a17fff640 1 --2- 172.21.15.17:0/1165404981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a180b0020 0x7f3a180b0450 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.303+0000 7f3a17fff640 1 --2- 172.21.15.17:0/1165404981 >> v2:172.21.15.142:3300/0 conn(0x7f3a1815a8c0 0x7f3a180b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.303+0000 7f3a17fff640 1 -- 172.21.15.17:0/1165404981 >> 172.21.15.17:0/1165404981 conn(0x7f3a180cb020 msgr2=0x7f3a180cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.303+0000 7f3a17fff640 1 -- 172.21.15.17:0/1165404981 shutdown_connections 2023-08-09T12:44:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.303+0000 7f3a17fff640 1 -- 172.21.15.17:0/1165404981 wait complete. 2023-08-09T12:44:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.305+0000 7f3a17fff640 1 Processor -- start 2023-08-09T12:44:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.306+0000 7f3a17fff640 1 -- start start 2023-08-09T12:44:17.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a17fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a180b0020 0x7f3a180c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a17fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a180b13f0 0x7f3a18157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1815a8c0 0x7f3a1806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a17fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180c3a90 con 0x7f3a1815a8c0 2023-08-09T12:44:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a17fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180c4f10 con 0x7f3a180b0020 2023-08-09T12:44:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a17fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180c2e80 con 0x7f3a180b13f0 2023-08-09T12:44:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1815a8c0 0x7f3a1806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1815a8c0 0x7f3a1806ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58558/0 (socket says 172.21.15.17:58558) 2023-08-09T12:44:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.307+0000 7f3a177fe640 1 -- 172.21.15.17:0/2581797182 learned_addr learned my addr 172.21.15.17:0/2581797182 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a16ffd640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a180b0020 0x7f3a180c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a167fc640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a180b13f0 0x7f3a18157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a177fe640 1 -- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a180b13f0 msgr2=0x7f3a18157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a177fe640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a180b13f0 0x7f3a18157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a177fe640 1 -- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a180b0020 msgr2=0x7f3a180c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a177fe640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a180b0020 0x7f3a180c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a177fe640 1 -- 172.21.15.17:0/2581797182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10009b30 con 0x7f3a1815a8c0 2023-08-09T12:44:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a16ffd640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a180b0020 0x7f3a180c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a167fc640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a180b13f0 0x7f3a18157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f3a177fe640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1815a8c0 0x7f3a1806ed20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3a10036040 tx=0x7f3a10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.308+0000 7f39fffff640 1 -- 172.21.15.17:0/2581797182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1003e450 con 0x7f3a1815a8c0 2023-08-09T12:44:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.309+0000 7f39fffff640 1 -- 172.21.15.17:0/2581797182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1003e5d0 con 0x7f3a1815a8c0 2023-08-09T12:44:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.309+0000 7f39fffff640 1 -- 172.21.15.17:0/2581797182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1003e980 con 0x7f3a1815a8c0 2023-08-09T12:44:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.309+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a180c3160 con 0x7f3a1815a8c0 2023-08-09T12:44:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.309+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a180c3720 con 0x7f3a1815a8c0 2023-08-09T12:44:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.310+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a180c3c40 con 0x7f3a1815a8c0 2023-08-09T12:44:17.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.311+0000 7f39fffff640 1 -- 172.21.15.17:0/2581797182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3a1002cd50 con 0x7f3a1815a8c0 2023-08-09T12:44:17.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.312+0000 7f39fffff640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a0406a050 0x7f3a0406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.312+0000 7f39fffff640 1 -- 172.21.15.17:0/2581797182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3a100aaeb0 con 0x7f3a1815a8c0 2023-08-09T12:44:17.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.313+0000 7f3a16ffd640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a0406a050 0x7f3a0406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.314+0000 7f3a16ffd640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a0406a050 0x7f3a0406c510 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3a08008890 tx=0x7f3a08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:17.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.316+0000 7f39fffff640 1 -- 172.21.15.17:0/2581797182 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3a100769f0 con 0x7f3a1815a8c0 2023-08-09T12:44:17.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.509+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a1804e390 con 0x7f3a1815a8c0 2023-08-09T12:44:17.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.510+0000 7f39fffff640 1 -- 172.21.15.17:0/2581797182 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v83) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a10043020 con 0x7f3a1815a8c0 2023-08-09T12:44:17.513 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:44:17.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a0406a050 msgr2=0x7f3a0406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a0406a050 0x7f3a0406c510 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3a08008890 tx=0x7f3a08008040 comp rx=0 tx=0).stop 2023-08-09T12:44:17.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1815a8c0 msgr2=0x7f3a1806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1815a8c0 0x7f3a1806ed20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3a10036040 tx=0x7f3a10004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:17.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 shutdown_connections 2023-08-09T12:44:17.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a0406a050 0x7f3a0406c510 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1815a8c0 0x7f3a1806ed20 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a180b13f0 0x7f3a18157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2581797182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a180b0020 0x7f3a180c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 >> 172.21.15.17:0/2581797182 conn(0x7f3a180cb020 msgr2=0x7f3a18159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:17.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 shutdown_connections 2023-08-09T12:44:17.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.513+0000 7f3a17fff640 1 -- 172.21.15.17:0/2581797182 wait complete. 2023-08-09T12:44:17.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:44:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.761+0000 7fb834ca6640 1 Processor -- start 2023-08-09T12:44:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.761+0000 7fb834ca6640 1 -- start start 2023-08-09T12:44:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb834ca6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb83015cef0 0x7fb8300b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb834ca6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8300cfab0 0x7fb8300ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb834ca6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8300b2010 con 0x7fb83015d2d0 2023-08-09T12:44:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb834ca6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8300cdee0 con 0x7fb8300cfab0 2023-08-09T12:44:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb834ca6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8300b1d30 con 0x7fb83015cef0 2023-08-09T12:44:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb82dd9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb83015d2d0 0x7fb8300cf3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33818/0 (socket says 172.21.15.17:33818) 2023-08-09T12:44:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb82dd9b640 1 -- 172.21.15.17:0/1569242240 learned_addr learned my addr 172.21.15.17:0/1569242240 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb82ed9d640 1 --2- 172.21.15.17:0/1569242240 >> v2:172.21.15.17:3300/0 conn(0x7fb8300cfab0 0x7fb8300ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.763+0000 7fb82e59c640 1 --2- 172.21.15.17:0/1569242240 >> v2:172.21.15.142:3300/0 conn(0x7fb83015cef0 0x7fb8300b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.764+0000 7fb82ed9d640 1 -- 172.21.15.17:0/1569242240 >> v2:172.21.15.142:3300/0 conn(0x7fb83015cef0 msgr2=0x7fb8300b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.764+0000 7fb82ed9d640 1 --2- 172.21.15.17:0/1569242240 >> v2:172.21.15.142:3300/0 conn(0x7fb83015cef0 0x7fb8300b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.764+0000 7fb82ed9d640 1 -- 172.21.15.17:0/1569242240 >> v1:172.21.15.17:6789/0 conn(0x7fb83015d2d0 legacy=0x7fb8300cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.764+0000 7fb82ed9d640 1 -- 172.21.15.17:0/1569242240 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8300cd820 con 0x7fb8300cfab0 2023-08-09T12:44:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.764+0000 7fb82d59a640 1 -- 172.21.15.17:0/1569242240 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031560370 0 0) 0x7fb8300b2010 con 0x7fb83015d2d0 2023-08-09T12:44:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.765+0000 7fb82ed9d640 1 --2- 172.21.15.17:0/1569242240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8300cfab0 0x7fb8300ce300 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb8300b5790 tx=0x7fb82802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfe0846d5ae8e24 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.765+0000 7fb82d59a640 1 -- 172.21.15.17:0/1569242240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828031710 con 0x7fb8300cfab0 2023-08-09T12:44:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.765+0000 7fb82d59a640 1 -- 172.21.15.17:0/1569242240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82802f050 con 0x7fb8300cfab0 2023-08-09T12:44:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.765+0000 7fb82d59a640 1 -- 172.21.15.17:0/1569242240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828031a90 con 0x7fb8300cfab0 2023-08-09T12:44:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.766+0000 7fb834ca6640 1 -- 172.21.15.17:0/1569242240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8300cfab0 msgr2=0x7fb8300ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.766+0000 7fb834ca6640 1 --2- 172.21.15.17:0/1569242240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8300cfab0 0x7fb8300ce300 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb8300b5790 tx=0x7fb82802b7b0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.766+0000 7fb834ca6640 1 -- 172.21.15.17:0/1569242240 shutdown_connections 2023-08-09T12:44:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.766+0000 7fb834ca6640 1 --2- 172.21.15.17:0/1569242240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8300cfab0 0x7fb8300ce300 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.766+0000 7fb834ca6640 1 --2- 172.21.15.17:0/1569242240 >> v2:172.21.15.142:3300/0 conn(0x7fb83015cef0 0x7fb8300b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.766+0000 7fb834ca6640 1 -- 172.21.15.17:0/1569242240 >> 172.21.15.17:0/1569242240 conn(0x7fb83006fde0 msgr2=0x7fb8300701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.766+0000 7fb834ca6640 1 -- 172.21.15.17:0/1569242240 shutdown_connections 2023-08-09T12:44:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.766+0000 7fb834ca6640 1 -- 172.21.15.17:0/1569242240 wait complete. 2023-08-09T12:44:17.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.768+0000 7fb834ca6640 1 Processor -- start 2023-08-09T12:44:17.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.768+0000 7fb834ca6640 1 -- start start 2023-08-09T12:44:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.769+0000 7fb834ca6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cfab0 0x7fb83014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.769+0000 7fb834ca6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83015cef0 0x7fb8301f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.769+0000 7fb834ca6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb83015d2d0 0x7fb8300cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.769+0000 7fb834ca6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83014d6f0 con 0x7fb83015d2d0 2023-08-09T12:44:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.769+0000 7fb834ca6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300b4b40 con 0x7fb83015cef0 2023-08-09T12:44:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.769+0000 7fb834ca6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300b3f30 con 0x7fb8300cfab0 2023-08-09T12:44:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.769+0000 7fb82ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb83015d2d0 0x7fb8300cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb83015d2d0 0x7fb8300cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58566/0 (socket says 172.21.15.17:58566) 2023-08-09T12:44:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82ed9d640 1 -- 172.21.15.17:0/49769715 learned_addr learned my addr 172.21.15.17:0/49769715 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82dd9b640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83015cef0 0x7fb8301f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82e59c640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cfab0 0x7fb83014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82ed9d640 1 -- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cfab0 msgr2=0x7fb83014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82ed9d640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cfab0 0x7fb83014d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82ed9d640 1 -- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83015cef0 msgr2=0x7fb8301f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82ed9d640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83015cef0 0x7fb8301f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.770+0000 7fb82ed9d640 1 -- 172.21.15.17:0/49769715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828009400 con 0x7fb83015d2d0 2023-08-09T12:44:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.771+0000 7fb82ed9d640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb83015d2d0 0x7fb8300cb870 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb82802b7f0 tx=0x7fb8280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.771+0000 7fb81effd640 1 -- 172.21.15.17:0/49769715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82803c810 con 0x7fb83015d2d0 2023-08-09T12:44:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.771+0000 7fb81effd640 1 -- 172.21.15.17:0/49769715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82803c970 con 0x7fb83015d2d0 2023-08-09T12:44:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.771+0000 7fb81effd640 1 -- 172.21.15.17:0/49769715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82803cd00 con 0x7fb83015d2d0 2023-08-09T12:44:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.771+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8300b4210 con 0x7fb83015d2d0 2023-08-09T12:44:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.771+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8300b47d0 con 0x7fb83015d2d0 2023-08-09T12:44:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.772+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8300b4cb0 con 0x7fb83015d2d0 2023-08-09T12:44:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.774+0000 7fb81effd640 1 -- 172.21.15.17:0/49769715 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb82803a040 con 0x7fb83015d2d0 2023-08-09T12:44:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.775+0000 7fb81effd640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb81006a050 0x7fb81006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.776+0000 7fb81effd640 1 -- 172.21.15.17:0/49769715 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb8280a9870 con 0x7fb83015d2d0 2023-08-09T12:44:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.776+0000 7fb82e59c640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb81006a050 0x7fb81006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.777+0000 7fb82e59c640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb81006a050 0x7fb81006c510 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb8200074a0 tx=0x7fb82000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.780+0000 7fb81effd640 1 -- 172.21.15.17:0/49769715 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb8280751e0 con 0x7fb83015d2d0 2023-08-09T12:44:17.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.973+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb830067a80 con 0x7fb83015d2d0 2023-08-09T12:44:17.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.981+0000 7fb81effd640 1 -- 172.21.15.17:0/49769715 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb82803ce60 con 0x7fb83015d2d0 2023-08-09T12:44:17.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb81006a050 msgr2=0x7fb81006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb81006a050 0x7fb81006c510 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb8200074a0 tx=0x7fb82000b040 comp rx=0 tx=0).stop 2023-08-09T12:44:17.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb83015d2d0 msgr2=0x7fb8300cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:17.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb83015d2d0 0x7fb8300cb870 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb82802b7f0 tx=0x7fb8280046c0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 shutdown_connections 2023-08-09T12:44:17.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb81006a050 0x7fb81006c510 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb83015d2d0 0x7fb8300cb870 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83015cef0 0x7fb8301f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 --2- 172.21.15.17:0/49769715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cfab0 0x7fb83014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:17.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 >> 172.21.15.17:0/49769715 conn(0x7fb83006fde0 msgr2=0x7fb8300c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:17.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.984+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 shutdown_connections 2023-08-09T12:44:17.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:17.985+0000 7fb834ca6640 1 -- 172.21.15.17:0/49769715 wait complete. 2023-08-09T12:44:18.006 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:44:18.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:44:18.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:44:18.257 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:44:18.258 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:44:18.258 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:18.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:44:18.324 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:44:18.324 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:18.384 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:44:18.385 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:44:18.385 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:18.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:44:18.451 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:44:18.451 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:18.512 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:44:18.513 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:44:18.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:44:18.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.745+0000 7f0447206640 1 Processor -- start 2023-08-09T12:44:18.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.745+0000 7f0447206640 1 -- start start 2023-08-09T12:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.747+0000 7f0447206640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f04401616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.747+0000 7f0447206640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f04400b6000 0x7f04400cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.747+0000 7f0447206640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04400b6460 con 0x7f04400d29d0 2023-08-09T12:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.747+0000 7f0447206640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04400cda40 con 0x7f04400b6000 2023-08-09T12:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.747+0000 7f0447206640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04400cdd10 con 0x7f044015ce90 2023-08-09T12:44:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.748+0000 7f0437fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f04400b6000 0x7f04400cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.748+0000 7f04457a3640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f04400d29d0 0x7f04400d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34724/0 (socket says 172.21.15.17:34724) 2023-08-09T12:44:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.748+0000 7f04457a3640 1 -- 172.21.15.17:0/3828379029 learned_addr learned my addr 172.21.15.17:0/3828379029 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.748+0000 7f0444fa2640 1 --2- 172.21.15.17:0/3828379029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f04401616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:18.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.748+0000 7f0437fff640 1 -- 172.21.15.17:0/3828379029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 msgr2=0x7f04401616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:18.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.748+0000 7f0437fff640 1 --2- 172.21.15.17:0/3828379029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f04401616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:18.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.748+0000 7f0437fff640 1 -- 172.21.15.17:0/3828379029 >> v1:172.21.15.17:6789/0 conn(0x7f04400d29d0 legacy=0x7f04400d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:18.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.748+0000 7f0437fff640 1 -- 172.21.15.17:0/3828379029 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400cdff0 con 0x7f04400b6000 2023-08-09T12:44:18.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.749+0000 7f0444fa2640 1 --2- 172.21.15.17:0/3828379029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f04401616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.750+0000 7f0437fff640 1 --2- 172.21.15.17:0/3828379029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400b6000 0x7f04400cd500 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f04300097a0 tx=0x7f043002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dba8dc6ee7c2d72 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.750+0000 7f04377fe640 1 -- 172.21.15.17:0/3828379029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043002d040 con 0x7f04400b6000 2023-08-09T12:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.750+0000 7f04377fe640 1 -- 172.21.15.17:0/3828379029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0430031810 con 0x7f04400b6000 2023-08-09T12:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.750+0000 7f04377fe640 1 -- 172.21.15.17:0/3828379029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430031ba0 con 0x7f04400b6000 2023-08-09T12:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.751+0000 7f0447206640 1 -- 172.21.15.17:0/3828379029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400b6000 msgr2=0x7f04400cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.751+0000 7f0447206640 1 --2- 172.21.15.17:0/3828379029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400b6000 0x7f04400cd500 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f04300097a0 tx=0x7f043002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.751+0000 7f0447206640 1 -- 172.21.15.17:0/3828379029 shutdown_connections 2023-08-09T12:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.751+0000 7f0447206640 1 --2- 172.21.15.17:0/3828379029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400b6000 0x7f04400cd500 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.751+0000 7f0447206640 1 --2- 172.21.15.17:0/3828379029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f04401616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.751+0000 7f0447206640 1 -- 172.21.15.17:0/3828379029 >> 172.21.15.17:0/3828379029 conn(0x7f044006fde0 msgr2=0x7f04400701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.751+0000 7f0447206640 1 -- 172.21.15.17:0/3828379029 shutdown_connections 2023-08-09T12:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.751+0000 7f0447206640 1 -- 172.21.15.17:0/3828379029 wait complete. 2023-08-09T12:44:18.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.753+0000 7f0447206640 1 Processor -- start 2023-08-09T12:44:18.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.753+0000 7f0447206640 1 -- start start 2023-08-09T12:44:18.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0447206640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04400b6000 0x7f044015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:18.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0447206640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400d29d0 0x7f044015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:18.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0447206640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f044015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:18.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0447206640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044015deb0 con 0x7f04400d29d0 2023-08-09T12:44:18.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0447206640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044015e2d0 con 0x7f04400b6000 2023-08-09T12:44:18.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0447206640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044015d270 con 0x7f044015ce90 2023-08-09T12:44:18.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0437fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400d29d0 0x7f044015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:18.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0437fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400d29d0 0x7f044015f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53854/0 (socket says 172.21.15.17:53854) 2023-08-09T12:44:18.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.754+0000 7f0437fff640 1 -- 172.21.15.17:0/3012954356 learned_addr learned my addr 172.21.15.17:0/3012954356 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:18.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f0444fa2640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04400b6000 0x7f044015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:18.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f04457a3640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f044015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:18.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f0437fff640 1 -- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 msgr2=0x7f044015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:18.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f0437fff640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f044015f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:18.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f0437fff640 1 -- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04400b6000 msgr2=0x7f044015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:18.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f0437fff640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04400b6000 0x7f044015b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:18.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f0437fff640 1 -- 172.21.15.17:0/3012954356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430009400 con 0x7f04400d29d0 2023-08-09T12:44:18.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f04457a3640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f044015f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:18.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f0437fff640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400d29d0 0x7f044015f0d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f04300098c0 tx=0x7f04300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:18.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f04357fa640 1 -- 172.21.15.17:0/3012954356 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043003ad60 con 0x7f04400d29d0 2023-08-09T12:44:18.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f04357fa640 1 -- 172.21.15.17:0/3012954356 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0430044400 con 0x7f04400d29d0 2023-08-09T12:44:18.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f04357fa640 1 -- 172.21.15.17:0/3012954356 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04300447b0 con 0x7f04400d29d0 2023-08-09T12:44:18.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.755+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044015d510 con 0x7f04400d29d0 2023-08-09T12:44:18.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.756+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044015dad0 con 0x7f04400d29d0 2023-08-09T12:44:18.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.757+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044015dc60 con 0x7f04400d29d0 2023-08-09T12:44:18.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.758+0000 7f04357fa640 1 -- 172.21.15.17:0/3012954356 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f043004d440 con 0x7f04400d29d0 2023-08-09T12:44:18.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.759+0000 7f04357fa640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f042c06a050 0x7f042c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:18.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.759+0000 7f04357fa640 1 -- 172.21.15.17:0/3012954356 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f04300aa830 con 0x7f04400d29d0 2023-08-09T12:44:18.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.760+0000 7f0444fa2640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f042c06a050 0x7f042c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:18.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.761+0000 7f0444fa2640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f042c06a050 0x7f042c06c510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f043c008ee0 tx=0x7f043c008430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:18.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.764+0000 7f04357fa640 1 -- 172.21.15.17:0/3012954356 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f04300761a0 con 0x7f04400d29d0 2023-08-09T12:44:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.994+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0440067a80 con 0x7f04400d29d0 2023-08-09T12:44:18.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.995+0000 7f04357fa640 1 -- 172.21.15.17:0/3012954356 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f04300797c0 con 0x7f04400d29d0 2023-08-09T12:44:18.999 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:18.999 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2314028117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2314028117},{"type":"v1","addr":"172.21.15.142:6837","nonce":2314028117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5236,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3413359063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3413359063},{"type":"v1","addr":"172.21.15.142:6835","nonce":3413359063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/295901720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":295901720},{"type":"v1","addr":"172.21.15.17:6834","nonce":295901720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/413500407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":413500407},{"type":"v1","addr":"172.21.15.17:6835","nonce":413500407}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[]} 2023-08-09T12:44:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 37 2023-08-09T12:44:19.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f042c06a050 msgr2=0x7f042c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:19.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f042c06a050 0x7f042c06c510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f043c008ee0 tx=0x7f043c008430 comp rx=0 tx=0).stop 2023-08-09T12:44:19.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400d29d0 msgr2=0x7f044015f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:19.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400d29d0 0x7f044015f0d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f04300098c0 tx=0x7f04300046c0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 shutdown_connections 2023-08-09T12:44:19.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f042c06a050 0x7f042c06c510 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f044015ce90 0x7f044015f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400d29d0 0x7f044015f0d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 --2- 172.21.15.17:0/3012954356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04400b6000 0x7f044015b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 >> 172.21.15.17:0/3012954356 conn(0x7f044006fde0 msgr2=0x7f04400b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:19.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 shutdown_connections 2023-08-09T12:44:19.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:18.998+0000 7f0447206640 1 -- 172.21.15.17:0/3012954356 wait complete. 2023-08-09T12:44:19.022 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:44:19.023 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:44:19.023 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:44:19.023 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:44:19.024 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:44:19.024 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:44:19.025 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:44:19.025 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:44:19.026 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:44:19.026 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:44:19.026 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:44:19.027 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:44:19.027 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:44:19.028 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:44:19.028 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:44:19.029 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:44:19.040 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:44:19.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:44:19.049 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:44:19.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:44:19.057 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:44:19.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:44:19.061 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:44:19.062 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:44:19.097 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:44:19.098 DEBUG:teuthology.parallel:result is None 2023-08-09T12:44:19.105 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:44:19.106 DEBUG:teuthology.parallel:result is None 2023-08-09T12:44:19.109 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:44:19.110 DEBUG:teuthology.parallel:result is None 2023-08-09T12:44:19.117 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:44:19.118 DEBUG:teuthology.parallel:result is None 2023-08-09T12:44:19.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:44:19.266 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:44:19.268 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:44:19.282 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:44:19.292 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:44:19.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.321+0000 7f1dd5c01640 1 Processor -- start 2023-08-09T12:44:19.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.322+0000 7f1dd5c01640 1 -- start start 2023-08-09T12:44:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.323+0000 7f1dd5c01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd00afa40 0x7f1dd00afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.323+0000 7f1dd5c01640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1dd00b2b60 0x7f1dd00cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.323+0000 7f1dd5c01640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00cf8b0 con 0x7f1dd015ad10 2023-08-09T12:44:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.323+0000 7f1dd5c01640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00cf010 con 0x7f1dd00b2b60 2023-08-09T12:44:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.323+0000 7f1dd5c01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00cf2f0 con 0x7f1dd00afa40 2023-08-09T12:44:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.323+0000 7f1dcf7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1dd015ad10 0x7f1dd00b2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34754/0 (socket says 172.21.15.17:34754) 2023-08-09T12:44:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.323+0000 7f1dcf7fe640 1 -- 172.21.15.17:0/3848069462 learned_addr learned my addr 172.21.15.17:0/3848069462 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.324+0000 7f1dcffff640 1 --2- 172.21.15.17:0/3848069462 >> v2:172.21.15.142:3300/0 conn(0x7f1dd00b2b60 0x7f1dd00cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.324+0000 7f1dceffd640 1 --2- 172.21.15.17:0/3848069462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd00afa40 0x7f1dd00afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.324+0000 7f1dce7fc640 1 -- 172.21.15.17:0/3848069462 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266031521 0 0) 0x7f1dd00cf8b0 con 0x7f1dd015ad10 2023-08-09T12:44:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.324+0000 7f1dce7fc640 1 -- 172.21.15.17:0/3848069462 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dbc003520 con 0x7f1dd015ad10 2023-08-09T12:44:19.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.324+0000 7f1dcffff640 1 -- 172.21.15.17:0/3848069462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd00afa40 msgr2=0x7f1dd00afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.324+0000 7f1dcffff640 1 --2- 172.21.15.17:0/3848069462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd00afa40 0x7f1dd00afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.324+0000 7f1dcffff640 1 -- 172.21.15.17:0/3848069462 >> v1:172.21.15.17:6789/0 conn(0x7f1dd015ad10 legacy=0x7f1dd00b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.324+0000 7f1dcffff640 1 -- 172.21.15.17:0/3848069462 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00cf5d0 con 0x7f1dd00b2b60 2023-08-09T12:44:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.325+0000 7f1dcffff640 1 --2- 172.21.15.17:0/3848069462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00cff40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80097a0 tx=0x7f1dc802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91af74a36569c2be server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dce7fc640 1 -- 172.21.15.17:0/3848069462 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc802d040 con 0x7f1dd00b2b60 2023-08-09T12:44:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dce7fc640 1 -- 172.21.15.17:0/3848069462 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8031810 con 0x7f1dd00b2b60 2023-08-09T12:44:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dce7fc640 1 -- 172.21.15.17:0/3848069462 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8031ba0 con 0x7f1dd00b2b60 2023-08-09T12:44:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dd5c01640 1 -- 172.21.15.17:0/3848069462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00b2b60 msgr2=0x7f1dd00cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/3848069462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00cff40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80097a0 tx=0x7f1dc802b8b0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dd5c01640 1 -- 172.21.15.17:0/3848069462 shutdown_connections 2023-08-09T12:44:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/3848069462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00cff40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/3848069462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd00afa40 0x7f1dd00afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.326+0000 7f1dd5c01640 1 -- 172.21.15.17:0/3848069462 >> 172.21.15.17:0/3848069462 conn(0x7f1dd006cf40 msgr2=0x7f1dd006d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.327+0000 7f1dd5c01640 1 -- 172.21.15.17:0/3848069462 shutdown_connections 2023-08-09T12:44:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.327+0000 7f1dd5c01640 1 -- 172.21.15.17:0/3848069462 wait complete. 2023-08-09T12:44:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.328+0000 7f1dd5c01640 1 Processor -- start 2023-08-09T12:44:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.329+0000 7f1dd5c01640 1 -- start start 2023-08-09T12:44:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.329+0000 7f1dd5c01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00afa40 0x7f1dd00ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.329+0000 7f1dd5c01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.329+0000 7f1dd5c01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd015ad10 0x7f1dd00b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.329+0000 7f1dd5c01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00aedd0 con 0x7f1dd00b2b60 2023-08-09T12:44:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.329+0000 7f1dd5c01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00c6bf0 con 0x7f1dd00afa40 2023-08-09T12:44:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.329+0000 7f1dd5c01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00c5fe0 con 0x7f1dd015ad10 2023-08-09T12:44:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dceffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dceffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53886/0 (socket says 172.21.15.17:53886) 2023-08-09T12:44:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dceffd640 1 -- 172.21.15.17:0/1376444431 learned_addr learned my addr 172.21.15.17:0/1376444431 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dcf7fe640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00afa40 0x7f1dd00ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dcffff640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd015ad10 0x7f1dd00b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:19.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dceffd640 1 -- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd015ad10 msgr2=0x7f1dd00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:19.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dceffd640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd015ad10 0x7f1dd00b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dceffd640 1 -- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00afa40 msgr2=0x7f1dd00ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dceffd640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00afa40 0x7f1dd00ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.330+0000 7f1dceffd640 1 -- 172.21.15.17:0/1376444431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8009400 con 0x7f1dd00b2b60 2023-08-09T12:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.331+0000 7f1dceffd640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00c58e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e9b0 tx=0x7f1db800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.331+0000 7f1dc7fff640 1 -- 172.21.15.17:0/1376444431 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8009670 con 0x7f1dd00b2b60 2023-08-09T12:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.331+0000 7f1dc7fff640 1 -- 172.21.15.17:0/1376444431 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db800c9a0 con 0x7f1dd00b2b60 2023-08-09T12:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.331+0000 7f1dc7fff640 1 -- 172.21.15.17:0/1376444431 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db800cd50 con 0x7f1dd00b2b60 2023-08-09T12:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.331+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd00c62c0 con 0x7f1dd00b2b60 2023-08-09T12:44:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.331+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd00c6880 con 0x7f1dd00b2b60 2023-08-09T12:44:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.332+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd0067a80 con 0x7f1dd00b2b60 2023-08-09T12:44:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.333+0000 7f1dc7fff640 1 -- 172.21.15.17:0/1376444431 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1db8013470 con 0x7f1dd00b2b60 2023-08-09T12:44:19.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.335+0000 7f1dc7fff640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1db006a050 0x7f1db006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:19.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.335+0000 7f1dc7fff640 1 -- 172.21.15.17:0/1376444431 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1db8088510 con 0x7f1dd00b2b60 2023-08-09T12:44:19.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.335+0000 7f1dcf7fe640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1db006a050 0x7f1db006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.336+0000 7f1dcf7fe640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1db006a050 0x7f1db006c510 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0001560 tx=0x7f1dc00019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.339+0000 7f1dc7fff640 1 -- 172.21.15.17:0/1376444431 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1db8053f30 con 0x7f1dd00b2b60 2023-08-09T12:44:19.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:19.545+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1dd00c6a40 con 0x7f1dd00b2b60 2023-08-09T12:44:20.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.784+0000 7f1dc7fff640 1 -- 172.21.15.17:0/1376444431 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v88) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1db8057550 con 0x7f1dd00b2b60 2023-08-09T12:44:20.788 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:44:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1db006a050 msgr2=0x7f1db006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1db006a050 0x7f1db006c510 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0001560 tx=0x7f1dc00019f0 comp rx=0 tx=0).stop 2023-08-09T12:44:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd00b2b60 msgr2=0x7f1dd00c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00c58e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e9b0 tx=0x7f1db800ee70 comp rx=0 tx=0).stop 2023-08-09T12:44:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 shutdown_connections 2023-08-09T12:44:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1db006a050 0x7f1db006c510 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd015ad10 0x7f1dd00b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dd00b2b60 0x7f1dd00c58e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 --2- 172.21.15.17:0/1376444431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd00afa40 0x7f1dd00ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.788+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 >> 172.21.15.17:0/1376444431 conn(0x7f1dd006cf40 msgr2=0x7f1dd00cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.789+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 shutdown_connections 2023-08-09T12:44:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:20.789+0000 7f1dd5c01640 1 -- 172.21.15.17:0/1376444431 wait complete. 2023-08-09T12:44:20.815 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:44:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.048+0000 7efdaa314640 1 Processor -- start 2023-08-09T12:44:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.048+0000 7efdaa314640 1 -- start start 2023-08-09T12:44:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.049+0000 7efdaa314640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efda40b0ac0 0x7efda40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efdaa314640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efda40b0ea0 0x7efda40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efdaa314640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40b3b60 con 0x7efda40c8d40 2023-08-09T12:44:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efdaa314640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda41617b0 con 0x7efda40b0ac0 2023-08-09T12:44:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efdaa314640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda40b3550 con 0x7efda40b0ea0 2023-08-09T12:44:21.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efda9312640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efda40b0ac0 0x7efda40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efda9312640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efda40b0ac0 0x7efda40b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53892/0 (socket says 172.21.15.17:53892) 2023-08-09T12:44:21.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efda9b13640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7efda40c8d40 0x7efda406ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34756/0 (socket says 172.21.15.17:34756) 2023-08-09T12:44:21.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efda9312640 1 -- 172.21.15.17:0/2527327235 learned_addr learned my addr 172.21.15.17:0/2527327235 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:21.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.050+0000 7efda8b11640 1 --2- 172.21.15.17:0/2527327235 >> v2:172.21.15.142:3300/0 conn(0x7efda40b0ea0 0x7efda40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.051+0000 7efda9312640 1 -- 172.21.15.17:0/2527327235 >> v2:172.21.15.142:3300/0 conn(0x7efda40b0ea0 msgr2=0x7efda40caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:21.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.051+0000 7efda9312640 1 --2- 172.21.15.17:0/2527327235 >> v2:172.21.15.142:3300/0 conn(0x7efda40b0ea0 0x7efda40caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.051+0000 7efda9312640 1 -- 172.21.15.17:0/2527327235 >> v1:172.21.15.17:6789/0 conn(0x7efda40c8d40 legacy=0x7efda406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.051+0000 7efda9312640 1 -- 172.21.15.17:0/2527327235 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40c9e10 con 0x7efda40b0ac0 2023-08-09T12:44:21.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.052+0000 7efda9312640 1 --2- 172.21.15.17:0/2527327235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40b0ac0 0x7efda40b3ff0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efda406b780 tx=0x7efda002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01b7205d34a7782 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:21.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.052+0000 7efd9bfff640 1 -- 172.21.15.17:0/2527327235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda002cb10 con 0x7efda40b0ac0 2023-08-09T12:44:21.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.052+0000 7efd9bfff640 1 -- 172.21.15.17:0/2527327235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda002cc70 con 0x7efda40b0ac0 2023-08-09T12:44:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.052+0000 7efd9bfff640 1 -- 172.21.15.17:0/2527327235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00343f0 con 0x7efda40b0ac0 2023-08-09T12:44:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.053+0000 7efdaa314640 1 -- 172.21.15.17:0/2527327235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40b0ac0 msgr2=0x7efda40b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.053+0000 7efdaa314640 1 --2- 172.21.15.17:0/2527327235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40b0ac0 0x7efda40b3ff0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efda406b780 tx=0x7efda002bf70 comp rx=0 tx=0).stop 2023-08-09T12:44:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.053+0000 7efdaa314640 1 -- 172.21.15.17:0/2527327235 shutdown_connections 2023-08-09T12:44:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.053+0000 7efdaa314640 1 --2- 172.21.15.17:0/2527327235 >> v2:172.21.15.142:3300/0 conn(0x7efda40b0ea0 0x7efda40caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.053+0000 7efdaa314640 1 --2- 172.21.15.17:0/2527327235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40b0ac0 0x7efda40b3ff0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.053+0000 7efdaa314640 1 -- 172.21.15.17:0/2527327235 >> 172.21.15.17:0/2527327235 conn(0x7efda40b1d50 msgr2=0x7efda406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:21.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.053+0000 7efdaa314640 1 -- 172.21.15.17:0/2527327235 shutdown_connections 2023-08-09T12:44:21.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.053+0000 7efdaa314640 1 -- 172.21.15.17:0/2527327235 wait complete. 2023-08-09T12:44:21.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.055+0000 7efdaa314640 1 Processor -- start 2023-08-09T12:44:21.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.055+0000 7efdaa314640 1 -- start start 2023-08-09T12:44:21.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.056+0000 7efdaa314640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efda40b0ac0 0x7efda4159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.056+0000 7efdaa314640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efda40b0ea0 0x7efda41fa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.056+0000 7efdaa314640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40c8d40 0x7efda40c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.056+0000 7efdaa314640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda41faca0 con 0x7efda40c8d40 2023-08-09T12:44:21.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.056+0000 7efdaa314640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda415a660 con 0x7efda40b0ac0 2023-08-09T12:44:21.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.056+0000 7efdaa314640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda4159a50 con 0x7efda40b0ea0 2023-08-09T12:44:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40c8d40 0x7efda40c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40c8d40 0x7efda40c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53894/0 (socket says 172.21.15.17:53894) 2023-08-09T12:44:21.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 -- 172.21.15.17:0/3758468265 learned_addr learned my addr 172.21.15.17:0/3758468265 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:21.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda8b11640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efda40b0ea0 0x7efda41fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9312640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efda40b0ac0 0x7efda4159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 -- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efda40b0ea0 msgr2=0x7efda41fa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efda40b0ea0 0x7efda41fa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 -- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efda40b0ac0 msgr2=0x7efda4159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efda40b0ac0 0x7efda4159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 -- 172.21.15.17:0/3758468265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0009b30 con 0x7efda40c8d40 2023-08-09T12:44:21.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9312640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efda40b0ac0 0x7efda4159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:21.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.057+0000 7efda9b13640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40c8d40 0x7efda40c4590 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00c400 tx=0x7efd9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:21.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.058+0000 7efd99ffb640 1 -- 172.21.15.17:0/3758468265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0074e0 con 0x7efda40c8d40 2023-08-09T12:44:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.058+0000 7efd99ffb640 1 -- 172.21.15.17:0/3758468265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c007640 con 0x7efda40c8d40 2023-08-09T12:44:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.058+0000 7efd99ffb640 1 -- 172.21.15.17:0/3758468265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0049e0 con 0x7efda40c8d40 2023-08-09T12:44:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.058+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda4159d30 con 0x7efda40c8d40 2023-08-09T12:44:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.058+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda415a2f0 con 0x7efda40c8d40 2023-08-09T12:44:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.059+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda404e390 con 0x7efda40c8d40 2023-08-09T12:44:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.060+0000 7efd99ffb640 1 -- 172.21.15.17:0/3758468265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd9c004b40 con 0x7efda40c8d40 2023-08-09T12:44:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.061+0000 7efd99ffb640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd8806a080 0x7efd8806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.061+0000 7efd99ffb640 1 -- 172.21.15.17:0/3758468265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efd9c087be0 con 0x7efda40c8d40 2023-08-09T12:44:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.062+0000 7efda9312640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd8806a080 0x7efd8806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.063+0000 7efda9312640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd8806a080 0x7efd8806c540 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efda0035000 tx=0x7efda0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.066+0000 7efd99ffb640 1 -- 172.21.15.17:0/3758468265 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efd9c053610 con 0x7efda40c8d40 2023-08-09T12:44:21.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.330+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efda40cc840 con 0x7efda40c8d40 2023-08-09T12:44:21.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.330+0000 7efd99ffb640 1 -- 172.21.15.17:0/3758468265 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efd9c056c30 con 0x7efda40c8d40 2023-08-09T12:44:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:21.334 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:44:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:44:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:44:21.334 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:44:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:44:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:44:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:44:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:44:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:44:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:44:21.336 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:44:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:44:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.337 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:44:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:44:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:44:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:44:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:44:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:44:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:44:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.339 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:44:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:44:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:44:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:44:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:44:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:44:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:44:21.341 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:44:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:44:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:44:21.342 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:44:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:44:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:44:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.343 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:44:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:44:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:44:21.344 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:44:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:44:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:44:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.345 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:44:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:44:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:44:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:44:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:44:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:44:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:44:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:44:21.347 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:44:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:44:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.348 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:44:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:44:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:44:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:44:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:44:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:44:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:44:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:44:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:44:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:44:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:44:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:44:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:44:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:44:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:44:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:44:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:44:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:44:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:44:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:44:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:44:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:44:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:44:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:44:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:44:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:44:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:44:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:44:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:44:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:44:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:44:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:44:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:44:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:44:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:44:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:44:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:44:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:44:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:44:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:44:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:44:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:44:21.360 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:44:21.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd8806a080 msgr2=0x7efd8806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd8806a080 0x7efd8806c540 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efda0035000 tx=0x7efda0030000 comp rx=0 tx=0).stop 2023-08-09T12:44:21.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40c8d40 msgr2=0x7efda40c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40c8d40 0x7efda40c4590 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00c400 tx=0x7efd9c00c8c0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 shutdown_connections 2023-08-09T12:44:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efd8806a080 0x7efd8806c540 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda40c8d40 0x7efda40c4590 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efda40b0ea0 0x7efda41fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 --2- 172.21.15.17:0/3758468265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efda40b0ac0 0x7efda4159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 >> 172.21.15.17:0/3758468265 conn(0x7efda40b1d50 msgr2=0x7efda40ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:21.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.333+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 shutdown_connections 2023-08-09T12:44:21.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.334+0000 7efdaa314640 1 -- 172.21.15.17:0/3758468265 wait complete. 2023-08-09T12:44:21.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:21.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.596+0000 7f79b9085640 1 Processor -- start 2023-08-09T12:44:21.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.596+0000 7f79b9085640 1 -- start start 2023-08-09T12:44:21.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.598+0000 7f79b9085640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3fe0 0x7f79b40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.598+0000 7f79b9085640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b406fe10 con 0x7f79b4159bd0 2023-08-09T12:44:21.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.598+0000 7f79b9085640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b4159fb0 con 0x7f79b40697c0 2023-08-09T12:44:21.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.598+0000 7f79b9085640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40b11a0 con 0x7f79b40b3fe0 2023-08-09T12:44:21.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.598+0000 7f79b3fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f79b4159bd0 0x7f79b4070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34770/0 (socket says 172.21.15.17:34770) 2023-08-09T12:44:21.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.598+0000 7f79b3fff640 1 -- 172.21.15.17:0/69739741 learned_addr learned my addr 172.21.15.17:0/69739741 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b37fe640 1 --2- 172.21.15.17:0/69739741 >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3fe0 0x7f79b40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297779001 0 0) 0x7f79b406fe10 con 0x7f79b4159bd0 2023-08-09T12:44:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f799c003520 con 0x7f79b4159bd0 2023-08-09T12:44:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 373212754 0 0) 0x7f799c003520 con 0x7f79b4159bd0 2023-08-09T12:44:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3fe0 msgr2=0x7f79b40ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 --2- 172.21.15.17:0/69739741 >> v2:172.21.15.142:3300/0 conn(0x7f79b40b3fe0 0x7f79b40ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 >> v1:172.21.15.142:6789/0 conn(0x7f79b40697c0 legacy=0x7f79b40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4070970 con 0x7f79b4159bd0 2023-08-09T12:44:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f79a4001670 con 0x7f79b4159bd0 2023-08-09T12:44:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 >> v1:172.21.15.17:6789/0 conn(0x7f79b4159bd0 legacy=0x7f79b4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c003970 0x7f799c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f799c0047c0 0x7f799c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f799c005180 0x7f799c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40b11a0 con 0x7f799c0047c0 2023-08-09T12:44:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c00e330 con 0x7f799c003970 2023-08-09T12:44:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.599+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c00e4f0 con 0x7f799c005180 2023-08-09T12:44:21.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b37fe640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f799c0047c0 0x7f799c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b37fe640 1 -- 172.21.15.17:0/69739741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f799c005180 msgr2=0x7f799c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:21.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b37fe640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f799c005180 0x7f799c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b3fff640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c003970 0x7f799c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b37fe640 1 -- 172.21.15.17:0/69739741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c003970 msgr2=0x7f799c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b37fe640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c003970 0x7f799c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b37fe640 1 -- 172.21.15.17:0/69739741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c003520 con 0x7f799c0047c0 2023-08-09T12:44:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b8884640 1 -- 172.21.15.17:0/69739741 reap_dead start 2023-08-09T12:44:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.600+0000 7f79b3fff640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c003970 0x7f799c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.601+0000 7f79b37fe640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f799c0047c0 0x7f799c004c40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009ac0 tx=0x7f799c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9461043c895f8d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.601+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a802c6d0 con 0x7f799c0047c0 2023-08-09T12:44:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.601+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a802c830 con 0x7f799c0047c0 2023-08-09T12:44:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.601+0000 7f79b2ffd640 1 -- 172.21.15.17:0/69739741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a802cbc0 con 0x7f799c0047c0 2023-08-09T12:44:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.602+0000 7f79b9085640 1 -- 172.21.15.17:0/69739741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f799c0047c0 msgr2=0x7f799c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.602+0000 7f79b9085640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f799c0047c0 0x7f799c004c40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009ac0 tx=0x7f799c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.602+0000 7f79b9085640 1 -- 172.21.15.17:0/69739741 shutdown_connections 2023-08-09T12:44:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.602+0000 7f79b9085640 1 --2- 172.21.15.17:0/69739741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f799c0047c0 0x7f799c004c40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.602+0000 7f79b9085640 1 -- 172.21.15.17:0/69739741 >> 172.21.15.17:0/69739741 conn(0x7f79b40b1d50 msgr2=0x7f79b406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:21.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.602+0000 7f79b9085640 1 -- 172.21.15.17:0/69739741 shutdown_connections 2023-08-09T12:44:21.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.602+0000 7f79b9085640 1 -- 172.21.15.17:0/69739741 wait complete. 2023-08-09T12:44:21.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.604+0000 7f79b9085640 1 Processor -- start 2023-08-09T12:44:21.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.604+0000 7f79b9085640 1 -- start start 2023-08-09T12:44:21.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.605+0000 7f79b9085640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c0047c0 0x7f79b414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.605+0000 7f79b9085640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b40c2220 0x7f79b40c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.605+0000 7f79b9085640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b414ca40 0x7f79b4157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.605+0000 7f79b9085640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c2a00 con 0x7f79b414ca40 2023-08-09T12:44:21.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.605+0000 7f79b9085640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c5550 con 0x7f799c0047c0 2023-08-09T12:44:21.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.605+0000 7f79b9085640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40ce3a0 con 0x7f79b40c2220 2023-08-09T12:44:21.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b8884640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b414ca40 0x7f79b4157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b8884640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b414ca40 0x7f79b4157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53904/0 (socket says 172.21.15.17:53904) 2023-08-09T12:44:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b8884640 1 -- 172.21.15.17:0/2006761703 learned_addr learned my addr 172.21.15.17:0/2006761703 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b37fe640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b40c2220 0x7f79b40c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b3fff640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c0047c0 0x7f79b414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b8884640 1 -- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b40c2220 msgr2=0x7f79b40c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b8884640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b40c2220 0x7f79b40c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b8884640 1 -- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c0047c0 msgr2=0x7f79b414d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b8884640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c0047c0 0x7f79b414d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.606+0000 7f79b8884640 1 -- 172.21.15.17:0/2006761703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40c2720 con 0x7f79b414ca40 2023-08-09T12:44:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.607+0000 7f79b8884640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b414ca40 0x7f79b4157430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f79b406a640 tx=0x7f79ac00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.607+0000 7f79b0ff9640 1 -- 172.21.15.17:0/2006761703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac005d40 con 0x7f79b414ca40 2023-08-09T12:44:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.607+0000 7f79b0ff9640 1 -- 172.21.15.17:0/2006761703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac00ced0 con 0x7f79b414ca40 2023-08-09T12:44:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.607+0000 7f79b0ff9640 1 -- 172.21.15.17:0/2006761703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00a880 con 0x7f79b414ca40 2023-08-09T12:44:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.607+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40cdd50 con 0x7f79b414ca40 2023-08-09T12:44:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.607+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b41560e0 con 0x7f79b414ca40 2023-08-09T12:44:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.608+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b40cdbb0 con 0x7f79b414ca40 2023-08-09T12:44:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.609+0000 7f79b0ff9640 1 -- 172.21.15.17:0/2006761703 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79ac00a9e0 con 0x7f79b414ca40 2023-08-09T12:44:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.610+0000 7f79b0ff9640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f79a006a080 0x7f79a006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.610+0000 7f79b0ff9640 1 -- 172.21.15.17:0/2006761703 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f79ac086fb0 con 0x7f79b414ca40 2023-08-09T12:44:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.611+0000 7f79b3fff640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f79a006a080 0x7f79a006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.612+0000 7f79b3fff640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f79a006a080 0x7f79a006c540 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000fb0 tx=0x7f79a40014b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.614+0000 7f79b0ff9640 1 -- 172.21.15.17:0/2006761703 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f79b40cdbb0 con 0x7f79b414ca40 2023-08-09T12:44:21.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.811+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79b4159fb0 con 0x7f79b414ca40 2023-08-09T12:44:21.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.812+0000 7f79b0ff9640 1 -- 172.21.15.17:0/2006761703 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+14616 (secure 0 0 0) 0x7f79b4159fb0 con 0x7f79b414ca40 2023-08-09T12:44:21.816 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:21.816 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:20.777183+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:21.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.815+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f79a006a080 msgr2=0x7f79a006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.815+0000 7f79b9085640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f79a006a080 0x7f79a006c540 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000fb0 tx=0x7f79a40014b0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.815+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b414ca40 msgr2=0x7f79b4157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:21.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.815+0000 7f79b9085640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b414ca40 0x7f79b4157430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f79b406a640 tx=0x7f79ac00cb90 comp rx=0 tx=0).stop 2023-08-09T12:44:21.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.816+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 shutdown_connections 2023-08-09T12:44:21.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.816+0000 7f79b9085640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f79a006a080 0x7f79a006c540 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.816+0000 7f79b9085640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79b414ca40 0x7f79b4157430 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.816+0000 7f79b9085640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79b40c2220 0x7f79b40c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.816+0000 7f79b9085640 1 --2- 172.21.15.17:0/2006761703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f799c0047c0 0x7f79b414d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:21.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.816+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 >> 172.21.15.17:0/2006761703 conn(0x7f79b40b1d50 msgr2=0x7f79b40ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:21.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.816+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 shutdown_connections 2023-08-09T12:44:21.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:21.816+0000 7f79b9085640 1 -- 172.21.15.17:0/2006761703 wait complete. 2023-08-09T12:44:21.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:44:21.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:44:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.059+0000 7feb75263640 1 Processor -- start 2023-08-09T12:44:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.060+0000 7feb75263640 1 -- start start 2023-08-09T12:44:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.061+0000 7feb75263640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feb700b8420 0x7feb700cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.061+0000 7feb75263640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb7015cf20 0x7feb700cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.061+0000 7feb75263640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb700d0f00 con 0x7feb7015cb40 2023-08-09T12:44:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.061+0000 7feb75263640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb701611f0 con 0x7feb700b8420 2023-08-09T12:44:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.061+0000 7feb75263640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb701614d0 con 0x7feb7015cf20 2023-08-09T12:44:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.062+0000 7feb6f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feb700b8420 0x7feb700cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.062+0000 7feb6f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feb700b8420 0x7feb700cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53920/0 (socket says 172.21.15.17:53920) 2023-08-09T12:44:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.062+0000 7feb6f7fe640 1 -- 172.21.15.17:0/2656579200 learned_addr learned my addr 172.21.15.17:0/2656579200 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.062+0000 7feb74a62640 1 --2- 172.21.15.17:0/2656579200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb7015cf20 0x7feb700cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.062+0000 7feb6f7fe640 1 -- 172.21.15.17:0/2656579200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb7015cf20 msgr2=0x7feb700cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.062+0000 7feb6f7fe640 1 --2- 172.21.15.17:0/2656579200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb7015cf20 0x7feb700cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.062+0000 7feb6f7fe640 1 -- 172.21.15.17:0/2656579200 >> v1:172.21.15.142:6789/0 conn(0x7feb7015cb40 legacy=0x7feb701609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.062+0000 7feb6f7fe640 1 -- 172.21.15.17:0/2656579200 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb701617b0 con 0x7feb700b8420 2023-08-09T12:44:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.063+0000 7feb6f7fe640 1 --2- 172.21.15.17:0/2656579200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b8420 0x7feb700cd860 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7feb64009870 tx=0x7feb6402ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89821af553698269 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb6effd640 1 -- 172.21.15.17:0/2656579200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6402f830 con 0x7feb700b8420 2023-08-09T12:44:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb6effd640 1 -- 172.21.15.17:0/2656579200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6402f990 con 0x7feb700b8420 2023-08-09T12:44:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb6effd640 1 -- 172.21.15.17:0/2656579200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6402fd20 con 0x7feb700b8420 2023-08-09T12:44:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb75263640 1 -- 172.21.15.17:0/2656579200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b8420 msgr2=0x7feb700cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb75263640 1 --2- 172.21.15.17:0/2656579200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b8420 0x7feb700cd860 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7feb64009870 tx=0x7feb6402ba10 comp rx=0 tx=0).stop 2023-08-09T12:44:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb75263640 1 -- 172.21.15.17:0/2656579200 shutdown_connections 2023-08-09T12:44:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb75263640 1 --2- 172.21.15.17:0/2656579200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb7015cf20 0x7feb700cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb75263640 1 --2- 172.21.15.17:0/2656579200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b8420 0x7feb700cd860 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.064+0000 7feb75263640 1 -- 172.21.15.17:0/2656579200 >> 172.21.15.17:0/2656579200 conn(0x7feb700d2ab0 msgr2=0x7feb700d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.065+0000 7feb75263640 1 -- 172.21.15.17:0/2656579200 shutdown_connections 2023-08-09T12:44:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.065+0000 7feb75263640 1 -- 172.21.15.17:0/2656579200 wait complete. 2023-08-09T12:44:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.066+0000 7feb75263640 1 Processor -- start 2023-08-09T12:44:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.067+0000 7feb75263640 1 -- start start 2023-08-09T12:44:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb75263640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb700b8420 0x7feb70148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb75263640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015cb40 0x7feb700c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb75263640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb7015cf20 0x7feb7015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb75263640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb70159ce0 con 0x7feb7015cb40 2023-08-09T12:44:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb75263640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c9190 con 0x7feb7015cf20 2023-08-09T12:44:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb75263640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7015fa70 con 0x7feb700b8420 2023-08-09T12:44:22.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015cb40 0x7feb700c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015cb40 0x7feb700c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53926/0 (socket says 172.21.15.17:53926) 2023-08-09T12:44:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6f7fe640 1 -- 172.21.15.17:0/1806920597 learned_addr learned my addr 172.21.15.17:0/1806920597 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6ffff640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb700b8420 0x7feb70148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6f7fe640 1 -- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb700b8420 msgr2=0x7feb70148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6f7fe640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb700b8420 0x7feb70148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6f7fe640 1 -- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb7015cf20 msgr2=0x7feb7015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6f7fe640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb7015cf20 0x7feb7015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.068+0000 7feb6f7fe640 1 -- 172.21.15.17:0/1806920597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb640094d0 con 0x7feb7015cb40 2023-08-09T12:44:22.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.069+0000 7feb6f7fe640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015cb40 0x7feb700c8c50 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7feb64000c00 tx=0x7feb64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:22.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.069+0000 7feb6cff9640 1 -- 172.21.15.17:0/1806920597 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64037c40 con 0x7feb7015cb40 2023-08-09T12:44:22.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.069+0000 7feb6cff9640 1 -- 172.21.15.17:0/1806920597 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64037da0 con 0x7feb7015cb40 2023-08-09T12:44:22.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.069+0000 7feb6cff9640 1 -- 172.21.15.17:0/1806920597 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64041640 con 0x7feb7015cb40 2023-08-09T12:44:22.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.069+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7015fd50 con 0x7feb7015cb40 2023-08-09T12:44:22.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.069+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb70160310 con 0x7feb7015cb40 2023-08-09T12:44:22.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.070+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7004e390 con 0x7feb7015cb40 2023-08-09T12:44:22.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.071+0000 7feb6cff9640 1 -- 172.21.15.17:0/1806920597 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb640417a0 con 0x7feb7015cb40 2023-08-09T12:44:22.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.072+0000 7feb6cff9640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feb5c06a050 0x7feb5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.072+0000 7feb6cff9640 1 -- 172.21.15.17:0/1806920597 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feb6403c070 con 0x7feb7015cb40 2023-08-09T12:44:22.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.073+0000 7feb6ffff640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feb5c06a050 0x7feb5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.074+0000 7feb6ffff640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feb5c06a050 0x7feb5c06c510 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feb60007fd0 tx=0x7feb60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:22.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.077+0000 7feb6cff9640 1 -- 172.21.15.17:0/1806920597 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feb64076c00 con 0x7feb7015cb40 2023-08-09T12:44:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.272+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb700c9380 con 0x7feb7015cb40 2023-08-09T12:44:22.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.273+0000 7feb6cff9640 1 -- 172.21.15.17:0/1806920597 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb6407a220 con 0x7feb7015cb40 2023-08-09T12:44:22.276 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:44:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feb5c06a050 msgr2=0x7feb5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feb5c06a050 0x7feb5c06c510 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feb60007fd0 tx=0x7feb60009040 comp rx=0 tx=0).stop 2023-08-09T12:44:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015cb40 msgr2=0x7feb700c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015cb40 0x7feb700c8c50 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7feb64000c00 tx=0x7feb64004730 comp rx=0 tx=0).stop 2023-08-09T12:44:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 shutdown_connections 2023-08-09T12:44:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feb5c06a050 0x7feb5c06c510 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb7015cf20 0x7feb7015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015cb40 0x7feb700c8c50 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 --2- 172.21.15.17:0/1806920597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb700b8420 0x7feb70148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 >> 172.21.15.17:0/1806920597 conn(0x7feb700d2ab0 msgr2=0x7feb7015b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 shutdown_connections 2023-08-09T12:44:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.276+0000 7feb75263640 1 -- 172.21.15.17:0/1806920597 wait complete. 2023-08-09T12:44:22.298 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:44:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.529+0000 7f446390c640 1 Processor -- start 2023-08-09T12:44:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.529+0000 7f446390c640 1 -- start start 2023-08-09T12:44:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.531+0000 7f446390c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f445c161280 0x7f445c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.531+0000 7f446390c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f445c0acfc0 0x7f445c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.531+0000 7f446390c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c15df30 con 0x7f445c161660 2023-08-09T12:44:22.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.531+0000 7f446390c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c15d430 con 0x7f445c0acfc0 2023-08-09T12:44:22.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.531+0000 7f446390c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0ca9d0 con 0x7f445c161280 2023-08-09T12:44:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.531+0000 7f4461ea9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f445c0acfc0 0x7f445c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.532+0000 7f4460ea7640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f445c161660 0x7f445c0ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34780/0 (socket says 172.21.15.17:34780) 2023-08-09T12:44:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.532+0000 7f4460ea7640 1 -- 172.21.15.17:0/3931757586 learned_addr learned my addr 172.21.15.17:0/3931757586 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.532+0000 7f44616a8640 1 --2- 172.21.15.17:0/3931757586 >> v2:172.21.15.142:3300/0 conn(0x7f445c161280 0x7f445c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.532+0000 7f4461ea9640 1 -- 172.21.15.17:0/3931757586 >> v2:172.21.15.142:3300/0 conn(0x7f445c161280 msgr2=0x7f445c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.532+0000 7f4461ea9640 1 --2- 172.21.15.17:0/3931757586 >> v2:172.21.15.142:3300/0 conn(0x7f445c161280 0x7f445c0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.532+0000 7f4461ea9640 1 -- 172.21.15.17:0/3931757586 >> v1:172.21.15.17:6789/0 conn(0x7f445c161660 legacy=0x7f445c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.532+0000 7f4461ea9640 1 -- 172.21.15.17:0/3931757586 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c15e3c0 con 0x7f445c0acfc0 2023-08-09T12:44:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.532+0000 7f4453fff640 1 -- 172.21.15.17:0/3931757586 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690100622 0 0) 0x7f445c15df30 con 0x7f445c161660 2023-08-09T12:44:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.533+0000 7f4461ea9640 1 --2- 172.21.15.17:0/3931757586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0acfc0 0x7f445c0cc630 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f445c0ad990 tx=0x7f445402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cadf3e14e164959 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.533+0000 7f4453fff640 1 -- 172.21.15.17:0/3931757586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445402cbe0 con 0x7f445c0acfc0 2023-08-09T12:44:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f4453fff640 1 -- 172.21.15.17:0/3931757586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445402cd40 con 0x7f445c0acfc0 2023-08-09T12:44:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f4453fff640 1 -- 172.21.15.17:0/3931757586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4454034660 con 0x7f445c0acfc0 2023-08-09T12:44:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f446390c640 1 -- 172.21.15.17:0/3931757586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0acfc0 msgr2=0x7f445c0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f446390c640 1 --2- 172.21.15.17:0/3931757586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0acfc0 0x7f445c0cc630 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f445c0ad990 tx=0x7f445402be30 comp rx=0 tx=0).stop 2023-08-09T12:44:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f446390c640 1 -- 172.21.15.17:0/3931757586 shutdown_connections 2023-08-09T12:44:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f446390c640 1 --2- 172.21.15.17:0/3931757586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0acfc0 0x7f445c0cc630 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f446390c640 1 --2- 172.21.15.17:0/3931757586 >> v2:172.21.15.142:3300/0 conn(0x7f445c161280 0x7f445c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f446390c640 1 -- 172.21.15.17:0/3931757586 >> 172.21.15.17:0/3931757586 conn(0x7f445c0cb1b0 msgr2=0x7f445c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f446390c640 1 -- 172.21.15.17:0/3931757586 shutdown_connections 2023-08-09T12:44:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.534+0000 7f446390c640 1 -- 172.21.15.17:0/3931757586 wait complete. 2023-08-09T12:44:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.536+0000 7f446390c640 1 Processor -- start 2023-08-09T12:44:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.536+0000 7f446390c640 1 -- start start 2023-08-09T12:44:22.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f446390c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c0acfc0 0x7f445c1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f446390c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f445c161280 0x7f445c154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f446390c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c161660 0x7f445c1436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f446390c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c3130 con 0x7f445c161660 2023-08-09T12:44:22.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f446390c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c21d0 con 0x7f445c0acfc0 2023-08-09T12:44:22.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f446390c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c24b0 con 0x7f445c161280 2023-08-09T12:44:22.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f4461ea9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c161660 0x7f445c1436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f4461ea9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c161660 0x7f445c1436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53944/0 (socket says 172.21.15.17:53944) 2023-08-09T12:44:22.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.537+0000 7f4461ea9640 1 -- 172.21.15.17:0/3162407850 learned_addr learned my addr 172.21.15.17:0/3162407850 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:22.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.538+0000 7f4460ea7640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f445c161280 0x7f445c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.538+0000 7f4461ea9640 1 -- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f445c161280 msgr2=0x7f445c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.538+0000 7f4461ea9640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f445c161280 0x7f445c154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.538+0000 7f4461ea9640 1 -- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c0acfc0 msgr2=0x7f445c1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.538+0000 7f4461ea9640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c0acfc0 0x7f445c1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.538+0000 7f4461ea9640 1 -- 172.21.15.17:0/3162407850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454009a70 con 0x7f445c161660 2023-08-09T12:44:22.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.538+0000 7f4461ea9640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c161660 0x7f445c1436f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f445402c440 tx=0x7f4454004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:22.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.539+0000 7f4451ffb640 1 -- 172.21.15.17:0/3162407850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445403e610 con 0x7f445c161660 2023-08-09T12:44:22.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.539+0000 7f4451ffb640 1 -- 172.21.15.17:0/3162407850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445403e770 con 0x7f445c161660 2023-08-09T12:44:22.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.539+0000 7f4451ffb640 1 -- 172.21.15.17:0/3162407850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445403eb20 con 0x7f445c161660 2023-08-09T12:44:22.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.539+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c0c2790 con 0x7f445c161660 2023-08-09T12:44:22.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.539+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c0c2d50 con 0x7f445c161660 2023-08-09T12:44:22.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.540+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c1605c0 con 0x7f445c161660 2023-08-09T12:44:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.541+0000 7f4451ffb640 1 -- 172.21.15.17:0/3162407850 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f445403b050 con 0x7f445c161660 2023-08-09T12:44:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.542+0000 7f4451ffb640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f444006a050 0x7f444006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.542+0000 7f4451ffb640 1 -- 172.21.15.17:0/3162407850 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f44540aa900 con 0x7f445c161660 2023-08-09T12:44:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.542+0000 7f44616a8640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f444006a050 0x7f444006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.544+0000 7f44616a8640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f444006a050 0x7f444006c510 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4458006fd0 tx=0x7f4458008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.546+0000 7f4451ffb640 1 -- 172.21.15.17:0/3162407850 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4454076330 con 0x7f445c161660 2023-08-09T12:44:22.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.739+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f445c067a80 con 0x7f445c161660 2023-08-09T12:44:22.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.740+0000 7f4451ffb640 1 -- 172.21.15.17:0/3162407850 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7f445404d0a0 con 0x7f445c161660 2023-08-09T12:44:22.744 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:44:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f444006a050 msgr2=0x7f444006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f444006a050 0x7f444006c510 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4458006fd0 tx=0x7f4458008040 comp rx=0 tx=0).stop 2023-08-09T12:44:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c161660 msgr2=0x7f445c1436f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c161660 0x7f445c1436f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f445402c440 tx=0x7f4454004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 shutdown_connections 2023-08-09T12:44:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f444006a050 0x7f444006c510 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c161660 0x7f445c1436f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f445c161280 0x7f445c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 --2- 172.21.15.17:0/3162407850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c0acfc0 0x7f445c1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 >> 172.21.15.17:0/3162407850 conn(0x7f445c0cb1b0 msgr2=0x7f445c0703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 shutdown_connections 2023-08-09T12:44:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.743+0000 7f446390c640 1 -- 172.21.15.17:0/3162407850 wait complete. 2023-08-09T12:44:22.766 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:44:22.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.988+0000 7f9b4ef12640 1 Processor -- start 2023-08-09T12:44:22.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.988+0000 7f9b4ef12640 1 -- start start 2023-08-09T12:44:22.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.990+0000 7f9b4ef12640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9b480b3b40 0x7f9b480b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.990+0000 7f9b4ef12640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4806c990 con 0x7f9b480cc630 2023-08-09T12:44:22.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.990+0000 7f9b4ef12640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b480b2250 con 0x7f9b480adc40 2023-08-09T12:44:22.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.990+0000 7f9b4ef12640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b480ae020 con 0x7f9b480b3b40 2023-08-09T12:44:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.990+0000 7f9b4d4af640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9b480cc630 0x7f9b480ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34790/0 (socket says 172.21.15.17:34790) 2023-08-09T12:44:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.990+0000 7f9b3ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9b480b3b40 0x7f9b480b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.990+0000 7f9b4d4af640 1 -- 172.21.15.17:0/3575661981 learned_addr learned my addr 172.21.15.17:0/3575661981 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.991+0000 7f9b3ffff640 1 -- 172.21.15.17:0/3575661981 >> v1:172.21.15.142:6789/0 conn(0x7f9b480adc40 legacy=0x7f9b4806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.991+0000 7f9b3ffff640 1 -- 172.21.15.17:0/3575661981 >> v1:172.21.15.17:6789/0 conn(0x7f9b480cc630 legacy=0x7f9b480ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.991+0000 7f9b3ffff640 1 -- 172.21.15.17:0/3575661981 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b480b2530 con 0x7f9b480b3b40 2023-08-09T12:44:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.991+0000 7f9b3f7fe640 1 -- 172.21.15.17:0/3575661981 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517057719 0 0) 0x7f9b4806c990 con 0x7f9b480cc630 2023-08-09T12:44:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.992+0000 7f9b3ffff640 1 --2- 172.21.15.17:0/3575661981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480b3b40 0x7f9b480b3fd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009790 tx=0x7f9b3802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b895a61e6f466ad8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.992+0000 7f9b3f7fe640 1 -- 172.21.15.17:0/3575661981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38030800 con 0x7f9b480b3b40 2023-08-09T12:44:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.992+0000 7f9b3f7fe640 1 -- 172.21.15.17:0/3575661981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b38030960 con 0x7f9b480b3b40 2023-08-09T12:44:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.992+0000 7f9b3f7fe640 1 -- 172.21.15.17:0/3575661981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38030cf0 con 0x7f9b480b3b40 2023-08-09T12:44:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.993+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3575661981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480b3b40 msgr2=0x7f9b480b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.993+0000 7f9b4ef12640 1 --2- 172.21.15.17:0/3575661981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480b3b40 0x7f9b480b3fd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009790 tx=0x7f9b3802b940 comp rx=0 tx=0).stop 2023-08-09T12:44:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.993+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3575661981 shutdown_connections 2023-08-09T12:44:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.993+0000 7f9b4ef12640 1 --2- 172.21.15.17:0/3575661981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480b3b40 0x7f9b480b3fd0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.993+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3575661981 >> 172.21.15.17:0/3575661981 conn(0x7f9b480cb1b0 msgr2=0x7f9b480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.993+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3575661981 shutdown_connections 2023-08-09T12:44:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.993+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3575661981 wait complete. 2023-08-09T12:44:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.995+0000 7f9b4ef12640 1 Processor -- start 2023-08-09T12:44:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.995+0000 7f9b4ef12640 1 -- start start 2023-08-09T12:44:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ef12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480adc40 0x7f9b480ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ef12640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b480b3b40 0x7f9b480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ef12640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b480cc630 0x7f9b480acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ef12640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b480cadb0 con 0x7f9b480adc40 2023-08-09T12:44:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ef12640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4814f6b0 con 0x7f9b480b3b40 2023-08-09T12:44:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ef12640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b480c7f80 con 0x7f9b480cc630 2023-08-09T12:44:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ccae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480adc40 0x7f9b480ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ccae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480adc40 0x7f9b480ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53962/0 (socket says 172.21.15.17:53962) 2023-08-09T12:44:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.996+0000 7f9b4ccae640 1 -- 172.21.15.17:0/3656789134 learned_addr learned my addr 172.21.15.17:0/3656789134 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.997+0000 7f9b4d4af640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b480cc630 0x7f9b480acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.997+0000 7f9b4ccae640 1 -- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b480cc630 msgr2=0x7f9b480acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.997+0000 7f9b4ccae640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b480cc630 0x7f9b480acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.997+0000 7f9b4ccae640 1 -- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b480b3b40 msgr2=0x7f9b480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.997+0000 7f9b4ccae640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b480b3b40 0x7f9b480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.997+0000 7f9b4ccae640 1 -- 172.21.15.17:0/3656789134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b380093a0 con 0x7f9b480adc40 2023-08-09T12:44:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.997+0000 7f9b4ccae640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480adc40 0x7f9b480ca870 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400c450 tx=0x7f9b4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:23.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.997+0000 7f9b3d7fa640 1 -- 172.21.15.17:0/3656789134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b440052d0 con 0x7f9b480adc40 2023-08-09T12:44:23.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.998+0000 7f9b3d7fa640 1 -- 172.21.15.17:0/3656789134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b44005430 con 0x7f9b480adc40 2023-08-09T12:44:23.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.998+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b480c6ee0 con 0x7f9b480adc40 2023-08-09T12:44:23.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.998+0000 7f9b3d7fa640 1 -- 172.21.15.17:0/3656789134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44012870 con 0x7f9b480adc40 2023-08-09T12:44:23.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.998+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b480c74a0 con 0x7f9b480adc40 2023-08-09T12:44:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:22.999+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b48067a80 con 0x7f9b480adc40 2023-08-09T12:44:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.000+0000 7f9b3d7fa640 1 -- 172.21.15.17:0/3656789134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b440129d0 con 0x7f9b480adc40 2023-08-09T12:44:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.001+0000 7f9b3d7fa640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b3406a050 0x7f9b3406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.001+0000 7f9b3d7fa640 1 -- 172.21.15.17:0/3656789134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9b44087d90 con 0x7f9b480adc40 2023-08-09T12:44:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.002+0000 7f9b3ffff640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b3406a050 0x7f9b3406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.003+0000 7f9b3ffff640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b3406a050 0x7f9b3406c510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9b38036000 tx=0x7f9b3803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:23.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.005+0000 7f9b3d7fa640 1 -- 172.21.15.17:0/3656789134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9b440537c0 con 0x7f9b480adc40 2023-08-09T12:44:23.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.208+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9b4806ed40 con 0x7f9b480adc40 2023-08-09T12:44:23.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.209+0000 7f9b3d7fa640 1 -- 172.21.15.17:0/3656789134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9b44056de0 con 0x7f9b480adc40 2023-08-09T12:44:23.212 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:23.213 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:44:23.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:23.213 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:44:23.213 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:44:23.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:44:23.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:44:23.214 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:44:23.214 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:44:23.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:44:23.214 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:44:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b3406a050 msgr2=0x7f9b3406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b3406a050 0x7f9b3406c510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9b38036000 tx=0x7f9b3803b040 comp rx=0 tx=0).stop 2023-08-09T12:44:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480adc40 msgr2=0x7f9b480ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480adc40 0x7f9b480ca870 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400c450 tx=0x7f9b4400c910 comp rx=0 tx=0).stop 2023-08-09T12:44:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 shutdown_connections 2023-08-09T12:44:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b3406a050 0x7f9b3406c510 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b480cc630 0x7f9b480acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b480b3b40 0x7f9b480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 --2- 172.21.15.17:0/3656789134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480adc40 0x7f9b480ca870 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 >> 172.21.15.17:0/3656789134 conn(0x7f9b480cb1b0 msgr2=0x7f9b480699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 shutdown_connections 2023-08-09T12:44:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.212+0000 7f9b4ef12640 1 -- 172.21.15.17:0/3656789134 wait complete. 2023-08-09T12:44:23.235 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:44:23.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:44:23.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.477+0000 7fcd003b5640 1 Processor -- start 2023-08-09T12:44:23.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.477+0000 7fcd003b5640 1 -- start start 2023-08-09T12:44:23.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.479+0000 7fcd003b5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fccf8159ab0 0x7fccf80cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:23.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.479+0000 7fcd003b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf806f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:23.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.479+0000 7fcd003b5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf8159e90 con 0x7fccf80ce090 2023-08-09T12:44:23.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.479+0000 7fcd003b5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf80ccab0 con 0x7fccf8159ab0 2023-08-09T12:44:23.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.479+0000 7fcd003b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80ccd90 con 0x7fccf80cee00 2023-08-09T12:44:23.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.479+0000 7fccfe952640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.480+0000 7fccfd950640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fccf80ce090 0x7fccf80ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:60300/0 (socket says 172.21.15.17:60300) 2023-08-09T12:44:23.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.480+0000 7fccfd950640 1 -- 172.21.15.17:0/969042034 learned_addr learned my addr 172.21.15.17:0/969042034 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:23.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.480+0000 7fccfe151640 1 --2- 172.21.15.17:0/969042034 >> v2:172.21.15.142:3300/0 conn(0x7fccf8159ab0 0x7fccf80cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.480+0000 7fccfe952640 1 -- 172.21.15.17:0/969042034 >> v2:172.21.15.142:3300/0 conn(0x7fccf8159ab0 msgr2=0x7fccf80cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:23.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.480+0000 7fccfe952640 1 --2- 172.21.15.17:0/969042034 >> v2:172.21.15.142:3300/0 conn(0x7fccf8159ab0 0x7fccf80cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.480+0000 7fccfe952640 1 -- 172.21.15.17:0/969042034 >> v1:172.21.15.142:6789/0 conn(0x7fccf80ce090 legacy=0x7fccf80ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:23.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.480+0000 7fccfe952640 1 -- 172.21.15.17:0/969042034 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf80cd070 con 0x7fccf80cee00 2023-08-09T12:44:23.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.481+0000 7fccfe151640 1 --2- 172.21.15.17:0/969042034 >> v2:172.21.15.142:3300/0 conn(0x7fccf8159ab0 0x7fccf80cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:44:23.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.482+0000 7fccfe952640 1 --2- 172.21.15.17:0/969042034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf806f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009d90 tx=0x7fccf002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ae68fc6627598e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.482+0000 7fccfd14f640 1 -- 172.21.15.17:0/969042034 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf002cce0 con 0x7fccf80cee00 2023-08-09T12:44:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.482+0000 7fccfd14f640 1 -- 172.21.15.17:0/969042034 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf002ce40 con 0x7fccf80cee00 2023-08-09T12:44:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.482+0000 7fccfd14f640 1 -- 172.21.15.17:0/969042034 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0034660 con 0x7fccf80cee00 2023-08-09T12:44:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.483+0000 7fcd003b5640 1 -- 172.21.15.17:0/969042034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 msgr2=0x7fccf806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.483+0000 7fcd003b5640 1 --2- 172.21.15.17:0/969042034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf806f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009d90 tx=0x7fccf002bf30 comp rx=0 tx=0).stop 2023-08-09T12:44:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.483+0000 7fcd003b5640 1 -- 172.21.15.17:0/969042034 shutdown_connections 2023-08-09T12:44:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.483+0000 7fcd003b5640 1 --2- 172.21.15.17:0/969042034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf806f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.483+0000 7fcd003b5640 1 --2- 172.21.15.17:0/969042034 >> v2:172.21.15.142:3300/0 conn(0x7fccf8159ab0 0x7fccf80cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.483+0000 7fcd003b5640 1 -- 172.21.15.17:0/969042034 >> 172.21.15.17:0/969042034 conn(0x7fccf80697c0 msgr2=0x7fccf8069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.483+0000 7fcd003b5640 1 -- 172.21.15.17:0/969042034 shutdown_connections 2023-08-09T12:44:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.483+0000 7fcd003b5640 1 -- 172.21.15.17:0/969042034 wait complete. 2023-08-09T12:44:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.485+0000 7fcd003b5640 1 Processor -- start 2023-08-09T12:44:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.485+0000 7fcd003b5640 1 -- start start 2023-08-09T12:44:23.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.486+0000 7fcd003b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf80ce090 0x7fccf815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:23.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.486+0000 7fcd003b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf80adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.486+0000 7fcd003b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf8159ab0 0x7fccf80c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.486+0000 7fcd003b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf815c910 con 0x7fccf8159ab0 2023-08-09T12:44:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.486+0000 7fcd003b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8147740 con 0x7fccf80ce090 2023-08-09T12:44:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.486+0000 7fcd003b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80c5240 con 0x7fccf80cee00 2023-08-09T12:44:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.486+0000 7fccfe952640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf8159ab0 0x7fccf80c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfe952640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf8159ab0 0x7fccf80c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53972/0 (socket says 172.21.15.17:53972) 2023-08-09T12:44:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfe952640 1 -- 172.21.15.17:0/1594776833 learned_addr learned my addr 172.21.15.17:0/1594776833 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfd950640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf80adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfe151640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf80ce090 0x7fccf815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfe952640 1 -- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 msgr2=0x7fccf80adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfe952640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf80adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfe952640 1 -- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf80ce090 msgr2=0x7fccf815a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfe952640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf80ce090 0x7fccf815a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.487+0000 7fccfe952640 1 -- 172.21.15.17:0/1594776833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce8009400 con 0x7fccf8159ab0 2023-08-09T12:44:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.488+0000 7fccfe952640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf8159ab0 0x7fccf80c49d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009eb0 tx=0x7fccf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.488+0000 7fccf6ffd640 1 -- 172.21.15.17:0/1594776833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf003e610 con 0x7fccf8159ab0 2023-08-09T12:44:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.488+0000 7fccf6ffd640 1 -- 172.21.15.17:0/1594776833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf003e770 con 0x7fccf8159ab0 2023-08-09T12:44:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.488+0000 7fccf6ffd640 1 -- 172.21.15.17:0/1594776833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf003eb00 con 0x7fccf8159ab0 2023-08-09T12:44:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.488+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf0009a70 con 0x7fccf8159ab0 2023-08-09T12:44:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.488+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf815c250 con 0x7fccf8159ab0 2023-08-09T12:44:23.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.489+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf8067a80 con 0x7fccf8159ab0 2023-08-09T12:44:23.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.490+0000 7fccf6ffd640 1 -- 172.21.15.17:0/1594776833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fccf003b050 con 0x7fccf8159ab0 2023-08-09T12:44:23.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.491+0000 7fccf6ffd640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcce406a050 0x7fcce406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:23.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.491+0000 7fccf6ffd640 1 -- 172.21.15.17:0/1594776833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fccf00aa700 con 0x7fccf8159ab0 2023-08-09T12:44:23.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.492+0000 7fccfe151640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcce406a050 0x7fcce406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.493+0000 7fccfe151640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcce406a050 0x7fcce406c510 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fccf81f4090 tx=0x7fcce8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.495+0000 7fccf6ffd640 1 -- 172.21.15.17:0/1594776833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fccf0076130 con 0x7fccf8159ab0 2023-08-09T12:44:23.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:23.687+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fccf81538e0 con 0x7fccf8159ab0 2023-08-09T12:44:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.030+0000 7fccf6ffd640 1 -- 172.21.15.17:0/1594776833 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v89) v1 ==== 138+0+0 (secure 0 0 0) 0x7fccf00390b0 con 0x7fccf8159ab0 2023-08-09T12:44:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:44:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.037+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcce406a050 msgr2=0x7fcce406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.037+0000 7fcd003b5640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcce406a050 0x7fcce406c510 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fccf81f4090 tx=0x7fcce8008040 comp rx=0 tx=0).stop 2023-08-09T12:44:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.037+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf8159ab0 msgr2=0x7fccf80c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.037+0000 7fcd003b5640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf8159ab0 0x7fccf80c49d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009eb0 tx=0x7fccf0004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.038+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 shutdown_connections 2023-08-09T12:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.038+0000 7fcd003b5640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcce406a050 0x7fcce406c510 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.038+0000 7fcd003b5640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf8159ab0 0x7fccf80c49d0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.038+0000 7fcd003b5640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccf80cee00 0x7fccf80adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.038+0000 7fcd003b5640 1 --2- 172.21.15.17:0/1594776833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccf80ce090 0x7fccf815a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.038+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 >> 172.21.15.17:0/1594776833 conn(0x7fccf80697c0 msgr2=0x7fccf806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.038+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 shutdown_connections 2023-08-09T12:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.038+0000 7fcd003b5640 1 -- 172.21.15.17:0/1594776833 wait complete. 2023-08-09T12:44:24.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:44:24.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.297+0000 7f23b583f640 1 Processor -- start 2023-08-09T12:44:24.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.297+0000 7f23b583f640 1 -- start start 2023-08-09T12:44:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.298+0000 7f23b583f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f23b006c550 0x7f23b00cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:24.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.298+0000 7f23b583f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b00cdb00 con 0x7f23b015ce50 2023-08-09T12:44:24.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.298+0000 7f23b583f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b00cdde0 con 0x7f23b015d230 2023-08-09T12:44:24.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.298+0000 7f23b583f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00af710 con 0x7f23b006c550 2023-08-09T12:44:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.299+0000 7f23aeffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f23b015ce50 0x7f23b00c9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34792/0 (socket says 172.21.15.17:34792) 2023-08-09T12:44:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.299+0000 7f23aeffd640 1 -- 172.21.15.17:0/3550724510 learned_addr learned my addr 172.21.15.17:0/3550724510 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.299+0000 7f23af7fe640 1 --2- 172.21.15.17:0/3550724510 >> v2:172.21.15.17:3300/0 conn(0x7f23b006c550 0x7f23b00cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.299+0000 7f23af7fe640 1 -- 172.21.15.17:0/3550724510 >> v1:172.21.15.142:6789/0 conn(0x7f23b015d230 legacy=0x7f23b006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.299+0000 7f23af7fe640 1 -- 172.21.15.17:0/3550724510 >> v1:172.21.15.17:6789/0 conn(0x7f23b015ce50 legacy=0x7f23b00c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.300+0000 7f23af7fe640 1 -- 172.21.15.17:0/3550724510 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b00ce0c0 con 0x7f23b006c550 2023-08-09T12:44:24.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.301+0000 7f23af7fe640 1 --2- 172.21.15.17:0/3550724510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b006c550 0x7f23b00cd520 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009d90 tx=0x7f23a802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918f0fecc883425c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:24.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.301+0000 7f23adffb640 1 -- 172.21.15.17:0/3550724510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a802ccf0 con 0x7f23b006c550 2023-08-09T12:44:24.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.301+0000 7f23adffb640 1 -- 172.21.15.17:0/3550724510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a802ce50 con 0x7f23b006c550 2023-08-09T12:44:24.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.301+0000 7f23adffb640 1 -- 172.21.15.17:0/3550724510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8034660 con 0x7f23b006c550 2023-08-09T12:44:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.302+0000 7f23b583f640 1 -- 172.21.15.17:0/3550724510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b006c550 msgr2=0x7f23b00cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.302+0000 7f23b583f640 1 --2- 172.21.15.17:0/3550724510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b006c550 0x7f23b00cd520 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009d90 tx=0x7f23a802bf40 comp rx=0 tx=0).stop 2023-08-09T12:44:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.302+0000 7f23b583f640 1 -- 172.21.15.17:0/3550724510 shutdown_connections 2023-08-09T12:44:24.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.302+0000 7f23b583f640 1 --2- 172.21.15.17:0/3550724510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b006c550 0x7f23b00cd520 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:24.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.302+0000 7f23b583f640 1 -- 172.21.15.17:0/3550724510 >> 172.21.15.17:0/3550724510 conn(0x7f23b00ce840 msgr2=0x7f23b00cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:24.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.302+0000 7f23b583f640 1 -- 172.21.15.17:0/3550724510 shutdown_connections 2023-08-09T12:44:24.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.302+0000 7f23b583f640 1 -- 172.21.15.17:0/3550724510 wait complete. 2023-08-09T12:44:24.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.304+0000 7f23b583f640 1 Processor -- start 2023-08-09T12:44:24.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.304+0000 7f23b583f640 1 -- start start 2023-08-09T12:44:24.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23b583f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b006c550 0x7f23b01320c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:24.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23b583f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b015ce50 0x7f23b0146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23b583f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b015d230 0x7f23b014ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23b583f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b01329f0 con 0x7f23b015d230 2023-08-09T12:44:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23b583f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0132cd0 con 0x7f23b015ce50 2023-08-09T12:44:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23b583f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0132fb0 con 0x7f23b006c550 2023-08-09T12:44:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b015d230 0x7f23b014ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b015d230 0x7f23b014ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53984/0 (socket says 172.21.15.17:53984) 2023-08-09T12:44:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.305+0000 7f23af7fe640 1 -- 172.21.15.17:0/1031012113 learned_addr learned my addr 172.21.15.17:0/1031012113 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23ae7fc640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b015ce50 0x7f23b0146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23af7fe640 1 -- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b006c550 msgr2=0x7f23b01320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23aeffd640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b006c550 0x7f23b01320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23af7fe640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b006c550 0x7f23b01320c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23af7fe640 1 -- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b015ce50 msgr2=0x7f23b0146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23af7fe640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b015ce50 0x7f23b0146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23af7fe640 1 -- 172.21.15.17:0/1031012113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8009a70 con 0x7f23b015d230 2023-08-09T12:44:24.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23ae7fc640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b015ce50 0x7f23b0146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:24.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f23af7fe640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b015d230 0x7f23b014ef40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f23a8037040 tx=0x7f23a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:24.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.306+0000 7f2397fff640 1 -- 172.21.15.17:0/1031012113 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a803d600 con 0x7f23b015d230 2023-08-09T12:44:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.307+0000 7f2397fff640 1 -- 172.21.15.17:0/1031012113 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a803d760 con 0x7f23b015d230 2023-08-09T12:44:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.307+0000 7f2397fff640 1 -- 172.21.15.17:0/1031012113 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a803daf0 con 0x7f23b015d230 2023-08-09T12:44:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.307+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b01300d0 con 0x7f23b015d230 2023-08-09T12:44:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.307+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b0132600 con 0x7f23b015d230 2023-08-09T12:44:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.308+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b01305f0 con 0x7f23b015d230 2023-08-09T12:44:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.309+0000 7f2397fff640 1 -- 172.21.15.17:0/1031012113 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f23a803b040 con 0x7f23b015d230 2023-08-09T12:44:24.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.310+0000 7f2397fff640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239c06a050 0x7f239c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:24.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.311+0000 7f2397fff640 1 -- 172.21.15.17:0/1031012113 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f23a80aabd0 con 0x7f23b015d230 2023-08-09T12:44:24.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.311+0000 7f23aeffd640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239c06a050 0x7f239c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:24.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.312+0000 7f23aeffd640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239c06a050 0x7f239c06c510 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f23a0005880 tx=0x7f23a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:24.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.316+0000 7f2397fff640 1 -- 172.21.15.17:0/1031012113 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f23b01305f0 con 0x7f23b015d230 2023-08-09T12:44:24.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:24.512+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f23b01305f0 con 0x7f23b015d230 2023-08-09T12:44:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.041+0000 7f2397fff640 1 -- 172.21.15.17:0/1031012113 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v90) v1 ==== 170+0+0 (secure 0 0 0) 0x7f23b01305f0 con 0x7f23b015d230 2023-08-09T12:44:25.048 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:44:25.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239c06a050 msgr2=0x7f239c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:25.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239c06a050 0x7f239c06c510 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f23a0005880 tx=0x7f23a0009040 comp rx=0 tx=0).stop 2023-08-09T12:44:25.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b015d230 msgr2=0x7f23b014ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:25.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b015d230 0x7f23b014ef40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f23a8037040 tx=0x7f23a8004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:25.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 shutdown_connections 2023-08-09T12:44:25.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239c06a050 0x7f239c06c510 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:25.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b015d230 0x7f23b014ef40 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:25.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23b015ce50 0x7f23b0146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:25.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 --2- 172.21.15.17:0/1031012113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23b006c550 0x7f23b01320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:25.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.054+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 >> 172.21.15.17:0/1031012113 conn(0x7f23b00ce840 msgr2=0x7f23b006b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.059+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 shutdown_connections 2023-08-09T12:44:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.059+0000 7f23b583f640 1 -- 172.21.15.17:0/1031012113 wait complete. 2023-08-09T12:44:25.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:44:25.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.289+0000 7f904202d640 1 Processor -- start 2023-08-09T12:44:25.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.289+0000 7f904202d640 1 -- start start 2023-08-09T12:44:25.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.290+0000 7f904202d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f903c1616e0 0x7f903c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:25.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.290+0000 7f904202d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0cdd10 con 0x7f903c15ce90 2023-08-09T12:44:25.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.290+0000 7f904202d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0cdff0 con 0x7f903c0d29d0 2023-08-09T12:44:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.290+0000 7f904202d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0b6540 con 0x7f903c1616e0 2023-08-09T12:44:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.291+0000 7f9032ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f903c1616e0 0x7f903c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.291+0000 7f903b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f903c15ce90 0x7f903c0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34808/0 (socket says 172.21.15.17:34808) 2023-08-09T12:44:25.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.291+0000 7f9032ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f903c1616e0 0x7f903c0b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53996/0 (socket says 172.21.15.17:53996) 2023-08-09T12:44:25.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.291+0000 7f903b7fe640 1 -- 172.21.15.17:0/271808280 learned_addr learned my addr 172.21.15.17:0/271808280 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:25.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.291+0000 7f9032ffd640 1 -- 172.21.15.17:0/271808280 >> v1:172.21.15.142:6789/0 conn(0x7f903c0d29d0 legacy=0x7f903c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:25.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.291+0000 7f9032ffd640 1 -- 172.21.15.17:0/271808280 >> v1:172.21.15.17:6789/0 conn(0x7f903c15ce90 legacy=0x7f903c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:25.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.291+0000 7f9032ffd640 1 -- 172.21.15.17:0/271808280 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0ce2d0 con 0x7f903c1616e0 2023-08-09T12:44:25.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.293+0000 7f9032ffd640 1 --2- 172.21.15.17:0/271808280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c0b6000 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f90240097a0 tx=0x7f902402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60028de18f591269 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:25.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.293+0000 7f903affd640 1 -- 172.21.15.17:0/271808280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024030610 con 0x7f903c1616e0 2023-08-09T12:44:25.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.293+0000 7f903affd640 1 -- 172.21.15.17:0/271808280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9024030770 con 0x7f903c1616e0 2023-08-09T12:44:25.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.293+0000 7f903affd640 1 -- 172.21.15.17:0/271808280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024030b00 con 0x7f903c1616e0 2023-08-09T12:44:25.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.293+0000 7f904202d640 1 -- 172.21.15.17:0/271808280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 msgr2=0x7f903c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:25.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.293+0000 7f904202d640 1 --2- 172.21.15.17:0/271808280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c0b6000 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f90240097a0 tx=0x7f902402b960 comp rx=0 tx=0).stop 2023-08-09T12:44:25.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.294+0000 7f904202d640 1 -- 172.21.15.17:0/271808280 shutdown_connections 2023-08-09T12:44:25.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.294+0000 7f904202d640 1 --2- 172.21.15.17:0/271808280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c0b6000 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:25.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.294+0000 7f904202d640 1 -- 172.21.15.17:0/271808280 >> 172.21.15.17:0/271808280 conn(0x7f903c06fde0 msgr2=0x7f903c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:25.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.294+0000 7f904202d640 1 -- 172.21.15.17:0/271808280 shutdown_connections 2023-08-09T12:44:25.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.294+0000 7f904202d640 1 -- 172.21.15.17:0/271808280 wait complete. 2023-08-09T12:44:25.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.295+0000 7f904202d640 1 Processor -- start 2023-08-09T12:44:25.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.296+0000 7f904202d640 1 -- start start 2023-08-09T12:44:25.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f904202d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f903c0d29d0 0x7f903c15dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:25.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f904202d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903c15ce90 0x7f903c0aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:25.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f904202d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:25.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f904202d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c15e800 con 0x7f903c1616e0 2023-08-09T12:44:25.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f904202d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0c9cf0 con 0x7f903c0d29d0 2023-08-09T12:44:25.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f904202d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0c9fd0 con 0x7f903c15ce90 2023-08-09T12:44:25.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:25.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c15f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53998/0 (socket says 172.21.15.17:53998) 2023-08-09T12:44:25.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903bfff640 1 -- 172.21.15.17:0/1016763000 learned_addr learned my addr 172.21.15.17:0/1016763000 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:25.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f9032ffd640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903c15ce90 0x7f903c0aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903bfff640 1 -- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903c15ce90 msgr2=0x7f903c0aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903b7fe640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f903c0d29d0 0x7f903c15dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903bfff640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903c15ce90 0x7f903c0aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903bfff640 1 -- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f903c0d29d0 msgr2=0x7f903c15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903bfff640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f903c0d29d0 0x7f903c15dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.297+0000 7f903bfff640 1 -- 172.21.15.17:0/1016763000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024009400 con 0x7f903c1616e0 2023-08-09T12:44:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.298+0000 7f9032ffd640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903c15ce90 0x7f903c0aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:25.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.298+0000 7f903bfff640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c15f2c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f903400c390 tx=0x7f903400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:25.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.298+0000 7f9038ff9640 1 -- 172.21.15.17:0/1016763000 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340052d0 con 0x7f903c1616e0 2023-08-09T12:44:25.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.298+0000 7f9038ff9640 1 -- 172.21.15.17:0/1016763000 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9034005430 con 0x7f903c1616e0 2023-08-09T12:44:25.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.298+0000 7f9038ff9640 1 -- 172.21.15.17:0/1016763000 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034003810 con 0x7f903c1616e0 2023-08-09T12:44:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.298+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c0ca2b0 con 0x7f903c1616e0 2023-08-09T12:44:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.298+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c15e4f0 con 0x7f903c1616e0 2023-08-09T12:44:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.299+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0ca7d0 con 0x7f903c1616e0 2023-08-09T12:44:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.301+0000 7f9038ff9640 1 -- 172.21.15.17:0/1016763000 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9034003970 con 0x7f903c1616e0 2023-08-09T12:44:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.301+0000 7f9038ff9640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f901c06a050 0x7f901c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.302+0000 7f9038ff9640 1 -- 172.21.15.17:0/1016763000 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f9034087a70 con 0x7f903c1616e0 2023-08-09T12:44:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.302+0000 7f903b7fe640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f901c06a050 0x7f901c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.303+0000 7f903b7fe640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f901c06a050 0x7f901c06c510 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f902c005c00 tx=0x7f902c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.306+0000 7f9038ff9640 1 -- 172.21.15.17:0/1016763000 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f90340531b0 con 0x7f903c1616e0 2023-08-09T12:44:25.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:25.541+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f903c067a80 con 0x7f903c1616e0 2023-08-09T12:44:26.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.106+0000 7f9038ff9640 1 -- 172.21.15.17:0/1016763000 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7f90340567d0 con 0x7f903c1616e0 2023-08-09T12:44:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 11 and data pool 12 2023-08-09T12:44:26.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f901c06a050 msgr2=0x7f901c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f901c06a050 0x7f901c06c510 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f902c005c00 tx=0x7f902c009040 comp rx=0 tx=0).stop 2023-08-09T12:44:26.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 msgr2=0x7f903c15f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c15f2c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f903400c390 tx=0x7f903400c850 comp rx=0 tx=0).stop 2023-08-09T12:44:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 shutdown_connections 2023-08-09T12:44:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f901c06a050 0x7f901c06c510 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c1616e0 0x7f903c15f2c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903c15ce90 0x7f903c0aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 --2- 172.21.15.17:0/1016763000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f903c0d29d0 0x7f903c15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.119+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 >> 172.21.15.17:0/1016763000 conn(0x7f903c06fde0 msgr2=0x7f903c0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.120+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 shutdown_connections 2023-08-09T12:44:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.120+0000 7f904202d640 1 -- 172.21.15.17:0/1016763000 wait complete. 2023-08-09T12:44:26.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:26.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.336+0000 7f45ad947640 1 Processor -- start 2023-08-09T12:44:26.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.336+0000 7f45ad947640 1 -- start start 2023-08-09T12:44:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.338+0000 7f45ad947640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f45a8070a90 0x7f45a80b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.338+0000 7f45ad947640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a80b4630 con 0x7f45a80ad810 2023-08-09T12:44:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.338+0000 7f45ad947640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a80b3ab0 con 0x7f45a8159d80 2023-08-09T12:44:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.338+0000 7f45ad947640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a815a160 con 0x7f45a8070a90 2023-08-09T12:44:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.338+0000 7f45a67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f45a8070a90 0x7f45a80b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.338+0000 7f45a77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f45a80ad810 0x7f45a80c8fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34810/0 (socket says 172.21.15.17:34810) 2023-08-09T12:44:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.338+0000 7f45a77fe640 1 -- 172.21.15.17:0/4231955438 learned_addr learned my addr 172.21.15.17:0/4231955438 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.339+0000 7f45a67fc640 1 -- 172.21.15.17:0/4231955438 >> v1:172.21.15.142:6789/0 conn(0x7f45a8159d80 legacy=0x7f45a8070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.339+0000 7f45a67fc640 1 -- 172.21.15.17:0/4231955438 >> v1:172.21.15.17:6789/0 conn(0x7f45a80ad810 legacy=0x7f45a80c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.339+0000 7f45a67fc640 1 -- 172.21.15.17:0/4231955438 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80b3d90 con 0x7f45a8070a90 2023-08-09T12:44:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.339+0000 7f45a5ffb640 1 -- 172.21.15.17:0/4231955438 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298083944 0 0) 0x7f45a80b4630 con 0x7f45a80ad810 2023-08-09T12:44:26.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.340+0000 7f45a67fc640 1 --2- 172.21.15.17:0/4231955438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8070a90 0x7f45a80b34d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f459c009790 tx=0x7f459c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284d3819aa07f082 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:26.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.340+0000 7f45a5ffb640 1 -- 172.21.15.17:0/4231955438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c030800 con 0x7f45a8070a90 2023-08-09T12:44:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.340+0000 7f45a5ffb640 1 -- 172.21.15.17:0/4231955438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c030960 con 0x7f45a8070a90 2023-08-09T12:44:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.340+0000 7f45a5ffb640 1 -- 172.21.15.17:0/4231955438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c030cf0 con 0x7f45a8070a90 2023-08-09T12:44:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.341+0000 7f45ad947640 1 -- 172.21.15.17:0/4231955438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8070a90 msgr2=0x7f45a80b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.341+0000 7f45ad947640 1 --2- 172.21.15.17:0/4231955438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8070a90 0x7f45a80b34d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f459c009790 tx=0x7f459c02b940 comp rx=0 tx=0).stop 2023-08-09T12:44:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.341+0000 7f45ad947640 1 -- 172.21.15.17:0/4231955438 shutdown_connections 2023-08-09T12:44:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.341+0000 7f45ad947640 1 --2- 172.21.15.17:0/4231955438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8070a90 0x7f45a80b34d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.341+0000 7f45ad947640 1 -- 172.21.15.17:0/4231955438 >> 172.21.15.17:0/4231955438 conn(0x7f45a80cb1b0 msgr2=0x7f45a80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:26.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.341+0000 7f45ad947640 1 -- 172.21.15.17:0/4231955438 shutdown_connections 2023-08-09T12:44:26.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.341+0000 7f45ad947640 1 -- 172.21.15.17:0/4231955438 wait complete. 2023-08-09T12:44:26.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.343+0000 7f45ad947640 1 Processor -- start 2023-08-09T12:44:26.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.343+0000 7f45ad947640 1 -- start start 2023-08-09T12:44:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45ad947640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8070a90 0x7f45a80c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45ad947640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a80ad810 0x7f45a815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45ad947640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8159d80 0x7f45a80af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45ad947640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a815b170 con 0x7f45a8159d80 2023-08-09T12:44:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45ad947640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a815a2a0 con 0x7f45a80ad810 2023-08-09T12:44:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45ad947640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a815a4f0 con 0x7f45a8070a90 2023-08-09T12:44:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8159d80 0x7f45a80af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8159d80 0x7f45a80af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54010/0 (socket says 172.21.15.17:54010) 2023-08-09T12:44:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.344+0000 7f45a77fe640 1 -- 172.21.15.17:0/2052512707 learned_addr learned my addr 172.21.15.17:0/2052512707 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a77fe640 1 -- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8070a90 msgr2=0x7f45a80c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a67fc640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a80ad810 0x7f45a815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a6ffd640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8070a90 0x7f45a80c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a77fe640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8070a90 0x7f45a80c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a77fe640 1 -- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a80ad810 msgr2=0x7f45a815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a77fe640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a80ad810 0x7f45a815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a77fe640 1 -- 172.21.15.17:0/2052512707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0093a0 con 0x7f45a8159d80 2023-08-09T12:44:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a67fc640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a80ad810 0x7f45a815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.345+0000 7f45a77fe640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8159d80 0x7f45a80af1b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f45a000c7a0 tx=0x7f45a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.346+0000 7f458ffff640 1 -- 172.21.15.17:0/2052512707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000a640 con 0x7f45a8159d80 2023-08-09T12:44:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.346+0000 7f458ffff640 1 -- 172.21.15.17:0/2052512707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a000a7a0 con 0x7f45a8159d80 2023-08-09T12:44:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.346+0000 7f458ffff640 1 -- 172.21.15.17:0/2052512707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000abd0 con 0x7f45a8159d80 2023-08-09T12:44:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.346+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a815a7d0 con 0x7f45a8159d80 2023-08-09T12:44:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.346+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a80b0eb0 con 0x7f45a8159d80 2023-08-09T12:44:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.347+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a815b2b0 con 0x7f45a8159d80 2023-08-09T12:44:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.348+0000 7f458ffff640 1 -- 172.21.15.17:0/2052512707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45a000ad30 con 0x7f45a8159d80 2023-08-09T12:44:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.349+0000 7f458ffff640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f459406a050 0x7f459406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.349+0000 7f458ffff640 1 -- 172.21.15.17:0/2052512707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45a0087bf0 con 0x7f45a8159d80 2023-08-09T12:44:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.350+0000 7f45a6ffd640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f459406a050 0x7f459406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.351+0000 7f45a6ffd640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f459406a050 0x7f459406c510 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4598000f60 tx=0x7f4598009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:26.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.353+0000 7f458ffff640 1 -- 172.21.15.17:0/2052512707 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f45a815b2b0 con 0x7f45a8159d80 2023-08-09T12:44:26.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.548+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45a815b2b0 con 0x7f45a8159d80 2023-08-09T12:44:26.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.551+0000 7f458ffff640 1 -- 172.21.15.17:0/2052512707 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+18343 (secure 0 0 0) 0x7f45a815b2b0 con 0x7f45a8159d80 2023-08-09T12:44:26.555 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:26.555 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":91,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:25.542790+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:44:23.740360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-09T12:44:24.571392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f459406a050 msgr2=0x7f459406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f459406a050 0x7f459406c510 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4598000f60 tx=0x7f4598009040 comp rx=0 tx=0).stop 2023-08-09T12:44:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8159d80 msgr2=0x7f45a80af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8159d80 0x7f45a80af1b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f45a000c7a0 tx=0x7f45a000cc60 comp rx=0 tx=0).stop 2023-08-09T12:44:26.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 shutdown_connections 2023-08-09T12:44:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f459406a050 0x7f459406c510 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a8159d80 0x7f45a80af1b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a80ad810 0x7f45a815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 --2- 172.21.15.17:0/2052512707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8070a90 0x7f45a80c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 >> 172.21.15.17:0/2052512707 conn(0x7f45a80cb1b0 msgr2=0x7f45a80cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 shutdown_connections 2023-08-09T12:44:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.554+0000 7f45ad947640 1 -- 172.21.15.17:0/2052512707 wait complete. 2023-08-09T12:44:26.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.805+0000 7f07d81b5640 1 Processor -- start 2023-08-09T12:44:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.805+0000 7f07d81b5640 1 -- start start 2023-08-09T12:44:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.807+0000 7f07d81b5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07d00d30e0 0x7f07d00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.807+0000 7f07d81b5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d00cdd10 con 0x7f07d015ce90 2023-08-09T12:44:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.807+0000 7f07d81b5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d00cdff0 con 0x7f07d01616e0 2023-08-09T12:44:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.807+0000 7f07d81b5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00b6540 con 0x7f07d00d30e0 2023-08-09T12:44:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.807+0000 7f07d5f51640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f07d015ce90 0x7f07d00cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34816/0 (socket says 172.21.15.17:34816) 2023-08-09T12:44:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.807+0000 7f07d5f51640 1 -- 172.21.15.17:0/3762050790 learned_addr learned my addr 172.21.15.17:0/3762050790 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522706126 0 0) 0x7f07d00cdd10 con 0x7f07d015ce90 2023-08-09T12:44:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07bc003520 con 0x7f07d015ce90 2023-08-09T12:44:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4072880895 0 0) 0x7f07bc003520 con 0x7f07d015ce90 2023-08-09T12:44:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 >> v2:172.21.15.142:3300/0 conn(0x7f07d00d30e0 msgr2=0x7f07d00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 --2- 172.21.15.17:0/3762050790 >> v2:172.21.15.142:3300/0 conn(0x7f07d00d30e0 0x7f07d00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 >> v1:172.21.15.142:6789/0 conn(0x7f07d01616e0 legacy=0x7f07d00d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00ce2d0 con 0x7f07d015ce90 2023-08-09T12:44:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f07cc001670 con 0x7f07d015ce90 2023-08-09T12:44:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 >> v1:172.21.15.17:6789/0 conn(0x7f07d015ce90 legacy=0x7f07d00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07bc003970 0x7f07bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07bc0047c0 0x7f07bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00b6540 con 0x7f07bc0052a0 2023-08-09T12:44:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc00c1a0 con 0x7f07bc003970 2023-08-09T12:44:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.808+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc00c360 con 0x7f07bc0047c0 2023-08-09T12:44:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d6752640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d5f51640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07bc003970 0x7f07bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d6752640 1 -- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07bc0047c0 msgr2=0x7f07bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:26.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d5750640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07bc0047c0 0x7f07bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d6752640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07bc0047c0 0x7f07bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d6752640 1 -- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07bc003970 msgr2=0x7f07bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d6752640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07bc003970 0x7f07bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d6752640 1 -- 172.21.15.17:0/3762050790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc003520 con 0x7f07bc0052a0 2023-08-09T12:44:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.809+0000 7f07d5750640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07bc0047c0 0x7f07bc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.810+0000 7f07d6752640 1 -- 172.21.15.17:0/3762050790 reap_dead start 2023-08-09T12:44:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.811+0000 7f07d6752640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07bc00b980 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009e10 tx=0x7f07bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac0b470780c765c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.811+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c802cd50 con 0x7f07bc0052a0 2023-08-09T12:44:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.811+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c8003970 con 0x7f07bc0052a0 2023-08-09T12:44:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.811+0000 7f07d4f4f640 1 -- 172.21.15.17:0/3762050790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8003d20 con 0x7f07bc0052a0 2023-08-09T12:44:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.811+0000 7f07d81b5640 1 -- 172.21.15.17:0/3762050790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 msgr2=0x7f07bc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.811+0000 7f07d81b5640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07bc00b980 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009e10 tx=0x7f07bc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.812+0000 7f07d81b5640 1 -- 172.21.15.17:0/3762050790 shutdown_connections 2023-08-09T12:44:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.812+0000 7f07d81b5640 1 --2- 172.21.15.17:0/3762050790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07bc00b980 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.812+0000 7f07d81b5640 1 -- 172.21.15.17:0/3762050790 >> 172.21.15.17:0/3762050790 conn(0x7f07d006fde0 msgr2=0x7f07d00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.812+0000 7f07d81b5640 1 -- 172.21.15.17:0/3762050790 shutdown_connections 2023-08-09T12:44:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.812+0000 7f07d81b5640 1 -- 172.21.15.17:0/3762050790 wait complete. 2023-08-09T12:44:26.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.814+0000 7f07d81b5640 1 Processor -- start 2023-08-09T12:44:26.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.815+0000 7f07d81b5640 1 -- start start 2023-08-09T12:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.816+0000 7f07d81b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07d00b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.816+0000 7f07d81b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d015d670 0x7f07d00cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.816+0000 7f07d81b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0154040 0x7f07d00c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.816+0000 7f07d81b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00cb310 con 0x7f07bc0052a0 2023-08-09T12:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.816+0000 7f07d81b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00cb5f0 con 0x7f07d015d670 2023-08-09T12:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.816+0000 7f07d81b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00cb8d0 con 0x7f07d0154040 2023-08-09T12:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.816+0000 7f07d5f51640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07d00b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5f51640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07d00b7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54034/0 (socket says 172.21.15.17:54034) 2023-08-09T12:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5f51640 1 -- 172.21.15.17:0/54145201 learned_addr learned my addr 172.21.15.17:0/54145201 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d6752640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0154040 0x7f07d00c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5750640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d015d670 0x7f07d00cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5f51640 1 -- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0154040 msgr2=0x7f07d00c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5f51640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0154040 0x7f07d00c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5f51640 1 -- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d015d670 msgr2=0x7f07d00cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5f51640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d015d670 0x7f07d00cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5f51640 1 -- 172.21.15.17:0/54145201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00cbbb0 con 0x7f07bc0052a0 2023-08-09T12:44:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.817+0000 7f07d5f51640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07d00b7ee0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00e7b0 tx=0x7f07cc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.818+0000 7f07c67fc640 1 -- 172.21.15.17:0/54145201 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00c870 con 0x7f07bc0052a0 2023-08-09T12:44:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.818+0000 7f07c67fc640 1 -- 172.21.15.17:0/54145201 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc00c9d0 con 0x7f07bc0052a0 2023-08-09T12:44:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.818+0000 7f07c67fc640 1 -- 172.21.15.17:0/54145201 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00cd80 con 0x7f07bc0052a0 2023-08-09T12:44:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.818+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d00cbe90 con 0x7f07bc0052a0 2023-08-09T12:44:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.818+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d00b8420 con 0x7f07bc0052a0 2023-08-09T12:44:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.819+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d00cc080 con 0x7f07bc0052a0 2023-08-09T12:44:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.820+0000 7f07c67fc640 1 -- 172.21.15.17:0/54145201 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f07cc01d460 con 0x7f07bc0052a0 2023-08-09T12:44:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.821+0000 7f07c67fc640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07b406a050 0x7f07b406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.821+0000 7f07c67fc640 1 -- 172.21.15.17:0/54145201 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07cc088520 con 0x7f07bc0052a0 2023-08-09T12:44:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.822+0000 7f07d5750640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07b406a050 0x7f07b406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.823+0000 7f07d5750640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07b406a050 0x7f07b406c510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f07d00b8c10 tx=0x7f07c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:26.825+0000 7f07c67fc640 1 -- 172.21.15.17:0/54145201 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f07cc053c10 con 0x7f07bc0052a0 2023-08-09T12:44:27.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.022+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07d0067a80 con 0x7f07bc0052a0 2023-08-09T12:44:27.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.025+0000 7f07c67fc640 1 -- 172.21.15.17:0/54145201 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+18343 (secure 0 0 0) 0x7f07cc057230 con 0x7f07bc0052a0 2023-08-09T12:44:27.029 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:27.029 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":91,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:25.542790+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:44:23.740360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-09T12:44:24.571392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:27.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07b406a050 msgr2=0x7f07b406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:27.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07b406a050 0x7f07b406c510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f07d00b8c10 tx=0x7f07c0009040 comp rx=0 tx=0).stop 2023-08-09T12:44:27.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 msgr2=0x7f07d00b7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:27.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07d00b7ee0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00e7b0 tx=0x7f07cc00ec70 comp rx=0 tx=0).stop 2023-08-09T12:44:27.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 shutdown_connections 2023-08-09T12:44:27.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07b406a050 0x7f07b406c510 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0154040 0x7f07d00c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d015d670 0x7f07d00cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 --2- 172.21.15.17:0/54145201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07bc0052a0 0x7f07d00b7ee0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 >> 172.21.15.17:0/54145201 conn(0x7f07d006fde0 msgr2=0x7f07d015c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:27.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 shutdown_connections 2023-08-09T12:44:27.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.028+0000 7f07d81b5640 1 -- 172.21.15.17:0/54145201 wait complete. 2023-08-09T12:44:27.053 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:44:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.270+0000 7feafb057640 1 Processor -- start 2023-08-09T12:44:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.271+0000 7feafb057640 1 -- start start 2023-08-09T12:44:27.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.272+0000 7feafb057640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feaf415cef0 0x7feaf40b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:27.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.272+0000 7feafb057640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415d2d0 0x7feaf40ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:27.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.272+0000 7feafb057640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40b2010 con 0x7feaf41616b0 2023-08-09T12:44:27.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.272+0000 7feafb057640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf40cdee0 con 0x7feaf415cef0 2023-08-09T12:44:27.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.272+0000 7feafb057640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40b1d30 con 0x7feaf415d2d0 2023-08-09T12:44:27.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.273+0000 7feaf3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415d2d0 0x7feaf40ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.273+0000 7feaf95f4640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7feaf41616b0 0x7feaf40cf3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:60342/0 (socket says 172.21.15.17:60342) 2023-08-09T12:44:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.273+0000 7feaf95f4640 1 -- 172.21.15.17:0/140736772 learned_addr learned my addr 172.21.15.17:0/140736772 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.273+0000 7feaf8df3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feaf415cef0 0x7feaf40b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.273+0000 7feaf3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415d2d0 0x7feaf40ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:46014/0 (socket says 172.21.15.17:46014) 2023-08-09T12:44:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.274+0000 7feaf8df3640 1 -- 172.21.15.17:0/140736772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415d2d0 msgr2=0x7feaf40ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.274+0000 7feaf8df3640 1 --2- 172.21.15.17:0/140736772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415d2d0 0x7feaf40ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.274+0000 7feaf8df3640 1 -- 172.21.15.17:0/140736772 >> v1:172.21.15.142:6789/0 conn(0x7feaf41616b0 legacy=0x7feaf40cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.274+0000 7feaf8df3640 1 -- 172.21.15.17:0/140736772 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40cd820 con 0x7feaf415cef0 2023-08-09T12:44:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.276+0000 7feaf8df3640 1 --2- 172.21.15.17:0/140736772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf415cef0 0x7feaf40b1750 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feae4009d90 tx=0x7feae402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daef0cbb9ca15368 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.276+0000 7feaf37fe640 1 -- 172.21.15.17:0/140736772 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae402cb30 con 0x7feaf415cef0 2023-08-09T12:44:27.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.276+0000 7feaf37fe640 1 -- 172.21.15.17:0/140736772 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae402cc90 con 0x7feaf415cef0 2023-08-09T12:44:27.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.276+0000 7feaf37fe640 1 -- 172.21.15.17:0/140736772 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4034440 con 0x7feaf415cef0 2023-08-09T12:44:27.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.277+0000 7feafb057640 1 -- 172.21.15.17:0/140736772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf415cef0 msgr2=0x7feaf40b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:27.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.277+0000 7feafb057640 1 --2- 172.21.15.17:0/140736772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf415cef0 0x7feaf40b1750 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feae4009d90 tx=0x7feae402bd80 comp rx=0 tx=0).stop 2023-08-09T12:44:27.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.277+0000 7feafb057640 1 -- 172.21.15.17:0/140736772 shutdown_connections 2023-08-09T12:44:27.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.277+0000 7feafb057640 1 --2- 172.21.15.17:0/140736772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415d2d0 0x7feaf40ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.277+0000 7feafb057640 1 --2- 172.21.15.17:0/140736772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf415cef0 0x7feaf40b1750 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.277+0000 7feafb057640 1 -- 172.21.15.17:0/140736772 >> 172.21.15.17:0/140736772 conn(0x7feaf406fde0 msgr2=0x7feaf40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:27.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.277+0000 7feafb057640 1 -- 172.21.15.17:0/140736772 shutdown_connections 2023-08-09T12:44:27.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.277+0000 7feafb057640 1 -- 172.21.15.17:0/140736772 wait complete. 2023-08-09T12:44:27.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.279+0000 7feafb057640 1 Processor -- start 2023-08-09T12:44:27.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.279+0000 7feafb057640 1 -- start start 2023-08-09T12:44:27.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.280+0000 7feafb057640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415cef0 0x7feaf40b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:27.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.280+0000 7feafb057640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf415d2d0 0x7feaf40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.280+0000 7feafb057640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf41616b0 0x7feaf40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.280+0000 7feafb057640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40b3740 con 0x7feaf415d2d0 2023-08-09T12:44:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.280+0000 7feafb057640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf415ecc0 con 0x7feaf41616b0 2023-08-09T12:44:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.280+0000 7feafb057640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40b2c10 con 0x7feaf415cef0 2023-08-09T12:44:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.280+0000 7feaf3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf415d2d0 0x7feaf40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf415d2d0 0x7feaf40cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54046/0 (socket says 172.21.15.17:54046) 2023-08-09T12:44:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf3fff640 1 -- 172.21.15.17:0/1326434298 learned_addr learned my addr 172.21.15.17:0/1326434298 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf8df3640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415cef0 0x7feaf40b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf95f4640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf41616b0 0x7feaf40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf3fff640 1 -- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415cef0 msgr2=0x7feaf40b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf3fff640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415cef0 0x7feaf40b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf3fff640 1 -- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf41616b0 msgr2=0x7feaf40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf3fff640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf41616b0 0x7feaf40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf3fff640 1 -- 172.21.15.17:0/1326434298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae4009a70 con 0x7feaf415d2d0 2023-08-09T12:44:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf8df3640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415cef0 0x7feaf40b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf95f4640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf41616b0 0x7feaf40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.281+0000 7feaf3fff640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf415d2d0 0x7feaf40cb100 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7feae800e9b0 tx=0x7feae800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.282+0000 7feaf17fa640 1 -- 172.21.15.17:0/1326434298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8009670 con 0x7feaf415d2d0 2023-08-09T12:44:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.282+0000 7feaf17fa640 1 -- 172.21.15.17:0/1326434298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800c9a0 con 0x7feaf415d2d0 2023-08-09T12:44:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.282+0000 7feaf17fa640 1 -- 172.21.15.17:0/1326434298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800cd50 con 0x7feaf415d2d0 2023-08-09T12:44:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.282+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf40b3180 con 0x7feaf415d2d0 2023-08-09T12:44:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.282+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf415e950 con 0x7feaf415d2d0 2023-08-09T12:44:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.283+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf4067a80 con 0x7feaf415d2d0 2023-08-09T12:44:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.284+0000 7feaf17fa640 1 -- 172.21.15.17:0/1326434298 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feae8013470 con 0x7feaf415d2d0 2023-08-09T12:44:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.285+0000 7feaf17fa640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feae006a050 0x7feae006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.285+0000 7feaf17fa640 1 -- 172.21.15.17:0/1326434298 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feae8088860 con 0x7feaf415d2d0 2023-08-09T12:44:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.285+0000 7feaf8df3640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feae006a050 0x7feae006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.287+0000 7feaf8df3640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feae006a050 0x7feae006c510 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feae4036000 tx=0x7feae4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.289+0000 7feaf17fa640 1 -- 172.21.15.17:0/1326434298 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feae8053eb0 con 0x7feaf415d2d0 2023-08-09T12:44:27.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:27.530+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feaf40d12a0 con 0x7feaf415d2d0 2023-08-09T12:44:28.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.114+0000 7feaf17fa640 1 -- 172.21.15.17:0/1326434298 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7feae80574d0 con 0x7feaf415d2d0 2023-08-09T12:44:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.118+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feae006a050 msgr2=0x7feae006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.118+0000 7feafb057640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feae006a050 0x7feae006c510 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feae4036000 tx=0x7feae4030000 comp rx=0 tx=0).stop 2023-08-09T12:44:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.118+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf415d2d0 msgr2=0x7feaf40cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.118+0000 7feafb057640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf415d2d0 0x7feaf40cb100 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7feae800e9b0 tx=0x7feae800ee70 comp rx=0 tx=0).stop 2023-08-09T12:44:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.119+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 shutdown_connections 2023-08-09T12:44:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.119+0000 7feafb057640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feae006a050 0x7feae006c510 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:28.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.119+0000 7feafb057640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaf41616b0 0x7feaf40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:28.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.119+0000 7feafb057640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf415d2d0 0x7feaf40cb100 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:28.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.119+0000 7feafb057640 1 --2- 172.21.15.17:0/1326434298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feaf415cef0 0x7feaf40b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:28.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.119+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 >> 172.21.15.17:0/1326434298 conn(0x7feaf406fde0 msgr2=0x7feaf40cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:28.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.119+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 shutdown_connections 2023-08-09T12:44:28.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.119+0000 7feafb057640 1 -- 172.21.15.17:0/1326434298 wait complete. 2023-08-09T12:44:28.145 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:44:28.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:44:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.377+0000 7f4258db7640 1 Processor -- start 2023-08-09T12:44:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.377+0000 7f4258db7640 1 -- start start 2023-08-09T12:44:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.378+0000 7f4258db7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42540cfab0 0x7f42540b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.378+0000 7f4258db7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42540b2010 con 0x7f425415cef0 2023-08-09T12:44:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.379+0000 7f4258db7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42540b1d30 con 0x7f425415d2d0 2023-08-09T12:44:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.379+0000 7f4258db7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42540cdee0 con 0x7f42540cfab0 2023-08-09T12:44:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.379+0000 7f4249d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42540cfab0 0x7f42540b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.379+0000 7f4252d9d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f425415d2d0 0x7f42540d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:44816/0 (socket says 172.21.15.17:44816) 2023-08-09T12:44:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.379+0000 7f4252d9d640 1 -- 172.21.15.17:0/3670283473 learned_addr learned my addr 172.21.15.17:0/3670283473 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.380+0000 7f4249d9b640 1 -- 172.21.15.17:0/3670283473 >> v1:172.21.15.142:6789/0 conn(0x7f425415d2d0 legacy=0x7f42540d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.380+0000 7f4249d9b640 1 -- 172.21.15.17:0/3670283473 >> v1:172.21.15.17:6789/0 conn(0x7f425415cef0 legacy=0x7f42540cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:28.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.380+0000 7f4249d9b640 1 -- 172.21.15.17:0/3670283473 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540cd820 con 0x7f42540cfab0 2023-08-09T12:44:28.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.380+0000 7f4251d9b640 1 -- 172.21.15.17:0/3670283473 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206641275 0 0) 0x7f42540b2010 con 0x7f425415cef0 2023-08-09T12:44:28.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.382+0000 7f4249d9b640 1 --2- 172.21.15.17:0/3670283473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42540cfab0 0x7f42540b1750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f423c009750 tx=0x7f423c02b600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ccdd36646acfebd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.382+0000 7f4251d9b640 1 -- 172.21.15.17:0/3670283473 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c030710 con 0x7f42540cfab0 2023-08-09T12:44:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.382+0000 7f4251d9b640 1 -- 172.21.15.17:0/3670283473 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c02e050 con 0x7f42540cfab0 2023-08-09T12:44:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.382+0000 7f4251d9b640 1 -- 172.21.15.17:0/3670283473 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c030a90 con 0x7f42540cfab0 2023-08-09T12:44:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.383+0000 7f4258db7640 1 -- 172.21.15.17:0/3670283473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42540cfab0 msgr2=0x7f42540b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.383+0000 7f4258db7640 1 --2- 172.21.15.17:0/3670283473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42540cfab0 0x7f42540b1750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f423c009750 tx=0x7f423c02b600 comp rx=0 tx=0).stop 2023-08-09T12:44:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.383+0000 7f4258db7640 1 -- 172.21.15.17:0/3670283473 shutdown_connections 2023-08-09T12:44:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.383+0000 7f4258db7640 1 --2- 172.21.15.17:0/3670283473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42540cfab0 0x7f42540b1750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.383+0000 7f4258db7640 1 -- 172.21.15.17:0/3670283473 >> 172.21.15.17:0/3670283473 conn(0x7f425406fde0 msgr2=0x7f42540701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.383+0000 7f4258db7640 1 -- 172.21.15.17:0/3670283473 shutdown_connections 2023-08-09T12:44:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.383+0000 7f4258db7640 1 -- 172.21.15.17:0/3670283473 wait complete. 2023-08-09T12:44:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.385+0000 7f4258db7640 1 Processor -- start 2023-08-09T12:44:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.385+0000 7f4258db7640 1 -- start start 2023-08-09T12:44:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4258db7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42540cfab0 0x7f42540c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4258db7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425415cef0 0x7f42540d1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4258db7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f425415d2d0 0x7f42540d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4258db7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540b4250 con 0x7f425415d2d0 2023-08-09T12:44:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4258db7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425415fae0 con 0x7f42540cfab0 2023-08-09T12:44:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4258db7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425415f520 con 0x7f425415cef0 2023-08-09T12:44:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4252d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f425415d2d0 0x7f42540d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4252d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f425415d2d0 0x7f42540d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49840/0 (socket says 172.21.15.17:49840) 2023-08-09T12:44:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4252d9d640 1 -- 172.21.15.17:0/2305507064 learned_addr learned my addr 172.21.15.17:0/2305507064 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f425259c640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42540cfab0 0x7f42540c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4249d9b640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425415cef0 0x7f42540d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.386+0000 7f4252d9d640 1 -- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425415cef0 msgr2=0x7f42540d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f4252d9d640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425415cef0 0x7f42540d1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f4252d9d640 1 -- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42540cfab0 msgr2=0x7f42540c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f4252d9d640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42540cfab0 0x7f42540c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f4252d9d640 1 -- 172.21.15.17:0/2305507064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009400 con 0x7f425415d2d0 2023-08-09T12:44:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f4249d9b640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425415cef0 0x7f42540d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f4252d9d640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f425415d2d0 0x7f42540d1ad0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c520 tx=0x7f424c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f424b7fe640 1 -- 172.21.15.17:0/2305507064 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c0074e0 con 0x7f425415d2d0 2023-08-09T12:44:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f424b7fe640 1 -- 172.21.15.17:0/2305507064 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c007640 con 0x7f425415d2d0 2023-08-09T12:44:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f424b7fe640 1 -- 172.21.15.17:0/2305507064 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c0049e0 con 0x7f425415d2d0 2023-08-09T12:44:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425415f800 con 0x7f425415d2d0 2023-08-09T12:44:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.387+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425415f160 con 0x7f425415d2d0 2023-08-09T12:44:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.389+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42540663a0 con 0x7f425415d2d0 2023-08-09T12:44:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.390+0000 7f424b7fe640 1 -- 172.21.15.17:0/2305507064 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f424c004b40 con 0x7f425415d2d0 2023-08-09T12:44:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.390+0000 7f424b7fe640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f423406a050 0x7f423406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.391+0000 7f424b7fe640 1 -- 172.21.15.17:0/2305507064 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f424c087860 con 0x7f425415d2d0 2023-08-09T12:44:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.391+0000 7f425259c640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f423406a050 0x7f423406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:28.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.392+0000 7f425259c640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f423406a050 0x7f423406c510 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f42440014a0 tx=0x7f4244009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.395+0000 7f424b7fe640 1 -- 172.21.15.17:0/2305507064 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f424c056960 con 0x7f425415d2d0 2023-08-09T12:44:28.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:28.625+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f42540b3d40 con 0x7f425415d2d0 2023-08-09T12:44:29.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.117+0000 7f424b7fe640 1 -- 172.21.15.17:0/2305507064 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f42540b3d40 con 0x7f425415d2d0 2023-08-09T12:44:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.120+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f423406a050 msgr2=0x7f423406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.120+0000 7f4258db7640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f423406a050 0x7f423406c510 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f42440014a0 tx=0x7f4244009040 comp rx=0 tx=0).stop 2023-08-09T12:44:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.120+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f425415d2d0 msgr2=0x7f42540d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.120+0000 7f4258db7640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f425415d2d0 0x7f42540d1ad0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c520 tx=0x7f424c00c9e0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.120+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 shutdown_connections 2023-08-09T12:44:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.120+0000 7f4258db7640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f423406a050 0x7f423406c510 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.120+0000 7f4258db7640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f425415d2d0 0x7f42540d1ad0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.120+0000 7f4258db7640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f425415cef0 0x7f42540d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.121+0000 7f4258db7640 1 --2- 172.21.15.17:0/2305507064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42540cfab0 0x7f42540c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.121+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 >> 172.21.15.17:0/2305507064 conn(0x7f425406fde0 msgr2=0x7f42540c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.121+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 shutdown_connections 2023-08-09T12:44:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.121+0000 7f4258db7640 1 -- 172.21.15.17:0/2305507064 wait complete. 2023-08-09T12:44:29.150 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:44:29.150 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:44:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.382+0000 7f037248e640 1 Processor -- start 2023-08-09T12:44:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.382+0000 7f037248e640 1 -- start start 2023-08-09T12:44:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.384+0000 7f037248e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.384+0000 7f037248e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f036c0ad810 0x7f036c070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.384+0000 7f037248e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c070d20 con 0x7f036c0708c0 2023-08-09T12:44:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.384+0000 7f037248e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c15a160 con 0x7f036c0ad810 2023-08-09T12:44:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.384+0000 7f037248e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0b4630 con 0x7f036c159d80 2023-08-09T12:44:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.385+0000 7f0370a2b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f036c0708c0 0x7f036c06eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:44824/0 (socket says 172.21.15.17:44824) 2023-08-09T12:44:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.385+0000 7f0370a2b640 1 -- 172.21.15.17:0/2802063928 learned_addr learned my addr 172.21.15.17:0/2802063928 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.385+0000 7f036bfff640 1 --2- 172.21.15.17:0/2802063928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.385+0000 7f036b7fe640 1 --2- 172.21.15.17:0/2802063928 >> v2:172.21.15.142:3300/0 conn(0x7f036c0ad810 0x7f036c070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.386+0000 7f036bfff640 1 -- 172.21.15.17:0/2802063928 >> v2:172.21.15.142:3300/0 conn(0x7f036c0ad810 msgr2=0x7f036c070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:29.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.386+0000 7f036bfff640 1 --2- 172.21.15.17:0/2802063928 >> v2:172.21.15.142:3300/0 conn(0x7f036c0ad810 0x7f036c070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.386+0000 7f036bfff640 1 -- 172.21.15.17:0/2802063928 >> v1:172.21.15.142:6789/0 conn(0x7f036c0708c0 legacy=0x7f036c06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.386+0000 7f036bfff640 1 -- 172.21.15.17:0/2802063928 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0b3ab0 con 0x7f036c159d80 2023-08-09T12:44:29.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.386+0000 7f036affd640 1 -- 172.21.15.17:0/2802063928 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097299083 0 0) 0x7f036c070d20 con 0x7f036c0708c0 2023-08-09T12:44:29.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.388+0000 7f036bfff640 1 --2- 172.21.15.17:0/2802063928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0b34d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f035c0097a0 tx=0x7f035c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3040cbad1af51bcd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f036affd640 1 -- 172.21.15.17:0/2802063928 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c02d040 con 0x7f036c159d80 2023-08-09T12:44:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f036affd640 1 -- 172.21.15.17:0/2802063928 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c031810 con 0x7f036c159d80 2023-08-09T12:44:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f036affd640 1 -- 172.21.15.17:0/2802063928 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c031ba0 con 0x7f036c159d80 2023-08-09T12:44:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f037248e640 1 -- 172.21.15.17:0/2802063928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 msgr2=0x7f036c0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f037248e640 1 --2- 172.21.15.17:0/2802063928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0b34d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f035c0097a0 tx=0x7f035c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f037248e640 1 -- 172.21.15.17:0/2802063928 shutdown_connections 2023-08-09T12:44:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f037248e640 1 --2- 172.21.15.17:0/2802063928 >> v2:172.21.15.142:3300/0 conn(0x7f036c0ad810 0x7f036c070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f037248e640 1 --2- 172.21.15.17:0/2802063928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0b34d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f037248e640 1 -- 172.21.15.17:0/2802063928 >> 172.21.15.17:0/2802063928 conn(0x7f036c0cb1b0 msgr2=0x7f036c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:29.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f037248e640 1 -- 172.21.15.17:0/2802063928 shutdown_connections 2023-08-09T12:44:29.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.389+0000 7f037248e640 1 -- 172.21.15.17:0/2802063928 wait complete. 2023-08-09T12:44:29.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.392+0000 7f037248e640 1 Processor -- start 2023-08-09T12:44:29.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.392+0000 7f037248e640 1 -- start start 2023-08-09T12:44:29.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.393+0000 7f037248e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f036c0708c0 0x7f036c0697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.393+0000 7f037248e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f036c0ad810 0x7f036c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.393+0000 7f037248e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.393+0000 7f037248e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c150de0 con 0x7f036c0708c0 2023-08-09T12:44:29.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.393+0000 7f037248e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0b09d0 con 0x7f036c0ad810 2023-08-09T12:44:29.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.393+0000 7f037248e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0b0c70 con 0x7f036c159d80 2023-08-09T12:44:29.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f036c0708c0 0x7f036c0697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f036c0708c0 0x7f036c0697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49842/0 (socket says 172.21.15.17:49842) 2023-08-09T12:44:29.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036bfff640 1 -- 172.21.15.17:0/241402580 learned_addr learned my addr 172.21.15.17:0/241402580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f0370a2b640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036b7fe640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f036c0ad810 0x7f036c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036bfff640 1 -- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 msgr2=0x7f036c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036bfff640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036bfff640 1 -- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f036c0ad810 msgr2=0x7f036c14fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036bfff640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f036c0ad810 0x7f036c14fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036bfff640 1 -- 172.21.15.17:0/241402580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c009400 con 0x7f036c0708c0 2023-08-09T12:44:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f036b7fe640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f036c0ad810 0x7f036c14fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.394+0000 7f0370a2b640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.395+0000 7f036bfff640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f036c0708c0 0x7f036c0697c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f035c0098c0 tx=0x7f035c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.395+0000 7f0368ff9640 1 -- 172.21.15.17:0/241402580 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c006e10 con 0x7f036c0708c0 2023-08-09T12:44:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.395+0000 7f0368ff9640 1 -- 172.21.15.17:0/241402580 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c03ad60 con 0x7f036c0708c0 2023-08-09T12:44:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.395+0000 7f0368ff9640 1 -- 172.21.15.17:0/241402580 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c044610 con 0x7f036c0708c0 2023-08-09T12:44:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.395+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c0b0f50 con 0x7f036c0708c0 2023-08-09T12:44:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.395+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c069e50 con 0x7f036c0708c0 2023-08-09T12:44:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.396+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036c067a80 con 0x7f036c0708c0 2023-08-09T12:44:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.397+0000 7f0368ff9640 1 -- 172.21.15.17:0/241402580 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f035c04d450 con 0x7f036c0708c0 2023-08-09T12:44:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.398+0000 7f0368ff9640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f035806a050 0x7f035806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.398+0000 7f0368ff9640 1 -- 172.21.15.17:0/241402580 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f035c0aa850 con 0x7f036c0708c0 2023-08-09T12:44:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.399+0000 7f036b7fe640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f035806a050 0x7f035806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.400+0000 7f036b7fe640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f035806a050 0x7f035806c510 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f036c0b1840 tx=0x7f0360008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:29.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.403+0000 7f0368ff9640 1 -- 172.21.15.17:0/241402580 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f035c075f30 con 0x7f036c0708c0 2023-08-09T12:44:29.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.624+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f036c0b1870 con 0x7f036c0708c0 2023-08-09T12:44:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.625+0000 7f0368ff9640 1 -- 172.21.15.17:0/241402580 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f035c079550 con 0x7f036c0708c0 2023-08-09T12:44:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:29.629 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2093028023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2093028023},{"type":"v1","addr":"172.21.15.142:6835","nonce":2093028023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2762526663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2762526663},{"type":"v1","addr":"172.21.15.142:6837","nonce":2762526663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2544978987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2544978987},{"type":"v1","addr":"172.21.15.17:6834","nonce":2544978987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:44:25.543433+0000","modified":"2023-08-09T12:44:29.110856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4077789912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4077789912},{"type":"v1","addr":"172.21.15.17:6835","nonce":4077789912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-09T12:44:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 43 2023-08-09T12:44:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f035806a050 msgr2=0x7f035806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f035806a050 0x7f035806c510 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f036c0b1840 tx=0x7f0360008040 comp rx=0 tx=0).stop 2023-08-09T12:44:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f036c0708c0 msgr2=0x7f036c0697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f036c0708c0 0x7f036c0697c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f035c0098c0 tx=0x7f035c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 shutdown_connections 2023-08-09T12:44:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f035806a050 0x7f035806c510 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f036c159d80 0x7f036c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f036c0ad810 0x7f036c14fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 --2- 172.21.15.17:0/241402580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f036c0708c0 0x7f036c0697c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.627+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 >> 172.21.15.17:0/241402580 conn(0x7f036c0cb1b0 msgr2=0x7f036c157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.628+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 shutdown_connections 2023-08-09T12:44:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.628+0000 7f037248e640 1 -- 172.21.15.17:0/241402580 wait complete. 2023-08-09T12:44:29.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:44:29.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.861+0000 7fcf8a5e8640 1 Processor -- start 2023-08-09T12:44:29.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.861+0000 7fcf8a5e8640 1 -- start start 2023-08-09T12:44:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf8a5e8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf84159d80 0x7fcf840b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf8a5e8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf840ad810 0x7fcf84070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf8a5e8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf840b4630 con 0x7fcf840708c0 2023-08-09T12:44:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf8a5e8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf84070d50 con 0x7fcf84159d80 2023-08-09T12:44:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf8a5e8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8415a160 con 0x7fcf840ad810 2023-08-09T12:44:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf83fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf84159d80 0x7fcf840b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf83fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf84159d80 0x7fcf840b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49852/0 (socket says 172.21.15.17:49852) 2023-08-09T12:44:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf83fff640 1 -- 172.21.15.17:0/4043185018 learned_addr learned my addr 172.21.15.17:0/4043185018 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf83fff640 1 -- 172.21.15.17:0/4043185018 >> v2:172.21.15.142:3300/0 conn(0x7fcf840ad810 msgr2=0x7fcf84070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.863+0000 7fcf83fff640 1 --2- 172.21.15.17:0/4043185018 >> v2:172.21.15.142:3300/0 conn(0x7fcf840ad810 0x7fcf84070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.864+0000 7fcf83fff640 1 -- 172.21.15.17:0/4043185018 >> v1:172.21.15.142:6789/0 conn(0x7fcf840708c0 legacy=0x7fcf8406eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.864+0000 7fcf83fff640 1 -- 172.21.15.17:0/4043185018 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840b3ab0 con 0x7fcf84159d80 2023-08-09T12:44:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.865+0000 7fcf83fff640 1 --2- 172.21.15.17:0/4043185018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84159d80 0x7fcf840b34d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fcf840b1270 tx=0x7fcf7402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f130c99faf53683 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.865+0000 7fcf837fe640 1 -- 172.21.15.17:0/4043185018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7402ea80 con 0x7fcf84159d80 2023-08-09T12:44:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.865+0000 7fcf837fe640 1 -- 172.21.15.17:0/4043185018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7402ebe0 con 0x7fcf84159d80 2023-08-09T12:44:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.865+0000 7fcf837fe640 1 -- 172.21.15.17:0/4043185018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74009600 con 0x7fcf84159d80 2023-08-09T12:44:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.866+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/4043185018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84159d80 msgr2=0x7fcf840b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.866+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/4043185018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84159d80 0x7fcf840b34d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fcf840b1270 tx=0x7fcf7402e0e0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.866+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/4043185018 shutdown_connections 2023-08-09T12:44:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.866+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/4043185018 >> v2:172.21.15.142:3300/0 conn(0x7fcf840ad810 0x7fcf84070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.866+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/4043185018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84159d80 0x7fcf840b34d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.866+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/4043185018 >> 172.21.15.17:0/4043185018 conn(0x7fcf840cb1b0 msgr2=0x7fcf840cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.866+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/4043185018 shutdown_connections 2023-08-09T12:44:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.866+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/4043185018 wait complete. 2023-08-09T12:44:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.868+0000 7fcf8a5e8640 1 Processor -- start 2023-08-09T12:44:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.868+0000 7fcf8a5e8640 1 -- start start 2023-08-09T12:44:29.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf8a5e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf840708c0 0x7fcf840b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf8a5e8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf840ad810 0x7fcf840c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf8a5e8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf84159d80 0x7fcf84069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf8a5e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84149cc0 con 0x7fcf840708c0 2023-08-09T12:44:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf8a5e8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c2300 con 0x7fcf840ad810 2023-08-09T12:44:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf8a5e8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c25a0 con 0x7fcf84159d80 2023-08-09T12:44:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf840708c0 0x7fcf840b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf840708c0 0x7fcf840b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49854/0 (socket says 172.21.15.17:49854) 2023-08-09T12:44:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf83fff640 1 -- 172.21.15.17:0/1510231455 learned_addr learned my addr 172.21.15.17:0/1510231455 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.869+0000 7fcf83fff640 1 -- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf84159d80 msgr2=0x7fcf84069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf83fff640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf84159d80 0x7fcf84069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf83fff640 1 -- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf840ad810 msgr2=0x7fcf840c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf83fff640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf840ad810 0x7fcf840c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf83fff640 1 -- 172.21.15.17:0/1510231455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7400bd40 con 0x7fcf840708c0 2023-08-09T12:44:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf83fff640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf840708c0 0x7fcf840b0c50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fcf74038040 tx=0x7fcf74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf817fa640 1 -- 172.21.15.17:0/1510231455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7402ea80 con 0x7fcf840708c0 2023-08-09T12:44:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf817fa640 1 -- 172.21.15.17:0/1510231455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74036820 con 0x7fcf840708c0 2023-08-09T12:44:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf817fa640 1 -- 172.21.15.17:0/1510231455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74036bd0 con 0x7fcf840708c0 2023-08-09T12:44:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf840c2880 con 0x7fcf840708c0 2023-08-09T12:44:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.870+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf840c2e40 con 0x7fcf840708c0 2023-08-09T12:44:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.871+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf840c3030 con 0x7fcf840708c0 2023-08-09T12:44:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.873+0000 7fcf817fa640 1 -- 172.21.15.17:0/1510231455 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf7402ed50 con 0x7fcf840708c0 2023-08-09T12:44:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.873+0000 7fcf817fa640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf6406a050 0x7fcf6406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.874+0000 7fcf817fa640 1 -- 172.21.15.17:0/1510231455 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf740ab6f0 con 0x7fcf840708c0 2023-08-09T12:44:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.874+0000 7fcf7b7fe640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf6406a050 0x7fcf6406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:29.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.875+0000 7fcf7b7fe640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf6406a050 0x7fcf6406c510 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcf840b0740 tx=0x7fcf6c006be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:29.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:29.878+0000 7fcf817fa640 1 -- 172.21.15.17:0/1510231455 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcf74076df0 con 0x7fcf840708c0 2023-08-09T12:44:30.010 INFO:tasks.ceph.mds.a.smithi017.stderr:2023-08-09T12:44:30.006+0000 7f961695e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:44:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.073+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf840c3030 con 0x7fcf840708c0 2023-08-09T12:44:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.077+0000 7fcf817fa640 1 -- 172.21.15.17:0/1510231455 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+18330 (secure 0 0 0) 0x7fcf7400b720 con 0x7fcf840708c0 2023-08-09T12:44:30.081 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:30.081 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":92,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:27.072768+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:44:23.740360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-09T12:44:24.571392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:44:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.079+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf6406a050 msgr2=0x7fcf6406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.079+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf6406a050 0x7fcf6406c510 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcf840b0740 tx=0x7fcf6c006be0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.079+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf840708c0 msgr2=0x7fcf840b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.079+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf840708c0 0x7fcf840b0c50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fcf74038040 tx=0x7fcf74004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.080+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 shutdown_connections 2023-08-09T12:44:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.080+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf6406a050 0x7fcf6406c510 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.080+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf84159d80 0x7fcf84069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.080+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf840ad810 0x7fcf840c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.080+0000 7fcf8a5e8640 1 --2- 172.21.15.17:0/1510231455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf840708c0 0x7fcf840b0c50 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.080+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 >> 172.21.15.17:0/1510231455 conn(0x7fcf840cb1b0 msgr2=0x7fcf840cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.080+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 shutdown_connections 2023-08-09T12:44:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.080+0000 7fcf8a5e8640 1 -- 172.21.15.17:0/1510231455 wait complete. 2023-08-09T12:44:30.103 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:44:30.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:44:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.326+0000 7f9944c91640 1 Processor -- start 2023-08-09T12:44:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.326+0000 7f9944c91640 1 -- start start 2023-08-09T12:44:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.328+0000 7f9944c91640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99400cfb50 0x7f9940167a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.328+0000 7f9944c91640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400b5a30 con 0x7f9940160030 2023-08-09T12:44:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.328+0000 7f9944c91640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400d0d70 con 0x7f99400b86e0 2023-08-09T12:44:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.328+0000 7f9944c91640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99400d1110 con 0x7f99400cfb50 2023-08-09T12:44:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.328+0000 7f993ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99400cfb50 0x7f9940167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.328+0000 7f993f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9940160030 0x7f9940160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57120/0 (socket says 172.21.15.17:57120) 2023-08-09T12:44:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.328+0000 7f993ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99400cfb50 0x7f9940167a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49870/0 (socket says 172.21.15.17:49870) 2023-08-09T12:44:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.328+0000 7f993f7fe640 1 -- 172.21.15.17:0/659808706 learned_addr learned my addr 172.21.15.17:0/659808706 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.329+0000 7f993ffff640 1 -- 172.21.15.17:0/659808706 >> v1:172.21.15.142:6789/0 conn(0x7f99400b86e0 legacy=0x7f99400cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.329+0000 7f993ffff640 1 -- 172.21.15.17:0/659808706 >> v1:172.21.15.17:6789/0 conn(0x7f9940160030 legacy=0x7f9940160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.329+0000 7f993ffff640 1 -- 172.21.15.17:0/659808706 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940160f70 con 0x7f99400cfb50 2023-08-09T12:44:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.329+0000 7f993e7fc640 1 -- 172.21.15.17:0/659808706 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453958418 0 0) 0x7f99400b5a30 con 0x7f9940160030 2023-08-09T12:44:30.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.330+0000 7f993ffff640 1 --2- 172.21.15.17:0/659808706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99400cfb50 0x7f9940167a90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f9938009d90 tx=0x7f993802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25baef199063d3df server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:30.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.330+0000 7f993e7fc640 1 -- 172.21.15.17:0/659808706 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993802ccf0 con 0x7f99400cfb50 2023-08-09T12:44:30.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.330+0000 7f993e7fc640 1 -- 172.21.15.17:0/659808706 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993802ce50 con 0x7f99400cfb50 2023-08-09T12:44:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.330+0000 7f993e7fc640 1 -- 172.21.15.17:0/659808706 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938034660 con 0x7f99400cfb50 2023-08-09T12:44:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.331+0000 7f9944c91640 1 -- 172.21.15.17:0/659808706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99400cfb50 msgr2=0x7f9940167a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.331+0000 7f9944c91640 1 --2- 172.21.15.17:0/659808706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99400cfb50 0x7f9940167a90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f9938009d90 tx=0x7f993802bf40 comp rx=0 tx=0).stop 2023-08-09T12:44:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.331+0000 7f9944c91640 1 -- 172.21.15.17:0/659808706 shutdown_connections 2023-08-09T12:44:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.331+0000 7f9944c91640 1 --2- 172.21.15.17:0/659808706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99400cfb50 0x7f9940167a90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.331+0000 7f9944c91640 1 -- 172.21.15.17:0/659808706 >> 172.21.15.17:0/659808706 conn(0x7f99400697c0 msgr2=0x7f9940069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.331+0000 7f9944c91640 1 -- 172.21.15.17:0/659808706 shutdown_connections 2023-08-09T12:44:30.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.331+0000 7f9944c91640 1 -- 172.21.15.17:0/659808706 wait complete. 2023-08-09T12:44:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.333+0000 7f9944c91640 1 Processor -- start 2023-08-09T12:44:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.333+0000 7f9944c91640 1 -- start start 2023-08-09T12:44:30.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.334+0000 7f9944c91640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99400b86e0 0x7f9940151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.334+0000 7f9944c91640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99400cfb50 0x7f99400a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.334+0000 7f9944c91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9940160030 0x7f99400a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.334+0000 7f9944c91640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400b3500 con 0x7f9940160030 2023-08-09T12:44:30.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.334+0000 7f9944c91640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9940151dc0 con 0x7f99400b86e0 2023-08-09T12:44:30.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.334+0000 7f9944c91640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99400cc4b0 con 0x7f99400cfb50 2023-08-09T12:44:30.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9940160030 0x7f99400a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9940160030 0x7f99400a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49872/0 (socket says 172.21.15.17:49872) 2023-08-09T12:44:30.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 -- 172.21.15.17:0/752877759 learned_addr learned my addr 172.21.15.17:0/752877759 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:30.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993f7fe640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99400b86e0 0x7f9940151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 -- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99400cfb50 msgr2=0x7f99400a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993effd640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99400cfb50 0x7f99400a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99400cfb50 0x7f99400a93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 -- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99400b86e0 msgr2=0x7f9940151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99400b86e0 0x7f9940151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 -- 172.21.15.17:0/752877759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938009a70 con 0x7f9940160030 2023-08-09T12:44:30.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.335+0000 7f993ffff640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9940160030 0x7f99400a9900 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f993802dfd0 tx=0x7f9938004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:30.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.336+0000 7f9927fff640 1 -- 172.21.15.17:0/752877759 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938003b90 con 0x7f9940160030 2023-08-09T12:44:30.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.336+0000 7f9927fff640 1 -- 172.21.15.17:0/752877759 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9938003d10 con 0x7f9940160030 2023-08-09T12:44:30.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.336+0000 7f9927fff640 1 -- 172.21.15.17:0/752877759 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938004270 con 0x7f9940160030 2023-08-09T12:44:30.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.336+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99400b2eb0 con 0x7f9940160030 2023-08-09T12:44:30.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.336+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99400cc790 con 0x7f9940160030 2023-08-09T12:44:30.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.337+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994004e390 con 0x7f9940160030 2023-08-09T12:44:30.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.338+0000 7f9927fff640 1 -- 172.21.15.17:0/752877759 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f993803b050 con 0x7f9940160030 2023-08-09T12:44:30.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.339+0000 7f9927fff640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f992c06a080 0x7f992c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.340+0000 7f9927fff640 1 -- 172.21.15.17:0/752877759 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99380aab80 con 0x7f9940160030 2023-08-09T12:44:30.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.340+0000 7f993f7fe640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f992c06a080 0x7f992c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.342+0000 7f993f7fe640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f992c06a080 0x7f992c06c540 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9930000f60 tx=0x7f9930009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:30.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.345+0000 7f9927fff640 1 -- 172.21.15.17:0/752877759 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9938076260 con 0x7f9940160030 2023-08-09T12:44:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.536+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9940161530 con 0x7f992c06a080 2023-08-09T12:44:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.560+0000 7f9927fff640 1 -- 172.21.15.17:0/752877759 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302739 (secure 0 0 0) 0x7f9930001cf0 con 0x7f992c06a080 2023-08-09T12:44:30.565 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:30.569 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:44:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f992c06a080 msgr2=0x7f992c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f992c06a080 0x7f992c06c540 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9930000f60 tx=0x7f9930009040 comp rx=0 tx=0).stop 2023-08-09T12:44:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9940160030 msgr2=0x7f99400a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9940160030 0x7f99400a9900 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f993802dfd0 tx=0x7f9938004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 shutdown_connections 2023-08-09T12:44:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f992c06a080 0x7f992c06c540 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9940160030 0x7f99400a9900 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99400cfb50 0x7f99400a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 --2- 172.21.15.17:0/752877759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99400b86e0 0x7f9940151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 >> 172.21.15.17:0/752877759 conn(0x7f99400697c0 msgr2=0x7f99400c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 shutdown_connections 2023-08-09T12:44:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.567+0000 7f9944c91640 1 -- 172.21.15.17:0/752877759 wait complete. 2023-08-09T12:44:30.592 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2023-08-09T12:44:28.751423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5175,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557324,"statfs":{"total":1600000000,"available":1594700039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.723272"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080897+0000","last_change":"2023-08-09T12:44:26.102425+0000","last_active":"2023-08-09T12:44:27.080897+0000","last_peered":"2023-08-09T12:44:27.080897+0000","last_clean":"2023-08-09T12:44:27.080897+0000","last_became_active":"2023-08-09T12:44:26.102036+0000","last_became_peered":"2023-08-09T12:44:26.102036+0000","last_unstale":"2023-08-09T12:44:27.080897+0000","last_undegraded":"2023-08-09T12:44:27.080897+0000","last_fullsized":"2023-08-09T12:44:27.080897+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:12.171355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.117797+0000","last_change":"2023-08-09T12:44:26.117672+0000","last_active":"2023-08-09T12:44:26.117797+0000","last_peered":"2023-08-09T12:44:26.117797+0000","last_clean":"2023-08-09T12:44:26.117797+0000","last_became_active":"2023-08-09T12:44:26.117438+0000","last_became_peered":"2023-08-09T12:44:26.117438+0000","last_unstale":"2023-08-09T12:44:26.117797+0000","last_undegraded":"2023-08-09T12:44:26.117797+0000","last_fullsized":"2023-08-09T12:44:26.117797+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:16:15.368770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.110626+0000","last_change":"2023-08-09T12:44:26.110132+0000","last_active":"2023-08-09T12:44:26.110626+0000","last_peered":"2023-08-09T12:44:26.110626+0000","last_clean":"2023-08-09T12:44:26.110626+0000","last_became_active":"2023-08-09T12:44:26.109541+0000","last_became_peered":"2023-08-09T12:44:26.109541+0000","last_unstale":"2023-08-09T12:44:26.110626+0000","last_undegraded":"2023-08-09T12:44:26.110626+0000","last_fullsized":"2023-08-09T12:44:26.110626+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:23.402270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085949+0000","last_change":"2023-08-09T12:44:26.109724+0000","last_active":"2023-08-09T12:44:27.085949+0000","last_peered":"2023-08-09T12:44:27.085949+0000","last_clean":"2023-08-09T12:44:27.085949+0000","last_became_active":"2023-08-09T12:44:26.108750+0000","last_became_peered":"2023-08-09T12:44:26.108750+0000","last_unstale":"2023-08-09T12:44:27.085949+0000","last_undegraded":"2023-08-09T12:44:27.085949+0000","last_fullsized":"2023-08-09T12:44:27.085949+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:12.088155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083961+0000","last_change":"2023-08-09T12:44:26.107851+0000","last_active":"2023-08-09T12:44:27.083961+0000","last_peered":"2023-08-09T12:44:27.083961+0000","last_clean":"2023-08-09T12:44:27.083961+0000","last_became_active":"2023-08-09T12:44:26.107412+0000","last_became_peered":"2023-08-09T12:44:26.107412+0000","last_unstale":"2023-08-09T12:44:27.083961+0000","last_undegraded":"2023-08-09T12:44:27.083961+0000","last_fullsized":"2023-08-09T12:44:27.083961+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:15:14.676259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083346+0000","last_change":"2023-08-09T12:44:26.109068+0000","last_active":"2023-08-09T12:44:27.083346+0000","last_peered":"2023-08-09T12:44:27.083346+0000","last_clean":"2023-08-09T12:44:27.083346+0000","last_became_active":"2023-08-09T12:44:26.108779+0000","last_became_peered":"2023-08-09T12:44:26.108779+0000","last_unstale":"2023-08-09T12:44:27.083346+0000","last_undegraded":"2023-08-09T12:44:27.083346+0000","last_fullsized":"2023-08-09T12:44:27.083346+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:01:34.451855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085572+0000","last_change":"2023-08-09T12:44:26.096432+0000","last_active":"2023-08-09T12:44:27.085572+0000","last_peered":"2023-08-09T12:44:27.085572+0000","last_clean":"2023-08-09T12:44:27.085572+0000","last_became_active":"2023-08-09T12:44:26.095692+0000","last_became_peered":"2023-08-09T12:44:26.095692+0000","last_unstale":"2023-08-09T12:44:27.085572+0000","last_undegraded":"2023-08-09T12:44:27.085572+0000","last_fullsized":"2023-08-09T12:44:27.085572+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:09:14.076904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085006+0000","last_change":"2023-08-09T12:44:26.108868+0000","last_active":"2023-08-09T12:44:27.085006+0000","last_peered":"2023-08-09T12:44:27.085006+0000","last_clean":"2023-08-09T12:44:27.085006+0000","last_became_active":"2023-08-09T12:44:26.108345+0000","last_became_peered":"2023-08-09T12:44:26.108345+0000","last_unstale":"2023-08-09T12:44:27.085006+0000","last_undegraded":"2023-08-09T12:44:27.085006+0000","last_fullsized":"2023-08-09T12:44:27.085006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:37:50.104196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083417+0000","last_change":"2023-08-09T12:44:26.113100+0000","last_active":"2023-08-09T12:44:27.083417+0000","last_peered":"2023-08-09T12:44:27.083417+0000","last_clean":"2023-08-09T12:44:27.083417+0000","last_became_active":"2023-08-09T12:44:26.110802+0000","last_became_peered":"2023-08-09T12:44:26.110802+0000","last_unstale":"2023-08-09T12:44:27.083417+0000","last_undegraded":"2023-08-09T12:44:27.083417+0000","last_fullsized":"2023-08-09T12:44:27.083417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:37:39.579820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.088028+0000","last_change":"2023-08-09T12:44:26.105327+0000","last_active":"2023-08-09T12:44:27.088028+0000","last_peered":"2023-08-09T12:44:27.088028+0000","last_clean":"2023-08-09T12:44:27.088028+0000","last_became_active":"2023-08-09T12:44:26.105064+0000","last_became_peered":"2023-08-09T12:44:26.105064+0000","last_unstale":"2023-08-09T12:44:27.088028+0000","last_undegraded":"2023-08-09T12:44:27.088028+0000","last_fullsized":"2023-08-09T12:44:27.088028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:23:07.272660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.117778+0000","last_change":"2023-08-09T12:44:26.117473+0000","last_active":"2023-08-09T12:44:26.117778+0000","last_peered":"2023-08-09T12:44:26.117778+0000","last_clean":"2023-08-09T12:44:26.117778+0000","last_became_active":"2023-08-09T12:44:26.117182+0000","last_became_peered":"2023-08-09T12:44:26.117182+0000","last_unstale":"2023-08-09T12:44:26.117778+0000","last_undegraded":"2023-08-09T12:44:26.117778+0000","last_fullsized":"2023-08-09T12:44:26.117778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:58.750914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087096+0000","last_change":"2023-08-09T12:44:26.111107+0000","last_active":"2023-08-09T12:44:27.087096+0000","last_peered":"2023-08-09T12:44:27.087096+0000","last_clean":"2023-08-09T12:44:27.087096+0000","last_became_active":"2023-08-09T12:44:26.110062+0000","last_became_peered":"2023-08-09T12:44:26.110062+0000","last_unstale":"2023-08-09T12:44:27.087096+0000","last_undegraded":"2023-08-09T12:44:27.087096+0000","last_fullsized":"2023-08-09T12:44:27.087096+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:50.347843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085197+0000","last_change":"2023-08-09T12:44:26.115177+0000","last_active":"2023-08-09T12:44:27.085197+0000","last_peered":"2023-08-09T12:44:27.085197+0000","last_clean":"2023-08-09T12:44:27.085197+0000","last_became_active":"2023-08-09T12:44:26.114500+0000","last_became_peered":"2023-08-09T12:44:26.114500+0000","last_unstale":"2023-08-09T12:44:27.085197+0000","last_undegraded":"2023-08-09T12:44:27.085197+0000","last_fullsized":"2023-08-09T12:44:27.085197+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:51:06.591122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084159+0000","last_change":"2023-08-09T12:44:26.106043+0000","last_active":"2023-08-09T12:44:27.084159+0000","last_peered":"2023-08-09T12:44:27.084159+0000","last_clean":"2023-08-09T12:44:27.084159+0000","last_became_active":"2023-08-09T12:44:26.105612+0000","last_became_peered":"2023-08-09T12:44:26.105612+0000","last_unstale":"2023-08-09T12:44:27.084159+0000","last_undegraded":"2023-08-09T12:44:27.084159+0000","last_fullsized":"2023-08-09T12:44:27.084159+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:15.448723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.106167+0000","last_change":"2023-08-09T12:44:26.105549+0000","last_active":"2023-08-09T12:44:26.106167+0000","last_peered":"2023-08-09T12:44:26.106167+0000","last_clean":"2023-08-09T12:44:26.106167+0000","last_became_active":"2023-08-09T12:44:26.103252+0000","last_became_peered":"2023-08-09T12:44:26.103252+0000","last_unstale":"2023-08-09T12:44:26.106167+0000","last_undegraded":"2023-08-09T12:44:26.106167+0000","last_fullsized":"2023-08-09T12:44:26.106167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:02.311424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079452+0000","last_change":"2023-08-09T12:44:26.107884+0000","last_active":"2023-08-09T12:44:27.079452+0000","last_peered":"2023-08-09T12:44:27.079452+0000","last_clean":"2023-08-09T12:44:27.079452+0000","last_became_active":"2023-08-09T12:44:26.107339+0000","last_became_peered":"2023-08-09T12:44:26.107339+0000","last_unstale":"2023-08-09T12:44:27.079452+0000","last_undegraded":"2023-08-09T12:44:27.079452+0000","last_fullsized":"2023-08-09T12:44:27.079452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:20:11.176195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085284+0000","last_change":"2023-08-09T12:44:26.106896+0000","last_active":"2023-08-09T12:44:27.085284+0000","last_peered":"2023-08-09T12:44:27.085284+0000","last_clean":"2023-08-09T12:44:27.085284+0000","last_became_active":"2023-08-09T12:44:26.106521+0000","last_became_peered":"2023-08-09T12:44:26.106521+0000","last_unstale":"2023-08-09T12:44:27.085284+0000","last_undegraded":"2023-08-09T12:44:27.085284+0000","last_fullsized":"2023-08-09T12:44:27.085284+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:07:44.447078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.108915+0000","last_change":"2023-08-09T12:44:26.102778+0000","last_active":"2023-08-09T12:44:26.108915+0000","last_peered":"2023-08-09T12:44:26.108915+0000","last_clean":"2023-08-09T12:44:26.108915+0000","last_became_active":"2023-08-09T12:44:26.102378+0000","last_became_peered":"2023-08-09T12:44:26.102378+0000","last_unstale":"2023-08-09T12:44:26.108915+0000","last_undegraded":"2023-08-09T12:44:26.108915+0000","last_fullsized":"2023-08-09T12:44:26.108915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:41:04.506330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084377+0000","last_change":"2023-08-09T12:44:26.093984+0000","last_active":"2023-08-09T12:44:27.084377+0000","last_peered":"2023-08-09T12:44:27.084377+0000","last_clean":"2023-08-09T12:44:27.084377+0000","last_became_active":"2023-08-09T12:44:26.092648+0000","last_became_peered":"2023-08-09T12:44:26.092648+0000","last_unstale":"2023-08-09T12:44:27.084377+0000","last_undegraded":"2023-08-09T12:44:27.084377+0000","last_fullsized":"2023-08-09T12:44:27.084377+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:58.750914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084309+0000","last_change":"2023-08-09T12:44:26.102515+0000","last_active":"2023-08-09T12:44:27.084309+0000","last_peered":"2023-08-09T12:44:27.084309+0000","last_clean":"2023-08-09T12:44:27.084309+0000","last_became_active":"2023-08-09T12:44:26.102265+0000","last_became_peered":"2023-08-09T12:44:26.102265+0000","last_unstale":"2023-08-09T12:44:27.084309+0000","last_undegraded":"2023-08-09T12:44:27.084309+0000","last_fullsized":"2023-08-09T12:44:27.084309+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:35.530763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084375+0000","last_change":"2023-08-09T12:44:26.112594+0000","last_active":"2023-08-09T12:44:27.084375+0000","last_peered":"2023-08-09T12:44:27.084375+0000","last_clean":"2023-08-09T12:44:27.084375+0000","last_became_active":"2023-08-09T12:44:26.112345+0000","last_became_peered":"2023-08-09T12:44:26.112345+0000","last_unstale":"2023-08-09T12:44:27.084375+0000","last_undegraded":"2023-08-09T12:44:27.084375+0000","last_fullsized":"2023-08-09T12:44:27.084375+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:37:02.087473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084589+0000","last_change":"2023-08-09T12:44:26.099482+0000","last_active":"2023-08-09T12:44:27.084589+0000","last_peered":"2023-08-09T12:44:27.084589+0000","last_clean":"2023-08-09T12:44:27.084589+0000","last_became_active":"2023-08-09T12:44:26.098832+0000","last_became_peered":"2023-08-09T12:44:26.098832+0000","last_unstale":"2023-08-09T12:44:27.084589+0000","last_undegraded":"2023-08-09T12:44:27.084589+0000","last_fullsized":"2023-08-09T12:44:27.084589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:15.184033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083490+0000","last_change":"2023-08-09T12:44:26.102926+0000","last_active":"2023-08-09T12:44:27.083490+0000","last_peered":"2023-08-09T12:44:27.083490+0000","last_clean":"2023-08-09T12:44:27.083490+0000","last_became_active":"2023-08-09T12:44:26.102639+0000","last_became_peered":"2023-08-09T12:44:26.102639+0000","last_unstale":"2023-08-09T12:44:27.083490+0000","last_undegraded":"2023-08-09T12:44:27.083490+0000","last_fullsized":"2023-08-09T12:44:27.083490+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:05:13.616951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.107776+0000","last_change":"2023-08-09T12:44:26.107461+0000","last_active":"2023-08-09T12:44:26.107776+0000","last_peered":"2023-08-09T12:44:26.107776+0000","last_clean":"2023-08-09T12:44:26.107776+0000","last_became_active":"2023-08-09T12:44:26.106898+0000","last_became_peered":"2023-08-09T12:44:26.106898+0000","last_unstale":"2023-08-09T12:44:26.107776+0000","last_undegraded":"2023-08-09T12:44:26.107776+0000","last_fullsized":"2023-08-09T12:44:26.107776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:44:50.255962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.106184+0000","last_change":"2023-08-09T12:44:26.106095+0000","last_active":"2023-08-09T12:44:26.106184+0000","last_peered":"2023-08-09T12:44:26.106184+0000","last_clean":"2023-08-09T12:44:26.106184+0000","last_became_active":"2023-08-09T12:44:26.105852+0000","last_became_peered":"2023-08-09T12:44:26.105852+0000","last_unstale":"2023-08-09T12:44:26.106184+0000","last_undegraded":"2023-08-09T12:44:26.106184+0000","last_fullsized":"2023-08-09T12:44:26.106184+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:57:20.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086124+0000","last_change":"2023-08-09T12:44:26.105054+0000","last_active":"2023-08-09T12:44:27.086124+0000","last_peered":"2023-08-09T12:44:27.086124+0000","last_clean":"2023-08-09T12:44:27.086124+0000","last_became_active":"2023-08-09T12:44:26.104647+0000","last_became_peered":"2023-08-09T12:44:26.104647+0000","last_unstale":"2023-08-09T12:44:27.086124+0000","last_undegraded":"2023-08-09T12:44:27.086124+0000","last_fullsized":"2023-08-09T12:44:27.086124+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:40:32.854458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079446+0000","last_change":"2023-08-09T12:44:26.105385+0000","last_active":"2023-08-09T12:44:27.079446+0000","last_peered":"2023-08-09T12:44:27.079446+0000","last_clean":"2023-08-09T12:44:27.079446+0000","last_became_active":"2023-08-09T12:44:26.104435+0000","last_became_peered":"2023-08-09T12:44:26.104435+0000","last_unstale":"2023-08-09T12:44:27.079446+0000","last_undegraded":"2023-08-09T12:44:27.079446+0000","last_fullsized":"2023-08-09T12:44:27.079446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:26:59.816334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085354+0000","last_change":"2023-08-09T12:44:26.115377+0000","last_active":"2023-08-09T12:44:27.085354+0000","last_peered":"2023-08-09T12:44:27.085354+0000","last_clean":"2023-08-09T12:44:27.085354+0000","last_became_active":"2023-08-09T12:44:26.114821+0000","last_became_peered":"2023-08-09T12:44:26.114821+0000","last_unstale":"2023-08-09T12:44:27.085354+0000","last_undegraded":"2023-08-09T12:44:27.085354+0000","last_fullsized":"2023-08-09T12:44:27.085354+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:11:42.286393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.107795+0000","last_change":"2023-08-09T12:44:26.107629+0000","last_active":"2023-08-09T12:44:26.107795+0000","last_peered":"2023-08-09T12:44:26.107795+0000","last_clean":"2023-08-09T12:44:26.107795+0000","last_became_active":"2023-08-09T12:44:26.107229+0000","last_became_peered":"2023-08-09T12:44:26.107229+0000","last_unstale":"2023-08-09T12:44:26.107795+0000","last_undegraded":"2023-08-09T12:44:26.107795+0000","last_fullsized":"2023-08-09T12:44:26.107795+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:32.200904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079444+0000","last_change":"2023-08-09T12:44:26.110209+0000","last_active":"2023-08-09T12:44:27.079444+0000","last_peered":"2023-08-09T12:44:27.079444+0000","last_clean":"2023-08-09T12:44:27.079444+0000","last_became_active":"2023-08-09T12:44:26.109155+0000","last_became_peered":"2023-08-09T12:44:26.109155+0000","last_unstale":"2023-08-09T12:44:27.079444+0000","last_undegraded":"2023-08-09T12:44:27.079444+0000","last_fullsized":"2023-08-09T12:44:27.079444+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:43:34.728478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.097970+0000","last_change":"2023-08-09T12:44:26.097522+0000","last_active":"2023-08-09T12:44:26.097970+0000","last_peered":"2023-08-09T12:44:26.097970+0000","last_clean":"2023-08-09T12:44:26.097970+0000","last_became_active":"2023-08-09T12:44:26.097011+0000","last_became_peered":"2023-08-09T12:44:26.097011+0000","last_unstale":"2023-08-09T12:44:26.097970+0000","last_undegraded":"2023-08-09T12:44:26.097970+0000","last_fullsized":"2023-08-09T12:44:26.097970+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:59.391922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079778+0000","last_change":"2023-08-09T12:44:26.105583+0000","last_active":"2023-08-09T12:44:27.079778+0000","last_peered":"2023-08-09T12:44:27.079778+0000","last_clean":"2023-08-09T12:44:27.079778+0000","last_became_active":"2023-08-09T12:44:26.104993+0000","last_became_peered":"2023-08-09T12:44:26.104993+0000","last_unstale":"2023-08-09T12:44:27.079778+0000","last_undegraded":"2023-08-09T12:44:27.079778+0000","last_fullsized":"2023-08-09T12:44:27.079778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:24.465572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.111234+0000","last_change":"2023-08-09T12:44:26.104279+0000","last_active":"2023-08-09T12:44:26.111234+0000","last_peered":"2023-08-09T12:44:26.111234+0000","last_clean":"2023-08-09T12:44:26.111234+0000","last_became_active":"2023-08-09T12:44:26.103806+0000","last_became_peered":"2023-08-09T12:44:26.103806+0000","last_unstale":"2023-08-09T12:44:26.111234+0000","last_undegraded":"2023-08-09T12:44:26.111234+0000","last_fullsized":"2023-08-09T12:44:26.111234+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:32:39.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"91'4","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085615+0000","last_change":"2023-08-09T12:44:25.058192+0000","last_active":"2023-08-09T12:44:27.085615+0000","last_peered":"2023-08-09T12:44:27.085615+0000","last_clean":"2023-08-09T12:44:27.085615+0000","last_became_active":"2023-08-09T12:44:25.057183+0000","last_became_peered":"2023-08-09T12:44:25.057183+0000","last_unstale":"2023-08-09T12:44:27.085615+0000","last_undegraded":"2023-08-09T12:44:27.085615+0000","last_fullsized":"2023-08-09T12:44:27.085615+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:35.196422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.103648+0000","last_change":"2023-08-09T12:44:26.103443+0000","last_active":"2023-08-09T12:44:26.103648+0000","last_peered":"2023-08-09T12:44:26.103648+0000","last_clean":"2023-08-09T12:44:26.103648+0000","last_became_active":"2023-08-09T12:44:26.103090+0000","last_became_peered":"2023-08-09T12:44:26.103090+0000","last_unstale":"2023-08-09T12:44:26.103648+0000","last_undegraded":"2023-08-09T12:44:26.103648+0000","last_fullsized":"2023-08-09T12:44:26.103648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:23.402270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.078993+0000","last_change":"2023-08-09T12:44:25.063728+0000","last_active":"2023-08-09T12:44:27.078993+0000","last_peered":"2023-08-09T12:44:27.078993+0000","last_clean":"2023-08-09T12:44:27.078993+0000","last_became_active":"2023-08-09T12:44:25.063011+0000","last_became_peered":"2023-08-09T12:44:25.063011+0000","last_unstale":"2023-08-09T12:44:27.078993+0000","last_undegraded":"2023-08-09T12:44:27.078993+0000","last_fullsized":"2023-08-09T12:44:27.078993+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:01:16.030882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083886+0000","last_change":"2023-08-09T12:44:26.108807+0000","last_active":"2023-08-09T12:44:27.083886+0000","last_peered":"2023-08-09T12:44:27.083886+0000","last_clean":"2023-08-09T12:44:27.083886+0000","last_became_active":"2023-08-09T12:44:26.108329+0000","last_became_peered":"2023-08-09T12:44:26.108329+0000","last_unstale":"2023-08-09T12:44:27.083886+0000","last_undegraded":"2023-08-09T12:44:27.083886+0000","last_fullsized":"2023-08-09T12:44:27.083886+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:43:16.301169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080041+0000","last_change":"2023-08-09T12:44:25.061566+0000","last_active":"2023-08-09T12:44:27.080041+0000","last_peered":"2023-08-09T12:44:27.080041+0000","last_clean":"2023-08-09T12:44:27.080041+0000","last_became_active":"2023-08-09T12:44:25.061235+0000","last_became_peered":"2023-08-09T12:44:25.061235+0000","last_unstale":"2023-08-09T12:44:27.080041+0000","last_undegraded":"2023-08-09T12:44:27.080041+0000","last_fullsized":"2023-08-09T12:44:27.080041+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:54:52.898460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083707+0000","last_change":"2023-08-09T12:44:26.106358+0000","last_active":"2023-08-09T12:44:27.083707+0000","last_peered":"2023-08-09T12:44:27.083707+0000","last_clean":"2023-08-09T12:44:27.083707+0000","last_became_active":"2023-08-09T12:44:26.105013+0000","last_became_peered":"2023-08-09T12:44:26.105013+0000","last_unstale":"2023-08-09T12:44:27.083707+0000","last_undegraded":"2023-08-09T12:44:27.083707+0000","last_fullsized":"2023-08-09T12:44:27.083707+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:46.473919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087349+0000","last_change":"2023-08-09T12:44:25.060055+0000","last_active":"2023-08-09T12:44:27.087349+0000","last_peered":"2023-08-09T12:44:27.087349+0000","last_clean":"2023-08-09T12:44:27.087349+0000","last_became_active":"2023-08-09T12:44:25.059550+0000","last_became_peered":"2023-08-09T12:44:25.059550+0000","last_unstale":"2023-08-09T12:44:27.087349+0000","last_undegraded":"2023-08-09T12:44:27.087349+0000","last_fullsized":"2023-08-09T12:44:27.087349+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:36:26.062627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.112223+0000","last_change":"2023-08-09T12:44:26.112145+0000","last_active":"2023-08-09T12:44:26.112223+0000","last_peered":"2023-08-09T12:44:26.112223+0000","last_clean":"2023-08-09T12:44:26.112223+0000","last_became_active":"2023-08-09T12:44:26.111896+0000","last_became_peered":"2023-08-09T12:44:26.111896+0000","last_unstale":"2023-08-09T12:44:26.112223+0000","last_undegraded":"2023-08-09T12:44:26.112223+0000","last_fullsized":"2023-08-09T12:44:26.112223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:15.448723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084660+0000","last_change":"2023-08-09T12:44:25.059555+0000","last_active":"2023-08-09T12:44:27.084660+0000","last_peered":"2023-08-09T12:44:27.084660+0000","last_clean":"2023-08-09T12:44:27.084660+0000","last_became_active":"2023-08-09T12:44:25.059309+0000","last_became_peered":"2023-08-09T12:44:25.059309+0000","last_unstale":"2023-08-09T12:44:27.084660+0000","last_undegraded":"2023-08-09T12:44:27.084660+0000","last_fullsized":"2023-08-09T12:44:27.084660+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:02:16.737561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.117758+0000","last_change":"2023-08-09T12:44:26.117452+0000","last_active":"2023-08-09T12:44:26.117758+0000","last_peered":"2023-08-09T12:44:26.117758+0000","last_clean":"2023-08-09T12:44:26.117758+0000","last_became_active":"2023-08-09T12:44:26.117147+0000","last_became_peered":"2023-08-09T12:44:26.117147+0000","last_unstale":"2023-08-09T12:44:26.117758+0000","last_undegraded":"2023-08-09T12:44:26.117758+0000","last_fullsized":"2023-08-09T12:44:26.117758+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:06.432408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086023+0000","last_change":"2023-08-09T12:44:25.057373+0000","last_active":"2023-08-09T12:44:27.086023+0000","last_peered":"2023-08-09T12:44:27.086023+0000","last_clean":"2023-08-09T12:44:27.086023+0000","last_became_active":"2023-08-09T12:44:25.057111+0000","last_became_peered":"2023-08-09T12:44:25.057111+0000","last_unstale":"2023-08-09T12:44:27.086023+0000","last_undegraded":"2023-08-09T12:44:27.086023+0000","last_fullsized":"2023-08-09T12:44:27.086023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:25.163624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084332+0000","last_change":"2023-08-09T12:44:26.112844+0000","last_active":"2023-08-09T12:44:27.084332+0000","last_peered":"2023-08-09T12:44:27.084332+0000","last_clean":"2023-08-09T12:44:27.084332+0000","last_became_active":"2023-08-09T12:44:26.110501+0000","last_became_peered":"2023-08-09T12:44:26.110501+0000","last_unstale":"2023-08-09T12:44:27.084332+0000","last_undegraded":"2023-08-09T12:44:27.084332+0000","last_fullsized":"2023-08-09T12:44:27.084332+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:46:57.054421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.099219+0000","last_change":"2023-08-09T12:44:25.063688+0000","last_active":"2023-08-09T12:44:26.099219+0000","last_peered":"2023-08-09T12:44:26.099219+0000","last_clean":"2023-08-09T12:44:26.099219+0000","last_became_active":"2023-08-09T12:44:25.063462+0000","last_became_peered":"2023-08-09T12:44:25.063462+0000","last_unstale":"2023-08-09T12:44:26.099219+0000","last_undegraded":"2023-08-09T12:44:26.099219+0000","last_fullsized":"2023-08-09T12:44:26.099219+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:08.918356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084746+0000","last_change":"2023-08-09T12:44:26.099046+0000","last_active":"2023-08-09T12:44:27.084746+0000","last_peered":"2023-08-09T12:44:27.084746+0000","last_clean":"2023-08-09T12:44:27.084746+0000","last_became_active":"2023-08-09T12:44:26.098025+0000","last_became_peered":"2023-08-09T12:44:26.098025+0000","last_unstale":"2023-08-09T12:44:27.084746+0000","last_undegraded":"2023-08-09T12:44:27.084746+0000","last_fullsized":"2023-08-09T12:44:27.084746+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:30:23.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084466+0000","last_change":"2023-08-09T12:44:25.059827+0000","last_active":"2023-08-09T12:44:27.084466+0000","last_peered":"2023-08-09T12:44:27.084466+0000","last_clean":"2023-08-09T12:44:27.084466+0000","last_became_active":"2023-08-09T12:44:25.059196+0000","last_became_peered":"2023-08-09T12:44:25.059196+0000","last_unstale":"2023-08-09T12:44:27.084466+0000","last_undegraded":"2023-08-09T12:44:27.084466+0000","last_fullsized":"2023-08-09T12:44:27.084466+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:45:45.019950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.103669+0000","last_change":"2023-08-09T12:44:26.103541+0000","last_active":"2023-08-09T12:44:26.103669+0000","last_peered":"2023-08-09T12:44:26.103669+0000","last_clean":"2023-08-09T12:44:26.103669+0000","last_became_active":"2023-08-09T12:44:26.102884+0000","last_became_peered":"2023-08-09T12:44:26.102884+0000","last_unstale":"2023-08-09T12:44:26.103669+0000","last_undegraded":"2023-08-09T12:44:26.103669+0000","last_fullsized":"2023-08-09T12:44:26.103669+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:01:34.451855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080582+0000","last_change":"2023-08-09T12:44:25.059129+0000","last_active":"2023-08-09T12:44:27.080582+0000","last_peered":"2023-08-09T12:44:27.080582+0000","last_clean":"2023-08-09T12:44:27.080582+0000","last_became_active":"2023-08-09T12:44:25.056919+0000","last_became_peered":"2023-08-09T12:44:25.056919+0000","last_unstale":"2023-08-09T12:44:27.080582+0000","last_undegraded":"2023-08-09T12:44:27.080582+0000","last_fullsized":"2023-08-09T12:44:27.080582+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:52:20.046690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087398+0000","last_change":"2023-08-09T12:44:26.111286+0000","last_active":"2023-08-09T12:44:27.087398+0000","last_peered":"2023-08-09T12:44:27.087398+0000","last_clean":"2023-08-09T12:44:27.087398+0000","last_became_active":"2023-08-09T12:44:26.110851+0000","last_became_peered":"2023-08-09T12:44:26.110851+0000","last_unstale":"2023-08-09T12:44:27.087398+0000","last_undegraded":"2023-08-09T12:44:27.087398+0000","last_fullsized":"2023-08-09T12:44:27.087398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:52:28.843708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087665+0000","last_change":"2023-08-09T12:44:25.060557+0000","last_active":"2023-08-09T12:44:27.087665+0000","last_peered":"2023-08-09T12:44:27.087665+0000","last_clean":"2023-08-09T12:44:27.087665+0000","last_became_active":"2023-08-09T12:44:25.060305+0000","last_became_peered":"2023-08-09T12:44:25.060305+0000","last_unstale":"2023-08-09T12:44:27.087665+0000","last_undegraded":"2023-08-09T12:44:27.087665+0000","last_fullsized":"2023-08-09T12:44:27.087665+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:06:10.332866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083532+0000","last_change":"2023-08-09T12:44:26.091961+0000","last_active":"2023-08-09T12:44:27.083532+0000","last_peered":"2023-08-09T12:44:27.083532+0000","last_clean":"2023-08-09T12:44:27.083532+0000","last_became_active":"2023-08-09T12:44:26.090723+0000","last_became_peered":"2023-08-09T12:44:26.090723+0000","last_unstale":"2023-08-09T12:44:27.083532+0000","last_undegraded":"2023-08-09T12:44:27.083532+0000","last_fullsized":"2023-08-09T12:44:27.083532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:23.402270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"91'3","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085772+0000","last_change":"2023-08-09T12:44:25.057716+0000","last_active":"2023-08-09T12:44:27.085772+0000","last_peered":"2023-08-09T12:44:27.085772+0000","last_clean":"2023-08-09T12:44:27.085772+0000","last_became_active":"2023-08-09T12:44:25.056565+0000","last_became_peered":"2023-08-09T12:44:25.056565+0000","last_unstale":"2023-08-09T12:44:27.085772+0000","last_undegraded":"2023-08-09T12:44:27.085772+0000","last_fullsized":"2023-08-09T12:44:27.085772+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:38:01.769643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.112255+0000","last_change":"2023-08-09T12:44:26.112089+0000","last_active":"2023-08-09T12:44:26.112255+0000","last_peered":"2023-08-09T12:44:26.112255+0000","last_clean":"2023-08-09T12:44:26.112255+0000","last_became_active":"2023-08-09T12:44:26.111460+0000","last_became_peered":"2023-08-09T12:44:26.111460+0000","last_unstale":"2023-08-09T12:44:26.112255+0000","last_undegraded":"2023-08-09T12:44:26.112255+0000","last_fullsized":"2023-08-09T12:44:26.112255+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:23:35.388519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"91'6","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085493+0000","last_change":"2023-08-09T12:44:25.056275+0000","last_active":"2023-08-09T12:44:27.085493+0000","last_peered":"2023-08-09T12:44:27.085493+0000","last_clean":"2023-08-09T12:44:27.085493+0000","last_became_active":"2023-08-09T12:44:25.055917+0000","last_became_peered":"2023-08-09T12:44:25.055917+0000","last_unstale":"2023-08-09T12:44:27.085493+0000","last_undegraded":"2023-08-09T12:44:27.085493+0000","last_fullsized":"2023-08-09T12:44:27.085493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:15:41.278405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086320+0000","last_change":"2023-08-09T12:44:26.100111+0000","last_active":"2023-08-09T12:44:27.086320+0000","last_peered":"2023-08-09T12:44:27.086320+0000","last_clean":"2023-08-09T12:44:27.086320+0000","last_became_active":"2023-08-09T12:44:26.099539+0000","last_became_peered":"2023-08-09T12:44:26.099539+0000","last_unstale":"2023-08-09T12:44:27.086320+0000","last_undegraded":"2023-08-09T12:44:27.086320+0000","last_fullsized":"2023-08-09T12:44:27.086320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:08:31.822535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.088395+0000","last_change":"2023-08-09T12:44:25.059513+0000","last_active":"2023-08-09T12:44:27.088395+0000","last_peered":"2023-08-09T12:44:27.088395+0000","last_clean":"2023-08-09T12:44:27.088395+0000","last_became_active":"2023-08-09T12:44:25.059230+0000","last_became_peered":"2023-08-09T12:44:25.059230+0000","last_unstale":"2023-08-09T12:44:27.088395+0000","last_undegraded":"2023-08-09T12:44:27.088395+0000","last_fullsized":"2023-08-09T12:44:27.088395+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:21.031949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085320+0000","last_change":"2023-08-09T12:44:26.098637+0000","last_active":"2023-08-09T12:44:27.085320+0000","last_peered":"2023-08-09T12:44:27.085320+0000","last_clean":"2023-08-09T12:44:27.085320+0000","last_became_active":"2023-08-09T12:44:26.097140+0000","last_became_peered":"2023-08-09T12:44:26.097140+0000","last_unstale":"2023-08-09T12:44:27.085320+0000","last_undegraded":"2023-08-09T12:44:27.085320+0000","last_fullsized":"2023-08-09T12:44:27.085320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:27:27.701607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.081211+0000","last_change":"2023-08-09T12:44:25.058820+0000","last_active":"2023-08-09T12:44:27.081211+0000","last_peered":"2023-08-09T12:44:27.081211+0000","last_clean":"2023-08-09T12:44:27.081211+0000","last_became_active":"2023-08-09T12:44:25.056210+0000","last_became_peered":"2023-08-09T12:44:25.056210+0000","last_unstale":"2023-08-09T12:44:27.081211+0000","last_undegraded":"2023-08-09T12:44:27.081211+0000","last_fullsized":"2023-08-09T12:44:27.081211+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:07.654395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086218+0000","last_change":"2023-08-09T12:44:26.106697+0000","last_active":"2023-08-09T12:44:27.086218+0000","last_peered":"2023-08-09T12:44:27.086218+0000","last_clean":"2023-08-09T12:44:27.086218+0000","last_became_active":"2023-08-09T12:44:26.106112+0000","last_became_peered":"2023-08-09T12:44:26.106112+0000","last_unstale":"2023-08-09T12:44:27.086218+0000","last_undegraded":"2023-08-09T12:44:27.086218+0000","last_fullsized":"2023-08-09T12:44:27.086218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:46.789365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084903+0000","last_change":"2023-08-09T12:44:25.054317+0000","last_active":"2023-08-09T12:44:27.084903+0000","last_peered":"2023-08-09T12:44:27.084903+0000","last_clean":"2023-08-09T12:44:27.084903+0000","last_became_active":"2023-08-09T12:44:25.053190+0000","last_became_peered":"2023-08-09T12:44:25.053190+0000","last_unstale":"2023-08-09T12:44:27.084903+0000","last_undegraded":"2023-08-09T12:44:27.084903+0000","last_fullsized":"2023-08-09T12:44:27.084903+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:34.927846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086832+0000","last_change":"2023-08-09T12:44:26.104941+0000","last_active":"2023-08-09T12:44:27.086832+0000","last_peered":"2023-08-09T12:44:27.086832+0000","last_clean":"2023-08-09T12:44:27.086832+0000","last_became_active":"2023-08-09T12:44:26.099960+0000","last_became_peered":"2023-08-09T12:44:26.099960+0000","last_unstale":"2023-08-09T12:44:27.086832+0000","last_undegraded":"2023-08-09T12:44:27.086832+0000","last_fullsized":"2023-08-09T12:44:27.086832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:58.836276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"91'8","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.121059+0000","last_change":"2023-08-09T12:44:25.058283+0000","last_active":"2023-08-09T12:44:26.121059+0000","last_peered":"2023-08-09T12:44:26.121059+0000","last_clean":"2023-08-09T12:44:26.121059+0000","last_became_active":"2023-08-09T12:44:25.058031+0000","last_became_peered":"2023-08-09T12:44:25.058031+0000","last_unstale":"2023-08-09T12:44:26.121059+0000","last_undegraded":"2023-08-09T12:44:26.121059+0000","last_fullsized":"2023-08-09T12:44:26.121059+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:54.357965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083959+0000","last_change":"2023-08-09T12:44:26.113280+0000","last_active":"2023-08-09T12:44:27.083959+0000","last_peered":"2023-08-09T12:44:27.083959+0000","last_clean":"2023-08-09T12:44:27.083959+0000","last_became_active":"2023-08-09T12:44:26.111178+0000","last_became_peered":"2023-08-09T12:44:26.111178+0000","last_unstale":"2023-08-09T12:44:27.083959+0000","last_undegraded":"2023-08-09T12:44:27.083959+0000","last_fullsized":"2023-08-09T12:44:27.083959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:13.871101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087960+0000","last_change":"2023-08-09T12:44:25.056092+0000","last_active":"2023-08-09T12:44:27.087960+0000","last_peered":"2023-08-09T12:44:27.087960+0000","last_clean":"2023-08-09T12:44:27.087960+0000","last_became_active":"2023-08-09T12:44:25.055690+0000","last_became_peered":"2023-08-09T12:44:25.055690+0000","last_unstale":"2023-08-09T12:44:27.087960+0000","last_undegraded":"2023-08-09T12:44:27.087960+0000","last_fullsized":"2023-08-09T12:44:27.087960+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:18:51.734975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085630+0000","last_change":"2023-08-09T12:44:26.104446+0000","last_active":"2023-08-09T12:44:27.085630+0000","last_peered":"2023-08-09T12:44:27.085630+0000","last_clean":"2023-08-09T12:44:27.085630+0000","last_became_active":"2023-08-09T12:44:26.099741+0000","last_became_peered":"2023-08-09T12:44:26.099741+0000","last_unstale":"2023-08-09T12:44:27.085630+0000","last_undegraded":"2023-08-09T12:44:27.085630+0000","last_fullsized":"2023-08-09T12:44:27.085630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:22:25.562201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.097440+0000","last_change":"2023-08-09T12:44:25.060898+0000","last_active":"2023-08-09T12:44:26.097440+0000","last_peered":"2023-08-09T12:44:26.097440+0000","last_clean":"2023-08-09T12:44:26.097440+0000","last_became_active":"2023-08-09T12:44:25.060600+0000","last_became_peered":"2023-08-09T12:44:25.060600+0000","last_unstale":"2023-08-09T12:44:26.097440+0000","last_undegraded":"2023-08-09T12:44:26.097440+0000","last_fullsized":"2023-08-09T12:44:26.097440+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:57:46.223981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084063+0000","last_change":"2023-08-09T12:44:26.105575+0000","last_active":"2023-08-09T12:44:27.084063+0000","last_peered":"2023-08-09T12:44:27.084063+0000","last_clean":"2023-08-09T12:44:27.084063+0000","last_became_active":"2023-08-09T12:44:26.103624+0000","last_became_peered":"2023-08-09T12:44:26.103624+0000","last_unstale":"2023-08-09T12:44:27.084063+0000","last_undegraded":"2023-08-09T12:44:27.084063+0000","last_fullsized":"2023-08-09T12:44:27.084063+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:53:02.341383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080331+0000","last_change":"2023-08-09T12:44:25.063535+0000","last_active":"2023-08-09T12:44:27.080331+0000","last_peered":"2023-08-09T12:44:27.080331+0000","last_clean":"2023-08-09T12:44:27.080331+0000","last_became_active":"2023-08-09T12:44:25.062661+0000","last_became_peered":"2023-08-09T12:44:25.062661+0000","last_unstale":"2023-08-09T12:44:27.080331+0000","last_undegraded":"2023-08-09T12:44:27.080331+0000","last_fullsized":"2023-08-09T12:44:27.080331+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:58.720302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.105338+0000","last_change":"2023-08-09T12:44:26.104499+0000","last_active":"2023-08-09T12:44:26.105338+0000","last_peered":"2023-08-09T12:44:26.105338+0000","last_clean":"2023-08-09T12:44:26.105338+0000","last_became_active":"2023-08-09T12:44:26.104144+0000","last_became_peered":"2023-08-09T12:44:26.104144+0000","last_unstale":"2023-08-09T12:44:26.105338+0000","last_undegraded":"2023-08-09T12:44:26.105338+0000","last_fullsized":"2023-08-09T12:44:26.105338+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:26.953923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080406+0000","last_change":"2023-08-09T12:44:25.055061+0000","last_active":"2023-08-09T12:44:27.080406+0000","last_peered":"2023-08-09T12:44:27.080406+0000","last_clean":"2023-08-09T12:44:27.080406+0000","last_became_active":"2023-08-09T12:44:25.054674+0000","last_became_peered":"2023-08-09T12:44:25.054674+0000","last_unstale":"2023-08-09T12:44:27.080406+0000","last_undegraded":"2023-08-09T12:44:27.080406+0000","last_fullsized":"2023-08-09T12:44:27.080406+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:05:45.825564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087296+0000","last_change":"2023-08-09T12:44:26.105258+0000","last_active":"2023-08-09T12:44:27.087296+0000","last_peered":"2023-08-09T12:44:27.087296+0000","last_clean":"2023-08-09T12:44:27.087296+0000","last_became_active":"2023-08-09T12:44:26.099679+0000","last_became_peered":"2023-08-09T12:44:26.099679+0000","last_unstale":"2023-08-09T12:44:27.087296+0000","last_undegraded":"2023-08-09T12:44:27.087296+0000","last_fullsized":"2023-08-09T12:44:27.087296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:52.640535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087646+0000","last_change":"2023-08-09T12:44:25.057511+0000","last_active":"2023-08-09T12:44:27.087646+0000","last_peered":"2023-08-09T12:44:27.087646+0000","last_clean":"2023-08-09T12:44:27.087646+0000","last_became_active":"2023-08-09T12:44:25.057051+0000","last_became_peered":"2023-08-09T12:44:25.057051+0000","last_unstale":"2023-08-09T12:44:27.087646+0000","last_undegraded":"2023-08-09T12:44:27.087646+0000","last_fullsized":"2023-08-09T12:44:27.087646+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:23:16.538142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084742+0000","last_change":"2023-08-09T12:44:26.096313+0000","last_active":"2023-08-09T12:44:27.084742+0000","last_peered":"2023-08-09T12:44:27.084742+0000","last_clean":"2023-08-09T12:44:27.084742+0000","last_became_active":"2023-08-09T12:44:26.095716+0000","last_became_peered":"2023-08-09T12:44:26.095716+0000","last_unstale":"2023-08-09T12:44:27.084742+0000","last_undegraded":"2023-08-09T12:44:27.084742+0000","last_fullsized":"2023-08-09T12:44:27.084742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:37:55.461198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085585+0000","last_change":"2023-08-09T12:44:25.059728+0000","last_active":"2023-08-09T12:44:27.085585+0000","last_peered":"2023-08-09T12:44:27.085585+0000","last_clean":"2023-08-09T12:44:27.085585+0000","last_became_active":"2023-08-09T12:44:25.053851+0000","last_became_peered":"2023-08-09T12:44:25.053851+0000","last_unstale":"2023-08-09T12:44:27.085585+0000","last_undegraded":"2023-08-09T12:44:27.085585+0000","last_fullsized":"2023-08-09T12:44:27.085585+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:22:56.184316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.110608+0000","last_change":"2023-08-09T12:44:26.109940+0000","last_active":"2023-08-09T12:44:26.110608+0000","last_peered":"2023-08-09T12:44:26.110608+0000","last_clean":"2023-08-09T12:44:26.110608+0000","last_became_active":"2023-08-09T12:44:26.109194+0000","last_became_peered":"2023-08-09T12:44:26.109194+0000","last_unstale":"2023-08-09T12:44:26.110608+0000","last_undegraded":"2023-08-09T12:44:26.110608+0000","last_fullsized":"2023-08-09T12:44:26.110608+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:32.200904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085935+0000","last_change":"2023-08-09T12:44:25.057591+0000","last_active":"2023-08-09T12:44:27.085935+0000","last_peered":"2023-08-09T12:44:27.085935+0000","last_clean":"2023-08-09T12:44:27.085935+0000","last_became_active":"2023-08-09T12:44:25.057153+0000","last_became_peered":"2023-08-09T12:44:25.057153+0000","last_unstale":"2023-08-09T12:44:27.085935+0000","last_undegraded":"2023-08-09T12:44:27.085935+0000","last_fullsized":"2023-08-09T12:44:27.085935+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:47:54.882280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.083446+0000","last_change":"2023-08-09T12:44:26.083250+0000","last_active":"2023-08-09T12:44:26.083446+0000","last_peered":"2023-08-09T12:44:26.083446+0000","last_clean":"2023-08-09T12:44:26.083446+0000","last_became_active":"2023-08-09T12:44:26.082575+0000","last_became_peered":"2023-08-09T12:44:26.082575+0000","last_unstale":"2023-08-09T12:44:26.083446+0000","last_undegraded":"2023-08-09T12:44:26.083446+0000","last_fullsized":"2023-08-09T12:44:26.083446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:11.726432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.078686+0000","last_change":"2023-08-09T12:44:25.055000+0000","last_active":"2023-08-09T12:44:26.078686+0000","last_peered":"2023-08-09T12:44:26.078686+0000","last_clean":"2023-08-09T12:44:26.078686+0000","last_became_active":"2023-08-09T12:44:25.053863+0000","last_became_peered":"2023-08-09T12:44:25.053863+0000","last_unstale":"2023-08-09T12:44:26.078686+0000","last_undegraded":"2023-08-09T12:44:26.078686+0000","last_fullsized":"2023-08-09T12:44:26.078686+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:03:44.169795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079801+0000","last_change":"2023-08-09T12:44:26.083582+0000","last_active":"2023-08-09T12:44:27.079801+0000","last_peered":"2023-08-09T12:44:27.079801+0000","last_clean":"2023-08-09T12:44:27.079801+0000","last_became_active":"2023-08-09T12:44:26.082940+0000","last_became_peered":"2023-08-09T12:44:26.082940+0000","last_unstale":"2023-08-09T12:44:27.079801+0000","last_undegraded":"2023-08-09T12:44:27.079801+0000","last_fullsized":"2023-08-09T12:44:27.079801+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:40:37.168951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084495+0000","last_change":"2023-08-09T12:44:25.056943+0000","last_active":"2023-08-09T12:44:27.084495+0000","last_peered":"2023-08-09T12:44:27.084495+0000","last_clean":"2023-08-09T12:44:27.084495+0000","last_became_active":"2023-08-09T12:44:25.056406+0000","last_became_peered":"2023-08-09T12:44:25.056406+0000","last_unstale":"2023-08-09T12:44:27.084495+0000","last_undegraded":"2023-08-09T12:44:27.084495+0000","last_fullsized":"2023-08-09T12:44:27.084495+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:01.306917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":307,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080568+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:44:27.080568+0000","last_peered":"2023-08-09T12:44:27.080568+0000","last_clean":"2023-08-09T12:44:27.080568+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:44:27.080568+0000","last_undegraded":"2023-08-09T12:44:27.080568+0000","last_fullsized":"2023-08-09T12:44:27.080568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:40:07.892416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086334+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:44:27.086334+0000","last_peered":"2023-08-09T12:44:27.086334+0000","last_clean":"2023-08-09T12:44:27.086334+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:44:27.086334+0000","last_undegraded":"2023-08-09T12:44:27.086334+0000","last_fullsized":"2023-08-09T12:44:27.086334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:07:49.738233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.109959+0000","last_change":"2023-08-09T12:44:26.109250+0000","last_active":"2023-08-09T12:44:26.109959+0000","last_peered":"2023-08-09T12:44:26.109959+0000","last_clean":"2023-08-09T12:44:26.109959+0000","last_became_active":"2023-08-09T12:44:26.108906+0000","last_became_peered":"2023-08-09T12:44:26.108906+0000","last_unstale":"2023-08-09T12:44:26.109959+0000","last_undegraded":"2023-08-09T12:44:26.109959+0000","last_fullsized":"2023-08-09T12:44:26.109959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:45:09.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084325+0000","last_change":"2023-08-09T12:44:25.056088+0000","last_active":"2023-08-09T12:44:27.084325+0000","last_peered":"2023-08-09T12:44:27.084325+0000","last_clean":"2023-08-09T12:44:27.084325+0000","last_became_active":"2023-08-09T12:44:25.055674+0000","last_became_peered":"2023-08-09T12:44:25.055674+0000","last_unstale":"2023-08-09T12:44:27.084325+0000","last_undegraded":"2023-08-09T12:44:27.084325+0000","last_fullsized":"2023-08-09T12:44:27.084325+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:57:46.223981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079868+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:44:27.079868+0000","last_peered":"2023-08-09T12:44:27.079868+0000","last_clean":"2023-08-09T12:44:27.079868+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:44:27.079868+0000","last_undegraded":"2023-08-09T12:44:27.079868+0000","last_fullsized":"2023-08-09T12:44:27.079868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:07.799063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084418+0000","last_change":"2023-08-09T12:44:26.107314+0000","last_active":"2023-08-09T12:44:27.084418+0000","last_peered":"2023-08-09T12:44:27.084418+0000","last_clean":"2023-08-09T12:44:27.084418+0000","last_became_active":"2023-08-09T12:44:26.106673+0000","last_became_peered":"2023-08-09T12:44:26.106673+0000","last_unstale":"2023-08-09T12:44:27.084418+0000","last_undegraded":"2023-08-09T12:44:27.084418+0000","last_fullsized":"2023-08-09T12:44:27.084418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:15.464543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083894+0000","last_change":"2023-08-09T12:44:25.060099+0000","last_active":"2023-08-09T12:44:27.083894+0000","last_peered":"2023-08-09T12:44:27.083894+0000","last_clean":"2023-08-09T12:44:27.083894+0000","last_became_active":"2023-08-09T12:44:25.059584+0000","last_became_peered":"2023-08-09T12:44:25.059584+0000","last_unstale":"2023-08-09T12:44:27.083894+0000","last_undegraded":"2023-08-09T12:44:27.083894+0000","last_fullsized":"2023-08-09T12:44:27.083894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:44:49.251455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085875+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:44:27.085875+0000","last_peered":"2023-08-09T12:44:27.085875+0000","last_clean":"2023-08-09T12:44:27.085875+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:44:27.085875+0000","last_undegraded":"2023-08-09T12:44:27.085875+0000","last_fullsized":"2023-08-09T12:44:27.085875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:29:49.903747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.105359+0000","last_change":"2023-08-09T12:44:26.105165+0000","last_active":"2023-08-09T12:44:26.105359+0000","last_peered":"2023-08-09T12:44:26.105359+0000","last_clean":"2023-08-09T12:44:26.105359+0000","last_became_active":"2023-08-09T12:44:26.104876+0000","last_became_peered":"2023-08-09T12:44:26.104876+0000","last_unstale":"2023-08-09T12:44:26.105359+0000","last_undegraded":"2023-08-09T12:44:26.105359+0000","last_fullsized":"2023-08-09T12:44:26.105359+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:23:35.388519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083872+0000","last_change":"2023-08-09T12:44:25.056378+0000","last_active":"2023-08-09T12:44:27.083872+0000","last_peered":"2023-08-09T12:44:27.083872+0000","last_clean":"2023-08-09T12:44:27.083872+0000","last_became_active":"2023-08-09T12:44:25.054551+0000","last_became_peered":"2023-08-09T12:44:25.054551+0000","last_unstale":"2023-08-09T12:44:27.083872+0000","last_undegraded":"2023-08-09T12:44:27.083872+0000","last_fullsized":"2023-08-09T12:44:27.083872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:54.357965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.088345+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:44:27.088345+0000","last_peered":"2023-08-09T12:44:27.088345+0000","last_clean":"2023-08-09T12:44:27.088345+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:44:27.088345+0000","last_undegraded":"2023-08-09T12:44:27.088345+0000","last_fullsized":"2023-08-09T12:44:27.088345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:25:44.977514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084660+0000","last_change":"2023-08-09T12:44:26.113526+0000","last_active":"2023-08-09T12:44:27.084660+0000","last_peered":"2023-08-09T12:44:27.084660+0000","last_clean":"2023-08-09T12:44:27.084660+0000","last_became_active":"2023-08-09T12:44:26.111233+0000","last_became_peered":"2023-08-09T12:44:26.111233+0000","last_unstale":"2023-08-09T12:44:27.084660+0000","last_undegraded":"2023-08-09T12:44:27.084660+0000","last_fullsized":"2023-08-09T12:44:27.084660+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:05:44.886152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083597+0000","last_change":"2023-08-09T12:44:25.056962+0000","last_active":"2023-08-09T12:44:27.083597+0000","last_peered":"2023-08-09T12:44:27.083597+0000","last_clean":"2023-08-09T12:44:27.083597+0000","last_became_active":"2023-08-09T12:44:25.056721+0000","last_became_peered":"2023-08-09T12:44:25.056721+0000","last_unstale":"2023-08-09T12:44:27.083597+0000","last_undegraded":"2023-08-09T12:44:27.083597+0000","last_fullsized":"2023-08-09T12:44:27.083597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:29.061687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.080656+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:44:26.080656+0000","last_peered":"2023-08-09T12:44:26.080656+0000","last_clean":"2023-08-09T12:44:26.080656+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:44:26.080656+0000","last_undegraded":"2023-08-09T12:44:26.080656+0000","last_fullsized":"2023-08-09T12:44:26.080656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:27.690537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083656+0000","last_change":"2023-08-09T12:44:26.110913+0000","last_active":"2023-08-09T12:44:27.083656+0000","last_peered":"2023-08-09T12:44:27.083656+0000","last_clean":"2023-08-09T12:44:27.083656+0000","last_became_active":"2023-08-09T12:44:26.110577+0000","last_became_peered":"2023-08-09T12:44:26.110577+0000","last_unstale":"2023-08-09T12:44:27.083656+0000","last_undegraded":"2023-08-09T12:44:27.083656+0000","last_fullsized":"2023-08-09T12:44:27.083656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:32.200904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.080278+0000","last_change":"2023-08-09T12:44:25.061700+0000","last_active":"2023-08-09T12:44:26.080278+0000","last_peered":"2023-08-09T12:44:26.080278+0000","last_clean":"2023-08-09T12:44:26.080278+0000","last_became_active":"2023-08-09T12:44:25.061370+0000","last_became_peered":"2023-08-09T12:44:25.061370+0000","last_unstale":"2023-08-09T12:44:26.080278+0000","last_undegraded":"2023-08-09T12:44:26.080278+0000","last_fullsized":"2023-08-09T12:44:26.080278+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:16:14.364263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079555+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:44:27.079555+0000","last_peered":"2023-08-09T12:44:27.079555+0000","last_clean":"2023-08-09T12:44:27.079555+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:44:27.079555+0000","last_undegraded":"2023-08-09T12:44:27.079555+0000","last_fullsized":"2023-08-09T12:44:27.079555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:43:59.057403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083716+0000","last_change":"2023-08-09T12:44:26.092296+0000","last_active":"2023-08-09T12:44:27.083716+0000","last_peered":"2023-08-09T12:44:27.083716+0000","last_clean":"2023-08-09T12:44:27.083716+0000","last_became_active":"2023-08-09T12:44:26.091462+0000","last_became_peered":"2023-08-09T12:44:26.091462+0000","last_unstale":"2023-08-09T12:44:27.083716+0000","last_undegraded":"2023-08-09T12:44:27.083716+0000","last_fullsized":"2023-08-09T12:44:27.083716+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:26.953923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079305+0000","last_change":"2023-08-09T12:44:25.063331+0000","last_active":"2023-08-09T12:44:27.079305+0000","last_peered":"2023-08-09T12:44:27.079305+0000","last_clean":"2023-08-09T12:44:27.079305+0000","last_became_active":"2023-08-09T12:44:25.062313+0000","last_became_peered":"2023-08-09T12:44:25.062313+0000","last_unstale":"2023-08-09T12:44:27.079305+0000","last_undegraded":"2023-08-09T12:44:27.079305+0000","last_fullsized":"2023-08-09T12:44:27.079305+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:23:47.665695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.083466+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:44:26.083466+0000","last_peered":"2023-08-09T12:44:26.083466+0000","last_clean":"2023-08-09T12:44:26.083466+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:44:26.083466+0000","last_undegraded":"2023-08-09T12:44:26.083466+0000","last_fullsized":"2023-08-09T12:44:26.083466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:11:20.192605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084143+0000","last_change":"2023-08-09T12:44:26.107664+0000","last_active":"2023-08-09T12:44:27.084143+0000","last_peered":"2023-08-09T12:44:27.084143+0000","last_clean":"2023-08-09T12:44:27.084143+0000","last_became_active":"2023-08-09T12:44:26.107032+0000","last_became_peered":"2023-08-09T12:44:26.107032+0000","last_unstale":"2023-08-09T12:44:27.084143+0000","last_undegraded":"2023-08-09T12:44:27.084143+0000","last_fullsized":"2023-08-09T12:44:27.084143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:17:41.489861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085060+0000","last_change":"2023-08-09T12:44:25.054284+0000","last_active":"2023-08-09T12:44:27.085060+0000","last_peered":"2023-08-09T12:44:27.085060+0000","last_clean":"2023-08-09T12:44:27.085060+0000","last_became_active":"2023-08-09T12:44:25.053070+0000","last_became_peered":"2023-08-09T12:44:25.053070+0000","last_unstale":"2023-08-09T12:44:27.085060+0000","last_undegraded":"2023-08-09T12:44:27.085060+0000","last_fullsized":"2023-08-09T12:44:27.085060+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:12.578503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086421+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:44:27.086421+0000","last_peered":"2023-08-09T12:44:27.086421+0000","last_clean":"2023-08-09T12:44:27.086421+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:44:27.086421+0000","last_undegraded":"2023-08-09T12:44:27.086421+0000","last_fullsized":"2023-08-09T12:44:27.086421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:26:25.894705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1086,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194226,"statfs":{"total":200000000,"available":198887692,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1140000000000001,"15min":1.099},"min":{"1min":0.72499999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6359999999999999,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.02},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.1339999999999999,"15min":1.079},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.464,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.089}]},{"osd":1,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.1919999999999999,"15min":1.1100000000000001},"min":{"1min":0.70799999999999996,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1639999999999999,"15min":1.105},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.466,"5min":1.734,"15min":1.734},"last":0.97499999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.256,"15min":1.167},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.8100000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.96},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.147},"min":{"1min":0.83299999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.474,"5min":2.173,"15min":2.173},"last":1.5429999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.3029999999999999,"15min":1.2390000000000001},"min":{"1min":0.84699999999999998,"5min":0.746,"15min":0.746},"max":{"1min":3.4540000000000002,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3320000000000001,"15min":1.27},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.992,"5min":2.282,"15min":2.282},"last":1.843}]},{"osd":4,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.2270000000000001,"15min":1.2},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4930000000000001,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":2.6179999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3740000000000001,"15min":1.28},"min":{"1min":0.94799999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.5070000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.73}]},{"osd":5,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.393,"15min":1.2949999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1589999999999998,"5min":2.802,"15min":2.802},"last":2.1699999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4930000000000001,"15min":1.4790000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6819999999999999,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":2.7799999999999998}]},{"osd":6,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.472,"15min":1.464},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.764,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":2.8849999999999998},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4750000000000001,"15min":1.4430000000000001},"min":{"1min":1.0289999999999999,"5min":0.623,"15min":0.623},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":2.3580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199483123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.171,"15min":1.1240000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.734,"5min":2.54,"15min":2.54},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1080000000000001,"15min":1.0660000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6020000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.59899999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2470000000000001,"15min":1.228},"min":{"1min":0.80400000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.696,"5min":2.306,"15min":2.306},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.385,"5min":1.361,"15min":1.3220000000000001},"min":{"1min":0.88900000000000001,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7450000000000001,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1499999999999999,"15min":1.101},"min":{"1min":0.82399999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.244,"5min":1.2969999999999999,"15min":1.2709999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.784,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.1779999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.329,"15min":1.2689999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3240000000000001,"15min":1.284},"min":{"1min":0.755,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.0589999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.4359999999999999,"15min":1.3280000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.796,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.107},{"interface":"front","average":{"1min":1.286,"5min":1.3959999999999999,"15min":1.3400000000000001},"min":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.8180000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.393,"15min":1.331},"min":{"1min":0.98799999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6639999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.462,"5min":1.552,"15min":1.48},"min":{"1min":1.0720000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.8799999999999999,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.256}]},{"osd":7,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.552,"15min":1.4239999999999999},"min":{"1min":1.0009999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.8700000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5469999999999999,"15min":1.4330000000000001},"min":{"1min":1.2609999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.8109999999999999,"5min":3.621,"15min":3.621},"last":0.94999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194809,"statfs":{"total":200000000,"available":199484701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.1319999999999999,"15min":1.117},"min":{"1min":0.879,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.5409999999999999,"5min":2.427,"15min":2.427},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.157,"15min":1.071},"min":{"1min":0.77000000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.1399999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3140000000000001,"15min":1.284},"min":{"1min":0.76100000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6890000000000001,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.585},{"interface":"front","average":{"1min":1.286,"5min":1.2709999999999999,"15min":1.2430000000000001},"min":{"1min":0.80700000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6319999999999999,"5min":1.984,"15min":1.984},"last":1.51}]},{"osd":2,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2110000000000001,"15min":1.202},"min":{"1min":0.93700000000000006,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5760000000000001,"5min":1.861,"15min":1.861},"last":1.304},{"interface":"front","average":{"1min":1.175,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5089999999999999,"5min":1.728,"15min":1.728},"last":1.3580000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.268,"15min":1.1990000000000001},"min":{"1min":0.97099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7110000000000001,"5min":1.901,"15min":1.901},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.359,"15min":1.373},"min":{"1min":1.204,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6830000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.413}]},{"osd":4,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.226,"15min":1.224},"min":{"1min":0.79100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.839,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3300000000000001,"15min":1.3620000000000001},"min":{"1min":0.94799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":2.0579999999999998,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.675}]},{"osd":6,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.347,"15min":1.331},"min":{"1min":0.92200000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7909999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4139999999999999,"15min":1.4850000000000001},"min":{"1min":0.91000000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9970000000000001,"5min":2.948,"15min":2.948},"last":1.615}]},{"osd":7,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":1.1619999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.1640000000000001,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.782},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.52,"15min":1.508},"min":{"1min":1.175,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.8879999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.952}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199483019,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1359999999999999,"15min":1.085},"min":{"1min":0.84099999999999997,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.581,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.339},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.161,"15min":1.1000000000000001},"min":{"1min":0.77200000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5860000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.2629999999999999,"15min":1.3400000000000001},"min":{"1min":0.94699999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.641,"5min":1.97,"15min":1.97},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.2889999999999999,"15min":1.325},"min":{"1min":0.83399999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5369999999999999,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.089}]},{"osd":2,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.70799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.708,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.331,"15min":1.3149999999999999},"min":{"1min":0.93500000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.673,"5min":1.929,"15min":1.929},"last":0.99199999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.224},"min":{"1min":0.78500000000000003,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.196},{"interface":"front","average":{"1min":1.252,"5min":1.3129999999999999,"15min":1.3320000000000001},"min":{"1min":0.93999999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6160000000000001,"5min":2.081,"15min":2.081},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3260000000000001,"15min":1.385},"min":{"1min":0.86899999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.776,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.468},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4039999999999999,"15min":1.3899999999999999},"min":{"1min":0.97999999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7350000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.5}]},{"osd":6,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.419,"15min":1.4930000000000001},"min":{"1min":1.0389999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.825,"5min":2.238,"15min":2.238},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.51,"15min":1.534},"min":{"1min":1.05,"5min":0.755,"15min":0.755},"max":{"1min":1.869,"5min":2.036,"15min":2.036},"last":1.8200000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5569999999999999,"15min":1.53},"min":{"1min":1.1240000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.9139999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.595,"5min":1.575,"15min":1.627},"min":{"1min":1.3340000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.946,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.7589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199484153,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.86499999999999999,"15min":0.82699999999999996},"min":{"1min":0.45300000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.95199999999999996,"15min":0.88400000000000001},"min":{"1min":0.52100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.7,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.71899999999999997}]},{"osd":1,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88200000000000001,"15min":0.89600000000000002},"min":{"1min":0.51300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5760000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":0.98899999999999999,"15min":0.89500000000000002},"min":{"1min":0.60099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.5509999999999999,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.995}]},{"osd":2,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2729999999999999,"15min":1.0980000000000001},"min":{"1min":0.57099999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.6759999999999999,"5min":18.145,"15min":18.145},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.171,"5min":1.1699999999999999,"15min":1.1890000000000001},"min":{"1min":0.53800000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.468,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.329,"15min":1.333},"min":{"1min":0.87,"5min":0.745,"15min":0.745},"max":{"1min":2.859,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.319,"15min":1.339},"min":{"1min":0.89300000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6719999999999999,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.087}]},{"osd":5,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.569,"15min":1.4410000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7709999999999999,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4950000000000001,"15min":1.3280000000000001},"min":{"1min":0.83499999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":3.0419999999999998,"5min":14.105,"15min":14.105},"last":1.073}]},{"osd":6,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3580000000000001,"15min":1.3360000000000001},"min":{"1min":0.97399999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.762,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.468,"15min":1.48},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8700000000000001,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.1719999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":0.91700000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8200000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.393,"15min":1.367},"min":{"1min":0.85699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.746,"5min":3.016,"15min":3.016},"last":1.1499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483993,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.60199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.391,"5min":1.716,"15min":1.716},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":0.93999999999999995,"15min":0.95499999999999996},"min":{"1min":0.53800000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.617,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.123}]},{"osd":1,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.93500000000000005,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.371,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.87},{"interface":"front","average":{"1min":1.125,"5min":1.0389999999999999,"15min":1.0549999999999999},"min":{"1min":0.70199999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.641,"5min":1.869,"15min":1.869},"last":1.6399999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1539999999999999,"15min":1.1679999999999999},"min":{"1min":0.63200000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.52,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.155,"15min":1.147},"min":{"1min":0.65800000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.0469999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.421,"15min":1.4099999999999999},"min":{"1min":1.044,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.7629999999999999,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.3260000000000001,"15min":1.27},"min":{"1min":1.036,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.829,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.361}]},{"osd":5,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.419,"15min":1.359},"min":{"1min":0.90400000000000003,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7929999999999999,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.474,"15min":1.478},"min":{"1min":1.004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.667,"5min":4.806,"15min":4.806},"last":1.4279999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.331,"15min":1.2989999999999999},"min":{"1min":0.98199999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7490000000000001,"5min":2.323,"15min":2.323},"last":1.476},{"interface":"front","average":{"1min":1.532,"5min":1.4379999999999999,"15min":1.4179999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.177,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.393}]},{"osd":7,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.381,"15min":1.357},"min":{"1min":0.92300000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9410000000000001,"5min":2.218,"15min":2.218},"last":1.228},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.5429999999999999,"15min":1.53},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.1150000000000002,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.532}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199491863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.875,"15min":0.88700000000000001},"min":{"1min":0.45200000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.609,"5min":1.881,"15min":1.881},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.982,"15min":1.2310000000000001},"min":{"1min":0.70899999999999996,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.373,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.68999999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.028,"15min":0.94899999999999995},"min":{"1min":0.64700000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9390000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.355,"5min":1.252,"15min":1.129},"min":{"1min":0.622,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0449999999999999,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":2.044}]},{"osd":3,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.1599999999999999,"15min":1.0880000000000001},"min":{"1min":0.57999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7130000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.587},{"interface":"front","average":{"1min":1.232,"5min":1.1339999999999999,"15min":0.96099999999999997},"min":{"1min":0.77700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.659,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.57299999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.5409999999999999,"15min":1.288},"min":{"1min":0.92700000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6679999999999999,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.008},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.365,"15min":1.2969999999999999},"min":{"1min":0.93200000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":2.1589999999999998}]},{"osd":5,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.653,"15min":1.3939999999999999},"min":{"1min":0.89400000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.649,"5min":28.710000000000001,"15min":28.710000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.363,"15min":1.2789999999999999},"min":{"1min":1.0649999999999999,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.629,"5min":3.762,"15min":3.762},"last":0.91800000000000004}]},{"osd":6,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.522,"15min":1.423},"min":{"1min":1.0900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7729999999999999,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.454,"15min":1.375},"min":{"1min":0.873,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8200000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.7929999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.841,"15min":1.579},"min":{"1min":1.119,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.4769999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":2.5089999999999999},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.849,"15min":1.5589999999999999},"min":{"1min":1.1599999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.887,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.246}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1072,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194239,"statfs":{"total":200000000,"available":198901495,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89000000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.288,"5min":1.819,"15min":1.819},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.0609999999999999,"15min":0.95099999999999996},"min":{"1min":0.60299999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.6699999999999999,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":1.5629999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.998,"15min":0.95199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6659999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.1220000000000001,"15min":1.0249999999999999},"min":{"1min":0.57999999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.411,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":1.103}]},{"osd":3,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0549999999999999,"15min":0.93500000000000005},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.5469999999999999,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.1990000000000001,"15min":1.177},"min":{"1min":0.84899999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.51,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.871}]},{"osd":4,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.377,"15min":1.333},"min":{"1min":0.874,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.819,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.331,"15min":1.2789999999999999},"min":{"1min":0.78600000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.782,"5min":1.806,"15min":1.806},"last":1.3129999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3779999999999999,"15min":1.302},"min":{"1min":0.98099999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.758,"5min":10.004,"15min":10.004},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4059999999999999,"15min":1.377},"min":{"1min":0.90200000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.887,"5min":2.161,"15min":2.161},"last":1.3819999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4199999999999999,"15min":1.3360000000000001},"min":{"1min":1.163,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.2000000000000002,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.355},{"interface":"front","average":{"1min":1.462,"5min":1.506,"15min":1.4259999999999999},"min":{"1min":1.131,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.794,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.0609999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5840000000000001,"15min":1.431},"min":{"1min":1.111,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2909999999999999,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.27},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.546,"15min":1.456},"min":{"1min":1.103,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.9450000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.22}]}]}],"pool_statfs":[]}} 2023-08-09T12:44:30.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:44:30.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.867+0000 7f6cddd31640 1 Processor -- start 2023-08-09T12:44:30.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.867+0000 7f6cddd31640 1 -- start start 2023-08-09T12:44:30.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.869+0000 7f6cddd31640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6cd8161280 0x7f6cd80c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.869+0000 7f6cddd31640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 0x7f6cd80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.869+0000 7f6cddd31640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6cd80ca450 0x7f6cd80acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.869+0000 7f6cddd31640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd815d430 con 0x7f6cd8161280 2023-08-09T12:44:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.869+0000 7f6cddd31640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd815df30 con 0x7f6cd80ca450 2023-08-09T12:44:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.869+0000 7f6cddd31640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80ca9d0 con 0x7f6cd8161660 2023-08-09T12:44:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.869+0000 7f6cd77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6cd8161280 0x7f6cd80c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cd77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6cd8161280 0x7f6cd80c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49884/0 (socket says 172.21.15.17:49884) 2023-08-09T12:44:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cd77fe640 1 -- 172.21.15.17:0/3722998902 learned_addr learned my addr 172.21.15.17:0/3722998902 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cceffd640 1 --2- 172.21.15.17:0/3722998902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 0x7f6cd80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cd7fff640 1 --2- 172.21.15.17:0/3722998902 >> v2:172.21.15.142:3300/0 conn(0x7f6cd80ca450 0x7f6cd80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cd77fe640 1 -- 172.21.15.17:0/3722998902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 msgr2=0x7f6cd80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cd77fe640 1 --2- 172.21.15.17:0/3722998902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 0x7f6cd80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cd77fe640 1 -- 172.21.15.17:0/3722998902 >> v2:172.21.15.142:3300/0 conn(0x7f6cd80ca450 msgr2=0x7f6cd80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cd77fe640 1 --2- 172.21.15.17:0/3722998902 >> v2:172.21.15.142:3300/0 conn(0x7f6cd80ca450 0x7f6cd80acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.870+0000 7f6cd77fe640 1 -- 172.21.15.17:0/3722998902 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd815e3c0 con 0x7f6cd8161280 2023-08-09T12:44:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.871+0000 7f6cd77fe640 1 --2- 172.21.15.17:0/3722998902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd8161280 0x7f6cd80c9f10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80cc220 tx=0x7f6cc802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a14d076110407 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cd6ffd640 1 -- 172.21.15.17:0/3722998902 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc802c9f0 con 0x7f6cd8161280 2023-08-09T12:44:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cd6ffd640 1 -- 172.21.15.17:0/3722998902 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc802cb50 con 0x7f6cd8161280 2023-08-09T12:44:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cd6ffd640 1 -- 172.21.15.17:0/3722998902 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80343f0 con 0x7f6cd8161280 2023-08-09T12:44:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cddd31640 1 -- 172.21.15.17:0/3722998902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd8161280 msgr2=0x7f6cd80c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cddd31640 1 --2- 172.21.15.17:0/3722998902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd8161280 0x7f6cd80c9f10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80cc220 tx=0x7f6cc802be50 comp rx=0 tx=0).stop 2023-08-09T12:44:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cddd31640 1 -- 172.21.15.17:0/3722998902 shutdown_connections 2023-08-09T12:44:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cddd31640 1 --2- 172.21.15.17:0/3722998902 >> v2:172.21.15.142:3300/0 conn(0x7f6cd80ca450 0x7f6cd80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cddd31640 1 --2- 172.21.15.17:0/3722998902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 0x7f6cd80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cddd31640 1 --2- 172.21.15.17:0/3722998902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd8161280 0x7f6cd80c9f10 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cddd31640 1 -- 172.21.15.17:0/3722998902 >> 172.21.15.17:0/3722998902 conn(0x7f6cd80cb1b0 msgr2=0x7f6cd80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.872+0000 7f6cddd31640 1 -- 172.21.15.17:0/3722998902 shutdown_connections 2023-08-09T12:44:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.873+0000 7f6cddd31640 1 -- 172.21.15.17:0/3722998902 wait complete. 2023-08-09T12:44:30.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.874+0000 7f6cddd31640 1 Processor -- start 2023-08-09T12:44:30.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.875+0000 7f6cddd31640 1 -- start start 2023-08-09T12:44:30.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.875+0000 7f6cddd31640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd80ca450 0x7f6cd81f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cddd31640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd8161280 0x7f6cd81558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cddd31640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 0x7f6cd8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cddd31640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8154800 con 0x7f6cd80ca450 2023-08-09T12:44:30.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cddd31640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8154ae0 con 0x7f6cd8161280 2023-08-09T12:44:30.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cddd31640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8154dc0 con 0x7f6cd8161660 2023-08-09T12:44:30.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cd77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd80ca450 0x7f6cd81f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cd77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd80ca450 0x7f6cd81f3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49890/0 (socket says 172.21.15.17:49890) 2023-08-09T12:44:30.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cd77fe640 1 -- 172.21.15.17:0/2837710047 learned_addr learned my addr 172.21.15.17:0/2837710047 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:30.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cd77fe640 1 -- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 msgr2=0x7f6cd8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cd77fe640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 0x7f6cd8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cd77fe640 1 -- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd8161280 msgr2=0x7f6cd81558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:30.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cd77fe640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd8161280 0x7f6cd81558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.876+0000 7f6cd77fe640 1 -- 172.21.15.17:0/2837710047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8009b30 con 0x7f6cd80ca450 2023-08-09T12:44:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.877+0000 7f6cd77fe640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd80ca450 0x7f6cd81f3c90 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000f80 tx=0x7f6cc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.877+0000 7f6cd4ff9640 1 -- 172.21.15.17:0/2837710047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8009510 con 0x7f6cd80ca450 2023-08-09T12:44:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.877+0000 7f6cd4ff9640 1 -- 172.21.15.17:0/2837710047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc803e450 con 0x7f6cd80ca450 2023-08-09T12:44:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.877+0000 7f6cd4ff9640 1 -- 172.21.15.17:0/2837710047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc803e800 con 0x7f6cd80ca450 2023-08-09T12:44:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.877+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd81550a0 con 0x7f6cd80ca450 2023-08-09T12:44:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.877+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd81f41d0 con 0x7f6cd80ca450 2023-08-09T12:44:30.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.878+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd80cd970 con 0x7f6cd80ca450 2023-08-09T12:44:30.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.879+0000 7f6cd4ff9640 1 -- 172.21.15.17:0/2837710047 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6cc803e960 con 0x7f6cd80ca450 2023-08-09T12:44:30.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.880+0000 7f6cd4ff9640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:30.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.880+0000 7f6cd4ff9640 1 -- 172.21.15.17:0/2837710047 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6cc80ab400 con 0x7f6cd80ca450 2023-08-09T12:44:30.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.881+0000 7f6cceffd640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:30.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.882+0000 7f6cceffd640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0006e20 tx=0x7f6cc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:30.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:30.884+0000 7f6cd4ff9640 1 -- 172.21.15.17:0/2837710047 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6cc8076ae0 con 0x7f6cd80ca450 2023-08-09T12:44:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.075+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6cd815d8e0 con 0x7f6cb806a050 2023-08-09T12:44:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.099+0000 7f6cd4ff9640 1 -- 172.21.15.17:0/2837710047 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302739 (secure 0 0 0) 0x7f6cc0009460 con 0x7f6cb806a050 2023-08-09T12:44:31.104 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:44:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 msgr2=0x7f6cb806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0006e20 tx=0x7f6cc0008040 comp rx=0 tx=0).stop 2023-08-09T12:44:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd80ca450 msgr2=0x7f6cd81f3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd80ca450 0x7f6cd81f3c90 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000f80 tx=0x7f6cc8004a40 comp rx=0 tx=0).stop 2023-08-09T12:44:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 shutdown_connections 2023-08-09T12:44:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd8161660 0x7f6cd8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd8161280 0x7f6cd81558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 --2- 172.21.15.17:0/2837710047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd80ca450 0x7f6cd81f3c90 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 >> 172.21.15.17:0/2837710047 conn(0x7f6cd80cb1b0 msgr2=0x7f6cd806bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 shutdown_connections 2023-08-09T12:44:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.106+0000 7f6cddd31640 1 -- 172.21.15.17:0/2837710047 wait complete. 2023-08-09T12:44:31.130 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2023-08-09T12:44:30.752249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5175,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557324,"statfs":{"total":1600000000,"available":1594700039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002040"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080897+0000","last_change":"2023-08-09T12:44:26.102425+0000","last_active":"2023-08-09T12:44:27.080897+0000","last_peered":"2023-08-09T12:44:27.080897+0000","last_clean":"2023-08-09T12:44:27.080897+0000","last_became_active":"2023-08-09T12:44:26.102036+0000","last_became_peered":"2023-08-09T12:44:26.102036+0000","last_unstale":"2023-08-09T12:44:27.080897+0000","last_undegraded":"2023-08-09T12:44:27.080897+0000","last_fullsized":"2023-08-09T12:44:27.080897+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:12.171355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.117797+0000","last_change":"2023-08-09T12:44:26.117672+0000","last_active":"2023-08-09T12:44:26.117797+0000","last_peered":"2023-08-09T12:44:26.117797+0000","last_clean":"2023-08-09T12:44:26.117797+0000","last_became_active":"2023-08-09T12:44:26.117438+0000","last_became_peered":"2023-08-09T12:44:26.117438+0000","last_unstale":"2023-08-09T12:44:26.117797+0000","last_undegraded":"2023-08-09T12:44:26.117797+0000","last_fullsized":"2023-08-09T12:44:26.117797+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:16:15.368770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.110626+0000","last_change":"2023-08-09T12:44:26.110132+0000","last_active":"2023-08-09T12:44:26.110626+0000","last_peered":"2023-08-09T12:44:26.110626+0000","last_clean":"2023-08-09T12:44:26.110626+0000","last_became_active":"2023-08-09T12:44:26.109541+0000","last_became_peered":"2023-08-09T12:44:26.109541+0000","last_unstale":"2023-08-09T12:44:26.110626+0000","last_undegraded":"2023-08-09T12:44:26.110626+0000","last_fullsized":"2023-08-09T12:44:26.110626+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:23.402270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085949+0000","last_change":"2023-08-09T12:44:26.109724+0000","last_active":"2023-08-09T12:44:27.085949+0000","last_peered":"2023-08-09T12:44:27.085949+0000","last_clean":"2023-08-09T12:44:27.085949+0000","last_became_active":"2023-08-09T12:44:26.108750+0000","last_became_peered":"2023-08-09T12:44:26.108750+0000","last_unstale":"2023-08-09T12:44:27.085949+0000","last_undegraded":"2023-08-09T12:44:27.085949+0000","last_fullsized":"2023-08-09T12:44:27.085949+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:12.088155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083961+0000","last_change":"2023-08-09T12:44:26.107851+0000","last_active":"2023-08-09T12:44:27.083961+0000","last_peered":"2023-08-09T12:44:27.083961+0000","last_clean":"2023-08-09T12:44:27.083961+0000","last_became_active":"2023-08-09T12:44:26.107412+0000","last_became_peered":"2023-08-09T12:44:26.107412+0000","last_unstale":"2023-08-09T12:44:27.083961+0000","last_undegraded":"2023-08-09T12:44:27.083961+0000","last_fullsized":"2023-08-09T12:44:27.083961+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:15:14.676259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083346+0000","last_change":"2023-08-09T12:44:26.109068+0000","last_active":"2023-08-09T12:44:27.083346+0000","last_peered":"2023-08-09T12:44:27.083346+0000","last_clean":"2023-08-09T12:44:27.083346+0000","last_became_active":"2023-08-09T12:44:26.108779+0000","last_became_peered":"2023-08-09T12:44:26.108779+0000","last_unstale":"2023-08-09T12:44:27.083346+0000","last_undegraded":"2023-08-09T12:44:27.083346+0000","last_fullsized":"2023-08-09T12:44:27.083346+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:01:34.451855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085572+0000","last_change":"2023-08-09T12:44:26.096432+0000","last_active":"2023-08-09T12:44:27.085572+0000","last_peered":"2023-08-09T12:44:27.085572+0000","last_clean":"2023-08-09T12:44:27.085572+0000","last_became_active":"2023-08-09T12:44:26.095692+0000","last_became_peered":"2023-08-09T12:44:26.095692+0000","last_unstale":"2023-08-09T12:44:27.085572+0000","last_undegraded":"2023-08-09T12:44:27.085572+0000","last_fullsized":"2023-08-09T12:44:27.085572+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:09:14.076904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085006+0000","last_change":"2023-08-09T12:44:26.108868+0000","last_active":"2023-08-09T12:44:27.085006+0000","last_peered":"2023-08-09T12:44:27.085006+0000","last_clean":"2023-08-09T12:44:27.085006+0000","last_became_active":"2023-08-09T12:44:26.108345+0000","last_became_peered":"2023-08-09T12:44:26.108345+0000","last_unstale":"2023-08-09T12:44:27.085006+0000","last_undegraded":"2023-08-09T12:44:27.085006+0000","last_fullsized":"2023-08-09T12:44:27.085006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:37:50.104196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083417+0000","last_change":"2023-08-09T12:44:26.113100+0000","last_active":"2023-08-09T12:44:27.083417+0000","last_peered":"2023-08-09T12:44:27.083417+0000","last_clean":"2023-08-09T12:44:27.083417+0000","last_became_active":"2023-08-09T12:44:26.110802+0000","last_became_peered":"2023-08-09T12:44:26.110802+0000","last_unstale":"2023-08-09T12:44:27.083417+0000","last_undegraded":"2023-08-09T12:44:27.083417+0000","last_fullsized":"2023-08-09T12:44:27.083417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:37:39.579820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.088028+0000","last_change":"2023-08-09T12:44:26.105327+0000","last_active":"2023-08-09T12:44:27.088028+0000","last_peered":"2023-08-09T12:44:27.088028+0000","last_clean":"2023-08-09T12:44:27.088028+0000","last_became_active":"2023-08-09T12:44:26.105064+0000","last_became_peered":"2023-08-09T12:44:26.105064+0000","last_unstale":"2023-08-09T12:44:27.088028+0000","last_undegraded":"2023-08-09T12:44:27.088028+0000","last_fullsized":"2023-08-09T12:44:27.088028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:23:07.272660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.117778+0000","last_change":"2023-08-09T12:44:26.117473+0000","last_active":"2023-08-09T12:44:26.117778+0000","last_peered":"2023-08-09T12:44:26.117778+0000","last_clean":"2023-08-09T12:44:26.117778+0000","last_became_active":"2023-08-09T12:44:26.117182+0000","last_became_peered":"2023-08-09T12:44:26.117182+0000","last_unstale":"2023-08-09T12:44:26.117778+0000","last_undegraded":"2023-08-09T12:44:26.117778+0000","last_fullsized":"2023-08-09T12:44:26.117778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:58.750914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087096+0000","last_change":"2023-08-09T12:44:26.111107+0000","last_active":"2023-08-09T12:44:27.087096+0000","last_peered":"2023-08-09T12:44:27.087096+0000","last_clean":"2023-08-09T12:44:27.087096+0000","last_became_active":"2023-08-09T12:44:26.110062+0000","last_became_peered":"2023-08-09T12:44:26.110062+0000","last_unstale":"2023-08-09T12:44:27.087096+0000","last_undegraded":"2023-08-09T12:44:27.087096+0000","last_fullsized":"2023-08-09T12:44:27.087096+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:08:50.347843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085197+0000","last_change":"2023-08-09T12:44:26.115177+0000","last_active":"2023-08-09T12:44:27.085197+0000","last_peered":"2023-08-09T12:44:27.085197+0000","last_clean":"2023-08-09T12:44:27.085197+0000","last_became_active":"2023-08-09T12:44:26.114500+0000","last_became_peered":"2023-08-09T12:44:26.114500+0000","last_unstale":"2023-08-09T12:44:27.085197+0000","last_undegraded":"2023-08-09T12:44:27.085197+0000","last_fullsized":"2023-08-09T12:44:27.085197+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:51:06.591122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084159+0000","last_change":"2023-08-09T12:44:26.106043+0000","last_active":"2023-08-09T12:44:27.084159+0000","last_peered":"2023-08-09T12:44:27.084159+0000","last_clean":"2023-08-09T12:44:27.084159+0000","last_became_active":"2023-08-09T12:44:26.105612+0000","last_became_peered":"2023-08-09T12:44:26.105612+0000","last_unstale":"2023-08-09T12:44:27.084159+0000","last_undegraded":"2023-08-09T12:44:27.084159+0000","last_fullsized":"2023-08-09T12:44:27.084159+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:15.448723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.106167+0000","last_change":"2023-08-09T12:44:26.105549+0000","last_active":"2023-08-09T12:44:26.106167+0000","last_peered":"2023-08-09T12:44:26.106167+0000","last_clean":"2023-08-09T12:44:26.106167+0000","last_became_active":"2023-08-09T12:44:26.103252+0000","last_became_peered":"2023-08-09T12:44:26.103252+0000","last_unstale":"2023-08-09T12:44:26.106167+0000","last_undegraded":"2023-08-09T12:44:26.106167+0000","last_fullsized":"2023-08-09T12:44:26.106167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:02.311424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079452+0000","last_change":"2023-08-09T12:44:26.107884+0000","last_active":"2023-08-09T12:44:27.079452+0000","last_peered":"2023-08-09T12:44:27.079452+0000","last_clean":"2023-08-09T12:44:27.079452+0000","last_became_active":"2023-08-09T12:44:26.107339+0000","last_became_peered":"2023-08-09T12:44:26.107339+0000","last_unstale":"2023-08-09T12:44:27.079452+0000","last_undegraded":"2023-08-09T12:44:27.079452+0000","last_fullsized":"2023-08-09T12:44:27.079452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:20:11.176195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085284+0000","last_change":"2023-08-09T12:44:26.106896+0000","last_active":"2023-08-09T12:44:27.085284+0000","last_peered":"2023-08-09T12:44:27.085284+0000","last_clean":"2023-08-09T12:44:27.085284+0000","last_became_active":"2023-08-09T12:44:26.106521+0000","last_became_peered":"2023-08-09T12:44:26.106521+0000","last_unstale":"2023-08-09T12:44:27.085284+0000","last_undegraded":"2023-08-09T12:44:27.085284+0000","last_fullsized":"2023-08-09T12:44:27.085284+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:07:44.447078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.108915+0000","last_change":"2023-08-09T12:44:26.102778+0000","last_active":"2023-08-09T12:44:26.108915+0000","last_peered":"2023-08-09T12:44:26.108915+0000","last_clean":"2023-08-09T12:44:26.108915+0000","last_became_active":"2023-08-09T12:44:26.102378+0000","last_became_peered":"2023-08-09T12:44:26.102378+0000","last_unstale":"2023-08-09T12:44:26.108915+0000","last_undegraded":"2023-08-09T12:44:26.108915+0000","last_fullsized":"2023-08-09T12:44:26.108915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:41:04.506330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084377+0000","last_change":"2023-08-09T12:44:26.093984+0000","last_active":"2023-08-09T12:44:27.084377+0000","last_peered":"2023-08-09T12:44:27.084377+0000","last_clean":"2023-08-09T12:44:27.084377+0000","last_became_active":"2023-08-09T12:44:26.092648+0000","last_became_peered":"2023-08-09T12:44:26.092648+0000","last_unstale":"2023-08-09T12:44:27.084377+0000","last_undegraded":"2023-08-09T12:44:27.084377+0000","last_fullsized":"2023-08-09T12:44:27.084377+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:58.750914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084309+0000","last_change":"2023-08-09T12:44:26.102515+0000","last_active":"2023-08-09T12:44:27.084309+0000","last_peered":"2023-08-09T12:44:27.084309+0000","last_clean":"2023-08-09T12:44:27.084309+0000","last_became_active":"2023-08-09T12:44:26.102265+0000","last_became_peered":"2023-08-09T12:44:26.102265+0000","last_unstale":"2023-08-09T12:44:27.084309+0000","last_undegraded":"2023-08-09T12:44:27.084309+0000","last_fullsized":"2023-08-09T12:44:27.084309+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:35.530763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084375+0000","last_change":"2023-08-09T12:44:26.112594+0000","last_active":"2023-08-09T12:44:27.084375+0000","last_peered":"2023-08-09T12:44:27.084375+0000","last_clean":"2023-08-09T12:44:27.084375+0000","last_became_active":"2023-08-09T12:44:26.112345+0000","last_became_peered":"2023-08-09T12:44:26.112345+0000","last_unstale":"2023-08-09T12:44:27.084375+0000","last_undegraded":"2023-08-09T12:44:27.084375+0000","last_fullsized":"2023-08-09T12:44:27.084375+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:37:02.087473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084589+0000","last_change":"2023-08-09T12:44:26.099482+0000","last_active":"2023-08-09T12:44:27.084589+0000","last_peered":"2023-08-09T12:44:27.084589+0000","last_clean":"2023-08-09T12:44:27.084589+0000","last_became_active":"2023-08-09T12:44:26.098832+0000","last_became_peered":"2023-08-09T12:44:26.098832+0000","last_unstale":"2023-08-09T12:44:27.084589+0000","last_undegraded":"2023-08-09T12:44:27.084589+0000","last_fullsized":"2023-08-09T12:44:27.084589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:15.184033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083490+0000","last_change":"2023-08-09T12:44:26.102926+0000","last_active":"2023-08-09T12:44:27.083490+0000","last_peered":"2023-08-09T12:44:27.083490+0000","last_clean":"2023-08-09T12:44:27.083490+0000","last_became_active":"2023-08-09T12:44:26.102639+0000","last_became_peered":"2023-08-09T12:44:26.102639+0000","last_unstale":"2023-08-09T12:44:27.083490+0000","last_undegraded":"2023-08-09T12:44:27.083490+0000","last_fullsized":"2023-08-09T12:44:27.083490+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:05:13.616951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.107776+0000","last_change":"2023-08-09T12:44:26.107461+0000","last_active":"2023-08-09T12:44:26.107776+0000","last_peered":"2023-08-09T12:44:26.107776+0000","last_clean":"2023-08-09T12:44:26.107776+0000","last_became_active":"2023-08-09T12:44:26.106898+0000","last_became_peered":"2023-08-09T12:44:26.106898+0000","last_unstale":"2023-08-09T12:44:26.107776+0000","last_undegraded":"2023-08-09T12:44:26.107776+0000","last_fullsized":"2023-08-09T12:44:26.107776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:44:50.255962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.106184+0000","last_change":"2023-08-09T12:44:26.106095+0000","last_active":"2023-08-09T12:44:26.106184+0000","last_peered":"2023-08-09T12:44:26.106184+0000","last_clean":"2023-08-09T12:44:26.106184+0000","last_became_active":"2023-08-09T12:44:26.105852+0000","last_became_peered":"2023-08-09T12:44:26.105852+0000","last_unstale":"2023-08-09T12:44:26.106184+0000","last_undegraded":"2023-08-09T12:44:26.106184+0000","last_fullsized":"2023-08-09T12:44:26.106184+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:57:20.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086124+0000","last_change":"2023-08-09T12:44:26.105054+0000","last_active":"2023-08-09T12:44:27.086124+0000","last_peered":"2023-08-09T12:44:27.086124+0000","last_clean":"2023-08-09T12:44:27.086124+0000","last_became_active":"2023-08-09T12:44:26.104647+0000","last_became_peered":"2023-08-09T12:44:26.104647+0000","last_unstale":"2023-08-09T12:44:27.086124+0000","last_undegraded":"2023-08-09T12:44:27.086124+0000","last_fullsized":"2023-08-09T12:44:27.086124+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:40:32.854458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079446+0000","last_change":"2023-08-09T12:44:26.105385+0000","last_active":"2023-08-09T12:44:27.079446+0000","last_peered":"2023-08-09T12:44:27.079446+0000","last_clean":"2023-08-09T12:44:27.079446+0000","last_became_active":"2023-08-09T12:44:26.104435+0000","last_became_peered":"2023-08-09T12:44:26.104435+0000","last_unstale":"2023-08-09T12:44:27.079446+0000","last_undegraded":"2023-08-09T12:44:27.079446+0000","last_fullsized":"2023-08-09T12:44:27.079446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:26:59.816334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085354+0000","last_change":"2023-08-09T12:44:26.115377+0000","last_active":"2023-08-09T12:44:27.085354+0000","last_peered":"2023-08-09T12:44:27.085354+0000","last_clean":"2023-08-09T12:44:27.085354+0000","last_became_active":"2023-08-09T12:44:26.114821+0000","last_became_peered":"2023-08-09T12:44:26.114821+0000","last_unstale":"2023-08-09T12:44:27.085354+0000","last_undegraded":"2023-08-09T12:44:27.085354+0000","last_fullsized":"2023-08-09T12:44:27.085354+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:11:42.286393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.107795+0000","last_change":"2023-08-09T12:44:26.107629+0000","last_active":"2023-08-09T12:44:26.107795+0000","last_peered":"2023-08-09T12:44:26.107795+0000","last_clean":"2023-08-09T12:44:26.107795+0000","last_became_active":"2023-08-09T12:44:26.107229+0000","last_became_peered":"2023-08-09T12:44:26.107229+0000","last_unstale":"2023-08-09T12:44:26.107795+0000","last_undegraded":"2023-08-09T12:44:26.107795+0000","last_fullsized":"2023-08-09T12:44:26.107795+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:32.200904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079444+0000","last_change":"2023-08-09T12:44:26.110209+0000","last_active":"2023-08-09T12:44:27.079444+0000","last_peered":"2023-08-09T12:44:27.079444+0000","last_clean":"2023-08-09T12:44:27.079444+0000","last_became_active":"2023-08-09T12:44:26.109155+0000","last_became_peered":"2023-08-09T12:44:26.109155+0000","last_unstale":"2023-08-09T12:44:27.079444+0000","last_undegraded":"2023-08-09T12:44:27.079444+0000","last_fullsized":"2023-08-09T12:44:27.079444+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:43:34.728478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.097970+0000","last_change":"2023-08-09T12:44:26.097522+0000","last_active":"2023-08-09T12:44:26.097970+0000","last_peered":"2023-08-09T12:44:26.097970+0000","last_clean":"2023-08-09T12:44:26.097970+0000","last_became_active":"2023-08-09T12:44:26.097011+0000","last_became_peered":"2023-08-09T12:44:26.097011+0000","last_unstale":"2023-08-09T12:44:26.097970+0000","last_undegraded":"2023-08-09T12:44:26.097970+0000","last_fullsized":"2023-08-09T12:44:26.097970+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:59.391922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079778+0000","last_change":"2023-08-09T12:44:26.105583+0000","last_active":"2023-08-09T12:44:27.079778+0000","last_peered":"2023-08-09T12:44:27.079778+0000","last_clean":"2023-08-09T12:44:27.079778+0000","last_became_active":"2023-08-09T12:44:26.104993+0000","last_became_peered":"2023-08-09T12:44:26.104993+0000","last_unstale":"2023-08-09T12:44:27.079778+0000","last_undegraded":"2023-08-09T12:44:27.079778+0000","last_fullsized":"2023-08-09T12:44:27.079778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:24.465572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.111234+0000","last_change":"2023-08-09T12:44:26.104279+0000","last_active":"2023-08-09T12:44:26.111234+0000","last_peered":"2023-08-09T12:44:26.111234+0000","last_clean":"2023-08-09T12:44:26.111234+0000","last_became_active":"2023-08-09T12:44:26.103806+0000","last_became_peered":"2023-08-09T12:44:26.103806+0000","last_unstale":"2023-08-09T12:44:26.111234+0000","last_undegraded":"2023-08-09T12:44:26.111234+0000","last_fullsized":"2023-08-09T12:44:26.111234+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:32:39.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"91'4","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085615+0000","last_change":"2023-08-09T12:44:25.058192+0000","last_active":"2023-08-09T12:44:27.085615+0000","last_peered":"2023-08-09T12:44:27.085615+0000","last_clean":"2023-08-09T12:44:27.085615+0000","last_became_active":"2023-08-09T12:44:25.057183+0000","last_became_peered":"2023-08-09T12:44:25.057183+0000","last_unstale":"2023-08-09T12:44:27.085615+0000","last_undegraded":"2023-08-09T12:44:27.085615+0000","last_fullsized":"2023-08-09T12:44:27.085615+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:35.196422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.103648+0000","last_change":"2023-08-09T12:44:26.103443+0000","last_active":"2023-08-09T12:44:26.103648+0000","last_peered":"2023-08-09T12:44:26.103648+0000","last_clean":"2023-08-09T12:44:26.103648+0000","last_became_active":"2023-08-09T12:44:26.103090+0000","last_became_peered":"2023-08-09T12:44:26.103090+0000","last_unstale":"2023-08-09T12:44:26.103648+0000","last_undegraded":"2023-08-09T12:44:26.103648+0000","last_fullsized":"2023-08-09T12:44:26.103648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:23.402270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.078993+0000","last_change":"2023-08-09T12:44:25.063728+0000","last_active":"2023-08-09T12:44:27.078993+0000","last_peered":"2023-08-09T12:44:27.078993+0000","last_clean":"2023-08-09T12:44:27.078993+0000","last_became_active":"2023-08-09T12:44:25.063011+0000","last_became_peered":"2023-08-09T12:44:25.063011+0000","last_unstale":"2023-08-09T12:44:27.078993+0000","last_undegraded":"2023-08-09T12:44:27.078993+0000","last_fullsized":"2023-08-09T12:44:27.078993+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:01:16.030882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083886+0000","last_change":"2023-08-09T12:44:26.108807+0000","last_active":"2023-08-09T12:44:27.083886+0000","last_peered":"2023-08-09T12:44:27.083886+0000","last_clean":"2023-08-09T12:44:27.083886+0000","last_became_active":"2023-08-09T12:44:26.108329+0000","last_became_peered":"2023-08-09T12:44:26.108329+0000","last_unstale":"2023-08-09T12:44:27.083886+0000","last_undegraded":"2023-08-09T12:44:27.083886+0000","last_fullsized":"2023-08-09T12:44:27.083886+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:43:16.301169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080041+0000","last_change":"2023-08-09T12:44:25.061566+0000","last_active":"2023-08-09T12:44:27.080041+0000","last_peered":"2023-08-09T12:44:27.080041+0000","last_clean":"2023-08-09T12:44:27.080041+0000","last_became_active":"2023-08-09T12:44:25.061235+0000","last_became_peered":"2023-08-09T12:44:25.061235+0000","last_unstale":"2023-08-09T12:44:27.080041+0000","last_undegraded":"2023-08-09T12:44:27.080041+0000","last_fullsized":"2023-08-09T12:44:27.080041+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:54:52.898460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083707+0000","last_change":"2023-08-09T12:44:26.106358+0000","last_active":"2023-08-09T12:44:27.083707+0000","last_peered":"2023-08-09T12:44:27.083707+0000","last_clean":"2023-08-09T12:44:27.083707+0000","last_became_active":"2023-08-09T12:44:26.105013+0000","last_became_peered":"2023-08-09T12:44:26.105013+0000","last_unstale":"2023-08-09T12:44:27.083707+0000","last_undegraded":"2023-08-09T12:44:27.083707+0000","last_fullsized":"2023-08-09T12:44:27.083707+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:46.473919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087349+0000","last_change":"2023-08-09T12:44:25.060055+0000","last_active":"2023-08-09T12:44:27.087349+0000","last_peered":"2023-08-09T12:44:27.087349+0000","last_clean":"2023-08-09T12:44:27.087349+0000","last_became_active":"2023-08-09T12:44:25.059550+0000","last_became_peered":"2023-08-09T12:44:25.059550+0000","last_unstale":"2023-08-09T12:44:27.087349+0000","last_undegraded":"2023-08-09T12:44:27.087349+0000","last_fullsized":"2023-08-09T12:44:27.087349+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:36:26.062627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.112223+0000","last_change":"2023-08-09T12:44:26.112145+0000","last_active":"2023-08-09T12:44:26.112223+0000","last_peered":"2023-08-09T12:44:26.112223+0000","last_clean":"2023-08-09T12:44:26.112223+0000","last_became_active":"2023-08-09T12:44:26.111896+0000","last_became_peered":"2023-08-09T12:44:26.111896+0000","last_unstale":"2023-08-09T12:44:26.112223+0000","last_undegraded":"2023-08-09T12:44:26.112223+0000","last_fullsized":"2023-08-09T12:44:26.112223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:20:15.448723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084660+0000","last_change":"2023-08-09T12:44:25.059555+0000","last_active":"2023-08-09T12:44:27.084660+0000","last_peered":"2023-08-09T12:44:27.084660+0000","last_clean":"2023-08-09T12:44:27.084660+0000","last_became_active":"2023-08-09T12:44:25.059309+0000","last_became_peered":"2023-08-09T12:44:25.059309+0000","last_unstale":"2023-08-09T12:44:27.084660+0000","last_undegraded":"2023-08-09T12:44:27.084660+0000","last_fullsized":"2023-08-09T12:44:27.084660+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:02:16.737561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.117758+0000","last_change":"2023-08-09T12:44:26.117452+0000","last_active":"2023-08-09T12:44:26.117758+0000","last_peered":"2023-08-09T12:44:26.117758+0000","last_clean":"2023-08-09T12:44:26.117758+0000","last_became_active":"2023-08-09T12:44:26.117147+0000","last_became_peered":"2023-08-09T12:44:26.117147+0000","last_unstale":"2023-08-09T12:44:26.117758+0000","last_undegraded":"2023-08-09T12:44:26.117758+0000","last_fullsized":"2023-08-09T12:44:26.117758+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:06.432408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086023+0000","last_change":"2023-08-09T12:44:25.057373+0000","last_active":"2023-08-09T12:44:27.086023+0000","last_peered":"2023-08-09T12:44:27.086023+0000","last_clean":"2023-08-09T12:44:27.086023+0000","last_became_active":"2023-08-09T12:44:25.057111+0000","last_became_peered":"2023-08-09T12:44:25.057111+0000","last_unstale":"2023-08-09T12:44:27.086023+0000","last_undegraded":"2023-08-09T12:44:27.086023+0000","last_fullsized":"2023-08-09T12:44:27.086023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:25.163624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084332+0000","last_change":"2023-08-09T12:44:26.112844+0000","last_active":"2023-08-09T12:44:27.084332+0000","last_peered":"2023-08-09T12:44:27.084332+0000","last_clean":"2023-08-09T12:44:27.084332+0000","last_became_active":"2023-08-09T12:44:26.110501+0000","last_became_peered":"2023-08-09T12:44:26.110501+0000","last_unstale":"2023-08-09T12:44:27.084332+0000","last_undegraded":"2023-08-09T12:44:27.084332+0000","last_fullsized":"2023-08-09T12:44:27.084332+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:46:57.054421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.099219+0000","last_change":"2023-08-09T12:44:25.063688+0000","last_active":"2023-08-09T12:44:26.099219+0000","last_peered":"2023-08-09T12:44:26.099219+0000","last_clean":"2023-08-09T12:44:26.099219+0000","last_became_active":"2023-08-09T12:44:25.063462+0000","last_became_peered":"2023-08-09T12:44:25.063462+0000","last_unstale":"2023-08-09T12:44:26.099219+0000","last_undegraded":"2023-08-09T12:44:26.099219+0000","last_fullsized":"2023-08-09T12:44:26.099219+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:26:08.918356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084746+0000","last_change":"2023-08-09T12:44:26.099046+0000","last_active":"2023-08-09T12:44:27.084746+0000","last_peered":"2023-08-09T12:44:27.084746+0000","last_clean":"2023-08-09T12:44:27.084746+0000","last_became_active":"2023-08-09T12:44:26.098025+0000","last_became_peered":"2023-08-09T12:44:26.098025+0000","last_unstale":"2023-08-09T12:44:27.084746+0000","last_undegraded":"2023-08-09T12:44:27.084746+0000","last_fullsized":"2023-08-09T12:44:27.084746+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:30:23.392512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084466+0000","last_change":"2023-08-09T12:44:25.059827+0000","last_active":"2023-08-09T12:44:27.084466+0000","last_peered":"2023-08-09T12:44:27.084466+0000","last_clean":"2023-08-09T12:44:27.084466+0000","last_became_active":"2023-08-09T12:44:25.059196+0000","last_became_peered":"2023-08-09T12:44:25.059196+0000","last_unstale":"2023-08-09T12:44:27.084466+0000","last_undegraded":"2023-08-09T12:44:27.084466+0000","last_fullsized":"2023-08-09T12:44:27.084466+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:45:45.019950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.103669+0000","last_change":"2023-08-09T12:44:26.103541+0000","last_active":"2023-08-09T12:44:26.103669+0000","last_peered":"2023-08-09T12:44:26.103669+0000","last_clean":"2023-08-09T12:44:26.103669+0000","last_became_active":"2023-08-09T12:44:26.102884+0000","last_became_peered":"2023-08-09T12:44:26.102884+0000","last_unstale":"2023-08-09T12:44:26.103669+0000","last_undegraded":"2023-08-09T12:44:26.103669+0000","last_fullsized":"2023-08-09T12:44:26.103669+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:01:34.451855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080582+0000","last_change":"2023-08-09T12:44:25.059129+0000","last_active":"2023-08-09T12:44:27.080582+0000","last_peered":"2023-08-09T12:44:27.080582+0000","last_clean":"2023-08-09T12:44:27.080582+0000","last_became_active":"2023-08-09T12:44:25.056919+0000","last_became_peered":"2023-08-09T12:44:25.056919+0000","last_unstale":"2023-08-09T12:44:27.080582+0000","last_undegraded":"2023-08-09T12:44:27.080582+0000","last_fullsized":"2023-08-09T12:44:27.080582+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:52:20.046690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087398+0000","last_change":"2023-08-09T12:44:26.111286+0000","last_active":"2023-08-09T12:44:27.087398+0000","last_peered":"2023-08-09T12:44:27.087398+0000","last_clean":"2023-08-09T12:44:27.087398+0000","last_became_active":"2023-08-09T12:44:26.110851+0000","last_became_peered":"2023-08-09T12:44:26.110851+0000","last_unstale":"2023-08-09T12:44:27.087398+0000","last_undegraded":"2023-08-09T12:44:27.087398+0000","last_fullsized":"2023-08-09T12:44:27.087398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:52:28.843708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087665+0000","last_change":"2023-08-09T12:44:25.060557+0000","last_active":"2023-08-09T12:44:27.087665+0000","last_peered":"2023-08-09T12:44:27.087665+0000","last_clean":"2023-08-09T12:44:27.087665+0000","last_became_active":"2023-08-09T12:44:25.060305+0000","last_became_peered":"2023-08-09T12:44:25.060305+0000","last_unstale":"2023-08-09T12:44:27.087665+0000","last_undegraded":"2023-08-09T12:44:27.087665+0000","last_fullsized":"2023-08-09T12:44:27.087665+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:06:10.332866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083532+0000","last_change":"2023-08-09T12:44:26.091961+0000","last_active":"2023-08-09T12:44:27.083532+0000","last_peered":"2023-08-09T12:44:27.083532+0000","last_clean":"2023-08-09T12:44:27.083532+0000","last_became_active":"2023-08-09T12:44:26.090723+0000","last_became_peered":"2023-08-09T12:44:26.090723+0000","last_unstale":"2023-08-09T12:44:27.083532+0000","last_undegraded":"2023-08-09T12:44:27.083532+0000","last_fullsized":"2023-08-09T12:44:27.083532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:23.402270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"91'3","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085772+0000","last_change":"2023-08-09T12:44:25.057716+0000","last_active":"2023-08-09T12:44:27.085772+0000","last_peered":"2023-08-09T12:44:27.085772+0000","last_clean":"2023-08-09T12:44:27.085772+0000","last_became_active":"2023-08-09T12:44:25.056565+0000","last_became_peered":"2023-08-09T12:44:25.056565+0000","last_unstale":"2023-08-09T12:44:27.085772+0000","last_undegraded":"2023-08-09T12:44:27.085772+0000","last_fullsized":"2023-08-09T12:44:27.085772+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:38:01.769643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.112255+0000","last_change":"2023-08-09T12:44:26.112089+0000","last_active":"2023-08-09T12:44:26.112255+0000","last_peered":"2023-08-09T12:44:26.112255+0000","last_clean":"2023-08-09T12:44:26.112255+0000","last_became_active":"2023-08-09T12:44:26.111460+0000","last_became_peered":"2023-08-09T12:44:26.111460+0000","last_unstale":"2023-08-09T12:44:26.112255+0000","last_undegraded":"2023-08-09T12:44:26.112255+0000","last_fullsized":"2023-08-09T12:44:26.112255+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:23:35.388519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"91'6","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085493+0000","last_change":"2023-08-09T12:44:25.056275+0000","last_active":"2023-08-09T12:44:27.085493+0000","last_peered":"2023-08-09T12:44:27.085493+0000","last_clean":"2023-08-09T12:44:27.085493+0000","last_became_active":"2023-08-09T12:44:25.055917+0000","last_became_peered":"2023-08-09T12:44:25.055917+0000","last_unstale":"2023-08-09T12:44:27.085493+0000","last_undegraded":"2023-08-09T12:44:27.085493+0000","last_fullsized":"2023-08-09T12:44:27.085493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:15:41.278405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086320+0000","last_change":"2023-08-09T12:44:26.100111+0000","last_active":"2023-08-09T12:44:27.086320+0000","last_peered":"2023-08-09T12:44:27.086320+0000","last_clean":"2023-08-09T12:44:27.086320+0000","last_became_active":"2023-08-09T12:44:26.099539+0000","last_became_peered":"2023-08-09T12:44:26.099539+0000","last_unstale":"2023-08-09T12:44:27.086320+0000","last_undegraded":"2023-08-09T12:44:27.086320+0000","last_fullsized":"2023-08-09T12:44:27.086320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:08:31.822535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.088395+0000","last_change":"2023-08-09T12:44:25.059513+0000","last_active":"2023-08-09T12:44:27.088395+0000","last_peered":"2023-08-09T12:44:27.088395+0000","last_clean":"2023-08-09T12:44:27.088395+0000","last_became_active":"2023-08-09T12:44:25.059230+0000","last_became_peered":"2023-08-09T12:44:25.059230+0000","last_unstale":"2023-08-09T12:44:27.088395+0000","last_undegraded":"2023-08-09T12:44:27.088395+0000","last_fullsized":"2023-08-09T12:44:27.088395+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:21.031949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085320+0000","last_change":"2023-08-09T12:44:26.098637+0000","last_active":"2023-08-09T12:44:27.085320+0000","last_peered":"2023-08-09T12:44:27.085320+0000","last_clean":"2023-08-09T12:44:27.085320+0000","last_became_active":"2023-08-09T12:44:26.097140+0000","last_became_peered":"2023-08-09T12:44:26.097140+0000","last_unstale":"2023-08-09T12:44:27.085320+0000","last_undegraded":"2023-08-09T12:44:27.085320+0000","last_fullsized":"2023-08-09T12:44:27.085320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:27:27.701607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.081211+0000","last_change":"2023-08-09T12:44:25.058820+0000","last_active":"2023-08-09T12:44:27.081211+0000","last_peered":"2023-08-09T12:44:27.081211+0000","last_clean":"2023-08-09T12:44:27.081211+0000","last_became_active":"2023-08-09T12:44:25.056210+0000","last_became_peered":"2023-08-09T12:44:25.056210+0000","last_unstale":"2023-08-09T12:44:27.081211+0000","last_undegraded":"2023-08-09T12:44:27.081211+0000","last_fullsized":"2023-08-09T12:44:27.081211+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:07.654395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086218+0000","last_change":"2023-08-09T12:44:26.106697+0000","last_active":"2023-08-09T12:44:27.086218+0000","last_peered":"2023-08-09T12:44:27.086218+0000","last_clean":"2023-08-09T12:44:27.086218+0000","last_became_active":"2023-08-09T12:44:26.106112+0000","last_became_peered":"2023-08-09T12:44:26.106112+0000","last_unstale":"2023-08-09T12:44:27.086218+0000","last_undegraded":"2023-08-09T12:44:27.086218+0000","last_fullsized":"2023-08-09T12:44:27.086218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:46.789365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084903+0000","last_change":"2023-08-09T12:44:25.054317+0000","last_active":"2023-08-09T12:44:27.084903+0000","last_peered":"2023-08-09T12:44:27.084903+0000","last_clean":"2023-08-09T12:44:27.084903+0000","last_became_active":"2023-08-09T12:44:25.053190+0000","last_became_peered":"2023-08-09T12:44:25.053190+0000","last_unstale":"2023-08-09T12:44:27.084903+0000","last_undegraded":"2023-08-09T12:44:27.084903+0000","last_fullsized":"2023-08-09T12:44:27.084903+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:34.927846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086832+0000","last_change":"2023-08-09T12:44:26.104941+0000","last_active":"2023-08-09T12:44:27.086832+0000","last_peered":"2023-08-09T12:44:27.086832+0000","last_clean":"2023-08-09T12:44:27.086832+0000","last_became_active":"2023-08-09T12:44:26.099960+0000","last_became_peered":"2023-08-09T12:44:26.099960+0000","last_unstale":"2023-08-09T12:44:27.086832+0000","last_undegraded":"2023-08-09T12:44:27.086832+0000","last_fullsized":"2023-08-09T12:44:27.086832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:58.836276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"91'8","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.121059+0000","last_change":"2023-08-09T12:44:25.058283+0000","last_active":"2023-08-09T12:44:26.121059+0000","last_peered":"2023-08-09T12:44:26.121059+0000","last_clean":"2023-08-09T12:44:26.121059+0000","last_became_active":"2023-08-09T12:44:25.058031+0000","last_became_peered":"2023-08-09T12:44:25.058031+0000","last_unstale":"2023-08-09T12:44:26.121059+0000","last_undegraded":"2023-08-09T12:44:26.121059+0000","last_fullsized":"2023-08-09T12:44:26.121059+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:54.357965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083959+0000","last_change":"2023-08-09T12:44:26.113280+0000","last_active":"2023-08-09T12:44:27.083959+0000","last_peered":"2023-08-09T12:44:27.083959+0000","last_clean":"2023-08-09T12:44:27.083959+0000","last_became_active":"2023-08-09T12:44:26.111178+0000","last_became_peered":"2023-08-09T12:44:26.111178+0000","last_unstale":"2023-08-09T12:44:27.083959+0000","last_undegraded":"2023-08-09T12:44:27.083959+0000","last_fullsized":"2023-08-09T12:44:27.083959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:13.871101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087960+0000","last_change":"2023-08-09T12:44:25.056092+0000","last_active":"2023-08-09T12:44:27.087960+0000","last_peered":"2023-08-09T12:44:27.087960+0000","last_clean":"2023-08-09T12:44:27.087960+0000","last_became_active":"2023-08-09T12:44:25.055690+0000","last_became_peered":"2023-08-09T12:44:25.055690+0000","last_unstale":"2023-08-09T12:44:27.087960+0000","last_undegraded":"2023-08-09T12:44:27.087960+0000","last_fullsized":"2023-08-09T12:44:27.087960+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:18:51.734975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085630+0000","last_change":"2023-08-09T12:44:26.104446+0000","last_active":"2023-08-09T12:44:27.085630+0000","last_peered":"2023-08-09T12:44:27.085630+0000","last_clean":"2023-08-09T12:44:27.085630+0000","last_became_active":"2023-08-09T12:44:26.099741+0000","last_became_peered":"2023-08-09T12:44:26.099741+0000","last_unstale":"2023-08-09T12:44:27.085630+0000","last_undegraded":"2023-08-09T12:44:27.085630+0000","last_fullsized":"2023-08-09T12:44:27.085630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:22:25.562201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.097440+0000","last_change":"2023-08-09T12:44:25.060898+0000","last_active":"2023-08-09T12:44:26.097440+0000","last_peered":"2023-08-09T12:44:26.097440+0000","last_clean":"2023-08-09T12:44:26.097440+0000","last_became_active":"2023-08-09T12:44:25.060600+0000","last_became_peered":"2023-08-09T12:44:25.060600+0000","last_unstale":"2023-08-09T12:44:26.097440+0000","last_undegraded":"2023-08-09T12:44:26.097440+0000","last_fullsized":"2023-08-09T12:44:26.097440+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:57:46.223981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084063+0000","last_change":"2023-08-09T12:44:26.105575+0000","last_active":"2023-08-09T12:44:27.084063+0000","last_peered":"2023-08-09T12:44:27.084063+0000","last_clean":"2023-08-09T12:44:27.084063+0000","last_became_active":"2023-08-09T12:44:26.103624+0000","last_became_peered":"2023-08-09T12:44:26.103624+0000","last_unstale":"2023-08-09T12:44:27.084063+0000","last_undegraded":"2023-08-09T12:44:27.084063+0000","last_fullsized":"2023-08-09T12:44:27.084063+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:53:02.341383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080331+0000","last_change":"2023-08-09T12:44:25.063535+0000","last_active":"2023-08-09T12:44:27.080331+0000","last_peered":"2023-08-09T12:44:27.080331+0000","last_clean":"2023-08-09T12:44:27.080331+0000","last_became_active":"2023-08-09T12:44:25.062661+0000","last_became_peered":"2023-08-09T12:44:25.062661+0000","last_unstale":"2023-08-09T12:44:27.080331+0000","last_undegraded":"2023-08-09T12:44:27.080331+0000","last_fullsized":"2023-08-09T12:44:27.080331+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:08:58.720302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.105338+0000","last_change":"2023-08-09T12:44:26.104499+0000","last_active":"2023-08-09T12:44:26.105338+0000","last_peered":"2023-08-09T12:44:26.105338+0000","last_clean":"2023-08-09T12:44:26.105338+0000","last_became_active":"2023-08-09T12:44:26.104144+0000","last_became_peered":"2023-08-09T12:44:26.104144+0000","last_unstale":"2023-08-09T12:44:26.105338+0000","last_undegraded":"2023-08-09T12:44:26.105338+0000","last_fullsized":"2023-08-09T12:44:26.105338+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:26.953923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080406+0000","last_change":"2023-08-09T12:44:25.055061+0000","last_active":"2023-08-09T12:44:27.080406+0000","last_peered":"2023-08-09T12:44:27.080406+0000","last_clean":"2023-08-09T12:44:27.080406+0000","last_became_active":"2023-08-09T12:44:25.054674+0000","last_became_peered":"2023-08-09T12:44:25.054674+0000","last_unstale":"2023-08-09T12:44:27.080406+0000","last_undegraded":"2023-08-09T12:44:27.080406+0000","last_fullsized":"2023-08-09T12:44:27.080406+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:05:45.825564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087296+0000","last_change":"2023-08-09T12:44:26.105258+0000","last_active":"2023-08-09T12:44:27.087296+0000","last_peered":"2023-08-09T12:44:27.087296+0000","last_clean":"2023-08-09T12:44:27.087296+0000","last_became_active":"2023-08-09T12:44:26.099679+0000","last_became_peered":"2023-08-09T12:44:26.099679+0000","last_unstale":"2023-08-09T12:44:27.087296+0000","last_undegraded":"2023-08-09T12:44:27.087296+0000","last_fullsized":"2023-08-09T12:44:27.087296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:18:52.640535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.087646+0000","last_change":"2023-08-09T12:44:25.057511+0000","last_active":"2023-08-09T12:44:27.087646+0000","last_peered":"2023-08-09T12:44:27.087646+0000","last_clean":"2023-08-09T12:44:27.087646+0000","last_became_active":"2023-08-09T12:44:25.057051+0000","last_became_peered":"2023-08-09T12:44:25.057051+0000","last_unstale":"2023-08-09T12:44:27.087646+0000","last_undegraded":"2023-08-09T12:44:27.087646+0000","last_fullsized":"2023-08-09T12:44:27.087646+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:23:16.538142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084742+0000","last_change":"2023-08-09T12:44:26.096313+0000","last_active":"2023-08-09T12:44:27.084742+0000","last_peered":"2023-08-09T12:44:27.084742+0000","last_clean":"2023-08-09T12:44:27.084742+0000","last_became_active":"2023-08-09T12:44:26.095716+0000","last_became_peered":"2023-08-09T12:44:26.095716+0000","last_unstale":"2023-08-09T12:44:27.084742+0000","last_undegraded":"2023-08-09T12:44:27.084742+0000","last_fullsized":"2023-08-09T12:44:27.084742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:37:55.461198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085585+0000","last_change":"2023-08-09T12:44:25.059728+0000","last_active":"2023-08-09T12:44:27.085585+0000","last_peered":"2023-08-09T12:44:27.085585+0000","last_clean":"2023-08-09T12:44:27.085585+0000","last_became_active":"2023-08-09T12:44:25.053851+0000","last_became_peered":"2023-08-09T12:44:25.053851+0000","last_unstale":"2023-08-09T12:44:27.085585+0000","last_undegraded":"2023-08-09T12:44:27.085585+0000","last_fullsized":"2023-08-09T12:44:27.085585+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:22:56.184316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.110608+0000","last_change":"2023-08-09T12:44:26.109940+0000","last_active":"2023-08-09T12:44:26.110608+0000","last_peered":"2023-08-09T12:44:26.110608+0000","last_clean":"2023-08-09T12:44:26.110608+0000","last_became_active":"2023-08-09T12:44:26.109194+0000","last_became_peered":"2023-08-09T12:44:26.109194+0000","last_unstale":"2023-08-09T12:44:26.110608+0000","last_undegraded":"2023-08-09T12:44:26.110608+0000","last_fullsized":"2023-08-09T12:44:26.110608+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:32.200904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085935+0000","last_change":"2023-08-09T12:44:25.057591+0000","last_active":"2023-08-09T12:44:27.085935+0000","last_peered":"2023-08-09T12:44:27.085935+0000","last_clean":"2023-08-09T12:44:27.085935+0000","last_became_active":"2023-08-09T12:44:25.057153+0000","last_became_peered":"2023-08-09T12:44:25.057153+0000","last_unstale":"2023-08-09T12:44:27.085935+0000","last_undegraded":"2023-08-09T12:44:27.085935+0000","last_fullsized":"2023-08-09T12:44:27.085935+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:47:54.882280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.083446+0000","last_change":"2023-08-09T12:44:26.083250+0000","last_active":"2023-08-09T12:44:26.083446+0000","last_peered":"2023-08-09T12:44:26.083446+0000","last_clean":"2023-08-09T12:44:26.083446+0000","last_became_active":"2023-08-09T12:44:26.082575+0000","last_became_peered":"2023-08-09T12:44:26.082575+0000","last_unstale":"2023-08-09T12:44:26.083446+0000","last_undegraded":"2023-08-09T12:44:26.083446+0000","last_fullsized":"2023-08-09T12:44:26.083446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:11.726432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.078686+0000","last_change":"2023-08-09T12:44:25.055000+0000","last_active":"2023-08-09T12:44:26.078686+0000","last_peered":"2023-08-09T12:44:26.078686+0000","last_clean":"2023-08-09T12:44:26.078686+0000","last_became_active":"2023-08-09T12:44:25.053863+0000","last_became_peered":"2023-08-09T12:44:25.053863+0000","last_unstale":"2023-08-09T12:44:26.078686+0000","last_undegraded":"2023-08-09T12:44:26.078686+0000","last_fullsized":"2023-08-09T12:44:26.078686+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:03:44.169795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079801+0000","last_change":"2023-08-09T12:44:26.083582+0000","last_active":"2023-08-09T12:44:27.079801+0000","last_peered":"2023-08-09T12:44:27.079801+0000","last_clean":"2023-08-09T12:44:27.079801+0000","last_became_active":"2023-08-09T12:44:26.082940+0000","last_became_peered":"2023-08-09T12:44:26.082940+0000","last_unstale":"2023-08-09T12:44:27.079801+0000","last_undegraded":"2023-08-09T12:44:27.079801+0000","last_fullsized":"2023-08-09T12:44:27.079801+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:40:37.168951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084495+0000","last_change":"2023-08-09T12:44:25.056943+0000","last_active":"2023-08-09T12:44:27.084495+0000","last_peered":"2023-08-09T12:44:27.084495+0000","last_clean":"2023-08-09T12:44:27.084495+0000","last_became_active":"2023-08-09T12:44:25.056406+0000","last_became_peered":"2023-08-09T12:44:25.056406+0000","last_unstale":"2023-08-09T12:44:27.084495+0000","last_undegraded":"2023-08-09T12:44:27.084495+0000","last_fullsized":"2023-08-09T12:44:27.084495+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:01.306917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":307,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.080568+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:44:27.080568+0000","last_peered":"2023-08-09T12:44:27.080568+0000","last_clean":"2023-08-09T12:44:27.080568+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:44:27.080568+0000","last_undegraded":"2023-08-09T12:44:27.080568+0000","last_fullsized":"2023-08-09T12:44:27.080568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:40:07.892416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086334+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:44:27.086334+0000","last_peered":"2023-08-09T12:44:27.086334+0000","last_clean":"2023-08-09T12:44:27.086334+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:44:27.086334+0000","last_undegraded":"2023-08-09T12:44:27.086334+0000","last_fullsized":"2023-08-09T12:44:27.086334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:07:49.738233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.109959+0000","last_change":"2023-08-09T12:44:26.109250+0000","last_active":"2023-08-09T12:44:26.109959+0000","last_peered":"2023-08-09T12:44:26.109959+0000","last_clean":"2023-08-09T12:44:26.109959+0000","last_became_active":"2023-08-09T12:44:26.108906+0000","last_became_peered":"2023-08-09T12:44:26.108906+0000","last_unstale":"2023-08-09T12:44:26.109959+0000","last_undegraded":"2023-08-09T12:44:26.109959+0000","last_fullsized":"2023-08-09T12:44:26.109959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:45:09.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084325+0000","last_change":"2023-08-09T12:44:25.056088+0000","last_active":"2023-08-09T12:44:27.084325+0000","last_peered":"2023-08-09T12:44:27.084325+0000","last_clean":"2023-08-09T12:44:27.084325+0000","last_became_active":"2023-08-09T12:44:25.055674+0000","last_became_peered":"2023-08-09T12:44:25.055674+0000","last_unstale":"2023-08-09T12:44:27.084325+0000","last_undegraded":"2023-08-09T12:44:27.084325+0000","last_fullsized":"2023-08-09T12:44:27.084325+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:57:46.223981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079868+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:44:27.079868+0000","last_peered":"2023-08-09T12:44:27.079868+0000","last_clean":"2023-08-09T12:44:27.079868+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:44:27.079868+0000","last_undegraded":"2023-08-09T12:44:27.079868+0000","last_fullsized":"2023-08-09T12:44:27.079868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:18:07.799063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084418+0000","last_change":"2023-08-09T12:44:26.107314+0000","last_active":"2023-08-09T12:44:27.084418+0000","last_peered":"2023-08-09T12:44:27.084418+0000","last_clean":"2023-08-09T12:44:27.084418+0000","last_became_active":"2023-08-09T12:44:26.106673+0000","last_became_peered":"2023-08-09T12:44:26.106673+0000","last_unstale":"2023-08-09T12:44:27.084418+0000","last_undegraded":"2023-08-09T12:44:27.084418+0000","last_fullsized":"2023-08-09T12:44:27.084418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:15.464543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083894+0000","last_change":"2023-08-09T12:44:25.060099+0000","last_active":"2023-08-09T12:44:27.083894+0000","last_peered":"2023-08-09T12:44:27.083894+0000","last_clean":"2023-08-09T12:44:27.083894+0000","last_became_active":"2023-08-09T12:44:25.059584+0000","last_became_peered":"2023-08-09T12:44:25.059584+0000","last_unstale":"2023-08-09T12:44:27.083894+0000","last_undegraded":"2023-08-09T12:44:27.083894+0000","last_fullsized":"2023-08-09T12:44:27.083894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:44:49.251455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085875+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:44:27.085875+0000","last_peered":"2023-08-09T12:44:27.085875+0000","last_clean":"2023-08-09T12:44:27.085875+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:44:27.085875+0000","last_undegraded":"2023-08-09T12:44:27.085875+0000","last_fullsized":"2023-08-09T12:44:27.085875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:29:49.903747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.105359+0000","last_change":"2023-08-09T12:44:26.105165+0000","last_active":"2023-08-09T12:44:26.105359+0000","last_peered":"2023-08-09T12:44:26.105359+0000","last_clean":"2023-08-09T12:44:26.105359+0000","last_became_active":"2023-08-09T12:44:26.104876+0000","last_became_peered":"2023-08-09T12:44:26.104876+0000","last_unstale":"2023-08-09T12:44:26.105359+0000","last_undegraded":"2023-08-09T12:44:26.105359+0000","last_fullsized":"2023-08-09T12:44:26.105359+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:23:35.388519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083872+0000","last_change":"2023-08-09T12:44:25.056378+0000","last_active":"2023-08-09T12:44:27.083872+0000","last_peered":"2023-08-09T12:44:27.083872+0000","last_clean":"2023-08-09T12:44:27.083872+0000","last_became_active":"2023-08-09T12:44:25.054551+0000","last_became_peered":"2023-08-09T12:44:25.054551+0000","last_unstale":"2023-08-09T12:44:27.083872+0000","last_undegraded":"2023-08-09T12:44:27.083872+0000","last_fullsized":"2023-08-09T12:44:27.083872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:54.357965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.088345+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:44:27.088345+0000","last_peered":"2023-08-09T12:44:27.088345+0000","last_clean":"2023-08-09T12:44:27.088345+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:44:27.088345+0000","last_undegraded":"2023-08-09T12:44:27.088345+0000","last_fullsized":"2023-08-09T12:44:27.088345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:25:44.977514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084660+0000","last_change":"2023-08-09T12:44:26.113526+0000","last_active":"2023-08-09T12:44:27.084660+0000","last_peered":"2023-08-09T12:44:27.084660+0000","last_clean":"2023-08-09T12:44:27.084660+0000","last_became_active":"2023-08-09T12:44:26.111233+0000","last_became_peered":"2023-08-09T12:44:26.111233+0000","last_unstale":"2023-08-09T12:44:27.084660+0000","last_undegraded":"2023-08-09T12:44:27.084660+0000","last_fullsized":"2023-08-09T12:44:27.084660+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:05:44.886152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083597+0000","last_change":"2023-08-09T12:44:25.056962+0000","last_active":"2023-08-09T12:44:27.083597+0000","last_peered":"2023-08-09T12:44:27.083597+0000","last_clean":"2023-08-09T12:44:27.083597+0000","last_became_active":"2023-08-09T12:44:25.056721+0000","last_became_peered":"2023-08-09T12:44:25.056721+0000","last_unstale":"2023-08-09T12:44:27.083597+0000","last_undegraded":"2023-08-09T12:44:27.083597+0000","last_fullsized":"2023-08-09T12:44:27.083597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:29.061687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.080656+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:44:26.080656+0000","last_peered":"2023-08-09T12:44:26.080656+0000","last_clean":"2023-08-09T12:44:26.080656+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:44:26.080656+0000","last_undegraded":"2023-08-09T12:44:26.080656+0000","last_fullsized":"2023-08-09T12:44:26.080656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:27.690537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083656+0000","last_change":"2023-08-09T12:44:26.110913+0000","last_active":"2023-08-09T12:44:27.083656+0000","last_peered":"2023-08-09T12:44:27.083656+0000","last_clean":"2023-08-09T12:44:27.083656+0000","last_became_active":"2023-08-09T12:44:26.110577+0000","last_became_peered":"2023-08-09T12:44:26.110577+0000","last_unstale":"2023-08-09T12:44:27.083656+0000","last_undegraded":"2023-08-09T12:44:27.083656+0000","last_fullsized":"2023-08-09T12:44:27.083656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:32.200904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.080278+0000","last_change":"2023-08-09T12:44:25.061700+0000","last_active":"2023-08-09T12:44:26.080278+0000","last_peered":"2023-08-09T12:44:26.080278+0000","last_clean":"2023-08-09T12:44:26.080278+0000","last_became_active":"2023-08-09T12:44:25.061370+0000","last_became_peered":"2023-08-09T12:44:25.061370+0000","last_unstale":"2023-08-09T12:44:26.080278+0000","last_undegraded":"2023-08-09T12:44:26.080278+0000","last_fullsized":"2023-08-09T12:44:26.080278+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:16:14.364263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079555+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:44:27.079555+0000","last_peered":"2023-08-09T12:44:27.079555+0000","last_clean":"2023-08-09T12:44:27.079555+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:44:27.079555+0000","last_undegraded":"2023-08-09T12:44:27.079555+0000","last_fullsized":"2023-08-09T12:44:27.079555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:43:59.057403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.083716+0000","last_change":"2023-08-09T12:44:26.092296+0000","last_active":"2023-08-09T12:44:27.083716+0000","last_peered":"2023-08-09T12:44:27.083716+0000","last_clean":"2023-08-09T12:44:27.083716+0000","last_became_active":"2023-08-09T12:44:26.091462+0000","last_became_peered":"2023-08-09T12:44:26.091462+0000","last_unstale":"2023-08-09T12:44:27.083716+0000","last_undegraded":"2023-08-09T12:44:27.083716+0000","last_fullsized":"2023-08-09T12:44:27.083716+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:26.953923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"91'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.079305+0000","last_change":"2023-08-09T12:44:25.063331+0000","last_active":"2023-08-09T12:44:27.079305+0000","last_peered":"2023-08-09T12:44:27.079305+0000","last_clean":"2023-08-09T12:44:27.079305+0000","last_became_active":"2023-08-09T12:44:25.062313+0000","last_became_peered":"2023-08-09T12:44:25.062313+0000","last_unstale":"2023-08-09T12:44:27.079305+0000","last_undegraded":"2023-08-09T12:44:27.079305+0000","last_fullsized":"2023-08-09T12:44:27.079305+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:23:47.665695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-09T12:44:26.083466+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:44:26.083466+0000","last_peered":"2023-08-09T12:44:26.083466+0000","last_clean":"2023-08-09T12:44:26.083466+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:44:26.083466+0000","last_undegraded":"2023-08-09T12:44:26.083466+0000","last_fullsized":"2023-08-09T12:44:26.083466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:11:20.192605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.084143+0000","last_change":"2023-08-09T12:44:26.107664+0000","last_active":"2023-08-09T12:44:27.084143+0000","last_peered":"2023-08-09T12:44:27.084143+0000","last_clean":"2023-08-09T12:44:27.084143+0000","last_became_active":"2023-08-09T12:44:26.107032+0000","last_became_peered":"2023-08-09T12:44:26.107032+0000","last_unstale":"2023-08-09T12:44:27.084143+0000","last_undegraded":"2023-08-09T12:44:27.084143+0000","last_fullsized":"2023-08-09T12:44:27.084143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:25.024630+0000","last_clean_scrub_stamp":"2023-08-09T12:44:25.024630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:17:41.489861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"91'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.085060+0000","last_change":"2023-08-09T12:44:25.054284+0000","last_active":"2023-08-09T12:44:27.085060+0000","last_peered":"2023-08-09T12:44:27.085060+0000","last_clean":"2023-08-09T12:44:27.085060+0000","last_became_active":"2023-08-09T12:44:25.053070+0000","last_became_peered":"2023-08-09T12:44:25.053070+0000","last_unstale":"2023-08-09T12:44:27.085060+0000","last_undegraded":"2023-08-09T12:44:27.085060+0000","last_fullsized":"2023-08-09T12:44:27.085060+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:44:24.020123+0000","last_clean_scrub_stamp":"2023-08-09T12:44:24.020123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:12.578503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-09T12:44:27.086421+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:44:27.086421+0000","last_peered":"2023-08-09T12:44:27.086421+0000","last_clean":"2023-08-09T12:44:27.086421+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:44:27.086421+0000","last_undegraded":"2023-08-09T12:44:27.086421+0000","last_fullsized":"2023-08-09T12:44:27.086421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:26:25.894705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1086,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194226,"statfs":{"total":200000000,"available":198887692,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1140000000000001,"15min":1.099},"min":{"1min":0.72499999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6359999999999999,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.02},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.1339999999999999,"15min":1.079},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.464,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.089}]},{"osd":1,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.1919999999999999,"15min":1.1100000000000001},"min":{"1min":0.70799999999999996,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1639999999999999,"15min":1.105},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.466,"5min":1.734,"15min":1.734},"last":0.97499999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.256,"15min":1.167},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.8100000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.96},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.147},"min":{"1min":0.83299999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.474,"5min":2.173,"15min":2.173},"last":1.5429999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.3029999999999999,"15min":1.2390000000000001},"min":{"1min":0.84699999999999998,"5min":0.746,"15min":0.746},"max":{"1min":3.4540000000000002,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3320000000000001,"15min":1.27},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.992,"5min":2.282,"15min":2.282},"last":1.843}]},{"osd":4,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.2270000000000001,"15min":1.2},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4930000000000001,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":2.6179999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3740000000000001,"15min":1.28},"min":{"1min":0.94799999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.5070000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.73}]},{"osd":5,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.393,"15min":1.2949999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1589999999999998,"5min":2.802,"15min":2.802},"last":2.1699999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4930000000000001,"15min":1.4790000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6819999999999999,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":2.7799999999999998}]},{"osd":6,"last update":"Wed Aug 9 12:44:21 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.472,"15min":1.464},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.764,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":2.8849999999999998},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.4750000000000001,"15min":1.4430000000000001},"min":{"1min":1.0289999999999999,"5min":0.623,"15min":0.623},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":2.3580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199483123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.171,"15min":1.1240000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.734,"5min":2.54,"15min":2.54},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1080000000000001,"15min":1.0660000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6020000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.59899999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2470000000000001,"15min":1.228},"min":{"1min":0.80400000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.696,"5min":2.306,"15min":2.306},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.385,"5min":1.361,"15min":1.3220000000000001},"min":{"1min":0.88900000000000001,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7450000000000001,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1499999999999999,"15min":1.101},"min":{"1min":0.82399999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.244,"5min":1.2969999999999999,"15min":1.2709999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.784,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.1779999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.329,"15min":1.2689999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3240000000000001,"15min":1.284},"min":{"1min":0.755,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.0589999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.4359999999999999,"15min":1.3280000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.796,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.107},{"interface":"front","average":{"1min":1.286,"5min":1.3959999999999999,"15min":1.3400000000000001},"min":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.8180000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.393,"15min":1.331},"min":{"1min":0.98799999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6639999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.462,"5min":1.552,"15min":1.48},"min":{"1min":1.0720000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.8799999999999999,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.256}]},{"osd":7,"last update":"Wed Aug 9 12:44:19 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.552,"15min":1.4239999999999999},"min":{"1min":1.0009999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.8700000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5469999999999999,"15min":1.4330000000000001},"min":{"1min":1.2609999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.8109999999999999,"5min":3.621,"15min":3.621},"last":0.94999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194809,"statfs":{"total":200000000,"available":199484701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.1319999999999999,"15min":1.117},"min":{"1min":0.879,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.5409999999999999,"5min":2.427,"15min":2.427},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.157,"15min":1.071},"min":{"1min":0.77000000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.1399999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3140000000000001,"15min":1.284},"min":{"1min":0.76100000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.6890000000000001,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":1.585},{"interface":"front","average":{"1min":1.286,"5min":1.2709999999999999,"15min":1.2430000000000001},"min":{"1min":0.80700000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6319999999999999,"5min":1.984,"15min":1.984},"last":1.51}]},{"osd":2,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2110000000000001,"15min":1.202},"min":{"1min":0.93700000000000006,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5760000000000001,"5min":1.861,"15min":1.861},"last":1.304},{"interface":"front","average":{"1min":1.175,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5089999999999999,"5min":1.728,"15min":1.728},"last":1.3580000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.268,"15min":1.1990000000000001},"min":{"1min":0.97099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7110000000000001,"5min":1.901,"15min":1.901},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.359,"15min":1.373},"min":{"1min":1.204,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6830000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.413}]},{"osd":4,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.226,"15min":1.224},"min":{"1min":0.79100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.839,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3300000000000001,"15min":1.3620000000000001},"min":{"1min":0.94799999999999995,"5min":0.628,"15min":0.628},"max":{"1min":2.0579999999999998,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.675}]},{"osd":6,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.347,"15min":1.331},"min":{"1min":0.92200000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7909999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4139999999999999,"15min":1.4850000000000001},"min":{"1min":0.91000000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9970000000000001,"5min":2.948,"15min":2.948},"last":1.615}]},{"osd":7,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":1.1619999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.1640000000000001,"5min":3.3250000000000002,"15min":3.3250000000000002},"last":1.782},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.52,"15min":1.508},"min":{"1min":1.175,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.8879999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.952}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":504,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194807,"statfs":{"total":200000000,"available":199483019,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1359999999999999,"15min":1.085},"min":{"1min":0.84099999999999997,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.581,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.339},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.161,"15min":1.1000000000000001},"min":{"1min":0.77200000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5860000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.2629999999999999,"15min":1.3400000000000001},"min":{"1min":0.94699999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.641,"5min":1.97,"15min":1.97},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.2889999999999999,"15min":1.325},"min":{"1min":0.83399999999999996,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5369999999999999,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.089}]},{"osd":2,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3220000000000001},"min":{"1min":0.70799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.708,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.331,"15min":1.3149999999999999},"min":{"1min":0.93500000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.673,"5min":1.929,"15min":1.929},"last":0.99199999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.27,"15min":1.224},"min":{"1min":0.78500000000000003,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.196},{"interface":"front","average":{"1min":1.252,"5min":1.3129999999999999,"15min":1.3320000000000001},"min":{"1min":0.93999999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.6160000000000001,"5min":2.081,"15min":2.081},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3260000000000001,"15min":1.385},"min":{"1min":0.86899999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.776,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.468},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4039999999999999,"15min":1.3899999999999999},"min":{"1min":0.97999999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7350000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.5}]},{"osd":6,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.419,"15min":1.4930000000000001},"min":{"1min":1.0389999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.825,"5min":2.238,"15min":2.238},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.51,"15min":1.534},"min":{"1min":1.05,"5min":0.755,"15min":0.755},"max":{"1min":1.869,"5min":2.036,"15min":2.036},"last":1.8200000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:44:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.5569999999999999,"15min":1.53},"min":{"1min":1.1240000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.9139999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.595,"5min":1.575,"15min":1.627},"min":{"1min":1.3340000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.946,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.7589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199484153,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.86499999999999999,"15min":0.82699999999999996},"min":{"1min":0.45300000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.95199999999999996,"15min":0.88400000000000001},"min":{"1min":0.52100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.7,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.71899999999999997}]},{"osd":1,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88200000000000001,"15min":0.89600000000000002},"min":{"1min":0.51300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5760000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":0.98899999999999999,"15min":0.89500000000000002},"min":{"1min":0.60099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.5509999999999999,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.995}]},{"osd":2,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2729999999999999,"15min":1.0980000000000001},"min":{"1min":0.57099999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.6759999999999999,"5min":18.145,"15min":18.145},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.171,"5min":1.1699999999999999,"15min":1.1890000000000001},"min":{"1min":0.53800000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.468,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.329,"15min":1.333},"min":{"1min":0.87,"5min":0.745,"15min":0.745},"max":{"1min":2.859,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.319,"15min":1.339},"min":{"1min":0.89300000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6719999999999999,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.087}]},{"osd":5,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.569,"15min":1.4410000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7709999999999999,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4950000000000001,"15min":1.3280000000000001},"min":{"1min":0.83499999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":3.0419999999999998,"5min":14.105,"15min":14.105},"last":1.073}]},{"osd":6,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3580000000000001,"15min":1.3360000000000001},"min":{"1min":0.97399999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.762,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.468,"15min":1.48},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8700000000000001,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.1719999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:43:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":0.91700000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8200000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.393,"15min":1.367},"min":{"1min":0.85699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.746,"5min":3.016,"15min":3.016},"last":1.1499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":503,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194808,"statfs":{"total":200000000,"available":199483993,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.60199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.391,"5min":1.716,"15min":1.716},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":0.93999999999999995,"15min":0.95499999999999996},"min":{"1min":0.53800000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.617,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.123}]},{"osd":1,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.93500000000000005,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.371,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.87},{"interface":"front","average":{"1min":1.125,"5min":1.0389999999999999,"15min":1.0549999999999999},"min":{"1min":0.70199999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.641,"5min":1.869,"15min":1.869},"last":1.6399999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1539999999999999,"15min":1.1679999999999999},"min":{"1min":0.63200000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.52,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.155,"15min":1.147},"min":{"1min":0.65800000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.0469999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.421,"15min":1.4099999999999999},"min":{"1min":1.044,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.7629999999999999,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.3260000000000001,"15min":1.27},"min":{"1min":1.036,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.829,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.361}]},{"osd":5,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.419,"15min":1.359},"min":{"1min":0.90400000000000003,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7929999999999999,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.474,"15min":1.478},"min":{"1min":1.004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.667,"5min":4.806,"15min":4.806},"last":1.4279999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.331,"15min":1.2989999999999999},"min":{"1min":0.98199999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7490000000000001,"5min":2.323,"15min":2.323},"last":1.476},{"interface":"front","average":{"1min":1.532,"5min":1.4379999999999999,"15min":1.4179999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.177,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.393}]},{"osd":7,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.381,"15min":1.357},"min":{"1min":0.92300000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9410000000000001,"5min":2.218,"15min":2.218},"last":1.228},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.5429999999999999,"15min":1.53},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.1150000000000002,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.532}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":496,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194816,"statfs":{"total":200000000,"available":199491863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.875,"15min":0.88700000000000001},"min":{"1min":0.45200000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.609,"5min":1.881,"15min":1.881},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.982,"15min":1.2310000000000001},"min":{"1min":0.70899999999999996,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.373,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.68999999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.028,"15min":0.94899999999999995},"min":{"1min":0.64700000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9390000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.355,"5min":1.252,"15min":1.129},"min":{"1min":0.622,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0449999999999999,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":2.044}]},{"osd":3,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.1599999999999999,"15min":1.0880000000000001},"min":{"1min":0.57999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7130000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.587},{"interface":"front","average":{"1min":1.232,"5min":1.1339999999999999,"15min":0.96099999999999997},"min":{"1min":0.77700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.659,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.57299999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.5409999999999999,"15min":1.288},"min":{"1min":0.92700000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6679999999999999,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.008},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.365,"15min":1.2969999999999999},"min":{"1min":0.93200000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":2.1589999999999998}]},{"osd":5,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.653,"15min":1.3939999999999999},"min":{"1min":0.89400000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.649,"5min":28.710000000000001,"15min":28.710000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.363,"15min":1.2789999999999999},"min":{"1min":1.0649999999999999,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.629,"5min":3.762,"15min":3.762},"last":0.91800000000000004}]},{"osd":6,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.522,"15min":1.423},"min":{"1min":1.0900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.7729999999999999,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.454,"15min":1.375},"min":{"1min":0.873,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8200000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.7929999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:44:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.841,"15min":1.579},"min":{"1min":1.119,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.4769999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":2.5089999999999999},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.849,"15min":1.5589999999999999},"min":{"1min":1.1599999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.887,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.246}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1072,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194239,"statfs":{"total":200000000,"available":198901495,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89000000000000001,"15min":0.86599999999999999},"min":{"1min":0.56799999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.288,"5min":1.819,"15min":1.819},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.0609999999999999,"15min":0.95099999999999996},"min":{"1min":0.60299999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.6699999999999999,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":1.5629999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.998,"15min":0.95199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6659999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.1220000000000001,"15min":1.0249999999999999},"min":{"1min":0.57999999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.411,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":1.103}]},{"osd":3,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0549999999999999,"15min":0.93500000000000005},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.5469999999999999,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.1990000000000001,"15min":1.177},"min":{"1min":0.84899999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.51,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.871}]},{"osd":4,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.377,"15min":1.333},"min":{"1min":0.874,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.819,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.331,"15min":1.2789999999999999},"min":{"1min":0.78600000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.782,"5min":1.806,"15min":1.806},"last":1.3129999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3779999999999999,"15min":1.302},"min":{"1min":0.98099999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.758,"5min":10.004,"15min":10.004},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4059999999999999,"15min":1.377},"min":{"1min":0.90200000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.887,"5min":2.161,"15min":2.161},"last":1.3819999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4199999999999999,"15min":1.3360000000000001},"min":{"1min":1.163,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.2000000000000002,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.355},{"interface":"front","average":{"1min":1.462,"5min":1.506,"15min":1.4259999999999999},"min":{"1min":1.131,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.794,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.0609999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:44:18 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5840000000000001,"15min":1.431},"min":{"1min":1.111,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2909999999999999,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.27},{"interface":"front","average":{"1min":1.5349999999999999,"5min":1.546,"15min":1.456},"min":{"1min":1.103,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.9450000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.22}]}]}],"pool_statfs":[]}} 2023-08-09T12:44:31.137 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:44:31.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:44:31.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.412+0000 7f7a9574f640 1 Processor -- start 2023-08-09T12:44:31.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.412+0000 7f7a9574f640 1 -- start start 2023-08-09T12:44:31.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.413+0000 7f7a9574f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cb40 0x7f7a901609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a9574f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a900b8420 0x7f7a900cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a9574f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7a9015cf20 0x7f7a900cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a9574f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a900d0f00 con 0x7f7a9015cf20 2023-08-09T12:44:31.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a9574f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a901611f0 con 0x7f7a900b8420 2023-08-09T12:44:31.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a9574f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a901614d0 con 0x7f7a9015cb40 2023-08-09T12:44:31.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a94f4e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7a9015cf20 0x7f7a900cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a94f4e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7a9015cf20 0x7f7a900cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49904/0 (socket says 172.21.15.17:49904) 2023-08-09T12:44:31.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a94f4e640 1 -- 172.21.15.17:0/1134422828 learned_addr learned my addr 172.21.15.17:0/1134422828 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:31.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a8ffff640 1 --2- 172.21.15.17:0/1134422828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cb40 0x7f7a901609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.414+0000 7f7a8f7fe640 1 --2- 172.21.15.17:0/1134422828 >> v2:172.21.15.142:3300/0 conn(0x7f7a900b8420 0x7f7a900cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.415+0000 7f7a94f4e640 1 -- 172.21.15.17:0/1134422828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cb40 msgr2=0x7f7a901609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:31.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.415+0000 7f7a94f4e640 1 --2- 172.21.15.17:0/1134422828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cb40 0x7f7a901609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.415+0000 7f7a94f4e640 1 -- 172.21.15.17:0/1134422828 >> v2:172.21.15.142:3300/0 conn(0x7f7a900b8420 msgr2=0x7f7a900cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:31.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.415+0000 7f7a94f4e640 1 --2- 172.21.15.17:0/1134422828 >> v2:172.21.15.142:3300/0 conn(0x7f7a900b8420 0x7f7a900cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.415+0000 7f7a94f4e640 1 -- 172.21.15.17:0/1134422828 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a901617b0 con 0x7f7a9015cf20 2023-08-09T12:44:31.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.416+0000 7f7a94f4e640 1 --2- 172.21.15.17:0/1134422828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9015cf20 0x7f7a900cdda0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7a9006a830 tx=0x7f7a8802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e0419576632d33 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:31.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.416+0000 7f7a8effd640 1 -- 172.21.15.17:0/1134422828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8802cb00 con 0x7f7a9015cf20 2023-08-09T12:44:31.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.416+0000 7f7a8effd640 1 -- 172.21.15.17:0/1134422828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8802cc60 con 0x7f7a9015cf20 2023-08-09T12:44:31.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.416+0000 7f7a8effd640 1 -- 172.21.15.17:0/1134422828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a880343f0 con 0x7f7a9015cf20 2023-08-09T12:44:31.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 -- 172.21.15.17:0/1134422828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9015cf20 msgr2=0x7f7a900cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 --2- 172.21.15.17:0/1134422828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9015cf20 0x7f7a900cdda0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7a9006a830 tx=0x7f7a8802bf60 comp rx=0 tx=0).stop 2023-08-09T12:44:31.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 -- 172.21.15.17:0/1134422828 shutdown_connections 2023-08-09T12:44:31.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 --2- 172.21.15.17:0/1134422828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9015cf20 0x7f7a900cdda0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 --2- 172.21.15.17:0/1134422828 >> v2:172.21.15.142:3300/0 conn(0x7f7a900b8420 0x7f7a900cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 --2- 172.21.15.17:0/1134422828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cb40 0x7f7a901609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 -- 172.21.15.17:0/1134422828 >> 172.21.15.17:0/1134422828 conn(0x7f7a900d2ab0 msgr2=0x7f7a900d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:31.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 -- 172.21.15.17:0/1134422828 shutdown_connections 2023-08-09T12:44:31.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.417+0000 7f7a9574f640 1 -- 172.21.15.17:0/1134422828 wait complete. 2023-08-09T12:44:31.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.419+0000 7f7a9574f640 1 Processor -- start 2023-08-09T12:44:31.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.419+0000 7f7a9574f640 1 -- start start 2023-08-09T12:44:31.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a9574f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a900b8420 0x7f7a90148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a9574f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a9015cb40 0x7f7a900c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a9574f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cf20 0x7f7a900cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a9574f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90149450 con 0x7f7a900b8420 2023-08-09T12:44:31.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a9574f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a900ca460 con 0x7f7a9015cb40 2023-08-09T12:44:31.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a9574f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a900ca740 con 0x7f7a9015cf20 2023-08-09T12:44:31.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a900b8420 0x7f7a90148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a900b8420 0x7f7a90148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49910/0 (socket says 172.21.15.17:49910) 2023-08-09T12:44:31.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.420+0000 7f7a8ffff640 1 -- 172.21.15.17:0/2458186352 learned_addr learned my addr 172.21.15.17:0/2458186352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:31.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8ffff640 1 -- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cf20 msgr2=0x7f7a900cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8ffff640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cf20 0x7f7a900cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8ffff640 1 -- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a9015cb40 msgr2=0x7f7a900c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8ffff640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a9015cb40 0x7f7a900c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8ffff640 1 -- 172.21.15.17:0/2458186352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a88009b30 con 0x7f7a900b8420 2023-08-09T12:44:31.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8ffff640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a900b8420 0x7f7a90148f10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000d800 tx=0x7f7a8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:31.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8cff9640 1 -- 172.21.15.17:0/2458186352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000b6c0 con 0x7f7a900b8420 2023-08-09T12:44:31.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8cff9640 1 -- 172.21.15.17:0/2458186352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000b820 con 0x7f7a900b8420 2023-08-09T12:44:31.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a8cff9640 1 -- 172.21.15.17:0/2458186352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000bb90 con 0x7f7a900b8420 2023-08-09T12:44:31.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.421+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a900caa20 con 0x7f7a900b8420 2023-08-09T12:44:31.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.422+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a900cafe0 con 0x7f7a900b8420 2023-08-09T12:44:31.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.423+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a900cb1a0 con 0x7f7a900b8420 2023-08-09T12:44:31.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.424+0000 7f7a8cff9640 1 -- 172.21.15.17:0/2458186352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7a8000bcf0 con 0x7f7a900b8420 2023-08-09T12:44:31.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.425+0000 7f7a8cff9640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7a7c06a050 0x7f7a7c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.425+0000 7f7a8cff9640 1 -- 172.21.15.17:0/2458186352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a80088bd0 con 0x7f7a900b8420 2023-08-09T12:44:31.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.425+0000 7f7a8f7fe640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7a7c06a050 0x7f7a7c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.427+0000 7f7a8f7fe640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7a7c06a050 0x7f7a7c06c510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a84006fd0 tx=0x7f7a84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:31.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.429+0000 7f7a8cff9640 1 -- 172.21.15.17:0/2458186352 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7a80057cb0 con 0x7f7a900b8420 2023-08-09T12:44:31.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.697+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7a9004e390 con 0x7f7a900b8420 2023-08-09T12:44:31.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.704+0000 7f7a8cff9640 1 -- 172.21.15.17:0/2458186352 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7a80057840 con 0x7f7a900b8420 2023-08-09T12:44:31.708 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:44:31.708 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:44:31.709 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:44:31.709 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:44:31.709 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:44:31.710 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:44:31.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7a7c06a050 msgr2=0x7f7a7c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7a7c06a050 0x7f7a7c06c510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a84006fd0 tx=0x7f7a84008040 comp rx=0 tx=0).stop 2023-08-09T12:44:31.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a900b8420 msgr2=0x7f7a90148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a900b8420 0x7f7a90148f10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000d800 tx=0x7f7a8000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 shutdown_connections 2023-08-09T12:44:31.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7a7c06a050 0x7f7a7c06c510 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a9015cf20 0x7f7a900cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a9015cb40 0x7f7a900c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 --2- 172.21.15.17:0/2458186352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a900b8420 0x7f7a90148f10 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 >> 172.21.15.17:0/2458186352 conn(0x7f7a900d2ab0 msgr2=0x7f7a90155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:31.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.707+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 shutdown_connections 2023-08-09T12:44:31.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.708+0000 7f7a9574f640 1 -- 172.21.15.17:0/2458186352 wait complete. 2023-08-09T12:44:31.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:44:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.951+0000 7f749228a640 1 Processor -- start 2023-08-09T12:44:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.951+0000 7f749228a640 1 -- start start 2023-08-09T12:44:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.952+0000 7f749228a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 0x7f748c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.952+0000 7f749228a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0b5a30 con 0x7f748c0cfb50 2023-08-09T12:44:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.952+0000 7f749228a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0d0d70 con 0x7f748c0b86e0 2023-08-09T12:44:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.952+0000 7f749228a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0d1110 con 0x7f748c160030 2023-08-09T12:44:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.953+0000 7f7491a89640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f748c0cfb50 0x7f748c0d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57134/0 (socket says 172.21.15.17:57134) 2023-08-09T12:44:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.953+0000 7f7491a89640 1 -- 172.21.15.17:0/3173754832 learned_addr learned my addr 172.21.15.17:0/3173754832 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.953+0000 7f7491288640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 0x7f748c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.953+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198759414 0 0) 0x7f748c0b5a30 con 0x7f748c0cfb50 2023-08-09T12:44:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.953+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7478003520 con 0x7f748c0cfb50 2023-08-09T12:44:31.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1167225991 0 0) 0x7f7478003520 con 0x7f748c0cfb50 2023-08-09T12:44:31.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 msgr2=0x7f748c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:31.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 0x7f748c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 >> v1:172.21.15.142:6789/0 conn(0x7f748c0b86e0 legacy=0x7f748c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c160f70 con 0x7f748c0cfb50 2023-08-09T12:44:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7491288640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 0x7f748c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:44:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f7484001670 con 0x7f748c0cfb50 2023-08-09T12:44:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 >> v1:172.21.15.17:6789/0 conn(0x7f748c0cfb50 legacy=0x7f748c0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74780039a0 0x7f7478003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 0x7f74780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478004d00 0x7f7478005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0d1110 con 0x7f7478004d00 2023-08-09T12:44:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747800b980 con 0x7f74780039a0 2023-08-09T12:44:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747800baf0 con 0x7f748c160030 2023-08-09T12:44:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.954+0000 7f7491a89640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478004d00 0x7f7478005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.955+0000 7f7491288640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74780039a0 0x7f7478003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.955+0000 7f7490a87640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 0x7f74780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.955+0000 7f7491a89640 1 -- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 msgr2=0x7f74780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.955+0000 7f7491a89640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c160030 0x7f74780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.955+0000 7f7491a89640 1 -- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74780039a0 msgr2=0x7f7478003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.955+0000 7f7491a89640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74780039a0 0x7f7478003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.955+0000 7f7491a89640 1 -- 172.21.15.17:0/3173754832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009a70 con 0x7f7478004d00 2023-08-09T12:44:31.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.956+0000 7f7491a89640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478004d00 0x7f7478005180 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f748c06a560 tx=0x7f74780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cec93bbcc2aa1a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:31.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.956+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484005ad0 con 0x7f7478004d00 2023-08-09T12:44:31.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.956+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484005c50 con 0x7f7478004d00 2023-08-09T12:44:31.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.956+0000 7f7483fff640 1 -- 172.21.15.17:0/3173754832 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748402c7d0 con 0x7f7478004d00 2023-08-09T12:44:31.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.957+0000 7f749228a640 1 -- 172.21.15.17:0/3173754832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478004d00 msgr2=0x7f7478005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.957+0000 7f749228a640 1 --2- 172.21.15.17:0/3173754832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478004d00 0x7f7478005180 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f748c06a560 tx=0x7f74780057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.957+0000 7f7491a89640 1 -- 172.21.15.17:0/3173754832 reap_dead start 2023-08-09T12:44:31.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.957+0000 7f749228a640 1 -- 172.21.15.17:0/3173754832 shutdown_connections 2023-08-09T12:44:31.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.957+0000 7f749228a640 1 -- 172.21.15.17:0/3173754832 >> 172.21.15.17:0/3173754832 conn(0x7f748c0697c0 msgr2=0x7f748c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:31.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.957+0000 7f749228a640 1 -- 172.21.15.17:0/3173754832 shutdown_connections 2023-08-09T12:44:31.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.957+0000 7f749228a640 1 -- 172.21.15.17:0/3173754832 wait complete. 2023-08-09T12:44:31.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.959+0000 7f749228a640 1 Processor -- start 2023-08-09T12:44:31.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.959+0000 7f749228a640 1 -- start start 2023-08-09T12:44:31.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f749228a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7478004d00 0x7f748c0b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f749228a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c153560 0x7f748c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f749228a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c15a2c0 0x7f748c15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f749228a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1f6c70 con 0x7f748c15a2c0 2023-08-09T12:44:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f749228a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c15a740 con 0x7f7478004d00 2023-08-09T12:44:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f749228a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1f5da0 con 0x7f748c153560 2023-08-09T12:44:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f7491a89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c15a2c0 0x7f748c15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f7491a89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c15a2c0 0x7f748c15b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49930/0 (socket says 172.21.15.17:49930) 2023-08-09T12:44:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.960+0000 7f7491a89640 1 -- 172.21.15.17:0/669410163 learned_addr learned my addr 172.21.15.17:0/669410163 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7490a87640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c153560 0x7f748c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7491288640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7478004d00 0x7f748c0b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7491a89640 1 -- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c153560 msgr2=0x7f748c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7491a89640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c153560 0x7f748c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7491a89640 1 -- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7478004d00 msgr2=0x7f748c0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:31.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7491a89640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7478004d00 0x7f748c0b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:31.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7491a89640 1 -- 172.21.15.17:0/669410163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c1f5ff0 con 0x7f748c15a2c0 2023-08-09T12:44:31.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7490a87640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c153560 0x7f748c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:31.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.961+0000 7f7491a89640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c15a2c0 0x7f748c15b8f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f748400c220 tx=0x7f748402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:31.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.962+0000 7f7481ffb640 1 -- 172.21.15.17:0/669410163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748403c040 con 0x7f748c15a2c0 2023-08-09T12:44:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.962+0000 7f7481ffb640 1 -- 172.21.15.17:0/669410163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748402cbe0 con 0x7f748c15a2c0 2023-08-09T12:44:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.962+0000 7f7481ffb640 1 -- 172.21.15.17:0/669410163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484007070 con 0x7f748c15a2c0 2023-08-09T12:44:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.962+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c1f62d0 con 0x7f748c15a2c0 2023-08-09T12:44:31.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.962+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c1f6890 con 0x7f748c15a2c0 2023-08-09T12:44:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.963+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c04e390 con 0x7f748c15a2c0 2023-08-09T12:44:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.964+0000 7f7481ffb640 1 -- 172.21.15.17:0/669410163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7484032070 con 0x7f748c15a2c0 2023-08-09T12:44:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.965+0000 7f7481ffb640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f747006a080 0x7f747006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.965+0000 7f7481ffb640 1 -- 172.21.15.17:0/669410163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74840a9150 con 0x7f748c15a2c0 2023-08-09T12:44:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.966+0000 7f7491288640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f747006a080 0x7f747006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:31.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.967+0000 7f7491288640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f747006a080 0x7f747006c540 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7488007520 tx=0x7f748800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:31.969+0000 7f7481ffb640 1 -- 172.21.15.17:0/669410163 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7484074830 con 0x7f748c15a2c0 2023-08-09T12:44:32.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.208+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f748c0d0640 con 0x7f748c15a2c0 2023-08-09T12:44:32.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.209+0000 7f7481ffb640 1 -- 172.21.15.17:0/669410163 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f7484077e50 con 0x7f748c15a2c0 2023-08-09T12:44:32.213 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:32.213 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2093028023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2093028023},{"type":"v1","addr":"172.21.15.142:6835","nonce":2093028023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2762526663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2762526663},{"type":"v1","addr":"172.21.15.142:6837","nonce":2762526663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2544978987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2544978987},{"type":"v1","addr":"172.21.15.17:6834","nonce":2544978987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:44:25.543433+0000","modified":"2023-08-09T12:44:29.110856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4077789912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4077789912},{"type":"v1","addr":"172.21.15.17:6835","nonce":4077789912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-09T12:44:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 43 2023-08-09T12:44:32.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f747006a080 msgr2=0x7f747006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f747006a080 0x7f747006c540 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7488007520 tx=0x7f748800b040 comp rx=0 tx=0).stop 2023-08-09T12:44:32.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c15a2c0 msgr2=0x7f748c15b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c15a2c0 0x7f748c15b8f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f748400c220 tx=0x7f748402e070 comp rx=0 tx=0).stop 2023-08-09T12:44:32.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 shutdown_connections 2023-08-09T12:44:32.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f747006a080 0x7f747006c540 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c15a2c0 0x7f748c15b8f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748c153560 0x7f748c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 --2- 172.21.15.17:0/669410163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7478004d00 0x7f748c0b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 >> 172.21.15.17:0/669410163 conn(0x7f748c0697c0 msgr2=0x7f748c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:32.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 shutdown_connections 2023-08-09T12:44:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.212+0000 7f749228a640 1 -- 172.21.15.17:0/669410163 wait complete. 2023-08-09T12:44:32.636 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:44:25.543433+0000', 'modified': '2023-08-09T12:44:29.110856+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6585}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6585': {'gid': 6585, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/4077789912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 4077789912}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 4077789912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:44:32.637 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:44:32.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-09T12:44:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.874+0000 7fee51e71640 1 Processor -- start 2023-08-09T12:44:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.874+0000 7fee51e71640 1 -- start start 2023-08-09T12:44:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.876+0000 7fee51e71640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee4c163c10 0x7fee4c166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.876+0000 7fee51e71640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c06c990 con 0x7fee4c0adc40 2023-08-09T12:44:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.876+0000 7fee51e71640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0b2250 con 0x7fee4c0b3b40 2023-08-09T12:44:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.876+0000 7fee51e71640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0ae020 con 0x7fee4c163c10 2023-08-09T12:44:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.876+0000 7fee4bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee4c163c10 0x7fee4c166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.876+0000 7fee4bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee4c163c10 0x7fee4c166000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49942/0 (socket says 172.21.15.17:49942) 2023-08-09T12:44:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.876+0000 7fee4bfff640 1 -- 172.21.15.17:0/822715559 learned_addr learned my addr 172.21.15.17:0/822715559 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.876+0000 7fee4b7fe640 1 --1- 172.21.15.17:0/822715559 >> v1:172.21.15.17:6789/0 conn(0x7fee4c0adc40 0x7fee4c06c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57138/0 (socket says 172.21.15.17:57138) 2023-08-09T12:44:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.877+0000 7fee4bfff640 1 -- 172.21.15.17:0/822715559 >> v1:172.21.15.142:6789/0 conn(0x7fee4c0b3b40 legacy=0x7fee4c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.877+0000 7fee4bfff640 1 -- 172.21.15.17:0/822715559 >> v1:172.21.15.17:6789/0 conn(0x7fee4c0adc40 legacy=0x7fee4c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.877+0000 7fee4bfff640 1 -- 172.21.15.17:0/822715559 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0b2530 con 0x7fee4c163c10 2023-08-09T12:44:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.877+0000 7fee4affd640 1 -- 172.21.15.17:0/822715559 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084832430 0 0) 0x7fee4c06c990 con 0x7fee4c0adc40 2023-08-09T12:44:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.878+0000 7fee4bfff640 1 --2- 172.21.15.17:0/822715559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c163c10 0x7fee4c166000 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fee44009870 tx=0x7fee4402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa0ef114d13f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.878+0000 7fee4affd640 1 -- 172.21.15.17:0/822715559 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44030860 con 0x7fee4c163c10 2023-08-09T12:44:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.878+0000 7fee4affd640 1 -- 172.21.15.17:0/822715559 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee440309c0 con 0x7fee4c163c10 2023-08-09T12:44:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.878+0000 7fee4affd640 1 -- 172.21.15.17:0/822715559 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44030d50 con 0x7fee4c163c10 2023-08-09T12:44:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.879+0000 7fee51e71640 1 -- 172.21.15.17:0/822715559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c163c10 msgr2=0x7fee4c166000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.879+0000 7fee51e71640 1 --2- 172.21.15.17:0/822715559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c163c10 0x7fee4c166000 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fee44009870 tx=0x7fee4402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.879+0000 7fee51e71640 1 -- 172.21.15.17:0/822715559 shutdown_connections 2023-08-09T12:44:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.879+0000 7fee51e71640 1 --2- 172.21.15.17:0/822715559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c163c10 0x7fee4c166000 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.879+0000 7fee51e71640 1 -- 172.21.15.17:0/822715559 >> 172.21.15.17:0/822715559 conn(0x7fee4c0cb1b0 msgr2=0x7fee4c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.879+0000 7fee51e71640 1 -- 172.21.15.17:0/822715559 shutdown_connections 2023-08-09T12:44:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.879+0000 7fee51e71640 1 -- 172.21.15.17:0/822715559 wait complete. 2023-08-09T12:44:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.881+0000 7fee51e71640 1 Processor -- start 2023-08-09T12:44:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.881+0000 7fee51e71640 1 -- start start 2023-08-09T12:44:32.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.882+0000 7fee51e71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c0adc40 0x7fee4c0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.882+0000 7fee51e71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee4c0b3b40 0x7fee4c06a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.882+0000 7fee51e71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee4c163c10 0x7fee4c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.882+0000 7fee51e71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c8cf0 con 0x7fee4c0adc40 2023-08-09T12:44:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.882+0000 7fee51e71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c06b7e0 con 0x7fee4c0b3b40 2023-08-09T12:44:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.882+0000 7fee51e71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c8f00 con 0x7fee4c163c10 2023-08-09T12:44:32.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c0adc40 0x7fee4c0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c0adc40 0x7fee4c0acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49948/0 (socket says 172.21.15.17:49948) 2023-08-09T12:44:32.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 -- 172.21.15.17:0/1891079099 learned_addr learned my addr 172.21.15.17:0/1891079099 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:32.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 -- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee4c163c10 msgr2=0x7fee4c15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee4c163c10 0x7fee4c15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 -- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee4c0b3b40 msgr2=0x7fee4c06a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee4c0b3b40 0x7fee4c06a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 -- 172.21.15.17:0/1891079099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440094d0 con 0x7fee4c0adc40 2023-08-09T12:44:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.883+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c0adc40 0x7fee4c0acb20 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00c8c0 tx=0x7fee3c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.884+0000 7fee48ff9640 1 -- 172.21.15.17:0/1891079099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c00a640 con 0x7fee4c0adc40 2023-08-09T12:44:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.884+0000 7fee48ff9640 1 -- 172.21.15.17:0/1891079099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c00a7a0 con 0x7fee4c0adc40 2023-08-09T12:44:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.884+0000 7fee51e71640 1 -- 172.21.15.17:0/1891079099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c0c91e0 con 0x7fee4c0adc40 2023-08-09T12:44:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.884+0000 7fee48ff9640 1 -- 172.21.15.17:0/1891079099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c00ab90 con 0x7fee4c0adc40 2023-08-09T12:44:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.884+0000 7fee51e71640 1 -- 172.21.15.17:0/1891079099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0c97a0 con 0x7fee4c0adc40 2023-08-09T12:44:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.886+0000 7fee48ff9640 1 -- 172.21.15.17:0/1891079099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fee3c00acf0 con 0x7fee4c0adc40 2023-08-09T12:44:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.887+0000 7fee48ff9640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee2c06a050 0x7fee2c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.887+0000 7fee48ff9640 1 -- 172.21.15.17:0/1891079099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee3c087c90 con 0x7fee4c0adc40 2023-08-09T12:44:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.888+0000 7fee549e0740 1 Processor -- start 2023-08-09T12:44:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.888+0000 7fee42ffd640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee2c06a050 0x7fee2c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.888+0000 7fee549e0740 1 -- start start 2023-08-09T12:44:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee549e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012ad2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee549e0740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa1bd0 0x55e012aceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee549e0740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 0x55e012acf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee549e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e012a138f0 con 0x55e012ad1c50 2023-08-09T12:44:32.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee549e0740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e012a10fe0 con 0x55e012aa1bd0 2023-08-09T12:44:32.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee549e0740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e012a0c8d0 con 0x55e012aa57d0 2023-08-09T12:44:32.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012ad2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee42ffd640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee2c06a050 0x7fee2c06c510 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fee34007fd0 tx=0x7fee340079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:32.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012ad2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49964/0 (socket says 172.21.15.17:49964) 2023-08-09T12:44:32.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.889+0000 7fee4b7fe640 1 -- 172.21.15.17:0/1555472222 learned_addr learned my addr 172.21.15.17:0/1555472222 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:32.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee4bfff640 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 0x55e012acf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee4b7fe640 1 -- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 msgr2=0x55e012acf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:32.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 0x55e012acf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee4b7fe640 1 -- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa1bd0 msgr2=0x55e012aceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee42ffd640 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa1bd0 0x55e012aceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa1bd0 0x55e012aceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee4b7fe640 1 -- 172.21.15.17:0/1555472222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0129c5ac0 con 0x55e012ad1c50 2023-08-09T12:44:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee42ffd640 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa1bd0 0x55e012aceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012ad2030 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fee3c05e780 tx=0x7fee3c057630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacbef02fa450060 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.890+0000 7fee417fa640 1 -- 172.21.15.17:0/1555472222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c05ecb0 con 0x55e012ad1c50 2023-08-09T12:44:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.891+0000 7fee417fa640 1 -- 172.21.15.17:0/1555472222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c055340 con 0x55e012ad1c50 2023-08-09T12:44:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.891+0000 7fee417fa640 1 -- 172.21.15.17:0/1555472222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c052d90 con 0x55e012ad1c50 2023-08-09T12:44:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.891+0000 7fee549e0740 1 -- 172.21.15.17:0/1555472222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 msgr2=0x55e012ad2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.891+0000 7fee549e0740 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012ad2030 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fee3c05e780 tx=0x7fee3c057630 comp rx=0 tx=0).stop 2023-08-09T12:44:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.891+0000 7fee549e0740 1 -- 172.21.15.17:0/1555472222 shutdown_connections 2023-08-09T12:44:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.891+0000 7fee549e0740 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 0x55e012acf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.891+0000 7fee549e0740 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa1bd0 0x55e012aceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.891+0000 7fee549e0740 1 --2- 172.21.15.17:0/1555472222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012ad2030 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.892+0000 7fee549e0740 1 -- 172.21.15.17:0/1555472222 >> 172.21.15.17:0/1555472222 conn(0x55e012aa3ee0 msgr2=0x55e012aeca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.892+0000 7fee549e0740 1 -- 172.21.15.17:0/1555472222 shutdown_connections 2023-08-09T12:44:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.892+0000 7fee549e0740 1 -- 172.21.15.17:0/1555472222 wait complete. 2023-08-09T12:44:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.892+0000 7fee549e0740 1 -- start start 2023-08-09T12:44:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.893+0000 7fee549e0740 1 Processor -- start 2023-08-09T12:44:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee549e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012aa57d0 0x55e012acc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee549e0740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad1c50 0x55e012accc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee549e0740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012ad2590 0x55e012abbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee549e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0129acd40 con 0x55e012aa57d0 2023-08-09T12:44:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee549e0740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0129ac9e0 con 0x55e012ad2590 2023-08-09T12:44:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee549e0740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e012772f20 con 0x55e012ad1c50 2023-08-09T12:44:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee549e0740 10 client.0 _ll_register_callbacks cb 0x55e0129c5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:44:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012aa57d0 0x55e012acc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012aa57d0 0x55e012acc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49968/0 (socket says 172.21.15.17:49968) 2023-08-09T12:44:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee4b7fe640 1 -- 172.21.15.17:0/2058413781 learned_addr learned my addr 172.21.15.17:0/2058413781 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee42ffd640 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad1c50 0x55e012accc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee4b7fe640 1 -- 172.21.15.17:0/2058413781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad1c50 msgr2=0x55e012accc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad1c50 0x55e012accc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee4b7fe640 1 -- 172.21.15.17:0/2058413781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012ad2590 msgr2=0x55e012abbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.894+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012ad2590 0x55e012abbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee4b7fe640 1 -- 172.21.15.17:0/2058413781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0c97a0 con 0x55e012aa57d0 2023-08-09T12:44:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012aa57d0 0x55e012acc740 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fee3c05e780 tx=0x7fee3c059070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7706b5c0d8dd9a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:44:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee2a7fc640 1 -- 172.21.15.17:0/2058413781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c052d90 con 0x55e012aa57d0 2023-08-09T12:44:32.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee549e0740 1 -- 172.21.15.17:0/2058413781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0129e4500 con 0x55e012aa57d0 2023-08-09T12:44:32.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee2a7fc640 1 -- 172.21.15.17:0/2058413781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee3c052ef0 con 0x55e012aa57d0 2023-08-09T12:44:32.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee2a7fc640 1 -- 172.21.15.17:0/2058413781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee3c0530b0 con 0x55e012aa57d0 2023-08-09T12:44:32.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee549e0740 10 client.6738 fetch_fsmap learned FSMap version 43 2023-08-09T12:44:32.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.895+0000 7fee549e0740 1 -- 172.21.15.17:0/2058413781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55e012a0af50 con 0x55e012aa57d0 2023-08-09T12:44:32.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee2a7fc640 1 -- 172.21.15.17:0/2058413781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0129e4500 con 0x55e012aa57d0 2023-08-09T12:44:32.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee2a7fc640 1 -- 172.21.15.17:0/2058413781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fee3c055f00 con 0x55e012aa57d0 2023-08-09T12:44:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee549e0740 10 client.6738 fetch_fsmap finished waiting for FSMap version 43 2023-08-09T12:44:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee549e0740 10 client.6738 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:44:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee549e0740 20 client.6738 populate_metadata read hostname 'smithi017' 2023-08-09T12:44:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee549e0740 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] conn(0x55e012b00b70 0x55e012ad4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee549e0740 4 client.6738 mds_command: new command op to 6585 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:44:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee549e0740 1 -- 172.21.15.17:0/2058413781 --> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0129e1bc0 con 0x55e012b00b70 2023-08-09T12:44:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.896+0000 7fee42ffd640 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] conn(0x55e012b00b70 0x55e012ad4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.897+0000 7fee42ffd640 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] conn(0x55e012b00b70 0x55e012ad4c60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=507530bf39d32d56 server_cookie=4495995160b4115c in_seq=0 out_seq=0 2023-08-09T12:44:32.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.897+0000 7fee2a7fc640 10 client.6738 ms_handle_connect on v2:172.21.15.17:6833/4077789912 2023-08-09T12:44:32.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee2a7fc640 1 -- 172.21.15.17:0/2058413781 <== mds.0 v2:172.21.15.17:6833/4077789912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e0129e1bc0 con 0x55e012b00b70 2023-08-09T12:44:32.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee2a7fc640 10 client.6738 handle_command_reply: tid=0 2023-08-09T12:44:32.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 client.6738 shutdown 2023-08-09T12:44:32.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 -- 172.21.15.17:0/2058413781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012aa57d0 msgr2=0x55e012acc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012aa57d0 0x55e012acc740 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fee3c05e780 tx=0x7fee3c059070 comp rx=0 tx=0).stop 2023-08-09T12:44:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 -- 172.21.15.17:0/2058413781 shutdown_connections 2023-08-09T12:44:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] conn(0x55e012b00b70 0x55e012ad4c60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012ad2590 0x55e012abbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad1c50 0x55e012accc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 --2- 172.21.15.17:0/2058413781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012aa57d0 0x55e012acc740 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee2a7fc640 0 client.6738 ms_handle_reset on v2:172.21.15.17:6833/4077789912 2023-08-09T12:44:32.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 -- 172.21.15.17:0/2058413781 >> 172.21.15.17:0/2058413781 conn(0x55e012aa1bd0 msgr2=0x55e012aa6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:32.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 -- 172.21.15.17:0/2058413781 shutdown_connections 2023-08-09T12:44:32.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 1 -- 172.21.15.17:0/2058413781 wait complete. 2023-08-09T12:44:32.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.898+0000 7fee549e0740 20 client.6738 trim_cache size 0 max 16384 2023-08-09T12:44:32.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.916+0000 7fee549e0740 1 Processor -- start 2023-08-09T12:44:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.916+0000 7fee549e0740 1 -- start start 2023-08-09T12:44:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.916+0000 7fee549e0740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa57d0 0x55e012a9d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee549e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012af0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee549e0740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad2590 0x55e012af06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee549e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e012ac9120 con 0x55e012ad1c50 2023-08-09T12:44:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee549e0740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e012a9dfe0 con 0x55e012aa57d0 2023-08-09T12:44:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee549e0740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e012aa35a0 con 0x55e012ad2590 2023-08-09T12:44:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012af0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012af0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49974/0 (socket says 172.21.15.17:49974) 2023-08-09T12:44:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee42ffd640 1 -- 172.21.15.17:0/1389740493 learned_addr learned my addr 172.21.15.17:0/1389740493 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa57d0 0x55e012a9d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee42ffd640 1 -- 172.21.15.17:0/1389740493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad2590 msgr2=0x55e012af06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee42ffd640 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad2590 0x55e012af06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee42ffd640 1 -- 172.21.15.17:0/1389740493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa57d0 msgr2=0x55e012a9d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee42ffd640 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa57d0 0x55e012a9d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee42ffd640 1 -- 172.21.15.17:0/1389740493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e012a3e300 con 0x55e012ad1c50 2023-08-09T12:44:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.917+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa57d0 0x55e012a9d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.918+0000 7fee42ffd640 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012af0190 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fee34014720 tx=0x7fee34012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93662705e1ad131 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.918+0000 7fee41ffb640 1 -- 172.21.15.17:0/1389740493 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34015cb0 con 0x55e012ad1c50 2023-08-09T12:44:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.918+0000 7fee41ffb640 1 -- 172.21.15.17:0/1389740493 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3401a040 con 0x55e012ad1c50 2023-08-09T12:44:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.918+0000 7fee41ffb640 1 -- 172.21.15.17:0/1389740493 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34021b10 con 0x55e012ad1c50 2023-08-09T12:44:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 -- 172.21.15.17:0/1389740493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 msgr2=0x55e012af0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012af0190 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fee34014720 tx=0x7fee34012000 comp rx=0 tx=0).stop 2023-08-09T12:44:32.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 -- 172.21.15.17:0/1389740493 shutdown_connections 2023-08-09T12:44:32.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012ad2590 0x55e012af06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012af0190 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 --2- 172.21.15.17:0/1389740493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012aa57d0 0x55e012a9d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 -- 172.21.15.17:0/1389740493 >> 172.21.15.17:0/1389740493 conn(0x55e012aa1bd0 msgr2=0x55e012aef670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:32.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 -- 172.21.15.17:0/1389740493 shutdown_connections 2023-08-09T12:44:32.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.919+0000 7fee549e0740 1 -- 172.21.15.17:0/1389740493 wait complete. 2023-08-09T12:44:32.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.920+0000 7fee549e0740 1 -- start start 2023-08-09T12:44:32.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.920+0000 7fee549e0740 1 Processor -- start 2023-08-09T12:44:32.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee549e0740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 0x55e012b02f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee549e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012aa73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee549e0740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012ad2590 0x55e012af0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee549e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e012b071f0 con 0x55e012ad1c50 2023-08-09T12:44:32.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee549e0740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e012b03970 con 0x55e012ad2590 2023-08-09T12:44:32.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee549e0740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e012b3ed20 con 0x55e012aa57d0 2023-08-09T12:44:32.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee549e0740 10 client.0 _ll_register_callbacks cb 0x7fee3c056bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:44:32.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012aa73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012aa73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49978/0 (socket says 172.21.15.17:49978) 2023-08-09T12:44:32.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.921+0000 7fee42ffd640 1 -- 172.21.15.17:0/912027933 learned_addr learned my addr 172.21.15.17:0/912027933 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 0x55e012b02f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee42ffd640 1 -- 172.21.15.17:0/912027933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 msgr2=0x55e012b02f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee42ffd640 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 0x55e012b02f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee42ffd640 1 -- 172.21.15.17:0/912027933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012ad2590 msgr2=0x55e012af0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee42ffd640 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012ad2590 0x55e012af0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee42ffd640 1 -- 172.21.15.17:0/912027933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0b2250 con 0x55e012ad1c50 2023-08-09T12:44:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee42ffd640 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012aa73b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fee4c06f5b0 tx=0x7fee340011e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79cf0a6e285cece server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:44:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee2a7fc640 1 -- 172.21.15.17:0/912027933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34021ad0 con 0x55e012ad1c50 2023-08-09T12:44:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee2a7fc640 1 -- 172.21.15.17:0/912027933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee34021c30 con 0x55e012ad1c50 2023-08-09T12:44:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.922+0000 7fee549e0740 1 -- 172.21.15.17:0/912027933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e012a34800 con 0x55e012ad1c50 2023-08-09T12:44:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee2a7fc640 1 -- 172.21.15.17:0/912027933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee34021df0 con 0x55e012ad1c50 2023-08-09T12:44:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee549e0740 10 client.6744 fetch_fsmap learned FSMap version 43 2023-08-09T12:44:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee549e0740 1 -- 172.21.15.17:0/912027933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55e0129aba10 con 0x55e012ad1c50 2023-08-09T12:44:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee2a7fc640 1 -- 172.21.15.17:0/912027933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e012a34800 con 0x55e012ad1c50 2023-08-09T12:44:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee2a7fc640 1 -- 172.21.15.17:0/912027933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fee34028070 con 0x55e012ad1c50 2023-08-09T12:44:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee549e0740 10 client.6744 fetch_fsmap finished waiting for FSMap version 43 2023-08-09T12:44:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee549e0740 10 client.6744 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:44:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee549e0740 20 client.6744 populate_metadata read hostname 'smithi017' 2023-08-09T12:44:32.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee549e0740 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] conn(0x55e012aa8070 0x55e012af06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:32.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee549e0740 4 client.6744 mds_command: new command op to 6585 tid=0[{"prefix": "status"}] 2023-08-09T12:44:32.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee549e0740 1 -- 172.21.15.17:0/912027933 --> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e012a058b0 con 0x55e012aa8070 2023-08-09T12:44:32.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.923+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] conn(0x55e012aa8070 0x55e012af06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:32.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee4b7fe640 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] conn(0x55e012aa8070 0x55e012af06d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29c55b4010f9c9d server_cookie=93fa58d361d44af8 in_seq=0 out_seq=0 2023-08-09T12:44:32.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee2a7fc640 10 client.6744 ms_handle_connect on v2:172.21.15.17:6833/4077789912 2023-08-09T12:44:32.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee2a7fc640 1 -- 172.21.15.17:0/912027933 <== mds.0 v2:172.21.15.17:6833/4077789912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e012a058b0 con 0x55e012aa8070 2023-08-09T12:44:32.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee2a7fc640 10 client.6744 handle_command_reply: tid=0 2023-08-09T12:44:32.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 client.6744 shutdown 2023-08-09T12:44:32.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 -- 172.21.15.17:0/912027933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 msgr2=0x55e012aa73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012aa73b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fee4c06f5b0 tx=0x7fee340011e0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 -- 172.21.15.17:0/912027933 shutdown_connections 2023-08-09T12:44:32.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.17:6833/4077789912,v1:172.21.15.17:6835/4077789912] conn(0x55e012aa8070 0x55e012af06d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e012ad2590 0x55e012af0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e012ad1c50 0x55e012aa73b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 --2- 172.21.15.17:0/912027933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e012aa57d0 0x55e012b02f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee2a7fc640 0 client.6744 ms_handle_reset on v2:172.21.15.17:6833/4077789912 2023-08-09T12:44:32.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.924+0000 7fee549e0740 1 -- 172.21.15.17:0/912027933 >> 172.21.15.17:0/912027933 conn(0x55e012aa1bd0 msgr2=0x55e012acb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:32.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.925+0000 7fee549e0740 1 -- 172.21.15.17:0/912027933 shutdown_connections 2023-08-09T12:44:32.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.925+0000 7fee549e0740 1 -- 172.21.15.17:0/912027933 wait complete. 2023-08-09T12:44:32.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.925+0000 7fee549e0740 20 client.6744 trim_cache size 0 max 16384 2023-08-09T12:44:32.936 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:44:32.936 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:44:32.936 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:44:32.936 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 6585, 2023-08-09T12:44:32.936 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:44:32.936 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:44:32.936 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:44:32.937 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.8244225800000002, 2023-08-09T12:44:32.937 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 43, 2023-08-09T12:44:32.937 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 92, 2023-08-09T12:44:32.937 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 92, 2023-08-09T12:44:32.937 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 13.654231677 2023-08-09T12:44:32.937 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:44:32.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.925+0000 7fee51e71640 1 -- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee2c06a050 msgr2=0x7fee2c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.925+0000 7fee51e71640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee2c06a050 0x7fee2c06c510 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fee34007fd0 tx=0x7fee340079a0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.925+0000 7fee51e71640 1 -- 172.21.15.17:0/1891079099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c0adc40 msgr2=0x7fee4c0acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:32.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.925+0000 7fee51e71640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c0adc40 0x7fee4c0acb20 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00c8c0 tx=0x7fee3c00cd80 comp rx=0 tx=0).stop 2023-08-09T12:44:32.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.926+0000 7fee51e71640 1 -- 172.21.15.17:0/1891079099 shutdown_connections 2023-08-09T12:44:32.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.926+0000 7fee51e71640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee2c06a050 0x7fee2c06c510 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.926+0000 7fee51e71640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee4c163c10 0x7fee4c15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.926+0000 7fee51e71640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee4c0b3b40 0x7fee4c06a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.926+0000 7fee51e71640 1 --2- 172.21.15.17:0/1891079099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee4c0adc40 0x7fee4c0acb20 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:32.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.926+0000 7fee51e71640 1 -- 172.21.15.17:0/1891079099 >> 172.21.15.17:0/1891079099 conn(0x7fee4c0cb1b0 msgr2=0x7fee4c15bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:32.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.926+0000 7fee51e71640 1 -- 172.21.15.17:0/1891079099 shutdown_connections 2023-08-09T12:44:32.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:32.926+0000 7fee51e71640 1 -- 172.21.15.17:0/1891079099 wait complete. 2023-08-09T12:44:32.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:44:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.156+0000 7f963ac25640 1 Processor -- start 2023-08-09T12:44:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.156+0000 7f963ac25640 1 -- start start 2023-08-09T12:44:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f963ac25640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9634160030 0x7f9634160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f963ac25640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f96340b86e0 0x7f96340cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f963ac25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 0x7f96340b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f963ac25640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96340d1110 con 0x7f96340b86e0 2023-08-09T12:44:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f963ac25640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96340ceac0 con 0x7f9634160030 2023-08-09T12:44:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f963ac25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96340cfe10 con 0x7f96340cf980 2023-08-09T12:44:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f9639422640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f96340b86e0 0x7f96340cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f9639422640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f96340b86e0 0x7f96340cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49980/0 (socket says 172.21.15.17:49980) 2023-08-09T12:44:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.158+0000 7f9639422640 1 -- 172.21.15.17:0/845798916 learned_addr learned my addr 172.21.15.17:0/845798916 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.159+0000 7f9639c23640 1 --2- 172.21.15.17:0/845798916 >> v2:172.21.15.142:3300/0 conn(0x7f9634160030 0x7f9634160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.159+0000 7f9639422640 1 -- 172.21.15.17:0/845798916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 msgr2=0x7f96340b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.159+0000 7f9639422640 1 --2- 172.21.15.17:0/845798916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 0x7f96340b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.159+0000 7f9639422640 1 -- 172.21.15.17:0/845798916 >> v2:172.21.15.142:3300/0 conn(0x7f9634160030 msgr2=0x7f9634160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.159+0000 7f9639422640 1 --2- 172.21.15.17:0/845798916 >> v2:172.21.15.142:3300/0 conn(0x7f9634160030 0x7f9634160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.159+0000 7f9639422640 1 -- 172.21.15.17:0/845798916 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340b5a30 con 0x7f96340b86e0 2023-08-09T12:44:33.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.160+0000 7f9639422640 1 --2- 172.21.15.17:0/845798916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96340b86e0 0x7f96340cf440 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9634065f60 tx=0x7f962402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb2b069f1eea14c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.160+0000 7f9638c21640 1 -- 172.21.15.17:0/845798916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624031860 con 0x7f96340b86e0 2023-08-09T12:44:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.160+0000 7f9638c21640 1 -- 172.21.15.17:0/845798916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96240319c0 con 0x7f96340b86e0 2023-08-09T12:44:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.160+0000 7f9638c21640 1 -- 172.21.15.17:0/845798916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624031d50 con 0x7f96340b86e0 2023-08-09T12:44:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 -- 172.21.15.17:0/845798916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96340b86e0 msgr2=0x7f96340cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 --2- 172.21.15.17:0/845798916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96340b86e0 0x7f96340cf440 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9634065f60 tx=0x7f962402b900 comp rx=0 tx=0).stop 2023-08-09T12:44:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 -- 172.21.15.17:0/845798916 shutdown_connections 2023-08-09T12:44:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 --2- 172.21.15.17:0/845798916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 0x7f96340b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 --2- 172.21.15.17:0/845798916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96340b86e0 0x7f96340cf440 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 --2- 172.21.15.17:0/845798916 >> v2:172.21.15.142:3300/0 conn(0x7f9634160030 0x7f9634160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 -- 172.21.15.17:0/845798916 >> 172.21.15.17:0/845798916 conn(0x7f96340697c0 msgr2=0x7f9634069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 -- 172.21.15.17:0/845798916 shutdown_connections 2023-08-09T12:44:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.161+0000 7f963ac25640 1 -- 172.21.15.17:0/845798916 wait complete. 2023-08-09T12:44:33.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.164+0000 7f963ac25640 1 Processor -- start 2023-08-09T12:44:33.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.164+0000 7f963ac25640 1 -- start start 2023-08-09T12:44:33.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.165+0000 7f963ac25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96340b86e0 0x7f96340c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:33.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.165+0000 7f963ac25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 0x7f96340cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.165+0000 7f963ac25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634160030 0x7f96340ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.165+0000 7f963ac25640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96340cbad0 con 0x7f9634160030 2023-08-09T12:44:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.165+0000 7f963ac25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96340cbd20 con 0x7f96340b86e0 2023-08-09T12:44:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.165+0000 7f963ac25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96340cc000 con 0x7f96340cf980 2023-08-09T12:44:33.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f963a424640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634160030 0x7f96340ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:33.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f9639c23640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96340b86e0 0x7f96340c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:33.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f963a424640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634160030 0x7f96340ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49986/0 (socket says 172.21.15.17:49986) 2023-08-09T12:44:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f963a424640 1 -- 172.21.15.17:0/1890508507 learned_addr learned my addr 172.21.15.17:0/1890508507 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f9639422640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 0x7f96340cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f963a424640 1 -- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 msgr2=0x7f96340cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f963a424640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 0x7f96340cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f963a424640 1 -- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96340b86e0 msgr2=0x7f96340c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f963a424640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96340b86e0 0x7f96340c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f963a424640 1 -- 172.21.15.17:0/1890508507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240094d0 con 0x7f9634160030 2023-08-09T12:44:33.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.166+0000 7f9639c23640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96340b86e0 0x7f96340c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:44:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.167+0000 7f963a424640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634160030 0x7f96340ca6d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f962c00b970 tx=0x7f962c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.167+0000 7f962a7fc640 1 -- 172.21.15.17:0/1890508507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00cb40 con 0x7f9634160030 2023-08-09T12:44:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.167+0000 7f962a7fc640 1 -- 172.21.15.17:0/1890508507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c00ccc0 con 0x7f9634160030 2023-08-09T12:44:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.167+0000 7f962a7fc640 1 -- 172.21.15.17:0/1890508507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c014680 con 0x7f9634160030 2023-08-09T12:44:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.167+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96340cc2e0 con 0x7f9634160030 2023-08-09T12:44:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.167+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96340cc8a0 con 0x7f9634160030 2023-08-09T12:44:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.168+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963404e390 con 0x7f9634160030 2023-08-09T12:44:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.170+0000 7f962a7fc640 1 -- 172.21.15.17:0/1890508507 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f962c01d3b0 con 0x7f9634160030 2023-08-09T12:44:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.170+0000 7f962a7fc640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f961806a050 0x7f961806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:33.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.171+0000 7f962a7fc640 1 -- 172.21.15.17:0/1890508507 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f962c0884c0 con 0x7f9634160030 2023-08-09T12:44:33.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.171+0000 7f9639c23640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f961806a050 0x7f961806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:33.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.172+0000 7f9639c23640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f961806a050 0x7f961806c510 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9630006fd0 tx=0x7f9630008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:33.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.175+0000 7f962a7fc640 1 -- 172.21.15.17:0/1890508507 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f962c053c40 con 0x7f9634160030 2023-08-09T12:44:33.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.404+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96341453a0 con 0x7f9634160030 2023-08-09T12:44:33.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.405+0000 7f962a7fc640 1 -- 172.21.15.17:0/1890508507 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f962c057260 con 0x7f9634160030 2023-08-09T12:44:33.408 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:44:33.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.407+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f961806a050 msgr2=0x7f961806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:33.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.407+0000 7f963ac25640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f961806a050 0x7f961806c510 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9630006fd0 tx=0x7f9630008040 comp rx=0 tx=0).stop 2023-08-09T12:44:33.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.407+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634160030 msgr2=0x7f96340ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:33.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.407+0000 7f963ac25640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634160030 0x7f96340ca6d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f962c00b970 tx=0x7f962c00be30 comp rx=0 tx=0).stop 2023-08-09T12:44:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.408+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 shutdown_connections 2023-08-09T12:44:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.408+0000 7f963ac25640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f961806a050 0x7f961806c510 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.408+0000 7f963ac25640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634160030 0x7f96340ca6d0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.408+0000 7f963ac25640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96340cf980 0x7f96340cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.408+0000 7f963ac25640 1 --2- 172.21.15.17:0/1890508507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96340b86e0 0x7f96340c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.408+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 >> 172.21.15.17:0/1890508507 conn(0x7f96340697c0 msgr2=0x7f963415f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.408+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 shutdown_connections 2023-08-09T12:44:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:33.408+0000 7f963ac25640 1 -- 172.21.15.17:0/1890508507 wait complete. 2023-08-09T12:44:33.430 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:44:33.430 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:44:33.430 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:44:33.431 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:44:33.431 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:44:33.431 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:44:33.431 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:44:33.432 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:44:33.432 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:44:33.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:33.433 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:44:33.487 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:44:33.487 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:44:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:44:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:44:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:33.488 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:44:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:44:33.489 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:44:33.489 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:33.489 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:44:33.489 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:44:33.489 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:33.490 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:44:33.490 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:44:33.490 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41906sec preferred_lft 41906sec 2023-08-09T12:44:33.491 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:44:33.491 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:33.491 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:44:33.491 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:33.492 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:44:33.492 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:44:33.492 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:33.492 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:44:33.493 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:33.493 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:44:33.493 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:33.494 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:44:33.494 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:44:33.494 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:44:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:33.495 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:44:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:44:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:44:33.496 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:33.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:33.498 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:44:33.591 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:44:33.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:33.596 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:44:33.657 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:44:33.658 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:44:33.658 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:44:33.658 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:44:33.658 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:44:33.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:33.659 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:44:33.659 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:44:33.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:44:33.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:44:33.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:44:33.661 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:44:33.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:33.860 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:44:33.913 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:44:33.914 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:44:33.914 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:44:33.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:33.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:44:34.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:44:34.017 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:44:34.083 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:44:34.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:44:34.084 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:44:34.137 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:44:34.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:34.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:44:34.282 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:44:34.282 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:44:34.282 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:44:34.304 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:44:34.304 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:44:34.304 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:44:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:44:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:44:34.329 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:44:34.330 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:44:34.330 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:44:34.330 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:44:34.330 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:44:34.330 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:44:34.330 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:44:34.330 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:44:34.332 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:44:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:44:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:44:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:44:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:44:34.335 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:44:34.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:34.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:44:34.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:34.426 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:44:34.497 INFO:teuthology.orchestra.run.smithi017.stdout:client5252 2023-08-09T12:44:34.497 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:44:34.498 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:34.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:44:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.787+0000 7f8b40226640 1 Processor -- start 2023-08-09T12:44:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.787+0000 7f8b40226640 1 -- start start 2023-08-09T12:44:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.788+0000 7f8b40226640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b38161660 0x7f8b380ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:34.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.788+0000 7f8b40226640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b380ad240 con 0x7f8b380acdf0 2023-08-09T12:44:34.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.788+0000 7f8b40226640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3815df30 con 0x7f8b38161280 2023-08-09T12:44:34.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.788+0000 7f8b40226640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3815d430 con 0x7f8b38161660 2023-08-09T12:44:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.789+0000 7f8b3e7c3640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8b380acdf0 0x7f8b380cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57146/0 (socket says 172.21.15.17:57146) 2023-08-09T12:44:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.789+0000 7f8b3e7c3640 1 -- 172.21.15.17:0/3779192579 learned_addr learned my addr 172.21.15.17:0/3779192579 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:44:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.789+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189063765 0 0) 0x7f8b30001490 con 0x7f8b380acdf0 2023-08-09T12:44:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.789+0000 7f8b3d7c1640 1 --2- 172.21.15.17:0/3779192579 >> v2:172.21.15.142:3300/0 conn(0x7f8b38161660 0x7f8b380ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.789+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b24003520 con 0x7f8b380acdf0 2023-08-09T12:44:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515677145 0 0) 0x7f8b24003520 con 0x7f8b380acdf0 2023-08-09T12:44:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 >> v2:172.21.15.142:3300/0 conn(0x7f8b38161660 msgr2=0x7f8b380ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 --2- 172.21.15.17:0/3779192579 >> v2:172.21.15.142:3300/0 conn(0x7f8b38161660 0x7f8b380ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 >> v1:172.21.15.142:6789/0 conn(0x7f8b38161280 legacy=0x7f8b380c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380ca9d0 con 0x7f8b380acdf0 2023-08-09T12:44:34.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8b30001b80 con 0x7f8b380acdf0 2023-08-09T12:44:34.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 >> v1:172.21.15.17:6789/0 conn(0x7f8b380acdf0 legacy=0x7f8b380cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:34.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b240039c0 0x7f8b24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:34.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240047c0 0x7f8b24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:34.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b240052a0 0x7f8b2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:34.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2400c190 con 0x7f8b240039c0 2023-08-09T12:44:34.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2400c300 con 0x7f8b240052a0 2023-08-09T12:44:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2400c4c0 con 0x7f8b240047c0 2023-08-09T12:44:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.790+0000 7f8b3dfc2640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b240039c0 0x7f8b24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3d7c1640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240047c0 0x7f8b24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3dfc2640 1 -- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240047c0 msgr2=0x7f8b24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3dfc2640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240047c0 0x7f8b24004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3dfc2640 1 -- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b240052a0 msgr2=0x7f8b2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3e7c3640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b240052a0 0x7f8b2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3dfc2640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b240052a0 0x7f8b2400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3dfc2640 1 -- 172.21.15.17:0/3779192579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24003520 con 0x7f8b240039c0 2023-08-09T12:44:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3d7c1640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240047c0 0x7f8b24004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3e7c3640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b240052a0 0x7f8b2400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.791+0000 7f8b3e7c3640 1 -- 172.21.15.17:0/3779192579 reap_dead start 2023-08-09T12:44:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.792+0000 7f8b3dfc2640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b240039c0 0x7f8b24003de0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8b34001750 tx=0x7f8b240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20018cb08b71a0a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.792+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b340052d0 con 0x7f8b240039c0 2023-08-09T12:44:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.792+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3402e050 con 0x7f8b240039c0 2023-08-09T12:44:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.792+0000 7f8b3cfc0640 1 -- 172.21.15.17:0/3779192579 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34003830 con 0x7f8b240039c0 2023-08-09T12:44:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.793+0000 7f8b40226640 1 -- 172.21.15.17:0/3779192579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b240039c0 msgr2=0x7f8b24003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.793+0000 7f8b40226640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b240039c0 0x7f8b24003de0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8b34001750 tx=0x7f8b240057f0 comp rx=0 tx=0).stop 2023-08-09T12:44:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.793+0000 7f8b40226640 1 -- 172.21.15.17:0/3779192579 shutdown_connections 2023-08-09T12:44:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.793+0000 7f8b40226640 1 --2- 172.21.15.17:0/3779192579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b240039c0 0x7f8b24003de0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.793+0000 7f8b40226640 1 -- 172.21.15.17:0/3779192579 >> 172.21.15.17:0/3779192579 conn(0x7f8b380cb1b0 msgr2=0x7f8b380cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.793+0000 7f8b40226640 1 -- 172.21.15.17:0/3779192579 shutdown_connections 2023-08-09T12:44:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.793+0000 7f8b40226640 1 -- 172.21.15.17:0/3779192579 wait complete. 2023-08-09T12:44:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.795+0000 7f8b40226640 1 Processor -- start 2023-08-09T12:44:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.795+0000 7f8b40226640 1 -- start start 2023-08-09T12:44:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b40226640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240039c0 0x7f8b38149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b40226640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3806a9e0 0x7f8b3806ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b40226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b380b3770 0x7f8b380b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b40226640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3806b380 con 0x7f8b380b3770 2023-08-09T12:44:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b40226640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38149670 con 0x7f8b3806a9e0 2023-08-09T12:44:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b40226640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b380b4530 con 0x7f8b240039c0 2023-08-09T12:44:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b3e7c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b380b3770 0x7f8b380b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b3e7c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b380b3770 0x7f8b380b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50008/0 (socket says 172.21.15.17:50008) 2023-08-09T12:44:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.796+0000 7f8b3e7c3640 1 -- 172.21.15.17:0/4253553128 learned_addr learned my addr 172.21.15.17:0/4253553128 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b3d7c1640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3806a9e0 0x7f8b3806ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b3dfc2640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240039c0 0x7f8b38149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b3e7c3640 1 -- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240039c0 msgr2=0x7f8b38149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b3e7c3640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240039c0 0x7f8b38149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b3e7c3640 1 -- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3806a9e0 msgr2=0x7f8b3806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b3e7c3640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3806a9e0 0x7f8b3806ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b3e7c3640 1 -- 172.21.15.17:0/4253553128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b381498c0 con 0x7f8b380b3770 2023-08-09T12:44:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b3e7c3640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b380b3770 0x7f8b380b3bf0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f8b380c5700 tx=0x7f8b3000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b2e7fc640 1 -- 172.21.15.17:0/4253553128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30004d60 con 0x7f8b380b3770 2023-08-09T12:44:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.797+0000 7f8b2e7fc640 1 -- 172.21.15.17:0/4253553128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3000baa0 con 0x7f8b380b3770 2023-08-09T12:44:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.798+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b38149ba0 con 0x7f8b380b3770 2023-08-09T12:44:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.798+0000 7f8b2e7fc640 1 -- 172.21.15.17:0/4253553128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000be30 con 0x7f8b380b3770 2023-08-09T12:44:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.798+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b380b4130 con 0x7f8b380b3770 2023-08-09T12:44:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.799+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b380b42c0 con 0x7f8b380b3770 2023-08-09T12:44:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.800+0000 7f8b2e7fc640 1 -- 172.21.15.17:0/4253553128 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8b30007110 con 0x7f8b380b3770 2023-08-09T12:44:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.801+0000 7f8b2e7fc640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b1c06a050 0x7f8b1c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.801+0000 7f8b2e7fc640 1 -- 172.21.15.17:0/4253553128 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b30088770 con 0x7f8b380b3770 2023-08-09T12:44:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.801+0000 7f8b3dfc2640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b1c06a050 0x7f8b1c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.803+0000 7f8b3dfc2640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b1c06a050 0x7f8b1c06c510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8b34033000 tx=0x7f8b34009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:34.805+0000 7f8b2e7fc640 1 -- 172.21.15.17:0/4253553128 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8b30053e50 con 0x7f8b380b3770 2023-08-09T12:44:35.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.043+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8b380ad240 con 0x7f8b380b3770 2023-08-09T12:44:35.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.043+0000 7f8b2e7fc640 1 -- 172.21.15.17:0/4253553128 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8b380ad240 con 0x7f8b380b3770 2023-08-09T12:44:35.047 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:44:35.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b1c06a050 msgr2=0x7f8b1c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:35.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b1c06a050 0x7f8b1c06c510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8b34033000 tx=0x7f8b34009030 comp rx=0 tx=0).stop 2023-08-09T12:44:35.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b380b3770 msgr2=0x7f8b380b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:35.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b380b3770 0x7f8b380b3bf0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f8b380c5700 tx=0x7f8b3000b4a0 comp rx=0 tx=0).stop 2023-08-09T12:44:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 shutdown_connections 2023-08-09T12:44:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b1c06a050 0x7f8b1c06c510 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b380b3770 0x7f8b380b3bf0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3806a9e0 0x7f8b3806ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 --2- 172.21.15.17:0/4253553128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b240039c0 0x7f8b38149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.046+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 >> 172.21.15.17:0/4253553128 conn(0x7f8b380cb1b0 msgr2=0x7f8b380b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:35.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.047+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 shutdown_connections 2023-08-09T12:44:35.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:35.047+0000 7f8b40226640 1 -- 172.21.15.17:0/4253553128 wait complete. 2023-08-09T12:44:35.068 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:44:35.068 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:44:35.068 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:44:35.069 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:44:35.069 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:44:35.069 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:44:35.069 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:44:35.070 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:44:35.070 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:44:35.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:35.071 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:44:35.132 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:44:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:44:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:44:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:44:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:35.133 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:44:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:44:35.134 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:44:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:44:35.134 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:44:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:35.134 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:44:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:44:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41893sec preferred_lft 41893sec 2023-08-09T12:44:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:44:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:35.135 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:44:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:44:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:44:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:44:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:35.136 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:44:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:44:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:44:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:35.137 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:44:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:44:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:44:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:44:35.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:35.138 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:44:35.232 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:44:35.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:35.236 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:44:35.288 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:44:35.289 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:44:35.289 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:44:35.289 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:44:35.289 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:44:35.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:35.290 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:44:35.290 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:44:35.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:44:35.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:44:35.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:44:35.292 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:44:35.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:35.476 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:44:35.529 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:44:35.529 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:44:35.530 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:44:35.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:35.531 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:44:35.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:44:35.629 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:44:35.672 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:44:35.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:44:35.673 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:44:35.770 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:44:35.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:35.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:44:35.904 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:44:35.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:44:35.904 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:44:35.928 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:44:35.928 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:44:35.928 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:44:35.928 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:44:35.929 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:44:35.954 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:44:35.954 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:44:35.954 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:44:35.954 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:44:35.954 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:44:35.955 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:44:35.955 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:44:35.955 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:44:35.959 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:44:35.959 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:44:35.960 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:44:35.960 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:44:35.960 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:44:35.961 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:44:35.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:35.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:44:36.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:44:36.044 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:44:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:client5258 2023-08-09T12:44:36.103 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:44:36.103 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:44:36.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:44:36.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.394+0000 7f7d7f59e640 1 Processor -- start 2023-08-09T12:44:36.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.394+0000 7f7d7f59e640 1 -- start start 2023-08-09T12:44:36.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.395+0000 7f7d7f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d801587e0 0x7f7d80070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:36.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.395+0000 7f7d7f59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d800b0b10 0x7f7d8015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.395+0000 7f7d7f59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d8015bce0 0x7f7d800cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.395+0000 7f7d7f59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d800715c0 con 0x7f7d800b0b10 2023-08-09T12:44:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.395+0000 7f7d7f59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d800718a0 con 0x7f7d8015bce0 2023-08-09T12:44:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.395+0000 7f7d7f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d80071b80 con 0x7f7d801587e0 2023-08-09T12:44:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7dd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d800b0b10 0x7f7d8015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7dd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d800b0b10 0x7f7d8015b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50014/0 (socket says 172.21.15.17:50014) 2023-08-09T12:44:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7dd9b640 1 -- 172.21.15.17:0/1212483827 learned_addr learned my addr 172.21.15.17:0/1212483827 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7ed9d640 1 --2- 172.21.15.17:0/1212483827 >> v2:172.21.15.142:3300/0 conn(0x7f7d8015bce0 0x7f7d800cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:36.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7e59c640 1 --2- 172.21.15.17:0/1212483827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d801587e0 0x7f7d80070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:36.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7dd9b640 1 -- 172.21.15.17:0/1212483827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d801587e0 msgr2=0x7f7d80070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:36.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7dd9b640 1 --2- 172.21.15.17:0/1212483827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d801587e0 0x7f7d80070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7dd9b640 1 -- 172.21.15.17:0/1212483827 >> v2:172.21.15.142:3300/0 conn(0x7f7d8015bce0 msgr2=0x7f7d800cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:44:36.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7dd9b640 1 --2- 172.21.15.17:0/1212483827 >> v2:172.21.15.142:3300/0 conn(0x7f7d8015bce0 0x7f7d800cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.396+0000 7f7d7dd9b640 1 -- 172.21.15.17:0/1212483827 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8015b280 con 0x7f7d800b0b10 2023-08-09T12:44:36.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.397+0000 7f7d7dd9b640 1 --2- 172.21.15.17:0/1212483827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d800b0b10 0x7f7d8015b7a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7d80070790 tx=0x7f7d7402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83625a094e82f3e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:36.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.398+0000 7f7d7d59a640 1 -- 172.21.15.17:0/1212483827 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7402ca70 con 0x7f7d800b0b10 2023-08-09T12:44:36.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.398+0000 7f7d7d59a640 1 -- 172.21.15.17:0/1212483827 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7402cbd0 con 0x7f7d800b0b10 2023-08-09T12:44:36.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.398+0000 7f7d7d59a640 1 -- 172.21.15.17:0/1212483827 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d740343f0 con 0x7f7d800b0b10 2023-08-09T12:44:36.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.398+0000 7f7d7f59e640 1 -- 172.21.15.17:0/1212483827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d800b0b10 msgr2=0x7f7d8015b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:36.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.398+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/1212483827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d800b0b10 0x7f7d8015b7a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7d80070790 tx=0x7f7d7402bed0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.399+0000 7f7d7f59e640 1 -- 172.21.15.17:0/1212483827 shutdown_connections 2023-08-09T12:44:36.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.399+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/1212483827 >> v2:172.21.15.142:3300/0 conn(0x7f7d8015bce0 0x7f7d800cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.399+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/1212483827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d800b0b10 0x7f7d8015b7a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.399+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/1212483827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d801587e0 0x7f7d80070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.399+0000 7f7d7f59e640 1 -- 172.21.15.17:0/1212483827 >> 172.21.15.17:0/1212483827 conn(0x7f7d800b1d50 msgr2=0x7f7d8006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.399+0000 7f7d7f59e640 1 -- 172.21.15.17:0/1212483827 shutdown_connections 2023-08-09T12:44:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.399+0000 7f7d7f59e640 1 -- 172.21.15.17:0/1212483827 wait complete. 2023-08-09T12:44:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.400+0000 7f7d7f59e640 1 Processor -- start 2023-08-09T12:44:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.401+0000 7f7d7f59e640 1 -- start start 2023-08-09T12:44:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d800b0b10 0x7f7d8014aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7f59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d801587e0 0x7f7d80149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7f59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d8014a580 0x7f7d800c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7f59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800c25a0 con 0x7f7d8014a580 2023-08-09T12:44:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7f59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800c1b70 con 0x7f7d801587e0 2023-08-09T12:44:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d80155840 con 0x7f7d800b0b10 2023-08-09T12:44:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d8014a580 0x7f7d800c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d8014a580 0x7f7d800c29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50016/0 (socket says 172.21.15.17:50016) 2023-08-09T12:44:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7ed9d640 1 -- 172.21.15.17:0/3102992290 learned_addr learned my addr 172.21.15.17:0/3102992290 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:44:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7e59c640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d800b0b10 0x7f7d8014aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7dd9b640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d801587e0 0x7f7d80149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7ed9d640 1 -- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d800b0b10 msgr2=0x7f7d8014aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.402+0000 7f7d7ed9d640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d800b0b10 0x7f7d8014aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d7ed9d640 1 -- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d801587e0 msgr2=0x7f7d80149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d7ed9d640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d801587e0 0x7f7d80149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d7ed9d640 1 -- 172.21.15.17:0/3102992290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74009b30 con 0x7f7d8014a580 2023-08-09T12:44:36.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d7dd9b640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d801587e0 0x7f7d80149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:44:36.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d7ed9d640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d8014a580 0x7f7d800c29f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800d4e0 tx=0x7f7d7800d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:36.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d6effd640 1 -- 172.21.15.17:0/3102992290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d780125f0 con 0x7f7d8014a580 2023-08-09T12:44:36.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d6effd640 1 -- 172.21.15.17:0/3102992290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78012770 con 0x7f7d8014a580 2023-08-09T12:44:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d6effd640 1 -- 172.21.15.17:0/3102992290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78012b20 con 0x7f7d8014a580 2023-08-09T12:44:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d80155b20 con 0x7f7d8014a580 2023-08-09T12:44:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.403+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8014a310 con 0x7f7d8014a580 2023-08-09T12:44:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.404+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8006fa10 con 0x7f7d8014a580 2023-08-09T12:44:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.406+0000 7f7d6effd640 1 -- 172.21.15.17:0/3102992290 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7d78012c80 con 0x7f7d8014a580 2023-08-09T12:44:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.407+0000 7f7d6effd640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7d6006a080 0x7f7d6006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:44:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.407+0000 7f7d6effd640 1 -- 172.21.15.17:0/3102992290 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d78088a20 con 0x7f7d8014a580 2023-08-09T12:44:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.408+0000 7f7d7e59c640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7d6006a080 0x7f7d6006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:44:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.409+0000 7f7d7e59c640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7d6006a080 0x7f7d6006c540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7d70006fd0 tx=0x7f7d70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:44:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.411+0000 7f7d6effd640 1 -- 172.21.15.17:0/3102992290 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7d8006fa10 con 0x7f7d8014a580 2023-08-09T12:44:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.645+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d8006fa10 con 0x7f7d8014a580 2023-08-09T12:44:36.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.646+0000 7f7d6effd640 1 -- 172.21.15.17:0/3102992290 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f7d8006fa10 con 0x7f7d8014a580 2023-08-09T12:44:36.649 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:44:36.649 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2093028023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2093028023},{"type":"v1","addr":"172.21.15.142:6835","nonce":2093028023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2762526663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2762526663},{"type":"v1","addr":"172.21.15.142:6837","nonce":2762526663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2544978987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2544978987},{"type":"v1","addr":"172.21.15.17:6834","nonce":2544978987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:44:25.543433+0000","modified":"2023-08-09T12:44:29.110856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4077789912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4077789912},{"type":"v1","addr":"172.21.15.17:6835","nonce":4077789912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-09T12:44:36.650 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 43 2023-08-09T12:44:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7d6006a080 msgr2=0x7f7d6006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7d6006a080 0x7f7d6006c540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7d70006fd0 tx=0x7f7d70008040 comp rx=0 tx=0).stop 2023-08-09T12:44:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d8014a580 msgr2=0x7f7d800c29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:44:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d8014a580 0x7f7d800c29f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800d4e0 tx=0x7f7d7800d9a0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 shutdown_connections 2023-08-09T12:44:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7d6006a080 0x7f7d6006c540 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d8014a580 0x7f7d800c29f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d801587e0 0x7f7d80149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 --2- 172.21.15.17:0/3102992290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d800b0b10 0x7f7d8014aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:44:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 >> 172.21.15.17:0/3102992290 conn(0x7f7d800b1d50 msgr2=0x7f7d8006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:44:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 shutdown_connections 2023-08-09T12:44:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:44:36.649+0000 7f7d7f59e640 1 -- 172.21.15.17:0/3102992290 wait complete. 2023-08-09T12:44:36.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-08-09T12:44:36.923 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":6585,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.80348878,"mdsmap_epoch":43,"osdmap_epoch":92,"osdmap_epoch_barrier":92,"uptime":17.633295508} 2023-08-09T12:44:36.923 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 6585, "mdsmap_epoch": 43, "osdmap_epoch": 92, "osdmap_epoch_barrier": 92, "rank_uptime": 10.80348878, "state": "up:active", "uptime": 17.633295508, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:44:36.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-09T12:44:37.169 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_mon_report_interval":"5"} 2023-08-09T12:44:37.169 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-09T12:44:37.170 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-08-09T12:44:37.407 INFO:teuthology.orchestra.run.smithi017.stdout:{"mon_tick_interval":"5"} 2023-08-09T12:44:37.407 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-08-09T12:44:37.408 INFO:tasks.cephfs.test_full:pool capacity 556934720, 531MB should be enough to fill it 2023-08-09T12:44:37.408 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:44:37.409 DEBUG:teuthology.orchestra.run.smithi017:> import time 2023-08-09T12:44:37.409 DEBUG:teuthology.orchestra.run.smithi017:> import datetime 2023-08-09T12:44:37.409 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2023-08-09T12:44:37.409 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:44:37.410 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:44:37.410 DEBUG:teuthology.orchestra.run.smithi017:> # Write some buffered data through before going full, all should be well 2023-08-09T12:44:37.410 DEBUG:teuthology.orchestra.run.smithi017:> print("writing some data through which we expect to succeed") 2023-08-09T12:44:37.410 DEBUG:teuthology.orchestra.run.smithi017:> bytes = 0 2023-08-09T12:44:37.411 DEBUG:teuthology.orchestra.run.smithi017:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-08-09T12:44:37.411 DEBUG:teuthology.orchestra.run.smithi017:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-08-09T12:44:37.411 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-08-09T12:44:37.411 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f) 2023-08-09T12:44:37.412 DEBUG:teuthology.orchestra.run.smithi017:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-08-09T12:44:37.412 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:44:37.412 DEBUG:teuthology.orchestra.run.smithi017:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-08-09T12:44:37.413 DEBUG:teuthology.orchestra.run.smithi017:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-08-09T12:44:37.413 DEBUG:teuthology.orchestra.run.smithi017:> # buffered IO, the error should always only appear from fsync and not 2023-08-09T12:44:37.413 DEBUG:teuthology.orchestra.run.smithi017:> # from write 2023-08-09T12:44:37.413 DEBUG:teuthology.orchestra.run.smithi017:> full = False 2023-08-09T12:44:37.414 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:44:37.414 DEBUG:teuthology.orchestra.run.smithi017:> for n in range(0, int(531 * 1.1)): 2023-08-09T12:44:37.414 DEBUG:teuthology.orchestra.run.smithi017:> try: 2023-08-09T12:44:37.415 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-09T12:44:37.415 DEBUG:teuthology.orchestra.run.smithi017:> print("wrote bytes via buffered write, moving on to fsync") 2023-08-09T12:44:37.415 DEBUG:teuthology.orchestra.run.smithi017:> except OSError as e: 2023-08-09T12:44:37.415 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2023-08-09T12:44:37.416 DEBUG:teuthology.orchestra.run.smithi017:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-08-09T12:44:37.416 DEBUG:teuthology.orchestra.run.smithi017:> raise 2023-08-09T12:44:37.416 DEBUG:teuthology.orchestra.run.smithi017:> else: 2023-08-09T12:44:37.416 DEBUG:teuthology.orchestra.run.smithi017:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-09T12:44:37.417 DEBUG:teuthology.orchestra.run.smithi017:> full = True 2023-08-09T12:44:37.417 DEBUG:teuthology.orchestra.run.smithi017:> break 2023-08-09T12:44:37.417 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:44:37.418 DEBUG:teuthology.orchestra.run.smithi017:> try: 2023-08-09T12:44:37.418 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f) 2023-08-09T12:44:37.418 DEBUG:teuthology.orchestra.run.smithi017:> print("fsync'"'"'ed successfully") 2023-08-09T12:44:37.418 DEBUG:teuthology.orchestra.run.smithi017:> except OSError as e: 2023-08-09T12:44:37.419 DEBUG:teuthology.orchestra.run.smithi017:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-09T12:44:37.419 DEBUG:teuthology.orchestra.run.smithi017:> full = True 2023-08-09T12:44:37.419 DEBUG:teuthology.orchestra.run.smithi017:> break 2023-08-09T12:44:37.419 DEBUG:teuthology.orchestra.run.smithi017:> else: 2023-08-09T12:44:37.420 DEBUG:teuthology.orchestra.run.smithi017:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-09T12:44:37.420 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:44:37.420 DEBUG:teuthology.orchestra.run.smithi017:> if n > 531 * 0.9: 2023-08-09T12:44:37.420 DEBUG:teuthology.orchestra.run.smithi017:> # Be cautious in the last region where we expect to hit 2023-08-09T12:44:37.421 DEBUG:teuthology.orchestra.run.smithi017:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-08-09T12:44:37.421 DEBUG:teuthology.orchestra.run.smithi017:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-08-09T12:44:37.421 DEBUG:teuthology.orchestra.run.smithi017:> time.sleep(15.0) 2023-08-09T12:44:37.421 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:44:37.422 DEBUG:teuthology.orchestra.run.smithi017:> if not full: 2023-08-09T12:44:37.422 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-08-09T12:44:37.422 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:44:37.422 DEBUG:teuthology.orchestra.run.smithi017:> # close() should not raise an error because we already caught it in 2023-08-09T12:44:37.423 DEBUG:teuthology.orchestra.run.smithi017:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-08-09T12:44:37.423 DEBUG:teuthology.orchestra.run.smithi017:> # since then because all IOs got cancelled on the full flag. 2023-08-09T12:44:37.423 DEBUG:teuthology.orchestra.run.smithi017:> print("calling close") 2023-08-09T12:44:37.423 DEBUG:teuthology.orchestra.run.smithi017:> os.close(f) 2023-08-09T12:44:37.424 DEBUG:teuthology.orchestra.run.smithi017:> print("close() did not raise error") 2023-08-09T12:44:37.424 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:44:37.424 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-08-09T12:44:37.424 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:44:40.317 INFO:teuthology.orchestra.run.smithi017.stdout:writing some data through which we expect to succeed 2023-08-09T12:44:40.317 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-08-09T12:44:40.317 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.317 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.317 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 1.00 MB 2023-08-09T12:44:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 2.00 MB 2023-08-09T12:44:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 3.00 MB 2023-08-09T12:44:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 4.00 MB 2023-08-09T12:44:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 5.00 MB 2023-08-09T12:44:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 6.00 MB 2023-08-09T12:44:40.320 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.320 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.320 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 7.00 MB 2023-08-09T12:44:40.320 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.320 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.320 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 8.00 MB 2023-08-09T12:44:40.320 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.321 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.321 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 9.00 MB 2023-08-09T12:44:40.321 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.321 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.321 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 10.00 MB 2023-08-09T12:44:40.321 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.321 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.321 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 11.00 MB 2023-08-09T12:44:40.322 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.322 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.322 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 12.00 MB 2023-08-09T12:44:40.322 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.322 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.322 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 13.00 MB 2023-08-09T12:44:40.322 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.322 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.323 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 14.00 MB 2023-08-09T12:44:40.323 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.323 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.323 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 15.00 MB 2023-08-09T12:44:40.323 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.323 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.323 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 16.00 MB 2023-08-09T12:44:40.323 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.324 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.324 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 17.00 MB 2023-08-09T12:44:40.324 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.324 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.324 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 18.00 MB 2023-08-09T12:44:40.324 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.325 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.325 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 19.00 MB 2023-08-09T12:44:40.325 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.325 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.325 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 20.00 MB 2023-08-09T12:44:40.326 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.326 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.326 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 21.00 MB 2023-08-09T12:44:40.326 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.326 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.326 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 22.00 MB 2023-08-09T12:44:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 23.00 MB 2023-08-09T12:44:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 24.00 MB 2023-08-09T12:44:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.327 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.328 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 25.00 MB 2023-08-09T12:44:40.328 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.328 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.328 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 26.00 MB 2023-08-09T12:44:40.328 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.328 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.328 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 27.00 MB 2023-08-09T12:44:40.329 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.329 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.329 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 28.00 MB 2023-08-09T12:44:40.329 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.329 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.329 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 29.00 MB 2023-08-09T12:44:40.329 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.329 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.330 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 30.00 MB 2023-08-09T12:44:40.330 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.330 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.330 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 31.00 MB 2023-08-09T12:44:40.330 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.330 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.330 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 32.00 MB 2023-08-09T12:44:40.330 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.331 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.331 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 33.00 MB 2023-08-09T12:44:40.331 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.331 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.331 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 34.00 MB 2023-08-09T12:44:40.331 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.331 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.331 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 35.00 MB 2023-08-09T12:44:40.332 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.332 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.332 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 36.00 MB 2023-08-09T12:44:40.332 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.332 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.332 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 37.00 MB 2023-08-09T12:44:40.332 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.332 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.333 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 38.00 MB 2023-08-09T12:44:40.333 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.333 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.333 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 39.00 MB 2023-08-09T12:44:40.333 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.333 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.333 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 40.00 MB 2023-08-09T12:44:40.334 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.334 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.334 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 41.00 MB 2023-08-09T12:44:40.334 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.334 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.334 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 42.00 MB 2023-08-09T12:44:40.334 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.334 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.335 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 43.00 MB 2023-08-09T12:44:40.335 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.335 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.335 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 44.00 MB 2023-08-09T12:44:40.335 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.335 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.335 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 45.00 MB 2023-08-09T12:44:40.335 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.336 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.336 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 46.00 MB 2023-08-09T12:44:40.336 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.336 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.336 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 47.00 MB 2023-08-09T12:44:40.336 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.336 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.337 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 48.00 MB 2023-08-09T12:44:40.337 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.337 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.337 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 49.00 MB 2023-08-09T12:44:40.337 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.337 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.337 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 50.00 MB 2023-08-09T12:44:40.338 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.338 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.338 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 51.00 MB 2023-08-09T12:44:40.338 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.338 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.338 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 52.00 MB 2023-08-09T12:44:40.338 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.338 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.339 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 53.00 MB 2023-08-09T12:44:40.339 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.339 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.339 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 54.00 MB 2023-08-09T12:44:40.339 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.339 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.339 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 55.00 MB 2023-08-09T12:44:40.339 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.340 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.340 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 56.00 MB 2023-08-09T12:44:40.340 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.340 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.340 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 57.00 MB 2023-08-09T12:44:40.340 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.340 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 58.00 MB 2023-08-09T12:44:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 59.00 MB 2023-08-09T12:44:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.341 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 60.00 MB 2023-08-09T12:44:40.342 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.342 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.342 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 61.00 MB 2023-08-09T12:44:40.342 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.342 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.342 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 62.00 MB 2023-08-09T12:44:40.342 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.342 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.343 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 63.00 MB 2023-08-09T12:44:40.343 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.343 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.343 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 64.00 MB 2023-08-09T12:44:40.343 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.343 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.343 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 65.00 MB 2023-08-09T12:44:40.343 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.344 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.344 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 66.00 MB 2023-08-09T12:44:40.344 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.344 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.344 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 67.00 MB 2023-08-09T12:44:40.344 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.344 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.345 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 68.00 MB 2023-08-09T12:44:40.345 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.345 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.345 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 69.00 MB 2023-08-09T12:44:40.345 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.345 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.345 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 70.00 MB 2023-08-09T12:44:40.345 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 71.00 MB 2023-08-09T12:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 72.00 MB 2023-08-09T12:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.346 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 73.00 MB 2023-08-09T12:44:40.347 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.347 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.347 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 74.00 MB 2023-08-09T12:44:40.347 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.347 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.347 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 75.00 MB 2023-08-09T12:44:40.347 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.347 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.348 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 76.00 MB 2023-08-09T12:44:40.348 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.348 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.348 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 77.00 MB 2023-08-09T12:44:40.348 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.348 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.348 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 78.00 MB 2023-08-09T12:44:40.348 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.349 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.349 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 79.00 MB 2023-08-09T12:44:40.349 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:40.349 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:40.349 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 80.00 MB 2023-08-09T12:44:40.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:44:40.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:44:41.294 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.295 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.295 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 81.00 MB 2023-08-09T12:44:41.295 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.295 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.295 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 82.00 MB 2023-08-09T12:44:41.296 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.296 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.296 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 83.00 MB 2023-08-09T12:44:41.296 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.296 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.296 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 84.00 MB 2023-08-09T12:44:41.296 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.297 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.297 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 85.00 MB 2023-08-09T12:44:41.297 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.297 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.297 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 86.00 MB 2023-08-09T12:44:41.297 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.297 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.297 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 87.00 MB 2023-08-09T12:44:41.298 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.298 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.298 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 88.00 MB 2023-08-09T12:44:41.298 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.298 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.298 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 89.00 MB 2023-08-09T12:44:41.298 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.299 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.299 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 90.00 MB 2023-08-09T12:44:41.299 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.299 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.299 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 91.00 MB 2023-08-09T12:44:41.299 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.299 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.299 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 92.00 MB 2023-08-09T12:44:41.300 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.300 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.300 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 93.00 MB 2023-08-09T12:44:41.300 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.300 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.300 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 94.00 MB 2023-08-09T12:44:41.300 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.300 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.301 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 95.00 MB 2023-08-09T12:44:41.301 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.301 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.301 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 96.00 MB 2023-08-09T12:44:41.301 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.301 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.301 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 97.00 MB 2023-08-09T12:44:41.302 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.302 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.302 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 98.00 MB 2023-08-09T12:44:41.302 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.302 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.302 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 99.00 MB 2023-08-09T12:44:41.302 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.302 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.303 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 100.00 MB 2023-08-09T12:44:41.303 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.303 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.303 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 101.00 MB 2023-08-09T12:44:41.303 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.303 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.303 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 102.00 MB 2023-08-09T12:44:41.303 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.304 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.304 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 103.00 MB 2023-08-09T12:44:41.304 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.304 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.304 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 104.00 MB 2023-08-09T12:44:41.304 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.304 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.304 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 105.00 MB 2023-08-09T12:44:41.305 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.305 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.305 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 106.00 MB 2023-08-09T12:44:41.305 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.305 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.305 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 107.00 MB 2023-08-09T12:44:41.305 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.306 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.306 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 108.00 MB 2023-08-09T12:44:41.306 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.306 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.306 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 109.00 MB 2023-08-09T12:44:41.306 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.306 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.306 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 110.00 MB 2023-08-09T12:44:41.307 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.307 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.307 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 111.00 MB 2023-08-09T12:44:41.307 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.307 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.307 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 112.00 MB 2023-08-09T12:44:41.307 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.307 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.308 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 113.00 MB 2023-08-09T12:44:41.308 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.308 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.308 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 114.00 MB 2023-08-09T12:44:41.309 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.309 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.309 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 115.00 MB 2023-08-09T12:44:41.309 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.309 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.309 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 116.00 MB 2023-08-09T12:44:41.309 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.310 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.310 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 117.00 MB 2023-08-09T12:44:41.310 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.310 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.310 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 118.00 MB 2023-08-09T12:44:41.310 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.311 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.311 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 119.00 MB 2023-08-09T12:44:41.311 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.311 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.311 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 120.00 MB 2023-08-09T12:44:41.311 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.311 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 121.00 MB 2023-08-09T12:44:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 122.00 MB 2023-08-09T12:44:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 123.00 MB 2023-08-09T12:44:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.313 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.313 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 124.00 MB 2023-08-09T12:44:41.313 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.313 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.313 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 125.00 MB 2023-08-09T12:44:41.313 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.313 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 126.00 MB 2023-08-09T12:44:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 127.00 MB 2023-08-09T12:44:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 128.00 MB 2023-08-09T12:44:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 129.00 MB 2023-08-09T12:44:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 130.00 MB 2023-08-09T12:44:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 131.00 MB 2023-08-09T12:44:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 132.00 MB 2023-08-09T12:44:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 133.00 MB 2023-08-09T12:44:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.317 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 134.00 MB 2023-08-09T12:44:41.317 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.317 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.317 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 135.00 MB 2023-08-09T12:44:41.317 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.317 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.317 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 136.00 MB 2023-08-09T12:44:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 137.00 MB 2023-08-09T12:44:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 138.00 MB 2023-08-09T12:44:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.319 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 139.00 MB 2023-08-09T12:44:41.319 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.319 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.319 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 140.00 MB 2023-08-09T12:44:41.319 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.319 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.319 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 141.00 MB 2023-08-09T12:44:41.319 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.320 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.320 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 142.00 MB 2023-08-09T12:44:41.320 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.320 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.320 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 143.00 MB 2023-08-09T12:44:41.320 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.320 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.320 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 144.00 MB 2023-08-09T12:44:41.321 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.321 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.321 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 145.00 MB 2023-08-09T12:44:41.321 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.321 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.321 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 146.00 MB 2023-08-09T12:44:41.321 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.321 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.322 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 147.00 MB 2023-08-09T12:44:41.322 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.322 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.322 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 148.00 MB 2023-08-09T12:44:41.322 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.322 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.322 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 149.00 MB 2023-08-09T12:44:41.322 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.323 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.323 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 150.00 MB 2023-08-09T12:44:41.323 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.323 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.323 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 151.00 MB 2023-08-09T12:44:41.323 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.323 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.324 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 152.00 MB 2023-08-09T12:44:41.324 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.324 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.324 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 153.00 MB 2023-08-09T12:44:41.324 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.324 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.324 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 154.00 MB 2023-08-09T12:44:41.324 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 155.00 MB 2023-08-09T12:44:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 156.00 MB 2023-08-09T12:44:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.325 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 157.00 MB 2023-08-09T12:44:41.326 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.326 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.326 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 158.00 MB 2023-08-09T12:44:41.326 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.326 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.326 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 159.00 MB 2023-08-09T12:44:41.326 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:41.327 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:41.327 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 160.00 MB 2023-08-09T12:44:41.327 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.262 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.262 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 161.00 MB 2023-08-09T12:44:42.262 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.263 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.263 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 162.00 MB 2023-08-09T12:44:42.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.263 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.263 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 163.00 MB 2023-08-09T12:44:42.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.263 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.264 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 164.00 MB 2023-08-09T12:44:42.264 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.264 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.264 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 165.00 MB 2023-08-09T12:44:42.264 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.264 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.264 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 166.00 MB 2023-08-09T12:44:42.265 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.265 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.265 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 167.00 MB 2023-08-09T12:44:42.265 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.265 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.265 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 168.00 MB 2023-08-09T12:44:42.265 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.265 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 169.00 MB 2023-08-09T12:44:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 170.00 MB 2023-08-09T12:44:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 171.00 MB 2023-08-09T12:44:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 172.00 MB 2023-08-09T12:44:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 173.00 MB 2023-08-09T12:44:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 174.00 MB 2023-08-09T12:44:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 175.00 MB 2023-08-09T12:44:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 176.00 MB 2023-08-09T12:44:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 177.00 MB 2023-08-09T12:44:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 178.00 MB 2023-08-09T12:44:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 179.00 MB 2023-08-09T12:44:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 180.00 MB 2023-08-09T12:44:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 181.00 MB 2023-08-09T12:44:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.271 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 182.00 MB 2023-08-09T12:44:42.271 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.271 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 183.00 MB 2023-08-09T12:44:42.271 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.271 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 184.00 MB 2023-08-09T12:44:42.272 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.272 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.272 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 185.00 MB 2023-08-09T12:44:42.272 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.272 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.272 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 186.00 MB 2023-08-09T12:44:42.272 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 187.00 MB 2023-08-09T12:44:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 188.00 MB 2023-08-09T12:44:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 189.00 MB 2023-08-09T12:44:42.274 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.274 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.274 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 190.00 MB 2023-08-09T12:44:42.274 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.274 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.274 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 191.00 MB 2023-08-09T12:44:42.274 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.274 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.275 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 192.00 MB 2023-08-09T12:44:42.275 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.275 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.275 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 193.00 MB 2023-08-09T12:44:42.275 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.275 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.275 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 194.00 MB 2023-08-09T12:44:42.275 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.276 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.276 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 195.00 MB 2023-08-09T12:44:42.276 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.276 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.276 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 196.00 MB 2023-08-09T12:44:42.276 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.276 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.277 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 197.00 MB 2023-08-09T12:44:42.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.277 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.277 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 198.00 MB 2023-08-09T12:44:42.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.277 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.277 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 199.00 MB 2023-08-09T12:44:42.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.278 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 200.00 MB 2023-08-09T12:44:42.278 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.278 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 201.00 MB 2023-08-09T12:44:42.278 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.278 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 202.00 MB 2023-08-09T12:44:42.279 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.279 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 203.00 MB 2023-08-09T12:44:42.279 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.279 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 204.00 MB 2023-08-09T12:44:42.279 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 205.00 MB 2023-08-09T12:44:42.280 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.280 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 206.00 MB 2023-08-09T12:44:42.280 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.280 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 207.00 MB 2023-08-09T12:44:42.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.281 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 208.00 MB 2023-08-09T12:44:42.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.281 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 209.00 MB 2023-08-09T12:44:42.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 210.00 MB 2023-08-09T12:44:42.282 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.282 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 211.00 MB 2023-08-09T12:44:42.282 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.282 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 212.00 MB 2023-08-09T12:44:42.283 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.283 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 213.00 MB 2023-08-09T12:44:42.283 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.283 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 214.00 MB 2023-08-09T12:44:42.283 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.284 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 215.00 MB 2023-08-09T12:44:42.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.284 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.284 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 216.00 MB 2023-08-09T12:44:42.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.284 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.284 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 217.00 MB 2023-08-09T12:44:42.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.285 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 218.00 MB 2023-08-09T12:44:42.285 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.285 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 219.00 MB 2023-08-09T12:44:42.285 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.286 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 220.00 MB 2023-08-09T12:44:42.286 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.286 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.286 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 221.00 MB 2023-08-09T12:44:42.286 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.286 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.286 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 222.00 MB 2023-08-09T12:44:42.286 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 223.00 MB 2023-08-09T12:44:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 224.00 MB 2023-08-09T12:44:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 225.00 MB 2023-08-09T12:44:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 226.00 MB 2023-08-09T12:44:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 227.00 MB 2023-08-09T12:44:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.289 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 228.00 MB 2023-08-09T12:44:42.289 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.289 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.289 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 229.00 MB 2023-08-09T12:44:42.289 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.289 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.289 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 230.00 MB 2023-08-09T12:44:42.290 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.290 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.290 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 231.00 MB 2023-08-09T12:44:42.290 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.290 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.290 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 232.00 MB 2023-08-09T12:44:42.290 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.290 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.291 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 233.00 MB 2023-08-09T12:44:42.291 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.291 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.291 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 234.00 MB 2023-08-09T12:44:42.291 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.291 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.291 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 235.00 MB 2023-08-09T12:44:42.291 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.292 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 236.00 MB 2023-08-09T12:44:42.292 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.292 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 237.00 MB 2023-08-09T12:44:42.292 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.292 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 238.00 MB 2023-08-09T12:44:42.293 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.293 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.293 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 239.00 MB 2023-08-09T12:44:42.293 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.293 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:42.293 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 240.00 MB 2023-08-09T12:44:42.293 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:42.294 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.263 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 241.00 MB 2023-08-09T12:44:43.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.263 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.263 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 242.00 MB 2023-08-09T12:44:43.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.263 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.264 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 243.00 MB 2023-08-09T12:44:43.264 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.264 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.264 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 244.00 MB 2023-08-09T12:44:43.264 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.264 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.264 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 245.00 MB 2023-08-09T12:44:43.265 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.265 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.265 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 246.00 MB 2023-08-09T12:44:43.265 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.265 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.266 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 247.00 MB 2023-08-09T12:44:43.266 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.266 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.266 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 248.00 MB 2023-08-09T12:44:43.266 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.266 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.266 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 249.00 MB 2023-08-09T12:44:43.266 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.267 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.267 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 250.00 MB 2023-08-09T12:44:43.267 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.267 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.267 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 251.00 MB 2023-08-09T12:44:43.267 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.267 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 252.00 MB 2023-08-09T12:44:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 253.00 MB 2023-08-09T12:44:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 254.00 MB 2023-08-09T12:44:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.269 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 255.00 MB 2023-08-09T12:44:43.269 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.269 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 256.00 MB 2023-08-09T12:44:43.269 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 257.00 MB 2023-08-09T12:44:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 258.00 MB 2023-08-09T12:44:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 259.00 MB 2023-08-09T12:44:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.271 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 260.00 MB 2023-08-09T12:44:43.271 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.271 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 261.00 MB 2023-08-09T12:44:43.271 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.271 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 262.00 MB 2023-08-09T12:44:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 263.00 MB 2023-08-09T12:44:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 264.00 MB 2023-08-09T12:44:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.273 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 265.00 MB 2023-08-09T12:44:43.273 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.273 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.273 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 266.00 MB 2023-08-09T12:44:43.273 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.273 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.273 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 267.00 MB 2023-08-09T12:44:43.273 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.274 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.274 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 268.00 MB 2023-08-09T12:44:43.274 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.274 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.274 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 269.00 MB 2023-08-09T12:44:43.274 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.274 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.275 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 270.00 MB 2023-08-09T12:44:43.275 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.275 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.275 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 271.00 MB 2023-08-09T12:44:43.275 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.275 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.275 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 272.00 MB 2023-08-09T12:44:43.276 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.276 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.276 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 273.00 MB 2023-08-09T12:44:43.276 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.276 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.277 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 274.00 MB 2023-08-09T12:44:43.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.277 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.277 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 275.00 MB 2023-08-09T12:44:43.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.277 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.277 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 276.00 MB 2023-08-09T12:44:43.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.278 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 277.00 MB 2023-08-09T12:44:43.278 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.278 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 278.00 MB 2023-08-09T12:44:43.278 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.278 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 279.00 MB 2023-08-09T12:44:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 280.00 MB 2023-08-09T12:44:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 281.00 MB 2023-08-09T12:44:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 282.00 MB 2023-08-09T12:44:43.280 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.280 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 283.00 MB 2023-08-09T12:44:43.280 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.280 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 284.00 MB 2023-08-09T12:44:43.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.281 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 285.00 MB 2023-08-09T12:44:43.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.281 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 286.00 MB 2023-08-09T12:44:43.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 287.00 MB 2023-08-09T12:44:43.282 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.282 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 288.00 MB 2023-08-09T12:44:43.282 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.282 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 289.00 MB 2023-08-09T12:44:43.282 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.283 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 290.00 MB 2023-08-09T12:44:43.283 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.283 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 291.00 MB 2023-08-09T12:44:43.283 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.283 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 292.00 MB 2023-08-09T12:44:43.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.284 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.284 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 293.00 MB 2023-08-09T12:44:43.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.284 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.284 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 294.00 MB 2023-08-09T12:44:43.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 295.00 MB 2023-08-09T12:44:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 296.00 MB 2023-08-09T12:44:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.285 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 297.00 MB 2023-08-09T12:44:43.286 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.286 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.286 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 298.00 MB 2023-08-09T12:44:43.286 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.286 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 299.00 MB 2023-08-09T12:44:43.287 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.287 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 300.00 MB 2023-08-09T12:44:43.287 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.287 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 301.00 MB 2023-08-09T12:44:43.287 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.288 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.288 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 302.00 MB 2023-08-09T12:44:43.288 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.288 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.288 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 303.00 MB 2023-08-09T12:44:43.288 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.288 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 304.00 MB 2023-08-09T12:44:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 305.00 MB 2023-08-09T12:44:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 306.00 MB 2023-08-09T12:44:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.290 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.290 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 307.00 MB 2023-08-09T12:44:43.290 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.290 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.290 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 308.00 MB 2023-08-09T12:44:43.290 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.290 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.290 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 309.00 MB 2023-08-09T12:44:43.291 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.291 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.291 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 310.00 MB 2023-08-09T12:44:43.291 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.291 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.291 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 311.00 MB 2023-08-09T12:44:43.291 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.291 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 312.00 MB 2023-08-09T12:44:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 313.00 MB 2023-08-09T12:44:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 314.00 MB 2023-08-09T12:44:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.293 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.293 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 315.00 MB 2023-08-09T12:44:43.293 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.293 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.293 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 316.00 MB 2023-08-09T12:44:43.293 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.293 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.294 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 317.00 MB 2023-08-09T12:44:43.294 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.294 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.294 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 318.00 MB 2023-08-09T12:44:43.294 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.294 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.294 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 319.00 MB 2023-08-09T12:44:43.294 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.295 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.295 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 320.00 MB 2023-08-09T12:44:43.295 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:43.295 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:43.295 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 321.00 MB 2023-08-09T12:44:44.266 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.266 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.267 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 322.00 MB 2023-08-09T12:44:44.267 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.267 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.267 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 323.00 MB 2023-08-09T12:44:44.267 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.267 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.267 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 324.00 MB 2023-08-09T12:44:44.268 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.268 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.268 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 325.00 MB 2023-08-09T12:44:44.268 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.268 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.268 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 326.00 MB 2023-08-09T12:44:44.268 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 327.00 MB 2023-08-09T12:44:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 328.00 MB 2023-08-09T12:44:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 329.00 MB 2023-08-09T12:44:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 330.00 MB 2023-08-09T12:44:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 331.00 MB 2023-08-09T12:44:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 332.00 MB 2023-08-09T12:44:44.271 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.271 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 333.00 MB 2023-08-09T12:44:44.271 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.271 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.271 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 334.00 MB 2023-08-09T12:44:44.272 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.272 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.272 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 335.00 MB 2023-08-09T12:44:44.272 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.272 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.272 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 336.00 MB 2023-08-09T12:44:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 337.00 MB 2023-08-09T12:44:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 338.00 MB 2023-08-09T12:44:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 339.00 MB 2023-08-09T12:44:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 340.00 MB 2023-08-09T12:44:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 341.00 MB 2023-08-09T12:44:44.275 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.275 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.275 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 342.00 MB 2023-08-09T12:44:44.275 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.275 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.275 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 343.00 MB 2023-08-09T12:44:44.275 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.275 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.276 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 344.00 MB 2023-08-09T12:44:44.276 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.276 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.276 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 345.00 MB 2023-08-09T12:44:44.276 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.276 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.276 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 346.00 MB 2023-08-09T12:44:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 347.00 MB 2023-08-09T12:44:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 348.00 MB 2023-08-09T12:44:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.277 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 349.00 MB 2023-08-09T12:44:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 350.00 MB 2023-08-09T12:44:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 351.00 MB 2023-08-09T12:44:44.278 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.279 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 352.00 MB 2023-08-09T12:44:44.279 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.279 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 353.00 MB 2023-08-09T12:44:44.279 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.279 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 354.00 MB 2023-08-09T12:44:44.280 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.280 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 355.00 MB 2023-08-09T12:44:44.280 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.280 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.280 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 356.00 MB 2023-08-09T12:44:44.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.281 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 357.00 MB 2023-08-09T12:44:44.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.281 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 358.00 MB 2023-08-09T12:44:44.281 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.281 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 359.00 MB 2023-08-09T12:44:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 360.00 MB 2023-08-09T12:44:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 361.00 MB 2023-08-09T12:44:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.283 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 362.00 MB 2023-08-09T12:44:44.283 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.283 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 363.00 MB 2023-08-09T12:44:44.283 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.283 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.283 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 364.00 MB 2023-08-09T12:44:44.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.284 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.284 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 365.00 MB 2023-08-09T12:44:44.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.284 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.284 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 366.00 MB 2023-08-09T12:44:44.284 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.285 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 367.00 MB 2023-08-09T12:44:44.285 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.285 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 368.00 MB 2023-08-09T12:44:44.285 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.285 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 369.00 MB 2023-08-09T12:44:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 370.00 MB 2023-08-09T12:44:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 371.00 MB 2023-08-09T12:44:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.287 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 372.00 MB 2023-08-09T12:44:44.287 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.287 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 373.00 MB 2023-08-09T12:44:44.287 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.287 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.287 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 374.00 MB 2023-08-09T12:44:44.288 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.288 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.288 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 375.00 MB 2023-08-09T12:44:44.288 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.288 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.288 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 376.00 MB 2023-08-09T12:44:44.288 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.289 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.289 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 377.00 MB 2023-08-09T12:44:44.289 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.289 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.289 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 378.00 MB 2023-08-09T12:44:44.289 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.289 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.290 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 379.00 MB 2023-08-09T12:44:44.290 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.290 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.290 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 380.00 MB 2023-08-09T12:44:44.290 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.290 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.290 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 381.00 MB 2023-08-09T12:44:44.290 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.291 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.291 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 382.00 MB 2023-08-09T12:44:44.291 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.291 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.291 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 383.00 MB 2023-08-09T12:44:44.291 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.291 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 384.00 MB 2023-08-09T12:44:44.292 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.292 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 385.00 MB 2023-08-09T12:44:44.292 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.292 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.292 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 386.00 MB 2023-08-09T12:44:44.292 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.293 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.293 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 387.00 MB 2023-08-09T12:44:44.293 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.293 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.293 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 388.00 MB 2023-08-09T12:44:44.293 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.293 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.294 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 389.00 MB 2023-08-09T12:44:44.294 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.294 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.294 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 390.00 MB 2023-08-09T12:44:44.294 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.294 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.294 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 391.00 MB 2023-08-09T12:44:44.294 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.295 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.295 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 392.00 MB 2023-08-09T12:44:44.295 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.295 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.295 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 393.00 MB 2023-08-09T12:44:44.295 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.295 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.295 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 394.00 MB 2023-08-09T12:44:44.296 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.296 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.296 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 395.00 MB 2023-08-09T12:44:44.296 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.296 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.296 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 396.00 MB 2023-08-09T12:44:44.296 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 397.00 MB 2023-08-09T12:44:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 398.00 MB 2023-08-09T12:44:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 399.00 MB 2023-08-09T12:44:44.298 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.298 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.298 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 400.00 MB 2023-08-09T12:44:44.298 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:44:44.298 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:44:44.299 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 401.00 MB 2023-08-09T12:44:46.795 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:44:46.792+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-08-09T12:44:53.757 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:44:53.754+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-08-09T12:45:10.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:45:10.608 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:45:15.335 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.335 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.336 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 402.00 MB 2023-08-09T12:45:15.336 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.336 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.337 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 403.00 MB 2023-08-09T12:45:15.337 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.337 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.337 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 404.00 MB 2023-08-09T12:45:15.338 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.338 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.338 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 405.00 MB 2023-08-09T12:45:15.338 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.338 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.338 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 406.00 MB 2023-08-09T12:45:15.338 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.339 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.339 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 407.00 MB 2023-08-09T12:45:15.339 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.339 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.339 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 408.00 MB 2023-08-09T12:45:15.340 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.340 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.340 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 409.00 MB 2023-08-09T12:45:15.340 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.340 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.340 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 410.00 MB 2023-08-09T12:45:15.341 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.341 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.341 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 411.00 MB 2023-08-09T12:45:15.341 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.341 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.341 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 412.00 MB 2023-08-09T12:45:15.342 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.342 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.342 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 413.00 MB 2023-08-09T12:45:15.342 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.343 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.343 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 414.00 MB 2023-08-09T12:45:15.343 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.344 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.344 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 415.00 MB 2023-08-09T12:45:15.345 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.346 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.346 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 416.00 MB 2023-08-09T12:45:15.346 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.346 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.346 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 417.00 MB 2023-08-09T12:45:15.346 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.347 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.347 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 418.00 MB 2023-08-09T12:45:15.347 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.347 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.347 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 419.00 MB 2023-08-09T12:45:15.347 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.347 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.347 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 420.00 MB 2023-08-09T12:45:15.348 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.348 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.348 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 421.00 MB 2023-08-09T12:45:15.348 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.348 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.348 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 422.00 MB 2023-08-09T12:45:15.348 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.349 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.349 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 423.00 MB 2023-08-09T12:45:15.349 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.349 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.349 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 424.00 MB 2023-08-09T12:45:15.349 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.349 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.350 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 425.00 MB 2023-08-09T12:45:15.350 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.350 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.350 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 426.00 MB 2023-08-09T12:45:15.350 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.350 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.350 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 427.00 MB 2023-08-09T12:45:15.350 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.351 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.351 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 428.00 MB 2023-08-09T12:45:15.351 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.351 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.351 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 429.00 MB 2023-08-09T12:45:15.351 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.351 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.351 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 430.00 MB 2023-08-09T12:45:15.352 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.352 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.352 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 431.00 MB 2023-08-09T12:45:15.352 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.352 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.352 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 432.00 MB 2023-08-09T12:45:15.352 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 433.00 MB 2023-08-09T12:45:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 434.00 MB 2023-08-09T12:45:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 435.00 MB 2023-08-09T12:45:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 436.00 MB 2023-08-09T12:45:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 437.00 MB 2023-08-09T12:45:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.355 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 438.00 MB 2023-08-09T12:45:15.355 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.355 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.356 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 439.00 MB 2023-08-09T12:45:15.356 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.356 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.356 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 440.00 MB 2023-08-09T12:45:15.356 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.356 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.357 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 441.00 MB 2023-08-09T12:45:15.357 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.357 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.357 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 442.00 MB 2023-08-09T12:45:15.357 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.357 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.357 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 443.00 MB 2023-08-09T12:45:15.358 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.358 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.358 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 444.00 MB 2023-08-09T12:45:15.358 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.358 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.358 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 445.00 MB 2023-08-09T12:45:15.358 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.358 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.359 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 446.00 MB 2023-08-09T12:45:15.359 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.359 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.359 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 447.00 MB 2023-08-09T12:45:15.359 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.359 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.359 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 448.00 MB 2023-08-09T12:45:15.360 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.360 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.360 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 449.00 MB 2023-08-09T12:45:15.360 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.360 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.360 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 450.00 MB 2023-08-09T12:45:15.360 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.361 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.361 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 451.00 MB 2023-08-09T12:45:15.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.361 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.361 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 452.00 MB 2023-08-09T12:45:15.361 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.361 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.361 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 453.00 MB 2023-08-09T12:45:15.362 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.362 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.362 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 454.00 MB 2023-08-09T12:45:15.362 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.362 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.362 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 455.00 MB 2023-08-09T12:45:15.362 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.362 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.363 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 456.00 MB 2023-08-09T12:45:15.363 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.363 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.363 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 457.00 MB 2023-08-09T12:45:15.363 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.363 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.363 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 458.00 MB 2023-08-09T12:45:15.363 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.364 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.364 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 459.00 MB 2023-08-09T12:45:15.364 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.364 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.364 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 460.00 MB 2023-08-09T12:45:15.364 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.364 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 461.00 MB 2023-08-09T12:45:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 462.00 MB 2023-08-09T12:45:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 463.00 MB 2023-08-09T12:45:15.365 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 464.00 MB 2023-08-09T12:45:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 465.00 MB 2023-08-09T12:45:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 466.00 MB 2023-08-09T12:45:15.367 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.367 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.367 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 467.00 MB 2023-08-09T12:45:15.367 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.367 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.367 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 468.00 MB 2023-08-09T12:45:15.367 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.368 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.368 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 469.00 MB 2023-08-09T12:45:15.368 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.368 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.368 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 470.00 MB 2023-08-09T12:45:15.368 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.368 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.368 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 471.00 MB 2023-08-09T12:45:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 472.00 MB 2023-08-09T12:45:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 473.00 MB 2023-08-09T12:45:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.369 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.370 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 474.00 MB 2023-08-09T12:45:15.370 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.370 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.370 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 475.00 MB 2023-08-09T12:45:15.370 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.370 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.370 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 476.00 MB 2023-08-09T12:45:15.370 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.371 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.371 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 477.00 MB 2023-08-09T12:45:15.371 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.371 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.371 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 478.00 MB 2023-08-09T12:45:15.371 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.371 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 479.00 MB 2023-08-09T12:45:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:45:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:45:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:45:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 480.00 MB 2023-08-09T12:45:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:45:15.476 INFO:teuthology.orchestra.run.smithi017.stdout:Reached fullness after 480.00 MB 2023-08-09T12:45:15.476 INFO:teuthology.orchestra.run.smithi017.stdout:calling close 2023-08-09T12:45:15.477 INFO:teuthology.orchestra.run.smithi017.stdout:close() did not raise error 2023-08-09T12:45:15.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:45:15.503 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:45:15.504 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:45:15.638 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:45:15.759 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:45:15.760 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:45:15.760 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:15.826 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:45:15.827 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:15.886 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:16.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.113+0000 7f71b4f71640 1 Processor -- start 2023-08-09T12:45:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.113+0000 7f71b4f71640 1 -- start start 2023-08-09T12:45:16.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.115+0000 7f71b4f71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b0159d80 0x7f71b00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.115+0000 7f71b4f71640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f71b00ad810 0x7f71b0070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.115+0000 7f71b4f71640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71b00708c0 0x7f71b006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.115+0000 7f71b4f71640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b015a160 con 0x7f71b00ad810 2023-08-09T12:45:16.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.115+0000 7f71b4f71640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b0070d20 con 0x7f71b00708c0 2023-08-09T12:45:16.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.115+0000 7f71b4f71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00b4630 con 0x7f71b0159d80 2023-08-09T12:45:16.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.115+0000 7f71a7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f71b00ad810 0x7f71b0070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71a7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f71b00ad810 0x7f71b0070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39248/0 (socket says 172.21.15.17:39248) 2023-08-09T12:45:16.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71a7fff640 1 -- 172.21.15.17:0/1759721461 learned_addr learned my addr 172.21.15.17:0/1759721461 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:16.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71aed9d640 1 --2- 172.21.15.17:0/1759721461 >> v2:172.21.15.142:3300/0 conn(0x7f71b00708c0 0x7f71b006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71ae59c640 1 --2- 172.21.15.17:0/1759721461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b0159d80 0x7f71b00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71a7fff640 1 -- 172.21.15.17:0/1759721461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b0159d80 msgr2=0x7f71b00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:16.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71a7fff640 1 --2- 172.21.15.17:0/1759721461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b0159d80 0x7f71b00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71a7fff640 1 -- 172.21.15.17:0/1759721461 >> v2:172.21.15.142:3300/0 conn(0x7f71b00708c0 msgr2=0x7f71b006eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:16.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71a7fff640 1 --2- 172.21.15.17:0/1759721461 >> v2:172.21.15.142:3300/0 conn(0x7f71b00708c0 0x7f71b006eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.116+0000 7f71a7fff640 1 -- 172.21.15.17:0/1759721461 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b00b3ab0 con 0x7f71b00ad810 2023-08-09T12:45:16.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.118+0000 7f71a7fff640 1 --2- 172.21.15.17:0/1759721461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b0070380 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f71b00cad10 tx=0x7f719802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103a637a91c8c335 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:16.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.118+0000 7f71add9b640 1 -- 172.21.15.17:0/1759721461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198031640 con 0x7f71b00ad810 2023-08-09T12:45:16.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.118+0000 7f71add9b640 1 -- 172.21.15.17:0/1759721461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71980317a0 con 0x7f71b00ad810 2023-08-09T12:45:16.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.118+0000 7f71add9b640 1 -- 172.21.15.17:0/1759721461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198031b30 con 0x7f71b00ad810 2023-08-09T12:45:16.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 -- 172.21.15.17:0/1759721461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 msgr2=0x7f71b0070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 --2- 172.21.15.17:0/1759721461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b0070380 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f71b00cad10 tx=0x7f719802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 -- 172.21.15.17:0/1759721461 shutdown_connections 2023-08-09T12:45:16.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 --2- 172.21.15.17:0/1759721461 >> v2:172.21.15.142:3300/0 conn(0x7f71b00708c0 0x7f71b006eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 --2- 172.21.15.17:0/1759721461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b0070380 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 --2- 172.21.15.17:0/1759721461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b0159d80 0x7f71b00b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 -- 172.21.15.17:0/1759721461 >> 172.21.15.17:0/1759721461 conn(0x7f71b00cb1b0 msgr2=0x7f71b00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 -- 172.21.15.17:0/1759721461 shutdown_connections 2023-08-09T12:45:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.119+0000 7f71b4f71640 1 -- 172.21.15.17:0/1759721461 wait complete. 2023-08-09T12:45:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.121+0000 7f71b4f71640 1 Processor -- start 2023-08-09T12:45:16.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.121+0000 7f71b4f71640 1 -- start start 2023-08-09T12:45:16.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71b4f71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b00708c0 0x7f71b014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71b4f71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b014f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71b4f71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71b0159d80 0x7f71b014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71b4f71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c7af0 con 0x7f71b00ad810 2023-08-09T12:45:16.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71b4f71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c7f10 con 0x7f71b0159d80 2023-08-09T12:45:16.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71b4f71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b014d260 con 0x7f71b00708c0 2023-08-09T12:45:16.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b014f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b014f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39258/0 (socket says 172.21.15.17:39258) 2023-08-09T12:45:16.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.122+0000 7f71a7fff640 1 -- 172.21.15.17:0/479280436 learned_addr learned my addr 172.21.15.17:0/479280436 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:16.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.123+0000 7f71ae59c640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b00708c0 0x7f71b014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.123+0000 7f71aed9d640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71b0159d80 0x7f71b014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.123+0000 7f71a7fff640 1 -- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b00708c0 msgr2=0x7f71b014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.123+0000 7f71a7fff640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b00708c0 0x7f71b014cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.123+0000 7f71a7fff640 1 -- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71b0159d80 msgr2=0x7f71b014f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.123+0000 7f71a7fff640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71b0159d80 0x7f71b014f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.123+0000 7f71a7fff640 1 -- 172.21.15.17:0/479280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198009470 con 0x7f71b00ad810 2023-08-09T12:45:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.123+0000 7f71a7fff640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b014f060 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7198000c00 tx=0x7f71980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.124+0000 7f71a6ffd640 1 -- 172.21.15.17:0/479280436 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719803ac60 con 0x7f71b00ad810 2023-08-09T12:45:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.124+0000 7f71a6ffd640 1 -- 172.21.15.17:0/479280436 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719803adc0 con 0x7f71b00ad810 2023-08-09T12:45:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.124+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b00c6c20 con 0x7f71b00ad810 2023-08-09T12:45:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.124+0000 7f71a6ffd640 1 -- 172.21.15.17:0/479280436 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198044630 con 0x7f71b00ad810 2023-08-09T12:45:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.124+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b00c6e70 con 0x7f71b00ad810 2023-08-09T12:45:16.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.125+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b00c7c30 con 0x7f71b00ad810 2023-08-09T12:45:16.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.126+0000 7f71a6ffd640 1 -- 172.21.15.17:0/479280436 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f719802f050 con 0x7f71b00ad810 2023-08-09T12:45:16.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.127+0000 7f71a6ffd640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f719006a080 0x7f719006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.127+0000 7f71a6ffd640 1 -- 172.21.15.17:0/479280436 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71980aa400 con 0x7f71b00ad810 2023-08-09T12:45:16.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.127+0000 7f71a6ffd640 1 -- 172.21.15.17:0/479280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f71900721d0 con 0x7f71b00ad810 2023-08-09T12:45:16.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.128+0000 7f71ae59c640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f719006a080 0x7f719006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.129+0000 7f71ae59c640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f719006a080 0x7f719006c540 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f71a0006fd0 tx=0x7f71a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:16.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.131+0000 7f71a6ffd640 1 -- 172.21.15.17:0/479280436 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f71b00c7c30 con 0x7f71b00ad810 2023-08-09T12:45:16.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.329+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71b00c7c30 con 0x7f71b00ad810 2023-08-09T12:45:16.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.332+0000 7f71a6ffd640 1 -- 172.21.15.17:0/479280436 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f71b00c7c30 con 0x7f71b00ad810 2023-08-09T12:45:16.336 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:16.336 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":96,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:50.876837+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:44:23.740360+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-09T12:44:24.571392+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["backfillfull","exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:16.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f719006a080 msgr2=0x7f719006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f719006a080 0x7f719006c540 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f71a0006fd0 tx=0x7f71a0008040 comp rx=0 tx=0).stop 2023-08-09T12:45:16.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 msgr2=0x7f71b014f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b014f060 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7198000c00 tx=0x7f71980046c0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 shutdown_connections 2023-08-09T12:45:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f719006a080 0x7f719006c540 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71b0159d80 0x7f71b014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71b00ad810 0x7f71b014f060 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 --2- 172.21.15.17:0/479280436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71b00708c0 0x7f71b014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 >> 172.21.15.17:0/479280436 conn(0x7f71b00cb1b0 msgr2=0x7f71b00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 shutdown_connections 2023-08-09T12:45:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.335+0000 7f71b4f71640 1 -- 172.21.15.17:0/479280436 wait complete. 2023-08-09T12:45:16.359 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:44:23.740360+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:44:24.571392+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:45:16.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:45:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.583+0000 7fac7ffff640 1 Processor -- start 2023-08-09T12:45:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.583+0000 7fac7ffff640 1 -- start start 2023-08-09T12:45:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac8015cb40 0x7fac801609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cdf70 0x7fac800d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7ffff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac800d0f00 con 0x7fac800b8420 2023-08-09T12:45:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7ffff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac801611f0 con 0x7fac8015cb40 2023-08-09T12:45:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac801614d0 con 0x7fac800cdf70 2023-08-09T12:45:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac8015cb40 0x7fac801609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac8015cb40 0x7fac801609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39272/0 (socket says 172.21.15.17:39272) 2023-08-09T12:45:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7effd640 1 -- 172.21.15.17:0/3703753103 learned_addr learned my addr 172.21.15.17:0/3703753103 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.585+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/3703753103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cdf70 0x7fac800d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.586+0000 7fac7effd640 1 -- 172.21.15.17:0/3703753103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cdf70 msgr2=0x7fac800d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.586+0000 7fac7effd640 1 --2- 172.21.15.17:0/3703753103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cdf70 0x7fac800d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.586+0000 7fac7effd640 1 -- 172.21.15.17:0/3703753103 >> v1:172.21.15.17:6789/0 conn(0x7fac800b8420 legacy=0x7fac800cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.586+0000 7fac7effd640 1 -- 172.21.15.17:0/3703753103 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac801617b0 con 0x7fac8015cb40 2023-08-09T12:45:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.586+0000 7fac7dffb640 1 -- 172.21.15.17:0/3703753103 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423428943 0 0) 0x7fac800d0f00 con 0x7fac800b8420 2023-08-09T12:45:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.586+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/3703753103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cdf70 0x7fac800d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.587+0000 7fac7effd640 1 --2- 172.21.15.17:0/3703753103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8015cb40 0x7fac801609a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fac70009e50 tx=0x7fac7002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d83f4926e85edf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.587+0000 7fac7dffb640 1 -- 172.21.15.17:0/3703753103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7002cb90 con 0x7fac8015cb40 2023-08-09T12:45:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.587+0000 7fac7dffb640 1 -- 172.21.15.17:0/3703753103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7002ccf0 con 0x7fac8015cb40 2023-08-09T12:45:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.587+0000 7fac7dffb640 1 -- 172.21.15.17:0/3703753103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac70034610 con 0x7fac8015cb40 2023-08-09T12:45:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.588+0000 7fac7ffff640 1 -- 172.21.15.17:0/3703753103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8015cb40 msgr2=0x7fac801609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.588+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3703753103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8015cb40 0x7fac801609a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fac70009e50 tx=0x7fac7002bff0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.588+0000 7fac7ffff640 1 -- 172.21.15.17:0/3703753103 shutdown_connections 2023-08-09T12:45:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.588+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3703753103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800cdf70 0x7fac800d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.588+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3703753103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8015cb40 0x7fac801609a0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.588+0000 7fac7ffff640 1 -- 172.21.15.17:0/3703753103 >> 172.21.15.17:0/3703753103 conn(0x7fac800d2ab0 msgr2=0x7fac800d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.588+0000 7fac7ffff640 1 -- 172.21.15.17:0/3703753103 shutdown_connections 2023-08-09T12:45:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.588+0000 7fac7ffff640 1 -- 172.21.15.17:0/3703753103 wait complete. 2023-08-09T12:45:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.591+0000 7fac7ffff640 1 Processor -- start 2023-08-09T12:45:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.591+0000 7fac7ffff640 1 -- start start 2023-08-09T12:45:16.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.592+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800b8420 0x7fac80157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.592+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac800cdf70 0x7fac800cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.592+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8015cb40 0x7fac800b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.592+0000 7fac7ffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac800a96b0 con 0x7fac800cdf70 2023-08-09T12:45:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.592+0000 7fac7ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac800aaac0 con 0x7fac8015cb40 2023-08-09T12:45:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.592+0000 7fac7ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac800cb350 con 0x7fac800b8420 2023-08-09T12:45:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.592+0000 7fac7e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac800cdf70 0x7fac800cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac800cdf70 0x7fac800cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39278/0 (socket says 172.21.15.17:39278) 2023-08-09T12:45:16.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7e7fc640 1 -- 172.21.15.17:0/3079345173 learned_addr learned my addr 172.21.15.17:0/3079345173 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7effd640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800b8420 0x7fac80157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7e7fc640 1 -- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800b8420 msgr2=0x7fac80157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7e7fc640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800b8420 0x7fac80157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8015cb40 0x7fac800b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7e7fc640 1 -- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8015cb40 msgr2=0x7fac800b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7e7fc640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8015cb40 0x7fac800b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7e7fc640 1 -- 172.21.15.17:0/3079345173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70009b30 con 0x7fac800cdf70 2023-08-09T12:45:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7effd640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800b8420 0x7fac80157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.593+0000 7fac7e7fc640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac800cdf70 0x7fac800cc110 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fac6800c4b0 tx=0x7fac6800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.594+0000 7fac777fe640 1 -- 172.21.15.17:0/3079345173 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68005480 con 0x7fac800cdf70 2023-08-09T12:45:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.594+0000 7fac777fe640 1 -- 172.21.15.17:0/3079345173 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac680035f0 con 0x7fac800cdf70 2023-08-09T12:45:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.594+0000 7fac777fe640 1 -- 172.21.15.17:0/3079345173 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680039e0 con 0x7fac800cdf70 2023-08-09T12:45:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.594+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac800cb630 con 0x7fac800cdf70 2023-08-09T12:45:16.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.594+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac800cbbf0 con 0x7fac800cdf70 2023-08-09T12:45:16.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.595+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac800cbe10 con 0x7fac800cdf70 2023-08-09T12:45:16.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.596+0000 7fac777fe640 1 -- 172.21.15.17:0/3079345173 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac68003b40 con 0x7fac800cdf70 2023-08-09T12:45:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.597+0000 7fac777fe640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac6006a080 0x7fac6006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.597+0000 7fac777fe640 1 -- 172.21.15.17:0/3079345173 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac68087be0 con 0x7fac800cdf70 2023-08-09T12:45:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.598+0000 7fac777fe640 1 -- 172.21.15.17:0/3079345173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fac600721d0 con 0x7fac800cdf70 2023-08-09T12:45:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.598+0000 7fac7effd640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac6006a080 0x7fac6006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:16.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.600+0000 7fac7effd640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac6006a080 0x7fac6006c540 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fac70035000 tx=0x7fac70030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:16.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.602+0000 7fac777fe640 1 -- 172.21.15.17:0/3079345173 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fac68053230 con 0x7fac800cdf70 2023-08-09T12:45:16.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.793+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac8004e390 con 0x7fac800cdf70 2023-08-09T12:45:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.794+0000 7fac777fe640 1 -- 172.21.15.17:0/3079345173 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac68017030 con 0x7fac800cdf70 2023-08-09T12:45:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:45:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac6006a080 msgr2=0x7fac6006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac6006a080 0x7fac6006c540 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fac70035000 tx=0x7fac70030000 comp rx=0 tx=0).stop 2023-08-09T12:45:16.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac800cdf70 msgr2=0x7fac800cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:16.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac800cdf70 0x7fac800cc110 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fac6800c4b0 tx=0x7fac6800c970 comp rx=0 tx=0).stop 2023-08-09T12:45:16.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 shutdown_connections 2023-08-09T12:45:16.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac6006a080 0x7fac6006c540 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac8015cb40 0x7fac800b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac800cdf70 0x7fac800cc110 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3079345173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac800b8420 0x7fac80157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:16.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.797+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 >> 172.21.15.17:0/3079345173 conn(0x7fac800d2ab0 msgr2=0x7fac800b73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:16.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.798+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 shutdown_connections 2023-08-09T12:45:16.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:16.798+0000 7fac7ffff640 1 -- 172.21.15.17:0/3079345173 wait complete. 2023-08-09T12:45:16.819 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:45:17.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.033+0000 7f386eb55640 1 Processor -- start 2023-08-09T12:45:17.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.034+0000 7f386eb55640 1 -- start start 2023-08-09T12:45:17.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.035+0000 7f386eb55640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f386815cb40 0x7f38681609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.035+0000 7f386eb55640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f38680cdf70 0x7f38680d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.035+0000 7f386eb55640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38680d0f00 con 0x7f38680b8420 2023-08-09T12:45:17.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.035+0000 7f386eb55640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38681611f0 con 0x7f38680cdf70 2023-08-09T12:45:17.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.035+0000 7f386eb55640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38681614d0 con 0x7f386815cb40 2023-08-09T12:45:17.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.036+0000 7f386e354640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f38680cdf70 0x7f38680d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.036+0000 7f386e354640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f38680cdf70 0x7f38680d16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39280/0 (socket says 172.21.15.17:39280) 2023-08-09T12:45:17.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.036+0000 7f386e354640 1 -- 172.21.15.17:0/1835475267 learned_addr learned my addr 172.21.15.17:0/1835475267 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:17.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.036+0000 7f386e354640 1 -- 172.21.15.17:0/1835475267 >> v2:172.21.15.142:3300/0 conn(0x7f386815cb40 msgr2=0x7f38681609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:17.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.036+0000 7f386e354640 1 --2- 172.21.15.17:0/1835475267 >> v2:172.21.15.142:3300/0 conn(0x7f386815cb40 0x7f38681609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.036+0000 7f386e354640 1 -- 172.21.15.17:0/1835475267 >> v1:172.21.15.17:6789/0 conn(0x7f38680b8420 legacy=0x7f38680cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.036+0000 7f386e354640 1 -- 172.21.15.17:0/1835475267 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38681617b0 con 0x7f38680cdf70 2023-08-09T12:45:17.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.037+0000 7f386e354640 1 --2- 172.21.15.17:0/1835475267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38680cdf70 0x7f38680d16c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f38680713f0 tx=0x7f386002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f833fa525b3e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386cb51640 1 -- 172.21.15.17:0/1835475267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386002cba0 con 0x7f38680cdf70 2023-08-09T12:45:17.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386cb51640 1 -- 172.21.15.17:0/1835475267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386002cd00 con 0x7f38680cdf70 2023-08-09T12:45:17.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386cb51640 1 -- 172.21.15.17:0/1835475267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860034610 con 0x7f38680cdf70 2023-08-09T12:45:17.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386eb55640 1 -- 172.21.15.17:0/1835475267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38680cdf70 msgr2=0x7f38680d16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386eb55640 1 --2- 172.21.15.17:0/1835475267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38680cdf70 0x7f38680d16c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f38680713f0 tx=0x7f386002c000 comp rx=0 tx=0).stop 2023-08-09T12:45:17.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386eb55640 1 -- 172.21.15.17:0/1835475267 shutdown_connections 2023-08-09T12:45:17.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386eb55640 1 --2- 172.21.15.17:0/1835475267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38680cdf70 0x7f38680d16c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386eb55640 1 --2- 172.21.15.17:0/1835475267 >> v2:172.21.15.142:3300/0 conn(0x7f386815cb40 0x7f38681609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386eb55640 1 -- 172.21.15.17:0/1835475267 >> 172.21.15.17:0/1835475267 conn(0x7f38680d2ab0 msgr2=0x7f38680d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:17.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386eb55640 1 -- 172.21.15.17:0/1835475267 shutdown_connections 2023-08-09T12:45:17.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.038+0000 7f386eb55640 1 -- 172.21.15.17:0/1835475267 wait complete. 2023-08-09T12:45:17.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.040+0000 7f386eb55640 1 Processor -- start 2023-08-09T12:45:17.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.040+0000 7f386eb55640 1 -- start start 2023-08-09T12:45:17.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.041+0000 7f386eb55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38680b8420 0x7f38680c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.041+0000 7f386eb55640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38680cdf70 0x7f38680cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.041+0000 7f386eb55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f386815cb40 0x7f386815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.041+0000 7f386eb55640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680c9410 con 0x7f386815cb40 2023-08-09T12:45:17.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.041+0000 7f386eb55640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680c8790 con 0x7f38680cdf70 2023-08-09T12:45:17.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.041+0000 7f386eb55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38680c8a70 con 0x7f38680b8420 2023-08-09T12:45:17.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f386815cb40 0x7f386815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f386815cb40 0x7f386815b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39294/0 (socket says 172.21.15.17:39294) 2023-08-09T12:45:17.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 -- 172.21.15.17:0/2080734935 learned_addr learned my addr 172.21.15.17:0/2080734935 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:17.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 -- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38680b8420 msgr2=0x7f38680c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38680b8420 0x7f38680c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 -- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38680cdf70 msgr2=0x7f38680cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38680cdf70 0x7f38680cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 -- 172.21.15.17:0/2080734935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860009b30 con 0x7f386815cb40 2023-08-09T12:45:17.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.042+0000 7f386e354640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f386815cb40 0x7f386815b150 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3860036040 tx=0x7f3860004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.043+0000 7f385e7fc640 1 -- 172.21.15.17:0/2080734935 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386003e450 con 0x7f386815cb40 2023-08-09T12:45:17.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.043+0000 7f385e7fc640 1 -- 172.21.15.17:0/2080734935 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386003e5d0 con 0x7f386815cb40 2023-08-09T12:45:17.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.043+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38680c8d50 con 0x7f386815cb40 2023-08-09T12:45:17.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.043+0000 7f385e7fc640 1 -- 172.21.15.17:0/2080734935 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386003e980 con 0x7f386815cb40 2023-08-09T12:45:17.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.043+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38680c84a0 con 0x7f386815cb40 2023-08-09T12:45:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.044+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386804e390 con 0x7f386815cb40 2023-08-09T12:45:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.045+0000 7f385e7fc640 1 -- 172.21.15.17:0/2080734935 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f386003eae0 con 0x7f386815cb40 2023-08-09T12:45:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.046+0000 7f385e7fc640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384c06a050 0x7f384c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.046+0000 7f385e7fc640 1 -- 172.21.15.17:0/2080734935 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38600ab7b0 con 0x7f386815cb40 2023-08-09T12:45:17.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.046+0000 7f385e7fc640 1 -- 172.21.15.17:0/2080734935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f384c0721a0 con 0x7f386815cb40 2023-08-09T12:45:17.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.047+0000 7f386db53640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384c06a050 0x7f384c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.048+0000 7f386db53640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384c06a050 0x7f384c06c510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3864009670 tx=0x7f3864006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.050+0000 7f385e7fc640 1 -- 172.21.15.17:0/2080734935 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3860076f20 con 0x7f386815cb40 2023-08-09T12:45:17.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.234+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f38680cd5d0 con 0x7f386815cb40 2023-08-09T12:45:17.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.234+0000 7f385e7fc640 1 -- 172.21.15.17:0/2080734935 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7f38600430a0 con 0x7f386815cb40 2023-08-09T12:45:17.238 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:45:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384c06a050 msgr2=0x7f384c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384c06a050 0x7f384c06c510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3864009670 tx=0x7f3864006bf0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f386815cb40 msgr2=0x7f386815b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f386815cb40 0x7f386815b150 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3860036040 tx=0x7f3860004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 shutdown_connections 2023-08-09T12:45:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f384c06a050 0x7f384c06c510 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f386815cb40 0x7f386815b150 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38680cdf70 0x7f38680cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 --2- 172.21.15.17:0/2080734935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38680b8420 0x7f38680c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 >> 172.21.15.17:0/2080734935 conn(0x7f38680d2ab0 msgr2=0x7f38681562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:17.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 shutdown_connections 2023-08-09T12:45:17.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.237+0000 7f386eb55640 1 -- 172.21.15.17:0/2080734935 wait complete. 2023-08-09T12:45:17.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:45:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.474+0000 7f173bcec640 1 Processor -- start 2023-08-09T12:45:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.474+0000 7f173bcec640 1 -- start start 2023-08-09T12:45:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f173bcec640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f173415cef0 0x7f17340b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f173bcec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f17340cfab0 0x7f17340ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f173bcec640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340b2010 con 0x7f173415d2d0 2023-08-09T12:45:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f173bcec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340cdee0 con 0x7f17340cfab0 2023-08-09T12:45:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f173bcec640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340b1d30 con 0x7f173415cef0 2023-08-09T12:45:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f173a289640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f17340cfab0 0x7f17340ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f1739287640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f173415d2d0 0x7f17340cf3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43032/0 (socket says 172.21.15.17:43032) 2023-08-09T12:45:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f1739287640 1 -- 172.21.15.17:0/1842350250 learned_addr learned my addr 172.21.15.17:0/1842350250 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.476+0000 7f1739a88640 1 --2- 172.21.15.17:0/1842350250 >> v2:172.21.15.142:3300/0 conn(0x7f173415cef0 0x7f17340b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.477+0000 7f173a289640 1 -- 172.21.15.17:0/1842350250 >> v2:172.21.15.142:3300/0 conn(0x7f173415cef0 msgr2=0x7f17340b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:17.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.477+0000 7f173a289640 1 --2- 172.21.15.17:0/1842350250 >> v2:172.21.15.142:3300/0 conn(0x7f173415cef0 0x7f17340b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.477+0000 7f173a289640 1 -- 172.21.15.17:0/1842350250 >> v1:172.21.15.17:6789/0 conn(0x7f173415d2d0 legacy=0x7f17340cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.477+0000 7f173a289640 1 -- 172.21.15.17:0/1842350250 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17340cd820 con 0x7f17340cfab0 2023-08-09T12:45:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.478+0000 7f173a289640 1 --2- 172.21.15.17:0/1842350250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17340cfab0 0x7f17340ce300 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f17340b5790 tx=0x7f172c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e669ab1eaeca88 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.478+0000 7f1738a86640 1 -- 172.21.15.17:0/1842350250 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c02cb50 con 0x7f17340cfab0 2023-08-09T12:45:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.478+0000 7f1738a86640 1 -- 172.21.15.17:0/1842350250 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c02ccb0 con 0x7f17340cfab0 2023-08-09T12:45:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.478+0000 7f1738a86640 1 -- 172.21.15.17:0/1842350250 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c034660 con 0x7f17340cfab0 2023-08-09T12:45:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.479+0000 7f173bcec640 1 -- 172.21.15.17:0/1842350250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17340cfab0 msgr2=0x7f17340ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.479+0000 7f173bcec640 1 --2- 172.21.15.17:0/1842350250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17340cfab0 0x7f17340ce300 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f17340b5790 tx=0x7f172c02bda0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.479+0000 7f173bcec640 1 -- 172.21.15.17:0/1842350250 shutdown_connections 2023-08-09T12:45:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.479+0000 7f173bcec640 1 --2- 172.21.15.17:0/1842350250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17340cfab0 0x7f17340ce300 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.479+0000 7f173bcec640 1 --2- 172.21.15.17:0/1842350250 >> v2:172.21.15.142:3300/0 conn(0x7f173415cef0 0x7f17340b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.479+0000 7f173bcec640 1 -- 172.21.15.17:0/1842350250 >> 172.21.15.17:0/1842350250 conn(0x7f173406fde0 msgr2=0x7f17340701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.479+0000 7f173bcec640 1 -- 172.21.15.17:0/1842350250 shutdown_connections 2023-08-09T12:45:17.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.479+0000 7f173bcec640 1 -- 172.21.15.17:0/1842350250 wait complete. 2023-08-09T12:45:17.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.481+0000 7f173bcec640 1 Processor -- start 2023-08-09T12:45:17.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.481+0000 7f173bcec640 1 -- start start 2023-08-09T12:45:17.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f173bcec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17340cfab0 0x7f17340b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f173bcec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f173415cef0 0x7f17340abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f173bcec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173415d2d0 0x7f17340ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f173bcec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b2d40 con 0x7f173415cef0 2023-08-09T12:45:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f173bcec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b3020 con 0x7f17340cfab0 2023-08-09T12:45:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f173bcec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b3300 con 0x7f173415d2d0 2023-08-09T12:45:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f1739287640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f173415cef0 0x7f17340abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f1739287640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f173415cef0 0x7f17340abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39312/0 (socket says 172.21.15.17:39312) 2023-08-09T12:45:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.482+0000 7f1739287640 1 -- 172.21.15.17:0/1807141632 learned_addr learned my addr 172.21.15.17:0/1807141632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:17.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f1739a88640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17340cfab0 0x7f17340b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f173a289640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173415d2d0 0x7f17340ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f1739287640 1 -- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173415d2d0 msgr2=0x7f17340ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f1739287640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173415d2d0 0x7f17340ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f1739287640 1 -- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17340cfab0 msgr2=0x7f17340b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f1739287640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17340cfab0 0x7f17340b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f1739287640 1 -- 172.21.15.17:0/1807141632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c009a70 con 0x7f173415cef0 2023-08-09T12:45:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f1739287640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f173415cef0 0x7f17340abb30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f172400c400 tx=0x7f172400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f172a7fc640 1 -- 172.21.15.17:0/1807141632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724005ce0 con 0x7f173415cef0 2023-08-09T12:45:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f172a7fc640 1 -- 172.21.15.17:0/1807141632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724005e40 con 0x7f173415cef0 2023-08-09T12:45:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340b35e0 con 0x7f173415cef0 2023-08-09T12:45:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f172a7fc640 1 -- 172.21.15.17:0/1807141632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724007310 con 0x7f173415cef0 2023-08-09T12:45:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.483+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17340b5520 con 0x7f173415cef0 2023-08-09T12:45:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.484+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17340b3b00 con 0x7f173415cef0 2023-08-09T12:45:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.485+0000 7f172a7fc640 1 -- 172.21.15.17:0/1807141632 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1724007470 con 0x7f173415cef0 2023-08-09T12:45:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.486+0000 7f172a7fc640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f171806a050 0x7f171806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.486+0000 7f172a7fc640 1 -- 172.21.15.17:0/1807141632 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1724087c00 con 0x7f173415cef0 2023-08-09T12:45:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.487+0000 7f172a7fc640 1 -- 172.21.15.17:0/1807141632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f17180721a0 con 0x7f173415cef0 2023-08-09T12:45:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.487+0000 7f1739a88640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f171806a050 0x7f171806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.488+0000 7f1739a88640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f171806a050 0x7f171806c510 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1730006fd0 tx=0x7f1730008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.490+0000 7f172a7fc640 1 -- 172.21.15.17:0/1807141632 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f17340b3b00 con 0x7f173415cef0 2023-08-09T12:45:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.679+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17340b3b00 con 0x7f173415cef0 2023-08-09T12:45:17.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.680+0000 7f172a7fc640 1 -- 172.21.15.17:0/1807141632 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17340b3b00 con 0x7f173415cef0 2023-08-09T12:45:17.683 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:45:17.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f171806a050 msgr2=0x7f171806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f171806a050 0x7f171806c510 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1730006fd0 tx=0x7f1730008040 comp rx=0 tx=0).stop 2023-08-09T12:45:17.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f173415cef0 msgr2=0x7f17340abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f173415cef0 0x7f17340abb30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f172400c400 tx=0x7f172400c8c0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 shutdown_connections 2023-08-09T12:45:17.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f171806a050 0x7f171806c510 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173415d2d0 0x7f17340ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f173415cef0 0x7f17340abb30 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 --2- 172.21.15.17:0/1807141632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17340cfab0 0x7f17340b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.682+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 >> 172.21.15.17:0/1807141632 conn(0x7f173406fde0 msgr2=0x7f17340cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:17.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.683+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 shutdown_connections 2023-08-09T12:45:17.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.683+0000 7f173bcec640 1 -- 172.21.15.17:0/1807141632 wait complete. 2023-08-09T12:45:17.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:45:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.913+0000 7fd919d52640 1 Processor -- start 2023-08-09T12:45:17.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.913+0000 7fd919d52640 1 -- start start 2023-08-09T12:45:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.915+0000 7fd919d52640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9140b3d60 0x7fd9140cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.915+0000 7fd919d52640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9140b2b90 con 0x7fd9140cc6b0 2023-08-09T12:45:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.915+0000 7fd919d52640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9140b2580 con 0x7fd914159bd0 2023-08-09T12:45:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.915+0000 7fd919d52640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9140cabb0 con 0x7fd9140b3d60 2023-08-09T12:45:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.915+0000 7fd913fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9140b3d60 0x7fd9140cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.915+0000 7fd913fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9140b3d60 0x7fd9140cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51246/0 (socket says 172.21.15.17:51246) 2023-08-09T12:45:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.915+0000 7fd913fff640 1 -- 172.21.15.17:0/2149075218 learned_addr learned my addr 172.21.15.17:0/2149075218 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.915+0000 7fd919551640 1 --1- 172.21.15.17:0/2149075218 >> v1:172.21.15.17:6789/0 conn(0x7fd9140cc6b0 0x7fd9140b3020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58762/0 (socket says 172.21.15.17:58762) 2023-08-09T12:45:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.916+0000 7fd913fff640 1 -- 172.21.15.17:0/2149075218 >> v1:172.21.15.142:6789/0 conn(0x7fd914159bd0 legacy=0x7fd9140c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.916+0000 7fd913fff640 1 -- 172.21.15.17:0/2149075218 >> v1:172.21.15.17:6789/0 conn(0x7fd9140cc6b0 legacy=0x7fd9140b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.916+0000 7fd9137fe640 1 -- 172.21.15.17:0/2149075218 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629010199 0 0) 0x7fd9140b2b90 con 0x7fd9140cc6b0 2023-08-09T12:45:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.916+0000 7fd913fff640 1 -- 172.21.15.17:0/2149075218 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140ca5f0 con 0x7fd9140b3d60 2023-08-09T12:45:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.917+0000 7fd913fff640 1 --2- 172.21.15.17:0/2149075218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140b3d60 0x7fd9140cc170 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd900009870 tx=0x7fd90002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2a1d224f18eb58 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.917+0000 7fd9137fe640 1 -- 172.21.15.17:0/2149075218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90002f840 con 0x7fd9140b3d60 2023-08-09T12:45:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.917+0000 7fd9137fe640 1 -- 172.21.15.17:0/2149075218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90002f9a0 con 0x7fd9140b3d60 2023-08-09T12:45:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.917+0000 7fd9137fe640 1 -- 172.21.15.17:0/2149075218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90002fd30 con 0x7fd9140b3d60 2023-08-09T12:45:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.918+0000 7fd919d52640 1 -- 172.21.15.17:0/2149075218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140b3d60 msgr2=0x7fd9140cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.918+0000 7fd919d52640 1 --2- 172.21.15.17:0/2149075218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140b3d60 0x7fd9140cc170 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd900009870 tx=0x7fd90002ba20 comp rx=0 tx=0).stop 2023-08-09T12:45:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.918+0000 7fd919d52640 1 -- 172.21.15.17:0/2149075218 shutdown_connections 2023-08-09T12:45:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.918+0000 7fd919d52640 1 --2- 172.21.15.17:0/2149075218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140b3d60 0x7fd9140cc170 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.918+0000 7fd919d52640 1 -- 172.21.15.17:0/2149075218 >> 172.21.15.17:0/2149075218 conn(0x7fd9140cb020 msgr2=0x7fd9140cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.918+0000 7fd919d52640 1 -- 172.21.15.17:0/2149075218 shutdown_connections 2023-08-09T12:45:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.919+0000 7fd919d52640 1 -- 172.21.15.17:0/2149075218 wait complete. 2023-08-09T12:45:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.920+0000 7fd919d52640 1 Processor -- start 2023-08-09T12:45:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.920+0000 7fd919d52640 1 -- start start 2023-08-09T12:45:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.921+0000 7fd919d52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140cc6b0 0x7fd91406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.921+0000 7fd919d52640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd914159bd0 0x7fd9140c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.921+0000 7fd919d52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9140c5670 0x7fd914156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.921+0000 7fd919d52640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91415be10 con 0x7fd9140cc6b0 2023-08-09T12:45:17.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.921+0000 7fd919d52640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140c66a0 con 0x7fd914159bd0 2023-08-09T12:45:17.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.921+0000 7fd919d52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140c6970 con 0x7fd9140c5670 2023-08-09T12:45:17.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd918d50640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140cc6b0 0x7fd91406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd918d50640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140cc6b0 0x7fd91406ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51254/0 (socket says 172.21.15.17:51254) 2023-08-09T12:45:17.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd918d50640 1 -- 172.21.15.17:0/1918361674 learned_addr learned my addr 172.21.15.17:0/1918361674 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:17.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd913fff640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd914159bd0 0x7fd9140c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd919551640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9140c5670 0x7fd914156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd918d50640 1 -- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9140c5670 msgr2=0x7fd914156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd918d50640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9140c5670 0x7fd914156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd918d50640 1 -- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd914159bd0 msgr2=0x7fd9140c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd918d50640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd914159bd0 0x7fd9140c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd918d50640 1 -- 172.21.15.17:0/1918361674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000094d0 con 0x7fd9140cc6b0 2023-08-09T12:45:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.922+0000 7fd913fff640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd914159bd0 0x7fd9140c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.923+0000 7fd918d50640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140cc6b0 0x7fd91406ea70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c400 tx=0x7fd90800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.923+0000 7fd9117fa640 1 -- 172.21.15.17:0/1918361674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9080052d0 con 0x7fd9140cc6b0 2023-08-09T12:45:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.923+0000 7fd9117fa640 1 -- 172.21.15.17:0/1918361674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908005430 con 0x7fd9140cc6b0 2023-08-09T12:45:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.923+0000 7fd9117fa640 1 -- 172.21.15.17:0/1918361674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908003830 con 0x7fd9140cc6b0 2023-08-09T12:45:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.923+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9140c6c50 con 0x7fd9140cc6b0 2023-08-09T12:45:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.923+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd914156e50 con 0x7fd9140cc6b0 2023-08-09T12:45:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.924+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91404e390 con 0x7fd9140cc6b0 2023-08-09T12:45:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.925+0000 7fd9117fa640 1 -- 172.21.15.17:0/1918361674 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd908003990 con 0x7fd9140cc6b0 2023-08-09T12:45:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.926+0000 7fd9117fa640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8f806a050 0x7fd8f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:17.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.926+0000 7fd9117fa640 1 -- 172.21.15.17:0/1918361674 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd908087b30 con 0x7fd9140cc6b0 2023-08-09T12:45:17.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.926+0000 7fd9117fa640 1 -- 172.21.15.17:0/1918361674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fd8f80721a0 con 0x7fd9140cc6b0 2023-08-09T12:45:17.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.927+0000 7fd913fff640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8f806a050 0x7fd8f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:17.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.928+0000 7fd913fff640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8f806a050 0x7fd8f806c510 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd900036000 tx=0x7fd900039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:17.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:17.930+0000 7fd9117fa640 1 -- 172.21.15.17:0/1918361674 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd908053210 con 0x7fd9140cc6b0 2023-08-09T12:45:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.124+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9140ace10 con 0x7fd9140cc6b0 2023-08-09T12:45:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.125+0000 7fd9117fa640 1 -- 172.21.15.17:0/1918361674 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd908017020 con 0x7fd9140cc6b0 2023-08-09T12:45:18.128 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:45:18.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8f806a050 msgr2=0x7fd8f806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:18.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8f806a050 0x7fd8f806c510 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd900036000 tx=0x7fd900039040 comp rx=0 tx=0).stop 2023-08-09T12:45:18.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140cc6b0 msgr2=0x7fd91406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:18.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140cc6b0 0x7fd91406ea70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c400 tx=0x7fd90800c8c0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 shutdown_connections 2023-08-09T12:45:18.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd8f806a050 0x7fd8f806c510 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9140c5670 0x7fd914156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd914159bd0 0x7fd9140c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 --2- 172.21.15.17:0/1918361674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140cc6b0 0x7fd91406ea70 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 >> 172.21.15.17:0/1918361674 conn(0x7fd9140cb020 msgr2=0x7fd9141e2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 shutdown_connections 2023-08-09T12:45:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.128+0000 7fd919d52640 1 -- 172.21.15.17:0/1918361674 wait complete. 2023-08-09T12:45:18.150 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:45:18.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.371+0000 7fb96f999640 1 Processor -- start 2023-08-09T12:45:18.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.372+0000 7fb96f999640 1 -- start start 2023-08-09T12:45:18.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96f999640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96815ce90 0x7fb9681616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:18.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96f999640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9680b6000 0x7fb9680cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:18.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96f999640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9680d29d0 0x7fb9680d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:18.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96f999640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9680d33a0 con 0x7fb9680d29d0 2023-08-09T12:45:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96f999640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9680b6460 con 0x7fb9680b6000 2023-08-09T12:45:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96f999640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9680cda40 con 0x7fb96815ce90 2023-08-09T12:45:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96df36640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9680d29d0 0x7fb9680d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:18.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96df36640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9680d29d0 0x7fb9680d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51270/0 (socket says 172.21.15.17:51270) 2023-08-09T12:45:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.373+0000 7fb96df36640 1 -- 172.21.15.17:0/2782349653 learned_addr learned my addr 172.21.15.17:0/2782349653 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.374+0000 7fb96d735640 1 --2- 172.21.15.17:0/2782349653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96815ce90 0x7fb9681616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.374+0000 7fb96cf34640 1 --2- 172.21.15.17:0/2782349653 >> v2:172.21.15.142:3300/0 conn(0x7fb9680b6000 0x7fb9680cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.374+0000 7fb96df36640 1 -- 172.21.15.17:0/2782349653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96815ce90 msgr2=0x7fb9681616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.374+0000 7fb96df36640 1 --2- 172.21.15.17:0/2782349653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96815ce90 0x7fb9681616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.374+0000 7fb96df36640 1 -- 172.21.15.17:0/2782349653 >> v2:172.21.15.142:3300/0 conn(0x7fb9680b6000 msgr2=0x7fb9680cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.374+0000 7fb96df36640 1 --2- 172.21.15.17:0/2782349653 >> v2:172.21.15.142:3300/0 conn(0x7fb9680b6000 0x7fb9680cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.374+0000 7fb96df36640 1 -- 172.21.15.17:0/2782349653 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680cdd10 con 0x7fb9680d29d0 2023-08-09T12:45:18.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.375+0000 7fb96df36640 1 --2- 172.21.15.17:0/2782349653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9680d29d0 0x7fb9680d2e60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb9680d3c80 tx=0x7fb96002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e87e6fdbe7dd4ed server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.375+0000 7fb95ffff640 1 -- 172.21.15.17:0/2782349653 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960031870 con 0x7fb9680d29d0 2023-08-09T12:45:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb95ffff640 1 -- 172.21.15.17:0/2782349653 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9600319d0 con 0x7fb9680d29d0 2023-08-09T12:45:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb95ffff640 1 -- 172.21.15.17:0/2782349653 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960031d60 con 0x7fb9680d29d0 2023-08-09T12:45:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 -- 172.21.15.17:0/2782349653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9680d29d0 msgr2=0x7fb9680d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 --2- 172.21.15.17:0/2782349653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9680d29d0 0x7fb9680d2e60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb9680d3c80 tx=0x7fb96002b910 comp rx=0 tx=0).stop 2023-08-09T12:45:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 -- 172.21.15.17:0/2782349653 shutdown_connections 2023-08-09T12:45:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 --2- 172.21.15.17:0/2782349653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9680d29d0 0x7fb9680d2e60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 --2- 172.21.15.17:0/2782349653 >> v2:172.21.15.142:3300/0 conn(0x7fb9680b6000 0x7fb9680cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 --2- 172.21.15.17:0/2782349653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96815ce90 0x7fb9681616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 -- 172.21.15.17:0/2782349653 >> 172.21.15.17:0/2782349653 conn(0x7fb96806fde0 msgr2=0x7fb9680701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 -- 172.21.15.17:0/2782349653 shutdown_connections 2023-08-09T12:45:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.376+0000 7fb96f999640 1 -- 172.21.15.17:0/2782349653 wait complete. 2023-08-09T12:45:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.378+0000 7fb96f999640 1 Processor -- start 2023-08-09T12:45:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.378+0000 7fb96f999640 1 -- start start 2023-08-09T12:45:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.379+0000 7fb96f999640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b6000 0x7fb9681f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.379+0000 7fb96f999640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680d29d0 0x7fb96815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.379+0000 7fb96f999640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96815ce90 0x7fb96815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.379+0000 7fb96f999640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb968160310 con 0x7fb96815ce90 2023-08-09T12:45:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.379+0000 7fb96f999640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681f6a50 con 0x7fb9680d29d0 2023-08-09T12:45:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.379+0000 7fb96f999640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681607a0 con 0x7fb9680b6000 2023-08-09T12:45:18.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.379+0000 7fb96df36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96815ce90 0x7fb96815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96df36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96815ce90 0x7fb96815d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51274/0 (socket says 172.21.15.17:51274) 2023-08-09T12:45:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96df36640 1 -- 172.21.15.17:0/3752701763 learned_addr learned my addr 172.21.15.17:0/3752701763 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96cf34640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680d29d0 0x7fb96815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96d735640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b6000 0x7fb9681f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96df36640 1 -- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b6000 msgr2=0x7fb9681f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96df36640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b6000 0x7fb9681f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96df36640 1 -- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680d29d0 msgr2=0x7fb96815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96df36640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680d29d0 0x7fb96815d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96df36640 1 -- 172.21.15.17:0/3752701763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9600094d0 con 0x7fb96815ce90 2023-08-09T12:45:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.380+0000 7fb96df36640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96815ce90 0x7fb96815d7b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb96002b950 tx=0x7fb9600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.381+0000 7fb95dffb640 1 -- 172.21.15.17:0/3752701763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96003ac60 con 0x7fb96815ce90 2023-08-09T12:45:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.381+0000 7fb95dffb640 1 -- 172.21.15.17:0/3752701763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96003adc0 con 0x7fb96815ce90 2023-08-09T12:45:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.381+0000 7fb95dffb640 1 -- 172.21.15.17:0/3752701763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960044610 con 0x7fb96815ce90 2023-08-09T12:45:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.381+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96814beb0 con 0x7fb96815ce90 2023-08-09T12:45:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.381+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96815f9e0 con 0x7fb96815ce90 2023-08-09T12:45:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.382+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9681604c0 con 0x7fb96815ce90 2023-08-09T12:45:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.383+0000 7fb95dffb640 1 -- 172.21.15.17:0/3752701763 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb960044770 con 0x7fb96815ce90 2023-08-09T12:45:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.384+0000 7fb95dffb640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb94c06a050 0x7fb94c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.384+0000 7fb95dffb640 1 -- 172.21.15.17:0/3752701763 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb96002d040 con 0x7fb96815ce90 2023-08-09T12:45:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.384+0000 7fb95dffb640 1 -- 172.21.15.17:0/3752701763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fb94c0721a0 con 0x7fb96815ce90 2023-08-09T12:45:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.385+0000 7fb96d735640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb94c06a050 0x7fb94c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.386+0000 7fb96d735640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb94c06a050 0x7fb94c06c510 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb964009940 tx=0x7fb964003cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:18.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.389+0000 7fb95dffb640 1 -- 172.21.15.17:0/3752701763 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb9681604c0 con 0x7fb96815ce90 2023-08-09T12:45:18.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.592+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb9681604c0 con 0x7fb96815ce90 2023-08-09T12:45:18.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.593+0000 7fb95dffb640 1 -- 172.21.15.17:0/3752701763 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v96) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb9681604c0 con 0x7fb96815ce90 2023-08-09T12:45:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:45:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb94c06a050 msgr2=0x7fb94c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb94c06a050 0x7fb94c06c510 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb964009940 tx=0x7fb964003cd0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96815ce90 msgr2=0x7fb96815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96815ce90 0x7fb96815d7b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb96002b950 tx=0x7fb9600046c0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 shutdown_connections 2023-08-09T12:45:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb94c06a050 0x7fb94c06c510 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96815ce90 0x7fb96815d7b0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680d29d0 0x7fb96815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 --2- 172.21.15.17:0/3752701763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b6000 0x7fb9681f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 >> 172.21.15.17:0/3752701763 conn(0x7fb96806fde0 msgr2=0x7fb9680b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:18.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 shutdown_connections 2023-08-09T12:45:18.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:18.596+0000 7fb96f999640 1 -- 172.21.15.17:0/3752701763 wait complete. 2023-08-09T12:45:18.618 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:45:18.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:18.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:45:18.745 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:45:18.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:18.746 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:45:18.802 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:45:18.802 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:18.863 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:45:18.864 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:18.917 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:19.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.151+0000 7fc39bf24640 1 Processor -- start 2023-08-09T12:45:19.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.151+0000 7fc39bf24640 1 -- start start 2023-08-09T12:45:19.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.152+0000 7fc39bf24640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3940acfc0 0x7fc394167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.152+0000 7fc39bf24640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39415df30 con 0x7fc394161280 2023-08-09T12:45:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.152+0000 7fc39bf24640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940ca9d0 con 0x7fc394161660 2023-08-09T12:45:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.152+0000 7fc39bf24640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39415d430 con 0x7fc3940acfc0 2023-08-09T12:45:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.153+0000 7fc399cc0640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc394161280 0x7fc3940c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58766/0 (socket says 172.21.15.17:58766) 2023-08-09T12:45:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.153+0000 7fc39a4c1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3940acfc0 0x7fc394167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.153+0000 7fc399cc0640 1 -- 172.21.15.17:0/1060162851 learned_addr learned my addr 172.21.15.17:0/1060162851 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.153+0000 7fc39a4c1640 1 -- 172.21.15.17:0/1060162851 >> v1:172.21.15.142:6789/0 conn(0x7fc394161660 legacy=0x7fc3940ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.153+0000 7fc398cbe640 1 -- 172.21.15.17:0/1060162851 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171295843 0 0) 0x7fc39415df30 con 0x7fc394161280 2023-08-09T12:45:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.153+0000 7fc39a4c1640 1 -- 172.21.15.17:0/1060162851 >> v1:172.21.15.17:6789/0 conn(0x7fc394161280 legacy=0x7fc3940c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.153+0000 7fc39a4c1640 1 -- 172.21.15.17:0/1060162851 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39415e3c0 con 0x7fc3940acfc0 2023-08-09T12:45:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.155+0000 7fc39a4c1640 1 --2- 172.21.15.17:0/1060162851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394167db0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009d90 tx=0x7fc38c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5b49a63f15f8f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.155+0000 7fc398cbe640 1 -- 172.21.15.17:0/1060162851 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c02cc60 con 0x7fc3940acfc0 2023-08-09T12:45:19.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.155+0000 7fc398cbe640 1 -- 172.21.15.17:0/1060162851 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c02cdc0 con 0x7fc3940acfc0 2023-08-09T12:45:19.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.155+0000 7fc398cbe640 1 -- 172.21.15.17:0/1060162851 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c034660 con 0x7fc3940acfc0 2023-08-09T12:45:19.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.155+0000 7fc39bf24640 1 -- 172.21.15.17:0/1060162851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 msgr2=0x7fc394167db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.155+0000 7fc39bf24640 1 --2- 172.21.15.17:0/1060162851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394167db0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009d90 tx=0x7fc38c02beb0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.156+0000 7fc39bf24640 1 -- 172.21.15.17:0/1060162851 shutdown_connections 2023-08-09T12:45:19.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.156+0000 7fc39bf24640 1 --2- 172.21.15.17:0/1060162851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394167db0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.156+0000 7fc39bf24640 1 -- 172.21.15.17:0/1060162851 >> 172.21.15.17:0/1060162851 conn(0x7fc3940cb1b0 msgr2=0x7fc3940cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:19.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.156+0000 7fc39bf24640 1 -- 172.21.15.17:0/1060162851 shutdown_connections 2023-08-09T12:45:19.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.156+0000 7fc39bf24640 1 -- 172.21.15.17:0/1060162851 wait complete. 2023-08-09T12:45:19.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.157+0000 7fc39bf24640 1 Processor -- start 2023-08-09T12:45:19.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.158+0000 7fc39bf24640 1 -- start start 2023-08-09T12:45:19.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.158+0000 7fc39bf24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc39bf24640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc394161280 0x7fc3940c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc39bf24640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394161660 0x7fc3940c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc39bf24640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940b3ad0 con 0x7fc3940acfc0 2023-08-09T12:45:19.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc39bf24640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394153ea0 con 0x7fc394161660 2023-08-09T12:45:19.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc39bf24640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940b2e50 con 0x7fc394161280 2023-08-09T12:45:19.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc399cc0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc399cc0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51300/0 (socket says 172.21.15.17:51300) 2023-08-09T12:45:19.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc399cc0640 1 -- 172.21.15.17:0/1736481274 learned_addr learned my addr 172.21.15.17:0/1736481274 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:19.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc39a4c1640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394161660 0x7fc3940c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc399cc0640 1 -- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc394161280 msgr2=0x7fc3940c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc3994bf640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc394161280 0x7fc3940c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc399cc0640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc394161280 0x7fc3940c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc399cc0640 1 -- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394161660 msgr2=0x7fc3940c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc399cc0640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394161660 0x7fc3940c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc399cc0640 1 -- 172.21.15.17:0/1736481274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c009a70 con 0x7fc3940acfc0 2023-08-09T12:45:19.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc39a4c1640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394161660 0x7fc3940c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:19.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.159+0000 7fc3994bf640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc394161280 0x7fc3940c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:19.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.160+0000 7fc399cc0640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394156bb0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fc39000c3f0 tx=0x7fc39000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:19.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.160+0000 7fc38a7fc640 1 -- 172.21.15.17:0/1736481274 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900074e0 con 0x7fc3940acfc0 2023-08-09T12:45:19.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.160+0000 7fc38a7fc640 1 -- 172.21.15.17:0/1736481274 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc390007640 con 0x7fc3940acfc0 2023-08-09T12:45:19.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.160+0000 7fc38a7fc640 1 -- 172.21.15.17:0/1736481274 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390004a00 con 0x7fc3940acfc0 2023-08-09T12:45:19.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.160+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940b3130 con 0x7fc3940acfc0 2023-08-09T12:45:19.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.160+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3940b36f0 con 0x7fc3940acfc0 2023-08-09T12:45:19.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.161+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3940b3c10 con 0x7fc3940acfc0 2023-08-09T12:45:19.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.162+0000 7fc38a7fc640 1 -- 172.21.15.17:0/1736481274 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc390004b60 con 0x7fc3940acfc0 2023-08-09T12:45:19.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.164+0000 7fc38a7fc640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37806a050 0x7fc37806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.164+0000 7fc38a7fc640 1 -- 172.21.15.17:0/1736481274 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc390088440 con 0x7fc3940acfc0 2023-08-09T12:45:19.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.164+0000 7fc38a7fc640 1 -- 172.21.15.17:0/1736481274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fc3780721a0 con 0x7fc3940acfc0 2023-08-09T12:45:19.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.164+0000 7fc3994bf640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37806a050 0x7fc37806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.166+0000 7fc3994bf640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37806a050 0x7fc37806c510 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc3941f5520 tx=0x7fc384009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:19.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.169+0000 7fc38a7fc640 1 -- 172.21.15.17:0/1736481274 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc3940b3c10 con 0x7fc3940acfc0 2023-08-09T12:45:19.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.473+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3940b3c10 con 0x7fc3940acfc0 2023-08-09T12:45:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.476+0000 7fc38a7fc640 1 -- 172.21.15.17:0/1736481274 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+18394 (secure 0 0 0) 0x7fc3940b3c10 con 0x7fc3940acfc0 2023-08-09T12:45:19.480 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:19.480 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":96,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:44:50.876837+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:44:23.740360+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-09T12:44:24.571392+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["backfillfull","exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:19.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37806a050 msgr2=0x7fc37806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37806a050 0x7fc37806c510 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc3941f5520 tx=0x7fc384009040 comp rx=0 tx=0).stop 2023-08-09T12:45:19.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 msgr2=0x7fc394156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394156bb0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fc39000c3f0 tx=0x7fc39000c8b0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 shutdown_connections 2023-08-09T12:45:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc37806a050 0x7fc37806c510 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc394161660 0x7fc3940c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc394161280 0x7fc3940c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 --2- 172.21.15.17:0/1736481274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940acfc0 0x7fc394156bb0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 >> 172.21.15.17:0/1736481274 conn(0x7fc3940cb1b0 msgr2=0x7fc3940cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 shutdown_connections 2023-08-09T12:45:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.480+0000 7fc39bf24640 1 -- 172.21.15.17:0/1736481274 wait complete. 2023-08-09T12:45:19.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:44:23.740360+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:44:24.571392+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:45:19.504 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:45:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.722+0000 7f302a663640 1 Processor -- start 2023-08-09T12:45:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.723+0000 7f302a663640 1 -- start start 2023-08-09T12:45:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f302a663640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f302415cb40 0x7f30241609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f302a663640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f30240b8420 0x7f30240cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f302a663640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f302415cf20 0x7f30240cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f302a663640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30240d0f00 con 0x7f30240b8420 2023-08-09T12:45:19.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f302a663640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30241611f0 con 0x7f302415cf20 2023-08-09T12:45:19.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f302a663640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30241614d0 con 0x7f302415cb40 2023-08-09T12:45:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f3028e60640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f30240b8420 0x7f30240cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f3028e60640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f30240b8420 0x7f30240cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51308/0 (socket says 172.21.15.17:51308) 2023-08-09T12:45:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.724+0000 7f3028e60640 1 -- 172.21.15.17:0/2128500432 learned_addr learned my addr 172.21.15.17:0/2128500432 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.725+0000 7f3029661640 1 --2- 172.21.15.17:0/2128500432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f302415cb40 0x7f30241609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.725+0000 7f3028e60640 1 -- 172.21.15.17:0/2128500432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f302415cb40 msgr2=0x7f30241609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.725+0000 7f3028e60640 1 --2- 172.21.15.17:0/2128500432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f302415cb40 0x7f30241609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.725+0000 7f3028e60640 1 -- 172.21.15.17:0/2128500432 >> v2:172.21.15.142:3300/0 conn(0x7f302415cf20 msgr2=0x7f30240cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.725+0000 7f3029e62640 1 --2- 172.21.15.17:0/2128500432 >> v2:172.21.15.142:3300/0 conn(0x7f302415cf20 0x7f30240cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.725+0000 7f3028e60640 1 --2- 172.21.15.17:0/2128500432 >> v2:172.21.15.142:3300/0 conn(0x7f302415cf20 0x7f30240cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.725+0000 7f3028e60640 1 -- 172.21.15.17:0/2128500432 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30241617b0 con 0x7f30240b8420 2023-08-09T12:45:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.725+0000 7f3029661640 1 --2- 172.21.15.17:0/2128500432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f302415cb40 0x7f30241609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:19.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.726+0000 7f3028e60640 1 --2- 172.21.15.17:0/2128500432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30240b8420 0x7f30240cd860 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f30240b88b0 tx=0x7f301402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff75f810b60e4017 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:19.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.726+0000 7f301bfff640 1 -- 172.21.15.17:0/2128500432 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014030860 con 0x7f30240b8420 2023-08-09T12:45:19.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.726+0000 7f301bfff640 1 -- 172.21.15.17:0/2128500432 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30140309c0 con 0x7f30240b8420 2023-08-09T12:45:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.726+0000 7f301bfff640 1 -- 172.21.15.17:0/2128500432 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014030d50 con 0x7f30240b8420 2023-08-09T12:45:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 -- 172.21.15.17:0/2128500432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30240b8420 msgr2=0x7f30240cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 --2- 172.21.15.17:0/2128500432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30240b8420 0x7f30240cd860 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f30240b88b0 tx=0x7f301402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 -- 172.21.15.17:0/2128500432 shutdown_connections 2023-08-09T12:45:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 --2- 172.21.15.17:0/2128500432 >> v2:172.21.15.142:3300/0 conn(0x7f302415cf20 0x7f30240cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 --2- 172.21.15.17:0/2128500432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30240b8420 0x7f30240cd860 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 --2- 172.21.15.17:0/2128500432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f302415cb40 0x7f30241609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 -- 172.21.15.17:0/2128500432 >> 172.21.15.17:0/2128500432 conn(0x7f30240d2ab0 msgr2=0x7f30240d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 -- 172.21.15.17:0/2128500432 shutdown_connections 2023-08-09T12:45:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.727+0000 7f302a663640 1 -- 172.21.15.17:0/2128500432 wait complete. 2023-08-09T12:45:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.729+0000 7f302a663640 1 Processor -- start 2023-08-09T12:45:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.729+0000 7f302a663640 1 -- start start 2023-08-09T12:45:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f302a663640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30240b8420 0x7f3024155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f302a663640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302415cb40 0x7f3024157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f302a663640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f302415cf20 0x7f30240b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f302a663640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302415a5c0 con 0x7f302415cb40 2023-08-09T12:45:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f302a663640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024158530 con 0x7f302415cf20 2023-08-09T12:45:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f302a663640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3024158810 con 0x7f30240b8420 2023-08-09T12:45:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f3028e60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302415cb40 0x7f3024157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f3028e60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302415cb40 0x7f3024157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51314/0 (socket says 172.21.15.17:51314) 2023-08-09T12:45:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.730+0000 7f3028e60640 1 -- 172.21.15.17:0/386537350 learned_addr learned my addr 172.21.15.17:0/386537350 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3029661640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30240b8420 0x7f3024155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3029e62640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f302415cf20 0x7f30240b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3028e60640 1 -- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30240b8420 msgr2=0x7f3024155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3028e60640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30240b8420 0x7f3024155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3028e60640 1 -- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f302415cf20 msgr2=0x7f30240b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3028e60640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f302415cf20 0x7f30240b6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3028e60640 1 -- 172.21.15.17:0/386537350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30140094d0 con 0x7f302415cb40 2023-08-09T12:45:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3029661640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30240b8420 0x7f3024155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.731+0000 7f3028e60640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302415cb40 0x7f3024157bc0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f301402b9e0 tx=0x7f3014004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.732+0000 7f3019ffb640 1 -- 172.21.15.17:0/386537350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014030850 con 0x7f302415cb40 2023-08-09T12:45:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.732+0000 7f3019ffb640 1 -- 172.21.15.17:0/386537350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3014043400 con 0x7f302415cb40 2023-08-09T12:45:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.732+0000 7f3019ffb640 1 -- 172.21.15.17:0/386537350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30140437b0 con 0x7f302415cb40 2023-08-09T12:45:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.732+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3024158af0 con 0x7f302415cb40 2023-08-09T12:45:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.732+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30241590b0 con 0x7f302415cb40 2023-08-09T12:45:19.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.733+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302404e390 con 0x7f302415cb40 2023-08-09T12:45:19.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.734+0000 7f3019ffb640 1 -- 172.21.15.17:0/386537350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3014043910 con 0x7f302415cb40 2023-08-09T12:45:19.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.735+0000 7f3019ffb640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f300806a050 0x7f300806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:19.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.735+0000 7f3019ffb640 1 -- 172.21.15.17:0/386537350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f301403e070 con 0x7f302415cb40 2023-08-09T12:45:19.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.735+0000 7f3019ffb640 1 -- 172.21.15.17:0/386537350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f30080721a0 con 0x7f302415cb40 2023-08-09T12:45:19.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.736+0000 7f3029661640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f300806a050 0x7f300806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:19.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.737+0000 7f3029661640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f300806a050 0x7f300806c510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f30200088b0 tx=0x7f3020008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:19.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.739+0000 7f3019ffb640 1 -- 172.21.15.17:0/386537350 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3014034020 con 0x7f302415cb40 2023-08-09T12:45:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.935+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30240cd070 con 0x7f302415cb40 2023-08-09T12:45:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.936+0000 7f3019ffb640 1 -- 172.21.15.17:0/386537350 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3014077030 con 0x7f302415cb40 2023-08-09T12:45:19.939 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:45:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f300806a050 msgr2=0x7f300806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f300806a050 0x7f300806c510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f30200088b0 tx=0x7f3020008040 comp rx=0 tx=0).stop 2023-08-09T12:45:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302415cb40 msgr2=0x7f3024157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302415cb40 0x7f3024157bc0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f301402b9e0 tx=0x7f3014004730 comp rx=0 tx=0).stop 2023-08-09T12:45:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 shutdown_connections 2023-08-09T12:45:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f300806a050 0x7f300806c510 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f302415cf20 0x7f30240b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302415cb40 0x7f3024157bc0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 --2- 172.21.15.17:0/386537350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30240b8420 0x7f3024155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 >> 172.21.15.17:0/386537350 conn(0x7f30240d2ab0 msgr2=0x7f30240c7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 shutdown_connections 2023-08-09T12:45:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:19.939+0000 7f302a663640 1 -- 172.21.15.17:0/386537350 wait complete. 2023-08-09T12:45:19.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:45:20.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.188+0000 7fa39ffff640 1 Processor -- start 2023-08-09T12:45:20.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.188+0000 7fa39ffff640 1 -- start start 2023-08-09T12:45:20.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.190+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a00703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.190+0000 7fa39ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa3a00708e0 0x7fa3a00d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.190+0000 7fa39ffff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a00d0f00 con 0x7fa3a00d2360 2023-08-09T12:45:20.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.190+0000 7fa39ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a00d1a80 con 0x7fa3a00708e0 2023-08-09T12:45:20.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.190+0000 7fa39ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00d2810 con 0x7fa3a015caf0 2023-08-09T12:45:20.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.190+0000 7fa39effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a00703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.190+0000 7fa39effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a00703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:60618/0 (socket says 172.21.15.17:60618) 2023-08-09T12:45:20.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.191+0000 7fa39effd640 1 -- 172.21.15.17:0/930944633 learned_addr learned my addr 172.21.15.17:0/930944633 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:20.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.191+0000 7fa3967fc640 1 --2- 172.21.15.17:0/930944633 >> v2:172.21.15.142:3300/0 conn(0x7fa3a00708e0 0x7fa3a00d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.191+0000 7fa39effd640 1 -- 172.21.15.17:0/930944633 >> v2:172.21.15.142:3300/0 conn(0x7fa3a00708e0 msgr2=0x7fa3a00d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:20.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.191+0000 7fa39effd640 1 --2- 172.21.15.17:0/930944633 >> v2:172.21.15.142:3300/0 conn(0x7fa3a00708e0 0x7fa3a00d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.191+0000 7fa39effd640 1 -- 172.21.15.17:0/930944633 >> v1:172.21.15.142:6789/0 conn(0x7fa3a00d2360 legacy=0x7fa3a00697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.191+0000 7fa39effd640 1 -- 172.21.15.17:0/930944633 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00d11e0 con 0x7fa3a015caf0 2023-08-09T12:45:20.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.193+0000 7fa39effd640 1 --2- 172.21.15.17:0/930944633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a00703a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa390009e50 tx=0x7fa39002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8034526fd584fed server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:20.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.193+0000 7fa39e7fc640 1 -- 172.21.15.17:0/930944633 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39002cb90 con 0x7fa3a015caf0 2023-08-09T12:45:20.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.193+0000 7fa39e7fc640 1 -- 172.21.15.17:0/930944633 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39002ccf0 con 0x7fa3a015caf0 2023-08-09T12:45:20.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.193+0000 7fa39e7fc640 1 -- 172.21.15.17:0/930944633 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390034610 con 0x7fa3a015caf0 2023-08-09T12:45:20.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.194+0000 7fa39ffff640 1 -- 172.21.15.17:0/930944633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 msgr2=0x7fa3a00703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.194+0000 7fa39ffff640 1 --2- 172.21.15.17:0/930944633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a00703a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa390009e50 tx=0x7fa39002bff0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.194+0000 7fa39ffff640 1 -- 172.21.15.17:0/930944633 shutdown_connections 2023-08-09T12:45:20.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.194+0000 7fa39ffff640 1 --2- 172.21.15.17:0/930944633 >> v2:172.21.15.142:3300/0 conn(0x7fa3a00708e0 0x7fa3a00d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.194+0000 7fa39ffff640 1 --2- 172.21.15.17:0/930944633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a00703a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.194+0000 7fa39ffff640 1 -- 172.21.15.17:0/930944633 >> 172.21.15.17:0/930944633 conn(0x7fa3a00cf6b0 msgr2=0x7fa3a00cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:20.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.194+0000 7fa39ffff640 1 -- 172.21.15.17:0/930944633 shutdown_connections 2023-08-09T12:45:20.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.194+0000 7fa39ffff640 1 -- 172.21.15.17:0/930944633 wait complete. 2023-08-09T12:45:20.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.196+0000 7fa39ffff640 1 Processor -- start 2023-08-09T12:45:20.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.196+0000 7fa39ffff640 1 -- start start 2023-08-09T12:45:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.197+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a00d2360 0x7fa3a01593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.197+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a01f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.197+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a0156170 0x7fa3a015f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.197+0000 7fa39ffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00cd9e0 con 0x7fa3a00d2360 2023-08-09T12:45:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.197+0000 7fa39ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a01f6b90 con 0x7fa3a0156170 2023-08-09T12:45:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.197+0000 7fa39ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0159af0 con 0x7fa3a015caf0 2023-08-09T12:45:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.197+0000 7fa39effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a00d2360 0x7fa3a01593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a00d2360 0x7fa3a01593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51326/0 (socket says 172.21.15.17:51326) 2023-08-09T12:45:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39effd640 1 -- 172.21.15.17:0/1734412468 learned_addr learned my addr 172.21.15.17:0/1734412468 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39f7fe640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a0156170 0x7fa3a015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa3967fc640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a01f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39effd640 1 -- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 msgr2=0x7fa3a01f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39effd640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a01f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39effd640 1 -- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a0156170 msgr2=0x7fa3a015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39effd640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a0156170 0x7fa3a015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39effd640 1 -- 172.21.15.17:0/1734412468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa390009b30 con 0x7fa3a00d2360 2023-08-09T12:45:20.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.198+0000 7fa39effd640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a00d2360 0x7fa3a01593f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa390000f80 tx=0x7fa390004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:20.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.199+0000 7fa39cff9640 1 -- 172.21.15.17:0/1734412468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390040670 con 0x7fa3a00d2360 2023-08-09T12:45:20.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.199+0000 7fa39cff9640 1 -- 172.21.15.17:0/1734412468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa390040810 con 0x7fa3a00d2360 2023-08-09T12:45:20.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.199+0000 7fa39cff9640 1 -- 172.21.15.17:0/1734412468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390040bc0 con 0x7fa3a00d2360 2023-08-09T12:45:20.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.199+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a00cd180 con 0x7fa3a00d2360 2023-08-09T12:45:20.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.199+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a00cd700 con 0x7fa3a00d2360 2023-08-09T12:45:20.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.200+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a004e390 con 0x7fa3a00d2360 2023-08-09T12:45:20.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.201+0000 7fa39cff9640 1 -- 172.21.15.17:0/1734412468 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa390040d20 con 0x7fa3a00d2360 2023-08-09T12:45:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.202+0000 7fa39cff9640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa38006a050 0x7fa38006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.202+0000 7fa39cff9640 1 -- 172.21.15.17:0/1734412468 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3900ab3c0 con 0x7fa3a00d2360 2023-08-09T12:45:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.202+0000 7fa39cff9640 1 -- 172.21.15.17:0/1734412468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fa3800721a0 con 0x7fa3a00d2360 2023-08-09T12:45:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.203+0000 7fa3967fc640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa38006a050 0x7fa38006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.204+0000 7fa3967fc640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa38006a050 0x7fa38006c510 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00b6880 tx=0x7fa388008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.206+0000 7fa39cff9640 1 -- 172.21.15.17:0/1734412468 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa390076aa0 con 0x7fa3a00d2360 2023-08-09T12:45:20.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.399+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa3a00b13c0 con 0x7fa3a00d2360 2023-08-09T12:45:20.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.400+0000 7fa39cff9640 1 -- 172.21.15.17:0/1734412468 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa39002ce60 con 0x7fa3a00d2360 2023-08-09T12:45:20.403 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:45:20.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.402+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa38006a050 msgr2=0x7fa38006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.402+0000 7fa39ffff640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa38006a050 0x7fa38006c510 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00b6880 tx=0x7fa388008040 comp rx=0 tx=0).stop 2023-08-09T12:45:20.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.402+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a00d2360 msgr2=0x7fa3a01593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.402+0000 7fa39ffff640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a00d2360 0x7fa3a01593f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa390000f80 tx=0x7fa390004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:20.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.403+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 shutdown_connections 2023-08-09T12:45:20.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.403+0000 7fa39ffff640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa38006a050 0x7fa38006c510 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.403+0000 7fa39ffff640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3a0156170 0x7fa3a015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.403+0000 7fa39ffff640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3a015caf0 0x7fa3a01f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.403+0000 7fa39ffff640 1 --2- 172.21.15.17:0/1734412468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a00d2360 0x7fa3a01593f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.403+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 >> 172.21.15.17:0/1734412468 conn(0x7fa3a00cf6b0 msgr2=0x7fa3a015bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:20.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.403+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 shutdown_connections 2023-08-09T12:45:20.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.403+0000 7fa39ffff640 1 -- 172.21.15.17:0/1734412468 wait complete. 2023-08-09T12:45:20.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:45:20.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.652+0000 7fba8bb86640 1 Processor -- start 2023-08-09T12:45:20.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.653+0000 7fba8bb86640 1 -- start start 2023-08-09T12:45:20.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.654+0000 7fba8bb86640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba84158840 0x7fba840af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.654+0000 7fba8bb86640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba840afce0 0x7fba840ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.654+0000 7fba8bb86640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba840cef20 0x7fba8406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.654+0000 7fba8bb86640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba84158c20 con 0x7fba840cef20 2023-08-09T12:45:20.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.654+0000 7fba8bb86640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba840cf3b0 con 0x7fba84158840 2023-08-09T12:45:20.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.654+0000 7fba8bb86640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba840b0220 con 0x7fba840afce0 2023-08-09T12:45:20.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.655+0000 7fba8a123640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba840cef20 0x7fba8406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.655+0000 7fba8a123640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba840cef20 0x7fba8406ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51338/0 (socket says 172.21.15.17:51338) 2023-08-09T12:45:20.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.655+0000 7fba8a123640 1 -- 172.21.15.17:0/1845068261 learned_addr learned my addr 172.21.15.17:0/1845068261 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:20.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.655+0000 7fba89922640 1 --2- 172.21.15.17:0/1845068261 >> v2:172.21.15.142:3300/0 conn(0x7fba84158840 0x7fba840af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.655+0000 7fba89121640 1 --2- 172.21.15.17:0/1845068261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba840afce0 0x7fba840ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.656+0000 7fba8a123640 1 -- 172.21.15.17:0/1845068261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba840afce0 msgr2=0x7fba840ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:20.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.656+0000 7fba8a123640 1 --2- 172.21.15.17:0/1845068261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba840afce0 0x7fba840ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.656+0000 7fba8a123640 1 -- 172.21.15.17:0/1845068261 >> v2:172.21.15.142:3300/0 conn(0x7fba84158840 msgr2=0x7fba840af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:20.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.656+0000 7fba8a123640 1 --2- 172.21.15.17:0/1845068261 >> v2:172.21.15.142:3300/0 conn(0x7fba84158840 0x7fba840af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.656+0000 7fba8a123640 1 -- 172.21.15.17:0/1845068261 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8415e7f0 con 0x7fba840cef20 2023-08-09T12:45:20.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.656+0000 7fba89922640 1 --2- 172.21.15.17:0/1845068261 >> v2:172.21.15.142:3300/0 conn(0x7fba84158840 0x7fba840af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:20.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.657+0000 7fba8a123640 1 --2- 172.21.15.17:0/1845068261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840cef20 0x7fba8406ecc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fba8406b2e0 tx=0x7fba7c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775c4be6bb8a3df server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:20.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.657+0000 7fba88920640 1 -- 172.21.15.17:0/1845068261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c02ca70 con 0x7fba840cef20 2023-08-09T12:45:20.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.657+0000 7fba88920640 1 -- 172.21.15.17:0/1845068261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c02cbd0 con 0x7fba840cef20 2023-08-09T12:45:20.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.657+0000 7fba88920640 1 -- 172.21.15.17:0/1845068261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0343f0 con 0x7fba840cef20 2023-08-09T12:45:20.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 -- 172.21.15.17:0/1845068261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840cef20 msgr2=0x7fba8406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 --2- 172.21.15.17:0/1845068261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840cef20 0x7fba8406ecc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fba8406b2e0 tx=0x7fba7c02bed0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 -- 172.21.15.17:0/1845068261 shutdown_connections 2023-08-09T12:45:20.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 --2- 172.21.15.17:0/1845068261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840cef20 0x7fba8406ecc0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 --2- 172.21.15.17:0/1845068261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba840afce0 0x7fba840ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 --2- 172.21.15.17:0/1845068261 >> v2:172.21.15.142:3300/0 conn(0x7fba84158840 0x7fba840af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 -- 172.21.15.17:0/1845068261 >> 172.21.15.17:0/1845068261 conn(0x7fba84069be0 msgr2=0x7fba84069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:20.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 -- 172.21.15.17:0/1845068261 shutdown_connections 2023-08-09T12:45:20.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.658+0000 7fba8bb86640 1 -- 172.21.15.17:0/1845068261 wait complete. 2023-08-09T12:45:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.660+0000 7fba8bb86640 1 Processor -- start 2023-08-09T12:45:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.661+0000 7fba8bb86640 1 -- start start 2023-08-09T12:45:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba8bb86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840afce0 0x7fba840ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba8bb86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba840cef20 0x7fba8414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba8bb86640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba84158840 0x7fba840c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba8bb86640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba840ca180 con 0x7fba840afce0 2023-08-09T12:45:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba8bb86640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba840c9310 con 0x7fba840cef20 2023-08-09T12:45:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba8bb86640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba840c9570 con 0x7fba84158840 2023-08-09T12:45:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba89922640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840afce0 0x7fba840ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba89922640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840afce0 0x7fba840ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51354/0 (socket says 172.21.15.17:51354) 2023-08-09T12:45:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.662+0000 7fba89922640 1 -- 172.21.15.17:0/625138353 learned_addr learned my addr 172.21.15.17:0/625138353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba8a123640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba84158840 0x7fba840c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba89922640 1 -- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba84158840 msgr2=0x7fba840c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba89922640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba84158840 0x7fba840c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba89922640 1 -- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba840cef20 msgr2=0x7fba8414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba89121640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba840cef20 0x7fba8414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba89922640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba840cef20 0x7fba8414d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba89922640 1 -- 172.21.15.17:0/625138353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c009b30 con 0x7fba840afce0 2023-08-09T12:45:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba89922640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840afce0 0x7fba840ca610 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fba8000e7e0 tx=0x7fba8000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80004030 con 0x7fba840afce0 2023-08-09T12:45:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba80004190 con 0x7fba840afce0 2023-08-09T12:45:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80004520 con 0x7fba840afce0 2023-08-09T12:45:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.663+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba840c9850 con 0x7fba840afce0 2023-08-09T12:45:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.664+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba840c9e10 con 0x7fba840afce0 2023-08-09T12:45:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.665+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba84067a80 con 0x7fba840afce0 2023-08-09T12:45:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.666+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fba8000c6d0 con 0x7fba840afce0 2023-08-09T12:45:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.667+0000 7fba7a7fc640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6806a050 0x7fba6806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.667+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba80088200 con 0x7fba840afce0 2023-08-09T12:45:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.667+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fba680721a0 con 0x7fba840afce0 2023-08-09T12:45:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.667+0000 7fba89121640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6806a050 0x7fba6806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:20.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.669+0000 7fba89121640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6806a050 0x7fba6806c510 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fba74006fd0 tx=0x7fba74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.671+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fba80053980 con 0x7fba840afce0 2023-08-09T12:45:20.813 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:45:20.810+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-08-09T12:45:20.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.820+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(97..97 src has 1..97) v4 ==== 296+0+0 (secure 0 0 0) 0x7fba80057cd0 con 0x7fba840afce0 2023-08-09T12:45:20.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.820+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7fba68072a50 con 0x7fba840afce0 2023-08-09T12:45:20.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.871+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba8406b380 con 0x7fba840afce0 2023-08-09T12:45:20.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.872+0000 7fba7a7fc640 1 -- 172.21.15.17:0/625138353 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba80020030 con 0x7fba840afce0 2023-08-09T12:45:20.875 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:45:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6806a050 msgr2=0x7fba6806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6806a050 0x7fba6806c510 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fba74006fd0 tx=0x7fba74008040 comp rx=0 tx=0).stop 2023-08-09T12:45:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840afce0 msgr2=0x7fba840ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840afce0 0x7fba840ca610 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fba8000e7e0 tx=0x7fba8000eca0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 shutdown_connections 2023-08-09T12:45:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6806a050 0x7fba6806c510 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba84158840 0x7fba840c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba840cef20 0x7fba8414d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 --2- 172.21.15.17:0/625138353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba840afce0 0x7fba840ca610 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:20.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 >> 172.21.15.17:0/625138353 conn(0x7fba84069be0 msgr2=0x7fba8415a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:20.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 shutdown_connections 2023-08-09T12:45:20.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:20.875+0000 7fba8bb86640 1 -- 172.21.15.17:0/625138353 wait complete. 2023-08-09T12:45:20.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:45:21.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.119+0000 7f41a11a4640 1 Processor -- start 2023-08-09T12:45:21.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.119+0000 7f41a11a4640 1 -- start start 2023-08-09T12:45:21.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.121+0000 7f41a11a4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f419c15a8c0 0x7f419c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.121+0000 7f41a11a4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c15e7b0 con 0x7f419c0b13f0 2023-08-09T12:45:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.121+0000 7f41a11a4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c0b1850 con 0x7f419c0b0020 2023-08-09T12:45:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.121+0000 7f41a11a4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c15e460 con 0x7f419c15a8c0 2023-08-09T12:45:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.121+0000 7f419bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f419c15a8c0 0x7f419c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.121+0000 7f419bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f419c15a8c0 0x7f419c0b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51366/0 (socket says 172.21.15.17:51366) 2023-08-09T12:45:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.121+0000 7f419bfff640 1 -- 172.21.15.17:0/3656584747 learned_addr learned my addr 172.21.15.17:0/3656584747 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.121+0000 7f419b7fe640 1 --1- 172.21.15.17:0/3656584747 >> v1:172.21.15.17:6789/0 conn(0x7f419c0b13f0 0x7f419c15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58780/0 (socket says 172.21.15.17:58780) 2023-08-09T12:45:21.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.122+0000 7f419bfff640 1 -- 172.21.15.17:0/3656584747 >> v1:172.21.15.142:6789/0 conn(0x7f419c0b0020 legacy=0x7f419c0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:21.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.122+0000 7f419bfff640 1 -- 172.21.15.17:0/3656584747 >> v1:172.21.15.17:6789/0 conn(0x7f419c0b13f0 legacy=0x7f419c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.122+0000 7f419bfff640 1 -- 172.21.15.17:0/3656584747 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c15aca0 con 0x7f419c15a8c0 2023-08-09T12:45:21.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.122+0000 7f419affd640 1 -- 172.21.15.17:0/3656584747 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264670313 0 0) 0x7f419c15e7b0 con 0x7f419c0b13f0 2023-08-09T12:45:21.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.123+0000 7f419bfff640 1 --2- 172.21.15.17:0/3656584747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c15a8c0 0x7f419c0b4170 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f418c009e50 tx=0x7f418c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b03aa3eaf3439d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:21.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.123+0000 7f419affd640 1 -- 172.21.15.17:0/3656584747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c02cb00 con 0x7f419c15a8c0 2023-08-09T12:45:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.123+0000 7f419affd640 1 -- 172.21.15.17:0/3656584747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c02cc60 con 0x7f419c15a8c0 2023-08-09T12:45:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.123+0000 7f419affd640 1 -- 172.21.15.17:0/3656584747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0343f0 con 0x7f419c15a8c0 2023-08-09T12:45:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.124+0000 7f41a11a4640 1 -- 172.21.15.17:0/3656584747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c15a8c0 msgr2=0x7f419c0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.124+0000 7f41a11a4640 1 --2- 172.21.15.17:0/3656584747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c15a8c0 0x7f419c0b4170 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f418c009e50 tx=0x7f418c02bf60 comp rx=0 tx=0).stop 2023-08-09T12:45:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.124+0000 7f41a11a4640 1 -- 172.21.15.17:0/3656584747 shutdown_connections 2023-08-09T12:45:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.124+0000 7f41a11a4640 1 --2- 172.21.15.17:0/3656584747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c15a8c0 0x7f419c0b4170 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.124+0000 7f41a11a4640 1 -- 172.21.15.17:0/3656584747 >> 172.21.15.17:0/3656584747 conn(0x7f419c0cb020 msgr2=0x7f419c0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.124+0000 7f41a11a4640 1 -- 172.21.15.17:0/3656584747 shutdown_connections 2023-08-09T12:45:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.124+0000 7f41a11a4640 1 -- 172.21.15.17:0/3656584747 wait complete. 2023-08-09T12:45:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.126+0000 7f41a11a4640 1 Processor -- start 2023-08-09T12:45:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.126+0000 7f41a11a4640 1 -- start start 2023-08-09T12:45:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.127+0000 7f41a11a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0b0020 0x7f419c14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.127+0000 7f41a11a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c0b13f0 0x7f419c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.127+0000 7f41a11a4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c15a8c0 0x7f419c148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f41a11a4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c14c7c0 con 0x7f419c0b13f0 2023-08-09T12:45:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f41a11a4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c14c9f0 con 0x7f419c15a8c0 2023-08-09T12:45:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f41a11a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c14ccd0 con 0x7f419c0b0020 2023-08-09T12:45:21.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c0b13f0 0x7f419c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c0b13f0 0x7f419c15aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51374/0 (socket says 172.21.15.17:51374) 2023-08-09T12:45:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419b7fe640 1 -- 172.21.15.17:0/1103427474 learned_addr learned my addr 172.21.15.17:0/1103427474 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419bfff640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0b0020 0x7f419c14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f41a09a3640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c15a8c0 0x7f419c148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419b7fe640 1 -- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0b0020 msgr2=0x7f419c14c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419b7fe640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0b0020 0x7f419c14c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419b7fe640 1 -- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c15a8c0 msgr2=0x7f419c148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419b7fe640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c15a8c0 0x7f419c148300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419b7fe640 1 -- 172.21.15.17:0/1103427474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c009b30 con 0x7f419c0b13f0 2023-08-09T12:45:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.128+0000 7f419bfff640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0b0020 0x7f419c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.129+0000 7f419b7fe640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c0b13f0 0x7f419c15aee0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f418400c4d0 tx=0x7f418400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.129+0000 7f4198ff9640 1 -- 172.21.15.17:0/1103427474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840074e0 con 0x7f419c0b13f0 2023-08-09T12:45:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.129+0000 7f4198ff9640 1 -- 172.21.15.17:0/1103427474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4184007660 con 0x7f419c0b13f0 2023-08-09T12:45:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.129+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c14cfb0 con 0x7f419c0b13f0 2023-08-09T12:45:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.129+0000 7f4198ff9640 1 -- 172.21.15.17:0/1103427474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184004a20 con 0x7f419c0b13f0 2023-08-09T12:45:21.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.129+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c14d570 con 0x7f419c0b13f0 2023-08-09T12:45:21.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.130+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c04e390 con 0x7f419c0b13f0 2023-08-09T12:45:21.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.131+0000 7f4198ff9640 1 -- 172.21.15.17:0/1103427474 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4184004b80 con 0x7f419c0b13f0 2023-08-09T12:45:21.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.133+0000 7f4198ff9640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f417c06a080 0x7f417c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.133+0000 7f4198ff9640 1 -- 172.21.15.17:0/1103427474 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4184087a90 con 0x7f419c0b13f0 2023-08-09T12:45:21.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.133+0000 7f4198ff9640 1 -- 172.21.15.17:0/1103427474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f417c0721d0 con 0x7f419c0b13f0 2023-08-09T12:45:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.133+0000 7f419bfff640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f417c06a080 0x7f417c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.135+0000 7f419bfff640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f417c06a080 0x7f417c06c540 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f418c035000 tx=0x7f418c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:21.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.137+0000 7f4198ff9640 1 -- 172.21.15.17:0/1103427474 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4184018060 con 0x7f419c0b13f0 2023-08-09T12:45:21.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.332+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f419c0b3a90 con 0x7f419c0b13f0 2023-08-09T12:45:21.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.332+0000 7f4198ff9640 1 -- 172.21.15.17:0/1103427474 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4184053170 con 0x7f419c0b13f0 2023-08-09T12:45:21.336 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:45:21.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f417c06a080 msgr2=0x7f417c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f417c06a080 0x7f417c06c540 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f418c035000 tx=0x7f418c030000 comp rx=0 tx=0).stop 2023-08-09T12:45:21.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c0b13f0 msgr2=0x7f419c15aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c0b13f0 0x7f419c15aee0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f418400c4d0 tx=0x7f418400c990 comp rx=0 tx=0).stop 2023-08-09T12:45:21.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 shutdown_connections 2023-08-09T12:45:21.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f417c06a080 0x7f417c06c540 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c15a8c0 0x7f419c148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f419c0b13f0 0x7f419c15aee0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 --2- 172.21.15.17:0/1103427474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0b0020 0x7f419c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 >> 172.21.15.17:0/1103427474 conn(0x7f419c0cb020 msgr2=0x7f419c0aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:21.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.335+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 shutdown_connections 2023-08-09T12:45:21.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.336+0000 7f41a11a4640 1 -- 172.21.15.17:0/1103427474 wait complete. 2023-08-09T12:45:21.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:45:21.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.578+0000 7f40cf59e640 1 Processor -- start 2023-08-09T12:45:21.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.578+0000 7f40cf59e640 1 -- start start 2023-08-09T12:45:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.580+0000 7f40cf59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d0070f00 0x7f40d015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.580+0000 7f40cf59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40d015bce0 0x7f40d00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.580+0000 7f40cf59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d0071340 con 0x7f40d01587e0 2023-08-09T12:45:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.580+0000 7f40cf59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00715c0 con 0x7f40d015bce0 2023-08-09T12:45:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.580+0000 7f40cf59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00718a0 con 0x7f40d0070f00 2023-08-09T12:45:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.580+0000 7f40ced9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40d015bce0 0x7f40d00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.580+0000 7f40ced9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40d015bce0 0x7f40d00cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51376/0 (socket says 172.21.15.17:51376) 2023-08-09T12:45:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.580+0000 7f40ced9d640 1 -- 172.21.15.17:0/673761723 learned_addr learned my addr 172.21.15.17:0/673761723 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.581+0000 7f40cdd9b640 1 --2- 172.21.15.17:0/673761723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d0070f00 0x7f40d015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.581+0000 7f40ced9d640 1 -- 172.21.15.17:0/673761723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d0070f00 msgr2=0x7f40d015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.581+0000 7f40ced9d640 1 --2- 172.21.15.17:0/673761723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d0070f00 0x7f40d015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.581+0000 7f40ced9d640 1 -- 172.21.15.17:0/673761723 >> v1:172.21.15.142:6789/0 conn(0x7f40d01587e0 legacy=0x7f40d00b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.581+0000 7f40ced9d640 1 -- 172.21.15.17:0/673761723 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0071b80 con 0x7f40d015bce0 2023-08-09T12:45:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.582+0000 7f40ced9d640 1 --2- 172.21.15.17:0/673761723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d015bce0 0x7f40d00cb070 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009e50 tx=0x7f40c802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a4b1e508a4f9a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cd59a640 1 -- 172.21.15.17:0/673761723 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c802cb00 con 0x7f40d015bce0 2023-08-09T12:45:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cd59a640 1 -- 172.21.15.17:0/673761723 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c802cc60 con 0x7f40d015bce0 2023-08-09T12:45:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cd59a640 1 -- 172.21.15.17:0/673761723 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80343f0 con 0x7f40d015bce0 2023-08-09T12:45:21.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cf59e640 1 -- 172.21.15.17:0/673761723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d015bce0 msgr2=0x7f40d00cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cf59e640 1 --2- 172.21.15.17:0/673761723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d015bce0 0x7f40d00cb070 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009e50 tx=0x7f40c802bf60 comp rx=0 tx=0).stop 2023-08-09T12:45:21.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cf59e640 1 -- 172.21.15.17:0/673761723 shutdown_connections 2023-08-09T12:45:21.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cf59e640 1 --2- 172.21.15.17:0/673761723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d015bce0 0x7f40d00cb070 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cf59e640 1 --2- 172.21.15.17:0/673761723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d0070f00 0x7f40d015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cf59e640 1 -- 172.21.15.17:0/673761723 >> 172.21.15.17:0/673761723 conn(0x7f40d00b1d50 msgr2=0x7f40d006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:21.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.583+0000 7f40cf59e640 1 -- 172.21.15.17:0/673761723 shutdown_connections 2023-08-09T12:45:21.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.584+0000 7f40cf59e640 1 -- 172.21.15.17:0/673761723 wait complete. 2023-08-09T12:45:21.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.585+0000 7f40cf59e640 1 Processor -- start 2023-08-09T12:45:21.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.585+0000 7f40cf59e640 1 -- start start 2023-08-09T12:45:21.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.586+0000 7f40cf59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d0070f00 0x7f40d00cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.586+0000 7f40cf59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d01587e0 0x7f40d015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.586+0000 7f40cf59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d015cf30 0x7f40d00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.586+0000 7f40cf59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00b0480 con 0x7f40d0070f00 2023-08-09T12:45:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.586+0000 7f40cf59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015ab10 con 0x7f40d015cf30 2023-08-09T12:45:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.586+0000 7f40cf59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015c170 con 0x7f40d01587e0 2023-08-09T12:45:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d0070f00 0x7f40d00cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d0070f00 0x7f40d00cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51378/0 (socket says 172.21.15.17:51378) 2023-08-09T12:45:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ce59c640 1 -- 172.21.15.17:0/979286691 learned_addr learned my addr 172.21.15.17:0/979286691 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:21.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40cdd9b640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d01587e0 0x7f40d015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ced9d640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d015cf30 0x7f40d00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ce59c640 1 -- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d01587e0 msgr2=0x7f40d015a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ce59c640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d01587e0 0x7f40d015a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ce59c640 1 -- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d015cf30 msgr2=0x7f40d00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ce59c640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d015cf30 0x7f40d00cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.587+0000 7f40ce59c640 1 -- 172.21.15.17:0/979286691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8009b30 con 0x7f40d0070f00 2023-08-09T12:45:21.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.588+0000 7f40ce59c640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d0070f00 0x7f40d00cb5e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c450 tx=0x7f40c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:21.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.588+0000 7f40beffd640 1 -- 172.21.15.17:0/979286691 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00052d0 con 0x7f40d0070f00 2023-08-09T12:45:21.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.588+0000 7f40beffd640 1 -- 172.21.15.17:0/979286691 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0005430 con 0x7f40d0070f00 2023-08-09T12:45:21.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.588+0000 7f40beffd640 1 -- 172.21.15.17:0/979286691 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0012870 con 0x7f40d0070f00 2023-08-09T12:45:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.588+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d015c450 con 0x7f40d0070f00 2023-08-09T12:45:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.588+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d015ca10 con 0x7f40d0070f00 2023-08-09T12:45:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.589+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d004e390 con 0x7f40d0070f00 2023-08-09T12:45:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.590+0000 7f40beffd640 1 -- 172.21.15.17:0/979286691 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f40c00129d0 con 0x7f40d0070f00 2023-08-09T12:45:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.591+0000 7f40beffd640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40b006a080 0x7f40b006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.591+0000 7f40beffd640 1 -- 172.21.15.17:0/979286691 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40c0088140 con 0x7f40d0070f00 2023-08-09T12:45:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.592+0000 7f40beffd640 1 -- 172.21.15.17:0/979286691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f40b00721d0 con 0x7f40d0070f00 2023-08-09T12:45:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.592+0000 7f40cdd9b640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40b006a080 0x7f40b006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.593+0000 7f40cdd9b640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40b006a080 0x7f40b006c540 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f40d00cae10 tx=0x7f40c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:21.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.596+0000 7f40beffd640 1 -- 172.21.15.17:0/979286691 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f40c0053790 con 0x7f40d0070f00 2023-08-09T12:45:21.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.804+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f40d00b3500 con 0x7f40d0070f00 2023-08-09T12:45:21.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.805+0000 7f40beffd640 1 -- 172.21.15.17:0/979286691 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v97) v1 ==== 80+0+0 (secure 0 0 0) 0x7f40c0056db0 con 0x7f40d0070f00 2023-08-09T12:45:21.808 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:45:21.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.807+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40b006a080 msgr2=0x7f40b006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.807+0000 7f40cf59e640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40b006a080 0x7f40b006c540 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f40d00cae10 tx=0x7f40c4008040 comp rx=0 tx=0).stop 2023-08-09T12:45:21.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.807+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d0070f00 msgr2=0x7f40d00cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:21.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.807+0000 7f40cf59e640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d0070f00 0x7f40d00cb5e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c450 tx=0x7f40c000c910 comp rx=0 tx=0).stop 2023-08-09T12:45:21.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.808+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 shutdown_connections 2023-08-09T12:45:21.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.808+0000 7f40cf59e640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40b006a080 0x7f40b006c540 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.808+0000 7f40cf59e640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d015cf30 0x7f40d00cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.808+0000 7f40cf59e640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d01587e0 0x7f40d015a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.808+0000 7f40cf59e640 1 --2- 172.21.15.17:0/979286691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d0070f00 0x7f40d00cb5e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:21.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.808+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 >> 172.21.15.17:0/979286691 conn(0x7f40d00b1d50 msgr2=0x7f40d0156f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:21.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.808+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 shutdown_connections 2023-08-09T12:45:21.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:21.808+0000 7f40cf59e640 1 -- 172.21.15.17:0/979286691 wait complete. 2023-08-09T12:45:21.834 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:45:21.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:21.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:45:21.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:45:21.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:21.949 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:45:21.994 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:45:21.995 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:22.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:45:22.058 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:45:22.059 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:22.120 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:45:22.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:45:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.341+0000 7f12f0aad640 1 Processor -- start 2023-08-09T12:45:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.342+0000 7f12f0aad640 1 -- start start 2023-08-09T12:45:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.343+0000 7f12f0aad640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12ec160030 0x7f12ec160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.343+0000 7f12f0aad640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0b5a30 con 0x7f12ec0cfb50 2023-08-09T12:45:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.344+0000 7f12f0aad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0d0d70 con 0x7f12ec0b86e0 2023-08-09T12:45:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.344+0000 7f12f0aad640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec0d1110 con 0x7f12ec160030 2023-08-09T12:45:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.344+0000 7f12ebfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f12ec0cfb50 0x7f12ec0d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58794/0 (socket says 172.21.15.17:58794) 2023-08-09T12:45:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.344+0000 7f12ebfff640 1 -- 172.21.15.17:0/1077035944 learned_addr learned my addr 172.21.15.17:0/1077035944 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:22.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.344+0000 7f12eb7fe640 1 --2- 172.21.15.17:0/1077035944 >> v2:172.21.15.17:3300/0 conn(0x7f12ec160030 0x7f12ec160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:22.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.344+0000 7f12eaffd640 1 -- 172.21.15.17:0/1077035944 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798921814 0 0) 0x7f12ec0b5a30 con 0x7f12ec0cfb50 2023-08-09T12:45:22.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.344+0000 7f12eaffd640 1 -- 172.21.15.17:0/1077035944 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d8003520 con 0x7f12ec0cfb50 2023-08-09T12:45:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.345+0000 7f12eb7fe640 1 -- 172.21.15.17:0/1077035944 >> v1:172.21.15.142:6789/0 conn(0x7f12ec0b86e0 legacy=0x7f12ec0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.345+0000 7f12eb7fe640 1 -- 172.21.15.17:0/1077035944 >> v1:172.21.15.17:6789/0 conn(0x7f12ec0cfb50 legacy=0x7f12ec0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.345+0000 7f12eb7fe640 1 -- 172.21.15.17:0/1077035944 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec160f70 con 0x7f12ec160030 2023-08-09T12:45:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.346+0000 7f12eb7fe640 1 --2- 172.21.15.17:0/1077035944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec160030 0x7f12ec160740 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0097a0 tx=0x7f12dc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae23ac45977a1c67 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.346+0000 7f12eaffd640 1 -- 172.21.15.17:0/1077035944 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc030610 con 0x7f12ec160030 2023-08-09T12:45:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.346+0000 7f12eaffd640 1 -- 172.21.15.17:0/1077035944 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc030770 con 0x7f12ec160030 2023-08-09T12:45:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.346+0000 7f12eaffd640 1 -- 172.21.15.17:0/1077035944 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc030ae0 con 0x7f12ec160030 2023-08-09T12:45:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.347+0000 7f12f0aad640 1 -- 172.21.15.17:0/1077035944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec160030 msgr2=0x7f12ec160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.347+0000 7f12f0aad640 1 --2- 172.21.15.17:0/1077035944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec160030 0x7f12ec160740 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0097a0 tx=0x7f12dc02b960 comp rx=0 tx=0).stop 2023-08-09T12:45:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.347+0000 7f12f0aad640 1 -- 172.21.15.17:0/1077035944 shutdown_connections 2023-08-09T12:45:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.347+0000 7f12f0aad640 1 --2- 172.21.15.17:0/1077035944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec160030 0x7f12ec160740 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.347+0000 7f12f0aad640 1 -- 172.21.15.17:0/1077035944 >> 172.21.15.17:0/1077035944 conn(0x7f12ec0697c0 msgr2=0x7f12ec069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.347+0000 7f12f0aad640 1 -- 172.21.15.17:0/1077035944 shutdown_connections 2023-08-09T12:45:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.347+0000 7f12f0aad640 1 -- 172.21.15.17:0/1077035944 wait complete. 2023-08-09T12:45:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.349+0000 7f12f0aad640 1 Processor -- start 2023-08-09T12:45:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.349+0000 7f12f0aad640 1 -- start start 2023-08-09T12:45:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12f0aad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec0b86e0 0x7f12ec0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12f0aad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12ec0cfb50 0x7f12ec1f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12f0aad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ec1f2690 0x7f12ec0b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12f0aad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b2f90 con 0x7f12ec0b86e0 2023-08-09T12:45:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12f0aad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b3270 con 0x7f12ec1f2690 2023-08-09T12:45:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12f0aad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b3550 con 0x7f12ec0cfb50 2023-08-09T12:45:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12eb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec0b86e0 0x7f12ec0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12eb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec0b86e0 0x7f12ec0b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51402/0 (socket says 172.21.15.17:51402) 2023-08-09T12:45:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.350+0000 7f12eb7fe640 1 -- 172.21.15.17:0/365272422 learned_addr learned my addr 172.21.15.17:0/365272422 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12eb7fe640 1 -- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12ec0cfb50 msgr2=0x7f12ec1f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12eb7fe640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12ec0cfb50 0x7f12ec1f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12eb7fe640 1 -- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ec1f2690 msgr2=0x7f12ec0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12eb7fe640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ec1f2690 0x7f12ec0b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12eb7fe640 1 -- 172.21.15.17:0/365272422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc009400 con 0x7f12ec0b86e0 2023-08-09T12:45:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12eb7fe640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec0b86e0 0x7f12ec0b1c40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f12dc02bef0 tx=0x7f12dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12e8ff9640 1 -- 172.21.15.17:0/365272422 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc039c90 con 0x7f12ec0b86e0 2023-08-09T12:45:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12e8ff9640 1 -- 172.21.15.17:0/365272422 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc03f040 con 0x7f12ec0b86e0 2023-08-09T12:45:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12e8ff9640 1 -- 172.21.15.17:0/365272422 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc006e10 con 0x7f12ec0b86e0 2023-08-09T12:45:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec0b3830 con 0x7f12ec0b86e0 2023-08-09T12:45:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.351+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec0b2180 con 0x7f12ec0b86e0 2023-08-09T12:45:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.353+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec0b3d50 con 0x7f12ec0b86e0 2023-08-09T12:45:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.353+0000 7f12e8ff9640 1 -- 172.21.15.17:0/365272422 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f12dc004030 con 0x7f12ec0b86e0 2023-08-09T12:45:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.354+0000 7f12e8ff9640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12cc06a050 0x7f12cc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.354+0000 7f12e8ff9640 1 -- 172.21.15.17:0/365272422 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12dc0aa150 con 0x7f12ec0b86e0 2023-08-09T12:45:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.355+0000 7f12e3fff640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12cc06a050 0x7f12cc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.356+0000 7f12e3fff640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12cc06a050 0x7f12cc06c510 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f12d4000f60 tx=0x7f12d40079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.358+0000 7f12e8ff9640 1 -- 172.21.15.17:0/365272422 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f12ec0b3d50 con 0x7f12ec0b86e0 2023-08-09T12:45:22.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.588+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12ec0b3d50 con 0x7f12ec0b86e0 2023-08-09T12:45:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.589+0000 7f12e8ff9640 1 -- 172.21.15.17:0/365272422 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f12dc0757a0 con 0x7f12ec0b86e0 2023-08-09T12:45:22.592 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:22.593 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2093028023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2093028023},{"type":"v1","addr":"172.21.15.142:6835","nonce":2093028023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2762526663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2762526663},{"type":"v1","addr":"172.21.15.142:6837","nonce":2762526663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2544978987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2544978987},{"type":"v1","addr":"172.21.15.17:6834","nonce":2544978987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:44:25.543433+0000","modified":"2023-08-09T12:44:29.110856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4077789912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4077789912},{"type":"v1","addr":"172.21.15.17:6835","nonce":4077789912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-09T12:45:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 43 2023-08-09T12:45:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12cc06a050 msgr2=0x7f12cc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12cc06a050 0x7f12cc06c510 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f12d4000f60 tx=0x7f12d40079b0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec0b86e0 msgr2=0x7f12ec0b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec0b86e0 0x7f12ec0b1c40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f12dc02bef0 tx=0x7f12dc0046c0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 shutdown_connections 2023-08-09T12:45:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12cc06a050 0x7f12cc06c510 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ec1f2690 0x7f12ec0b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12ec0cfb50 0x7f12ec1f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 --2- 172.21.15.17:0/365272422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12ec0b86e0 0x7f12ec0b1c40 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 >> 172.21.15.17:0/365272422 conn(0x7f12ec0697c0 msgr2=0x7f12ec0c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 shutdown_connections 2023-08-09T12:45:22.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.592+0000 7f12f0aad640 1 -- 172.21.15.17:0/365272422 wait complete. 2023-08-09T12:45:22.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.842+0000 7f07eecda640 1 Processor -- start 2023-08-09T12:45:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.842+0000 7f07eecda640 1 -- start start 2023-08-09T12:45:22.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.844+0000 7f07eecda640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f07e80b0900 0x7f07e806c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.844+0000 7f07eecda640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e80ca930 con 0x7f07e815b140 2023-08-09T12:45:22.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.844+0000 7f07eecda640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e815b520 con 0x7f07e80b0ea0 2023-08-09T12:45:22.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.844+0000 7f07eecda640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e806cb30 con 0x7f07e80b0900 2023-08-09T12:45:22.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.845+0000 7f07eca76640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f07e815b140 0x7f07e806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58810/0 (socket says 172.21.15.17:58810) 2023-08-09T12:45:22.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.845+0000 7f07eca76640 1 -- 172.21.15.17:0/3960203472 learned_addr learned my addr 172.21.15.17:0/3960203472 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:22.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.845+0000 7f07ed277640 1 --2- 172.21.15.17:0/3960203472 >> v2:172.21.15.17:3300/0 conn(0x7f07e80b0900 0x7f07e806c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:22.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.845+0000 7f07ed277640 1 -- 172.21.15.17:0/3960203472 >> v1:172.21.15.142:6789/0 conn(0x7f07e80b0ea0 legacy=0x7f07e8069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.845+0000 7f07ed277640 1 -- 172.21.15.17:0/3960203472 >> v1:172.21.15.17:6789/0 conn(0x7f07e815b140 legacy=0x7f07e806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.845+0000 7f07ed277640 1 -- 172.21.15.17:0/3960203472 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80cabd0 con 0x7f07e80b0900 2023-08-09T12:45:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.845+0000 7f07e77fe640 1 -- 172.21.15.17:0/3960203472 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364591553 0 0) 0x7f07e80ca930 con 0x7f07e815b140 2023-08-09T12:45:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.847+0000 7f07ed277640 1 --2- 172.21.15.17:0/3960203472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0900 0x7f07e806c4c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009d90 tx=0x7f07e002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297e05c97b64769b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.847+0000 7f07e77fe640 1 -- 172.21.15.17:0/3960203472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e002cbd0 con 0x7f07e80b0900 2023-08-09T12:45:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.847+0000 7f07e77fe640 1 -- 172.21.15.17:0/3960203472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e002cd30 con 0x7f07e80b0900 2023-08-09T12:45:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.847+0000 7f07e77fe640 1 -- 172.21.15.17:0/3960203472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e002cea0 con 0x7f07e80b0900 2023-08-09T12:45:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.848+0000 7f07eecda640 1 -- 172.21.15.17:0/3960203472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0900 msgr2=0x7f07e806c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.848+0000 7f07eecda640 1 --2- 172.21.15.17:0/3960203472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0900 0x7f07e806c4c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009d90 tx=0x7f07e002be20 comp rx=0 tx=0).stop 2023-08-09T12:45:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.848+0000 7f07eecda640 1 -- 172.21.15.17:0/3960203472 shutdown_connections 2023-08-09T12:45:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.848+0000 7f07eecda640 1 --2- 172.21.15.17:0/3960203472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0900 0x7f07e806c4c0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.848+0000 7f07eecda640 1 -- 172.21.15.17:0/3960203472 >> 172.21.15.17:0/3960203472 conn(0x7f07e80cc350 msgr2=0x7f07e80cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.848+0000 7f07eecda640 1 -- 172.21.15.17:0/3960203472 shutdown_connections 2023-08-09T12:45:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.848+0000 7f07eecda640 1 -- 172.21.15.17:0/3960203472 wait complete. 2023-08-09T12:45:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.850+0000 7f07eecda640 1 Processor -- start 2023-08-09T12:45:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.851+0000 7f07eecda640 1 -- start start 2023-08-09T12:45:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.852+0000 7f07eecda640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e80b0900 0x7f07e80c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.852+0000 7f07eecda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0ea0 0x7f07e80c3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.852+0000 7f07eecda640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e815b140 0x7f07e80c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.852+0000 7f07eecda640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e8156c70 con 0x7f07e80b0ea0 2023-08-09T12:45:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.853+0000 7f07eecda640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e81e0560 con 0x7f07e815b140 2023-08-09T12:45:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.853+0000 7f07eecda640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e81e0840 con 0x7f07e80b0900 2023-08-09T12:45:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.853+0000 7f07e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0ea0 0x7f07e80c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:22.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.853+0000 7f07e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0ea0 0x7f07e80c3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51432/0 (socket says 172.21.15.17:51432) 2023-08-09T12:45:22.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.853+0000 7f07e7fff640 1 -- 172.21.15.17:0/2328665587 learned_addr learned my addr 172.21.15.17:0/2328665587 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:22.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.853+0000 7f07eca76640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e80b0900 0x7f07e80c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.854+0000 7f07e7fff640 1 -- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e80b0900 msgr2=0x7f07e80c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.854+0000 7f07e7fff640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e80b0900 0x7f07e80c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.854+0000 7f07e7fff640 1 -- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e815b140 msgr2=0x7f07e80c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.854+0000 7f07e7fff640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e815b140 0x7f07e80c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.854+0000 7f07e7fff640 1 -- 172.21.15.17:0/2328665587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0009a70 con 0x7f07e80b0ea0 2023-08-09T12:45:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.854+0000 7f07e7fff640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0ea0 0x7f07e80c3400 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c450 tx=0x7f07d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.855+0000 7f07e57fa640 1 -- 172.21.15.17:0/2328665587 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40052d0 con 0x7f07e80b0ea0 2023-08-09T12:45:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.855+0000 7f07e57fa640 1 -- 172.21.15.17:0/2328665587 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4005430 con 0x7f07e80b0ea0 2023-08-09T12:45:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.855+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e81e0b20 con 0x7f07e80b0ea0 2023-08-09T12:45:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.855+0000 7f07e57fa640 1 -- 172.21.15.17:0/2328665587 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4012870 con 0x7f07e80b0ea0 2023-08-09T12:45:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.855+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e81e10e0 con 0x7f07e80b0ea0 2023-08-09T12:45:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.856+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e8067a80 con 0x7f07e80b0ea0 2023-08-09T12:45:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.857+0000 7f07e57fa640 1 -- 172.21.15.17:0/2328665587 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f07d40129d0 con 0x7f07e80b0ea0 2023-08-09T12:45:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.858+0000 7f07e57fa640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07cc06a050 0x7f07cc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.858+0000 7f07e57fa640 1 -- 172.21.15.17:0/2328665587 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07d4088180 con 0x7f07e80b0ea0 2023-08-09T12:45:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.859+0000 7f07eca76640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07cc06a050 0x7f07cc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.861+0000 7f07eca76640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07cc06a050 0x7f07cc06c510 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f07dc000f60 tx=0x7f07dc007b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:22.862+0000 7f07e57fa640 1 -- 172.21.15.17:0/2328665587 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f07d40537d0 con 0x7f07e80b0ea0 2023-08-09T12:45:23.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.057+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07e8073740 con 0x7f07e80b0ea0 2023-08-09T12:45:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.059+0000 7f07e57fa640 1 -- 172.21.15.17:0/2328665587 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+18330 (secure 0 0 0) 0x7f07d4056df0 con 0x7f07e80b0ea0 2023-08-09T12:45:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:23.064 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":99,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:45:22.838658+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:44:23.740360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-09T12:44:24.571392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07cc06a050 msgr2=0x7f07cc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07cc06a050 0x7f07cc06c510 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f07dc000f60 tx=0x7f07dc007b90 comp rx=0 tx=0).stop 2023-08-09T12:45:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0ea0 msgr2=0x7f07e80c3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0ea0 0x7f07e80c3400 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c450 tx=0x7f07d400c910 comp rx=0 tx=0).stop 2023-08-09T12:45:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 shutdown_connections 2023-08-09T12:45:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07cc06a050 0x7f07cc06c510 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e815b140 0x7f07e80c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80b0ea0 0x7f07e80c3400 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 --2- 172.21.15.17:0/2328665587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07e80b0900 0x7f07e80c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 >> 172.21.15.17:0/2328665587 conn(0x7f07e80cc350 msgr2=0x7f07e806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:23.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 shutdown_connections 2023-08-09T12:45:23.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.062+0000 7f07eecda640 1 -- 172.21.15.17:0/2328665587 wait complete. 2023-08-09T12:45:23.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:44:23.740360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:44:24.571392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:45:23.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:45:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.312+0000 7feed5877640 1 Processor -- start 2023-08-09T12:45:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.313+0000 7feed5877640 1 -- start start 2023-08-09T12:45:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.314+0000 7feed5877640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feed015cb40 0x7feed01609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.314+0000 7feed5877640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00d0f00 con 0x7feed00cdf70 2023-08-09T12:45:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.314+0000 7feed5877640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed01611f0 con 0x7feed00b8420 2023-08-09T12:45:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.314+0000 7feed5877640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed01614d0 con 0x7feed015cb40 2023-08-09T12:45:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.315+0000 7feed5076640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7feed00cdf70 0x7feed00d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58812/0 (socket says 172.21.15.17:58812) 2023-08-09T12:45:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.315+0000 7feed5076640 1 -- 172.21.15.17:0/1386128371 learned_addr learned my addr 172.21.15.17:0/1386128371 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.315+0000 7feed4875640 1 --2- 172.21.15.17:0/1386128371 >> v2:172.21.15.142:3300/0 conn(0x7feed015cb40 0x7feed01609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.315+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539637830 0 0) 0x7feed00d0f00 con 0x7feed00cdf70 2023-08-09T12:45:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.315+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec0003520 con 0x7feed00cdf70 2023-08-09T12:45:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153052262 0 0) 0x7feec0003520 con 0x7feed00cdf70 2023-08-09T12:45:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 >> v2:172.21.15.142:3300/0 conn(0x7feed015cb40 msgr2=0x7feed01609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 --2- 172.21.15.17:0/1386128371 >> v2:172.21.15.142:3300/0 conn(0x7feed015cb40 0x7feed01609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 >> v1:172.21.15.142:6789/0 conn(0x7feed00b8420 legacy=0x7feed00cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed01617b0 con 0x7feed00cdf70 2023-08-09T12:45:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7feec80019f0 con 0x7feed00cdf70 2023-08-09T12:45:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 >> v1:172.21.15.17:6789/0 conn(0x7feed00cdf70 legacy=0x7feed00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec0003970 0x7feec0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec00047c0 0x7feec0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec0005180 0x7feec000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01614d0 con 0x7feec0005180 2023-08-09T12:45:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec000c030 con 0x7feec00047c0 2023-08-09T12:45:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec000c1f0 con 0x7feec0003970 2023-08-09T12:45:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feed5076640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec0005180 0x7feec000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feecffff640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec00047c0 0x7feec0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.316+0000 7feed4875640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec0003970 0x7feec0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.317+0000 7feed5076640 1 -- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec0003970 msgr2=0x7feec0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.317+0000 7feed5076640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec0003970 0x7feec0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.317+0000 7feed5076640 1 -- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec00047c0 msgr2=0x7feec0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.317+0000 7feed5076640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec00047c0 0x7feec0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.317+0000 7feed5076640 1 -- 172.21.15.17:0/1386128371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0003520 con 0x7feec0005180 2023-08-09T12:45:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.317+0000 7feecffff640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec00047c0 0x7feec0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.317+0000 7feed4875640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec0003970 0x7feec0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.318+0000 7feed5076640 1 -- 172.21.15.17:0/1386128371 reap_dead start 2023-08-09T12:45:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.318+0000 7feed5076640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec0005180 0x7feec000b980 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7feec800a830 tx=0x7feec00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dab92003f4f8a44 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.318+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80072d0 con 0x7feec0005180 2023-08-09T12:45:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.318+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec802f070 con 0x7feec0005180 2023-08-09T12:45:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.318+0000 7feecf7fe640 1 -- 172.21.15.17:0/1386128371 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80076b0 con 0x7feec0005180 2023-08-09T12:45:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.319+0000 7feed5877640 1 -- 172.21.15.17:0/1386128371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec0005180 msgr2=0x7feec000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.319+0000 7feed5877640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec0005180 0x7feec000b980 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7feec800a830 tx=0x7feec00057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.319+0000 7feed5877640 1 -- 172.21.15.17:0/1386128371 shutdown_connections 2023-08-09T12:45:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.319+0000 7feed5877640 1 --2- 172.21.15.17:0/1386128371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec0005180 0x7feec000b980 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.319+0000 7feed5877640 1 -- 172.21.15.17:0/1386128371 >> 172.21.15.17:0/1386128371 conn(0x7feed00d2ab0 msgr2=0x7feed00d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.319+0000 7feed5877640 1 -- 172.21.15.17:0/1386128371 shutdown_connections 2023-08-09T12:45:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.319+0000 7feed5877640 1 -- 172.21.15.17:0/1386128371 wait complete. 2023-08-09T12:45:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.321+0000 7feed5877640 1 Processor -- start 2023-08-09T12:45:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.321+0000 7feed5877640 1 -- start start 2023-08-09T12:45:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5877640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0005180 0x7feed015de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5877640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed00ca1c0 0x7feed014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5877640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feed0155fd0 0x7feed0156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5877640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01569c0 con 0x7feed0155fd0 2023-08-09T12:45:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5877640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01f2330 con 0x7feec0005180 2023-08-09T12:45:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5877640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00cb270 con 0x7feed00ca1c0 2023-08-09T12:45:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5076640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feed0155fd0 0x7feed0156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5076640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feed0155fd0 0x7feed0156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51454/0 (socket says 172.21.15.17:51454) 2023-08-09T12:45:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed5076640 1 -- 172.21.15.17:0/2689646382 learned_addr learned my addr 172.21.15.17:0/2689646382 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feed4875640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0005180 0x7feed015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.322+0000 7feecffff640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed00ca1c0 0x7feed014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feed5076640 1 -- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed00ca1c0 msgr2=0x7feed014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feed5076640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed00ca1c0 0x7feed014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feed5076640 1 -- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0005180 msgr2=0x7feed015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feed5076640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0005180 0x7feed015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feed5076640 1 -- 172.21.15.17:0/2689646382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00ca9d0 con 0x7feed0155fd0 2023-08-09T12:45:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feed4875640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0005180 0x7feed015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feecffff640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed00ca1c0 0x7feed014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feed5076640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feed0155fd0 0x7feed0156480 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7feec802cc50 tx=0x7feec8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feecd7fa640 1 -- 172.21.15.17:0/2689646382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8001930 con 0x7feed0155fd0 2023-08-09T12:45:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feecd7fa640 1 -- 172.21.15.17:0/2689646382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8001250 con 0x7feed0155fd0 2023-08-09T12:45:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feecd7fa640 1 -- 172.21.15.17:0/2689646382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8004da0 con 0x7feed0155fd0 2023-08-09T12:45:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.323+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed00cacb0 con 0x7feed0155fd0 2023-08-09T12:45:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.324+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed015e7c0 con 0x7feed0155fd0 2023-08-09T12:45:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.325+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed015e9e0 con 0x7feed0155fd0 2023-08-09T12:45:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.326+0000 7feecd7fa640 1 -- 172.21.15.17:0/2689646382 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feec8031030 con 0x7feed0155fd0 2023-08-09T12:45:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.326+0000 7feecd7fa640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feeb406a050 0x7feeb406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.327+0000 7feecd7fa640 1 -- 172.21.15.17:0/2689646382 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feec80aa160 con 0x7feed0155fd0 2023-08-09T12:45:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.327+0000 7feed4875640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feeb406a050 0x7feeb406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.328+0000 7feed4875640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feeb406a050 0x7feeb406c510 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feec4009aa0 tx=0x7feec4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.331+0000 7feecd7fa640 1 -- 172.21.15.17:0/2689646382 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feec80757b0 con 0x7feed0155fd0 2023-08-09T12:45:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.523+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feed015e9e0 con 0x7feed0155fd0 2023-08-09T12:45:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.524+0000 7feecd7fa640 1 -- 172.21.15.17:0/2689646382 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7feec8078dd0 con 0x7feed0155fd0 2023-08-09T12:45:23.527 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:45:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feeb406a050 msgr2=0x7feeb406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feeb406a050 0x7feeb406c510 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feec4009aa0 tx=0x7feec4008040 comp rx=0 tx=0).stop 2023-08-09T12:45:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feed0155fd0 msgr2=0x7feed0156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feed0155fd0 0x7feed0156480 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7feec802cc50 tx=0x7feec8001d80 comp rx=0 tx=0).stop 2023-08-09T12:45:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 shutdown_connections 2023-08-09T12:45:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feeb406a050 0x7feeb406c510 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feed0155fd0 0x7feed0156480 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed00ca1c0 0x7feed014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 --2- 172.21.15.17:0/2689646382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0005180 0x7feed015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.526+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 >> 172.21.15.17:0/2689646382 conn(0x7feed00d2ab0 msgr2=0x7feed00cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.527+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 shutdown_connections 2023-08-09T12:45:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.527+0000 7feed5877640 1 -- 172.21.15.17:0/2689646382 wait complete. 2023-08-09T12:45:23.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:45:23.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.783+0000 7f8757fff640 1 Processor -- start 2023-08-09T12:45:23.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.783+0000 7f8757fff640 1 -- start start 2023-08-09T12:45:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.784+0000 7f8757fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f875815cb40 0x7f87581609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.784+0000 7f8757fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87580b8420 0x7f87580cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.785+0000 7f8757fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580d0f00 con 0x7f875815cf20 2023-08-09T12:45:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.785+0000 7f8757fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87581611f0 con 0x7f875815cb40 2023-08-09T12:45:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.785+0000 7f8757fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87581614d0 con 0x7f87580b8420 2023-08-09T12:45:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.785+0000 7f8756ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f875815cb40 0x7f87581609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.785+0000 7f8756ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f875815cb40 0x7f87581609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51466/0 (socket says 172.21.15.17:51466) 2023-08-09T12:45:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.785+0000 7f8756ffd640 1 -- 172.21.15.17:0/2325249896 learned_addr learned my addr 172.21.15.17:0/2325249896 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.785+0000 7f87567fc640 1 --2- 172.21.15.17:0/2325249896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87580b8420 0x7f87580cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.786+0000 7f8756ffd640 1 -- 172.21.15.17:0/2325249896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87580b8420 msgr2=0x7f87580cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.786+0000 7f8756ffd640 1 --2- 172.21.15.17:0/2325249896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87580b8420 0x7f87580cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.786+0000 7f8756ffd640 1 -- 172.21.15.17:0/2325249896 >> v1:172.21.15.17:6789/0 conn(0x7f875815cf20 legacy=0x7f87580697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.786+0000 7f8756ffd640 1 -- 172.21.15.17:0/2325249896 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87581617b0 con 0x7f875815cb40 2023-08-09T12:45:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.786+0000 7f8755ffb640 1 -- 172.21.15.17:0/2325249896 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740811817 0 0) 0x7f87580d0f00 con 0x7f875815cf20 2023-08-09T12:45:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.787+0000 7f8756ffd640 1 --2- 172.21.15.17:0/2325249896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f875815cb40 0x7f87581609a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8748009e50 tx=0x7f874802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90343df26acf5f0f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.787+0000 7f8755ffb640 1 -- 172.21.15.17:0/2325249896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874802cb90 con 0x7f875815cb40 2023-08-09T12:45:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.787+0000 7f8755ffb640 1 -- 172.21.15.17:0/2325249896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874802ccf0 con 0x7f875815cb40 2023-08-09T12:45:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.787+0000 7f8755ffb640 1 -- 172.21.15.17:0/2325249896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748034610 con 0x7f875815cb40 2023-08-09T12:45:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.788+0000 7f8757fff640 1 -- 172.21.15.17:0/2325249896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f875815cb40 msgr2=0x7f87581609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.788+0000 7f8757fff640 1 --2- 172.21.15.17:0/2325249896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f875815cb40 0x7f87581609a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8748009e50 tx=0x7f874802bff0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.788+0000 7f8757fff640 1 -- 172.21.15.17:0/2325249896 shutdown_connections 2023-08-09T12:45:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.788+0000 7f8757fff640 1 --2- 172.21.15.17:0/2325249896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87580b8420 0x7f87580cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.788+0000 7f8757fff640 1 --2- 172.21.15.17:0/2325249896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f875815cb40 0x7f87581609a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.788+0000 7f8757fff640 1 -- 172.21.15.17:0/2325249896 >> 172.21.15.17:0/2325249896 conn(0x7f87580d2ab0 msgr2=0x7f87580d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:23.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.788+0000 7f8757fff640 1 -- 172.21.15.17:0/2325249896 shutdown_connections 2023-08-09T12:45:23.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.788+0000 7f8757fff640 1 -- 172.21.15.17:0/2325249896 wait complete. 2023-08-09T12:45:23.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.790+0000 7f8757fff640 1 Processor -- start 2023-08-09T12:45:23.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.790+0000 7f8757fff640 1 -- start start 2023-08-09T12:45:23.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.791+0000 7f8757fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87580b8420 0x7f875814bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.791+0000 7f8757fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875815cb40 0x7f87581f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.791+0000 7f8757fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875815cf20 0x7f87580d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.791+0000 7f8757fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87581f6770 con 0x7f87580b8420 2023-08-09T12:45:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.791+0000 7f8757fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875815dff0 con 0x7f875815cf20 2023-08-09T12:45:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.791+0000 7f8757fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87580a9340 con 0x7f875815cb40 2023-08-09T12:45:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87580b8420 0x7f875814bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87580b8420 0x7f875814bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51474/0 (socket says 172.21.15.17:51474) 2023-08-09T12:45:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 -- 172.21.15.17:0/1110179625 learned_addr learned my addr 172.21.15.17:0/1110179625 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f87567fc640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875815cb40 0x7f87581f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f87577fe640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875815cf20 0x7f87580d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 -- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875815cb40 msgr2=0x7f87581f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875815cb40 0x7f87581f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 -- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875815cf20 msgr2=0x7f87580d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875815cf20 0x7f87580d1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 -- 172.21.15.17:0/1110179625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748009b30 con 0x7f87580b8420 2023-08-09T12:45:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f87577fe640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875815cf20 0x7f87580d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.792+0000 7f8756ffd640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87580b8420 0x7f875814bf30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8748036040 tx=0x7f8748004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.793+0000 7f873f7fe640 1 -- 172.21.15.17:0/1110179625 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748009510 con 0x7f87580b8420 2023-08-09T12:45:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.793+0000 7f873f7fe640 1 -- 172.21.15.17:0/1110179625 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874803e450 con 0x7f87580b8420 2023-08-09T12:45:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.793+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875815e290 con 0x7f87580b8420 2023-08-09T12:45:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.793+0000 7f873f7fe640 1 -- 172.21.15.17:0/1110179625 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874803e800 con 0x7f87580b8420 2023-08-09T12:45:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.793+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87580a9600 con 0x7f87580b8420 2023-08-09T12:45:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.794+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875804e390 con 0x7f87580b8420 2023-08-09T12:45:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.795+0000 7f873f7fe640 1 -- 172.21.15.17:0/1110179625 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f874803e960 con 0x7f87580b8420 2023-08-09T12:45:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.797+0000 7f873f7fe640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f874406a050 0x7f874406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.797+0000 7f873f7fe640 1 -- 172.21.15.17:0/1110179625 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87480ab370 con 0x7f87580b8420 2023-08-09T12:45:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.797+0000 7f87567fc640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f874406a050 0x7f874406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.798+0000 7f87567fc640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f874406a050 0x7f874406c510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8758160de0 tx=0x7f874c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.801+0000 7f873f7fe640 1 -- 172.21.15.17:0/1110179625 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f87480769c0 con 0x7f87580b8420 2023-08-09T12:45:23.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.995+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87580c8fd0 con 0x7f87580b8420 2023-08-09T12:45:23.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.995+0000 7f873f7fe640 1 -- 172.21.15.17:0/1110179625 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7f874802ce60 con 0x7f87580b8420 2023-08-09T12:45:23.999 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:45:24.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f874406a050 msgr2=0x7f874406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f874406a050 0x7f874406c510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8758160de0 tx=0x7f874c008040 comp rx=0 tx=0).stop 2023-08-09T12:45:24.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87580b8420 msgr2=0x7f875814bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87580b8420 0x7f875814bf30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8748036040 tx=0x7f8748004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:24.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 shutdown_connections 2023-08-09T12:45:24.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f874406a050 0x7f874406c510 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875815cf20 0x7f87580d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875815cb40 0x7f87581f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 --2- 172.21.15.17:0/1110179625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87580b8420 0x7f875814bf30 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 >> 172.21.15.17:0/1110179625 conn(0x7f87580d2ab0 msgr2=0x7f87580b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:24.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 shutdown_connections 2023-08-09T12:45:24.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:23.998+0000 7f8757fff640 1 -- 172.21.15.17:0/1110179625 wait complete. 2023-08-09T12:45:24.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:45:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.239+0000 7f12c27cb640 1 Processor -- start 2023-08-09T12:45:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.239+0000 7f12c27cb640 1 -- start start 2023-08-09T12:45:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.240+0000 7f12c27cb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12bc0ce9e0 0x7f12bc0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.240+0000 7f12c27cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.240+0000 7f12c27cb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc0cf380 con 0x7f12bc158840 2023-08-09T12:45:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12c27cb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc158c20 con 0x7f12bc0ce9e0 2023-08-09T12:45:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12c27cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0b0220 con 0x7f12bc15b160 2023-08-09T12:45:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12b3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12bc0ce9e0 0x7f12bc0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12b3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12bc0ce9e0 0x7f12bc0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51488/0 (socket says 172.21.15.17:51488) 2023-08-09T12:45:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12b3fff640 1 -- 172.21.15.17:0/559938141 learned_addr learned my addr 172.21.15.17:0/559938141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12c0d68640 1 --2- 172.21.15.17:0/559938141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12b3fff640 1 -- 172.21.15.17:0/559938141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 msgr2=0x7f12bc15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12b3fff640 1 --2- 172.21.15.17:0/559938141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc15b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12b3fff640 1 -- 172.21.15.17:0/559938141 >> v1:172.21.15.17:6789/0 conn(0x7f12bc158840 legacy=0x7f12bc0af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.241+0000 7f12b3fff640 1 -- 172.21.15.17:0/559938141 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc15e7f0 con 0x7f12bc0ce9e0 2023-08-09T12:45:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.243+0000 7f12b3fff640 1 --2- 172.21.15.17:0/559938141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc0ce9e0 0x7f12bc0cee40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009870 tx=0x7f12a402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a2a698e64624c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.243+0000 7f12bb7fe640 1 -- 172.21.15.17:0/559938141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4030840 con 0x7f12bc0ce9e0 2023-08-09T12:45:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.243+0000 7f12bb7fe640 1 -- 172.21.15.17:0/559938141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40309a0 con 0x7f12bc0ce9e0 2023-08-09T12:45:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.243+0000 7f12bb7fe640 1 -- 172.21.15.17:0/559938141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4030d30 con 0x7f12bc0ce9e0 2023-08-09T12:45:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.243+0000 7f12c27cb640 1 -- 172.21.15.17:0/559938141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc0ce9e0 msgr2=0x7f12bc0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.243+0000 7f12c27cb640 1 --2- 172.21.15.17:0/559938141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc0ce9e0 0x7f12bc0cee40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009870 tx=0x7f12a402b980 comp rx=0 tx=0).stop 2023-08-09T12:45:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.244+0000 7f12c27cb640 1 -- 172.21.15.17:0/559938141 shutdown_connections 2023-08-09T12:45:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.244+0000 7f12c27cb640 1 --2- 172.21.15.17:0/559938141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.244+0000 7f12c27cb640 1 --2- 172.21.15.17:0/559938141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc0ce9e0 0x7f12bc0cee40 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.244+0000 7f12c27cb640 1 -- 172.21.15.17:0/559938141 >> 172.21.15.17:0/559938141 conn(0x7f12bc069be0 msgr2=0x7f12bc069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.244+0000 7f12c27cb640 1 -- 172.21.15.17:0/559938141 shutdown_connections 2023-08-09T12:45:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.244+0000 7f12c27cb640 1 -- 172.21.15.17:0/559938141 wait complete. 2023-08-09T12:45:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.245+0000 7f12c27cb640 1 Processor -- start 2023-08-09T12:45:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.246+0000 7f12c27cb640 1 -- start start 2023-08-09T12:45:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.246+0000 7f12c27cb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0ce9e0 0x7f12bc151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12c27cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc158840 0x7f12bc157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12c27cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12c27cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0cccd0 con 0x7f12bc158840 2023-08-09T12:45:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12c27cb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0cc330 con 0x7f12bc0ce9e0 2023-08-09T12:45:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12c27cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0cc610 con 0x7f12bc15b160 2023-08-09T12:45:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc158840 0x7f12bc157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc158840 0x7f12bc157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51500/0 (socket says 172.21.15.17:51500) 2023-08-09T12:45:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12b3fff640 1 -- 172.21.15.17:0/1849237758 learned_addr learned my addr 172.21.15.17:0/1849237758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12c0d68640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12bbfff640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0ce9e0 0x7f12bc151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12b3fff640 1 -- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 msgr2=0x7f12bc1523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12b3fff640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc1523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12b3fff640 1 -- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0ce9e0 msgr2=0x7f12bc151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12b3fff640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0ce9e0 0x7f12bc151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12b3fff640 1 -- 172.21.15.17:0/1849237758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40094d0 con 0x7f12bc158840 2023-08-09T12:45:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12c0d68640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.247+0000 7f12bbfff640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0ce9e0 0x7f12bc151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.248+0000 7f12b3fff640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc158840 0x7f12bc157570 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000c00 tx=0x7f12a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.248+0000 7f12b97fa640 1 -- 172.21.15.17:0/1849237758 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4039c90 con 0x7f12bc158840 2023-08-09T12:45:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.248+0000 7f12b97fa640 1 -- 172.21.15.17:0/1849237758 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4039df0 con 0x7f12bc158840 2023-08-09T12:45:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.248+0000 7f12b97fa640 1 -- 172.21.15.17:0/1849237758 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4043640 con 0x7f12bc158840 2023-08-09T12:45:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.248+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc0cc8f0 con 0x7f12bc158840 2023-08-09T12:45:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.248+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc157ab0 con 0x7f12bc158840 2023-08-09T12:45:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.250+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc067a80 con 0x7f12bc158840 2023-08-09T12:45:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.251+0000 7f12b97fa640 1 -- 172.21.15.17:0/1849237758 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f12a40437a0 con 0x7f12bc158840 2023-08-09T12:45:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.251+0000 7f12b97fa640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f129c06a080 0x7f129c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.252+0000 7f12b97fa640 1 -- 172.21.15.17:0/1849237758 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12a403e070 con 0x7f12bc158840 2023-08-09T12:45:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.252+0000 7f12bbfff640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f129c06a080 0x7f129c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.253+0000 7f12bbfff640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f129c06a080 0x7f129c06c540 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f12ac000f60 tx=0x7f12ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:24.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.256+0000 7f12b97fa640 1 -- 172.21.15.17:0/1849237758 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f12a4076d10 con 0x7f12bc158840 2023-08-09T12:45:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.451+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12bc06b380 con 0x7f12bc158840 2023-08-09T12:45:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.452+0000 7f12b97fa640 1 -- 172.21.15.17:0/1849237758 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12a407a330 con 0x7f12bc158840 2023-08-09T12:45:24.456 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:45:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.456+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f129c06a080 msgr2=0x7f129c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.456+0000 7f12c27cb640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f129c06a080 0x7f129c06c540 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f12ac000f60 tx=0x7f12ac009040 comp rx=0 tx=0).stop 2023-08-09T12:45:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.456+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc158840 msgr2=0x7f12bc157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.456+0000 7f12c27cb640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc158840 0x7f12bc157570 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000c00 tx=0x7f12a4004730 comp rx=0 tx=0).stop 2023-08-09T12:45:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.457+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 shutdown_connections 2023-08-09T12:45:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.457+0000 7f12c27cb640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f129c06a080 0x7f129c06c540 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.457+0000 7f12c27cb640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc15b160 0x7f12bc1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.457+0000 7f12c27cb640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12bc158840 0x7f12bc157570 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.457+0000 7f12c27cb640 1 --2- 172.21.15.17:0/1849237758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0ce9e0 0x7f12bc151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.457+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 >> 172.21.15.17:0/1849237758 conn(0x7f12bc069be0 msgr2=0x7f12bc0c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.457+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 shutdown_connections 2023-08-09T12:45:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.457+0000 7f12c27cb640 1 -- 172.21.15.17:0/1849237758 wait complete. 2023-08-09T12:45:24.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:45:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.703+0000 7fe4c235b640 1 Processor -- start 2023-08-09T12:45:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.704+0000 7fe4c235b640 1 -- start start 2023-08-09T12:45:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.705+0000 7fe4c235b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4bc163c10 0x7fe4bc166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.705+0000 7fe4c235b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc06c990 con 0x7fe4bc0b3b40 2023-08-09T12:45:24.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.706+0000 7fe4c235b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc0b2250 con 0x7fe4bc0adc40 2023-08-09T12:45:24.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.706+0000 7fe4c235b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc0ae020 con 0x7fe4bc163c10 2023-08-09T12:45:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.706+0000 7fe4bb7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe4bc0b3b40 0x7fe4bc0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58852/0 (socket says 172.21.15.17:58852) 2023-08-09T12:45:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.706+0000 7fe4bb7fe640 1 -- 172.21.15.17:0/235256712 learned_addr learned my addr 172.21.15.17:0/235256712 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.706+0000 7fe4c08f8640 1 --2- 172.21.15.17:0/235256712 >> v2:172.21.15.142:3300/0 conn(0x7fe4bc163c10 0x7fe4bc166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.707+0000 7fe4baffd640 1 -- 172.21.15.17:0/235256712 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878924422 0 0) 0x7fe4bc06c990 con 0x7fe4bc0b3b40 2023-08-09T12:45:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.707+0000 7fe4baffd640 1 -- 172.21.15.17:0/235256712 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a4003520 con 0x7fe4bc0b3b40 2023-08-09T12:45:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.707+0000 7fe4c08f8640 1 -- 172.21.15.17:0/235256712 >> v1:172.21.15.142:6789/0 conn(0x7fe4bc0adc40 legacy=0x7fe4bc06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.707+0000 7fe4c08f8640 1 -- 172.21.15.17:0/235256712 >> v1:172.21.15.17:6789/0 conn(0x7fe4bc0b3b40 legacy=0x7fe4bc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.707+0000 7fe4c08f8640 1 -- 172.21.15.17:0/235256712 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc0b2530 con 0x7fe4bc163c10 2023-08-09T12:45:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.709+0000 7fe4c08f8640 1 --2- 172.21.15.17:0/235256712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc163c10 0x7fe4bc166000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009d90 tx=0x7fe4b402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba2e1764674dfcb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:24.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.709+0000 7fe4baffd640 1 -- 172.21.15.17:0/235256712 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b402cc60 con 0x7fe4bc163c10 2023-08-09T12:45:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.709+0000 7fe4baffd640 1 -- 172.21.15.17:0/235256712 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b402cdc0 con 0x7fe4bc163c10 2023-08-09T12:45:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.709+0000 7fe4baffd640 1 -- 172.21.15.17:0/235256712 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4034660 con 0x7fe4bc163c10 2023-08-09T12:45:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.710+0000 7fe4c235b640 1 -- 172.21.15.17:0/235256712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc163c10 msgr2=0x7fe4bc166000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.710+0000 7fe4c235b640 1 --2- 172.21.15.17:0/235256712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc163c10 0x7fe4bc166000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009d90 tx=0x7fe4b402beb0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.710+0000 7fe4c235b640 1 -- 172.21.15.17:0/235256712 shutdown_connections 2023-08-09T12:45:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.710+0000 7fe4c235b640 1 --2- 172.21.15.17:0/235256712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc163c10 0x7fe4bc166000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.710+0000 7fe4c235b640 1 -- 172.21.15.17:0/235256712 >> 172.21.15.17:0/235256712 conn(0x7fe4bc0cb1b0 msgr2=0x7fe4bc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.711+0000 7fe4c235b640 1 -- 172.21.15.17:0/235256712 shutdown_connections 2023-08-09T12:45:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.711+0000 7fe4c235b640 1 -- 172.21.15.17:0/235256712 wait complete. 2023-08-09T12:45:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.712+0000 7fe4c235b640 1 Processor -- start 2023-08-09T12:45:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.712+0000 7fe4c235b640 1 -- start start 2023-08-09T12:45:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.713+0000 7fe4c235b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4bc0adc40 0x7fe4bc156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.713+0000 7fe4c235b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc0b3b40 0x7fe4bc0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.713+0000 7fe4c235b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4bc163c10 0x7fe4bc146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.713+0000 7fe4c235b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc1552d0 con 0x7fe4bc163c10 2023-08-09T12:45:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.713+0000 7fe4c235b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc1555b0 con 0x7fe4bc0b3b40 2023-08-09T12:45:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.713+0000 7fe4c235b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc155890 con 0x7fe4bc0adc40 2023-08-09T12:45:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4c08f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4bc163c10 0x7fe4bc146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4c08f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4bc163c10 0x7fe4bc146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51506/0 (socket says 172.21.15.17:51506) 2023-08-09T12:45:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4c08f8640 1 -- 172.21.15.17:0/291353860 learned_addr learned my addr 172.21.15.17:0/291353860 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4bbfff640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4bc0adc40 0x7fe4bc156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4bb7fe640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc0b3b40 0x7fe4bc0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4c08f8640 1 -- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4bc0adc40 msgr2=0x7fe4bc156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4c08f8640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4bc0adc40 0x7fe4bc156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4c08f8640 1 -- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc0b3b40 msgr2=0x7fe4bc0c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4c08f8640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc0b3b40 0x7fe4bc0c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.714+0000 7fe4c08f8640 1 -- 172.21.15.17:0/291353860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4009a70 con 0x7fe4bc163c10 2023-08-09T12:45:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.715+0000 7fe4c08f8640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4bc163c10 0x7fe4bc146790 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009eb0 tx=0x7fe4b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.715+0000 7fe4b8ff9640 1 -- 172.21.15.17:0/291353860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4040650 con 0x7fe4bc163c10 2023-08-09T12:45:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.715+0000 7fe4b8ff9640 1 -- 172.21.15.17:0/291353860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b40407b0 con 0x7fe4bc163c10 2023-08-09T12:45:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.715+0000 7fe4b8ff9640 1 -- 172.21.15.17:0/291353860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4040b60 con 0x7fe4bc163c10 2023-08-09T12:45:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.715+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4bc155b70 con 0x7fe4bc163c10 2023-08-09T12:45:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.715+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc156a70 con 0x7fe4bc163c10 2023-08-09T12:45:24.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.716+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4bc156c00 con 0x7fe4bc163c10 2023-08-09T12:45:24.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.717+0000 7fe4b8ff9640 1 -- 172.21.15.17:0/291353860 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4b4040cc0 con 0x7fe4bc163c10 2023-08-09T12:45:24.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.718+0000 7fe4b8ff9640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe4a806a050 0x7fe4a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.718+0000 7fe4b8ff9640 1 -- 172.21.15.17:0/291353860 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4b40ab380 con 0x7fe4bc163c10 2023-08-09T12:45:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.719+0000 7fe4bbfff640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe4a806a050 0x7fe4a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:24.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.720+0000 7fe4bbfff640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe4a806a050 0x7fe4a806c510 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac000f60 tx=0x7fe4ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:24.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.723+0000 7fe4b8ff9640 1 -- 172.21.15.17:0/291353860 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe4b40769d0 con 0x7fe4bc163c10 2023-08-09T12:45:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.918+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4bc156030 con 0x7fe4bc163c10 2023-08-09T12:45:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.919+0000 7fe4b8ff9640 1 -- 172.21.15.17:0/291353860 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4b4009450 con 0x7fe4bc163c10 2023-08-09T12:45:24.922 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:45:24.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe4a806a050 msgr2=0x7fe4a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe4a806a050 0x7fe4a806c510 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac000f60 tx=0x7fe4ac009040 comp rx=0 tx=0).stop 2023-08-09T12:45:24.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4bc163c10 msgr2=0x7fe4bc146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4bc163c10 0x7fe4bc146790 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009eb0 tx=0x7fe4b4004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 shutdown_connections 2023-08-09T12:45:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe4a806a050 0x7fe4a806c510 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4bc163c10 0x7fe4bc146790 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4bc0b3b40 0x7fe4bc0c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 --2- 172.21.15.17:0/291353860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4bc0adc40 0x7fe4bc156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 >> 172.21.15.17:0/291353860 conn(0x7fe4bc0cb1b0 msgr2=0x7fe4bc15ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.921+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 shutdown_connections 2023-08-09T12:45:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:24.922+0000 7fe4c235b640 1 -- 172.21.15.17:0/291353860 wait complete. 2023-08-09T12:45:24.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:45:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.164+0000 7fcd5d437640 1 Processor -- start 2023-08-09T12:45:25.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.164+0000 7fcd5d437640 1 -- start start 2023-08-09T12:45:25.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.166+0000 7fcd5d437640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd58070f00 0x7fcd5815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.166+0000 7fcd5d437640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd5815bce0 0x7fcd580cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.166+0000 7fcd5d437640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd58071340 con 0x7fcd581587e0 2023-08-09T12:45:25.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.166+0000 7fcd5d437640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd580715c0 con 0x7fcd5815bce0 2023-08-09T12:45:25.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.166+0000 7fcd5d437640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd580718a0 con 0x7fcd58070f00 2023-08-09T12:45:25.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd57fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcd581587e0 0x7fcd580b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58868/0 (socket says 172.21.15.17:58868) 2023-08-09T12:45:25.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd5cc36640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd5815bce0 0x7fcd580cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd57fff640 1 -- 172.21.15.17:0/1084854263 learned_addr learned my addr 172.21.15.17:0/1084854263 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:25.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd577fe640 1 --2- 172.21.15.17:0/1084854263 >> v2:172.21.15.142:3300/0 conn(0x7fcd58070f00 0x7fcd5815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd5cc36640 1 -- 172.21.15.17:0/1084854263 >> v2:172.21.15.142:3300/0 conn(0x7fcd58070f00 msgr2=0x7fcd5815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:25.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd5cc36640 1 --2- 172.21.15.17:0/1084854263 >> v2:172.21.15.142:3300/0 conn(0x7fcd58070f00 0x7fcd5815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd5cc36640 1 -- 172.21.15.17:0/1084854263 >> v1:172.21.15.17:6789/0 conn(0x7fcd581587e0 legacy=0x7fcd580b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd5cc36640 1 -- 172.21.15.17:0/1084854263 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58071b80 con 0x7fcd5815bce0 2023-08-09T12:45:25.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.167+0000 7fcd56ffd640 1 -- 172.21.15.17:0/1084854263 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776154412 0 0) 0x7fcd58071340 con 0x7fcd581587e0 2023-08-09T12:45:25.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.168+0000 7fcd5cc36640 1 --2- 172.21.15.17:0/1084854263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd5815bce0 0x7fcd580cb070 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fcd5806b8a0 tx=0x7fcd5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73ecf417c3a2cc5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:25.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd56ffd640 1 -- 172.21.15.17:0/1084854263 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50031830 con 0x7fcd5815bce0 2023-08-09T12:45:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd56ffd640 1 -- 172.21.15.17:0/1084854263 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50031990 con 0x7fcd5815bce0 2023-08-09T12:45:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd56ffd640 1 -- 172.21.15.17:0/1084854263 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50031d20 con 0x7fcd5815bce0 2023-08-09T12:45:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd5d437640 1 -- 172.21.15.17:0/1084854263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd5815bce0 msgr2=0x7fcd580cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd5d437640 1 --2- 172.21.15.17:0/1084854263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd5815bce0 0x7fcd580cb070 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fcd5806b8a0 tx=0x7fcd5002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd5d437640 1 -- 172.21.15.17:0/1084854263 shutdown_connections 2023-08-09T12:45:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd5d437640 1 --2- 172.21.15.17:0/1084854263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd5815bce0 0x7fcd580cb070 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd5d437640 1 --2- 172.21.15.17:0/1084854263 >> v2:172.21.15.142:3300/0 conn(0x7fcd58070f00 0x7fcd5815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd5d437640 1 -- 172.21.15.17:0/1084854263 >> 172.21.15.17:0/1084854263 conn(0x7fcd580b1d50 msgr2=0x7fcd5806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:25.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd5d437640 1 -- 172.21.15.17:0/1084854263 shutdown_connections 2023-08-09T12:45:25.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.169+0000 7fcd5d437640 1 -- 172.21.15.17:0/1084854263 wait complete. 2023-08-09T12:45:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.171+0000 7fcd5d437640 1 Processor -- start 2023-08-09T12:45:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.171+0000 7fcd5d437640 1 -- start start 2023-08-09T12:45:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.172+0000 7fcd5d437640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd58070f00 0x7fcd58155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.172+0000 7fcd5d437640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd581587e0 0x7fcd580ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.172+0000 7fcd5d437640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd580ac920 0x7fcd580ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.172+0000 7fcd5d437640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd581561d0 con 0x7fcd581587e0 2023-08-09T12:45:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.172+0000 7fcd5d437640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580c9df0 con 0x7fcd580ac920 2023-08-09T12:45:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.172+0000 7fcd5d437640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5815c0d0 con 0x7fcd58070f00 2023-08-09T12:45:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd581587e0 0x7fcd580ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd581587e0 0x7fcd580ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51514/0 (socket says 172.21.15.17:51514) 2023-08-09T12:45:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd577fe640 1 -- 172.21.15.17:0/3569019798 learned_addr learned my addr 172.21.15.17:0/3569019798 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd57fff640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd58070f00 0x7fcd58155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd577fe640 1 -- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd58070f00 msgr2=0x7fcd58155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd577fe640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd58070f00 0x7fcd58155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd577fe640 1 -- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd580ac920 msgr2=0x7fcd580ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd577fe640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd580ac920 0x7fcd580ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd577fe640 1 -- 172.21.15.17:0/3569019798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009400 con 0x7fcd581587e0 2023-08-09T12:45:25.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.173+0000 7fcd57fff640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd58070f00 0x7fcd58155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:25.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.174+0000 7fcd577fe640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd581587e0 0x7fcd580ca6b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007e40 tx=0x7fcd4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:25.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.174+0000 7fcd54ff9640 1 -- 172.21.15.17:0/3569019798 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c014620 con 0x7fcd581587e0 2023-08-09T12:45:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.174+0000 7fcd54ff9640 1 -- 172.21.15.17:0/3569019798 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00ee90 con 0x7fcd581587e0 2023-08-09T12:45:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.174+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd580ca090 con 0x7fcd581587e0 2023-08-09T12:45:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.174+0000 7fcd54ff9640 1 -- 172.21.15.17:0/3569019798 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0149c0 con 0x7fcd581587e0 2023-08-09T12:45:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.174+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5815c370 con 0x7fcd581587e0 2023-08-09T12:45:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.175+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5815c500 con 0x7fcd581587e0 2023-08-09T12:45:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.176+0000 7fcd54ff9640 1 -- 172.21.15.17:0/3569019798 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd4c014b20 con 0x7fcd581587e0 2023-08-09T12:45:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.177+0000 7fcd54ff9640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4406a080 0x7fcd4406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.177+0000 7fcd54ff9640 1 -- 172.21.15.17:0/3569019798 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd4c088fe0 con 0x7fcd581587e0 2023-08-09T12:45:25.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.178+0000 7fcd57fff640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4406a080 0x7fcd4406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.179+0000 7fcd57fff640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4406a080 0x7fcd4406c540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000f60 tx=0x7fcd48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:25.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.181+0000 7fcd54ff9640 1 -- 172.21.15.17:0/3569019798 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcd4c0545c0 con 0x7fcd581587e0 2023-08-09T12:45:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.408+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd5806fa10 con 0x7fcd581587e0 2023-08-09T12:45:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.409+0000 7fcd54ff9640 1 -- 172.21.15.17:0/3569019798 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4883 (secure 0 0 0) 0x7fcd5806fa10 con 0x7fcd581587e0 2023-08-09T12:45:25.413 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:25.413 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2093028023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2093028023},{"type":"v1","addr":"172.21.15.142:6835","nonce":2093028023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2762526663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2762526663},{"type":"v1","addr":"172.21.15.142:6837","nonce":2762526663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2544978987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2544978987},{"type":"v1","addr":"172.21.15.17:6834","nonce":2544978987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:44:25.543433+0000","modified":"2023-08-09T12:44:29.110856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4077789912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4077789912},{"type":"v1","addr":"172.21.15.17:6835","nonce":4077789912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-09T12:45:25.413 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 43 2023-08-09T12:45:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.411+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4406a080 msgr2=0x7fcd4406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.411+0000 7fcd5d437640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4406a080 0x7fcd4406c540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000f60 tx=0x7fcd48009040 comp rx=0 tx=0).stop 2023-08-09T12:45:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd581587e0 msgr2=0x7fcd580ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd581587e0 0x7fcd580ca6b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007e40 tx=0x7fcd4c00e4b0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 shutdown_connections 2023-08-09T12:45:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4406a080 0x7fcd4406c540 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd580ac920 0x7fcd580ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd581587e0 0x7fcd580ca6b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 --2- 172.21.15.17:0/3569019798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd58070f00 0x7fcd58155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 >> 172.21.15.17:0/3569019798 conn(0x7fcd580b1d50 msgr2=0x7fcd580b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 shutdown_connections 2023-08-09T12:45:25.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.412+0000 7fcd5d437640 1 -- 172.21.15.17:0/3569019798 wait complete. 2023-08-09T12:45:25.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.658+0000 7f5c6fd99640 1 Processor -- start 2023-08-09T12:45:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.658+0000 7f5c6fd99640 1 -- start start 2023-08-09T12:45:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.659+0000 7f5c6fd99640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5c68164f50 0x7f5c680cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6fd99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c68165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6fd99640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c680cd520 con 0x7f5c680c1980 2023-08-09T12:45:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6fd99640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c680cc630 con 0x7f5c68164f50 2023-08-09T12:45:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6fd99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680cc910 con 0x7f5c68162650 2023-08-09T12:45:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6e336640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c68165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6db35640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5c68164f50 0x7f5c680cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6e336640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c68165a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:60780/0 (socket says 172.21.15.17:60780) 2023-08-09T12:45:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6d334640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5c680c1980 0x7f5c68165330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:59698/0 (socket says 172.21.15.17:59698) 2023-08-09T12:45:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.660+0000 7f5c6e336640 1 -- 172.21.15.17:0/3893239734 learned_addr learned my addr 172.21.15.17:0/3893239734 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.661+0000 7f5c6e336640 1 -- 172.21.15.17:0/3893239734 >> v2:172.21.15.142:3300/0 conn(0x7f5c68164f50 msgr2=0x7f5c680cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.661+0000 7f5c6e336640 1 --2- 172.21.15.17:0/3893239734 >> v2:172.21.15.142:3300/0 conn(0x7f5c68164f50 0x7f5c680cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.661+0000 7f5c6e336640 1 -- 172.21.15.17:0/3893239734 >> v1:172.21.15.142:6789/0 conn(0x7f5c680c1980 legacy=0x7f5c68165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.661+0000 7f5c6e336640 1 -- 172.21.15.17:0/3893239734 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c680ccbf0 con 0x7f5c68162650 2023-08-09T12:45:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.663+0000 7f5c6e336640 1 --2- 172.21.15.17:0/3893239734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c68165a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009e50 tx=0x7f5c6002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8170ba281a15516 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.664+0000 7f5c6cb33640 1 -- 172.21.15.17:0/3893239734 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6002cb00 con 0x7f5c68162650 2023-08-09T12:45:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.664+0000 7f5c6cb33640 1 -- 172.21.15.17:0/3893239734 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6002cc60 con 0x7f5c68162650 2023-08-09T12:45:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.664+0000 7f5c6cb33640 1 -- 172.21.15.17:0/3893239734 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c600343f0 con 0x7f5c68162650 2023-08-09T12:45:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.664+0000 7f5c6fd99640 1 -- 172.21.15.17:0/3893239734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 msgr2=0x7f5c68165a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.664+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/3893239734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c68165a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009e50 tx=0x7f5c6002bf60 comp rx=0 tx=0).stop 2023-08-09T12:45:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.665+0000 7f5c6fd99640 1 -- 172.21.15.17:0/3893239734 shutdown_connections 2023-08-09T12:45:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.665+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/3893239734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c68165a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.665+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/3893239734 >> v2:172.21.15.142:3300/0 conn(0x7f5c68164f50 0x7f5c680cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.665+0000 7f5c6fd99640 1 -- 172.21.15.17:0/3893239734 >> 172.21.15.17:0/3893239734 conn(0x7f5c680cb1b0 msgr2=0x7f5c680cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.665+0000 7f5c6fd99640 1 -- 172.21.15.17:0/3893239734 shutdown_connections 2023-08-09T12:45:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.665+0000 7f5c6fd99640 1 -- 172.21.15.17:0/3893239734 wait complete. 2023-08-09T12:45:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.666+0000 7f5c6fd99640 1 Processor -- start 2023-08-09T12:45:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.667+0000 7f5c6fd99640 1 -- start start 2023-08-09T12:45:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.667+0000 7f5c6fd99640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c680c1980 0x7f5c68150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.667+0000 7f5c6fd99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c680c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.667+0000 7f5c6fd99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68164f50 0x7f5c680ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6fd99640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6806a860 con 0x7f5c68164f50 2023-08-09T12:45:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6fd99640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680c4c30 con 0x7f5c680c1980 2023-08-09T12:45:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6fd99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680c4f10 con 0x7f5c68162650 2023-08-09T12:45:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6e336640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68164f50 0x7f5c680ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6e336640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68164f50 0x7f5c680ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51516/0 (socket says 172.21.15.17:51516) 2023-08-09T12:45:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6e336640 1 -- 172.21.15.17:0/1125950581 learned_addr learned my addr 172.21.15.17:0/1125950581 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6d334640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c680c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6db35640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c680c1980 0x7f5c68150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6e336640 1 -- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 msgr2=0x7f5c680c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6e336640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c680c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6e336640 1 -- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c680c1980 msgr2=0x7f5c68150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6e336640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c680c1980 0x7f5c68150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6e336640 1 -- 172.21.15.17:0/1125950581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c60009b30 con 0x7f5c68164f50 2023-08-09T12:45:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.668+0000 7f5c6db35640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c680c1980 0x7f5c68150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.669+0000 7f5c6e336640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68164f50 0x7f5c680ae190 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009e50 tx=0x7f5c60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.669+0000 7f5c5e7fc640 1 -- 172.21.15.17:0/1125950581 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60009510 con 0x7f5c68164f50 2023-08-09T12:45:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.669+0000 7f5c5e7fc640 1 -- 172.21.15.17:0/1125950581 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6003e450 con 0x7f5c68164f50 2023-08-09T12:45:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.669+0000 7f5c5e7fc640 1 -- 172.21.15.17:0/1125950581 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6003e800 con 0x7f5c68164f50 2023-08-09T12:45:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.669+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c680c51f0 con 0x7f5c68164f50 2023-08-09T12:45:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.669+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c680c4890 con 0x7f5c68164f50 2023-08-09T12:45:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.670+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6806aa10 con 0x7f5c68164f50 2023-08-09T12:45:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.671+0000 7f5c5e7fc640 1 -- 172.21.15.17:0/1125950581 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c6003e960 con 0x7f5c68164f50 2023-08-09T12:45:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.672+0000 7f5c5e7fc640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c4c06a050 0x7f5c4c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.672+0000 7f5c5e7fc640 1 -- 172.21.15.17:0/1125950581 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c600ab300 con 0x7f5c68164f50 2023-08-09T12:45:25.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.673+0000 7f5c6db35640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c4c06a050 0x7f5c4c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:25.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.674+0000 7f5c6db35640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c4c06a050 0x7f5c4c06c510 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009ac0 tx=0x7f5c64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:25.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.677+0000 7f5c5e7fc640 1 -- 172.21.15.17:0/1125950581 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5c6806aa10 con 0x7f5c68164f50 2023-08-09T12:45:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.862+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c680ccea0 con 0x7f5c68164f50 2023-08-09T12:45:25.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.865+0000 7f5c5e7fc640 1 -- 172.21.15.17:0/1125950581 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+18330 (secure 0 0 0) 0x7f5c60076950 con 0x7f5c68164f50 2023-08-09T12:45:25.869 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:25.869 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":99,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:45:22.838658+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:44:23.740360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-09T12:44:24.571392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:25.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c4c06a050 msgr2=0x7f5c4c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c4c06a050 0x7f5c4c06c510 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009ac0 tx=0x7f5c64008040 comp rx=0 tx=0).stop 2023-08-09T12:45:25.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68164f50 msgr2=0x7f5c680ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:25.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68164f50 0x7f5c680ae190 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009e50 tx=0x7f5c60004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:25.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 shutdown_connections 2023-08-09T12:45:25.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5c4c06a050 0x7f5c4c06c510 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68164f50 0x7f5c680ae190 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c68162650 0x7f5c680c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 --2- 172.21.15.17:0/1125950581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c680c1980 0x7f5c68150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:25.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 >> 172.21.15.17:0/1125950581 conn(0x7f5c680cb1b0 msgr2=0x7f5c680cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:25.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 shutdown_connections 2023-08-09T12:45:25.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:25.868+0000 7f5c6fd99640 1 -- 172.21.15.17:0/1125950581 wait complete. 2023-08-09T12:45:25.889 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:45:25.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:45:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.098+0000 7f7f60a87640 1 Processor -- start 2023-08-09T12:45:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.098+0000 7f7f60a87640 1 -- start start 2023-08-09T12:45:26.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.099+0000 7f7f60a87640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f5c0adc40 0x7f7f5c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.099+0000 7f7f60a87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.099+0000 7f7f60a87640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c0b2250 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.099+0000 7f7f60a87640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0ae020 con 0x7f7f5c0adc40 2023-08-09T12:45:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.099+0000 7f7f60a87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b2530 con 0x7f7f5c0b3b40 2023-08-09T12:45:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.100+0000 7f7f59d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.100+0000 7f7f59d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c0b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:60796/0 (socket says 172.21.15.17:60796) 2023-08-09T12:45:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.100+0000 7f7f59d9b640 1 -- 172.21.15.17:0/83366239 learned_addr learned my addr 172.21.15.17:0/83366239 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.100+0000 7f7f5a59c640 1 --2- 172.21.15.17:0/83366239 >> v2:172.21.15.142:3300/0 conn(0x7f7f5c0adc40 0x7f7f5c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.101+0000 7f7f59d9b640 1 -- 172.21.15.17:0/83366239 >> v2:172.21.15.142:3300/0 conn(0x7f7f5c0adc40 msgr2=0x7f7f5c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.101+0000 7f7f59d9b640 1 --2- 172.21.15.17:0/83366239 >> v2:172.21.15.142:3300/0 conn(0x7f7f5c0adc40 0x7f7f5c06c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.101+0000 7f7f59d9b640 1 -- 172.21.15.17:0/83366239 >> v1:172.21.15.142:6789/0 conn(0x7f7f5c15e8f0 legacy=0x7f7f5c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.101+0000 7f7f59d9b640 1 -- 172.21.15.17:0/83366239 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c06fe80 con 0x7f7f5c0b3b40 2023-08-09T12:45:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.102+0000 7f7f59d9b640 1 --2- 172.21.15.17:0/83366239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c0b3fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009850 tx=0x7f7f5002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd7c9ce02a78e71 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:26.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.103+0000 7f7f5959a640 1 -- 172.21.15.17:0/83366239 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50004230 con 0x7f7f5c0b3b40 2023-08-09T12:45:26.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.103+0000 7f7f5959a640 1 -- 172.21.15.17:0/83366239 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f50004390 con 0x7f7f5c0b3b40 2023-08-09T12:45:26.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.103+0000 7f7f5959a640 1 -- 172.21.15.17:0/83366239 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50003810 con 0x7f7f5c0b3b40 2023-08-09T12:45:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.104+0000 7f7f60a87640 1 -- 172.21.15.17:0/83366239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 msgr2=0x7f7f5c0b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.104+0000 7f7f60a87640 1 --2- 172.21.15.17:0/83366239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c0b3fa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009850 tx=0x7f7f5002b960 comp rx=0 tx=0).stop 2023-08-09T12:45:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.104+0000 7f7f60a87640 1 -- 172.21.15.17:0/83366239 shutdown_connections 2023-08-09T12:45:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.104+0000 7f7f60a87640 1 --2- 172.21.15.17:0/83366239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c0b3fa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.104+0000 7f7f60a87640 1 --2- 172.21.15.17:0/83366239 >> v2:172.21.15.142:3300/0 conn(0x7f7f5c0adc40 0x7f7f5c06c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.104+0000 7f7f60a87640 1 -- 172.21.15.17:0/83366239 >> 172.21.15.17:0/83366239 conn(0x7f7f5c0cb1b0 msgr2=0x7f7f5c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.104+0000 7f7f60a87640 1 -- 172.21.15.17:0/83366239 shutdown_connections 2023-08-09T12:45:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.104+0000 7f7f60a87640 1 -- 172.21.15.17:0/83366239 wait complete. 2023-08-09T12:45:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.106+0000 7f7f60a87640 1 Processor -- start 2023-08-09T12:45:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.106+0000 7f7f60a87640 1 -- start start 2023-08-09T12:45:26.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f60a87640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f5c0adc40 0x7f7f5c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f60a87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f60a87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5c15e8f0 0x7f7f5c0c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f60a87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c8440 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f60a87640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c8720 con 0x7f7f5c0adc40 2023-08-09T12:45:26.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f60a87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c8a00 con 0x7f7f5c0b3b40 2023-08-09T12:45:26.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f5ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5c15e8f0 0x7f7f5c0c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f5ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5c15e8f0 0x7f7f5c0c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51532/0 (socket says 172.21.15.17:51532) 2023-08-09T12:45:26.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f5ad9d640 1 -- 172.21.15.17:0/647055370 learned_addr learned my addr 172.21.15.17:0/647055370 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:26.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f5a59c640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f5c0adc40 0x7f7f5c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.108+0000 7f7f59d9b640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f5ad9d640 1 -- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 msgr2=0x7f7f5c069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f5ad9d640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f5ad9d640 1 -- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f5c0adc40 msgr2=0x7f7f5c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f5ad9d640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f5c0adc40 0x7f7f5c150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f5ad9d640 1 -- 172.21.15.17:0/647055370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50009460 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f5a59c640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f5c0adc40 0x7f7f5c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f5ad9d640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5c15e8f0 0x7f7f5c0c58c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c6b0 tx=0x7f7f5400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f4affd640 1 -- 172.21.15.17:0/647055370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54003b70 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f4affd640 1 -- 172.21.15.17:0/647055370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54003cf0 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c0c8ce0 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.109+0000 7f7f4affd640 1 -- 172.21.15.17:0/647055370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54003ea0 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.110+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c151130 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.111+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c0c9200 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.112+0000 7f7f4affd640 1 -- 172.21.15.17:0/647055370 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f54005310 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.113+0000 7f7f4affd640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f3c06a050 0x7f7f3c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.113+0000 7f7f4affd640 1 -- 172.21.15.17:0/647055370 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f54088340 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.114+0000 7f7f5a59c640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f3c06a050 0x7f7f3c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.115+0000 7f7f5a59c640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f3c06a050 0x7f7f3c06c510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009b90 tx=0x7f7f4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:26.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.118+0000 7f7f4affd640 1 -- 172.21.15.17:0/647055370 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7f5c0c9200 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.345+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f5c0c9200 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.346+0000 7f7f4affd640 1 -- 172.21.15.17:0/647055370 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f7f5c0c9200 con 0x7f7f5c15e8f0 2023-08-09T12:45:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:26.350 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2093028023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2093028023},{"type":"v1","addr":"172.21.15.142:6835","nonce":2093028023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2762526663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2762526663},{"type":"v1","addr":"172.21.15.142:6837","nonce":2762526663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2544978987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2544978987},{"type":"v1","addr":"172.21.15.17:6834","nonce":2544978987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:44:25.543433+0000","modified":"2023-08-09T12:44:29.110856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4077789912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4077789912},{"type":"v1","addr":"172.21.15.17:6835","nonce":4077789912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-09T12:45:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 43 2023-08-09T12:45:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f3c06a050 msgr2=0x7f7f3c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f3c06a050 0x7f7f3c06c510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009b90 tx=0x7f7f4c008040 comp rx=0 tx=0).stop 2023-08-09T12:45:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5c15e8f0 msgr2=0x7f7f5c0c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5c15e8f0 0x7f7f5c0c58c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c6b0 tx=0x7f7f5400cb70 comp rx=0 tx=0).stop 2023-08-09T12:45:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 shutdown_connections 2023-08-09T12:45:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f3c06a050 0x7f7f3c06c510 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5c15e8f0 0x7f7f5c0c58c0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f5c0b3b40 0x7f7f5c069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.348+0000 7f7f60a87640 1 --2- 172.21.15.17:0/647055370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f5c0adc40 0x7f7f5c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.349+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 >> 172.21.15.17:0/647055370 conn(0x7f7f5c0cb1b0 msgr2=0x7f7f5c06f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.349+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 shutdown_connections 2023-08-09T12:45:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.349+0000 7f7f60a87640 1 -- 172.21.15.17:0/647055370 wait complete. 2023-08-09T12:45:26.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:45:26.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.580+0000 7fea6759e640 1 Processor -- start 2023-08-09T12:45:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.580+0000 7fea6759e640 1 -- start start 2023-08-09T12:45:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.582+0000 7fea6759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea681587e0 0x7fea68070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.582+0000 7fea6759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fea680cb070 0x7fea680cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.582+0000 7fea6759e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea680cb9e0 con 0x7fea680b0b10 2023-08-09T12:45:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.582+0000 7fea6759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6815beb0 con 0x7fea680cb070 2023-08-09T12:45:26.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.582+0000 7fea6759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea680715c0 con 0x7fea681587e0 2023-08-09T12:45:26.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.582+0000 7fea66d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fea680cb070 0x7fea680cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.582+0000 7fea66d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fea680cb070 0x7fea680cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51536/0 (socket says 172.21.15.17:51536) 2023-08-09T12:45:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.582+0000 7fea66d9d640 1 -- 172.21.15.17:0/891034436 learned_addr learned my addr 172.21.15.17:0/891034436 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.583+0000 7fea66d9d640 1 -- 172.21.15.17:0/891034436 >> v2:172.21.15.142:3300/0 conn(0x7fea681587e0 msgr2=0x7fea68070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.583+0000 7fea66d9d640 1 --2- 172.21.15.17:0/891034436 >> v2:172.21.15.142:3300/0 conn(0x7fea681587e0 0x7fea68070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.583+0000 7fea66d9d640 1 -- 172.21.15.17:0/891034436 >> v1:172.21.15.142:6789/0 conn(0x7fea680b0b10 legacy=0x7fea6815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.583+0000 7fea66d9d640 1 -- 172.21.15.17:0/891034436 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680718a0 con 0x7fea680cb070 2023-08-09T12:45:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.584+0000 7fea66d9d640 1 --2- 172.21.15.17:0/891034436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea680cb070 0x7fea680cb4a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fea6806cc50 tx=0x7fea6002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5239d5ea5d30303a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.584+0000 7fea65d9b640 1 -- 172.21.15.17:0/891034436 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6002ca80 con 0x7fea680cb070 2023-08-09T12:45:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.584+0000 7fea65d9b640 1 -- 172.21.15.17:0/891034436 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6002cbe0 con 0x7fea680cb070 2023-08-09T12:45:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea65d9b640 1 -- 172.21.15.17:0/891034436 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600343f0 con 0x7fea680cb070 2023-08-09T12:45:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea6759e640 1 -- 172.21.15.17:0/891034436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea680cb070 msgr2=0x7fea680cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea6759e640 1 --2- 172.21.15.17:0/891034436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea680cb070 0x7fea680cb4a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fea6806cc50 tx=0x7fea6002bee0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea6759e640 1 -- 172.21.15.17:0/891034436 shutdown_connections 2023-08-09T12:45:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea6759e640 1 --2- 172.21.15.17:0/891034436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea680cb070 0x7fea680cb4a0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea6759e640 1 --2- 172.21.15.17:0/891034436 >> v2:172.21.15.142:3300/0 conn(0x7fea681587e0 0x7fea68070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea6759e640 1 -- 172.21.15.17:0/891034436 >> 172.21.15.17:0/891034436 conn(0x7fea680b1d50 msgr2=0x7fea6806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea6759e640 1 -- 172.21.15.17:0/891034436 shutdown_connections 2023-08-09T12:45:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.585+0000 7fea6759e640 1 -- 172.21.15.17:0/891034436 wait complete. 2023-08-09T12:45:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.587+0000 7fea6759e640 1 Processor -- start 2023-08-09T12:45:26.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.587+0000 7fea6759e640 1 -- start start 2023-08-09T12:45:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.588+0000 7fea6759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea680b0b10 0x7fea681f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.588+0000 7fea6759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680cb070 0x7fea681f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.588+0000 7fea6759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea681587e0 0x7fea681f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.588+0000 7fea6759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea680c7f60 con 0x7fea681587e0 2023-08-09T12:45:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.588+0000 7fea6759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6814c410 con 0x7fea680cb070 2023-08-09T12:45:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.588+0000 7fea6759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea680c7350 con 0x7fea680b0b10 2023-08-09T12:45:26.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea681587e0 0x7fea681f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea681587e0 0x7fea681f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51544/0 (socket says 172.21.15.17:51544) 2023-08-09T12:45:26.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 -- 172.21.15.17:0/4113122122 learned_addr learned my addr 172.21.15.17:0/4113122122 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:26.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea5ffff640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680cb070 0x7fea681f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 -- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea680b0b10 msgr2=0x7fea681f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea680b0b10 0x7fea681f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 -- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680cb070 msgr2=0x7fea681f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680cb070 0x7fea681f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 -- 172.21.15.17:0/4113122122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60009b30 con 0x7fea681587e0 2023-08-09T12:45:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea5ffff640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680cb070 0x7fea681f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.589+0000 7fea66d9d640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea681587e0 0x7fea681f5d70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fea60036040 tx=0x7fea60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.590+0000 7fea5effd640 1 -- 172.21.15.17:0/4113122122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6003e450 con 0x7fea681587e0 2023-08-09T12:45:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.590+0000 7fea5effd640 1 -- 172.21.15.17:0/4113122122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6003e5d0 con 0x7fea681587e0 2023-08-09T12:45:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.590+0000 7fea5effd640 1 -- 172.21.15.17:0/4113122122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6003e980 con 0x7fea681587e0 2023-08-09T12:45:26.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.590+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea680c7630 con 0x7fea681587e0 2023-08-09T12:45:26.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.590+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea680c7bf0 con 0x7fea681587e0 2023-08-09T12:45:26.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.591+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea680c7d80 con 0x7fea681587e0 2023-08-09T12:45:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.592+0000 7fea5effd640 1 -- 172.21.15.17:0/4113122122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea6002cd50 con 0x7fea681587e0 2023-08-09T12:45:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.593+0000 7fea5effd640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fea4806a050 0x7fea4806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.593+0000 7fea5effd640 1 -- 172.21.15.17:0/4113122122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea600ab1b0 con 0x7fea681587e0 2023-08-09T12:45:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.594+0000 7fea6659c640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fea4806a050 0x7fea4806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.595+0000 7fea6659c640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fea4806a050 0x7fea4806c510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fea58009670 tx=0x7fea58006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:26.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.597+0000 7fea5effd640 1 -- 172.21.15.17:0/4113122122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fea60076a60 con 0x7fea681587e0 2023-08-09T12:45:26.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.829+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea6806fa10 con 0x7fea681587e0 2023-08-09T12:45:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.830+0000 7fea5effd640 1 -- 172.21.15.17:0/4113122122 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4883 (secure 0 0 0) 0x7fea6806fa10 con 0x7fea681587e0 2023-08-09T12:45:26.833 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:26.833 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2093028023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2093028023},{"type":"v1","addr":"172.21.15.142:6835","nonce":2093028023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2762526663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2762526663},{"type":"v1","addr":"172.21.15.142:6837","nonce":2762526663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2544978987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2544978987},{"type":"v1","addr":"172.21.15.17:6834","nonce":2544978987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:44:25.543433+0000","modified":"2023-08-09T12:44:29.110856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4077789912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4077789912},{"type":"v1","addr":"172.21.15.17:6835","nonce":4077789912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-09T12:45:26.834 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 43 2023-08-09T12:45:26.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.832+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fea4806a050 msgr2=0x7fea4806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.832+0000 7fea6759e640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fea4806a050 0x7fea4806c510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fea58009670 tx=0x7fea58006bf0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.832+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea681587e0 msgr2=0x7fea681f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:26.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.832+0000 7fea6759e640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea681587e0 0x7fea681f5d70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fea60036040 tx=0x7fea60004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:26.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.832+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 shutdown_connections 2023-08-09T12:45:26.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.832+0000 7fea6759e640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fea4806a050 0x7fea4806c510 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.832+0000 7fea6759e640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea681587e0 0x7fea681f5d70 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.833+0000 7fea6759e640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680cb070 0x7fea681f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.833+0000 7fea6759e640 1 --2- 172.21.15.17:0/4113122122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea680b0b10 0x7fea681f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:26.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.833+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 >> 172.21.15.17:0/4113122122 conn(0x7fea680b1d50 msgr2=0x7fea680b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:26.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.833+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 shutdown_connections 2023-08-09T12:45:26.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:26.833+0000 7fea6759e640 1 -- 172.21.15.17:0/4113122122 wait complete. 2023-08-09T12:45:26.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:27.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.082+0000 7f87d2cf9640 1 Processor -- start 2023-08-09T12:45:27.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.083+0000 7f87d2cf9640 1 -- start start 2023-08-09T12:45:27.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.084+0000 7f87d2cf9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f87cc1587e0 0x7f87cc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.084+0000 7f87d2cf9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 0x7f87cc15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.084+0000 7f87d2cf9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87cc0715c0 con 0x7f87cc15bce0 2023-08-09T12:45:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.084+0000 7f87d2cf9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0718a0 con 0x7f87cc1587e0 2023-08-09T12:45:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.084+0000 7f87d2cf9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc071b80 con 0x7f87cc0b0b10 2023-08-09T12:45:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.085+0000 7f87d14f6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 0x7f87cc15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.085+0000 7f87d1cf7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f87cc1587e0 0x7f87cc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.085+0000 7f87d24f8640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f87cc15bce0 0x7f87cc0cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:59722/0 (socket says 172.21.15.17:59722) 2023-08-09T12:45:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.085+0000 7f87d24f8640 1 -- 172.21.15.17:0/2349508332 learned_addr learned my addr 172.21.15.17:0/2349508332 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.086+0000 7f87d1cf7640 1 -- 172.21.15.17:0/2349508332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 msgr2=0x7f87cc15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.086+0000 7f87d1cf7640 1 --2- 172.21.15.17:0/2349508332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 0x7f87cc15b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.086+0000 7f87d1cf7640 1 -- 172.21.15.17:0/2349508332 >> v1:172.21.15.142:6789/0 conn(0x7f87cc15bce0 legacy=0x7f87cc0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.086+0000 7f87d1cf7640 1 -- 172.21.15.17:0/2349508332 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc15b280 con 0x7f87cc1587e0 2023-08-09T12:45:27.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.087+0000 7f87d1cf7640 1 --2- 172.21.15.17:0/2349508332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc1587e0 0x7f87cc070f00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f87c80097a0 tx=0x7f87c802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fbe3f6c07754a44 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:27.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.088+0000 7f87d0cf5640 1 -- 172.21.15.17:0/2349508332 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c802d040 con 0x7f87cc1587e0 2023-08-09T12:45:27.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.088+0000 7f87d0cf5640 1 -- 172.21.15.17:0/2349508332 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8031810 con 0x7f87cc1587e0 2023-08-09T12:45:27.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.088+0000 7f87d0cf5640 1 -- 172.21.15.17:0/2349508332 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8031ba0 con 0x7f87cc1587e0 2023-08-09T12:45:27.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.088+0000 7f87d2cf9640 1 -- 172.21.15.17:0/2349508332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc1587e0 msgr2=0x7f87cc070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.088+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/2349508332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc1587e0 0x7f87cc070f00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f87c80097a0 tx=0x7f87c802b8b0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.089+0000 7f87d2cf9640 1 -- 172.21.15.17:0/2349508332 shutdown_connections 2023-08-09T12:45:27.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.089+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/2349508332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 0x7f87cc15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.089+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/2349508332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc1587e0 0x7f87cc070f00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.089+0000 7f87d2cf9640 1 -- 172.21.15.17:0/2349508332 >> 172.21.15.17:0/2349508332 conn(0x7f87cc0b1d50 msgr2=0x7f87cc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.089+0000 7f87d2cf9640 1 -- 172.21.15.17:0/2349508332 shutdown_connections 2023-08-09T12:45:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.089+0000 7f87d2cf9640 1 -- 172.21.15.17:0/2349508332 wait complete. 2023-08-09T12:45:27.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.091+0000 7f87d2cf9640 1 Processor -- start 2023-08-09T12:45:27.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.091+0000 7f87d2cf9640 1 -- start start 2023-08-09T12:45:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d2cf9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 0x7f87cc0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d2cf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1587e0 0x7f87cc0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d2cf9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc0aff10 0x7f87cc1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d2cf9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0c9280 con 0x7f87cc1587e0 2023-08-09T12:45:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d2cf9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0c9470 con 0x7f87cc0aff10 2023-08-09T12:45:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d2cf9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0c9750 con 0x7f87cc0b0b10 2023-08-09T12:45:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d14f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1587e0 0x7f87cc0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d14f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1587e0 0x7f87cc0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51554/0 (socket says 172.21.15.17:51554) 2023-08-09T12:45:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d14f6640 1 -- 172.21.15.17:0/1480828395 learned_addr learned my addr 172.21.15.17:0/1480828395 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d24f8640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc0aff10 0x7f87cc1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.093+0000 7f87d1cf7640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 0x7f87cc0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d14f6640 1 -- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 msgr2=0x7f87cc0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d14f6640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 0x7f87cc0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d14f6640 1 -- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc0aff10 msgr2=0x7f87cc1f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d14f6640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc0aff10 0x7f87cc1f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d14f6640 1 -- 172.21.15.17:0/1480828395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8009400 con 0x7f87cc1587e0 2023-08-09T12:45:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d24f8640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc0aff10 0x7f87cc1f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d14f6640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1587e0 0x7f87cc0c8d40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00e9b0 tx=0x7f87bc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87c27fc640 1 -- 172.21.15.17:0/1480828395 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc009670 con 0x7f87cc1587e0 2023-08-09T12:45:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87c27fc640 1 -- 172.21.15.17:0/1480828395 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc00c9a0 con 0x7f87cc1587e0 2023-08-09T12:45:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87c27fc640 1 -- 172.21.15.17:0/1480828395 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00cd50 con 0x7f87cc1587e0 2023-08-09T12:45:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc0c9a30 con 0x7f87cc1587e0 2023-08-09T12:45:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.094+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc0b03c0 con 0x7f87cc1587e0 2023-08-09T12:45:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.096+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc0c9c20 con 0x7f87cc1587e0 2023-08-09T12:45:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.097+0000 7f87c27fc640 1 -- 172.21.15.17:0/1480828395 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f87bc013470 con 0x7f87cc1587e0 2023-08-09T12:45:27.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.098+0000 7f87c27fc640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87b006a050 0x7f87b006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.098+0000 7f87c27fc640 1 -- 172.21.15.17:0/1480828395 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87bc0887e0 con 0x7f87cc1587e0 2023-08-09T12:45:27.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.099+0000 7f87d1cf7640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87b006a050 0x7f87b006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.100+0000 7f87d1cf7640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87b006a050 0x7f87b006c510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f87c8036000 tx=0x7f87c803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:27.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.102+0000 7f87c27fc640 1 -- 172.21.15.17:0/1480828395 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f87bc053eb0 con 0x7f87cc1587e0 2023-08-09T12:45:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.300+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87cc06fa10 con 0x7f87cc1587e0 2023-08-09T12:45:27.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.302+0000 7f87c27fc640 1 -- 172.21.15.17:0/1480828395 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+18330 (secure 0 0 0) 0x7f87cc06fa10 con 0x7f87cc1587e0 2023-08-09T12:45:27.305 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:27.306 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":99,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:45:22.838658+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:44:23.740360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-09T12:44:24.571392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:27.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.304+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87b006a050 msgr2=0x7f87b006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.304+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87b006a050 0x7f87b006c510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f87c8036000 tx=0x7f87c803c040 comp rx=0 tx=0).stop 2023-08-09T12:45:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1587e0 msgr2=0x7f87cc0c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1587e0 0x7f87cc0c8d40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00e9b0 tx=0x7f87bc00ee70 comp rx=0 tx=0).stop 2023-08-09T12:45:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 shutdown_connections 2023-08-09T12:45:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f87b006a050 0x7f87b006c510 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87cc0aff10 0x7f87cc1f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1587e0 0x7f87cc0c8d40 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 --2- 172.21.15.17:0/1480828395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87cc0b0b10 0x7f87cc0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 >> 172.21.15.17:0/1480828395 conn(0x7f87cc0b1d50 msgr2=0x7f87cc1574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 shutdown_connections 2023-08-09T12:45:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.305+0000 7f87d2cf9640 1 -- 172.21.15.17:0/1480828395 wait complete. 2023-08-09T12:45:27.329 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:45:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.556+0000 7f5b254d7640 1 Processor -- start 2023-08-09T12:45:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.556+0000 7f5b254d7640 1 -- start start 2023-08-09T12:45:27.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.557+0000 7f5b254d7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5b200cb3b0 0x7f5b200c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.557+0000 7f5b254d7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b200b34a0 con 0x7f5b200caf00 2023-08-09T12:45:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.557+0000 7f5b254d7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b200b3780 con 0x7f5b201601f0 2023-08-09T12:45:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.557+0000 7f5b254d7640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b200b4120 con 0x7f5b200cb3b0 2023-08-09T12:45:27.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.558+0000 7f5b24cd6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5b200cb3b0 0x7f5b200c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.558+0000 7f5b24cd6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5b200cb3b0 0x7f5b200c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51558/0 (socket says 172.21.15.17:51558) 2023-08-09T12:45:27.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.558+0000 7f5b24cd6640 1 -- 172.21.15.17:0/3199808357 learned_addr learned my addr 172.21.15.17:0/3199808357 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:27.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.558+0000 7f5b17fff640 1 --1- 172.21.15.17:0/3199808357 >> v1:172.21.15.17:6789/0 conn(0x7f5b200caf00 0x7f5b200c2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58870/0 (socket says 172.21.15.17:58870) 2023-08-09T12:45:27.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.558+0000 7f5b24cd6640 1 -- 172.21.15.17:0/3199808357 >> v1:172.21.15.142:6789/0 conn(0x7f5b201601f0 legacy=0x7f5b200b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:27.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.558+0000 7f5b24cd6640 1 -- 172.21.15.17:0/3199808357 >> v1:172.21.15.17:6789/0 conn(0x7f5b200caf00 legacy=0x7f5b200c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.559+0000 7f5b24cd6640 1 -- 172.21.15.17:0/3199808357 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b200b3a60 con 0x7f5b200cb3b0 2023-08-09T12:45:27.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.560+0000 7f5b24cd6640 1 --2- 172.21.15.17:0/3199808357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b200cb3b0 0x7f5b200c2950 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009e50 tx=0x7f5b1802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f056dc2e6bcb399b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:27.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.560+0000 7f5b1f7fe640 1 -- 172.21.15.17:0/3199808357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1802cb10 con 0x7f5b200cb3b0 2023-08-09T12:45:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.560+0000 7f5b1f7fe640 1 -- 172.21.15.17:0/3199808357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1802cc70 con 0x7f5b200cb3b0 2023-08-09T12:45:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.560+0000 7f5b1f7fe640 1 -- 172.21.15.17:0/3199808357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180343f0 con 0x7f5b200cb3b0 2023-08-09T12:45:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.561+0000 7f5b254d7640 1 -- 172.21.15.17:0/3199808357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b200cb3b0 msgr2=0x7f5b200c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.561+0000 7f5b254d7640 1 --2- 172.21.15.17:0/3199808357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b200cb3b0 0x7f5b200c2950 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009e50 tx=0x7f5b1802bf70 comp rx=0 tx=0).stop 2023-08-09T12:45:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.561+0000 7f5b254d7640 1 -- 172.21.15.17:0/3199808357 shutdown_connections 2023-08-09T12:45:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.561+0000 7f5b254d7640 1 --2- 172.21.15.17:0/3199808357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b200cb3b0 0x7f5b200c2950 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.561+0000 7f5b254d7640 1 -- 172.21.15.17:0/3199808357 >> 172.21.15.17:0/3199808357 conn(0x7f5b200b1d50 msgr2=0x7f5b2006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.561+0000 7f5b254d7640 1 -- 172.21.15.17:0/3199808357 shutdown_connections 2023-08-09T12:45:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.561+0000 7f5b254d7640 1 -- 172.21.15.17:0/3199808357 wait complete. 2023-08-09T12:45:27.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.563+0000 7f5b254d7640 1 Processor -- start 2023-08-09T12:45:27.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.563+0000 7f5b254d7640 1 -- start start 2023-08-09T12:45:27.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b254d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b200caf00 0x7f5b20145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b254d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b200cb3b0 0x7f5b200c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b254d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b201601f0 0x7f5b200c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b254d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201f6810 con 0x7f5b201601f0 2023-08-09T12:45:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b254d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201f5c00 con 0x7f5b200cb3b0 2023-08-09T12:45:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b254d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201f5ee0 con 0x7f5b200caf00 2023-08-09T12:45:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b24cd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b201601f0 0x7f5b200c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b24cd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b201601f0 0x7f5b200c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51574/0 (socket says 172.21.15.17:51574) 2023-08-09T12:45:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.564+0000 7f5b24cd6640 1 -- 172.21.15.17:0/615316222 learned_addr learned my addr 172.21.15.17:0/615316222 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b1ffff640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b200caf00 0x7f5b20145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b17fff640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b200cb3b0 0x7f5b200c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b24cd6640 1 -- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b200caf00 msgr2=0x7f5b20145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b24cd6640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b200caf00 0x7f5b20145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b24cd6640 1 -- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b200cb3b0 msgr2=0x7f5b200c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b24cd6640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b200cb3b0 0x7f5b200c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b24cd6640 1 -- 172.21.15.17:0/615316222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18009b30 con 0x7f5b201601f0 2023-08-09T12:45:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b1ffff640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b200caf00 0x7f5b20145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b17fff640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b200cb3b0 0x7f5b200c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.565+0000 7f5b24cd6640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b201601f0 0x7f5b200c6980 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5b18036040 tx=0x7f5b18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.566+0000 7f5b1d7fa640 1 -- 172.21.15.17:0/615316222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1803e450 con 0x7f5b201601f0 2023-08-09T12:45:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.566+0000 7f5b1d7fa640 1 -- 172.21.15.17:0/615316222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1803e5d0 con 0x7f5b201601f0 2023-08-09T12:45:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.566+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b201f61c0 con 0x7f5b201601f0 2023-08-09T12:45:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.566+0000 7f5b1d7fa640 1 -- 172.21.15.17:0/615316222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1803e980 con 0x7f5b201601f0 2023-08-09T12:45:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.566+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b20145680 con 0x7f5b201601f0 2023-08-09T12:45:27.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.567+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b201f69c0 con 0x7f5b201601f0 2023-08-09T12:45:27.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.568+0000 7f5b1d7fa640 1 -- 172.21.15.17:0/615316222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b1803eae0 con 0x7f5b201601f0 2023-08-09T12:45:27.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.569+0000 7f5b1d7fa640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b0006a050 0x7f5b0006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:27.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.569+0000 7f5b1d7fa640 1 -- 172.21.15.17:0/615316222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b180ab440 con 0x7f5b201601f0 2023-08-09T12:45:27.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.570+0000 7f5b1ffff640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b0006a050 0x7f5b0006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:27.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.571+0000 7f5b1ffff640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b0006a050 0x7f5b0006c510 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000a830 tx=0x7f5b10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.573+0000 7f5b1d7fa640 1 -- 172.21.15.17:0/615316222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5b201f69c0 con 0x7f5b201601f0 2023-08-09T12:45:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.807+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5b2004e390 con 0x7f5b201601f0 2023-08-09T12:45:27.811 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:45:27.808+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:45:27.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.819+0000 7f5b1d7fa640 1 -- 172.21.15.17:0/615316222 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5b18076bd0 con 0x7f5b201601f0 2023-08-09T12:45:27.823 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:45:27.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b0006a050 msgr2=0x7f5b0006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b0006a050 0x7f5b0006c510 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000a830 tx=0x7f5b10008040 comp rx=0 tx=0).stop 2023-08-09T12:45:27.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b201601f0 msgr2=0x7f5b200c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:27.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b201601f0 0x7f5b200c6980 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5b18036040 tx=0x7f5b18004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:27.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 shutdown_connections 2023-08-09T12:45:27.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b0006a050 0x7f5b0006c510 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b201601f0 0x7f5b200c6980 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b200cb3b0 0x7f5b200c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 --2- 172.21.15.17:0/615316222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b200caf00 0x7f5b20145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 >> 172.21.15.17:0/615316222 conn(0x7f5b200b1d50 msgr2=0x7f5b200c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 shutdown_connections 2023-08-09T12:45:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:27.824+0000 7f5b254d7640 1 -- 172.21.15.17:0/615316222 wait complete. 2023-08-09T12:45:27.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:45:27.897 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:45:28.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.050+0000 7ff45b477640 1 Processor -- start 2023-08-09T12:45:28.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.050+0000 7ff45b477640 1 -- start start 2023-08-09T12:45:28.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.051+0000 7ff45b477640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:28.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.051+0000 7ff45b477640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff454070a90 0x7ff4540c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:28.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.051+0000 7ff45b477640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4540b4630 con 0x7ff4540ad810 2023-08-09T12:45:28.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.051+0000 7ff45b477640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45415a160 con 0x7ff454070a90 2023-08-09T12:45:28.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.051+0000 7ff45b477640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540b3ab0 con 0x7ff454159d80 2023-08-09T12:45:28.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.052+0000 7ff459213640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:28.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.052+0000 7ff459213640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:59120/0 (socket says 172.21.15.17:59120) 2023-08-09T12:45:28.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.052+0000 7ff459213640 1 -- 172.21.15.17:0/1878352632 learned_addr learned my addr 172.21.15.17:0/1878352632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:28.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.052+0000 7ff459a14640 1 --2- 172.21.15.17:0/1878352632 >> v2:172.21.15.142:3300/0 conn(0x7ff454070a90 0x7ff4540c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:28.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.053+0000 7ff459213640 1 -- 172.21.15.17:0/1878352632 >> v2:172.21.15.142:3300/0 conn(0x7ff454070a90 msgr2=0x7ff4540c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:28.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.053+0000 7ff459213640 1 --2- 172.21.15.17:0/1878352632 >> v2:172.21.15.142:3300/0 conn(0x7ff454070a90 0x7ff4540c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.053+0000 7ff459213640 1 -- 172.21.15.17:0/1878352632 >> v1:172.21.15.142:6789/0 conn(0x7ff4540ad810 legacy=0x7ff454070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:28.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.053+0000 7ff459213640 1 -- 172.21.15.17:0/1878352632 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540b3d90 con 0x7ff454159d80 2023-08-09T12:45:28.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.053+0000 7ff459a14640 1 --2- 172.21.15.17:0/1878352632 >> v2:172.21.15.142:3300/0 conn(0x7ff454070a90 0x7ff4540c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:45:28.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.055+0000 7ff459213640 1 --2- 172.21.15.17:0/1878352632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540b34d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff450009870 tx=0x7ff45002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6778d63d3e90d703 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:28.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.056+0000 7ff44bfff640 1 -- 172.21.15.17:0/1878352632 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450030840 con 0x7ff454159d80 2023-08-09T12:45:28.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.056+0000 7ff44bfff640 1 -- 172.21.15.17:0/1878352632 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4500309a0 con 0x7ff454159d80 2023-08-09T12:45:28.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.056+0000 7ff44bfff640 1 -- 172.21.15.17:0/1878352632 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450030d30 con 0x7ff454159d80 2023-08-09T12:45:28.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.057+0000 7ff45b477640 1 -- 172.21.15.17:0/1878352632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 msgr2=0x7ff4540b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:28.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.057+0000 7ff45b477640 1 --2- 172.21.15.17:0/1878352632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540b34d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff450009870 tx=0x7ff45002b980 comp rx=0 tx=0).stop 2023-08-09T12:45:28.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.057+0000 7ff45b477640 1 -- 172.21.15.17:0/1878352632 shutdown_connections 2023-08-09T12:45:28.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.057+0000 7ff45b477640 1 --2- 172.21.15.17:0/1878352632 >> v2:172.21.15.142:3300/0 conn(0x7ff454070a90 0x7ff4540c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.057+0000 7ff45b477640 1 --2- 172.21.15.17:0/1878352632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540b34d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.057+0000 7ff45b477640 1 -- 172.21.15.17:0/1878352632 >> 172.21.15.17:0/1878352632 conn(0x7ff4540cb1b0 msgr2=0x7ff4540cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:28.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.057+0000 7ff45b477640 1 -- 172.21.15.17:0/1878352632 shutdown_connections 2023-08-09T12:45:28.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.057+0000 7ff45b477640 1 -- 172.21.15.17:0/1878352632 wait complete. 2023-08-09T12:45:28.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.059+0000 7ff45b477640 1 Processor -- start 2023-08-09T12:45:28.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.059+0000 7ff45b477640 1 -- start start 2023-08-09T12:45:28.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff45b477640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff454070a90 0x7ff45414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff45b477640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4540ad810 0x7ff4540c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff45b477640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff45b477640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540b0090 con 0x7ff454070a90 2023-08-09T12:45:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff45b477640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45414f280 con 0x7ff4540ad810 2023-08-09T12:45:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff45b477640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540af310 con 0x7ff454159d80 2023-08-09T12:45:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff459213640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff454070a90 0x7ff45414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff459213640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff454070a90 0x7ff45414ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42238/0 (socket says 172.21.15.17:42238) 2023-08-09T12:45:28.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.060+0000 7ff459213640 1 -- 172.21.15.17:0/401661131 learned_addr learned my addr 172.21.15.17:0/401661131 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:28.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff459213640 1 -- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 msgr2=0x7ff4540c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:28.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff459213640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff459213640 1 -- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4540ad810 msgr2=0x7ff4540c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:28.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff458a12640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4540ad810 0x7ff4540c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:28.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff459213640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4540ad810 0x7ff4540c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff459213640 1 -- 172.21.15.17:0/401661131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c009a70 con 0x7ff454070a90 2023-08-09T12:45:28.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff459213640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff454070a90 0x7ff45414ed40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff45002b9c0 tx=0x7ff4500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:28.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff449ffb640 1 -- 172.21.15.17:0/401661131 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45003e070 con 0x7ff454070a90 2023-08-09T12:45:28.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff449ffb640 1 -- 172.21.15.17:0/401661131 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450039990 con 0x7ff454070a90 2023-08-09T12:45:28.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff449ffb640 1 -- 172.21.15.17:0/401661131 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450039d60 con 0x7ff454070a90 2023-08-09T12:45:28.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.061+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4500094d0 con 0x7ff454070a90 2023-08-09T12:45:28.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.062+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4540b05c0 con 0x7ff454070a90 2023-08-09T12:45:28.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.062+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4540c94d0 con 0x7ff454070a90 2023-08-09T12:45:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.064+0000 7ff449ffb640 1 -- 172.21.15.17:0/401661131 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff45004b400 con 0x7ff454070a90 2023-08-09T12:45:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.065+0000 7ff449ffb640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff43806a050 0x7ff43806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.065+0000 7ff449ffb640 1 -- 172.21.15.17:0/401661131 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff4500aaa90 con 0x7ff454070a90 2023-08-09T12:45:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.065+0000 7ff458a12640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff43806a050 0x7ff43806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.067+0000 7ff458a12640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff43806a050 0x7ff43806c510 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff4541591b0 tx=0x7ff444009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:28.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.069+0000 7ff449ffb640 1 -- 172.21.15.17:0/401661131 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff450076110 con 0x7ff454070a90 2023-08-09T12:45:28.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.298+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff454067a80 con 0x7ff454070a90 2023-08-09T12:45:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.877+0000 7ff449ffb640 1 -- 172.21.15.17:0/401661131 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff4500340a0 con 0x7ff454070a90 2023-08-09T12:45:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff43806a050 msgr2=0x7ff43806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff43806a050 0x7ff43806c510 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff4541591b0 tx=0x7ff444009040 comp rx=0 tx=0).stop 2023-08-09T12:45:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff454070a90 msgr2=0x7ff45414ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff454070a90 0x7ff45414ed40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff45002b9c0 tx=0x7ff4500046c0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 shutdown_connections 2023-08-09T12:45:28.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff43806a050 0x7ff43806c510 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff454159d80 0x7ff4540c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4540ad810 0x7ff4540c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 --2- 172.21.15.17:0/401661131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff454070a90 0x7ff45414ed40 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:28.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 >> 172.21.15.17:0/401661131 conn(0x7ff4540cb1b0 msgr2=0x7ff4540698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:28.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.881+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 shutdown_connections 2023-08-09T12:45:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:28.882+0000 7ff45b477640 1 -- 172.21.15.17:0/401661131 wait complete. 2023-08-09T12:45:28.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:45:29.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.142+0000 7f7074806640 1 Processor -- start 2023-08-09T12:45:29.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.142+0000 7f7074806640 1 -- start start 2023-08-09T12:45:29.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.143+0000 7f7074806640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f707015add0 0x7f707006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.143+0000 7f7074806640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707015b1b0 con 0x7f7070070320 2023-08-09T12:45:29.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.143+0000 7f7074806640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70700cd6e0 con 0x7f7070161570 2023-08-09T12:45:29.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.143+0000 7f7074806640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70700707b0 con 0x7f707015add0 2023-08-09T12:45:29.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.144+0000 7f706dd9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7070070320 0x7f7070160e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54476/0 (socket says 172.21.15.17:54476) 2023-08-09T12:45:29.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.144+0000 7f706dd9b640 1 -- 172.21.15.17:0/1290289579 learned_addr learned my addr 172.21.15.17:0/1290289579 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.144+0000 7f706e59c640 1 --2- 172.21.15.17:0/1290289579 >> v2:172.21.15.142:3300/0 conn(0x7f707015add0 0x7f707006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.144+0000 7f706d59a640 1 -- 172.21.15.17:0/1290289579 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263100943 0 0) 0x7f707015b1b0 con 0x7f7070070320 2023-08-09T12:45:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.144+0000 7f706d59a640 1 -- 172.21.15.17:0/1290289579 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7058003520 con 0x7f7070070320 2023-08-09T12:45:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.145+0000 7f706e59c640 1 -- 172.21.15.17:0/1290289579 >> v1:172.21.15.142:6789/0 conn(0x7f7070161570 legacy=0x7f70700d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.145+0000 7f706e59c640 1 -- 172.21.15.17:0/1290289579 >> v1:172.21.15.17:6789/0 conn(0x7f7070070320 legacy=0x7f7070160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.145+0000 7f706e59c640 1 -- 172.21.15.17:0/1290289579 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700cd9c0 con 0x7f707015add0 2023-08-09T12:45:29.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.146+0000 7f706e59c640 1 --2- 172.21.15.17:0/1290289579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707015add0 0x7f707006fde0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7060009d90 tx=0x7f706002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e451292a878a621e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:29.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.147+0000 7f706d59a640 1 -- 172.21.15.17:0/1290289579 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706002ccf0 con 0x7f707015add0 2023-08-09T12:45:29.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.147+0000 7f706d59a640 1 -- 172.21.15.17:0/1290289579 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706002ce50 con 0x7f707015add0 2023-08-09T12:45:29.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.147+0000 7f706d59a640 1 -- 172.21.15.17:0/1290289579 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060034660 con 0x7f707015add0 2023-08-09T12:45:29.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.147+0000 7f7074806640 1 -- 172.21.15.17:0/1290289579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707015add0 msgr2=0x7f707006fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:29.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.147+0000 7f7074806640 1 --2- 172.21.15.17:0/1290289579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707015add0 0x7f707006fde0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7060009d90 tx=0x7f706002bf40 comp rx=0 tx=0).stop 2023-08-09T12:45:29.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.148+0000 7f7074806640 1 -- 172.21.15.17:0/1290289579 shutdown_connections 2023-08-09T12:45:29.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.148+0000 7f7074806640 1 --2- 172.21.15.17:0/1290289579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707015add0 0x7f707006fde0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:29.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.148+0000 7f7074806640 1 -- 172.21.15.17:0/1290289579 >> 172.21.15.17:0/1290289579 conn(0x7f70700d2b50 msgr2=0x7f70700d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:29.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.148+0000 7f7074806640 1 -- 172.21.15.17:0/1290289579 shutdown_connections 2023-08-09T12:45:29.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.148+0000 7f7074806640 1 -- 172.21.15.17:0/1290289579 wait complete. 2023-08-09T12:45:29.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.149+0000 7f7074806640 1 Processor -- start 2023-08-09T12:45:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.149+0000 7f7074806640 1 -- start start 2023-08-09T12:45:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.150+0000 7f7074806640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7070070320 0x7f70700b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.150+0000 7f7074806640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707015add0 0x7f70700b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.150+0000 7f7074806640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7070161570 0x7f70700b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.150+0000 7f7074806640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70701f3b20 con 0x7f7070070320 2023-08-09T12:45:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.150+0000 7f7074806640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70700b48f0 con 0x7f7070161570 2023-08-09T12:45:29.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.150+0000 7f7074806640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70701f2c50 con 0x7f707015add0 2023-08-09T12:45:29.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7070070320 0x7f70700b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:29.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7070070320 0x7f70700b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42242/0 (socket says 172.21.15.17:42242) 2023-08-09T12:45:29.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706e59c640 1 -- 172.21.15.17:0/1093360293 learned_addr learned my addr 172.21.15.17:0/1093360293 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:29.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706dd9b640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707015add0 0x7f70700b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:29.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706ed9d640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7070161570 0x7f70700b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:29.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706e59c640 1 -- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707015add0 msgr2=0x7f70700b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:29.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706e59c640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707015add0 0x7f70700b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:29.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706e59c640 1 -- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7070161570 msgr2=0x7f70700b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:29.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706e59c640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7070161570 0x7f70700b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:29.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.151+0000 7f706e59c640 1 -- 172.21.15.17:0/1093360293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060009a70 con 0x7f7070070320 2023-08-09T12:45:29.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.152+0000 7f706e59c640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7070070320 0x7f70700b43b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f706002dfd0 tx=0x7f7060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:29.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.152+0000 7f705effd640 1 -- 172.21.15.17:0/1093360293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706003d600 con 0x7f7070070320 2023-08-09T12:45:29.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.152+0000 7f705effd640 1 -- 172.21.15.17:0/1093360293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706003d7a0 con 0x7f7070070320 2023-08-09T12:45:29.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.152+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70700b5460 con 0x7f7070070320 2023-08-09T12:45:29.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.152+0000 7f705effd640 1 -- 172.21.15.17:0/1093360293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706003db50 con 0x7f7070070320 2023-08-09T12:45:29.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.152+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70701f3180 con 0x7f7070070320 2023-08-09T12:45:29.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.153+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7070067a80 con 0x7f7070070320 2023-08-09T12:45:29.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.154+0000 7f705effd640 1 -- 172.21.15.17:0/1093360293 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f706003b040 con 0x7f7070070320 2023-08-09T12:45:29.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.156+0000 7f705effd640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:29.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.156+0000 7f705effd640 1 -- 172.21.15.17:0/1093360293 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f70600aa930 con 0x7f7070070320 2023-08-09T12:45:29.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.157+0000 7f706dd9b640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:29.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.158+0000 7f706dd9b640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f70701580e0 tx=0x7f7064009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:29.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.161+0000 7f705effd640 1 -- 172.21.15.17:0/1093360293 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7060075fb0 con 0x7f7070070320 2023-08-09T12:45:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.354+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f707006fde0 con 0x7f7070070320 2023-08-09T12:45:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.900+0000 7f705effd640 1 -- 172.21.15.17:0/1093360293 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) v1 ==== 181+0+0 (secure 0 0 0) 0x7f70600390d0 con 0x7f7070070320 2023-08-09T12:45:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:45:29.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.906+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 msgr2=0x7f705006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:29.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.906+0000 7f7074806640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f70701580e0 tx=0x7f7064009040 comp rx=0 tx=0).stop 2023-08-09T12:45:29.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.906+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7070070320 msgr2=0x7f70700b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:29.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.906+0000 7f7074806640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7070070320 0x7f70700b43b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f706002dfd0 tx=0x7f7060004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:29.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.908+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 shutdown_connections 2023-08-09T12:45:29.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.908+0000 7f7074806640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:29.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.908+0000 7f7074806640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7070161570 0x7f70700b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:29.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.908+0000 7f7074806640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707015add0 0x7f70700b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:29.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.908+0000 7f7074806640 1 --2- 172.21.15.17:0/1093360293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7070070320 0x7f70700b43b0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:29.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.908+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 >> 172.21.15.17:0/1093360293 conn(0x7f70700d2b50 msgr2=0x7f707015e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:29.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.908+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 shutdown_connections 2023-08-09T12:45:29.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:29.909+0000 7f7074806640 1 -- 172.21.15.17:0/1093360293 wait complete. 2023-08-09T12:45:29.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:45:30.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.165+0000 7fdbab8f3640 1 Processor -- start 2023-08-09T12:45:30.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.165+0000 7fdbab8f3640 1 -- start start 2023-08-09T12:45:30.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdbab8f3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdba40708a0 0x7fdba40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:30.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdbab8f3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba40b4770 con 0x7fdba415abe0 2023-08-09T12:45:30.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdbab8f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba40caa70 con 0x7fdba40add60 2023-08-09T12:45:30.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdbab8f3640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba40b41b0 con 0x7fdba40708a0 2023-08-09T12:45:30.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdba9e90640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdba40708a0 0x7fdba40c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:30.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdba9e90640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdba40708a0 0x7fdba40c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42246/0 (socket says 172.21.15.17:42246) 2023-08-09T12:45:30.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdba9e90640 1 -- 172.21.15.17:0/807419167 learned_addr learned my addr 172.21.15.17:0/807419167 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:30.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdba968f640 1 --1- 172.21.15.17:0/807419167 >> v1:172.21.15.17:6789/0 conn(0x7fdba415abe0 0x7fdba4070190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54492/0 (socket says 172.21.15.17:54492) 2023-08-09T12:45:30.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.167+0000 7fdba9e90640 1 -- 172.21.15.17:0/807419167 >> v1:172.21.15.142:6789/0 conn(0x7fdba40add60 legacy=0x7fdba40caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:30.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.168+0000 7fdba9e90640 1 -- 172.21.15.17:0/807419167 >> v1:172.21.15.17:6789/0 conn(0x7fdba415abe0 legacy=0x7fdba4070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:30.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.168+0000 7fdba9e90640 1 -- 172.21.15.17:0/807419167 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40b4490 con 0x7fdba40708a0 2023-08-09T12:45:30.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.168+0000 7fdb9bfff640 1 -- 172.21.15.17:0/807419167 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201882671 0 0) 0x7fdba40b4770 con 0x7fdba415abe0 2023-08-09T12:45:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.169+0000 7fdba9e90640 1 --2- 172.21.15.17:0/807419167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba40c8e00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009e50 tx=0x7fdb9c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50492bd0a6bd817 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.169+0000 7fdb9bfff640 1 -- 172.21.15.17:0/807419167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c02c9e0 con 0x7fdba40708a0 2023-08-09T12:45:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.169+0000 7fdb9bfff640 1 -- 172.21.15.17:0/807419167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c02cb40 con 0x7fdba40708a0 2023-08-09T12:45:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.169+0000 7fdb9bfff640 1 -- 172.21.15.17:0/807419167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0343f0 con 0x7fdba40708a0 2023-08-09T12:45:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.170+0000 7fdbab8f3640 1 -- 172.21.15.17:0/807419167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 msgr2=0x7fdba40c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.170+0000 7fdbab8f3640 1 --2- 172.21.15.17:0/807419167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba40c8e00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009e50 tx=0x7fdb9c02be40 comp rx=0 tx=0).stop 2023-08-09T12:45:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.170+0000 7fdbab8f3640 1 -- 172.21.15.17:0/807419167 shutdown_connections 2023-08-09T12:45:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.170+0000 7fdbab8f3640 1 --2- 172.21.15.17:0/807419167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba40c8e00 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.170+0000 7fdbab8f3640 1 -- 172.21.15.17:0/807419167 >> 172.21.15.17:0/807419167 conn(0x7fdba40697c0 msgr2=0x7fdba4069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.170+0000 7fdbab8f3640 1 -- 172.21.15.17:0/807419167 shutdown_connections 2023-08-09T12:45:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.170+0000 7fdbab8f3640 1 -- 172.21.15.17:0/807419167 wait complete. 2023-08-09T12:45:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.172+0000 7fdbab8f3640 1 Processor -- start 2023-08-09T12:45:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.172+0000 7fdbab8f3640 1 -- start start 2023-08-09T12:45:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdbab8f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba4157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdbab8f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40add60 0x7fdba415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdbab8f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba415abe0 0x7fdba40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdbab8f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40cc9d0 con 0x7fdba40708a0 2023-08-09T12:45:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdbab8f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba415d3f0 con 0x7fdba415abe0 2023-08-09T12:45:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdbab8f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba415d6d0 con 0x7fdba40add60 2023-08-09T12:45:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdba968f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba4157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdba968f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba4157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42248/0 (socket says 172.21.15.17:42248) 2023-08-09T12:45:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.173+0000 7fdba968f640 1 -- 172.21.15.17:0/534735948 learned_addr learned my addr 172.21.15.17:0/534735948 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:30.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba8e8e640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40add60 0x7fdba415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:30.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba9e90640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba415abe0 0x7fdba40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba968f640 1 -- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40add60 msgr2=0x7fdba415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba968f640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40add60 0x7fdba415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba968f640 1 -- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba415abe0 msgr2=0x7fdba40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba968f640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba415abe0 0x7fdba40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba968f640 1 -- 172.21.15.17:0/534735948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c009b30 con 0x7fdba40708a0 2023-08-09T12:45:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba8e8e640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40add60 0x7fdba415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba9e90640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba415abe0 0x7fdba40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdba968f640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba4157d50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c430 tx=0x7fdba000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdb99ffb640 1 -- 172.21.15.17:0/534735948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00074e0 con 0x7fdba40708a0 2023-08-09T12:45:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdb99ffb640 1 -- 172.21.15.17:0/534735948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0007660 con 0x7fdba40708a0 2023-08-09T12:45:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdb99ffb640 1 -- 172.21.15.17:0/534735948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0004a20 con 0x7fdba40708a0 2023-08-09T12:45:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.174+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba40cc380 con 0x7fdba40708a0 2023-08-09T12:45:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.175+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba415d0e0 con 0x7fdba40708a0 2023-08-09T12:45:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.176+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba40b3f00 con 0x7fdba40708a0 2023-08-09T12:45:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.177+0000 7fdb99ffb640 1 -- 172.21.15.17:0/534735948 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdba0004b80 con 0x7fdba40708a0 2023-08-09T12:45:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.178+0000 7fdb99ffb640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a080 0x7fdb8806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.178+0000 7fdb99ffb640 1 -- 172.21.15.17:0/534735948 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fdba0088250 con 0x7fdba40708a0 2023-08-09T12:45:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.178+0000 7fdba8e8e640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a080 0x7fdb8806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.180+0000 7fdba8e8e640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a080 0x7fdb8806c540 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdba41f59d0 tx=0x7fdb94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:30.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.182+0000 7fdb99ffb640 1 -- 172.21.15.17:0/534735948 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdba0053aa0 con 0x7fdba40708a0 2023-08-09T12:45:30.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.377+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdba4067a80 con 0x7fdba40708a0 2023-08-09T12:45:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.916+0000 7fdb99ffb640 1 -- 172.21.15.17:0/534735948 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdba00570c0 con 0x7fdba40708a0 2023-08-09T12:45:30.920 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:45:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.921+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a080 msgr2=0x7fdb8806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.921+0000 7fdbab8f3640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a080 0x7fdb8806c540 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdba41f59d0 tx=0x7fdb94009040 comp rx=0 tx=0).stop 2023-08-09T12:45:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.921+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 msgr2=0x7fdba4157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.921+0000 7fdbab8f3640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba4157d50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c430 tx=0x7fdba000c8f0 comp rx=0 tx=0).stop 2023-08-09T12:45:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.921+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 shutdown_connections 2023-08-09T12:45:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.922+0000 7fdbab8f3640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdb8806a080 0x7fdb8806c540 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.922+0000 7fdbab8f3640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba415abe0 0x7fdba40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.922+0000 7fdbab8f3640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba40add60 0x7fdba415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.922+0000 7fdbab8f3640 1 --2- 172.21.15.17:0/534735948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdba40708a0 0x7fdba4157d50 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.922+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 >> 172.21.15.17:0/534735948 conn(0x7fdba40697c0 msgr2=0x7fdba40caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.922+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 shutdown_connections 2023-08-09T12:45:30.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:30.922+0000 7fdbab8f3640 1 -- 172.21.15.17:0/534735948 wait complete. 2023-08-09T12:45:30.948 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:45:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.170+0000 7f23b0923640 1 Processor -- start 2023-08-09T12:45:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.170+0000 7f23b0923640 1 -- start start 2023-08-09T12:45:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.171+0000 7f23b0923640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23ac0b8420 0x7f23ac0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.171+0000 7f23b0923640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f23ac15cf20 0x7f23ac0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.171+0000 7f23b0923640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0d0f00 con 0x7f23ac15cb40 2023-08-09T12:45:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.171+0000 7f23b0923640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac1611f0 con 0x7f23ac15cf20 2023-08-09T12:45:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.171+0000 7f23b0923640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac1614d0 con 0x7f23ac0b8420 2023-08-09T12:45:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.172+0000 7f23aad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f23ac15cb40 0x7f23ac1609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54502/0 (socket says 172.21.15.17:54502) 2023-08-09T12:45:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.172+0000 7f23aad9d640 1 -- 172.21.15.17:0/3080292238 learned_addr learned my addr 172.21.15.17:0/3080292238 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.172+0000 7f23ab59e640 1 --2- 172.21.15.17:0/3080292238 >> v2:172.21.15.17:3300/0 conn(0x7f23ac15cf20 0x7f23ac0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.172+0000 7f23aa59c640 1 --2- 172.21.15.17:0/3080292238 >> v2:172.21.15.142:3300/0 conn(0x7f23ac0b8420 0x7f23ac0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.172+0000 7f23ab59e640 1 -- 172.21.15.17:0/3080292238 >> v2:172.21.15.142:3300/0 conn(0x7f23ac0b8420 msgr2=0x7f23ac0cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:31.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.172+0000 7f23ab59e640 1 --2- 172.21.15.17:0/3080292238 >> v2:172.21.15.142:3300/0 conn(0x7f23ac0b8420 0x7f23ac0cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.172+0000 7f23ab59e640 1 -- 172.21.15.17:0/3080292238 >> v1:172.21.15.17:6789/0 conn(0x7f23ac15cb40 legacy=0x7f23ac1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.173+0000 7f23ab59e640 1 -- 172.21.15.17:0/3080292238 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac1617b0 con 0x7f23ac15cf20 2023-08-09T12:45:31.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.173+0000 7f23a9d9b640 1 -- 172.21.15.17:0/3080292238 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412189176 0 0) 0x7f23ac0d0f00 con 0x7f23ac15cb40 2023-08-09T12:45:31.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.174+0000 7f23ab59e640 1 --2- 172.21.15.17:0/3080292238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cf20 0x7f23ac0cdda0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0cf4d0 tx=0x7f23a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f084f44d8f7ec7d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:31.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.174+0000 7f23a9d9b640 1 -- 172.21.15.17:0/3080292238 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4030610 con 0x7f23ac15cf20 2023-08-09T12:45:31.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.174+0000 7f23a9d9b640 1 -- 172.21.15.17:0/3080292238 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4030770 con 0x7f23ac15cf20 2023-08-09T12:45:31.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.174+0000 7f23a9d9b640 1 -- 172.21.15.17:0/3080292238 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4030b00 con 0x7f23ac15cf20 2023-08-09T12:45:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.174+0000 7f23b0923640 1 -- 172.21.15.17:0/3080292238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cf20 msgr2=0x7f23ac0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.174+0000 7f23b0923640 1 --2- 172.21.15.17:0/3080292238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cf20 0x7f23ac0cdda0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0cf4d0 tx=0x7f23a402b960 comp rx=0 tx=0).stop 2023-08-09T12:45:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.175+0000 7f23b0923640 1 -- 172.21.15.17:0/3080292238 shutdown_connections 2023-08-09T12:45:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.175+0000 7f23b0923640 1 --2- 172.21.15.17:0/3080292238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cf20 0x7f23ac0cdda0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.175+0000 7f23b0923640 1 --2- 172.21.15.17:0/3080292238 >> v2:172.21.15.142:3300/0 conn(0x7f23ac0b8420 0x7f23ac0cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.175+0000 7f23b0923640 1 -- 172.21.15.17:0/3080292238 >> 172.21.15.17:0/3080292238 conn(0x7f23ac0d2ab0 msgr2=0x7f23ac0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.175+0000 7f23b0923640 1 -- 172.21.15.17:0/3080292238 shutdown_connections 2023-08-09T12:45:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.175+0000 7f23b0923640 1 -- 172.21.15.17:0/3080292238 wait complete. 2023-08-09T12:45:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.176+0000 7f23b0923640 1 Processor -- start 2023-08-09T12:45:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.177+0000 7f23b0923640 1 -- start start 2023-08-09T12:45:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.177+0000 7f23b0923640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23ac0b8420 0x7f23ac0b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23b0923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cb40 0x7f23ac15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23b0923640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23ac15cf20 0x7f23ac14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23b0923640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0c9af0 con 0x7f23ac15cb40 2023-08-09T12:45:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23b0923640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0c9dd0 con 0x7f23ac15cf20 2023-08-09T12:45:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23b0923640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0ca0b0 con 0x7f23ac0b8420 2023-08-09T12:45:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cb40 0x7f23ac15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cb40 0x7f23ac15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42270/0 (socket says 172.21.15.17:42270) 2023-08-09T12:45:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aa59c640 1 -- 172.21.15.17:0/1941341110 learned_addr learned my addr 172.21.15.17:0/1941341110 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23ab59e640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23ac15cf20 0x7f23ac14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aad9d640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23ac0b8420 0x7f23ac0b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aa59c640 1 -- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23ac0b8420 msgr2=0x7f23ac0b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aa59c640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23ac0b8420 0x7f23ac0b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aa59c640 1 -- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23ac15cf20 msgr2=0x7f23ac14c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aa59c640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23ac15cf20 0x7f23ac14c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aa59c640 1 -- 172.21.15.17:0/1941341110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4009400 con 0x7f23ac15cb40 2023-08-09T12:45:31.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23aad9d640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23ac0b8420 0x7f23ac0b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:31.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.178+0000 7f23ab59e640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23ac15cf20 0x7f23ac14c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.179+0000 7f23aa59c640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cb40 0x7f23ac15b370 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f23a000d800 tx=0x7f23a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.179+0000 7f23937fe640 1 -- 172.21.15.17:0/1941341110 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a000b6c0 con 0x7f23ac15cb40 2023-08-09T12:45:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.179+0000 7f23937fe640 1 -- 172.21.15.17:0/1941341110 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a000b820 con 0x7f23ac15cb40 2023-08-09T12:45:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.179+0000 7f23937fe640 1 -- 172.21.15.17:0/1941341110 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a000bbb0 con 0x7f23ac15cb40 2023-08-09T12:45:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.179+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0ca390 con 0x7f23ac15cb40 2023-08-09T12:45:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.179+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0ca950 con 0x7f23ac15cb40 2023-08-09T12:45:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.181+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac0c6c90 con 0x7f23ac15cb40 2023-08-09T12:45:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.181+0000 7f23937fe640 1 -- 172.21.15.17:0/1941341110 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f23a000bd10 con 0x7f23ac15cb40 2023-08-09T12:45:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.183+0000 7f23937fe640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239806a050 0x7f239806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.183+0000 7f23937fe640 1 -- 172.21.15.17:0/1941341110 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f23a00888a0 con 0x7f23ac15cb40 2023-08-09T12:45:31.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.184+0000 7f23aad9d640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239806a050 0x7f239806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.185+0000 7f23aad9d640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239806a050 0x7f239806c510 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f239c0012e0 tx=0x7f239c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:31.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.187+0000 7f23937fe640 1 -- 172.21.15.17:0/1941341110 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f23ac0c6c90 con 0x7f23ac15cb40 2023-08-09T12:45:31.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.383+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f23ac0c6c90 con 0x7f23ac15cb40 2023-08-09T12:45:31.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.392+0000 7f23937fe640 1 -- 172.21.15.17:0/1941341110 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f23ac0c6c90 con 0x7f23ac15cb40 2023-08-09T12:45:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.394+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239806a050 msgr2=0x7f239806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.394+0000 7f23b0923640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239806a050 0x7f239806c510 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f239c0012e0 tx=0x7f239c009040 comp rx=0 tx=0).stop 2023-08-09T12:45:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.394+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cb40 msgr2=0x7f23ac15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.394+0000 7f23b0923640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cb40 0x7f23ac15b370 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f23a000d800 tx=0x7f23a000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.395+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 shutdown_connections 2023-08-09T12:45:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.395+0000 7f23b0923640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f239806a050 0x7f239806c510 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.395+0000 7f23b0923640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23ac15cf20 0x7f23ac14c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.395+0000 7f23b0923640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23ac15cb40 0x7f23ac15b370 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.395+0000 7f23b0923640 1 --2- 172.21.15.17:0/1941341110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23ac0b8420 0x7f23ac0b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.395+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 >> 172.21.15.17:0/1941341110 conn(0x7f23ac0d2ab0 msgr2=0x7f23ac1563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.395+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 shutdown_connections 2023-08-09T12:45:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.395+0000 7f23b0923640 1 -- 172.21.15.17:0/1941341110 wait complete. 2023-08-09T12:45:31.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-08-09T12:45:31.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.634+0000 7f813d3cb640 1 Processor -- start 2023-08-09T12:45:31.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.634+0000 7f813d3cb640 1 -- start start 2023-08-09T12:45:31.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.636+0000 7f813d3cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81380cb870 0x7f813815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.636+0000 7f813d3cb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f813806f570 0x7f8138071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.636+0000 7f813d3cb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813815d2c0 con 0x7f813806b380 2023-08-09T12:45:31.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.636+0000 7f813d3cb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8138159710 con 0x7f813806f570 2023-08-09T12:45:31.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.636+0000 7f813d3cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81380cbc50 con 0x7f81380cb870 2023-08-09T12:45:31.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.636+0000 7f81377fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f813806f570 0x7f8138071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.637+0000 7f81377fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f813806f570 0x7f8138071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42276/0 (socket says 172.21.15.17:42276) 2023-08-09T12:45:31.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.637+0000 7f813cbca640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f813806b380 0x7f81380c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54504/0 (socket says 172.21.15.17:54504) 2023-08-09T12:45:31.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.637+0000 7f81377fe640 1 -- 172.21.15.17:0/2988258607 learned_addr learned my addr 172.21.15.17:0/2988258607 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:31.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.637+0000 7f8137fff640 1 --2- 172.21.15.17:0/2988258607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81380cb870 0x7f813815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.637+0000 7f81377fe640 1 -- 172.21.15.17:0/2988258607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81380cb870 msgr2=0x7f813815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:31.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.637+0000 7f81377fe640 1 --2- 172.21.15.17:0/2988258607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81380cb870 0x7f813815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.637+0000 7f81377fe640 1 -- 172.21.15.17:0/2988258607 >> v1:172.21.15.17:6789/0 conn(0x7f813806b380 legacy=0x7f81380c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.637+0000 7f81377fe640 1 -- 172.21.15.17:0/2988258607 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138071990 con 0x7f813806f570 2023-08-09T12:45:31.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.638+0000 7f81377fe640 1 --2- 172.21.15.17:0/2988258607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f8138071450 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f812c009870 tx=0x7f812c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f727c79fccaa63e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:31.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f8136ffd640 1 -- 172.21.15.17:0/2988258607 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c031640 con 0x7f813806f570 2023-08-09T12:45:31.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f8136ffd640 1 -- 172.21.15.17:0/2988258607 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c0317a0 con 0x7f813806f570 2023-08-09T12:45:31.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f8136ffd640 1 -- 172.21.15.17:0/2988258607 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c031b30 con 0x7f813806f570 2023-08-09T12:45:31.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f813d3cb640 1 -- 172.21.15.17:0/2988258607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 msgr2=0x7f8138071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2988258607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f8138071450 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f812c009870 tx=0x7f812c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f813d3cb640 1 -- 172.21.15.17:0/2988258607 shutdown_connections 2023-08-09T12:45:31.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2988258607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f8138071450 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2988258607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81380cb870 0x7f813815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f813d3cb640 1 -- 172.21.15.17:0/2988258607 >> 172.21.15.17:0/2988258607 conn(0x7f81380b1d50 msgr2=0x7f813806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:31.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f813d3cb640 1 -- 172.21.15.17:0/2988258607 shutdown_connections 2023-08-09T12:45:31.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.639+0000 7f813d3cb640 1 -- 172.21.15.17:0/2988258607 wait complete. 2023-08-09T12:45:31.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.641+0000 7f813d3cb640 1 Processor -- start 2023-08-09T12:45:31.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.641+0000 7f813d3cb640 1 -- start start 2023-08-09T12:45:31.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.642+0000 7f813d3cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f813806b380 0x7f81381528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.642+0000 7f813d3cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f813815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.642+0000 7f813d3cb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81380cb870 0x7f81380afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.642+0000 7f813d3cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138152730 con 0x7f813806f570 2023-08-09T12:45:31.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.642+0000 7f813d3cb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813815a8f0 con 0x7f81380cb870 2023-08-09T12:45:31.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.642+0000 7f813d3cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813815a310 con 0x7f813806b380 2023-08-09T12:45:31.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f81377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f813815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f81377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f813815ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42292/0 (socket says 172.21.15.17:42292) 2023-08-09T12:45:31.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f81377fe640 1 -- 172.21.15.17:0/2137082141 learned_addr learned my addr 172.21.15.17:0/2137082141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:31.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f813cbca640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81380cb870 0x7f81380afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f8137fff640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f813806b380 0x7f81381528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f81377fe640 1 -- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f813806b380 msgr2=0x7f81381528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f81377fe640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f813806b380 0x7f81381528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f81377fe640 1 -- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81380cb870 msgr2=0x7f81380afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:31.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f81377fe640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81380cb870 0x7f81380afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:31.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f81377fe640 1 -- 172.21.15.17:0/2137082141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c0094d0 con 0x7f813806f570 2023-08-09T12:45:31.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.643+0000 7f813cbca640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81380cb870 0x7f81380afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:31.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.644+0000 7f81377fe640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f813815ad80 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f812c02b930 tx=0x7f812c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:31.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.644+0000 7f8134ff9640 1 -- 172.21.15.17:0/2137082141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c03ac60 con 0x7f813806f570 2023-08-09T12:45:31.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.644+0000 7f8134ff9640 1 -- 172.21.15.17:0/2137082141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c03adc0 con 0x7f813806f570 2023-08-09T12:45:31.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.644+0000 7f8134ff9640 1 -- 172.21.15.17:0/2137082141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c042630 con 0x7f813806f570 2023-08-09T12:45:31.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.644+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813815b9b0 con 0x7f813806f570 2023-08-09T12:45:31.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.644+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81380b03c0 con 0x7f813806f570 2023-08-09T12:45:31.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.645+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813804e390 con 0x7f813806f570 2023-08-09T12:45:31.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.646+0000 7f8134ff9640 1 -- 172.21.15.17:0/2137082141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f812c02f050 con 0x7f813806f570 2023-08-09T12:45:31.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.647+0000 7f8134ff9640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f812406a050 0x7f812406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:31.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.647+0000 7f8134ff9640 1 -- 172.21.15.17:0/2137082141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f812c0a9b00 con 0x7f813806f570 2023-08-09T12:45:31.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.648+0000 7f8137fff640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f812406a050 0x7f812406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:31.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.649+0000 7f8137fff640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f812406a050 0x7f812406c510 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8128006fd0 tx=0x7f8128008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:31.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.652+0000 7f8134ff9640 1 -- 172.21.15.17:0/2137082141 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f812c0754f0 con 0x7f813806f570 2023-08-09T12:45:31.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:31.925+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f81380b2de0 con 0x7f813806f570 2023-08-09T12:45:32.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.922+0000 7f8134ff9640 1 -- 172.21.15.17:0/2137082141 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v320) v1 ==== 133+0+0 (secure 0 0 0) 0x7f812c031e60 con 0x7f813806f570 2023-08-09T12:45:32.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f812406a050 msgr2=0x7f812406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f812406a050 0x7f812406c510 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8128006fd0 tx=0x7f8128008040 comp rx=0 tx=0).stop 2023-08-09T12:45:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 msgr2=0x7f813815ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f813815ad80 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f812c02b930 tx=0x7f812c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:45:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 shutdown_connections 2023-08-09T12:45:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f812406a050 0x7f812406c510 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81380cb870 0x7f81380afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f813806f570 0x7f813815ad80 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 --2- 172.21.15.17:0/2137082141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f813806b380 0x7f81381528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 >> 172.21.15.17:0/2137082141 conn(0x7f81380b1d50 msgr2=0x7f81380b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 shutdown_connections 2023-08-09T12:45:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:32.926+0000 7f813d3cb640 1 -- 172.21.15.17:0/2137082141 wait complete. 2023-08-09T12:45:32.951 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-09T12:45:32.951 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-08-09T12:45:32.952 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-08-09T12:45:33.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.180+0000 7ff9d269f640 1 Processor -- start 2023-08-09T12:45:33.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.181+0000 7ff9d269f640 1 -- start start 2023-08-09T12:45:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.182+0000 7ff9d269f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff9cc0ccee0 0x7ff9cc0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.182+0000 7ff9d269f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0b1930 con 0x7ff9cc160ea0 2023-08-09T12:45:33.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.182+0000 7ff9d269f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0cd410 con 0x7ff9cc0c9330 2023-08-09T12:45:33.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.182+0000 7ff9d269f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0cd6f0 con 0x7ff9cc0ccee0 2023-08-09T12:45:33.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.183+0000 7ff9d1e9e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff9cc0ccee0 0x7ff9cc0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:33.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.183+0000 7ff9d169d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff9cc160ea0 0x7ff9cc0c8c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54520/0 (socket says 172.21.15.17:54520) 2023-08-09T12:45:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.183+0000 7ff9d169d640 1 -- 172.21.15.17:0/1103851986 learned_addr learned my addr 172.21.15.17:0/1103851986 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.183+0000 7ff9d1e9e640 1 -- 172.21.15.17:0/1103851986 >> v1:172.21.15.142:6789/0 conn(0x7ff9cc0c9330 legacy=0x7ff9cc0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.183+0000 7ff9d1e9e640 1 -- 172.21.15.17:0/1103851986 >> v1:172.21.15.17:6789/0 conn(0x7ff9cc160ea0 legacy=0x7ff9cc0c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.183+0000 7ff9d1e9e640 1 -- 172.21.15.17:0/1103851986 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0b15c0 con 0x7ff9cc0ccee0 2023-08-09T12:45:33.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.184+0000 7ff9d1e9e640 1 --2- 172.21.15.17:0/1103851986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0ccee0 0x7ff9cc0ce040 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009d90 tx=0x7ff9c402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324bce8c549c5101 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:33.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9c3fff640 1 -- 172.21.15.17:0/1103851986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c402cbd0 con 0x7ff9cc0ccee0 2023-08-09T12:45:33.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9c3fff640 1 -- 172.21.15.17:0/1103851986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c402cd30 con 0x7ff9cc0ccee0 2023-08-09T12:45:33.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9c3fff640 1 -- 172.21.15.17:0/1103851986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c402cea0 con 0x7ff9cc0ccee0 2023-08-09T12:45:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9d269f640 1 -- 172.21.15.17:0/1103851986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0ccee0 msgr2=0x7ff9cc0ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9d269f640 1 --2- 172.21.15.17:0/1103851986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0ccee0 0x7ff9cc0ce040 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009d90 tx=0x7ff9c402be20 comp rx=0 tx=0).stop 2023-08-09T12:45:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9d269f640 1 -- 172.21.15.17:0/1103851986 shutdown_connections 2023-08-09T12:45:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9d269f640 1 --2- 172.21.15.17:0/1103851986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0ccee0 0x7ff9cc0ce040 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9d269f640 1 -- 172.21.15.17:0/1103851986 >> 172.21.15.17:0/1103851986 conn(0x7ff9cc0cec00 msgr2=0x7ff9cc0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.185+0000 7ff9d269f640 1 -- 172.21.15.17:0/1103851986 shutdown_connections 2023-08-09T12:45:33.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.186+0000 7ff9d269f640 1 -- 172.21.15.17:0/1103851986 wait complete. 2023-08-09T12:45:33.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.187+0000 7ff9d269f640 1 Processor -- start 2023-08-09T12:45:33.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.187+0000 7ff9d269f640 1 -- start start 2023-08-09T12:45:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.188+0000 7ff9d269f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc0c9330 0x7ff9cc06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:33.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d269f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ccee0 0x7ff9cc1f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:33.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d269f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc160ea0 0x7ff9cc06b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:33.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d269f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc06b530 con 0x7ff9cc160ea0 2023-08-09T12:45:33.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d269f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc15dd90 con 0x7ff9cc0c9330 2023-08-09T12:45:33.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d269f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc06a8b0 con 0x7ff9cc0ccee0 2023-08-09T12:45:33.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d1e9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc160ea0 0x7ff9cc06b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:33.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d1e9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc160ea0 0x7ff9cc06b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42306/0 (socket says 172.21.15.17:42306) 2023-08-09T12:45:33.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d1e9e640 1 -- 172.21.15.17:0/2583589204 learned_addr learned my addr 172.21.15.17:0/2583589204 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:33.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d0e9c640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ccee0 0x7ff9cc1f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:33.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d1e9e640 1 -- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ccee0 msgr2=0x7ff9cc1f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:33.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d169d640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc0c9330 0x7ff9cc06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:33.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d1e9e640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ccee0 0x7ff9cc1f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:33.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d1e9e640 1 -- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc0c9330 msgr2=0x7ff9cc06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d1e9e640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc0c9330 0x7ff9cc06f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d1e9e640 1 -- 172.21.15.17:0/2583589204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4009a70 con 0x7ff9cc160ea0 2023-08-09T12:45:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d0e9c640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ccee0 0x7ff9cc1f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.189+0000 7ff9d169d640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc0c9330 0x7ff9cc06f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.190+0000 7ff9d1e9e640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc160ea0 0x7ff9cc06b950 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009d90 tx=0x7ff9c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.190+0000 7ff9c1ffb640 1 -- 172.21.15.17:0/2583589204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c402cea0 con 0x7ff9cc160ea0 2023-08-09T12:45:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.190+0000 7ff9c1ffb640 1 -- 172.21.15.17:0/2583589204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4040450 con 0x7ff9cc160ea0 2023-08-09T12:45:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.190+0000 7ff9c1ffb640 1 -- 172.21.15.17:0/2583589204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40407e0 con 0x7ff9cc160ea0 2023-08-09T12:45:33.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.190+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc06ab90 con 0x7ff9cc160ea0 2023-08-09T12:45:33.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.190+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc06b150 con 0x7ff9cc160ea0 2023-08-09T12:45:33.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.192+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc06b670 con 0x7ff9cc160ea0 2023-08-09T12:45:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.192+0000 7ff9c1ffb640 1 -- 172.21.15.17:0/2583589204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff9c4040940 con 0x7ff9cc160ea0 2023-08-09T12:45:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.193+0000 7ff9c1ffb640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.194+0000 7ff9c1ffb640 1 -- 172.21.15.17:0/2583589204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff9c40aac70 con 0x7ff9cc160ea0 2023-08-09T12:45:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.194+0000 7ff9d169d640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:33.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.195+0000 7ff9d169d640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80010e0 tx=0x7ff9c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.198+0000 7ff9c1ffb640 1 -- 172.21.15.17:0/2583589204 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff9cc06b670 con 0x7ff9cc160ea0 2023-08-09T12:45:33.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.458+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7ff9cc06b670 con 0x7ff9cc160ea0 2023-08-09T12:45:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.924+0000 7ff9c1ffb640 1 -- 172.21.15.17:0/2583589204 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v321) v1 ==== 140+0+0 (secure 0 0 0) 0x7ff9cc06b670 con 0x7ff9cc160ea0 2023-08-09T12:45:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 msgr2=0x7ff9b006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80010e0 tx=0x7ff9c8009040 comp rx=0 tx=0).stop 2023-08-09T12:45:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc160ea0 msgr2=0x7ff9cc06b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc160ea0 0x7ff9cc06b950 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009d90 tx=0x7ff9c4004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 shutdown_connections 2023-08-09T12:45:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc160ea0 0x7ff9cc06b950 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ccee0 0x7ff9cc1f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 --2- 172.21.15.17:0/2583589204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc0c9330 0x7ff9cc06f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 >> 172.21.15.17:0/2583589204 conn(0x7ff9cc0cec00 msgr2=0x7ff9cc160490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.928+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 shutdown_connections 2023-08-09T12:45:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:33.929+0000 7ff9d269f640 1 -- 172.21.15.17:0/2583589204 wait complete. 2023-08-09T12:45:33.955 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-08-09T12:45:34.201 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_objectstore":"memstore"} 2023-08-09T12:45:34.202 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-08-09T12:45:34.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.432+0000 7f3b06038640 1 Processor -- start 2023-08-09T12:45:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.432+0000 7f3b06038640 1 -- start start 2023-08-09T12:45:34.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.434+0000 7f3b06038640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b000b3b40 0x7f3b000b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.434+0000 7f3b06038640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0006c990 con 0x7f3b000adc40 2023-08-09T12:45:34.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.434+0000 7f3b06038640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b2250 con 0x7f3b000cc630 2023-08-09T12:45:34.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.434+0000 7f3b06038640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000ae020 con 0x7f3b000b3b40 2023-08-09T12:45:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.435+0000 7f3aff7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3b000adc40 0x7f3b0006c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54532/0 (socket says 172.21.15.17:54532) 2023-08-09T12:45:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.435+0000 7f3aff7fe640 1 -- 172.21.15.17:0/1308017616 learned_addr learned my addr 172.21.15.17:0/1308017616 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.435+0000 7f3afeffd640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b000b3b40 0x7f3b000b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.435+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956228426 0 0) 0x7f3b0006c990 con 0x7f3b000adc40 2023-08-09T12:45:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.435+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae8003520 con 0x7f3b000adc40 2023-08-09T12:45:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3561557085 0 0) 0x7f3ae8003520 con 0x7f3b000adc40 2023-08-09T12:45:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b000b3b40 msgr2=0x7f3b000b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b000b3b40 0x7f3b000b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 >> v1:172.21.15.142:6789/0 conn(0x7f3b000cc630 legacy=0x7f3b000ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000b2530 con 0x7f3b000adc40 2023-08-09T12:45:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f3af0001670 con 0x7f3b000adc40 2023-08-09T12:45:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 >> v1:172.21.15.17:6789/0 conn(0x7f3b000adc40 legacy=0x7f3b0006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b000b3b40 0x7f3ae80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3ae80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae8004d00 0x7f3ae8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000ae020 con 0x7f3ae8003f20 2023-08-09T12:45:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae800ba60 con 0x7f3ae8004d00 2023-08-09T12:45:34.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae800bc20 con 0x7f3b000b3b40 2023-08-09T12:45:34.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3afeffd640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3ae80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.436+0000 7f3aff7fe640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b000b3b40 0x7f3ae80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.437+0000 7f3afffff640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae8004d00 0x7f3ae8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.437+0000 7f3afeffd640 1 -- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b000b3b40 msgr2=0x7f3ae80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.437+0000 7f3afeffd640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b000b3b40 0x7f3ae80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.437+0000 7f3afeffd640 1 -- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae8004d00 msgr2=0x7f3ae8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.437+0000 7f3afeffd640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae8004d00 0x7f3ae8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.437+0000 7f3afeffd640 1 -- 172.21.15.17:0/1308017616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae8003520 con 0x7f3ae8003f20 2023-08-09T12:45:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.437+0000 7f3afffff640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae8004d00 0x7f3ae8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.438+0000 7f3afeffd640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3ae80047c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009ab0 tx=0x7f3ae80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d1bdb930b6d561 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.438+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4005990 con 0x7f3ae8003f20 2023-08-09T12:45:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.438+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af4005af0 con 0x7f3ae8003f20 2023-08-09T12:45:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.438+0000 7f3afe7fc640 1 -- 172.21.15.17:0/1308017616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4005ea0 con 0x7f3ae8003f20 2023-08-09T12:45:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.439+0000 7f3b06038640 1 -- 172.21.15.17:0/1308017616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 msgr2=0x7f3ae80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.439+0000 7f3b06038640 1 --2- 172.21.15.17:0/1308017616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3ae80047c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009ab0 tx=0x7f3ae80057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.439+0000 7f3afffff640 1 -- 172.21.15.17:0/1308017616 reap_dead start 2023-08-09T12:45:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.439+0000 7f3b06038640 1 -- 172.21.15.17:0/1308017616 shutdown_connections 2023-08-09T12:45:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.439+0000 7f3b06038640 1 -- 172.21.15.17:0/1308017616 >> 172.21.15.17:0/1308017616 conn(0x7f3b000cb1b0 msgr2=0x7f3b000cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.439+0000 7f3b06038640 1 -- 172.21.15.17:0/1308017616 shutdown_connections 2023-08-09T12:45:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.439+0000 7f3b06038640 1 -- 172.21.15.17:0/1308017616 wait complete. 2023-08-09T12:45:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.441+0000 7f3b06038640 1 Processor -- start 2023-08-09T12:45:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.441+0000 7f3b06038640 1 -- start start 2023-08-09T12:45:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3b06038640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3b000c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3b06038640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0006b3c0 0x7f3b00148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3b06038640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0006b840 0x7f3b00148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3b06038640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000c2ca0 con 0x7f3ae8003f20 2023-08-09T12:45:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3b06038640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000cad00 con 0x7f3b0006b3c0 2023-08-09T12:45:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3b06038640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000c2300 con 0x7f3b0006b840 2023-08-09T12:45:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3aff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3b000c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3aff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3b000c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42318/0 (socket says 172.21.15.17:42318) 2023-08-09T12:45:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.442+0000 7f3aff7fe640 1 -- 172.21.15.17:0/3952184703 learned_addr learned my addr 172.21.15.17:0/3952184703 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3aff7fe640 1 -- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0006b840 msgr2=0x7f3b00148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3aff7fe640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0006b840 0x7f3b00148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3aff7fe640 1 -- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0006b3c0 msgr2=0x7f3b00148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3aff7fe640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0006b3c0 0x7f3b00148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3aff7fe640 1 -- 172.21.15.17:0/3952184703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000c25e0 con 0x7f3ae8003f20 2023-08-09T12:45:34.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3aff7fe640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3b000c30c0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e7b0 tx=0x7f3af000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:34.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3ae7fff640 1 -- 172.21.15.17:0/3952184703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000c8d0 con 0x7f3ae8003f20 2023-08-09T12:45:34.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3ae7fff640 1 -- 172.21.15.17:0/3952184703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000ca50 con 0x7f3ae8003f20 2023-08-09T12:45:34.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3ae7fff640 1 -- 172.21.15.17:0/3952184703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000ce00 con 0x7f3ae8003f20 2023-08-09T12:45:34.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b000c28c0 con 0x7f3ae8003f20 2023-08-09T12:45:34.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.443+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000c37e0 con 0x7f3ae8003f20 2023-08-09T12:45:34.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.445+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b000c2de0 con 0x7f3ae8003f20 2023-08-09T12:45:34.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.446+0000 7f3ae7fff640 1 -- 172.21.15.17:0/3952184703 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3af001d460 con 0x7f3ae8003f20 2023-08-09T12:45:34.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.446+0000 7f3ae7fff640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3aec06a050 0x7f3aec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.447+0000 7f3ae7fff640 1 -- 172.21.15.17:0/3952184703 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3af0088120 con 0x7f3ae8003f20 2023-08-09T12:45:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.447+0000 7f3afeffd640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3aec06a050 0x7f3aec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.448+0000 7f3afeffd640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3aec06a050 0x7f3aec06c510 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3af4035000 tx=0x7f3af402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.451+0000 7f3ae7fff640 1 -- 172.21.15.17:0/3952184703 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3b000c2de0 con 0x7f3ae8003f20 2023-08-09T12:45:34.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.650+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b000c37e0 con 0x7f3ae8003f20 2023-08-09T12:45:34.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.651+0000 7f3ae7fff640 1 -- 172.21.15.17:0/3952184703 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+14746 (secure 0 0 0) 0x7f3b000c37e0 con 0x7f3ae8003f20 2023-08-09T12:45:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:34.655 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":102,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:45:30.898822+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/4077789912":"2023-08-10T12:45:27.809225+0000","172.21.15.17:6833/4077789912":"2023-08-10T12:45:27.809225+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:34.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3aec06a050 msgr2=0x7f3aec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3aec06a050 0x7f3aec06c510 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3af4035000 tx=0x7f3af402e000 comp rx=0 tx=0).stop 2023-08-09T12:45:34.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 msgr2=0x7f3b000c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3b000c30c0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e7b0 tx=0x7f3af000ec70 comp rx=0 tx=0).stop 2023-08-09T12:45:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 shutdown_connections 2023-08-09T12:45:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3aec06a050 0x7f3aec06c510 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0006b840 0x7f3b00148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0006b3c0 0x7f3b00148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 --2- 172.21.15.17:0/3952184703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ae8003f20 0x7f3b000c30c0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 >> 172.21.15.17:0/3952184703 conn(0x7f3b000cb1b0 msgr2=0x7f3b00069850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 shutdown_connections 2023-08-09T12:45:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.654+0000 7f3b06038640 1 -- 172.21.15.17:0/3952184703 wait complete. 2023-08-09T12:45:34.678 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:45:34.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:45:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.912+0000 7fe629739640 1 Processor -- start 2023-08-09T12:45:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.913+0000 7fe629739640 1 -- start start 2023-08-09T12:45:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.914+0000 7fe629739640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe62415ccf0 0x7fe62406b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe629739640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6240cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe629739640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe624161390 con 0x7fe6240cb630 2023-08-09T12:45:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe629739640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6240cb3b0 con 0x7fe62415ccf0 2023-08-09T12:45:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe629739640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240ad010 con 0x7fe6240cd340 2023-08-09T12:45:34.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6240cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe6227fc640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe6240cb630 0x7fe6240ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:37868/0 (socket says 172.21.15.17:37868) 2023-08-09T12:45:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe6227fc640 1 -- 172.21.15.17:0/2505347304 learned_addr learned my addr 172.21.15.17:0/2505347304 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6240cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:59234/0 (socket says 172.21.15.17:59234) 2023-08-09T12:45:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.915+0000 7fe622ffd640 1 --2- 172.21.15.17:0/2505347304 >> v2:172.21.15.142:3300/0 conn(0x7fe62415ccf0 0x7fe62406b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.916+0000 7fe6237fe640 1 -- 172.21.15.17:0/2505347304 >> v2:172.21.15.142:3300/0 conn(0x7fe62415ccf0 msgr2=0x7fe62406b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.916+0000 7fe6237fe640 1 --2- 172.21.15.17:0/2505347304 >> v2:172.21.15.142:3300/0 conn(0x7fe62415ccf0 0x7fe62406b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.916+0000 7fe6237fe640 1 -- 172.21.15.17:0/2505347304 >> v1:172.21.15.142:6789/0 conn(0x7fe6240cb630 legacy=0x7fe6240ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.916+0000 7fe6237fe640 1 -- 172.21.15.17:0/2505347304 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6241618c0 con 0x7fe6240cd340 2023-08-09T12:45:34.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.918+0000 7fe6237fe640 1 --2- 172.21.15.17:0/2505347304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6240cae70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009d90 tx=0x7fe61c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4870fe4cc309428 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:34.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.918+0000 7fe621ffb640 1 -- 172.21.15.17:0/2505347304 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c02cc50 con 0x7fe6240cd340 2023-08-09T12:45:34.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.918+0000 7fe621ffb640 1 -- 172.21.15.17:0/2505347304 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c02cdb0 con 0x7fe6240cd340 2023-08-09T12:45:34.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.918+0000 7fe621ffb640 1 -- 172.21.15.17:0/2505347304 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c034660 con 0x7fe6240cd340 2023-08-09T12:45:34.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.919+0000 7fe629739640 1 -- 172.21.15.17:0/2505347304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 msgr2=0x7fe6240cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.919+0000 7fe629739640 1 --2- 172.21.15.17:0/2505347304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6240cae70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009d90 tx=0x7fe61c02bea0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.919+0000 7fe629739640 1 -- 172.21.15.17:0/2505347304 shutdown_connections 2023-08-09T12:45:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.919+0000 7fe629739640 1 --2- 172.21.15.17:0/2505347304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6240cae70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.919+0000 7fe629739640 1 --2- 172.21.15.17:0/2505347304 >> v2:172.21.15.142:3300/0 conn(0x7fe62415ccf0 0x7fe62406b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.919+0000 7fe629739640 1 -- 172.21.15.17:0/2505347304 >> 172.21.15.17:0/2505347304 conn(0x7fe6240cf060 msgr2=0x7fe6240cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.919+0000 7fe629739640 1 -- 172.21.15.17:0/2505347304 shutdown_connections 2023-08-09T12:45:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.919+0000 7fe629739640 1 -- 172.21.15.17:0/2505347304 wait complete. 2023-08-09T12:45:34.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.921+0000 7fe629739640 1 Processor -- start 2023-08-09T12:45:34.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.922+0000 7fe629739640 1 -- start start 2023-08-09T12:45:34.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.922+0000 7fe629739640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6240cb630 0x7fe6241f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe629739640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6241f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe629739640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62415ccf0 0x7fe6240aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe629739640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe624153010 con 0x7fe6240cb630 2023-08-09T12:45:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe629739640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6241f6c10 con 0x7fe62415ccf0 2023-08-09T12:45:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe629739640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240c2ca0 con 0x7fe6240cd340 2023-08-09T12:45:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe622ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6240cb630 0x7fe6241f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe622ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6240cb630 0x7fe6241f66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42334/0 (socket says 172.21.15.17:42334) 2023-08-09T12:45:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe622ffd640 1 -- 172.21.15.17:0/3254077744 learned_addr learned my addr 172.21.15.17:0/3254077744 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe6227fc640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6241f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe622ffd640 1 -- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 msgr2=0x7fe6241f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe622ffd640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6241f1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe622ffd640 1 -- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62415ccf0 msgr2=0x7fe6240aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe622ffd640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62415ccf0 0x7fe6240aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.923+0000 7fe622ffd640 1 -- 172.21.15.17:0/3254077744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c009a70 con 0x7fe6240cb630 2023-08-09T12:45:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.924+0000 7fe622ffd640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6240cb630 0x7fe6241f66d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe61400e870 tx=0x7fe61400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.924+0000 7fe60b7fe640 1 -- 172.21.15.17:0/3254077744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6140094f0 con 0x7fe6240cb630 2023-08-09T12:45:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.924+0000 7fe60b7fe640 1 -- 172.21.15.17:0/3254077744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61400c940 con 0x7fe6240cb630 2023-08-09T12:45:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.924+0000 7fe60b7fe640 1 -- 172.21.15.17:0/3254077744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400ccf0 con 0x7fe6240cb630 2023-08-09T12:45:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.924+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6240c2f80 con 0x7fe6240cb630 2023-08-09T12:45:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.924+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6240c3540 con 0x7fe6240cb630 2023-08-09T12:45:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.925+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe624067a80 con 0x7fe6240cb630 2023-08-09T12:45:34.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.926+0000 7fe60b7fe640 1 -- 172.21.15.17:0/3254077744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe614013470 con 0x7fe6240cb630 2023-08-09T12:45:34.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.927+0000 7fe60b7fe640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe61006a050 0x7fe61006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:34.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.927+0000 7fe60b7fe640 1 -- 172.21.15.17:0/3254077744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe614088300 con 0x7fe6240cb630 2023-08-09T12:45:34.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.928+0000 7fe6227fc640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe61006a050 0x7fe61006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:34.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.929+0000 7fe6227fc640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe61006a050 0x7fe61006c510 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe6240c75d0 tx=0x7fe618009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:34.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:34.932+0000 7fe60b7fe640 1 -- 172.21.15.17:0/3254077744 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe614053d80 con 0x7fe6240cb630 2023-08-09T12:45:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.127+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6240b4fe0 con 0x7fe6240cb630 2023-08-09T12:45:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.128+0000 7fe60b7fe640 1 -- 172.21.15.17:0/3254077744 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6140573a0 con 0x7fe6240cb630 2023-08-09T12:45:35.133 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:45:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.130+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe61006a050 msgr2=0x7fe61006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.130+0000 7fe629739640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe61006a050 0x7fe61006c510 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe6240c75d0 tx=0x7fe618009040 comp rx=0 tx=0).stop 2023-08-09T12:45:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.130+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6240cb630 msgr2=0x7fe6241f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.130+0000 7fe629739640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6240cb630 0x7fe6241f66d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe61400e870 tx=0x7fe61400ed30 comp rx=0 tx=0).stop 2023-08-09T12:45:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.131+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 shutdown_connections 2023-08-09T12:45:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.131+0000 7fe629739640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe61006a050 0x7fe61006c510 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.131+0000 7fe629739640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe62415ccf0 0x7fe6240aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.131+0000 7fe629739640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6240cd340 0x7fe6241f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.131+0000 7fe629739640 1 --2- 172.21.15.17:0/3254077744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6240cb630 0x7fe6241f66d0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.131+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 >> 172.21.15.17:0/3254077744 conn(0x7fe6240cf060 msgr2=0x7fe62415c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.131+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 shutdown_connections 2023-08-09T12:45:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.131+0000 7fe629739640 1 -- 172.21.15.17:0/3254077744 wait complete. 2023-08-09T12:45:35.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:45:35.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.379+0000 7f91ec964640 1 Processor -- start 2023-08-09T12:45:35.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.379+0000 7f91ec964640 1 -- start start 2023-08-09T12:45:35.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.380+0000 7f91ec964640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91e80d30e0 0x7f91e80b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.381+0000 7f91ec964640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80cdd10 con 0x7f91e815ce90 2023-08-09T12:45:35.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.381+0000 7f91ec964640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80cdff0 con 0x7f91e81616e0 2023-08-09T12:45:35.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.381+0000 7f91ec964640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80b6540 con 0x7f91e80d30e0 2023-08-09T12:45:35.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.381+0000 7f91e659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f91e815ce90 0x7f91e80cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54536/0 (socket says 172.21.15.17:54536) 2023-08-09T12:45:35.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.381+0000 7f91e659c640 1 -- 172.21.15.17:0/469691311 learned_addr learned my addr 172.21.15.17:0/469691311 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:35.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.381+0000 7f91e6d9d640 1 --2- 172.21.15.17:0/469691311 >> v2:172.21.15.142:3300/0 conn(0x7f91e80d30e0 0x7f91e80b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.381+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065525341 0 0) 0x7f91e80cdd10 con 0x7f91e815ce90 2023-08-09T12:45:35.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d4003520 con 0x7f91e815ce90 2023-08-09T12:45:35.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3329052214 0 0) 0x7f91d4003520 con 0x7f91e815ce90 2023-08-09T12:45:35.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 >> v2:172.21.15.142:3300/0 conn(0x7f91e80d30e0 msgr2=0x7f91e80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:35.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 --2- 172.21.15.17:0/469691311 >> v2:172.21.15.142:3300/0 conn(0x7f91e80d30e0 0x7f91e80b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 >> v1:172.21.15.142:6789/0 conn(0x7f91e81616e0 legacy=0x7f91e80d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80ce2d0 con 0x7f91e815ce90 2023-08-09T12:45:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f91d8001670 con 0x7f91e815ce90 2023-08-09T12:45:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 >> v1:172.21.15.17:6789/0 conn(0x7f91e815ce90 legacy=0x7f91e80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d4003970 0x7f91d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d40047c0 0x7f91d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d4005180 0x7f91d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80b6540 con 0x7f91d4005180 2023-08-09T12:45:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d400c020 con 0x7f91d40047c0 2023-08-09T12:45:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.382+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d400c1e0 con 0x7f91d4003970 2023-08-09T12:45:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e6d9d640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d4005180 0x7f91d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e659c640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d4003970 0x7f91d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e6d9d640 1 -- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d4003970 msgr2=0x7f91d4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e6d9d640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d4003970 0x7f91d4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e6d9d640 1 -- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d40047c0 msgr2=0x7f91d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e5d9b640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d40047c0 0x7f91d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e6d9d640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d40047c0 0x7f91d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e6d9d640 1 -- 172.21.15.17:0/469691311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4003520 con 0x7f91d4005180 2023-08-09T12:45:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e5d9b640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d40047c0 0x7f91d4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.383+0000 7f91e659c640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d4003970 0x7f91d4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.384+0000 7f91e6d9d640 1 -- 172.21.15.17:0/469691311 reap_dead start 2023-08-09T12:45:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.384+0000 7f91e6d9d640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d4005180 0x7f91d400b980 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009a90 tx=0x7f91d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c81f937203f2fc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.384+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0004020 con 0x7f91d4005180 2023-08-09T12:45:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.384+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0004180 con 0x7f91d4005180 2023-08-09T12:45:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.384+0000 7f91e559a640 1 -- 172.21.15.17:0/469691311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e002c6d0 con 0x7f91d4005180 2023-08-09T12:45:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.385+0000 7f91ec964640 1 -- 172.21.15.17:0/469691311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d4005180 msgr2=0x7f91d400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.385+0000 7f91ec964640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d4005180 0x7f91d400b980 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009a90 tx=0x7f91d40057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.385+0000 7f91ec964640 1 -- 172.21.15.17:0/469691311 shutdown_connections 2023-08-09T12:45:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.385+0000 7f91ec964640 1 --2- 172.21.15.17:0/469691311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d4005180 0x7f91d400b980 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.385+0000 7f91ec964640 1 -- 172.21.15.17:0/469691311 >> 172.21.15.17:0/469691311 conn(0x7f91e806fde0 msgr2=0x7f91e80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:35.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.385+0000 7f91ec964640 1 -- 172.21.15.17:0/469691311 shutdown_connections 2023-08-09T12:45:35.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.385+0000 7f91ec964640 1 -- 172.21.15.17:0/469691311 wait complete. 2023-08-09T12:45:35.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.387+0000 7f91ec964640 1 Processor -- start 2023-08-09T12:45:35.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.387+0000 7f91ec964640 1 -- start start 2023-08-09T12:45:35.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.388+0000 7f91ec964640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d4005180 0x7f91e80c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.388+0000 7f91ec964640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e815ffc0 0x7f91e815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.388+0000 7f91ec964640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e815e510 0x7f91e80b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.388+0000 7f91ec964640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81f0390 con 0x7f91e815ffc0 2023-08-09T12:45:35.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.388+0000 7f91ec964640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e815ef20 con 0x7f91d4005180 2023-08-09T12:45:35.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.388+0000 7f91ec964640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e815f200 con 0x7f91e815e510 2023-08-09T12:45:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e815ffc0 0x7f91e815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e815ffc0 0x7f91e815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42360/0 (socket says 172.21.15.17:42360) 2023-08-09T12:45:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e5d9b640 1 -- 172.21.15.17:0/3440990241 learned_addr learned my addr 172.21.15.17:0/3440990241 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e6d9d640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e815e510 0x7f91e80b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e659c640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d4005180 0x7f91e80c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e5d9b640 1 -- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e815e510 msgr2=0x7f91e80b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e5d9b640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e815e510 0x7f91e80b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e5d9b640 1 -- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d4005180 msgr2=0x7f91e80c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e5d9b640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d4005180 0x7f91e80c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.389+0000 7f91e5d9b640 1 -- 172.21.15.17:0/3440990241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e815f4e0 con 0x7f91e815ffc0 2023-08-09T12:45:35.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.390+0000 7f91e5d9b640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e815ffc0 0x7f91e815dfd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f91d000d8b0 tx=0x7f91d000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:35.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.390+0000 7f91deffd640 1 -- 172.21.15.17:0/3440990241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0003da0 con 0x7f91e815ffc0 2023-08-09T12:45:35.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.390+0000 7f91deffd640 1 -- 172.21.15.17:0/3440990241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d000b6b0 con 0x7f91e815ffc0 2023-08-09T12:45:35.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.390+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e815f7c0 con 0x7f91e815ffc0 2023-08-09T12:45:35.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.390+0000 7f91deffd640 1 -- 172.21.15.17:0/3440990241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000ba80 con 0x7f91e815ffc0 2023-08-09T12:45:35.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.390+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e81f2b60 con 0x7f91e815ffc0 2023-08-09T12:45:35.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.391+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e8067a80 con 0x7f91e815ffc0 2023-08-09T12:45:35.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.392+0000 7f91deffd640 1 -- 172.21.15.17:0/3440990241 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91d000bbe0 con 0x7f91e815ffc0 2023-08-09T12:45:35.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.394+0000 7f91deffd640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c806a050 0x7f91c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.394+0000 7f91deffd640 1 -- 172.21.15.17:0/3440990241 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f91d00885b0 con 0x7f91e815ffc0 2023-08-09T12:45:35.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.394+0000 7f91e659c640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c806a050 0x7f91c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.395+0000 7f91e659c640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c806a050 0x7f91c806c510 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f91d8001eb0 tx=0x7f91d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:35.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.398+0000 7f91deffd640 1 -- 172.21.15.17:0/3440990241 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f91d0053f20 con 0x7f91e815ffc0 2023-08-09T12:45:35.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.616+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91e80d0ad0 con 0x7f91e815ffc0 2023-08-09T12:45:35.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.617+0000 7f91deffd640 1 -- 172.21.15.17:0/3440990241 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f91d0057540 con 0x7f91e815ffc0 2023-08-09T12:45:35.620 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:45:35.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c806a050 msgr2=0x7f91c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c806a050 0x7f91c806c510 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f91d8001eb0 tx=0x7f91d8009040 comp rx=0 tx=0).stop 2023-08-09T12:45:35.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e815ffc0 msgr2=0x7f91e815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e815ffc0 0x7f91e815dfd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f91d000d8b0 tx=0x7f91d000dd70 comp rx=0 tx=0).stop 2023-08-09T12:45:35.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 shutdown_connections 2023-08-09T12:45:35.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c806a050 0x7f91c806c510 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e815e510 0x7f91e80b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e815ffc0 0x7f91e815dfd0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.619+0000 7f91ec964640 1 --2- 172.21.15.17:0/3440990241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d4005180 0x7f91e80c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.620+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 >> 172.21.15.17:0/3440990241 conn(0x7f91e806fde0 msgr2=0x7f91e815ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.620+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 shutdown_connections 2023-08-09T12:45:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.620+0000 7f91ec964640 1 -- 172.21.15.17:0/3440990241 wait complete. 2023-08-09T12:45:35.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:45:35.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.870+0000 7f289114b640 1 Processor -- start 2023-08-09T12:45:35.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.870+0000 7f289114b640 1 -- start start 2023-08-09T12:45:35.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.871+0000 7f289114b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c15cef0 0x7f288c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.871+0000 7f289114b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f288c15d2d0 0x7f288c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.871+0000 7f289114b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288c0b2010 con 0x7f288c1616b0 2023-08-09T12:45:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.871+0000 7f289114b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c0cdee0 con 0x7f288c15d2d0 2023-08-09T12:45:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.871+0000 7f289114b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0b1d30 con 0x7f288c15cef0 2023-08-09T12:45:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.872+0000 7f288ad9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c15cef0 0x7f288c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.872+0000 7f288ad9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c15cef0 0x7f288c0b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:59276/0 (socket says 172.21.15.17:59276) 2023-08-09T12:45:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.872+0000 7f288ad9d640 1 -- 172.21.15.17:0/1245235088 learned_addr learned my addr 172.21.15.17:0/1245235088 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.872+0000 7f288a59c640 1 --2- 172.21.15.17:0/1245235088 >> v2:172.21.15.142:3300/0 conn(0x7f288c15d2d0 0x7f288c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.873+0000 7f288ad9d640 1 -- 172.21.15.17:0/1245235088 >> v2:172.21.15.142:3300/0 conn(0x7f288c15d2d0 msgr2=0x7f288c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.873+0000 7f288ad9d640 1 --2- 172.21.15.17:0/1245235088 >> v2:172.21.15.142:3300/0 conn(0x7f288c15d2d0 0x7f288c0ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.873+0000 7f288ad9d640 1 -- 172.21.15.17:0/1245235088 >> v1:172.21.15.142:6789/0 conn(0x7f288c1616b0 legacy=0x7f288c0cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.873+0000 7f288ad9d640 1 -- 172.21.15.17:0/1245235088 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0cd820 con 0x7f288c15cef0 2023-08-09T12:45:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.874+0000 7f288ad9d640 1 --2- 172.21.15.17:0/1245235088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c15cef0 0x7f288c0b1750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f287c009e50 tx=0x7f287c02be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17234763bdbb284b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.875+0000 7f2889d9b640 1 -- 172.21.15.17:0/1245235088 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c02c9f0 con 0x7f288c15cef0 2023-08-09T12:45:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.875+0000 7f2889d9b640 1 -- 172.21.15.17:0/1245235088 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c02cb50 con 0x7f288c15cef0 2023-08-09T12:45:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.875+0000 7f2889d9b640 1 -- 172.21.15.17:0/1245235088 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0343f0 con 0x7f288c15cef0 2023-08-09T12:45:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.876+0000 7f289114b640 1 -- 172.21.15.17:0/1245235088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c15cef0 msgr2=0x7f288c0b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.876+0000 7f289114b640 1 --2- 172.21.15.17:0/1245235088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c15cef0 0x7f288c0b1750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f287c009e50 tx=0x7f287c02be50 comp rx=0 tx=0).stop 2023-08-09T12:45:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.876+0000 7f289114b640 1 -- 172.21.15.17:0/1245235088 shutdown_connections 2023-08-09T12:45:35.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.876+0000 7f289114b640 1 --2- 172.21.15.17:0/1245235088 >> v2:172.21.15.142:3300/0 conn(0x7f288c15d2d0 0x7f288c0ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.876+0000 7f289114b640 1 --2- 172.21.15.17:0/1245235088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c15cef0 0x7f288c0b1750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.876+0000 7f289114b640 1 -- 172.21.15.17:0/1245235088 >> 172.21.15.17:0/1245235088 conn(0x7f288c06fde0 msgr2=0x7f288c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:35.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.876+0000 7f289114b640 1 -- 172.21.15.17:0/1245235088 shutdown_connections 2023-08-09T12:45:35.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.876+0000 7f289114b640 1 -- 172.21.15.17:0/1245235088 wait complete. 2023-08-09T12:45:35.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.878+0000 7f289114b640 1 Processor -- start 2023-08-09T12:45:35.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.878+0000 7f289114b640 1 -- start start 2023-08-09T12:45:35.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f289114b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c15cef0 0x7f288c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f289114b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f288c15d2d0 0x7f288c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f289114b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c1616b0 0x7f288c0c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f289114b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c151fc0 con 0x7f288c15cef0 2023-08-09T12:45:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f289114b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0c78f0 con 0x7f288c15d2d0 2023-08-09T12:45:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f289114b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0c83f0 con 0x7f288c1616b0 2023-08-09T12:45:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f288ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c15cef0 0x7f288c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f288ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c15cef0 0x7f288c0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42372/0 (socket says 172.21.15.17:42372) 2023-08-09T12:45:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.879+0000 7f288ad9d640 1 -- 172.21.15.17:0/115816730 learned_addr learned my addr 172.21.15.17:0/115816730 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:35.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288a59c640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f288c15d2d0 0x7f288c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288b59e640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c1616b0 0x7f288c0c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288ad9d640 1 -- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c1616b0 msgr2=0x7f288c0c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288ad9d640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c1616b0 0x7f288c0c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288ad9d640 1 -- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f288c15d2d0 msgr2=0x7f288c151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288ad9d640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f288c15d2d0 0x7f288c151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288ad9d640 1 -- 172.21.15.17:0/115816730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c009b30 con 0x7f288c15cef0 2023-08-09T12:45:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288a59c640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f288c15d2d0 0x7f288c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288b59e640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c1616b0 0x7f288c0c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f288ad9d640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c15cef0 0x7f288c0c7cf0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f287c000f80 tx=0x7f287c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.880+0000 7f28837fe640 1 -- 172.21.15.17:0/115816730 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c03e450 con 0x7f288c15cef0 2023-08-09T12:45:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.881+0000 7f28837fe640 1 -- 172.21.15.17:0/115816730 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c03e5f0 con 0x7f288c15cef0 2023-08-09T12:45:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.881+0000 7f28837fe640 1 -- 172.21.15.17:0/115816730 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c03e9a0 con 0x7f288c15cef0 2023-08-09T12:45:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.881+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c0c86d0 con 0x7f288c15cef0 2023-08-09T12:45:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.881+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c0c8c90 con 0x7f288c15cef0 2023-08-09T12:45:35.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.882+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c067a80 con 0x7f288c15cef0 2023-08-09T12:45:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.883+0000 7f28837fe640 1 -- 172.21.15.17:0/115816730 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f287c03eb00 con 0x7f288c15cef0 2023-08-09T12:45:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.884+0000 7f28837fe640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f286c06a050 0x7f286c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.884+0000 7f28837fe640 1 -- 172.21.15.17:0/115816730 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f287c0ab130 con 0x7f288c15cef0 2023-08-09T12:45:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.884+0000 7f288a59c640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f286c06a050 0x7f286c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.885+0000 7f288a59c640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f286c06a050 0x7f286c06c510 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f288c0b57c0 tx=0x7f2874008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:35.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:35.888+0000 7f28837fe640 1 -- 172.21.15.17:0/115816730 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f287c076c70 con 0x7f288c15cef0 2023-08-09T12:45:36.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.087+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f288c0d0ae0 con 0x7f288c15cef0 2023-08-09T12:45:36.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.096+0000 7f28837fe640 1 -- 172.21.15.17:0/115816730 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f287c03edb0 con 0x7f288c15cef0 2023-08-09T12:45:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f286c06a050 msgr2=0x7f286c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f286c06a050 0x7f286c06c510 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f288c0b57c0 tx=0x7f2874008040 comp rx=0 tx=0).stop 2023-08-09T12:45:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c15cef0 msgr2=0x7f288c0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c15cef0 0x7f288c0c7cf0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f287c000f80 tx=0x7f287c004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 shutdown_connections 2023-08-09T12:45:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f286c06a050 0x7f286c06c510 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f288c1616b0 0x7f288c0c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f288c15d2d0 0x7f288c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.098+0000 7f289114b640 1 --2- 172.21.15.17:0/115816730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c15cef0 0x7f288c0c7cf0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.099+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 >> 172.21.15.17:0/115816730 conn(0x7f288c06fde0 msgr2=0x7f288c0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.099+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 shutdown_connections 2023-08-09T12:45:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.099+0000 7f289114b640 1 -- 172.21.15.17:0/115816730 wait complete. 2023-08-09T12:45:36.121 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:45:36.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:45:36.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:45:36.356 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:45:36.357 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:45:36.357 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:36.423 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:45:36.424 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:45:36.424 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:36.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:45:36.484 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:45:36.485 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:36.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:45:36.549 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:45:36.550 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:36.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:45:36.609 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:45:36.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:45:36.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.849+0000 7fbbff00f640 1 Processor -- start 2023-08-09T12:45:36.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.849+0000 7fbbff00f640 1 -- start start 2023-08-09T12:45:36.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.851+0000 7fbbff00f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf8070f00 0x7fbbf815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:36.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.851+0000 7fbbff00f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbbf815bce0 0x7fbbf80cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:36.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.851+0000 7fbbff00f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf8071340 con 0x7fbbf81587e0 2023-08-09T12:45:36.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.851+0000 7fbbff00f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf80715c0 con 0x7fbbf815bce0 2023-08-09T12:45:36.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.851+0000 7fbbff00f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80718a0 con 0x7fbbf8070f00 2023-08-09T12:45:36.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.851+0000 7fbbfe00d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fbbf81587e0 0x7fbbf80b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54548/0 (socket says 172.21.15.17:54548) 2023-08-09T12:45:36.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.851+0000 7fbbfe00d640 1 -- 172.21.15.17:0/2337270478 learned_addr learned my addr 172.21.15.17:0/2337270478 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:36.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.851+0000 7fbbfe80e640 1 --2- 172.21.15.17:0/2337270478 >> v2:172.21.15.17:3300/0 conn(0x7fbbf815bce0 0x7fbbf80cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:36.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.852+0000 7fbbfd80c640 1 --2- 172.21.15.17:0/2337270478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf8070f00 0x7fbbf815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:36.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.852+0000 7fbbfd00b640 1 -- 172.21.15.17:0/2337270478 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219918026 0 0) 0x7fbbf8071340 con 0x7fbbf81587e0 2023-08-09T12:45:36.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.852+0000 7fbbfd00b640 1 -- 172.21.15.17:0/2337270478 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe4003520 con 0x7fbbf81587e0 2023-08-09T12:45:36.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.852+0000 7fbbfe80e640 1 -- 172.21.15.17:0/2337270478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf8070f00 msgr2=0x7fbbf815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:36.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.852+0000 7fbbfe80e640 1 --2- 172.21.15.17:0/2337270478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf8070f00 0x7fbbf815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.852+0000 7fbbfe80e640 1 -- 172.21.15.17:0/2337270478 >> v1:172.21.15.17:6789/0 conn(0x7fbbf81587e0 legacy=0x7fbbf80b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:36.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.852+0000 7fbbfe80e640 1 -- 172.21.15.17:0/2337270478 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8071b80 con 0x7fbbf815bce0 2023-08-09T12:45:36.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.853+0000 7fbbfe80e640 1 --2- 172.21.15.17:0/2337270478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf815bce0 0x7fbbf80cb070 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009d90 tx=0x7fbbf002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b83288a71e87dd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:36.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.853+0000 7fbbfd00b640 1 -- 172.21.15.17:0/2337270478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf002cc60 con 0x7fbbf815bce0 2023-08-09T12:45:36.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbfd00b640 1 -- 172.21.15.17:0/2337270478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf002cdc0 con 0x7fbbf815bce0 2023-08-09T12:45:36.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbfd00b640 1 -- 172.21.15.17:0/2337270478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0034640 con 0x7fbbf815bce0 2023-08-09T12:45:36.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbff00f640 1 -- 172.21.15.17:0/2337270478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf815bce0 msgr2=0x7fbbf80cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbff00f640 1 --2- 172.21.15.17:0/2337270478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf815bce0 0x7fbbf80cb070 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009d90 tx=0x7fbbf002beb0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbff00f640 1 -- 172.21.15.17:0/2337270478 shutdown_connections 2023-08-09T12:45:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbff00f640 1 --2- 172.21.15.17:0/2337270478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf815bce0 0x7fbbf80cb070 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbff00f640 1 --2- 172.21.15.17:0/2337270478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf8070f00 0x7fbbf815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbff00f640 1 -- 172.21.15.17:0/2337270478 >> 172.21.15.17:0/2337270478 conn(0x7fbbf80b1d50 msgr2=0x7fbbf806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbff00f640 1 -- 172.21.15.17:0/2337270478 shutdown_connections 2023-08-09T12:45:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.854+0000 7fbbff00f640 1 -- 172.21.15.17:0/2337270478 wait complete. 2023-08-09T12:45:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.856+0000 7fbbff00f640 1 Processor -- start 2023-08-09T12:45:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.856+0000 7fbbff00f640 1 -- start start 2023-08-09T12:45:36.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.857+0000 7fbbff00f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf8070f00 0x7fbbf814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:36.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.857+0000 7fbbff00f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf81587e0 0x7fbbf815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:36.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.857+0000 7fbbff00f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbf815a740 0x7fbbf80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:36.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.857+0000 7fbbff00f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80c6570 con 0x7fbbf8070f00 2023-08-09T12:45:36.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.857+0000 7fbbff00f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80c5960 con 0x7fbbf815a740 2023-08-09T12:45:36.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.857+0000 7fbbff00f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80c5c40 con 0x7fbbf81587e0 2023-08-09T12:45:36.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.857+0000 7fbbfe00d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf8070f00 0x7fbbf814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.858+0000 7fbbfe00d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf8070f00 0x7fbbf814c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42388/0 (socket says 172.21.15.17:42388) 2023-08-09T12:45:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.858+0000 7fbbfe00d640 1 -- 172.21.15.17:0/589421508 learned_addr learned my addr 172.21.15.17:0/589421508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.858+0000 7fbbfe00d640 1 -- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf81587e0 msgr2=0x7fbbf815a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:36.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.858+0000 7fbbfe00d640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf81587e0 0x7fbbf815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.858+0000 7fbbfe00d640 1 -- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbf815a740 msgr2=0x7fbbf80cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:36.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.858+0000 7fbbfe00d640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbf815a740 0x7fbbf80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:36.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.858+0000 7fbbfe00d640 1 -- 172.21.15.17:0/589421508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf0009a70 con 0x7fbbf8070f00 2023-08-09T12:45:36.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.858+0000 7fbbfe00d640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf8070f00 0x7fbbf814c9d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400c430 tx=0x7fbbf400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:36.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.859+0000 7fbbeeffd640 1 -- 172.21.15.17:0/589421508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4005ce0 con 0x7fbbf8070f00 2023-08-09T12:45:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.859+0000 7fbbeeffd640 1 -- 172.21.15.17:0/589421508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf4005e40 con 0x7fbbf8070f00 2023-08-09T12:45:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.859+0000 7fbbeeffd640 1 -- 172.21.15.17:0/589421508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40072f0 con 0x7fbbf8070f00 2023-08-09T12:45:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.859+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf80c5f20 con 0x7fbbf8070f00 2023-08-09T12:45:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.859+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf80c8360 con 0x7fbbf8070f00 2023-08-09T12:45:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.860+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf80c8520 con 0x7fbbf8070f00 2023-08-09T12:45:36.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.861+0000 7fbbeeffd640 1 -- 172.21.15.17:0/589421508 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbbf4007450 con 0x7fbbf8070f00 2023-08-09T12:45:36.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.862+0000 7fbbeeffd640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbdc06a050 0x7fbbdc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:36.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.862+0000 7fbbeeffd640 1 -- 172.21.15.17:0/589421508 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbbf4087990 con 0x7fbbf8070f00 2023-08-09T12:45:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.863+0000 7fbbfd80c640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbdc06a050 0x7fbbdc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:36.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.864+0000 7fbbfd80c640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbdc06a050 0x7fbbdc06c510 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbbf806ece0 tx=0x7fbbe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:36.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:36.867+0000 7fbbeeffd640 1 -- 172.21.15.17:0/589421508 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbbf4053300 con 0x7fbbf8070f00 2023-08-09T12:45:37.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.103+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbf806fa10 con 0x7fbbf8070f00 2023-08-09T12:45:37.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.105+0000 7fbbeeffd640 1 -- 172.21.15.17:0/589421508 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fbbf806fa10 con 0x7fbbf8070f00 2023-08-09T12:45:37.108 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2093028023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2093028023},{"type":"v1","addr":"172.21.15.142:6835","nonce":2093028023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2762526663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2762526663},{"type":"v1","addr":"172.21.15.142:6837","nonce":2762526663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2544978987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2544978987},{"type":"v1","addr":"172.21.15.17:6834","nonce":2544978987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/435858246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":435858246},{"type":"v1","addr":"172.21.15.17:6835","nonce":435858246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[]} 2023-08-09T12:45:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 45 2023-08-09T12:45:37.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.107+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbdc06a050 msgr2=0x7fbbdc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:37.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.107+0000 7fbbff00f640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbdc06a050 0x7fbbdc06c510 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbbf806ece0 tx=0x7fbbe8008040 comp rx=0 tx=0).stop 2023-08-09T12:45:37.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.107+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf8070f00 msgr2=0x7fbbf814c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:37.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.107+0000 7fbbff00f640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf8070f00 0x7fbbf814c9d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400c430 tx=0x7fbbf400c8f0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.108+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 shutdown_connections 2023-08-09T12:45:37.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.108+0000 7fbbff00f640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbbdc06a050 0x7fbbdc06c510 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.108+0000 7fbbff00f640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbf815a740 0x7fbbf80cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.108+0000 7fbbff00f640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbf81587e0 0x7fbbf815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.108+0000 7fbbff00f640 1 --2- 172.21.15.17:0/589421508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbf8070f00 0x7fbbf814c9d0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.108+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 >> 172.21.15.17:0/589421508 conn(0x7fbbf80b1d50 msgr2=0x7fbbf80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:37.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.108+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 shutdown_connections 2023-08-09T12:45:37.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.108+0000 7fbbff00f640 1 -- 172.21.15.17:0/589421508 wait complete. 2023-08-09T12:45:37.131 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:45:37.131 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:45:37.131 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:45:37.131 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:45:37.132 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:45:37.132 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:45:37.132 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:45:37.132 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:45:37.133 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:45:37.133 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:45:37.133 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:45:37.133 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:45:37.133 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:45:37.134 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:45:37.134 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:45:37.134 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:45:37.152 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:45:37.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:45:37.153 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:45:37.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:45:37.165 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:45:37.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:45:37.167 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:45:37.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:45:37.202 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:45:37.203 DEBUG:teuthology.parallel:result is None 2023-08-09T12:45:37.210 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:45:37.211 DEBUG:teuthology.parallel:result is None 2023-08-09T12:45:37.215 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:45:37.215 DEBUG:teuthology.parallel:result is None 2023-08-09T12:45:37.223 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:45:37.223 DEBUG:teuthology.parallel:result is None 2023-08-09T12:45:37.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:45:37.370 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:45:37.371 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:45:37.373 INFO:tasks.ceph.mds.a.smithi017.stderr:2023-08-09T12:45:37.370+0000 7ff15b36a640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-08-09T12:45:37.384 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:45:37.385 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:45:37.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.417+0000 7f1807299640 1 Processor -- start 2023-08-09T12:45:37.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.418+0000 7f1807299640 1 -- start start 2023-08-09T12:45:37.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1807299640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18001616e0 0x7f18000b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:37.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1807299640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18000d29d0 0x7f18000d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:37.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1807299640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000d3360 con 0x7f180015ce90 2023-08-09T12:45:37.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1807299640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000b6540 con 0x7f18001616e0 2023-08-09T12:45:37.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1807299640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000cdd10 con 0x7f18000d29d0 2023-08-09T12:45:37.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1804834640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18001616e0 0x7f18000b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:37.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1804834640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18001616e0 0x7f18000b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42422/0 (socket says 172.21.15.17:42422) 2023-08-09T12:45:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1804834640 1 -- 172.21.15.17:0/3619856615 learned_addr learned my addr 172.21.15.17:0/3619856615 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.419+0000 7f1805035640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f180015ce90 0x7f18000cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54572/0 (socket says 172.21.15.17:54572) 2023-08-09T12:45:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.420+0000 7f1805836640 1 --2- 172.21.15.17:0/3619856615 >> v2:172.21.15.142:3300/0 conn(0x7f18000d29d0 0x7f18000d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.420+0000 7f1804834640 1 -- 172.21.15.17:0/3619856615 >> v2:172.21.15.142:3300/0 conn(0x7f18000d29d0 msgr2=0x7f18000d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.420+0000 7f1804834640 1 --2- 172.21.15.17:0/3619856615 >> v2:172.21.15.142:3300/0 conn(0x7f18000d29d0 0x7f18000d2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.420+0000 7f1804834640 1 -- 172.21.15.17:0/3619856615 >> v1:172.21.15.17:6789/0 conn(0x7f180015ce90 legacy=0x7f18000cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:37.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.420+0000 7f1804834640 1 -- 172.21.15.17:0/3619856615 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000cdff0 con 0x7f18001616e0 2023-08-09T12:45:37.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.420+0000 7f1805836640 1 --2- 172.21.15.17:0/3619856615 >> v2:172.21.15.142:3300/0 conn(0x7f18000d29d0 0x7f18000d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:37.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.421+0000 7f1804834640 1 --2- 172.21.15.17:0/3619856615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000b6000 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f18000d07e0 tx=0x7f17f402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f4cabb4883527b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:37.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.421+0000 7f17fffff640 1 -- 172.21.15.17:0/3619856615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4030870 con 0x7f18001616e0 2023-08-09T12:45:37.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.421+0000 7f17fffff640 1 -- 172.21.15.17:0/3619856615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f40309d0 con 0x7f18001616e0 2023-08-09T12:45:37.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f17fffff640 1 -- 172.21.15.17:0/3619856615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4030d60 con 0x7f18001616e0 2023-08-09T12:45:37.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f1807299640 1 -- 172.21.15.17:0/3619856615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 msgr2=0x7f18000b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:37.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f1807299640 1 --2- 172.21.15.17:0/3619856615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000b6000 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f18000d07e0 tx=0x7f17f402b9b0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f1807299640 1 -- 172.21.15.17:0/3619856615 shutdown_connections 2023-08-09T12:45:37.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f1807299640 1 --2- 172.21.15.17:0/3619856615 >> v2:172.21.15.142:3300/0 conn(0x7f18000d29d0 0x7f18000d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f1807299640 1 --2- 172.21.15.17:0/3619856615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000b6000 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f1807299640 1 -- 172.21.15.17:0/3619856615 >> 172.21.15.17:0/3619856615 conn(0x7f180006fde0 msgr2=0x7f18000701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:37.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f1807299640 1 -- 172.21.15.17:0/3619856615 shutdown_connections 2023-08-09T12:45:37.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.422+0000 7f1807299640 1 -- 172.21.15.17:0/3619856615 wait complete. 2023-08-09T12:45:37.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.424+0000 7f1807299640 1 Processor -- start 2023-08-09T12:45:37.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.424+0000 7f1807299640 1 -- start start 2023-08-09T12:45:37.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.425+0000 7f1807299640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000d29d0 0x7f180015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:37.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.425+0000 7f1807299640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f180015ce90 0x7f18000ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:37.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.425+0000 7f1807299640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:37.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.425+0000 7f1807299640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18001f37e0 con 0x7f18001616e0 2023-08-09T12:45:37.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.425+0000 7f1807299640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000caf40 con 0x7f180015ce90 2023-08-09T12:45:37.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.425+0000 7f1807299640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000cb220 con 0x7f18000d29d0 2023-08-09T12:45:37.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:37.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805035640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000d29d0 0x7f180015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:37.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42438/0 (socket says 172.21.15.17:42438) 2023-08-09T12:45:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 -- 172.21.15.17:0/3313175394 learned_addr learned my addr 172.21.15.17:0/3313175394 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1804834640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f180015ce90 0x7f18000ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 -- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000d29d0 msgr2=0x7f180015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000d29d0 0x7f180015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 -- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f180015ce90 msgr2=0x7f18000ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:37.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f180015ce90 0x7f18000ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:37.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 -- 172.21.15.17:0/3313175394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f40094d0 con 0x7f18001616e0 2023-08-09T12:45:37.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805035640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000d29d0 0x7f180015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:45:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.426+0000 7f1805836640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000ca710 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f17f800e7e0 tx=0x7f17f800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.427+0000 7f17fdffb640 1 -- 172.21.15.17:0/3313175394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8004030 con 0x7f18001616e0 2023-08-09T12:45:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.427+0000 7f17fdffb640 1 -- 172.21.15.17:0/3313175394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f8004190 con 0x7f18001616e0 2023-08-09T12:45:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.427+0000 7f17fdffb640 1 -- 172.21.15.17:0/3313175394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8004500 con 0x7f18001616e0 2023-08-09T12:45:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.427+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18000cb500 con 0x7f18001616e0 2023-08-09T12:45:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.427+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18000cac50 con 0x7f18001616e0 2023-08-09T12:45:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.428+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18001f3990 con 0x7f18001616e0 2023-08-09T12:45:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.429+0000 7f17fdffb640 1 -- 172.21.15.17:0/3313175394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f17f800c6d0 con 0x7f18001616e0 2023-08-09T12:45:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.430+0000 7f17fdffb640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f17ec06a050 0x7f17ec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.430+0000 7f17fdffb640 1 -- 172.21.15.17:0/3313175394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f17f8088120 con 0x7f18001616e0 2023-08-09T12:45:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.431+0000 7f1805035640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f17ec06a050 0x7f17ec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:37.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.432+0000 7f1805035640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f17ec06a050 0x7f17ec06c510 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f17f00012e0 tx=0x7f17f00016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:37.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.434+0000 7f17fdffb640 1 -- 172.21.15.17:0/3313175394 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f18001f3990 con 0x7f18001616e0 2023-08-09T12:45:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:37.641+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f18001f3990 con 0x7f18001616e0 2023-08-09T12:45:38.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.127+0000 7f17fdffb640 1 -- 172.21.15.17:0/3313175394 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v104) v1 ==== 97+0+0 (secure 0 0 0) 0x7f18001f3990 con 0x7f18001616e0 2023-08-09T12:45:38.131 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:45:38.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f17ec06a050 msgr2=0x7f17ec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f17ec06a050 0x7f17ec06c510 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f17f00012e0 tx=0x7f17f00016f0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 msgr2=0x7f18000ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000ca710 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f17f800e7e0 tx=0x7f17f800eca0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 shutdown_connections 2023-08-09T12:45:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f17ec06a050 0x7f17ec06c510 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18001616e0 0x7f18000ca710 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f180015ce90 0x7f18000ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 --2- 172.21.15.17:0/3313175394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000d29d0 0x7f180015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 >> 172.21.15.17:0/3313175394 conn(0x7f180006fde0 msgr2=0x7f18000cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 shutdown_connections 2023-08-09T12:45:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.131+0000 7f1807299640 1 -- 172.21.15.17:0/3313175394 wait complete. 2023-08-09T12:45:38.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:45:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.376+0000 7f90cbbe3640 1 Processor -- start 2023-08-09T12:45:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.376+0000 7f90cbbe3640 1 -- start start 2023-08-09T12:45:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.378+0000 7f90cbbe3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90c415ce90 0x7f90c41616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.378+0000 7f90cbbe3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c40b6460 con 0x7f90c40b6000 2023-08-09T12:45:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.378+0000 7f90cbbe3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c40cdd10 con 0x7f90c40d29d0 2023-08-09T12:45:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.378+0000 7f90cbbe3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40cdff0 con 0x7f90c415ce90 2023-08-09T12:45:38.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.378+0000 7f90c917e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f90c40b6000 0x7f90c40cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60436/0 (socket says 172.21.15.17:60436) 2023-08-09T12:45:38.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.378+0000 7f90c917e640 1 -- 172.21.15.17:0/2080387851 learned_addr learned my addr 172.21.15.17:0/2080387851 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:38.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646025570 0 0) 0x7f90c40b6460 con 0x7f90c40b6000 2023-08-09T12:45:38.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b0003520 con 0x7f90c40b6000 2023-08-09T12:45:38.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c997f640 1 --2- 172.21.15.17:0/2080387851 >> v2:172.21.15.142:3300/0 conn(0x7f90c415ce90 0x7f90c41616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1877810986 0 0) 0x7f90b0003520 con 0x7f90c40b6000 2023-08-09T12:45:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 >> v2:172.21.15.142:3300/0 conn(0x7f90c415ce90 msgr2=0x7f90c41616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 --2- 172.21.15.17:0/2080387851 >> v2:172.21.15.142:3300/0 conn(0x7f90c415ce90 0x7f90c41616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 >> v1:172.21.15.142:6789/0 conn(0x7f90c40d29d0 legacy=0x7f90c40d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c40ce2d0 con 0x7f90c40b6000 2023-08-09T12:45:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f90b4001670 con 0x7f90c40b6000 2023-08-09T12:45:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 >> v1:172.21.15.17:6789/0 conn(0x7f90c40b6000 legacy=0x7f90c40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b0003970 0x7f90b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b00047c0 0x7f90b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.379+0000 7f90c897d640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b0005180 0x7f90b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40cdff0 con 0x7f90b0005180 2023-08-09T12:45:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b000c020 con 0x7f90b0003970 2023-08-09T12:45:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b000c1e0 con 0x7f90b00047c0 2023-08-09T12:45:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90ca180640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b0005180 0x7f90b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90c917e640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b00047c0 0x7f90b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90c997f640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b0003970 0x7f90b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90ca180640 1 -- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b00047c0 msgr2=0x7f90b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90ca180640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b00047c0 0x7f90b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90ca180640 1 -- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b0003970 msgr2=0x7f90b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:38.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90ca180640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b0003970 0x7f90b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90ca180640 1 -- 172.21.15.17:0/2080387851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0003520 con 0x7f90b0005180 2023-08-09T12:45:38.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.380+0000 7f90c997f640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90b0003970 0x7f90b0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.381+0000 7f90ca180640 1 -- 172.21.15.17:0/2080387851 reap_dead start 2023-08-09T12:45:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.382+0000 7f90ca180640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b0005180 0x7f90b000b980 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f90bc001e50 tx=0x7f90b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4211fef74ead62c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.382+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc003b70 con 0x7f90b0005180 2023-08-09T12:45:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.382+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc003d10 con 0x7f90b0005180 2023-08-09T12:45:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.382+0000 7f90c897d640 1 -- 172.21.15.17:0/2080387851 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc005310 con 0x7f90b0005180 2023-08-09T12:45:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.382+0000 7f90cbbe3640 1 -- 172.21.15.17:0/2080387851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b0005180 msgr2=0x7f90b000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.382+0000 7f90cbbe3640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b0005180 0x7f90b000b980 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f90bc001e50 tx=0x7f90b00057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.383+0000 7f90cbbe3640 1 -- 172.21.15.17:0/2080387851 shutdown_connections 2023-08-09T12:45:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.383+0000 7f90cbbe3640 1 --2- 172.21.15.17:0/2080387851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b0005180 0x7f90b000b980 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.383+0000 7f90cbbe3640 1 -- 172.21.15.17:0/2080387851 >> 172.21.15.17:0/2080387851 conn(0x7f90c406fde0 msgr2=0x7f90c40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:38.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.383+0000 7f90cbbe3640 1 -- 172.21.15.17:0/2080387851 shutdown_connections 2023-08-09T12:45:38.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.383+0000 7f90cbbe3640 1 -- 172.21.15.17:0/2080387851 wait complete. 2023-08-09T12:45:38.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.384+0000 7f90cbbe3640 1 Processor -- start 2023-08-09T12:45:38.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.385+0000 7f90cbbe3640 1 -- start start 2023-08-09T12:45:38.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.385+0000 7f90cbbe3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b0005180 0x7f90c4149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90cbbe3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c414a9d0 0x7f90c40b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90cbbe3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c414ae50 0x7f90c40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90cbbe3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c414a5b0 con 0x7f90c414a9d0 2023-08-09T12:45:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90cbbe3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4149930 con 0x7f90c414ae50 2023-08-09T12:45:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90cbbe3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4149c10 con 0x7f90b0005180 2023-08-09T12:45:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c917e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c414a9d0 0x7f90c40b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c917e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c414a9d0 0x7f90c40b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54888/0 (socket says 172.21.15.17:54888) 2023-08-09T12:45:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c917e640 1 -- 172.21.15.17:0/287396093 learned_addr learned my addr 172.21.15.17:0/287396093 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c997f640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b0005180 0x7f90c4149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90ca180640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c414ae50 0x7f90c40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c917e640 1 -- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b0005180 msgr2=0x7f90c4149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c917e640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b0005180 0x7f90c4149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c917e640 1 -- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c414ae50 msgr2=0x7f90c40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c917e640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c414ae50 0x7f90c40b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c917e640 1 -- 172.21.15.17:0/287396093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4149ef0 con 0x7f90c414a9d0 2023-08-09T12:45:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.386+0000 7f90c997f640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b0005180 0x7f90c4149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.387+0000 7f90c917e640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c414a9d0 0x7f90c40b7340 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f90b400e760 tx=0x7f90b400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.387+0000 7f90ba7fc640 1 -- 172.21.15.17:0/287396093 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400ee70 con 0x7f90c414a9d0 2023-08-09T12:45:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.387+0000 7f90ba7fc640 1 -- 172.21.15.17:0/287396093 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b400c870 con 0x7f90c414a9d0 2023-08-09T12:45:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.387+0000 7f90ba7fc640 1 -- 172.21.15.17:0/287396093 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400cc20 con 0x7f90c414a9d0 2023-08-09T12:45:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.387+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c414a1d0 con 0x7f90c414a9d0 2023-08-09T12:45:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.387+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c414c940 con 0x7f90c414a9d0 2023-08-09T12:45:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.388+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c4067a80 con 0x7f90c414a9d0 2023-08-09T12:45:38.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.389+0000 7f90ba7fc640 1 -- 172.21.15.17:0/287396093 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f90b401d460 con 0x7f90c414a9d0 2023-08-09T12:45:38.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.390+0000 7f90ba7fc640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90a806a050 0x7f90a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.390+0000 7f90ba7fc640 1 -- 172.21.15.17:0/287396093 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f90b40881c0 con 0x7f90c414a9d0 2023-08-09T12:45:38.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.391+0000 7f90c997f640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90a806a050 0x7f90a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.392+0000 7f90c997f640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90a806a050 0x7f90a806c510 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009aa0 tx=0x7f90c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:38.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.395+0000 7f90ba7fc640 1 -- 172.21.15.17:0/287396093 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f90b4053bf0 con 0x7f90c414a9d0 2023-08-09T12:45:38.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.663+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f90c40b7120 con 0x7f90c414a9d0 2023-08-09T12:45:38.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.664+0000 7f90ba7fc640 1 -- 172.21.15.17:0/287396093 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f90b4057210 con 0x7f90c414a9d0 2023-08-09T12:45:38.667 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:38.668 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:45:38.668 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:45:38.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.668 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:45:38.668 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:45:38.668 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:45:38.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:45:38.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:45:38.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.669 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:45:38.670 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:45:38.670 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:45:38.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:45:38.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:45:38.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.671 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:45:38.671 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:45:38.671 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:45:38.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:45:38.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:45:38.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.672 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:45:38.672 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:45:38.672 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:45:38.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:45:38.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:45:38.673 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.673 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:45:38.674 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:45:38.674 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:45:38.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:45:38.674 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.675 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:45:38.675 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:45:38.675 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:45:38.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:45:38.675 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.676 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:45:38.676 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:45:38.676 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:45:38.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:45:38.676 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:45:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:45:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:45:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:45:38.678 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.678 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:45:38.678 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:45:38.678 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.678 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:45:38.679 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:45:38.679 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.679 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:45:38.679 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:45:38.680 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:45:38.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:45:38.680 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.680 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:45:38.681 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:45:38.681 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.681 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:45:38.681 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:45:38.681 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.682 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:45:38.682 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:45:38.682 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.682 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:45:38.682 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:45:38.682 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.683 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:45:38.683 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:45:38.683 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.683 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:45:38.683 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:45:38.683 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:45:38.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.684 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:45:38.684 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:45:38.684 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.684 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:45:38.685 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:45:38.685 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:45:38.685 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:45:38.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.685 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:45:38.685 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:45:38.686 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.686 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:45:38.686 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:45:38.686 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:45:38.686 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:45:38.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.687 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:45:38.687 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:45:38.687 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.687 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:45:38.687 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:45:38.687 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:45:38.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:45:38.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.688 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:45:38.688 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:45:38.688 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.688 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:45:38.688 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:45:38.689 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:45:38.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.689 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:45:38.689 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:45:38.690 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.690 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:45:38.690 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:45:38.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:38.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:45:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:45:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:45:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:45:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:45:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:45:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:38.692 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:45:38.692 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:45:38.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.666+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90a806a050 msgr2=0x7f90a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.666+0000 7f90cbbe3640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90a806a050 0x7f90a806c510 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009aa0 tx=0x7f90c0008040 comp rx=0 tx=0).stop 2023-08-09T12:45:38.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c414a9d0 msgr2=0x7f90c40b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c414a9d0 0x7f90c40b7340 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f90b400e760 tx=0x7f90b400ec20 comp rx=0 tx=0).stop 2023-08-09T12:45:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 shutdown_connections 2023-08-09T12:45:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f90a806a050 0x7f90a806c510 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90c414ae50 0x7f90c40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c414a9d0 0x7f90c40b7340 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 --2- 172.21.15.17:0/287396093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90b0005180 0x7f90c4149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 >> 172.21.15.17:0/287396093 conn(0x7f90c406fde0 msgr2=0x7f90c40b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 shutdown_connections 2023-08-09T12:45:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.667+0000 7f90cbbe3640 1 -- 172.21.15.17:0/287396093 wait complete. 2023-08-09T12:45:38.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.928+0000 7f44a1f22640 1 Processor -- start 2023-08-09T12:45:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.928+0000 7f44a1f22640 1 -- start start 2023-08-09T12:45:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f44a1f22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449c163c10 0x7f449c166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f44a1f22640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c06c990 con 0x7f449c0adc40 2023-08-09T12:45:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f44a1f22640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c0b2250 con 0x7f449c0b3b40 2023-08-09T12:45:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f44a1f22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0ae020 con 0x7f449c163c10 2023-08-09T12:45:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f449c0adc40 0x7f449c06c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60450/0 (socket says 172.21.15.17:60450) 2023-08-09T12:45:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449b7fe640 1 -- 172.21.15.17:0/1765350829 learned_addr learned my addr 172.21.15.17:0/1765350829 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824110004 0 0) 0x7f449c06c990 con 0x7f449c0adc40 2023-08-09T12:45:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449bfff640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449c163c10 0x7f449c166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4484003520 con 0x7f449c0adc40 2023-08-09T12:45:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3555080609 0 0) 0x7f4484003520 con 0x7f449c0adc40 2023-08-09T12:45:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449c163c10 msgr2=0x7f449c166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449c163c10 0x7f449c166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 >> v1:172.21.15.142:6789/0 conn(0x7f449c0b3b40 legacy=0x7f449c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0b2530 con 0x7f449c0adc40 2023-08-09T12:45:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f448c001670 con 0x7f449c0adc40 2023-08-09T12:45:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 >> v1:172.21.15.17:6789/0 conn(0x7f449c0adc40 legacy=0x7f449c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449c163c10 0x7f44840039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4484003f20 0x7f44840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4484004d00 0x7f4484005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0ae020 con 0x7f4484004d00 2023-08-09T12:45:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448400bb10 con 0x7f4484003f20 2023-08-09T12:45:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.930+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448400bcd0 con 0x7f449c163c10 2023-08-09T12:45:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.931+0000 7f449bfff640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4484004d00 0x7f4484005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.931+0000 7f449affd640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4484003f20 0x7f44840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.931+0000 7f449b7fe640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449c163c10 0x7f44840039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.931+0000 7f449bfff640 1 -- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449c163c10 msgr2=0x7f44840039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.931+0000 7f449bfff640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f449c163c10 0x7f44840039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.931+0000 7f449bfff640 1 -- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4484003f20 msgr2=0x7f44840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.931+0000 7f449bfff640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4484003f20 0x7f44840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.931+0000 7f449bfff640 1 -- 172.21.15.17:0/1765350829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484003520 con 0x7f4484004d00 2023-08-09T12:45:38.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.932+0000 7f449bfff640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4484004d00 0x7f4484005180 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f449c0cb010 tx=0x7f44840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf1ad7cffa3ddeb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449402cb90 con 0x7f4484004d00 2023-08-09T12:45:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400f040 con 0x7f4484004d00 2023-08-09T12:45:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f449a7fc640 1 -- 172.21.15.17:0/1765350829 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494034440 con 0x7f4484004d00 2023-08-09T12:45:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f44a1f22640 1 -- 172.21.15.17:0/1765350829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4484004d00 msgr2=0x7f4484005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f44a1f22640 1 --2- 172.21.15.17:0/1765350829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4484004d00 0x7f4484005180 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f449c0cb010 tx=0x7f44840057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f449bfff640 1 -- 172.21.15.17:0/1765350829 reap_dead start 2023-08-09T12:45:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f44a1f22640 1 -- 172.21.15.17:0/1765350829 shutdown_connections 2023-08-09T12:45:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f44a1f22640 1 -- 172.21.15.17:0/1765350829 >> 172.21.15.17:0/1765350829 conn(0x7f449c0cb1b0 msgr2=0x7f449c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f44a1f22640 1 -- 172.21.15.17:0/1765350829 shutdown_connections 2023-08-09T12:45:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.933+0000 7f44a1f22640 1 -- 172.21.15.17:0/1765350829 wait complete. 2023-08-09T12:45:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.935+0000 7f44a1f22640 1 Processor -- start 2023-08-09T12:45:38.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.935+0000 7f44a1f22640 1 -- start start 2023-08-09T12:45:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.936+0000 7f44a1f22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4484004d00 0x7f449c1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.936+0000 7f44a1f22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f449c148970 0x7f449c148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.936+0000 7f44a1f22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0c3e80 0x7f449c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.936+0000 7f44a1f22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c149330 con 0x7f449c148970 2023-08-09T12:45:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.936+0000 7f44a1f22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c1f3700 con 0x7f449c0c3e80 2023-08-09T12:45:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.936+0000 7f44a1f22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c1f3970 con 0x7f4484004d00 2023-08-09T12:45:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f449c148970 0x7f449c148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f449c148970 0x7f449c148df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54896/0 (socket says 172.21.15.17:54896) 2023-08-09T12:45:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 -- 172.21.15.17:0/1236102972 learned_addr learned my addr 172.21.15.17:0/1236102972 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449bfff640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0c3e80 0x7f449c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449b7fe640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4484004d00 0x7f449c1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 -- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4484004d00 msgr2=0x7f449c1f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4484004d00 0x7f449c1f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 -- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0c3e80 msgr2=0x7f449c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:38.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0c3e80 0x7f449c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:38.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 -- 172.21.15.17:0/1236102972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c1f3c50 con 0x7f449c148970 2023-08-09T12:45:38.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449b7fe640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4484004d00 0x7f449c1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449bfff640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0c3e80 0x7f449c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.937+0000 7f449affd640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f449c148970 0x7f449c148df0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f449000e5b0 tx=0x7f449000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.938+0000 7f4483fff640 1 -- 172.21.15.17:0/1236102972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44900052e0 con 0x7f449c148970 2023-08-09T12:45:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.938+0000 7f4483fff640 1 -- 172.21.15.17:0/1236102972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490005440 con 0x7f449c148970 2023-08-09T12:45:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.938+0000 7f4483fff640 1 -- 172.21.15.17:0/1236102972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490003880 con 0x7f449c148970 2023-08-09T12:45:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.938+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c1f3f30 con 0x7f449c148970 2023-08-09T12:45:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.938+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c0c4870 con 0x7f449c148970 2023-08-09T12:45:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.939+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c067a80 con 0x7f449c148970 2023-08-09T12:45:38.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.940+0000 7f4483fff640 1 -- 172.21.15.17:0/1236102972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44900039e0 con 0x7f449c148970 2023-08-09T12:45:38.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.941+0000 7f4483fff640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f448806a050 0x7f448806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:38.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.942+0000 7f4483fff640 1 -- 172.21.15.17:0/1236102972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f44900880c0 con 0x7f449c148970 2023-08-09T12:45:38.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.942+0000 7f449b7fe640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f448806a050 0x7f448806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:38.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.943+0000 7f449b7fe640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f448806a050 0x7f448806c510 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f448c001eb0 tx=0x7f448c001d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:38.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:38.947+0000 7f4483fff640 1 -- 172.21.15.17:0/1236102972 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4490053af0 con 0x7f449c148970 2023-08-09T12:45:39.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.145+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f449c06ed40 con 0x7f449c148970 2023-08-09T12:45:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.147+0000 7f4483fff640 1 -- 172.21.15.17:0/1236102972 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+14617 (secure 0 0 0) 0x7f4490057110 con 0x7f449c148970 2023-08-09T12:45:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:39.151 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":106,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:45:38.137327+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f448806a050 msgr2=0x7f448806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f448806a050 0x7f448806c510 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f448c001eb0 tx=0x7f448c001d80 comp rx=0 tx=0).stop 2023-08-09T12:45:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f449c148970 msgr2=0x7f449c148df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f449c148970 0x7f449c148df0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f449000e5b0 tx=0x7f449000ea70 comp rx=0 tx=0).stop 2023-08-09T12:45:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 shutdown_connections 2023-08-09T12:45:39.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f448806a050 0x7f448806c510 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f449c0c3e80 0x7f449c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f449c148970 0x7f449c148df0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 --2- 172.21.15.17:0/1236102972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4484004d00 0x7f449c1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 >> 172.21.15.17:0/1236102972 conn(0x7f449c0cb1b0 msgr2=0x7f449c06c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 shutdown_connections 2023-08-09T12:45:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.150+0000 7f44a1f22640 1 -- 172.21.15.17:0/1236102972 wait complete. 2023-08-09T12:45:39.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:45:39.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:45:39.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.402+0000 7f898d542640 1 Processor -- start 2023-08-09T12:45:39.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.402+0000 7f898d542640 1 -- start start 2023-08-09T12:45:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f898d542640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f898815ce90 0x7f89881616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f898d542640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89880b6000 0x7f89880cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f898d542640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89880b6460 con 0x7f89880d29d0 2023-08-09T12:45:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f898d542640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89880cda40 con 0x7f89880b6000 2023-08-09T12:45:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f898d542640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89880cdd10 con 0x7f898815ce90 2023-08-09T12:45:39.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f89867fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89880b6000 0x7f89880cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f89867fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89880b6000 0x7f89880cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54910/0 (socket says 172.21.15.17:54910) 2023-08-09T12:45:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f89867fc640 1 -- 172.21.15.17:0/2584817978 learned_addr learned my addr 172.21.15.17:0/2584817978 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f8986ffd640 1 --2- 172.21.15.17:0/2584817978 >> v2:172.21.15.142:3300/0 conn(0x7f898815ce90 0x7f89881616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f89867fc640 1 -- 172.21.15.17:0/2584817978 >> v2:172.21.15.142:3300/0 conn(0x7f898815ce90 msgr2=0x7f89881616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f89867fc640 1 --2- 172.21.15.17:0/2584817978 >> v2:172.21.15.142:3300/0 conn(0x7f898815ce90 0x7f89881616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f89867fc640 1 -- 172.21.15.17:0/2584817978 >> v1:172.21.15.142:6789/0 conn(0x7f89880d29d0 legacy=0x7f89880d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.405+0000 7f89867fc640 1 -- 172.21.15.17:0/2584817978 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880cdff0 con 0x7f89880b6000 2023-08-09T12:45:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.406+0000 7f89867fc640 1 --2- 172.21.15.17:0/2584817978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89880cd500 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f89880d0690 tx=0x7f897c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdc9f5d9b56a14a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.406+0000 7f8985ffb640 1 -- 172.21.15.17:0/2584817978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c031870 con 0x7f89880b6000 2023-08-09T12:45:39.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.406+0000 7f8985ffb640 1 -- 172.21.15.17:0/2584817978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c0319d0 con 0x7f89880b6000 2023-08-09T12:45:39.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.406+0000 7f8985ffb640 1 -- 172.21.15.17:0/2584817978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c031d60 con 0x7f89880b6000 2023-08-09T12:45:39.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.407+0000 7f898d542640 1 -- 172.21.15.17:0/2584817978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 msgr2=0x7f89880cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.407+0000 7f898d542640 1 --2- 172.21.15.17:0/2584817978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89880cd500 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f89880d0690 tx=0x7f897c02b910 comp rx=0 tx=0).stop 2023-08-09T12:45:39.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.407+0000 7f898d542640 1 -- 172.21.15.17:0/2584817978 shutdown_connections 2023-08-09T12:45:39.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.407+0000 7f898d542640 1 --2- 172.21.15.17:0/2584817978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89880cd500 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.407+0000 7f898d542640 1 --2- 172.21.15.17:0/2584817978 >> v2:172.21.15.142:3300/0 conn(0x7f898815ce90 0x7f89881616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.407+0000 7f898d542640 1 -- 172.21.15.17:0/2584817978 >> 172.21.15.17:0/2584817978 conn(0x7f898806fde0 msgr2=0x7f89880701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:39.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.407+0000 7f898d542640 1 -- 172.21.15.17:0/2584817978 shutdown_connections 2023-08-09T12:45:39.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.407+0000 7f898d542640 1 -- 172.21.15.17:0/2584817978 wait complete. 2023-08-09T12:45:39.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.409+0000 7f898d542640 1 Processor -- start 2023-08-09T12:45:39.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.409+0000 7f898d542640 1 -- start start 2023-08-09T12:45:39.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f898d542640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89881f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f898d542640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89880d29d0 0x7f898815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f898d542640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898815ce90 0x7f898815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f898d542640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898815d270 con 0x7f89880b6000 2023-08-09T12:45:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f898d542640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898815d4c0 con 0x7f898815ce90 2023-08-09T12:45:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f898d542640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898815d7a0 con 0x7f89880d29d0 2023-08-09T12:45:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f8986ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89881f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f8986ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89881f3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54922/0 (socket says 172.21.15.17:54922) 2023-08-09T12:45:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.410+0000 7f8986ffd640 1 -- 172.21.15.17:0/3373683205 learned_addr learned my addr 172.21.15.17:0/3373683205 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f8986ffd640 1 -- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89880d29d0 msgr2=0x7f898815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f8986ffd640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89880d29d0 0x7f898815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f89877fe640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898815ce90 0x7f898815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f8986ffd640 1 -- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898815ce90 msgr2=0x7f898815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f8986ffd640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898815ce90 0x7f898815b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f8986ffd640 1 -- 172.21.15.17:0/3373683205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0094d0 con 0x7f89880b6000 2023-08-09T12:45:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f89877fe640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898815ce90 0x7f898815b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f8986ffd640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89881f3c30 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8978007e40 tx=0x7f897800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.411+0000 7f896f7fe640 1 -- 172.21.15.17:0/3373683205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978014620 con 0x7f89880b6000 2023-08-09T12:45:39.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.412+0000 7f896f7fe640 1 -- 172.21.15.17:0/3373683205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800ee90 con 0x7f89880b6000 2023-08-09T12:45:39.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.412+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898815da80 con 0x7f89880b6000 2023-08-09T12:45:39.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.412+0000 7f896f7fe640 1 -- 172.21.15.17:0/3373683205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780149c0 con 0x7f89880b6000 2023-08-09T12:45:39.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.412+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89881f4170 con 0x7f89880b6000 2023-08-09T12:45:39.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.413+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8988067a80 con 0x7f89880b6000 2023-08-09T12:45:39.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.414+0000 7f896f7fe640 1 -- 172.21.15.17:0/3373683205 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8978014b20 con 0x7f89880b6000 2023-08-09T12:45:39.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.415+0000 7f896f7fe640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897406a050 0x7f897406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.415+0000 7f896f7fe640 1 -- 172.21.15.17:0/3373683205 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8978088c90 con 0x7f89880b6000 2023-08-09T12:45:39.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.416+0000 7f89867fc640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897406a050 0x7f897406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.418+0000 7f89867fc640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897406a050 0x7f897406c510 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f897c036000 tx=0x7f897c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.420+0000 7f896f7fe640 1 -- 172.21.15.17:0/3373683205 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8978054630 con 0x7f89880b6000 2023-08-09T12:45:39.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.613+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89880d27b0 con 0x7f89880b6000 2023-08-09T12:45:39.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.614+0000 7f896f7fe640 1 -- 172.21.15.17:0/3373683205 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8978057c50 con 0x7f89880b6000 2023-08-09T12:45:39.617 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:45:39.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.616+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897406a050 msgr2=0x7f897406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.616+0000 7f898d542640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897406a050 0x7f897406c510 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f897c036000 tx=0x7f897c030000 comp rx=0 tx=0).stop 2023-08-09T12:45:39.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.616+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 msgr2=0x7f89881f3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.616+0000 7f898d542640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89881f3c30 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8978007e40 tx=0x7f897800e4b0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.617+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 shutdown_connections 2023-08-09T12:45:39.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.617+0000 7f898d542640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f897406a050 0x7f897406c510 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.617+0000 7f898d542640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898815ce90 0x7f898815b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.617+0000 7f898d542640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89880d29d0 0x7f898815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.617+0000 7f898d542640 1 --2- 172.21.15.17:0/3373683205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89880b6000 0x7f89881f3c30 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.617+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 >> 172.21.15.17:0/3373683205 conn(0x7f898806fde0 msgr2=0x7f89881518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:39.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.617+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 shutdown_connections 2023-08-09T12:45:39.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.617+0000 7f898d542640 1 -- 172.21.15.17:0/3373683205 wait complete. 2023-08-09T12:45:39.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:45:39.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.853+0000 7f7e5759e640 1 Processor -- start 2023-08-09T12:45:39.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.853+0000 7f7e5759e640 1 -- start start 2023-08-09T12:45:39.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.854+0000 7f7e5759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e580b3d60 0x7f7e580cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.854+0000 7f7e5759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7e580cc6b0 0x7f7e580b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.854+0000 7f7e5759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580b2b90 con 0x7f7e58159bd0 2023-08-09T12:45:39.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.854+0000 7f7e5759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e580cabb0 con 0x7f7e580cc6b0 2023-08-09T12:45:39.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.854+0000 7f7e5759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e580b2580 con 0x7f7e580b3d60 2023-08-09T12:45:39.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.854+0000 7f7e5659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7e58159bd0 0x7f7e580c9e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60464/0 (socket says 172.21.15.17:60464) 2023-08-09T12:45:39.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.854+0000 7f7e5659c640 1 -- 172.21.15.17:0/1368962000 learned_addr learned my addr 172.21.15.17:0/1368962000 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:39.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.854+0000 7f7e56d9d640 1 --2- 172.21.15.17:0/1368962000 >> v2:172.21.15.17:3300/0 conn(0x7f7e580cc6b0 0x7f7e580b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.855+0000 7f7e4ffff640 1 --2- 172.21.15.17:0/1368962000 >> v2:172.21.15.142:3300/0 conn(0x7f7e580b3d60 0x7f7e580cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.855+0000 7f7e56d9d640 1 -- 172.21.15.17:0/1368962000 >> v2:172.21.15.142:3300/0 conn(0x7f7e580b3d60 msgr2=0x7f7e580cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.855+0000 7f7e56d9d640 1 --2- 172.21.15.17:0/1368962000 >> v2:172.21.15.142:3300/0 conn(0x7f7e580b3d60 0x7f7e580cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.855+0000 7f7e56d9d640 1 -- 172.21.15.17:0/1368962000 >> v1:172.21.15.17:6789/0 conn(0x7f7e58159bd0 legacy=0x7f7e580c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.855+0000 7f7e56d9d640 1 -- 172.21.15.17:0/1368962000 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e580ca5f0 con 0x7f7e580cc6b0 2023-08-09T12:45:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.856+0000 7f7e56d9d640 1 --2- 172.21.15.17:0/1368962000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580cc6b0 0x7f7e580b3020 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7e580cbf50 tx=0x7f7e5002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd579de531233650 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:39.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.856+0000 7f7e55d9b640 1 -- 172.21.15.17:0/1368962000 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5002cc70 con 0x7f7e580cc6b0 2023-08-09T12:45:39.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.856+0000 7f7e55d9b640 1 -- 172.21.15.17:0/1368962000 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5002cdd0 con 0x7f7e580cc6b0 2023-08-09T12:45:39.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.856+0000 7f7e55d9b640 1 -- 172.21.15.17:0/1368962000 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50034660 con 0x7f7e580cc6b0 2023-08-09T12:45:39.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.857+0000 7f7e5759e640 1 -- 172.21.15.17:0/1368962000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580cc6b0 msgr2=0x7f7e580b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.857+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1368962000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580cc6b0 0x7f7e580b3020 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7e580cbf50 tx=0x7f7e5002bec0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.857+0000 7f7e5759e640 1 -- 172.21.15.17:0/1368962000 shutdown_connections 2023-08-09T12:45:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.857+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1368962000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580cc6b0 0x7f7e580b3020 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.857+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1368962000 >> v2:172.21.15.142:3300/0 conn(0x7f7e580b3d60 0x7f7e580cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.857+0000 7f7e5759e640 1 -- 172.21.15.17:0/1368962000 >> 172.21.15.17:0/1368962000 conn(0x7f7e580cb020 msgr2=0x7f7e580cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.857+0000 7f7e5759e640 1 -- 172.21.15.17:0/1368962000 shutdown_connections 2023-08-09T12:45:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.857+0000 7f7e5759e640 1 -- 172.21.15.17:0/1368962000 wait complete. 2023-08-09T12:45:39.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.859+0000 7f7e5759e640 1 Processor -- start 2023-08-09T12:45:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.859+0000 7f7e5759e640 1 -- start start 2023-08-09T12:45:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580b3d60 0x7f7e58156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e580cc6b0 0x7f7e58159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e58159bd0 0x7f7e580cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5815aa30 con 0x7f7e580b3d60 2023-08-09T12:45:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5815ad10 con 0x7f7e580cc6b0 2023-08-09T12:45:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5815aff0 con 0x7f7e58159bd0 2023-08-09T12:45:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580b3d60 0x7f7e58156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580b3d60 0x7f7e58156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54940/0 (socket says 172.21.15.17:54940) 2023-08-09T12:45:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5659c640 1 -- 172.21.15.17:0/1179237280 learned_addr learned my addr 172.21.15.17:0/1179237280 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5659c640 1 -- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e58159bd0 msgr2=0x7f7e580cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5659c640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e58159bd0 0x7f7e580cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5659c640 1 -- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e580cc6b0 msgr2=0x7f7e58159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5659c640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e580cc6b0 0x7f7e58159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.860+0000 7f7e5659c640 1 -- 172.21.15.17:0/1179237280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50009a70 con 0x7f7e580b3d60 2023-08-09T12:45:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.861+0000 7f7e5659c640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580b3d60 0x7f7e58156ef0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c480 tx=0x7f7e4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.861+0000 7f7e4effd640 1 -- 172.21.15.17:0/1179237280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48005ce0 con 0x7f7e580b3d60 2023-08-09T12:45:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.861+0000 7f7e4effd640 1 -- 172.21.15.17:0/1179237280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e48005e40 con 0x7f7e580b3d60 2023-08-09T12:45:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.861+0000 7f7e4effd640 1 -- 172.21.15.17:0/1179237280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e480072f0 con 0x7f7e580b3d60 2023-08-09T12:45:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.861+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5815b2d0 con 0x7f7e580b3d60 2023-08-09T12:45:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.861+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e580c7000 con 0x7f7e580b3d60 2023-08-09T12:45:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.862+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5815b7f0 con 0x7f7e580b3d60 2023-08-09T12:45:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.863+0000 7f7e4effd640 1 -- 172.21.15.17:0/1179237280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e48007510 con 0x7f7e580b3d60 2023-08-09T12:45:39.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.864+0000 7f7e4effd640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e3806a050 0x7f7e3806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:39.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.864+0000 7f7e4effd640 1 -- 172.21.15.17:0/1179237280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7e48087730 con 0x7f7e580b3d60 2023-08-09T12:45:39.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.865+0000 7f7e4ffff640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e3806a050 0x7f7e3806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:39.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.866+0000 7f7e4ffff640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e3806a050 0x7f7e3806c510 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7e581e79b0 tx=0x7f7e40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:39.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:39.869+0000 7f7e4effd640 1 -- 172.21.15.17:0/1179237280 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7e5815b7f0 con 0x7f7e580b3d60 2023-08-09T12:45:40.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.064+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e5815b7f0 con 0x7f7e580b3d60 2023-08-09T12:45:40.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.064+0000 7f7e4effd640 1 -- 172.21.15.17:0/1179237280 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e48053210 con 0x7f7e580b3d60 2023-08-09T12:45:40.068 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:45:40.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e3806a050 msgr2=0x7f7e3806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e3806a050 0x7f7e3806c510 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7e581e79b0 tx=0x7f7e40008040 comp rx=0 tx=0).stop 2023-08-09T12:45:40.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580b3d60 msgr2=0x7f7e58156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580b3d60 0x7f7e58156ef0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c480 tx=0x7f7e4800c940 comp rx=0 tx=0).stop 2023-08-09T12:45:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 shutdown_connections 2023-08-09T12:45:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e3806a050 0x7f7e3806c510 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e58159bd0 0x7f7e580cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e580cc6b0 0x7f7e58159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 --2- 172.21.15.17:0/1179237280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e580b3d60 0x7f7e58156ef0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 >> 172.21.15.17:0/1179237280 conn(0x7f7e580cb020 msgr2=0x7f7e58069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:40.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 shutdown_connections 2023-08-09T12:45:40.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.068+0000 7f7e5759e640 1 -- 172.21.15.17:0/1179237280 wait complete. 2023-08-09T12:45:40.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:45:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.301+0000 7f268d4d6640 1 Processor -- start 2023-08-09T12:45:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.301+0000 7f268d4d6640 1 -- start start 2023-08-09T12:45:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268d4d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 0x7f26880cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268d4d6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f26880b2a10 0x7f2688161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268d4d6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26880cbf50 con 0x7f268815ce90 2023-08-09T12:45:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268d4d6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26880caed0 con 0x7f26880b2a10 2023-08-09T12:45:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268d4d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26880cb1b0 con 0x7f268815cab0 2023-08-09T12:45:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f26877fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f268815ce90 0x7f26880b2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60480/0 (socket says 172.21.15.17:60480) 2023-08-09T12:45:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f26877fe640 1 -- 172.21.15.17:0/3113267032 learned_addr learned my addr 172.21.15.17:0/3113267032 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268ccd5640 1 --2- 172.21.15.17:0/3113267032 >> v2:172.21.15.17:3300/0 conn(0x7f26880b2a10 0x7f2688161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f2687fff640 1 --2- 172.21.15.17:0/3113267032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 0x7f26880cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f2686ffd640 1 -- 172.21.15.17:0/3113267032 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664443741 0 0) 0x7f26880cbf50 con 0x7f268815ce90 2023-08-09T12:45:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f2686ffd640 1 -- 172.21.15.17:0/3113267032 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2670003520 con 0x7f268815ce90 2023-08-09T12:45:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268ccd5640 1 -- 172.21.15.17:0/3113267032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 msgr2=0x7f26880cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268ccd5640 1 --2- 172.21.15.17:0/3113267032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 0x7f26880cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268ccd5640 1 -- 172.21.15.17:0/3113267032 >> v1:172.21.15.17:6789/0 conn(0x7f268815ce90 legacy=0x7f26880b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.303+0000 7f268ccd5640 1 -- 172.21.15.17:0/3113267032 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880cb490 con 0x7f26880b2a10 2023-08-09T12:45:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.304+0000 7f268ccd5640 1 --2- 172.21.15.17:0/3113267032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688161190 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f2680009d90 tx=0x7f268002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6ce7b730110527 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.304+0000 7f2686ffd640 1 -- 172.21.15.17:0/3113267032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268002cb30 con 0x7f26880b2a10 2023-08-09T12:45:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.305+0000 7f2686ffd640 1 -- 172.21.15.17:0/3113267032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268002cc90 con 0x7f26880b2a10 2023-08-09T12:45:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.305+0000 7f2686ffd640 1 -- 172.21.15.17:0/3113267032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2680034440 con 0x7f26880b2a10 2023-08-09T12:45:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.305+0000 7f268d4d6640 1 -- 172.21.15.17:0/3113267032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 msgr2=0x7f2688161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.305+0000 7f268d4d6640 1 --2- 172.21.15.17:0/3113267032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688161190 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f2680009d90 tx=0x7f268002bd80 comp rx=0 tx=0).stop 2023-08-09T12:45:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.305+0000 7f268d4d6640 1 -- 172.21.15.17:0/3113267032 shutdown_connections 2023-08-09T12:45:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.305+0000 7f268d4d6640 1 --2- 172.21.15.17:0/3113267032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688161190 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.305+0000 7f268d4d6640 1 --2- 172.21.15.17:0/3113267032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 0x7f26880cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.305+0000 7f268d4d6640 1 -- 172.21.15.17:0/3113267032 >> 172.21.15.17:0/3113267032 conn(0x7f26880cd300 msgr2=0x7f26880cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.306+0000 7f268d4d6640 1 -- 172.21.15.17:0/3113267032 shutdown_connections 2023-08-09T12:45:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.306+0000 7f268d4d6640 1 -- 172.21.15.17:0/3113267032 wait complete. 2023-08-09T12:45:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.307+0000 7f268d4d6640 1 Processor -- start 2023-08-09T12:45:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.308+0000 7f268d4d6640 1 -- start start 2023-08-09T12:45:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f268d4d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f268d4d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 0x7f26880c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f268d4d6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26881f29a0 0x7f26880c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f268d4d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26881e6590 con 0x7f26880b2a10 2023-08-09T12:45:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f268d4d6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26881f2e30 con 0x7f26881f29a0 2023-08-09T12:45:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f268d4d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2688153330 con 0x7f268815cab0 2023-08-09T12:45:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f2687fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f2687fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54966/0 (socket says 172.21.15.17:54966) 2023-08-09T12:45:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f2687fff640 1 -- 172.21.15.17:0/2705620858 learned_addr learned my addr 172.21.15.17:0/2705620858 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f2687fff640 1 -- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 msgr2=0x7f26880c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f2687fff640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 0x7f26880c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f2687fff640 1 -- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26881f29a0 msgr2=0x7f26880c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f2687fff640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26881f29a0 0x7f26880c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.309+0000 7f2687fff640 1 -- 172.21.15.17:0/2705620858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680009a70 con 0x7f26880b2a10 2023-08-09T12:45:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.310+0000 7f2687fff640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688152b30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f267800ea10 tx=0x7f267800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.310+0000 7f2684ff9640 1 -- 172.21.15.17:0/2705620858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678009670 con 0x7f26880b2a10 2023-08-09T12:45:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.310+0000 7f2684ff9640 1 -- 172.21.15.17:0/2705620858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267800ca00 con 0x7f26880b2a10 2023-08-09T12:45:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.310+0000 7f2684ff9640 1 -- 172.21.15.17:0/2705620858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267800cdb0 con 0x7f26880b2a10 2023-08-09T12:45:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.310+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26881e5980 con 0x7f26880b2a10 2023-08-09T12:45:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.310+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26881e5f40 con 0x7f26880b2a10 2023-08-09T12:45:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.311+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268804e390 con 0x7f26880b2a10 2023-08-09T12:45:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.314+0000 7f2684ff9640 1 -- 172.21.15.17:0/2705620858 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2678013470 con 0x7f26880b2a10 2023-08-09T12:45:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.314+0000 7f2684ff9640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f267406a050 0x7f267406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.314+0000 7f2684ff9640 1 -- 172.21.15.17:0/2705620858 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2678088560 con 0x7f26880b2a10 2023-08-09T12:45:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.314+0000 7f26877fe640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f267406a050 0x7f267406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.315+0000 7f26877fe640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f267406a050 0x7f267406c510 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f26880b3800 tx=0x7f267c007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:40.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.318+0000 7f2684ff9640 1 -- 172.21.15.17:0/2705620858 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2678053f00 con 0x7f26880b2a10 2023-08-09T12:45:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.512+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f26880b1860 con 0x7f26880b2a10 2023-08-09T12:45:40.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.513+0000 7f2684ff9640 1 -- 172.21.15.17:0/2705620858 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2678057520 con 0x7f26880b2a10 2023-08-09T12:45:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:40.517 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:45:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:45:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:45:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:45:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:45:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:45:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:45:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:45:40.518 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:45:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f267406a050 msgr2=0x7f267406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f267406a050 0x7f267406c510 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f26880b3800 tx=0x7f267c007930 comp rx=0 tx=0).stop 2023-08-09T12:45:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 msgr2=0x7f2688152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688152b30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f267800ea10 tx=0x7f267800eed0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 shutdown_connections 2023-08-09T12:45:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f267406a050 0x7f267406c510 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26881f29a0 0x7f26880c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f268815cab0 0x7f26880c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 --2- 172.21.15.17:0/2705620858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26880b2a10 0x7f2688152b30 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 >> 172.21.15.17:0/2705620858 conn(0x7f26880cd300 msgr2=0x7f26880b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 shutdown_connections 2023-08-09T12:45:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.517+0000 7f268d4d6640 1 -- 172.21.15.17:0/2705620858 wait complete. 2023-08-09T12:45:40.538 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:45:40.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:45:40.753 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:45:40.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:45:40.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.767+0000 7f0f07fff640 1 Processor -- start 2023-08-09T12:45:40.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.767+0000 7f0f07fff640 1 -- start start 2023-08-09T12:45:40.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f07fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f080cf790 0x7f0f0815b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f07fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f0806c510 0x7f0f0815b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f07fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0815bea0 con 0x7f0f08071270 2023-08-09T12:45:40.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f07fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0806b750 con 0x7f0f0806c510 2023-08-09T12:45:40.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f07fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0806ba30 con 0x7f0f080cf790 2023-08-09T12:45:40.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f077fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f0806c510 0x7f0f0815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f077fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0f0806c510 0x7f0f0815b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54968/0 (socket says 172.21.15.17:54968) 2023-08-09T12:45:40.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f077fe640 1 -- 172.21.15.17:0/628733086 learned_addr learned my addr 172.21.15.17:0/628733086 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:40.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f067fc640 1 --2- 172.21.15.17:0/628733086 >> v2:172.21.15.142:3300/0 conn(0x7f0f080cf790 0x7f0f0815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f077fe640 1 -- 172.21.15.17:0/628733086 >> v2:172.21.15.142:3300/0 conn(0x7f0f080cf790 msgr2=0x7f0f0815b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f077fe640 1 --2- 172.21.15.17:0/628733086 >> v2:172.21.15.142:3300/0 conn(0x7f0f080cf790 0x7f0f0815b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f077fe640 1 -- 172.21.15.17:0/628733086 >> v1:172.21.15.17:6789/0 conn(0x7f0f08071270 legacy=0x7f0f080cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f077fe640 1 -- 172.21.15.17:0/628733086 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0806bd10 con 0x7f0f0806c510 2023-08-09T12:45:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.769+0000 7f0f05ffb640 1 -- 172.21.15.17:0/628733086 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524089161 0 0) 0x7f0f0815bea0 con 0x7f0f08071270 2023-08-09T12:45:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.770+0000 7f0f077fe640 1 --2- 172.21.15.17:0/628733086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f0806c510 0x7f0f0815b670 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0f080cec90 tx=0x7f0f0002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab40bb7f20aaec90 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f05ffb640 1 -- 172.21.15.17:0/628733086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0002ca80 con 0x7f0f0806c510 2023-08-09T12:45:40.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f05ffb640 1 -- 172.21.15.17:0/628733086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0002cbe0 con 0x7f0f0806c510 2023-08-09T12:45:40.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f05ffb640 1 -- 172.21.15.17:0/628733086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f000343f0 con 0x7f0f0806c510 2023-08-09T12:45:40.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f07fff640 1 -- 172.21.15.17:0/628733086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f0806c510 msgr2=0x7f0f0815b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f07fff640 1 --2- 172.21.15.17:0/628733086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f0806c510 0x7f0f0815b670 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0f080cec90 tx=0x7f0f0002bee0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f07fff640 1 -- 172.21.15.17:0/628733086 shutdown_connections 2023-08-09T12:45:40.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f07fff640 1 --2- 172.21.15.17:0/628733086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f0806c510 0x7f0f0815b670 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f07fff640 1 --2- 172.21.15.17:0/628733086 >> v2:172.21.15.142:3300/0 conn(0x7f0f080cf790 0x7f0f0815b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.771+0000 7f0f07fff640 1 -- 172.21.15.17:0/628733086 >> 172.21.15.17:0/628733086 conn(0x7f0f080699a0 msgr2=0x7f0f08069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:40.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.772+0000 7f0f07fff640 1 -- 172.21.15.17:0/628733086 shutdown_connections 2023-08-09T12:45:40.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.772+0000 7f0f07fff640 1 -- 172.21.15.17:0/628733086 wait complete. 2023-08-09T12:45:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.773+0000 7f0f07fff640 1 Processor -- start 2023-08-09T12:45:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.773+0000 7f0f07fff640 1 -- start start 2023-08-09T12:45:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.774+0000 7f0f07fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0806c510 0x7f0f081efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.774+0000 7f0f07fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f08071270 0x7f0f080c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.774+0000 7f0f07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080cf790 0x7f0f080c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.774+0000 7f0f07fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080c6f00 con 0x7f0f080cf790 2023-08-09T12:45:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.774+0000 7f0f07fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080c71e0 con 0x7f0f0806c510 2023-08-09T12:45:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.774+0000 7f0f07fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080c74c0 con 0x7f0f08071270 2023-08-09T12:45:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080cf790 0x7f0f080c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080cf790 0x7f0f080c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54972/0 (socket says 172.21.15.17:54972) 2023-08-09T12:45:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f077fe640 1 -- 172.21.15.17:0/523300809 learned_addr learned my addr 172.21.15.17:0/523300809 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f067fc640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f08071270 0x7f0f080c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f077fe640 1 -- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f08071270 msgr2=0x7f0f080c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f06ffd640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0806c510 0x7f0f081efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f077fe640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f08071270 0x7f0f080c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f077fe640 1 -- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0806c510 msgr2=0x7f0f081efbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f077fe640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0806c510 0x7f0f081efbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.775+0000 7f0f077fe640 1 -- 172.21.15.17:0/523300809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f00009b30 con 0x7f0f080cf790 2023-08-09T12:45:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.776+0000 7f0f077fe640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080cf790 0x7f0f080c4ff0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f0f00036040 tx=0x7f0f00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.776+0000 7f0eeffff640 1 -- 172.21.15.17:0/523300809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00009510 con 0x7f0f080cf790 2023-08-09T12:45:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.776+0000 7f0eeffff640 1 -- 172.21.15.17:0/523300809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0003e450 con 0x7f0f080cf790 2023-08-09T12:45:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.776+0000 7f0eeffff640 1 -- 172.21.15.17:0/523300809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0003e5e0 con 0x7f0f080cf790 2023-08-09T12:45:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.776+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f080c77a0 con 0x7f0f080cf790 2023-08-09T12:45:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.776+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0814bac0 con 0x7f0f080cf790 2023-08-09T12:45:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.778+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f080c5530 con 0x7f0f080cf790 2023-08-09T12:45:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.778+0000 7f0eeffff640 1 -- 172.21.15.17:0/523300809 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f0002cd50 con 0x7f0f080cf790 2023-08-09T12:45:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.779+0000 7f0eeffff640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.780+0000 7f0eeffff640 1 -- 172.21.15.17:0/523300809 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0f000aa9f0 con 0x7f0f080cf790 2023-08-09T12:45:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.780+0000 7f0f06ffd640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.781+0000 7f0f06ffd640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8000f60 tx=0x7f0ef8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:40.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.784+0000 7f0eeffff640 1 -- 172.21.15.17:0/523300809 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0f00076390 con 0x7f0f080cf790 2023-08-09T12:45:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:40.983+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0f0814bd10 con 0x7f0f080cf790 2023-08-09T12:45:41.148 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:45:41.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.144+0000 7f0eeffff640 1 -- 172.21.15.17:0/523300809 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0f000799b0 con 0x7f0f080cf790 2023-08-09T12:45:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 msgr2=0x7f0ef406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8000f60 tx=0x7f0ef8009040 comp rx=0 tx=0).stop 2023-08-09T12:45:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080cf790 msgr2=0x7f0f080c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080cf790 0x7f0f080c4ff0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f0f00036040 tx=0x7f0f00004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 shutdown_connections 2023-08-09T12:45:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0ef406a050 0x7f0ef406c510 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080cf790 0x7f0f080c4ff0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f08071270 0x7f0f080c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 --2- 172.21.15.17:0/523300809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0806c510 0x7f0f081efbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.150+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 >> 172.21.15.17:0/523300809 conn(0x7f0f080699a0 msgr2=0x7f0f0815d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.151+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 shutdown_connections 2023-08-09T12:45:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.151+0000 7f0f07fff640 1 -- 172.21.15.17:0/523300809 wait complete. 2023-08-09T12:45:41.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:45:41.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.412+0000 7f2210966640 1 Processor -- start 2023-08-09T12:45:41.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.412+0000 7f2210966640 1 -- start start 2023-08-09T12:45:41.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.413+0000 7f2210966640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c15ca90 0x7f220c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:41.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.413+0000 7f2210966640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f220c161420 0x7f220c0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:41.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.413+0000 7f2210966640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f220c0cf040 0x7f220c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:41.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.413+0000 7f2210966640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c0cfa10 con 0x7f220c161420 2023-08-09T12:45:41.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.413+0000 7f2210966640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c160730 con 0x7f220c0cf040 2023-08-09T12:45:41.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.413+0000 7f2210966640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c160f90 con 0x7f220c15ca90 2023-08-09T12:45:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.413+0000 7f2202ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f220c161420 0x7f220c0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f2202ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f220c161420 0x7f220c0ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54984/0 (socket says 172.21.15.17:54984) 2023-08-09T12:45:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f2202ffd640 1 -- 172.21.15.17:0/3204219575 learned_addr learned my addr 172.21.15.17:0/3204219575 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f220bfff640 1 --2- 172.21.15.17:0/3204219575 >> v2:172.21.15.142:3300/0 conn(0x7f220c0cf040 0x7f220c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f220b7fe640 1 --2- 172.21.15.17:0/3204219575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c15ca90 0x7f220c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f2202ffd640 1 -- 172.21.15.17:0/3204219575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c15ca90 msgr2=0x7f220c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:41.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f2202ffd640 1 --2- 172.21.15.17:0/3204219575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c15ca90 0x7f220c0ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f2202ffd640 1 -- 172.21.15.17:0/3204219575 >> v2:172.21.15.142:3300/0 conn(0x7f220c0cf040 msgr2=0x7f220c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:41.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f2202ffd640 1 --2- 172.21.15.17:0/3204219575 >> v2:172.21.15.142:3300/0 conn(0x7f220c0cf040 0x7f220c0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.414+0000 7f2202ffd640 1 -- 172.21.15.17:0/3204219575 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0ae5b0 con 0x7f220c161420 2023-08-09T12:45:41.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.415+0000 7f2202ffd640 1 --2- 172.21.15.17:0/3204219575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c161420 0x7f220c0ae070 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f220c0c28c0 tx=0x7f21f402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276c69505f3b0cdc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:41.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f220affd640 1 -- 172.21.15.17:0/3204219575 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40317e0 con 0x7f220c161420 2023-08-09T12:45:41.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f220affd640 1 -- 172.21.15.17:0/3204219575 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4031940 con 0x7f220c161420 2023-08-09T12:45:41.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f220affd640 1 -- 172.21.15.17:0/3204219575 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4031cd0 con 0x7f220c161420 2023-08-09T12:45:41.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 -- 172.21.15.17:0/3204219575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c161420 msgr2=0x7f220c0ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:41.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 --2- 172.21.15.17:0/3204219575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c161420 0x7f220c0ae070 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f220c0c28c0 tx=0x7f21f402b880 comp rx=0 tx=0).stop 2023-08-09T12:45:41.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 -- 172.21.15.17:0/3204219575 shutdown_connections 2023-08-09T12:45:41.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 --2- 172.21.15.17:0/3204219575 >> v2:172.21.15.142:3300/0 conn(0x7f220c0cf040 0x7f220c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 --2- 172.21.15.17:0/3204219575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c161420 0x7f220c0ae070 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 --2- 172.21.15.17:0/3204219575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c15ca90 0x7f220c0ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 -- 172.21.15.17:0/3204219575 >> 172.21.15.17:0/3204219575 conn(0x7f220c0b0bd0 msgr2=0x7f220c0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:41.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 -- 172.21.15.17:0/3204219575 shutdown_connections 2023-08-09T12:45:41.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.416+0000 7f2210966640 1 -- 172.21.15.17:0/3204219575 wait complete. 2023-08-09T12:45:41.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.418+0000 7f2210966640 1 Processor -- start 2023-08-09T12:45:41.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.418+0000 7f2210966640 1 -- start start 2023-08-09T12:45:41.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.419+0000 7f2210966640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c0cf040 0x7f220c15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:41.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.419+0000 7f2210966640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c15ca90 0x7f220c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:41.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.419+0000 7f2210966640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c161420 0x7f220c159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:41.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.419+0000 7f2210966640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15d570 con 0x7f220c0cf040 2023-08-09T12:45:41.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.419+0000 7f2210966640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15d850 con 0x7f220c15ca90 2023-08-09T12:45:41.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.419+0000 7f2210966640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15db30 con 0x7f220c161420 2023-08-09T12:45:41.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c0cf040 0x7f220c15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:41.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c0cf040 0x7f220c15f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54998/0 (socket says 172.21.15.17:54998) 2023-08-09T12:45:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220b7fe640 1 -- 172.21.15.17:0/3807559220 learned_addr learned my addr 172.21.15.17:0/3807559220 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220bfff640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c161420 0x7f220c159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f2202ffd640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c15ca90 0x7f220c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220b7fe640 1 -- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c161420 msgr2=0x7f220c159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220b7fe640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c161420 0x7f220c159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220b7fe640 1 -- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c15ca90 msgr2=0x7f220c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220b7fe640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c15ca90 0x7f220c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:41.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f220b7fe640 1 -- 172.21.15.17:0/3807559220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40094d0 con 0x7f220c0cf040 2023-08-09T12:45:41.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.420+0000 7f2202ffd640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c15ca90 0x7f220c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.421+0000 7f220b7fe640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c0cf040 0x7f220c15f4b0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f21fc007ef0 tx=0x7f21fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.421+0000 7f2208ff9640 1 -- 172.21.15.17:0/3807559220 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc014620 con 0x7f220c0cf040 2023-08-09T12:45:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.421+0000 7f2208ff9640 1 -- 172.21.15.17:0/3807559220 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc014780 con 0x7f220c0cf040 2023-08-09T12:45:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.421+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c0c2d90 con 0x7f220c0cf040 2023-08-09T12:45:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.421+0000 7f2208ff9640 1 -- 172.21.15.17:0/3807559220 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc014b30 con 0x7f220c0cf040 2023-08-09T12:45:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.421+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c159e60 con 0x7f220c0cf040 2023-08-09T12:45:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.422+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c0737b0 con 0x7f220c0cf040 2023-08-09T12:45:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.424+0000 7f2208ff9640 1 -- 172.21.15.17:0/3807559220 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f21fc014c90 con 0x7f220c0cf040 2023-08-09T12:45:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.425+0000 7f2208ff9640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21ec06a050 0x7f21ec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.425+0000 7f2208ff9640 1 -- 172.21.15.17:0/3807559220 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f21fc089c00 con 0x7f220c0cf040 2023-08-09T12:45:41.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.425+0000 7f2202ffd640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21ec06a050 0x7f21ec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:41.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.427+0000 7f2202ffd640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21ec06a050 0x7f21ec06c510 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f21f4036000 tx=0x7f21f403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:41.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.428+0000 7f2208ff9640 1 -- 172.21.15.17:0/3807559220 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f21fc055540 con 0x7f220c0cf040 2023-08-09T12:45:41.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:41.646+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f220c0c2bf0 con 0x7f220c0cf040 2023-08-09T12:45:42.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.154+0000 7f2208ff9640 1 -- 172.21.15.17:0/3807559220 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) v1 ==== 170+0+0 (secure 0 0 0) 0x7f220c0c2bf0 con 0x7f220c0cf040 2023-08-09T12:45:42.167 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:45:42.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.174+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21ec06a050 msgr2=0x7f21ec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.174+0000 7f2210966640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21ec06a050 0x7f21ec06c510 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f21f4036000 tx=0x7f21f403d040 comp rx=0 tx=0).stop 2023-08-09T12:45:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.174+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c0cf040 msgr2=0x7f220c15f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.174+0000 7f2210966640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c0cf040 0x7f220c15f4b0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f21fc007ef0 tx=0x7f21fc00e4b0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.175+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 shutdown_connections 2023-08-09T12:45:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.175+0000 7f2210966640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f21ec06a050 0x7f21ec06c510 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.175+0000 7f2210966640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c161420 0x7f220c159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.175+0000 7f2210966640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c15ca90 0x7f220c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.175+0000 7f2210966640 1 --2- 172.21.15.17:0/3807559220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220c0cf040 0x7f220c15f4b0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.175+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 >> 172.21.15.17:0/3807559220 conn(0x7f220c0b0bd0 msgr2=0x7f220c0ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.175+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 shutdown_connections 2023-08-09T12:45:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.175+0000 7f2210966640 1 -- 172.21.15.17:0/3807559220 wait complete. 2023-08-09T12:45:42.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:45:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.411+0000 7f7b80921640 1 Processor -- start 2023-08-09T12:45:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.412+0000 7f7b80921640 1 -- start start 2023-08-09T12:45:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.413+0000 7f7b80921640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7b7c15a8c0 0x7f7b7c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.413+0000 7f7b80921640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 0x7f7b7c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.413+0000 7f7b80921640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c15e7b0 con 0x7f7b7c0b13f0 2023-08-09T12:45:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.413+0000 7f7b80921640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c0b09d0 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.413+0000 7f7b80921640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0b1850 con 0x7f7b7c0b0020 2023-08-09T12:45:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.414+0000 7f7b7ad9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7b7c15a8c0 0x7f7b7c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.414+0000 7f7b7a59c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7b7c0b13f0 0x7f7b7c15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:45772/0 (socket says 172.21.15.17:45772) 2023-08-09T12:45:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.414+0000 7f7b7a59c640 1 -- 172.21.15.17:0/3837240646 learned_addr learned my addr 172.21.15.17:0/3837240646 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.414+0000 7f7b7b59e640 1 --2- 172.21.15.17:0/3837240646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 0x7f7b7c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.414+0000 7f7b7ad9d640 1 -- 172.21.15.17:0/3837240646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 msgr2=0x7f7b7c0b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.414+0000 7f7b7ad9d640 1 --2- 172.21.15.17:0/3837240646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 0x7f7b7c0b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.414+0000 7f7b7ad9d640 1 -- 172.21.15.17:0/3837240646 >> v1:172.21.15.142:6789/0 conn(0x7f7b7c0b13f0 legacy=0x7f7b7c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.414+0000 7f7b7ad9d640 1 -- 172.21.15.17:0/3837240646 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c15e460 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.416+0000 7f7b7ad9d640 1 --2- 172.21.15.17:0/3837240646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c0b4170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0097a0 tx=0x7f7b6c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b034d1a2f68dc40d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.416+0000 7f7b79d9b640 1 -- 172.21.15.17:0/3837240646 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c02d040 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.416+0000 7f7b79d9b640 1 -- 172.21.15.17:0/3837240646 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c031810 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.416+0000 7f7b79d9b640 1 -- 172.21.15.17:0/3837240646 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c031ba0 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.417+0000 7f7b80921640 1 -- 172.21.15.17:0/3837240646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c15a8c0 msgr2=0x7f7b7c0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.417+0000 7f7b80921640 1 --2- 172.21.15.17:0/3837240646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c0b4170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0097a0 tx=0x7f7b6c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.417+0000 7f7b80921640 1 -- 172.21.15.17:0/3837240646 shutdown_connections 2023-08-09T12:45:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.417+0000 7f7b80921640 1 --2- 172.21.15.17:0/3837240646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 0x7f7b7c0b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.417+0000 7f7b80921640 1 --2- 172.21.15.17:0/3837240646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c0b4170 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.417+0000 7f7b80921640 1 -- 172.21.15.17:0/3837240646 >> 172.21.15.17:0/3837240646 conn(0x7f7b7c0cb020 msgr2=0x7f7b7c0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.417+0000 7f7b80921640 1 -- 172.21.15.17:0/3837240646 shutdown_connections 2023-08-09T12:45:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.417+0000 7f7b80921640 1 -- 172.21.15.17:0/3837240646 wait complete. 2023-08-09T12:45:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.419+0000 7f7b80921640 1 Processor -- start 2023-08-09T12:45:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.419+0000 7f7b80921640 1 -- start start 2023-08-09T12:45:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b80921640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 0x7f7b7c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b80921640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c0b13f0 0x7f7b7c14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b80921640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b80921640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c14b500 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b80921640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15dd20 con 0x7f7b7c0b13f0 2023-08-09T12:45:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b80921640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c14ba50 con 0x7f7b7c0b0020 2023-08-09T12:45:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b7b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b7b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c15d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55000/0 (socket says 172.21.15.17:55000) 2023-08-09T12:45:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.420+0000 7f7b7b59e640 1 -- 172.21.15.17:0/2468525579 learned_addr learned my addr 172.21.15.17:0/2468525579 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7ad9d640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 0x7f7b7c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7a59c640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c0b13f0 0x7f7b7c14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7b59e640 1 -- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 msgr2=0x7f7b7c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7b59e640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 0x7f7b7c14dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7b59e640 1 -- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c0b13f0 msgr2=0x7f7b7c14afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7b59e640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c0b13f0 0x7f7b7c14afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7b59e640 1 -- 172.21.15.17:0/2468525579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c009400 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7a59c640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c0b13f0 0x7f7b7c14afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.421+0000 7f7b7b59e640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c15d7e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009d30 tx=0x7f7b7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.422+0000 7f7b637fe640 1 -- 172.21.15.17:0/2468525579 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74009ba0 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.422+0000 7f7b637fe640 1 -- 172.21.15.17:0/2468525579 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7400f040 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.422+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c14e0b0 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.422+0000 7f7b637fe640 1 -- 172.21.15.17:0/2468525579 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b740146c0 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.422+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c14e670 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.423+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c04e390 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.425+0000 7f7b637fe640 1 -- 172.21.15.17:0/2468525579 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b74014820 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.426+0000 7f7b637fe640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6806a050 0x7f7b6806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.426+0000 7f7b637fe640 1 -- 172.21.15.17:0/2468525579 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7b740898d0 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.426+0000 7f7b7ad9d640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6806a050 0x7f7b6806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.427+0000 7f7b7ad9d640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6806a050 0x7f7b6806c510 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c036000 tx=0x7f7b6c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.429+0000 7f7b637fe640 1 -- 172.21.15.17:0/2468525579 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7b74055010 con 0x7f7b7c15a8c0 2023-08-09T12:45:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:42.661+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7b7c0cbd50 con 0x7f7b7c15a8c0 2023-08-09T12:45:43.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.214+0000 7f7b637fe640 1 -- 172.21.15.17:0/2468525579 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v48) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7b74058630 con 0x7f7b7c15a8c0 2023-08-09T12:45:43.217 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 13 and data pool 14 2023-08-09T12:45:43.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.223+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6806a050 msgr2=0x7f7b6806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.224+0000 7f7b80921640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6806a050 0x7f7b6806c510 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c036000 tx=0x7f7b6c03c040 comp rx=0 tx=0).stop 2023-08-09T12:45:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.224+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b7c15a8c0 msgr2=0x7f7b7c15d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.224+0000 7f7b80921640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c15d7e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009d30 tx=0x7f7b7400c490 comp rx=0 tx=0).stop 2023-08-09T12:45:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.225+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 shutdown_connections 2023-08-09T12:45:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.225+0000 7f7b80921640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6806a050 0x7f7b6806c510 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.225+0000 7f7b80921640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b7c15a8c0 0x7f7b7c15d7e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.225+0000 7f7b80921640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7c0b13f0 0x7f7b7c14afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.225+0000 7f7b80921640 1 --2- 172.21.15.17:0/2468525579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7c0b0020 0x7f7b7c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.225+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 >> 172.21.15.17:0/2468525579 conn(0x7f7b7c0cb020 msgr2=0x7f7b7c158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:43.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.225+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 shutdown_connections 2023-08-09T12:45:43.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.226+0000 7f7b80921640 1 -- 172.21.15.17:0/2468525579 wait complete. 2023-08-09T12:45:43.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:43.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.446+0000 7fe144cba640 1 Processor -- start 2023-08-09T12:45:43.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.446+0000 7fe144cba640 1 -- start start 2023-08-09T12:45:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.448+0000 7fe144cba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe140161280 0x7fe1400c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.448+0000 7fe144cba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 0x7fe1400ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.448+0000 7fe144cba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14015df30 con 0x7fe1400ca450 2023-08-09T12:45:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.448+0000 7fe144cba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14015d430 con 0x7fe140161280 2023-08-09T12:45:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.448+0000 7fe144cba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400ca9d0 con 0x7fe140161660 2023-08-09T12:45:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.448+0000 7fe13ed9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe1400ca450 0x7fe1400c8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60496/0 (socket says 172.21.15.17:60496) 2023-08-09T12:45:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.448+0000 7fe13ed9d640 1 -- 172.21.15.17:0/1591935546 learned_addr learned my addr 172.21.15.17:0/1591935546 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13e59c640 1 --2- 172.21.15.17:0/1591935546 >> v2:172.21.15.142:3300/0 conn(0x7fe140161280 0x7fe1400c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13dd9b640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 0x7fe1400ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646605415 0 0) 0x7fe14015df30 con 0x7fe1400ca450 2023-08-09T12:45:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe128003520 con 0x7fe1400ca450 2023-08-09T12:45:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508102785 0 0) 0x7fe128003520 con 0x7fe1400ca450 2023-08-09T12:45:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 msgr2=0x7fe1400ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 0x7fe1400ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 >> v2:172.21.15.142:3300/0 conn(0x7fe140161280 msgr2=0x7fe1400c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 --2- 172.21.15.17:0/1591935546 >> v2:172.21.15.142:3300/0 conn(0x7fe140161280 0x7fe1400c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14015e3c0 con 0x7fe1400ca450 2023-08-09T12:45:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe1380019f0 con 0x7fe1400ca450 2023-08-09T12:45:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 >> v1:172.21.15.17:6789/0 conn(0x7fe1400ca450 legacy=0x7fe1400c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 0x7fe128003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe128003ef0 0x7fe1280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe128004d00 0x7fe128005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400ca9d0 con 0x7fe128003ef0 2023-08-09T12:45:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12800b980 con 0x7fe128004d00 2023-08-09T12:45:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.449+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12800bb10 con 0x7fe140161660 2023-08-09T12:45:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13dd9b640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe128003ef0 0x7fe1280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13e59c640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 0x7fe128003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13dd9b640 1 -- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 msgr2=0x7fe128003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13dd9b640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 0x7fe128003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13dd9b640 1 -- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe128004d00 msgr2=0x7fe128005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13ed9d640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe128004d00 0x7fe128005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13dd9b640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe128004d00 0x7fe128005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13dd9b640 1 -- 172.21.15.17:0/1591935546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe128003520 con 0x7fe128003ef0 2023-08-09T12:45:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13e59c640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe140161660 0x7fe128003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.450+0000 7fe13ed9d640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe128004d00 0x7fe128005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:43.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.451+0000 7fe13dd9b640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe128003ef0 0x7fe1280047c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe134009ab0 tx=0x7fe1280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca907e1a7e4fa52 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:43.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.452+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134005990 con 0x7fe128003ef0 2023-08-09T12:45:43.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.452+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134005af0 con 0x7fe128003ef0 2023-08-09T12:45:43.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.452+0000 7fe13d59a640 1 -- 172.21.15.17:0/1591935546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134005ea0 con 0x7fe128003ef0 2023-08-09T12:45:43.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.452+0000 7fe144cba640 1 -- 172.21.15.17:0/1591935546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe128003ef0 msgr2=0x7fe1280047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.452+0000 7fe144cba640 1 --2- 172.21.15.17:0/1591935546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe128003ef0 0x7fe1280047c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe134009ab0 tx=0x7fe1280057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.452+0000 7fe13ed9d640 1 -- 172.21.15.17:0/1591935546 reap_dead start 2023-08-09T12:45:43.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.452+0000 7fe144cba640 1 -- 172.21.15.17:0/1591935546 shutdown_connections 2023-08-09T12:45:43.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.452+0000 7fe144cba640 1 -- 172.21.15.17:0/1591935546 >> 172.21.15.17:0/1591935546 conn(0x7fe1400cb1b0 msgr2=0x7fe1400cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:43.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.453+0000 7fe144cba640 1 -- 172.21.15.17:0/1591935546 shutdown_connections 2023-08-09T12:45:43.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.453+0000 7fe144cba640 1 -- 172.21.15.17:0/1591935546 wait complete. 2023-08-09T12:45:43.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.454+0000 7fe144cba640 1 Processor -- start 2023-08-09T12:45:43.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.455+0000 7fe144cba640 1 -- start start 2023-08-09T12:45:43.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe144cba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe128003ef0 0x7fe1400c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe144cba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1400b1540 0x7fe1400b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe144cba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1400b1f00 0x7fe1400c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe144cba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400b0a50 con 0x7fe1400b1540 2023-08-09T12:45:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe144cba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1401514a0 con 0x7fe1400b1f00 2023-08-09T12:45:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe144cba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400c22f0 con 0x7fe128003ef0 2023-08-09T12:45:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1400b1540 0x7fe1400b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1400b1540 0x7fe1400b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55020/0 (socket says 172.21.15.17:55020) 2023-08-09T12:45:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13dd9b640 1 -- 172.21.15.17:0/1846447006 learned_addr learned my addr 172.21.15.17:0/1846447006 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13e59c640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe128003ef0 0x7fe1400c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13ed9d640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1400b1f00 0x7fe1400c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13dd9b640 1 -- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe128003ef0 msgr2=0x7fe1400c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13dd9b640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe128003ef0 0x7fe1400c1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13dd9b640 1 -- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1400b1f00 msgr2=0x7fe1400c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13dd9b640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1400b1f00 0x7fe1400c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13dd9b640 1 -- 172.21.15.17:0/1846447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1400afc90 con 0x7fe1400b1540 2023-08-09T12:45:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13e59c640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe128003ef0 0x7fe1400c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.456+0000 7fe13ed9d640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1400b1f00 0x7fe1400c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:43.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.457+0000 7fe13dd9b640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1400b1540 0x7fe1400b19c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe13402c200 tx=0x7fe134004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:43.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.457+0000 7fe12effd640 1 -- 172.21.15.17:0/1846447006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134005e70 con 0x7fe1400b1540 2023-08-09T12:45:43.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.457+0000 7fe12effd640 1 -- 172.21.15.17:0/1846447006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134006030 con 0x7fe1400b1540 2023-08-09T12:45:43.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.457+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1400aff70 con 0x7fe1400b1540 2023-08-09T12:45:43.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.457+0000 7fe12effd640 1 -- 172.21.15.17:0/1846447006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1340063a0 con 0x7fe1400b1540 2023-08-09T12:45:43.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.457+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1400b0530 con 0x7fe1400b1540 2023-08-09T12:45:43.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.458+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1400b06c0 con 0x7fe1400b1540 2023-08-09T12:45:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.459+0000 7fe12effd640 1 -- 172.21.15.17:0/1846447006 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe134006500 con 0x7fe1400b1540 2023-08-09T12:45:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.460+0000 7fe12effd640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe12006a050 0x7fe12006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.460+0000 7fe12effd640 1 -- 172.21.15.17:0/1846447006 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1340aac10 con 0x7fe1400b1540 2023-08-09T12:45:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.461+0000 7fe13e59c640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe12006a050 0x7fe12006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.462+0000 7fe13e59c640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe12006a050 0x7fe12006c510 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe130009b00 tx=0x7fe130008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:43.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.465+0000 7fe12effd640 1 -- 172.21.15.17:0/1846447006 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe134076260 con 0x7fe1400b1540 2023-08-09T12:45:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.658+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe14006eb90 con 0x7fe1400b1540 2023-08-09T12:45:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.662+0000 7fe12effd640 1 -- 172.21.15.17:0/1846447006 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18294 (secure 0 0 0) 0x7fe13404d090 con 0x7fe1400b1540 2023-08-09T12:45:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:43.665 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":109,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:45:42.662237+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:45:41.039914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-09T12:45:41.697620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:43.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe12006a050 msgr2=0x7fe12006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe12006a050 0x7fe12006c510 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe130009b00 tx=0x7fe130008040 comp rx=0 tx=0).stop 2023-08-09T12:45:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1400b1540 msgr2=0x7fe1400b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1400b1540 0x7fe1400b19c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe13402c200 tx=0x7fe134004730 comp rx=0 tx=0).stop 2023-08-09T12:45:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 shutdown_connections 2023-08-09T12:45:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe12006a050 0x7fe12006c510 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1400b1f00 0x7fe1400c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1400b1540 0x7fe1400b19c0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 --2- 172.21.15.17:0/1846447006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe128003ef0 0x7fe1400c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.664+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 >> 172.21.15.17:0/1846447006 conn(0x7fe1400cb1b0 msgr2=0x7fe1400cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.665+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 shutdown_connections 2023-08-09T12:45:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.665+0000 7fe144cba640 1 -- 172.21.15.17:0/1846447006 wait complete. 2023-08-09T12:45:43.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:43.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.919+0000 7f5f831a4640 1 Processor -- start 2023-08-09T12:45:43.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.919+0000 7f5f831a4640 1 -- start start 2023-08-09T12:45:43.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.920+0000 7f5f831a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c070a90 0x7f5f7c0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.921+0000 7f5f831a4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f7c0ad810 0x7f5f7c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.921+0000 7f5f831a4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0b4630 con 0x7f5f7c159d80 2023-08-09T12:45:43.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.921+0000 7f5f831a4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c15a160 con 0x7f5f7c0ad810 2023-08-09T12:45:43.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.921+0000 7f5f831a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0b3ab0 con 0x7f5f7c070a90 2023-08-09T12:45:43.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.921+0000 7f5f80f40640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5f7c159d80 0x7f5f7c070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60502/0 (socket says 172.21.15.17:60502) 2023-08-09T12:45:43.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.921+0000 7f5f80f40640 1 -- 172.21.15.17:0/1322465805 learned_addr learned my addr 172.21.15.17:0/1322465805 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:43.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.921+0000 7f5f73fff640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c070a90 0x7f5f7c0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.921+0000 7f5f81741640 1 --2- 172.21.15.17:0/1322465805 >> v2:172.21.15.142:3300/0 conn(0x7f5f7c0ad810 0x7f5f7c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348689574 0 0) 0x7f5f7c0b4630 con 0x7f5f7c159d80 2023-08-09T12:45:43.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f64003520 con 0x7f5f7c159d80 2023-08-09T12:45:43.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 301844241 0 0) 0x7f5f64003520 con 0x7f5f7c159d80 2023-08-09T12:45:43.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c070a90 msgr2=0x7f5f7c0b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:43.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c070a90 0x7f5f7c0b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 >> v2:172.21.15.142:3300/0 conn(0x7f5f7c0ad810 msgr2=0x7f5f7c0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:43.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 --2- 172.21.15.17:0/1322465805 >> v2:172.21.15.142:3300/0 conn(0x7f5f7c0ad810 0x7f5f7c0c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0b3d90 con 0x7f5f7c159d80 2023-08-09T12:45:43.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f5f780019f0 con 0x7f5f7c159d80 2023-08-09T12:45:43.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 >> v1:172.21.15.17:6789/0 conn(0x7f5f7c159d80 legacy=0x7f5f7c070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f640047c0 0x7f5f64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c070a90 0x7f5f64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c15a160 con 0x7f5f64003970 2023-08-09T12:45:43.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0b3ab0 con 0x7f5f640047c0 2023-08-09T12:45:43.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6400db90 con 0x7f5f7c070a90 2023-08-09T12:45:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.922+0000 7f5f80f40640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.923+0000 7f5f73fff640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f640047c0 0x7f5f64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.923+0000 7f5f81741640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c070a90 0x7f5f64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.923+0000 7f5f80f40640 1 -- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c070a90 msgr2=0x7f5f64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.923+0000 7f5f80f40640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c070a90 0x7f5f64005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.923+0000 7f5f80f40640 1 -- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f640047c0 msgr2=0x7f5f64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:43.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.923+0000 7f5f80f40640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f640047c0 0x7f5f64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.923+0000 7f5f80f40640 1 -- 172.21.15.17:0/1322465805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64003520 con 0x7f5f64003970 2023-08-09T12:45:43.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.923+0000 7f5f73fff640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f640047c0 0x7f5f64004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:43.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.924+0000 7f5f80f40640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f64003d90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800a8d0 tx=0x7f5f640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71995aea500eca8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:43.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78034630 con 0x7f5f64003970 2023-08-09T12:45:43.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7802f070 con 0x7f5f64003970 2023-08-09T12:45:43.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f737fe640 1 -- 172.21.15.17:0/1322465805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780349d0 con 0x7f5f64003970 2023-08-09T12:45:43.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f831a4640 1 -- 172.21.15.17:0/1322465805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 msgr2=0x7f5f64003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f831a4640 1 --2- 172.21.15.17:0/1322465805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f64003d90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800a8d0 tx=0x7f5f640057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f81741640 1 -- 172.21.15.17:0/1322465805 reap_dead start 2023-08-09T12:45:43.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f831a4640 1 -- 172.21.15.17:0/1322465805 shutdown_connections 2023-08-09T12:45:43.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f831a4640 1 -- 172.21.15.17:0/1322465805 >> 172.21.15.17:0/1322465805 conn(0x7f5f7c0cb1b0 msgr2=0x7f5f7c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:43.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.925+0000 7f5f831a4640 1 -- 172.21.15.17:0/1322465805 shutdown_connections 2023-08-09T12:45:43.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.926+0000 7f5f831a4640 1 -- 172.21.15.17:0/1322465805 wait complete. 2023-08-09T12:45:43.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.927+0000 7f5f831a4640 1 Processor -- start 2023-08-09T12:45:43.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.927+0000 7f5f831a4640 1 -- start start 2023-08-09T12:45:43.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.928+0000 7f5f831a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f7c1f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.928+0000 7f5f831a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c0c9b20 0x7f5f7c0c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.928+0000 7f5f831a4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f7c0ac8b0 0x7f5f7c0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.928+0000 7f5f831a4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0ad270 con 0x7f5f64003970 2023-08-09T12:45:43.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.928+0000 7f5f831a4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c8010 con 0x7f5f7c0ac8b0 2023-08-09T12:45:43.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.928+0000 7f5f831a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c7400 con 0x7f5f7c0c9b20 2023-08-09T12:45:43.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f80f40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f7c1f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f80f40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f7c1f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55026/0 (socket says 172.21.15.17:55026) 2023-08-09T12:45:43.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f80f40640 1 -- 172.21.15.17:0/2521657144 learned_addr learned my addr 172.21.15.17:0/2521657144 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:43.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f81741640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f7c0ac8b0 0x7f5f7c0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f73fff640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c0c9b20 0x7f5f7c0c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f80f40640 1 -- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c0c9b20 msgr2=0x7f5f7c0c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f80f40640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c0c9b20 0x7f5f7c0c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f80f40640 1 -- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f7c0ac8b0 msgr2=0x7f5f7c0acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:43.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f80f40640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f7c0ac8b0 0x7f5f7c0acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:43.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f80f40640 1 -- 172.21.15.17:0/2521657144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0c76e0 con 0x7f5f64003970 2023-08-09T12:45:43.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.929+0000 7f5f81741640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f7c0ac8b0 0x7f5f7c0acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:43.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.930+0000 7f5f80f40640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f7c1f1cc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5f780012e0 tx=0x7f5f78001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:43.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.930+0000 7f5f717fa640 1 -- 172.21.15.17:0/2521657144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78034840 con 0x7f5f64003970 2023-08-09T12:45:43.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.930+0000 7f5f717fa640 1 -- 172.21.15.17:0/2521657144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f780349a0 con 0x7f5f64003970 2023-08-09T12:45:43.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.930+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c0c79c0 con 0x7f5f64003970 2023-08-09T12:45:43.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.930+0000 7f5f717fa640 1 -- 172.21.15.17:0/2521657144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78034d50 con 0x7f5f64003970 2023-08-09T12:45:43.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.930+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c0c84a0 con 0x7f5f64003970 2023-08-09T12:45:43.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.931+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c067a80 con 0x7f5f64003970 2023-08-09T12:45:43.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.932+0000 7f5f717fa640 1 -- 172.21.15.17:0/2521657144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5f78031030 con 0x7f5f64003970 2023-08-09T12:45:43.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.933+0000 7f5f717fa640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5f6806a050 0x7f5f6806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:43.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.933+0000 7f5f717fa640 1 -- 172.21.15.17:0/2521657144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f780aab80 con 0x7f5f64003970 2023-08-09T12:45:43.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.934+0000 7f5f73fff640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5f6806a050 0x7f5f6806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:43.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.935+0000 7f5f73fff640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5f6806a050 0x7f5f6806c510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c1567f0 tx=0x7f5f6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:43.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:43.938+0000 7f5f717fa640 1 -- 172.21.15.17:0/2521657144 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5f78076260 con 0x7f5f64003970 2023-08-09T12:45:44.132 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-08-09T12:45:44.130+0000 7fa51934c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:45:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.130+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f7c067a80 con 0x7f5f64003970 2023-08-09T12:45:44.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.133+0000 7f5f717fa640 1 -- 172.21.15.17:0/2521657144 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f5f78079880 con 0x7f5f64003970 2023-08-09T12:45:44.135 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:44.136 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":109,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:45:42.662237+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:45:41.039914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-09T12:45:41.697620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5f6806a050 msgr2=0x7f5f6806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5f6806a050 0x7f5f6806c510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c1567f0 tx=0x7f5f6c008040 comp rx=0 tx=0).stop 2023-08-09T12:45:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 msgr2=0x7f5f7c1f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f7c1f1cc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5f780012e0 tx=0x7f5f78001360 comp rx=0 tx=0).stop 2023-08-09T12:45:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 shutdown_connections 2023-08-09T12:45:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5f6806a050 0x7f5f6806c510 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f7c0ac8b0 0x7f5f7c0acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f7c0c9b20 0x7f5f7c0c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 --2- 172.21.15.17:0/2521657144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f64003970 0x7f5f7c1f1cc0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.135+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 >> 172.21.15.17:0/2521657144 conn(0x7f5f7c0cb1b0 msgr2=0x7f5f7c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.136+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 shutdown_connections 2023-08-09T12:45:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.136+0000 7f5f831a4640 1 -- 172.21.15.17:0/2521657144 wait complete. 2023-08-09T12:45:44.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:45:44.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.380+0000 7f549b166640 1 Processor -- start 2023-08-09T12:45:44.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.380+0000 7f549b166640 1 -- start start 2023-08-09T12:45:44.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.382+0000 7f549b166640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f549415cac0 0x7f54940cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.382+0000 7f549b166640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54940b1fc0 0x7f54940d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.382+0000 7f549b166640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940d09e0 con 0x7f54940b44b0 2023-08-09T12:45:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.382+0000 7f549b166640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54940d1010 con 0x7f549415cac0 2023-08-09T12:45:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.382+0000 7f549b166640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54940cdb70 con 0x7f54940b1fc0 2023-08-09T12:45:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.382+0000 7f549a164640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f549415cac0 0x7f54940cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.382+0000 7f549a965640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f54940b44b0 0x7f54940b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60510/0 (socket says 172.21.15.17:60510) 2023-08-09T12:45:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.382+0000 7f549a965640 1 -- 172.21.15.17:0/3202871570 learned_addr learned my addr 172.21.15.17:0/3202871570 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:44.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.383+0000 7f5499963640 1 --2- 172.21.15.17:0/3202871570 >> v2:172.21.15.142:3300/0 conn(0x7f54940b1fc0 0x7f54940d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:44.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.383+0000 7f549a164640 1 -- 172.21.15.17:0/3202871570 >> v2:172.21.15.142:3300/0 conn(0x7f54940b1fc0 msgr2=0x7f54940d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:44.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.383+0000 7f549a164640 1 --2- 172.21.15.17:0/3202871570 >> v2:172.21.15.142:3300/0 conn(0x7f54940b1fc0 0x7f54940d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.383+0000 7f549a164640 1 -- 172.21.15.17:0/3202871570 >> v1:172.21.15.17:6789/0 conn(0x7f54940b44b0 legacy=0x7f54940b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:44.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.383+0000 7f5499162640 1 -- 172.21.15.17:0/3202871570 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355317492 0 0) 0x7f54940d09e0 con 0x7f54940b44b0 2023-08-09T12:45:44.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.383+0000 7f549a164640 1 -- 172.21.15.17:0/3202871570 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54940cde50 con 0x7f549415cac0 2023-08-09T12:45:44.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.384+0000 7f549a164640 1 --2- 172.21.15.17:0/3202871570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549415cac0 0x7f54940cd290 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f54940b50e0 tx=0x7f549002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8297a8075c957f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:44.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.384+0000 7f5499162640 1 -- 172.21.15.17:0/3202871570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490031830 con 0x7f549415cac0 2023-08-09T12:45:44.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f5499162640 1 -- 172.21.15.17:0/3202871570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490031990 con 0x7f549415cac0 2023-08-09T12:45:44.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f5499162640 1 -- 172.21.15.17:0/3202871570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490031d20 con 0x7f549415cac0 2023-08-09T12:45:44.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f549b166640 1 -- 172.21.15.17:0/3202871570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549415cac0 msgr2=0x7f54940cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:44.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f549b166640 1 --2- 172.21.15.17:0/3202871570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549415cac0 0x7f54940cd290 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f54940b50e0 tx=0x7f549002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f549b166640 1 -- 172.21.15.17:0/3202871570 shutdown_connections 2023-08-09T12:45:44.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f549b166640 1 --2- 172.21.15.17:0/3202871570 >> v2:172.21.15.142:3300/0 conn(0x7f54940b1fc0 0x7f54940d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f549b166640 1 --2- 172.21.15.17:0/3202871570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549415cac0 0x7f54940cd290 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f549b166640 1 -- 172.21.15.17:0/3202871570 >> 172.21.15.17:0/3202871570 conn(0x7f54940cf4b0 msgr2=0x7f54940cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:44.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f549b166640 1 -- 172.21.15.17:0/3202871570 shutdown_connections 2023-08-09T12:45:44.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.385+0000 7f549b166640 1 -- 172.21.15.17:0/3202871570 wait complete. 2023-08-09T12:45:44.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.387+0000 7f549b166640 1 Processor -- start 2023-08-09T12:45:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.387+0000 7f549b166640 1 -- start start 2023-08-09T12:45:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.388+0000 7f549b166640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54940b1fc0 0x7f54940ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.388+0000 7f549b166640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54940b44b0 0x7f54940b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.388+0000 7f549b166640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549415cac0 0x7f5494159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.388+0000 7f549b166640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54941f2050 con 0x7f54940b1fc0 2023-08-09T12:45:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.388+0000 7f549b166640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549415e9d0 con 0x7f54940b44b0 2023-08-09T12:45:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.388+0000 7f549b166640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549415d410 con 0x7f549415cac0 2023-08-09T12:45:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.388+0000 7f549a164640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54940b1fc0 0x7f54940ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a164640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54940b1fc0 0x7f54940ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55048/0 (socket says 172.21.15.17:55048) 2023-08-09T12:45:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a164640 1 -- 172.21.15.17:0/617408805 learned_addr learned my addr 172.21.15.17:0/617408805 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f5499963640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54940b44b0 0x7f54940b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a965640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549415cac0 0x7f5494159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a164640 1 -- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549415cac0 msgr2=0x7f5494159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a164640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549415cac0 0x7f5494159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a164640 1 -- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54940b44b0 msgr2=0x7f54940b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a164640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54940b44b0 0x7f54940b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a164640 1 -- 172.21.15.17:0/617408805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490009400 con 0x7f54940b1fc0 2023-08-09T12:45:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.389+0000 7f549a164640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54940b1fc0 0x7f54940ca510 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5490009890 tx=0x7f54900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.390+0000 7f548affd640 1 -- 172.21.15.17:0/617408805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490004230 con 0x7f54940b1fc0 2023-08-09T12:45:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.390+0000 7f548affd640 1 -- 172.21.15.17:0/617408805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54900043b0 con 0x7f54940b1fc0 2023-08-09T12:45:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.390+0000 7f548affd640 1 -- 172.21.15.17:0/617408805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490004520 con 0x7f54940b1fc0 2023-08-09T12:45:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.390+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549415d6f0 con 0x7f54940b1fc0 2023-08-09T12:45:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.390+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549415dcb0 con 0x7f54940b1fc0 2023-08-09T12:45:44.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.391+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549415ded0 con 0x7f54940b1fc0 2023-08-09T12:45:44.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.392+0000 7f548affd640 1 -- 172.21.15.17:0/617408805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f549003a8a0 con 0x7f54940b1fc0 2023-08-09T12:45:44.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.393+0000 7f548affd640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f547806a050 0x7f547806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:44.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.393+0000 7f548affd640 1 -- 172.21.15.17:0/617408805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54900aac50 con 0x7f54940b1fc0 2023-08-09T12:45:44.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.394+0000 7f5499963640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f547806a050 0x7f547806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.395+0000 7f5499963640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f547806a050 0x7f547806c510 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5484006fd0 tx=0x7f5484008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:44.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.397+0000 7f548affd640 1 -- 172.21.15.17:0/617408805 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f54900762a0 con 0x7f54940b1fc0 2023-08-09T12:45:44.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:44.632+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f549404e390 con 0x7f54940b1fc0 2023-08-09T12:45:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.220+0000 7f548affd640 1 -- 172.21.15.17:0/617408805 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7f54900798c0 con 0x7f54940b1fc0 2023-08-09T12:45:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f547806a050 msgr2=0x7f547806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f547806a050 0x7f547806c510 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5484006fd0 tx=0x7f5484008040 comp rx=0 tx=0).stop 2023-08-09T12:45:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54940b1fc0 msgr2=0x7f54940ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54940b1fc0 0x7f54940ca510 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5490009890 tx=0x7f54900046c0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 shutdown_connections 2023-08-09T12:45:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f547806a050 0x7f547806c510 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549415cac0 0x7f5494159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54940b44b0 0x7f54940b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 --2- 172.21.15.17:0/617408805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54940b1fc0 0x7f54940ca510 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 >> 172.21.15.17:0/617408805 conn(0x7f54940cf4b0 msgr2=0x7f549415af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 shutdown_connections 2023-08-09T12:45:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.224+0000 7f549b166640 1 -- 172.21.15.17:0/617408805 wait complete. 2023-08-09T12:45:45.247 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:45:45.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:45:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.479+0000 7ff3ee683640 1 Processor -- start 2023-08-09T12:45:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.479+0000 7ff3ee683640 1 -- start start 2023-08-09T12:45:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.481+0000 7ff3ee683640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff3e8156c90 0x7ff3e815d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.481+0000 7ff3ee683640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e815a700 con 0x7ff3e80c8df0 2023-08-09T12:45:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.481+0000 7ff3ee683640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e815a140 con 0x7ff3e8070bf0 2023-08-09T12:45:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.481+0000 7ff3ee683640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e815d260 con 0x7ff3e8156c90 2023-08-09T12:45:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.481+0000 7ff3ecc20640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff3e80c8df0 0x7ff3e80c9200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60520/0 (socket says 172.21.15.17:60520) 2023-08-09T12:45:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.481+0000 7ff3ecc20640 1 -- 172.21.15.17:0/402664043 learned_addr learned my addr 172.21.15.17:0/402664043 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e7fff640 1 --2- 172.21.15.17:0/402664043 >> v2:172.21.15.142:3300/0 conn(0x7ff3e8156c90 0x7ff3e815d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448026499 0 0) 0x7ff3e815a700 con 0x7ff3e80c8df0 2023-08-09T12:45:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d4003520 con 0x7ff3e80c8df0 2023-08-09T12:45:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 541338194 0 0) 0x7ff3d4003520 con 0x7ff3e80c8df0 2023-08-09T12:45:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 >> v2:172.21.15.142:3300/0 conn(0x7ff3e8156c90 msgr2=0x7ff3e815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 --2- 172.21.15.17:0/402664043 >> v2:172.21.15.142:3300/0 conn(0x7ff3e8156c90 0x7ff3e815d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 >> v1:172.21.15.142:6789/0 conn(0x7ff3e8070bf0 legacy=0x7ff3e81596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e815a420 con 0x7ff3e80c8df0 2023-08-09T12:45:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff3e00019f0 con 0x7ff3e80c8df0 2023-08-09T12:45:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 >> v1:172.21.15.17:6789/0 conn(0x7ff3e80c8df0 legacy=0x7ff3e80c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d4003970 0x7ff3d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d40047c0 0x7ff3d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.482+0000 7ff3e77fe640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40052a0 0x7ff3d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e815d260 con 0x7ff3d4003970 2023-08-09T12:45:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d400c170 con 0x7ff3d40052a0 2023-08-09T12:45:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d400c330 con 0x7ff3d40047c0 2023-08-09T12:45:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e7fff640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d4003970 0x7ff3d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3ecc20640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40052a0 0x7ff3d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e7fff640 1 -- 172.21.15.17:0/402664043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d40047c0 msgr2=0x7ff3d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e7fff640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d40047c0 0x7ff3d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e7fff640 1 -- 172.21.15.17:0/402664043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40052a0 msgr2=0x7ff3d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e7fff640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40052a0 0x7ff3d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3e7fff640 1 -- 172.21.15.17:0/402664043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4003520 con 0x7ff3d4003970 2023-08-09T12:45:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3ecc20640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40052a0 0x7ff3d400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.483+0000 7ff3ecc20640 1 -- 172.21.15.17:0/402664043 reap_dead start 2023-08-09T12:45:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.484+0000 7ff3e7fff640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d4003970 0x7ff3d4003d90 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800bd30 tx=0x7ff3d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d00248474ee04f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80306a0 con 0x7ff3d4003970 2023-08-09T12:45:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d8030800 con 0x7ff3d4003970 2023-08-09T12:45:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3e77fe640 1 -- 172.21.15.17:0/402664043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8030b90 con 0x7ff3d4003970 2023-08-09T12:45:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3ee683640 1 -- 172.21.15.17:0/402664043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d4003970 msgr2=0x7ff3d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3ee683640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d4003970 0x7ff3d4003d90 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800bd30 tx=0x7ff3d40057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3ee683640 1 -- 172.21.15.17:0/402664043 shutdown_connections 2023-08-09T12:45:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3ee683640 1 --2- 172.21.15.17:0/402664043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d4003970 0x7ff3d4003d90 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3ee683640 1 -- 172.21.15.17:0/402664043 >> 172.21.15.17:0/402664043 conn(0x7ff3e8069be0 msgr2=0x7ff3e8069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3ee683640 1 -- 172.21.15.17:0/402664043 shutdown_connections 2023-08-09T12:45:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.485+0000 7ff3ee683640 1 -- 172.21.15.17:0/402664043 wait complete. 2023-08-09T12:45:45.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.487+0000 7ff3ee683640 1 Processor -- start 2023-08-09T12:45:45.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.487+0000 7ff3ee683640 1 -- start start 2023-08-09T12:45:45.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.488+0000 7ff3ee683640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4003970 0x7ff3e814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:45.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.488+0000 7ff3ee683640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3e8155730 0x7ff3e81f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:45.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.488+0000 7ff3ee683640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3e81f2db0 0x7ff3e80b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:45.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.488+0000 7ff3ee683640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e814d760 con 0x7ff3e81f2db0 2023-08-09T12:45:45.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.488+0000 7ff3ee683640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e81f62e0 con 0x7ff3e8155730 2023-08-09T12:45:45.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.488+0000 7ff3ee683640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e81f65c0 con 0x7ff3d4003970 2023-08-09T12:45:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3ecc20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3e81f2db0 0x7ff3e80b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3ecc20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3e81f2db0 0x7ff3e80b0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55066/0 (socket says 172.21.15.17:55066) 2023-08-09T12:45:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3ecc20640 1 -- 172.21.15.17:0/411810905 learned_addr learned my addr 172.21.15.17:0/411810905 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3df7fe640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3e8155730 0x7ff3e81f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3e7fff640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4003970 0x7ff3e814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3ecc20640 1 -- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4003970 msgr2=0x7ff3e814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3ecc20640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4003970 0x7ff3e814d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3ecc20640 1 -- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3e8155730 msgr2=0x7ff3e81f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3ecc20640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3e8155730 0x7ff3e81f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.489+0000 7ff3ecc20640 1 -- 172.21.15.17:0/411810905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e81571f0 con 0x7ff3e81f2db0 2023-08-09T12:45:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.490+0000 7ff3ecc20640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3e81f2db0 0x7ff3e80b0470 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80c8d80 tx=0x7ff3e000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.490+0000 7ff3e57fa640 1 -- 172.21.15.17:0/411810905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0004d60 con 0x7ff3e81f2db0 2023-08-09T12:45:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.490+0000 7ff3e57fa640 1 -- 172.21.15.17:0/411810905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e000bb80 con 0x7ff3e81f2db0 2023-08-09T12:45:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.490+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e81f25b0 con 0x7ff3e81f2db0 2023-08-09T12:45:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.490+0000 7ff3e57fa640 1 -- 172.21.15.17:0/411810905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0007070 con 0x7ff3e81f2db0 2023-08-09T12:45:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.490+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e81f5fd0 con 0x7ff3e81f2db0 2023-08-09T12:45:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.491+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e806d510 con 0x7ff3e81f2db0 2023-08-09T12:45:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.492+0000 7ff3e57fa640 1 -- 172.21.15.17:0/411810905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff3e00071d0 con 0x7ff3e81f2db0 2023-08-09T12:45:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.493+0000 7ff3e57fa640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff3c806a080 0x7ff3c806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:45.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.493+0000 7ff3e57fa640 1 -- 172.21.15.17:0/411810905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3e0088970 con 0x7ff3e81f2db0 2023-08-09T12:45:45.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.494+0000 7ff3e7fff640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff3c806a080 0x7ff3c806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:45.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.495+0000 7ff3e7fff640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff3c806a080 0x7ff3c806c540 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8039000 tx=0x7ff3d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:45.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.497+0000 7ff3e57fa640 1 -- 172.21.15.17:0/411810905 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff3e0053fc0 con 0x7ff3e81f2db0 2023-08-09T12:45:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:45.730+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff3e8067a80 con 0x7ff3e81f2db0 2023-08-09T12:45:46.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.223+0000 7ff3e57fa640 1 -- 172.21.15.17:0/411810905 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff3e00575e0 con 0x7ff3e81f2db0 2023-08-09T12:45:46.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff3c806a080 msgr2=0x7ff3c806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff3c806a080 0x7ff3c806c540 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8039000 tx=0x7ff3d8008040 comp rx=0 tx=0).stop 2023-08-09T12:45:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3e81f2db0 msgr2=0x7ff3e80b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3e81f2db0 0x7ff3e80b0470 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80c8d80 tx=0x7ff3e000b4a0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 shutdown_connections 2023-08-09T12:45:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff3c806a080 0x7ff3c806c540 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3e81f2db0 0x7ff3e80b0470 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3e8155730 0x7ff3e81f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.226+0000 7ff3ee683640 1 --2- 172.21.15.17:0/411810905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4003970 0x7ff3e814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.227+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 >> 172.21.15.17:0/411810905 conn(0x7ff3e8069be0 msgr2=0x7ff3e806ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.227+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 shutdown_connections 2023-08-09T12:45:46.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.227+0000 7ff3ee683640 1 -- 172.21.15.17:0/411810905 wait complete. 2023-08-09T12:45:46.252 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:45:46.253 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:45:46.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.480+0000 7f96ac42d640 1 Processor -- start 2023-08-09T12:45:46.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.480+0000 7f96ac42d640 1 -- start start 2023-08-09T12:45:46.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.482+0000 7f96ac42d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96a40b3b40 0x7f96a40b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.482+0000 7f96ac42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.482+0000 7f96ac42d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a406c990 con 0x7f96a40adc40 2023-08-09T12:45:46.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.482+0000 7f96ac42d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40ae020 con 0x7f96a40b3b40 2023-08-09T12:45:46.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.482+0000 7f96ac42d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40b2250 con 0x7f96a40cc630 2023-08-09T12:45:46.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.483+0000 7f96aa9ca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.483+0000 7f96a99c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96a40b3b40 0x7f96a40b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.483+0000 7f96aa1c9640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f96a40adc40 0x7f96a406c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:45792/0 (socket says 172.21.15.17:45792) 2023-08-09T12:45:46.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.483+0000 7f96aa1c9640 1 -- 172.21.15.17:0/4112223822 learned_addr learned my addr 172.21.15.17:0/4112223822 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:46.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.484+0000 7f96aa9ca640 1 -- 172.21.15.17:0/4112223822 >> v2:172.21.15.142:3300/0 conn(0x7f96a40b3b40 msgr2=0x7f96a40b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:46.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.484+0000 7f96aa9ca640 1 --2- 172.21.15.17:0/4112223822 >> v2:172.21.15.142:3300/0 conn(0x7f96a40b3b40 0x7f96a40b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.484+0000 7f96aa9ca640 1 -- 172.21.15.17:0/4112223822 >> v1:172.21.15.142:6789/0 conn(0x7f96a40adc40 legacy=0x7f96a406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.484+0000 7f96aa9ca640 1 -- 172.21.15.17:0/4112223822 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40b2530 con 0x7f96a40cc630 2023-08-09T12:45:46.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.484+0000 7f96a99c8640 1 --2- 172.21.15.17:0/4112223822 >> v2:172.21.15.142:3300/0 conn(0x7f96a40b3b40 0x7f96a40b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:45:46.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.486+0000 7f96aa9ca640 1 --2- 172.21.15.17:0/4112223822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40ccac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097a0 tx=0x7f969c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc09511c1f36dc67 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:46.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.486+0000 7f96a91c7640 1 -- 172.21.15.17:0/4112223822 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c02d040 con 0x7f96a40cc630 2023-08-09T12:45:46.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.486+0000 7f96a91c7640 1 -- 172.21.15.17:0/4112223822 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c031810 con 0x7f96a40cc630 2023-08-09T12:45:46.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.486+0000 7f96a91c7640 1 -- 172.21.15.17:0/4112223822 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c031ba0 con 0x7f96a40cc630 2023-08-09T12:45:46.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.487+0000 7f96ac42d640 1 -- 172.21.15.17:0/4112223822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 msgr2=0x7f96a40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.487+0000 7f96ac42d640 1 --2- 172.21.15.17:0/4112223822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40ccac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097a0 tx=0x7f969c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.487+0000 7f96ac42d640 1 -- 172.21.15.17:0/4112223822 shutdown_connections 2023-08-09T12:45:46.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.487+0000 7f96ac42d640 1 --2- 172.21.15.17:0/4112223822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40ccac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.487+0000 7f96ac42d640 1 --2- 172.21.15.17:0/4112223822 >> v2:172.21.15.142:3300/0 conn(0x7f96a40b3b40 0x7f96a40b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.487+0000 7f96ac42d640 1 -- 172.21.15.17:0/4112223822 >> 172.21.15.17:0/4112223822 conn(0x7f96a40cb1b0 msgr2=0x7f96a40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:46.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.487+0000 7f96ac42d640 1 -- 172.21.15.17:0/4112223822 shutdown_connections 2023-08-09T12:45:46.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.487+0000 7f96ac42d640 1 -- 172.21.15.17:0/4112223822 wait complete. 2023-08-09T12:45:46.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.489+0000 7f96ac42d640 1 Processor -- start 2023-08-09T12:45:46.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.489+0000 7f96ac42d640 1 -- start start 2023-08-09T12:45:46.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.490+0000 7f96ac42d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a40adc40 0x7f96a415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.490+0000 7f96ac42d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a40b3b40 0x7f96a415cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.490+0000 7f96ac42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.490+0000 7f96ac42d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a415d380 con 0x7f96a40b3b40 2023-08-09T12:45:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.490+0000 7f96ac42d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4156b70 con 0x7f96a40adc40 2023-08-09T12:45:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.490+0000 7f96ac42d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4156e50 con 0x7f96a40cc630 2023-08-09T12:45:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.490+0000 7f96a99c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a40b3b40 0x7f96a415cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96a99c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a40b3b40 0x7f96a415cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55080/0 (socket says 172.21.15.17:55080) 2023-08-09T12:45:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96a99c8640 1 -- 172.21.15.17:0/3588796757 learned_addr learned my addr 172.21.15.17:0/3588796757 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96aa9ca640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96a99c8640 1 -- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 msgr2=0x7f96a40c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96a99c8640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96a99c8640 1 -- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a40adc40 msgr2=0x7f96a415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96a99c8640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a40adc40 0x7f96a415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96a99c8640 1 -- 172.21.15.17:0/3588796757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940093a0 con 0x7f96a40b3b40 2023-08-09T12:45:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.491+0000 7f96a99c8640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a40b3b40 0x7f96a415cb00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f969400ebe0 tx=0x7f969400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.492+0000 7f969affd640 1 -- 172.21.15.17:0/3588796757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694009750 con 0x7f96a40b3b40 2023-08-09T12:45:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.492+0000 7f969affd640 1 -- 172.21.15.17:0/3588796757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969400cc30 con 0x7f96a40b3b40 2023-08-09T12:45:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.492+0000 7f969affd640 1 -- 172.21.15.17:0/3588796757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400eee0 con 0x7f96a40b3b40 2023-08-09T12:45:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.492+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c009400 con 0x7f96a40b3b40 2023-08-09T12:45:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.492+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a4157410 con 0x7f96a40b3b40 2023-08-09T12:45:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.493+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a4067a80 con 0x7f96a40b3b40 2023-08-09T12:45:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.494+0000 7f969affd640 1 -- 172.21.15.17:0/3588796757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9694005990 con 0x7f96a40b3b40 2023-08-09T12:45:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.495+0000 7f969affd640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a050 0x7f968806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.495+0000 7f969affd640 1 -- 172.21.15.17:0/3588796757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9694088bb0 con 0x7f96a40b3b40 2023-08-09T12:45:46.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.496+0000 7f96aa1c9640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a050 0x7f968806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.497+0000 7f96aa1c9640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a050 0x7f968806c510 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f96a0001fd0 tx=0x7f96a00015c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.499+0000 7f969affd640 1 -- 172.21.15.17:0/3588796757 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9694057c90 con 0x7f96a40b3b40 2023-08-09T12:45:46.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.730+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96a406ed40 con 0x7f96a40b3b40 2023-08-09T12:45:46.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.731+0000 7f969affd640 1 -- 172.21.15.17:0/3588796757 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f9694058e60 con 0x7f96a40b3b40 2023-08-09T12:45:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:46.735 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:45:46.735 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:45:46.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.734+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a050 msgr2=0x7f968806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.734+0000 7f96ac42d640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a050 0x7f968806c510 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f96a0001fd0 tx=0x7f96a00015c0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.734+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a40b3b40 msgr2=0x7f96a415cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.734+0000 7f96ac42d640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a40b3b40 0x7f96a415cb00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f969400ebe0 tx=0x7f969400c520 comp rx=0 tx=0).stop 2023-08-09T12:45:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.735+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 shutdown_connections 2023-08-09T12:45:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.735+0000 7f96ac42d640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f968806a050 0x7f968806c510 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.735+0000 7f96ac42d640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96a40cc630 0x7f96a40c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.735+0000 7f96ac42d640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a40b3b40 0x7f96a415cb00 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.735+0000 7f96ac42d640 1 --2- 172.21.15.17:0/3588796757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96a40adc40 0x7f96a415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.735+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 >> 172.21.15.17:0/3588796757 conn(0x7f96a40cb1b0 msgr2=0x7f96a40af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.735+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 shutdown_connections 2023-08-09T12:45:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.735+0000 7f96ac42d640 1 -- 172.21.15.17:0/3588796757 wait complete. 2023-08-09T12:45:46.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:45:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.977+0000 7fe351a4d640 1 Processor -- start 2023-08-09T12:45:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.977+0000 7fe351a4d640 1 -- start start 2023-08-09T12:45:46.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.978+0000 7fe351a4d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe34c15ce90 0x7fe34c1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.978+0000 7fe351a4d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c0b6460 con 0x7fe34c0d29d0 2023-08-09T12:45:46.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.978+0000 7fe351a4d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c0cdd10 con 0x7fe34c0b6000 2023-08-09T12:45:46.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.978+0000 7fe351a4d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34c0cdff0 con 0x7fe34c15ce90 2023-08-09T12:45:46.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.979+0000 7fe34affd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe34c15ce90 0x7fe34c1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.979+0000 7fe34affd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe34c15ce90 0x7fe34c1616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55088/0 (socket says 172.21.15.17:55088) 2023-08-09T12:45:46.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.979+0000 7fe34affd640 1 -- 172.21.15.17:0/1295170562 learned_addr learned my addr 172.21.15.17:0/1295170562 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:46.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.979+0000 7fe34b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe34c0d29d0 0x7fe34c0d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60536/0 (socket says 172.21.15.17:60536) 2023-08-09T12:45:46.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.979+0000 7fe34affd640 1 -- 172.21.15.17:0/1295170562 >> v1:172.21.15.142:6789/0 conn(0x7fe34c0b6000 legacy=0x7fe34c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.979+0000 7fe34affd640 1 -- 172.21.15.17:0/1295170562 >> v1:172.21.15.17:6789/0 conn(0x7fe34c0d29d0 legacy=0x7fe34c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.979+0000 7fe34affd640 1 -- 172.21.15.17:0/1295170562 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c0ce2d0 con 0x7fe34c15ce90 2023-08-09T12:45:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.979+0000 7fe349ffb640 1 -- 172.21.15.17:0/1295170562 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784829633 0 0) 0x7fe34c0b6460 con 0x7fe34c0d29d0 2023-08-09T12:45:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.980+0000 7fe34affd640 1 --2- 172.21.15.17:0/1295170562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c15ce90 0x7fe34c1616e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ade7b77dd7fdef7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.981+0000 7fe349ffb640 1 -- 172.21.15.17:0/1295170562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c02f850 con 0x7fe34c15ce90 2023-08-09T12:45:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.981+0000 7fe349ffb640 1 -- 172.21.15.17:0/1295170562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c02f9b0 con 0x7fe34c15ce90 2023-08-09T12:45:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.981+0000 7fe349ffb640 1 -- 172.21.15.17:0/1295170562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c02fd40 con 0x7fe34c15ce90 2023-08-09T12:45:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.981+0000 7fe351a4d640 1 -- 172.21.15.17:0/1295170562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c15ce90 msgr2=0x7fe34c1616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.981+0000 7fe351a4d640 1 --2- 172.21.15.17:0/1295170562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c15ce90 0x7fe34c1616e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c02ba30 comp rx=0 tx=0).stop 2023-08-09T12:45:46.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.982+0000 7fe351a4d640 1 -- 172.21.15.17:0/1295170562 shutdown_connections 2023-08-09T12:45:46.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.982+0000 7fe351a4d640 1 --2- 172.21.15.17:0/1295170562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c15ce90 0x7fe34c1616e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.982+0000 7fe351a4d640 1 -- 172.21.15.17:0/1295170562 >> 172.21.15.17:0/1295170562 conn(0x7fe34c06fde0 msgr2=0x7fe34c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:46.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.982+0000 7fe351a4d640 1 -- 172.21.15.17:0/1295170562 shutdown_connections 2023-08-09T12:45:46.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.982+0000 7fe351a4d640 1 -- 172.21.15.17:0/1295170562 wait complete. 2023-08-09T12:45:46.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.983+0000 7fe351a4d640 1 Processor -- start 2023-08-09T12:45:46.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.984+0000 7fe351a4d640 1 -- start start 2023-08-09T12:45:46.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe351a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c0b6000 0x7fe34c158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe351a4d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe34c0d29d0 0x7fe34c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe351a4d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe34c15ce90 0x7fe34c1e7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe351a4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c15e880 con 0x7fe34c0b6000 2023-08-09T12:45:46.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe351a4d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c15eb60 con 0x7fe34c0d29d0 2023-08-09T12:45:46.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe351a4d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c15ee40 con 0x7fe34c15ce90 2023-08-09T12:45:46.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c0b6000 0x7fe34c158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c0b6000 0x7fe34c158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55100/0 (socket says 172.21.15.17:55100) 2023-08-09T12:45:46.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34affd640 1 -- 172.21.15.17:0/614870999 learned_addr learned my addr 172.21.15.17:0/614870999 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:46.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34b7fe640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe34c15ce90 0x7fe34c1e7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34affd640 1 -- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe34c15ce90 msgr2=0x7fe34c1e7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34a7fc640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe34c0d29d0 0x7fe34c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34affd640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe34c15ce90 0x7fe34c1e7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34affd640 1 -- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe34c0d29d0 msgr2=0x7fe34c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:46.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34affd640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe34c0d29d0 0x7fe34c15df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:46.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34affd640 1 -- 172.21.15.17:0/614870999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0094d0 con 0x7fe34c0b6000 2023-08-09T12:45:46.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.985+0000 7fe34b7fe640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe34c15ce90 0x7fe34c1e7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:46.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.986+0000 7fe34affd640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c0b6000 0x7fe34c158290 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:46.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.986+0000 7fe333fff640 1 -- 172.21.15.17:0/614870999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c02f800 con 0x7fe34c0b6000 2023-08-09T12:45:46.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.986+0000 7fe333fff640 1 -- 172.21.15.17:0/614870999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c041400 con 0x7fe34c0b6000 2023-08-09T12:45:46.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.986+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c0b3200 con 0x7fe34c0b6000 2023-08-09T12:45:46.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.986+0000 7fe333fff640 1 -- 172.21.15.17:0/614870999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0417b0 con 0x7fe34c0b6000 2023-08-09T12:45:46.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.986+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c15e490 con 0x7fe34c0b6000 2023-08-09T12:45:46.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.988+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34c0b3040 con 0x7fe34c0b6000 2023-08-09T12:45:46.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.988+0000 7fe333fff640 1 -- 172.21.15.17:0/614870999 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe33c041910 con 0x7fe34c0b6000 2023-08-09T12:45:46.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.989+0000 7fe333fff640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33806a080 0x7fe33806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:46.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.989+0000 7fe333fff640 1 -- 172.21.15.17:0/614870999 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe33c03c070 con 0x7fe34c0b6000 2023-08-09T12:45:46.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.990+0000 7fe34a7fc640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33806a080 0x7fe33806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:46.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.991+0000 7fe34a7fc640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33806a080 0x7fe33806c540 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0d24a0 tx=0x7fe340009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:46.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:46.993+0000 7fe333fff640 1 -- 172.21.15.17:0/614870999 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe33c076cc0 con 0x7fe34c0b6000 2023-08-09T12:45:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.188+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe34c067a80 con 0x7fe34c0b6000 2023-08-09T12:45:47.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.192+0000 7fe333fff640 1 -- 172.21.15.17:0/614870999 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18281 (secure 0 0 0) 0x7fe33c07a2e0 con 0x7fe34c0b6000 2023-08-09T12:45:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:47.196 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":110,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:45:44.179943+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:45:41.039914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-09T12:45:41.697620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:45:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33806a080 msgr2=0x7fe33806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33806a080 0x7fe33806c540 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0d24a0 tx=0x7fe340009040 comp rx=0 tx=0).stop 2023-08-09T12:45:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c0b6000 msgr2=0x7fe34c158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c0b6000 0x7fe34c158290 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c004730 comp rx=0 tx=0).stop 2023-08-09T12:45:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 shutdown_connections 2023-08-09T12:45:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33806a080 0x7fe33806c540 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe34c15ce90 0x7fe34c1e7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe34c0d29d0 0x7fe34c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 --2- 172.21.15.17:0/614870999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe34c0b6000 0x7fe34c158290 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 >> 172.21.15.17:0/614870999 conn(0x7fe34c06fde0 msgr2=0x7fe34c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 shutdown_connections 2023-08-09T12:45:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.195+0000 7fe351a4d640 1 -- 172.21.15.17:0/614870999 wait complete. 2023-08-09T12:45:47.217 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:45:47.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:45:47.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.416+0000 7f56bab37640 1 Processor -- start 2023-08-09T12:45:47.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.416+0000 7f56bab37640 1 -- start start 2023-08-09T12:45:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.418+0000 7f56bab37640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f56b40b3fe0 0x7f56b40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.418+0000 7f56bab37640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b406fe10 con 0x7f56b40697c0 2023-08-09T12:45:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.418+0000 7f56bab37640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b4159fb0 con 0x7f56b4159bd0 2023-08-09T12:45:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.418+0000 7f56bab37640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b40b11a0 con 0x7f56b40b3fe0 2023-08-09T12:45:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.418+0000 7f56b9334640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f56b40b3fe0 0x7f56b40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.419+0000 7f56b9334640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f56b40b3fe0 0x7f56b40ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55110/0 (socket says 172.21.15.17:55110) 2023-08-09T12:45:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.419+0000 7f56b9334640 1 -- 172.21.15.17:0/883551621 learned_addr learned my addr 172.21.15.17:0/883551621 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.419+0000 7f56ba336640 1 --1- 172.21.15.17:0/883551621 >> v1:172.21.15.17:6789/0 conn(0x7f56b40697c0 0x7f56b40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60550/0 (socket says 172.21.15.17:60550) 2023-08-09T12:45:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.419+0000 7f56b9334640 1 -- 172.21.15.17:0/883551621 >> v1:172.21.15.142:6789/0 conn(0x7f56b4159bd0 legacy=0x7f56b4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.419+0000 7f56b9334640 1 -- 172.21.15.17:0/883551621 >> v1:172.21.15.17:6789/0 conn(0x7f56b40697c0 legacy=0x7f56b40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.419+0000 7f56b9334640 1 -- 172.21.15.17:0/883551621 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b4070970 con 0x7f56b40b3fe0 2023-08-09T12:45:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.420+0000 7f56b9334640 1 --2- 172.21.15.17:0/883551621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40ca730 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f56a400bb10 tx=0x7f56a402e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3540aa7d7f51b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.421+0000 7f56b8b33640 1 -- 172.21.15.17:0/883551621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4036440 con 0x7f56b40b3fe0 2023-08-09T12:45:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.421+0000 7f56b8b33640 1 -- 172.21.15.17:0/883551621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a40365a0 con 0x7f56b40b3fe0 2023-08-09T12:45:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.421+0000 7f56b8b33640 1 -- 172.21.15.17:0/883551621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4036930 con 0x7f56b40b3fe0 2023-08-09T12:45:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.421+0000 7f56bab37640 1 -- 172.21.15.17:0/883551621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 msgr2=0x7f56b40ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.421+0000 7f56bab37640 1 --2- 172.21.15.17:0/883551621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40ca730 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f56a400bb10 tx=0x7f56a402e160 comp rx=0 tx=0).stop 2023-08-09T12:45:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.421+0000 7f56bab37640 1 -- 172.21.15.17:0/883551621 shutdown_connections 2023-08-09T12:45:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.421+0000 7f56bab37640 1 --2- 172.21.15.17:0/883551621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40ca730 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.421+0000 7f56bab37640 1 -- 172.21.15.17:0/883551621 >> 172.21.15.17:0/883551621 conn(0x7f56b40b1d50 msgr2=0x7f56b406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:47.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.422+0000 7f56bab37640 1 -- 172.21.15.17:0/883551621 shutdown_connections 2023-08-09T12:45:47.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.422+0000 7f56bab37640 1 -- 172.21.15.17:0/883551621 wait complete. 2023-08-09T12:45:47.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.423+0000 7f56bab37640 1 Processor -- start 2023-08-09T12:45:47.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.424+0000 7f56bab37640 1 -- start start 2023-08-09T12:45:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56bab37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56b40697c0 0x7f56b41567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56bab37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56bab37640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56b4159bd0 0x7f56b40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56bab37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41f3680 con 0x7f56b40b3fe0 2023-08-09T12:45:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56bab37640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b40b07f0 con 0x7f56b4159bd0 2023-08-09T12:45:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56bab37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b4156d00 con 0x7f56b40697c0 2023-08-09T12:45:47.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56b9334640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56b9334640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55120/0 (socket says 172.21.15.17:55120) 2023-08-09T12:45:47.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56b9334640 1 -- 172.21.15.17:0/3089755883 learned_addr learned my addr 172.21.15.17:0/3089755883 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:47.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56b9b35640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56b40697c0 0x7f56b41567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.425+0000 7f56ba336640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56b4159bd0 0x7f56b40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56b9334640 1 -- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56b40697c0 msgr2=0x7f56b41567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56b9334640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56b40697c0 0x7f56b41567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56b9334640 1 -- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56b4159bd0 msgr2=0x7f56b40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56b9334640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56b4159bd0 0x7f56b40c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56b9334640 1 -- 172.21.15.17:0/3089755883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a400b770 con 0x7f56b40b3fe0 2023-08-09T12:45:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56b9334640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40c3d20 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f56a402e1a0 tx=0x7f56a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56aa7fc640 1 -- 172.21.15.17:0/3089755883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4034b80 con 0x7f56b40b3fe0 2023-08-09T12:45:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56aa7fc640 1 -- 172.21.15.17:0/3089755883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4034ce0 con 0x7f56b40b3fe0 2023-08-09T12:45:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b40c4f50 con 0x7f56b40b3fe0 2023-08-09T12:45:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.426+0000 7f56aa7fc640 1 -- 172.21.15.17:0/3089755883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a40416a0 con 0x7f56b40b3fe0 2023-08-09T12:45:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.427+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b41f2de0 con 0x7f56b40b3fe0 2023-08-09T12:45:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.428+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b41f5d40 con 0x7f56b40b3fe0 2023-08-09T12:45:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.429+0000 7f56aa7fc640 1 -- 172.21.15.17:0/3089755883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f56a4049360 con 0x7f56b40b3fe0 2023-08-09T12:45:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.430+0000 7f56aa7fc640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f569806a050 0x7f569806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.430+0000 7f56aa7fc640 1 -- 172.21.15.17:0/3089755883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56a40aaf70 con 0x7f56b40b3fe0 2023-08-09T12:45:47.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.431+0000 7f56b9b35640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f569806a050 0x7f569806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.432+0000 7f56b9b35640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f569806a050 0x7f569806c510 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f56b40c1e50 tx=0x7f56b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:47.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.434+0000 7f56aa7fc640 1 -- 172.21.15.17:0/3089755883 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f56a40766d0 con 0x7f56b40b3fe0 2023-08-09T12:45:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.621+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56b40caed0 con 0x7f569806a050 2023-08-09T12:45:47.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.648+0000 7f56aa7fc640 1 -- 172.21.15.17:0/3089755883 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299984 (secure 0 0 0) 0x7f56b00050d0 con 0x7f569806a050 2023-08-09T12:45:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:47.656 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:45:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f569806a050 msgr2=0x7f569806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f569806a050 0x7f569806c510 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f56b40c1e50 tx=0x7f56b0009040 comp rx=0 tx=0).stop 2023-08-09T12:45:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 msgr2=0x7f56b40c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40c3d20 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f56a402e1a0 tx=0x7f56a40046c0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 shutdown_connections 2023-08-09T12:45:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f569806a050 0x7f569806c510 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56b4159bd0 0x7f56b40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40b3fe0 0x7f56b40c3d20 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 --2- 172.21.15.17:0/3089755883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56b40697c0 0x7f56b41567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 >> 172.21.15.17:0/3089755883 conn(0x7f56b40b1d50 msgr2=0x7f56b40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 shutdown_connections 2023-08-09T12:45:47.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.653+0000 7f56bab37640 1 -- 172.21.15.17:0/3089755883 wait complete. 2023-08-09T12:45:47.677 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-08-09T12:45:46.782311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556484,"statfs":{"total":1600000000,"available":1593839923,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.642597"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161210+0000","last_change":"2023-08-09T12:45:42.161210+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161210+0000","last_undegraded":"2023-08-09T12:45:42.161210+0000","last_fullsized":"2023-08-09T12:45:42.161210+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.166849+0000","last_change":"2023-08-09T12:45:42.166849+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.166849+0000","last_undegraded":"2023-08-09T12:45:42.166849+0000","last_fullsized":"2023-08-09T12:45:42.166849+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164929+0000","last_change":"2023-08-09T12:45:42.164929+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164929+0000","last_undegraded":"2023-08-09T12:45:42.164929+0000","last_fullsized":"2023-08-09T12:45:42.164929+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000704+0000","last_change":"2023-08-09T12:45:43.213782+0000","last_active":"2023-08-09T12:45:46.000704+0000","last_peered":"2023-08-09T12:45:46.000704+0000","last_clean":"2023-08-09T12:45:46.000704+0000","last_became_active":"2023-08-09T12:45:43.208612+0000","last_became_peered":"2023-08-09T12:45:43.208612+0000","last_unstale":"2023-08-09T12:45:46.000704+0000","last_undegraded":"2023-08-09T12:45:46.000704+0000","last_fullsized":"2023-08-09T12:45:46.000704+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:39.279681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157285+0000","last_change":"2023-08-09T12:45:42.157285+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157285+0000","last_undegraded":"2023-08-09T12:45:42.157285+0000","last_fullsized":"2023-08-09T12:45:42.157285+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187782+0000","last_change":"2023-08-09T12:45:43.220479+0000","last_active":"2023-08-09T12:45:44.187782+0000","last_peered":"2023-08-09T12:45:44.187782+0000","last_clean":"2023-08-09T12:45:44.187782+0000","last_became_active":"2023-08-09T12:45:43.219067+0000","last_became_peered":"2023-08-09T12:45:43.219067+0000","last_unstale":"2023-08-09T12:45:44.187782+0000","last_undegraded":"2023-08-09T12:45:44.187782+0000","last_fullsized":"2023-08-09T12:45:44.187782+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:33:26.728442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.168347+0000","last_change":"2023-08-09T12:45:42.168347+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.168347+0000","last_undegraded":"2023-08-09T12:45:42.168347+0000","last_fullsized":"2023-08-09T12:45:42.168347+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000642+0000","last_change":"2023-08-09T12:45:43.222222+0000","last_active":"2023-08-09T12:45:46.000642+0000","last_peered":"2023-08-09T12:45:46.000642+0000","last_clean":"2023-08-09T12:45:46.000642+0000","last_became_active":"2023-08-09T12:45:43.221414+0000","last_became_peered":"2023-08-09T12:45:43.221414+0000","last_unstale":"2023-08-09T12:45:46.000642+0000","last_undegraded":"2023-08-09T12:45:46.000642+0000","last_fullsized":"2023-08-09T12:45:46.000642+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:56.592868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163008+0000","last_change":"2023-08-09T12:45:42.163008+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163008+0000","last_undegraded":"2023-08-09T12:45:42.163008+0000","last_fullsized":"2023-08-09T12:45:42.163008+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161933+0000","last_change":"2023-08-09T12:45:42.161933+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161933+0000","last_undegraded":"2023-08-09T12:45:42.161933+0000","last_fullsized":"2023-08-09T12:45:42.161933+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.158457+0000","last_change":"2023-08-09T12:45:42.158457+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.158457+0000","last_undegraded":"2023-08-09T12:45:42.158457+0000","last_fullsized":"2023-08-09T12:45:42.158457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162043+0000","last_change":"2023-08-09T12:45:42.162043+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162043+0000","last_undegraded":"2023-08-09T12:45:42.162043+0000","last_fullsized":"2023-08-09T12:45:42.162043+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000997+0000","last_change":"2023-08-09T12:45:43.222062+0000","last_active":"2023-08-09T12:45:46.000997+0000","last_peered":"2023-08-09T12:45:46.000997+0000","last_clean":"2023-08-09T12:45:46.000997+0000","last_became_active":"2023-08-09T12:45:43.220036+0000","last_became_peered":"2023-08-09T12:45:43.220036+0000","last_unstale":"2023-08-09T12:45:46.000997+0000","last_undegraded":"2023-08-09T12:45:46.000997+0000","last_fullsized":"2023-08-09T12:45:46.000997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:32:26.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161558+0000","last_change":"2023-08-09T12:45:42.161558+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161558+0000","last_undegraded":"2023-08-09T12:45:42.161558+0000","last_fullsized":"2023-08-09T12:45:42.161558+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001377+0000","last_change":"2023-08-09T12:45:43.220452+0000","last_active":"2023-08-09T12:45:46.001377+0000","last_peered":"2023-08-09T12:45:46.001377+0000","last_clean":"2023-08-09T12:45:46.001377+0000","last_became_active":"2023-08-09T12:45:43.219442+0000","last_became_peered":"2023-08-09T12:45:43.219442+0000","last_unstale":"2023-08-09T12:45:46.001377+0000","last_undegraded":"2023-08-09T12:45:46.001377+0000","last_fullsized":"2023-08-09T12:45:46.001377+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:07:24.077186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187419+0000","last_change":"2023-08-09T12:45:43.215398+0000","last_active":"2023-08-09T12:45:44.187419+0000","last_peered":"2023-08-09T12:45:44.187419+0000","last_clean":"2023-08-09T12:45:44.187419+0000","last_became_active":"2023-08-09T12:45:43.208415+0000","last_became_peered":"2023-08-09T12:45:43.208415+0000","last_unstale":"2023-08-09T12:45:44.187419+0000","last_undegraded":"2023-08-09T12:45:44.187419+0000","last_fullsized":"2023-08-09T12:45:44.187419+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:29:31.561794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187082+0000","last_change":"2023-08-09T12:45:43.213178+0000","last_active":"2023-08-09T12:45:44.187082+0000","last_peered":"2023-08-09T12:45:44.187082+0000","last_clean":"2023-08-09T12:45:44.187082+0000","last_became_active":"2023-08-09T12:45:43.210516+0000","last_became_peered":"2023-08-09T12:45:43.210516+0000","last_unstale":"2023-08-09T12:45:44.187082+0000","last_undegraded":"2023-08-09T12:45:44.187082+0000","last_fullsized":"2023-08-09T12:45:44.187082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:17:21.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164026+0000","last_change":"2023-08-09T12:45:42.164026+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164026+0000","last_undegraded":"2023-08-09T12:45:42.164026+0000","last_fullsized":"2023-08-09T12:45:42.164026+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159847+0000","last_change":"2023-08-09T12:45:42.159847+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159847+0000","last_undegraded":"2023-08-09T12:45:42.159847+0000","last_fullsized":"2023-08-09T12:45:42.159847+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001736+0000","last_change":"2023-08-09T12:45:43.220290+0000","last_active":"2023-08-09T12:45:46.001736+0000","last_peered":"2023-08-09T12:45:46.001736+0000","last_clean":"2023-08-09T12:45:46.001736+0000","last_became_active":"2023-08-09T12:45:43.219092+0000","last_became_peered":"2023-08-09T12:45:43.219092+0000","last_unstale":"2023-08-09T12:45:46.001736+0000","last_undegraded":"2023-08-09T12:45:46.001736+0000","last_fullsized":"2023-08-09T12:45:46.001736+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:50.772522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157526+0000","last_change":"2023-08-09T12:45:42.157526+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157526+0000","last_undegraded":"2023-08-09T12:45:42.157526+0000","last_fullsized":"2023-08-09T12:45:42.157526+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157066+0000","last_change":"2023-08-09T12:45:42.157066+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157066+0000","last_undegraded":"2023-08-09T12:45:42.157066+0000","last_fullsized":"2023-08-09T12:45:42.157066+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154308+0000","last_change":"2023-08-09T12:45:42.154308+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154308+0000","last_undegraded":"2023-08-09T12:45:42.154308+0000","last_fullsized":"2023-08-09T12:45:42.154308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162404+0000","last_change":"2023-08-09T12:45:42.162404+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162404+0000","last_undegraded":"2023-08-09T12:45:42.162404+0000","last_fullsized":"2023-08-09T12:45:42.162404+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163371+0000","last_change":"2023-08-09T12:45:42.163371+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163371+0000","last_undegraded":"2023-08-09T12:45:42.163371+0000","last_fullsized":"2023-08-09T12:45:42.163371+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155911+0000","last_change":"2023-08-09T12:45:42.155911+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155911+0000","last_undegraded":"2023-08-09T12:45:42.155911+0000","last_fullsized":"2023-08-09T12:45:42.155911+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161542+0000","last_change":"2023-08-09T12:45:42.161542+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161542+0000","last_undegraded":"2023-08-09T12:45:42.161542+0000","last_fullsized":"2023-08-09T12:45:42.161542+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001780+0000","last_change":"2023-08-09T12:45:43.221846+0000","last_active":"2023-08-09T12:45:46.001780+0000","last_peered":"2023-08-09T12:45:46.001780+0000","last_clean":"2023-08-09T12:45:46.001780+0000","last_became_active":"2023-08-09T12:45:43.219183+0000","last_became_peered":"2023-08-09T12:45:43.219183+0000","last_unstale":"2023-08-09T12:45:46.001780+0000","last_undegraded":"2023-08-09T12:45:46.001780+0000","last_fullsized":"2023-08-09T12:45:46.001780+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:12.047475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.171415+0000","last_change":"2023-08-09T12:45:42.171415+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.171415+0000","last_undegraded":"2023-08-09T12:45:42.171415+0000","last_fullsized":"2023-08-09T12:45:42.171415+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155693+0000","last_change":"2023-08-09T12:45:42.155693+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155693+0000","last_undegraded":"2023-08-09T12:45:42.155693+0000","last_fullsized":"2023-08-09T12:45:42.155693+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.160364+0000","last_change":"2023-08-09T12:45:42.160364+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.160364+0000","last_undegraded":"2023-08-09T12:45:42.160364+0000","last_fullsized":"2023-08-09T12:45:42.160364+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187308+0000","last_change":"2023-08-09T12:45:43.212976+0000","last_active":"2023-08-09T12:45:44.187308+0000","last_peered":"2023-08-09T12:45:44.187308+0000","last_clean":"2023-08-09T12:45:44.187308+0000","last_became_active":"2023-08-09T12:45:43.210090+0000","last_became_peered":"2023-08-09T12:45:43.210090+0000","last_unstale":"2023-08-09T12:45:44.187308+0000","last_undegraded":"2023-08-09T12:45:44.187308+0000","last_fullsized":"2023-08-09T12:45:44.187308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:14.105191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188003+0000","last_change":"2023-08-09T12:45:43.220135+0000","last_active":"2023-08-09T12:45:44.188003+0000","last_peered":"2023-08-09T12:45:44.188003+0000","last_clean":"2023-08-09T12:45:44.188003+0000","last_became_active":"2023-08-09T12:45:43.214687+0000","last_became_peered":"2023-08-09T12:45:43.214687+0000","last_unstale":"2023-08-09T12:45:44.188003+0000","last_undegraded":"2023-08-09T12:45:44.188003+0000","last_fullsized":"2023-08-09T12:45:44.188003+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:31.661935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.169477+0000","last_change":"2023-08-09T12:45:42.169123+0000","last_active":"2023-08-09T12:45:42.169477+0000","last_peered":"2023-08-09T12:45:42.169477+0000","last_clean":"2023-08-09T12:45:42.169477+0000","last_became_active":"2023-08-09T12:45:42.168705+0000","last_became_peered":"2023-08-09T12:45:42.168705+0000","last_unstale":"2023-08-09T12:45:42.169477+0000","last_undegraded":"2023-08-09T12:45:42.169477+0000","last_fullsized":"2023-08-09T12:45:42.169477+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:48.565955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187492+0000","last_change":"2023-08-09T12:45:43.194527+0000","last_active":"2023-08-09T12:45:44.187492+0000","last_peered":"2023-08-09T12:45:44.187492+0000","last_clean":"2023-08-09T12:45:44.187492+0000","last_became_active":"2023-08-09T12:45:43.193850+0000","last_became_peered":"2023-08-09T12:45:43.193850+0000","last_unstale":"2023-08-09T12:45:44.187492+0000","last_undegraded":"2023-08-09T12:45:44.187492+0000","last_fullsized":"2023-08-09T12:45:44.187492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:34:15.244986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171471+0000","last_change":"2023-08-09T12:45:42.171355+0000","last_active":"2023-08-09T12:45:42.171471+0000","last_peered":"2023-08-09T12:45:42.171471+0000","last_clean":"2023-08-09T12:45:42.171471+0000","last_became_active":"2023-08-09T12:45:42.170706+0000","last_became_peered":"2023-08-09T12:45:42.170706+0000","last_unstale":"2023-08-09T12:45:42.171471+0000","last_undegraded":"2023-08-09T12:45:42.171471+0000","last_fullsized":"2023-08-09T12:45:42.171471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:09:47.921573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.170058+0000","last_change":"2023-08-09T12:45:42.170058+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.170058+0000","last_undegraded":"2023-08-09T12:45:42.170058+0000","last_fullsized":"2023-08-09T12:45:42.170058+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174243+0000","last_change":"2023-08-09T12:45:42.174144+0000","last_active":"2023-08-09T12:45:42.174243+0000","last_peered":"2023-08-09T12:45:42.174243+0000","last_clean":"2023-08-09T12:45:42.174243+0000","last_became_active":"2023-08-09T12:45:42.173218+0000","last_became_peered":"2023-08-09T12:45:42.173218+0000","last_unstale":"2023-08-09T12:45:42.174243+0000","last_undegraded":"2023-08-09T12:45:42.174243+0000","last_fullsized":"2023-08-09T12:45:42.174243+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:54:50.748372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186995+0000","last_change":"2023-08-09T12:45:43.207086+0000","last_active":"2023-08-09T12:45:44.186995+0000","last_peered":"2023-08-09T12:45:44.186995+0000","last_clean":"2023-08-09T12:45:44.186995+0000","last_became_active":"2023-08-09T12:45:43.203598+0000","last_became_peered":"2023-08-09T12:45:43.203598+0000","last_unstale":"2023-08-09T12:45:44.186995+0000","last_undegraded":"2023-08-09T12:45:44.186995+0000","last_fullsized":"2023-08-09T12:45:44.186995+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:50.199091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.170755+0000","last_change":"2023-08-09T12:45:42.170662+0000","last_active":"2023-08-09T12:45:42.170755+0000","last_peered":"2023-08-09T12:45:42.170755+0000","last_clean":"2023-08-09T12:45:42.170755+0000","last_became_active":"2023-08-09T12:45:42.170368+0000","last_became_peered":"2023-08-09T12:45:42.170368+0000","last_unstale":"2023-08-09T12:45:42.170755+0000","last_undegraded":"2023-08-09T12:45:42.170755+0000","last_fullsized":"2023-08-09T12:45:42.170755+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:24.757940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002114+0000","last_change":"2023-08-09T12:45:43.220102+0000","last_active":"2023-08-09T12:45:46.002114+0000","last_peered":"2023-08-09T12:45:46.002114+0000","last_clean":"2023-08-09T12:45:46.002114+0000","last_became_active":"2023-08-09T12:45:43.218701+0000","last_became_peered":"2023-08-09T12:45:43.218701+0000","last_unstale":"2023-08-09T12:45:46.002114+0000","last_undegraded":"2023-08-09T12:45:46.002114+0000","last_fullsized":"2023-08-09T12:45:46.002114+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:08.765300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158762+0000","last_change":"2023-08-09T12:45:42.158581+0000","last_active":"2023-08-09T12:45:42.158762+0000","last_peered":"2023-08-09T12:45:42.158762+0000","last_clean":"2023-08-09T12:45:42.158762+0000","last_became_active":"2023-08-09T12:45:42.157895+0000","last_became_peered":"2023-08-09T12:45:42.157895+0000","last_unstale":"2023-08-09T12:45:42.158762+0000","last_undegraded":"2023-08-09T12:45:42.158762+0000","last_fullsized":"2023-08-09T12:45:42.158762+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:21:42.267168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.153059+0000","last_change":"2023-08-09T12:45:42.153059+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.153059+0000","last_undegraded":"2023-08-09T12:45:42.153059+0000","last_fullsized":"2023-08-09T12:45:42.153059+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001280+0000","last_change":"2023-08-09T12:45:42.173485+0000","last_active":"2023-08-09T12:45:46.001280+0000","last_peered":"2023-08-09T12:45:46.001280+0000","last_clean":"2023-08-09T12:45:46.001280+0000","last_became_active":"2023-08-09T12:45:42.173032+0000","last_became_peered":"2023-08-09T12:45:42.173032+0000","last_unstale":"2023-08-09T12:45:46.001280+0000","last_undegraded":"2023-08-09T12:45:46.001280+0000","last_fullsized":"2023-08-09T12:45:46.001280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.080795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187228+0000","last_change":"2023-08-09T12:45:43.214279+0000","last_active":"2023-08-09T12:45:44.187228+0000","last_peered":"2023-08-09T12:45:44.187228+0000","last_clean":"2023-08-09T12:45:44.187228+0000","last_became_active":"2023-08-09T12:45:43.213914+0000","last_became_peered":"2023-08-09T12:45:43.213914+0000","last_unstale":"2023-08-09T12:45:44.187228+0000","last_undegraded":"2023-08-09T12:45:44.187228+0000","last_fullsized":"2023-08-09T12:45:44.187228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:49:27.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.161901+0000","last_change":"2023-08-09T12:45:42.161901+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161901+0000","last_undegraded":"2023-08-09T12:45:42.161901+0000","last_fullsized":"2023-08-09T12:45:42.161901+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:31.040704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000702+0000","last_change":"2023-08-09T12:45:43.210681+0000","last_active":"2023-08-09T12:45:46.000702+0000","last_peered":"2023-08-09T12:45:46.000702+0000","last_clean":"2023-08-09T12:45:46.000702+0000","last_became_active":"2023-08-09T12:45:43.209762+0000","last_became_peered":"2023-08-09T12:45:43.209762+0000","last_unstale":"2023-08-09T12:45:46.000702+0000","last_undegraded":"2023-08-09T12:45:46.000702+0000","last_fullsized":"2023-08-09T12:45:46.000702+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:52:34.879127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.172852+0000","last_change":"2023-08-09T12:45:42.172728+0000","last_active":"2023-08-09T12:45:42.172852+0000","last_peered":"2023-08-09T12:45:42.172852+0000","last_clean":"2023-08-09T12:45:42.172852+0000","last_became_active":"2023-08-09T12:45:42.172043+0000","last_became_peered":"2023-08-09T12:45:42.172043+0000","last_unstale":"2023-08-09T12:45:42.172852+0000","last_undegraded":"2023-08-09T12:45:42.172852+0000","last_fullsized":"2023-08-09T12:45:42.172852+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:52:08.457096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155247+0000","last_change":"2023-08-09T12:45:42.155247+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155247+0000","last_undegraded":"2023-08-09T12:45:42.155247+0000","last_fullsized":"2023-08-09T12:45:42.155247+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.173118+0000","last_change":"2023-08-09T12:45:42.170330+0000","last_active":"2023-08-09T12:45:42.173118+0000","last_peered":"2023-08-09T12:45:42.173118+0000","last_clean":"2023-08-09T12:45:42.173118+0000","last_became_active":"2023-08-09T12:45:42.169301+0000","last_became_peered":"2023-08-09T12:45:42.169301+0000","last_unstale":"2023-08-09T12:45:42.173118+0000","last_undegraded":"2023-08-09T12:45:42.173118+0000","last_fullsized":"2023-08-09T12:45:42.173118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:20:33.769406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164521+0000","last_change":"2023-08-09T12:45:42.164521+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164521+0000","last_undegraded":"2023-08-09T12:45:42.164521+0000","last_fullsized":"2023-08-09T12:45:42.164521+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.162977+0000","last_change":"2023-08-09T12:45:42.162977+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162977+0000","last_undegraded":"2023-08-09T12:45:42.162977+0000","last_fullsized":"2023-08-09T12:45:42.162977+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:43.375069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163437+0000","last_change":"2023-08-09T12:45:42.163437+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163437+0000","last_undegraded":"2023-08-09T12:45:42.163437+0000","last_fullsized":"2023-08-09T12:45:42.163437+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.166921+0000","last_change":"2023-08-09T12:45:42.166679+0000","last_active":"2023-08-09T12:45:42.166921+0000","last_peered":"2023-08-09T12:45:42.166921+0000","last_clean":"2023-08-09T12:45:42.166921+0000","last_became_active":"2023-08-09T12:45:42.166306+0000","last_became_peered":"2023-08-09T12:45:42.166306+0000","last_unstale":"2023-08-09T12:45:42.166921+0000","last_undegraded":"2023-08-09T12:45:42.166921+0000","last_fullsized":"2023-08-09T12:45:42.166921+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:12.598589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001536+0000","last_change":"2023-08-09T12:45:43.217109+0000","last_active":"2023-08-09T12:45:46.001536+0000","last_peered":"2023-08-09T12:45:46.001536+0000","last_clean":"2023-08-09T12:45:46.001536+0000","last_became_active":"2023-08-09T12:45:43.216368+0000","last_became_peered":"2023-08-09T12:45:43.216368+0000","last_unstale":"2023-08-09T12:45:46.001536+0000","last_undegraded":"2023-08-09T12:45:46.001536+0000","last_fullsized":"2023-08-09T12:45:46.001536+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:05:21.390158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"109'6","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187481+0000","last_change":"2023-08-09T12:45:42.169490+0000","last_active":"2023-08-09T12:45:44.187481+0000","last_peered":"2023-08-09T12:45:44.187481+0000","last_clean":"2023-08-09T12:45:44.187481+0000","last_became_active":"2023-08-09T12:45:42.169083+0000","last_became_peered":"2023-08-09T12:45:42.169083+0000","last_unstale":"2023-08-09T12:45:44.187481+0000","last_undegraded":"2023-08-09T12:45:44.187481+0000","last_fullsized":"2023-08-09T12:45:44.187481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.655063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002255+0000","last_change":"2023-08-09T12:45:43.213666+0000","last_active":"2023-08-09T12:45:46.002255+0000","last_peered":"2023-08-09T12:45:46.002255+0000","last_clean":"2023-08-09T12:45:46.002255+0000","last_became_active":"2023-08-09T12:45:43.211302+0000","last_became_peered":"2023-08-09T12:45:43.211302+0000","last_unstale":"2023-08-09T12:45:46.002255+0000","last_undegraded":"2023-08-09T12:45:46.002255+0000","last_fullsized":"2023-08-09T12:45:46.002255+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:28:50.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.173563+0000","last_change":"2023-08-09T12:45:42.173486+0000","last_active":"2023-08-09T12:45:42.173563+0000","last_peered":"2023-08-09T12:45:42.173563+0000","last_clean":"2023-08-09T12:45:42.173563+0000","last_became_active":"2023-08-09T12:45:42.172463+0000","last_became_peered":"2023-08-09T12:45:42.172463+0000","last_unstale":"2023-08-09T12:45:42.173563+0000","last_undegraded":"2023-08-09T12:45:42.173563+0000","last_fullsized":"2023-08-09T12:45:42.173563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:43:08.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154768+0000","last_change":"2023-08-09T12:45:42.154768+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154768+0000","last_undegraded":"2023-08-09T12:45:42.154768+0000","last_fullsized":"2023-08-09T12:45:42.154768+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188072+0000","last_change":"2023-08-09T12:45:42.170960+0000","last_active":"2023-08-09T12:45:44.188072+0000","last_peered":"2023-08-09T12:45:44.188072+0000","last_clean":"2023-08-09T12:45:44.188072+0000","last_became_active":"2023-08-09T12:45:42.170519+0000","last_became_peered":"2023-08-09T12:45:42.170519+0000","last_unstale":"2023-08-09T12:45:44.188072+0000","last_undegraded":"2023-08-09T12:45:44.188072+0000","last_fullsized":"2023-08-09T12:45:44.188072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:08:04.874324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159739+0000","last_change":"2023-08-09T12:45:42.159739+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159739+0000","last_undegraded":"2023-08-09T12:45:42.159739+0000","last_fullsized":"2023-08-09T12:45:42.159739+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000943+0000","last_change":"2023-08-09T12:45:42.170297+0000","last_active":"2023-08-09T12:45:46.000943+0000","last_peered":"2023-08-09T12:45:46.000943+0000","last_clean":"2023-08-09T12:45:46.000943+0000","last_became_active":"2023-08-09T12:45:42.169795+0000","last_became_peered":"2023-08-09T12:45:42.169795+0000","last_unstale":"2023-08-09T12:45:46.000943+0000","last_undegraded":"2023-08-09T12:45:46.000943+0000","last_fullsized":"2023-08-09T12:45:46.000943+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:12:25.996027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159891+0000","last_change":"2023-08-09T12:45:42.159891+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159891+0000","last_undegraded":"2023-08-09T12:45:42.159891+0000","last_fullsized":"2023-08-09T12:45:42.159891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"109'8","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001962+0000","last_change":"2023-08-09T12:45:42.170246+0000","last_active":"2023-08-09T12:45:46.001962+0000","last_peered":"2023-08-09T12:45:46.001962+0000","last_clean":"2023-08-09T12:45:46.001962+0000","last_became_active":"2023-08-09T12:45:42.169960+0000","last_became_peered":"2023-08-09T12:45:42.169960+0000","last_unstale":"2023-08-09T12:45:46.001962+0000","last_undegraded":"2023-08-09T12:45:46.001962+0000","last_fullsized":"2023-08-09T12:45:46.001962+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:49:26.573151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.152115+0000","last_change":"2023-08-09T12:45:42.152115+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.152115+0000","last_undegraded":"2023-08-09T12:45:42.152115+0000","last_fullsized":"2023-08-09T12:45:42.152115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171025+0000","last_change":"2023-08-09T12:45:42.170944+0000","last_active":"2023-08-09T12:45:42.171025+0000","last_peered":"2023-08-09T12:45:42.171025+0000","last_clean":"2023-08-09T12:45:42.171025+0000","last_became_active":"2023-08-09T12:45:42.170658+0000","last_became_peered":"2023-08-09T12:45:42.170658+0000","last_unstale":"2023-08-09T12:45:42.171025+0000","last_undegraded":"2023-08-09T12:45:42.171025+0000","last_fullsized":"2023-08-09T12:45:42.171025+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:42.449824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187233+0000","last_change":"2023-08-09T12:45:43.209718+0000","last_active":"2023-08-09T12:45:44.187233+0000","last_peered":"2023-08-09T12:45:44.187233+0000","last_clean":"2023-08-09T12:45:44.187233+0000","last_became_active":"2023-08-09T12:45:43.208102+0000","last_became_peered":"2023-08-09T12:45:43.208102+0000","last_unstale":"2023-08-09T12:45:44.187233+0000","last_undegraded":"2023-08-09T12:45:44.187233+0000","last_fullsized":"2023-08-09T12:45:44.187233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:50.899939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174927+0000","last_change":"2023-08-09T12:45:42.173319+0000","last_active":"2023-08-09T12:45:42.174927+0000","last_peered":"2023-08-09T12:45:42.174927+0000","last_clean":"2023-08-09T12:45:42.174927+0000","last_became_active":"2023-08-09T12:45:42.173050+0000","last_became_peered":"2023-08-09T12:45:42.173050+0000","last_unstale":"2023-08-09T12:45:42.174927+0000","last_undegraded":"2023-08-09T12:45:42.174927+0000","last_fullsized":"2023-08-09T12:45:42.174927+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:53:44.942746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187418+0000","last_change":"2023-08-09T12:45:43.207367+0000","last_active":"2023-08-09T12:45:44.187418+0000","last_peered":"2023-08-09T12:45:44.187418+0000","last_clean":"2023-08-09T12:45:44.187418+0000","last_became_active":"2023-08-09T12:45:43.204580+0000","last_became_peered":"2023-08-09T12:45:43.204580+0000","last_unstale":"2023-08-09T12:45:44.187418+0000","last_undegraded":"2023-08-09T12:45:44.187418+0000","last_fullsized":"2023-08-09T12:45:44.187418+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:35:03.227531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174793+0000","last_change":"2023-08-09T12:45:42.174675+0000","last_active":"2023-08-09T12:45:42.174793+0000","last_peered":"2023-08-09T12:45:42.174793+0000","last_clean":"2023-08-09T12:45:42.174793+0000","last_became_active":"2023-08-09T12:45:42.172063+0000","last_became_peered":"2023-08-09T12:45:42.172063+0000","last_unstale":"2023-08-09T12:45:42.174793+0000","last_undegraded":"2023-08-09T12:45:42.174793+0000","last_fullsized":"2023-08-09T12:45:42.174793+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:06.446881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.166272+0000","last_change":"2023-08-09T12:45:42.166272+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.166272+0000","last_undegraded":"2023-08-09T12:45:42.166272+0000","last_fullsized":"2023-08-09T12:45:42.166272+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.157349+0000","last_change":"2023-08-09T12:45:42.157166+0000","last_active":"2023-08-09T12:45:42.157349+0000","last_peered":"2023-08-09T12:45:42.157349+0000","last_clean":"2023-08-09T12:45:42.157349+0000","last_became_active":"2023-08-09T12:45:42.156526+0000","last_became_peered":"2023-08-09T12:45:42.156526+0000","last_unstale":"2023-08-09T12:45:42.157349+0000","last_undegraded":"2023-08-09T12:45:42.157349+0000","last_fullsized":"2023-08-09T12:45:42.157349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:58:27.924929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.160963+0000","last_change":"2023-08-09T12:45:42.160963+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.160963+0000","last_undegraded":"2023-08-09T12:45:42.160963+0000","last_fullsized":"2023-08-09T12:45:42.160963+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188157+0000","last_change":"2023-08-09T12:45:42.168078+0000","last_active":"2023-08-09T12:45:44.188157+0000","last_peered":"2023-08-09T12:45:44.188157+0000","last_clean":"2023-08-09T12:45:44.188157+0000","last_became_active":"2023-08-09T12:45:42.167759+0000","last_became_peered":"2023-08-09T12:45:42.167759+0000","last_unstale":"2023-08-09T12:45:44.188157+0000","last_undegraded":"2023-08-09T12:45:44.188157+0000","last_fullsized":"2023-08-09T12:45:44.188157+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:51.969009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164478+0000","last_change":"2023-08-09T12:45:42.164478+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164478+0000","last_undegraded":"2023-08-09T12:45:42.164478+0000","last_fullsized":"2023-08-09T12:45:42.164478+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.175062+0000","last_change":"2023-08-09T12:45:42.174892+0000","last_active":"2023-08-09T12:45:42.175062+0000","last_peered":"2023-08-09T12:45:42.175062+0000","last_clean":"2023-08-09T12:45:42.175062+0000","last_became_active":"2023-08-09T12:45:42.172982+0000","last_became_peered":"2023-08-09T12:45:42.172982+0000","last_unstale":"2023-08-09T12:45:42.175062+0000","last_undegraded":"2023-08-09T12:45:42.175062+0000","last_fullsized":"2023-08-09T12:45:42.175062+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:13:37.150933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157194+0000","last_change":"2023-08-09T12:45:42.157194+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157194+0000","last_undegraded":"2023-08-09T12:45:42.157194+0000","last_fullsized":"2023-08-09T12:45:42.157194+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.161908+0000","last_change":"2023-08-09T12:45:42.161730+0000","last_active":"2023-08-09T12:45:42.161908+0000","last_peered":"2023-08-09T12:45:42.161908+0000","last_clean":"2023-08-09T12:45:42.161908+0000","last_became_active":"2023-08-09T12:45:42.160990+0000","last_became_peered":"2023-08-09T12:45:42.160990+0000","last_unstale":"2023-08-09T12:45:42.161908+0000","last_undegraded":"2023-08-09T12:45:42.161908+0000","last_fullsized":"2023-08-09T12:45:42.161908+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:18.677102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187917+0000","last_change":"2023-08-09T12:45:43.219911+0000","last_active":"2023-08-09T12:45:44.187917+0000","last_peered":"2023-08-09T12:45:44.187917+0000","last_clean":"2023-08-09T12:45:44.187917+0000","last_became_active":"2023-08-09T12:45:43.214021+0000","last_became_peered":"2023-08-09T12:45:43.214021+0000","last_unstale":"2023-08-09T12:45:44.187917+0000","last_undegraded":"2023-08-09T12:45:44.187917+0000","last_fullsized":"2023-08-09T12:45:44.187917+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:07.660676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.176022+0000","last_change":"2023-08-09T12:45:42.175573+0000","last_active":"2023-08-09T12:45:42.176022+0000","last_peered":"2023-08-09T12:45:42.176022+0000","last_clean":"2023-08-09T12:45:42.176022+0000","last_became_active":"2023-08-09T12:45:42.174408+0000","last_became_peered":"2023-08-09T12:45:42.174408+0000","last_unstale":"2023-08-09T12:45:42.176022+0000","last_undegraded":"2023-08-09T12:45:42.176022+0000","last_fullsized":"2023-08-09T12:45:42.176022+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:21:34.811103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.167806+0000","last_change":"2023-08-09T12:45:42.167806+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.167806+0000","last_undegraded":"2023-08-09T12:45:42.167806+0000","last_fullsized":"2023-08-09T12:45:42.167806+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001499+0000","last_change":"2023-08-09T12:45:42.173336+0000","last_active":"2023-08-09T12:45:46.001499+0000","last_peered":"2023-08-09T12:45:46.001499+0000","last_clean":"2023-08-09T12:45:46.001499+0000","last_became_active":"2023-08-09T12:45:42.173027+0000","last_became_peered":"2023-08-09T12:45:42.173027+0000","last_unstale":"2023-08-09T12:45:46.001499+0000","last_undegraded":"2023-08-09T12:45:46.001499+0000","last_fullsized":"2023-08-09T12:45:46.001499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:52.986927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":338,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158948+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:45:42.158948+0000","last_peered":"2023-08-09T12:45:42.158948+0000","last_clean":"2023-08-09T12:45:42.158948+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:45:42.158948+0000","last_undegraded":"2023-08-09T12:45:42.158948+0000","last_fullsized":"2023-08-09T12:45:42.158948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:00.329935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.160765+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:45:42.160765+0000","last_peered":"2023-08-09T12:45:42.160765+0000","last_clean":"2023-08-09T12:45:42.160765+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:45:42.160765+0000","last_undegraded":"2023-08-09T12:45:42.160765+0000","last_fullsized":"2023-08-09T12:45:42.160765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:35.037032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187486+0000","last_change":"2023-08-09T12:45:43.213774+0000","last_active":"2023-08-09T12:45:44.187486+0000","last_peered":"2023-08-09T12:45:44.187486+0000","last_clean":"2023-08-09T12:45:44.187486+0000","last_became_active":"2023-08-09T12:45:43.213507+0000","last_became_peered":"2023-08-09T12:45:43.213507+0000","last_unstale":"2023-08-09T12:45:44.187486+0000","last_undegraded":"2023-08-09T12:45:44.187486+0000","last_fullsized":"2023-08-09T12:45:44.187486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:18:30.758379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171171+0000","last_change":"2023-08-09T12:45:42.170733+0000","last_active":"2023-08-09T12:45:42.171171+0000","last_peered":"2023-08-09T12:45:42.171171+0000","last_clean":"2023-08-09T12:45:42.171171+0000","last_became_active":"2023-08-09T12:45:42.170416+0000","last_became_peered":"2023-08-09T12:45:42.170416+0000","last_unstale":"2023-08-09T12:45:42.171171+0000","last_undegraded":"2023-08-09T12:45:42.171171+0000","last_fullsized":"2023-08-09T12:45:42.171171+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:03:03.106880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158635+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:45:42.158635+0000","last_peered":"2023-08-09T12:45:42.158635+0000","last_clean":"2023-08-09T12:45:42.158635+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:45:42.158635+0000","last_undegraded":"2023-08-09T12:45:42.158635+0000","last_fullsized":"2023-08-09T12:45:42.158635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:15:08.262289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.156291+0000","last_change":"2023-08-09T12:45:42.156291+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.156291+0000","last_undegraded":"2023-08-09T12:45:42.156291+0000","last_fullsized":"2023-08-09T12:45:42.156291+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.176003+0000","last_change":"2023-08-09T12:45:42.175558+0000","last_active":"2023-08-09T12:45:42.176003+0000","last_peered":"2023-08-09T12:45:42.176003+0000","last_clean":"2023-08-09T12:45:42.176003+0000","last_became_active":"2023-08-09T12:45:42.175254+0000","last_became_peered":"2023-08-09T12:45:42.175254+0000","last_unstale":"2023-08-09T12:45:42.176003+0000","last_undegraded":"2023-08-09T12:45:42.176003+0000","last_fullsized":"2023-08-09T12:45:42.176003+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:27:04.977793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.146383+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:45:42.146383+0000","last_peered":"2023-08-09T12:45:42.146383+0000","last_clean":"2023-08-09T12:45:42.146383+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:45:42.146383+0000","last_undegraded":"2023-08-09T12:45:42.146383+0000","last_fullsized":"2023-08-09T12:45:42.146383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:38:39.646668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154723+0000","last_change":"2023-08-09T12:45:42.154723+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154723+0000","last_undegraded":"2023-08-09T12:45:42.154723+0000","last_fullsized":"2023-08-09T12:45:42.154723+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":6,"reported_epoch":108,"state":"active","last_fresh":"2023-08-09T12:45:42.174803+0000","last_change":"2023-08-09T12:45:42.174611+0000","last_active":"2023-08-09T12:45:42.174803+0000","last_peered":"2023-08-09T12:45:42.174803+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"2023-08-09T12:45:42.174611+0000","last_became_peered":"2023-08-09T12:45:42.174611+0000","last_unstale":"2023-08-09T12:45:42.174803+0000","last_undegraded":"2023-08-09T12:45:42.174803+0000","last_fullsized":"2023-08-09T12:45:42.174803+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:48.953496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.167216+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:45:42.167216+0000","last_peered":"2023-08-09T12:45:42.167216+0000","last_clean":"2023-08-09T12:45:42.167216+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:45:42.167216+0000","last_undegraded":"2023-08-09T12:45:42.167216+0000","last_fullsized":"2023-08-09T12:45:42.167216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:54.531530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187601+0000","last_change":"2023-08-09T12:45:43.220645+0000","last_active":"2023-08-09T12:45:44.187601+0000","last_peered":"2023-08-09T12:45:44.187601+0000","last_clean":"2023-08-09T12:45:44.187601+0000","last_became_active":"2023-08-09T12:45:43.219540+0000","last_became_peered":"2023-08-09T12:45:43.219540+0000","last_unstale":"2023-08-09T12:45:44.187601+0000","last_undegraded":"2023-08-09T12:45:44.187601+0000","last_fullsized":"2023-08-09T12:45:44.187601+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:25.671887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174369+0000","last_change":"2023-08-09T12:45:42.172661+0000","last_active":"2023-08-09T12:45:42.174369+0000","last_peered":"2023-08-09T12:45:42.174369+0000","last_clean":"2023-08-09T12:45:42.174369+0000","last_became_active":"2023-08-09T12:45:42.172329+0000","last_became_peered":"2023-08-09T12:45:42.172329+0000","last_unstale":"2023-08-09T12:45:42.174369+0000","last_undegraded":"2023-08-09T12:45:42.174369+0000","last_fullsized":"2023-08-09T12:45:42.174369+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:34:05.528627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002339+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:45:46.002339+0000","last_peered":"2023-08-09T12:45:46.002339+0000","last_clean":"2023-08-09T12:45:46.002339+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:45:46.002339+0000","last_undegraded":"2023-08-09T12:45:46.002339+0000","last_fullsized":"2023-08-09T12:45:46.002339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:04.608129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162571+0000","last_change":"2023-08-09T12:45:42.162571+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162571+0000","last_undegraded":"2023-08-09T12:45:42.162571+0000","last_fullsized":"2023-08-09T12:45:42.162571+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.146606+0000","last_change":"2023-08-09T12:45:42.146606+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.146606+0000","last_undegraded":"2023-08-09T12:45:42.146606+0000","last_fullsized":"2023-08-09T12:45:42.146606+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:42.436453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158351+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:45:42.158351+0000","last_peered":"2023-08-09T12:45:42.158351+0000","last_clean":"2023-08-09T12:45:42.158351+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:45:42.158351+0000","last_undegraded":"2023-08-09T12:45:42.158351+0000","last_fullsized":"2023-08-09T12:45:42.158351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:45:47.235734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159875+0000","last_change":"2023-08-09T12:45:42.159875+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159875+0000","last_undegraded":"2023-08-09T12:45:42.159875+0000","last_fullsized":"2023-08-09T12:45:42.159875+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174386+0000","last_change":"2023-08-09T12:45:42.174137+0000","last_active":"2023-08-09T12:45:42.174386+0000","last_peered":"2023-08-09T12:45:42.174386+0000","last_clean":"2023-08-09T12:45:42.174386+0000","last_became_active":"2023-08-09T12:45:42.173831+0000","last_became_peered":"2023-08-09T12:45:42.173831+0000","last_unstale":"2023-08-09T12:45:42.174386+0000","last_undegraded":"2023-08-09T12:45:42.174386+0000","last_fullsized":"2023-08-09T12:45:42.174386+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:37.726534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002368+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:45:46.002368+0000","last_peered":"2023-08-09T12:45:46.002368+0000","last_clean":"2023-08-09T12:45:46.002368+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:45:46.002368+0000","last_undegraded":"2023-08-09T12:45:46.002368+0000","last_fullsized":"2023-08-09T12:45:46.002368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:25.902601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187606+0000","last_change":"2023-08-09T12:45:43.207564+0000","last_active":"2023-08-09T12:45:44.187606+0000","last_peered":"2023-08-09T12:45:44.187606+0000","last_clean":"2023-08-09T12:45:44.187606+0000","last_became_active":"2023-08-09T12:45:43.206550+0000","last_became_peered":"2023-08-09T12:45:43.206550+0000","last_unstale":"2023-08-09T12:45:44.187606+0000","last_undegraded":"2023-08-09T12:45:44.187606+0000","last_fullsized":"2023-08-09T12:45:44.187606+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:37.720656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.146817+0000","last_change":"2023-08-09T12:45:42.146817+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.146817+0000","last_undegraded":"2023-08-09T12:45:42.146817+0000","last_fullsized":"2023-08-09T12:45:42.146817+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:03.177644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.149239+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:45:42.149239+0000","last_peered":"2023-08-09T12:45:42.149239+0000","last_clean":"2023-08-09T12:45:42.149239+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:45:42.149239+0000","last_undegraded":"2023-08-09T12:45:42.149239+0000","last_fullsized":"2023-08-09T12:45:42.149239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:23:37.763281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1185,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194126,"statfs":{"total":200000000,"available":198785984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.137,"15min":1.107},"min":{"1min":0.627,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.542,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.0860000000000001},"min":{"1min":0.89700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7769999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.82399999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.21,"15min":1.1160000000000001},"min":{"1min":0.748,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1990000000000001,"15min":1.117},"min":{"1min":0.79100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5600000000000001,"5min":1.734,"15min":1.734},"last":1.224}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.1819999999999999},"min":{"1min":0.69999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.96,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.083},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.1539999999999999},"min":{"1min":0.746,"5min":0.73399999999999999,"15min":0.69799999999999995},"max":{"1min":1.7070000000000001,"5min":2.173,"15min":2.173},"last":1.306}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3180000000000001,"15min":1.244},"min":{"1min":0.83299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.732,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.524},{"interface":"front","average":{"1min":1.345,"5min":1.353,"15min":1.2769999999999999},"min":{"1min":0.92600000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.843,"5min":2.282,"15min":2.282},"last":1.4590000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2330000000000001,"15min":1.202},"min":{"1min":0.81100000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6179999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.179},{"interface":"front","average":{"1min":1.341,"5min":1.3959999999999999,"15min":1.288},"min":{"1min":0.93700000000000006,"5min":0.67900000000000005,"15min":0.58599999999999997},"max":{"1min":2.0630000000000002,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.6259999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.427,"15min":1.3069999999999999},"min":{"1min":0.90200000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1699999999999999,"5min":2.802,"15min":2.802},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.587,"5min":1.516,"15min":1.4870000000000001},"min":{"1min":1.214,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.7799999999999998,"5min":3.1400000000000001,"15min":3.3580000000000001},"last":1.579}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4850000000000001,"15min":1.4690000000000001},"min":{"1min":1.0740000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.8849999999999998,"5min":3.266,"15min":3.4910000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.161,"5min":0.83699999999999997,"15min":0.623},"max":{"1min":2.3580000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.696}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1899999999999999,"15min":1.1299999999999999},"min":{"1min":0.79400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7929999999999999,"5min":2.54,"15min":2.54},"last":1.498},{"interface":"front","average":{"1min":1.139,"5min":1.127,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5469999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.92400000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.234},"min":{"1min":0.86299999999999999,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0009999999999999,"15min":2.306},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.3720000000000001,"15min":1.3260000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.613,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0309999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1659999999999999,"15min":1.1060000000000001},"min":{"1min":0.70199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5629999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3089999999999999,"15min":1.2749999999999999},"min":{"1min":0.93700000000000006,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.857,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.5940000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.363,"15min":1.2809999999999999},"min":{"1min":0.93600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.673,"5min":2.327,"15min":2.327},"last":1.131},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.359,"15min":1.296},"min":{"1min":1.0589999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.6819999999999999,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.538}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4650000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0139999999999998,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.363},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.403,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.766,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.214}]},{"osd":5,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.407,"15min":1.335},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.77600000000000002},"max":{"1min":1.8440000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.577,"15min":1.4890000000000001},"min":{"1min":1.2110000000000001,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":2.222,"5min":2.7160000000000002,"15min":2.8580000000000001},"last":1.679}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.597,"15min":1.4390000000000001},"min":{"1min":1.0820000000000001,"5min":1.0009999999999999,"15min":0.752},"max":{"1min":1.954,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":1.446},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.9690000000000001,"5min":3.621,"15min":3.621},"last":1.6419999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.131,"15min":1.117},"min":{"1min":0.77300000000000002,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.427},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.208,"15min":1.0880000000000001},"min":{"1min":0.81999999999999995,"5min":0.71699999999999997,"15min":0.625},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.3600000000000001,"15min":1.2989999999999999},"min":{"1min":1.0369999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.29,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.982,"5min":1.984,"15min":1.984},"last":1.137}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.236,"15min":1.21},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.2190000000000001,"15min":1.198},"min":{"1min":0.81399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3169999999999999,"15min":1.2150000000000001},"min":{"1min":0.96499999999999997,"5min":0.78000000000000003,"15min":0.77100000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.157},{"interface":"front","average":{"1min":1.502,"5min":1.383,"15min":1.381},"min":{"1min":1.1539999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.266,"15min":1.2370000000000001},"min":{"1min":0.88400000000000001,"5min":0.621,"15min":0.60699999999999998},"max":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":1.329},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.96899999999999997,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.496}]},{"osd":6,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3799999999999999,"15min":1.3420000000000001},"min":{"1min":1.0289999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.429,"15min":1.49},"min":{"1min":1.194,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.3879999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.5069999999999999,"15min":1.5229999999999999},"min":{"1min":1.2010000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.722,"5min":2.722,"15min":3.3250000000000002},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.72,"5min":1.5629999999999999,"15min":1.522},"min":{"1min":1.452,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.4670000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.141,"15min":1.087},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5529999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.165,"15min":1.101},"min":{"1min":0.83599999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4279999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.4830000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.3320000000000001},"min":{"1min":0.83999999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7589999999999999,"5min":1.897,"15min":1.97},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3009999999999999,"15min":1.329},"min":{"1min":0.92100000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.804,"5min":2.2040000000000002,"15min":2.7770000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.3169999999999999},"min":{"1min":0.81599999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.9810000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.3200000000000001,"15min":1.3109999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6539999999999999,"5min":1.929,"15min":1.929},"last":1.5309999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.28,"15min":1.228},"min":{"1min":0.82999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.623,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":1.665,"5min":2.081,"15min":2.081},"last":1.883}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3029999999999999,"15min":1.377},"min":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.615,"5min":1.853,"15min":1.9490000000000001},"last":1.323},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3899999999999999,"15min":1.385},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.665,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.5680000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.397,"15min":1.4850000000000001},"min":{"1min":0.76000000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.784,"5min":2.238,"15min":2.238},"last":2.101},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.756,"5min":2.036,"15min":2.036},"last":1.4370000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.542,"15min":1.5249999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8089999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.9350000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.552,"15min":1.619},"min":{"1min":0.89400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.9299999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":2.0470000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90400000000000003,"15min":0.83999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.3480000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.143,"5min":1.0549999999999999,"15min":0.91900000000000004},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":2.778,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.82399999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.91100000000000003,"15min":0.90600000000000003},"min":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.1399999999999999,"15min":0.94599999999999995},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.373},"max":{"1min":2.0219999999999998,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.98599999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.3360000000000001,"15min":1.119},"min":{"1min":0.59399999999999997,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":1.75,"5min":18.145,"15min":18.145},"last":1.361},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.2290000000000001,"15min":1.2090000000000001},"min":{"1min":0.66500000000000004,"5min":0.48999999999999999,"15min":0.41799999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.129}]},{"osd":4,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.323,"15min":1.331},"min":{"1min":0.98099999999999998,"5min":0.84399999999999997,"15min":0.745},"max":{"1min":1.712,"5min":2.972,"15min":3.5110000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.325,"15min":1.341},"min":{"1min":0.98999999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.712,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.294}]},{"osd":5,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.5760000000000001,"15min":1.444},"min":{"1min":1.099,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7210000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.512},{"interface":"front","average":{"1min":1.55,"5min":1.595,"15min":1.361},"min":{"1min":1.0249999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.2959999999999998,"5min":14.105,"15min":14.105},"last":1.0820000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.401,"15min":1.3500000000000001},"min":{"1min":1.091,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8999999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.4690000000000001,"15min":1.4810000000000001},"min":{"1min":0.93700000000000006,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8839999999999999,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.415}]},{"osd":7,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.4790000000000001,"15min":1.407},"min":{"1min":0.98599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.458,"15min":1.389},"min":{"1min":1.022,"5min":0.85699999999999998,"15min":0.70799999999999996},"max":{"1min":1.8180000000000001,"5min":3.016,"15min":3.016},"last":1.2549999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56799999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.716},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.107,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.38900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":2.9009999999999998},"last":1.236}]},{"osd":1,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.95399999999999996,"15min":0.93100000000000005},"min":{"1min":0.63700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4219999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.264,"5min":1.079,"15min":1.069},"min":{"1min":0.66700000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.823,"5min":1.823,"15min":1.869},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1719999999999999,"15min":1.1739999999999999},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.681,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.395,"5min":1.2050000000000001,"15min":1.1639999999999999},"min":{"1min":0.77300000000000002,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":2.0289999999999999,"5min":2.242,"15min":2.9409999999999998},"last":0.52800000000000002}]},{"osd":4,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.4770000000000001,"15min":1.429},"min":{"1min":1.1539999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7450000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.3799999999999999,"15min":1.288},"min":{"1min":0.97999999999999998,"5min":0.83199999999999996,"15min":0.66800000000000004},"max":{"1min":2.6509999999999998,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.1619999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.446,"15min":1.3680000000000001},"min":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.3210000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.046},{"interface":"front","average":{"1min":1.673,"5min":1.512,"15min":1.4910000000000001},"min":{"1min":1.034,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4780000000000002,"5min":4.806,"15min":4.806},"last":1.125}]},{"osd":6,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.399,"15min":1.321},"min":{"1min":0.82799999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.613,"5min":1.4790000000000001,"15min":1.431},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.7309999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.2}]},{"osd":7,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.89500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.579,"15min":1.542},"min":{"1min":0.995,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.6549999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.101}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":38,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":616,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194696,"statfs":{"total":200000000,"available":199369154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.53000000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.609,"5min":1.881,"15min":1.881},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":2.0529999999999999,"15min":1.2549999999999999},"min":{"1min":0.66400000000000003,"5min":0.47799999999999998,"15min":0.34300000000000003},"max":{"1min":1.863,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0469999999999999,"15min":0.95499999999999996},"min":{"1min":0.67400000000000004,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.476,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.337,"5min":1.306,"15min":1.147},"min":{"1min":0.91900000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.044,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1950000000000001,"15min":1.099},"min":{"1min":0.71999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.724,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.1779999999999999,"15min":0.97599999999999998},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.5740000000000001,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.55,"15min":1.2909999999999999},"min":{"1min":0.95999999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.5289999999999999,"5min":25.172000000000001,"15min":25.172000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.351,"5min":1.3819999999999999,"15min":1.302},"min":{"1min":0.94499999999999995,"5min":0.88500000000000001,"15min":0.84599999999999997},"max":{"1min":2.1589999999999998,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.669,"15min":1.399},"min":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8420000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.228},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3799999999999999,"15min":1.2849999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9059999999999999,"5min":3.762,"15min":3.762},"last":1.198}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.5449999999999999,"15min":1.431},"min":{"1min":0.91000000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.827,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.482,"15min":1.3839999999999999},"min":{"1min":1.0600000000000001,"5min":0.873,"15min":0.79500000000000004},"max":{"1min":1.7949999999999999,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.262}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.8680000000000001,"15min":1.5880000000000001},"min":{"1min":1.2829999999999999,"5min":0.96899999999999997,"15min":0.88800000000000001},"max":{"1min":2.5089999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.8759999999999999,"15min":1.5680000000000001},"min":{"1min":1.1379999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.7949999999999999,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.2929999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194111,"statfs":{"total":200000000,"available":198769885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.64500000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":1.389,"5min":1.819,"15min":1.819},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1040000000000001,"15min":0.96499999999999997},"min":{"1min":0.79200000000000004,"5min":0.53300000000000003,"15min":0.436},"max":{"1min":1.6160000000000001,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.92300000000000004}]},{"osd":2,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.038,"15min":0.96599999999999997},"min":{"1min":0.68899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.159,"15min":1.0369999999999999},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.5},"max":{"1min":1.732,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":0.63}]},{"osd":3,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.089,"15min":0.94699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.413,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.298},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.218,"15min":1.1830000000000001},"min":{"1min":0.72899999999999998,"5min":0.58199999999999996,"15min":0.56000000000000005},"max":{"1min":1.6950000000000001,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":1.375}]},{"osd":4,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3779999999999999,"15min":1.3340000000000001},"min":{"1min":0.81599999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8240000000000001,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.163},{"interface":"front","average":{"1min":1.419,"5min":1.3640000000000001,"15min":1.29},"min":{"1min":1.0289999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.45}]},{"osd":5,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4119999999999999,"15min":1.3129999999999999},"min":{"1min":0.91900000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.891,"5min":10.004,"15min":10.004},"last":1.407},{"interface":"front","average":{"1min":1.496,"5min":1.4330000000000001,"15min":1.3859999999999999},"min":{"1min":0.97799999999999998,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":1.8069999999999999,"5min":1.909,"15min":2.161},"last":1.2350000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4550000000000001,"15min":1.3480000000000001},"min":{"1min":1.1399999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9370000000000001,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.532,"15min":1.4350000000000001},"min":{"1min":1.0609999999999999,"5min":0.90100000000000002,"15min":0.86799999999999999},"max":{"1min":2.0099999999999998,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.5940000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.609,"15min":1.4390000000000001},"min":{"1min":1.202,"5min":0.80400000000000005,"15min":0.79200000000000004},"max":{"1min":1.8360000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.627,"5min":1.589,"15min":1.4710000000000001},"min":{"1min":1.1180000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.1120000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.506}]}]}],"pool_statfs":[]}} 2023-08-09T12:45:47.685 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:45:47.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.950+0000 7fe4881fd640 1 Processor -- start 2023-08-09T12:45:47.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.950+0000 7fe4881fd640 1 -- start start 2023-08-09T12:45:47.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.951+0000 7fe4881fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe480159d80 0x7fe4800b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.951+0000 7fe4881fd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4800ad810 0x7fe480070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.951+0000 7fe4881fd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe480070d20 con 0x7fe4800708c0 2023-08-09T12:45:47.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.951+0000 7fe4881fd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48015a160 con 0x7fe4800ad810 2023-08-09T12:45:47.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.951+0000 7fe4881fd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800b4630 con 0x7fe480159d80 2023-08-09T12:45:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.952+0000 7fe485798640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4800ad810 0x7fe480070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.952+0000 7fe485798640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4800ad810 0x7fe480070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45304/0 (socket says 172.21.15.17:45304) 2023-08-09T12:45:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.952+0000 7fe485798640 1 -- 172.21.15.17:0/3919012479 learned_addr learned my addr 172.21.15.17:0/3919012479 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.952+0000 7fe485f99640 1 --2- 172.21.15.17:0/3919012479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe480159d80 0x7fe4800b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.952+0000 7fe485798640 1 -- 172.21.15.17:0/3919012479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe480159d80 msgr2=0x7fe4800b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.952+0000 7fe485798640 1 --2- 172.21.15.17:0/3919012479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe480159d80 0x7fe4800b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.952+0000 7fe485798640 1 -- 172.21.15.17:0/3919012479 >> v1:172.21.15.142:6789/0 conn(0x7fe4800708c0 legacy=0x7fe48006eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:47.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.952+0000 7fe485798640 1 -- 172.21.15.17:0/3919012479 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800b3ab0 con 0x7fe4800ad810 2023-08-09T12:45:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.953+0000 7fe485798640 1 --2- 172.21.15.17:0/3919012479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4800ad810 0x7fe480070380 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe470009850 tx=0x7fe47002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f923e21fe1198ef1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.954+0000 7fe484f97640 1 -- 172.21.15.17:0/3919012479 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470004230 con 0x7fe4800ad810 2023-08-09T12:45:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.954+0000 7fe484f97640 1 -- 172.21.15.17:0/3919012479 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe470004390 con 0x7fe4800ad810 2023-08-09T12:45:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.954+0000 7fe484f97640 1 -- 172.21.15.17:0/3919012479 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470031830 con 0x7fe4800ad810 2023-08-09T12:45:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.954+0000 7fe4881fd640 1 -- 172.21.15.17:0/3919012479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4800ad810 msgr2=0x7fe480070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.954+0000 7fe4881fd640 1 --2- 172.21.15.17:0/3919012479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4800ad810 0x7fe480070380 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe470009850 tx=0x7fe47002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.955+0000 7fe4881fd640 1 -- 172.21.15.17:0/3919012479 shutdown_connections 2023-08-09T12:45:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.955+0000 7fe4881fd640 1 --2- 172.21.15.17:0/3919012479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4800ad810 0x7fe480070380 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.955+0000 7fe4881fd640 1 --2- 172.21.15.17:0/3919012479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe480159d80 0x7fe4800b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.955+0000 7fe4881fd640 1 -- 172.21.15.17:0/3919012479 >> 172.21.15.17:0/3919012479 conn(0x7fe4800cb1b0 msgr2=0x7fe4800cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.955+0000 7fe4881fd640 1 -- 172.21.15.17:0/3919012479 shutdown_connections 2023-08-09T12:45:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.955+0000 7fe4881fd640 1 -- 172.21.15.17:0/3919012479 wait complete. 2023-08-09T12:45:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.956+0000 7fe4881fd640 1 Processor -- start 2023-08-09T12:45:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.957+0000 7fe4881fd640 1 -- start start 2023-08-09T12:45:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe4881fd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4800708c0 0x7fe480145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe4881fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4800ad810 0x7fe4800ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe4881fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe480159d80 0x7fe4800ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe4881fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480163ee0 con 0x7fe480159d80 2023-08-09T12:45:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe4881fd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801674a0 con 0x7fe4800708c0 2023-08-09T12:45:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe4881fd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe480163820 con 0x7fe4800ad810 2023-08-09T12:45:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe48679a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe480159d80 0x7fe4800ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe48679a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe480159d80 0x7fe4800ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45310/0 (socket says 172.21.15.17:45310) 2023-08-09T12:45:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe48679a640 1 -- 172.21.15.17:0/1222975501 learned_addr learned my addr 172.21.15.17:0/1222975501 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe485798640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4800ad810 0x7fe4800ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe48679a640 1 -- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4800ad810 msgr2=0x7fe4800ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe48679a640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4800ad810 0x7fe4800ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe48679a640 1 -- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4800708c0 msgr2=0x7fe480145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe48679a640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4800708c0 0x7fe480145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.958+0000 7fe48679a640 1 -- 172.21.15.17:0/1222975501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe470009460 con 0x7fe480159d80 2023-08-09T12:45:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.959+0000 7fe48679a640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe480159d80 0x7fe4800ae6a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c780 tx=0x7fe47800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.959+0000 7fe4767fc640 1 -- 172.21.15.17:0/1222975501 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478004b60 con 0x7fe480159d80 2023-08-09T12:45:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.959+0000 7fe4767fc640 1 -- 172.21.15.17:0/1222975501 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47800ce90 con 0x7fe480159d80 2023-08-09T12:45:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.959+0000 7fe4767fc640 1 -- 172.21.15.17:0/1222975501 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800a850 con 0x7fe480159d80 2023-08-09T12:45:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.959+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480163b00 con 0x7fe480159d80 2023-08-09T12:45:47.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.959+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480145ca0 con 0x7fe480159d80 2023-08-09T12:45:47.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.960+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4800664b0 con 0x7fe480159d80 2023-08-09T12:45:47.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.961+0000 7fe4767fc640 1 -- 172.21.15.17:0/1222975501 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe47800a9b0 con 0x7fe480159d80 2023-08-09T12:45:47.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.962+0000 7fe4767fc640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe46406a050 0x7fe46406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.962+0000 7fe4767fc640 1 -- 172.21.15.17:0/1222975501 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe478088750 con 0x7fe480159d80 2023-08-09T12:45:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.963+0000 7fe485f99640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe46406a050 0x7fe46406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:47.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.964+0000 7fe485f99640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe46406a050 0x7fe46406c510 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00a810 tx=0x7fe47c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:47.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:47.967+0000 7fe4767fc640 1 -- 172.21.15.17:0/1222975501 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe478053e30 con 0x7fe480159d80 2023-08-09T12:45:48.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.159+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4800b3d90 con 0x7fe46406a050 2023-08-09T12:45:48.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.183+0000 7fe4767fc640 1 -- 172.21.15.17:0/1222975501 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299984 (secure 0 0 0) 0x7fe47c00a400 con 0x7fe46406a050 2023-08-09T12:45:48.190 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:45:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe46406a050 msgr2=0x7fe46406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe46406a050 0x7fe46406c510 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00a810 tx=0x7fe47c008040 comp rx=0 tx=0).stop 2023-08-09T12:45:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe480159d80 msgr2=0x7fe4800ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe480159d80 0x7fe4800ae6a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c780 tx=0x7fe47800cc40 comp rx=0 tx=0).stop 2023-08-09T12:45:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 shutdown_connections 2023-08-09T12:45:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe46406a050 0x7fe46406c510 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe480159d80 0x7fe4800ae6a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4800ad810 0x7fe4800ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 --2- 172.21.15.17:0/1222975501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4800708c0 0x7fe480145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 >> 172.21.15.17:0/1222975501 conn(0x7fe4800cb1b0 msgr2=0x7fe480151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 shutdown_connections 2023-08-09T12:45:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.189+0000 7fe4881fd640 1 -- 172.21.15.17:0/1222975501 wait complete. 2023-08-09T12:45:48.213 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-08-09T12:45:46.782311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556484,"statfs":{"total":1600000000,"available":1593839923,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.642597"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161210+0000","last_change":"2023-08-09T12:45:42.161210+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161210+0000","last_undegraded":"2023-08-09T12:45:42.161210+0000","last_fullsized":"2023-08-09T12:45:42.161210+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.166849+0000","last_change":"2023-08-09T12:45:42.166849+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.166849+0000","last_undegraded":"2023-08-09T12:45:42.166849+0000","last_fullsized":"2023-08-09T12:45:42.166849+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164929+0000","last_change":"2023-08-09T12:45:42.164929+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164929+0000","last_undegraded":"2023-08-09T12:45:42.164929+0000","last_fullsized":"2023-08-09T12:45:42.164929+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000704+0000","last_change":"2023-08-09T12:45:43.213782+0000","last_active":"2023-08-09T12:45:46.000704+0000","last_peered":"2023-08-09T12:45:46.000704+0000","last_clean":"2023-08-09T12:45:46.000704+0000","last_became_active":"2023-08-09T12:45:43.208612+0000","last_became_peered":"2023-08-09T12:45:43.208612+0000","last_unstale":"2023-08-09T12:45:46.000704+0000","last_undegraded":"2023-08-09T12:45:46.000704+0000","last_fullsized":"2023-08-09T12:45:46.000704+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:39.279681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157285+0000","last_change":"2023-08-09T12:45:42.157285+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157285+0000","last_undegraded":"2023-08-09T12:45:42.157285+0000","last_fullsized":"2023-08-09T12:45:42.157285+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187782+0000","last_change":"2023-08-09T12:45:43.220479+0000","last_active":"2023-08-09T12:45:44.187782+0000","last_peered":"2023-08-09T12:45:44.187782+0000","last_clean":"2023-08-09T12:45:44.187782+0000","last_became_active":"2023-08-09T12:45:43.219067+0000","last_became_peered":"2023-08-09T12:45:43.219067+0000","last_unstale":"2023-08-09T12:45:44.187782+0000","last_undegraded":"2023-08-09T12:45:44.187782+0000","last_fullsized":"2023-08-09T12:45:44.187782+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:33:26.728442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.168347+0000","last_change":"2023-08-09T12:45:42.168347+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.168347+0000","last_undegraded":"2023-08-09T12:45:42.168347+0000","last_fullsized":"2023-08-09T12:45:42.168347+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000642+0000","last_change":"2023-08-09T12:45:43.222222+0000","last_active":"2023-08-09T12:45:46.000642+0000","last_peered":"2023-08-09T12:45:46.000642+0000","last_clean":"2023-08-09T12:45:46.000642+0000","last_became_active":"2023-08-09T12:45:43.221414+0000","last_became_peered":"2023-08-09T12:45:43.221414+0000","last_unstale":"2023-08-09T12:45:46.000642+0000","last_undegraded":"2023-08-09T12:45:46.000642+0000","last_fullsized":"2023-08-09T12:45:46.000642+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:56.592868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163008+0000","last_change":"2023-08-09T12:45:42.163008+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163008+0000","last_undegraded":"2023-08-09T12:45:42.163008+0000","last_fullsized":"2023-08-09T12:45:42.163008+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161933+0000","last_change":"2023-08-09T12:45:42.161933+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161933+0000","last_undegraded":"2023-08-09T12:45:42.161933+0000","last_fullsized":"2023-08-09T12:45:42.161933+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.158457+0000","last_change":"2023-08-09T12:45:42.158457+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.158457+0000","last_undegraded":"2023-08-09T12:45:42.158457+0000","last_fullsized":"2023-08-09T12:45:42.158457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162043+0000","last_change":"2023-08-09T12:45:42.162043+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162043+0000","last_undegraded":"2023-08-09T12:45:42.162043+0000","last_fullsized":"2023-08-09T12:45:42.162043+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000997+0000","last_change":"2023-08-09T12:45:43.222062+0000","last_active":"2023-08-09T12:45:46.000997+0000","last_peered":"2023-08-09T12:45:46.000997+0000","last_clean":"2023-08-09T12:45:46.000997+0000","last_became_active":"2023-08-09T12:45:43.220036+0000","last_became_peered":"2023-08-09T12:45:43.220036+0000","last_unstale":"2023-08-09T12:45:46.000997+0000","last_undegraded":"2023-08-09T12:45:46.000997+0000","last_fullsized":"2023-08-09T12:45:46.000997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:32:26.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161558+0000","last_change":"2023-08-09T12:45:42.161558+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161558+0000","last_undegraded":"2023-08-09T12:45:42.161558+0000","last_fullsized":"2023-08-09T12:45:42.161558+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001377+0000","last_change":"2023-08-09T12:45:43.220452+0000","last_active":"2023-08-09T12:45:46.001377+0000","last_peered":"2023-08-09T12:45:46.001377+0000","last_clean":"2023-08-09T12:45:46.001377+0000","last_became_active":"2023-08-09T12:45:43.219442+0000","last_became_peered":"2023-08-09T12:45:43.219442+0000","last_unstale":"2023-08-09T12:45:46.001377+0000","last_undegraded":"2023-08-09T12:45:46.001377+0000","last_fullsized":"2023-08-09T12:45:46.001377+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:07:24.077186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187419+0000","last_change":"2023-08-09T12:45:43.215398+0000","last_active":"2023-08-09T12:45:44.187419+0000","last_peered":"2023-08-09T12:45:44.187419+0000","last_clean":"2023-08-09T12:45:44.187419+0000","last_became_active":"2023-08-09T12:45:43.208415+0000","last_became_peered":"2023-08-09T12:45:43.208415+0000","last_unstale":"2023-08-09T12:45:44.187419+0000","last_undegraded":"2023-08-09T12:45:44.187419+0000","last_fullsized":"2023-08-09T12:45:44.187419+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:29:31.561794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187082+0000","last_change":"2023-08-09T12:45:43.213178+0000","last_active":"2023-08-09T12:45:44.187082+0000","last_peered":"2023-08-09T12:45:44.187082+0000","last_clean":"2023-08-09T12:45:44.187082+0000","last_became_active":"2023-08-09T12:45:43.210516+0000","last_became_peered":"2023-08-09T12:45:43.210516+0000","last_unstale":"2023-08-09T12:45:44.187082+0000","last_undegraded":"2023-08-09T12:45:44.187082+0000","last_fullsized":"2023-08-09T12:45:44.187082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:17:21.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164026+0000","last_change":"2023-08-09T12:45:42.164026+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164026+0000","last_undegraded":"2023-08-09T12:45:42.164026+0000","last_fullsized":"2023-08-09T12:45:42.164026+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159847+0000","last_change":"2023-08-09T12:45:42.159847+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159847+0000","last_undegraded":"2023-08-09T12:45:42.159847+0000","last_fullsized":"2023-08-09T12:45:42.159847+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001736+0000","last_change":"2023-08-09T12:45:43.220290+0000","last_active":"2023-08-09T12:45:46.001736+0000","last_peered":"2023-08-09T12:45:46.001736+0000","last_clean":"2023-08-09T12:45:46.001736+0000","last_became_active":"2023-08-09T12:45:43.219092+0000","last_became_peered":"2023-08-09T12:45:43.219092+0000","last_unstale":"2023-08-09T12:45:46.001736+0000","last_undegraded":"2023-08-09T12:45:46.001736+0000","last_fullsized":"2023-08-09T12:45:46.001736+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:50.772522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157526+0000","last_change":"2023-08-09T12:45:42.157526+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157526+0000","last_undegraded":"2023-08-09T12:45:42.157526+0000","last_fullsized":"2023-08-09T12:45:42.157526+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157066+0000","last_change":"2023-08-09T12:45:42.157066+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157066+0000","last_undegraded":"2023-08-09T12:45:42.157066+0000","last_fullsized":"2023-08-09T12:45:42.157066+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154308+0000","last_change":"2023-08-09T12:45:42.154308+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154308+0000","last_undegraded":"2023-08-09T12:45:42.154308+0000","last_fullsized":"2023-08-09T12:45:42.154308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162404+0000","last_change":"2023-08-09T12:45:42.162404+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162404+0000","last_undegraded":"2023-08-09T12:45:42.162404+0000","last_fullsized":"2023-08-09T12:45:42.162404+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163371+0000","last_change":"2023-08-09T12:45:42.163371+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163371+0000","last_undegraded":"2023-08-09T12:45:42.163371+0000","last_fullsized":"2023-08-09T12:45:42.163371+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155911+0000","last_change":"2023-08-09T12:45:42.155911+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155911+0000","last_undegraded":"2023-08-09T12:45:42.155911+0000","last_fullsized":"2023-08-09T12:45:42.155911+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161542+0000","last_change":"2023-08-09T12:45:42.161542+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161542+0000","last_undegraded":"2023-08-09T12:45:42.161542+0000","last_fullsized":"2023-08-09T12:45:42.161542+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001780+0000","last_change":"2023-08-09T12:45:43.221846+0000","last_active":"2023-08-09T12:45:46.001780+0000","last_peered":"2023-08-09T12:45:46.001780+0000","last_clean":"2023-08-09T12:45:46.001780+0000","last_became_active":"2023-08-09T12:45:43.219183+0000","last_became_peered":"2023-08-09T12:45:43.219183+0000","last_unstale":"2023-08-09T12:45:46.001780+0000","last_undegraded":"2023-08-09T12:45:46.001780+0000","last_fullsized":"2023-08-09T12:45:46.001780+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:12.047475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.171415+0000","last_change":"2023-08-09T12:45:42.171415+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.171415+0000","last_undegraded":"2023-08-09T12:45:42.171415+0000","last_fullsized":"2023-08-09T12:45:42.171415+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155693+0000","last_change":"2023-08-09T12:45:42.155693+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155693+0000","last_undegraded":"2023-08-09T12:45:42.155693+0000","last_fullsized":"2023-08-09T12:45:42.155693+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.160364+0000","last_change":"2023-08-09T12:45:42.160364+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.160364+0000","last_undegraded":"2023-08-09T12:45:42.160364+0000","last_fullsized":"2023-08-09T12:45:42.160364+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187308+0000","last_change":"2023-08-09T12:45:43.212976+0000","last_active":"2023-08-09T12:45:44.187308+0000","last_peered":"2023-08-09T12:45:44.187308+0000","last_clean":"2023-08-09T12:45:44.187308+0000","last_became_active":"2023-08-09T12:45:43.210090+0000","last_became_peered":"2023-08-09T12:45:43.210090+0000","last_unstale":"2023-08-09T12:45:44.187308+0000","last_undegraded":"2023-08-09T12:45:44.187308+0000","last_fullsized":"2023-08-09T12:45:44.187308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:14.105191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188003+0000","last_change":"2023-08-09T12:45:43.220135+0000","last_active":"2023-08-09T12:45:44.188003+0000","last_peered":"2023-08-09T12:45:44.188003+0000","last_clean":"2023-08-09T12:45:44.188003+0000","last_became_active":"2023-08-09T12:45:43.214687+0000","last_became_peered":"2023-08-09T12:45:43.214687+0000","last_unstale":"2023-08-09T12:45:44.188003+0000","last_undegraded":"2023-08-09T12:45:44.188003+0000","last_fullsized":"2023-08-09T12:45:44.188003+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:31.661935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.169477+0000","last_change":"2023-08-09T12:45:42.169123+0000","last_active":"2023-08-09T12:45:42.169477+0000","last_peered":"2023-08-09T12:45:42.169477+0000","last_clean":"2023-08-09T12:45:42.169477+0000","last_became_active":"2023-08-09T12:45:42.168705+0000","last_became_peered":"2023-08-09T12:45:42.168705+0000","last_unstale":"2023-08-09T12:45:42.169477+0000","last_undegraded":"2023-08-09T12:45:42.169477+0000","last_fullsized":"2023-08-09T12:45:42.169477+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:48.565955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187492+0000","last_change":"2023-08-09T12:45:43.194527+0000","last_active":"2023-08-09T12:45:44.187492+0000","last_peered":"2023-08-09T12:45:44.187492+0000","last_clean":"2023-08-09T12:45:44.187492+0000","last_became_active":"2023-08-09T12:45:43.193850+0000","last_became_peered":"2023-08-09T12:45:43.193850+0000","last_unstale":"2023-08-09T12:45:44.187492+0000","last_undegraded":"2023-08-09T12:45:44.187492+0000","last_fullsized":"2023-08-09T12:45:44.187492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:34:15.244986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171471+0000","last_change":"2023-08-09T12:45:42.171355+0000","last_active":"2023-08-09T12:45:42.171471+0000","last_peered":"2023-08-09T12:45:42.171471+0000","last_clean":"2023-08-09T12:45:42.171471+0000","last_became_active":"2023-08-09T12:45:42.170706+0000","last_became_peered":"2023-08-09T12:45:42.170706+0000","last_unstale":"2023-08-09T12:45:42.171471+0000","last_undegraded":"2023-08-09T12:45:42.171471+0000","last_fullsized":"2023-08-09T12:45:42.171471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:09:47.921573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.170058+0000","last_change":"2023-08-09T12:45:42.170058+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.170058+0000","last_undegraded":"2023-08-09T12:45:42.170058+0000","last_fullsized":"2023-08-09T12:45:42.170058+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174243+0000","last_change":"2023-08-09T12:45:42.174144+0000","last_active":"2023-08-09T12:45:42.174243+0000","last_peered":"2023-08-09T12:45:42.174243+0000","last_clean":"2023-08-09T12:45:42.174243+0000","last_became_active":"2023-08-09T12:45:42.173218+0000","last_became_peered":"2023-08-09T12:45:42.173218+0000","last_unstale":"2023-08-09T12:45:42.174243+0000","last_undegraded":"2023-08-09T12:45:42.174243+0000","last_fullsized":"2023-08-09T12:45:42.174243+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:54:50.748372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186995+0000","last_change":"2023-08-09T12:45:43.207086+0000","last_active":"2023-08-09T12:45:44.186995+0000","last_peered":"2023-08-09T12:45:44.186995+0000","last_clean":"2023-08-09T12:45:44.186995+0000","last_became_active":"2023-08-09T12:45:43.203598+0000","last_became_peered":"2023-08-09T12:45:43.203598+0000","last_unstale":"2023-08-09T12:45:44.186995+0000","last_undegraded":"2023-08-09T12:45:44.186995+0000","last_fullsized":"2023-08-09T12:45:44.186995+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:50.199091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.170755+0000","last_change":"2023-08-09T12:45:42.170662+0000","last_active":"2023-08-09T12:45:42.170755+0000","last_peered":"2023-08-09T12:45:42.170755+0000","last_clean":"2023-08-09T12:45:42.170755+0000","last_became_active":"2023-08-09T12:45:42.170368+0000","last_became_peered":"2023-08-09T12:45:42.170368+0000","last_unstale":"2023-08-09T12:45:42.170755+0000","last_undegraded":"2023-08-09T12:45:42.170755+0000","last_fullsized":"2023-08-09T12:45:42.170755+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:24.757940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002114+0000","last_change":"2023-08-09T12:45:43.220102+0000","last_active":"2023-08-09T12:45:46.002114+0000","last_peered":"2023-08-09T12:45:46.002114+0000","last_clean":"2023-08-09T12:45:46.002114+0000","last_became_active":"2023-08-09T12:45:43.218701+0000","last_became_peered":"2023-08-09T12:45:43.218701+0000","last_unstale":"2023-08-09T12:45:46.002114+0000","last_undegraded":"2023-08-09T12:45:46.002114+0000","last_fullsized":"2023-08-09T12:45:46.002114+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:08.765300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158762+0000","last_change":"2023-08-09T12:45:42.158581+0000","last_active":"2023-08-09T12:45:42.158762+0000","last_peered":"2023-08-09T12:45:42.158762+0000","last_clean":"2023-08-09T12:45:42.158762+0000","last_became_active":"2023-08-09T12:45:42.157895+0000","last_became_peered":"2023-08-09T12:45:42.157895+0000","last_unstale":"2023-08-09T12:45:42.158762+0000","last_undegraded":"2023-08-09T12:45:42.158762+0000","last_fullsized":"2023-08-09T12:45:42.158762+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:21:42.267168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.153059+0000","last_change":"2023-08-09T12:45:42.153059+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.153059+0000","last_undegraded":"2023-08-09T12:45:42.153059+0000","last_fullsized":"2023-08-09T12:45:42.153059+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001280+0000","last_change":"2023-08-09T12:45:42.173485+0000","last_active":"2023-08-09T12:45:46.001280+0000","last_peered":"2023-08-09T12:45:46.001280+0000","last_clean":"2023-08-09T12:45:46.001280+0000","last_became_active":"2023-08-09T12:45:42.173032+0000","last_became_peered":"2023-08-09T12:45:42.173032+0000","last_unstale":"2023-08-09T12:45:46.001280+0000","last_undegraded":"2023-08-09T12:45:46.001280+0000","last_fullsized":"2023-08-09T12:45:46.001280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.080795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187228+0000","last_change":"2023-08-09T12:45:43.214279+0000","last_active":"2023-08-09T12:45:44.187228+0000","last_peered":"2023-08-09T12:45:44.187228+0000","last_clean":"2023-08-09T12:45:44.187228+0000","last_became_active":"2023-08-09T12:45:43.213914+0000","last_became_peered":"2023-08-09T12:45:43.213914+0000","last_unstale":"2023-08-09T12:45:44.187228+0000","last_undegraded":"2023-08-09T12:45:44.187228+0000","last_fullsized":"2023-08-09T12:45:44.187228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:49:27.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.161901+0000","last_change":"2023-08-09T12:45:42.161901+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161901+0000","last_undegraded":"2023-08-09T12:45:42.161901+0000","last_fullsized":"2023-08-09T12:45:42.161901+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:31.040704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000702+0000","last_change":"2023-08-09T12:45:43.210681+0000","last_active":"2023-08-09T12:45:46.000702+0000","last_peered":"2023-08-09T12:45:46.000702+0000","last_clean":"2023-08-09T12:45:46.000702+0000","last_became_active":"2023-08-09T12:45:43.209762+0000","last_became_peered":"2023-08-09T12:45:43.209762+0000","last_unstale":"2023-08-09T12:45:46.000702+0000","last_undegraded":"2023-08-09T12:45:46.000702+0000","last_fullsized":"2023-08-09T12:45:46.000702+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:52:34.879127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.172852+0000","last_change":"2023-08-09T12:45:42.172728+0000","last_active":"2023-08-09T12:45:42.172852+0000","last_peered":"2023-08-09T12:45:42.172852+0000","last_clean":"2023-08-09T12:45:42.172852+0000","last_became_active":"2023-08-09T12:45:42.172043+0000","last_became_peered":"2023-08-09T12:45:42.172043+0000","last_unstale":"2023-08-09T12:45:42.172852+0000","last_undegraded":"2023-08-09T12:45:42.172852+0000","last_fullsized":"2023-08-09T12:45:42.172852+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:52:08.457096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155247+0000","last_change":"2023-08-09T12:45:42.155247+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155247+0000","last_undegraded":"2023-08-09T12:45:42.155247+0000","last_fullsized":"2023-08-09T12:45:42.155247+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.173118+0000","last_change":"2023-08-09T12:45:42.170330+0000","last_active":"2023-08-09T12:45:42.173118+0000","last_peered":"2023-08-09T12:45:42.173118+0000","last_clean":"2023-08-09T12:45:42.173118+0000","last_became_active":"2023-08-09T12:45:42.169301+0000","last_became_peered":"2023-08-09T12:45:42.169301+0000","last_unstale":"2023-08-09T12:45:42.173118+0000","last_undegraded":"2023-08-09T12:45:42.173118+0000","last_fullsized":"2023-08-09T12:45:42.173118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:20:33.769406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164521+0000","last_change":"2023-08-09T12:45:42.164521+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164521+0000","last_undegraded":"2023-08-09T12:45:42.164521+0000","last_fullsized":"2023-08-09T12:45:42.164521+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.162977+0000","last_change":"2023-08-09T12:45:42.162977+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162977+0000","last_undegraded":"2023-08-09T12:45:42.162977+0000","last_fullsized":"2023-08-09T12:45:42.162977+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:43.375069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163437+0000","last_change":"2023-08-09T12:45:42.163437+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163437+0000","last_undegraded":"2023-08-09T12:45:42.163437+0000","last_fullsized":"2023-08-09T12:45:42.163437+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.166921+0000","last_change":"2023-08-09T12:45:42.166679+0000","last_active":"2023-08-09T12:45:42.166921+0000","last_peered":"2023-08-09T12:45:42.166921+0000","last_clean":"2023-08-09T12:45:42.166921+0000","last_became_active":"2023-08-09T12:45:42.166306+0000","last_became_peered":"2023-08-09T12:45:42.166306+0000","last_unstale":"2023-08-09T12:45:42.166921+0000","last_undegraded":"2023-08-09T12:45:42.166921+0000","last_fullsized":"2023-08-09T12:45:42.166921+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:12.598589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001536+0000","last_change":"2023-08-09T12:45:43.217109+0000","last_active":"2023-08-09T12:45:46.001536+0000","last_peered":"2023-08-09T12:45:46.001536+0000","last_clean":"2023-08-09T12:45:46.001536+0000","last_became_active":"2023-08-09T12:45:43.216368+0000","last_became_peered":"2023-08-09T12:45:43.216368+0000","last_unstale":"2023-08-09T12:45:46.001536+0000","last_undegraded":"2023-08-09T12:45:46.001536+0000","last_fullsized":"2023-08-09T12:45:46.001536+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:05:21.390158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"109'6","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187481+0000","last_change":"2023-08-09T12:45:42.169490+0000","last_active":"2023-08-09T12:45:44.187481+0000","last_peered":"2023-08-09T12:45:44.187481+0000","last_clean":"2023-08-09T12:45:44.187481+0000","last_became_active":"2023-08-09T12:45:42.169083+0000","last_became_peered":"2023-08-09T12:45:42.169083+0000","last_unstale":"2023-08-09T12:45:44.187481+0000","last_undegraded":"2023-08-09T12:45:44.187481+0000","last_fullsized":"2023-08-09T12:45:44.187481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.655063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002255+0000","last_change":"2023-08-09T12:45:43.213666+0000","last_active":"2023-08-09T12:45:46.002255+0000","last_peered":"2023-08-09T12:45:46.002255+0000","last_clean":"2023-08-09T12:45:46.002255+0000","last_became_active":"2023-08-09T12:45:43.211302+0000","last_became_peered":"2023-08-09T12:45:43.211302+0000","last_unstale":"2023-08-09T12:45:46.002255+0000","last_undegraded":"2023-08-09T12:45:46.002255+0000","last_fullsized":"2023-08-09T12:45:46.002255+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:28:50.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.173563+0000","last_change":"2023-08-09T12:45:42.173486+0000","last_active":"2023-08-09T12:45:42.173563+0000","last_peered":"2023-08-09T12:45:42.173563+0000","last_clean":"2023-08-09T12:45:42.173563+0000","last_became_active":"2023-08-09T12:45:42.172463+0000","last_became_peered":"2023-08-09T12:45:42.172463+0000","last_unstale":"2023-08-09T12:45:42.173563+0000","last_undegraded":"2023-08-09T12:45:42.173563+0000","last_fullsized":"2023-08-09T12:45:42.173563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:43:08.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154768+0000","last_change":"2023-08-09T12:45:42.154768+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154768+0000","last_undegraded":"2023-08-09T12:45:42.154768+0000","last_fullsized":"2023-08-09T12:45:42.154768+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188072+0000","last_change":"2023-08-09T12:45:42.170960+0000","last_active":"2023-08-09T12:45:44.188072+0000","last_peered":"2023-08-09T12:45:44.188072+0000","last_clean":"2023-08-09T12:45:44.188072+0000","last_became_active":"2023-08-09T12:45:42.170519+0000","last_became_peered":"2023-08-09T12:45:42.170519+0000","last_unstale":"2023-08-09T12:45:44.188072+0000","last_undegraded":"2023-08-09T12:45:44.188072+0000","last_fullsized":"2023-08-09T12:45:44.188072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:08:04.874324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159739+0000","last_change":"2023-08-09T12:45:42.159739+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159739+0000","last_undegraded":"2023-08-09T12:45:42.159739+0000","last_fullsized":"2023-08-09T12:45:42.159739+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000943+0000","last_change":"2023-08-09T12:45:42.170297+0000","last_active":"2023-08-09T12:45:46.000943+0000","last_peered":"2023-08-09T12:45:46.000943+0000","last_clean":"2023-08-09T12:45:46.000943+0000","last_became_active":"2023-08-09T12:45:42.169795+0000","last_became_peered":"2023-08-09T12:45:42.169795+0000","last_unstale":"2023-08-09T12:45:46.000943+0000","last_undegraded":"2023-08-09T12:45:46.000943+0000","last_fullsized":"2023-08-09T12:45:46.000943+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:12:25.996027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159891+0000","last_change":"2023-08-09T12:45:42.159891+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159891+0000","last_undegraded":"2023-08-09T12:45:42.159891+0000","last_fullsized":"2023-08-09T12:45:42.159891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"109'8","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001962+0000","last_change":"2023-08-09T12:45:42.170246+0000","last_active":"2023-08-09T12:45:46.001962+0000","last_peered":"2023-08-09T12:45:46.001962+0000","last_clean":"2023-08-09T12:45:46.001962+0000","last_became_active":"2023-08-09T12:45:42.169960+0000","last_became_peered":"2023-08-09T12:45:42.169960+0000","last_unstale":"2023-08-09T12:45:46.001962+0000","last_undegraded":"2023-08-09T12:45:46.001962+0000","last_fullsized":"2023-08-09T12:45:46.001962+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:49:26.573151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.152115+0000","last_change":"2023-08-09T12:45:42.152115+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.152115+0000","last_undegraded":"2023-08-09T12:45:42.152115+0000","last_fullsized":"2023-08-09T12:45:42.152115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171025+0000","last_change":"2023-08-09T12:45:42.170944+0000","last_active":"2023-08-09T12:45:42.171025+0000","last_peered":"2023-08-09T12:45:42.171025+0000","last_clean":"2023-08-09T12:45:42.171025+0000","last_became_active":"2023-08-09T12:45:42.170658+0000","last_became_peered":"2023-08-09T12:45:42.170658+0000","last_unstale":"2023-08-09T12:45:42.171025+0000","last_undegraded":"2023-08-09T12:45:42.171025+0000","last_fullsized":"2023-08-09T12:45:42.171025+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:42.449824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187233+0000","last_change":"2023-08-09T12:45:43.209718+0000","last_active":"2023-08-09T12:45:44.187233+0000","last_peered":"2023-08-09T12:45:44.187233+0000","last_clean":"2023-08-09T12:45:44.187233+0000","last_became_active":"2023-08-09T12:45:43.208102+0000","last_became_peered":"2023-08-09T12:45:43.208102+0000","last_unstale":"2023-08-09T12:45:44.187233+0000","last_undegraded":"2023-08-09T12:45:44.187233+0000","last_fullsized":"2023-08-09T12:45:44.187233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:50.899939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174927+0000","last_change":"2023-08-09T12:45:42.173319+0000","last_active":"2023-08-09T12:45:42.174927+0000","last_peered":"2023-08-09T12:45:42.174927+0000","last_clean":"2023-08-09T12:45:42.174927+0000","last_became_active":"2023-08-09T12:45:42.173050+0000","last_became_peered":"2023-08-09T12:45:42.173050+0000","last_unstale":"2023-08-09T12:45:42.174927+0000","last_undegraded":"2023-08-09T12:45:42.174927+0000","last_fullsized":"2023-08-09T12:45:42.174927+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:53:44.942746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187418+0000","last_change":"2023-08-09T12:45:43.207367+0000","last_active":"2023-08-09T12:45:44.187418+0000","last_peered":"2023-08-09T12:45:44.187418+0000","last_clean":"2023-08-09T12:45:44.187418+0000","last_became_active":"2023-08-09T12:45:43.204580+0000","last_became_peered":"2023-08-09T12:45:43.204580+0000","last_unstale":"2023-08-09T12:45:44.187418+0000","last_undegraded":"2023-08-09T12:45:44.187418+0000","last_fullsized":"2023-08-09T12:45:44.187418+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:35:03.227531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174793+0000","last_change":"2023-08-09T12:45:42.174675+0000","last_active":"2023-08-09T12:45:42.174793+0000","last_peered":"2023-08-09T12:45:42.174793+0000","last_clean":"2023-08-09T12:45:42.174793+0000","last_became_active":"2023-08-09T12:45:42.172063+0000","last_became_peered":"2023-08-09T12:45:42.172063+0000","last_unstale":"2023-08-09T12:45:42.174793+0000","last_undegraded":"2023-08-09T12:45:42.174793+0000","last_fullsized":"2023-08-09T12:45:42.174793+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:06.446881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.166272+0000","last_change":"2023-08-09T12:45:42.166272+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.166272+0000","last_undegraded":"2023-08-09T12:45:42.166272+0000","last_fullsized":"2023-08-09T12:45:42.166272+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.157349+0000","last_change":"2023-08-09T12:45:42.157166+0000","last_active":"2023-08-09T12:45:42.157349+0000","last_peered":"2023-08-09T12:45:42.157349+0000","last_clean":"2023-08-09T12:45:42.157349+0000","last_became_active":"2023-08-09T12:45:42.156526+0000","last_became_peered":"2023-08-09T12:45:42.156526+0000","last_unstale":"2023-08-09T12:45:42.157349+0000","last_undegraded":"2023-08-09T12:45:42.157349+0000","last_fullsized":"2023-08-09T12:45:42.157349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:58:27.924929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.160963+0000","last_change":"2023-08-09T12:45:42.160963+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.160963+0000","last_undegraded":"2023-08-09T12:45:42.160963+0000","last_fullsized":"2023-08-09T12:45:42.160963+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188157+0000","last_change":"2023-08-09T12:45:42.168078+0000","last_active":"2023-08-09T12:45:44.188157+0000","last_peered":"2023-08-09T12:45:44.188157+0000","last_clean":"2023-08-09T12:45:44.188157+0000","last_became_active":"2023-08-09T12:45:42.167759+0000","last_became_peered":"2023-08-09T12:45:42.167759+0000","last_unstale":"2023-08-09T12:45:44.188157+0000","last_undegraded":"2023-08-09T12:45:44.188157+0000","last_fullsized":"2023-08-09T12:45:44.188157+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:51.969009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164478+0000","last_change":"2023-08-09T12:45:42.164478+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164478+0000","last_undegraded":"2023-08-09T12:45:42.164478+0000","last_fullsized":"2023-08-09T12:45:42.164478+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.175062+0000","last_change":"2023-08-09T12:45:42.174892+0000","last_active":"2023-08-09T12:45:42.175062+0000","last_peered":"2023-08-09T12:45:42.175062+0000","last_clean":"2023-08-09T12:45:42.175062+0000","last_became_active":"2023-08-09T12:45:42.172982+0000","last_became_peered":"2023-08-09T12:45:42.172982+0000","last_unstale":"2023-08-09T12:45:42.175062+0000","last_undegraded":"2023-08-09T12:45:42.175062+0000","last_fullsized":"2023-08-09T12:45:42.175062+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:13:37.150933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157194+0000","last_change":"2023-08-09T12:45:42.157194+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157194+0000","last_undegraded":"2023-08-09T12:45:42.157194+0000","last_fullsized":"2023-08-09T12:45:42.157194+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.161908+0000","last_change":"2023-08-09T12:45:42.161730+0000","last_active":"2023-08-09T12:45:42.161908+0000","last_peered":"2023-08-09T12:45:42.161908+0000","last_clean":"2023-08-09T12:45:42.161908+0000","last_became_active":"2023-08-09T12:45:42.160990+0000","last_became_peered":"2023-08-09T12:45:42.160990+0000","last_unstale":"2023-08-09T12:45:42.161908+0000","last_undegraded":"2023-08-09T12:45:42.161908+0000","last_fullsized":"2023-08-09T12:45:42.161908+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:18.677102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187917+0000","last_change":"2023-08-09T12:45:43.219911+0000","last_active":"2023-08-09T12:45:44.187917+0000","last_peered":"2023-08-09T12:45:44.187917+0000","last_clean":"2023-08-09T12:45:44.187917+0000","last_became_active":"2023-08-09T12:45:43.214021+0000","last_became_peered":"2023-08-09T12:45:43.214021+0000","last_unstale":"2023-08-09T12:45:44.187917+0000","last_undegraded":"2023-08-09T12:45:44.187917+0000","last_fullsized":"2023-08-09T12:45:44.187917+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:07.660676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.176022+0000","last_change":"2023-08-09T12:45:42.175573+0000","last_active":"2023-08-09T12:45:42.176022+0000","last_peered":"2023-08-09T12:45:42.176022+0000","last_clean":"2023-08-09T12:45:42.176022+0000","last_became_active":"2023-08-09T12:45:42.174408+0000","last_became_peered":"2023-08-09T12:45:42.174408+0000","last_unstale":"2023-08-09T12:45:42.176022+0000","last_undegraded":"2023-08-09T12:45:42.176022+0000","last_fullsized":"2023-08-09T12:45:42.176022+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:21:34.811103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.167806+0000","last_change":"2023-08-09T12:45:42.167806+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.167806+0000","last_undegraded":"2023-08-09T12:45:42.167806+0000","last_fullsized":"2023-08-09T12:45:42.167806+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001499+0000","last_change":"2023-08-09T12:45:42.173336+0000","last_active":"2023-08-09T12:45:46.001499+0000","last_peered":"2023-08-09T12:45:46.001499+0000","last_clean":"2023-08-09T12:45:46.001499+0000","last_became_active":"2023-08-09T12:45:42.173027+0000","last_became_peered":"2023-08-09T12:45:42.173027+0000","last_unstale":"2023-08-09T12:45:46.001499+0000","last_undegraded":"2023-08-09T12:45:46.001499+0000","last_fullsized":"2023-08-09T12:45:46.001499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:52.986927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":338,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158948+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:45:42.158948+0000","last_peered":"2023-08-09T12:45:42.158948+0000","last_clean":"2023-08-09T12:45:42.158948+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:45:42.158948+0000","last_undegraded":"2023-08-09T12:45:42.158948+0000","last_fullsized":"2023-08-09T12:45:42.158948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:00.329935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.160765+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:45:42.160765+0000","last_peered":"2023-08-09T12:45:42.160765+0000","last_clean":"2023-08-09T12:45:42.160765+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:45:42.160765+0000","last_undegraded":"2023-08-09T12:45:42.160765+0000","last_fullsized":"2023-08-09T12:45:42.160765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:35.037032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187486+0000","last_change":"2023-08-09T12:45:43.213774+0000","last_active":"2023-08-09T12:45:44.187486+0000","last_peered":"2023-08-09T12:45:44.187486+0000","last_clean":"2023-08-09T12:45:44.187486+0000","last_became_active":"2023-08-09T12:45:43.213507+0000","last_became_peered":"2023-08-09T12:45:43.213507+0000","last_unstale":"2023-08-09T12:45:44.187486+0000","last_undegraded":"2023-08-09T12:45:44.187486+0000","last_fullsized":"2023-08-09T12:45:44.187486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:18:30.758379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171171+0000","last_change":"2023-08-09T12:45:42.170733+0000","last_active":"2023-08-09T12:45:42.171171+0000","last_peered":"2023-08-09T12:45:42.171171+0000","last_clean":"2023-08-09T12:45:42.171171+0000","last_became_active":"2023-08-09T12:45:42.170416+0000","last_became_peered":"2023-08-09T12:45:42.170416+0000","last_unstale":"2023-08-09T12:45:42.171171+0000","last_undegraded":"2023-08-09T12:45:42.171171+0000","last_fullsized":"2023-08-09T12:45:42.171171+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:03:03.106880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158635+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:45:42.158635+0000","last_peered":"2023-08-09T12:45:42.158635+0000","last_clean":"2023-08-09T12:45:42.158635+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:45:42.158635+0000","last_undegraded":"2023-08-09T12:45:42.158635+0000","last_fullsized":"2023-08-09T12:45:42.158635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:15:08.262289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.156291+0000","last_change":"2023-08-09T12:45:42.156291+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.156291+0000","last_undegraded":"2023-08-09T12:45:42.156291+0000","last_fullsized":"2023-08-09T12:45:42.156291+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.176003+0000","last_change":"2023-08-09T12:45:42.175558+0000","last_active":"2023-08-09T12:45:42.176003+0000","last_peered":"2023-08-09T12:45:42.176003+0000","last_clean":"2023-08-09T12:45:42.176003+0000","last_became_active":"2023-08-09T12:45:42.175254+0000","last_became_peered":"2023-08-09T12:45:42.175254+0000","last_unstale":"2023-08-09T12:45:42.176003+0000","last_undegraded":"2023-08-09T12:45:42.176003+0000","last_fullsized":"2023-08-09T12:45:42.176003+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:27:04.977793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.146383+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:45:42.146383+0000","last_peered":"2023-08-09T12:45:42.146383+0000","last_clean":"2023-08-09T12:45:42.146383+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:45:42.146383+0000","last_undegraded":"2023-08-09T12:45:42.146383+0000","last_fullsized":"2023-08-09T12:45:42.146383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:38:39.646668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154723+0000","last_change":"2023-08-09T12:45:42.154723+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154723+0000","last_undegraded":"2023-08-09T12:45:42.154723+0000","last_fullsized":"2023-08-09T12:45:42.154723+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":6,"reported_epoch":108,"state":"active","last_fresh":"2023-08-09T12:45:42.174803+0000","last_change":"2023-08-09T12:45:42.174611+0000","last_active":"2023-08-09T12:45:42.174803+0000","last_peered":"2023-08-09T12:45:42.174803+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"2023-08-09T12:45:42.174611+0000","last_became_peered":"2023-08-09T12:45:42.174611+0000","last_unstale":"2023-08-09T12:45:42.174803+0000","last_undegraded":"2023-08-09T12:45:42.174803+0000","last_fullsized":"2023-08-09T12:45:42.174803+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:48.953496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.167216+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:45:42.167216+0000","last_peered":"2023-08-09T12:45:42.167216+0000","last_clean":"2023-08-09T12:45:42.167216+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:45:42.167216+0000","last_undegraded":"2023-08-09T12:45:42.167216+0000","last_fullsized":"2023-08-09T12:45:42.167216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:54.531530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187601+0000","last_change":"2023-08-09T12:45:43.220645+0000","last_active":"2023-08-09T12:45:44.187601+0000","last_peered":"2023-08-09T12:45:44.187601+0000","last_clean":"2023-08-09T12:45:44.187601+0000","last_became_active":"2023-08-09T12:45:43.219540+0000","last_became_peered":"2023-08-09T12:45:43.219540+0000","last_unstale":"2023-08-09T12:45:44.187601+0000","last_undegraded":"2023-08-09T12:45:44.187601+0000","last_fullsized":"2023-08-09T12:45:44.187601+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:25.671887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174369+0000","last_change":"2023-08-09T12:45:42.172661+0000","last_active":"2023-08-09T12:45:42.174369+0000","last_peered":"2023-08-09T12:45:42.174369+0000","last_clean":"2023-08-09T12:45:42.174369+0000","last_became_active":"2023-08-09T12:45:42.172329+0000","last_became_peered":"2023-08-09T12:45:42.172329+0000","last_unstale":"2023-08-09T12:45:42.174369+0000","last_undegraded":"2023-08-09T12:45:42.174369+0000","last_fullsized":"2023-08-09T12:45:42.174369+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:34:05.528627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002339+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:45:46.002339+0000","last_peered":"2023-08-09T12:45:46.002339+0000","last_clean":"2023-08-09T12:45:46.002339+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:45:46.002339+0000","last_undegraded":"2023-08-09T12:45:46.002339+0000","last_fullsized":"2023-08-09T12:45:46.002339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:04.608129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162571+0000","last_change":"2023-08-09T12:45:42.162571+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162571+0000","last_undegraded":"2023-08-09T12:45:42.162571+0000","last_fullsized":"2023-08-09T12:45:42.162571+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.146606+0000","last_change":"2023-08-09T12:45:42.146606+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.146606+0000","last_undegraded":"2023-08-09T12:45:42.146606+0000","last_fullsized":"2023-08-09T12:45:42.146606+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:42.436453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158351+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:45:42.158351+0000","last_peered":"2023-08-09T12:45:42.158351+0000","last_clean":"2023-08-09T12:45:42.158351+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:45:42.158351+0000","last_undegraded":"2023-08-09T12:45:42.158351+0000","last_fullsized":"2023-08-09T12:45:42.158351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:45:47.235734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159875+0000","last_change":"2023-08-09T12:45:42.159875+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159875+0000","last_undegraded":"2023-08-09T12:45:42.159875+0000","last_fullsized":"2023-08-09T12:45:42.159875+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174386+0000","last_change":"2023-08-09T12:45:42.174137+0000","last_active":"2023-08-09T12:45:42.174386+0000","last_peered":"2023-08-09T12:45:42.174386+0000","last_clean":"2023-08-09T12:45:42.174386+0000","last_became_active":"2023-08-09T12:45:42.173831+0000","last_became_peered":"2023-08-09T12:45:42.173831+0000","last_unstale":"2023-08-09T12:45:42.174386+0000","last_undegraded":"2023-08-09T12:45:42.174386+0000","last_fullsized":"2023-08-09T12:45:42.174386+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:37.726534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002368+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:45:46.002368+0000","last_peered":"2023-08-09T12:45:46.002368+0000","last_clean":"2023-08-09T12:45:46.002368+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:45:46.002368+0000","last_undegraded":"2023-08-09T12:45:46.002368+0000","last_fullsized":"2023-08-09T12:45:46.002368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:25.902601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187606+0000","last_change":"2023-08-09T12:45:43.207564+0000","last_active":"2023-08-09T12:45:44.187606+0000","last_peered":"2023-08-09T12:45:44.187606+0000","last_clean":"2023-08-09T12:45:44.187606+0000","last_became_active":"2023-08-09T12:45:43.206550+0000","last_became_peered":"2023-08-09T12:45:43.206550+0000","last_unstale":"2023-08-09T12:45:44.187606+0000","last_undegraded":"2023-08-09T12:45:44.187606+0000","last_fullsized":"2023-08-09T12:45:44.187606+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:37.720656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.146817+0000","last_change":"2023-08-09T12:45:42.146817+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.146817+0000","last_undegraded":"2023-08-09T12:45:42.146817+0000","last_fullsized":"2023-08-09T12:45:42.146817+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:03.177644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.149239+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:45:42.149239+0000","last_peered":"2023-08-09T12:45:42.149239+0000","last_clean":"2023-08-09T12:45:42.149239+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:45:42.149239+0000","last_undegraded":"2023-08-09T12:45:42.149239+0000","last_fullsized":"2023-08-09T12:45:42.149239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:23:37.763281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1185,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194126,"statfs":{"total":200000000,"available":198785984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.137,"15min":1.107},"min":{"1min":0.627,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.542,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.0860000000000001},"min":{"1min":0.89700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7769999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.82399999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.21,"15min":1.1160000000000001},"min":{"1min":0.748,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1990000000000001,"15min":1.117},"min":{"1min":0.79100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5600000000000001,"5min":1.734,"15min":1.734},"last":1.224}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.1819999999999999},"min":{"1min":0.69999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.96,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.083},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.1539999999999999},"min":{"1min":0.746,"5min":0.73399999999999999,"15min":0.69799999999999995},"max":{"1min":1.7070000000000001,"5min":2.173,"15min":2.173},"last":1.306}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3180000000000001,"15min":1.244},"min":{"1min":0.83299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.732,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.524},{"interface":"front","average":{"1min":1.345,"5min":1.353,"15min":1.2769999999999999},"min":{"1min":0.92600000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.843,"5min":2.282,"15min":2.282},"last":1.4590000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2330000000000001,"15min":1.202},"min":{"1min":0.81100000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6179999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.179},{"interface":"front","average":{"1min":1.341,"5min":1.3959999999999999,"15min":1.288},"min":{"1min":0.93700000000000006,"5min":0.67900000000000005,"15min":0.58599999999999997},"max":{"1min":2.0630000000000002,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.6259999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.427,"15min":1.3069999999999999},"min":{"1min":0.90200000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1699999999999999,"5min":2.802,"15min":2.802},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.587,"5min":1.516,"15min":1.4870000000000001},"min":{"1min":1.214,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.7799999999999998,"5min":3.1400000000000001,"15min":3.3580000000000001},"last":1.579}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4850000000000001,"15min":1.4690000000000001},"min":{"1min":1.0740000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.8849999999999998,"5min":3.266,"15min":3.4910000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.161,"5min":0.83699999999999997,"15min":0.623},"max":{"1min":2.3580000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.696}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1899999999999999,"15min":1.1299999999999999},"min":{"1min":0.79400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7929999999999999,"5min":2.54,"15min":2.54},"last":1.498},{"interface":"front","average":{"1min":1.139,"5min":1.127,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5469999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.92400000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.234},"min":{"1min":0.86299999999999999,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0009999999999999,"15min":2.306},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.3720000000000001,"15min":1.3260000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.613,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0309999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1659999999999999,"15min":1.1060000000000001},"min":{"1min":0.70199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5629999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3089999999999999,"15min":1.2749999999999999},"min":{"1min":0.93700000000000006,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.857,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.5940000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.363,"15min":1.2809999999999999},"min":{"1min":0.93600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.673,"5min":2.327,"15min":2.327},"last":1.131},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.359,"15min":1.296},"min":{"1min":1.0589999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.6819999999999999,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.538}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4650000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0139999999999998,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.363},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.403,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.766,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.214}]},{"osd":5,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.407,"15min":1.335},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.77600000000000002},"max":{"1min":1.8440000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.577,"15min":1.4890000000000001},"min":{"1min":1.2110000000000001,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":2.222,"5min":2.7160000000000002,"15min":2.8580000000000001},"last":1.679}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.597,"15min":1.4390000000000001},"min":{"1min":1.0820000000000001,"5min":1.0009999999999999,"15min":0.752},"max":{"1min":1.954,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":1.446},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.9690000000000001,"5min":3.621,"15min":3.621},"last":1.6419999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.131,"15min":1.117},"min":{"1min":0.77300000000000002,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.427},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.208,"15min":1.0880000000000001},"min":{"1min":0.81999999999999995,"5min":0.71699999999999997,"15min":0.625},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.3600000000000001,"15min":1.2989999999999999},"min":{"1min":1.0369999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.29,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.982,"5min":1.984,"15min":1.984},"last":1.137}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.236,"15min":1.21},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.2190000000000001,"15min":1.198},"min":{"1min":0.81399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3169999999999999,"15min":1.2150000000000001},"min":{"1min":0.96499999999999997,"5min":0.78000000000000003,"15min":0.77100000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.157},{"interface":"front","average":{"1min":1.502,"5min":1.383,"15min":1.381},"min":{"1min":1.1539999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.266,"15min":1.2370000000000001},"min":{"1min":0.88400000000000001,"5min":0.621,"15min":0.60699999999999998},"max":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":1.329},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.96899999999999997,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.496}]},{"osd":6,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3799999999999999,"15min":1.3420000000000001},"min":{"1min":1.0289999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.429,"15min":1.49},"min":{"1min":1.194,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.3879999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.5069999999999999,"15min":1.5229999999999999},"min":{"1min":1.2010000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.722,"5min":2.722,"15min":3.3250000000000002},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.72,"5min":1.5629999999999999,"15min":1.522},"min":{"1min":1.452,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.4670000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.141,"15min":1.087},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5529999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.165,"15min":1.101},"min":{"1min":0.83599999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4279999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.4830000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.3320000000000001},"min":{"1min":0.83999999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7589999999999999,"5min":1.897,"15min":1.97},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3009999999999999,"15min":1.329},"min":{"1min":0.92100000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.804,"5min":2.2040000000000002,"15min":2.7770000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.3169999999999999},"min":{"1min":0.81599999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.9810000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.3200000000000001,"15min":1.3109999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6539999999999999,"5min":1.929,"15min":1.929},"last":1.5309999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.28,"15min":1.228},"min":{"1min":0.82999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.623,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":1.665,"5min":2.081,"15min":2.081},"last":1.883}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3029999999999999,"15min":1.377},"min":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.615,"5min":1.853,"15min":1.9490000000000001},"last":1.323},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3899999999999999,"15min":1.385},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.665,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.5680000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.397,"15min":1.4850000000000001},"min":{"1min":0.76000000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.784,"5min":2.238,"15min":2.238},"last":2.101},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.756,"5min":2.036,"15min":2.036},"last":1.4370000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.542,"15min":1.5249999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8089999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.9350000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.552,"15min":1.619},"min":{"1min":0.89400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.9299999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":2.0470000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90400000000000003,"15min":0.83999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.3480000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.143,"5min":1.0549999999999999,"15min":0.91900000000000004},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":2.778,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.82399999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.91100000000000003,"15min":0.90600000000000003},"min":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.1399999999999999,"15min":0.94599999999999995},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.373},"max":{"1min":2.0219999999999998,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.98599999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.3360000000000001,"15min":1.119},"min":{"1min":0.59399999999999997,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":1.75,"5min":18.145,"15min":18.145},"last":1.361},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.2290000000000001,"15min":1.2090000000000001},"min":{"1min":0.66500000000000004,"5min":0.48999999999999999,"15min":0.41799999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.129}]},{"osd":4,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.323,"15min":1.331},"min":{"1min":0.98099999999999998,"5min":0.84399999999999997,"15min":0.745},"max":{"1min":1.712,"5min":2.972,"15min":3.5110000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.325,"15min":1.341},"min":{"1min":0.98999999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.712,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.294}]},{"osd":5,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.5760000000000001,"15min":1.444},"min":{"1min":1.099,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7210000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.512},{"interface":"front","average":{"1min":1.55,"5min":1.595,"15min":1.361},"min":{"1min":1.0249999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.2959999999999998,"5min":14.105,"15min":14.105},"last":1.0820000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.401,"15min":1.3500000000000001},"min":{"1min":1.091,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8999999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.4690000000000001,"15min":1.4810000000000001},"min":{"1min":0.93700000000000006,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8839999999999999,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.415}]},{"osd":7,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.4790000000000001,"15min":1.407},"min":{"1min":0.98599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.458,"15min":1.389},"min":{"1min":1.022,"5min":0.85699999999999998,"15min":0.70799999999999996},"max":{"1min":1.8180000000000001,"5min":3.016,"15min":3.016},"last":1.2549999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56799999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.716},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.107,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.38900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":2.9009999999999998},"last":1.236}]},{"osd":1,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.95399999999999996,"15min":0.93100000000000005},"min":{"1min":0.63700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4219999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.264,"5min":1.079,"15min":1.069},"min":{"1min":0.66700000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.823,"5min":1.823,"15min":1.869},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1719999999999999,"15min":1.1739999999999999},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.681,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.395,"5min":1.2050000000000001,"15min":1.1639999999999999},"min":{"1min":0.77300000000000002,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":2.0289999999999999,"5min":2.242,"15min":2.9409999999999998},"last":0.52800000000000002}]},{"osd":4,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.4770000000000001,"15min":1.429},"min":{"1min":1.1539999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7450000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.3799999999999999,"15min":1.288},"min":{"1min":0.97999999999999998,"5min":0.83199999999999996,"15min":0.66800000000000004},"max":{"1min":2.6509999999999998,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.1619999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.446,"15min":1.3680000000000001},"min":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.3210000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.046},{"interface":"front","average":{"1min":1.673,"5min":1.512,"15min":1.4910000000000001},"min":{"1min":1.034,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4780000000000002,"5min":4.806,"15min":4.806},"last":1.125}]},{"osd":6,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.399,"15min":1.321},"min":{"1min":0.82799999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.613,"5min":1.4790000000000001,"15min":1.431},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.7309999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.2}]},{"osd":7,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.89500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.579,"15min":1.542},"min":{"1min":0.995,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.6549999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.101}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":38,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":616,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194696,"statfs":{"total":200000000,"available":199369154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.53000000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.609,"5min":1.881,"15min":1.881},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":2.0529999999999999,"15min":1.2549999999999999},"min":{"1min":0.66400000000000003,"5min":0.47799999999999998,"15min":0.34300000000000003},"max":{"1min":1.863,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0469999999999999,"15min":0.95499999999999996},"min":{"1min":0.67400000000000004,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.476,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.337,"5min":1.306,"15min":1.147},"min":{"1min":0.91900000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.044,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1950000000000001,"15min":1.099},"min":{"1min":0.71999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.724,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.1779999999999999,"15min":0.97599999999999998},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.5740000000000001,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.55,"15min":1.2909999999999999},"min":{"1min":0.95999999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.5289999999999999,"5min":25.172000000000001,"15min":25.172000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.351,"5min":1.3819999999999999,"15min":1.302},"min":{"1min":0.94499999999999995,"5min":0.88500000000000001,"15min":0.84599999999999997},"max":{"1min":2.1589999999999998,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.669,"15min":1.399},"min":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8420000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.228},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3799999999999999,"15min":1.2849999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9059999999999999,"5min":3.762,"15min":3.762},"last":1.198}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.5449999999999999,"15min":1.431},"min":{"1min":0.91000000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.827,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.482,"15min":1.3839999999999999},"min":{"1min":1.0600000000000001,"5min":0.873,"15min":0.79500000000000004},"max":{"1min":1.7949999999999999,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.262}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.8680000000000001,"15min":1.5880000000000001},"min":{"1min":1.2829999999999999,"5min":0.96899999999999997,"15min":0.88800000000000001},"max":{"1min":2.5089999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.8759999999999999,"15min":1.5680000000000001},"min":{"1min":1.1379999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.7949999999999999,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.2929999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194111,"statfs":{"total":200000000,"available":198769885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.64500000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":1.389,"5min":1.819,"15min":1.819},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1040000000000001,"15min":0.96499999999999997},"min":{"1min":0.79200000000000004,"5min":0.53300000000000003,"15min":0.436},"max":{"1min":1.6160000000000001,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.92300000000000004}]},{"osd":2,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.038,"15min":0.96599999999999997},"min":{"1min":0.68899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.159,"15min":1.0369999999999999},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.5},"max":{"1min":1.732,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":0.63}]},{"osd":3,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.089,"15min":0.94699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.413,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.298},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.218,"15min":1.1830000000000001},"min":{"1min":0.72899999999999998,"5min":0.58199999999999996,"15min":0.56000000000000005},"max":{"1min":1.6950000000000001,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":1.375}]},{"osd":4,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3779999999999999,"15min":1.3340000000000001},"min":{"1min":0.81599999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8240000000000001,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.163},{"interface":"front","average":{"1min":1.419,"5min":1.3640000000000001,"15min":1.29},"min":{"1min":1.0289999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.45}]},{"osd":5,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4119999999999999,"15min":1.3129999999999999},"min":{"1min":0.91900000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.891,"5min":10.004,"15min":10.004},"last":1.407},{"interface":"front","average":{"1min":1.496,"5min":1.4330000000000001,"15min":1.3859999999999999},"min":{"1min":0.97799999999999998,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":1.8069999999999999,"5min":1.909,"15min":2.161},"last":1.2350000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4550000000000001,"15min":1.3480000000000001},"min":{"1min":1.1399999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9370000000000001,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.532,"15min":1.4350000000000001},"min":{"1min":1.0609999999999999,"5min":0.90100000000000002,"15min":0.86799999999999999},"max":{"1min":2.0099999999999998,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.5940000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.609,"15min":1.4390000000000001},"min":{"1min":1.202,"5min":0.80400000000000005,"15min":0.79200000000000004},"max":{"1min":1.8360000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.627,"5min":1.589,"15min":1.4710000000000001},"min":{"1min":1.1180000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.1120000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.506}]}]}],"pool_statfs":[]}} 2023-08-09T12:45:48.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:45:48.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.480+0000 7f96e4204640 1 Processor -- start 2023-08-09T12:45:48.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.480+0000 7f96e4204640 1 -- start start 2023-08-09T12:45:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.481+0000 7f96e4204640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96dc0adc40 0x7f96dc06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.481+0000 7f96e4204640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96dc0b2250 con 0x7f96dc0b3b40 2023-08-09T12:45:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.481+0000 7f96e4204640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96dc0b2530 con 0x7f96dc0cc630 2023-08-09T12:45:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.481+0000 7f96e4204640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96dc0ae020 con 0x7f96dc0adc40 2023-08-09T12:45:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e179f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f96dc0b3b40 0x7f96dc0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56098/0 (socket says 172.21.15.17:56098) 2023-08-09T12:45:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e179f640 1 -- 172.21.15.17:0/3744947651 learned_addr learned my addr 172.21.15.17:0/3744947651 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604046908 0 0) 0x7f96dc0b2250 con 0x7f96dc0b3b40 2023-08-09T12:45:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e1fa0640 1 --2- 172.21.15.17:0/3744947651 >> v2:172.21.15.142:3300/0 conn(0x7f96dc0adc40 0x7f96dc06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96c8003520 con 0x7f96dc0b3b40 2023-08-09T12:45:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1718571494 0 0) 0x7f96c8003520 con 0x7f96dc0b3b40 2023-08-09T12:45:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 >> v2:172.21.15.142:3300/0 conn(0x7f96dc0adc40 msgr2=0x7f96dc06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e0f9e640 1 --2- 172.21.15.17:0/3744947651 >> v2:172.21.15.142:3300/0 conn(0x7f96dc0adc40 0x7f96dc06c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 >> v1:172.21.15.142:6789/0 conn(0x7f96dc0cc630 legacy=0x7f96dc0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc06fe80 con 0x7f96dc0b3b40 2023-08-09T12:45:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.482+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f96cc0017f0 con 0x7f96dc0b3b40 2023-08-09T12:45:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 >> v1:172.21.15.17:6789/0 conn(0x7f96dc0b3b40 legacy=0x7f96dc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e0f9e640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96c8003970 0x7f96c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e0f9e640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96c80047c0 0x7f96c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e0f9e640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0ae020 con 0x7f96c8005180 2023-08-09T12:45:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c800c120 con 0x7f96c8003970 2023-08-09T12:45:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c800c2e0 con 0x7f96c80047c0 2023-08-09T12:45:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e27a1640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:48.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e1fa0640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96c8003970 0x7f96c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:48.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e179f640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96c80047c0 0x7f96c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:48.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e27a1640 1 -- 172.21.15.17:0/3744947651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96c80047c0 msgr2=0x7f96c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:48.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e27a1640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96c80047c0 0x7f96c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e27a1640 1 -- 172.21.15.17:0/3744947651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96c8003970 msgr2=0x7f96c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:48.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e27a1640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96c8003970 0x7f96c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.483+0000 7f96e27a1640 1 -- 172.21.15.17:0/3744947651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8003520 con 0x7f96c8005180 2023-08-09T12:45:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.484+0000 7f96e27a1640 1 -- 172.21.15.17:0/3744947651 reap_dead start 2023-08-09T12:45:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.485+0000 7f96e27a1640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96c800b980 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f96d4001e50 tx=0x7f96c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f044db2ab017036 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.485+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4003b70 con 0x7f96c8005180 2023-08-09T12:45:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.485+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d4003cf0 con 0x7f96c8005180 2023-08-09T12:45:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.485+0000 7f96e0f9e640 1 -- 172.21.15.17:0/3744947651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4005310 con 0x7f96c8005180 2023-08-09T12:45:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.485+0000 7f96e4204640 1 -- 172.21.15.17:0/3744947651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 msgr2=0x7f96c800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.485+0000 7f96e4204640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96c800b980 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f96d4001e50 tx=0x7f96c80057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.486+0000 7f96e4204640 1 -- 172.21.15.17:0/3744947651 shutdown_connections 2023-08-09T12:45:48.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.486+0000 7f96e4204640 1 --2- 172.21.15.17:0/3744947651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96c800b980 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.486+0000 7f96e4204640 1 -- 172.21.15.17:0/3744947651 >> 172.21.15.17:0/3744947651 conn(0x7f96dc0cb1b0 msgr2=0x7f96dc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:48.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.486+0000 7f96e4204640 1 -- 172.21.15.17:0/3744947651 shutdown_connections 2023-08-09T12:45:48.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.486+0000 7f96e4204640 1 -- 172.21.15.17:0/3744947651 wait complete. 2023-08-09T12:45:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.488+0000 7f96e4204640 1 Processor -- start 2023-08-09T12:45:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.488+0000 7f96e4204640 1 -- start start 2023-08-09T12:45:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e4204640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96dc147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e4204640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96dc0ae160 0x7f96dc0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e4204640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96dc1f0060 0x7f96dc1f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e4204640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0aeb20 con 0x7f96c8005180 2023-08-09T12:45:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e4204640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc14a6d0 con 0x7f96dc1f0060 2023-08-09T12:45:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e4204640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc1f0d90 con 0x7f96dc0ae160 2023-08-09T12:45:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e1fa0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96dc147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e1fa0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96dc147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45316/0 (socket says 172.21.15.17:45316) 2023-08-09T12:45:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e1fa0640 1 -- 172.21.15.17:0/794835207 learned_addr learned my addr 172.21.15.17:0/794835207 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e1fa0640 1 -- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96dc0ae160 msgr2=0x7f96dc0ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e1fa0640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96dc0ae160 0x7f96dc0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e1fa0640 1 -- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96dc1f0060 msgr2=0x7f96dc1f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e1fa0640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96dc1f0060 0x7f96dc1f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.489+0000 7f96e1fa0640 1 -- 172.21.15.17:0/794835207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc14a990 con 0x7f96c8005180 2023-08-09T12:45:48.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.490+0000 7f96e1fa0640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96dc147d60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f96d8011540 tx=0x7f96d8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:48.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.490+0000 7f96d27fc640 1 -- 172.21.15.17:0/794835207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8015930 con 0x7f96c8005180 2023-08-09T12:45:48.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.490+0000 7f96d27fc640 1 -- 172.21.15.17:0/794835207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8015a90 con 0x7f96c8005180 2023-08-09T12:45:48.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.490+0000 7f96d27fc640 1 -- 172.21.15.17:0/794835207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8015e60 con 0x7f96c8005180 2023-08-09T12:45:48.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.490+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96dc14ac70 con 0x7f96c8005180 2023-08-09T12:45:48.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.490+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96dc1482a0 con 0x7f96c8005180 2023-08-09T12:45:48.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.491+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96dc0b1e20 con 0x7f96c8005180 2023-08-09T12:45:48.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.492+0000 7f96d27fc640 1 -- 172.21.15.17:0/794835207 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f96d800f460 con 0x7f96c8005180 2023-08-09T12:45:48.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.494+0000 7f96d27fc640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96c006a080 0x7f96c006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:48.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.494+0000 7f96d27fc640 1 -- 172.21.15.17:0/794835207 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96d8088de0 con 0x7f96c8005180 2023-08-09T12:45:48.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.495+0000 7f96e179f640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96c006a080 0x7f96c006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:48.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.496+0000 7f96e179f640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96c006a080 0x7f96c006c540 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f96cc000ef0 tx=0x7f96cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:48.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.498+0000 7f96d27fc640 1 -- 172.21.15.17:0/794835207 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f96d8057ec0 con 0x7f96c8005180 2023-08-09T12:45:48.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.691+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96dc070440 con 0x7f96c006a080 2023-08-09T12:45:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.715+0000 7f96d27fc640 1 -- 172.21.15.17:0/794835207 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299984 (secure 0 0 0) 0x7f96cc0016d0 con 0x7f96c006a080 2023-08-09T12:45:48.719 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:45:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96c006a080 msgr2=0x7f96c006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96c006a080 0x7f96c006c540 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f96cc000ef0 tx=0x7f96cc009040 comp rx=0 tx=0).stop 2023-08-09T12:45:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 msgr2=0x7f96dc147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:48.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96dc147d60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f96d8011540 tx=0x7f96d8011a00 comp rx=0 tx=0).stop 2023-08-09T12:45:48.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 shutdown_connections 2023-08-09T12:45:48.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96c006a080 0x7f96c006c540 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96dc1f0060 0x7f96dc1f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96dc0ae160 0x7f96dc0ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 --2- 172.21.15.17:0/794835207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96c8005180 0x7f96dc147d60 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:48.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 >> 172.21.15.17:0/794835207 conn(0x7f96dc0cb1b0 msgr2=0x7f96dc06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:48.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 shutdown_connections 2023-08-09T12:45:48.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:48.722+0000 7f96e4204640 1 -- 172.21.15.17:0/794835207 wait complete. 2023-08-09T12:45:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-08-09T12:45:46.782311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556484,"statfs":{"total":1600000000,"available":1593839923,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.642597"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161210+0000","last_change":"2023-08-09T12:45:42.161210+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161210+0000","last_undegraded":"2023-08-09T12:45:42.161210+0000","last_fullsized":"2023-08-09T12:45:42.161210+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.166849+0000","last_change":"2023-08-09T12:45:42.166849+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.166849+0000","last_undegraded":"2023-08-09T12:45:42.166849+0000","last_fullsized":"2023-08-09T12:45:42.166849+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164929+0000","last_change":"2023-08-09T12:45:42.164929+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164929+0000","last_undegraded":"2023-08-09T12:45:42.164929+0000","last_fullsized":"2023-08-09T12:45:42.164929+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000704+0000","last_change":"2023-08-09T12:45:43.213782+0000","last_active":"2023-08-09T12:45:46.000704+0000","last_peered":"2023-08-09T12:45:46.000704+0000","last_clean":"2023-08-09T12:45:46.000704+0000","last_became_active":"2023-08-09T12:45:43.208612+0000","last_became_peered":"2023-08-09T12:45:43.208612+0000","last_unstale":"2023-08-09T12:45:46.000704+0000","last_undegraded":"2023-08-09T12:45:46.000704+0000","last_fullsized":"2023-08-09T12:45:46.000704+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:39.279681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157285+0000","last_change":"2023-08-09T12:45:42.157285+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157285+0000","last_undegraded":"2023-08-09T12:45:42.157285+0000","last_fullsized":"2023-08-09T12:45:42.157285+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187782+0000","last_change":"2023-08-09T12:45:43.220479+0000","last_active":"2023-08-09T12:45:44.187782+0000","last_peered":"2023-08-09T12:45:44.187782+0000","last_clean":"2023-08-09T12:45:44.187782+0000","last_became_active":"2023-08-09T12:45:43.219067+0000","last_became_peered":"2023-08-09T12:45:43.219067+0000","last_unstale":"2023-08-09T12:45:44.187782+0000","last_undegraded":"2023-08-09T12:45:44.187782+0000","last_fullsized":"2023-08-09T12:45:44.187782+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:33:26.728442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.168347+0000","last_change":"2023-08-09T12:45:42.168347+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.168347+0000","last_undegraded":"2023-08-09T12:45:42.168347+0000","last_fullsized":"2023-08-09T12:45:42.168347+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000642+0000","last_change":"2023-08-09T12:45:43.222222+0000","last_active":"2023-08-09T12:45:46.000642+0000","last_peered":"2023-08-09T12:45:46.000642+0000","last_clean":"2023-08-09T12:45:46.000642+0000","last_became_active":"2023-08-09T12:45:43.221414+0000","last_became_peered":"2023-08-09T12:45:43.221414+0000","last_unstale":"2023-08-09T12:45:46.000642+0000","last_undegraded":"2023-08-09T12:45:46.000642+0000","last_fullsized":"2023-08-09T12:45:46.000642+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:56.592868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163008+0000","last_change":"2023-08-09T12:45:42.163008+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163008+0000","last_undegraded":"2023-08-09T12:45:42.163008+0000","last_fullsized":"2023-08-09T12:45:42.163008+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161933+0000","last_change":"2023-08-09T12:45:42.161933+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161933+0000","last_undegraded":"2023-08-09T12:45:42.161933+0000","last_fullsized":"2023-08-09T12:45:42.161933+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.158457+0000","last_change":"2023-08-09T12:45:42.158457+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.158457+0000","last_undegraded":"2023-08-09T12:45:42.158457+0000","last_fullsized":"2023-08-09T12:45:42.158457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162043+0000","last_change":"2023-08-09T12:45:42.162043+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162043+0000","last_undegraded":"2023-08-09T12:45:42.162043+0000","last_fullsized":"2023-08-09T12:45:42.162043+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000997+0000","last_change":"2023-08-09T12:45:43.222062+0000","last_active":"2023-08-09T12:45:46.000997+0000","last_peered":"2023-08-09T12:45:46.000997+0000","last_clean":"2023-08-09T12:45:46.000997+0000","last_became_active":"2023-08-09T12:45:43.220036+0000","last_became_peered":"2023-08-09T12:45:43.220036+0000","last_unstale":"2023-08-09T12:45:46.000997+0000","last_undegraded":"2023-08-09T12:45:46.000997+0000","last_fullsized":"2023-08-09T12:45:46.000997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:32:26.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161558+0000","last_change":"2023-08-09T12:45:42.161558+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161558+0000","last_undegraded":"2023-08-09T12:45:42.161558+0000","last_fullsized":"2023-08-09T12:45:42.161558+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001377+0000","last_change":"2023-08-09T12:45:43.220452+0000","last_active":"2023-08-09T12:45:46.001377+0000","last_peered":"2023-08-09T12:45:46.001377+0000","last_clean":"2023-08-09T12:45:46.001377+0000","last_became_active":"2023-08-09T12:45:43.219442+0000","last_became_peered":"2023-08-09T12:45:43.219442+0000","last_unstale":"2023-08-09T12:45:46.001377+0000","last_undegraded":"2023-08-09T12:45:46.001377+0000","last_fullsized":"2023-08-09T12:45:46.001377+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:07:24.077186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187419+0000","last_change":"2023-08-09T12:45:43.215398+0000","last_active":"2023-08-09T12:45:44.187419+0000","last_peered":"2023-08-09T12:45:44.187419+0000","last_clean":"2023-08-09T12:45:44.187419+0000","last_became_active":"2023-08-09T12:45:43.208415+0000","last_became_peered":"2023-08-09T12:45:43.208415+0000","last_unstale":"2023-08-09T12:45:44.187419+0000","last_undegraded":"2023-08-09T12:45:44.187419+0000","last_fullsized":"2023-08-09T12:45:44.187419+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:29:31.561794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187082+0000","last_change":"2023-08-09T12:45:43.213178+0000","last_active":"2023-08-09T12:45:44.187082+0000","last_peered":"2023-08-09T12:45:44.187082+0000","last_clean":"2023-08-09T12:45:44.187082+0000","last_became_active":"2023-08-09T12:45:43.210516+0000","last_became_peered":"2023-08-09T12:45:43.210516+0000","last_unstale":"2023-08-09T12:45:44.187082+0000","last_undegraded":"2023-08-09T12:45:44.187082+0000","last_fullsized":"2023-08-09T12:45:44.187082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:17:21.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164026+0000","last_change":"2023-08-09T12:45:42.164026+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164026+0000","last_undegraded":"2023-08-09T12:45:42.164026+0000","last_fullsized":"2023-08-09T12:45:42.164026+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159847+0000","last_change":"2023-08-09T12:45:42.159847+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159847+0000","last_undegraded":"2023-08-09T12:45:42.159847+0000","last_fullsized":"2023-08-09T12:45:42.159847+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001736+0000","last_change":"2023-08-09T12:45:43.220290+0000","last_active":"2023-08-09T12:45:46.001736+0000","last_peered":"2023-08-09T12:45:46.001736+0000","last_clean":"2023-08-09T12:45:46.001736+0000","last_became_active":"2023-08-09T12:45:43.219092+0000","last_became_peered":"2023-08-09T12:45:43.219092+0000","last_unstale":"2023-08-09T12:45:46.001736+0000","last_undegraded":"2023-08-09T12:45:46.001736+0000","last_fullsized":"2023-08-09T12:45:46.001736+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:50.772522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157526+0000","last_change":"2023-08-09T12:45:42.157526+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157526+0000","last_undegraded":"2023-08-09T12:45:42.157526+0000","last_fullsized":"2023-08-09T12:45:42.157526+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157066+0000","last_change":"2023-08-09T12:45:42.157066+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157066+0000","last_undegraded":"2023-08-09T12:45:42.157066+0000","last_fullsized":"2023-08-09T12:45:42.157066+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154308+0000","last_change":"2023-08-09T12:45:42.154308+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154308+0000","last_undegraded":"2023-08-09T12:45:42.154308+0000","last_fullsized":"2023-08-09T12:45:42.154308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162404+0000","last_change":"2023-08-09T12:45:42.162404+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162404+0000","last_undegraded":"2023-08-09T12:45:42.162404+0000","last_fullsized":"2023-08-09T12:45:42.162404+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163371+0000","last_change":"2023-08-09T12:45:42.163371+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163371+0000","last_undegraded":"2023-08-09T12:45:42.163371+0000","last_fullsized":"2023-08-09T12:45:42.163371+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155911+0000","last_change":"2023-08-09T12:45:42.155911+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155911+0000","last_undegraded":"2023-08-09T12:45:42.155911+0000","last_fullsized":"2023-08-09T12:45:42.155911+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.161542+0000","last_change":"2023-08-09T12:45:42.161542+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161542+0000","last_undegraded":"2023-08-09T12:45:42.161542+0000","last_fullsized":"2023-08-09T12:45:42.161542+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001780+0000","last_change":"2023-08-09T12:45:43.221846+0000","last_active":"2023-08-09T12:45:46.001780+0000","last_peered":"2023-08-09T12:45:46.001780+0000","last_clean":"2023-08-09T12:45:46.001780+0000","last_became_active":"2023-08-09T12:45:43.219183+0000","last_became_peered":"2023-08-09T12:45:43.219183+0000","last_unstale":"2023-08-09T12:45:46.001780+0000","last_undegraded":"2023-08-09T12:45:46.001780+0000","last_fullsized":"2023-08-09T12:45:46.001780+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:12.047475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.171415+0000","last_change":"2023-08-09T12:45:42.171415+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.171415+0000","last_undegraded":"2023-08-09T12:45:42.171415+0000","last_fullsized":"2023-08-09T12:45:42.171415+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155693+0000","last_change":"2023-08-09T12:45:42.155693+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155693+0000","last_undegraded":"2023-08-09T12:45:42.155693+0000","last_fullsized":"2023-08-09T12:45:42.155693+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.160364+0000","last_change":"2023-08-09T12:45:42.160364+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.160364+0000","last_undegraded":"2023-08-09T12:45:42.160364+0000","last_fullsized":"2023-08-09T12:45:42.160364+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187308+0000","last_change":"2023-08-09T12:45:43.212976+0000","last_active":"2023-08-09T12:45:44.187308+0000","last_peered":"2023-08-09T12:45:44.187308+0000","last_clean":"2023-08-09T12:45:44.187308+0000","last_became_active":"2023-08-09T12:45:43.210090+0000","last_became_peered":"2023-08-09T12:45:43.210090+0000","last_unstale":"2023-08-09T12:45:44.187308+0000","last_undegraded":"2023-08-09T12:45:44.187308+0000","last_fullsized":"2023-08-09T12:45:44.187308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:14.105191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188003+0000","last_change":"2023-08-09T12:45:43.220135+0000","last_active":"2023-08-09T12:45:44.188003+0000","last_peered":"2023-08-09T12:45:44.188003+0000","last_clean":"2023-08-09T12:45:44.188003+0000","last_became_active":"2023-08-09T12:45:43.214687+0000","last_became_peered":"2023-08-09T12:45:43.214687+0000","last_unstale":"2023-08-09T12:45:44.188003+0000","last_undegraded":"2023-08-09T12:45:44.188003+0000","last_fullsized":"2023-08-09T12:45:44.188003+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:31.661935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.169477+0000","last_change":"2023-08-09T12:45:42.169123+0000","last_active":"2023-08-09T12:45:42.169477+0000","last_peered":"2023-08-09T12:45:42.169477+0000","last_clean":"2023-08-09T12:45:42.169477+0000","last_became_active":"2023-08-09T12:45:42.168705+0000","last_became_peered":"2023-08-09T12:45:42.168705+0000","last_unstale":"2023-08-09T12:45:42.169477+0000","last_undegraded":"2023-08-09T12:45:42.169477+0000","last_fullsized":"2023-08-09T12:45:42.169477+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:48.565955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187492+0000","last_change":"2023-08-09T12:45:43.194527+0000","last_active":"2023-08-09T12:45:44.187492+0000","last_peered":"2023-08-09T12:45:44.187492+0000","last_clean":"2023-08-09T12:45:44.187492+0000","last_became_active":"2023-08-09T12:45:43.193850+0000","last_became_peered":"2023-08-09T12:45:43.193850+0000","last_unstale":"2023-08-09T12:45:44.187492+0000","last_undegraded":"2023-08-09T12:45:44.187492+0000","last_fullsized":"2023-08-09T12:45:44.187492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:34:15.244986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171471+0000","last_change":"2023-08-09T12:45:42.171355+0000","last_active":"2023-08-09T12:45:42.171471+0000","last_peered":"2023-08-09T12:45:42.171471+0000","last_clean":"2023-08-09T12:45:42.171471+0000","last_became_active":"2023-08-09T12:45:42.170706+0000","last_became_peered":"2023-08-09T12:45:42.170706+0000","last_unstale":"2023-08-09T12:45:42.171471+0000","last_undegraded":"2023-08-09T12:45:42.171471+0000","last_fullsized":"2023-08-09T12:45:42.171471+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:09:47.921573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.170058+0000","last_change":"2023-08-09T12:45:42.170058+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.170058+0000","last_undegraded":"2023-08-09T12:45:42.170058+0000","last_fullsized":"2023-08-09T12:45:42.170058+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174243+0000","last_change":"2023-08-09T12:45:42.174144+0000","last_active":"2023-08-09T12:45:42.174243+0000","last_peered":"2023-08-09T12:45:42.174243+0000","last_clean":"2023-08-09T12:45:42.174243+0000","last_became_active":"2023-08-09T12:45:42.173218+0000","last_became_peered":"2023-08-09T12:45:42.173218+0000","last_unstale":"2023-08-09T12:45:42.174243+0000","last_undegraded":"2023-08-09T12:45:42.174243+0000","last_fullsized":"2023-08-09T12:45:42.174243+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:54:50.748372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186995+0000","last_change":"2023-08-09T12:45:43.207086+0000","last_active":"2023-08-09T12:45:44.186995+0000","last_peered":"2023-08-09T12:45:44.186995+0000","last_clean":"2023-08-09T12:45:44.186995+0000","last_became_active":"2023-08-09T12:45:43.203598+0000","last_became_peered":"2023-08-09T12:45:43.203598+0000","last_unstale":"2023-08-09T12:45:44.186995+0000","last_undegraded":"2023-08-09T12:45:44.186995+0000","last_fullsized":"2023-08-09T12:45:44.186995+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:50.199091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.170755+0000","last_change":"2023-08-09T12:45:42.170662+0000","last_active":"2023-08-09T12:45:42.170755+0000","last_peered":"2023-08-09T12:45:42.170755+0000","last_clean":"2023-08-09T12:45:42.170755+0000","last_became_active":"2023-08-09T12:45:42.170368+0000","last_became_peered":"2023-08-09T12:45:42.170368+0000","last_unstale":"2023-08-09T12:45:42.170755+0000","last_undegraded":"2023-08-09T12:45:42.170755+0000","last_fullsized":"2023-08-09T12:45:42.170755+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:24.757940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002114+0000","last_change":"2023-08-09T12:45:43.220102+0000","last_active":"2023-08-09T12:45:46.002114+0000","last_peered":"2023-08-09T12:45:46.002114+0000","last_clean":"2023-08-09T12:45:46.002114+0000","last_became_active":"2023-08-09T12:45:43.218701+0000","last_became_peered":"2023-08-09T12:45:43.218701+0000","last_unstale":"2023-08-09T12:45:46.002114+0000","last_undegraded":"2023-08-09T12:45:46.002114+0000","last_fullsized":"2023-08-09T12:45:46.002114+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:08.765300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158762+0000","last_change":"2023-08-09T12:45:42.158581+0000","last_active":"2023-08-09T12:45:42.158762+0000","last_peered":"2023-08-09T12:45:42.158762+0000","last_clean":"2023-08-09T12:45:42.158762+0000","last_became_active":"2023-08-09T12:45:42.157895+0000","last_became_peered":"2023-08-09T12:45:42.157895+0000","last_unstale":"2023-08-09T12:45:42.158762+0000","last_undegraded":"2023-08-09T12:45:42.158762+0000","last_fullsized":"2023-08-09T12:45:42.158762+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:21:42.267168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.153059+0000","last_change":"2023-08-09T12:45:42.153059+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.153059+0000","last_undegraded":"2023-08-09T12:45:42.153059+0000","last_fullsized":"2023-08-09T12:45:42.153059+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001280+0000","last_change":"2023-08-09T12:45:42.173485+0000","last_active":"2023-08-09T12:45:46.001280+0000","last_peered":"2023-08-09T12:45:46.001280+0000","last_clean":"2023-08-09T12:45:46.001280+0000","last_became_active":"2023-08-09T12:45:42.173032+0000","last_became_peered":"2023-08-09T12:45:42.173032+0000","last_unstale":"2023-08-09T12:45:46.001280+0000","last_undegraded":"2023-08-09T12:45:46.001280+0000","last_fullsized":"2023-08-09T12:45:46.001280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.080795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187228+0000","last_change":"2023-08-09T12:45:43.214279+0000","last_active":"2023-08-09T12:45:44.187228+0000","last_peered":"2023-08-09T12:45:44.187228+0000","last_clean":"2023-08-09T12:45:44.187228+0000","last_became_active":"2023-08-09T12:45:43.213914+0000","last_became_peered":"2023-08-09T12:45:43.213914+0000","last_unstale":"2023-08-09T12:45:44.187228+0000","last_undegraded":"2023-08-09T12:45:44.187228+0000","last_fullsized":"2023-08-09T12:45:44.187228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:49:27.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.161901+0000","last_change":"2023-08-09T12:45:42.161901+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.161901+0000","last_undegraded":"2023-08-09T12:45:42.161901+0000","last_fullsized":"2023-08-09T12:45:42.161901+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:31.040704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000702+0000","last_change":"2023-08-09T12:45:43.210681+0000","last_active":"2023-08-09T12:45:46.000702+0000","last_peered":"2023-08-09T12:45:46.000702+0000","last_clean":"2023-08-09T12:45:46.000702+0000","last_became_active":"2023-08-09T12:45:43.209762+0000","last_became_peered":"2023-08-09T12:45:43.209762+0000","last_unstale":"2023-08-09T12:45:46.000702+0000","last_undegraded":"2023-08-09T12:45:46.000702+0000","last_fullsized":"2023-08-09T12:45:46.000702+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:52:34.879127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.172852+0000","last_change":"2023-08-09T12:45:42.172728+0000","last_active":"2023-08-09T12:45:42.172852+0000","last_peered":"2023-08-09T12:45:42.172852+0000","last_clean":"2023-08-09T12:45:42.172852+0000","last_became_active":"2023-08-09T12:45:42.172043+0000","last_became_peered":"2023-08-09T12:45:42.172043+0000","last_unstale":"2023-08-09T12:45:42.172852+0000","last_undegraded":"2023-08-09T12:45:42.172852+0000","last_fullsized":"2023-08-09T12:45:42.172852+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:52:08.457096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.155247+0000","last_change":"2023-08-09T12:45:42.155247+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.155247+0000","last_undegraded":"2023-08-09T12:45:42.155247+0000","last_fullsized":"2023-08-09T12:45:42.155247+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.173118+0000","last_change":"2023-08-09T12:45:42.170330+0000","last_active":"2023-08-09T12:45:42.173118+0000","last_peered":"2023-08-09T12:45:42.173118+0000","last_clean":"2023-08-09T12:45:42.173118+0000","last_became_active":"2023-08-09T12:45:42.169301+0000","last_became_peered":"2023-08-09T12:45:42.169301+0000","last_unstale":"2023-08-09T12:45:42.173118+0000","last_undegraded":"2023-08-09T12:45:42.173118+0000","last_fullsized":"2023-08-09T12:45:42.173118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:20:33.769406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164521+0000","last_change":"2023-08-09T12:45:42.164521+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164521+0000","last_undegraded":"2023-08-09T12:45:42.164521+0000","last_fullsized":"2023-08-09T12:45:42.164521+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.162977+0000","last_change":"2023-08-09T12:45:42.162977+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162977+0000","last_undegraded":"2023-08-09T12:45:42.162977+0000","last_fullsized":"2023-08-09T12:45:42.162977+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:43.375069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.163437+0000","last_change":"2023-08-09T12:45:42.163437+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.163437+0000","last_undegraded":"2023-08-09T12:45:42.163437+0000","last_fullsized":"2023-08-09T12:45:42.163437+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.166921+0000","last_change":"2023-08-09T12:45:42.166679+0000","last_active":"2023-08-09T12:45:42.166921+0000","last_peered":"2023-08-09T12:45:42.166921+0000","last_clean":"2023-08-09T12:45:42.166921+0000","last_became_active":"2023-08-09T12:45:42.166306+0000","last_became_peered":"2023-08-09T12:45:42.166306+0000","last_unstale":"2023-08-09T12:45:42.166921+0000","last_undegraded":"2023-08-09T12:45:42.166921+0000","last_fullsized":"2023-08-09T12:45:42.166921+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:14:12.598589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001536+0000","last_change":"2023-08-09T12:45:43.217109+0000","last_active":"2023-08-09T12:45:46.001536+0000","last_peered":"2023-08-09T12:45:46.001536+0000","last_clean":"2023-08-09T12:45:46.001536+0000","last_became_active":"2023-08-09T12:45:43.216368+0000","last_became_peered":"2023-08-09T12:45:43.216368+0000","last_unstale":"2023-08-09T12:45:46.001536+0000","last_undegraded":"2023-08-09T12:45:46.001536+0000","last_fullsized":"2023-08-09T12:45:46.001536+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:05:21.390158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"109'6","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187481+0000","last_change":"2023-08-09T12:45:42.169490+0000","last_active":"2023-08-09T12:45:44.187481+0000","last_peered":"2023-08-09T12:45:44.187481+0000","last_clean":"2023-08-09T12:45:44.187481+0000","last_became_active":"2023-08-09T12:45:42.169083+0000","last_became_peered":"2023-08-09T12:45:42.169083+0000","last_unstale":"2023-08-09T12:45:44.187481+0000","last_undegraded":"2023-08-09T12:45:44.187481+0000","last_fullsized":"2023-08-09T12:45:44.187481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.655063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002255+0000","last_change":"2023-08-09T12:45:43.213666+0000","last_active":"2023-08-09T12:45:46.002255+0000","last_peered":"2023-08-09T12:45:46.002255+0000","last_clean":"2023-08-09T12:45:46.002255+0000","last_became_active":"2023-08-09T12:45:43.211302+0000","last_became_peered":"2023-08-09T12:45:43.211302+0000","last_unstale":"2023-08-09T12:45:46.002255+0000","last_undegraded":"2023-08-09T12:45:46.002255+0000","last_fullsized":"2023-08-09T12:45:46.002255+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:28:50.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.173563+0000","last_change":"2023-08-09T12:45:42.173486+0000","last_active":"2023-08-09T12:45:42.173563+0000","last_peered":"2023-08-09T12:45:42.173563+0000","last_clean":"2023-08-09T12:45:42.173563+0000","last_became_active":"2023-08-09T12:45:42.172463+0000","last_became_peered":"2023-08-09T12:45:42.172463+0000","last_unstale":"2023-08-09T12:45:42.173563+0000","last_undegraded":"2023-08-09T12:45:42.173563+0000","last_fullsized":"2023-08-09T12:45:42.173563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:43:08.787669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154768+0000","last_change":"2023-08-09T12:45:42.154768+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154768+0000","last_undegraded":"2023-08-09T12:45:42.154768+0000","last_fullsized":"2023-08-09T12:45:42.154768+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188072+0000","last_change":"2023-08-09T12:45:42.170960+0000","last_active":"2023-08-09T12:45:44.188072+0000","last_peered":"2023-08-09T12:45:44.188072+0000","last_clean":"2023-08-09T12:45:44.188072+0000","last_became_active":"2023-08-09T12:45:42.170519+0000","last_became_peered":"2023-08-09T12:45:42.170519+0000","last_unstale":"2023-08-09T12:45:44.188072+0000","last_undegraded":"2023-08-09T12:45:44.188072+0000","last_fullsized":"2023-08-09T12:45:44.188072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:08:04.874324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159739+0000","last_change":"2023-08-09T12:45:42.159739+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159739+0000","last_undegraded":"2023-08-09T12:45:42.159739+0000","last_fullsized":"2023-08-09T12:45:42.159739+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000943+0000","last_change":"2023-08-09T12:45:42.170297+0000","last_active":"2023-08-09T12:45:46.000943+0000","last_peered":"2023-08-09T12:45:46.000943+0000","last_clean":"2023-08-09T12:45:46.000943+0000","last_became_active":"2023-08-09T12:45:42.169795+0000","last_became_peered":"2023-08-09T12:45:42.169795+0000","last_unstale":"2023-08-09T12:45:46.000943+0000","last_undegraded":"2023-08-09T12:45:46.000943+0000","last_fullsized":"2023-08-09T12:45:46.000943+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:12:25.996027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159891+0000","last_change":"2023-08-09T12:45:42.159891+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159891+0000","last_undegraded":"2023-08-09T12:45:42.159891+0000","last_fullsized":"2023-08-09T12:45:42.159891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"109'8","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001962+0000","last_change":"2023-08-09T12:45:42.170246+0000","last_active":"2023-08-09T12:45:46.001962+0000","last_peered":"2023-08-09T12:45:46.001962+0000","last_clean":"2023-08-09T12:45:46.001962+0000","last_became_active":"2023-08-09T12:45:42.169960+0000","last_became_peered":"2023-08-09T12:45:42.169960+0000","last_unstale":"2023-08-09T12:45:46.001962+0000","last_undegraded":"2023-08-09T12:45:46.001962+0000","last_fullsized":"2023-08-09T12:45:46.001962+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:49:26.573151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.152115+0000","last_change":"2023-08-09T12:45:42.152115+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.152115+0000","last_undegraded":"2023-08-09T12:45:42.152115+0000","last_fullsized":"2023-08-09T12:45:42.152115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171025+0000","last_change":"2023-08-09T12:45:42.170944+0000","last_active":"2023-08-09T12:45:42.171025+0000","last_peered":"2023-08-09T12:45:42.171025+0000","last_clean":"2023-08-09T12:45:42.171025+0000","last_became_active":"2023-08-09T12:45:42.170658+0000","last_became_peered":"2023-08-09T12:45:42.170658+0000","last_unstale":"2023-08-09T12:45:42.171025+0000","last_undegraded":"2023-08-09T12:45:42.171025+0000","last_fullsized":"2023-08-09T12:45:42.171025+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:42.449824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187233+0000","last_change":"2023-08-09T12:45:43.209718+0000","last_active":"2023-08-09T12:45:44.187233+0000","last_peered":"2023-08-09T12:45:44.187233+0000","last_clean":"2023-08-09T12:45:44.187233+0000","last_became_active":"2023-08-09T12:45:43.208102+0000","last_became_peered":"2023-08-09T12:45:43.208102+0000","last_unstale":"2023-08-09T12:45:44.187233+0000","last_undegraded":"2023-08-09T12:45:44.187233+0000","last_fullsized":"2023-08-09T12:45:44.187233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:50.899939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174927+0000","last_change":"2023-08-09T12:45:42.173319+0000","last_active":"2023-08-09T12:45:42.174927+0000","last_peered":"2023-08-09T12:45:42.174927+0000","last_clean":"2023-08-09T12:45:42.174927+0000","last_became_active":"2023-08-09T12:45:42.173050+0000","last_became_peered":"2023-08-09T12:45:42.173050+0000","last_unstale":"2023-08-09T12:45:42.174927+0000","last_undegraded":"2023-08-09T12:45:42.174927+0000","last_fullsized":"2023-08-09T12:45:42.174927+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:53:44.942746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187418+0000","last_change":"2023-08-09T12:45:43.207367+0000","last_active":"2023-08-09T12:45:44.187418+0000","last_peered":"2023-08-09T12:45:44.187418+0000","last_clean":"2023-08-09T12:45:44.187418+0000","last_became_active":"2023-08-09T12:45:43.204580+0000","last_became_peered":"2023-08-09T12:45:43.204580+0000","last_unstale":"2023-08-09T12:45:44.187418+0000","last_undegraded":"2023-08-09T12:45:44.187418+0000","last_fullsized":"2023-08-09T12:45:44.187418+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:35:03.227531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174793+0000","last_change":"2023-08-09T12:45:42.174675+0000","last_active":"2023-08-09T12:45:42.174793+0000","last_peered":"2023-08-09T12:45:42.174793+0000","last_clean":"2023-08-09T12:45:42.174793+0000","last_became_active":"2023-08-09T12:45:42.172063+0000","last_became_peered":"2023-08-09T12:45:42.172063+0000","last_unstale":"2023-08-09T12:45:42.174793+0000","last_undegraded":"2023-08-09T12:45:42.174793+0000","last_fullsized":"2023-08-09T12:45:42.174793+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:06.446881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.166272+0000","last_change":"2023-08-09T12:45:42.166272+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.166272+0000","last_undegraded":"2023-08-09T12:45:42.166272+0000","last_fullsized":"2023-08-09T12:45:42.166272+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.157349+0000","last_change":"2023-08-09T12:45:42.157166+0000","last_active":"2023-08-09T12:45:42.157349+0000","last_peered":"2023-08-09T12:45:42.157349+0000","last_clean":"2023-08-09T12:45:42.157349+0000","last_became_active":"2023-08-09T12:45:42.156526+0000","last_became_peered":"2023-08-09T12:45:42.156526+0000","last_unstale":"2023-08-09T12:45:42.157349+0000","last_undegraded":"2023-08-09T12:45:42.157349+0000","last_fullsized":"2023-08-09T12:45:42.157349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:58:27.924929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.160963+0000","last_change":"2023-08-09T12:45:42.160963+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.160963+0000","last_undegraded":"2023-08-09T12:45:42.160963+0000","last_fullsized":"2023-08-09T12:45:42.160963+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188157+0000","last_change":"2023-08-09T12:45:42.168078+0000","last_active":"2023-08-09T12:45:44.188157+0000","last_peered":"2023-08-09T12:45:44.188157+0000","last_clean":"2023-08-09T12:45:44.188157+0000","last_became_active":"2023-08-09T12:45:42.167759+0000","last_became_peered":"2023-08-09T12:45:42.167759+0000","last_unstale":"2023-08-09T12:45:44.188157+0000","last_undegraded":"2023-08-09T12:45:44.188157+0000","last_fullsized":"2023-08-09T12:45:44.188157+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:51.969009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.164478+0000","last_change":"2023-08-09T12:45:42.164478+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.164478+0000","last_undegraded":"2023-08-09T12:45:42.164478+0000","last_fullsized":"2023-08-09T12:45:42.164478+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.175062+0000","last_change":"2023-08-09T12:45:42.174892+0000","last_active":"2023-08-09T12:45:42.175062+0000","last_peered":"2023-08-09T12:45:42.175062+0000","last_clean":"2023-08-09T12:45:42.175062+0000","last_became_active":"2023-08-09T12:45:42.172982+0000","last_became_peered":"2023-08-09T12:45:42.172982+0000","last_unstale":"2023-08-09T12:45:42.175062+0000","last_undegraded":"2023-08-09T12:45:42.175062+0000","last_fullsized":"2023-08-09T12:45:42.175062+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:13:37.150933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.157194+0000","last_change":"2023-08-09T12:45:42.157194+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.157194+0000","last_undegraded":"2023-08-09T12:45:42.157194+0000","last_fullsized":"2023-08-09T12:45:42.157194+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.161908+0000","last_change":"2023-08-09T12:45:42.161730+0000","last_active":"2023-08-09T12:45:42.161908+0000","last_peered":"2023-08-09T12:45:42.161908+0000","last_clean":"2023-08-09T12:45:42.161908+0000","last_became_active":"2023-08-09T12:45:42.160990+0000","last_became_peered":"2023-08-09T12:45:42.160990+0000","last_unstale":"2023-08-09T12:45:42.161908+0000","last_undegraded":"2023-08-09T12:45:42.161908+0000","last_fullsized":"2023-08-09T12:45:42.161908+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:18.677102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187917+0000","last_change":"2023-08-09T12:45:43.219911+0000","last_active":"2023-08-09T12:45:44.187917+0000","last_peered":"2023-08-09T12:45:44.187917+0000","last_clean":"2023-08-09T12:45:44.187917+0000","last_became_active":"2023-08-09T12:45:43.214021+0000","last_became_peered":"2023-08-09T12:45:43.214021+0000","last_unstale":"2023-08-09T12:45:44.187917+0000","last_undegraded":"2023-08-09T12:45:44.187917+0000","last_fullsized":"2023-08-09T12:45:44.187917+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:07.660676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.176022+0000","last_change":"2023-08-09T12:45:42.175573+0000","last_active":"2023-08-09T12:45:42.176022+0000","last_peered":"2023-08-09T12:45:42.176022+0000","last_clean":"2023-08-09T12:45:42.176022+0000","last_became_active":"2023-08-09T12:45:42.174408+0000","last_became_peered":"2023-08-09T12:45:42.174408+0000","last_unstale":"2023-08-09T12:45:42.176022+0000","last_undegraded":"2023-08-09T12:45:42.176022+0000","last_fullsized":"2023-08-09T12:45:42.176022+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:21:34.811103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.167806+0000","last_change":"2023-08-09T12:45:42.167806+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.167806+0000","last_undegraded":"2023-08-09T12:45:42.167806+0000","last_fullsized":"2023-08-09T12:45:42.167806+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001499+0000","last_change":"2023-08-09T12:45:42.173336+0000","last_active":"2023-08-09T12:45:46.001499+0000","last_peered":"2023-08-09T12:45:46.001499+0000","last_clean":"2023-08-09T12:45:46.001499+0000","last_became_active":"2023-08-09T12:45:42.173027+0000","last_became_peered":"2023-08-09T12:45:42.173027+0000","last_unstale":"2023-08-09T12:45:46.001499+0000","last_undegraded":"2023-08-09T12:45:46.001499+0000","last_fullsized":"2023-08-09T12:45:46.001499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:52.986927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":338,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158948+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:45:42.158948+0000","last_peered":"2023-08-09T12:45:42.158948+0000","last_clean":"2023-08-09T12:45:42.158948+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:45:42.158948+0000","last_undegraded":"2023-08-09T12:45:42.158948+0000","last_fullsized":"2023-08-09T12:45:42.158948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:12:00.329935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.160765+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:45:42.160765+0000","last_peered":"2023-08-09T12:45:42.160765+0000","last_clean":"2023-08-09T12:45:42.160765+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:45:42.160765+0000","last_undegraded":"2023-08-09T12:45:42.160765+0000","last_fullsized":"2023-08-09T12:45:42.160765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:35.037032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187486+0000","last_change":"2023-08-09T12:45:43.213774+0000","last_active":"2023-08-09T12:45:44.187486+0000","last_peered":"2023-08-09T12:45:44.187486+0000","last_clean":"2023-08-09T12:45:44.187486+0000","last_became_active":"2023-08-09T12:45:43.213507+0000","last_became_peered":"2023-08-09T12:45:43.213507+0000","last_unstale":"2023-08-09T12:45:44.187486+0000","last_undegraded":"2023-08-09T12:45:44.187486+0000","last_fullsized":"2023-08-09T12:45:44.187486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:18:30.758379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.171171+0000","last_change":"2023-08-09T12:45:42.170733+0000","last_active":"2023-08-09T12:45:42.171171+0000","last_peered":"2023-08-09T12:45:42.171171+0000","last_clean":"2023-08-09T12:45:42.171171+0000","last_became_active":"2023-08-09T12:45:42.170416+0000","last_became_peered":"2023-08-09T12:45:42.170416+0000","last_unstale":"2023-08-09T12:45:42.171171+0000","last_undegraded":"2023-08-09T12:45:42.171171+0000","last_fullsized":"2023-08-09T12:45:42.171171+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:03:03.106880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158635+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:45:42.158635+0000","last_peered":"2023-08-09T12:45:42.158635+0000","last_clean":"2023-08-09T12:45:42.158635+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:45:42.158635+0000","last_undegraded":"2023-08-09T12:45:42.158635+0000","last_fullsized":"2023-08-09T12:45:42.158635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:15:08.262289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.156291+0000","last_change":"2023-08-09T12:45:42.156291+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.156291+0000","last_undegraded":"2023-08-09T12:45:42.156291+0000","last_fullsized":"2023-08-09T12:45:42.156291+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.176003+0000","last_change":"2023-08-09T12:45:42.175558+0000","last_active":"2023-08-09T12:45:42.176003+0000","last_peered":"2023-08-09T12:45:42.176003+0000","last_clean":"2023-08-09T12:45:42.176003+0000","last_became_active":"2023-08-09T12:45:42.175254+0000","last_became_peered":"2023-08-09T12:45:42.175254+0000","last_unstale":"2023-08-09T12:45:42.176003+0000","last_undegraded":"2023-08-09T12:45:42.176003+0000","last_fullsized":"2023-08-09T12:45:42.176003+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:27:04.977793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.146383+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:45:42.146383+0000","last_peered":"2023-08-09T12:45:42.146383+0000","last_clean":"2023-08-09T12:45:42.146383+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:45:42.146383+0000","last_undegraded":"2023-08-09T12:45:42.146383+0000","last_fullsized":"2023-08-09T12:45:42.146383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:38:39.646668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.154723+0000","last_change":"2023-08-09T12:45:42.154723+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.154723+0000","last_undegraded":"2023-08-09T12:45:42.154723+0000","last_fullsized":"2023-08-09T12:45:42.154723+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":6,"reported_epoch":108,"state":"active","last_fresh":"2023-08-09T12:45:42.174803+0000","last_change":"2023-08-09T12:45:42.174611+0000","last_active":"2023-08-09T12:45:42.174803+0000","last_peered":"2023-08-09T12:45:42.174803+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"2023-08-09T12:45:42.174611+0000","last_became_peered":"2023-08-09T12:45:42.174611+0000","last_unstale":"2023-08-09T12:45:42.174803+0000","last_undegraded":"2023-08-09T12:45:42.174803+0000","last_fullsized":"2023-08-09T12:45:42.174803+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:48.953496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.167216+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:45:42.167216+0000","last_peered":"2023-08-09T12:45:42.167216+0000","last_clean":"2023-08-09T12:45:42.167216+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:45:42.167216+0000","last_undegraded":"2023-08-09T12:45:42.167216+0000","last_fullsized":"2023-08-09T12:45:42.167216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:54.531530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187601+0000","last_change":"2023-08-09T12:45:43.220645+0000","last_active":"2023-08-09T12:45:44.187601+0000","last_peered":"2023-08-09T12:45:44.187601+0000","last_clean":"2023-08-09T12:45:44.187601+0000","last_became_active":"2023-08-09T12:45:43.219540+0000","last_became_peered":"2023-08-09T12:45:43.219540+0000","last_unstale":"2023-08-09T12:45:44.187601+0000","last_undegraded":"2023-08-09T12:45:44.187601+0000","last_fullsized":"2023-08-09T12:45:44.187601+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:25.671887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174369+0000","last_change":"2023-08-09T12:45:42.172661+0000","last_active":"2023-08-09T12:45:42.174369+0000","last_peered":"2023-08-09T12:45:42.174369+0000","last_clean":"2023-08-09T12:45:42.174369+0000","last_became_active":"2023-08-09T12:45:42.172329+0000","last_became_peered":"2023-08-09T12:45:42.172329+0000","last_unstale":"2023-08-09T12:45:42.174369+0000","last_undegraded":"2023-08-09T12:45:42.174369+0000","last_fullsized":"2023-08-09T12:45:42.174369+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:34:05.528627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002339+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:45:46.002339+0000","last_peered":"2023-08-09T12:45:46.002339+0000","last_clean":"2023-08-09T12:45:46.002339+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:45:46.002339+0000","last_undegraded":"2023-08-09T12:45:46.002339+0000","last_fullsized":"2023-08-09T12:45:46.002339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:04.608129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.162571+0000","last_change":"2023-08-09T12:45:42.162571+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.162571+0000","last_undegraded":"2023-08-09T12:45:42.162571+0000","last_fullsized":"2023-08-09T12:45:42.162571+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.146606+0000","last_change":"2023-08-09T12:45:42.146606+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.146606+0000","last_undegraded":"2023-08-09T12:45:42.146606+0000","last_fullsized":"2023-08-09T12:45:42.146606+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:42.436453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.158351+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:45:42.158351+0000","last_peered":"2023-08-09T12:45:42.158351+0000","last_clean":"2023-08-09T12:45:42.158351+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:45:42.158351+0000","last_undegraded":"2023-08-09T12:45:42.158351+0000","last_fullsized":"2023-08-09T12:45:42.158351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:45:47.235734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2023-08-09T12:45:42.159875+0000","last_change":"2023-08-09T12:45:42.159875+0000","last_active":"2023-08-09T12:45:42.136592+0000","last_peered":"2023-08-09T12:45:42.136592+0000","last_clean":"2023-08-09T12:45:42.136592+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.159875+0000","last_undegraded":"2023-08-09T12:45:42.159875+0000","last_fullsized":"2023-08-09T12:45:42.159875+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.174386+0000","last_change":"2023-08-09T12:45:42.174137+0000","last_active":"2023-08-09T12:45:42.174386+0000","last_peered":"2023-08-09T12:45:42.174386+0000","last_clean":"2023-08-09T12:45:42.174386+0000","last_became_active":"2023-08-09T12:45:42.173831+0000","last_became_peered":"2023-08-09T12:45:42.173831+0000","last_unstale":"2023-08-09T12:45:42.174386+0000","last_undegraded":"2023-08-09T12:45:42.174386+0000","last_fullsized":"2023-08-09T12:45:42.174386+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:40:37.726534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002368+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:45:46.002368+0000","last_peered":"2023-08-09T12:45:46.002368+0000","last_clean":"2023-08-09T12:45:46.002368+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:45:46.002368+0000","last_undegraded":"2023-08-09T12:45:46.002368+0000","last_fullsized":"2023-08-09T12:45:46.002368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:25.902601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187606+0000","last_change":"2023-08-09T12:45:43.207564+0000","last_active":"2023-08-09T12:45:44.187606+0000","last_peered":"2023-08-09T12:45:44.187606+0000","last_clean":"2023-08-09T12:45:44.187606+0000","last_became_active":"2023-08-09T12:45:43.206550+0000","last_became_peered":"2023-08-09T12:45:43.206550+0000","last_unstale":"2023-08-09T12:45:44.187606+0000","last_undegraded":"2023-08-09T12:45:44.187606+0000","last_fullsized":"2023-08-09T12:45:44.187606+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:37.720656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":3,"reported_epoch":108,"state":"creating+activating","last_fresh":"2023-08-09T12:45:42.146817+0000","last_change":"2023-08-09T12:45:42.146817+0000","last_active":"2023-08-09T12:45:41.123668+0000","last_peered":"2023-08-09T12:45:41.123668+0000","last_clean":"2023-08-09T12:45:41.123668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:45:42.146817+0000","last_undegraded":"2023-08-09T12:45:42.146817+0000","last_fullsized":"2023-08-09T12:45:42.146817+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:03.177644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-09T12:45:42.149239+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:45:42.149239+0000","last_peered":"2023-08-09T12:45:42.149239+0000","last_clean":"2023-08-09T12:45:42.149239+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:45:42.149239+0000","last_undegraded":"2023-08-09T12:45:42.149239+0000","last_fullsized":"2023-08-09T12:45:42.149239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:23:37.763281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1185,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194126,"statfs":{"total":200000000,"available":198785984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.137,"15min":1.107},"min":{"1min":0.627,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.542,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.0860000000000001},"min":{"1min":0.89700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7769999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.82399999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.21,"15min":1.1160000000000001},"min":{"1min":0.748,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1990000000000001,"15min":1.117},"min":{"1min":0.79100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5600000000000001,"5min":1.734,"15min":1.734},"last":1.224}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.1819999999999999},"min":{"1min":0.69999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.96,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.083},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.1539999999999999},"min":{"1min":0.746,"5min":0.73399999999999999,"15min":0.69799999999999995},"max":{"1min":1.7070000000000001,"5min":2.173,"15min":2.173},"last":1.306}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3180000000000001,"15min":1.244},"min":{"1min":0.83299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.732,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.524},{"interface":"front","average":{"1min":1.345,"5min":1.353,"15min":1.2769999999999999},"min":{"1min":0.92600000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.843,"5min":2.282,"15min":2.282},"last":1.4590000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2330000000000001,"15min":1.202},"min":{"1min":0.81100000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6179999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.179},{"interface":"front","average":{"1min":1.341,"5min":1.3959999999999999,"15min":1.288},"min":{"1min":0.93700000000000006,"5min":0.67900000000000005,"15min":0.58599999999999997},"max":{"1min":2.0630000000000002,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.6259999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.427,"15min":1.3069999999999999},"min":{"1min":0.90200000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1699999999999999,"5min":2.802,"15min":2.802},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.587,"5min":1.516,"15min":1.4870000000000001},"min":{"1min":1.214,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.7799999999999998,"5min":3.1400000000000001,"15min":3.3580000000000001},"last":1.579}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4850000000000001,"15min":1.4690000000000001},"min":{"1min":1.0740000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.8849999999999998,"5min":3.266,"15min":3.4910000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.161,"5min":0.83699999999999997,"15min":0.623},"max":{"1min":2.3580000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.696}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1899999999999999,"15min":1.1299999999999999},"min":{"1min":0.79400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7929999999999999,"5min":2.54,"15min":2.54},"last":1.498},{"interface":"front","average":{"1min":1.139,"5min":1.127,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5469999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.92400000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.234},"min":{"1min":0.86299999999999999,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0009999999999999,"15min":2.306},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.3720000000000001,"15min":1.3260000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.613,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0309999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1659999999999999,"15min":1.1060000000000001},"min":{"1min":0.70199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5629999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3089999999999999,"15min":1.2749999999999999},"min":{"1min":0.93700000000000006,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.857,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.5940000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.363,"15min":1.2809999999999999},"min":{"1min":0.93600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.673,"5min":2.327,"15min":2.327},"last":1.131},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.359,"15min":1.296},"min":{"1min":1.0589999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.6819999999999999,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.538}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4650000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0139999999999998,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.363},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.403,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.766,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.214}]},{"osd":5,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.407,"15min":1.335},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.77600000000000002},"max":{"1min":1.8440000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.577,"15min":1.4890000000000001},"min":{"1min":1.2110000000000001,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":2.222,"5min":2.7160000000000002,"15min":2.8580000000000001},"last":1.679}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.597,"15min":1.4390000000000001},"min":{"1min":1.0820000000000001,"5min":1.0009999999999999,"15min":0.752},"max":{"1min":1.954,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":1.446},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.9690000000000001,"5min":3.621,"15min":3.621},"last":1.6419999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.131,"15min":1.117},"min":{"1min":0.77300000000000002,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.427},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.208,"15min":1.0880000000000001},"min":{"1min":0.81999999999999995,"5min":0.71699999999999997,"15min":0.625},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.3600000000000001,"15min":1.2989999999999999},"min":{"1min":1.0369999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.29,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.982,"5min":1.984,"15min":1.984},"last":1.137}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.236,"15min":1.21},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.2190000000000001,"15min":1.198},"min":{"1min":0.81399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3169999999999999,"15min":1.2150000000000001},"min":{"1min":0.96499999999999997,"5min":0.78000000000000003,"15min":0.77100000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.157},{"interface":"front","average":{"1min":1.502,"5min":1.383,"15min":1.381},"min":{"1min":1.1539999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.266,"15min":1.2370000000000001},"min":{"1min":0.88400000000000001,"5min":0.621,"15min":0.60699999999999998},"max":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":1.329},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.96899999999999997,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.496}]},{"osd":6,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3799999999999999,"15min":1.3420000000000001},"min":{"1min":1.0289999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.429,"15min":1.49},"min":{"1min":1.194,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.3879999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.5069999999999999,"15min":1.5229999999999999},"min":{"1min":1.2010000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.722,"5min":2.722,"15min":3.3250000000000002},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.72,"5min":1.5629999999999999,"15min":1.522},"min":{"1min":1.452,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.4670000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.141,"15min":1.087},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5529999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.165,"15min":1.101},"min":{"1min":0.83599999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4279999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.4830000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.3320000000000001},"min":{"1min":0.83999999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7589999999999999,"5min":1.897,"15min":1.97},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3009999999999999,"15min":1.329},"min":{"1min":0.92100000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.804,"5min":2.2040000000000002,"15min":2.7770000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.3169999999999999},"min":{"1min":0.81599999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.9810000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.3200000000000001,"15min":1.3109999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6539999999999999,"5min":1.929,"15min":1.929},"last":1.5309999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.28,"15min":1.228},"min":{"1min":0.82999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.623,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":1.665,"5min":2.081,"15min":2.081},"last":1.883}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3029999999999999,"15min":1.377},"min":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.615,"5min":1.853,"15min":1.9490000000000001},"last":1.323},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3899999999999999,"15min":1.385},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.665,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.5680000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.397,"15min":1.4850000000000001},"min":{"1min":0.76000000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.784,"5min":2.238,"15min":2.238},"last":2.101},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.756,"5min":2.036,"15min":2.036},"last":1.4370000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.542,"15min":1.5249999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8089999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.9350000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.552,"15min":1.619},"min":{"1min":0.89400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.9299999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":2.0470000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90400000000000003,"15min":0.83999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.3480000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.143,"5min":1.0549999999999999,"15min":0.91900000000000004},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":2.778,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.82399999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.91100000000000003,"15min":0.90600000000000003},"min":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.1399999999999999,"15min":0.94599999999999995},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.373},"max":{"1min":2.0219999999999998,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.98599999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.3360000000000001,"15min":1.119},"min":{"1min":0.59399999999999997,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":1.75,"5min":18.145,"15min":18.145},"last":1.361},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.2290000000000001,"15min":1.2090000000000001},"min":{"1min":0.66500000000000004,"5min":0.48999999999999999,"15min":0.41799999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.129}]},{"osd":4,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.323,"15min":1.331},"min":{"1min":0.98099999999999998,"5min":0.84399999999999997,"15min":0.745},"max":{"1min":1.712,"5min":2.972,"15min":3.5110000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.325,"15min":1.341},"min":{"1min":0.98999999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.712,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.294}]},{"osd":5,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.5760000000000001,"15min":1.444},"min":{"1min":1.099,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7210000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.512},{"interface":"front","average":{"1min":1.55,"5min":1.595,"15min":1.361},"min":{"1min":1.0249999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.2959999999999998,"5min":14.105,"15min":14.105},"last":1.0820000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.401,"15min":1.3500000000000001},"min":{"1min":1.091,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8999999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.4690000000000001,"15min":1.4810000000000001},"min":{"1min":0.93700000000000006,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8839999999999999,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.415}]},{"osd":7,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.4790000000000001,"15min":1.407},"min":{"1min":0.98599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.458,"15min":1.389},"min":{"1min":1.022,"5min":0.85699999999999998,"15min":0.70799999999999996},"max":{"1min":1.8180000000000001,"5min":3.016,"15min":3.016},"last":1.2549999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56799999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.716},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.107,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.38900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":2.9009999999999998},"last":1.236}]},{"osd":1,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.95399999999999996,"15min":0.93100000000000005},"min":{"1min":0.63700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4219999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.264,"5min":1.079,"15min":1.069},"min":{"1min":0.66700000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.823,"5min":1.823,"15min":1.869},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1719999999999999,"15min":1.1739999999999999},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.681,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.395,"5min":1.2050000000000001,"15min":1.1639999999999999},"min":{"1min":0.77300000000000002,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":2.0289999999999999,"5min":2.242,"15min":2.9409999999999998},"last":0.52800000000000002}]},{"osd":4,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.4770000000000001,"15min":1.429},"min":{"1min":1.1539999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7450000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.3799999999999999,"15min":1.288},"min":{"1min":0.97999999999999998,"5min":0.83199999999999996,"15min":0.66800000000000004},"max":{"1min":2.6509999999999998,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.1619999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.446,"15min":1.3680000000000001},"min":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.3210000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.046},{"interface":"front","average":{"1min":1.673,"5min":1.512,"15min":1.4910000000000001},"min":{"1min":1.034,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4780000000000002,"5min":4.806,"15min":4.806},"last":1.125}]},{"osd":6,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.399,"15min":1.321},"min":{"1min":0.82799999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.613,"5min":1.4790000000000001,"15min":1.431},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.7309999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.2}]},{"osd":7,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.89500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.579,"15min":1.542},"min":{"1min":0.995,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.6549999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.101}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":38,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":616,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194696,"statfs":{"total":200000000,"available":199369154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.53000000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.609,"5min":1.881,"15min":1.881},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":2.0529999999999999,"15min":1.2549999999999999},"min":{"1min":0.66400000000000003,"5min":0.47799999999999998,"15min":0.34300000000000003},"max":{"1min":1.863,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0469999999999999,"15min":0.95499999999999996},"min":{"1min":0.67400000000000004,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.476,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.337,"5min":1.306,"15min":1.147},"min":{"1min":0.91900000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.044,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1950000000000001,"15min":1.099},"min":{"1min":0.71999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.724,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.1779999999999999,"15min":0.97599999999999998},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.5740000000000001,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.55,"15min":1.2909999999999999},"min":{"1min":0.95999999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.5289999999999999,"5min":25.172000000000001,"15min":25.172000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.351,"5min":1.3819999999999999,"15min":1.302},"min":{"1min":0.94499999999999995,"5min":0.88500000000000001,"15min":0.84599999999999997},"max":{"1min":2.1589999999999998,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.669,"15min":1.399},"min":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8420000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.228},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3799999999999999,"15min":1.2849999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9059999999999999,"5min":3.762,"15min":3.762},"last":1.198}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.5449999999999999,"15min":1.431},"min":{"1min":0.91000000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.827,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.482,"15min":1.3839999999999999},"min":{"1min":1.0600000000000001,"5min":0.873,"15min":0.79500000000000004},"max":{"1min":1.7949999999999999,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.262}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.8680000000000001,"15min":1.5880000000000001},"min":{"1min":1.2829999999999999,"5min":0.96899999999999997,"15min":0.88800000000000001},"max":{"1min":2.5089999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.8759999999999999,"15min":1.5680000000000001},"min":{"1min":1.1379999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.7949999999999999,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.2929999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194111,"statfs":{"total":200000000,"available":198769885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.64500000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":1.389,"5min":1.819,"15min":1.819},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1040000000000001,"15min":0.96499999999999997},"min":{"1min":0.79200000000000004,"5min":0.53300000000000003,"15min":0.436},"max":{"1min":1.6160000000000001,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.92300000000000004}]},{"osd":2,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.038,"15min":0.96599999999999997},"min":{"1min":0.68899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.159,"15min":1.0369999999999999},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.5},"max":{"1min":1.732,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":0.63}]},{"osd":3,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.089,"15min":0.94699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.413,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.298},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.218,"15min":1.1830000000000001},"min":{"1min":0.72899999999999998,"5min":0.58199999999999996,"15min":0.56000000000000005},"max":{"1min":1.6950000000000001,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":1.375}]},{"osd":4,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3779999999999999,"15min":1.3340000000000001},"min":{"1min":0.81599999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8240000000000001,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.163},{"interface":"front","average":{"1min":1.419,"5min":1.3640000000000001,"15min":1.29},"min":{"1min":1.0289999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.45}]},{"osd":5,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4119999999999999,"15min":1.3129999999999999},"min":{"1min":0.91900000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.891,"5min":10.004,"15min":10.004},"last":1.407},{"interface":"front","average":{"1min":1.496,"5min":1.4330000000000001,"15min":1.3859999999999999},"min":{"1min":0.97799999999999998,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":1.8069999999999999,"5min":1.909,"15min":2.161},"last":1.2350000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4550000000000001,"15min":1.3480000000000001},"min":{"1min":1.1399999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9370000000000001,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.532,"15min":1.4350000000000001},"min":{"1min":1.0609999999999999,"5min":0.90100000000000002,"15min":0.86799999999999999},"max":{"1min":2.0099999999999998,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.5940000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.609,"15min":1.4390000000000001},"min":{"1min":1.202,"5min":0.80400000000000005,"15min":0.79200000000000004},"max":{"1min":1.8360000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.627,"5min":1.589,"15min":1.4710000000000001},"min":{"1min":1.1180000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.1120000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.506}]}]}],"pool_statfs":[]}} 2023-08-09T12:45:48.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-08-09T12:45:48.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.161210+0000', 'last_change': '2023-08-09T12:45:42.161210+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.161210+0000', 'last_undegraded': '2023-08-09T12:45:42.161210+0000', 'last_fullsized': '2023-08-09T12:45:42.161210+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-09T12:45:48.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-08-09T12:45:48.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.166849+0000', 'last_change': '2023-08-09T12:45:42.166849+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.166849+0000', 'last_undegraded': '2023-08-09T12:45:42.166849+0000', 'last_fullsized': '2023-08-09T12:45:42.166849+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-09T12:45:48.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-08-09T12:45:48.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.164929+0000', 'last_change': '2023-08-09T12:45:42.164929+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.164929+0000', 'last_undegraded': '2023-08-09T12:45:42.164929+0000', 'last_fullsized': '2023-08-09T12:45:42.164929+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-09T12:45:48.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-08-09T12:45:48.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.157285+0000', 'last_change': '2023-08-09T12:45:42.157285+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.157285+0000', 'last_undegraded': '2023-08-09T12:45:42.157285+0000', 'last_fullsized': '2023-08-09T12:45:42.157285+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-08-09T12:45:48.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.168347+0000', 'last_change': '2023-08-09T12:45:42.168347+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.168347+0000', 'last_undegraded': '2023-08-09T12:45:42.168347+0000', 'last_fullsized': '2023-08-09T12:45:42.168347+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-09T12:45:48.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-08-09T12:45:48.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.163008+0000', 'last_change': '2023-08-09T12:45:42.163008+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.163008+0000', 'last_undegraded': '2023-08-09T12:45:42.163008+0000', 'last_fullsized': '2023-08-09T12:45:42.163008+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-08-09T12:45:48.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.161933+0000', 'last_change': '2023-08-09T12:45:42.161933+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.161933+0000', 'last_undegraded': '2023-08-09T12:45:42.161933+0000', 'last_fullsized': '2023-08-09T12:45:42.161933+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-09T12:45:48.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-08-09T12:45:48.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.158457+0000', 'last_change': '2023-08-09T12:45:42.158457+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.158457+0000', 'last_undegraded': '2023-08-09T12:45:42.158457+0000', 'last_fullsized': '2023-08-09T12:45:42.158457+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-08-09T12:45:48.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.162043+0000', 'last_change': '2023-08-09T12:45:42.162043+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.162043+0000', 'last_undegraded': '2023-08-09T12:45:42.162043+0000', 'last_fullsized': '2023-08-09T12:45:42.162043+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-09T12:45:48.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-08-09T12:45:48.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.161558+0000', 'last_change': '2023-08-09T12:45:42.161558+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.161558+0000', 'last_undegraded': '2023-08-09T12:45:42.161558+0000', 'last_fullsized': '2023-08-09T12:45:42.161558+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-08-09T12:45:48.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.164026+0000', 'last_change': '2023-08-09T12:45:42.164026+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.164026+0000', 'last_undegraded': '2023-08-09T12:45:42.164026+0000', 'last_fullsized': '2023-08-09T12:45:42.164026+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-09T12:45:48.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-08-09T12:45:48.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.159847+0000', 'last_change': '2023-08-09T12:45:42.159847+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.159847+0000', 'last_undegraded': '2023-08-09T12:45:42.159847+0000', 'last_fullsized': '2023-08-09T12:45:42.159847+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-08-09T12:45:48.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.157526+0000', 'last_change': '2023-08-09T12:45:42.157526+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.157526+0000', 'last_undegraded': '2023-08-09T12:45:42.157526+0000', 'last_fullsized': '2023-08-09T12:45:42.157526+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-08-09T12:45:48.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.157066+0000', 'last_change': '2023-08-09T12:45:42.157066+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.157066+0000', 'last_undegraded': '2023-08-09T12:45:42.157066+0000', 'last_fullsized': '2023-08-09T12:45:42.157066+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-08-09T12:45:48.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.154308+0000', 'last_change': '2023-08-09T12:45:42.154308+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.154308+0000', 'last_undegraded': '2023-08-09T12:45:42.154308+0000', 'last_fullsized': '2023-08-09T12:45:42.154308+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-09T12:45:48.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-08-09T12:45:48.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.162404+0000', 'last_change': '2023-08-09T12:45:42.162404+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.162404+0000', 'last_undegraded': '2023-08-09T12:45:42.162404+0000', 'last_fullsized': '2023-08-09T12:45:42.162404+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-09T12:45:48.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-08-09T12:45:48.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.163371+0000', 'last_change': '2023-08-09T12:45:42.163371+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.163371+0000', 'last_undegraded': '2023-08-09T12:45:42.163371+0000', 'last_fullsized': '2023-08-09T12:45:42.163371+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-09T12:45:48.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-08-09T12:45:48.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.155911+0000', 'last_change': '2023-08-09T12:45:42.155911+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.155911+0000', 'last_undegraded': '2023-08-09T12:45:42.155911+0000', 'last_fullsized': '2023-08-09T12:45:42.155911+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-08-09T12:45:48.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.161542+0000', 'last_change': '2023-08-09T12:45:42.161542+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.161542+0000', 'last_undegraded': '2023-08-09T12:45:42.161542+0000', 'last_fullsized': '2023-08-09T12:45:42.161542+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-09T12:45:48.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-08-09T12:45:48.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.171415+0000', 'last_change': '2023-08-09T12:45:42.171415+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.171415+0000', 'last_undegraded': '2023-08-09T12:45:42.171415+0000', 'last_fullsized': '2023-08-09T12:45:42.171415+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-09T12:45:48.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-08-09T12:45:48.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.155693+0000', 'last_change': '2023-08-09T12:45:42.155693+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.155693+0000', 'last_undegraded': '2023-08-09T12:45:42.155693+0000', 'last_fullsized': '2023-08-09T12:45:42.155693+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-08-09T12:45:48.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.160364+0000', 'last_change': '2023-08-09T12:45:42.160364+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.160364+0000', 'last_undegraded': '2023-08-09T12:45:42.160364+0000', 'last_fullsized': '2023-08-09T12:45:42.160364+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-09T12:45:48.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-08-09T12:45:48.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.170058+0000', 'last_change': '2023-08-09T12:45:42.170058+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.170058+0000', 'last_undegraded': '2023-08-09T12:45:42.170058+0000', 'last_fullsized': '2023-08-09T12:45:42.170058+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-09T12:45:48.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-08-09T12:45:48.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.153059+0000', 'last_change': '2023-08-09T12:45:42.153059+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.153059+0000', 'last_undegraded': '2023-08-09T12:45:42.153059+0000', 'last_fullsized': '2023-08-09T12:45:42.153059+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-09T12:45:48.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-08-09T12:45:48.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-08-09T12:45:42.161901+0000', 'last_change': '2023-08-09T12:45:42.161901+0000', 'last_active': '2023-08-09T12:45:41.123668+0000', 'last_peered': '2023-08-09T12:45:41.123668+0000', 'last_clean': '2023-08-09T12:45:41.123668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.161901+0000', 'last_undegraded': '2023-08-09T12:45:42.161901+0000', 'last_fullsized': '2023-08-09T12:45:42.161901+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-08-10T21:54:31.040704+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-09T12:45:48.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-08-09T12:45:48.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.155247+0000', 'last_change': '2023-08-09T12:45:42.155247+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.155247+0000', 'last_undegraded': '2023-08-09T12:45:42.155247+0000', 'last_fullsized': '2023-08-09T12:45:42.155247+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-08-09T12:45:48.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.164521+0000', 'last_change': '2023-08-09T12:45:42.164521+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.164521+0000', 'last_undegraded': '2023-08-09T12:45:42.164521+0000', 'last_fullsized': '2023-08-09T12:45:42.164521+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-09T12:45:48.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-08-09T12:45:48.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-08-09T12:45:42.162977+0000', 'last_change': '2023-08-09T12:45:42.162977+0000', 'last_active': '2023-08-09T12:45:41.123668+0000', 'last_peered': '2023-08-09T12:45:41.123668+0000', 'last_clean': '2023-08-09T12:45:41.123668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.162977+0000', 'last_undegraded': '2023-08-09T12:45:42.162977+0000', 'last_fullsized': '2023-08-09T12:45:42.162977+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-08-11T00:18:43.375069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-09T12:45:48.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-08-09T12:45:48.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.163437+0000', 'last_change': '2023-08-09T12:45:42.163437+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.163437+0000', 'last_undegraded': '2023-08-09T12:45:42.163437+0000', 'last_fullsized': '2023-08-09T12:45:42.163437+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-09T12:45:48.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-08-09T12:45:48.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.154768+0000', 'last_change': '2023-08-09T12:45:42.154768+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.154768+0000', 'last_undegraded': '2023-08-09T12:45:42.154768+0000', 'last_fullsized': '2023-08-09T12:45:42.154768+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-08-09T12:45:48.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.159739+0000', 'last_change': '2023-08-09T12:45:42.159739+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.159739+0000', 'last_undegraded': '2023-08-09T12:45:42.159739+0000', 'last_fullsized': '2023-08-09T12:45:42.159739+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-09T12:45:48.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-08-09T12:45:48.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.159891+0000', 'last_change': '2023-08-09T12:45:42.159891+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.159891+0000', 'last_undegraded': '2023-08-09T12:45:42.159891+0000', 'last_fullsized': '2023-08-09T12:45:42.159891+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-09T12:45:48.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-08-09T12:45:48.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.152115+0000', 'last_change': '2023-08-09T12:45:42.152115+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.152115+0000', 'last_undegraded': '2023-08-09T12:45:42.152115+0000', 'last_fullsized': '2023-08-09T12:45:42.152115+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-09T12:45:48.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-08-09T12:45:48.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.166272+0000', 'last_change': '2023-08-09T12:45:42.166272+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.166272+0000', 'last_undegraded': '2023-08-09T12:45:42.166272+0000', 'last_fullsized': '2023-08-09T12:45:42.166272+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-09T12:45:48.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-08-09T12:45:48.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.160963+0000', 'last_change': '2023-08-09T12:45:42.160963+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.160963+0000', 'last_undegraded': '2023-08-09T12:45:42.160963+0000', 'last_fullsized': '2023-08-09T12:45:42.160963+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-09T12:45:48.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-08-09T12:45:48.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.164478+0000', 'last_change': '2023-08-09T12:45:42.164478+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.164478+0000', 'last_undegraded': '2023-08-09T12:45:42.164478+0000', 'last_fullsized': '2023-08-09T12:45:42.164478+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-09T12:45:48.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-08-09T12:45:48.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.157194+0000', 'last_change': '2023-08-09T12:45:42.157194+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.157194+0000', 'last_undegraded': '2023-08-09T12:45:42.157194+0000', 'last_fullsized': '2023-08-09T12:45:42.157194+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-09T12:45:48.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-08-09T12:45:48.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.167806+0000', 'last_change': '2023-08-09T12:45:42.167806+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.167806+0000', 'last_undegraded': '2023-08-09T12:45:42.167806+0000', 'last_fullsized': '2023-08-09T12:45:42.167806+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-09T12:45:48.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-08-09T12:45:48.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.156291+0000', 'last_change': '2023-08-09T12:45:42.156291+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.156291+0000', 'last_undegraded': '2023-08-09T12:45:42.156291+0000', 'last_fullsized': '2023-08-09T12:45:42.156291+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-09T12:45:48.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-08-09T12:45:48.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.154723+0000', 'last_change': '2023-08-09T12:45:42.154723+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.154723+0000', 'last_undegraded': '2023-08-09T12:45:42.154723+0000', 'last_fullsized': '2023-08-09T12:45:42.154723+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-08-09T12:45:48.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 108, 'state': 'active', 'last_fresh': '2023-08-09T12:45:42.174803+0000', 'last_change': '2023-08-09T12:45:42.174611+0000', 'last_active': '2023-08-09T12:45:42.174803+0000', 'last_peered': '2023-08-09T12:45:42.174803+0000', 'last_clean': '2023-08-09T12:45:41.123668+0000', 'last_became_active': '2023-08-09T12:45:42.174611+0000', 'last_became_peered': '2023-08-09T12:45:42.174611+0000', 'last_unstale': '2023-08-09T12:45:42.174803+0000', 'last_undegraded': '2023-08-09T12:45:42.174803+0000', 'last_fullsized': '2023-08-09T12:45:42.174803+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-08-10T22:41:48.953496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': ['4', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-09T12:45:48.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-08-09T12:45:48.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.162571+0000', 'last_change': '2023-08-09T12:45:42.162571+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.162571+0000', 'last_undegraded': '2023-08-09T12:45:42.162571+0000', 'last_fullsized': '2023-08-09T12:45:42.162571+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-09T12:45:48.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-08-09T12:45:48.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-08-09T12:45:42.146606+0000', 'last_change': '2023-08-09T12:45:42.146606+0000', 'last_active': '2023-08-09T12:45:41.123668+0000', 'last_peered': '2023-08-09T12:45:41.123668+0000', 'last_clean': '2023-08-09T12:45:41.123668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.146606+0000', 'last_undegraded': '2023-08-09T12:45:42.146606+0000', 'last_fullsized': '2023-08-09T12:45:42.146606+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-08-10T22:35:42.436453+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-09T12:45:48.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-08-09T12:45:48.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 108, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:45:42.159875+0000', 'last_change': '2023-08-09T12:45:42.159875+0000', 'last_active': '2023-08-09T12:45:42.136592+0000', 'last_peered': '2023-08-09T12:45:42.136592+0000', 'last_clean': '2023-08-09T12:45:42.136592+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.159875+0000', 'last_undegraded': '2023-08-09T12:45:42.159875+0000', 'last_fullsized': '2023-08-09T12:45:42.159875+0000', 'mapping_epoch': 108, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 108, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:42.136592+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-09T12:45:48.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-08-09T12:45:48.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 108, 'state': 'creating+activating', 'last_fresh': '2023-08-09T12:45:42.146817+0000', 'last_change': '2023-08-09T12:45:42.146817+0000', 'last_active': '2023-08-09T12:45:41.123668+0000', 'last_peered': '2023-08-09T12:45:41.123668+0000', 'last_clean': '2023-08-09T12:45:41.123668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:45:42.146817+0000', 'last_undegraded': '2023-08-09T12:45:42.146817+0000', 'last_fullsized': '2023-08-09T12:45:42.146817+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'last_clean_scrub_stamp': '2023-08-09T12:45:41.123668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-08-10T18:20:03.177644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-09T12:45:48.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-09T12:45:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.019+0000 7fb9df59e640 1 Processor -- start 2023-08-09T12:45:49.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.019+0000 7fb9df59e640 1 -- start start 2023-08-09T12:45:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9df59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9e015e130 0x7fb9e00ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9df59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9e00ad660 0x7fb9e00abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9df59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e00ac170 con 0x7fb9e00cb490 2023-08-09T12:45:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9df59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e00ca5e0 con 0x7fb9e00ad660 2023-08-09T12:45:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9df59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e00adbf0 con 0x7fb9e015e130 2023-08-09T12:45:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9d7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9e00ad660 0x7fb9e00abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9d7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9e00ad660 0x7fb9e00abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45330/0 (socket says 172.21.15.17:45330) 2023-08-09T12:45:49.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9ded9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb9e00cb490 0x7fb9e00cb8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56114/0 (socket says 172.21.15.17:56114) 2023-08-09T12:45:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.021+0000 7fb9d7fff640 1 -- 172.21.15.17:0/3651104930 learned_addr learned my addr 172.21.15.17:0/3651104930 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.022+0000 7fb9de59c640 1 --2- 172.21.15.17:0/3651104930 >> v2:172.21.15.142:3300/0 conn(0x7fb9e015e130 0x7fb9e00ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.022+0000 7fb9d7fff640 1 -- 172.21.15.17:0/3651104930 >> v2:172.21.15.142:3300/0 conn(0x7fb9e015e130 msgr2=0x7fb9e00ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.022+0000 7fb9d7fff640 1 --2- 172.21.15.17:0/3651104930 >> v2:172.21.15.142:3300/0 conn(0x7fb9e015e130 0x7fb9e00ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.022+0000 7fb9d7fff640 1 -- 172.21.15.17:0/3651104930 >> v1:172.21.15.17:6789/0 conn(0x7fb9e00cb490 legacy=0x7fb9e00cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.022+0000 7fb9d7fff640 1 -- 172.21.15.17:0/3651104930 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00c92e0 con 0x7fb9e00ad660 2023-08-09T12:45:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.022+0000 7fb9ddd9b640 1 -- 172.21.15.17:0/3651104930 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043854493 0 0) 0x7fb9d8001490 con 0x7fb9e00cb490 2023-08-09T12:45:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.023+0000 7fb9d7fff640 1 --2- 172.21.15.17:0/3651104930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00ad660 0x7fb9e00abc30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00b2c90 tx=0x7fb9c802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9082a2a89f3b0f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9ddd9b640 1 -- 172.21.15.17:0/3651104930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8030870 con 0x7fb9e00ad660 2023-08-09T12:45:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9ddd9b640 1 -- 172.21.15.17:0/3651104930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c80309d0 con 0x7fb9e00ad660 2023-08-09T12:45:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9ddd9b640 1 -- 172.21.15.17:0/3651104930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8030d60 con 0x7fb9e00ad660 2023-08-09T12:45:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9df59e640 1 -- 172.21.15.17:0/3651104930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00ad660 msgr2=0x7fb9e00abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9df59e640 1 --2- 172.21.15.17:0/3651104930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00ad660 0x7fb9e00abc30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00b2c90 tx=0x7fb9c802b9b0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9df59e640 1 -- 172.21.15.17:0/3651104930 shutdown_connections 2023-08-09T12:45:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9df59e640 1 --2- 172.21.15.17:0/3651104930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00ad660 0x7fb9e00abc30 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9df59e640 1 --2- 172.21.15.17:0/3651104930 >> v2:172.21.15.142:3300/0 conn(0x7fb9e015e130 0x7fb9e00ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9df59e640 1 -- 172.21.15.17:0/3651104930 >> 172.21.15.17:0/3651104930 conn(0x7fb9e00cea40 msgr2=0x7fb9e00cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.024+0000 7fb9df59e640 1 -- 172.21.15.17:0/3651104930 shutdown_connections 2023-08-09T12:45:49.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.025+0000 7fb9df59e640 1 -- 172.21.15.17:0/3651104930 wait complete. 2023-08-09T12:45:49.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.026+0000 7fb9df59e640 1 Processor -- start 2023-08-09T12:45:49.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.027+0000 7fb9df59e640 1 -- start start 2023-08-09T12:45:49.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.027+0000 7fb9df59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e00ad660 0x7fb9e00c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.027+0000 7fb9df59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9e00cb490 0x7fb9e006bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9df59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00c48b0 0x7fb9e0157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9df59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e006c0f0 con 0x7fb9e00c48b0 2023-08-09T12:45:49.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9df59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00c7ad0 con 0x7fb9e00ad660 2023-08-09T12:45:49.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9df59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00c7db0 con 0x7fb9e00cb490 2023-08-09T12:45:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9ded9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00c48b0 0x7fb9e0157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9ded9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00c48b0 0x7fb9e0157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45344/0 (socket says 172.21.15.17:45344) 2023-08-09T12:45:49.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9ded9d640 1 -- 172.21.15.17:0/1479327813 learned_addr learned my addr 172.21.15.17:0/1479327813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:49.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9de59c640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e00ad660 0x7fb9e00c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9d7fff640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9e00cb490 0x7fb9e006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.028+0000 7fb9ded9d640 1 -- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9e00cb490 msgr2=0x7fb9e006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9ded9d640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9e00cb490 0x7fb9e006bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9ded9d640 1 -- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e00ad660 msgr2=0x7fb9e00c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9ded9d640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e00ad660 0x7fb9e00c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9ded9d640 1 -- 172.21.15.17:0/1479327813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80094d0 con 0x7fb9e00c48b0 2023-08-09T12:45:49.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9de59c640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e00ad660 0x7fb9e00c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:49.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9ded9d640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00c48b0 0x7fb9e0157450 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800c7d0 tx=0x7fb9d800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:49.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9d6ffd640 1 -- 172.21.15.17:0/1479327813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800a640 con 0x7fb9e00c48b0 2023-08-09T12:45:49.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9d6ffd640 1 -- 172.21.15.17:0/1479327813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800a7c0 con 0x7fb9e00c48b0 2023-08-09T12:45:49.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9d6ffd640 1 -- 172.21.15.17:0/1479327813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800abb0 con 0x7fb9e00c48b0 2023-08-09T12:45:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e00c8090 con 0x7fb9e00c48b0 2023-08-09T12:45:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.029+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e00c4d60 con 0x7fb9e00c48b0 2023-08-09T12:45:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.030+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e00c8890 con 0x7fb9e00c48b0 2023-08-09T12:45:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.032+0000 7fb9d6ffd640 1 -- 172.21.15.17:0/1479327813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb9d800ad10 con 0x7fb9e00c48b0 2023-08-09T12:45:49.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.033+0000 7fb9d6ffd640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9c006a050 0x7fb9c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.033+0000 7fb9d6ffd640 1 -- 172.21.15.17:0/1479327813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9d80879f0 con 0x7fb9e00c48b0 2023-08-09T12:45:49.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.033+0000 7fb9de59c640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9c006a050 0x7fb9c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.034+0000 7fb9de59c640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9c006a050 0x7fb9c006c510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00979c0 tx=0x7fb9d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:49.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.038+0000 7fb9d6ffd640 1 -- 172.21.15.17:0/1479327813 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb9e00c8890 con 0x7fb9e00c48b0 2023-08-09T12:45:49.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.305+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb9e00ac170 con 0x7fb9e00c48b0 2023-08-09T12:45:49.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.306+0000 7fb9d6ffd640 1 -- 172.21.15.17:0/1479327813 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1175 (secure 0 0 0) 0x7fb9e00ac170 con 0x7fb9e00c48b0 2023-08-09T12:45:49.310 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":405,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":110,"num_osds":8,"num_up_osds":8,"osd_up_since":1691584751,"num_in_osds":8,"osd_in_since":1691584748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":60},{"state_name":"creating+peering","count":40},{"state_name":"creating+activating","count":4},{"state_name":"active","count":1}],"num_pgs":105,"num_pools":4,"num_objects":10,"data_bytes":591980,"bytes_used":6160077,"bytes_avail":1593839923,"bytes_total":1600000000,"inactive_pgs_ratio":0.41904762387275696,"write_bytes_sec":544,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":51,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7029}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-08-09T12:45:28.776813+0000","services":{}},"progress_events":{}} 2023-08-09T12:45:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9c006a050 msgr2=0x7fb9c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9c006a050 0x7fb9c006c510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00979c0 tx=0x7fb9d0008040 comp rx=0 tx=0).stop 2023-08-09T12:45:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00c48b0 msgr2=0x7fb9e0157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00c48b0 0x7fb9e0157450 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800c7d0 tx=0x7fb9d800cc90 comp rx=0 tx=0).stop 2023-08-09T12:45:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 shutdown_connections 2023-08-09T12:45:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9c006a050 0x7fb9c006c510 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00c48b0 0x7fb9e0157450 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9e00cb490 0x7fb9e006bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 --2- 172.21.15.17:0/1479327813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e00ad660 0x7fb9e00c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 >> 172.21.15.17:0/1479327813 conn(0x7fb9e00cea40 msgr2=0x7fb9e00cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 shutdown_connections 2023-08-09T12:45:49.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.309+0000 7fb9df59e640 1 -- 172.21.15.17:0/1479327813 wait complete. 2023-08-09T12:45:49.333 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-09T12:45:49.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:45:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.554+0000 7f000c42d640 1 Processor -- start 2023-08-09T12:45:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.555+0000 7f000c42d640 1 -- start start 2023-08-09T12:45:49.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.556+0000 7f000c42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 0x7f00041616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.556+0000 7f000c42d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00040b6000 0x7f00040cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.556+0000 7f000c42d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040b6460 con 0x7f00040d29d0 2023-08-09T12:45:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.556+0000 7f000c42d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040cda40 con 0x7f00040b6000 2023-08-09T12:45:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.556+0000 7f000c42d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040cdd10 con 0x7f000415ce90 2023-08-09T12:45:49.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f000a9ca640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f00040d29d0 0x7f00040d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56118/0 (socket says 172.21.15.17:56118) 2023-08-09T12:45:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f000a9ca640 1 -- 172.21.15.17:0/1024845386 learned_addr learned my addr 172.21.15.17:0/1024845386 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f00099c8640 1 --2- 172.21.15.17:0/1024845386 >> v2:172.21.15.17:3300/0 conn(0x7f00040b6000 0x7f00040cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f000a1c9640 1 --2- 172.21.15.17:0/1024845386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 0x7f00041616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f00091c7640 1 -- 172.21.15.17:0/1024845386 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833851757 0 0) 0x7f00040b6460 con 0x7f00040d29d0 2023-08-09T12:45:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f00091c7640 1 -- 172.21.15.17:0/1024845386 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003520 con 0x7f00040d29d0 2023-08-09T12:45:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f00099c8640 1 -- 172.21.15.17:0/1024845386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 msgr2=0x7f00041616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f00099c8640 1 --2- 172.21.15.17:0/1024845386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 0x7f00041616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f00099c8640 1 -- 172.21.15.17:0/1024845386 >> v1:172.21.15.17:6789/0 conn(0x7f00040d29d0 legacy=0x7f00040d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f00099c8640 1 -- 172.21.15.17:0/1024845386 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040cdff0 con 0x7f00040b6000 2023-08-09T12:45:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.557+0000 7f000a1c9640 1 --2- 172.21.15.17:0/1024845386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 0x7f00041616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.559+0000 7f00099c8640 1 --2- 172.21.15.17:0/1024845386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f00040cd500 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7efff40097a0 tx=0x7efff402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158318074d312063 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.559+0000 7f00091c7640 1 -- 172.21.15.17:0/1024845386 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff402d040 con 0x7f00040b6000 2023-08-09T12:45:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.559+0000 7f00091c7640 1 -- 172.21.15.17:0/1024845386 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4031810 con 0x7f00040b6000 2023-08-09T12:45:49.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.559+0000 7f00091c7640 1 -- 172.21.15.17:0/1024845386 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4031b80 con 0x7f00040b6000 2023-08-09T12:45:49.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.560+0000 7f000c42d640 1 -- 172.21.15.17:0/1024845386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 msgr2=0x7f00040cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.560+0000 7f000c42d640 1 --2- 172.21.15.17:0/1024845386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f00040cd500 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7efff40097a0 tx=0x7efff402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.560+0000 7f000c42d640 1 -- 172.21.15.17:0/1024845386 shutdown_connections 2023-08-09T12:45:49.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.560+0000 7f000c42d640 1 --2- 172.21.15.17:0/1024845386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f00040cd500 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.560+0000 7f000c42d640 1 --2- 172.21.15.17:0/1024845386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 0x7f00041616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.560+0000 7f000c42d640 1 -- 172.21.15.17:0/1024845386 >> 172.21.15.17:0/1024845386 conn(0x7f000406fde0 msgr2=0x7f00040701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.560+0000 7f000c42d640 1 -- 172.21.15.17:0/1024845386 shutdown_connections 2023-08-09T12:45:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.560+0000 7f000c42d640 1 -- 172.21.15.17:0/1024845386 wait complete. 2023-08-09T12:45:49.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.562+0000 7f000c42d640 1 Processor -- start 2023-08-09T12:45:49.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.562+0000 7f000c42d640 1 -- start start 2023-08-09T12:45:49.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000c42d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f0004151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000c42d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00040d29d0 0x7f0004159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000c42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 0x7f000415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000c42d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0004157030 con 0x7f00040b6000 2023-08-09T12:45:49.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000c42d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0004156420 con 0x7f00040d29d0 2023-08-09T12:45:49.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000c42d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0004156700 con 0x7f000415ce90 2023-08-09T12:45:49.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000a1c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f0004151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000a1c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f0004151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45362/0 (socket says 172.21.15.17:45362) 2023-08-09T12:45:49.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.563+0000 7f000a1c9640 1 -- 172.21.15.17:0/3864151896 learned_addr learned my addr 172.21.15.17:0/3864151896 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:49.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7f000a1c9640 1 -- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 msgr2=0x7f000415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7f000a1c9640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 0x7f000415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7f000a1c9640 1 -- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00040d29d0 msgr2=0x7f0004159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7f000a1c9640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00040d29d0 0x7f0004159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7f000a1c9640 1 -- 172.21.15.17:0/3864151896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4009400 con 0x7f00040b6000 2023-08-09T12:45:49.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7f000a1c9640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f0004151420 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f000000d7d0 tx=0x7f000000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:49.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7efffaffd640 1 -- 172.21.15.17:0/3864151896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000004030 con 0x7f00040b6000 2023-08-09T12:45:49.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7efffaffd640 1 -- 172.21.15.17:0/3864151896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0000004190 con 0x7f00040b6000 2023-08-09T12:45:49.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00041569e0 con 0x7f00040b6000 2023-08-09T12:45:49.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.564+0000 7efffaffd640 1 -- 172.21.15.17:0/3864151896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000b6c0 con 0x7f00040b6000 2023-08-09T12:45:49.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.565+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00041574c0 con 0x7f00040b6000 2023-08-09T12:45:49.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.566+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0004067a80 con 0x7f00040b6000 2023-08-09T12:45:49.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.567+0000 7efffaffd640 1 -- 172.21.15.17:0/3864151896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f000000b820 con 0x7f00040b6000 2023-08-09T12:45:49.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.568+0000 7efffaffd640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effe806a080 0x7effe806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:49.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.568+0000 7efffaffd640 1 -- 172.21.15.17:0/3864151896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0000088840 con 0x7f00040b6000 2023-08-09T12:45:49.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.568+0000 7f00099c8640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effe806a080 0x7effe806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:49.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.570+0000 7f00099c8640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effe806a080 0x7effe806c540 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efff4036000 tx=0x7efff4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:49.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.572+0000 7efffaffd640 1 -- 172.21.15.17:0/3864151896 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0000057890 con 0x7f00040b6000 2023-08-09T12:45:49.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.761+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0004156870 con 0x7effe806a080 2023-08-09T12:45:49.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.785+0000 7efffaffd640 1 -- 172.21.15.17:0/3864151896 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303436 (secure 0 0 0) 0x7f0004156870 con 0x7effe806a080 2023-08-09T12:45:49.791 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:49.793 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:45:49.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effe806a080 msgr2=0x7effe806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effe806a080 0x7effe806c540 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efff4036000 tx=0x7efff4030000 comp rx=0 tx=0).stop 2023-08-09T12:45:49.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 msgr2=0x7f0004151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:49.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f0004151420 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f000000d7d0 tx=0x7f000000dc90 comp rx=0 tx=0).stop 2023-08-09T12:45:49.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 shutdown_connections 2023-08-09T12:45:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effe806a080 0x7effe806c540 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f000415ce90 0x7f000415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00040d29d0 0x7f0004159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 --2- 172.21.15.17:0/3864151896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00040b6000 0x7f0004151420 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 >> 172.21.15.17:0/3864151896 conn(0x7f000406fde0 msgr2=0x7f00040b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 shutdown_connections 2023-08-09T12:45:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:49.792+0000 7f000c42d640 1 -- 172.21.15.17:0/3864151896 wait complete. 2023-08-09T12:45:49.815 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2023-08-09T12:45:48.783044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556368,"statfs":{"total":1600000000,"available":1593721665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.636177"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895654+0000","last_change":"2023-08-09T12:45:43.216819+0000","last_active":"2023-08-09T12:45:45.895654+0000","last_peered":"2023-08-09T12:45:45.895654+0000","last_clean":"2023-08-09T12:45:45.895654+0000","last_became_active":"2023-08-09T12:45:43.216411+0000","last_became_peered":"2023-08-09T12:45:43.216411+0000","last_unstale":"2023-08-09T12:45:45.895654+0000","last_undegraded":"2023-08-09T12:45:45.895654+0000","last_fullsized":"2023-08-09T12:45:45.895654+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:44:50.951511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952412+0000","last_change":"2023-08-09T12:45:43.216299+0000","last_active":"2023-08-09T12:45:44.952412+0000","last_peered":"2023-08-09T12:45:44.952412+0000","last_clean":"2023-08-09T12:45:44.952412+0000","last_became_active":"2023-08-09T12:45:43.215456+0000","last_became_peered":"2023-08-09T12:45:43.215456+0000","last_unstale":"2023-08-09T12:45:44.952412+0000","last_undegraded":"2023-08-09T12:45:44.952412+0000","last_fullsized":"2023-08-09T12:45:44.952412+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:37.720656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.894894+0000","last_change":"2023-08-09T12:45:43.215516+0000","last_active":"2023-08-09T12:45:45.894894+0000","last_peered":"2023-08-09T12:45:45.894894+0000","last_clean":"2023-08-09T12:45:45.894894+0000","last_became_active":"2023-08-09T12:45:43.214934+0000","last_became_peered":"2023-08-09T12:45:43.214934+0000","last_unstale":"2023-08-09T12:45:45.894894+0000","last_undegraded":"2023-08-09T12:45:45.894894+0000","last_fullsized":"2023-08-09T12:45:45.894894+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:54.191860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000704+0000","last_change":"2023-08-09T12:45:43.213782+0000","last_active":"2023-08-09T12:45:46.000704+0000","last_peered":"2023-08-09T12:45:46.000704+0000","last_clean":"2023-08-09T12:45:46.000704+0000","last_became_active":"2023-08-09T12:45:43.208612+0000","last_became_peered":"2023-08-09T12:45:43.208612+0000","last_unstale":"2023-08-09T12:45:46.000704+0000","last_undegraded":"2023-08-09T12:45:46.000704+0000","last_fullsized":"2023-08-09T12:45:46.000704+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:39.279681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000414+0000","last_change":"2023-08-09T12:45:43.209346+0000","last_active":"2023-08-09T12:45:46.000414+0000","last_peered":"2023-08-09T12:45:46.000414+0000","last_clean":"2023-08-09T12:45:46.000414+0000","last_became_active":"2023-08-09T12:45:43.209102+0000","last_became_peered":"2023-08-09T12:45:43.209102+0000","last_unstale":"2023-08-09T12:45:46.000414+0000","last_undegraded":"2023-08-09T12:45:46.000414+0000","last_fullsized":"2023-08-09T12:45:46.000414+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:41:39.519119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187782+0000","last_change":"2023-08-09T12:45:43.220479+0000","last_active":"2023-08-09T12:45:44.187782+0000","last_peered":"2023-08-09T12:45:44.187782+0000","last_clean":"2023-08-09T12:45:44.187782+0000","last_became_active":"2023-08-09T12:45:43.219067+0000","last_became_peered":"2023-08-09T12:45:43.219067+0000","last_unstale":"2023-08-09T12:45:44.187782+0000","last_undegraded":"2023-08-09T12:45:44.187782+0000","last_fullsized":"2023-08-09T12:45:44.187782+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:33:26.728442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184630+0000","last_change":"2023-08-09T12:45:43.205796+0000","last_active":"2023-08-09T12:45:44.184630+0000","last_peered":"2023-08-09T12:45:44.184630+0000","last_clean":"2023-08-09T12:45:44.184630+0000","last_became_active":"2023-08-09T12:45:43.205333+0000","last_became_peered":"2023-08-09T12:45:43.205333+0000","last_unstale":"2023-08-09T12:45:44.184630+0000","last_undegraded":"2023-08-09T12:45:44.184630+0000","last_fullsized":"2023-08-09T12:45:44.184630+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:43.931548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000642+0000","last_change":"2023-08-09T12:45:43.222222+0000","last_active":"2023-08-09T12:45:46.000642+0000","last_peered":"2023-08-09T12:45:46.000642+0000","last_clean":"2023-08-09T12:45:46.000642+0000","last_became_active":"2023-08-09T12:45:43.221414+0000","last_became_peered":"2023-08-09T12:45:43.221414+0000","last_unstale":"2023-08-09T12:45:46.000642+0000","last_undegraded":"2023-08-09T12:45:46.000642+0000","last_fullsized":"2023-08-09T12:45:46.000642+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:56.592868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.999965+0000","last_change":"2023-08-09T12:45:43.209976+0000","last_active":"2023-08-09T12:45:45.999965+0000","last_peered":"2023-08-09T12:45:45.999965+0000","last_clean":"2023-08-09T12:45:45.999965+0000","last_became_active":"2023-08-09T12:45:43.207856+0000","last_became_peered":"2023-08-09T12:45:43.207856+0000","last_unstale":"2023-08-09T12:45:45.999965+0000","last_undegraded":"2023-08-09T12:45:45.999965+0000","last_fullsized":"2023-08-09T12:45:45.999965+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:20:22.622930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001040+0000","last_change":"2023-08-09T12:45:43.215731+0000","last_active":"2023-08-09T12:45:46.001040+0000","last_peered":"2023-08-09T12:45:46.001040+0000","last_clean":"2023-08-09T12:45:46.001040+0000","last_became_active":"2023-08-09T12:45:43.215327+0000","last_became_peered":"2023-08-09T12:45:43.215327+0000","last_unstale":"2023-08-09T12:45:46.001040+0000","last_undegraded":"2023-08-09T12:45:46.001040+0000","last_fullsized":"2023-08-09T12:45:46.001040+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:27:27.034825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000490+0000","last_change":"2023-08-09T12:45:43.218668+0000","last_active":"2023-08-09T12:45:46.000490+0000","last_peered":"2023-08-09T12:45:46.000490+0000","last_clean":"2023-08-09T12:45:46.000490+0000","last_became_active":"2023-08-09T12:45:43.218249+0000","last_became_peered":"2023-08-09T12:45:43.218249+0000","last_unstale":"2023-08-09T12:45:46.000490+0000","last_undegraded":"2023-08-09T12:45:46.000490+0000","last_fullsized":"2023-08-09T12:45:46.000490+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:40:55.775971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.999649+0000","last_change":"2023-08-09T12:45:43.208367+0000","last_active":"2023-08-09T12:45:45.999649+0000","last_peered":"2023-08-09T12:45:45.999649+0000","last_clean":"2023-08-09T12:45:45.999649+0000","last_became_active":"2023-08-09T12:45:43.207997+0000","last_became_peered":"2023-08-09T12:45:43.207997+0000","last_unstale":"2023-08-09T12:45:45.999649+0000","last_undegraded":"2023-08-09T12:45:45.999649+0000","last_fullsized":"2023-08-09T12:45:45.999649+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:21:32.560685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000997+0000","last_change":"2023-08-09T12:45:43.222062+0000","last_active":"2023-08-09T12:45:46.000997+0000","last_peered":"2023-08-09T12:45:46.000997+0000","last_clean":"2023-08-09T12:45:46.000997+0000","last_became_active":"2023-08-09T12:45:43.220036+0000","last_became_peered":"2023-08-09T12:45:43.220036+0000","last_unstale":"2023-08-09T12:45:46.000997+0000","last_undegraded":"2023-08-09T12:45:46.000997+0000","last_fullsized":"2023-08-09T12:45:46.000997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:32:26.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001375+0000","last_change":"2023-08-09T12:45:43.217515+0000","last_active":"2023-08-09T12:45:46.001375+0000","last_peered":"2023-08-09T12:45:46.001375+0000","last_clean":"2023-08-09T12:45:46.001375+0000","last_became_active":"2023-08-09T12:45:43.216115+0000","last_became_peered":"2023-08-09T12:45:43.216115+0000","last_unstale":"2023-08-09T12:45:46.001375+0000","last_undegraded":"2023-08-09T12:45:46.001375+0000","last_fullsized":"2023-08-09T12:45:46.001375+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:59.535409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001377+0000","last_change":"2023-08-09T12:45:43.220452+0000","last_active":"2023-08-09T12:45:46.001377+0000","last_peered":"2023-08-09T12:45:46.001377+0000","last_clean":"2023-08-09T12:45:46.001377+0000","last_became_active":"2023-08-09T12:45:43.219442+0000","last_became_peered":"2023-08-09T12:45:43.219442+0000","last_unstale":"2023-08-09T12:45:46.001377+0000","last_undegraded":"2023-08-09T12:45:46.001377+0000","last_fullsized":"2023-08-09T12:45:46.001377+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:07:24.077186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187419+0000","last_change":"2023-08-09T12:45:43.215398+0000","last_active":"2023-08-09T12:45:44.187419+0000","last_peered":"2023-08-09T12:45:44.187419+0000","last_clean":"2023-08-09T12:45:44.187419+0000","last_became_active":"2023-08-09T12:45:43.208415+0000","last_became_peered":"2023-08-09T12:45:43.208415+0000","last_unstale":"2023-08-09T12:45:44.187419+0000","last_undegraded":"2023-08-09T12:45:44.187419+0000","last_fullsized":"2023-08-09T12:45:44.187419+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:29:31.561794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187082+0000","last_change":"2023-08-09T12:45:43.213178+0000","last_active":"2023-08-09T12:45:44.187082+0000","last_peered":"2023-08-09T12:45:44.187082+0000","last_clean":"2023-08-09T12:45:44.187082+0000","last_became_active":"2023-08-09T12:45:43.210516+0000","last_became_peered":"2023-08-09T12:45:43.210516+0000","last_unstale":"2023-08-09T12:45:44.187082+0000","last_undegraded":"2023-08-09T12:45:44.187082+0000","last_fullsized":"2023-08-09T12:45:44.187082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:17:21.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895655+0000","last_change":"2023-08-09T12:45:43.212902+0000","last_active":"2023-08-09T12:45:45.895655+0000","last_peered":"2023-08-09T12:45:45.895655+0000","last_clean":"2023-08-09T12:45:45.895655+0000","last_became_active":"2023-08-09T12:45:43.212559+0000","last_became_peered":"2023-08-09T12:45:43.212559+0000","last_unstale":"2023-08-09T12:45:45.895655+0000","last_undegraded":"2023-08-09T12:45:45.895655+0000","last_fullsized":"2023-08-09T12:45:45.895655+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:32.646473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000398+0000","last_change":"2023-08-09T12:45:43.217690+0000","last_active":"2023-08-09T12:45:46.000398+0000","last_peered":"2023-08-09T12:45:46.000398+0000","last_clean":"2023-08-09T12:45:46.000398+0000","last_became_active":"2023-08-09T12:45:43.216998+0000","last_became_peered":"2023-08-09T12:45:43.216998+0000","last_unstale":"2023-08-09T12:45:46.000398+0000","last_undegraded":"2023-08-09T12:45:46.000398+0000","last_fullsized":"2023-08-09T12:45:46.000398+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:41:03.796561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001736+0000","last_change":"2023-08-09T12:45:43.220290+0000","last_active":"2023-08-09T12:45:46.001736+0000","last_peered":"2023-08-09T12:45:46.001736+0000","last_clean":"2023-08-09T12:45:46.001736+0000","last_became_active":"2023-08-09T12:45:43.219092+0000","last_became_peered":"2023-08-09T12:45:43.219092+0000","last_unstale":"2023-08-09T12:45:46.001736+0000","last_undegraded":"2023-08-09T12:45:46.001736+0000","last_fullsized":"2023-08-09T12:45:46.001736+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:50.772522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000901+0000","last_change":"2023-08-09T12:45:43.212214+0000","last_active":"2023-08-09T12:45:46.000901+0000","last_peered":"2023-08-09T12:45:46.000901+0000","last_clean":"2023-08-09T12:45:46.000901+0000","last_became_active":"2023-08-09T12:45:43.211963+0000","last_became_peered":"2023-08-09T12:45:43.211963+0000","last_unstale":"2023-08-09T12:45:46.000901+0000","last_undegraded":"2023-08-09T12:45:46.000901+0000","last_fullsized":"2023-08-09T12:45:46.000901+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:31:22.843668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000122+0000","last_change":"2023-08-09T12:45:43.215756+0000","last_active":"2023-08-09T12:45:46.000122+0000","last_peered":"2023-08-09T12:45:46.000122+0000","last_clean":"2023-08-09T12:45:46.000122+0000","last_became_active":"2023-08-09T12:45:43.215329+0000","last_became_peered":"2023-08-09T12:45:43.215329+0000","last_unstale":"2023-08-09T12:45:46.000122+0000","last_undegraded":"2023-08-09T12:45:46.000122+0000","last_fullsized":"2023-08-09T12:45:46.000122+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:16:56.998636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187805+0000","last_change":"2023-08-09T12:45:43.215101+0000","last_active":"2023-08-09T12:45:44.187805+0000","last_peered":"2023-08-09T12:45:44.187805+0000","last_clean":"2023-08-09T12:45:44.187805+0000","last_became_active":"2023-08-09T12:45:43.214856+0000","last_became_peered":"2023-08-09T12:45:43.214856+0000","last_unstale":"2023-08-09T12:45:44.187805+0000","last_undegraded":"2023-08-09T12:45:44.187805+0000","last_fullsized":"2023-08-09T12:45:44.187805+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:55:55.597288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895082+0000","last_change":"2023-08-09T12:45:43.213935+0000","last_active":"2023-08-09T12:45:45.895082+0000","last_peered":"2023-08-09T12:45:45.895082+0000","last_clean":"2023-08-09T12:45:45.895082+0000","last_became_active":"2023-08-09T12:45:43.213574+0000","last_became_peered":"2023-08-09T12:45:43.213574+0000","last_unstale":"2023-08-09T12:45:45.895082+0000","last_undegraded":"2023-08-09T12:45:45.895082+0000","last_fullsized":"2023-08-09T12:45:45.895082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:36.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952907+0000","last_change":"2023-08-09T12:45:43.208273+0000","last_active":"2023-08-09T12:45:44.952907+0000","last_peered":"2023-08-09T12:45:44.952907+0000","last_clean":"2023-08-09T12:45:44.952907+0000","last_became_active":"2023-08-09T12:45:43.207828+0000","last_became_peered":"2023-08-09T12:45:43.207828+0000","last_unstale":"2023-08-09T12:45:44.952907+0000","last_undegraded":"2023-08-09T12:45:44.952907+0000","last_fullsized":"2023-08-09T12:45:44.952907+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:40.059489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001445+0000","last_change":"2023-08-09T12:45:43.218492+0000","last_active":"2023-08-09T12:45:46.001445+0000","last_peered":"2023-08-09T12:45:46.001445+0000","last_clean":"2023-08-09T12:45:46.001445+0000","last_became_active":"2023-08-09T12:45:43.217698+0000","last_became_peered":"2023-08-09T12:45:43.217698+0000","last_unstale":"2023-08-09T12:45:46.001445+0000","last_undegraded":"2023-08-09T12:45:46.001445+0000","last_fullsized":"2023-08-09T12:45:46.001445+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:09:31.867125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000014+0000","last_change":"2023-08-09T12:45:43.192924+0000","last_active":"2023-08-09T12:45:46.000014+0000","last_peered":"2023-08-09T12:45:46.000014+0000","last_clean":"2023-08-09T12:45:46.000014+0000","last_became_active":"2023-08-09T12:45:43.192277+0000","last_became_peered":"2023-08-09T12:45:43.192277+0000","last_unstale":"2023-08-09T12:45:46.000014+0000","last_undegraded":"2023-08-09T12:45:46.000014+0000","last_fullsized":"2023-08-09T12:45:46.000014+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:11:19.423386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001780+0000","last_change":"2023-08-09T12:45:43.221846+0000","last_active":"2023-08-09T12:45:46.001780+0000","last_peered":"2023-08-09T12:45:46.001780+0000","last_clean":"2023-08-09T12:45:46.001780+0000","last_became_active":"2023-08-09T12:45:43.219183+0000","last_became_peered":"2023-08-09T12:45:43.219183+0000","last_unstale":"2023-08-09T12:45:46.001780+0000","last_undegraded":"2023-08-09T12:45:46.001780+0000","last_fullsized":"2023-08-09T12:45:46.001780+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:12.047475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184407+0000","last_change":"2023-08-09T12:45:43.197275+0000","last_active":"2023-08-09T12:45:44.184407+0000","last_peered":"2023-08-09T12:45:44.184407+0000","last_clean":"2023-08-09T12:45:44.184407+0000","last_became_active":"2023-08-09T12:45:43.196395+0000","last_became_peered":"2023-08-09T12:45:43.196395+0000","last_unstale":"2023-08-09T12:45:44.184407+0000","last_undegraded":"2023-08-09T12:45:44.184407+0000","last_fullsized":"2023-08-09T12:45:44.184407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:00:20.116329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000803+0000","last_change":"2023-08-09T12:45:43.208849+0000","last_active":"2023-08-09T12:45:46.000803+0000","last_peered":"2023-08-09T12:45:46.000803+0000","last_clean":"2023-08-09T12:45:46.000803+0000","last_became_active":"2023-08-09T12:45:43.208459+0000","last_became_peered":"2023-08-09T12:45:43.208459+0000","last_unstale":"2023-08-09T12:45:46.000803+0000","last_undegraded":"2023-08-09T12:45:46.000803+0000","last_fullsized":"2023-08-09T12:45:46.000803+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:27:49.863649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952773+0000","last_change":"2023-08-09T12:45:43.213929+0000","last_active":"2023-08-09T12:45:44.952773+0000","last_peered":"2023-08-09T12:45:44.952773+0000","last_clean":"2023-08-09T12:45:44.952773+0000","last_became_active":"2023-08-09T12:45:43.213641+0000","last_became_peered":"2023-08-09T12:45:43.213641+0000","last_unstale":"2023-08-09T12:45:44.952773+0000","last_undegraded":"2023-08-09T12:45:44.952773+0000","last_fullsized":"2023-08-09T12:45:44.952773+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:08:05.887249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187308+0000","last_change":"2023-08-09T12:45:43.212976+0000","last_active":"2023-08-09T12:45:44.187308+0000","last_peered":"2023-08-09T12:45:44.187308+0000","last_clean":"2023-08-09T12:45:44.187308+0000","last_became_active":"2023-08-09T12:45:43.210090+0000","last_became_peered":"2023-08-09T12:45:43.210090+0000","last_unstale":"2023-08-09T12:45:44.187308+0000","last_undegraded":"2023-08-09T12:45:44.187308+0000","last_fullsized":"2023-08-09T12:45:44.187308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:14.105191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188003+0000","last_change":"2023-08-09T12:45:43.220135+0000","last_active":"2023-08-09T12:45:44.188003+0000","last_peered":"2023-08-09T12:45:44.188003+0000","last_clean":"2023-08-09T12:45:44.188003+0000","last_became_active":"2023-08-09T12:45:43.214687+0000","last_became_peered":"2023-08-09T12:45:43.214687+0000","last_unstale":"2023-08-09T12:45:44.188003+0000","last_undegraded":"2023-08-09T12:45:44.188003+0000","last_fullsized":"2023-08-09T12:45:44.188003+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:31.661935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"109'4","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188193+0000","last_change":"2023-08-09T12:45:42.169123+0000","last_active":"2023-08-09T12:45:44.188193+0000","last_peered":"2023-08-09T12:45:44.188193+0000","last_clean":"2023-08-09T12:45:44.188193+0000","last_became_active":"2023-08-09T12:45:42.168705+0000","last_became_peered":"2023-08-09T12:45:42.168705+0000","last_unstale":"2023-08-09T12:45:44.188193+0000","last_undegraded":"2023-08-09T12:45:44.188193+0000","last_fullsized":"2023-08-09T12:45:44.188193+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:48:03.643184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187492+0000","last_change":"2023-08-09T12:45:43.194527+0000","last_active":"2023-08-09T12:45:44.187492+0000","last_peered":"2023-08-09T12:45:44.187492+0000","last_clean":"2023-08-09T12:45:44.187492+0000","last_became_active":"2023-08-09T12:45:43.193850+0000","last_became_peered":"2023-08-09T12:45:43.193850+0000","last_unstale":"2023-08-09T12:45:44.187492+0000","last_undegraded":"2023-08-09T12:45:44.187492+0000","last_fullsized":"2023-08-09T12:45:44.187492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:34:15.244986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001102+0000","last_change":"2023-08-09T12:45:42.171355+0000","last_active":"2023-08-09T12:45:46.001102+0000","last_peered":"2023-08-09T12:45:46.001102+0000","last_clean":"2023-08-09T12:45:46.001102+0000","last_became_active":"2023-08-09T12:45:42.170706+0000","last_became_peered":"2023-08-09T12:45:42.170706+0000","last_unstale":"2023-08-09T12:45:46.001102+0000","last_undegraded":"2023-08-09T12:45:46.001102+0000","last_fullsized":"2023-08-09T12:45:46.001102+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:01:49.192081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184795+0000","last_change":"2023-08-09T12:45:43.210437+0000","last_active":"2023-08-09T12:45:44.184795+0000","last_peered":"2023-08-09T12:45:44.184795+0000","last_clean":"2023-08-09T12:45:44.184795+0000","last_became_active":"2023-08-09T12:45:43.210180+0000","last_became_peered":"2023-08-09T12:45:43.210180+0000","last_unstale":"2023-08-09T12:45:44.184795+0000","last_undegraded":"2023-08-09T12:45:44.184795+0000","last_fullsized":"2023-08-09T12:45:44.184795+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:38:57.395314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185611+0000","last_change":"2023-08-09T12:45:42.174144+0000","last_active":"2023-08-09T12:45:44.185611+0000","last_peered":"2023-08-09T12:45:44.185611+0000","last_clean":"2023-08-09T12:45:44.185611+0000","last_became_active":"2023-08-09T12:45:42.173218+0000","last_became_peered":"2023-08-09T12:45:42.173218+0000","last_unstale":"2023-08-09T12:45:44.185611+0000","last_undegraded":"2023-08-09T12:45:44.185611+0000","last_fullsized":"2023-08-09T12:45:44.185611+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:03:47.707503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186995+0000","last_change":"2023-08-09T12:45:43.207086+0000","last_active":"2023-08-09T12:45:44.186995+0000","last_peered":"2023-08-09T12:45:44.186995+0000","last_clean":"2023-08-09T12:45:44.186995+0000","last_became_active":"2023-08-09T12:45:43.203598+0000","last_became_peered":"2023-08-09T12:45:43.203598+0000","last_unstale":"2023-08-09T12:45:44.186995+0000","last_undegraded":"2023-08-09T12:45:44.186995+0000","last_fullsized":"2023-08-09T12:45:44.186995+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:50.199091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.189225+0000","last_change":"2023-08-09T12:45:42.170662+0000","last_active":"2023-08-09T12:45:44.189225+0000","last_peered":"2023-08-09T12:45:44.189225+0000","last_clean":"2023-08-09T12:45:44.189225+0000","last_became_active":"2023-08-09T12:45:42.170368+0000","last_became_peered":"2023-08-09T12:45:42.170368+0000","last_unstale":"2023-08-09T12:45:44.189225+0000","last_undegraded":"2023-08-09T12:45:44.189225+0000","last_fullsized":"2023-08-09T12:45:44.189225+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:44:49.938587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002114+0000","last_change":"2023-08-09T12:45:43.220102+0000","last_active":"2023-08-09T12:45:46.002114+0000","last_peered":"2023-08-09T12:45:46.002114+0000","last_clean":"2023-08-09T12:45:46.002114+0000","last_became_active":"2023-08-09T12:45:43.218701+0000","last_became_peered":"2023-08-09T12:45:43.218701+0000","last_unstale":"2023-08-09T12:45:46.002114+0000","last_undegraded":"2023-08-09T12:45:46.002114+0000","last_fullsized":"2023-08-09T12:45:46.002114+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:08.765300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000701+0000","last_change":"2023-08-09T12:45:42.158581+0000","last_active":"2023-08-09T12:45:46.000701+0000","last_peered":"2023-08-09T12:45:46.000701+0000","last_clean":"2023-08-09T12:45:46.000701+0000","last_became_active":"2023-08-09T12:45:42.157895+0000","last_became_peered":"2023-08-09T12:45:42.157895+0000","last_unstale":"2023-08-09T12:45:46.000701+0000","last_undegraded":"2023-08-09T12:45:46.000701+0000","last_fullsized":"2023-08-09T12:45:46.000701+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:24.818918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188128+0000","last_change":"2023-08-09T12:45:43.198404+0000","last_active":"2023-08-09T12:45:44.188128+0000","last_peered":"2023-08-09T12:45:44.188128+0000","last_clean":"2023-08-09T12:45:44.188128+0000","last_became_active":"2023-08-09T12:45:43.197701+0000","last_became_peered":"2023-08-09T12:45:43.197701+0000","last_unstale":"2023-08-09T12:45:44.188128+0000","last_undegraded":"2023-08-09T12:45:44.188128+0000","last_fullsized":"2023-08-09T12:45:44.188128+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:45.948508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001280+0000","last_change":"2023-08-09T12:45:42.173485+0000","last_active":"2023-08-09T12:45:46.001280+0000","last_peered":"2023-08-09T12:45:46.001280+0000","last_clean":"2023-08-09T12:45:46.001280+0000","last_became_active":"2023-08-09T12:45:42.173032+0000","last_became_peered":"2023-08-09T12:45:42.173032+0000","last_unstale":"2023-08-09T12:45:46.001280+0000","last_undegraded":"2023-08-09T12:45:46.001280+0000","last_fullsized":"2023-08-09T12:45:46.001280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.080795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187228+0000","last_change":"2023-08-09T12:45:43.214279+0000","last_active":"2023-08-09T12:45:44.187228+0000","last_peered":"2023-08-09T12:45:44.187228+0000","last_clean":"2023-08-09T12:45:44.187228+0000","last_became_active":"2023-08-09T12:45:43.213914+0000","last_became_peered":"2023-08-09T12:45:43.213914+0000","last_unstale":"2023-08-09T12:45:44.187228+0000","last_undegraded":"2023-08-09T12:45:44.187228+0000","last_fullsized":"2023-08-09T12:45:44.187228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:49:27.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895349+0000","last_change":"2023-08-09T12:45:42.173695+0000","last_active":"2023-08-09T12:45:45.895349+0000","last_peered":"2023-08-09T12:45:45.895349+0000","last_clean":"2023-08-09T12:45:45.895349+0000","last_became_active":"2023-08-09T12:45:42.173317+0000","last_became_peered":"2023-08-09T12:45:42.173317+0000","last_unstale":"2023-08-09T12:45:45.895349+0000","last_undegraded":"2023-08-09T12:45:45.895349+0000","last_fullsized":"2023-08-09T12:45:45.895349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:48:14.984377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000702+0000","last_change":"2023-08-09T12:45:43.210681+0000","last_active":"2023-08-09T12:45:46.000702+0000","last_peered":"2023-08-09T12:45:46.000702+0000","last_clean":"2023-08-09T12:45:46.000702+0000","last_became_active":"2023-08-09T12:45:43.209762+0000","last_became_peered":"2023-08-09T12:45:43.209762+0000","last_unstale":"2023-08-09T12:45:46.000702+0000","last_undegraded":"2023-08-09T12:45:46.000702+0000","last_fullsized":"2023-08-09T12:45:46.000702+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:52:34.879127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184932+0000","last_change":"2023-08-09T12:45:42.172728+0000","last_active":"2023-08-09T12:45:44.184932+0000","last_peered":"2023-08-09T12:45:44.184932+0000","last_clean":"2023-08-09T12:45:44.184932+0000","last_became_active":"2023-08-09T12:45:42.172043+0000","last_became_peered":"2023-08-09T12:45:42.172043+0000","last_unstale":"2023-08-09T12:45:44.184932+0000","last_undegraded":"2023-08-09T12:45:44.184932+0000","last_fullsized":"2023-08-09T12:45:44.184932+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:52.936076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000753+0000","last_change":"2023-08-09T12:45:43.210266+0000","last_active":"2023-08-09T12:45:46.000753+0000","last_peered":"2023-08-09T12:45:46.000753+0000","last_clean":"2023-08-09T12:45:46.000753+0000","last_became_active":"2023-08-09T12:45:43.209693+0000","last_became_peered":"2023-08-09T12:45:43.209693+0000","last_unstale":"2023-08-09T12:45:46.000753+0000","last_undegraded":"2023-08-09T12:45:46.000753+0000","last_fullsized":"2023-08-09T12:45:46.000753+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:23.490823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953284+0000","last_change":"2023-08-09T12:45:42.170330+0000","last_active":"2023-08-09T12:45:44.953284+0000","last_peered":"2023-08-09T12:45:44.953284+0000","last_clean":"2023-08-09T12:45:44.953284+0000","last_became_active":"2023-08-09T12:45:42.169301+0000","last_became_peered":"2023-08-09T12:45:42.169301+0000","last_unstale":"2023-08-09T12:45:44.953284+0000","last_undegraded":"2023-08-09T12:45:44.953284+0000","last_fullsized":"2023-08-09T12:45:44.953284+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:38:31.692323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185009+0000","last_change":"2023-08-09T12:45:43.202745+0000","last_active":"2023-08-09T12:45:44.185009+0000","last_peered":"2023-08-09T12:45:44.185009+0000","last_clean":"2023-08-09T12:45:44.185009+0000","last_became_active":"2023-08-09T12:45:43.202339+0000","last_became_peered":"2023-08-09T12:45:43.202339+0000","last_unstale":"2023-08-09T12:45:44.185009+0000","last_undegraded":"2023-08-09T12:45:44.185009+0000","last_fullsized":"2023-08-09T12:45:44.185009+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:27:58.721470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.896610+0000","last_change":"2023-08-09T12:45:42.173812+0000","last_active":"2023-08-09T12:45:45.896610+0000","last_peered":"2023-08-09T12:45:45.896610+0000","last_clean":"2023-08-09T12:45:45.896610+0000","last_became_active":"2023-08-09T12:45:42.173417+0000","last_became_peered":"2023-08-09T12:45:42.173417+0000","last_unstale":"2023-08-09T12:45:45.896610+0000","last_undegraded":"2023-08-09T12:45:45.896610+0000","last_fullsized":"2023-08-09T12:45:45.896610+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:01:15.267840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.896301+0000","last_change":"2023-08-09T12:45:43.218302+0000","last_active":"2023-08-09T12:45:45.896301+0000","last_peered":"2023-08-09T12:45:45.896301+0000","last_clean":"2023-08-09T12:45:45.896301+0000","last_became_active":"2023-08-09T12:45:43.217352+0000","last_became_peered":"2023-08-09T12:45:43.217352+0000","last_unstale":"2023-08-09T12:45:45.896301+0000","last_undegraded":"2023-08-09T12:45:45.896301+0000","last_fullsized":"2023-08-09T12:45:45.896301+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:40:03.144027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"109'3","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000365+0000","last_change":"2023-08-09T12:45:42.166679+0000","last_active":"2023-08-09T12:45:46.000365+0000","last_peered":"2023-08-09T12:45:46.000365+0000","last_clean":"2023-08-09T12:45:46.000365+0000","last_became_active":"2023-08-09T12:45:42.166306+0000","last_became_peered":"2023-08-09T12:45:42.166306+0000","last_unstale":"2023-08-09T12:45:46.000365+0000","last_undegraded":"2023-08-09T12:45:46.000365+0000","last_fullsized":"2023-08-09T12:45:46.000365+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:16:29.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001536+0000","last_change":"2023-08-09T12:45:43.217109+0000","last_active":"2023-08-09T12:45:46.001536+0000","last_peered":"2023-08-09T12:45:46.001536+0000","last_clean":"2023-08-09T12:45:46.001536+0000","last_became_active":"2023-08-09T12:45:43.216368+0000","last_became_peered":"2023-08-09T12:45:43.216368+0000","last_unstale":"2023-08-09T12:45:46.001536+0000","last_undegraded":"2023-08-09T12:45:46.001536+0000","last_fullsized":"2023-08-09T12:45:46.001536+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:05:21.390158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"109'6","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187481+0000","last_change":"2023-08-09T12:45:42.169490+0000","last_active":"2023-08-09T12:45:44.187481+0000","last_peered":"2023-08-09T12:45:44.187481+0000","last_clean":"2023-08-09T12:45:44.187481+0000","last_became_active":"2023-08-09T12:45:42.169083+0000","last_became_peered":"2023-08-09T12:45:42.169083+0000","last_unstale":"2023-08-09T12:45:44.187481+0000","last_undegraded":"2023-08-09T12:45:44.187481+0000","last_fullsized":"2023-08-09T12:45:44.187481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.655063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002255+0000","last_change":"2023-08-09T12:45:43.213666+0000","last_active":"2023-08-09T12:45:46.002255+0000","last_peered":"2023-08-09T12:45:46.002255+0000","last_clean":"2023-08-09T12:45:46.002255+0000","last_became_active":"2023-08-09T12:45:43.211302+0000","last_became_peered":"2023-08-09T12:45:43.211302+0000","last_unstale":"2023-08-09T12:45:46.002255+0000","last_undegraded":"2023-08-09T12:45:46.002255+0000","last_fullsized":"2023-08-09T12:45:46.002255+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:28:50.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185286+0000","last_change":"2023-08-09T12:45:42.173486+0000","last_active":"2023-08-09T12:45:44.185286+0000","last_peered":"2023-08-09T12:45:44.185286+0000","last_clean":"2023-08-09T12:45:44.185286+0000","last_became_active":"2023-08-09T12:45:42.172463+0000","last_became_peered":"2023-08-09T12:45:42.172463+0000","last_unstale":"2023-08-09T12:45:44.185286+0000","last_undegraded":"2023-08-09T12:45:44.185286+0000","last_fullsized":"2023-08-09T12:45:44.185286+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:30.835160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000373+0000","last_change":"2023-08-09T12:45:43.212960+0000","last_active":"2023-08-09T12:45:46.000373+0000","last_peered":"2023-08-09T12:45:46.000373+0000","last_clean":"2023-08-09T12:45:46.000373+0000","last_became_active":"2023-08-09T12:45:43.212578+0000","last_became_peered":"2023-08-09T12:45:43.212578+0000","last_unstale":"2023-08-09T12:45:46.000373+0000","last_undegraded":"2023-08-09T12:45:46.000373+0000","last_fullsized":"2023-08-09T12:45:46.000373+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:08.044178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188072+0000","last_change":"2023-08-09T12:45:42.170960+0000","last_active":"2023-08-09T12:45:44.188072+0000","last_peered":"2023-08-09T12:45:44.188072+0000","last_clean":"2023-08-09T12:45:44.188072+0000","last_became_active":"2023-08-09T12:45:42.170519+0000","last_became_peered":"2023-08-09T12:45:42.170519+0000","last_unstale":"2023-08-09T12:45:44.188072+0000","last_undegraded":"2023-08-09T12:45:44.188072+0000","last_fullsized":"2023-08-09T12:45:44.188072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:08:04.874324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001644+0000","last_change":"2023-08-09T12:45:43.215175+0000","last_active":"2023-08-09T12:45:46.001644+0000","last_peered":"2023-08-09T12:45:46.001644+0000","last_clean":"2023-08-09T12:45:46.001644+0000","last_became_active":"2023-08-09T12:45:43.214824+0000","last_became_peered":"2023-08-09T12:45:43.214824+0000","last_unstale":"2023-08-09T12:45:46.001644+0000","last_undegraded":"2023-08-09T12:45:46.001644+0000","last_fullsized":"2023-08-09T12:45:46.001644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:58:37.997832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000943+0000","last_change":"2023-08-09T12:45:42.170297+0000","last_active":"2023-08-09T12:45:46.000943+0000","last_peered":"2023-08-09T12:45:46.000943+0000","last_clean":"2023-08-09T12:45:46.000943+0000","last_became_active":"2023-08-09T12:45:42.169795+0000","last_became_peered":"2023-08-09T12:45:42.169795+0000","last_unstale":"2023-08-09T12:45:46.000943+0000","last_undegraded":"2023-08-09T12:45:46.000943+0000","last_fullsized":"2023-08-09T12:45:46.000943+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:12:25.996027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001619+0000","last_change":"2023-08-09T12:45:43.206557+0000","last_active":"2023-08-09T12:45:46.001619+0000","last_peered":"2023-08-09T12:45:46.001619+0000","last_clean":"2023-08-09T12:45:46.001619+0000","last_became_active":"2023-08-09T12:45:43.206118+0000","last_became_peered":"2023-08-09T12:45:43.206118+0000","last_unstale":"2023-08-09T12:45:46.001619+0000","last_undegraded":"2023-08-09T12:45:46.001619+0000","last_fullsized":"2023-08-09T12:45:46.001619+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:32:23.544370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"109'8","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001962+0000","last_change":"2023-08-09T12:45:42.170246+0000","last_active":"2023-08-09T12:45:46.001962+0000","last_peered":"2023-08-09T12:45:46.001962+0000","last_clean":"2023-08-09T12:45:46.001962+0000","last_became_active":"2023-08-09T12:45:42.169960+0000","last_became_peered":"2023-08-09T12:45:42.169960+0000","last_unstale":"2023-08-09T12:45:46.001962+0000","last_undegraded":"2023-08-09T12:45:46.001962+0000","last_fullsized":"2023-08-09T12:45:46.001962+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:49:26.573151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188652+0000","last_change":"2023-08-09T12:45:43.195106+0000","last_active":"2023-08-09T12:45:44.188652+0000","last_peered":"2023-08-09T12:45:44.188652+0000","last_clean":"2023-08-09T12:45:44.188652+0000","last_became_active":"2023-08-09T12:45:43.194423+0000","last_became_peered":"2023-08-09T12:45:43.194423+0000","last_unstale":"2023-08-09T12:45:44.188652+0000","last_undegraded":"2023-08-09T12:45:44.188652+0000","last_fullsized":"2023-08-09T12:45:44.188652+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:54.191860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184981+0000","last_change":"2023-08-09T12:45:42.170944+0000","last_active":"2023-08-09T12:45:44.184981+0000","last_peered":"2023-08-09T12:45:44.184981+0000","last_clean":"2023-08-09T12:45:44.184981+0000","last_became_active":"2023-08-09T12:45:42.170658+0000","last_became_peered":"2023-08-09T12:45:42.170658+0000","last_unstale":"2023-08-09T12:45:44.184981+0000","last_undegraded":"2023-08-09T12:45:44.184981+0000","last_fullsized":"2023-08-09T12:45:44.184981+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:04:01.862737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187233+0000","last_change":"2023-08-09T12:45:43.209718+0000","last_active":"2023-08-09T12:45:44.187233+0000","last_peered":"2023-08-09T12:45:44.187233+0000","last_clean":"2023-08-09T12:45:44.187233+0000","last_became_active":"2023-08-09T12:45:43.208102+0000","last_became_peered":"2023-08-09T12:45:43.208102+0000","last_unstale":"2023-08-09T12:45:44.187233+0000","last_undegraded":"2023-08-09T12:45:44.187233+0000","last_fullsized":"2023-08-09T12:45:44.187233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:50.899939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000572+0000","last_change":"2023-08-09T12:45:42.173319+0000","last_active":"2023-08-09T12:45:46.000572+0000","last_peered":"2023-08-09T12:45:46.000572+0000","last_clean":"2023-08-09T12:45:46.000572+0000","last_became_active":"2023-08-09T12:45:42.173050+0000","last_became_peered":"2023-08-09T12:45:42.173050+0000","last_unstale":"2023-08-09T12:45:46.000572+0000","last_undegraded":"2023-08-09T12:45:46.000572+0000","last_fullsized":"2023-08-09T12:45:46.000572+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:49:06.602695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187418+0000","last_change":"2023-08-09T12:45:43.207367+0000","last_active":"2023-08-09T12:45:44.187418+0000","last_peered":"2023-08-09T12:45:44.187418+0000","last_clean":"2023-08-09T12:45:44.187418+0000","last_became_active":"2023-08-09T12:45:43.204580+0000","last_became_peered":"2023-08-09T12:45:43.204580+0000","last_unstale":"2023-08-09T12:45:44.187418+0000","last_undegraded":"2023-08-09T12:45:44.187418+0000","last_fullsized":"2023-08-09T12:45:44.187418+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:35:03.227531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001536+0000","last_change":"2023-08-09T12:45:42.174675+0000","last_active":"2023-08-09T12:45:46.001536+0000","last_peered":"2023-08-09T12:45:46.001536+0000","last_clean":"2023-08-09T12:45:46.001536+0000","last_became_active":"2023-08-09T12:45:42.172063+0000","last_became_peered":"2023-08-09T12:45:42.172063+0000","last_unstale":"2023-08-09T12:45:46.001536+0000","last_undegraded":"2023-08-09T12:45:46.001536+0000","last_fullsized":"2023-08-09T12:45:46.001536+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:22.991939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952664+0000","last_change":"2023-08-09T12:45:43.214460+0000","last_active":"2023-08-09T12:45:44.952664+0000","last_peered":"2023-08-09T12:45:44.952664+0000","last_clean":"2023-08-09T12:45:44.952664+0000","last_became_active":"2023-08-09T12:45:43.214226+0000","last_became_peered":"2023-08-09T12:45:43.214226+0000","last_unstale":"2023-08-09T12:45:44.952664+0000","last_undegraded":"2023-08-09T12:45:44.952664+0000","last_fullsized":"2023-08-09T12:45:44.952664+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:31.661935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.189006+0000","last_change":"2023-08-09T12:45:42.157166+0000","last_active":"2023-08-09T12:45:44.189006+0000","last_peered":"2023-08-09T12:45:44.189006+0000","last_clean":"2023-08-09T12:45:44.189006+0000","last_became_active":"2023-08-09T12:45:42.156526+0000","last_became_peered":"2023-08-09T12:45:42.156526+0000","last_unstale":"2023-08-09T12:45:44.189006+0000","last_undegraded":"2023-08-09T12:45:44.189006+0000","last_fullsized":"2023-08-09T12:45:44.189006+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:48:14.984377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.999672+0000","last_change":"2023-08-09T12:45:43.196676+0000","last_active":"2023-08-09T12:45:45.999672+0000","last_peered":"2023-08-09T12:45:45.999672+0000","last_clean":"2023-08-09T12:45:45.999672+0000","last_became_active":"2023-08-09T12:45:43.194854+0000","last_became_peered":"2023-08-09T12:45:43.194854+0000","last_unstale":"2023-08-09T12:45:45.999672+0000","last_undegraded":"2023-08-09T12:45:45.999672+0000","last_fullsized":"2023-08-09T12:45:45.999672+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:59:04.340451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188157+0000","last_change":"2023-08-09T12:45:42.168078+0000","last_active":"2023-08-09T12:45:44.188157+0000","last_peered":"2023-08-09T12:45:44.188157+0000","last_clean":"2023-08-09T12:45:44.188157+0000","last_became_active":"2023-08-09T12:45:42.167759+0000","last_became_peered":"2023-08-09T12:45:42.167759+0000","last_unstale":"2023-08-09T12:45:44.188157+0000","last_undegraded":"2023-08-09T12:45:44.188157+0000","last_fullsized":"2023-08-09T12:45:44.188157+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:51.969009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895318+0000","last_change":"2023-08-09T12:45:43.215808+0000","last_active":"2023-08-09T12:45:45.895318+0000","last_peered":"2023-08-09T12:45:45.895318+0000","last_clean":"2023-08-09T12:45:45.895318+0000","last_became_active":"2023-08-09T12:45:43.215274+0000","last_became_peered":"2023-08-09T12:45:43.215274+0000","last_unstale":"2023-08-09T12:45:45.895318+0000","last_undegraded":"2023-08-09T12:45:45.895318+0000","last_fullsized":"2023-08-09T12:45:45.895318+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:56.205594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952835+0000","last_change":"2023-08-09T12:45:42.174892+0000","last_active":"2023-08-09T12:45:44.952835+0000","last_peered":"2023-08-09T12:45:44.952835+0000","last_clean":"2023-08-09T12:45:44.952835+0000","last_became_active":"2023-08-09T12:45:42.172982+0000","last_became_peered":"2023-08-09T12:45:42.172982+0000","last_unstale":"2023-08-09T12:45:44.952835+0000","last_undegraded":"2023-08-09T12:45:44.952835+0000","last_fullsized":"2023-08-09T12:45:44.952835+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:51.969009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188668+0000","last_change":"2023-08-09T12:45:43.213327+0000","last_active":"2023-08-09T12:45:44.188668+0000","last_peered":"2023-08-09T12:45:44.188668+0000","last_clean":"2023-08-09T12:45:44.188668+0000","last_became_active":"2023-08-09T12:45:43.212933+0000","last_became_peered":"2023-08-09T12:45:43.212933+0000","last_unstale":"2023-08-09T12:45:44.188668+0000","last_undegraded":"2023-08-09T12:45:44.188668+0000","last_fullsized":"2023-08-09T12:45:44.188668+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:36.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188535+0000","last_change":"2023-08-09T12:45:42.161730+0000","last_active":"2023-08-09T12:45:44.188535+0000","last_peered":"2023-08-09T12:45:44.188535+0000","last_clean":"2023-08-09T12:45:44.188535+0000","last_became_active":"2023-08-09T12:45:42.160990+0000","last_became_peered":"2023-08-09T12:45:42.160990+0000","last_unstale":"2023-08-09T12:45:44.188535+0000","last_undegraded":"2023-08-09T12:45:44.188535+0000","last_fullsized":"2023-08-09T12:45:44.188535+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:19:20.492510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187917+0000","last_change":"2023-08-09T12:45:43.219911+0000","last_active":"2023-08-09T12:45:44.187917+0000","last_peered":"2023-08-09T12:45:44.187917+0000","last_clean":"2023-08-09T12:45:44.187917+0000","last_became_active":"2023-08-09T12:45:43.214021+0000","last_became_peered":"2023-08-09T12:45:43.214021+0000","last_unstale":"2023-08-09T12:45:44.187917+0000","last_undegraded":"2023-08-09T12:45:44.187917+0000","last_fullsized":"2023-08-09T12:45:44.187917+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:07.660676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185143+0000","last_change":"2023-08-09T12:45:42.175573+0000","last_active":"2023-08-09T12:45:44.185143+0000","last_peered":"2023-08-09T12:45:44.185143+0000","last_clean":"2023-08-09T12:45:44.185143+0000","last_became_active":"2023-08-09T12:45:42.174408+0000","last_became_peered":"2023-08-09T12:45:42.174408+0000","last_unstale":"2023-08-09T12:45:44.185143+0000","last_undegraded":"2023-08-09T12:45:44.185143+0000","last_fullsized":"2023-08-09T12:45:44.185143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:38:46.623512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186407+0000","last_change":"2023-08-09T12:45:43.207398+0000","last_active":"2023-08-09T12:45:44.186407+0000","last_peered":"2023-08-09T12:45:44.186407+0000","last_clean":"2023-08-09T12:45:44.186407+0000","last_became_active":"2023-08-09T12:45:43.206744+0000","last_became_peered":"2023-08-09T12:45:43.206744+0000","last_unstale":"2023-08-09T12:45:44.186407+0000","last_undegraded":"2023-08-09T12:45:44.186407+0000","last_fullsized":"2023-08-09T12:45:44.186407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:20:44.444578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001499+0000","last_change":"2023-08-09T12:45:42.173336+0000","last_active":"2023-08-09T12:45:46.001499+0000","last_peered":"2023-08-09T12:45:46.001499+0000","last_clean":"2023-08-09T12:45:46.001499+0000","last_became_active":"2023-08-09T12:45:42.173027+0000","last_became_peered":"2023-08-09T12:45:42.173027+0000","last_unstale":"2023-08-09T12:45:46.001499+0000","last_undegraded":"2023-08-09T12:45:46.001499+0000","last_fullsized":"2023-08-09T12:45:46.001499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:52.986927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":342,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186716+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:45:44.186716+0000","last_peered":"2023-08-09T12:45:44.186716+0000","last_clean":"2023-08-09T12:45:44.186716+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:45:44.186716+0000","last_undegraded":"2023-08-09T12:45:44.186716+0000","last_fullsized":"2023-08-09T12:45:44.186716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:54.045524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953548+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:45:44.953548+0000","last_peered":"2023-08-09T12:45:44.953548+0000","last_clean":"2023-08-09T12:45:44.953548+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:45:44.953548+0000","last_undegraded":"2023-08-09T12:45:44.953548+0000","last_fullsized":"2023-08-09T12:45:44.953548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:30.689030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187486+0000","last_change":"2023-08-09T12:45:43.213774+0000","last_active":"2023-08-09T12:45:44.187486+0000","last_peered":"2023-08-09T12:45:44.187486+0000","last_clean":"2023-08-09T12:45:44.187486+0000","last_became_active":"2023-08-09T12:45:43.213507+0000","last_became_peered":"2023-08-09T12:45:43.213507+0000","last_unstale":"2023-08-09T12:45:44.187486+0000","last_undegraded":"2023-08-09T12:45:44.187486+0000","last_fullsized":"2023-08-09T12:45:44.187486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:18:30.758379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188477+0000","last_change":"2023-08-09T12:45:42.170733+0000","last_active":"2023-08-09T12:45:44.188477+0000","last_peered":"2023-08-09T12:45:44.188477+0000","last_clean":"2023-08-09T12:45:44.188477+0000","last_became_active":"2023-08-09T12:45:42.170416+0000","last_became_peered":"2023-08-09T12:45:42.170416+0000","last_unstale":"2023-08-09T12:45:44.188477+0000","last_undegraded":"2023-08-09T12:45:44.188477+0000","last_fullsized":"2023-08-09T12:45:44.188477+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:52:06.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186070+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:45:44.186070+0000","last_peered":"2023-08-09T12:45:44.186070+0000","last_clean":"2023-08-09T12:45:44.186070+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:45:44.186070+0000","last_undegraded":"2023-08-09T12:45:44.186070+0000","last_fullsized":"2023-08-09T12:45:44.186070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:54:52.511168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188891+0000","last_change":"2023-08-09T12:45:43.208244+0000","last_active":"2023-08-09T12:45:44.188891+0000","last_peered":"2023-08-09T12:45:44.188891+0000","last_clean":"2023-08-09T12:45:44.188891+0000","last_became_active":"2023-08-09T12:45:43.207810+0000","last_became_peered":"2023-08-09T12:45:43.207810+0000","last_unstale":"2023-08-09T12:45:44.188891+0000","last_undegraded":"2023-08-09T12:45:44.188891+0000","last_fullsized":"2023-08-09T12:45:44.188891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:56.205594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185798+0000","last_change":"2023-08-09T12:45:42.175558+0000","last_active":"2023-08-09T12:45:44.185798+0000","last_peered":"2023-08-09T12:45:44.185798+0000","last_clean":"2023-08-09T12:45:44.185798+0000","last_became_active":"2023-08-09T12:45:42.175254+0000","last_became_peered":"2023-08-09T12:45:42.175254+0000","last_unstale":"2023-08-09T12:45:44.185798+0000","last_undegraded":"2023-08-09T12:45:44.185798+0000","last_fullsized":"2023-08-09T12:45:44.185798+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:16:58.168568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000549+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:45:46.000549+0000","last_peered":"2023-08-09T12:45:46.000549+0000","last_clean":"2023-08-09T12:45:46.000549+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:45:46.000549+0000","last_undegraded":"2023-08-09T12:45:46.000549+0000","last_fullsized":"2023-08-09T12:45:46.000549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:02.769714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001136+0000","last_change":"2023-08-09T12:45:43.211905+0000","last_active":"2023-08-09T12:45:46.001136+0000","last_peered":"2023-08-09T12:45:46.001136+0000","last_clean":"2023-08-09T12:45:46.001136+0000","last_became_active":"2023-08-09T12:45:43.211641+0000","last_became_peered":"2023-08-09T12:45:43.211641+0000","last_unstale":"2023-08-09T12:45:46.001136+0000","last_undegraded":"2023-08-09T12:45:46.001136+0000","last_fullsized":"2023-08-09T12:45:46.001136+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:48:26.931509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001774+0000","last_change":"2023-08-09T12:45:42.176363+0000","last_active":"2023-08-09T12:45:46.001774+0000","last_peered":"2023-08-09T12:45:46.001774+0000","last_clean":"2023-08-09T12:45:46.001774+0000","last_became_active":"2023-08-09T12:45:42.174611+0000","last_became_peered":"2023-08-09T12:45:42.174611+0000","last_unstale":"2023-08-09T12:45:46.001774+0000","last_undegraded":"2023-08-09T12:45:46.001774+0000","last_fullsized":"2023-08-09T12:45:46.001774+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:44.610451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953003+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:45:44.953003+0000","last_peered":"2023-08-09T12:45:44.953003+0000","last_clean":"2023-08-09T12:45:44.953003+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:45:44.953003+0000","last_undegraded":"2023-08-09T12:45:44.953003+0000","last_fullsized":"2023-08-09T12:45:44.953003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:13.915329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187601+0000","last_change":"2023-08-09T12:45:43.220645+0000","last_active":"2023-08-09T12:45:44.187601+0000","last_peered":"2023-08-09T12:45:44.187601+0000","last_clean":"2023-08-09T12:45:44.187601+0000","last_became_active":"2023-08-09T12:45:43.219540+0000","last_became_peered":"2023-08-09T12:45:43.219540+0000","last_unstale":"2023-08-09T12:45:44.187601+0000","last_undegraded":"2023-08-09T12:45:44.187601+0000","last_fullsized":"2023-08-09T12:45:44.187601+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:25.671887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952601+0000","last_change":"2023-08-09T12:45:42.172661+0000","last_active":"2023-08-09T12:45:44.952601+0000","last_peered":"2023-08-09T12:45:44.952601+0000","last_clean":"2023-08-09T12:45:44.952601+0000","last_became_active":"2023-08-09T12:45:42.172329+0000","last_became_peered":"2023-08-09T12:45:42.172329+0000","last_unstale":"2023-08-09T12:45:44.952601+0000","last_undegraded":"2023-08-09T12:45:44.952601+0000","last_fullsized":"2023-08-09T12:45:44.952601+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:06.647752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002339+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:45:46.002339+0000","last_peered":"2023-08-09T12:45:46.002339+0000","last_clean":"2023-08-09T12:45:46.002339+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:45:46.002339+0000","last_undegraded":"2023-08-09T12:45:46.002339+0000","last_fullsized":"2023-08-09T12:45:46.002339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:04.608129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953271+0000","last_change":"2023-08-09T12:45:43.216055+0000","last_active":"2023-08-09T12:45:44.953271+0000","last_peered":"2023-08-09T12:45:44.953271+0000","last_clean":"2023-08-09T12:45:44.953271+0000","last_became_active":"2023-08-09T12:45:43.215827+0000","last_became_peered":"2023-08-09T12:45:43.215827+0000","last_unstale":"2023-08-09T12:45:44.953271+0000","last_undegraded":"2023-08-09T12:45:44.953271+0000","last_fullsized":"2023-08-09T12:45:44.953271+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:38:35.446299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000004+0000","last_change":"2023-08-09T12:45:42.169273+0000","last_active":"2023-08-09T12:45:46.000004+0000","last_peered":"2023-08-09T12:45:46.000004+0000","last_clean":"2023-08-09T12:45:46.000004+0000","last_became_active":"2023-08-09T12:45:42.168542+0000","last_became_peered":"2023-08-09T12:45:42.168542+0000","last_unstale":"2023-08-09T12:45:46.000004+0000","last_undegraded":"2023-08-09T12:45:46.000004+0000","last_fullsized":"2023-08-09T12:45:46.000004+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:14.849952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185609+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:45:44.185609+0000","last_peered":"2023-08-09T12:45:44.185609+0000","last_clean":"2023-08-09T12:45:44.185609+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:45:44.185609+0000","last_undegraded":"2023-08-09T12:45:44.185609+0000","last_fullsized":"2023-08-09T12:45:44.185609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:10.946592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952486+0000","last_change":"2023-08-09T12:45:43.213181+0000","last_active":"2023-08-09T12:45:44.952486+0000","last_peered":"2023-08-09T12:45:44.952486+0000","last_clean":"2023-08-09T12:45:44.952486+0000","last_became_active":"2023-08-09T12:45:43.212879+0000","last_became_peered":"2023-08-09T12:45:43.212879+0000","last_unstale":"2023-08-09T12:45:44.952486+0000","last_undegraded":"2023-08-09T12:45:44.952486+0000","last_fullsized":"2023-08-09T12:45:44.952486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:33:26.728442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953553+0000","last_change":"2023-08-09T12:45:42.174137+0000","last_active":"2023-08-09T12:45:44.953553+0000","last_peered":"2023-08-09T12:45:44.953553+0000","last_clean":"2023-08-09T12:45:44.953553+0000","last_became_active":"2023-08-09T12:45:42.173831+0000","last_became_peered":"2023-08-09T12:45:42.173831+0000","last_unstale":"2023-08-09T12:45:44.953553+0000","last_undegraded":"2023-08-09T12:45:44.953553+0000","last_fullsized":"2023-08-09T12:45:44.953553+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:58.838314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002368+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:45:46.002368+0000","last_peered":"2023-08-09T12:45:46.002368+0000","last_clean":"2023-08-09T12:45:46.002368+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:45:46.002368+0000","last_undegraded":"2023-08-09T12:45:46.002368+0000","last_fullsized":"2023-08-09T12:45:46.002368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:25.902601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187606+0000","last_change":"2023-08-09T12:45:43.207564+0000","last_active":"2023-08-09T12:45:44.187606+0000","last_peered":"2023-08-09T12:45:44.187606+0000","last_clean":"2023-08-09T12:45:44.187606+0000","last_became_active":"2023-08-09T12:45:43.206550+0000","last_became_peered":"2023-08-09T12:45:43.206550+0000","last_unstale":"2023-08-09T12:45:44.187606+0000","last_undegraded":"2023-08-09T12:45:44.187606+0000","last_fullsized":"2023-08-09T12:45:44.187606+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:37.720656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001968+0000","last_change":"2023-08-09T12:45:42.168543+0000","last_active":"2023-08-09T12:45:46.001968+0000","last_peered":"2023-08-09T12:45:46.001968+0000","last_clean":"2023-08-09T12:45:46.001968+0000","last_became_active":"2023-08-09T12:45:42.168289+0000","last_became_peered":"2023-08-09T12:45:42.168289+0000","last_unstale":"2023-08-09T12:45:46.001968+0000","last_undegraded":"2023-08-09T12:45:46.001968+0000","last_fullsized":"2023-08-09T12:45:46.001968+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:47:37.731380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.189158+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:45:44.189158+0000","last_peered":"2023-08-09T12:45:44.189158+0000","last_clean":"2023-08-09T12:45:44.189158+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:45:44.189158+0000","last_undegraded":"2023-08-09T12:45:44.189158+0000","last_fullsized":"2023-08-09T12:45:44.189158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:04:08.773192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194113,"statfs":{"total":200000000,"available":198772147,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.137,"15min":1.107},"min":{"1min":0.627,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.542,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":1.331},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.0860000000000001},"min":{"1min":0.89700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7769999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.91700000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.21,"15min":1.1160000000000001},"min":{"1min":0.748,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1990000000000001,"15min":1.117},"min":{"1min":0.79100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5600000000000001,"5min":1.734,"15min":1.734},"last":1.1559999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.1819999999999999},"min":{"1min":0.69999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.96,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.1539999999999999},"min":{"1min":0.746,"5min":0.73399999999999999,"15min":0.69799999999999995},"max":{"1min":1.7070000000000001,"5min":2.173,"15min":2.173},"last":1.121}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3180000000000001,"15min":1.244},"min":{"1min":0.83299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.732,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.514},{"interface":"front","average":{"1min":1.345,"5min":1.353,"15min":1.2769999999999999},"min":{"1min":0.92600000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.843,"5min":2.282,"15min":2.282},"last":1.474}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2330000000000001,"15min":1.202},"min":{"1min":0.81100000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6179999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.212},{"interface":"front","average":{"1min":1.341,"5min":1.3959999999999999,"15min":1.288},"min":{"1min":0.93700000000000006,"5min":0.67900000000000005,"15min":0.58599999999999997},"max":{"1min":2.0630000000000002,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.921}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.427,"15min":1.3069999999999999},"min":{"1min":0.90200000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1699999999999999,"5min":2.802,"15min":2.802},"last":1.391},{"interface":"front","average":{"1min":1.587,"5min":1.516,"15min":1.4870000000000001},"min":{"1min":1.214,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.7799999999999998,"5min":3.1400000000000001,"15min":3.3580000000000001},"last":1.7050000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4850000000000001,"15min":1.4690000000000001},"min":{"1min":1.0740000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.8849999999999998,"5min":3.266,"15min":3.4910000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.161,"5min":0.83699999999999997,"15min":0.623},"max":{"1min":2.3580000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.998}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":624,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199360355,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1899999999999999,"15min":1.1299999999999999},"min":{"1min":0.79400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7929999999999999,"5min":2.54,"15min":2.54},"last":1.04},{"interface":"front","average":{"1min":1.139,"5min":1.127,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5469999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.98399999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.234},"min":{"1min":0.86299999999999999,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0009999999999999,"15min":2.306},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.359,"5min":1.3720000000000001,"15min":1.3260000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.613,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.3300000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1659999999999999,"15min":1.1060000000000001},"min":{"1min":0.70199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5629999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3089999999999999,"15min":1.2749999999999999},"min":{"1min":0.93700000000000006,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.857,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.1579999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.363,"15min":1.2809999999999999},"min":{"1min":0.93600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.673,"5min":2.327,"15min":2.327},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.359,"15min":1.296},"min":{"1min":1.0589999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.6819999999999999,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.4710000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4650000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0139999999999998,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.403,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.766,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.423}]},{"osd":5,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.407,"15min":1.335},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.77600000000000002},"max":{"1min":1.8440000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.577,"15min":1.4890000000000001},"min":{"1min":1.2110000000000001,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":2.222,"5min":2.7160000000000002,"15min":2.8580000000000001},"last":1.2789999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.597,"15min":1.4390000000000001},"min":{"1min":1.0820000000000001,"5min":1.0009999999999999,"15min":0.752},"max":{"1min":1.954,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.645},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":1.446},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.9690000000000001,"5min":3.621,"15min":3.621},"last":1.6850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194690,"statfs":{"total":200000000,"available":199362571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.131,"15min":1.117},"min":{"1min":0.77300000000000002,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.427},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.208,"15min":1.0880000000000001},"min":{"1min":0.81999999999999995,"5min":0.71699999999999997,"15min":0.625},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.8859999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.3600000000000001,"15min":1.2989999999999999},"min":{"1min":1.0369999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.804},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.29,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.982,"5min":1.984,"15min":1.984},"last":1.635}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.236,"15min":1.21},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.2190000000000001,"15min":1.198},"min":{"1min":0.81399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.4570000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3169999999999999,"15min":1.2150000000000001},"min":{"1min":0.96499999999999997,"5min":0.78000000000000003,"15min":0.77100000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.383,"15min":1.381},"min":{"1min":1.1539999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.3999999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.266,"15min":1.2370000000000001},"min":{"1min":0.88400000000000001,"5min":0.621,"15min":0.60699999999999998},"max":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.96899999999999997,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.5489999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3799999999999999,"15min":1.3420000000000001},"min":{"1min":1.0289999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.429,"15min":1.49},"min":{"1min":1.194,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.726}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.5069999999999999,"15min":1.5229999999999999},"min":{"1min":1.2010000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.722,"5min":2.722,"15min":3.3250000000000002},"last":1.946},{"interface":"front","average":{"1min":1.72,"5min":1.5629999999999999,"15min":1.522},"min":{"1min":1.452,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.849}]}]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199362411,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.141,"15min":1.087},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5529999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.165,"15min":1.101},"min":{"1min":0.83599999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4279999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.258}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.3320000000000001},"min":{"1min":0.83999999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7589999999999999,"5min":1.897,"15min":1.97},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3009999999999999,"15min":1.329},"min":{"1min":0.92100000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.804,"5min":2.2040000000000002,"15min":2.7770000000000001},"last":1.5149999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.3169999999999999},"min":{"1min":0.81599999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.073},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.3200000000000001,"15min":1.3109999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6539999999999999,"5min":1.929,"15min":1.929},"last":1.3180000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.28,"15min":1.228},"min":{"1min":0.82999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.623,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":1.665,"5min":2.081,"15min":2.081},"last":1.2210000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3029999999999999,"15min":1.377},"min":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.615,"5min":1.853,"15min":1.9490000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3899999999999999,"15min":1.385},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.665,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.92600000000000005}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.397,"15min":1.4850000000000001},"min":{"1min":0.76000000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.784,"5min":2.238,"15min":2.238},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.756,"5min":2.036,"15min":2.036},"last":1.1419999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.542,"15min":1.5249999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8089999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.552,"15min":1.619},"min":{"1min":0.89400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.9299999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.347}]}]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194690,"statfs":{"total":200000000,"available":199362571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90400000000000003,"15min":0.83999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.3480000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.0549999999999999,"15min":0.91900000000000004},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":2.778,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.24}]},{"osd":1,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.91100000000000003,"15min":0.90600000000000003},"min":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.1399999999999999,"15min":0.94599999999999995},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.373},"max":{"1min":2.0219999999999998,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.8400000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.3360000000000001,"15min":1.119},"min":{"1min":0.59399999999999997,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":1.75,"5min":18.145,"15min":18.145},"last":1.198},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.2290000000000001,"15min":1.2090000000000001},"min":{"1min":0.66500000000000004,"5min":0.48999999999999999,"15min":0.41799999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.593}]},{"osd":4,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.323,"15min":1.331},"min":{"1min":0.98099999999999998,"5min":0.84399999999999997,"15min":0.745},"max":{"1min":1.712,"5min":2.972,"15min":3.5110000000000001},"last":1.129},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.325,"15min":1.341},"min":{"1min":0.98999999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.712,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.329}]},{"osd":5,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.5760000000000001,"15min":1.444},"min":{"1min":1.099,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7210000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.431},{"interface":"front","average":{"1min":1.55,"5min":1.595,"15min":1.361},"min":{"1min":1.0249999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.2959999999999998,"5min":14.105,"15min":14.105},"last":2.0489999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.401,"15min":1.3500000000000001},"min":{"1min":1.091,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8999999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.4690000000000001,"15min":1.4810000000000001},"min":{"1min":0.93700000000000006,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8839999999999999,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.655}]},{"osd":7,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.4790000000000001,"15min":1.407},"min":{"1min":0.98599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.698},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.458,"15min":1.389},"min":{"1min":1.022,"5min":0.85699999999999998,"15min":0.70799999999999996},"max":{"1min":1.8180000000000001,"5min":3.016,"15min":3.016},"last":1.4790000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194690,"statfs":{"total":200000000,"available":199362571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56799999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.716},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.107,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.38900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":2.9009999999999998},"last":1.014}]},{"osd":1,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.95399999999999996,"15min":0.93100000000000005},"min":{"1min":0.63700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4219999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.264,"5min":1.079,"15min":1.069},"min":{"1min":0.66700000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.823,"5min":1.823,"15min":1.869},"last":0.93600000000000005}]},{"osd":3,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1719999999999999,"15min":1.1739999999999999},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.681,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":1.373},{"interface":"front","average":{"1min":1.395,"5min":1.2050000000000001,"15min":1.1639999999999999},"min":{"1min":0.77300000000000002,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":2.0289999999999999,"5min":2.242,"15min":2.9409999999999998},"last":0.89300000000000002}]},{"osd":4,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.4770000000000001,"15min":1.429},"min":{"1min":1.1539999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7450000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.218},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.3799999999999999,"15min":1.288},"min":{"1min":0.97999999999999998,"5min":0.83199999999999996,"15min":0.66800000000000004},"max":{"1min":2.6509999999999998,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.0600000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.446,"15min":1.3680000000000001},"min":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.3210000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.673,"5min":1.512,"15min":1.4910000000000001},"min":{"1min":1.034,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4780000000000002,"5min":4.806,"15min":4.806},"last":1.3149999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.399,"15min":1.321},"min":{"1min":0.82799999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.613,"5min":1.4790000000000001,"15min":1.431},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.7309999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.484}]},{"osd":7,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.89500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.579,"15min":1.542},"min":{"1min":0.995,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.6549999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.71}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":38,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":616,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194696,"statfs":{"total":200000000,"available":199369154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.53000000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.609,"5min":1.881,"15min":1.881},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":2.0529999999999999,"15min":1.2549999999999999},"min":{"1min":0.66400000000000003,"5min":0.47799999999999998,"15min":0.34300000000000003},"max":{"1min":1.863,"5min":88.254999999999995,"15min":88.254999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0469999999999999,"15min":0.95499999999999996},"min":{"1min":0.67400000000000004,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.476,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.337,"5min":1.306,"15min":1.147},"min":{"1min":0.91900000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.044,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1950000000000001,"15min":1.099},"min":{"1min":0.71999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.724,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.1779999999999999,"15min":0.97599999999999998},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.5740000000000001,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.55,"15min":1.2909999999999999},"min":{"1min":0.95999999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.5289999999999999,"5min":25.172000000000001,"15min":25.172000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.351,"5min":1.3819999999999999,"15min":1.302},"min":{"1min":0.94499999999999995,"5min":0.88500000000000001,"15min":0.84599999999999997},"max":{"1min":2.1589999999999998,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.669,"15min":1.399},"min":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8420000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.228},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3799999999999999,"15min":1.2849999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9059999999999999,"5min":3.762,"15min":3.762},"last":1.198}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.5449999999999999,"15min":1.431},"min":{"1min":0.91000000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.827,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.482,"15min":1.3839999999999999},"min":{"1min":1.0600000000000001,"5min":0.873,"15min":0.79500000000000004},"max":{"1min":1.7949999999999999,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.262}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.8680000000000001,"15min":1.5880000000000001},"min":{"1min":1.2829999999999999,"5min":0.96899999999999997,"15min":0.88800000000000001},"max":{"1min":2.5089999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.8759999999999999,"15min":1.5680000000000001},"min":{"1min":1.1379999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.7949999999999999,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.2929999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194111,"statfs":{"total":200000000,"available":198769885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.64500000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":1.389,"5min":1.819,"15min":1.819},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1040000000000001,"15min":0.96499999999999997},"min":{"1min":0.79200000000000004,"5min":0.53300000000000003,"15min":0.436},"max":{"1min":1.6160000000000001,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.92300000000000004}]},{"osd":2,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.038,"15min":0.96599999999999997},"min":{"1min":0.68899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.159,"15min":1.0369999999999999},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.5},"max":{"1min":1.732,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":0.63}]},{"osd":3,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.089,"15min":0.94699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.413,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.298},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.218,"15min":1.1830000000000001},"min":{"1min":0.72899999999999998,"5min":0.58199999999999996,"15min":0.56000000000000005},"max":{"1min":1.6950000000000001,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":1.375}]},{"osd":4,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3779999999999999,"15min":1.3340000000000001},"min":{"1min":0.81599999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8240000000000001,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.163},{"interface":"front","average":{"1min":1.419,"5min":1.3640000000000001,"15min":1.29},"min":{"1min":1.0289999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.45}]},{"osd":5,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4119999999999999,"15min":1.3129999999999999},"min":{"1min":0.91900000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.891,"5min":10.004,"15min":10.004},"last":1.407},{"interface":"front","average":{"1min":1.496,"5min":1.4330000000000001,"15min":1.3859999999999999},"min":{"1min":0.97799999999999998,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":1.8069999999999999,"5min":1.909,"15min":2.161},"last":1.2350000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4550000000000001,"15min":1.3480000000000001},"min":{"1min":1.1399999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9370000000000001,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.532,"15min":1.4350000000000001},"min":{"1min":1.0609999999999999,"5min":0.90100000000000002,"15min":0.86799999999999999},"max":{"1min":2.0099999999999998,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.5940000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.609,"15min":1.4390000000000001},"min":{"1min":1.202,"5min":0.80400000000000005,"15min":0.79200000000000004},"max":{"1min":1.8360000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.627,"5min":1.589,"15min":1.4710000000000001},"min":{"1min":1.1180000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.1120000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.506}]}]}],"pool_statfs":[]}} 2023-08-09T12:45:52.824 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:45:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.064+0000 7f028d2f2640 1 Processor -- start 2023-08-09T12:45:53.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.064+0000 7f028d2f2640 1 -- start start 2023-08-09T12:45:53.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f028d2f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f0288070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f028d2f2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f02880cb070 0x7f02880cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f028d2f2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028815beb0 con 0x7f02880b0b10 2023-08-09T12:45:53.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f028d2f2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880cba40 con 0x7f02880cb070 2023-08-09T12:45:53.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f028d2f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880715c0 con 0x7f02881587e0 2023-08-09T12:45:53.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f028caf1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f02880cb070 0x7f02880cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f028caf1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f02880cb070 0x7f02880cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45368/0 (socket says 172.21.15.17:45368) 2023-08-09T12:45:53.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f028caf1640 1 -- 172.21.15.17:0/3356555144 learned_addr learned my addr 172.21.15.17:0/3356555144 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.066+0000 7f0287fff640 1 --2- 172.21.15.17:0/3356555144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f0288070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.067+0000 7f028caf1640 1 -- 172.21.15.17:0/3356555144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 msgr2=0x7f0288070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.067+0000 7f028caf1640 1 --2- 172.21.15.17:0/3356555144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f0288070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.067+0000 7f028caf1640 1 -- 172.21.15.17:0/3356555144 >> v1:172.21.15.142:6789/0 conn(0x7f02880b0b10 legacy=0x7f028815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.067+0000 7f028caf1640 1 -- 172.21.15.17:0/3356555144 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880718a0 con 0x7f02880cb070 2023-08-09T12:45:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.067+0000 7f0287fff640 1 --2- 172.21.15.17:0/3356555144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f0288070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:45:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.068+0000 7f028caf1640 1 --2- 172.21.15.17:0/3356555144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cb500 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0280009e50 tx=0x7f028002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6106a2c27135fdd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.069+0000 7f0286ffd640 1 -- 172.21.15.17:0/3356555144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028002cb00 con 0x7f02880cb070 2023-08-09T12:45:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.069+0000 7f0286ffd640 1 -- 172.21.15.17:0/3356555144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028002cc60 con 0x7f02880cb070 2023-08-09T12:45:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.069+0000 7f0286ffd640 1 -- 172.21.15.17:0/3356555144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02800343f0 con 0x7f02880cb070 2023-08-09T12:45:53.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.069+0000 7f028d2f2640 1 -- 172.21.15.17:0/3356555144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 msgr2=0x7f02880cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.069+0000 7f028d2f2640 1 --2- 172.21.15.17:0/3356555144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cb500 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0280009e50 tx=0x7f028002bf60 comp rx=0 tx=0).stop 2023-08-09T12:45:53.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.070+0000 7f028d2f2640 1 -- 172.21.15.17:0/3356555144 shutdown_connections 2023-08-09T12:45:53.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.070+0000 7f028d2f2640 1 --2- 172.21.15.17:0/3356555144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cb500 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.070+0000 7f028d2f2640 1 --2- 172.21.15.17:0/3356555144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f0288070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.070+0000 7f028d2f2640 1 -- 172.21.15.17:0/3356555144 >> 172.21.15.17:0/3356555144 conn(0x7f02880b1d50 msgr2=0x7f028806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:53.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.070+0000 7f028d2f2640 1 -- 172.21.15.17:0/3356555144 shutdown_connections 2023-08-09T12:45:53.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.070+0000 7f028d2f2640 1 -- 172.21.15.17:0/3356555144 wait complete. 2023-08-09T12:45:53.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.072+0000 7f028d2f2640 1 Processor -- start 2023-08-09T12:45:53.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.072+0000 7f028d2f2640 1 -- start start 2023-08-09T12:45:53.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f028d2f2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880b0b10 0x7f028814cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f028d2f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f028d2f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f02880cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f028d2f2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880c6810 con 0x7f02880cb070 2023-08-09T12:45:53.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f028d2f2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028814d1b0 con 0x7f02880b0b10 2023-08-09T12:45:53.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f028d2f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880c6a60 con 0x7f02881587e0 2023-08-09T12:45:53.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f02877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f02877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45380/0 (socket says 172.21.15.17:45380) 2023-08-09T12:45:53.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f02877fe640 1 -- 172.21.15.17:0/1055408610 learned_addr learned my addr 172.21.15.17:0/1055408610 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:53.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f0287fff640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880b0b10 0x7f028814cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.073+0000 7f028caf1640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f02880cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f02877fe640 1 -- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 msgr2=0x7f02880cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f02877fe640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f02880cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f02877fe640 1 -- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880b0b10 msgr2=0x7f028814cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f02877fe640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880b0b10 0x7f028814cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f02877fe640 1 -- 172.21.15.17:0/1055408610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280009b30 con 0x7f02880cb070 2023-08-09T12:45:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f028caf1640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f02880cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f02877fe640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cd4e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c450 tx=0x7f027c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f0284ff9640 1 -- 172.21.15.17:0/1055408610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c0052d0 con 0x7f02880cb070 2023-08-09T12:45:53.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f0284ff9640 1 -- 172.21.15.17:0/1055408610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c005430 con 0x7f02880cb070 2023-08-09T12:45:53.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f0284ff9640 1 -- 172.21.15.17:0/1055408610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c012870 con 0x7f02880cb070 2023-08-09T12:45:53.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02880c6d40 con 0x7f02880cb070 2023-08-09T12:45:53.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.074+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02880c7300 con 0x7f02880cb070 2023-08-09T12:45:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.076+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02880c7520 con 0x7f02880cb070 2023-08-09T12:45:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.076+0000 7f0284ff9640 1 -- 172.21.15.17:0/1055408610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f027c0129d0 con 0x7f02880cb070 2023-08-09T12:45:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.077+0000 7f0284ff9640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f027406a050 0x7f027406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.078+0000 7f0284ff9640 1 -- 172.21.15.17:0/1055408610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f027c0880f0 con 0x7f02880cb070 2023-08-09T12:45:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.078+0000 7f0287fff640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f027406a050 0x7f027406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.079+0000 7f0287fff640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f027406a050 0x7f027406c510 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0278006fd0 tx=0x7f0278008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:53.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.082+0000 7f0284ff9640 1 -- 172.21.15.17:0/1055408610 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f027c0537d0 con 0x7f02880cb070 2023-08-09T12:45:53.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.269+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f028815b280 con 0x7f027406a050 2023-08-09T12:45:53.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.293+0000 7f0284ff9640 1 -- 172.21.15.17:0/1055408610 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303327 (secure 0 0 0) 0x7f027800b6b0 con 0x7f027406a050 2023-08-09T12:45:53.298 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:53.301 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:45:53.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f027406a050 msgr2=0x7f027406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f027406a050 0x7f027406c510 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0278006fd0 tx=0x7f0278008040 comp rx=0 tx=0).stop 2023-08-09T12:45:53.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 msgr2=0x7f02880cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cd4e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c450 tx=0x7f027c00c910 comp rx=0 tx=0).stop 2023-08-09T12:45:53.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 shutdown_connections 2023-08-09T12:45:53.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f027406a050 0x7f027406c510 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02881587e0 0x7f02880cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02880cb070 0x7f02880cd4e0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 --2- 172.21.15.17:0/1055408610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880b0b10 0x7f028814cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.300+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 >> 172.21.15.17:0/1055408610 conn(0x7f02880b1d50 msgr2=0x7f028815a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:53.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.301+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 shutdown_connections 2023-08-09T12:45:53.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.301+0000 7f028d2f2640 1 -- 172.21.15.17:0/1055408610 wait complete. 2023-08-09T12:45:53.324 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-08-09T12:45:52.784662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556362,"statfs":{"total":1600000000,"available":1593715012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.599255"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895654+0000","last_change":"2023-08-09T12:45:43.216819+0000","last_active":"2023-08-09T12:45:45.895654+0000","last_peered":"2023-08-09T12:45:45.895654+0000","last_clean":"2023-08-09T12:45:45.895654+0000","last_became_active":"2023-08-09T12:45:43.216411+0000","last_became_peered":"2023-08-09T12:45:43.216411+0000","last_unstale":"2023-08-09T12:45:45.895654+0000","last_undegraded":"2023-08-09T12:45:45.895654+0000","last_fullsized":"2023-08-09T12:45:45.895654+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:44:50.951511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952412+0000","last_change":"2023-08-09T12:45:43.216299+0000","last_active":"2023-08-09T12:45:44.952412+0000","last_peered":"2023-08-09T12:45:44.952412+0000","last_clean":"2023-08-09T12:45:44.952412+0000","last_became_active":"2023-08-09T12:45:43.215456+0000","last_became_peered":"2023-08-09T12:45:43.215456+0000","last_unstale":"2023-08-09T12:45:44.952412+0000","last_undegraded":"2023-08-09T12:45:44.952412+0000","last_fullsized":"2023-08-09T12:45:44.952412+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:37.720656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.894894+0000","last_change":"2023-08-09T12:45:43.215516+0000","last_active":"2023-08-09T12:45:45.894894+0000","last_peered":"2023-08-09T12:45:45.894894+0000","last_clean":"2023-08-09T12:45:45.894894+0000","last_became_active":"2023-08-09T12:45:43.214934+0000","last_became_peered":"2023-08-09T12:45:43.214934+0000","last_unstale":"2023-08-09T12:45:45.894894+0000","last_undegraded":"2023-08-09T12:45:45.894894+0000","last_fullsized":"2023-08-09T12:45:45.894894+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:54.191860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000704+0000","last_change":"2023-08-09T12:45:43.213782+0000","last_active":"2023-08-09T12:45:46.000704+0000","last_peered":"2023-08-09T12:45:46.000704+0000","last_clean":"2023-08-09T12:45:46.000704+0000","last_became_active":"2023-08-09T12:45:43.208612+0000","last_became_peered":"2023-08-09T12:45:43.208612+0000","last_unstale":"2023-08-09T12:45:46.000704+0000","last_undegraded":"2023-08-09T12:45:46.000704+0000","last_fullsized":"2023-08-09T12:45:46.000704+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:39.279681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000414+0000","last_change":"2023-08-09T12:45:43.209346+0000","last_active":"2023-08-09T12:45:46.000414+0000","last_peered":"2023-08-09T12:45:46.000414+0000","last_clean":"2023-08-09T12:45:46.000414+0000","last_became_active":"2023-08-09T12:45:43.209102+0000","last_became_peered":"2023-08-09T12:45:43.209102+0000","last_unstale":"2023-08-09T12:45:46.000414+0000","last_undegraded":"2023-08-09T12:45:46.000414+0000","last_fullsized":"2023-08-09T12:45:46.000414+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:41:39.519119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187782+0000","last_change":"2023-08-09T12:45:43.220479+0000","last_active":"2023-08-09T12:45:44.187782+0000","last_peered":"2023-08-09T12:45:44.187782+0000","last_clean":"2023-08-09T12:45:44.187782+0000","last_became_active":"2023-08-09T12:45:43.219067+0000","last_became_peered":"2023-08-09T12:45:43.219067+0000","last_unstale":"2023-08-09T12:45:44.187782+0000","last_undegraded":"2023-08-09T12:45:44.187782+0000","last_fullsized":"2023-08-09T12:45:44.187782+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:33:26.728442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184630+0000","last_change":"2023-08-09T12:45:43.205796+0000","last_active":"2023-08-09T12:45:44.184630+0000","last_peered":"2023-08-09T12:45:44.184630+0000","last_clean":"2023-08-09T12:45:44.184630+0000","last_became_active":"2023-08-09T12:45:43.205333+0000","last_became_peered":"2023-08-09T12:45:43.205333+0000","last_unstale":"2023-08-09T12:45:44.184630+0000","last_undegraded":"2023-08-09T12:45:44.184630+0000","last_fullsized":"2023-08-09T12:45:44.184630+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:43.931548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000642+0000","last_change":"2023-08-09T12:45:43.222222+0000","last_active":"2023-08-09T12:45:46.000642+0000","last_peered":"2023-08-09T12:45:46.000642+0000","last_clean":"2023-08-09T12:45:46.000642+0000","last_became_active":"2023-08-09T12:45:43.221414+0000","last_became_peered":"2023-08-09T12:45:43.221414+0000","last_unstale":"2023-08-09T12:45:46.000642+0000","last_undegraded":"2023-08-09T12:45:46.000642+0000","last_fullsized":"2023-08-09T12:45:46.000642+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:56.592868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.999965+0000","last_change":"2023-08-09T12:45:43.209976+0000","last_active":"2023-08-09T12:45:45.999965+0000","last_peered":"2023-08-09T12:45:45.999965+0000","last_clean":"2023-08-09T12:45:45.999965+0000","last_became_active":"2023-08-09T12:45:43.207856+0000","last_became_peered":"2023-08-09T12:45:43.207856+0000","last_unstale":"2023-08-09T12:45:45.999965+0000","last_undegraded":"2023-08-09T12:45:45.999965+0000","last_fullsized":"2023-08-09T12:45:45.999965+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:20:22.622930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001040+0000","last_change":"2023-08-09T12:45:43.215731+0000","last_active":"2023-08-09T12:45:46.001040+0000","last_peered":"2023-08-09T12:45:46.001040+0000","last_clean":"2023-08-09T12:45:46.001040+0000","last_became_active":"2023-08-09T12:45:43.215327+0000","last_became_peered":"2023-08-09T12:45:43.215327+0000","last_unstale":"2023-08-09T12:45:46.001040+0000","last_undegraded":"2023-08-09T12:45:46.001040+0000","last_fullsized":"2023-08-09T12:45:46.001040+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:27:27.034825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000490+0000","last_change":"2023-08-09T12:45:43.218668+0000","last_active":"2023-08-09T12:45:46.000490+0000","last_peered":"2023-08-09T12:45:46.000490+0000","last_clean":"2023-08-09T12:45:46.000490+0000","last_became_active":"2023-08-09T12:45:43.218249+0000","last_became_peered":"2023-08-09T12:45:43.218249+0000","last_unstale":"2023-08-09T12:45:46.000490+0000","last_undegraded":"2023-08-09T12:45:46.000490+0000","last_fullsized":"2023-08-09T12:45:46.000490+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:40:55.775971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.999649+0000","last_change":"2023-08-09T12:45:43.208367+0000","last_active":"2023-08-09T12:45:45.999649+0000","last_peered":"2023-08-09T12:45:45.999649+0000","last_clean":"2023-08-09T12:45:45.999649+0000","last_became_active":"2023-08-09T12:45:43.207997+0000","last_became_peered":"2023-08-09T12:45:43.207997+0000","last_unstale":"2023-08-09T12:45:45.999649+0000","last_undegraded":"2023-08-09T12:45:45.999649+0000","last_fullsized":"2023-08-09T12:45:45.999649+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:21:32.560685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000997+0000","last_change":"2023-08-09T12:45:43.222062+0000","last_active":"2023-08-09T12:45:46.000997+0000","last_peered":"2023-08-09T12:45:46.000997+0000","last_clean":"2023-08-09T12:45:46.000997+0000","last_became_active":"2023-08-09T12:45:43.220036+0000","last_became_peered":"2023-08-09T12:45:43.220036+0000","last_unstale":"2023-08-09T12:45:46.000997+0000","last_undegraded":"2023-08-09T12:45:46.000997+0000","last_fullsized":"2023-08-09T12:45:46.000997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:32:26.384776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001375+0000","last_change":"2023-08-09T12:45:43.217515+0000","last_active":"2023-08-09T12:45:46.001375+0000","last_peered":"2023-08-09T12:45:46.001375+0000","last_clean":"2023-08-09T12:45:46.001375+0000","last_became_active":"2023-08-09T12:45:43.216115+0000","last_became_peered":"2023-08-09T12:45:43.216115+0000","last_unstale":"2023-08-09T12:45:46.001375+0000","last_undegraded":"2023-08-09T12:45:46.001375+0000","last_fullsized":"2023-08-09T12:45:46.001375+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:59.535409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001377+0000","last_change":"2023-08-09T12:45:43.220452+0000","last_active":"2023-08-09T12:45:46.001377+0000","last_peered":"2023-08-09T12:45:46.001377+0000","last_clean":"2023-08-09T12:45:46.001377+0000","last_became_active":"2023-08-09T12:45:43.219442+0000","last_became_peered":"2023-08-09T12:45:43.219442+0000","last_unstale":"2023-08-09T12:45:46.001377+0000","last_undegraded":"2023-08-09T12:45:46.001377+0000","last_fullsized":"2023-08-09T12:45:46.001377+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:07:24.077186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187419+0000","last_change":"2023-08-09T12:45:43.215398+0000","last_active":"2023-08-09T12:45:44.187419+0000","last_peered":"2023-08-09T12:45:44.187419+0000","last_clean":"2023-08-09T12:45:44.187419+0000","last_became_active":"2023-08-09T12:45:43.208415+0000","last_became_peered":"2023-08-09T12:45:43.208415+0000","last_unstale":"2023-08-09T12:45:44.187419+0000","last_undegraded":"2023-08-09T12:45:44.187419+0000","last_fullsized":"2023-08-09T12:45:44.187419+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:29:31.561794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187082+0000","last_change":"2023-08-09T12:45:43.213178+0000","last_active":"2023-08-09T12:45:44.187082+0000","last_peered":"2023-08-09T12:45:44.187082+0000","last_clean":"2023-08-09T12:45:44.187082+0000","last_became_active":"2023-08-09T12:45:43.210516+0000","last_became_peered":"2023-08-09T12:45:43.210516+0000","last_unstale":"2023-08-09T12:45:44.187082+0000","last_undegraded":"2023-08-09T12:45:44.187082+0000","last_fullsized":"2023-08-09T12:45:44.187082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:17:21.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895655+0000","last_change":"2023-08-09T12:45:43.212902+0000","last_active":"2023-08-09T12:45:45.895655+0000","last_peered":"2023-08-09T12:45:45.895655+0000","last_clean":"2023-08-09T12:45:45.895655+0000","last_became_active":"2023-08-09T12:45:43.212559+0000","last_became_peered":"2023-08-09T12:45:43.212559+0000","last_unstale":"2023-08-09T12:45:45.895655+0000","last_undegraded":"2023-08-09T12:45:45.895655+0000","last_fullsized":"2023-08-09T12:45:45.895655+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:32.646473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000398+0000","last_change":"2023-08-09T12:45:43.217690+0000","last_active":"2023-08-09T12:45:46.000398+0000","last_peered":"2023-08-09T12:45:46.000398+0000","last_clean":"2023-08-09T12:45:46.000398+0000","last_became_active":"2023-08-09T12:45:43.216998+0000","last_became_peered":"2023-08-09T12:45:43.216998+0000","last_unstale":"2023-08-09T12:45:46.000398+0000","last_undegraded":"2023-08-09T12:45:46.000398+0000","last_fullsized":"2023-08-09T12:45:46.000398+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:41:03.796561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001736+0000","last_change":"2023-08-09T12:45:43.220290+0000","last_active":"2023-08-09T12:45:46.001736+0000","last_peered":"2023-08-09T12:45:46.001736+0000","last_clean":"2023-08-09T12:45:46.001736+0000","last_became_active":"2023-08-09T12:45:43.219092+0000","last_became_peered":"2023-08-09T12:45:43.219092+0000","last_unstale":"2023-08-09T12:45:46.001736+0000","last_undegraded":"2023-08-09T12:45:46.001736+0000","last_fullsized":"2023-08-09T12:45:46.001736+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:50.772522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000901+0000","last_change":"2023-08-09T12:45:43.212214+0000","last_active":"2023-08-09T12:45:46.000901+0000","last_peered":"2023-08-09T12:45:46.000901+0000","last_clean":"2023-08-09T12:45:46.000901+0000","last_became_active":"2023-08-09T12:45:43.211963+0000","last_became_peered":"2023-08-09T12:45:43.211963+0000","last_unstale":"2023-08-09T12:45:46.000901+0000","last_undegraded":"2023-08-09T12:45:46.000901+0000","last_fullsized":"2023-08-09T12:45:46.000901+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:31:22.843668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000122+0000","last_change":"2023-08-09T12:45:43.215756+0000","last_active":"2023-08-09T12:45:46.000122+0000","last_peered":"2023-08-09T12:45:46.000122+0000","last_clean":"2023-08-09T12:45:46.000122+0000","last_became_active":"2023-08-09T12:45:43.215329+0000","last_became_peered":"2023-08-09T12:45:43.215329+0000","last_unstale":"2023-08-09T12:45:46.000122+0000","last_undegraded":"2023-08-09T12:45:46.000122+0000","last_fullsized":"2023-08-09T12:45:46.000122+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:16:56.998636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187805+0000","last_change":"2023-08-09T12:45:43.215101+0000","last_active":"2023-08-09T12:45:44.187805+0000","last_peered":"2023-08-09T12:45:44.187805+0000","last_clean":"2023-08-09T12:45:44.187805+0000","last_became_active":"2023-08-09T12:45:43.214856+0000","last_became_peered":"2023-08-09T12:45:43.214856+0000","last_unstale":"2023-08-09T12:45:44.187805+0000","last_undegraded":"2023-08-09T12:45:44.187805+0000","last_fullsized":"2023-08-09T12:45:44.187805+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:55:55.597288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895082+0000","last_change":"2023-08-09T12:45:43.213935+0000","last_active":"2023-08-09T12:45:45.895082+0000","last_peered":"2023-08-09T12:45:45.895082+0000","last_clean":"2023-08-09T12:45:45.895082+0000","last_became_active":"2023-08-09T12:45:43.213574+0000","last_became_peered":"2023-08-09T12:45:43.213574+0000","last_unstale":"2023-08-09T12:45:45.895082+0000","last_undegraded":"2023-08-09T12:45:45.895082+0000","last_fullsized":"2023-08-09T12:45:45.895082+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:36.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952907+0000","last_change":"2023-08-09T12:45:43.208273+0000","last_active":"2023-08-09T12:45:44.952907+0000","last_peered":"2023-08-09T12:45:44.952907+0000","last_clean":"2023-08-09T12:45:44.952907+0000","last_became_active":"2023-08-09T12:45:43.207828+0000","last_became_peered":"2023-08-09T12:45:43.207828+0000","last_unstale":"2023-08-09T12:45:44.952907+0000","last_undegraded":"2023-08-09T12:45:44.952907+0000","last_fullsized":"2023-08-09T12:45:44.952907+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:40.059489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001445+0000","last_change":"2023-08-09T12:45:43.218492+0000","last_active":"2023-08-09T12:45:46.001445+0000","last_peered":"2023-08-09T12:45:46.001445+0000","last_clean":"2023-08-09T12:45:46.001445+0000","last_became_active":"2023-08-09T12:45:43.217698+0000","last_became_peered":"2023-08-09T12:45:43.217698+0000","last_unstale":"2023-08-09T12:45:46.001445+0000","last_undegraded":"2023-08-09T12:45:46.001445+0000","last_fullsized":"2023-08-09T12:45:46.001445+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:09:31.867125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000014+0000","last_change":"2023-08-09T12:45:43.192924+0000","last_active":"2023-08-09T12:45:46.000014+0000","last_peered":"2023-08-09T12:45:46.000014+0000","last_clean":"2023-08-09T12:45:46.000014+0000","last_became_active":"2023-08-09T12:45:43.192277+0000","last_became_peered":"2023-08-09T12:45:43.192277+0000","last_unstale":"2023-08-09T12:45:46.000014+0000","last_undegraded":"2023-08-09T12:45:46.000014+0000","last_fullsized":"2023-08-09T12:45:46.000014+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:11:19.423386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001780+0000","last_change":"2023-08-09T12:45:43.221846+0000","last_active":"2023-08-09T12:45:46.001780+0000","last_peered":"2023-08-09T12:45:46.001780+0000","last_clean":"2023-08-09T12:45:46.001780+0000","last_became_active":"2023-08-09T12:45:43.219183+0000","last_became_peered":"2023-08-09T12:45:43.219183+0000","last_unstale":"2023-08-09T12:45:46.001780+0000","last_undegraded":"2023-08-09T12:45:46.001780+0000","last_fullsized":"2023-08-09T12:45:46.001780+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:25:12.047475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184407+0000","last_change":"2023-08-09T12:45:43.197275+0000","last_active":"2023-08-09T12:45:44.184407+0000","last_peered":"2023-08-09T12:45:44.184407+0000","last_clean":"2023-08-09T12:45:44.184407+0000","last_became_active":"2023-08-09T12:45:43.196395+0000","last_became_peered":"2023-08-09T12:45:43.196395+0000","last_unstale":"2023-08-09T12:45:44.184407+0000","last_undegraded":"2023-08-09T12:45:44.184407+0000","last_fullsized":"2023-08-09T12:45:44.184407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:00:20.116329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000803+0000","last_change":"2023-08-09T12:45:43.208849+0000","last_active":"2023-08-09T12:45:46.000803+0000","last_peered":"2023-08-09T12:45:46.000803+0000","last_clean":"2023-08-09T12:45:46.000803+0000","last_became_active":"2023-08-09T12:45:43.208459+0000","last_became_peered":"2023-08-09T12:45:43.208459+0000","last_unstale":"2023-08-09T12:45:46.000803+0000","last_undegraded":"2023-08-09T12:45:46.000803+0000","last_fullsized":"2023-08-09T12:45:46.000803+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:27:49.863649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952773+0000","last_change":"2023-08-09T12:45:43.213929+0000","last_active":"2023-08-09T12:45:44.952773+0000","last_peered":"2023-08-09T12:45:44.952773+0000","last_clean":"2023-08-09T12:45:44.952773+0000","last_became_active":"2023-08-09T12:45:43.213641+0000","last_became_peered":"2023-08-09T12:45:43.213641+0000","last_unstale":"2023-08-09T12:45:44.952773+0000","last_undegraded":"2023-08-09T12:45:44.952773+0000","last_fullsized":"2023-08-09T12:45:44.952773+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:08:05.887249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187308+0000","last_change":"2023-08-09T12:45:43.212976+0000","last_active":"2023-08-09T12:45:44.187308+0000","last_peered":"2023-08-09T12:45:44.187308+0000","last_clean":"2023-08-09T12:45:44.187308+0000","last_became_active":"2023-08-09T12:45:43.210090+0000","last_became_peered":"2023-08-09T12:45:43.210090+0000","last_unstale":"2023-08-09T12:45:44.187308+0000","last_undegraded":"2023-08-09T12:45:44.187308+0000","last_fullsized":"2023-08-09T12:45:44.187308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:14.105191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188003+0000","last_change":"2023-08-09T12:45:43.220135+0000","last_active":"2023-08-09T12:45:44.188003+0000","last_peered":"2023-08-09T12:45:44.188003+0000","last_clean":"2023-08-09T12:45:44.188003+0000","last_became_active":"2023-08-09T12:45:43.214687+0000","last_became_peered":"2023-08-09T12:45:43.214687+0000","last_unstale":"2023-08-09T12:45:44.188003+0000","last_undegraded":"2023-08-09T12:45:44.188003+0000","last_fullsized":"2023-08-09T12:45:44.188003+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:31.661935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"109'4","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188193+0000","last_change":"2023-08-09T12:45:42.169123+0000","last_active":"2023-08-09T12:45:44.188193+0000","last_peered":"2023-08-09T12:45:44.188193+0000","last_clean":"2023-08-09T12:45:44.188193+0000","last_became_active":"2023-08-09T12:45:42.168705+0000","last_became_peered":"2023-08-09T12:45:42.168705+0000","last_unstale":"2023-08-09T12:45:44.188193+0000","last_undegraded":"2023-08-09T12:45:44.188193+0000","last_fullsized":"2023-08-09T12:45:44.188193+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:48:03.643184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187492+0000","last_change":"2023-08-09T12:45:43.194527+0000","last_active":"2023-08-09T12:45:44.187492+0000","last_peered":"2023-08-09T12:45:44.187492+0000","last_clean":"2023-08-09T12:45:44.187492+0000","last_became_active":"2023-08-09T12:45:43.193850+0000","last_became_peered":"2023-08-09T12:45:43.193850+0000","last_unstale":"2023-08-09T12:45:44.187492+0000","last_undegraded":"2023-08-09T12:45:44.187492+0000","last_fullsized":"2023-08-09T12:45:44.187492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:34:15.244986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001102+0000","last_change":"2023-08-09T12:45:42.171355+0000","last_active":"2023-08-09T12:45:46.001102+0000","last_peered":"2023-08-09T12:45:46.001102+0000","last_clean":"2023-08-09T12:45:46.001102+0000","last_became_active":"2023-08-09T12:45:42.170706+0000","last_became_peered":"2023-08-09T12:45:42.170706+0000","last_unstale":"2023-08-09T12:45:46.001102+0000","last_undegraded":"2023-08-09T12:45:46.001102+0000","last_fullsized":"2023-08-09T12:45:46.001102+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:01:49.192081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184795+0000","last_change":"2023-08-09T12:45:43.210437+0000","last_active":"2023-08-09T12:45:44.184795+0000","last_peered":"2023-08-09T12:45:44.184795+0000","last_clean":"2023-08-09T12:45:44.184795+0000","last_became_active":"2023-08-09T12:45:43.210180+0000","last_became_peered":"2023-08-09T12:45:43.210180+0000","last_unstale":"2023-08-09T12:45:44.184795+0000","last_undegraded":"2023-08-09T12:45:44.184795+0000","last_fullsized":"2023-08-09T12:45:44.184795+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:38:57.395314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185611+0000","last_change":"2023-08-09T12:45:42.174144+0000","last_active":"2023-08-09T12:45:44.185611+0000","last_peered":"2023-08-09T12:45:44.185611+0000","last_clean":"2023-08-09T12:45:44.185611+0000","last_became_active":"2023-08-09T12:45:42.173218+0000","last_became_peered":"2023-08-09T12:45:42.173218+0000","last_unstale":"2023-08-09T12:45:44.185611+0000","last_undegraded":"2023-08-09T12:45:44.185611+0000","last_fullsized":"2023-08-09T12:45:44.185611+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:03:47.707503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186995+0000","last_change":"2023-08-09T12:45:43.207086+0000","last_active":"2023-08-09T12:45:44.186995+0000","last_peered":"2023-08-09T12:45:44.186995+0000","last_clean":"2023-08-09T12:45:44.186995+0000","last_became_active":"2023-08-09T12:45:43.203598+0000","last_became_peered":"2023-08-09T12:45:43.203598+0000","last_unstale":"2023-08-09T12:45:44.186995+0000","last_undegraded":"2023-08-09T12:45:44.186995+0000","last_fullsized":"2023-08-09T12:45:44.186995+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:50.199091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.189225+0000","last_change":"2023-08-09T12:45:42.170662+0000","last_active":"2023-08-09T12:45:44.189225+0000","last_peered":"2023-08-09T12:45:44.189225+0000","last_clean":"2023-08-09T12:45:44.189225+0000","last_became_active":"2023-08-09T12:45:42.170368+0000","last_became_peered":"2023-08-09T12:45:42.170368+0000","last_unstale":"2023-08-09T12:45:44.189225+0000","last_undegraded":"2023-08-09T12:45:44.189225+0000","last_fullsized":"2023-08-09T12:45:44.189225+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:44:49.938587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002114+0000","last_change":"2023-08-09T12:45:43.220102+0000","last_active":"2023-08-09T12:45:46.002114+0000","last_peered":"2023-08-09T12:45:46.002114+0000","last_clean":"2023-08-09T12:45:46.002114+0000","last_became_active":"2023-08-09T12:45:43.218701+0000","last_became_peered":"2023-08-09T12:45:43.218701+0000","last_unstale":"2023-08-09T12:45:46.002114+0000","last_undegraded":"2023-08-09T12:45:46.002114+0000","last_fullsized":"2023-08-09T12:45:46.002114+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:08.765300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000701+0000","last_change":"2023-08-09T12:45:42.158581+0000","last_active":"2023-08-09T12:45:46.000701+0000","last_peered":"2023-08-09T12:45:46.000701+0000","last_clean":"2023-08-09T12:45:46.000701+0000","last_became_active":"2023-08-09T12:45:42.157895+0000","last_became_peered":"2023-08-09T12:45:42.157895+0000","last_unstale":"2023-08-09T12:45:46.000701+0000","last_undegraded":"2023-08-09T12:45:46.000701+0000","last_fullsized":"2023-08-09T12:45:46.000701+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:24.818918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188128+0000","last_change":"2023-08-09T12:45:43.198404+0000","last_active":"2023-08-09T12:45:44.188128+0000","last_peered":"2023-08-09T12:45:44.188128+0000","last_clean":"2023-08-09T12:45:44.188128+0000","last_became_active":"2023-08-09T12:45:43.197701+0000","last_became_peered":"2023-08-09T12:45:43.197701+0000","last_unstale":"2023-08-09T12:45:44.188128+0000","last_undegraded":"2023-08-09T12:45:44.188128+0000","last_fullsized":"2023-08-09T12:45:44.188128+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:45.948508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001280+0000","last_change":"2023-08-09T12:45:42.173485+0000","last_active":"2023-08-09T12:45:46.001280+0000","last_peered":"2023-08-09T12:45:46.001280+0000","last_clean":"2023-08-09T12:45:46.001280+0000","last_became_active":"2023-08-09T12:45:42.173032+0000","last_became_peered":"2023-08-09T12:45:42.173032+0000","last_unstale":"2023-08-09T12:45:46.001280+0000","last_undegraded":"2023-08-09T12:45:46.001280+0000","last_fullsized":"2023-08-09T12:45:46.001280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.080795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187228+0000","last_change":"2023-08-09T12:45:43.214279+0000","last_active":"2023-08-09T12:45:44.187228+0000","last_peered":"2023-08-09T12:45:44.187228+0000","last_clean":"2023-08-09T12:45:44.187228+0000","last_became_active":"2023-08-09T12:45:43.213914+0000","last_became_peered":"2023-08-09T12:45:43.213914+0000","last_unstale":"2023-08-09T12:45:44.187228+0000","last_undegraded":"2023-08-09T12:45:44.187228+0000","last_fullsized":"2023-08-09T12:45:44.187228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:49:27.807542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895349+0000","last_change":"2023-08-09T12:45:42.173695+0000","last_active":"2023-08-09T12:45:45.895349+0000","last_peered":"2023-08-09T12:45:45.895349+0000","last_clean":"2023-08-09T12:45:45.895349+0000","last_became_active":"2023-08-09T12:45:42.173317+0000","last_became_peered":"2023-08-09T12:45:42.173317+0000","last_unstale":"2023-08-09T12:45:45.895349+0000","last_undegraded":"2023-08-09T12:45:45.895349+0000","last_fullsized":"2023-08-09T12:45:45.895349+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:48:14.984377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000702+0000","last_change":"2023-08-09T12:45:43.210681+0000","last_active":"2023-08-09T12:45:46.000702+0000","last_peered":"2023-08-09T12:45:46.000702+0000","last_clean":"2023-08-09T12:45:46.000702+0000","last_became_active":"2023-08-09T12:45:43.209762+0000","last_became_peered":"2023-08-09T12:45:43.209762+0000","last_unstale":"2023-08-09T12:45:46.000702+0000","last_undegraded":"2023-08-09T12:45:46.000702+0000","last_fullsized":"2023-08-09T12:45:46.000702+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:52:34.879127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184932+0000","last_change":"2023-08-09T12:45:42.172728+0000","last_active":"2023-08-09T12:45:44.184932+0000","last_peered":"2023-08-09T12:45:44.184932+0000","last_clean":"2023-08-09T12:45:44.184932+0000","last_became_active":"2023-08-09T12:45:42.172043+0000","last_became_peered":"2023-08-09T12:45:42.172043+0000","last_unstale":"2023-08-09T12:45:44.184932+0000","last_undegraded":"2023-08-09T12:45:44.184932+0000","last_fullsized":"2023-08-09T12:45:44.184932+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:52.936076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000753+0000","last_change":"2023-08-09T12:45:43.210266+0000","last_active":"2023-08-09T12:45:46.000753+0000","last_peered":"2023-08-09T12:45:46.000753+0000","last_clean":"2023-08-09T12:45:46.000753+0000","last_became_active":"2023-08-09T12:45:43.209693+0000","last_became_peered":"2023-08-09T12:45:43.209693+0000","last_unstale":"2023-08-09T12:45:46.000753+0000","last_undegraded":"2023-08-09T12:45:46.000753+0000","last_fullsized":"2023-08-09T12:45:46.000753+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:15:23.490823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953284+0000","last_change":"2023-08-09T12:45:42.170330+0000","last_active":"2023-08-09T12:45:44.953284+0000","last_peered":"2023-08-09T12:45:44.953284+0000","last_clean":"2023-08-09T12:45:44.953284+0000","last_became_active":"2023-08-09T12:45:42.169301+0000","last_became_peered":"2023-08-09T12:45:42.169301+0000","last_unstale":"2023-08-09T12:45:44.953284+0000","last_undegraded":"2023-08-09T12:45:44.953284+0000","last_fullsized":"2023-08-09T12:45:44.953284+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:38:31.692323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185009+0000","last_change":"2023-08-09T12:45:43.202745+0000","last_active":"2023-08-09T12:45:44.185009+0000","last_peered":"2023-08-09T12:45:44.185009+0000","last_clean":"2023-08-09T12:45:44.185009+0000","last_became_active":"2023-08-09T12:45:43.202339+0000","last_became_peered":"2023-08-09T12:45:43.202339+0000","last_unstale":"2023-08-09T12:45:44.185009+0000","last_undegraded":"2023-08-09T12:45:44.185009+0000","last_fullsized":"2023-08-09T12:45:44.185009+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:27:58.721470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.896610+0000","last_change":"2023-08-09T12:45:42.173812+0000","last_active":"2023-08-09T12:45:45.896610+0000","last_peered":"2023-08-09T12:45:45.896610+0000","last_clean":"2023-08-09T12:45:45.896610+0000","last_became_active":"2023-08-09T12:45:42.173417+0000","last_became_peered":"2023-08-09T12:45:42.173417+0000","last_unstale":"2023-08-09T12:45:45.896610+0000","last_undegraded":"2023-08-09T12:45:45.896610+0000","last_fullsized":"2023-08-09T12:45:45.896610+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:01:15.267840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.896301+0000","last_change":"2023-08-09T12:45:43.218302+0000","last_active":"2023-08-09T12:45:45.896301+0000","last_peered":"2023-08-09T12:45:45.896301+0000","last_clean":"2023-08-09T12:45:45.896301+0000","last_became_active":"2023-08-09T12:45:43.217352+0000","last_became_peered":"2023-08-09T12:45:43.217352+0000","last_unstale":"2023-08-09T12:45:45.896301+0000","last_undegraded":"2023-08-09T12:45:45.896301+0000","last_fullsized":"2023-08-09T12:45:45.896301+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:40:03.144027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"109'3","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000365+0000","last_change":"2023-08-09T12:45:42.166679+0000","last_active":"2023-08-09T12:45:46.000365+0000","last_peered":"2023-08-09T12:45:46.000365+0000","last_clean":"2023-08-09T12:45:46.000365+0000","last_became_active":"2023-08-09T12:45:42.166306+0000","last_became_peered":"2023-08-09T12:45:42.166306+0000","last_unstale":"2023-08-09T12:45:46.000365+0000","last_undegraded":"2023-08-09T12:45:46.000365+0000","last_fullsized":"2023-08-09T12:45:46.000365+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:16:29.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001536+0000","last_change":"2023-08-09T12:45:43.217109+0000","last_active":"2023-08-09T12:45:46.001536+0000","last_peered":"2023-08-09T12:45:46.001536+0000","last_clean":"2023-08-09T12:45:46.001536+0000","last_became_active":"2023-08-09T12:45:43.216368+0000","last_became_peered":"2023-08-09T12:45:43.216368+0000","last_unstale":"2023-08-09T12:45:46.001536+0000","last_undegraded":"2023-08-09T12:45:46.001536+0000","last_fullsized":"2023-08-09T12:45:46.001536+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:05:21.390158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"109'6","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187481+0000","last_change":"2023-08-09T12:45:42.169490+0000","last_active":"2023-08-09T12:45:44.187481+0000","last_peered":"2023-08-09T12:45:44.187481+0000","last_clean":"2023-08-09T12:45:44.187481+0000","last_became_active":"2023-08-09T12:45:42.169083+0000","last_became_peered":"2023-08-09T12:45:42.169083+0000","last_unstale":"2023-08-09T12:45:44.187481+0000","last_undegraded":"2023-08-09T12:45:44.187481+0000","last_fullsized":"2023-08-09T12:45:44.187481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:45.655063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002255+0000","last_change":"2023-08-09T12:45:43.213666+0000","last_active":"2023-08-09T12:45:46.002255+0000","last_peered":"2023-08-09T12:45:46.002255+0000","last_clean":"2023-08-09T12:45:46.002255+0000","last_became_active":"2023-08-09T12:45:43.211302+0000","last_became_peered":"2023-08-09T12:45:43.211302+0000","last_unstale":"2023-08-09T12:45:46.002255+0000","last_undegraded":"2023-08-09T12:45:46.002255+0000","last_fullsized":"2023-08-09T12:45:46.002255+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:28:50.991642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185286+0000","last_change":"2023-08-09T12:45:42.173486+0000","last_active":"2023-08-09T12:45:44.185286+0000","last_peered":"2023-08-09T12:45:44.185286+0000","last_clean":"2023-08-09T12:45:44.185286+0000","last_became_active":"2023-08-09T12:45:42.172463+0000","last_became_peered":"2023-08-09T12:45:42.172463+0000","last_unstale":"2023-08-09T12:45:44.185286+0000","last_undegraded":"2023-08-09T12:45:44.185286+0000","last_fullsized":"2023-08-09T12:45:44.185286+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:30.835160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000373+0000","last_change":"2023-08-09T12:45:43.212960+0000","last_active":"2023-08-09T12:45:46.000373+0000","last_peered":"2023-08-09T12:45:46.000373+0000","last_clean":"2023-08-09T12:45:46.000373+0000","last_became_active":"2023-08-09T12:45:43.212578+0000","last_became_peered":"2023-08-09T12:45:43.212578+0000","last_unstale":"2023-08-09T12:45:46.000373+0000","last_undegraded":"2023-08-09T12:45:46.000373+0000","last_fullsized":"2023-08-09T12:45:46.000373+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:08.044178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188072+0000","last_change":"2023-08-09T12:45:42.170960+0000","last_active":"2023-08-09T12:45:44.188072+0000","last_peered":"2023-08-09T12:45:44.188072+0000","last_clean":"2023-08-09T12:45:44.188072+0000","last_became_active":"2023-08-09T12:45:42.170519+0000","last_became_peered":"2023-08-09T12:45:42.170519+0000","last_unstale":"2023-08-09T12:45:44.188072+0000","last_undegraded":"2023-08-09T12:45:44.188072+0000","last_fullsized":"2023-08-09T12:45:44.188072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:08:04.874324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001644+0000","last_change":"2023-08-09T12:45:43.215175+0000","last_active":"2023-08-09T12:45:46.001644+0000","last_peered":"2023-08-09T12:45:46.001644+0000","last_clean":"2023-08-09T12:45:46.001644+0000","last_became_active":"2023-08-09T12:45:43.214824+0000","last_became_peered":"2023-08-09T12:45:43.214824+0000","last_unstale":"2023-08-09T12:45:46.001644+0000","last_undegraded":"2023-08-09T12:45:46.001644+0000","last_fullsized":"2023-08-09T12:45:46.001644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:58:37.997832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000943+0000","last_change":"2023-08-09T12:45:42.170297+0000","last_active":"2023-08-09T12:45:46.000943+0000","last_peered":"2023-08-09T12:45:46.000943+0000","last_clean":"2023-08-09T12:45:46.000943+0000","last_became_active":"2023-08-09T12:45:42.169795+0000","last_became_peered":"2023-08-09T12:45:42.169795+0000","last_unstale":"2023-08-09T12:45:46.000943+0000","last_undegraded":"2023-08-09T12:45:46.000943+0000","last_fullsized":"2023-08-09T12:45:46.000943+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:12:25.996027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001619+0000","last_change":"2023-08-09T12:45:43.206557+0000","last_active":"2023-08-09T12:45:46.001619+0000","last_peered":"2023-08-09T12:45:46.001619+0000","last_clean":"2023-08-09T12:45:46.001619+0000","last_became_active":"2023-08-09T12:45:43.206118+0000","last_became_peered":"2023-08-09T12:45:43.206118+0000","last_unstale":"2023-08-09T12:45:46.001619+0000","last_undegraded":"2023-08-09T12:45:46.001619+0000","last_fullsized":"2023-08-09T12:45:46.001619+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:32:23.544370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"109'8","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001962+0000","last_change":"2023-08-09T12:45:42.170246+0000","last_active":"2023-08-09T12:45:46.001962+0000","last_peered":"2023-08-09T12:45:46.001962+0000","last_clean":"2023-08-09T12:45:46.001962+0000","last_became_active":"2023-08-09T12:45:42.169960+0000","last_became_peered":"2023-08-09T12:45:42.169960+0000","last_unstale":"2023-08-09T12:45:46.001962+0000","last_undegraded":"2023-08-09T12:45:46.001962+0000","last_fullsized":"2023-08-09T12:45:46.001962+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:49:26.573151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188652+0000","last_change":"2023-08-09T12:45:43.195106+0000","last_active":"2023-08-09T12:45:44.188652+0000","last_peered":"2023-08-09T12:45:44.188652+0000","last_clean":"2023-08-09T12:45:44.188652+0000","last_became_active":"2023-08-09T12:45:43.194423+0000","last_became_peered":"2023-08-09T12:45:43.194423+0000","last_unstale":"2023-08-09T12:45:44.188652+0000","last_undegraded":"2023-08-09T12:45:44.188652+0000","last_fullsized":"2023-08-09T12:45:44.188652+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:26:54.191860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.184981+0000","last_change":"2023-08-09T12:45:42.170944+0000","last_active":"2023-08-09T12:45:44.184981+0000","last_peered":"2023-08-09T12:45:44.184981+0000","last_clean":"2023-08-09T12:45:44.184981+0000","last_became_active":"2023-08-09T12:45:42.170658+0000","last_became_peered":"2023-08-09T12:45:42.170658+0000","last_unstale":"2023-08-09T12:45:44.184981+0000","last_undegraded":"2023-08-09T12:45:44.184981+0000","last_fullsized":"2023-08-09T12:45:44.184981+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:04:01.862737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187233+0000","last_change":"2023-08-09T12:45:43.209718+0000","last_active":"2023-08-09T12:45:44.187233+0000","last_peered":"2023-08-09T12:45:44.187233+0000","last_clean":"2023-08-09T12:45:44.187233+0000","last_became_active":"2023-08-09T12:45:43.208102+0000","last_became_peered":"2023-08-09T12:45:43.208102+0000","last_unstale":"2023-08-09T12:45:44.187233+0000","last_undegraded":"2023-08-09T12:45:44.187233+0000","last_fullsized":"2023-08-09T12:45:44.187233+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:50.899939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"110'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000622+0000","last_change":"2023-08-09T12:45:42.173319+0000","last_active":"2023-08-09T12:45:46.000622+0000","last_peered":"2023-08-09T12:45:46.000622+0000","last_clean":"2023-08-09T12:45:46.000622+0000","last_became_active":"2023-08-09T12:45:42.173050+0000","last_became_peered":"2023-08-09T12:45:42.173050+0000","last_unstale":"2023-08-09T12:45:46.000622+0000","last_undegraded":"2023-08-09T12:45:46.000622+0000","last_fullsized":"2023-08-09T12:45:46.000622+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:49:06.602695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187418+0000","last_change":"2023-08-09T12:45:43.207367+0000","last_active":"2023-08-09T12:45:44.187418+0000","last_peered":"2023-08-09T12:45:44.187418+0000","last_clean":"2023-08-09T12:45:44.187418+0000","last_became_active":"2023-08-09T12:45:43.204580+0000","last_became_peered":"2023-08-09T12:45:43.204580+0000","last_unstale":"2023-08-09T12:45:44.187418+0000","last_undegraded":"2023-08-09T12:45:44.187418+0000","last_fullsized":"2023-08-09T12:45:44.187418+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:35:03.227531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001536+0000","last_change":"2023-08-09T12:45:42.174675+0000","last_active":"2023-08-09T12:45:46.001536+0000","last_peered":"2023-08-09T12:45:46.001536+0000","last_clean":"2023-08-09T12:45:46.001536+0000","last_became_active":"2023-08-09T12:45:42.172063+0000","last_became_peered":"2023-08-09T12:45:42.172063+0000","last_unstale":"2023-08-09T12:45:46.001536+0000","last_undegraded":"2023-08-09T12:45:46.001536+0000","last_fullsized":"2023-08-09T12:45:46.001536+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:13:22.991939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952664+0000","last_change":"2023-08-09T12:45:43.214460+0000","last_active":"2023-08-09T12:45:44.952664+0000","last_peered":"2023-08-09T12:45:44.952664+0000","last_clean":"2023-08-09T12:45:44.952664+0000","last_became_active":"2023-08-09T12:45:43.214226+0000","last_became_peered":"2023-08-09T12:45:43.214226+0000","last_unstale":"2023-08-09T12:45:44.952664+0000","last_undegraded":"2023-08-09T12:45:44.952664+0000","last_fullsized":"2023-08-09T12:45:44.952664+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:31.661935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.189006+0000","last_change":"2023-08-09T12:45:42.157166+0000","last_active":"2023-08-09T12:45:44.189006+0000","last_peered":"2023-08-09T12:45:44.189006+0000","last_clean":"2023-08-09T12:45:44.189006+0000","last_became_active":"2023-08-09T12:45:42.156526+0000","last_became_peered":"2023-08-09T12:45:42.156526+0000","last_unstale":"2023-08-09T12:45:44.189006+0000","last_undegraded":"2023-08-09T12:45:44.189006+0000","last_fullsized":"2023-08-09T12:45:44.189006+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:48:14.984377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.999672+0000","last_change":"2023-08-09T12:45:43.196676+0000","last_active":"2023-08-09T12:45:45.999672+0000","last_peered":"2023-08-09T12:45:45.999672+0000","last_clean":"2023-08-09T12:45:45.999672+0000","last_became_active":"2023-08-09T12:45:43.194854+0000","last_became_peered":"2023-08-09T12:45:43.194854+0000","last_unstale":"2023-08-09T12:45:45.999672+0000","last_undegraded":"2023-08-09T12:45:45.999672+0000","last_fullsized":"2023-08-09T12:45:45.999672+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:59:04.340451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188157+0000","last_change":"2023-08-09T12:45:42.168078+0000","last_active":"2023-08-09T12:45:44.188157+0000","last_peered":"2023-08-09T12:45:44.188157+0000","last_clean":"2023-08-09T12:45:44.188157+0000","last_became_active":"2023-08-09T12:45:42.167759+0000","last_became_peered":"2023-08-09T12:45:42.167759+0000","last_unstale":"2023-08-09T12:45:44.188157+0000","last_undegraded":"2023-08-09T12:45:44.188157+0000","last_fullsized":"2023-08-09T12:45:44.188157+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:51.969009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:45.895318+0000","last_change":"2023-08-09T12:45:43.215808+0000","last_active":"2023-08-09T12:45:45.895318+0000","last_peered":"2023-08-09T12:45:45.895318+0000","last_clean":"2023-08-09T12:45:45.895318+0000","last_became_active":"2023-08-09T12:45:43.215274+0000","last_became_peered":"2023-08-09T12:45:43.215274+0000","last_unstale":"2023-08-09T12:45:45.895318+0000","last_undegraded":"2023-08-09T12:45:45.895318+0000","last_fullsized":"2023-08-09T12:45:45.895318+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:56.205594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952835+0000","last_change":"2023-08-09T12:45:42.174892+0000","last_active":"2023-08-09T12:45:44.952835+0000","last_peered":"2023-08-09T12:45:44.952835+0000","last_clean":"2023-08-09T12:45:44.952835+0000","last_became_active":"2023-08-09T12:45:42.172982+0000","last_became_peered":"2023-08-09T12:45:42.172982+0000","last_unstale":"2023-08-09T12:45:44.952835+0000","last_undegraded":"2023-08-09T12:45:44.952835+0000","last_fullsized":"2023-08-09T12:45:44.952835+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:51.969009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188668+0000","last_change":"2023-08-09T12:45:43.213327+0000","last_active":"2023-08-09T12:45:44.188668+0000","last_peered":"2023-08-09T12:45:44.188668+0000","last_clean":"2023-08-09T12:45:44.188668+0000","last_became_active":"2023-08-09T12:45:43.212933+0000","last_became_peered":"2023-08-09T12:45:43.212933+0000","last_unstale":"2023-08-09T12:45:44.188668+0000","last_undegraded":"2023-08-09T12:45:44.188668+0000","last_fullsized":"2023-08-09T12:45:44.188668+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:02:36.619905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188535+0000","last_change":"2023-08-09T12:45:42.161730+0000","last_active":"2023-08-09T12:45:44.188535+0000","last_peered":"2023-08-09T12:45:44.188535+0000","last_clean":"2023-08-09T12:45:44.188535+0000","last_became_active":"2023-08-09T12:45:42.160990+0000","last_became_peered":"2023-08-09T12:45:42.160990+0000","last_unstale":"2023-08-09T12:45:44.188535+0000","last_undegraded":"2023-08-09T12:45:44.188535+0000","last_fullsized":"2023-08-09T12:45:44.188535+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:19:20.492510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187917+0000","last_change":"2023-08-09T12:45:43.219911+0000","last_active":"2023-08-09T12:45:44.187917+0000","last_peered":"2023-08-09T12:45:44.187917+0000","last_clean":"2023-08-09T12:45:44.187917+0000","last_became_active":"2023-08-09T12:45:43.214021+0000","last_became_peered":"2023-08-09T12:45:43.214021+0000","last_unstale":"2023-08-09T12:45:44.187917+0000","last_undegraded":"2023-08-09T12:45:44.187917+0000","last_fullsized":"2023-08-09T12:45:44.187917+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:07.660676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185143+0000","last_change":"2023-08-09T12:45:42.175573+0000","last_active":"2023-08-09T12:45:44.185143+0000","last_peered":"2023-08-09T12:45:44.185143+0000","last_clean":"2023-08-09T12:45:44.185143+0000","last_became_active":"2023-08-09T12:45:42.174408+0000","last_became_peered":"2023-08-09T12:45:42.174408+0000","last_unstale":"2023-08-09T12:45:44.185143+0000","last_undegraded":"2023-08-09T12:45:44.185143+0000","last_fullsized":"2023-08-09T12:45:44.185143+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:38:46.623512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186407+0000","last_change":"2023-08-09T12:45:43.207398+0000","last_active":"2023-08-09T12:45:44.186407+0000","last_peered":"2023-08-09T12:45:44.186407+0000","last_clean":"2023-08-09T12:45:44.186407+0000","last_became_active":"2023-08-09T12:45:43.206744+0000","last_became_peered":"2023-08-09T12:45:43.206744+0000","last_unstale":"2023-08-09T12:45:44.186407+0000","last_undegraded":"2023-08-09T12:45:44.186407+0000","last_fullsized":"2023-08-09T12:45:44.186407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:20:44.444578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001499+0000","last_change":"2023-08-09T12:45:42.173336+0000","last_active":"2023-08-09T12:45:46.001499+0000","last_peered":"2023-08-09T12:45:46.001499+0000","last_clean":"2023-08-09T12:45:46.001499+0000","last_became_active":"2023-08-09T12:45:42.173027+0000","last_became_peered":"2023-08-09T12:45:42.173027+0000","last_unstale":"2023-08-09T12:45:46.001499+0000","last_undegraded":"2023-08-09T12:45:46.001499+0000","last_fullsized":"2023-08-09T12:45:46.001499+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:52.986927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":342,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186716+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:45:44.186716+0000","last_peered":"2023-08-09T12:45:44.186716+0000","last_clean":"2023-08-09T12:45:44.186716+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:45:44.186716+0000","last_undegraded":"2023-08-09T12:45:44.186716+0000","last_fullsized":"2023-08-09T12:45:44.186716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:54.045524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953548+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:45:44.953548+0000","last_peered":"2023-08-09T12:45:44.953548+0000","last_clean":"2023-08-09T12:45:44.953548+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:45:44.953548+0000","last_undegraded":"2023-08-09T12:45:44.953548+0000","last_fullsized":"2023-08-09T12:45:44.953548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:51:30.689030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187486+0000","last_change":"2023-08-09T12:45:43.213774+0000","last_active":"2023-08-09T12:45:44.187486+0000","last_peered":"2023-08-09T12:45:44.187486+0000","last_clean":"2023-08-09T12:45:44.187486+0000","last_became_active":"2023-08-09T12:45:43.213507+0000","last_became_peered":"2023-08-09T12:45:43.213507+0000","last_unstale":"2023-08-09T12:45:44.187486+0000","last_undegraded":"2023-08-09T12:45:44.187486+0000","last_fullsized":"2023-08-09T12:45:44.187486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:18:30.758379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188477+0000","last_change":"2023-08-09T12:45:42.170733+0000","last_active":"2023-08-09T12:45:44.188477+0000","last_peered":"2023-08-09T12:45:44.188477+0000","last_clean":"2023-08-09T12:45:44.188477+0000","last_became_active":"2023-08-09T12:45:42.170416+0000","last_became_peered":"2023-08-09T12:45:42.170416+0000","last_unstale":"2023-08-09T12:45:44.188477+0000","last_undegraded":"2023-08-09T12:45:44.188477+0000","last_fullsized":"2023-08-09T12:45:44.188477+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:52:06.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.186070+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:45:44.186070+0000","last_peered":"2023-08-09T12:45:44.186070+0000","last_clean":"2023-08-09T12:45:44.186070+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:45:44.186070+0000","last_undegraded":"2023-08-09T12:45:44.186070+0000","last_fullsized":"2023-08-09T12:45:44.186070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:54:52.511168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.188891+0000","last_change":"2023-08-09T12:45:43.208244+0000","last_active":"2023-08-09T12:45:44.188891+0000","last_peered":"2023-08-09T12:45:44.188891+0000","last_clean":"2023-08-09T12:45:44.188891+0000","last_became_active":"2023-08-09T12:45:43.207810+0000","last_became_peered":"2023-08-09T12:45:43.207810+0000","last_unstale":"2023-08-09T12:45:44.188891+0000","last_undegraded":"2023-08-09T12:45:44.188891+0000","last_fullsized":"2023-08-09T12:45:44.188891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:56.205594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185798+0000","last_change":"2023-08-09T12:45:42.175558+0000","last_active":"2023-08-09T12:45:44.185798+0000","last_peered":"2023-08-09T12:45:44.185798+0000","last_clean":"2023-08-09T12:45:44.185798+0000","last_became_active":"2023-08-09T12:45:42.175254+0000","last_became_peered":"2023-08-09T12:45:42.175254+0000","last_unstale":"2023-08-09T12:45:44.185798+0000","last_undegraded":"2023-08-09T12:45:44.185798+0000","last_fullsized":"2023-08-09T12:45:44.185798+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:16:58.168568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000549+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:45:46.000549+0000","last_peered":"2023-08-09T12:45:46.000549+0000","last_clean":"2023-08-09T12:45:46.000549+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:45:46.000549+0000","last_undegraded":"2023-08-09T12:45:46.000549+0000","last_fullsized":"2023-08-09T12:45:46.000549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:02.769714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001136+0000","last_change":"2023-08-09T12:45:43.211905+0000","last_active":"2023-08-09T12:45:46.001136+0000","last_peered":"2023-08-09T12:45:46.001136+0000","last_clean":"2023-08-09T12:45:46.001136+0000","last_became_active":"2023-08-09T12:45:43.211641+0000","last_became_peered":"2023-08-09T12:45:43.211641+0000","last_unstale":"2023-08-09T12:45:46.001136+0000","last_undegraded":"2023-08-09T12:45:46.001136+0000","last_fullsized":"2023-08-09T12:45:46.001136+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:48:26.931509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001774+0000","last_change":"2023-08-09T12:45:42.176363+0000","last_active":"2023-08-09T12:45:46.001774+0000","last_peered":"2023-08-09T12:45:46.001774+0000","last_clean":"2023-08-09T12:45:46.001774+0000","last_became_active":"2023-08-09T12:45:42.174611+0000","last_became_peered":"2023-08-09T12:45:42.174611+0000","last_unstale":"2023-08-09T12:45:46.001774+0000","last_undegraded":"2023-08-09T12:45:46.001774+0000","last_fullsized":"2023-08-09T12:45:46.001774+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:44.610451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953003+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:45:44.953003+0000","last_peered":"2023-08-09T12:45:44.953003+0000","last_clean":"2023-08-09T12:45:44.953003+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:45:44.953003+0000","last_undegraded":"2023-08-09T12:45:44.953003+0000","last_fullsized":"2023-08-09T12:45:44.953003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:13.915329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187601+0000","last_change":"2023-08-09T12:45:43.220645+0000","last_active":"2023-08-09T12:45:44.187601+0000","last_peered":"2023-08-09T12:45:44.187601+0000","last_clean":"2023-08-09T12:45:44.187601+0000","last_became_active":"2023-08-09T12:45:43.219540+0000","last_became_peered":"2023-08-09T12:45:43.219540+0000","last_unstale":"2023-08-09T12:45:44.187601+0000","last_undegraded":"2023-08-09T12:45:44.187601+0000","last_fullsized":"2023-08-09T12:45:44.187601+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:25.671887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952601+0000","last_change":"2023-08-09T12:45:42.172661+0000","last_active":"2023-08-09T12:45:44.952601+0000","last_peered":"2023-08-09T12:45:44.952601+0000","last_clean":"2023-08-09T12:45:44.952601+0000","last_became_active":"2023-08-09T12:45:42.172329+0000","last_became_peered":"2023-08-09T12:45:42.172329+0000","last_unstale":"2023-08-09T12:45:44.952601+0000","last_undegraded":"2023-08-09T12:45:44.952601+0000","last_fullsized":"2023-08-09T12:45:44.952601+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:06.647752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002339+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:45:46.002339+0000","last_peered":"2023-08-09T12:45:46.002339+0000","last_clean":"2023-08-09T12:45:46.002339+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:45:46.002339+0000","last_undegraded":"2023-08-09T12:45:46.002339+0000","last_fullsized":"2023-08-09T12:45:46.002339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:04.608129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953271+0000","last_change":"2023-08-09T12:45:43.216055+0000","last_active":"2023-08-09T12:45:44.953271+0000","last_peered":"2023-08-09T12:45:44.953271+0000","last_clean":"2023-08-09T12:45:44.953271+0000","last_became_active":"2023-08-09T12:45:43.215827+0000","last_became_peered":"2023-08-09T12:45:43.215827+0000","last_unstale":"2023-08-09T12:45:44.953271+0000","last_undegraded":"2023-08-09T12:45:44.953271+0000","last_fullsized":"2023-08-09T12:45:44.953271+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:38:35.446299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.000004+0000","last_change":"2023-08-09T12:45:42.169273+0000","last_active":"2023-08-09T12:45:46.000004+0000","last_peered":"2023-08-09T12:45:46.000004+0000","last_clean":"2023-08-09T12:45:46.000004+0000","last_became_active":"2023-08-09T12:45:42.168542+0000","last_became_peered":"2023-08-09T12:45:42.168542+0000","last_unstale":"2023-08-09T12:45:46.000004+0000","last_undegraded":"2023-08-09T12:45:46.000004+0000","last_fullsized":"2023-08-09T12:45:46.000004+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:14.849952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.185609+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:45:44.185609+0000","last_peered":"2023-08-09T12:45:44.185609+0000","last_clean":"2023-08-09T12:45:44.185609+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:45:44.185609+0000","last_undegraded":"2023-08-09T12:45:44.185609+0000","last_fullsized":"2023-08-09T12:45:44.185609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:10.946592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.952486+0000","last_change":"2023-08-09T12:45:43.213181+0000","last_active":"2023-08-09T12:45:44.952486+0000","last_peered":"2023-08-09T12:45:44.952486+0000","last_clean":"2023-08-09T12:45:44.952486+0000","last_became_active":"2023-08-09T12:45:43.212879+0000","last_became_peered":"2023-08-09T12:45:43.212879+0000","last_unstale":"2023-08-09T12:45:44.952486+0000","last_undegraded":"2023-08-09T12:45:44.952486+0000","last_fullsized":"2023-08-09T12:45:44.952486+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:33:26.728442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.953553+0000","last_change":"2023-08-09T12:45:42.174137+0000","last_active":"2023-08-09T12:45:44.953553+0000","last_peered":"2023-08-09T12:45:44.953553+0000","last_clean":"2023-08-09T12:45:44.953553+0000","last_became_active":"2023-08-09T12:45:42.173831+0000","last_became_peered":"2023-08-09T12:45:42.173831+0000","last_unstale":"2023-08-09T12:45:44.953553+0000","last_undegraded":"2023-08-09T12:45:44.953553+0000","last_fullsized":"2023-08-09T12:45:44.953553+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:26:58.838314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.002426+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:45:46.002426+0000","last_peered":"2023-08-09T12:45:46.002426+0000","last_clean":"2023-08-09T12:45:46.002426+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:45:46.002426+0000","last_undegraded":"2023-08-09T12:45:46.002426+0000","last_fullsized":"2023-08-09T12:45:46.002426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:25.902601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.187606+0000","last_change":"2023-08-09T12:45:43.207564+0000","last_active":"2023-08-09T12:45:44.187606+0000","last_peered":"2023-08-09T12:45:44.187606+0000","last_clean":"2023-08-09T12:45:44.187606+0000","last_became_active":"2023-08-09T12:45:43.206550+0000","last_became_peered":"2023-08-09T12:45:43.206550+0000","last_unstale":"2023-08-09T12:45:44.187606+0000","last_undegraded":"2023-08-09T12:45:44.187606+0000","last_fullsized":"2023-08-09T12:45:44.187606+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:42.136592+0000","last_clean_scrub_stamp":"2023-08-09T12:45:42.136592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:37.720656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:46.001968+0000","last_change":"2023-08-09T12:45:42.168543+0000","last_active":"2023-08-09T12:45:46.001968+0000","last_peered":"2023-08-09T12:45:46.001968+0000","last_clean":"2023-08-09T12:45:46.001968+0000","last_became_active":"2023-08-09T12:45:42.168289+0000","last_became_peered":"2023-08-09T12:45:42.168289+0000","last_unstale":"2023-08-09T12:45:46.001968+0000","last_undegraded":"2023-08-09T12:45:46.001968+0000","last_fullsized":"2023-08-09T12:45:46.001968+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:45:41.123668+0000","last_clean_scrub_stamp":"2023-08-09T12:45:41.123668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:47:37.731380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-09T12:45:44.189249+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:45:44.189249+0000","last_peered":"2023-08-09T12:45:44.189249+0000","last_clean":"2023-08-09T12:45:44.189249+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:45:44.189249+0000","last_undegraded":"2023-08-09T12:45:44.189249+0000","last_fullsized":"2023-08-09T12:45:44.189249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:04:08.773192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194113,"statfs":{"total":200000000,"available":198772147,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.137,"15min":1.107},"min":{"1min":0.627,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.542,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.0860000000000001},"min":{"1min":0.89700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7769999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.339}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.21,"15min":1.1160000000000001},"min":{"1min":0.748,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1990000000000001,"15min":1.117},"min":{"1min":0.79100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5600000000000001,"5min":1.734,"15min":1.734},"last":1.0049999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.302,"15min":1.1819999999999999},"min":{"1min":0.69999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.96,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.216},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.1539999999999999},"min":{"1min":0.746,"5min":0.73399999999999999,"15min":0.69799999999999995},"max":{"1min":1.7070000000000001,"5min":2.173,"15min":2.173},"last":1.5149999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3180000000000001,"15min":1.244},"min":{"1min":0.83299999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.732,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.353,"15min":1.2769999999999999},"min":{"1min":0.92600000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.843,"5min":2.282,"15min":2.282},"last":1.4259999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2330000000000001,"15min":1.202},"min":{"1min":0.81100000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6179999999999999,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":1.139},{"interface":"front","average":{"1min":1.341,"5min":1.3959999999999999,"15min":1.288},"min":{"1min":0.93700000000000006,"5min":0.67900000000000005,"15min":0.58599999999999997},"max":{"1min":2.0630000000000002,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.6699999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.427,"15min":1.3069999999999999},"min":{"1min":0.90200000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1699999999999999,"5min":2.802,"15min":2.802},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.587,"5min":1.516,"15min":1.4870000000000001},"min":{"1min":1.214,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.7799999999999998,"5min":3.1400000000000001,"15min":3.3580000000000001},"last":1.6220000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.4850000000000001,"15min":1.4690000000000001},"min":{"1min":1.0740000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.8849999999999998,"5min":3.266,"15min":3.4910000000000001},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.492,"15min":1.4490000000000001},"min":{"1min":1.161,"5min":0.83699999999999997,"15min":0.623},"max":{"1min":2.3580000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.5589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":624,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199360355,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1899999999999999,"15min":1.1299999999999999},"min":{"1min":0.79400000000000004,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7929999999999999,"5min":2.54,"15min":2.54},"last":1.375},{"interface":"front","average":{"1min":1.139,"5min":1.127,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5469999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.071}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.266,"15min":1.234},"min":{"1min":0.86299999999999999,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.7250000000000001,"5min":2.0009999999999999,"15min":2.306},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.3720000000000001,"15min":1.3260000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.613,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.3009999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1659999999999999,"15min":1.1060000000000001},"min":{"1min":0.70199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5629999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.429},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3089999999999999,"15min":1.2749999999999999},"min":{"1min":0.93700000000000006,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.857,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.997}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.363,"15min":1.2809999999999999},"min":{"1min":0.93600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.673,"5min":2.327,"15min":2.327},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.359,"15min":1.296},"min":{"1min":1.0589999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.6819999999999999,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.589}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4650000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.0139999999999998,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.403,"15min":1.3420000000000001},"min":{"1min":0.90800000000000003,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.766,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.407,"15min":1.335},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.77600000000000002},"max":{"1min":1.8440000000000001,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.534},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.577,"15min":1.4890000000000001},"min":{"1min":1.2110000000000001,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":2.222,"5min":2.7160000000000002,"15min":2.8580000000000001},"last":1.4790000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.597,"15min":1.4390000000000001},"min":{"1min":1.0820000000000001,"5min":1.0009999999999999,"15min":0.752},"max":{"1min":1.954,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":1.446},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.9690000000000001,"5min":3.621,"15min":3.621},"last":1.6399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194690,"statfs":{"total":200000000,"available":199362571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.131,"15min":1.117},"min":{"1min":0.77300000000000002,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.427},"last":0.875},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.208,"15min":1.0880000000000001},"min":{"1min":0.81999999999999995,"5min":0.71699999999999997,"15min":0.625},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.649}]},{"osd":1,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.3600000000000001,"15min":1.2989999999999999},"min":{"1min":1.0369999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.387},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.29,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.982,"5min":1.984,"15min":1.984},"last":1.131}]},{"osd":2,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.236,"15min":1.21},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.25},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.2190000000000001,"15min":1.198},"min":{"1min":0.81399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.1819999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3169999999999999,"15min":1.2150000000000001},"min":{"1min":0.96499999999999997,"5min":0.78000000000000003,"15min":0.77100000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.383,"15min":1.381},"min":{"1min":1.1539999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.0369999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.266,"15min":1.2370000000000001},"min":{"1min":0.88400000000000001,"5min":0.621,"15min":0.60699999999999998},"max":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":1.099},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.96899999999999997,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.5089999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3799999999999999,"15min":1.3420000000000001},"min":{"1min":1.0289999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.429,"15min":1.49},"min":{"1min":1.194,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.4239999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:45:20 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.5069999999999999,"15min":1.5229999999999999},"min":{"1min":1.2010000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.722,"5min":2.722,"15min":3.3250000000000002},"last":1.593},{"interface":"front","average":{"1min":1.72,"5min":1.5629999999999999,"15min":1.522},"min":{"1min":1.452,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.4710000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199362411,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.141,"15min":1.087},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5529999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.107},{"interface":"front","average":{"1min":1.093,"5min":1.165,"15min":1.101},"min":{"1min":0.83599999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4279999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.325}]},{"osd":1,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.3320000000000001},"min":{"1min":0.83999999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7589999999999999,"5min":1.897,"15min":1.97},"last":2.3679999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3009999999999999,"15min":1.329},"min":{"1min":0.92100000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.804,"5min":2.2040000000000002,"15min":2.7770000000000001},"last":1.248}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3029999999999999,"15min":1.3169999999999999},"min":{"1min":0.81599999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":2.4729999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.3200000000000001,"15min":1.3109999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6539999999999999,"5min":1.929,"15min":1.929},"last":1.6220000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.28,"15min":1.228},"min":{"1min":0.82999999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.623,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.3009999999999999,"15min":1.3280000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":1.665,"5min":2.081,"15min":2.081},"last":2.5289999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3029999999999999,"15min":1.377},"min":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.615,"5min":1.853,"15min":1.9490000000000001},"last":1.768},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3899999999999999,"15min":1.385},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.665,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.9750000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.397,"15min":1.4850000000000001},"min":{"1min":0.76000000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.784,"5min":2.238,"15min":2.238},"last":2.5819999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.756,"5min":2.036,"15min":2.036},"last":1.859}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.542,"15min":1.5249999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8089999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":2.0859999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.552,"15min":1.619},"min":{"1min":0.89400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.9299999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":2.875}]}]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194690,"statfs":{"total":200000000,"available":199362571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.90400000000000003,"15min":0.83999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.3480000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.103},{"interface":"front","average":{"1min":1.143,"5min":1.0549999999999999,"15min":0.91900000000000004},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":2.778,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.7170000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.91100000000000003,"15min":0.90600000000000003},"min":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.27,"5min":1.1399999999999999,"15min":0.94599999999999995},"min":{"1min":0.622,"5min":0.52000000000000002,"15min":0.373},"max":{"1min":2.0219999999999998,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.466}]},{"osd":2,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.3360000000000001,"15min":1.119},"min":{"1min":0.59399999999999997,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":1.75,"5min":18.145,"15min":18.145},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.2290000000000001,"15min":1.2090000000000001},"min":{"1min":0.66500000000000004,"5min":0.48999999999999999,"15min":0.41799999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.5620000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.323,"15min":1.331},"min":{"1min":0.98099999999999998,"5min":0.84399999999999997,"15min":0.745},"max":{"1min":1.712,"5min":2.972,"15min":3.5110000000000001},"last":1.236},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.325,"15min":1.341},"min":{"1min":0.98999999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.712,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.4099999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.5760000000000001,"15min":1.444},"min":{"1min":1.099,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7210000000000001,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.288},{"interface":"front","average":{"1min":1.55,"5min":1.595,"15min":1.361},"min":{"1min":1.0249999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.2959999999999998,"5min":14.105,"15min":14.105},"last":1.6499999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.401,"15min":1.3500000000000001},"min":{"1min":1.091,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8999999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.4690000000000001,"15min":1.4810000000000001},"min":{"1min":0.93700000000000006,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8839999999999999,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.593}]},{"osd":7,"last update":"Wed Aug 9 12:45:33 2023","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.4790000000000001,"15min":1.407},"min":{"1min":0.98599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.756},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.458,"15min":1.389},"min":{"1min":1.022,"5min":0.85699999999999998,"15min":0.70799999999999996},"max":{"1min":1.8180000000000001,"5min":3.016,"15min":3.016},"last":1.792}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194690,"statfs":{"total":200000000,"available":199362571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56799999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.716},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.107,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.38900000000000001},"max":{"1min":1.73,"5min":1.73,"15min":2.9009999999999998},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.95399999999999996,"15min":0.93100000000000005},"min":{"1min":0.63700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4219999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.264,"5min":1.079,"15min":1.069},"min":{"1min":0.66700000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.823,"5min":1.823,"15min":1.869},"last":0.57999999999999996}]},{"osd":3,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1719999999999999,"15min":1.1739999999999999},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.681,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.395,"5min":1.2050000000000001,"15min":1.1639999999999999},"min":{"1min":0.77300000000000002,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":2.0289999999999999,"5min":2.242,"15min":2.9409999999999998},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.4770000000000001,"15min":1.429},"min":{"1min":1.1539999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.7450000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":1.369},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.3799999999999999,"15min":1.288},"min":{"1min":0.97999999999999998,"5min":0.83199999999999996,"15min":0.66800000000000004},"max":{"1min":2.6509999999999998,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.3260000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.446,"15min":1.3680000000000001},"min":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.3210000000000002,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":1.177},{"interface":"front","average":{"1min":1.673,"5min":1.512,"15min":1.4910000000000001},"min":{"1min":1.034,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4780000000000002,"5min":4.806,"15min":4.806},"last":1.2909999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.399,"15min":1.321},"min":{"1min":0.82799999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.4790000000000001,"15min":1.431},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.7309999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.006}]},{"osd":7,"last update":"Wed Aug 9 12:45:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.4430000000000001,"15min":1.3779999999999999},"min":{"1min":0.89500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.206},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.579,"15min":1.542},"min":{"1min":0.995,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.6549999999999998,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.256}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":38,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199362501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.53000000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.609,"5min":1.881,"15min":1.881},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.2070000000000001,"5min":2.0529999999999999,"15min":1.2549999999999999},"min":{"1min":0.66400000000000003,"5min":0.47799999999999998,"15min":0.34300000000000003},"max":{"1min":1.863,"5min":88.254999999999995,"15min":88.254999999999995},"last":1.0049999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0469999999999999,"15min":0.95499999999999996},"min":{"1min":0.67400000000000004,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.476,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.878},{"interface":"front","average":{"1min":1.337,"5min":1.306,"15min":1.147},"min":{"1min":0.91900000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.044,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.407}]},{"osd":3,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1950000000000001,"15min":1.099},"min":{"1min":0.71999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.724,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.1779999999999999,"15min":0.97599999999999998},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.5740000000000001,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.202}]},{"osd":4,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.55,"15min":1.2909999999999999},"min":{"1min":0.95999999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.5289999999999999,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.179},{"interface":"front","average":{"1min":1.351,"5min":1.3819999999999999,"15min":1.302},"min":{"1min":0.94499999999999995,"5min":0.88500000000000001,"15min":0.84599999999999997},"max":{"1min":2.1589999999999998,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.5}]},{"osd":5,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.669,"15min":1.399},"min":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8420000000000001,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.296},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3799999999999999,"15min":1.2849999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9059999999999999,"5min":3.762,"15min":3.762},"last":1.2589999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.5449999999999999,"15min":1.431},"min":{"1min":0.91000000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.827,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.373},{"interface":"front","average":{"1min":1.474,"5min":1.482,"15min":1.3839999999999999},"min":{"1min":1.0600000000000001,"5min":0.873,"15min":0.79500000000000004},"max":{"1min":1.7949999999999999,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.5349999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:45:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.8680000000000001,"15min":1.5880000000000001},"min":{"1min":1.2829999999999999,"5min":0.96899999999999997,"15min":0.88800000000000001},"max":{"1min":2.5089999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.798},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.8759999999999999,"15min":1.5680000000000001},"min":{"1min":1.1379999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":1.7949999999999999,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.6160000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194111,"statfs":{"total":200000000,"available":198769885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.64500000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":1.389,"5min":1.819,"15min":1.819},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1040000000000001,"15min":0.96499999999999997},"min":{"1min":0.79200000000000004,"5min":0.53300000000000003,"15min":0.436},"max":{"1min":1.6160000000000001,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":1.091}]},{"osd":2,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.038,"15min":0.96599999999999997},"min":{"1min":0.68899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.159,"15min":1.0369999999999999},"min":{"1min":0.80100000000000005,"5min":0.57999999999999996,"15min":0.5},"max":{"1min":1.732,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":1.2210000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.089,"15min":0.94699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.413,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.601},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.218,"15min":1.1830000000000001},"min":{"1min":0.72899999999999998,"5min":0.58199999999999996,"15min":0.56000000000000005},"max":{"1min":1.6950000000000001,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":1.1699999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3779999999999999,"15min":1.3340000000000001},"min":{"1min":0.81599999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8240000000000001,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.8},{"interface":"front","average":{"1min":1.419,"5min":1.3640000000000001,"15min":1.29},"min":{"1min":1.0289999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.286}]},{"osd":5,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4119999999999999,"15min":1.3129999999999999},"min":{"1min":0.91900000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.891,"5min":10.004,"15min":10.004},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.4330000000000001,"15min":1.3859999999999999},"min":{"1min":0.97799999999999998,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":1.8069999999999999,"5min":1.909,"15min":2.161},"last":1.474}]},{"osd":6,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4550000000000001,"15min":1.3480000000000001},"min":{"1min":1.1399999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9370000000000001,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.353},{"interface":"front","average":{"1min":1.518,"5min":1.532,"15min":1.4350000000000001},"min":{"1min":1.0609999999999999,"5min":0.90100000000000002,"15min":0.86799999999999999},"max":{"1min":2.0099999999999998,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.397}]},{"osd":7,"last update":"Wed Aug 9 12:45:21 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.609,"15min":1.4390000000000001},"min":{"1min":1.202,"5min":0.80400000000000005,"15min":0.79200000000000004},"max":{"1min":1.8360000000000001,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.627,"5min":1.589,"15min":1.4710000000000001},"min":{"1min":1.1180000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.1120000000000001,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.75}]}]}],"pool_statfs":[]}} 2023-08-09T12:45:53.334 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:45:53.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:45:53.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.609+0000 7fb77da21640 1 Processor -- start 2023-08-09T12:45:53.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.609+0000 7fb77da21640 1 -- start start 2023-08-09T12:45:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.611+0000 7fb77da21640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb77815caf0 0x7fb7780703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.611+0000 7fb77da21640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780d0f00 con 0x7fb7780d2530 2023-08-09T12:45:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.611+0000 7fb77da21640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780d11e0 con 0x7fb7780708e0 2023-08-09T12:45:53.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.611+0000 7fb77da21640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780d1a80 con 0x7fb77815caf0 2023-08-09T12:45:53.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.611+0000 7fb77ca1f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb77815caf0 0x7fb7780703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.611+0000 7fb77d220640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb7780d2530 0x7fb7780b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56132/0 (socket says 172.21.15.17:56132) 2023-08-09T12:45:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.611+0000 7fb77ca1f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb77815caf0 0x7fb7780703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45382/0 (socket says 172.21.15.17:45382) 2023-08-09T12:45:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.611+0000 7fb77d220640 1 -- 172.21.15.17:0/1471867067 learned_addr learned my addr 172.21.15.17:0/1471867067 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.612+0000 7fb77ca1f640 1 -- 172.21.15.17:0/1471867067 >> v1:172.21.15.142:6789/0 conn(0x7fb7780708e0 legacy=0x7fb7780d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.612+0000 7fb77ca1f640 1 -- 172.21.15.17:0/1471867067 >> v1:172.21.15.17:6789/0 conn(0x7fb7780d2530 legacy=0x7fb7780b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.612+0000 7fb77ca1f640 1 -- 172.21.15.17:0/1471867067 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780d14c0 con 0x7fb77815caf0 2023-08-09T12:45:53.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.613+0000 7fb77ca1f640 1 --2- 172.21.15.17:0/1471867067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77815caf0 0x7fb7780703a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb774009d90 tx=0x7fb77402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c7455b92199ae0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:53.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.613+0000 7fb76f7fe640 1 -- 172.21.15.17:0/1471867067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77402cc60 con 0x7fb77815caf0 2023-08-09T12:45:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.613+0000 7fb76f7fe640 1 -- 172.21.15.17:0/1471867067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77402cdc0 con 0x7fb77815caf0 2023-08-09T12:45:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.613+0000 7fb76f7fe640 1 -- 172.21.15.17:0/1471867067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774034660 con 0x7fb77815caf0 2023-08-09T12:45:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.614+0000 7fb77da21640 1 -- 172.21.15.17:0/1471867067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77815caf0 msgr2=0x7fb7780703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.614+0000 7fb77da21640 1 --2- 172.21.15.17:0/1471867067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77815caf0 0x7fb7780703a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb774009d90 tx=0x7fb77402beb0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.614+0000 7fb77da21640 1 -- 172.21.15.17:0/1471867067 shutdown_connections 2023-08-09T12:45:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.614+0000 7fb77da21640 1 --2- 172.21.15.17:0/1471867067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77815caf0 0x7fb7780703a0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.614+0000 7fb77da21640 1 -- 172.21.15.17:0/1471867067 >> 172.21.15.17:0/1471867067 conn(0x7fb7780cf6b0 msgr2=0x7fb7780cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:53.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.614+0000 7fb77da21640 1 -- 172.21.15.17:0/1471867067 shutdown_connections 2023-08-09T12:45:53.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.614+0000 7fb77da21640 1 -- 172.21.15.17:0/1471867067 wait complete. 2023-08-09T12:45:53.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.616+0000 7fb77da21640 1 Processor -- start 2023-08-09T12:45:53.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.616+0000 7fb77da21640 1 -- start start 2023-08-09T12:45:53.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77da21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7780d2530 0x7fb7781f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77da21640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77815caf0 0x7fb778151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77da21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb778153390 0x7fb77815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77da21640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778154460 con 0x7fb7780d2530 2023-08-09T12:45:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77da21640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7781f66a0 con 0x7fb778153390 2023-08-09T12:45:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77da21640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb778152620 con 0x7fb77815caf0 2023-08-09T12:45:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77ca1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7780d2530 0x7fb7781f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77ca1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7780d2530 0x7fb7781f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45390/0 (socket says 172.21.15.17:45390) 2023-08-09T12:45:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77ca1f640 1 -- 172.21.15.17:0/1836445619 learned_addr learned my addr 172.21.15.17:0/1836445619 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77ca1f640 1 -- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77815caf0 msgr2=0x7fb778151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77ca1f640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77815caf0 0x7fb778151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77ca1f640 1 -- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb778153390 msgr2=0x7fb77815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77ca1f640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb778153390 0x7fb77815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.617+0000 7fb77ca1f640 1 -- 172.21.15.17:0/1836445619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009a70 con 0x7fb7780d2530 2023-08-09T12:45:53.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.618+0000 7fb77ca1f640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7780d2530 0x7fb7781f6160 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb774037040 tx=0x7fb774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:53.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.618+0000 7fb76d7fa640 1 -- 172.21.15.17:0/1836445619 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77403e610 con 0x7fb7780d2530 2023-08-09T12:45:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.618+0000 7fb76d7fa640 1 -- 172.21.15.17:0/1836445619 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77403e770 con 0x7fb7780d2530 2023-08-09T12:45:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.618+0000 7fb76d7fa640 1 -- 172.21.15.17:0/1836445619 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77403eb20 con 0x7fb7780d2530 2023-08-09T12:45:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.618+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb778153850 con 0x7fb7780d2530 2023-08-09T12:45:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.618+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb778153e10 con 0x7fb7780d2530 2023-08-09T12:45:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.619+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77804e390 con 0x7fb7780d2530 2023-08-09T12:45:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.621+0000 7fb76d7fa640 1 -- 172.21.15.17:0/1836445619 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb77403b050 con 0x7fb7780d2530 2023-08-09T12:45:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.622+0000 7fb76d7fa640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb76406a050 0x7fb76406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.622+0000 7fb76d7fa640 1 -- 172.21.15.17:0/1836445619 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7740ab190 con 0x7fb7780d2530 2023-08-09T12:45:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.622+0000 7fb76ffff640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb76406a050 0x7fb76406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:53.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.623+0000 7fb76ffff640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb76406a050 0x7fb76406c510 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb778160390 tx=0x7fb7680079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.626+0000 7fb76d7fa640 1 -- 172.21.15.17:0/1836445619 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb7740769a0 con 0x7fb7780d2530 2023-08-09T12:45:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.891+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb7780ce9d0 con 0x7fb7780d2530 2023-08-09T12:45:53.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.897+0000 7fb76d7fa640 1 -- 172.21.15.17:0/1836445619 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb774079fc0 con 0x7fb7780d2530 2023-08-09T12:45:53.901 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:45:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:45:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:45:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:45:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:45:53.902 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:45:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb76406a050 msgr2=0x7fb76406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb76406a050 0x7fb76406c510 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb778160390 tx=0x7fb7680079b0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7780d2530 msgr2=0x7fb7781f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7780d2530 0x7fb7781f6160 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb774037040 tx=0x7fb774004a40 comp rx=0 tx=0).stop 2023-08-09T12:45:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 shutdown_connections 2023-08-09T12:45:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb76406a050 0x7fb76406c510 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb778153390 0x7fb77815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77815caf0 0x7fb778151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 --2- 172.21.15.17:0/1836445619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7780d2530 0x7fb7781f6160 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 >> 172.21.15.17:0/1836445619 conn(0x7fb7780cf6b0 msgr2=0x7fb7780b6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.900+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 shutdown_connections 2023-08-09T12:45:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:53.901+0000 7fb77da21640 1 -- 172.21.15.17:0/1836445619 wait complete. 2023-08-09T12:45:53.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:45:54.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.141+0000 7fc44b20d640 1 Processor -- start 2023-08-09T12:45:54.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.142+0000 7fc44b20d640 1 -- start start 2023-08-09T12:45:54.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.143+0000 7fc44b20d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc4440adc40 0x7fc44406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:54.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.143+0000 7fc44b20d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc4440cc630 0x7fc4440ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:54.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.143+0000 7fc44b20d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4440b2250 con 0x7fc4440b3b40 2023-08-09T12:45:54.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.143+0000 7fc44b20d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4440ae020 con 0x7fc4440adc40 2023-08-09T12:45:54.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.143+0000 7fc44b20d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4440b2530 con 0x7fc4440cc630 2023-08-09T12:45:54.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.143+0000 7fc448fa9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc4440adc40 0x7fc44406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:54.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.143+0000 7fc448fa9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc4440adc40 0x7fc44406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45396/0 (socket says 172.21.15.17:45396) 2023-08-09T12:45:54.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.143+0000 7fc448fa9640 1 -- 172.21.15.17:0/4287655067 learned_addr learned my addr 172.21.15.17:0/4287655067 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:54.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.144+0000 7fc448fa9640 1 -- 172.21.15.17:0/4287655067 >> v2:172.21.15.142:3300/0 conn(0x7fc4440cc630 msgr2=0x7fc4440ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:54.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.144+0000 7fc448fa9640 1 --2- 172.21.15.17:0/4287655067 >> v2:172.21.15.142:3300/0 conn(0x7fc4440cc630 0x7fc4440ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.144+0000 7fc448fa9640 1 -- 172.21.15.17:0/4287655067 >> v1:172.21.15.142:6789/0 conn(0x7fc4440b3b40 legacy=0x7fc4440b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:54.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.144+0000 7fc448fa9640 1 -- 172.21.15.17:0/4287655067 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44406fe80 con 0x7fc4440adc40 2023-08-09T12:45:54.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.145+0000 7fc448fa9640 1 --2- 172.21.15.17:0/4287655067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc44406c280 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc4440caff0 tx=0x7fc43802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f756aa02dbd579 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.145+0000 7fc4437fe640 1 -- 172.21.15.17:0/4287655067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380317e0 con 0x7fc4440adc40 2023-08-09T12:45:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.145+0000 7fc4437fe640 1 -- 172.21.15.17:0/4287655067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438031940 con 0x7fc4440adc40 2023-08-09T12:45:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.145+0000 7fc4437fe640 1 -- 172.21.15.17:0/4287655067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438031cd0 con 0x7fc4440adc40 2023-08-09T12:45:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.146+0000 7fc44b20d640 1 -- 172.21.15.17:0/4287655067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 msgr2=0x7fc44406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.146+0000 7fc44b20d640 1 --2- 172.21.15.17:0/4287655067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc44406c280 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc4440caff0 tx=0x7fc43802b880 comp rx=0 tx=0).stop 2023-08-09T12:45:54.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.146+0000 7fc44b20d640 1 -- 172.21.15.17:0/4287655067 shutdown_connections 2023-08-09T12:45:54.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.146+0000 7fc44b20d640 1 --2- 172.21.15.17:0/4287655067 >> v2:172.21.15.142:3300/0 conn(0x7fc4440cc630 0x7fc4440ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.146+0000 7fc44b20d640 1 --2- 172.21.15.17:0/4287655067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc44406c280 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.146+0000 7fc44b20d640 1 -- 172.21.15.17:0/4287655067 >> 172.21.15.17:0/4287655067 conn(0x7fc4440cb1b0 msgr2=0x7fc4440cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:54.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.146+0000 7fc44b20d640 1 -- 172.21.15.17:0/4287655067 shutdown_connections 2023-08-09T12:45:54.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.146+0000 7fc44b20d640 1 -- 172.21.15.17:0/4287655067 wait complete. 2023-08-09T12:45:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.148+0000 7fc44b20d640 1 Processor -- start 2023-08-09T12:45:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.148+0000 7fc44b20d640 1 -- start start 2023-08-09T12:45:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc44b20d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc444155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc44b20d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4440b3b40 0x7fc4440c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc44b20d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4440cc630 0x7fc4440ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc44b20d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440c4200 con 0x7fc4440adc40 2023-08-09T12:45:54.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc44b20d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440c4410 con 0x7fc4440cc630 2023-08-09T12:45:54.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc44b20d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440c8d90 con 0x7fc4440b3b40 2023-08-09T12:45:54.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc448fa9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc444155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:54.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc448fa9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc444155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45412/0 (socket says 172.21.15.17:45412) 2023-08-09T12:45:54.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.149+0000 7fc448fa9640 1 -- 172.21.15.17:0/2731634909 learned_addr learned my addr 172.21.15.17:0/2731634909 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:54.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc448fa9640 1 -- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4440b3b40 msgr2=0x7fc4440c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:54.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc448fa9640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4440b3b40 0x7fc4440c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc448fa9640 1 -- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4440cc630 msgr2=0x7fc4440ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:54.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc448fa9640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4440cc630 0x7fc4440ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc448fa9640 1 -- 172.21.15.17:0/2731634909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380094d0 con 0x7fc4440adc40 2023-08-09T12:45:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc448fa9640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc444155aa0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc43802b8c0 tx=0x7fc4380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc4417fa640 1 -- 172.21.15.17:0/2731634909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438032940 con 0x7fc4440adc40 2023-08-09T12:45:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc4417fa640 1 -- 172.21.15.17:0/2731634909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438032aa0 con 0x7fc4440adc40 2023-08-09T12:45:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc4417fa640 1 -- 172.21.15.17:0/2731634909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438032e50 con 0x7fc4440adc40 2023-08-09T12:45:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.150+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4440c9070 con 0x7fc4440adc40 2023-08-09T12:45:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.151+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4440c9630 con 0x7fc4440adc40 2023-08-09T12:45:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.152+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc444067a80 con 0x7fc4440adc40 2023-08-09T12:45:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.153+0000 7fc4417fa640 1 -- 172.21.15.17:0/2731634909 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc43804e450 con 0x7fc4440adc40 2023-08-09T12:45:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.153+0000 7fc4417fa640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc42806a050 0x7fc42806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.154+0000 7fc4417fa640 1 -- 172.21.15.17:0/2731634909 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4380aa7f0 con 0x7fc4440adc40 2023-08-09T12:45:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.154+0000 7fc443fff640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc42806a050 0x7fc42806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.155+0000 7fc443fff640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc42806a050 0x7fc42806c510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc4440ca950 tx=0x7fc4300079e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:54.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.158+0000 7fc4417fa640 1 -- 172.21.15.17:0/2731634909 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc438075ed0 con 0x7fc4440adc40 2023-08-09T12:45:54.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.404+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4440c9820 con 0x7fc4440adc40 2023-08-09T12:45:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.406+0000 7fc4417fa640 1 -- 172.21.15.17:0/2731634909 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7fc438034e60 con 0x7fc4440adc40 2023-08-09T12:45:54.409 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:54.409 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:45:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:45:54.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc42806a050 msgr2=0x7fc42806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:54.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc42806a050 0x7fc42806c510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc4440ca950 tx=0x7fc4300079e0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 msgr2=0x7fc444155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:54.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc444155aa0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc43802b8c0 tx=0x7fc4380046c0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 shutdown_connections 2023-08-09T12:45:54.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc42806a050 0x7fc42806c510 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4440cc630 0x7fc4440ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4440b3b40 0x7fc4440c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 --2- 172.21.15.17:0/2731634909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4440adc40 0x7fc444155aa0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:54.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 >> 172.21.15.17:0/2731634909 conn(0x7fc4440cb1b0 msgr2=0x7fc44406c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:54.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 shutdown_connections 2023-08-09T12:45:54.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:54.409+0000 7fc44b20d640 1 -- 172.21.15.17:0/2731634909 wait complete. 2023-08-09T12:45:54.834 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:45:42.662961+0000', 'modified': '2023-08-09T12:45:46.216706+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7029}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7029': {'gid': 7029, 'name': 'd', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/734281214', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 734281214}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 734281214}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:45:54.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:45:54.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-09T12:45:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.072+0000 7f246b263640 1 Processor -- start 2023-08-09T12:45:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.072+0000 7f246b263640 1 -- start start 2023-08-09T12:45:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.074+0000 7f246b263640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24640cb610 0x7f246406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.074+0000 7f246b263640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24640b3b60 con 0x7f24640b0ea0 2023-08-09T12:45:55.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.074+0000 7f246b263640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24640b3550 con 0x7f24640b0ac0 2023-08-09T12:45:55.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.074+0000 7f246b263640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24641617b0 con 0x7f24640cb610 2023-08-09T12:45:55.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.074+0000 7f2469a60640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f24640b0ea0 0x7f24640caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56138/0 (socket says 172.21.15.17:56138) 2023-08-09T12:45:55.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.074+0000 7f2469a60640 1 -- 172.21.15.17:0/4069110107 learned_addr learned my addr 172.21.15.17:0/4069110107 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:55.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.074+0000 7f246aa62640 1 --2- 172.21.15.17:0/4069110107 >> v2:172.21.15.142:3300/0 conn(0x7f24640cb610 0x7f246406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.075+0000 7f246925f640 1 -- 172.21.15.17:0/4069110107 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063901381 0 0) 0x7f24640b3b60 con 0x7f24640b0ea0 2023-08-09T12:45:55.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.075+0000 7f246925f640 1 -- 172.21.15.17:0/4069110107 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2450003520 con 0x7f24640b0ea0 2023-08-09T12:45:55.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.075+0000 7f246aa62640 1 -- 172.21.15.17:0/4069110107 >> v1:172.21.15.142:6789/0 conn(0x7f24640b0ac0 legacy=0x7f24640b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.075+0000 7f246aa62640 1 -- 172.21.15.17:0/4069110107 >> v1:172.21.15.17:6789/0 conn(0x7f24640b0ea0 legacy=0x7f24640caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.075+0000 7f246aa62640 1 -- 172.21.15.17:0/4069110107 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640c9e10 con 0x7f24640cb610 2023-08-09T12:45:55.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.077+0000 7f246aa62640 1 --2- 172.21.15.17:0/4069110107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 0x7f246406ecd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f245c009d90 tx=0x7f245c02bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff2191846d2eb5a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.077+0000 7f246925f640 1 -- 172.21.15.17:0/4069110107 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c02ccf0 con 0x7f24640cb610 2023-08-09T12:45:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.077+0000 7f246925f640 1 -- 172.21.15.17:0/4069110107 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c02ce50 con 0x7f24640cb610 2023-08-09T12:45:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.077+0000 7f246925f640 1 -- 172.21.15.17:0/4069110107 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c034660 con 0x7f24640cb610 2023-08-09T12:45:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.078+0000 7f246b263640 1 -- 172.21.15.17:0/4069110107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 msgr2=0x7f246406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.078+0000 7f246b263640 1 --2- 172.21.15.17:0/4069110107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 0x7f246406ecd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f245c009d90 tx=0x7f245c02bf40 comp rx=0 tx=0).stop 2023-08-09T12:45:55.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.078+0000 7f246b263640 1 -- 172.21.15.17:0/4069110107 shutdown_connections 2023-08-09T12:45:55.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.078+0000 7f246b263640 1 --2- 172.21.15.17:0/4069110107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 0x7f246406ecd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.078+0000 7f246b263640 1 -- 172.21.15.17:0/4069110107 >> 172.21.15.17:0/4069110107 conn(0x7f24640b1d50 msgr2=0x7f246406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:55.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.078+0000 7f246b263640 1 -- 172.21.15.17:0/4069110107 shutdown_connections 2023-08-09T12:45:55.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.078+0000 7f246b263640 1 -- 172.21.15.17:0/4069110107 wait complete. 2023-08-09T12:45:55.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.080+0000 7f246b263640 1 Processor -- start 2023-08-09T12:45:55.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.080+0000 7f246b263640 1 -- start start 2023-08-09T12:45:55.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246b263640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24640b0ac0 0x7f2464151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246b263640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24640b0ea0 0x7f24641526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246b263640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 0x7f24640c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246b263640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640c2c50 con 0x7f24640b0ac0 2023-08-09T12:45:55.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246b263640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640c6300 con 0x7f24640cb610 2023-08-09T12:45:55.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246b263640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24640c5960 con 0x7f24640b0ea0 2023-08-09T12:45:55.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246a261640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24640b0ac0 0x7f2464151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246a261640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24640b0ac0 0x7f2464151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45418/0 (socket says 172.21.15.17:45418) 2023-08-09T12:45:55.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.082+0000 7f246a261640 1 -- 172.21.15.17:0/338365850 learned_addr learned my addr 172.21.15.17:0/338365850 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:55.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246a261640 1 -- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24640b0ea0 msgr2=0x7f24641526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246aa62640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 0x7f24640c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f2469a60640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24640b0ea0 0x7f24641526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246a261640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24640b0ea0 0x7f24641526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246a261640 1 -- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 msgr2=0x7f24640c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246a261640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 0x7f24640c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246a261640 1 -- 172.21.15.17:0/338365850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c009a70 con 0x7f24640b0ac0 2023-08-09T12:45:55.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f2469a60640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24640b0ea0 0x7f24641526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:55.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246aa62640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 0x7f24640c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:55.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246a261640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24640b0ac0 0x7f2464151d50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f246000c450 tx=0x7f246000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f245affd640 1 -- 172.21.15.17:0/338365850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600052d0 con 0x7f24640b0ac0 2023-08-09T12:45:55.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f245affd640 1 -- 172.21.15.17:0/338365850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460005430 con 0x7f24640b0ac0 2023-08-09T12:45:55.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f245affd640 1 -- 172.21.15.17:0/338365850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460012870 con 0x7f24640b0ac0 2023-08-09T12:45:55.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.083+0000 7f246b263640 1 -- 172.21.15.17:0/338365850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24640c5c40 con 0x7f24640b0ac0 2023-08-09T12:45:55.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.084+0000 7f246b263640 1 -- 172.21.15.17:0/338365850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2464152be0 con 0x7f24640b0ac0 2023-08-09T12:45:55.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.086+0000 7f245affd640 1 -- 172.21.15.17:0/338365850 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f24600129d0 con 0x7f24640b0ac0 2023-08-09T12:45:55.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.088+0000 7f245affd640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f244806a0a0 0x7f244806c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.088+0000 7f245affd640 1 -- 172.21.15.17:0/338365850 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2460088120 con 0x7f24640b0ac0 2023-08-09T12:45:55.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.088+0000 7f246f034740 1 Processor -- start 2023-08-09T12:45:55.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.088+0000 7f246f034740 1 -- start start 2023-08-09T12:45:55.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.088+0000 7f2469a60640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f244806a0a0 0x7f244806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246f034740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 0x5576e57be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246f034740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e578ddb0 0x5576e57bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246f034740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246f034740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e56ff8f0 con 0x5576e57919b0 2023-08-09T12:45:55.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246f034740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e56fcfe0 con 0x5576e57bde30 2023-08-09T12:45:55.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246f034740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576e56f88d0 con 0x5576e578ddb0 2023-08-09T12:45:55.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246aa62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246aa62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57bb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45422/0 (socket says 172.21.15.17:45422) 2023-08-09T12:45:55.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f2469a60640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f244806a0a0 0x7f244806c560 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f24641f96b0 tx=0x7f2454009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.089+0000 7f246aa62640 1 -- 172.21.15.17:0/3321788388 learned_addr learned my addr 172.21.15.17:0/3321788388 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:55.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f2469a60640 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e578ddb0 0x5576e57bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f246aa62640 1 -- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e578ddb0 msgr2=0x5576e57bb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f246a261640 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 0x5576e57be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f246aa62640 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e578ddb0 0x5576e57bb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f246aa62640 1 -- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 msgr2=0x5576e57be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f246aa62640 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 0x5576e57be210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f246aa62640 1 -- 172.21.15.17:0/3321788388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e56b1ac0 con 0x5576e57919b0 2023-08-09T12:45:55.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f2469a60640 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e578ddb0 0x5576e57bb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:55.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.090+0000 7f246aa62640 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57bb5e0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f245c02dfd0 tx=0x7f245c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1154ae915812f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f2447fff640 1 -- 172.21.15.17:0/3321788388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c03e670 con 0x5576e57919b0 2023-08-09T12:45:55.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f2447fff640 1 -- 172.21.15.17:0/3321788388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c03e7d0 con 0x5576e57919b0 2023-08-09T12:45:55.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f2447fff640 1 -- 172.21.15.17:0/3321788388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c03eb80 con 0x5576e57919b0 2023-08-09T12:45:55.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 -- 172.21.15.17:0/3321788388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 msgr2=0x5576e57bb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57bb5e0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f245c02dfd0 tx=0x7f245c02e000 comp rx=0 tx=0).stop 2023-08-09T12:45:55.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 -- 172.21.15.17:0/3321788388 shutdown_connections 2023-08-09T12:45:55.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57bb5e0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e578ddb0 0x5576e57bb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 --2- 172.21.15.17:0/3321788388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 0x5576e57be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 -- 172.21.15.17:0/3321788388 >> 172.21.15.17:0/3321788388 conn(0x5576e57900c0 msgr2=0x5576e57d8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:55.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 -- 172.21.15.17:0/3321788388 shutdown_connections 2023-08-09T12:45:55.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.091+0000 7f246f034740 1 -- 172.21.15.17:0/3321788388 wait complete. 2023-08-09T12:45:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.092+0000 7f246f034740 1 -- start start 2023-08-09T12:45:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.092+0000 7f246f034740 1 Processor -- start 2023-08-09T12:45:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.093+0000 7f246f034740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.093+0000 7f246f034740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 0x5576e57c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.093+0000 7f246f034740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57c1230 0x5576e57d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.093+0000 7f246f034740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e5698d40 con 0x5576e57919b0 2023-08-09T12:45:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.093+0000 7f246f034740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e56989e0 con 0x5576e57c1230 2023-08-09T12:45:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.093+0000 7f246f034740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576e545ef20 con 0x5576e57bde30 2023-08-09T12:45:55.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.093+0000 7f246f034740 10 client.0 _ll_register_callbacks cb 0x5576e56b1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:45:55.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45432/0 (socket says 172.21.15.17:45432) 2023-08-09T12:45:55.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 -- 172.21.15.17:0/1957740757 learned_addr learned my addr 172.21.15.17:0/1957740757 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:55.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f2469a60640 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 0x5576e57c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 -- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 msgr2=0x5576e57c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 0x5576e57c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 -- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57c1230 msgr2=0x5576e57d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57c1230 0x5576e57d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 -- 172.21.15.17:0/1957740757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24640c9e10 con 0x5576e57919b0 2023-08-09T12:45:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f246a261640 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57af3a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2460086470 tx=0x7f246005b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d130f6f08689226 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.094+0000 7f24457fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:45:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f24457fa640 1 -- 172.21.15.17:0/1957740757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246005b080 con 0x5576e57919b0 2023-08-09T12:45:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f24457fa640 1 -- 172.21.15.17:0/1957740757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2460012c80 con 0x5576e57919b0 2023-08-09T12:45:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f246f034740 1 -- 172.21.15.17:0/1957740757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576e56d0500 con 0x5576e57919b0 2023-08-09T12:45:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f24457fa640 1 -- 172.21.15.17:0/1957740757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2460012e60 con 0x5576e57919b0 2023-08-09T12:45:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f246f034740 10 client.7203 fetch_fsmap learned FSMap version 51 2023-08-09T12:45:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f246f034740 1 -- 172.21.15.17:0/1957740757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5576e56f6f50 con 0x5576e57919b0 2023-08-09T12:45:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f24457fa640 1 -- 172.21.15.17:0/1957740757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460085020 con 0x5576e57919b0 2023-08-09T12:45:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f24457fa640 1 -- 172.21.15.17:0/1957740757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2460019020 con 0x5576e57919b0 2023-08-09T12:45:55.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f246f034740 10 client.7203 fetch_fsmap finished waiting for FSMap version 51 2023-08-09T12:45:55.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f246f034740 10 client.7203 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-09T12:45:55.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f246f034740 20 client.7203 populate_metadata read hostname 'smithi017' 2023-08-09T12:45:55.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.095+0000 7f246f034740 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] conn(0x5576e57f4570 0x5576e57f6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.096+0000 7f246f034740 4 client.7203 mds_command: new command op to 7029 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:45:55.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.096+0000 7f246f034740 1 -- 172.21.15.17:0/1957740757 --> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576e56cdbc0 con 0x5576e57f4570 2023-08-09T12:45:55.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.096+0000 7f2469a60640 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] conn(0x5576e57f4570 0x5576e57f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.097+0000 7f2469a60640 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] conn(0x5576e57f4570 0x5576e57f6960 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=add444495e50193e server_cookie=7c6e285f568251fc in_seq=0 out_seq=0 2023-08-09T12:45:55.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.097+0000 7f24457fa640 10 client.7203 ms_handle_connect on v2:172.21.15.142:6835/734281214 2023-08-09T12:45:55.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f24457fa640 1 -- 172.21.15.17:0/1957740757 <== mds.0 v2:172.21.15.142:6835/734281214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5576e56cdbc0 con 0x5576e57f4570 2023-08-09T12:45:55.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f24457fa640 10 client.7203 handle_command_reply: tid=0 2023-08-09T12:45:55.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 client.7203 shutdown 2023-08-09T12:45:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 -- 172.21.15.17:0/1957740757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 msgr2=0x5576e57af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57af3a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2460086470 tx=0x7f246005b3b0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 -- 172.21.15.17:0/1957740757 shutdown_connections 2023-08-09T12:45:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] conn(0x5576e57f4570 0x5576e57f6960 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57c1230 0x5576e57d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 0x5576e57c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 --2- 172.21.15.17:0/1957740757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57af3a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f24457fa640 0 client.7203 ms_handle_reset on v2:172.21.15.142:6835/734281214 2023-08-09T12:45:55.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 -- 172.21.15.17:0/1957740757 >> 172.21.15.17:0/1957740757 conn(0x5576e578ddb0 msgr2=0x5576e57dc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:55.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 -- 172.21.15.17:0/1957740757 shutdown_connections 2023-08-09T12:45:55.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.099+0000 7f246f034740 1 -- 172.21.15.17:0/1957740757 wait complete. 2023-08-09T12:45:55.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.100+0000 7f246f034740 20 client.7203 trim_cache size 0 max 16384 2023-08-09T12:45:55.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.116+0000 7f246f034740 1 Processor -- start 2023-08-09T12:45:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.117+0000 7f246f034740 1 -- start start 2023-08-09T12:45:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.117+0000 7f246f034740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.117+0000 7f246f034740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 0x5576e57baae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.117+0000 7f246f034740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57c1230 0x5576e57bb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.117+0000 7f246f034740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e572a1c0 con 0x5576e57919b0 2023-08-09T12:45:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.117+0000 7f246f034740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e57af2e0 con 0x5576e57c1230 2023-08-09T12:45:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.117+0000 7f246f034740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576e57d4490 con 0x5576e57bde30 2023-08-09T12:45:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45444/0 (socket says 172.21.15.17:45444) 2023-08-09T12:45:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 -- 172.21.15.17:0/4152591963 learned_addr learned my addr 172.21.15.17:0/4152591963 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 -- 172.21.15.17:0/4152591963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 msgr2=0x5576e57baae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 --2- 172.21.15.17:0/4152591963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 0x5576e57baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 -- 172.21.15.17:0/4152591963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57c1230 msgr2=0x5576e57bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 --2- 172.21.15.17:0/4152591963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57c1230 0x5576e57bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 -- 172.21.15.17:0/4152591963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e572a300 con 0x5576e57919b0 2023-08-09T12:45:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.118+0000 7f246a261640 1 --2- 172.21.15.17:0/4152591963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57d2880 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f24600571b0 tx=0x7f2460059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8382e0b57cd42768 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f2458ff9640 1 -- 172.21.15.17:0/4152591963 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460086240 con 0x5576e57919b0 2023-08-09T12:45:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f2458ff9640 1 -- 172.21.15.17:0/4152591963 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460085070 con 0x5576e57919b0 2023-08-09T12:45:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f2458ff9640 1 -- 172.21.15.17:0/4152591963 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000e040 con 0x5576e57919b0 2023-08-09T12:45:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 -- 172.21.15.17:0/4152591963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 msgr2=0x5576e57d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 --2- 172.21.15.17:0/4152591963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57d2880 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f24600571b0 tx=0x7f2460059000 comp rx=0 tx=0).stop 2023-08-09T12:45:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 -- 172.21.15.17:0/4152591963 shutdown_connections 2023-08-09T12:45:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 --2- 172.21.15.17:0/4152591963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57c1230 0x5576e57bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 --2- 172.21.15.17:0/4152591963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57bde30 0x5576e57baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 --2- 172.21.15.17:0/4152591963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57919b0 0x5576e57d2880 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 -- 172.21.15.17:0/4152591963 >> 172.21.15.17:0/4152591963 conn(0x5576e578ddb0 msgr2=0x5576e578cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 -- 172.21.15.17:0/4152591963 shutdown_connections 2023-08-09T12:45:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.119+0000 7f246f034740 1 -- 172.21.15.17:0/4152591963 wait complete. 2023-08-09T12:45:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.120+0000 7f246f034740 1 -- start start 2023-08-09T12:45:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.120+0000 7f246f034740 1 Processor -- start 2023-08-09T12:45:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.121+0000 7f246f034740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 0x5576e58428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.121+0000 7f246f034740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57c1230 0x5576e57e7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.121+0000 7f246f034740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57db890 0x5576e57c0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.121+0000 7f246f034740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e57e7cd0 con 0x5576e57c1230 2023-08-09T12:45:55.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.121+0000 7f246f034740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e57ae710 con 0x5576e57bde30 2023-08-09T12:45:55.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.121+0000 7f246f034740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576e57bb480 con 0x5576e57db890 2023-08-09T12:45:55.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.121+0000 7f246f034740 10 client.0 _ll_register_callbacks cb 0x7f24600537f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:45:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57c1230 0x5576e57e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57c1230 0x5576e57e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45458/0 (socket says 172.21.15.17:45458) 2023-08-09T12:45:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 -- 172.21.15.17:0/1351164740 learned_addr learned my addr 172.21.15.17:0/1351164740 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 -- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57db890 msgr2=0x5576e57c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57db890 0x5576e57c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 -- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 msgr2=0x5576e58428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 0x5576e58428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 -- 172.21.15.17:0/1351164740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576e56f6f50 con 0x5576e57c1230 2023-08-09T12:45:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f2469a60640 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57c1230 0x5576e57e7130 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f24540011e0 tx=0x7f2454001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0198d07dad58a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.122+0000 7f24457fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:45:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f24457fa640 1 -- 172.21.15.17:0/1351164740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454007760 con 0x5576e57c1230 2023-08-09T12:45:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f24457fa640 1 -- 172.21.15.17:0/1351164740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2454018070 con 0x5576e57c1230 2023-08-09T12:45:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 1 -- 172.21.15.17:0/1351164740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576e57ba640 con 0x5576e57c1230 2023-08-09T12:45:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f24457fa640 1 -- 172.21.15.17:0/1351164740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f245400dbf0 con 0x5576e57c1230 2023-08-09T12:45:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 10 client.7209 fetch_fsmap learned FSMap version 51 2023-08-09T12:45:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 1 -- 172.21.15.17:0/1351164740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5576e5697a10 con 0x5576e57c1230 2023-08-09T12:45:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f24457fa640 1 -- 172.21.15.17:0/1351164740 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5576e57ba640 con 0x5576e57c1230 2023-08-09T12:45:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f24457fa640 1 -- 172.21.15.17:0/1351164740 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f245401e040 con 0x5576e57c1230 2023-08-09T12:45:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 10 client.7209 fetch_fsmap finished waiting for FSMap version 51 2023-08-09T12:45:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 10 client.7209 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-09T12:45:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 20 client.7209 populate_metadata read hostname 'smithi017' 2023-08-09T12:45:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] conn(0x5576e57c0c30 0x5576e5792bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 4 client.7209 mds_command: new command op to 7029 tid=0[{"prefix": "status"}] 2023-08-09T12:45:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.123+0000 7f246f034740 1 -- 172.21.15.17:0/1351164740 --> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5576e5720800 con 0x5576e57c0c30 2023-08-09T12:45:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.124+0000 7f246a261640 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] conn(0x5576e57c0c30 0x5576e5792bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.125+0000 7f246a261640 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] conn(0x5576e57c0c30 0x5576e5792bf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08aa80a3c15174a server_cookie=38953edf3a514872 in_seq=0 out_seq=0 2023-08-09T12:45:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.125+0000 7f24457fa640 10 client.7209 ms_handle_connect on v2:172.21.15.142:6835/734281214 2023-08-09T12:45:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f24457fa640 1 -- 172.21.15.17:0/1351164740 <== mds.0 v2:172.21.15.142:6835/734281214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5576e5720800 con 0x5576e57c0c30 2023-08-09T12:45:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f24457fa640 10 client.7209 handle_command_reply: tid=0 2023-08-09T12:45:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 client.7209 shutdown 2023-08-09T12:45:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 -- 172.21.15.17:0/1351164740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57c1230 msgr2=0x5576e57e7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57c1230 0x5576e57e7130 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f24540011e0 tx=0x7f2454001150 comp rx=0 tx=0).stop 2023-08-09T12:45:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 -- 172.21.15.17:0/1351164740 shutdown_connections 2023-08-09T12:45:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:6835/734281214,v1:172.21.15.142:6837/734281214] conn(0x5576e57c0c30 0x5576e5792bf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5576e57db890 0x5576e57c0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576e57c1230 0x5576e57e7130 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 --2- 172.21.15.17:0/1351164740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5576e57bde30 0x5576e58428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f24457fa640 0 client.7209 ms_handle_reset on v2:172.21.15.142:6835/734281214 2023-08-09T12:45:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 -- 172.21.15.17:0/1351164740 >> 172.21.15.17:0/1351164740 conn(0x5576e578ddb0 msgr2=0x5576e578cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 -- 172.21.15.17:0/1351164740 shutdown_connections 2023-08-09T12:45:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.126+0000 7f246f034740 1 -- 172.21.15.17:0/1351164740 wait complete. 2023-08-09T12:45:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246f034740 20 client.7209 trim_cache size 0 max 16384 2023-08-09T12:45:55.136 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:45:55.136 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:45:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:45:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7029, 2023-08-09T12:45:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:45:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:45:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:45:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 11.919427244, 2023-08-09T12:45:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 51, 2023-08-09T12:45:55.137 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 110, 2023-08-09T12:45:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 110, 2023-08-09T12:45:55.138 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 17.739740079000001 2023-08-09T12:45:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:45:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 -- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f244806a0a0 msgr2=0x7f244806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f244806a0a0 0x7f244806c560 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f24641f96b0 tx=0x7f2454009040 comp rx=0 tx=0).stop 2023-08-09T12:45:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 -- 172.21.15.17:0/338365850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24640b0ac0 msgr2=0x7f2464151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24640b0ac0 0x7f2464151d50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f246000c450 tx=0x7f246000c910 comp rx=0 tx=0).stop 2023-08-09T12:45:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 -- 172.21.15.17:0/338365850 shutdown_connections 2023-08-09T12:45:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f244806a0a0 0x7f244806c560 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24640cb610 0x7f24640c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24640b0ea0 0x7f24641526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 --2- 172.21.15.17:0/338365850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24640b0ac0 0x7f2464151d50 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 -- 172.21.15.17:0/338365850 >> 172.21.15.17:0/338365850 conn(0x7f24640b1d50 msgr2=0x7f2464160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:55.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 -- 172.21.15.17:0/338365850 shutdown_connections 2023-08-09T12:45:55.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.127+0000 7f246b263640 1 -- 172.21.15.17:0/338365850 wait complete. 2023-08-09T12:45:55.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:45:55.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.372+0000 7fd38225d640 1 Processor -- start 2023-08-09T12:45:55.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.372+0000 7fd38225d640 1 -- start start 2023-08-09T12:45:55.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.373+0000 7fd38225d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd37c159bd0 0x7fd37c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.373+0000 7fd38225d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.373+0000 7fd38225d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c06fe10 con 0x7fd37c0697c0 2023-08-09T12:45:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.373+0000 7fd38225d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0b11a0 con 0x7fd37c159bd0 2023-08-09T12:45:55.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.373+0000 7fd38225d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c159fb0 con 0x7fd37c0b3fe0 2023-08-09T12:45:55.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.374+0000 7fd380a5a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.374+0000 7fd380a5a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:39100/0 (socket says 172.21.15.17:39100) 2023-08-09T12:45:55.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.374+0000 7fd380a5a640 1 -- 172.21.15.17:0/1654419331 learned_addr learned my addr 172.21.15.17:0/1654419331 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:55.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.374+0000 7fd38125b640 1 --2- 172.21.15.17:0/1654419331 >> v2:172.21.15.142:3300/0 conn(0x7fd37c159bd0 0x7fd37c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.375+0000 7fd380a5a640 1 -- 172.21.15.17:0/1654419331 >> v2:172.21.15.142:3300/0 conn(0x7fd37c159bd0 msgr2=0x7fd37c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.375+0000 7fd380a5a640 1 --2- 172.21.15.17:0/1654419331 >> v2:172.21.15.142:3300/0 conn(0x7fd37c159bd0 0x7fd37c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.375+0000 7fd380a5a640 1 -- 172.21.15.17:0/1654419331 >> v1:172.21.15.142:6789/0 conn(0x7fd37c0697c0 legacy=0x7fd37c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.375+0000 7fd380a5a640 1 -- 172.21.15.17:0/1654419331 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c070970 con 0x7fd37c0b3fe0 2023-08-09T12:45:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.376+0000 7fd380a5a640 1 --2- 172.21.15.17:0/1654419331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c070e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009870 tx=0x7fd36c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f4fff003c9ec27b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd373fff640 1 -- 172.21.15.17:0/1654419331 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c030840 con 0x7fd37c0b3fe0 2023-08-09T12:45:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd373fff640 1 -- 172.21.15.17:0/1654419331 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0309a0 con 0x7fd37c0b3fe0 2023-08-09T12:45:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd373fff640 1 -- 172.21.15.17:0/1654419331 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c030d30 con 0x7fd37c0b3fe0 2023-08-09T12:45:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd38225d640 1 -- 172.21.15.17:0/1654419331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 msgr2=0x7fd37c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd38225d640 1 --2- 172.21.15.17:0/1654419331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c070e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009870 tx=0x7fd36c02b980 comp rx=0 tx=0).stop 2023-08-09T12:45:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd38225d640 1 -- 172.21.15.17:0/1654419331 shutdown_connections 2023-08-09T12:45:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd38225d640 1 --2- 172.21.15.17:0/1654419331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c070e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd38225d640 1 --2- 172.21.15.17:0/1654419331 >> v2:172.21.15.142:3300/0 conn(0x7fd37c159bd0 0x7fd37c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.377+0000 7fd38225d640 1 -- 172.21.15.17:0/1654419331 >> 172.21.15.17:0/1654419331 conn(0x7fd37c0b1d50 msgr2=0x7fd37c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.378+0000 7fd38225d640 1 -- 172.21.15.17:0/1654419331 shutdown_connections 2023-08-09T12:45:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.378+0000 7fd38225d640 1 -- 172.21.15.17:0/1654419331 wait complete. 2023-08-09T12:45:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.379+0000 7fd38225d640 1 Processor -- start 2023-08-09T12:45:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.380+0000 7fd38225d640 1 -- start start 2023-08-09T12:45:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38225d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd37c0697c0 0x7fd37c155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38225d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38225d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd37c159bd0 0x7fd37c0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38225d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c15b910 con 0x7fd37c0697c0 2023-08-09T12:45:55.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38225d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0c3710 con 0x7fd37c159bd0 2023-08-09T12:45:55.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38225d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0c3150 con 0x7fd37c0b3fe0 2023-08-09T12:45:55.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38125b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd37c0697c0 0x7fd37c155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38125b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd37c0697c0 0x7fd37c155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45474/0 (socket says 172.21.15.17:45474) 2023-08-09T12:45:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38125b640 1 -- 172.21.15.17:0/2073163397 learned_addr learned my addr 172.21.15.17:0/2073163397 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd380a5a640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38125b640 1 -- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 msgr2=0x7fd37c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd381a5c640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd37c159bd0 0x7fd37c0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38125b640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.381+0000 7fd38125b640 1 -- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd37c159bd0 msgr2=0x7fd37c0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.382+0000 7fd38125b640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd37c159bd0 0x7fd37c0ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.382+0000 7fd38125b640 1 -- 172.21.15.17:0/2073163397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0094d0 con 0x7fd37c0697c0 2023-08-09T12:45:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.382+0000 7fd381a5c640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd37c159bd0 0x7fd37c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.382+0000 7fd38125b640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd37c0697c0 0x7fd37c155a40 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd37800e870 tx=0x7fd37800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.382+0000 7fd371ffb640 1 -- 172.21.15.17:0/2073163397 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780094f0 con 0x7fd37c0697c0 2023-08-09T12:45:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.382+0000 7fd371ffb640 1 -- 172.21.15.17:0/2073163397 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37800c940 con 0x7fd37c0697c0 2023-08-09T12:45:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.382+0000 7fd371ffb640 1 -- 172.21.15.17:0/2073163397 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800ccf0 con 0x7fd37c0697c0 2023-08-09T12:45:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.382+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c0c3430 con 0x7fd37c0697c0 2023-08-09T12:45:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.383+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c155f80 con 0x7fd37c0697c0 2023-08-09T12:45:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.384+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c15bb80 con 0x7fd37c0697c0 2023-08-09T12:45:55.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.385+0000 7fd371ffb640 1 -- 172.21.15.17:0/2073163397 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd378013470 con 0x7fd37c0697c0 2023-08-09T12:45:55.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.385+0000 7fd371ffb640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd36006a050 0x7fd36006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:55.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.386+0000 7fd371ffb640 1 -- 172.21.15.17:0/2073163397 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3780886f0 con 0x7fd37c0697c0 2023-08-09T12:45:55.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.386+0000 7fd380a5a640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd36006a050 0x7fd36006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:55.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.387+0000 7fd380a5a640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd36006a050 0x7fd36006c510 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd36c036000 tx=0x7fd36c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:55.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.390+0000 7fd371ffb640 1 -- 172.21.15.17:0/2073163397 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd378053dd0 con 0x7fd37c0697c0 2023-08-09T12:45:55.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.621+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd37c15b390 con 0x7fd37c0697c0 2023-08-09T12:45:55.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.622+0000 7fd371ffb640 1 -- 172.21.15.17:0/2073163397 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd37c15b390 con 0x7fd37c0697c0 2023-08-09T12:45:55.625 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:45:55.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd36006a050 msgr2=0x7fd36006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd36006a050 0x7fd36006c510 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd36c036000 tx=0x7fd36c008030 comp rx=0 tx=0).stop 2023-08-09T12:45:55.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd37c0697c0 msgr2=0x7fd37c155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:55.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd37c0697c0 0x7fd37c155a40 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd37800e870 tx=0x7fd37800ed30 comp rx=0 tx=0).stop 2023-08-09T12:45:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 shutdown_connections 2023-08-09T12:45:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd36006a050 0x7fd36006c510 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd37c159bd0 0x7fd37c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd37c0b3fe0 0x7fd37c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 --2- 172.21.15.17:0/2073163397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd37c0697c0 0x7fd37c155a40 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.624+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 >> 172.21.15.17:0/2073163397 conn(0x7fd37c0b1d50 msgr2=0x7fd37c158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.625+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 shutdown_connections 2023-08-09T12:45:55.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:55.625+0000 7fd38225d640 1 -- 172.21.15.17:0/2073163397 wait complete. 2023-08-09T12:45:55.647 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:45:55.649 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:45:55.649 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:45:55.650 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:45:55.650 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:45:55.650 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:45:55.651 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:45:55.651 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:45:55.652 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:45:55.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:55.653 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:45:55.710 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:45:55.710 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:45:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:45:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:45:55.711 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:55.711 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:45:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:45:55.712 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:45:55.712 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:45:55.713 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:45:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:55.713 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:45:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:45:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41824sec preferred_lft 41824sec 2023-08-09T12:45:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:45:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:55.714 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:45:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:45:55.715 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:45:55.715 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:45:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:45:55.716 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:55.717 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:45:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:45:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:45:55.717 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:55.718 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:45:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:45:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:45:55.718 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:55.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:55.720 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:45:55.821 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:45:55.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:55.826 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:45:55.885 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:45:55.885 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:45:55.885 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:45:55.885 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:45:55.885 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:45:55.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:55.886 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:45:55.886 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:45:55.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:45:55.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:45:55.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:45:55.888 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:45:56.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:56.092 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:45:56.150 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:45:56.150 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:45:56.151 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:45:56.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:56.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:45:56.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:45:56.257 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:45:56.318 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:45:56.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:45:56.318 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:45:56.376 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:45:56.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:56.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:45:56.538 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:45:56.538 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:45:56.539 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:45:56.562 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:45:56.562 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:45:56.563 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:45:56.563 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:45:56.563 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:45:56.590 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:45:56.590 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:45:56.590 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:45:56.590 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:45:56.590 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:45:56.590 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:45:56.591 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:45:56.591 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:45:56.592 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:45:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:45:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:45:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:45:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:45:56.598 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:45:56.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:56.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:45:56.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:56.689 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:45:56.768 INFO:teuthology.orchestra.run.smithi017.stdout:client5429 2023-08-09T12:45:56.769 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:45:56.769 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:56.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:45:57.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.059+0000 7ff42bfff640 1 Processor -- start 2023-08-09T12:45:57.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.059+0000 7ff42bfff640 1 -- start start 2023-08-09T12:45:57.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.061+0000 7ff42bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff42c160030 0x7ff42c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:57.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.061+0000 7ff42bfff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0b5a30 con 0x7ff42c0cfb50 2023-08-09T12:45:57.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.061+0000 7ff42bfff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0d0d70 con 0x7ff42c0b86e0 2023-08-09T12:45:57.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.061+0000 7ff42bfff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0d1110 con 0x7ff42c160030 2023-08-09T12:45:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.061+0000 7ff42b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff42c0cfb50 0x7ff42c0d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56146/0 (socket says 172.21.15.17:56146) 2023-08-09T12:45:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.061+0000 7ff42b7fe640 1 -- 172.21.15.17:0/1041358999 learned_addr learned my addr 172.21.15.17:0/1041358999 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:45:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212306787 0 0) 0x7ff42c0b5a30 con 0x7ff42c0cfb50 2023-08-09T12:45:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff418003520 con 0x7ff42c0cfb50 2023-08-09T12:45:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42affd640 1 --2- 172.21.15.17:0/1041358999 >> v2:172.21.15.142:3300/0 conn(0x7ff42c160030 0x7ff42c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118825115 0 0) 0x7ff418003520 con 0x7ff42c0cfb50 2023-08-09T12:45:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 >> v2:172.21.15.142:3300/0 conn(0x7ff42c160030 msgr2=0x7ff42c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 --2- 172.21.15.17:0/1041358999 >> v2:172.21.15.142:3300/0 conn(0x7ff42c160030 0x7ff42c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 >> v1:172.21.15.142:6789/0 conn(0x7ff42c0b86e0 legacy=0x7ff42c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c160f70 con 0x7ff42c0cfb50 2023-08-09T12:45:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff424001a10 con 0x7ff42c0cfb50 2023-08-09T12:45:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 >> v1:172.21.15.17:6789/0 conn(0x7ff42c0cfb50 legacy=0x7ff42c0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff418003970 0x7ff418003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4180047c0 0x7ff418004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff418005180 0x7ff41800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0d1110 con 0x7ff418003970 2023-08-09T12:45:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41800c0d0 con 0x7ff4180047c0 2023-08-09T12:45:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.062+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41800c290 con 0x7ff418005180 2023-08-09T12:45:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42affd640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff418003970 0x7ff418003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:57.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42affd640 1 -- 172.21.15.17:0/1041358999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff418005180 msgr2=0x7ff41800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:57.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42b7fe640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff418005180 0x7ff41800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:57.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42affd640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff418005180 0x7ff41800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42affd640 1 -- 172.21.15.17:0/1041358999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4180047c0 msgr2=0x7ff418004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:57.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42affd640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4180047c0 0x7ff418004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42affd640 1 -- 172.21.15.17:0/1041358999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418003520 con 0x7ff418003970 2023-08-09T12:45:57.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42b7fe640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff418005180 0x7ff41800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:57.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.063+0000 7ff42b7fe640 1 -- 172.21.15.17:0/1041358999 reap_dead start 2023-08-09T12:45:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.065+0000 7ff42affd640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff418003970 0x7ff418003d90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00ba30 tx=0x7ff4180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3095383867239f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.065+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c032640 con 0x7ff418003970 2023-08-09T12:45:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.065+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c0327a0 con 0x7ff418003970 2023-08-09T12:45:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.065+0000 7ff42a7fc640 1 -- 172.21.15.17:0/1041358999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c032b30 con 0x7ff418003970 2023-08-09T12:45:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.065+0000 7ff42bfff640 1 -- 172.21.15.17:0/1041358999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff418003970 msgr2=0x7ff418003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.065+0000 7ff42bfff640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff418003970 0x7ff418003d90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00ba30 tx=0x7ff4180057f0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.066+0000 7ff42bfff640 1 -- 172.21.15.17:0/1041358999 shutdown_connections 2023-08-09T12:45:57.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.066+0000 7ff42bfff640 1 --2- 172.21.15.17:0/1041358999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff418003970 0x7ff418003d90 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.066+0000 7ff42bfff640 1 -- 172.21.15.17:0/1041358999 >> 172.21.15.17:0/1041358999 conn(0x7ff42c0697c0 msgr2=0x7ff42c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:57.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.066+0000 7ff42bfff640 1 -- 172.21.15.17:0/1041358999 shutdown_connections 2023-08-09T12:45:57.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.066+0000 7ff42bfff640 1 -- 172.21.15.17:0/1041358999 wait complete. 2023-08-09T12:45:57.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.068+0000 7ff42bfff640 1 Processor -- start 2023-08-09T12:45:57.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.068+0000 7ff42bfff640 1 -- start start 2023-08-09T12:45:57.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff42bfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff418003970 0x7ff42c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:57.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff42bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c155ca0 0x7ff42c156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:57.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff42bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c0b37c0 0x7ff42c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:57.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff42bfff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c158c30 con 0x7ff42c155ca0 2023-08-09T12:45:57.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff42bfff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0b24d0 con 0x7ff418003970 2023-08-09T12:45:57.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff42bfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0b3330 con 0x7ff42c0b37c0 2023-08-09T12:45:57.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff423fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c155ca0 0x7ff42c156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:57.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff423fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c155ca0 0x7ff42c156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45494/0 (socket says 172.21.15.17:45494) 2023-08-09T12:45:57.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff423fff640 1 -- 172.21.15.17:0/867667293 learned_addr learned my addr 172.21.15.17:0/867667293 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:57.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff42affd640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff418003970 0x7ff42c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:57.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.069+0000 7ff423fff640 1 -- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c0b37c0 msgr2=0x7ff42c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:57.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff423fff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c0b37c0 0x7ff42c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff423fff640 1 -- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff418003970 msgr2=0x7ff42c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:57.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff423fff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff418003970 0x7ff42c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff423fff640 1 -- 172.21.15.17:0/867667293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c156660 con 0x7ff42c155ca0 2023-08-09T12:45:57.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff423fff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c155ca0 0x7ff42c156120 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c3c0 tx=0x7ff41400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:57.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff428ff9640 1 -- 172.21.15.17:0/867667293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4140052d0 con 0x7ff42c155ca0 2023-08-09T12:45:57.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff428ff9640 1 -- 172.21.15.17:0/867667293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414005450 con 0x7ff42c155ca0 2023-08-09T12:45:57.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c0c5ba0 con 0x7ff42c155ca0 2023-08-09T12:45:57.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff428ff9640 1 -- 172.21.15.17:0/867667293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414003830 con 0x7ff42c155ca0 2023-08-09T12:45:57.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.070+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c0b2a00 con 0x7ff42c155ca0 2023-08-09T12:45:57.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.071+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c04e390 con 0x7ff42c155ca0 2023-08-09T12:45:57.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.074+0000 7ff428ff9640 1 -- 172.21.15.17:0/867667293 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff414003990 con 0x7ff42c155ca0 2023-08-09T12:45:57.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.075+0000 7ff428ff9640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff40c06a050 0x7ff40c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:57.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.076+0000 7ff428ff9640 1 -- 172.21.15.17:0/867667293 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff414087a20 con 0x7ff42c155ca0 2023-08-09T12:45:57.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.076+0000 7ff42affd640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff40c06a050 0x7ff40c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:57.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.077+0000 7ff42affd640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff40c06a050 0x7ff40c06c510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00ba00 tx=0x7ff41c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.080+0000 7ff428ff9640 1 -- 172.21.15.17:0/867667293 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff4140531a0 con 0x7ff42c155ca0 2023-08-09T12:45:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.321+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff42c0b3470 con 0x7ff42c155ca0 2023-08-09T12:45:57.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.322+0000 7ff428ff9640 1 -- 172.21.15.17:0/867667293 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff414017060 con 0x7ff42c155ca0 2023-08-09T12:45:57.325 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:45:57.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff40c06a050 msgr2=0x7ff40c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:57.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff40c06a050 0x7ff40c06c510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00ba00 tx=0x7ff41c03d040 comp rx=0 tx=0).stop 2023-08-09T12:45:57.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c155ca0 msgr2=0x7ff42c156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:57.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c155ca0 0x7ff42c156120 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c3c0 tx=0x7ff41400c880 comp rx=0 tx=0).stop 2023-08-09T12:45:57.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 shutdown_connections 2023-08-09T12:45:57.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff40c06a050 0x7ff40c06c510 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c0b37c0 0x7ff42c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c155ca0 0x7ff42c156120 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 --2- 172.21.15.17:0/867667293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff418003970 0x7ff42c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:57.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 >> 172.21.15.17:0/867667293 conn(0x7ff42c0697c0 msgr2=0x7ff42c0b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:57.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 shutdown_connections 2023-08-09T12:45:57.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:57.325+0000 7ff42bfff640 1 -- 172.21.15.17:0/867667293 wait complete. 2023-08-09T12:45:57.348 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:45:57.349 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:45:57.349 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:45:57.349 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:45:57.349 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:45:57.350 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:45:57.350 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:45:57.350 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:45:57.351 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:45:57.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:57.351 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:45:57.411 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:45:57.411 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:45:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:45:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:45:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:57.413 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:45:57.413 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:57.413 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:45:57.413 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:45:57.414 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:57.414 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:45:57.414 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:45:57.415 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:57.415 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:45:57.415 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:57.415 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:45:57.416 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41811sec preferred_lft 41811sec 2023-08-09T12:45:57.416 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:45:57.416 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:57.416 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:45:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:45:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:45:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:45:57.418 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:57.418 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:45:57.418 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:45:57.418 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:45:57.419 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:57.419 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:45:57.419 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:45:57.419 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:45:57.420 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:45:57.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:57.422 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:45:57.519 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:45:57.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:57.525 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:45:57.578 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:45:57.578 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:45:57.578 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:45:57.578 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:45:57.579 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:45:57.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:57.579 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:45:57.580 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:45:57.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:45:57.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:45:57.581 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:45:57.581 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:45:57.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:57.772 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:45:57.820 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:45:57.820 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:45:57.820 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:45:57.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:57.821 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:45:57.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:45:57.963 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:45:58.019 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:45:58.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:45:58.020 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:45:58.069 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:45:58.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:58.070 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:45:58.202 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:45:58.202 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:45:58.203 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:45:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:45:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:45:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:45:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:45:58.228 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:45:58.247 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:45:58.247 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:45:58.247 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:45:58.247 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:45:58.248 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:45:58.248 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:45:58.248 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:45:58.248 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:45:58.249 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:45:58.249 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:45:58.249 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:45:58.249 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:45:58.250 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:45:58.253 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:45:58.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:58.254 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:45:58.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:58.348 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:45:58.408 INFO:teuthology.orchestra.run.smithi142.stdout:client5860 2023-08-09T12:45:58.408 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:45:58.409 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:58.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:45:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.691+0000 7f8b6ef34640 1 Processor -- start 2023-08-09T12:45:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.691+0000 7f8b6ef34640 1 -- start start 2023-08-09T12:45:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.693+0000 7f8b6ef34640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b681601f0 0x7f8b680b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.693+0000 7f8b6ef34640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8b680b2ee0 0x7f8b680caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.693+0000 7f8b6ef34640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b680c3250 con 0x7f8b680cb440 2023-08-09T12:45:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.693+0000 7f8b6ef34640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b680b4120 con 0x7f8b680b2ee0 2023-08-09T12:45:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.693+0000 7f8b6ef34640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680cb870 con 0x7f8b681601f0 2023-08-09T12:45:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.693+0000 7f8b6d731640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8b680b2ee0 0x7f8b680caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.694+0000 7f8b6d731640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8b680b2ee0 0x7f8b680caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35172/0 (socket says 172.21.15.17:35172) 2023-08-09T12:45:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.694+0000 7f8b6d731640 1 -- 172.21.15.17:0/3667948418 learned_addr learned my addr 172.21.15.17:0/3667948418 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.694+0000 7f8b6df32640 1 --2- 172.21.15.17:0/3667948418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b681601f0 0x7f8b680b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.694+0000 7f8b6d731640 1 -- 172.21.15.17:0/3667948418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b681601f0 msgr2=0x7f8b680b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.694+0000 7f8b6d731640 1 --2- 172.21.15.17:0/3667948418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b681601f0 0x7f8b680b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.694+0000 7f8b6d731640 1 -- 172.21.15.17:0/3667948418 >> v1:172.21.15.142:6789/0 conn(0x7f8b680cb440 legacy=0x7f8b680697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:45:58.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.694+0000 7f8b6d731640 1 -- 172.21.15.17:0/3667948418 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b680b34a0 con 0x7f8b680b2ee0 2023-08-09T12:45:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.695+0000 7f8b6d731640 1 --2- 172.21.15.17:0/3667948418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b680b2ee0 0x7f8b680caf00 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009870 tx=0x7f8b5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba4b342c5598590 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.696+0000 7f8b6cf30640 1 -- 172.21.15.17:0/3667948418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58031640 con 0x7f8b680b2ee0 2023-08-09T12:45:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.696+0000 7f8b6cf30640 1 -- 172.21.15.17:0/3667948418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580317a0 con 0x7f8b680b2ee0 2023-08-09T12:45:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.696+0000 7f8b6cf30640 1 -- 172.21.15.17:0/3667948418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58031b30 con 0x7f8b680b2ee0 2023-08-09T12:45:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.696+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3667948418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b680b2ee0 msgr2=0x7f8b680caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.696+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3667948418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b680b2ee0 0x7f8b680caf00 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009870 tx=0x7f8b5802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.696+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3667948418 shutdown_connections 2023-08-09T12:45:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.696+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3667948418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b680b2ee0 0x7f8b680caf00 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.697+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3667948418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b681601f0 0x7f8b680b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.697+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3667948418 >> 172.21.15.17:0/3667948418 conn(0x7f8b680b1d50 msgr2=0x7f8b6806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.697+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3667948418 shutdown_connections 2023-08-09T12:45:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.697+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3667948418 wait complete. 2023-08-09T12:45:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.698+0000 7f8b6ef34640 1 Processor -- start 2023-08-09T12:45:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.699+0000 7f8b6ef34640 1 -- start start 2023-08-09T12:45:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.699+0000 7f8b6ef34640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b680b2ee0 0x7f8b6806f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.699+0000 7f8b6ef34640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b680cb440 0x7f8b680c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.699+0000 7f8b6ef34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b681601f0 0x7f8b680c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.699+0000 7f8b6ef34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6806f7d0 con 0x7f8b681601f0 2023-08-09T12:45:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.699+0000 7f8b6ef34640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6806fab0 con 0x7f8b680b2ee0 2023-08-09T12:45:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.699+0000 7f8b6ef34640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6806fd90 con 0x7f8b680cb440 2023-08-09T12:45:58.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6e733640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b681601f0 0x7f8b680c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:58.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6e733640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b681601f0 0x7f8b680c2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35182/0 (socket says 172.21.15.17:35182) 2023-08-09T12:45:58.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6e733640 1 -- 172.21.15.17:0/3434208409 learned_addr learned my addr 172.21.15.17:0/3434208409 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:45:58.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6df32640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b680b2ee0 0x7f8b6806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:58.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6d731640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b680cb440 0x7f8b680c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6e733640 1 -- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b680cb440 msgr2=0x7f8b680c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6e733640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b680cb440 0x7f8b680c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6e733640 1 -- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b680b2ee0 msgr2=0x7f8b6806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6e733640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b680b2ee0 0x7f8b6806f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6e733640 1 -- 172.21.15.17:0/3434208409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580094d0 con 0x7f8b681601f0 2023-08-09T12:45:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.700+0000 7f8b6d731640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b680cb440 0x7f8b680c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:45:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.701+0000 7f8b6e733640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b681601f0 0x7f8b680c2740 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000c780 tx=0x7f8b6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.701+0000 7f8b5e7fc640 1 -- 172.21.15.17:0/3434208409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60004b60 con 0x7f8b681601f0 2023-08-09T12:45:58.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.701+0000 7f8b5e7fc640 1 -- 172.21.15.17:0/3434208409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6000ce90 con 0x7f8b681601f0 2023-08-09T12:45:58.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.701+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b68070070 con 0x7f8b681601f0 2023-08-09T12:45:58.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.701+0000 7f8b5e7fc640 1 -- 172.21.15.17:0/3434208409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000a850 con 0x7f8b681601f0 2023-08-09T12:45:58.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.701+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b680ad8f0 con 0x7f8b681601f0 2023-08-09T12:45:58.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.702+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b680adb40 con 0x7f8b681601f0 2023-08-09T12:45:58.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.704+0000 7f8b5e7fc640 1 -- 172.21.15.17:0/3434208409 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8b6000a9b0 con 0x7f8b681601f0 2023-08-09T12:45:58.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.704+0000 7f8b5e7fc640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b4c06a050 0x7f8b4c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:45:58.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.705+0000 7f8b5e7fc640 1 -- 172.21.15.17:0/3434208409 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b60088770 con 0x7f8b681601f0 2023-08-09T12:45:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.705+0000 7f8b6df32640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b4c06a050 0x7f8b4c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:45:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.706+0000 7f8b6df32640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b4c06a050 0x7f8b4c06c510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8b64006fd0 tx=0x7f8b64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:45:58.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.709+0000 7f8b5e7fc640 1 -- 172.21.15.17:0/3434208409 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8b60053e50 con 0x7f8b681601f0 2023-08-09T12:45:58.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.942+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b6804e390 con 0x7f8b681601f0 2023-08-09T12:45:58.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.943+0000 7f8b5e7fc640 1 -- 172.21.15.17:0/3434208409 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f8b60057470 con 0x7f8b681601f0 2023-08-09T12:45:58.947 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:45:58.947 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:45:58.948 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:45:58.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.946+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b4c06a050 msgr2=0x7f8b4c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:58.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.946+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b4c06a050 0x7f8b4c06c510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8b64006fd0 tx=0x7f8b64008040 comp rx=0 tx=0).stop 2023-08-09T12:45:58.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.946+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b681601f0 msgr2=0x7f8b680c2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:45:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.946+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b681601f0 0x7f8b680c2740 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000c780 tx=0x7f8b6000cc40 comp rx=0 tx=0).stop 2023-08-09T12:45:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.946+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 shutdown_connections 2023-08-09T12:45:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.946+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8b4c06a050 0x7f8b4c06c510 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.946+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b681601f0 0x7f8b680c2740 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.947+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b680cb440 0x7f8b680c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.947+0000 7f8b6ef34640 1 --2- 172.21.15.17:0/3434208409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b680b2ee0 0x7f8b6806f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:45:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.947+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 >> 172.21.15.17:0/3434208409 conn(0x7f8b680b1d50 msgr2=0x7f8b680cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:45:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.947+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 shutdown_connections 2023-08-09T12:45:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:45:58.947+0000 7f8b6ef34640 1 -- 172.21.15.17:0/3434208409 wait complete. 2023-08-09T12:45:58.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-08-09T12:45:59.217 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":7029,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.990495988999999,"mdsmap_epoch":51,"osdmap_epoch":110,"osdmap_epoch_barrier":110,"uptime":21.810823457000001} 2023-08-09T12:45:59.218 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 7029, "mdsmap_epoch": 51, "osdmap_epoch": 110, "osdmap_epoch_barrier": 110, "rank_uptime": 15.990495989, "state": "up:active", "uptime": 21.810823457, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:45:59.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-09T12:45:59.465 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_mon_report_interval":"5"} 2023-08-09T12:45:59.466 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-09T12:45:59.466 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-08-09T12:45:59.467 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:45:59.467 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:45:59.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:45:59.521 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-08-09T12:46:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:265+0 records in 2023-08-09T12:46:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:265+0 records out 2023-08-09T12:46:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.96526 s, 141 MB/s 2023-08-09T12:46:01.545 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:01.545 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:01.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:01.585 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-08-09T12:46:03.878 INFO:teuthology.orchestra.run.smithi017.stderr:292+0 records in 2023-08-09T12:46:03.878 INFO:teuthology.orchestra.run.smithi017.stderr:292+0 records out 2023-08-09T12:46:03.879 INFO:teuthology.orchestra.run.smithi017.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.19682 s, 139 MB/s 2023-08-09T12:46:03.879 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-08-09T12:46:03.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:46:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.066+0000 7f91e62ee640 1 Processor -- start 2023-08-09T12:46:04.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.066+0000 7f91e62ee640 1 -- start start 2023-08-09T12:46:04.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91e62ee640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f91e0161660 0x7f91e00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:04.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91e62ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:04.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91e62ee640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e00ad240 con 0x7f91e0161280 2023-08-09T12:46:04.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91e62ee640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e015d430 con 0x7f91e0161660 2023-08-09T12:46:04.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91e62ee640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e015df30 con 0x7f91e00acdf0 2023-08-09T12:46:04.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91dffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f91e0161280 0x7f91e00c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42884/0 (socket says 172.21.15.17:42884) 2023-08-09T12:46:04.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91d7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f91e0161660 0x7f91e00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:04.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91dffff640 1 -- 172.21.15.17:0/2967164915 learned_addr learned my addr 172.21.15.17:0/2967164915 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:04.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.068+0000 7f91e488b640 1 --2- 172.21.15.17:0/2967164915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:04.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.069+0000 7f91d7fff640 1 -- 172.21.15.17:0/2967164915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 msgr2=0x7f91e00cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:04.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.069+0000 7f91d7fff640 1 --2- 172.21.15.17:0/2967164915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.069+0000 7f91d7fff640 1 -- 172.21.15.17:0/2967164915 >> v1:172.21.15.17:6789/0 conn(0x7f91e0161280 legacy=0x7f91e00c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:04.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.069+0000 7f91d7fff640 1 -- 172.21.15.17:0/2967164915 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00ca9d0 con 0x7f91e0161660 2023-08-09T12:46:04.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.069+0000 7f91e488b640 1 --2- 172.21.15.17:0/2967164915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:04.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.070+0000 7f91d7fff640 1 --2- 172.21.15.17:0/2967164915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00ac8b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009790 tx=0x7f91c802b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1546b57f557d286 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:04.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.070+0000 7f91df7fe640 1 -- 172.21.15.17:0/2967164915 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8031770 con 0x7f91e0161660 2023-08-09T12:46:04.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.070+0000 7f91df7fe640 1 -- 172.21.15.17:0/2967164915 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c80318d0 con 0x7f91e0161660 2023-08-09T12:46:04.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.070+0000 7f91df7fe640 1 -- 172.21.15.17:0/2967164915 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8031c60 con 0x7f91e0161660 2023-08-09T12:46:04.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.071+0000 7f91e62ee640 1 -- 172.21.15.17:0/2967164915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 msgr2=0x7f91e00ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:04.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.071+0000 7f91e62ee640 1 --2- 172.21.15.17:0/2967164915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00ac8b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009790 tx=0x7f91c802b810 comp rx=0 tx=0).stop 2023-08-09T12:46:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.071+0000 7f91e62ee640 1 -- 172.21.15.17:0/2967164915 shutdown_connections 2023-08-09T12:46:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.071+0000 7f91e62ee640 1 --2- 172.21.15.17:0/2967164915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.071+0000 7f91e62ee640 1 --2- 172.21.15.17:0/2967164915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00ac8b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.071+0000 7f91e62ee640 1 -- 172.21.15.17:0/2967164915 >> 172.21.15.17:0/2967164915 conn(0x7f91e00cb1b0 msgr2=0x7f91e00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.071+0000 7f91e62ee640 1 -- 172.21.15.17:0/2967164915 shutdown_connections 2023-08-09T12:46:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.071+0000 7f91e62ee640 1 -- 172.21.15.17:0/2967164915 wait complete. 2023-08-09T12:46:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.073+0000 7f91e62ee640 1 Processor -- start 2023-08-09T12:46:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.073+0000 7f91e62ee640 1 -- start start 2023-08-09T12:46:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e62ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e62ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0161280 0x7f91e014e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e62ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e62ee640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e0154530 con 0x7f91e0161660 2023-08-09T12:46:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e62ee640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e0154af0 con 0x7f91e0161280 2023-08-09T12:46:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e62ee640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00c2e50 con 0x7f91e00acdf0 2023-08-09T12:46:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e488b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e488b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35198/0 (socket says 172.21.15.17:35198) 2023-08-09T12:46:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91e488b640 1 -- 172.21.15.17:0/3252768198 learned_addr learned my addr 172.21.15.17:0/3252768198 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.074+0000 7f91d7fff640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0161280 0x7f91e014e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91dffff640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91e488b640 1 -- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 msgr2=0x7f91e00c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91e488b640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91e488b640 1 -- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0161280 msgr2=0x7f91e014e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91e488b640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0161280 0x7f91e014e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91e488b640 1 -- 172.21.15.17:0/3252768198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80093a0 con 0x7f91e0161660 2023-08-09T12:46:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91dffff640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91d7fff640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0161280 0x7f91e014e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91e488b640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00c4140 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f91d800cd80 tx=0x7f91d800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91dd7fa640 1 -- 172.21.15.17:0/3252768198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800f680 con 0x7f91e0161660 2023-08-09T12:46:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91dd7fa640 1 -- 172.21.15.17:0/3252768198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d800f800 con 0x7f91e0161660 2023-08-09T12:46:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e00c3120 con 0x7f91e0161660 2023-08-09T12:46:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91dd7fa640 1 -- 172.21.15.17:0/3252768198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800fbb0 con 0x7f91e0161660 2023-08-09T12:46:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.075+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e0154780 con 0x7f91e0161660 2023-08-09T12:46:04.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.077+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e0067a80 con 0x7f91e0161660 2023-08-09T12:46:04.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.077+0000 7f91dd7fa640 1 -- 172.21.15.17:0/3252768198 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91d800b040 con 0x7f91e0161660 2023-08-09T12:46:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.078+0000 7f91dd7fa640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c006a050 0x7f91c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.078+0000 7f91dd7fa640 1 -- 172.21.15.17:0/3252768198 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91d8089010 con 0x7f91e0161660 2023-08-09T12:46:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.079+0000 7f91dffff640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c006a050 0x7f91c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.080+0000 7f91dffff640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c006a050 0x7f91c006c510 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f91d0000f60 tx=0x7f91d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.083+0000 7f91dd7fa640 1 -- 172.21.15.17:0/3252768198 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f91d80546f0 con 0x7f91e0161660 2023-08-09T12:46:04.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.279+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f91e00adc60 con 0x7f91e0161660 2023-08-09T12:46:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.281+0000 7f91dd7fa640 1 -- 172.21.15.17:0/3252768198 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+36928 (secure 0 0 0) 0x7f91d8057d10 con 0x7f91e0161660 2023-08-09T12:46:04.284 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:04.285 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:46:04.285 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 110, 2023-08-09T12:46:04.285 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:46:04.285 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:46:04.285 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:45:44.179943+0000", 2023-08-09T12:46:04.285 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:46:04.285 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:46:04.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:46:04.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:46:04.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:46:04.286 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:46:04.286 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:46:04.286 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:46:04.286 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:46:04.286 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:04.287 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:46:04.287 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:46:04.287 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:46:04.287 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:46:04.287 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:46:04.287 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 14, 2023-08-09T12:46:04.287 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:46:04.288 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:46:04.288 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:46:04.288 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:46:04.288 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:46:04.288 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:46:04.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.288 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:46:04.288 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:46:04.289 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:46:04.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:04.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:04.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:04.289 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:04.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:04.289 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:04.290 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:04.290 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:04.290 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:04.290 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:04.290 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:04.290 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:46:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:46:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:46:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:46:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:46:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:04.292 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:04.292 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:04.292 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:04.292 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:04.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.292 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "99", 2023-08-09T12:46:04.293 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:04.293 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:04.293 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:04.293 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:04.293 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:04.293 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:04.293 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:04.293 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:04.294 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:04.294 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:04.294 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:04.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:04.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:04.294 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:04.294 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:04.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:04.295 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:04.295 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:04.295 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:04.295 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:04.295 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:04.295 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:04.296 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:04.296 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:04.296 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:04.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:04.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.296 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:04.296 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:04.297 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:04.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:04.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:04.297 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:04.297 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:04.297 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:04.297 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:04.298 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:04.298 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:04.298 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:04.298 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:46:04.298 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:46:04.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.298 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:04.298 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:46:04.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.299 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:04.299 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:46:04.299 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:46:04.299 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:46:04.299 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:46:04.300 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:46:04.300 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:04.300 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:04.300 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:04.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.301 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:46:04.301 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:46:04.301 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:46:04.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:04.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:04.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:04.301 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:04.301 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:04.302 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:04.302 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:04.302 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:04.302 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:04.302 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:04.302 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:04.303 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:04.303 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:46:04.303 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:46:04.303 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:46:04.303 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:46:04.303 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:46:04.304 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:04.304 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:04.304 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:04.304 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:04.304 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:04.304 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:04.304 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "99", 2023-08-09T12:46:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:04.306 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:04.306 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:04.306 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:04.306 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:04.306 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:04.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:04.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:04.307 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:04.307 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:04.307 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:04.307 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:04.307 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:04.307 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:04.307 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:04.308 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:04.308 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:04.308 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:04.308 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:04.308 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:04.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:04.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.309 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:04.309 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:04.309 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:04.309 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:04.309 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:04.309 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:04.309 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:04.309 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:04.310 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:04.310 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:04.310 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:04.310 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:46:04.310 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:04.310 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:46:04.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.311 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:04.311 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:46:04.311 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:46:04.311 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:46:04.311 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:04.311 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:04.311 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:04.311 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:04.312 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:04.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.312 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 13, 2023-08-09T12:46:04.312 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:46:04.312 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.039914+0000", 2023-08-09T12:46:04.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:04.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:04.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:04.313 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:04.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:04.314 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:04.314 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:04.314 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:04.314 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:04.314 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:04.314 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:04.314 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:04.315 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:46:04.315 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:46:04.315 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:46:04.315 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:46:04.316 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:46:04.316 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:04.316 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:04.316 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:04.316 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:04.316 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:04.317 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:04.317 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:04.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.317 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "109", 2023-08-09T12:46:04.317 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:04.317 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:04.317 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:04.317 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:04.318 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:04.318 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:04.318 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:04.318 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:04.318 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:04.318 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:04.318 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:04.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:04.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:04.319 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:04.319 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:04.319 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:04.319 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:04.319 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:04.319 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:04.320 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:04.320 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:04.320 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:04.320 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:04.320 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:04.320 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:04.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:04.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.321 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:04.321 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:04.321 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:04.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:04.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:04.321 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:04.321 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:04.322 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:04.322 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:04.322 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:04.322 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:04.322 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:04.323 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:46:04.323 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:46:04.323 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:46:04.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.323 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:04.323 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:04.324 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:46:04.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.324 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:04.324 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:46:04.324 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:46:04.325 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:04.325 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:46:04.325 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:46:04.325 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:04.325 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:04.325 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:04.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.326 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 14, 2023-08-09T12:46:04.326 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:46:04.326 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.697620+0000", 2023-08-09T12:46:04.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:04.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:04.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:04.327 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:04.327 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:04.327 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:04.327 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:04.327 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:04.327 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:04.328 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:04.328 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:04.328 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:04.328 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:46:04.328 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:46:04.328 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:46:04.328 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:46:04.328 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:46:04.329 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:04.329 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:04.329 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:04.329 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:04.329 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:04.329 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:04.330 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:04.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.330 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "110", 2023-08-09T12:46:04.330 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:04.330 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:04.330 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:04.330 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:04.330 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:04.331 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:04.331 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:04.331 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:04.331 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:04.331 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:04.331 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:04.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:04.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:04.332 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:04.332 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:04.332 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:04.332 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:04.332 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:04.332 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:04.332 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:04.333 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:04.333 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:04.333 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:04.333 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:04.334 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:04.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:04.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.334 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:04.335 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:04.335 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:04.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:04.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:04.336 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:04.336 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:04.336 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:04.336 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:04.336 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:04.336 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:04.336 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:04.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:46:04.337 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:46:04.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.337 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:04.337 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:04.337 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:46:04.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.338 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:04.338 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:46:04.338 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:46:04.338 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:04.338 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:04.338 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:04.338 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:04.338 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:04.339 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:04.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.339 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:04.339 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:46:04.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.339 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:04.339 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:04.340 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:04.340 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:04.340 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:04.340 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:04.340 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:04.340 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:04.340 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:04.341 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:04.341 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:04.341 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:04.341 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:04.341 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.341 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:46:04.342 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:04.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.342 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:46:04.342 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:04.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.342 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.343 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:04.343 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.343 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:46:04.344 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:04.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.344 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:46:04.344 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:04.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.345 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.345 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:04.345 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.345 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:46:04.345 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:04.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.346 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:46:04.347 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:04.347 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.347 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.347 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:04.348 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.348 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:46:04.348 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:04.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.349 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:46:04.349 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:04.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.350 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:46:04.350 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:46:04.350 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:46:04.350 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:46:04.350 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:04.350 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:04.351 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:04.351 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.351 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:04.351 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:04.351 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:04.352 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:04.352 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:04.352 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:04.352 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:04.352 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:04.352 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:04.352 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:04.353 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:04.353 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:04.353 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:04.353 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.354 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:46:04.354 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:04.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.354 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:46:04.355 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:04.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.355 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.355 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:04.355 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.356 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:46:04.356 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:04.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.356 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:46:04.356 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:04.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.357 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.357 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:04.357 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.358 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:46:04.358 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:04.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.359 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:46:04.359 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:04.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.360 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.360 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:04.361 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.361 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:46:04.362 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:04.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.362 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:46:04.362 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:04.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.363 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:46:04.363 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:46:04.363 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:46:04.363 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:46:04.363 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:04.363 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:04.364 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:04.364 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.364 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:04.365 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:04.365 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:04.365 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:04.365 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:04.366 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:04.366 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:04.366 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:04.366 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:04.366 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:04.367 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:04.367 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:04.367 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:04.367 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.368 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:46:04.368 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:04.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.369 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:46:04.369 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:04.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.370 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.370 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:04.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:46:04.371 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:04.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:46:04.372 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:04.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.373 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:04.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.374 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:46:04.374 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:04.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.375 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:46:04.375 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:04.376 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.376 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.376 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:04.376 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.377 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:46:04.377 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:04.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.378 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:46:04.378 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:04.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.379 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.379 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:46:04.379 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:46:04.379 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:46:04.380 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:46:04.380 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:04.380 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:04.380 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:04.380 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:04.382 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:04.382 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:04.382 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:04.382 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:04.382 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:04.383 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:04.383 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:04.383 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:04.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:46:04.384 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:04.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.385 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:46:04.385 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:04.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.386 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:04.386 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.387 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:46:04.387 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:04.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.388 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:46:04.388 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:04.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.389 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.389 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:04.389 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.390 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:46:04.390 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:04.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.391 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:46:04.391 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:04.391 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.392 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.392 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:04.392 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:46:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:04.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.395 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:46:04.395 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:04.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.396 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:46:04.396 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:46:04.397 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:46:04.397 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:46:04.397 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:04.397 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:04.398 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:04.398 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.399 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:04.399 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:04.399 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:04.400 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:04.400 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:04.400 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:04.400 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:04.400 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:04.401 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:04.401 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:04.401 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:04.401 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:04.401 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:04.401 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.402 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:46:04.402 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:04.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.402 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:46:04.402 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:04.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.403 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.403 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:04.403 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.403 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:46:04.404 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:04.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.404 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:46:04.404 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:04.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.405 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.405 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:04.405 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.405 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:46:04.406 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:04.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.406 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:46:04.406 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:04.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.407 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.407 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:04.407 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.407 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:46:04.407 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:04.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.408 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:46:04.408 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:04.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.409 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.409 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:46:04.409 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:46:04.409 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:46:04.409 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:46:04.409 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:04.409 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:04.411 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:04.411 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:04.411 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:04.411 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:04.411 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:04.411 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:04.411 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:04.411 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:04.412 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:04.412 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.412 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:46:04.412 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:04.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.413 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:46:04.413 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:04.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.413 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.413 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:04.414 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.414 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:46:04.414 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:04.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.415 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:46:04.415 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:04.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.415 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.415 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:04.415 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.416 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:46:04.416 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:04.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.416 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:46:04.417 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:04.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.417 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.417 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:04.417 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.418 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:46:04.418 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:04.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.418 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:46:04.419 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:04.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.419 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.419 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:46:04.419 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:46:04.419 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:46:04.420 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:46:04.420 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:04.420 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:04.420 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:04.420 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.420 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:04.422 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:04.422 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:04.422 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:04.422 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:04.422 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.423 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:46:04.423 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:04.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.424 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:46:04.425 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:04.425 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.425 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.426 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:04.426 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.426 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:46:04.426 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:04.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.427 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:46:04.427 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:04.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.428 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:04.428 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.428 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:46:04.428 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:04.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.429 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:46:04.429 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:04.429 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.430 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.430 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:04.430 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.431 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:46:04.431 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:04.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.432 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:46:04.433 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:04.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.433 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:46:04.433 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:46:04.434 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:46:04.434 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:46:04.434 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:04.434 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:04.434 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:04.434 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:46:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:46:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:46:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:46:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:46:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:46:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:46:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:46:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:46:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:46:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:46:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:46:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:46:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:46:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:46:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:46:04.450 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:04.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.450 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:04.450 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:04.450 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:04.450 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:04.450 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:04.451 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:04.451 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:46:04.451 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:04.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:04.451 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:04.452 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:04.452 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:04.452 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:04.452 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:04.452 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:46:04.452 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:04.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.453 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:04.453 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:04.453 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:04.453 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:04.453 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:04.453 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:04.453 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:46:04.454 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:04.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.454 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:04.454 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:04.455 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:04.455 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:04.455 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:04.455 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:04.455 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:46:04.455 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:04.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:04.456 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:04.456 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:04.456 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:04.456 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:04.456 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:04.456 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:04.456 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:46:04.457 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:04.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.457 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:04.457 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:46:04.457 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:46:04.457 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:46:04.457 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:46:04.457 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:46:04.458 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:46:04.458 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:46:04.458 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:46:04.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:46:04.458 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:46:04.458 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:46:04.458 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:46:04.458 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:46:04.459 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:46:04.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:04.459 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:46:04.459 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:46:04.459 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:46:04.460 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:46:04.460 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:46:04.460 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:46:04.460 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:46:04.460 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:46:04.460 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:46:04.460 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:46:04.461 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:46:04.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:04.461 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:46:04.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.283+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c006a050 msgr2=0x7f91c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.283+0000 7f91e62ee640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c006a050 0x7f91c006c510 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f91d0000f60 tx=0x7f91d0009040 comp rx=0 tx=0).stop 2023-08-09T12:46:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.283+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 msgr2=0x7f91e00c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.283+0000 7f91e62ee640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00c4140 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f91d800cd80 tx=0x7f91d800a650 comp rx=0 tx=0).stop 2023-08-09T12:46:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.284+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 shutdown_connections 2023-08-09T12:46:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.284+0000 7f91e62ee640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91c006a050 0x7f91c006c510 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.284+0000 7f91e62ee640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e0161660 0x7f91e00c4140 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.284+0000 7f91e62ee640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e0161280 0x7f91e014e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.284+0000 7f91e62ee640 1 --2- 172.21.15.17:0/3252768198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e00acdf0 0x7f91e00c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:04.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.284+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 >> 172.21.15.17:0/3252768198 conn(0x7f91e00cb1b0 msgr2=0x7f91e006b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:04.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.284+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 shutdown_connections 2023-08-09T12:46:04.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:04.284+0000 7f91e62ee640 1 -- 172.21.15.17:0/3252768198 wait complete. 2023-08-09T12:46:04.465 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:46:05.825 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:46:05.822+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-08-09T12:46:09.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:46:09.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.704+0000 7ff58bc0d640 1 Processor -- start 2023-08-09T12:46:09.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.704+0000 7ff58bc0d640 1 -- start start 2023-08-09T12:46:09.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.705+0000 7ff58bc0d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff5840b3b40 0x7ff5840b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:09.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff58bc0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 0x7ff5840ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:09.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff58bc0d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58406c990 con 0x7ff5840adc40 2023-08-09T12:46:09.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff58bc0d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5840ae020 con 0x7ff5840b3b40 2023-08-09T12:46:09.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff58bc0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5840b2250 con 0x7ff5840cc630 2023-08-09T12:46:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff5891a8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff5840b3b40 0x7ff5840b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff5891a8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff5840b3b40 0x7ff5840b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54916/0 (socket says 172.21.15.17:54916) 2023-08-09T12:46:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff5891a8640 1 -- 172.21.15.17:0/2253880716 learned_addr learned my addr 172.21.15.17:0/2253880716 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff5891a8640 1 -- 172.21.15.17:0/2253880716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 msgr2=0x7ff5840ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff5891a8640 1 --2- 172.21.15.17:0/2253880716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 0x7ff5840ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff5891a8640 1 -- 172.21.15.17:0/2253880716 >> v1:172.21.15.142:6789/0 conn(0x7ff5840adc40 legacy=0x7ff58406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.706+0000 7ff5891a8640 1 -- 172.21.15.17:0/2253880716 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5840b2530 con 0x7ff5840b3b40 2023-08-09T12:46:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.708+0000 7ff5891a8640 1 --2- 172.21.15.17:0/2253880716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840b3fd0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ff574009850 tx=0x7ff57402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3b029919667048 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.708+0000 7ff5889a7640 1 -- 172.21.15.17:0/2253880716 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574004230 con 0x7ff5840b3b40 2023-08-09T12:46:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.708+0000 7ff5889a7640 1 -- 172.21.15.17:0/2253880716 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff574004390 con 0x7ff5840b3b40 2023-08-09T12:46:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.708+0000 7ff5889a7640 1 -- 172.21.15.17:0/2253880716 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574031830 con 0x7ff5840b3b40 2023-08-09T12:46:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.708+0000 7ff58bc0d640 1 -- 172.21.15.17:0/2253880716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 msgr2=0x7ff5840b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.708+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/2253880716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840b3fd0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ff574009850 tx=0x7ff57402b8d0 comp rx=0 tx=0).stop 2023-08-09T12:46:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.709+0000 7ff58bc0d640 1 -- 172.21.15.17:0/2253880716 shutdown_connections 2023-08-09T12:46:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.709+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/2253880716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 0x7ff5840ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.709+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/2253880716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840b3fd0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.709+0000 7ff58bc0d640 1 -- 172.21.15.17:0/2253880716 >> 172.21.15.17:0/2253880716 conn(0x7ff5840cb1b0 msgr2=0x7ff5840cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.709+0000 7ff58bc0d640 1 -- 172.21.15.17:0/2253880716 shutdown_connections 2023-08-09T12:46:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.709+0000 7ff58bc0d640 1 -- 172.21.15.17:0/2253880716 wait complete. 2023-08-09T12:46:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.711+0000 7ff58bc0d640 1 Processor -- start 2023-08-09T12:46:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.711+0000 7ff58bc0d640 1 -- start start 2023-08-09T12:46:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff58bc0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840adc40 0x7ff5841f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff58bc0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff58bc0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 0x7ff5840af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff58bc0d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5841460e0 con 0x7ff5840b3b40 2023-08-09T12:46:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff58bc0d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5841f24a0 con 0x7ff5840adc40 2023-08-09T12:46:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff58bc0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff584145460 con 0x7ff5840cc630 2023-08-09T12:46:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff5891a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff5891a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54924/0 (socket says 172.21.15.17:54924) 2023-08-09T12:46:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.712+0000 7ff5891a8640 1 -- 172.21.15.17:0/720558540 learned_addr learned my addr 172.21.15.17:0/720558540 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff5891a8640 1 -- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 msgr2=0x7ff5840af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff5899a9640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840adc40 0x7ff5841f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff58a1aa640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 0x7ff5840af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff5891a8640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 0x7ff5840af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff5891a8640 1 -- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840adc40 msgr2=0x7ff5841f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff5891a8640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840adc40 0x7ff5841f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff5891a8640 1 -- 172.21.15.17:0/720558540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574009460 con 0x7ff5840b3b40 2023-08-09T12:46:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff5891a8640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840af0c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ff5740090b0 tx=0x7ff5740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff57a7fc640 1 -- 172.21.15.17:0/720558540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574031830 con 0x7ff5840b3b40 2023-08-09T12:46:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff57a7fc640 1 -- 172.21.15.17:0/720558540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57403f070 con 0x7ff5840b3b40 2023-08-09T12:46:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff57a7fc640 1 -- 172.21.15.17:0/720558540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574031bb0 con 0x7ff5840b3b40 2023-08-09T12:46:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.713+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff584145740 con 0x7ff5840b3b40 2023-08-09T12:46:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.714+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff584145d00 con 0x7ff5840b3b40 2023-08-09T12:46:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.715+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff584146220 con 0x7ff5840b3b40 2023-08-09T12:46:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.716+0000 7ff57a7fc640 1 -- 172.21.15.17:0/720558540 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff574041030 con 0x7ff5840b3b40 2023-08-09T12:46:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.717+0000 7ff57a7fc640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56806a050 0x7ff56806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.717+0000 7ff57a7fc640 1 -- 172.21.15.17:0/720558540 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5740aa940 con 0x7ff5840b3b40 2023-08-09T12:46:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.717+0000 7ff57a7fc640 1 -- 172.21.15.17:0/720558540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7ff568072220 con 0x7ff5840b3b40 2023-08-09T12:46:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.717+0000 7ff5899a9640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56806a050 0x7ff56806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.719+0000 7ff5899a9640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56806a050 0x7ff56806c510 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff580007fd0 tx=0x7ff580009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:09.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.722+0000 7ff57a7fc640 1 -- 172.21.15.17:0/720558540 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff584146220 con 0x7ff5840b3b40 2023-08-09T12:46:09.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.924+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff584146220 con 0x7ff5840b3b40 2023-08-09T12:46:09.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.926+0000 7ff57a7fc640 1 -- 172.21.15.17:0/720558540 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+37046 (secure 0 0 0) 0x7ff584146220 con 0x7ff5840b3b40 2023-08-09T12:46:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:09.930 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:46:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 113, 2023-08-09T12:46:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:46:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:46:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:46:08.832557+0000", 2023-08-09T12:46:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:46:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:46:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:46:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:46:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:46:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:46:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:46:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:46:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:46:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:46:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:46:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:46:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:46:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:46:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 14, 2023-08-09T12:46:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:46:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:46:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:46:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:46:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:46:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:46:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:46:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:46:09.935 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:46:09.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:09.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:09.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:09.935 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:09.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:09.935 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:09.936 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:09.936 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:09.936 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:09.936 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:09.936 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:09.936 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:09.936 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:46:09.937 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:46:09.937 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:46:09.937 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:46:09.937 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:46:09.937 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:09.937 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:09.937 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:09.938 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:09.938 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:09.938 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:09.938 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:09.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.938 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:09.938 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:09.939 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:09.939 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:09.939 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:09.939 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:09.939 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:09.939 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:09.939 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:09.940 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:09.940 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:09.940 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:09.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:09.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:09.940 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:09.940 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:09.942 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:09.942 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:09.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:09.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.942 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:09.942 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:09.942 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:09.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:09.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:09.943 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:09.943 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:09.943 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:09.943 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:09.943 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:09.944 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:09.944 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:09.944 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:46:09.944 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:46:09.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.944 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:09.944 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:46:09.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.945 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:09.945 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:46:09.945 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:46:09.945 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:46:09.945 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:46:09.945 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:46:09.945 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:09.946 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:09.946 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:09.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.946 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:46:09.946 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:46:09.947 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:46:09.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:09.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:09.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:09.947 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:09.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:09.947 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:09.948 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:09.948 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:09.948 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:09.948 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:09.948 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:09.948 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:09.948 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:46:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:46:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:46:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:46:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:46:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:46:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:46:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:46:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:46:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:46:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 13, 2023-08-09T12:46:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:46:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.039914+0000", 2023-08-09T12:46:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:46:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:46:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:46:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:46:09.961 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:46:09.961 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:09.961 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:09.961 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:09.961 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:09.961 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:09.961 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:09.962 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:09.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.962 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:09.962 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:09.962 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:09.962 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:09.962 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:09.963 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:09.963 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:09.963 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:09.963 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:09.963 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:09.963 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:09.963 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:09.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:09.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:09.964 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:09.964 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:09.964 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:09.964 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:09.964 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:09.965 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:09.965 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:09.965 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:09.965 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:09.965 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:09.965 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:09.965 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:09.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:09.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.966 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:09.966 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:09.966 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:09.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:09.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:09.966 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:46:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:46:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:46:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:46:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:46:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:46:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:46:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:46:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 14, 2023-08-09T12:46:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:46:09.971 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.697620+0000", 2023-08-09T12:46:09.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:09.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:09.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:09.971 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:09.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:09.971 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:09.972 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:09.972 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:09.972 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:09.972 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:09.972 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:09.972 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:09.972 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:46:09.973 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:46:09.973 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:46:09.973 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:46:09.973 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:46:09.973 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:09.973 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:09.973 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:09.974 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:09.974 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:09.974 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:09.974 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:09.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.974 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:09.974 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:09.975 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:09.975 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:09.975 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:09.975 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:09.975 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:09.975 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:09.975 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:09.975 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:09.976 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:09.976 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:09.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:09.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:09.976 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:09.976 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:09.976 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:09.977 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:09.977 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:09.977 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:09.977 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:09.977 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:09.977 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:09.977 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:09.978 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:09.978 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:09.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:09.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.978 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:09.978 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:09.978 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:09.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:09.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:09.979 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:09.979 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:09.979 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:09.979 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:09.979 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:09.980 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:09.980 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:09.980 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:46:09.980 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:46:09.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.980 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:09.980 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:09.980 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:46:09.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.981 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:09.981 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:46:09.981 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:46:09.981 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:09.981 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:09.982 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:09.982 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:09.982 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:09.982 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:09.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.982 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:09.983 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:46:09.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.983 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:09.983 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:09.983 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:09.983 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:09.983 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:09.984 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:09.984 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:09.984 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:09.984 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:09.984 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:09.984 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:09.984 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:46:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:09.986 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:46:09.986 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:09.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.986 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:09.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:09.987 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:09.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:09.987 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:46:09.987 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:09.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:09.988 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:46:09.988 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:09.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:09.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.988 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:09.989 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:09.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:09.989 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:46:09.989 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:09.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:09.990 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:46:09.990 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:09.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:09.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.990 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:09.990 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:09.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:09.991 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:46:09.991 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:09.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:09.992 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:46:09.992 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:09.992 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.992 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:09.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.992 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:46:09.992 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:46:09.993 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:46:09.993 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:46:09.993 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:09.993 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:09.993 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:09.993 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:09.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:09.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.994 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:09.994 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:09.994 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:09.994 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:09.994 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:09.994 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:09.995 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:09.995 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:09.995 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:09.995 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:09.995 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:09.995 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:09.996 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:09.996 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:09.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:09.996 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:46:09.997 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:09.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:09.997 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:46:09.997 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:09.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:09.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:09.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.998 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:09.998 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:09.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:09.998 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:46:09.999 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:09.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:09.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:09.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:09.999 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:46:09.999 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:09.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.000 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.000 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:10.000 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.000 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:46:10.001 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:10.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.001 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:46:10.001 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:10.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:46:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:10.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.003 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:46:10.003 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:10.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:46:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:46:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:46:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:46:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:10.005 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:10.005 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:10.005 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.005 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:10.005 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:10.006 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:10.006 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:10.006 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:10.006 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:10.006 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:10.006 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:10.006 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:10.006 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:10.007 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:10.007 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:10.007 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:10.007 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.007 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:46:10.008 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:10.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.008 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:46:10.008 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:10.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.009 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:10.009 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.009 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:46:10.010 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:10.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.010 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:46:10.010 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:10.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.011 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:10.011 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.011 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:46:10.011 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:10.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.012 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:46:10.012 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:10.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.012 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.013 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:10.013 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.013 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:46:10.013 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:10.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.014 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:46:10.014 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:10.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.014 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.015 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:46:10.015 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:46:10.015 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:46:10.015 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:46:10.015 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:10.015 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:10.015 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:10.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.016 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:10.016 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:10.016 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:10.016 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:10.017 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:10.017 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:10.017 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:10.017 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:10.017 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:10.017 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:10.017 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:10.018 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:10.018 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:10.018 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.018 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:46:10.018 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:10.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.019 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:46:10.019 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:10.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.019 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.020 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:10.020 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.020 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:46:10.020 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:10.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.021 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:46:10.021 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:10.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.022 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:10.022 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.022 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:46:10.022 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:10.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.023 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:46:10.023 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:10.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.023 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.023 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:10.024 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.024 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:46:10.024 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:10.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.025 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:46:10.025 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:10.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.025 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.025 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:46:10.026 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:46:10.026 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:46:10.026 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:46:10.026 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:10.026 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:10.026 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:10.026 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:10.027 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.027 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:10.027 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:10.027 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:10.027 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:10.027 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:10.028 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:10.028 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:10.028 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:10.028 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:10.028 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:10.028 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:10.028 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:10.029 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:10.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:46:10.029 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:10.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.030 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:46:10.030 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:10.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.030 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:10.031 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.031 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:46:10.031 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:10.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.032 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:46:10.032 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:10.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.032 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.032 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:10.033 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.033 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:46:10.033 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:10.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.034 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:46:10.034 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:10.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.034 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:10.035 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.035 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:46:10.035 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:10.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.036 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:46:10.036 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:10.036 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.036 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.036 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:46:10.036 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:46:10.037 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:46:10.037 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:46:10.037 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:10.037 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:10.037 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:10.037 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:10.037 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.038 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:10.038 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:10.038 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:10.038 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:10.038 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:10.039 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:10.039 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:10.039 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:10.039 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:10.039 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:10.039 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:10.039 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:10.040 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:10.040 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.040 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:46:10.040 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:10.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.041 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:46:10.041 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:10.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.041 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.041 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:10.042 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.042 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:46:10.042 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:10.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.043 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:46:10.043 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:10.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.043 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.043 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:10.044 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.044 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:46:10.044 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:10.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.045 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:46:10.045 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:10.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.045 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.045 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:10.046 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.046 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:46:10.046 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:10.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.047 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:46:10.047 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:10.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.047 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.047 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:46:10.047 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:46:10.048 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:46:10.048 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:46:10.048 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:10.048 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:10.048 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:10.048 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.049 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:10.049 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:10.049 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:10.049 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:10.049 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:10.049 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:10.050 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:10.050 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:10.050 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:10.050 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:10.050 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:10.050 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:10.050 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:10.050 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.051 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:46:10.051 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:10.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.052 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:46:10.052 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:10.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.052 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.052 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:10.052 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.053 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:46:10.053 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:10.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.054 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:46:10.054 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:10.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.054 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.054 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:10.054 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.055 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:46:10.055 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:10.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.055 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:46:10.056 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:10.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.056 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.056 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:10.056 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.057 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:46:10.057 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:10.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.057 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:46:10.058 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:10.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.058 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.058 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:46:10.058 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:46:10.058 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:46:10.059 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:46:10.059 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:10.059 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:10.059 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:10.059 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.060 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:10.060 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:10.060 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:10.060 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:10.060 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:10.060 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:10.060 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.062 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:46:10.062 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:10.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.062 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:46:10.063 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:10.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.063 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.063 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:10.063 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.064 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:46:10.064 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:10.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.064 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:46:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.066 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:46:10.066 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:10.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.066 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:46:10.066 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:10.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.067 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.067 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:10.067 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:10.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:46:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:46:10.068 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:10.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.069 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.069 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:46:10.069 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:46:10.069 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:46:10.069 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:46:10.070 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:10.070 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:10.070 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:10.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:10.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.070 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:10.070 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:46:10.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.071 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:10.071 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:10.071 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:10.071 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:10.071 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:10.071 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:10.072 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:46:10.072 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:10.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.072 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:10.072 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:10.072 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:10.072 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:10.073 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:10.073 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:10.073 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:46:10.073 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:10.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.073 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:10.074 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:10.074 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:10.074 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:10.074 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:10.074 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:10.074 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:46:10.074 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:10.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.075 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:10.075 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:10.075 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:10.075 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:10.075 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:10.076 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:10.076 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:46:10.076 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:10.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.076 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:10.076 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:10.077 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:10.077 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:10.077 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:10.077 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:10.077 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:46:10.077 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:10.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.078 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:10.078 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:10.078 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:10.078 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:10.078 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:10.078 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:10.078 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:46:10.079 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:10.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.079 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:10.079 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:10.079 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:10.079 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:10.080 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:10.080 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:10.080 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:46:10.080 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:10.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:10.080 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:10.081 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:10.081 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:10.081 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:10.081 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:10.081 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:10.081 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:46:10.081 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:10.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.082 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:10.082 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:46:10.082 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:46:10.082 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:46:10.082 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:46:10.082 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:46:10.082 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:46:10.083 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:46:10.083 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:46:10.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:46:10.083 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:46:10.083 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:46:10.083 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:46:10.083 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:46:10.084 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:46:10.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:10.084 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:46:10.084 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:46:10.084 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:46:10.084 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:46:10.085 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:46:10.085 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:46:10.085 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:46:10.085 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:46:10.085 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:46:10.085 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:46:10.085 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:46:10.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:10.086 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:46:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.928+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56806a050 msgr2=0x7ff56806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.928+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56806a050 0x7ff56806c510 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff580007fd0 tx=0x7ff580009040 comp rx=0 tx=0).stop 2023-08-09T12:46:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.928+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 msgr2=0x7ff5840af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.928+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840af0c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ff5740090b0 tx=0x7ff5740046c0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.929+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 shutdown_connections 2023-08-09T12:46:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.929+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56806a050 0x7ff56806c510 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.929+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cc630 0x7ff5840af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.929+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b3b40 0x7ff5840af0c0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.929+0000 7ff58bc0d640 1 --2- 172.21.15.17:0/720558540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840adc40 0x7ff5841f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.929+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 >> 172.21.15.17:0/720558540 conn(0x7ff5840cb1b0 msgr2=0x7ff5840b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.929+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 shutdown_connections 2023-08-09T12:46:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:09.929+0000 7ff58bc0d640 1 -- 172.21.15.17:0/720558540 wait complete. 2023-08-09T12:46:10.090 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-09T12:46:10.090 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:10.090 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:10.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:10.154 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-08-09T12:46:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-08-09T12:46:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records in 2023-08-09T12:46:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records out 2023-08-09T12:46:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.379831 s, 138 MB/s 2023-08-09T12:46:10.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:46:10.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:46:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.842+0000 7f705c122640 1 Processor -- start 2023-08-09T12:46:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.842+0000 7f705c122640 1 -- start start 2023-08-09T12:46:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.844+0000 7f705c122640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7054161660 0x7f70540ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.844+0000 7f705c122640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540ad240 con 0x7f70540acdf0 2023-08-09T12:46:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.844+0000 7f705c122640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705415df30 con 0x7f7054161280 2023-08-09T12:46:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.844+0000 7f705c122640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705415d430 con 0x7f7054161660 2023-08-09T12:46:10.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.844+0000 7f70596bd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7054161660 0x7f70540ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:10.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.844+0000 7f705a6bf640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f70540acdf0 0x7f70540cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47198/0 (socket says 172.21.15.17:47198) 2023-08-09T12:46:10.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.844+0000 7f705a6bf640 1 -- 172.21.15.17:0/125418929 learned_addr learned my addr 172.21.15.17:0/125418929 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:10.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.845+0000 7f7058ebc640 1 -- 172.21.15.17:0/125418929 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051720294 0 0) 0x7f704c001490 con 0x7f70540acdf0 2023-08-09T12:46:10.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.845+0000 7f7058ebc640 1 -- 172.21.15.17:0/125418929 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7040003520 con 0x7f70540acdf0 2023-08-09T12:46:10.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.845+0000 7f70596bd640 1 -- 172.21.15.17:0/125418929 >> v1:172.21.15.142:6789/0 conn(0x7f7054161280 legacy=0x7f70540c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:10.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.845+0000 7f70596bd640 1 -- 172.21.15.17:0/125418929 >> v1:172.21.15.17:6789/0 conn(0x7f70540acdf0 legacy=0x7f70540cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:10.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.845+0000 7f70596bd640 1 -- 172.21.15.17:0/125418929 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540ca9d0 con 0x7f7054161660 2023-08-09T12:46:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.846+0000 7f70596bd640 1 --2- 172.21.15.17:0/125418929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161660 0x7f70540ac8b0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7044009790 tx=0x7f704402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9691fd0e3c025e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.847+0000 7f7058ebc640 1 -- 172.21.15.17:0/125418929 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704402d040 con 0x7f7054161660 2023-08-09T12:46:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.847+0000 7f7058ebc640 1 -- 172.21.15.17:0/125418929 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7044031810 con 0x7f7054161660 2023-08-09T12:46:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.847+0000 7f7058ebc640 1 -- 172.21.15.17:0/125418929 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044031b80 con 0x7f7054161660 2023-08-09T12:46:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.847+0000 7f705c122640 1 -- 172.21.15.17:0/125418929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161660 msgr2=0x7f70540ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.847+0000 7f705c122640 1 --2- 172.21.15.17:0/125418929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161660 0x7f70540ac8b0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7044009790 tx=0x7f704402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.848+0000 7f705c122640 1 -- 172.21.15.17:0/125418929 shutdown_connections 2023-08-09T12:46:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.848+0000 7f705c122640 1 --2- 172.21.15.17:0/125418929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161660 0x7f70540ac8b0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.848+0000 7f705c122640 1 -- 172.21.15.17:0/125418929 >> 172.21.15.17:0/125418929 conn(0x7f70540cb1b0 msgr2=0x7f70540cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.848+0000 7f705c122640 1 -- 172.21.15.17:0/125418929 shutdown_connections 2023-08-09T12:46:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.848+0000 7f705c122640 1 -- 172.21.15.17:0/125418929 wait complete. 2023-08-09T12:46:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.849+0000 7f705c122640 1 Processor -- start 2023-08-09T12:46:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.850+0000 7f705c122640 1 -- start start 2023-08-09T12:46:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f705c122640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70540acdf0 0x7f70540c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f705c122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161280 0x7f7054142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f705c122640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7054161660 0x7f70540af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f705c122640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c1f80 con 0x7f7054161280 2023-08-09T12:46:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f705c122640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c5140 con 0x7f70540acdf0 2023-08-09T12:46:10.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f705c122640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c40a0 con 0x7f7054161660 2023-08-09T12:46:10.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f70596bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161280 0x7f7054142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:10.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f70596bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161280 0x7f7054142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54938/0 (socket says 172.21.15.17:54938) 2023-08-09T12:46:10.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f70596bd640 1 -- 172.21.15.17:0/2417893869 learned_addr learned my addr 172.21.15.17:0/2417893869 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:10.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f7059ebe640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70540acdf0 0x7f70540c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.851+0000 7f705a6bf640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7054161660 0x7f70540af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f70596bd640 1 -- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7054161660 msgr2=0x7f70540af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f70596bd640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7054161660 0x7f70540af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f70596bd640 1 -- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70540acdf0 msgr2=0x7f70540c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f70596bd640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70540acdf0 0x7f70540c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f70596bd640 1 -- 172.21.15.17:0/2417893869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440093a0 con 0x7f7054161280 2023-08-09T12:46:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f7059ebe640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70540acdf0 0x7f70540c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:46:10.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f70596bd640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161280 0x7f7054142080 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f7044000c00 tx=0x7f70440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:10.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f704a7fc640 1 -- 172.21.15.17:0/2417893869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044006db0 con 0x7f7054161280 2023-08-09T12:46:10.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.852+0000 7f704a7fc640 1 -- 172.21.15.17:0/2417893869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704403bb60 con 0x7f7054161280 2023-08-09T12:46:10.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.853+0000 7f704a7fc640 1 -- 172.21.15.17:0/2417893869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044004020 con 0x7f7054161280 2023-08-09T12:46:10.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.853+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70540c4380 con 0x7f7054161280 2023-08-09T12:46:10.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.853+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70540c4940 con 0x7f7054161280 2023-08-09T12:46:10.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.854+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7054067a80 con 0x7f7054161280 2023-08-09T12:46:10.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.855+0000 7f704a7fc640 1 -- 172.21.15.17:0/2417893869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7044043070 con 0x7f7054161280 2023-08-09T12:46:10.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.857+0000 7f704a7fc640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f703806a050 0x7f703806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:10.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.857+0000 7f704a7fc640 1 -- 172.21.15.17:0/2417893869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70440aa500 con 0x7f7054161280 2023-08-09T12:46:10.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.857+0000 7f704a7fc640 1 -- 172.21.15.17:0/2417893869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7f70380721a0 con 0x7f7054161280 2023-08-09T12:46:10.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.857+0000 7f7059ebe640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f703806a050 0x7f703806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:10.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.858+0000 7f7059ebe640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f703806a050 0x7f703806c510 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7050001700 tx=0x7f7050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:10.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:10.862+0000 7f704a7fc640 1 -- 172.21.15.17:0/2417893869 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7044075c70 con 0x7f7054161280 2023-08-09T12:46:10.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:46:10.918 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:46:11.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.060+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f70540adc60 con 0x7f7054161280 2023-08-09T12:46:11.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.062+0000 7f704a7fc640 1 -- 172.21.15.17:0/2417893869 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+37046 (secure 0 0 0) 0x7f7044035030 con 0x7f7054161280 2023-08-09T12:46:11.066 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:11.066 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:46:11.066 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 113, 2023-08-09T12:46:11.067 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:46:11.067 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:46:11.067 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:46:08.832557+0000", 2023-08-09T12:46:11.067 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:46:11.067 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:46:11.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:46:11.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:46:11.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:46:11.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:46:11.068 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:46:11.068 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:46:11.068 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:46:11.068 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:11.069 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:46:11.069 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:46:11.069 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:46:11.069 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:46:11.069 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:46:11.069 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 14, 2023-08-09T12:46:11.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:46:11.070 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:46:11.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:46:11.070 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:46:11.070 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:46:11.070 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:46:11.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.070 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:46:11.071 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:46:11.071 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:46:11.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:11.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:11.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:11.071 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:11.071 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:11.071 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:11.072 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:11.072 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:11.072 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:11.072 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:11.072 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:11.072 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:11.072 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:46:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:46:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:46:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:46:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:46:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:11.073 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:11.074 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:11.074 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:11.074 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:11.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.074 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:11.074 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:11.074 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:11.074 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:11.075 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:11.075 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:11.075 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:11.075 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:11.075 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:11.075 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:11.075 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:11.075 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:11.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:11.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:11.076 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:11.076 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:11.076 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:11.076 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:11.076 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:11.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.078 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:11.078 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:11.078 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:11.079 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:11.079 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:11.079 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:11.080 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:11.080 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:11.080 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:11.080 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:11.080 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:11.080 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:11.080 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:46:11.081 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:46:11.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.081 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:11.081 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:46:11.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.081 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:46:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:46:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:46:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:46:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:46:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:11.083 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:11.083 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.084 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:46:11.084 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:46:11.084 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:46:11.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:11.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:11.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:11.085 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:11.085 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:11.085 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:11.085 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:11.086 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:11.086 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:11.086 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:11.086 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:11.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:11.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:46:11.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:46:11.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:46:11.087 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:46:11.087 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:46:11.087 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:11.087 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:11.087 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:11.087 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:11.087 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:11.088 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:11.088 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:11.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.088 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:11.088 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:11.088 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:11.088 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:11.089 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:11.089 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:11.089 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:11.089 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:11.089 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:11.090 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:11.090 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:11.090 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:11.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:11.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:11.090 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:11.090 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:11.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:11.091 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:11.091 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:11.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:11.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:11.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:11.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:11.094 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:11.094 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:11.094 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:11.094 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:11.094 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:11.094 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:11.094 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:46:11.095 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:11.095 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:46:11.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.095 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:11.095 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:46:11.095 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:46:11.096 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:46:11.096 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:11.096 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:11.096 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:11.096 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:11.096 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:11.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.097 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 13, 2023-08-09T12:46:11.097 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:46:11.097 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.039914+0000", 2023-08-09T12:46:11.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:11.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:11.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:11.098 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:11.098 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:11.098 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:11.099 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:11.099 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:11.099 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:11.099 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:11.099 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:11.099 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:11.100 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:46:11.100 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:46:11.100 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:46:11.100 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:46:11.100 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:46:11.100 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:11.100 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:11.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:11.101 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:11.101 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:11.101 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:11.101 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:11.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.101 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:11.101 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:11.102 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:11.102 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:11.102 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:11.102 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:11.102 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:11.103 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:11.103 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:11.103 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:11.103 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:11.104 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:11.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:11.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:11.104 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:11.104 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:11.104 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:11.105 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:11.105 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:11.105 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:11.105 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:11.105 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:11.105 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:11.108 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:11.108 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:11.108 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:11.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:11.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.109 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:11.109 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:11.109 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:11.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:11.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:11.110 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:11.110 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:11.110 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:11.110 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:11.110 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:11.110 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:11.110 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:11.110 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:46:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:46:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:46:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:46:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.112 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:11.112 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:46:11.112 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:46:11.112 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:11.112 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:46:11.112 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:46:11.112 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:11.112 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:11.113 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:11.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.114 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 14, 2023-08-09T12:46:11.114 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:46:11.114 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.697620+0000", 2023-08-09T12:46:11.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:11.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:11.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:11.115 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:11.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:11.115 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:11.115 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:11.115 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:11.116 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:11.116 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:11.116 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:11.116 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:11.116 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:46:11.116 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:46:11.116 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:46:11.116 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:46:11.117 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:46:11.117 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:11.117 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:11.117 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:11.117 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:11.117 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:11.117 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:11.117 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:11.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.118 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:11.118 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:11.118 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:11.118 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:11.118 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:11.118 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:11.119 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:11.119 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:11.119 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:11.119 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:11.119 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:11.119 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:11.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:11.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:11.121 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:11.121 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:11.121 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:11.121 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:11.121 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:11.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:11.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:11.122 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:46:11.123 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:46:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:46:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.124 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:46:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:46:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:11.125 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:46:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:11.126 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:11.127 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:46:11.128 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:46:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:46:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:46:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.131 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:46:11.132 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:46:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.134 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:11.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:46:11.134 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:11.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:46:11.135 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:11.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.135 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.135 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:46:11.136 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:46:11.136 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:46:11.136 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:46:11.136 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:11.136 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:11.136 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:11.136 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:11.136 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:11.138 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:11.138 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:11.138 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:11.138 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:11.138 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:11.138 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:11.138 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:11.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:46:11.139 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:11.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:46:11.140 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:11.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.140 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.140 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:11.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.141 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:46:11.141 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:11.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.141 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:46:11.142 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:11.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.142 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:11.142 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.143 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:46:11.143 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:11.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.143 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:46:11.143 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:11.144 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.144 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.144 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:11.144 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.144 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:46:11.145 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:11.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:46:11.145 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:11.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.145 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:46:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:46:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:46:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:46:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:11.147 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:11.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.147 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:11.147 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:11.147 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:11.148 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:11.148 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:11.148 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:11.148 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:11.148 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:11.148 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:11.148 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:11.148 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:11.149 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:11.149 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:11.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:46:11.149 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:11.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.150 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:46:11.150 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:11.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.150 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.150 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:11.151 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.151 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:46:11.151 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:11.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.152 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:46:11.152 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:11.152 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.152 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.152 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:11.152 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.153 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:46:11.153 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:11.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.153 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:46:11.154 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:11.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.154 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.154 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:11.154 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.155 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:46:11.155 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:11.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.155 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:46:11.155 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:11.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.156 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.156 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:46:11.156 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:46:11.156 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:46:11.156 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:46:11.156 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:11.157 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:11.157 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:11.157 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.157 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:11.157 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:11.157 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:11.158 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:11.158 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:11.158 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:11.158 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:11.158 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:11.158 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:11.158 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:11.158 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:11.159 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:11.159 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:11.159 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.159 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:46:11.159 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:11.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.160 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:46:11.160 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:11.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.160 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.161 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:11.161 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.161 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:46:11.161 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:11.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.162 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:46:11.162 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:11.162 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.162 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.162 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:11.162 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.163 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:46:11.163 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:11.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.163 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:46:11.164 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:11.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.164 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.164 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:11.164 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.165 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:46:11.165 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:11.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.165 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:46:11.165 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:11.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.166 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.166 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:46:11.166 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:46:11.166 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:46:11.166 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:46:11.166 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:11.167 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:11.167 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:11.167 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:11.167 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.167 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:11.167 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:11.168 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:11.168 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:11.168 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:11.168 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:11.168 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:11.168 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:11.168 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:11.169 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:11.169 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:11.169 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:11.169 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:11.169 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.169 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:46:11.170 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:11.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.170 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:46:11.170 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:11.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.170 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.171 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:11.171 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.171 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:46:11.171 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:11.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.172 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:46:11.172 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:11.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.172 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.172 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:11.173 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.173 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:46:11.173 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:11.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.174 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:46:11.174 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:11.174 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.174 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.174 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:11.174 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.175 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:46:11.175 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:11.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.175 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:46:11.176 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:11.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.176 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.176 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:46:11.176 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:46:11.176 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:46:11.176 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:46:11.177 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:11.177 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:11.177 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:11.177 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:11.177 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.177 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:11.178 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:11.178 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:11.178 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:11.178 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:11.178 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:11.178 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:11.178 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:11.179 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:11.179 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:11.179 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:11.179 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:11.179 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:11.179 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:46:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:46:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:46:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:11.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.182 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:46:11.182 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:11.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.182 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.183 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:11.183 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.183 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:46:11.183 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:11.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.184 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:46:11.184 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:11.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.184 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.184 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:11.185 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.185 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:46:11.185 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:11.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.186 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:46:11.186 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:11.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.186 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.186 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:46:11.186 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:46:11.186 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:46:11.187 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:46:11.187 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:11.187 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:11.187 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:11.187 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.188 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:11.188 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:11.188 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:11.188 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:11.188 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:11.188 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:11.188 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:11.188 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.190 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:46:11.190 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:11.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.190 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:46:11.190 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:11.191 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.191 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.191 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:11.191 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.191 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:46:11.192 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:11.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.192 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:46:11.192 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:11.192 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.192 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.193 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:11.193 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.193 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:46:11.193 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:11.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:46:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:11.195 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.195 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:46:11.195 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:11.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.196 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:46:11.196 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:11.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.196 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:46:11.196 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:46:11.197 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:46:11.197 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:46:11.197 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:11.197 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:11.197 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:11.197 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.198 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:11.198 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:11.198 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:11.198 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:11.198 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:11.198 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:11.198 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:11.198 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:11.199 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:11.199 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:11.199 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:11.199 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:11.199 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:11.199 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.200 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:46:11.200 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:11.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.200 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:46:11.200 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:11.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.201 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.201 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:11.201 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.201 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:46:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:46:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:46:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.204 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:46:11.204 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:11.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.204 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.205 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:11.205 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:11.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:11.205 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:46:11.205 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:11.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:11.206 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:46:11.206 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:11.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.206 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.206 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:46:11.206 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:46:11.207 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:46:11.207 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:46:11.207 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:11.207 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:11.207 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:11.207 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:11.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.207 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:11.208 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:46:11.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.208 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:11.208 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:11.208 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:11.208 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:11.208 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:11.209 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:11.209 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:46:11.209 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:11.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.209 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:11.209 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:11.209 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:11.210 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:11.210 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:11.210 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:11.210 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:46:11.210 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:11.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.210 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:11.211 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:11.211 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:11.211 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:11.211 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:11.211 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:11.211 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:46:11.211 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:11.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.212 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:11.212 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:11.212 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:11.212 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:11.212 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:11.212 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:11.212 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:46:11.213 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:11.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.213 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:11.213 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:11.213 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:11.213 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:11.214 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:11.214 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:11.214 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:46:11.214 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:11.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.214 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:11.214 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:11.215 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:11.215 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:11.215 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:11.215 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:11.215 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:46:11.215 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:11.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.216 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:11.216 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:11.216 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:11.216 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:11.216 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:11.216 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:11.216 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:46:11.216 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:11.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:11.217 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:11.217 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:11.217 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:11.217 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:11.217 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:11.217 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:46:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:46:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:46:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:46:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:46:11.219 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:46:11.219 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:46:11.219 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:46:11.219 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:46:11.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:46:11.219 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:46:11.219 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:46:11.219 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:46:11.220 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:46:11.220 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:46:11.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:11.220 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:46:11.220 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:46:11.220 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:46:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:46:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:46:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:46:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:46:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:46:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:46:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:46:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:46:11.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:11.222 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:46:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f703806a050 msgr2=0x7f703806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f703806a050 0x7f703806c510 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7050001700 tx=0x7f7050009040 comp rx=0 tx=0).stop 2023-08-09T12:46:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161280 msgr2=0x7f7054142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161280 0x7f7054142080 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f7044000c00 tx=0x7f70440046c0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 shutdown_connections 2023-08-09T12:46:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f703806a050 0x7f703806c510 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7054161660 0x7f70540af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7054161280 0x7f7054142080 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 --2- 172.21.15.17:0/2417893869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70540acdf0 0x7f70540c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 >> 172.21.15.17:0/2417893869 conn(0x7f70540cb1b0 msgr2=0x7f7054070320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 shutdown_connections 2023-08-09T12:46:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.065+0000 7f705c122640 1 -- 172.21.15.17:0/2417893869 wait complete. 2023-08-09T12:46:11.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:46:11.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.492+0000 7fb04b59e640 1 Processor -- start 2023-08-09T12:46:11.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.492+0000 7fb04b59e640 1 -- start start 2023-08-09T12:46:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb04b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c0b3fe0 0x7fb04c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb04b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb04c0697c0 0x7fb04c069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb04b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c06fe10 con 0x7fb04c159bd0 2023-08-09T12:46:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb04b59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c0b11a0 con 0x7fb04c0697c0 2023-08-09T12:46:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb04b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c06a190 con 0x7fb04c0b3fe0 2023-08-09T12:46:11.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb04ad9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb04c0697c0 0x7fb04c069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:11.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb049d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c0b3fe0 0x7fb04c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:11.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb049d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c0b3fe0 0x7fb04c0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:50320/0 (socket says 172.21.15.17:50320) 2023-08-09T12:46:11.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.494+0000 7fb049d9b640 1 -- 172.21.15.17:0/2324500005 learned_addr learned my addr 172.21.15.17:0/2324500005 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:11.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.495+0000 7fb04ad9d640 1 -- 172.21.15.17:0/2324500005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c0b3fe0 msgr2=0x7fb04c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:11.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.495+0000 7fb04ad9d640 1 --2- 172.21.15.17:0/2324500005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c0b3fe0 0x7fb04c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.495+0000 7fb04ad9d640 1 -- 172.21.15.17:0/2324500005 >> v1:172.21.15.142:6789/0 conn(0x7fb04c159bd0 legacy=0x7fb04c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:11.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.495+0000 7fb04ad9d640 1 -- 172.21.15.17:0/2324500005 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c159fb0 con 0x7fb04c0697c0 2023-08-09T12:46:11.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.497+0000 7fb04ad9d640 1 --2- 172.21.15.17:0/2324500005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0697c0 0x7fb04c069c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb0440097a0 tx=0x7fb04402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b4a256154901054 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:11.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.497+0000 7fb04959a640 1 -- 172.21.15.17:0/2324500005 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044031780 con 0x7fb04c0697c0 2023-08-09T12:46:11.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.497+0000 7fb04959a640 1 -- 172.21.15.17:0/2324500005 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0440318e0 con 0x7fb04c0697c0 2023-08-09T12:46:11.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.497+0000 7fb04959a640 1 -- 172.21.15.17:0/2324500005 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044031c70 con 0x7fb04c0697c0 2023-08-09T12:46:11.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.498+0000 7fb04b59e640 1 -- 172.21.15.17:0/2324500005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0697c0 msgr2=0x7fb04c069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:11.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.498+0000 7fb04b59e640 1 --2- 172.21.15.17:0/2324500005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0697c0 0x7fb04c069c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb0440097a0 tx=0x7fb04402b820 comp rx=0 tx=0).stop 2023-08-09T12:46:11.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.498+0000 7fb04b59e640 1 -- 172.21.15.17:0/2324500005 shutdown_connections 2023-08-09T12:46:11.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.498+0000 7fb04b59e640 1 --2- 172.21.15.17:0/2324500005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c0b3fe0 0x7fb04c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.498+0000 7fb04b59e640 1 --2- 172.21.15.17:0/2324500005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0697c0 0x7fb04c069c50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.498+0000 7fb04b59e640 1 -- 172.21.15.17:0/2324500005 >> 172.21.15.17:0/2324500005 conn(0x7fb04c0b1d50 msgr2=0x7fb04c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:11.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.498+0000 7fb04b59e640 1 -- 172.21.15.17:0/2324500005 shutdown_connections 2023-08-09T12:46:11.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.498+0000 7fb04b59e640 1 -- 172.21.15.17:0/2324500005 wait complete. 2023-08-09T12:46:11.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.500+0000 7fb04b59e640 1 Processor -- start 2023-08-09T12:46:11.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.500+0000 7fb04b59e640 1 -- start start 2023-08-09T12:46:11.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.501+0000 7fb04b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb04c0697c0 0x7fb04c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:11.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.501+0000 7fb04b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0b3fe0 0x7fb04c0c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:11.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.501+0000 7fb04b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c159bd0 0x7fb04c0c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:11.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.501+0000 7fb04b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0c3bd0 con 0x7fb04c0697c0 2023-08-09T12:46:11.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.501+0000 7fb04b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0c3740 con 0x7fb04c0b3fe0 2023-08-09T12:46:11.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.501+0000 7fb04b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0c2b30 con 0x7fb04c159bd0 2023-08-09T12:46:11.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb04c0697c0 0x7fb04c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:11.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb04c0697c0 0x7fb04c155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54954/0 (socket says 172.21.15.17:54954) 2023-08-09T12:46:11.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04a59c640 1 -- 172.21.15.17:0/3574117440 learned_addr learned my addr 172.21.15.17:0/3574117440 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:11.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb049d9b640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0b3fe0 0x7fb04c0c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:11.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04ad9d640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c159bd0 0x7fb04c0c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:11.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04a59c640 1 -- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c159bd0 msgr2=0x7fb04c0c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:11.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04a59c640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c159bd0 0x7fb04c0c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04a59c640 1 -- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0b3fe0 msgr2=0x7fb04c0c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:11.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04a59c640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0b3fe0 0x7fb04c0c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb04a59c640 1 -- 172.21.15.17:0/3574117440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb044009400 con 0x7fb04c0697c0 2023-08-09T12:46:11.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.502+0000 7fb049d9b640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0b3fe0 0x7fb04c0c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:46:11.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.503+0000 7fb04a59c640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb04c0697c0 0x7fb04c155b70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c730 tx=0x7fb03c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.503+0000 7fb03affd640 1 -- 172.21.15.17:0/3574117440 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c003b70 con 0x7fb04c0697c0 2023-08-09T12:46:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.503+0000 7fb03affd640 1 -- 172.21.15.17:0/3574117440 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c003cf0 con 0x7fb04c0697c0 2023-08-09T12:46:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.503+0000 7fb03affd640 1 -- 172.21.15.17:0/3574117440 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00aa30 con 0x7fb04c0697c0 2023-08-09T12:46:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.503+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c0c2e10 con 0x7fb04c0697c0 2023-08-09T12:46:11.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.503+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c0c33d0 con 0x7fb04c0697c0 2023-08-09T12:46:11.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.504+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c0c3590 con 0x7fb04c0697c0 2023-08-09T12:46:11.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.505+0000 7fb03affd640 1 -- 172.21.15.17:0/3574117440 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb03c00ab90 con 0x7fb04c0697c0 2023-08-09T12:46:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.506+0000 7fb03affd640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb02c06a050 0x7fb02c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.506+0000 7fb03affd640 1 -- 172.21.15.17:0/3574117440 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb03c088400 con 0x7fb04c0697c0 2023-08-09T12:46:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.506+0000 7fb03affd640 1 -- 172.21.15.17:0/3574117440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7fb02c0721a0 con 0x7fb04c0697c0 2023-08-09T12:46:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.507+0000 7fb049d9b640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb02c06a050 0x7fb02c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.508+0000 7fb049d9b640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb02c06a050 0x7fb02c06c510 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0c67b0 tx=0x7fb040008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.511+0000 7fb03affd640 1 -- 172.21.15.17:0/3574117440 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb03c003e60 con 0x7fb04c0697c0 2023-08-09T12:46:11.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.740+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb04c04e390 con 0x7fb04c0697c0 2023-08-09T12:46:11.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.741+0000 7fb03affd640 1 -- 172.21.15.17:0/3574117440 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7fb03c053a50 con 0x7fb04c0697c0 2023-08-09T12:46:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:11.745 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:46:11.745 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:46:11.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb02c06a050 msgr2=0x7fb02c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:11.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb02c06a050 0x7fb02c06c510 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0c67b0 tx=0x7fb040008040 comp rx=0 tx=0).stop 2023-08-09T12:46:11.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb04c0697c0 msgr2=0x7fb04c155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:11.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb04c0697c0 0x7fb04c155b70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c730 tx=0x7fb03c00cbf0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 shutdown_connections 2023-08-09T12:46:11.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb02c06a050 0x7fb02c06c510 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb04c159bd0 0x7fb04c0c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb04c0b3fe0 0x7fb04c0c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 --2- 172.21.15.17:0/3574117440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb04c0697c0 0x7fb04c155b70 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:11.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 >> 172.21.15.17:0/3574117440 conn(0x7fb04c0b1d50 msgr2=0x7fb04c0b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:11.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 shutdown_connections 2023-08-09T12:46:11.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:11.744+0000 7fb04b59e640 1 -- 172.21.15.17:0/3574117440 wait complete. 2023-08-09T12:46:11.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-08-09T12:46:11.996 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":7029,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.772579284999999,"mdsmap_epoch":51,"osdmap_epoch":114,"osdmap_epoch_barrier":113,"uptime":34.592882703000001} 2023-08-09T12:46:11.997 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 7029, "mdsmap_epoch": 51, "osdmap_epoch": 114, "osdmap_epoch_barrier": 113, "rank_uptime": 28.772579285, "state": "up:active", "uptime": 34.592882703, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:46:11.997 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:46:11.998 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:11.998 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:12.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:12.064 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-08-09T12:46:12.120 INFO:teuthology.orchestra.run.smithi017.stderr:dd: failed to open 'small_file_1': Permission denied 2023-08-09T12:46:12.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:46:12.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:12.122 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-08-09T12:46:12.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:12.179 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-08-09T12:46:12.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:46:12.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.530+0000 7f7e1cba4640 1 Processor -- start 2023-08-09T12:46:12.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.530+0000 7f7e1cba4640 1 -- start start 2023-08-09T12:46:12.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.531+0000 7f7e1cba4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e181616e0 0x7f7e180b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:12.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.531+0000 7f7e1cba4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 0x7f7e180d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:12.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.531+0000 7f7e1cba4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e180cdd10 con 0x7f7e1815ce90 2023-08-09T12:46:12.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.531+0000 7f7e1cba4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e180b6540 con 0x7f7e181616e0 2023-08-09T12:46:12.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.531+0000 7f7e1cba4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180d33a0 con 0x7f7e180d29d0 2023-08-09T12:46:12.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.532+0000 7f7e15d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e181616e0 0x7f7e180b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:12.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.532+0000 7f7e15d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e181616e0 0x7f7e180b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:51142/0 (socket says 172.21.15.17:51142) 2023-08-09T12:46:12.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.532+0000 7f7e15d9b640 1 -- 172.21.15.17:0/1737488078 learned_addr learned my addr 172.21.15.17:0/1737488078 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:12.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.532+0000 7f7e16d9d640 1 --2- 172.21.15.17:0/1737488078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 0x7f7e180d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.533+0000 7f7e15d9b640 1 -- 172.21.15.17:0/1737488078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 msgr2=0x7f7e180d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.533+0000 7f7e15d9b640 1 --2- 172.21.15.17:0/1737488078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 0x7f7e180d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.533+0000 7f7e15d9b640 1 -- 172.21.15.17:0/1737488078 >> v1:172.21.15.142:6789/0 conn(0x7f7e1815ce90 legacy=0x7f7e180cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.533+0000 7f7e15d9b640 1 -- 172.21.15.17:0/1737488078 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e180cdff0 con 0x7f7e181616e0 2023-08-09T12:46:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.534+0000 7f7e15d9b640 1 --2- 172.21.15.17:0/1737488078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 0x7f7e180b6000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009870 tx=0x7f7e0002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c6bd24f23ce553 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.535+0000 7f7e1559a640 1 -- 172.21.15.17:0/1737488078 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00030840 con 0x7f7e181616e0 2023-08-09T12:46:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1559a640 1 -- 172.21.15.17:0/1737488078 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e000309a0 con 0x7f7e181616e0 2023-08-09T12:46:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1559a640 1 -- 172.21.15.17:0/1737488078 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00030d30 con 0x7f7e181616e0 2023-08-09T12:46:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1cba4640 1 -- 172.21.15.17:0/1737488078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 msgr2=0x7f7e180b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/1737488078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 0x7f7e180b6000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009870 tx=0x7f7e0002b980 comp rx=0 tx=0).stop 2023-08-09T12:46:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1cba4640 1 -- 172.21.15.17:0/1737488078 shutdown_connections 2023-08-09T12:46:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/1737488078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 0x7f7e180d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/1737488078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 0x7f7e180b6000 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1cba4640 1 -- 172.21.15.17:0/1737488078 >> 172.21.15.17:0/1737488078 conn(0x7f7e1806fde0 msgr2=0x7f7e180701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1cba4640 1 -- 172.21.15.17:0/1737488078 shutdown_connections 2023-08-09T12:46:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.536+0000 7f7e1cba4640 1 -- 172.21.15.17:0/1737488078 wait complete. 2023-08-09T12:46:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.538+0000 7f7e1cba4640 1 Processor -- start 2023-08-09T12:46:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.538+0000 7f7e1cba4640 1 -- start start 2023-08-09T12:46:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.539+0000 7f7e1cba4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 0x7f7e18157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.539+0000 7f7e1cba4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1815ce90 0x7f7e18159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.539+0000 7f7e1cba4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 0x7f7e1815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.539+0000 7f7e1cba4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e181e67f0 con 0x7f7e1815ce90 2023-08-09T12:46:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.539+0000 7f7e1cba4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18157fc0 con 0x7f7e181616e0 2023-08-09T12:46:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.539+0000 7f7e1cba4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180ca700 con 0x7f7e180d29d0 2023-08-09T12:46:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e15d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1815ce90 0x7f7e18159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e15d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1815ce90 0x7f7e18159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54960/0 (socket says 172.21.15.17:54960) 2023-08-09T12:46:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e15d9b640 1 -- 172.21.15.17:0/3598238743 learned_addr learned my addr 172.21.15.17:0/3598238743 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e16d9d640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 0x7f7e1815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e1659c640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 0x7f7e18157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e15d9b640 1 -- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 msgr2=0x7f7e18157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e15d9b640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 0x7f7e18157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e15d9b640 1 -- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 msgr2=0x7f7e1815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e15d9b640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 0x7f7e1815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.540+0000 7f7e15d9b640 1 -- 172.21.15.17:0/3598238743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000094d0 con 0x7f7e1815ce90 2023-08-09T12:46:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.541+0000 7f7e15d9b640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1815ce90 0x7f7e18159fa0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7e000090b0 tx=0x7f7e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.541+0000 7f7e0effd640 1 -- 172.21.15.17:0/3598238743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0003e070 con 0x7f7e1815ce90 2023-08-09T12:46:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.541+0000 7f7e0effd640 1 -- 172.21.15.17:0/3598238743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00039a10 con 0x7f7e1815ce90 2023-08-09T12:46:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.541+0000 7f7e0effd640 1 -- 172.21.15.17:0/3598238743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00039de0 con 0x7f7e1815ce90 2023-08-09T12:46:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.541+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e180c9dd0 con 0x7f7e1815ce90 2023-08-09T12:46:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.541+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e180ca390 con 0x7f7e1815ce90 2023-08-09T12:46:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.542+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e180ca520 con 0x7f7e1815ce90 2023-08-09T12:46:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.543+0000 7f7e0effd640 1 -- 172.21.15.17:0/3598238743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e000423f0 con 0x7f7e1815ce90 2023-08-09T12:46:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.544+0000 7f7e0effd640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7df806a050 0x7f7df806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.544+0000 7f7e0effd640 1 -- 172.21.15.17:0/3598238743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f7e000aa410 con 0x7f7e1815ce90 2023-08-09T12:46:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.544+0000 7f7e0effd640 1 -- 172.21.15.17:0/3598238743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=115}) v3 -- 0x7f7df8072320 con 0x7f7e1815ce90 2023-08-09T12:46:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.545+0000 7f7e1659c640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7df806a050 0x7f7df806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.546+0000 7f7e1659c640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7df806a050 0x7f7df806c510 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000f60 tx=0x7f7e08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.549+0000 7f7e0effd640 1 -- 172.21.15.17:0/3598238743 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7e00034060 con 0x7f7e1815ce90 2023-08-09T12:46:12.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.741+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7e18067a80 con 0x7f7e1815ce90 2023-08-09T12:46:12.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.745+0000 7f7e0effd640 1 -- 172.21.15.17:0/3598238743 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v114) v1 ==== 81+0+37792 (secure 0 0 0) 0x7f7e00048090 con 0x7f7e1815ce90 2023-08-09T12:46:12.749 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:12.749 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:46:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 114, 2023-08-09T12:46:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:46:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:46:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:46:11.866278+0000", 2023-08-09T12:46:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:46:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:46:12.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:46:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:46:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:46:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:46:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:46:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:46:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:46:12.751 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:46:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:46:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:46:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:46:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:46:12.752 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 14, 2023-08-09T12:46:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:46:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:46:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "luminous", 2023-08-09T12:46:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:46:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:46:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:46:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.753 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:46:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:46:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:46:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:12.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:12.755 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:46:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:46:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:46:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:46:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:46:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:12.756 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.757 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:12.758 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:12.759 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:12.760 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:12.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:12.762 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:46:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:46:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.763 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:46:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:46:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:46:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:46:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:46:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:46:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:46:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:46:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:46:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:12.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:12.767 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:46:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:46:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:46:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:46:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:46:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:12.768 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:12.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:12.770 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:12.771 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:12.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:12.773 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:12.774 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:46:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:46:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:46:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:46:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:46:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:12.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 13, 2023-08-09T12:46:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:46:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.039914+0000", 2023-08-09T12:46:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:12.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:46:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:46:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:46:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:46:12.779 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:46:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:12.780 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:12.781 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:12.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:12.783 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.784 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:12.785 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:46:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:46:12.786 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:46:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:46:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:12.787 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:46:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:46:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:46:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:46:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:12.788 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 14, 2023-08-09T12:46:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:46:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.697620+0000", 2023-08-09T12:46:12.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:12.790 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:46:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:46:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:46:12.791 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:46:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:46:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:12.792 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:12.795 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:12.796 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:12.797 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:12.798 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:12.799 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:12.800 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:12.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:12.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:12.803 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:46:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:46:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:12.804 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:46:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:46:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:46:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.806 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:46:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:12.807 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:12.808 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.809 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:46:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:46:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:12.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:12.812 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.813 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:46:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.815 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:46:12.815 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:12.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.816 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.816 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:12.816 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.817 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:46:12.817 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:12.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.818 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:46:12.818 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:12.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.818 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.818 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:46:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:46:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:46:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:46:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:46:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:46:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:46:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:46:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:46:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:46:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:46:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:46:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:46:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:46:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:46:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:46:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:46:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:46:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:46:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:46:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:46:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:46:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:46:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:46:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:46:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:46:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:46:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:46:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:46:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:46:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:46:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:46:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:46:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:46:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:46:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:46:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:46:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:46:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:46:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:46:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:46:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:46:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:46:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:46:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:46:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:46:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:46:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:46:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:46:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:46:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:46:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:46:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:46:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:46:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:46:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:46:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:46:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:46:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:46:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:46:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:46:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:46:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:46:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:46:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:46:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:46:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:46:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:46:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:46:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:46:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:46:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:46:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:46:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:46:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:46:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:46:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:46:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:46:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:46:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:46:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:46:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:46:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:46:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:46:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:46:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:46:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:46:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:46:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:46:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:46:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:46:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:46:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:46:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:46:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:46:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:46:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:46:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:46:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:46:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:46:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [ 2023-08-09T12:46:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.8", 2023-08-09T12:46:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 5 2023-08-09T12:46:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.1a", 2023-08-09T12:46:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 7 2023-08-09T12:46:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.21", 2023-08-09T12:46:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 7 2023-08-09T12:46:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.26", 2023-08-09T12:46:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 2 2023-08-09T12:46:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:46:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:46:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:46:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:46:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:46:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:46:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:46:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:46:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:46:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:46:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:46:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:46:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:46:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:46:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:46:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:46:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:46:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:46:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:46:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:46:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:46:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:46:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:46:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:12.930 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:46:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7df806a050 msgr2=0x7f7df806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7df806a050 0x7f7df806c510 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000f60 tx=0x7f7e08009040 comp rx=0 tx=0).stop 2023-08-09T12:46:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1815ce90 msgr2=0x7f7e18159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1815ce90 0x7f7e18159fa0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7e000090b0 tx=0x7f7e000046c0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 shutdown_connections 2023-08-09T12:46:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7df806a050 0x7f7df806c510 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e181616e0 0x7f7e1815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1815ce90 0x7f7e18159fa0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 --2- 172.21.15.17:0/3598238743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e180d29d0 0x7f7e18157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 >> 172.21.15.17:0/3598238743 conn(0x7f7e1806fde0 msgr2=0x7f7e1815ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 shutdown_connections 2023-08-09T12:46:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:12.748+0000 7f7e1cba4640 1 -- 172.21.15.17:0/3598238743 wait complete. 2023-08-09T12:46:12.933 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:46:13.790 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:46:13.786+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-08-09T12:46:16.907 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:46:16.904+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL) 2023-08-09T12:46:17.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:46:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.176+0000 7f930f3a2640 1 Processor -- start 2023-08-09T12:46:18.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.176+0000 7f930f3a2640 1 -- start start 2023-08-09T12:46:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.177+0000 7f930f3a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9308160030 0x7f9308160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.178+0000 7f930f3a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b86e0 0x7f93080cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.178+0000 7f930f3a2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93080b5a30 con 0x7f93080cf980 2023-08-09T12:46:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.178+0000 7f930f3a2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93080d1110 con 0x7f9308160030 2023-08-09T12:46:18.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.178+0000 7f930f3a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93080ceac0 con 0x7f93080b86e0 2023-08-09T12:46:18.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.178+0000 7f930eba1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f93080cf980 0x7f93080b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55478/0 (socket says 172.21.15.17:55478) 2023-08-09T12:46:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.178+0000 7f930eba1640 1 -- 172.21.15.17:0/4173093993 learned_addr learned my addr 172.21.15.17:0/4173093993 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930db9f640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b86e0 0x7f93080cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930e3a0640 1 --2- 172.21.15.17:0/4173093993 >> v2:172.21.15.142:3300/0 conn(0x7f9308160030 0x7f9308160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824561738 0 0) 0x7f93080b5a30 con 0x7f93080cf980 2023-08-09T12:46:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f4003520 con 0x7f93080cf980 2023-08-09T12:46:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2486612737 0 0) 0x7f92f4003520 con 0x7f93080cf980 2023-08-09T12:46:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b86e0 msgr2=0x7f93080cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b86e0 0x7f93080cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 >> v2:172.21.15.142:3300/0 conn(0x7f9308160030 msgr2=0x7f9308160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:18.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 --2- 172.21.15.17:0/4173093993 >> v2:172.21.15.142:3300/0 conn(0x7f9308160030 0x7f9308160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080d0d70 con 0x7f93080cf980 2023-08-09T12:46:18.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f93000019f0 con 0x7f93080cf980 2023-08-09T12:46:18.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 >> v1:172.21.15.17:6789/0 conn(0x7f93080cf980 legacy=0x7f93080b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:18.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b86e0 0x7f92f4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4003ef0 0x7f92f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f4004d00 0x7f92f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080d1110 con 0x7f92f4004d00 2023-08-09T12:46:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f400b980 con 0x7f92f4003ef0 2023-08-09T12:46:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.179+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f400bac0 con 0x7f93080b86e0 2023-08-09T12:46:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930eba1640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f4004d00 0x7f92f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930e3a0640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b86e0 0x7f92f4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930db9f640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4003ef0 0x7f92f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930eba1640 1 -- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b86e0 msgr2=0x7f92f4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930eba1640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b86e0 0x7f92f4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930eba1640 1 -- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4003ef0 msgr2=0x7f92f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930eba1640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4003ef0 0x7f92f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930eba1640 1 -- 172.21.15.17:0/4173093993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4003520 con 0x7f92f4004d00 2023-08-09T12:46:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.180+0000 7f930db9f640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4003ef0 0x7f92f40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.181+0000 7f930eba1640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f4004d00 0x7f92f4005180 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f930000a830 tx=0x7f92f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba3eb4cdeccd673 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300034630 con 0x7f92f4004d00 2023-08-09T12:46:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930002f070 con 0x7f92f4004d00 2023-08-09T12:46:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930d39e640 1 -- 172.21.15.17:0/4173093993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300034a50 con 0x7f92f4004d00 2023-08-09T12:46:18.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930f3a2640 1 -- 172.21.15.17:0/4173093993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f4004d00 msgr2=0x7f92f4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930f3a2640 1 --2- 172.21.15.17:0/4173093993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f4004d00 0x7f92f4005180 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f930000a830 tx=0x7f92f40057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930eba1640 1 -- 172.21.15.17:0/4173093993 reap_dead start 2023-08-09T12:46:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930f3a2640 1 -- 172.21.15.17:0/4173093993 shutdown_connections 2023-08-09T12:46:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930f3a2640 1 -- 172.21.15.17:0/4173093993 >> 172.21.15.17:0/4173093993 conn(0x7f93080697c0 msgr2=0x7f9308069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.182+0000 7f930f3a2640 1 -- 172.21.15.17:0/4173093993 shutdown_connections 2023-08-09T12:46:18.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.183+0000 7f930f3a2640 1 -- 172.21.15.17:0/4173093993 wait complete. 2023-08-09T12:46:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.184+0000 7f930f3a2640 1 Processor -- start 2023-08-09T12:46:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.185+0000 7f930f3a2640 1 -- start start 2023-08-09T12:46:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.185+0000 7f930f3a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4004d00 0x7f9308153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930f3a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b46e0 0x7f93080b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930f3a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9308158fe0 0x7f9308159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930f3a2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930815a690 con 0x7f9308158fe0 2023-08-09T12:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930f3a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308154c00 con 0x7f92f4004d00 2023-08-09T12:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930f3a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93080b5080 con 0x7f93080b46e0 2023-08-09T12:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930eba1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9308158fe0 0x7f9308159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930eba1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9308158fe0 0x7f9308159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36558/0 (socket says 172.21.15.17:36558) 2023-08-09T12:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930eba1640 1 -- 172.21.15.17:0/1711207107 learned_addr learned my addr 172.21.15.17:0/1711207107 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930e3a0640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4004d00 0x7f9308153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930db9f640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b46e0 0x7f93080b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930eba1640 1 -- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b46e0 msgr2=0x7f93080b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930eba1640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b46e0 0x7f93080b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930eba1640 1 -- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4004d00 msgr2=0x7f9308153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930eba1640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4004d00 0x7f9308153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.186+0000 7f930eba1640 1 -- 172.21.15.17:0/1711207107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308154130 con 0x7f9308158fe0 2023-08-09T12:46:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.187+0000 7f930eba1640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9308158fe0 0x7f9308159460 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f930000a830 tx=0x7f93080d0f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.187+0000 7f92feffd640 1 -- 172.21.15.17:0/1711207107 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300034630 con 0x7f9308158fe0 2023-08-09T12:46:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.187+0000 7f92feffd640 1 -- 172.21.15.17:0/1711207107 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300001270 con 0x7f9308158fe0 2023-08-09T12:46:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.187+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9308159df0 con 0x7f9308158fe0 2023-08-09T12:46:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.187+0000 7f92feffd640 1 -- 172.21.15.17:0/1711207107 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300034990 con 0x7f9308158fe0 2023-08-09T12:46:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.187+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930815a3b0 con 0x7f9308158fe0 2023-08-09T12:46:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.188+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9308154960 con 0x7f9308158fe0 2023-08-09T12:46:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.189+0000 7f92feffd640 1 -- 172.21.15.17:0/1711207107 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9300031030 con 0x7f9308158fe0 2023-08-09T12:46:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.190+0000 7f92feffd640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f92ec06a050 0x7f92ec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.190+0000 7f92feffd640 1 -- 172.21.15.17:0/1711207107 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f93000a9fe0 con 0x7f9308158fe0 2023-08-09T12:46:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.191+0000 7f92feffd640 1 -- 172.21.15.17:0/1711207107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=118}) v3 -- 0x7f92ec072320 con 0x7f9308158fe0 2023-08-09T12:46:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.191+0000 7f930e3a0640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f92ec06a050 0x7f92ec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:18.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.192+0000 7f930e3a0640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f92ec06a050 0x7f92ec06c510 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9304009a90 tx=0x7f9304008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.195+0000 7f92feffd640 1 -- 172.21.15.17:0/1711207107 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9308154960 con 0x7f9308158fe0 2023-08-09T12:46:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.392+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9308154130 con 0x7f9308158fe0 2023-08-09T12:46:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.394+0000 7f92feffd640 1 -- 172.21.15.17:0/1711207107 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v117) v1 ==== 81+0+37720 (secure 0 0 0) 0x7f9308154130 con 0x7f9308158fe0 2023-08-09T12:46:18.399 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:18.399 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:46:18.399 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 117, 2023-08-09T12:46:18.399 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:46:18.399 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:46:18.400 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:46:16.905971+0000", 2023-08-09T12:46:18.400 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:46:18.400 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:46:18.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:46:18.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:46:18.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:46:18.401 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:46:18.401 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:46:18.401 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:46:18.401 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:46:18.401 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:18.401 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:46:18.401 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:46:18.401 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:46:18.402 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:46:18.402 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:46:18.402 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 14, 2023-08-09T12:46:18.402 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:46:18.403 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:46:18.403 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "luminous", 2023-08-09T12:46:18.403 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:46:18.403 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:46:18.403 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:46:18.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.403 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:46:18.404 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:46:18.404 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:46:18.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:18.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:18.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:18.404 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:18.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:18.405 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:18.405 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:18.405 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:18.405 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:18.405 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:18.405 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:18.406 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:18.406 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:46:18.406 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:46:18.406 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:46:18.406 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:46:18.406 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:46:18.406 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:18.407 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:18.407 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:18.407 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:18.407 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:18.407 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:18.407 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:18.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.407 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:18.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:18.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:18.408 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:18.408 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:18.408 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:18.408 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:18.409 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:18.409 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:18.409 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:18.409 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:18.409 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:18.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:18.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:18.409 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:18.410 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:18.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:18.410 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:18.410 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:18.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:18.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:18.410 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:18.411 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:18.411 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:18.411 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:18.411 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:18.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:18.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.411 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:18.411 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:18.412 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:18.412 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:18.412 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:18.412 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:18.412 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:18.412 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:18.412 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:46:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:46:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:46:18.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.414 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:18.414 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:46:18.414 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:46:18.414 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:46:18.414 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:46:18.414 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:46:18.415 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:18.415 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:18.415 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:18.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:46:18.416 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:46:18.416 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:46:18.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:18.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:18.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:18.416 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:18.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:18.418 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:46:18.418 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:46:18.418 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:46:18.418 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:46:18.418 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:46:18.418 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:18.419 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:18.419 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:18.419 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:18.419 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:18.419 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:18.419 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:18.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:18.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:18.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:18.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:18.420 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:18.420 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:18.421 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:18.421 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:18.421 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:18.421 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:18.421 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:18.421 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:18.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:18.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:18.422 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:18.422 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:18.422 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:18.422 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:18.422 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:18.422 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:18.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:18.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:18.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:18.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:18.423 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:18.423 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:18.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:18.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.424 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:18.424 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:18.424 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:18.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:18.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:18.424 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:18.424 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:18.425 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:18.425 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:18.425 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:18.425 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:18.425 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:46:18.425 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:18.425 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:46:18.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.426 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:18.426 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:46:18.426 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:46:18.426 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:46:18.426 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:18.426 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:18.427 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:18.427 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:18.427 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:18.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.427 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 13, 2023-08-09T12:46:18.428 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:46:18.428 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.039914+0000", 2023-08-09T12:46:18.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:18.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:18.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:18.428 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:18.428 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:18.430 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:46:18.430 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:46:18.430 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:46:18.430 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:46:18.430 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:46:18.430 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:18.430 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:18.432 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:18.432 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:18.432 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:18.432 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:18.432 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:18.432 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:18.435 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:18.435 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:18.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:18.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.435 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:18.435 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:18.435 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:18.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:18.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:18.436 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:18.436 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:18.436 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:18.436 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:18.436 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:18.436 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:18.437 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:18.437 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:46:18.437 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:46:18.437 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:46:18.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.437 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:18.437 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:18.438 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:46:18.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.438 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:18.438 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:46:18.438 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:46:18.438 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:18.438 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:46:18.439 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:46:18.439 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:18.439 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:18.439 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:18.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.439 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 14, 2023-08-09T12:46:18.440 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:46:18.440 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.697620+0000", 2023-08-09T12:46:18.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 3, 2023-08-09T12:46:18.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full", 2023-08-09T12:46:18.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:18.440 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:18.440 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:18.441 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:18.441 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:18.441 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:18.441 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:18.441 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:18.441 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:18.441 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:18.441 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:46:18.442 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:46:18.442 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:46:18.442 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:46:18.442 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:46:18.442 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:18.442 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:18.442 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:18.442 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:18.443 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:18.443 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:18.443 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:18.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.443 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "111", 2023-08-09T12:46:18.443 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:18.443 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:18.443 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:18.444 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:18.444 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:18.444 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:18.444 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:18.444 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:18.444 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:18.444 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:18.445 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:18.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:18.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:18.445 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:18.445 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:18.445 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:18.445 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:18.445 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:18.446 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:18.446 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:18.446 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:18.446 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:18.446 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:18.446 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:18.446 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:18.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:18.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.447 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:18.447 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:18.447 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:18.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:18.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:18.447 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:46:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:46:18.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.449 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:18.449 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:18.449 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:46:18.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.449 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:18.450 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:46:18.450 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:46:18.450 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:18.450 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:18.450 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:18.450 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:18.450 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:18.450 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:18.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.451 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:18.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:46:18.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:18.451 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:18.451 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:18.452 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:18.452 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:18.452 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:18.452 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:18.452 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:18.452 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:18.452 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:18.452 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:18.453 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:18.453 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:18.453 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.453 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:46:18.453 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:18.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.454 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:46:18.454 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:18.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:46:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.456 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:46:18.456 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:18.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.456 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.456 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:18.456 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.457 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:46:18.457 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:18.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.457 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:46:18.458 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:18.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.458 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:18.458 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.459 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:46:18.459 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:18.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.459 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:46:18.459 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:18.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.460 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:46:18.460 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:46:18.460 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:46:18.460 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:46:18.460 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:18.462 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:18.462 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:18.462 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:18.462 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:18.462 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:18.462 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:18.462 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:18.463 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:18.463 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:18.463 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:18.463 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.463 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:46:18.463 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:18.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.464 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:46:18.464 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:18.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.464 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:18.465 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.465 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:46:18.465 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:18.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.466 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:46:18.466 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:18.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.466 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.467 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:18.467 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.467 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:46:18.467 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:18.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.468 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:46:18.468 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:18.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.468 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.469 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:18.469 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.469 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:46:18.469 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:18.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.470 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:46:18.470 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:18.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.470 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.470 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:46:18.470 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:46:18.471 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:46:18.471 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:46:18.471 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:18.471 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:18.471 INFO:teuthology.orchestra.run.smithi017.stdout: "full", 2023-08-09T12:46:18.471 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:18.471 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.472 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:18.472 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:18.472 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:18.472 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:18.472 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:18.472 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:18.473 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:18.473 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:18.473 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:18.473 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:18.473 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:18.473 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:18.473 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:18.473 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.474 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:46:18.474 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:18.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.474 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:46:18.475 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:18.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.475 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.475 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:18.475 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.476 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:46:18.476 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:18.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.476 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:46:18.476 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:18.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.477 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.477 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:18.477 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.477 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:46:18.478 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:18.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.478 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:46:18.478 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:18.478 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.478 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.479 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:18.479 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.479 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:46:18.479 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:18.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.480 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:46:18.480 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:18.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.480 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.481 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:46:18.481 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:46:18.481 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:46:18.481 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:46:18.481 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:18.481 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:18.481 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:18.481 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.482 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:18.482 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:18.482 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:18.482 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:18.482 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:18.482 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:18.483 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:18.483 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:18.483 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:18.483 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:18.483 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:18.483 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:18.483 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:18.483 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.484 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:46:18.484 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:18.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:46:18.485 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:18.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.485 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.485 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:18.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.486 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:46:18.486 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:18.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.486 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:46:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.488 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:46:18.488 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:18.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.488 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:46:18.488 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:18.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.489 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:18.489 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.489 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:46:18.490 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:18.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.490 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:46:18.490 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:18.490 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.491 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.491 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:46:18.491 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:46:18.491 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:46:18.491 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:46:18.491 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:18.491 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:18.492 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:18.492 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.492 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:18.492 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:18.492 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:18.492 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:18.493 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:18.493 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:18.493 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:18.493 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:18.493 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:18.493 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:18.493 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:18.494 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:18.494 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:18.494 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.494 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:46:18.494 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:18.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.495 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:46:18.495 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:18.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.495 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.495 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:18.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:46:18.496 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:18.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:46:18.497 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:18.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.497 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.497 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:18.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:46:18.498 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:18.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:46:18.499 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:18.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.499 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:18.499 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:46:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:46:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:18.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.501 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:46:18.501 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:46:18.501 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:46:18.501 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:46:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:18.504 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:18.504 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:18.504 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:18.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:46:18.505 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:18.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:46:18.505 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:18.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.505 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.506 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:18.506 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.506 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:46:18.506 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:18.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:46:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:18.508 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.508 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:46:18.508 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:18.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:46:18.509 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:18.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.509 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.509 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:18.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:46:18.510 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:18.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:46:18.511 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:18.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.511 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.511 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:46:18.511 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:46:18.511 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:46:18.511 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:46:18.512 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:18.512 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:18.512 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:18.512 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.512 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:18.513 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:18.513 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:18.513 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:18.513 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:18.513 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:18.513 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:18.513 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:18.513 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:18.514 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:18.514 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:18.514 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:18.514 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:18.514 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.514 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:46:18.515 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:18.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.515 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:46:18.515 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:18.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.516 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:18.516 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.516 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:46:18.516 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:18.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.517 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:46:18.517 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:18.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.517 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.518 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:18.518 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.518 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:46:18.518 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:18.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.519 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:46:18.519 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:18.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.519 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:18.520 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.520 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:46:18.520 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:18.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.521 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:46:18.521 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:18.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.521 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.521 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:46:18.521 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:46:18.521 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:46:18.522 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:46:18.522 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:18.522 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:18.522 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:18.522 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.522 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:18.523 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:18.523 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:18.523 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:18.523 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:18.524 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:18.524 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:18.524 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:18.524 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:18.524 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:18.524 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:18.524 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:18.525 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:18.525 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.525 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:46:18.525 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:18.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.526 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:46:18.526 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:18.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.527 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.527 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:18.527 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.528 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:46:18.528 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:18.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.528 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:46:18.529 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:18.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.529 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:18.529 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.530 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:46:18.530 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:18.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.531 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:46:18.531 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:18.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.531 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:18.532 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:18.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:18.532 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:46:18.532 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:18.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:18.533 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:46:18.533 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:18.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.533 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.533 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:46:18.533 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:46:18.533 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:46:18.534 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:46:18.534 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:18.534 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:18.534 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:18.534 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.534 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:18.535 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:46:18.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.535 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:18.535 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:18.535 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:18.535 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:18.535 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:18.535 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:18.536 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:46:18.536 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:18.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.536 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:18.536 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:18.536 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:18.536 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:18.537 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:18.537 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:18.537 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:46:18.537 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:18.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:18.537 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:18.538 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:18.538 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:18.538 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:18.538 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:18.538 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:46:18.538 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:18.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:18.539 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:18.539 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:18.539 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:18.539 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:18.539 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:18.539 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:46:18.539 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:18.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:18.540 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:18.540 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:18.540 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:18.540 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:18.541 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:18.541 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:46:18.541 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:18.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:18.541 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:18.541 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:18.542 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:18.542 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:18.542 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:18.542 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:46:18.542 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:18.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:18.543 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:18.543 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:18.543 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:18.543 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:18.543 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:18.543 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:46:18.543 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:18.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:18.544 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:18.544 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:18.544 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:18.544 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:18.544 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:18.544 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:46:18.545 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:18.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.545 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:18.545 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:46:18.545 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [ 2023-08-09T12:46:18.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.545 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.8", 2023-08-09T12:46:18.545 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:18.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.546 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:18.546 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 5 2023-08-09T12:46:18.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.546 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.546 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.1a", 2023-08-09T12:46:18.547 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:18.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.547 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:18.547 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 7 2023-08-09T12:46:18.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.547 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.548 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.21", 2023-08-09T12:46:18.548 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:18.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.548 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:18.548 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 7 2023-08-09T12:46:18.548 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.548 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.549 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.26", 2023-08-09T12:46:18.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:18.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:18.549 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:18.549 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 2 2023-08-09T12:46:18.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.550 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:18.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.550 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:18.550 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:46:18.550 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:46:18.550 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:46:18.550 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:46:18.550 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:46:18.551 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:46:18.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:46:18.551 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:46:18.551 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:46:18.551 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:46:18.551 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:46:18.551 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:46:18.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:46:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:46:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:46:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:46:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:46:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:46:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:46:18.553 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:46:18.553 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:46:18.553 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:46:18.553 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:46:18.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:18.553 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:46:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.397+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f92ec06a050 msgr2=0x7f92ec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.397+0000 7f930f3a2640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f92ec06a050 0x7f92ec06c510 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9304009a90 tx=0x7f9304008040 comp rx=0 tx=0).stop 2023-08-09T12:46:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.397+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9308158fe0 msgr2=0x7f9308159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.397+0000 7f930f3a2640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9308158fe0 0x7f9308159460 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f930000a830 tx=0x7f93080d0f00 comp rx=0 tx=0).stop 2023-08-09T12:46:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.398+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 shutdown_connections 2023-08-09T12:46:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.398+0000 7f930f3a2640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f92ec06a050 0x7f92ec06c510 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.398+0000 7f930f3a2640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9308158fe0 0x7f9308159460 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.398+0000 7f930f3a2640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93080b46e0 0x7f93080b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.398+0000 7f930f3a2640 1 --2- 172.21.15.17:0/1711207107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f4004d00 0x7f9308153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.398+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 >> 172.21.15.17:0/1711207107 conn(0x7f93080697c0 msgr2=0x7f93080d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.398+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 shutdown_connections 2023-08-09T12:46:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:18.398+0000 7f930f3a2640 1 -- 172.21.15.17:0/1711207107 wait complete. 2023-08-09T12:46:18.557 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:46:18.792 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:46:18.789+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-08-09T12:46:23.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:46:23.794 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:46:23.791+0000 7ff9cad83640 -1 log_channel(cluster) log [ERR] : Health check update: Full OSDs blocking recovery: 3 pgs recovery_toofull (PG_RECOVERY_FULL) 2023-08-09T12:46:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.795+0000 7f6503fff640 1 Processor -- start 2023-08-09T12:46:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.795+0000 7f6503fff640 1 -- start start 2023-08-09T12:46:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.796+0000 7f6503fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65040b86e0 0x7f65040cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.796+0000 7f6503fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040b5a30 con 0x7f65040cf980 2023-08-09T12:46:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.796+0000 7f6503fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040cfdd0 con 0x7f6504160030 2023-08-09T12:46:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.796+0000 7f6503fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65040d1110 con 0x7f65040b86e0 2023-08-09T12:46:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.797+0000 7f65037fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f65040cf980 0x7f65040d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55480/0 (socket says 172.21.15.17:55480) 2023-08-09T12:46:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.797+0000 7f65037fe640 1 -- 172.21.15.17:0/544006612 learned_addr learned my addr 172.21.15.17:0/544006612 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.797+0000 7f64fa7fc640 1 --2- 172.21.15.17:0/544006612 >> v2:172.21.15.142:3300/0 conn(0x7f65040b86e0 0x7f65040cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.797+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031623129 0 0) 0x7f65040b5a30 con 0x7f65040cf980 2023-08-09T12:46:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.797+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f0003520 con 0x7f65040cf980 2023-08-09T12:46:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3584748782 0 0) 0x7f64f0003520 con 0x7f65040cf980 2023-08-09T12:46:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 >> v2:172.21.15.142:3300/0 conn(0x7f65040b86e0 msgr2=0x7f65040cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 --2- 172.21.15.17:0/544006612 >> v2:172.21.15.142:3300/0 conn(0x7f65040b86e0 0x7f65040cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 >> v1:172.21.15.142:6789/0 conn(0x7f6504160030 legacy=0x7f6504160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65040d0d70 con 0x7f65040cf980 2023-08-09T12:46:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f64fc001a10 con 0x7f65040cf980 2023-08-09T12:46:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 >> v1:172.21.15.17:6789/0 conn(0x7f65040cf980 legacy=0x7f65040d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0003970 0x7f64f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f00047c0 0x7f64f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f64f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040d1110 con 0x7f64f0005180 2023-08-09T12:46:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f000c020 con 0x7f64f00047c0 2023-08-09T12:46:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f000c1e0 con 0x7f64f0003970 2023-08-09T12:46:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.798+0000 7f65037fe640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f64f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f65037fe640 1 -- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0003970 msgr2=0x7f64f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f6502ffd640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0003970 0x7f64f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f64fa7fc640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f00047c0 0x7f64f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f65037fe640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0003970 0x7f64f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f65037fe640 1 -- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f00047c0 msgr2=0x7f64f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f65037fe640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f00047c0 0x7f64f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f65037fe640 1 -- 172.21.15.17:0/544006612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0003520 con 0x7f64f0005180 2023-08-09T12:46:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f6502ffd640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0003970 0x7f64f0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.799+0000 7f64fa7fc640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f00047c0 0x7f64f0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.800+0000 7f65037fe640 1 -- 172.21.15.17:0/544006612 reap_dead start 2023-08-09T12:46:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.800+0000 7f65037fe640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f64f000b980 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00a810 tx=0x7f64f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ee472d45504795 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.800+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc034630 con 0x7f64f0005180 2023-08-09T12:46:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.800+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc02f070 con 0x7f64f0005180 2023-08-09T12:46:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.800+0000 7f65027fc640 1 -- 172.21.15.17:0/544006612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0349d0 con 0x7f64f0005180 2023-08-09T12:46:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.801+0000 7f6503fff640 1 -- 172.21.15.17:0/544006612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 msgr2=0x7f64f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.801+0000 7f6503fff640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f64f000b980 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00a810 tx=0x7f64f00057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.801+0000 7f6503fff640 1 -- 172.21.15.17:0/544006612 shutdown_connections 2023-08-09T12:46:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.801+0000 7f6503fff640 1 --2- 172.21.15.17:0/544006612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f64f000b980 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.801+0000 7f6503fff640 1 -- 172.21.15.17:0/544006612 >> 172.21.15.17:0/544006612 conn(0x7f65040697c0 msgr2=0x7f6504069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.801+0000 7f6503fff640 1 -- 172.21.15.17:0/544006612 shutdown_connections 2023-08-09T12:46:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.801+0000 7f6503fff640 1 -- 172.21.15.17:0/544006612 wait complete. 2023-08-09T12:46:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.803+0000 7f6503fff640 1 Processor -- start 2023-08-09T12:46:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.803+0000 7f6503fff640 1 -- start start 2023-08-09T12:46:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6503fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f65040b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6503fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6504152540 0x7f6504153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6503fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6504151310 0x7f65040c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6503fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65041529c0 con 0x7f64f0005180 2023-08-09T12:46:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6503fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65041520b0 con 0x7f6504151310 2023-08-09T12:46:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6503fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6504153580 con 0x7f6504152540 2023-08-09T12:46:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6502ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f65040b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6502ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f65040b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36570/0 (socket says 172.21.15.17:36570) 2023-08-09T12:46:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.804+0000 7f6502ffd640 1 -- 172.21.15.17:0/1102988933 learned_addr learned my addr 172.21.15.17:0/1102988933 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f65037fe640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6504151310 0x7f65040c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f64fa7fc640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6504152540 0x7f6504153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f6502ffd640 1 -- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6504152540 msgr2=0x7f6504153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f6502ffd640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6504152540 0x7f6504153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f6502ffd640 1 -- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6504151310 msgr2=0x7f65040c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f6502ffd640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6504151310 0x7f65040c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f6502ffd640 1 -- 172.21.15.17:0/1102988933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504153800 con 0x7f64f0005180 2023-08-09T12:46:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f6502ffd640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f65040b4970 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f64f4000f60 tx=0x7f64f400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.805+0000 7f6500ff9640 1 -- 172.21.15.17:0/1102988933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4005480 con 0x7f64f0005180 2023-08-09T12:46:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.806+0000 7f6500ff9640 1 -- 172.21.15.17:0/1102988933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f4003610 con 0x7f64f0005180 2023-08-09T12:46:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.806+0000 7f6500ff9640 1 -- 172.21.15.17:0/1102988933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40039c0 con 0x7f64f0005180 2023-08-09T12:46:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.806+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6504153ae0 con 0x7f64f0005180 2023-08-09T12:46:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.806+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6504151d40 con 0x7f64f0005180 2023-08-09T12:46:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.807+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504151ed0 con 0x7f64f0005180 2023-08-09T12:46:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.808+0000 7f6500ff9640 1 -- 172.21.15.17:0/1102988933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f64f4003b20 con 0x7f64f0005180 2023-08-09T12:46:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.809+0000 7f6500ff9640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64e406a050 0x7f64e406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.809+0000 7f6500ff9640 1 -- 172.21.15.17:0/1102988933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f64f40883b0 con 0x7f64f0005180 2023-08-09T12:46:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.809+0000 7f64fa7fc640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64e406a050 0x7f64e406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.810+0000 7f64fa7fc640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64e406a050 0x7f64e406c510 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f65040b7a80 tx=0x7f64ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:23.813+0000 7f6500ff9640 1 -- 172.21.15.17:0/1102988933 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f64f4053a10 con 0x7f64f0005180 2023-08-09T12:46:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.011+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f65040cfdd0 con 0x7f64f0005180 2023-08-09T12:46:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.015+0000 7f6500ff9640 1 -- 172.21.15.17:0/1102988933 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v118) v1 ==== 81+0+37676 (secure 0 0 0) 0x7f65040cfdd0 con 0x7f64f0005180 2023-08-09T12:46:24.018 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:24.019 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:46:24.019 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 118, 2023-08-09T12:46:24.019 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:46:24.019 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:46:24.019 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:46:18.920294+0000", 2023-08-09T12:46:24.019 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:46:24.020 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:46:24.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:46:24.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:46:24.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:46:24.020 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:46:24.020 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:46:24.021 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:46:24.021 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:46:24.021 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.021 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:46:24.021 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:46:24.021 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:46:24.022 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:46:24.022 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:46:24.022 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 14, 2023-08-09T12:46:24.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:46:24.022 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:46:24.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "luminous", 2023-08-09T12:46:24.023 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:46:24.023 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:46:24.023 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:46:24.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.023 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:46:24.024 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:46:24.024 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:46:24.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:24.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:24.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:24.024 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:24.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:24.025 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:24.025 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:24.025 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:24.025 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:24.026 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:24.026 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:24.026 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:24.026 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:46:24.027 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:46:24.027 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:46:24.027 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:46:24.027 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:46:24.028 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:24.028 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:24.028 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:24.028 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:24.028 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:24.028 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:24.028 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:24.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.029 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:46:24.029 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:24.029 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:24.029 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:24.029 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:24.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:24.031 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:24.031 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:24.031 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:24.031 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:24.031 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:24.031 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:24.031 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:24.032 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:24.032 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:24.032 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:24.032 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:24.033 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:24.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:24.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.033 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:24.033 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:24.033 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:24.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:24.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:24.034 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:24.034 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:24.034 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:24.034 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:24.034 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:24.034 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:24.035 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:24.035 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:46:24.035 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:46:24.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.035 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:24.035 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:46:24.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.036 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:24.036 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:46:24.036 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:46:24.036 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:46:24.036 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:46:24.037 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:46:24.037 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:24.037 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:24.037 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:24.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.038 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:46:24.038 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:46:24.038 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:46:24.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:24.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:24.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:24.039 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:24.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:24.039 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:24.039 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:24.039 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:24.039 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:24.039 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:24.039 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:24.040 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:24.040 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:46:24.040 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:46:24.040 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:46:24.040 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:46:24.040 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:46:24.040 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:46:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:24.043 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:24.043 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:24.043 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:24.043 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:24.043 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:24.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:24.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:24.044 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:24.044 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:24.044 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:24.044 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:24.044 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:24.044 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:24.044 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:24.044 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:24.045 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:24.045 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:24.045 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:24.045 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:24.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:24.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.045 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:24.045 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:24.046 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:24.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:24.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:24.046 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:24.046 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:24.046 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:24.047 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:24.047 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:24.047 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:24.047 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:46:24.047 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:24.047 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:46:24.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.048 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:24.048 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:46:24.048 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:46:24.048 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:46:24.048 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:24.048 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:24.049 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:24.049 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:24.049 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:24.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.050 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 13, 2023-08-09T12:46:24.050 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:46:24.050 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.039914+0000", 2023-08-09T12:46:24.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:24.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:24.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:24.051 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:24.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:24.052 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:24.052 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:24.052 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:24.052 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:24.053 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:24.053 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:24.053 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:24.053 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:46:24.054 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:46:24.054 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:46:24.054 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:46:24.054 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:46:24.055 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:24.055 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:24.055 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:24.055 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:24.055 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:24.056 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:24.056 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:24.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.056 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:46:24.056 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:24.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:24.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:24.057 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:24.057 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:24.057 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:24.057 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:24.058 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:24.058 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:24.058 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:24.058 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:24.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:24.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:24.058 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:24.059 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:24.059 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:24.059 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:24.059 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:24.059 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:24.060 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:24.060 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:24.060 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:24.060 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:24.060 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:24.061 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:24.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:24.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.061 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:24.061 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:24.061 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:24.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:24.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:24.062 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:24.062 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:24.062 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:24.062 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:24.062 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:24.062 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:24.062 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:24.063 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:46:24.063 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:46:24.063 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:46:24.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.063 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:24.063 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:24.063 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:46:24.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.064 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:24.064 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:46:24.064 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:46:24.064 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:24.064 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:46:24.064 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:46:24.065 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:24.065 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:24.065 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:24.065 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.065 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 14, 2023-08-09T12:46:24.065 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:46:24.066 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.697620+0000", 2023-08-09T12:46:24.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:24.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:24.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:24.066 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:24.066 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:24.067 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:24.067 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:24.067 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:24.067 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:24.067 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:24.067 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:24.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:24.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:46:24.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:46:24.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:46:24.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:46:24.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:46:24.069 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:24.069 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:24.069 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:24.069 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:24.069 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:24.069 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:24.069 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:24.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.070 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:46:24.070 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:24.070 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:24.070 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:24.070 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:24.070 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:24.070 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:24.076 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:24.076 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:24.076 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:24.076 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:24.077 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:24.077 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:24.077 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:24.078 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:24.078 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:46:24.078 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:46:24.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.079 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:24.079 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:24.079 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:46:24.079 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.080 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:24.080 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:46:24.080 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:46:24.081 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:24.081 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:24.081 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:24.081 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:24.082 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:24.082 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:24.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.083 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.083 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:46:24.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.083 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:24.084 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.084 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.084 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.085 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.085 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.085 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.085 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.086 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.086 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:24.086 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.086 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.087 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.087 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.088 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:46:24.088 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.089 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:46:24.089 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.090 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.090 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.091 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.091 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:46:24.091 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.092 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:46:24.092 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.092 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.093 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.093 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.093 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:46:24.093 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.094 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:46:24.094 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.094 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.094 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:46:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:46:24.096 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.096 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.096 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:46:24.096 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:46:24.097 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:46:24.097 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:46:24.097 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.097 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.097 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.097 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.098 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:24.098 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.098 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.098 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.098 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.098 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.098 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.098 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.099 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.099 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.099 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.099 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.099 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.099 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.100 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:46:24.100 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.101 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:46:24.101 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.101 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.101 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.101 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.102 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:46:24.102 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.102 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:46:24.102 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.103 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.103 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.103 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.103 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.104 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:46:24.104 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.104 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:46:24.104 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.105 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.105 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.105 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.105 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:46:24.105 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.106 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:46:24.106 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.106 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.107 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:46:24.107 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:46:24.107 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:46:24.107 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:46:24.107 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.107 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.108 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.108 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.108 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:24.108 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.109 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.109 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.109 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.109 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.110 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.110 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.110 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.110 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.110 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.110 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.111 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.111 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.111 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:46:24.111 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.112 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:46:24.112 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.112 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.113 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.113 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.113 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:46:24.113 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.114 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:46:24.114 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.114 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.115 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.115 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.115 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:46:24.115 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.116 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:46:24.116 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.116 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.117 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.117 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.117 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:46:24.117 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.118 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:46:24.118 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.119 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.119 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:46:24.119 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:46:24.119 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:46:24.120 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:46:24.120 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.120 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.120 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.120 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:24.121 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.121 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.121 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.121 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.121 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.122 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.122 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.122 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.122 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.122 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.122 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.122 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.122 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.123 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:46:24.123 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.123 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:46:24.124 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.124 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.124 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.125 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:46:24.125 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.125 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:46:24.126 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.126 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.126 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.127 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:46:24.127 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.127 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:46:24.127 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.128 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.128 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.128 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.129 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:46:24.129 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.129 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:46:24.129 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.130 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.130 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:46:24.130 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:46:24.130 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:46:24.130 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:46:24.131 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.131 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.131 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.131 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.132 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:24.132 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.132 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.132 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.132 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.132 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.132 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.133 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.133 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.133 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:24.133 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.133 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.133 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.133 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:46:24.134 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:46:24.134 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:46:24.136 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.136 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:46:24.136 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.137 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.137 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.137 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.138 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:46:24.138 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.138 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:46:24.138 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.139 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.139 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:46:24.139 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:46:24.140 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.141 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.141 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:46:24.141 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:46:24.141 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:46:24.141 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:46:24.142 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.142 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.142 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.142 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:24.143 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.143 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.143 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.143 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.143 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.143 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.143 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.143 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.144 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:24.144 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.144 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.144 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.144 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:46:24.145 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:46:24.145 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.146 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.146 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.146 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.146 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:46:24.147 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.147 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:46:24.147 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.148 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.148 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.148 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.148 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.148 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:46:24.148 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:46:24.149 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.149 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.149 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.150 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.150 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.150 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:46:24.150 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.151 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:46:24.151 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.152 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:46:24.152 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:46:24.152 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:46:24.152 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:46:24.152 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.153 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.153 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.153 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.153 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:24.153 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.153 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.154 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.154 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.154 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.154 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.154 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.154 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.154 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.154 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.155 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.155 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.155 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.155 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:46:24.155 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.156 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:46:24.156 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.156 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.157 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.157 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.157 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:46:24.157 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.158 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:46:24.158 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.158 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.158 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.158 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.159 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.159 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:46:24.159 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.160 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:46:24.160 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.160 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.160 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.160 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.160 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.161 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:46:24.161 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.162 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:46:24.162 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.162 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.162 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.162 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:46:24.163 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:46:24.163 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:46:24.163 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:46:24.163 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.163 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.163 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.163 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:46:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.167 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:46:24.167 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.167 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.168 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.168 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.168 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:46:24.168 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.169 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:46:24.169 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.169 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.169 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.170 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.170 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:46:24.170 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.171 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:46:24.171 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.171 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.171 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.172 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.172 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:46:24.173 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.173 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:46:24.173 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.174 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.174 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.174 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:46:24.174 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:46:24.174 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:46:24.174 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:46:24.174 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.175 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.175 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.175 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.175 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:46:24.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.176 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:24.176 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.176 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.176 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.176 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.176 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.176 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:46:24.177 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.177 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:24.177 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.177 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.177 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:46:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:24.178 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:46:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.180 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:46:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.181 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:46:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.182 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.183 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:46:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:46:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.186 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.187 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:46:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.188 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:46:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [ 2023-08-09T12:46:24.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.8", 2023-08-09T12:46:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 5 2023-08-09T12:46:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.191 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.1a", 2023-08-09T12:46:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.192 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 7 2023-08-09T12:46:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.21", 2023-08-09T12:46:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 7 2023-08-09T12:46:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.26", 2023-08-09T12:46:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:24.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 2 2023-08-09T12:46:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.196 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:46:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:46:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:46:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:46:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:46:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:46:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:46:24.197 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:46:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:46:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:46:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:46:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:46:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:46:24.198 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:46:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:46:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:46:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:46:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:46:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:46:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:46:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:46:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:46:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:46:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.200 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:46:24.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64e406a050 msgr2=0x7f64e406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64e406a050 0x7f64e406c510 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f65040b7a80 tx=0x7f64ec008040 comp rx=0 tx=0).stop 2023-08-09T12:46:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 msgr2=0x7f65040b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f65040b4970 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f64f4000f60 tx=0x7f64f400d9f0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 shutdown_connections 2023-08-09T12:46:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64e406a050 0x7f64e406c510 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6504151310 0x7f65040c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6504152540 0x7f6504153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 --2- 172.21.15.17:0/1102988933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64f0005180 0x7f65040b4970 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.017+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 >> 172.21.15.17:0/1102988933 conn(0x7f65040697c0 msgr2=0x7f65040d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.018+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 shutdown_connections 2023-08-09T12:46:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.018+0000 7f6503fff640 1 -- 172.21.15.17:0/1102988933 wait complete. 2023-08-09T12:46:24.204 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-09T12:46:24.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:46:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.449+0000 7fc5c3c60640 1 Processor -- start 2023-08-09T12:46:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.449+0000 7fc5c3c60640 1 -- start start 2023-08-09T12:46:24.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.450+0000 7fc5c3c60640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5bc15ce90 0x7fc5bc1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.450+0000 7fc5c3c60640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5bc0d29d0 0x7fc5bc0d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.450+0000 7fc5c3c60640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5bc0d3360 con 0x7fc5bc0b6000 2023-08-09T12:46:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.450+0000 7fc5c3c60640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc0b6460 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.450+0000 7fc5c3c60640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc0cdd10 con 0x7fc5bc15ce90 2023-08-09T12:46:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.451+0000 7fc5c11fb640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc5bc0b6000 0x7fc5bc0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55484/0 (socket says 172.21.15.17:55484) 2023-08-09T12:46:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.451+0000 7fc5c11fb640 1 -- 172.21.15.17:0/1083855937 learned_addr learned my addr 172.21.15.17:0/1083855937 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.451+0000 7fc5c21fd640 1 --2- 172.21.15.17:0/1083855937 >> v2:172.21.15.17:3300/0 conn(0x7fc5bc0d29d0 0x7fc5bc0d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.451+0000 7fc5c19fc640 1 --2- 172.21.15.17:0/1083855937 >> v2:172.21.15.142:3300/0 conn(0x7fc5bc15ce90 0x7fc5bc1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:24.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.451+0000 7fc5c09fa640 1 -- 172.21.15.17:0/1083855937 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635236895 0 0) 0x7fc5ac001110 con 0x7fc5bc0b6000 2023-08-09T12:46:24.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.451+0000 7fc5c09fa640 1 -- 172.21.15.17:0/1083855937 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a8003520 con 0x7fc5bc0b6000 2023-08-09T12:46:24.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.451+0000 7fc5c21fd640 1 -- 172.21.15.17:0/1083855937 >> v2:172.21.15.142:3300/0 conn(0x7fc5bc15ce90 msgr2=0x7fc5bc1616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:24.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.451+0000 7fc5c21fd640 1 --2- 172.21.15.17:0/1083855937 >> v2:172.21.15.142:3300/0 conn(0x7fc5bc15ce90 0x7fc5bc1616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.452+0000 7fc5c21fd640 1 -- 172.21.15.17:0/1083855937 >> v1:172.21.15.17:6789/0 conn(0x7fc5bc0b6000 legacy=0x7fc5bc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:24.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.452+0000 7fc5c21fd640 1 -- 172.21.15.17:0/1083855937 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0cdff0 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.453+0000 7fc5c21fd640 1 --2- 172.21.15.17:0/1083855937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc0d2e20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0d0690 tx=0x7fc5b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f541ef1da2892ce server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:24.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.453+0000 7fc5c09fa640 1 -- 172.21.15.17:0/1083855937 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4031830 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.453+0000 7fc5c09fa640 1 -- 172.21.15.17:0/1083855937 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4031990 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.453+0000 7fc5c09fa640 1 -- 172.21.15.17:0/1083855937 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4031d20 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.454+0000 7fc5c3c60640 1 -- 172.21.15.17:0/1083855937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 msgr2=0x7fc5bc0d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:24.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.454+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/1083855937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc0d2e20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0d0690 tx=0x7fc5b402b8d0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.454+0000 7fc5c3c60640 1 -- 172.21.15.17:0/1083855937 shutdown_connections 2023-08-09T12:46:24.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.454+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/1083855937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc0d2e20 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.454+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/1083855937 >> v2:172.21.15.142:3300/0 conn(0x7fc5bc15ce90 0x7fc5bc1616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.454+0000 7fc5c3c60640 1 -- 172.21.15.17:0/1083855937 >> 172.21.15.17:0/1083855937 conn(0x7fc5bc06fde0 msgr2=0x7fc5bc0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:24.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.454+0000 7fc5c3c60640 1 -- 172.21.15.17:0/1083855937 shutdown_connections 2023-08-09T12:46:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.454+0000 7fc5c3c60640 1 -- 172.21.15.17:0/1083855937 wait complete. 2023-08-09T12:46:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.456+0000 7fc5c3c60640 1 Processor -- start 2023-08-09T12:46:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.456+0000 7fc5c3c60640 1 -- start start 2023-08-09T12:46:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.457+0000 7fc5c3c60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5bc0b6000 0x7fc5bc1f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.457+0000 7fc5c3c60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c3c60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5bc15ce90 0x7fc5bc158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c3c60640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc0cc440 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c3c60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc0cb7c0 con 0x7fc5bc15ce90 2023-08-09T12:46:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c3c60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc0cbaa0 con 0x7fc5bc0b6000 2023-08-09T12:46:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c11fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c11fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36578/0 (socket says 172.21.15.17:36578) 2023-08-09T12:46:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c11fb640 1 -- 172.21.15.17:0/4104721997 learned_addr learned my addr 172.21.15.17:0/4104721997 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c21fd640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5bc15ce90 0x7fc5bc158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c11fb640 1 -- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5bc0b6000 msgr2=0x7fc5bc1f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c19fc640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5bc0b6000 0x7fc5bc1f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c11fb640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5bc0b6000 0x7fc5bc1f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c11fb640 1 -- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5bc15ce90 msgr2=0x7fc5bc158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c11fb640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5bc15ce90 0x7fc5bc158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c11fb640 1 -- 172.21.15.17:0/4104721997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b4009400 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.458+0000 7fc5c21fd640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5bc15ce90 0x7fc5bc158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.459+0000 7fc5c11fb640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc157310 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00c700 tx=0x7fc5ac00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.459+0000 7fc5b27fc640 1 -- 172.21.15.17:0/4104721997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac005ce0 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.459+0000 7fc5b27fc640 1 -- 172.21.15.17:0/4104721997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac005e40 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.459+0000 7fc5b27fc640 1 -- 172.21.15.17:0/4104721997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac007290 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.459+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc0cbd80 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.459+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc156b50 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.461+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc067a80 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.461+0000 7fc5b27fc640 1 -- 172.21.15.17:0/4104721997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5ac0074b0 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.462+0000 7fc5b27fc640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a006a050 0x7fc5a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:24.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.463+0000 7fc5b27fc640 1 -- 172.21.15.17:0/4104721997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fc5ac087ac0 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.463+0000 7fc5c19fc640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a006a050 0x7fc5a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:24.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.464+0000 7fc5c19fc640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a006a050 0x7fc5a006c510 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009e90 tx=0x7fc5b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:24.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.467+0000 7fc5b27fc640 1 -- 172.21.15.17:0/4104721997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc5ac056bb0 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.664+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc5bc0d3360 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.666+0000 7fc5b27fc640 1 -- 172.21.15.17:0/4104721997 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v118) v1 ==== 81+0+37676 (secure 0 0 0) 0x7fc5bc0d3360 con 0x7fc5bc0d29d0 2023-08-09T12:46:24.670 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:24.671 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:46:24.671 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 118, 2023-08-09T12:46:24.671 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:46:24.672 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:46:24.672 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:46:18.920294+0000", 2023-08-09T12:46:24.672 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:46:24.673 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:46:24.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:46:24.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:46:24.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:46:24.674 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:46:24.674 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:46:24.674 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:46:24.674 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:46:24.675 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.675 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:46:24.675 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:46:24.676 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:46:24.676 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:46:24.676 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:46:24.677 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 14, 2023-08-09T12:46:24.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:46:24.677 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:46:24.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "luminous", 2023-08-09T12:46:24.678 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:46:24.678 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:46:24.679 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:46:24.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.679 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:46:24.679 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:46:24.680 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:46:24.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:24.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:24.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:24.680 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:24.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:24.681 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:24.681 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:24.682 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:24.682 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:24.682 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:24.682 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:24.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:24.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:46:24.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:46:24.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:46:24.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:46:24.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:46:24.683 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:24.683 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:24.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:24.684 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:24.684 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:24.684 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:24.684 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:24.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.684 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:46:24.685 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:24.685 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:24.685 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:24.685 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:24.685 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:24.685 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:24.685 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:24.686 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:24.686 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:24.686 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:24.686 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:24.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:24.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:24.686 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:24.686 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:24.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:24.687 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:24.687 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:24.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:24.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:24.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:24.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:24.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:24.688 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:24.688 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:24.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:24.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.688 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:24.688 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:24.688 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:24.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:24.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:24.689 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:24.689 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:24.689 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:24.689 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:24.689 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:24.689 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:24.690 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:24.690 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:46:24.690 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:46:24.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.690 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:24.690 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:46:24.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.691 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:24.691 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:46:24.691 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:46:24.691 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:46:24.691 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:46:24.691 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:46:24.691 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:24.692 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:24.692 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:24.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.692 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:46:24.692 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:46:24.693 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:46:24.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:24.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:24.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:24.693 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:24.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:24.693 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:24.694 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:24.694 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:24.694 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:24.694 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:24.694 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:24.694 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:24.694 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:46:24.694 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:46:24.695 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:46:24.695 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:46:24.695 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:46:24.695 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:24.695 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:24.695 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:24.695 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:24.696 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:24.696 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:24.696 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:24.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.696 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:46:24.696 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:24.697 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:24.697 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:24.697 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:24.697 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:24.697 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:24.697 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:24.697 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:24.698 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:24.698 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:24.698 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:24.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:24.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:24.698 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:24.698 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:24.698 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:24.699 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:24.699 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:24.699 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:24.699 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:24.699 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:24.699 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:24.699 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:24.700 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:24.700 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:24.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:24.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.700 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:24.700 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:24.700 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:24.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:24.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:24.701 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:24.701 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:24.701 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:24.701 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:24.702 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:24.702 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:24.702 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:46:24.702 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:24.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:46:24.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.702 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:24.703 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:46:24.703 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:46:24.703 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:46:24.703 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:24.703 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:24.703 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:24.703 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:24.704 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:24.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.704 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 13, 2023-08-09T12:46:24.704 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:46:24.705 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.039914+0000", 2023-08-09T12:46:24.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:24.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:24.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:24.705 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:24.705 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:24.705 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:24.705 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:24.706 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:24.706 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:24.706 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:24.706 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:24.706 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:24.706 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:46:24.706 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:46:24.706 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:46:24.707 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:46:24.707 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:46:24.707 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:24.707 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:24.707 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:24.707 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:24.707 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:24.708 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:24.708 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:24.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.708 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:46:24.708 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:24.708 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:24.708 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:24.709 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:24.709 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:24.709 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:24.709 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:24.709 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:24.709 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:24.709 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:24.709 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:24.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:24.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:24.710 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:24.710 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:24.710 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:24.710 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:24.710 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:24.711 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:24.711 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:24.711 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:24.711 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:24.711 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:24.711 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:24.711 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:24.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:24.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.712 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:24.712 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:24.712 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:24.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:24.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:24.712 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:24.712 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:24.713 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:24.713 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:24.713 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:24.713 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:24.713 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:24.713 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:46:24.713 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:46:24.714 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:46:24.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.714 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:24.714 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:24.714 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:46:24.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.714 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:24.715 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:46:24.715 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:46:24.715 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:24.715 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:46:24.715 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:46:24.715 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:24.715 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:24.715 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:24.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.716 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 14, 2023-08-09T12:46:24.716 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:46:24.716 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:45:41.697620+0000", 2023-08-09T12:46:24.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:46:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:46:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:46:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:46:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:46:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:46:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:46:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:46:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:46:24.718 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:46:24.718 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:46:24.718 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:46:24.718 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:46:24.718 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:46:24.718 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:46:24.718 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:46:24.719 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:46:24.719 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:46:24.719 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:46:24.719 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:46:24.719 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:46:24.719 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:46:24.719 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:46:24.720 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:46:24.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.720 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:46:24.720 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:46:24.720 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:46:24.720 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:46:24.720 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:46:24.720 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:46:24.721 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:46:24.721 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:46:24.721 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:46:24.721 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:46:24.721 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:46:24.721 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:46:24.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:46:24.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:46:24.723 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:46:24.723 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:46:24.723 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:46:24.723 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:46:24.724 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:46:24.724 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:46:24.724 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:46:24.724 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:46:24.724 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:46:24.724 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:46:24.724 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:46:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:46:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:46:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:46:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:46:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:46:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:46:24.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:46:24.726 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:46:24.726 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:46:24.726 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:46:24.726 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:46:24.726 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:46:24.726 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:46:24.726 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:46:24.727 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:46:24.727 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:46:24.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.727 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:46:24.727 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:46:24.727 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:46:24.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.728 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:46:24.728 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.75, 2023-08-09T12:46:24.728 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.75, 2023-08-09T12:46:24.728 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:46:24.728 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:46:24.728 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:46:24.729 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:46:24.729 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:46:24.729 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:46:24.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.730 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.730 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.730 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:46:24.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.730 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:24.730 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.730 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.731 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.731 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.731 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.731 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.731 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.731 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.731 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:24.731 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.732 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.732 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.732 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.732 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:46:24.732 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.733 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:46:24.733 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.734 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.734 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.734 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:46:24.734 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.735 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:46:24.736 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.736 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.737 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.737 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.738 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:46:24.738 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.739 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:46:24.740 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.740 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.741 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.741 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.742 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:46:24.742 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.743 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:46:24.743 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:46:24.744 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.744 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.744 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:46:24.745 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:46:24.745 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:46:24.745 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:46:24.745 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.746 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.746 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.746 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.746 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:24.746 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.747 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.747 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.747 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.747 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.747 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.747 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.747 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.747 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:46:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:46:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.750 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.750 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.750 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:46:24.750 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.751 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:46:24.751 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.751 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.752 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.752 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.752 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:46:24.752 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.753 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:46:24.753 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.754 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.754 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.754 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:46:24.754 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.755 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:46:24.755 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:46:24.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.755 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:46:24.755 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:46:24.756 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:46:24.756 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:46:24.756 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.756 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.756 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.756 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:24.757 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.757 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.757 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.757 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.758 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.758 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.758 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.758 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.758 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.758 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.759 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.759 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.760 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:46:24.760 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.760 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:46:24.761 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.761 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.761 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.762 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:46:24.762 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.762 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:46:24.762 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.763 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.763 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.764 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:46:24.764 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.765 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:46:24.765 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.765 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.765 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.765 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.766 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:46:24.766 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.767 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:46:24.767 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:46:24.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.767 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:46:24.767 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:46:24.768 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:46:24.768 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:46:24.768 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.768 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.768 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.768 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:24.769 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.769 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.769 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.769 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.769 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.770 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.770 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.770 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.770 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.770 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.770 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.770 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.771 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:46:24.771 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.771 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:46:24.772 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.772 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.772 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.773 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:46:24.773 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.773 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:46:24.774 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.774 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.774 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.774 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.775 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:46:24.775 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.775 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:46:24.775 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.776 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.776 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.776 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.777 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:46:24.777 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.777 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:46:24.777 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:46:24.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.778 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.778 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:46:24.778 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:46:24.778 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:46:24.778 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:46:24.778 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.779 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.779 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.779 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.779 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:24.779 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.779 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.780 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.780 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.780 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.780 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.780 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.780 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.780 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:24.781 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.781 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.781 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.781 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.781 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:46:24.781 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.782 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:46:24.782 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.782 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.783 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.783 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.783 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:46:24.783 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.784 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:46:24.784 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.784 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.785 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.785 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.785 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:46:24.785 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:46:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.787 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:46:24.787 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.787 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:46:24.788 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:46:24.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.788 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.788 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:46:24.788 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:46:24.788 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:46:24.789 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:46:24.789 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.789 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.789 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.789 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.789 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:24.790 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.790 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.790 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.790 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.790 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.790 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.790 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.790 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.791 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 114, 2023-08-09T12:46:24.791 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.791 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.791 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.791 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.791 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:46:24.792 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.792 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:46:24.792 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.792 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.793 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.793 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.793 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:46:24.793 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.794 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:46:24.794 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.794 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.795 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.795 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.795 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:46:24.795 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.796 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:46:24.796 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.796 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.796 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.796 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.797 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:46:24.797 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.797 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:46:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:46:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:46:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:46:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:46:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:46:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.800 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.800 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.800 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.800 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.800 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.800 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.800 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.800 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.801 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.801 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.801 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.801 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.801 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:46:24.801 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.802 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:46:24.803 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.803 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.803 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.803 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.804 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:46:24.804 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.804 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:46:24.804 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.805 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.805 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.806 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:46:24.806 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.806 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:46:24.806 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.807 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.807 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.807 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.807 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.808 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:46:24.809 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.810 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:46:24.810 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:46:24.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.811 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.811 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:46:24.811 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:46:24.811 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:46:24.811 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:46:24.811 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.812 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.812 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.812 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.812 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:24.812 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:46:24.813 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:46:24.813 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:46:24.813 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:46:24.813 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:46:24.813 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:46:24.813 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:46:24.813 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:46:24.813 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 108, 2023-08-09T12:46:24.814 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:46:24.814 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:46:24.814 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:46:24.814 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.814 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:46:24.814 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.815 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:46:24.815 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.816 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:46:24.816 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.816 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:46:24.816 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.817 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:46:24.817 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.817 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.817 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:46:24.817 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.818 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:46:24.818 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.818 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:46:24.819 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.819 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.819 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:46:24.819 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:46:24.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:46:24.820 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:46:24.820 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:46:24.820 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:46:24.820 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:46:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:46:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:46:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:46:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:46:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:46:24.822 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:46:24.822 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:46:24.822 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.822 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.822 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:46:24.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.823 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:46:24.823 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.823 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.823 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.823 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.823 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.823 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:46:24.823 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.824 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:46:24.824 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.824 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.824 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.824 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.824 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.825 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:46:24.825 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.825 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:46:24.825 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.825 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.825 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:46:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:46:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:46:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.828 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:46:24.828 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.828 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.828 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.828 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.828 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.829 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:46:24.829 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.829 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:46:24.829 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.829 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.829 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.830 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.830 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.830 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:46:24.830 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.830 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:46:24.830 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.831 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.831 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.831 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.831 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.831 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:46:24.831 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.832 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:46:24.832 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:46:24.832 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:46:24.832 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:46:24.832 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:46:24.832 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:46:24.832 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:46:24.833 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:46:24.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.833 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.833 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:46:24.833 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [ 2023-08-09T12:46:24.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.833 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.8", 2023-08-09T12:46:24.834 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:24.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.834 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:24.834 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 5 2023-08-09T12:46:24.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.834 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.835 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.1a", 2023-08-09T12:46:24.835 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:24.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.835 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:24.835 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 7 2023-08-09T12:46:24.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.835 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.836 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.21", 2023-08-09T12:46:24.836 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:24.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.836 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:24.836 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 7 2023-08-09T12:46:24.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.836 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.837 INFO:teuthology.orchestra.run.smithi017.stdout: "pgid": "14.26", 2023-08-09T12:46:24.837 INFO:teuthology.orchestra.run.smithi017.stdout: "mappings": [ 2023-08-09T12:46:24.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:24.837 INFO:teuthology.orchestra.run.smithi017.stdout: "from": 1, 2023-08-09T12:46:24.837 INFO:teuthology.orchestra.run.smithi017.stdout: "to": 2 2023-08-09T12:46:24.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:24.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.838 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:46:24.838 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:46:24.838 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:46:24.838 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:46:24.838 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:46:24.839 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:46:24.839 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:46:24.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:46:24.839 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:46:24.839 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:46:24.839 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:46:24.839 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:46:24.839 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:46:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:46:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:46:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:46:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:46:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:46:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:46:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:46:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:46:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:46:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:46:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:46:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:24.841 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:46:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.669+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a006a050 msgr2=0x7fc5a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.669+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a006a050 0x7fc5a006c510 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009e90 tx=0x7fc5b800b040 comp rx=0 tx=0).stop 2023-08-09T12:46:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.669+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 msgr2=0x7fc5bc157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.669+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc157310 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00c700 tx=0x7fc5ac00cb00 comp rx=0 tx=0).stop 2023-08-09T12:46:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.670+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 shutdown_connections 2023-08-09T12:46:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.670+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a006a050 0x7fc5a006c510 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.670+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5bc15ce90 0x7fc5bc158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.670+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5bc0d29d0 0x7fc5bc157310 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.670+0000 7fc5c3c60640 1 --2- 172.21.15.17:0/4104721997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5bc0b6000 0x7fc5bc1f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:24.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.670+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 >> 172.21.15.17:0/4104721997 conn(0x7fc5bc06fde0 msgr2=0x7fc5bc0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:24.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.670+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 shutdown_connections 2023-08-09T12:46:24.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:24.670+0000 7fc5c3c60640 1 -- 172.21.15.17:0/4104721997 wait complete. 2023-08-09T12:46:24.845 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:46:25.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.082+0000 7fc0d5f71640 1 Processor -- start 2023-08-09T12:46:25.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.082+0000 7fc0d5f71640 1 -- start start 2023-08-09T12:46:25.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.083+0000 7fc0d5f71640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0d015ce90 0x7fc0d01616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:25.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.083+0000 7fc0d5f71640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6000 0x7fc0d00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:25.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.083+0000 7fc0d5f71640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d00b6460 con 0x7fc0d00d29d0 2023-08-09T12:46:25.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.083+0000 7fc0d5f71640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d00cda40 con 0x7fc0d015ce90 2023-08-09T12:46:25.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.083+0000 7fc0d5f71640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d00cdd10 con 0x7fc0d00b6000 2023-08-09T12:46:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0cf7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0d015ce90 0x7fc0d01616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0cf7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0d015ce90 0x7fc0d01616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36584/0 (socket says 172.21.15.17:36584) 2023-08-09T12:46:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0cf7fe640 1 -- 172.21.15.17:0/2064634415 learned_addr learned my addr 172.21.15.17:0/2064634415 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:25.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0cf7fe640 1 -- 172.21.15.17:0/2064634415 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6000 msgr2=0x7fc0d00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:25.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0ceffd640 1 --2- 172.21.15.17:0/2064634415 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6000 0x7fc0d00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:25.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0cf7fe640 1 --2- 172.21.15.17:0/2064634415 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6000 0x7fc0d00cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0cf7fe640 1 -- 172.21.15.17:0/2064634415 >> v1:172.21.15.142:6789/0 conn(0x7fc0d00d29d0 legacy=0x7fc0d00d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:25.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0cf7fe640 1 -- 172.21.15.17:0/2064634415 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d00cdff0 con 0x7fc0d015ce90 2023-08-09T12:46:25.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.084+0000 7fc0ceffd640 1 --2- 172.21.15.17:0/2064634415 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6000 0x7fc0d00cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.086+0000 7fc0cf7fe640 1 --2- 172.21.15.17:0/2064634415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d01616e0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00c9c00 tx=0x7fc0c002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c530cdd8f974e67c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.086+0000 7fc0ce7fc640 1 -- 172.21.15.17:0/2064634415 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c002ca80 con 0x7fc0d015ce90 2023-08-09T12:46:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.086+0000 7fc0ce7fc640 1 -- 172.21.15.17:0/2064634415 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c002cbe0 con 0x7fc0d015ce90 2023-08-09T12:46:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.086+0000 7fc0ce7fc640 1 -- 172.21.15.17:0/2064634415 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00343f0 con 0x7fc0d015ce90 2023-08-09T12:46:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.087+0000 7fc0d5f71640 1 -- 172.21.15.17:0/2064634415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 msgr2=0x7fc0d01616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.087+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/2064634415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d01616e0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00c9c00 tx=0x7fc0c002bee0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.087+0000 7fc0d5f71640 1 -- 172.21.15.17:0/2064634415 shutdown_connections 2023-08-09T12:46:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.087+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/2064634415 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6000 0x7fc0d00cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.087+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/2064634415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d01616e0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.087+0000 7fc0d5f71640 1 -- 172.21.15.17:0/2064634415 >> 172.21.15.17:0/2064634415 conn(0x7fc0d006fde0 msgr2=0x7fc0d00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.087+0000 7fc0d5f71640 1 -- 172.21.15.17:0/2064634415 shutdown_connections 2023-08-09T12:46:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.087+0000 7fc0d5f71640 1 -- 172.21.15.17:0/2064634415 wait complete. 2023-08-09T12:46:25.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.089+0000 7fc0d5f71640 1 Processor -- start 2023-08-09T12:46:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.089+0000 7fc0d5f71640 1 -- start start 2023-08-09T12:46:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0d5f71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00b6000 0x7fc0d0157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0d5f71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d29d0 0x7fc0d00ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0d5f71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0d5f71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00cbcc0 con 0x7fc0d015ce90 2023-08-09T12:46:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0d5f71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00cb0b0 con 0x7fc0d00d29d0 2023-08-09T12:46:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0d5f71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00cb390 con 0x7fc0d00b6000 2023-08-09T12:46:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d015d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36596/0 (socket says 172.21.15.17:36596) 2023-08-09T12:46:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cffff640 1 -- 172.21.15.17:0/1752925303 learned_addr learned my addr 172.21.15.17:0/1752925303 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cf7fe640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00b6000 0x7fc0d0157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0ceffd640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d29d0 0x7fc0d00ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:25.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cffff640 1 -- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00b6000 msgr2=0x7fc0d0157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cffff640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00b6000 0x7fc0d0157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cffff640 1 -- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d29d0 msgr2=0x7fc0d00ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cffff640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d29d0 0x7fc0d00ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cffff640 1 -- 172.21.15.17:0/1752925303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c0009b30 con 0x7fc0d015ce90 2023-08-09T12:46:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.090+0000 7fc0cf7fe640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00b6000 0x7fc0d0157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.091+0000 7fc0ceffd640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d29d0 0x7fc0d00ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.091+0000 7fc0cffff640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d015d9a0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800c390 tx=0x7fc0c800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.091+0000 7fc0b7fff640 1 -- 172.21.15.17:0/1752925303 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c80035f0 con 0x7fc0d015ce90 2023-08-09T12:46:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.091+0000 7fc0b7fff640 1 -- 172.21.15.17:0/1752925303 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c8003750 con 0x7fc0d015ce90 2023-08-09T12:46:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.091+0000 7fc0b7fff640 1 -- 172.21.15.17:0/1752925303 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8003b00 con 0x7fc0d015ce90 2023-08-09T12:46:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.091+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d00cb670 con 0x7fc0d015ce90 2023-08-09T12:46:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.091+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d0157950 con 0x7fc0d015ce90 2023-08-09T12:46:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.092+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d0067a80 con 0x7fc0d015ce90 2023-08-09T12:46:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.093+0000 7fc0b7fff640 1 -- 172.21.15.17:0/1752925303 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc0c8003c60 con 0x7fc0d015ce90 2023-08-09T12:46:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.094+0000 7fc0b7fff640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0bc06a080 0x7fc0bc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.094+0000 7fc0b7fff640 1 -- 172.21.15.17:0/1752925303 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fc0c8087880 con 0x7fc0d015ce90 2023-08-09T12:46:25.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.095+0000 7fc0cf7fe640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0bc06a080 0x7fc0bc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:25.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.096+0000 7fc0cf7fe640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0bc06a080 0x7fc0bc06c540 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0035000 tx=0x7fc0c0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:25.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.099+0000 7fc0b7fff640 1 -- 172.21.15.17:0/1752925303 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc0c8052e50 con 0x7fc0d015ce90 2023-08-09T12:46:25.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.329+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0d00d0ad0 con 0x7fc0d015ce90 2023-08-09T12:46:25.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.331+0000 7fc0b7fff640 1 -- 172.21.15.17:0/1752925303 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7fc0c8056470 con 0x7fc0d015ce90 2023-08-09T12:46:25.334 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:25.334 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:46:25.334 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:46:25.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0bc06a080 msgr2=0x7fc0bc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:25.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0bc06a080 0x7fc0bc06c540 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0035000 tx=0x7fc0c0030000 comp rx=0 tx=0).stop 2023-08-09T12:46:25.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 msgr2=0x7fc0d015d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:25.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d015d9a0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800c390 tx=0x7fc0c800c850 comp rx=0 tx=0).stop 2023-08-09T12:46:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 shutdown_connections 2023-08-09T12:46:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0bc06a080 0x7fc0bc06c540 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d015ce90 0x7fc0d015d9a0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d29d0 0x7fc0d00ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 --2- 172.21.15.17:0/1752925303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00b6000 0x7fc0d0157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.333+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 >> 172.21.15.17:0/1752925303 conn(0x7fc0d006fde0 msgr2=0x7fc0d00b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.334+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 shutdown_connections 2023-08-09T12:46:25.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:25.334+0000 7fc0d5f71640 1 -- 172.21.15.17:0/1752925303 wait complete. 2023-08-09T12:46:25.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-08-09T12:46:25.597 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":7029,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":42.372892125,"mdsmap_epoch":51,"osdmap_epoch":118,"osdmap_epoch_barrier":113,"uptime":48.193193475000001} 2023-08-09T12:46:25.598 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 7029, "mdsmap_epoch": 51, "osdmap_epoch": 118, "osdmap_epoch_barrier": 113, "rank_uptime": 42.372892125, "state": "up:active", "uptime": 48.193193475, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:46:25.598 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:46:25.599 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:25.599 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:25.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:25.664 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-08-09T12:46:26.113 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records in 2023-08-09T12:46:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records out 2023-08-09T12:46:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.387049 s, 135 MB/s 2023-08-09T12:46:26.115 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:46:26.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:46:26.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:46:26.339 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:46:26.340 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:26.340 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:26.405 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:26.405 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:26.463 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:26.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.691+0000 7f48bc5d6640 1 Processor -- start 2023-08-09T12:46:26.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.691+0000 7f48bc5d6640 1 -- start start 2023-08-09T12:46:26.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.692+0000 7f48bc5d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48b40cc430 0x7f48b406f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.692+0000 7f48bc5d6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48b40af8d0 0x7f48b40afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.692+0000 7f48bc5d6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b40ccbc0 con 0x7f48b415aab0 2023-08-09T12:46:26.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.692+0000 7f48bc5d6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b40b0280 con 0x7f48b40af8d0 2023-08-09T12:46:26.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.692+0000 7f48bc5d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40ccea0 con 0x7f48b40cc430 2023-08-09T12:46:26.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.692+0000 7f48ba372640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f48b415aab0 0x7f48b40b2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55500/0 (socket says 172.21.15.17:55500) 2023-08-09T12:46:26.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.693+0000 7f48ba372640 1 -- 172.21.15.17:0/2160490599 learned_addr learned my addr 172.21.15.17:0/2160490599 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:26.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.693+0000 7f48bab73640 1 --2- 172.21.15.17:0/2160490599 >> v2:172.21.15.142:3300/0 conn(0x7f48b40af8d0 0x7f48b40afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:26.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.693+0000 7f48b9b71640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48b40cc430 0x7f48b406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.693+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529299939 0 0) 0x7f48b40ccbc0 con 0x7f48b415aab0 2023-08-09T12:46:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.693+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a0003520 con 0x7f48b415aab0 2023-08-09T12:46:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.693+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1157791955 0 0) 0x7f48a0003520 con 0x7f48b415aab0 2023-08-09T12:46:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48b40cc430 msgr2=0x7f48b406f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48b40cc430 0x7f48b406f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 >> v2:172.21.15.142:3300/0 conn(0x7f48b40af8d0 msgr2=0x7f48b40afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:26.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 --2- 172.21.15.17:0/2160490599 >> v2:172.21.15.142:3300/0 conn(0x7f48b40af8d0 0x7f48b40afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40cd180 con 0x7f48b415aab0 2023-08-09T12:46:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f48b00019f0 con 0x7f48b415aab0 2023-08-09T12:46:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 >> v1:172.21.15.17:6789/0 conn(0x7f48b415aab0 legacy=0x7f48b40b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48a0003970 0x7f48a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48b40cc430 0x7f48a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a0004d00 0x7f48a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40b0280 con 0x7f48a0003970 2023-08-09T12:46:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40ccea0 con 0x7f48a0004d00 2023-08-09T12:46:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a000b980 con 0x7f48b40cc430 2023-08-09T12:46:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48ba372640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48a0003970 0x7f48a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:26.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48bab73640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a0004d00 0x7f48a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:26.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48ba372640 1 -- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48b40cc430 msgr2=0x7f48a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:26.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48ba372640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48b40cc430 0x7f48a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48ba372640 1 -- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a0004d00 msgr2=0x7f48a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:26.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48ba372640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48a0004d00 0x7f48a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.694+0000 7f48ba372640 1 -- 172.21.15.17:0/2160490599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0003520 con 0x7f48a0003970 2023-08-09T12:46:26.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.696+0000 7f48ba372640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48a0003970 0x7f48a0003d90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f48b000a890 tx=0x7f48a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0daa590e2125fb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:26.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.696+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0034630 con 0x7f48a0003970 2023-08-09T12:46:26.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.696+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b002f070 con 0x7f48a0003970 2023-08-09T12:46:26.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.696+0000 7f48b9370640 1 -- 172.21.15.17:0/2160490599 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b00349f0 con 0x7f48a0003970 2023-08-09T12:46:26.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.696+0000 7f48bc5d6640 1 -- 172.21.15.17:0/2160490599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48a0003970 msgr2=0x7f48a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.696+0000 7f48bc5d6640 1 --2- 172.21.15.17:0/2160490599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48a0003970 0x7f48a0003d90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f48b000a890 tx=0x7f48a00057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.697+0000 7f48bab73640 1 -- 172.21.15.17:0/2160490599 reap_dead start 2023-08-09T12:46:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.697+0000 7f48bc5d6640 1 -- 172.21.15.17:0/2160490599 shutdown_connections 2023-08-09T12:46:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.697+0000 7f48bc5d6640 1 -- 172.21.15.17:0/2160490599 >> 172.21.15.17:0/2160490599 conn(0x7f48b40cd440 msgr2=0x7f48b40cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:26.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.697+0000 7f48bc5d6640 1 -- 172.21.15.17:0/2160490599 shutdown_connections 2023-08-09T12:46:26.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.697+0000 7f48bc5d6640 1 -- 172.21.15.17:0/2160490599 wait complete. 2023-08-09T12:46:26.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.698+0000 7f48bc5d6640 1 Processor -- start 2023-08-09T12:46:26.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.699+0000 7f48bc5d6640 1 -- start start 2023-08-09T12:46:26.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bc5d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a0003970 0x7f48b4158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bc5d6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48b4158c50 0x7f48b40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bc5d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b40ca3c0 0x7f48b40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bc5d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40ca840 con 0x7f48b40ca3c0 2023-08-09T12:46:26.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bc5d6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41594f0 con 0x7f48b4158c50 2023-08-09T12:46:26.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bc5d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c91a0 con 0x7f48a0003970 2023-08-09T12:46:26.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bab73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b40ca3c0 0x7f48b40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:26.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bab73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b40ca3c0 0x7f48b40b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36604/0 (socket says 172.21.15.17:36604) 2023-08-09T12:46:26.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bab73640 1 -- 172.21.15.17:0/1814788589 learned_addr learned my addr 172.21.15.17:0/1814788589 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48ba372640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a0003970 0x7f48b4158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48b9b71640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48b4158c50 0x7f48b40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bab73640 1 -- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a0003970 msgr2=0x7f48b4158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bab73640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a0003970 0x7f48b4158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bab73640 1 -- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48b4158c50 msgr2=0x7f48b40c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:26.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bab73640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48b4158c50 0x7f48b40c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.700+0000 7f48bab73640 1 -- 172.21.15.17:0/1814788589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b415ce50 con 0x7f48b40ca3c0 2023-08-09T12:46:26.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.701+0000 7f48bab73640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b40ca3c0 0x7f48b40b3c30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f48b40b35b0 tx=0x7f48ac011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:26.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.701+0000 7f48aaffd640 1 -- 172.21.15.17:0/1814788589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac004500 con 0x7f48b40ca3c0 2023-08-09T12:46:26.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.701+0000 7f48aaffd640 1 -- 172.21.15.17:0/1814788589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac003610 con 0x7f48b40ca3c0 2023-08-09T12:46:26.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.701+0000 7f48aaffd640 1 -- 172.21.15.17:0/1814788589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0039c0 con 0x7f48b40ca3c0 2023-08-09T12:46:26.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.701+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b415d130 con 0x7f48b40ca3c0 2023-08-09T12:46:26.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.701+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b415d6f0 con 0x7f48b40ca3c0 2023-08-09T12:46:26.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.702+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b40cf580 con 0x7f48b40ca3c0 2023-08-09T12:46:26.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.703+0000 7f48aaffd640 1 -- 172.21.15.17:0/1814788589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f48ac003b20 con 0x7f48b40ca3c0 2023-08-09T12:46:26.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.705+0000 7f48aaffd640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f489806a050 0x7f489806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:26.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.705+0000 7f48aaffd640 1 -- 172.21.15.17:0/1814788589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f48ac0883b0 con 0x7f48b40ca3c0 2023-08-09T12:46:26.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.705+0000 7f48ba372640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f489806a050 0x7f489806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:26.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.707+0000 7f48ba372640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f489806a050 0x7f489806c510 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f48b0034000 tx=0x7f48b0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:26.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.709+0000 7f48aaffd640 1 -- 172.21.15.17:0/1814788589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f48ac053a20 con 0x7f48b40ca3c0 2023-08-09T12:46:26.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.905+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48b4067a80 con 0x7f48b40ca3c0 2023-08-09T12:46:26.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.908+0000 7f48aaffd640 1 -- 172.21.15.17:0/1814788589 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f48ac057040 con 0x7f48b40ca3c0 2023-08-09T12:46:26.911 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:26.911 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":118,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:18.920294+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:45:41.039914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-09T12:45:41.697620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:26.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.910+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f489806a050 msgr2=0x7f489806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:26.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.910+0000 7f48bc5d6640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f489806a050 0x7f489806c510 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f48b0034000 tx=0x7f48b0009030 comp rx=0 tx=0).stop 2023-08-09T12:46:26.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b40ca3c0 msgr2=0x7f48b40b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:26.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b40ca3c0 0x7f48b40b3c30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f48b40b35b0 tx=0x7f48ac011920 comp rx=0 tx=0).stop 2023-08-09T12:46:26.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 shutdown_connections 2023-08-09T12:46:26.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f489806a050 0x7f489806c510 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b40ca3c0 0x7f48b40b3c30 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48b4158c50 0x7f48b40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 --2- 172.21.15.17:0/1814788589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48a0003970 0x7f48b4158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:26.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 >> 172.21.15.17:0/1814788589 conn(0x7f48b40cd440 msgr2=0x7f48b40b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:26.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 shutdown_connections 2023-08-09T12:46:26.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:26.911+0000 7f48bc5d6640 1 -- 172.21.15.17:0/1814788589 wait complete. 2023-08-09T12:46:26.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:45:41.039914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:45:41.697620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:46:26.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:46:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.164+0000 7fa701621640 1 Processor -- start 2023-08-09T12:46:27.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.164+0000 7fa701621640 1 -- start start 2023-08-09T12:46:27.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.166+0000 7fa701621640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa6fc15a8c0 0x7fa6fc0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.166+0000 7fa701621640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b0020 0x7fa6fc0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.166+0000 7fa701621640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc15e7b0 con 0x7fa6fc0b13f0 2023-08-09T12:46:27.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.166+0000 7fa701621640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6fc0b09d0 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.166+0000 7fa701621640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0b1850 con 0x7fa6fc0b0020 2023-08-09T12:46:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.166+0000 7fa6f3fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa6fc0b13f0 0x7fa6fc15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55516/0 (socket says 172.21.15.17:55516) 2023-08-09T12:46:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.166+0000 7fa6f3fff640 1 -- 172.21.15.17:0/1579176054 learned_addr learned my addr 172.21.15.17:0/1579176054 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:27.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.166+0000 7fa6fbfff640 1 --2- 172.21.15.17:0/1579176054 >> v2:172.21.15.17:3300/0 conn(0x7fa6fc15a8c0 0x7fa6fc0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.167+0000 7fa700e20640 1 --2- 172.21.15.17:0/1579176054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b0020 0x7fa6fc0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.167+0000 7fa6fb7fe640 1 -- 172.21.15.17:0/1579176054 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293548589 0 0) 0x7fa6fc15e7b0 con 0x7fa6fc0b13f0 2023-08-09T12:46:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.167+0000 7fa6fb7fe640 1 -- 172.21.15.17:0/1579176054 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e8003520 con 0x7fa6fc0b13f0 2023-08-09T12:46:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.167+0000 7fa6fbfff640 1 -- 172.21.15.17:0/1579176054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b0020 msgr2=0x7fa6fc0b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.167+0000 7fa6fbfff640 1 --2- 172.21.15.17:0/1579176054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b0020 0x7fa6fc0b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.167+0000 7fa6fbfff640 1 -- 172.21.15.17:0/1579176054 >> v1:172.21.15.17:6789/0 conn(0x7fa6fc0b13f0 legacy=0x7fa6fc15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.167+0000 7fa6fbfff640 1 -- 172.21.15.17:0/1579176054 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc15e460 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.168+0000 7fa6fbfff640 1 --2- 172.21.15.17:0/1579176054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc0b4170 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0097a0 tx=0x7fa6ec02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763b4fec870ce162 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.168+0000 7fa6fb7fe640 1 -- 172.21.15.17:0/1579176054 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec02d040 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.168+0000 7fa6fb7fe640 1 -- 172.21.15.17:0/1579176054 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec031810 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.168+0000 7fa6fb7fe640 1 -- 172.21.15.17:0/1579176054 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec031ba0 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.169+0000 7fa701621640 1 -- 172.21.15.17:0/1579176054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 msgr2=0x7fa6fc0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.169+0000 7fa701621640 1 --2- 172.21.15.17:0/1579176054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc0b4170 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0097a0 tx=0x7fa6ec02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.169+0000 7fa701621640 1 -- 172.21.15.17:0/1579176054 shutdown_connections 2023-08-09T12:46:27.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.169+0000 7fa701621640 1 --2- 172.21.15.17:0/1579176054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b0020 0x7fa6fc0b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.169+0000 7fa701621640 1 --2- 172.21.15.17:0/1579176054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc0b4170 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.169+0000 7fa701621640 1 -- 172.21.15.17:0/1579176054 >> 172.21.15.17:0/1579176054 conn(0x7fa6fc0cb020 msgr2=0x7fa6fc0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:27.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.169+0000 7fa701621640 1 -- 172.21.15.17:0/1579176054 shutdown_connections 2023-08-09T12:46:27.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.169+0000 7fa701621640 1 -- 172.21.15.17:0/1579176054 wait complete. 2023-08-09T12:46:27.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.171+0000 7fa701621640 1 Processor -- start 2023-08-09T12:46:27.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.171+0000 7fa701621640 1 -- start start 2023-08-09T12:46:27.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.172+0000 7fa701621640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6fc0b0020 0x7fa6fc150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.172+0000 7fa701621640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b13f0 0x7fa6fc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.172+0000 7fa701621640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.172+0000 7fa701621640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc152030 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.172+0000 7fa701621640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc15c5b0 con 0x7fa6fc0b0020 2023-08-09T12:46:27.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.172+0000 7fa701621640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc15b500 con 0x7fa6fc0b13f0 2023-08-09T12:46:27.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa700e20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa700e20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc1505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36612/0 (socket says 172.21.15.17:36612) 2023-08-09T12:46:27.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa700e20640 1 -- 172.21.15.17:0/611825171 learned_addr learned my addr 172.21.15.17:0/611825171 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:27.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa6fbfff640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6fc0b0020 0x7fa6fc150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa6f3fff640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b13f0 0x7fa6fc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa700e20640 1 -- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b13f0 msgr2=0x7fa6fc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa700e20640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b13f0 0x7fa6fc15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa700e20640 1 -- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6fc0b0020 msgr2=0x7fa6fc150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa700e20640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6fc0b0020 0x7fa6fc150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.173+0000 7fa700e20640 1 -- 172.21.15.17:0/611825171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec009400 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.174+0000 7fa700e20640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc1505f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4007e70 tx=0x7fa6f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:27.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.174+0000 7fa6f97fa640 1 -- 172.21.15.17:0/611825171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4014620 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.174+0000 7fa6f97fa640 1 -- 172.21.15.17:0/611825171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f40147a0 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.174+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc150b30 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.174+0000 7fa6f97fa640 1 -- 172.21.15.17:0/611825171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4014b50 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.174+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc151690 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.175+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc152170 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.176+0000 7fa6f97fa640 1 -- 172.21.15.17:0/611825171 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6f4014cb0 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.177+0000 7fa6f97fa640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa6dc06a050 0x7fa6dc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.177+0000 7fa6f97fa640 1 -- 172.21.15.17:0/611825171 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fa6f4089090 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.178+0000 7fa6fbfff640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa6dc06a050 0x7fa6dc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.179+0000 7fa6fbfff640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa6dc06a050 0x7fa6dc06c510 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec036000 tx=0x7fa6ec03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:27.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.181+0000 7fa6f97fa640 1 -- 172.21.15.17:0/611825171 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa6fc152170 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.374+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6fc152170 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.375+0000 7fa6f97fa640 1 -- 172.21.15.17:0/611825171 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6fc152170 con 0x7fa6fc15a8c0 2023-08-09T12:46:27.378 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:46:27.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.377+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa6dc06a050 msgr2=0x7fa6dc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa6dc06a050 0x7fa6dc06c510 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec036000 tx=0x7fa6ec03c040 comp rx=0 tx=0).stop 2023-08-09T12:46:27.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 msgr2=0x7fa6fc1505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc1505f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4007e70 tx=0x7fa6f400e4b0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 shutdown_connections 2023-08-09T12:46:27.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa6dc06a050 0x7fa6dc06c510 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc15a8c0 0x7fa6fc1505f0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6fc0b13f0 0x7fa6fc15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 --2- 172.21.15.17:0/611825171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6fc0b0020 0x7fa6fc150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 >> 172.21.15.17:0/611825171 conn(0x7fa6fc0cb020 msgr2=0x7fa6fc1563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 shutdown_connections 2023-08-09T12:46:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.378+0000 7fa701621640 1 -- 172.21.15.17:0/611825171 wait complete. 2023-08-09T12:46:27.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:46:27.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.636+0000 7f2cd5a63640 1 Processor -- start 2023-08-09T12:46:27.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.636+0000 7f2cd5a63640 1 -- start start 2023-08-09T12:46:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.638+0000 7f2cd5a63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd0072850 0x7f2cd0072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.638+0000 7f2cd5a63640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2cd00cd5c0 0x7f2cd00cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.638+0000 7f2cd5a63640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd00cac30 con 0x7f2cd015a8e0 2023-08-09T12:46:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.638+0000 7f2cd5a63640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd0073210 con 0x7f2cd00cd5c0 2023-08-09T12:46:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.638+0000 7f2cd5a63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00caf10 con 0x7f2cd0072850 2023-08-09T12:46:27.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.638+0000 7f2cd5262640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2cd00cd5c0 0x7f2cd00cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.638+0000 7f2cd4a61640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2cd015a8e0 0x7f2cd015dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55524/0 (socket says 172.21.15.17:55524) 2023-08-09T12:46:27.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.638+0000 7f2cd4a61640 1 -- 172.21.15.17:0/341453712 learned_addr learned my addr 172.21.15.17:0/341453712 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:27.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.639+0000 7f2cd5262640 1 -- 172.21.15.17:0/341453712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd0072850 msgr2=0x7f2cd0072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:27.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.639+0000 7f2cd5262640 1 --2- 172.21.15.17:0/341453712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd0072850 0x7f2cd0072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.639+0000 7f2cd5262640 1 -- 172.21.15.17:0/341453712 >> v1:172.21.15.17:6789/0 conn(0x7f2cd015a8e0 legacy=0x7f2cd015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.639+0000 7f2cd5262640 1 -- 172.21.15.17:0/341453712 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00cb1f0 con 0x7f2cd00cd5c0 2023-08-09T12:46:27.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.640+0000 7f2cd5262640 1 --2- 172.21.15.17:0/341453712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd00cd5c0 0x7f2cd00cda30 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80097a0 tx=0x7f2cc802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c1a3ba76c51db9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:27.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.640+0000 7f2cc77fe640 1 -- 172.21.15.17:0/341453712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc802d040 con 0x7f2cd00cd5c0 2023-08-09T12:46:27.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.640+0000 7f2cc77fe640 1 -- 172.21.15.17:0/341453712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8031810 con 0x7f2cd00cd5c0 2023-08-09T12:46:27.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.640+0000 7f2cc77fe640 1 -- 172.21.15.17:0/341453712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8031ba0 con 0x7f2cd00cd5c0 2023-08-09T12:46:27.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.641+0000 7f2cd5a63640 1 -- 172.21.15.17:0/341453712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd00cd5c0 msgr2=0x7f2cd00cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.641+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/341453712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd00cd5c0 0x7f2cd00cda30 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80097a0 tx=0x7f2cc802b8b0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.641+0000 7f2cd5a63640 1 -- 172.21.15.17:0/341453712 shutdown_connections 2023-08-09T12:46:27.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.641+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/341453712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd00cd5c0 0x7f2cd00cda30 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.641+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/341453712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd0072850 0x7f2cd0072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.641+0000 7f2cd5a63640 1 -- 172.21.15.17:0/341453712 >> 172.21.15.17:0/341453712 conn(0x7f2cd00b1390 msgr2=0x7f2cd00b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:27.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.641+0000 7f2cd5a63640 1 -- 172.21.15.17:0/341453712 shutdown_connections 2023-08-09T12:46:27.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.641+0000 7f2cd5a63640 1 -- 172.21.15.17:0/341453712 wait complete. 2023-08-09T12:46:27.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.643+0000 7f2cd5a63640 1 Processor -- start 2023-08-09T12:46:27.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.643+0000 7f2cd5a63640 1 -- start start 2023-08-09T12:46:27.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.644+0000 7f2cd5a63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0072850 0x7f2cd006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.644+0000 7f2cd5a63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00cd5c0 0x7f2cd0156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.644+0000 7f2cd5a63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015a8e0 0x7f2cd01f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.644+0000 7f2cd5a63640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd01568d0 con 0x7f2cd0072850 2023-08-09T12:46:27.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.644+0000 7f2cd5a63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd015e3c0 con 0x7f2cd015a8e0 2023-08-09T12:46:27.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.644+0000 7f2cd5a63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd01f2f10 con 0x7f2cd00cd5c0 2023-08-09T12:46:27.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.644+0000 7f2cd4a61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0072850 0x7f2cd006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd4a61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0072850 0x7f2cd006d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36630/0 (socket says 172.21.15.17:36630) 2023-08-09T12:46:27.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd4a61640 1 -- 172.21.15.17:0/3740835872 learned_addr learned my addr 172.21.15.17:0/3740835872 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:27.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd4a61640 1 -- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00cd5c0 msgr2=0x7f2cd0156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd4a61640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00cd5c0 0x7f2cd0156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd5262640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015a8e0 0x7f2cd01f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd4a61640 1 -- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015a8e0 msgr2=0x7f2cd01f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd4a61640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015a8e0 0x7f2cd01f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd4a61640 1 -- 172.21.15.17:0/3740835872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8009400 con 0x7f2cd0072850 2023-08-09T12:46:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd5262640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015a8e0 0x7f2cd01f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.645+0000 7f2cd4a61640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0072850 0x7f2cd006d270 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00cbc0 tx=0x7f2ccc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:27.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.646+0000 7f2cc57fa640 1 -- 172.21.15.17:0/3740835872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00aca0 con 0x7f2cd0072850 2023-08-09T12:46:27.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.646+0000 7f2cc57fa640 1 -- 172.21.15.17:0/3740835872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc00ae00 con 0x7f2cd0072850 2023-08-09T12:46:27.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.646+0000 7f2cc57fa640 1 -- 172.21.15.17:0/3740835872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc012600 con 0x7f2cd0072850 2023-08-09T12:46:27.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.646+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd0155cc0 con 0x7f2cd0072850 2023-08-09T12:46:27.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.646+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd0156280 con 0x7f2cd0072850 2023-08-09T12:46:27.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.647+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd004e390 con 0x7f2cd0072850 2023-08-09T12:46:27.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.648+0000 7f2cc57fa640 1 -- 172.21.15.17:0/3740835872 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ccc007070 con 0x7f2cd0072850 2023-08-09T12:46:27.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.649+0000 7f2cc57fa640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2cbc06a050 0x7f2cbc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:27.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.649+0000 7f2cc57fa640 1 -- 172.21.15.17:0/3740835872 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f2ccc088550 con 0x7f2cd0072850 2023-08-09T12:46:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.650+0000 7f2cc7fff640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2cbc06a050 0x7f2cbc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.651+0000 7f2cc7fff640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2cbc06a050 0x7f2cbc06c510 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00b52d0 tx=0x7f2cc0006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:27.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.653+0000 7f2cc57fa640 1 -- 172.21.15.17:0/3740835872 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2ccc053bd0 con 0x7f2cd0072850 2023-08-09T12:46:27.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.843+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2cd00aef80 con 0x7f2cd0072850 2023-08-09T12:46:27.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.845+0000 7f2cc57fa640 1 -- 172.21.15.17:0/3740835872 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2ccc0571f0 con 0x7f2cd0072850 2023-08-09T12:46:27.848 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:46:27.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2cbc06a050 msgr2=0x7f2cbc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2cbc06a050 0x7f2cbc06c510 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00b52d0 tx=0x7f2cc0006c90 comp rx=0 tx=0).stop 2023-08-09T12:46:27.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0072850 msgr2=0x7f2cd006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:27.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0072850 0x7f2cd006d270 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00cbc0 tx=0x7f2ccc00a060 comp rx=0 tx=0).stop 2023-08-09T12:46:27.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 shutdown_connections 2023-08-09T12:46:27.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2cbc06a050 0x7f2cbc06c510 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015a8e0 0x7f2cd01f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00cd5c0 0x7f2cd0156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 --2- 172.21.15.17:0/3740835872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0072850 0x7f2cd006d270 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:27.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 >> 172.21.15.17:0/3740835872 conn(0x7f2cd00b1390 msgr2=0x7f2cd01579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:27.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 shutdown_connections 2023-08-09T12:46:27.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:27.847+0000 7f2cd5a63640 1 -- 172.21.15.17:0/3740835872 wait complete. 2023-08-09T12:46:27.870 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:46:28.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.088+0000 7f51d0c38640 1 Processor -- start 2023-08-09T12:46:28.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.088+0000 7f51d0c38640 1 -- start start 2023-08-09T12:46:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.090+0000 7f51d0c38640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51cc1573e0 0x7f51cc15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.090+0000 7f51d0c38640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51cc06c070 0x7f51cc0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.090+0000 7f51d0c38640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc15e240 con 0x7f51cc0cb6c0 2023-08-09T12:46:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.090+0000 7f51d0c38640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc1577c0 con 0x7f51cc06c070 2023-08-09T12:46:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.090+0000 7f51d0c38640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc15d240 con 0x7f51cc1573e0 2023-08-09T12:46:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51c9d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51cc06c070 0x7f51cc0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51c9d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51cc06c070 0x7f51cc0cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57656/0 (socket says 172.21.15.17:57656) 2023-08-09T12:46:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51c9d9b640 1 -- 172.21.15.17:0/1107450145 learned_addr learned my addr 172.21.15.17:0/1107450145 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51c9d9b640 1 -- 172.21.15.17:0/1107450145 >> v2:172.21.15.142:3300/0 conn(0x7f51cc1573e0 msgr2=0x7f51cc15dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51ca59c640 1 --2- 172.21.15.17:0/1107450145 >> v2:172.21.15.142:3300/0 conn(0x7f51cc1573e0 0x7f51cc15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51c9d9b640 1 --2- 172.21.15.17:0/1107450145 >> v2:172.21.15.142:3300/0 conn(0x7f51cc1573e0 0x7f51cc15dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51c9d9b640 1 -- 172.21.15.17:0/1107450145 >> v1:172.21.15.142:6789/0 conn(0x7f51cc0cb6c0 legacy=0x7f51cc0ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51c9d9b640 1 -- 172.21.15.17:0/1107450145 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0cbb90 con 0x7f51cc06c070 2023-08-09T12:46:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.091+0000 7f51ca59c640 1 --2- 172.21.15.17:0/1107450145 >> v2:172.21.15.142:3300/0 conn(0x7f51cc1573e0 0x7f51cc15dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.093+0000 7f51c9d9b640 1 --2- 172.21.15.17:0/1107450145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc0cb180 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f51cc06cfb0 tx=0x7f51c002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6108584551cd1de server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.093+0000 7f51c959a640 1 -- 172.21.15.17:0/1107450145 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c00317e0 con 0x7f51cc06c070 2023-08-09T12:46:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.093+0000 7f51c959a640 1 -- 172.21.15.17:0/1107450145 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0031940 con 0x7f51cc06c070 2023-08-09T12:46:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.093+0000 7f51c959a640 1 -- 172.21.15.17:0/1107450145 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0031cd0 con 0x7f51cc06c070 2023-08-09T12:46:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.094+0000 7f51d0c38640 1 -- 172.21.15.17:0/1107450145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 msgr2=0x7f51cc0cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.094+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1107450145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc0cb180 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f51cc06cfb0 tx=0x7f51c002b880 comp rx=0 tx=0).stop 2023-08-09T12:46:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.094+0000 7f51d0c38640 1 -- 172.21.15.17:0/1107450145 shutdown_connections 2023-08-09T12:46:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.094+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1107450145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc0cb180 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.094+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1107450145 >> v2:172.21.15.142:3300/0 conn(0x7f51cc1573e0 0x7f51cc15dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.094+0000 7f51d0c38640 1 -- 172.21.15.17:0/1107450145 >> 172.21.15.17:0/1107450145 conn(0x7f51cc069be0 msgr2=0x7f51cc069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.094+0000 7f51d0c38640 1 -- 172.21.15.17:0/1107450145 shutdown_connections 2023-08-09T12:46:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.094+0000 7f51d0c38640 1 -- 172.21.15.17:0/1107450145 wait complete. 2023-08-09T12:46:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.096+0000 7f51d0c38640 1 Processor -- start 2023-08-09T12:46:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.096+0000 7f51d0c38640 1 -- start start 2023-08-09T12:46:28.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51d0c38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51d0c38640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51cc0cb6c0 0x7f51cc1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51d0c38640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51cc1573e0 0x7f51cc152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51d0c38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0b35d0 con 0x7f51cc06c070 2023-08-09T12:46:28.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51d0c38640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc1f3610 con 0x7f51cc0cb6c0 2023-08-09T12:46:28.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51d0c38640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc15bda0 con 0x7f51cc1573e0 2023-08-09T12:46:28.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51ca59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51ca59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc15aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57666/0 (socket says 172.21.15.17:57666) 2023-08-09T12:46:28.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.097+0000 7f51ca59c640 1 -- 172.21.15.17:0/1275574296 learned_addr learned my addr 172.21.15.17:0/1275574296 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:28.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51c9d9b640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51cc0cb6c0 0x7f51cc1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51cad9d640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51cc1573e0 0x7f51cc152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51ca59c640 1 -- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51cc1573e0 msgr2=0x7f51cc152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51ca59c640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51cc1573e0 0x7f51cc152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51ca59c640 1 -- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51cc0cb6c0 msgr2=0x7f51cc1f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51ca59c640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51cc0cb6c0 0x7f51cc1f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51ca59c640 1 -- 172.21.15.17:0/1275574296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00094d0 con 0x7f51cc06c070 2023-08-09T12:46:28.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51ca59c640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc15aaf0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00c7f0 tx=0x7f51bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:28.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51baffd640 1 -- 172.21.15.17:0/1275574296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0077c0 con 0x7f51cc06c070 2023-08-09T12:46:28.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51baffd640 1 -- 172.21.15.17:0/1275574296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc007920 con 0x7f51cc06c070 2023-08-09T12:46:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.098+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc15b190 con 0x7f51cc06c070 2023-08-09T12:46:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.099+0000 7f51baffd640 1 -- 172.21.15.17:0/1275574296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc007c90 con 0x7f51cc06c070 2023-08-09T12:46:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.099+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc15b750 con 0x7f51cc06c070 2023-08-09T12:46:28.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.100+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc067a80 con 0x7f51cc06c070 2023-08-09T12:46:28.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.101+0000 7f51baffd640 1 -- 172.21.15.17:0/1275574296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f51bc0113f0 con 0x7f51cc06c070 2023-08-09T12:46:28.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.102+0000 7f51baffd640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51ac06a050 0x7f51ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.102+0000 7f51baffd640 1 -- 172.21.15.17:0/1275574296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f51bc0888c0 con 0x7f51cc06c070 2023-08-09T12:46:28.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.103+0000 7f51c9d9b640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51ac06a050 0x7f51ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.104+0000 7f51c9d9b640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51ac06a050 0x7f51ac06c510 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f51c0036000 tx=0x7f51c003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.106+0000 7f51baffd640 1 -- 172.21.15.17:0/1275574296 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f51bc053f20 con 0x7f51cc06c070 2023-08-09T12:46:28.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.299+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51cc153910 con 0x7f51cc06c070 2023-08-09T12:46:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.300+0000 7f51baffd640 1 -- 172.21.15.17:0/1275574296 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51bc057540 con 0x7f51cc06c070 2023-08-09T12:46:28.303 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:46:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51ac06a050 msgr2=0x7f51ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51ac06a050 0x7f51ac06c510 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f51c0036000 tx=0x7f51c003d040 comp rx=0 tx=0).stop 2023-08-09T12:46:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 msgr2=0x7f51cc15aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc15aaf0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00c7f0 tx=0x7f51bc00ccb0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 shutdown_connections 2023-08-09T12:46:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51ac06a050 0x7f51ac06c510 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51cc1573e0 0x7f51cc152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51cc0cb6c0 0x7f51cc1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 --2- 172.21.15.17:0/1275574296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51cc06c070 0x7f51cc15aaf0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 >> 172.21.15.17:0/1275574296 conn(0x7f51cc069be0 msgr2=0x7f51cc069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 shutdown_connections 2023-08-09T12:46:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.303+0000 7f51d0c38640 1 -- 172.21.15.17:0/1275574296 wait complete. 2023-08-09T12:46:28.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:46:28.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.554+0000 7ff61403f640 1 Processor -- start 2023-08-09T12:46:28.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.554+0000 7ff61403f640 1 -- start start 2023-08-09T12:46:28.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.556+0000 7ff61403f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff60c0b2b60 0x7ff60c167e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.556+0000 7ff61403f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c0cfc20 con 0x7ff60c15d1a0 2023-08-09T12:46:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.556+0000 7ff61403f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c06ab40 con 0x7ff60c15cdc0 2023-08-09T12:46:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.556+0000 7ff61403f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c06a2a0 con 0x7ff60c0b2b60 2023-08-09T12:46:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.556+0000 7ff6115da640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff60c15d1a0 0x7ff60c0b2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48950/0 (socket says 172.21.15.17:48950) 2023-08-09T12:46:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.556+0000 7ff6115da640 1 -- 172.21.15.17:0/2119523032 learned_addr learned my addr 172.21.15.17:0/2119523032 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.556+0000 7ff6125dc640 1 --2- 172.21.15.17:0/2119523032 >> v2:172.21.15.142:3300/0 conn(0x7ff60c0b2b60 0x7ff60c167e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329127091 0 0) 0x7ff60c0cfc20 con 0x7ff60c15d1a0 2023-08-09T12:46:28.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f8003520 con 0x7ff60c15d1a0 2023-08-09T12:46:28.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1434780221 0 0) 0x7ff5f8003520 con 0x7ff60c15d1a0 2023-08-09T12:46:28.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 >> v2:172.21.15.142:3300/0 conn(0x7ff60c0b2b60 msgr2=0x7ff60c167e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:28.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 --2- 172.21.15.17:0/2119523032 >> v2:172.21.15.142:3300/0 conn(0x7ff60c0b2b60 0x7ff60c167e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 >> v1:172.21.15.142:6789/0 conn(0x7ff60c15cdc0 legacy=0x7ff60c0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c06a580 con 0x7ff60c15d1a0 2023-08-09T12:46:28.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff5fc001670 con 0x7ff60c15d1a0 2023-08-09T12:46:28.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 >> v1:172.21.15.17:6789/0 conn(0x7ff60c15d1a0 legacy=0x7ff60c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f8003970 0x7ff5f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f80047c0 0x7ff5f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f8005180 0x7ff5f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c06a2a0 con 0x7ff5f8003970 2023-08-09T12:46:28.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f800c020 con 0x7ff5f8005180 2023-08-09T12:46:28.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.557+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f800c1e0 con 0x7ff5f80047c0 2023-08-09T12:46:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff611ddb640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f8003970 0x7ff5f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff6115da640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f80047c0 0x7ff5f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff6125dc640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f8005180 0x7ff5f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff611ddb640 1 -- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f80047c0 msgr2=0x7ff5f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff611ddb640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f80047c0 0x7ff5f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff611ddb640 1 -- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f8005180 msgr2=0x7ff5f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff611ddb640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f8005180 0x7ff5f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff611ddb640 1 -- 172.21.15.17:0/2119523032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8003520 con 0x7ff5f8003970 2023-08-09T12:46:28.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff6125dc640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f8005180 0x7ff5f800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:28.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.558+0000 7ff6125dc640 1 -- 172.21.15.17:0/2119523032 reap_dead start 2023-08-09T12:46:28.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.559+0000 7ff611ddb640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f8003970 0x7ff5f8003d90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff608001750 tx=0x7ff5f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc03513d4b8e38a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:28.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080052d0 con 0x7ff5f8003970 2023-08-09T12:46:28.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60802e050 con 0x7ff5f8003970 2023-08-09T12:46:28.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff610dd9640 1 -- 172.21.15.17:0/2119523032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608003830 con 0x7ff5f8003970 2023-08-09T12:46:28.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff61403f640 1 -- 172.21.15.17:0/2119523032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f8003970 msgr2=0x7ff5f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff61403f640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f8003970 0x7ff5f8003d90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff608001750 tx=0x7ff5f80057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff61403f640 1 -- 172.21.15.17:0/2119523032 shutdown_connections 2023-08-09T12:46:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff61403f640 1 --2- 172.21.15.17:0/2119523032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f8003970 0x7ff5f8003d90 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff61403f640 1 -- 172.21.15.17:0/2119523032 >> 172.21.15.17:0/2119523032 conn(0x7ff60c06cf40 msgr2=0x7ff60c06d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff61403f640 1 -- 172.21.15.17:0/2119523032 shutdown_connections 2023-08-09T12:46:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.560+0000 7ff61403f640 1 -- 172.21.15.17:0/2119523032 wait complete. 2023-08-09T12:46:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.562+0000 7ff61403f640 1 Processor -- start 2023-08-09T12:46:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.562+0000 7ff61403f640 1 -- start start 2023-08-09T12:46:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.563+0000 7ff61403f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f8003970 0x7ff60c15df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.563+0000 7ff61403f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1603a0 0x7ff60c0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.563+0000 7ff61403f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff60c15e470 0x7ff60c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.563+0000 7ff61403f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0c4640 con 0x7ff60c15e470 2023-08-09T12:46:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.563+0000 7ff61403f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0c4920 con 0x7ff60c1603a0 2023-08-09T12:46:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.563+0000 7ff61403f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0c4c00 con 0x7ff5f8003970 2023-08-09T12:46:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6125dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff60c15e470 0x7ff60c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6125dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff60c15e470 0x7ff60c0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57686/0 (socket says 172.21.15.17:57686) 2023-08-09T12:46:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6125dc640 1 -- 172.21.15.17:0/4258337833 learned_addr learned my addr 172.21.15.17:0/4258337833 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff611ddb640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f8003970 0x7ff60c15df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6115da640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1603a0 0x7ff60c0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6125dc640 1 -- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f8003970 msgr2=0x7ff60c15df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6125dc640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f8003970 0x7ff60c15df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6125dc640 1 -- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1603a0 msgr2=0x7ff60c0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6125dc640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1603a0 0x7ff60c0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6125dc640 1 -- 172.21.15.17:0/4258337833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0c4ee0 con 0x7ff60c15e470 2023-08-09T12:46:28.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff611ddb640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f8003970 0x7ff60c15df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:28.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.564+0000 7ff6115da640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1603a0 0x7ff60c0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:28.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.565+0000 7ff6125dc640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff60c15e470 0x7ff60c0c9a70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff60c06df20 tx=0x7ff60400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:28.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.565+0000 7ff6027fc640 1 -- 172.21.15.17:0/4258337833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604016420 con 0x7ff60c15e470 2023-08-09T12:46:28.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.565+0000 7ff6027fc640 1 -- 172.21.15.17:0/4258337833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff604016580 con 0x7ff60c15e470 2023-08-09T12:46:28.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.565+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c0c5400 con 0x7ff60c15e470 2023-08-09T12:46:28.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.565+0000 7ff6027fc640 1 -- 172.21.15.17:0/4258337833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6040168f0 con 0x7ff60c15e470 2023-08-09T12:46:28.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.565+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c0c5890 con 0x7ff60c15e470 2023-08-09T12:46:28.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.566+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c0c4780 con 0x7ff60c15e470 2023-08-09T12:46:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.567+0000 7ff6027fc640 1 -- 172.21.15.17:0/4258337833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff604016a50 con 0x7ff60c15e470 2023-08-09T12:46:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.568+0000 7ff6027fc640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5f006a050 0x7ff5f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.568+0000 7ff6027fc640 1 -- 172.21.15.17:0/4258337833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff604089350 con 0x7ff60c15e470 2023-08-09T12:46:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.569+0000 7ff611ddb640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5f006a050 0x7ff5f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.570+0000 7ff611ddb640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5f006a050 0x7ff5f006c510 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff608033000 tx=0x7ff608009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.572+0000 7ff6027fc640 1 -- 172.21.15.17:0/4258337833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff60c0c4780 con 0x7ff60c15e470 2023-08-09T12:46:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.764+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff60c0c4780 con 0x7ff60c15e470 2023-08-09T12:46:28.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.765+0000 7ff6027fc640 1 -- 172.21.15.17:0/4258337833 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff60c0c4780 con 0x7ff60c15e470 2023-08-09T12:46:28.768 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:46:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5f006a050 msgr2=0x7ff5f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5f006a050 0x7ff5f006c510 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff608033000 tx=0x7ff608009030 comp rx=0 tx=0).stop 2023-08-09T12:46:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff60c15e470 msgr2=0x7ff60c0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff60c15e470 0x7ff60c0c9a70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff60c06df20 tx=0x7ff60400f520 comp rx=0 tx=0).stop 2023-08-09T12:46:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 shutdown_connections 2023-08-09T12:46:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff5f006a050 0x7ff5f006c510 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff60c15e470 0x7ff60c0c9a70 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff60c1603a0 0x7ff60c0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 --2- 172.21.15.17:0/4258337833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f8003970 0x7ff60c15df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:28.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 >> 172.21.15.17:0/4258337833 conn(0x7ff60c06cf40 msgr2=0x7ff60c0ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:28.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.768+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 shutdown_connections 2023-08-09T12:46:28.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:28.769+0000 7ff61403f640 1 -- 172.21.15.17:0/4258337833 wait complete. 2023-08-09T12:46:28.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:46:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.016+0000 7f9a2f59e640 1 Processor -- start 2023-08-09T12:46:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.017+0000 7f9a2f59e640 1 -- start start 2023-08-09T12:46:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.018+0000 7f9a2f59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9a300caf00 0x7f9a300cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.018+0000 7f9a2f59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9a300c2240 0x7f9a300c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.018+0000 7f9a2f59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a300b34a0 con 0x7f9a301601f0 2023-08-09T12:46:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.018+0000 7f9a2f59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a300b4120 con 0x7f9a300c2240 2023-08-09T12:46:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.018+0000 7f9a2f59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a300cb8f0 con 0x7f9a300caf00 2023-08-09T12:46:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9a300c2240 0x7f9a300c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9a300c2240 0x7f9a300c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57692/0 (socket says 172.21.15.17:57692) 2023-08-09T12:46:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2ed9d640 1 -- 172.21.15.17:0/1341348171 learned_addr learned my addr 172.21.15.17:0/1341348171 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2dd9b640 1 --2- 172.21.15.17:0/1341348171 >> v2:172.21.15.142:3300/0 conn(0x7f9a300caf00 0x7f9a300cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2ed9d640 1 -- 172.21.15.17:0/1341348171 >> v2:172.21.15.142:3300/0 conn(0x7f9a300caf00 msgr2=0x7f9a300cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2ed9d640 1 --2- 172.21.15.17:0/1341348171 >> v2:172.21.15.142:3300/0 conn(0x7f9a300caf00 0x7f9a300cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2ed9d640 1 -- 172.21.15.17:0/1341348171 >> v1:172.21.15.17:6789/0 conn(0x7f9a301601f0 legacy=0x7f9a300b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2d59a640 1 -- 172.21.15.17:0/1341348171 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717986861 0 0) 0x7f9a300b34a0 con 0x7f9a301601f0 2023-08-09T12:46:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2ed9d640 1 -- 172.21.15.17:0/1341348171 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a300b3780 con 0x7f9a300c2240 2023-08-09T12:46:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.019+0000 7f9a2dd9b640 1 --2- 172.21.15.17:0/1341348171 >> v2:172.21.15.142:3300/0 conn(0x7f9a300caf00 0x7f9a300cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.020+0000 7f9a2ed9d640 1 --2- 172.21.15.17:0/1341348171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300c2240 0x7f9a300c2650 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9a300b12b0 tx=0x7f9a2802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d22306c4abbc77 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.021+0000 7f9a2d59a640 1 -- 172.21.15.17:0/1341348171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28030860 con 0x7f9a300c2240 2023-08-09T12:46:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.021+0000 7f9a2d59a640 1 -- 172.21.15.17:0/1341348171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280309c0 con 0x7f9a300c2240 2023-08-09T12:46:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.021+0000 7f9a2d59a640 1 -- 172.21.15.17:0/1341348171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28030d50 con 0x7f9a300c2240 2023-08-09T12:46:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.021+0000 7f9a2f59e640 1 -- 172.21.15.17:0/1341348171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300c2240 msgr2=0x7f9a300c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.021+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/1341348171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300c2240 0x7f9a300c2650 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9a300b12b0 tx=0x7f9a2802b9a0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.022+0000 7f9a2f59e640 1 -- 172.21.15.17:0/1341348171 shutdown_connections 2023-08-09T12:46:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.022+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/1341348171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300c2240 0x7f9a300c2650 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.022+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/1341348171 >> v2:172.21.15.142:3300/0 conn(0x7f9a300caf00 0x7f9a300cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.022+0000 7f9a2f59e640 1 -- 172.21.15.17:0/1341348171 >> 172.21.15.17:0/1341348171 conn(0x7f9a300b1d50 msgr2=0x7f9a3006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.022+0000 7f9a2f59e640 1 -- 172.21.15.17:0/1341348171 shutdown_connections 2023-08-09T12:46:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.022+0000 7f9a2f59e640 1 -- 172.21.15.17:0/1341348171 wait complete. 2023-08-09T12:46:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.023+0000 7f9a2f59e640 1 Processor -- start 2023-08-09T12:46:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.024+0000 7f9a2f59e640 1 -- start start 2023-08-09T12:46:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.024+0000 7f9a2f59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300c2240 0x7f9a301547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.024+0000 7f9a2f59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300caf00 0x7f9a3006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.024+0000 7f9a2f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a301601f0 0x7f9a3006f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2f59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a30071140 con 0x7f9a300caf00 2023-08-09T12:46:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2f59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a30071420 con 0x7f9a300c2240 2023-08-09T12:46:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a30071700 con 0x7f9a301601f0 2023-08-09T12:46:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300caf00 0x7f9a3006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300caf00 0x7f9a3006efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57704/0 (socket says 172.21.15.17:57704) 2023-08-09T12:46:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2dd9b640 1 -- 172.21.15.17:0/2737896772 learned_addr learned my addr 172.21.15.17:0/2737896772 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2dd9b640 1 -- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a301601f0 msgr2=0x7f9a3006f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2dd9b640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a301601f0 0x7f9a3006f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2dd9b640 1 -- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300c2240 msgr2=0x7f9a301547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2dd9b640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300c2240 0x7f9a301547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.025+0000 7f9a2dd9b640 1 -- 172.21.15.17:0/2737896772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280094d0 con 0x7f9a300caf00 2023-08-09T12:46:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.026+0000 7f9a2dd9b640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300caf00 0x7f9a3006efc0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c7f0 tx=0x7f9a1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.026+0000 7f9a26ffd640 1 -- 172.21.15.17:0/2737896772 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18007a30 con 0x7f9a300caf00 2023-08-09T12:46:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.026+0000 7f9a26ffd640 1 -- 172.21.15.17:0/2737896772 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a18007b90 con 0x7f9a300caf00 2023-08-09T12:46:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.026+0000 7f9a26ffd640 1 -- 172.21.15.17:0/2737896772 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800ce40 con 0x7f9a300caf00 2023-08-09T12:46:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.026+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a300719e0 con 0x7f9a300caf00 2023-08-09T12:46:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.026+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a300c7c40 con 0x7f9a300caf00 2023-08-09T12:46:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.027+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3004e390 con 0x7f9a300caf00 2023-08-09T12:46:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.028+0000 7f9a26ffd640 1 -- 172.21.15.17:0/2737896772 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a180113f0 con 0x7f9a300caf00 2023-08-09T12:46:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.029+0000 7f9a26ffd640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a1006a080 0x7f9a1006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.030+0000 7f9a26ffd640 1 -- 172.21.15.17:0/2737896772 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f9a180888f0 con 0x7f9a300caf00 2023-08-09T12:46:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.030+0000 7f9a2e59c640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a1006a080 0x7f9a1006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.031+0000 7f9a2e59c640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a1006a080 0x7f9a1006c540 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9a20001c60 tx=0x7f9a20007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:29.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.034+0000 7f9a26ffd640 1 -- 172.21.15.17:0/2737896772 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9a18053e30 con 0x7f9a300caf00 2023-08-09T12:46:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.242+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a300c5e50 con 0x7f9a300caf00 2023-08-09T12:46:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.243+0000 7f9a26ffd640 1 -- 172.21.15.17:0/2737896772 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9a1801f080 con 0x7f9a300caf00 2023-08-09T12:46:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:46:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a1006a080 msgr2=0x7f9a1006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a1006a080 0x7f9a1006c540 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9a20001c60 tx=0x7f9a20007cb0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300caf00 msgr2=0x7f9a3006efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300caf00 0x7f9a3006efc0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c7f0 tx=0x7f9a1800cbf0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 shutdown_connections 2023-08-09T12:46:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a1006a080 0x7f9a1006c540 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a301601f0 0x7f9a3006f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a300caf00 0x7f9a3006efc0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 --2- 172.21.15.17:0/2737896772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300c2240 0x7f9a301547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 >> 172.21.15.17:0/2737896772 conn(0x7f9a300b1d50 msgr2=0x7f9a300c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 shutdown_connections 2023-08-09T12:46:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.246+0000 7f9a2f59e640 1 -- 172.21.15.17:0/2737896772 wait complete. 2023-08-09T12:46:29.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:46:29.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:29.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:46:29.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:46:29.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:29.452 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:46:29.493 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:46:29.494 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:29.542 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:46:29.542 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:29.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.860+0000 7f6cdb70f640 1 Processor -- start 2023-08-09T12:46:29.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.860+0000 7f6cdb70f640 1 -- start start 2023-08-09T12:46:29.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.861+0000 7f6cdb70f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6cd4159d80 0x7f6cd40b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.861+0000 7f6cdb70f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6cd40ad810 0x7f6cd4070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cdb70f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd40b4630 con 0x7f6cd40708c0 2023-08-09T12:46:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cdb70f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd4070d50 con 0x7f6cd40ad810 2023-08-09T12:46:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cdb70f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd415a160 con 0x7f6cd4159d80 2023-08-09T12:46:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cd8caa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6cd40ad810 0x7f6cd4070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cd9cac640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6cd40708c0 0x7f6cd406eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48972/0 (socket says 172.21.15.17:48972) 2023-08-09T12:46:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cd9cac640 1 -- 172.21.15.17:0/2599009210 learned_addr learned my addr 172.21.15.17:0/2599009210 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cd8caa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6cd40ad810 0x7f6cd4070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57706/0 (socket says 172.21.15.17:57706) 2023-08-09T12:46:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cd94ab640 1 --2- 172.21.15.17:0/2599009210 >> v2:172.21.15.142:3300/0 conn(0x7f6cd4159d80 0x7f6cd40b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cd8caa640 1 -- 172.21.15.17:0/2599009210 >> v2:172.21.15.142:3300/0 conn(0x7f6cd4159d80 msgr2=0x7f6cd40b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:29.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cd8caa640 1 --2- 172.21.15.17:0/2599009210 >> v2:172.21.15.142:3300/0 conn(0x7f6cd4159d80 0x7f6cd40b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.862+0000 7f6cd8caa640 1 -- 172.21.15.17:0/2599009210 >> v1:172.21.15.17:6789/0 conn(0x7f6cd40708c0 legacy=0x7f6cd406eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.863+0000 7f6cd8caa640 1 -- 172.21.15.17:0/2599009210 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd40b3ab0 con 0x7f6cd40ad810 2023-08-09T12:46:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.863+0000 7f6ccbfff640 1 -- 172.21.15.17:0/2599009210 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413617029 0 0) 0x7f6cd40b4630 con 0x7f6cd40708c0 2023-08-09T12:46:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.864+0000 7f6cd8caa640 1 --2- 172.21.15.17:0/2599009210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd40ad810 0x7f6cd4070380 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40cb110 tx=0x7f6cc402e080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c486da33d2ea14 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.864+0000 7f6ccbfff640 1 -- 172.21.15.17:0/2599009210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc402ee30 con 0x7f6cd40ad810 2023-08-09T12:46:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.864+0000 7f6ccbfff640 1 -- 172.21.15.17:0/2599009210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc4036440 con 0x7f6cd40ad810 2023-08-09T12:46:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.864+0000 7f6ccbfff640 1 -- 172.21.15.17:0/2599009210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40367d0 con 0x7f6cd40ad810 2023-08-09T12:46:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.864+0000 7f6cdb70f640 1 -- 172.21.15.17:0/2599009210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd40ad810 msgr2=0x7f6cd4070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.864+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/2599009210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd40ad810 0x7f6cd4070380 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40cb110 tx=0x7f6cc402e080 comp rx=0 tx=0).stop 2023-08-09T12:46:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.865+0000 7f6cdb70f640 1 -- 172.21.15.17:0/2599009210 shutdown_connections 2023-08-09T12:46:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.865+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/2599009210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd40ad810 0x7f6cd4070380 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.865+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/2599009210 >> v2:172.21.15.142:3300/0 conn(0x7f6cd4159d80 0x7f6cd40b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.865+0000 7f6cdb70f640 1 -- 172.21.15.17:0/2599009210 >> 172.21.15.17:0/2599009210 conn(0x7f6cd40cb1b0 msgr2=0x7f6cd40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.865+0000 7f6cdb70f640 1 -- 172.21.15.17:0/2599009210 shutdown_connections 2023-08-09T12:46:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.865+0000 7f6cdb70f640 1 -- 172.21.15.17:0/2599009210 wait complete. 2023-08-09T12:46:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.866+0000 7f6cdb70f640 1 Processor -- start 2023-08-09T12:46:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.867+0000 7f6cdb70f640 1 -- start start 2023-08-09T12:46:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cdb70f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd40708c0 0x7f6cd4156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cdb70f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd40ad810 0x7f6cd40c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cdb70f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4159d80 0x7f6cd40c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cdb70f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd415bbf0 con 0x7f6cd4159d80 2023-08-09T12:46:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cdb70f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd415bed0 con 0x7f6cd40708c0 2023-08-09T12:46:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cdb70f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd415c1b0 con 0x7f6cd40ad810 2023-08-09T12:46:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd9cac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4159d80 0x7f6cd40c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd9cac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4159d80 0x7f6cd40c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57722/0 (socket says 172.21.15.17:57722) 2023-08-09T12:46:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd9cac640 1 -- 172.21.15.17:0/4244022205 learned_addr learned my addr 172.21.15.17:0/4244022205 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd8caa640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd40ad810 0x7f6cd40c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd94ab640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd40708c0 0x7f6cd4156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd9cac640 1 -- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd40ad810 msgr2=0x7f6cd40c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd9cac640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd40ad810 0x7f6cd40c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd9cac640 1 -- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd40708c0 msgr2=0x7f6cd4156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:29.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd9cac640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd40708c0 0x7f6cd4156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:29.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd9cac640 1 -- 172.21.15.17:0/4244022205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc400b640 con 0x7f6cd4159d80 2023-08-09T12:46:29.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.868+0000 7f6cd94ab640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd40708c0 0x7f6cd4156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:29.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.869+0000 7f6cd9cac640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4159d80 0x7f6cd40c2f90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc001eb0 tx=0x7f6ccc00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:29.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.869+0000 7f6cc9ffb640 1 -- 172.21.15.17:0/4244022205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0074e0 con 0x7f6cd4159d80 2023-08-09T12:46:29.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.869+0000 7f6cc9ffb640 1 -- 172.21.15.17:0/4244022205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc007640 con 0x7f6cd4159d80 2023-08-09T12:46:29.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.869+0000 7f6cc9ffb640 1 -- 172.21.15.17:0/4244022205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc004a00 con 0x7f6cd4159d80 2023-08-09T12:46:29.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.869+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd415c490 con 0x7f6cd4159d80 2023-08-09T12:46:29.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.869+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd40c4e10 con 0x7f6cd4159d80 2023-08-09T12:46:29.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.870+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd415c9b0 con 0x7f6cd4159d80 2023-08-09T12:46:29.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.871+0000 7f6cc9ffb640 1 -- 172.21.15.17:0/4244022205 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ccc004b60 con 0x7f6cd4159d80 2023-08-09T12:46:29.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.872+0000 7f6cc9ffb640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:29.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.872+0000 7f6cc9ffb640 1 -- 172.21.15.17:0/4244022205 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f6ccc0884e0 con 0x7f6cd4159d80 2023-08-09T12:46:29.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.873+0000 7f6cd94ab640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:29.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.874+0000 7f6cd94ab640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0007330 tx=0x7f6cd000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:29.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:29.877+0000 7f6cc9ffb640 1 -- 172.21.15.17:0/4244022205 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6cd415c9b0 con 0x7f6cd4159d80 2023-08-09T12:46:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.074+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cd415c9b0 con 0x7f6cd4159d80 2023-08-09T12:46:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.076+0000 7f6cc9ffb640 1 -- 172.21.15.17:0/4244022205 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f6cd415c9b0 con 0x7f6cd4159d80 2023-08-09T12:46:30.079 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:30.079 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":118,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:18.920294+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:45:41.039914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-09T12:45:41.697620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 msgr2=0x7f6cb806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0007330 tx=0x7f6cd000b040 comp rx=0 tx=0).stop 2023-08-09T12:46:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4159d80 msgr2=0x7f6cd40c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4159d80 0x7f6cd40c2f90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc001eb0 tx=0x7f6ccc00c870 comp rx=0 tx=0).stop 2023-08-09T12:46:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 shutdown_connections 2023-08-09T12:46:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6cb806a050 0x7f6cb806c510 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4159d80 0x7f6cd40c2f90 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cd40ad810 0x7f6cd40c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 --2- 172.21.15.17:0/4244022205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cd40708c0 0x7f6cd4156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.079+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 >> 172.21.15.17:0/4244022205 conn(0x7f6cd40cb1b0 msgr2=0x7f6cd40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.080+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 shutdown_connections 2023-08-09T12:46:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.080+0000 7f6cdb70f640 1 -- 172.21.15.17:0/4244022205 wait complete. 2023-08-09T12:46:30.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:45:41.039914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:45:41.697620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:46:30.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:46:30.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.343+0000 7fd851d66640 1 Processor -- start 2023-08-09T12:46:30.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.343+0000 7fd851d66640 1 -- start start 2023-08-09T12:46:30.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.345+0000 7fd851d66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c15ae60 0x7fd84c0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.345+0000 7fd851d66640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c0cd1e0 con 0x7fd84c15aa80 2023-08-09T12:46:30.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.345+0000 7fd851d66640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c0cf1f0 con 0x7fd84c0cbaf0 2023-08-09T12:46:30.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.345+0000 7fd851d66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0cf4d0 con 0x7fd84c15ae60 2023-08-09T12:46:30.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.345+0000 7fd850d64640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd84c15aa80 0x7fd84c0ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48974/0 (socket says 172.21.15.17:48974) 2023-08-09T12:46:30.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.345+0000 7fd850d64640 1 -- 172.21.15.17:0/365696298 learned_addr learned my addr 172.21.15.17:0/365696298 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:30.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.345+0000 7fd843fff640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c15ae60 0x7fd84c0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966251068 0 0) 0x7fd84c0cd1e0 con 0x7fd84c15aa80 2023-08-09T12:46:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd834003520 con 0x7fd84c15aa80 2023-08-09T12:46:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2457253486 0 0) 0x7fd834003520 con 0x7fd84c15aa80 2023-08-09T12:46:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c15ae60 msgr2=0x7fd84c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c15ae60 0x7fd84c0cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 >> v1:172.21.15.142:6789/0 conn(0x7fd84c0cbaf0 legacy=0x7fd84c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0cf7b0 con 0x7fd84c15aa80 2023-08-09T12:46:30.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fd848001b70 con 0x7fd84c15aa80 2023-08-09T12:46:30.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 >> v1:172.21.15.17:6789/0 conn(0x7fd84c15aa80 legacy=0x7fd84c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd834003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c15ae60 0x7fd8340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd834004d00 0x7fd834005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0cf4d0 con 0x7fd8340039a0 2023-08-09T12:46:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83400ba30 con 0x7fd834004d00 2023-08-09T12:46:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83400bbf0 con 0x7fd84c15ae60 2023-08-09T12:46:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.346+0000 7fd850d64640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd834003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.347+0000 7fd843fff640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c15ae60 0x7fd8340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.347+0000 7fd850d64640 1 -- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c15ae60 msgr2=0x7fd8340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:30.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.347+0000 7fd850d64640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c15ae60 0x7fd8340047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.347+0000 7fd850d64640 1 -- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd834004d00 msgr2=0x7fd834005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:30.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.347+0000 7fd851565640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd834004d00 0x7fd834005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.347+0000 7fd850d64640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd834004d00 0x7fd834005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.347+0000 7fd850d64640 1 -- 172.21.15.17:0/365696298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834003520 con 0x7fd8340039a0 2023-08-09T12:46:30.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.348+0000 7fd850d64640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd834003dc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd848002230 tx=0x7fd8340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b720665503bddc9a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:30.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848005b20 con 0x7fd8340039a0 2023-08-09T12:46:30.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd848005ca0 con 0x7fd8340039a0 2023-08-09T12:46:30.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd8437fe640 1 -- 172.21.15.17:0/365696298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8480072b0 con 0x7fd8340039a0 2023-08-09T12:46:30.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd851d66640 1 -- 172.21.15.17:0/365696298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 msgr2=0x7fd834003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd851d66640 1 --2- 172.21.15.17:0/365696298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd834003dc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd848002230 tx=0x7fd8340057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd851565640 1 -- 172.21.15.17:0/365696298 reap_dead start 2023-08-09T12:46:30.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd851d66640 1 -- 172.21.15.17:0/365696298 shutdown_connections 2023-08-09T12:46:30.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd851d66640 1 -- 172.21.15.17:0/365696298 >> 172.21.15.17:0/365696298 conn(0x7fd84c0b3750 msgr2=0x7fd84c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:30.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd851d66640 1 -- 172.21.15.17:0/365696298 shutdown_connections 2023-08-09T12:46:30.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.349+0000 7fd851d66640 1 -- 172.21.15.17:0/365696298 wait complete. 2023-08-09T12:46:30.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.351+0000 7fd851d66640 1 Processor -- start 2023-08-09T12:46:30.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.351+0000 7fd851d66640 1 -- start start 2023-08-09T12:46:30.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.352+0000 7fd851d66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd84c06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.352+0000 7fd851d66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c06cf20 0x7fd84c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.352+0000 7fd851d66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84c15c220 0x7fd84c1f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.352+0000 7fd851d66640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1f2860 con 0x7fd8340039a0 2023-08-09T12:46:30.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.352+0000 7fd851d66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c06d3a0 con 0x7fd84c15c220 2023-08-09T12:46:30.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.352+0000 7fd851d66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1f37f0 con 0x7fd84c06cf20 2023-08-09T12:46:30.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd850d64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd84c06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd850d64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd84c06c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57742/0 (socket says 172.21.15.17:57742) 2023-08-09T12:46:30.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd850d64640 1 -- 172.21.15.17:0/1212491272 learned_addr learned my addr 172.21.15.17:0/1212491272 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:30.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd851565640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84c15c220 0x7fd84c1f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd843fff640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c06cf20 0x7fd84c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd850d64640 1 -- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c06cf20 msgr2=0x7fd84c15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd850d64640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c06cf20 0x7fd84c15bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd850d64640 1 -- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84c15c220 msgr2=0x7fd84c1f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd850d64640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84c15c220 0x7fd84c1f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.353+0000 7fd850d64640 1 -- 172.21.15.17:0/1212491272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c15ca10 con 0x7fd8340039a0 2023-08-09T12:46:30.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.354+0000 7fd850d64640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd84c06c9e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd848002230 tx=0x7fd848001f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:30.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.354+0000 7fd8417fa640 1 -- 172.21.15.17:0/1212491272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848007480 con 0x7fd8340039a0 2023-08-09T12:46:30.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.354+0000 7fd8417fa640 1 -- 172.21.15.17:0/1212491272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8480075e0 con 0x7fd8340039a0 2023-08-09T12:46:30.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.354+0000 7fd8417fa640 1 -- 172.21.15.17:0/1212491272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848007970 con 0x7fd8340039a0 2023-08-09T12:46:30.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.354+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c1f2a50 con 0x7fd8340039a0 2023-08-09T12:46:30.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.354+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c1f2ff0 con 0x7fd8340039a0 2023-08-09T12:46:30.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.355+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c04e390 con 0x7fd8340039a0 2023-08-09T12:46:30.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.356+0000 7fd8417fa640 1 -- 172.21.15.17:0/1212491272 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd848032050 con 0x7fd8340039a0 2023-08-09T12:46:30.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.357+0000 7fd8417fa640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83806a080 0x7fd83806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.357+0000 7fd8417fa640 1 -- 172.21.15.17:0/1212491272 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fd8480a9d60 con 0x7fd8340039a0 2023-08-09T12:46:30.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.358+0000 7fd843fff640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83806a080 0x7fd83806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.359+0000 7fd843fff640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83806a080 0x7fd83806c540 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd84c15b550 tx=0x7fd83c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:30.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.361+0000 7fd8417fa640 1 -- 172.21.15.17:0/1212491272 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd848075330 con 0x7fd8340039a0 2023-08-09T12:46:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.553+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd84c0cac30 con 0x7fd8340039a0 2023-08-09T12:46:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.554+0000 7fd8417fa640 1 -- 172.21.15.17:0/1212491272 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd848046020 con 0x7fd8340039a0 2023-08-09T12:46:30.557 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:46:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.556+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83806a080 msgr2=0x7fd83806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.556+0000 7fd851d66640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83806a080 0x7fd83806c540 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd84c15b550 tx=0x7fd83c008040 comp rx=0 tx=0).stop 2023-08-09T12:46:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.556+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 msgr2=0x7fd84c06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.556+0000 7fd851d66640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd84c06c9e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd848002230 tx=0x7fd848001f00 comp rx=0 tx=0).stop 2023-08-09T12:46:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.557+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 shutdown_connections 2023-08-09T12:46:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.557+0000 7fd851d66640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83806a080 0x7fd83806c540 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.557+0000 7fd851d66640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84c15c220 0x7fd84c1f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.557+0000 7fd851d66640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84c06cf20 0x7fd84c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.557+0000 7fd851d66640 1 --2- 172.21.15.17:0/1212491272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8340039a0 0x7fd84c06c9e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.557+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 >> 172.21.15.17:0/1212491272 conn(0x7fd84c0b3750 msgr2=0x7fd84c0ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.557+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 shutdown_connections 2023-08-09T12:46:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.557+0000 7fd851d66640 1 -- 172.21.15.17:0/1212491272 wait complete. 2023-08-09T12:46:30.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:46:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.781+0000 7feecc7e1640 1 Processor -- start 2023-08-09T12:46:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.781+0000 7feecc7e1640 1 -- start start 2023-08-09T12:46:30.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feecc7e1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feec40b3b40 0x7feec40b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feecc7e1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40cc630 0x7feec40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feecc7e1640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec406c990 con 0x7feec40adc40 2023-08-09T12:46:30.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feecc7e1640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40ae020 con 0x7feec40b3b40 2023-08-09T12:46:30.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feecc7e1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b2250 con 0x7feec40cc630 2023-08-09T12:46:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feec9d7c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feec40b3b40 0x7feec40b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feec9d7c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feec40b3b40 0x7feec40b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57756/0 (socket says 172.21.15.17:57756) 2023-08-09T12:46:30.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feec9d7c640 1 -- 172.21.15.17:0/2811196616 learned_addr learned my addr 172.21.15.17:0/2811196616 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:30.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.783+0000 7feeca57d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7feec40adc40 0x7feec406c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48980/0 (socket says 172.21.15.17:48980) 2023-08-09T12:46:30.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.784+0000 7feecad7e640 1 --2- 172.21.15.17:0/2811196616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40cc630 0x7feec40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.784+0000 7feec9d7c640 1 -- 172.21.15.17:0/2811196616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40cc630 msgr2=0x7feec40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.784+0000 7feec9d7c640 1 --2- 172.21.15.17:0/2811196616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40cc630 0x7feec40ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.784+0000 7feec9d7c640 1 -- 172.21.15.17:0/2811196616 >> v1:172.21.15.17:6789/0 conn(0x7feec40adc40 legacy=0x7feec406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.784+0000 7feec9d7c640 1 -- 172.21.15.17:0/2811196616 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40b2530 con 0x7feec40b3b40 2023-08-09T12:46:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.784+0000 7feec957b640 1 -- 172.21.15.17:0/2811196616 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231676568 0 0) 0x7feec406c990 con 0x7feec40adc40 2023-08-09T12:46:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.784+0000 7feecad7e640 1 --2- 172.21.15.17:0/2811196616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40cc630 0x7feec40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:30.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.785+0000 7feec9d7c640 1 --2- 172.21.15.17:0/2811196616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40b3b40 0x7feec40b3fd0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009860 tx=0x7feeb402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7d5ae6abc0dbad server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:30.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.785+0000 7feec957b640 1 -- 172.21.15.17:0/2811196616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4030840 con 0x7feec40b3b40 2023-08-09T12:46:30.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.785+0000 7feec957b640 1 -- 172.21.15.17:0/2811196616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb40309a0 con 0x7feec40b3b40 2023-08-09T12:46:30.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.785+0000 7feec957b640 1 -- 172.21.15.17:0/2811196616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4030d30 con 0x7feec40b3b40 2023-08-09T12:46:30.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.786+0000 7feecc7e1640 1 -- 172.21.15.17:0/2811196616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40b3b40 msgr2=0x7feec40b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.786+0000 7feecc7e1640 1 --2- 172.21.15.17:0/2811196616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40b3b40 0x7feec40b3fd0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009860 tx=0x7feeb402b980 comp rx=0 tx=0).stop 2023-08-09T12:46:30.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.786+0000 7feecc7e1640 1 -- 172.21.15.17:0/2811196616 shutdown_connections 2023-08-09T12:46:30.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.786+0000 7feecc7e1640 1 --2- 172.21.15.17:0/2811196616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40cc630 0x7feec40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.786+0000 7feecc7e1640 1 --2- 172.21.15.17:0/2811196616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40b3b40 0x7feec40b3fd0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.786+0000 7feecc7e1640 1 -- 172.21.15.17:0/2811196616 >> 172.21.15.17:0/2811196616 conn(0x7feec40cb1b0 msgr2=0x7feec40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:30.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.786+0000 7feecc7e1640 1 -- 172.21.15.17:0/2811196616 shutdown_connections 2023-08-09T12:46:30.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.786+0000 7feecc7e1640 1 -- 172.21.15.17:0/2811196616 wait complete. 2023-08-09T12:46:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.788+0000 7feecc7e1640 1 Processor -- start 2023-08-09T12:46:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.788+0000 7feecc7e1640 1 -- start start 2023-08-09T12:46:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecc7e1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40adc40 0x7feec414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecc7e1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec40b3b40 0x7feec415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecc7e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40cc630 0x7feec415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecc7e1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec415b460 con 0x7feec40cc630 2023-08-09T12:46:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecc7e1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec41578f0 con 0x7feec40b3b40 2023-08-09T12:46:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecc7e1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40c4ad0 con 0x7feec40adc40 2023-08-09T12:46:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecad7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40cc630 0x7feec415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecad7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40cc630 0x7feec415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57766/0 (socket says 172.21.15.17:57766) 2023-08-09T12:46:30.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.789+0000 7feecad7e640 1 -- 172.21.15.17:0/1640346404 learned_addr learned my addr 172.21.15.17:0/1640346404 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:30.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feeca57d640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40adc40 0x7feec414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feec9d7c640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec40b3b40 0x7feec415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feecad7e640 1 -- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40adc40 msgr2=0x7feec414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feecad7e640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40adc40 0x7feec414fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feecad7e640 1 -- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec40b3b40 msgr2=0x7feec415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:30.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feecad7e640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec40b3b40 0x7feec415a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feecad7e640 1 -- 172.21.15.17:0/1640346404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4009470 con 0x7feec40cc630 2023-08-09T12:46:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feecad7e640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40cc630 0x7feec415a590 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7feebc00cd50 tx=0x7feebc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.790+0000 7feebaffd640 1 -- 172.21.15.17:0/1640346404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00f680 con 0x7feec40cc630 2023-08-09T12:46:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.791+0000 7feebaffd640 1 -- 172.21.15.17:0/1640346404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc00f800 con 0x7feec40cc630 2023-08-09T12:46:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.791+0000 7feebaffd640 1 -- 172.21.15.17:0/1640346404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00fbb0 con 0x7feec40cc630 2023-08-09T12:46:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.791+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec4150290 con 0x7feec40cc630 2023-08-09T12:46:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.791+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec415aea0 con 0x7feec40cc630 2023-08-09T12:46:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.792+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec4157630 con 0x7feec40cc630 2023-08-09T12:46:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.793+0000 7feebaffd640 1 -- 172.21.15.17:0/1640346404 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feebc00b040 con 0x7feec40cc630 2023-08-09T12:46:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.794+0000 7feebaffd640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feea806a050 0x7feea806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.794+0000 7feebaffd640 1 -- 172.21.15.17:0/1640346404 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7feebc089030 con 0x7feec40cc630 2023-08-09T12:46:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.795+0000 7feeca57d640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feea806a050 0x7feea806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.795+0000 7feeca57d640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feea806a050 0x7feea806c510 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7feec0000f60 tx=0x7feec0007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:30.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.798+0000 7feebaffd640 1 -- 172.21.15.17:0/1640346404 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feebc054730 con 0x7feec40cc630 2023-08-09T12:46:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.994+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feec4067a80 con 0x7feec40cc630 2023-08-09T12:46:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.994+0000 7feebaffd640 1 -- 172.21.15.17:0/1640346404 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7feebc01d020 con 0x7feec40cc630 2023-08-09T12:46:30.998 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:46:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feea806a050 msgr2=0x7feea806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feea806a050 0x7feea806c510 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7feec0000f60 tx=0x7feec0007b70 comp rx=0 tx=0).stop 2023-08-09T12:46:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40cc630 msgr2=0x7feec415a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40cc630 0x7feec415a590 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7feebc00cd50 tx=0x7feebc00a650 comp rx=0 tx=0).stop 2023-08-09T12:46:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 shutdown_connections 2023-08-09T12:46:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feea806a050 0x7feea806c510 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec40cc630 0x7feec415a590 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec40b3b40 0x7feec415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 --2- 172.21.15.17:0/1640346404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec40adc40 0x7feec414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 >> 172.21.15.17:0/1640346404 conn(0x7feec40cb1b0 msgr2=0x7feec40b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 shutdown_connections 2023-08-09T12:46:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:30.997+0000 7feecc7e1640 1 -- 172.21.15.17:0/1640346404 wait complete. 2023-08-09T12:46:31.020 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:46:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.249+0000 7f3b0651f640 1 Processor -- start 2023-08-09T12:46:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.249+0000 7f3b0651f640 1 -- start start 2023-08-09T12:46:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3b0651f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3b0015cef0 0x7f3b000b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3b0651f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 0x7f3b000ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3b0651f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3b001616b0 0x7f3b000cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3b0651f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000cdee0 con 0x7f3b0015cef0 2023-08-09T12:46:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3b0651f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000b2010 con 0x7f3b001616b0 2023-08-09T12:46:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3b0651f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000b1d30 con 0x7f3b0015d2d0 2023-08-09T12:46:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3afffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3b0015cef0 0x7f3b000b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3afffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3b0015cef0 0x7f3b000b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57778/0 (socket says 172.21.15.17:57778) 2023-08-09T12:46:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3afffff640 1 -- 172.21.15.17:0/1601116446 learned_addr learned my addr 172.21.15.17:0/1601116446 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3afffff640 1 -- 172.21.15.17:0/1601116446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 msgr2=0x7f3b000ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3afffff640 1 --2- 172.21.15.17:0/1601116446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 0x7f3b000ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3afffff640 1 -- 172.21.15.17:0/1601116446 >> v2:172.21.15.142:3300/0 conn(0x7f3b001616b0 msgr2=0x7f3b000cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.251+0000 7f3afffff640 1 --2- 172.21.15.17:0/1601116446 >> v2:172.21.15.142:3300/0 conn(0x7f3b001616b0 0x7f3b000cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.252+0000 7f3afffff640 1 -- 172.21.15.17:0/1601116446 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000cd820 con 0x7f3b0015cef0 2023-08-09T12:46:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.253+0000 7f3afffff640 1 --2- 172.21.15.17:0/1601116446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b0015cef0 0x7f3b000b1750 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3b000b2680 tx=0x7f3af002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af02b529797f5b34 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.253+0000 7f3aff7fe640 1 -- 172.21.15.17:0/1601116446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0031740 con 0x7f3b0015cef0 2023-08-09T12:46:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.253+0000 7f3aff7fe640 1 -- 172.21.15.17:0/1601116446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af00318a0 con 0x7f3b0015cef0 2023-08-09T12:46:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.253+0000 7f3aff7fe640 1 -- 172.21.15.17:0/1601116446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0031c30 con 0x7f3b0015cef0 2023-08-09T12:46:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 -- 172.21.15.17:0/1601116446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b0015cef0 msgr2=0x7f3b000b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 --2- 172.21.15.17:0/1601116446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b0015cef0 0x7f3b000b1750 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3b000b2680 tx=0x7f3af002b7e0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 -- 172.21.15.17:0/1601116446 shutdown_connections 2023-08-09T12:46:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 --2- 172.21.15.17:0/1601116446 >> v2:172.21.15.142:3300/0 conn(0x7f3b001616b0 0x7f3b000cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 --2- 172.21.15.17:0/1601116446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 0x7f3b000ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 --2- 172.21.15.17:0/1601116446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b0015cef0 0x7f3b000b1750 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 -- 172.21.15.17:0/1601116446 >> 172.21.15.17:0/1601116446 conn(0x7f3b0006fde0 msgr2=0x7f3b000701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 -- 172.21.15.17:0/1601116446 shutdown_connections 2023-08-09T12:46:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.254+0000 7f3b0651f640 1 -- 172.21.15.17:0/1601116446 wait complete. 2023-08-09T12:46:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.256+0000 7f3b0651f640 1 Processor -- start 2023-08-09T12:46:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.256+0000 7f3b0651f640 1 -- start start 2023-08-09T12:46:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b0651f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0015cef0 0x7f3b00157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b0651f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 0x7f3b0015e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b0651f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001616b0 0x7f3b0015e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b0651f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001f3a80 con 0x7f3b001616b0 2023-08-09T12:46:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b0651f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001f3cd0 con 0x7f3b0015cef0 2023-08-09T12:46:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b0651f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001f3fb0 con 0x7f3b0015d2d0 2023-08-09T12:46:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b04abc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001616b0 0x7f3b0015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b04abc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001616b0 0x7f3b0015e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57790/0 (socket says 172.21.15.17:57790) 2023-08-09T12:46:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.257+0000 7f3b04abc640 1 -- 172.21.15.17:0/539337567 learned_addr learned my addr 172.21.15.17:0/539337567 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.258+0000 7f3afffff640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0015cef0 0x7f3b00157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.258+0000 7f3af77fe640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 0x7f3b0015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.258+0000 7f3b04abc640 1 -- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 msgr2=0x7f3b0015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.258+0000 7f3b04abc640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 0x7f3b0015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.258+0000 7f3b04abc640 1 -- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0015cef0 msgr2=0x7f3b00157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.258+0000 7f3b04abc640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0015cef0 0x7f3b00157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.258+0000 7f3b04abc640 1 -- 172.21.15.17:0/539337567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00094d0 con 0x7f3b001616b0 2023-08-09T12:46:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.258+0000 7f3b04abc640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001616b0 0x7f3b0015e680 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f3af800b970 tx=0x7f3af800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.259+0000 7f3afd7fa640 1 -- 172.21.15.17:0/539337567 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800cb40 con 0x7f3b001616b0 2023-08-09T12:46:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.259+0000 7f3afd7fa640 1 -- 172.21.15.17:0/539337567 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800ccc0 con 0x7f3b001616b0 2023-08-09T12:46:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.259+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b001f4290 con 0x7f3b001616b0 2023-08-09T12:46:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.259+0000 7f3afd7fa640 1 -- 172.21.15.17:0/539337567 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8014680 con 0x7f3b001616b0 2023-08-09T12:46:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.259+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b00157790 con 0x7f3b001616b0 2023-08-09T12:46:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.260+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b001f47b0 con 0x7f3b001616b0 2023-08-09T12:46:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.261+0000 7f3afd7fa640 1 -- 172.21.15.17:0/539337567 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3af801d3b0 con 0x7f3b001616b0 2023-08-09T12:46:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.262+0000 7f3afd7fa640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3ae006a050 0x7f3ae006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.262+0000 7f3afd7fa640 1 -- 172.21.15.17:0/539337567 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f3af8088610 con 0x7f3b001616b0 2023-08-09T12:46:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.263+0000 7f3afffff640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3ae006a050 0x7f3ae006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.264+0000 7f3afffff640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3ae006a050 0x7f3ae006c510 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3af0035000 tx=0x7f3af0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.266+0000 7f3afd7fa640 1 -- 172.21.15.17:0/539337567 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3b001f47b0 con 0x7f3b001616b0 2023-08-09T12:46:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.459+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b001f47b0 con 0x7f3b001616b0 2023-08-09T12:46:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.460+0000 7f3afd7fa640 1 -- 172.21.15.17:0/539337567 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b001f47b0 con 0x7f3b001616b0 2023-08-09T12:46:31.464 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:46:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3ae006a050 msgr2=0x7f3ae006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3ae006a050 0x7f3ae006c510 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3af0035000 tx=0x7f3af0008030 comp rx=0 tx=0).stop 2023-08-09T12:46:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001616b0 msgr2=0x7f3b0015e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001616b0 0x7f3b0015e680 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f3af800b970 tx=0x7f3af800be30 comp rx=0 tx=0).stop 2023-08-09T12:46:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 shutdown_connections 2023-08-09T12:46:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3ae006a050 0x7f3ae006c510 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001616b0 0x7f3b0015e680 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b0015d2d0 0x7f3b0015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 --2- 172.21.15.17:0/539337567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b0015cef0 0x7f3b00157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 >> 172.21.15.17:0/539337567 conn(0x7f3b0006fde0 msgr2=0x7f3b0015aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 shutdown_connections 2023-08-09T12:46:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.463+0000 7f3b0651f640 1 -- 172.21.15.17:0/539337567 wait complete. 2023-08-09T12:46:31.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:46:31.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.709+0000 7fa81ffff640 1 Processor -- start 2023-08-09T12:46:31.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.709+0000 7fa81ffff640 1 -- start start 2023-08-09T12:46:31.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.710+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa82015caf0 0x7fa8200703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.710+0000 7fa81ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa8200708e0 0x7fa8200d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.710+0000 7fa81ffff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8200d0f00 con 0x7fa8200d2360 2023-08-09T12:46:31.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.710+0000 7fa81ffff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200d1a80 con 0x7fa8200708e0 2023-08-09T12:46:31.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.710+0000 7fa81ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200d2810 con 0x7fa82015caf0 2023-08-09T12:46:31.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa81f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa8200d2360 0x7fa8200697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48990/0 (socket says 172.21.15.17:48990) 2023-08-09T12:46:31.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa81f7fe640 1 -- 172.21.15.17:0/2509395723 learned_addr learned my addr 172.21.15.17:0/2509395723 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:31.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa8167fc640 1 --2- 172.21.15.17:0/2509395723 >> v2:172.21.15.17:3300/0 conn(0x7fa8200708e0 0x7fa8200d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa81effd640 1 --2- 172.21.15.17:0/2509395723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa82015caf0 0x7fa8200703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa81e7fc640 1 -- 172.21.15.17:0/2509395723 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910383176 0 0) 0x7fa8200d0f00 con 0x7fa8200d2360 2023-08-09T12:46:31.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa81e7fc640 1 -- 172.21.15.17:0/2509395723 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa80c003520 con 0x7fa8200d2360 2023-08-09T12:46:31.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa8167fc640 1 -- 172.21.15.17:0/2509395723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa82015caf0 msgr2=0x7fa8200703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:31.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa8167fc640 1 --2- 172.21.15.17:0/2509395723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa82015caf0 0x7fa8200703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa8167fc640 1 -- 172.21.15.17:0/2509395723 >> v1:172.21.15.17:6789/0 conn(0x7fa8200d2360 legacy=0x7fa8200697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa8167fc640 1 -- 172.21.15.17:0/2509395723 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200d11e0 con 0x7fa8200708e0 2023-08-09T12:46:31.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.711+0000 7fa81effd640 1 --2- 172.21.15.17:0/2509395723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa82015caf0 0x7fa8200703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:46:31.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.713+0000 7fa8167fc640 1 --2- 172.21.15.17:0/2509395723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200708e0 0x7fa8200d1e20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa80802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef22d691f41f4a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:31.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.713+0000 7fa81e7fc640 1 -- 172.21.15.17:0/2509395723 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808030800 con 0x7fa8200708e0 2023-08-09T12:46:31.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.713+0000 7fa81e7fc640 1 -- 172.21.15.17:0/2509395723 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808030960 con 0x7fa8200708e0 2023-08-09T12:46:31.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.713+0000 7fa81e7fc640 1 -- 172.21.15.17:0/2509395723 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808030cf0 con 0x7fa8200708e0 2023-08-09T12:46:31.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.714+0000 7fa81ffff640 1 -- 172.21.15.17:0/2509395723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200708e0 msgr2=0x7fa8200d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.714+0000 7fa81ffff640 1 --2- 172.21.15.17:0/2509395723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200708e0 0x7fa8200d1e20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa80802b940 comp rx=0 tx=0).stop 2023-08-09T12:46:31.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.714+0000 7fa81ffff640 1 -- 172.21.15.17:0/2509395723 shutdown_connections 2023-08-09T12:46:31.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.714+0000 7fa81ffff640 1 --2- 172.21.15.17:0/2509395723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200708e0 0x7fa8200d1e20 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.714+0000 7fa81ffff640 1 --2- 172.21.15.17:0/2509395723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa82015caf0 0x7fa8200703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.714+0000 7fa81ffff640 1 -- 172.21.15.17:0/2509395723 >> 172.21.15.17:0/2509395723 conn(0x7fa8200cf6b0 msgr2=0x7fa8200cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:31.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.714+0000 7fa81ffff640 1 -- 172.21.15.17:0/2509395723 shutdown_connections 2023-08-09T12:46:31.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.714+0000 7fa81ffff640 1 -- 172.21.15.17:0/2509395723 wait complete. 2023-08-09T12:46:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.716+0000 7fa81ffff640 1 Processor -- start 2023-08-09T12:46:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.716+0000 7fa81ffff640 1 -- start start 2023-08-09T12:46:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200d2360 0x7fa820153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa82015caf0 0x7fa820153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200c7ca0 0x7fa8200c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81ffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82015f900 con 0x7fa8200d2360 2023-08-09T12:46:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82015f3d0 con 0x7fa82015caf0 2023-08-09T12:46:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200c64a0 con 0x7fa8200c7ca0 2023-08-09T12:46:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200d2360 0x7fa820153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200d2360 0x7fa820153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57814/0 (socket says 172.21.15.17:57814) 2023-08-09T12:46:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81effd640 1 -- 172.21.15.17:0/3084946680 learned_addr learned my addr 172.21.15.17:0/3084946680 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81effd640 1 -- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200c7ca0 msgr2=0x7fa8200c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81effd640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200c7ca0 0x7fa8200c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81effd640 1 -- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa82015caf0 msgr2=0x7fa820153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81effd640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa82015caf0 0x7fa820153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.717+0000 7fa81effd640 1 -- 172.21.15.17:0/3084946680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808009400 con 0x7fa8200d2360 2023-08-09T12:46:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.718+0000 7fa81effd640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200d2360 0x7fa820153d00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa810007f20 tx=0x7fa81000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.718+0000 7fa817fff640 1 -- 172.21.15.17:0/3084946680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81000dee0 con 0x7fa8200d2360 2023-08-09T12:46:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.718+0000 7fa817fff640 1 -- 172.21.15.17:0/3084946680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81000f040 con 0x7fa8200d2360 2023-08-09T12:46:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.718+0000 7fa817fff640 1 -- 172.21.15.17:0/3084946680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810003dd0 con 0x7fa8200d2360 2023-08-09T12:46:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.718+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8200c6780 con 0x7fa8200d2360 2023-08-09T12:46:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.718+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82015f620 con 0x7fa8200d2360 2023-08-09T12:46:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.719+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82004e390 con 0x7fa8200d2360 2023-08-09T12:46:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.720+0000 7fa817fff640 1 -- 172.21.15.17:0/3084946680 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa810004030 con 0x7fa8200d2360 2023-08-09T12:46:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.722+0000 7fa817fff640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80006a050 0x7fa80006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.722+0000 7fa817fff640 1 -- 172.21.15.17:0/3084946680 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fa810088830 con 0x7fa8200d2360 2023-08-09T12:46:31.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.723+0000 7fa8167fc640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80006a050 0x7fa80006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.724+0000 7fa8167fc640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80006a050 0x7fa80006c510 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa808036000 tx=0x7fa80803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:31.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.727+0000 7fa817fff640 1 -- 172.21.15.17:0/3084946680 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa810053fe0 con 0x7fa8200d2360 2023-08-09T12:46:31.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.918+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8200b4280 con 0x7fa8200d2360 2023-08-09T12:46:31.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.919+0000 7fa817fff640 1 -- 172.21.15.17:0/3084946680 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa810057600 con 0x7fa8200d2360 2023-08-09T12:46:31.922 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:46:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.921+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80006a050 msgr2=0x7fa80006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.921+0000 7fa81ffff640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80006a050 0x7fa80006c510 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa808036000 tx=0x7fa80803b040 comp rx=0 tx=0).stop 2023-08-09T12:46:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.921+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200d2360 msgr2=0x7fa820153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.921+0000 7fa81ffff640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200d2360 0x7fa820153d00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa810007f20 tx=0x7fa81000d560 comp rx=0 tx=0).stop 2023-08-09T12:46:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.922+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 shutdown_connections 2023-08-09T12:46:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.922+0000 7fa81ffff640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa80006a050 0x7fa80006c510 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.922+0000 7fa81ffff640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8200c7ca0 0x7fa8200c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.922+0000 7fa81ffff640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa82015caf0 0x7fa820153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.922+0000 7fa81ffff640 1 --2- 172.21.15.17:0/3084946680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8200d2360 0x7fa820153d00 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.922+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 >> 172.21.15.17:0/3084946680 conn(0x7fa8200cf6b0 msgr2=0x7fa8200c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.922+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 shutdown_connections 2023-08-09T12:46:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:31.922+0000 7fa81ffff640 1 -- 172.21.15.17:0/3084946680 wait complete. 2023-08-09T12:46:31.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:46:32.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.161+0000 7f004b59e640 1 Processor -- start 2023-08-09T12:46:32.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.162+0000 7f004b59e640 1 -- start start 2023-08-09T12:46:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.163+0000 7f004b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f004c159bd0 0x7f004c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.163+0000 7f004b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 0x7f004c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.163+0000 7f004b59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004c06fe10 con 0x7f004c0697c0 2023-08-09T12:46:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.163+0000 7f004b59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004c0b11a0 con 0x7f004c159bd0 2023-08-09T12:46:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.163+0000 7f004b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c159fb0 con 0x7f004c0b3fe0 2023-08-09T12:46:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.164+0000 7f004ad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f004c0697c0 0x7f004c0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48992/0 (socket says 172.21.15.17:48992) 2023-08-09T12:46:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.164+0000 7f004ad9d640 1 -- 172.21.15.17:0/1195414746 learned_addr learned my addr 172.21.15.17:0/1195414746 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.164+0000 7f0043fff640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 0x7f004c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.164+0000 7f004a59c640 1 --2- 172.21.15.17:0/1195414746 >> v2:172.21.15.142:3300/0 conn(0x7f004c159bd0 0x7f004c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.164+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350281071 0 0) 0x7f004c06fe10 con 0x7f004c0697c0 2023-08-09T12:46:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.164+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0038003520 con 0x7f004c0697c0 2023-08-09T12:46:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3732776956 0 0) 0x7f0038003520 con 0x7f004c0697c0 2023-08-09T12:46:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 msgr2=0x7f004c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 0x7f004c070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 >> v2:172.21.15.142:3300/0 conn(0x7f004c159bd0 msgr2=0x7f004c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 --2- 172.21.15.17:0/1195414746 >> v2:172.21.15.142:3300/0 conn(0x7f004c159bd0 0x7f004c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c070970 con 0x7f004c0697c0 2023-08-09T12:46:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f00440019f0 con 0x7f004c0697c0 2023-08-09T12:46:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 >> v1:172.21.15.17:6789/0 conn(0x7f004c0697c0 legacy=0x7f004c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f0038003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 0x7f00380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0038004d00 0x7f0038005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0b11a0 con 0x7f0038003970 2023-08-09T12:46:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c159fb0 con 0x7f0038004d00 2023-08-09T12:46:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003800b980 con 0x7f004c0b3fe0 2023-08-09T12:46:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f004a59c640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f0038003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f004ad9d640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0038004d00 0x7f0038005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.165+0000 7f0043fff640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 0x7f00380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.166+0000 7f004a59c640 1 -- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 msgr2=0x7f00380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.166+0000 7f004a59c640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 0x7f00380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.166+0000 7f004a59c640 1 -- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0038004d00 msgr2=0x7f0038005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:32.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.166+0000 7f004a59c640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0038004d00 0x7f0038005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.166+0000 7f004a59c640 1 -- 172.21.15.17:0/1195414746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038003520 con 0x7f0038003970 2023-08-09T12:46:32.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.166+0000 7f0043fff640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c0b3fe0 0x7f00380047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:32.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.167+0000 7f004a59c640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f0038003d90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f003c009ac0 tx=0x7f00380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ab9004624bb1cc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:32.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.167+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c02c710 con 0x7f0038003970 2023-08-09T12:46:32.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.167+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c02c870 con 0x7f0038003970 2023-08-09T12:46:32.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.167+0000 7f0049d9b640 1 -- 172.21.15.17:0/1195414746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c02cc00 con 0x7f0038003970 2023-08-09T12:46:32.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.168+0000 7f004b59e640 1 -- 172.21.15.17:0/1195414746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 msgr2=0x7f0038003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.168+0000 7f004b59e640 1 --2- 172.21.15.17:0/1195414746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f0038003d90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f003c009ac0 tx=0x7f00380057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.168+0000 7f004ad9d640 1 -- 172.21.15.17:0/1195414746 reap_dead start 2023-08-09T12:46:32.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.168+0000 7f004b59e640 1 -- 172.21.15.17:0/1195414746 shutdown_connections 2023-08-09T12:46:32.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.168+0000 7f004b59e640 1 -- 172.21.15.17:0/1195414746 >> 172.21.15.17:0/1195414746 conn(0x7f004c0b1d50 msgr2=0x7f004c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:32.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.168+0000 7f004b59e640 1 -- 172.21.15.17:0/1195414746 shutdown_connections 2023-08-09T12:46:32.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.168+0000 7f004b59e640 1 -- 172.21.15.17:0/1195414746 wait complete. 2023-08-09T12:46:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.170+0000 7f004b59e640 1 Processor -- start 2023-08-09T12:46:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.170+0000 7f004b59e640 1 -- start start 2023-08-09T12:46:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f004c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c150160 0x7f004c0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004c0c61a0 0x7f004c0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0c6b60 con 0x7f0038003970 2023-08-09T12:46:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c150f20 con 0x7f004c0c61a0 2023-08-09T12:46:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c15b5e0 con 0x7f004c150160 2023-08-09T12:46:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f004c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f004c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57824/0 (socket says 172.21.15.17:57824) 2023-08-09T12:46:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.171+0000 7f004a59c640 1 -- 172.21.15.17:0/1614844538 learned_addr learned my addr 172.21.15.17:0/1614844538 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.172+0000 7f0043fff640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c150160 0x7f004c0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.172+0000 7f004a59c640 1 -- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c150160 msgr2=0x7f004c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.172+0000 7f004a59c640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c150160 0x7f004c0c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.172+0000 7f004a59c640 1 -- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004c0c61a0 msgr2=0x7f004c0c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.172+0000 7f004a59c640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004c0c61a0 0x7f004c0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.172+0000 7f004a59c640 1 -- 172.21.15.17:0/1614844538 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0c87d0 con 0x7f0038003970 2023-08-09T12:46:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.172+0000 7f0043fff640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c150160 0x7f004c0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.172+0000 7f004a59c640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f004c0c57c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f003c02c2b0 tx=0x7f003c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.173+0000 7f0042ffd640 1 -- 172.21.15.17:0/1614844538 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c003810 con 0x7f0038003970 2023-08-09T12:46:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.173+0000 7f0042ffd640 1 -- 172.21.15.17:0/1614844538 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c02de90 con 0x7f0038003970 2023-08-09T12:46:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.173+0000 7f0042ffd640 1 -- 172.21.15.17:0/1614844538 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c003bb0 con 0x7f0038003970 2023-08-09T12:46:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.173+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c0c84f0 con 0x7f0038003970 2023-08-09T12:46:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.173+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c0c8110 con 0x7f0038003970 2023-08-09T12:46:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.174+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c04e390 con 0x7f0038003970 2023-08-09T12:46:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.175+0000 7f0042ffd640 1 -- 172.21.15.17:0/1614844538 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f003c003d10 con 0x7f0038003970 2023-08-09T12:46:32.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.176+0000 7f0042ffd640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f002c06a050 0x7f002c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.177+0000 7f0042ffd640 1 -- 172.21.15.17:0/1614844538 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f003c0aa5e0 con 0x7f0038003970 2023-08-09T12:46:32.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.177+0000 7f0043fff640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f002c06a050 0x7f002c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.178+0000 7f0043fff640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f002c06a050 0x7f002c06c510 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f004c1f9ca0 tx=0x7f0034008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:32.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.181+0000 7f0042ffd640 1 -- 172.21.15.17:0/1614844538 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f003c075bb0 con 0x7f0038003970 2023-08-09T12:46:32.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.386+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f004c151140 con 0x7f0038003970 2023-08-09T12:46:32.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.387+0000 7f0042ffd640 1 -- 172.21.15.17:0/1614844538 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) v1 ==== 80+0+0 (secure 0 0 0) 0x7f003c0791d0 con 0x7f0038003970 2023-08-09T12:46:32.390 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:46:32.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f002c06a050 msgr2=0x7f002c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f002c06a050 0x7f002c06c510 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f004c1f9ca0 tx=0x7f0034008040 comp rx=0 tx=0).stop 2023-08-09T12:46:32.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 msgr2=0x7f004c0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f004c0c57c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f003c02c2b0 tx=0x7f003c004730 comp rx=0 tx=0).stop 2023-08-09T12:46:32.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 shutdown_connections 2023-08-09T12:46:32.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f002c06a050 0x7f002c06c510 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004c0c61a0 0x7f004c0c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004c150160 0x7f004c0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 --2- 172.21.15.17:0/1614844538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0038003970 0x7f004c0c57c0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 >> 172.21.15.17:0/1614844538 conn(0x7f004c0b1d50 msgr2=0x7f004c154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:32.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 shutdown_connections 2023-08-09T12:46:32.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.390+0000 7f004b59e640 1 -- 172.21.15.17:0/1614844538 wait complete. 2023-08-09T12:46:32.413 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:46:32.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:32.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:46:32.539 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:46:32.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:46:32.540 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:46:32.591 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:32.592 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:32.658 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:46:32.658 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:46:32.659 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:32.717 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:46:32.717 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:46:32.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.959+0000 7f2d4e0c5640 1 Processor -- start 2023-08-09T12:46:32.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.959+0000 7f2d4e0c5640 1 -- start start 2023-08-09T12:46:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.960+0000 7f2d4e0c5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2d48159b00 0x7f2d480b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.960+0000 7f2d4e0c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 0x7f2d4815a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.961+0000 7f2d4e0c5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4815aed0 con 0x7f2d4815a6b0 2023-08-09T12:46:32.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.961+0000 7f2d4e0c5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d480b0ba0 con 0x7f2d48159b00 2023-08-09T12:46:32.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.961+0000 7f2d4e0c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4815e3c0 con 0x7f2d480b0710 2023-08-09T12:46:32.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.961+0000 7f2d47fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2d4815a6b0 0x7f2d480cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48996/0 (socket says 172.21.15.17:48996) 2023-08-09T12:46:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.961+0000 7f2d47fff640 1 -- 172.21.15.17:0/2605889671 learned_addr learned my addr 172.21.15.17:0/2605889671 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.961+0000 7f2d477fe640 1 --2- 172.21.15.17:0/2605889671 >> v2:172.21.15.142:3300/0 conn(0x7f2d48159b00 0x7f2d480b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.961+0000 7f2d3ffff640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 0x7f2d4815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.961+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592948789 0 0) 0x7f2d4815aed0 con 0x7f2d4815a6b0 2023-08-09T12:46:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d34005730 con 0x7f2d4815a6b0 2023-08-09T12:46:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3585018181 0 0) 0x7f2d34005730 con 0x7f2d4815a6b0 2023-08-09T12:46:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 msgr2=0x7f2d4815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 0x7f2d4815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 >> v2:172.21.15.142:3300/0 conn(0x7f2d48159b00 msgr2=0x7f2d480b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 --2- 172.21.15.17:0/2605889671 >> v2:172.21.15.142:3300/0 conn(0x7f2d48159b00 0x7f2d480b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4815d600 con 0x7f2d4815a6b0 2023-08-09T12:46:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f2d400019f0 con 0x7f2d4815a6b0 2023-08-09T12:46:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 >> v1:172.21.15.17:6789/0 conn(0x7f2d4815a6b0 legacy=0x7f2d480cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d34005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d340069d0 0x7f2d34006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 0x7f2d34007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480b0ba0 con 0x7f2d34005b80 2023-08-09T12:46:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4815e3c0 con 0x7f2d340069d0 2023-08-09T12:46:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3400dc10 con 0x7f2d480b0710 2023-08-09T12:46:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.962+0000 7f2d477fe640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d34005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.963+0000 7f2d477fe640 1 -- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 msgr2=0x7f2d34007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.963+0000 7f2d47fff640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 0x7f2d34007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.963+0000 7f2d477fe640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 0x7f2d34007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.963+0000 7f2d477fe640 1 -- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d340069d0 msgr2=0x7f2d34006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.963+0000 7f2d477fe640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d340069d0 0x7f2d34006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.963+0000 7f2d477fe640 1 -- 172.21.15.17:0/2605889671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34005730 con 0x7f2d34005b80 2023-08-09T12:46:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.963+0000 7f2d47fff640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480b0710 0x7f2d34007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.964+0000 7f2d477fe640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d34005fa0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009ac0 tx=0x7f2d34007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8b95d82409e7a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.964+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3802c710 con 0x7f2d34005b80 2023-08-09T12:46:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.964+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3802c870 con 0x7f2d34005b80 2023-08-09T12:46:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.964+0000 7f2d46ffd640 1 -- 172.21.15.17:0/2605889671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3802cc00 con 0x7f2d34005b80 2023-08-09T12:46:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.965+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/2605889671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 msgr2=0x7f2d34005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.965+0000 7f2d4e0c5640 1 --2- 172.21.15.17:0/2605889671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d34005fa0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009ac0 tx=0x7f2d34007a00 comp rx=0 tx=0).stop 2023-08-09T12:46:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.965+0000 7f2d47fff640 1 -- 172.21.15.17:0/2605889671 reap_dead start 2023-08-09T12:46:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.965+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/2605889671 shutdown_connections 2023-08-09T12:46:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.965+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/2605889671 >> 172.21.15.17:0/2605889671 conn(0x7f2d480cb1d0 msgr2=0x7f2d480cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.965+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/2605889671 shutdown_connections 2023-08-09T12:46:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.965+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/2605889671 wait complete. 2023-08-09T12:46:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.967+0000 7f2d4e0c5640 1 Processor -- start 2023-08-09T12:46:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.967+0000 7f2d4e0c5640 1 -- start start 2023-08-09T12:46:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.968+0000 7f2d4e0c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d481464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.968+0000 7f2d4e0c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480cd3d0 0x7f2d480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.968+0000 7f2d4e0c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d480acdf0 0x7f2d480cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.968+0000 7f2d4e0c5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480ad270 con 0x7f2d34005b80 2023-08-09T12:46:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.968+0000 7f2d4e0c5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d48146a30 con 0x7f2d480acdf0 2023-08-09T12:46:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.968+0000 7f2d4e0c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480c3ce0 con 0x7f2d480cd3d0 2023-08-09T12:46:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d481464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d481464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57846/0 (socket says 172.21.15.17:57846) 2023-08-09T12:46:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 -- 172.21.15.17:0/271837731 learned_addr learned my addr 172.21.15.17:0/271837731 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d3ffff640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480cd3d0 0x7f2d480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 -- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480cd3d0 msgr2=0x7f2d480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480cd3d0 0x7f2d480ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 -- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d480acdf0 msgr2=0x7f2d480cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d480acdf0 0x7f2d480cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 -- 172.21.15.17:0/271837731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d480c3f80 con 0x7f2d34005b80 2023-08-09T12:46:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.969+0000 7f2d477fe640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d481464f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2d3802c2b0 tx=0x7f2d38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.970+0000 7f2d44ff9640 1 -- 172.21.15.17:0/271837731 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38003810 con 0x7f2d34005b80 2023-08-09T12:46:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.970+0000 7f2d44ff9640 1 -- 172.21.15.17:0/271837731 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38003970 con 0x7f2d34005b80 2023-08-09T12:46:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.970+0000 7f2d44ff9640 1 -- 172.21.15.17:0/271837731 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38003d00 con 0x7f2d34005b80 2023-08-09T12:46:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.970+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d480c4260 con 0x7f2d34005b80 2023-08-09T12:46:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.970+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d480c4820 con 0x7f2d34005b80 2023-08-09T12:46:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.971+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d480ad210 con 0x7f2d34005b80 2023-08-09T12:46:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.972+0000 7f2d44ff9640 1 -- 172.21.15.17:0/271837731 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2d38034440 con 0x7f2d34005b80 2023-08-09T12:46:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.973+0000 7f2d44ff9640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2806a050 0x7f2d2806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.973+0000 7f2d44ff9640 1 -- 172.21.15.17:0/271837731 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f2d380aa570 con 0x7f2d34005b80 2023-08-09T12:46:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.974+0000 7f2d3ffff640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2806a050 0x7f2d2806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.975+0000 7f2d3ffff640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2806a050 0x7f2d2806c510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2d48070120 tx=0x7f2d30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:32.977+0000 7f2d44ff9640 1 -- 172.21.15.17:0/271837731 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2d480ad210 con 0x7f2d34005b80 2023-08-09T12:46:33.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.213+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d4815dba0 con 0x7f2d34005b80 2023-08-09T12:46:33.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.215+0000 7f2d44ff9640 1 -- 172.21.15.17:0/271837731 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f2d4815dba0 con 0x7f2d34005b80 2023-08-09T12:46:33.218 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:33.218 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:46:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:46:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.217+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2806a050 msgr2=0x7f2d2806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2806a050 0x7f2d2806c510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2d48070120 tx=0x7f2d30008040 comp rx=0 tx=0).stop 2023-08-09T12:46:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 msgr2=0x7f2d481464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d481464f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2d3802c2b0 tx=0x7f2d38004730 comp rx=0 tx=0).stop 2023-08-09T12:46:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 shutdown_connections 2023-08-09T12:46:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2806a050 0x7f2d2806c510 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d480acdf0 0x7f2d480cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d480cd3d0 0x7f2d480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 --2- 172.21.15.17:0/271837731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34005b80 0x7f2d481464f0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 >> 172.21.15.17:0/271837731 conn(0x7f2d480cb1d0 msgr2=0x7f2d48156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 shutdown_connections 2023-08-09T12:46:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.218+0000 7f2d4e0c5640 1 -- 172.21.15.17:0/271837731 wait complete. 2023-08-09T12:46:33.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:33.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.469+0000 7f9a2759e640 1 Processor -- start 2023-08-09T12:46:33.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.470+0000 7f9a2759e640 1 -- start start 2023-08-09T12:46:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.471+0000 7f9a2759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9a28070f00 0x7f9a2815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.471+0000 7f9a2759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9a2815bce0 0x7f9a280cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.471+0000 7f9a2759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a28071340 con 0x7f9a281587e0 2023-08-09T12:46:33.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.471+0000 7f9a2759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280715c0 con 0x7f9a28070f00 2023-08-09T12:46:33.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.471+0000 7f9a2759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280718a0 con 0x7f9a2815bce0 2023-08-09T12:46:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.472+0000 7f9a1dd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9a28070f00 0x7f9a2815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.472+0000 7f9a2659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9a281587e0 0x7f9a280b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49006/0 (socket says 172.21.15.17:49006) 2023-08-09T12:46:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.472+0000 7f9a1dd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9a28070f00 0x7f9a2815b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57858/0 (socket says 172.21.15.17:57858) 2023-08-09T12:46:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.472+0000 7f9a2659c640 1 -- 172.21.15.17:0/766405736 learned_addr learned my addr 172.21.15.17:0/766405736 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.472+0000 7f9a26d9d640 1 --2- 172.21.15.17:0/766405736 >> v2:172.21.15.142:3300/0 conn(0x7f9a2815bce0 0x7f9a280cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.473+0000 7f9a1dd9b640 1 -- 172.21.15.17:0/766405736 >> v2:172.21.15.142:3300/0 conn(0x7f9a2815bce0 msgr2=0x7f9a280cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.473+0000 7f9a1dd9b640 1 --2- 172.21.15.17:0/766405736 >> v2:172.21.15.142:3300/0 conn(0x7f9a2815bce0 0x7f9a280cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.473+0000 7f9a1dd9b640 1 -- 172.21.15.17:0/766405736 >> v1:172.21.15.17:6789/0 conn(0x7f9a281587e0 legacy=0x7f9a280b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.473+0000 7f9a1dd9b640 1 -- 172.21.15.17:0/766405736 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28071b80 con 0x7f9a28070f00 2023-08-09T12:46:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.474+0000 7f9a1dd9b640 1 --2- 172.21.15.17:0/766405736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a2815b7a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f9a280b4290 tx=0x7f9a1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee62681443b81870 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.474+0000 7f9a25d9b640 1 -- 172.21.15.17:0/766405736 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10031830 con 0x7f9a28070f00 2023-08-09T12:46:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.474+0000 7f9a25d9b640 1 -- 172.21.15.17:0/766405736 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10031990 con 0x7f9a28070f00 2023-08-09T12:46:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.474+0000 7f9a25d9b640 1 -- 172.21.15.17:0/766405736 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10031d20 con 0x7f9a28070f00 2023-08-09T12:46:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.475+0000 7f9a2759e640 1 -- 172.21.15.17:0/766405736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 msgr2=0x7f9a2815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.475+0000 7f9a2759e640 1 --2- 172.21.15.17:0/766405736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a2815b7a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f9a280b4290 tx=0x7f9a1002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.475+0000 7f9a2759e640 1 -- 172.21.15.17:0/766405736 shutdown_connections 2023-08-09T12:46:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.475+0000 7f9a2759e640 1 --2- 172.21.15.17:0/766405736 >> v2:172.21.15.142:3300/0 conn(0x7f9a2815bce0 0x7f9a280cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.475+0000 7f9a2759e640 1 --2- 172.21.15.17:0/766405736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a2815b7a0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.475+0000 7f9a2759e640 1 -- 172.21.15.17:0/766405736 >> 172.21.15.17:0/766405736 conn(0x7f9a280b1d50 msgr2=0x7f9a2806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.475+0000 7f9a2759e640 1 -- 172.21.15.17:0/766405736 shutdown_connections 2023-08-09T12:46:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.475+0000 7f9a2759e640 1 -- 172.21.15.17:0/766405736 wait complete. 2023-08-09T12:46:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.477+0000 7f9a2759e640 1 Processor -- start 2023-08-09T12:46:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.477+0000 7f9a2759e640 1 -- start start 2023-08-09T12:46:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.478+0000 7f9a2759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a280c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a281587e0 0x7f9a280ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280afd00 0x7f9a281f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280ca190 con 0x7f9a28070f00 2023-08-09T12:46:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280c5170 con 0x7f9a281587e0 2023-08-09T12:46:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280c97f0 con 0x7f9a280afd00 2023-08-09T12:46:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a280c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a280c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57874/0 (socket says 172.21.15.17:57874) 2023-08-09T12:46:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2659c640 1 -- 172.21.15.17:0/1607008721 learned_addr learned my addr 172.21.15.17:0/1607008721 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2659c640 1 -- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280afd00 msgr2=0x7f9a281f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2659c640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280afd00 0x7f9a281f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2659c640 1 -- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a281587e0 msgr2=0x7f9a280ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a1dd9b640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a281587e0 0x7f9a280ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2659c640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a281587e0 0x7f9a280ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a2659c640 1 -- 172.21.15.17:0/1607008721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009400 con 0x7f9a28070f00 2023-08-09T12:46:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.479+0000 7f9a1dd9b640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a281587e0 0x7f9a280ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.480+0000 7f9a2659c640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a280c7fd0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800cba0 tx=0x7f9a1800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.480+0000 7f9a1f7fe640 1 -- 172.21.15.17:0/1607008721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800ad40 con 0x7f9a28070f00 2023-08-09T12:46:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.480+0000 7f9a1f7fe640 1 -- 172.21.15.17:0/1607008721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a18012400 con 0x7f9a28070f00 2023-08-09T12:46:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.480+0000 7f9a1f7fe640 1 -- 172.21.15.17:0/1607008721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800aea0 con 0x7f9a28070f00 2023-08-09T12:46:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.480+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a280c9ad0 con 0x7f9a28070f00 2023-08-09T12:46:33.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.480+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a280c8510 con 0x7f9a28070f00 2023-08-09T12:46:33.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.481+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2806fa10 con 0x7f9a28070f00 2023-08-09T12:46:33.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.482+0000 7f9a1f7fe640 1 -- 172.21.15.17:0/1607008721 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a18007070 con 0x7f9a28070f00 2023-08-09T12:46:33.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.483+0000 7f9a1f7fe640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0806a050 0x7f9a0806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.483+0000 7f9a1f7fe640 1 -- 172.21.15.17:0/1607008721 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f9a180885c0 con 0x7f9a28070f00 2023-08-09T12:46:33.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.484+0000 7f9a1dd9b640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0806a050 0x7f9a0806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.485+0000 7f9a1dd9b640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0806a050 0x7f9a0806c510 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9a10036000 tx=0x7f9a1003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:33.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.488+0000 7f9a1f7fe640 1 -- 172.21.15.17:0/1607008721 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9a2806fa10 con 0x7f9a28070f00 2023-08-09T12:46:33.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.679+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a2806fa10 con 0x7f9a28070f00 2023-08-09T12:46:33.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.683+0000 7f9a1f7fe640 1 -- 172.21.15.17:0/1607008721 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f9a2806fa10 con 0x7f9a28070f00 2023-08-09T12:46:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:33.687 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":118,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:18.920294+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:45:41.039914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-09T12:45:41.697620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.685+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0806a050 msgr2=0x7f9a0806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.685+0000 7f9a2759e640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0806a050 0x7f9a0806c510 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9a10036000 tx=0x7f9a1003c040 comp rx=0 tx=0).stop 2023-08-09T12:46:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.685+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 msgr2=0x7f9a280c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.685+0000 7f9a2759e640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a280c7fd0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800cba0 tx=0x7f9a1800a430 comp rx=0 tx=0).stop 2023-08-09T12:46:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.685+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 shutdown_connections 2023-08-09T12:46:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.686+0000 7f9a2759e640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0806a050 0x7f9a0806c510 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.686+0000 7f9a2759e640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280afd00 0x7f9a281f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.686+0000 7f9a2759e640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a281587e0 0x7f9a280ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.686+0000 7f9a2759e640 1 --2- 172.21.15.17:0/1607008721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28070f00 0x7f9a280c7fd0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.686+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 >> 172.21.15.17:0/1607008721 conn(0x7f9a280b1d50 msgr2=0x7f9a280b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.686+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 shutdown_connections 2023-08-09T12:46:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.686+0000 7f9a2759e640 1 -- 172.21.15.17:0/1607008721 wait complete. 2023-08-09T12:46:33.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:45:41.039914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:45:41.697620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:46:33.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:46:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.947+0000 7fd856186640 1 Processor -- start 2023-08-09T12:46:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.947+0000 7fd856186640 1 -- start start 2023-08-09T12:46:33.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.948+0000 7fd856186640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8500b5150 0x7fd850069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.948+0000 7fd856186640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd850069e70 0x7fd85015b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.948+0000 7fd856186640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85006cf30 con 0x7fd850144370 2023-08-09T12:46:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.948+0000 7fd856186640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd850144750 con 0x7fd8500b5150 2023-08-09T12:46:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.948+0000 7fd856186640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85006a2e0 con 0x7fd850069e70 2023-08-09T12:46:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.949+0000 7fd854983640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8500b5150 0x7fd850069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.949+0000 7fd854983640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8500b5150 0x7fd850069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57880/0 (socket says 172.21.15.17:57880) 2023-08-09T12:46:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.949+0000 7fd854983640 1 -- 172.21.15.17:0/211048991 learned_addr learned my addr 172.21.15.17:0/211048991 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.949+0000 7fd855985640 1 --2- 172.21.15.17:0/211048991 >> v2:172.21.15.142:3300/0 conn(0x7fd850069e70 0x7fd85015b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.949+0000 7fd854983640 1 -- 172.21.15.17:0/211048991 >> v2:172.21.15.142:3300/0 conn(0x7fd850069e70 msgr2=0x7fd85015b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.949+0000 7fd854983640 1 --2- 172.21.15.17:0/211048991 >> v2:172.21.15.142:3300/0 conn(0x7fd850069e70 0x7fd85015b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.949+0000 7fd854983640 1 -- 172.21.15.17:0/211048991 >> v1:172.21.15.142:6789/0 conn(0x7fd850144370 legacy=0x7fd8500b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.949+0000 7fd854983640 1 -- 172.21.15.17:0/211048991 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85006c320 con 0x7fd8500b5150 2023-08-09T12:46:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.951+0000 7fd854983640 1 --2- 172.21.15.17:0/211048991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850069930 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd85006cea0 tx=0x7fd84002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c7e88ca1c9d99a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.951+0000 7fd847fff640 1 -- 172.21.15.17:0/211048991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400317e0 con 0x7fd8500b5150 2023-08-09T12:46:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd847fff640 1 -- 172.21.15.17:0/211048991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840031940 con 0x7fd8500b5150 2023-08-09T12:46:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd847fff640 1 -- 172.21.15.17:0/211048991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840031cd0 con 0x7fd8500b5150 2023-08-09T12:46:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd856186640 1 -- 172.21.15.17:0/211048991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 msgr2=0x7fd850069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd856186640 1 --2- 172.21.15.17:0/211048991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850069930 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd85006cea0 tx=0x7fd84002b880 comp rx=0 tx=0).stop 2023-08-09T12:46:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd856186640 1 -- 172.21.15.17:0/211048991 shutdown_connections 2023-08-09T12:46:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd856186640 1 --2- 172.21.15.17:0/211048991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850069930 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd856186640 1 --2- 172.21.15.17:0/211048991 >> v2:172.21.15.142:3300/0 conn(0x7fd850069e70 0x7fd85015b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd856186640 1 -- 172.21.15.17:0/211048991 >> 172.21.15.17:0/211048991 conn(0x7fd8500cc180 msgr2=0x7fd8500cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd856186640 1 -- 172.21.15.17:0/211048991 shutdown_connections 2023-08-09T12:46:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.952+0000 7fd856186640 1 -- 172.21.15.17:0/211048991 wait complete. 2023-08-09T12:46:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.954+0000 7fd856186640 1 Processor -- start 2023-08-09T12:46:33.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.954+0000 7fd856186640 1 -- start start 2023-08-09T12:46:33.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.955+0000 7fd856186640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd850069e70 0x7fd8501370f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.955+0000 7fd856186640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.955+0000 7fd856186640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd850144370 0x7fd850138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.955+0000 7fd856186640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd850158ff0 con 0x7fd8500b5150 2023-08-09T12:46:33.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.955+0000 7fd856186640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85015a250 con 0x7fd850069e70 2023-08-09T12:46:33.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.955+0000 7fd856186640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd850159640 con 0x7fd850144370 2023-08-09T12:46:33.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.955+0000 7fd854983640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd854983640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57888/0 (socket says 172.21.15.17:57888) 2023-08-09T12:46:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd854983640 1 -- 172.21.15.17:0/2336218147 learned_addr learned my addr 172.21.15.17:0/2336218147 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd855985640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd850144370 0x7fd850138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd855184640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd850069e70 0x7fd8501370f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd854983640 1 -- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd850144370 msgr2=0x7fd850138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd854983640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd850144370 0x7fd850138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd854983640 1 -- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd850069e70 msgr2=0x7fd8501370f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd854983640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd850069e70 0x7fd8501370f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd854983640 1 -- 172.21.15.17:0/2336218147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400094d0 con 0x7fd8500b5150 2023-08-09T12:46:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd855184640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd850069e70 0x7fd8501370f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.956+0000 7fd854983640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850158ab0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd84002b8c0 tx=0x7fd8400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.957+0000 7fd845ffb640 1 -- 172.21.15.17:0/2336218147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840032880 con 0x7fd8500b5150 2023-08-09T12:46:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.957+0000 7fd845ffb640 1 -- 172.21.15.17:0/2336218147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400329e0 con 0x7fd8500b5150 2023-08-09T12:46:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.957+0000 7fd845ffb640 1 -- 172.21.15.17:0/2336218147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840032d90 con 0x7fd8500b5150 2023-08-09T12:46:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.957+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd850159920 con 0x7fd8500b5150 2023-08-09T12:46:33.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.957+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd850159ee0 con 0x7fd8500b5150 2023-08-09T12:46:33.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.958+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85004e390 con 0x7fd8500b5150 2023-08-09T12:46:33.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.959+0000 7fd845ffb640 1 -- 172.21.15.17:0/2336218147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd84004e450 con 0x7fd8500b5150 2023-08-09T12:46:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.960+0000 7fd845ffb640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83406a050 0x7fd83406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.960+0000 7fd845ffb640 1 -- 172.21.15.17:0/2336218147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fd8400aa7e0 con 0x7fd8500b5150 2023-08-09T12:46:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.961+0000 7fd855184640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83406a050 0x7fd83406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:33.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.962+0000 7fd855184640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83406a050 0x7fd83406c510 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00a830 tx=0x7fd84c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:33.965+0000 7fd845ffb640 1 -- 172.21.15.17:0/2336218147 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd840075e60 con 0x7fd8500b5150 2023-08-09T12:46:34.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.159+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8500cbab0 con 0x7fd8500b5150 2023-08-09T12:46:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.160+0000 7fd845ffb640 1 -- 172.21.15.17:0/2336218147 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd840034e60 con 0x7fd8500b5150 2023-08-09T12:46:34.163 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:46:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83406a050 msgr2=0x7fd83406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83406a050 0x7fd83406c510 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00a830 tx=0x7fd84c008040 comp rx=0 tx=0).stop 2023-08-09T12:46:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 msgr2=0x7fd850158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850158ab0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd84002b8c0 tx=0x7fd8400046c0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 shutdown_connections 2023-08-09T12:46:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd83406a050 0x7fd83406c510 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd850144370 0x7fd850138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8500b5150 0x7fd850158ab0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 --2- 172.21.15.17:0/2336218147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd850069e70 0x7fd8501370f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 >> 172.21.15.17:0/2336218147 conn(0x7fd8500cc180 msgr2=0x7fd85013d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 shutdown_connections 2023-08-09T12:46:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.163+0000 7fd856186640 1 -- 172.21.15.17:0/2336218147 wait complete. 2023-08-09T12:46:34.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:46:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.412+0000 7fac5df74640 1 Processor -- start 2023-08-09T12:46:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.412+0000 7fac5df74640 1 -- start start 2023-08-09T12:46:34.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.413+0000 7fac5df74640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac5815caf0 0x7fac580703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.413+0000 7fac5df74640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac580708e0 0x7fac580d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.413+0000 7fac5df74640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac580d0f00 con 0x7fac580d2360 2023-08-09T12:46:34.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.413+0000 7fac5df74640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac580d1a80 con 0x7fac580708e0 2023-08-09T12:46:34.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.413+0000 7fac5df74640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac580d27f0 con 0x7fac5815caf0 2023-08-09T12:46:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.414+0000 7fac4ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac580708e0 0x7fac580d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.414+0000 7fac4ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac580708e0 0x7fac580d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57898/0 (socket says 172.21.15.17:57898) 2023-08-09T12:46:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.414+0000 7fac4ffff640 1 -- 172.21.15.17:0/2975845482 learned_addr learned my addr 172.21.15.17:0/2975845482 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.414+0000 7fac5cf72640 1 --2- 172.21.15.17:0/2975845482 >> v2:172.21.15.142:3300/0 conn(0x7fac5815caf0 0x7fac580703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.414+0000 7fac4ffff640 1 -- 172.21.15.17:0/2975845482 >> v2:172.21.15.142:3300/0 conn(0x7fac5815caf0 msgr2=0x7fac580703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.414+0000 7fac4ffff640 1 --2- 172.21.15.17:0/2975845482 >> v2:172.21.15.142:3300/0 conn(0x7fac5815caf0 0x7fac580703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.414+0000 7fac4ffff640 1 -- 172.21.15.17:0/2975845482 >> v1:172.21.15.17:6789/0 conn(0x7fac580d2360 legacy=0x7fac580697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.414+0000 7fac4ffff640 1 -- 172.21.15.17:0/2975845482 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac580d11e0 con 0x7fac580708e0 2023-08-09T12:46:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.416+0000 7fac4ffff640 1 --2- 172.21.15.17:0/2975845482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac580708e0 0x7fac580d1e20 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fac580d04a0 tx=0x7fac4802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64b9bd1029a594e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.416+0000 7fac4f7fe640 1 -- 172.21.15.17:0/2975845482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48030880 con 0x7fac580708e0 2023-08-09T12:46:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.416+0000 7fac4f7fe640 1 -- 172.21.15.17:0/2975845482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac480309e0 con 0x7fac580708e0 2023-08-09T12:46:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.416+0000 7fac4f7fe640 1 -- 172.21.15.17:0/2975845482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48030d70 con 0x7fac580708e0 2023-08-09T12:46:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.417+0000 7fac5df74640 1 -- 172.21.15.17:0/2975845482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac580708e0 msgr2=0x7fac580d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.417+0000 7fac5df74640 1 --2- 172.21.15.17:0/2975845482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac580708e0 0x7fac580d1e20 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fac580d04a0 tx=0x7fac4802b9c0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.417+0000 7fac5df74640 1 -- 172.21.15.17:0/2975845482 shutdown_connections 2023-08-09T12:46:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.417+0000 7fac5df74640 1 --2- 172.21.15.17:0/2975845482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac580708e0 0x7fac580d1e20 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.417+0000 7fac5df74640 1 --2- 172.21.15.17:0/2975845482 >> v2:172.21.15.142:3300/0 conn(0x7fac5815caf0 0x7fac580703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.417+0000 7fac5df74640 1 -- 172.21.15.17:0/2975845482 >> 172.21.15.17:0/2975845482 conn(0x7fac580cf6b0 msgr2=0x7fac580cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.417+0000 7fac5df74640 1 -- 172.21.15.17:0/2975845482 shutdown_connections 2023-08-09T12:46:34.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.417+0000 7fac5df74640 1 -- 172.21.15.17:0/2975845482 wait complete. 2023-08-09T12:46:34.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.419+0000 7fac5df74640 1 Processor -- start 2023-08-09T12:46:34.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.419+0000 7fac5df74640 1 -- start start 2023-08-09T12:46:34.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5df74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac580d2360 0x7fac5815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5df74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5815caf0 0x7fac5815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5df74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac58151f10 0x7fac58151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5df74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac581544d0 con 0x7fac58151f10 2023-08-09T12:46:34.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5df74640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac581547b0 con 0x7fac580d2360 2023-08-09T12:46:34.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5df74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac58154a90 con 0x7fac5815caf0 2023-08-09T12:46:34.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5d773640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac58151f10 0x7fac58151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5d773640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac58151f10 0x7fac58151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57912/0 (socket says 172.21.15.17:57912) 2023-08-09T12:46:34.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.420+0000 7fac5d773640 1 -- 172.21.15.17:0/4214282023 learned_addr learned my addr 172.21.15.17:0/4214282023 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:34.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac4ffff640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5815caf0 0x7fac5815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac5cf72640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac580d2360 0x7fac5815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac5d773640 1 -- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5815caf0 msgr2=0x7fac5815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac5d773640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5815caf0 0x7fac5815aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac5d773640 1 -- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac580d2360 msgr2=0x7fac5815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac5d773640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac580d2360 0x7fac5815d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac5d773640 1 -- 172.21.15.17:0/4214282023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480094d0 con 0x7fac58151f10 2023-08-09T12:46:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac5cf72640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac580d2360 0x7fac5815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac5d773640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac58151f10 0x7fac58151300 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c7a0 tx=0x7fac5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.421+0000 7fac4d7fa640 1 -- 172.21.15.17:0/4214282023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50003b70 con 0x7fac58151f10 2023-08-09T12:46:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.422+0000 7fac4d7fa640 1 -- 172.21.15.17:0/4214282023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50003cf0 con 0x7fac58151f10 2023-08-09T12:46:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.422+0000 7fac4d7fa640 1 -- 172.21.15.17:0/4214282023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50003ea0 con 0x7fac58151f10 2023-08-09T12:46:34.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.422+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac58154d70 con 0x7fac58151f10 2023-08-09T12:46:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.422+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac581540f0 con 0x7fac58151f10 2023-08-09T12:46:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.423+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac58155290 con 0x7fac58151f10 2023-08-09T12:46:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.424+0000 7fac4d7fa640 1 -- 172.21.15.17:0/4214282023 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac5000aa90 con 0x7fac58151f10 2023-08-09T12:46:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.425+0000 7fac4d7fa640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4406a050 0x7fac4406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.425+0000 7fac4d7fa640 1 -- 172.21.15.17:0/4214282023 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fac50088510 con 0x7fac58151f10 2023-08-09T12:46:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.425+0000 7fac5cf72640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4406a050 0x7fac4406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.427+0000 7fac5cf72640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4406a050 0x7fac4406c510 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fac54006fd0 tx=0x7fac54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:34.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.429+0000 7fac4d7fa640 1 -- 172.21.15.17:0/4214282023 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fac58155290 con 0x7fac58151f10 2023-08-09T12:46:34.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.613+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac58155290 con 0x7fac58151f10 2023-08-09T12:46:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.614+0000 7fac4d7fa640 1 -- 172.21.15.17:0/4214282023 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac58155290 con 0x7fac58151f10 2023-08-09T12:46:34.617 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:46:34.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4406a050 msgr2=0x7fac4406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4406a050 0x7fac4406c510 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fac54006fd0 tx=0x7fac54008040 comp rx=0 tx=0).stop 2023-08-09T12:46:34.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac58151f10 msgr2=0x7fac58151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac58151f10 0x7fac58151300 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c7a0 tx=0x7fac5000cc60 comp rx=0 tx=0).stop 2023-08-09T12:46:34.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 shutdown_connections 2023-08-09T12:46:34.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac4406a050 0x7fac4406c510 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac58151f10 0x7fac58151300 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5815caf0 0x7fac5815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 --2- 172.21.15.17:0/4214282023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac580d2360 0x7fac5815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.616+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 >> 172.21.15.17:0/4214282023 conn(0x7fac580cf6b0 msgr2=0x7fac580b79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.617+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 shutdown_connections 2023-08-09T12:46:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.617+0000 7fac5df74640 1 -- 172.21.15.17:0/4214282023 wait complete. 2023-08-09T12:46:34.638 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:46:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.859+0000 7fed83fff640 1 Processor -- start 2023-08-09T12:46:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.859+0000 7fed83fff640 1 -- start start 2023-08-09T12:46:34.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.861+0000 7fed83fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fed840b21c0 0x7fed840c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.861+0000 7fed83fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840c2670 0x7fed840c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.861+0000 7fed83fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed840c8c30 con 0x7fed8415ab40 2023-08-09T12:46:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.861+0000 7fed83fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed840cb770 con 0x7fed840b21c0 2023-08-09T12:46:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.861+0000 7fed83fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed840cb9d0 con 0x7fed840c2670 2023-08-09T12:46:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.862+0000 7fed837fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840c2670 0x7fed840c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.862+0000 7fed827fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fed840b21c0 0x7fed840c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.862+0000 7fed82ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fed8415ab40 0x7fed840cb060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:41360/0 (socket says 172.21.15.17:41360) 2023-08-09T12:46:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.862+0000 7fed837fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840c2670 0x7fed840c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:37982/0 (socket says 172.21.15.17:37982) 2023-08-09T12:46:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.862+0000 7fed82ffd640 1 -- 172.21.15.17:0/4012781202 learned_addr learned my addr 172.21.15.17:0/4012781202 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.863+0000 7fed837fe640 1 -- 172.21.15.17:0/4012781202 >> v2:172.21.15.142:3300/0 conn(0x7fed840b21c0 msgr2=0x7fed840c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:34.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.863+0000 7fed837fe640 1 --2- 172.21.15.17:0/4012781202 >> v2:172.21.15.142:3300/0 conn(0x7fed840b21c0 0x7fed840c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.863+0000 7fed837fe640 1 -- 172.21.15.17:0/4012781202 >> v1:172.21.15.142:6789/0 conn(0x7fed8415ab40 legacy=0x7fed840cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.863+0000 7fed837fe640 1 -- 172.21.15.17:0/4012781202 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed840c8e80 con 0x7fed840c2670 2023-08-09T12:46:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.864+0000 7fed837fe640 1 --2- 172.21.15.17:0/4012781202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840c2670 0x7fed840c9960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009d90 tx=0x7fed7c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51a6cefa76235e43 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed81ffb640 1 -- 172.21.15.17:0/4012781202 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c02cc50 con 0x7fed840c2670 2023-08-09T12:46:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed81ffb640 1 -- 172.21.15.17:0/4012781202 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c02cdb0 con 0x7fed840c2670 2023-08-09T12:46:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed81ffb640 1 -- 172.21.15.17:0/4012781202 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c034660 con 0x7fed840c2670 2023-08-09T12:46:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed83fff640 1 -- 172.21.15.17:0/4012781202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840c2670 msgr2=0x7fed840c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed83fff640 1 --2- 172.21.15.17:0/4012781202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840c2670 0x7fed840c9960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009d90 tx=0x7fed7c02bea0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed83fff640 1 -- 172.21.15.17:0/4012781202 shutdown_connections 2023-08-09T12:46:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed83fff640 1 --2- 172.21.15.17:0/4012781202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840c2670 0x7fed840c9960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed83fff640 1 --2- 172.21.15.17:0/4012781202 >> v2:172.21.15.142:3300/0 conn(0x7fed840b21c0 0x7fed840c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed83fff640 1 -- 172.21.15.17:0/4012781202 >> 172.21.15.17:0/4012781202 conn(0x7fed8406abd0 msgr2=0x7fed8406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed83fff640 1 -- 172.21.15.17:0/4012781202 shutdown_connections 2023-08-09T12:46:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.865+0000 7fed83fff640 1 -- 172.21.15.17:0/4012781202 wait complete. 2023-08-09T12:46:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.867+0000 7fed83fff640 1 Processor -- start 2023-08-09T12:46:34.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.867+0000 7fed83fff640 1 -- start start 2023-08-09T12:46:34.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.868+0000 7fed83fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840b21c0 0x7fed840cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.868+0000 7fed83fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840c2670 0x7fed841f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.868+0000 7fed83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8415ab40 0x7fed840c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.868+0000 7fed83fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8406eb30 con 0x7fed8415ab40 2023-08-09T12:46:34.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.868+0000 7fed83fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8406ee10 con 0x7fed840c2670 2023-08-09T12:46:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.868+0000 7fed83fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8406f0f0 con 0x7fed840b21c0 2023-08-09T12:46:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.869+0000 7fed82ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840b21c0 0x7fed840cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.869+0000 7fed827fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840c2670 0x7fed841f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.869+0000 7fed837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8415ab40 0x7fed840c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.869+0000 7fed82ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840b21c0 0x7fed840cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:37992/0 (socket says 172.21.15.17:37992) 2023-08-09T12:46:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.869+0000 7fed827fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840c2670 0x7fed841f15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:49940/0 (socket says 172.21.15.17:49940) 2023-08-09T12:46:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.869+0000 7fed82ffd640 1 -- 172.21.15.17:0/2079019391 learned_addr learned my addr 172.21.15.17:0/2079019391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed837fe640 1 -- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840b21c0 msgr2=0x7fed840cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed837fe640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840b21c0 0x7fed840cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed837fe640 1 -- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840c2670 msgr2=0x7fed841f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed837fe640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840c2670 0x7fed841f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed837fe640 1 -- 172.21.15.17:0/2079019391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c009a70 con 0x7fed8415ab40 2023-08-09T12:46:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed837fe640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8415ab40 0x7fed840c56b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fed7c033000 tx=0x7fed7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed6b7fe640 1 -- 172.21.15.17:0/2079019391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c040650 con 0x7fed8415ab40 2023-08-09T12:46:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed6b7fe640 1 -- 172.21.15.17:0/2079019391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c0407b0 con 0x7fed8415ab40 2023-08-09T12:46:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed6b7fe640 1 -- 172.21.15.17:0/2079019391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c040b60 con 0x7fed8415ab40 2023-08-09T12:46:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.870+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8406f3d0 con 0x7fed8415ab40 2023-08-09T12:46:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.871+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed840cdb90 con 0x7fed8415ab40 2023-08-09T12:46:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.872+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8406f8f0 con 0x7fed8415ab40 2023-08-09T12:46:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.873+0000 7fed6b7fe640 1 -- 172.21.15.17:0/2079019391 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fed7c040cc0 con 0x7fed8415ab40 2023-08-09T12:46:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.873+0000 7fed6b7fe640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed7006a050 0x7fed7006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:34.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.874+0000 7fed6b7fe640 1 -- 172.21.15.17:0/2079019391 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fed7c0ab110 con 0x7fed8415ab40 2023-08-09T12:46:34.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.874+0000 7fed82ffd640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed7006a050 0x7fed7006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:34.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.875+0000 7fed82ffd640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed7006a050 0x7fed7006c510 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fed74005880 tx=0x7fed74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:34.878+0000 7fed6b7fe640 1 -- 172.21.15.17:0/2079019391 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fed8406f8f0 con 0x7fed8415ab40 2023-08-09T12:46:35.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.072+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed8406f8f0 con 0x7fed8415ab40 2023-08-09T12:46:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.073+0000 7fed6b7fe640 1 -- 172.21.15.17:0/2079019391 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed8406f8f0 con 0x7fed8415ab40 2023-08-09T12:46:35.077 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:46:35.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.076+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed7006a050 msgr2=0x7fed7006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.076+0000 7fed83fff640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed7006a050 0x7fed7006c510 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fed74005880 tx=0x7fed74009040 comp rx=0 tx=0).stop 2023-08-09T12:46:35.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8415ab40 msgr2=0x7fed840c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8415ab40 0x7fed840c56b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fed7c033000 tx=0x7fed7c004a40 comp rx=0 tx=0).stop 2023-08-09T12:46:35.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 shutdown_connections 2023-08-09T12:46:35.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed7006a050 0x7fed7006c510 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8415ab40 0x7fed840c56b0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840c2670 0x7fed841f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 --2- 172.21.15.17:0/2079019391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed840b21c0 0x7fed840cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 >> 172.21.15.17:0/2079019391 conn(0x7fed8406abd0 msgr2=0x7fed840c2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 shutdown_connections 2023-08-09T12:46:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.077+0000 7fed83fff640 1 -- 172.21.15.17:0/2079019391 wait complete. 2023-08-09T12:46:35.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:46:35.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.326+0000 7f29fc9bd640 1 Processor -- start 2023-08-09T12:46:35.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.326+0000 7f29fc9bd640 1 -- start start 2023-08-09T12:46:35.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.327+0000 7f29fc9bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f80b4170 0x7f29f80b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29fc9bd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f29f80b0020 0x7f29f80b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29fc9bd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f815e7b0 con 0x7f29f815a8c0 2023-08-09T12:46:35.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29fc9bd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80b09f0 con 0x7f29f80b0020 2023-08-09T12:46:35.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29fc9bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f815e460 con 0x7f29f80b4170 2023-08-09T12:46:35.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29f7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f29f80b0020 0x7f29f80b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29f7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f29f80b0020 0x7f29f80b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57936/0 (socket says 172.21.15.17:57936) 2023-08-09T12:46:35.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29f7fff640 1 -- 172.21.15.17:0/762082841 learned_addr learned my addr 172.21.15.17:0/762082841 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:35.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29f6ffd640 1 --2- 172.21.15.17:0/762082841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f80b4170 0x7f29f80b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.328+0000 7f29f7fff640 1 -- 172.21.15.17:0/762082841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f80b4170 msgr2=0x7f29f80b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:35.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.329+0000 7f29f7fff640 1 --2- 172.21.15.17:0/762082841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f80b4170 0x7f29f80b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.329+0000 7f29f7fff640 1 -- 172.21.15.17:0/762082841 >> v1:172.21.15.142:6789/0 conn(0x7f29f815a8c0 legacy=0x7f29f815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:35.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.329+0000 7f29f7fff640 1 -- 172.21.15.17:0/762082841 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f815aca0 con 0x7f29f80b0020 2023-08-09T12:46:35.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.330+0000 7f29f7fff640 1 --2- 172.21.15.17:0/762082841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80b04b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009e50 tx=0x7f29f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889f60a38c87f172 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:35.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.330+0000 7f29f67fc640 1 -- 172.21.15.17:0/762082841 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f002ca80 con 0x7f29f80b0020 2023-08-09T12:46:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.330+0000 7f29f67fc640 1 -- 172.21.15.17:0/762082841 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f002cbe0 con 0x7f29f80b0020 2023-08-09T12:46:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.330+0000 7f29f67fc640 1 -- 172.21.15.17:0/762082841 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00343f0 con 0x7f29f80b0020 2023-08-09T12:46:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.331+0000 7f29fc9bd640 1 -- 172.21.15.17:0/762082841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 msgr2=0x7f29f80b04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.331+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/762082841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80b04b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009e50 tx=0x7f29f002bee0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.331+0000 7f29fc9bd640 1 -- 172.21.15.17:0/762082841 shutdown_connections 2023-08-09T12:46:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.331+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/762082841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80b04b0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.331+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/762082841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f80b4170 0x7f29f80b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.331+0000 7f29fc9bd640 1 -- 172.21.15.17:0/762082841 >> 172.21.15.17:0/762082841 conn(0x7f29f80cb020 msgr2=0x7f29f80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.331+0000 7f29fc9bd640 1 -- 172.21.15.17:0/762082841 shutdown_connections 2023-08-09T12:46:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.331+0000 7f29fc9bd640 1 -- 172.21.15.17:0/762082841 wait complete. 2023-08-09T12:46:35.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.333+0000 7f29fc9bd640 1 Processor -- start 2023-08-09T12:46:35.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.333+0000 7f29fc9bd640 1 -- start start 2023-08-09T12:46:35.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29fc9bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29fc9bd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29f80b4170 0x7f29f81f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29fc9bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f815a8c0 0x7f29f81f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29fc9bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8157600 con 0x7f29f80b0020 2023-08-09T12:46:35.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29fc9bd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80c19a0 con 0x7f29f80b4170 2023-08-09T12:46:35.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29fc9bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f815dd50 con 0x7f29f815a8c0 2023-08-09T12:46:35.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80c4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57946/0 (socket says 172.21.15.17:57946) 2023-08-09T12:46:35.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.334+0000 7f29f77fe640 1 -- 172.21.15.17:0/170680600 learned_addr learned my addr 172.21.15.17:0/170680600 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:35.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29f7fff640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f815a8c0 0x7f29f81f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29f77fe640 1 -- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f815a8c0 msgr2=0x7f29f81f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29f6ffd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29f80b4170 0x7f29f81f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29f77fe640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f815a8c0 0x7f29f81f5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29f77fe640 1 -- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29f80b4170 msgr2=0x7f29f81f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29f77fe640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29f80b4170 0x7f29f81f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29f77fe640 1 -- 172.21.15.17:0/170680600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f0009b30 con 0x7f29f80b0020 2023-08-09T12:46:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29f77fe640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80c4b50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f29e800b3f0 tx=0x7f29e800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29dffff640 1 -- 172.21.15.17:0/170680600 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8011830 con 0x7f29f80b0020 2023-08-09T12:46:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29dffff640 1 -- 172.21.15.17:0/170680600 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e8011990 con 0x7f29f80b0020 2023-08-09T12:46:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29dffff640 1 -- 172.21.15.17:0/170680600 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8011d40 con 0x7f29f80b0020 2023-08-09T12:46:35.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.335+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f8157a90 con 0x7f29f80b0020 2023-08-09T12:46:35.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.336+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f8156fb0 con 0x7f29f80b0020 2023-08-09T12:46:35.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.337+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f804e390 con 0x7f29f80b0020 2023-08-09T12:46:35.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.338+0000 7f29dffff640 1 -- 172.21.15.17:0/170680600 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f29e801a400 con 0x7f29f80b0020 2023-08-09T12:46:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.338+0000 7f29dffff640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f29e406a080 0x7f29e406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.339+0000 7f29dffff640 1 -- 172.21.15.17:0/170680600 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f29e8088420 con 0x7f29f80b0020 2023-08-09T12:46:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.339+0000 7f29f6ffd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f29e406a080 0x7f29e406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.340+0000 7f29f6ffd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f29e406a080 0x7f29e406c540 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f29f81f5750 tx=0x7f29ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:35.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.343+0000 7f29dffff640 1 -- 172.21.15.17:0/170680600 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f29e8053a80 con 0x7f29f80b0020 2023-08-09T12:46:35.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.537+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29f80cbd50 con 0x7f29f80b0020 2023-08-09T12:46:35.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.537+0000 7f29dffff640 1 -- 172.21.15.17:0/170680600 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29e80570a0 con 0x7f29f80b0020 2023-08-09T12:46:35.541 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:46:35.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f29e406a080 msgr2=0x7f29e406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f29e406a080 0x7f29e406c540 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f29f81f5750 tx=0x7f29ec008040 comp rx=0 tx=0).stop 2023-08-09T12:46:35.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 msgr2=0x7f29f80c4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80c4b50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f29e800b3f0 tx=0x7f29e800b8b0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 shutdown_connections 2023-08-09T12:46:35.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f29e406a080 0x7f29e406c540 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29f815a8c0 0x7f29f81f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29f80b4170 0x7f29f81f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 --2- 172.21.15.17:0/170680600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f80b0020 0x7f29f80c4b50 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 >> 172.21.15.17:0/170680600 conn(0x7f29f80cb020 msgr2=0x7f29f8159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:35.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 shutdown_connections 2023-08-09T12:46:35.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.540+0000 7f29fc9bd640 1 -- 172.21.15.17:0/170680600 wait complete. 2023-08-09T12:46:35.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:46:35.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.786+0000 7f7275f9f640 1 Processor -- start 2023-08-09T12:46:35.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.786+0000 7f7275f9f640 1 -- start start 2023-08-09T12:46:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.787+0000 7f7275f9f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7270160030 0x7f7270160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.787+0000 7f7275f9f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72700cfb50 0x7f72700d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f7275f9f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72700b5a30 con 0x7f72700b86e0 2023-08-09T12:46:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f7275f9f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72700d1110 con 0x7f72700cfb50 2023-08-09T12:46:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f7275f9f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72700ceac0 con 0x7f7270160030 2023-08-09T12:46:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f727579e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72700cfb50 0x7f72700d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f727579e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72700cfb50 0x7f72700d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57958/0 (socket says 172.21.15.17:57958) 2023-08-09T12:46:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f727579e640 1 -- 172.21.15.17:0/3585681459 learned_addr learned my addr 172.21.15.17:0/3585681459 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f7274f9d640 1 --2- 172.21.15.17:0/3585681459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7270160030 0x7f7270160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f727579e640 1 -- 172.21.15.17:0/3585681459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7270160030 msgr2=0x7f7270160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f727579e640 1 --2- 172.21.15.17:0/3585681459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7270160030 0x7f7270160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f727579e640 1 -- 172.21.15.17:0/3585681459 >> v1:172.21.15.142:6789/0 conn(0x7f72700b86e0 legacy=0x7f72700cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.788+0000 7f727579e640 1 -- 172.21.15.17:0/3585681459 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700d0d70 con 0x7f72700cfb50 2023-08-09T12:46:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.789+0000 7f727579e640 1 --2- 172.21.15.17:0/3585681459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72700cfb50 0x7f72700d1530 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7268009e50 tx=0x7f726802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34d3345f590fd0e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.790+0000 7f72677fe640 1 -- 172.21.15.17:0/3585681459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726802ca70 con 0x7f72700cfb50 2023-08-09T12:46:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.790+0000 7f72677fe640 1 -- 172.21.15.17:0/3585681459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726802cbd0 con 0x7f72700cfb50 2023-08-09T12:46:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.790+0000 7f72677fe640 1 -- 172.21.15.17:0/3585681459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72680343f0 con 0x7f72700cfb50 2023-08-09T12:46:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.790+0000 7f7275f9f640 1 -- 172.21.15.17:0/3585681459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72700cfb50 msgr2=0x7f72700d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.790+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3585681459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72700cfb50 0x7f72700d1530 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7268009e50 tx=0x7f726802bed0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.791+0000 7f7275f9f640 1 -- 172.21.15.17:0/3585681459 shutdown_connections 2023-08-09T12:46:35.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.791+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3585681459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72700cfb50 0x7f72700d1530 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.791+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3585681459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7270160030 0x7f7270160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.791+0000 7f7275f9f640 1 -- 172.21.15.17:0/3585681459 >> 172.21.15.17:0/3585681459 conn(0x7f72700697c0 msgr2=0x7f7270069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:35.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.791+0000 7f7275f9f640 1 -- 172.21.15.17:0/3585681459 shutdown_connections 2023-08-09T12:46:35.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.791+0000 7f7275f9f640 1 -- 172.21.15.17:0/3585681459 wait complete. 2023-08-09T12:46:35.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.792+0000 7f7275f9f640 1 Processor -- start 2023-08-09T12:46:35.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.793+0000 7f7275f9f640 1 -- start start 2023-08-09T12:46:35.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7275f9f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72700b86e0 0x7f72700cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7275f9f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72700cfb50 0x7f727015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7275f9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270160030 0x7f7270148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7275f9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72700cb770 con 0x7f7270160030 2023-08-09T12:46:35.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7275f9f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72700cba50 con 0x7f72700b86e0 2023-08-09T12:46:35.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7275f9f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72700cbd30 con 0x7f72700cfb50 2023-08-09T12:46:35.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f727579e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270160030 0x7f7270148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f727579e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270160030 0x7f7270148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57970/0 (socket says 172.21.15.17:57970) 2023-08-09T12:46:35.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f727579e640 1 -- 172.21.15.17:0/3875764063 learned_addr learned my addr 172.21.15.17:0/3875764063 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:35.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7267fff640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72700cfb50 0x7f727015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7274f9d640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72700b86e0 0x7f72700cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f727579e640 1 -- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72700cfb50 msgr2=0x7f727015cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f727579e640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72700cfb50 0x7f727015cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f727579e640 1 -- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72700b86e0 msgr2=0x7f72700cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:35.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f727579e640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72700b86e0 0x7f72700cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:35.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f727579e640 1 -- 172.21.15.17:0/3875764063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7268009b30 con 0x7f7270160030 2023-08-09T12:46:35.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.794+0000 7f7274f9d640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72700b86e0 0x7f72700cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:35.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.795+0000 7f727579e640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270160030 0x7f7270148ad0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7268036040 tx=0x7f7268004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:35.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.795+0000 7f72657fa640 1 -- 172.21.15.17:0/3875764063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726803e450 con 0x7f7270160030 2023-08-09T12:46:35.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.795+0000 7f72657fa640 1 -- 172.21.15.17:0/3875764063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726803e5d0 con 0x7f7270160030 2023-08-09T12:46:35.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.795+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72700cc010 con 0x7f7270160030 2023-08-09T12:46:35.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.795+0000 7f72657fa640 1 -- 172.21.15.17:0/3875764063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726803e980 con 0x7f7270160030 2023-08-09T12:46:35.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.795+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72700cb3d0 con 0x7f7270160030 2023-08-09T12:46:35.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.796+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72700cc530 con 0x7f7270160030 2023-08-09T12:46:35.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.797+0000 7f72657fa640 1 -- 172.21.15.17:0/3875764063 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f726803eae0 con 0x7f7270160030 2023-08-09T12:46:35.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.799+0000 7f72657fa640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f725c06a050 0x7f725c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:35.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.799+0000 7f72657fa640 1 -- 172.21.15.17:0/3875764063 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f72680ab4c0 con 0x7f7270160030 2023-08-09T12:46:35.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.800+0000 7f7274f9d640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f725c06a050 0x7f725c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.801+0000 7f7274f9d640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f725c06a050 0x7f725c06c510 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f726c00b820 tx=0x7f726c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:35.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:35.803+0000 7f72657fa640 1 -- 172.21.15.17:0/3875764063 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7268076bd0 con 0x7f7270160030 2023-08-09T12:46:36.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.039+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f727004e390 con 0x7f7270160030 2023-08-09T12:46:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.040+0000 7f72657fa640 1 -- 172.21.15.17:0/3875764063 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f726807a1f0 con 0x7f7270160030 2023-08-09T12:46:36.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:36.044 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:46:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:46:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f725c06a050 msgr2=0x7f725c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f725c06a050 0x7f725c06c510 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f726c00b820 tx=0x7f726c008040 comp rx=0 tx=0).stop 2023-08-09T12:46:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270160030 msgr2=0x7f7270148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270160030 0x7f7270148ad0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7268036040 tx=0x7f7268004a40 comp rx=0 tx=0).stop 2023-08-09T12:46:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 shutdown_connections 2023-08-09T12:46:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f725c06a050 0x7f725c06c510 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270160030 0x7f7270148ad0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72700cfb50 0x7f727015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 --2- 172.21.15.17:0/3875764063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72700b86e0 0x7f72700cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 >> 172.21.15.17:0/3875764063 conn(0x7f72700697c0 msgr2=0x7f72700c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 shutdown_connections 2023-08-09T12:46:36.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.043+0000 7f7275f9f640 1 -- 172.21.15.17:0/3875764063 wait complete. 2023-08-09T12:46:36.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:36.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.289+0000 7fa238ffc640 1 Processor -- start 2023-08-09T12:46:36.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.289+0000 7fa238ffc640 1 -- start start 2023-08-09T12:46:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.291+0000 7fa238ffc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa234071450 0x7fa2340cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.291+0000 7fa238ffc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa23415cd80 0x7fa23406f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.291+0000 7fa238ffc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23406fab0 con 0x7fa2340c98f0 2023-08-09T12:46:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.291+0000 7fa238ffc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa234159710 con 0x7fa234071450 2023-08-09T12:46:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.291+0000 7fa238ffc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23415d4f0 con 0x7fa23415cd80 2023-08-09T12:46:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.292+0000 7fa22affd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa23415cd80 0x7fa23406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.292+0000 7fa22affd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa23415cd80 0x7fa23406f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38028/0 (socket says 172.21.15.17:38028) 2023-08-09T12:46:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.292+0000 7fa22affd640 1 -- 172.21.15.17:0/3776763618 learned_addr learned my addr 172.21.15.17:0/3776763618 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.292+0000 7fa2337fe640 1 --2- 172.21.15.17:0/3776763618 >> v2:172.21.15.142:3300/0 conn(0x7fa234071450 0x7fa2340cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.292+0000 7fa2337fe640 1 -- 172.21.15.17:0/3776763618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa23415cd80 msgr2=0x7fa23406f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.292+0000 7fa2337fe640 1 --2- 172.21.15.17:0/3776763618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa23415cd80 0x7fa23406f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.293+0000 7fa2337fe640 1 -- 172.21.15.17:0/3776763618 >> v1:172.21.15.142:6789/0 conn(0x7fa2340c98f0 legacy=0x7fa2340b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.293+0000 7fa2337fe640 1 -- 172.21.15.17:0/3776763618 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23415d7d0 con 0x7fa234071450 2023-08-09T12:46:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.294+0000 7fa2337fe640 1 --2- 172.21.15.17:0/3776763618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa234071450 0x7fa2340cb870 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa224009d90 tx=0x7fa22402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aac3e5401af2c0da server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.294+0000 7fa232ffd640 1 -- 172.21.15.17:0/3776763618 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22402cbd0 con 0x7fa234071450 2023-08-09T12:46:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa232ffd640 1 -- 172.21.15.17:0/3776763618 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22402cd30 con 0x7fa234071450 2023-08-09T12:46:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa232ffd640 1 -- 172.21.15.17:0/3776763618 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22402cea0 con 0x7fa234071450 2023-08-09T12:46:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa238ffc640 1 -- 172.21.15.17:0/3776763618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa234071450 msgr2=0x7fa2340cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa238ffc640 1 --2- 172.21.15.17:0/3776763618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa234071450 0x7fa2340cb870 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa224009d90 tx=0x7fa22402be20 comp rx=0 tx=0).stop 2023-08-09T12:46:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa238ffc640 1 -- 172.21.15.17:0/3776763618 shutdown_connections 2023-08-09T12:46:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa238ffc640 1 --2- 172.21.15.17:0/3776763618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa23415cd80 0x7fa23406f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa238ffc640 1 --2- 172.21.15.17:0/3776763618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa234071450 0x7fa2340cb870 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa238ffc640 1 -- 172.21.15.17:0/3776763618 >> 172.21.15.17:0/3776763618 conn(0x7fa2340b1d50 msgr2=0x7fa23406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa238ffc640 1 -- 172.21.15.17:0/3776763618 shutdown_connections 2023-08-09T12:46:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.295+0000 7fa238ffc640 1 -- 172.21.15.17:0/3776763618 wait complete. 2023-08-09T12:46:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.297+0000 7fa238ffc640 1 Processor -- start 2023-08-09T12:46:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.297+0000 7fa238ffc640 1 -- start start 2023-08-09T12:46:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.298+0000 7fa238ffc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234071450 0x7fa234146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.298+0000 7fa238ffc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2340c98f0 0x7fa23414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.298+0000 7fa238ffc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23415cd80 0x7fa23414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.298+0000 7fa238ffc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23414f310 con 0x7fa234071450 2023-08-09T12:46:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.298+0000 7fa238ffc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23414d110 con 0x7fa23415cd80 2023-08-09T12:46:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.298+0000 7fa238ffc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa234146c90 con 0x7fa2340c98f0 2023-08-09T12:46:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa2337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234071450 0x7fa234146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa2337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234071450 0x7fa234146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57984/0 (socket says 172.21.15.17:57984) 2023-08-09T12:46:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa2337fe640 1 -- 172.21.15.17:0/2360706356 learned_addr learned my addr 172.21.15.17:0/2360706356 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa22affd640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2340c98f0 0x7fa23414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa2337fe640 1 -- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2340c98f0 msgr2=0x7fa23414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa233fff640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23415cd80 0x7fa23414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa2337fe640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2340c98f0 0x7fa23414fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa2337fe640 1 -- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23415cd80 msgr2=0x7fa23414a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa2337fe640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23415cd80 0x7fa23414a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa2337fe640 1 -- 172.21.15.17:0/2360706356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224009a70 con 0x7fa234071450 2023-08-09T12:46:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.299+0000 7fa22affd640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2340c98f0 0x7fa23414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.300+0000 7fa2337fe640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234071450 0x7fa234146750 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fa224009d90 tx=0x7fa224004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.300+0000 7fa230ff9640 1 -- 172.21.15.17:0/2360706356 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22402cea0 con 0x7fa234071450 2023-08-09T12:46:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.300+0000 7fa230ff9640 1 -- 172.21.15.17:0/2360706356 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224040650 con 0x7fa234071450 2023-08-09T12:46:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.300+0000 7fa230ff9640 1 -- 172.21.15.17:0/2360706356 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224040a00 con 0x7fa234071450 2023-08-09T12:46:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.300+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23414c500 con 0x7fa234071450 2023-08-09T12:46:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.300+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23414cac0 con 0x7fa234071450 2023-08-09T12:46:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.302+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23404e390 con 0x7fa234071450 2023-08-09T12:46:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.302+0000 7fa230ff9640 1 -- 172.21.15.17:0/2360706356 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa224040b60 con 0x7fa234071450 2023-08-09T12:46:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.304+0000 7fa230ff9640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa21406a050 0x7fa21406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.304+0000 7fa230ff9640 1 -- 172.21.15.17:0/2360706356 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fa2240ab300 con 0x7fa234071450 2023-08-09T12:46:36.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.305+0000 7fa22affd640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa21406a050 0x7fa21406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.306+0000 7fa22affd640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa21406a050 0x7fa21406c510 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa23414b770 tx=0x7fa21c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.309+0000 7fa230ff9640 1 -- 172.21.15.17:0/2360706356 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa224076a80 con 0x7fa234071450 2023-08-09T12:46:36.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.503+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa23415da80 con 0x7fa234071450 2023-08-09T12:46:36.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.505+0000 7fa230ff9640 1 -- 172.21.15.17:0/2360706356 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18476 (secure 0 0 0) 0x7fa22407a0a0 con 0x7fa234071450 2023-08-09T12:46:36.509 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:36.509 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":118,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:18.920294+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:45:41.039914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-09T12:45:41.697620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:36.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.507+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa21406a050 msgr2=0x7fa21406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.507+0000 7fa238ffc640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa21406a050 0x7fa21406c510 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa23414b770 tx=0x7fa21c008040 comp rx=0 tx=0).stop 2023-08-09T12:46:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234071450 msgr2=0x7fa234146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234071450 0x7fa234146750 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fa224009d90 tx=0x7fa224004a40 comp rx=0 tx=0).stop 2023-08-09T12:46:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 shutdown_connections 2023-08-09T12:46:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa21406a050 0x7fa21406c510 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa23415cd80 0x7fa23414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2340c98f0 0x7fa23414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 --2- 172.21.15.17:0/2360706356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234071450 0x7fa234146750 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 >> 172.21.15.17:0/2360706356 conn(0x7fa2340b1d50 msgr2=0x7fa2340ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 shutdown_connections 2023-08-09T12:46:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.508+0000 7fa238ffc640 1 -- 172.21.15.17:0/2360706356 wait complete. 2023-08-09T12:46:36.533 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:46:36.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:46:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.754+0000 7f395bde4640 1 Processor -- start 2023-08-09T12:46:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.754+0000 7f395bde4640 1 -- start start 2023-08-09T12:46:36.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.756+0000 7f395bde4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39540adc40 0x7f395406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.756+0000 7f395bde4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39540b2250 con 0x7f39540cc630 2023-08-09T12:46:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.756+0000 7f395bde4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39540b2530 con 0x7f39540b3b40 2023-08-09T12:46:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.756+0000 7f395bde4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39540ae020 con 0x7f39540adc40 2023-08-09T12:46:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.756+0000 7f395a381640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f39540cc630 0x7f39540ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49014/0 (socket says 172.21.15.17:49014) 2023-08-09T12:46:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.756+0000 7f395a381640 1 -- 172.21.15.17:0/987471558 learned_addr learned my addr 172.21.15.17:0/987471558 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:36.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.756+0000 7f3959b80640 1 --2- 172.21.15.17:0/987471558 >> v2:172.21.15.142:3300/0 conn(0x7f39540adc40 0x7f395406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766477689 0 0) 0x7f39540b2250 con 0x7f39540cc630 2023-08-09T12:46:36.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3940003520 con 0x7f39540cc630 2023-08-09T12:46:36.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1843998854 0 0) 0x7f3940003520 con 0x7f39540cc630 2023-08-09T12:46:36.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 >> v2:172.21.15.142:3300/0 conn(0x7f39540adc40 msgr2=0x7f395406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:36.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 --2- 172.21.15.17:0/987471558 >> v2:172.21.15.142:3300/0 conn(0x7f39540adc40 0x7f395406c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 >> v1:172.21.15.142:6789/0 conn(0x7f39540b3b40 legacy=0x7f39540b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395406fe80 con 0x7f39540cc630 2023-08-09T12:46:36.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f394c0019f0 con 0x7f39540cc630 2023-08-09T12:46:36.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 >> v1:172.21.15.17:6789/0 conn(0x7f39540cc630 legacy=0x7f39540ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940003970 0x7f3940003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39400047c0 0x7f3940004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3940005180 0x7f394000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39540ae020 con 0x7f3940005180 2023-08-09T12:46:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394000c120 con 0x7f39400047c0 2023-08-09T12:46:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.757+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394000c2e0 con 0x7f3940003970 2023-08-09T12:46:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.758+0000 7f395a381640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3940005180 0x7f394000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.758+0000 7f395a381640 1 -- 172.21.15.17:0/987471558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940003970 msgr2=0x7f3940003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.758+0000 7f3959b80640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940003970 0x7f3940003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.758+0000 7f395937f640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39400047c0 0x7f3940004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.758+0000 7f395a381640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940003970 0x7f3940003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.758+0000 7f395a381640 1 -- 172.21.15.17:0/987471558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39400047c0 msgr2=0x7f3940004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.758+0000 7f395a381640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39400047c0 0x7f3940004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.758+0000 7f395a381640 1 -- 172.21.15.17:0/987471558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940003520 con 0x7f3940005180 2023-08-09T12:46:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.759+0000 7f395a381640 1 -- 172.21.15.17:0/987471558 reap_dead start 2023-08-09T12:46:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.759+0000 7f395a381640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3940005180 0x7f394000b980 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f394c00a830 tx=0x7f39400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3983fd2daab67798 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.759+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c0072d0 con 0x7f3940005180 2023-08-09T12:46:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.759+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c02f070 con 0x7f3940005180 2023-08-09T12:46:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.759+0000 7f3958b7e640 1 -- 172.21.15.17:0/987471558 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c0076b0 con 0x7f3940005180 2023-08-09T12:46:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.760+0000 7f395bde4640 1 -- 172.21.15.17:0/987471558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3940005180 msgr2=0x7f394000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.760+0000 7f395bde4640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3940005180 0x7f394000b980 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f394c00a830 tx=0x7f39400057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.760+0000 7f395bde4640 1 -- 172.21.15.17:0/987471558 shutdown_connections 2023-08-09T12:46:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.760+0000 7f395bde4640 1 --2- 172.21.15.17:0/987471558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3940005180 0x7f394000b980 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.760+0000 7f395bde4640 1 -- 172.21.15.17:0/987471558 >> 172.21.15.17:0/987471558 conn(0x7f39540cb1b0 msgr2=0x7f39540cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.760+0000 7f395bde4640 1 -- 172.21.15.17:0/987471558 shutdown_connections 2023-08-09T12:46:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.760+0000 7f395bde4640 1 -- 172.21.15.17:0/987471558 wait complete. 2023-08-09T12:46:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.762+0000 7f395bde4640 1 Processor -- start 2023-08-09T12:46:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.762+0000 7f395bde4640 1 -- start start 2023-08-09T12:46:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.763+0000 7f395bde4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940005180 0x7f39541f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.763+0000 7f395bde4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39540c3700 0x7f39540c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.763+0000 7f395bde4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39540c7830 0x7f39540c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.763+0000 7f395bde4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39540c7cb0 con 0x7f39540c7830 2023-08-09T12:46:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.763+0000 7f395bde4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39540c3f50 con 0x7f39540c3700 2023-08-09T12:46:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.763+0000 7f395bde4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39540c58a0 con 0x7f3940005180 2023-08-09T12:46:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395a381640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39540c7830 0x7f39540c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395a381640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39540c7830 0x7f39540c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58014/0 (socket says 172.21.15.17:58014) 2023-08-09T12:46:36.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395a381640 1 -- 172.21.15.17:0/2640998582 learned_addr learned my addr 172.21.15.17:0/2640998582 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:36.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f3959b80640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940005180 0x7f39541f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395937f640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39540c3700 0x7f39540c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395a381640 1 -- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940005180 msgr2=0x7f39541f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395a381640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940005180 0x7f39541f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395a381640 1 -- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39540c3700 msgr2=0x7f39540c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:36.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395a381640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39540c3700 0x7f39540c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:36.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395a381640 1 -- 172.21.15.17:0/2640998582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540c5b80 con 0x7f39540c7830 2023-08-09T12:46:36.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.764+0000 7f395937f640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39540c3700 0x7f39540c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:46:36.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.765+0000 7f395a381640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39540c7830 0x7f39540c2970 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f394c001580 tx=0x7f394c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:36.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.765+0000 7f394a7fc640 1 -- 172.21.15.17:0/2640998582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c004e20 con 0x7f39540c7830 2023-08-09T12:46:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.765+0000 7f394a7fc640 1 -- 172.21.15.17:0/2640998582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c001730 con 0x7f39540c7830 2023-08-09T12:46:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.765+0000 7f394a7fc640 1 -- 172.21.15.17:0/2640998582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c001aa0 con 0x7f39540c7830 2023-08-09T12:46:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.765+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39540c5e60 con 0x7f39540c7830 2023-08-09T12:46:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.765+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39540c3b80 con 0x7f39540c7830 2023-08-09T12:46:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.767+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39540664b0 con 0x7f39540c7830 2023-08-09T12:46:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.767+0000 7f394a7fc640 1 -- 172.21.15.17:0/2640998582 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f394c031030 con 0x7f39540c7830 2023-08-09T12:46:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.768+0000 7f394a7fc640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f393806a050 0x7f393806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.768+0000 7f394a7fc640 1 -- 172.21.15.17:0/2640998582 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f394c0aa290 con 0x7f39540c7830 2023-08-09T12:46:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.769+0000 7f3959b80640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f393806a050 0x7f393806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.770+0000 7f3959b80640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f393806a050 0x7f393806c510 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3950009a10 tx=0x7f3950008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:36.773+0000 7f394a7fc640 1 -- 172.21.15.17:0/2640998582 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f394c0758f0 con 0x7f39540c7830 2023-08-09T12:46:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.006+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3954070410 con 0x7f39540c7830 2023-08-09T12:46:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.007+0000 7f394a7fc640 1 -- 172.21.15.17:0/2640998582 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f394c007400 con 0x7f39540c7830 2023-08-09T12:46:37.010 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:37.010 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:46:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:46:37.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.009+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f393806a050 msgr2=0x7f393806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f393806a050 0x7f393806c510 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3950009a10 tx=0x7f3950008040 comp rx=0 tx=0).stop 2023-08-09T12:46:37.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39540c7830 msgr2=0x7f39540c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39540c7830 0x7f39540c2970 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f394c001580 tx=0x7f394c001d80 comp rx=0 tx=0).stop 2023-08-09T12:46:37.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 shutdown_connections 2023-08-09T12:46:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f393806a050 0x7f393806c510 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39540c7830 0x7f39540c2970 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39540c3700 0x7f39540c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 --2- 172.21.15.17:0/2640998582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3940005180 0x7f39541f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 >> 172.21.15.17:0/2640998582 conn(0x7f39540cb1b0 msgr2=0x7f39540697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 shutdown_connections 2023-08-09T12:46:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.010+0000 7f395bde4640 1 -- 172.21.15.17:0/2640998582 wait complete. 2023-08-09T12:46:37.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:46:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.242+0000 7f32130cd640 1 Processor -- start 2023-08-09T12:46:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.242+0000 7f32130cd640 1 -- start start 2023-08-09T12:46:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.244+0000 7f32130cd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f320c1587e0 0x7f320c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.244+0000 7f32130cd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320c15beb0 con 0x7f320c0b0b10 2023-08-09T12:46:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.244+0000 7f32130cd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320c0715c0 con 0x7f320c0cb070 2023-08-09T12:46:37.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.244+0000 7f32130cd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320c0718a0 con 0x7f320c1587e0 2023-08-09T12:46:37.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.244+0000 7f32118ca640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f320c0b0b10 0x7f320c15b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49024/0 (socket says 172.21.15.17:49024) 2023-08-09T12:46:37.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.244+0000 7f32118ca640 1 -- 172.21.15.17:0/3219600928 learned_addr learned my addr 172.21.15.17:0/3219600928 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:37.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32120cb640 1 --2- 172.21.15.17:0/3219600928 >> v2:172.21.15.142:3300/0 conn(0x7f320c1587e0 0x7f320c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511982257 0 0) 0x7f320c15beb0 con 0x7f320c0b0b10 2023-08-09T12:46:37.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f8003520 con 0x7f320c0b0b10 2023-08-09T12:46:37.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984138348 0 0) 0x7f31f8003520 con 0x7f320c0b0b10 2023-08-09T12:46:37.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 >> v2:172.21.15.142:3300/0 conn(0x7f320c1587e0 msgr2=0x7f320c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:37.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 --2- 172.21.15.17:0/3219600928 >> v2:172.21.15.142:3300/0 conn(0x7f320c1587e0 0x7f320c070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 >> v1:172.21.15.142:6789/0 conn(0x7f320c0cb070 legacy=0x7f320c15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c071b80 con 0x7f320c0b0b10 2023-08-09T12:46:37.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f31fc001670 con 0x7f320c0b0b10 2023-08-09T12:46:37.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 >> v1:172.21.15.17:6789/0 conn(0x7f320c0b0b10 legacy=0x7f320c15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f8003970 0x7f31f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f80047c0 0x7f31f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.245+0000 7f32110c9640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f8005180 0x7f31f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c0718a0 con 0x7f31f8003970 2023-08-09T12:46:37.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f800c0d0 con 0x7f31f80047c0 2023-08-09T12:46:37.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f800c290 con 0x7f31f8005180 2023-08-09T12:46:37.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32120cb640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f8003970 0x7f31f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32118ca640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f80047c0 0x7f31f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32128cc640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f8005180 0x7f31f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32120cb640 1 -- 172.21.15.17:0/3219600928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f8005180 msgr2=0x7f31f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:37.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32120cb640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31f8005180 0x7f31f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32120cb640 1 -- 172.21.15.17:0/3219600928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f80047c0 msgr2=0x7f31f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:37.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32120cb640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f80047c0 0x7f31f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32120cb640 1 -- 172.21.15.17:0/3219600928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8003520 con 0x7f31f8003970 2023-08-09T12:46:37.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.246+0000 7f32128cc640 1 -- 172.21.15.17:0/3219600928 reap_dead start 2023-08-09T12:46:37.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.248+0000 7f32120cb640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f8003970 0x7f31f8003d90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f3208007360 tx=0x7f31f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b650a799fc6650 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:37.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.248+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320802ccd0 con 0x7f31f8003970 2023-08-09T12:46:37.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.248+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320802ce30 con 0x7f31f8003970 2023-08-09T12:46:37.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.248+0000 7f32110c9640 1 -- 172.21.15.17:0/3219600928 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3208034660 con 0x7f31f8003970 2023-08-09T12:46:37.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.248+0000 7f32130cd640 1 -- 172.21.15.17:0/3219600928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f8003970 msgr2=0x7f31f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.248+0000 7f32130cd640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f8003970 0x7f31f8003d90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f3208007360 tx=0x7f31f80057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.249+0000 7f32130cd640 1 -- 172.21.15.17:0/3219600928 shutdown_connections 2023-08-09T12:46:37.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.249+0000 7f32130cd640 1 --2- 172.21.15.17:0/3219600928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f8003970 0x7f31f8003d90 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.249+0000 7f32130cd640 1 -- 172.21.15.17:0/3219600928 >> 172.21.15.17:0/3219600928 conn(0x7f320c0b1d50 msgr2=0x7f320c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:37.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.249+0000 7f32130cd640 1 -- 172.21.15.17:0/3219600928 shutdown_connections 2023-08-09T12:46:37.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.249+0000 7f32130cd640 1 -- 172.21.15.17:0/3219600928 wait complete. 2023-08-09T12:46:37.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.251+0000 7f32130cd640 1 Processor -- start 2023-08-09T12:46:37.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.251+0000 7f32130cd640 1 -- start start 2023-08-09T12:46:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32130cd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f8003970 0x7f320c1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32130cd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f320c1f3650 0x7f320c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32130cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f320c159c30 0x7f320c15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32130cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c1f22b0 con 0x7f320c159c30 2023-08-09T12:46:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32130cd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c15a5f0 con 0x7f31f8003970 2023-08-09T12:46:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32130cd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320c0ca560 con 0x7f320c1f3650 2023-08-09T12:46:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32128cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f320c159c30 0x7f320c15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32128cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f320c159c30 0x7f320c15a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58040/0 (socket says 172.21.15.17:58040) 2023-08-09T12:46:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.252+0000 7f32128cc640 1 -- 172.21.15.17:0/1964264360 learned_addr learned my addr 172.21.15.17:0/1964264360 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32118ca640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f320c1f3650 0x7f320c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32120cb640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f8003970 0x7f320c1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32128cc640 1 -- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f320c1f3650 msgr2=0x7f320c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32128cc640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f320c1f3650 0x7f320c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32128cc640 1 -- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f8003970 msgr2=0x7f320c1f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32128cc640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f8003970 0x7f320c1f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32128cc640 1 -- 172.21.15.17:0/1964264360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c1f3ad0 con 0x7f320c159c30 2023-08-09T12:46:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32120cb640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f8003970 0x7f320c1f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:46:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.253+0000 7f32128cc640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f320c159c30 0x7f320c15a0b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f320c06bc80 tx=0x7f320400e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.254+0000 7f3202ffd640 1 -- 172.21.15.17:0/1964264360 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040052e0 con 0x7f320c159c30 2023-08-09T12:46:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.254+0000 7f3202ffd640 1 -- 172.21.15.17:0/1964264360 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204005440 con 0x7f320c159c30 2023-08-09T12:46:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.254+0000 7f3202ffd640 1 -- 172.21.15.17:0/1964264360 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204003830 con 0x7f320c159c30 2023-08-09T12:46:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.254+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c0cabd0 con 0x7f320c159c30 2023-08-09T12:46:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.254+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c0c9470 con 0x7f320c159c30 2023-08-09T12:46:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.255+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320c1f23f0 con 0x7f320c159c30 2023-08-09T12:46:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.256+0000 7f3202ffd640 1 -- 172.21.15.17:0/1964264360 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3204003990 con 0x7f320c159c30 2023-08-09T12:46:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.257+0000 7f3202ffd640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f31f006a050 0x7f31f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.257+0000 7f3202ffd640 1 -- 172.21.15.17:0/1964264360 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f3204087c90 con 0x7f320c159c30 2023-08-09T12:46:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.258+0000 7f32120cb640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f31f006a050 0x7f31f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.259+0000 7f32120cb640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f31f006a050 0x7f31f006c510 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3208036000 tx=0x7f3208030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.261+0000 7f3202ffd640 1 -- 172.21.15.17:0/1964264360 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f320c1f23f0 con 0x7f320c159c30 2023-08-09T12:46:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.495+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f320c1f23f0 con 0x7f320c159c30 2023-08-09T12:46:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.496+0000 7f3202ffd640 1 -- 172.21.15.17:0/1964264360 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f320c1f23f0 con 0x7f320c159c30 2023-08-09T12:46:37.499 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:37.499 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:45:42.662961+0000","modified":"2023-08-09T12:45:46.216706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7029},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7029":{"gid":7029,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/734281214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":734281214},{"type":"v1","addr":"172.21.15.142:6837","nonce":734281214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-09T12:46:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-08-09T12:46:37.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f31f006a050 msgr2=0x7f31f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f31f006a050 0x7f31f006c510 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3208036000 tx=0x7f3208030000 comp rx=0 tx=0).stop 2023-08-09T12:46:37.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f320c159c30 msgr2=0x7f320c15a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f320c159c30 0x7f320c15a0b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f320c06bc80 tx=0x7f320400e8a0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 shutdown_connections 2023-08-09T12:46:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f31f006a050 0x7f31f006c510 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f320c159c30 0x7f320c15a0b0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f320c1f3650 0x7f320c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 --2- 172.21.15.17:0/1964264360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31f8003970 0x7f320c1f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 >> 172.21.15.17:0/1964264360 conn(0x7f320c0b1d50 msgr2=0x7f320c0b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 shutdown_connections 2023-08-09T12:46:37.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.499+0000 7f32130cd640 1 -- 172.21.15.17:0/1964264360 wait complete. 2023-08-09T12:46:37.523 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.747+0000 7f1201648640 1 Processor -- start 2023-08-09T12:46:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.747+0000 7f1201648640 1 -- start start 2023-08-09T12:46:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.748+0000 7f1201648640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc1616e0 0x7f11fc0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.748+0000 7f1201648640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11fc0d29d0 0x7f11fc0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f1201648640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0cdd10 con 0x7f11fc15ce90 2023-08-09T12:46:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f1201648640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0b6540 con 0x7f11fc0d29d0 2023-08-09T12:46:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f1201648640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0d33a0 con 0x7f11fc1616e0 2023-08-09T12:46:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f11fb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11fc0d29d0 0x7f11fc0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f11fb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11fc0d29d0 0x7f11fc0d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58056/0 (socket says 172.21.15.17:58056) 2023-08-09T12:46:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f11fb7fe640 1 -- 172.21.15.17:0/3593778017 learned_addr learned my addr 172.21.15.17:0/3593778017 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f11fa7fc640 1 --2- 172.21.15.17:0/3593778017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc1616e0 0x7f11fc0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f11fb7fe640 1 -- 172.21.15.17:0/3593778017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc1616e0 msgr2=0x7f11fc0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.749+0000 7f11fb7fe640 1 --2- 172.21.15.17:0/3593778017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc1616e0 0x7f11fc0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.750+0000 7f11fb7fe640 1 -- 172.21.15.17:0/3593778017 >> v1:172.21.15.142:6789/0 conn(0x7f11fc15ce90 legacy=0x7f11fc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.750+0000 7f11fb7fe640 1 -- 172.21.15.17:0/3593778017 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0cdff0 con 0x7f11fc0d29d0 2023-08-09T12:46:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.751+0000 7f11fb7fe640 1 --2- 172.21.15.17:0/3593778017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc0d2e60 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009870 tx=0x7f11f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0637d0925e8207 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.751+0000 7f11f9ffb640 1 -- 172.21.15.17:0/3593778017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4030840 con 0x7f11fc0d29d0 2023-08-09T12:46:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.751+0000 7f11f9ffb640 1 -- 172.21.15.17:0/3593778017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f40309a0 con 0x7f11fc0d29d0 2023-08-09T12:46:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.751+0000 7f11f9ffb640 1 -- 172.21.15.17:0/3593778017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4030d30 con 0x7f11fc0d29d0 2023-08-09T12:46:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.752+0000 7f1201648640 1 -- 172.21.15.17:0/3593778017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 msgr2=0x7f11fc0d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.752+0000 7f1201648640 1 --2- 172.21.15.17:0/3593778017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc0d2e60 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009870 tx=0x7f11f402b980 comp rx=0 tx=0).stop 2023-08-09T12:46:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.752+0000 7f1201648640 1 -- 172.21.15.17:0/3593778017 shutdown_connections 2023-08-09T12:46:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.752+0000 7f1201648640 1 --2- 172.21.15.17:0/3593778017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc0d2e60 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.752+0000 7f1201648640 1 --2- 172.21.15.17:0/3593778017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc1616e0 0x7f11fc0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.752+0000 7f1201648640 1 -- 172.21.15.17:0/3593778017 >> 172.21.15.17:0/3593778017 conn(0x7f11fc06fde0 msgr2=0x7f11fc0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.752+0000 7f1201648640 1 -- 172.21.15.17:0/3593778017 shutdown_connections 2023-08-09T12:46:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.752+0000 7f1201648640 1 -- 172.21.15.17:0/3593778017 wait complete. 2023-08-09T12:46:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.754+0000 7f1201648640 1 Processor -- start 2023-08-09T12:46:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.754+0000 7f1201648640 1 -- start start 2023-08-09T12:46:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f1201648640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc1f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f1201648640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc15ce90 0x7f11fc15fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f1201648640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11fc1616e0 0x7f11fc1f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f1201648640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0a9700 con 0x7f11fc0d29d0 2023-08-09T12:46:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f1201648640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc1601c0 con 0x7f11fc1616e0 2023-08-09T12:46:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f1201648640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0aae00 con 0x7f11fc15ce90 2023-08-09T12:46:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11faffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc1f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11faffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc1f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58060/0 (socket says 172.21.15.17:58060) 2023-08-09T12:46:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11faffd640 1 -- 172.21.15.17:0/2987948634 learned_addr learned my addr 172.21.15.17:0/2987948634 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11faffd640 1 -- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc15ce90 msgr2=0x7f11fc15fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11fa7fc640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc15ce90 0x7f11fc15fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11faffd640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc15ce90 0x7f11fc15fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11fb7fe640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11fc1616e0 0x7f11fc1f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11faffd640 1 -- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11fc1616e0 msgr2=0x7f11fc1f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.755+0000 7f11faffd640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11fc1616e0 0x7f11fc1f38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.756+0000 7f11faffd640 1 -- 172.21.15.17:0/2987948634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f40094d0 con 0x7f11fc0d29d0 2023-08-09T12:46:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.756+0000 7f11faffd640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc1f2670 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00c8a0 tx=0x7f11ec00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.756+0000 7f11e37fe640 1 -- 172.21.15.17:0/2987948634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec003b70 con 0x7f11fc0d29d0 2023-08-09T12:46:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.756+0000 7f11e37fe640 1 -- 172.21.15.17:0/2987948634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec003cf0 con 0x7f11fc0d29d0 2023-08-09T12:46:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.756+0000 7f11e37fe640 1 -- 172.21.15.17:0/2987948634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec00aa90 con 0x7f11fc0d29d0 2023-08-09T12:46:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.756+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc1f3df0 con 0x7f11fc0d29d0 2023-08-09T12:46:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.756+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc1f3000 con 0x7f11fc0d29d0 2023-08-09T12:46:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.757+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc067a80 con 0x7f11fc0d29d0 2023-08-09T12:46:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.758+0000 7f11e37fe640 1 -- 172.21.15.17:0/2987948634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f11ec00abf0 con 0x7f11fc0d29d0 2023-08-09T12:46:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.760+0000 7f11e37fe640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f11e806a050 0x7f11e806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.760+0000 7f11e37fe640 1 -- 172.21.15.17:0/2987948634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f11ec088420 con 0x7f11fc0d29d0 2023-08-09T12:46:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.760+0000 7f11fa7fc640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f11e806a050 0x7f11e806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.761+0000 7f11fa7fc640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f11e806a050 0x7f11e806c510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f11f0006fd0 tx=0x7f11f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:37.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.763+0000 7f11e37fe640 1 -- 172.21.15.17:0/2987948634 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f11ec053b20 con 0x7f11fc0d29d0 2023-08-09T12:46:37.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.961+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11fc0d0ad0 con 0x7f11fc0d29d0 2023-08-09T12:46:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.964+0000 7f11e37fe640 1 -- 172.21.15.17:0/2987948634 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f11ec003e60 con 0x7f11fc0d29d0 2023-08-09T12:46:37.967 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:37.968 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":118,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:18.920294+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:45:41.039914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-09T12:45:41.697620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:37.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f11e806a050 msgr2=0x7f11e806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f11e806a050 0x7f11e806c510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f11f0006fd0 tx=0x7f11f0008040 comp rx=0 tx=0).stop 2023-08-09T12:46:37.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 msgr2=0x7f11fc1f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:37.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc1f2670 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00c8a0 tx=0x7f11ec00cd60 comp rx=0 tx=0).stop 2023-08-09T12:46:37.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 shutdown_connections 2023-08-09T12:46:37.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f11e806a050 0x7f11e806c510 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11fc1616e0 0x7f11fc1f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11fc15ce90 0x7f11fc15fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 --2- 172.21.15.17:0/2987948634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11fc0d29d0 0x7f11fc1f2670 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:37.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 >> 172.21.15.17:0/2987948634 conn(0x7f11fc06fde0 msgr2=0x7f11fc0b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:37.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 shutdown_connections 2023-08-09T12:46:37.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:37.967+0000 7f1201648640 1 -- 172.21.15.17:0/2987948634 wait complete. 2023-08-09T12:46:37.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:46:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.195+0000 7f8873271640 1 Processor -- start 2023-08-09T12:46:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.196+0000 7f8873271640 1 -- start start 2023-08-09T12:46:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.197+0000 7f8873271640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 0x7f886c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.197+0000 7f8873271640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f886c0acdf0 0x7f886c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.197+0000 7f8873271640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c15df30 con 0x7f886c161280 2023-08-09T12:46:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.197+0000 7f8873271640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c0ad2a0 con 0x7f886c0acdf0 2023-08-09T12:46:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.197+0000 7f8873271640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c15d430 con 0x7f886c161660 2023-08-09T12:46:38.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f887100d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f886c161280 0x7f886c0c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55374/0 (socket says 172.21.15.17:55374) 2023-08-09T12:46:38.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f887100d640 1 -- 172.21.15.17:0/314893246 learned_addr learned my addr 172.21.15.17:0/314893246 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:38.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f887180e640 1 --2- 172.21.15.17:0/314893246 >> v2:172.21.15.17:3300/0 conn(0x7f886c0acdf0 0x7f886c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f887080c640 1 --2- 172.21.15.17:0/314893246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 0x7f886c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f8863fff640 1 -- 172.21.15.17:0/314893246 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768933941 0 0) 0x7f886c15df30 con 0x7f886c161280 2023-08-09T12:46:38.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f8863fff640 1 -- 172.21.15.17:0/314893246 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8858003520 con 0x7f886c161280 2023-08-09T12:46:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f887180e640 1 -- 172.21.15.17:0/314893246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 msgr2=0x7f886c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f887180e640 1 --2- 172.21.15.17:0/314893246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 0x7f886c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f887180e640 1 -- 172.21.15.17:0/314893246 >> v1:172.21.15.17:6789/0 conn(0x7f886c161280 legacy=0x7f886c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.198+0000 7f887180e640 1 -- 172.21.15.17:0/314893246 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c0ca9d0 con 0x7f886c0acdf0 2023-08-09T12:46:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.199+0000 7f887180e640 1 --2- 172.21.15.17:0/314893246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c0acdf0 0x7f886c0cc630 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f88640097a0 tx=0x7f886402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad433f297ee237b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8863fff640 1 -- 172.21.15.17:0/314893246 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864031780 con 0x7f886c0acdf0 2023-08-09T12:46:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8863fff640 1 -- 172.21.15.17:0/314893246 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88640318e0 con 0x7f886c0acdf0 2023-08-09T12:46:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8863fff640 1 -- 172.21.15.17:0/314893246 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864031c50 con 0x7f886c0acdf0 2023-08-09T12:46:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8873271640 1 -- 172.21.15.17:0/314893246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c0acdf0 msgr2=0x7f886c0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8873271640 1 --2- 172.21.15.17:0/314893246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c0acdf0 0x7f886c0cc630 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f88640097a0 tx=0x7f886402b820 comp rx=0 tx=0).stop 2023-08-09T12:46:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8873271640 1 -- 172.21.15.17:0/314893246 shutdown_connections 2023-08-09T12:46:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8873271640 1 --2- 172.21.15.17:0/314893246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c0acdf0 0x7f886c0cc630 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8873271640 1 --2- 172.21.15.17:0/314893246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 0x7f886c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.200+0000 7f8873271640 1 -- 172.21.15.17:0/314893246 >> 172.21.15.17:0/314893246 conn(0x7f886c0cb1b0 msgr2=0x7f886c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.201+0000 7f8873271640 1 -- 172.21.15.17:0/314893246 shutdown_connections 2023-08-09T12:46:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.201+0000 7f8873271640 1 -- 172.21.15.17:0/314893246 wait complete. 2023-08-09T12:46:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.202+0000 7f8873271640 1 Processor -- start 2023-08-09T12:46:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.203+0000 7f8873271640 1 -- start start 2023-08-09T12:46:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f8873271640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0acdf0 0x7f886c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f8873271640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c161280 0x7f886c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f8873271640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 0x7f886c0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f8873271640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0c31e0 con 0x7f886c161280 2023-08-09T12:46:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f8873271640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c1f34c0 con 0x7f886c0acdf0 2023-08-09T12:46:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f8873271640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c1f2940 con 0x7f886c161660 2023-08-09T12:46:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f887080c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c161280 0x7f886c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f887080c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c161280 0x7f886c152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45094/0 (socket says 172.21.15.17:45094) 2023-08-09T12:46:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f887080c640 1 -- 172.21.15.17:0/2195577296 learned_addr learned my addr 172.21.15.17:0/2195577296 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:38.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f887100d640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0acdf0 0x7f886c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.204+0000 7f887180e640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 0x7f886c0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f887080c640 1 -- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 msgr2=0x7f886c0b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f887080c640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 0x7f886c0b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f887080c640 1 -- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0acdf0 msgr2=0x7f886c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f887080c640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0acdf0 0x7f886c0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f887080c640 1 -- 172.21.15.17:0/2195577296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864009400 con 0x7f886c161280 2023-08-09T12:46:38.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f887080c640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c161280 0x7f886c152fa0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f885c00d800 tx=0x7f885c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:38.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f8861ffb640 1 -- 172.21.15.17:0/2195577296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c018070 con 0x7f886c161280 2023-08-09T12:46:38.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f8861ffb640 1 -- 172.21.15.17:0/2195577296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c004020 con 0x7f886c161280 2023-08-09T12:46:38.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f8861ffb640 1 -- 172.21.15.17:0/2195577296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0041d0 con 0x7f886c161280 2023-08-09T12:46:38.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c1f2c20 con 0x7f886c161280 2023-08-09T12:46:38.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.205+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c1f31e0 con 0x7f886c161280 2023-08-09T12:46:38.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.207+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c067a80 con 0x7f886c161280 2023-08-09T12:46:38.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.207+0000 7f8861ffb640 1 -- 172.21.15.17:0/2195577296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f885c004330 con 0x7f886c161280 2023-08-09T12:46:38.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.209+0000 7f8861ffb640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.209+0000 7f8861ffb640 1 -- 172.21.15.17:0/2195577296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f885c088280 con 0x7f886c161280 2023-08-09T12:46:38.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.210+0000 7f887100d640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.211+0000 7f887100d640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8868005c00 tx=0x7f8868009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:38.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.214+0000 7f8861ffb640 1 -- 172.21.15.17:0/2195577296 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f885c057370 con 0x7f886c161280 2023-08-09T12:46:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.445+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f886c15dbb0 con 0x7f886c161280 2023-08-09T12:46:38.450 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:46:38.447+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:46:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.459+0000 7f8861ffb640 1 -- 172.21.15.17:0/2195577296 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f885c056f00 con 0x7f886c161280 2023-08-09T12:46:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:46:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.462+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 msgr2=0x7f885006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.462+0000 7f8873271640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8868005c00 tx=0x7f8868009040 comp rx=0 tx=0).stop 2023-08-09T12:46:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.462+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c161280 msgr2=0x7f886c152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.462+0000 7f8873271640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c161280 0x7f886c152fa0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f885c00d800 tx=0x7f885c00dcc0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.463+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 shutdown_connections 2023-08-09T12:46:38.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.463+0000 7f8873271640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.463+0000 7f8873271640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c161660 0x7f886c0b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.463+0000 7f8873271640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f886c161280 0x7f886c152fa0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.463+0000 7f8873271640 1 --2- 172.21.15.17:0/2195577296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0acdf0 0x7f886c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.463+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 >> 172.21.15.17:0/2195577296 conn(0x7f886c0cb1b0 msgr2=0x7f886c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.463+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 shutdown_connections 2023-08-09T12:46:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.463+0000 7f8873271640 1 -- 172.21.15.17:0/2195577296 wait complete. 2023-08-09T12:46:38.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:46:38.590 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:46:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.718+0000 7fbfecbb2640 1 Processor -- start 2023-08-09T12:46:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.718+0000 7fbfecbb2640 1 -- start start 2023-08-09T12:46:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.719+0000 7fbfecbb2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe815cb40 0x7fbfe81609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.719+0000 7fbfecbb2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfe80b8420 0x7fbfe80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.719+0000 7fbfecbb2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbfe815cf20 0x7fbfe80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.719+0000 7fbfecbb2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe80d0f00 con 0x7fbfe80b8420 2023-08-09T12:46:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.719+0000 7fbfecbb2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe81611f0 con 0x7fbfe815cf20 2023-08-09T12:46:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.719+0000 7fbfecbb2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81614d0 con 0x7fbfe815cb40 2023-08-09T12:46:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfdffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfe80b8420 0x7fbfe80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfdffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfe80b8420 0x7fbfe80cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45098/0 (socket says 172.21.15.17:45098) 2023-08-09T12:46:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfdffff640 1 -- 172.21.15.17:0/402040835 learned_addr learned my addr 172.21.15.17:0/402040835 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/402040835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe815cb40 0x7fbfe81609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfe7fff640 1 --2- 172.21.15.17:0/402040835 >> v2:172.21.15.142:3300/0 conn(0x7fbfe815cf20 0x7fbfe80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfdffff640 1 -- 172.21.15.17:0/402040835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe815cb40 msgr2=0x7fbfe81609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfdffff640 1 --2- 172.21.15.17:0/402040835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe815cb40 0x7fbfe81609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfdffff640 1 -- 172.21.15.17:0/402040835 >> v2:172.21.15.142:3300/0 conn(0x7fbfe815cf20 msgr2=0x7fbfe80cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfdffff640 1 --2- 172.21.15.17:0/402040835 >> v2:172.21.15.142:3300/0 conn(0x7fbfe815cf20 0x7fbfe80cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.720+0000 7fbfdffff640 1 -- 172.21.15.17:0/402040835 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe81617b0 con 0x7fbfe80b8420 2023-08-09T12:46:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.722+0000 7fbfdffff640 1 --2- 172.21.15.17:0/402040835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe80b8420 0x7fbfe80cd860 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80b88b0 tx=0x7fbfd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388c6e5935106fad server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.722+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/402040835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0030860 con 0x7fbfe80b8420 2023-08-09T12:46:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.722+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/402040835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd00309c0 con 0x7fbfe80b8420 2023-08-09T12:46:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.722+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/402040835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0030d50 con 0x7fbfe80b8420 2023-08-09T12:46:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 -- 172.21.15.17:0/402040835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe80b8420 msgr2=0x7fbfe80cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/402040835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe80b8420 0x7fbfe80cd860 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80b88b0 tx=0x7fbfd002b9a0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 -- 172.21.15.17:0/402040835 shutdown_connections 2023-08-09T12:46:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/402040835 >> v2:172.21.15.142:3300/0 conn(0x7fbfe815cf20 0x7fbfe80cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/402040835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe80b8420 0x7fbfe80cd860 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/402040835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe815cb40 0x7fbfe81609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 -- 172.21.15.17:0/402040835 >> 172.21.15.17:0/402040835 conn(0x7fbfe80d2ab0 msgr2=0x7fbfe80d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 -- 172.21.15.17:0/402040835 shutdown_connections 2023-08-09T12:46:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.723+0000 7fbfecbb2640 1 -- 172.21.15.17:0/402040835 wait complete. 2023-08-09T12:46:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.725+0000 7fbfecbb2640 1 Processor -- start 2023-08-09T12:46:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.725+0000 7fbfecbb2640 1 -- start start 2023-08-09T12:46:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfecbb2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe80b8420 0x7fbfe815fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfecbb2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe815cb40 0x7fbfe81f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfecbb2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe815cf20 0x7fbfe8156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfecbb2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe815ef50 con 0x7fbfe815cf20 2023-08-09T12:46:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfecbb2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe815e3d0 con 0x7fbfe815cb40 2023-08-09T12:46:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfecbb2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe815e6b0 con 0x7fbfe80b8420 2023-08-09T12:46:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfe7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe815cf20 0x7fbfe8156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfe7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe815cf20 0x7fbfe8156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45114/0 (socket says 172.21.15.17:45114) 2023-08-09T12:46:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfe7fff640 1 -- 172.21.15.17:0/2334874542 learned_addr learned my addr 172.21.15.17:0/2334874542 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.726+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe80b8420 0x7fbfe815fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfdffff640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe815cb40 0x7fbfe81f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe7fff640 1 -- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe80b8420 msgr2=0x7fbfe815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe7fff640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe80b8420 0x7fbfe815fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe7fff640 1 -- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe815cb40 msgr2=0x7fbfe81f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe7fff640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe815cb40 0x7fbfe81f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe7fff640 1 -- 172.21.15.17:0/2334874542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd00094d0 con 0x7fbfe815cf20 2023-08-09T12:46:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe7fff640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe815cf20 0x7fbfe8156be0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007e60 tx=0x7fbfe000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe4ff9640 1 -- 172.21.15.17:0/2334874542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0014420 con 0x7fbfe815cf20 2023-08-09T12:46:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe4ff9640 1 -- 172.21.15.17:0/2334874542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe00145a0 con 0x7fbfe815cf20 2023-08-09T12:46:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfe4ff9640 1 -- 172.21.15.17:0/2334874542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0014950 con 0x7fbfe815cf20 2023-08-09T12:46:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.727+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe815e990 con 0x7fbfe815cf20 2023-08-09T12:46:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.728+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe8160300 con 0x7fbfe815cf20 2023-08-09T12:46:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.728+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe8160490 con 0x7fbfe815cf20 2023-08-09T12:46:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.730+0000 7fbfe4ff9640 1 -- 172.21.15.17:0/2334874542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbfe0014ab0 con 0x7fbfe815cf20 2023-08-09T12:46:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.730+0000 7fbfe4ff9640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc806a050 0x7fbfc806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.731+0000 7fbfe4ff9640 1 -- 172.21.15.17:0/2334874542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fbfe0089060 con 0x7fbfe815cf20 2023-08-09T12:46:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.731+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc806a050 0x7fbfc806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:38.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.732+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc806a050 0x7fbfc806c510 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8006fd0 tx=0x7fbfd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.735+0000 7fbfe4ff9640 1 -- 172.21.15.17:0/2334874542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbfe00bb7b0 con 0x7fbfe815cf20 2023-08-09T12:46:38.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:38.966+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbfe804e390 con 0x7fbfe815cf20 2023-08-09T12:46:39.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.458+0000 7fbfe4ff9640 1 -- 172.21.15.17:0/2334874542 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbfe0058070 con 0x7fbfe815cf20 2023-08-09T12:46:39.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc806a050 msgr2=0x7fbfc806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:39.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc806a050 0x7fbfc806c510 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8006fd0 tx=0x7fbfd8008040 comp rx=0 tx=0).stop 2023-08-09T12:46:39.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe815cf20 msgr2=0x7fbfe8156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:39.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe815cf20 0x7fbfe8156be0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007e60 tx=0x7fbfe000e4b0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 shutdown_connections 2023-08-09T12:46:39.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc806a050 0x7fbfc806c510 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe815cf20 0x7fbfe8156be0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe815cb40 0x7fbfe81f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 --2- 172.21.15.17:0/2334874542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe80b8420 0x7fbfe815fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 >> 172.21.15.17:0/2334874542 conn(0x7fbfe80d2ab0 msgr2=0x7fbfe80d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:39.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 shutdown_connections 2023-08-09T12:46:39.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.462+0000 7fbfecbb2640 1 -- 172.21.15.17:0/2334874542 wait complete. 2023-08-09T12:46:39.488 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:46:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.726+0000 7f381b59e640 1 Processor -- start 2023-08-09T12:46:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.726+0000 7f381b59e640 1 -- start start 2023-08-09T12:46:39.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381b59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f381c0b3dd0 0x7f381c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:39.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b41b0 0x7f381c15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:39.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381b59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c0b18b0 con 0x7f381c15f0e0 2023-08-09T12:46:39.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381b59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c0b1b10 con 0x7f381c0b3dd0 2023-08-09T12:46:39.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b1df0 con 0x7f381c0b41b0 2023-08-09T12:46:39.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381a59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f381c0b3dd0 0x7f381c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:39.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381a59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f381c0b3dd0 0x7f381c0b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45118/0 (socket says 172.21.15.17:45118) 2023-08-09T12:46:39.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381a59c640 1 -- 172.21.15.17:0/595359161 learned_addr learned my addr 172.21.15.17:0/595359161 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:39.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.728+0000 7f381ad9d640 1 --1- 172.21.15.17:0/595359161 >> v1:172.21.15.17:6789/0 conn(0x7f381c15f0e0 0x7f381c0affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55386/0 (socket says 172.21.15.17:55386) 2023-08-09T12:46:39.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.729+0000 7f3819d9b640 1 --2- 172.21.15.17:0/595359161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b41b0 0x7f381c15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:39.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.729+0000 7f381a59c640 1 -- 172.21.15.17:0/595359161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b41b0 msgr2=0x7f381c15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:39.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.729+0000 7f381a59c640 1 --2- 172.21.15.17:0/595359161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b41b0 0x7f381c15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.729+0000 7f381a59c640 1 -- 172.21.15.17:0/595359161 >> v1:172.21.15.17:6789/0 conn(0x7f381c15f0e0 legacy=0x7f381c0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:39.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.729+0000 7f381a59c640 1 -- 172.21.15.17:0/595359161 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0b20d0 con 0x7f381c0b3dd0 2023-08-09T12:46:39.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.730+0000 7f381a59c640 1 --2- 172.21.15.17:0/595359161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b3dd0 0x7f381c0b1370 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f380c009870 tx=0x7f380c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e693ea04578ad27 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:39.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.730+0000 7f381959a640 1 -- 172.21.15.17:0/595359161 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c030840 con 0x7f381c0b3dd0 2023-08-09T12:46:39.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.730+0000 7f381959a640 1 -- 172.21.15.17:0/595359161 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c0309a0 con 0x7f381c0b3dd0 2023-08-09T12:46:39.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.730+0000 7f381959a640 1 -- 172.21.15.17:0/595359161 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c030d30 con 0x7f381c0b3dd0 2023-08-09T12:46:39.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.731+0000 7f381b59e640 1 -- 172.21.15.17:0/595359161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b3dd0 msgr2=0x7f381c0b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:39.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.731+0000 7f381b59e640 1 --2- 172.21.15.17:0/595359161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b3dd0 0x7f381c0b1370 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f380c009870 tx=0x7f380c02b980 comp rx=0 tx=0).stop 2023-08-09T12:46:39.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.731+0000 7f381b59e640 1 -- 172.21.15.17:0/595359161 shutdown_connections 2023-08-09T12:46:39.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.731+0000 7f381b59e640 1 --2- 172.21.15.17:0/595359161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b41b0 0x7f381c15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.731+0000 7f381b59e640 1 --2- 172.21.15.17:0/595359161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b3dd0 0x7f381c0b1370 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.731+0000 7f381b59e640 1 -- 172.21.15.17:0/595359161 >> 172.21.15.17:0/595359161 conn(0x7f381c0cafa0 msgr2=0x7f381c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:39.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.731+0000 7f381b59e640 1 -- 172.21.15.17:0/595359161 shutdown_connections 2023-08-09T12:46:39.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.731+0000 7f381b59e640 1 -- 172.21.15.17:0/595359161 wait complete. 2023-08-09T12:46:39.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.733+0000 7f381b59e640 1 Processor -- start 2023-08-09T12:46:39.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.733+0000 7f381b59e640 1 -- start start 2023-08-09T12:46:39.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f381b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b3dd0 0x7f381c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:39.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f381b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b41b0 0x7f381c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f381b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15f0e0 0x7f381c0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f381b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c1511a0 con 0x7f381c0b41b0 2023-08-09T12:46:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f381b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0715b0 con 0x7f381c15f0e0 2023-08-09T12:46:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f381b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0add90 con 0x7f381c0b3dd0 2023-08-09T12:46:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f3819d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b41b0 0x7f381c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f3819d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b41b0 0x7f381c070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45120/0 (socket says 172.21.15.17:45120) 2023-08-09T12:46:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.734+0000 7f3819d9b640 1 -- 172.21.15.17:0/1961864487 learned_addr learned my addr 172.21.15.17:0/1961864487 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:39.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f381a59c640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b3dd0 0x7f381c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:39.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f3819d9b640 1 -- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b3dd0 msgr2=0x7f381c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:39.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f3819d9b640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b3dd0 0x7f381c150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f3819d9b640 1 -- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15f0e0 msgr2=0x7f381c0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:39.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f381ad9d640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15f0e0 0x7f381c0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:39.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f3819d9b640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15f0e0 0x7f381c0c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:39.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f3819d9b640 1 -- 172.21.15.17:0/1961864487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0094d0 con 0x7f381c0b41b0 2023-08-09T12:46:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f381a59c640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b3dd0 0x7f381c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f3819d9b640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b41b0 0x7f381c070c90 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f381000d800 tx=0x7f381000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.735+0000 7f380affd640 1 -- 172.21.15.17:0/1961864487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000b6c0 con 0x7f381c0b41b0 2023-08-09T12:46:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.736+0000 7f380affd640 1 -- 172.21.15.17:0/1961864487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381000b820 con 0x7f381c0b41b0 2023-08-09T12:46:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.736+0000 7f380affd640 1 -- 172.21.15.17:0/1961864487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000bbb0 con 0x7f381c0b41b0 2023-08-09T12:46:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.736+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c0ae070 con 0x7f381c0b41b0 2023-08-09T12:46:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.736+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c0ae630 con 0x7f381c0b41b0 2023-08-09T12:46:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.737+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c0ae7f0 con 0x7f381c0b41b0 2023-08-09T12:46:39.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.738+0000 7f380affd640 1 -- 172.21.15.17:0/1961864487 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f381000bd10 con 0x7f381c0b41b0 2023-08-09T12:46:39.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.739+0000 7f380affd640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f37fc06a050 0x7f37fc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:39.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.739+0000 7f380affd640 1 -- 172.21.15.17:0/1961864487 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f3810088c90 con 0x7f381c0b41b0 2023-08-09T12:46:39.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.740+0000 7f381a59c640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f37fc06a050 0x7f37fc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:39.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.741+0000 7f381a59c640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f37fc06a050 0x7f37fc06c510 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f380c036000 tx=0x7f380c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:39.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.743+0000 7f380affd640 1 -- 172.21.15.17:0/1961864487 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3810054210 con 0x7f381c0b41b0 2023-08-09T12:46:39.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:39.942+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f381c04e390 con 0x7f381c0b41b0 2023-08-09T12:46:40.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.811+0000 7f380affd640 1 -- 172.21.15.17:0/1961864487 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3810057830 con 0x7f381c0b41b0 2023-08-09T12:46:40.815 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:46:40.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f37fc06a050 msgr2=0x7f37fc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:40.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f37fc06a050 0x7f37fc06c510 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f380c036000 tx=0x7f380c03b040 comp rx=0 tx=0).stop 2023-08-09T12:46:40.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b41b0 msgr2=0x7f381c070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:40.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b41b0 0x7f381c070c90 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f381000d800 tx=0x7f381000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:46:40.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 shutdown_connections 2023-08-09T12:46:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f37fc06a050 0x7f37fc06c510 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15f0e0 0x7f381c0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0b41b0 0x7f381c070c90 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 --2- 172.21.15.17:0/1961864487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0b3dd0 0x7f381c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 >> 172.21.15.17:0/1961864487 conn(0x7f381c0cafa0 msgr2=0x7f381c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.815+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 shutdown_connections 2023-08-09T12:46:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:40.816+0000 7f381b59e640 1 -- 172.21.15.17:0/1961864487 wait complete. 2023-08-09T12:46:40.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:46:41.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:46:41.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:46:41.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.075+0000 7f4781371640 1 Processor -- start 2023-08-09T12:46:41.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.075+0000 7f4781371640 1 -- start start 2023-08-09T12:46:41.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.077+0000 7f4781371640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c160e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:41.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.077+0000 7f4781371640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f477c1613a0 0x7f477c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:41.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.077+0000 7f4781371640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c15b1b0 con 0x7f477c15add0 2023-08-09T12:46:41.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.077+0000 7f4781371640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0cd6e0 con 0x7f477c1613a0 2023-08-09T12:46:41.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.077+0000 7f4781371640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0cd9c0 con 0x7f477c0704f0 2023-08-09T12:46:41.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.077+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:41.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.077+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:38718/0 (socket says 172.21.15.17:38718) 2023-08-09T12:46:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.077+0000 7f477a7fc640 1 -- 172.21.15.17:0/1748625113 learned_addr learned my addr 172.21.15.17:0/1748625113 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.078+0000 7f477b7fe640 1 --2- 172.21.15.17:0/1748625113 >> v2:172.21.15.142:3300/0 conn(0x7f477c1613a0 0x7f477c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.078+0000 7f4779ffb640 1 -- 172.21.15.17:0/1748625113 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163066224 0 0) 0x7f477c15b1b0 con 0x7f477c15add0 2023-08-09T12:46:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.078+0000 7f4779ffb640 1 -- 172.21.15.17:0/1748625113 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4764003520 con 0x7f477c15add0 2023-08-09T12:46:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.078+0000 7f477b7fe640 1 -- 172.21.15.17:0/1748625113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 msgr2=0x7f477c160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.078+0000 7f477b7fe640 1 --2- 172.21.15.17:0/1748625113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.078+0000 7f477b7fe640 1 -- 172.21.15.17:0/1748625113 >> v1:172.21.15.142:6789/0 conn(0x7f477c15add0 legacy=0x7f477c06fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:41.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.078+0000 7f477b7fe640 1 -- 172.21.15.17:0/1748625113 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0cdca0 con 0x7f477c1613a0 2023-08-09T12:46:41.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.080+0000 7f477b7fe640 1 --2- 172.21.15.17:0/1748625113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 0x7f477c0d1110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4774009d90 tx=0x7f477402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14aab5e4546cd867 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:41.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.080+0000 7f4779ffb640 1 -- 172.21.15.17:0/1748625113 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477402cc50 con 0x7f477c1613a0 2023-08-09T12:46:41.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.081+0000 7f4779ffb640 1 -- 172.21.15.17:0/1748625113 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477402cdb0 con 0x7f477c1613a0 2023-08-09T12:46:41.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.081+0000 7f4779ffb640 1 -- 172.21.15.17:0/1748625113 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774034660 con 0x7f477c1613a0 2023-08-09T12:46:41.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.081+0000 7f4781371640 1 -- 172.21.15.17:0/1748625113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 msgr2=0x7f477c0d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:41.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.081+0000 7f4781371640 1 --2- 172.21.15.17:0/1748625113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 0x7f477c0d1110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4774009d90 tx=0x7f477402bea0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.081+0000 7f4781371640 1 -- 172.21.15.17:0/1748625113 shutdown_connections 2023-08-09T12:46:41.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.081+0000 7f4781371640 1 --2- 172.21.15.17:0/1748625113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.081+0000 7f4781371640 1 --2- 172.21.15.17:0/1748625113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 0x7f477c0d1110 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.081+0000 7f4781371640 1 -- 172.21.15.17:0/1748625113 >> 172.21.15.17:0/1748625113 conn(0x7f477c0d2b50 msgr2=0x7f477c0d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:41.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.082+0000 7f4781371640 1 -- 172.21.15.17:0/1748625113 shutdown_connections 2023-08-09T12:46:41.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.082+0000 7f4781371640 1 -- 172.21.15.17:0/1748625113 wait complete. 2023-08-09T12:46:41.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.083+0000 7f4781371640 1 Processor -- start 2023-08-09T12:46:41.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.084+0000 7f4781371640 1 -- start start 2023-08-09T12:46:41.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f4781371640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:41.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f4781371640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477c15add0 0x7f477c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:41.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f4781371640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 0x7f477c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:41.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f4781371640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b51e0 con 0x7f477c15add0 2023-08-09T12:46:41.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f4781371640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1f6d70 con 0x7f477c1613a0 2023-08-09T12:46:41.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f4781371640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1f7050 con 0x7f477c0704f0 2023-08-09T12:46:41.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477c15add0 0x7f477c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:41.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477c15add0 0x7f477c0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45126/0 (socket says 172.21.15.17:45126) 2023-08-09T12:46:41.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477a7fc640 1 -- 172.21.15.17:0/1325972657 learned_addr learned my addr 172.21.15.17:0/1325972657 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:41.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477b7fe640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 0x7f477c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:41.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477affd640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:41.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477a7fc640 1 -- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 msgr2=0x7f477c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:41.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477a7fc640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477a7fc640 1 -- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 msgr2=0x7f477c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:41.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477a7fc640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 0x7f477c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.085+0000 7f477a7fc640 1 -- 172.21.15.17:0/1325972657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774009a70 con 0x7f477c15add0 2023-08-09T12:46:41.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.086+0000 7f477a7fc640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477c15add0 0x7f477c0c9b90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f4770009fd0 tx=0x7f477000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:41.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.086+0000 7f47637fe640 1 -- 172.21.15.17:0/1325972657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000c940 con 0x7f477c15add0 2023-08-09T12:46:41.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.086+0000 7f47637fe640 1 -- 172.21.15.17:0/1325972657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000caa0 con 0x7f477c15add0 2023-08-09T12:46:41.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.086+0000 7f47637fe640 1 -- 172.21.15.17:0/1325972657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000ce30 con 0x7f477c15add0 2023-08-09T12:46:41.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.086+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c1f7330 con 0x7f477c15add0 2023-08-09T12:46:41.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.086+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c1f78f0 con 0x7f477c15add0 2023-08-09T12:46:41.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.088+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c067a80 con 0x7f477c15add0 2023-08-09T12:46:41.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.089+0000 7f47637fe640 1 -- 172.21.15.17:0/1325972657 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4770013470 con 0x7f477c15add0 2023-08-09T12:46:41.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.091+0000 7f47637fe640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f476806a050 0x7f476806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:41.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.091+0000 7f47637fe640 1 -- 172.21.15.17:0/1325972657 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5826+0+0 (secure 0 0 0) 0x7f47700886f0 con 0x7f477c15add0 2023-08-09T12:46:41.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.091+0000 7f477affd640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f476806a050 0x7f476806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:41.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.092+0000 7f477affd640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f476806a050 0x7f476806c510 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f476c0011e0 tx=0x7f476c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:41.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.095+0000 7f47637fe640 1 -- 172.21.15.17:0/1325972657 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4770053ed0 con 0x7f477c15add0 2023-08-09T12:46:41.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.292+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f477c0d0cc0 con 0x7f477c15add0 2023-08-09T12:46:41.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.987+0000 7f47637fe640 1 -- 172.21.15.17:0/1325972657 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) v1 ==== 169+0+0 (secure 0 0 0) 0x7f47700574f0 con 0x7f477c15add0 2023-08-09T12:46:41.992 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f476806a050 msgr2=0x7f476806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f476806a050 0x7f476806c510 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f476c0011e0 tx=0x7f476c009040 comp rx=0 tx=0).stop 2023-08-09T12:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477c15add0 msgr2=0x7f477c0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477c15add0 0x7f477c0c9b90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f4770009fd0 tx=0x7f477000ed40 comp rx=0 tx=0).stop 2023-08-09T12:46:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 shutdown_connections 2023-08-09T12:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f476806a050 0x7f476806c510 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f477c1613a0 0x7f477c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477c15add0 0x7f477c0c9b90 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 --2- 172.21.15.17:0/1325972657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f477c0704f0 0x7f477c159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 >> 172.21.15.17:0/1325972657 conn(0x7f477c0d2b50 msgr2=0x7f477c1605f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.994+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 shutdown_connections 2023-08-09T12:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:41.995+0000 7f4781371640 1 -- 172.21.15.17:0/1325972657 wait complete. 2023-08-09T12:46:42.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:46:42.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.251+0000 7f69bb2ec640 1 Processor -- start 2023-08-09T12:46:42.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.252+0000 7f69bb2ec640 1 -- start start 2023-08-09T12:46:42.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69bb2ec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69b4162650 0x7f69b4165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69bb2ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 0x7f69b4165870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69bb2ec640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b40cd520 con 0x7f69b4164f50 2023-08-09T12:46:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69bb2ec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b40cc630 con 0x7f69b4162650 2023-08-09T12:46:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69bb2ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40cc910 con 0x7f69b40c1980 2023-08-09T12:46:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69b8887640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69b4162650 0x7f69b4165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69b9088640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f69b4164f50 0x7f69b40cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55400/0 (socket says 172.21.15.17:55400) 2023-08-09T12:46:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69b9088640 1 -- 172.21.15.17:0/47595660 learned_addr learned my addr 172.21.15.17:0/47595660 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:42.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.253+0000 7f69b8887640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69b4162650 0x7f69b4165330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45130/0 (socket says 172.21.15.17:45130) 2023-08-09T12:46:42.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.254+0000 7f69b8887640 1 -- 172.21.15.17:0/47595660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 msgr2=0x7f69b4165870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:42.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.254+0000 7f69b8887640 1 --2- 172.21.15.17:0/47595660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 0x7f69b4165870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.254+0000 7f69b8887640 1 -- 172.21.15.17:0/47595660 >> v1:172.21.15.17:6789/0 conn(0x7f69b4164f50 legacy=0x7f69b40cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.254+0000 7f69b8887640 1 -- 172.21.15.17:0/47595660 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40ccbf0 con 0x7f69b4162650 2023-08-09T12:46:42.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.254+0000 7f69abfff640 1 -- 172.21.15.17:0/47595660 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558560838 0 0) 0x7f69b40cd520 con 0x7f69b4164f50 2023-08-09T12:46:42.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.255+0000 7f69b8887640 1 --2- 172.21.15.17:0/47595660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4162650 0x7f69b4165330 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009790 tx=0x7f69a402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227cd01f5694aca2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:42.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.255+0000 7f69abfff640 1 -- 172.21.15.17:0/47595660 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a402d040 con 0x7f69b4162650 2023-08-09T12:46:42.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.255+0000 7f69abfff640 1 -- 172.21.15.17:0/47595660 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a4031810 con 0x7f69b4162650 2023-08-09T12:46:42.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.255+0000 7f69abfff640 1 -- 172.21.15.17:0/47595660 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4031ba0 con 0x7f69b4162650 2023-08-09T12:46:42.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.256+0000 7f69bb2ec640 1 -- 172.21.15.17:0/47595660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4162650 msgr2=0x7f69b4165330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.256+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/47595660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4162650 0x7f69b4165330 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009790 tx=0x7f69a402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.256+0000 7f69bb2ec640 1 -- 172.21.15.17:0/47595660 shutdown_connections 2023-08-09T12:46:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.256+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/47595660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 0x7f69b4165870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.256+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/47595660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4162650 0x7f69b4165330 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.256+0000 7f69bb2ec640 1 -- 172.21.15.17:0/47595660 >> 172.21.15.17:0/47595660 conn(0x7f69b40cb1b0 msgr2=0x7f69b40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.256+0000 7f69bb2ec640 1 -- 172.21.15.17:0/47595660 shutdown_connections 2023-08-09T12:46:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.256+0000 7f69bb2ec640 1 -- 172.21.15.17:0/47595660 wait complete. 2023-08-09T12:46:42.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.258+0000 7f69bb2ec640 1 Processor -- start 2023-08-09T12:46:42.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.258+0000 7f69bb2ec640 1 -- start start 2023-08-09T12:46:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.259+0000 7f69bb2ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 0x7f69b415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.259+0000 7f69bb2ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4162650 0x7f69b40c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.259+0000 7f69bb2ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4164f50 0x7f69b40c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.259+0000 7f69bb2ec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40c3b10 con 0x7f69b4164f50 2023-08-09T12:46:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.259+0000 7f69bb2ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40c2f00 con 0x7f69b4162650 2023-08-09T12:46:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.259+0000 7f69bb2ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40c31e0 con 0x7f69b40c1980 2023-08-09T12:46:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4164f50 0x7f69b40c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4164f50 0x7f69b40c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45132/0 (socket says 172.21.15.17:45132) 2023-08-09T12:46:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 -- 172.21.15.17:0/2692471910 learned_addr learned my addr 172.21.15.17:0/2692471910 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 -- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 msgr2=0x7f69b415fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9088640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 0x7f69b415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b8887640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4162650 0x7f69b40c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 0x7f69b415fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 -- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4162650 msgr2=0x7f69b40c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4162650 0x7f69b40c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 -- 172.21.15.17:0/2692471910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40093a0 con 0x7f69b4164f50 2023-08-09T12:46:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b8887640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4162650 0x7f69b40c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.260+0000 7f69b9889640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4164f50 0x7f69b40c48d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00b970 tx=0x7f69ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.261+0000 7f69a9ffb640 1 -- 172.21.15.17:0/2692471910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00cb40 con 0x7f69b4164f50 2023-08-09T12:46:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.261+0000 7f69a9ffb640 1 -- 172.21.15.17:0/2692471910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac00ccc0 con 0x7f69b4164f50 2023-08-09T12:46:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.261+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b40c34c0 con 0x7f69b4164f50 2023-08-09T12:46:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.261+0000 7f69a9ffb640 1 -- 172.21.15.17:0/2692471910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac014680 con 0x7f69b4164f50 2023-08-09T12:46:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.261+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b4160320 con 0x7f69b4164f50 2023-08-09T12:46:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.262+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b40c3c80 con 0x7f69b4164f50 2023-08-09T12:46:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.263+0000 7f69a9ffb640 1 -- 172.21.15.17:0/2692471910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f69ac01d3b0 con 0x7f69b4164f50 2023-08-09T12:46:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.264+0000 7f69a9ffb640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f699806a050 0x7f699806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.264+0000 7f69a9ffb640 1 -- 172.21.15.17:0/2692471910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f69ac0882d0 con 0x7f69b4164f50 2023-08-09T12:46:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.265+0000 7f69b9088640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f699806a050 0x7f699806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.266+0000 7f69b9088640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f699806a050 0x7f699806c510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f69b0007fd0 tx=0x7f69b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:42.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.268+0000 7f69a9ffb640 1 -- 172.21.15.17:0/2692471910 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f69ac053c40 con 0x7f69b4164f50 2023-08-09T12:46:42.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.462+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f69b4067a80 con 0x7f69b4164f50 2023-08-09T12:46:42.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.469+0000 7f69a9ffb640 1 -- 172.21.15.17:0/2692471910 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f69ac057260 con 0x7f69b4164f50 2023-08-09T12:46:42.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f699806a050 msgr2=0x7f699806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f699806a050 0x7f699806c510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f69b0007fd0 tx=0x7f69b0009040 comp rx=0 tx=0).stop 2023-08-09T12:46:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4164f50 msgr2=0x7f69b40c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4164f50 0x7f69b40c48d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00b970 tx=0x7f69ac00be30 comp rx=0 tx=0).stop 2023-08-09T12:46:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 shutdown_connections 2023-08-09T12:46:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f699806a050 0x7f699806c510 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69b4164f50 0x7f69b40c48d0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b4162650 0x7f69b40c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 --2- 172.21.15.17:0/2692471910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b40c1980 0x7f69b415fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 >> 172.21.15.17:0/2692471910 conn(0x7f69b40cb1b0 msgr2=0x7f69b40c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 shutdown_connections 2023-08-09T12:46:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.471+0000 7f69bb2ec640 1 -- 172.21.15.17:0/2692471910 wait complete. 2023-08-09T12:46:42.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-08-09T12:46:42.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.719+0000 7ff87de58640 1 Processor -- start 2023-08-09T12:46:42.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.719+0000 7ff87de58640 1 -- start start 2023-08-09T12:46:42.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff87de58640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8780cd980 0x7ff8780b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff87de58640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87815d0f0 con 0x7ff87806acd0 2023-08-09T12:46:42.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff87de58640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff878069c30 con 0x7ff87815cd10 2023-08-09T12:46:42.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff87de58640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff878069f10 con 0x7ff8780cd980 2023-08-09T12:46:42.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff877fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff87806acd0 0x7ff8780cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55414/0 (socket says 172.21.15.17:55414) 2023-08-09T12:46:42.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff877fff640 1 -- 172.21.15.17:0/516653843 learned_addr learned my addr 172.21.15.17:0/516653843 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:42.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283589913 0 0) 0x7ff87815d0f0 con 0x7ff87806acd0 2023-08-09T12:46:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff860003520 con 0x7ff87806acd0 2023-08-09T12:46:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.721+0000 7ff87d657640 1 --2- 172.21.15.17:0/516653843 >> v2:172.21.15.142:3300/0 conn(0x7ff8780cd980 0x7ff8780b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 52487934 0 0) 0x7ff860003520 con 0x7ff87806acd0 2023-08-09T12:46:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 >> v2:172.21.15.142:3300/0 conn(0x7ff8780cd980 msgr2=0x7ff8780b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 --2- 172.21.15.17:0/516653843 >> v2:172.21.15.142:3300/0 conn(0x7ff8780cd980 0x7ff8780b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 >> v1:172.21.15.142:6789/0 conn(0x7ff87815cd10 legacy=0x7ff8780b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87806a1f0 con 0x7ff87806acd0 2023-08-09T12:46:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff86c0019f0 con 0x7ff87806acd0 2023-08-09T12:46:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 >> v1:172.21.15.17:6789/0 conn(0x7ff87806acd0 legacy=0x7ff8780cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff860003970 0x7ff860003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff860005180 0x7ff86000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff878069f10 con 0x7ff8600047c0 2023-08-09T12:46:42.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86000c090 con 0x7ff860005180 2023-08-09T12:46:42.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86000c250 con 0x7ff860003970 2023-08-09T12:46:42.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.722+0000 7ff877fff640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff87ce56640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff860003970 0x7ff860003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff877fff640 1 -- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff860003970 msgr2=0x7ff860003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:42.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff87d657640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff860005180 0x7ff86000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff877fff640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff860003970 0x7ff860003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff877fff640 1 -- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff860005180 msgr2=0x7ff86000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff877fff640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff860005180 0x7ff86000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff877fff640 1 -- 172.21.15.17:0/516653843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860003520 con 0x7ff8600047c0 2023-08-09T12:46:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff87ce56640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff860003970 0x7ff860003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff87d657640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff860005180 0x7ff86000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.723+0000 7ff87d657640 1 -- 172.21.15.17:0/516653843 reap_dead start 2023-08-09T12:46:42.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.724+0000 7ff877fff640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff860004c40 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00a830 tx=0x7ff8600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a018fb770fe946cf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:42.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.724+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c02cea0 con 0x7ff8600047c0 2023-08-09T12:46:42.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.724+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c02f070 con 0x7ff8600047c0 2023-08-09T12:46:42.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.724+0000 7ff8777fe640 1 -- 172.21.15.17:0/516653843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0348d0 con 0x7ff8600047c0 2023-08-09T12:46:42.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.725+0000 7ff87de58640 1 -- 172.21.15.17:0/516653843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 msgr2=0x7ff860004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.725+0000 7ff87de58640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff860004c40 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00a830 tx=0x7ff8600057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.725+0000 7ff87de58640 1 -- 172.21.15.17:0/516653843 shutdown_connections 2023-08-09T12:46:42.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.725+0000 7ff87de58640 1 --2- 172.21.15.17:0/516653843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff860004c40 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.725+0000 7ff87de58640 1 -- 172.21.15.17:0/516653843 >> 172.21.15.17:0/516653843 conn(0x7ff8780d2a10 msgr2=0x7ff8780d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:42.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.725+0000 7ff87de58640 1 -- 172.21.15.17:0/516653843 shutdown_connections 2023-08-09T12:46:42.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.725+0000 7ff87de58640 1 -- 172.21.15.17:0/516653843 wait complete. 2023-08-09T12:46:42.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.727+0000 7ff87de58640 1 Processor -- start 2023-08-09T12:46:42.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.727+0000 7ff87de58640 1 -- start start 2023-08-09T12:46:42.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.728+0000 7ff87de58640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff8780c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.728+0000 7ff87de58640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff878158830 0x7ff8781f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.728+0000 7ff87de58640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8781f5d10 0x7ff8781f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.728+0000 7ff87de58640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780cc010 con 0x7ff8600047c0 2023-08-09T12:46:42.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.728+0000 7ff87de58640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780ca150 con 0x7ff8781f5d10 2023-08-09T12:46:42.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.728+0000 7ff87de58640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780ca430 con 0x7ff878158830 2023-08-09T12:46:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.728+0000 7ff87ce56640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff8780c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87ce56640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff8780c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45138/0 (socket says 172.21.15.17:45138) 2023-08-09T12:46:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87ce56640 1 -- 172.21.15.17:0/4229866727 learned_addr learned my addr 172.21.15.17:0/4229866727 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff877fff640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff878158830 0x7ff8781f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87d657640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8781f5d10 0x7ff8781f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87ce56640 1 -- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff878158830 msgr2=0x7ff8781f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87ce56640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff878158830 0x7ff8781f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87ce56640 1 -- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8781f5d10 msgr2=0x7ff8781f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87ce56640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8781f5d10 0x7ff8781f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87ce56640 1 -- 172.21.15.17:0/4229866727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8780ca710 con 0x7ff8600047c0 2023-08-09T12:46:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87d657640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8781f5d10 0x7ff8781f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:42.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.729+0000 7ff87ce56640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff8780c9ae0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff86800d430 tx=0x7ff86800d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:42.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.730+0000 7ff8757fa640 1 -- 172.21.15.17:0/4229866727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868007020 con 0x7ff8600047c0 2023-08-09T12:46:42.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.730+0000 7ff8757fa640 1 -- 172.21.15.17:0/4229866727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868007180 con 0x7ff8600047c0 2023-08-09T12:46:42.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.730+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8780ca9f0 con 0x7ff8600047c0 2023-08-09T12:46:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.730+0000 7ff8757fa640 1 -- 172.21.15.17:0/4229866727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868007530 con 0x7ff8600047c0 2023-08-09T12:46:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.730+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8780cb1f0 con 0x7ff8600047c0 2023-08-09T12:46:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.731+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87804e390 con 0x7ff8600047c0 2023-08-09T12:46:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.732+0000 7ff8757fa640 1 -- 172.21.15.17:0/4229866727 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff8680067d0 con 0x7ff8600047c0 2023-08-09T12:46:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.734+0000 7ff8757fa640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff86406a080 0x7ff86406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.734+0000 7ff8757fa640 1 -- 172.21.15.17:0/4229866727 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff868088050 con 0x7ff8600047c0 2023-08-09T12:46:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.734+0000 7ff877fff640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff86406a080 0x7ff86406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:42.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.736+0000 7ff877fff640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff86406a080 0x7ff86406c540 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:42.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:42.738+0000 7ff8757fa640 1 -- 172.21.15.17:0/4229866727 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff8680ba7b0 con 0x7ff8600047c0 2023-08-09T12:46:43.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.012+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7ff8780d05c0 con 0x7ff8600047c0 2023-08-09T12:46:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.993+0000 7ff8757fa640 1 -- 172.21.15.17:0/4229866727 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v383) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff868053a50 con 0x7ff8600047c0 2023-08-09T12:46:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.997+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff86406a080 msgr2=0x7ff86406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.997+0000 7ff87de58640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff86406a080 0x7ff86406c540 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c02f000 comp rx=0 tx=0).stop 2023-08-09T12:46:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.997+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 msgr2=0x7ff8780c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.997+0000 7ff87de58640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff8780c9ae0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff86800d430 tx=0x7ff86800d8f0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.998+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 shutdown_connections 2023-08-09T12:46:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.998+0000 7ff87de58640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff86406a080 0x7ff86406c540 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.998+0000 7ff87de58640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8781f5d10 0x7ff8781f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.998+0000 7ff87de58640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff878158830 0x7ff8781f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.998+0000 7ff87de58640 1 --2- 172.21.15.17:0/4229866727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8600047c0 0x7ff8780c9ae0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.998+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 >> 172.21.15.17:0/4229866727 conn(0x7ff8780d2a10 msgr2=0x7ff8780b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.998+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 shutdown_connections 2023-08-09T12:46:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:43.998+0000 7ff87de58640 1 -- 172.21.15.17:0/4229866727 wait complete. 2023-08-09T12:46:44.024 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-08-09T12:46:44.025 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-08-09T12:46:44.025 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-08-09T12:46:44.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.248+0000 7f9f15f01640 1 Processor -- start 2023-08-09T12:46:44.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.248+0000 7f9f15f01640 1 -- start start 2023-08-09T12:46:44.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.249+0000 7f9f15f01640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f1015cdc0 0x7f9f100697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:44.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.249+0000 7f9f15f01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1015d1a0 0x7f9f100b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:44.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.249+0000 7f9f15f01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9f10069d00 0x7f9f100b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:44.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.249+0000 7f9f15f01640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f100cfc20 con 0x7f9f10069d00 2023-08-09T12:46:44.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.249+0000 7f9f15f01640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1006ab40 con 0x7f9f1015cdc0 2023-08-09T12:46:44.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.249+0000 7f9f15f01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1006a2a0 con 0x7f9f1015d1a0 2023-08-09T12:46:44.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9f10069d00 0x7f9f100b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:44.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9f10069d00 0x7f9f100b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45154/0 (socket says 172.21.15.17:45154) 2023-08-09T12:46:44.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0ffff640 1 -- 172.21.15.17:0/2164494015 learned_addr learned my addr 172.21.15.17:0/2164494015 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:44.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0f7fe640 1 --2- 172.21.15.17:0/2164494015 >> v2:172.21.15.142:3300/0 conn(0x7f9f1015cdc0 0x7f9f100697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:44.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0effd640 1 --2- 172.21.15.17:0/2164494015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1015d1a0 0x7f9f100b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:44.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0ffff640 1 -- 172.21.15.17:0/2164494015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1015d1a0 msgr2=0x7f9f100b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:44.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0ffff640 1 --2- 172.21.15.17:0/2164494015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1015d1a0 0x7f9f100b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0ffff640 1 -- 172.21.15.17:0/2164494015 >> v2:172.21.15.142:3300/0 conn(0x7f9f1015cdc0 msgr2=0x7f9f100697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:44.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.250+0000 7f9f0ffff640 1 --2- 172.21.15.17:0/2164494015 >> v2:172.21.15.142:3300/0 conn(0x7f9f1015cdc0 0x7f9f100697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.251+0000 7f9f0ffff640 1 -- 172.21.15.17:0/2164494015 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1006a580 con 0x7f9f10069d00 2023-08-09T12:46:44.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.252+0000 7f9f0ffff640 1 --2- 172.21.15.17:0/2164494015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f10069d00 0x7f9f100b2990 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f9f100d19a0 tx=0x7f9f0802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b68f1227fc4a92 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:44.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.252+0000 7f9f0e7fc640 1 -- 172.21.15.17:0/2164494015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f080317e0 con 0x7f9f10069d00 2023-08-09T12:46:44.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.252+0000 7f9f0e7fc640 1 -- 172.21.15.17:0/2164494015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08031940 con 0x7f9f10069d00 2023-08-09T12:46:44.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.252+0000 7f9f0e7fc640 1 -- 172.21.15.17:0/2164494015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08031cd0 con 0x7f9f10069d00 2023-08-09T12:46:44.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 -- 172.21.15.17:0/2164494015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f10069d00 msgr2=0x7f9f100b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:44.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2164494015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f10069d00 0x7f9f100b2990 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f9f100d19a0 tx=0x7f9f0802b880 comp rx=0 tx=0).stop 2023-08-09T12:46:44.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 -- 172.21.15.17:0/2164494015 shutdown_connections 2023-08-09T12:46:44.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2164494015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f10069d00 0x7f9f100b2990 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2164494015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1015d1a0 0x7f9f100b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2164494015 >> v2:172.21.15.142:3300/0 conn(0x7f9f1015cdc0 0x7f9f100697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 -- 172.21.15.17:0/2164494015 >> 172.21.15.17:0/2164494015 conn(0x7f9f1006cf40 msgr2=0x7f9f1006d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:44.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 -- 172.21.15.17:0/2164494015 shutdown_connections 2023-08-09T12:46:44.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.253+0000 7f9f15f01640 1 -- 172.21.15.17:0/2164494015 wait complete. 2023-08-09T12:46:44.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.255+0000 7f9f15f01640 1 Processor -- start 2023-08-09T12:46:44.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.255+0000 7f9f15f01640 1 -- start start 2023-08-09T12:46:44.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f15f01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f10069d00 0x7f9f100c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:44.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f15f01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1015cdc0 0x7f9f100b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f15f01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1015d1a0 0x7f9f100b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f15f01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100b35f0 con 0x7f9f1015cdc0 2023-08-09T12:46:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f15f01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100ac8b0 con 0x7f9f1015d1a0 2023-08-09T12:46:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f15f01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100b5dc0 con 0x7f9f10069d00 2023-08-09T12:46:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1015cdc0 0x7f9f100b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1015cdc0 0x7f9f100b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45170/0 (socket says 172.21.15.17:45170) 2023-08-09T12:46:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f0effd640 1 -- 172.21.15.17:0/2808872204 learned_addr learned my addr 172.21.15.17:0/2808872204 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.256+0000 7f9f0f7fe640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f10069d00 0x7f9f100c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f0ffff640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1015d1a0 0x7f9f100b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f0effd640 1 -- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f10069d00 msgr2=0x7f9f100c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f0effd640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f10069d00 0x7f9f100c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f0effd640 1 -- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1015d1a0 msgr2=0x7f9f100b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f0effd640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1015d1a0 0x7f9f100b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f0effd640 1 -- 172.21.15.17:0/2808872204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f080094d0 con 0x7f9f1015cdc0 2023-08-09T12:46:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f0ffff640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1015d1a0 0x7f9f100b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f0effd640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1015cdc0 0x7f9f100b30b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9f04007e70 tx=0x7f9f0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9ef7fff640 1 -- 172.21.15.17:0/2808872204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04014620 con 0x7f9f1015cdc0 2023-08-09T12:46:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9ef7fff640 1 -- 172.21.15.17:0/2808872204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04014780 con 0x7f9f1015cdc0 2023-08-09T12:46:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9ef7fff640 1 -- 172.21.15.17:0/2808872204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04014b30 con 0x7f9f1015cdc0 2023-08-09T12:46:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.257+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f100b60a0 con 0x7f9f1015cdc0 2023-08-09T12:46:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.258+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f100acde0 con 0x7f9f1015cdc0 2023-08-09T12:46:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.259+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f100acfa0 con 0x7f9f1015cdc0 2023-08-09T12:46:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.260+0000 7f9ef7fff640 1 -- 172.21.15.17:0/2808872204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9f04014c90 con 0x7f9f1015cdc0 2023-08-09T12:46:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.260+0000 7f9ef7fff640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9efc06a050 0x7f9efc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.261+0000 7f9ef7fff640 1 -- 172.21.15.17:0/2808872204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9f04088bf0 con 0x7f9f1015cdc0 2023-08-09T12:46:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.261+0000 7f9f0f7fe640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9efc06a050 0x7f9efc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.262+0000 7f9f0f7fe640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9efc06a050 0x7f9efc06c510 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9f00006fd0 tx=0x7f9f00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.265+0000 7f9ef7fff640 1 -- 172.21.15.17:0/2808872204 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9f040545f0 con 0x7f9f1015cdc0 2023-08-09T12:46:44.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:44.535+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f9f100b6290 con 0x7f9f1015cdc0 2023-08-09T12:46:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.003+0000 7f9ef7fff640 1 -- 172.21.15.17:0/2808872204 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v384) v1 ==== 131+0+0 (secure 0 0 0) 0x7f9f04057c10 con 0x7f9f1015cdc0 2023-08-09T12:46:45.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.006+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9efc06a050 msgr2=0x7f9efc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.006+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9efc06a050 0x7f9efc06c510 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9f00006fd0 tx=0x7f9f00008040 comp rx=0 tx=0).stop 2023-08-09T12:46:45.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.006+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1015cdc0 msgr2=0x7f9f100b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.006+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1015cdc0 0x7f9f100b30b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9f04007e70 tx=0x7f9f0400e4b0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.007+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 shutdown_connections 2023-08-09T12:46:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.007+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9efc06a050 0x7f9efc06c510 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.007+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1015d1a0 0x7f9f100b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.007+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1015cdc0 0x7f9f100b30b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.007+0000 7f9f15f01640 1 --2- 172.21.15.17:0/2808872204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f10069d00 0x7f9f100c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.007+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 >> 172.21.15.17:0/2808872204 conn(0x7f9f1006cf40 msgr2=0x7f9f100cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.007+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 shutdown_connections 2023-08-09T12:46:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.007+0000 7f9f15f01640 1 -- 172.21.15.17:0/2808872204 wait complete. 2023-08-09T12:46:45.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.261+0000 7f107bb71640 1 Processor -- start 2023-08-09T12:46:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.262+0000 7f107bb71640 1 -- start start 2023-08-09T12:46:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.263+0000 7f107bb71640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f10740b08e0 0x7f1074165ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.263+0000 7f107bb71640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1074070fa0 con 0x7f107415df70 2023-08-09T12:46:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.263+0000 7f107bb71640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107406ccc0 con 0x7f107415e350 2023-08-09T12:46:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.263+0000 7f107bb71640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107406c180 con 0x7f10740b08e0 2023-08-09T12:46:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107990d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f107415df70 0x7f10740704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55416/0 (socket says 172.21.15.17:55416) 2023-08-09T12:46:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107990d640 1 -- 172.21.15.17:0/1486799915 learned_addr learned my addr 172.21.15.17:0/1486799915 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:45.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318548487 0 0) 0x7f1074070fa0 con 0x7f107415df70 2023-08-09T12:46:45.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1060003520 con 0x7f107415df70 2023-08-09T12:46:45.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107a10e640 1 --2- 172.21.15.17:0/1486799915 >> v2:172.21.15.142:3300/0 conn(0x7f10740b08e0 0x7f1074165ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3482272999 0 0) 0x7f1060003520 con 0x7f107415df70 2023-08-09T12:46:45.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 >> v2:172.21.15.142:3300/0 conn(0x7f10740b08e0 msgr2=0x7f1074165ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:45.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107890b640 1 --2- 172.21.15.17:0/1486799915 >> v2:172.21.15.142:3300/0 conn(0x7f10740b08e0 0x7f1074165ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.264+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 >> v1:172.21.15.142:6789/0 conn(0x7f107415e350 legacy=0x7f10740b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:45.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107406c390 con 0x7f107415df70 2023-08-09T12:46:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1070001670 con 0x7f107415df70 2023-08-09T12:46:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 >> v1:172.21.15.17:6789/0 conn(0x7f107415df70 legacy=0x7f10740704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1060003970 0x7f1060003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f1060004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600052a0 0x7f106000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107406c180 con 0x7f10600047c0 2023-08-09T12:46:45.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106000c1a0 con 0x7f1060003970 2023-08-09T12:46:45.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106000c360 con 0x7f10600052a0 2023-08-09T12:46:45.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107910c640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f1060004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.265+0000 7f107a10e640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600052a0 0x7f106000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.266+0000 7f107990d640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1060003970 0x7f1060003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.266+0000 7f107910c640 1 -- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600052a0 msgr2=0x7f106000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:45.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.266+0000 7f107910c640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10600052a0 0x7f106000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.266+0000 7f107910c640 1 -- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1060003970 msgr2=0x7f1060003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:45.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.266+0000 7f107910c640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1060003970 0x7f1060003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.266+0000 7f107910c640 1 -- 172.21.15.17:0/1486799915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060003520 con 0x7f10600047c0 2023-08-09T12:46:45.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.266+0000 7f107990d640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1060003970 0x7f1060003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:45.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.266+0000 7f107a10e640 1 -- 172.21.15.17:0/1486799915 reap_dead start 2023-08-09T12:46:45.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.267+0000 7f107910c640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f1060004c40 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f107406ec00 tx=0x7f10600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53714f0f1a71deb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:45.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.267+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064032600 con 0x7f10600047c0 2023-08-09T12:46:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.267+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106402e050 con 0x7f10600047c0 2023-08-09T12:46:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.267+0000 7f107890b640 1 -- 172.21.15.17:0/1486799915 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640329c0 con 0x7f10600047c0 2023-08-09T12:46:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.267+0000 7f107bb71640 1 -- 172.21.15.17:0/1486799915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 msgr2=0x7f1060004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.267+0000 7f107bb71640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f1060004c40 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f107406ec00 tx=0x7f10600057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.268+0000 7f107bb71640 1 -- 172.21.15.17:0/1486799915 shutdown_connections 2023-08-09T12:46:45.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.268+0000 7f107bb71640 1 --2- 172.21.15.17:0/1486799915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f1060004c40 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.268+0000 7f107bb71640 1 -- 172.21.15.17:0/1486799915 >> 172.21.15.17:0/1486799915 conn(0x7f10740cb1d0 msgr2=0x7f10740cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:45.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.268+0000 7f107bb71640 1 -- 172.21.15.17:0/1486799915 shutdown_connections 2023-08-09T12:46:45.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.268+0000 7f107bb71640 1 -- 172.21.15.17:0/1486799915 wait complete. 2023-08-09T12:46:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.270+0000 7f107bb71640 1 Processor -- start 2023-08-09T12:46:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.270+0000 7f107bb71640 1 -- start start 2023-08-09T12:46:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107bb71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f10740c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107bb71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10741f20c0 0x7f10740c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107bb71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10741f3080 0x7f10740af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107bb71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740c6670 con 0x7f10600047c0 2023-08-09T12:46:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107bb71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740c6390 con 0x7f10741f20c0 2023-08-09T12:46:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107bb71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10741f25a0 con 0x7f10741f3080 2023-08-09T12:46:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107990d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f10740c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107990d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f10740c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45196/0 (socket says 172.21.15.17:45196) 2023-08-09T12:46:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107990d640 1 -- 172.21.15.17:0/648351881 learned_addr learned my addr 172.21.15.17:0/648351881 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107a10e640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10741f3080 0x7f10740af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107910c640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10741f20c0 0x7f10740c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107990d640 1 -- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10741f3080 msgr2=0x7f10740af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107990d640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10741f3080 0x7f10740af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107990d640 1 -- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10741f20c0 msgr2=0x7f10740c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.271+0000 7f107990d640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10741f20c0 0x7f10740c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.272+0000 7f107990d640 1 -- 172.21.15.17:0/648351881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10741f2880 con 0x7f10600047c0 2023-08-09T12:46:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.272+0000 7f107a10e640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10741f3080 0x7f10740af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.272+0000 7f107990d640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f10740c5820 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f1070000fd0 tx=0x7f107000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.272+0000 7f106a7fc640 1 -- 172.21.15.17:0/648351881 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700072d0 con 0x7f10600047c0 2023-08-09T12:46:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.272+0000 7f106a7fc640 1 -- 172.21.15.17:0/648351881 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1070007430 con 0x7f10600047c0 2023-08-09T12:46:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.272+0000 7f106a7fc640 1 -- 172.21.15.17:0/648351881 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700047e0 con 0x7f10600047c0 2023-08-09T12:46:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.272+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10741f2b60 con 0x7f10600047c0 2023-08-09T12:46:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.272+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10740afce0 con 0x7f10600047c0 2023-08-09T12:46:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.273+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1074067a80 con 0x7f10600047c0 2023-08-09T12:46:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.274+0000 7f106a7fc640 1 -- 172.21.15.17:0/648351881 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1070004940 con 0x7f10600047c0 2023-08-09T12:46:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.276+0000 7f106a7fc640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f105806a080 0x7f105806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.276+0000 7f106a7fc640 1 -- 172.21.15.17:0/648351881 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1070087b00 con 0x7f10600047c0 2023-08-09T12:46:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.277+0000 7f107910c640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f105806a080 0x7f105806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.278+0000 7f107910c640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f105806a080 0x7f105806c540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1064034000 tx=0x7f1064009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.281+0000 7f106a7fc640 1 -- 172.21.15.17:0/648351881 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1070089e60 con 0x7f10600047c0 2023-08-09T12:46:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.475+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10740b23c0 con 0x7f10600047c0 2023-08-09T12:46:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.478+0000 7f106a7fc640 1 -- 172.21.15.17:0/648351881 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+14756 (secure 0 0 0) 0x7f1070019020 con 0x7f10600047c0 2023-08-09T12:46:45.481 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:45.481 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:41.979373+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6837/734281214":"2023-08-10T12:46:38.447621+0000","172.21.15.142:6835/734281214":"2023-08-10T12:46:38.447621+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.480+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f105806a080 msgr2=0x7f105806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.480+0000 7f107bb71640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f105806a080 0x7f105806c540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1064034000 tx=0x7f1064009030 comp rx=0 tx=0).stop 2023-08-09T12:46:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.480+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 msgr2=0x7f10740c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.480+0000 7f107bb71640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f10740c5820 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f1070000fd0 tx=0x7f107000dc00 comp rx=0 tx=0).stop 2023-08-09T12:46:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.481+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 shutdown_connections 2023-08-09T12:46:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.481+0000 7f107bb71640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f105806a080 0x7f105806c540 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.481+0000 7f107bb71640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10741f3080 0x7f10740af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.481+0000 7f107bb71640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10741f20c0 0x7f10740c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.481+0000 7f107bb71640 1 --2- 172.21.15.17:0/648351881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600047c0 0x7f10740c5820 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.481+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 >> 172.21.15.17:0/648351881 conn(0x7f10740cb1d0 msgr2=0x7f10740ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.481+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 shutdown_connections 2023-08-09T12:46:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.481+0000 7f107bb71640 1 -- 172.21.15.17:0/648351881 wait complete. 2023-08-09T12:46:45.505 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:46:45.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:46:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.736+0000 7f4c9955b640 1 Processor -- start 2023-08-09T12:46:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.737+0000 7f4c9955b640 1 -- start start 2023-08-09T12:46:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.738+0000 7f4c9955b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c940d30e0 0x7f4c940b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.738+0000 7f4c9955b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940cdd10 con 0x7f4c9415ce90 2023-08-09T12:46:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.738+0000 7f4c9955b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940cdff0 con 0x7f4c941616e0 2023-08-09T12:46:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.738+0000 7f4c9955b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940b6540 con 0x7f4c940d30e0 2023-08-09T12:46:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.739+0000 7f4c937fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c940d30e0 0x7f4c940b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.739+0000 7f4c937fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c940d30e0 0x7f4c940b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45204/0 (socket says 172.21.15.17:45204) 2023-08-09T12:46:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.739+0000 7f4c92ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4c9415ce90 0x7f4c940cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55420/0 (socket says 172.21.15.17:55420) 2023-08-09T12:46:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.739+0000 7f4c937fe640 1 -- 172.21.15.17:0/789997803 learned_addr learned my addr 172.21.15.17:0/789997803 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.739+0000 7f4c937fe640 1 -- 172.21.15.17:0/789997803 >> v1:172.21.15.142:6789/0 conn(0x7f4c941616e0 legacy=0x7f4c940d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.739+0000 7f4c937fe640 1 -- 172.21.15.17:0/789997803 >> v1:172.21.15.17:6789/0 conn(0x7f4c9415ce90 legacy=0x7f4c940cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.739+0000 7f4c937fe640 1 -- 172.21.15.17:0/789997803 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940ce2d0 con 0x7f4c940d30e0 2023-08-09T12:46:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.739+0000 7f4c91ffb640 1 -- 172.21.15.17:0/789997803 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833043806 0 0) 0x7f4c940cdd10 con 0x7f4c9415ce90 2023-08-09T12:46:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.741+0000 7f4c937fe640 1 --2- 172.21.15.17:0/789997803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940d30e0 0x7f4c940b6000 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009870 tx=0x7f4c8c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbf632bf5128cd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.741+0000 7f4c91ffb640 1 -- 172.21.15.17:0/789997803 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c02f840 con 0x7f4c940d30e0 2023-08-09T12:46:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.741+0000 7f4c91ffb640 1 -- 172.21.15.17:0/789997803 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c02f9a0 con 0x7f4c940d30e0 2023-08-09T12:46:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.741+0000 7f4c91ffb640 1 -- 172.21.15.17:0/789997803 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c02fd30 con 0x7f4c940d30e0 2023-08-09T12:46:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.741+0000 7f4c9955b640 1 -- 172.21.15.17:0/789997803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940d30e0 msgr2=0x7f4c940b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.741+0000 7f4c9955b640 1 --2- 172.21.15.17:0/789997803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940d30e0 0x7f4c940b6000 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009870 tx=0x7f4c8c02ba20 comp rx=0 tx=0).stop 2023-08-09T12:46:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.742+0000 7f4c9955b640 1 -- 172.21.15.17:0/789997803 shutdown_connections 2023-08-09T12:46:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.742+0000 7f4c9955b640 1 --2- 172.21.15.17:0/789997803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940d30e0 0x7f4c940b6000 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.742+0000 7f4c9955b640 1 -- 172.21.15.17:0/789997803 >> 172.21.15.17:0/789997803 conn(0x7f4c9406fde0 msgr2=0x7f4c940701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.742+0000 7f4c9955b640 1 -- 172.21.15.17:0/789997803 shutdown_connections 2023-08-09T12:46:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.742+0000 7f4c9955b640 1 -- 172.21.15.17:0/789997803 wait complete. 2023-08-09T12:46:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.743+0000 7f4c9955b640 1 Processor -- start 2023-08-09T12:46:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.744+0000 7f4c9955b640 1 -- start start 2023-08-09T12:46:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.744+0000 7f4c9955b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c940d30e0 0x7f4c940b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c9955b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c9415ce90 0x7f4c9415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c9955b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c941616e0 0x7f4c94155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c9955b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9415ea30 con 0x7f4c9415ce90 2023-08-09T12:46:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c9955b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9415db80 con 0x7f4c941616e0 2023-08-09T12:46:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c9955b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941548a0 con 0x7f4c940d30e0 2023-08-09T12:46:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c927fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c9415ce90 0x7f4c9415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c927fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c9415ce90 0x7f4c9415d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45208/0 (socket says 172.21.15.17:45208) 2023-08-09T12:46:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c927fc640 1 -- 172.21.15.17:0/4060266407 learned_addr learned my addr 172.21.15.17:0/4060266407 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c92ffd640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c940d30e0 0x7f4c940b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c927fc640 1 -- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c940d30e0 msgr2=0x7f4c940b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c927fc640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c940d30e0 0x7f4c940b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c927fc640 1 -- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c941616e0 msgr2=0x7f4c94155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c937fe640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c941616e0 0x7f4c94155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c927fc640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c941616e0 0x7f4c94155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.745+0000 7f4c927fc640 1 -- 172.21.15.17:0/4060266407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0094d0 con 0x7f4c9415ce90 2023-08-09T12:46:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.746+0000 7f4c927fc640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c9415ce90 0x7f4c9415d640 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800c400 tx=0x7f4c8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.746+0000 7f4c7b7fe640 1 -- 172.21.15.17:0/4060266407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c880052d0 con 0x7f4c9415ce90 2023-08-09T12:46:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.746+0000 7f4c7b7fe640 1 -- 172.21.15.17:0/4060266407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c88005430 con 0x7f4c9415ce90 2023-08-09T12:46:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.746+0000 7f4c7b7fe640 1 -- 172.21.15.17:0/4060266407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88003830 con 0x7f4c9415ce90 2023-08-09T12:46:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.746+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9415ddb0 con 0x7f4c9415ce90 2023-08-09T12:46:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.746+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9415e370 con 0x7f4c9415ce90 2023-08-09T12:46:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.747+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9415eb70 con 0x7f4c9415ce90 2023-08-09T12:46:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.749+0000 7f4c7b7fe640 1 -- 172.21.15.17:0/4060266407 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4c88003990 con 0x7f4c9415ce90 2023-08-09T12:46:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.750+0000 7f4c7b7fe640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c8006a050 0x7f4c8006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.750+0000 7f4c7b7fe640 1 -- 172.21.15.17:0/4060266407 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4c88087810 con 0x7f4c9415ce90 2023-08-09T12:46:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.751+0000 7f4c92ffd640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c8006a050 0x7f4c8006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.752+0000 7f4c92ffd640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c8006a050 0x7f4c8006c510 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4c840012e0 tx=0x7f4c84007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.754+0000 7f4c7b7fe640 1 -- 172.21.15.17:0/4060266407 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4c9415eb70 con 0x7f4c9415ce90 2023-08-09T12:46:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.944+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c9415eb70 con 0x7f4c9415ce90 2023-08-09T12:46:45.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.945+0000 7f4c7b7fe640 1 -- 172.21.15.17:0/4060266407 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c9415eb70 con 0x7f4c9415ce90 2023-08-09T12:46:45.948 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:46:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c8006a050 msgr2=0x7f4c8006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c8006a050 0x7f4c8006c510 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4c840012e0 tx=0x7f4c84007f30 comp rx=0 tx=0).stop 2023-08-09T12:46:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c9415ce90 msgr2=0x7f4c9415d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c9415ce90 0x7f4c9415d640 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800c400 tx=0x7f4c8800c8c0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 shutdown_connections 2023-08-09T12:46:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4c8006a050 0x7f4c8006c510 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c941616e0 0x7f4c94155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c9415ce90 0x7f4c9415d640 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 --2- 172.21.15.17:0/4060266407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c940d30e0 0x7f4c940b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 >> 172.21.15.17:0/4060266407 conn(0x7f4c9406fde0 msgr2=0x7f4c9415b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 shutdown_connections 2023-08-09T12:46:45.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:45.948+0000 7f4c9955b640 1 -- 172.21.15.17:0/4060266407 wait complete. 2023-08-09T12:46:45.971 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:46:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.198+0000 7fb7b21a6640 1 Processor -- start 2023-08-09T12:46:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.198+0000 7fb7b21a6640 1 -- start start 2023-08-09T12:46:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.199+0000 7fb7b21a6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7ac0c6590 0x7fb7ac0c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.199+0000 7fb7b21a6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac0b5740 con 0x7fb7ac0cd3d0 2023-08-09T12:46:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.199+0000 7fb7b21a6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac0b26a0 con 0x7fb7ac0b5bd0 2023-08-09T12:46:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.199+0000 7fb7b21a6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac0b6990 con 0x7fb7ac0c6590 2023-08-09T12:46:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.200+0000 7fb7ab7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb7ac0cd3d0 0x7fb7ac0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55428/0 (socket says 172.21.15.17:55428) 2023-08-09T12:46:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.200+0000 7fb7ab7fe640 1 -- 172.21.15.17:0/509263868 learned_addr learned my addr 172.21.15.17:0/509263868 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.200+0000 7fb7abfff640 1 --2- 172.21.15.17:0/509263868 >> v2:172.21.15.142:3300/0 conn(0x7fb7ac0c6590 0x7fb7ac0c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.200+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266832722 0 0) 0x7fb7ac0b5740 con 0x7fb7ac0cd3d0 2023-08-09T12:46:46.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.200+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb798003520 con 0x7fb7ac0cd3d0 2023-08-09T12:46:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384713074 0 0) 0x7fb798003520 con 0x7fb7ac0cd3d0 2023-08-09T12:46:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 >> v2:172.21.15.142:3300/0 conn(0x7fb7ac0c6590 msgr2=0x7fb7ac0c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 --2- 172.21.15.17:0/509263868 >> v2:172.21.15.142:3300/0 conn(0x7fb7ac0c6590 0x7fb7ac0c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 >> v1:172.21.15.142:6789/0 conn(0x7fb7ac0b5bd0 legacy=0x7fb7ac0b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0b4b30 con 0x7fb7ac0cd3d0 2023-08-09T12:46:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fb79c001670 con 0x7fb7ac0cd3d0 2023-08-09T12:46:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 >> v1:172.21.15.17:6789/0 conn(0x7fb7ac0cd3d0 legacy=0x7fb7ac0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798003970 0x7fb798003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb798004370 0x7fb798004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798005040 0x7fb79800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0b6990 con 0x7fb798005040 2023-08-09T12:46:46.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79800bef0 con 0x7fb798003970 2023-08-09T12:46:46.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79800c0b0 con 0x7fb798004370 2023-08-09T12:46:46.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.201+0000 7fb7abfff640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798005040 0x7fb79800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.202+0000 7fb7ab7fe640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798003970 0x7fb798003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.202+0000 7fb7aaffd640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb798004370 0x7fb798004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.202+0000 7fb7abfff640 1 -- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb798004370 msgr2=0x7fb798004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.202+0000 7fb7abfff640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb798004370 0x7fb798004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.202+0000 7fb7abfff640 1 -- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798003970 msgr2=0x7fb798003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.202+0000 7fb7abfff640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798003970 0x7fb798003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.202+0000 7fb7abfff640 1 -- 172.21.15.17:0/509263868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798003520 con 0x7fb798005040 2023-08-09T12:46:46.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.202+0000 7fb7aaffd640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb798004370 0x7fb798004840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.203+0000 7fb7abfff640 1 -- 172.21.15.17:0/509263868 reap_dead start 2023-08-09T12:46:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.203+0000 7fb7abfff640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798005040 0x7fb79800b980 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009fc0 tx=0x7fb7980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d8ad4eef52d728 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:46.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a402cc60 con 0x7fb798005040 2023-08-09T12:46:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a400f040 con 0x7fb798005040 2023-08-09T12:46:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7aa7fc640 1 -- 172.21.15.17:0/509263868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4003990 con 0x7fb798005040 2023-08-09T12:46:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7b21a6640 1 -- 172.21.15.17:0/509263868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798005040 msgr2=0x7fb79800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7b21a6640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798005040 0x7fb79800b980 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009fc0 tx=0x7fb7980057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7b21a6640 1 -- 172.21.15.17:0/509263868 shutdown_connections 2023-08-09T12:46:46.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7b21a6640 1 --2- 172.21.15.17:0/509263868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798005040 0x7fb79800b980 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7b21a6640 1 -- 172.21.15.17:0/509263868 >> 172.21.15.17:0/509263868 conn(0x7fb7ac06b9d0 msgr2=0x7fb7ac06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:46.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.204+0000 7fb7b21a6640 1 -- 172.21.15.17:0/509263868 shutdown_connections 2023-08-09T12:46:46.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.205+0000 7fb7b21a6640 1 -- 172.21.15.17:0/509263868 wait complete. 2023-08-09T12:46:46.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.206+0000 7fb7b21a6640 1 Processor -- start 2023-08-09T12:46:46.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.207+0000 7fb7b21a6640 1 -- start start 2023-08-09T12:46:46.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7b21a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798005040 0x7fb7ac15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7b21a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7ac0d0f20 0x7fb7ac157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7b21a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7ac15c6b0 0x7fb7ac06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7b21a6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac1583b0 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7b21a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac15b610 con 0x7fb798005040 2023-08-09T12:46:46.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7b21a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac15b8f0 con 0x7fb7ac15c6b0 2023-08-09T12:46:46.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7ac0d0f20 0x7fb7ac157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7ac0d0f20 0x7fb7ac157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45238/0 (socket says 172.21.15.17:45238) 2023-08-09T12:46:46.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7aaffd640 1 -- 172.21.15.17:0/3283066427 learned_addr learned my addr 172.21.15.17:0/3283066427 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:46.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7ab7fe640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798005040 0x7fb7ac15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7abfff640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7ac15c6b0 0x7fb7ac06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7aaffd640 1 -- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7ac15c6b0 msgr2=0x7fb7ac06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7aaffd640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7ac15c6b0 0x7fb7ac06a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7aaffd640 1 -- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798005040 msgr2=0x7fb7ac15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7aaffd640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798005040 0x7fb7ac15af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.208+0000 7fb7aaffd640 1 -- 172.21.15.17:0/3283066427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac15bbd0 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.209+0000 7fb7aaffd640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7ac0d0f20 0x7fb7ac157e70 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fb79400d7f0 tx=0x7fb79400dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:46.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.209+0000 7fb7a3fff640 1 -- 172.21.15.17:0/3283066427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794017070 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.209+0000 7fb7a3fff640 1 -- 172.21.15.17:0/3283066427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb794005070 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.209+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac15beb0 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.209+0000 7fb7a3fff640 1 -- 172.21.15.17:0/3283066427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794005420 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.209+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac0d13a0 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.211+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac067a80 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.211+0000 7fb7a3fff640 1 -- 172.21.15.17:0/3283066427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb794007240 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.212+0000 7fb7a3fff640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb78c06a080 0x7fb78c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.212+0000 7fb7a3fff640 1 -- 172.21.15.17:0/3283066427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb794087d40 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.213+0000 7fb7ab7fe640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb78c06a080 0x7fb78c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.214+0000 7fb7ab7fe640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb78c06a080 0x7fb78c06c540 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0cff20 tx=0x7fb79c000f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:46.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.217+0000 7fb7a3fff640 1 -- 172.21.15.17:0/3283066427 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb7940537c0 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.410+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7ac06a160 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.410+0000 7fb7a3fff640 1 -- 172.21.15.17:0/3283066427 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v121) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb7940074f0 con 0x7fb7ac0d0f20 2023-08-09T12:46:46.414 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:46:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb78c06a080 msgr2=0x7fb78c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb78c06a080 0x7fb78c06c540 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0cff20 tx=0x7fb79c000f10 comp rx=0 tx=0).stop 2023-08-09T12:46:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7ac0d0f20 msgr2=0x7fb7ac157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7ac0d0f20 0x7fb7ac157e70 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fb79400d7f0 tx=0x7fb79400dcb0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 shutdown_connections 2023-08-09T12:46:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb78c06a080 0x7fb78c06c540 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7ac15c6b0 0x7fb7ac06a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7ac0d0f20 0x7fb7ac157e70 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 --2- 172.21.15.17:0/3283066427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb798005040 0x7fb7ac15af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 >> 172.21.15.17:0/3283066427 conn(0x7fb7ac06b9d0 msgr2=0x7fb7ac0b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 shutdown_connections 2023-08-09T12:46:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.413+0000 7fb7b21a6640 1 -- 172.21.15.17:0/3283066427 wait complete. 2023-08-09T12:46:46.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:46:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.665+0000 7f6a96f86640 1 Processor -- start 2023-08-09T12:46:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.665+0000 7f6a96f86640 1 -- start start 2023-08-09T12:46:46.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.666+0000 7f6a96f86640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6a9015d2d0 0x7f6a900b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.666+0000 7f6a96f86640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a900b2010 con 0x7f6a900cfab0 2023-08-09T12:46:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.667+0000 7f6a96f86640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a900b1d30 con 0x7f6a9015cef0 2023-08-09T12:46:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.667+0000 7f6a96f86640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900cdee0 con 0x7f6a9015d2d0 2023-08-09T12:46:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.667+0000 7f6a95523640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6a9015d2d0 0x7f6a900b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.667+0000 7f6a8ffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6a900cfab0 0x7f6a900d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55444/0 (socket says 172.21.15.17:55444) 2023-08-09T12:46:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.667+0000 7f6a8ffff640 1 -- 172.21.15.17:0/1172756960 learned_addr learned my addr 172.21.15.17:0/1172756960 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.667+0000 7f6a95523640 1 -- 172.21.15.17:0/1172756960 >> v1:172.21.15.142:6789/0 conn(0x7f6a9015cef0 legacy=0x7f6a900cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.667+0000 7f6a95523640 1 -- 172.21.15.17:0/1172756960 >> v1:172.21.15.17:6789/0 conn(0x7f6a900cfab0 legacy=0x7f6a900d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.668+0000 7f6a95523640 1 -- 172.21.15.17:0/1172756960 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a900cd820 con 0x7f6a9015d2d0 2023-08-09T12:46:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.669+0000 7f6a95523640 1 --2- 172.21.15.17:0/1172756960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a9015d2d0 0x7f6a900b1750 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009d90 tx=0x7f6a8802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f2b8ee42ccde2d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.669+0000 7f6a8f7fe640 1 -- 172.21.15.17:0/1172756960 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8802cbd0 con 0x7f6a9015d2d0 2023-08-09T12:46:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.669+0000 7f6a8f7fe640 1 -- 172.21.15.17:0/1172756960 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8802cd30 con 0x7f6a9015d2d0 2023-08-09T12:46:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.669+0000 7f6a8f7fe640 1 -- 172.21.15.17:0/1172756960 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8802cea0 con 0x7f6a9015d2d0 2023-08-09T12:46:46.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.670+0000 7f6a96f86640 1 -- 172.21.15.17:0/1172756960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a9015d2d0 msgr2=0x7f6a900b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.670+0000 7f6a96f86640 1 --2- 172.21.15.17:0/1172756960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a9015d2d0 0x7f6a900b1750 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009d90 tx=0x7f6a8802be20 comp rx=0 tx=0).stop 2023-08-09T12:46:46.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.670+0000 7f6a96f86640 1 -- 172.21.15.17:0/1172756960 shutdown_connections 2023-08-09T12:46:46.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.670+0000 7f6a96f86640 1 --2- 172.21.15.17:0/1172756960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a9015d2d0 0x7f6a900b1750 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.670+0000 7f6a96f86640 1 -- 172.21.15.17:0/1172756960 >> 172.21.15.17:0/1172756960 conn(0x7f6a9006fde0 msgr2=0x7f6a900701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:46.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.670+0000 7f6a96f86640 1 -- 172.21.15.17:0/1172756960 shutdown_connections 2023-08-09T12:46:46.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.670+0000 7f6a96f86640 1 -- 172.21.15.17:0/1172756960 wait complete. 2023-08-09T12:46:46.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.672+0000 7f6a96f86640 1 Processor -- start 2023-08-09T12:46:46.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.672+0000 7f6a96f86640 1 -- start start 2023-08-09T12:46:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a96f86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cfab0 0x7f6a900b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a96f86640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9015cef0 0x7f6a901e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a96f86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9015d2d0 0x7f6a900d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a96f86640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90154a60 con 0x7f6a900cfab0 2023-08-09T12:46:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a96f86640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a901e7f70 con 0x7f6a9015d2d0 2023-08-09T12:46:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a96f86640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a901e8250 con 0x7f6a9015cef0 2023-08-09T12:46:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a94d22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cfab0 0x7f6a900b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a94d22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cfab0 0x7f6a900b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45266/0 (socket says 172.21.15.17:45266) 2023-08-09T12:46:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a94d22640 1 -- 172.21.15.17:0/153024658 learned_addr learned my addr 172.21.15.17:0/153024658 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:46.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a94d22640 1 -- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9015cef0 msgr2=0x7f6a901e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a94d22640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9015cef0 0x7f6a901e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a94d22640 1 -- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9015d2d0 msgr2=0x7f6a900d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a94d22640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9015d2d0 0x7f6a900d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.673+0000 7f6a94d22640 1 -- 172.21.15.17:0/153024658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009a70 con 0x7f6a900cfab0 2023-08-09T12:46:46.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.674+0000 7f6a94d22640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cfab0 0x7f6a900b4750 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400c450 tx=0x7f6a8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:46.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.674+0000 7f6a8d7fa640 1 -- 172.21.15.17:0/153024658 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840052d0 con 0x7f6a900cfab0 2023-08-09T12:46:46.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.674+0000 7f6a8d7fa640 1 -- 172.21.15.17:0/153024658 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84005430 con 0x7f6a900cfab0 2023-08-09T12:46:46.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.674+0000 7f6a8d7fa640 1 -- 172.21.15.17:0/153024658 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84012870 con 0x7f6a900cfab0 2023-08-09T12:46:46.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.674+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a901e8530 con 0x7f6a900cfab0 2023-08-09T12:46:46.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.674+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a901e7c40 con 0x7f6a900cfab0 2023-08-09T12:46:46.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.675+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a90067a80 con 0x7f6a900cfab0 2023-08-09T12:46:46.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.676+0000 7f6a8d7fa640 1 -- 172.21.15.17:0/153024658 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6a840129d0 con 0x7f6a900cfab0 2023-08-09T12:46:46.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.677+0000 7f6a8d7fa640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6a7406a050 0x7f6a7406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.677+0000 7f6a8d7fa640 1 -- 172.21.15.17:0/153024658 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6a84087dd0 con 0x7f6a900cfab0 2023-08-09T12:46:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.678+0000 7f6a8ffff640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6a7406a050 0x7f6a7406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:46.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.679+0000 7f6a8ffff640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6a7406a050 0x7f6a7406c510 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c005880 tx=0x7f6a7c007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.682+0000 7f6a8d7fa640 1 -- 172.21.15.17:0/153024658 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6a840537d0 con 0x7f6a900cfab0 2023-08-09T12:46:46.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.880+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6a900d1c60 con 0x7f6a900cfab0 2023-08-09T12:46:46.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.886+0000 7f6a8d7fa640 1 -- 172.21.15.17:0/153024658 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6a84056df0 con 0x7f6a900cfab0 2023-08-09T12:46:46.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6a7406a050 msgr2=0x7f6a7406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6a7406a050 0x7f6a7406c510 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c005880 tx=0x7f6a7c007a00 comp rx=0 tx=0).stop 2023-08-09T12:46:46.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cfab0 msgr2=0x7f6a900b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:46.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cfab0 0x7f6a900b4750 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400c450 tx=0x7f6a8400c910 comp rx=0 tx=0).stop 2023-08-09T12:46:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 shutdown_connections 2023-08-09T12:46:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6a7406a050 0x7f6a7406c510 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9015d2d0 0x7f6a900d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9015cef0 0x7f6a901e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 --2- 172.21.15.17:0/153024658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cfab0 0x7f6a900b4750 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 >> 172.21.15.17:0/153024658 conn(0x7f6a9006fde0 msgr2=0x7f6a900b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.890+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 shutdown_connections 2023-08-09T12:46:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:46.891+0000 7f6a96f86640 1 -- 172.21.15.17:0/153024658 wait complete. 2023-08-09T12:46:46.913 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:46:46.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:46:47.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:46:47.181 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:46:47.181 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:47.182 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:47.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:46:47.246 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:46:47.247 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:47.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:46:47.306 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:46:47.307 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:47.370 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:46:47.370 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:46:47.371 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:46:47.430 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:46:47.430 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:46:47.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:46:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.675+0000 7f26528c5640 1 Processor -- start 2023-08-09T12:46:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.675+0000 7f26528c5640 1 -- start start 2023-08-09T12:46:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f26528c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 0x7f264c0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f26528c5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f264c070a90 0x7f264c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f26528c5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264c0b4630 con 0x7f264c0ad810 2023-08-09T12:46:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f26528c5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c15a160 con 0x7f264c070a90 2023-08-09T12:46:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f26528c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0b3ab0 con 0x7f264c159d80 2023-08-09T12:46:47.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f2650e62640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f264c070a90 0x7f264c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:47.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f2650e62640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f264c070a90 0x7f264c0c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45282/0 (socket says 172.21.15.17:45282) 2023-08-09T12:46:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f2650e62640 1 -- 172.21.15.17:0/2414752820 learned_addr learned my addr 172.21.15.17:0/2414752820 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.677+0000 7f264b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f264c0ad810 0x7f264c070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55448/0 (socket says 172.21.15.17:55448) 2023-08-09T12:46:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.678+0000 7f264bfff640 1 --2- 172.21.15.17:0/2414752820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 0x7f264c0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.678+0000 7f2650e62640 1 -- 172.21.15.17:0/2414752820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 msgr2=0x7f264c0b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.678+0000 7f2650e62640 1 --2- 172.21.15.17:0/2414752820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 0x7f264c0b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.678+0000 7f2650e62640 1 -- 172.21.15.17:0/2414752820 >> v1:172.21.15.17:6789/0 conn(0x7f264c0ad810 legacy=0x7f264c070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.678+0000 7f2650e62640 1 -- 172.21.15.17:0/2414752820 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0b3d90 con 0x7f264c070a90 2023-08-09T12:46:47.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.678+0000 7f264affd640 1 -- 172.21.15.17:0/2414752820 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026559750 0 0) 0x7f264c0b4630 con 0x7f264c0ad810 2023-08-09T12:46:47.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.679+0000 7f2650e62640 1 --2- 172.21.15.17:0/2414752820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c070a90 0x7f264c0c8fd0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f264400d150 tx=0x7f264402e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fdc6f5b82ed11a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.679+0000 7f264affd640 1 -- 172.21.15.17:0/2414752820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400b0d0 con 0x7f264c070a90 2023-08-09T12:46:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.679+0000 7f264affd640 1 -- 172.21.15.17:0/2414752820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400b230 con 0x7f264c070a90 2023-08-09T12:46:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.679+0000 7f264affd640 1 -- 172.21.15.17:0/2414752820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644009600 con 0x7f264c070a90 2023-08-09T12:46:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.680+0000 7f26528c5640 1 -- 172.21.15.17:0/2414752820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c070a90 msgr2=0x7f264c0c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.680+0000 7f26528c5640 1 --2- 172.21.15.17:0/2414752820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c070a90 0x7f264c0c8fd0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f264400d150 tx=0x7f264402e160 comp rx=0 tx=0).stop 2023-08-09T12:46:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.680+0000 7f26528c5640 1 -- 172.21.15.17:0/2414752820 shutdown_connections 2023-08-09T12:46:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.680+0000 7f26528c5640 1 --2- 172.21.15.17:0/2414752820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c070a90 0x7f264c0c8fd0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.680+0000 7f26528c5640 1 --2- 172.21.15.17:0/2414752820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 0x7f264c0b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.680+0000 7f26528c5640 1 -- 172.21.15.17:0/2414752820 >> 172.21.15.17:0/2414752820 conn(0x7f264c0cb1b0 msgr2=0x7f264c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.680+0000 7f26528c5640 1 -- 172.21.15.17:0/2414752820 shutdown_connections 2023-08-09T12:46:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.680+0000 7f26528c5640 1 -- 172.21.15.17:0/2414752820 wait complete. 2023-08-09T12:46:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.682+0000 7f26528c5640 1 Processor -- start 2023-08-09T12:46:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.682+0000 7f26528c5640 1 -- start start 2023-08-09T12:46:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f26528c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f264c070a90 0x7f264c14fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f26528c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c0ad810 0x7f264c0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f26528c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 0x7f264c14cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f26528c5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c3a90 con 0x7f264c0ad810 2023-08-09T12:46:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f26528c5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c21d0 con 0x7f264c070a90 2023-08-09T12:46:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f26528c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c24b0 con 0x7f264c159d80 2023-08-09T12:46:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f264b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c0ad810 0x7f264c0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f264b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c0ad810 0x7f264c0c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45290/0 (socket says 172.21.15.17:45290) 2023-08-09T12:46:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.683+0000 7f264b7fe640 1 -- 172.21.15.17:0/4292799564 learned_addr learned my addr 172.21.15.17:0/4292799564 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.684+0000 7f264b7fe640 1 -- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 msgr2=0x7f264c14cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.684+0000 7f264b7fe640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 0x7f264c14cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.684+0000 7f264b7fe640 1 -- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f264c070a90 msgr2=0x7f264c14fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.684+0000 7f264b7fe640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f264c070a90 0x7f264c14fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.684+0000 7f264b7fe640 1 -- 172.21.15.17:0/4292799564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264400bd40 con 0x7f264c0ad810 2023-08-09T12:46:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.684+0000 7f264b7fe640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c0ad810 0x7f264c0c3550 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f263400c4d0 tx=0x7f263400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.684+0000 7f2648ff9640 1 -- 172.21.15.17:0/4292799564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634007480 con 0x7f264c0ad810 2023-08-09T12:46:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.685+0000 7f2648ff9640 1 -- 172.21.15.17:0/4292799564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26340075e0 con 0x7f264c0ad810 2023-08-09T12:46:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.685+0000 7f2648ff9640 1 -- 172.21.15.17:0/4292799564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26340059a0 con 0x7f264c0ad810 2023-08-09T12:46:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.685+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c0c2790 con 0x7f264c0ad810 2023-08-09T12:46:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.685+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c0c2d50 con 0x7f264c0ad810 2023-08-09T12:46:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.686+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c067a80 con 0x7f264c0ad810 2023-08-09T12:46:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.687+0000 7f2648ff9640 1 -- 172.21.15.17:0/4292799564 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2634005b00 con 0x7f264c0ad810 2023-08-09T12:46:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.688+0000 7f2648ff9640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f262c06a050 0x7f262c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.688+0000 7f2648ff9640 1 -- 172.21.15.17:0/4292799564 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2634087e60 con 0x7f264c0ad810 2023-08-09T12:46:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.689+0000 7f264bfff640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f262c06a050 0x7f262c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:47.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.690+0000 7f264bfff640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f262c06a050 0x7f262c06c510 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f263c006fd0 tx=0x7f263c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:47.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.693+0000 7f2648ff9640 1 -- 172.21.15.17:0/4292799564 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2634053860 con 0x7f264c0ad810 2023-08-09T12:46:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.922+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f264c0b3560 con 0x7f264c0ad810 2023-08-09T12:46:47.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.923+0000 7f2648ff9640 1 -- 172.21.15.17:0/4292799564 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f2634005db0 con 0x7f264c0ad810 2023-08-09T12:46:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:47.927 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2341976100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2341976100},{"type":"v1","addr":"172.21.15.142:6836","nonce":2341976100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47},{"gid":5525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3365129743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":3365129743},{"type":"v1","addr":"172.21.15.142:6837","nonce":3365129743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7017,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3647037956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3647037956},{"type":"v1","addr":"172.21.15.17:6834","nonce":3647037956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3723084733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3723084733},{"type":"v1","addr":"172.21.15.17:6835","nonce":3723084733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[]} 2023-08-09T12:46:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 53 2023-08-09T12:46:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f262c06a050 msgr2=0x7f262c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f262c06a050 0x7f262c06c510 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f263c006fd0 tx=0x7f263c008040 comp rx=0 tx=0).stop 2023-08-09T12:46:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c0ad810 msgr2=0x7f264c0c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c0ad810 0x7f264c0c3550 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f263400c4d0 tx=0x7f263400c990 comp rx=0 tx=0).stop 2023-08-09T12:46:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 shutdown_connections 2023-08-09T12:46:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f262c06a050 0x7f262c06c510 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f264c159d80 0x7f264c14cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f264c0ad810 0x7f264c0c3550 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 --2- 172.21.15.17:0/4292799564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f264c070a90 0x7f264c14fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 >> 172.21.15.17:0/4292799564 conn(0x7f264c0cb1b0 msgr2=0x7f264c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 shutdown_connections 2023-08-09T12:46:47.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:47.926+0000 7f26528c5640 1 -- 172.21.15.17:0/4292799564 wait complete. 2023-08-09T12:46:47.947 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:46:47.947 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:46:47.947 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:46:47.948 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:46:47.948 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:46:47.948 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:46:47.948 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:46:47.949 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:46:47.949 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:46:47.949 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:46:47.949 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:46:47.949 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:46:47.950 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:46:47.950 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:46:47.950 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:46:47.950 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:46:47.969 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:46:47.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:46:47.970 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:46:47.971 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:46:47.972 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:46:47.972 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:46:47.984 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:46:47.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:46:48.016 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:46:48.016 DEBUG:teuthology.parallel:result is None 2023-08-09T12:46:48.021 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:46:48.021 DEBUG:teuthology.parallel:result is None 2023-08-09T12:46:48.033 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:46:48.034 DEBUG:teuthology.parallel:result is None 2023-08-09T12:46:48.041 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:46:48.041 DEBUG:teuthology.parallel:result is None 2023-08-09T12:46:48.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:46:48.187 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:46:48.188 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:46:48.209 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:46:48.210 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:46:48.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.238+0000 7fee9bd99640 1 Processor -- start 2023-08-09T12:46:48.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.238+0000 7fee9bd99640 1 -- start start 2023-08-09T12:46:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.239+0000 7fee9bd99640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee940cd3d0 0x7fee940cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.239+0000 7fee9bd99640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee940b5bd0 0x7fee940b6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.239+0000 7fee9bd99640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee940b5740 con 0x7fee940c6590 2023-08-09T12:46:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.239+0000 7fee9bd99640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee940b26a0 con 0x7fee940b5bd0 2023-08-09T12:46:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.239+0000 7fee9bd99640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee940cdcf0 con 0x7fee940cd3d0 2023-08-09T12:46:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99334640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee940b5bd0 0x7fee940b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99334640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee940b5bd0 0x7fee940b6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44064/0 (socket says 172.21.15.17:44064) 2023-08-09T12:46:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99334640 1 -- 172.21.15.17:0/2235658475 learned_addr learned my addr 172.21.15.17:0/2235658475 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee9a336640 1 --1- 172.21.15.17:0/2235658475 >> v1:172.21.15.17:6789/0 conn(0x7fee940c6590 0x7fee940c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34028/0 (socket says 172.21.15.17:34028) 2023-08-09T12:46:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99b35640 1 --2- 172.21.15.17:0/2235658475 >> v2:172.21.15.142:3300/0 conn(0x7fee940cd3d0 0x7fee940cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:48.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99334640 1 -- 172.21.15.17:0/2235658475 >> v2:172.21.15.142:3300/0 conn(0x7fee940cd3d0 msgr2=0x7fee940cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:48.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99334640 1 --2- 172.21.15.17:0/2235658475 >> v2:172.21.15.142:3300/0 conn(0x7fee940cd3d0 0x7fee940cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:48.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99334640 1 -- 172.21.15.17:0/2235658475 >> v1:172.21.15.17:6789/0 conn(0x7fee940c6590 legacy=0x7fee940c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:48.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99334640 1 -- 172.21.15.17:0/2235658475 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee940b4b30 con 0x7fee940b5bd0 2023-08-09T12:46:48.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.240+0000 7fee99b35640 1 --2- 172.21.15.17:0/2235658475 >> v2:172.21.15.142:3300/0 conn(0x7fee940cd3d0 0x7fee940cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:48.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.241+0000 7fee99334640 1 --2- 172.21.15.17:0/2235658475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee940b6280 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fee9406c7e0 tx=0x7fee8402ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e85d2704d5ec6fb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:48.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee98b33640 1 -- 172.21.15.17:0/2235658475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8402f860 con 0x7fee940b5bd0 2023-08-09T12:46:48.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee98b33640 1 -- 172.21.15.17:0/2235658475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8402f9c0 con 0x7fee940b5bd0 2023-08-09T12:46:48.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee98b33640 1 -- 172.21.15.17:0/2235658475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8402fd50 con 0x7fee940b5bd0 2023-08-09T12:46:48.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee9bd99640 1 -- 172.21.15.17:0/2235658475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 msgr2=0x7fee940b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:48.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee9bd99640 1 --2- 172.21.15.17:0/2235658475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee940b6280 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fee9406c7e0 tx=0x7fee8402ba40 comp rx=0 tx=0).stop 2023-08-09T12:46:48.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee9bd99640 1 -- 172.21.15.17:0/2235658475 shutdown_connections 2023-08-09T12:46:48.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee9bd99640 1 --2- 172.21.15.17:0/2235658475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee940b6280 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:48.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee9bd99640 1 --2- 172.21.15.17:0/2235658475 >> v2:172.21.15.142:3300/0 conn(0x7fee940cd3d0 0x7fee940cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:48.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee9bd99640 1 -- 172.21.15.17:0/2235658475 >> 172.21.15.17:0/2235658475 conn(0x7fee9406b9d0 msgr2=0x7fee9406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:48.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee9bd99640 1 -- 172.21.15.17:0/2235658475 shutdown_connections 2023-08-09T12:46:48.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.242+0000 7fee9bd99640 1 -- 172.21.15.17:0/2235658475 wait complete. 2023-08-09T12:46:48.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.244+0000 7fee9bd99640 1 Processor -- start 2023-08-09T12:46:48.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.244+0000 7fee9bd99640 1 -- start start 2023-08-09T12:46:48.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.245+0000 7fee9bd99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee9414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:48.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.245+0000 7fee9bd99640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940c6590 0x7fee9406aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:48.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.245+0000 7fee9bd99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940cd3d0 0x7fee940cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:48.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.245+0000 7fee9bd99640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94150220 con 0x7fee940b5bd0 2023-08-09T12:46:48.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.245+0000 7fee9bd99640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9406b330 con 0x7fee940c6590 2023-08-09T12:46:48.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.245+0000 7fee9bd99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee94069860 con 0x7fee940cd3d0 2023-08-09T12:46:48.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.245+0000 7fee99b35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee9414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:48.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99b35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee9414fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44080/0 (socket says 172.21.15.17:44080) 2023-08-09T12:46:48.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99b35640 1 -- 172.21.15.17:0/1422522329 learned_addr learned my addr 172.21.15.17:0/1422522329 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:48.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee9a336640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940cd3d0 0x7fee940cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:48.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99334640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940c6590 0x7fee9406aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:48.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99b35640 1 -- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940cd3d0 msgr2=0x7fee940cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:48.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99b35640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940cd3d0 0x7fee940cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:48.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99b35640 1 -- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940c6590 msgr2=0x7fee9406aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:48.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99b35640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940c6590 0x7fee9406aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:48.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99b35640 1 -- 172.21.15.17:0/1422522329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee840094d0 con 0x7fee940b5bd0 2023-08-09T12:46:48.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.246+0000 7fee99b35640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee9414fce0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fee9000c7f0 tx=0x7fee9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:48.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.247+0000 7fee8a7fc640 1 -- 172.21.15.17:0/1422522329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90007820 con 0x7fee940b5bd0 2023-08-09T12:46:48.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.247+0000 7fee8a7fc640 1 -- 172.21.15.17:0/1422522329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee90007980 con 0x7fee940b5bd0 2023-08-09T12:46:48.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.247+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee94069b40 con 0x7fee940b5bd0 2023-08-09T12:46:48.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.247+0000 7fee8a7fc640 1 -- 172.21.15.17:0/1422522329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90007cf0 con 0x7fee940b5bd0 2023-08-09T12:46:48.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.247+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9406b610 con 0x7fee940b5bd0 2023-08-09T12:46:48.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.248+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee94067190 con 0x7fee940b5bd0 2023-08-09T12:46:48.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.249+0000 7fee8a7fc640 1 -- 172.21.15.17:0/1422522329 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fee900113f0 con 0x7fee940b5bd0 2023-08-09T12:46:48.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.250+0000 7fee8a7fc640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee7806a080 0x7fee7806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:48.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.250+0000 7fee8a7fc640 1 -- 172.21.15.17:0/1422522329 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fee900885c0 con 0x7fee940b5bd0 2023-08-09T12:46:48.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.251+0000 7fee99334640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee7806a080 0x7fee7806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:48.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.251+0000 7fee99334640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee7806a080 0x7fee7806c540 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fee84036000 tx=0x7fee84008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.254+0000 7fee8a7fc640 1 -- 172.21.15.17:0/1422522329 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fee90053f50 con 0x7fee940b5bd0 2023-08-09T12:46:48.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:48.476+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fee94067a80 con 0x7fee940b5bd0 2023-08-09T12:46:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.842+0000 7fee8a7fc640 1 -- 172.21.15.17:0/1422522329 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7fee9001f080 con 0x7fee940b5bd0 2023-08-09T12:46:49.846 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:46:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.846+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee7806a080 msgr2=0x7fee7806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.846+0000 7fee9bd99640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee7806a080 0x7fee7806c540 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fee84036000 tx=0x7fee84008030 comp rx=0 tx=0).stop 2023-08-09T12:46:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.846+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 msgr2=0x7fee9414fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.846+0000 7fee9bd99640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee9414fce0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fee9000c7f0 tx=0x7fee9000ccb0 comp rx=0 tx=0).stop 2023-08-09T12:46:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.847+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 shutdown_connections 2023-08-09T12:46:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.847+0000 7fee9bd99640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fee7806a080 0x7fee7806c540 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.847+0000 7fee9bd99640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940cd3d0 0x7fee940cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.847+0000 7fee9bd99640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940c6590 0x7fee9406aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.847+0000 7fee9bd99640 1 --2- 172.21.15.17:0/1422522329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee940b5bd0 0x7fee9414fce0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.847+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 >> 172.21.15.17:0/1422522329 conn(0x7fee9406b9d0 msgr2=0x7fee940c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.847+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 shutdown_connections 2023-08-09T12:46:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:49.847+0000 7fee9bd99640 1 -- 172.21.15.17:0/1422522329 wait complete. 2023-08-09T12:46:49.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:46:50.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.105+0000 7f45e2eda640 1 Processor -- start 2023-08-09T12:46:50.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.106+0000 7f45e2eda640 1 -- start start 2023-08-09T12:46:50.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.107+0000 7f45e2eda640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc1616e0 0x7f45dc0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.107+0000 7f45e2eda640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f45dc0d29d0 0x7f45dc0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.108+0000 7f45e2eda640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0cdd10 con 0x7f45dc15ce90 2023-08-09T12:46:50.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.108+0000 7f45e2eda640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0b6540 con 0x7f45dc0d29d0 2023-08-09T12:46:50.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.108+0000 7f45e2eda640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0d33a0 con 0x7f45dc1616e0 2023-08-09T12:46:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.108+0000 7f45e1477640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f45dc0d29d0 0x7f45dc0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.108+0000 7f45e1477640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f45dc0d29d0 0x7f45dc0d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44084/0 (socket says 172.21.15.17:44084) 2023-08-09T12:46:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.108+0000 7f45e0c76640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f45dc15ce90 0x7f45dc0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34034/0 (socket says 172.21.15.17:34034) 2023-08-09T12:46:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.108+0000 7f45e1477640 1 -- 172.21.15.17:0/1019915088 learned_addr learned my addr 172.21.15.17:0/1019915088 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.108+0000 7f45d3fff640 1 --2- 172.21.15.17:0/1019915088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc1616e0 0x7f45dc0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.109+0000 7f45e1477640 1 -- 172.21.15.17:0/1019915088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc1616e0 msgr2=0x7f45dc0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.109+0000 7f45e1477640 1 --2- 172.21.15.17:0/1019915088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc1616e0 0x7f45dc0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.109+0000 7f45e1477640 1 -- 172.21.15.17:0/1019915088 >> v1:172.21.15.17:6789/0 conn(0x7f45dc15ce90 legacy=0x7f45dc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.109+0000 7f45e1477640 1 -- 172.21.15.17:0/1019915088 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0cdff0 con 0x7f45dc0d29d0 2023-08-09T12:46:50.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.110+0000 7f45e1477640 1 --2- 172.21.15.17:0/1019915088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc0d29d0 0x7f45dc0d2e60 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009870 tx=0x7f45d402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87775071b6a9abce server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.110+0000 7f45d37fe640 1 -- 172.21.15.17:0/1019915088 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4030840 con 0x7f45dc0d29d0 2023-08-09T12:46:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.110+0000 7f45d37fe640 1 -- 172.21.15.17:0/1019915088 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d40309a0 con 0x7f45dc0d29d0 2023-08-09T12:46:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.110+0000 7f45d37fe640 1 -- 172.21.15.17:0/1019915088 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4030d30 con 0x7f45dc0d29d0 2023-08-09T12:46:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.111+0000 7f45e2eda640 1 -- 172.21.15.17:0/1019915088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc0d29d0 msgr2=0x7f45dc0d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.111+0000 7f45e2eda640 1 --2- 172.21.15.17:0/1019915088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc0d29d0 0x7f45dc0d2e60 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009870 tx=0x7f45d402b980 comp rx=0 tx=0).stop 2023-08-09T12:46:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.111+0000 7f45e2eda640 1 -- 172.21.15.17:0/1019915088 shutdown_connections 2023-08-09T12:46:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.111+0000 7f45e2eda640 1 --2- 172.21.15.17:0/1019915088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc0d29d0 0x7f45dc0d2e60 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.111+0000 7f45e2eda640 1 --2- 172.21.15.17:0/1019915088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc1616e0 0x7f45dc0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.111+0000 7f45e2eda640 1 -- 172.21.15.17:0/1019915088 >> 172.21.15.17:0/1019915088 conn(0x7f45dc06fde0 msgr2=0x7f45dc0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.111+0000 7f45e2eda640 1 -- 172.21.15.17:0/1019915088 shutdown_connections 2023-08-09T12:46:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.111+0000 7f45e2eda640 1 -- 172.21.15.17:0/1019915088 wait complete. 2023-08-09T12:46:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.113+0000 7f45e2eda640 1 Processor -- start 2023-08-09T12:46:50.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.113+0000 7f45e2eda640 1 -- start start 2023-08-09T12:46:50.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.114+0000 7f45e2eda640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc0d29d0 0x7f45dc1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.114+0000 7f45e2eda640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45dc15ce90 0x7f45dc0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.114+0000 7f45e2eda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc1616e0 0x7f45dc159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.114+0000 7f45e2eda640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0cc4d0 con 0x7f45dc1616e0 2023-08-09T12:46:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.114+0000 7f45e2eda640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc1e8750 con 0x7f45dc15ce90 2023-08-09T12:46:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.114+0000 7f45e2eda640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc15a170 con 0x7f45dc0d29d0 2023-08-09T12:46:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e1477640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc1616e0 0x7f45dc159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e1477640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc1616e0 0x7f45dc159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44088/0 (socket says 172.21.15.17:44088) 2023-08-09T12:46:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e1477640 1 -- 172.21.15.17:0/2220163790 learned_addr learned my addr 172.21.15.17:0/2220163790 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e0c76640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc0d29d0 0x7f45dc1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45d3fff640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45dc15ce90 0x7f45dc0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e1477640 1 -- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc0d29d0 msgr2=0x7f45dc1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e1477640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc0d29d0 0x7f45dc1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e1477640 1 -- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45dc15ce90 msgr2=0x7f45dc0c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e1477640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45dc15ce90 0x7f45dc0c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45e1477640 1 -- 172.21.15.17:0/2220163790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40094d0 con 0x7f45dc1616e0 2023-08-09T12:46:50.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.115+0000 7f45d3fff640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45dc15ce90 0x7f45dc0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:46:50.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.116+0000 7f45e1477640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc1616e0 0x7f45dc159160 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f45d402b9c0 tx=0x7f45d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:50.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.116+0000 7f45d17fa640 1 -- 172.21.15.17:0/2220163790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4039c90 con 0x7f45dc1616e0 2023-08-09T12:46:50.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.116+0000 7f45d17fa640 1 -- 172.21.15.17:0/2220163790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d4039e10 con 0x7f45dc1616e0 2023-08-09T12:46:50.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.116+0000 7f45d17fa640 1 -- 172.21.15.17:0/2220163790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40446c0 con 0x7f45dc1616e0 2023-08-09T12:46:50.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.116+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc0ccca0 con 0x7f45dc1616e0 2023-08-09T12:46:50.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.116+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc0cc6e0 con 0x7f45dc1616e0 2023-08-09T12:46:50.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.117+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc1e8900 con 0x7f45dc1616e0 2023-08-09T12:46:50.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.118+0000 7f45d17fa640 1 -- 172.21.15.17:0/2220163790 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45d404d3b0 con 0x7f45dc1616e0 2023-08-09T12:46:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.120+0000 7f45d17fa640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45c806a050 0x7f45c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.120+0000 7f45d17fa640 1 -- 172.21.15.17:0/2220163790 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f45d403e070 con 0x7f45dc1616e0 2023-08-09T12:46:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.120+0000 7f45e0c76640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45c806a050 0x7f45c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.121+0000 7f45e0c76640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45c806a050 0x7f45c806c510 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f45d80012e0 tx=0x7f45d80016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:50.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.124+0000 7f45d17fa640 1 -- 172.21.15.17:0/2220163790 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f45dc1e8900 con 0x7f45dc1616e0 2023-08-09T12:46:50.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.389+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f45dc1e8900 con 0x7f45dc1616e0 2023-08-09T12:46:50.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.391+0000 7f45d17fa640 1 -- 172.21.15.17:0/2220163790 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f45dc1e8900 con 0x7f45dc1616e0 2023-08-09T12:46:50.394 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:50.394 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:46:50.394 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:46:50.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.395 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:46:50.395 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:46:50.395 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.395 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:46:50.395 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:46:50.395 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:46:50.396 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.396 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:46:50.396 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:46:50.396 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.396 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:46:50.397 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:46:50.397 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:46:50.397 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.397 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:46:50.397 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:46:50.398 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.398 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:46:50.398 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:46:50.398 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:46:50.398 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.399 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:46:50.399 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:46:50.399 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.399 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:46:50.399 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:46:50.399 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:46:50.399 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.400 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:46:50.400 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:46:50.400 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.400 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:46:50.400 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:46:50.401 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.401 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:46:50.401 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:46:50.401 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.402 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:46:50.402 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:46:50.402 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.402 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:46:50.402 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:46:50.403 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.403 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:46:50.403 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:46:50.403 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.403 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:46:50.404 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:46:50.404 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.404 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:46:50.404 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:46:50.404 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.404 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.405 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:46:50.405 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:46:50.405 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.405 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:46:50.405 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:46:50.405 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.406 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:46:50.406 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:46:50.406 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.406 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:46:50.406 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:46:50.407 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.407 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:46:50.407 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:46:50.407 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.407 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:46:50.408 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:46:50.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.408 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:46:50.408 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:46:50.408 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.409 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:46:50.409 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:46:50.409 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.409 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.409 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:46:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:46:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:46:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:46:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:46:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.411 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:46:50.411 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:46:50.411 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.411 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:46:50.411 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:46:50.411 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:46:50.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:46:50.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.412 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:46:50.412 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:46:50.412 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:46:50.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:46:50.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:46:50.413 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:46:50.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.413 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:46:50.413 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:46:50.413 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.413 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:46:50.414 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:46:50.414 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:46:50.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:46:50.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.414 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:46:50.415 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:46:50.415 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.415 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:46:50.415 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:46:50.415 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:46:50.415 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.416 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:46:50.416 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:46:50.416 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.416 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:46:50.416 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:46:50.416 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:50.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:50.417 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:46:50.417 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:46:50.417 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:46:50.417 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:46:50.417 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:46:50.418 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:46:50.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:50.418 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:46:50.418 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:46:50.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45c806a050 msgr2=0x7f45c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45c806a050 0x7f45c806c510 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f45d80012e0 tx=0x7f45d80016f0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc1616e0 msgr2=0x7f45dc159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc1616e0 0x7f45dc159160 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f45d402b9c0 tx=0x7f45d4004730 comp rx=0 tx=0).stop 2023-08-09T12:46:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 shutdown_connections 2023-08-09T12:46:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f45c806a050 0x7f45c806c510 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45dc1616e0 0x7f45dc159160 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45dc15ce90 0x7f45dc0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.393+0000 7f45e2eda640 1 --2- 172.21.15.17:0/2220163790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45dc0d29d0 0x7f45dc1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.394+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 >> 172.21.15.17:0/2220163790 conn(0x7f45dc06fde0 msgr2=0x7f45dc0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:50.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.394+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 shutdown_connections 2023-08-09T12:46:50.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.394+0000 7f45e2eda640 1 -- 172.21.15.17:0/2220163790 wait complete. 2023-08-09T12:46:50.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:50.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.648+0000 7f91f26fb640 1 Processor -- start 2023-08-09T12:46:50.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.648+0000 7f91f26fb640 1 -- start start 2023-08-09T12:46:50.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.650+0000 7f91f26fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ec0b86e0 0x7f91ec0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.650+0000 7f91f26fb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91ec0cf980 0x7f91ec0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.650+0000 7f91f26fb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec0b5a30 con 0x7f91ec160030 2023-08-09T12:46:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.650+0000 7f91f26fb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec0d1110 con 0x7f91ec0cf980 2023-08-09T12:46:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.650+0000 7f91f26fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0ceac0 con 0x7f91ec0b86e0 2023-08-09T12:46:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.650+0000 7f91f16f9640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f91ec160030 0x7f91ec160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34040/0 (socket says 172.21.15.17:34040) 2023-08-09T12:46:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.650+0000 7f91f16f9640 1 -- 172.21.15.17:0/2581239917 learned_addr learned my addr 172.21.15.17:0/2581239917 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:50.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91f1efa640 1 --2- 172.21.15.17:0/2581239917 >> v2:172.21.15.142:3300/0 conn(0x7f91ec0cf980 0x7f91ec0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91f0ef8640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ec0b86e0 0x7f91ec0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893462287 0 0) 0x7f91ec0b5a30 con 0x7f91ec160030 2023-08-09T12:46:50.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d8003520 con 0x7f91ec160030 2023-08-09T12:46:50.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3859511087 0 0) 0x7f91d8003520 con 0x7f91ec160030 2023-08-09T12:46:50.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ec0b86e0 msgr2=0x7f91ec0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:50.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ec0b86e0 0x7f91ec0cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 >> v2:172.21.15.142:3300/0 conn(0x7f91ec0cf980 msgr2=0x7f91ec0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:50.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 --2- 172.21.15.17:0/2581239917 >> v2:172.21.15.142:3300/0 conn(0x7f91ec0cf980 0x7f91ec0d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec0d0d70 con 0x7f91ec160030 2023-08-09T12:46:50.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f91e80019f0 con 0x7f91ec160030 2023-08-09T12:46:50.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 >> v1:172.21.15.17:6789/0 conn(0x7f91ec160030 legacy=0x7f91ec160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ec0b86e0 0x7f91d8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.651+0000 7f91e3fff640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d8003ef0 0x7f91d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91e3fff640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d8004d00 0x7f91d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0d1110 con 0x7f91d8003ef0 2023-08-09T12:46:50.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d800b980 con 0x7f91d8004d00 2023-08-09T12:46:50.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d800bac0 con 0x7f91ec0b86e0 2023-08-09T12:46:50.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91f0ef8640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d8003ef0 0x7f91d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91f16f9640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ec0b86e0 0x7f91d8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91f1efa640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d8004d00 0x7f91d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91f0ef8640 1 -- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ec0b86e0 msgr2=0x7f91d8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:50.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91f0ef8640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ec0b86e0 0x7f91d8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91f0ef8640 1 -- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d8004d00 msgr2=0x7f91d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:50.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91f0ef8640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d8004d00 0x7f91d8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.652+0000 7f91f0ef8640 1 -- 172.21.15.17:0/2581239917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8003520 con 0x7f91d8003ef0 2023-08-09T12:46:50.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.653+0000 7f91f0ef8640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d8003ef0 0x7f91d80047c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009ac0 tx=0x7f91d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04d93e98920f636 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:50.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.654+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc02c6b0 con 0x7f91d8003ef0 2023-08-09T12:46:50.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.654+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc02c810 con 0x7f91d8003ef0 2023-08-09T12:46:50.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.654+0000 7f91e3fff640 1 -- 172.21.15.17:0/2581239917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc02cba0 con 0x7f91d8003ef0 2023-08-09T12:46:50.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.654+0000 7f91f26fb640 1 -- 172.21.15.17:0/2581239917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d8003ef0 msgr2=0x7f91d80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.654+0000 7f91f26fb640 1 --2- 172.21.15.17:0/2581239917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91d8003ef0 0x7f91d80047c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009ac0 tx=0x7f91d80057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.654+0000 7f91f1efa640 1 -- 172.21.15.17:0/2581239917 reap_dead start 2023-08-09T12:46:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.654+0000 7f91f26fb640 1 -- 172.21.15.17:0/2581239917 shutdown_connections 2023-08-09T12:46:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.654+0000 7f91f26fb640 1 -- 172.21.15.17:0/2581239917 >> 172.21.15.17:0/2581239917 conn(0x7f91ec0697c0 msgr2=0x7f91ec069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.655+0000 7f91f26fb640 1 -- 172.21.15.17:0/2581239917 shutdown_connections 2023-08-09T12:46:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.655+0000 7f91f26fb640 1 -- 172.21.15.17:0/2581239917 wait complete. 2023-08-09T12:46:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.656+0000 7f91f26fb640 1 Processor -- start 2023-08-09T12:46:50.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.657+0000 7f91f26fb640 1 -- start start 2023-08-09T12:46:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f26fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d8003ef0 0x7f91ec150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f26fb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ec153860 0x7f91ec0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f26fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91ec0b4930 0x7f91ec1f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f26fb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0b4db0 con 0x7f91ec0b4930 2023-08-09T12:46:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f26fb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec157d00 con 0x7f91ec153860 2023-08-09T12:46:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f26fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec1f66e0 con 0x7f91d8003ef0 2023-08-09T12:46:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f1efa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91ec0b4930 0x7f91ec1f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f1efa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91ec0b4930 0x7f91ec1f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44106/0 (socket says 172.21.15.17:44106) 2023-08-09T12:46:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f1efa640 1 -- 172.21.15.17:0/172232396 learned_addr learned my addr 172.21.15.17:0/172232396 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f16f9640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d8003ef0 0x7f91ec150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f0ef8640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ec153860 0x7f91ec0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f1efa640 1 -- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d8003ef0 msgr2=0x7f91ec150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f1efa640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d8003ef0 0x7f91ec150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f1efa640 1 -- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ec153860 msgr2=0x7f91ec0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f1efa640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ec153860 0x7f91ec0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.658+0000 7f91f1efa640 1 -- 172.21.15.17:0/172232396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec1f6400 con 0x7f91ec0b4930 2023-08-09T12:46:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.659+0000 7f91f1efa640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91ec0b4930 0x7f91ec1f57b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0cd040 tx=0x7f91e4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.659+0000 7f91e1ffb640 1 -- 172.21.15.17:0/172232396 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400e8d0 con 0x7f91ec0b4930 2023-08-09T12:46:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.659+0000 7f91e1ffb640 1 -- 172.21.15.17:0/172232396 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e400ea50 con 0x7f91ec0b4930 2023-08-09T12:46:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.659+0000 7f91e1ffb640 1 -- 172.21.15.17:0/172232396 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400ee00 con 0x7f91ec0b4930 2023-08-09T12:46:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.659+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec152d80 con 0x7f91ec0b4930 2023-08-09T12:46:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.659+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec153340 con 0x7f91ec0b4930 2023-08-09T12:46:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.660+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec04e390 con 0x7f91ec0b4930 2023-08-09T12:46:50.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.661+0000 7f91e1ffb640 1 -- 172.21.15.17:0/172232396 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91e40143f0 con 0x7f91ec0b4930 2023-08-09T12:46:50.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.663+0000 7f91e1ffb640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91d006a080 0x7f91d006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:50.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.663+0000 7f91e1ffb640 1 -- 172.21.15.17:0/172232396 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f91e4087eb0 con 0x7f91ec0b4930 2023-08-09T12:46:50.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.664+0000 7f91f16f9640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91d006a080 0x7f91d006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:50.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.665+0000 7f91f16f9640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91d006a080 0x7f91d006c540 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f91e8005db0 tx=0x7f91e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:50.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.667+0000 7f91e1ffb640 1 -- 172.21.15.17:0/172232396 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f91e40538e0 con 0x7f91ec0b4930 2023-08-09T12:46:50.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.860+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91ec0d0640 con 0x7f91ec0b4930 2023-08-09T12:46:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.862+0000 7f91e1ffb640 1 -- 172.21.15.17:0/172232396 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f91e4000e60 con 0x7f91ec0b4930 2023-08-09T12:46:50.866 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:50.866 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":126,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:49.833317+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91d006a080 msgr2=0x7f91d006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91d006a080 0x7f91d006c540 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f91e8005db0 tx=0x7f91e8009040 comp rx=0 tx=0).stop 2023-08-09T12:46:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91ec0b4930 msgr2=0x7f91ec1f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91ec0b4930 0x7f91ec1f57b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0cd040 tx=0x7f91e4010c20 comp rx=0 tx=0).stop 2023-08-09T12:46:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 shutdown_connections 2023-08-09T12:46:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f91d006a080 0x7f91d006c540 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91ec0b4930 0x7f91ec1f57b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ec153860 0x7f91ec0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 --2- 172.21.15.17:0/172232396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d8003ef0 0x7f91ec150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:50.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 >> 172.21.15.17:0/172232396 conn(0x7f91ec0697c0 msgr2=0x7f91ec0b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:50.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 shutdown_connections 2023-08-09T12:46:50.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:50.865+0000 7f91f26fb640 1 -- 172.21.15.17:0/172232396 wait complete. 2023-08-09T12:46:50.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:46:50.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:46:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.125+0000 7f7b86fe8640 1 Processor -- start 2023-08-09T12:46:51.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.126+0000 7f7b86fe8640 1 -- start start 2023-08-09T12:46:51.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.127+0000 7f7b86fe8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7b801616e0 0x7f7b800b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.127+0000 7f7b86fe8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b800d29d0 0x7f7b800d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.127+0000 7f7b86fe8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b800cdd10 con 0x7f7b8015ce90 2023-08-09T12:46:51.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.127+0000 7f7b86fe8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b800b6540 con 0x7f7b801616e0 2023-08-09T12:46:51.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.127+0000 7f7b86fe8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800d33a0 con 0x7f7b800d29d0 2023-08-09T12:46:51.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.128+0000 7f7b7ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7b801616e0 0x7f7b800b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.128+0000 7f7b85585640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b800d29d0 0x7f7b800d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.128+0000 7f7b85585640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b800d29d0 0x7f7b800d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:55382/0 (socket says 172.21.15.17:55382) 2023-08-09T12:46:51.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.128+0000 7f7b85585640 1 -- 172.21.15.17:0/659464010 learned_addr learned my addr 172.21.15.17:0/659464010 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:51.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.129+0000 7f7b7f7fe640 1 -- 172.21.15.17:0/659464010 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808468414 0 0) 0x7f7b800cdd10 con 0x7f7b8015ce90 2023-08-09T12:46:51.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.129+0000 7f7b7f7fe640 1 -- 172.21.15.17:0/659464010 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b70003520 con 0x7f7b8015ce90 2023-08-09T12:46:51.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.129+0000 7f7b7ffff640 1 -- 172.21.15.17:0/659464010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b800d29d0 msgr2=0x7f7b800d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:51.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.129+0000 7f7b7ffff640 1 --2- 172.21.15.17:0/659464010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b800d29d0 0x7f7b800d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.129+0000 7f7b7ffff640 1 -- 172.21.15.17:0/659464010 >> v1:172.21.15.142:6789/0 conn(0x7f7b8015ce90 legacy=0x7f7b800cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.129+0000 7f7b7ffff640 1 -- 172.21.15.17:0/659464010 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b800cdff0 con 0x7f7b801616e0 2023-08-09T12:46:51.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.129+0000 7f7b85585640 1 --2- 172.21.15.17:0/659464010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b800d29d0 0x7f7b800d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:46:51.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.130+0000 7f7b7ffff640 1 --2- 172.21.15.17:0/659464010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b801616e0 0x7f7b800b6000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0097a0 tx=0x7f7b6c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c709ff2ba67a202 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:51.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.131+0000 7f7b7f7fe640 1 -- 172.21.15.17:0/659464010 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c02d040 con 0x7f7b801616e0 2023-08-09T12:46:51.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.131+0000 7f7b7f7fe640 1 -- 172.21.15.17:0/659464010 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c031810 con 0x7f7b801616e0 2023-08-09T12:46:51.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.131+0000 7f7b7f7fe640 1 -- 172.21.15.17:0/659464010 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c031ba0 con 0x7f7b801616e0 2023-08-09T12:46:51.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.132+0000 7f7b86fe8640 1 -- 172.21.15.17:0/659464010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b801616e0 msgr2=0x7f7b800b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.132+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/659464010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b801616e0 0x7f7b800b6000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0097a0 tx=0x7f7b6c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.132+0000 7f7b86fe8640 1 -- 172.21.15.17:0/659464010 shutdown_connections 2023-08-09T12:46:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.132+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/659464010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b800d29d0 0x7f7b800d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.132+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/659464010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b801616e0 0x7f7b800b6000 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.132+0000 7f7b86fe8640 1 -- 172.21.15.17:0/659464010 >> 172.21.15.17:0/659464010 conn(0x7f7b8006fde0 msgr2=0x7f7b800701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.132+0000 7f7b86fe8640 1 -- 172.21.15.17:0/659464010 shutdown_connections 2023-08-09T12:46:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.132+0000 7f7b86fe8640 1 -- 172.21.15.17:0/659464010 wait complete. 2023-08-09T12:46:51.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.134+0000 7f7b86fe8640 1 Processor -- start 2023-08-09T12:46:51.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.134+0000 7f7b86fe8640 1 -- start start 2023-08-09T12:46:51.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.135+0000 7f7b86fe8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b800d29d0 0x7f7b800cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.135+0000 7f7b86fe8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b8015ce90 0x7f7b800cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.135+0000 7f7b86fe8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b801616e0 0x7f7b800cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.135+0000 7f7b86fe8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800a9890 con 0x7f7b801616e0 2023-08-09T12:46:51.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.135+0000 7f7b86fe8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800c9c50 con 0x7f7b800d29d0 2023-08-09T12:46:51.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.135+0000 7f7b86fe8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b801f2f00 con 0x7f7b8015ce90 2023-08-09T12:46:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b801616e0 0x7f7b800cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b801616e0 0x7f7b800cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44120/0 (socket says 172.21.15.17:44120) 2023-08-09T12:46:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 -- 172.21.15.17:0/4191095047 learned_addr learned my addr 172.21.15.17:0/4191095047 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b84d84640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b800d29d0 0x7f7b800cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b7ffff640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b8015ce90 0x7f7b800cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 -- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b8015ce90 msgr2=0x7f7b800cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b8015ce90 0x7f7b800cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 -- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b800d29d0 msgr2=0x7f7b800cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b800d29d0 0x7f7b800cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 -- 172.21.15.17:0/4191095047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009b30 con 0x7f7b801616e0 2023-08-09T12:46:51.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.136+0000 7f7b85585640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b801616e0 0x7f7b800cb640 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800efc0 tx=0x7f7b7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:51.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.137+0000 7f7b7d7fa640 1 -- 172.21.15.17:0/4191095047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78018070 con 0x7f7b801616e0 2023-08-09T12:46:51.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.137+0000 7f7b7d7fa640 1 -- 172.21.15.17:0/4191095047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7800f040 con 0x7f7b801616e0 2023-08-09T12:46:51.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.137+0000 7f7b7d7fa640 1 -- 172.21.15.17:0/4191095047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800ce00 con 0x7f7b801616e0 2023-08-09T12:46:51.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.137+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c009400 con 0x7f7b801616e0 2023-08-09T12:46:51.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.137+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b801f34c0 con 0x7f7b801616e0 2023-08-09T12:46:51.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.138+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b80067a80 con 0x7f7b801616e0 2023-08-09T12:46:51.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.139+0000 7f7b7d7fa640 1 -- 172.21.15.17:0/4191095047 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b78014480 con 0x7f7b801616e0 2023-08-09T12:46:51.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.140+0000 7f7b7d7fa640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6406a080 0x7f7b6406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.140+0000 7f7b7d7fa640 1 -- 172.21.15.17:0/4191095047 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7b780885a0 con 0x7f7b801616e0 2023-08-09T12:46:51.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.141+0000 7f7b84d84640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6406a080 0x7f7b6406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.142+0000 7f7b84d84640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6406a080 0x7f7b6406c540 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7b740011e0 tx=0x7f7b74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:51.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.144+0000 7f7b7d7fa640 1 -- 172.21.15.17:0/4191095047 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7b78057a60 con 0x7f7b801616e0 2023-08-09T12:46:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.336+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b800d0ad0 con 0x7f7b801616e0 2023-08-09T12:46:51.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.337+0000 7f7b7d7fa640 1 -- 172.21.15.17:0/4191095047 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b780575f0 con 0x7f7b801616e0 2023-08-09T12:46:51.340 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:46:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6406a080 msgr2=0x7f7b6406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6406a080 0x7f7b6406c540 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7b740011e0 tx=0x7f7b74009040 comp rx=0 tx=0).stop 2023-08-09T12:46:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b801616e0 msgr2=0x7f7b800cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b801616e0 0x7f7b800cb640 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800efc0 tx=0x7f7b7800c490 comp rx=0 tx=0).stop 2023-08-09T12:46:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 shutdown_connections 2023-08-09T12:46:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7b6406a080 0x7f7b6406c540 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b801616e0 0x7f7b800cb640 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b8015ce90 0x7f7b800cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 --2- 172.21.15.17:0/4191095047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b800d29d0 0x7f7b800cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 >> 172.21.15.17:0/4191095047 conn(0x7f7b8006fde0 msgr2=0x7f7b8015ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 shutdown_connections 2023-08-09T12:46:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.340+0000 7f7b86fe8640 1 -- 172.21.15.17:0/4191095047 wait complete. 2023-08-09T12:46:51.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:46:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.589+0000 7f03c68e7640 1 Processor -- start 2023-08-09T12:46:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.590+0000 7f03c68e7640 1 -- start start 2023-08-09T12:46:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.591+0000 7f03c68e7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c01616e0 0x7f03c00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.591+0000 7f03c68e7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03c00d29d0 0x7f03c00d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.591+0000 7f03c68e7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00cdd10 con 0x7f03c015ce90 2023-08-09T12:46:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.591+0000 7f03c68e7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00b6540 con 0x7f03c00d29d0 2023-08-09T12:46:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.591+0000 7f03c68e7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00d33a0 con 0x7f03c01616e0 2023-08-09T12:46:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.592+0000 7f03b77fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c01616e0 0x7f03c00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.592+0000 7f03c4e84640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03c00d29d0 0x7f03c00d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.592+0000 7f03bffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f03c015ce90 0x7f03c00cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:42460/0 (socket says 172.21.15.17:42460) 2023-08-09T12:46:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.592+0000 7f03b77fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c01616e0 0x7f03c00b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:55404/0 (socket says 172.21.15.17:55404) 2023-08-09T12:46:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.592+0000 7f03bffff640 1 -- 172.21.15.17:0/2198223017 learned_addr learned my addr 172.21.15.17:0/2198223017 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.592+0000 7f03c4e84640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03c00d29d0 0x7f03c00d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:44518/0 (socket says 172.21.15.17:44518) 2023-08-09T12:46:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.593+0000 7f03c4e84640 1 -- 172.21.15.17:0/2198223017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c01616e0 msgr2=0x7f03c00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.593+0000 7f03c4e84640 1 --2- 172.21.15.17:0/2198223017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c01616e0 0x7f03c00b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.593+0000 7f03c4e84640 1 -- 172.21.15.17:0/2198223017 >> v1:172.21.15.142:6789/0 conn(0x7f03c015ce90 legacy=0x7f03c00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.593+0000 7f03c4e84640 1 -- 172.21.15.17:0/2198223017 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00cdff0 con 0x7f03c00d29d0 2023-08-09T12:46:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.595+0000 7f03c4e84640 1 --2- 172.21.15.17:0/2198223017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 0x7f03c00d2e60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f03b80097a0 tx=0x7f03b802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7ab9638057b717d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.595+0000 7f03bf7fe640 1 -- 172.21.15.17:0/2198223017 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8031830 con 0x7f03c00d29d0 2023-08-09T12:46:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.595+0000 7f03bf7fe640 1 -- 172.21.15.17:0/2198223017 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b8031990 con 0x7f03c00d29d0 2023-08-09T12:46:51.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.595+0000 7f03bf7fe640 1 -- 172.21.15.17:0/2198223017 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8031d20 con 0x7f03c00d29d0 2023-08-09T12:46:51.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.596+0000 7f03c68e7640 1 -- 172.21.15.17:0/2198223017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 msgr2=0x7f03c00d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.596+0000 7f03c68e7640 1 --2- 172.21.15.17:0/2198223017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 0x7f03c00d2e60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f03b80097a0 tx=0x7f03b802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.596+0000 7f03c68e7640 1 -- 172.21.15.17:0/2198223017 shutdown_connections 2023-08-09T12:46:51.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.596+0000 7f03c68e7640 1 --2- 172.21.15.17:0/2198223017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c01616e0 0x7f03c00b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.596+0000 7f03c68e7640 1 --2- 172.21.15.17:0/2198223017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 0x7f03c00d2e60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.596+0000 7f03c68e7640 1 -- 172.21.15.17:0/2198223017 >> 172.21.15.17:0/2198223017 conn(0x7f03c006fde0 msgr2=0x7f03c00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:51.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.596+0000 7f03c68e7640 1 -- 172.21.15.17:0/2198223017 shutdown_connections 2023-08-09T12:46:51.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.596+0000 7f03c68e7640 1 -- 172.21.15.17:0/2198223017 wait complete. 2023-08-09T12:46:51.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.598+0000 7f03c68e7640 1 Processor -- start 2023-08-09T12:46:51.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.598+0000 7f03c68e7640 1 -- start start 2023-08-09T12:46:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.599+0000 7f03c68e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 0x7f03c0151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.599+0000 7f03c68e7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c015ce90 0x7f03c015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.599+0000 7f03c68e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01616e0 0x7f03c00b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.599+0000 7f03c68e7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00cb7c0 con 0x7f03c01616e0 2023-08-09T12:46:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.599+0000 7f03c68e7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01515b0 con 0x7f03c00d29d0 2023-08-09T12:46:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.599+0000 7f03c68e7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00cabb0 con 0x7f03c015ce90 2023-08-09T12:46:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01616e0 0x7f03c00b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01616e0 0x7f03c00b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44136/0 (socket says 172.21.15.17:44136) 2023-08-09T12:46:51.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 -- 172.21.15.17:0/3136979224 learned_addr learned my addr 172.21.15.17:0/3136979224 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:51.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03bffff640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 0x7f03c0151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03b77fe640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c015ce90 0x7f03c015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 -- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c015ce90 msgr2=0x7f03c015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c015ce90 0x7f03c015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 -- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 msgr2=0x7f03c0151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 0x7f03c0151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 -- 172.21.15.17:0/3136979224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8009400 con 0x7f03c01616e0 2023-08-09T12:46:51.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.600+0000 7f03c4e84640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01616e0 0x7f03c00b4570 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f03b802bee0 tx=0x7f03b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.601+0000 7f03bd7fa640 1 -- 172.21.15.17:0/3136979224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b803a830 con 0x7f03c01616e0 2023-08-09T12:46:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.601+0000 7f03bd7fa640 1 -- 172.21.15.17:0/3136979224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b803a990 con 0x7f03c01616e0 2023-08-09T12:46:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.601+0000 7f03bd7fa640 1 -- 172.21.15.17:0/3136979224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b803ad40 con 0x7f03c01616e0 2023-08-09T12:46:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.601+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c00cae90 con 0x7f03c01616e0 2023-08-09T12:46:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.601+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c00cb450 con 0x7f03c01616e0 2023-08-09T12:46:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.602+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c00cb970 con 0x7f03c01616e0 2023-08-09T12:46:51.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.603+0000 7f03bd7fa640 1 -- 172.21.15.17:0/3136979224 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f03b804d440 con 0x7f03c01616e0 2023-08-09T12:46:51.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.604+0000 7f03bd7fa640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03a006a080 0x7f03a006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:51.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.604+0000 7f03bd7fa640 1 -- 172.21.15.17:0/3136979224 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f03b80aa410 con 0x7f03c01616e0 2023-08-09T12:46:51.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.605+0000 7f03bffff640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03a006a080 0x7f03a006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:51.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.606+0000 7f03bffff640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03a006a080 0x7f03a006c540 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f03b0005880 tx=0x7f03b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.608+0000 7f03bd7fa640 1 -- 172.21.15.17:0/3136979224 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f03c00cb970 con 0x7f03c01616e0 2023-08-09T12:46:51.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.812+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03c00cb970 con 0x7f03c01616e0 2023-08-09T12:46:51.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.813+0000 7f03bd7fa640 1 -- 172.21.15.17:0/3136979224 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03c00cb970 con 0x7f03c01616e0 2023-08-09T12:46:51.816 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:46:51.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03a006a080 msgr2=0x7f03a006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03a006a080 0x7f03a006c540 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f03b0005880 tx=0x7f03b0009040 comp rx=0 tx=0).stop 2023-08-09T12:46:51.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01616e0 msgr2=0x7f03c00b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:51.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01616e0 0x7f03c00b4570 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f03b802bee0 tx=0x7f03b80046c0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 shutdown_connections 2023-08-09T12:46:51.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f03a006a080 0x7f03a006c540 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01616e0 0x7f03c00b4570 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03c015ce90 0x7f03c015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 --2- 172.21.15.17:0/3136979224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03c00d29d0 0x7f03c0151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:51.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 >> 172.21.15.17:0/3136979224 conn(0x7f03c006fde0 msgr2=0x7f03c00b8440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:51.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 shutdown_connections 2023-08-09T12:46:51.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:51.816+0000 7f03c68e7640 1 -- 172.21.15.17:0/3136979224 wait complete. 2023-08-09T12:46:51.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:46:52.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.065+0000 7fc93684d640 1 Processor -- start 2023-08-09T12:46:52.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.065+0000 7fc93684d640 1 -- start start 2023-08-09T12:46:52.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.067+0000 7fc93684d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930163c10 0x7fc930166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.067+0000 7fc93684d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93006c990 con 0x7fc9300adc40 2023-08-09T12:46:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.067+0000 7fc93684d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9300b2250 con 0x7fc9300b3b40 2023-08-09T12:46:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.067+0000 7fc93684d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300ae020 con 0x7fc930163c10 2023-08-09T12:46:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.067+0000 7fc92ffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc9300adc40 0x7fc93006c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34050/0 (socket says 172.21.15.17:34050) 2023-08-09T12:46:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92ffff640 1 -- 172.21.15.17:0/3468380752 learned_addr learned my addr 172.21.15.17:0/3468380752 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc934dea640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930163c10 0x7fc930166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991441350 0 0) 0x7fc93006c990 con 0x7fc9300adc40 2023-08-09T12:46:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc918003520 con 0x7fc9300adc40 2023-08-09T12:46:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397670491 0 0) 0x7fc918003520 con 0x7fc9300adc40 2023-08-09T12:46:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930163c10 msgr2=0x7fc930166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92effd640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930163c10 0x7fc930166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 >> v1:172.21.15.142:6789/0 conn(0x7fc9300b3b40 legacy=0x7fc9300b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300b2530 con 0x7fc9300adc40 2023-08-09T12:46:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.068+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc920001670 con 0x7fc9300adc40 2023-08-09T12:46:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 >> v1:172.21.15.17:6789/0 conn(0x7fc9300adc40 legacy=0x7fc93006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc92effd640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9180039a0 0x7fc918003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc92effd640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930163c10 0x7fc9180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc92effd640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc918004d00 0x7fc918005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300ae020 con 0x7fc918004d00 2023-08-09T12:46:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91800bae0 con 0x7fc9180039a0 2023-08-09T12:46:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91800bca0 con 0x7fc930163c10 2023-08-09T12:46:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc934dea640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc918004d00 0x7fc918005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc92ffff640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9180039a0 0x7fc918003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc934dea640 1 -- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930163c10 msgr2=0x7fc9180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc934dea640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc930163c10 0x7fc9180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc934dea640 1 -- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9180039a0 msgr2=0x7fc918003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc934dea640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9180039a0 0x7fc918003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.069+0000 7fc934dea640 1 -- 172.21.15.17:0/3468380752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc918003520 con 0x7fc918004d00 2023-08-09T12:46:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.071+0000 7fc934dea640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc918004d00 0x7fc918005180 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc9300cb010 tx=0x7fc9180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad1396a90dcd7ea server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:52.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.071+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92802cbd0 con 0x7fc918004d00 2023-08-09T12:46:52.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.071+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92800f040 con 0x7fc918004d00 2023-08-09T12:46:52.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.071+0000 7fc92effd640 1 -- 172.21.15.17:0/3468380752 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928034440 con 0x7fc918004d00 2023-08-09T12:46:52.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.071+0000 7fc93684d640 1 -- 172.21.15.17:0/3468380752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc918004d00 msgr2=0x7fc918005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.071+0000 7fc93684d640 1 --2- 172.21.15.17:0/3468380752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc918004d00 0x7fc918005180 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc9300cb010 tx=0x7fc9180057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.071+0000 7fc934dea640 1 -- 172.21.15.17:0/3468380752 reap_dead start 2023-08-09T12:46:52.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.071+0000 7fc93684d640 1 -- 172.21.15.17:0/3468380752 shutdown_connections 2023-08-09T12:46:52.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.072+0000 7fc93684d640 1 -- 172.21.15.17:0/3468380752 >> 172.21.15.17:0/3468380752 conn(0x7fc9300cb1b0 msgr2=0x7fc9300cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:52.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.072+0000 7fc93684d640 1 -- 172.21.15.17:0/3468380752 shutdown_connections 2023-08-09T12:46:52.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.072+0000 7fc93684d640 1 -- 172.21.15.17:0/3468380752 wait complete. 2023-08-09T12:46:52.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.073+0000 7fc93684d640 1 Processor -- start 2023-08-09T12:46:52.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.074+0000 7fc93684d640 1 -- start start 2023-08-09T12:46:52.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc93684d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc918004d00 0x7fc9300aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc93684d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9300c30c0 0x7fc9300c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc93684d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc930156010 0x7fc930156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc93684d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300ca590 con 0x7fc9300c30c0 2023-08-09T12:46:52.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc93684d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300c2300 con 0x7fc930156010 2023-08-09T12:46:52.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc93684d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300c25e0 con 0x7fc918004d00 2023-08-09T12:46:52.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc92f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9300c30c0 0x7fc9300c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc92f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9300c30c0 0x7fc9300c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44160/0 (socket says 172.21.15.17:44160) 2023-08-09T12:46:52.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc92f7fe640 1 -- 172.21.15.17:0/592559043 learned_addr learned my addr 172.21.15.17:0/592559043 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:52.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc92ffff640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc918004d00 0x7fc9300aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.075+0000 7fc934dea640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc930156010 0x7fc930156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92f7fe640 1 -- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc918004d00 msgr2=0x7fc9300aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92f7fe640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc918004d00 0x7fc9300aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92f7fe640 1 -- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc930156010 msgr2=0x7fc930156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92f7fe640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc930156010 0x7fc930156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92f7fe640 1 -- 172.21.15.17:0/592559043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300c28c0 con 0x7fc9300c30c0 2023-08-09T12:46:52.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc934dea640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc930156010 0x7fc930156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:52.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92f7fe640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9300c30c0 0x7fc9300c3540 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc92400c4d0 tx=0x7fc92400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:52.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92cff9640 1 -- 172.21.15.17:0/592559043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240052d0 con 0x7fc9300c30c0 2023-08-09T12:46:52.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92cff9640 1 -- 172.21.15.17:0/592559043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924005430 con 0x7fc9300c30c0 2023-08-09T12:46:52.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc92cff9640 1 -- 172.21.15.17:0/592559043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924003860 con 0x7fc9300c30c0 2023-08-09T12:46:52.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9300c2ba0 con 0x7fc9300c30c0 2023-08-09T12:46:52.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.076+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9300af0c0 con 0x7fc9300c30c0 2023-08-09T12:46:52.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.078+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc930067a80 con 0x7fc9300c30c0 2023-08-09T12:46:52.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.079+0000 7fc92cff9640 1 -- 172.21.15.17:0/592559043 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc9240039c0 con 0x7fc9300c30c0 2023-08-09T12:46:52.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.079+0000 7fc92cff9640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc91c06a050 0x7fc91c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.080+0000 7fc92cff9640 1 -- 172.21.15.17:0/592559043 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc924087e30 con 0x7fc9300c30c0 2023-08-09T12:46:52.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.080+0000 7fc92ffff640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc91c06a050 0x7fc91c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.081+0000 7fc92ffff640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc91c06a050 0x7fc91c06c510 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc920001c90 tx=0x7fc920009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:52.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.084+0000 7fc92cff9640 1 -- 172.21.15.17:0/592559043 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc924053860 con 0x7fc9300c30c0 2023-08-09T12:46:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.280+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc93006ed40 con 0x7fc9300c30c0 2023-08-09T12:46:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.281+0000 7fc92cff9640 1 -- 172.21.15.17:0/592559043 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v126) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc924056e80 con 0x7fc9300c30c0 2023-08-09T12:46:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:52.285 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:46:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:46:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:46:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:46:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:46:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:46:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:46:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:46:52.288 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:46:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.284+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc91c06a050 msgr2=0x7fc91c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.284+0000 7fc93684d640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc91c06a050 0x7fc91c06c510 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc920001c90 tx=0x7fc920009040 comp rx=0 tx=0).stop 2023-08-09T12:46:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.284+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9300c30c0 msgr2=0x7fc9300c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.284+0000 7fc93684d640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9300c30c0 0x7fc9300c3540 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc92400c4d0 tx=0x7fc92400c990 comp rx=0 tx=0).stop 2023-08-09T12:46:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.284+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 shutdown_connections 2023-08-09T12:46:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.285+0000 7fc93684d640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc91c06a050 0x7fc91c06c510 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.285+0000 7fc93684d640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc930156010 0x7fc930156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.285+0000 7fc93684d640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9300c30c0 0x7fc9300c3540 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.285+0000 7fc93684d640 1 --2- 172.21.15.17:0/592559043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc918004d00 0x7fc9300aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.285+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 >> 172.21.15.17:0/592559043 conn(0x7fc9300cb1b0 msgr2=0x7fc93006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:52.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.285+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 shutdown_connections 2023-08-09T12:46:52.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.285+0000 7fc93684d640 1 -- 172.21.15.17:0/592559043 wait complete. 2023-08-09T12:46:52.307 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:46:52.308 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:46:52.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.538+0000 7f7ee0c1f640 1 Processor -- start 2023-08-09T12:46:52.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.538+0000 7f7ee0c1f640 1 -- start start 2023-08-09T12:46:52.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7ee0c1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 0x7f7edc160e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7ee0c1f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7edc1613a0 0x7f7edc0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7ee0c1f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc15b1b0 con 0x7f7edc15add0 2023-08-09T12:46:52.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7ee0c1f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0cd6e0 con 0x7f7edc1613a0 2023-08-09T12:46:52.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7ee0c1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0cd9c0 con 0x7f7edc0704f0 2023-08-09T12:46:52.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7eda59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7edc15add0 0x7f7edc06fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34064/0 (socket says 172.21.15.17:34064) 2023-08-09T12:46:52.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7eda59c640 1 -- 172.21.15.17:0/2162831235 learned_addr learned my addr 172.21.15.17:0/2162831235 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:52.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7ed9d9b640 1 --2- 172.21.15.17:0/2162831235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 0x7f7edc160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.540+0000 7f7edad9d640 1 --2- 172.21.15.17:0/2162831235 >> v2:172.21.15.142:3300/0 conn(0x7f7edc1613a0 0x7f7edc0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.541+0000 7f7ed959a640 1 -- 172.21.15.17:0/2162831235 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44325935 0 0) 0x7f7edc15b1b0 con 0x7f7edc15add0 2023-08-09T12:46:52.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.541+0000 7f7ed959a640 1 -- 172.21.15.17:0/2162831235 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec4003520 con 0x7f7edc15add0 2023-08-09T12:46:52.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.541+0000 7f7edad9d640 1 -- 172.21.15.17:0/2162831235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 msgr2=0x7f7edc160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:52.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.541+0000 7f7edad9d640 1 --2- 172.21.15.17:0/2162831235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 0x7f7edc160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.541+0000 7f7edad9d640 1 -- 172.21.15.17:0/2162831235 >> v1:172.21.15.17:6789/0 conn(0x7f7edc15add0 legacy=0x7f7edc06fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.541+0000 7f7ed959a640 1 -- 172.21.15.17:0/2162831235 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1707465104 0 0) 0x7f7ec4003520 con 0x7f7edc15add0 2023-08-09T12:46:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.541+0000 7f7edad9d640 1 -- 172.21.15.17:0/2162831235 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0cdca0 con 0x7f7edc1613a0 2023-08-09T12:46:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.543+0000 7f7edad9d640 1 --2- 172.21.15.17:0/2162831235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 0x7f7edc0d1110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed402bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8789a2c69c4105d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.543+0000 7f7ed959a640 1 -- 172.21.15.17:0/2162831235 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc001670 con 0x7f7edc1613a0 2023-08-09T12:46:52.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.543+0000 7f7ed959a640 1 -- 172.21.15.17:0/2162831235 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed402c8a0 con 0x7f7edc1613a0 2023-08-09T12:46:52.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ed959a640 1 -- 172.21.15.17:0/2162831235 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed402cc30 con 0x7f7edc1613a0 2023-08-09T12:46:52.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/2162831235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 msgr2=0x7f7edc0d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/2162831235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 0x7f7edc0d1110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed402bd70 comp rx=0 tx=0).stop 2023-08-09T12:46:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/2162831235 shutdown_connections 2023-08-09T12:46:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/2162831235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 0x7f7edc0d1110 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/2162831235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 0x7f7edc160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/2162831235 >> 172.21.15.17:0/2162831235 conn(0x7f7edc0d2b50 msgr2=0x7f7edc0d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/2162831235 shutdown_connections 2023-08-09T12:46:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.544+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/2162831235 wait complete. 2023-08-09T12:46:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.546+0000 7f7ee0c1f640 1 Processor -- start 2023-08-09T12:46:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.546+0000 7f7ee0c1f640 1 -- start start 2023-08-09T12:46:52.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.547+0000 7f7ee0c1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 0x7f7edc1f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.547+0000 7f7ee0c1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7edc15add0 0x7f7edc14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.547+0000 7f7ee0c1f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 0x7f7edc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.547+0000 7f7ee0c1f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc14dc90 con 0x7f7edc15add0 2023-08-09T12:46:52.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.547+0000 7f7ee0c1f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc14d6d0 con 0x7f7edc1613a0 2023-08-09T12:46:52.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.547+0000 7f7ee0c1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc14d9b0 con 0x7f7edc0704f0 2023-08-09T12:46:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7edc15add0 0x7f7edc14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7edc15add0 0x7f7edc14cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44170/0 (socket says 172.21.15.17:44170) 2023-08-09T12:46:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 -- 172.21.15.17:0/3429922475 learned_addr learned my addr 172.21.15.17:0/3429922475 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7eda59c640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 0x7f7edc1f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 -- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 msgr2=0x7f7edc1f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7edad9d640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 0x7f7edc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 0x7f7edc1f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 -- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 msgr2=0x7f7edc0b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 0x7f7edc0b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 -- 172.21.15.17:0/3429922475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009a70 con 0x7f7edc15add0 2023-08-09T12:46:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.548+0000 7f7ed9d9b640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7edc15add0 0x7f7edc14cc30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000e9b0 tx=0x7f7ed000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.549+0000 7f7ecaffd640 1 -- 172.21.15.17:0/3429922475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0009670 con 0x7f7edc15add0 2023-08-09T12:46:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.549+0000 7f7ecaffd640 1 -- 172.21.15.17:0/3429922475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed000c9a0 con 0x7f7edc15add0 2023-08-09T12:46:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.549+0000 7f7ecaffd640 1 -- 172.21.15.17:0/3429922475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000cd50 con 0x7f7edc15add0 2023-08-09T12:46:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.549+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc14ad70 con 0x7f7edc15add0 2023-08-09T12:46:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.549+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc0c89b0 con 0x7f7edc15add0 2023-08-09T12:46:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.550+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc14abd0 con 0x7f7edc15add0 2023-08-09T12:46:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.551+0000 7f7ecaffd640 1 -- 172.21.15.17:0/3429922475 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ed0013470 con 0x7f7edc15add0 2023-08-09T12:46:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.552+0000 7f7ecaffd640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ebc06a080 0x7f7ebc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.552+0000 7f7ecaffd640 1 -- 172.21.15.17:0/3429922475 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7ed00884f0 con 0x7f7edc15add0 2023-08-09T12:46:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.553+0000 7f7eda59c640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ebc06a080 0x7f7ebc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.554+0000 7f7eda59c640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ebc06a080 0x7f7ebc06c540 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc001eb0 tx=0x7f7ecc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.556+0000 7f7ecaffd640 1 -- 172.21.15.17:0/3429922475 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7edc14abd0 con 0x7f7edc15add0 2023-08-09T12:46:52.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:52.747+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7edc14abd0 con 0x7f7edc15add0 2023-08-09T12:46:53.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.072+0000 7f7ecaffd640 1 -- 172.21.15.17:0/3429922475 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v127) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7edc14abd0 con 0x7f7edc15add0 2023-08-09T12:46:53.077 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:46:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ebc06a080 msgr2=0x7f7ebc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ebc06a080 0x7f7ebc06c540 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc001eb0 tx=0x7f7ecc009040 comp rx=0 tx=0).stop 2023-08-09T12:46:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7edc15add0 msgr2=0x7f7edc14cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:53.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7edc15add0 0x7f7edc14cc30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000e9b0 tx=0x7f7ed000ee70 comp rx=0 tx=0).stop 2023-08-09T12:46:53.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 shutdown_connections 2023-08-09T12:46:53.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ebc06a080 0x7f7ebc06c540 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1613a0 0x7f7edc0b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7edc15add0 0x7f7edc14cc30 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 --2- 172.21.15.17:0/3429922475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc0704f0 0x7f7edc1f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.078+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 >> 172.21.15.17:0/3429922475 conn(0x7f7edc0d2b50 msgr2=0x7f7edc0cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.079+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 shutdown_connections 2023-08-09T12:46:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.079+0000 7f7ee0c1f640 1 -- 172.21.15.17:0/3429922475 wait complete. 2023-08-09T12:46:53.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:46:53.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.342+0000 7fb148b2f640 1 Processor -- start 2023-08-09T12:46:53.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.342+0000 7fb148b2f640 1 -- start start 2023-08-09T12:46:53.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.344+0000 7fb148b2f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb144161000 0x7fb1440b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.344+0000 7fb148b2f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1440c14c0 0x7fb1440b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.344+0000 7fb148b2f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440cc170 con 0x7fb1440b41c0 2023-08-09T12:46:53.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.344+0000 7fb148b2f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440cc450 con 0x7fb1440c14c0 2023-08-09T12:46:53.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.344+0000 7fb148b2f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440cc730 con 0x7fb144161000 2023-08-09T12:46:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb142ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb1440b41c0 0x7fb1440697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34072/0 (socket says 172.21.15.17:34072) 2023-08-09T12:46:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb142ffd640 1 -- 172.21.15.17:0/1797473300 learned_addr learned my addr 172.21.15.17:0/1797473300 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb1437fe640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb144161000 0x7fb1440b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb143fff640 1 --2- 172.21.15.17:0/1797473300 >> v2:172.21.15.142:3300/0 conn(0x7fb1440c14c0 0x7fb1440b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598328272 0 0) 0x7fb1440cc170 con 0x7fb1440b41c0 2023-08-09T12:46:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb12c003520 con 0x7fb1440b41c0 2023-08-09T12:46:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028808372 0 0) 0x7fb12c003520 con 0x7fb1440b41c0 2023-08-09T12:46:53.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb144161000 msgr2=0x7fb1440b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:53.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb1427fc640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb144161000 0x7fb1440b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 >> v2:172.21.15.142:3300/0 conn(0x7fb1440c14c0 msgr2=0x7fb1440b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:53.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.345+0000 7fb1427fc640 1 --2- 172.21.15.17:0/1797473300 >> v2:172.21.15.142:3300/0 conn(0x7fb1440c14c0 0x7fb1440b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440cca10 con 0x7fb1440b41c0 2023-08-09T12:46:53.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fb138001670 con 0x7fb1440b41c0 2023-08-09T12:46:53.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 >> v1:172.21.15.17:6789/0 conn(0x7fb1440b41c0 legacy=0x7fb1440697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb12c003970 0x7fb12c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb144161000 0x7fb12c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb12c004d00 0x7fb12c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440cc450 con 0x7fb12c003970 2023-08-09T12:46:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440cc730 con 0x7fb12c004d00 2023-08-09T12:46:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c00b980 con 0x7fb144161000 2023-08-09T12:46:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1437fe640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb12c003970 0x7fb12c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb142ffd640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb144161000 0x7fb12c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb143fff640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb12c004d00 0x7fb12c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1437fe640 1 -- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb144161000 msgr2=0x7fb12c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1437fe640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb144161000 0x7fb12c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.346+0000 7fb1437fe640 1 -- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb12c004d00 msgr2=0x7fb12c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.347+0000 7fb1437fe640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb12c004d00 0x7fb12c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.347+0000 7fb1437fe640 1 -- 172.21.15.17:0/1797473300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c003520 con 0x7fb12c003970 2023-08-09T12:46:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.347+0000 7fb143fff640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb12c004d00 0x7fb12c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:53.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.348+0000 7fb1437fe640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb12c003970 0x7fb12c003d90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fb134009ac0 tx=0x7fb12c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193c076903253ae3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.348+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13402c6b0 con 0x7fb12c003970 2023-08-09T12:46:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.348+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13402c810 con 0x7fb12c003970 2023-08-09T12:46:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.348+0000 7fb1427fc640 1 -- 172.21.15.17:0/1797473300 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13402cba0 con 0x7fb12c003970 2023-08-09T12:46:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.349+0000 7fb148b2f640 1 -- 172.21.15.17:0/1797473300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb12c003970 msgr2=0x7fb12c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.349+0000 7fb148b2f640 1 --2- 172.21.15.17:0/1797473300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb12c003970 0x7fb12c003d90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fb134009ac0 tx=0x7fb12c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.349+0000 7fb143fff640 1 -- 172.21.15.17:0/1797473300 reap_dead start 2023-08-09T12:46:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.349+0000 7fb148b2f640 1 -- 172.21.15.17:0/1797473300 shutdown_connections 2023-08-09T12:46:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.349+0000 7fb148b2f640 1 -- 172.21.15.17:0/1797473300 >> 172.21.15.17:0/1797473300 conn(0x7fb1440cb020 msgr2=0x7fb1440cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.349+0000 7fb148b2f640 1 -- 172.21.15.17:0/1797473300 shutdown_connections 2023-08-09T12:46:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.349+0000 7fb148b2f640 1 -- 172.21.15.17:0/1797473300 wait complete. 2023-08-09T12:46:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.351+0000 7fb148b2f640 1 Processor -- start 2023-08-09T12:46:53.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.351+0000 7fb148b2f640 1 -- start start 2023-08-09T12:46:53.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb148b2f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb12c003970 0x7fb1440714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb148b2f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb14406ead0 0x7fb14414f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb148b2f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb14414fee0 0x7fb1440cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb148b2f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb144071a30 con 0x7fb14406ead0 2023-08-09T12:46:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb148b2f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb144150370 con 0x7fb14414fee0 2023-08-09T12:46:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb148b2f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb144163020 con 0x7fb12c003970 2023-08-09T12:46:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb142ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb14406ead0 0x7fb14414f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb142ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb14406ead0 0x7fb14414f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44194/0 (socket says 172.21.15.17:44194) 2023-08-09T12:46:53.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.352+0000 7fb142ffd640 1 -- 172.21.15.17:0/3542037595 learned_addr learned my addr 172.21.15.17:0/3542037595 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:53.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb143fff640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb14414fee0 0x7fb1440cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb1437fe640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb12c003970 0x7fb1440714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb142ffd640 1 -- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb12c003970 msgr2=0x7fb1440714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:53.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb142ffd640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb12c003970 0x7fb1440714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb142ffd640 1 -- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb14414fee0 msgr2=0x7fb1440cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb142ffd640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb14414fee0 0x7fb1440cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb142ffd640 1 -- 172.21.15.17:0/3542037595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144163300 con 0x7fb14406ead0 2023-08-09T12:46:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb1437fe640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb12c003970 0x7fb1440714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb143fff640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb14414fee0 0x7fb1440cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb142ffd640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb14406ead0 0x7fb14414f9a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fb138001eb0 tx=0x7fb13800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb12bfff640 1 -- 172.21.15.17:0/3542037595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800ee60 con 0x7fb14406ead0 2023-08-09T12:46:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.353+0000 7fb12bfff640 1 -- 172.21.15.17:0/3542037595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13800c840 con 0x7fb14406ead0 2023-08-09T12:46:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.354+0000 7fb12bfff640 1 -- 172.21.15.17:0/3542037595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800cbd0 con 0x7fb14406ead0 2023-08-09T12:46:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.354+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1441635e0 con 0x7fb14406ead0 2023-08-09T12:46:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.354+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1441537e0 con 0x7fb14406ead0 2023-08-09T12:46:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.355+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb144163800 con 0x7fb14406ead0 2023-08-09T12:46:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.356+0000 7fb12bfff640 1 -- 172.21.15.17:0/3542037595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb13800cd30 con 0x7fb14406ead0 2023-08-09T12:46:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.357+0000 7fb12bfff640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb13006a050 0x7fb13006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.358+0000 7fb12bfff640 1 -- 172.21.15.17:0/3542037595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb138088e60 con 0x7fb14406ead0 2023-08-09T12:46:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.358+0000 7fb1437fe640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb13006a050 0x7fb13006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.359+0000 7fb1437fe640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb13006a050 0x7fb13006c510 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb134036000 tx=0x7fb134030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.361+0000 7fb12bfff640 1 -- 172.21.15.17:0/3542037595 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb138054710 con 0x7fb14406ead0 2023-08-09T12:46:53.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:53.556+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb14404e390 con 0x7fb14406ead0 2023-08-09T12:46:54.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.079+0000 7fb12bfff640 1 -- 172.21.15.17:0/3542037595 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v128) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb138057d30 con 0x7fb14406ead0 2023-08-09T12:46:54.091 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:46:54.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb13006a050 msgr2=0x7fb13006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:54.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb13006a050 0x7fb13006c510 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb134036000 tx=0x7fb134030000 comp rx=0 tx=0).stop 2023-08-09T12:46:54.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb14406ead0 msgr2=0x7fb14414f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:54.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb14406ead0 0x7fb14414f9a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fb138001eb0 tx=0x7fb13800ec10 comp rx=0 tx=0).stop 2023-08-09T12:46:54.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 shutdown_connections 2023-08-09T12:46:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb13006a050 0x7fb13006c510 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb14414fee0 0x7fb1440cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb14406ead0 0x7fb14414f9a0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 --2- 172.21.15.17:0/3542037595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb12c003970 0x7fb1440714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.095+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 >> 172.21.15.17:0/3542037595 conn(0x7fb1440cb020 msgr2=0x7fb1440ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:54.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.096+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 shutdown_connections 2023-08-09T12:46:54.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.096+0000 7fb148b2f640 1 -- 172.21.15.17:0/3542037595 wait complete. 2023-08-09T12:46:54.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:46:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.329+0000 7fe0422f3640 1 Processor -- start 2023-08-09T12:46:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.329+0000 7fe0422f3640 1 -- start start 2023-08-09T12:46:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.330+0000 7fe0422f3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe03c0d30e0 0x7fe03c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.330+0000 7fe0422f3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c0cdd10 con 0x7fe03c1616e0 2023-08-09T12:46:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.330+0000 7fe0422f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c0cdff0 con 0x7fe03c15ce90 2023-08-09T12:46:54.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.330+0000 7fe0422f3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03c0b6540 con 0x7fe03c0d30e0 2023-08-09T12:46:54.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.330+0000 7fe03b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe03c1616e0 0x7fe03c0d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34076/0 (socket says 172.21.15.17:34076) 2023-08-09T12:46:54.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.330+0000 7fe03b7fe640 1 -- 172.21.15.17:0/444978324 learned_addr learned my addr 172.21.15.17:0/444978324 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe040890640 1 --2- 172.21.15.17:0/444978324 >> v2:172.21.15.142:3300/0 conn(0x7fe03c0d30e0 0x7fe03c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011369813 0 0) 0x7fe03c0cdd10 con 0x7fe03c1616e0 2023-08-09T12:46:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe028003520 con 0x7fe03c1616e0 2023-08-09T12:46:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2712909934 0 0) 0x7fe028003520 con 0x7fe03c1616e0 2023-08-09T12:46:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 >> v2:172.21.15.142:3300/0 conn(0x7fe03c0d30e0 msgr2=0x7fe03c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 --2- 172.21.15.17:0/444978324 >> v2:172.21.15.142:3300/0 conn(0x7fe03c0d30e0 0x7fe03c0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 >> v1:172.21.15.142:6789/0 conn(0x7fe03c15ce90 legacy=0x7fe03c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0ce2d0 con 0x7fe03c1616e0 2023-08-09T12:46:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe02c001670 con 0x7fe03c1616e0 2023-08-09T12:46:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 >> v1:172.21.15.17:6789/0 conn(0x7fe03c1616e0 legacy=0x7fe03c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028003970 0x7fe028003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0280047c0 0x7fe028004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe028005180 0x7fe02800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:54.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0b6540 con 0x7fe028005180 2023-08-09T12:46:54.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02800c000 con 0x7fe0280047c0 2023-08-09T12:46:54.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.331+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02800c1c0 con 0x7fe028003970 2023-08-09T12:46:54.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.332+0000 7fe040890640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe028005180 0x7fe02800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:54.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.332+0000 7fe03b7fe640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0280047c0 0x7fe028004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:54.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.332+0000 7fe03bfff640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028003970 0x7fe028003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:54.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.332+0000 7fe040890640 1 -- 172.21.15.17:0/444978324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028003970 msgr2=0x7fe028003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:54.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.332+0000 7fe040890640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028003970 0x7fe028003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.332+0000 7fe040890640 1 -- 172.21.15.17:0/444978324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0280047c0 msgr2=0x7fe028004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:54.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.332+0000 7fe040890640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0280047c0 0x7fe028004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.332+0000 7fe040890640 1 -- 172.21.15.17:0/444978324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028003520 con 0x7fe028005180 2023-08-09T12:46:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.333+0000 7fe040890640 1 -- 172.21.15.17:0/444978324 reap_dead start 2023-08-09T12:46:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.333+0000 7fe040890640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe028005180 0x7fe02800b980 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fe034009f90 tx=0x7fe0280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825e885c0f2d7c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.334+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03402cc20 con 0x7fe028005180 2023-08-09T12:46:54.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.334+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03400f040 con 0x7fe028005180 2023-08-09T12:46:54.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.334+0000 7fe03affd640 1 -- 172.21.15.17:0/444978324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034003990 con 0x7fe028005180 2023-08-09T12:46:54.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.334+0000 7fe0422f3640 1 -- 172.21.15.17:0/444978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe028005180 msgr2=0x7fe02800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:54.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.334+0000 7fe0422f3640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe028005180 0x7fe02800b980 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fe034009f90 tx=0x7fe0280057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.334+0000 7fe0422f3640 1 -- 172.21.15.17:0/444978324 shutdown_connections 2023-08-09T12:46:54.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.334+0000 7fe0422f3640 1 --2- 172.21.15.17:0/444978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe028005180 0x7fe02800b980 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.334+0000 7fe0422f3640 1 -- 172.21.15.17:0/444978324 >> 172.21.15.17:0/444978324 conn(0x7fe03c06fde0 msgr2=0x7fe03c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:54.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.335+0000 7fe0422f3640 1 -- 172.21.15.17:0/444978324 shutdown_connections 2023-08-09T12:46:54.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.335+0000 7fe0422f3640 1 -- 172.21.15.17:0/444978324 wait complete. 2023-08-09T12:46:54.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.336+0000 7fe0422f3640 1 Processor -- start 2023-08-09T12:46:54.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.336+0000 7fe0422f3640 1 -- start start 2023-08-09T12:46:54.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.337+0000 7fe0422f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028005180 0x7fe03c0a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:54.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.337+0000 7fe0422f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe03c0a9c80 0x7fe03c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:54.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.337+0000 7fe0422f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe03c0b0a60 0x7fe03c0cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:54.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.337+0000 7fe0422f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c14f110 con 0x7fe03c0a9c80 2023-08-09T12:46:54.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.337+0000 7fe0422f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0b0f10 con 0x7fe03c0b0a60 2023-08-09T12:46:54.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.337+0000 7fe0422f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0cc5e0 con 0x7fe028005180 2023-08-09T12:46:54.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe03c0a9c80 0x7fe03c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:54.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe03c0a9c80 0x7fe03c0b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44224/0 (socket says 172.21.15.17:44224) 2023-08-09T12:46:54.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03b7fe640 1 -- 172.21.15.17:0/2930488928 learned_addr learned my addr 172.21.15.17:0/2930488928 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:54.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03bfff640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028005180 0x7fe03c0a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:54.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe040890640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe03c0b0a60 0x7fe03c0cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03b7fe640 1 -- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028005180 msgr2=0x7fe03c0a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03b7fe640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028005180 0x7fe03c0a9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03b7fe640 1 -- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe03c0b0a60 msgr2=0x7fe03c0cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03b7fe640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe03c0b0a60 0x7fe03c0cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe03b7fe640 1 -- 172.21.15.17:0/2930488928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c14cf50 con 0x7fe03c0a9c80 2023-08-09T12:46:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.338+0000 7fe040890640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe03c0b0a60 0x7fe03c0cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.339+0000 7fe03b7fe640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe03c0a9c80 0x7fe03c0b0520 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00e730 tx=0x7fe02c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.339+0000 7fe038ff9640 1 -- 172.21.15.17:0/2930488928 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00ee40 con 0x7fe03c0a9c80 2023-08-09T12:46:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.339+0000 7fe038ff9640 1 -- 172.21.15.17:0/2930488928 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c00c8d0 con 0x7fe03c0a9c80 2023-08-09T12:46:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.339+0000 7fe038ff9640 1 -- 172.21.15.17:0/2930488928 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00cc80 con 0x7fe03c0a9c80 2023-08-09T12:46:54.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.339+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c0cc300 con 0x7fe03c0a9c80 2023-08-09T12:46:54.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.339+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c14cbe0 con 0x7fe03c0a9c80 2023-08-09T12:46:54.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.340+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c14d0e0 con 0x7fe03c0a9c80 2023-08-09T12:46:54.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.342+0000 7fe038ff9640 1 -- 172.21.15.17:0/2930488928 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe02c01d460 con 0x7fe03c0a9c80 2023-08-09T12:46:54.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.343+0000 7fe038ff9640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe01c06a080 0x7fe01c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.343+0000 7fe038ff9640 1 -- 172.21.15.17:0/2930488928 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe02c088f10 con 0x7fe03c0a9c80 2023-08-09T12:46:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.344+0000 7fe03bfff640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe01c06a080 0x7fe01c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.345+0000 7fe03bfff640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe01c06a080 0x7fe01c06c540 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe024004dc0 tx=0x7fe024009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.347+0000 7fe038ff9640 1 -- 172.21.15.17:0/2930488928 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe02c0546d0 con 0x7fe03c0a9c80 2023-08-09T12:46:54.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:54.577+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe03c067a80 con 0x7fe03c0a9c80 2023-08-09T12:46:55.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.142+0000 7fe038ff9640 1 -- 172.21.15.17:0/2930488928 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v55) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe02c057cf0 con 0x7fe03c0a9c80 2023-08-09T12:46:55.146 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 15 and data pool 16 2023-08-09T12:46:55.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.149+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe01c06a080 msgr2=0x7fe01c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.149+0000 7fe0422f3640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe01c06a080 0x7fe01c06c540 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe024004dc0 tx=0x7fe024009040 comp rx=0 tx=0).stop 2023-08-09T12:46:55.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.150+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe03c0a9c80 msgr2=0x7fe03c0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.150+0000 7fe0422f3640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe03c0a9c80 0x7fe03c0b0520 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00e730 tx=0x7fe02c00ebf0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.150+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 shutdown_connections 2023-08-09T12:46:55.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.150+0000 7fe0422f3640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe01c06a080 0x7fe01c06c540 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.150+0000 7fe0422f3640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe03c0b0a60 0x7fe03c0cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.150+0000 7fe0422f3640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe03c0a9c80 0x7fe03c0b0520 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.150+0000 7fe0422f3640 1 --2- 172.21.15.17:0/2930488928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe028005180 0x7fe03c0a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.150+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 >> 172.21.15.17:0/2930488928 conn(0x7fe03c06fde0 msgr2=0x7fe03c0b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.152+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 shutdown_connections 2023-08-09T12:46:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.153+0000 7fe0422f3640 1 -- 172.21.15.17:0/2930488928 wait complete. 2023-08-09T12:46:55.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.378+0000 7fbfe8300640 1 Processor -- start 2023-08-09T12:46:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.378+0000 7fbfe8300640 1 -- start start 2023-08-09T12:46:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.379+0000 7fbfe8300640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfe015ce90 0x7fbfe01616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.379+0000 7fbfe8300640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbfe00b6000 0x7fbfe00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.379+0000 7fbfe8300640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00d29d0 0x7fbfe00d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.379+0000 7fbfe8300640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00d33a0 con 0x7fbfe015ce90 2023-08-09T12:46:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.379+0000 7fbfe8300640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00b6460 con 0x7fbfe00b6000 2023-08-09T12:46:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.379+0000 7fbfe8300640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00cda40 con 0x7fbfe00d29d0 2023-08-09T12:46:55.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe609c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfe015ce90 0x7fbfe01616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe609c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfe015ce90 0x7fbfe01616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44240/0 (socket says 172.21.15.17:44240) 2023-08-09T12:46:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe609c640 1 -- 172.21.15.17:0/3695216207 learned_addr learned my addr 172.21.15.17:0/3695216207 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe689d640 1 --2- 172.21.15.17:0/3695216207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00d29d0 0x7fbfe00d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe589b640 1 --2- 172.21.15.17:0/3695216207 >> v2:172.21.15.142:3300/0 conn(0x7fbfe00b6000 0x7fbfe00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe609c640 1 -- 172.21.15.17:0/3695216207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00d29d0 msgr2=0x7fbfe00d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe609c640 1 --2- 172.21.15.17:0/3695216207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00d29d0 0x7fbfe00d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe609c640 1 -- 172.21.15.17:0/3695216207 >> v2:172.21.15.142:3300/0 conn(0x7fbfe00b6000 msgr2=0x7fbfe00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:55.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe609c640 1 --2- 172.21.15.17:0/3695216207 >> v2:172.21.15.142:3300/0 conn(0x7fbfe00b6000 0x7fbfe00cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.380+0000 7fbfe609c640 1 -- 172.21.15.17:0/3695216207 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00cdd10 con 0x7fbfe015ce90 2023-08-09T12:46:55.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.382+0000 7fbfe609c640 1 --2- 172.21.15.17:0/3695216207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe01616e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00c9c00 tx=0x7fbfd402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7720b918ae2f0eab server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.382+0000 7fbfe509a640 1 -- 172.21.15.17:0/3695216207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd402ca70 con 0x7fbfe015ce90 2023-08-09T12:46:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.382+0000 7fbfe509a640 1 -- 172.21.15.17:0/3695216207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd402cbd0 con 0x7fbfe015ce90 2023-08-09T12:46:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.382+0000 7fbfe509a640 1 -- 172.21.15.17:0/3695216207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40343f0 con 0x7fbfe015ce90 2023-08-09T12:46:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 -- 172.21.15.17:0/3695216207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 msgr2=0x7fbfe01616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 --2- 172.21.15.17:0/3695216207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe01616e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00c9c00 tx=0x7fbfd402bed0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 -- 172.21.15.17:0/3695216207 shutdown_connections 2023-08-09T12:46:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 --2- 172.21.15.17:0/3695216207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00d29d0 0x7fbfe00d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 --2- 172.21.15.17:0/3695216207 >> v2:172.21.15.142:3300/0 conn(0x7fbfe00b6000 0x7fbfe00cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 --2- 172.21.15.17:0/3695216207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe01616e0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 -- 172.21.15.17:0/3695216207 >> 172.21.15.17:0/3695216207 conn(0x7fbfe006fde0 msgr2=0x7fbfe00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 -- 172.21.15.17:0/3695216207 shutdown_connections 2023-08-09T12:46:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.383+0000 7fbfe8300640 1 -- 172.21.15.17:0/3695216207 wait complete. 2023-08-09T12:46:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.385+0000 7fbfe8300640 1 Processor -- start 2023-08-09T12:46:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.385+0000 7fbfe8300640 1 -- start start 2023-08-09T12:46:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe8300640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00b6000 0x7fbfe0155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe8300640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe00d29d0 0x7fbfe0157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe8300640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe8300640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe0156640 con 0x7fbfe015ce90 2023-08-09T12:46:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe8300640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe01e90c0 con 0x7fbfe00d29d0 2023-08-09T12:46:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe8300640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe0159490 con 0x7fbfe00b6000 2023-08-09T12:46:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe689d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe689d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe015fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44254/0 (socket says 172.21.15.17:44254) 2023-08-09T12:46:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe689d640 1 -- 172.21.15.17:0/722550444 learned_addr learned my addr 172.21.15.17:0/722550444 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.386+0000 7fbfe609c640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00b6000 0x7fbfe0155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe589b640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe00d29d0 0x7fbfe0157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe689d640 1 -- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00b6000 msgr2=0x7fbfe0155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe689d640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00b6000 0x7fbfe0155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe689d640 1 -- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe00d29d0 msgr2=0x7fbfe0157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe689d640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe00d29d0 0x7fbfe0157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe689d640 1 -- 172.21.15.17:0/722550444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009b30 con 0x7fbfe015ce90 2023-08-09T12:46:55.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe609c640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00b6000 0x7fbfe0155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:55.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe689d640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe015fdd0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800d830 tx=0x7fbfd800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:55.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfdeffd640 1 -- 172.21.15.17:0/722550444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800b6c0 con 0x7fbfe015ce90 2023-08-09T12:46:55.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfdeffd640 1 -- 172.21.15.17:0/722550444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800b840 con 0x7fbfe015ce90 2023-08-09T12:46:55.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfdeffd640 1 -- 172.21.15.17:0/722550444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800bbf0 con 0x7fbfe015ce90 2023-08-09T12:46:55.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe0159770 con 0x7fbfe015ce90 2023-08-09T12:46:55.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.387+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe0159d30 con 0x7fbfe015ce90 2023-08-09T12:46:55.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.389+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe0067a80 con 0x7fbfe015ce90 2023-08-09T12:46:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.390+0000 7fbfdeffd640 1 -- 172.21.15.17:0/722550444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbfd801e460 con 0x7fbfe015ce90 2023-08-09T12:46:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.391+0000 7fbfdeffd640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc406a050 0x7fbfc406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.391+0000 7fbfdeffd640 1 -- 172.21.15.17:0/722550444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfd8088c90 con 0x7fbfe015ce90 2023-08-09T12:46:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.392+0000 7fbfe609c640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc406a050 0x7fbfc406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.393+0000 7fbfe609c640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc406a050 0x7fbfc406c510 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4035000 tx=0x7fbfd4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:55.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.396+0000 7fbfdeffd640 1 -- 172.21.15.17:0/722550444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbfd8054370 con 0x7fbfe015ce90 2023-08-09T12:46:55.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.594+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfe00d0ad0 con 0x7fbfe015ce90 2023-08-09T12:46:55.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.597+0000 7fbfdeffd640 1 -- 172.21.15.17:0/722550444 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+18284 (secure 0 0 0) 0x7fbfd8057990 con 0x7fbfe015ce90 2023-08-09T12:46:55.601 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:55.601 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":129,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:54.579441+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.600+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc406a050 msgr2=0x7fbfc406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.600+0000 7fbfe8300640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc406a050 0x7fbfc406c510 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4035000 tx=0x7fbfd4030000 comp rx=0 tx=0).stop 2023-08-09T12:46:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 msgr2=0x7fbfe015fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe015fdd0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800d830 tx=0x7fbfd800dcf0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 shutdown_connections 2023-08-09T12:46:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbfc406a050 0x7fbfc406c510 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe015ce90 0x7fbfe015fdd0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfe00d29d0 0x7fbfe0157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 --2- 172.21.15.17:0/722550444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfe00b6000 0x7fbfe0155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 >> 172.21.15.17:0/722550444 conn(0x7fbfe006fde0 msgr2=0x7fbfe00b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 shutdown_connections 2023-08-09T12:46:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.601+0000 7fbfe8300640 1 -- 172.21.15.17:0/722550444 wait complete. 2023-08-09T12:46:55.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:55.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.846+0000 7fd65ab42640 1 Processor -- start 2023-08-09T12:46:55.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.846+0000 7fd65ab42640 1 -- start start 2023-08-09T12:46:55.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd65ab42640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6540adc40 0x7fd65406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd65ab42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 0x7fd6540ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd65ab42640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540b2250 con 0x7fd6540b3b40 2023-08-09T12:46:55.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd65ab42640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6540ae020 con 0x7fd6540adc40 2023-08-09T12:46:55.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd65ab42640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540b2530 con 0x7fd6540cc630 2023-08-09T12:46:55.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd6588de640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6540adc40 0x7fd65406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd653fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd6540b3b40 0x7fd6540b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34088/0 (socket says 172.21.15.17:34088) 2023-08-09T12:46:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd653fff640 1 -- 172.21.15.17:0/293197034 learned_addr learned my addr 172.21.15.17:0/293197034 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.848+0000 7fd6590df640 1 --2- 172.21.15.17:0/293197034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 0x7fd6540ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.849+0000 7fd6588de640 1 -- 172.21.15.17:0/293197034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 msgr2=0x7fd6540ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.849+0000 7fd6588de640 1 --2- 172.21.15.17:0/293197034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 0x7fd6540ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.849+0000 7fd6588de640 1 -- 172.21.15.17:0/293197034 >> v1:172.21.15.17:6789/0 conn(0x7fd6540b3b40 legacy=0x7fd6540b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.849+0000 7fd6588de640 1 -- 172.21.15.17:0/293197034 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65406fe80 con 0x7fd6540adc40 2023-08-09T12:46:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.849+0000 7fd6537fe640 1 -- 172.21.15.17:0/293197034 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447988603 0 0) 0x7fd6540b2250 con 0x7fd6540b3b40 2023-08-09T12:46:55.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.850+0000 7fd6588de640 1 --2- 172.21.15.17:0/293197034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540adc40 0x7fd65406c280 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fd6480097a0 tx=0x7fd64802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8011a1ee0afb3d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.850+0000 7fd6537fe640 1 -- 172.21.15.17:0/293197034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648031780 con 0x7fd6540adc40 2023-08-09T12:46:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.850+0000 7fd6537fe640 1 -- 172.21.15.17:0/293197034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6480318e0 con 0x7fd6540adc40 2023-08-09T12:46:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.850+0000 7fd6537fe640 1 -- 172.21.15.17:0/293197034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648031c70 con 0x7fd6540adc40 2023-08-09T12:46:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.851+0000 7fd65ab42640 1 -- 172.21.15.17:0/293197034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540adc40 msgr2=0x7fd65406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.851+0000 7fd65ab42640 1 --2- 172.21.15.17:0/293197034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540adc40 0x7fd65406c280 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fd6480097a0 tx=0x7fd64802b820 comp rx=0 tx=0).stop 2023-08-09T12:46:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.851+0000 7fd65ab42640 1 -- 172.21.15.17:0/293197034 shutdown_connections 2023-08-09T12:46:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.851+0000 7fd65ab42640 1 --2- 172.21.15.17:0/293197034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 0x7fd6540ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.851+0000 7fd65ab42640 1 --2- 172.21.15.17:0/293197034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540adc40 0x7fd65406c280 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.851+0000 7fd65ab42640 1 -- 172.21.15.17:0/293197034 >> 172.21.15.17:0/293197034 conn(0x7fd6540cb1b0 msgr2=0x7fd6540cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.851+0000 7fd65ab42640 1 -- 172.21.15.17:0/293197034 shutdown_connections 2023-08-09T12:46:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.851+0000 7fd65ab42640 1 -- 172.21.15.17:0/293197034 wait complete. 2023-08-09T12:46:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.853+0000 7fd65ab42640 1 Processor -- start 2023-08-09T12:46:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.853+0000 7fd65ab42640 1 -- start start 2023-08-09T12:46:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd65ab42640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6540adc40 0x7fd65406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd65ab42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540b3b40 0x7fd65406bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd65ab42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 0x7fd654149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd65ab42640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65406a7b0 con 0x7fd6540b3b40 2023-08-09T12:46:55.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd65ab42640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654069ba0 con 0x7fd6540adc40 2023-08-09T12:46:55.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd65ab42640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd654069e80 con 0x7fd6540cc630 2023-08-09T12:46:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd653fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540b3b40 0x7fd65406bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd653fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540b3b40 0x7fd65406bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44280/0 (socket says 172.21.15.17:44280) 2023-08-09T12:46:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.854+0000 7fd653fff640 1 -- 172.21.15.17:0/3787567594 learned_addr learned my addr 172.21.15.17:0/3787567594 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd6590df640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 0x7fd654149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd6588de640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6540adc40 0x7fd65406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd653fff640 1 -- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 msgr2=0x7fd654149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd653fff640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 0x7fd654149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd653fff640 1 -- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6540adc40 msgr2=0x7fd65406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd653fff640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6540adc40 0x7fd65406ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd653fff640 1 -- 172.21.15.17:0/3787567594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd648009400 con 0x7fd6540b3b40 2023-08-09T12:46:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd653fff640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540b3b40 0x7fd65406bc60 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fd6400010e0 tx=0x7fd64000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd6517fa640 1 -- 172.21.15.17:0/3787567594 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640007480 con 0x7fd6540b3b40 2023-08-09T12:46:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd6517fa640 1 -- 172.21.15.17:0/3787567594 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6400075e0 con 0x7fd6540b3b40 2023-08-09T12:46:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65406a160 con 0x7fd6540b3b40 2023-08-09T12:46:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.855+0000 7fd6517fa640 1 -- 172.21.15.17:0/3787567594 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400059c0 con 0x7fd6540b3b40 2023-08-09T12:46:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.856+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65406b180 con 0x7fd6540b3b40 2023-08-09T12:46:55.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.857+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65406a920 con 0x7fd6540b3b40 2023-08-09T12:46:55.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.858+0000 7fd6517fa640 1 -- 172.21.15.17:0/3787567594 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd640005b20 con 0x7fd6540b3b40 2023-08-09T12:46:55.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.859+0000 7fd6517fa640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd63806a050 0x7fd63806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:55.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.859+0000 7fd6517fa640 1 -- 172.21.15.17:0/3787567594 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd640087c00 con 0x7fd6540b3b40 2023-08-09T12:46:55.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.859+0000 7fd6588de640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd63806a050 0x7fd63806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:55.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.861+0000 7fd6588de640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd63806a050 0x7fd63806c510 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd648036000 tx=0x7fd64803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:55.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:55.863+0000 7fd6517fa640 1 -- 172.21.15.17:0/3787567594 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd640053250 con 0x7fd6540b3b40 2023-08-09T12:46:56.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.059+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd654067a80 con 0x7fd6540b3b40 2023-08-09T12:46:56.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.064+0000 7fd6517fa640 1 -- 172.21.15.17:0/3787567594 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+18284 (secure 0 0 0) 0x7fd640017020 con 0x7fd6540b3b40 2023-08-09T12:46:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:56.067 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":129,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:54.579441+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd63806a050 msgr2=0x7fd63806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd63806a050 0x7fd63806c510 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd648036000 tx=0x7fd64803d040 comp rx=0 tx=0).stop 2023-08-09T12:46:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540b3b40 msgr2=0x7fd65406bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540b3b40 0x7fd65406bc60 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fd6400010e0 tx=0x7fd64000c9b0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 shutdown_connections 2023-08-09T12:46:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd63806a050 0x7fd63806c510 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6540cc630 0x7fd654149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540b3b40 0x7fd65406bc60 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 --2- 172.21.15.17:0/3787567594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6540adc40 0x7fd65406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.066+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 >> 172.21.15.17:0/3787567594 conn(0x7fd6540cb1b0 msgr2=0x7fd6540cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.067+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 shutdown_connections 2023-08-09T12:46:56.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.067+0000 7fd65ab42640 1 -- 172.21.15.17:0/3787567594 wait complete. 2023-08-09T12:46:56.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:46:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.313+0000 7f9a28a5d640 1 Processor -- start 2023-08-09T12:46:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.313+0000 7f9a28a5d640 1 -- start start 2023-08-09T12:46:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.314+0000 7f9a28a5d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9a240b44b0 0x7f9a240b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:56.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.314+0000 7f9a28a5d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a240d09e0 con 0x7f9a2415cac0 2023-08-09T12:46:56.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.315+0000 7f9a28a5d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a240b4e00 con 0x7f9a240b1fc0 2023-08-09T12:46:56.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.315+0000 7f9a28a5d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240d1010 con 0x7f9a240b44b0 2023-08-09T12:46:56.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.315+0000 7f9a22d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9a2415cac0 0x7f9a240cd290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34094/0 (socket says 172.21.15.17:34094) 2023-08-09T12:46:56.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.315+0000 7f9a22d9d640 1 -- 172.21.15.17:0/263012205 learned_addr learned my addr 172.21.15.17:0/263012205 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:56.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.315+0000 7f9a2359e640 1 --2- 172.21.15.17:0/263012205 >> v2:172.21.15.142:3300/0 conn(0x7f9a240b44b0 0x7f9a240b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:56.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.315+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556382490 0 0) 0x7f9a240d09e0 con 0x7f9a2415cac0 2023-08-09T12:46:56.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10003520 con 0x7f9a2415cac0 2023-08-09T12:46:56.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4125975287 0 0) 0x7f9a10003520 con 0x7f9a2415cac0 2023-08-09T12:46:56.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 >> v2:172.21.15.142:3300/0 conn(0x7f9a240b44b0 msgr2=0x7f9a240b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:56.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 --2- 172.21.15.17:0/263012205 >> v2:172.21.15.142:3300/0 conn(0x7f9a240b44b0 0x7f9a240b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 >> v1:172.21.15.142:6789/0 conn(0x7f9a240b1fc0 legacy=0x7f9a240d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:56.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240cdb70 con 0x7f9a2415cac0 2023-08-09T12:46:56.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f9a140019f0 con 0x7f9a2415cac0 2023-08-09T12:46:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 >> v1:172.21.15.17:6789/0 conn(0x7f9a2415cac0 legacy=0x7f9a240cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a10003970 0x7f9a10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10005180 0x7f9a1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240d1010 con 0x7f9a100047c0 2023-08-09T12:46:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1000c020 con 0x7f9a10005180 2023-08-09T12:46:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1000c1e0 con 0x7f9a10003970 2023-08-09T12:46:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.316+0000 7f9a1a59c640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.317+0000 7f9a2359e640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10005180 0x7f9a1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.317+0000 7f9a22d9d640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a10003970 0x7f9a10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.317+0000 7f9a1a59c640 1 -- 172.21.15.17:0/263012205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a10003970 msgr2=0x7f9a10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.317+0000 7f9a1a59c640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a10003970 0x7f9a10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.317+0000 7f9a1a59c640 1 -- 172.21.15.17:0/263012205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10005180 msgr2=0x7f9a1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.317+0000 7f9a1a59c640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a10005180 0x7f9a1000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.317+0000 7f9a1a59c640 1 -- 172.21.15.17:0/263012205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10003520 con 0x7f9a100047c0 2023-08-09T12:46:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.317+0000 7f9a2359e640 1 -- 172.21.15.17:0/263012205 reap_dead start 2023-08-09T12:46:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.318+0000 7f9a1a59c640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a10004c40 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c001750 tx=0x7f9a100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7aac77ddb759bf3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.318+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0052d0 con 0x7f9a100047c0 2023-08-09T12:46:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.318+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c02e050 con 0x7f9a100047c0 2023-08-09T12:46:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.318+0000 7f9a2259c640 1 -- 172.21.15.17:0/263012205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c003830 con 0x7f9a100047c0 2023-08-09T12:46:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.319+0000 7f9a28a5d640 1 -- 172.21.15.17:0/263012205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 msgr2=0x7f9a10004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.319+0000 7f9a28a5d640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a10004c40 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c001750 tx=0x7f9a100057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.319+0000 7f9a28a5d640 1 -- 172.21.15.17:0/263012205 shutdown_connections 2023-08-09T12:46:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.319+0000 7f9a28a5d640 1 --2- 172.21.15.17:0/263012205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a10004c40 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.319+0000 7f9a28a5d640 1 -- 172.21.15.17:0/263012205 >> 172.21.15.17:0/263012205 conn(0x7f9a240cf4b0 msgr2=0x7f9a240cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.319+0000 7f9a28a5d640 1 -- 172.21.15.17:0/263012205 shutdown_connections 2023-08-09T12:46:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.319+0000 7f9a28a5d640 1 -- 172.21.15.17:0/263012205 wait complete. 2023-08-09T12:46:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.321+0000 7f9a28a5d640 1 Processor -- start 2023-08-09T12:46:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.321+0000 7f9a28a5d640 1 -- start start 2023-08-09T12:46:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.322+0000 7f9a28a5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a24152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.322+0000 7f9a28a5d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a241f7750 0x7f9a240cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.322+0000 7f9a28a5d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a240cc500 0x7f9a2415ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.322+0000 7f9a28a5d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240d1b40 con 0x7f9a100047c0 2023-08-09T12:46:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.322+0000 7f9a28a5d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2415d2d0 con 0x7f9a240cc500 2023-08-09T12:46:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.322+0000 7f9a28a5d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2415d5b0 con 0x7f9a241f7750 2023-08-09T12:46:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.322+0000 7f9a22d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a24152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a22d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a24152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44300/0 (socket says 172.21.15.17:44300) 2023-08-09T12:46:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a22d9d640 1 -- 172.21.15.17:0/739159384 learned_addr learned my addr 172.21.15.17:0/739159384 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a1a59c640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a241f7750 0x7f9a240cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a2359e640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a240cc500 0x7f9a2415ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a22d9d640 1 -- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a241f7750 msgr2=0x7f9a240cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:56.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a22d9d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a241f7750 0x7f9a240cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a22d9d640 1 -- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a240cc500 msgr2=0x7f9a2415ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:56.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a22d9d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a240cc500 0x7f9a2415ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:56.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a22d9d640 1 -- 172.21.15.17:0/739159384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2415d890 con 0x7f9a100047c0 2023-08-09T12:46:56.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.323+0000 7f9a22d9d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a24152480 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f9a14007a10 tx=0x7f9a1400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:56.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.324+0000 7f9a1bfff640 1 -- 172.21.15.17:0/739159384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400ee50 con 0x7f9a100047c0 2023-08-09T12:46:56.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.324+0000 7f9a1bfff640 1 -- 172.21.15.17:0/739159384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14013420 con 0x7f9a100047c0 2023-08-09T12:46:56.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.324+0000 7f9a1bfff640 1 -- 172.21.15.17:0/739159384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140137d0 con 0x7f9a100047c0 2023-08-09T12:46:56.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.324+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2415db70 con 0x7f9a100047c0 2023-08-09T12:46:56.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.324+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2415f3a0 con 0x7f9a100047c0 2023-08-09T12:46:56.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.325+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2404e390 con 0x7f9a100047c0 2023-08-09T12:46:56.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.326+0000 7f9a1bfff640 1 -- 172.21.15.17:0/739159384 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a14013930 con 0x7f9a100047c0 2023-08-09T12:46:56.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.327+0000 7f9a1bfff640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0406a080 0x7f9a0406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:56.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.327+0000 7f9a1bfff640 1 -- 172.21.15.17:0/739159384 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a14088d70 con 0x7f9a100047c0 2023-08-09T12:46:56.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.328+0000 7f9a1a59c640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0406a080 0x7f9a0406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:56.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.329+0000 7f9a1a59c640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0406a080 0x7f9a0406c540 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c033000 tx=0x7f9a0c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:56.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.331+0000 7f9a1bfff640 1 -- 172.21.15.17:0/739159384 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9a14054340 con 0x7f9a100047c0 2023-08-09T12:46:56.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:56.566+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9a2406fbc0 con 0x7f9a100047c0 2023-08-09T12:46:57.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.170+0000 7f9a1bfff640 1 -- 172.21.15.17:0/739159384 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9a14057960 con 0x7f9a100047c0 2023-08-09T12:46:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0406a080 msgr2=0x7f9a0406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0406a080 0x7f9a0406c540 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c033000 tx=0x7f9a0c009030 comp rx=0 tx=0).stop 2023-08-09T12:46:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 msgr2=0x7f9a24152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a24152480 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f9a14007a10 tx=0x7f9a1400e530 comp rx=0 tx=0).stop 2023-08-09T12:46:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 shutdown_connections 2023-08-09T12:46:57.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9a0406a080 0x7f9a0406c540 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a240cc500 0x7f9a2415ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a241f7750 0x7f9a240cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 --2- 172.21.15.17:0/739159384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a100047c0 0x7f9a24152480 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.174+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 >> 172.21.15.17:0/739159384 conn(0x7f9a240cf4b0 msgr2=0x7f9a241e6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.175+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 shutdown_connections 2023-08-09T12:46:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.175+0000 7f9a28a5d640 1 -- 172.21.15.17:0/739159384 wait complete. 2023-08-09T12:46:57.199 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:46:57.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:46:57.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.426+0000 7f8af7fff640 1 Processor -- start 2023-08-09T12:46:57.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.427+0000 7f8af7fff640 1 -- start start 2023-08-09T12:46:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.428+0000 7f8af7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8af815ab40 0x7f8af80cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.428+0000 7f8af7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8af80b21c0 0x7f8af80c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:57.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.428+0000 7f8af7fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af80c8c30 con 0x7f8af80c2670 2023-08-09T12:46:57.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.428+0000 7f8af7fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af80cb9d0 con 0x7f8af815ab40 2023-08-09T12:46:57.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.428+0000 7f8af7fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af80c8e80 con 0x7f8af80b21c0 2023-08-09T12:46:57.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.429+0000 7f8af6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8af815ab40 0x7f8af80cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:57.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.429+0000 7f8af6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8af815ab40 0x7f8af80cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44306/0 (socket says 172.21.15.17:44306) 2023-08-09T12:46:57.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.429+0000 7f8af6ffd640 1 -- 172.21.15.17:0/2787354505 learned_addr learned my addr 172.21.15.17:0/2787354505 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:57.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.429+0000 7f8af67fc640 1 --2- 172.21.15.17:0/2787354505 >> v2:172.21.15.142:3300/0 conn(0x7f8af80b21c0 0x7f8af80c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:57.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.429+0000 7f8af6ffd640 1 -- 172.21.15.17:0/2787354505 >> v2:172.21.15.142:3300/0 conn(0x7f8af80b21c0 msgr2=0x7f8af80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:57.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.429+0000 7f8af6ffd640 1 --2- 172.21.15.17:0/2787354505 >> v2:172.21.15.142:3300/0 conn(0x7f8af80b21c0 0x7f8af80c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.429+0000 7f8af6ffd640 1 -- 172.21.15.17:0/2787354505 >> v1:172.21.15.142:6789/0 conn(0x7f8af80c2670 legacy=0x7f8af80c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:57.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.429+0000 7f8af6ffd640 1 -- 172.21.15.17:0/2787354505 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af80c9160 con 0x7f8af815ab40 2023-08-09T12:46:57.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.430+0000 7f8af6ffd640 1 --2- 172.21.15.17:0/2787354505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af80cb060 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8af815e440 tx=0x7f8ae802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dbb45196cb3bcf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:57.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.431+0000 7f8af5ffb640 1 -- 172.21.15.17:0/2787354505 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8031870 con 0x7f8af815ab40 2023-08-09T12:46:57.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.431+0000 7f8af5ffb640 1 -- 172.21.15.17:0/2787354505 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae80319d0 con 0x7f8af815ab40 2023-08-09T12:46:57.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.431+0000 7f8af5ffb640 1 -- 172.21.15.17:0/2787354505 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8031d60 con 0x7f8af815ab40 2023-08-09T12:46:57.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.431+0000 7f8af7fff640 1 -- 172.21.15.17:0/2787354505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 msgr2=0x7f8af80cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:57.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.431+0000 7f8af7fff640 1 --2- 172.21.15.17:0/2787354505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af80cb060 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8af815e440 tx=0x7f8ae802b910 comp rx=0 tx=0).stop 2023-08-09T12:46:57.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.432+0000 7f8af7fff640 1 -- 172.21.15.17:0/2787354505 shutdown_connections 2023-08-09T12:46:57.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.432+0000 7f8af7fff640 1 --2- 172.21.15.17:0/2787354505 >> v2:172.21.15.142:3300/0 conn(0x7f8af80b21c0 0x7f8af80c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.432+0000 7f8af7fff640 1 --2- 172.21.15.17:0/2787354505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af80cb060 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.432+0000 7f8af7fff640 1 -- 172.21.15.17:0/2787354505 >> 172.21.15.17:0/2787354505 conn(0x7f8af806abd0 msgr2=0x7f8af806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:57.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.432+0000 7f8af7fff640 1 -- 172.21.15.17:0/2787354505 shutdown_connections 2023-08-09T12:46:57.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.432+0000 7f8af7fff640 1 -- 172.21.15.17:0/2787354505 wait complete. 2023-08-09T12:46:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.434+0000 7f8af7fff640 1 Processor -- start 2023-08-09T12:46:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.434+0000 7f8af7fff640 1 -- start start 2023-08-09T12:46:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af80b21c0 0x7f8af81f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af80c2670 0x7f8af8151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af81f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af7fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af81f64b0 con 0x7f8af815ab40 2023-08-09T12:46:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af7fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80c5870 con 0x7f8af80c2670 2023-08-09T12:46:57.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8151c40 con 0x7f8af80b21c0 2023-08-09T12:46:57.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af81f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:57.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af81f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44320/0 (socket says 172.21.15.17:44320) 2023-08-09T12:46:57.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.435+0000 7f8af77fe640 1 -- 172.21.15.17:0/540478566 learned_addr learned my addr 172.21.15.17:0/540478566 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:57.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af67fc640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af80c2670 0x7f8af8151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af6ffd640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af80b21c0 0x7f8af81f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af77fe640 1 -- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af80b21c0 msgr2=0x7f8af81f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af77fe640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af80b21c0 0x7f8af81f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af77fe640 1 -- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af80c2670 msgr2=0x7f8af8151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af77fe640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af80c2670 0x7f8af8151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af77fe640 1 -- 172.21.15.17:0/540478566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80094d0 con 0x7f8af815ab40 2023-08-09T12:46:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af77fe640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af81f18f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c7b0 tx=0x7f8af000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8adf7fe640 1 -- 172.21.15.17:0/540478566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0003d80 con 0x7f8af815ab40 2023-08-09T12:46:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8adf7fe640 1 -- 172.21.15.17:0/540478566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af0005070 con 0x7f8af815ab40 2023-08-09T12:46:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8adf7fe640 1 -- 172.21.15.17:0/540478566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0005420 con 0x7f8af815ab40 2023-08-09T12:46:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.436+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af81f5c10 con 0x7f8af815ab40 2023-08-09T12:46:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.437+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af81f61d0 con 0x7f8af815ab40 2023-08-09T12:46:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.438+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af804e390 con 0x7f8af815ab40 2023-08-09T12:46:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.439+0000 7f8adf7fe640 1 -- 172.21.15.17:0/540478566 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8af0005580 con 0x7f8af815ab40 2023-08-09T12:46:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.440+0000 7f8adf7fe640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ae406a050 0x7f8ae406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.440+0000 7f8adf7fe640 1 -- 172.21.15.17:0/540478566 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8af0087a60 con 0x7f8af815ab40 2023-08-09T12:46:57.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.441+0000 7f8af6ffd640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ae406a050 0x7f8ae406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:57.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.442+0000 7f8af6ffd640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ae406a050 0x7f8ae406c510 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8036000 tx=0x7f8ae803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:57.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.445+0000 7f8adf7fe640 1 -- 172.21.15.17:0/540478566 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8af0053140 con 0x7f8af815ab40 2023-08-09T12:46:57.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:57.677+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8af80c59b0 con 0x7f8af815ab40 2023-08-09T12:46:58.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.175+0000 7f8adf7fe640 1 -- 172.21.15.17:0/540478566 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8af00170c0 con 0x7f8af815ab40 2023-08-09T12:46:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ae406a050 msgr2=0x7f8ae406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ae406a050 0x7f8ae406c510 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8036000 tx=0x7f8ae803c040 comp rx=0 tx=0).stop 2023-08-09T12:46:58.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 msgr2=0x7f8af81f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af81f18f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c7b0 tx=0x7f8af000cc70 comp rx=0 tx=0).stop 2023-08-09T12:46:58.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 shutdown_connections 2023-08-09T12:46:58.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8ae406a050 0x7f8ae406c510 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8af815ab40 0x7f8af81f18f0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8af80c2670 0x7f8af8151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 --2- 172.21.15.17:0/540478566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8af80b21c0 0x7f8af81f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.179+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 >> 172.21.15.17:0/540478566 conn(0x7f8af806abd0 msgr2=0x7f8af80ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:58.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.180+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 shutdown_connections 2023-08-09T12:46:58.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.180+0000 7f8af7fff640 1 -- 172.21.15.17:0/540478566 wait complete. 2023-08-09T12:46:58.204 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:46:58.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:46:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.436+0000 7f7465bd2640 1 Processor -- start 2023-08-09T12:46:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.436+0000 7f7465bd2640 1 -- start start 2023-08-09T12:46:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.438+0000 7f7465bd2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74601647e0 0x7f74600cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.438+0000 7f7465bd2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600c3780 0x7f74600b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.438+0000 7f7465bd2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74600b3ff0 0x7f74600cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.438+0000 7f7465bd2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74600b0170 con 0x7f74601647e0 2023-08-09T12:46:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.438+0000 7f7465bd2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74600ce990 con 0x7f74600b3ff0 2023-08-09T12:46:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.438+0000 7f7465bd2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600cebe0 con 0x7f74600c3780 2023-08-09T12:46:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.438+0000 7f7464bd0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74601647e0 0x7f74600cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.438+0000 7f7464bd0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74601647e0 0x7f74600cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53984/0 (socket says 172.21.15.17:53984) 2023-08-09T12:46:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.439+0000 7f7464bd0640 1 -- 172.21.15.17:0/4149096855 learned_addr learned my addr 172.21.15.17:0/4149096855 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.439+0000 7f7457fff640 1 --2- 172.21.15.17:0/4149096855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600c3780 0x7f74600b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.439+0000 7f74653d1640 1 --2- 172.21.15.17:0/4149096855 >> v2:172.21.15.142:3300/0 conn(0x7f74600b3ff0 0x7f74600cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.439+0000 7f7464bd0640 1 -- 172.21.15.17:0/4149096855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600c3780 msgr2=0x7f74600b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.439+0000 7f7464bd0640 1 --2- 172.21.15.17:0/4149096855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600c3780 0x7f74600b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.439+0000 7f7464bd0640 1 -- 172.21.15.17:0/4149096855 >> v2:172.21.15.142:3300/0 conn(0x7f74600b3ff0 msgr2=0x7f74600cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.439+0000 7f7464bd0640 1 --2- 172.21.15.17:0/4149096855 >> v2:172.21.15.142:3300/0 conn(0x7f74600b3ff0 0x7f74600cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.439+0000 7f7464bd0640 1 -- 172.21.15.17:0/4149096855 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600ceec0 con 0x7f74601647e0 2023-08-09T12:46:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.440+0000 7f7464bd0640 1 --2- 172.21.15.17:0/4149096855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600cbb30 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f74600b3880 tx=0x7f745c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae7eed11643be9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f74577fe640 1 -- 172.21.15.17:0/4149096855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c02ca80 con 0x7f74601647e0 2023-08-09T12:46:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f74577fe640 1 -- 172.21.15.17:0/4149096855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c02cbe0 con 0x7f74601647e0 2023-08-09T12:46:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f74577fe640 1 -- 172.21.15.17:0/4149096855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0343f0 con 0x7f74601647e0 2023-08-09T12:46:58.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 -- 172.21.15.17:0/4149096855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 msgr2=0x7f74600cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4149096855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600cbb30 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f74600b3880 tx=0x7f745c02bee0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 -- 172.21.15.17:0/4149096855 shutdown_connections 2023-08-09T12:46:58.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4149096855 >> v2:172.21.15.142:3300/0 conn(0x7f74600b3ff0 0x7f74600cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4149096855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600c3780 0x7f74600b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4149096855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600cbb30 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 -- 172.21.15.17:0/4149096855 >> 172.21.15.17:0/4149096855 conn(0x7f74600cd300 msgr2=0x7f74600cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:58.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 -- 172.21.15.17:0/4149096855 shutdown_connections 2023-08-09T12:46:58.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.441+0000 7f7465bd2640 1 -- 172.21.15.17:0/4149096855 wait complete. 2023-08-09T12:46:58.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.443+0000 7f7465bd2640 1 Processor -- start 2023-08-09T12:46:58.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.443+0000 7f7465bd2640 1 -- start start 2023-08-09T12:46:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.444+0000 7f7465bd2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600b3ff0 0x7f74600c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.444+0000 7f7465bd2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600c3780 0x7f74600c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.444+0000 7f7465bd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.444+0000 7f7465bd2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600c7e90 con 0x7f74601647e0 2023-08-09T12:46:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.444+0000 7f7465bd2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600c8110 con 0x7f74600c3780 2023-08-09T12:46:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.444+0000 7f7465bd2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600c83f0 con 0x7f74600b3ff0 2023-08-09T12:46:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f74653d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f74653d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53988/0 (socket says 172.21.15.17:53988) 2023-08-09T12:46:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f74653d1640 1 -- 172.21.15.17:0/4071267108 learned_addr learned my addr 172.21.15.17:0/4071267108 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:58.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f7464bd0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600b3ff0 0x7f74600c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f7457fff640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600c3780 0x7f74600c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f74653d1640 1 -- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600b3ff0 msgr2=0x7f74600c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f74653d1640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600b3ff0 0x7f74600c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f74653d1640 1 -- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600c3780 msgr2=0x7f74600c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f74653d1640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600c3780 0x7f74600c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.445+0000 7f74653d1640 1 -- 172.21.15.17:0/4071267108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c009b30 con 0x7f74601647e0 2023-08-09T12:46:58.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.446+0000 7f74653d1640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600c91b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f745800c4c0 tx=0x7f745800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:58.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.446+0000 7f74557fa640 1 -- 172.21.15.17:0/4071267108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458004220 con 0x7f74601647e0 2023-08-09T12:46:58.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.446+0000 7f74557fa640 1 -- 172.21.15.17:0/4071267108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7458004380 con 0x7f74601647e0 2023-08-09T12:46:58.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.446+0000 7f74557fa640 1 -- 172.21.15.17:0/4071267108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458003810 con 0x7f74601647e0 2023-08-09T12:46:58.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.446+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74600c86d0 con 0x7f74601647e0 2023-08-09T12:46:58.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.446+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74600c8c90 con 0x7f74601647e0 2023-08-09T12:46:58.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.448+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74600c8eb0 con 0x7f74601647e0 2023-08-09T12:46:58.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.449+0000 7f74557fa640 1 -- 172.21.15.17:0/4071267108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7458003970 con 0x7f74601647e0 2023-08-09T12:46:58.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.450+0000 7f74557fa640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f744c06a050 0x7f744c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.450+0000 7f74557fa640 1 -- 172.21.15.17:0/4071267108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7458088290 con 0x7f74601647e0 2023-08-09T12:46:58.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.451+0000 7f7464bd0640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f744c06a050 0x7f744c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.452+0000 7f7464bd0640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f744c06a050 0x7f744c06c510 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f745c035000 tx=0x7f745c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:58.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.455+0000 7f74557fa640 1 -- 172.21.15.17:0/4071267108 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7458053900 con 0x7f74601647e0 2023-08-09T12:46:58.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.687+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f746004e390 con 0x7f74601647e0 2023-08-09T12:46:58.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.688+0000 7f74557fa640 1 -- 172.21.15.17:0/4071267108 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f745801e090 con 0x7f74601647e0 2023-08-09T12:46:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:58.691 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:46:54.580315+0000","modified":"2023-08-09T12:46:58.167844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1719182807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1719182807},{"type":"v1","addr":"172.21.15.17:6835","nonce":1719182807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-09T12:46:58.692 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 59 2023-08-09T12:46:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.690+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f744c06a050 msgr2=0x7f744c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.690+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f744c06a050 0x7f744c06c510 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f745c035000 tx=0x7f745c030000 comp rx=0 tx=0).stop 2023-08-09T12:46:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.690+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 msgr2=0x7f74600c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.690+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600c91b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f745800c4c0 tx=0x7f745800c980 comp rx=0 tx=0).stop 2023-08-09T12:46:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.691+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 shutdown_connections 2023-08-09T12:46:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.691+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f744c06a050 0x7f744c06c510 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.691+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74601647e0 0x7f74600c91b0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.691+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74600c3780 0x7f74600c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.691+0000 7f7465bd2640 1 --2- 172.21.15.17:0/4071267108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74600b3ff0 0x7f74600c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.691+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 >> 172.21.15.17:0/4071267108 conn(0x7f74600cd300 msgr2=0x7f74600b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.691+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 shutdown_connections 2023-08-09T12:46:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.691+0000 7f7465bd2640 1 -- 172.21.15.17:0/4071267108 wait complete. 2023-08-09T12:46:58.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:46:58.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.933+0000 7ff6d1131640 1 Processor -- start 2023-08-09T12:46:58.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.933+0000 7ff6d1131640 1 -- start start 2023-08-09T12:46:58.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.934+0000 7ff6d1131640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6cc1616e0 0x7ff6cc0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.935+0000 7ff6d1131640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc0cdd10 con 0x7ff6cc0d29d0 2023-08-09T12:46:58.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.935+0000 7ff6d1131640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc0cdff0 con 0x7ff6cc15ce90 2023-08-09T12:46:58.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.935+0000 7ff6d1131640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc0b6540 con 0x7ff6cc1616e0 2023-08-09T12:46:58.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.935+0000 7ff6cb59e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff6cc0d29d0 0x7ff6cc0d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45794/0 (socket says 172.21.15.17:45794) 2023-08-09T12:46:58.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.935+0000 7ff6cb59e640 1 -- 172.21.15.17:0/2998230335 learned_addr learned my addr 172.21.15.17:0/2998230335 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:58.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.935+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/2998230335 >> v2:172.21.15.142:3300/0 conn(0x7ff6cc1616e0 0x7ff6cc0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044717071 0 0) 0x7ff6cc0cdd10 con 0x7ff6cc0d29d0 2023-08-09T12:46:58.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b8003520 con 0x7ff6cc0d29d0 2023-08-09T12:46:58.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1979466054 0 0) 0x7ff6b8003520 con 0x7ff6cc0d29d0 2023-08-09T12:46:58.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 >> v2:172.21.15.142:3300/0 conn(0x7ff6cc1616e0 msgr2=0x7ff6cc0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:58.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 --2- 172.21.15.17:0/2998230335 >> v2:172.21.15.142:3300/0 conn(0x7ff6cc1616e0 0x7ff6cc0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 >> v1:172.21.15.142:6789/0 conn(0x7ff6cc15ce90 legacy=0x7ff6cc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0ce2d0 con 0x7ff6cc0d29d0 2023-08-09T12:46:58.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff6c40019f0 con 0x7ff6cc0d29d0 2023-08-09T12:46:58.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 >> v1:172.21.15.17:6789/0 conn(0x7ff6cc0d29d0 legacy=0x7ff6cc0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b8003970 0x7ff6b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6b8005180 0x7ff6b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0b6540 con 0x7ff6b80047c0 2023-08-09T12:46:58.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b800c020 con 0x7ff6b8003970 2023-08-09T12:46:58.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.936+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b800c1e0 con 0x7ff6b8005180 2023-08-09T12:46:58.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6cad9d640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b8003970 0x7ff6b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6cb59e640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6b8005180 0x7ff6b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6c3fff640 1 -- 172.21.15.17:0/2998230335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6b8005180 msgr2=0x7ff6b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:58.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6b8005180 0x7ff6b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6c3fff640 1 -- 172.21.15.17:0/2998230335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b8003970 msgr2=0x7ff6b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:58.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b8003970 0x7ff6b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6c3fff640 1 -- 172.21.15.17:0/2998230335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8003520 con 0x7ff6b80047c0 2023-08-09T12:46:58.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.937+0000 7ff6cb59e640 1 -- 172.21.15.17:0/2998230335 reap_dead start 2023-08-09T12:46:58.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.938+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009ac0 tx=0x7ff6b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9099e2d58b913215 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:58.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.939+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b402c6d0 con 0x7ff6b80047c0 2023-08-09T12:46:58.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.939+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b402c830 con 0x7ff6b80047c0 2023-08-09T12:46:58.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.939+0000 7ff6ca59c640 1 -- 172.21.15.17:0/2998230335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b402cbc0 con 0x7ff6b80047c0 2023-08-09T12:46:58.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.939+0000 7ff6d1131640 1 -- 172.21.15.17:0/2998230335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6b80047c0 msgr2=0x7ff6b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.939+0000 7ff6d1131640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009ac0 tx=0x7ff6b80057f0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.939+0000 7ff6d1131640 1 -- 172.21.15.17:0/2998230335 shutdown_connections 2023-08-09T12:46:58.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.939+0000 7ff6d1131640 1 --2- 172.21.15.17:0/2998230335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6b80047c0 0x7ff6b8004c40 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.939+0000 7ff6d1131640 1 -- 172.21.15.17:0/2998230335 >> 172.21.15.17:0/2998230335 conn(0x7ff6cc06fde0 msgr2=0x7ff6cc0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:58.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.940+0000 7ff6d1131640 1 -- 172.21.15.17:0/2998230335 shutdown_connections 2023-08-09T12:46:58.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.940+0000 7ff6d1131640 1 -- 172.21.15.17:0/2998230335 wait complete. 2023-08-09T12:46:58.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.941+0000 7ff6d1131640 1 Processor -- start 2023-08-09T12:46:58.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.942+0000 7ff6d1131640 1 -- start start 2023-08-09T12:46:58.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6d1131640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b80047c0 0x7ff6cc1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6d1131640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6cc155d50 0x7ff6cc1e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6d1131640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc1e8300 0x7ff6cc15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6d1131640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc15e140 con 0x7ff6cc155d50 2023-08-09T12:46:58.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6d1131640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1e8780 con 0x7ff6b80047c0 2023-08-09T12:46:58.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6d1131640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1604c0 con 0x7ff6cc1e8300 2023-08-09T12:46:58.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6cc155d50 0x7ff6cc1e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6cc155d50 0x7ff6cc1e7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54012/0 (socket says 172.21.15.17:54012) 2023-08-09T12:46:58.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6c3fff640 1 -- 172.21.15.17:0/3809808969 learned_addr learned my addr 172.21.15.17:0/3809808969 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:58.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6cad9d640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b80047c0 0x7ff6cc1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6cb59e640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc1e8300 0x7ff6cc15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6c3fff640 1 -- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc1e8300 msgr2=0x7ff6cc15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc1e8300 0x7ff6cc15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6c3fff640 1 -- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b80047c0 msgr2=0x7ff6cc1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.943+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b80047c0 0x7ff6cc1553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.944+0000 7ff6c3fff640 1 -- 172.21.15.17:0/3809808969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0c9cf0 con 0x7ff6cc155d50 2023-08-09T12:46:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.944+0000 7ff6cb59e640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc1e8300 0x7ff6cc15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:46:58.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.944+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6cc155d50 0x7ff6cc1e7dc0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7ff6b402c270 tx=0x7ff6b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.944+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3809808969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4003810 con 0x7ff6cc155d50 2023-08-09T12:46:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.944+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3809808969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b4003970 con 0x7ff6cc155d50 2023-08-09T12:46:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.944+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc0c9fd0 con 0x7ff6cc155d50 2023-08-09T12:46:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.944+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3809808969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4003ce0 con 0x7ff6cc155d50 2023-08-09T12:46:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.945+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc160140 con 0x7ff6cc155d50 2023-08-09T12:46:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.946+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc067a80 con 0x7ff6cc155d50 2023-08-09T12:46:58.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.947+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3809808969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff6b4040450 con 0x7ff6cc155d50 2023-08-09T12:46:58.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.948+0000 7ff6c37fe640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6ac06a050 0x7ff6ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:58.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.948+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3809808969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6b40aa4d0 con 0x7ff6cc155d50 2023-08-09T12:46:58.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.949+0000 7ff6cad9d640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6ac06a050 0x7ff6ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:58.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.950+0000 7ff6cad9d640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6ac06a050 0x7ff6ac06c510 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc068cb0 tx=0x7ff6bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:58.953+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3809808969 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff6b4075bb0 con 0x7ff6cc155d50 2023-08-09T12:46:59.050 INFO:tasks.ceph.mds.a.smithi017.stderr:2023-08-09T12:46:59.046+0000 7f8955258640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:46:59.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.147+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6cc0d0ad0 con 0x7ff6cc155d50 2023-08-09T12:46:59.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.151+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3809808969 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+18271 (secure 0 0 0) 0x7ff6b40044e0 con 0x7ff6cc155d50 2023-08-09T12:46:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:59.155 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":130,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:46:56.106775+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:46:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6ac06a050 msgr2=0x7ff6ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6ac06a050 0x7ff6ac06c510 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc068cb0 tx=0x7ff6bc009040 comp rx=0 tx=0).stop 2023-08-09T12:46:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6cc155d50 msgr2=0x7ff6cc1e7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6cc155d50 0x7ff6cc1e7dc0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7ff6b402c270 tx=0x7ff6b4004730 comp rx=0 tx=0).stop 2023-08-09T12:46:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 shutdown_connections 2023-08-09T12:46:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6ac06a050 0x7ff6ac06c510 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc1e8300 0x7ff6cc15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6cc155d50 0x7ff6cc1e7dc0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 --2- 172.21.15.17:0/3809808969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b80047c0 0x7ff6cc1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 >> 172.21.15.17:0/3809808969 conn(0x7ff6cc06fde0 msgr2=0x7ff6cc0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 shutdown_connections 2023-08-09T12:46:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.154+0000 7ff6d1131640 1 -- 172.21.15.17:0/3809808969 wait complete. 2023-08-09T12:46:59.177 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:46:59.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:46:59.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.403+0000 7f2009586640 1 Processor -- start 2023-08-09T12:46:59.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.403+0000 7f2009586640 1 -- start start 2023-08-09T12:46:59.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f2009586640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f20040adc40 0x7f200406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f2009586640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040b3b40 0x7f20040b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f2009586640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20040b2250 con 0x7f200415e8f0 2023-08-09T12:46:59.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f2009586640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20040ae020 con 0x7f20040adc40 2023-08-09T12:46:59.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f2009586640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20040b2530 con 0x7f20040b3b40 2023-08-09T12:46:59.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f20037fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f200415e8f0 0x7f200415ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45808/0 (socket says 172.21.15.17:45808) 2023-08-09T12:46:59.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f20037fe640 1 -- 172.21.15.17:0/938727472 learned_addr learned my addr 172.21.15.17:0/938727472 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:46:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f2002ffd640 1 --2- 172.21.15.17:0/938727472 >> v2:172.21.15.17:3300/0 conn(0x7f20040adc40 0x7f200406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.405+0000 7f20027fc640 1 --2- 172.21.15.17:0/938727472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040b3b40 0x7f20040b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.406+0000 7f2001ffb640 1 -- 172.21.15.17:0/938727472 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638581374 0 0) 0x7f20040b2250 con 0x7f200415e8f0 2023-08-09T12:46:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.406+0000 7f2001ffb640 1 -- 172.21.15.17:0/938727472 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fec003520 con 0x7f200415e8f0 2023-08-09T12:46:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.406+0000 7f2002ffd640 1 -- 172.21.15.17:0/938727472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040b3b40 msgr2=0x7f20040b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:46:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.406+0000 7f2002ffd640 1 --2- 172.21.15.17:0/938727472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040b3b40 0x7f20040b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.406+0000 7f2002ffd640 1 -- 172.21.15.17:0/938727472 >> v1:172.21.15.17:6789/0 conn(0x7f200415e8f0 legacy=0x7f200415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.406+0000 7f2002ffd640 1 -- 172.21.15.17:0/938727472 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200406fe80 con 0x7f20040adc40 2023-08-09T12:46:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.407+0000 7f2002ffd640 1 --2- 172.21.15.17:0/938727472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040adc40 0x7f200406c280 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40097a0 tx=0x7f1ff402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f337e98ceab07560 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.407+0000 7f2001ffb640 1 -- 172.21.15.17:0/938727472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff402d040 con 0x7f20040adc40 2023-08-09T12:46:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.407+0000 7f2001ffb640 1 -- 172.21.15.17:0/938727472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4031810 con 0x7f20040adc40 2023-08-09T12:46:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.407+0000 7f2001ffb640 1 -- 172.21.15.17:0/938727472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4031ba0 con 0x7f20040adc40 2023-08-09T12:46:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.408+0000 7f2009586640 1 -- 172.21.15.17:0/938727472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040adc40 msgr2=0x7f200406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.408+0000 7f2009586640 1 --2- 172.21.15.17:0/938727472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040adc40 0x7f200406c280 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40097a0 tx=0x7f1ff402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.408+0000 7f2009586640 1 -- 172.21.15.17:0/938727472 shutdown_connections 2023-08-09T12:46:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.408+0000 7f2009586640 1 --2- 172.21.15.17:0/938727472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040b3b40 0x7f20040b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.408+0000 7f2009586640 1 --2- 172.21.15.17:0/938727472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040adc40 0x7f200406c280 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.408+0000 7f2009586640 1 -- 172.21.15.17:0/938727472 >> 172.21.15.17:0/938727472 conn(0x7f20040cb1b0 msgr2=0x7f20040cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.408+0000 7f2009586640 1 -- 172.21.15.17:0/938727472 shutdown_connections 2023-08-09T12:46:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.408+0000 7f2009586640 1 -- 172.21.15.17:0/938727472 wait complete. 2023-08-09T12:46:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.410+0000 7f2009586640 1 Processor -- start 2023-08-09T12:46:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.410+0000 7f2009586640 1 -- start start 2023-08-09T12:46:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f2009586640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040adc40 0x7f20041f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f2009586640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20040b3b40 0x7f20040c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f2009586640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200415e8f0 0x7f20040c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f2009586640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040c6150 con 0x7f200415e8f0 2023-08-09T12:46:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f2009586640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20041f5df0 con 0x7f20040b3b40 2023-08-09T12:46:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f2009586640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20041f60d0 con 0x7f20040adc40 2023-08-09T12:46:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f20037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200415e8f0 0x7f20040c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f20037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200415e8f0 0x7f20040c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54030/0 (socket says 172.21.15.17:54030) 2023-08-09T12:46:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.411+0000 7f20037fe640 1 -- 172.21.15.17:0/763246880 learned_addr learned my addr 172.21.15.17:0/763246880 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f2002ffd640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040adc40 0x7f20041f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f20027fc640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20040b3b40 0x7f20040c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f20037fe640 1 -- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040adc40 msgr2=0x7f20041f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f20037fe640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040adc40 0x7f20041f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f20037fe640 1 -- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20040b3b40 msgr2=0x7f20040c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f20037fe640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20040b3b40 0x7f20040c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f20037fe640 1 -- 172.21.15.17:0/763246880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff4009400 con 0x7f200415e8f0 2023-08-09T12:46:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f20037fe640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200415e8f0 0x7f20040c5770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00caa0 tx=0x7f1ffc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.412+0000 7f1feb7fe640 1 -- 172.21.15.17:0/763246880 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00ac00 con 0x7f200415e8f0 2023-08-09T12:46:59.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.413+0000 7f1feb7fe640 1 -- 172.21.15.17:0/763246880 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc00ad60 con 0x7f200415e8f0 2023-08-09T12:46:59.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.413+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20041f63b0 con 0x7f200415e8f0 2023-08-09T12:46:59.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.413+0000 7f1feb7fe640 1 -- 172.21.15.17:0/763246880 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc012620 con 0x7f200415e8f0 2023-08-09T12:46:59.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.413+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20040c8490 con 0x7f200415e8f0 2023-08-09T12:46:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.414+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20041f65f0 con 0x7f200415e8f0 2023-08-09T12:46:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.415+0000 7f1feb7fe640 1 -- 172.21.15.17:0/763246880 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ffc007070 con 0x7f200415e8f0 2023-08-09T12:46:59.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.416+0000 7f1feb7fe640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ff006a050 0x7f1ff006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.416+0000 7f1feb7fe640 1 -- 172.21.15.17:0/763246880 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ffc0885f0 con 0x7f200415e8f0 2023-08-09T12:46:59.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.417+0000 7f2002ffd640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ff006a050 0x7f1ff006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.418+0000 7f2002ffd640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ff006a050 0x7f1ff006c510 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4036000 tx=0x7f1ff403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:59.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.421+0000 7f1feb7fe640 1 -- 172.21.15.17:0/763246880 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f20041f65f0 con 0x7f200415e8f0 2023-08-09T12:46:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.609+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2004070440 con 0x7f1ff006a050 2023-08-09T12:46:59.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.633+0000 7f1feb7fe640 1 -- 172.21.15.17:0/763246880 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303298 (secure 0 0 0) 0x7f1ff4044400 con 0x7f1ff006a050 2023-08-09T12:46:59.638 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:46:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:46:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ff006a050 msgr2=0x7f1ff006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ff006a050 0x7f1ff006c510 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4036000 tx=0x7f1ff403c040 comp rx=0 tx=0).stop 2023-08-09T12:46:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200415e8f0 msgr2=0x7f20040c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200415e8f0 0x7f20040c5770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00caa0 tx=0x7f1ffc00cf60 comp rx=0 tx=0).stop 2023-08-09T12:46:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 shutdown_connections 2023-08-09T12:46:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1ff006a050 0x7f1ff006c510 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200415e8f0 0x7f20040c5770 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20040b3b40 0x7f20040c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 --2- 172.21.15.17:0/763246880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20040adc40 0x7f20041f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 >> 172.21.15.17:0/763246880 conn(0x7f20040cb1b0 msgr2=0x7f20040af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:59.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 shutdown_connections 2023-08-09T12:46:59.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.640+0000 7f2009586640 1 -- 172.21.15.17:0/763246880 wait complete. 2023-08-09T12:46:59.665 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2023-08-09T12:46:58.809774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7102,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555397,"statfs":{"total":1600000000,"available":1592727101,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.742391"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146710+0000","last_change":"2023-08-09T12:46:55.146618+0000","last_active":"2023-08-09T12:46:55.146710+0000","last_peered":"2023-08-09T12:46:55.146710+0000","last_clean":"2023-08-09T12:46:55.146710+0000","last_became_active":"2023-08-09T12:46:55.142254+0000","last_became_peered":"2023-08-09T12:46:55.142254+0000","last_unstale":"2023-08-09T12:46:55.146710+0000","last_undegraded":"2023-08-09T12:46:55.146710+0000","last_fullsized":"2023-08-09T12:46:55.146710+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:59:52.927447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117914+0000","last_change":"2023-08-09T12:46:55.123831+0000","last_active":"2023-08-09T12:46:56.117914+0000","last_peered":"2023-08-09T12:46:56.117914+0000","last_clean":"2023-08-09T12:46:56.117914+0000","last_became_active":"2023-08-09T12:46:55.123301+0000","last_became_peered":"2023-08-09T12:46:55.123301+0000","last_unstale":"2023-08-09T12:46:56.117914+0000","last_undegraded":"2023-08-09T12:46:56.117914+0000","last_fullsized":"2023-08-09T12:46:56.117914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:15:55.858398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.139452+0000","last_change":"2023-08-09T12:46:55.139298+0000","last_active":"2023-08-09T12:46:55.139452+0000","last_peered":"2023-08-09T12:46:55.139452+0000","last_clean":"2023-08-09T12:46:55.139452+0000","last_became_active":"2023-08-09T12:46:55.138718+0000","last_became_peered":"2023-08-09T12:46:55.138718+0000","last_unstale":"2023-08-09T12:46:55.139452+0000","last_undegraded":"2023-08-09T12:46:55.139452+0000","last_fullsized":"2023-08-09T12:46:55.139452+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:17:19.050542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.141831+0000","last_change":"2023-08-09T12:46:55.141621+0000","last_active":"2023-08-09T12:46:55.141831+0000","last_peered":"2023-08-09T12:46:55.141831+0000","last_clean":"2023-08-09T12:46:55.141831+0000","last_became_active":"2023-08-09T12:46:55.140830+0000","last_became_peered":"2023-08-09T12:46:55.140830+0000","last_unstale":"2023-08-09T12:46:55.141831+0000","last_undegraded":"2023-08-09T12:46:55.141831+0000","last_fullsized":"2023-08-09T12:46:55.141831+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:24:06.093998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.148513+0000","last_change":"2023-08-09T12:46:55.148346+0000","last_active":"2023-08-09T12:46:55.148513+0000","last_peered":"2023-08-09T12:46:55.148513+0000","last_clean":"2023-08-09T12:46:55.148513+0000","last_became_active":"2023-08-09T12:46:55.139843+0000","last_became_peered":"2023-08-09T12:46:55.139843+0000","last_unstale":"2023-08-09T12:46:55.148513+0000","last_undegraded":"2023-08-09T12:46:55.148513+0000","last_fullsized":"2023-08-09T12:46:55.148513+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:24.496782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116914+0000","last_change":"2023-08-09T12:46:55.136932+0000","last_active":"2023-08-09T12:46:56.116914+0000","last_peered":"2023-08-09T12:46:56.116914+0000","last_clean":"2023-08-09T12:46:56.116914+0000","last_became_active":"2023-08-09T12:46:55.136678+0000","last_became_peered":"2023-08-09T12:46:55.136678+0000","last_unstale":"2023-08-09T12:46:56.116914+0000","last_undegraded":"2023-08-09T12:46:56.116914+0000","last_fullsized":"2023-08-09T12:46:56.116914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:43:22.013379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117433+0000","last_change":"2023-08-09T12:46:55.135782+0000","last_active":"2023-08-09T12:46:56.117433+0000","last_peered":"2023-08-09T12:46:56.117433+0000","last_clean":"2023-08-09T12:46:56.117433+0000","last_became_active":"2023-08-09T12:46:55.135544+0000","last_became_peered":"2023-08-09T12:46:55.135544+0000","last_unstale":"2023-08-09T12:46:56.117433+0000","last_undegraded":"2023-08-09T12:46:56.117433+0000","last_fullsized":"2023-08-09T12:46:56.117433+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:32.043179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143751+0000","last_change":"2023-08-09T12:46:55.141422+0000","last_active":"2023-08-09T12:46:55.143751+0000","last_peered":"2023-08-09T12:46:55.143751+0000","last_clean":"2023-08-09T12:46:55.143751+0000","last_became_active":"2023-08-09T12:46:55.140867+0000","last_became_peered":"2023-08-09T12:46:55.140867+0000","last_unstale":"2023-08-09T12:46:55.143751+0000","last_undegraded":"2023-08-09T12:46:55.143751+0000","last_fullsized":"2023-08-09T12:46:55.143751+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:11:44.573323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115677+0000","last_change":"2023-08-09T12:46:55.143097+0000","last_active":"2023-08-09T12:46:56.115677+0000","last_peered":"2023-08-09T12:46:56.115677+0000","last_clean":"2023-08-09T12:46:56.115677+0000","last_became_active":"2023-08-09T12:46:55.142715+0000","last_became_peered":"2023-08-09T12:46:55.142715+0000","last_unstale":"2023-08-09T12:46:56.115677+0000","last_undegraded":"2023-08-09T12:46:56.115677+0000","last_fullsized":"2023-08-09T12:46:56.115677+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:08.985978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.142665+0000","last_change":"2023-08-09T12:46:55.142474+0000","last_active":"2023-08-09T12:46:55.142665+0000","last_peered":"2023-08-09T12:46:55.142665+0000","last_clean":"2023-08-09T12:46:55.142665+0000","last_became_active":"2023-08-09T12:46:55.139252+0000","last_became_peered":"2023-08-09T12:46:55.139252+0000","last_unstale":"2023-08-09T12:46:55.142665+0000","last_undegraded":"2023-08-09T12:46:55.142665+0000","last_fullsized":"2023-08-09T12:46:55.142665+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:01.643440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.128848+0000","last_change":"2023-08-09T12:46:55.127659+0000","last_active":"2023-08-09T12:46:55.128848+0000","last_peered":"2023-08-09T12:46:55.128848+0000","last_clean":"2023-08-09T12:46:55.128848+0000","last_became_active":"2023-08-09T12:46:55.127131+0000","last_became_peered":"2023-08-09T12:46:55.127131+0000","last_unstale":"2023-08-09T12:46:55.128848+0000","last_undegraded":"2023-08-09T12:46:55.128848+0000","last_fullsized":"2023-08-09T12:46:55.128848+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:54:47.347713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115860+0000","last_change":"2023-08-09T12:46:55.140320+0000","last_active":"2023-08-09T12:46:56.115860+0000","last_peered":"2023-08-09T12:46:56.115860+0000","last_clean":"2023-08-09T12:46:56.115860+0000","last_became_active":"2023-08-09T12:46:55.139961+0000","last_became_peered":"2023-08-09T12:46:55.139961+0000","last_unstale":"2023-08-09T12:46:56.115860+0000","last_undegraded":"2023-08-09T12:46:56.115860+0000","last_fullsized":"2023-08-09T12:46:56.115860+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:32:27.755997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.140276+0000","last_change":"2023-08-09T12:46:55.139866+0000","last_active":"2023-08-09T12:46:55.140276+0000","last_peered":"2023-08-09T12:46:55.140276+0000","last_clean":"2023-08-09T12:46:55.140276+0000","last_became_active":"2023-08-09T12:46:55.139451+0000","last_became_peered":"2023-08-09T12:46:55.139451+0000","last_unstale":"2023-08-09T12:46:55.140276+0000","last_undegraded":"2023-08-09T12:46:55.140276+0000","last_fullsized":"2023-08-09T12:46:55.140276+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:10.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.112053+0000","last_change":"2023-08-09T12:46:55.141917+0000","last_active":"2023-08-09T12:46:56.112053+0000","last_peered":"2023-08-09T12:46:56.112053+0000","last_clean":"2023-08-09T12:46:56.112053+0000","last_became_active":"2023-08-09T12:46:55.141558+0000","last_became_peered":"2023-08-09T12:46:55.141558+0000","last_unstale":"2023-08-09T12:46:56.112053+0000","last_undegraded":"2023-08-09T12:46:56.112053+0000","last_fullsized":"2023-08-09T12:46:56.112053+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:43.165450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.113438+0000","last_change":"2023-08-09T12:46:55.127181+0000","last_active":"2023-08-09T12:46:56.113438+0000","last_peered":"2023-08-09T12:46:56.113438+0000","last_clean":"2023-08-09T12:46:56.113438+0000","last_became_active":"2023-08-09T12:46:55.126827+0000","last_became_peered":"2023-08-09T12:46:55.126827+0000","last_unstale":"2023-08-09T12:46:56.113438+0000","last_undegraded":"2023-08-09T12:46:56.113438+0000","last_fullsized":"2023-08-09T12:46:56.113438+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:02:00.275203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.112422+0000","last_change":"2023-08-09T12:46:55.134501+0000","last_active":"2023-08-09T12:46:56.112422+0000","last_peered":"2023-08-09T12:46:56.112422+0000","last_clean":"2023-08-09T12:46:56.112422+0000","last_became_active":"2023-08-09T12:46:55.134103+0000","last_became_peered":"2023-08-09T12:46:55.134103+0000","last_unstale":"2023-08-09T12:46:56.112422+0000","last_undegraded":"2023-08-09T12:46:56.112422+0000","last_fullsized":"2023-08-09T12:46:56.112422+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:46.188820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.137729+0000","last_change":"2023-08-09T12:46:55.137230+0000","last_active":"2023-08-09T12:46:55.137729+0000","last_peered":"2023-08-09T12:46:55.137729+0000","last_clean":"2023-08-09T12:46:55.137729+0000","last_became_active":"2023-08-09T12:46:55.136284+0000","last_became_peered":"2023-08-09T12:46:55.136284+0000","last_unstale":"2023-08-09T12:46:55.137729+0000","last_undegraded":"2023-08-09T12:46:55.137729+0000","last_fullsized":"2023-08-09T12:46:55.137729+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:18.561482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115390+0000","last_change":"2023-08-09T12:46:55.136581+0000","last_active":"2023-08-09T12:46:56.115390+0000","last_peered":"2023-08-09T12:46:56.115390+0000","last_clean":"2023-08-09T12:46:56.115390+0000","last_became_active":"2023-08-09T12:46:55.136279+0000","last_became_peered":"2023-08-09T12:46:55.136279+0000","last_unstale":"2023-08-09T12:46:56.115390+0000","last_undegraded":"2023-08-09T12:46:56.115390+0000","last_fullsized":"2023-08-09T12:46:56.115390+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:31:38.665398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.147668+0000","last_change":"2023-08-09T12:46:55.147522+0000","last_active":"2023-08-09T12:46:55.147668+0000","last_peered":"2023-08-09T12:46:55.147668+0000","last_clean":"2023-08-09T12:46:55.147668+0000","last_became_active":"2023-08-09T12:46:55.145297+0000","last_became_peered":"2023-08-09T12:46:55.145297+0000","last_unstale":"2023-08-09T12:46:55.147668+0000","last_undegraded":"2023-08-09T12:46:55.147668+0000","last_fullsized":"2023-08-09T12:46:55.147668+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:34:21.286896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117979+0000","last_change":"2023-08-09T12:46:55.134566+0000","last_active":"2023-08-09T12:46:56.117979+0000","last_peered":"2023-08-09T12:46:56.117979+0000","last_clean":"2023-08-09T12:46:56.117979+0000","last_became_active":"2023-08-09T12:46:55.132491+0000","last_became_peered":"2023-08-09T12:46:55.132491+0000","last_unstale":"2023-08-09T12:46:56.117979+0000","last_undegraded":"2023-08-09T12:46:56.117979+0000","last_fullsized":"2023-08-09T12:46:56.117979+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:17.866294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.144120+0000","last_change":"2023-08-09T12:46:55.143972+0000","last_active":"2023-08-09T12:46:55.144120+0000","last_peered":"2023-08-09T12:46:55.144120+0000","last_clean":"2023-08-09T12:46:55.144120+0000","last_became_active":"2023-08-09T12:46:55.134542+0000","last_became_peered":"2023-08-09T12:46:55.134542+0000","last_unstale":"2023-08-09T12:46:55.144120+0000","last_undegraded":"2023-08-09T12:46:55.144120+0000","last_fullsized":"2023-08-09T12:46:55.144120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:28.207615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126887+0000","last_change":"2023-08-09T12:46:55.126477+0000","last_active":"2023-08-09T12:46:55.126887+0000","last_peered":"2023-08-09T12:46:55.126887+0000","last_clean":"2023-08-09T12:46:55.126887+0000","last_became_active":"2023-08-09T12:46:55.125816+0000","last_became_peered":"2023-08-09T12:46:55.125816+0000","last_unstale":"2023-08-09T12:46:55.126887+0000","last_undegraded":"2023-08-09T12:46:55.126887+0000","last_fullsized":"2023-08-09T12:46:55.126887+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:31.767914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.139249+0000","last_change":"2023-08-09T12:46:55.139140+0000","last_active":"2023-08-09T12:46:55.139249+0000","last_peered":"2023-08-09T12:46:55.139249+0000","last_clean":"2023-08-09T12:46:55.139249+0000","last_became_active":"2023-08-09T12:46:55.138373+0000","last_became_peered":"2023-08-09T12:46:55.138373+0000","last_unstale":"2023-08-09T12:46:55.139249+0000","last_undegraded":"2023-08-09T12:46:55.139249+0000","last_fullsized":"2023-08-09T12:46:55.139249+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:12:16.374220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.137781+0000","last_change":"2023-08-09T12:46:55.137572+0000","last_active":"2023-08-09T12:46:55.137781+0000","last_peered":"2023-08-09T12:46:55.137781+0000","last_clean":"2023-08-09T12:46:55.137781+0000","last_became_active":"2023-08-09T12:46:55.137226+0000","last_became_peered":"2023-08-09T12:46:55.137226+0000","last_unstale":"2023-08-09T12:46:55.137781+0000","last_undegraded":"2023-08-09T12:46:55.137781+0000","last_fullsized":"2023-08-09T12:46:55.137781+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:08.927890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.118284+0000","last_change":"2023-08-09T12:46:55.133165+0000","last_active":"2023-08-09T12:46:56.118284+0000","last_peered":"2023-08-09T12:46:56.118284+0000","last_clean":"2023-08-09T12:46:56.118284+0000","last_became_active":"2023-08-09T12:46:55.131905+0000","last_became_peered":"2023-08-09T12:46:55.131905+0000","last_unstale":"2023-08-09T12:46:56.118284+0000","last_undegraded":"2023-08-09T12:46:56.118284+0000","last_fullsized":"2023-08-09T12:46:56.118284+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:38.414626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116747+0000","last_change":"2023-08-09T12:46:55.131754+0000","last_active":"2023-08-09T12:46:56.116747+0000","last_peered":"2023-08-09T12:46:56.116747+0000","last_clean":"2023-08-09T12:46:56.116747+0000","last_became_active":"2023-08-09T12:46:55.131398+0000","last_became_peered":"2023-08-09T12:46:55.131398+0000","last_unstale":"2023-08-09T12:46:56.116747+0000","last_undegraded":"2023-08-09T12:46:56.116747+0000","last_fullsized":"2023-08-09T12:46:56.116747+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:24:06.093998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.128806+0000","last_change":"2023-08-09T12:46:55.127441+0000","last_active":"2023-08-09T12:46:55.128806+0000","last_peered":"2023-08-09T12:46:55.128806+0000","last_clean":"2023-08-09T12:46:55.128806+0000","last_became_active":"2023-08-09T12:46:55.126315+0000","last_became_peered":"2023-08-09T12:46:55.126315+0000","last_unstale":"2023-08-09T12:46:55.128806+0000","last_undegraded":"2023-08-09T12:46:55.128806+0000","last_fullsized":"2023-08-09T12:46:55.128806+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:21:45.179778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115753+0000","last_change":"2023-08-09T12:46:55.129999+0000","last_active":"2023-08-09T12:46:56.115753+0000","last_peered":"2023-08-09T12:46:56.115753+0000","last_clean":"2023-08-09T12:46:56.115753+0000","last_became_active":"2023-08-09T12:46:55.129544+0000","last_became_peered":"2023-08-09T12:46:55.129544+0000","last_unstale":"2023-08-09T12:46:56.115753+0000","last_undegraded":"2023-08-09T12:46:56.115753+0000","last_fullsized":"2023-08-09T12:46:56.115753+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:44.116719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.128767+0000","last_change":"2023-08-09T12:46:55.128548+0000","last_active":"2023-08-09T12:46:55.128767+0000","last_peered":"2023-08-09T12:46:55.128767+0000","last_clean":"2023-08-09T12:46:55.128767+0000","last_became_active":"2023-08-09T12:46:55.127757+0000","last_became_peered":"2023-08-09T12:46:55.127757+0000","last_unstale":"2023-08-09T12:46:55.128767+0000","last_undegraded":"2023-08-09T12:46:55.128767+0000","last_fullsized":"2023-08-09T12:46:55.128767+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:28:06.118710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.118569+0000","last_change":"2023-08-09T12:46:55.132869+0000","last_active":"2023-08-09T12:46:56.118569+0000","last_peered":"2023-08-09T12:46:56.118569+0000","last_clean":"2023-08-09T12:46:56.118569+0000","last_became_active":"2023-08-09T12:46:55.131371+0000","last_became_peered":"2023-08-09T12:46:55.131371+0000","last_unstale":"2023-08-09T12:46:56.118569+0000","last_undegraded":"2023-08-09T12:46:56.118569+0000","last_fullsized":"2023-08-09T12:46:56.118569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:29:36.647253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116015+0000","last_change":"2023-08-09T12:46:55.133144+0000","last_active":"2023-08-09T12:46:56.116015+0000","last_peered":"2023-08-09T12:46:56.116015+0000","last_clean":"2023-08-09T12:46:56.116015+0000","last_became_active":"2023-08-09T12:46:55.132453+0000","last_became_peered":"2023-08-09T12:46:55.132453+0000","last_unstale":"2023-08-09T12:46:56.116015+0000","last_undegraded":"2023-08-09T12:46:56.116015+0000","last_fullsized":"2023-08-09T12:46:56.116015+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:06:59.707363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.127092+0000","last_change":"2023-08-09T12:46:55.126875+0000","last_active":"2023-08-09T12:46:55.127092+0000","last_peered":"2023-08-09T12:46:55.127092+0000","last_clean":"2023-08-09T12:46:55.127092+0000","last_became_active":"2023-08-09T12:46:55.126218+0000","last_became_peered":"2023-08-09T12:46:55.126218+0000","last_unstale":"2023-08-09T12:46:55.127092+0000","last_undegraded":"2023-08-09T12:46:55.127092+0000","last_fullsized":"2023-08-09T12:46:55.127092+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:03:48.546756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146779+0000","last_change":"2023-08-09T12:46:55.145965+0000","last_active":"2023-08-09T12:46:55.146779+0000","last_peered":"2023-08-09T12:46:55.146779+0000","last_clean":"2023-08-09T12:46:55.146779+0000","last_became_active":"2023-08-09T12:46:55.144343+0000","last_became_peered":"2023-08-09T12:46:55.144343+0000","last_unstale":"2023-08-09T12:46:55.146779+0000","last_undegraded":"2023-08-09T12:46:55.146779+0000","last_fullsized":"2023-08-09T12:46:55.146779+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:57:38.982863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"129'4","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.158441+0000","last_change":"2023-08-09T12:46:54.097692+0000","last_active":"2023-08-09T12:46:55.158441+0000","last_peered":"2023-08-09T12:46:55.158441+0000","last_clean":"2023-08-09T12:46:55.158441+0000","last_became_active":"2023-08-09T12:46:54.097020+0000","last_became_peered":"2023-08-09T12:46:54.097020+0000","last_unstale":"2023-08-09T12:46:55.158441+0000","last_undegraded":"2023-08-09T12:46:55.158441+0000","last_fullsized":"2023-08-09T12:46:55.158441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:32:26.743508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143733+0000","last_change":"2023-08-09T12:46:55.141275+0000","last_active":"2023-08-09T12:46:55.143733+0000","last_peered":"2023-08-09T12:46:55.143733+0000","last_clean":"2023-08-09T12:46:55.143733+0000","last_became_active":"2023-08-09T12:46:55.140545+0000","last_became_peered":"2023-08-09T12:46:55.140545+0000","last_unstale":"2023-08-09T12:46:55.143733+0000","last_undegraded":"2023-08-09T12:46:55.143733+0000","last_fullsized":"2023-08-09T12:46:55.143733+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:20:13.772387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"129'1","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.157322+0000","last_change":"2023-08-09T12:46:54.086804+0000","last_active":"2023-08-09T12:46:55.157322+0000","last_peered":"2023-08-09T12:46:55.157322+0000","last_clean":"2023-08-09T12:46:55.157322+0000","last_became_active":"2023-08-09T12:46:54.085717+0000","last_became_peered":"2023-08-09T12:46:54.085717+0000","last_unstale":"2023-08-09T12:46:55.157322+0000","last_undegraded":"2023-08-09T12:46:55.157322+0000","last_fullsized":"2023-08-09T12:46:55.157322+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:39:46.861574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116236+0000","last_change":"2023-08-09T12:46:55.136469+0000","last_active":"2023-08-09T12:46:56.116236+0000","last_peered":"2023-08-09T12:46:56.116236+0000","last_clean":"2023-08-09T12:46:56.116236+0000","last_became_active":"2023-08-09T12:46:55.136201+0000","last_became_peered":"2023-08-09T12:46:55.136201+0000","last_unstale":"2023-08-09T12:46:56.116236+0000","last_undegraded":"2023-08-09T12:46:56.116236+0000","last_fullsized":"2023-08-09T12:46:56.116236+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:00.249612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"129'2","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.118881+0000","last_change":"2023-08-09T12:46:54.095303+0000","last_active":"2023-08-09T12:46:56.118881+0000","last_peered":"2023-08-09T12:46:56.118881+0000","last_clean":"2023-08-09T12:46:56.118881+0000","last_became_active":"2023-08-09T12:46:54.094978+0000","last_became_peered":"2023-08-09T12:46:54.094978+0000","last_unstale":"2023-08-09T12:46:56.118881+0000","last_undegraded":"2023-08-09T12:46:56.118881+0000","last_fullsized":"2023-08-09T12:46:56.118881+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:20:12.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.132503+0000","last_change":"2023-08-09T12:46:55.131700+0000","last_active":"2023-08-09T12:46:55.132503+0000","last_peered":"2023-08-09T12:46:55.132503+0000","last_clean":"2023-08-09T12:46:55.132503+0000","last_became_active":"2023-08-09T12:46:55.131312+0000","last_became_peered":"2023-08-09T12:46:55.131312+0000","last_unstale":"2023-08-09T12:46:55.132503+0000","last_undegraded":"2023-08-09T12:46:55.132503+0000","last_fullsized":"2023-08-09T12:46:55.132503+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:01.230530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.158020+0000","last_change":"2023-08-09T12:46:54.093029+0000","last_active":"2023-08-09T12:46:55.158020+0000","last_peered":"2023-08-09T12:46:55.158020+0000","last_clean":"2023-08-09T12:46:55.158020+0000","last_became_active":"2023-08-09T12:46:54.092746+0000","last_became_peered":"2023-08-09T12:46:54.092746+0000","last_unstale":"2023-08-09T12:46:55.158020+0000","last_undegraded":"2023-08-09T12:46:55.158020+0000","last_fullsized":"2023-08-09T12:46:55.158020+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:00.218041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143507+0000","last_change":"2023-08-09T12:46:55.143405+0000","last_active":"2023-08-09T12:46:55.143507+0000","last_peered":"2023-08-09T12:46:55.143507+0000","last_clean":"2023-08-09T12:46:55.143507+0000","last_became_active":"2023-08-09T12:46:55.143164+0000","last_became_peered":"2023-08-09T12:46:55.143164+0000","last_unstale":"2023-08-09T12:46:55.143507+0000","last_undegraded":"2023-08-09T12:46:55.143507+0000","last_fullsized":"2023-08-09T12:46:55.143507+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:00.249612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"129'1","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.112649+0000","last_change":"2023-08-09T12:46:54.095541+0000","last_active":"2023-08-09T12:46:56.112649+0000","last_peered":"2023-08-09T12:46:56.112649+0000","last_clean":"2023-08-09T12:46:56.112649+0000","last_became_active":"2023-08-09T12:46:54.095237+0000","last_became_peered":"2023-08-09T12:46:54.095237+0000","last_unstale":"2023-08-09T12:46:56.112649+0000","last_undegraded":"2023-08-09T12:46:56.112649+0000","last_fullsized":"2023-08-09T12:46:56.112649+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:52:32.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146992+0000","last_change":"2023-08-09T12:46:55.146887+0000","last_active":"2023-08-09T12:46:55.146992+0000","last_peered":"2023-08-09T12:46:55.146992+0000","last_clean":"2023-08-09T12:46:55.146992+0000","last_became_active":"2023-08-09T12:46:55.144675+0000","last_became_peered":"2023-08-09T12:46:55.144675+0000","last_unstale":"2023-08-09T12:46:55.146992+0000","last_undegraded":"2023-08-09T12:46:55.146992+0000","last_fullsized":"2023-08-09T12:46:55.146992+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:21:13.658088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"129'1","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.159153+0000","last_change":"2023-08-09T12:46:54.098214+0000","last_active":"2023-08-09T12:46:55.159153+0000","last_peered":"2023-08-09T12:46:55.159153+0000","last_clean":"2023-08-09T12:46:55.159153+0000","last_became_active":"2023-08-09T12:46:54.097947+0000","last_became_peered":"2023-08-09T12:46:54.097947+0000","last_unstale":"2023-08-09T12:46:55.159153+0000","last_undegraded":"2023-08-09T12:46:55.159153+0000","last_fullsized":"2023-08-09T12:46:55.159153+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:45:42.772240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116093+0000","last_change":"2023-08-09T12:46:55.131701+0000","last_active":"2023-08-09T12:46:56.116093+0000","last_peered":"2023-08-09T12:46:56.116093+0000","last_clean":"2023-08-09T12:46:56.116093+0000","last_became_active":"2023-08-09T12:46:55.131141+0000","last_became_peered":"2023-08-09T12:46:55.131141+0000","last_unstale":"2023-08-09T12:46:56.116093+0000","last_undegraded":"2023-08-09T12:46:56.116093+0000","last_fullsized":"2023-08-09T12:46:56.116093+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:33.225798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116164+0000","last_change":"2023-08-09T12:46:54.094869+0000","last_active":"2023-08-09T12:46:56.116164+0000","last_peered":"2023-08-09T12:46:56.116164+0000","last_clean":"2023-08-09T12:46:56.116164+0000","last_became_active":"2023-08-09T12:46:54.094461+0000","last_became_peered":"2023-08-09T12:46:54.094461+0000","last_unstale":"2023-08-09T12:46:56.116164+0000","last_undegraded":"2023-08-09T12:46:56.116164+0000","last_fullsized":"2023-08-09T12:46:56.116164+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:25:24.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.141211+0000","last_change":"2023-08-09T12:46:55.141125+0000","last_active":"2023-08-09T12:46:55.141211+0000","last_peered":"2023-08-09T12:46:55.141211+0000","last_clean":"2023-08-09T12:46:55.141211+0000","last_became_active":"2023-08-09T12:46:55.140826+0000","last_became_peered":"2023-08-09T12:46:55.140826+0000","last_unstale":"2023-08-09T12:46:55.141211+0000","last_undegraded":"2023-08-09T12:46:55.141211+0000","last_fullsized":"2023-08-09T12:46:55.141211+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:50.610520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.132519+0000","last_change":"2023-08-09T12:46:54.091334+0000","last_active":"2023-08-09T12:46:55.132519+0000","last_peered":"2023-08-09T12:46:55.132519+0000","last_clean":"2023-08-09T12:46:55.132519+0000","last_became_active":"2023-08-09T12:46:54.090940+0000","last_became_peered":"2023-08-09T12:46:54.090940+0000","last_unstale":"2023-08-09T12:46:55.132519+0000","last_undegraded":"2023-08-09T12:46:55.132519+0000","last_fullsized":"2023-08-09T12:46:55.132519+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:43.811909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146436+0000","last_change":"2023-08-09T12:46:55.142515+0000","last_active":"2023-08-09T12:46:55.146436+0000","last_peered":"2023-08-09T12:46:55.146436+0000","last_clean":"2023-08-09T12:46:55.146436+0000","last_became_active":"2023-08-09T12:46:55.141598+0000","last_became_peered":"2023-08-09T12:46:55.141598+0000","last_unstale":"2023-08-09T12:46:55.146436+0000","last_undegraded":"2023-08-09T12:46:55.146436+0000","last_fullsized":"2023-08-09T12:46:55.146436+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:38:42.092665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117030+0000","last_change":"2023-08-09T12:46:54.099875+0000","last_active":"2023-08-09T12:46:56.117030+0000","last_peered":"2023-08-09T12:46:56.117030+0000","last_clean":"2023-08-09T12:46:56.117030+0000","last_became_active":"2023-08-09T12:46:54.099663+0000","last_became_peered":"2023-08-09T12:46:54.099663+0000","last_unstale":"2023-08-09T12:46:56.117030+0000","last_undegraded":"2023-08-09T12:46:56.117030+0000","last_fullsized":"2023-08-09T12:46:56.117030+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:43.811909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.142134+0000","last_change":"2023-08-09T12:46:55.141984+0000","last_active":"2023-08-09T12:46:55.142134+0000","last_peered":"2023-08-09T12:46:55.142134+0000","last_clean":"2023-08-09T12:46:55.142134+0000","last_became_active":"2023-08-09T12:46:55.137701+0000","last_became_peered":"2023-08-09T12:46:55.137701+0000","last_unstale":"2023-08-09T12:46:55.142134+0000","last_undegraded":"2023-08-09T12:46:55.142134+0000","last_fullsized":"2023-08-09T12:46:55.142134+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:32.286753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126808+0000","last_change":"2023-08-09T12:46:54.094847+0000","last_active":"2023-08-09T12:46:55.126808+0000","last_peered":"2023-08-09T12:46:55.126808+0000","last_clean":"2023-08-09T12:46:55.126808+0000","last_became_active":"2023-08-09T12:46:54.094613+0000","last_became_peered":"2023-08-09T12:46:54.094613+0000","last_unstale":"2023-08-09T12:46:55.126808+0000","last_undegraded":"2023-08-09T12:46:55.126808+0000","last_fullsized":"2023-08-09T12:46:55.126808+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:42:43.647535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143840+0000","last_change":"2023-08-09T12:46:55.137446+0000","last_active":"2023-08-09T12:46:55.143840+0000","last_peered":"2023-08-09T12:46:55.143840+0000","last_clean":"2023-08-09T12:46:55.143840+0000","last_became_active":"2023-08-09T12:46:55.137014+0000","last_became_peered":"2023-08-09T12:46:55.137014+0000","last_unstale":"2023-08-09T12:46:55.143840+0000","last_undegraded":"2023-08-09T12:46:55.143840+0000","last_fullsized":"2023-08-09T12:46:55.143840+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:15.070877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"129'3","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.112407+0000","last_change":"2023-08-09T12:46:54.094669+0000","last_active":"2023-08-09T12:46:56.112407+0000","last_peered":"2023-08-09T12:46:56.112407+0000","last_clean":"2023-08-09T12:46:56.112407+0000","last_became_active":"2023-08-09T12:46:54.094424+0000","last_became_peered":"2023-08-09T12:46:54.094424+0000","last_unstale":"2023-08-09T12:46:56.112407+0000","last_undegraded":"2023-08-09T12:46:56.112407+0000","last_fullsized":"2023-08-09T12:46:56.112407+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:02.810452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146197+0000","last_change":"2023-08-09T12:46:55.145543+0000","last_active":"2023-08-09T12:46:55.146197+0000","last_peered":"2023-08-09T12:46:55.146197+0000","last_clean":"2023-08-09T12:46:55.146197+0000","last_became_active":"2023-08-09T12:46:55.145303+0000","last_became_peered":"2023-08-09T12:46:55.145303+0000","last_unstale":"2023-08-09T12:46:55.146197+0000","last_undegraded":"2023-08-09T12:46:55.146197+0000","last_fullsized":"2023-08-09T12:46:55.146197+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:33:45.196215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"129'6","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115295+0000","last_change":"2023-08-09T12:46:54.098955+0000","last_active":"2023-08-09T12:46:56.115295+0000","last_peered":"2023-08-09T12:46:56.115295+0000","last_clean":"2023-08-09T12:46:56.115295+0000","last_became_active":"2023-08-09T12:46:54.098454+0000","last_became_peered":"2023-08-09T12:46:54.098454+0000","last_unstale":"2023-08-09T12:46:56.115295+0000","last_undegraded":"2023-08-09T12:46:56.115295+0000","last_fullsized":"2023-08-09T12:46:56.115295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:47.241703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.137991+0000","last_change":"2023-08-09T12:46:55.137898+0000","last_active":"2023-08-09T12:46:55.137991+0000","last_peered":"2023-08-09T12:46:55.137991+0000","last_clean":"2023-08-09T12:46:55.137991+0000","last_became_active":"2023-08-09T12:46:55.137182+0000","last_became_peered":"2023-08-09T12:46:55.137182+0000","last_unstale":"2023-08-09T12:46:55.137991+0000","last_undegraded":"2023-08-09T12:46:55.137991+0000","last_fullsized":"2023-08-09T12:46:55.137991+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:24.496782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.157526+0000","last_change":"2023-08-09T12:46:54.088476+0000","last_active":"2023-08-09T12:46:55.157526+0000","last_peered":"2023-08-09T12:46:55.157526+0000","last_clean":"2023-08-09T12:46:55.157526+0000","last_became_active":"2023-08-09T12:46:54.088102+0000","last_became_peered":"2023-08-09T12:46:54.088102+0000","last_unstale":"2023-08-09T12:46:55.157526+0000","last_undegraded":"2023-08-09T12:46:55.157526+0000","last_fullsized":"2023-08-09T12:46:55.157526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:44.439232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117259+0000","last_change":"2023-08-09T12:46:55.140061+0000","last_active":"2023-08-09T12:46:56.117259+0000","last_peered":"2023-08-09T12:46:56.117259+0000","last_clean":"2023-08-09T12:46:56.117259+0000","last_became_active":"2023-08-09T12:46:55.139632+0000","last_became_peered":"2023-08-09T12:46:55.139632+0000","last_unstale":"2023-08-09T12:46:56.117259+0000","last_undegraded":"2023-08-09T12:46:56.117259+0000","last_fullsized":"2023-08-09T12:46:56.117259+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:21.265488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.129142+0000","last_change":"2023-08-09T12:46:54.092551+0000","last_active":"2023-08-09T12:46:55.129142+0000","last_peered":"2023-08-09T12:46:55.129142+0000","last_clean":"2023-08-09T12:46:55.129142+0000","last_became_active":"2023-08-09T12:46:54.092218+0000","last_became_peered":"2023-08-09T12:46:54.092218+0000","last_unstale":"2023-08-09T12:46:55.129142+0000","last_undegraded":"2023-08-09T12:46:55.129142+0000","last_fullsized":"2023-08-09T12:46:55.129142+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:06:56.315739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143771+0000","last_change":"2023-08-09T12:46:55.136435+0000","last_active":"2023-08-09T12:46:55.143771+0000","last_peered":"2023-08-09T12:46:55.143771+0000","last_clean":"2023-08-09T12:46:55.143771+0000","last_became_active":"2023-08-09T12:46:55.136019+0000","last_became_peered":"2023-08-09T12:46:55.136019+0000","last_unstale":"2023-08-09T12:46:55.143771+0000","last_undegraded":"2023-08-09T12:46:55.143771+0000","last_fullsized":"2023-08-09T12:46:55.143771+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:37.054109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.110545+0000","last_change":"2023-08-09T12:46:54.094475+0000","last_active":"2023-08-09T12:46:55.110545+0000","last_peered":"2023-08-09T12:46:55.110545+0000","last_clean":"2023-08-09T12:46:55.110545+0000","last_became_active":"2023-08-09T12:46:54.093989+0000","last_became_peered":"2023-08-09T12:46:54.093989+0000","last_unstale":"2023-08-09T12:46:55.110545+0000","last_undegraded":"2023-08-09T12:46:55.110545+0000","last_fullsized":"2023-08-09T12:46:55.110545+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:46:01.865872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.147287+0000","last_change":"2023-08-09T12:46:55.147187+0000","last_active":"2023-08-09T12:46:55.147287+0000","last_peered":"2023-08-09T12:46:55.147287+0000","last_clean":"2023-08-09T12:46:55.147287+0000","last_became_active":"2023-08-09T12:46:55.144962+0000","last_became_peered":"2023-08-09T12:46:55.144962+0000","last_unstale":"2023-08-09T12:46:55.147287+0000","last_undegraded":"2023-08-09T12:46:55.147287+0000","last_fullsized":"2023-08-09T12:46:55.147287+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:09:02.321281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"129'8","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115406+0000","last_change":"2023-08-09T12:46:54.100603+0000","last_active":"2023-08-09T12:46:56.115406+0000","last_peered":"2023-08-09T12:46:56.115406+0000","last_clean":"2023-08-09T12:46:56.115406+0000","last_became_active":"2023-08-09T12:46:54.100372+0000","last_became_peered":"2023-08-09T12:46:54.100372+0000","last_unstale":"2023-08-09T12:46:56.115406+0000","last_undegraded":"2023-08-09T12:46:56.115406+0000","last_fullsized":"2023-08-09T12:46:56.115406+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:49.598031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.140530+0000","last_change":"2023-08-09T12:46:55.140124+0000","last_active":"2023-08-09T12:46:55.140530+0000","last_peered":"2023-08-09T12:46:55.140530+0000","last_clean":"2023-08-09T12:46:55.140530+0000","last_became_active":"2023-08-09T12:46:55.139805+0000","last_became_peered":"2023-08-09T12:46:55.139805+0000","last_unstale":"2023-08-09T12:46:55.140530+0000","last_undegraded":"2023-08-09T12:46:55.140530+0000","last_fullsized":"2023-08-09T12:46:55.140530+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:22:04.156283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.155902+0000","last_change":"2023-08-09T12:46:54.094866+0000","last_active":"2023-08-09T12:46:55.155902+0000","last_peered":"2023-08-09T12:46:55.155902+0000","last_clean":"2023-08-09T12:46:55.155902+0000","last_became_active":"2023-08-09T12:46:54.094554+0000","last_became_peered":"2023-08-09T12:46:54.094554+0000","last_unstale":"2023-08-09T12:46:55.155902+0000","last_undegraded":"2023-08-09T12:46:55.155902+0000","last_fullsized":"2023-08-09T12:46:55.155902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:54:46.335223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115815+0000","last_change":"2023-08-09T12:46:55.143014+0000","last_active":"2023-08-09T12:46:56.115815+0000","last_peered":"2023-08-09T12:46:56.115815+0000","last_clean":"2023-08-09T12:46:56.115815+0000","last_became_active":"2023-08-09T12:46:55.142587+0000","last_became_peered":"2023-08-09T12:46:55.142587+0000","last_unstale":"2023-08-09T12:46:56.115815+0000","last_undegraded":"2023-08-09T12:46:56.115815+0000","last_fullsized":"2023-08-09T12:46:56.115815+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:10.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126184+0000","last_change":"2023-08-09T12:46:54.100085+0000","last_active":"2023-08-09T12:46:55.126184+0000","last_peered":"2023-08-09T12:46:55.126184+0000","last_clean":"2023-08-09T12:46:55.126184+0000","last_became_active":"2023-08-09T12:46:54.099794+0000","last_became_peered":"2023-08-09T12:46:54.099794+0000","last_unstale":"2023-08-09T12:46:55.126184+0000","last_undegraded":"2023-08-09T12:46:55.126184+0000","last_fullsized":"2023-08-09T12:46:55.126184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:24.511939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.140256+0000","last_change":"2023-08-09T12:46:55.139709+0000","last_active":"2023-08-09T12:46:55.140256+0000","last_peered":"2023-08-09T12:46:55.140256+0000","last_clean":"2023-08-09T12:46:55.140256+0000","last_became_active":"2023-08-09T12:46:55.138993+0000","last_became_peered":"2023-08-09T12:46:55.138993+0000","last_unstale":"2023-08-09T12:46:55.140256+0000","last_undegraded":"2023-08-09T12:46:55.140256+0000","last_fullsized":"2023-08-09T12:46:55.140256+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:59:47.309995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116393+0000","last_change":"2023-08-09T12:46:54.098679+0000","last_active":"2023-08-09T12:46:56.116393+0000","last_peered":"2023-08-09T12:46:56.116393+0000","last_clean":"2023-08-09T12:46:56.116393+0000","last_became_active":"2023-08-09T12:46:54.097648+0000","last_became_peered":"2023-08-09T12:46:54.097648+0000","last_unstale":"2023-08-09T12:46:56.116393+0000","last_undegraded":"2023-08-09T12:46:56.116393+0000","last_fullsized":"2023-08-09T12:46:56.116393+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:23.001604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126858+0000","last_change":"2023-08-09T12:46:55.126670+0000","last_active":"2023-08-09T12:46:55.126858+0000","last_peered":"2023-08-09T12:46:55.126858+0000","last_clean":"2023-08-09T12:46:55.126858+0000","last_became_active":"2023-08-09T12:46:55.125770+0000","last_became_peered":"2023-08-09T12:46:55.125770+0000","last_unstale":"2023-08-09T12:46:55.126858+0000","last_undegraded":"2023-08-09T12:46:55.126858+0000","last_fullsized":"2023-08-09T12:46:55.126858+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:03.476742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.124702+0000","last_change":"2023-08-09T12:46:54.096839+0000","last_active":"2023-08-09T12:46:55.124702+0000","last_peered":"2023-08-09T12:46:55.124702+0000","last_clean":"2023-08-09T12:46:55.124702+0000","last_became_active":"2023-08-09T12:46:54.096516+0000","last_became_peered":"2023-08-09T12:46:54.096516+0000","last_unstale":"2023-08-09T12:46:55.124702+0000","last_undegraded":"2023-08-09T12:46:55.124702+0000","last_fullsized":"2023-08-09T12:46:55.124702+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:13:19.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143858+0000","last_change":"2023-08-09T12:46:55.143798+0000","last_active":"2023-08-09T12:46:55.143858+0000","last_peered":"2023-08-09T12:46:55.143858+0000","last_clean":"2023-08-09T12:46:55.143858+0000","last_became_active":"2023-08-09T12:46:55.134003+0000","last_became_peered":"2023-08-09T12:46:55.134003+0000","last_unstale":"2023-08-09T12:46:55.143858+0000","last_undegraded":"2023-08-09T12:46:55.143858+0000","last_fullsized":"2023-08-09T12:46:55.143858+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:08.132444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117336+0000","last_change":"2023-08-09T12:46:54.101441+0000","last_active":"2023-08-09T12:46:56.117336+0000","last_peered":"2023-08-09T12:46:56.117336+0000","last_clean":"2023-08-09T12:46:56.117336+0000","last_became_active":"2023-08-09T12:46:54.101007+0000","last_became_peered":"2023-08-09T12:46:54.101007+0000","last_unstale":"2023-08-09T12:46:56.117336+0000","last_undegraded":"2023-08-09T12:46:56.117336+0000","last_fullsized":"2023-08-09T12:46:56.117336+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:00.023225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143789+0000","last_change":"2023-08-09T12:46:55.142687+0000","last_active":"2023-08-09T12:46:55.143789+0000","last_peered":"2023-08-09T12:46:55.143789+0000","last_clean":"2023-08-09T12:46:55.143789+0000","last_became_active":"2023-08-09T12:46:55.142263+0000","last_became_peered":"2023-08-09T12:46:55.142263+0000","last_unstale":"2023-08-09T12:46:55.143789+0000","last_undegraded":"2023-08-09T12:46:55.143789+0000","last_fullsized":"2023-08-09T12:46:55.143789+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:27.924152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.110908+0000","last_change":"2023-08-09T12:46:54.094289+0000","last_active":"2023-08-09T12:46:55.110908+0000","last_peered":"2023-08-09T12:46:55.110908+0000","last_clean":"2023-08-09T12:46:55.110908+0000","last_became_active":"2023-08-09T12:46:54.093560+0000","last_became_peered":"2023-08-09T12:46:54.093560+0000","last_unstale":"2023-08-09T12:46:55.110908+0000","last_undegraded":"2023-08-09T12:46:55.110908+0000","last_fullsized":"2023-08-09T12:46:55.110908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:41:09.308160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.114661+0000","last_change":"2023-08-09T12:46:55.136338+0000","last_active":"2023-08-09T12:46:56.114661+0000","last_peered":"2023-08-09T12:46:56.114661+0000","last_clean":"2023-08-09T12:46:56.114661+0000","last_became_active":"2023-08-09T12:46:55.127031+0000","last_became_peered":"2023-08-09T12:46:55.127031+0000","last_unstale":"2023-08-09T12:46:56.114661+0000","last_undegraded":"2023-08-09T12:46:56.114661+0000","last_fullsized":"2023-08-09T12:46:56.114661+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:31:35.917100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116562+0000","last_change":"2023-08-09T12:46:54.098330+0000","last_active":"2023-08-09T12:46:56.116562+0000","last_peered":"2023-08-09T12:46:56.116562+0000","last_clean":"2023-08-09T12:46:56.116562+0000","last_became_active":"2023-08-09T12:46:54.096328+0000","last_became_peered":"2023-08-09T12:46:54.096328+0000","last_unstale":"2023-08-09T12:46:56.116562+0000","last_undegraded":"2023-08-09T12:46:56.116562+0000","last_fullsized":"2023-08-09T12:46:56.116562+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:06:36.421003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126807+0000","last_change":"2023-08-09T12:46:55.126597+0000","last_active":"2023-08-09T12:46:55.126807+0000","last_peered":"2023-08-09T12:46:55.126807+0000","last_clean":"2023-08-09T12:46:55.126807+0000","last_became_active":"2023-08-09T12:46:55.126037+0000","last_became_peered":"2023-08-09T12:46:55.126037+0000","last_unstale":"2023-08-09T12:46:55.126807+0000","last_undegraded":"2023-08-09T12:46:55.126807+0000","last_fullsized":"2023-08-09T12:46:55.126807+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:42:41.473270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.111935+0000","last_change":"2023-08-09T12:46:54.097268+0000","last_active":"2023-08-09T12:46:55.111935+0000","last_peered":"2023-08-09T12:46:55.111935+0000","last_clean":"2023-08-09T12:46:55.111935+0000","last_became_active":"2023-08-09T12:46:54.093607+0000","last_became_peered":"2023-08-09T12:46:54.093607+0000","last_unstale":"2023-08-09T12:46:55.111935+0000","last_undegraded":"2023-08-09T12:46:55.111935+0000","last_fullsized":"2023-08-09T12:46:55.111935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:39:47.432179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.138400+0000","last_change":"2023-08-09T12:46:55.138219+0000","last_active":"2023-08-09T12:46:55.138400+0000","last_peered":"2023-08-09T12:46:55.138400+0000","last_clean":"2023-08-09T12:46:55.138400+0000","last_became_active":"2023-08-09T12:46:55.137605+0000","last_became_peered":"2023-08-09T12:46:55.137605+0000","last_unstale":"2023-08-09T12:46:55.138400+0000","last_undegraded":"2023-08-09T12:46:55.138400+0000","last_fullsized":"2023-08-09T12:46:55.138400+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:45.451722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.157699+0000","last_change":"2023-08-09T12:46:54.088590+0000","last_active":"2023-08-09T12:46:55.157699+0000","last_peered":"2023-08-09T12:46:55.157699+0000","last_clean":"2023-08-09T12:46:55.157699+0000","last_became_active":"2023-08-09T12:46:54.086840+0000","last_became_peered":"2023-08-09T12:46:54.086840+0000","last_unstale":"2023-08-09T12:46:55.157699+0000","last_undegraded":"2023-08-09T12:46:55.157699+0000","last_fullsized":"2023-08-09T12:46:55.157699+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:37.848458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":382,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.114884+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:46:56.114884+0000","last_peered":"2023-08-09T12:46:56.114884+0000","last_clean":"2023-08-09T12:46:56.114884+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:46:56.114884+0000","last_undegraded":"2023-08-09T12:46:56.114884+0000","last_fullsized":"2023-08-09T12:46:56.114884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:59:28.729976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":202,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.113160+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:46:55.113160+0000","last_peered":"2023-08-09T12:46:55.113160+0000","last_clean":"2023-08-09T12:46:55.113160+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:46:55.113160+0000","last_undegraded":"2023-08-09T12:46:55.113160+0000","last_fullsized":"2023-08-09T12:46:55.113160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:05:45.050037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116590+0000","last_change":"2023-08-09T12:46:55.132754+0000","last_active":"2023-08-09T12:46:56.116590+0000","last_peered":"2023-08-09T12:46:56.116590+0000","last_clean":"2023-08-09T12:46:56.116590+0000","last_became_active":"2023-08-09T12:46:55.132023+0000","last_became_peered":"2023-08-09T12:46:55.132023+0000","last_unstale":"2023-08-09T12:46:56.116590+0000","last_undegraded":"2023-08-09T12:46:56.116590+0000","last_fullsized":"2023-08-09T12:46:56.116590+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:24:38.809743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"129'1","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.113020+0000","last_change":"2023-08-09T12:46:54.096185+0000","last_active":"2023-08-09T12:46:56.113020+0000","last_peered":"2023-08-09T12:46:56.113020+0000","last_clean":"2023-08-09T12:46:56.113020+0000","last_became_active":"2023-08-09T12:46:54.095889+0000","last_became_peered":"2023-08-09T12:46:54.095889+0000","last_unstale":"2023-08-09T12:46:56.113020+0000","last_undegraded":"2023-08-09T12:46:56.113020+0000","last_fullsized":"2023-08-09T12:46:56.113020+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:49:22.470606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.113585+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:46:56.113585+0000","last_peered":"2023-08-09T12:46:56.113585+0000","last_clean":"2023-08-09T12:46:56.113585+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:46:56.113585+0000","last_undegraded":"2023-08-09T12:46:56.113585+0000","last_fullsized":"2023-08-09T12:46:56.113585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:38:34.335566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.141721+0000","last_change":"2023-08-09T12:46:55.141551+0000","last_active":"2023-08-09T12:46:55.141721+0000","last_peered":"2023-08-09T12:46:55.141721+0000","last_clean":"2023-08-09T12:46:55.141721+0000","last_became_active":"2023-08-09T12:46:55.136759+0000","last_became_peered":"2023-08-09T12:46:55.136759+0000","last_unstale":"2023-08-09T12:46:55.141721+0000","last_undegraded":"2023-08-09T12:46:55.141721+0000","last_fullsized":"2023-08-09T12:46:55.141721+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:04.993382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.114859+0000","last_change":"2023-08-09T12:46:54.098535+0000","last_active":"2023-08-09T12:46:55.114859+0000","last_peered":"2023-08-09T12:46:55.114859+0000","last_clean":"2023-08-09T12:46:55.114859+0000","last_became_active":"2023-08-09T12:46:54.098289+0000","last_became_peered":"2023-08-09T12:46:54.098289+0000","last_unstale":"2023-08-09T12:46:55.114859+0000","last_undegraded":"2023-08-09T12:46:55.114859+0000","last_fullsized":"2023-08-09T12:46:55.114859+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:12:32.203445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.112797+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:46:55.112797+0000","last_peered":"2023-08-09T12:46:55.112797+0000","last_clean":"2023-08-09T12:46:55.112797+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:46:55.112797+0000","last_undegraded":"2023-08-09T12:46:55.112797+0000","last_fullsized":"2023-08-09T12:46:55.112797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:59:08.920629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143713+0000","last_change":"2023-08-09T12:46:55.141124+0000","last_active":"2023-08-09T12:46:55.143713+0000","last_peered":"2023-08-09T12:46:55.143713+0000","last_clean":"2023-08-09T12:46:55.143713+0000","last_became_active":"2023-08-09T12:46:55.140006+0000","last_became_peered":"2023-08-09T12:46:55.140006+0000","last_unstale":"2023-08-09T12:46:55.143713+0000","last_undegraded":"2023-08-09T12:46:55.143713+0000","last_fullsized":"2023-08-09T12:46:55.143713+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:46:47.707585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"129'1","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116029+0000","last_change":"2023-08-09T12:46:54.098828+0000","last_active":"2023-08-09T12:46:56.116029+0000","last_peered":"2023-08-09T12:46:56.116029+0000","last_clean":"2023-08-09T12:46:56.116029+0000","last_became_active":"2023-08-09T12:46:54.098144+0000","last_became_peered":"2023-08-09T12:46:54.098144+0000","last_unstale":"2023-08-09T12:46:56.116029+0000","last_undegraded":"2023-08-09T12:46:56.116029+0000","last_fullsized":"2023-08-09T12:46:56.116029+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:46:23.923697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.115030+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:46:55.115030+0000","last_peered":"2023-08-09T12:46:55.115030+0000","last_clean":"2023-08-09T12:46:55.115030+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:46:55.115030+0000","last_undegraded":"2023-08-09T12:46:55.115030+0000","last_fullsized":"2023-08-09T12:46:55.115030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:22:10.540231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.138895+0000","last_change":"2023-08-09T12:46:55.138803+0000","last_active":"2023-08-09T12:46:55.138895+0000","last_peered":"2023-08-09T12:46:55.138895+0000","last_clean":"2023-08-09T12:46:55.138895+0000","last_became_active":"2023-08-09T12:46:55.138290+0000","last_became_peered":"2023-08-09T12:46:55.138290+0000","last_unstale":"2023-08-09T12:46:55.138895+0000","last_undegraded":"2023-08-09T12:46:55.138895+0000","last_fullsized":"2023-08-09T12:46:55.138895+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:25:25.398131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117376+0000","last_change":"2023-08-09T12:46:54.097063+0000","last_active":"2023-08-09T12:46:56.117376+0000","last_peered":"2023-08-09T12:46:56.117376+0000","last_clean":"2023-08-09T12:46:56.117376+0000","last_became_active":"2023-08-09T12:46:54.096802+0000","last_became_peered":"2023-08-09T12:46:54.096802+0000","last_unstale":"2023-08-09T12:46:56.117376+0000","last_undegraded":"2023-08-09T12:46:56.117376+0000","last_fullsized":"2023-08-09T12:46:56.117376+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:49.567328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126883+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:46:55.126883+0000","last_peered":"2023-08-09T12:46:55.126883+0000","last_clean":"2023-08-09T12:46:55.126883+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:46:55.126883+0000","last_undegraded":"2023-08-09T12:46:55.126883+0000","last_fullsized":"2023-08-09T12:46:55.126883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:27.676611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143670+0000","last_change":"2023-08-09T12:46:55.135010+0000","last_active":"2023-08-09T12:46:55.143670+0000","last_peered":"2023-08-09T12:46:55.143670+0000","last_clean":"2023-08-09T12:46:55.143670+0000","last_became_active":"2023-08-09T12:46:55.133356+0000","last_became_peered":"2023-08-09T12:46:55.133356+0000","last_unstale":"2023-08-09T12:46:55.143670+0000","last_undegraded":"2023-08-09T12:46:55.143670+0000","last_fullsized":"2023-08-09T12:46:55.143670+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:11:23.855350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.112184+0000","last_change":"2023-08-09T12:46:54.082498+0000","last_active":"2023-08-09T12:46:55.112184+0000","last_peered":"2023-08-09T12:46:55.112184+0000","last_clean":"2023-08-09T12:46:55.112184+0000","last_became_active":"2023-08-09T12:46:54.081841+0000","last_became_peered":"2023-08-09T12:46:54.081841+0000","last_unstale":"2023-08-09T12:46:55.112184+0000","last_undegraded":"2023-08-09T12:46:55.112184+0000","last_fullsized":"2023-08-09T12:46:55.112184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:10:22.973619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.113290+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:46:56.113290+0000","last_peered":"2023-08-09T12:46:56.113290+0000","last_clean":"2023-08-09T12:46:56.113290+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:46:56.113290+0000","last_undegraded":"2023-08-09T12:46:56.113290+0000","last_fullsized":"2023-08-09T12:46:56.113290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:24:24.191320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.147920+0000","last_change":"2023-08-09T12:46:55.147843+0000","last_active":"2023-08-09T12:46:55.147920+0000","last_peered":"2023-08-09T12:46:55.147920+0000","last_clean":"2023-08-09T12:46:55.147920+0000","last_became_active":"2023-08-09T12:46:55.145729+0000","last_became_peered":"2023-08-09T12:46:55.145729+0000","last_unstale":"2023-08-09T12:46:55.147920+0000","last_undegraded":"2023-08-09T12:46:55.147920+0000","last_fullsized":"2023-08-09T12:46:55.147920+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:46:45.368274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.158761+0000","last_change":"2023-08-09T12:46:54.094844+0000","last_active":"2023-08-09T12:46:55.158761+0000","last_peered":"2023-08-09T12:46:55.158761+0000","last_clean":"2023-08-09T12:46:55.158761+0000","last_became_active":"2023-08-09T12:46:54.094569+0000","last_became_peered":"2023-08-09T12:46:54.094569+0000","last_unstale":"2023-08-09T12:46:55.158761+0000","last_undegraded":"2023-08-09T12:46:55.158761+0000","last_fullsized":"2023-08-09T12:46:55.158761+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:20:57.729755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.121693+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:46:55.121693+0000","last_peered":"2023-08-09T12:46:55.121693+0000","last_clean":"2023-08-09T12:46:55.121693+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:46:55.121693+0000","last_undegraded":"2023-08-09T12:46:55.121693+0000","last_fullsized":"2023-08-09T12:46:55.121693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:57:47.335379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.139230+0000","last_change":"2023-08-09T12:46:55.138967+0000","last_active":"2023-08-09T12:46:55.139230+0000","last_peered":"2023-08-09T12:46:55.139230+0000","last_clean":"2023-08-09T12:46:55.139230+0000","last_became_active":"2023-08-09T12:46:55.137977+0000","last_became_peered":"2023-08-09T12:46:55.137977+0000","last_unstale":"2023-08-09T12:46:55.139230+0000","last_undegraded":"2023-08-09T12:46:55.139230+0000","last_fullsized":"2023-08-09T12:46:55.139230+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:26.868895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.111604+0000","last_change":"2023-08-09T12:46:54.088023+0000","last_active":"2023-08-09T12:46:55.111604+0000","last_peered":"2023-08-09T12:46:55.111604+0000","last_clean":"2023-08-09T12:46:55.111604+0000","last_became_active":"2023-08-09T12:46:54.086357+0000","last_became_peered":"2023-08-09T12:46:54.086357+0000","last_unstale":"2023-08-09T12:46:55.111604+0000","last_undegraded":"2023-08-09T12:46:55.111604+0000","last_fullsized":"2023-08-09T12:46:55.111604+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:06:45.180778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.118030+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:46:56.118030+0000","last_peered":"2023-08-09T12:46:56.118030+0000","last_clean":"2023-08-09T12:46:56.118030+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:46:56.118030+0000","last_undegraded":"2023-08-09T12:46:56.118030+0000","last_fullsized":"2023-08-09T12:46:56.118030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:32:33.522033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193988,"statfs":{"total":200000000,"available":198644396,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.1279999999999999,"15min":1.105},"min":{"1min":0.749,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3799999999999999,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":1.022},{"interface":"front","average":{"1min":1.097,"5min":1.1359999999999999,"15min":1.089},"min":{"1min":0.82199999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.395,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.84499999999999997}]},{"osd":1,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2130000000000001,"15min":1.129},"min":{"1min":0.78400000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8069999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.153},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2090000000000001,"15min":1.127},"min":{"1min":0.92600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.7010000000000001,"5min":1.714,"15min":1.734},"last":1.0980000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.304,"15min":1.1899999999999999},"min":{"1min":0.95999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.804,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2130000000000001,"15min":1.1619999999999999},"min":{"1min":0.78400000000000003,"5min":0.73399999999999999,"15min":0.69799999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":2.173},"last":1.282}]},{"osd":3,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.325,"15min":1.254},"min":{"1min":0.872,"5min":0.746,"15min":0.746},"max":{"1min":1.581,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.415},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.375,"15min":1.2909999999999999},"min":{"1min":1.1950000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.702,"5min":2.282,"15min":2.282},"last":0.72699999999999998}]},{"osd":4,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.224,"15min":1.212},"min":{"1min":1.0029999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.776,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.4079999999999999,"15min":1.3049999999999999},"min":{"1min":1.077,"5min":0.67900000000000005,"15min":0.58599999999999997},"max":{"1min":1.921,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.304}]},{"osd":5,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4399999999999999,"15min":1.323},"min":{"1min":0.92800000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7549999999999999,"5min":2.802,"15min":2.802},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.5309999999999999,"15min":1.498},"min":{"1min":1.5069999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1230000000000002,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.3400000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.486,"15min":1.478},"min":{"1min":1.3520000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.0169999999999999,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.645,"5min":1.518,"15min":1.4630000000000001},"min":{"1min":1.411,"5min":0.83699999999999997,"15min":0.623},"max":{"1min":1.998,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.47}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199232708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1699999999999999,"15min":1.1359999999999999},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.986,"5min":1.986,"15min":2.54},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.103,"15min":1.0720000000000001},"min":{"1min":0.69299999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4770000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.127}]},{"osd":1,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.268,"15min":1.238},"min":{"1min":0.84799999999999998,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.621,"5min":1.7250000000000001,"15min":2.306},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.355,"15min":1.3260000000000001},"min":{"1min":0.94899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6379999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.2370000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.179,"15min":1.117},"min":{"1min":0.96199999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5920000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.357,"5min":1.3129999999999999,"15min":1.2809999999999999},"min":{"1min":0.76500000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.827,"5min":1.923,"15min":2.6499999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3420000000000001,"15min":1.2869999999999999},"min":{"1min":0.82199999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7390000000000001,"5min":2.327,"15min":2.327},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.3859999999999999,"15min":1.3089999999999999},"min":{"1min":1.2130000000000001,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.639,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.0409999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4690000000000001,"15min":1.3460000000000001},"min":{"1min":0.78300000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.028,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3979999999999999,"15min":1.345},"min":{"1min":0.91100000000000003,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":2.29,"5min":2.29,"15min":2.3479999999999999},"last":1.3700000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.427,"15min":1.3420000000000001},"min":{"1min":1.0149999999999999,"5min":0.83999999999999997,"15min":0.77600000000000002},"max":{"1min":1.798,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.258},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.5580000000000001,"15min":1.488},"min":{"1min":1.079,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.7450000000000001,"5min":2.4350000000000001,"15min":2.8580000000000001},"last":1.3}]},{"osd":7,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5780000000000001,"15min":1.4490000000000001},"min":{"1min":1.2050000000000001,"5min":1.0009999999999999,"15min":0.752},"max":{"1min":2.1520000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.542,"5min":1.593,"15min":1.4570000000000001},"min":{"1min":1.099,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.7709999999999999,"5min":3.621,"15min":3.621},"last":1.3420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.1080000000000001,"15min":1.109},"min":{"1min":0.71199999999999997,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":1.3120000000000001,"5min":2.4020000000000001,"15min":2.427},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.194,"5min":1.218,"15min":1.099},"min":{"1min":0.76300000000000001,"5min":0.71699999999999997,"15min":0.625},"max":{"1min":1.8859999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.2150000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3640000000000001,"15min":1.3029999999999999},"min":{"1min":0.64400000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.804,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.254,"5min":1.286,"15min":1.2509999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6699999999999999,"5min":1.984,"15min":1.984},"last":0.73899999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.26,"15min":1.2130000000000001},"min":{"1min":0.84699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6060000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.22,"15min":1.194},"min":{"1min":0.76300000000000001,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4570000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.03}]},{"osd":3,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.333,"15min":1.226},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.77100000000000002},"max":{"1min":1.6899999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3879999999999999,"15min":1.377},"min":{"1min":0.93999999999999995,"5min":0.86299999999999999,"15min":0.78200000000000003},"max":{"1min":1.76,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2689999999999999,"15min":1.238},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":1.6319999999999999,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":1.167},{"interface":"front","average":{"1min":1.474,"5min":1.403,"15min":1.379},"min":{"1min":0.80600000000000005,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":1.722,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.115}]},{"osd":6,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.393,"15min":1.3480000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.929,"5min":2.5,"15min":2.5},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.448,"15min":1.482},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.726,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.3460000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5269999999999999,"15min":1.5229999999999999},"min":{"1min":0.86599999999999999,"5min":0.76900000000000002,"15min":0.67200000000000004},"max":{"1min":1.946,"5min":2.722,"15min":3.3250000000000002},"last":1.518},{"interface":"front","average":{"1min":1.589,"5min":1.583,"15min":1.528},"min":{"1min":1.0740000000000001,"5min":0.80000000000000004,"15min":0.65300000000000002},"max":{"1min":1.857,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.5720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199234832,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1559999999999999,"15min":1.0940000000000001},"min":{"1min":0.65600000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.171,"5min":1.169,"15min":1.1080000000000001},"min":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4830000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.95199999999999996}]},{"osd":1,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.268,"15min":1.3260000000000001},"min":{"1min":0.77400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.327,"15min":1.3360000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.363}]},{"osd":2,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.70899999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.427},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.3480000000000001,"15min":1.323},"min":{"1min":0.97699999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":3.0579999999999998,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.5760000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3089999999999999,"15min":1.2350000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.649,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.087},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":1.071,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.536}]},{"osd":5,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.337,"15min":1.3839999999999999},"min":{"1min":0.98699999999999999,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3939999999999999,"15min":1.3819999999999999},"min":{"1min":0.85599999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.9750000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.2829999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.417,"15min":1.482},"min":{"1min":0.97599999999999998,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.645,"5min":1.5369999999999999,"15min":1.54},"min":{"1min":0.96599999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3340000000000001,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.7070000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.54,"15min":1.524},"min":{"1min":1.115,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0859999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.5820000000000001,"15min":1.621},"min":{"1min":1.347,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":1.6859999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199240995,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90900000000000003,"15min":0.84199999999999997},"min":{"1min":0.42699999999999999,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.4219999999999999,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.996,"5min":1.079,"15min":0.92800000000000005},"min":{"1min":0.497,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":1.7170000000000001,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.222}]},{"osd":1,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.93300000000000005,"15min":0.90700000000000003},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4930000000000001,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1519999999999999,"15min":0.95799999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.373},"max":{"1min":1.8400000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.28}]},{"osd":2,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.3680000000000001,"15min":1.129},"min":{"1min":0.53700000000000003,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":1.9259999999999999,"5min":18.145,"15min":18.145},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2509999999999999,"15min":1.2070000000000001},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.41799999999999998},"max":{"1min":1.593,"5min":2.169,"15min":2.169},"last":0.91300000000000003}]},{"osd":4,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3220000000000001,"15min":1.3240000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.745},"max":{"1min":1.6140000000000001,"5min":2.972,"15min":3.5110000000000001},"last":1.121},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.351,"15min":1.3380000000000001},"min":{"1min":1.012,"5min":0.751,"15min":0.65400000000000003},"max":{"1min":1.752,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.175}]},{"osd":5,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.587,"15min":1.4399999999999999},"min":{"1min":0.97499999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8169999999999999,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.6140000000000001,"15min":1.3720000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":2.1219999999999999,"5min":14.105,"15min":14.105},"last":1.0349999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.405,"15min":1.349},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4910000000000001,"15min":1.478},"min":{"1min":0.88400000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.0099999999999998,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.5389999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.5029999999999999,"15min":1.4139999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.72499999999999998},"max":{"1min":2.242,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4850000000000001,"15min":1.3979999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":1.8129999999999999,"5min":3.016,"15min":3.016},"last":2.073}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.111,"5min":1.597,"15min":1.716},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.995,"15min":0.96399999999999997},"min":{"1min":0.629,"5min":0.46700000000000003,"15min":0.38900000000000001},"max":{"1min":1.2370000000000001,"5min":1.73,"15min":2.9009999999999998},"last":0.92100000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":0.92700000000000005},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.36299999999999999},"max":{"1min":1.6379999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.073,"15min":1.0569999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.383,"5min":1.823,"15min":1.869},"last":1.248}]},{"osd":3,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.161,"15min":1.1659999999999999},"min":{"1min":0.65900000000000003,"5min":0.54800000000000004,"15min":0.46600000000000003},"max":{"1min":1.5669999999999999,"5min":1.6819999999999999,"15min":3.2850000000000001},"last":1.202},{"interface":"front","average":{"1min":1.105,"5min":1.2030000000000001,"15min":1.161},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.583,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":1.101}]},{"osd":4,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.4570000000000001,"15min":1.421},"min":{"1min":0.83499999999999996,"5min":0.82599999999999996,"15min":0.81899999999999995},"max":{"1min":1.794,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.323},{"interface":"front","average":{"1min":1.276,"5min":1.3420000000000001,"15min":1.29},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.7629999999999999,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":1.5609999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4119999999999999,"15min":1.369},"min":{"1min":1.006,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7889999999999999,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.462,"15min":1.48},"min":{"1min":0.90800000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.669,"5min":2.4780000000000002,"15min":4.806},"last":1.3999999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.319},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.71,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.478},{"interface":"front","average":{"1min":1.373,"5min":1.468,"15min":1.429},"min":{"1min":0.998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.917,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":0.97699999999999998}]},{"osd":7,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4359999999999999,"15min":1.377},"min":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":2.464,"15min":2.464},"last":1.621},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.5569999999999999,"15min":1.536},"min":{"1min":0.96599999999999997,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.0139999999999998,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.1599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.008},{"interface":"front","average":{"1min":0.95599999999999996,"5min":2.077,"15min":1.2609999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.9530000000000001,"5min":88.254999999999995,"15min":88.254999999999995},"last":1.3959999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.034,"15min":0.95699999999999996},"min":{"1min":0.65100000000000002,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.417,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.333,"15min":1.159},"min":{"1min":0.83299999999999996,"5min":0.622,"15min":0.61799999999999999},"max":{"1min":1.778,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.341}]},{"osd":3,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.24,"15min":1.109},"min":{"1min":0.57899999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5640000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.208},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2030000000000001,"15min":0.99299999999999999},"min":{"1min":0.55600000000000005,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.704,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.1160000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.5569999999999999,"15min":1.2969999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.76200000000000001},"max":{"1min":2.391,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.4319999999999999,"15min":1.3200000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.84599999999999997},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.47}]},{"osd":5,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.7,"15min":1.409},"min":{"1min":0.98199999999999998,"5min":0.81100000000000005,"15min":0.77800000000000002},"max":{"1min":2.5419999999999998,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.639},{"interface":"front","average":{"1min":1.304,"5min":1.3720000000000001,"15min":1.2889999999999999},"min":{"1min":0.878,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9910000000000001,"5min":3.762,"15min":3.762},"last":1.516}]},{"osd":6,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.569,"15min":1.4390000000000001},"min":{"1min":0.92300000000000004,"5min":0.91000000000000003,"15min":0.83799999999999997},"max":{"1min":1.841,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.478,"15min":1.389},"min":{"1min":1.022,"5min":0.873,"15min":0.79500000000000004},"max":{"1min":2.0960000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.8}]},{"osd":7,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.881,"15min":1.5940000000000001},"min":{"1min":1.097,"5min":0.98699999999999999,"15min":0.88800000000000001},"max":{"1min":1.9199999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.9139999999999999,"15min":1.5800000000000001},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.492,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.948}]}]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193993,"statfs":{"total":200000000,"available":198649507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92300000000000004,"15min":0.875},"min":{"1min":0.57099999999999995,"5min":0.50900000000000001,"15min":0.39500000000000002},"max":{"1min":1.597,"5min":1.819,"15min":1.819},"last":0.754},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.111,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.436},"max":{"1min":1.5740000000000001,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.86499999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.054,"15min":0.96999999999999997},"min":{"1min":0.63800000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5069999999999999,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.05,"5min":1.1619999999999999,"15min":1.042},"min":{"1min":0.63,"5min":0.57999999999999996,"15min":0.5},"max":{"1min":1.6160000000000001,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":1.0900000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.135,"15min":0.95999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6699999999999999,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.246,"15min":1.1879999999999999},"min":{"1min":0.64700000000000002,"5min":0.58399999999999996,"15min":0.56000000000000005},"max":{"1min":1.4970000000000001,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.403,"15min":1.3320000000000001},"min":{"1min":0.92500000000000004,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.8,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.377,"15min":1.298},"min":{"1min":0.86699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8049999999999999,"5min":1.879,"15min":1.879},"last":1.4490000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4419999999999999,"15min":1.319},"min":{"1min":0.93999999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0419999999999998,"5min":10.004,"15min":10.004},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.45,"15min":1.389},"min":{"1min":0.91700000000000004,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":1.742,"5min":1.909,"15min":2.161},"last":1.3080000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.4450000000000001,"15min":1.3500000000000001},"min":{"1min":1.097,"5min":0.83699999999999997,"15min":0.75900000000000001},"max":{"1min":1.6339999999999999,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.548,"15min":1.4359999999999999},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":2.1549999999999998,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.6279999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.609,"15min":1.444},"min":{"1min":1.0069999999999999,"5min":0.84999999999999998,"15min":0.79200000000000004},"max":{"1min":1.909,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.6120000000000001,"15min":1.4730000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.8759999999999999,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.573}]}]}],"pool_statfs":[]}} 2023-08-09T12:46:59.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:46:59.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.935+0000 7fb44637f640 1 Processor -- start 2023-08-09T12:46:59.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.935+0000 7fb44637f640 1 -- start start 2023-08-09T12:46:59.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.936+0000 7fb44637f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb440069ed0 0x7fb4400ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.936+0000 7fb44637f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44006fe10 con 0x7fb440159bd0 2023-08-09T12:46:59.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.936+0000 7fb44637f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb440159fb0 con 0x7fb4400b3fe0 2023-08-09T12:46:59.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.936+0000 7fb44637f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4400b11a0 con 0x7fb440069ed0 2023-08-09T12:46:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.937+0000 7fb445b7e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb440069ed0 0x7fb4400ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.937+0000 7fb445b7e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb440069ed0 0x7fb4400ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54040/0 (socket says 172.21.15.17:54040) 2023-08-09T12:46:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.937+0000 7fb445b7e640 1 -- 172.21.15.17:0/844981815 learned_addr learned my addr 172.21.15.17:0/844981815 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.937+0000 7fb44537d640 1 --1- 172.21.15.17:0/844981815 >> v1:172.21.15.17:6789/0 conn(0x7fb440159bd0 0x7fb440070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45810/0 (socket says 172.21.15.17:45810) 2023-08-09T12:46:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.937+0000 7fb445b7e640 1 -- 172.21.15.17:0/844981815 >> v1:172.21.15.142:6789/0 conn(0x7fb4400b3fe0 legacy=0x7fb4400697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.937+0000 7fb445b7e640 1 -- 172.21.15.17:0/844981815 >> v1:172.21.15.17:6789/0 conn(0x7fb440159bd0 legacy=0x7fb440070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.937+0000 7fb445b7e640 1 -- 172.21.15.17:0/844981815 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440070970 con 0x7fb440069ed0 2023-08-09T12:46:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.937+0000 7fb437fff640 1 -- 172.21.15.17:0/844981815 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257226326 0 0) 0x7fb44006fe10 con 0x7fb440159bd0 2023-08-09T12:46:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.939+0000 7fb445b7e640 1 --2- 172.21.15.17:0/844981815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb4400ca730 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb438009e50 tx=0x7fb43802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3684ba59b026ba server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.939+0000 7fb437fff640 1 -- 172.21.15.17:0/844981815 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43802cb10 con 0x7fb440069ed0 2023-08-09T12:46:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.939+0000 7fb437fff640 1 -- 172.21.15.17:0/844981815 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43802cc70 con 0x7fb440069ed0 2023-08-09T12:46:59.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.940+0000 7fb437fff640 1 -- 172.21.15.17:0/844981815 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380343f0 con 0x7fb440069ed0 2023-08-09T12:46:59.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.940+0000 7fb44637f640 1 -- 172.21.15.17:0/844981815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 msgr2=0x7fb4400ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.940+0000 7fb44637f640 1 --2- 172.21.15.17:0/844981815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb4400ca730 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb438009e50 tx=0x7fb43802bf70 comp rx=0 tx=0).stop 2023-08-09T12:46:59.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.940+0000 7fb44637f640 1 -- 172.21.15.17:0/844981815 shutdown_connections 2023-08-09T12:46:59.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.940+0000 7fb44637f640 1 --2- 172.21.15.17:0/844981815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb4400ca730 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.940+0000 7fb44637f640 1 -- 172.21.15.17:0/844981815 >> 172.21.15.17:0/844981815 conn(0x7fb4400b1d50 msgr2=0x7fb44006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:46:59.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.940+0000 7fb44637f640 1 -- 172.21.15.17:0/844981815 shutdown_connections 2023-08-09T12:46:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.940+0000 7fb44637f640 1 -- 172.21.15.17:0/844981815 wait complete. 2023-08-09T12:46:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.942+0000 7fb44637f640 1 Processor -- start 2023-08-09T12:46:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.942+0000 7fb44637f640 1 -- start start 2023-08-09T12:46:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.943+0000 7fb44637f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb440156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.943+0000 7fb44637f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4400b3fe0 0x7fb4400c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.943+0000 7fb44637f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb440159bd0 0x7fb4400c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.943+0000 7fb44637f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44015ba40 con 0x7fb440069ed0 2023-08-09T12:46:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.943+0000 7fb44637f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44015bfa0 con 0x7fb440159bd0 2023-08-09T12:46:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.943+0000 7fb44637f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440157250 con 0x7fb4400b3fe0 2023-08-09T12:46:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb44537d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb440156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb44537d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb440156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54056/0 (socket says 172.21.15.17:54056) 2023-08-09T12:46:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb44537d640 1 -- 172.21.15.17:0/3900718587 learned_addr learned my addr 172.21.15.17:0/3900718587 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:46:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb445b7e640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb440159bd0 0x7fb4400c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb444b7c640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4400b3fe0 0x7fb4400c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb44537d640 1 -- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4400b3fe0 msgr2=0x7fb4400c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb44537d640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4400b3fe0 0x7fb4400c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb44537d640 1 -- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb440159bd0 msgr2=0x7fb4400c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:46:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb44537d640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb440159bd0 0x7fb4400c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:46:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.944+0000 7fb44537d640 1 -- 172.21.15.17:0/3900718587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438009b30 con 0x7fb440069ed0 2023-08-09T12:46:59.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.945+0000 7fb44537d640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb440156d10 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c460 tx=0x7fb43c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.945+0000 7fb435ffb640 1 -- 172.21.15.17:0/3900718587 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0074e0 con 0x7fb440069ed0 2023-08-09T12:46:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.945+0000 7fb435ffb640 1 -- 172.21.15.17:0/3900718587 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c007660 con 0x7fb440069ed0 2023-08-09T12:46:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.945+0000 7fb435ffb640 1 -- 172.21.15.17:0/3900718587 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c004a20 con 0x7fb440069ed0 2023-08-09T12:46:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.945+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4400c2a80 con 0x7fb440069ed0 2023-08-09T12:46:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.945+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4400c24c0 con 0x7fb440069ed0 2023-08-09T12:46:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.946+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44004e390 con 0x7fb440069ed0 2023-08-09T12:46:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.947+0000 7fb435ffb640 1 -- 172.21.15.17:0/3900718587 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb43c004b80 con 0x7fb440069ed0 2023-08-09T12:46:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.948+0000 7fb435ffb640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb42406a050 0x7fb42406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:46:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.948+0000 7fb435ffb640 1 -- 172.21.15.17:0/3900718587 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb43c087820 con 0x7fb440069ed0 2023-08-09T12:46:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.949+0000 7fb444b7c640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb42406a050 0x7fb42406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:46:59.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.950+0000 7fb444b7c640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb42406a050 0x7fb42406c510 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb4400c83c0 tx=0x7fb430009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:46:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:46:59.952+0000 7fb435ffb640 1 -- 172.21.15.17:0/3900718587 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb43c052e70 con 0x7fb440069ed0 2023-08-09T12:47:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.144+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4400caed0 con 0x7fb42406a050 2023-08-09T12:47:00.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.168+0000 7fb435ffb640 1 -- 172.21.15.17:0/3900718587 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303298 (secure 0 0 0) 0x7fb430001390 con 0x7fb42406a050 2023-08-09T12:47:00.174 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:47:00.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb42406a050 msgr2=0x7fb42406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb42406a050 0x7fb42406c510 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb4400c83c0 tx=0x7fb430009040 comp rx=0 tx=0).stop 2023-08-09T12:47:00.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 msgr2=0x7fb440156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb440156d10 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c460 tx=0x7fb43c00c920 comp rx=0 tx=0).stop 2023-08-09T12:47:00.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 shutdown_connections 2023-08-09T12:47:00.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb42406a050 0x7fb42406c510 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb440159bd0 0x7fb4400c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4400b3fe0 0x7fb4400c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 --2- 172.21.15.17:0/3900718587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb440069ed0 0x7fb440156d10 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 >> 172.21.15.17:0/3900718587 conn(0x7fb4400b1d50 msgr2=0x7fb440070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:00.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.173+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 shutdown_connections 2023-08-09T12:47:00.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.174+0000 7fb44637f640 1 -- 172.21.15.17:0/3900718587 wait complete. 2023-08-09T12:47:00.197 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2023-08-09T12:46:58.809774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7102,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555397,"statfs":{"total":1600000000,"available":1592727101,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.742391"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146710+0000","last_change":"2023-08-09T12:46:55.146618+0000","last_active":"2023-08-09T12:46:55.146710+0000","last_peered":"2023-08-09T12:46:55.146710+0000","last_clean":"2023-08-09T12:46:55.146710+0000","last_became_active":"2023-08-09T12:46:55.142254+0000","last_became_peered":"2023-08-09T12:46:55.142254+0000","last_unstale":"2023-08-09T12:46:55.146710+0000","last_undegraded":"2023-08-09T12:46:55.146710+0000","last_fullsized":"2023-08-09T12:46:55.146710+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:59:52.927447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117914+0000","last_change":"2023-08-09T12:46:55.123831+0000","last_active":"2023-08-09T12:46:56.117914+0000","last_peered":"2023-08-09T12:46:56.117914+0000","last_clean":"2023-08-09T12:46:56.117914+0000","last_became_active":"2023-08-09T12:46:55.123301+0000","last_became_peered":"2023-08-09T12:46:55.123301+0000","last_unstale":"2023-08-09T12:46:56.117914+0000","last_undegraded":"2023-08-09T12:46:56.117914+0000","last_fullsized":"2023-08-09T12:46:56.117914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:15:55.858398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.139452+0000","last_change":"2023-08-09T12:46:55.139298+0000","last_active":"2023-08-09T12:46:55.139452+0000","last_peered":"2023-08-09T12:46:55.139452+0000","last_clean":"2023-08-09T12:46:55.139452+0000","last_became_active":"2023-08-09T12:46:55.138718+0000","last_became_peered":"2023-08-09T12:46:55.138718+0000","last_unstale":"2023-08-09T12:46:55.139452+0000","last_undegraded":"2023-08-09T12:46:55.139452+0000","last_fullsized":"2023-08-09T12:46:55.139452+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:17:19.050542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.141831+0000","last_change":"2023-08-09T12:46:55.141621+0000","last_active":"2023-08-09T12:46:55.141831+0000","last_peered":"2023-08-09T12:46:55.141831+0000","last_clean":"2023-08-09T12:46:55.141831+0000","last_became_active":"2023-08-09T12:46:55.140830+0000","last_became_peered":"2023-08-09T12:46:55.140830+0000","last_unstale":"2023-08-09T12:46:55.141831+0000","last_undegraded":"2023-08-09T12:46:55.141831+0000","last_fullsized":"2023-08-09T12:46:55.141831+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:24:06.093998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.148513+0000","last_change":"2023-08-09T12:46:55.148346+0000","last_active":"2023-08-09T12:46:55.148513+0000","last_peered":"2023-08-09T12:46:55.148513+0000","last_clean":"2023-08-09T12:46:55.148513+0000","last_became_active":"2023-08-09T12:46:55.139843+0000","last_became_peered":"2023-08-09T12:46:55.139843+0000","last_unstale":"2023-08-09T12:46:55.148513+0000","last_undegraded":"2023-08-09T12:46:55.148513+0000","last_fullsized":"2023-08-09T12:46:55.148513+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:24.496782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116914+0000","last_change":"2023-08-09T12:46:55.136932+0000","last_active":"2023-08-09T12:46:56.116914+0000","last_peered":"2023-08-09T12:46:56.116914+0000","last_clean":"2023-08-09T12:46:56.116914+0000","last_became_active":"2023-08-09T12:46:55.136678+0000","last_became_peered":"2023-08-09T12:46:55.136678+0000","last_unstale":"2023-08-09T12:46:56.116914+0000","last_undegraded":"2023-08-09T12:46:56.116914+0000","last_fullsized":"2023-08-09T12:46:56.116914+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:43:22.013379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117433+0000","last_change":"2023-08-09T12:46:55.135782+0000","last_active":"2023-08-09T12:46:56.117433+0000","last_peered":"2023-08-09T12:46:56.117433+0000","last_clean":"2023-08-09T12:46:56.117433+0000","last_became_active":"2023-08-09T12:46:55.135544+0000","last_became_peered":"2023-08-09T12:46:55.135544+0000","last_unstale":"2023-08-09T12:46:56.117433+0000","last_undegraded":"2023-08-09T12:46:56.117433+0000","last_fullsized":"2023-08-09T12:46:56.117433+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:01:32.043179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143751+0000","last_change":"2023-08-09T12:46:55.141422+0000","last_active":"2023-08-09T12:46:55.143751+0000","last_peered":"2023-08-09T12:46:55.143751+0000","last_clean":"2023-08-09T12:46:55.143751+0000","last_became_active":"2023-08-09T12:46:55.140867+0000","last_became_peered":"2023-08-09T12:46:55.140867+0000","last_unstale":"2023-08-09T12:46:55.143751+0000","last_undegraded":"2023-08-09T12:46:55.143751+0000","last_fullsized":"2023-08-09T12:46:55.143751+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:11:44.573323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115677+0000","last_change":"2023-08-09T12:46:55.143097+0000","last_active":"2023-08-09T12:46:56.115677+0000","last_peered":"2023-08-09T12:46:56.115677+0000","last_clean":"2023-08-09T12:46:56.115677+0000","last_became_active":"2023-08-09T12:46:55.142715+0000","last_became_peered":"2023-08-09T12:46:55.142715+0000","last_unstale":"2023-08-09T12:46:56.115677+0000","last_undegraded":"2023-08-09T12:46:56.115677+0000","last_fullsized":"2023-08-09T12:46:56.115677+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:08.985978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.142665+0000","last_change":"2023-08-09T12:46:55.142474+0000","last_active":"2023-08-09T12:46:55.142665+0000","last_peered":"2023-08-09T12:46:55.142665+0000","last_clean":"2023-08-09T12:46:55.142665+0000","last_became_active":"2023-08-09T12:46:55.139252+0000","last_became_peered":"2023-08-09T12:46:55.139252+0000","last_unstale":"2023-08-09T12:46:55.142665+0000","last_undegraded":"2023-08-09T12:46:55.142665+0000","last_fullsized":"2023-08-09T12:46:55.142665+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:01.643440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.128848+0000","last_change":"2023-08-09T12:46:55.127659+0000","last_active":"2023-08-09T12:46:55.128848+0000","last_peered":"2023-08-09T12:46:55.128848+0000","last_clean":"2023-08-09T12:46:55.128848+0000","last_became_active":"2023-08-09T12:46:55.127131+0000","last_became_peered":"2023-08-09T12:46:55.127131+0000","last_unstale":"2023-08-09T12:46:55.128848+0000","last_undegraded":"2023-08-09T12:46:55.128848+0000","last_fullsized":"2023-08-09T12:46:55.128848+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:54:47.347713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115860+0000","last_change":"2023-08-09T12:46:55.140320+0000","last_active":"2023-08-09T12:46:56.115860+0000","last_peered":"2023-08-09T12:46:56.115860+0000","last_clean":"2023-08-09T12:46:56.115860+0000","last_became_active":"2023-08-09T12:46:55.139961+0000","last_became_peered":"2023-08-09T12:46:55.139961+0000","last_unstale":"2023-08-09T12:46:56.115860+0000","last_undegraded":"2023-08-09T12:46:56.115860+0000","last_fullsized":"2023-08-09T12:46:56.115860+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:32:27.755997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.140276+0000","last_change":"2023-08-09T12:46:55.139866+0000","last_active":"2023-08-09T12:46:55.140276+0000","last_peered":"2023-08-09T12:46:55.140276+0000","last_clean":"2023-08-09T12:46:55.140276+0000","last_became_active":"2023-08-09T12:46:55.139451+0000","last_became_peered":"2023-08-09T12:46:55.139451+0000","last_unstale":"2023-08-09T12:46:55.140276+0000","last_undegraded":"2023-08-09T12:46:55.140276+0000","last_fullsized":"2023-08-09T12:46:55.140276+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:10.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.112053+0000","last_change":"2023-08-09T12:46:55.141917+0000","last_active":"2023-08-09T12:46:56.112053+0000","last_peered":"2023-08-09T12:46:56.112053+0000","last_clean":"2023-08-09T12:46:56.112053+0000","last_became_active":"2023-08-09T12:46:55.141558+0000","last_became_peered":"2023-08-09T12:46:55.141558+0000","last_unstale":"2023-08-09T12:46:56.112053+0000","last_undegraded":"2023-08-09T12:46:56.112053+0000","last_fullsized":"2023-08-09T12:46:56.112053+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:43.165450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.113438+0000","last_change":"2023-08-09T12:46:55.127181+0000","last_active":"2023-08-09T12:46:56.113438+0000","last_peered":"2023-08-09T12:46:56.113438+0000","last_clean":"2023-08-09T12:46:56.113438+0000","last_became_active":"2023-08-09T12:46:55.126827+0000","last_became_peered":"2023-08-09T12:46:55.126827+0000","last_unstale":"2023-08-09T12:46:56.113438+0000","last_undegraded":"2023-08-09T12:46:56.113438+0000","last_fullsized":"2023-08-09T12:46:56.113438+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:02:00.275203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.112422+0000","last_change":"2023-08-09T12:46:55.134501+0000","last_active":"2023-08-09T12:46:56.112422+0000","last_peered":"2023-08-09T12:46:56.112422+0000","last_clean":"2023-08-09T12:46:56.112422+0000","last_became_active":"2023-08-09T12:46:55.134103+0000","last_became_peered":"2023-08-09T12:46:55.134103+0000","last_unstale":"2023-08-09T12:46:56.112422+0000","last_undegraded":"2023-08-09T12:46:56.112422+0000","last_fullsized":"2023-08-09T12:46:56.112422+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:46.188820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.137729+0000","last_change":"2023-08-09T12:46:55.137230+0000","last_active":"2023-08-09T12:46:55.137729+0000","last_peered":"2023-08-09T12:46:55.137729+0000","last_clean":"2023-08-09T12:46:55.137729+0000","last_became_active":"2023-08-09T12:46:55.136284+0000","last_became_peered":"2023-08-09T12:46:55.136284+0000","last_unstale":"2023-08-09T12:46:55.137729+0000","last_undegraded":"2023-08-09T12:46:55.137729+0000","last_fullsized":"2023-08-09T12:46:55.137729+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:47:18.561482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115390+0000","last_change":"2023-08-09T12:46:55.136581+0000","last_active":"2023-08-09T12:46:56.115390+0000","last_peered":"2023-08-09T12:46:56.115390+0000","last_clean":"2023-08-09T12:46:56.115390+0000","last_became_active":"2023-08-09T12:46:55.136279+0000","last_became_peered":"2023-08-09T12:46:55.136279+0000","last_unstale":"2023-08-09T12:46:56.115390+0000","last_undegraded":"2023-08-09T12:46:56.115390+0000","last_fullsized":"2023-08-09T12:46:56.115390+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:31:38.665398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.147668+0000","last_change":"2023-08-09T12:46:55.147522+0000","last_active":"2023-08-09T12:46:55.147668+0000","last_peered":"2023-08-09T12:46:55.147668+0000","last_clean":"2023-08-09T12:46:55.147668+0000","last_became_active":"2023-08-09T12:46:55.145297+0000","last_became_peered":"2023-08-09T12:46:55.145297+0000","last_unstale":"2023-08-09T12:46:55.147668+0000","last_undegraded":"2023-08-09T12:46:55.147668+0000","last_fullsized":"2023-08-09T12:46:55.147668+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:34:21.286896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117979+0000","last_change":"2023-08-09T12:46:55.134566+0000","last_active":"2023-08-09T12:46:56.117979+0000","last_peered":"2023-08-09T12:46:56.117979+0000","last_clean":"2023-08-09T12:46:56.117979+0000","last_became_active":"2023-08-09T12:46:55.132491+0000","last_became_peered":"2023-08-09T12:46:55.132491+0000","last_unstale":"2023-08-09T12:46:56.117979+0000","last_undegraded":"2023-08-09T12:46:56.117979+0000","last_fullsized":"2023-08-09T12:46:56.117979+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:17.866294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.144120+0000","last_change":"2023-08-09T12:46:55.143972+0000","last_active":"2023-08-09T12:46:55.144120+0000","last_peered":"2023-08-09T12:46:55.144120+0000","last_clean":"2023-08-09T12:46:55.144120+0000","last_became_active":"2023-08-09T12:46:55.134542+0000","last_became_peered":"2023-08-09T12:46:55.134542+0000","last_unstale":"2023-08-09T12:46:55.144120+0000","last_undegraded":"2023-08-09T12:46:55.144120+0000","last_fullsized":"2023-08-09T12:46:55.144120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:28.207615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126887+0000","last_change":"2023-08-09T12:46:55.126477+0000","last_active":"2023-08-09T12:46:55.126887+0000","last_peered":"2023-08-09T12:46:55.126887+0000","last_clean":"2023-08-09T12:46:55.126887+0000","last_became_active":"2023-08-09T12:46:55.125816+0000","last_became_peered":"2023-08-09T12:46:55.125816+0000","last_unstale":"2023-08-09T12:46:55.126887+0000","last_undegraded":"2023-08-09T12:46:55.126887+0000","last_fullsized":"2023-08-09T12:46:55.126887+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:31.767914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.139249+0000","last_change":"2023-08-09T12:46:55.139140+0000","last_active":"2023-08-09T12:46:55.139249+0000","last_peered":"2023-08-09T12:46:55.139249+0000","last_clean":"2023-08-09T12:46:55.139249+0000","last_became_active":"2023-08-09T12:46:55.138373+0000","last_became_peered":"2023-08-09T12:46:55.138373+0000","last_unstale":"2023-08-09T12:46:55.139249+0000","last_undegraded":"2023-08-09T12:46:55.139249+0000","last_fullsized":"2023-08-09T12:46:55.139249+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:12:16.374220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.137781+0000","last_change":"2023-08-09T12:46:55.137572+0000","last_active":"2023-08-09T12:46:55.137781+0000","last_peered":"2023-08-09T12:46:55.137781+0000","last_clean":"2023-08-09T12:46:55.137781+0000","last_became_active":"2023-08-09T12:46:55.137226+0000","last_became_peered":"2023-08-09T12:46:55.137226+0000","last_unstale":"2023-08-09T12:46:55.137781+0000","last_undegraded":"2023-08-09T12:46:55.137781+0000","last_fullsized":"2023-08-09T12:46:55.137781+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:35:08.927890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.118284+0000","last_change":"2023-08-09T12:46:55.133165+0000","last_active":"2023-08-09T12:46:56.118284+0000","last_peered":"2023-08-09T12:46:56.118284+0000","last_clean":"2023-08-09T12:46:56.118284+0000","last_became_active":"2023-08-09T12:46:55.131905+0000","last_became_peered":"2023-08-09T12:46:55.131905+0000","last_unstale":"2023-08-09T12:46:56.118284+0000","last_undegraded":"2023-08-09T12:46:56.118284+0000","last_fullsized":"2023-08-09T12:46:56.118284+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:38.414626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116747+0000","last_change":"2023-08-09T12:46:55.131754+0000","last_active":"2023-08-09T12:46:56.116747+0000","last_peered":"2023-08-09T12:46:56.116747+0000","last_clean":"2023-08-09T12:46:56.116747+0000","last_became_active":"2023-08-09T12:46:55.131398+0000","last_became_peered":"2023-08-09T12:46:55.131398+0000","last_unstale":"2023-08-09T12:46:56.116747+0000","last_undegraded":"2023-08-09T12:46:56.116747+0000","last_fullsized":"2023-08-09T12:46:56.116747+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:24:06.093998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.128806+0000","last_change":"2023-08-09T12:46:55.127441+0000","last_active":"2023-08-09T12:46:55.128806+0000","last_peered":"2023-08-09T12:46:55.128806+0000","last_clean":"2023-08-09T12:46:55.128806+0000","last_became_active":"2023-08-09T12:46:55.126315+0000","last_became_peered":"2023-08-09T12:46:55.126315+0000","last_unstale":"2023-08-09T12:46:55.128806+0000","last_undegraded":"2023-08-09T12:46:55.128806+0000","last_fullsized":"2023-08-09T12:46:55.128806+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:21:45.179778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115753+0000","last_change":"2023-08-09T12:46:55.129999+0000","last_active":"2023-08-09T12:46:56.115753+0000","last_peered":"2023-08-09T12:46:56.115753+0000","last_clean":"2023-08-09T12:46:56.115753+0000","last_became_active":"2023-08-09T12:46:55.129544+0000","last_became_peered":"2023-08-09T12:46:55.129544+0000","last_unstale":"2023-08-09T12:46:56.115753+0000","last_undegraded":"2023-08-09T12:46:56.115753+0000","last_fullsized":"2023-08-09T12:46:56.115753+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:44.116719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.128767+0000","last_change":"2023-08-09T12:46:55.128548+0000","last_active":"2023-08-09T12:46:55.128767+0000","last_peered":"2023-08-09T12:46:55.128767+0000","last_clean":"2023-08-09T12:46:55.128767+0000","last_became_active":"2023-08-09T12:46:55.127757+0000","last_became_peered":"2023-08-09T12:46:55.127757+0000","last_unstale":"2023-08-09T12:46:55.128767+0000","last_undegraded":"2023-08-09T12:46:55.128767+0000","last_fullsized":"2023-08-09T12:46:55.128767+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:28:06.118710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.118569+0000","last_change":"2023-08-09T12:46:55.132869+0000","last_active":"2023-08-09T12:46:56.118569+0000","last_peered":"2023-08-09T12:46:56.118569+0000","last_clean":"2023-08-09T12:46:56.118569+0000","last_became_active":"2023-08-09T12:46:55.131371+0000","last_became_peered":"2023-08-09T12:46:55.131371+0000","last_unstale":"2023-08-09T12:46:56.118569+0000","last_undegraded":"2023-08-09T12:46:56.118569+0000","last_fullsized":"2023-08-09T12:46:56.118569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:29:36.647253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116015+0000","last_change":"2023-08-09T12:46:55.133144+0000","last_active":"2023-08-09T12:46:56.116015+0000","last_peered":"2023-08-09T12:46:56.116015+0000","last_clean":"2023-08-09T12:46:56.116015+0000","last_became_active":"2023-08-09T12:46:55.132453+0000","last_became_peered":"2023-08-09T12:46:55.132453+0000","last_unstale":"2023-08-09T12:46:56.116015+0000","last_undegraded":"2023-08-09T12:46:56.116015+0000","last_fullsized":"2023-08-09T12:46:56.116015+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:06:59.707363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.127092+0000","last_change":"2023-08-09T12:46:55.126875+0000","last_active":"2023-08-09T12:46:55.127092+0000","last_peered":"2023-08-09T12:46:55.127092+0000","last_clean":"2023-08-09T12:46:55.127092+0000","last_became_active":"2023-08-09T12:46:55.126218+0000","last_became_peered":"2023-08-09T12:46:55.126218+0000","last_unstale":"2023-08-09T12:46:55.127092+0000","last_undegraded":"2023-08-09T12:46:55.127092+0000","last_fullsized":"2023-08-09T12:46:55.127092+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:03:48.546756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146779+0000","last_change":"2023-08-09T12:46:55.145965+0000","last_active":"2023-08-09T12:46:55.146779+0000","last_peered":"2023-08-09T12:46:55.146779+0000","last_clean":"2023-08-09T12:46:55.146779+0000","last_became_active":"2023-08-09T12:46:55.144343+0000","last_became_peered":"2023-08-09T12:46:55.144343+0000","last_unstale":"2023-08-09T12:46:55.146779+0000","last_undegraded":"2023-08-09T12:46:55.146779+0000","last_fullsized":"2023-08-09T12:46:55.146779+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:57:38.982863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"129'4","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.158441+0000","last_change":"2023-08-09T12:46:54.097692+0000","last_active":"2023-08-09T12:46:55.158441+0000","last_peered":"2023-08-09T12:46:55.158441+0000","last_clean":"2023-08-09T12:46:55.158441+0000","last_became_active":"2023-08-09T12:46:54.097020+0000","last_became_peered":"2023-08-09T12:46:54.097020+0000","last_unstale":"2023-08-09T12:46:55.158441+0000","last_undegraded":"2023-08-09T12:46:55.158441+0000","last_fullsized":"2023-08-09T12:46:55.158441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:32:26.743508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143733+0000","last_change":"2023-08-09T12:46:55.141275+0000","last_active":"2023-08-09T12:46:55.143733+0000","last_peered":"2023-08-09T12:46:55.143733+0000","last_clean":"2023-08-09T12:46:55.143733+0000","last_became_active":"2023-08-09T12:46:55.140545+0000","last_became_peered":"2023-08-09T12:46:55.140545+0000","last_unstale":"2023-08-09T12:46:55.143733+0000","last_undegraded":"2023-08-09T12:46:55.143733+0000","last_fullsized":"2023-08-09T12:46:55.143733+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:20:13.772387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"129'1","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.157322+0000","last_change":"2023-08-09T12:46:54.086804+0000","last_active":"2023-08-09T12:46:55.157322+0000","last_peered":"2023-08-09T12:46:55.157322+0000","last_clean":"2023-08-09T12:46:55.157322+0000","last_became_active":"2023-08-09T12:46:54.085717+0000","last_became_peered":"2023-08-09T12:46:54.085717+0000","last_unstale":"2023-08-09T12:46:55.157322+0000","last_undegraded":"2023-08-09T12:46:55.157322+0000","last_fullsized":"2023-08-09T12:46:55.157322+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:39:46.861574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116236+0000","last_change":"2023-08-09T12:46:55.136469+0000","last_active":"2023-08-09T12:46:56.116236+0000","last_peered":"2023-08-09T12:46:56.116236+0000","last_clean":"2023-08-09T12:46:56.116236+0000","last_became_active":"2023-08-09T12:46:55.136201+0000","last_became_peered":"2023-08-09T12:46:55.136201+0000","last_unstale":"2023-08-09T12:46:56.116236+0000","last_undegraded":"2023-08-09T12:46:56.116236+0000","last_fullsized":"2023-08-09T12:46:56.116236+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:00.249612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"129'2","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.118881+0000","last_change":"2023-08-09T12:46:54.095303+0000","last_active":"2023-08-09T12:46:56.118881+0000","last_peered":"2023-08-09T12:46:56.118881+0000","last_clean":"2023-08-09T12:46:56.118881+0000","last_became_active":"2023-08-09T12:46:54.094978+0000","last_became_peered":"2023-08-09T12:46:54.094978+0000","last_unstale":"2023-08-09T12:46:56.118881+0000","last_undegraded":"2023-08-09T12:46:56.118881+0000","last_fullsized":"2023-08-09T12:46:56.118881+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:20:12.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.132503+0000","last_change":"2023-08-09T12:46:55.131700+0000","last_active":"2023-08-09T12:46:55.132503+0000","last_peered":"2023-08-09T12:46:55.132503+0000","last_clean":"2023-08-09T12:46:55.132503+0000","last_became_active":"2023-08-09T12:46:55.131312+0000","last_became_peered":"2023-08-09T12:46:55.131312+0000","last_unstale":"2023-08-09T12:46:55.132503+0000","last_undegraded":"2023-08-09T12:46:55.132503+0000","last_fullsized":"2023-08-09T12:46:55.132503+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:01.230530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.158020+0000","last_change":"2023-08-09T12:46:54.093029+0000","last_active":"2023-08-09T12:46:55.158020+0000","last_peered":"2023-08-09T12:46:55.158020+0000","last_clean":"2023-08-09T12:46:55.158020+0000","last_became_active":"2023-08-09T12:46:54.092746+0000","last_became_peered":"2023-08-09T12:46:54.092746+0000","last_unstale":"2023-08-09T12:46:55.158020+0000","last_undegraded":"2023-08-09T12:46:55.158020+0000","last_fullsized":"2023-08-09T12:46:55.158020+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:26:00.218041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143507+0000","last_change":"2023-08-09T12:46:55.143405+0000","last_active":"2023-08-09T12:46:55.143507+0000","last_peered":"2023-08-09T12:46:55.143507+0000","last_clean":"2023-08-09T12:46:55.143507+0000","last_became_active":"2023-08-09T12:46:55.143164+0000","last_became_peered":"2023-08-09T12:46:55.143164+0000","last_unstale":"2023-08-09T12:46:55.143507+0000","last_undegraded":"2023-08-09T12:46:55.143507+0000","last_fullsized":"2023-08-09T12:46:55.143507+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:00.249612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"129'1","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.112649+0000","last_change":"2023-08-09T12:46:54.095541+0000","last_active":"2023-08-09T12:46:56.112649+0000","last_peered":"2023-08-09T12:46:56.112649+0000","last_clean":"2023-08-09T12:46:56.112649+0000","last_became_active":"2023-08-09T12:46:54.095237+0000","last_became_peered":"2023-08-09T12:46:54.095237+0000","last_unstale":"2023-08-09T12:46:56.112649+0000","last_undegraded":"2023-08-09T12:46:56.112649+0000","last_fullsized":"2023-08-09T12:46:56.112649+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:52:32.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146992+0000","last_change":"2023-08-09T12:46:55.146887+0000","last_active":"2023-08-09T12:46:55.146992+0000","last_peered":"2023-08-09T12:46:55.146992+0000","last_clean":"2023-08-09T12:46:55.146992+0000","last_became_active":"2023-08-09T12:46:55.144675+0000","last_became_peered":"2023-08-09T12:46:55.144675+0000","last_unstale":"2023-08-09T12:46:55.146992+0000","last_undegraded":"2023-08-09T12:46:55.146992+0000","last_fullsized":"2023-08-09T12:46:55.146992+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:21:13.658088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"129'1","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.159153+0000","last_change":"2023-08-09T12:46:54.098214+0000","last_active":"2023-08-09T12:46:55.159153+0000","last_peered":"2023-08-09T12:46:55.159153+0000","last_clean":"2023-08-09T12:46:55.159153+0000","last_became_active":"2023-08-09T12:46:54.097947+0000","last_became_peered":"2023-08-09T12:46:54.097947+0000","last_unstale":"2023-08-09T12:46:55.159153+0000","last_undegraded":"2023-08-09T12:46:55.159153+0000","last_fullsized":"2023-08-09T12:46:55.159153+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:45:42.772240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116093+0000","last_change":"2023-08-09T12:46:55.131701+0000","last_active":"2023-08-09T12:46:56.116093+0000","last_peered":"2023-08-09T12:46:56.116093+0000","last_clean":"2023-08-09T12:46:56.116093+0000","last_became_active":"2023-08-09T12:46:55.131141+0000","last_became_peered":"2023-08-09T12:46:55.131141+0000","last_unstale":"2023-08-09T12:46:56.116093+0000","last_undegraded":"2023-08-09T12:46:56.116093+0000","last_fullsized":"2023-08-09T12:46:56.116093+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:33.225798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116164+0000","last_change":"2023-08-09T12:46:54.094869+0000","last_active":"2023-08-09T12:46:56.116164+0000","last_peered":"2023-08-09T12:46:56.116164+0000","last_clean":"2023-08-09T12:46:56.116164+0000","last_became_active":"2023-08-09T12:46:54.094461+0000","last_became_peered":"2023-08-09T12:46:54.094461+0000","last_unstale":"2023-08-09T12:46:56.116164+0000","last_undegraded":"2023-08-09T12:46:56.116164+0000","last_fullsized":"2023-08-09T12:46:56.116164+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:25:24.385641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.141211+0000","last_change":"2023-08-09T12:46:55.141125+0000","last_active":"2023-08-09T12:46:55.141211+0000","last_peered":"2023-08-09T12:46:55.141211+0000","last_clean":"2023-08-09T12:46:55.141211+0000","last_became_active":"2023-08-09T12:46:55.140826+0000","last_became_peered":"2023-08-09T12:46:55.140826+0000","last_unstale":"2023-08-09T12:46:55.141211+0000","last_undegraded":"2023-08-09T12:46:55.141211+0000","last_fullsized":"2023-08-09T12:46:55.141211+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:50.610520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.132519+0000","last_change":"2023-08-09T12:46:54.091334+0000","last_active":"2023-08-09T12:46:55.132519+0000","last_peered":"2023-08-09T12:46:55.132519+0000","last_clean":"2023-08-09T12:46:55.132519+0000","last_became_active":"2023-08-09T12:46:54.090940+0000","last_became_peered":"2023-08-09T12:46:54.090940+0000","last_unstale":"2023-08-09T12:46:55.132519+0000","last_undegraded":"2023-08-09T12:46:55.132519+0000","last_fullsized":"2023-08-09T12:46:55.132519+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:43.811909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146436+0000","last_change":"2023-08-09T12:46:55.142515+0000","last_active":"2023-08-09T12:46:55.146436+0000","last_peered":"2023-08-09T12:46:55.146436+0000","last_clean":"2023-08-09T12:46:55.146436+0000","last_became_active":"2023-08-09T12:46:55.141598+0000","last_became_peered":"2023-08-09T12:46:55.141598+0000","last_unstale":"2023-08-09T12:46:55.146436+0000","last_undegraded":"2023-08-09T12:46:55.146436+0000","last_fullsized":"2023-08-09T12:46:55.146436+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:38:42.092665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117030+0000","last_change":"2023-08-09T12:46:54.099875+0000","last_active":"2023-08-09T12:46:56.117030+0000","last_peered":"2023-08-09T12:46:56.117030+0000","last_clean":"2023-08-09T12:46:56.117030+0000","last_became_active":"2023-08-09T12:46:54.099663+0000","last_became_peered":"2023-08-09T12:46:54.099663+0000","last_unstale":"2023-08-09T12:46:56.117030+0000","last_undegraded":"2023-08-09T12:46:56.117030+0000","last_fullsized":"2023-08-09T12:46:56.117030+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:43.811909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.142134+0000","last_change":"2023-08-09T12:46:55.141984+0000","last_active":"2023-08-09T12:46:55.142134+0000","last_peered":"2023-08-09T12:46:55.142134+0000","last_clean":"2023-08-09T12:46:55.142134+0000","last_became_active":"2023-08-09T12:46:55.137701+0000","last_became_peered":"2023-08-09T12:46:55.137701+0000","last_unstale":"2023-08-09T12:46:55.142134+0000","last_undegraded":"2023-08-09T12:46:55.142134+0000","last_fullsized":"2023-08-09T12:46:55.142134+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:32.286753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126808+0000","last_change":"2023-08-09T12:46:54.094847+0000","last_active":"2023-08-09T12:46:55.126808+0000","last_peered":"2023-08-09T12:46:55.126808+0000","last_clean":"2023-08-09T12:46:55.126808+0000","last_became_active":"2023-08-09T12:46:54.094613+0000","last_became_peered":"2023-08-09T12:46:54.094613+0000","last_unstale":"2023-08-09T12:46:55.126808+0000","last_undegraded":"2023-08-09T12:46:55.126808+0000","last_fullsized":"2023-08-09T12:46:55.126808+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:42:43.647535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143840+0000","last_change":"2023-08-09T12:46:55.137446+0000","last_active":"2023-08-09T12:46:55.143840+0000","last_peered":"2023-08-09T12:46:55.143840+0000","last_clean":"2023-08-09T12:46:55.143840+0000","last_became_active":"2023-08-09T12:46:55.137014+0000","last_became_peered":"2023-08-09T12:46:55.137014+0000","last_unstale":"2023-08-09T12:46:55.143840+0000","last_undegraded":"2023-08-09T12:46:55.143840+0000","last_fullsized":"2023-08-09T12:46:55.143840+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:15.070877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"129'3","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.112407+0000","last_change":"2023-08-09T12:46:54.094669+0000","last_active":"2023-08-09T12:46:56.112407+0000","last_peered":"2023-08-09T12:46:56.112407+0000","last_clean":"2023-08-09T12:46:56.112407+0000","last_became_active":"2023-08-09T12:46:54.094424+0000","last_became_peered":"2023-08-09T12:46:54.094424+0000","last_unstale":"2023-08-09T12:46:56.112407+0000","last_undegraded":"2023-08-09T12:46:56.112407+0000","last_fullsized":"2023-08-09T12:46:56.112407+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:14:02.810452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.146197+0000","last_change":"2023-08-09T12:46:55.145543+0000","last_active":"2023-08-09T12:46:55.146197+0000","last_peered":"2023-08-09T12:46:55.146197+0000","last_clean":"2023-08-09T12:46:55.146197+0000","last_became_active":"2023-08-09T12:46:55.145303+0000","last_became_peered":"2023-08-09T12:46:55.145303+0000","last_unstale":"2023-08-09T12:46:55.146197+0000","last_undegraded":"2023-08-09T12:46:55.146197+0000","last_fullsized":"2023-08-09T12:46:55.146197+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:33:45.196215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"129'6","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115295+0000","last_change":"2023-08-09T12:46:54.098955+0000","last_active":"2023-08-09T12:46:56.115295+0000","last_peered":"2023-08-09T12:46:56.115295+0000","last_clean":"2023-08-09T12:46:56.115295+0000","last_became_active":"2023-08-09T12:46:54.098454+0000","last_became_peered":"2023-08-09T12:46:54.098454+0000","last_unstale":"2023-08-09T12:46:56.115295+0000","last_undegraded":"2023-08-09T12:46:56.115295+0000","last_fullsized":"2023-08-09T12:46:56.115295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:47.241703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.137991+0000","last_change":"2023-08-09T12:46:55.137898+0000","last_active":"2023-08-09T12:46:55.137991+0000","last_peered":"2023-08-09T12:46:55.137991+0000","last_clean":"2023-08-09T12:46:55.137991+0000","last_became_active":"2023-08-09T12:46:55.137182+0000","last_became_peered":"2023-08-09T12:46:55.137182+0000","last_unstale":"2023-08-09T12:46:55.137991+0000","last_undegraded":"2023-08-09T12:46:55.137991+0000","last_fullsized":"2023-08-09T12:46:55.137991+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:54:24.496782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.157526+0000","last_change":"2023-08-09T12:46:54.088476+0000","last_active":"2023-08-09T12:46:55.157526+0000","last_peered":"2023-08-09T12:46:55.157526+0000","last_clean":"2023-08-09T12:46:55.157526+0000","last_became_active":"2023-08-09T12:46:54.088102+0000","last_became_peered":"2023-08-09T12:46:54.088102+0000","last_unstale":"2023-08-09T12:46:55.157526+0000","last_undegraded":"2023-08-09T12:46:55.157526+0000","last_fullsized":"2023-08-09T12:46:55.157526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:44.439232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117259+0000","last_change":"2023-08-09T12:46:55.140061+0000","last_active":"2023-08-09T12:46:56.117259+0000","last_peered":"2023-08-09T12:46:56.117259+0000","last_clean":"2023-08-09T12:46:56.117259+0000","last_became_active":"2023-08-09T12:46:55.139632+0000","last_became_peered":"2023-08-09T12:46:55.139632+0000","last_unstale":"2023-08-09T12:46:56.117259+0000","last_undegraded":"2023-08-09T12:46:56.117259+0000","last_fullsized":"2023-08-09T12:46:56.117259+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:21.265488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.129142+0000","last_change":"2023-08-09T12:46:54.092551+0000","last_active":"2023-08-09T12:46:55.129142+0000","last_peered":"2023-08-09T12:46:55.129142+0000","last_clean":"2023-08-09T12:46:55.129142+0000","last_became_active":"2023-08-09T12:46:54.092218+0000","last_became_peered":"2023-08-09T12:46:54.092218+0000","last_unstale":"2023-08-09T12:46:55.129142+0000","last_undegraded":"2023-08-09T12:46:55.129142+0000","last_fullsized":"2023-08-09T12:46:55.129142+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:06:56.315739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143771+0000","last_change":"2023-08-09T12:46:55.136435+0000","last_active":"2023-08-09T12:46:55.143771+0000","last_peered":"2023-08-09T12:46:55.143771+0000","last_clean":"2023-08-09T12:46:55.143771+0000","last_became_active":"2023-08-09T12:46:55.136019+0000","last_became_peered":"2023-08-09T12:46:55.136019+0000","last_unstale":"2023-08-09T12:46:55.143771+0000","last_undegraded":"2023-08-09T12:46:55.143771+0000","last_fullsized":"2023-08-09T12:46:55.143771+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:37.054109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.110545+0000","last_change":"2023-08-09T12:46:54.094475+0000","last_active":"2023-08-09T12:46:55.110545+0000","last_peered":"2023-08-09T12:46:55.110545+0000","last_clean":"2023-08-09T12:46:55.110545+0000","last_became_active":"2023-08-09T12:46:54.093989+0000","last_became_peered":"2023-08-09T12:46:54.093989+0000","last_unstale":"2023-08-09T12:46:55.110545+0000","last_undegraded":"2023-08-09T12:46:55.110545+0000","last_fullsized":"2023-08-09T12:46:55.110545+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:46:01.865872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.147287+0000","last_change":"2023-08-09T12:46:55.147187+0000","last_active":"2023-08-09T12:46:55.147287+0000","last_peered":"2023-08-09T12:46:55.147287+0000","last_clean":"2023-08-09T12:46:55.147287+0000","last_became_active":"2023-08-09T12:46:55.144962+0000","last_became_peered":"2023-08-09T12:46:55.144962+0000","last_unstale":"2023-08-09T12:46:55.147287+0000","last_undegraded":"2023-08-09T12:46:55.147287+0000","last_fullsized":"2023-08-09T12:46:55.147287+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:09:02.321281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"129'8","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115406+0000","last_change":"2023-08-09T12:46:54.100603+0000","last_active":"2023-08-09T12:46:56.115406+0000","last_peered":"2023-08-09T12:46:56.115406+0000","last_clean":"2023-08-09T12:46:56.115406+0000","last_became_active":"2023-08-09T12:46:54.100372+0000","last_became_peered":"2023-08-09T12:46:54.100372+0000","last_unstale":"2023-08-09T12:46:56.115406+0000","last_undegraded":"2023-08-09T12:46:56.115406+0000","last_fullsized":"2023-08-09T12:46:56.115406+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:49.598031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.140530+0000","last_change":"2023-08-09T12:46:55.140124+0000","last_active":"2023-08-09T12:46:55.140530+0000","last_peered":"2023-08-09T12:46:55.140530+0000","last_clean":"2023-08-09T12:46:55.140530+0000","last_became_active":"2023-08-09T12:46:55.139805+0000","last_became_peered":"2023-08-09T12:46:55.139805+0000","last_unstale":"2023-08-09T12:46:55.140530+0000","last_undegraded":"2023-08-09T12:46:55.140530+0000","last_fullsized":"2023-08-09T12:46:55.140530+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:22:04.156283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.155902+0000","last_change":"2023-08-09T12:46:54.094866+0000","last_active":"2023-08-09T12:46:55.155902+0000","last_peered":"2023-08-09T12:46:55.155902+0000","last_clean":"2023-08-09T12:46:55.155902+0000","last_became_active":"2023-08-09T12:46:54.094554+0000","last_became_peered":"2023-08-09T12:46:54.094554+0000","last_unstale":"2023-08-09T12:46:55.155902+0000","last_undegraded":"2023-08-09T12:46:55.155902+0000","last_fullsized":"2023-08-09T12:46:55.155902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:54:46.335223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.115815+0000","last_change":"2023-08-09T12:46:55.143014+0000","last_active":"2023-08-09T12:46:56.115815+0000","last_peered":"2023-08-09T12:46:56.115815+0000","last_clean":"2023-08-09T12:46:56.115815+0000","last_became_active":"2023-08-09T12:46:55.142587+0000","last_became_peered":"2023-08-09T12:46:55.142587+0000","last_unstale":"2023-08-09T12:46:56.115815+0000","last_undegraded":"2023-08-09T12:46:56.115815+0000","last_fullsized":"2023-08-09T12:46:56.115815+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:10.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126184+0000","last_change":"2023-08-09T12:46:54.100085+0000","last_active":"2023-08-09T12:46:55.126184+0000","last_peered":"2023-08-09T12:46:55.126184+0000","last_clean":"2023-08-09T12:46:55.126184+0000","last_became_active":"2023-08-09T12:46:54.099794+0000","last_became_peered":"2023-08-09T12:46:54.099794+0000","last_unstale":"2023-08-09T12:46:55.126184+0000","last_undegraded":"2023-08-09T12:46:55.126184+0000","last_fullsized":"2023-08-09T12:46:55.126184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:24.511939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.140256+0000","last_change":"2023-08-09T12:46:55.139709+0000","last_active":"2023-08-09T12:46:55.140256+0000","last_peered":"2023-08-09T12:46:55.140256+0000","last_clean":"2023-08-09T12:46:55.140256+0000","last_became_active":"2023-08-09T12:46:55.138993+0000","last_became_peered":"2023-08-09T12:46:55.138993+0000","last_unstale":"2023-08-09T12:46:55.140256+0000","last_undegraded":"2023-08-09T12:46:55.140256+0000","last_fullsized":"2023-08-09T12:46:55.140256+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:59:47.309995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116393+0000","last_change":"2023-08-09T12:46:54.098679+0000","last_active":"2023-08-09T12:46:56.116393+0000","last_peered":"2023-08-09T12:46:56.116393+0000","last_clean":"2023-08-09T12:46:56.116393+0000","last_became_active":"2023-08-09T12:46:54.097648+0000","last_became_peered":"2023-08-09T12:46:54.097648+0000","last_unstale":"2023-08-09T12:46:56.116393+0000","last_undegraded":"2023-08-09T12:46:56.116393+0000","last_fullsized":"2023-08-09T12:46:56.116393+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:23.001604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126858+0000","last_change":"2023-08-09T12:46:55.126670+0000","last_active":"2023-08-09T12:46:55.126858+0000","last_peered":"2023-08-09T12:46:55.126858+0000","last_clean":"2023-08-09T12:46:55.126858+0000","last_became_active":"2023-08-09T12:46:55.125770+0000","last_became_peered":"2023-08-09T12:46:55.125770+0000","last_unstale":"2023-08-09T12:46:55.126858+0000","last_undegraded":"2023-08-09T12:46:55.126858+0000","last_fullsized":"2023-08-09T12:46:55.126858+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:03.476742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.124702+0000","last_change":"2023-08-09T12:46:54.096839+0000","last_active":"2023-08-09T12:46:55.124702+0000","last_peered":"2023-08-09T12:46:55.124702+0000","last_clean":"2023-08-09T12:46:55.124702+0000","last_became_active":"2023-08-09T12:46:54.096516+0000","last_became_peered":"2023-08-09T12:46:54.096516+0000","last_unstale":"2023-08-09T12:46:55.124702+0000","last_undegraded":"2023-08-09T12:46:55.124702+0000","last_fullsized":"2023-08-09T12:46:55.124702+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:13:19.837678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143858+0000","last_change":"2023-08-09T12:46:55.143798+0000","last_active":"2023-08-09T12:46:55.143858+0000","last_peered":"2023-08-09T12:46:55.143858+0000","last_clean":"2023-08-09T12:46:55.143858+0000","last_became_active":"2023-08-09T12:46:55.134003+0000","last_became_peered":"2023-08-09T12:46:55.134003+0000","last_unstale":"2023-08-09T12:46:55.143858+0000","last_undegraded":"2023-08-09T12:46:55.143858+0000","last_fullsized":"2023-08-09T12:46:55.143858+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:08.132444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117336+0000","last_change":"2023-08-09T12:46:54.101441+0000","last_active":"2023-08-09T12:46:56.117336+0000","last_peered":"2023-08-09T12:46:56.117336+0000","last_clean":"2023-08-09T12:46:56.117336+0000","last_became_active":"2023-08-09T12:46:54.101007+0000","last_became_peered":"2023-08-09T12:46:54.101007+0000","last_unstale":"2023-08-09T12:46:56.117336+0000","last_undegraded":"2023-08-09T12:46:56.117336+0000","last_fullsized":"2023-08-09T12:46:56.117336+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:44:00.023225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143789+0000","last_change":"2023-08-09T12:46:55.142687+0000","last_active":"2023-08-09T12:46:55.143789+0000","last_peered":"2023-08-09T12:46:55.143789+0000","last_clean":"2023-08-09T12:46:55.143789+0000","last_became_active":"2023-08-09T12:46:55.142263+0000","last_became_peered":"2023-08-09T12:46:55.142263+0000","last_unstale":"2023-08-09T12:46:55.143789+0000","last_undegraded":"2023-08-09T12:46:55.143789+0000","last_fullsized":"2023-08-09T12:46:55.143789+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:49:27.924152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.110908+0000","last_change":"2023-08-09T12:46:54.094289+0000","last_active":"2023-08-09T12:46:55.110908+0000","last_peered":"2023-08-09T12:46:55.110908+0000","last_clean":"2023-08-09T12:46:55.110908+0000","last_became_active":"2023-08-09T12:46:54.093560+0000","last_became_peered":"2023-08-09T12:46:54.093560+0000","last_unstale":"2023-08-09T12:46:55.110908+0000","last_undegraded":"2023-08-09T12:46:55.110908+0000","last_fullsized":"2023-08-09T12:46:55.110908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:41:09.308160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.114661+0000","last_change":"2023-08-09T12:46:55.136338+0000","last_active":"2023-08-09T12:46:56.114661+0000","last_peered":"2023-08-09T12:46:56.114661+0000","last_clean":"2023-08-09T12:46:56.114661+0000","last_became_active":"2023-08-09T12:46:55.127031+0000","last_became_peered":"2023-08-09T12:46:55.127031+0000","last_unstale":"2023-08-09T12:46:56.114661+0000","last_undegraded":"2023-08-09T12:46:56.114661+0000","last_fullsized":"2023-08-09T12:46:56.114661+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:31:35.917100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116562+0000","last_change":"2023-08-09T12:46:54.098330+0000","last_active":"2023-08-09T12:46:56.116562+0000","last_peered":"2023-08-09T12:46:56.116562+0000","last_clean":"2023-08-09T12:46:56.116562+0000","last_became_active":"2023-08-09T12:46:54.096328+0000","last_became_peered":"2023-08-09T12:46:54.096328+0000","last_unstale":"2023-08-09T12:46:56.116562+0000","last_undegraded":"2023-08-09T12:46:56.116562+0000","last_fullsized":"2023-08-09T12:46:56.116562+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:06:36.421003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126807+0000","last_change":"2023-08-09T12:46:55.126597+0000","last_active":"2023-08-09T12:46:55.126807+0000","last_peered":"2023-08-09T12:46:55.126807+0000","last_clean":"2023-08-09T12:46:55.126807+0000","last_became_active":"2023-08-09T12:46:55.126037+0000","last_became_peered":"2023-08-09T12:46:55.126037+0000","last_unstale":"2023-08-09T12:46:55.126807+0000","last_undegraded":"2023-08-09T12:46:55.126807+0000","last_fullsized":"2023-08-09T12:46:55.126807+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:42:41.473270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.111935+0000","last_change":"2023-08-09T12:46:54.097268+0000","last_active":"2023-08-09T12:46:55.111935+0000","last_peered":"2023-08-09T12:46:55.111935+0000","last_clean":"2023-08-09T12:46:55.111935+0000","last_became_active":"2023-08-09T12:46:54.093607+0000","last_became_peered":"2023-08-09T12:46:54.093607+0000","last_unstale":"2023-08-09T12:46:55.111935+0000","last_undegraded":"2023-08-09T12:46:55.111935+0000","last_fullsized":"2023-08-09T12:46:55.111935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:39:47.432179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.138400+0000","last_change":"2023-08-09T12:46:55.138219+0000","last_active":"2023-08-09T12:46:55.138400+0000","last_peered":"2023-08-09T12:46:55.138400+0000","last_clean":"2023-08-09T12:46:55.138400+0000","last_became_active":"2023-08-09T12:46:55.137605+0000","last_became_peered":"2023-08-09T12:46:55.137605+0000","last_unstale":"2023-08-09T12:46:55.138400+0000","last_undegraded":"2023-08-09T12:46:55.138400+0000","last_fullsized":"2023-08-09T12:46:55.138400+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:45.451722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.157699+0000","last_change":"2023-08-09T12:46:54.088590+0000","last_active":"2023-08-09T12:46:55.157699+0000","last_peered":"2023-08-09T12:46:55.157699+0000","last_clean":"2023-08-09T12:46:55.157699+0000","last_became_active":"2023-08-09T12:46:54.086840+0000","last_became_peered":"2023-08-09T12:46:54.086840+0000","last_unstale":"2023-08-09T12:46:55.157699+0000","last_undegraded":"2023-08-09T12:46:55.157699+0000","last_fullsized":"2023-08-09T12:46:55.157699+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:37.848458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":382,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.114884+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:46:56.114884+0000","last_peered":"2023-08-09T12:46:56.114884+0000","last_clean":"2023-08-09T12:46:56.114884+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:46:56.114884+0000","last_undegraded":"2023-08-09T12:46:56.114884+0000","last_fullsized":"2023-08-09T12:46:56.114884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:59:28.729976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":202,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.113160+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:46:55.113160+0000","last_peered":"2023-08-09T12:46:55.113160+0000","last_clean":"2023-08-09T12:46:55.113160+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:46:55.113160+0000","last_undegraded":"2023-08-09T12:46:55.113160+0000","last_fullsized":"2023-08-09T12:46:55.113160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:05:45.050037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116590+0000","last_change":"2023-08-09T12:46:55.132754+0000","last_active":"2023-08-09T12:46:56.116590+0000","last_peered":"2023-08-09T12:46:56.116590+0000","last_clean":"2023-08-09T12:46:56.116590+0000","last_became_active":"2023-08-09T12:46:55.132023+0000","last_became_peered":"2023-08-09T12:46:55.132023+0000","last_unstale":"2023-08-09T12:46:56.116590+0000","last_undegraded":"2023-08-09T12:46:56.116590+0000","last_fullsized":"2023-08-09T12:46:56.116590+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:24:38.809743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"129'1","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.113020+0000","last_change":"2023-08-09T12:46:54.096185+0000","last_active":"2023-08-09T12:46:56.113020+0000","last_peered":"2023-08-09T12:46:56.113020+0000","last_clean":"2023-08-09T12:46:56.113020+0000","last_became_active":"2023-08-09T12:46:54.095889+0000","last_became_peered":"2023-08-09T12:46:54.095889+0000","last_unstale":"2023-08-09T12:46:56.113020+0000","last_undegraded":"2023-08-09T12:46:56.113020+0000","last_fullsized":"2023-08-09T12:46:56.113020+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:49:22.470606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.113585+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:46:56.113585+0000","last_peered":"2023-08-09T12:46:56.113585+0000","last_clean":"2023-08-09T12:46:56.113585+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:46:56.113585+0000","last_undegraded":"2023-08-09T12:46:56.113585+0000","last_fullsized":"2023-08-09T12:46:56.113585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:38:34.335566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.141721+0000","last_change":"2023-08-09T12:46:55.141551+0000","last_active":"2023-08-09T12:46:55.141721+0000","last_peered":"2023-08-09T12:46:55.141721+0000","last_clean":"2023-08-09T12:46:55.141721+0000","last_became_active":"2023-08-09T12:46:55.136759+0000","last_became_peered":"2023-08-09T12:46:55.136759+0000","last_unstale":"2023-08-09T12:46:55.141721+0000","last_undegraded":"2023-08-09T12:46:55.141721+0000","last_fullsized":"2023-08-09T12:46:55.141721+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:21:04.993382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.114859+0000","last_change":"2023-08-09T12:46:54.098535+0000","last_active":"2023-08-09T12:46:55.114859+0000","last_peered":"2023-08-09T12:46:55.114859+0000","last_clean":"2023-08-09T12:46:55.114859+0000","last_became_active":"2023-08-09T12:46:54.098289+0000","last_became_peered":"2023-08-09T12:46:54.098289+0000","last_unstale":"2023-08-09T12:46:55.114859+0000","last_undegraded":"2023-08-09T12:46:55.114859+0000","last_fullsized":"2023-08-09T12:46:55.114859+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:12:32.203445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.112797+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:46:55.112797+0000","last_peered":"2023-08-09T12:46:55.112797+0000","last_clean":"2023-08-09T12:46:55.112797+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:46:55.112797+0000","last_undegraded":"2023-08-09T12:46:55.112797+0000","last_fullsized":"2023-08-09T12:46:55.112797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:59:08.920629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143713+0000","last_change":"2023-08-09T12:46:55.141124+0000","last_active":"2023-08-09T12:46:55.143713+0000","last_peered":"2023-08-09T12:46:55.143713+0000","last_clean":"2023-08-09T12:46:55.143713+0000","last_became_active":"2023-08-09T12:46:55.140006+0000","last_became_peered":"2023-08-09T12:46:55.140006+0000","last_unstale":"2023-08-09T12:46:55.143713+0000","last_undegraded":"2023-08-09T12:46:55.143713+0000","last_fullsized":"2023-08-09T12:46:55.143713+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:46:47.707585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"129'1","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.116029+0000","last_change":"2023-08-09T12:46:54.098828+0000","last_active":"2023-08-09T12:46:56.116029+0000","last_peered":"2023-08-09T12:46:56.116029+0000","last_clean":"2023-08-09T12:46:56.116029+0000","last_became_active":"2023-08-09T12:46:54.098144+0000","last_became_peered":"2023-08-09T12:46:54.098144+0000","last_unstale":"2023-08-09T12:46:56.116029+0000","last_undegraded":"2023-08-09T12:46:56.116029+0000","last_fullsized":"2023-08-09T12:46:56.116029+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:46:23.923697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.115030+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:46:55.115030+0000","last_peered":"2023-08-09T12:46:55.115030+0000","last_clean":"2023-08-09T12:46:55.115030+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:46:55.115030+0000","last_undegraded":"2023-08-09T12:46:55.115030+0000","last_fullsized":"2023-08-09T12:46:55.115030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:22:10.540231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.138895+0000","last_change":"2023-08-09T12:46:55.138803+0000","last_active":"2023-08-09T12:46:55.138895+0000","last_peered":"2023-08-09T12:46:55.138895+0000","last_clean":"2023-08-09T12:46:55.138895+0000","last_became_active":"2023-08-09T12:46:55.138290+0000","last_became_peered":"2023-08-09T12:46:55.138290+0000","last_unstale":"2023-08-09T12:46:55.138895+0000","last_undegraded":"2023-08-09T12:46:55.138895+0000","last_fullsized":"2023-08-09T12:46:55.138895+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:25:25.398131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.117376+0000","last_change":"2023-08-09T12:46:54.097063+0000","last_active":"2023-08-09T12:46:56.117376+0000","last_peered":"2023-08-09T12:46:56.117376+0000","last_clean":"2023-08-09T12:46:56.117376+0000","last_became_active":"2023-08-09T12:46:54.096802+0000","last_became_peered":"2023-08-09T12:46:54.096802+0000","last_unstale":"2023-08-09T12:46:56.117376+0000","last_undegraded":"2023-08-09T12:46:56.117376+0000","last_fullsized":"2023-08-09T12:46:56.117376+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:49.567328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.126883+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:46:55.126883+0000","last_peered":"2023-08-09T12:46:55.126883+0000","last_clean":"2023-08-09T12:46:55.126883+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:46:55.126883+0000","last_undegraded":"2023-08-09T12:46:55.126883+0000","last_fullsized":"2023-08-09T12:46:55.126883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:14:27.676611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.143670+0000","last_change":"2023-08-09T12:46:55.135010+0000","last_active":"2023-08-09T12:46:55.143670+0000","last_peered":"2023-08-09T12:46:55.143670+0000","last_clean":"2023-08-09T12:46:55.143670+0000","last_became_active":"2023-08-09T12:46:55.133356+0000","last_became_peered":"2023-08-09T12:46:55.133356+0000","last_unstale":"2023-08-09T12:46:55.143670+0000","last_undegraded":"2023-08-09T12:46:55.143670+0000","last_fullsized":"2023-08-09T12:46:55.143670+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:11:23.855350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.112184+0000","last_change":"2023-08-09T12:46:54.082498+0000","last_active":"2023-08-09T12:46:55.112184+0000","last_peered":"2023-08-09T12:46:55.112184+0000","last_clean":"2023-08-09T12:46:55.112184+0000","last_became_active":"2023-08-09T12:46:54.081841+0000","last_became_peered":"2023-08-09T12:46:54.081841+0000","last_unstale":"2023-08-09T12:46:55.112184+0000","last_undegraded":"2023-08-09T12:46:55.112184+0000","last_fullsized":"2023-08-09T12:46:55.112184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:10:22.973619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.113290+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:46:56.113290+0000","last_peered":"2023-08-09T12:46:56.113290+0000","last_clean":"2023-08-09T12:46:56.113290+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:46:56.113290+0000","last_undegraded":"2023-08-09T12:46:56.113290+0000","last_fullsized":"2023-08-09T12:46:56.113290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:24:24.191320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.147920+0000","last_change":"2023-08-09T12:46:55.147843+0000","last_active":"2023-08-09T12:46:55.147920+0000","last_peered":"2023-08-09T12:46:55.147920+0000","last_clean":"2023-08-09T12:46:55.147920+0000","last_became_active":"2023-08-09T12:46:55.145729+0000","last_became_peered":"2023-08-09T12:46:55.145729+0000","last_unstale":"2023-08-09T12:46:55.147920+0000","last_undegraded":"2023-08-09T12:46:55.147920+0000","last_fullsized":"2023-08-09T12:46:55.147920+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:46:45.368274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"129'2","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.158761+0000","last_change":"2023-08-09T12:46:54.094844+0000","last_active":"2023-08-09T12:46:55.158761+0000","last_peered":"2023-08-09T12:46:55.158761+0000","last_clean":"2023-08-09T12:46:55.158761+0000","last_became_active":"2023-08-09T12:46:54.094569+0000","last_became_peered":"2023-08-09T12:46:54.094569+0000","last_unstale":"2023-08-09T12:46:55.158761+0000","last_undegraded":"2023-08-09T12:46:55.158761+0000","last_fullsized":"2023-08-09T12:46:55.158761+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:20:57.729755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.121693+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:46:55.121693+0000","last_peered":"2023-08-09T12:46:55.121693+0000","last_clean":"2023-08-09T12:46:55.121693+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:46:55.121693+0000","last_undegraded":"2023-08-09T12:46:55.121693+0000","last_fullsized":"2023-08-09T12:46:55.121693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:57:47.335379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.139230+0000","last_change":"2023-08-09T12:46:55.138967+0000","last_active":"2023-08-09T12:46:55.139230+0000","last_peered":"2023-08-09T12:46:55.139230+0000","last_clean":"2023-08-09T12:46:55.139230+0000","last_became_active":"2023-08-09T12:46:55.137977+0000","last_became_peered":"2023-08-09T12:46:55.137977+0000","last_unstale":"2023-08-09T12:46:55.139230+0000","last_undegraded":"2023-08-09T12:46:55.139230+0000","last_fullsized":"2023-08-09T12:46:55.139230+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:54.063443+0000","last_clean_scrub_stamp":"2023-08-09T12:46:54.063443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:26.868895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-08-09T12:46:55.111604+0000","last_change":"2023-08-09T12:46:54.088023+0000","last_active":"2023-08-09T12:46:55.111604+0000","last_peered":"2023-08-09T12:46:55.111604+0000","last_clean":"2023-08-09T12:46:55.111604+0000","last_became_active":"2023-08-09T12:46:54.086357+0000","last_became_peered":"2023-08-09T12:46:54.086357+0000","last_unstale":"2023-08-09T12:46:55.111604+0000","last_undegraded":"2023-08-09T12:46:55.111604+0000","last_fullsized":"2023-08-09T12:46:55.111604+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:46:53.050953+0000","last_clean_scrub_stamp":"2023-08-09T12:46:53.050953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:06:45.180778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-08-09T12:46:56.118030+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:46:56.118030+0000","last_peered":"2023-08-09T12:46:56.118030+0000","last_clean":"2023-08-09T12:46:56.118030+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:46:56.118030+0000","last_undegraded":"2023-08-09T12:46:56.118030+0000","last_fullsized":"2023-08-09T12:46:56.118030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:32:33.522033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193988,"statfs":{"total":200000000,"available":198644396,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.1279999999999999,"15min":1.105},"min":{"1min":0.749,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3799999999999999,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":1.022},{"interface":"front","average":{"1min":1.097,"5min":1.1359999999999999,"15min":1.089},"min":{"1min":0.82199999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.395,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.84499999999999997}]},{"osd":1,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2130000000000001,"15min":1.129},"min":{"1min":0.78400000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8069999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.153},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2090000000000001,"15min":1.127},"min":{"1min":0.92600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.7010000000000001,"5min":1.714,"15min":1.734},"last":1.0980000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.304,"15min":1.1899999999999999},"min":{"1min":0.95999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.804,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2130000000000001,"15min":1.1619999999999999},"min":{"1min":0.78400000000000003,"5min":0.73399999999999999,"15min":0.69799999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":2.173},"last":1.282}]},{"osd":3,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.325,"15min":1.254},"min":{"1min":0.872,"5min":0.746,"15min":0.746},"max":{"1min":1.581,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.415},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.375,"15min":1.2909999999999999},"min":{"1min":1.1950000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.702,"5min":2.282,"15min":2.282},"last":0.72699999999999998}]},{"osd":4,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.224,"15min":1.212},"min":{"1min":1.0029999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.776,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.4079999999999999,"15min":1.3049999999999999},"min":{"1min":1.077,"5min":0.67900000000000005,"15min":0.58599999999999997},"max":{"1min":1.921,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.304}]},{"osd":5,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4399999999999999,"15min":1.323},"min":{"1min":0.92800000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.7549999999999999,"5min":2.802,"15min":2.802},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.5309999999999999,"15min":1.498},"min":{"1min":1.5069999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1230000000000002,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.3400000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.486,"15min":1.478},"min":{"1min":1.3520000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.0169999999999999,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.645,"5min":1.518,"15min":1.4630000000000001},"min":{"1min":1.411,"5min":0.83699999999999997,"15min":0.623},"max":{"1min":1.998,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.47}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199232708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1699999999999999,"15min":1.1359999999999999},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.986,"5min":1.986,"15min":2.54},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.103,"15min":1.0720000000000001},"min":{"1min":0.69299999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4770000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.127}]},{"osd":1,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.268,"15min":1.238},"min":{"1min":0.84799999999999998,"5min":0.80400000000000005,"15min":0.66500000000000004},"max":{"1min":1.621,"5min":1.7250000000000001,"15min":2.306},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.355,"15min":1.3260000000000001},"min":{"1min":0.94899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6379999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.2370000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.179,"15min":1.117},"min":{"1min":0.96199999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5920000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.357,"5min":1.3129999999999999,"15min":1.2809999999999999},"min":{"1min":0.76500000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.827,"5min":1.923,"15min":2.6499999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3420000000000001,"15min":1.2869999999999999},"min":{"1min":0.82199999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7390000000000001,"5min":2.327,"15min":2.327},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.3859999999999999,"15min":1.3089999999999999},"min":{"1min":1.2130000000000001,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.639,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.0409999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4690000000000001,"15min":1.3460000000000001},"min":{"1min":0.78300000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.028,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3979999999999999,"15min":1.345},"min":{"1min":0.91100000000000003,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":2.29,"5min":2.29,"15min":2.3479999999999999},"last":1.3700000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.427,"15min":1.3420000000000001},"min":{"1min":1.0149999999999999,"5min":0.83999999999999997,"15min":0.77600000000000002},"max":{"1min":1.798,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.258},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.5580000000000001,"15min":1.488},"min":{"1min":1.079,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.7450000000000001,"5min":2.4350000000000001,"15min":2.8580000000000001},"last":1.3}]},{"osd":7,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5780000000000001,"15min":1.4490000000000001},"min":{"1min":1.2050000000000001,"5min":1.0009999999999999,"15min":0.752},"max":{"1min":2.1520000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.542,"5min":1.593,"15min":1.4570000000000001},"min":{"1min":1.099,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.7709999999999999,"5min":3.621,"15min":3.621},"last":1.3420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.1080000000000001,"15min":1.109},"min":{"1min":0.71199999999999997,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":1.3120000000000001,"5min":2.4020000000000001,"15min":2.427},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.194,"5min":1.218,"15min":1.099},"min":{"1min":0.76300000000000001,"5min":0.71699999999999997,"15min":0.625},"max":{"1min":1.8859999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.2150000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3640000000000001,"15min":1.3029999999999999},"min":{"1min":0.64400000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.804,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.254,"5min":1.286,"15min":1.2509999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6699999999999999,"5min":1.984,"15min":1.984},"last":0.73899999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.26,"15min":1.2130000000000001},"min":{"1min":0.84699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6060000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.22,"15min":1.194},"min":{"1min":0.76300000000000001,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4570000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.03}]},{"osd":3,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.333,"15min":1.226},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.77100000000000002},"max":{"1min":1.6899999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3879999999999999,"15min":1.377},"min":{"1min":0.93999999999999995,"5min":0.86299999999999999,"15min":0.78200000000000003},"max":{"1min":1.76,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2689999999999999,"15min":1.238},"min":{"1min":0.82399999999999995,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":1.6319999999999999,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":1.167},{"interface":"front","average":{"1min":1.474,"5min":1.403,"15min":1.379},"min":{"1min":0.80600000000000005,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":1.722,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":1.115}]},{"osd":6,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.393,"15min":1.3480000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.929,"5min":2.5,"15min":2.5},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.448,"15min":1.482},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.726,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.3460000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:46:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5269999999999999,"15min":1.5229999999999999},"min":{"1min":0.86599999999999999,"5min":0.76900000000000002,"15min":0.67200000000000004},"max":{"1min":1.946,"5min":2.722,"15min":3.3250000000000002},"last":1.518},{"interface":"front","average":{"1min":1.589,"5min":1.583,"15min":1.528},"min":{"1min":1.0740000000000001,"5min":0.80000000000000004,"15min":0.65300000000000002},"max":{"1min":1.857,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.5720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199234832,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1559999999999999,"15min":1.0940000000000001},"min":{"1min":0.65600000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.171,"5min":1.169,"15min":1.1080000000000001},"min":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4830000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.95199999999999996}]},{"osd":1,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.268,"15min":1.3260000000000001},"min":{"1min":0.77400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.327,"15min":1.3360000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.363}]},{"osd":2,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.70899999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.427},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.3480000000000001,"15min":1.323},"min":{"1min":0.97699999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":3.0579999999999998,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.5760000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3089999999999999,"15min":1.2350000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.649,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.087},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":1.071,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.536}]},{"osd":5,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.337,"15min":1.3839999999999999},"min":{"1min":0.98699999999999999,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":3.137,"5min":3.137,"15min":3.137},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3939999999999999,"15min":1.3819999999999999},"min":{"1min":0.85599999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.9750000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.2829999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.417,"15min":1.482},"min":{"1min":0.97599999999999998,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.645,"5min":1.5369999999999999,"15min":1.54},"min":{"1min":0.96599999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.3340000000000001,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.7070000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.54,"15min":1.524},"min":{"1min":1.115,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0859999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.5820000000000001,"15min":1.621},"min":{"1min":1.347,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":1.6859999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199240995,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90900000000000003,"15min":0.84199999999999997},"min":{"1min":0.42699999999999999,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.4219999999999999,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.996,"5min":1.079,"15min":0.92800000000000005},"min":{"1min":0.497,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":1.7170000000000001,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.222}]},{"osd":1,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.93300000000000005,"15min":0.90700000000000003},"min":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4930000000000001,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1519999999999999,"15min":0.95799999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.373},"max":{"1min":1.8400000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.28}]},{"osd":2,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.3680000000000001,"15min":1.129},"min":{"1min":0.53700000000000003,"5min":0.47299999999999998,"15min":0.433},"max":{"1min":1.9259999999999999,"5min":18.145,"15min":18.145},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2509999999999999,"15min":1.2070000000000001},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.41799999999999998},"max":{"1min":1.593,"5min":2.169,"15min":2.169},"last":0.91300000000000003}]},{"osd":4,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.3220000000000001,"15min":1.3240000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.745},"max":{"1min":1.6140000000000001,"5min":2.972,"15min":3.5110000000000001},"last":1.121},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.351,"15min":1.3380000000000001},"min":{"1min":1.012,"5min":0.751,"15min":0.65400000000000003},"max":{"1min":1.752,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.175}]},{"osd":5,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.587,"15min":1.4399999999999999},"min":{"1min":0.97499999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8169999999999999,"5min":18.094000000000001,"15min":18.094000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.6140000000000001,"15min":1.3720000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":2.1219999999999999,"5min":14.105,"15min":14.105},"last":1.0349999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.405,"15min":1.349},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4910000000000001,"15min":1.478},"min":{"1min":0.88400000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.0099999999999998,"5min":4.0220000000000002,"15min":4.0220000000000002},"last":1.5389999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:46:36 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.5029999999999999,"15min":1.4139999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.72499999999999998},"max":{"1min":2.242,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4850000000000001,"15min":1.3979999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":1.8129999999999999,"5min":3.016,"15min":3.016},"last":2.073}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.111,"5min":1.597,"15min":1.716},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.995,"15min":0.96399999999999997},"min":{"1min":0.629,"5min":0.46700000000000003,"15min":0.38900000000000001},"max":{"1min":1.2370000000000001,"5min":1.73,"15min":2.9009999999999998},"last":0.92100000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.95399999999999996,"15min":0.92700000000000005},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.36299999999999999},"max":{"1min":1.6379999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.073,"15min":1.0569999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.383,"5min":1.823,"15min":1.869},"last":1.248}]},{"osd":3,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.161,"15min":1.1659999999999999},"min":{"1min":0.65900000000000003,"5min":0.54800000000000004,"15min":0.46600000000000003},"max":{"1min":1.5669999999999999,"5min":1.6819999999999999,"15min":3.2850000000000001},"last":1.202},{"interface":"front","average":{"1min":1.105,"5min":1.2030000000000001,"15min":1.161},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.583,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":1.101}]},{"osd":4,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.4570000000000001,"15min":1.421},"min":{"1min":0.83499999999999996,"5min":0.82599999999999996,"15min":0.81899999999999995},"max":{"1min":1.794,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.323},{"interface":"front","average":{"1min":1.276,"5min":1.3420000000000001,"15min":1.29},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.7629999999999999,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":1.5609999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4119999999999999,"15min":1.369},"min":{"1min":1.006,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7889999999999999,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.462,"15min":1.48},"min":{"1min":0.90800000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.669,"5min":2.4780000000000002,"15min":4.806},"last":1.3999999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3779999999999999,"15min":1.319},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.71,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.478},{"interface":"front","average":{"1min":1.373,"5min":1.468,"15min":1.429},"min":{"1min":0.998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.917,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":0.97699999999999998}]},{"osd":7,"last update":"Wed Aug 9 12:46:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4359999999999999,"15min":1.377},"min":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":2.464,"15min":2.464},"last":1.621},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.5569999999999999,"15min":1.536},"min":{"1min":0.96599999999999997,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.0139999999999998,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.1599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.50800000000000001,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.008},{"interface":"front","average":{"1min":0.95599999999999996,"5min":2.077,"15min":1.2609999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.9530000000000001,"5min":88.254999999999995,"15min":88.254999999999995},"last":1.3959999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.034,"15min":0.95699999999999996},"min":{"1min":0.65100000000000002,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.417,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.333,"15min":1.159},"min":{"1min":0.83299999999999996,"5min":0.622,"15min":0.61799999999999999},"max":{"1min":1.778,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":1.341}]},{"osd":3,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.24,"15min":1.109},"min":{"1min":0.57899999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5640000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.208},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2030000000000001,"15min":0.99299999999999999},"min":{"1min":0.55600000000000005,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.704,"5min":5.4320000000000004,"15min":5.4320000000000004},"last":1.1160000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.5569999999999999,"15min":1.2969999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.76200000000000001},"max":{"1min":2.391,"5min":25.172000000000001,"15min":25.172000000000001},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.53,"5min":1.4319999999999999,"15min":1.3200000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.84599999999999997},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.47}]},{"osd":5,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.7,"15min":1.409},"min":{"1min":0.98199999999999998,"5min":0.81100000000000005,"15min":0.77800000000000002},"max":{"1min":2.5419999999999998,"5min":28.710000000000001,"15min":28.710000000000001},"last":1.639},{"interface":"front","average":{"1min":1.304,"5min":1.3720000000000001,"15min":1.2889999999999999},"min":{"1min":0.878,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9910000000000001,"5min":3.762,"15min":3.762},"last":1.516}]},{"osd":6,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.569,"15min":1.4390000000000001},"min":{"1min":0.92300000000000004,"5min":0.91000000000000003,"15min":0.83799999999999997},"max":{"1min":1.841,"5min":6.0460000000000003,"15min":6.0460000000000003},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.478,"15min":1.389},"min":{"1min":1.022,"5min":0.873,"15min":0.79500000000000004},"max":{"1min":2.0960000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.8}]},{"osd":7,"last update":"Wed Aug 9 12:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.881,"15min":1.5940000000000001},"min":{"1min":1.097,"5min":0.98699999999999999,"15min":0.88800000000000001},"max":{"1min":1.9199999999999999,"5min":26.975999999999999,"15min":26.975999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.9139999999999999,"15min":1.5800000000000001},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.492,"5min":28.765000000000001,"15min":28.765000000000001},"last":1.948}]}]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193993,"statfs":{"total":200000000,"available":198649507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92300000000000004,"15min":0.875},"min":{"1min":0.57099999999999995,"5min":0.50900000000000001,"15min":0.39500000000000002},"max":{"1min":1.597,"5min":1.819,"15min":1.819},"last":0.754},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.111,"15min":0.97299999999999998},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.436},"max":{"1min":1.5740000000000001,"5min":6.1749999999999998,"15min":6.1749999999999998},"last":0.86499999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.054,"15min":0.96999999999999997},"min":{"1min":0.63800000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5069999999999999,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.05,"5min":1.1619999999999999,"15min":1.042},"min":{"1min":0.63,"5min":0.57999999999999996,"15min":0.5},"max":{"1min":1.6160000000000001,"5min":6.2549999999999999,"15min":6.2549999999999999},"last":1.0900000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.135,"15min":0.95999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6699999999999999,"5min":9.6069999999999993,"15min":9.6069999999999993},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.246,"15min":1.1879999999999999},"min":{"1min":0.64700000000000002,"5min":0.58399999999999996,"15min":0.56000000000000005},"max":{"1min":1.4970000000000001,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.403,"15min":1.3320000000000001},"min":{"1min":0.92500000000000004,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.8,"5min":9.9629999999999992,"15min":9.9629999999999992},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.377,"15min":1.298},"min":{"1min":0.86699999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8049999999999999,"5min":1.879,"15min":1.879},"last":1.4490000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4419999999999999,"15min":1.319},"min":{"1min":0.93999999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.0419999999999998,"5min":10.004,"15min":10.004},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.45,"15min":1.389},"min":{"1min":0.91700000000000004,"5min":0.87,"15min":0.84999999999999998},"max":{"1min":1.742,"5min":1.909,"15min":2.161},"last":1.3080000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.4450000000000001,"15min":1.3500000000000001},"min":{"1min":1.097,"5min":0.83699999999999997,"15min":0.75900000000000001},"max":{"1min":1.6339999999999999,"5min":6.4290000000000003,"15min":6.4290000000000003},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.548,"15min":1.4359999999999999},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":2.1549999999999998,"5min":9.9190000000000005,"15min":9.9190000000000005},"last":1.6279999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:46:22 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.609,"15min":1.444},"min":{"1min":1.0069999999999999,"5min":0.84999999999999998,"15min":0.79200000000000004},"max":{"1min":1.909,"5min":18.114000000000001,"15min":18.114000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.6120000000000001,"15min":1.4730000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.8759999999999999,"5min":9.5640000000000001,"15min":9.5640000000000001},"last":1.573}]}]}],"pool_statfs":[]}} 2023-08-09T12:47:00.205 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:47:00.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:47:00.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.479+0000 7f0fbbc87640 1 Processor -- start 2023-08-09T12:47:00.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.479+0000 7f0fbbc87640 1 -- start start 2023-08-09T12:47:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.481+0000 7f0fbbc87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40ca9c0 0x7f0fb40cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.481+0000 7f0fbbc87640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40ce410 con 0x7f0fb415d150 2023-08-09T12:47:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.481+0000 7f0fbbc87640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb4160ae0 con 0x7f0fb40cada0 2023-08-09T12:47:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.481+0000 7f0fbbc87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4160dc0 con 0x7f0fb40ca9c0 2023-08-09T12:47:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.482+0000 7f0fba224640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0fb415d150 0x7f0fb40cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45814/0 (socket says 172.21.15.17:45814) 2023-08-09T12:47:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.482+0000 7f0fba224640 1 -- 172.21.15.17:0/1540459405 learned_addr learned my addr 172.21.15.17:0/1540459405 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.482+0000 7f0fb9a23640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40ca9c0 0x7f0fb40cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.482+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293026415 0 0) 0x7f0fb40ce410 con 0x7f0fb415d150 2023-08-09T12:47:00.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.482+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa0003520 con 0x7f0fb415d150 2023-08-09T12:47:00.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1392977538 0 0) 0x7f0fa0003520 con 0x7f0fb415d150 2023-08-09T12:47:00.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40ca9c0 msgr2=0x7f0fb40cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:00.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40ca9c0 0x7f0fb40cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 >> v1:172.21.15.142:6789/0 conn(0x7f0fb40cada0 legacy=0x7f0fb415ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb41610a0 con 0x7f0fb415d150 2023-08-09T12:47:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0fac0019f0 con 0x7f0fb415d150 2023-08-09T12:47:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 >> v1:172.21.15.17:6789/0 conn(0x7f0fb415d150 legacy=0x7f0fb40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00039a0 0x7f0fa0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa00047c0 0x7f0fa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40ca9c0 0x7f0fa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4160dc0 con 0x7f0fa00047c0 2023-08-09T12:47:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa000ba30 con 0x7f0fa00039a0 2023-08-09T12:47:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa000bbf0 con 0x7f0fb40ca9c0 2023-08-09T12:47:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb9222640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa00047c0 0x7f0fa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.483+0000 7f0fb9a23640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00039a0 0x7f0fa0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.484+0000 7f0fba224640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40ca9c0 0x7f0fa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.484+0000 7f0fb9222640 1 -- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40ca9c0 msgr2=0x7f0fa0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.484+0000 7f0fb9222640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40ca9c0 0x7f0fa0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.484+0000 7f0fb9222640 1 -- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00039a0 msgr2=0x7f0fa0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.484+0000 7f0fb9222640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00039a0 0x7f0fa0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.484+0000 7f0fb9222640 1 -- 172.21.15.17:0/1540459405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0003520 con 0x7f0fa00047c0 2023-08-09T12:47:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.485+0000 7f0fb9222640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa00047c0 0x7f0fa0004c40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4001720 tx=0x7f0fa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1816607e6d9ba7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.485+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40052d0 con 0x7f0fa00047c0 2023-08-09T12:47:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.485+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa402e050 con 0x7f0fa00047c0 2023-08-09T12:47:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.485+0000 7f0fb8a21640 1 -- 172.21.15.17:0/1540459405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40035f0 con 0x7f0fa00047c0 2023-08-09T12:47:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.486+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1540459405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa00047c0 msgr2=0x7f0fa0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.486+0000 7f0fbbc87640 1 --2- 172.21.15.17:0/1540459405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa00047c0 0x7f0fa0004c40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4001720 tx=0x7f0fa00057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.486+0000 7f0fba224640 1 -- 172.21.15.17:0/1540459405 reap_dead start 2023-08-09T12:47:00.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.486+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1540459405 shutdown_connections 2023-08-09T12:47:00.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.486+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1540459405 >> 172.21.15.17:0/1540459405 conn(0x7f0fb40ce840 msgr2=0x7f0fb40cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:00.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.486+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1540459405 shutdown_connections 2023-08-09T12:47:00.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.486+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1540459405 wait complete. 2023-08-09T12:47:00.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.488+0000 7f0fbbc87640 1 Processor -- start 2023-08-09T12:47:00.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.488+0000 7f0fbbc87640 1 -- start start 2023-08-09T12:47:00.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fbbc87640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00047c0 0x7f0fb414c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:00.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fbbc87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb40c5880 0x7f0fb415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:00.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fbbc87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40c5ce0 0x7f0fb415f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:00.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fbbc87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c7350 con 0x7f0fb40c5880 2023-08-09T12:47:00.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fbbc87640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c62b0 con 0x7f0fa00047c0 2023-08-09T12:47:00.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fbbc87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c6590 con 0x7f0fb40c5ce0 2023-08-09T12:47:00.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fb9222640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb40c5880 0x7f0fb415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:00.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fb9222640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb40c5880 0x7f0fb415ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54072/0 (socket says 172.21.15.17:54072) 2023-08-09T12:47:00.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.489+0000 7f0fb9222640 1 -- 172.21.15.17:0/1619539667 learned_addr learned my addr 172.21.15.17:0/1619539667 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:00.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.490+0000 7f0fb9a23640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00047c0 0x7f0fb414c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:00.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.490+0000 7f0fba224640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40c5ce0 0x7f0fb415f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:00.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.490+0000 7f0fb9222640 1 -- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40c5ce0 msgr2=0x7f0fb415f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.490+0000 7f0fb9222640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40c5ce0 0x7f0fb415f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.490+0000 7f0fb9222640 1 -- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00047c0 msgr2=0x7f0fb414c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.490+0000 7f0fb9222640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00047c0 0x7f0fb414c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.490+0000 7f0fb9222640 1 -- 172.21.15.17:0/1619539667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40c6870 con 0x7f0fb40c5880 2023-08-09T12:47:00.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.490+0000 7f0fb9a23640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00047c0 0x7f0fb414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:47:00.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.491+0000 7f0fb9222640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb40c5880 0x7f0fb415ebd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4008fd0 tx=0x7f0fa4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:00.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.491+0000 7f0faa7fc640 1 -- 172.21.15.17:0/1619539667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40076c0 con 0x7f0fb40c5880 2023-08-09T12:47:00.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.491+0000 7f0faa7fc640 1 -- 172.21.15.17:0/1619539667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa4007a30 con 0x7f0fb40c5880 2023-08-09T12:47:00.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.491+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb40c6b50 con 0x7f0fb40c5880 2023-08-09T12:47:00.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.491+0000 7f0faa7fc640 1 -- 172.21.15.17:0/1619539667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4006be0 con 0x7f0fb40c5880 2023-08-09T12:47:00.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.491+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb414c810 con 0x7f0fb40c5880 2023-08-09T12:47:00.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.492+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb4067a80 con 0x7f0fb40c5880 2023-08-09T12:47:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.493+0000 7f0faa7fc640 1 -- 172.21.15.17:0/1619539667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0fa4006d40 con 0x7f0fb40c5880 2023-08-09T12:47:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.494+0000 7f0faa7fc640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f9806a080 0x7f0f9806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.494+0000 7f0faa7fc640 1 -- 172.21.15.17:0/1619539667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fa40aa760 con 0x7f0fb40c5880 2023-08-09T12:47:00.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.495+0000 7f0fb9a23640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f9806a080 0x7f0f9806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:00.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.496+0000 7f0fb9a23640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f9806a080 0x7f0f9806c540 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009ad0 tx=0x7f0fb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:00.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.499+0000 7f0faa7fc640 1 -- 172.21.15.17:0/1619539667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0fa4079840 con 0x7f0fb40c5880 2023-08-09T12:47:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.767+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0fb406be80 con 0x7f0fb40c5880 2023-08-09T12:47:00.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.775+0000 7f0faa7fc640 1 -- 172.21.15.17:0/1619539667 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0fa40793d0 con 0x7f0fb40c5880 2023-08-09T12:47:00.779 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:47:00.779 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:47:00.780 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:47:00.780 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:47:00.780 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:47:00.780 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:47:00.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f9806a080 msgr2=0x7f0f9806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f9806a080 0x7f0f9806c540 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009ad0 tx=0x7f0fb0008040 comp rx=0 tx=0).stop 2023-08-09T12:47:00.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb40c5880 msgr2=0x7f0fb415ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:00.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb40c5880 0x7f0fb415ebd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4008fd0 tx=0x7f0fa4001120 comp rx=0 tx=0).stop 2023-08-09T12:47:00.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 shutdown_connections 2023-08-09T12:47:00.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0f9806a080 0x7f0f9806c540 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb40c5ce0 0x7f0fb415f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb40c5880 0x7f0fb415ebd0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 --2- 172.21.15.17:0/1619539667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa00047c0 0x7f0fb414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:00.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 >> 172.21.15.17:0/1619539667 conn(0x7f0fb40ce840 msgr2=0x7f0fb415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:00.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.778+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 shutdown_connections 2023-08-09T12:47:00.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:00.779+0000 7f0fbbc87640 1 -- 172.21.15.17:0/1619539667 wait complete. 2023-08-09T12:47:00.802 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.031+0000 7fdfca663640 1 Processor -- start 2023-08-09T12:47:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.031+0000 7fdfca663640 1 -- start start 2023-08-09T12:47:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.033+0000 7fdfca663640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdfc41587e0 0x7fdfc4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.033+0000 7fdfca663640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdfc40cb070 0x7fdfc40cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.033+0000 7fdfca663640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40cb9e0 con 0x7fdfc40b0b10 2023-08-09T12:47:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.033+0000 7fdfca663640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc415beb0 con 0x7fdfc41587e0 2023-08-09T12:47:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.033+0000 7fdfca663640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc40715c0 con 0x7fdfc40cb070 2023-08-09T12:47:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.033+0000 7fdfc9661640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdfc41587e0 0x7fdfc4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.033+0000 7fdfc9661640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdfc41587e0 0x7fdfc4070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54082/0 (socket says 172.21.15.17:54082) 2023-08-09T12:47:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.033+0000 7fdfc9661640 1 -- 172.21.15.17:0/1572457374 learned_addr learned my addr 172.21.15.17:0/1572457374 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.034+0000 7fdfc9e62640 1 --2- 172.21.15.17:0/1572457374 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40cb070 0x7fdfc40cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.034+0000 7fdfc9661640 1 -- 172.21.15.17:0/1572457374 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40cb070 msgr2=0x7fdfc40cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.034+0000 7fdfc9661640 1 --2- 172.21.15.17:0/1572457374 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40cb070 0x7fdfc40cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.034+0000 7fdfc9661640 1 -- 172.21.15.17:0/1572457374 >> v1:172.21.15.142:6789/0 conn(0x7fdfc40b0b10 legacy=0x7fdfc415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.034+0000 7fdfc9661640 1 -- 172.21.15.17:0/1572457374 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40718a0 con 0x7fdfc41587e0 2023-08-09T12:47:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.035+0000 7fdfc9661640 1 --2- 172.21.15.17:0/1572457374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc4070f00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b4290 tx=0x7fdfc002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c58c340bd9322ee server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:01.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.035+0000 7fdfbbfff640 1 -- 172.21.15.17:0/1572457374 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc002ca80 con 0x7fdfc41587e0 2023-08-09T12:47:01.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.035+0000 7fdfbbfff640 1 -- 172.21.15.17:0/1572457374 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc002cbe0 con 0x7fdfc41587e0 2023-08-09T12:47:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.035+0000 7fdfbbfff640 1 -- 172.21.15.17:0/1572457374 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc00343f0 con 0x7fdfc41587e0 2023-08-09T12:47:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.036+0000 7fdfca663640 1 -- 172.21.15.17:0/1572457374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 msgr2=0x7fdfc4070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.036+0000 7fdfca663640 1 --2- 172.21.15.17:0/1572457374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc4070f00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b4290 tx=0x7fdfc002bee0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.036+0000 7fdfca663640 1 -- 172.21.15.17:0/1572457374 shutdown_connections 2023-08-09T12:47:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.036+0000 7fdfca663640 1 --2- 172.21.15.17:0/1572457374 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40cb070 0x7fdfc40cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.036+0000 7fdfca663640 1 --2- 172.21.15.17:0/1572457374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc4070f00 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.036+0000 7fdfca663640 1 -- 172.21.15.17:0/1572457374 >> 172.21.15.17:0/1572457374 conn(0x7fdfc40b1d50 msgr2=0x7fdfc406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:01.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.036+0000 7fdfca663640 1 -- 172.21.15.17:0/1572457374 shutdown_connections 2023-08-09T12:47:01.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.036+0000 7fdfca663640 1 -- 172.21.15.17:0/1572457374 wait complete. 2023-08-09T12:47:01.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.038+0000 7fdfca663640 1 Processor -- start 2023-08-09T12:47:01.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.038+0000 7fdfca663640 1 -- start start 2023-08-09T12:47:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.039+0000 7fdfca663640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc40b0b10 0x7fdfc4151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.039+0000 7fdfca663640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc40cb070 0x7fdfc41f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfca663640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc41f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfca663640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc415de00 con 0x7fdfc41587e0 2023-08-09T12:47:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfca663640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc415f3b0 con 0x7fdfc40cb070 2023-08-09T12:47:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfca663640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc415d040 con 0x7fdfc40b0b10 2023-08-09T12:47:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9e62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc41f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9e62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc41f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54096/0 (socket says 172.21.15.17:54096) 2023-08-09T12:47:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9e62640 1 -- 172.21.15.17:0/2449744887 learned_addr learned my addr 172.21.15.17:0/2449744887 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9661640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc40b0b10 0x7fdfc4151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc8e60640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc40cb070 0x7fdfc41f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9e62640 1 -- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc40b0b10 msgr2=0x7fdfc4151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9e62640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc40b0b10 0x7fdfc4151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9e62640 1 -- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc40cb070 msgr2=0x7fdfc41f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9e62640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc40cb070 0x7fdfc41f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.040+0000 7fdfc9e62640 1 -- 172.21.15.17:0/2449744887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009b30 con 0x7fdfc41587e0 2023-08-09T12:47:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.041+0000 7fdfc9e62640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc41f66c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00d800 tx=0x7fdfbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.041+0000 7fdfb9ffb640 1 -- 172.21.15.17:0/2449744887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00b6c0 con 0x7fdfc41587e0 2023-08-09T12:47:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.041+0000 7fdfb9ffb640 1 -- 172.21.15.17:0/2449744887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc00b840 con 0x7fdfc41587e0 2023-08-09T12:47:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.041+0000 7fdfb9ffb640 1 -- 172.21.15.17:0/2449744887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00bbf0 con 0x7fdfc41587e0 2023-08-09T12:47:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.041+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc415d320 con 0x7fdfc41587e0 2023-08-09T12:47:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.041+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc415d8e0 con 0x7fdfc41587e0 2023-08-09T12:47:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.042+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc415ab90 con 0x7fdfc41587e0 2023-08-09T12:47:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.043+0000 7fdfb9ffb640 1 -- 172.21.15.17:0/2449744887 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdfbc00bd50 con 0x7fdfc41587e0 2023-08-09T12:47:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.044+0000 7fdfb9ffb640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdfa806a050 0x7fdfa806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.044+0000 7fdfb9ffb640 1 -- 172.21.15.17:0/2449744887 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfbc088b80 con 0x7fdfc41587e0 2023-08-09T12:47:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.045+0000 7fdfc9661640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdfa806a050 0x7fdfa806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.046+0000 7fdfc9661640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdfa806a050 0x7fdfa806c510 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0035000 tx=0x7fdfc0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:01.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.049+0000 7fdfb9ffb640 1 -- 172.21.15.17:0/2449744887 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdfbc0541d0 con 0x7fdfc41587e0 2023-08-09T12:47:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.281+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfc406fa10 con 0x7fdfc41587e0 2023-08-09T12:47:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.282+0000 7fdfb9ffb640 1 -- 172.21.15.17:0/2449744887 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4880 (secure 0 0 0) 0x7fdfc406fa10 con 0x7fdfc41587e0 2023-08-09T12:47:01.285 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:01.286 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:46:54.580315+0000","modified":"2023-08-09T12:46:58.167844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1719182807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1719182807},{"type":"v1","addr":"172.21.15.17:6835","nonce":1719182807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-09T12:47:01.286 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 59 2023-08-09T12:47:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.284+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdfa806a050 msgr2=0x7fdfa806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.284+0000 7fdfca663640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdfa806a050 0x7fdfa806c510 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0035000 tx=0x7fdfc0030000 comp rx=0 tx=0).stop 2023-08-09T12:47:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.284+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 msgr2=0x7fdfc41f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.284+0000 7fdfca663640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc41f66c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00d800 tx=0x7fdfbc00dcc0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.285+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 shutdown_connections 2023-08-09T12:47:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.285+0000 7fdfca663640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdfa806a050 0x7fdfa806c510 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.285+0000 7fdfca663640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfc41587e0 0x7fdfc41f66c0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.285+0000 7fdfca663640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc40cb070 0x7fdfc41f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.285+0000 7fdfca663640 1 --2- 172.21.15.17:0/2449744887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc40b0b10 0x7fdfc4151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.285+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 >> 172.21.15.17:0/2449744887 conn(0x7fdfc40b1d50 msgr2=0x7fdfc40b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:01.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.285+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 shutdown_connections 2023-08-09T12:47:01.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.285+0000 7fdfca663640 1 -- 172.21.15.17:0/2449744887 wait complete. 2023-08-09T12:47:01.709 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:46:54.580315+0000', 'modified': '2023-08-09T12:46:58.167844+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7545': {'gid': 7545, 'name': 'a', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/1719182807', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 1719182807}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 1719182807}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:47:01.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:47:01.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-09T12:47:01.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.956+0000 7fe7240ee640 1 Processor -- start 2023-08-09T12:47:01.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.956+0000 7fe7240ee640 1 -- start start 2023-08-09T12:47:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe7240ee640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71c0adc40 0x7fe71c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe7240ee640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe71c0b3b40 0x7fe71c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe7240ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 0x7fe71c15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe7240ee640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0ae020 con 0x7fe71c0adc40 2023-08-09T12:47:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe7240ee640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0b2250 con 0x7fe71c0b3b40 2023-08-09T12:47:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe7240ee640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0b2530 con 0x7fe71c15e8f0 2023-08-09T12:47:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe721e8a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71c0adc40 0x7fe71c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe721e8a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71c0adc40 0x7fe71c06c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54106/0 (socket says 172.21.15.17:54106) 2023-08-09T12:47:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.958+0000 7fe721e8a640 1 -- 172.21.15.17:0/3479456028 learned_addr learned my addr 172.21.15.17:0/3479456028 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.959+0000 7fe721e8a640 1 -- 172.21.15.17:0/3479456028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 msgr2=0x7fe71c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.959+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3479456028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 0x7fe71c15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.959+0000 7fe721e8a640 1 -- 172.21.15.17:0/3479456028 >> v2:172.21.15.142:3300/0 conn(0x7fe71c0b3b40 msgr2=0x7fe71c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.959+0000 7fe721689640 1 --2- 172.21.15.17:0/3479456028 >> v2:172.21.15.142:3300/0 conn(0x7fe71c0b3b40 0x7fe71c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.959+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3479456028 >> v2:172.21.15.142:3300/0 conn(0x7fe71c0b3b40 0x7fe71c0b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.959+0000 7fe721e8a640 1 -- 172.21.15.17:0/3479456028 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c06fe80 con 0x7fe71c0adc40 2023-08-09T12:47:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.960+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3479456028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0adc40 0x7fe71c06c280 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0b48a0 tx=0x7fe71802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4613000dfa867c86 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.960+0000 7fe720e88640 1 -- 172.21.15.17:0/3479456028 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718031870 con 0x7fe71c0adc40 2023-08-09T12:47:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.960+0000 7fe720e88640 1 -- 172.21.15.17:0/3479456028 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180319d0 con 0x7fe71c0adc40 2023-08-09T12:47:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.960+0000 7fe720e88640 1 -- 172.21.15.17:0/3479456028 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718031d60 con 0x7fe71c0adc40 2023-08-09T12:47:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 -- 172.21.15.17:0/3479456028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0adc40 msgr2=0x7fe71c06c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3479456028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0adc40 0x7fe71c06c280 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0b48a0 tx=0x7fe71802b910 comp rx=0 tx=0).stop 2023-08-09T12:47:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 -- 172.21.15.17:0/3479456028 shutdown_connections 2023-08-09T12:47:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3479456028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 0x7fe71c15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3479456028 >> v2:172.21.15.142:3300/0 conn(0x7fe71c0b3b40 0x7fe71c0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3479456028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0adc40 0x7fe71c06c280 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 -- 172.21.15.17:0/3479456028 >> 172.21.15.17:0/3479456028 conn(0x7fe71c0cb1b0 msgr2=0x7fe71c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 -- 172.21.15.17:0/3479456028 shutdown_connections 2023-08-09T12:47:01.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.961+0000 7fe7240ee640 1 -- 172.21.15.17:0/3479456028 wait complete. 2023-08-09T12:47:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.963+0000 7fe7240ee640 1 Processor -- start 2023-08-09T12:47:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.963+0000 7fe7240ee640 1 -- start start 2023-08-09T12:47:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe7240ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe71c0adc40 0x7fe71c1f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe7240ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0b3b40 0x7fe71c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe7240ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 0x7fe71c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe7240ee640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c1f6ee0 con 0x7fe71c0b3b40 2023-08-09T12:47:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe7240ee640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0c7360 con 0x7fe71c0adc40 2023-08-09T12:47:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe7240ee640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0c7640 con 0x7fe71c15e8f0 2023-08-09T12:47:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe721689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0b3b40 0x7fe71c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe721689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0b3b40 0x7fe71c0c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54120/0 (socket says 172.21.15.17:54120) 2023-08-09T12:47:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.964+0000 7fe721689640 1 -- 172.21.15.17:0/3889422106 learned_addr learned my addr 172.21.15.17:0/3889422106 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe71c0adc40 0x7fe71c1f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe721689640 1 -- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 msgr2=0x7fe71c151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe72268b640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 0x7fe71c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe721689640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 0x7fe71c151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe721689640 1 -- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe71c0adc40 msgr2=0x7fe71c1f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe721689640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe71c0adc40 0x7fe71c1f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe721689640 1 -- 172.21.15.17:0/3889422106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7180094d0 con 0x7fe71c0b3b40 2023-08-09T12:47:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe721689640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0b3b40 0x7fe71c0c8400 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c7f0 tx=0x7fe70c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe7127fc640 1 -- 172.21.15.17:0/3889422106 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c007820 con 0x7fe71c0b3b40 2023-08-09T12:47:01.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe7127fc640 1 -- 172.21.15.17:0/3889422106 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c007980 con 0x7fe71c0b3b40 2023-08-09T12:47:01.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.965+0000 7fe7127fc640 1 -- 172.21.15.17:0/3889422106 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c007d30 con 0x7fe71c0b3b40 2023-08-09T12:47:01.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.966+0000 7fe7240ee640 1 -- 172.21.15.17:0/3889422106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c0c7920 con 0x7fe71c0b3b40 2023-08-09T12:47:01.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.966+0000 7fe7240ee640 1 -- 172.21.15.17:0/3889422106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c0c7ee0 con 0x7fe71c0b3b40 2023-08-09T12:47:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.968+0000 7fe7127fc640 1 -- 172.21.15.17:0/3889422106 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe70c0113f0 con 0x7fe71c0b3b40 2023-08-09T12:47:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.969+0000 7fe7127fc640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe70006a080 0x7fe70006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.969+0000 7fe7127fc640 1 -- 172.21.15.17:0/3889422106 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe70c0884f0 con 0x7fe71c0b3b40 2023-08-09T12:47:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.970+0000 7fe726c56740 1 Processor -- start 2023-08-09T12:47:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.970+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe70006a080 0x7fe70006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.970+0000 7fe726c56740 1 -- start start 2023-08-09T12:47:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe726c56740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 0x56216a74f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe70006a080 0x7fe70006c540 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe718036000 tx=0x7fe71803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:01.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe726c56740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a71ebd0 0x56216a74bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe726c56740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a74c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe726c56740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216a6908f0 con 0x56216a71ebd0 2023-08-09T12:47:01.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe726c56740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216a68dfe0 con 0x56216a7227d0 2023-08-09T12:47:01.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe726c56740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56216a6898d0 con 0x56216a74ec50 2023-08-09T12:47:01.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe721689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a71ebd0 0x56216a74bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe721689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a71ebd0 0x56216a74bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54134/0 (socket says 172.21.15.17:54134) 2023-08-09T12:47:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.971+0000 7fe721689640 1 -- 172.21.15.17:0/1005363640 learned_addr learned my addr 172.21.15.17:0/1005363640 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe721e8a640 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 0x56216a74f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe72268b640 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a74c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe721689640 1 -- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 msgr2=0x56216a74f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe721689640 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 0x56216a74f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe721689640 1 -- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 msgr2=0x56216a74c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe721689640 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a74c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe721689640 1 -- 172.21.15.17:0/1005363640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56216a642ac0 con 0x56216a71ebd0 2023-08-09T12:47:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe72268b640 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a74c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe721689640 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a71ebd0 0x56216a74bec0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe70c053d90 tx=0x7fe70c057f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5131e31fffd06f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe6ff7fe640 1 -- 172.21.15.17:0/1005363640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c05f5a0 con 0x56216a71ebd0 2023-08-09T12:47:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe6ff7fe640 1 -- 172.21.15.17:0/1005363640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c055c30 con 0x56216a71ebd0 2023-08-09T12:47:01.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.972+0000 7fe6ff7fe640 1 -- 172.21.15.17:0/1005363640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c05f110 con 0x56216a71ebd0 2023-08-09T12:47:01.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.973+0000 7fe726c56740 1 -- 172.21.15.17:0/1005363640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a71ebd0 msgr2=0x56216a74bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.973+0000 7fe726c56740 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a71ebd0 0x56216a74bec0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe70c053d90 tx=0x7fe70c057f20 comp rx=0 tx=0).stop 2023-08-09T12:47:01.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.973+0000 7fe726c56740 1 -- 172.21.15.17:0/1005363640 shutdown_connections 2023-08-09T12:47:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.973+0000 7fe726c56740 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a74c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.973+0000 7fe726c56740 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a71ebd0 0x56216a74bec0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.973+0000 7fe726c56740 1 --2- 172.21.15.17:0/1005363640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 0x56216a74f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.973+0000 7fe726c56740 1 -- 172.21.15.17:0/1005363640 >> 172.21.15.17:0/1005363640 conn(0x56216a720ee0 msgr2=0x56216a769a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.974+0000 7fe726c56740 1 -- 172.21.15.17:0/1005363640 shutdown_connections 2023-08-09T12:47:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.974+0000 7fe726c56740 1 -- 172.21.15.17:0/1005363640 wait complete. 2023-08-09T12:47:01.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.974+0000 7fe726c56740 1 -- start start 2023-08-09T12:47:01.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.975+0000 7fe726c56740 1 Processor -- start 2023-08-09T12:47:01.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.975+0000 7fe726c56740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a733360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe726c56740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 0x56216a7477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe726c56740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a751720 0x56216a751ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe726c56740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216a629d40 con 0x56216a751720 2023-08-09T12:47:01.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe726c56740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216a6299e0 con 0x56216a7227d0 2023-08-09T12:47:01.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe726c56740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56216a3eff20 con 0x56216a74ec50 2023-08-09T12:47:01.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe726c56740 10 client.0 _ll_register_callbacks cb 0x56216a642160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:47:01.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe72268b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a751720 0x56216a751ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe72268b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a751720 0x56216a751ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54148/0 (socket says 172.21.15.17:54148) 2023-08-09T12:47:01.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe72268b640 1 -- 172.21.15.17:0/2173056218 learned_addr learned my addr 172.21.15.17:0/2173056218 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:01.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe721689640 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 0x56216a7477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe721e8a640 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a733360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe72268b640 1 -- 172.21.15.17:0/2173056218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 msgr2=0x56216a7477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:01.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe72268b640 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 0x56216a7477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe72268b640 1 -- 172.21.15.17:0/2173056218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 msgr2=0x56216a733360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:01.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe72268b640 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a733360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.976+0000 7fe72268b640 1 -- 172.21.15.17:0/2173056218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c0c7ee0 con 0x56216a751720 2023-08-09T12:47:01.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.977+0000 7fe72268b640 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a751720 0x56216a751ba0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe71400d8d0 tx=0x7fe71400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ea3fee76703abe server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:01.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.977+0000 7fe6fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:47:01.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.977+0000 7fe6fcff9640 1 -- 172.21.15.17:0/2173056218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400bb70 con 0x56216a751720 2023-08-09T12:47:01.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.977+0000 7fe6fcff9640 1 -- 172.21.15.17:0/2173056218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe714007e30 con 0x56216a751720 2023-08-09T12:47:01.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.977+0000 7fe726c56740 1 -- 172.21.15.17:0/2173056218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56216a661500 con 0x56216a751720 2023-08-09T12:47:01.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.977+0000 7fe6fcff9640 1 -- 172.21.15.17:0/2173056218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe71400bcd0 con 0x56216a751720 2023-08-09T12:47:01.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.977+0000 7fe726c56740 10 client.7695 fetch_fsmap learned FSMap version 59 2023-08-09T12:47:01.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.977+0000 7fe726c56740 1 -- 172.21.15.17:0/2173056218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x56216a687f50 con 0x56216a751720 2023-08-09T12:47:01.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe6fcff9640 1 -- 172.21.15.17:0/2173056218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56216a661500 con 0x56216a751720 2023-08-09T12:47:01.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe6fcff9640 1 -- 172.21.15.17:0/2173056218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe714017020 con 0x56216a751720 2023-08-09T12:47:01.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe726c56740 10 client.7695 fetch_fsmap finished waiting for FSMap version 59 2023-08-09T12:47:01.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe726c56740 10 client.7695 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:47:01.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe726c56740 20 client.7695 populate_metadata read hostname 'smithi017' 2023-08-09T12:47:01.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe726c56740 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] conn(0x56216a735890 0x56216a735c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:01.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe726c56740 4 client.7695 mds_command: new command op to 7545 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:47:01.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe726c56740 1 -- 172.21.15.17:0/2173056218 --> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56216a65ebc0 con 0x56216a735890 2023-08-09T12:47:01.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.978+0000 7fe721e8a640 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] conn(0x56216a735890 0x56216a735c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:01.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.979+0000 7fe721e8a640 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] conn(0x56216a735890 0x56216a735c70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa889b61b3028acc server_cookie=7020d7c837eb7312 in_seq=0 out_seq=0 2023-08-09T12:47:01.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.979+0000 7fe6fcff9640 10 client.7695 ms_handle_connect on v2:172.21.15.17:6833/1719182807 2023-08-09T12:47:01.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe6fcff9640 1 -- 172.21.15.17:0/2173056218 <== mds.0 v2:172.21.15.17:6833/1719182807 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56216a65ebc0 con 0x56216a735890 2023-08-09T12:47:01.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe6fcff9640 10 client.7695 handle_command_reply: tid=0 2023-08-09T12:47:01.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 client.7695 shutdown 2023-08-09T12:47:01.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 -- 172.21.15.17:0/2173056218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a751720 msgr2=0x56216a751ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:01.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a751720 0x56216a751ba0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe71400d8d0 tx=0x7fe71400dd90 comp rx=0 tx=0).stop 2023-08-09T12:47:01.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 -- 172.21.15.17:0/2173056218 shutdown_connections 2023-08-09T12:47:01.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a751720 0x56216a751ba0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:01.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] conn(0x56216a735890 0x56216a735c70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a74ec50 0x56216a7477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 --2- 172.21.15.17:0/2173056218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a733360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe6fcff9640 0 client.7695 ms_handle_reset on v2:172.21.15.17:6833/1719182807 2023-08-09T12:47:02.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 -- 172.21.15.17:0/2173056218 >> 172.21.15.17:0/2173056218 conn(0x56216a71ebd0 msgr2=0x56216a752860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:02.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 -- 172.21.15.17:0/2173056218 shutdown_connections 2023-08-09T12:47:02.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.980+0000 7fe726c56740 1 -- 172.21.15.17:0/2173056218 wait complete. 2023-08-09T12:47:02.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.981+0000 7fe726c56740 20 client.7695 trim_cache size 0 max 16384 2023-08-09T12:47:02.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.997+0000 7fe726c56740 1 Processor -- start 2023-08-09T12:47:02.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.997+0000 7fe726c56740 1 -- start start 2023-08-09T12:47:02.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.998+0000 7fe726c56740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a7227d0 0x56216a738cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.998+0000 7fe726c56740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a739200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.998+0000 7fe726c56740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a751720 0x56216a7521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.998+0000 7fe726c56740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216a744700 con 0x56216a74ec50 2023-08-09T12:47:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.998+0000 7fe726c56740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216a76d080 con 0x56216a751720 2023-08-09T12:47:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.998+0000 7fe726c56740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56216a60f2d0 con 0x56216a7227d0 2023-08-09T12:47:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a739200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a739200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54164/0 (socket says 172.21.15.17:54164) 2023-08-09T12:47:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721689640 1 -- 172.21.15.17:0/3136556872 learned_addr learned my addr 172.21.15.17:0/3136556872 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a7227d0 0x56216a738cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe72268b640 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a751720 0x56216a7521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721689640 1 -- 172.21.15.17:0/3136556872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a7227d0 msgr2=0x56216a738cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:02.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721689640 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a7227d0 0x56216a738cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721689640 1 -- 172.21.15.17:0/3136556872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a751720 msgr2=0x56216a7521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:02.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721689640 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a751720 0x56216a7521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:01.999+0000 7fe721689640 1 -- 172.21.15.17:0/3136556872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56216a6bb300 con 0x56216a74ec50 2023-08-09T12:47:02.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.000+0000 7fe721689640 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a739200 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0884a0 tx=0x7fe70c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6618f7b24a2f7d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:02.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.000+0000 7fe6fffff640 1 -- 172.21.15.17:0/3136556872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c055c30 con 0x56216a74ec50 2023-08-09T12:47:02.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.000+0000 7fe6fffff640 1 -- 172.21.15.17:0/3136556872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c053fa0 con 0x56216a74ec50 2023-08-09T12:47:02.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.000+0000 7fe6fffff640 1 -- 172.21.15.17:0/3136556872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c05f350 con 0x56216a74ec50 2023-08-09T12:47:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.000+0000 7fe726c56740 1 -- 172.21.15.17:0/3136556872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 msgr2=0x56216a739200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.000+0000 7fe726c56740 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a739200 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0884a0 tx=0x7fe70c01f000 comp rx=0 tx=0).stop 2023-08-09T12:47:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.001+0000 7fe726c56740 1 -- 172.21.15.17:0/3136556872 shutdown_connections 2023-08-09T12:47:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.001+0000 7fe726c56740 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a751720 0x56216a7521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.001+0000 7fe726c56740 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a739200 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.001+0000 7fe726c56740 1 --2- 172.21.15.17:0/3136556872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a7227d0 0x56216a738cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.001+0000 7fe726c56740 1 -- 172.21.15.17:0/3136556872 >> 172.21.15.17:0/3136556872 conn(0x56216a71ebd0 msgr2=0x56216a71dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.001+0000 7fe726c56740 1 -- 172.21.15.17:0/3136556872 shutdown_connections 2023-08-09T12:47:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.001+0000 7fe726c56740 1 -- 172.21.15.17:0/3136556872 wait complete. 2023-08-09T12:47:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.001+0000 7fe726c56740 1 -- start start 2023-08-09T12:47:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.002+0000 7fe726c56740 1 Processor -- start 2023-08-09T12:47:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe726c56740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a7d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe726c56740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a732e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe726c56740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a751720 0x56216a733350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe726c56740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216a76a3c0 con 0x56216a74ec50 2023-08-09T12:47:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe726c56740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216a76a5d0 con 0x56216a7227d0 2023-08-09T12:47:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe726c56740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56216a738050 con 0x56216a751720 2023-08-09T12:47:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe726c56740 10 client.0 _ll_register_callbacks cb 0x56216a71e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:47:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a732e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a732e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54166/0 (socket says 172.21.15.17:54166) 2023-08-09T12:47:02.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721689640 1 -- 172.21.15.17:0/3877846557 learned_addr learned my addr 172.21.15.17:0/3877846557 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:02.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a7d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721689640 1 -- 172.21.15.17:0/3877846557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a751720 msgr2=0x56216a733350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:02.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721689640 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a751720 0x56216a733350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721689640 1 -- 172.21.15.17:0/3877846557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 msgr2=0x56216a7d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:02.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721689640 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a7d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.003+0000 7fe721689640 1 -- 172.21.15.17:0/3877846557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56216a642ac0 con 0x56216a74ec50 2023-08-09T12:47:02.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe721689640 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a732e10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fe70c057820 tx=0x7fe70c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce79a4ac6e7143a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:02.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe6fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:47:02.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe6fcff9640 1 -- 172.21.15.17:0/3877846557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c055c30 con 0x56216a74ec50 2023-08-09T12:47:02.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe6fcff9640 1 -- 172.21.15.17:0/3877846557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe70c054110 con 0x56216a74ec50 2023-08-09T12:47:02.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe726c56740 1 -- 172.21.15.17:0/3877846557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56216a6b1800 con 0x56216a74ec50 2023-08-09T12:47:02.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe6fcff9640 1 -- 172.21.15.17:0/3877846557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe70c053680 con 0x56216a74ec50 2023-08-09T12:47:02.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe726c56740 10 client.7701 fetch_fsmap learned FSMap version 59 2023-08-09T12:47:02.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe726c56740 1 -- 172.21.15.17:0/3877846557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x56216a628a10 con 0x56216a74ec50 2023-08-09T12:47:02.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe6fcff9640 1 -- 172.21.15.17:0/3877846557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56216a6b1800 con 0x56216a74ec50 2023-08-09T12:47:02.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.004+0000 7fe6fcff9640 1 -- 172.21.15.17:0/3877846557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe70c0537e0 con 0x56216a74ec50 2023-08-09T12:47:02.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe726c56740 10 client.7701 fetch_fsmap finished waiting for FSMap version 59 2023-08-09T12:47:02.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe726c56740 10 client.7701 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:47:02.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe726c56740 20 client.7701 populate_metadata read hostname 'smithi017' 2023-08-09T12:47:02.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe726c56740 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] conn(0x56216a7243b0 0x56216a724790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe726c56740 4 client.7701 mds_command: new command op to 7545 tid=0[{"prefix": "status"}] 2023-08-09T12:47:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe726c56740 1 -- 172.21.15.17:0/3877846557 --> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56216a6828b0 con 0x56216a7243b0 2023-08-09T12:47:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] conn(0x56216a7243b0 0x56216a724790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe721e8a640 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] conn(0x56216a7243b0 0x56216a724790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c9d9529a8e36436 server_cookie=a34e00d89efdbcc8 in_seq=0 out_seq=0 2023-08-09T12:47:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.005+0000 7fe6fcff9640 10 client.7701 ms_handle_connect on v2:172.21.15.17:6833/1719182807 2023-08-09T12:47:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe6fcff9640 1 -- 172.21.15.17:0/3877846557 <== mds.0 v2:172.21.15.17:6833/1719182807 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x56216a6828b0 con 0x56216a7243b0 2023-08-09T12:47:02.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe6fcff9640 10 client.7701 handle_command_reply: tid=0 2023-08-09T12:47:02.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 client.7701 shutdown 2023-08-09T12:47:02.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 -- 172.21.15.17:0/3877846557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 msgr2=0x56216a732e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a732e10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fe70c057820 tx=0x7fe70c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 -- 172.21.15.17:0/3877846557 shutdown_connections 2023-08-09T12:47:02.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.17:6833/1719182807,v1:172.21.15.17:6835/1719182807] conn(0x56216a7243b0 0x56216a724790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56216a751720 0x56216a733350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56216a74ec50 0x56216a732e10 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 --2- 172.21.15.17:0/3877846557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a7227d0 0x56216a7d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe6fcff9640 0 client.7701 ms_handle_reset on v2:172.21.15.17:6833/1719182807 2023-08-09T12:47:02.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 -- 172.21.15.17:0/3877846557 >> 172.21.15.17:0/3877846557 conn(0x56216a71ebd0 msgr2=0x56216a722ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:02.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 -- 172.21.15.17:0/3877846557 shutdown_connections 2023-08-09T12:47:02.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 1 -- 172.21.15.17:0/3877846557 wait complete. 2023-08-09T12:47:02.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.006+0000 7fe726c56740 20 client.7701 trim_cache size 0 max 16384 2023-08-09T12:47:02.025 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:47:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:47:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:47:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7545, 2023-08-09T12:47:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:47:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:47:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:47:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.8681832729999996, 2023-08-09T12:47:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 59, 2023-08-09T12:47:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 130, 2023-08-09T12:47:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 130, 2023-08-09T12:47:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 13.814418459000001 2023-08-09T12:47:02.028 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:47:02.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 -- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe70006a080 msgr2=0x7fe70006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe70006a080 0x7fe70006c540 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe718036000 tx=0x7fe71803c040 comp rx=0 tx=0).stop 2023-08-09T12:47:02.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 -- 172.21.15.17:0/3889422106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0b3b40 msgr2=0x7fe71c0c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0b3b40 0x7fe71c0c8400 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c7f0 tx=0x7fe70c00ccb0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 -- 172.21.15.17:0/3889422106 shutdown_connections 2023-08-09T12:47:02.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe70006a080 0x7fe70006c540 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe71c15e8f0 0x7fe71c151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe71c0b3b40 0x7fe71c0c8400 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 --2- 172.21.15.17:0/3889422106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe71c0adc40 0x7fe71c1f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 -- 172.21.15.17:0/3889422106 >> 172.21.15.17:0/3889422106 conn(0x7fe71c0cb1b0 msgr2=0x7fe71c15c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:02.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 -- 172.21.15.17:0/3889422106 shutdown_connections 2023-08-09T12:47:02.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.007+0000 7fe7240ee640 1 -- 172.21.15.17:0/3889422106 wait complete. 2023-08-09T12:47:02.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:47:02.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.265+0000 7f898afe1640 1 Processor -- start 2023-08-09T12:47:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.265+0000 7f898afe1640 1 -- start start 2023-08-09T12:47:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.267+0000 7f898afe1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89840adab0 0x7f89840b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.267+0000 7f898afe1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f89840b23b0 0x7f89840b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.267+0000 7f898afe1640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898406ff20 con 0x7f89840b4080 2023-08-09T12:47:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.267+0000 7f898afe1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8984070ba0 con 0x7f89840b23b0 2023-08-09T12:47:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.267+0000 7f898afe1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8984070fc0 con 0x7f89840adab0 2023-08-09T12:47:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.268+0000 7f898957e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f89840b4080 0x7f898415e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45820/0 (socket says 172.21.15.17:45820) 2023-08-09T12:47:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.268+0000 7f898957e640 1 -- 172.21.15.17:0/1231264872 learned_addr learned my addr 172.21.15.17:0/1231264872 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.268+0000 7f8988d7d640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89840adab0 0x7f89840b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.268+0000 7f8983fff640 1 --2- 172.21.15.17:0/1231264872 >> v2:172.21.15.142:3300/0 conn(0x7f89840b23b0 0x7f89840b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.268+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716342073 0 0) 0x7f898406ff20 con 0x7f89840b4080 2023-08-09T12:47:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.268+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8974003520 con 0x7f89840b4080 2023-08-09T12:47:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1423755664 0 0) 0x7f8974003520 con 0x7f89840b4080 2023-08-09T12:47:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89840adab0 msgr2=0x7f89840b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89840adab0 0x7f89840b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 >> v2:172.21.15.142:3300/0 conn(0x7f89840b23b0 msgr2=0x7f89840b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 --2- 172.21.15.17:0/1231264872 >> v2:172.21.15.142:3300/0 conn(0x7f89840b23b0 0x7f89840b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984070200 con 0x7f89840b4080 2023-08-09T12:47:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f897c001a10 con 0x7f89840b4080 2023-08-09T12:47:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 >> v1:172.21.15.17:6789/0 conn(0x7f89840b4080 legacy=0x7f898415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89740039a0 0x7f8974003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89840adab0 0x7f89740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974004d00 0x7f8974005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984070ba0 con 0x7f89740039a0 2023-08-09T12:47:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984070fc0 con 0x7f8974004d00 2023-08-09T12:47:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897400b9b0 con 0x7f89840adab0 2023-08-09T12:47:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.269+0000 7f8988d7d640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89740039a0 0x7f8974003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.270+0000 7f8983fff640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89840adab0 0x7f89740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.270+0000 7f898957e640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974004d00 0x7f8974005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.270+0000 7f8988d7d640 1 -- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89840adab0 msgr2=0x7f89740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.270+0000 7f8988d7d640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89840adab0 0x7f89740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.270+0000 7f8988d7d640 1 -- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974004d00 msgr2=0x7f8974005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.270+0000 7f8988d7d640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974004d00 0x7f8974005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.270+0000 7f8988d7d640 1 -- 172.21.15.17:0/1231264872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974003520 con 0x7f89740039a0 2023-08-09T12:47:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.271+0000 7f8988d7d640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89740039a0 0x7f8974003dc0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f8978009ac0 tx=0x7f89740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70b3a646823bb9f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.271+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897802c6b0 con 0x7f89740039a0 2023-08-09T12:47:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.271+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897802c810 con 0x7f89740039a0 2023-08-09T12:47:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.271+0000 7f89837fe640 1 -- 172.21.15.17:0/1231264872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897802cba0 con 0x7f89740039a0 2023-08-09T12:47:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.272+0000 7f898afe1640 1 -- 172.21.15.17:0/1231264872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89740039a0 msgr2=0x7f8974003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.272+0000 7f898afe1640 1 --2- 172.21.15.17:0/1231264872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89740039a0 0x7f8974003dc0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f8978009ac0 tx=0x7f89740057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.272+0000 7f898957e640 1 -- 172.21.15.17:0/1231264872 reap_dead start 2023-08-09T12:47:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.272+0000 7f898afe1640 1 -- 172.21.15.17:0/1231264872 shutdown_connections 2023-08-09T12:47:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.272+0000 7f898afe1640 1 -- 172.21.15.17:0/1231264872 >> 172.21.15.17:0/1231264872 conn(0x7f89840cb1b0 msgr2=0x7f89840cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.272+0000 7f898afe1640 1 -- 172.21.15.17:0/1231264872 shutdown_connections 2023-08-09T12:47:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.272+0000 7f898afe1640 1 -- 172.21.15.17:0/1231264872 wait complete. 2023-08-09T12:47:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.274+0000 7f898afe1640 1 Processor -- start 2023-08-09T12:47:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.274+0000 7f898afe1640 1 -- start start 2023-08-09T12:47:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.275+0000 7f898afe1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740039a0 0x7f89841e88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.275+0000 7f898afe1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f898414a3a0 0x7f89841e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.275+0000 7f898afe1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898414a820 0x7f89840adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.275+0000 7f898afe1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89840c7750 con 0x7f898414a3a0 2023-08-09T12:47:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.275+0000 7f898afe1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89840c6b40 con 0x7f898414a820 2023-08-09T12:47:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.275+0000 7f898afe1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89840c6e20 con 0x7f89740039a0 2023-08-09T12:47:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f898414a3a0 0x7f89841e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f898414a3a0 0x7f89841e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54186/0 (socket says 172.21.15.17:54186) 2023-08-09T12:47:02.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 -- 172.21.15.17:0/2255750697 learned_addr learned my addr 172.21.15.17:0/2255750697 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:02.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8988d7d640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740039a0 0x7f89841e88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f898957e640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898414a820 0x7f89840adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 -- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740039a0 msgr2=0x7f89841e88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740039a0 0x7f89841e88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 -- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898414a820 msgr2=0x7f89840adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898414a820 0x7f89840adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 -- 172.21.15.17:0/2255750697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89840c7100 con 0x7f898414a3a0 2023-08-09T12:47:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f898957e640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898414a820 0x7f89840adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.276+0000 7f8983fff640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f898414a3a0 0x7f89841e3590 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f89700116d0 tx=0x7f8970011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.277+0000 7f89817fa640 1 -- 172.21.15.17:0/2255750697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000f9c0 con 0x7f898414a3a0 2023-08-09T12:47:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.277+0000 7f89817fa640 1 -- 172.21.15.17:0/2255750697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897000fb20 con 0x7f898414a3a0 2023-08-09T12:47:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.277+0000 7f89817fa640 1 -- 172.21.15.17:0/2255750697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000fe90 con 0x7f898414a3a0 2023-08-09T12:47:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.277+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89840c73e0 con 0x7f898414a3a0 2023-08-09T12:47:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.277+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89840c6780 con 0x7f898414a3a0 2023-08-09T12:47:02.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.278+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8984067a80 con 0x7f898414a3a0 2023-08-09T12:47:02.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.279+0000 7f89817fa640 1 -- 172.21.15.17:0/2255750697 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8970015460 con 0x7f898414a3a0 2023-08-09T12:47:02.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.280+0000 7f89817fa640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f896806a050 0x7f896806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.280+0000 7f89817fa640 1 -- 172.21.15.17:0/2255750697 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8970088eb0 con 0x7f898414a3a0 2023-08-09T12:47:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.281+0000 7f8988d7d640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f896806a050 0x7f896806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.282+0000 7f8988d7d640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f896806a050 0x7f896806c510 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8978036000 tx=0x7f8978030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:02.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.284+0000 7f89817fa640 1 -- 172.21.15.17:0/2255750697 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f89700545b0 con 0x7f898414a3a0 2023-08-09T12:47:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.517+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89840c7890 con 0x7f898414a3a0 2023-08-09T12:47:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.518+0000 7f89817fa640 1 -- 172.21.15.17:0/2255750697 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8970022020 con 0x7f898414a3a0 2023-08-09T12:47:02.522 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:47:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f896806a050 msgr2=0x7f896806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f896806a050 0x7f896806c510 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8978036000 tx=0x7f8978030000 comp rx=0 tx=0).stop 2023-08-09T12:47:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f898414a3a0 msgr2=0x7f89841e3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f898414a3a0 0x7f89841e3590 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f89700116d0 tx=0x7f8970011b90 comp rx=0 tx=0).stop 2023-08-09T12:47:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 shutdown_connections 2023-08-09T12:47:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f896806a050 0x7f896806c510 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f898414a820 0x7f89840adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f898414a3a0 0x7f89841e3590 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 --2- 172.21.15.17:0/2255750697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740039a0 0x7f89841e88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 >> 172.21.15.17:0/2255750697 conn(0x7f89840cb1b0 msgr2=0x7f89840aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:02.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 shutdown_connections 2023-08-09T12:47:02.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:02.521+0000 7f898afe1640 1 -- 172.21.15.17:0/2255750697 wait complete. 2023-08-09T12:47:02.543 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:47:02.544 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:47:02.544 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:47:02.544 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:47:02.545 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:02.545 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:47:02.546 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:47:02.546 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:47:02.546 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:47:02.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:02.547 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:47:02.601 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:47:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:47:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:47:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:47:02.602 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:02.602 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:02.602 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:02.602 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:47:02.602 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:02.602 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:02.602 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:47:02.602 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:47:02.603 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:02.603 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:47:02.603 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:47:02.603 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41757sec preferred_lft 41757sec 2023-08-09T12:47:02.603 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:47:02.603 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:02.603 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:02.604 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:02.604 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:47:02.604 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:47:02.604 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:02.604 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:47:02.604 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:02.604 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:47:02.604 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:02.605 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:47:02.605 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:47:02.605 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:47:02.605 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:02.605 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:47:02.605 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:47:02.605 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:47:02.605 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:02.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:02.607 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:47:02.704 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:47:02.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:02.709 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:47:02.767 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:47:02.767 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:47:02.768 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:47:02.768 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:47:02.768 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:47:02.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:02.769 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:47:02.769 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:47:02.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:47:02.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:47:02.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:47:02.771 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:47:02.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:02.982 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:47:03.042 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:47:03.042 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:47:03.043 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:47:03.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:03.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:47:03.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:47:03.154 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:03.209 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:47:03.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:47:03.210 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:03.265 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:47:03.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:03.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:47:03.419 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:47:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:47:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:47:03.443 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:47:03.443 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:47:03.443 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:47:03.444 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:47:03.444 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:47:03.470 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:47:03.470 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:47:03.470 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:47:03.470 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:47:03.471 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:47:03.471 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:47:03.471 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:47:03.471 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:47:03.475 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:47:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:47:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:47:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:47:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:47:03.480 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:47:03.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:03.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:03.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:03.574 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:47:03.645 INFO:teuthology.orchestra.run.smithi017.stdout:client6118 2023-08-09T12:47:03.646 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:03.646 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:03.704 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:47:03.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.928+0000 7f532359e640 1 Processor -- start 2023-08-09T12:47:03.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.928+0000 7f532359e640 1 -- start start 2023-08-09T12:47:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f532359e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53241587e0 0x7f5324070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f532359e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53240cb070 0x7f53240cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f532359e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53240cb9e0 con 0x7f53240b0b10 2023-08-09T12:47:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f532359e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532415beb0 con 0x7f53241587e0 2023-08-09T12:47:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f532359e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240715c0 con 0x7f53240cb070 2023-08-09T12:47:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f532259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53241587e0 0x7f5324070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:03.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f532259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53241587e0 0x7f5324070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54188/0 (socket says 172.21.15.17:54188) 2023-08-09T12:47:03.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f532259c640 1 -- 172.21.15.17:0/2959167953 learned_addr learned my addr 172.21.15.17:0/2959167953 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:03.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.930+0000 7f5322d9d640 1 --2- 172.21.15.17:0/2959167953 >> v2:172.21.15.142:3300/0 conn(0x7f53240cb070 0x7f53240cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:03.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.931+0000 7f532259c640 1 -- 172.21.15.17:0/2959167953 >> v2:172.21.15.142:3300/0 conn(0x7f53240cb070 msgr2=0x7f53240cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:03.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.931+0000 7f532259c640 1 --2- 172.21.15.17:0/2959167953 >> v2:172.21.15.142:3300/0 conn(0x7f53240cb070 0x7f53240cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:03.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.931+0000 7f532259c640 1 -- 172.21.15.17:0/2959167953 >> v1:172.21.15.142:6789/0 conn(0x7f53240b0b10 legacy=0x7f532415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:03.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.931+0000 7f532259c640 1 -- 172.21.15.17:0/2959167953 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240718a0 con 0x7f53241587e0 2023-08-09T12:47:03.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.932+0000 7f532259c640 1 --2- 172.21.15.17:0/2959167953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f5324070f00 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f53240b4290 tx=0x7f531402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9237833fac37d061 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:03.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.932+0000 7f532159a640 1 -- 172.21.15.17:0/2959167953 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314031870 con 0x7f53241587e0 2023-08-09T12:47:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.932+0000 7f532159a640 1 -- 172.21.15.17:0/2959167953 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53140319d0 con 0x7f53241587e0 2023-08-09T12:47:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.932+0000 7f532159a640 1 -- 172.21.15.17:0/2959167953 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314031d60 con 0x7f53241587e0 2023-08-09T12:47:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.933+0000 7f532359e640 1 -- 172.21.15.17:0/2959167953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 msgr2=0x7f5324070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.933+0000 7f532359e640 1 --2- 172.21.15.17:0/2959167953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f5324070f00 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f53240b4290 tx=0x7f531402b910 comp rx=0 tx=0).stop 2023-08-09T12:47:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.933+0000 7f532359e640 1 -- 172.21.15.17:0/2959167953 shutdown_connections 2023-08-09T12:47:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.933+0000 7f532359e640 1 --2- 172.21.15.17:0/2959167953 >> v2:172.21.15.142:3300/0 conn(0x7f53240cb070 0x7f53240cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.933+0000 7f532359e640 1 --2- 172.21.15.17:0/2959167953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f5324070f00 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.933+0000 7f532359e640 1 -- 172.21.15.17:0/2959167953 >> 172.21.15.17:0/2959167953 conn(0x7f53240b1d50 msgr2=0x7f532406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.933+0000 7f532359e640 1 -- 172.21.15.17:0/2959167953 shutdown_connections 2023-08-09T12:47:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.933+0000 7f532359e640 1 -- 172.21.15.17:0/2959167953 wait complete. 2023-08-09T12:47:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.935+0000 7f532359e640 1 Processor -- start 2023-08-09T12:47:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.935+0000 7f532359e640 1 -- start start 2023-08-09T12:47:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f532359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53240b0b10 0x7f532415e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f532359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240cb070 0x7f53240c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f532359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f53240c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f532359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53240c5d00 con 0x7f53241587e0 2023-08-09T12:47:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f532359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53240c5f10 con 0x7f53240b0b10 2023-08-09T12:47:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f532359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240c61f0 con 0x7f53240cb070 2023-08-09T12:47:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f5322d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f53240c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f5322d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f53240c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54204/0 (socket says 172.21.15.17:54204) 2023-08-09T12:47:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.936+0000 7f5322d9d640 1 -- 172.21.15.17:0/2935449628 learned_addr learned my addr 172.21.15.17:0/2935449628 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5322d9d640 1 -- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240cb070 msgr2=0x7f53240c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5322d9d640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240cb070 0x7f53240c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5322d9d640 1 -- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53240b0b10 msgr2=0x7f532415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f532259c640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53240b0b10 0x7f532415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5322d9d640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53240b0b10 0x7f532415e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5322d9d640 1 -- 172.21.15.17:0/2935449628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140094d0 con 0x7f53241587e0 2023-08-09T12:47:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5322d9d640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f53240c7920 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f531c007e40 tx=0x7f531c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5312ffd640 1 -- 172.21.15.17:0/2935449628 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c014620 con 0x7f53241587e0 2023-08-09T12:47:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5312ffd640 1 -- 172.21.15.17:0/2935449628 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00ee90 con 0x7f53241587e0 2023-08-09T12:47:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f5312ffd640 1 -- 172.21.15.17:0/2935449628 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0149e0 con 0x7f53241587e0 2023-08-09T12:47:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.937+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53240c64d0 con 0x7f53241587e0 2023-08-09T12:47:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.938+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53240c67b0 con 0x7f53241587e0 2023-08-09T12:47:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.939+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53240c2d30 con 0x7f53241587e0 2023-08-09T12:47:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.940+0000 7f5312ffd640 1 -- 172.21.15.17:0/2935449628 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f531c014b40 con 0x7f53241587e0 2023-08-09T12:47:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.941+0000 7f5312ffd640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.941+0000 7f5312ffd640 1 -- 172.21.15.17:0/2935449628 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f531c088ff0 con 0x7f53241587e0 2023-08-09T12:47:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.941+0000 7f532259c640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.943+0000 7f532259c640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5314036000 tx=0x7f531403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:03.946+0000 7f5312ffd640 1 -- 172.21.15.17:0/2935449628 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f531c0bb7b0 con 0x7f53241587e0 2023-08-09T12:47:04.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.178+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53240c3110 con 0x7f53241587e0 2023-08-09T12:47:04.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.179+0000 7f5312ffd640 1 -- 172.21.15.17:0/2935449628 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53240c3110 con 0x7f53241587e0 2023-08-09T12:47:04.182 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:47:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 msgr2=0x7f530406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5314036000 tx=0x7f531403c040 comp rx=0 tx=0).stop 2023-08-09T12:47:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 msgr2=0x7f53240c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f53240c7920 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f531c007e40 tx=0x7f531c00e4b0 comp rx=0 tx=0).stop 2023-08-09T12:47:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 shutdown_connections 2023-08-09T12:47:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f530406a050 0x7f530406c510 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53241587e0 0x7f53240c7920 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53240cb070 0x7f53240c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 --2- 172.21.15.17:0/2935449628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53240b0b10 0x7f532415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.181+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 >> 172.21.15.17:0/2935449628 conn(0x7f53240b1d50 msgr2=0x7f53240b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.182+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 shutdown_connections 2023-08-09T12:47:04.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:04.182+0000 7f532359e640 1 -- 172.21.15.17:0/2935449628 wait complete. 2023-08-09T12:47:04.204 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:47:04.205 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:47:04.205 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:47:04.206 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:47:04.206 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:04.206 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:47:04.206 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:47:04.207 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:47:04.207 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:47:04.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:04.208 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:47:04.270 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:47:04.270 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:47:04.270 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:47:04.270 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:04.271 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:47:04.271 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:04.271 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:04.271 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:04.271 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:47:04.271 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:04.271 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:47:04.272 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:04.272 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:47:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:47:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41744sec preferred_lft 41744sec 2023-08-09T12:47:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:47:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:04.273 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:47:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:47:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:04.274 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:47:04.274 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:04.274 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:47:04.274 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:47:04.274 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:47:04.274 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:04.275 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:47:04.275 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:47:04.275 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:47:04.275 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:04.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:04.277 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:47:04.369 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:47:04.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:04.373 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:47:04.429 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:47:04.431 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:47:04.432 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:47:04.432 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:47:04.432 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:47:04.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:04.434 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:47:04.434 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:47:04.435 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:47:04.435 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:47:04.436 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:47:04.436 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:47:04.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:04.614 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:47:04.661 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:47:04.662 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:47:04.662 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:47:04.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:04.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:47:04.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:47:04.804 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:04.860 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:47:04.861 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:47:04.861 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:04.904 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:47:04.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:04.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:47:05.088 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:47:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:47:05.089 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:47:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:47:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:47:05.110 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:47:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:47:05.111 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:47:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:47:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:47:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:47:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:47:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:47:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:47:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:47:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:47:05.138 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:47:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:47:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:47:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:47:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:47:05.144 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:47:05.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:05.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:05.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:05.237 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:47:05.296 INFO:teuthology.orchestra.run.smithi142.stdout:client7716 2023-08-09T12:47:05.297 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:47:05.297 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:05.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:05.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.592+0000 7f12801c8640 1 Processor -- start 2023-08-09T12:47:05.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.592+0000 7f12801c8640 1 -- start start 2023-08-09T12:47:05.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.594+0000 7f12801c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1278159d80 0x7f12780b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:05.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.594+0000 7f12801c8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12780ad810 0x7f1278070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:05.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.594+0000 7f12801c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 0x7f127806eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:05.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.594+0000 7f12801c8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1278070d50 con 0x7f12780ad810 2023-08-09T12:47:05.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.594+0000 7f12801c8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127815a160 con 0x7f1278159d80 2023-08-09T12:47:05.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.594+0000 7f12801c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12780b4630 con 0x7f12780708c0 2023-08-09T12:47:05.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127d763640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12780ad810 0x7f1278070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:05.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127d763640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f12780ad810 0x7f1278070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54210/0 (socket says 172.21.15.17:54210) 2023-08-09T12:47:05.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127d763640 1 -- 172.21.15.17:0/3203162972 learned_addr learned my addr 172.21.15.17:0/3203162972 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:05.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127e765640 1 --2- 172.21.15.17:0/3203162972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 0x7f127806eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:05.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127df64640 1 --2- 172.21.15.17:0/3203162972 >> v2:172.21.15.142:3300/0 conn(0x7f1278159d80 0x7f12780b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:05.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127d763640 1 -- 172.21.15.17:0/3203162972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 msgr2=0x7f127806eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:05.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127d763640 1 --2- 172.21.15.17:0/3203162972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 0x7f127806eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127d763640 1 -- 172.21.15.17:0/3203162972 >> v2:172.21.15.142:3300/0 conn(0x7f1278159d80 msgr2=0x7f12780b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:05.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127d763640 1 --2- 172.21.15.17:0/3203162972 >> v2:172.21.15.142:3300/0 conn(0x7f1278159d80 0x7f12780b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.595+0000 7f127d763640 1 -- 172.21.15.17:0/3203162972 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12780b3ab0 con 0x7f12780ad810 2023-08-09T12:47:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.596+0000 7f127d763640 1 --2- 172.21.15.17:0/3203162972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12780ad810 0x7f1278070380 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f12780cb110 tx=0x7f126802dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41879d28d6a07105 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.597+0000 7f127cf62640 1 -- 172.21.15.17:0/3203162972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268004230 con 0x7f12780ad810 2023-08-09T12:47:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.597+0000 7f127cf62640 1 -- 172.21.15.17:0/3203162972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268004390 con 0x7f12780ad810 2023-08-09T12:47:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.597+0000 7f127cf62640 1 -- 172.21.15.17:0/3203162972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126802f8a0 con 0x7f12780ad810 2023-08-09T12:47:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.597+0000 7f12801c8640 1 -- 172.21.15.17:0/3203162972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12780ad810 msgr2=0x7f1278070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:05.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.597+0000 7f12801c8640 1 --2- 172.21.15.17:0/3203162972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12780ad810 0x7f1278070380 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f12780cb110 tx=0x7f126802dae0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.598+0000 7f12801c8640 1 -- 172.21.15.17:0/3203162972 shutdown_connections 2023-08-09T12:47:05.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.598+0000 7f12801c8640 1 --2- 172.21.15.17:0/3203162972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 0x7f127806eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.598+0000 7f12801c8640 1 --2- 172.21.15.17:0/3203162972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12780ad810 0x7f1278070380 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.598+0000 7f12801c8640 1 --2- 172.21.15.17:0/3203162972 >> v2:172.21.15.142:3300/0 conn(0x7f1278159d80 0x7f12780b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.598+0000 7f12801c8640 1 -- 172.21.15.17:0/3203162972 >> 172.21.15.17:0/3203162972 conn(0x7f12780cb1b0 msgr2=0x7f12780cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:05.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.598+0000 7f12801c8640 1 -- 172.21.15.17:0/3203162972 shutdown_connections 2023-08-09T12:47:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.598+0000 7f12801c8640 1 -- 172.21.15.17:0/3203162972 wait complete. 2023-08-09T12:47:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.599+0000 7f12801c8640 1 Processor -- start 2023-08-09T12:47:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.600+0000 7f12801c8640 1 -- start start 2023-08-09T12:47:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.600+0000 7f12801c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 0x7f12781eba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f12801c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12780ad810 0x7f12781eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f12801c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1278159d80 0x7f1278157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f12801c8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12781ef400 con 0x7f1278159d80 2023-08-09T12:47:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f12801c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12780c2070 con 0x7f12780ad810 2023-08-09T12:47:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f12801c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12780ae720 con 0x7f12780708c0 2023-08-09T12:47:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127e765640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1278159d80 0x7f1278157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127e765640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1278159d80 0x7f1278157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54226/0 (socket says 172.21.15.17:54226) 2023-08-09T12:47:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127e765640 1 -- 172.21.15.17:0/1812525364 learned_addr learned my addr 172.21.15.17:0/1812525364 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127df64640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 0x7f12781eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127d763640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12780ad810 0x7f12781eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127e765640 1 -- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 msgr2=0x7f12781eba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127e765640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 0x7f12781eba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127e765640 1 -- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12780ad810 msgr2=0x7f12781eeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127e765640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12780ad810 0x7f12781eeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.601+0000 7f127e765640 1 -- 172.21.15.17:0/1812525364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268009460 con 0x7f1278159d80 2023-08-09T12:47:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.602+0000 7f127e765640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1278159d80 0x7f1278157a80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f127000eed0 tx=0x7f127000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.602+0000 7f126e7fc640 1 -- 172.21.15.17:0/1812525364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270010040 con 0x7f1278159d80 2023-08-09T12:47:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.602+0000 7f126e7fc640 1 -- 172.21.15.17:0/1812525364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1270014400 con 0x7f1278159d80 2023-08-09T12:47:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.602+0000 7f126e7fc640 1 -- 172.21.15.17:0/1812525364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270009ea0 con 0x7f1278159d80 2023-08-09T12:47:05.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.602+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12780aea00 con 0x7f1278159d80 2023-08-09T12:47:05.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.602+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12780aefc0 con 0x7f1278159d80 2023-08-09T12:47:05.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.604+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12780c21e0 con 0x7f1278159d80 2023-08-09T12:47:05.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.605+0000 7f126e7fc640 1 -- 172.21.15.17:0/1812525364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f12700147b0 con 0x7f1278159d80 2023-08-09T12:47:05.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.606+0000 7f126e7fc640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f125c06a050 0x7f125c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:05.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.606+0000 7f126e7fc640 1 -- 172.21.15.17:0/1812525364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1270088d70 con 0x7f1278159d80 2023-08-09T12:47:05.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.607+0000 7f127df64640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f125c06a050 0x7f125c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:05.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.608+0000 7f127df64640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f125c06a050 0x7f125c06c510 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1274006fd0 tx=0x7f1274008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:05.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.611+0000 7f126e7fc640 1 -- 172.21.15.17:0/1812525364 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1270054450 con 0x7f1278159d80 2023-08-09T12:47:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.846+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12780b2a30 con 0x7f1278159d80 2023-08-09T12:47:05.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.848+0000 7f126e7fc640 1 -- 172.21.15.17:0/1812525364 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f1270018090 con 0x7f1278159d80 2023-08-09T12:47:05.851 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:05.851 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:46:54.580315+0000","modified":"2023-08-09T12:46:58.167844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1719182807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1719182807},{"type":"v1","addr":"172.21.15.17:6835","nonce":1719182807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-09T12:47:05.852 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 59 2023-08-09T12:47:05.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f125c06a050 msgr2=0x7f125c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:05.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f125c06a050 0x7f125c06c510 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1274006fd0 tx=0x7f1274008040 comp rx=0 tx=0).stop 2023-08-09T12:47:05.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1278159d80 msgr2=0x7f1278157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:05.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1278159d80 0x7f1278157a80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f127000eed0 tx=0x7f127000b480 comp rx=0 tx=0).stop 2023-08-09T12:47:05.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 shutdown_connections 2023-08-09T12:47:05.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f125c06a050 0x7f125c06c510 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1278159d80 0x7f1278157a80 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12780ad810 0x7f12781eeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 --2- 172.21.15.17:0/1812525364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12780708c0 0x7f12781eba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 >> 172.21.15.17:0/1812525364 conn(0x7f12780cb1b0 msgr2=0x7f1278069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 shutdown_connections 2023-08-09T12:47:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:05.850+0000 7f12801c8640 1 -- 172.21.15.17:0/1812525364 wait complete. 2023-08-09T12:47:05.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-08-09T12:47:06.116 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":7545,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.959278013,"mdsmap_epoch":59,"osdmap_epoch":130,"osdmap_epoch_barrier":130,"uptime":17.905525906000001} 2023-08-09T12:47:06.117 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 7545, "mdsmap_epoch": 59, "osdmap_epoch": 130, "osdmap_epoch_barrier": 130, "rank_uptime": 10.959278013, "state": "up:active", "uptime": 17.905525906, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:47:06.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-09T12:47:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.352+0000 7f85f7fff640 1 Processor -- start 2023-08-09T12:47:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.352+0000 7f85f7fff640 1 -- start start 2023-08-09T12:47:06.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.353+0000 7f85f7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f815d000 0x7f85f8160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.353+0000 7f85f7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85f80cc0f0 0x7f85f80affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.353+0000 7f85f7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f85f80b04e0 0x7f85f815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.353+0000 7f85f7fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f80c9990 con 0x7f85f80cc0f0 2023-08-09T12:47:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.353+0000 7f85f7fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f8161490 con 0x7f85f80b04e0 2023-08-09T12:47:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.353+0000 7f85f7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80cc530 con 0x7f85f815d000 2023-08-09T12:47:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85f80cc0f0 0x7f85f80affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85f80cc0f0 0x7f85f80affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54228/0 (socket says 172.21.15.17:54228) 2023-08-09T12:47:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f67fc640 1 -- 172.21.15.17:0/2740296096 learned_addr learned my addr 172.21.15.17:0/2740296096 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f6ffd640 1 --2- 172.21.15.17:0/2740296096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f815d000 0x7f85f8160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f77fe640 1 --2- 172.21.15.17:0/2740296096 >> v2:172.21.15.142:3300/0 conn(0x7f85f80b04e0 0x7f85f815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f67fc640 1 -- 172.21.15.17:0/2740296096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f815d000 msgr2=0x7f85f8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:06.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f67fc640 1 --2- 172.21.15.17:0/2740296096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f815d000 0x7f85f8160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f67fc640 1 -- 172.21.15.17:0/2740296096 >> v2:172.21.15.142:3300/0 conn(0x7f85f80b04e0 msgr2=0x7f85f815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:06.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f67fc640 1 --2- 172.21.15.17:0/2740296096 >> v2:172.21.15.142:3300/0 conn(0x7f85f80b04e0 0x7f85f815d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f67fc640 1 -- 172.21.15.17:0/2740296096 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80b08e0 con 0x7f85f80cc0f0 2023-08-09T12:47:06.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.354+0000 7f85f77fe640 1 --2- 172.21.15.17:0/2740296096 >> v2:172.21.15.142:3300/0 conn(0x7f85f80b04e0 0x7f85f815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:06.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.356+0000 7f85f67fc640 1 --2- 172.21.15.17:0/2740296096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f80cc0f0 0x7f85f80affa0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f85f80b0f50 tx=0x7f85ec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cea6bf2f1024535 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:06.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.356+0000 7f85f5ffb640 1 -- 172.21.15.17:0/2740296096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0317e0 con 0x7f85f80cc0f0 2023-08-09T12:47:06.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.356+0000 7f85f5ffb640 1 -- 172.21.15.17:0/2740296096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec031940 con 0x7f85f80cc0f0 2023-08-09T12:47:06.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.356+0000 7f85f5ffb640 1 -- 172.21.15.17:0/2740296096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec031cd0 con 0x7f85f80cc0f0 2023-08-09T12:47:06.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.356+0000 7f85f7fff640 1 -- 172.21.15.17:0/2740296096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f80cc0f0 msgr2=0x7f85f80affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:06.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.356+0000 7f85f7fff640 1 --2- 172.21.15.17:0/2740296096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f80cc0f0 0x7f85f80affa0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f85f80b0f50 tx=0x7f85ec02b880 comp rx=0 tx=0).stop 2023-08-09T12:47:06.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.357+0000 7f85f7fff640 1 -- 172.21.15.17:0/2740296096 shutdown_connections 2023-08-09T12:47:06.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.357+0000 7f85f7fff640 1 --2- 172.21.15.17:0/2740296096 >> v2:172.21.15.142:3300/0 conn(0x7f85f80b04e0 0x7f85f815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.357+0000 7f85f7fff640 1 --2- 172.21.15.17:0/2740296096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f80cc0f0 0x7f85f80affa0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.357+0000 7f85f7fff640 1 --2- 172.21.15.17:0/2740296096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f815d000 0x7f85f8160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.357+0000 7f85f7fff640 1 -- 172.21.15.17:0/2740296096 >> 172.21.15.17:0/2740296096 conn(0x7f85f80cafa0 msgr2=0x7f85f80cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:06.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.357+0000 7f85f7fff640 1 -- 172.21.15.17:0/2740296096 shutdown_connections 2023-08-09T12:47:06.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.357+0000 7f85f7fff640 1 -- 172.21.15.17:0/2740296096 wait complete. 2023-08-09T12:47:06.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.358+0000 7f85f7fff640 1 Processor -- start 2023-08-09T12:47:06.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.359+0000 7f85f7fff640 1 -- start start 2023-08-09T12:47:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85f80b04e0 0x7f85f806ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f80cc0f0 0x7f85f8154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f815d000 0x7f85f8071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f7fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b1df0 con 0x7f85f815d000 2023-08-09T12:47:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f7fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b11e0 con 0x7f85f80b04e0 2023-08-09T12:47:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8154b90 con 0x7f85f80cc0f0 2023-08-09T12:47:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f815d000 0x7f85f8071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f815d000 0x7f85f8071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54242/0 (socket says 172.21.15.17:54242) 2023-08-09T12:47:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f77fe640 1 -- 172.21.15.17:0/416164878 learned_addr learned my addr 172.21.15.17:0/416164878 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f6ffd640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85f80b04e0 0x7f85f806ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f77fe640 1 -- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f80cc0f0 msgr2=0x7f85f8154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f77fe640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f80cc0f0 0x7f85f8154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f77fe640 1 -- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85f80b04e0 msgr2=0x7f85f806ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f77fe640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85f80b04e0 0x7f85f806ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.360+0000 7f85f77fe640 1 -- 172.21.15.17:0/416164878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0094d0 con 0x7f85f815d000 2023-08-09T12:47:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.361+0000 7f85f77fe640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f815d000 0x7f85f8071250 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f85f000c610 tx=0x7f85f000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.361+0000 7f85df7fe640 1 -- 172.21.15.17:0/416164878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0011800 con 0x7f85f815d000 2023-08-09T12:47:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.361+0000 7f85df7fe640 1 -- 172.21.15.17:0/416164878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0011960 con 0x7f85f815d000 2023-08-09T12:47:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.361+0000 7f85df7fe640 1 -- 172.21.15.17:0/416164878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0011d10 con 0x7f85f815d000 2023-08-09T12:47:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.361+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f80b1450 con 0x7f85f815d000 2023-08-09T12:47:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.361+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f80b1a10 con 0x7f85f815d000 2023-08-09T12:47:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.363+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f80b1f30 con 0x7f85f815d000 2023-08-09T12:47:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.363+0000 7f85df7fe640 1 -- 172.21.15.17:0/416164878 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f85f0022350 con 0x7f85f815d000 2023-08-09T12:47:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.364+0000 7f85df7fe640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85e406a080 0x7f85e406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.364+0000 7f85df7fe640 1 -- 172.21.15.17:0/416164878 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85f0088660 con 0x7f85f815d000 2023-08-09T12:47:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.365+0000 7f85f6ffd640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85e406a080 0x7f85e406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.366+0000 7f85f6ffd640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85e406a080 0x7f85e406c540 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009e10 tx=0x7f85e800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:06.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.369+0000 7f85df7fe640 1 -- 172.21.15.17:0/416164878 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f85f80b1f30 con 0x7f85f815d000 2023-08-09T12:47:06.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.587+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f85f80b1f30 con 0x7f85f815d000 2023-08-09T12:47:06.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.917+0000 7f85df7fe640 1 -- 172.21.15.17:0/416164878 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v131) v1 ==== 181+0+0 (secure 0 0 0) 0x7f85f80b1f30 con 0x7f85f815d000 2023-08-09T12:47:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-09T12:47:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85e406a080 msgr2=0x7f85e406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85e406a080 0x7f85e406c540 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009e10 tx=0x7f85e800b040 comp rx=0 tx=0).stop 2023-08-09T12:47:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f815d000 msgr2=0x7f85f8071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f815d000 0x7f85f8071250 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f85f000c610 tx=0x7f85f000cad0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 shutdown_connections 2023-08-09T12:47:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85e406a080 0x7f85e406c540 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f815d000 0x7f85f8071250 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85f80cc0f0 0x7f85f8154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 --2- 172.21.15.17:0/416164878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85f80b04e0 0x7f85f806ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.921+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 >> 172.21.15.17:0/416164878 conn(0x7f85f80cafa0 msgr2=0x7f85f815b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.922+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 shutdown_connections 2023-08-09T12:47:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:06.922+0000 7f85f7fff640 1 -- 172.21.15.17:0/416164878 wait complete. 2023-08-09T12:47:06.946 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:47:06.946 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:47:06.947 DEBUG:teuthology.orchestra.run.smithi017:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-09T12:47:06.947 DEBUG:teuthology.orchestra.run.smithi017:> os.fchmod(fd, 0O666) 2023-08-09T12:47:06.947 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(fd) 2023-08-09T12:47:06.947 DEBUG:teuthology.orchestra.run.smithi017:> os.close(fd) 2023-08-09T12:47:06.948 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:47:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:47:07.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:07.124 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:47:07.233 INFO:teuthology.orchestra.run.smithi017.stdout:client6118 2023-08-09T12:47:07.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:07.234 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client6118/osdmap') 2023-08-09T12:47:07.338 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 130 barrier 130 flags 0x588000 2023-08-09T12:47:07.338 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:07.338 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:07.338 INFO:teuthology.orchestra.run.smithi017.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:07.338 INFO:teuthology.orchestra.run.smithi017.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:07.339 INFO:teuthology.orchestra.run.smithi017.stdout:osd0 (1)172.21.15.17:6809 100% (exists, up) 100% -1 2023-08-09T12:47:07.339 INFO:teuthology.orchestra.run.smithi017.stdout:osd1 (1)172.21.15.17:6817 100% (exists, up) 100% -1 2023-08-09T12:47:07.339 INFO:teuthology.orchestra.run.smithi017.stdout:osd2 (1)172.21.15.17:6801 100% (exists, up) 100% -1 2023-08-09T12:47:07.339 INFO:teuthology.orchestra.run.smithi017.stdout:osd3 (1)172.21.15.17:6825 100% (exists, up) 100% -1 2023-08-09T12:47:07.339 INFO:teuthology.orchestra.run.smithi017.stdout:osd4 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-08-09T12:47:07.339 INFO:teuthology.orchestra.run.smithi017.stdout:osd5 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-08-09T12:47:07.339 INFO:teuthology.orchestra.run.smithi017.stdout:osd6 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-08-09T12:47:07.340 INFO:teuthology.orchestra.run.smithi017.stdout:osd7 (1)172.21.15.142:6817 100% (exists, up) 100% -1 2023-08-09T12:47:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records in 2023-08-09T12:47:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records out 2023-08-09T12:47:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:904 bytes copied, 9.2193e-05 s, 9.8 MB/s 2023-08-09T12:47:07.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-08-09T12:47:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.565+0000 7fb797eb8640 1 Processor -- start 2023-08-09T12:47:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.565+0000 7fb797eb8640 1 -- start start 2023-08-09T12:47:07.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.567+0000 7fb797eb8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb790161280 0x7fb7900c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:07.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.567+0000 7fb797eb8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79015df30 con 0x7fb790161660 2023-08-09T12:47:07.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.567+0000 7fb797eb8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7900ca9d0 con 0x7fb7900acfc0 2023-08-09T12:47:07.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.567+0000 7fb797eb8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79015d430 con 0x7fb790161280 2023-08-09T12:47:07.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.567+0000 7fb795453640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb790161660 0x7fb7900ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45832/0 (socket says 172.21.15.17:45832) 2023-08-09T12:47:07.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.567+0000 7fb795453640 1 -- 172.21.15.17:0/1406150483 learned_addr learned my addr 172.21.15.17:0/1406150483 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:07.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.567+0000 7fb795c54640 1 --2- 172.21.15.17:0/1406150483 >> v2:172.21.15.142:3300/0 conn(0x7fb790161280 0x7fb7900c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029111484 0 0) 0x7fb79015df30 con 0x7fb790161660 2023-08-09T12:47:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb77c003520 con 0x7fb790161660 2023-08-09T12:47:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 758636127 0 0) 0x7fb77c003520 con 0x7fb790161660 2023-08-09T12:47:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 >> v2:172.21.15.142:3300/0 conn(0x7fb790161280 msgr2=0x7fb7900c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 --2- 172.21.15.17:0/1406150483 >> v2:172.21.15.142:3300/0 conn(0x7fb790161280 0x7fb7900c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 >> v1:172.21.15.142:6789/0 conn(0x7fb7900acfc0 legacy=0x7fb7900cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:07.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79015e3c0 con 0x7fb790161660 2023-08-09T12:47:07.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fb7800017f0 con 0x7fb790161660 2023-08-09T12:47:07.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 >> v1:172.21.15.17:6789/0 conn(0x7fb790161660 legacy=0x7fb7900ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:07.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.568+0000 7fb794c52640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c003970 0x7fb77c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:07.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb794c52640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb77c0047c0 0x7fb77c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:07.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb794c52640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c005180 0x7fb77c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:07.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c00c0f0 con 0x7fb77c005180 2023-08-09T12:47:07.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c00c260 con 0x7fb77c0047c0 2023-08-09T12:47:07.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c00c420 con 0x7fb77c003970 2023-08-09T12:47:07.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb796455640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c005180 0x7fb77c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:07.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb795c54640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c003970 0x7fb77c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:07.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb795453640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb77c0047c0 0x7fb77c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:07.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb796455640 1 -- 172.21.15.17:0/1406150483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c003970 msgr2=0x7fb77c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:07.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb796455640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c003970 0x7fb77c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb796455640 1 -- 172.21.15.17:0/1406150483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb77c0047c0 msgr2=0x7fb77c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:07.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb796455640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb77c0047c0 0x7fb77c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.569+0000 7fb796455640 1 -- 172.21.15.17:0/1406150483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c003520 con 0x7fb77c005180 2023-08-09T12:47:07.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.570+0000 7fb796455640 1 -- 172.21.15.17:0/1406150483 reap_dead start 2023-08-09T12:47:07.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb796455640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c005180 0x7fb77c00b980 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fb788001e50 tx=0x7fb77c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f6cc2891d10671 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:07.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788003b70 con 0x7fb77c005180 2023-08-09T12:47:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788003d10 con 0x7fb77c005180 2023-08-09T12:47:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb794c52640 1 -- 172.21.15.17:0/1406150483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788005310 con 0x7fb77c005180 2023-08-09T12:47:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb797eb8640 1 -- 172.21.15.17:0/1406150483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c005180 msgr2=0x7fb77c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb797eb8640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c005180 0x7fb77c00b980 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fb788001e50 tx=0x7fb77c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb797eb8640 1 -- 172.21.15.17:0/1406150483 shutdown_connections 2023-08-09T12:47:07.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb797eb8640 1 --2- 172.21.15.17:0/1406150483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c005180 0x7fb77c00b980 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.571+0000 7fb797eb8640 1 -- 172.21.15.17:0/1406150483 >> 172.21.15.17:0/1406150483 conn(0x7fb7900cb1b0 msgr2=0x7fb7900cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:07.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.572+0000 7fb797eb8640 1 -- 172.21.15.17:0/1406150483 shutdown_connections 2023-08-09T12:47:07.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.572+0000 7fb797eb8640 1 -- 172.21.15.17:0/1406150483 wait complete. 2023-08-09T12:47:07.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.573+0000 7fb797eb8640 1 Processor -- start 2023-08-09T12:47:07.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.574+0000 7fb797eb8640 1 -- start start 2023-08-09T12:47:07.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.574+0000 7fb797eb8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c005180 0x7fb790145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:07.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.574+0000 7fb797eb8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7900c4e70 0x7fb790155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:07.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.574+0000 7fb797eb8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb790156060 0x7fb7900c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:07.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.574+0000 7fb797eb8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900c3760 con 0x7fb790156060 2023-08-09T12:47:07.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.574+0000 7fb797eb8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901564e0 con 0x7fb7900c4e70 2023-08-09T12:47:07.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.574+0000 7fb797eb8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb790157e40 con 0x7fb77c005180 2023-08-09T12:47:07.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb796455640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb790156060 0x7fb7900c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:07.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb796455640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb790156060 0x7fb7900c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54260/0 (socket says 172.21.15.17:54260) 2023-08-09T12:47:07.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb796455640 1 -- 172.21.15.17:0/442088232 learned_addr learned my addr 172.21.15.17:0/442088232 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:07.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb795c54640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c005180 0x7fb790145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:07.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb795453640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7900c4e70 0x7fb790155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:07.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb796455640 1 -- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c005180 msgr2=0x7fb790145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:07.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb796455640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c005180 0x7fb790145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb796455640 1 -- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7900c4e70 msgr2=0x7fb790155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:07.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb796455640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7900c4e70 0x7fb790155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb796455640 1 -- 172.21.15.17:0/442088232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790146520 con 0x7fb790156060 2023-08-09T12:47:07.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.575+0000 7fb795453640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7900c4e70 0x7fb790155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:07.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.576+0000 7fb796455640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb790156060 0x7fb7900c3b80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fb788005040 tx=0x7fb7880014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:07.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.576+0000 7fb7867fc640 1 -- 172.21.15.17:0/442088232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788006d50 con 0x7fb790156060 2023-08-09T12:47:07.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.576+0000 7fb7867fc640 1 -- 172.21.15.17:0/442088232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788039480 con 0x7fb790156060 2023-08-09T12:47:07.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.576+0000 7fb7867fc640 1 -- 172.21.15.17:0/442088232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880397f0 con 0x7fb790156060 2023-08-09T12:47:07.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.576+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7900c2ae0 con 0x7fb790156060 2023-08-09T12:47:07.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.576+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7900c30a0 con 0x7fb790156060 2023-08-09T12:47:07.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.577+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb790067a80 con 0x7fb790156060 2023-08-09T12:47:07.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.578+0000 7fb7867fc640 1 -- 172.21.15.17:0/442088232 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb788039950 con 0x7fb790156060 2023-08-09T12:47:07.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.579+0000 7fb7867fc640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb77406a080 0x7fb77406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.579+0000 7fb7867fc640 1 -- 172.21.15.17:0/442088232 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7880aa2d0 con 0x7fb790156060 2023-08-09T12:47:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.580+0000 7fb795c54640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb77406a080 0x7fb77406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.581+0000 7fb795c54640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb77406a080 0x7fb77406c540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb7901f55f0 tx=0x7fb78c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.584+0000 7fb7867fc640 1 -- 172.21.15.17:0/442088232 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb7880759b0 con 0x7fb790156060 2023-08-09T12:47:07.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.788+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7fb7900adc60 con 0x7fb790156060 2023-08-09T12:47:07.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.928+0000 7fb7867fc640 1 -- 172.21.15.17:0/442088232 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v132) v1 ==== 93+0+0 (secure 0 0 0) 0x7fb788078fd0 con 0x7fb790156060 2023-08-09T12:47:07.932 INFO:teuthology.orchestra.run.smithi017.stderr:pauserd,pausewr is set 2023-08-09T12:47:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb77406a080 msgr2=0x7fb77406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:07.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb77406a080 0x7fb77406c540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb7901f55f0 tx=0x7fb78c008040 comp rx=0 tx=0).stop 2023-08-09T12:47:07.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb790156060 msgr2=0x7fb7900c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:07.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb790156060 0x7fb7900c3b80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fb788005040 tx=0x7fb7880014a0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 shutdown_connections 2023-08-09T12:47:07.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb77406a080 0x7fb77406c540 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb790156060 0x7fb7900c3b80 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7900c4e70 0x7fb790155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 --2- 172.21.15.17:0/442088232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb77c005180 0x7fb790145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 >> 172.21.15.17:0/442088232 conn(0x7fb7900cb1b0 msgr2=0x7fb7900703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 shutdown_connections 2023-08-09T12:47:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:07.932+0000 7fb797eb8640 1 -- 172.21.15.17:0/442088232 wait complete. 2023-08-09T12:47:07.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-08-09T12:47:08.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.180+0000 7fe26f371640 1 Processor -- start 2023-08-09T12:47:08.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.180+0000 7fe26f371640 1 -- start start 2023-08-09T12:47:08.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.181+0000 7fe26f371640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2680adc40 0x7fe26806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.181+0000 7fe26f371640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 0x7fe2680b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.182+0000 7fe26f371640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2680b2250 con 0x7fe26815e8f0 2023-08-09T12:47:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.182+0000 7fe26f371640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2680ae020 con 0x7fe2680adc40 2023-08-09T12:47:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.182+0000 7fe26f371640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2680b2530 con 0x7fe2680b3b40 2023-08-09T12:47:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.182+0000 7fe26d90e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe26815e8f0 0x7fe26815ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34618/0 (socket says 172.21.15.17:34618) 2023-08-09T12:47:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.182+0000 7fe26d90e640 1 -- 172.21.15.17:0/2397065257 learned_addr learned my addr 172.21.15.17:0/2397065257 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.182+0000 7fe26d10d640 1 --2- 172.21.15.17:0/2397065257 >> v2:172.21.15.142:3300/0 conn(0x7fe2680adc40 0x7fe26806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.182+0000 7fe26c90c640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 0x7fe2680b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.182+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375132774 0 0) 0x7fe2680b2250 con 0x7fe26815e8f0 2023-08-09T12:47:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe254003520 con 0x7fe26815e8f0 2023-08-09T12:47:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3342168984 0 0) 0x7fe254003520 con 0x7fe26815e8f0 2023-08-09T12:47:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 msgr2=0x7fe2680b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 0x7fe2680b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 >> v2:172.21.15.142:3300/0 conn(0x7fe2680adc40 msgr2=0x7fe26806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 --2- 172.21.15.17:0/2397065257 >> v2:172.21.15.142:3300/0 conn(0x7fe2680adc40 0x7fe26806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26806fe80 con 0x7fe26815e8f0 2023-08-09T12:47:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe2600019f0 con 0x7fe26815e8f0 2023-08-09T12:47:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 >> v1:172.21.15.17:6789/0 conn(0x7fe26815e8f0 legacy=0x7fe26815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe254003970 0x7fe254003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 0x7fe2540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe254004d00 0x7fe254005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2680ae020 con 0x7fe254004d00 2023-08-09T12:47:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2680b2530 con 0x7fe254003970 2023-08-09T12:47:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.183+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25400b980 con 0x7fe2680b3b40 2023-08-09T12:47:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26d90e640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe254004d00 0x7fe254005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26d10d640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe254003970 0x7fe254003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26c90c640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 0x7fe2540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26d90e640 1 -- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 msgr2=0x7fe2540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26d90e640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 0x7fe2540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26d90e640 1 -- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe254003970 msgr2=0x7fe254003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26d90e640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe254003970 0x7fe254003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26d90e640 1 -- 172.21.15.17:0/2397065257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254003520 con 0x7fe254004d00 2023-08-09T12:47:08.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.184+0000 7fe26c90c640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2680b3b40 0x7fe2540047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.185+0000 7fe26d90e640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe254004d00 0x7fe254005180 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fe26000a8d0 tx=0x7fe2540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648dcf48a211b3d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.185+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260034630 con 0x7fe254004d00 2023-08-09T12:47:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26002f070 con 0x7fe254004d00 2023-08-09T12:47:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe25ffff640 1 -- 172.21.15.17:0/2397065257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2600349d0 con 0x7fe254004d00 2023-08-09T12:47:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe26f371640 1 -- 172.21.15.17:0/2397065257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe254004d00 msgr2=0x7fe254005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe26f371640 1 --2- 172.21.15.17:0/2397065257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe254004d00 0x7fe254005180 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fe26000a8d0 tx=0x7fe2540057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe26d90e640 1 -- 172.21.15.17:0/2397065257 reap_dead start 2023-08-09T12:47:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe26f371640 1 -- 172.21.15.17:0/2397065257 shutdown_connections 2023-08-09T12:47:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe26f371640 1 -- 172.21.15.17:0/2397065257 >> 172.21.15.17:0/2397065257 conn(0x7fe2680cb1b0 msgr2=0x7fe2680cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe26f371640 1 -- 172.21.15.17:0/2397065257 shutdown_connections 2023-08-09T12:47:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.186+0000 7fe26f371640 1 -- 172.21.15.17:0/2397065257 wait complete. 2023-08-09T12:47:08.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.188+0000 7fe26f371640 1 Processor -- start 2023-08-09T12:47:08.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.188+0000 7fe26f371640 1 -- start start 2023-08-09T12:47:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.189+0000 7fe26f371640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe254004d00 0x7fe2680c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.189+0000 7fe26f371640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2680c2820 0x7fe2680c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.189+0000 7fe26f371640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2680c2c80 0x7fe2680c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.189+0000 7fe26f371640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2681f3b40 con 0x7fe2680c2820 2023-08-09T12:47:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.189+0000 7fe26f371640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2681f3e20 con 0x7fe2680c2c80 2023-08-09T12:47:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.189+0000 7fe26f371640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2681f4100 con 0x7fe254004d00 2023-08-09T12:47:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2680c2820 0x7fe2680c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2680c2820 0x7fe2680c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38676/0 (socket says 172.21.15.17:38676) 2023-08-09T12:47:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 -- 172.21.15.17:0/3229654990 learned_addr learned my addr 172.21.15.17:0/3229654990 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26d10d640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe254004d00 0x7fe2680c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26d90e640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2680c2c80 0x7fe2680c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 -- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe254004d00 msgr2=0x7fe2680c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe254004d00 0x7fe2680c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 -- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2680c2c80 msgr2=0x7fe2680c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2680c2c80 0x7fe2680c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 -- 172.21.15.17:0/3229654990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2681f43e0 con 0x7fe2680c2820 2023-08-09T12:47:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26d90e640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2680c2c80 0x7fe2680c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.190+0000 7fe26c90c640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2680c2820 0x7fe2680c75d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fe258010900 tx=0x7fe258010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.191+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258004220 con 0x7fe2680c2820 2023-08-09T12:47:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.191+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe258004380 con 0x7fe2680c2820 2023-08-09T12:47:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.191+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2681f46c0 con 0x7fe2680c2820 2023-08-09T12:47:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.191+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258005bd0 con 0x7fe2680c2820 2023-08-09T12:47:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.191+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2680c6050 con 0x7fe2680c2820 2023-08-09T12:47:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.192+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe268067a80 con 0x7fe2680c2820 2023-08-09T12:47:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.193+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe258005d30 con 0x7fe2680c2820 2023-08-09T12:47:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.194+0000 7fe25dffb640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe24c06a080 0x7fe24c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.195+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2580889b0 con 0x7fe2680c2820 2023-08-09T12:47:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.195+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=133+}) v3 -- 0x7fe24c0721d0 con 0x7fe2680c2820 2023-08-09T12:47:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.195+0000 7fe26d10d640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe24c06a080 0x7fe24c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.196+0000 7fe26d10d640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe24c06a080 0x7fe24c06c540 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe264009990 tx=0x7fe264008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.199+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe258054000 con 0x7fe2680c2820 2023-08-09T12:47:08.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.403+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fe26806c900 con 0x7fe2680c2820 2023-08-09T12:47:08.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.928+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(133..133 src has 1..133) v4 ==== 288+0+0 (secure 0 0 0) 0x7fe258058350 con 0x7fe2680c2820 2023-08-09T12:47:08.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.928+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=134}) v3 -- 0x7fe24c072a80 con 0x7fe2680c2820 2023-08-09T12:47:08.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.933+0000 7fe25dffb640 1 -- 172.21.15.17:0/3229654990 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v133) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe258021020 con 0x7fe2680c2820 2023-08-09T12:47:08.937 INFO:teuthology.orchestra.run.smithi017.stderr:pauserd,pausewr is unset 2023-08-09T12:47:08.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.937+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe24c06a080 msgr2=0x7fe24c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.937+0000 7fe26f371640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe24c06a080 0x7fe24c06c540 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe264009990 tx=0x7fe264008040 comp rx=0 tx=0).stop 2023-08-09T12:47:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.937+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2680c2820 msgr2=0x7fe2680c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.937+0000 7fe26f371640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2680c2820 0x7fe2680c75d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fe258010900 tx=0x7fe258010dc0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.938+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 shutdown_connections 2023-08-09T12:47:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.938+0000 7fe26f371640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe24c06a080 0x7fe24c06c540 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.938+0000 7fe26f371640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2680c2c80 0x7fe2680c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.938+0000 7fe26f371640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2680c2820 0x7fe2680c75d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.938+0000 7fe26f371640 1 --2- 172.21.15.17:0/3229654990 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe254004d00 0x7fe2680c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.938+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 >> 172.21.15.17:0/3229654990 conn(0x7fe2680cb1b0 msgr2=0x7fe26815dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.938+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 shutdown_connections 2023-08-09T12:47:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:08.938+0000 7fe26f371640 1 -- 172.21.15.17:0/3229654990 wait complete. 2023-08-09T12:47:08.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.191+0000 7f9e93a83640 1 Processor -- start 2023-08-09T12:47:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.191+0000 7f9e93a83640 1 -- start start 2023-08-09T12:47:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.192+0000 7f9e93a83640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e8c15add0 0x7f9e8c0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.192+0000 7f9e93a83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c0b38a0 0x7f9e8c0cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.192+0000 7f9e93a83640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0cc660 con 0x7f9e8c0717e0 2023-08-09T12:47:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.192+0000 7f9e93a83640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0cc940 con 0x7f9e8c15add0 2023-08-09T12:47:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.192+0000 7f9e93a83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0ccc20 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.193+0000 7f9e9101e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c0b38a0 0x7f9e8c0cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.193+0000 7f9e9181f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e8c15add0 0x7f9e8c0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.193+0000 7f9e9101e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c0b38a0 0x7f9e8c0cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:53290/0 (socket says 172.21.15.17:53290) 2023-08-09T12:47:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.193+0000 7f9e9181f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e8c15add0 0x7f9e8c0b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:37182/0 (socket says 172.21.15.17:37182) 2023-08-09T12:47:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.193+0000 7f9e9101e640 1 -- 172.21.15.17:0/4253854283 learned_addr learned my addr 172.21.15.17:0/4253854283 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.194+0000 7f9e9181f640 1 -- 172.21.15.17:0/4253854283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c0b38a0 msgr2=0x7f9e8c0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.194+0000 7f9e9181f640 1 --2- 172.21.15.17:0/4253854283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c0b38a0 0x7f9e8c0cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.194+0000 7f9e9181f640 1 -- 172.21.15.17:0/4253854283 >> v1:172.21.15.142:6789/0 conn(0x7f9e8c0717e0 legacy=0x7f9e8c0cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.194+0000 7f9e9181f640 1 -- 172.21.15.17:0/4253854283 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0ccf00 con 0x7f9e8c15add0 2023-08-09T12:47:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.196+0000 7f9e9181f640 1 --2- 172.21.15.17:0/4253854283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c15add0 0x7f9e8c0b6350 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9e880097a0 tx=0x7f9e8802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3158a7d9a1858749 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:09.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.196+0000 7f9e9081d640 1 -- 172.21.15.17:0/4253854283 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8802f050 con 0x7f9e8c15add0 2023-08-09T12:47:09.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.196+0000 7f9e9081d640 1 -- 172.21.15.17:0/4253854283 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88031700 con 0x7f9e8c15add0 2023-08-09T12:47:09.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.196+0000 7f9e9081d640 1 -- 172.21.15.17:0/4253854283 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88031a90 con 0x7f9e8c15add0 2023-08-09T12:47:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.197+0000 7f9e93a83640 1 -- 172.21.15.17:0/4253854283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c15add0 msgr2=0x7f9e8c0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.197+0000 7f9e93a83640 1 --2- 172.21.15.17:0/4253854283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c15add0 0x7f9e8c0b6350 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9e880097a0 tx=0x7f9e8802b7a0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.197+0000 7f9e93a83640 1 -- 172.21.15.17:0/4253854283 shutdown_connections 2023-08-09T12:47:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.197+0000 7f9e93a83640 1 --2- 172.21.15.17:0/4253854283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c0b38a0 0x7f9e8c0cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.197+0000 7f9e93a83640 1 --2- 172.21.15.17:0/4253854283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c15add0 0x7f9e8c0b6350 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.197+0000 7f9e93a83640 1 -- 172.21.15.17:0/4253854283 >> 172.21.15.17:0/4253854283 conn(0x7f9e8c06b9d0 msgr2=0x7f9e8c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.197+0000 7f9e93a83640 1 -- 172.21.15.17:0/4253854283 shutdown_connections 2023-08-09T12:47:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.197+0000 7f9e93a83640 1 -- 172.21.15.17:0/4253854283 wait complete. 2023-08-09T12:47:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.199+0000 7f9e93a83640 1 Processor -- start 2023-08-09T12:47:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.199+0000 7f9e93a83640 1 -- start start 2023-08-09T12:47:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.200+0000 7f9e93a83640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c0717e0 0x7f9e8c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.200+0000 7f9e93a83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e8c0b38a0 0x7f9e8c1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.200+0000 7f9e93a83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c15add0 0x7f9e8c1f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.200+0000 7f9e93a83640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0ca930 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.200+0000 7f9e93a83640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0697c0 con 0x7f9e8c0717e0 2023-08-09T12:47:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.200+0000 7f9e93a83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0ca650 con 0x7f9e8c15add0 2023-08-09T12:47:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9101e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e8c0b38a0 0x7f9e8c1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9101e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e8c0b38a0 0x7f9e8c1f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38680/0 (socket says 172.21.15.17:38680) 2023-08-09T12:47:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9101e640 1 -- 172.21.15.17:0/2264555366 learned_addr learned my addr 172.21.15.17:0/2264555366 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9181f640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c0717e0 0x7f9e8c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e92020640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c15add0 0x7f9e8c1f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9101e640 1 -- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c15add0 msgr2=0x7f9e8c1f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9101e640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c15add0 0x7f9e8c1f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9101e640 1 -- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c0717e0 msgr2=0x7f9e8c0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9101e640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c0717e0 0x7f9e8c0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e9101e640 1 -- 172.21.15.17:0/2264555366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88009400 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.201+0000 7f9e92020640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c15add0 0x7f9e8c1f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.202+0000 7f9e9101e640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e8c0b38a0 0x7f9e8c1f5760 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00e870 tx=0x7f9e7c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.202+0000 7f9e827fc640 1 -- 172.21.15.17:0/2264555366 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c00c940 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.202+0000 7f9e827fc640 1 -- 172.21.15.17:0/2264555366 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c00caa0 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.202+0000 7f9e827fc640 1 -- 172.21.15.17:0/2264555366 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c00ce50 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.202+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c1427c0 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.202+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c142d80 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.203+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c142620 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.204+0000 7f9e827fc640 1 -- 172.21.15.17:0/2264555366 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9e7c013470 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.205+0000 7f9e827fc640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e7006a050 0x7f9e7006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:09.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.205+0000 7f9e827fc640 1 -- 172.21.15.17:0/2264555366 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e7c088600 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.206+0000 7f9e9181f640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e7006a050 0x7f9e7006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:09.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.207+0000 7f9e9181f640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e7006a050 0x7f9e7006c510 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9e88035000 tx=0x7f9e88008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:09.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.210+0000 7f9e827fc640 1 -- 172.21.15.17:0/2264555366 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9e8c142620 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.403+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e8c142620 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.406+0000 7f9e827fc640 1 -- 172.21.15.17:0/2264555366 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+18278 (secure 0 0 0) 0x7f9e8c142620 con 0x7f9e8c0b38a0 2023-08-09T12:47:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:09.410 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":133,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:08.924888+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e7006a050 msgr2=0x7f9e7006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e7006a050 0x7f9e7006c510 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9e88035000 tx=0x7f9e88008030 comp rx=0 tx=0).stop 2023-08-09T12:47:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e8c0b38a0 msgr2=0x7f9e8c1f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e8c0b38a0 0x7f9e8c1f5760 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00e870 tx=0x7f9e7c00ed30 comp rx=0 tx=0).stop 2023-08-09T12:47:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 shutdown_connections 2023-08-09T12:47:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e7006a050 0x7f9e7006c510 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e8c15add0 0x7f9e8c1f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e8c0b38a0 0x7f9e8c1f5760 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 --2- 172.21.15.17:0/2264555366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e8c0717e0 0x7f9e8c0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 >> 172.21.15.17:0/2264555366 conn(0x7f9e8c06b9d0 msgr2=0x7f9e8c0cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 shutdown_connections 2023-08-09T12:47:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09.409+0000 7f9e93a83640 1 -- 172.21.15.17:0/2264555366 wait complete. 2023-08-09T12:47:09.432 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:47:09.433 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:47:09.433 DEBUG:teuthology.orchestra.run.smithi017:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-09T12:47:09.433 DEBUG:teuthology.orchestra.run.smithi017:> os.fchmod(fd, 0O666) 2023-08-09T12:47:09.434 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(fd) 2023-08-09T12:47:09.434 DEBUG:teuthology.orchestra.run.smithi017:> os.close(fd) 2023-08-09T12:47:09.434 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:47:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:47:09.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:09.603 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:47:09.711 INFO:teuthology.orchestra.run.smithi017.stdout:client6118 2023-08-09T12:47:09.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:09.712 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client6118/osdmap') 2023-08-09T12:47:09.809 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 130 barrier 130 flags 0x588000 2023-08-09T12:47:09.809 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:09.810 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:09.810 INFO:teuthology.orchestra.run.smithi017.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:09.810 INFO:teuthology.orchestra.run.smithi017.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:09.810 INFO:teuthology.orchestra.run.smithi017.stdout:osd0 (1)172.21.15.17:6809 100% (exists, up) 100% -1 2023-08-09T12:47:09.810 INFO:teuthology.orchestra.run.smithi017.stdout:osd1 (1)172.21.15.17:6817 100% (exists, up) 100% -1 2023-08-09T12:47:09.810 INFO:teuthology.orchestra.run.smithi017.stdout:osd2 (1)172.21.15.17:6801 100% (exists, up) 100% -1 2023-08-09T12:47:09.810 INFO:teuthology.orchestra.run.smithi017.stdout:osd3 (1)172.21.15.17:6825 100% (exists, up) 100% -1 2023-08-09T12:47:09.810 INFO:teuthology.orchestra.run.smithi017.stdout:osd4 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-08-09T12:47:09.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd5 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-08-09T12:47:09.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd6 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-08-09T12:47:09.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd7 (1)172.21.15.142:6817 100% (exists, up) 100% -1 2023-08-09T12:47:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records in 2023-08-09T12:47:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records out 2023-08-09T12:47:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:904 bytes copied, 9.3645e-05 s, 9.7 MB/s 2023-08-09T12:47:09.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.039+0000 7fe2f5f84640 1 Processor -- start 2023-08-09T12:47:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.039+0000 7fe2f5f84640 1 -- start start 2023-08-09T12:47:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.040+0000 7fe2f5f84640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2f015ce90 0x7fe2f01616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.040+0000 7fe2f5f84640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2f00b6000 0x7fe2f00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.040+0000 7fe2f5f84640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f00b6460 con 0x7fe2f00d29d0 2023-08-09T12:47:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.040+0000 7fe2f5f84640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00cda40 con 0x7fe2f015ce90 2023-08-09T12:47:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.040+0000 7fe2f5f84640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00cdd10 con 0x7fe2f00b6000 2023-08-09T12:47:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.041+0000 7fe2ef7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2f015ce90 0x7fe2f01616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.041+0000 7fe2ef7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2f015ce90 0x7fe2f01616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38682/0 (socket says 172.21.15.17:38682) 2023-08-09T12:47:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.041+0000 7fe2ef7fe640 1 -- 172.21.15.17:0/765528681 learned_addr learned my addr 172.21.15.17:0/765528681 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.041+0000 7fe2e6ffd640 1 --2- 172.21.15.17:0/765528681 >> v2:172.21.15.142:3300/0 conn(0x7fe2f00b6000 0x7fe2f00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.041+0000 7fe2ef7fe640 1 -- 172.21.15.17:0/765528681 >> v2:172.21.15.142:3300/0 conn(0x7fe2f00b6000 msgr2=0x7fe2f00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.041+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/765528681 >> v2:172.21.15.142:3300/0 conn(0x7fe2f00b6000 0x7fe2f00cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.041+0000 7fe2ef7fe640 1 -- 172.21.15.17:0/765528681 >> v1:172.21.15.17:6789/0 conn(0x7fe2f00d29d0 legacy=0x7fe2f00d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.041+0000 7fe2ef7fe640 1 -- 172.21.15.17:0/765528681 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00cdff0 con 0x7fe2f015ce90 2023-08-09T12:47:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.042+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/765528681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f01616e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00c9c00 tx=0x7fe2e002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4136821e3e584029 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2eeffd640 1 -- 172.21.15.17:0/765528681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e002cb10 con 0x7fe2f015ce90 2023-08-09T12:47:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2eeffd640 1 -- 172.21.15.17:0/765528681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e002cc70 con 0x7fe2f015ce90 2023-08-09T12:47:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2eeffd640 1 -- 172.21.15.17:0/765528681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00343f0 con 0x7fe2f015ce90 2023-08-09T12:47:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2f5f84640 1 -- 172.21.15.17:0/765528681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 msgr2=0x7fe2f01616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/765528681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f01616e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00c9c00 tx=0x7fe2e002bf70 comp rx=0 tx=0).stop 2023-08-09T12:47:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2f5f84640 1 -- 172.21.15.17:0/765528681 shutdown_connections 2023-08-09T12:47:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/765528681 >> v2:172.21.15.142:3300/0 conn(0x7fe2f00b6000 0x7fe2f00cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/765528681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f01616e0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2f5f84640 1 -- 172.21.15.17:0/765528681 >> 172.21.15.17:0/765528681 conn(0x7fe2f006fde0 msgr2=0x7fe2f00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2f5f84640 1 -- 172.21.15.17:0/765528681 shutdown_connections 2023-08-09T12:47:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.043+0000 7fe2f5f84640 1 -- 172.21.15.17:0/765528681 wait complete. 2023-08-09T12:47:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.045+0000 7fe2f5f84640 1 Processor -- start 2023-08-09T12:47:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.045+0000 7fe2f5f84640 1 -- start start 2023-08-09T12:47:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.046+0000 7fe2f5f84640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f00b6000 0x7fe2f01f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.046+0000 7fe2f5f84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f00d29d0 0x7fe2f00cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.046+0000 7fe2f5f84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f0154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.046+0000 7fe2f5f84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f01581b0 con 0x7fe2f015ce90 2023-08-09T12:47:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.046+0000 7fe2f5f84640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00cb0d0 con 0x7fe2f00d29d0 2023-08-09T12:47:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.046+0000 7fe2f5f84640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0154a50 con 0x7fe2f00b6000 2023-08-09T12:47:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f0154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f0154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38684/0 (socket says 172.21.15.17:38684) 2023-08-09T12:47:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 -- 172.21.15.17:0/447706071 learned_addr learned my addr 172.21.15.17:0/447706071 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2e6ffd640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f00d29d0 0x7fe2f00cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f00b6000 0x7fe2f01f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 -- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f00b6000 msgr2=0x7fe2f01f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f00b6000 0x7fe2f01f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 -- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f00d29d0 msgr2=0x7fe2f00cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f00d29d0 0x7fe2f00cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 -- 172.21.15.17:0/447706071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0009b30 con 0x7fe2f015ce90 2023-08-09T12:47:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f00b6000 0x7fe2f01f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.047+0000 7fe2effff640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f0154510 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c400 tx=0x7fe2e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.048+0000 7fe2ecff9640 1 -- 172.21.15.17:0/447706071 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e80052d0 con 0x7fe2f015ce90 2023-08-09T12:47:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.048+0000 7fe2ecff9640 1 -- 172.21.15.17:0/447706071 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e8005430 con 0x7fe2f015ce90 2023-08-09T12:47:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.048+0000 7fe2ecff9640 1 -- 172.21.15.17:0/447706071 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8003810 con 0x7fe2f015ce90 2023-08-09T12:47:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.048+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f00cadd0 con 0x7fe2f015ce90 2023-08-09T12:47:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.048+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f0158400 con 0x7fe2f015ce90 2023-08-09T12:47:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.049+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f0067a80 con 0x7fe2f015ce90 2023-08-09T12:47:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.050+0000 7fe2ecff9640 1 -- 172.21.15.17:0/447706071 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2e8003970 con 0x7fe2f015ce90 2023-08-09T12:47:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.052+0000 7fe2ecff9640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe2d006a020 0x7fe2d006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.052+0000 7fe2ecff9640 1 -- 172.21.15.17:0/447706071 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2e8087b40 con 0x7fe2f015ce90 2023-08-09T12:47:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.052+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe2d006a020 0x7fe2d006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.053+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe2d006a020 0x7fe2d006c4e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0035000 tx=0x7fe2e0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.056+0000 7fe2ecff9640 1 -- 172.21.15.17:0/447706071 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe2e8053220 con 0x7fe2f015ce90 2023-08-09T12:47:10.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.288+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2f00ce2a0 con 0x7fe2f015ce90 2023-08-09T12:47:10.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.289+0000 7fe2ecff9640 1 -- 172.21.15.17:0/447706071 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4880 (secure 0 0 0) 0x7fe2e8056840 con 0x7fe2f015ce90 2023-08-09T12:47:10.293 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:10.293 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:46:54.580315+0000","modified":"2023-08-09T12:46:58.167844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1719182807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1719182807},{"type":"v1","addr":"172.21.15.17:6835","nonce":1719182807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-09T12:47:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 59 2023-08-09T12:47:10.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe2d006a020 msgr2=0x7fe2d006c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe2d006a020 0x7fe2d006c4e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0035000 tx=0x7fe2e0030000 comp rx=0 tx=0).stop 2023-08-09T12:47:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 msgr2=0x7fe2f0154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f0154510 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c400 tx=0x7fe2e800c8c0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 shutdown_connections 2023-08-09T12:47:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe2d006a020 0x7fe2d006c4e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f015ce90 0x7fe2f0154510 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f00d29d0 0x7fe2f00cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 --2- 172.21.15.17:0/447706071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f00b6000 0x7fe2f01f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 >> 172.21.15.17:0/447706071 conn(0x7fe2f006fde0 msgr2=0x7fe2f00b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 shutdown_connections 2023-08-09T12:47:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10.292+0000 7fe2f5f84640 1 -- 172.21.15.17:0/447706071 wait complete. 2023-08-09T12:47:10.313 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 133 2023-08-09T12:47:10.551 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-08-09T12:47:10.551 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:47:10.552 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:47:10.552 DEBUG:teuthology.orchestra.run.smithi017:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-08-09T12:47:10.552 DEBUG:teuthology.orchestra.run.smithi017:> os.fchmod(fd, 0O666) 2023-08-09T12:47:10.553 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(fd) 2023-08-09T12:47:10.553 DEBUG:teuthology.orchestra.run.smithi017:> os.close(fd) 2023-08-09T12:47:10.553 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:47:10.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:47:10.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:10.728 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:47:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:client6118 2023-08-09T12:47:10.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:10.838 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client6118/osdmap') 2023-08-09T12:47:10.943 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 133 barrier 133 flags 0x588000 2023-08-09T12:47:10.943 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:10.944 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:10.944 INFO:teuthology.orchestra.run.smithi017.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:10.944 INFO:teuthology.orchestra.run.smithi017.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:10.944 INFO:teuthology.orchestra.run.smithi017.stdout:osd0 (1)172.21.15.17:6809 100% (exists, up) 100% -1 2023-08-09T12:47:10.945 INFO:teuthology.orchestra.run.smithi017.stdout:osd1 (1)172.21.15.17:6817 100% (exists, up) 100% -1 2023-08-09T12:47:10.945 INFO:teuthology.orchestra.run.smithi017.stdout:osd2 (1)172.21.15.17:6801 100% (exists, up) 100% -1 2023-08-09T12:47:10.945 INFO:teuthology.orchestra.run.smithi017.stdout:osd3 (1)172.21.15.17:6825 100% (exists, up) 100% -1 2023-08-09T12:47:10.945 INFO:teuthology.orchestra.run.smithi017.stdout:osd4 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-08-09T12:47:10.945 INFO:teuthology.orchestra.run.smithi017.stdout:osd5 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-08-09T12:47:10.946 INFO:teuthology.orchestra.run.smithi017.stdout:osd6 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-08-09T12:47:10.946 INFO:teuthology.orchestra.run.smithi017.stdout:osd7 (1)172.21.15.142:6817 100% (exists, up) 100% -1 2023-08-09T12:47:10.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records in 2023-08-09T12:47:10.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records out 2023-08-09T12:47:10.947 INFO:teuthology.orchestra.run.smithi017.stderr:904 bytes copied, 9.8327e-05 s, 9.2 MB/s 2023-08-09T12:47:10.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:10.948 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:47:11.012 INFO:teuthology.orchestra.run.smithi017.stdout:client6118 2023-08-09T12:47:11.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:11.014 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/00c647bf-6030-4006-bfa6-56fa996e3ac5.client6118/osdmap') 2023-08-09T12:47:11.121 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 133 barrier 133 flags 0x588000 2023-08-09T12:47:11.121 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:11.121 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:11.121 INFO:teuthology.orchestra.run.smithi017.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:11.121 INFO:teuthology.orchestra.run.smithi017.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-08-09T12:47:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd0 (1)172.21.15.17:6809 100% (exists, up) 100% -1 2023-08-09T12:47:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd1 (1)172.21.15.17:6817 100% (exists, up) 100% -1 2023-08-09T12:47:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd2 (1)172.21.15.17:6801 100% (exists, up) 100% -1 2023-08-09T12:47:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd3 (1)172.21.15.17:6825 100% (exists, up) 100% -1 2023-08-09T12:47:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd4 (1)172.21.15.142:6809 100% (exists, up) 100% -1 2023-08-09T12:47:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd5 (1)172.21.15.142:6801 100% (exists, up) 100% -1 2023-08-09T12:47:11.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd6 (1)172.21.15.142:6823 100% (exists, up) 100% -1 2023-08-09T12:47:11.123 INFO:teuthology.orchestra.run.smithi017.stdout:osd7 (1)172.21.15.142:6817 100% (exists, up) 100% -1 2023-08-09T12:47:11.123 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records in 2023-08-09T12:47:11.123 INFO:teuthology.orchestra.run.smithi017.stderr:1+1 records out 2023-08-09T12:47:11.123 INFO:teuthology.orchestra.run.smithi017.stderr:904 bytes copied, 0.000126514 s, 7.1 MB/s 2023-08-09T12:47:11.125 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:47:11.125 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:47:11.126 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:47:11.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:47:11.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:47:11.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:47:11.372 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:47:11.373 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:11.373 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:11.438 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:11.439 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:11.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:11.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.720+0000 7fccdbfff640 1 Processor -- start 2023-08-09T12:47:11.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.721+0000 7fccdbfff640 1 -- start start 2023-08-09T12:47:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.722+0000 7fccdbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 0x7fccdc0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.722+0000 7fccdbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fccdc0cb610 0x7fccdc0c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.722+0000 7fccdbfff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0b34a0 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.722+0000 7fccdbfff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0b4120 con 0x7fccdc0cb610 2023-08-09T12:47:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.722+0000 7fccdbfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b3780 con 0x7fccdc1601f0 2023-08-09T12:47:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fccdc0cb610 0x7fccdc0c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fccdc0cb610 0x7fccdc0c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38700/0 (socket says 172.21.15.17:38700) 2023-08-09T12:47:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdb7fe640 1 -- 172.21.15.17:0/1625884188 learned_addr learned my addr 172.21.15.17:0/1625884188 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdaffd640 1 --2- 172.21.15.17:0/1625884188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 0x7fccdc0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdb7fe640 1 -- 172.21.15.17:0/1625884188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 msgr2=0x7fccdc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdb7fe640 1 --2- 172.21.15.17:0/1625884188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 0x7fccdc0b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdb7fe640 1 -- 172.21.15.17:0/1625884188 >> v1:172.21.15.17:6789/0 conn(0x7fccdc0b2ee0 legacy=0x7fccdc0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:11.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdb7fe640 1 -- 172.21.15.17:0/1625884188 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0b3a60 con 0x7fccdc0cb610 2023-08-09T12:47:11.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.723+0000 7fccdaffd640 1 --2- 172.21.15.17:0/1625884188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 0x7fccdc0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.724+0000 7fccdb7fe640 1 --2- 172.21.15.17:0/1625884188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0cb610 0x7fccdc0c2240 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009870 tx=0x7fccd402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d5959b3b4d4081 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccda7fc640 1 -- 172.21.15.17:0/1625884188 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4030840 con 0x7fccdc0cb610 2023-08-09T12:47:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccda7fc640 1 -- 172.21.15.17:0/1625884188 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd40309a0 con 0x7fccdc0cb610 2023-08-09T12:47:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccda7fc640 1 -- 172.21.15.17:0/1625884188 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4030d30 con 0x7fccdc0cb610 2023-08-09T12:47:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccdbfff640 1 -- 172.21.15.17:0/1625884188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0cb610 msgr2=0x7fccdc0c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccdbfff640 1 --2- 172.21.15.17:0/1625884188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0cb610 0x7fccdc0c2240 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009870 tx=0x7fccd402b980 comp rx=0 tx=0).stop 2023-08-09T12:47:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccdbfff640 1 -- 172.21.15.17:0/1625884188 shutdown_connections 2023-08-09T12:47:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccdbfff640 1 --2- 172.21.15.17:0/1625884188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0cb610 0x7fccdc0c2240 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccdbfff640 1 --2- 172.21.15.17:0/1625884188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 0x7fccdc0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.725+0000 7fccdbfff640 1 -- 172.21.15.17:0/1625884188 >> 172.21.15.17:0/1625884188 conn(0x7fccdc0b1d50 msgr2=0x7fccdc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.726+0000 7fccdbfff640 1 -- 172.21.15.17:0/1625884188 shutdown_connections 2023-08-09T12:47:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.726+0000 7fccdbfff640 1 -- 172.21.15.17:0/1625884188 wait complete. 2023-08-09T12:47:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.727+0000 7fccdbfff640 1 Processor -- start 2023-08-09T12:47:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.728+0000 7fccdbfff640 1 -- start start 2023-08-09T12:47:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.728+0000 7fccdbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0b2ee0 0x7fccdc1f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.728+0000 7fccdbfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc0cb610 0x7fccdc155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.728+0000 7fccdbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 0x7fccdc1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:11.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.728+0000 7fccdbfff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c3d90 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.728+0000 7fccdbfff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c4070 con 0x7fccdc0cb610 2023-08-09T12:47:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.728+0000 7fccdbfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c4350 con 0x7fccdc1601f0 2023-08-09T12:47:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccdaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0b2ee0 0x7fccdc1f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccdaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0b2ee0 0x7fccdc1f19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38706/0 (socket says 172.21.15.17:38706) 2023-08-09T12:47:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccdaffd640 1 -- 172.21.15.17:0/2559624520 learned_addr learned my addr 172.21.15.17:0/2559624520 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccdaffd640 1 -- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 msgr2=0x7fccdc1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccdaffd640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 0x7fccdc1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccdaffd640 1 -- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc0cb610 msgr2=0x7fccdc155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccd27fc640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc0cb610 0x7fccdc155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccdaffd640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc0cb610 0x7fccdc155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccdaffd640 1 -- 172.21.15.17:0/2559624520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40094d0 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.729+0000 7fccd27fc640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc0cb610 0x7fccdc155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.730+0000 7fccdaffd640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0b2ee0 0x7fccdc1f19c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00ce00 tx=0x7fcccc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.730+0000 7fccd3fff640 1 -- 172.21.15.17:0/2559624520 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00f890 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.730+0000 7fccd3fff640 1 -- 172.21.15.17:0/2559624520 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc00f9f0 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.730+0000 7fccd3fff640 1 -- 172.21.15.17:0/2559624520 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00fdc0 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.730+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc0c4630 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.730+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc1f1f00 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.731+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc04e390 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.732+0000 7fccd3fff640 1 -- 172.21.15.17:0/2559624520 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcccc00b040 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.733+0000 7fccd3fff640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccbc06a050 0x7fccbc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:11.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.733+0000 7fccd3fff640 1 -- 172.21.15.17:0/2559624520 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcccc088fc0 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.734+0000 7fccd27fc640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccbc06a050 0x7fccbc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:11.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.735+0000 7fccd27fc640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccbc06a050 0x7fccbc06c510 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0c9ee0 tx=0x7fccc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:11.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.738+0000 7fccd3fff640 1 -- 172.21.15.17:0/2559624520 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcccc0546a0 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.932+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccdc0c84f0 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.935+0000 7fccd3fff640 1 -- 172.21.15.17:0/2559624520 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+18278 (secure 0 0 0) 0x7fcccc01d020 con 0x7fccdc0b2ee0 2023-08-09T12:47:11.939 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:11.939 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":133,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:08.924888+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:11.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.938+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccbc06a050 msgr2=0x7fccbc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:11.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.938+0000 7fccdbfff640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccbc06a050 0x7fccbc06c510 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0c9ee0 tx=0x7fccc4009040 comp rx=0 tx=0).stop 2023-08-09T12:47:11.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.938+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0b2ee0 msgr2=0x7fccdc1f19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:11.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.938+0000 7fccdbfff640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0b2ee0 0x7fccdc1f19c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00ce00 tx=0x7fcccc00a650 comp rx=0 tx=0).stop 2023-08-09T12:47:11.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.939+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 shutdown_connections 2023-08-09T12:47:11.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.939+0000 7fccdbfff640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fccbc06a050 0x7fccbc06c510 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.939+0000 7fccdbfff640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc1601f0 0x7fccdc1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.939+0000 7fccdbfff640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc0cb610 0x7fccdc155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.939+0000 7fccdbfff640 1 --2- 172.21.15.17:0/2559624520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc0b2ee0 0x7fccdc1f19c0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:11.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.939+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 >> 172.21.15.17:0/2559624520 conn(0x7fccdc0b1d50 msgr2=0x7fccdc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:11.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.939+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 shutdown_connections 2023-08-09T12:47:11.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:11.939+0000 7fccdbfff640 1 -- 172.21.15.17:0/2559624520 wait complete. 2023-08-09T12:47:11.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:46:52.804156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:46:53.615239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:47:11.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:47:12.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.195+0000 7effcfb57640 1 Processor -- start 2023-08-09T12:47:12.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.195+0000 7effcfb57640 1 -- start start 2023-08-09T12:47:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.197+0000 7effcfb57640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7effc8161660 0x7effc80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.197+0000 7effcfb57640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc80ad240 con 0x7effc80acdf0 2023-08-09T12:47:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.197+0000 7effcfb57640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc815df30 con 0x7effc8161280 2023-08-09T12:47:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.197+0000 7effcfb57640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc815d430 con 0x7effc8161660 2023-08-09T12:47:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.197+0000 7effce0f4640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7effc80acdf0 0x7effc80cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34642/0 (socket says 172.21.15.17:34642) 2023-08-09T12:47:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.197+0000 7effce0f4640 1 -- 172.21.15.17:0/2899625628 learned_addr learned my addr 172.21.15.17:0/2899625628 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcd0f2640 1 --2- 172.21.15.17:0/2899625628 >> v2:172.21.15.142:3300/0 conn(0x7effc8161660 0x7effc80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202968398 0 0) 0x7effc0001490 con 0x7effc80acdf0 2023-08-09T12:47:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb4003520 con 0x7effc80acdf0 2023-08-09T12:47:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1985750764 0 0) 0x7effb4003520 con 0x7effc80acdf0 2023-08-09T12:47:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 >> v2:172.21.15.142:3300/0 conn(0x7effc8161660 msgr2=0x7effc80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 --2- 172.21.15.17:0/2899625628 >> v2:172.21.15.142:3300/0 conn(0x7effc8161660 0x7effc80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 >> v1:172.21.15.142:6789/0 conn(0x7effc8161280 legacy=0x7effc80c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80ca9d0 con 0x7effc80acdf0 2023-08-09T12:47:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7effc0001b80 con 0x7effc80acdf0 2023-08-09T12:47:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 >> v1:172.21.15.17:6789/0 conn(0x7effc80acdf0 legacy=0x7effc80cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effb4003970 0x7effb4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb40047c0 0x7effb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effb400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb400c120 con 0x7effb40052a0 2023-08-09T12:47:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb400c290 con 0x7effb40047c0 2023-08-09T12:47:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.198+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb400c450 con 0x7effb4003970 2023-08-09T12:47:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effce0f4640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effb400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effcd0f2640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb40047c0 0x7effb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effce0f4640 1 -- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effb4003970 msgr2=0x7effb4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:12.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effcd8f3640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effb4003970 0x7effb4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effce0f4640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effb4003970 0x7effb4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effce0f4640 1 -- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb40047c0 msgr2=0x7effb4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:12.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effce0f4640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effb40047c0 0x7effb4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effce0f4640 1 -- 172.21.15.17:0/2899625628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4003520 con 0x7effb40052a0 2023-08-09T12:47:12.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.199+0000 7effcd8f3640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effb4003970 0x7effb4003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:12.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.200+0000 7effce0f4640 1 -- 172.21.15.17:0/2899625628 reap_dead start 2023-08-09T12:47:12.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.200+0000 7effce0f4640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effb400b980 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7effc000a810 tx=0x7effb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5c745d7648dfb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:12.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.201+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0034630 con 0x7effb40052a0 2023-08-09T12:47:12.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.201+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc002f070 con 0x7effb40052a0 2023-08-09T12:47:12.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.201+0000 7effcc8f1640 1 -- 172.21.15.17:0/2899625628 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00349f0 con 0x7effb40052a0 2023-08-09T12:47:12.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.201+0000 7effcfb57640 1 -- 172.21.15.17:0/2899625628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 msgr2=0x7effb400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.201+0000 7effcfb57640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effb400b980 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7effc000a810 tx=0x7effb40057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.202+0000 7effcfb57640 1 -- 172.21.15.17:0/2899625628 shutdown_connections 2023-08-09T12:47:12.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.202+0000 7effcfb57640 1 --2- 172.21.15.17:0/2899625628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effb400b980 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.202+0000 7effcfb57640 1 -- 172.21.15.17:0/2899625628 >> 172.21.15.17:0/2899625628 conn(0x7effc80cb1b0 msgr2=0x7effc80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:12.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.202+0000 7effcfb57640 1 -- 172.21.15.17:0/2899625628 shutdown_connections 2023-08-09T12:47:12.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.202+0000 7effcfb57640 1 -- 172.21.15.17:0/2899625628 wait complete. 2023-08-09T12:47:12.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.204+0000 7effcfb57640 1 Processor -- start 2023-08-09T12:47:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.204+0000 7effcfb57640 1 -- start start 2023-08-09T12:47:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcfb57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effc80c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcfb57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effc80c8190 0x7effc8150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcfb57640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effc80c5770 0x7effc80c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcfb57640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80c7d70 con 0x7effb40052a0 2023-08-09T12:47:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcfb57640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80c70f0 con 0x7effc80c5770 2023-08-09T12:47:12.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcfb57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80c73d0 con 0x7effc80c8190 2023-08-09T12:47:12.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcd8f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effc80c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcd8f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effc80c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38714/0 (socket says 172.21.15.17:38714) 2023-08-09T12:47:12.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcd8f3640 1 -- 172.21.15.17:0/2960746263 learned_addr learned my addr 172.21.15.17:0/2960746263 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:12.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcd8f3640 1 -- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effc80c8190 msgr2=0x7effc8150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcd8f3640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effc80c8190 0x7effc8150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effce0f4640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effc80c5770 0x7effc80c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcd8f3640 1 -- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effc80c5770 msgr2=0x7effc80c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.206+0000 7effcd8f3640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effc80c5770 0x7effc80c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.207+0000 7effcd8f3640 1 -- 172.21.15.17:0/2960746263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80c76b0 con 0x7effb40052a0 2023-08-09T12:47:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.207+0000 7effcd8f3640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effc80c68a0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7effc400d590 tx=0x7effc400da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.207+0000 7effbe7fc640 1 -- 172.21.15.17:0/2960746263 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4007220 con 0x7effb40052a0 2023-08-09T12:47:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.207+0000 7effbe7fc640 1 -- 172.21.15.17:0/2960746263 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc40073a0 con 0x7effb40052a0 2023-08-09T12:47:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.207+0000 7effbe7fc640 1 -- 172.21.15.17:0/2960746263 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc40067d0 con 0x7effb40052a0 2023-08-09T12:47:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.207+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc80c7990 con 0x7effb40052a0 2023-08-09T12:47:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.207+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc8151110 con 0x7effb40052a0 2023-08-09T12:47:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.209+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc815e3a0 con 0x7effb40052a0 2023-08-09T12:47:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.209+0000 7effbe7fc640 1 -- 172.21.15.17:0/2960746263 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7effc4006930 con 0x7effb40052a0 2023-08-09T12:47:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.210+0000 7effbe7fc640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effac06a080 0x7effac06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.211+0000 7effbe7fc640 1 -- 172.21.15.17:0/2960746263 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6091+0+0 (secure 0 0 0) 0x7effc4088310 con 0x7effb40052a0 2023-08-09T12:47:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.211+0000 7effcd0f2640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effac06a080 0x7effac06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.212+0000 7effcd0f2640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effac06a080 0x7effac06c540 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7effc80c4bd0 tx=0x7effb800d240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.215+0000 7effbe7fc640 1 -- 172.21.15.17:0/2960746263 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7effc815e3a0 con 0x7effb40052a0 2023-08-09T12:47:12.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.407+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effc80c7eb0 con 0x7effb40052a0 2023-08-09T12:47:12.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.408+0000 7effbe7fc640 1 -- 172.21.15.17:0/2960746263 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7effc80c7eb0 con 0x7effb40052a0 2023-08-09T12:47:12.411 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:47:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effac06a080 msgr2=0x7effac06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effac06a080 0x7effac06c540 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7effc80c4bd0 tx=0x7effb800d240 comp rx=0 tx=0).stop 2023-08-09T12:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 msgr2=0x7effc80c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effc80c68a0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7effc400d590 tx=0x7effc400da50 comp rx=0 tx=0).stop 2023-08-09T12:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 shutdown_connections 2023-08-09T12:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7effac06a080 0x7effac06c540 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effc80c5770 0x7effc80c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effc80c8190 0x7effc8150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 --2- 172.21.15.17:0/2960746263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb40052a0 0x7effc80c68a0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 >> 172.21.15.17:0/2960746263 conn(0x7effc80cb1b0 msgr2=0x7effc80703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 shutdown_connections 2023-08-09T12:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.411+0000 7effcfb57640 1 -- 172.21.15.17:0/2960746263 wait complete. 2023-08-09T12:47:12.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:47:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.665+0000 7f099c6ec640 1 Processor -- start 2023-08-09T12:47:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.665+0000 7f099c6ec640 1 -- start start 2023-08-09T12:47:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.667+0000 7f099c6ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0994161280 0x7f09940c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.667+0000 7f099c6ec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f09940acfc0 0x7f09940cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.667+0000 7f099c6ec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099415df30 con 0x7f0994161660 2023-08-09T12:47:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.667+0000 7f099c6ec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099415d430 con 0x7f09940acfc0 2023-08-09T12:47:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.667+0000 7f099c6ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940ca9d0 con 0x7f0994161280 2023-08-09T12:47:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.667+0000 7f099ac89640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f09940acfc0 0x7f09940cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.668+0000 7f099ac89640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f09940acfc0 0x7f09940cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38720/0 (socket says 172.21.15.17:38720) 2023-08-09T12:47:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.668+0000 7f099ac89640 1 -- 172.21.15.17:0/1201054484 learned_addr learned my addr 172.21.15.17:0/1201054484 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.668+0000 7f099a488640 1 --2- 172.21.15.17:0/1201054484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0994161280 0x7f09940c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.668+0000 7f099ac89640 1 -- 172.21.15.17:0/1201054484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0994161280 msgr2=0x7f09940c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.668+0000 7f099ac89640 1 --2- 172.21.15.17:0/1201054484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0994161280 0x7f09940c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.668+0000 7f099ac89640 1 -- 172.21.15.17:0/1201054484 >> v1:172.21.15.142:6789/0 conn(0x7f0994161660 legacy=0x7f09940ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.668+0000 7f099ac89640 1 -- 172.21.15.17:0/1201054484 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099415e3c0 con 0x7f09940acfc0 2023-08-09T12:47:12.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.670+0000 7f099ac89640 1 --2- 172.21.15.17:0/1201054484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09940acfc0 0x7f09940cc630 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f098c009e50 tx=0x7f098c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d349a255c542de server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:12.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.670+0000 7f0999486640 1 -- 172.21.15.17:0/1201054484 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c02ca80 con 0x7f09940acfc0 2023-08-09T12:47:12.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.670+0000 7f0999486640 1 -- 172.21.15.17:0/1201054484 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c02cbe0 con 0x7f09940acfc0 2023-08-09T12:47:12.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.670+0000 7f0999486640 1 -- 172.21.15.17:0/1201054484 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0343f0 con 0x7f09940acfc0 2023-08-09T12:47:12.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.671+0000 7f099c6ec640 1 -- 172.21.15.17:0/1201054484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09940acfc0 msgr2=0x7f09940cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.671+0000 7f099c6ec640 1 --2- 172.21.15.17:0/1201054484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09940acfc0 0x7f09940cc630 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f098c009e50 tx=0x7f098c02bee0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.671+0000 7f099c6ec640 1 -- 172.21.15.17:0/1201054484 shutdown_connections 2023-08-09T12:47:12.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.671+0000 7f099c6ec640 1 --2- 172.21.15.17:0/1201054484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09940acfc0 0x7f09940cc630 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.671+0000 7f099c6ec640 1 --2- 172.21.15.17:0/1201054484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0994161280 0x7f09940c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.671+0000 7f099c6ec640 1 -- 172.21.15.17:0/1201054484 >> 172.21.15.17:0/1201054484 conn(0x7f09940cb1b0 msgr2=0x7f09940cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:12.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.671+0000 7f099c6ec640 1 -- 172.21.15.17:0/1201054484 shutdown_connections 2023-08-09T12:47:12.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.671+0000 7f099c6ec640 1 -- 172.21.15.17:0/1201054484 wait complete. 2023-08-09T12:47:12.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.673+0000 7f099c6ec640 1 Processor -- start 2023-08-09T12:47:12.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.673+0000 7f099c6ec640 1 -- start start 2023-08-09T12:47:12.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.674+0000 7f099c6ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09940acfc0 0x7f09941f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.674+0000 7f099c6ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0994161280 0x7f09941f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.674+0000 7f099c6ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0994161660 0x7f09940c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.674+0000 7f099c6ec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994155d20 con 0x7f0994161660 2023-08-09T12:47:12.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.674+0000 7f099c6ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994156000 con 0x7f0994161280 2023-08-09T12:47:12.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.674+0000 7f099c6ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09941562e0 con 0x7f09940acfc0 2023-08-09T12:47:12.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.674+0000 7f099ac89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0994161660 0x7f09940c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099ac89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0994161660 0x7f09940c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38722/0 (socket says 172.21.15.17:38722) 2023-08-09T12:47:12.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099ac89640 1 -- 172.21.15.17:0/3353808510 learned_addr learned my addr 172.21.15.17:0/3353808510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:12.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f0999c87640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0994161280 0x7f09941f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099a488640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09940acfc0 0x7f09941f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099ac89640 1 -- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09940acfc0 msgr2=0x7f09941f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099ac89640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09940acfc0 0x7f09941f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099ac89640 1 -- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0994161280 msgr2=0x7f09941f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099ac89640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0994161280 0x7f09941f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099ac89640 1 -- 172.21.15.17:0/3353808510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009b30 con 0x7f0994161660 2023-08-09T12:47:12.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099a488640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09940acfc0 0x7f09941f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:12.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f0999c87640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0994161280 0x7f09941f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:47:12.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.675+0000 7f099ac89640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0994161660 0x7f09940c6260 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f098c009e50 tx=0x7f098c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:12.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.676+0000 7f098affd640 1 -- 172.21.15.17:0/3353808510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c009510 con 0x7f0994161660 2023-08-09T12:47:12.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.676+0000 7f098affd640 1 -- 172.21.15.17:0/3353808510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c03e450 con 0x7f0994161660 2023-08-09T12:47:12.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.676+0000 7f098affd640 1 -- 172.21.15.17:0/3353808510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c03e800 con 0x7f0994161660 2023-08-09T12:47:12.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.676+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09941565c0 con 0x7f0994161660 2023-08-09T12:47:12.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.676+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09941f2670 con 0x7f0994161660 2023-08-09T12:47:12.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.677+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994156800 con 0x7f0994161660 2023-08-09T12:47:12.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.678+0000 7f098affd640 1 -- 172.21.15.17:0/3353808510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f098c02cd50 con 0x7f0994161660 2023-08-09T12:47:12.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.679+0000 7f098affd640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f097806a050 0x7f097806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:12.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.680+0000 7f098affd640 1 -- 172.21.15.17:0/3353808510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f098c0ab140 con 0x7f0994161660 2023-08-09T12:47:12.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.680+0000 7f099a488640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f097806a050 0x7f097806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:12.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.681+0000 7f099a488640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f097806a050 0x7f097806c510 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0990006fd0 tx=0x7f0990008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:12.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.684+0000 7f098affd640 1 -- 172.21.15.17:0/3353808510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0994156800 con 0x7f0994161660 2023-08-09T12:47:12.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.880+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0994156800 con 0x7f0994161660 2023-08-09T12:47:12.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.881+0000 7f098affd640 1 -- 172.21.15.17:0/3353808510 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v134) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0994156800 con 0x7f0994161660 2023-08-09T12:47:12.884 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:47:12.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f097806a050 msgr2=0x7f097806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f097806a050 0x7f097806c510 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0990006fd0 tx=0x7f0990008040 comp rx=0 tx=0).stop 2023-08-09T12:47:12.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0994161660 msgr2=0x7f09940c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:12.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0994161660 0x7f09940c6260 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f098c009e50 tx=0x7f098c004a40 comp rx=0 tx=0).stop 2023-08-09T12:47:12.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 shutdown_connections 2023-08-09T12:47:12.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f097806a050 0x7f097806c510 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0994161660 0x7f09940c6260 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0994161280 0x7f09941f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 --2- 172.21.15.17:0/3353808510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09940acfc0 0x7f09941f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:12.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 >> 172.21.15.17:0/3353808510 conn(0x7f09940cb1b0 msgr2=0x7f099406aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:12.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 shutdown_connections 2023-08-09T12:47:12.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:12.883+0000 7f099c6ec640 1 -- 172.21.15.17:0/3353808510 wait complete. 2023-08-09T12:47:12.905 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:47:13.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.122+0000 7f81110cd640 1 Processor -- start 2023-08-09T12:47:13.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.122+0000 7f81110cd640 1 -- start start 2023-08-09T12:47:13.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f81110cd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f810c0caff0 0x7f810c0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f81110cd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c165470 0x7f810c0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f81110cd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0ad700 con 0x7f810c0697c0 2023-08-09T12:47:13.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f81110cd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0adf10 con 0x7f810c0caff0 2023-08-09T12:47:13.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f81110cd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0cb910 con 0x7f810c165470 2023-08-09T12:47:13.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f81108cc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f810c0697c0 0x7f810c069c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34654/0 (socket says 172.21.15.17:34654) 2023-08-09T12:47:13.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f81108cc640 1 -- 172.21.15.17:0/3820740237 learned_addr learned my addr 172.21.15.17:0/3820740237 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:13.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f810bfff640 1 --2- 172.21.15.17:0/3820740237 >> v2:172.21.15.142:3300/0 conn(0x7f810c0caff0 0x7f810c0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.124+0000 7f81037fe640 1 --2- 172.21.15.17:0/3820740237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c165470 0x7f810c0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.125+0000 7f810b7fe640 1 -- 172.21.15.17:0/3820740237 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544664281 0 0) 0x7f810c0ad700 con 0x7f810c0697c0 2023-08-09T12:47:13.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.125+0000 7f810b7fe640 1 -- 172.21.15.17:0/3820740237 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f8003520 con 0x7f810c0697c0 2023-08-09T12:47:13.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.125+0000 7f81037fe640 1 -- 172.21.15.17:0/3820740237 >> v2:172.21.15.142:3300/0 conn(0x7f810c0caff0 msgr2=0x7f810c0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:13.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.125+0000 7f810b7fe640 1 -- 172.21.15.17:0/3820740237 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4206733202 0 0) 0x7f80f8003520 con 0x7f810c0697c0 2023-08-09T12:47:13.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.125+0000 7f81037fe640 1 --2- 172.21.15.17:0/3820740237 >> v2:172.21.15.142:3300/0 conn(0x7f810c0caff0 0x7f810c0c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.125+0000 7f81037fe640 1 -- 172.21.15.17:0/3820740237 >> v1:172.21.15.17:6789/0 conn(0x7f810c0697c0 legacy=0x7f810c069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.125+0000 7f81037fe640 1 -- 172.21.15.17:0/3820740237 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0c9a20 con 0x7f810c165470 2023-08-09T12:47:13.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.125+0000 7f810bfff640 1 --2- 172.21.15.17:0/3820740237 >> v2:172.21.15.142:3300/0 conn(0x7f810c0caff0 0x7f810c0c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:47:13.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.127+0000 7f81037fe640 1 --2- 172.21.15.17:0/3820740237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c165470 0x7f810c0cb3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f80f40097a0 tx=0x7f80f402b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d6b70aa3bd9f6a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:13.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.127+0000 7f810b7fe640 1 -- 172.21.15.17:0/3820740237 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104001670 con 0x7f810c165470 2023-08-09T12:47:13.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.127+0000 7f810b7fe640 1 -- 172.21.15.17:0/3820740237 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f402e050 con 0x7f810c165470 2023-08-09T12:47:13.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.127+0000 7f810b7fe640 1 -- 172.21.15.17:0/3820740237 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4030730 con 0x7f810c165470 2023-08-09T12:47:13.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.128+0000 7f81110cd640 1 -- 172.21.15.17:0/3820740237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c165470 msgr2=0x7f810c0cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.128+0000 7f81110cd640 1 --2- 172.21.15.17:0/3820740237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c165470 0x7f810c0cb3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f80f40097a0 tx=0x7f80f402b710 comp rx=0 tx=0).stop 2023-08-09T12:47:13.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.128+0000 7f81110cd640 1 -- 172.21.15.17:0/3820740237 shutdown_connections 2023-08-09T12:47:13.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.128+0000 7f81110cd640 1 --2- 172.21.15.17:0/3820740237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c165470 0x7f810c0cb3d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.128+0000 7f81110cd640 1 --2- 172.21.15.17:0/3820740237 >> v2:172.21.15.142:3300/0 conn(0x7f810c0caff0 0x7f810c0c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.128+0000 7f81110cd640 1 -- 172.21.15.17:0/3820740237 >> 172.21.15.17:0/3820740237 conn(0x7f810c06abd0 msgr2=0x7f810c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:13.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.128+0000 7f81110cd640 1 -- 172.21.15.17:0/3820740237 shutdown_connections 2023-08-09T12:47:13.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.128+0000 7f81110cd640 1 -- 172.21.15.17:0/3820740237 wait complete. 2023-08-09T12:47:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.130+0000 7f81110cd640 1 Processor -- start 2023-08-09T12:47:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.130+0000 7f81110cd640 1 -- start start 2023-08-09T12:47:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.131+0000 7f81110cd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810c0697c0 0x7f810c15b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.131+0000 7f81110cd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c0caff0 0x7f810c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.131+0000 7f81110cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c165470 0x7f810c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.131+0000 7f81110cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c15cc90 con 0x7f810c165470 2023-08-09T12:47:13.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.131+0000 7f81110cd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c157010 con 0x7f810c0697c0 2023-08-09T12:47:13.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.131+0000 7f81110cd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c15c010 con 0x7f810c0caff0 2023-08-09T12:47:13.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81108cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c165470 0x7f810c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81108cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c165470 0x7f810c156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38738/0 (socket says 172.21.15.17:38738) 2023-08-09T12:47:13.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81108cc640 1 -- 172.21.15.17:0/3200296253 learned_addr learned my addr 172.21.15.17:0/3200296253 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f810bfff640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810c0697c0 0x7f810c15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81037fe640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c0caff0 0x7f810c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81108cc640 1 -- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c0caff0 msgr2=0x7f810c1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81108cc640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c0caff0 0x7f810c1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81108cc640 1 -- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810c0697c0 msgr2=0x7f810c15b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81108cc640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810c0697c0 0x7f810c15b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.132+0000 7f81108cc640 1 -- 172.21.15.17:0/3200296253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc009a70 con 0x7f810c165470 2023-08-09T12:47:13.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.133+0000 7f81108cc640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c165470 0x7f810c156ad0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f810400c750 tx=0x7f810400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:13.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.133+0000 7f81097fa640 1 -- 172.21.15.17:0/3200296253 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104005ad0 con 0x7f810c165470 2023-08-09T12:47:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.133+0000 7f81097fa640 1 -- 172.21.15.17:0/3200296253 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104005c30 con 0x7f810c165470 2023-08-09T12:47:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.133+0000 7f81097fa640 1 -- 172.21.15.17:0/3200296253 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104007070 con 0x7f810c165470 2023-08-09T12:47:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.133+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f4009400 con 0x7f810c165470 2023-08-09T12:47:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.133+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c15c5d0 con 0x7f810c165470 2023-08-09T12:47:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.134+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c04e390 con 0x7f810c165470 2023-08-09T12:47:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.135+0000 7f81097fa640 1 -- 172.21.15.17:0/3200296253 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81040071d0 con 0x7f810c165470 2023-08-09T12:47:13.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.136+0000 7f81097fa640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ec06a050 0x7f80ec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.136+0000 7f81097fa640 1 -- 172.21.15.17:0/3200296253 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f8104087cb0 con 0x7f810c165470 2023-08-09T12:47:13.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.137+0000 7f810bfff640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ec06a050 0x7f80ec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.138+0000 7f810bfff640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ec06a050 0x7f80ec06c510 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f80fc007560 tx=0x7f80fc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:13.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.141+0000 7f81097fa640 1 -- 172.21.15.17:0/3200296253 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f81040532e0 con 0x7f810c165470 2023-08-09T12:47:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.336+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f810c071b30 con 0x7f810c165470 2023-08-09T12:47:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.337+0000 7f81097fa640 1 -- 172.21.15.17:0/3200296253 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81040170a0 con 0x7f810c165470 2023-08-09T12:47:13.341 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:47:13.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ec06a050 msgr2=0x7f80ec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ec06a050 0x7f80ec06c510 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f80fc007560 tx=0x7f80fc00b040 comp rx=0 tx=0).stop 2023-08-09T12:47:13.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c165470 msgr2=0x7f810c156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c165470 0x7f810c156ad0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f810400c750 tx=0x7f810400cc10 comp rx=0 tx=0).stop 2023-08-09T12:47:13.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 shutdown_connections 2023-08-09T12:47:13.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80ec06a050 0x7f80ec06c510 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c165470 0x7f810c156ad0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810c0caff0 0x7f810c1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 --2- 172.21.15.17:0/3200296253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f810c0697c0 0x7f810c15b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.340+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 >> 172.21.15.17:0/3200296253 conn(0x7f810c06abd0 msgr2=0x7f810c0af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:13.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.341+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 shutdown_connections 2023-08-09T12:47:13.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.341+0000 7f81110cd640 1 -- 172.21.15.17:0/3200296253 wait complete. 2023-08-09T12:47:13.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:47:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.583+0000 7f3b2bb42640 1 Processor -- start 2023-08-09T12:47:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.583+0000 7f3b2bb42640 1 -- start start 2023-08-09T12:47:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.585+0000 7f3b2bb42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b241616e0 0x7f3b240b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.585+0000 7f3b2bb42640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3b240d29d0 0x7f3b240d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.585+0000 7f3b2bb42640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b240cdd10 con 0x7f3b2415ce90 2023-08-09T12:47:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.585+0000 7f3b2bb42640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b240b6540 con 0x7f3b240d29d0 2023-08-09T12:47:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.585+0000 7f3b2bb42640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240d33a0 con 0x7f3b241616e0 2023-08-09T12:47:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.585+0000 7f3b2a0df640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3b240d29d0 0x7f3b240d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.585+0000 7f3b2a0df640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3b240d29d0 0x7f3b240d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38740/0 (socket says 172.21.15.17:38740) 2023-08-09T12:47:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.586+0000 7f3b2a0df640 1 -- 172.21.15.17:0/759659466 learned_addr learned my addr 172.21.15.17:0/759659466 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.586+0000 7f3b290dd640 1 --2- 172.21.15.17:0/759659466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b241616e0 0x7f3b240b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.586+0000 7f3b2a0df640 1 -- 172.21.15.17:0/759659466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b241616e0 msgr2=0x7f3b240b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.586+0000 7f3b2a0df640 1 --2- 172.21.15.17:0/759659466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b241616e0 0x7f3b240b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.586+0000 7f3b2a0df640 1 -- 172.21.15.17:0/759659466 >> v1:172.21.15.142:6789/0 conn(0x7f3b2415ce90 legacy=0x7f3b240cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.586+0000 7f3b2a0df640 1 -- 172.21.15.17:0/759659466 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b240cdff0 con 0x7f3b240d29d0 2023-08-09T12:47:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.587+0000 7f3b2a0df640 1 --2- 172.21.15.17:0/759659466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b240d2e60 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009e50 tx=0x7f3b1c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6a9d82db6ef203 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b288dc640 1 -- 172.21.15.17:0/759659466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c02ca70 con 0x7f3b240d29d0 2023-08-09T12:47:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b288dc640 1 -- 172.21.15.17:0/759659466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c02cbd0 con 0x7f3b240d29d0 2023-08-09T12:47:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b288dc640 1 -- 172.21.15.17:0/759659466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c0343f0 con 0x7f3b240d29d0 2023-08-09T12:47:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b2bb42640 1 -- 172.21.15.17:0/759659466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 msgr2=0x7f3b240d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/759659466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b240d2e60 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009e50 tx=0x7f3b1c02bed0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b2bb42640 1 -- 172.21.15.17:0/759659466 shutdown_connections 2023-08-09T12:47:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/759659466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b240d2e60 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/759659466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b241616e0 0x7f3b240b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b2bb42640 1 -- 172.21.15.17:0/759659466 >> 172.21.15.17:0/759659466 conn(0x7f3b2406fde0 msgr2=0x7f3b240701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b2bb42640 1 -- 172.21.15.17:0/759659466 shutdown_connections 2023-08-09T12:47:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.588+0000 7f3b2bb42640 1 -- 172.21.15.17:0/759659466 wait complete. 2023-08-09T12:47:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.590+0000 7f3b2bb42640 1 Processor -- start 2023-08-09T12:47:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.590+0000 7f3b2bb42640 1 -- start start 2023-08-09T12:47:13.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.591+0000 7f3b2bb42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b241f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.591+0000 7f3b2bb42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b2415ce90 0x7f3b2415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.591+0000 7f3b2bb42640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b241616e0 0x7f3b240a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.591+0000 7f3b2bb42640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241f2e50 con 0x7f3b240d29d0 2023-08-09T12:47:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.591+0000 7f3b2bb42640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240caf70 con 0x7f3b241616e0 2023-08-09T12:47:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.591+0000 7f3b2bb42640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240cb1e0 con 0x7f3b2415ce90 2023-08-09T12:47:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.591+0000 7f3b298de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b241f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b298de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b241f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38744/0 (socket says 172.21.15.17:38744) 2023-08-09T12:47:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b298de640 1 -- 172.21.15.17:0/1164057378 learned_addr learned my addr 172.21.15.17:0/1164057378 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b290dd640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b2415ce90 0x7f3b2415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b2a0df640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b241616e0 0x7f3b240a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b298de640 1 -- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b2415ce90 msgr2=0x7f3b2415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b298de640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b2415ce90 0x7f3b2415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b298de640 1 -- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b241616e0 msgr2=0x7f3b240a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b298de640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b241616e0 0x7f3b240a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b298de640 1 -- 172.21.15.17:0/1164057378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c009b30 con 0x7f3b240d29d0 2023-08-09T12:47:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b2a0df640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b241616e0 0x7f3b240a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:13.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.592+0000 7f3b298de640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b241f2910 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c460 tx=0x7f3b2000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:13.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.593+0000 7f3b1a7fc640 1 -- 172.21.15.17:0/1164057378 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20012830 con 0x7f3b240d29d0 2023-08-09T12:47:13.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.593+0000 7f3b1a7fc640 1 -- 172.21.15.17:0/1164057378 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200129d0 con 0x7f3b240d29d0 2023-08-09T12:47:13.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.593+0000 7f3b1a7fc640 1 -- 172.21.15.17:0/1164057378 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20012d80 con 0x7f3b240d29d0 2023-08-09T12:47:13.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.593+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b240cb4c0 con 0x7f3b240d29d0 2023-08-09T12:47:13.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.593+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b240cba80 con 0x7f3b240d29d0 2023-08-09T12:47:13.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.594+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b24067a80 con 0x7f3b240d29d0 2023-08-09T12:47:13.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.595+0000 7f3b1a7fc640 1 -- 172.21.15.17:0/1164057378 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b2001a3b0 con 0x7f3b240d29d0 2023-08-09T12:47:13.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.596+0000 7f3b1a7fc640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b0806a050 0x7f3b0806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:13.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.596+0000 7f3b1a7fc640 1 -- 172.21.15.17:0/1164057378 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f3b200882b0 con 0x7f3b240d29d0 2023-08-09T12:47:13.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.597+0000 7f3b290dd640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b0806a050 0x7f3b0806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:13.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.598+0000 7f3b290dd640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b0806a050 0x7f3b0806c510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3b14006fd0 tx=0x7f3b14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:13.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.600+0000 7f3b1a7fc640 1 -- 172.21.15.17:0/1164057378 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3b200538e0 con 0x7f3b240d29d0 2023-08-09T12:47:13.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.792+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b240d0ad0 con 0x7f3b240d29d0 2023-08-09T12:47:13.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.793+0000 7f3b1a7fc640 1 -- 172.21.15.17:0/1164057378 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b20056f00 con 0x7f3b240d29d0 2023-08-09T12:47:13.797 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:47:13.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b0806a050 msgr2=0x7f3b0806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b0806a050 0x7f3b0806c510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3b14006fd0 tx=0x7f3b14008040 comp rx=0 tx=0).stop 2023-08-09T12:47:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 msgr2=0x7f3b241f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b241f2910 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c460 tx=0x7f3b2000c920 comp rx=0 tx=0).stop 2023-08-09T12:47:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 shutdown_connections 2023-08-09T12:47:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b0806a050 0x7f3b0806c510 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b241616e0 0x7f3b240a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b2415ce90 0x7f3b2415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 --2- 172.21.15.17:0/1164057378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b240d29d0 0x7f3b241f2910 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 >> 172.21.15.17:0/1164057378 conn(0x7f3b2406fde0 msgr2=0x7f3b240b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 shutdown_connections 2023-08-09T12:47:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:13.796+0000 7f3b2bb42640 1 -- 172.21.15.17:0/1164057378 wait complete. 2023-08-09T12:47:13.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:47:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.040+0000 7fd9f821f640 1 Processor -- start 2023-08-09T12:47:14.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.040+0000 7fd9f821f640 1 -- start start 2023-08-09T12:47:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f821f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9f00b3b40 0x7fd9f00b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f821f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd9f00cc630 0x7fd9f00ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f821f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f006c990 con 0x7fd9f00adc40 2023-08-09T12:47:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f821f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f00ae020 con 0x7fd9f00b3b40 2023-08-09T12:47:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f821f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f00b2250 con 0x7fd9f00cc630 2023-08-09T12:47:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f57ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9f00b3b40 0x7fd9f00b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f57ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9f00b3b40 0x7fd9f00b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38752/0 (socket says 172.21.15.17:38752) 2023-08-09T12:47:14.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f57ba640 1 -- 172.21.15.17:0/2750474959 learned_addr learned my addr 172.21.15.17:0/2750474959 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.042+0000 7fd9f67bc640 1 --2- 172.21.15.17:0/2750474959 >> v2:172.21.15.142:3300/0 conn(0x7fd9f00cc630 0x7fd9f00ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.043+0000 7fd9f57ba640 1 -- 172.21.15.17:0/2750474959 >> v2:172.21.15.142:3300/0 conn(0x7fd9f00cc630 msgr2=0x7fd9f00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.043+0000 7fd9f57ba640 1 --2- 172.21.15.17:0/2750474959 >> v2:172.21.15.142:3300/0 conn(0x7fd9f00cc630 0x7fd9f00ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.043+0000 7fd9f57ba640 1 -- 172.21.15.17:0/2750474959 >> v1:172.21.15.142:6789/0 conn(0x7fd9f00adc40 legacy=0x7fd9f006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.043+0000 7fd9f57ba640 1 -- 172.21.15.17:0/2750474959 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00b2530 con 0x7fd9f00b3b40 2023-08-09T12:47:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.044+0000 7fd9f57ba640 1 --2- 172.21.15.17:0/2750474959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00b3b40 0x7fd9f00b3fd0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00caff0 tx=0x7fd9e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88687ae5e5198ff3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.044+0000 7fd9f4fb9640 1 -- 172.21.15.17:0/2750474959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0031870 con 0x7fd9f00b3b40 2023-08-09T12:47:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.044+0000 7fd9f4fb9640 1 -- 172.21.15.17:0/2750474959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e00319d0 con 0x7fd9f00b3b40 2023-08-09T12:47:14.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.044+0000 7fd9f4fb9640 1 -- 172.21.15.17:0/2750474959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0031d60 con 0x7fd9f00b3b40 2023-08-09T12:47:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.045+0000 7fd9f821f640 1 -- 172.21.15.17:0/2750474959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00b3b40 msgr2=0x7fd9f00b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.045+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2750474959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00b3b40 0x7fd9f00b3fd0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00caff0 tx=0x7fd9e002b910 comp rx=0 tx=0).stop 2023-08-09T12:47:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.045+0000 7fd9f821f640 1 -- 172.21.15.17:0/2750474959 shutdown_connections 2023-08-09T12:47:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.045+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2750474959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00b3b40 0x7fd9f00b3fd0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.045+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2750474959 >> v2:172.21.15.142:3300/0 conn(0x7fd9f00cc630 0x7fd9f00ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.045+0000 7fd9f821f640 1 -- 172.21.15.17:0/2750474959 >> 172.21.15.17:0/2750474959 conn(0x7fd9f00cb1b0 msgr2=0x7fd9f00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.045+0000 7fd9f821f640 1 -- 172.21.15.17:0/2750474959 shutdown_connections 2023-08-09T12:47:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.045+0000 7fd9f821f640 1 -- 172.21.15.17:0/2750474959 wait complete. 2023-08-09T12:47:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.047+0000 7fd9f821f640 1 Processor -- start 2023-08-09T12:47:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.047+0000 7fd9f821f640 1 -- start start 2023-08-09T12:47:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f821f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f00adc40 0x7fd9f0159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f821f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00b3b40 0x7fd9f00c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f821f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00cc630 0x7fd9f00c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f821f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0159870 con 0x7fd9f00cc630 2023-08-09T12:47:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f821f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c5770 con 0x7fd9f00b3b40 2023-08-09T12:47:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f821f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c59c0 con 0x7fd9f00adc40 2023-08-09T12:47:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f67bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00cc630 0x7fd9f00c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f67bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00cc630 0x7fd9f00c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38766/0 (socket says 172.21.15.17:38766) 2023-08-09T12:47:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.048+0000 7fd9f67bc640 1 -- 172.21.15.17:0/2751304478 learned_addr learned my addr 172.21.15.17:0/2751304478 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f5fbb640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f00adc40 0x7fd9f0159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f67bc640 1 -- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f00adc40 msgr2=0x7fd9f0159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f57ba640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00b3b40 0x7fd9f00c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f67bc640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f00adc40 0x7fd9f0159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f67bc640 1 -- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00b3b40 msgr2=0x7fd9f00c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f67bc640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00b3b40 0x7fd9f00c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f67bc640 1 -- 172.21.15.17:0/2751304478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0009470 con 0x7fd9f00cc630 2023-08-09T12:47:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f5fbb640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f00adc40 0x7fd9f0159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.049+0000 7fd9f67bc640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00cc630 0x7fd9f00c72a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800cc30 tx=0x7fd9e800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.050+0000 7fd9e67fc640 1 -- 172.21.15.17:0/2751304478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e800ce40 con 0x7fd9f00cc630 2023-08-09T12:47:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.050+0000 7fd9e67fc640 1 -- 172.21.15.17:0/2751304478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8003990 con 0x7fd9f00cc630 2023-08-09T12:47:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.050+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f00c5ca0 con 0x7fd9f00cc630 2023-08-09T12:47:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.050+0000 7fd9e67fc640 1 -- 172.21.15.17:0/2751304478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8003d20 con 0x7fd9f00cc630 2023-08-09T12:47:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.050+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f00c6260 con 0x7fd9f00cc630 2023-08-09T12:47:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.051+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f0067a80 con 0x7fd9f00cc630 2023-08-09T12:47:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.052+0000 7fd9e67fc640 1 -- 172.21.15.17:0/2751304478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd9e8003e80 con 0x7fd9f00cc630 2023-08-09T12:47:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.053+0000 7fd9e67fc640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9d406a050 0x7fd9d406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.053+0000 7fd9e67fc640 1 -- 172.21.15.17:0/2751304478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd9e80889f0 con 0x7fd9f00cc630 2023-08-09T12:47:14.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.054+0000 7fd9f5fbb640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9d406a050 0x7fd9d406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.055+0000 7fd9f5fbb640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9d406a050 0x7fd9d406c510 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec003eb0 tx=0x7fd9ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:14.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.057+0000 7fd9e67fc640 1 -- 172.21.15.17:0/2751304478 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd9e8054020 con 0x7fd9f00cc630 2023-08-09T12:47:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.262+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd9f006ed40 con 0x7fd9f00cc630 2023-08-09T12:47:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.263+0000 7fd9e67fc640 1 -- 172.21.15.17:0/2751304478 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v135) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd9e8057640 con 0x7fd9f00cc630 2023-08-09T12:47:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:47:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9d406a050 msgr2=0x7fd9d406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9d406a050 0x7fd9d406c510 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec003eb0 tx=0x7fd9ec009040 comp rx=0 tx=0).stop 2023-08-09T12:47:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00cc630 msgr2=0x7fd9f00c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00cc630 0x7fd9f00c72a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800cc30 tx=0x7fd9e800a5c0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 shutdown_connections 2023-08-09T12:47:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd9d406a050 0x7fd9d406c510 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9f00cc630 0x7fd9f00c72a0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00b3b40 0x7fd9f00c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 --2- 172.21.15.17:0/2751304478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f00adc40 0x7fd9f0159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 >> 172.21.15.17:0/2751304478 conn(0x7fd9f00cb1b0 msgr2=0x7fd9f00697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 shutdown_connections 2023-08-09T12:47:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.266+0000 7fd9f821f640 1 -- 172.21.15.17:0/2751304478 wait complete. 2023-08-09T12:47:14.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:47:14.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:14.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:14.422 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:47:14.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:14.423 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:47:14.464 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:47:14.464 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:14.512 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:47:14.512 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:14.608 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:14.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.834+0000 7f3a6f00d640 1 Processor -- start 2023-08-09T12:47:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.834+0000 7f3a6f00d640 1 -- start start 2023-08-09T12:47:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.835+0000 7f3a6f00d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3a68159d80 0x7f3a680b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a6f00d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a680ad810 0x7f3a68070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a6f00d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 0x7f3a6806eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a6f00d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a68070d50 con 0x7f3a680ad810 2023-08-09T12:47:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a6f00d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6815a160 con 0x7f3a68159d80 2023-08-09T12:47:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a6f00d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680b4630 con 0x7f3a680708c0 2023-08-09T12:47:14.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a67fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a680ad810 0x7f3a68070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a67fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a680ad810 0x7f3a68070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38778/0 (socket says 172.21.15.17:38778) 2023-08-09T12:47:14.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a67fff640 1 -- 172.21.15.17:0/2688798163 learned_addr learned my addr 172.21.15.17:0/2688798163 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a6d5aa640 1 --2- 172.21.15.17:0/2688798163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 0x7f3a6806eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a6cda9640 1 --2- 172.21.15.17:0/2688798163 >> v2:172.21.15.142:3300/0 conn(0x7f3a68159d80 0x7f3a680b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a67fff640 1 -- 172.21.15.17:0/2688798163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 msgr2=0x7f3a6806eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a67fff640 1 --2- 172.21.15.17:0/2688798163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 0x7f3a6806eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a67fff640 1 -- 172.21.15.17:0/2688798163 >> v2:172.21.15.142:3300/0 conn(0x7f3a68159d80 msgr2=0x7f3a680b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a67fff640 1 --2- 172.21.15.17:0/2688798163 >> v2:172.21.15.142:3300/0 conn(0x7f3a68159d80 0x7f3a680b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a67fff640 1 -- 172.21.15.17:0/2688798163 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680b3ab0 con 0x7f3a680ad810 2023-08-09T12:47:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.836+0000 7f3a6cda9640 1 --2- 172.21.15.17:0/2688798163 >> v2:172.21.15.142:3300/0 conn(0x7f3a68159d80 0x7f3a680b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.838+0000 7f3a67fff640 1 --2- 172.21.15.17:0/2688798163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a68070380 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3a680cb110 tx=0x7f3a5402e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6660544be2fcb194 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:14.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.838+0000 7f3a677fe640 1 -- 172.21.15.17:0/2688798163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5402ee70 con 0x7f3a680ad810 2023-08-09T12:47:14.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.838+0000 7f3a677fe640 1 -- 172.21.15.17:0/2688798163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a54036440 con 0x7f3a680ad810 2023-08-09T12:47:14.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.838+0000 7f3a677fe640 1 -- 172.21.15.17:0/2688798163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540367d0 con 0x7f3a680ad810 2023-08-09T12:47:14.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 -- 172.21.15.17:0/2688798163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 msgr2=0x7f3a68070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:14.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/2688798163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a68070380 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3a680cb110 tx=0x7f3a5402e0c0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 -- 172.21.15.17:0/2688798163 shutdown_connections 2023-08-09T12:47:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/2688798163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 0x7f3a6806eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/2688798163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a68070380 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/2688798163 >> v2:172.21.15.142:3300/0 conn(0x7f3a68159d80 0x7f3a680b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 -- 172.21.15.17:0/2688798163 >> 172.21.15.17:0/2688798163 conn(0x7f3a680cb1b0 msgr2=0x7f3a680cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 -- 172.21.15.17:0/2688798163 shutdown_connections 2023-08-09T12:47:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.839+0000 7f3a6f00d640 1 -- 172.21.15.17:0/2688798163 wait complete. 2023-08-09T12:47:14.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.841+0000 7f3a6f00d640 1 Processor -- start 2023-08-09T12:47:14.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.841+0000 7f3a6f00d640 1 -- start start 2023-08-09T12:47:14.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a6f00d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 0x7f3a680c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a6f00d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a681f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a6f00d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a68159d80 0x7f3a68151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a6f00d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680ae160 con 0x7f3a680ad810 2023-08-09T12:47:14.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a6f00d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a681f6690 con 0x7f3a68159d80 2023-08-09T12:47:14.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a6f00d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68151ac0 con 0x7f3a680708c0 2023-08-09T12:47:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a681f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a681f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38786/0 (socket says 172.21.15.17:38786) 2023-08-09T12:47:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.842+0000 7f3a67fff640 1 -- 172.21.15.17:0/1583547016 learned_addr learned my addr 172.21.15.17:0/1583547016 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a67fff640 1 -- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 msgr2=0x7f3a680c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a67fff640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 0x7f3a680c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a67fff640 1 -- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a68159d80 msgr2=0x7f3a68151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a67fff640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a68159d80 0x7f3a68151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a67fff640 1 -- 172.21.15.17:0/1583547016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5400b710 con 0x7f3a680ad810 2023-08-09T12:47:14.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a67fff640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a681f6150 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400b2c0 tx=0x7f3a540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:14.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a657fa640 1 -- 172.21.15.17:0/1583547016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54034b80 con 0x7f3a680ad810 2023-08-09T12:47:14.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a657fa640 1 -- 172.21.15.17:0/1583547016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a54034ce0 con 0x7f3a680ad810 2023-08-09T12:47:14.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a657fa640 1 -- 172.21.15.17:0/1583547016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540416a0 con 0x7f3a680ad810 2023-08-09T12:47:14.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.843+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a680c2650 con 0x7f3a680ad810 2023-08-09T12:47:14.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.844+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a680c2c10 con 0x7f3a680ad810 2023-08-09T12:47:14.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.845+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a68067a80 con 0x7f3a680ad810 2023-08-09T12:47:14.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.846+0000 7f3a657fa640 1 -- 172.21.15.17:0/1583547016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3a54049360 con 0x7f3a680ad810 2023-08-09T12:47:14.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.847+0000 7f3a657fa640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a4c06a050 0x7f3a4c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:14.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.847+0000 7f3a657fa640 1 -- 172.21.15.17:0/1583547016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f3a540aabd0 con 0x7f3a680ad810 2023-08-09T12:47:14.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.847+0000 7f3a6cda9640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a4c06a050 0x7f3a4c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:14.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.848+0000 7f3a6cda9640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a4c06a050 0x7f3a4c06c510 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c006fd0 tx=0x7f3a5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:14.851+0000 7f3a657fa640 1 -- 172.21.15.17:0/1583547016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3a54076290 con 0x7f3a680ad810 2023-08-09T12:47:15.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.047+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a6806b5f0 con 0x7f3a680ad810 2023-08-09T12:47:15.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.052+0000 7f3a657fa640 1 -- 172.21.15.17:0/1583547016 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+18328 (secure 0 0 0) 0x7f3a5403b090 con 0x7f3a680ad810 2023-08-09T12:47:15.056 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:15.056 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":135,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:12.937583+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.35","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:15.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a4c06a050 msgr2=0x7f3a4c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a4c06a050 0x7f3a4c06c510 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c006fd0 tx=0x7f3a5c008040 comp rx=0 tx=0).stop 2023-08-09T12:47:15.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 msgr2=0x7f3a681f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a681f6150 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400b2c0 tx=0x7f3a540046c0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 shutdown_connections 2023-08-09T12:47:15.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3a4c06a050 0x7f3a4c06c510 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a68159d80 0x7f3a68151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a680ad810 0x7f3a681f6150 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 --2- 172.21.15.17:0/1583547016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a680708c0 0x7f3a680c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 >> 172.21.15.17:0/1583547016 conn(0x7f3a680cb1b0 msgr2=0x7f3a680cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 shutdown_connections 2023-08-09T12:47:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.055+0000 7f3a6f00d640 1 -- 172.21.15.17:0/1583547016 wait complete. 2023-08-09T12:47:15.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:46:52.804156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:46:53.615239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:47:15.081 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:47:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.292+0000 7f94dffff640 1 Processor -- start 2023-08-09T12:47:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.293+0000 7f94dffff640 1 -- start start 2023-08-09T12:47:15.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.294+0000 7f94dffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f94e015a8c0 0x7f94e00b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.294+0000 7f94dffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94e00b13f0 0x7f94e015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.294+0000 7f94dffff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e015e7b0 con 0x7f94e015f180 2023-08-09T12:47:15.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.294+0000 7f94dffff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e00b1850 con 0x7f94e00b13f0 2023-08-09T12:47:15.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.294+0000 7f94dffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e015e460 con 0x7f94e015a8c0 2023-08-09T12:47:15.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94d7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94e00b13f0 0x7f94e015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94d7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94e00b13f0 0x7f94e015ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38790/0 (socket says 172.21.15.17:38790) 2023-08-09T12:47:15.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94d7fff640 1 -- 172.21.15.17:0/2245866747 learned_addr learned my addr 172.21.15.17:0/2245866747 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:15.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94deffd640 1 --2- 172.21.15.17:0/2245866747 >> v2:172.21.15.142:3300/0 conn(0x7f94e015a8c0 0x7f94e00b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94d7fff640 1 -- 172.21.15.17:0/2245866747 >> v2:172.21.15.142:3300/0 conn(0x7f94e015a8c0 msgr2=0x7f94e00b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:15.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94d7fff640 1 --2- 172.21.15.17:0/2245866747 >> v2:172.21.15.142:3300/0 conn(0x7f94e015a8c0 0x7f94e00b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94d7fff640 1 -- 172.21.15.17:0/2245866747 >> v1:172.21.15.142:6789/0 conn(0x7f94e015f180 legacy=0x7f94e00b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94d7fff640 1 -- 172.21.15.17:0/2245866747 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e015aca0 con 0x7f94e00b13f0 2023-08-09T12:47:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.295+0000 7f94deffd640 1 --2- 172.21.15.17:0/2245866747 >> v2:172.21.15.142:3300/0 conn(0x7f94e015a8c0 0x7f94e00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.296+0000 7f94d7fff640 1 --2- 172.21.15.17:0/2245866747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015ec40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f94e00ce460 tx=0x7f94c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987139920132c21d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94de7fc640 1 -- 172.21.15.17:0/2245866747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8031870 con 0x7f94e00b13f0 2023-08-09T12:47:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94de7fc640 1 -- 172.21.15.17:0/2245866747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c80319d0 con 0x7f94e00b13f0 2023-08-09T12:47:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94de7fc640 1 -- 172.21.15.17:0/2245866747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8031d60 con 0x7f94e00b13f0 2023-08-09T12:47:15.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94dffff640 1 -- 172.21.15.17:0/2245866747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 msgr2=0x7f94e015ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94dffff640 1 --2- 172.21.15.17:0/2245866747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015ec40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f94e00ce460 tx=0x7f94c802b910 comp rx=0 tx=0).stop 2023-08-09T12:47:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94dffff640 1 -- 172.21.15.17:0/2245866747 shutdown_connections 2023-08-09T12:47:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94dffff640 1 --2- 172.21.15.17:0/2245866747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015ec40 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94dffff640 1 --2- 172.21.15.17:0/2245866747 >> v2:172.21.15.142:3300/0 conn(0x7f94e015a8c0 0x7f94e00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94dffff640 1 -- 172.21.15.17:0/2245866747 >> 172.21.15.17:0/2245866747 conn(0x7f94e00cb020 msgr2=0x7f94e00cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:15.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.297+0000 7f94dffff640 1 -- 172.21.15.17:0/2245866747 shutdown_connections 2023-08-09T12:47:15.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.298+0000 7f94dffff640 1 -- 172.21.15.17:0/2245866747 wait complete. 2023-08-09T12:47:15.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.299+0000 7f94dffff640 1 Processor -- start 2023-08-09T12:47:15.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.299+0000 7f94dffff640 1 -- start start 2023-08-09T12:47:15.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.300+0000 7f94dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.300+0000 7f94dffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e015a8c0 0x7f94e01f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.300+0000 7f94dffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e015f180 0x7f94e00c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.300+0000 7f94dffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00cc210 con 0x7f94e00b13f0 2023-08-09T12:47:15.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.300+0000 7f94dffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00cc4f0 con 0x7f94e015f180 2023-08-09T12:47:15.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.300+0000 7f94dffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00cc7d0 con 0x7f94e015a8c0 2023-08-09T12:47:15.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38794/0 (socket says 172.21.15.17:38794) 2023-08-09T12:47:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 -- 172.21.15.17:0/993931737 learned_addr learned my addr 172.21.15.17:0/993931737 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 -- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e015a8c0 msgr2=0x7f94e01f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e015a8c0 0x7f94e01f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 -- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e015f180 msgr2=0x7f94e00c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e015f180 0x7f94e00c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 -- 172.21.15.17:0/993931737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80094d0 con 0x7f94e00b13f0 2023-08-09T12:47:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.301+0000 7f94deffd640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015cd50 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f94d000c7f0 tx=0x7f94d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:15.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.302+0000 7f94d77fe640 1 -- 172.21.15.17:0/993931737 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0007a30 con 0x7f94e00b13f0 2023-08-09T12:47:15.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.302+0000 7f94d77fe640 1 -- 172.21.15.17:0/993931737 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0007b90 con 0x7f94e00b13f0 2023-08-09T12:47:15.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.302+0000 7f94d77fe640 1 -- 172.21.15.17:0/993931737 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000ce40 con 0x7f94e00b13f0 2023-08-09T12:47:15.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.302+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e00ccab0 con 0x7f94e00b13f0 2023-08-09T12:47:15.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.302+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e015d290 con 0x7f94e00b13f0 2023-08-09T12:47:15.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.303+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00ccfd0 con 0x7f94e00b13f0 2023-08-09T12:47:15.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.304+0000 7f94d77fe640 1 -- 172.21.15.17:0/993931737 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f94d00113f0 con 0x7f94e00b13f0 2023-08-09T12:47:15.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.304+0000 7f94d77fe640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94c006a050 0x7f94c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.305+0000 7f94d77fe640 1 -- 172.21.15.17:0/993931737 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f94d0088790 con 0x7f94e00b13f0 2023-08-09T12:47:15.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.305+0000 7f94d7fff640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94c006a050 0x7f94c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.306+0000 7f94d7fff640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94c006a050 0x7f94c006c510 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f94c8036000 tx=0x7f94c8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.309+0000 7f94d77fe640 1 -- 172.21.15.17:0/993931737 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f94e00ccfd0 con 0x7f94e00b13f0 2023-08-09T12:47:15.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.490+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94e00ccfd0 con 0x7f94e00b13f0 2023-08-09T12:47:15.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.491+0000 7f94d77fe640 1 -- 172.21.15.17:0/993931737 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94e00ccfd0 con 0x7f94e00b13f0 2023-08-09T12:47:15.495 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:47:15.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.493+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94c006a050 msgr2=0x7f94c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.493+0000 7f94dffff640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94c006a050 0x7f94c006c510 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f94c8036000 tx=0x7f94c8030000 comp rx=0 tx=0).stop 2023-08-09T12:47:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.493+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 msgr2=0x7f94e015cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.493+0000 7f94dffff640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015cd50 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f94d000c7f0 tx=0x7f94d000cbf0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.494+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 shutdown_connections 2023-08-09T12:47:15.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.494+0000 7f94dffff640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94c006a050 0x7f94c006c510 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.494+0000 7f94dffff640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e015f180 0x7f94e00c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.494+0000 7f94dffff640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e015a8c0 0x7f94e01f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.494+0000 7f94dffff640 1 --2- 172.21.15.17:0/993931737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e00b13f0 0x7f94e015cd50 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.494+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 >> 172.21.15.17:0/993931737 conn(0x7f94e00cb020 msgr2=0x7f94e00ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:15.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.494+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 shutdown_connections 2023-08-09T12:47:15.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.494+0000 7f94dffff640 1 -- 172.21.15.17:0/993931737 wait complete. 2023-08-09T12:47:15.515 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:47:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.747+0000 7f4dc459f640 1 Processor -- start 2023-08-09T12:47:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.747+0000 7f4dc459f640 1 -- start start 2023-08-09T12:47:15.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc459f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 0x7f4dbc06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc459f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4dbc0cc630 0x7f4dbc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc459f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc0b2250 con 0x7f4dbc0b3b40 2023-08-09T12:47:15.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc459f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc0ae020 con 0x7f4dbc0cc630 2023-08-09T12:47:15.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc459f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0b2530 con 0x7f4dbc0adc40 2023-08-09T12:47:15.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc2b3c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4dbc0cc630 0x7f4dbc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc2b3c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4dbc0cc630 0x7f4dbc0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38802/0 (socket says 172.21.15.17:38802) 2023-08-09T12:47:15.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc2b3c640 1 -- 172.21.15.17:0/3383382466 learned_addr learned my addr 172.21.15.17:0/3383382466 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:15.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.748+0000 7f4dc233b640 1 --2- 172.21.15.17:0/3383382466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 0x7f4dbc06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.749+0000 7f4dc2b3c640 1 -- 172.21.15.17:0/3383382466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 msgr2=0x7f4dbc06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:15.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.749+0000 7f4dc2b3c640 1 --2- 172.21.15.17:0/3383382466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 0x7f4dbc06c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.749+0000 7f4dc2b3c640 1 -- 172.21.15.17:0/3383382466 >> v1:172.21.15.142:6789/0 conn(0x7f4dbc0b3b40 legacy=0x7f4dbc0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:15.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.749+0000 7f4dc2b3c640 1 -- 172.21.15.17:0/3383382466 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc06fe80 con 0x7f4dbc0cc630 2023-08-09T12:47:15.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.750+0000 7f4dc2b3c640 1 --2- 172.21.15.17:0/3383382466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc0ccac0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009e50 tx=0x7f4db402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d7c87e1bf9bca9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:15.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.750+0000 7f4dc1339640 1 -- 172.21.15.17:0/3383382466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db402ca70 con 0x7f4dbc0cc630 2023-08-09T12:47:15.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.750+0000 7f4dc1339640 1 -- 172.21.15.17:0/3383382466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db402cbd0 con 0x7f4dbc0cc630 2023-08-09T12:47:15.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.750+0000 7f4dc1339640 1 -- 172.21.15.17:0/3383382466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40343f0 con 0x7f4dbc0cc630 2023-08-09T12:47:15.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.751+0000 7f4dc459f640 1 -- 172.21.15.17:0/3383382466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 msgr2=0x7f4dbc0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.751+0000 7f4dc459f640 1 --2- 172.21.15.17:0/3383382466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc0ccac0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009e50 tx=0x7f4db402bed0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.751+0000 7f4dc459f640 1 -- 172.21.15.17:0/3383382466 shutdown_connections 2023-08-09T12:47:15.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.751+0000 7f4dc459f640 1 --2- 172.21.15.17:0/3383382466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc0ccac0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.751+0000 7f4dc459f640 1 --2- 172.21.15.17:0/3383382466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 0x7f4dbc06c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.751+0000 7f4dc459f640 1 -- 172.21.15.17:0/3383382466 >> 172.21.15.17:0/3383382466 conn(0x7f4dbc0cb1b0 msgr2=0x7f4dbc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:15.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.751+0000 7f4dc459f640 1 -- 172.21.15.17:0/3383382466 shutdown_connections 2023-08-09T12:47:15.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.751+0000 7f4dc459f640 1 -- 172.21.15.17:0/3383382466 wait complete. 2023-08-09T12:47:15.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.753+0000 7f4dc459f640 1 Processor -- start 2023-08-09T12:47:15.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.753+0000 7f4dc459f640 1 -- start start 2023-08-09T12:47:15.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.754+0000 7f4dc459f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 0x7f4dbc0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.754+0000 7f4dc459f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0b3b40 0x7f4dbc152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.754+0000 7f4dc459f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc06bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.754+0000 7f4dc459f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc069c40 con 0x7f4dbc0cc630 2023-08-09T12:47:15.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.754+0000 7f4dc459f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0c7950 con 0x7f4dbc0b3b40 2023-08-09T12:47:15.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.754+0000 7f4dc459f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0c7c30 con 0x7f4dbc0adc40 2023-08-09T12:47:15.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc2b3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc06bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc2b3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc06bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38812/0 (socket says 172.21.15.17:38812) 2023-08-09T12:47:15.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc2b3c640 1 -- 172.21.15.17:0/2140775395 learned_addr learned my addr 172.21.15.17:0/2140775395 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:15.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc1b3a640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0b3b40 0x7f4dbc152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc233b640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 0x7f4dbc0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc2b3c640 1 -- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 msgr2=0x7f4dbc0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc2b3c640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 0x7f4dbc0c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc2b3c640 1 -- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0b3b40 msgr2=0x7f4dbc152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc2b3c640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0b3b40 0x7f4dbc152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.755+0000 7f4dc2b3c640 1 -- 172.21.15.17:0/2140775395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009b30 con 0x7f4dbc0cc630 2023-08-09T12:47:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.756+0000 7f4dc2b3c640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc06bbb0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f4db4036040 tx=0x7f4db4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.756+0000 7f4db2ffd640 1 -- 172.21.15.17:0/2140775395 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4009510 con 0x7f4dbc0cc630 2023-08-09T12:47:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.756+0000 7f4db2ffd640 1 -- 172.21.15.17:0/2140775395 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db403e450 con 0x7f4dbc0cc630 2023-08-09T12:47:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.756+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc069860 con 0x7f4dbc0cc630 2023-08-09T12:47:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.756+0000 7f4db2ffd640 1 -- 172.21.15.17:0/2140775395 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db403e7e0 con 0x7f4dbc0cc630 2023-08-09T12:47:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.756+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc0c6b30 con 0x7f4dbc0cc630 2023-08-09T12:47:15.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.757+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc069d80 con 0x7f4dbc0cc630 2023-08-09T12:47:15.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.758+0000 7f4db2ffd640 1 -- 172.21.15.17:0/2140775395 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4db403e940 con 0x7f4dbc0cc630 2023-08-09T12:47:15.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.759+0000 7f4db2ffd640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4da006a050 0x7f4da006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:15.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.759+0000 7f4db2ffd640 1 -- 172.21.15.17:0/2140775395 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f4db40ab400 con 0x7f4dbc0cc630 2023-08-09T12:47:15.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.760+0000 7f4dc233b640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4da006a050 0x7f4da006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:15.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.761+0000 7f4dc233b640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4da006a050 0x7f4da006c510 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4db8006fd0 tx=0x7f4db8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.764+0000 7f4db2ffd640 1 -- 172.21.15.17:0/2140775395 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4dbc069d80 con 0x7f4dbc0cc630 2023-08-09T12:47:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.955+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4dbc069d80 con 0x7f4dbc0cc630 2023-08-09T12:47:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.955+0000 7f4db2ffd640 1 -- 172.21.15.17:0/2140775395 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4dbc069d80 con 0x7f4dbc0cc630 2023-08-09T12:47:15.959 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:47:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4da006a050 msgr2=0x7f4da006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4da006a050 0x7f4da006c510 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4db8006fd0 tx=0x7f4db8008040 comp rx=0 tx=0).stop 2023-08-09T12:47:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 msgr2=0x7f4dbc06bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc06bbb0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f4db4036040 tx=0x7f4db4004a40 comp rx=0 tx=0).stop 2023-08-09T12:47:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 shutdown_connections 2023-08-09T12:47:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4da006a050 0x7f4da006c510 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc0cc630 0x7f4dbc06bbb0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0b3b40 0x7f4dbc152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 --2- 172.21.15.17:0/2140775395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc0adc40 0x7f4dbc0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 >> 172.21.15.17:0/2140775395 conn(0x7f4dbc0cb1b0 msgr2=0x7f4dbc06f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.958+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 shutdown_connections 2023-08-09T12:47:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:15.959+0000 7f4dc459f640 1 -- 172.21.15.17:0/2140775395 wait complete. 2023-08-09T12:47:15.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:47:16.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.211+0000 7fba7a6d2640 1 Processor -- start 2023-08-09T12:47:16.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.212+0000 7fba7a6d2640 1 -- start start 2023-08-09T12:47:16.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.213+0000 7fba7a6d2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba7415d2d0 0x7fba740b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.213+0000 7fba7a6d2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba740b2010 con 0x7fba740cfab0 2023-08-09T12:47:16.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.213+0000 7fba7a6d2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba740b1d30 con 0x7fba7415cef0 2023-08-09T12:47:16.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.213+0000 7fba7a6d2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba740cdee0 con 0x7fba7415d2d0 2023-08-09T12:47:16.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.214+0000 7fba737fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fba740cfab0 0x7fba740d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34660/0 (socket says 172.21.15.17:34660) 2023-08-09T12:47:16.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.214+0000 7fba737fe640 1 -- 172.21.15.17:0/73023860 learned_addr learned my addr 172.21.15.17:0/73023860 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.214+0000 7fba78c6f640 1 --2- 172.21.15.17:0/73023860 >> v2:172.21.15.142:3300/0 conn(0x7fba7415d2d0 0x7fba740b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.214+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399362929 0 0) 0x7fba740b2010 con 0x7fba740cfab0 2023-08-09T12:47:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.214+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c003520 con 0x7fba740cfab0 2023-08-09T12:47:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001317194 0 0) 0x7fba5c003520 con 0x7fba740cfab0 2023-08-09T12:47:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 >> v2:172.21.15.142:3300/0 conn(0x7fba7415d2d0 msgr2=0x7fba740b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:16.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 --2- 172.21.15.17:0/73023860 >> v2:172.21.15.142:3300/0 conn(0x7fba7415d2d0 0x7fba740b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 >> v1:172.21.15.142:6789/0 conn(0x7fba7415cef0 legacy=0x7fba740cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740cd820 con 0x7fba740cfab0 2023-08-09T12:47:16.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fba68001690 con 0x7fba740cfab0 2023-08-09T12:47:16.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 >> v1:172.21.15.17:6789/0 conn(0x7fba740cfab0 legacy=0x7fba740d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c0039c0 0x7fba5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba5c0047c0 0x7fba5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0052a0 0x7fba5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba740cdee0 con 0x7fba5c0047c0 2023-08-09T12:47:16.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c00c1a0 con 0x7fba5c0039c0 2023-08-09T12:47:16.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c00c360 con 0x7fba5c0052a0 2023-08-09T12:47:16.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.215+0000 7fba737fe640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba5c0047c0 0x7fba5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.216+0000 7fba73fff640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c0039c0 0x7fba5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.216+0000 7fba737fe640 1 -- 172.21.15.17:0/73023860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0052a0 msgr2=0x7fba5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:16.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.216+0000 7fba737fe640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0052a0 0x7fba5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.216+0000 7fba737fe640 1 -- 172.21.15.17:0/73023860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c0039c0 msgr2=0x7fba5c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:16.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.216+0000 7fba737fe640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c0039c0 0x7fba5c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.216+0000 7fba737fe640 1 -- 172.21.15.17:0/73023860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c003520 con 0x7fba5c0047c0 2023-08-09T12:47:16.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.216+0000 7fba73fff640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba5c0039c0 0x7fba5c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:16.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.216+0000 7fba78c6f640 1 -- 172.21.15.17:0/73023860 reap_dead start 2023-08-09T12:47:16.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.217+0000 7fba737fe640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba5c0047c0 0x7fba5c004c40 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fba6800c160 tx=0x7fba5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba5077eb08beec9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:16.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.217+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68005ad0 con 0x7fba5c0047c0 2023-08-09T12:47:16.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.217+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68005c30 con 0x7fba5c0047c0 2023-08-09T12:47:16.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.217+0000 7fba72ffd640 1 -- 172.21.15.17:0/73023860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6802c790 con 0x7fba5c0047c0 2023-08-09T12:47:16.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.218+0000 7fba7a6d2640 1 -- 172.21.15.17:0/73023860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba5c0047c0 msgr2=0x7fba5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.218+0000 7fba7a6d2640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba5c0047c0 0x7fba5c004c40 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fba6800c160 tx=0x7fba5c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.218+0000 7fba7a6d2640 1 -- 172.21.15.17:0/73023860 shutdown_connections 2023-08-09T12:47:16.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.218+0000 7fba7a6d2640 1 --2- 172.21.15.17:0/73023860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba5c0047c0 0x7fba5c004c40 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.218+0000 7fba7a6d2640 1 -- 172.21.15.17:0/73023860 >> 172.21.15.17:0/73023860 conn(0x7fba7406fde0 msgr2=0x7fba740701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:16.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.218+0000 7fba7a6d2640 1 -- 172.21.15.17:0/73023860 shutdown_connections 2023-08-09T12:47:16.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.218+0000 7fba7a6d2640 1 -- 172.21.15.17:0/73023860 wait complete. 2023-08-09T12:47:16.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.220+0000 7fba7a6d2640 1 Processor -- start 2023-08-09T12:47:16.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.220+0000 7fba7a6d2640 1 -- start start 2023-08-09T12:47:16.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba7a6d2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0047c0 0x7fba740b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba7a6d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba740c92f0 0x7fba741f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba7a6d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba7415a3d0 0x7fba7415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba7a6d2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7415ad90 con 0x7fba7415a3d0 2023-08-09T12:47:16.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba7a6d2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba740b3140 con 0x7fba740c92f0 2023-08-09T12:47:16.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba7a6d2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba740b3420 con 0x7fba5c0047c0 2023-08-09T12:47:16.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba78c6f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba7415a3d0 0x7fba7415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba78c6f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba7415a3d0 0x7fba7415a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38828/0 (socket says 172.21.15.17:38828) 2023-08-09T12:47:16.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.221+0000 7fba78c6f640 1 -- 172.21.15.17:0/945656911 learned_addr learned my addr 172.21.15.17:0/945656911 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba73fff640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0047c0 0x7fba740b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba78c6f640 1 -- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0047c0 msgr2=0x7fba740b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba78c6f640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0047c0 0x7fba740b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba78c6f640 1 -- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba740c92f0 msgr2=0x7fba741f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba78c6f640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba740c92f0 0x7fba741f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba78c6f640 1 -- 172.21.15.17:0/945656911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740b3700 con 0x7fba7415a3d0 2023-08-09T12:47:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba73fff640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0047c0 0x7fba740b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:16.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba78c6f640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba7415a3d0 0x7fba7415a850 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fba740719f0 tx=0x7fba6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:16.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba70ff9640 1 -- 172.21.15.17:0/945656911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c00ccf0 con 0x7fba7415a3d0 2023-08-09T12:47:16.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba70ff9640 1 -- 172.21.15.17:0/945656911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c00f040 con 0x7fba7415a3d0 2023-08-09T12:47:16.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba740b39e0 con 0x7fba7415a3d0 2023-08-09T12:47:16.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.222+0000 7fba70ff9640 1 -- 172.21.15.17:0/945656911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0146c0 con 0x7fba7415a3d0 2023-08-09T12:47:16.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.223+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba740b2d10 con 0x7fba7415a3d0 2023-08-09T12:47:16.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.224+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba740663a0 con 0x7fba7415a3d0 2023-08-09T12:47:16.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.225+0000 7fba70ff9640 1 -- 172.21.15.17:0/945656911 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fba6c014820 con 0x7fba7415a3d0 2023-08-09T12:47:16.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.226+0000 7fba70ff9640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6006a080 0x7fba6006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.226+0000 7fba70ff9640 1 -- 172.21.15.17:0/945656911 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fba6c088e10 con 0x7fba7415a3d0 2023-08-09T12:47:16.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.226+0000 7fba73fff640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6006a080 0x7fba6006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.227+0000 7fba73fff640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6006a080 0x7fba6006c540 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fba7404f440 tx=0x7fba64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:16.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.230+0000 7fba70ff9640 1 -- 172.21.15.17:0/945656911 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fba6c08c030 con 0x7fba7415a3d0 2023-08-09T12:47:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.422+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba740b2ea0 con 0x7fba7415a3d0 2023-08-09T12:47:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.423+0000 7fba70ff9640 1 -- 172.21.15.17:0/945656911 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba6c0543b0 con 0x7fba7415a3d0 2023-08-09T12:47:16.426 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:47:16.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6006a080 msgr2=0x7fba6006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6006a080 0x7fba6006c540 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fba7404f440 tx=0x7fba64009040 comp rx=0 tx=0).stop 2023-08-09T12:47:16.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba7415a3d0 msgr2=0x7fba7415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba7415a3d0 0x7fba7415a850 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fba740719f0 tx=0x7fba6c00c490 comp rx=0 tx=0).stop 2023-08-09T12:47:16.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 shutdown_connections 2023-08-09T12:47:16.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fba6006a080 0x7fba6006c540 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba7415a3d0 0x7fba7415a850 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba740c92f0 0x7fba741f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 --2- 172.21.15.17:0/945656911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba5c0047c0 0x7fba740b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 >> 172.21.15.17:0/945656911 conn(0x7fba7406fde0 msgr2=0x7fba740c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:16.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.425+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 shutdown_connections 2023-08-09T12:47:16.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.426+0000 7fba7a6d2640 1 -- 172.21.15.17:0/945656911 wait complete. 2023-08-09T12:47:16.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:47:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.678+0000 7fdf9a856640 1 Processor -- start 2023-08-09T12:47:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.678+0000 7fdf9a856640 1 -- start start 2023-08-09T12:47:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.679+0000 7fdf9a856640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 0x7fdf940b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.679+0000 7fdf9a856640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdf940b0020 0x7fdf940b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.679+0000 7fdf9a856640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9415e7b0 con 0x7fdf940b13f0 2023-08-09T12:47:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.679+0000 7fdf9a856640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf940b09f0 con 0x7fdf940b0020 2023-08-09T12:47:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.679+0000 7fdf9a856640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940b1850 con 0x7fdf9415a8c0 2023-08-09T12:47:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.679+0000 7fdf9a055640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdf940b0020 0x7fdf940b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.679+0000 7fdf9a055640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdf940b0020 0x7fdf940b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38830/0 (socket says 172.21.15.17:38830) 2023-08-09T12:47:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.679+0000 7fdf9a055640 1 -- 172.21.15.17:0/1690596969 learned_addr learned my addr 172.21.15.17:0/1690596969 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.680+0000 7fdf99854640 1 --2- 172.21.15.17:0/1690596969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 0x7fdf940b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.680+0000 7fdf9a055640 1 -- 172.21.15.17:0/1690596969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 msgr2=0x7fdf940b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.680+0000 7fdf9a055640 1 --2- 172.21.15.17:0/1690596969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 0x7fdf940b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.680+0000 7fdf9a055640 1 -- 172.21.15.17:0/1690596969 >> v1:172.21.15.142:6789/0 conn(0x7fdf940b13f0 legacy=0x7fdf9415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.680+0000 7fdf9a055640 1 -- 172.21.15.17:0/1690596969 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9415e460 con 0x7fdf940b0020 2023-08-09T12:47:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.680+0000 7fdf99854640 1 --2- 172.21.15.17:0/1690596969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 0x7fdf940b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:16.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a055640 1 --2- 172.21.15.17:0/1690596969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b0020 0x7fdf940b04b0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009e50 tx=0x7fdf8c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e5e7be280bdbf7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf98852640 1 -- 172.21.15.17:0/1690596969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c02ca70 con 0x7fdf940b0020 2023-08-09T12:47:16.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf98852640 1 -- 172.21.15.17:0/1690596969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c02cbd0 con 0x7fdf940b0020 2023-08-09T12:47:16.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf98852640 1 -- 172.21.15.17:0/1690596969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0343f0 con 0x7fdf940b0020 2023-08-09T12:47:16.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a856640 1 -- 172.21.15.17:0/1690596969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b0020 msgr2=0x7fdf940b04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a856640 1 --2- 172.21.15.17:0/1690596969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b0020 0x7fdf940b04b0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009e50 tx=0x7fdf8c02bed0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a856640 1 -- 172.21.15.17:0/1690596969 shutdown_connections 2023-08-09T12:47:16.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a856640 1 --2- 172.21.15.17:0/1690596969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b0020 0x7fdf940b04b0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a856640 1 --2- 172.21.15.17:0/1690596969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 0x7fdf940b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a856640 1 -- 172.21.15.17:0/1690596969 >> 172.21.15.17:0/1690596969 conn(0x7fdf940cb020 msgr2=0x7fdf940cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:16.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a856640 1 -- 172.21.15.17:0/1690596969 shutdown_connections 2023-08-09T12:47:16.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.682+0000 7fdf9a856640 1 -- 172.21.15.17:0/1690596969 wait complete. 2023-08-09T12:47:16.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.684+0000 7fdf9a856640 1 Processor -- start 2023-08-09T12:47:16.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.684+0000 7fdf9a856640 1 -- start start 2023-08-09T12:47:16.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.685+0000 7fdf9a856640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf940b0020 0x7fdf940c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.685+0000 7fdf9a856640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b13f0 0x7fdf9414bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.685+0000 7fdf9a856640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 0x7fdf9415d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.685+0000 7fdf9a856640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9415bfa0 con 0x7fdf940b13f0 2023-08-09T12:47:16.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.685+0000 7fdf9a856640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9415c280 con 0x7fdf940b0020 2023-08-09T12:47:16.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.685+0000 7fdf9a856640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9415c560 con 0x7fdf9415a8c0 2023-08-09T12:47:16.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.685+0000 7fdf99053640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b13f0 0x7fdf9414bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf99053640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b13f0 0x7fdf9414bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38836/0 (socket says 172.21.15.17:38836) 2023-08-09T12:47:16.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf99053640 1 -- 172.21.15.17:0/4095548496 learned_addr learned my addr 172.21.15.17:0/4095548496 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:16.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf99053640 1 -- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 msgr2=0x7fdf9415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf99053640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 0x7fdf9415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf99053640 1 -- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf940b0020 msgr2=0x7fdf940c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf99053640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf940b0020 0x7fdf940c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf99053640 1 -- 172.21.15.17:0/4095548496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c009b30 con 0x7fdf940b13f0 2023-08-09T12:47:16.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf99053640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b13f0 0x7fdf9414bd20 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c430 tx=0x7fdf8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:16.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.686+0000 7fdf8a7fc640 1 -- 172.21.15.17:0/4095548496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84011790 con 0x7fdf940b13f0 2023-08-09T12:47:16.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.687+0000 7fdf8a7fc640 1 -- 172.21.15.17:0/4095548496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840118f0 con 0x7fdf940b13f0 2023-08-09T12:47:16.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.687+0000 7fdf8a7fc640 1 -- 172.21.15.17:0/4095548496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84011ce0 con 0x7fdf940b13f0 2023-08-09T12:47:16.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.687+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9415c840 con 0x7fdf940b13f0 2023-08-09T12:47:16.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.687+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9415cd60 con 0x7fdf940b13f0 2023-08-09T12:47:16.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.688+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9415ca60 con 0x7fdf940b13f0 2023-08-09T12:47:16.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.690+0000 7fdf8a7fc640 1 -- 172.21.15.17:0/4095548496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdf8401c460 con 0x7fdf940b13f0 2023-08-09T12:47:16.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.691+0000 7fdf8a7fc640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdf7806a050 0x7fdf7806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:16.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.691+0000 7fdf8a7fc640 1 -- 172.21.15.17:0/4095548496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fdf84088530 con 0x7fdf940b13f0 2023-08-09T12:47:16.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.692+0000 7fdf99854640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdf7806a050 0x7fdf7806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:16.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.692+0000 7fdf99854640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdf7806a050 0x7fdf7806c510 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdf90006fd0 tx=0x7fdf90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:16.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.695+0000 7fdf8a7fc640 1 -- 172.21.15.17:0/4095548496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdf84053c90 con 0x7fdf940b13f0 2023-08-09T12:47:16.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.887+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf9415c0e0 con 0x7fdf940b13f0 2023-08-09T12:47:16.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.888+0000 7fdf8a7fc640 1 -- 172.21.15.17:0/4095548496 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf9415c0e0 con 0x7fdf940b13f0 2023-08-09T12:47:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:47:16.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.890+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdf7806a050 msgr2=0x7fdf7806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.890+0000 7fdf9a856640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdf7806a050 0x7fdf7806c510 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdf90006fd0 tx=0x7fdf90008040 comp rx=0 tx=0).stop 2023-08-09T12:47:16.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.890+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b13f0 msgr2=0x7fdf9414bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:16.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.890+0000 7fdf9a856640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b13f0 0x7fdf9414bd20 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c430 tx=0x7fdf8400c8f0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.891+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 shutdown_connections 2023-08-09T12:47:16.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.891+0000 7fdf9a856640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdf7806a050 0x7fdf7806c510 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.891+0000 7fdf9a856640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf9415a8c0 0x7fdf9415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.891+0000 7fdf9a856640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf940b13f0 0x7fdf9414bd20 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.891+0000 7fdf9a856640 1 --2- 172.21.15.17:0/4095548496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf940b0020 0x7fdf940c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:16.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.891+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 >> 172.21.15.17:0/4095548496 conn(0x7fdf940cb020 msgr2=0x7fdf940ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:16.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.891+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 shutdown_connections 2023-08-09T12:47:16.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:16.891+0000 7fdf9a856640 1 -- 172.21.15.17:0/4095548496 wait complete. 2023-08-09T12:47:16.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:47:17.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.140+0000 7f7073fc8640 1 Processor -- start 2023-08-09T12:47:17.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.140+0000 7f7073fc8640 1 -- start start 2023-08-09T12:47:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7073fc8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c0adc40 0x7f706c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7073fc8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f706c0cc630 0x7f706c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7073fc8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0b2250 con 0x7f706c0b3b40 2023-08-09T12:47:17.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7073fc8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c0ae020 con 0x7f706c0cc630 2023-08-09T12:47:17.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7073fc8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0b2530 con 0x7f706c0adc40 2023-08-09T12:47:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7071563640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f706c0b3b40 0x7f706c0b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34676/0 (socket says 172.21.15.17:34676) 2023-08-09T12:47:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7071563640 1 -- 172.21.15.17:0/2879777927 learned_addr learned my addr 172.21.15.17:0/2879777927 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7071d64640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c0adc40 0x7f706c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7072565640 1 --2- 172.21.15.17:0/2879777927 >> v2:172.21.15.142:3300/0 conn(0x7f706c0cc630 0x7f706c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471780756 0 0) 0x7f706c0b2250 con 0x7f706c0b3b40 2023-08-09T12:47:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.142+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7058003520 con 0x7f706c0b3b40 2023-08-09T12:47:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4269587858 0 0) 0x7f7058003520 con 0x7f706c0b3b40 2023-08-09T12:47:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c0adc40 msgr2=0x7f706c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c0adc40 0x7f706c06c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 >> v2:172.21.15.142:3300/0 conn(0x7f706c0cc630 msgr2=0x7f706c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 --2- 172.21.15.17:0/2879777927 >> v2:172.21.15.142:3300/0 conn(0x7f706c0cc630 0x7f706c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c06fe80 con 0x7f706c0b3b40 2023-08-09T12:47:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f705c0017f0 con 0x7f706c0b3b40 2023-08-09T12:47:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 >> v1:172.21.15.17:6789/0 conn(0x7f706c0b3b40 legacy=0x7f706c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7058003970 0x7f7058003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c0adc40 0x7f70580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058004d00 0x7f7058005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0ae020 con 0x7f7058003970 2023-08-09T12:47:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0b2530 con 0x7f7058004d00 2023-08-09T12:47:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705800b980 con 0x7f706c0adc40 2023-08-09T12:47:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.143+0000 7f7071d64640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7058003970 0x7f7058003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.144+0000 7f7072565640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058004d00 0x7f7058005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.144+0000 7f7071d64640 1 -- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c0adc40 msgr2=0x7f70580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.144+0000 7f7071563640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c0adc40 0x7f70580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.144+0000 7f7071d64640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c0adc40 0x7f70580047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.144+0000 7f7071d64640 1 -- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058004d00 msgr2=0x7f7058005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.144+0000 7f7071d64640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058004d00 0x7f7058005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.144+0000 7f7071d64640 1 -- 172.21.15.17:0/2879777927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058003520 con 0x7f7058003970 2023-08-09T12:47:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.144+0000 7f7072565640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058004d00 0x7f7058005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.145+0000 7f7071d64640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7058003970 0x7f7058003d90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f7068009ac0 tx=0x7f70580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97dbebd8ef449f0a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.145+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706802c6b0 con 0x7f7058003970 2023-08-09T12:47:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.145+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706802c810 con 0x7f7058003970 2023-08-09T12:47:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.145+0000 7f7070d62640 1 -- 172.21.15.17:0/2879777927 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706802cba0 con 0x7f7058003970 2023-08-09T12:47:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.147+0000 7f7073fc8640 1 -- 172.21.15.17:0/2879777927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7058003970 msgr2=0x7f7058003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.147+0000 7f7073fc8640 1 --2- 172.21.15.17:0/2879777927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7058003970 0x7f7058003d90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f7068009ac0 tx=0x7f70580057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.147+0000 7f7072565640 1 -- 172.21.15.17:0/2879777927 reap_dead start 2023-08-09T12:47:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.147+0000 7f7073fc8640 1 -- 172.21.15.17:0/2879777927 shutdown_connections 2023-08-09T12:47:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.147+0000 7f7073fc8640 1 -- 172.21.15.17:0/2879777927 >> 172.21.15.17:0/2879777927 conn(0x7f706c0cb1b0 msgr2=0x7f706c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.147+0000 7f7073fc8640 1 -- 172.21.15.17:0/2879777927 shutdown_connections 2023-08-09T12:47:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.147+0000 7f7073fc8640 1 -- 172.21.15.17:0/2879777927 wait complete. 2023-08-09T12:47:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.148+0000 7f7073fc8640 1 Processor -- start 2023-08-09T12:47:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.148+0000 7f7073fc8640 1 -- start start 2023-08-09T12:47:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7073fc8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058003970 0x7f706c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7073fc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706c0caa60 0x7f706c0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7073fc8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c155220 0x7f706c149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7073fc8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0ca640 con 0x7f706c0caa60 2023-08-09T12:47:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7073fc8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0c9790 con 0x7f7058003970 2023-08-09T12:47:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7073fc8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0c99c0 con 0x7f706c155220 2023-08-09T12:47:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706c0caa60 0x7f706c0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706c0caa60 0x7f706c0acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38844/0 (socket says 172.21.15.17:38844) 2023-08-09T12:47:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 -- 172.21.15.17:0/197015792 learned_addr learned my addr 172.21.15.17:0/197015792 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7072565640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c155220 0x7f706c149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071d64640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058003970 0x7f706c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 -- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c155220 msgr2=0x7f706c149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c155220 0x7f706c149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 -- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058003970 msgr2=0x7f706c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058003970 0x7f706c0c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 -- 172.21.15.17:0/197015792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0c9ca0 con 0x7f706c0caa60 2023-08-09T12:47:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7071563640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706c0caa60 0x7f706c0acb20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f705c00d7a0 tx=0x7f705c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f70627fc640 1 -- 172.21.15.17:0/197015792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c007270 con 0x7f706c0caa60 2023-08-09T12:47:17.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f70627fc640 1 -- 172.21.15.17:0/197015792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c0073d0 con 0x7f706c0caa60 2023-08-09T12:47:17.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f70627fc640 1 -- 172.21.15.17:0/197015792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c0057a0 con 0x7f706c0caa60 2023-08-09T12:47:17.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c0c9f80 con 0x7f706c0caa60 2023-08-09T12:47:17.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.150+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c0ad060 con 0x7f706c0caa60 2023-08-09T12:47:17.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.151+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c0ca780 con 0x7f706c0caa60 2023-08-09T12:47:17.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.152+0000 7f70627fc640 1 -- 172.21.15.17:0/197015792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f705c005900 con 0x7f706c0caa60 2023-08-09T12:47:17.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.153+0000 7f70627fc640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.153+0000 7f70627fc640 1 -- 172.21.15.17:0/197015792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f705c088690 con 0x7f706c0caa60 2023-08-09T12:47:17.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.155+0000 7f7071d64640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.155+0000 7f7071d64640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7068036000 tx=0x7f7068030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:17.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.158+0000 7f70627fc640 1 -- 172.21.15.17:0/197015792 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f706c0ca780 con 0x7f706c0caa60 2023-08-09T12:47:17.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.363+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f706c0ca780 con 0x7f706c0caa60 2023-08-09T12:47:17.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.364+0000 7f70627fc640 1 -- 172.21.15.17:0/197015792 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v135) v1 ==== 80+0+0 (secure 0 0 0) 0x7f706c0ca780 con 0x7f706c0caa60 2023-08-09T12:47:17.367 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:47:17.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 msgr2=0x7f705006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7068036000 tx=0x7f7068030000 comp rx=0 tx=0).stop 2023-08-09T12:47:17.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706c0caa60 msgr2=0x7f706c0acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706c0caa60 0x7f706c0acb20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f705c00d7a0 tx=0x7f705c00dc60 comp rx=0 tx=0).stop 2023-08-09T12:47:17.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 shutdown_connections 2023-08-09T12:47:17.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f705006a050 0x7f705006c510 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c155220 0x7f706c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706c0caa60 0x7f706c0acb20 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 --2- 172.21.15.17:0/197015792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7058003970 0x7f706c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 >> 172.21.15.17:0/197015792 conn(0x7f706c0cb1b0 msgr2=0x7f706c0af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:17.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 shutdown_connections 2023-08-09T12:47:17.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.368+0000 7f7073fc8640 1 -- 172.21.15.17:0/197015792 wait complete. 2023-08-09T12:47:17.389 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:47:17.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:17.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:17.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:47:17.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:17.519 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:47:17.573 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:17.574 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:17.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:47:17.637 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:47:17.638 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:17.697 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:47:17.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:17.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.936+0000 7f4635d9f640 1 Processor -- start 2023-08-09T12:47:17.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.936+0000 7f4635d9f640 1 -- start start 2023-08-09T12:47:17.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.938+0000 7f4635d9f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46300adc40 0x7f463006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.938+0000 7f4635d9f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300cc630 0x7f46300ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.938+0000 7f4635d9f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46300b2250 con 0x7f46300b3b40 2023-08-09T12:47:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.938+0000 7f4635d9f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46300ae020 con 0x7f46300adc40 2023-08-09T12:47:17.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.938+0000 7f4635d9f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300b2530 con 0x7f46300cc630 2023-08-09T12:47:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.939+0000 7f462f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46300adc40 0x7f463006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.939+0000 7f462ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300cc630 0x7f46300ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.939+0000 7f4627fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f46300b3b40 0x7f46300b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:40128/0 (socket says 172.21.15.17:40128) 2023-08-09T12:47:17.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.939+0000 7f462ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300cc630 0x7f46300ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:44112/0 (socket says 172.21.15.17:44112) 2023-08-09T12:47:17.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.939+0000 7f462f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46300adc40 0x7f463006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:44610/0 (socket says 172.21.15.17:44610) 2023-08-09T12:47:17.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.939+0000 7f4627fff640 1 -- 172.21.15.17:0/4288934842 learned_addr learned my addr 172.21.15.17:0/4288934842 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:17.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.940+0000 7f462f7fe640 1 -- 172.21.15.17:0/4288934842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300cc630 msgr2=0x7f46300ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:17.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.940+0000 7f462f7fe640 1 --2- 172.21.15.17:0/4288934842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300cc630 0x7f46300ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.940+0000 7f462f7fe640 1 -- 172.21.15.17:0/4288934842 >> v1:172.21.15.142:6789/0 conn(0x7f46300b3b40 legacy=0x7f46300b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.940+0000 7f462f7fe640 1 -- 172.21.15.17:0/4288934842 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463006fe80 con 0x7f46300adc40 2023-08-09T12:47:17.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.940+0000 7f462ffff640 1 --2- 172.21.15.17:0/4288934842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300cc630 0x7f46300ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:47:17.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.940+0000 7f462effd640 1 -- 172.21.15.17:0/4288934842 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299665220 0 0) 0x7f46300b2250 con 0x7f46300b3b40 2023-08-09T12:47:17.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.942+0000 7f462f7fe640 1 --2- 172.21.15.17:0/4288934842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300adc40 0x7f463006c280 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f46200097a0 tx=0x7f462002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6569306b24307032 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:17.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.942+0000 7f462effd640 1 -- 172.21.15.17:0/4288934842 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620031780 con 0x7f46300adc40 2023-08-09T12:47:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.942+0000 7f462effd640 1 -- 172.21.15.17:0/4288934842 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46200318e0 con 0x7f46300adc40 2023-08-09T12:47:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.942+0000 7f462effd640 1 -- 172.21.15.17:0/4288934842 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620031c70 con 0x7f46300adc40 2023-08-09T12:47:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.943+0000 7f4635d9f640 1 -- 172.21.15.17:0/4288934842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300adc40 msgr2=0x7f463006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.943+0000 7f4635d9f640 1 --2- 172.21.15.17:0/4288934842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300adc40 0x7f463006c280 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f46200097a0 tx=0x7f462002b820 comp rx=0 tx=0).stop 2023-08-09T12:47:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.943+0000 7f4635d9f640 1 -- 172.21.15.17:0/4288934842 shutdown_connections 2023-08-09T12:47:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.943+0000 7f4635d9f640 1 --2- 172.21.15.17:0/4288934842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300cc630 0x7f46300ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.943+0000 7f4635d9f640 1 --2- 172.21.15.17:0/4288934842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300adc40 0x7f463006c280 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.943+0000 7f4635d9f640 1 -- 172.21.15.17:0/4288934842 >> 172.21.15.17:0/4288934842 conn(0x7f46300cb1b0 msgr2=0x7f46300cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.943+0000 7f4635d9f640 1 -- 172.21.15.17:0/4288934842 shutdown_connections 2023-08-09T12:47:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.943+0000 7f4635d9f640 1 -- 172.21.15.17:0/4288934842 wait complete. 2023-08-09T12:47:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.945+0000 7f4635d9f640 1 Processor -- start 2023-08-09T12:47:17.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.945+0000 7f4635d9f640 1 -- start start 2023-08-09T12:47:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.946+0000 7f4635d9f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300adc40 0x7f4630159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.946+0000 7f4635d9f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300b3b40 0x7f463015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.946+0000 7f4635d9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46300cc630 0x7f46300af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.946+0000 7f4635d9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46300c97f0 con 0x7f46300cc630 2023-08-09T12:47:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.946+0000 7f4635d9f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46300c9ad0 con 0x7f46300b3b40 2023-08-09T12:47:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.946+0000 7f4635d9f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300c9db0 con 0x7f46300adc40 2023-08-09T12:47:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46300cc630 0x7f46300af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46300cc630 0x7f46300af5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44916/0 (socket says 172.21.15.17:44916) 2023-08-09T12:47:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462ffff640 1 -- 172.21.15.17:0/157257596 learned_addr learned my addr 172.21.15.17:0/157257596 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462f7fe640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300adc40 0x7f4630159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f4627fff640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300b3b40 0x7f463015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462ffff640 1 -- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300adc40 msgr2=0x7f4630159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462ffff640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300adc40 0x7f4630159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462ffff640 1 -- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300b3b40 msgr2=0x7f463015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462ffff640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300b3b40 0x7f463015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.947+0000 7f462ffff640 1 -- 172.21.15.17:0/157257596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628009a70 con 0x7f46300cc630 2023-08-09T12:47:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.948+0000 7f462ffff640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46300cc630 0x7f46300af5e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f462800efc0 tx=0x7f462800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.948+0000 7f462cff9640 1 -- 172.21.15.17:0/157257596 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628009cd0 con 0x7f46300cc630 2023-08-09T12:47:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.948+0000 7f462cff9640 1 -- 172.21.15.17:0/157257596 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462800f040 con 0x7f46300cc630 2023-08-09T12:47:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.948+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4620009400 con 0x7f46300cc630 2023-08-09T12:47:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.948+0000 7f462cff9640 1 -- 172.21.15.17:0/157257596 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628003990 con 0x7f46300cc630 2023-08-09T12:47:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.948+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46300ca370 con 0x7f46300cc630 2023-08-09T12:47:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.949+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46300ca590 con 0x7f46300cc630 2023-08-09T12:47:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.950+0000 7f462cff9640 1 -- 172.21.15.17:0/157257596 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4628014480 con 0x7f46300cc630 2023-08-09T12:47:17.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.951+0000 7f462cff9640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f461006a080 0x7f461006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:17.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.951+0000 7f462cff9640 1 -- 172.21.15.17:0/157257596 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f46280890f0 con 0x7f46300cc630 2023-08-09T12:47:17.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.952+0000 7f462f7fe640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f461006a080 0x7f461006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:17.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.953+0000 7f462f7fe640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f461006a080 0x7f461006c540 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4620036000 tx=0x7f462003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:17.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:17.955+0000 7f462cff9640 1 -- 172.21.15.17:0/157257596 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4628058240 con 0x7f46300cc630 2023-08-09T12:47:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.192+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4630067a80 con 0x7f46300cc630 2023-08-09T12:47:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.193+0000 7f462cff9640 1 -- 172.21.15.17:0/157257596 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f4628057dd0 con 0x7f46300cc630 2023-08-09T12:47:18.196 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:18.196 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:46:54.580315+0000","modified":"2023-08-09T12:46:58.167844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1719182807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1719182807},{"type":"v1","addr":"172.21.15.17:6835","nonce":1719182807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-09T12:47:18.196 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 59 2023-08-09T12:47:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f461006a080 msgr2=0x7f461006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f461006a080 0x7f461006c540 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4620036000 tx=0x7f462003d040 comp rx=0 tx=0).stop 2023-08-09T12:47:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46300cc630 msgr2=0x7f46300af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46300cc630 0x7f46300af5e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f462800efc0 tx=0x7f462800c490 comp rx=0 tx=0).stop 2023-08-09T12:47:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 shutdown_connections 2023-08-09T12:47:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f461006a080 0x7f461006c540 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46300cc630 0x7f46300af5e0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46300b3b40 0x7f463015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 --2- 172.21.15.17:0/157257596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46300adc40 0x7f4630159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 >> 172.21.15.17:0/157257596 conn(0x7f46300cb1b0 msgr2=0x7f463006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 shutdown_connections 2023-08-09T12:47:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.197+0000 7f4635d9f640 1 -- 172.21.15.17:0/157257596 wait complete. 2023-08-09T12:47:18.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:18.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.447+0000 7f3c5d1fc640 1 Processor -- start 2023-08-09T12:47:18.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.448+0000 7f3c5d1fc640 1 -- start start 2023-08-09T12:47:18.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.449+0000 7f3c5d1fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3c580b3fe0 0x7f3c580ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.449+0000 7f3c5d1fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c580697c0 0x7f3c58069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.449+0000 7f3c5d1fc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5806fe10 con 0x7f3c58159bd0 2023-08-09T12:47:18.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.449+0000 7f3c5d1fc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c580b11a0 con 0x7f3c580b3fe0 2023-08-09T12:47:18.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.449+0000 7f3c5d1fc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5806a190 con 0x7f3c580697c0 2023-08-09T12:47:18.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.449+0000 7f3c57fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3c58159bd0 0x7f3c58070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58680/0 (socket says 172.21.15.17:58680) 2023-08-09T12:47:18.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.449+0000 7f3c57fff640 1 -- 172.21.15.17:0/1252578717 learned_addr learned my addr 172.21.15.17:0/1252578717 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:18.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.449+0000 7f3c4f7fe640 1 --2- 172.21.15.17:0/1252578717 >> v2:172.21.15.17:3300/0 conn(0x7f3c580b3fe0 0x7f3c580ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.450+0000 7f3c577fe640 1 -- 172.21.15.17:0/1252578717 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233532230 0 0) 0x7f3c5806fe10 con 0x7f3c58159bd0 2023-08-09T12:47:18.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.450+0000 7f3c5c9fb640 1 --2- 172.21.15.17:0/1252578717 >> v2:172.21.15.142:3300/0 conn(0x7f3c580697c0 0x7f3c58069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.450+0000 7f3c577fe640 1 -- 172.21.15.17:0/1252578717 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c44003520 con 0x7f3c58159bd0 2023-08-09T12:47:18.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.450+0000 7f3c4f7fe640 1 -- 172.21.15.17:0/1252578717 >> v2:172.21.15.142:3300/0 conn(0x7f3c580697c0 msgr2=0x7f3c58069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:18.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.450+0000 7f3c4f7fe640 1 --2- 172.21.15.17:0/1252578717 >> v2:172.21.15.142:3300/0 conn(0x7f3c580697c0 0x7f3c58069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.450+0000 7f3c4f7fe640 1 -- 172.21.15.17:0/1252578717 >> v1:172.21.15.17:6789/0 conn(0x7f3c58159bd0 legacy=0x7f3c58070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.450+0000 7f3c4f7fe640 1 -- 172.21.15.17:0/1252578717 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58159fb0 con 0x7f3c580b3fe0 2023-08-09T12:47:18.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.452+0000 7f3c4f7fe640 1 --2- 172.21.15.17:0/1252578717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580b3fe0 0x7f3c580ca730 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f3c5815d590 tx=0x7f3c4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed367a1f72638e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:18.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.452+0000 7f3c577fe640 1 -- 172.21.15.17:0/1252578717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4002e070 con 0x7f3c580b3fe0 2023-08-09T12:47:18.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.452+0000 7f3c577fe640 1 -- 172.21.15.17:0/1252578717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400315a0 con 0x7f3c580b3fe0 2023-08-09T12:47:18.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.452+0000 7f3c577fe640 1 -- 172.21.15.17:0/1252578717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40031910 con 0x7f3c580b3fe0 2023-08-09T12:47:18.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.452+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1252578717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580b3fe0 msgr2=0x7f3c580ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.452+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1252578717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580b3fe0 0x7f3c580ca730 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f3c5815d590 tx=0x7f3c4002b840 comp rx=0 tx=0).stop 2023-08-09T12:47:18.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.453+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1252578717 shutdown_connections 2023-08-09T12:47:18.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.453+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1252578717 >> v2:172.21.15.142:3300/0 conn(0x7f3c580697c0 0x7f3c58069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.453+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1252578717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580b3fe0 0x7f3c580ca730 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.453+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1252578717 >> 172.21.15.17:0/1252578717 conn(0x7f3c580b1d50 msgr2=0x7f3c5806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:18.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.453+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1252578717 shutdown_connections 2023-08-09T12:47:18.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.453+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1252578717 wait complete. 2023-08-09T12:47:18.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.455+0000 7f3c5d1fc640 1 Processor -- start 2023-08-09T12:47:18.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.455+0000 7f3c5d1fc640 1 -- start start 2023-08-09T12:47:18.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c5d1fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580697c0 0x7f3c580c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c5d1fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c580b3fe0 0x7f3c580c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c5d1fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c58159bd0 0x7f3c581f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c5d1fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580c7430 con 0x7f3c580697c0 2023-08-09T12:47:18.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c5d1fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c581574c0 con 0x7f3c580b3fe0 2023-08-09T12:47:18.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c5d1fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580c67b0 con 0x7f3c58159bd0 2023-08-09T12:47:18.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580697c0 0x7f3c580c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580697c0 0x7f3c580c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44932/0 (socket says 172.21.15.17:44932) 2023-08-09T12:47:18.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c57fff640 1 -- 172.21.15.17:0/1025150982 learned_addr learned my addr 172.21.15.17:0/1025150982 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:18.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.456+0000 7f3c57fff640 1 -- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c58159bd0 msgr2=0x7f3c581f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c57fff640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c58159bd0 0x7f3c581f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c4f7fe640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c580b3fe0 0x7f3c580c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c57fff640 1 -- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c580b3fe0 msgr2=0x7f3c580c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c57fff640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c580b3fe0 0x7f3c580c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c57fff640 1 -- 172.21.15.17:0/1025150982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40009400 con 0x7f3c580697c0 2023-08-09T12:47:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c57fff640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580697c0 0x7f3c580c61d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800c390 tx=0x7f3c4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c557fa640 1 -- 172.21.15.17:0/1025150982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48005ce0 con 0x7f3c580697c0 2023-08-09T12:47:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c557fa640 1 -- 172.21.15.17:0/1025150982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48005e40 con 0x7f3c580697c0 2023-08-09T12:47:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c557fa640 1 -- 172.21.15.17:0/1025150982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480072f0 con 0x7f3c580697c0 2023-08-09T12:47:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c580c6a90 con 0x7f3c580697c0 2023-08-09T12:47:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.457+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c580c7050 con 0x7f3c580697c0 2023-08-09T12:47:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.459+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c580c7570 con 0x7f3c580697c0 2023-08-09T12:47:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.460+0000 7f3c557fa640 1 -- 172.21.15.17:0/1025150982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c48007450 con 0x7f3c580697c0 2023-08-09T12:47:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.460+0000 7f3c557fa640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c3806a050 0x7f3c3806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.461+0000 7f3c557fa640 1 -- 172.21.15.17:0/1025150982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f3c48087c10 con 0x7f3c580697c0 2023-08-09T12:47:18.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.461+0000 7f3c4f7fe640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c3806a050 0x7f3c3806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.462+0000 7f3c4f7fe640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c3806a050 0x7f3c3806c510 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3c40036000 tx=0x7f3c40008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.465+0000 7f3c557fa640 1 -- 172.21.15.17:0/1025150982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3c580c7570 con 0x7f3c580697c0 2023-08-09T12:47:18.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.666+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c580c7570 con 0x7f3c580697c0 2023-08-09T12:47:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.669+0000 7f3c557fa640 1 -- 172.21.15.17:0/1025150982 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+18328 (secure 0 0 0) 0x7f3c580c7570 con 0x7f3c580697c0 2023-08-09T12:47:18.671 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:18.672 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":135,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:12.937583+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.35","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c3806a050 msgr2=0x7f3c3806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c3806a050 0x7f3c3806c510 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3c40036000 tx=0x7f3c40008030 comp rx=0 tx=0).stop 2023-08-09T12:47:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580697c0 msgr2=0x7f3c580c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580697c0 0x7f3c580c61d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800c390 tx=0x7f3c4800c850 comp rx=0 tx=0).stop 2023-08-09T12:47:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 shutdown_connections 2023-08-09T12:47:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c3806a050 0x7f3c3806c510 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c58159bd0 0x7f3c581f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c580b3fe0 0x7f3c580c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 --2- 172.21.15.17:0/1025150982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c580697c0 0x7f3c580c61d0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 >> 172.21.15.17:0/1025150982 conn(0x7f3c580b1d50 msgr2=0x7f3c580cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:18.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.671+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 shutdown_connections 2023-08-09T12:47:18.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.672+0000 7f3c5d1fc640 1 -- 172.21.15.17:0/1025150982 wait complete. 2023-08-09T12:47:18.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:46:52.804156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:46:53.615239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:47:18.693 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:47:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.911+0000 7fbf2f8d2640 1 Processor -- start 2023-08-09T12:47:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.912+0000 7fbf2f8d2640 1 -- start start 2023-08-09T12:47:18.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.913+0000 7fbf2f8d2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf280adc40 0x7fbf2806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.913+0000 7fbf2f8d2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf280b2250 con 0x7fbf280b3b40 2023-08-09T12:47:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.913+0000 7fbf2f8d2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf280b2530 con 0x7fbf280cc630 2023-08-09T12:47:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.913+0000 7fbf2f8d2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280ae020 con 0x7fbf280adc40 2023-08-09T12:47:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.914+0000 7fbf2ce6d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fbf280b3b40 0x7fbf280b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58684/0 (socket says 172.21.15.17:58684) 2023-08-09T12:47:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.914+0000 7fbf2ce6d640 1 -- 172.21.15.17:0/2553914420 learned_addr learned my addr 172.21.15.17:0/2553914420 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.914+0000 7fbf2d66e640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf280adc40 0x7fbf2806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.914+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939306496 0 0) 0x7fbf280b2250 con 0x7fbf280b3b40 2023-08-09T12:47:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.914+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf14003520 con 0x7fbf280b3b40 2023-08-09T12:47:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1398855537 0 0) 0x7fbf14003520 con 0x7fbf280b3b40 2023-08-09T12:47:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf280adc40 msgr2=0x7fbf2806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf280adc40 0x7fbf2806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 >> v1:172.21.15.142:6789/0 conn(0x7fbf280cc630 legacy=0x7fbf280ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2806fe80 con 0x7fbf280b3b40 2023-08-09T12:47:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fbf18005090 con 0x7fbf280b3b40 2023-08-09T12:47:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 >> v1:172.21.15.17:6789/0 conn(0x7fbf280b3b40 legacy=0x7fbf280b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf280adc40 0x7fbf140039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf14003fd0 0x7fbf140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14004d00 0x7fbf14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280ae020 con 0x7fbf14003fd0 2023-08-09T12:47:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1400ff50 con 0x7fbf14004d00 2023-08-09T12:47:18.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14010110 con 0x7fbf280adc40 2023-08-09T12:47:18.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.915+0000 7fbf2ce6d640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf14003fd0 0x7fbf140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.916+0000 7fbf2d66e640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf280adc40 0x7fbf140039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.916+0000 7fbf2de6f640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14004d00 0x7fbf14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.916+0000 7fbf2ce6d640 1 -- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf280adc40 msgr2=0x7fbf140039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:18.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.916+0000 7fbf2ce6d640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf280adc40 0x7fbf140039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.916+0000 7fbf2ce6d640 1 -- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14004d00 msgr2=0x7fbf14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:18.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.916+0000 7fbf2ce6d640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14004d00 0x7fbf14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.916+0000 7fbf2ce6d640 1 -- 172.21.15.17:0/2553914420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14003520 con 0x7fbf14003fd0 2023-08-09T12:47:18.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.917+0000 7fbf2ce6d640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf14003fd0 0x7fbf140047c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800c190 tx=0x7fbf140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5851da746a74245e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:18.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.917+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18005ad0 con 0x7fbf14003fd0 2023-08-09T12:47:18.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.917+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18005c30 con 0x7fbf14003fd0 2023-08-09T12:47:18.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.917+0000 7fbf1ffff640 1 -- 172.21.15.17:0/2553914420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1802caf0 con 0x7fbf14003fd0 2023-08-09T12:47:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.918+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/2553914420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf14003fd0 msgr2=0x7fbf140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.918+0000 7fbf2f8d2640 1 --2- 172.21.15.17:0/2553914420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf14003fd0 0x7fbf140047c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800c190 tx=0x7fbf140057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.918+0000 7fbf2de6f640 1 -- 172.21.15.17:0/2553914420 reap_dead start 2023-08-09T12:47:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.918+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/2553914420 shutdown_connections 2023-08-09T12:47:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.918+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/2553914420 >> 172.21.15.17:0/2553914420 conn(0x7fbf280cb1b0 msgr2=0x7fbf280cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.918+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/2553914420 shutdown_connections 2023-08-09T12:47:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.918+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/2553914420 wait complete. 2023-08-09T12:47:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.920+0000 7fbf2f8d2640 1 Processor -- start 2023-08-09T12:47:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.920+0000 7fbf2f8d2640 1 -- start start 2023-08-09T12:47:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.921+0000 7fbf2f8d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14003fd0 0x7fbf28156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.921+0000 7fbf2f8d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf281534d0 0x7fbf28157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.921+0000 7fbf2f8d2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf281576c0 0x7fbf281f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.921+0000 7fbf2f8d2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c23c0 con 0x7fbf281534d0 2023-08-09T12:47:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.921+0000 7fbf2f8d2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28154c00 con 0x7fbf14003fd0 2023-08-09T12:47:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.921+0000 7fbf2f8d2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c3fb0 con 0x7fbf281576c0 2023-08-09T12:47:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf281534d0 0x7fbf28157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf281534d0 0x7fbf28157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44958/0 (socket says 172.21.15.17:44958) 2023-08-09T12:47:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 -- 172.21.15.17:0/3541220898 learned_addr learned my addr 172.21.15.17:0/3541220898 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:18.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2de6f640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf281576c0 0x7fbf281f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 -- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf281576c0 msgr2=0x7fbf281f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf281576c0 0x7fbf281f1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 -- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14003fd0 msgr2=0x7fbf28156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:18.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2d66e640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14003fd0 0x7fbf28156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14003fd0 0x7fbf28156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:18.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 -- 172.21.15.17:0/3541220898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280c2610 con 0x7fbf281534d0 2023-08-09T12:47:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2d66e640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14003fd0 0x7fbf28156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.922+0000 7fbf2ce6d640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf281534d0 0x7fbf28157180 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fbf1802c450 tx=0x7fbf18005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.923+0000 7fbf1dffb640 1 -- 172.21.15.17:0/3541220898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18039070 con 0x7fbf281534d0 2023-08-09T12:47:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.923+0000 7fbf1dffb640 1 -- 172.21.15.17:0/3541220898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1802cce0 con 0x7fbf281534d0 2023-08-09T12:47:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.923+0000 7fbf1dffb640 1 -- 172.21.15.17:0/3541220898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1803c040 con 0x7fbf281534d0 2023-08-09T12:47:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.923+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf280c28f0 con 0x7fbf281534d0 2023-08-09T12:47:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.923+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2815b830 con 0x7fbf281534d0 2023-08-09T12:47:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.924+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2815ba20 con 0x7fbf281534d0 2023-08-09T12:47:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.925+0000 7fbf1dffb640 1 -- 172.21.15.17:0/3541220898 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf18032070 con 0x7fbf281534d0 2023-08-09T12:47:18.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.926+0000 7fbf1dffb640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbf0c06a080 0x7fbf0c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:18.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.926+0000 7fbf1dffb640 1 -- 172.21.15.17:0/3541220898 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fbf180a9a10 con 0x7fbf281534d0 2023-08-09T12:47:18.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.927+0000 7fbf2d66e640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbf0c06a080 0x7fbf0c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:18.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.928+0000 7fbf2d66e640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbf0c06a080 0x7fbf0c06c540 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbf24006fd0 tx=0x7fbf24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:18.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:18.930+0000 7fbf1dffb640 1 -- 172.21.15.17:0/3541220898 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbf180750d0 con 0x7fbf281534d0 2023-08-09T12:47:19.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.125+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf28067a80 con 0x7fbf281534d0 2023-08-09T12:47:19.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.126+0000 7fbf1dffb640 1 -- 172.21.15.17:0/3541220898 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf180786f0 con 0x7fbf281534d0 2023-08-09T12:47:19.129 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:47:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbf0c06a080 msgr2=0x7fbf0c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbf0c06a080 0x7fbf0c06c540 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbf24006fd0 tx=0x7fbf24008040 comp rx=0 tx=0).stop 2023-08-09T12:47:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf281534d0 msgr2=0x7fbf28157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf281534d0 0x7fbf28157180 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fbf1802c450 tx=0x7fbf18005420 comp rx=0 tx=0).stop 2023-08-09T12:47:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 shutdown_connections 2023-08-09T12:47:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbf0c06a080 0x7fbf0c06c540 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf281576c0 0x7fbf281f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf281534d0 0x7fbf28157180 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 --2- 172.21.15.17:0/3541220898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf14003fd0 0x7fbf28156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 >> 172.21.15.17:0/3541220898 conn(0x7fbf280cb1b0 msgr2=0x7fbf2806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 shutdown_connections 2023-08-09T12:47:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.129+0000 7fbf2f8d2640 1 -- 172.21.15.17:0/3541220898 wait complete. 2023-08-09T12:47:19.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:47:19.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.385+0000 7f3933fff640 1 Processor -- start 2023-08-09T12:47:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.385+0000 7f3933fff640 1 -- start start 2023-08-09T12:47:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.387+0000 7f3933fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39340b3d60 0x7f39340cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.387+0000 7f3933fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340cc6b0 0x7f39340b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.387+0000 7f3933fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39340b2b90 con 0x7f3934159bd0 2023-08-09T12:47:19.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.387+0000 7f3933fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39340cabb0 con 0x7f39340b3d60 2023-08-09T12:47:19.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.387+0000 7f3933fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39340b2580 con 0x7f39340cc6b0 2023-08-09T12:47:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.388+0000 7f39337fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340cc6b0 0x7f39340b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.388+0000 7f392bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39340b3d60 0x7f39340cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.388+0000 7f39337fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340cc6b0 0x7f39340b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:44174/0 (socket says 172.21.15.17:44174) 2023-08-09T12:47:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.388+0000 7f39337fe640 1 -- 172.21.15.17:0/2356468274 learned_addr learned my addr 172.21.15.17:0/2356468274 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.389+0000 7f39337fe640 1 -- 172.21.15.17:0/2356468274 >> v2:172.21.15.142:3300/0 conn(0x7f39340b3d60 msgr2=0x7f39340cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.389+0000 7f39337fe640 1 --2- 172.21.15.17:0/2356468274 >> v2:172.21.15.142:3300/0 conn(0x7f39340b3d60 0x7f39340cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.389+0000 7f39337fe640 1 -- 172.21.15.17:0/2356468274 >> v1:172.21.15.142:6789/0 conn(0x7f3934159bd0 legacy=0x7f39340c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.389+0000 7f39337fe640 1 -- 172.21.15.17:0/2356468274 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340ca5f0 con 0x7f39340cc6b0 2023-08-09T12:47:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.389+0000 7f392bfff640 1 --2- 172.21.15.17:0/2356468274 >> v2:172.21.15.142:3300/0 conn(0x7f39340b3d60 0x7f39340cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:47:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.390+0000 7f39337fe640 1 --2- 172.21.15.17:0/2356468274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340cc6b0 0x7f39340b3020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f392c009e50 tx=0x7f392c02bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f082c6bb71832d8a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:19.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.391+0000 7f39327fc640 1 -- 172.21.15.17:0/2356468274 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c02c8c0 con 0x7f39340cc6b0 2023-08-09T12:47:19.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.391+0000 7f39327fc640 1 -- 172.21.15.17:0/2356468274 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c02ca20 con 0x7f39340cc6b0 2023-08-09T12:47:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.391+0000 7f39327fc640 1 -- 172.21.15.17:0/2356468274 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c02cdb0 con 0x7f39340cc6b0 2023-08-09T12:47:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.392+0000 7f3933fff640 1 -- 172.21.15.17:0/2356468274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340cc6b0 msgr2=0x7f39340b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.392+0000 7f3933fff640 1 --2- 172.21.15.17:0/2356468274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340cc6b0 0x7f39340b3020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f392c009e50 tx=0x7f392c02bda0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.392+0000 7f3933fff640 1 -- 172.21.15.17:0/2356468274 shutdown_connections 2023-08-09T12:47:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.392+0000 7f3933fff640 1 --2- 172.21.15.17:0/2356468274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340cc6b0 0x7f39340b3020 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.392+0000 7f3933fff640 1 --2- 172.21.15.17:0/2356468274 >> v2:172.21.15.142:3300/0 conn(0x7f39340b3d60 0x7f39340cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.392+0000 7f3933fff640 1 -- 172.21.15.17:0/2356468274 >> 172.21.15.17:0/2356468274 conn(0x7f39340cb020 msgr2=0x7f39340cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:19.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.392+0000 7f3933fff640 1 -- 172.21.15.17:0/2356468274 shutdown_connections 2023-08-09T12:47:19.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.392+0000 7f3933fff640 1 -- 172.21.15.17:0/2356468274 wait complete. 2023-08-09T12:47:19.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.394+0000 7f3933fff640 1 Processor -- start 2023-08-09T12:47:19.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.394+0000 7f3933fff640 1 -- start start 2023-08-09T12:47:19.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f3933fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340b3d60 0x7f3934148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f3933fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340cc6b0 0x7f393414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f3933fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3934159bd0 0x7f39341546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f3933fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3934149180 con 0x7f39340cc6b0 2023-08-09T12:47:19.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f3933fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393415cf70 con 0x7f3934159bd0 2023-08-09T12:47:19.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f3933fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393406f670 con 0x7f39340b3d60 2023-08-09T12:47:19.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f392bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340cc6b0 0x7f393414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f392bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340cc6b0 0x7f393414a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44970/0 (socket says 172.21.15.17:44970) 2023-08-09T12:47:19.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.395+0000 7f392bfff640 1 -- 172.21.15.17:0/1851325515 learned_addr learned my addr 172.21.15.17:0/1851325515 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:19.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.396+0000 7f39337fe640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3934159bd0 0x7f39341546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.396+0000 7f3932ffd640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340b3d60 0x7f3934148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.396+0000 7f392bfff640 1 -- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340b3d60 msgr2=0x7f3934148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.396+0000 7f392bfff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340b3d60 0x7f3934148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.396+0000 7f392bfff640 1 -- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3934159bd0 msgr2=0x7f39341546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.396+0000 7f392bfff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3934159bd0 0x7f39341546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.396+0000 7f392bfff640 1 -- 172.21.15.17:0/1851325515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c00d8a0 con 0x7f39340cc6b0 2023-08-09T12:47:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.396+0000 7f392bfff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340cc6b0 0x7f393414a0a0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f391c012fc0 tx=0x7f391c010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.397+0000 7f3930ff9640 1 -- 172.21.15.17:0/1851325515 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00dc00 con 0x7f39340cc6b0 2023-08-09T12:47:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.397+0000 7f3930ff9640 1 -- 172.21.15.17:0/1851325515 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c013040 con 0x7f39340cc6b0 2023-08-09T12:47:19.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.397+0000 7f3930ff9640 1 -- 172.21.15.17:0/1851325515 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00d2e0 con 0x7f39340cc6b0 2023-08-09T12:47:19.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.397+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c009b30 con 0x7f39340cc6b0 2023-08-09T12:47:19.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.397+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39341498a0 con 0x7f39340cc6b0 2023-08-09T12:47:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.398+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393404e390 con 0x7f39340cc6b0 2023-08-09T12:47:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.399+0000 7f3930ff9640 1 -- 172.21.15.17:0/1851325515 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f391c018480 con 0x7f39340cc6b0 2023-08-09T12:47:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.400+0000 7f3930ff9640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f391406a050 0x7f391406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.400+0000 7f3930ff9640 1 -- 172.21.15.17:0/1851325515 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f391c08c8b0 con 0x7f39340cc6b0 2023-08-09T12:47:19.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.401+0000 7f3932ffd640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f391406a050 0x7f391406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.402+0000 7f3932ffd640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f391406a050 0x7f391406c510 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3924000f60 tx=0x7f3924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:19.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.404+0000 7f3930ff9640 1 -- 172.21.15.17:0/1851325515 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f391c05b970 con 0x7f39340cc6b0 2023-08-09T12:47:19.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.607+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39340b38b0 con 0x7f39340cc6b0 2023-08-09T12:47:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.608+0000 7f3930ff9640 1 -- 172.21.15.17:0/1851325515 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f391c05b500 con 0x7f39340cc6b0 2023-08-09T12:47:19.610 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:47:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.610+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f391406a050 msgr2=0x7f391406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.610+0000 7f3933fff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f391406a050 0x7f391406c510 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3924000f60 tx=0x7f3924009040 comp rx=0 tx=0).stop 2023-08-09T12:47:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.610+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340cc6b0 msgr2=0x7f393414a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.610+0000 7f3933fff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340cc6b0 0x7f393414a0a0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f391c012fc0 tx=0x7f391c010490 comp rx=0 tx=0).stop 2023-08-09T12:47:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.611+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 shutdown_connections 2023-08-09T12:47:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.611+0000 7f3933fff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f391406a050 0x7f391406c510 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.611+0000 7f3933fff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3934159bd0 0x7f39341546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.611+0000 7f3933fff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340cc6b0 0x7f393414a0a0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.611+0000 7f3933fff640 1 --2- 172.21.15.17:0/1851325515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39340b3d60 0x7f3934148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.611+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 >> 172.21.15.17:0/1851325515 conn(0x7f39340cb020 msgr2=0x7f39340cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.611+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 shutdown_connections 2023-08-09T12:47:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.611+0000 7f3933fff640 1 -- 172.21.15.17:0/1851325515 wait complete. 2023-08-09T12:47:19.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:47:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.864+0000 7f04c17e1640 1 Processor -- start 2023-08-09T12:47:19.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.864+0000 7f04c17e1640 1 -- start start 2023-08-09T12:47:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.866+0000 7f04c17e1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f04bc0ce9e0 0x7f04bc0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.866+0000 7f04c17e1640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0cf380 con 0x7f04bc15b160 2023-08-09T12:47:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.866+0000 7f04c17e1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0b0220 con 0x7f04bc158840 2023-08-09T12:47:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.866+0000 7f04c17e1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04bc158c20 con 0x7f04bc0ce9e0 2023-08-09T12:47:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.867+0000 7f04bb7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f04bc15b160 0x7f04bc15b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58696/0 (socket says 172.21.15.17:58696) 2023-08-09T12:47:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.867+0000 7f04bb7fe640 1 -- 172.21.15.17:0/2051827787 learned_addr learned my addr 172.21.15.17:0/2051827787 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.867+0000 7f04b3fff640 1 --2- 172.21.15.17:0/2051827787 >> v2:172.21.15.142:3300/0 conn(0x7f04bc0ce9e0 0x7f04bc0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.867+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133552326 0 0) 0x7f04bc0cf380 con 0x7f04bc15b160 2023-08-09T12:47:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.867+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a8003520 con 0x7f04bc15b160 2023-08-09T12:47:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279092357 0 0) 0x7f04a8003520 con 0x7f04bc15b160 2023-08-09T12:47:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 >> v2:172.21.15.142:3300/0 conn(0x7f04bc0ce9e0 msgr2=0x7f04bc0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 --2- 172.21.15.17:0/2051827787 >> v2:172.21.15.142:3300/0 conn(0x7f04bc0ce9e0 0x7f04bc0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 >> v1:172.21.15.142:6789/0 conn(0x7f04bc158840 legacy=0x7f04bc0af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc15e7f0 con 0x7f04bc15b160 2023-08-09T12:47:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f04b40019f0 con 0x7f04bc15b160 2023-08-09T12:47:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 >> v1:172.21.15.17:6789/0 conn(0x7f04bc15b160 legacy=0x7f04bc15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a8003970 0x7f04a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80047c0 0x7f04a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04a8005180 0x7f04a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc158c20 con 0x7f04a80047c0 2023-08-09T12:47:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a800bfd0 con 0x7f04a8003970 2023-08-09T12:47:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a800c190 con 0x7f04a8005180 2023-08-09T12:47:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04b3fff640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80047c0 0x7f04a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.868+0000 7f04baffd640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a8003970 0x7f04a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.869+0000 7f04b3fff640 1 -- 172.21.15.17:0/2051827787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04a8005180 msgr2=0x7f04a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:19.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.869+0000 7f04b3fff640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04a8005180 0x7f04a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.869+0000 7f04b3fff640 1 -- 172.21.15.17:0/2051827787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a8003970 msgr2=0x7f04a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:19.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.869+0000 7f04b3fff640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a8003970 0x7f04a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.869+0000 7f04b3fff640 1 -- 172.21.15.17:0/2051827787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc15e7f0 con 0x7f04a80047c0 2023-08-09T12:47:19.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.869+0000 7f04bb7fe640 1 -- 172.21.15.17:0/2051827787 reap_dead start 2023-08-09T12:47:19.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.870+0000 7f04b3fff640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80047c0 0x7f04a8004c40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009ac0 tx=0x7f04a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a918bcd289ceecf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:19.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.870+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a402c6b0 con 0x7f04a80047c0 2023-08-09T12:47:19.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.870+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a402c810 con 0x7f04a80047c0 2023-08-09T12:47:19.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.870+0000 7f04ba7fc640 1 -- 172.21.15.17:0/2051827787 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a402cba0 con 0x7f04a80047c0 2023-08-09T12:47:19.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.871+0000 7f04c17e1640 1 -- 172.21.15.17:0/2051827787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80047c0 msgr2=0x7f04a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.871+0000 7f04c17e1640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80047c0 0x7f04a8004c40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009ac0 tx=0x7f04a80057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.871+0000 7f04c17e1640 1 -- 172.21.15.17:0/2051827787 shutdown_connections 2023-08-09T12:47:19.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.871+0000 7f04c17e1640 1 --2- 172.21.15.17:0/2051827787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80047c0 0x7f04a8004c40 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.871+0000 7f04c17e1640 1 -- 172.21.15.17:0/2051827787 >> 172.21.15.17:0/2051827787 conn(0x7f04bc069be0 msgr2=0x7f04bc069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:19.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.871+0000 7f04c17e1640 1 -- 172.21.15.17:0/2051827787 shutdown_connections 2023-08-09T12:47:19.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.871+0000 7f04c17e1640 1 -- 172.21.15.17:0/2051827787 wait complete. 2023-08-09T12:47:19.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.874+0000 7f04c17e1640 1 Processor -- start 2023-08-09T12:47:19.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.874+0000 7f04c17e1640 1 -- start start 2023-08-09T12:47:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.875+0000 7f04c17e1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80047c0 0x7f04bc152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.875+0000 7f04c17e1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04bc1545d0 0x7f04bc154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.875+0000 7f04c17e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04bc15a240 0x7f04bc15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.875+0000 7f04c17e1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc15ac00 con 0x7f04bc15a240 2023-08-09T12:47:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.875+0000 7f04c17e1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc152bd0 con 0x7f04a80047c0 2023-08-09T12:47:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.875+0000 7f04c17e1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc155090 con 0x7f04bc1545d0 2023-08-09T12:47:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04bc15a240 0x7f04bc15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04bc15a240 0x7f04bc15a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44978/0 (socket says 172.21.15.17:44978) 2023-08-09T12:47:19.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 -- 172.21.15.17:0/572891634 learned_addr learned my addr 172.21.15.17:0/572891634 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:19.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04baffd640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80047c0 0x7f04bc152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04b3fff640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04bc1545d0 0x7f04bc154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 -- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04bc1545d0 msgr2=0x7f04bc154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04bc1545d0 0x7f04bc154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 -- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80047c0 msgr2=0x7f04bc152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:19.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80047c0 0x7f04bc152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:19.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 -- 172.21.15.17:0/572891634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc155370 con 0x7f04bc15a240 2023-08-09T12:47:19.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.876+0000 7f04bb7fe640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04bc15a240 0x7f04bc15a6c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f04bc15b540 tx=0x7f04b400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:19.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.877+0000 7f04b37fe640 1 -- 172.21.15.17:0/572891634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400a610 con 0x7f04bc15a240 2023-08-09T12:47:19.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.877+0000 7f04b37fe640 1 -- 172.21.15.17:0/572891634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b400a770 con 0x7f04bc15a240 2023-08-09T12:47:19.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.877+0000 7f04b37fe640 1 -- 172.21.15.17:0/572891634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400ab20 con 0x7f04bc15a240 2023-08-09T12:47:19.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.877+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc155650 con 0x7f04bc15a240 2023-08-09T12:47:19.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.877+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc1f0240 con 0x7f04bc15a240 2023-08-09T12:47:19.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.878+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc1f0460 con 0x7f04bc15a240 2023-08-09T12:47:19.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.879+0000 7f04b37fe640 1 -- 172.21.15.17:0/572891634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f04b400ac80 con 0x7f04bc15a240 2023-08-09T12:47:19.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.880+0000 7f04b37fe640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f049c06a050 0x7f049c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:19.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.880+0000 7f04b37fe640 1 -- 172.21.15.17:0/572891634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f04b4087e30 con 0x7f04bc15a240 2023-08-09T12:47:19.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.881+0000 7f04baffd640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f049c06a050 0x7f049c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:19.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.882+0000 7f04baffd640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f049c06a050 0x7f049c06c510 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f04ac007fd0 tx=0x7f04ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:19.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:19.884+0000 7f04b37fe640 1 -- 172.21.15.17:0/572891634 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f04b40534f0 con 0x7f04bc15a240 2023-08-09T12:47:20.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.081+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04bc067a80 con 0x7f04bc15a240 2023-08-09T12:47:20.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.082+0000 7f04b37fe640 1 -- 172.21.15.17:0/572891634 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04b401a020 con 0x7f04bc15a240 2023-08-09T12:47:20.084 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:47:20.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f049c06a050 msgr2=0x7f049c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f049c06a050 0x7f049c06c510 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f04ac007fd0 tx=0x7f04ac009040 comp rx=0 tx=0).stop 2023-08-09T12:47:20.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04bc15a240 msgr2=0x7f04bc15a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04bc15a240 0x7f04bc15a6c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f04bc15b540 tx=0x7f04b400ce80 comp rx=0 tx=0).stop 2023-08-09T12:47:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 shutdown_connections 2023-08-09T12:47:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f049c06a050 0x7f049c06c510 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04bc15a240 0x7f04bc15a6c0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04bc1545d0 0x7f04bc154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 --2- 172.21.15.17:0/572891634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80047c0 0x7f04bc152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 >> 172.21.15.17:0/572891634 conn(0x7f04bc069be0 msgr2=0x7f04bc070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 shutdown_connections 2023-08-09T12:47:20.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.085+0000 7f04c17e1640 1 -- 172.21.15.17:0/572891634 wait complete. 2023-08-09T12:47:20.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:47:20.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.325+0000 7f78c4f86640 1 Processor -- start 2023-08-09T12:47:20.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.326+0000 7f78c4f86640 1 -- start start 2023-08-09T12:47:20.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.327+0000 7f78c4f86640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 0x7f78c00b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.327+0000 7f78c4f86640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78c00b13f0 0x7f78c015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.327+0000 7f78c4f86640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c015e7b0 con 0x7f78c015f180 2023-08-09T12:47:20.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.327+0000 7f78c4f86640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c00b1850 con 0x7f78c00b13f0 2023-08-09T12:47:20.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.327+0000 7f78c4f86640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c015e460 con 0x7f78c015a8c0 2023-08-09T12:47:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78b6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78c00b13f0 0x7f78c015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78b6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78c00b13f0 0x7f78c015ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44980/0 (socket says 172.21.15.17:44980) 2023-08-09T12:47:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78b6ffd640 1 -- 172.21.15.17:0/3770909805 learned_addr learned my addr 172.21.15.17:0/3770909805 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78bffff640 1 --1- 172.21.15.17:0/3770909805 >> v1:172.21.15.17:6789/0 conn(0x7f78c015f180 0x7f78c00b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58704/0 (socket says 172.21.15.17:58704) 2023-08-09T12:47:20.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78bf7fe640 1 --2- 172.21.15.17:0/3770909805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 0x7f78c00b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78b6ffd640 1 -- 172.21.15.17:0/3770909805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 msgr2=0x7f78c00b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:20.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78b6ffd640 1 --2- 172.21.15.17:0/3770909805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 0x7f78c00b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78b6ffd640 1 -- 172.21.15.17:0/3770909805 >> v1:172.21.15.17:6789/0 conn(0x7f78c015f180 legacy=0x7f78c00b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.328+0000 7f78b6ffd640 1 -- 172.21.15.17:0/3770909805 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c015aca0 con 0x7f78c00b13f0 2023-08-09T12:47:20.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.330+0000 7f78b6ffd640 1 --2- 172.21.15.17:0/3770909805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00b13f0 0x7f78c015ec40 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009870 tx=0x7f78a802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64b37c58f4ae75b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:20.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.330+0000 7f78beffd640 1 -- 172.21.15.17:0/3770909805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8030840 con 0x7f78c00b13f0 2023-08-09T12:47:20.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.330+0000 7f78beffd640 1 -- 172.21.15.17:0/3770909805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a80309a0 con 0x7f78c00b13f0 2023-08-09T12:47:20.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.330+0000 7f78beffd640 1 -- 172.21.15.17:0/3770909805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8030d30 con 0x7f78c00b13f0 2023-08-09T12:47:20.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.331+0000 7f78c4f86640 1 -- 172.21.15.17:0/3770909805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00b13f0 msgr2=0x7f78c015ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.331+0000 7f78c4f86640 1 --2- 172.21.15.17:0/3770909805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00b13f0 0x7f78c015ec40 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009870 tx=0x7f78a802b980 comp rx=0 tx=0).stop 2023-08-09T12:47:20.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.331+0000 7f78c4f86640 1 -- 172.21.15.17:0/3770909805 shutdown_connections 2023-08-09T12:47:20.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.331+0000 7f78c4f86640 1 --2- 172.21.15.17:0/3770909805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00b13f0 0x7f78c015ec40 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.331+0000 7f78c4f86640 1 --2- 172.21.15.17:0/3770909805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 0x7f78c00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.331+0000 7f78c4f86640 1 -- 172.21.15.17:0/3770909805 >> 172.21.15.17:0/3770909805 conn(0x7f78c00cb020 msgr2=0x7f78c00cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:20.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.331+0000 7f78c4f86640 1 -- 172.21.15.17:0/3770909805 shutdown_connections 2023-08-09T12:47:20.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.331+0000 7f78c4f86640 1 -- 172.21.15.17:0/3770909805 wait complete. 2023-08-09T12:47:20.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.333+0000 7f78c4f86640 1 Processor -- start 2023-08-09T12:47:20.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.333+0000 7f78c4f86640 1 -- start start 2023-08-09T12:47:20.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78c4f86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78c00b13f0 0x7f78c01544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78c4f86640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 0x7f78c00aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78c4f86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015f180 0x7f78c0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78c4f86640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00c20d0 con 0x7f78c015f180 2023-08-09T12:47:20.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78c4f86640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c015dbc0 con 0x7f78c00b13f0 2023-08-09T12:47:20.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78c4f86640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00c2320 con 0x7f78c015a8c0 2023-08-09T12:47:20.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015f180 0x7f78c0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015f180 0x7f78c0156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44994/0 (socket says 172.21.15.17:44994) 2023-08-09T12:47:20.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78bffff640 1 -- 172.21.15.17:0/2379779224 learned_addr learned my addr 172.21.15.17:0/2379779224 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:20.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78b6ffd640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 0x7f78c00aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.335+0000 7f78bf7fe640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78c00b13f0 0x7f78c01544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bffff640 1 -- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 msgr2=0x7f78c00aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bffff640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 0x7f78c00aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bffff640 1 -- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78c00b13f0 msgr2=0x7f78c01544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bffff640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78c00b13f0 0x7f78c01544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bffff640 1 -- 172.21.15.17:0/2379779224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80094d0 con 0x7f78c015f180 2023-08-09T12:47:20.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bffff640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015f180 0x7f78c0156ed0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c730 tx=0x7f78b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:20.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bcff9640 1 -- 172.21.15.17:0/2379779224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8004d60 con 0x7f78c015f180 2023-08-09T12:47:20.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bcff9640 1 -- 172.21.15.17:0/2379779224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800a640 con 0x7f78c015f180 2023-08-09T12:47:20.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c00c2600 con 0x7f78c015f180 2023-08-09T12:47:20.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78bcff9640 1 -- 172.21.15.17:0/2379779224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800a9d0 con 0x7f78c015f180 2023-08-09T12:47:20.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.336+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c00acfd0 con 0x7f78c015f180 2023-08-09T12:47:20.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.338+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c00c2b20 con 0x7f78c015f180 2023-08-09T12:47:20.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.339+0000 7f78bcff9640 1 -- 172.21.15.17:0/2379779224 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f78b800ad40 con 0x7f78c015f180 2023-08-09T12:47:20.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.339+0000 7f78bcff9640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a050 0x7f78a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.340+0000 7f78bcff9640 1 -- 172.21.15.17:0/2379779224 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f78b8087e90 con 0x7f78c015f180 2023-08-09T12:47:20.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.340+0000 7f78bf7fe640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a050 0x7f78a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.341+0000 7f78bf7fe640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a050 0x7f78a006c510 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f78b0006fd0 tx=0x7f78b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:20.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.344+0000 7f78bcff9640 1 -- 172.21.15.17:0/2379779224 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f78c00c2b20 con 0x7f78c015f180 2023-08-09T12:47:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.537+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78c00c2b20 con 0x7f78c015f180 2023-08-09T12:47:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.538+0000 7f78bcff9640 1 -- 172.21.15.17:0/2379779224 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78b8018020 con 0x7f78c015f180 2023-08-09T12:47:20.540 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:47:20.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a050 msgr2=0x7f78a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a050 0x7f78a006c510 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f78b0006fd0 tx=0x7f78b0008040 comp rx=0 tx=0).stop 2023-08-09T12:47:20.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015f180 msgr2=0x7f78c0156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015f180 0x7f78c0156ed0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c730 tx=0x7f78b800cbf0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 shutdown_connections 2023-08-09T12:47:20.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a050 0x7f78a006c510 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015f180 0x7f78c0156ed0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c015a8c0 0x7f78c00aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 --2- 172.21.15.17:0/2379779224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78c00b13f0 0x7f78c01544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.540+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 >> 172.21.15.17:0/2379779224 conn(0x7f78c00cb020 msgr2=0x7f78c00cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:20.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.541+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 shutdown_connections 2023-08-09T12:47:20.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.541+0000 7f78c4f86640 1 -- 172.21.15.17:0/2379779224 wait complete. 2023-08-09T12:47:20.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:20.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.781+0000 7fc971ba2640 1 Processor -- start 2023-08-09T12:47:20.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.781+0000 7fc971ba2640 1 -- start start 2023-08-09T12:47:20.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.783+0000 7fc971ba2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc96c070f00 0x7fc96c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.783+0000 7fc971ba2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c071340 con 0x7fc96c15bce0 2023-08-09T12:47:20.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.783+0000 7fc971ba2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c0715c0 con 0x7fc96c1587e0 2023-08-09T12:47:20.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc971ba2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0718a0 con 0x7fc96c070f00 2023-08-09T12:47:20.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc96bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc96c070f00 0x7fc96c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc96bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc96c070f00 0x7fc96c15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44998/0 (socket says 172.21.15.17:44998) 2023-08-09T12:47:20.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc96bfff640 1 -- 172.21.15.17:0/3259665204 learned_addr learned my addr 172.21.15.17:0/3259665204 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:20.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc9713a1640 1 --1- 172.21.15.17:0/3259665204 >> v1:172.21.15.17:6789/0 conn(0x7fc96c15bce0 0x7fc96c0cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58720/0 (socket says 172.21.15.17:58720) 2023-08-09T12:47:20.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc96bfff640 1 -- 172.21.15.17:0/3259665204 >> v1:172.21.15.142:6789/0 conn(0x7fc96c1587e0 legacy=0x7fc96c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc96bfff640 1 -- 172.21.15.17:0/3259665204 >> v1:172.21.15.17:6789/0 conn(0x7fc96c15bce0 legacy=0x7fc96c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc96bfff640 1 -- 172.21.15.17:0/3259665204 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c071b80 con 0x7fc96c070f00 2023-08-09T12:47:20.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.784+0000 7fc96b7fe640 1 -- 172.21.15.17:0/3259665204 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181287830 0 0) 0x7fc96c071340 con 0x7fc96c15bce0 2023-08-09T12:47:20.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.786+0000 7fc96bfff640 1 --2- 172.21.15.17:0/3259665204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c070f00 0x7fc96c15b7a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc958009870 tx=0x7fc95802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b100708a63c116d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:20.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.786+0000 7fc96b7fe640 1 -- 172.21.15.17:0/3259665204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95802f850 con 0x7fc96c070f00 2023-08-09T12:47:20.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.786+0000 7fc96b7fe640 1 -- 172.21.15.17:0/3259665204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95802f9b0 con 0x7fc96c070f00 2023-08-09T12:47:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.786+0000 7fc96b7fe640 1 -- 172.21.15.17:0/3259665204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95802fd40 con 0x7fc96c070f00 2023-08-09T12:47:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.787+0000 7fc971ba2640 1 -- 172.21.15.17:0/3259665204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c070f00 msgr2=0x7fc96c15b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.787+0000 7fc971ba2640 1 --2- 172.21.15.17:0/3259665204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c070f00 0x7fc96c15b7a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc958009870 tx=0x7fc95802ba30 comp rx=0 tx=0).stop 2023-08-09T12:47:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.787+0000 7fc971ba2640 1 -- 172.21.15.17:0/3259665204 shutdown_connections 2023-08-09T12:47:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.787+0000 7fc971ba2640 1 --2- 172.21.15.17:0/3259665204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c070f00 0x7fc96c15b7a0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.787+0000 7fc971ba2640 1 -- 172.21.15.17:0/3259665204 >> 172.21.15.17:0/3259665204 conn(0x7fc96c0b1d50 msgr2=0x7fc96c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.787+0000 7fc971ba2640 1 -- 172.21.15.17:0/3259665204 shutdown_connections 2023-08-09T12:47:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.787+0000 7fc971ba2640 1 -- 172.21.15.17:0/3259665204 wait complete. 2023-08-09T12:47:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.789+0000 7fc971ba2640 1 Processor -- start 2023-08-09T12:47:20.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.789+0000 7fc971ba2640 1 -- start start 2023-08-09T12:47:20.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc971ba2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c070f00 0x7fc96c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc971ba2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c1587e0 0x7fc96c1effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc971ba2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c1f4240 0x7fc96c1f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc971ba2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c1f0900 con 0x7fc96c1f4240 2023-08-09T12:47:20.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc971ba2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c1f0be0 con 0x7fc96c070f00 2023-08-09T12:47:20.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc971ba2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c1f0ec0 con 0x7fc96c1587e0 2023-08-09T12:47:20.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc9713a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c1f4240 0x7fc96c1f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc9713a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c1f4240 0x7fc96c1f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45008/0 (socket says 172.21.15.17:45008) 2023-08-09T12:47:20.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc9713a1640 1 -- 172.21.15.17:0/494883673 learned_addr learned my addr 172.21.15.17:0/494883673 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:20.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc970ba0640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c070f00 0x7fc96c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.790+0000 7fc96bfff640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c1587e0 0x7fc96c1effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9713a1640 1 -- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c1587e0 msgr2=0x7fc96c1effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9713a1640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c1587e0 0x7fc96c1effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9713a1640 1 -- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c070f00 msgr2=0x7fc96c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:20.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9713a1640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c070f00 0x7fc96c0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:20.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9713a1640 1 -- 172.21.15.17:0/494883673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580094d0 con 0x7fc96c1f4240 2023-08-09T12:47:20.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9713a1640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c1f4240 0x7fc96c1f3550 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc96400c780 tx=0x7fc96400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:20.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9697fa640 1 -- 172.21.15.17:0/494883673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400ce90 con 0x7fc96c1f4240 2023-08-09T12:47:20.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9697fa640 1 -- 172.21.15.17:0/494883673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400a640 con 0x7fc96c1f4240 2023-08-09T12:47:20.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc9697fa640 1 -- 172.21.15.17:0/494883673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400a9d0 con 0x7fc96c1f4240 2023-08-09T12:47:20.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.791+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c15e070 con 0x7fc96c1f4240 2023-08-09T12:47:20.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.792+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c1f0510 con 0x7fc96c1f4240 2023-08-09T12:47:20.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.793+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c15ded0 con 0x7fc96c1f4240 2023-08-09T12:47:20.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.794+0000 7fc9697fa640 1 -- 172.21.15.17:0/494883673 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc96400ab30 con 0x7fc96c1f4240 2023-08-09T12:47:20.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.794+0000 7fc9697fa640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc95006a080 0x7fc95006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:20.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.795+0000 7fc9697fa640 1 -- 172.21.15.17:0/494883673 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fc964087930 con 0x7fc96c1f4240 2023-08-09T12:47:20.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.795+0000 7fc970ba0640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc95006a080 0x7fc95006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:20.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.796+0000 7fc970ba0640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc95006a080 0x7fc95006c540 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc960000f60 tx=0x7fc960009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:20.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:20.799+0000 7fc9697fa640 1 -- 172.21.15.17:0/494883673 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc96c15ded0 con 0x7fc96c1f4240 2023-08-09T12:47:21.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.028+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc96c15ded0 con 0x7fc96c1f4240 2023-08-09T12:47:21.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.029+0000 7fc9697fa640 1 -- 172.21.15.17:0/494883673 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4880 (secure 0 0 0) 0x7fc96c15ded0 con 0x7fc96c1f4240 2023-08-09T12:47:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:21.032 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:46:54.580315+0000","modified":"2023-08-09T12:46:58.167844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1719182807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1719182807},{"type":"v1","addr":"172.21.15.17:6835","nonce":1719182807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-09T12:47:21.033 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 59 2023-08-09T12:47:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc95006a080 msgr2=0x7fc95006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc95006a080 0x7fc95006c540 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc960000f60 tx=0x7fc960009040 comp rx=0 tx=0).stop 2023-08-09T12:47:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c1f4240 msgr2=0x7fc96c1f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c1f4240 0x7fc96c1f3550 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc96400c780 tx=0x7fc96400cc40 comp rx=0 tx=0).stop 2023-08-09T12:47:21.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 shutdown_connections 2023-08-09T12:47:21.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc95006a080 0x7fc95006c540 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc96c1f4240 0x7fc96c1f3550 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c1587e0 0x7fc96c1effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 --2- 172.21.15.17:0/494883673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c070f00 0x7fc96c0c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 >> 172.21.15.17:0/494883673 conn(0x7fc96c0b1d50 msgr2=0x7fc96c0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 shutdown_connections 2023-08-09T12:47:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.032+0000 7fc971ba2640 1 -- 172.21.15.17:0/494883673 wait complete. 2023-08-09T12:47:21.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:21.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.281+0000 7f3b68970640 1 Processor -- start 2023-08-09T12:47:21.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.281+0000 7f3b68970640 1 -- start start 2023-08-09T12:47:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b68970640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3b640af9b0 0x7f3b640cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b68970640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b640b2300 0x7f3b640b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b68970640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6406b9d0 con 0x7f3b6415aa00 2023-08-09T12:47:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b68970640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b640b2cd0 con 0x7f3b640af9b0 2023-08-09T12:47:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b68970640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6406bcb0 con 0x7f3b640b2300 2023-08-09T12:47:21.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b637fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3b6415aa00 0x7f3b6406c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58726/0 (socket says 172.21.15.17:58726) 2023-08-09T12:47:21.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b637fe640 1 -- 172.21.15.17:0/3451152562 learned_addr learned my addr 172.21.15.17:0/3451152562 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:21.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b5affd640 1 --2- 172.21.15.17:0/3451152562 >> v2:172.21.15.17:3300/0 conn(0x7f3b640af9b0 0x7f3b640cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.283+0000 7f3b63fff640 1 --2- 172.21.15.17:0/3451152562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b640b2300 0x7f3b640b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.284+0000 7f3b62ffd640 1 -- 172.21.15.17:0/3451152562 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491216579 0 0) 0x7f3b6406b9d0 con 0x7f3b6415aa00 2023-08-09T12:47:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.284+0000 7f3b62ffd640 1 -- 172.21.15.17:0/3451152562 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b50003520 con 0x7f3b6415aa00 2023-08-09T12:47:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.284+0000 7f3b5affd640 1 -- 172.21.15.17:0/3451152562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b640b2300 msgr2=0x7f3b640b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.284+0000 7f3b5affd640 1 --2- 172.21.15.17:0/3451152562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b640b2300 0x7f3b640b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.284+0000 7f3b5affd640 1 -- 172.21.15.17:0/3451152562 >> v1:172.21.15.17:6789/0 conn(0x7f3b6415aa00 legacy=0x7f3b6406c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.284+0000 7f3b5affd640 1 -- 172.21.15.17:0/3451152562 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6406c850 con 0x7f3b640af9b0 2023-08-09T12:47:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.284+0000 7f3b63fff640 1 --2- 172.21.15.17:0/3451152562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b640b2300 0x7f3b640b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.285+0000 7f3b5affd640 1 --2- 172.21.15.17:0/3451152562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640af9b0 0x7f3b640cc260 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097a0 tx=0x7f3b4c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175cedc24e879b57 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.285+0000 7f3b62ffd640 1 -- 172.21.15.17:0/3451152562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c02d040 con 0x7f3b640af9b0 2023-08-09T12:47:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.285+0000 7f3b62ffd640 1 -- 172.21.15.17:0/3451152562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c031810 con 0x7f3b640af9b0 2023-08-09T12:47:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.285+0000 7f3b62ffd640 1 -- 172.21.15.17:0/3451152562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c031b80 con 0x7f3b640af9b0 2023-08-09T12:47:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.286+0000 7f3b68970640 1 -- 172.21.15.17:0/3451152562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640af9b0 msgr2=0x7f3b640cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.286+0000 7f3b68970640 1 --2- 172.21.15.17:0/3451152562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640af9b0 0x7f3b640cc260 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097a0 tx=0x7f3b4c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.286+0000 7f3b68970640 1 -- 172.21.15.17:0/3451152562 shutdown_connections 2023-08-09T12:47:21.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.286+0000 7f3b68970640 1 --2- 172.21.15.17:0/3451152562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b640b2300 0x7f3b640b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.286+0000 7f3b68970640 1 --2- 172.21.15.17:0/3451152562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640af9b0 0x7f3b640cc260 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.286+0000 7f3b68970640 1 -- 172.21.15.17:0/3451152562 >> 172.21.15.17:0/3451152562 conn(0x7f3b640cd300 msgr2=0x7f3b640cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:21.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.286+0000 7f3b68970640 1 -- 172.21.15.17:0/3451152562 shutdown_connections 2023-08-09T12:47:21.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.286+0000 7f3b68970640 1 -- 172.21.15.17:0/3451152562 wait complete. 2023-08-09T12:47:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.288+0000 7f3b68970640 1 Processor -- start 2023-08-09T12:47:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.288+0000 7f3b68970640 1 -- start start 2023-08-09T12:47:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b68970640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b640af9b0 0x7f3b640c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b68970640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640b2300 0x7f3b64159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b68970640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b6415aa00 0x7f3b641e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b68970640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641598c0 con 0x7f3b640b2300 2023-08-09T12:47:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b68970640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641e4830 con 0x7f3b640af9b0 2023-08-09T12:47:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b68970640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641e4b00 con 0x7f3b6415aa00 2023-08-09T12:47:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b5affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640b2300 0x7f3b64159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b5affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640b2300 0x7f3b64159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45034/0 (socket says 172.21.15.17:45034) 2023-08-09T12:47:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.289+0000 7f3b5affd640 1 -- 172.21.15.17:0/2143556261 learned_addr learned my addr 172.21.15.17:0/2143556261 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b5affd640 1 -- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b6415aa00 msgr2=0x7f3b641e42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b5affd640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b6415aa00 0x7f3b641e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b5affd640 1 -- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b640af9b0 msgr2=0x7f3b640c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b5affd640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b640af9b0 0x7f3b640c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b5affd640 1 -- 172.21.15.17:0/2143556261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c009400 con 0x7f3b640b2300 2023-08-09T12:47:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b5affd640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640b2300 0x7f3b64159380 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c000c00 tx=0x7f3b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b60ff9640 1 -- 172.21.15.17:0/2143556261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c006e10 con 0x7f3b640b2300 2023-08-09T12:47:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b60ff9640 1 -- 172.21.15.17:0/2143556261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c03ad60 con 0x7f3b640b2300 2023-08-09T12:47:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b60ff9640 1 -- 172.21.15.17:0/2143556261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c044620 con 0x7f3b640b2300 2023-08-09T12:47:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.290+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b641e4de0 con 0x7f3b640b2300 2023-08-09T12:47:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.291+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b641e53a0 con 0x7f3b640b2300 2023-08-09T12:47:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.292+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6404e390 con 0x7f3b640b2300 2023-08-09T12:47:21.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.292+0000 7f3b60ff9640 1 -- 172.21.15.17:0/2143556261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b4c04d440 con 0x7f3b640b2300 2023-08-09T12:47:21.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.293+0000 7f3b60ff9640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b4406a050 0x7f3b4406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.293+0000 7f3b60ff9640 1 -- 172.21.15.17:0/2143556261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f3b4c0aa880 con 0x7f3b640b2300 2023-08-09T12:47:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.294+0000 7f3b637fe640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b4406a050 0x7f3b4406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.295+0000 7f3b637fe640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b4406a050 0x7f3b4406c510 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3b540012e0 tx=0x7f3b540015b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:21.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.298+0000 7f3b60ff9640 1 -- 172.21.15.17:0/2143556261 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3b4c075f40 con 0x7f3b640b2300 2023-08-09T12:47:21.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.500+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b640735b0 con 0x7f3b640b2300 2023-08-09T12:47:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.502+0000 7f3b60ff9640 1 -- 172.21.15.17:0/2143556261 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+18328 (secure 0 0 0) 0x7f3b4c079560 con 0x7f3b640b2300 2023-08-09T12:47:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:21.504 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":135,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:12.937583+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.35","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.504+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b4406a050 msgr2=0x7f3b4406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.504+0000 7f3b68970640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b4406a050 0x7f3b4406c510 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3b540012e0 tx=0x7f3b540015b0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.504+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640b2300 msgr2=0x7f3b64159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.504+0000 7f3b68970640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640b2300 0x7f3b64159380 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c000c00 tx=0x7f3b4c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.505+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 shutdown_connections 2023-08-09T12:47:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.505+0000 7f3b68970640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3b4406a050 0x7f3b4406c510 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.505+0000 7f3b68970640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b6415aa00 0x7f3b641e42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.505+0000 7f3b68970640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b640b2300 0x7f3b64159380 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.505+0000 7f3b68970640 1 --2- 172.21.15.17:0/2143556261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b640af9b0 0x7f3b640c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.505+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 >> 172.21.15.17:0/2143556261 conn(0x7f3b640cd300 msgr2=0x7f3b640b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.505+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 shutdown_connections 2023-08-09T12:47:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.505+0000 7f3b68970640 1 -- 172.21.15.17:0/2143556261 wait complete. 2023-08-09T12:47:21.525 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:47:21.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:21.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.748+0000 7f89fffff640 1 Processor -- start 2023-08-09T12:47:21.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.748+0000 7f89fffff640 1 -- start start 2023-08-09T12:47:21.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.750+0000 7f89fffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a001587e0 0x7f8a00070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.750+0000 7f89fffff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0015beb0 con 0x7f8a000b0b10 2023-08-09T12:47:21.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.750+0000 7f89fffff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a000715c0 con 0x7f8a000cb070 2023-08-09T12:47:21.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.750+0000 7f89fffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a000718a0 con 0x7f8a001587e0 2023-08-09T12:47:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.751+0000 7f89f7fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8a000b0b10 0x7f8a0015b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58736/0 (socket says 172.21.15.17:58736) 2023-08-09T12:47:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.751+0000 7f89f7fff640 1 -- 172.21.15.17:0/1209219061 learned_addr learned my addr 172.21.15.17:0/1209219061 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.751+0000 7f89feffd640 1 --2- 172.21.15.17:0/1209219061 >> v2:172.21.15.142:3300/0 conn(0x7f8a001587e0 0x7f8a00070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.751+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437264454 0 0) 0x7f8a0015beb0 con 0x7f8a000b0b10 2023-08-09T12:47:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.751+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89ec003520 con 0x7f8a000b0b10 2023-08-09T12:47:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805979845 0 0) 0x7f89ec003520 con 0x7f8a000b0b10 2023-08-09T12:47:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 >> v2:172.21.15.142:3300/0 conn(0x7f8a001587e0 msgr2=0x7f8a00070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 --2- 172.21.15.17:0/1209219061 >> v2:172.21.15.142:3300/0 conn(0x7f8a001587e0 0x7f8a00070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 >> v1:172.21.15.142:6789/0 conn(0x7f8a000cb070 legacy=0x7f8a0015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00071b80 con 0x7f8a000b0b10 2023-08-09T12:47:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f89e8001670 con 0x7f8a000b0b10 2023-08-09T12:47:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 >> v1:172.21.15.17:6789/0 conn(0x7f8a000b0b10 legacy=0x7f8a0015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89ec003970 0x7f89ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec0047c0 0x7f89ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89ec005180 0x7f89ec00fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a000718a0 con 0x7f89ec003970 2023-08-09T12:47:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec010430 con 0x7f89ec0047c0 2023-08-09T12:47:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0105f0 con 0x7f89ec005180 2023-08-09T12:47:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89feffd640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89ec003970 0x7f89ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.752+0000 7f89ff7fe640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89ec005180 0x7f89ec00fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.753+0000 7f89f7fff640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec0047c0 0x7f89ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.753+0000 7f89feffd640 1 -- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89ec005180 msgr2=0x7f89ec00fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.753+0000 7f89feffd640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89ec005180 0x7f89ec00fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.753+0000 7f89feffd640 1 -- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec0047c0 msgr2=0x7f89ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.753+0000 7f89feffd640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec0047c0 0x7f89ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.753+0000 7f89feffd640 1 -- 172.21.15.17:0/1209219061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec003520 con 0x7f89ec003970 2023-08-09T12:47:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.753+0000 7f89ff7fe640 1 -- 172.21.15.17:0/1209219061 reap_dead start 2023-08-09T12:47:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.753+0000 7f89f7fff640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec0047c0 0x7f89ec004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.754+0000 7f89feffd640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89ec003970 0x7f89ec003d90 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009ac0 tx=0x7f89ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb99972872ec15f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f002c6d0 con 0x7f89ec003970 2023-08-09T12:47:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f002c830 con 0x7f89ec003970 2023-08-09T12:47:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fe7fc640 1 -- 172.21.15.17:0/1209219061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f002cbc0 con 0x7f89ec003970 2023-08-09T12:47:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fffff640 1 -- 172.21.15.17:0/1209219061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89ec003970 msgr2=0x7f89ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fffff640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89ec003970 0x7f89ec003d90 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009ac0 tx=0x7f89ec0057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fffff640 1 -- 172.21.15.17:0/1209219061 shutdown_connections 2023-08-09T12:47:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fffff640 1 --2- 172.21.15.17:0/1209219061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89ec003970 0x7f89ec003d90 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fffff640 1 -- 172.21.15.17:0/1209219061 >> 172.21.15.17:0/1209219061 conn(0x7f8a000b1d50 msgr2=0x7f8a0006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.755+0000 7f89fffff640 1 -- 172.21.15.17:0/1209219061 shutdown_connections 2023-08-09T12:47:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.756+0000 7f89fffff640 1 -- 172.21.15.17:0/1209219061 wait complete. 2023-08-09T12:47:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.757+0000 7f89fffff640 1 Processor -- start 2023-08-09T12:47:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.757+0000 7f89fffff640 1 -- start start 2023-08-09T12:47:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.758+0000 7f89fffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec003970 0x7f8a000c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.758+0000 7f89fffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a001edc00 0x7f8a001502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.758+0000 7f89fffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a000c6240 0x7f8a000c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.758+0000 7f89fffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a000c6c00 con 0x7f8a000c6240 2023-08-09T12:47:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.758+0000 7f89fffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00151100 con 0x7f89ec003970 2023-08-09T12:47:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.758+0000 7f89fffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00150b40 con 0x7f8a001edc00 2023-08-09T12:47:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a000c6240 0x7f8a000c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a000c6240 0x7f8a000c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45062/0 (socket says 172.21.15.17:45062) 2023-08-09T12:47:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 -- 172.21.15.17:0/4084606860 learned_addr learned my addr 172.21.15.17:0/4084606860 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89feffd640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec003970 0x7f8a000c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 -- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a001edc00 msgr2=0x7f8a001502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a001edc00 0x7f8a001502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 -- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec003970 msgr2=0x7f8a000c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec003970 0x7f8a000c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 -- 172.21.15.17:0/4084606860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00150e20 con 0x7f8a000c6240 2023-08-09T12:47:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.759+0000 7f89ff7fe640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a000c6240 0x7f8a000c66c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f89f8007fd0 tx=0x7f89f800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.760+0000 7f89f77fe640 1 -- 172.21.15.17:0/4084606860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8003970 con 0x7f8a000c6240 2023-08-09T12:47:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.760+0000 7f89f77fe640 1 -- 172.21.15.17:0/4084606860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8003af0 con 0x7f8a000c6240 2023-08-09T12:47:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.760+0000 7f89f77fe640 1 -- 172.21.15.17:0/4084606860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8003ea0 con 0x7f8a000c6240 2023-08-09T12:47:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.760+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a00158d10 con 0x7f8a000c6240 2023-08-09T12:47:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.760+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a001ee080 con 0x7f8a000c6240 2023-08-09T12:47:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.761+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0004e390 con 0x7f8a000c6240 2023-08-09T12:47:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.762+0000 7f89f77fe640 1 -- 172.21.15.17:0/4084606860 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89f80050d0 con 0x7f8a000c6240 2023-08-09T12:47:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.763+0000 7f89f77fe640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f89e006a080 0x7f89e006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.763+0000 7f89f77fe640 1 -- 172.21.15.17:0/4084606860 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f89f8088300 con 0x7f8a000c6240 2023-08-09T12:47:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.764+0000 7f89feffd640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f89e006a080 0x7f89e006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.765+0000 7f89feffd640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f89e006a080 0x7f89e006c540 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f89f0036000 tx=0x7f89f0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.768+0000 7f89f77fe640 1 -- 172.21.15.17:0/4084606860 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f89f80539c0 con 0x7f8a000c6240 2023-08-09T12:47:21.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.996+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a0006b8d0 con 0x7f8a000c6240 2023-08-09T12:47:21.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:21.997+0000 7f89f77fe640 1 -- 172.21.15.17:0/4084606860 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f89f8056fe0 con 0x7f8a000c6240 2023-08-09T12:47:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:22.000 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:46:54.580315+0000","modified":"2023-08-09T12:46:58.167844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1719182807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1719182807},{"type":"v1","addr":"172.21.15.17:6835","nonce":1719182807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-09T12:47:22.001 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 59 2023-08-09T12:47:22.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f89e006a080 msgr2=0x7f89e006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f89e006a080 0x7f89e006c540 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f89f0036000 tx=0x7f89f0030000 comp rx=0 tx=0).stop 2023-08-09T12:47:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a000c6240 msgr2=0x7f8a000c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a000c6240 0x7f8a000c66c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f89f8007fd0 tx=0x7f89f800ec10 comp rx=0 tx=0).stop 2023-08-09T12:47:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 shutdown_connections 2023-08-09T12:47:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f89e006a080 0x7f89e006c540 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a000c6240 0x7f8a000c66c0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a001edc00 0x7f8a001502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 --2- 172.21.15.17:0/4084606860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89ec003970 0x7f8a000c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 >> 172.21.15.17:0/4084606860 conn(0x7f8a000b1d50 msgr2=0x7f8a0006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 shutdown_connections 2023-08-09T12:47:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.000+0000 7f89fffff640 1 -- 172.21.15.17:0/4084606860 wait complete. 2023-08-09T12:47:22.025 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.250+0000 7ff5888e0640 1 Processor -- start 2023-08-09T12:47:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.250+0000 7ff5888e0640 1 -- start start 2023-08-09T12:47:22.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.251+0000 7ff5888e0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff5840b86e0 0x7ff5840cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.251+0000 7ff5888e0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5840b5a30 con 0x7ff584160030 2023-08-09T12:47:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.251+0000 7ff5888e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5840cfdd0 con 0x7ff5840cf980 2023-08-09T12:47:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.251+0000 7ff5888e0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5840d1110 con 0x7ff5840b86e0 2023-08-09T12:47:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.251+0000 7ff5837fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff584160030 0x7ff584160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58744/0 (socket says 172.21.15.17:58744) 2023-08-09T12:47:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.251+0000 7ff5837fe640 1 -- 172.21.15.17:0/3636208890 learned_addr learned my addr 172.21.15.17:0/3636208890 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.251+0000 7ff57bfff640 1 --2- 172.21.15.17:0/3636208890 >> v2:172.21.15.17:3300/0 conn(0x7ff5840b86e0 0x7ff5840cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.252+0000 7ff582ffd640 1 -- 172.21.15.17:0/3636208890 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070067287 0 0) 0x7ff5840b5a30 con 0x7ff584160030 2023-08-09T12:47:22.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.252+0000 7ff582ffd640 1 -- 172.21.15.17:0/3636208890 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff570003520 con 0x7ff584160030 2023-08-09T12:47:22.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.252+0000 7ff57bfff640 1 -- 172.21.15.17:0/3636208890 >> v1:172.21.15.142:6789/0 conn(0x7ff5840cf980 legacy=0x7ff5840d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:22.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.252+0000 7ff57bfff640 1 -- 172.21.15.17:0/3636208890 >> v1:172.21.15.17:6789/0 conn(0x7ff584160030 legacy=0x7ff584160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.252+0000 7ff57bfff640 1 -- 172.21.15.17:0/3636208890 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5840d0d70 con 0x7ff5840b86e0 2023-08-09T12:47:22.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.253+0000 7ff57bfff640 1 --2- 172.21.15.17:0/3636208890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b86e0 0x7ff5840cf440 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0097a0 tx=0x7ff56c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c12a8cec9c82e4a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:22.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff582ffd640 1 -- 172.21.15.17:0/3636208890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c031830 con 0x7ff5840b86e0 2023-08-09T12:47:22.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff582ffd640 1 -- 172.21.15.17:0/3636208890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c031990 con 0x7ff5840b86e0 2023-08-09T12:47:22.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff582ffd640 1 -- 172.21.15.17:0/3636208890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c031d00 con 0x7ff5840b86e0 2023-08-09T12:47:22.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff5888e0640 1 -- 172.21.15.17:0/3636208890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b86e0 msgr2=0x7ff5840cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff5888e0640 1 --2- 172.21.15.17:0/3636208890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b86e0 0x7ff5840cf440 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0097a0 tx=0x7ff56c02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff5888e0640 1 -- 172.21.15.17:0/3636208890 shutdown_connections 2023-08-09T12:47:22.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff5888e0640 1 --2- 172.21.15.17:0/3636208890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5840b86e0 0x7ff5840cf440 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff5888e0640 1 -- 172.21.15.17:0/3636208890 >> 172.21.15.17:0/3636208890 conn(0x7ff5840697c0 msgr2=0x7ff584069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:22.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff5888e0640 1 -- 172.21.15.17:0/3636208890 shutdown_connections 2023-08-09T12:47:22.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.254+0000 7ff5888e0640 1 -- 172.21.15.17:0/3636208890 wait complete. 2023-08-09T12:47:22.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.256+0000 7ff5888e0640 1 Processor -- start 2023-08-09T12:47:22.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.256+0000 7ff5888e0640 1 -- start start 2023-08-09T12:47:22.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.257+0000 7ff5888e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840b86e0 0x7ff5840caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.257+0000 7ff5888e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cf980 0x7ff5841487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.257+0000 7ff5888e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584160030 0x7ff5840b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.257+0000 7ff5888e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff584148d30 con 0x7ff584160030 2023-08-09T12:47:22.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.257+0000 7ff5888e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5840b4710 con 0x7ff5840b86e0 2023-08-09T12:47:22.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.257+0000 7ff5888e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5840b3820 con 0x7ff5840cf980 2023-08-09T12:47:22.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.257+0000 7ff583fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584160030 0x7ff5840b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff583fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584160030 0x7ff5840b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45072/0 (socket says 172.21.15.17:45072) 2023-08-09T12:47:22.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff583fff640 1 -- 172.21.15.17:0/1781617444 learned_addr learned my addr 172.21.15.17:0/1781617444 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:22.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff57bfff640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cf980 0x7ff5841487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff5837fe640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840b86e0 0x7ff5840caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff583fff640 1 -- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cf980 msgr2=0x7ff5841487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff583fff640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cf980 0x7ff5841487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff583fff640 1 -- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840b86e0 msgr2=0x7ff5840caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff583fff640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840b86e0 0x7ff5840caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff583fff640 1 -- 172.21.15.17:0/1781617444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c009400 con 0x7ff584160030 2023-08-09T12:47:22.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff5837fe640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840b86e0 0x7ff5840caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:22.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff57bfff640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cf980 0x7ff5841487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:22.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.258+0000 7ff583fff640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584160030 0x7ff5840b4ba0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c780 tx=0x7ff57c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:22.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.259+0000 7ff580ff9640 1 -- 172.21.15.17:0/1781617444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c003d80 con 0x7ff584160030 2023-08-09T12:47:22.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.259+0000 7ff580ff9640 1 -- 172.21.15.17:0/1781617444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c00ce90 con 0x7ff584160030 2023-08-09T12:47:22.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.259+0000 7ff580ff9640 1 -- 172.21.15.17:0/1781617444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0052b0 con 0x7ff584160030 2023-08-09T12:47:22.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.259+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5840b3b00 con 0x7ff584160030 2023-08-09T12:47:22.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.259+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5840b40c0 con 0x7ff584160030 2023-08-09T12:47:22.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.260+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5840ce330 con 0x7ff584160030 2023-08-09T12:47:22.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.261+0000 7ff580ff9640 1 -- 172.21.15.17:0/1781617444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff57c005410 con 0x7ff584160030 2023-08-09T12:47:22.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.262+0000 7ff580ff9640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56406a050 0x7ff56406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.263+0000 7ff580ff9640 1 -- 172.21.15.17:0/1781617444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7ff57c087b60 con 0x7ff584160030 2023-08-09T12:47:22.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.263+0000 7ff5837fe640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56406a050 0x7ff56406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.264+0000 7ff5837fe640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56406a050 0x7ff56406c510 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff574005880 tx=0x7ff574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:22.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.267+0000 7ff580ff9640 1 -- 172.21.15.17:0/1781617444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff57c053190 con 0x7ff584160030 2023-08-09T12:47:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.499+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff58404e390 con 0x7ff584160030 2023-08-09T12:47:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.501+0000 7ff580ff9640 1 -- 172.21.15.17:0/1781617444 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4880 (secure 0 0 0) 0x7ff57c017090 con 0x7ff584160030 2023-08-09T12:47:22.504 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:22.505 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:46:54.580315+0000","modified":"2023-08-09T12:46:58.167844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1719182807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1719182807},{"type":"v1","addr":"172.21.15.17:6835","nonce":1719182807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-09T12:47:22.505 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 59 2023-08-09T12:47:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.503+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56406a050 msgr2=0x7ff56406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.503+0000 7ff5888e0640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56406a050 0x7ff56406c510 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff574005880 tx=0x7ff574009040 comp rx=0 tx=0).stop 2023-08-09T12:47:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.503+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584160030 msgr2=0x7ff5840b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.503+0000 7ff5888e0640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584160030 0x7ff5840b4ba0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c780 tx=0x7ff57c00cc40 comp rx=0 tx=0).stop 2023-08-09T12:47:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.504+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 shutdown_connections 2023-08-09T12:47:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.504+0000 7ff5888e0640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff56406a050 0x7ff56406c510 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.504+0000 7ff5888e0640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584160030 0x7ff5840b4ba0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.504+0000 7ff5888e0640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5840cf980 0x7ff5841487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.504+0000 7ff5888e0640 1 --2- 172.21.15.17:0/1781617444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5840b86e0 0x7ff5840caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.504+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 >> 172.21.15.17:0/1781617444 conn(0x7ff5840697c0 msgr2=0x7ff5840c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.504+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 shutdown_connections 2023-08-09T12:47:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.504+0000 7ff5888e0640 1 -- 172.21.15.17:0/1781617444 wait complete. 2023-08-09T12:47:22.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.750+0000 7fcd896ed640 1 Processor -- start 2023-08-09T12:47:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.751+0000 7fcd896ed640 1 -- start start 2023-08-09T12:47:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd896ed640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd84160030 0x7fcd84160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd896ed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd840b86e0 0x7fcd840cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd896ed640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd840cf980 0x7fcd840b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd896ed640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd840d1110 con 0x7fcd84160030 2023-08-09T12:47:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd896ed640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd840ceac0 con 0x7fcd840cf980 2023-08-09T12:47:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd896ed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840cfe10 con 0x7fcd840b86e0 2023-08-09T12:47:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd83fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd84160030 0x7fcd84160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd83fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd84160030 0x7fcd84160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45076/0 (socket says 172.21.15.17:45076) 2023-08-09T12:47:22.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.752+0000 7fcd83fff640 1 -- 172.21.15.17:0/3303213652 learned_addr learned my addr 172.21.15.17:0/3303213652 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.753+0000 7fcd837fe640 1 --2- 172.21.15.17:0/3303213652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd840b86e0 0x7fcd840cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.753+0000 7fcd88eec640 1 --2- 172.21.15.17:0/3303213652 >> v2:172.21.15.142:3300/0 conn(0x7fcd840cf980 0x7fcd840b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.753+0000 7fcd83fff640 1 -- 172.21.15.17:0/3303213652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd840b86e0 msgr2=0x7fcd840cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.753+0000 7fcd83fff640 1 --2- 172.21.15.17:0/3303213652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd840b86e0 0x7fcd840cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.753+0000 7fcd83fff640 1 -- 172.21.15.17:0/3303213652 >> v2:172.21.15.142:3300/0 conn(0x7fcd840cf980 msgr2=0x7fcd840b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.753+0000 7fcd83fff640 1 --2- 172.21.15.17:0/3303213652 >> v2:172.21.15.142:3300/0 conn(0x7fcd840cf980 0x7fcd840b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.753+0000 7fcd83fff640 1 -- 172.21.15.17:0/3303213652 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840b5a30 con 0x7fcd84160030 2023-08-09T12:47:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.753+0000 7fcd88eec640 1 --2- 172.21.15.17:0/3303213652 >> v2:172.21.15.142:3300/0 conn(0x7fcd840cf980 0x7fcd840b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.754+0000 7fcd83fff640 1 --2- 172.21.15.17:0/3303213652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd84160030 0x7fcd84160740 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fcd840cd070 tx=0x7fcd7402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92331540e6a6c94c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.754+0000 7fcd82ffd640 1 -- 172.21.15.17:0/3303213652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7402ca80 con 0x7fcd84160030 2023-08-09T12:47:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.754+0000 7fcd82ffd640 1 -- 172.21.15.17:0/3303213652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7402cbe0 con 0x7fcd84160030 2023-08-09T12:47:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.754+0000 7fcd82ffd640 1 -- 172.21.15.17:0/3303213652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd740343f0 con 0x7fcd84160030 2023-08-09T12:47:22.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 -- 172.21.15.17:0/3303213652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd84160030 msgr2=0x7fcd84160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 --2- 172.21.15.17:0/3303213652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd84160030 0x7fcd84160740 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fcd840cd070 tx=0x7fcd7402bee0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 -- 172.21.15.17:0/3303213652 shutdown_connections 2023-08-09T12:47:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 --2- 172.21.15.17:0/3303213652 >> v2:172.21.15.142:3300/0 conn(0x7fcd840cf980 0x7fcd840b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 --2- 172.21.15.17:0/3303213652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd840b86e0 0x7fcd840cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 --2- 172.21.15.17:0/3303213652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd84160030 0x7fcd84160740 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 -- 172.21.15.17:0/3303213652 >> 172.21.15.17:0/3303213652 conn(0x7fcd840697c0 msgr2=0x7fcd84069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 -- 172.21.15.17:0/3303213652 shutdown_connections 2023-08-09T12:47:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.755+0000 7fcd896ed640 1 -- 172.21.15.17:0/3303213652 wait complete. 2023-08-09T12:47:22.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.757+0000 7fcd896ed640 1 Processor -- start 2023-08-09T12:47:22.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.757+0000 7fcd896ed640 1 -- start start 2023-08-09T12:47:22.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.758+0000 7fcd896ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd840b86e0 0x7fcd840cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.758+0000 7fcd896ed640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd840cf980 0x7fcd840a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.758+0000 7fcd896ed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd84160030 0x7fcd840aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.758+0000 7fcd896ed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840a9cc0 con 0x7fcd840b86e0 2023-08-09T12:47:22.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.758+0000 7fcd896ed640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840cc030 con 0x7fcd840cf980 2023-08-09T12:47:22.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.758+0000 7fcd896ed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840cb700 con 0x7fcd84160030 2023-08-09T12:47:22.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd840b86e0 0x7fcd840cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd840b86e0 0x7fcd840cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45088/0 (socket says 172.21.15.17:45088) 2023-08-09T12:47:22.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 -- 172.21.15.17:0/1141766368 learned_addr learned my addr 172.21.15.17:0/1141766368 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:22.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd88eec640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd84160030 0x7fcd840aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd837fe640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd840cf980 0x7fcd840a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 -- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd84160030 msgr2=0x7fcd840aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd84160030 0x7fcd840aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 -- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd840cf980 msgr2=0x7fcd840a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd840cf980 0x7fcd840a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 -- 172.21.15.17:0/1141766368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd74009b30 con 0x7fcd840b86e0 2023-08-09T12:47:22.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd837fe640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd840cf980 0x7fcd840a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:22.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.759+0000 7fcd83fff640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd840b86e0 0x7fcd840cc4c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcd74000f80 tx=0x7fcd74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:22.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.760+0000 7fcd80ff9640 1 -- 172.21.15.17:0/1141766368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74009510 con 0x7fcd840b86e0 2023-08-09T12:47:22.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.760+0000 7fcd80ff9640 1 -- 172.21.15.17:0/1141766368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7403e450 con 0x7fcd840b86e0 2023-08-09T12:47:22.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.760+0000 7fcd80ff9640 1 -- 172.21.15.17:0/1141766368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7403e800 con 0x7fcd840b86e0 2023-08-09T12:47:22.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.760+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd840cb9e0 con 0x7fcd840b86e0 2023-08-09T12:47:22.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.760+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd840a9900 con 0x7fcd840b86e0 2023-08-09T12:47:22.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.761+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd840d0cf0 con 0x7fcd840b86e0 2023-08-09T12:47:22.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.762+0000 7fcd80ff9640 1 -- 172.21.15.17:0/1141766368 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd7402cd50 con 0x7fcd840b86e0 2023-08-09T12:47:22.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.763+0000 7fcd80ff9640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd6406a050 0x7fcd6406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:22.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.763+0000 7fcd80ff9640 1 -- 172.21.15.17:0/1141766368 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fcd740ab160 con 0x7fcd840b86e0 2023-08-09T12:47:22.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.764+0000 7fcd837fe640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd6406a050 0x7fcd6406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:22.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.765+0000 7fcd837fe640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd6406a050 0x7fcd6406c510 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcd840c7150 tx=0x7fcd6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:22.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.767+0000 7fcd80ff9640 1 -- 172.21.15.17:0/1141766368 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcd740768b0 con 0x7fcd840b86e0 2023-08-09T12:47:22.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.962+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd8404e390 con 0x7fcd840b86e0 2023-08-09T12:47:22.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.966+0000 7fcd80ff9640 1 -- 172.21.15.17:0/1141766368 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+18328 (secure 0 0 0) 0x7fcd74079ed0 con 0x7fcd840b86e0 2023-08-09T12:47:22.969 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:22.970 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":135,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:12.937583+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:46:52.804156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-09T12:46:53.615239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.35","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:22.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.968+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd6406a050 msgr2=0x7fcd6406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.968+0000 7fcd896ed640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd6406a050 0x7fcd6406c510 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcd840c7150 tx=0x7fcd6c008040 comp rx=0 tx=0).stop 2023-08-09T12:47:22.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.968+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd840b86e0 msgr2=0x7fcd840cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:22.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.968+0000 7fcd896ed640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd840b86e0 0x7fcd840cc4c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcd74000f80 tx=0x7fcd74004a40 comp rx=0 tx=0).stop 2023-08-09T12:47:22.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.969+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 shutdown_connections 2023-08-09T12:47:22.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.969+0000 7fcd896ed640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd6406a050 0x7fcd6406c510 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.969+0000 7fcd896ed640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd84160030 0x7fcd840aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.969+0000 7fcd896ed640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd840cf980 0x7fcd840a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.969+0000 7fcd896ed640 1 --2- 172.21.15.17:0/1141766368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd840b86e0 0x7fcd840cc4c0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:22.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.969+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 >> 172.21.15.17:0/1141766368 conn(0x7fcd840697c0 msgr2=0x7fcd8415dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:22.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.969+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 shutdown_connections 2023-08-09T12:47:22.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:22.969+0000 7fcd896ed640 1 -- 172.21.15.17:0/1141766368 wait complete. 2023-08-09T12:47:22.993 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:47:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.206+0000 7f0a95c3f640 1 Processor -- start 2023-08-09T12:47:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.206+0000 7f0a95c3f640 1 -- start start 2023-08-09T12:47:23.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.207+0000 7f0a95c3f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 0x7f0a900b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.207+0000 7f0a95c3f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a900d29d0 0x7f0a900d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.207+0000 7f0a95c3f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a900cdd10 con 0x7f0a9015ce90 2023-08-09T12:47:23.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.207+0000 7f0a95c3f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a900b6540 con 0x7f0a900d29d0 2023-08-09T12:47:23.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.207+0000 7f0a95c3f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900d33a0 con 0x7f0a901616e0 2023-08-09T12:47:23.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.207+0000 7f0a8f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0a9015ce90 0x7f0a900cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58754/0 (socket says 172.21.15.17:58754) 2023-08-09T12:47:23.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.207+0000 7f0a8f7fe640 1 -- 172.21.15.17:0/1453455316 learned_addr learned my addr 172.21.15.17:0/1453455316 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:23.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8ffff640 1 --2- 172.21.15.17:0/1453455316 >> v2:172.21.15.142:3300/0 conn(0x7f0a900d29d0 0x7f0a900d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8effd640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 0x7f0a900b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94070660 0 0) 0x7f0a900cdd10 con 0x7f0a9015ce90 2023-08-09T12:47:23.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a78003520 con 0x7f0a9015ce90 2023-08-09T12:47:23.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1993641084 0 0) 0x7f0a78003520 con 0x7f0a9015ce90 2023-08-09T12:47:23.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 msgr2=0x7f0a900b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:23.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 0x7f0a900b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 >> v2:172.21.15.142:3300/0 conn(0x7f0a900d29d0 msgr2=0x7f0a900d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:23.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 --2- 172.21.15.17:0/1453455316 >> v2:172.21.15.142:3300/0 conn(0x7f0a900d29d0 0x7f0a900d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900cdff0 con 0x7f0a9015ce90 2023-08-09T12:47:23.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0a800019f0 con 0x7f0a9015ce90 2023-08-09T12:47:23.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 >> v1:172.21.15.17:6789/0 conn(0x7f0a9015ce90 legacy=0x7f0a900cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a78003970 0x7f0a78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a780047c0 0x7f0a78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.208+0000 7f0a8e7fc640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 0x7f0a78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900b6540 con 0x7f0a780047c0 2023-08-09T12:47:23.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900d33a0 con 0x7f0a78003970 2023-08-09T12:47:23.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7800b980 con 0x7f0a901616e0 2023-08-09T12:47:23.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8effd640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a780047c0 0x7f0a78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8f7fe640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a78003970 0x7f0a78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8ffff640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 0x7f0a78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8effd640 1 -- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 msgr2=0x7f0a78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8effd640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 0x7f0a78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8effd640 1 -- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a78003970 msgr2=0x7f0a78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8effd640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a78003970 0x7f0a78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8effd640 1 -- 172.21.15.17:0/1453455316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78003520 con 0x7f0a780047c0 2023-08-09T12:47:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.209+0000 7f0a8ffff640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a901616e0 0x7f0a78005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.210+0000 7f0a8effd640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a780047c0 0x7f0a78004c40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009ac0 tx=0x7f0a780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae21e49badf6c47 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8402c6b0 con 0x7f0a780047c0 2023-08-09T12:47:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8402c810 con 0x7f0a780047c0 2023-08-09T12:47:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a8e7fc640 1 -- 172.21.15.17:0/1453455316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8402cba0 con 0x7f0a780047c0 2023-08-09T12:47:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a95c3f640 1 -- 172.21.15.17:0/1453455316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a780047c0 msgr2=0x7f0a78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a95c3f640 1 --2- 172.21.15.17:0/1453455316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a780047c0 0x7f0a78004c40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009ac0 tx=0x7f0a780057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a8ffff640 1 -- 172.21.15.17:0/1453455316 reap_dead start 2023-08-09T12:47:23.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a95c3f640 1 -- 172.21.15.17:0/1453455316 shutdown_connections 2023-08-09T12:47:23.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a95c3f640 1 -- 172.21.15.17:0/1453455316 >> 172.21.15.17:0/1453455316 conn(0x7f0a9006fde0 msgr2=0x7f0a900701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:23.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.211+0000 7f0a95c3f640 1 -- 172.21.15.17:0/1453455316 shutdown_connections 2023-08-09T12:47:23.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.212+0000 7f0a95c3f640 1 -- 172.21.15.17:0/1453455316 wait complete. 2023-08-09T12:47:23.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.213+0000 7f0a95c3f640 1 Processor -- start 2023-08-09T12:47:23.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.213+0000 7f0a95c3f640 1 -- start start 2023-08-09T12:47:23.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.214+0000 7f0a95c3f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780047c0 0x7f0a9014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.214+0000 7f0a95c3f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900cc960 0x7f0a900caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.214+0000 7f0a95c3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cb420 0x7f0a9015e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.214+0000 7f0a95c3f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a901504a0 con 0x7f0a900cb420 2023-08-09T12:47:23.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.214+0000 7f0a95c3f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900cc4d0 con 0x7f0a780047c0 2023-08-09T12:47:23.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.214+0000 7f0a95c3f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900cb8c0 con 0x7f0a900cc960 2023-08-09T12:47:23.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cb420 0x7f0a9015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cb420 0x7f0a9015e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45116/0 (socket says 172.21.15.17:45116) 2023-08-09T12:47:23.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 -- 172.21.15.17:0/4184608360 learned_addr learned my addr 172.21.15.17:0/4184608360 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:23.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8effd640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900cc960 0x7f0a900caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 -- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900cc960 msgr2=0x7f0a900caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900cc960 0x7f0a900caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 -- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780047c0 msgr2=0x7f0a9014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780047c0 0x7f0a9014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 -- 172.21.15.17:0/4184608360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900cbba0 con 0x7f0a900cb420 2023-08-09T12:47:23.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.215+0000 7f0a8ffff640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cb420 0x7f0a9015e740 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0a90071ae0 tx=0x7f0a88010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:23.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.216+0000 7f0a77fff640 1 -- 172.21.15.17:0/4184608360 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800e8a0 con 0x7f0a900cb420 2023-08-09T12:47:23.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.216+0000 7f0a77fff640 1 -- 172.21.15.17:0/4184608360 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8800ea00 con 0x7f0a900cb420 2023-08-09T12:47:23.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.216+0000 7f0a77fff640 1 -- 172.21.15.17:0/4184608360 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800ed90 con 0x7f0a900cb420 2023-08-09T12:47:23.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.216+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a900cbe80 con 0x7f0a900cb420 2023-08-09T12:47:23.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.216+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9015a1f0 con 0x7f0a900cb420 2023-08-09T12:47:23.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.217+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9015a380 con 0x7f0a900cb420 2023-08-09T12:47:23.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.218+0000 7f0a77fff640 1 -- 172.21.15.17:0/4184608360 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a88020410 con 0x7f0a900cb420 2023-08-09T12:47:23.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.219+0000 7f0a77fff640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7c06a050 0x7f0a7c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.219+0000 7f0a77fff640 1 -- 172.21.15.17:0/4184608360 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f0a88087fa0 con 0x7f0a900cb420 2023-08-09T12:47:23.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.220+0000 7f0a8f7fe640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7c06a050 0x7f0a7c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.221+0000 7f0a8f7fe640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7c06a050 0x7f0a7c06c510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0a800012e0 tx=0x7f0a80001250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:23.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.223+0000 7f0a77fff640 1 -- 172.21.15.17:0/4184608360 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0a88053680 con 0x7f0a900cb420 2023-08-09T12:47:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.450+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0a90067a80 con 0x7f0a900cb420 2023-08-09T12:47:23.454 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:47:23.451+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:47:23.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.458+0000 7f0a77fff640 1 -- 172.21.15.17:0/4184608360 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0a88056ca0 con 0x7f0a900cb420 2023-08-09T12:47:23.461 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:47:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.461+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7c06a050 msgr2=0x7f0a7c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.461+0000 7f0a95c3f640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7c06a050 0x7f0a7c06c510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0a800012e0 tx=0x7f0a80001250 comp rx=0 tx=0).stop 2023-08-09T12:47:23.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.461+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cb420 msgr2=0x7f0a9015e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.461+0000 7f0a95c3f640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cb420 0x7f0a9015e740 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0a90071ae0 tx=0x7f0a88010c20 comp rx=0 tx=0).stop 2023-08-09T12:47:23.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.462+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 shutdown_connections 2023-08-09T12:47:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.462+0000 7f0a95c3f640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7c06a050 0x7f0a7c06c510 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.462+0000 7f0a95c3f640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cb420 0x7f0a9015e740 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.462+0000 7f0a95c3f640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900cc960 0x7f0a900caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.462+0000 7f0a95c3f640 1 --2- 172.21.15.17:0/4184608360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a780047c0 0x7f0a9014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.462+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 >> 172.21.15.17:0/4184608360 conn(0x7f0a9006fde0 msgr2=0x7f0a900b78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.462+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 shutdown_connections 2023-08-09T12:47:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.462+0000 7f0a95c3f640 1 -- 172.21.15.17:0/4184608360 wait complete. 2023-08-09T12:47:23.479 INFO:tasks.ceph.mds.a.smithi017.stderr: -4963> 2023-08-09T12:46:59.046+0000 7f8955258640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:47:23.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:47:23.551 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:47:23.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.689+0000 7f0df9514640 1 Processor -- start 2023-08-09T12:47:23.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.690+0000 7f0df9514640 1 -- start start 2023-08-09T12:47:23.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.691+0000 7f0df9514640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0df40b0730 0x7f0df40b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.691+0000 7f0df9514640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df415e7b0 con 0x7f0df40b4170 2023-08-09T12:47:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.691+0000 7f0df9514640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df415e460 con 0x7f0df415a8c0 2023-08-09T12:47:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.691+0000 7f0df9514640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df415aca0 con 0x7f0df40b0730 2023-08-09T12:47:23.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.692+0000 7f0df37fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0df40b4170 0x7f0df40b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58768/0 (socket says 172.21.15.17:58768) 2023-08-09T12:47:23.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.692+0000 7f0df37fe640 1 -- 172.21.15.17:0/3140458339 learned_addr learned my addr 172.21.15.17:0/3140458339 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:23.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.692+0000 7f0df8d13640 1 --2- 172.21.15.17:0/3140458339 >> v2:172.21.15.142:3300/0 conn(0x7f0df40b0730 0x7f0df40b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.692+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869896295 0 0) 0x7f0df415e7b0 con 0x7f0df40b4170 2023-08-09T12:47:23.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.692+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ddc003520 con 0x7f0df40b4170 2023-08-09T12:47:23.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3289596381 0 0) 0x7f0ddc003520 con 0x7f0df40b4170 2023-08-09T12:47:23.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 >> v2:172.21.15.142:3300/0 conn(0x7f0df40b0730 msgr2=0x7f0df40b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:23.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 --2- 172.21.15.17:0/3140458339 >> v2:172.21.15.142:3300/0 conn(0x7f0df40b0730 0x7f0df40b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 >> v1:172.21.15.142:6789/0 conn(0x7f0df415a8c0 legacy=0x7f0df415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40b1af0 con 0x7f0df40b4170 2023-08-09T12:47:23.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0de8001670 con 0x7f0df40b4170 2023-08-09T12:47:23.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 >> v1:172.21.15.17:6789/0 conn(0x7f0df40b4170 legacy=0x7f0df40b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc003970 0x7f0ddc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ddc0047c0 0x7f0ddc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ddc005180 0x7f0ddc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df415aca0 con 0x7f0ddc005180 2023-08-09T12:47:23.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc00c020 con 0x7f0ddc003970 2023-08-09T12:47:23.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc00c1e0 con 0x7f0ddc0047c0 2023-08-09T12:47:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df8d13640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ddc005180 0x7f0ddc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df37fe640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ddc0047c0 0x7f0ddc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.693+0000 7f0df3fff640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc003970 0x7f0ddc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.694+0000 7f0df8d13640 1 -- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ddc0047c0 msgr2=0x7f0ddc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.694+0000 7f0df8d13640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ddc0047c0 0x7f0ddc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.694+0000 7f0df8d13640 1 -- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc003970 msgr2=0x7f0ddc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.694+0000 7f0df8d13640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc003970 0x7f0ddc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.694+0000 7f0df8d13640 1 -- 172.21.15.17:0/3140458339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc003520 con 0x7f0ddc005180 2023-08-09T12:47:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.694+0000 7f0df37fe640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ddc0047c0 0x7f0ddc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.695+0000 7f0df8d13640 1 -- 172.21.15.17:0/3140458339 reap_dead start 2023-08-09T12:47:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.695+0000 7f0df8d13640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ddc005180 0x7f0ddc00b980 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009f90 tx=0x7f0ddc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90973df5306ea7ad server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.695+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec02cc20 con 0x7f0ddc005180 2023-08-09T12:47:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.695+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec00f040 con 0x7f0ddc005180 2023-08-09T12:47:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.695+0000 7f0df2ffd640 1 -- 172.21.15.17:0/3140458339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec034440 con 0x7f0ddc005180 2023-08-09T12:47:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.696+0000 7f0df9514640 1 -- 172.21.15.17:0/3140458339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ddc005180 msgr2=0x7f0ddc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.696+0000 7f0df9514640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ddc005180 0x7f0ddc00b980 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009f90 tx=0x7f0ddc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.696+0000 7f0df9514640 1 -- 172.21.15.17:0/3140458339 shutdown_connections 2023-08-09T12:47:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.696+0000 7f0df9514640 1 --2- 172.21.15.17:0/3140458339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ddc005180 0x7f0ddc00b980 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.696+0000 7f0df9514640 1 -- 172.21.15.17:0/3140458339 >> 172.21.15.17:0/3140458339 conn(0x7f0df40cb020 msgr2=0x7f0df40cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.696+0000 7f0df9514640 1 -- 172.21.15.17:0/3140458339 shutdown_connections 2023-08-09T12:47:23.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.696+0000 7f0df9514640 1 -- 172.21.15.17:0/3140458339 wait complete. 2023-08-09T12:47:23.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.698+0000 7f0df9514640 1 Processor -- start 2023-08-09T12:47:23.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.698+0000 7f0df9514640 1 -- start start 2023-08-09T12:47:23.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df9514640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc005180 0x7f0df4158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df9514640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0df4158050 0x7f0df40c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df9514640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df4158bc0 0x7f0df40c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df9514640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4156d10 con 0x7f0df4158bc0 2023-08-09T12:47:23.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df9514640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4156fb0 con 0x7f0ddc005180 2023-08-09T12:47:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df9514640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4157290 con 0x7f0df4158050 2023-08-09T12:47:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df8d13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df4158bc0 0x7f0df40c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df8d13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df4158bc0 0x7f0df40c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45142/0 (socket says 172.21.15.17:45142) 2023-08-09T12:47:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.699+0000 7f0df8d13640 1 -- 172.21.15.17:0/4274541996 learned_addr learned my addr 172.21.15.17:0/4274541996 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df3fff640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc005180 0x7f0df4158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df37fe640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0df4158050 0x7f0df40c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df8d13640 1 -- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0df4158050 msgr2=0x7f0df40c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df8d13640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0df4158050 0x7f0df40c3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df8d13640 1 -- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc005180 msgr2=0x7f0df4158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df8d13640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc005180 0x7f0df4158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df8d13640 1 -- 172.21.15.17:0/4274541996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4157570 con 0x7f0df4158bc0 2023-08-09T12:47:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df8d13640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df4158bc0 0x7f0df40c3750 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00e230 tx=0x7f0dec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df0ff9640 1 -- 172.21.15.17:0/4274541996 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec02cea0 con 0x7f0df4158bc0 2023-08-09T12:47:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df0ff9640 1 -- 172.21.15.17:0/4274541996 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec03d600 con 0x7f0df4158bc0 2023-08-09T12:47:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df0ff9640 1 -- 172.21.15.17:0/4274541996 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec03d9b0 con 0x7f0df4158bc0 2023-08-09T12:47:23.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.700+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df4157850 con 0x7f0df4158bc0 2023-08-09T12:47:23.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.701+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df4152d90 con 0x7f0df4158bc0 2023-08-09T12:47:23.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.702+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df4157d70 con 0x7f0df4158bc0 2023-08-09T12:47:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.703+0000 7f0df0ff9640 1 -- 172.21.15.17:0/4274541996 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0dec03b040 con 0x7f0df4158bc0 2023-08-09T12:47:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.704+0000 7f0df0ff9640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0de006a050 0x7f0de006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.704+0000 7f0df0ff9640 1 -- 172.21.15.17:0/4274541996 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f0dec0a9df0 con 0x7f0df4158bc0 2023-08-09T12:47:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.704+0000 7f0df3fff640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0de006a050 0x7f0de006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.705+0000 7f0df3fff640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0de006a050 0x7f0de006c510 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0df4070030 tx=0x7f0de4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:23.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.708+0000 7f0df0ff9640 1 -- 172.21.15.17:0/4274541996 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0dec075470 con 0x7f0df4158bc0 2023-08-09T12:47:23.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:23.945+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0df404e390 con 0x7f0df4158bc0 2023-08-09T12:47:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.462+0000 7f0df0ff9640 1 -- 172.21.15.17:0/4274541996 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0dec078a90 con 0x7f0df4158bc0 2023-08-09T12:47:24.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0de006a050 msgr2=0x7f0de006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0de006a050 0x7f0de006c510 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0df4070030 tx=0x7f0de4009040 comp rx=0 tx=0).stop 2023-08-09T12:47:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df4158bc0 msgr2=0x7f0df40c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df4158bc0 0x7f0df40c3750 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00e230 tx=0x7f0dec009750 comp rx=0 tx=0).stop 2023-08-09T12:47:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 shutdown_connections 2023-08-09T12:47:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0de006a050 0x7f0de006c510 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df4158bc0 0x7f0df40c3750 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0df4158050 0x7f0df40c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 --2- 172.21.15.17:0/4274541996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ddc005180 0x7f0df4158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 >> 172.21.15.17:0/4274541996 conn(0x7f0df40cb020 msgr2=0x7f0df40c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.466+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 shutdown_connections 2023-08-09T12:47:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.467+0000 7f0df9514640 1 -- 172.21.15.17:0/4274541996 wait complete. 2023-08-09T12:47:24.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:47:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.714+0000 7f3824406640 1 Processor -- start 2023-08-09T12:47:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.715+0000 7f3824406640 1 -- start start 2023-08-09T12:47:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.716+0000 7f3824406640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f381c15abe0 0x7f381c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.716+0000 7f3824406640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.716+0000 7f3824406640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c15f6e0 con 0x7f381c0add60 2023-08-09T12:47:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.716+0000 7f3824406640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c0b4770 con 0x7f381c15abe0 2023-08-09T12:47:24.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.716+0000 7f3824406640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0caa70 con 0x7f381c0708a0 2023-08-09T12:47:24.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.717+0000 7f38221a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f381c15abe0 0x7f381c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:24.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.717+0000 7f38221a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f381c15abe0 0x7f381c0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:44872/0 (socket says 172.21.15.17:44872) 2023-08-09T12:47:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.717+0000 7f38221a2640 1 -- 172.21.15.17:0/548825780 learned_addr learned my addr 172.21.15.17:0/548825780 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.717+0000 7f38219a1640 1 --1- 172.21.15.17:0/548825780 >> v1:172.21.15.142:6789/0 conn(0x7f381c0add60 0x7f381c070190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:40196/0 (socket says 172.21.15.17:40196) 2023-08-09T12:47:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.717+0000 7f38229a3640 1 --2- 172.21.15.17:0/548825780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.718+0000 7f38229a3640 1 -- 172.21.15.17:0/548825780 >> v2:172.21.15.142:3300/0 conn(0x7f381c15abe0 msgr2=0x7f381c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.718+0000 7f38229a3640 1 --2- 172.21.15.17:0/548825780 >> v2:172.21.15.142:3300/0 conn(0x7f381c15abe0 0x7f381c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.718+0000 7f38229a3640 1 -- 172.21.15.17:0/548825780 >> v1:172.21.15.142:6789/0 conn(0x7f381c0add60 legacy=0x7f381c070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:24.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.718+0000 7f38229a3640 1 -- 172.21.15.17:0/548825780 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0b41b0 con 0x7f381c0708a0 2023-08-09T12:47:24.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.718+0000 7f38221a2640 1 --2- 172.21.15.17:0/548825780 >> v2:172.21.15.142:3300/0 conn(0x7f381c15abe0 0x7f381c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:47:24.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.720+0000 7f38229a3640 1 --2- 172.21.15.17:0/548825780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c15f1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38140097a0 tx=0x7f381402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f40454b2c0b7519 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:24.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.720+0000 7f38211a0640 1 -- 172.21.15.17:0/548825780 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140316f0 con 0x7f381c0708a0 2023-08-09T12:47:24.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.720+0000 7f38211a0640 1 -- 172.21.15.17:0/548825780 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814031850 con 0x7f381c0708a0 2023-08-09T12:47:24.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.720+0000 7f38211a0640 1 -- 172.21.15.17:0/548825780 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814031be0 con 0x7f381c0708a0 2023-08-09T12:47:24.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.721+0000 7f3824406640 1 -- 172.21.15.17:0/548825780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 msgr2=0x7f381c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:24.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.721+0000 7f3824406640 1 --2- 172.21.15.17:0/548825780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c15f1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38140097a0 tx=0x7f381402b790 comp rx=0 tx=0).stop 2023-08-09T12:47:24.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.721+0000 7f3824406640 1 -- 172.21.15.17:0/548825780 shutdown_connections 2023-08-09T12:47:24.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.721+0000 7f3824406640 1 --2- 172.21.15.17:0/548825780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c15f1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.721+0000 7f3824406640 1 --2- 172.21.15.17:0/548825780 >> v2:172.21.15.142:3300/0 conn(0x7f381c15abe0 0x7f381c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.721+0000 7f3824406640 1 -- 172.21.15.17:0/548825780 >> 172.21.15.17:0/548825780 conn(0x7f381c0697c0 msgr2=0x7f381c069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:24.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.721+0000 7f3824406640 1 -- 172.21.15.17:0/548825780 shutdown_connections 2023-08-09T12:47:24.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.721+0000 7f3824406640 1 -- 172.21.15.17:0/548825780 wait complete. 2023-08-09T12:47:24.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.724+0000 7f3824406640 1 Processor -- start 2023-08-09T12:47:24.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.724+0000 7f3824406640 1 -- start start 2023-08-09T12:47:24.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.725+0000 7f3824406640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c1f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:24.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.725+0000 7f3824406640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0add60 0x7f381c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.725+0000 7f3824406640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15abe0 0x7f381c1f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.725+0000 7f3824406640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c1f6750 con 0x7f381c0add60 2023-08-09T12:47:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.725+0000 7f3824406640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c1f2880 con 0x7f381c15abe0 2023-08-09T12:47:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.725+0000 7f3824406640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c1f2b60 con 0x7f381c0708a0 2023-08-09T12:47:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.725+0000 7f38219a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0add60 0x7f381c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38219a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0add60 0x7f381c155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45144/0 (socket says 172.21.15.17:45144) 2023-08-09T12:47:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38219a1640 1 -- 172.21.15.17:0/1653105428 learned_addr learned my addr 172.21.15.17:0/1653105428 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38221a2640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c1f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38229a3640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15abe0 0x7f381c1f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38219a1640 1 -- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 msgr2=0x7f381c1f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:24.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38219a1640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c1f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38219a1640 1 -- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15abe0 msgr2=0x7f381c1f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:24.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38219a1640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15abe0 0x7f381c1f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:24.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38219a1640 1 -- 172.21.15.17:0/1653105428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009b30 con 0x7f381c0add60 2023-08-09T12:47:24.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.726+0000 7f38219a1640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0add60 0x7f381c155cc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f380c00c3c0 tx=0x7f380c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:24.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.727+0000 7f3812ffd640 1 -- 172.21.15.17:0/1653105428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0074e0 con 0x7f381c0add60 2023-08-09T12:47:24.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.727+0000 7f3812ffd640 1 -- 172.21.15.17:0/1653105428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c007640 con 0x7f381c0add60 2023-08-09T12:47:24.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.727+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3814009400 con 0x7f381c0add60 2023-08-09T12:47:24.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.727+0000 7f3812ffd640 1 -- 172.21.15.17:0/1653105428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c004a00 con 0x7f381c0add60 2023-08-09T12:47:24.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.727+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c0ae4d0 con 0x7f381c0add60 2023-08-09T12:47:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.728+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c0c3810 con 0x7f381c0add60 2023-08-09T12:47:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.729+0000 7f3812ffd640 1 -- 172.21.15.17:0/1653105428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f380c004b60 con 0x7f381c0add60 2023-08-09T12:47:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.730+0000 7f3812ffd640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f380006a080 0x7f380006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.730+0000 7f3812ffd640 1 -- 172.21.15.17:0/1653105428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f380c087e50 con 0x7f381c0add60 2023-08-09T12:47:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.731+0000 7f38221a2640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f380006a080 0x7f380006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.732+0000 7f38221a2640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f380006a080 0x7f380006c540 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f381c15eae0 tx=0x7f381800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.735+0000 7f3812ffd640 1 -- 172.21.15.17:0/1653105428 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f380c0534b0 con 0x7f381c0add60 2023-08-09T12:47:24.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:24.929+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f381c15f6e0 con 0x7f381c0add60 2023-08-09T12:47:25.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.474+0000 7f3812ffd640 1 -- 172.21.15.17:0/1653105428 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v137) v1 ==== 181+0+0 (secure 0 0 0) 0x7f381c15f6e0 con 0x7f381c0add60 2023-08-09T12:47:25.477 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:47:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.477+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f380006a080 msgr2=0x7f380006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.477+0000 7f3824406640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f380006a080 0x7f380006c540 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f381c15eae0 tx=0x7f381800b040 comp rx=0 tx=0).stop 2023-08-09T12:47:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.477+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0add60 msgr2=0x7f381c155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.477+0000 7f3824406640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0add60 0x7f381c155cc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f380c00c3c0 tx=0x7f380c00c880 comp rx=0 tx=0).stop 2023-08-09T12:47:25.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.478+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 shutdown_connections 2023-08-09T12:47:25.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.478+0000 7f3824406640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f380006a080 0x7f380006c540 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.478+0000 7f3824406640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f381c15abe0 0x7f381c1f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.478+0000 7f3824406640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f381c0add60 0x7f381c155cc0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.478+0000 7f3824406640 1 --2- 172.21.15.17:0/1653105428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f381c0708a0 0x7f381c1f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.478+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 >> 172.21.15.17:0/1653105428 conn(0x7f381c0697c0 msgr2=0x7f381c15dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:25.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.478+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 shutdown_connections 2023-08-09T12:47:25.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.478+0000 7f3824406640 1 -- 172.21.15.17:0/1653105428 wait complete. 2023-08-09T12:47:25.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:47:25.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.725+0000 7fa4a6dfc640 1 Processor -- start 2023-08-09T12:47:25.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.725+0000 7fa4a6dfc640 1 -- start start 2023-08-09T12:47:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a6dfc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b3dd0 0x7fa4a00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a6dfc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4a00b41b0 0x7fa4a015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a6dfc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa4a015f0e0 0x7fa4a00affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a6dfc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00b18b0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a6dfc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00b1b10 con 0x7fa4a00b41b0 2023-08-09T12:47:25.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a6dfc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00b1df0 con 0x7fa4a00b3dd0 2023-08-09T12:47:25.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a65fb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa4a015f0e0 0x7fa4a00affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a65fb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa4a015f0e0 0x7fa4a00affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45156/0 (socket says 172.21.15.17:45156) 2023-08-09T12:47:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a65fb640 1 -- 172.21.15.17:0/3135003229 learned_addr learned my addr 172.21.15.17:0/3135003229 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a55f9640 1 --2- 172.21.15.17:0/3135003229 >> v2:172.21.15.142:3300/0 conn(0x7fa4a00b41b0 0x7fa4a015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a65fb640 1 -- 172.21.15.17:0/3135003229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b3dd0 msgr2=0x7fa4a00b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.727+0000 7fa4a5dfa640 1 --2- 172.21.15.17:0/3135003229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b3dd0 0x7fa4a00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:25.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.728+0000 7fa4a65fb640 1 --2- 172.21.15.17:0/3135003229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b3dd0 0x7fa4a00b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.728+0000 7fa4a65fb640 1 -- 172.21.15.17:0/3135003229 >> v2:172.21.15.142:3300/0 conn(0x7fa4a00b41b0 msgr2=0x7fa4a015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.728+0000 7fa4a65fb640 1 --2- 172.21.15.17:0/3135003229 >> v2:172.21.15.142:3300/0 conn(0x7fa4a00b41b0 0x7fa4a015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.728+0000 7fa4a65fb640 1 -- 172.21.15.17:0/3135003229 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00b20d0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.728+0000 7fa4a55f9640 1 --2- 172.21.15.17:0/3135003229 >> v2:172.21.15.142:3300/0 conn(0x7fa4a00b41b0 0x7fa4a015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.729+0000 7fa4a65fb640 1 --2- 172.21.15.17:0/3135003229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a00affa0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fa4a006a7d0 tx=0x7fa49802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbc2dee6fe90fca server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.729+0000 7fa4a4df8640 1 -- 172.21.15.17:0/3135003229 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49802ca80 con 0x7fa4a015f0e0 2023-08-09T12:47:25.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.729+0000 7fa4a4df8640 1 -- 172.21.15.17:0/3135003229 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49802cbe0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.729+0000 7fa4a4df8640 1 -- 172.21.15.17:0/3135003229 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4980343f0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3135003229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 msgr2=0x7fa4a00affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3135003229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a00affa0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fa4a006a7d0 tx=0x7fa49802bee0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3135003229 shutdown_connections 2023-08-09T12:47:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3135003229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a00affa0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3135003229 >> v2:172.21.15.142:3300/0 conn(0x7fa4a00b41b0 0x7fa4a015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3135003229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b3dd0 0x7fa4a00b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3135003229 >> 172.21.15.17:0/3135003229 conn(0x7fa4a00cafa0 msgr2=0x7fa4a00cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:25.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3135003229 shutdown_connections 2023-08-09T12:47:25.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.730+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3135003229 wait complete. 2023-08-09T12:47:25.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.732+0000 7fa4a6dfc640 1 Processor -- start 2023-08-09T12:47:25.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.732+0000 7fa4a6dfc640 1 -- start start 2023-08-09T12:47:25.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a6dfc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a00b3dd0 0x7fa4a006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:25.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a6dfc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b41b0 0x7fa4a0152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:25.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a6dfc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a0071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:25.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a6dfc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a01534e0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a6dfc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a006f8f0 con 0x7fa4a00b3dd0 2023-08-09T12:47:25.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a6dfc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a006fbd0 con 0x7fa4a00b41b0 2023-08-09T12:47:25.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a65fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a0071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:25.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a65fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a0071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45166/0 (socket says 172.21.15.17:45166) 2023-08-09T12:47:25.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.733+0000 7fa4a65fb640 1 -- 172.21.15.17:0/3000856300 learned_addr learned my addr 172.21.15.17:0/3000856300 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:25.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a55f9640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b41b0 0x7fa4a0152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:25.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a5dfa640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a00b3dd0 0x7fa4a006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:25.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a65fb640 1 -- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b41b0 msgr2=0x7fa4a0152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:25.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a65fb640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b41b0 0x7fa4a0152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a65fb640 1 -- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a00b3dd0 msgr2=0x7fa4a006f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:25.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a65fb640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a00b3dd0 0x7fa4a006f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:25.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a65fb640 1 -- 172.21.15.17:0/3000856300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498009b30 con 0x7fa4a015f0e0 2023-08-09T12:47:25.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a55f9640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b41b0 0x7fa4a0152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:25.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4a65fb640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a0071450 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fa498036040 tx=0x7fa498004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:25.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.734+0000 7fa4967fc640 1 -- 172.21.15.17:0/3000856300 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498009510 con 0x7fa4a015f0e0 2023-08-09T12:47:25.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.735+0000 7fa4967fc640 1 -- 172.21.15.17:0/3000856300 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49803e450 con 0x7fa4a015f0e0 2023-08-09T12:47:25.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.735+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a006feb0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.735+0000 7fa4967fc640 1 -- 172.21.15.17:0/3000856300 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49803e800 con 0x7fa4a015f0e0 2023-08-09T12:47:25.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.735+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a015c3b0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.736+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a015c630 con 0x7fa4a015f0e0 2023-08-09T12:47:25.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.737+0000 7fa4967fc640 1 -- 172.21.15.17:0/3000856300 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa49802cd50 con 0x7fa4a015f0e0 2023-08-09T12:47:25.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.738+0000 7fa4967fc640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa48406a050 0x7fa48406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:25.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.739+0000 7fa4967fc640 1 -- 172.21.15.17:0/3000856300 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5739+0+0 (secure 0 0 0) 0x7fa4980aaff0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.739+0000 7fa4a5dfa640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa48406a050 0x7fa48406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:25.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.740+0000 7fa4a5dfa640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa48406a050 0x7fa48406c510 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa49c006fd0 tx=0x7fa49c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:25.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.744+0000 7fa4967fc640 1 -- 172.21.15.17:0/3000856300 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa4980dd7b0 con 0x7fa4a015f0e0 2023-08-09T12:47:25.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:25.940+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4a004e390 con 0x7fa4a015f0e0 2023-08-09T12:47:26.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.481+0000 7fa4967fc640 1 -- 172.21.15.17:0/3000856300 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v138) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa4980767c0 con 0x7fa4a015f0e0 2023-08-09T12:47:26.486 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:47:26.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa48406a050 msgr2=0x7fa48406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa48406a050 0x7fa48406c510 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa49c006fd0 tx=0x7fa49c008040 comp rx=0 tx=0).stop 2023-08-09T12:47:26.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 msgr2=0x7fa4a0071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a0071450 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fa498036040 tx=0x7fa498004a40 comp rx=0 tx=0).stop 2023-08-09T12:47:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 shutdown_connections 2023-08-09T12:47:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa48406a050 0x7fa48406c510 secure :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa49c006fd0 tx=0x7fa49c008040 comp rx=0 tx=0).stop 2023-08-09T12:47:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a015f0e0 0x7fa4a0071450 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4a00b41b0 0x7fa4a0152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 --2- 172.21.15.17:0/3000856300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4a00b3dd0 0x7fa4a006f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.488+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 >> 172.21.15.17:0/3000856300 conn(0x7fa4a00cafa0 msgr2=0x7fa4a00c7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.489+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 shutdown_connections 2023-08-09T12:47:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.489+0000 7fa4a6dfc640 1 -- 172.21.15.17:0/3000856300 wait complete. 2023-08-09T12:47:26.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:47:26.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.739+0000 7f12de734640 1 Processor -- start 2023-08-09T12:47:26.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.739+0000 7f12de734640 1 -- start start 2023-08-09T12:47:26.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.741+0000 7f12de734640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12d80b0020 0x7f12d80b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:26.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.741+0000 7f12de734640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d8157580 con 0x7f12d8160640 2023-08-09T12:47:26.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.741+0000 7f12de734640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d80ad490 con 0x7f12d80cdb00 2023-08-09T12:47:26.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.741+0000 7f12de734640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d815d1c0 con 0x7f12d80b0020 2023-08-09T12:47:26.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.741+0000 7f12ddf33640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f12d8160640 0x7f12d815d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58780/0 (socket says 172.21.15.17:58780) 2023-08-09T12:47:26.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.741+0000 7f12ddf33640 1 -- 172.21.15.17:0/3051202193 learned_addr learned my addr 172.21.15.17:0/3051202193 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:26.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12dd732640 1 --2- 172.21.15.17:0/3051202193 >> v2:172.21.15.142:3300/0 conn(0x7f12d80b0020 0x7f12d80b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:26.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416490612 0 0) 0x7f12d8157580 con 0x7f12d8160640 2023-08-09T12:47:26.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c0003520 con 0x7f12d8160640 2023-08-09T12:47:26.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578743354 0 0) 0x7f12c0003520 con 0x7f12d8160640 2023-08-09T12:47:26.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 >> v2:172.21.15.142:3300/0 conn(0x7f12d80b0020 msgr2=0x7f12d80b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:26.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 --2- 172.21.15.17:0/3051202193 >> v2:172.21.15.142:3300/0 conn(0x7f12d80b0020 0x7f12d80b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 >> v1:172.21.15.142:6789/0 conn(0x7f12d80cdb00 legacy=0x7f12d80acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d80b0940 con 0x7f12d8160640 2023-08-09T12:47:26.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f12d0001670 con 0x7f12d8160640 2023-08-09T12:47:26.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 >> v1:172.21.15.17:6789/0 conn(0x7f12d8160640 legacy=0x7f12d815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c0003970 0x7f12c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:26.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12c00047c0 0x7f12c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:26.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12c0005180 0x7f12c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:26.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.742+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d815d1c0 con 0x7f12c0003970 2023-08-09T12:47:26.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c000c020 con 0x7f12c0005180 2023-08-09T12:47:26.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c000c1e0 con 0x7f12c00047c0 2023-08-09T12:47:26.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12dd732640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c0003970 0x7f12c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12dd732640 1 -- 172.21.15.17:0/3051202193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12c00047c0 msgr2=0x7f12c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12dd732640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12c00047c0 0x7f12c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12ddf33640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12c0005180 0x7f12c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12dd732640 1 -- 172.21.15.17:0/3051202193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12c0005180 msgr2=0x7f12c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12dd732640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12c0005180 0x7f12c000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12dd732640 1 -- 172.21.15.17:0/3051202193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0003520 con 0x7f12c0003970 2023-08-09T12:47:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.743+0000 7f12ddf33640 1 -- 172.21.15.17:0/3051202193 reap_dead start 2023-08-09T12:47:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.744+0000 7f12dd732640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c0003970 0x7f12c0003d90 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009fc0 tx=0x7f12c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97a3e92eb5ebf0f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.745+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c802cc20 con 0x7f12c0003970 2023-08-09T12:47:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.745+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c800f040 con 0x7f12c0003970 2023-08-09T12:47:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.745+0000 7f12d7fff640 1 -- 172.21.15.17:0/3051202193 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8034440 con 0x7f12c0003970 2023-08-09T12:47:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.745+0000 7f12de734640 1 -- 172.21.15.17:0/3051202193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c0003970 msgr2=0x7f12c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.745+0000 7f12de734640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c0003970 0x7f12c0003d90 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009fc0 tx=0x7f12c00057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.746+0000 7f12de734640 1 -- 172.21.15.17:0/3051202193 shutdown_connections 2023-08-09T12:47:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.746+0000 7f12de734640 1 --2- 172.21.15.17:0/3051202193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c0003970 0x7f12c0003d90 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.746+0000 7f12de734640 1 -- 172.21.15.17:0/3051202193 >> 172.21.15.17:0/3051202193 conn(0x7f12d80cb020 msgr2=0x7f12d80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.746+0000 7f12de734640 1 -- 172.21.15.17:0/3051202193 shutdown_connections 2023-08-09T12:47:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.746+0000 7f12de734640 1 -- 172.21.15.17:0/3051202193 wait complete. 2023-08-09T12:47:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.748+0000 7f12de734640 1 Processor -- start 2023-08-09T12:47:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.748+0000 7f12de734640 1 -- start start 2023-08-09T12:47:26.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12de734640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12c0003970 0x7f12d8143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:26.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12de734640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12d814a160 0x7f12d8147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12de734640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d80cb400 0x7f12d80cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12de734640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80cbdc0 con 0x7f12d80cb400 2023-08-09T12:47:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12de734640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8144370 con 0x7f12d814a160 2023-08-09T12:47:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12de734640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80c6ed0 con 0x7f12c0003970 2023-08-09T12:47:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12ddf33640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d80cb400 0x7f12d80cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12ddf33640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d80cb400 0x7f12d80cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45186/0 (socket says 172.21.15.17:45186) 2023-08-09T12:47:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.749+0000 7f12ddf33640 1 -- 172.21.15.17:0/3940030566 learned_addr learned my addr 172.21.15.17:0/3940030566 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12dcf31640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12d814a160 0x7f12d8147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12ddf33640 1 -- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12c0003970 msgr2=0x7f12d8143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12dd732640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12c0003970 0x7f12d8143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12ddf33640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12c0003970 0x7f12d8143e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12ddf33640 1 -- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12d814a160 msgr2=0x7f12d8147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12ddf33640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12d814a160 0x7f12d8147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12ddf33640 1 -- 172.21.15.17:0/3940030566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d80b3a90 con 0x7f12d80cb400 2023-08-09T12:47:26.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12dcf31640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12d814a160 0x7f12d8147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:26.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12ddf33640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d80cb400 0x7f12d80cb880 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f12d0000fb0 tx=0x7f12d000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:26.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12d5ffb640 1 -- 172.21.15.17:0/3940030566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d00074e0 con 0x7f12d80cb400 2023-08-09T12:47:26.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12d5ffb640 1 -- 172.21.15.17:0/3940030566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d0007660 con 0x7f12d80cb400 2023-08-09T12:47:26.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12d5ffb640 1 -- 172.21.15.17:0/3940030566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0004a20 con 0x7f12d80cb400 2023-08-09T12:47:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.750+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d80b3d70 con 0x7f12d80cb400 2023-08-09T12:47:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.751+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d80b4050 con 0x7f12d80cb400 2023-08-09T12:47:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.752+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d80c6d30 con 0x7f12d80cb400 2023-08-09T12:47:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.753+0000 7f12d5ffb640 1 -- 172.21.15.17:0/3940030566 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f12d0004b80 con 0x7f12d80cb400 2023-08-09T12:47:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.754+0000 7f12d5ffb640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12c406a050 0x7f12c406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.754+0000 7f12d5ffb640 1 -- 172.21.15.17:0/3940030566 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f12d0087880 con 0x7f12d80cb400 2023-08-09T12:47:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.754+0000 7f12dd732640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12c406a050 0x7f12c406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.756+0000 7f12dd732640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12c406a050 0x7f12c406c510 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f12c8036000 tx=0x7f12c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.758+0000 7f12d5ffb640 1 -- 172.21.15.17:0/3940030566 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f12d80c6d30 con 0x7f12d80cb400 2023-08-09T12:47:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.952+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f12d80c6d30 con 0x7f12d80cb400 2023-08-09T12:47:26.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.958+0000 7f12d5ffb640 1 -- 172.21.15.17:0/3940030566 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f12d80c6d30 con 0x7f12d80cb400 2023-08-09T12:47:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.960+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12c406a050 msgr2=0x7f12c406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.960+0000 7f12de734640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12c406a050 0x7f12c406c510 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f12c8036000 tx=0x7f12c802e000 comp rx=0 tx=0).stop 2023-08-09T12:47:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.960+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d80cb400 msgr2=0x7f12d80cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.960+0000 7f12de734640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d80cb400 0x7f12d80cb880 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f12d0000fb0 tx=0x7f12d000d890 comp rx=0 tx=0).stop 2023-08-09T12:47:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.961+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 shutdown_connections 2023-08-09T12:47:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.961+0000 7f12de734640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f12c406a050 0x7f12c406c510 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.961+0000 7f12de734640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d80cb400 0x7f12d80cb880 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.961+0000 7f12de734640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12d814a160 0x7f12d8147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.961+0000 7f12de734640 1 --2- 172.21.15.17:0/3940030566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12c0003970 0x7f12d8143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.961+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 >> 172.21.15.17:0/3940030566 conn(0x7f12d80cb020 msgr2=0x7f12d8156cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.961+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 shutdown_connections 2023-08-09T12:47:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:26.961+0000 7f12de734640 1 -- 172.21.15.17:0/3940030566 wait complete. 2023-08-09T12:47:26.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-08-09T12:47:27.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.215+0000 7f8e8d05e640 1 Processor -- start 2023-08-09T12:47:27.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.215+0000 7f8e8d05e640 1 -- start start 2023-08-09T12:47:27.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.217+0000 7f8e8d05e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e88164f50 0x7f8e880cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:27.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.217+0000 7f8e8d05e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e88162650 0x7f8e88165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:27.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.217+0000 7f8e8d05e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e880cd520 con 0x7f8e880c1980 2023-08-09T12:47:27.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.217+0000 7f8e8d05e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e880cc630 con 0x7f8e88162650 2023-08-09T12:47:27.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.217+0000 7f8e8d05e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e880cc910 con 0x7f8e88164f50 2023-08-09T12:47:27.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.217+0000 7f8e8759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e88162650 0x7f8e88165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:27.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.217+0000 7f8e8759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e88162650 0x7f8e88165a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45190/0 (socket says 172.21.15.17:45190) 2023-08-09T12:47:27.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.217+0000 7f8e8759e640 1 -- 172.21.15.17:0/2351209365 learned_addr learned my addr 172.21.15.17:0/2351209365 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:27.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.218+0000 7f8e86d9d640 1 --2- 172.21.15.17:0/2351209365 >> v2:172.21.15.142:3300/0 conn(0x7f8e88164f50 0x7f8e880cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:27.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.218+0000 7f8e8759e640 1 -- 172.21.15.17:0/2351209365 >> v2:172.21.15.142:3300/0 conn(0x7f8e88164f50 msgr2=0x7f8e880cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:27.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.218+0000 7f8e8759e640 1 --2- 172.21.15.17:0/2351209365 >> v2:172.21.15.142:3300/0 conn(0x7f8e88164f50 0x7f8e880cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:27.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.218+0000 7f8e8759e640 1 -- 172.21.15.17:0/2351209365 >> v1:172.21.15.142:6789/0 conn(0x7f8e880c1980 legacy=0x7f8e88165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:27.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.218+0000 7f8e8759e640 1 -- 172.21.15.17:0/2351209365 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880ccbf0 con 0x7f8e88162650 2023-08-09T12:47:27.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.219+0000 7f8e8759e640 1 --2- 172.21.15.17:0/2351209365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e88162650 0x7f8e88165a40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ce4b0 tx=0x7f8e8002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6def4f9d3cec1364 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:27.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.219+0000 7f8e85d9b640 1 -- 172.21.15.17:0/2351209365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80031870 con 0x7f8e88162650 2023-08-09T12:47:27.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e85d9b640 1 -- 172.21.15.17:0/2351209365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e800319d0 con 0x7f8e88162650 2023-08-09T12:47:27.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e85d9b640 1 -- 172.21.15.17:0/2351209365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80031d60 con 0x7f8e88162650 2023-08-09T12:47:27.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e8d05e640 1 -- 172.21.15.17:0/2351209365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e88162650 msgr2=0x7f8e88165a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:27.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/2351209365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e88162650 0x7f8e88165a40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ce4b0 tx=0x7f8e8002b910 comp rx=0 tx=0).stop 2023-08-09T12:47:27.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e8d05e640 1 -- 172.21.15.17:0/2351209365 shutdown_connections 2023-08-09T12:47:27.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/2351209365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e88162650 0x7f8e88165a40 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:27.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/2351209365 >> v2:172.21.15.142:3300/0 conn(0x7f8e88164f50 0x7f8e880cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:27.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e8d05e640 1 -- 172.21.15.17:0/2351209365 >> 172.21.15.17:0/2351209365 conn(0x7f8e880cb1b0 msgr2=0x7f8e880cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:27.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.220+0000 7f8e8d05e640 1 -- 172.21.15.17:0/2351209365 shutdown_connections 2023-08-09T12:47:27.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.221+0000 7f8e8d05e640 1 -- 172.21.15.17:0/2351209365 wait complete. 2023-08-09T12:47:27.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.222+0000 7f8e8d05e640 1 Processor -- start 2023-08-09T12:47:27.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.223+0000 7f8e8d05e640 1 -- start start 2023-08-09T12:47:27.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.223+0000 7f8e8d05e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e880c1980 0x7f8e880c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:27.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e8d05e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e88162650 0x7f8e881f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:27.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e8d05e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e88164f50 0x7f8e881f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e8d05e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880c72b0 con 0x7f8e880c1980 2023-08-09T12:47:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e8d05e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880c66e0 con 0x7f8e88162650 2023-08-09T12:47:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e8d05e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880c6980 con 0x7f8e88164f50 2023-08-09T12:47:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e86d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e880c1980 0x7f8e880c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e86d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e880c1980 0x7f8e880c21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45192/0 (socket says 172.21.15.17:45192) 2023-08-09T12:47:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e86d9d640 1 -- 172.21.15.17:0/3220296108 learned_addr learned my addr 172.21.15.17:0/3220296108 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e86d9d640 1 -- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e88164f50 msgr2=0x7f8e881f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e86d9d640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e88164f50 0x7f8e881f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e86d9d640 1 -- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e88162650 msgr2=0x7f8e881f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e86d9d640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e88162650 0x7f8e881f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.224+0000 7f8e86d9d640 1 -- 172.21.15.17:0/3220296108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800094d0 con 0x7f8e880c1980 2023-08-09T12:47:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.225+0000 7f8e86d9d640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e880c1980 0x7f8e880c21d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f8e78007ef0 tx=0x7f8e7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.225+0000 7f8e7f7fe640 1 -- 172.21.15.17:0/3220296108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78014620 con 0x7f8e880c1980 2023-08-09T12:47:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.225+0000 7f8e7f7fe640 1 -- 172.21.15.17:0/3220296108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e78014780 con 0x7f8e880c1980 2023-08-09T12:47:27.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.225+0000 7f8e7f7fe640 1 -- 172.21.15.17:0/3220296108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78014b10 con 0x7f8e880c1980 2023-08-09T12:47:27.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.225+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e880c6c60 con 0x7f8e880c1980 2023-08-09T12:47:27.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.225+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e880c2710 con 0x7f8e880c1980 2023-08-09T12:47:27.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.226+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e88067a80 con 0x7f8e880c1980 2023-08-09T12:47:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.227+0000 7f8e7f7fe640 1 -- 172.21.15.17:0/3220296108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e78014c70 con 0x7f8e880c1980 2023-08-09T12:47:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.228+0000 7f8e7f7fe640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6806a050 0x7f8e6806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.228+0000 7f8e7f7fe640 1 -- 172.21.15.17:0/3220296108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8e78088d40 con 0x7f8e880c1980 2023-08-09T12:47:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.229+0000 7f8e8659c640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6806a050 0x7f8e6806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.230+0000 7f8e8659c640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6806a050 0x7f8e6806c510 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8e881fa1f0 tx=0x7f8e70006bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:27.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.233+0000 7f8e7f7fe640 1 -- 172.21.15.17:0/3220296108 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8e780546b0 con 0x7f8e880c1980 2023-08-09T12:47:27.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:27.497+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f8e880b46b0 con 0x7f8e880c1980 2023-08-09T12:47:28.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.506+0000 7f8e7f7fe640 1 -- 172.21.15.17:0/3220296108 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v426) v1 ==== 128+0+0 (secure 0 0 0) 0x7f8e78057cd0 con 0x7f8e880c1980 2023-08-09T12:47:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6806a050 msgr2=0x7f8e6806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6806a050 0x7f8e6806c510 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8e881fa1f0 tx=0x7f8e70006bb0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e880c1980 msgr2=0x7f8e880c21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e880c1980 0x7f8e880c21d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f8e78007ef0 tx=0x7f8e7800e4b0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 shutdown_connections 2023-08-09T12:47:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e6806a050 0x7f8e6806c510 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e88164f50 0x7f8e881f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e88162650 0x7f8e881f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 --2- 172.21.15.17:0/3220296108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e880c1980 0x7f8e880c21d0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 >> 172.21.15.17:0/3220296108 conn(0x7f8e880cb1b0 msgr2=0x7f8e88162b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:28.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 shutdown_connections 2023-08-09T12:47:28.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.510+0000 7f8e8d05e640 1 -- 172.21.15.17:0/3220296108 wait complete. 2023-08-09T12:47:28.532 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-09T12:47:28.533 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-08-09T12:47:28.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-08-09T12:47:28.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.757+0000 7f7546186640 1 Processor -- start 2023-08-09T12:47:28.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.757+0000 7f7546186640 1 -- start start 2023-08-09T12:47:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7546186640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400cb3b0 0x7f75400c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7546186640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75400b34a0 con 0x7f75400caf00 2023-08-09T12:47:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7546186640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75400b3780 con 0x7f75401601f0 2023-08-09T12:47:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7546186640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75400b4120 con 0x7f75400cb3b0 2023-08-09T12:47:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7544983640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f75400caf00 0x7f75400c2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49314/0 (socket says 172.21.15.17:49314) 2023-08-09T12:47:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7544983640 1 -- 172.21.15.17:0/3220378594 learned_addr learned my addr 172.21.15.17:0/3220378594 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:28.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673148730 0 0) 0x7f75400b34a0 con 0x7f75400caf00 2023-08-09T12:47:28.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f752c003520 con 0x7f75400caf00 2023-08-09T12:47:28.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.759+0000 7f7545985640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400cb3b0 0x7f75400c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1895577823 0 0) 0x7f752c003520 con 0x7f75400caf00 2023-08-09T12:47:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400cb3b0 msgr2=0x7f75400c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75400cb3b0 0x7f75400c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 >> v1:172.21.15.142:6789/0 conn(0x7f75401601f0 legacy=0x7f75400b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400b3a60 con 0x7f75400caf00 2023-08-09T12:47:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f7530001670 con 0x7f75400caf00 2023-08-09T12:47:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 >> v1:172.21.15.17:6789/0 conn(0x7f75400caf00 legacy=0x7f75400c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f752c0039a0 0x7f752c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c0047c0 0x7f752c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752c005180 0x7f752c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400b4120 con 0x7f752c005180 2023-08-09T12:47:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c00c050 con 0x7f752c0047c0 2023-08-09T12:47:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c00c210 con 0x7f752c0039a0 2023-08-09T12:47:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.760+0000 7f7545985640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752c005180 0x7f752c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.761+0000 7f7545184640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f752c0039a0 0x7f752c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.761+0000 7f7544983640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c0047c0 0x7f752c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.761+0000 7f7545985640 1 -- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f752c0039a0 msgr2=0x7f752c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.761+0000 7f7545985640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f752c0039a0 0x7f752c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.761+0000 7f7545985640 1 -- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c0047c0 msgr2=0x7f752c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.761+0000 7f7545985640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f752c0047c0 0x7f752c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.761+0000 7f7545985640 1 -- 172.21.15.17:0/3220378594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c003520 con 0x7f752c005180 2023-08-09T12:47:28.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.762+0000 7f7545985640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752c005180 0x7f752c00b980 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7538009ed0 tx=0x7f752c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abefa244d350f480 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:28.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.762+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753802cb90 con 0x7f752c005180 2023-08-09T12:47:28.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.762+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753802ccf0 con 0x7f752c005180 2023-08-09T12:47:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.762+0000 7f7537fff640 1 -- 172.21.15.17:0/3220378594 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538034660 con 0x7f752c005180 2023-08-09T12:47:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.763+0000 7f7546186640 1 -- 172.21.15.17:0/3220378594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752c005180 msgr2=0x7f752c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.763+0000 7f7546186640 1 --2- 172.21.15.17:0/3220378594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752c005180 0x7f752c00b980 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7538009ed0 tx=0x7f752c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.763+0000 7f7545985640 1 -- 172.21.15.17:0/3220378594 reap_dead start 2023-08-09T12:47:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.763+0000 7f7546186640 1 -- 172.21.15.17:0/3220378594 shutdown_connections 2023-08-09T12:47:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.763+0000 7f7546186640 1 -- 172.21.15.17:0/3220378594 >> 172.21.15.17:0/3220378594 conn(0x7f75400b1d50 msgr2=0x7f754006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.763+0000 7f7546186640 1 -- 172.21.15.17:0/3220378594 shutdown_connections 2023-08-09T12:47:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.763+0000 7f7546186640 1 -- 172.21.15.17:0/3220378594 wait complete. 2023-08-09T12:47:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.765+0000 7f7546186640 1 Processor -- start 2023-08-09T12:47:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.765+0000 7f7546186640 1 -- start start 2023-08-09T12:47:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7546186640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f752c005180 0x7f75401f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7546186640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75401f5ca0 0x7f754015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7546186640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7540159190 0x7f7540159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:28.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7546186640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7540159b50 con 0x7f75401f5ca0 2023-08-09T12:47:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7546186640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7540156cf0 con 0x7f7540159190 2023-08-09T12:47:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7546186640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754015bb10 con 0x7f752c005180 2023-08-09T12:47:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7544983640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75401f5ca0 0x7f754015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7544983640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75401f5ca0 0x7f754015b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49252/0 (socket says 172.21.15.17:49252) 2023-08-09T12:47:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.766+0000 7f7544983640 1 -- 172.21.15.17:0/42247324 learned_addr learned my addr 172.21.15.17:0/42247324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:28.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7544983640 1 -- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f752c005180 msgr2=0x7f75401f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:28.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7544983640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f752c005180 0x7f75401f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7544983640 1 -- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7540159190 msgr2=0x7f7540159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:28.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7545985640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7540159190 0x7f7540159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:28.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7544983640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7540159190 0x7f7540159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:28.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7544983640 1 -- 172.21.15.17:0/42247324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754015bdf0 con 0x7f75401f5ca0 2023-08-09T12:47:28.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7544983640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75401f5ca0 0x7f754015b1c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7530001200 tx=0x7f753000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:28.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7535ffb640 1 -- 172.21.15.17:0/42247324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000c8d0 con 0x7f75401f5ca0 2023-08-09T12:47:28.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7535ffb640 1 -- 172.21.15.17:0/42247324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000ca30 con 0x7f75401f5ca0 2023-08-09T12:47:28.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7535ffb640 1 -- 172.21.15.17:0/42247324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000cde0 con 0x7f75401f5ca0 2023-08-09T12:47:28.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.767+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754015c0d0 con 0x7f75401f5ca0 2023-08-09T12:47:28.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.768+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75401f6a80 con 0x7f75401f5ca0 2023-08-09T12:47:28.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.769+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75401f6c40 con 0x7f75401f5ca0 2023-08-09T12:47:28.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.769+0000 7f7535ffb640 1 -- 172.21.15.17:0/42247324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f753001d460 con 0x7f75401f5ca0 2023-08-09T12:47:28.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.770+0000 7f7535ffb640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f752406a050 0x7f752406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:28.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.770+0000 7f7535ffb640 1 -- 172.21.15.17:0/42247324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7530088370 con 0x7f75401f5ca0 2023-08-09T12:47:28.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.771+0000 7f7545184640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f752406a050 0x7f752406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:28.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.772+0000 7f7545184640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f752406a050 0x7f752406c510 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f753c007fd0 tx=0x7f753c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:28.775+0000 7f7535ffb640 1 -- 172.21.15.17:0/42247324 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7530053ce0 con 0x7f75401f5ca0 2023-08-09T12:47:29.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.038+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f754004e390 con 0x7f75401f5ca0 2023-08-09T12:47:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.510+0000 7f7535ffb640 1 -- 172.21.15.17:0/42247324 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v427) v1 ==== 143+0+0 (secure 0 0 0) 0x7f7530057300 con 0x7f75401f5ca0 2023-08-09T12:47:29.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f752406a050 msgr2=0x7f752406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f752406a050 0x7f752406c510 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f753c007fd0 tx=0x7f753c009040 comp rx=0 tx=0).stop 2023-08-09T12:47:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75401f5ca0 msgr2=0x7f754015b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75401f5ca0 0x7f754015b1c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7530001200 tx=0x7f753000ec80 comp rx=0 tx=0).stop 2023-08-09T12:47:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 shutdown_connections 2023-08-09T12:47:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f752406a050 0x7f752406c510 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7540159190 0x7f7540159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75401f5ca0 0x7f754015b1c0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 --2- 172.21.15.17:0/42247324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f752c005180 0x7f75401f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.513+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 >> 172.21.15.17:0/42247324 conn(0x7f75400b1d50 msgr2=0x7f75400b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:29.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.514+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 shutdown_connections 2023-08-09T12:47:29.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.514+0000 7f7546186640 1 -- 172.21.15.17:0/42247324 wait complete. 2023-08-09T12:47:29.539 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:29.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.769+0000 7f034c29b640 1 Processor -- start 2023-08-09T12:47:29.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.769+0000 7f034c29b640 1 -- start start 2023-08-09T12:47:29.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.771+0000 7f034c29b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03440c1980 0x7f0344165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:29.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.771+0000 7f034c29b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03440cd520 con 0x7f0344164f50 2023-08-09T12:47:29.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.771+0000 7f034c29b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03440cc630 con 0x7f0344162650 2023-08-09T12:47:29.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.771+0000 7f034c29b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03440cc910 con 0x7f03440c1980 2023-08-09T12:47:29.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.771+0000 7f034a037640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0344164f50 0x7f03440cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49324/0 (socket says 172.21.15.17:49324) 2023-08-09T12:47:29.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.771+0000 7f034a037640 1 -- 172.21.15.17:0/3640489283 learned_addr learned my addr 172.21.15.17:0/3640489283 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f034a838640 1 --2- 172.21.15.17:0/3640489283 >> v2:172.21.15.142:3300/0 conn(0x7f03440c1980 0x7f0344165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225217978 0 0) 0x7f03440cd520 con 0x7f0344164f50 2023-08-09T12:47:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0330003520 con 0x7f0344164f50 2023-08-09T12:47:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1122167499 0 0) 0x7f0330003520 con 0x7f0344164f50 2023-08-09T12:47:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 >> v2:172.21.15.142:3300/0 conn(0x7f03440c1980 msgr2=0x7f0344165a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 --2- 172.21.15.17:0/3640489283 >> v2:172.21.15.142:3300/0 conn(0x7f03440c1980 0x7f0344165a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 >> v1:172.21.15.142:6789/0 conn(0x7f0344162650 legacy=0x7f0344165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440ccbf0 con 0x7f0344164f50 2023-08-09T12:47:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0340001670 con 0x7f0344164f50 2023-08-09T12:47:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 >> v1:172.21.15.17:6789/0 conn(0x7f0344164f50 legacy=0x7f03440cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0330003970 0x7f0330003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03300047c0 0x7f0330004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0330005180 0x7f033000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440cc910 con 0x7f0330005180 2023-08-09T12:47:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033000c020 con 0x7f03300047c0 2023-08-09T12:47:29.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.772+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033000c1e0 con 0x7f0330003970 2023-08-09T12:47:29.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.773+0000 7f034a838640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0330005180 0x7f033000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:29.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.773+0000 7f0349836640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03300047c0 0x7f0330004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:29.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.773+0000 7f034a037640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0330003970 0x7f0330003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.773+0000 7f034a838640 1 -- 172.21.15.17:0/3640489283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0330003970 msgr2=0x7f0330003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.773+0000 7f034a838640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0330003970 0x7f0330003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.773+0000 7f034a838640 1 -- 172.21.15.17:0/3640489283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03300047c0 msgr2=0x7f0330004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.773+0000 7f034a838640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03300047c0 0x7f0330004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.773+0000 7f034a838640 1 -- 172.21.15.17:0/3640489283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0330003520 con 0x7f0330005180 2023-08-09T12:47:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.774+0000 7f034a838640 1 -- 172.21.15.17:0/3640489283 reap_dead start 2023-08-09T12:47:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.774+0000 7f034a838640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0330005180 0x7f033000b980 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f033c009fc0 tx=0x7f03300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cc328692e429bd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c02cc60 con 0x7f0330005180 2023-08-09T12:47:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00f040 con 0x7f0330005180 2023-08-09T12:47:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f0349035640 1 -- 172.21.15.17:0/3640489283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c003990 con 0x7f0330005180 2023-08-09T12:47:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f034c29b640 1 -- 172.21.15.17:0/3640489283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0330005180 msgr2=0x7f033000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f034c29b640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0330005180 0x7f033000b980 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f033c009fc0 tx=0x7f03300057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f034c29b640 1 -- 172.21.15.17:0/3640489283 shutdown_connections 2023-08-09T12:47:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f034c29b640 1 --2- 172.21.15.17:0/3640489283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0330005180 0x7f033000b980 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f034c29b640 1 -- 172.21.15.17:0/3640489283 >> 172.21.15.17:0/3640489283 conn(0x7f03440cb1b0 msgr2=0x7f03440cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:29.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f034c29b640 1 -- 172.21.15.17:0/3640489283 shutdown_connections 2023-08-09T12:47:29.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.775+0000 7f034c29b640 1 -- 172.21.15.17:0/3640489283 wait complete. 2023-08-09T12:47:29.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.777+0000 7f034c29b640 1 Processor -- start 2023-08-09T12:47:29.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.777+0000 7f034c29b640 1 -- start start 2023-08-09T12:47:29.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.778+0000 7f034c29b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0330005180 0x7f034415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:29.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.778+0000 7f034c29b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03441600b0 0x7f034406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:29.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.778+0000 7f034c29b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344069a30 0x7f0344159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:29.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.778+0000 7f034c29b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03441f6d80 con 0x7f0344069a30 2023-08-09T12:47:29.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.778+0000 7f034c29b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034406b930 con 0x7f0330005180 2023-08-09T12:47:29.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.778+0000 7f034c29b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034406a610 con 0x7f03441600b0 2023-08-09T12:47:29.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a838640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344069a30 0x7f0344159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:29.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a838640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344069a30 0x7f0344159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49270/0 (socket says 172.21.15.17:49270) 2023-08-09T12:47:29.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a838640 1 -- 172.21.15.17:0/2450300631 learned_addr learned my addr 172.21.15.17:0/2450300631 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:29.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a037640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0330005180 0x7f034415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:29.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f0349836640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03441600b0 0x7f034406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:29.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a838640 1 -- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03441600b0 msgr2=0x7f034406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a838640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03441600b0 0x7f034406b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a838640 1 -- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0330005180 msgr2=0x7f034415ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a838640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0330005180 0x7f034415ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.779+0000 7f034a838640 1 -- 172.21.15.17:0/2450300631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034415a0d0 con 0x7f0344069a30 2023-08-09T12:47:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.780+0000 7f034a838640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344069a30 0x7f0344159390 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f033c00e200 tx=0x7f033c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.780+0000 7f033affd640 1 -- 172.21.15.17:0/2450300631 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c035df0 con 0x7f0344069a30 2023-08-09T12:47:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.780+0000 7f033affd640 1 -- 172.21.15.17:0/2450300631 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c003990 con 0x7f0344069a30 2023-08-09T12:47:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.780+0000 7f033affd640 1 -- 172.21.15.17:0/2450300631 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c003d40 con 0x7f0344069a30 2023-08-09T12:47:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.780+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034415a3b0 con 0x7f0344069a30 2023-08-09T12:47:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.780+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034415a970 con 0x7f0344069a30 2023-08-09T12:47:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.781+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03440cdd40 con 0x7f0344069a30 2023-08-09T12:47:29.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.782+0000 7f033affd640 1 -- 172.21.15.17:0/2450300631 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f033c004030 con 0x7f0344069a30 2023-08-09T12:47:29.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.783+0000 7f033affd640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f032806a050 0x7f032806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.783+0000 7f033affd640 1 -- 172.21.15.17:0/2450300631 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f033c0aaf10 con 0x7f0344069a30 2023-08-09T12:47:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.784+0000 7f034a037640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f032806a050 0x7f032806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.785+0000 7f034a037640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f032806a050 0x7f032806c510 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0340001050 tx=0x7f0340009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.788+0000 7f033affd640 1 -- 172.21.15.17:0/2450300631 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f033c076910 con 0x7f0344069a30 2023-08-09T12:47:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.984+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0344067a80 con 0x7f0344069a30 2023-08-09T12:47:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.986+0000 7f033affd640 1 -- 172.21.15.17:0/2450300631 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+14756 (secure 0 0 0) 0x7f033c079f30 con 0x7f0344069a30 2023-08-09T12:47:29.990 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:29.990 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":138,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:26.470330+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/1719182807":"2023-08-10T12:47:23.451942+0000","172.21.15.17:6833/1719182807":"2023-08-10T12:47:23.451942+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:29.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f032806a050 msgr2=0x7f032806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f032806a050 0x7f032806c510 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0340001050 tx=0x7f0340009040 comp rx=0 tx=0).stop 2023-08-09T12:47:29.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344069a30 msgr2=0x7f0344159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:29.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344069a30 0x7f0344159390 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f033c00e200 tx=0x7f033c009750 comp rx=0 tx=0).stop 2023-08-09T12:47:29.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 shutdown_connections 2023-08-09T12:47:29.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f032806a050 0x7f032806c510 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344069a30 0x7f0344159390 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03441600b0 0x7f034406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 --2- 172.21.15.17:0/2450300631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0330005180 0x7f034415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:29.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 >> 172.21.15.17:0/2450300631 conn(0x7f03440cb1b0 msgr2=0x7f03440b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:29.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 shutdown_connections 2023-08-09T12:47:29.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:29.989+0000 7f034c29b640 1 -- 172.21.15.17:0/2450300631 wait complete. 2023-08-09T12:47:30.013 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:47:30.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:47:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.246+0000 7f6ac9a78640 1 Processor -- start 2023-08-09T12:47:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.246+0000 7f6ac9a78640 1 -- start start 2023-08-09T12:47:30.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.248+0000 7f6ac9a78640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ac40b3d60 0x7f6ac40cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.248+0000 7f6ac9a78640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac40b2b90 con 0x7f6ac40cc6b0 2023-08-09T12:47:30.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.248+0000 7f6ac9a78640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac40b2580 con 0x7f6ac4159bd0 2023-08-09T12:47:30.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.248+0000 7f6ac9a78640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac40cabb0 con 0x7f6ac40b3d60 2023-08-09T12:47:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.248+0000 7f6ac9277640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6ac40cc6b0 0x7f6ac40b3020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49330/0 (socket says 172.21.15.17:49330) 2023-08-09T12:47:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.248+0000 7f6ac9277640 1 -- 172.21.15.17:0/3135862724 learned_addr learned my addr 172.21.15.17:0/3135862724 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abbfff640 1 --2- 172.21.15.17:0/3135862724 >> v2:172.21.15.142:3300/0 conn(0x7f6ac40b3d60 0x7f6ac40cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54660016 0 0) 0x7f6ac40b2b90 con 0x7f6ac40cc6b0 2023-08-09T12:47:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aac003520 con 0x7f6ac40cc6b0 2023-08-09T12:47:30.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3898681695 0 0) 0x7f6aac003520 con 0x7f6ac40cc6b0 2023-08-09T12:47:30.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 >> v2:172.21.15.142:3300/0 conn(0x7f6ac40b3d60 msgr2=0x7f6ac40cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:30.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 --2- 172.21.15.17:0/3135862724 >> v2:172.21.15.142:3300/0 conn(0x7f6ac40b3d60 0x7f6ac40cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 >> v1:172.21.15.142:6789/0 conn(0x7f6ac4159bd0 legacy=0x7f6ac40c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40ca5f0 con 0x7f6ac40cc6b0 2023-08-09T12:47:30.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f6abc0019f0 con 0x7f6ac40cc6b0 2023-08-09T12:47:30.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 >> v1:172.21.15.17:6789/0 conn(0x7f6ac40cc6b0 legacy=0x7f6ac40b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6aac003970 0x7f6aac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac0047c0 0x7f6aac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.249+0000 7f6abb7fe640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6aac005180 0x7f6aac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac40cabb0 con 0x7f6aac005180 2023-08-09T12:47:30.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac00c020 con 0x7f6aac0047c0 2023-08-09T12:47:30.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac00c1e0 con 0x7f6aac003970 2023-08-09T12:47:30.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6ac9277640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6aac005180 0x7f6aac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6ac8a76640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6aac003970 0x7f6aac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6abbfff640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac0047c0 0x7f6aac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6ac9277640 1 -- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6aac003970 msgr2=0x7f6aac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:30.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6ac9277640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6aac003970 0x7f6aac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6ac9277640 1 -- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac0047c0 msgr2=0x7f6aac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6ac9277640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac0047c0 0x7f6aac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6ac9277640 1 -- 172.21.15.17:0/3135862724 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac003520 con 0x7f6aac005180 2023-08-09T12:47:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.250+0000 7f6abbfff640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac0047c0 0x7f6aac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.251+0000 7f6ac9277640 1 -- 172.21.15.17:0/3135862724 reap_dead start 2023-08-09T12:47:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.251+0000 7f6ac9277640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6aac005180 0x7f6aac00b980 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f6ac406e890 tx=0x7f6aac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51da91a101b4d619 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.252+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc0072d0 con 0x7f6aac005180 2023-08-09T12:47:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.252+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc007430 con 0x7f6aac005180 2023-08-09T12:47:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.252+0000 7f6abb7fe640 1 -- 172.21.15.17:0/3135862724 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc0077e0 con 0x7f6aac005180 2023-08-09T12:47:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.252+0000 7f6ac9a78640 1 -- 172.21.15.17:0/3135862724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6aac005180 msgr2=0x7f6aac00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.252+0000 7f6ac9a78640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6aac005180 0x7f6aac00b980 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f6ac406e890 tx=0x7f6aac0057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.252+0000 7f6ac9a78640 1 -- 172.21.15.17:0/3135862724 shutdown_connections 2023-08-09T12:47:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.252+0000 7f6ac9a78640 1 --2- 172.21.15.17:0/3135862724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6aac005180 0x7f6aac00b980 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.252+0000 7f6ac9a78640 1 -- 172.21.15.17:0/3135862724 >> 172.21.15.17:0/3135862724 conn(0x7f6ac40cb020 msgr2=0x7f6ac40cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.253+0000 7f6ac9a78640 1 -- 172.21.15.17:0/3135862724 shutdown_connections 2023-08-09T12:47:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.253+0000 7f6ac9a78640 1 -- 172.21.15.17:0/3135862724 wait complete. 2023-08-09T12:47:30.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.255+0000 7f6ac9a78640 1 Processor -- start 2023-08-09T12:47:30.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.255+0000 7f6ac9a78640 1 -- start start 2023-08-09T12:47:30.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9a78640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac005180 0x7f6ac4152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9a78640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ac40c6170 0x7f6ac406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9a78640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40b2e70 0x7f6ac40b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9a78640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac4152b50 con 0x7f6ac40b2e70 2023-08-09T12:47:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9a78640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac40b3830 con 0x7f6aac005180 2023-08-09T12:47:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9a78640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac406f7b0 con 0x7f6ac40c6170 2023-08-09T12:47:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9277640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40b2e70 0x7f6ac40b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9277640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40b2e70 0x7f6ac40b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49284/0 (socket says 172.21.15.17:49284) 2023-08-09T12:47:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9277640 1 -- 172.21.15.17:0/845641747 learned_addr learned my addr 172.21.15.17:0/845641747 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:30.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6abbfff640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ac40c6170 0x7f6ac406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9277640 1 -- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ac40c6170 msgr2=0x7f6ac406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac8a76640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac005180 0x7f6ac4152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9277640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ac40c6170 0x7f6ac406ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9277640 1 -- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac005180 msgr2=0x7f6ac4152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9277640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac005180 0x7f6ac4152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.256+0000 7f6ac9277640 1 -- 172.21.15.17:0/845641747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4153140 con 0x7f6ac40b2e70 2023-08-09T12:47:30.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.257+0000 7f6ac9277640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40b2e70 0x7f6ac40b32f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00a8c0 tx=0x7f6abc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:30.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.257+0000 7f6ab97fa640 1 -- 172.21.15.17:0/845641747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc045070 con 0x7f6ac40b2e70 2023-08-09T12:47:30.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.257+0000 7f6ab97fa640 1 -- 172.21.15.17:0/845641747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc001b60 con 0x7f6ac40b2e70 2023-08-09T12:47:30.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.257+0000 7f6ab97fa640 1 -- 172.21.15.17:0/845641747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00f1d0 con 0x7f6ac40b2e70 2023-08-09T12:47:30.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.257+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac4153420 con 0x7f6ac40b2e70 2023-08-09T12:47:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.257+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac41539e0 con 0x7f6ac40b2e70 2023-08-09T12:47:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.259+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac404e390 con 0x7f6ac40b2e70 2023-08-09T12:47:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.259+0000 7f6ab97fa640 1 -- 172.21.15.17:0/845641747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6abc0077b0 con 0x7f6ac40b2e70 2023-08-09T12:47:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.261+0000 7f6ab97fa640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ab006a050 0x7f6ab006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.261+0000 7f6ab97fa640 1 -- 172.21.15.17:0/845641747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6abc0a9cb0 con 0x7f6ac40b2e70 2023-08-09T12:47:30.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.262+0000 7f6ac8a76640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ab006a050 0x7f6ab006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.263+0000 7f6ac8a76640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ab006a050 0x7f6ab006c510 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0007fd0 tx=0x7f6ac0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:30.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.265+0000 7f6ab97fa640 1 -- 172.21.15.17:0/845641747 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6abc075740 con 0x7f6ac40b2e70 2023-08-09T12:47:30.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.461+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ac40cf250 con 0x7f6ac40b2e70 2023-08-09T12:47:30.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.462+0000 7f6ab97fa640 1 -- 172.21.15.17:0/845641747 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v138) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6abc078d60 con 0x7f6ac40b2e70 2023-08-09T12:47:30.465 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:47:30.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ab006a050 msgr2=0x7f6ab006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ab006a050 0x7f6ab006c510 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0007fd0 tx=0x7f6ac0009040 comp rx=0 tx=0).stop 2023-08-09T12:47:30.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40b2e70 msgr2=0x7f6ac40b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40b2e70 0x7f6ac40b32f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00a8c0 tx=0x7f6abc001d80 comp rx=0 tx=0).stop 2023-08-09T12:47:30.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 shutdown_connections 2023-08-09T12:47:30.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ab006a050 0x7f6ab006c510 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40b2e70 0x7f6ac40b32f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ac40c6170 0x7f6ac406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 --2- 172.21.15.17:0/845641747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aac005180 0x7f6ac4152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 >> 172.21.15.17:0/845641747 conn(0x7f6ac40cb020 msgr2=0x7f6ac4157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:30.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 shutdown_connections 2023-08-09T12:47:30.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.464+0000 7f6ac9a78640 1 -- 172.21.15.17:0/845641747 wait complete. 2023-08-09T12:47:30.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:47:30.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.716+0000 7f0d5f59e640 1 Processor -- start 2023-08-09T12:47:30.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.716+0000 7f0d5f59e640 1 -- start start 2023-08-09T12:47:30.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.718+0000 7f0d5f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d600ccfe0 0x7f0d600700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.718+0000 7f0d5f59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600cd7c0 con 0x7f0d60070600 2023-08-09T12:47:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.718+0000 7f0d5f59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600cd4e0 con 0x7f0d600b8060 2023-08-09T12:47:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.718+0000 7f0d5f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60070a70 con 0x7f0d600ccfe0 2023-08-09T12:47:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.719+0000 7f0d5ed9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0d60070600 0x7f0d60164aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49332/0 (socket says 172.21.15.17:49332) 2023-08-09T12:47:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.719+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/89940047 learned_addr learned my addr 172.21.15.17:0/89940047 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.719+0000 7f0d55d9b640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d600ccfe0 0x7f0d600700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.719+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624558744 0 0) 0x7f0d58001110 con 0x7f0d60070600 2023-08-09T12:47:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.719+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d4c003520 con 0x7f0d60070600 2023-08-09T12:47:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2640004073 0 0) 0x7f0d4c003520 con 0x7f0d60070600 2023-08-09T12:47:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d600ccfe0 msgr2=0x7f0d600700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d600ccfe0 0x7f0d600700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 >> v1:172.21.15.142:6789/0 conn(0x7f0d600b8060 legacy=0x7f0d600b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60069960 con 0x7f0d60070600 2023-08-09T12:47:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0d58001800 con 0x7f0d60070600 2023-08-09T12:47:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 >> v1:172.21.15.17:6789/0 conn(0x7f0d60070600 legacy=0x7f0d60164aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d600ccfe0 0x7f0d4c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4c003f20 0x7f0d4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d4c004d00 0x7f0d4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60070a70 con 0x7f0d4c004d00 2023-08-09T12:47:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c00bb10 con 0x7f0d4c003f20 2023-08-09T12:47:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c00bcd0 con 0x7f0d600ccfe0 2023-08-09T12:47:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5ed9d640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d4c004d00 0x7f0d4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d55d9b640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4c003f20 0x7f0d4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.720+0000 7f0d5e59c640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d600ccfe0 0x7f0d4c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.721+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d600ccfe0 msgr2=0x7f0d4c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.721+0000 7f0d5ed9d640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d600ccfe0 0x7f0d4c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.721+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4c003f20 msgr2=0x7f0d4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.721+0000 7f0d5ed9d640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4c003f20 0x7f0d4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.721+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/89940047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c003520 con 0x7f0d4c004d00 2023-08-09T12:47:30.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.722+0000 7f0d5ed9d640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d4c004d00 0x7f0d4c005180 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800c240 tx=0x7f0d4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e84ad11f6ee97c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:30.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.722+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58005ad0 con 0x7f0d4c004d00 2023-08-09T12:47:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.722+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58005c50 con 0x7f0d4c004d00 2023-08-09T12:47:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.722+0000 7f0d5dd9b640 1 -- 172.21.15.17:0/89940047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5802c8b0 con 0x7f0d4c004d00 2023-08-09T12:47:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.723+0000 7f0d5f59e640 1 -- 172.21.15.17:0/89940047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d4c004d00 msgr2=0x7f0d4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.723+0000 7f0d5f59e640 1 --2- 172.21.15.17:0/89940047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d4c004d00 0x7f0d4c005180 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800c240 tx=0x7f0d4c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.723+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/89940047 reap_dead start 2023-08-09T12:47:30.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.723+0000 7f0d5f59e640 1 -- 172.21.15.17:0/89940047 shutdown_connections 2023-08-09T12:47:30.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.723+0000 7f0d5f59e640 1 -- 172.21.15.17:0/89940047 >> 172.21.15.17:0/89940047 conn(0x7f0d600cf6b0 msgr2=0x7f0d600cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:30.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.723+0000 7f0d5f59e640 1 -- 172.21.15.17:0/89940047 shutdown_connections 2023-08-09T12:47:30.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.723+0000 7f0d5f59e640 1 -- 172.21.15.17:0/89940047 wait complete. 2023-08-09T12:47:30.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.725+0000 7f0d5f59e640 1 Processor -- start 2023-08-09T12:47:30.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.725+0000 7f0d5f59e640 1 -- start start 2023-08-09T12:47:30.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d4c004d00 0x7f0d6015d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5f59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6015e0d0 0x7f0d601f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5f59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d601f9d20 0x7f0d601fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5f59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601fa6e0 con 0x7f0d601f9d20 2023-08-09T12:47:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5f59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60157e60 con 0x7f0d6015e0d0 2023-08-09T12:47:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60161350 con 0x7f0d4c004d00 2023-08-09T12:47:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d601f9d20 0x7f0d601fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d601f9d20 0x7f0d601fa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49296/0 (socket says 172.21.15.17:49296) 2023-08-09T12:47:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/2939480443 learned_addr learned my addr 172.21.15.17:0/2939480443 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:30.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d5e59c640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d4c004d00 0x7f0d6015d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.726+0000 7f0d55d9b640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6015e0d0 0x7f0d601f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d4c004d00 msgr2=0x7f0d6015d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d5ed9d640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d4c004d00 0x7f0d6015d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6015e0d0 msgr2=0x7f0d601f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d5ed9d640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6015e0d0 0x7f0d601f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d5ed9d640 1 -- 172.21.15.17:0/2939480443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600cc5d0 con 0x7f0d601f9d20 2023-08-09T12:47:30.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d55d9b640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6015e0d0 0x7f0d601f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:30.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d5ed9d640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d601f9d20 0x7f0d601fa1a0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800c360 tx=0x7f0d5802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:30.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d577fe640 1 -- 172.21.15.17:0/2939480443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5803c040 con 0x7f0d601f9d20 2023-08-09T12:47:30.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d577fe640 1 -- 172.21.15.17:0/2939480443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5802ccc0 con 0x7f0d601f9d20 2023-08-09T12:47:30.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d577fe640 1 -- 172.21.15.17:0/2939480443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58007270 con 0x7f0d601f9d20 2023-08-09T12:47:30.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.727+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d600cc890 con 0x7f0d601f9d20 2023-08-09T12:47:30.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.728+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d600ccb70 con 0x7f0d601f9d20 2023-08-09T12:47:30.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.729+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60161510 con 0x7f0d601f9d20 2023-08-09T12:47:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.730+0000 7f0d577fe640 1 -- 172.21.15.17:0/2939480443 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0d58032070 con 0x7f0d601f9d20 2023-08-09T12:47:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.730+0000 7f0d577fe640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0d4006a050 0x7f0d4006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.731+0000 7f0d577fe640 1 -- 172.21.15.17:0/2939480443 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0d580a8d00 con 0x7f0d601f9d20 2023-08-09T12:47:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.731+0000 7f0d5e59c640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0d4006a050 0x7f0d4006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.732+0000 7f0d5e59c640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0d4006a050 0x7f0d4006c510 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0d50007fd0 tx=0x7f0d50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.735+0000 7f0d577fe640 1 -- 172.21.15.17:0/2939480443 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0d58074670 con 0x7f0d601f9d20 2023-08-09T12:47:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.925+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d600cd7c0 con 0x7f0d601f9d20 2023-08-09T12:47:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.926+0000 7f0d577fe640 1 -- 172.21.15.17:0/2939480443 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v138) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d600cd7c0 con 0x7f0d601f9d20 2023-08-09T12:47:30.929 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:47:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.928+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0d4006a050 msgr2=0x7f0d4006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.928+0000 7f0d5f59e640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0d4006a050 0x7f0d4006c510 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0d50007fd0 tx=0x7f0d50009040 comp rx=0 tx=0).stop 2023-08-09T12:47:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d601f9d20 msgr2=0x7f0d601fa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d601f9d20 0x7f0d601fa1a0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800c360 tx=0x7f0d5802e070 comp rx=0 tx=0).stop 2023-08-09T12:47:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 shutdown_connections 2023-08-09T12:47:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0d4006a050 0x7f0d4006c510 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d601f9d20 0x7f0d601fa1a0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d6015e0d0 0x7f0d601f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 --2- 172.21.15.17:0/2939480443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d4c004d00 0x7f0d6015d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 >> 172.21.15.17:0/2939480443 conn(0x7f0d600cf6b0 msgr2=0x7f0d600d1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 shutdown_connections 2023-08-09T12:47:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:30.929+0000 7f0d5f59e640 1 -- 172.21.15.17:0/2939480443 wait complete. 2023-08-09T12:47:30.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:47:31.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.166+0000 7fc9bd00d640 1 Processor -- start 2023-08-09T12:47:31.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.167+0000 7fc9bd00d640 1 -- start start 2023-08-09T12:47:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.168+0000 7fc9bd00d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b8158840 0x7fc9b80af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.168+0000 7fc9bd00d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9b80afce0 0x7fc9b80ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.168+0000 7fc9bd00d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b80b0220 con 0x7fc9b80cef20 2023-08-09T12:47:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9bd00d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b8158c20 con 0x7fc9b80afce0 2023-08-09T12:47:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9bd00d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80cf3b0 con 0x7fc9b8158840 2023-08-09T12:47:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9b659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9b80afce0 0x7fc9b80ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9b659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9b80afce0 0x7fc9b80ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49302/0 (socket says 172.21.15.17:49302) 2023-08-09T12:47:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9b659c640 1 -- 172.21.15.17:0/163283555 learned_addr learned my addr 172.21.15.17:0/163283555 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9b659c640 1 -- 172.21.15.17:0/163283555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b8158840 msgr2=0x7fc9b80af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9b6d9d640 1 --2- 172.21.15.17:0/163283555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b8158840 0x7fc9b80af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9b659c640 1 --2- 172.21.15.17:0/163283555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b8158840 0x7fc9b80af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9b659c640 1 -- 172.21.15.17:0/163283555 >> v1:172.21.15.142:6789/0 conn(0x7fc9b80cef20 legacy=0x7fc9b806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.169+0000 7fc9b659c640 1 -- 172.21.15.17:0/163283555 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b815e7f0 con 0x7fc9b80afce0 2023-08-09T12:47:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.171+0000 7fc9b659c640 1 --2- 172.21.15.17:0/163283555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80afce0 0x7fc9b80ce9e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009870 tx=0x7fc9ac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8604406aea33b4f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.171+0000 7fc9b5d9b640 1 -- 172.21.15.17:0/163283555 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac031640 con 0x7fc9b80afce0 2023-08-09T12:47:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.171+0000 7fc9b5d9b640 1 -- 172.21.15.17:0/163283555 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac0317a0 con 0x7fc9b80afce0 2023-08-09T12:47:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.171+0000 7fc9b5d9b640 1 -- 172.21.15.17:0/163283555 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac031b30 con 0x7fc9b80afce0 2023-08-09T12:47:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.172+0000 7fc9bd00d640 1 -- 172.21.15.17:0/163283555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80afce0 msgr2=0x7fc9b80ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.172+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/163283555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80afce0 0x7fc9b80ce9e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009870 tx=0x7fc9ac02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.172+0000 7fc9bd00d640 1 -- 172.21.15.17:0/163283555 shutdown_connections 2023-08-09T12:47:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.172+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/163283555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80afce0 0x7fc9b80ce9e0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.172+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/163283555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b8158840 0x7fc9b80af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.172+0000 7fc9bd00d640 1 -- 172.21.15.17:0/163283555 >> 172.21.15.17:0/163283555 conn(0x7fc9b8069be0 msgr2=0x7fc9b8069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:31.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.172+0000 7fc9bd00d640 1 -- 172.21.15.17:0/163283555 shutdown_connections 2023-08-09T12:47:31.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.172+0000 7fc9bd00d640 1 -- 172.21.15.17:0/163283555 wait complete. 2023-08-09T12:47:31.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.174+0000 7fc9bd00d640 1 Processor -- start 2023-08-09T12:47:31.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.175+0000 7fc9bd00d640 1 -- start start 2023-08-09T12:47:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.176+0000 7fc9bd00d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80afce0 0x7fc9b814c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:31.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.176+0000 7fc9bd00d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cef20 0x7fc9b80c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.176+0000 7fc9bd00d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8158840 0x7fc9b80cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.176+0000 7fc9bd00d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b81f2cd0 con 0x7fc9b80cef20 2023-08-09T12:47:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.176+0000 7fc9bd00d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b81529f0 con 0x7fc9b8158840 2023-08-09T12:47:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.176+0000 7fc9bd00d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8152cd0 con 0x7fc9b80afce0 2023-08-09T12:47:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.176+0000 7fc9b659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cef20 0x7fc9b80c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.176+0000 7fc9b659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cef20 0x7fc9b80c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49306/0 (socket says 172.21.15.17:49306) 2023-08-09T12:47:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b659c640 1 -- 172.21.15.17:0/3594275136 learned_addr learned my addr 172.21.15.17:0/3594275136 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b759e640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8158840 0x7fc9b80cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b6d9d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80afce0 0x7fc9b814c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b659c640 1 -- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80afce0 msgr2=0x7fc9b814c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b659c640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80afce0 0x7fc9b814c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b659c640 1 -- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8158840 msgr2=0x7fc9b80cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b659c640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8158840 0x7fc9b80cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b659c640 1 -- 172.21.15.17:0/3594275136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0094d0 con 0x7fc9b80cef20 2023-08-09T12:47:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.177+0000 7fc9b659c640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cef20 0x7fc9b80c8dd0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009870 tx=0x7fc9ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.178+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3594275136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac03ac60 con 0x7fc9b80cef20 2023-08-09T12:47:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.178+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3594275136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac03ade0 con 0x7fc9b80cef20 2023-08-09T12:47:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.178+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b8152fb0 con 0x7fc9b80cef20 2023-08-09T12:47:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.178+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3594275136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac044630 con 0x7fc9b80cef20 2023-08-09T12:47:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.178+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b81526e0 con 0x7fc9b80cef20 2023-08-09T12:47:31.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.179+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b8067a80 con 0x7fc9b80cef20 2023-08-09T12:47:31.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.180+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3594275136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc9ac02f050 con 0x7fc9b80cef20 2023-08-09T12:47:31.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.181+0000 7fc99f7fe640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a050 0x7fc9a406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.181+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3594275136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc9ac0aa450 con 0x7fc9b80cef20 2023-08-09T12:47:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.182+0000 7fc9b6d9d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a050 0x7fc9a406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.183+0000 7fc9b6d9d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a050 0x7fc9a406c510 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc9b806b8b0 tx=0x7fc9a8007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.185+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3594275136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc9ac075f10 con 0x7fc9b80cef20 2023-08-09T12:47:31.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.380+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc9b80b36f0 con 0x7fc9b80cef20 2023-08-09T12:47:31.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.386+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3594275136 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc9ac079530 con 0x7fc9b80cef20 2023-08-09T12:47:31.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a050 msgr2=0x7fc9a406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a050 0x7fc9a406c510 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc9b806b8b0 tx=0x7fc9a8007900 comp rx=0 tx=0).stop 2023-08-09T12:47:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cef20 msgr2=0x7fc9b80c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cef20 0x7fc9b80c8dd0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009870 tx=0x7fc9ac0046c0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 shutdown_connections 2023-08-09T12:47:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a050 0x7fc9a406c510 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8158840 0x7fc9b80cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cef20 0x7fc9b80c8dd0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 --2- 172.21.15.17:0/3594275136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80afce0 0x7fc9b814c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:31.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 >> 172.21.15.17:0/3594275136 conn(0x7fc9b8069be0 msgr2=0x7fc9b8154890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:31.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 shutdown_connections 2023-08-09T12:47:31.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:31.389+0000 7fc9bd00d640 1 -- 172.21.15.17:0/3594275136 wait complete. 2023-08-09T12:47:31.410 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:47:31.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:47:31.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:47:31.657 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:47:31.657 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:31.658 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:31.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:47:31.721 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:47:31.722 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:31.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:47:31.783 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:31.784 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:31.848 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:47:31.849 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:47:31.849 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:31.911 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:47:31.911 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:47:31.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:32.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.149+0000 7fac6d0e0640 1 Processor -- start 2023-08-09T12:47:32.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.149+0000 7fac6d0e0640 1 -- start start 2023-08-09T12:47:32.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.151+0000 7fac6d0e0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac680cfb50 0x7fac68167a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.151+0000 7fac6d0e0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac680b5a30 con 0x7fac68160030 2023-08-09T12:47:32.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.151+0000 7fac6d0e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac680d0d70 con 0x7fac680b86e0 2023-08-09T12:47:32.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.151+0000 7fac6d0e0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac680d1110 con 0x7fac680cfb50 2023-08-09T12:47:32.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.151+0000 7fac67fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fac68160030 0x7fac68160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49344/0 (socket says 172.21.15.17:49344) 2023-08-09T12:47:32.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.151+0000 7fac67fff640 1 -- 172.21.15.17:0/757338758 learned_addr learned my addr 172.21.15.17:0/757338758 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:32.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.151+0000 7fac6c8df640 1 --2- 172.21.15.17:0/757338758 >> v2:172.21.15.142:3300/0 conn(0x7fac680cfb50 0x7fac68167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241669876 0 0) 0x7fac680b5a30 con 0x7fac68160030 2023-08-09T12:47:32.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac50003520 con 0x7fac68160030 2023-08-09T12:47:32.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3404617747 0 0) 0x7fac50003520 con 0x7fac68160030 2023-08-09T12:47:32.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 >> v2:172.21.15.142:3300/0 conn(0x7fac680cfb50 msgr2=0x7fac68167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:32.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 --2- 172.21.15.17:0/757338758 >> v2:172.21.15.142:3300/0 conn(0x7fac680cfb50 0x7fac68167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 >> v1:172.21.15.142:6789/0 conn(0x7fac680b86e0 legacy=0x7fac680cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68160f70 con 0x7fac68160030 2023-08-09T12:47:32.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fac58001690 con 0x7fac68160030 2023-08-09T12:47:32.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 >> v1:172.21.15.17:6789/0 conn(0x7fac68160030 legacy=0x7fac68160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac50003970 0x7fac50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac50005180 0x7fac5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac680d1110 con 0x7fac500047c0 2023-08-09T12:47:32.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5000c020 con 0x7fac50005180 2023-08-09T12:47:32.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.152+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5000c1e0 con 0x7fac50003970 2023-08-09T12:47:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac677fe640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac6c8df640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac50005180 0x7fac5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac67fff640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac50003970 0x7fac50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac677fe640 1 -- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac50003970 msgr2=0x7fac50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac677fe640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac50003970 0x7fac50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac677fe640 1 -- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac50005180 msgr2=0x7fac5000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac677fe640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac50005180 0x7fac5000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac677fe640 1 -- 172.21.15.17:0/757338758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50003520 con 0x7fac500047c0 2023-08-09T12:47:32.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac6c8df640 1 -- 172.21.15.17:0/757338758 reap_dead start 2023-08-09T12:47:32.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.153+0000 7fac67fff640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac50003970 0x7fac50003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:32.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.154+0000 7fac677fe640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac50004c40 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fac5c001750 tx=0x7fac500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb34f14574fcd53 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0052d0 con 0x7fac500047c0 2023-08-09T12:47:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c02e050 con 0x7fac500047c0 2023-08-09T12:47:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac66ffd640 1 -- 172.21.15.17:0/757338758 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c003830 con 0x7fac500047c0 2023-08-09T12:47:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac6d0e0640 1 -- 172.21.15.17:0/757338758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 msgr2=0x7fac50004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac6d0e0640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac50004c40 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fac5c001750 tx=0x7fac500057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac6d0e0640 1 -- 172.21.15.17:0/757338758 shutdown_connections 2023-08-09T12:47:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac6d0e0640 1 --2- 172.21.15.17:0/757338758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac50004c40 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac6d0e0640 1 -- 172.21.15.17:0/757338758 >> 172.21.15.17:0/757338758 conn(0x7fac680697c0 msgr2=0x7fac68069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac6d0e0640 1 -- 172.21.15.17:0/757338758 shutdown_connections 2023-08-09T12:47:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.155+0000 7fac6d0e0640 1 -- 172.21.15.17:0/757338758 wait complete. 2023-08-09T12:47:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.157+0000 7fac6d0e0640 1 Processor -- start 2023-08-09T12:47:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.157+0000 7fac6d0e0640 1 -- start start 2023-08-09T12:47:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.158+0000 7fac6d0e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac680cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.158+0000 7fac6d0e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac681f5af0 0x7fac681f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.158+0000 7fac6d0e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac680b6d00 0x7fac680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.158+0000 7fac6d0e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac680b76f0 con 0x7fac500047c0 2023-08-09T12:47:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.158+0000 7fac6d0e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac680b5690 con 0x7fac681f5af0 2023-08-09T12:47:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.158+0000 7fac6d0e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6814ac60 con 0x7fac680b6d00 2023-08-09T12:47:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac680cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac680cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49318/0 (socket says 172.21.15.17:49318) 2023-08-09T12:47:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 -- 172.21.15.17:0/1488899971 learned_addr learned my addr 172.21.15.17:0/1488899971 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac677fe640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac681f5af0 0x7fac681f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac6c8df640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac680b6d00 0x7fac680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 -- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac680b6d00 msgr2=0x7fac680b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac680b6d00 0x7fac680b71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 -- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac681f5af0 msgr2=0x7fac681f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac681f5af0 0x7fac681f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 -- 172.21.15.17:0/1488899971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68152a20 con 0x7fac500047c0 2023-08-09T12:47:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.159+0000 7fac67fff640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac680cbbc0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fac5800d770 tx=0x7fac5800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.160+0000 7fac64ff9640 1 -- 172.21.15.17:0/1488899971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac580072d0 con 0x7fac500047c0 2023-08-09T12:47:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.160+0000 7fac64ff9640 1 -- 172.21.15.17:0/1488899971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac58007430 con 0x7fac500047c0 2023-08-09T12:47:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.160+0000 7fac64ff9640 1 -- 172.21.15.17:0/1488899971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac580047e0 con 0x7fac500047c0 2023-08-09T12:47:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.160+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac681f5ff0 con 0x7fac500047c0 2023-08-09T12:47:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.160+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac681f65b0 con 0x7fac500047c0 2023-08-09T12:47:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.161+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6804e390 con 0x7fac500047c0 2023-08-09T12:47:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.162+0000 7fac64ff9640 1 -- 172.21.15.17:0/1488899971 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac58004940 con 0x7fac500047c0 2023-08-09T12:47:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.163+0000 7fac64ff9640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac5406a080 0x7fac5406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.163+0000 7fac64ff9640 1 -- 172.21.15.17:0/1488899971 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fac58087820 con 0x7fac500047c0 2023-08-09T12:47:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.164+0000 7fac677fe640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac5406a080 0x7fac5406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.165+0000 7fac677fe640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac5406a080 0x7fac5406c540 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fac5c033000 tx=0x7fac5c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:32.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.168+0000 7fac64ff9640 1 -- 172.21.15.17:0/1488899971 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fac58053240 con 0x7fac500047c0 2023-08-09T12:47:32.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.400+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac681529b0 con 0x7fac500047c0 2023-08-09T12:47:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.401+0000 7fac64ff9640 1 -- 172.21.15.17:0/1488899971 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fac58019e90 con 0x7fac500047c0 2023-08-09T12:47:32.405 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:32.405 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":61,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/1843731851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1843731851},{"type":"v1","addr":"172.21.15.142:6836","nonce":1843731851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6028,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1591490003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1591490003},{"type":"v1","addr":"172.21.15.142:6837","nonce":1591490003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/691578214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":691578214},{"type":"v1","addr":"172.21.15.17:6834","nonce":691578214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1451031641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1451031641},{"type":"v1","addr":"172.21.15.17:6835","nonce":1451031641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[]} 2023-08-09T12:47:32.405 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 61 2023-08-09T12:47:32.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac5406a080 msgr2=0x7fac5406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac5406a080 0x7fac5406c540 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fac5c033000 tx=0x7fac5c009030 comp rx=0 tx=0).stop 2023-08-09T12:47:32.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 msgr2=0x7fac680cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac680cbbc0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fac5800d770 tx=0x7fac5800db70 comp rx=0 tx=0).stop 2023-08-09T12:47:32.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 shutdown_connections 2023-08-09T12:47:32.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fac5406a080 0x7fac5406c540 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac680b6d00 0x7fac680b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac681f5af0 0x7fac681f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 --2- 172.21.15.17:0/1488899971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac500047c0 0x7fac680cbbc0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.404+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 >> 172.21.15.17:0/1488899971 conn(0x7fac680697c0 msgr2=0x7fac680d1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:32.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.405+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 shutdown_connections 2023-08-09T12:47:32.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.405+0000 7fac6d0e0640 1 -- 172.21.15.17:0/1488899971 wait complete. 2023-08-09T12:47:32.425 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:47:32.426 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:47:32.426 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:47:32.426 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:47:32.426 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:47:32.427 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:47:32.427 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:47:32.427 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:47:32.427 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:47:32.428 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:47:32.428 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:47:32.428 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:47:32.428 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:47:32.428 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:47:32.429 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:47:32.429 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:47:32.445 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:47:32.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:47:32.446 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:47:32.446 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:47:32.457 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:47:32.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:47:32.462 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:47:32.462 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:47:32.493 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:47:32.494 DEBUG:teuthology.parallel:result is None 2023-08-09T12:47:32.500 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:47:32.501 DEBUG:teuthology.parallel:result is None 2023-08-09T12:47:32.516 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:47:32.517 DEBUG:teuthology.parallel:result is None 2023-08-09T12:47:32.530 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:47:32.530 DEBUG:teuthology.parallel:result is None 2023-08-09T12:47:32.531 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:47:32.661 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:47:32.663 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:47:32.675 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:47:32.684 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:47:32.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.735+0000 7f708179b640 1 Processor -- start 2023-08-09T12:47:32.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.736+0000 7f708179b640 1 -- start start 2023-08-09T12:47:32.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.737+0000 7f708179b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f707c1587e0 0x7f707c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.737+0000 7f708179b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c0b0b10 0x7f707c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.737+0000 7f708179b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c0715c0 con 0x7f707c15bce0 2023-08-09T12:47:32.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.737+0000 7f708179b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c0718a0 con 0x7f707c1587e0 2023-08-09T12:47:32.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.737+0000 7f708179b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c071b80 con 0x7f707c0b0b10 2023-08-09T12:47:32.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.737+0000 7f707bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f707c1587e0 0x7f707c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.738+0000 7f707bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f707c1587e0 0x7f707c070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49358/0 (socket says 172.21.15.17:49358) 2023-08-09T12:47:32.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.738+0000 7f707bfff640 1 -- 172.21.15.17:0/14533785 learned_addr learned my addr 172.21.15.17:0/14533785 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:32.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.738+0000 7f707b7fe640 1 --2- 172.21.15.17:0/14533785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c0b0b10 0x7f707c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.738+0000 7f707bfff640 1 -- 172.21.15.17:0/14533785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c0b0b10 msgr2=0x7f707c15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:32.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.738+0000 7f707bfff640 1 --2- 172.21.15.17:0/14533785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c0b0b10 0x7f707c15b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.738+0000 7f707bfff640 1 -- 172.21.15.17:0/14533785 >> v1:172.21.15.142:6789/0 conn(0x7f707c15bce0 legacy=0x7f707c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:32.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.738+0000 7f707bfff640 1 -- 172.21.15.17:0/14533785 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c15b280 con 0x7f707c1587e0 2023-08-09T12:47:32.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.739+0000 7f707bfff640 1 --2- 172.21.15.17:0/14533785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c1587e0 0x7f707c070f00 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f706c009870 tx=0x7f706c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4b98c329084ac4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:32.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.740+0000 7f707affd640 1 -- 172.21.15.17:0/14533785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c031640 con 0x7f707c1587e0 2023-08-09T12:47:32.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.740+0000 7f707affd640 1 -- 172.21.15.17:0/14533785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c0317a0 con 0x7f707c1587e0 2023-08-09T12:47:32.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.740+0000 7f707affd640 1 -- 172.21.15.17:0/14533785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c031b30 con 0x7f707c1587e0 2023-08-09T12:47:32.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.740+0000 7f708179b640 1 -- 172.21.15.17:0/14533785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c1587e0 msgr2=0x7f707c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.740+0000 7f708179b640 1 --2- 172.21.15.17:0/14533785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c1587e0 0x7f707c070f00 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f706c009870 tx=0x7f706c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.741+0000 7f708179b640 1 -- 172.21.15.17:0/14533785 shutdown_connections 2023-08-09T12:47:32.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.741+0000 7f708179b640 1 --2- 172.21.15.17:0/14533785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c0b0b10 0x7f707c15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.741+0000 7f708179b640 1 --2- 172.21.15.17:0/14533785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c1587e0 0x7f707c070f00 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.741+0000 7f708179b640 1 -- 172.21.15.17:0/14533785 >> 172.21.15.17:0/14533785 conn(0x7f707c0b1d50 msgr2=0x7f707c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:32.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.741+0000 7f708179b640 1 -- 172.21.15.17:0/14533785 shutdown_connections 2023-08-09T12:47:32.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.741+0000 7f708179b640 1 -- 172.21.15.17:0/14533785 wait complete. 2023-08-09T12:47:32.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.743+0000 7f708179b640 1 Processor -- start 2023-08-09T12:47:32.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.743+0000 7f708179b640 1 -- start start 2023-08-09T12:47:32.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f708179b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c0b0b10 0x7f707c156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f708179b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c1587e0 0x7f707c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f708179b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707c1593f0 0x7f707c159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f708179b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c156540 con 0x7f707c0b0b10 2023-08-09T12:47:32.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f708179b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c157380 con 0x7f707c1593f0 2023-08-09T12:47:32.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f708179b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c154100 con 0x7f707c1587e0 2023-08-09T12:47:32.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f707bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c0b0b10 0x7f707c156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f707bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c0b0b10 0x7f707c156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49362/0 (socket says 172.21.15.17:49362) 2023-08-09T12:47:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.744+0000 7f707bfff640 1 -- 172.21.15.17:0/3263341343 learned_addr learned my addr 172.21.15.17:0/3263341343 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f7080f9a640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707c1593f0 0x7f707c159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f707b7fe640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c1587e0 0x7f707c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f707bfff640 1 -- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c1587e0 msgr2=0x7f707c15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f707bfff640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c1587e0 0x7f707c15cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f707bfff640 1 -- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707c1593f0 msgr2=0x7f707c159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f707bfff640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707c1593f0 0x7f707c159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f707bfff640 1 -- 172.21.15.17:0/3263341343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0094d0 con 0x7f707c0b0b10 2023-08-09T12:47:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f7080f9a640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707c1593f0 0x7f707c159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:47:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.745+0000 7f707bfff640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c0b0b10 0x7f707c156000 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f706c009870 tx=0x7f706c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.746+0000 7f7078ff9640 1 -- 172.21.15.17:0/3263341343 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c03ac60 con 0x7f707c0b0b10 2023-08-09T12:47:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.746+0000 7f7078ff9640 1 -- 172.21.15.17:0/3263341343 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c03adc0 con 0x7f707c0b0b10 2023-08-09T12:47:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.746+0000 7f7078ff9640 1 -- 172.21.15.17:0/3263341343 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c044630 con 0x7f707c0b0b10 2023-08-09T12:47:32.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.746+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c15d480 con 0x7f707c0b0b10 2023-08-09T12:47:32.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.746+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c156770 con 0x7f707c0b0b10 2023-08-09T12:47:32.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.747+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c06fa10 con 0x7f707c0b0b10 2023-08-09T12:47:32.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.748+0000 7f7078ff9640 1 -- 172.21.15.17:0/3263341343 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f706c02f050 con 0x7f707c0b0b10 2023-08-09T12:47:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.749+0000 7f7078ff9640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f706806a050 0x7f706806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.749+0000 7f7078ff9640 1 -- 172.21.15.17:0/3263341343 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f706c0aa210 con 0x7f707c0b0b10 2023-08-09T12:47:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.750+0000 7f707b7fe640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f706806a050 0x7f706806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:32.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.751+0000 7f707b7fe640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f706806a050 0x7f706806c510 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f707c154dd0 tx=0x7f7070008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:32.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.754+0000 7f7078ff9640 1 -- 172.21.15.17:0/3263341343 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f707c06fa10 con 0x7f707c0b0b10 2023-08-09T12:47:32.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:32.961+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f707c06fa10 con 0x7f707c0b0b10 2023-08-09T12:47:33.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.548+0000 7f7078ff9640 1 -- 172.21.15.17:0/3263341343 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v140) v1 ==== 97+0+0 (secure 0 0 0) 0x7f707c06fa10 con 0x7f707c0b0b10 2023-08-09T12:47:33.552 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:47:33.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f706806a050 msgr2=0x7f706806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:33.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f706806a050 0x7f706806c510 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f707c154dd0 tx=0x7f7070008040 comp rx=0 tx=0).stop 2023-08-09T12:47:33.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c0b0b10 msgr2=0x7f707c156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:33.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c0b0b10 0x7f707c156000 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f706c009870 tx=0x7f706c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:47:33.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 shutdown_connections 2023-08-09T12:47:33.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f706806a050 0x7f706806c510 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:33.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f707c1593f0 0x7f707c159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:33.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f707c1587e0 0x7f707c15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:33.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 --2- 172.21.15.17:0/3263341343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f707c0b0b10 0x7f707c156000 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:33.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.552+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 >> 172.21.15.17:0/3263341343 conn(0x7f707c0b1d50 msgr2=0x7f707c155040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:33.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.553+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 shutdown_connections 2023-08-09T12:47:33.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.553+0000 7f708179b640 1 -- 172.21.15.17:0/3263341343 wait complete. 2023-08-09T12:47:33.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:47:33.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.812+0000 7fc7bb59e640 1 Processor -- start 2023-08-09T12:47:33.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.812+0000 7fc7bb59e640 1 -- start start 2023-08-09T12:47:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.814+0000 7fc7bb59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc7bc0cfb50 0x7fc7bc167a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.814+0000 7fc7bb59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc0b5a30 con 0x7fc7bc0b86e0 2023-08-09T12:47:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.814+0000 7fc7bb59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc0d0d70 con 0x7fc7bc160030 2023-08-09T12:47:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.814+0000 7fc7bb59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc0d1110 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.814+0000 7fc7b9d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc7bc0b86e0 0x7fc7bc0cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49358/0 (socket says 172.21.15.17:49358) 2023-08-09T12:47:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.814+0000 7fc7b9d9b640 1 -- 172.21.15.17:0/378844423 learned_addr learned my addr 172.21.15.17:0/378844423 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.814+0000 7fc7bad9d640 1 --2- 172.21.15.17:0/378844423 >> v2:172.21.15.17:3300/0 conn(0x7fc7bc0cfb50 0x7fc7bc167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.814+0000 7fc7b959a640 1 -- 172.21.15.17:0/378844423 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694042885 0 0) 0x7fc7bc0b5a30 con 0x7fc7bc0b86e0 2023-08-09T12:47:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.815+0000 7fc7b959a640 1 -- 172.21.15.17:0/378844423 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a8003520 con 0x7fc7bc0b86e0 2023-08-09T12:47:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.815+0000 7fc7bad9d640 1 -- 172.21.15.17:0/378844423 >> v1:172.21.15.142:6789/0 conn(0x7fc7bc160030 legacy=0x7fc7bc160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.815+0000 7fc7bad9d640 1 -- 172.21.15.17:0/378844423 >> v1:172.21.15.17:6789/0 conn(0x7fc7bc0b86e0 legacy=0x7fc7bc0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.815+0000 7fc7bad9d640 1 -- 172.21.15.17:0/378844423 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc160f70 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.816+0000 7fc7bad9d640 1 --2- 172.21.15.17:0/378844423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc167a90 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009d90 tx=0x7fc7b402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5747b90cee6e84e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.816+0000 7fc7b959a640 1 -- 172.21.15.17:0/378844423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b402ccf0 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.816+0000 7fc7b959a640 1 -- 172.21.15.17:0/378844423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b402ce50 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.816+0000 7fc7b959a640 1 -- 172.21.15.17:0/378844423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4034640 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.817+0000 7fc7bb59e640 1 -- 172.21.15.17:0/378844423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 msgr2=0x7fc7bc167a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.817+0000 7fc7bb59e640 1 --2- 172.21.15.17:0/378844423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc167a90 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009d90 tx=0x7fc7b402bf40 comp rx=0 tx=0).stop 2023-08-09T12:47:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.817+0000 7fc7bb59e640 1 -- 172.21.15.17:0/378844423 shutdown_connections 2023-08-09T12:47:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.817+0000 7fc7bb59e640 1 --2- 172.21.15.17:0/378844423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc167a90 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.817+0000 7fc7bb59e640 1 -- 172.21.15.17:0/378844423 >> 172.21.15.17:0/378844423 conn(0x7fc7bc0697c0 msgr2=0x7fc7bc069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.817+0000 7fc7bb59e640 1 -- 172.21.15.17:0/378844423 shutdown_connections 2023-08-09T12:47:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.817+0000 7fc7bb59e640 1 -- 172.21.15.17:0/378844423 wait complete. 2023-08-09T12:47:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.819+0000 7fc7bb59e640 1 Processor -- start 2023-08-09T12:47:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.819+0000 7fc7bb59e640 1 -- start start 2023-08-09T12:47:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7bb59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc0b86e0 0x7fc7bc0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7bb59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc1f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7bb59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc160030 0x7fc7bc0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7bb59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0b2f80 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7bb59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc15a2e0 con 0x7fc7bc0b86e0 2023-08-09T12:47:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7bb59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0cb130 con 0x7fc7bc160030 2023-08-09T12:47:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7b9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc1f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7b9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc1f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49376/0 (socket says 172.21.15.17:49376) 2023-08-09T12:47:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.820+0000 7fc7b9d9b640 1 -- 172.21.15.17:0/1603425625 learned_addr learned my addr 172.21.15.17:0/1603425625 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7ba59c640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc0b86e0 0x7fc7bc0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b9d9b640 1 -- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc160030 msgr2=0x7fc7bc0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b9d9b640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc160030 0x7fc7bc0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b9d9b640 1 -- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc0b86e0 msgr2=0x7fc7bc0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b9d9b640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc0b86e0 0x7fc7bc0b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b9d9b640 1 -- 172.21.15.17:0/1603425625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4009a70 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b9d9b640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc1f29d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c430 tx=0x7fc7a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b2ffd640 1 -- 172.21.15.17:0/1603425625 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4005ce0 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b2ffd640 1 -- 172.21.15.17:0/1603425625 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4005e40 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7b2ffd640 1 -- 172.21.15.17:0/1603425625 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40072d0 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.821+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc1f2f10 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.822+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc0b28c0 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.823+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7bc161510 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.824+0000 7fc7b2ffd640 1 -- 172.21.15.17:0/1603425625 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc7a40074f0 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.824+0000 7fc7b2ffd640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc79c06a050 0x7fc79c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:33.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.825+0000 7fc7b2ffd640 1 -- 172.21.15.17:0/1603425625 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc7a4087780 con 0x7fc7bc0cfb50 2023-08-09T12:47:33.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.825+0000 7fc7ba59c640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc79c06a050 0x7fc79c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:33.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.826+0000 7fc7ba59c640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc79c06a050 0x7fc79c06c510 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac000f60 tx=0x7fc7ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:33.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:33.830+0000 7fc7b2ffd640 1 -- 172.21.15.17:0/1603425625 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc7bc161510 con 0x7fc7bc0cfb50 2023-08-09T12:47:34.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.092+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc7bc0b30c0 con 0x7fc7bc0cfb50 2023-08-09T12:47:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.093+0000 7fc7b2ffd640 1 -- 172.21.15.17:0/1603425625 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc7bc0b30c0 con 0x7fc7bc0cfb50 2023-08-09T12:47:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:34.097 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:47:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:47:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:47:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:47:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:47:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:47:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:47:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:47:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:47:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:47:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:47:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:47:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:47:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:47:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:47:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:47:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:47:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:47:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:47:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:47:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:47:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:47:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:47:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:47:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:47:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:47:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:47:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:47:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:47:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:47:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:47:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:47:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:47:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:47:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:47:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:47:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:47:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:47:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:47:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:47:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:47:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:47:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:47:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:47:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:47:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:47:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:47:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:47:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:47:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:47:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:47:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:47:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:47:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:47:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:47:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:47:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:47:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:47:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:47:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:47:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:47:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:47:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:47:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:47:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:47:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:47:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:47:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:47:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:47:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:47:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:47:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:47:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:47:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:47:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:47:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:47:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:47:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:47:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:47:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:47:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:47:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:47:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:47:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:47:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:47:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:47:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:47:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:47:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:47:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:47:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:47:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:47:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:34.133 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:47:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc79c06a050 msgr2=0x7fc79c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc79c06a050 0x7fc79c06c510 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac000f60 tx=0x7fc7ac009040 comp rx=0 tx=0).stop 2023-08-09T12:47:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 msgr2=0x7fc7bc1f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc1f29d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c430 tx=0x7fc7a400c8f0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 shutdown_connections 2023-08-09T12:47:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc79c06a050 0x7fc79c06c510 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7bc160030 0x7fc7bc0cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7bc0cfb50 0x7fc7bc1f29d0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 --2- 172.21.15.17:0/1603425625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7bc0b86e0 0x7fc7bc0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.096+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 >> 172.21.15.17:0/1603425625 conn(0x7fc7bc0697c0 msgr2=0x7fc7bc15db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.097+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 shutdown_connections 2023-08-09T12:47:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.097+0000 7fc7bb59e640 1 -- 172.21.15.17:0/1603425625 wait complete. 2023-08-09T12:47:34.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:34.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.347+0000 7f021b59e640 1 Processor -- start 2023-08-09T12:47:34.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.347+0000 7f021b59e640 1 -- start start 2023-08-09T12:47:34.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ac0 0x7f021c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021b59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f021c0cb610 0x7f021c06ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0b3b60 con 0x7f021c0b0ea0 2023-08-09T12:47:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021b59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c1617b0 con 0x7f021c0cb610 2023-08-09T12:47:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0b3550 con 0x7f021c0b0ac0 2023-08-09T12:47:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021ad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f021c0cb610 0x7f021c06ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021ad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f021c0cb610 0x7f021c06ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49388/0 (socket says 172.21.15.17:49388) 2023-08-09T12:47:34.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021ad9d640 1 -- 172.21.15.17:0/2845944013 learned_addr learned my addr 172.21.15.17:0/2845944013 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:34.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.349+0000 7f021a59c640 1 --2- 172.21.15.17:0/2845944013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ac0 0x7f021c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.350+0000 7f021ad9d640 1 -- 172.21.15.17:0/2845944013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ac0 msgr2=0x7f021c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:34.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.350+0000 7f021ad9d640 1 --2- 172.21.15.17:0/2845944013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ac0 0x7f021c0b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.350+0000 7f021ad9d640 1 -- 172.21.15.17:0/2845944013 >> v1:172.21.15.142:6789/0 conn(0x7f021c0b0ea0 legacy=0x7f021c0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:34.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.350+0000 7f021ad9d640 1 -- 172.21.15.17:0/2845944013 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0c9e10 con 0x7f021c0cb610 2023-08-09T12:47:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.351+0000 7f021ad9d640 1 --2- 172.21.15.17:0/2845944013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06ecd0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f0214009e50 tx=0x7f021402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75020f3fe092bc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.351+0000 7f0219d9b640 1 -- 172.21.15.17:0/2845944013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021402cb00 con 0x7f021c0cb610 2023-08-09T12:47:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.351+0000 7f0219d9b640 1 -- 172.21.15.17:0/2845944013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021402cc60 con 0x7f021c0cb610 2023-08-09T12:47:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.351+0000 7f0219d9b640 1 -- 172.21.15.17:0/2845944013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140343f0 con 0x7f021c0cb610 2023-08-09T12:47:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.352+0000 7f021b59e640 1 -- 172.21.15.17:0/2845944013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 msgr2=0x7f021c06ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.352+0000 7f021b59e640 1 --2- 172.21.15.17:0/2845944013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06ecd0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f0214009e50 tx=0x7f021402bf60 comp rx=0 tx=0).stop 2023-08-09T12:47:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.352+0000 7f021b59e640 1 -- 172.21.15.17:0/2845944013 shutdown_connections 2023-08-09T12:47:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.352+0000 7f021b59e640 1 --2- 172.21.15.17:0/2845944013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06ecd0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.352+0000 7f021b59e640 1 --2- 172.21.15.17:0/2845944013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ac0 0x7f021c0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.352+0000 7f021b59e640 1 -- 172.21.15.17:0/2845944013 >> 172.21.15.17:0/2845944013 conn(0x7f021c0b1d50 msgr2=0x7f021c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.352+0000 7f021b59e640 1 -- 172.21.15.17:0/2845944013 shutdown_connections 2023-08-09T12:47:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.352+0000 7f021b59e640 1 -- 172.21.15.17:0/2845944013 wait complete. 2023-08-09T12:47:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.354+0000 7f021b59e640 1 Processor -- start 2023-08-09T12:47:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.354+0000 7f021b59e640 1 -- start start 2023-08-09T12:47:34.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f021c0b0ac0 0x7f021c15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ea0 0x7f021c0c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c7850 con 0x7f021c0cb610 2023-08-09T12:47:34.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c7b30 con 0x7f021c0b0ac0 2023-08-09T12:47:34.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c7e10 con 0x7f021c0b0ea0 2023-08-09T12:47:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49402/0 (socket says 172.21.15.17:49402) 2023-08-09T12:47:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021ad9d640 1 -- 172.21.15.17:0/2868689429 learned_addr learned my addr 172.21.15.17:0/2868689429 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f021a59c640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f021c0b0ac0 0x7f021c15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.355+0000 7f0213fff640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ea0 0x7f021c0c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f021ad9d640 1 -- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ea0 msgr2=0x7f021c0c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f021ad9d640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ea0 0x7f021c0c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f021ad9d640 1 -- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f021c0b0ac0 msgr2=0x7f021c15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f021ad9d640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f021c0b0ac0 0x7f021c15deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f021ad9d640 1 -- 172.21.15.17:0/2868689429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214009b30 con 0x7f021c0cb610 2023-08-09T12:47:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f0213fff640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ea0 0x7f021c0c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f021ad9d640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06f440 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f0214009e50 tx=0x7f0214004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f0212ffd640 1 -- 172.21.15.17:0/2868689429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214040670 con 0x7f021c0cb610 2023-08-09T12:47:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f0212ffd640 1 -- 172.21.15.17:0/2868689429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02140407d0 con 0x7f021c0cb610 2023-08-09T12:47:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f0212ffd640 1 -- 172.21.15.17:0/2868689429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214040b80 con 0x7f021c0cb610 2023-08-09T12:47:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.356+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0c80f0 con 0x7f021c0cb610 2023-08-09T12:47:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.357+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0c4270 con 0x7f021c0cb610 2023-08-09T12:47:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.358+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c0c85b0 con 0x7f021c0cb610 2023-08-09T12:47:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.359+0000 7f0212ffd640 1 -- 172.21.15.17:0/2868689429 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0214040ce0 con 0x7f021c0cb610 2023-08-09T12:47:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.360+0000 7f0212ffd640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f01fc06a050 0x7f01fc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.360+0000 7f0212ffd640 1 -- 172.21.15.17:0/2868689429 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f02140ab440 con 0x7f021c0cb610 2023-08-09T12:47:34.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.361+0000 7f021a59c640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f01fc06a050 0x7f01fc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.362+0000 7f021a59c640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f01fc06a050 0x7f01fc06c510 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f021c15e5d0 tx=0x7f020c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.364+0000 7f0212ffd640 1 -- 172.21.15.17:0/2868689429 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0214076de0 con 0x7f021c0cb610 2023-08-09T12:47:34.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.552+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021c04e390 con 0x7f021c0cb610 2023-08-09T12:47:34.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.553+0000 7f0212ffd640 1 -- 172.21.15.17:0/2868689429 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f0214009510 con 0x7f021c0cb610 2023-08-09T12:47:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:34.557 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":142,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:33.557953+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.556+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f01fc06a050 msgr2=0x7f01fc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.556+0000 7f021b59e640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f01fc06a050 0x7f01fc06c510 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f021c15e5d0 tx=0x7f020c008040 comp rx=0 tx=0).stop 2023-08-09T12:47:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.556+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 msgr2=0x7f021c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.556+0000 7f021b59e640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06f440 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f0214009e50 tx=0x7f0214004a40 comp rx=0 tx=0).stop 2023-08-09T12:47:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.557+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 shutdown_connections 2023-08-09T12:47:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.557+0000 7f021b59e640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f01fc06a050 0x7f01fc06c510 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.557+0000 7f021b59e640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0cb610 0x7f021c06f440 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.557+0000 7f021b59e640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f021c0b0ea0 0x7f021c0c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.557+0000 7f021b59e640 1 --2- 172.21.15.17:0/2868689429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f021c0b0ac0 0x7f021c15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.557+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 >> 172.21.15.17:0/2868689429 conn(0x7f021c0b1d50 msgr2=0x7f021c160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.557+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 shutdown_connections 2023-08-09T12:47:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.557+0000 7f021b59e640 1 -- 172.21.15.17:0/2868689429 wait complete. 2023-08-09T12:47:34.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:47:34.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:47:34.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.780+0000 7fd794912640 1 Processor -- start 2023-08-09T12:47:34.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.780+0000 7fd794912640 1 -- start start 2023-08-09T12:47:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.781+0000 7fd794912640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7900d30e0 0x7fd7900b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.781+0000 7fd794912640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900cdd10 con 0x7fd79015ce90 2023-08-09T12:47:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.781+0000 7fd794912640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900cdff0 con 0x7fd7901616e0 2023-08-09T12:47:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.781+0000 7fd794912640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7900b6540 con 0x7fd7900d30e0 2023-08-09T12:47:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.782+0000 7fd78e59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd79015ce90 0x7fd7900cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49370/0 (socket says 172.21.15.17:49370) 2023-08-09T12:47:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.782+0000 7fd78e59c640 1 -- 172.21.15.17:0/859079219 learned_addr learned my addr 172.21.15.17:0/859079219 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.782+0000 7fd78ed9d640 1 --2- 172.21.15.17:0/859079219 >> v2:172.21.15.142:3300/0 conn(0x7fd7900d30e0 0x7fd7900b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.782+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572577462 0 0) 0x7fd7900cdd10 con 0x7fd79015ce90 2023-08-09T12:47:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.782+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd778003520 con 0x7fd79015ce90 2023-08-09T12:47:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262632525 0 0) 0x7fd778003520 con 0x7fd79015ce90 2023-08-09T12:47:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 >> v2:172.21.15.142:3300/0 conn(0x7fd7900d30e0 msgr2=0x7fd7900b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 --2- 172.21.15.17:0/859079219 >> v2:172.21.15.142:3300/0 conn(0x7fd7900d30e0 0x7fd7900b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 >> v1:172.21.15.142:6789/0 conn(0x7fd7901616e0 legacy=0x7fd7900d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900ce2d0 con 0x7fd79015ce90 2023-08-09T12:47:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fd780001670 con 0x7fd79015ce90 2023-08-09T12:47:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 >> v1:172.21.15.17:6789/0 conn(0x7fd79015ce90 legacy=0x7fd7900cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd778003970 0x7fd778003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7780047c0 0x7fd778004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd778005180 0x7fd77800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900b6540 con 0x7fd778003970 2023-08-09T12:47:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77800c020 con 0x7fd7780047c0 2023-08-09T12:47:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77800c1e0 con 0x7fd778005180 2023-08-09T12:47:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.783+0000 7fd78e59c640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd778003970 0x7fd778003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.784+0000 7fd78dd9b640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7780047c0 0x7fd778004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.784+0000 7fd78e59c640 1 -- 172.21.15.17:0/859079219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd778005180 msgr2=0x7fd77800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:34.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.784+0000 7fd78e59c640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd778005180 0x7fd77800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.784+0000 7fd78e59c640 1 -- 172.21.15.17:0/859079219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7780047c0 msgr2=0x7fd778004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.784+0000 7fd78e59c640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7780047c0 0x7fd778004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.784+0000 7fd78e59c640 1 -- 172.21.15.17:0/859079219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778003520 con 0x7fd778003970 2023-08-09T12:47:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.784+0000 7fd78dd9b640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7780047c0 0x7fd778004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.784+0000 7fd78ed9d640 1 -- 172.21.15.17:0/859079219 reap_dead start 2023-08-09T12:47:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.785+0000 7fd78e59c640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd778003970 0x7fd778003d90 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c240 tx=0x7fd7780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e0691af4a9859f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.785+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780005ad0 con 0x7fd778003970 2023-08-09T12:47:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.785+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780005c50 con 0x7fd778003970 2023-08-09T12:47:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.785+0000 7fd78d59a640 1 -- 172.21.15.17:0/859079219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78002c870 con 0x7fd778003970 2023-08-09T12:47:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.786+0000 7fd794912640 1 -- 172.21.15.17:0/859079219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd778003970 msgr2=0x7fd778003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.786+0000 7fd794912640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd778003970 0x7fd778003d90 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c240 tx=0x7fd7780057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.786+0000 7fd794912640 1 -- 172.21.15.17:0/859079219 shutdown_connections 2023-08-09T12:47:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.786+0000 7fd794912640 1 --2- 172.21.15.17:0/859079219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd778003970 0x7fd778003d90 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.786+0000 7fd794912640 1 -- 172.21.15.17:0/859079219 >> 172.21.15.17:0/859079219 conn(0x7fd79006fde0 msgr2=0x7fd7900701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.786+0000 7fd794912640 1 -- 172.21.15.17:0/859079219 shutdown_connections 2023-08-09T12:47:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.786+0000 7fd794912640 1 -- 172.21.15.17:0/859079219 wait complete. 2023-08-09T12:47:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.788+0000 7fd794912640 1 Processor -- start 2023-08-09T12:47:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.788+0000 7fd794912640 1 -- start start 2023-08-09T12:47:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd794912640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd778003970 0x7fd7901f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd794912640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd790152080 0x7fd7900b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd794912640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7901f2a40 0x7fd7900b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd794912640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79015fbe0 con 0x7fd7901f2a40 2023-08-09T12:47:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd794912640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900b67b0 con 0x7fd778003970 2023-08-09T12:47:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd794912640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901f65d0 con 0x7fd790152080 2023-08-09T12:47:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7901f2a40 0x7fd7900b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7901f2a40 0x7fd7900b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49424/0 (socket says 172.21.15.17:49424) 2023-08-09T12:47:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78ed9d640 1 -- 172.21.15.17:0/3237330085 learned_addr learned my addr 172.21.15.17:0/3237330085 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78e59c640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd778003970 0x7fd7901f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78ed9d640 1 -- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd790152080 msgr2=0x7fd7900b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78ed9d640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd790152080 0x7fd7900b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78ed9d640 1 -- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd778003970 msgr2=0x7fd7901f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78ed9d640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd778003970 0x7fd7901f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78ed9d640 1 -- 172.21.15.17:0/3237330085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7901f68b0 con 0x7fd7901f2a40 2023-08-09T12:47:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.789+0000 7fd78e59c640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd778003970 0x7fd7901f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.790+0000 7fd78ed9d640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7901f2a40 0x7fd7900b6c40 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd7900cdc40 tx=0x7fd78800e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.790+0000 7fd77effd640 1 -- 172.21.15.17:0/3237330085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788013680 con 0x7fd7901f2a40 2023-08-09T12:47:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.790+0000 7fd77effd640 1 -- 172.21.15.17:0/3237330085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7880137e0 con 0x7fd7901f2a40 2023-08-09T12:47:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.790+0000 7fd77effd640 1 -- 172.21.15.17:0/3237330085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788013b90 con 0x7fd7901f2a40 2023-08-09T12:47:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.790+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7901f6b90 con 0x7fd7901f2a40 2023-08-09T12:47:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.790+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7900b87c0 con 0x7fd7901f2a40 2023-08-09T12:47:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.791+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd790067a80 con 0x7fd7901f2a40 2023-08-09T12:47:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.792+0000 7fd77effd640 1 -- 172.21.15.17:0/3237330085 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd788013cf0 con 0x7fd7901f2a40 2023-08-09T12:47:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.793+0000 7fd77effd640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd77006a080 0x7fd77006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.793+0000 7fd77effd640 1 -- 172.21.15.17:0/3237330085 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd788087ac0 con 0x7fd7901f2a40 2023-08-09T12:47:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.794+0000 7fd78e59c640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd77006a080 0x7fd77006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.795+0000 7fd78e59c640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd77006a080 0x7fd77006c540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd780034000 tx=0x7fd780009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.798+0000 7fd77effd640 1 -- 172.21.15.17:0/3237330085 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd7880534f0 con 0x7fd7901f2a40 2023-08-09T12:47:34.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.992+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7900ce580 con 0x7fd7901f2a40 2023-08-09T12:47:34.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.993+0000 7fd77effd640 1 -- 172.21.15.17:0/3237330085 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd788056b10 con 0x7fd7901f2a40 2023-08-09T12:47:34.997 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:47:34.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd77006a080 msgr2=0x7fd77006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:34.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd77006a080 0x7fd77006c540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd780034000 tx=0x7fd780009030 comp rx=0 tx=0).stop 2023-08-09T12:47:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7901f2a40 msgr2=0x7fd7900b6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7901f2a40 0x7fd7900b6c40 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd7900cdc40 tx=0x7fd78800e9d0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 shutdown_connections 2023-08-09T12:47:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd77006a080 0x7fd77006c540 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7901f2a40 0x7fd7900b6c40 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd790152080 0x7fd7900b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 --2- 172.21.15.17:0/3237330085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd778003970 0x7fd7901f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 >> 172.21.15.17:0/3237330085 conn(0x7fd79006fde0 msgr2=0x7fd7900b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:35.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 shutdown_connections 2023-08-09T12:47:35.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:34.996+0000 7fd794912640 1 -- 172.21.15.17:0/3237330085 wait complete. 2023-08-09T12:47:35.016 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:47:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.232+0000 7fd40900a640 1 Processor -- start 2023-08-09T12:47:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.232+0000 7fd40900a640 1 -- start start 2023-08-09T12:47:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.234+0000 7fd40900a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4040d2290 0x7fd4040b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.234+0000 7fd40900a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd404070ab0 con 0x7fd40415caf0 2023-08-09T12:47:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.234+0000 7fd40900a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4040d2720 con 0x7fd4040d1e20 2023-08-09T12:47:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.234+0000 7fd40900a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4040d1a80 con 0x7fd4040d2290 2023-08-09T12:47:35.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.234+0000 7fd403fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd40415caf0 0x7fd4040703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49386/0 (socket says 172.21.15.17:49386) 2023-08-09T12:47:35.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.234+0000 7fd403fff640 1 -- 172.21.15.17:0/96062094 learned_addr learned my addr 172.21.15.17:0/96062094 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:35.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.234+0000 7fd408809640 1 --2- 172.21.15.17:0/96062094 >> v2:172.21.15.142:3300/0 conn(0x7fd4040d2290 0x7fd4040b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117683009 0 0) 0x7fd404070ab0 con 0x7fd40415caf0 2023-08-09T12:47:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f0003520 con 0x7fd40415caf0 2023-08-09T12:47:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1849354434 0 0) 0x7fd3f0003520 con 0x7fd40415caf0 2023-08-09T12:47:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 >> v2:172.21.15.142:3300/0 conn(0x7fd4040d2290 msgr2=0x7fd4040b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 --2- 172.21.15.17:0/96062094 >> v2:172.21.15.142:3300/0 conn(0x7fd4040d2290 0x7fd4040b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 >> v1:172.21.15.142:6789/0 conn(0x7fd4040d1e20 legacy=0x7fd4040b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040d0f00 con 0x7fd40415caf0 2023-08-09T12:47:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fd3f4001670 con 0x7fd40415caf0 2023-08-09T12:47:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 >> v1:172.21.15.17:6789/0 conn(0x7fd40415caf0 legacy=0x7fd4040703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0003970 0x7fd3f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f00047c0 0x7fd3f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3f0005180 0x7fd3f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040d1a80 con 0x7fd3f0005180 2023-08-09T12:47:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f000c020 con 0x7fd3f00047c0 2023-08-09T12:47:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f000c1e0 con 0x7fd3f0003970 2023-08-09T12:47:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.235+0000 7fd408809640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3f0005180 0x7fd3f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.236+0000 7fd403fff640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0003970 0x7fd3f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.236+0000 7fd3fb7fe640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f00047c0 0x7fd3f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.236+0000 7fd408809640 1 -- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0003970 msgr2=0x7fd3f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:35.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.236+0000 7fd408809640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0003970 0x7fd3f0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.236+0000 7fd408809640 1 -- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f00047c0 msgr2=0x7fd3f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:35.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.236+0000 7fd408809640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f00047c0 0x7fd3f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.236+0000 7fd408809640 1 -- 172.21.15.17:0/96062094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0003520 con 0x7fd3f0005180 2023-08-09T12:47:35.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.236+0000 7fd3fb7fe640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3f00047c0 0x7fd3f0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:35.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.237+0000 7fd408809640 1 -- 172.21.15.17:0/96062094 reap_dead start 2023-08-09T12:47:35.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.237+0000 7fd408809640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3f0005180 0x7fd3f000b980 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009fc0 tx=0x7fd3f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f02f6b5fb1bdaaa server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:35.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.237+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc02cc60 con 0x7fd3f0005180 2023-08-09T12:47:35.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.237+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00f040 con 0x7fd3f0005180 2023-08-09T12:47:35.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.237+0000 7fd4037fe640 1 -- 172.21.15.17:0/96062094 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc003990 con 0x7fd3f0005180 2023-08-09T12:47:35.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.238+0000 7fd40900a640 1 -- 172.21.15.17:0/96062094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3f0005180 msgr2=0x7fd3f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.238+0000 7fd40900a640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3f0005180 0x7fd3f000b980 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009fc0 tx=0x7fd3f00057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.238+0000 7fd40900a640 1 -- 172.21.15.17:0/96062094 shutdown_connections 2023-08-09T12:47:35.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.238+0000 7fd40900a640 1 --2- 172.21.15.17:0/96062094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3f0005180 0x7fd3f000b980 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.238+0000 7fd40900a640 1 -- 172.21.15.17:0/96062094 >> 172.21.15.17:0/96062094 conn(0x7fd4040cf6b0 msgr2=0x7fd4040cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:35.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.238+0000 7fd40900a640 1 -- 172.21.15.17:0/96062094 shutdown_connections 2023-08-09T12:47:35.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.238+0000 7fd40900a640 1 -- 172.21.15.17:0/96062094 wait complete. 2023-08-09T12:47:35.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.240+0000 7fd40900a640 1 Processor -- start 2023-08-09T12:47:35.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.240+0000 7fd40900a640 1 -- start start 2023-08-09T12:47:35.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.241+0000 7fd40900a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0005180 0x7fd404158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.241+0000 7fd40900a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4040c8be0 0x7fd4040c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.241+0000 7fd40900a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4040c9060 0x7fd4041f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.241+0000 7fd40900a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040c7bd0 con 0x7fd4040c9060 2023-08-09T12:47:35.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.241+0000 7fd40900a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040c8750 con 0x7fd4040c8be0 2023-08-09T12:47:35.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.241+0000 7fd40900a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040c7e20 con 0x7fd3f0005180 2023-08-09T12:47:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.241+0000 7fd408809640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4040c9060 0x7fd4041f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.241+0000 7fd408809640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4040c9060 0x7fd4041f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49442/0 (socket says 172.21.15.17:49442) 2023-08-09T12:47:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.242+0000 7fd408809640 1 -- 172.21.15.17:0/1952331197 learned_addr learned my addr 172.21.15.17:0/1952331197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.242+0000 7fd403fff640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0005180 0x7fd404158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.242+0000 7fd408809640 1 -- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0005180 msgr2=0x7fd404158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.242+0000 7fd408809640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0005180 0x7fd404158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.242+0000 7fd408809640 1 -- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4040c8be0 msgr2=0x7fd4040c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.242+0000 7fd408809640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4040c8be0 0x7fd4040c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.242+0000 7fd408809640 1 -- 172.21.15.17:0/1952331197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040c8100 con 0x7fd4040c9060 2023-08-09T12:47:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.242+0000 7fd408809640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4040c9060 0x7fd4041f5ab0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc02c6d0 tx=0x7fd3fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.243+0000 7fd4017fa640 1 -- 172.21.15.17:0/1952331197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc035e40 con 0x7fd4040c9060 2023-08-09T12:47:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.243+0000 7fd4017fa640 1 -- 172.21.15.17:0/1952331197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc003990 con 0x7fd4040c9060 2023-08-09T12:47:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.243+0000 7fd4017fa640 1 -- 172.21.15.17:0/1952331197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc003d80 con 0x7fd4040c9060 2023-08-09T12:47:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.243+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4040c83e0 con 0x7fd4040c9060 2023-08-09T12:47:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.243+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4041f6800 con 0x7fd4040c9060 2023-08-09T12:47:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.244+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4041f6990 con 0x7fd4040c9060 2023-08-09T12:47:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.245+0000 7fd4017fa640 1 -- 172.21.15.17:0/1952331197 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd3fc004030 con 0x7fd4040c9060 2023-08-09T12:47:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.246+0000 7fd4017fa640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3e406a050 0x7fd3e406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.246+0000 7fd4017fa640 1 -- 172.21.15.17:0/1952331197 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd3fc0aafc0 con 0x7fd4040c9060 2023-08-09T12:47:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.246+0000 7fd403fff640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3e406a050 0x7fd3e406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.247+0000 7fd403fff640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3e406a050 0x7fd3e406c510 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40017a0 tx=0x7fd3f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:35.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.250+0000 7fd4017fa640 1 -- 172.21.15.17:0/1952331197 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd3fc076a80 con 0x7fd4040c9060 2023-08-09T12:47:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.443+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd40404e390 con 0x7fd4040c9060 2023-08-09T12:47:35.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.444+0000 7fd4017fa640 1 -- 172.21.15.17:0/1952331197 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd3fc07a0a0 con 0x7fd4040c9060 2023-08-09T12:47:35.447 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:47:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3e406a050 msgr2=0x7fd3e406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3e406a050 0x7fd3e406c510 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40017a0 tx=0x7fd3f4009040 comp rx=0 tx=0).stop 2023-08-09T12:47:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4040c9060 msgr2=0x7fd4041f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4040c9060 0x7fd4041f5ab0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc02c6d0 tx=0x7fd3fc009750 comp rx=0 tx=0).stop 2023-08-09T12:47:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 shutdown_connections 2023-08-09T12:47:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3e406a050 0x7fd3e406c510 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4040c9060 0x7fd4041f5ab0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4040c8be0 0x7fd4040c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 --2- 172.21.15.17:0/1952331197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3f0005180 0x7fd404158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.446+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 >> 172.21.15.17:0/1952331197 conn(0x7fd4040cf6b0 msgr2=0x7fd4040b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.447+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 shutdown_connections 2023-08-09T12:47:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.447+0000 7fd40900a640 1 -- 172.21.15.17:0/1952331197 wait complete. 2023-08-09T12:47:35.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:47:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.693+0000 7f81c942d640 1 Processor -- start 2023-08-09T12:47:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.693+0000 7f81c942d640 1 -- start start 2023-08-09T12:47:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.694+0000 7f81c942d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81c40d1400 0x7f81c406aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.694+0000 7f81c942d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f81c4161870 0x7f81c40b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.694+0000 7f81c942d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c4162910 con 0x7f81c406b400 2023-08-09T12:47:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.694+0000 7f81c942d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c40d17e0 con 0x7f81c4161870 2023-08-09T12:47:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.694+0000 7f81c942d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c4161d00 con 0x7f81c40d1400 2023-08-09T12:47:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c27fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f81c4161870 0x7f81c40b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c27fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f81c4161870 0x7f81c40b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49458/0 (socket says 172.21.15.17:49458) 2023-08-09T12:47:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c27fc640 1 -- 172.21.15.17:0/4274939027 learned_addr learned my addr 172.21.15.17:0/4274939027 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c2ffd640 1 --2- 172.21.15.17:0/4274939027 >> v2:172.21.15.142:3300/0 conn(0x7f81c40d1400 0x7f81c406aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c27fc640 1 -- 172.21.15.17:0/4274939027 >> v2:172.21.15.142:3300/0 conn(0x7f81c40d1400 msgr2=0x7f81c406aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c27fc640 1 --2- 172.21.15.17:0/4274939027 >> v2:172.21.15.142:3300/0 conn(0x7f81c40d1400 0x7f81c406aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c27fc640 1 -- 172.21.15.17:0/4274939027 >> v1:172.21.15.17:6789/0 conn(0x7f81c406b400 legacy=0x7f81c40af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c27fc640 1 -- 172.21.15.17:0/4274939027 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4161fe0 con 0x7f81c4161870 2023-08-09T12:47:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.695+0000 7f81c2ffd640 1 --2- 172.21.15.17:0/4274939027 >> v2:172.21.15.142:3300/0 conn(0x7f81c40d1400 0x7f81c406aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.696+0000 7f81c27fc640 1 --2- 172.21.15.17:0/4274939027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c4161870 0x7f81c40b2450 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f81c40d19a0 tx=0x7f81ac02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18d21ca2b19796a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.697+0000 7f81c1ffb640 1 -- 172.21.15.17:0/4274939027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac030870 con 0x7f81c4161870 2023-08-09T12:47:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.697+0000 7f81c1ffb640 1 -- 172.21.15.17:0/4274939027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac0309d0 con 0x7f81c4161870 2023-08-09T12:47:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.697+0000 7f81c1ffb640 1 -- 172.21.15.17:0/4274939027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac030d60 con 0x7f81c4161870 2023-08-09T12:47:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.697+0000 7f81c942d640 1 -- 172.21.15.17:0/4274939027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c4161870 msgr2=0x7f81c40b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.697+0000 7f81c942d640 1 --2- 172.21.15.17:0/4274939027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c4161870 0x7f81c40b2450 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f81c40d19a0 tx=0x7f81ac02b9b0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.698+0000 7f81c942d640 1 -- 172.21.15.17:0/4274939027 shutdown_connections 2023-08-09T12:47:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.698+0000 7f81c942d640 1 --2- 172.21.15.17:0/4274939027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c4161870 0x7f81c40b2450 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.698+0000 7f81c942d640 1 --2- 172.21.15.17:0/4274939027 >> v2:172.21.15.142:3300/0 conn(0x7f81c40d1400 0x7f81c406aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.698+0000 7f81c942d640 1 -- 172.21.15.17:0/4274939027 >> 172.21.15.17:0/4274939027 conn(0x7f81c406cf40 msgr2=0x7f81c406d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.698+0000 7f81c942d640 1 -- 172.21.15.17:0/4274939027 shutdown_connections 2023-08-09T12:47:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.698+0000 7f81c942d640 1 -- 172.21.15.17:0/4274939027 wait complete. 2023-08-09T12:47:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.700+0000 7f81c942d640 1 Processor -- start 2023-08-09T12:47:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.700+0000 7f81c942d640 1 -- start start 2023-08-09T12:47:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c942d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c406b400 0x7f81c4151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c942d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c40d1400 0x7f81c40b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c942d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c40b3a90 0x7f81c40c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c942d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40b3f30 con 0x7f81c40d1400 2023-08-09T12:47:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c942d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40b4210 con 0x7f81c406b400 2023-08-09T12:47:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c942d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40b44f0 con 0x7f81c40b3a90 2023-08-09T12:47:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c40d1400 0x7f81c40b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c40d1400 0x7f81c40b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49466/0 (socket says 172.21.15.17:49466) 2023-08-09T12:47:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.701+0000 7f81c27fc640 1 -- 172.21.15.17:0/1226684745 learned_addr learned my addr 172.21.15.17:0/1226684745 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81c2ffd640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c406b400 0x7f81c4151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81c27fc640 1 -- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c40b3a90 msgr2=0x7f81c40c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81c27fc640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c40b3a90 0x7f81c40c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81c27fc640 1 -- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c406b400 msgr2=0x7f81c4151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81c27fc640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c406b400 0x7f81c4151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81c27fc640 1 -- 172.21.15.17:0/1226684745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac0094d0 con 0x7f81c40d1400 2023-08-09T12:47:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81c27fc640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c40d1400 0x7f81c40b3550 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f81ac02b9f0 tx=0x7f81ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81bb7fe640 1 -- 172.21.15.17:0/1226684745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac030860 con 0x7f81c40d1400 2023-08-09T12:47:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81bb7fe640 1 -- 172.21.15.17:0/1226684745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac039d90 con 0x7f81c40d1400 2023-08-09T12:47:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.702+0000 7f81bb7fe640 1 -- 172.21.15.17:0/1226684745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac043650 con 0x7f81c40d1400 2023-08-09T12:47:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.703+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c40b47d0 con 0x7f81c40d1400 2023-08-09T12:47:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.703+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c40b64e0 con 0x7f81c40d1400 2023-08-09T12:47:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.704+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c40b66c0 con 0x7f81c40d1400 2023-08-09T12:47:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.705+0000 7f81bb7fe640 1 -- 172.21.15.17:0/1226684745 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81ac02f3c0 con 0x7f81c40d1400 2023-08-09T12:47:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.706+0000 7f81bb7fe640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81a406a050 0x7f81a406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.706+0000 7f81bb7fe640 1 -- 172.21.15.17:0/1226684745 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f81ac0aa800 con 0x7f81c40d1400 2023-08-09T12:47:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.706+0000 7f81c2ffd640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81a406a050 0x7f81a406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.708+0000 7f81c2ffd640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81a406a050 0x7f81a406c510 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f81b40075b0 tx=0x7f81b4007540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.710+0000 7f81bb7fe640 1 -- 172.21.15.17:0/1226684745 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f81ac0762c0 con 0x7f81c40d1400 2023-08-09T12:47:35.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.903+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f81c4067270 con 0x7f81c40d1400 2023-08-09T12:47:35.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.904+0000 7f81bb7fe640 1 -- 172.21.15.17:0/1226684745 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v142) v1 ==== 84+0+126 (secure 0 0 0) 0x7f81ac048090 con 0x7f81c40d1400 2023-08-09T12:47:35.908 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:35.908 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:47:35.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:35.908 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:47:35.908 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:47:35.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:35.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:35.909 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:47:35.909 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:47:35.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:35.910 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:47:35.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81a406a050 msgr2=0x7f81a406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81a406a050 0x7f81a406c510 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f81b40075b0 tx=0x7f81b4007540 comp rx=0 tx=0).stop 2023-08-09T12:47:35.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c40d1400 msgr2=0x7f81c40b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:35.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c40d1400 0x7f81c40b3550 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f81ac02b9f0 tx=0x7f81ac004730 comp rx=0 tx=0).stop 2023-08-09T12:47:35.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 shutdown_connections 2023-08-09T12:47:35.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81a406a050 0x7f81a406c510 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c40b3a90 0x7f81c40c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81c40d1400 0x7f81c40b3550 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 --2- 172.21.15.17:0/1226684745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c406b400 0x7f81c4151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:35.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 >> 172.21.15.17:0/1226684745 conn(0x7f81c406cf40 msgr2=0x7f81c4163a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:35.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 shutdown_connections 2023-08-09T12:47:35.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:35.907+0000 7f81c942d640 1 -- 172.21.15.17:0/1226684745 wait complete. 2023-08-09T12:47:35.930 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:47:35.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:47:36.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.160+0000 7f7064947640 1 Processor -- start 2023-08-09T12:47:36.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.161+0000 7f7064947640 1 -- start start 2023-08-09T12:47:36.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.162+0000 7f7064947640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f706015add0 0x7f706006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.162+0000 7f7064947640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060160e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.162+0000 7f7064947640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7060070780 con 0x7f70601613a0 2023-08-09T12:47:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.162+0000 7f7064947640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706015b1b0 con 0x7f706015add0 2023-08-09T12:47:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.162+0000 7f7064947640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600cd6e0 con 0x7f7060070320 2023-08-09T12:47:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.163+0000 7f705e59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f706015add0 0x7f706006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.163+0000 7f705dd9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.163+0000 7f705dd9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:41624/0 (socket says 172.21.15.17:41624) 2023-08-09T12:47:36.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.163+0000 7f705dd9b640 1 -- 172.21.15.17:0/4120438033 learned_addr learned my addr 172.21.15.17:0/4120438033 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:36.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.164+0000 7f705dd9b640 1 -- 172.21.15.17:0/4120438033 >> v2:172.21.15.142:3300/0 conn(0x7f706015add0 msgr2=0x7f706006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.164+0000 7f705dd9b640 1 --2- 172.21.15.17:0/4120438033 >> v2:172.21.15.142:3300/0 conn(0x7f706015add0 0x7f706006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.164+0000 7f705dd9b640 1 -- 172.21.15.17:0/4120438033 >> v1:172.21.15.142:6789/0 conn(0x7f70601613a0 legacy=0x7f70600b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.164+0000 7f705dd9b640 1 -- 172.21.15.17:0/4120438033 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600cd9c0 con 0x7f7060070320 2023-08-09T12:47:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.166+0000 7f705dd9b640 1 --2- 172.21.15.17:0/4120438033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060160e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70540098a0 tx=0x7f705402b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=258d16af0d64c567 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.166+0000 7f705d59a640 1 -- 172.21.15.17:0/4120438033 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054030830 con 0x7f7060070320 2023-08-09T12:47:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.166+0000 7f705d59a640 1 -- 172.21.15.17:0/4120438033 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054030990 con 0x7f7060070320 2023-08-09T12:47:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.166+0000 7f705d59a640 1 -- 172.21.15.17:0/4120438033 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054030d20 con 0x7f7060070320 2023-08-09T12:47:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.167+0000 7f7064947640 1 -- 172.21.15.17:0/4120438033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 msgr2=0x7f7060160e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.167+0000 7f7064947640 1 --2- 172.21.15.17:0/4120438033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060160e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70540098a0 tx=0x7f705402b970 comp rx=0 tx=0).stop 2023-08-09T12:47:36.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.167+0000 7f7064947640 1 -- 172.21.15.17:0/4120438033 shutdown_connections 2023-08-09T12:47:36.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.167+0000 7f7064947640 1 --2- 172.21.15.17:0/4120438033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060160e60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.167+0000 7f7064947640 1 --2- 172.21.15.17:0/4120438033 >> v2:172.21.15.142:3300/0 conn(0x7f706015add0 0x7f706006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.167+0000 7f7064947640 1 -- 172.21.15.17:0/4120438033 >> 172.21.15.17:0/4120438033 conn(0x7f70600d2b50 msgr2=0x7f70600d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:36.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.167+0000 7f7064947640 1 -- 172.21.15.17:0/4120438033 shutdown_connections 2023-08-09T12:47:36.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.167+0000 7f7064947640 1 -- 172.21.15.17:0/4120438033 wait complete. 2023-08-09T12:47:36.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.169+0000 7f7064947640 1 Processor -- start 2023-08-09T12:47:36.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.169+0000 7f7064947640 1 -- start start 2023-08-09T12:47:36.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.170+0000 7f7064947640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.170+0000 7f7064947640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706015add0 0x7f7060158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.170+0000 7f7064947640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70601613a0 0x7f70601590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.170+0000 7f7064947640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600b25b0 con 0x7f706015add0 2023-08-09T12:47:36.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.170+0000 7f7064947640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600c8c30 con 0x7f70601613a0 2023-08-09T12:47:36.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.170+0000 7f7064947640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600c8200 con 0x7f7060070320 2023-08-09T12:47:36.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706015add0 0x7f7060158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706015add0 0x7f7060158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49478/0 (socket says 172.21.15.17:49478) 2023-08-09T12:47:36.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705dd9b640 1 -- 172.21.15.17:0/2524483263 learned_addr learned my addr 172.21.15.17:0/2524483263 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:36.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705e59c640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705ed9d640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70601613a0 0x7f70601590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705dd9b640 1 -- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 msgr2=0x7f7060157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705dd9b640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705dd9b640 1 -- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70601613a0 msgr2=0x7f70601590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705dd9b640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70601613a0 0x7f70601590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705dd9b640 1 -- 172.21.15.17:0/2524483263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540094d0 con 0x7f706015add0 2023-08-09T12:47:36.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705ed9d640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70601613a0 0x7f70601590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:36.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.171+0000 7f705e59c640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:36.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.172+0000 7f705dd9b640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706015add0 0x7f7060158b70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7054000c00 tx=0x7f7054004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:36.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.172+0000 7f704effd640 1 -- 172.21.15.17:0/2524483263 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054039860 con 0x7f706015add0 2023-08-09T12:47:36.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.172+0000 7f704effd640 1 -- 172.21.15.17:0/2524483263 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70540399c0 con 0x7f706015add0 2023-08-09T12:47:36.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.172+0000 7f704effd640 1 -- 172.21.15.17:0/2524483263 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054039d70 con 0x7f706015add0 2023-08-09T12:47:36.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.172+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70600c84e0 con 0x7f706015add0 2023-08-09T12:47:36.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.172+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70600b2aa0 con 0x7f706015add0 2023-08-09T12:47:36.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.173+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70600c8700 con 0x7f706015add0 2023-08-09T12:47:36.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.174+0000 7f704effd640 1 -- 172.21.15.17:0/2524483263 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f705404d460 con 0x7f706015add0 2023-08-09T12:47:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.175+0000 7f704effd640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f704006a050 0x7f704006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.176+0000 7f704effd640 1 -- 172.21.15.17:0/2524483263 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f705403e070 con 0x7f706015add0 2023-08-09T12:47:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.176+0000 7f705e59c640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f704006a050 0x7f704006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.177+0000 7f705e59c640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f704006a050 0x7f704006c510 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7050009ac0 tx=0x7f7050008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:36.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.179+0000 7f704effd640 1 -- 172.21.15.17:0/2524483263 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7054076fc0 con 0x7f706015add0 2023-08-09T12:47:36.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.373+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7060067a80 con 0x7f706015add0 2023-08-09T12:47:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.570+0000 7f704effd640 1 -- 172.21.15.17:0/2524483263 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v143) v1 ==== 138+0+0 (secure 0 0 0) 0x7f70540340b0 con 0x7f706015add0 2023-08-09T12:47:36.574 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:47:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.578+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f704006a050 msgr2=0x7f704006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.578+0000 7f7064947640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f704006a050 0x7f704006c510 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7050009ac0 tx=0x7f7050008040 comp rx=0 tx=0).stop 2023-08-09T12:47:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.578+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706015add0 msgr2=0x7f7060158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.578+0000 7f7064947640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706015add0 0x7f7060158b70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7054000c00 tx=0x7f7054004730 comp rx=0 tx=0).stop 2023-08-09T12:47:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.580+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 shutdown_connections 2023-08-09T12:47:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.580+0000 7f7064947640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f704006a050 0x7f704006c510 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.580+0000 7f7064947640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70601613a0 0x7f70601590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.580+0000 7f7064947640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f706015add0 0x7f7060158b70 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.580+0000 7f7064947640 1 --2- 172.21.15.17:0/2524483263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7060070320 0x7f7060157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.580+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 >> 172.21.15.17:0/2524483263 conn(0x7f70600d2b50 msgr2=0x7f706015f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.580+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 shutdown_connections 2023-08-09T12:47:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.580+0000 7f7064947640 1 -- 172.21.15.17:0/2524483263 wait complete. 2023-08-09T12:47:36.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:47:36.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.826+0000 7f92a0196640 1 Processor -- start 2023-08-09T12:47:36.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.826+0000 7f92a0196640 1 -- start start 2023-08-09T12:47:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.827+0000 7f92a0196640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92980b1e30 0x7f92980b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.827+0000 7f92a0196640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92980b8930 0x7f929806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f92a0196640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980d18a0 con 0x7f929815cd10 2023-08-09T12:47:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f92a0196640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980d0d00 con 0x7f92980b1e30 2023-08-09T12:47:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f92a0196640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980d0f70 con 0x7f92980b8930 2023-08-09T12:47:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f929df32640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f929815cd10 0x7f92980b5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49404/0 (socket says 172.21.15.17:49404) 2023-08-09T12:47:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f929df32640 1 -- 172.21.15.17:0/2670168992 learned_addr learned my addr 172.21.15.17:0/2670168992 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f929d731640 1 --2- 172.21.15.17:0/2670168992 >> v2:172.21.15.142:3300/0 conn(0x7f92980b1e30 0x7f92980b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f929e733640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92980b8930 0x7f929806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442167242 0 0) 0x7f92980d18a0 con 0x7f929815cd10 2023-08-09T12:47:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.828+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9280003520 con 0x7f929815cd10 2023-08-09T12:47:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448477598 0 0) 0x7f9280003520 con 0x7f929815cd10 2023-08-09T12:47:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92980b8930 msgr2=0x7f929806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92980b8930 0x7f929806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 >> v2:172.21.15.142:3300/0 conn(0x7f92980b1e30 msgr2=0x7f92980b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 --2- 172.21.15.17:0/2670168992 >> v2:172.21.15.142:3300/0 conn(0x7f92980b1e30 0x7f92980b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980d1250 con 0x7f929815cd10 2023-08-09T12:47:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f92880019f0 con 0x7f929815cd10 2023-08-09T12:47:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 >> v1:172.21.15.17:6789/0 conn(0x7f929815cd10 legacy=0x7f92980b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9280003970 0x7f9280003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92980b8930 0x7f92800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9280004d00 0x7f9280005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980d0d00 con 0x7f9280003970 2023-08-09T12:47:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980d0f70 con 0x7f9280004d00 2023-08-09T12:47:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928000b980 con 0x7f92980b8930 2023-08-09T12:47:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.829+0000 7f929df32640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9280003970 0x7f9280003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.830+0000 7f929df32640 1 -- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92980b8930 msgr2=0x7f92800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.830+0000 7f929df32640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92980b8930 0x7f92800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.830+0000 7f929df32640 1 -- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9280004d00 msgr2=0x7f9280005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.830+0000 7f929df32640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9280004d00 0x7f9280005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.830+0000 7f929df32640 1 -- 172.21.15.17:0/2670168992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280003520 con 0x7f9280003970 2023-08-09T12:47:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.831+0000 7f929df32640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9280003970 0x7f9280003d90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f928800a830 tx=0x7f92800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7b6680e1200328 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.831+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288034630 con 0x7f9280003970 2023-08-09T12:47:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.831+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928802f070 con 0x7f9280003970 2023-08-09T12:47:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.831+0000 7f929cf30640 1 -- 172.21.15.17:0/2670168992 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92880349f0 con 0x7f9280003970 2023-08-09T12:47:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.832+0000 7f92a0196640 1 -- 172.21.15.17:0/2670168992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9280003970 msgr2=0x7f9280003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.832+0000 7f92a0196640 1 --2- 172.21.15.17:0/2670168992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9280003970 0x7f9280003d90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f928800a830 tx=0x7f92800057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.832+0000 7f929e733640 1 -- 172.21.15.17:0/2670168992 reap_dead start 2023-08-09T12:47:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.832+0000 7f92a0196640 1 -- 172.21.15.17:0/2670168992 shutdown_connections 2023-08-09T12:47:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.832+0000 7f92a0196640 1 -- 172.21.15.17:0/2670168992 >> 172.21.15.17:0/2670168992 conn(0x7f92980d2b90 msgr2=0x7f92980d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.832+0000 7f92a0196640 1 -- 172.21.15.17:0/2670168992 shutdown_connections 2023-08-09T12:47:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.832+0000 7f92a0196640 1 -- 172.21.15.17:0/2670168992 wait complete. 2023-08-09T12:47:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.834+0000 7f92a0196640 1 Processor -- start 2023-08-09T12:47:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.834+0000 7f92a0196640 1 -- start start 2023-08-09T12:47:36.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f92a0196640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9280003970 0x7f92980b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f92a0196640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92980cac20 0x7f92980cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f92a0196640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92981f5140 0x7f92981f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f92a0196640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980cb5c0 con 0x7f92980cac20 2023-08-09T12:47:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f92a0196640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b4980 con 0x7f9280003970 2023-08-09T12:47:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f92a0196640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92981f5b00 con 0x7f92981f5140 2023-08-09T12:47:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f929d731640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92980cac20 0x7f92980cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f929d731640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92980cac20 0x7f92980cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49492/0 (socket says 172.21.15.17:49492) 2023-08-09T12:47:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.835+0000 7f929d731640 1 -- 172.21.15.17:0/533716554 learned_addr learned my addr 172.21.15.17:0/533716554 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f929df32640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9280003970 0x7f92980b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f929e733640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92981f5140 0x7f92981f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f929d731640 1 -- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92981f5140 msgr2=0x7f92981f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f929d731640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92981f5140 0x7f92981f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f929d731640 1 -- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9280003970 msgr2=0x7f92980b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f929d731640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9280003970 0x7f92980b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:36.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f929d731640 1 -- 172.21.15.17:0/533716554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980cb800 con 0x7f92980cac20 2023-08-09T12:47:36.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f929d731640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92980cac20 0x7f92980cb080 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f928c00e890 tx=0x7f928c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:36.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f92967fc640 1 -- 172.21.15.17:0/533716554 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00c940 con 0x7f92980cac20 2023-08-09T12:47:36.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.836+0000 7f92967fc640 1 -- 172.21.15.17:0/533716554 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c00cac0 con 0x7f92980cac20 2023-08-09T12:47:36.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.837+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980cbae0 con 0x7f92980cac20 2023-08-09T12:47:36.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.837+0000 7f92967fc640 1 -- 172.21.15.17:0/533716554 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00ce70 con 0x7f92980cac20 2023-08-09T12:47:36.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.837+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980cc0a0 con 0x7f92980cac20 2023-08-09T12:47:36.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.838+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9298067a80 con 0x7f92980cac20 2023-08-09T12:47:36.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.839+0000 7f92967fc640 1 -- 172.21.15.17:0/533716554 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f928c013470 con 0x7f92980cac20 2023-08-09T12:47:36.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.840+0000 7f92967fc640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f928406a050 0x7f928406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:36.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.841+0000 7f92967fc640 1 -- 172.21.15.17:0/533716554 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f928c088c60 con 0x7f92980cac20 2023-08-09T12:47:36.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.841+0000 7f929df32640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f928406a050 0x7f928406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:36.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.842+0000 7f929df32640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f928406a050 0x7f928406c510 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9288034000 tx=0x7f9288009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:36.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:36.844+0000 7f92967fc640 1 -- 172.21.15.17:0/533716554 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f928c054510 con 0x7f92980cac20 2023-08-09T12:47:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.050+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f92980ccec0 con 0x7f92980cac20 2023-08-09T12:47:37.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.588+0000 7f92967fc640 1 -- 172.21.15.17:0/533716554 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v144) v1 ==== 170+0+0 (secure 0 0 0) 0x7f928c0170d0 con 0x7f92980cac20 2023-08-09T12:47:37.593 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:47:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.600+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f928406a050 msgr2=0x7f928406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.600+0000 7f92a0196640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f928406a050 0x7f928406c510 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9288034000 tx=0x7f9288009030 comp rx=0 tx=0).stop 2023-08-09T12:47:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.600+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92980cac20 msgr2=0x7f92980cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.600+0000 7f92a0196640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92980cac20 0x7f92980cb080 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f928c00e890 tx=0x7f928c00ed50 comp rx=0 tx=0).stop 2023-08-09T12:47:37.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.603+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 shutdown_connections 2023-08-09T12:47:37.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.603+0000 7f92a0196640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f928406a050 0x7f928406c510 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.603+0000 7f92a0196640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92981f5140 0x7f92981f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.603+0000 7f92a0196640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92980cac20 0x7f92980cb080 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.603+0000 7f92a0196640 1 --2- 172.21.15.17:0/533716554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9280003970 0x7f92980b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.604+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 >> 172.21.15.17:0/533716554 conn(0x7f92980d2b90 msgr2=0x7f92980b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.605+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 shutdown_connections 2023-08-09T12:47:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.605+0000 7f92a0196640 1 -- 172.21.15.17:0/533716554 wait complete. 2023-08-09T12:47:37.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:47:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.842+0000 7fe59d257640 1 Processor -- start 2023-08-09T12:47:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.842+0000 7fe59d257640 1 -- start start 2023-08-09T12:47:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe59d257640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe59815ce90 0x7fe5981616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe59d257640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5980b6000 0x7fe5980cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe59d257640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5980b6460 con 0x7fe5980d29d0 2023-08-09T12:47:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe59d257640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5980cda40 con 0x7fe59815ce90 2023-08-09T12:47:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe59d257640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980cdd10 con 0x7fe5980b6000 2023-08-09T12:47:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe596d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe59815ce90 0x7fe5981616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe596d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe59815ce90 0x7fe5981616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49506/0 (socket says 172.21.15.17:49506) 2023-08-09T12:47:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe596d9d640 1 -- 172.21.15.17:0/1997401676 learned_addr learned my addr 172.21.15.17:0/1997401676 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe596d9d640 1 -- 172.21.15.17:0/1997401676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5980b6000 msgr2=0x7fe5980cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe596d9d640 1 --2- 172.21.15.17:0/1997401676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5980b6000 0x7fe5980cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.844+0000 7fe596d9d640 1 -- 172.21.15.17:0/1997401676 >> v1:172.21.15.142:6789/0 conn(0x7fe5980d29d0 legacy=0x7fe5980d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.845+0000 7fe596d9d640 1 -- 172.21.15.17:0/1997401676 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980cdff0 con 0x7fe59815ce90 2023-08-09T12:47:37.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.846+0000 7fe596d9d640 1 --2- 172.21.15.17:0/1997401676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe59815ce90 0x7fe5981616e0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fe588009870 tx=0x7fe58802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6adc6a09ae34aa6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:37.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.846+0000 7fe59659c640 1 -- 172.21.15.17:0/1997401676 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588031640 con 0x7fe59815ce90 2023-08-09T12:47:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.846+0000 7fe59659c640 1 -- 172.21.15.17:0/1997401676 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5880317a0 con 0x7fe59815ce90 2023-08-09T12:47:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.846+0000 7fe59659c640 1 -- 172.21.15.17:0/1997401676 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588031b30 con 0x7fe59815ce90 2023-08-09T12:47:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.847+0000 7fe59d257640 1 -- 172.21.15.17:0/1997401676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe59815ce90 msgr2=0x7fe5981616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.847+0000 7fe59d257640 1 --2- 172.21.15.17:0/1997401676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe59815ce90 0x7fe5981616e0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fe588009870 tx=0x7fe58802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.847+0000 7fe59d257640 1 -- 172.21.15.17:0/1997401676 shutdown_connections 2023-08-09T12:47:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.847+0000 7fe59d257640 1 --2- 172.21.15.17:0/1997401676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5980b6000 0x7fe5980cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.847+0000 7fe59d257640 1 --2- 172.21.15.17:0/1997401676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe59815ce90 0x7fe5981616e0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.847+0000 7fe59d257640 1 -- 172.21.15.17:0/1997401676 >> 172.21.15.17:0/1997401676 conn(0x7fe59806fde0 msgr2=0x7fe5980701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:37.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.847+0000 7fe59d257640 1 -- 172.21.15.17:0/1997401676 shutdown_connections 2023-08-09T12:47:37.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.847+0000 7fe59d257640 1 -- 172.21.15.17:0/1997401676 wait complete. 2023-08-09T12:47:37.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.849+0000 7fe59d257640 1 Processor -- start 2023-08-09T12:47:37.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.849+0000 7fe59d257640 1 -- start start 2023-08-09T12:47:37.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe59d257640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5980b6000 0x7fe5980c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:37.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe59d257640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5980d29d0 0x7fe59815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:37.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe59d257640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe59815ce90 0x7fe59815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:37.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe59d257640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5981605d0 con 0x7fe5980d29d0 2023-08-09T12:47:37.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe59d257640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59815fa80 con 0x7fe5980b6000 2023-08-09T12:47:37.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe59d257640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59815fd30 con 0x7fe59815ce90 2023-08-09T12:47:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe58e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5980d29d0 0x7fe59815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe58e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5980d29d0 0x7fe59815f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49518/0 (socket says 172.21.15.17:49518) 2023-08-09T12:47:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.850+0000 7fe58e59c640 1 -- 172.21.15.17:0/3607908681 learned_addr learned my addr 172.21.15.17:0/3607908681 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe596d9d640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5980b6000 0x7fe5980c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe59759e640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe59815ce90 0x7fe59815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:37.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe58e59c640 1 -- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe59815ce90 msgr2=0x7fe59815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:37.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe58e59c640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe59815ce90 0x7fe59815f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe58e59c640 1 -- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5980b6000 msgr2=0x7fe5980c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:37.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe58e59c640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5980b6000 0x7fe5980c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:37.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe58e59c640 1 -- 172.21.15.17:0/3607908681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880094d0 con 0x7fe5980d29d0 2023-08-09T12:47:37.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe59759e640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe59815ce90 0x7fe59815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:37.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe58e59c640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5980d29d0 0x7fe59815f000 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fe58000b4a0 tx=0x7fe58000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:37.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.851+0000 7fe58ffff640 1 -- 172.21.15.17:0/3607908681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580010610 con 0x7fe5980d29d0 2023-08-09T12:47:37.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.852+0000 7fe58ffff640 1 -- 172.21.15.17:0/3607908681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580010770 con 0x7fe5980d29d0 2023-08-09T12:47:37.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.852+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe598160010 con 0x7fe5980d29d0 2023-08-09T12:47:37.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.852+0000 7fe58ffff640 1 -- 172.21.15.17:0/3607908681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580010b20 con 0x7fe5980d29d0 2023-08-09T12:47:37.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.852+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe598148c10 con 0x7fe5980d29d0 2023-08-09T12:47:37.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.853+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe598160940 con 0x7fe5980d29d0 2023-08-09T12:47:37.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.854+0000 7fe58ffff640 1 -- 172.21.15.17:0/3607908681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe580010c80 con 0x7fe5980d29d0 2023-08-09T12:47:37.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.855+0000 7fe58ffff640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe57806a050 0x7fe57806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:37.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.855+0000 7fe58ffff640 1 -- 172.21.15.17:0/3607908681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe580088200 con 0x7fe5980d29d0 2023-08-09T12:47:37.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.856+0000 7fe596d9d640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe57806a050 0x7fe57806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:37.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.857+0000 7fe596d9d640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe57806a050 0x7fe57806c510 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe588036000 tx=0x7fe58803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:37.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:37.860+0000 7fe58ffff640 1 -- 172.21.15.17:0/3607908681 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe5800538b0 con 0x7fe5980d29d0 2023-08-09T12:47:38.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.099+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe598148e30 con 0x7fe5980d29d0 2023-08-09T12:47:38.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.596+0000 7fe58ffff640 1 -- 172.21.15.17:0/3607908681 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe580056ed0 con 0x7fe5980d29d0 2023-08-09T12:47:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 17 and data pool 18 2023-08-09T12:47:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.606+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe57806a050 msgr2=0x7fe57806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.606+0000 7fe59d257640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe57806a050 0x7fe57806c510 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe588036000 tx=0x7fe58803c040 comp rx=0 tx=0).stop 2023-08-09T12:47:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.606+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5980d29d0 msgr2=0x7fe59815f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.606+0000 7fe59d257640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5980d29d0 0x7fe59815f000 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fe58000b4a0 tx=0x7fe58000b960 comp rx=0 tx=0).stop 2023-08-09T12:47:38.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.608+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 shutdown_connections 2023-08-09T12:47:38.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.608+0000 7fe59d257640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe57806a050 0x7fe57806c510 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.608+0000 7fe59d257640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe59815ce90 0x7fe59815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.609+0000 7fe59d257640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5980d29d0 0x7fe59815f000 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.609+0000 7fe59d257640 1 --2- 172.21.15.17:0/3607908681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5980b6000 0x7fe5980c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.609+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 >> 172.21.15.17:0/3607908681 conn(0x7fe59806fde0 msgr2=0x7fe5980b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:38.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.610+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 shutdown_connections 2023-08-09T12:47:38.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.611+0000 7fe59d257640 1 -- 172.21.15.17:0/3607908681 wait complete. 2023-08-09T12:47:38.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.833+0000 7f75bdb5b640 1 Processor -- start 2023-08-09T12:47:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.833+0000 7f75bdb5b640 1 -- start start 2023-08-09T12:47:38.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.834+0000 7f75bdb5b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f75b80ce590 0x7f75b8164990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.834+0000 7f75bdb5b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80ca3b0 con 0x7f75b8159bb0 2023-08-09T12:47:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.835+0000 7f75bdb5b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80ca650 con 0x7f75b80cd6f0 2023-08-09T12:47:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.835+0000 7f75bdb5b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b806c460 con 0x7f75b80ce590 2023-08-09T12:47:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.835+0000 7f75b77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f75b8159bb0 0x7f75b806bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33146/0 (socket says 172.21.15.17:33146) 2023-08-09T12:47:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.835+0000 7f75b77fe640 1 -- 172.21.15.17:0/2511746916 learned_addr learned my addr 172.21.15.17:0/2511746916 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.835+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530482551 0 0) 0x7f75b80ca3b0 con 0x7f75b8159bb0 2023-08-09T12:47:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.835+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a0005730 con 0x7f75b8159bb0 2023-08-09T12:47:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b7fff640 1 --2- 172.21.15.17:0/2511746916 >> v2:172.21.15.142:3300/0 conn(0x7f75b80ce590 0x7f75b8164990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2098298752 0 0) 0x7f75a0005730 con 0x7f75b8159bb0 2023-08-09T12:47:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 >> v2:172.21.15.142:3300/0 conn(0x7f75b80ce590 msgr2=0x7f75b8164990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 --2- 172.21.15.17:0/2511746916 >> v2:172.21.15.142:3300/0 conn(0x7f75b80ce590 0x7f75b8164990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 >> v1:172.21.15.142:6789/0 conn(0x7f75b80cd6f0 legacy=0x7f75b80cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b806c650 con 0x7f75b8159bb0 2023-08-09T12:47:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f75a8001670 con 0x7f75b8159bb0 2023-08-09T12:47:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 >> v1:172.21.15.17:6789/0 conn(0x7f75b8159bb0 legacy=0x7f75b806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75a0005b80 0x7f75a0005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75a0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75a0007390 0x7f75a000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a000e2b0 con 0x7f75a00069d0 2023-08-09T12:47:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a000e420 con 0x7f75a0007390 2023-08-09T12:47:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a000e5e0 con 0x7f75a0005b80 2023-08-09T12:47:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.836+0000 7f75b6ffd640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75a0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b6ffd640 1 -- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75a0005b80 msgr2=0x7f75a0005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b77fe640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75a0005b80 0x7f75a0005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b7fff640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75a0007390 0x7f75a000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b6ffd640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75a0005b80 0x7f75a0005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b6ffd640 1 -- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75a0007390 msgr2=0x7f75a000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b6ffd640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75a0007390 0x7f75a000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b6ffd640 1 -- 172.21.15.17:0/2511746916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0005730 con 0x7f75a00069d0 2023-08-09T12:47:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b7fff640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75a0007390 0x7f75a000db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.837+0000 7f75b7fff640 1 -- 172.21.15.17:0/2511746916 reap_dead start 2023-08-09T12:47:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.838+0000 7f75b6ffd640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75a0006e50 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f75ac001720 tx=0x7f75a0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224a064b4a9ed926 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.838+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0052d0 con 0x7f75a00069d0 2023-08-09T12:47:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.838+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac02e050 con 0x7f75a00069d0 2023-08-09T12:47:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.838+0000 7f75b67fc640 1 -- 172.21.15.17:0/2511746916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac003830 con 0x7f75a00069d0 2023-08-09T12:47:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.839+0000 7f75bdb5b640 1 -- 172.21.15.17:0/2511746916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 msgr2=0x7f75a0006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.839+0000 7f75bdb5b640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75a0006e50 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f75ac001720 tx=0x7f75a0007a00 comp rx=0 tx=0).stop 2023-08-09T12:47:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.839+0000 7f75bdb5b640 1 -- 172.21.15.17:0/2511746916 shutdown_connections 2023-08-09T12:47:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.839+0000 7f75bdb5b640 1 --2- 172.21.15.17:0/2511746916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75a0006e50 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.839+0000 7f75bdb5b640 1 -- 172.21.15.17:0/2511746916 >> 172.21.15.17:0/2511746916 conn(0x7f75b80cf930 msgr2=0x7f75b80cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.839+0000 7f75bdb5b640 1 -- 172.21.15.17:0/2511746916 shutdown_connections 2023-08-09T12:47:38.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.839+0000 7f75bdb5b640 1 -- 172.21.15.17:0/2511746916 wait complete. 2023-08-09T12:47:38.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.841+0000 7f75bdb5b640 1 Processor -- start 2023-08-09T12:47:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.841+0000 7f75bdb5b640 1 -- start start 2023-08-09T12:47:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75bdb5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75b81554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75bdb5b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75b80b0f10 0x7f75b815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75bdb5b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75b815b810 0x7f75b80cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75bdb5b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b815a560 con 0x7f75a00069d0 2023-08-09T12:47:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75bdb5b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b815a770 con 0x7f75b80b0f10 2023-08-09T12:47:38.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75bdb5b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b815aa50 con 0x7f75b815b810 2023-08-09T12:47:38.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75b77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75b81554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:38.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75b77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75b81554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59346/0 (socket says 172.21.15.17:59346) 2023-08-09T12:47:38.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.842+0000 7f75b77fe640 1 -- 172.21.15.17:0/339488290 learned_addr learned my addr 172.21.15.17:0/339488290 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:38.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75b7fff640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75b815b810 0x7f75b80cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:38.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75b6ffd640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75b80b0f10 0x7f75b815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:38.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75b77fe640 1 -- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75b815b810 msgr2=0x7f75b80cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:38.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75b77fe640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75b815b810 0x7f75b80cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75b77fe640 1 -- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75b80b0f10 msgr2=0x7f75b815a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:38.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75b77fe640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75b80b0f10 0x7f75b815a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:38.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75b77fe640 1 -- 172.21.15.17:0/339488290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b815ad30 con 0x7f75a00069d0 2023-08-09T12:47:38.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75b77fe640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75b81554b0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f75a800d770 tx=0x7f75a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:38.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f759ffff640 1 -- 172.21.15.17:0/339488290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80074e0 con 0x7f75a00069d0 2023-08-09T12:47:38.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f759ffff640 1 -- 172.21.15.17:0/339488290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8007640 con 0x7f75a00069d0 2023-08-09T12:47:38.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f759ffff640 1 -- 172.21.15.17:0/339488290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8004a00 con 0x7f75a00069d0 2023-08-09T12:47:38.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b815b010 con 0x7f75a00069d0 2023-08-09T12:47:38.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.843+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b815bcc0 con 0x7f75a00069d0 2023-08-09T12:47:38.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.845+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b815b530 con 0x7f75a00069d0 2023-08-09T12:47:38.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.845+0000 7f759ffff640 1 -- 172.21.15.17:0/339488290 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75a8004b60 con 0x7f75a00069d0 2023-08-09T12:47:38.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.847+0000 7f759ffff640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75a406a080 0x7f75a406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:38.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.847+0000 7f759ffff640 1 -- 172.21.15.17:0/339488290 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75a8087e50 con 0x7f75a00069d0 2023-08-09T12:47:38.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.848+0000 7f75b6ffd640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75a406a080 0x7f75a406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:38.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.849+0000 7f75b6ffd640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75a406a080 0x7f75a406c540 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f75ac033000 tx=0x7f75ac009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:38.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:38.852+0000 7f759ffff640 1 -- 172.21.15.17:0/339488290 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f75b815b530 con 0x7f75a00069d0 2023-08-09T12:47:39.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.050+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75b815b530 con 0x7f75a00069d0 2023-08-09T12:47:39.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.053+0000 7f759ffff640 1 -- 172.21.15.17:0/339488290 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f75b815b530 con 0x7f75a00069d0 2023-08-09T12:47:39.057 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:39.057 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":145,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:38.101242+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:47:36.431201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-09T12:47:37.108075+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:39.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75a406a080 msgr2=0x7f75a406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75a406a080 0x7f75a406c540 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f75ac033000 tx=0x7f75ac009030 comp rx=0 tx=0).stop 2023-08-09T12:47:39.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 msgr2=0x7f75b81554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75b81554b0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f75a800d770 tx=0x7f75a800dc30 comp rx=0 tx=0).stop 2023-08-09T12:47:39.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 shutdown_connections 2023-08-09T12:47:39.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f75a406a080 0x7f75a406c540 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75b815b810 0x7f75b80cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75b80b0f10 0x7f75b815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 --2- 172.21.15.17:0/339488290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a00069d0 0x7f75b81554b0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 >> 172.21.15.17:0/339488290 conn(0x7f75b80cf930 msgr2=0x7f75b8069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:39.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 shutdown_connections 2023-08-09T12:47:39.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.056+0000 7f75bdb5b640 1 -- 172.21.15.17:0/339488290 wait complete. 2023-08-09T12:47:39.078 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:39.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.302+0000 7fb1ec85e640 1 Processor -- start 2023-08-09T12:47:39.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.303+0000 7fb1ec85e640 1 -- start start 2023-08-09T12:47:39.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.304+0000 7fb1ec85e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1e80adc40 0x7fb1e806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.304+0000 7fb1ec85e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb1e80cc630 0x7fb1e80ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.304+0000 7fb1ec85e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e80b2250 con 0x7fb1e80b3b40 2023-08-09T12:47:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.304+0000 7fb1ec85e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e80ae020 con 0x7fb1e80cc630 2023-08-09T12:47:39.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.304+0000 7fb1ec85e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e80b2530 con 0x7fb1e80adc40 2023-08-09T12:47:39.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.304+0000 7fb1e6d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb1e80cc630 0x7fb1e80ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.304+0000 7fb1dffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb1e80b3b40 0x7fb1e80b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33152/0 (socket says 172.21.15.17:33152) 2023-08-09T12:47:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.305+0000 7fb1dffff640 1 -- 172.21.15.17:0/1935560204 learned_addr learned my addr 172.21.15.17:0/1935560204 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.305+0000 7fb1e659c640 1 --2- 172.21.15.17:0/1935560204 >> v2:172.21.15.142:3300/0 conn(0x7fb1e80adc40 0x7fb1e806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.305+0000 7fb1e6d9d640 1 -- 172.21.15.17:0/1935560204 >> v2:172.21.15.142:3300/0 conn(0x7fb1e80adc40 msgr2=0x7fb1e806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.305+0000 7fb1e6d9d640 1 --2- 172.21.15.17:0/1935560204 >> v2:172.21.15.142:3300/0 conn(0x7fb1e80adc40 0x7fb1e806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.305+0000 7fb1e6d9d640 1 -- 172.21.15.17:0/1935560204 >> v1:172.21.15.17:6789/0 conn(0x7fb1e80b3b40 legacy=0x7fb1e80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.305+0000 7fb1e5d9b640 1 -- 172.21.15.17:0/1935560204 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011246186 0 0) 0x7fb1e80b2250 con 0x7fb1e80b3b40 2023-08-09T12:47:39.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.305+0000 7fb1e6d9d640 1 -- 172.21.15.17:0/1935560204 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e806fe80 con 0x7fb1e80cc630 2023-08-09T12:47:39.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.306+0000 7fb1e6d9d640 1 --2- 172.21.15.17:0/1935560204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e80ccaa0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80b1320 tx=0x7fb1e002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654a719adfa8964d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:39.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1e5d9b640 1 -- 172.21.15.17:0/1935560204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e002cbf0 con 0x7fb1e80cc630 2023-08-09T12:47:39.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1e5d9b640 1 -- 172.21.15.17:0/1935560204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e002cd50 con 0x7fb1e80cc630 2023-08-09T12:47:39.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1e5d9b640 1 -- 172.21.15.17:0/1935560204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0034660 con 0x7fb1e80cc630 2023-08-09T12:47:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1ec85e640 1 -- 172.21.15.17:0/1935560204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 msgr2=0x7fb1e80ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/1935560204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e80ccaa0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80b1320 tx=0x7fb1e002be40 comp rx=0 tx=0).stop 2023-08-09T12:47:39.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1ec85e640 1 -- 172.21.15.17:0/1935560204 shutdown_connections 2023-08-09T12:47:39.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/1935560204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e80ccaa0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/1935560204 >> v2:172.21.15.142:3300/0 conn(0x7fb1e80adc40 0x7fb1e806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.307+0000 7fb1ec85e640 1 -- 172.21.15.17:0/1935560204 >> 172.21.15.17:0/1935560204 conn(0x7fb1e80cb1b0 msgr2=0x7fb1e80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.308+0000 7fb1ec85e640 1 -- 172.21.15.17:0/1935560204 shutdown_connections 2023-08-09T12:47:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.308+0000 7fb1ec85e640 1 -- 172.21.15.17:0/1935560204 wait complete. 2023-08-09T12:47:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.309+0000 7fb1ec85e640 1 Processor -- start 2023-08-09T12:47:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.310+0000 7fb1ec85e640 1 -- start start 2023-08-09T12:47:39.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1ec85e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1e80adc40 0x7fb1e80acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1ec85e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1e80b3b40 0x7fb1e80ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1ec85e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e8158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1ec85e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c94a0 con 0x7fb1e80cc630 2023-08-09T12:47:39.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1ec85e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c9780 con 0x7fb1e80adc40 2023-08-09T12:47:39.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1ec85e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c9a60 con 0x7fb1e80b3b40 2023-08-09T12:47:39.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e8158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e8158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59376/0 (socket says 172.21.15.17:59376) 2023-08-09T12:47:39.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e6d9d640 1 -- 172.21.15.17:0/2180234975 learned_addr learned my addr 172.21.15.17:0/2180234975 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:39.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1dffff640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1e80b3b40 0x7fb1e80ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e659c640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1e80adc40 0x7fb1e80acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e6d9d640 1 -- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1e80b3b40 msgr2=0x7fb1e80ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e6d9d640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1e80b3b40 0x7fb1e80ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e6d9d640 1 -- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1e80adc40 msgr2=0x7fb1e80acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e6d9d640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1e80adc40 0x7fb1e80acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e6d9d640 1 -- 172.21.15.17:0/2180234975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e0009a70 con 0x7fb1e80cc630 2023-08-09T12:47:39.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1dffff640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1e80b3b40 0x7fb1e80ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:39.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.311+0000 7fb1e659c640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1e80adc40 0x7fb1e80acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:39.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.312+0000 7fb1e6d9d640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e8158840 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb1e002c450 tx=0x7fb1e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:39.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.312+0000 7fb1deffd640 1 -- 172.21.15.17:0/2180234975 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e003e610 con 0x7fb1e80cc630 2023-08-09T12:47:39.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.312+0000 7fb1deffd640 1 -- 172.21.15.17:0/2180234975 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e003e770 con 0x7fb1e80cc630 2023-08-09T12:47:39.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.312+0000 7fb1deffd640 1 -- 172.21.15.17:0/2180234975 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e003eb20 con 0x7fb1e80cc630 2023-08-09T12:47:39.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.312+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e80c9d40 con 0x7fb1e80cc630 2023-08-09T12:47:39.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.312+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e80af8d0 con 0x7fb1e80cc630 2023-08-09T12:47:39.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.313+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e8067a80 con 0x7fb1e80cc630 2023-08-09T12:47:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.314+0000 7fb1deffd640 1 -- 172.21.15.17:0/2180234975 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb1e003b050 con 0x7fb1e80cc630 2023-08-09T12:47:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.315+0000 7fb1deffd640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb1c806a080 0x7fb1c806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.315+0000 7fb1deffd640 1 -- 172.21.15.17:0/2180234975 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb1e00aad30 con 0x7fb1e80cc630 2023-08-09T12:47:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.316+0000 7fb1e659c640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb1c806a080 0x7fb1c806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.317+0000 7fb1e659c640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb1c806a080 0x7fb1c806c540 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8006fd0 tx=0x7fb1d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:39.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.320+0000 7fb1deffd640 1 -- 172.21.15.17:0/2180234975 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb1e0076530 con 0x7fb1e80cc630 2023-08-09T12:47:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.516+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1e80af080 con 0x7fb1e80cc630 2023-08-09T12:47:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.519+0000 7fb1deffd640 1 -- 172.21.15.17:0/2180234975 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+18352 (secure 0 0 0) 0x7fb1e0039090 con 0x7fb1e80cc630 2023-08-09T12:47:39.523 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:39.523 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":145,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:38.101242+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:47:36.431201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-09T12:47:37.108075+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:39.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb1c806a080 msgr2=0x7fb1c806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb1c806a080 0x7fb1c806c540 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8006fd0 tx=0x7fb1d8008040 comp rx=0 tx=0).stop 2023-08-09T12:47:39.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 msgr2=0x7fb1e8158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e8158840 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb1e002c450 tx=0x7fb1e0004a40 comp rx=0 tx=0).stop 2023-08-09T12:47:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 shutdown_connections 2023-08-09T12:47:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb1c806a080 0x7fb1c806c540 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e80cc630 0x7fb1e8158840 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1e80b3b40 0x7fb1e80ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 --2- 172.21.15.17:0/2180234975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1e80adc40 0x7fb1e80acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 >> 172.21.15.17:0/2180234975 conn(0x7fb1e80cb1b0 msgr2=0x7fb1e8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:39.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 shutdown_connections 2023-08-09T12:47:39.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.522+0000 7fb1ec85e640 1 -- 172.21.15.17:0/2180234975 wait complete. 2023-08-09T12:47:39.546 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:47:39.557 INFO:tasks.ceph.mds.a.smithi017.stderr:2023-08-09T12:47:39.548+0000 7fc35ca7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:47:39.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.771+0000 7fd939dbf640 1 Processor -- start 2023-08-09T12:47:39.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.771+0000 7fd939dbf640 1 -- start start 2023-08-09T12:47:39.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.772+0000 7fd939dbf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd934159650 0x7fd9340b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.772+0000 7fd939dbf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd934159a30 0x7fd9340b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.772+0000 7fd939dbf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 0x7fd9340c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.772+0000 7fd939dbf640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340c95c0 con 0x7fd934159650 2023-08-09T12:47:39.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.772+0000 7fd939dbf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340c9a80 con 0x7fd934159a30 2023-08-09T12:47:39.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.772+0000 7fd939dbf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340ca010 con 0x7fd9340c8c30 2023-08-09T12:47:39.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd938dbd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd934159650 0x7fd9340b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd938dbd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd934159650 0x7fd9340b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59384/0 (socket says 172.21.15.17:59384) 2023-08-09T12:47:39.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd938dbd640 1 -- 172.21.15.17:0/3598430183 learned_addr learned my addr 172.21.15.17:0/3598430183 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:39.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd9395be640 1 --2- 172.21.15.17:0/3598430183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 0x7fd9340c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd92bfff640 1 --2- 172.21.15.17:0/3598430183 >> v2:172.21.15.142:3300/0 conn(0x7fd934159a30 0x7fd9340b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd938dbd640 1 -- 172.21.15.17:0/3598430183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 msgr2=0x7fd9340c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:39.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd938dbd640 1 --2- 172.21.15.17:0/3598430183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 0x7fd9340c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd938dbd640 1 -- 172.21.15.17:0/3598430183 >> v2:172.21.15.142:3300/0 conn(0x7fd934159a30 msgr2=0x7fd9340b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:39.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd938dbd640 1 --2- 172.21.15.17:0/3598430183 >> v2:172.21.15.142:3300/0 conn(0x7fd934159a30 0x7fd9340b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.773+0000 7fd938dbd640 1 -- 172.21.15.17:0/3598430183 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9340ca2f0 con 0x7fd934159650 2023-08-09T12:47:39.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.774+0000 7fd938dbd640 1 --2- 172.21.15.17:0/3598430183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd934159650 0x7fd9340b2870 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd93406aa80 tx=0x7fd93002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc18635e59e8e2f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:39.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.775+0000 7fd92b7fe640 1 -- 172.21.15.17:0/3598430183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93002ca80 con 0x7fd934159650 2023-08-09T12:47:39.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.775+0000 7fd92b7fe640 1 -- 172.21.15.17:0/3598430183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93002cbe0 con 0x7fd934159650 2023-08-09T12:47:39.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.775+0000 7fd92b7fe640 1 -- 172.21.15.17:0/3598430183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9300343f0 con 0x7fd934159650 2023-08-09T12:47:39.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.775+0000 7fd939dbf640 1 -- 172.21.15.17:0/3598430183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd934159650 msgr2=0x7fd9340b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.775+0000 7fd939dbf640 1 --2- 172.21.15.17:0/3598430183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd934159650 0x7fd9340b2870 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd93406aa80 tx=0x7fd93002bee0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.776+0000 7fd939dbf640 1 -- 172.21.15.17:0/3598430183 shutdown_connections 2023-08-09T12:47:39.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.776+0000 7fd939dbf640 1 --2- 172.21.15.17:0/3598430183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 0x7fd9340c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.776+0000 7fd939dbf640 1 --2- 172.21.15.17:0/3598430183 >> v2:172.21.15.142:3300/0 conn(0x7fd934159a30 0x7fd9340b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.776+0000 7fd939dbf640 1 --2- 172.21.15.17:0/3598430183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd934159650 0x7fd9340b2870 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.776+0000 7fd939dbf640 1 -- 172.21.15.17:0/3598430183 >> 172.21.15.17:0/3598430183 conn(0x7fd93406abd0 msgr2=0x7fd93406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:39.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.776+0000 7fd939dbf640 1 -- 172.21.15.17:0/3598430183 shutdown_connections 2023-08-09T12:47:39.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.776+0000 7fd939dbf640 1 -- 172.21.15.17:0/3598430183 wait complete. 2023-08-09T12:47:39.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.778+0000 7fd939dbf640 1 Processor -- start 2023-08-09T12:47:39.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.778+0000 7fd939dbf640 1 -- start start 2023-08-09T12:47:39.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.779+0000 7fd939dbf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 0x7fd9341eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.779+0000 7fd939dbf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd934159650 0x7fd934070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.779+0000 7fd939dbf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341eed90 0x7fd9340af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.779+0000 7fd939dbf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9341f1730 con 0x7fd9341eed90 2023-08-09T12:47:39.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.779+0000 7fd939dbf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340719a0 con 0x7fd934159650 2023-08-09T12:47:39.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.779+0000 7fd939dbf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9341f1f60 con 0x7fd9340c8c30 2023-08-09T12:47:39.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd9395be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341eed90 0x7fd9340af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd9395be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341eed90 0x7fd9340af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59392/0 (socket says 172.21.15.17:59392) 2023-08-09T12:47:39.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd9395be640 1 -- 172.21.15.17:0/41177623 learned_addr learned my addr 172.21.15.17:0/41177623 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:39.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd938dbd640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 0x7fd9341eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd92bfff640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd934159650 0x7fd934070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd9395be640 1 -- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 msgr2=0x7fd9341eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd9395be640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 0x7fd9341eda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd9395be640 1 -- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd934159650 msgr2=0x7fd934070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:39.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd9395be640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd934159650 0x7fd934070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:39.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.780+0000 7fd9395be640 1 -- 172.21.15.17:0/41177623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd930009b30 con 0x7fd9341eed90 2023-08-09T12:47:39.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.781+0000 7fd9395be640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341eed90 0x7fd9340af460 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00d5d0 tx=0x7fd92c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:39.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.781+0000 7fd9297fa640 1 -- 172.21.15.17:0/41177623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0125f0 con 0x7fd9341eed90 2023-08-09T12:47:39.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.781+0000 7fd9297fa640 1 -- 172.21.15.17:0/41177623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c012770 con 0x7fd9341eed90 2023-08-09T12:47:39.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.781+0000 7fd9297fa640 1 -- 172.21.15.17:0/41177623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c012b20 con 0x7fd9341eed90 2023-08-09T12:47:39.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.781+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9340716c0 con 0x7fd9341eed90 2023-08-09T12:47:39.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.781+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9341f1bf0 con 0x7fd9341eed90 2023-08-09T12:47:39.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.782+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9341f20f0 con 0x7fd9341eed90 2023-08-09T12:47:39.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.784+0000 7fd9297fa640 1 -- 172.21.15.17:0/41177623 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd92c012c80 con 0x7fd9341eed90 2023-08-09T12:47:39.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.785+0000 7fd9297fa640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd92006a050 0x7fd92006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:39.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.785+0000 7fd9297fa640 1 -- 172.21.15.17:0/41177623 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd92c088ab0 con 0x7fd9341eed90 2023-08-09T12:47:39.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.786+0000 7fd938dbd640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd92006a050 0x7fd92006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:39.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.787+0000 7fd938dbd640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd92006a050 0x7fd92006c510 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd930035000 tx=0x7fd930030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:39.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:39.791+0000 7fd9297fa640 1 -- 172.21.15.17:0/41177623 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd92c054110 con 0x7fd9341eed90 2023-08-09T12:47:40.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.022+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd93404e390 con 0x7fd9341eed90 2023-08-09T12:47:40.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.843+0000 7fd9297fa640 1 -- 172.21.15.17:0/41177623 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd92c057730 con 0x7fd9341eed90 2023-08-09T12:47:40.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd92006a050 msgr2=0x7fd92006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:40.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd92006a050 0x7fd92006c510 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd930035000 tx=0x7fd930030000 comp rx=0 tx=0).stop 2023-08-09T12:47:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341eed90 msgr2=0x7fd9340af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341eed90 0x7fd9340af460 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00d5d0 tx=0x7fd92c00da90 comp rx=0 tx=0).stop 2023-08-09T12:47:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 shutdown_connections 2023-08-09T12:47:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd92006a050 0x7fd92006c510 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341eed90 0x7fd9340af460 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd934159650 0x7fd934070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 --2- 172.21.15.17:0/41177623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9340c8c30 0x7fd9341eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 >> 172.21.15.17:0/41177623 conn(0x7fd93406abd0 msgr2=0x7fd934151e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 shutdown_connections 2023-08-09T12:47:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:40.846+0000 7fd939dbf640 1 -- 172.21.15.17:0/41177623 wait complete. 2023-08-09T12:47:40.872 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:47:40.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:47:41.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.107+0000 7fe19a078640 1 Processor -- start 2023-08-09T12:47:41.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.107+0000 7fe19a078640 1 -- start start 2023-08-09T12:47:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.108+0000 7fe19a078640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1940b21c0 0x7fe1940c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.108+0000 7fe19a078640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1940c2670 0x7fe1940c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.108+0000 7fe19a078640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1940c8c30 con 0x7fe19415ab40 2023-08-09T12:47:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.108+0000 7fe19a078640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1940cb770 con 0x7fe1940c2670 2023-08-09T12:47:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.108+0000 7fe19a078640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940cb9d0 con 0x7fe1940b21c0 2023-08-09T12:47:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.108+0000 7fe199076640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe19415ab40 0x7fe1940cb060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33162/0 (socket says 172.21.15.17:33162) 2023-08-09T12:47:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.108+0000 7fe199076640 1 -- 172.21.15.17:0/3684716708 learned_addr learned my addr 172.21.15.17:0/3684716708 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe198875640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1940b21c0 0x7fe1940c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe199877640 1 --2- 172.21.15.17:0/3684716708 >> v2:172.21.15.142:3300/0 conn(0x7fe1940c2670 0x7fe1940c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166912631 0 0) 0x7fe1940c8c30 con 0x7fe19415ab40 2023-08-09T12:47:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe180003520 con 0x7fe19415ab40 2023-08-09T12:47:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131629984 0 0) 0x7fe180003520 con 0x7fe19415ab40 2023-08-09T12:47:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1940b21c0 msgr2=0x7fe1940c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1940b21c0 0x7fe1940c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 >> v2:172.21.15.142:3300/0 conn(0x7fe1940c2670 msgr2=0x7fe1940c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 --2- 172.21.15.17:0/3684716708 >> v2:172.21.15.142:3300/0 conn(0x7fe1940c2670 0x7fe1940c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940c8e80 con 0x7fe19415ab40 2023-08-09T12:47:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe1900019f0 con 0x7fe19415ab40 2023-08-09T12:47:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 >> v1:172.21.15.17:6789/0 conn(0x7fe19415ab40 legacy=0x7fe1940cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe180003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1940b21c0 0x7fe1800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.109+0000 7fe18bfff640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe180004d00 0x7fe180005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940cb770 con 0x7fe180003970 2023-08-09T12:47:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940cb9d0 con 0x7fe180004d00 2023-08-09T12:47:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18000b980 con 0x7fe1940b21c0 2023-08-09T12:47:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe199076640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe180003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe199877640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe180004d00 0x7fe180005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe198875640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1940b21c0 0x7fe1800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe199076640 1 -- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1940b21c0 msgr2=0x7fe1800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe199076640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1940b21c0 0x7fe1800047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe199076640 1 -- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe180004d00 msgr2=0x7fe180005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe199076640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe180004d00 0x7fe180005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe199076640 1 -- 172.21.15.17:0/3684716708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180003520 con 0x7fe180003970 2023-08-09T12:47:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.110+0000 7fe199877640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe180004d00 0x7fe180005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.111+0000 7fe199076640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe180003d90 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe19000a860 tx=0x7fe1800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314a776bdaa37f14 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.112+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190034630 con 0x7fe180003970 2023-08-09T12:47:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.112+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19002f070 con 0x7fe180003970 2023-08-09T12:47:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.112+0000 7fe18bfff640 1 -- 172.21.15.17:0/3684716708 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900349f0 con 0x7fe180003970 2023-08-09T12:47:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.112+0000 7fe19a078640 1 -- 172.21.15.17:0/3684716708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 msgr2=0x7fe180003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.112+0000 7fe19a078640 1 --2- 172.21.15.17:0/3684716708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe180003d90 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe19000a860 tx=0x7fe1800057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.113+0000 7fe199877640 1 -- 172.21.15.17:0/3684716708 reap_dead start 2023-08-09T12:47:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.113+0000 7fe19a078640 1 -- 172.21.15.17:0/3684716708 shutdown_connections 2023-08-09T12:47:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.113+0000 7fe19a078640 1 -- 172.21.15.17:0/3684716708 >> 172.21.15.17:0/3684716708 conn(0x7fe19406abd0 msgr2=0x7fe19406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.113+0000 7fe19a078640 1 -- 172.21.15.17:0/3684716708 shutdown_connections 2023-08-09T12:47:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.113+0000 7fe19a078640 1 -- 172.21.15.17:0/3684716708 wait complete. 2023-08-09T12:47:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.114+0000 7fe19a078640 1 Processor -- start 2023-08-09T12:47:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.115+0000 7fe19a078640 1 -- start start 2023-08-09T12:47:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe19a078640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe194156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe19a078640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe194158f10 0x7fe194070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe19a078640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe194159390 0x7fe194070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe19a078640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194157df0 con 0x7fe180003970 2023-08-09T12:47:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe19a078640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194158090 con 0x7fe194159390 2023-08-09T12:47:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe19a078640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe194158370 con 0x7fe194158f10 2023-08-09T12:47:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe199076640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe194156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe199076640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe194156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59408/0 (socket says 172.21.15.17:59408) 2023-08-09T12:47:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe199076640 1 -- 172.21.15.17:0/2841852905 learned_addr learned my addr 172.21.15.17:0/2841852905 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe198875640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe194158f10 0x7fe194070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.116+0000 7fe199877640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe194159390 0x7fe194070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe199076640 1 -- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe194158f10 msgr2=0x7fe194070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe199076640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe194158f10 0x7fe194070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe199076640 1 -- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe194159390 msgr2=0x7fe194070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe199076640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe194159390 0x7fe194070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe199076640 1 -- 172.21.15.17:0/2841852905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe194158650 con 0x7fe180003970 2023-08-09T12:47:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe199076640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe194156940 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fe19000a860 tx=0x7fe190001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe189ffb640 1 -- 172.21.15.17:0/2841852905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190034430 con 0x7fe180003970 2023-08-09T12:47:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe189ffb640 1 -- 172.21.15.17:0/2841852905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1900345b0 con 0x7fe180003970 2023-08-09T12:47:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe194158930 con 0x7fe180003970 2023-08-09T12:47:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe189ffb640 1 -- 172.21.15.17:0/2841852905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190034960 con 0x7fe180003970 2023-08-09T12:47:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.117+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19415dd50 con 0x7fe180003970 2023-08-09T12:47:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.118+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19404e390 con 0x7fe180003970 2023-08-09T12:47:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.119+0000 7fe189ffb640 1 -- 172.21.15.17:0/2841852905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe190031030 con 0x7fe180003970 2023-08-09T12:47:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.120+0000 7fe189ffb640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe17806a050 0x7fe17806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.120+0000 7fe189ffb640 1 -- 172.21.15.17:0/2841852905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1900aa4a0 con 0x7fe180003970 2023-08-09T12:47:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.121+0000 7fe198875640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe17806a050 0x7fe17806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.122+0000 7fe198875640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe17806a050 0x7fe17806c510 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe1940cb5c0 tx=0x7fe184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.124+0000 7fe189ffb640 1 -- 172.21.15.17:0/2841852905 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe190075af0 con 0x7fe180003970 2023-08-09T12:47:41.345 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:47:41.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:47:41.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.360+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe194158ac0 con 0x7fe180003970 2023-08-09T12:47:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.847+0000 7fe189ffb640 1 -- 172.21.15.17:0/2841852905 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe190079110 con 0x7fe180003970 2023-08-09T12:47:41.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe17806a050 msgr2=0x7fe17806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:41.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe17806a050 0x7fe17806c510 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe1940cb5c0 tx=0x7fe184008040 comp rx=0 tx=0).stop 2023-08-09T12:47:41.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 msgr2=0x7fe194156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:41.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe194156940 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fe19000a860 tx=0x7fe190001d80 comp rx=0 tx=0).stop 2023-08-09T12:47:41.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 shutdown_connections 2023-08-09T12:47:41.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe17806a050 0x7fe17806c510 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe194159390 0x7fe194070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe194158f10 0x7fe194070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 --2- 172.21.15.17:0/2841852905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180003970 0x7fe194156940 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:41.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.850+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 >> 172.21.15.17:0/2841852905 conn(0x7fe19406abd0 msgr2=0x7fe1940cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:41.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.851+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 shutdown_connections 2023-08-09T12:47:41.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:41.851+0000 7fe19a078640 1 -- 172.21.15.17:0/2841852905 wait complete. 2023-08-09T12:47:41.874 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:47:41.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.098+0000 7ff0f5838640 1 Processor -- start 2023-08-09T12:47:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.098+0000 7ff0f5838640 1 -- start start 2023-08-09T12:47:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.100+0000 7ff0f5838640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff0f00adc40 0x7ff0f006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.100+0000 7ff0f5838640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f00b2250 con 0x7ff0f00cc630 2023-08-09T12:47:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.100+0000 7ff0f5838640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f00b2530 con 0x7ff0f00b3b40 2023-08-09T12:47:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.100+0000 7ff0f5838640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f00ae020 con 0x7ff0f00adc40 2023-08-09T12:47:42.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.100+0000 7ff0eeffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff0f00adc40 0x7ff0f006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.100+0000 7ff0eeffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff0f00adc40 0x7ff0f006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59416/0 (socket says 172.21.15.17:59416) 2023-08-09T12:47:42.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.100+0000 7ff0eeffd640 1 -- 172.21.15.17:0/1347407381 learned_addr learned my addr 172.21.15.17:0/1347407381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:42.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.101+0000 7ff0eeffd640 1 -- 172.21.15.17:0/1347407381 >> v1:172.21.15.142:6789/0 conn(0x7ff0f00b3b40 legacy=0x7ff0f00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:42.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.101+0000 7ff0eeffd640 1 -- 172.21.15.17:0/1347407381 >> v1:172.21.15.17:6789/0 conn(0x7ff0f00cc630 legacy=0x7ff0f00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.101+0000 7ff0eeffd640 1 -- 172.21.15.17:0/1347407381 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f006fe80 con 0x7ff0f00adc40 2023-08-09T12:47:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.101+0000 7ff0edffb640 1 -- 172.21.15.17:0/1347407381 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462627883 0 0) 0x7ff0f00b2250 con 0x7ff0f00cc630 2023-08-09T12:47:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.102+0000 7ff0eeffd640 1 --2- 172.21.15.17:0/1347407381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f006c280 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009870 tx=0x7ff0e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16542b0186568b7d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:42.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.102+0000 7ff0edffb640 1 -- 172.21.15.17:0/1347407381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0030860 con 0x7ff0f00adc40 2023-08-09T12:47:42.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.102+0000 7ff0edffb640 1 -- 172.21.15.17:0/1347407381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e00309c0 con 0x7ff0f00adc40 2023-08-09T12:47:42.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.102+0000 7ff0edffb640 1 -- 172.21.15.17:0/1347407381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0030d50 con 0x7ff0f00adc40 2023-08-09T12:47:42.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.103+0000 7ff0f5838640 1 -- 172.21.15.17:0/1347407381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 msgr2=0x7ff0f006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.103+0000 7ff0f5838640 1 --2- 172.21.15.17:0/1347407381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f006c280 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009870 tx=0x7ff0e002b9a0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.103+0000 7ff0f5838640 1 -- 172.21.15.17:0/1347407381 shutdown_connections 2023-08-09T12:47:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.103+0000 7ff0f5838640 1 --2- 172.21.15.17:0/1347407381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f006c280 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.103+0000 7ff0f5838640 1 -- 172.21.15.17:0/1347407381 >> 172.21.15.17:0/1347407381 conn(0x7ff0f00cb1b0 msgr2=0x7ff0f00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.103+0000 7ff0f5838640 1 -- 172.21.15.17:0/1347407381 shutdown_connections 2023-08-09T12:47:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.103+0000 7ff0f5838640 1 -- 172.21.15.17:0/1347407381 wait complete. 2023-08-09T12:47:42.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.105+0000 7ff0f5838640 1 Processor -- start 2023-08-09T12:47:42.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.105+0000 7ff0f5838640 1 -- start start 2023-08-09T12:47:42.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.106+0000 7ff0f5838640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f00c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.106+0000 7ff0f5838640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0f00b3b40 0x7ff0f01471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.106+0000 7ff0f5838640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0f00cc630 0x7ff0f00c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.106+0000 7ff0f5838640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00caa50 con 0x7ff0f00adc40 2023-08-09T12:47:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.106+0000 7ff0f5838640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00c4090 con 0x7ff0f00b3b40 2023-08-09T12:47:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.106+0000 7ff0f5838640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0147720 con 0x7ff0f00cc630 2023-08-09T12:47:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f00c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f00c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59418/0 (socket says 172.21.15.17:59418) 2023-08-09T12:47:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0eeffd640 1 -- 172.21.15.17:0/3061456352 learned_addr learned my addr 172.21.15.17:0/3061456352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0ef7fe640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0f00cc630 0x7ff0f00c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0ee7fc640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0f00b3b40 0x7ff0f01471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0eeffd640 1 -- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0f00cc630 msgr2=0x7ff0f00c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0eeffd640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0f00cc630 0x7ff0f00c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0eeffd640 1 -- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0f00b3b40 msgr2=0x7ff0f01471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0eeffd640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0f00b3b40 0x7ff0f01471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.107+0000 7ff0eeffd640 1 -- 172.21.15.17:0/3061456352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e00094d0 con 0x7ff0f00adc40 2023-08-09T12:47:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.108+0000 7ff0eeffd640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f00c9860 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009870 tx=0x7ff0e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.108+0000 7ff0d7fff640 1 -- 172.21.15.17:0/3061456352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0030810 con 0x7ff0f00adc40 2023-08-09T12:47:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.108+0000 7ff0d7fff640 1 -- 172.21.15.17:0/3061456352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0043400 con 0x7ff0f00adc40 2023-08-09T12:47:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.108+0000 7ff0d7fff640 1 -- 172.21.15.17:0/3061456352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00437b0 con 0x7ff0f00adc40 2023-08-09T12:47:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.108+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f00c9e40 con 0x7ff0f00adc40 2023-08-09T12:47:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.108+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f00ca400 con 0x7ff0f00adc40 2023-08-09T12:47:42.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.109+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f0067a80 con 0x7ff0f00adc40 2023-08-09T12:47:42.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.110+0000 7ff0d7fff640 1 -- 172.21.15.17:0/3061456352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff0e0043910 con 0x7ff0f00adc40 2023-08-09T12:47:42.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.111+0000 7ff0d7fff640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff0dc06a050 0x7ff0dc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.111+0000 7ff0d7fff640 1 -- 172.21.15.17:0/3061456352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0e003e070 con 0x7ff0f00adc40 2023-08-09T12:47:42.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.112+0000 7ff0ee7fc640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff0dc06a050 0x7ff0dc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.113+0000 7ff0ee7fc640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff0dc06a050 0x7ff0dc06c510 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff0f01f58b0 tx=0x7ff0e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:42.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.116+0000 7ff0d7fff640 1 -- 172.21.15.17:0/3061456352 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff0e0076fc0 con 0x7ff0f00adc40 2023-08-09T12:47:42.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.347+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0f006ed40 con 0x7ff0f00adc40 2023-08-09T12:47:42.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.348+0000 7ff0d7fff640 1 -- 172.21.15.17:0/3061456352 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7ff0e0034090 con 0x7ff0f00adc40 2023-08-09T12:47:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:42.351 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:47:42.352 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:47:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff0dc06a050 msgr2=0x7ff0dc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff0dc06a050 0x7ff0dc06c510 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff0f01f58b0 tx=0x7ff0e4009040 comp rx=0 tx=0).stop 2023-08-09T12:47:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 msgr2=0x7ff0f00c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f00c9860 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009870 tx=0x7ff0e0004730 comp rx=0 tx=0).stop 2023-08-09T12:47:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 shutdown_connections 2023-08-09T12:47:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff0dc06a050 0x7ff0dc06c510 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0f00cc630 0x7ff0f00c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0f00b3b40 0x7ff0f01471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 --2- 172.21.15.17:0/3061456352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f00adc40 0x7ff0f00c9860 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 >> 172.21.15.17:0/3061456352 conn(0x7ff0f00cb1b0 msgr2=0x7ff0f006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 shutdown_connections 2023-08-09T12:47:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.350+0000 7ff0f5838640 1 -- 172.21.15.17:0/3061456352 wait complete. 2023-08-09T12:47:42.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:47:42.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.593+0000 7fc176bab640 1 Processor -- start 2023-08-09T12:47:42.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.594+0000 7fc176bab640 1 -- start start 2023-08-09T12:47:42.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.595+0000 7fc176bab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1700adc40 0x7fc17006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.595+0000 7fc176bab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700b3b40 0x7fc1700b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.595+0000 7fc176bab640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1700b2250 con 0x7fc17015e8f0 2023-08-09T12:47:42.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.595+0000 7fc176bab640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1700ae020 con 0x7fc1700adc40 2023-08-09T12:47:42.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.595+0000 7fc176bab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b2530 con 0x7fc1700b3b40 2023-08-09T12:47:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.596+0000 7fc175148640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc17015e8f0 0x7fc17015ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33176/0 (socket says 172.21.15.17:33176) 2023-08-09T12:47:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.596+0000 7fc175148640 1 -- 172.21.15.17:0/2726333580 learned_addr learned my addr 172.21.15.17:0/2726333580 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.596+0000 7fc174947640 1 --2- 172.21.15.17:0/2726333580 >> v2:172.21.15.142:3300/0 conn(0x7fc1700adc40 0x7fc17006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.596+0000 7fc167fff640 1 --2- 172.21.15.17:0/2726333580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700b3b40 0x7fc1700b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.597+0000 7fc1677fe640 1 -- 172.21.15.17:0/2726333580 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776060363 0 0) 0x7fc1700b2250 con 0x7fc17015e8f0 2023-08-09T12:47:42.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.597+0000 7fc1677fe640 1 -- 172.21.15.17:0/2726333580 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc158003520 con 0x7fc17015e8f0 2023-08-09T12:47:42.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.597+0000 7fc174947640 1 -- 172.21.15.17:0/2726333580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700b3b40 msgr2=0x7fc1700b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:42.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.597+0000 7fc174947640 1 --2- 172.21.15.17:0/2726333580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700b3b40 0x7fc1700b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.597+0000 7fc174947640 1 -- 172.21.15.17:0/2726333580 >> v1:172.21.15.17:6789/0 conn(0x7fc17015e8f0 legacy=0x7fc17015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.597+0000 7fc174947640 1 -- 172.21.15.17:0/2726333580 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17006fe80 con 0x7fc1700adc40 2023-08-09T12:47:42.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.598+0000 7fc174947640 1 --2- 172.21.15.17:0/2726333580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1700adc40 0x7fc17006c280 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009d90 tx=0x7fc16c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc9c491a1e98d1e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:42.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.599+0000 7fc1677fe640 1 -- 172.21.15.17:0/2726333580 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c02cc60 con 0x7fc1700adc40 2023-08-09T12:47:42.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.599+0000 7fc1677fe640 1 -- 172.21.15.17:0/2726333580 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c02cdc0 con 0x7fc1700adc40 2023-08-09T12:47:42.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.599+0000 7fc1677fe640 1 -- 172.21.15.17:0/2726333580 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c034640 con 0x7fc1700adc40 2023-08-09T12:47:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.599+0000 7fc176bab640 1 -- 172.21.15.17:0/2726333580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1700adc40 msgr2=0x7fc17006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.599+0000 7fc176bab640 1 --2- 172.21.15.17:0/2726333580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1700adc40 0x7fc17006c280 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009d90 tx=0x7fc16c02beb0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.600+0000 7fc176bab640 1 -- 172.21.15.17:0/2726333580 shutdown_connections 2023-08-09T12:47:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.600+0000 7fc176bab640 1 --2- 172.21.15.17:0/2726333580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700b3b40 0x7fc1700b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.600+0000 7fc176bab640 1 --2- 172.21.15.17:0/2726333580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1700adc40 0x7fc17006c280 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.600+0000 7fc176bab640 1 -- 172.21.15.17:0/2726333580 >> 172.21.15.17:0/2726333580 conn(0x7fc1700cb1b0 msgr2=0x7fc1700cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.600+0000 7fc176bab640 1 -- 172.21.15.17:0/2726333580 shutdown_connections 2023-08-09T12:47:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.600+0000 7fc176bab640 1 -- 172.21.15.17:0/2726333580 wait complete. 2023-08-09T12:47:42.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.602+0000 7fc176bab640 1 Processor -- start 2023-08-09T12:47:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.602+0000 7fc176bab640 1 -- start start 2023-08-09T12:47:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc176bab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700adc40 0x7fc17015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc176bab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1700b3b40 0x7fc1700c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc176bab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17015e8f0 0x7fc1700c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc176bab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1701e4e00 con 0x7fc1700b3b40 2023-08-09T12:47:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc176bab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17015c090 con 0x7fc17015e8f0 2023-08-09T12:47:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc176bab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17015bb40 con 0x7fc1700adc40 2023-08-09T12:47:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc167fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1700b3b40 0x7fc1700c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc167fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1700b3b40 0x7fc1700c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59424/0 (socket says 172.21.15.17:59424) 2023-08-09T12:47:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc167fff640 1 -- 172.21.15.17:0/3994797264 learned_addr learned my addr 172.21.15.17:0/3994797264 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc174947640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700adc40 0x7fc17015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc175148640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17015e8f0 0x7fc1700c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc167fff640 1 -- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700adc40 msgr2=0x7fc17015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc167fff640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700adc40 0x7fc17015b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc167fff640 1 -- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17015e8f0 msgr2=0x7fc1700c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc167fff640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17015e8f0 0x7fc1700c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc167fff640 1 -- 172.21.15.17:0/3994797264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c009a70 con 0x7fc1700b3b40 2023-08-09T12:47:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.603+0000 7fc174947640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700adc40 0x7fc17015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.604+0000 7fc175148640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17015e8f0 0x7fc1700c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.604+0000 7fc167fff640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1700b3b40 0x7fc1700c41d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e930 tx=0x7fc16000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.604+0000 7fc1657fa640 1 -- 172.21.15.17:0/3994797264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160009660 con 0x7fc1700b3b40 2023-08-09T12:47:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.604+0000 7fc1657fa640 1 -- 172.21.15.17:0/3994797264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16000c9a0 con 0x7fc1700b3b40 2023-08-09T12:47:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.604+0000 7fc1657fa640 1 -- 172.21.15.17:0/3994797264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16000cd10 con 0x7fc1700b3b40 2023-08-09T12:47:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.604+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1701e7090 con 0x7fc1700b3b40 2023-08-09T12:47:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.604+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1701e7650 con 0x7fc1700b3b40 2023-08-09T12:47:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.605+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1701e4f40 con 0x7fc1700b3b40 2023-08-09T12:47:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.606+0000 7fc1657fa640 1 -- 172.21.15.17:0/3994797264 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc160013470 con 0x7fc1700b3b40 2023-08-09T12:47:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.608+0000 7fc1657fa640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc15c06a050 0x7fc15c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.608+0000 7fc1657fa640 1 -- 172.21.15.17:0/3994797264 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc160088c10 con 0x7fc1700b3b40 2023-08-09T12:47:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.608+0000 7fc174947640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc15c06a050 0x7fc15c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.610+0000 7fc174947640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc15c06a050 0x7fc15c06c510 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc16c036000 tx=0x7fc16c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.612+0000 7fc1657fa640 1 -- 172.21.15.17:0/3994797264 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc1701e4f40 con 0x7fc1700b3b40 2023-08-09T12:47:42.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.820+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1701e4f40 con 0x7fc1700b3b40 2023-08-09T12:47:42.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.821+0000 7fc1657fa640 1 -- 172.21.15.17:0/3994797264 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+18339 (secure 0 0 0) 0x7fc1701e4f40 con 0x7fc1700b3b40 2023-08-09T12:47:42.825 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:42.825 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":146,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:47:39.586967+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:47:36.431201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-09T12:47:37.108075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:47:42.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc15c06a050 msgr2=0x7fc15c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc15c06a050 0x7fc15c06c510 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc16c036000 tx=0x7fc16c030000 comp rx=0 tx=0).stop 2023-08-09T12:47:42.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1700b3b40 msgr2=0x7fc1700c41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:42.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1700b3b40 0x7fc1700c41d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e930 tx=0x7fc16000edf0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 shutdown_connections 2023-08-09T12:47:42.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc15c06a050 0x7fc15c06c510 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc17015e8f0 0x7fc1700c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1700b3b40 0x7fc1700c41d0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 --2- 172.21.15.17:0/3994797264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1700adc40 0x7fc17015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:42.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 >> 172.21.15.17:0/3994797264 conn(0x7fc1700cb1b0 msgr2=0x7fc17015db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:42.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 shutdown_connections 2023-08-09T12:47:42.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:42.824+0000 7fc176bab640 1 -- 172.21.15.17:0/3994797264 wait complete. 2023-08-09T12:47:42.848 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:47:42.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:47:43.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.067+0000 7fd2f34ed640 1 Processor -- start 2023-08-09T12:47:43.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.067+0000 7fd2f34ed640 1 -- start start 2023-08-09T12:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f34ed640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2ec1601f0 0x7fd2ec0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f34ed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0b2ee0 0x7fd2ec0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f34ed640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec0c3250 con 0x7fd2ec0cb440 2023-08-09T12:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f34ed640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0b4120 con 0x7fd2ec1601f0 2023-08-09T12:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f34ed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0cb870 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f24eb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2ec1601f0 0x7fd2ec0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f24eb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2ec1601f0 0x7fd2ec0b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59434/0 (socket says 172.21.15.17:59434) 2023-08-09T12:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f24eb640 1 -- 172.21.15.17:0/3951837561 learned_addr learned my addr 172.21.15.17:0/3951837561 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.069+0000 7fd2f2cec640 1 --1- 172.21.15.17:0/3951837561 >> v1:172.21.15.17:6789/0 conn(0x7fd2ec0cb440 0x7fd2ec0697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33180/0 (socket says 172.21.15.17:33180) 2023-08-09T12:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.070+0000 7fd2f1cea640 1 --2- 172.21.15.17:0/3951837561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0b2ee0 0x7fd2ec0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.070+0000 7fd2f24eb640 1 -- 172.21.15.17:0/3951837561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0b2ee0 msgr2=0x7fd2ec0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.070+0000 7fd2f24eb640 1 --2- 172.21.15.17:0/3951837561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0b2ee0 0x7fd2ec0caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.070+0000 7fd2f24eb640 1 -- 172.21.15.17:0/3951837561 >> v1:172.21.15.17:6789/0 conn(0x7fd2ec0cb440 legacy=0x7fd2ec0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.070+0000 7fd2f24eb640 1 -- 172.21.15.17:0/3951837561 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0b34a0 con 0x7fd2ec1601f0 2023-08-09T12:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.071+0000 7fd2f24eb640 1 --2- 172.21.15.17:0/3951837561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec1601f0 0x7fd2ec0b29a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009870 tx=0x7fd2e802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4d1ea218fb24ee server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.071+0000 7fd2f14e9640 1 -- 172.21.15.17:0/3951837561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8030840 con 0x7fd2ec1601f0 2023-08-09T12:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.071+0000 7fd2f14e9640 1 -- 172.21.15.17:0/3951837561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e80309a0 con 0x7fd2ec1601f0 2023-08-09T12:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.071+0000 7fd2f14e9640 1 -- 172.21.15.17:0/3951837561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8030d30 con 0x7fd2ec1601f0 2023-08-09T12:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.072+0000 7fd2f34ed640 1 -- 172.21.15.17:0/3951837561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec1601f0 msgr2=0x7fd2ec0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.072+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/3951837561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec1601f0 0x7fd2ec0b29a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009870 tx=0x7fd2e802b980 comp rx=0 tx=0).stop 2023-08-09T12:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.072+0000 7fd2f34ed640 1 -- 172.21.15.17:0/3951837561 shutdown_connections 2023-08-09T12:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.072+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/3951837561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0b2ee0 0x7fd2ec0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.072+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/3951837561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec1601f0 0x7fd2ec0b29a0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.072+0000 7fd2f34ed640 1 -- 172.21.15.17:0/3951837561 >> 172.21.15.17:0/3951837561 conn(0x7fd2ec0b1d50 msgr2=0x7fd2ec06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.072+0000 7fd2f34ed640 1 -- 172.21.15.17:0/3951837561 shutdown_connections 2023-08-09T12:47:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.072+0000 7fd2f34ed640 1 -- 172.21.15.17:0/3951837561 wait complete. 2023-08-09T12:47:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.074+0000 7fd2f34ed640 1 Processor -- start 2023-08-09T12:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.074+0000 7fd2f34ed640 1 -- start start 2023-08-09T12:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.075+0000 7fd2f34ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec0b2ee0 0x7fd2ec158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.075+0000 7fd2f34ed640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0cb440 0x7fd2ec06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.075+0000 7fd2f34ed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1601f0 0x7fd2ec15c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.075+0000 7fd2f34ed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec159270 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.075+0000 7fd2f34ed640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c6c90 con 0x7fd2ec0cb440 2023-08-09T12:47:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.075+0000 7fd2f34ed640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec070010 con 0x7fd2ec1601f0 2023-08-09T12:47:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.075+0000 7fd2f24eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec0b2ee0 0x7fd2ec158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f24eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec0b2ee0 0x7fd2ec158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59444/0 (socket says 172.21.15.17:59444) 2023-08-09T12:47:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f24eb640 1 -- 172.21.15.17:0/1115441646 learned_addr learned my addr 172.21.15.17:0/1115441646 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f2cec640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1601f0 0x7fd2ec15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f1cea640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0cb440 0x7fd2ec06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f24eb640 1 -- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1601f0 msgr2=0x7fd2ec15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f24eb640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1601f0 0x7fd2ec15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f24eb640 1 -- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0cb440 msgr2=0x7fd2ec06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f24eb640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0cb440 0x7fd2ec06fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.076+0000 7fd2f24eb640 1 -- 172.21.15.17:0/1115441646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80094d0 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.077+0000 7fd2f24eb640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec0b2ee0 0x7fd2ec158d30 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8000c00 tx=0x7fd2e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.077+0000 7fd2e2ffd640 1 -- 172.21.15.17:0/1115441646 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8039c90 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.077+0000 7fd2e2ffd640 1 -- 172.21.15.17:0/1115441646 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8039df0 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.077+0000 7fd2e2ffd640 1 -- 172.21.15.17:0/1115441646 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8043640 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.077+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec0c6080 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.077+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec0c6640 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.079+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec04e390 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.079+0000 7fd2e2ffd640 1 -- 172.21.15.17:0/1115441646 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd2e80437a0 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.081+0000 7fd2e2ffd640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2d006a050 0x7fd2d006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.081+0000 7fd2e2ffd640 1 -- 172.21.15.17:0/1115441646 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2e803e070 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.081+0000 7fd2f1cea640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2d006a050 0x7fd2d006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.082+0000 7fd2f1cea640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2d006a050 0x7fd2d006c510 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc006fd0 tx=0x7fd2dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.085+0000 7fd2e2ffd640 1 -- 172.21.15.17:0/1115441646 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd2e8076d70 con 0x7fd2ec0b2ee0 2023-08-09T12:47:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.276+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2ec0b3a60 con 0x7fd2d006a050 2023-08-09T12:47:43.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.301+0000 7fd2e2ffd640 1 -- 172.21.15.17:0/1115441646 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303708 (secure 0 0 0) 0x7fd2dc00f830 con 0x7fd2d006a050 2023-08-09T12:47:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:43.309 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:47:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2d006a050 msgr2=0x7fd2d006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2d006a050 0x7fd2d006c510 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc006fd0 tx=0x7fd2dc008040 comp rx=0 tx=0).stop 2023-08-09T12:47:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec0b2ee0 msgr2=0x7fd2ec158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec0b2ee0 0x7fd2ec158d30 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8000c00 tx=0x7fd2e8004730 comp rx=0 tx=0).stop 2023-08-09T12:47:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 shutdown_connections 2023-08-09T12:47:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2d006a050 0x7fd2d006c510 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1601f0 0x7fd2ec15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0cb440 0x7fd2ec06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 --2- 172.21.15.17:0/1115441646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2ec0b2ee0 0x7fd2ec158d30 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 >> 172.21.15.17:0/1115441646 conn(0x7fd2ec0b1d50 msgr2=0x7fd2ec0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 shutdown_connections 2023-08-09T12:47:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.308+0000 7fd2f34ed640 1 -- 172.21.15.17:0/1115441646 wait complete. 2023-08-09T12:47:43.333 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":395,"stamp":"2023-08-09T12:47:42.825952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7908,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554591,"statfs":{"total":1600000000,"available":1591901508,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001779"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113492+0000","last_change":"2023-08-09T12:47:38.619258+0000","last_active":"2023-08-09T12:47:40.113492+0000","last_peered":"2023-08-09T12:47:40.113492+0000","last_clean":"2023-08-09T12:47:40.113492+0000","last_became_active":"2023-08-09T12:47:38.615038+0000","last_became_peered":"2023-08-09T12:47:38.615038+0000","last_unstale":"2023-08-09T12:47:40.113492+0000","last_undegraded":"2023-08-09T12:47:40.113492+0000","last_fullsized":"2023-08-09T12:47:40.113492+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:36:43.952946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113254+0000","last_change":"2023-08-09T12:47:38.615219+0000","last_active":"2023-08-09T12:47:40.113254+0000","last_peered":"2023-08-09T12:47:40.113254+0000","last_clean":"2023-08-09T12:47:40.113254+0000","last_became_active":"2023-08-09T12:47:38.613495+0000","last_became_peered":"2023-08-09T12:47:38.613495+0000","last_unstale":"2023-08-09T12:47:40.113254+0000","last_undegraded":"2023-08-09T12:47:40.113254+0000","last_fullsized":"2023-08-09T12:47:40.113254+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:04.354239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113726+0000","last_change":"2023-08-09T12:47:38.600841+0000","last_active":"2023-08-09T12:47:40.113726+0000","last_peered":"2023-08-09T12:47:40.113726+0000","last_clean":"2023-08-09T12:47:40.113726+0000","last_became_active":"2023-08-09T12:47:38.600268+0000","last_became_peered":"2023-08-09T12:47:38.600268+0000","last_unstale":"2023-08-09T12:47:40.113726+0000","last_undegraded":"2023-08-09T12:47:40.113726+0000","last_fullsized":"2023-08-09T12:47:40.113726+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:43:24.977341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835149+0000","last_change":"2023-08-09T12:47:38.628367+0000","last_active":"2023-08-09T12:47:39.835149+0000","last_peered":"2023-08-09T12:47:39.835149+0000","last_clean":"2023-08-09T12:47:39.835149+0000","last_became_active":"2023-08-09T12:47:38.626969+0000","last_became_peered":"2023-08-09T12:47:38.626969+0000","last_unstale":"2023-08-09T12:47:39.835149+0000","last_undegraded":"2023-08-09T12:47:39.835149+0000","last_fullsized":"2023-08-09T12:47:39.835149+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:21:46.393947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113599+0000","last_change":"2023-08-09T12:47:38.611768+0000","last_active":"2023-08-09T12:47:40.113599+0000","last_peered":"2023-08-09T12:47:40.113599+0000","last_clean":"2023-08-09T12:47:40.113599+0000","last_became_active":"2023-08-09T12:47:38.611425+0000","last_became_peered":"2023-08-09T12:47:38.611425+0000","last_unstale":"2023-08-09T12:47:40.113599+0000","last_undegraded":"2023-08-09T12:47:40.113599+0000","last_fullsized":"2023-08-09T12:47:40.113599+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:13:22.982935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594166+0000","last_change":"2023-08-09T12:47:38.610118+0000","last_active":"2023-08-09T12:47:39.594166+0000","last_peered":"2023-08-09T12:47:39.594166+0000","last_clean":"2023-08-09T12:47:39.594166+0000","last_became_active":"2023-08-09T12:47:38.609485+0000","last_became_peered":"2023-08-09T12:47:38.609485+0000","last_unstale":"2023-08-09T12:47:39.594166+0000","last_undegraded":"2023-08-09T12:47:39.594166+0000","last_fullsized":"2023-08-09T12:47:39.594166+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:58.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594016+0000","last_change":"2023-08-09T12:47:38.622130+0000","last_active":"2023-08-09T12:47:39.594016+0000","last_peered":"2023-08-09T12:47:39.594016+0000","last_clean":"2023-08-09T12:47:39.594016+0000","last_became_active":"2023-08-09T12:47:38.621585+0000","last_became_peered":"2023-08-09T12:47:38.621585+0000","last_unstale":"2023-08-09T12:47:39.594016+0000","last_undegraded":"2023-08-09T12:47:39.594016+0000","last_fullsized":"2023-08-09T12:47:39.594016+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:33:50.423895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114677+0000","last_change":"2023-08-09T12:47:38.605799+0000","last_active":"2023-08-09T12:47:40.114677+0000","last_peered":"2023-08-09T12:47:40.114677+0000","last_clean":"2023-08-09T12:47:40.114677+0000","last_became_active":"2023-08-09T12:47:38.605411+0000","last_became_peered":"2023-08-09T12:47:38.605411+0000","last_unstale":"2023-08-09T12:47:40.114677+0000","last_undegraded":"2023-08-09T12:47:40.114677+0000","last_fullsized":"2023-08-09T12:47:40.114677+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:58:25.701193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834458+0000","last_change":"2023-08-09T12:47:38.628132+0000","last_active":"2023-08-09T12:47:39.834458+0000","last_peered":"2023-08-09T12:47:39.834458+0000","last_clean":"2023-08-09T12:47:39.834458+0000","last_became_active":"2023-08-09T12:47:38.626455+0000","last_became_peered":"2023-08-09T12:47:38.626455+0000","last_unstale":"2023-08-09T12:47:39.834458+0000","last_undegraded":"2023-08-09T12:47:39.834458+0000","last_fullsized":"2023-08-09T12:47:39.834458+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:24:08.616043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593335+0000","last_change":"2023-08-09T12:47:38.613131+0000","last_active":"2023-08-09T12:47:39.593335+0000","last_peered":"2023-08-09T12:47:39.593335+0000","last_clean":"2023-08-09T12:47:39.593335+0000","last_became_active":"2023-08-09T12:47:38.612862+0000","last_became_peered":"2023-08-09T12:47:38.612862+0000","last_unstale":"2023-08-09T12:47:39.593335+0000","last_undegraded":"2023-08-09T12:47:39.593335+0000","last_fullsized":"2023-08-09T12:47:39.593335+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:34.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113881+0000","last_change":"2023-08-09T12:47:38.619601+0000","last_active":"2023-08-09T12:47:40.113881+0000","last_peered":"2023-08-09T12:47:40.113881+0000","last_clean":"2023-08-09T12:47:40.113881+0000","last_became_active":"2023-08-09T12:47:38.618887+0000","last_became_peered":"2023-08-09T12:47:38.618887+0000","last_unstale":"2023-08-09T12:47:40.113881+0000","last_undegraded":"2023-08-09T12:47:40.113881+0000","last_fullsized":"2023-08-09T12:47:40.113881+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:49:00.060750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594218+0000","last_change":"2023-08-09T12:47:38.611625+0000","last_active":"2023-08-09T12:47:39.594218+0000","last_peered":"2023-08-09T12:47:39.594218+0000","last_clean":"2023-08-09T12:47:39.594218+0000","last_became_active":"2023-08-09T12:47:38.611416+0000","last_became_peered":"2023-08-09T12:47:38.611416+0000","last_unstale":"2023-08-09T12:47:39.594218+0000","last_undegraded":"2023-08-09T12:47:39.594218+0000","last_fullsized":"2023-08-09T12:47:39.594218+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:48:56.635655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593038+0000","last_change":"2023-08-09T12:47:38.609342+0000","last_active":"2023-08-09T12:47:39.593038+0000","last_peered":"2023-08-09T12:47:39.593038+0000","last_clean":"2023-08-09T12:47:39.593038+0000","last_became_active":"2023-08-09T12:47:38.608971+0000","last_became_peered":"2023-08-09T12:47:38.608971+0000","last_unstale":"2023-08-09T12:47:39.593038+0000","last_undegraded":"2023-08-09T12:47:39.593038+0000","last_fullsized":"2023-08-09T12:47:39.593038+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:50:13.884614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.112999+0000","last_change":"2023-08-09T12:47:38.606462+0000","last_active":"2023-08-09T12:47:40.112999+0000","last_peered":"2023-08-09T12:47:40.112999+0000","last_clean":"2023-08-09T12:47:40.112999+0000","last_became_active":"2023-08-09T12:47:38.605761+0000","last_became_peered":"2023-08-09T12:47:38.605761+0000","last_unstale":"2023-08-09T12:47:40.112999+0000","last_undegraded":"2023-08-09T12:47:40.112999+0000","last_fullsized":"2023-08-09T12:47:40.112999+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:30.851784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113904+0000","last_change":"2023-08-09T12:47:38.616235+0000","last_active":"2023-08-09T12:47:40.113904+0000","last_peered":"2023-08-09T12:47:40.113904+0000","last_clean":"2023-08-09T12:47:40.113904+0000","last_became_active":"2023-08-09T12:47:38.615693+0000","last_became_peered":"2023-08-09T12:47:38.615693+0000","last_unstale":"2023-08-09T12:47:40.113904+0000","last_undegraded":"2023-08-09T12:47:40.113904+0000","last_fullsized":"2023-08-09T12:47:40.113904+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:27:00.687407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594309+0000","last_change":"2023-08-09T12:47:38.609943+0000","last_active":"2023-08-09T12:47:39.594309+0000","last_peered":"2023-08-09T12:47:39.594309+0000","last_clean":"2023-08-09T12:47:39.594309+0000","last_became_active":"2023-08-09T12:47:38.609222+0000","last_became_peered":"2023-08-09T12:47:38.609222+0000","last_unstale":"2023-08-09T12:47:39.594309+0000","last_undegraded":"2023-08-09T12:47:39.594309+0000","last_fullsized":"2023-08-09T12:47:39.594309+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:42:14.853783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592987+0000","last_change":"2023-08-09T12:47:38.617413+0000","last_active":"2023-08-09T12:47:39.592987+0000","last_peered":"2023-08-09T12:47:39.592987+0000","last_clean":"2023-08-09T12:47:39.592987+0000","last_became_active":"2023-08-09T12:47:38.617173+0000","last_became_peered":"2023-08-09T12:47:38.617173+0000","last_unstale":"2023-08-09T12:47:39.592987+0000","last_undegraded":"2023-08-09T12:47:39.592987+0000","last_fullsized":"2023-08-09T12:47:39.592987+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:30:39.610489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113954+0000","last_change":"2023-08-09T12:47:38.626653+0000","last_active":"2023-08-09T12:47:40.113954+0000","last_peered":"2023-08-09T12:47:40.113954+0000","last_clean":"2023-08-09T12:47:40.113954+0000","last_became_active":"2023-08-09T12:47:38.626177+0000","last_became_peered":"2023-08-09T12:47:38.626177+0000","last_unstale":"2023-08-09T12:47:40.113954+0000","last_undegraded":"2023-08-09T12:47:40.113954+0000","last_fullsized":"2023-08-09T12:47:40.113954+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:29.844434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748862+0000","last_change":"2023-08-09T12:47:38.625442+0000","last_active":"2023-08-09T12:47:39.748862+0000","last_peered":"2023-08-09T12:47:39.748862+0000","last_clean":"2023-08-09T12:47:39.748862+0000","last_became_active":"2023-08-09T12:47:38.624710+0000","last_became_peered":"2023-08-09T12:47:38.624710+0000","last_unstale":"2023-08-09T12:47:39.748862+0000","last_undegraded":"2023-08-09T12:47:39.748862+0000","last_fullsized":"2023-08-09T12:47:39.748862+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:21:29.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591182+0000","last_change":"2023-08-09T12:47:38.613891+0000","last_active":"2023-08-09T12:47:39.591182+0000","last_peered":"2023-08-09T12:47:39.591182+0000","last_clean":"2023-08-09T12:47:39.591182+0000","last_became_active":"2023-08-09T12:47:38.613652+0000","last_became_peered":"2023-08-09T12:47:38.613652+0000","last_unstale":"2023-08-09T12:47:39.591182+0000","last_undegraded":"2023-08-09T12:47:39.591182+0000","last_fullsized":"2023-08-09T12:47:39.591182+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:34.083889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834432+0000","last_change":"2023-08-09T12:47:38.612139+0000","last_active":"2023-08-09T12:47:39.834432+0000","last_peered":"2023-08-09T12:47:39.834432+0000","last_clean":"2023-08-09T12:47:39.834432+0000","last_became_active":"2023-08-09T12:47:38.611619+0000","last_became_peered":"2023-08-09T12:47:38.611619+0000","last_unstale":"2023-08-09T12:47:39.834432+0000","last_undegraded":"2023-08-09T12:47:39.834432+0000","last_fullsized":"2023-08-09T12:47:39.834432+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:09:30.919866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113474+0000","last_change":"2023-08-09T12:47:38.615467+0000","last_active":"2023-08-09T12:47:40.113474+0000","last_peered":"2023-08-09T12:47:40.113474+0000","last_clean":"2023-08-09T12:47:40.113474+0000","last_became_active":"2023-08-09T12:47:38.615071+0000","last_became_peered":"2023-08-09T12:47:38.615071+0000","last_unstale":"2023-08-09T12:47:40.113474+0000","last_undegraded":"2023-08-09T12:47:40.113474+0000","last_fullsized":"2023-08-09T12:47:40.113474+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:00:45.196302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835955+0000","last_change":"2023-08-09T12:47:38.630678+0000","last_active":"2023-08-09T12:47:39.835955+0000","last_peered":"2023-08-09T12:47:39.835955+0000","last_clean":"2023-08-09T12:47:39.835955+0000","last_became_active":"2023-08-09T12:47:38.628805+0000","last_became_peered":"2023-08-09T12:47:38.628805+0000","last_unstale":"2023-08-09T12:47:39.835955+0000","last_undegraded":"2023-08-09T12:47:39.835955+0000","last_fullsized":"2023-08-09T12:47:39.835955+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:21.434575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835570+0000","last_change":"2023-08-09T12:47:38.616212+0000","last_active":"2023-08-09T12:47:39.835570+0000","last_peered":"2023-08-09T12:47:39.835570+0000","last_clean":"2023-08-09T12:47:39.835570+0000","last_became_active":"2023-08-09T12:47:38.615637+0000","last_became_peered":"2023-08-09T12:47:38.615637+0000","last_unstale":"2023-08-09T12:47:39.835570+0000","last_undegraded":"2023-08-09T12:47:39.835570+0000","last_fullsized":"2023-08-09T12:47:39.835570+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:34.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837937+0000","last_change":"2023-08-09T12:47:38.615652+0000","last_active":"2023-08-09T12:47:39.837937+0000","last_peered":"2023-08-09T12:47:39.837937+0000","last_clean":"2023-08-09T12:47:39.837937+0000","last_became_active":"2023-08-09T12:47:38.615233+0000","last_became_peered":"2023-08-09T12:47:38.615233+0000","last_unstale":"2023-08-09T12:47:39.837937+0000","last_undegraded":"2023-08-09T12:47:39.837937+0000","last_fullsized":"2023-08-09T12:47:39.837937+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:30:54.184671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591421+0000","last_change":"2023-08-09T12:47:38.603021+0000","last_active":"2023-08-09T12:47:39.591421+0000","last_peered":"2023-08-09T12:47:39.591421+0000","last_clean":"2023-08-09T12:47:39.591421+0000","last_became_active":"2023-08-09T12:47:38.601946+0000","last_became_peered":"2023-08-09T12:47:38.601946+0000","last_unstale":"2023-08-09T12:47:39.591421+0000","last_undegraded":"2023-08-09T12:47:39.591421+0000","last_fullsized":"2023-08-09T12:47:39.591421+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:16:39.362470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748708+0000","last_change":"2023-08-09T12:47:38.614318+0000","last_active":"2023-08-09T12:47:39.748708+0000","last_peered":"2023-08-09T12:47:39.748708+0000","last_clean":"2023-08-09T12:47:39.748708+0000","last_became_active":"2023-08-09T12:47:38.613845+0000","last_became_peered":"2023-08-09T12:47:38.613845+0000","last_unstale":"2023-08-09T12:47:39.748708+0000","last_undegraded":"2023-08-09T12:47:39.748708+0000","last_fullsized":"2023-08-09T12:47:39.748708+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:26:28.513752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592583+0000","last_change":"2023-08-09T12:47:38.607603+0000","last_active":"2023-08-09T12:47:39.592583+0000","last_peered":"2023-08-09T12:47:39.592583+0000","last_clean":"2023-08-09T12:47:39.592583+0000","last_became_active":"2023-08-09T12:47:38.607375+0000","last_became_peered":"2023-08-09T12:47:38.607375+0000","last_unstale":"2023-08-09T12:47:39.592583+0000","last_undegraded":"2023-08-09T12:47:39.592583+0000","last_fullsized":"2023-08-09T12:47:39.592583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:19.602397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591116+0000","last_change":"2023-08-09T12:47:38.596992+0000","last_active":"2023-08-09T12:47:39.591116+0000","last_peered":"2023-08-09T12:47:39.591116+0000","last_clean":"2023-08-09T12:47:39.591116+0000","last_became_active":"2023-08-09T12:47:38.596704+0000","last_became_peered":"2023-08-09T12:47:38.596704+0000","last_unstale":"2023-08-09T12:47:39.591116+0000","last_undegraded":"2023-08-09T12:47:39.591116+0000","last_fullsized":"2023-08-09T12:47:39.591116+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:04.769559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113153+0000","last_change":"2023-08-09T12:47:38.612214+0000","last_active":"2023-08-09T12:47:40.113153+0000","last_peered":"2023-08-09T12:47:40.113153+0000","last_clean":"2023-08-09T12:47:40.113153+0000","last_became_active":"2023-08-09T12:47:38.611958+0000","last_became_peered":"2023-08-09T12:47:38.611958+0000","last_unstale":"2023-08-09T12:47:40.113153+0000","last_undegraded":"2023-08-09T12:47:40.113153+0000","last_fullsized":"2023-08-09T12:47:40.113153+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:42:28.955794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836789+0000","last_change":"2023-08-09T12:47:38.616299+0000","last_active":"2023-08-09T12:47:39.836789+0000","last_peered":"2023-08-09T12:47:39.836789+0000","last_clean":"2023-08-09T12:47:39.836789+0000","last_became_active":"2023-08-09T12:47:38.615824+0000","last_became_peered":"2023-08-09T12:47:38.615824+0000","last_unstale":"2023-08-09T12:47:39.836789+0000","last_undegraded":"2023-08-09T12:47:39.836789+0000","last_fullsized":"2023-08-09T12:47:39.836789+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:11.499778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836720+0000","last_change":"2023-08-09T12:47:38.618191+0000","last_active":"2023-08-09T12:47:39.836720+0000","last_peered":"2023-08-09T12:47:39.836720+0000","last_clean":"2023-08-09T12:47:39.836720+0000","last_became_active":"2023-08-09T12:47:38.617368+0000","last_became_peered":"2023-08-09T12:47:38.617368+0000","last_unstale":"2023-08-09T12:47:39.836720+0000","last_undegraded":"2023-08-09T12:47:39.836720+0000","last_fullsized":"2023-08-09T12:47:39.836720+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:28.016184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593542+0000","last_change":"2023-08-09T12:47:38.611931+0000","last_active":"2023-08-09T12:47:39.593542+0000","last_peered":"2023-08-09T12:47:39.593542+0000","last_clean":"2023-08-09T12:47:39.593542+0000","last_became_active":"2023-08-09T12:47:38.611644+0000","last_became_peered":"2023-08-09T12:47:38.611644+0000","last_unstale":"2023-08-09T12:47:39.593542+0000","last_undegraded":"2023-08-09T12:47:39.593542+0000","last_fullsized":"2023-08-09T12:47:39.593542+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:28.016184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"145'4","reported_seq":17,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748928+0000","last_change":"2023-08-09T12:47:37.607795+0000","last_active":"2023-08-09T12:47:39.748928+0000","last_peered":"2023-08-09T12:47:39.748928+0000","last_clean":"2023-08-09T12:47:39.748928+0000","last_became_active":"2023-08-09T12:47:37.607529+0000","last_became_peered":"2023-08-09T12:47:37.607529+0000","last_unstale":"2023-08-09T12:47:39.748928+0000","last_undegraded":"2023-08-09T12:47:39.748928+0000","last_fullsized":"2023-08-09T12:47:39.748928+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:04:48.536033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594209+0000","last_change":"2023-08-09T12:47:38.613394+0000","last_active":"2023-08-09T12:47:39.594209+0000","last_peered":"2023-08-09T12:47:39.594209+0000","last_clean":"2023-08-09T12:47:39.594209+0000","last_became_active":"2023-08-09T12:47:38.613166+0000","last_became_peered":"2023-08-09T12:47:38.613166+0000","last_unstale":"2023-08-09T12:47:39.594209+0000","last_undegraded":"2023-08-09T12:47:39.594209+0000","last_fullsized":"2023-08-09T12:47:39.594209+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:17:28.607973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593750+0000","last_change":"2023-08-09T12:47:37.608531+0000","last_active":"2023-08-09T12:47:39.593750+0000","last_peered":"2023-08-09T12:47:39.593750+0000","last_clean":"2023-08-09T12:47:39.593750+0000","last_became_active":"2023-08-09T12:47:37.608277+0000","last_became_peered":"2023-08-09T12:47:37.608277+0000","last_unstale":"2023-08-09T12:47:39.593750+0000","last_undegraded":"2023-08-09T12:47:39.593750+0000","last_fullsized":"2023-08-09T12:47:39.593750+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:50:36.598234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835902+0000","last_change":"2023-08-09T12:47:38.615997+0000","last_active":"2023-08-09T12:47:39.835902+0000","last_peered":"2023-08-09T12:47:39.835902+0000","last_clean":"2023-08-09T12:47:39.835902+0000","last_became_active":"2023-08-09T12:47:38.614790+0000","last_became_peered":"2023-08-09T12:47:38.614790+0000","last_unstale":"2023-08-09T12:47:39.835902+0000","last_undegraded":"2023-08-09T12:47:39.835902+0000","last_fullsized":"2023-08-09T12:47:39.835902+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:14.497004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835582+0000","last_change":"2023-08-09T12:47:37.609310+0000","last_active":"2023-08-09T12:47:39.835582+0000","last_peered":"2023-08-09T12:47:39.835582+0000","last_clean":"2023-08-09T12:47:39.835582+0000","last_became_active":"2023-08-09T12:47:37.608988+0000","last_became_peered":"2023-08-09T12:47:37.608988+0000","last_unstale":"2023-08-09T12:47:39.835582+0000","last_undegraded":"2023-08-09T12:47:39.835582+0000","last_fullsized":"2023-08-09T12:47:39.835582+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:48.375500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834304+0000","last_change":"2023-08-09T12:47:38.630544+0000","last_active":"2023-08-09T12:47:39.834304+0000","last_peered":"2023-08-09T12:47:39.834304+0000","last_clean":"2023-08-09T12:47:39.834304+0000","last_became_active":"2023-08-09T12:47:38.626982+0000","last_became_peered":"2023-08-09T12:47:38.626982+0000","last_unstale":"2023-08-09T12:47:39.834304+0000","last_undegraded":"2023-08-09T12:47:39.834304+0000","last_fullsized":"2023-08-09T12:47:39.834304+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:10.539878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594001+0000","last_change":"2023-08-09T12:47:37.605016+0000","last_active":"2023-08-09T12:47:39.594001+0000","last_peered":"2023-08-09T12:47:39.594001+0000","last_clean":"2023-08-09T12:47:39.594001+0000","last_became_active":"2023-08-09T12:47:37.604394+0000","last_became_peered":"2023-08-09T12:47:37.604394+0000","last_unstale":"2023-08-09T12:47:39.594001+0000","last_undegraded":"2023-08-09T12:47:39.594001+0000","last_fullsized":"2023-08-09T12:47:39.594001+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:11:29.936634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593486+0000","last_change":"2023-08-09T12:47:38.604703+0000","last_active":"2023-08-09T12:47:39.593486+0000","last_peered":"2023-08-09T12:47:39.593486+0000","last_clean":"2023-08-09T12:47:39.593486+0000","last_became_active":"2023-08-09T12:47:38.604465+0000","last_became_peered":"2023-08-09T12:47:38.604465+0000","last_unstale":"2023-08-09T12:47:39.593486+0000","last_undegraded":"2023-08-09T12:47:39.593486+0000","last_fullsized":"2023-08-09T12:47:39.593486+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:21:56.369312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113729+0000","last_change":"2023-08-09T12:47:37.610816+0000","last_active":"2023-08-09T12:47:40.113729+0000","last_peered":"2023-08-09T12:47:40.113729+0000","last_clean":"2023-08-09T12:47:40.113729+0000","last_became_active":"2023-08-09T12:47:37.609879+0000","last_became_peered":"2023-08-09T12:47:37.609879+0000","last_unstale":"2023-08-09T12:47:40.113729+0000","last_undegraded":"2023-08-09T12:47:40.113729+0000","last_fullsized":"2023-08-09T12:47:40.113729+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:08:41.059329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113400+0000","last_change":"2023-08-09T12:47:38.629698+0000","last_active":"2023-08-09T12:47:40.113400+0000","last_peered":"2023-08-09T12:47:40.113400+0000","last_clean":"2023-08-09T12:47:40.113400+0000","last_became_active":"2023-08-09T12:47:38.629350+0000","last_became_peered":"2023-08-09T12:47:38.629350+0000","last_unstale":"2023-08-09T12:47:40.113400+0000","last_undegraded":"2023-08-09T12:47:40.113400+0000","last_fullsized":"2023-08-09T12:47:40.113400+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:13:55.228751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592735+0000","last_change":"2023-08-09T12:47:37.605855+0000","last_active":"2023-08-09T12:47:39.592735+0000","last_peered":"2023-08-09T12:47:39.592735+0000","last_clean":"2023-08-09T12:47:39.592735+0000","last_became_active":"2023-08-09T12:47:37.605463+0000","last_became_peered":"2023-08-09T12:47:37.605463+0000","last_unstale":"2023-08-09T12:47:39.592735+0000","last_undegraded":"2023-08-09T12:47:39.592735+0000","last_fullsized":"2023-08-09T12:47:39.592735+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:31:29.538310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114168+0000","last_change":"2023-08-09T12:47:38.605042+0000","last_active":"2023-08-09T12:47:40.114168+0000","last_peered":"2023-08-09T12:47:40.114168+0000","last_clean":"2023-08-09T12:47:40.114168+0000","last_became_active":"2023-08-09T12:47:38.604749+0000","last_became_peered":"2023-08-09T12:47:38.604749+0000","last_unstale":"2023-08-09T12:47:40.114168+0000","last_undegraded":"2023-08-09T12:47:40.114168+0000","last_fullsized":"2023-08-09T12:47:40.114168+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:08:48.402317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836749+0000","last_change":"2023-08-09T12:47:37.607226+0000","last_active":"2023-08-09T12:47:39.836749+0000","last_peered":"2023-08-09T12:47:39.836749+0000","last_clean":"2023-08-09T12:47:39.836749+0000","last_became_active":"2023-08-09T12:47:37.605788+0000","last_became_peered":"2023-08-09T12:47:37.605788+0000","last_unstale":"2023-08-09T12:47:39.836749+0000","last_undegraded":"2023-08-09T12:47:39.836749+0000","last_fullsized":"2023-08-09T12:47:39.836749+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:55:43.124963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593204+0000","last_change":"2023-08-09T12:47:38.606839+0000","last_active":"2023-08-09T12:47:39.593204+0000","last_peered":"2023-08-09T12:47:39.593204+0000","last_clean":"2023-08-09T12:47:39.593204+0000","last_became_active":"2023-08-09T12:47:38.606553+0000","last_became_peered":"2023-08-09T12:47:38.606553+0000","last_unstale":"2023-08-09T12:47:39.593204+0000","last_undegraded":"2023-08-09T12:47:39.593204+0000","last_fullsized":"2023-08-09T12:47:39.593204+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:13.265052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594701+0000","last_change":"2023-08-09T12:47:37.611964+0000","last_active":"2023-08-09T12:47:39.594701+0000","last_peered":"2023-08-09T12:47:39.594701+0000","last_clean":"2023-08-09T12:47:39.594701+0000","last_became_active":"2023-08-09T12:47:37.611369+0000","last_became_peered":"2023-08-09T12:47:37.611369+0000","last_unstale":"2023-08-09T12:47:39.594701+0000","last_undegraded":"2023-08-09T12:47:39.594701+0000","last_fullsized":"2023-08-09T12:47:39.594701+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:32:03.103433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836957+0000","last_change":"2023-08-09T12:47:38.617821+0000","last_active":"2023-08-09T12:47:39.836957+0000","last_peered":"2023-08-09T12:47:39.836957+0000","last_clean":"2023-08-09T12:47:39.836957+0000","last_became_active":"2023-08-09T12:47:38.616434+0000","last_became_peered":"2023-08-09T12:47:38.616434+0000","last_unstale":"2023-08-09T12:47:39.836957+0000","last_undegraded":"2023-08-09T12:47:39.836957+0000","last_fullsized":"2023-08-09T12:47:39.836957+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:50:37.614511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593597+0000","last_change":"2023-08-09T12:47:37.607994+0000","last_active":"2023-08-09T12:47:39.593597+0000","last_peered":"2023-08-09T12:47:39.593597+0000","last_clean":"2023-08-09T12:47:39.593597+0000","last_became_active":"2023-08-09T12:47:37.607749+0000","last_became_peered":"2023-08-09T12:47:37.607749+0000","last_unstale":"2023-08-09T12:47:39.593597+0000","last_undegraded":"2023-08-09T12:47:39.593597+0000","last_fullsized":"2023-08-09T12:47:39.593597+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:10.239424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114410+0000","last_change":"2023-08-09T12:47:38.619403+0000","last_active":"2023-08-09T12:47:40.114410+0000","last_peered":"2023-08-09T12:47:40.114410+0000","last_clean":"2023-08-09T12:47:40.114410+0000","last_became_active":"2023-08-09T12:47:38.618489+0000","last_became_peered":"2023-08-09T12:47:38.618489+0000","last_unstale":"2023-08-09T12:47:40.114410+0000","last_undegraded":"2023-08-09T12:47:40.114410+0000","last_fullsized":"2023-08-09T12:47:40.114410+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:51.193522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591241+0000","last_change":"2023-08-09T12:47:37.604528+0000","last_active":"2023-08-09T12:47:39.591241+0000","last_peered":"2023-08-09T12:47:39.591241+0000","last_clean":"2023-08-09T12:47:39.591241+0000","last_became_active":"2023-08-09T12:47:37.603750+0000","last_became_peered":"2023-08-09T12:47:37.603750+0000","last_unstale":"2023-08-09T12:47:39.591241+0000","last_undegraded":"2023-08-09T12:47:39.591241+0000","last_fullsized":"2023-08-09T12:47:39.591241+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:14.530974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594353+0000","last_change":"2023-08-09T12:47:38.612908+0000","last_active":"2023-08-09T12:47:39.594353+0000","last_peered":"2023-08-09T12:47:39.594353+0000","last_clean":"2023-08-09T12:47:39.594353+0000","last_became_active":"2023-08-09T12:47:38.612154+0000","last_became_peered":"2023-08-09T12:47:38.612154+0000","last_unstale":"2023-08-09T12:47:39.594353+0000","last_undegraded":"2023-08-09T12:47:39.594353+0000","last_fullsized":"2023-08-09T12:47:39.594353+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:02:10.461610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834678+0000","last_change":"2023-08-09T12:47:37.608848+0000","last_active":"2023-08-09T12:47:39.834678+0000","last_peered":"2023-08-09T12:47:39.834678+0000","last_clean":"2023-08-09T12:47:39.834678+0000","last_became_active":"2023-08-09T12:47:37.608379+0000","last_became_peered":"2023-08-09T12:47:37.608379+0000","last_unstale":"2023-08-09T12:47:39.834678+0000","last_undegraded":"2023-08-09T12:47:39.834678+0000","last_fullsized":"2023-08-09T12:47:39.834678+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:25:59.347390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836503+0000","last_change":"2023-08-09T12:47:38.628662+0000","last_active":"2023-08-09T12:47:39.836503+0000","last_peered":"2023-08-09T12:47:39.836503+0000","last_clean":"2023-08-09T12:47:39.836503+0000","last_became_active":"2023-08-09T12:47:38.628413+0000","last_became_peered":"2023-08-09T12:47:38.628413+0000","last_unstale":"2023-08-09T12:47:39.836503+0000","last_undegraded":"2023-08-09T12:47:39.836503+0000","last_fullsized":"2023-08-09T12:47:39.836503+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:21:56.369312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836000+0000","last_change":"2023-08-09T12:47:37.606094+0000","last_active":"2023-08-09T12:47:39.836000+0000","last_peered":"2023-08-09T12:47:39.836000+0000","last_clean":"2023-08-09T12:47:39.836000+0000","last_became_active":"2023-08-09T12:47:37.605653+0000","last_became_peered":"2023-08-09T12:47:37.605653+0000","last_unstale":"2023-08-09T12:47:39.836000+0000","last_undegraded":"2023-08-09T12:47:39.836000+0000","last_fullsized":"2023-08-09T12:47:39.836000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:28:55.497970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594406+0000","last_change":"2023-08-09T12:47:38.609785+0000","last_active":"2023-08-09T12:47:39.594406+0000","last_peered":"2023-08-09T12:47:39.594406+0000","last_clean":"2023-08-09T12:47:39.594406+0000","last_became_active":"2023-08-09T12:47:38.608869+0000","last_became_peered":"2023-08-09T12:47:38.608869+0000","last_unstale":"2023-08-09T12:47:39.594406+0000","last_undegraded":"2023-08-09T12:47:39.594406+0000","last_fullsized":"2023-08-09T12:47:39.594406+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:18:42.619085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592888+0000","last_change":"2023-08-09T12:47:37.610934+0000","last_active":"2023-08-09T12:47:39.592888+0000","last_peered":"2023-08-09T12:47:39.592888+0000","last_clean":"2023-08-09T12:47:39.592888+0000","last_became_active":"2023-08-09T12:47:37.610612+0000","last_became_peered":"2023-08-09T12:47:37.610612+0000","last_unstale":"2023-08-09T12:47:39.592888+0000","last_undegraded":"2023-08-09T12:47:39.592888+0000","last_fullsized":"2023-08-09T12:47:39.592888+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:28.345599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113531+0000","last_change":"2023-08-09T12:47:38.606180+0000","last_active":"2023-08-09T12:47:40.113531+0000","last_peered":"2023-08-09T12:47:40.113531+0000","last_clean":"2023-08-09T12:47:40.113531+0000","last_became_active":"2023-08-09T12:47:38.605851+0000","last_became_peered":"2023-08-09T12:47:38.605851+0000","last_unstale":"2023-08-09T12:47:40.113531+0000","last_undegraded":"2023-08-09T12:47:40.113531+0000","last_fullsized":"2023-08-09T12:47:40.113531+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:46.980814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836003+0000","last_change":"2023-08-09T12:47:37.609010+0000","last_active":"2023-08-09T12:47:39.836003+0000","last_peered":"2023-08-09T12:47:39.836003+0000","last_clean":"2023-08-09T12:47:39.836003+0000","last_became_active":"2023-08-09T12:47:37.608358+0000","last_became_peered":"2023-08-09T12:47:37.608358+0000","last_unstale":"2023-08-09T12:47:39.836003+0000","last_undegraded":"2023-08-09T12:47:39.836003+0000","last_fullsized":"2023-08-09T12:47:39.836003+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:42:51.626887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113615+0000","last_change":"2023-08-09T12:47:38.606697+0000","last_active":"2023-08-09T12:47:40.113615+0000","last_peered":"2023-08-09T12:47:40.113615+0000","last_clean":"2023-08-09T12:47:40.113615+0000","last_became_active":"2023-08-09T12:47:38.606226+0000","last_became_peered":"2023-08-09T12:47:38.606226+0000","last_unstale":"2023-08-09T12:47:40.113615+0000","last_undegraded":"2023-08-09T12:47:40.113615+0000","last_fullsized":"2023-08-09T12:47:40.113615+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:28.683850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114324+0000","last_change":"2023-08-09T12:47:37.609685+0000","last_active":"2023-08-09T12:47:40.114324+0000","last_peered":"2023-08-09T12:47:40.114324+0000","last_clean":"2023-08-09T12:47:40.114324+0000","last_became_active":"2023-08-09T12:47:37.608304+0000","last_became_peered":"2023-08-09T12:47:37.608304+0000","last_unstale":"2023-08-09T12:47:40.114324+0000","last_undegraded":"2023-08-09T12:47:40.114324+0000","last_fullsized":"2023-08-09T12:47:40.114324+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:13:02.160740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836783+0000","last_change":"2023-08-09T12:47:38.617768+0000","last_active":"2023-08-09T12:47:39.836783+0000","last_peered":"2023-08-09T12:47:39.836783+0000","last_clean":"2023-08-09T12:47:39.836783+0000","last_became_active":"2023-08-09T12:47:38.616698+0000","last_became_peered":"2023-08-09T12:47:38.616698+0000","last_unstale":"2023-08-09T12:47:39.836783+0000","last_undegraded":"2023-08-09T12:47:39.836783+0000","last_fullsized":"2023-08-09T12:47:39.836783+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:11.255700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835007+0000","last_change":"2023-08-09T12:47:37.608653+0000","last_active":"2023-08-09T12:47:39.835007+0000","last_peered":"2023-08-09T12:47:39.835007+0000","last_clean":"2023-08-09T12:47:39.835007+0000","last_became_active":"2023-08-09T12:47:37.608045+0000","last_became_peered":"2023-08-09T12:47:37.608045+0000","last_unstale":"2023-08-09T12:47:39.835007+0000","last_undegraded":"2023-08-09T12:47:39.835007+0000","last_fullsized":"2023-08-09T12:47:39.835007+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:32:00.103793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594575+0000","last_change":"2023-08-09T12:47:38.612683+0000","last_active":"2023-08-09T12:47:39.594575+0000","last_peered":"2023-08-09T12:47:39.594575+0000","last_clean":"2023-08-09T12:47:39.594575+0000","last_became_active":"2023-08-09T12:47:38.611769+0000","last_became_peered":"2023-08-09T12:47:38.611769+0000","last_unstale":"2023-08-09T12:47:39.594575+0000","last_undegraded":"2023-08-09T12:47:39.594575+0000","last_fullsized":"2023-08-09T12:47:39.594575+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:29:54.358222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594403+0000","last_change":"2023-08-09T12:47:37.602147+0000","last_active":"2023-08-09T12:47:39.594403+0000","last_peered":"2023-08-09T12:47:39.594403+0000","last_clean":"2023-08-09T12:47:39.594403+0000","last_became_active":"2023-08-09T12:47:37.601862+0000","last_became_peered":"2023-08-09T12:47:37.601862+0000","last_unstale":"2023-08-09T12:47:39.594403+0000","last_undegraded":"2023-08-09T12:47:39.594403+0000","last_fullsized":"2023-08-09T12:47:39.594403+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:09:11.202836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593396+0000","last_change":"2023-08-09T12:47:38.604062+0000","last_active":"2023-08-09T12:47:39.593396+0000","last_peered":"2023-08-09T12:47:39.593396+0000","last_clean":"2023-08-09T12:47:39.593396+0000","last_became_active":"2023-08-09T12:47:38.603821+0000","last_became_peered":"2023-08-09T12:47:38.603821+0000","last_unstale":"2023-08-09T12:47:39.593396+0000","last_undegraded":"2023-08-09T12:47:39.593396+0000","last_fullsized":"2023-08-09T12:47:39.593396+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:14.497004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.749142+0000","last_change":"2023-08-09T12:47:37.604130+0000","last_active":"2023-08-09T12:47:39.749142+0000","last_peered":"2023-08-09T12:47:39.749142+0000","last_clean":"2023-08-09T12:47:39.749142+0000","last_became_active":"2023-08-09T12:47:37.603832+0000","last_became_peered":"2023-08-09T12:47:37.603832+0000","last_unstale":"2023-08-09T12:47:39.749142+0000","last_undegraded":"2023-08-09T12:47:39.749142+0000","last_fullsized":"2023-08-09T12:47:39.749142+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:10:40.581500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836526+0000","last_change":"2023-08-09T12:47:38.630811+0000","last_active":"2023-08-09T12:47:39.836526+0000","last_peered":"2023-08-09T12:47:39.836526+0000","last_clean":"2023-08-09T12:47:39.836526+0000","last_became_active":"2023-08-09T12:47:38.630195+0000","last_became_peered":"2023-08-09T12:47:38.630195+0000","last_unstale":"2023-08-09T12:47:39.836526+0000","last_undegraded":"2023-08-09T12:47:39.836526+0000","last_fullsized":"2023-08-09T12:47:39.836526+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:56.508305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.749503+0000","last_change":"2023-08-09T12:47:37.606310+0000","last_active":"2023-08-09T12:47:39.749503+0000","last_peered":"2023-08-09T12:47:39.749503+0000","last_clean":"2023-08-09T12:47:39.749503+0000","last_became_active":"2023-08-09T12:47:37.605995+0000","last_became_peered":"2023-08-09T12:47:37.605995+0000","last_unstale":"2023-08-09T12:47:39.749503+0000","last_undegraded":"2023-08-09T12:47:39.749503+0000","last_fullsized":"2023-08-09T12:47:39.749503+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:40:29.670397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.590932+0000","last_change":"2023-08-09T12:47:38.618592+0000","last_active":"2023-08-09T12:47:39.590932+0000","last_peered":"2023-08-09T12:47:39.590932+0000","last_clean":"2023-08-09T12:47:39.590932+0000","last_became_active":"2023-08-09T12:47:38.618344+0000","last_became_peered":"2023-08-09T12:47:38.618344+0000","last_unstale":"2023-08-09T12:47:39.590932+0000","last_undegraded":"2023-08-09T12:47:39.590932+0000","last_fullsized":"2023-08-09T12:47:39.590932+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:22.313814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594825+0000","last_change":"2023-08-09T12:47:37.611823+0000","last_active":"2023-08-09T12:47:39.594825+0000","last_peered":"2023-08-09T12:47:39.594825+0000","last_clean":"2023-08-09T12:47:39.594825+0000","last_became_active":"2023-08-09T12:47:37.611006+0000","last_became_peered":"2023-08-09T12:47:37.611006+0000","last_unstale":"2023-08-09T12:47:39.594825+0000","last_undegraded":"2023-08-09T12:47:39.594825+0000","last_fullsized":"2023-08-09T12:47:39.594825+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:57:45.065648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592738+0000","last_change":"2023-08-09T12:47:38.611615+0000","last_active":"2023-08-09T12:47:39.592738+0000","last_peered":"2023-08-09T12:47:39.592738+0000","last_clean":"2023-08-09T12:47:39.592738+0000","last_became_active":"2023-08-09T12:47:38.611378+0000","last_became_peered":"2023-08-09T12:47:38.611378+0000","last_unstale":"2023-08-09T12:47:39.592738+0000","last_undegraded":"2023-08-09T12:47:39.592738+0000","last_fullsized":"2023-08-09T12:47:39.592738+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:10.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114610+0000","last_change":"2023-08-09T12:47:37.608459+0000","last_active":"2023-08-09T12:47:40.114610+0000","last_peered":"2023-08-09T12:47:40.114610+0000","last_clean":"2023-08-09T12:47:40.114610+0000","last_became_active":"2023-08-09T12:47:37.608211+0000","last_became_peered":"2023-08-09T12:47:37.608211+0000","last_unstale":"2023-08-09T12:47:40.114610+0000","last_undegraded":"2023-08-09T12:47:40.114610+0000","last_fullsized":"2023-08-09T12:47:40.114610+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:15:07.251128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114343+0000","last_change":"2023-08-09T12:47:38.601018+0000","last_active":"2023-08-09T12:47:40.114343+0000","last_peered":"2023-08-09T12:47:40.114343+0000","last_clean":"2023-08-09T12:47:40.114343+0000","last_became_active":"2023-08-09T12:47:38.600599+0000","last_became_peered":"2023-08-09T12:47:38.600599+0000","last_unstale":"2023-08-09T12:47:40.114343+0000","last_undegraded":"2023-08-09T12:47:40.114343+0000","last_fullsized":"2023-08-09T12:47:40.114343+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:44.530461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113909+0000","last_change":"2023-08-09T12:47:37.611005+0000","last_active":"2023-08-09T12:47:40.113909+0000","last_peered":"2023-08-09T12:47:40.113909+0000","last_clean":"2023-08-09T12:47:40.113909+0000","last_became_active":"2023-08-09T12:47:37.610478+0000","last_became_peered":"2023-08-09T12:47:37.610478+0000","last_unstale":"2023-08-09T12:47:40.113909+0000","last_undegraded":"2023-08-09T12:47:40.113909+0000","last_fullsized":"2023-08-09T12:47:40.113909+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:19.282619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835761+0000","last_change":"2023-08-09T12:47:38.623501+0000","last_active":"2023-08-09T12:47:39.835761+0000","last_peered":"2023-08-09T12:47:39.835761+0000","last_clean":"2023-08-09T12:47:39.835761+0000","last_became_active":"2023-08-09T12:47:38.623069+0000","last_became_peered":"2023-08-09T12:47:38.623069+0000","last_unstale":"2023-08-09T12:47:39.835761+0000","last_undegraded":"2023-08-09T12:47:39.835761+0000","last_fullsized":"2023-08-09T12:47:39.835761+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:15.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593686+0000","last_change":"2023-08-09T12:47:37.608400+0000","last_active":"2023-08-09T12:47:39.593686+0000","last_peered":"2023-08-09T12:47:39.593686+0000","last_clean":"2023-08-09T12:47:39.593686+0000","last_became_active":"2023-08-09T12:47:37.608137+0000","last_became_peered":"2023-08-09T12:47:37.608137+0000","last_unstale":"2023-08-09T12:47:39.593686+0000","last_undegraded":"2023-08-09T12:47:39.593686+0000","last_fullsized":"2023-08-09T12:47:39.593686+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:21.663688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593726+0000","last_change":"2023-08-09T12:47:38.614994+0000","last_active":"2023-08-09T12:47:39.593726+0000","last_peered":"2023-08-09T12:47:39.593726+0000","last_clean":"2023-08-09T12:47:39.593726+0000","last_became_active":"2023-08-09T12:47:38.614748+0000","last_became_peered":"2023-08-09T12:47:38.614748+0000","last_unstale":"2023-08-09T12:47:39.593726+0000","last_undegraded":"2023-08-09T12:47:39.593726+0000","last_fullsized":"2023-08-09T12:47:39.593726+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:55:44.141240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834689+0000","last_change":"2023-08-09T12:47:37.610052+0000","last_active":"2023-08-09T12:47:39.834689+0000","last_peered":"2023-08-09T12:47:39.834689+0000","last_clean":"2023-08-09T12:47:39.834689+0000","last_became_active":"2023-08-09T12:47:37.609772+0000","last_became_peered":"2023-08-09T12:47:37.609772+0000","last_unstale":"2023-08-09T12:47:39.834689+0000","last_undegraded":"2023-08-09T12:47:39.834689+0000","last_fullsized":"2023-08-09T12:47:39.834689+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:00:55.253797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835326+0000","last_change":"2023-08-09T12:47:38.613434+0000","last_active":"2023-08-09T12:47:39.835326+0000","last_peered":"2023-08-09T12:47:39.835326+0000","last_clean":"2023-08-09T12:47:39.835326+0000","last_became_active":"2023-08-09T12:47:38.612681+0000","last_became_peered":"2023-08-09T12:47:38.612681+0000","last_unstale":"2023-08-09T12:47:39.835326+0000","last_undegraded":"2023-08-09T12:47:39.835326+0000","last_fullsized":"2023-08-09T12:47:39.835326+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:04:32.275056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"145'8","reported_seq":21,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114462+0000","last_change":"2023-08-09T12:47:37.610418+0000","last_active":"2023-08-09T12:47:40.114462+0000","last_peered":"2023-08-09T12:47:40.114462+0000","last_clean":"2023-08-09T12:47:40.114462+0000","last_became_active":"2023-08-09T12:47:37.610113+0000","last_became_peered":"2023-08-09T12:47:37.610113+0000","last_unstale":"2023-08-09T12:47:40.114462+0000","last_undegraded":"2023-08-09T12:47:40.114462+0000","last_fullsized":"2023-08-09T12:47:40.114462+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:45:22.606673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":415,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836358+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:47:39.836358+0000","last_peered":"2023-08-09T12:47:39.836358+0000","last_clean":"2023-08-09T12:47:39.836358+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:47:39.836358+0000","last_undegraded":"2023-08-09T12:47:39.836358+0000","last_fullsized":"2023-08-09T12:47:39.836358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:12:48.082807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":235,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837427+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:47:39.837427+0000","last_peered":"2023-08-09T12:47:39.837427+0000","last_clean":"2023-08-09T12:47:39.837427+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:47:39.837427+0000","last_undegraded":"2023-08-09T12:47:39.837427+0000","last_fullsized":"2023-08-09T12:47:39.837427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:45.728929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748770+0000","last_change":"2023-08-09T12:47:38.599652+0000","last_active":"2023-08-09T12:47:39.748770+0000","last_peered":"2023-08-09T12:47:39.748770+0000","last_clean":"2023-08-09T12:47:39.748770+0000","last_became_active":"2023-08-09T12:47:38.598975+0000","last_became_peered":"2023-08-09T12:47:38.598975+0000","last_unstale":"2023-08-09T12:47:39.748770+0000","last_undegraded":"2023-08-09T12:47:39.748770+0000","last_fullsized":"2023-08-09T12:47:39.748770+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:32.208975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113968+0000","last_change":"2023-08-09T12:47:37.610165+0000","last_active":"2023-08-09T12:47:40.113968+0000","last_peered":"2023-08-09T12:47:40.113968+0000","last_clean":"2023-08-09T12:47:40.113968+0000","last_became_active":"2023-08-09T12:47:37.609085+0000","last_became_peered":"2023-08-09T12:47:37.609085+0000","last_unstale":"2023-08-09T12:47:40.113968+0000","last_undegraded":"2023-08-09T12:47:40.113968+0000","last_fullsized":"2023-08-09T12:47:40.113968+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:50.956437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835671+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:47:39.835671+0000","last_peered":"2023-08-09T12:47:39.835671+0000","last_clean":"2023-08-09T12:47:39.835671+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:47:39.835671+0000","last_undegraded":"2023-08-09T12:47:39.835671+0000","last_fullsized":"2023-08-09T12:47:39.835671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:40:52.671140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593395+0000","last_change":"2023-08-09T12:47:38.618695+0000","last_active":"2023-08-09T12:47:39.593395+0000","last_peered":"2023-08-09T12:47:39.593395+0000","last_clean":"2023-08-09T12:47:39.593395+0000","last_became_active":"2023-08-09T12:47:38.618438+0000","last_became_peered":"2023-08-09T12:47:38.618438+0000","last_unstale":"2023-08-09T12:47:39.593395+0000","last_undegraded":"2023-08-09T12:47:39.593395+0000","last_fullsized":"2023-08-09T12:47:39.593395+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:23.190301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113614+0000","last_change":"2023-08-09T12:47:37.603392+0000","last_active":"2023-08-09T12:47:40.113614+0000","last_peered":"2023-08-09T12:47:40.113614+0000","last_clean":"2023-08-09T12:47:40.113614+0000","last_became_active":"2023-08-09T12:47:37.602991+0000","last_became_peered":"2023-08-09T12:47:37.602991+0000","last_unstale":"2023-08-09T12:47:40.113614+0000","last_undegraded":"2023-08-09T12:47:40.113614+0000","last_fullsized":"2023-08-09T12:47:40.113614+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:13:15.703729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591101+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:47:39.591101+0000","last_peered":"2023-08-09T12:47:39.591101+0000","last_clean":"2023-08-09T12:47:39.591101+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:47:39.591101+0000","last_undegraded":"2023-08-09T12:47:39.591101+0000","last_fullsized":"2023-08-09T12:47:39.591101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:46.213248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591513+0000","last_change":"2023-08-09T12:47:38.611702+0000","last_active":"2023-08-09T12:47:39.591513+0000","last_peered":"2023-08-09T12:47:39.591513+0000","last_clean":"2023-08-09T12:47:39.591513+0000","last_became_active":"2023-08-09T12:47:38.611317+0000","last_became_peered":"2023-08-09T12:47:38.611317+0000","last_unstale":"2023-08-09T12:47:39.591513+0000","last_undegraded":"2023-08-09T12:47:39.591513+0000","last_fullsized":"2023-08-09T12:47:39.591513+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:40:52.826235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114041+0000","last_change":"2023-08-09T12:47:37.612169+0000","last_active":"2023-08-09T12:47:40.114041+0000","last_peered":"2023-08-09T12:47:40.114041+0000","last_clean":"2023-08-09T12:47:40.114041+0000","last_became_active":"2023-08-09T12:47:37.611919+0000","last_became_peered":"2023-08-09T12:47:37.611919+0000","last_unstale":"2023-08-09T12:47:40.114041+0000","last_undegraded":"2023-08-09T12:47:40.114041+0000","last_fullsized":"2023-08-09T12:47:40.114041+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:52:39.227580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":235,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837333+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:47:39.837333+0000","last_peered":"2023-08-09T12:47:39.837333+0000","last_clean":"2023-08-09T12:47:39.837333+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:47:39.837333+0000","last_undegraded":"2023-08-09T12:47:39.837333+0000","last_fullsized":"2023-08-09T12:47:39.837333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:14:25.552659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.749396+0000","last_change":"2023-08-09T12:47:38.625611+0000","last_active":"2023-08-09T12:47:39.749396+0000","last_peered":"2023-08-09T12:47:39.749396+0000","last_clean":"2023-08-09T12:47:39.749396+0000","last_became_active":"2023-08-09T12:47:38.625040+0000","last_became_peered":"2023-08-09T12:47:38.625040+0000","last_unstale":"2023-08-09T12:47:39.749396+0000","last_undegraded":"2023-08-09T12:47:39.749396+0000","last_fullsized":"2023-08-09T12:47:39.749396+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:30.185512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748468+0000","last_change":"2023-08-09T12:47:37.603307+0000","last_active":"2023-08-09T12:47:39.748468+0000","last_peered":"2023-08-09T12:47:39.748468+0000","last_clean":"2023-08-09T12:47:39.748468+0000","last_became_active":"2023-08-09T12:47:37.603018+0000","last_became_peered":"2023-08-09T12:47:37.603018+0000","last_unstale":"2023-08-09T12:47:39.748468+0000","last_undegraded":"2023-08-09T12:47:39.748468+0000","last_fullsized":"2023-08-09T12:47:39.748468+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:01.427332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593619+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:47:39.593619+0000","last_peered":"2023-08-09T12:47:39.593619+0000","last_clean":"2023-08-09T12:47:39.593619+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:47:39.593619+0000","last_undegraded":"2023-08-09T12:47:39.593619+0000","last_fullsized":"2023-08-09T12:47:39.593619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:57:52.195576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835866+0000","last_change":"2023-08-09T12:47:38.617562+0000","last_active":"2023-08-09T12:47:39.835866+0000","last_peered":"2023-08-09T12:47:39.835866+0000","last_clean":"2023-08-09T12:47:39.835866+0000","last_became_active":"2023-08-09T12:47:38.613829+0000","last_became_peered":"2023-08-09T12:47:38.613829+0000","last_unstale":"2023-08-09T12:47:39.835866+0000","last_undegraded":"2023-08-09T12:47:39.835866+0000","last_fullsized":"2023-08-09T12:47:39.835866+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:23.190301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837128+0000","last_change":"2023-08-09T12:47:37.594752+0000","last_active":"2023-08-09T12:47:39.837128+0000","last_peered":"2023-08-09T12:47:39.837128+0000","last_clean":"2023-08-09T12:47:39.837128+0000","last_became_active":"2023-08-09T12:47:37.593909+0000","last_became_peered":"2023-08-09T12:47:37.593909+0000","last_unstale":"2023-08-09T12:47:39.837128+0000","last_undegraded":"2023-08-09T12:47:39.837128+0000","last_fullsized":"2023-08-09T12:47:39.837128+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:08:33.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835462+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:47:39.835462+0000","last_peered":"2023-08-09T12:47:39.835462+0000","last_clean":"2023-08-09T12:47:39.835462+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:47:39.835462+0000","last_undegraded":"2023-08-09T12:47:39.835462+0000","last_fullsized":"2023-08-09T12:47:39.835462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:49.741300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113808+0000","last_change":"2023-08-09T12:47:38.598777+0000","last_active":"2023-08-09T12:47:40.113808+0000","last_peered":"2023-08-09T12:47:40.113808+0000","last_clean":"2023-08-09T12:47:40.113808+0000","last_became_active":"2023-08-09T12:47:38.598541+0000","last_became_peered":"2023-08-09T12:47:38.598541+0000","last_unstale":"2023-08-09T12:47:40.113808+0000","last_undegraded":"2023-08-09T12:47:40.113808+0000","last_fullsized":"2023-08-09T12:47:40.113808+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:46:27.288802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"145'3","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837041+0000","last_change":"2023-08-09T12:47:37.608278+0000","last_active":"2023-08-09T12:47:39.837041+0000","last_peered":"2023-08-09T12:47:39.837041+0000","last_clean":"2023-08-09T12:47:39.837041+0000","last_became_active":"2023-08-09T12:47:37.608019+0000","last_became_peered":"2023-08-09T12:47:37.608019+0000","last_unstale":"2023-08-09T12:47:39.837041+0000","last_undegraded":"2023-08-09T12:47:39.837041+0000","last_fullsized":"2023-08-09T12:47:39.837041+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:07.171927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":236,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593170+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:47:39.593170+0000","last_peered":"2023-08-09T12:47:39.593170+0000","last_clean":"2023-08-09T12:47:39.593170+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:47:39.593170+0000","last_undegraded":"2023-08-09T12:47:39.593170+0000","last_fullsized":"2023-08-09T12:47:39.593170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:59:51.745185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837140+0000","last_change":"2023-08-09T12:47:38.616131+0000","last_active":"2023-08-09T12:47:39.837140+0000","last_peered":"2023-08-09T12:47:39.837140+0000","last_clean":"2023-08-09T12:47:39.837140+0000","last_became_active":"2023-08-09T12:47:38.614504+0000","last_became_peered":"2023-08-09T12:47:38.614504+0000","last_unstale":"2023-08-09T12:47:39.837140+0000","last_undegraded":"2023-08-09T12:47:39.837140+0000","last_fullsized":"2023-08-09T12:47:39.837140+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:11:30.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"145'6","reported_seq":19,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113873+0000","last_change":"2023-08-09T12:47:37.608635+0000","last_active":"2023-08-09T12:47:40.113873+0000","last_peered":"2023-08-09T12:47:40.113873+0000","last_clean":"2023-08-09T12:47:40.113873+0000","last_became_active":"2023-08-09T12:47:37.608363+0000","last_became_peered":"2023-08-09T12:47:37.608363+0000","last_unstale":"2023-08-09T12:47:40.113873+0000","last_undegraded":"2023-08-09T12:47:40.113873+0000","last_fullsized":"2023-08-09T12:47:40.113873+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:53:51.774987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748949+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:47:39.748949+0000","last_peered":"2023-08-09T12:47:39.748949+0000","last_clean":"2023-08-09T12:47:39.748949+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:47:39.748949+0000","last_undegraded":"2023-08-09T12:47:39.748949+0000","last_fullsized":"2023-08-09T12:47:39.748949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:16:08.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574952,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193891,"statfs":{"total":200000000,"available":198544739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.135,"15min":1.1080000000000001},"min":{"1min":0.76900000000000002,"5min":0.627,"15min":0.59899999999999998},"max":{"1min":1.587,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":1.069},{"interface":"front","average":{"1min":1.069,"5min":1.1240000000000001,"15min":1.0900000000000001},"min":{"1min":0.76300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6659999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.274}]},{"osd":1,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2390000000000001,"15min":1.1419999999999999},"min":{"1min":0.74199999999999999,"5min":0.70799999999999996,"15min":0.63300000000000001},"max":{"1min":1.7809999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.125,"5min":1.2030000000000001,"15min":1.1299999999999999},"min":{"1min":0.72899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5349999999999999,"5min":1.714,"15min":1.734},"last":1.133}]},{"osd":2,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2989999999999999,"15min":1.1990000000000001},"min":{"1min":0.79200000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.661,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2210000000000001,"15min":1.169},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.5429999999999999,"5min":1.7450000000000001,"15min":2.173},"last":1.5489999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.351,"15min":1.26},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.696,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.373,"15min":1.294},"min":{"1min":0.72699999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.8460000000000001,"5min":2.282,"15min":2.282},"last":1.24}]},{"osd":4,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2589999999999999,"15min":1.2230000000000001},"min":{"1min":1.0409999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.768,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.464},{"interface":"front","average":{"1min":1.391,"5min":1.4399999999999999,"15min":1.3160000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.58599999999999997},"max":{"1min":1.8480000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.3959999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4399999999999999,"15min":1.333},"min":{"1min":0.88800000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9530000000000001,"5min":2.802,"15min":2.802},"last":1.347},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5509999999999999,"15min":1.5009999999999999},"min":{"1min":0.89300000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9450000000000001,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.6579999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5129999999999999,"15min":1.4810000000000001},"min":{"1min":0.96199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.0249999999999999,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.5509999999999999,"15min":1.4690000000000001},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":0.623},"max":{"1min":1.9770000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.591}]}]},{"osd":6,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1599999999999999,"15min":1.1319999999999999},"min":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4159999999999999,"5min":1.986,"15min":2.54},"last":1.536},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.101,"15min":1.0740000000000001},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2350000000000001,"15min":1.2330000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.66500000000000004},"max":{"1min":1.996,"5min":1.996,"15min":2.306},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.335,"15min":1.3220000000000001},"min":{"1min":0.79100000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.655,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.93500000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1739999999999999,"15min":1.1140000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.4399999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.288},{"interface":"front","average":{"1min":1.284,"5min":1.3109999999999999,"15min":1.2829999999999999},"min":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.772}]},{"osd":3,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.327,"15min":1.282},"min":{"1min":0.79500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.595,"5min":2.327,"15min":2.327},"last":1.496},{"interface":"front","average":{"1min":1.27,"5min":1.3819999999999999,"15min":1.3089999999999999},"min":{"1min":0.81799999999999995,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.6120000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.4550000000000001,"15min":1.349},"min":{"1min":0.93799999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7070000000000001,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.383,"15min":1.349},"min":{"1min":0.85399999999999998,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.744,"5min":2.29,"15min":2.3479999999999999},"last":1.1080000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.403,"15min":1.343},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":2.2349999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.536,"15min":1.492},"min":{"1min":1.22,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.8220000000000001,"5min":2.4319999999999999,"15min":2.8580000000000001},"last":1.677}]},{"osd":7,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5569999999999999,"15min":1.458},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.885,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.569,"15min":1.464},"min":{"1min":0.98699999999999999,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":2.7810000000000001,"5min":3.621,"15min":3.621},"last":1.8109999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1000000000000001,"15min":1.107},"min":{"1min":0.68000000000000005,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":3.4060000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.202,"15min":1.101},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.569,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.1850000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3580000000000001,"15min":1.306},"min":{"1min":0.91700000000000004,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.671,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.278,"15min":1.2549999999999999},"min":{"1min":0.73899999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.1020000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2390000000000001,"15min":1.2130000000000001},"min":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.194,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.446},{"interface":"front","average":{"1min":1.278,"5min":1.23,"15min":1.2},"min":{"1min":0.92300000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.4970000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.325,"15min":1.2310000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7829999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3819999999999999,"15min":1.3740000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":2.3319999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.2230000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.3080000000000001,"15min":1.2529999999999999},"min":{"1min":0.83999999999999997,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.571},{"interface":"front","average":{"1min":1.51,"5min":1.4319999999999999,"15min":1.3879999999999999},"min":{"1min":0.88400000000000001,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":3.3109999999999999,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.546}]},{"osd":6,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.423,"15min":1.3620000000000001},"min":{"1min":1.0209999999999999,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":2.952,"5min":2.952,"15min":2.952},"last":1.589},{"interface":"front","average":{"1min":1.716,"5min":1.5049999999999999,"15min":1.4950000000000001},"min":{"1min":1.0660000000000001,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":5.8570000000000002,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.6240000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.554,"15min":1.5289999999999999},"min":{"1min":1.081,"5min":0.76900000000000002,"15min":0.67200000000000004},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.7270000000000001},{"interface":"front","average":{"1min":1.6850000000000001,"5min":1.6100000000000001,"15min":1.54},"min":{"1min":1.1279999999999999,"5min":0.80000000000000004,"15min":0.65300000000000002},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.694}]}]},{"osd":4,"up_from":13,"seq":55834574952,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":845,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194467,"statfs":{"total":200000000,"available":199134271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.135,"15min":1.0960000000000001},"min":{"1min":0.68700000000000006,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6060000000000001,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.349},{"interface":"front","average":{"1min":1.155,"5min":1.169,"15min":1.1140000000000001},"min":{"1min":0.69099999999999995,"5min":0.66500000000000004,"15min":0.64800000000000002},"max":{"1min":1.635,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.5229999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2669999999999999,"15min":1.3169999999999999},"min":{"1min":0.82199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.468,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3160000000000001,"15min":1.331},"min":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.772,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.109}]},{"osd":2,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3089999999999999,"15min":1.3160000000000001},"min":{"1min":0.88500000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6000000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.3600000000000001,"15min":1.331},"min":{"1min":0.88,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.978,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.2350000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.306,"15min":1.2390000000000001},"min":{"1min":0.76700000000000002,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.9159999999999999,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.329,"15min":1.333},"min":{"1min":0.95999999999999996,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":1.6779999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.304}]},{"osd":5,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.3560000000000001,"15min":1.3839999999999999},"min":{"1min":0.996,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":1.843,"5min":3.137,"15min":3.137},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.3939999999999999,"15min":1.383},"min":{"1min":1.032,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.157}]},{"osd":6,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4450000000000001,"15min":1.478},"min":{"1min":1.1000000000000001,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":1.9410000000000001,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.393},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.542,"15min":1.542},"min":{"1min":0.97399999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1909999999999998,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.5580000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.5449999999999999,"15min":1.5269999999999999},"min":{"1min":0.94199999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.2429999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.419},{"interface":"front","average":{"1min":1.554,"5min":1.587,"15min":1.615},"min":{"1min":1.2669999999999999,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.0510000000000002,"5min":2.875,"15min":2.875},"last":1.603}]}]},{"osd":3,"up_from":13,"seq":55834574952,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":845,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194467,"statfs":{"total":200000000,"available":199134237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86099999999999999,"15min":0.84299999999999997},"min":{"1min":0.53400000000000003,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.1619999999999999,"5min":1.4219999999999999,"15min":4.4109999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":0.93400000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.35499999999999998},"max":{"1min":1.3,"5min":2.778,"15min":3.2269999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.92900000000000005,"15min":0.90100000000000002},"min":{"1min":0.53600000000000003,"5min":0.41099999999999998,"15min":0.38100000000000001},"max":{"1min":1.147,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.129,"15min":0.97099999999999997},"min":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.373},"max":{"1min":1.704,"5min":2.0219999999999998,"15min":2.0880000000000001},"last":0.33900000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.125,"15min":1.1279999999999999},"min":{"1min":0.61399999999999999,"5min":0.53700000000000003,"15min":0.433},"max":{"1min":1.4570000000000001,"5min":1.9259999999999999,"15min":18.145},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2350000000000001,"15min":1.2030000000000001},"min":{"1min":0.67200000000000004,"5min":0.53800000000000003,"15min":0.41799999999999998},"max":{"1min":1.976,"5min":2.169,"15min":2.169},"last":0.379}]},{"osd":4,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.284,"15min":1.3149999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.745},"max":{"1min":1.718,"5min":2.859,"15min":3.5110000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3149999999999999,"15min":1.3340000000000001},"min":{"1min":0.91500000000000004,"5min":0.89300000000000002,"15min":0.65400000000000003},"max":{"1min":2.056,"5min":2.056,"15min":3.5960000000000001},"last":1.0720000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.345,"15min":1.4319999999999999},"min":{"1min":0.85599999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":18.094000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.458,"15min":1.383},"min":{"1min":1.0069999999999999,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.8109999999999999,"5min":3.0419999999999998,"15min":14.105},"last":0.752}]},{"osd":6,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.393,"15min":1.3580000000000001},"min":{"1min":1.016,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.429,"15min":1.4670000000000001},"min":{"1min":0.86399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8340000000000001,"5min":2.0099999999999998,"15min":4.0220000000000002},"last":1.1919999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.5169999999999999,"15min":1.4199999999999999},"min":{"1min":1.0780000000000001,"5min":0.90900000000000003,"15min":0.72499999999999998},"max":{"1min":1.9119999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.569,"5min":1.4950000000000001,"15min":1.4119999999999999},"min":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":2.073,"5min":2.073,"15min":3.016},"last":1.296}]}]},{"osd":2,"up_from":13,"seq":55834574953,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.88400000000000001,"15min":0.86299999999999999},"min":{"1min":0.60899999999999999,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":1.377,"5min":1.597,"15min":1.716},"last":1.181},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0069999999999999,"15min":0.96299999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.73,"15min":2.9009999999999998},"last":1.0189999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.94799999999999995,"15min":0.92300000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.36299999999999999},"max":{"1min":1.2190000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.075,"15min":1.054},"min":{"1min":0.68100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5820000000000001,"5min":1.823,"15min":1.869},"last":0.85799999999999998}]},{"osd":3,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.177,"15min":1.163},"min":{"1min":0.59799999999999998,"5min":0.54800000000000004,"15min":0.46600000000000003},"max":{"1min":1.6140000000000001,"5min":1.6819999999999999,"15min":3.2850000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1990000000000001,"15min":1.161},"min":{"1min":0.67200000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.581,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":1.345}]},{"osd":4,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.448,"15min":1.417},"min":{"1min":0.88800000000000001,"5min":0.82599999999999996,"15min":0.81899999999999995},"max":{"1min":1.7709999999999999,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.712},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.343,"15min":1.2929999999999999},"min":{"1min":0.84499999999999997,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.974,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":1.6040000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.409,"15min":1.373},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4650000000000001,"15min":1.476},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.929,"5min":2.4780000000000002,"15min":4.806},"last":1.55}]},{"osd":6,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.379,"15min":1.3220000000000001},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8069999999999999,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.288},{"interface":"front","average":{"1min":1.387,"5min":1.476,"15min":1.4279999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8140000000000001,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":1.653}]},{"osd":7,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4470000000000001,"15min":1.3819999999999999},"min":{"1min":0.82399999999999995,"5min":0.76900000000000002,"15min":0.76200000000000001},"max":{"1min":2.1309999999999998,"5min":2.464,"15min":2.464},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.556,"15min":1.534},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.984,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.764}]}]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":1.304,"5min":2.621,"15min":2.621},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.036,"15min":1.27},"min":{"1min":0.54500000000000004,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.778,"5min":1.9790000000000001,"15min":88.254999999999995},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0149999999999999,"15min":0.96299999999999997},"min":{"1min":0.71299999999999997,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.6180000000000001,"5min":1.9390000000000001,"15min":3.0209999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.115,"5min":1.2909999999999999,"15min":1.1619999999999999},"min":{"1min":0.74099999999999999,"5min":0.622,"15min":0.61799999999999999},"max":{"1min":1.7330000000000001,"5min":2.0449999999999999,"15min":3.1890000000000001},"last":1.054}]},{"osd":3,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.2230000000000001,"15min":1.1120000000000001},"min":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.57399999999999995},"max":{"1min":1.4870000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.1279999999999999,"15min":1.0009999999999999},"min":{"1min":0.60199999999999998,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.819,"5min":1.819,"15min":5.4320000000000004},"last":0.94099999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2569999999999999,"15min":1.3},"min":{"1min":0.871,"5min":0.80000000000000004,"15min":0.76200000000000001},"max":{"1min":1.6739999999999999,"5min":2.391,"15min":25.172000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.421,"15min":1.323},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7270000000000001,"5min":3.762,"15min":3.762},"last":1.181}]},{"osd":5,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3600000000000001,"15min":1.4079999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7170000000000001,"5min":2.5419999999999998,"15min":28.710000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3460000000000001,"15min":1.2949999999999999},"min":{"1min":0.81899999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.802,"5min":2.048,"15min":3.762},"last":0.98499999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.49,"15min":1.4379999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7170000000000001,"5min":1.9670000000000001,"15min":6.0460000000000003},"last":1.375},{"interface":"front","average":{"1min":1.409,"5min":1.4750000000000001,"15min":1.393},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":1.8,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.3440000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.5600000000000001,"15min":1.5920000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9430000000000001,"5min":2.5089999999999999,"15min":26.975999999999999},"last":1.28},{"interface":"front","average":{"1min":1.468,"5min":1.575,"15min":1.5840000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.948,"5min":2.492,"15min":28.765000000000001},"last":1.323}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1420,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193892,"statfs":{"total":200000000,"available":198545493,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.90900000000000003,"15min":0.874},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.294,"5min":1.597,"15min":1.819},"last":1.4039999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":1.038,"15min":0.97299999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.3959999999999999,"5min":1.6699999999999999,"15min":6.1749999999999998},"last":1.331}]},{"osd":2,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0469999999999999,"15min":0.97599999999999998},"min":{"1min":0.51300000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.514,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.179},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0860000000000001,"15min":1.042},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.5},"max":{"1min":1.2649999999999999,"5min":1.732,"15min":6.2549999999999999},"last":0.89800000000000002}]},{"osd":3,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0629999999999999,"15min":0.97399999999999998},"min":{"1min":0.57899999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6639999999999999,"5min":1.6699999999999999,"15min":9.6069999999999993},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.218,"15min":1.1839999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.444,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":1.9350000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3340000000000001,"15min":1.337},"min":{"1min":1.1040000000000001,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.7909999999999999,"5min":1.8240000000000001,"15min":9.9629999999999992},"last":1.258},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.306},"min":{"1min":0.92100000000000004,"5min":0.78600000000000003,"15min":0.77900000000000003},"max":{"1min":1.8560000000000001,"5min":1.879,"15min":1.879},"last":1.825}]},{"osd":5,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3620000000000001,"15min":1.3220000000000001},"min":{"1min":0.82799999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.75,"5min":2.0419999999999998,"15min":10.004},"last":1.478},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4419999999999999,"15min":1.391},"min":{"1min":0.90300000000000002,"5min":0.90200000000000002,"15min":0.84999999999999998},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.161},"last":1.552}]},{"osd":6,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.4139999999999999,"15min":1.3620000000000001},"min":{"1min":1.117,"5min":1.0409999999999999,"15min":0.75900000000000001},"max":{"1min":2.0329999999999999,"5min":2.2000000000000002,"15min":6.4290000000000003},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.4650000000000001,"15min":1.4410000000000001},"min":{"1min":0.90200000000000002,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":2.117,"5min":2.1549999999999998,"15min":9.9190000000000005},"last":1.7030000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.79200000000000004},"max":{"1min":1.9259999999999999,"5min":2.2909999999999999,"15min":18.114000000000001},"last":1.659},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.4830000000000001},"min":{"1min":0.94099999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.0350000000000001,"5min":2.1120000000000001,"15min":9.5640000000000001},"last":1.891}]}]}],"pool_statfs":[]}} 2023-08-09T12:47:43.341 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:47:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.602+0000 7f8dc7964640 1 Processor -- start 2023-08-09T12:47:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.603+0000 7f8dc7964640 1 -- start start 2023-08-09T12:47:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.604+0000 7f8dc7964640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8dc0159250 0x7f8dc00ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.604+0000 7f8dc7964640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8dc0070230 0x7f8dc015b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.604+0000 7f8dc7964640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc0070650 con 0x7f8dc00cd400 2023-08-09T12:47:43.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.604+0000 7f8dc7964640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc00cd890 con 0x7f8dc0070230 2023-08-09T12:47:43.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.604+0000 7f8dc7964640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc0070890 con 0x7f8dc0159250 2023-08-09T12:47:43.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8dc5f01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8dc0070230 0x7f8dc015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8dc4eff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8dc00cd400 0x7f8dc006fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33190/0 (socket says 172.21.15.17:33190) 2023-08-09T12:47:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8dc4eff640 1 -- 172.21.15.17:0/409189764 learned_addr learned my addr 172.21.15.17:0/409189764 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8dc5700640 1 --2- 172.21.15.17:0/409189764 >> v2:172.21.15.142:3300/0 conn(0x7f8dc0159250 0x7f8dc00ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8db7fff640 1 -- 172.21.15.17:0/409189764 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59351785 0 0) 0x7f8db0001290 con 0x7f8dc00cd400 2023-08-09T12:47:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8db7fff640 1 -- 172.21.15.17:0/409189764 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac003520 con 0x7f8dc00cd400 2023-08-09T12:47:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8dc5f01640 1 -- 172.21.15.17:0/409189764 >> v2:172.21.15.142:3300/0 conn(0x7f8dc0159250 msgr2=0x7f8dc00ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8dc5f01640 1 --2- 172.21.15.17:0/409189764 >> v2:172.21.15.142:3300/0 conn(0x7f8dc0159250 0x7f8dc00ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.605+0000 7f8dc5f01640 1 -- 172.21.15.17:0/409189764 >> v1:172.21.15.17:6789/0 conn(0x7f8dc00cd400 legacy=0x7f8dc006fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.606+0000 7f8dc5f01640 1 -- 172.21.15.17:0/409189764 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc015a940 con 0x7f8dc0070230 2023-08-09T12:47:43.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.607+0000 7f8dc5f01640 1 --2- 172.21.15.17:0/409189764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc015b950 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b1320 tx=0x7f8db802cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6752ef2e4e5f5f86 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:43.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.607+0000 7f8db7fff640 1 -- 172.21.15.17:0/409189764 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db802db50 con 0x7f8dc0070230 2023-08-09T12:47:43.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.607+0000 7f8db7fff640 1 -- 172.21.15.17:0/409189764 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db802dcb0 con 0x7f8dc0070230 2023-08-09T12:47:43.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.607+0000 7f8db7fff640 1 -- 172.21.15.17:0/409189764 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8008640 con 0x7f8dc0070230 2023-08-09T12:47:43.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.608+0000 7f8dc7964640 1 -- 172.21.15.17:0/409189764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 msgr2=0x7f8dc015b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.608+0000 7f8dc7964640 1 --2- 172.21.15.17:0/409189764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc015b950 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b1320 tx=0x7f8db802cfb0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.608+0000 7f8dc7964640 1 -- 172.21.15.17:0/409189764 shutdown_connections 2023-08-09T12:47:43.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.608+0000 7f8dc7964640 1 --2- 172.21.15.17:0/409189764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc015b950 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.608+0000 7f8dc7964640 1 --2- 172.21.15.17:0/409189764 >> v2:172.21.15.142:3300/0 conn(0x7f8dc0159250 0x7f8dc00ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.608+0000 7f8dc7964640 1 -- 172.21.15.17:0/409189764 >> 172.21.15.17:0/409189764 conn(0x7f8dc00cb1b0 msgr2=0x7f8dc00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:43.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.608+0000 7f8dc7964640 1 -- 172.21.15.17:0/409189764 shutdown_connections 2023-08-09T12:47:43.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.608+0000 7f8dc7964640 1 -- 172.21.15.17:0/409189764 wait complete. 2023-08-09T12:47:43.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.610+0000 7f8dc7964640 1 Processor -- start 2023-08-09T12:47:43.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.610+0000 7f8dc7964640 1 -- start start 2023-08-09T12:47:43.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc7964640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc00b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc7964640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dc00cd400 0x7f8dc0150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc7964640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc0159250 0x7f8dc00ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc7964640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01f3580 con 0x7f8dc0070230 2023-08-09T12:47:43.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc7964640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01511a0 con 0x7f8dc0159250 2023-08-09T12:47:43.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc7964640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01f2970 con 0x7f8dc00cd400 2023-08-09T12:47:43.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc5700640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc00b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc5700640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc00b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59462/0 (socket says 172.21.15.17:59462) 2023-08-09T12:47:43.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.611+0000 7f8dc5700640 1 -- 172.21.15.17:0/1429540598 learned_addr learned my addr 172.21.15.17:0/1429540598 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8dc5700640 1 -- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dc00cd400 msgr2=0x7f8dc0150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8dc5700640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dc00cd400 0x7f8dc0150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8dc5700640 1 -- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc0159250 msgr2=0x7f8dc00ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8dc5700640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc0159250 0x7f8dc00ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8dc5700640 1 -- 172.21.15.17:0/1429540598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db800ab80 con 0x7f8dc0070230 2023-08-09T12:47:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8dc5700640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc00b2850 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00e870 tx=0x7f8dbc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8db5ffb640 1 -- 172.21.15.17:0/1429540598 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0094f0 con 0x7f8dc0070230 2023-08-09T12:47:43.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8db5ffb640 1 -- 172.21.15.17:0/1429540598 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00c940 con 0x7f8dc0070230 2023-08-09T12:47:43.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8db5ffb640 1 -- 172.21.15.17:0/1429540598 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00ccf0 con 0x7f8dc0070230 2023-08-09T12:47:43.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.612+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc01f2c50 con 0x7f8dc0070230 2023-08-09T12:47:43.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.613+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc01f3210 con 0x7f8dc0070230 2023-08-09T12:47:43.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.614+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc00cb860 con 0x7f8dc0070230 2023-08-09T12:47:43.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.615+0000 7f8db5ffb640 1 -- 172.21.15.17:0/1429540598 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8dbc013470 con 0x7f8dc0070230 2023-08-09T12:47:43.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.616+0000 7f8db5ffb640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8da406a050 0x7f8da406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:43.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.616+0000 7f8db5ffb640 1 -- 172.21.15.17:0/1429540598 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8dbc088650 con 0x7f8dc0070230 2023-08-09T12:47:43.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.616+0000 7f8dc4eff640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8da406a050 0x7f8da406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:43.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.617+0000 7f8dc4eff640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8da406a050 0x7f8da406c510 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8db00013f0 tx=0x7f8db0001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:43.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.620+0000 7f8db5ffb640 1 -- 172.21.15.17:0/1429540598 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8dbc053d30 con 0x7f8dc0070230 2023-08-09T12:47:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.812+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8dc015ab90 con 0x7f8da406a050 2023-08-09T12:47:43.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.838+0000 7f8db5ffb640 1 -- 172.21.15.17:0/1429540598 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303708 (secure 0 0 0) 0x7f8db00070d0 con 0x7f8da406a050 2023-08-09T12:47:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:43.849 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:47:43.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.845+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8da406a050 msgr2=0x7f8da406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.845+0000 7f8dc7964640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8da406a050 0x7f8da406c510 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8db00013f0 tx=0x7f8db0001240 comp rx=0 tx=0).stop 2023-08-09T12:47:43.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.845+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 msgr2=0x7f8dc00b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:43.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.845+0000 7f8dc7964640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc00b2850 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00e870 tx=0x7f8dbc00ed30 comp rx=0 tx=0).stop 2023-08-09T12:47:43.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.846+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 shutdown_connections 2023-08-09T12:47:43.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.846+0000 7f8dc7964640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8da406a050 0x7f8da406c510 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.846+0000 7f8dc7964640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc0159250 0x7f8dc00ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.846+0000 7f8dc7964640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dc00cd400 0x7f8dc0150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.846+0000 7f8dc7964640 1 --2- 172.21.15.17:0/1429540598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc0070230 0x7f8dc00b2850 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:43.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.846+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 >> 172.21.15.17:0/1429540598 conn(0x7f8dc00cb1b0 msgr2=0x7f8dc00cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:43.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.846+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 shutdown_connections 2023-08-09T12:47:43.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:43.846+0000 7f8dc7964640 1 -- 172.21.15.17:0/1429540598 wait complete. 2023-08-09T12:47:43.877 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":395,"stamp":"2023-08-09T12:47:42.825952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7908,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554591,"statfs":{"total":1600000000,"available":1591901508,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001779"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113492+0000","last_change":"2023-08-09T12:47:38.619258+0000","last_active":"2023-08-09T12:47:40.113492+0000","last_peered":"2023-08-09T12:47:40.113492+0000","last_clean":"2023-08-09T12:47:40.113492+0000","last_became_active":"2023-08-09T12:47:38.615038+0000","last_became_peered":"2023-08-09T12:47:38.615038+0000","last_unstale":"2023-08-09T12:47:40.113492+0000","last_undegraded":"2023-08-09T12:47:40.113492+0000","last_fullsized":"2023-08-09T12:47:40.113492+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:36:43.952946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113254+0000","last_change":"2023-08-09T12:47:38.615219+0000","last_active":"2023-08-09T12:47:40.113254+0000","last_peered":"2023-08-09T12:47:40.113254+0000","last_clean":"2023-08-09T12:47:40.113254+0000","last_became_active":"2023-08-09T12:47:38.613495+0000","last_became_peered":"2023-08-09T12:47:38.613495+0000","last_unstale":"2023-08-09T12:47:40.113254+0000","last_undegraded":"2023-08-09T12:47:40.113254+0000","last_fullsized":"2023-08-09T12:47:40.113254+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:14:04.354239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113726+0000","last_change":"2023-08-09T12:47:38.600841+0000","last_active":"2023-08-09T12:47:40.113726+0000","last_peered":"2023-08-09T12:47:40.113726+0000","last_clean":"2023-08-09T12:47:40.113726+0000","last_became_active":"2023-08-09T12:47:38.600268+0000","last_became_peered":"2023-08-09T12:47:38.600268+0000","last_unstale":"2023-08-09T12:47:40.113726+0000","last_undegraded":"2023-08-09T12:47:40.113726+0000","last_fullsized":"2023-08-09T12:47:40.113726+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:43:24.977341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835149+0000","last_change":"2023-08-09T12:47:38.628367+0000","last_active":"2023-08-09T12:47:39.835149+0000","last_peered":"2023-08-09T12:47:39.835149+0000","last_clean":"2023-08-09T12:47:39.835149+0000","last_became_active":"2023-08-09T12:47:38.626969+0000","last_became_peered":"2023-08-09T12:47:38.626969+0000","last_unstale":"2023-08-09T12:47:39.835149+0000","last_undegraded":"2023-08-09T12:47:39.835149+0000","last_fullsized":"2023-08-09T12:47:39.835149+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:21:46.393947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113599+0000","last_change":"2023-08-09T12:47:38.611768+0000","last_active":"2023-08-09T12:47:40.113599+0000","last_peered":"2023-08-09T12:47:40.113599+0000","last_clean":"2023-08-09T12:47:40.113599+0000","last_became_active":"2023-08-09T12:47:38.611425+0000","last_became_peered":"2023-08-09T12:47:38.611425+0000","last_unstale":"2023-08-09T12:47:40.113599+0000","last_undegraded":"2023-08-09T12:47:40.113599+0000","last_fullsized":"2023-08-09T12:47:40.113599+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:13:22.982935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594166+0000","last_change":"2023-08-09T12:47:38.610118+0000","last_active":"2023-08-09T12:47:39.594166+0000","last_peered":"2023-08-09T12:47:39.594166+0000","last_clean":"2023-08-09T12:47:39.594166+0000","last_became_active":"2023-08-09T12:47:38.609485+0000","last_became_peered":"2023-08-09T12:47:38.609485+0000","last_unstale":"2023-08-09T12:47:39.594166+0000","last_undegraded":"2023-08-09T12:47:39.594166+0000","last_fullsized":"2023-08-09T12:47:39.594166+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:42:58.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594016+0000","last_change":"2023-08-09T12:47:38.622130+0000","last_active":"2023-08-09T12:47:39.594016+0000","last_peered":"2023-08-09T12:47:39.594016+0000","last_clean":"2023-08-09T12:47:39.594016+0000","last_became_active":"2023-08-09T12:47:38.621585+0000","last_became_peered":"2023-08-09T12:47:38.621585+0000","last_unstale":"2023-08-09T12:47:39.594016+0000","last_undegraded":"2023-08-09T12:47:39.594016+0000","last_fullsized":"2023-08-09T12:47:39.594016+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:33:50.423895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114677+0000","last_change":"2023-08-09T12:47:38.605799+0000","last_active":"2023-08-09T12:47:40.114677+0000","last_peered":"2023-08-09T12:47:40.114677+0000","last_clean":"2023-08-09T12:47:40.114677+0000","last_became_active":"2023-08-09T12:47:38.605411+0000","last_became_peered":"2023-08-09T12:47:38.605411+0000","last_unstale":"2023-08-09T12:47:40.114677+0000","last_undegraded":"2023-08-09T12:47:40.114677+0000","last_fullsized":"2023-08-09T12:47:40.114677+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:58:25.701193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834458+0000","last_change":"2023-08-09T12:47:38.628132+0000","last_active":"2023-08-09T12:47:39.834458+0000","last_peered":"2023-08-09T12:47:39.834458+0000","last_clean":"2023-08-09T12:47:39.834458+0000","last_became_active":"2023-08-09T12:47:38.626455+0000","last_became_peered":"2023-08-09T12:47:38.626455+0000","last_unstale":"2023-08-09T12:47:39.834458+0000","last_undegraded":"2023-08-09T12:47:39.834458+0000","last_fullsized":"2023-08-09T12:47:39.834458+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:24:08.616043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593335+0000","last_change":"2023-08-09T12:47:38.613131+0000","last_active":"2023-08-09T12:47:39.593335+0000","last_peered":"2023-08-09T12:47:39.593335+0000","last_clean":"2023-08-09T12:47:39.593335+0000","last_became_active":"2023-08-09T12:47:38.612862+0000","last_became_peered":"2023-08-09T12:47:38.612862+0000","last_unstale":"2023-08-09T12:47:39.593335+0000","last_undegraded":"2023-08-09T12:47:39.593335+0000","last_fullsized":"2023-08-09T12:47:39.593335+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:34.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113881+0000","last_change":"2023-08-09T12:47:38.619601+0000","last_active":"2023-08-09T12:47:40.113881+0000","last_peered":"2023-08-09T12:47:40.113881+0000","last_clean":"2023-08-09T12:47:40.113881+0000","last_became_active":"2023-08-09T12:47:38.618887+0000","last_became_peered":"2023-08-09T12:47:38.618887+0000","last_unstale":"2023-08-09T12:47:40.113881+0000","last_undegraded":"2023-08-09T12:47:40.113881+0000","last_fullsized":"2023-08-09T12:47:40.113881+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:49:00.060750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594218+0000","last_change":"2023-08-09T12:47:38.611625+0000","last_active":"2023-08-09T12:47:39.594218+0000","last_peered":"2023-08-09T12:47:39.594218+0000","last_clean":"2023-08-09T12:47:39.594218+0000","last_became_active":"2023-08-09T12:47:38.611416+0000","last_became_peered":"2023-08-09T12:47:38.611416+0000","last_unstale":"2023-08-09T12:47:39.594218+0000","last_undegraded":"2023-08-09T12:47:39.594218+0000","last_fullsized":"2023-08-09T12:47:39.594218+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:48:56.635655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593038+0000","last_change":"2023-08-09T12:47:38.609342+0000","last_active":"2023-08-09T12:47:39.593038+0000","last_peered":"2023-08-09T12:47:39.593038+0000","last_clean":"2023-08-09T12:47:39.593038+0000","last_became_active":"2023-08-09T12:47:38.608971+0000","last_became_peered":"2023-08-09T12:47:38.608971+0000","last_unstale":"2023-08-09T12:47:39.593038+0000","last_undegraded":"2023-08-09T12:47:39.593038+0000","last_fullsized":"2023-08-09T12:47:39.593038+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:50:13.884614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.112999+0000","last_change":"2023-08-09T12:47:38.606462+0000","last_active":"2023-08-09T12:47:40.112999+0000","last_peered":"2023-08-09T12:47:40.112999+0000","last_clean":"2023-08-09T12:47:40.112999+0000","last_became_active":"2023-08-09T12:47:38.605761+0000","last_became_peered":"2023-08-09T12:47:38.605761+0000","last_unstale":"2023-08-09T12:47:40.112999+0000","last_undegraded":"2023-08-09T12:47:40.112999+0000","last_fullsized":"2023-08-09T12:47:40.112999+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:30.851784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113904+0000","last_change":"2023-08-09T12:47:38.616235+0000","last_active":"2023-08-09T12:47:40.113904+0000","last_peered":"2023-08-09T12:47:40.113904+0000","last_clean":"2023-08-09T12:47:40.113904+0000","last_became_active":"2023-08-09T12:47:38.615693+0000","last_became_peered":"2023-08-09T12:47:38.615693+0000","last_unstale":"2023-08-09T12:47:40.113904+0000","last_undegraded":"2023-08-09T12:47:40.113904+0000","last_fullsized":"2023-08-09T12:47:40.113904+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:27:00.687407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594309+0000","last_change":"2023-08-09T12:47:38.609943+0000","last_active":"2023-08-09T12:47:39.594309+0000","last_peered":"2023-08-09T12:47:39.594309+0000","last_clean":"2023-08-09T12:47:39.594309+0000","last_became_active":"2023-08-09T12:47:38.609222+0000","last_became_peered":"2023-08-09T12:47:38.609222+0000","last_unstale":"2023-08-09T12:47:39.594309+0000","last_undegraded":"2023-08-09T12:47:39.594309+0000","last_fullsized":"2023-08-09T12:47:39.594309+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:42:14.853783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592987+0000","last_change":"2023-08-09T12:47:38.617413+0000","last_active":"2023-08-09T12:47:39.592987+0000","last_peered":"2023-08-09T12:47:39.592987+0000","last_clean":"2023-08-09T12:47:39.592987+0000","last_became_active":"2023-08-09T12:47:38.617173+0000","last_became_peered":"2023-08-09T12:47:38.617173+0000","last_unstale":"2023-08-09T12:47:39.592987+0000","last_undegraded":"2023-08-09T12:47:39.592987+0000","last_fullsized":"2023-08-09T12:47:39.592987+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:30:39.610489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113954+0000","last_change":"2023-08-09T12:47:38.626653+0000","last_active":"2023-08-09T12:47:40.113954+0000","last_peered":"2023-08-09T12:47:40.113954+0000","last_clean":"2023-08-09T12:47:40.113954+0000","last_became_active":"2023-08-09T12:47:38.626177+0000","last_became_peered":"2023-08-09T12:47:38.626177+0000","last_unstale":"2023-08-09T12:47:40.113954+0000","last_undegraded":"2023-08-09T12:47:40.113954+0000","last_fullsized":"2023-08-09T12:47:40.113954+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:29.844434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748862+0000","last_change":"2023-08-09T12:47:38.625442+0000","last_active":"2023-08-09T12:47:39.748862+0000","last_peered":"2023-08-09T12:47:39.748862+0000","last_clean":"2023-08-09T12:47:39.748862+0000","last_became_active":"2023-08-09T12:47:38.624710+0000","last_became_peered":"2023-08-09T12:47:38.624710+0000","last_unstale":"2023-08-09T12:47:39.748862+0000","last_undegraded":"2023-08-09T12:47:39.748862+0000","last_fullsized":"2023-08-09T12:47:39.748862+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:21:29.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591182+0000","last_change":"2023-08-09T12:47:38.613891+0000","last_active":"2023-08-09T12:47:39.591182+0000","last_peered":"2023-08-09T12:47:39.591182+0000","last_clean":"2023-08-09T12:47:39.591182+0000","last_became_active":"2023-08-09T12:47:38.613652+0000","last_became_peered":"2023-08-09T12:47:38.613652+0000","last_unstale":"2023-08-09T12:47:39.591182+0000","last_undegraded":"2023-08-09T12:47:39.591182+0000","last_fullsized":"2023-08-09T12:47:39.591182+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:34.083889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834432+0000","last_change":"2023-08-09T12:47:38.612139+0000","last_active":"2023-08-09T12:47:39.834432+0000","last_peered":"2023-08-09T12:47:39.834432+0000","last_clean":"2023-08-09T12:47:39.834432+0000","last_became_active":"2023-08-09T12:47:38.611619+0000","last_became_peered":"2023-08-09T12:47:38.611619+0000","last_unstale":"2023-08-09T12:47:39.834432+0000","last_undegraded":"2023-08-09T12:47:39.834432+0000","last_fullsized":"2023-08-09T12:47:39.834432+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:09:30.919866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113474+0000","last_change":"2023-08-09T12:47:38.615467+0000","last_active":"2023-08-09T12:47:40.113474+0000","last_peered":"2023-08-09T12:47:40.113474+0000","last_clean":"2023-08-09T12:47:40.113474+0000","last_became_active":"2023-08-09T12:47:38.615071+0000","last_became_peered":"2023-08-09T12:47:38.615071+0000","last_unstale":"2023-08-09T12:47:40.113474+0000","last_undegraded":"2023-08-09T12:47:40.113474+0000","last_fullsized":"2023-08-09T12:47:40.113474+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:00:45.196302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835955+0000","last_change":"2023-08-09T12:47:38.630678+0000","last_active":"2023-08-09T12:47:39.835955+0000","last_peered":"2023-08-09T12:47:39.835955+0000","last_clean":"2023-08-09T12:47:39.835955+0000","last_became_active":"2023-08-09T12:47:38.628805+0000","last_became_peered":"2023-08-09T12:47:38.628805+0000","last_unstale":"2023-08-09T12:47:39.835955+0000","last_undegraded":"2023-08-09T12:47:39.835955+0000","last_fullsized":"2023-08-09T12:47:39.835955+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:21.434575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835570+0000","last_change":"2023-08-09T12:47:38.616212+0000","last_active":"2023-08-09T12:47:39.835570+0000","last_peered":"2023-08-09T12:47:39.835570+0000","last_clean":"2023-08-09T12:47:39.835570+0000","last_became_active":"2023-08-09T12:47:38.615637+0000","last_became_peered":"2023-08-09T12:47:38.615637+0000","last_unstale":"2023-08-09T12:47:39.835570+0000","last_undegraded":"2023-08-09T12:47:39.835570+0000","last_fullsized":"2023-08-09T12:47:39.835570+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:41:34.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837937+0000","last_change":"2023-08-09T12:47:38.615652+0000","last_active":"2023-08-09T12:47:39.837937+0000","last_peered":"2023-08-09T12:47:39.837937+0000","last_clean":"2023-08-09T12:47:39.837937+0000","last_became_active":"2023-08-09T12:47:38.615233+0000","last_became_peered":"2023-08-09T12:47:38.615233+0000","last_unstale":"2023-08-09T12:47:39.837937+0000","last_undegraded":"2023-08-09T12:47:39.837937+0000","last_fullsized":"2023-08-09T12:47:39.837937+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:30:54.184671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591421+0000","last_change":"2023-08-09T12:47:38.603021+0000","last_active":"2023-08-09T12:47:39.591421+0000","last_peered":"2023-08-09T12:47:39.591421+0000","last_clean":"2023-08-09T12:47:39.591421+0000","last_became_active":"2023-08-09T12:47:38.601946+0000","last_became_peered":"2023-08-09T12:47:38.601946+0000","last_unstale":"2023-08-09T12:47:39.591421+0000","last_undegraded":"2023-08-09T12:47:39.591421+0000","last_fullsized":"2023-08-09T12:47:39.591421+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:16:39.362470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748708+0000","last_change":"2023-08-09T12:47:38.614318+0000","last_active":"2023-08-09T12:47:39.748708+0000","last_peered":"2023-08-09T12:47:39.748708+0000","last_clean":"2023-08-09T12:47:39.748708+0000","last_became_active":"2023-08-09T12:47:38.613845+0000","last_became_peered":"2023-08-09T12:47:38.613845+0000","last_unstale":"2023-08-09T12:47:39.748708+0000","last_undegraded":"2023-08-09T12:47:39.748708+0000","last_fullsized":"2023-08-09T12:47:39.748708+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:26:28.513752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592583+0000","last_change":"2023-08-09T12:47:38.607603+0000","last_active":"2023-08-09T12:47:39.592583+0000","last_peered":"2023-08-09T12:47:39.592583+0000","last_clean":"2023-08-09T12:47:39.592583+0000","last_became_active":"2023-08-09T12:47:38.607375+0000","last_became_peered":"2023-08-09T12:47:38.607375+0000","last_unstale":"2023-08-09T12:47:39.592583+0000","last_undegraded":"2023-08-09T12:47:39.592583+0000","last_fullsized":"2023-08-09T12:47:39.592583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:19.602397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591116+0000","last_change":"2023-08-09T12:47:38.596992+0000","last_active":"2023-08-09T12:47:39.591116+0000","last_peered":"2023-08-09T12:47:39.591116+0000","last_clean":"2023-08-09T12:47:39.591116+0000","last_became_active":"2023-08-09T12:47:38.596704+0000","last_became_peered":"2023-08-09T12:47:38.596704+0000","last_unstale":"2023-08-09T12:47:39.591116+0000","last_undegraded":"2023-08-09T12:47:39.591116+0000","last_fullsized":"2023-08-09T12:47:39.591116+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:04.769559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113153+0000","last_change":"2023-08-09T12:47:38.612214+0000","last_active":"2023-08-09T12:47:40.113153+0000","last_peered":"2023-08-09T12:47:40.113153+0000","last_clean":"2023-08-09T12:47:40.113153+0000","last_became_active":"2023-08-09T12:47:38.611958+0000","last_became_peered":"2023-08-09T12:47:38.611958+0000","last_unstale":"2023-08-09T12:47:40.113153+0000","last_undegraded":"2023-08-09T12:47:40.113153+0000","last_fullsized":"2023-08-09T12:47:40.113153+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:42:28.955794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836789+0000","last_change":"2023-08-09T12:47:38.616299+0000","last_active":"2023-08-09T12:47:39.836789+0000","last_peered":"2023-08-09T12:47:39.836789+0000","last_clean":"2023-08-09T12:47:39.836789+0000","last_became_active":"2023-08-09T12:47:38.615824+0000","last_became_peered":"2023-08-09T12:47:38.615824+0000","last_unstale":"2023-08-09T12:47:39.836789+0000","last_undegraded":"2023-08-09T12:47:39.836789+0000","last_fullsized":"2023-08-09T12:47:39.836789+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:11.499778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836720+0000","last_change":"2023-08-09T12:47:38.618191+0000","last_active":"2023-08-09T12:47:39.836720+0000","last_peered":"2023-08-09T12:47:39.836720+0000","last_clean":"2023-08-09T12:47:39.836720+0000","last_became_active":"2023-08-09T12:47:38.617368+0000","last_became_peered":"2023-08-09T12:47:38.617368+0000","last_unstale":"2023-08-09T12:47:39.836720+0000","last_undegraded":"2023-08-09T12:47:39.836720+0000","last_fullsized":"2023-08-09T12:47:39.836720+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:28.016184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593542+0000","last_change":"2023-08-09T12:47:38.611931+0000","last_active":"2023-08-09T12:47:39.593542+0000","last_peered":"2023-08-09T12:47:39.593542+0000","last_clean":"2023-08-09T12:47:39.593542+0000","last_became_active":"2023-08-09T12:47:38.611644+0000","last_became_peered":"2023-08-09T12:47:38.611644+0000","last_unstale":"2023-08-09T12:47:39.593542+0000","last_undegraded":"2023-08-09T12:47:39.593542+0000","last_fullsized":"2023-08-09T12:47:39.593542+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:33:28.016184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"145'4","reported_seq":17,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748928+0000","last_change":"2023-08-09T12:47:37.607795+0000","last_active":"2023-08-09T12:47:39.748928+0000","last_peered":"2023-08-09T12:47:39.748928+0000","last_clean":"2023-08-09T12:47:39.748928+0000","last_became_active":"2023-08-09T12:47:37.607529+0000","last_became_peered":"2023-08-09T12:47:37.607529+0000","last_unstale":"2023-08-09T12:47:39.748928+0000","last_undegraded":"2023-08-09T12:47:39.748928+0000","last_fullsized":"2023-08-09T12:47:39.748928+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:04:48.536033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594209+0000","last_change":"2023-08-09T12:47:38.613394+0000","last_active":"2023-08-09T12:47:39.594209+0000","last_peered":"2023-08-09T12:47:39.594209+0000","last_clean":"2023-08-09T12:47:39.594209+0000","last_became_active":"2023-08-09T12:47:38.613166+0000","last_became_peered":"2023-08-09T12:47:38.613166+0000","last_unstale":"2023-08-09T12:47:39.594209+0000","last_undegraded":"2023-08-09T12:47:39.594209+0000","last_fullsized":"2023-08-09T12:47:39.594209+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:17:28.607973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593750+0000","last_change":"2023-08-09T12:47:37.608531+0000","last_active":"2023-08-09T12:47:39.593750+0000","last_peered":"2023-08-09T12:47:39.593750+0000","last_clean":"2023-08-09T12:47:39.593750+0000","last_became_active":"2023-08-09T12:47:37.608277+0000","last_became_peered":"2023-08-09T12:47:37.608277+0000","last_unstale":"2023-08-09T12:47:39.593750+0000","last_undegraded":"2023-08-09T12:47:39.593750+0000","last_fullsized":"2023-08-09T12:47:39.593750+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:50:36.598234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835902+0000","last_change":"2023-08-09T12:47:38.615997+0000","last_active":"2023-08-09T12:47:39.835902+0000","last_peered":"2023-08-09T12:47:39.835902+0000","last_clean":"2023-08-09T12:47:39.835902+0000","last_became_active":"2023-08-09T12:47:38.614790+0000","last_became_peered":"2023-08-09T12:47:38.614790+0000","last_unstale":"2023-08-09T12:47:39.835902+0000","last_undegraded":"2023-08-09T12:47:39.835902+0000","last_fullsized":"2023-08-09T12:47:39.835902+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:14.497004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835582+0000","last_change":"2023-08-09T12:47:37.609310+0000","last_active":"2023-08-09T12:47:39.835582+0000","last_peered":"2023-08-09T12:47:39.835582+0000","last_clean":"2023-08-09T12:47:39.835582+0000","last_became_active":"2023-08-09T12:47:37.608988+0000","last_became_peered":"2023-08-09T12:47:37.608988+0000","last_unstale":"2023-08-09T12:47:39.835582+0000","last_undegraded":"2023-08-09T12:47:39.835582+0000","last_fullsized":"2023-08-09T12:47:39.835582+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:48.375500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834304+0000","last_change":"2023-08-09T12:47:38.630544+0000","last_active":"2023-08-09T12:47:39.834304+0000","last_peered":"2023-08-09T12:47:39.834304+0000","last_clean":"2023-08-09T12:47:39.834304+0000","last_became_active":"2023-08-09T12:47:38.626982+0000","last_became_peered":"2023-08-09T12:47:38.626982+0000","last_unstale":"2023-08-09T12:47:39.834304+0000","last_undegraded":"2023-08-09T12:47:39.834304+0000","last_fullsized":"2023-08-09T12:47:39.834304+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:10.539878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594001+0000","last_change":"2023-08-09T12:47:37.605016+0000","last_active":"2023-08-09T12:47:39.594001+0000","last_peered":"2023-08-09T12:47:39.594001+0000","last_clean":"2023-08-09T12:47:39.594001+0000","last_became_active":"2023-08-09T12:47:37.604394+0000","last_became_peered":"2023-08-09T12:47:37.604394+0000","last_unstale":"2023-08-09T12:47:39.594001+0000","last_undegraded":"2023-08-09T12:47:39.594001+0000","last_fullsized":"2023-08-09T12:47:39.594001+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:11:29.936634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593486+0000","last_change":"2023-08-09T12:47:38.604703+0000","last_active":"2023-08-09T12:47:39.593486+0000","last_peered":"2023-08-09T12:47:39.593486+0000","last_clean":"2023-08-09T12:47:39.593486+0000","last_became_active":"2023-08-09T12:47:38.604465+0000","last_became_peered":"2023-08-09T12:47:38.604465+0000","last_unstale":"2023-08-09T12:47:39.593486+0000","last_undegraded":"2023-08-09T12:47:39.593486+0000","last_fullsized":"2023-08-09T12:47:39.593486+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:21:56.369312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113729+0000","last_change":"2023-08-09T12:47:37.610816+0000","last_active":"2023-08-09T12:47:40.113729+0000","last_peered":"2023-08-09T12:47:40.113729+0000","last_clean":"2023-08-09T12:47:40.113729+0000","last_became_active":"2023-08-09T12:47:37.609879+0000","last_became_peered":"2023-08-09T12:47:37.609879+0000","last_unstale":"2023-08-09T12:47:40.113729+0000","last_undegraded":"2023-08-09T12:47:40.113729+0000","last_fullsized":"2023-08-09T12:47:40.113729+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:08:41.059329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113400+0000","last_change":"2023-08-09T12:47:38.629698+0000","last_active":"2023-08-09T12:47:40.113400+0000","last_peered":"2023-08-09T12:47:40.113400+0000","last_clean":"2023-08-09T12:47:40.113400+0000","last_became_active":"2023-08-09T12:47:38.629350+0000","last_became_peered":"2023-08-09T12:47:38.629350+0000","last_unstale":"2023-08-09T12:47:40.113400+0000","last_undegraded":"2023-08-09T12:47:40.113400+0000","last_fullsized":"2023-08-09T12:47:40.113400+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:13:55.228751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592735+0000","last_change":"2023-08-09T12:47:37.605855+0000","last_active":"2023-08-09T12:47:39.592735+0000","last_peered":"2023-08-09T12:47:39.592735+0000","last_clean":"2023-08-09T12:47:39.592735+0000","last_became_active":"2023-08-09T12:47:37.605463+0000","last_became_peered":"2023-08-09T12:47:37.605463+0000","last_unstale":"2023-08-09T12:47:39.592735+0000","last_undegraded":"2023-08-09T12:47:39.592735+0000","last_fullsized":"2023-08-09T12:47:39.592735+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:31:29.538310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114168+0000","last_change":"2023-08-09T12:47:38.605042+0000","last_active":"2023-08-09T12:47:40.114168+0000","last_peered":"2023-08-09T12:47:40.114168+0000","last_clean":"2023-08-09T12:47:40.114168+0000","last_became_active":"2023-08-09T12:47:38.604749+0000","last_became_peered":"2023-08-09T12:47:38.604749+0000","last_unstale":"2023-08-09T12:47:40.114168+0000","last_undegraded":"2023-08-09T12:47:40.114168+0000","last_fullsized":"2023-08-09T12:47:40.114168+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:08:48.402317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836749+0000","last_change":"2023-08-09T12:47:37.607226+0000","last_active":"2023-08-09T12:47:39.836749+0000","last_peered":"2023-08-09T12:47:39.836749+0000","last_clean":"2023-08-09T12:47:39.836749+0000","last_became_active":"2023-08-09T12:47:37.605788+0000","last_became_peered":"2023-08-09T12:47:37.605788+0000","last_unstale":"2023-08-09T12:47:39.836749+0000","last_undegraded":"2023-08-09T12:47:39.836749+0000","last_fullsized":"2023-08-09T12:47:39.836749+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:55:43.124963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593204+0000","last_change":"2023-08-09T12:47:38.606839+0000","last_active":"2023-08-09T12:47:39.593204+0000","last_peered":"2023-08-09T12:47:39.593204+0000","last_clean":"2023-08-09T12:47:39.593204+0000","last_became_active":"2023-08-09T12:47:38.606553+0000","last_became_peered":"2023-08-09T12:47:38.606553+0000","last_unstale":"2023-08-09T12:47:39.593204+0000","last_undegraded":"2023-08-09T12:47:39.593204+0000","last_fullsized":"2023-08-09T12:47:39.593204+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:13.265052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594701+0000","last_change":"2023-08-09T12:47:37.611964+0000","last_active":"2023-08-09T12:47:39.594701+0000","last_peered":"2023-08-09T12:47:39.594701+0000","last_clean":"2023-08-09T12:47:39.594701+0000","last_became_active":"2023-08-09T12:47:37.611369+0000","last_became_peered":"2023-08-09T12:47:37.611369+0000","last_unstale":"2023-08-09T12:47:39.594701+0000","last_undegraded":"2023-08-09T12:47:39.594701+0000","last_fullsized":"2023-08-09T12:47:39.594701+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:32:03.103433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836957+0000","last_change":"2023-08-09T12:47:38.617821+0000","last_active":"2023-08-09T12:47:39.836957+0000","last_peered":"2023-08-09T12:47:39.836957+0000","last_clean":"2023-08-09T12:47:39.836957+0000","last_became_active":"2023-08-09T12:47:38.616434+0000","last_became_peered":"2023-08-09T12:47:38.616434+0000","last_unstale":"2023-08-09T12:47:39.836957+0000","last_undegraded":"2023-08-09T12:47:39.836957+0000","last_fullsized":"2023-08-09T12:47:39.836957+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:50:37.614511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593597+0000","last_change":"2023-08-09T12:47:37.607994+0000","last_active":"2023-08-09T12:47:39.593597+0000","last_peered":"2023-08-09T12:47:39.593597+0000","last_clean":"2023-08-09T12:47:39.593597+0000","last_became_active":"2023-08-09T12:47:37.607749+0000","last_became_peered":"2023-08-09T12:47:37.607749+0000","last_unstale":"2023-08-09T12:47:39.593597+0000","last_undegraded":"2023-08-09T12:47:39.593597+0000","last_fullsized":"2023-08-09T12:47:39.593597+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:10.239424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114410+0000","last_change":"2023-08-09T12:47:38.619403+0000","last_active":"2023-08-09T12:47:40.114410+0000","last_peered":"2023-08-09T12:47:40.114410+0000","last_clean":"2023-08-09T12:47:40.114410+0000","last_became_active":"2023-08-09T12:47:38.618489+0000","last_became_peered":"2023-08-09T12:47:38.618489+0000","last_unstale":"2023-08-09T12:47:40.114410+0000","last_undegraded":"2023-08-09T12:47:40.114410+0000","last_fullsized":"2023-08-09T12:47:40.114410+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:35:51.193522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591241+0000","last_change":"2023-08-09T12:47:37.604528+0000","last_active":"2023-08-09T12:47:39.591241+0000","last_peered":"2023-08-09T12:47:39.591241+0000","last_clean":"2023-08-09T12:47:39.591241+0000","last_became_active":"2023-08-09T12:47:37.603750+0000","last_became_peered":"2023-08-09T12:47:37.603750+0000","last_unstale":"2023-08-09T12:47:39.591241+0000","last_undegraded":"2023-08-09T12:47:39.591241+0000","last_fullsized":"2023-08-09T12:47:39.591241+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:02:14.530974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594353+0000","last_change":"2023-08-09T12:47:38.612908+0000","last_active":"2023-08-09T12:47:39.594353+0000","last_peered":"2023-08-09T12:47:39.594353+0000","last_clean":"2023-08-09T12:47:39.594353+0000","last_became_active":"2023-08-09T12:47:38.612154+0000","last_became_peered":"2023-08-09T12:47:38.612154+0000","last_unstale":"2023-08-09T12:47:39.594353+0000","last_undegraded":"2023-08-09T12:47:39.594353+0000","last_fullsized":"2023-08-09T12:47:39.594353+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:02:10.461610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834678+0000","last_change":"2023-08-09T12:47:37.608848+0000","last_active":"2023-08-09T12:47:39.834678+0000","last_peered":"2023-08-09T12:47:39.834678+0000","last_clean":"2023-08-09T12:47:39.834678+0000","last_became_active":"2023-08-09T12:47:37.608379+0000","last_became_peered":"2023-08-09T12:47:37.608379+0000","last_unstale":"2023-08-09T12:47:39.834678+0000","last_undegraded":"2023-08-09T12:47:39.834678+0000","last_fullsized":"2023-08-09T12:47:39.834678+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:25:59.347390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836503+0000","last_change":"2023-08-09T12:47:38.628662+0000","last_active":"2023-08-09T12:47:39.836503+0000","last_peered":"2023-08-09T12:47:39.836503+0000","last_clean":"2023-08-09T12:47:39.836503+0000","last_became_active":"2023-08-09T12:47:38.628413+0000","last_became_peered":"2023-08-09T12:47:38.628413+0000","last_unstale":"2023-08-09T12:47:39.836503+0000","last_undegraded":"2023-08-09T12:47:39.836503+0000","last_fullsized":"2023-08-09T12:47:39.836503+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:21:56.369312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836000+0000","last_change":"2023-08-09T12:47:37.606094+0000","last_active":"2023-08-09T12:47:39.836000+0000","last_peered":"2023-08-09T12:47:39.836000+0000","last_clean":"2023-08-09T12:47:39.836000+0000","last_became_active":"2023-08-09T12:47:37.605653+0000","last_became_peered":"2023-08-09T12:47:37.605653+0000","last_unstale":"2023-08-09T12:47:39.836000+0000","last_undegraded":"2023-08-09T12:47:39.836000+0000","last_fullsized":"2023-08-09T12:47:39.836000+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:28:55.497970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594406+0000","last_change":"2023-08-09T12:47:38.609785+0000","last_active":"2023-08-09T12:47:39.594406+0000","last_peered":"2023-08-09T12:47:39.594406+0000","last_clean":"2023-08-09T12:47:39.594406+0000","last_became_active":"2023-08-09T12:47:38.608869+0000","last_became_peered":"2023-08-09T12:47:38.608869+0000","last_unstale":"2023-08-09T12:47:39.594406+0000","last_undegraded":"2023-08-09T12:47:39.594406+0000","last_fullsized":"2023-08-09T12:47:39.594406+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:18:42.619085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592888+0000","last_change":"2023-08-09T12:47:37.610934+0000","last_active":"2023-08-09T12:47:39.592888+0000","last_peered":"2023-08-09T12:47:39.592888+0000","last_clean":"2023-08-09T12:47:39.592888+0000","last_became_active":"2023-08-09T12:47:37.610612+0000","last_became_peered":"2023-08-09T12:47:37.610612+0000","last_unstale":"2023-08-09T12:47:39.592888+0000","last_undegraded":"2023-08-09T12:47:39.592888+0000","last_fullsized":"2023-08-09T12:47:39.592888+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:40:28.345599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113531+0000","last_change":"2023-08-09T12:47:38.606180+0000","last_active":"2023-08-09T12:47:40.113531+0000","last_peered":"2023-08-09T12:47:40.113531+0000","last_clean":"2023-08-09T12:47:40.113531+0000","last_became_active":"2023-08-09T12:47:38.605851+0000","last_became_peered":"2023-08-09T12:47:38.605851+0000","last_unstale":"2023-08-09T12:47:40.113531+0000","last_undegraded":"2023-08-09T12:47:40.113531+0000","last_fullsized":"2023-08-09T12:47:40.113531+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:46.980814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836003+0000","last_change":"2023-08-09T12:47:37.609010+0000","last_active":"2023-08-09T12:47:39.836003+0000","last_peered":"2023-08-09T12:47:39.836003+0000","last_clean":"2023-08-09T12:47:39.836003+0000","last_became_active":"2023-08-09T12:47:37.608358+0000","last_became_peered":"2023-08-09T12:47:37.608358+0000","last_unstale":"2023-08-09T12:47:39.836003+0000","last_undegraded":"2023-08-09T12:47:39.836003+0000","last_fullsized":"2023-08-09T12:47:39.836003+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:42:51.626887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113615+0000","last_change":"2023-08-09T12:47:38.606697+0000","last_active":"2023-08-09T12:47:40.113615+0000","last_peered":"2023-08-09T12:47:40.113615+0000","last_clean":"2023-08-09T12:47:40.113615+0000","last_became_active":"2023-08-09T12:47:38.606226+0000","last_became_peered":"2023-08-09T12:47:38.606226+0000","last_unstale":"2023-08-09T12:47:40.113615+0000","last_undegraded":"2023-08-09T12:47:40.113615+0000","last_fullsized":"2023-08-09T12:47:40.113615+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:22:28.683850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114324+0000","last_change":"2023-08-09T12:47:37.609685+0000","last_active":"2023-08-09T12:47:40.114324+0000","last_peered":"2023-08-09T12:47:40.114324+0000","last_clean":"2023-08-09T12:47:40.114324+0000","last_became_active":"2023-08-09T12:47:37.608304+0000","last_became_peered":"2023-08-09T12:47:37.608304+0000","last_unstale":"2023-08-09T12:47:40.114324+0000","last_undegraded":"2023-08-09T12:47:40.114324+0000","last_fullsized":"2023-08-09T12:47:40.114324+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:13:02.160740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836783+0000","last_change":"2023-08-09T12:47:38.617768+0000","last_active":"2023-08-09T12:47:39.836783+0000","last_peered":"2023-08-09T12:47:39.836783+0000","last_clean":"2023-08-09T12:47:39.836783+0000","last_became_active":"2023-08-09T12:47:38.616698+0000","last_became_peered":"2023-08-09T12:47:38.616698+0000","last_unstale":"2023-08-09T12:47:39.836783+0000","last_undegraded":"2023-08-09T12:47:39.836783+0000","last_fullsized":"2023-08-09T12:47:39.836783+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:58:11.255700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835007+0000","last_change":"2023-08-09T12:47:37.608653+0000","last_active":"2023-08-09T12:47:39.835007+0000","last_peered":"2023-08-09T12:47:39.835007+0000","last_clean":"2023-08-09T12:47:39.835007+0000","last_became_active":"2023-08-09T12:47:37.608045+0000","last_became_peered":"2023-08-09T12:47:37.608045+0000","last_unstale":"2023-08-09T12:47:39.835007+0000","last_undegraded":"2023-08-09T12:47:39.835007+0000","last_fullsized":"2023-08-09T12:47:39.835007+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:32:00.103793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594575+0000","last_change":"2023-08-09T12:47:38.612683+0000","last_active":"2023-08-09T12:47:39.594575+0000","last_peered":"2023-08-09T12:47:39.594575+0000","last_clean":"2023-08-09T12:47:39.594575+0000","last_became_active":"2023-08-09T12:47:38.611769+0000","last_became_peered":"2023-08-09T12:47:38.611769+0000","last_unstale":"2023-08-09T12:47:39.594575+0000","last_undegraded":"2023-08-09T12:47:39.594575+0000","last_fullsized":"2023-08-09T12:47:39.594575+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:29:54.358222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594403+0000","last_change":"2023-08-09T12:47:37.602147+0000","last_active":"2023-08-09T12:47:39.594403+0000","last_peered":"2023-08-09T12:47:39.594403+0000","last_clean":"2023-08-09T12:47:39.594403+0000","last_became_active":"2023-08-09T12:47:37.601862+0000","last_became_peered":"2023-08-09T12:47:37.601862+0000","last_unstale":"2023-08-09T12:47:39.594403+0000","last_undegraded":"2023-08-09T12:47:39.594403+0000","last_fullsized":"2023-08-09T12:47:39.594403+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:09:11.202836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593396+0000","last_change":"2023-08-09T12:47:38.604062+0000","last_active":"2023-08-09T12:47:39.593396+0000","last_peered":"2023-08-09T12:47:39.593396+0000","last_clean":"2023-08-09T12:47:39.593396+0000","last_became_active":"2023-08-09T12:47:38.603821+0000","last_became_peered":"2023-08-09T12:47:38.603821+0000","last_unstale":"2023-08-09T12:47:39.593396+0000","last_undegraded":"2023-08-09T12:47:39.593396+0000","last_fullsized":"2023-08-09T12:47:39.593396+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:07:14.497004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.749142+0000","last_change":"2023-08-09T12:47:37.604130+0000","last_active":"2023-08-09T12:47:39.749142+0000","last_peered":"2023-08-09T12:47:39.749142+0000","last_clean":"2023-08-09T12:47:39.749142+0000","last_became_active":"2023-08-09T12:47:37.603832+0000","last_became_peered":"2023-08-09T12:47:37.603832+0000","last_unstale":"2023-08-09T12:47:39.749142+0000","last_undegraded":"2023-08-09T12:47:39.749142+0000","last_fullsized":"2023-08-09T12:47:39.749142+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:10:40.581500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836526+0000","last_change":"2023-08-09T12:47:38.630811+0000","last_active":"2023-08-09T12:47:39.836526+0000","last_peered":"2023-08-09T12:47:39.836526+0000","last_clean":"2023-08-09T12:47:39.836526+0000","last_became_active":"2023-08-09T12:47:38.630195+0000","last_became_peered":"2023-08-09T12:47:38.630195+0000","last_unstale":"2023-08-09T12:47:39.836526+0000","last_undegraded":"2023-08-09T12:47:39.836526+0000","last_fullsized":"2023-08-09T12:47:39.836526+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:03:56.508305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.749503+0000","last_change":"2023-08-09T12:47:37.606310+0000","last_active":"2023-08-09T12:47:39.749503+0000","last_peered":"2023-08-09T12:47:39.749503+0000","last_clean":"2023-08-09T12:47:39.749503+0000","last_became_active":"2023-08-09T12:47:37.605995+0000","last_became_peered":"2023-08-09T12:47:37.605995+0000","last_unstale":"2023-08-09T12:47:39.749503+0000","last_undegraded":"2023-08-09T12:47:39.749503+0000","last_fullsized":"2023-08-09T12:47:39.749503+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:40:29.670397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.590932+0000","last_change":"2023-08-09T12:47:38.618592+0000","last_active":"2023-08-09T12:47:39.590932+0000","last_peered":"2023-08-09T12:47:39.590932+0000","last_clean":"2023-08-09T12:47:39.590932+0000","last_became_active":"2023-08-09T12:47:38.618344+0000","last_became_peered":"2023-08-09T12:47:38.618344+0000","last_unstale":"2023-08-09T12:47:39.590932+0000","last_undegraded":"2023-08-09T12:47:39.590932+0000","last_fullsized":"2023-08-09T12:47:39.590932+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:22.313814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.594825+0000","last_change":"2023-08-09T12:47:37.611823+0000","last_active":"2023-08-09T12:47:39.594825+0000","last_peered":"2023-08-09T12:47:39.594825+0000","last_clean":"2023-08-09T12:47:39.594825+0000","last_became_active":"2023-08-09T12:47:37.611006+0000","last_became_peered":"2023-08-09T12:47:37.611006+0000","last_unstale":"2023-08-09T12:47:39.594825+0000","last_undegraded":"2023-08-09T12:47:39.594825+0000","last_fullsized":"2023-08-09T12:47:39.594825+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:57:45.065648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.592738+0000","last_change":"2023-08-09T12:47:38.611615+0000","last_active":"2023-08-09T12:47:39.592738+0000","last_peered":"2023-08-09T12:47:39.592738+0000","last_clean":"2023-08-09T12:47:39.592738+0000","last_became_active":"2023-08-09T12:47:38.611378+0000","last_became_peered":"2023-08-09T12:47:38.611378+0000","last_unstale":"2023-08-09T12:47:39.592738+0000","last_undegraded":"2023-08-09T12:47:39.592738+0000","last_fullsized":"2023-08-09T12:47:39.592738+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:10.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114610+0000","last_change":"2023-08-09T12:47:37.608459+0000","last_active":"2023-08-09T12:47:40.114610+0000","last_peered":"2023-08-09T12:47:40.114610+0000","last_clean":"2023-08-09T12:47:40.114610+0000","last_became_active":"2023-08-09T12:47:37.608211+0000","last_became_peered":"2023-08-09T12:47:37.608211+0000","last_unstale":"2023-08-09T12:47:40.114610+0000","last_undegraded":"2023-08-09T12:47:40.114610+0000","last_fullsized":"2023-08-09T12:47:40.114610+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:15:07.251128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114343+0000","last_change":"2023-08-09T12:47:38.601018+0000","last_active":"2023-08-09T12:47:40.114343+0000","last_peered":"2023-08-09T12:47:40.114343+0000","last_clean":"2023-08-09T12:47:40.114343+0000","last_became_active":"2023-08-09T12:47:38.600599+0000","last_became_peered":"2023-08-09T12:47:38.600599+0000","last_unstale":"2023-08-09T12:47:40.114343+0000","last_undegraded":"2023-08-09T12:47:40.114343+0000","last_fullsized":"2023-08-09T12:47:40.114343+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:10:44.530461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113909+0000","last_change":"2023-08-09T12:47:37.611005+0000","last_active":"2023-08-09T12:47:40.113909+0000","last_peered":"2023-08-09T12:47:40.113909+0000","last_clean":"2023-08-09T12:47:40.113909+0000","last_became_active":"2023-08-09T12:47:37.610478+0000","last_became_peered":"2023-08-09T12:47:37.610478+0000","last_unstale":"2023-08-09T12:47:40.113909+0000","last_undegraded":"2023-08-09T12:47:40.113909+0000","last_fullsized":"2023-08-09T12:47:40.113909+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:19.282619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835761+0000","last_change":"2023-08-09T12:47:38.623501+0000","last_active":"2023-08-09T12:47:39.835761+0000","last_peered":"2023-08-09T12:47:39.835761+0000","last_clean":"2023-08-09T12:47:39.835761+0000","last_became_active":"2023-08-09T12:47:38.623069+0000","last_became_peered":"2023-08-09T12:47:38.623069+0000","last_unstale":"2023-08-09T12:47:39.835761+0000","last_undegraded":"2023-08-09T12:47:39.835761+0000","last_fullsized":"2023-08-09T12:47:39.835761+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:55:15.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593686+0000","last_change":"2023-08-09T12:47:37.608400+0000","last_active":"2023-08-09T12:47:39.593686+0000","last_peered":"2023-08-09T12:47:39.593686+0000","last_clean":"2023-08-09T12:47:39.593686+0000","last_became_active":"2023-08-09T12:47:37.608137+0000","last_became_peered":"2023-08-09T12:47:37.608137+0000","last_unstale":"2023-08-09T12:47:39.593686+0000","last_undegraded":"2023-08-09T12:47:39.593686+0000","last_fullsized":"2023-08-09T12:47:39.593686+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:21.663688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593726+0000","last_change":"2023-08-09T12:47:38.614994+0000","last_active":"2023-08-09T12:47:39.593726+0000","last_peered":"2023-08-09T12:47:39.593726+0000","last_clean":"2023-08-09T12:47:39.593726+0000","last_became_active":"2023-08-09T12:47:38.614748+0000","last_became_peered":"2023-08-09T12:47:38.614748+0000","last_unstale":"2023-08-09T12:47:39.593726+0000","last_undegraded":"2023-08-09T12:47:39.593726+0000","last_fullsized":"2023-08-09T12:47:39.593726+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:55:44.141240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.834689+0000","last_change":"2023-08-09T12:47:37.610052+0000","last_active":"2023-08-09T12:47:39.834689+0000","last_peered":"2023-08-09T12:47:39.834689+0000","last_clean":"2023-08-09T12:47:39.834689+0000","last_became_active":"2023-08-09T12:47:37.609772+0000","last_became_peered":"2023-08-09T12:47:37.609772+0000","last_unstale":"2023-08-09T12:47:39.834689+0000","last_undegraded":"2023-08-09T12:47:39.834689+0000","last_fullsized":"2023-08-09T12:47:39.834689+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:00:55.253797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835326+0000","last_change":"2023-08-09T12:47:38.613434+0000","last_active":"2023-08-09T12:47:39.835326+0000","last_peered":"2023-08-09T12:47:39.835326+0000","last_clean":"2023-08-09T12:47:39.835326+0000","last_became_active":"2023-08-09T12:47:38.612681+0000","last_became_peered":"2023-08-09T12:47:38.612681+0000","last_unstale":"2023-08-09T12:47:39.835326+0000","last_undegraded":"2023-08-09T12:47:39.835326+0000","last_fullsized":"2023-08-09T12:47:39.835326+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:04:32.275056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"145'8","reported_seq":21,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114462+0000","last_change":"2023-08-09T12:47:37.610418+0000","last_active":"2023-08-09T12:47:40.114462+0000","last_peered":"2023-08-09T12:47:40.114462+0000","last_clean":"2023-08-09T12:47:40.114462+0000","last_became_active":"2023-08-09T12:47:37.610113+0000","last_became_peered":"2023-08-09T12:47:37.610113+0000","last_unstale":"2023-08-09T12:47:40.114462+0000","last_undegraded":"2023-08-09T12:47:40.114462+0000","last_fullsized":"2023-08-09T12:47:40.114462+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:45:22.606673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":415,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.836358+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:47:39.836358+0000","last_peered":"2023-08-09T12:47:39.836358+0000","last_clean":"2023-08-09T12:47:39.836358+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:47:39.836358+0000","last_undegraded":"2023-08-09T12:47:39.836358+0000","last_fullsized":"2023-08-09T12:47:39.836358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:12:48.082807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":235,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837427+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:47:39.837427+0000","last_peered":"2023-08-09T12:47:39.837427+0000","last_clean":"2023-08-09T12:47:39.837427+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:47:39.837427+0000","last_undegraded":"2023-08-09T12:47:39.837427+0000","last_fullsized":"2023-08-09T12:47:39.837427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:54:45.728929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748770+0000","last_change":"2023-08-09T12:47:38.599652+0000","last_active":"2023-08-09T12:47:39.748770+0000","last_peered":"2023-08-09T12:47:39.748770+0000","last_clean":"2023-08-09T12:47:39.748770+0000","last_became_active":"2023-08-09T12:47:38.598975+0000","last_became_peered":"2023-08-09T12:47:38.598975+0000","last_unstale":"2023-08-09T12:47:39.748770+0000","last_undegraded":"2023-08-09T12:47:39.748770+0000","last_fullsized":"2023-08-09T12:47:39.748770+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:32.208975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113968+0000","last_change":"2023-08-09T12:47:37.610165+0000","last_active":"2023-08-09T12:47:40.113968+0000","last_peered":"2023-08-09T12:47:40.113968+0000","last_clean":"2023-08-09T12:47:40.113968+0000","last_became_active":"2023-08-09T12:47:37.609085+0000","last_became_peered":"2023-08-09T12:47:37.609085+0000","last_unstale":"2023-08-09T12:47:40.113968+0000","last_undegraded":"2023-08-09T12:47:40.113968+0000","last_fullsized":"2023-08-09T12:47:40.113968+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:12:50.956437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835671+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:47:39.835671+0000","last_peered":"2023-08-09T12:47:39.835671+0000","last_clean":"2023-08-09T12:47:39.835671+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:47:39.835671+0000","last_undegraded":"2023-08-09T12:47:39.835671+0000","last_fullsized":"2023-08-09T12:47:39.835671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:40:52.671140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593395+0000","last_change":"2023-08-09T12:47:38.618695+0000","last_active":"2023-08-09T12:47:39.593395+0000","last_peered":"2023-08-09T12:47:39.593395+0000","last_clean":"2023-08-09T12:47:39.593395+0000","last_became_active":"2023-08-09T12:47:38.618438+0000","last_became_peered":"2023-08-09T12:47:38.618438+0000","last_unstale":"2023-08-09T12:47:39.593395+0000","last_undegraded":"2023-08-09T12:47:39.593395+0000","last_fullsized":"2023-08-09T12:47:39.593395+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:23.190301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113614+0000","last_change":"2023-08-09T12:47:37.603392+0000","last_active":"2023-08-09T12:47:40.113614+0000","last_peered":"2023-08-09T12:47:40.113614+0000","last_clean":"2023-08-09T12:47:40.113614+0000","last_became_active":"2023-08-09T12:47:37.602991+0000","last_became_peered":"2023-08-09T12:47:37.602991+0000","last_unstale":"2023-08-09T12:47:40.113614+0000","last_undegraded":"2023-08-09T12:47:40.113614+0000","last_fullsized":"2023-08-09T12:47:40.113614+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:13:15.703729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591101+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:47:39.591101+0000","last_peered":"2023-08-09T12:47:39.591101+0000","last_clean":"2023-08-09T12:47:39.591101+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:47:39.591101+0000","last_undegraded":"2023-08-09T12:47:39.591101+0000","last_fullsized":"2023-08-09T12:47:39.591101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:46.213248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.591513+0000","last_change":"2023-08-09T12:47:38.611702+0000","last_active":"2023-08-09T12:47:39.591513+0000","last_peered":"2023-08-09T12:47:39.591513+0000","last_clean":"2023-08-09T12:47:39.591513+0000","last_became_active":"2023-08-09T12:47:38.611317+0000","last_became_peered":"2023-08-09T12:47:38.611317+0000","last_unstale":"2023-08-09T12:47:39.591513+0000","last_undegraded":"2023-08-09T12:47:39.591513+0000","last_fullsized":"2023-08-09T12:47:39.591513+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:40:52.826235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.114041+0000","last_change":"2023-08-09T12:47:37.612169+0000","last_active":"2023-08-09T12:47:40.114041+0000","last_peered":"2023-08-09T12:47:40.114041+0000","last_clean":"2023-08-09T12:47:40.114041+0000","last_became_active":"2023-08-09T12:47:37.611919+0000","last_became_peered":"2023-08-09T12:47:37.611919+0000","last_unstale":"2023-08-09T12:47:40.114041+0000","last_undegraded":"2023-08-09T12:47:40.114041+0000","last_fullsized":"2023-08-09T12:47:40.114041+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:52:39.227580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":235,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837333+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:47:39.837333+0000","last_peered":"2023-08-09T12:47:39.837333+0000","last_clean":"2023-08-09T12:47:39.837333+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:47:39.837333+0000","last_undegraded":"2023-08-09T12:47:39.837333+0000","last_fullsized":"2023-08-09T12:47:39.837333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:14:25.552659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.749396+0000","last_change":"2023-08-09T12:47:38.625611+0000","last_active":"2023-08-09T12:47:39.749396+0000","last_peered":"2023-08-09T12:47:39.749396+0000","last_clean":"2023-08-09T12:47:39.749396+0000","last_became_active":"2023-08-09T12:47:38.625040+0000","last_became_peered":"2023-08-09T12:47:38.625040+0000","last_unstale":"2023-08-09T12:47:39.749396+0000","last_undegraded":"2023-08-09T12:47:39.749396+0000","last_fullsized":"2023-08-09T12:47:39.749396+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:30.185512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748468+0000","last_change":"2023-08-09T12:47:37.603307+0000","last_active":"2023-08-09T12:47:39.748468+0000","last_peered":"2023-08-09T12:47:39.748468+0000","last_clean":"2023-08-09T12:47:39.748468+0000","last_became_active":"2023-08-09T12:47:37.603018+0000","last_became_peered":"2023-08-09T12:47:37.603018+0000","last_unstale":"2023-08-09T12:47:39.748468+0000","last_undegraded":"2023-08-09T12:47:39.748468+0000","last_fullsized":"2023-08-09T12:47:39.748468+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:43:01.427332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593619+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:47:39.593619+0000","last_peered":"2023-08-09T12:47:39.593619+0000","last_clean":"2023-08-09T12:47:39.593619+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:47:39.593619+0000","last_undegraded":"2023-08-09T12:47:39.593619+0000","last_fullsized":"2023-08-09T12:47:39.593619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:57:52.195576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835866+0000","last_change":"2023-08-09T12:47:38.617562+0000","last_active":"2023-08-09T12:47:39.835866+0000","last_peered":"2023-08-09T12:47:39.835866+0000","last_clean":"2023-08-09T12:47:39.835866+0000","last_became_active":"2023-08-09T12:47:38.613829+0000","last_became_peered":"2023-08-09T12:47:38.613829+0000","last_unstale":"2023-08-09T12:47:39.835866+0000","last_undegraded":"2023-08-09T12:47:39.835866+0000","last_fullsized":"2023-08-09T12:47:39.835866+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:10:23.190301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837128+0000","last_change":"2023-08-09T12:47:37.594752+0000","last_active":"2023-08-09T12:47:39.837128+0000","last_peered":"2023-08-09T12:47:39.837128+0000","last_clean":"2023-08-09T12:47:39.837128+0000","last_became_active":"2023-08-09T12:47:37.593909+0000","last_became_peered":"2023-08-09T12:47:37.593909+0000","last_unstale":"2023-08-09T12:47:39.837128+0000","last_undegraded":"2023-08-09T12:47:39.837128+0000","last_fullsized":"2023-08-09T12:47:39.837128+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:08:33.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.835462+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:47:39.835462+0000","last_peered":"2023-08-09T12:47:39.835462+0000","last_clean":"2023-08-09T12:47:39.835462+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:47:39.835462+0000","last_undegraded":"2023-08-09T12:47:39.835462+0000","last_fullsized":"2023-08-09T12:47:39.835462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:49.741300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113808+0000","last_change":"2023-08-09T12:47:38.598777+0000","last_active":"2023-08-09T12:47:40.113808+0000","last_peered":"2023-08-09T12:47:40.113808+0000","last_clean":"2023-08-09T12:47:40.113808+0000","last_became_active":"2023-08-09T12:47:38.598541+0000","last_became_peered":"2023-08-09T12:47:38.598541+0000","last_unstale":"2023-08-09T12:47:40.113808+0000","last_undegraded":"2023-08-09T12:47:40.113808+0000","last_fullsized":"2023-08-09T12:47:40.113808+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:46:27.288802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"145'3","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837041+0000","last_change":"2023-08-09T12:47:37.608278+0000","last_active":"2023-08-09T12:47:39.837041+0000","last_peered":"2023-08-09T12:47:39.837041+0000","last_clean":"2023-08-09T12:47:39.837041+0000","last_became_active":"2023-08-09T12:47:37.608019+0000","last_became_peered":"2023-08-09T12:47:37.608019+0000","last_unstale":"2023-08-09T12:47:39.837041+0000","last_undegraded":"2023-08-09T12:47:39.837041+0000","last_fullsized":"2023-08-09T12:47:39.837041+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:07.171927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":236,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.593170+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:47:39.593170+0000","last_peered":"2023-08-09T12:47:39.593170+0000","last_clean":"2023-08-09T12:47:39.593170+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:47:39.593170+0000","last_undegraded":"2023-08-09T12:47:39.593170+0000","last_fullsized":"2023-08-09T12:47:39.593170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:59:51.745185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.837140+0000","last_change":"2023-08-09T12:47:38.616131+0000","last_active":"2023-08-09T12:47:39.837140+0000","last_peered":"2023-08-09T12:47:39.837140+0000","last_clean":"2023-08-09T12:47:39.837140+0000","last_became_active":"2023-08-09T12:47:38.614504+0000","last_became_peered":"2023-08-09T12:47:38.614504+0000","last_unstale":"2023-08-09T12:47:39.837140+0000","last_undegraded":"2023-08-09T12:47:39.837140+0000","last_fullsized":"2023-08-09T12:47:39.837140+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:37.567514+0000","last_clean_scrub_stamp":"2023-08-09T12:47:37.567514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:11:30.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"145'6","reported_seq":19,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:40.113873+0000","last_change":"2023-08-09T12:47:37.608635+0000","last_active":"2023-08-09T12:47:40.113873+0000","last_peered":"2023-08-09T12:47:40.113873+0000","last_clean":"2023-08-09T12:47:40.113873+0000","last_became_active":"2023-08-09T12:47:37.608363+0000","last_became_peered":"2023-08-09T12:47:37.608363+0000","last_unstale":"2023-08-09T12:47:40.113873+0000","last_undegraded":"2023-08-09T12:47:40.113873+0000","last_fullsized":"2023-08-09T12:47:40.113873+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:47:36.551237+0000","last_clean_scrub_stamp":"2023-08-09T12:47:36.551237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:53:51.774987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-08-09T12:47:39.748949+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:47:39.748949+0000","last_peered":"2023-08-09T12:47:39.748949+0000","last_clean":"2023-08-09T12:47:39.748949+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:47:39.748949+0000","last_undegraded":"2023-08-09T12:47:39.748949+0000","last_fullsized":"2023-08-09T12:47:39.748949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:16:08.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574952,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193891,"statfs":{"total":200000000,"available":198544739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.135,"15min":1.1080000000000001},"min":{"1min":0.76900000000000002,"5min":0.627,"15min":0.59899999999999998},"max":{"1min":1.587,"5min":1.6359999999999999,"15min":1.7490000000000001},"last":1.069},{"interface":"front","average":{"1min":1.069,"5min":1.1240000000000001,"15min":1.0900000000000001},"min":{"1min":0.76300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6659999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.274}]},{"osd":1,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2390000000000001,"15min":1.1419999999999999},"min":{"1min":0.74199999999999999,"5min":0.70799999999999996,"15min":0.63300000000000001},"max":{"1min":1.7809999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.125,"5min":1.2030000000000001,"15min":1.1299999999999999},"min":{"1min":0.72899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5349999999999999,"5min":1.714,"15min":1.734},"last":1.133}]},{"osd":2,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2989999999999999,"15min":1.1990000000000001},"min":{"1min":0.79200000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.661,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2210000000000001,"15min":1.169},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.5429999999999999,"5min":1.7450000000000001,"15min":2.173},"last":1.5489999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.351,"15min":1.26},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.696,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.373,"15min":1.294},"min":{"1min":0.72699999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.8460000000000001,"5min":2.282,"15min":2.282},"last":1.24}]},{"osd":4,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.2589999999999999,"15min":1.2230000000000001},"min":{"1min":1.0409999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.768,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.464},{"interface":"front","average":{"1min":1.391,"5min":1.4399999999999999,"15min":1.3160000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.58599999999999997},"max":{"1min":1.8480000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.3959999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4399999999999999,"15min":1.333},"min":{"1min":0.88800000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9530000000000001,"5min":2.802,"15min":2.802},"last":1.347},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5509999999999999,"15min":1.5009999999999999},"min":{"1min":0.89300000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9450000000000001,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.6579999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5129999999999999,"15min":1.4810000000000001},"min":{"1min":0.96199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.0249999999999999,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.5509999999999999,"15min":1.4690000000000001},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":0.623},"max":{"1min":1.9770000000000001,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.591}]}]},{"osd":6,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1599999999999999,"15min":1.1319999999999999},"min":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4159999999999999,"5min":1.986,"15min":2.54},"last":1.536},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.101,"15min":1.0740000000000001},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2350000000000001,"15min":1.2330000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.66500000000000004},"max":{"1min":1.996,"5min":1.996,"15min":2.306},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.335,"15min":1.3220000000000001},"min":{"1min":0.79100000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.655,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.93500000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1739999999999999,"15min":1.1140000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.4399999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.288},{"interface":"front","average":{"1min":1.284,"5min":1.3109999999999999,"15min":1.2829999999999999},"min":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.772}]},{"osd":3,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.327,"15min":1.282},"min":{"1min":0.79500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.595,"5min":2.327,"15min":2.327},"last":1.496},{"interface":"front","average":{"1min":1.27,"5min":1.3819999999999999,"15min":1.3089999999999999},"min":{"1min":0.81799999999999995,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.6120000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.4550000000000001,"15min":1.349},"min":{"1min":0.93799999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7070000000000001,"5min":11.058999999999999,"15min":11.058999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.383,"15min":1.349},"min":{"1min":0.85399999999999998,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.744,"5min":2.29,"15min":2.3479999999999999},"last":1.1080000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.403,"15min":1.343},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":2.2349999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.536,"15min":1.492},"min":{"1min":1.22,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.8220000000000001,"5min":2.4319999999999999,"15min":2.8580000000000001},"last":1.677}]},{"osd":7,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5569999999999999,"15min":1.458},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.885,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.569,"15min":1.464},"min":{"1min":0.98699999999999999,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":2.7810000000000001,"5min":3.621,"15min":3.621},"last":1.8109999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1000000000000001,"15min":1.107},"min":{"1min":0.68000000000000005,"5min":0.58399999999999996,"15min":0.55300000000000005},"max":{"1min":3.4060000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.202,"15min":1.101},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.569,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.1850000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3580000000000001,"15min":1.306},"min":{"1min":0.91700000000000004,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.671,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.278,"15min":1.2549999999999999},"min":{"1min":0.73899999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.1020000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2390000000000001,"15min":1.2130000000000001},"min":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.194,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.446},{"interface":"front","average":{"1min":1.278,"5min":1.23,"15min":1.2},"min":{"1min":0.92300000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.4970000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.325,"15min":1.2310000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7829999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3819999999999999,"15min":1.3740000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":2.3319999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.2230000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.3080000000000001,"15min":1.2529999999999999},"min":{"1min":0.83999999999999997,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.571},{"interface":"front","average":{"1min":1.51,"5min":1.4319999999999999,"15min":1.3879999999999999},"min":{"1min":0.88400000000000001,"5min":0.65800000000000003,"15min":0.628},"max":{"1min":3.3109999999999999,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.546}]},{"osd":6,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.423,"15min":1.3620000000000001},"min":{"1min":1.0209999999999999,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":2.952,"5min":2.952,"15min":2.952},"last":1.589},{"interface":"front","average":{"1min":1.716,"5min":1.5049999999999999,"15min":1.4950000000000001},"min":{"1min":1.0660000000000001,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":5.8570000000000002,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.6240000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:47:25 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.554,"15min":1.5289999999999999},"min":{"1min":1.081,"5min":0.76900000000000002,"15min":0.67200000000000004},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.7270000000000001},{"interface":"front","average":{"1min":1.6850000000000001,"5min":1.6100000000000001,"15min":1.54},"min":{"1min":1.1279999999999999,"5min":0.80000000000000004,"15min":0.65300000000000002},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.694}]}]},{"osd":4,"up_from":13,"seq":55834574952,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":845,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194467,"statfs":{"total":200000000,"available":199134271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.135,"15min":1.0960000000000001},"min":{"1min":0.68700000000000006,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6060000000000001,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.349},{"interface":"front","average":{"1min":1.155,"5min":1.169,"15min":1.1140000000000001},"min":{"1min":0.69099999999999995,"5min":0.66500000000000004,"15min":0.64800000000000002},"max":{"1min":1.635,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.5229999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2669999999999999,"15min":1.3169999999999999},"min":{"1min":0.82199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.468,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3160000000000001,"15min":1.331},"min":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.772,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.109}]},{"osd":2,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3089999999999999,"15min":1.3160000000000001},"min":{"1min":0.88500000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6000000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.3600000000000001,"15min":1.331},"min":{"1min":0.88,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.978,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.2350000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.306,"15min":1.2390000000000001},"min":{"1min":0.76700000000000002,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.9159999999999999,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.329,"15min":1.333},"min":{"1min":0.95999999999999996,"5min":0.89500000000000002,"15min":0.82699999999999996},"max":{"1min":1.6779999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.304}]},{"osd":5,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.3560000000000001,"15min":1.3839999999999999},"min":{"1min":0.996,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":1.843,"5min":3.137,"15min":3.137},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.3939999999999999,"15min":1.383},"min":{"1min":1.032,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.157}]},{"osd":6,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4450000000000001,"15min":1.478},"min":{"1min":1.1000000000000001,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":1.9410000000000001,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.393},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.542,"15min":1.542},"min":{"1min":0.97399999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1909999999999998,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.5580000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.5449999999999999,"15min":1.5269999999999999},"min":{"1min":0.94199999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.2429999999999999,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.419},{"interface":"front","average":{"1min":1.554,"5min":1.587,"15min":1.615},"min":{"1min":1.2669999999999999,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.0510000000000002,"5min":2.875,"15min":2.875},"last":1.603}]}]},{"osd":3,"up_from":13,"seq":55834574952,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":845,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194467,"statfs":{"total":200000000,"available":199134237,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86099999999999999,"15min":0.84299999999999997},"min":{"1min":0.53400000000000003,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.1619999999999999,"5min":1.4219999999999999,"15min":4.4109999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":0.93400000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.35499999999999998},"max":{"1min":1.3,"5min":2.778,"15min":3.2269999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.92900000000000005,"15min":0.90100000000000002},"min":{"1min":0.53600000000000003,"5min":0.41099999999999998,"15min":0.38100000000000001},"max":{"1min":1.147,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.129,"15min":0.97099999999999997},"min":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.373},"max":{"1min":1.704,"5min":2.0219999999999998,"15min":2.0880000000000001},"last":0.33900000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.125,"15min":1.1279999999999999},"min":{"1min":0.61399999999999999,"5min":0.53700000000000003,"15min":0.433},"max":{"1min":1.4570000000000001,"5min":1.9259999999999999,"15min":18.145},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2350000000000001,"15min":1.2030000000000001},"min":{"1min":0.67200000000000004,"5min":0.53800000000000003,"15min":0.41799999999999998},"max":{"1min":1.976,"5min":2.169,"15min":2.169},"last":0.379}]},{"osd":4,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.284,"15min":1.3149999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.745},"max":{"1min":1.718,"5min":2.859,"15min":3.5110000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3149999999999999,"15min":1.3340000000000001},"min":{"1min":0.91500000000000004,"5min":0.89300000000000002,"15min":0.65400000000000003},"max":{"1min":2.056,"5min":2.056,"15min":3.5960000000000001},"last":1.0720000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.345,"15min":1.4319999999999999},"min":{"1min":0.85599999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":18.094000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.458,"15min":1.383},"min":{"1min":1.0069999999999999,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.8109999999999999,"5min":3.0419999999999998,"15min":14.105},"last":0.752}]},{"osd":6,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.393,"15min":1.3580000000000001},"min":{"1min":1.016,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.429,"15min":1.4670000000000001},"min":{"1min":0.86399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8340000000000001,"5min":2.0099999999999998,"15min":4.0220000000000002},"last":1.1919999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:47:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.5169999999999999,"15min":1.4199999999999999},"min":{"1min":1.0780000000000001,"5min":0.90900000000000003,"15min":0.72499999999999998},"max":{"1min":1.9119999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.569,"5min":1.4950000000000001,"15min":1.4119999999999999},"min":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":2.073,"5min":2.073,"15min":3.016},"last":1.296}]}]},{"osd":2,"up_from":13,"seq":55834574953,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.88400000000000001,"15min":0.86299999999999999},"min":{"1min":0.60899999999999999,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":1.377,"5min":1.597,"15min":1.716},"last":1.181},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0069999999999999,"15min":0.96299999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.73,"15min":2.9009999999999998},"last":1.0189999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.94799999999999995,"15min":0.92300000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.36299999999999999},"max":{"1min":1.2190000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.075,"15min":1.054},"min":{"1min":0.68100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5820000000000001,"5min":1.823,"15min":1.869},"last":0.85799999999999998}]},{"osd":3,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.177,"15min":1.163},"min":{"1min":0.59799999999999998,"5min":0.54800000000000004,"15min":0.46600000000000003},"max":{"1min":1.6140000000000001,"5min":1.6819999999999999,"15min":3.2850000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1990000000000001,"15min":1.161},"min":{"1min":0.67200000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.581,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":1.345}]},{"osd":4,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.448,"15min":1.417},"min":{"1min":0.88800000000000001,"5min":0.82599999999999996,"15min":0.81899999999999995},"max":{"1min":1.7709999999999999,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.712},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.343,"15min":1.2929999999999999},"min":{"1min":0.84499999999999997,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.974,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":1.6040000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.409,"15min":1.373},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8779999999999999,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4650000000000001,"15min":1.476},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.929,"5min":2.4780000000000002,"15min":4.806},"last":1.55}]},{"osd":6,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.379,"15min":1.3220000000000001},"min":{"1min":0.80300000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8069999999999999,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.288},{"interface":"front","average":{"1min":1.387,"5min":1.476,"15min":1.4279999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.8140000000000001,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":1.653}]},{"osd":7,"last update":"Wed Aug 9 12:47:23 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4470000000000001,"15min":1.3819999999999999},"min":{"1min":0.82399999999999995,"5min":0.76900000000000002,"15min":0.76200000000000001},"max":{"1min":2.1309999999999998,"5min":2.464,"15min":2.464},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.556,"15min":1.534},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.984,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.764}]}]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":1.304,"5min":2.621,"15min":2.621},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.036,"15min":1.27},"min":{"1min":0.54500000000000004,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.778,"5min":1.9790000000000001,"15min":88.254999999999995},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0149999999999999,"15min":0.96299999999999997},"min":{"1min":0.71299999999999997,"5min":0.57299999999999995,"15min":0.57099999999999995},"max":{"1min":1.6180000000000001,"5min":1.9390000000000001,"15min":3.0209999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.115,"5min":1.2909999999999999,"15min":1.1619999999999999},"min":{"1min":0.74099999999999999,"5min":0.622,"15min":0.61799999999999999},"max":{"1min":1.7330000000000001,"5min":2.0449999999999999,"15min":3.1890000000000001},"last":1.054}]},{"osd":3,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.2230000000000001,"15min":1.1120000000000001},"min":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.57399999999999995},"max":{"1min":1.4870000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.1279999999999999,"15min":1.0009999999999999},"min":{"1min":0.60199999999999998,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.819,"5min":1.819,"15min":5.4320000000000004},"last":0.94099999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2569999999999999,"15min":1.3},"min":{"1min":0.871,"5min":0.80000000000000004,"15min":0.76200000000000001},"max":{"1min":1.6739999999999999,"5min":2.391,"15min":25.172000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.421,"15min":1.323},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7270000000000001,"5min":3.762,"15min":3.762},"last":1.181}]},{"osd":5,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3600000000000001,"15min":1.4079999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7170000000000001,"5min":2.5419999999999998,"15min":28.710000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3460000000000001,"15min":1.2949999999999999},"min":{"1min":0.81899999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.802,"5min":2.048,"15min":3.762},"last":0.98499999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.49,"15min":1.4379999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7170000000000001,"5min":1.9670000000000001,"15min":6.0460000000000003},"last":1.375},{"interface":"front","average":{"1min":1.409,"5min":1.4750000000000001,"15min":1.393},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":1.8,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.3440000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.5600000000000001,"15min":1.5920000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9430000000000001,"5min":2.5089999999999999,"15min":26.975999999999999},"last":1.28},{"interface":"front","average":{"1min":1.468,"5min":1.575,"15min":1.5840000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.948,"5min":2.492,"15min":28.765000000000001},"last":1.323}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1420,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193892,"statfs":{"total":200000000,"available":198545493,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.90900000000000003,"15min":0.874},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.294,"5min":1.597,"15min":1.819},"last":1.4039999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":1.038,"15min":0.97299999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.3959999999999999,"5min":1.6699999999999999,"15min":6.1749999999999998},"last":1.331}]},{"osd":2,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0469999999999999,"15min":0.97599999999999998},"min":{"1min":0.51300000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.514,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.179},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0860000000000001,"15min":1.042},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.5},"max":{"1min":1.2649999999999999,"5min":1.732,"15min":6.2549999999999999},"last":0.89800000000000002}]},{"osd":3,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0629999999999999,"15min":0.97399999999999998},"min":{"1min":0.57899999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6639999999999999,"5min":1.6699999999999999,"15min":9.6069999999999993},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.218,"15min":1.1839999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.444,"5min":1.7609999999999999,"15min":2.2730000000000001},"last":1.9350000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3340000000000001,"15min":1.337},"min":{"1min":1.1040000000000001,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.7909999999999999,"5min":1.8240000000000001,"15min":9.9629999999999992},"last":1.258},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.306},"min":{"1min":0.92100000000000004,"5min":0.78600000000000003,"15min":0.77900000000000003},"max":{"1min":1.8560000000000001,"5min":1.879,"15min":1.879},"last":1.825}]},{"osd":5,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3620000000000001,"15min":1.3220000000000001},"min":{"1min":0.82799999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.75,"5min":2.0419999999999998,"15min":10.004},"last":1.478},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4419999999999999,"15min":1.391},"min":{"1min":0.90300000000000002,"5min":0.90200000000000002,"15min":0.84999999999999998},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.161},"last":1.552}]},{"osd":6,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.4139999999999999,"15min":1.3620000000000001},"min":{"1min":1.117,"5min":1.0409999999999999,"15min":0.75900000000000001},"max":{"1min":2.0329999999999999,"5min":2.2000000000000002,"15min":6.4290000000000003},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.4650000000000001,"15min":1.4410000000000001},"min":{"1min":0.90200000000000002,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":2.117,"5min":2.1549999999999998,"15min":9.9190000000000005},"last":1.7030000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:47:26 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.79200000000000004},"max":{"1min":1.9259999999999999,"5min":2.2909999999999999,"15min":18.114000000000001},"last":1.659},{"interface":"front","average":{"1min":1.556,"5min":1.544,"15min":1.4830000000000001},"min":{"1min":0.94099999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.0350000000000001,"5min":2.1120000000000001,"15min":9.5640000000000001},"last":1.891}]}]}],"pool_statfs":[]}} 2023-08-09T12:47:43.891 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:47:43.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:47:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.160+0000 7fa33f64d640 1 Processor -- start 2023-08-09T12:47:44.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.161+0000 7fa33f64d640 1 -- start start 2023-08-09T12:47:44.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.162+0000 7fa33f64d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa3380b1ee0 0x7fa3381617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.163+0000 7fa33f64d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa338161360 con 0x7fa3380cd760 2023-08-09T12:47:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.163+0000 7fa33f64d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa338160d50 con 0x7fa338072f60 2023-08-09T12:47:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.163+0000 7fa33f64d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806a4c0 con 0x7fa3380b1ee0 2023-08-09T12:47:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.163+0000 7fa33cbe8640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa3380cd760 0x7fa338072850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33206/0 (socket says 172.21.15.17:33206) 2023-08-09T12:47:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.163+0000 7fa33cbe8640 1 -- 172.21.15.17:0/2993536878 learned_addr learned my addr 172.21.15.17:0/2993536878 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.163+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2993536878 >> v2:172.21.15.142:3300/0 conn(0x7fa3380b1ee0 0x7fa3381617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.163+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030365791 0 0) 0x7fa338161360 con 0x7fa3380cd760 2023-08-09T12:47:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.163+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa324003520 con 0x7fa3380cd760 2023-08-09T12:47:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118924033 0 0) 0x7fa324003520 con 0x7fa3380cd760 2023-08-09T12:47:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 >> v2:172.21.15.142:3300/0 conn(0x7fa3380b1ee0 msgr2=0x7fa3381617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 --2- 172.21.15.17:0/2993536878 >> v2:172.21.15.142:3300/0 conn(0x7fa3380b1ee0 0x7fa3381617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 >> v1:172.21.15.142:6789/0 conn(0x7fa338072f60 legacy=0x7fa3380697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33806ae70 con 0x7fa3380cd760 2023-08-09T12:47:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa328001670 con 0x7fa3380cd760 2023-08-09T12:47:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 >> v1:172.21.15.17:6789/0 conn(0x7fa3380cd760 legacy=0x7fa338072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa324003970 0x7fa324003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3240047c0 0x7fa324004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa324005180 0x7fa32400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33806a4c0 con 0x7fa324003970 2023-08-09T12:47:44.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32400c030 con 0x7fa324005180 2023-08-09T12:47:44.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32400c1f0 con 0x7fa3240047c0 2023-08-09T12:47:44.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.164+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa324003970 0x7fa324003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33d3e9640 1 -- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3240047c0 msgr2=0x7fa324004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:44.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33cbe8640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3240047c0 0x7fa324004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3240047c0 0x7fa324004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33d3e9640 1 -- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa324005180 msgr2=0x7fa32400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:44.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33dbea640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa324005180 0x7fa32400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa324005180 0x7fa32400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33d3e9640 1 -- 172.21.15.17:0/2993536878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324003520 con 0x7fa324003970 2023-08-09T12:47:44.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33dbea640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa324005180 0x7fa32400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:44.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33dbea640 1 -- 172.21.15.17:0/2993536878 reap_dead start 2023-08-09T12:47:44.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.165+0000 7fa33cbe8640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3240047c0 0x7fa324004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.166+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa324003970 0x7fa324003d90 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fa334009ac0 tx=0x7fa3240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86070ec35a9a6263 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.166+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33402c6b0 con 0x7fa324003970 2023-08-09T12:47:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.166+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33402c810 con 0x7fa324003970 2023-08-09T12:47:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.166+0000 7fa32ffff640 1 -- 172.21.15.17:0/2993536878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33402cba0 con 0x7fa324003970 2023-08-09T12:47:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.167+0000 7fa33f64d640 1 -- 172.21.15.17:0/2993536878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa324003970 msgr2=0x7fa324003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.167+0000 7fa33f64d640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa324003970 0x7fa324003d90 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fa334009ac0 tx=0x7fa3240057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.167+0000 7fa33f64d640 1 -- 172.21.15.17:0/2993536878 shutdown_connections 2023-08-09T12:47:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.167+0000 7fa33f64d640 1 --2- 172.21.15.17:0/2993536878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa324003970 0x7fa324003d90 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.167+0000 7fa33f64d640 1 -- 172.21.15.17:0/2993536878 >> 172.21.15.17:0/2993536878 conn(0x7fa3380cc450 msgr2=0x7fa3380cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.167+0000 7fa33f64d640 1 -- 172.21.15.17:0/2993536878 shutdown_connections 2023-08-09T12:47:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.167+0000 7fa33f64d640 1 -- 172.21.15.17:0/2993536878 wait complete. 2023-08-09T12:47:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.169+0000 7fa33f64d640 1 Processor -- start 2023-08-09T12:47:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.169+0000 7fa33f64d640 1 -- start start 2023-08-09T12:47:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.170+0000 7fa33f64d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa324003970 0x7fa338154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.170+0000 7fa33f64d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa33815a410 0x7fa33815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.170+0000 7fa33f64d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa33815d7e0 0x7fa33815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33f64d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815d3c0 con 0x7fa33815a410 2023-08-09T12:47:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33f64d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815c740 con 0x7fa33815d7e0 2023-08-09T12:47:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33f64d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815ca20 con 0x7fa324003970 2023-08-09T12:47:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33cbe8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa33815a410 0x7fa33815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33cbe8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa33815a410 0x7fa33815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59482/0 (socket says 172.21.15.17:59482) 2023-08-09T12:47:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33cbe8640 1 -- 172.21.15.17:0/2440915831 learned_addr learned my addr 172.21.15.17:0/2440915831 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa324003970 0x7fa338154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33dbea640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa33815d7e0 0x7fa33815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33cbe8640 1 -- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa324003970 msgr2=0x7fa338154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33cbe8640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa324003970 0x7fa338154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33cbe8640 1 -- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa33815d7e0 msgr2=0x7fa33815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33cbe8640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa33815d7e0 0x7fa33815dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33cbe8640 1 -- 172.21.15.17:0/2440915831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33815cd00 con 0x7fa33815a410 2023-08-09T12:47:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.171+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa324003970 0x7fa338154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.172+0000 7fa33cbe8640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa33815a410 0x7fa33815a870 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fa32800d6c0 tx=0x7fa32800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.172+0000 7fa32dffb640 1 -- 172.21.15.17:0/2440915831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280072d0 con 0x7fa33815a410 2023-08-09T12:47:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.172+0000 7fa32dffb640 1 -- 172.21.15.17:0/2440915831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328007430 con 0x7fa33815a410 2023-08-09T12:47:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.172+0000 7fa32dffb640 1 -- 172.21.15.17:0/2440915831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280047e0 con 0x7fa33815a410 2023-08-09T12:47:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.172+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33815cfe0 con 0x7fa33815a410 2023-08-09T12:47:44.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.172+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa338159e20 con 0x7fa33815a410 2023-08-09T12:47:44.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.173+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33815d630 con 0x7fa33815a410 2023-08-09T12:47:44.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.174+0000 7fa32dffb640 1 -- 172.21.15.17:0/2440915831 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa328004940 con 0x7fa33815a410 2023-08-09T12:47:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.175+0000 7fa32dffb640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa31c06a050 0x7fa31c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.175+0000 7fa32dffb640 1 -- 172.21.15.17:0/2440915831 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa328088060 con 0x7fa33815a410 2023-08-09T12:47:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.176+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa31c06a050 0x7fa31c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.177+0000 7fa33d3e9640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa31c06a050 0x7fa31c06c510 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa334036000 tx=0x7fa334030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.179+0000 7fa32dffb640 1 -- 172.21.15.17:0/2440915831 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa3280ba7b0 con 0x7fa33815a410 2023-08-09T12:47:44.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.446+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa338067a80 con 0x7fa33815a410 2023-08-09T12:47:44.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.453+0000 7fa32dffb640 1 -- 172.21.15.17:0/2440915831 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa3280190e0 con 0x7fa33815a410 2023-08-09T12:47:44.456 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:47:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:47:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:47:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:47:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:47:44.457 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:47:44.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa31c06a050 msgr2=0x7fa31c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa31c06a050 0x7fa31c06c510 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa334036000 tx=0x7fa334030000 comp rx=0 tx=0).stop 2023-08-09T12:47:44.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa33815a410 msgr2=0x7fa33815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa33815a410 0x7fa33815a870 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fa32800d6c0 tx=0x7fa32800db80 comp rx=0 tx=0).stop 2023-08-09T12:47:44.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 shutdown_connections 2023-08-09T12:47:44.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa31c06a050 0x7fa31c06c510 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa33815d7e0 0x7fa33815dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa33815a410 0x7fa33815a870 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 --2- 172.21.15.17:0/2440915831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa324003970 0x7fa338154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 >> 172.21.15.17:0/2440915831 conn(0x7fa3380cc450 msgr2=0x7fa338070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 shutdown_connections 2023-08-09T12:47:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.456+0000 7fa33f64d640 1 -- 172.21.15.17:0/2440915831 wait complete. 2023-08-09T12:47:44.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:44.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.700+0000 7f464ef54640 1 Processor -- start 2023-08-09T12:47:44.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.700+0000 7f464ef54640 1 -- start start 2023-08-09T12:47:44.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.702+0000 7f464ef54640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4648161660 0x7f46480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.702+0000 7f464ef54640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46480ad240 con 0x7f46480acdf0 2023-08-09T12:47:44.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.702+0000 7f464ef54640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464815df30 con 0x7f4648161280 2023-08-09T12:47:44.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.702+0000 7f464ef54640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464815d430 con 0x7f4648161660 2023-08-09T12:47:44.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.702+0000 7f4647fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4648161660 0x7f46480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.702+0000 7f464d4f1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f46480acdf0 0x7f46480cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33212/0 (socket says 172.21.15.17:33212) 2023-08-09T12:47:44.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.702+0000 7f464d4f1640 1 -- 172.21.15.17:0/2998248784 learned_addr learned my addr 172.21.15.17:0/2998248784 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:44.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.703+0000 7f4647fff640 1 -- 172.21.15.17:0/2998248784 >> v1:172.21.15.142:6789/0 conn(0x7f4648161280 legacy=0x7f46480c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.703+0000 7f4647fff640 1 -- 172.21.15.17:0/2998248784 >> v1:172.21.15.17:6789/0 conn(0x7f46480acdf0 legacy=0x7f46480cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.703+0000 7f4647fff640 1 -- 172.21.15.17:0/2998248784 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46480ca9d0 con 0x7f4648161660 2023-08-09T12:47:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.703+0000 7f46477fe640 1 -- 172.21.15.17:0/2998248784 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813425499 0 0) 0x7f4640001490 con 0x7f46480acdf0 2023-08-09T12:47:44.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.704+0000 7f4647fff640 1 --2- 172.21.15.17:0/2998248784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648161660 0x7f46480ac8b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f4634009790 tx=0x7f463402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24009869b62ab339 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:44.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.704+0000 7f46477fe640 1 -- 172.21.15.17:0/2998248784 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463402d040 con 0x7f4648161660 2023-08-09T12:47:44.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.704+0000 7f46477fe640 1 -- 172.21.15.17:0/2998248784 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634031810 con 0x7f4648161660 2023-08-09T12:47:44.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.704+0000 7f46477fe640 1 -- 172.21.15.17:0/2998248784 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634031ba0 con 0x7f4648161660 2023-08-09T12:47:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.705+0000 7f464ef54640 1 -- 172.21.15.17:0/2998248784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648161660 msgr2=0x7f46480ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.705+0000 7f464ef54640 1 --2- 172.21.15.17:0/2998248784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648161660 0x7f46480ac8b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f4634009790 tx=0x7f463402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.705+0000 7f464ef54640 1 -- 172.21.15.17:0/2998248784 shutdown_connections 2023-08-09T12:47:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.705+0000 7f464ef54640 1 --2- 172.21.15.17:0/2998248784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648161660 0x7f46480ac8b0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.705+0000 7f464ef54640 1 -- 172.21.15.17:0/2998248784 >> 172.21.15.17:0/2998248784 conn(0x7f46480cb1b0 msgr2=0x7f46480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.705+0000 7f464ef54640 1 -- 172.21.15.17:0/2998248784 shutdown_connections 2023-08-09T12:47:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.705+0000 7f464ef54640 1 -- 172.21.15.17:0/2998248784 wait complete. 2023-08-09T12:47:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.707+0000 7f464ef54640 1 Processor -- start 2023-08-09T12:47:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.707+0000 7f464ef54640 1 -- start start 2023-08-09T12:47:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ef54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46480acdf0 0x7f4648151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ef54640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4648161280 0x7f46480b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ef54640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4648161660 0x7f46480b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ef54640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46481521b0 con 0x7f46480acdf0 2023-08-09T12:47:44.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ef54640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46481f2a10 con 0x7f4648161280 2023-08-09T12:47:44.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ef54640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4648155570 con 0x7f4648161660 2023-08-09T12:47:44.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ccf0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46480acdf0 0x7f4648151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ccf0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46480acdf0 0x7f4648151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59510/0 (socket says 172.21.15.17:59510) 2023-08-09T12:47:44.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.708+0000 7f464ccf0640 1 -- 172.21.15.17:0/881207053 learned_addr learned my addr 172.21.15.17:0/881207053 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:44.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f464ccf0640 1 -- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4648161660 msgr2=0x7f46480b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f464ccf0640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4648161660 0x7f46480b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f464ccf0640 1 -- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4648161280 msgr2=0x7f46480b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f464ccf0640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4648161280 0x7f46480b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f464ccf0640 1 -- 172.21.15.17:0/881207053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340093a0 con 0x7f46480acdf0 2023-08-09T12:47:44.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f464ccf0640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46480acdf0 0x7f4648151c70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c450 tx=0x7f463c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:44.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f46457fa640 1 -- 172.21.15.17:0/881207053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0052d0 con 0x7f46480acdf0 2023-08-09T12:47:44.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f46457fa640 1 -- 172.21.15.17:0/881207053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c005430 con 0x7f46480acdf0 2023-08-09T12:47:44.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f46457fa640 1 -- 172.21.15.17:0/881207053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c012870 con 0x7f46480acdf0 2023-08-09T12:47:44.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4648155850 con 0x7f46480acdf0 2023-08-09T12:47:44.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.709+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4648155e10 con 0x7f46480acdf0 2023-08-09T12:47:44.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.711+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4648067a80 con 0x7f46480acdf0 2023-08-09T12:47:44.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.712+0000 7f46457fa640 1 -- 172.21.15.17:0/881207053 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f463c0129d0 con 0x7f46480acdf0 2023-08-09T12:47:44.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.713+0000 7f46457fa640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f462c06a050 0x7f462c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:44.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.713+0000 7f46457fa640 1 -- 172.21.15.17:0/881207053 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f463c0881b0 con 0x7f46480acdf0 2023-08-09T12:47:44.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.713+0000 7f4647fff640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f462c06a050 0x7f462c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:44.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.714+0000 7f4647fff640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f462c06a050 0x7f462c06c510 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4634036000 tx=0x7f4634030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:44.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.717+0000 7f46457fa640 1 -- 172.21.15.17:0/881207053 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f463c053800 con 0x7f46480acdf0 2023-08-09T12:47:44.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.953+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46480adc60 con 0x7f46480acdf0 2023-08-09T12:47:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.955+0000 7f46457fa640 1 -- 172.21.15.17:0/881207053 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f463c056e20 con 0x7f46480acdf0 2023-08-09T12:47:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:44.958 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:47:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:47:44.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f462c06a050 msgr2=0x7f462c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f462c06a050 0x7f462c06c510 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4634036000 tx=0x7f4634030000 comp rx=0 tx=0).stop 2023-08-09T12:47:44.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46480acdf0 msgr2=0x7f4648151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:44.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46480acdf0 0x7f4648151c70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c450 tx=0x7f463c00c910 comp rx=0 tx=0).stop 2023-08-09T12:47:44.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 shutdown_connections 2023-08-09T12:47:44.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f462c06a050 0x7f462c06c510 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4648161660 0x7f46480b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4648161280 0x7f46480b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 --2- 172.21.15.17:0/881207053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46480acdf0 0x7f4648151c70 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:44.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.957+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 >> 172.21.15.17:0/881207053 conn(0x7f46480cb1b0 msgr2=0x7f464806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:44.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.958+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 shutdown_connections 2023-08-09T12:47:44.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:44.958+0000 7f464ef54640 1 -- 172.21.15.17:0/881207053 wait complete. 2023-08-09T12:47:45.382 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:47:38.101574+0000', 'modified': '2023-08-09T12:47:41.839924+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7992}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7992': {'gid': 7992, 'name': 'a', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/4116172429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 4116172429}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 4116172429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:47:45.382 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:47:45.383 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-09T12:47:45.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.624+0000 7fab2a84b640 1 Processor -- start 2023-08-09T12:47:45.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.624+0000 7fab2a84b640 1 -- start start 2023-08-09T12:47:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.625+0000 7fab2a84b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab241587e0 0x7fab24070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.626+0000 7fab2a84b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab240cb070 0x7fab240cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.626+0000 7fab2a84b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2415beb0 con 0x7fab240b0b10 2023-08-09T12:47:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.626+0000 7fab2a84b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab240cba40 con 0x7fab240cb070 2023-08-09T12:47:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.626+0000 7fab2a84b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab240715c0 con 0x7fab241587e0 2023-08-09T12:47:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.626+0000 7fab29048640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fab240b0b10 0x7fab2415b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33214/0 (socket says 172.21.15.17:33214) 2023-08-09T12:47:45.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.626+0000 7fab29048640 1 -- 172.21.15.17:0/2465116193 learned_addr learned my addr 172.21.15.17:0/2465116193 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.626+0000 7fab2a04a640 1 --2- 172.21.15.17:0/2465116193 >> v2:172.21.15.142:3300/0 conn(0x7fab240cb070 0x7fab240cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.626+0000 7fab29849640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab241587e0 0x7fab24070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458652972 0 0) 0x7fab2415beb0 con 0x7fab240b0b10 2023-08-09T12:47:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab10003520 con 0x7fab240b0b10 2023-08-09T12:47:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393156549 0 0) 0x7fab10003520 con 0x7fab240b0b10 2023-08-09T12:47:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab241587e0 msgr2=0x7fab24070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab241587e0 0x7fab24070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 >> v2:172.21.15.142:3300/0 conn(0x7fab240cb070 msgr2=0x7fab240cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 --2- 172.21.15.17:0/2465116193 >> v2:172.21.15.142:3300/0 conn(0x7fab240cb070 0x7fab240cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab240718a0 con 0x7fab240b0b10 2023-08-09T12:47:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fab14001670 con 0x7fab240b0b10 2023-08-09T12:47:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 >> v1:172.21.15.17:6789/0 conn(0x7fab240b0b10 legacy=0x7fab2415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab241587e0 0x7fab10003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab10003ef0 0x7fab100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab10004d00 0x7fab10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240cba40 con 0x7fab10003ef0 2023-08-09T12:47:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240715c0 con 0x7fab10004d00 2023-08-09T12:47:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.627+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1000b980 con 0x7fab241587e0 2023-08-09T12:47:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.628+0000 7fab29048640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab10003ef0 0x7fab100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.628+0000 7fab29849640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab241587e0 0x7fab10003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.628+0000 7fab2a04a640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab10004d00 0x7fab10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.628+0000 7fab29048640 1 -- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab241587e0 msgr2=0x7fab10003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.628+0000 7fab29048640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab241587e0 0x7fab10003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.628+0000 7fab29048640 1 -- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab10004d00 msgr2=0x7fab10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.628+0000 7fab29048640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab10004d00 0x7fab10005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.628+0000 7fab29048640 1 -- 172.21.15.17:0/2465116193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10003520 con 0x7fab10003ef0 2023-08-09T12:47:45.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.629+0000 7fab29048640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab10003ef0 0x7fab100047c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fab1400c240 tx=0x7fab100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d7cb191551e7f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.629+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1402cae0 con 0x7fab10003ef0 2023-08-09T12:47:45.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1402cc40 con 0x7fab10003ef0 2023-08-09T12:47:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab28847640 1 -- 172.21.15.17:0/2465116193 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14005af0 con 0x7fab10003ef0 2023-08-09T12:47:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab2a84b640 1 -- 172.21.15.17:0/2465116193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab10003ef0 msgr2=0x7fab100047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab2a84b640 1 --2- 172.21.15.17:0/2465116193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab10003ef0 0x7fab100047c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fab1400c240 tx=0x7fab100057f0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab2a04a640 1 -- 172.21.15.17:0/2465116193 reap_dead start 2023-08-09T12:47:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab2a84b640 1 -- 172.21.15.17:0/2465116193 shutdown_connections 2023-08-09T12:47:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab2a84b640 1 -- 172.21.15.17:0/2465116193 >> 172.21.15.17:0/2465116193 conn(0x7fab240b1d50 msgr2=0x7fab2406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab2a84b640 1 -- 172.21.15.17:0/2465116193 shutdown_connections 2023-08-09T12:47:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.630+0000 7fab2a84b640 1 -- 172.21.15.17:0/2465116193 wait complete. 2023-08-09T12:47:45.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.632+0000 7fab2a84b640 1 Processor -- start 2023-08-09T12:47:45.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.632+0000 7fab2a84b640 1 -- start start 2023-08-09T12:47:45.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.633+0000 7fab2a84b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab10003ef0 0x7fab240afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.633+0000 7fab2a84b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab240c7690 0x7fab240c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.633+0000 7fab2a84b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab240c7060 0x7fab240c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.633+0000 7fab2a84b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240c6ba0 con 0x7fab240c7060 2023-08-09T12:47:45.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.633+0000 7fab2a84b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240c6270 con 0x7fab240c7690 2023-08-09T12:47:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.633+0000 7fab2a84b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab240c6550 con 0x7fab10003ef0 2023-08-09T12:47:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab2a04a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab240c7060 0x7fab240c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab2a04a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab240c7060 0x7fab240c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59532/0 (socket says 172.21.15.17:59532) 2023-08-09T12:47:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab2a04a640 1 -- 172.21.15.17:0/4280241456 learned_addr learned my addr 172.21.15.17:0/4280241456 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab29048640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab240c7690 0x7fab240c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab29849640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab10003ef0 0x7fab240afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab2a04a640 1 -- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab10003ef0 msgr2=0x7fab240afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab2a04a640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab10003ef0 0x7fab240afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab2a04a640 1 -- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab240c7690 msgr2=0x7fab240c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab2a04a640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab240c7690 0x7fab240c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab2a04a640 1 -- 172.21.15.17:0/4280241456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab240c6830 con 0x7fab240c7060 2023-08-09T12:47:45.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.634+0000 7fab29849640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab10003ef0 0x7fab240afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:45.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.635+0000 7fab2a04a640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab240c7060 0x7fab240c8040 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fab240b4290 tx=0x7fab1c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.635+0000 7fab1a7fc640 1 -- 172.21.15.17:0/4280241456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c00e8a0 con 0x7fab240c7060 2023-08-09T12:47:45.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.635+0000 7fab1a7fc640 1 -- 172.21.15.17:0/4280241456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c00ea20 con 0x7fab240c7060 2023-08-09T12:47:45.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.635+0000 7fab2a84b640 1 -- 172.21.15.17:0/4280241456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab240c4cc0 con 0x7fab240c7060 2023-08-09T12:47:45.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.635+0000 7fab1a7fc640 1 -- 172.21.15.17:0/4280241456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c00edd0 con 0x7fab240c7060 2023-08-09T12:47:45.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.635+0000 7fab2a84b640 1 -- 172.21.15.17:0/4280241456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab240c3760 con 0x7fab240c7060 2023-08-09T12:47:45.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.637+0000 7fab1a7fc640 1 -- 172.21.15.17:0/4280241456 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab1c020410 con 0x7fab240c7060 2023-08-09T12:47:45.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.638+0000 7fab1a7fc640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab0806a050 0x7fab0806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.638+0000 7fab1a7fc640 1 -- 172.21.15.17:0/4280241456 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab1c087fe0 con 0x7fab240c7060 2023-08-09T12:47:45.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.639+0000 7fab29849640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab0806a050 0x7fab0806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.639+0000 7fab2e625740 1 Processor -- start 2023-08-09T12:47:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.639+0000 7fab2e625740 1 -- start start 2023-08-09T12:47:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.640+0000 7fab29849640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab0806a050 0x7fab0806c510 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fab200073e0 tx=0x7fab2000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.640+0000 7fab2e625740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 0x5599da38e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.640+0000 7fab2e625740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da35ddb0 0x5599da38b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.640+0000 7fab2e625740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da38b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.640+0000 7fab2e625740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599da2cf8f0 con 0x5599da3619b0 2023-08-09T12:47:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.640+0000 7fab2e625740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599da2ccfe0 con 0x5599da35ddb0 2023-08-09T12:47:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.640+0000 7fab2e625740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599da2c88d0 con 0x5599da38de30 2023-08-09T12:47:45.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da38b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da38b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59540/0 (socket says 172.21.15.17:59540) 2023-08-09T12:47:45.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 -- 172.21.15.17:0/3889441273 learned_addr learned my addr 172.21.15.17:0/3889441273 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:45.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab29048640 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da35ddb0 0x5599da38b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab29849640 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 0x5599da38e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 -- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 msgr2=0x5599da38e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 0x5599da38e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 -- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da35ddb0 msgr2=0x5599da38b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da35ddb0 0x5599da38b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 -- 172.21.15.17:0/3889441273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599da281ac0 con 0x5599da3619b0 2023-08-09T12:47:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab29048640 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da35ddb0 0x5599da38b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.641+0000 7fab2a04a640 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da38b5e0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fab1c05eaf0 tx=0x7fab1c05b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40b9dfc3d374a7c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab077fe640 1 -- 172.21.15.17:0/3889441273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c010070 con 0x5599da3619b0 2023-08-09T12:47:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab077fe640 1 -- 172.21.15.17:0/3889441273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c053990 con 0x5599da3619b0 2023-08-09T12:47:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab077fe640 1 -- 172.21.15.17:0/3889441273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c05ed90 con 0x5599da3619b0 2023-08-09T12:47:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 -- 172.21.15.17:0/3889441273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 msgr2=0x5599da38b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da38b5e0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fab1c05eaf0 tx=0x7fab1c05b040 comp rx=0 tx=0).stop 2023-08-09T12:47:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 -- 172.21.15.17:0/3889441273 shutdown_connections 2023-08-09T12:47:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da38b5e0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da35ddb0 0x5599da38b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 --2- 172.21.15.17:0/3889441273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 0x5599da38e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 -- 172.21.15.17:0/3889441273 >> 172.21.15.17:0/3889441273 conn(0x5599da3600c0 msgr2=0x5599da3a8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 -- 172.21.15.17:0/3889441273 shutdown_connections 2023-08-09T12:47:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.642+0000 7fab2e625740 1 -- 172.21.15.17:0/3889441273 wait complete. 2023-08-09T12:47:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.643+0000 7fab2e625740 1 -- start start 2023-08-09T12:47:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.643+0000 7fab2e625740 1 Processor -- start 2023-08-09T12:47:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.644+0000 7fab2e625740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 0x5599da3ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.644+0000 7fab2e625740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da3934e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.644+0000 7fab2e625740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da393a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.644+0000 7fab2e625740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599da268d40 con 0x5599da389b50 2023-08-09T12:47:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.644+0000 7fab2e625740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599da2689e0 con 0x5599da38de30 2023-08-09T12:47:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.644+0000 7fab2e625740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599da02ef20 con 0x5599da3619b0 2023-08-09T12:47:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.644+0000 7fab2e625740 10 client.0 _ll_register_callbacks cb 0x5599da281160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:47:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab2a04a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da393a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab2a04a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da393a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59544/0 (socket says 172.21.15.17:59544) 2023-08-09T12:47:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab2a04a640 1 -- 172.21.15.17:0/2478496860 learned_addr learned my addr 172.21.15.17:0/2478496860 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab29849640 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 0x5599da3ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab29048640 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da3934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab2a04a640 1 -- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 msgr2=0x5599da3ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab2a04a640 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 0x5599da3ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab2a04a640 1 -- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 msgr2=0x5599da3934e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab2a04a640 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da3934e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab2a04a640 1 -- 172.21.15.17:0/2478496860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab240c3760 con 0x5599da389b50 2023-08-09T12:47:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.645+0000 7fab29048640 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da3934e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab2a04a640 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da393a20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0571c0 tx=0x7fab1c06b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a179db4208856b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:47:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab04ff9640 1 -- 172.21.15.17:0/2478496860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c06e120 con 0x5599da389b50 2023-08-09T12:47:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab04ff9640 1 -- 172.21.15.17:0/2478496860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab1c000e40 con 0x5599da389b50 2023-08-09T12:47:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab2e625740 1 -- 172.21.15.17:0/2478496860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599da2a0500 con 0x5599da389b50 2023-08-09T12:47:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab04ff9640 1 -- 172.21.15.17:0/2478496860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab1c06e280 con 0x5599da389b50 2023-08-09T12:47:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab2e625740 10 client.8148 fetch_fsmap learned FSMap version 67 2023-08-09T12:47:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab2e625740 1 -- 172.21.15.17:0/2478496860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x5599da2c6f50 con 0x5599da389b50 2023-08-09T12:47:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.646+0000 7fab04ff9640 1 -- 172.21.15.17:0/2478496860 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5599da2a0500 con 0x5599da389b50 2023-08-09T12:47:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.647+0000 7fab04ff9640 1 -- 172.21.15.17:0/2478496860 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 67) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fab1c075020 con 0x5599da389b50 2023-08-09T12:47:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.647+0000 7fab2e625740 10 client.8148 fetch_fsmap finished waiting for FSMap version 67 2023-08-09T12:47:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.647+0000 7fab2e625740 10 client.8148 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:47:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.647+0000 7fab2e625740 20 client.8148 populate_metadata read hostname 'smithi017' 2023-08-09T12:47:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.647+0000 7fab2e625740 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] conn(0x5599da3956d0 0x5599da3c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.647+0000 7fab2e625740 4 client.8148 mds_command: new command op to 7992 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:47:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.647+0000 7fab2e625740 1 -- 172.21.15.17:0/2478496860 --> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599da29dbc0 con 0x5599da3956d0 2023-08-09T12:47:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.647+0000 7fab29849640 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] conn(0x5599da3956d0 0x5599da3c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.648+0000 7fab04ff9640 10 client.8148 ms_handle_connect on v2:172.21.15.17:6834/4116172429 2023-08-09T12:47:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.648+0000 7fab29849640 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] conn(0x5599da3956d0 0x5599da3c5f80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce3c4af2f7cb6747 server_cookie=23771738314f05dd in_seq=0 out_seq=0 2023-08-09T12:47:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.648+0000 7fab04ff9640 1 -- 172.21.15.17:0/2478496860 <== mds.0 v2:172.21.15.17:6834/4116172429 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5599da29dbc0 con 0x5599da3956d0 2023-08-09T12:47:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.648+0000 7fab04ff9640 10 client.8148 handle_command_reply: tid=0 2023-08-09T12:47:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.648+0000 7fab2e625740 1 client.8148 shutdown 2023-08-09T12:47:45.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 -- 172.21.15.17:0/2478496860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 msgr2=0x5599da393a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da393a20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0571c0 tx=0x7fab1c06b000 comp rx=0 tx=0).stop 2023-08-09T12:47:45.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 -- 172.21.15.17:0/2478496860 shutdown_connections 2023-08-09T12:47:45.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] conn(0x5599da3956d0 0x5599da3c5f80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da393a20 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da3934e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 --2- 172.21.15.17:0/2478496860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 0x5599da3ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 -- 172.21.15.17:0/2478496860 >> 172.21.15.17:0/2478496860 conn(0x5599da35ddb0 msgr2=0x5599da3919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:45.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab04ff9640 0 client.8148 ms_handle_reset on v2:172.21.15.17:6834/4116172429 2023-08-09T12:47:45.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 -- 172.21.15.17:0/2478496860 shutdown_connections 2023-08-09T12:47:45.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 1 -- 172.21.15.17:0/2478496860 wait complete. 2023-08-09T12:47:45.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.649+0000 7fab2e625740 20 client.8148 trim_cache size 0 max 16384 2023-08-09T12:47:45.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.666+0000 7fab2e625740 1 Processor -- start 2023-08-09T12:47:45.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.666+0000 7fab2e625740 1 -- start start 2023-08-09T12:47:45.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.667+0000 7fab2e625740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 0x5599da3ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.667+0000 7fab2e625740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da4099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.667+0000 7fab2e625740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da409ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.667+0000 7fab2e625740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599da38ff80 con 0x5599da389b50 2023-08-09T12:47:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.667+0000 7fab2e625740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599da359780 con 0x5599da38de30 2023-08-09T12:47:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.667+0000 7fab2e625740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599da3ac630 con 0x5599da3619b0 2023-08-09T12:47:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29048640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da4099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29048640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da4099b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59558/0 (socket says 172.21.15.17:59558) 2023-08-09T12:47:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29048640 1 -- 172.21.15.17:0/3670615557 learned_addr learned my addr 172.21.15.17:0/3670615557 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29849640 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 0x5599da3ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab2a04a640 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da409ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29048640 1 -- 172.21.15.17:0/3670615557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 msgr2=0x5599da3ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29048640 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 0x5599da3ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29048640 1 -- 172.21.15.17:0/3670615557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 msgr2=0x5599da409ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29048640 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da409ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.668+0000 7fab29048640 1 -- 172.21.15.17:0/3670615557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599da2fa300 con 0x5599da389b50 2023-08-09T12:47:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.669+0000 7fab29048640 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da4099b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fab1402c4e0 tx=0x7fab1402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2d2f5f5a4ee3d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.669+0000 7fab07fff640 1 -- 172.21.15.17:0/3670615557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1402cae0 con 0x5599da389b50 2023-08-09T12:47:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.669+0000 7fab07fff640 1 -- 172.21.15.17:0/3670615557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1402de40 con 0x5599da389b50 2023-08-09T12:47:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.669+0000 7fab07fff640 1 -- 172.21.15.17:0/3670615557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14001650 con 0x5599da389b50 2023-08-09T12:47:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 -- 172.21.15.17:0/3670615557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 msgr2=0x5599da4099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da4099b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fab1402c4e0 tx=0x7fab1402e000 comp rx=0 tx=0).stop 2023-08-09T12:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 -- 172.21.15.17:0/3670615557 shutdown_connections 2023-08-09T12:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da38de30 0x5599da409ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da389b50 0x5599da4099b0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 --2- 172.21.15.17:0/3670615557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da3619b0 0x5599da3ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 -- 172.21.15.17:0/3670615557 >> 172.21.15.17:0/3670615557 conn(0x5599da35ddb0 msgr2=0x5599da35ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 -- 172.21.15.17:0/3670615557 shutdown_connections 2023-08-09T12:47:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.670+0000 7fab2e625740 1 -- 172.21.15.17:0/3670615557 wait complete. 2023-08-09T12:47:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.671+0000 7fab2e625740 1 -- start start 2023-08-09T12:47:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.671+0000 7fab2e625740 1 Processor -- start 2023-08-09T12:47:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab2e625740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da408dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab2e625740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 0x5599da3be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab2e625740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da3900d0 0x5599da3be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab2e625740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599da409660 con 0x5599da3619b0 2023-08-09T12:47:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab2e625740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599da409800 con 0x5599da3900d0 2023-08-09T12:47:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab2e625740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599da3875a0 con 0x5599da38de30 2023-08-09T12:47:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab2e625740 10 client.0 _ll_register_callbacks cb 0x7fab1c056cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:47:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab29849640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da408dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.672+0000 7fab29849640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da408dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59562/0 (socket says 172.21.15.17:59562) 2023-08-09T12:47:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab29849640 1 -- 172.21.15.17:0/717840187 learned_addr learned my addr 172.21.15.17:0/717840187 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab29048640 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 0x5599da3be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab29849640 1 -- 172.21.15.17:0/717840187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 msgr2=0x5599da3be4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab29849640 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 0x5599da3be4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab29849640 1 -- 172.21.15.17:0/717840187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da3900d0 msgr2=0x5599da3be9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab29849640 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da3900d0 0x5599da3be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab29849640 1 -- 172.21.15.17:0/717840187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab10003520 con 0x5599da3619b0 2023-08-09T12:47:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab29849640 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da408dd0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fab20028350 tx=0x7fab2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b7402b2acf8c8d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.673+0000 7fab04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:47:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab04ff9640 1 -- 172.21.15.17:0/717840187 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20017c10 con 0x5599da3619b0 2023-08-09T12:47:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 1 -- 172.21.15.17:0/717840187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599da2f0800 con 0x5599da3619b0 2023-08-09T12:47:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab04ff9640 1 -- 172.21.15.17:0/717840187 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab20017d70 con 0x5599da3619b0 2023-08-09T12:47:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab04ff9640 1 -- 172.21.15.17:0/717840187 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab20031440 con 0x5599da3619b0 2023-08-09T12:47:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 10 client.8154 fetch_fsmap learned FSMap version 67 2023-08-09T12:47:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 1 -- 172.21.15.17:0/717840187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x5599da396cb0 con 0x5599da3619b0 2023-08-09T12:47:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab04ff9640 1 -- 172.21.15.17:0/717840187 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5599da2f0800 con 0x5599da3619b0 2023-08-09T12:47:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab04ff9640 1 -- 172.21.15.17:0/717840187 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 67) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fab20022040 con 0x5599da3619b0 2023-08-09T12:47:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 10 client.8154 fetch_fsmap finished waiting for FSMap version 67 2023-08-09T12:47:45.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 10 client.8154 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:47:45.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 20 client.8154 populate_metadata read hostname 'smithi017' 2023-08-09T12:47:45.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] conn(0x5599da3c10a0 0x5599da388480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 4 client.8154 mds_command: new command op to 7992 tid=0[{"prefix": "status"}] 2023-08-09T12:47:45.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.674+0000 7fab2e625740 1 -- 172.21.15.17:0/717840187 --> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5599da2c18b0 con 0x5599da3c10a0 2023-08-09T12:47:45.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.675+0000 7fab29048640 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] conn(0x5599da3c10a0 0x5599da388480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.675+0000 7fab29048640 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] conn(0x5599da3c10a0 0x5599da388480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d987763b32ac0f52 server_cookie=a81830ddf80273c9 in_seq=0 out_seq=0 2023-08-09T12:47:45.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.675+0000 7fab04ff9640 10 client.8154 ms_handle_connect on v2:172.21.15.17:6834/4116172429 2023-08-09T12:47:45.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab04ff9640 1 -- 172.21.15.17:0/717840187 <== mds.0 v2:172.21.15.17:6834/4116172429 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x5599da2c18b0 con 0x5599da3c10a0 2023-08-09T12:47:45.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab04ff9640 10 client.8154 handle_command_reply: tid=0 2023-08-09T12:47:45.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 client.8154 shutdown 2023-08-09T12:47:45.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 -- 172.21.15.17:0/717840187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 msgr2=0x5599da408dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da408dd0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fab20028350 tx=0x7fab2000b040 comp rx=0 tx=0).stop 2023-08-09T12:47:45.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 -- 172.21.15.17:0/717840187 shutdown_connections 2023-08-09T12:47:45.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5599da3900d0 0x5599da3be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5599da38de30 0x5599da3be4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.17:6834/4116172429,v1:172.21.15.17:6835/4116172429] conn(0x5599da3c10a0 0x5599da388480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 --2- 172.21.15.17:0/717840187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599da3619b0 0x5599da408dd0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 -- 172.21.15.17:0/717840187 >> 172.21.15.17:0/717840187 conn(0x5599da35ddb0 msgr2=0x5599da35cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab04ff9640 0 client.8154 ms_handle_reset on v2:172.21.15.17:6834/4116172429 2023-08-09T12:47:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 -- 172.21.15.17:0/717840187 shutdown_connections 2023-08-09T12:47:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 1 -- 172.21.15.17:0/717840187 wait complete. 2023-08-09T12:47:45.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.676+0000 7fab2e625740 20 client.8154 trim_cache size 0 max 16384 2023-08-09T12:47:45.689 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:47:45.689 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:47:45.689 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:47:45.690 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7992, 2023-08-09T12:47:45.690 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:47:45.690 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:47:45.690 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:47:45.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 7.08783998, 2023-08-09T12:47:45.690 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 67, 2023-08-09T12:47:45.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 146, 2023-08-09T12:47:45.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 146, 2023-08-09T12:47:45.691 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 13.008518935 2023-08-09T12:47:45.691 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:47:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 -- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab0806a050 msgr2=0x7fab0806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab0806a050 0x7fab0806c510 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fab200073e0 tx=0x7fab2000d040 comp rx=0 tx=0).stop 2023-08-09T12:47:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 -- 172.21.15.17:0/4280241456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab240c7060 msgr2=0x7fab240c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab240c7060 0x7fab240c8040 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fab240b4290 tx=0x7fab1c010c20 comp rx=0 tx=0).stop 2023-08-09T12:47:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 -- 172.21.15.17:0/4280241456 shutdown_connections 2023-08-09T12:47:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab0806a050 0x7fab0806c510 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab240c7060 0x7fab240c8040 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab240c7690 0x7fab240c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 --2- 172.21.15.17:0/4280241456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab10003ef0 0x7fab240afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 -- 172.21.15.17:0/4280241456 >> 172.21.15.17:0/4280241456 conn(0x7fab240b1d50 msgr2=0x7fab2406e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 -- 172.21.15.17:0/4280241456 shutdown_connections 2023-08-09T12:47:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.677+0000 7fab2a84b640 1 -- 172.21.15.17:0/4280241456 wait complete. 2023-08-09T12:47:45.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:47:45.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.934+0000 7fc3b89b5640 1 Processor -- start 2023-08-09T12:47:45.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.934+0000 7fc3b89b5640 1 -- start start 2023-08-09T12:47:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.935+0000 7fc3b89b5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc3b41616e0 0x7fc3b40b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.935+0000 7fc3b89b5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b40cdd10 con 0x7fc3b40d29d0 2023-08-09T12:47:45.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.935+0000 7fc3b89b5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b40cdff0 con 0x7fc3b415ce90 2023-08-09T12:47:45.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.935+0000 7fc3b89b5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40b6540 con 0x7fc3b41616e0 2023-08-09T12:47:45.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.936+0000 7fc3b2d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc3b40d29d0 0x7fc3b40d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33228/0 (socket says 172.21.15.17:33228) 2023-08-09T12:47:45.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.936+0000 7fc3b2d9d640 1 -- 172.21.15.17:0/3030324947 learned_addr learned my addr 172.21.15.17:0/3030324947 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:45.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.936+0000 7fc3b1d9b640 1 --2- 172.21.15.17:0/3030324947 >> v2:172.21.15.142:3300/0 conn(0x7fc3b41616e0 0x7fc3b40b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.937+0000 7fc3b159a640 1 -- 172.21.15.17:0/3030324947 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18375237 0 0) 0x7fc3b40cdd10 con 0x7fc3b40d29d0 2023-08-09T12:47:45.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.937+0000 7fc3b159a640 1 -- 172.21.15.17:0/3030324947 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc39c003520 con 0x7fc3b40d29d0 2023-08-09T12:47:45.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.937+0000 7fc3b159a640 1 -- 172.21.15.17:0/3030324947 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75589566 0 0) 0x7fc3b40cdff0 con 0x7fc3b415ce90 2023-08-09T12:47:45.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.937+0000 7fc3b159a640 1 -- 172.21.15.17:0/3030324947 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b40cdd10 con 0x7fc3b415ce90 2023-08-09T12:47:45.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.937+0000 7fc3b1d9b640 1 -- 172.21.15.17:0/3030324947 >> v1:172.21.15.142:6789/0 conn(0x7fc3b415ce90 legacy=0x7fc3b40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.937+0000 7fc3b159a640 1 -- 172.21.15.17:0/3030324947 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 149658113 0 0) 0x7fc39c003520 con 0x7fc3b40d29d0 2023-08-09T12:47:45.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.937+0000 7fc3b1d9b640 1 -- 172.21.15.17:0/3030324947 >> v1:172.21.15.17:6789/0 conn(0x7fc3b40d29d0 legacy=0x7fc3b40d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.937+0000 7fc3b1d9b640 1 -- 172.21.15.17:0/3030324947 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40ce2d0 con 0x7fc3b41616e0 2023-08-09T12:47:45.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.939+0000 7fc3b1d9b640 1 --2- 172.21.15.17:0/3030324947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 0x7fc3b40b6000 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80097a0 tx=0x7fc3a802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d30322d79c3137 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.939+0000 7fc3b159a640 1 -- 172.21.15.17:0/3030324947 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a802f050 con 0x7fc3b41616e0 2023-08-09T12:47:45.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.939+0000 7fc3b159a640 1 -- 172.21.15.17:0/3030324947 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a8031500 con 0x7fc3b41616e0 2023-08-09T12:47:45.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.939+0000 7fc3b159a640 1 -- 172.21.15.17:0/3030324947 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac001670 con 0x7fc3b41616e0 2023-08-09T12:47:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.940+0000 7fc3b89b5640 1 -- 172.21.15.17:0/3030324947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 msgr2=0x7fc3b40b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.940+0000 7fc3b89b5640 1 --2- 172.21.15.17:0/3030324947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 0x7fc3b40b6000 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80097a0 tx=0x7fc3a802b820 comp rx=0 tx=0).stop 2023-08-09T12:47:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.940+0000 7fc3b89b5640 1 -- 172.21.15.17:0/3030324947 shutdown_connections 2023-08-09T12:47:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.940+0000 7fc3b89b5640 1 --2- 172.21.15.17:0/3030324947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 0x7fc3b40b6000 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.940+0000 7fc3b89b5640 1 -- 172.21.15.17:0/3030324947 >> 172.21.15.17:0/3030324947 conn(0x7fc3b406fde0 msgr2=0x7fc3b40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.940+0000 7fc3b89b5640 1 -- 172.21.15.17:0/3030324947 shutdown_connections 2023-08-09T12:47:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.940+0000 7fc3b89b5640 1 -- 172.21.15.17:0/3030324947 wait complete. 2023-08-09T12:47:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.942+0000 7fc3b89b5640 1 Processor -- start 2023-08-09T12:47:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.942+0000 7fc3b89b5640 1 -- start start 2023-08-09T12:47:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.943+0000 7fc3b89b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40d29d0 0x7fc3b4151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.943+0000 7fc3b89b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b415ce90 0x7fc3b40b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.943+0000 7fc3b89b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 0x7fc3b40b8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.943+0000 7fc3b89b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b41516d0 con 0x7fc3b415ce90 2023-08-09T12:47:45.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.943+0000 7fc3b89b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b41f6050 con 0x7fc3b41616e0 2023-08-09T12:47:45.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.943+0000 7fc3b89b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b41f6330 con 0x7fc3b40d29d0 2023-08-09T12:47:45.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.943+0000 7fc3b1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b415ce90 0x7fc3b40b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b415ce90 0x7fc3b40b7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59564/0 (socket says 172.21.15.17:59564) 2023-08-09T12:47:45.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b1d9b640 1 -- 172.21.15.17:0/1812254654 learned_addr learned my addr 172.21.15.17:0/1812254654 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b259c640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40d29d0 0x7fc3b4151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b1d9b640 1 -- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40d29d0 msgr2=0x7fc3b4151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b2d9d640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 0x7fc3b40b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b1d9b640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40d29d0 0x7fc3b4151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b1d9b640 1 -- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 msgr2=0x7fc3b40b8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b1d9b640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 0x7fc3b40b8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b1d9b640 1 -- 172.21.15.17:0/1812254654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8009400 con 0x7fc3b415ce90 2023-08-09T12:47:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b2d9d640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 0x7fc3b40b8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.944+0000 7fc3b1d9b640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b415ce90 0x7fc3b40b7af0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8036040 tx=0x7fc3a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.945+0000 7fc3a2ffd640 1 -- 172.21.15.17:0/1812254654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a803c8d0 con 0x7fc3b415ce90 2023-08-09T12:47:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.945+0000 7fc3a2ffd640 1 -- 172.21.15.17:0/1812254654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a803ca30 con 0x7fc3b415ce90 2023-08-09T12:47:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.945+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b41f6610 con 0x7fc3b415ce90 2023-08-09T12:47:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.945+0000 7fc3a2ffd640 1 -- 172.21.15.17:0/1812254654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a803cdc0 con 0x7fc3b415ce90 2023-08-09T12:47:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.945+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b41f6bd0 con 0x7fc3b415ce90 2023-08-09T12:47:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.946+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b41f6dc0 con 0x7fc3b415ce90 2023-08-09T12:47:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.947+0000 7fc3a2ffd640 1 -- 172.21.15.17:0/1812254654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc3a803a040 con 0x7fc3b415ce90 2023-08-09T12:47:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.948+0000 7fc3a2ffd640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:45.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.948+0000 7fc3a2ffd640 1 -- 172.21.15.17:0/1812254654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3a80a9e50 con 0x7fc3b415ce90 2023-08-09T12:47:45.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.949+0000 7fc3b259c640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:45.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.950+0000 7fc3b259c640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4001560 tx=0x7fc3a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:45.953+0000 7fc3a2ffd640 1 -- 172.21.15.17:0/1812254654 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc3a8075420 con 0x7fc3b415ce90 2023-08-09T12:47:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.185+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc3b4067a80 con 0x7fc3b415ce90 2023-08-09T12:47:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.186+0000 7fc3a2ffd640 1 -- 172.21.15.17:0/1812254654 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc3a8078a40 con 0x7fc3b415ce90 2023-08-09T12:47:46.190 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:47:46.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 msgr2=0x7fc39406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:46.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4001560 tx=0x7fc3a4009040 comp rx=0 tx=0).stop 2023-08-09T12:47:46.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b415ce90 msgr2=0x7fc3b40b7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:46.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b415ce90 0x7fc3b40b7af0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8036040 tx=0x7fc3a80046c0 comp rx=0 tx=0).stop 2023-08-09T12:47:46.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 shutdown_connections 2023-08-09T12:47:46.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc39406a050 0x7fc39406c510 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:46.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b41616e0 0x7fc3b40b8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:46.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3b415ce90 0x7fc3b40b7af0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:46.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 --2- 172.21.15.17:0/1812254654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3b40d29d0 0x7fc3b4151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:46.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 >> 172.21.15.17:0/1812254654 conn(0x7fc3b406fde0 msgr2=0x7fc3b40b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:46.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 shutdown_connections 2023-08-09T12:47:46.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:46.189+0000 7fc3b89b5640 1 -- 172.21.15.17:0/1812254654 wait complete. 2023-08-09T12:47:46.214 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:47:46.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:47:46.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:47:46.215 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:47:46.216 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:46.216 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:47:46.216 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:47:46.217 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:47:46.217 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:47:46.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:46.218 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:47:46.274 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:47:46.275 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:47:46.275 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:47:46.275 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:46.275 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:47:46.275 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:46.275 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:46.275 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:46.276 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:47:46.276 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:46.276 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:46.276 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:47:46.276 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:47:46.276 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:46.276 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:47:46.277 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:47:46.277 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41714sec preferred_lft 41714sec 2023-08-09T12:47:46.277 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:47:46.277 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:46.277 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:46.277 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:46.277 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:47:46.278 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:47:46.278 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:46.278 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:47:46.278 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:46.278 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:47:46.278 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:46.278 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:47:46.279 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:47:46.279 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:47:46.279 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:46.279 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:47:46.279 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:47:46.279 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:47:46.280 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:46.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:46.282 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:47:46.381 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:47:46.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:46.386 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:47:46.447 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:47:46.447 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:47:46.447 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:47:46.448 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:47:46.448 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:47:46.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:46.449 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:47:46.449 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:47:46.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:47:46.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:47:46.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:47:46.450 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:47:46.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:46.663 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:47:46.722 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:47:46.722 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:47:46.723 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:47:46.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:46.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:47:46.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:47:46.828 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:46.886 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:47:46.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:47:46.887 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:46.940 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:47:46.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:46.942 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:47:47.098 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:47:47.099 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:47:47.099 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:47:47.122 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:47:47.122 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:47:47.122 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:47:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:47:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:47:47.148 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:47:47.149 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:47:47.149 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:47:47.149 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:47:47.149 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:47:47.149 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:47:47.150 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:47:47.150 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:47:47.153 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:47:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:47:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:47:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:47:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:47:47.157 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:47:47.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:47.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:47:47.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:47.255 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:47:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:client5816 2023-08-09T12:47:47.330 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:47.330 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:47.390 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:47:47.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.616+0000 7f0a7c70e640 1 Processor -- start 2023-08-09T12:47:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.616+0000 7f0a7c70e640 1 -- start start 2023-08-09T12:47:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a7c70e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a740adc40 0x7f0a7406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a7c70e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a740b3b40 0x7f0a740b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a7c70e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7415e8f0 0x7f0a7415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a7c70e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740ae020 con 0x7f0a740b3b40 2023-08-09T12:47:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a7c70e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740b2250 con 0x7f0a740adc40 2023-08-09T12:47:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a7c70e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740b2530 con 0x7f0a7415e8f0 2023-08-09T12:47:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a79ca9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a740b3b40 0x7f0a740b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a79ca9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a740b3b40 0x7f0a740b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59566/0 (socket says 172.21.15.17:59566) 2023-08-09T12:47:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.618+0000 7f0a79ca9640 1 -- 172.21.15.17:0/3189066135 learned_addr learned my addr 172.21.15.17:0/3189066135 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.619+0000 7f0a7a4aa640 1 --2- 172.21.15.17:0/3189066135 >> v2:172.21.15.142:3300/0 conn(0x7f0a740adc40 0x7f0a7406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.619+0000 7f0a7acab640 1 --2- 172.21.15.17:0/3189066135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7415e8f0 0x7f0a7415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.619+0000 7f0a79ca9640 1 -- 172.21.15.17:0/3189066135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7415e8f0 msgr2=0x7f0a7415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.619+0000 7f0a79ca9640 1 --2- 172.21.15.17:0/3189066135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7415e8f0 0x7f0a7415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.619+0000 7f0a79ca9640 1 -- 172.21.15.17:0/3189066135 >> v2:172.21.15.142:3300/0 conn(0x7f0a740adc40 msgr2=0x7f0a7406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.619+0000 7f0a79ca9640 1 --2- 172.21.15.17:0/3189066135 >> v2:172.21.15.142:3300/0 conn(0x7f0a740adc40 0x7f0a7406c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.619+0000 7f0a79ca9640 1 -- 172.21.15.17:0/3189066135 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7406fe80 con 0x7f0a740b3b40 2023-08-09T12:47:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.619+0000 7f0a7acab640 1 --2- 172.21.15.17:0/3189066135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7415e8f0 0x7f0a7415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.620+0000 7f0a79ca9640 1 --2- 172.21.15.17:0/3189066135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a740b3b40 0x7f0a740b3fd0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b1320 tx=0x7f0a6402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a643396075e60bc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a794a8640 1 -- 172.21.15.17:0/3189066135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64004230 con 0x7f0a740b3b40 2023-08-09T12:47:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a794a8640 1 -- 172.21.15.17:0/3189066135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64004390 con 0x7f0a740b3b40 2023-08-09T12:47:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a794a8640 1 -- 172.21.15.17:0/3189066135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64003810 con 0x7f0a740b3b40 2023-08-09T12:47:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a7c70e640 1 -- 172.21.15.17:0/3189066135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a740b3b40 msgr2=0x7f0a740b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/3189066135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a740b3b40 0x7f0a740b3fd0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b1320 tx=0x7f0a6402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a7c70e640 1 -- 172.21.15.17:0/3189066135 shutdown_connections 2023-08-09T12:47:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/3189066135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7415e8f0 0x7f0a7415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/3189066135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a740b3b40 0x7f0a740b3fd0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/3189066135 >> v2:172.21.15.142:3300/0 conn(0x7f0a740adc40 0x7f0a7406c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.621+0000 7f0a7c70e640 1 -- 172.21.15.17:0/3189066135 >> 172.21.15.17:0/3189066135 conn(0x7f0a740cb1b0 msgr2=0x7f0a740cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:47.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.622+0000 7f0a7c70e640 1 -- 172.21.15.17:0/3189066135 shutdown_connections 2023-08-09T12:47:47.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.622+0000 7f0a7c70e640 1 -- 172.21.15.17:0/3189066135 wait complete. 2023-08-09T12:47:47.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.623+0000 7f0a7c70e640 1 Processor -- start 2023-08-09T12:47:47.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.624+0000 7f0a7c70e640 1 -- start start 2023-08-09T12:47:47.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7c70e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a740adc40 0x7f0a741f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:47.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7c70e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a740b3b40 0x7f0a74142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:47.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7c70e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a7415e8f0 0x7f0a74140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:47.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7c70e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74158950 con 0x7f0a7415e8f0 2023-08-09T12:47:47.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7c70e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74143d80 con 0x7f0a740adc40 2023-08-09T12:47:47.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7c70e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a741437c0 con 0x7f0a740b3b40 2023-08-09T12:47:47.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7acab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a7415e8f0 0x7f0a74140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:47.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7acab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a7415e8f0 0x7f0a74140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59574/0 (socket says 172.21.15.17:59574) 2023-08-09T12:47:47.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7acab640 1 -- 172.21.15.17:0/319346016 learned_addr learned my addr 172.21.15.17:0/319346016 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:47.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a7a4aa640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a740adc40 0x7f0a741f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:47.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.625+0000 7f0a79ca9640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a740b3b40 0x7f0a74142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:47.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a7acab640 1 -- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a740b3b40 msgr2=0x7f0a74142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:47.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a7acab640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a740b3b40 0x7f0a74142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a7acab640 1 -- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a740adc40 msgr2=0x7f0a741f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:47.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a7acab640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a740adc40 0x7f0a741f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a7acab640 1 -- 172.21.15.17:0/319346016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009460 con 0x7f0a7415e8f0 2023-08-09T12:47:47.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a7acab640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a7415e8f0 0x7f0a74140dc0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00cd50 tx=0x7f0a6c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:47.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a6affd640 1 -- 172.21.15.17:0/319346016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00f680 con 0x7f0a7415e8f0 2023-08-09T12:47:47.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a6affd640 1 -- 172.21.15.17:0/319346016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00f800 con 0x7f0a7415e8f0 2023-08-09T12:47:47.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a6affd640 1 -- 172.21.15.17:0/319346016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00fbb0 con 0x7f0a7415e8f0 2023-08-09T12:47:47.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.626+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a74143aa0 con 0x7f0a7415e8f0 2023-08-09T12:47:47.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.627+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a74158e60 con 0x7f0a7415e8f0 2023-08-09T12:47:47.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.628+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a74159080 con 0x7f0a7415e8f0 2023-08-09T12:47:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.629+0000 7f0a6affd640 1 -- 172.21.15.17:0/319346016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a6c00b040 con 0x7f0a7415e8f0 2023-08-09T12:47:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.630+0000 7f0a6affd640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a5806a050 0x7f0a5806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.630+0000 7f0a6affd640 1 -- 172.21.15.17:0/319346016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a6c088fe0 con 0x7f0a7415e8f0 2023-08-09T12:47:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.630+0000 7f0a7a4aa640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a5806a050 0x7f0a5806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.631+0000 7f0a7a4aa640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a5806a050 0x7f0a5806c510 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006fd0 tx=0x7f0a70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.634+0000 7f0a6affd640 1 -- 172.21.15.17:0/319346016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0a6c0546d0 con 0x7f0a7415e8f0 2023-08-09T12:47:47.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.867+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a74067a80 con 0x7f0a7415e8f0 2023-08-09T12:47:47.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.868+0000 7f0a6affd640 1 -- 172.21.15.17:0/319346016 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0a6c01d070 con 0x7f0a7415e8f0 2023-08-09T12:47:47.871 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:47:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.870+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a5806a050 msgr2=0x7f0a5806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.870+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a5806a050 0x7f0a5806c510 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006fd0 tx=0x7f0a70008040 comp rx=0 tx=0).stop 2023-08-09T12:47:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.870+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a7415e8f0 msgr2=0x7f0a74140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.870+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a7415e8f0 0x7f0a74140dc0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00cd50 tx=0x7f0a6c00a650 comp rx=0 tx=0).stop 2023-08-09T12:47:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.871+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 shutdown_connections 2023-08-09T12:47:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.871+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a5806a050 0x7f0a5806c510 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.871+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a7415e8f0 0x7f0a74140dc0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.871+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a740b3b40 0x7f0a74142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.871+0000 7f0a7c70e640 1 --2- 172.21.15.17:0/319346016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a740adc40 0x7f0a741f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.871+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 >> 172.21.15.17:0/319346016 conn(0x7f0a740cb1b0 msgr2=0x7f0a7415da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.871+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 shutdown_connections 2023-08-09T12:47:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:47.871+0000 7f0a7c70e640 1 -- 172.21.15.17:0/319346016 wait complete. 2023-08-09T12:47:47.894 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:47:47.895 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:47:47.895 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:47:47.895 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:47:47.896 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:47.896 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:47:47.897 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:47:47.897 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:47:47.897 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:47:47.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:47.898 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:47:47.956 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:47:47.956 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:47:47.956 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:47:47.957 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:47.957 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:47:47.958 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:47.958 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:47.958 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:47.958 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:47:47.959 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:47.959 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:47.959 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:47:47.959 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:47:47.959 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:47.959 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:47:47.959 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:47.960 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:47:47.960 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41700sec preferred_lft 41700sec 2023-08-09T12:47:47.960 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:47:47.960 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:47.960 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:47:47.960 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:47:47.960 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:47:47.961 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:47.961 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:47:47.961 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:47.961 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:47:47.961 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:47:47.961 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:47:47.961 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:47.961 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:47:47.962 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:47:47.962 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:47:47.962 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:47:47.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:47.963 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:47:48.055 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:47:48.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:48.060 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:47:48.112 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:47:48.112 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:47:48.113 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:47:48.113 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:47:48.113 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:47:48.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:48.114 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:47:48.115 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:47:48.115 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:47:48.115 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:47:48.116 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:47:48.116 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:47:48.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:48.303 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:47:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:47:48.356 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:47:48.358 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:47:48.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:48.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:47:48.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:47:48.448 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:48.503 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:47:48.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:47:48.504 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:48.556 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:47:48.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:48.557 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:47:48.696 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:47:48.697 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:47:48.697 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:47:48.716 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:47:48.716 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:47:48.717 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:47:48.717 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:47:48.717 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:47:48.742 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:47:48.742 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:47:48.743 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:47:48.743 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:47:48.743 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:47:48.743 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:47:48.743 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:47:48.743 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:47:48.745 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:47:48.745 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:47:48.746 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:47:48.746 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:47:48.746 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:47:48.749 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:47:48.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:48.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:47:48.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:48.843 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:47:48.899 INFO:teuthology.orchestra.run.smithi142.stdout:client8169 2023-08-09T12:47:48.900 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:47:48.900 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:48.953 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:47:49.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.188+0000 7f0fc520a640 1 Processor -- start 2023-08-09T12:47:49.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.188+0000 7f0fc520a640 1 -- start start 2023-08-09T12:47:49.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.189+0000 7f0fc520a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fc0160030 0x7f0fc0160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.189+0000 7f0fc520a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.189+0000 7f0fc520a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00b5a30 con 0x7f0fc00b86e0 2023-08-09T12:47:49.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.189+0000 7f0fc520a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc00d1110 con 0x7f0fc0160030 2023-08-09T12:47:49.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.189+0000 7f0fc520a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00ceac0 con 0x7f0fc00cfb50 2023-08-09T12:47:49.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.190+0000 7f0fc4a09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.190+0000 7f0fbffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fc0160030 0x7f0fc0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.190+0000 7f0fbffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fc0160030 0x7f0fc0160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:40182/0 (socket says 172.21.15.17:40182) 2023-08-09T12:47:49.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.190+0000 7f0fbffff640 1 -- 172.21.15.17:0/3649599543 learned_addr learned my addr 172.21.15.17:0/3649599543 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:49.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.191+0000 7f0fbffff640 1 -- 172.21.15.17:0/3649599543 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 msgr2=0x7f0fc00d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:49.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.191+0000 7f0fbffff640 1 --2- 172.21.15.17:0/3649599543 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.191+0000 7f0fbffff640 1 -- 172.21.15.17:0/3649599543 >> v1:172.21.15.142:6789/0 conn(0x7f0fc00b86e0 legacy=0x7f0fc00cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.191+0000 7f0fbffff640 1 -- 172.21.15.17:0/3649599543 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00d0d70 con 0x7f0fc0160030 2023-08-09T12:47:49.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.192+0000 7f0fbffff640 1 --2- 172.21.15.17:0/3649599543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 0x7f0fc0160740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009e50 tx=0x7f0fb002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f85fca35d02de684 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:49.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.192+0000 7f0fbeffd640 1 -- 172.21.15.17:0/3649599543 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb002cb00 con 0x7f0fc0160030 2023-08-09T12:47:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.192+0000 7f0fbeffd640 1 -- 172.21.15.17:0/3649599543 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb002cc60 con 0x7f0fc0160030 2023-08-09T12:47:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.193+0000 7f0fbeffd640 1 -- 172.21.15.17:0/3649599543 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00343f0 con 0x7f0fc0160030 2023-08-09T12:47:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.193+0000 7f0fc520a640 1 -- 172.21.15.17:0/3649599543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 msgr2=0x7f0fc0160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.193+0000 7f0fc520a640 1 --2- 172.21.15.17:0/3649599543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 0x7f0fc0160740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009e50 tx=0x7f0fb002bf60 comp rx=0 tx=0).stop 2023-08-09T12:47:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.194+0000 7f0fc520a640 1 -- 172.21.15.17:0/3649599543 shutdown_connections 2023-08-09T12:47:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.194+0000 7f0fc520a640 1 --2- 172.21.15.17:0/3649599543 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.194+0000 7f0fc520a640 1 --2- 172.21.15.17:0/3649599543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 0x7f0fc0160740 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.194+0000 7f0fc520a640 1 -- 172.21.15.17:0/3649599543 >> 172.21.15.17:0/3649599543 conn(0x7f0fc00697c0 msgr2=0x7f0fc0069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.194+0000 7f0fc520a640 1 -- 172.21.15.17:0/3649599543 shutdown_connections 2023-08-09T12:47:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.194+0000 7f0fc520a640 1 -- 172.21.15.17:0/3649599543 wait complete. 2023-08-09T12:47:49.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.195+0000 7f0fc520a640 1 Processor -- start 2023-08-09T12:47:49.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.196+0000 7f0fc520a640 1 -- start start 2023-08-09T12:47:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.196+0000 7f0fc520a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fc00b86e0 0x7f0fc0148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fc520a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fc520a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 0x7f0fc00c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fc520a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01f2430 con 0x7f0fc00b86e0 2023-08-09T12:47:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fc520a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01f2710 con 0x7f0fc0160030 2023-08-09T12:47:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fc520a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01f29f0 con 0x7f0fc00cfb50 2023-08-09T12:47:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fc00b86e0 0x7f0fc0148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fc00b86e0 0x7f0fc0148d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54344/0 (socket says 172.21.15.17:54344) 2023-08-09T12:47:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbffff640 1 -- 172.21.15.17:0/557706839 learned_addr learned my addr 172.21.15.17:0/557706839 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbf7fe640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fc4a09640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 0x7f0fc00c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbffff640 1 -- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 msgr2=0x7f0fc00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbffff640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbffff640 1 -- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 msgr2=0x7f0fc00c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbffff640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 0x7f0fc00c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbffff640 1 -- 172.21.15.17:0/557706839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb0009b30 con 0x7f0fc00b86e0 2023-08-09T12:47:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.197+0000 7f0fbf7fe640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:49.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.198+0000 7f0fbffff640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fc00b86e0 0x7f0fc0148d40 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0000f80 tx=0x7f0fb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:49.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.198+0000 7f0fbcff9640 1 -- 172.21.15.17:0/557706839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb003e450 con 0x7f0fc00b86e0 2023-08-09T12:47:49.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.198+0000 7f0fbcff9640 1 -- 172.21.15.17:0/557706839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb003e5f0 con 0x7f0fc00b86e0 2023-08-09T12:47:49.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.198+0000 7f0fbcff9640 1 -- 172.21.15.17:0/557706839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb003e9a0 con 0x7f0fc00b86e0 2023-08-09T12:47:49.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.198+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc01f2cd0 con 0x7f0fc00b86e0 2023-08-09T12:47:49.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.198+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc01f20a0 con 0x7f0fc00b86e0 2023-08-09T12:47:49.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.199+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc004e390 con 0x7f0fc00b86e0 2023-08-09T12:47:49.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.200+0000 7f0fbcff9640 1 -- 172.21.15.17:0/557706839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0fb003eb00 con 0x7f0fc00b86e0 2023-08-09T12:47:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.201+0000 7f0fbcff9640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0fac06a050 0x7f0fac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.201+0000 7f0fbcff9640 1 -- 172.21.15.17:0/557706839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fb00ab290 con 0x7f0fc00b86e0 2023-08-09T12:47:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.202+0000 7f0fbf7fe640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0fac06a050 0x7f0fac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.203+0000 7f0fbf7fe640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0fac06a050 0x7f0fac06c510 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00b7720 tx=0x7f0fb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.206+0000 7f0fbcff9640 1 -- 172.21.15.17:0/557706839 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0fb0076970 con 0x7f0fc00b86e0 2023-08-09T12:47:49.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.437+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fc01f2570 con 0x7f0fc00b86e0 2023-08-09T12:47:49.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.438+0000 7f0fbcff9640 1 -- 172.21.15.17:0/557706839 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f0fc01f2570 con 0x7f0fc00b86e0 2023-08-09T12:47:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:49.441 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:47:49.441 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:47:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0fac06a050 msgr2=0x7f0fac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0fac06a050 0x7f0fac06c510 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00b7720 tx=0x7f0fb4009040 comp rx=0 tx=0).stop 2023-08-09T12:47:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fc00b86e0 msgr2=0x7f0fc0148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fc00b86e0 0x7f0fc0148d40 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0000f80 tx=0x7f0fb0004a40 comp rx=0 tx=0).stop 2023-08-09T12:47:49.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 shutdown_connections 2023-08-09T12:47:49.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0fac06a050 0x7f0fac06c510 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0160030 0x7f0fc00c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00cfb50 0x7f0fc00c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 --2- 172.21.15.17:0/557706839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fc00b86e0 0x7f0fc0148d40 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 >> 172.21.15.17:0/557706839 conn(0x7f0fc00697c0 msgr2=0x7f0fc00cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:49.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 shutdown_connections 2023-08-09T12:47:49.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.440+0000 7f0fc520a640 1 -- 172.21.15.17:0/557706839 wait complete. 2023-08-09T12:47:49.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-08-09T12:47:49.707 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":7992,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.100573213000001,"mdsmap_epoch":67,"osdmap_epoch":146,"osdmap_epoch_barrier":146,"uptime":17.021277424000001} 2023-08-09T12:47:49.708 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 7992, "mdsmap_epoch": 67, "osdmap_epoch": 146, "osdmap_epoch_barrier": 146, "rank_uptime": 11.100573213, "state": "up:active", "uptime": 17.021277424, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:47:49.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-09T12:47:49.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.932+0000 7fda9e0f9640 1 Processor -- start 2023-08-09T12:47:49.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.932+0000 7fda9e0f9640 1 -- start start 2023-08-09T12:47:49.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.933+0000 7fda9e0f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda98159ab0 0x7fda980cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.933+0000 7fda9e0f9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda980ce090 0x7fda980ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.933+0000 7fda9e0f9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda98159e90 con 0x7fda980cec30 2023-08-09T12:47:49.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.933+0000 7fda9e0f9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda980cf0c0 con 0x7fda980ce090 2023-08-09T12:47:49.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.933+0000 7fda9e0f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda980ccab0 con 0x7fda98159ab0 2023-08-09T12:47:49.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.934+0000 7fda977fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda98159ab0 0x7fda980cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.934+0000 7fda8ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda980ce090 0x7fda980ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.934+0000 7fda977fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda98159ab0 0x7fda980cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:49154/0 (socket says 172.21.15.17:49154) 2023-08-09T12:47:49.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.934+0000 7fda977fe640 1 -- 172.21.15.17:0/2408156125 learned_addr learned my addr 172.21.15.17:0/2408156125 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.935+0000 7fda977fe640 1 -- 172.21.15.17:0/2408156125 >> v2:172.21.15.142:3300/0 conn(0x7fda980ce090 msgr2=0x7fda980ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.935+0000 7fda977fe640 1 --2- 172.21.15.17:0/2408156125 >> v2:172.21.15.142:3300/0 conn(0x7fda980ce090 0x7fda980ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.935+0000 7fda977fe640 1 -- 172.21.15.17:0/2408156125 >> v1:172.21.15.142:6789/0 conn(0x7fda980cec30 legacy=0x7fda9806f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.935+0000 7fda977fe640 1 -- 172.21.15.17:0/2408156125 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda980ccd90 con 0x7fda98159ab0 2023-08-09T12:47:49.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.937+0000 7fda977fe640 1 --2- 172.21.15.17:0/2408156125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda98159ab0 0x7fda980cdb50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda88009870 tx=0x7fda8802ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b912e3eaaa19edf6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.937+0000 7fda96ffd640 1 -- 172.21.15.17:0/2408156125 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8802f830 con 0x7fda98159ab0 2023-08-09T12:47:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.938+0000 7fda96ffd640 1 -- 172.21.15.17:0/2408156125 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8802f990 con 0x7fda98159ab0 2023-08-09T12:47:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.938+0000 7fda96ffd640 1 -- 172.21.15.17:0/2408156125 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8802fd20 con 0x7fda98159ab0 2023-08-09T12:47:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.938+0000 7fda9e0f9640 1 -- 172.21.15.17:0/2408156125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda98159ab0 msgr2=0x7fda980cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.938+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/2408156125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda98159ab0 0x7fda980cdb50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda88009870 tx=0x7fda8802ba10 comp rx=0 tx=0).stop 2023-08-09T12:47:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.938+0000 7fda9e0f9640 1 -- 172.21.15.17:0/2408156125 shutdown_connections 2023-08-09T12:47:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.938+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/2408156125 >> v2:172.21.15.142:3300/0 conn(0x7fda980ce090 0x7fda980ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.938+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/2408156125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda98159ab0 0x7fda980cdb50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.938+0000 7fda9e0f9640 1 -- 172.21.15.17:0/2408156125 >> 172.21.15.17:0/2408156125 conn(0x7fda980697c0 msgr2=0x7fda98069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:49.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.939+0000 7fda9e0f9640 1 -- 172.21.15.17:0/2408156125 shutdown_connections 2023-08-09T12:47:49.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.939+0000 7fda9e0f9640 1 -- 172.21.15.17:0/2408156125 wait complete. 2023-08-09T12:47:49.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.940+0000 7fda9e0f9640 1 Processor -- start 2023-08-09T12:47:49.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.941+0000 7fda9e0f9640 1 -- start start 2023-08-09T12:47:49.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda9e0f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda980ce090 0x7fda9814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda9e0f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda980cec30 0x7fda98155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda9e0f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda98159ab0 0x7fda98157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda9e0f9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda981585f0 con 0x7fda98159ab0 2023-08-09T12:47:49.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda9e0f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda981588d0 con 0x7fda980cec30 2023-08-09T12:47:49.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda9e0f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda98158bb0 con 0x7fda980ce090 2023-08-09T12:47:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda97fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda98159ab0 0x7fda98157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda97fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda98159ab0 0x7fda98157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54358/0 (socket says 172.21.15.17:54358) 2023-08-09T12:47:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda97fff640 1 -- 172.21.15.17:0/414326436 learned_addr learned my addr 172.21.15.17:0/414326436 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda977fe640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda980ce090 0x7fda9814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.942+0000 7fda8ffff640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda980cec30 0x7fda98155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda97fff640 1 -- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda980ce090 msgr2=0x7fda9814df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda97fff640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda980ce090 0x7fda9814df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda97fff640 1 -- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda980cec30 msgr2=0x7fda98155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:49.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda97fff640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda980cec30 0x7fda98155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:49.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda97fff640 1 -- 172.21.15.17:0/414326436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda880094d0 con 0x7fda98159ab0 2023-08-09T12:47:49.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda977fe640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda980ce090 0x7fda9814df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:47:49.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda97fff640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda98159ab0 0x7fda98157bb0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c7a0 tx=0x7fda9000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:49.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda94ff9640 1 -- 172.21.15.17:0/414326436 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90003b70 con 0x7fda98159ab0 2023-08-09T12:47:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda94ff9640 1 -- 172.21.15.17:0/414326436 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90003cf0 con 0x7fda98159ab0 2023-08-09T12:47:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda98158e90 con 0x7fda98159ab0 2023-08-09T12:47:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda94ff9640 1 -- 172.21.15.17:0/414326436 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90003ea0 con 0x7fda98159ab0 2023-08-09T12:47:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.943+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda981582d0 con 0x7fda98159ab0 2023-08-09T12:47:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.945+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda980cd020 con 0x7fda98159ab0 2023-08-09T12:47:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.946+0000 7fda94ff9640 1 -- 172.21.15.17:0/414326436 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda9000aa90 con 0x7fda98159ab0 2023-08-09T12:47:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.947+0000 7fda94ff9640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda7806a050 0x7fda7806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.947+0000 7fda94ff9640 1 -- 172.21.15.17:0/414326436 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda90088400 con 0x7fda98159ab0 2023-08-09T12:47:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.947+0000 7fda977fe640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda7806a050 0x7fda7806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.948+0000 7fda977fe640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda7806a050 0x7fda7806c510 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fda88036000 tx=0x7fda88008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:49.951+0000 7fda94ff9640 1 -- 172.21.15.17:0/414326436 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fda90053ae0 con 0x7fda98159ab0 2023-08-09T12:47:50.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.151+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fda98067a80 con 0x7fda98159ab0 2023-08-09T12:47:50.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.855+0000 7fda94ff9640 1 -- 172.21.15.17:0/414326436 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v147) v1 ==== 181+0+0 (secure 0 0 0) 0x7fda90057100 con 0x7fda98159ab0 2023-08-09T12:47:50.859 INFO:teuthology.orchestra.run.smithi017.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-09T12:47:50.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda7806a050 msgr2=0x7fda7806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:50.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda7806a050 0x7fda7806c510 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fda88036000 tx=0x7fda88008030 comp rx=0 tx=0).stop 2023-08-09T12:47:50.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda98159ab0 msgr2=0x7fda98157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:50.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda98159ab0 0x7fda98157bb0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c7a0 tx=0x7fda9000cc60 comp rx=0 tx=0).stop 2023-08-09T12:47:50.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 shutdown_connections 2023-08-09T12:47:50.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda7806a050 0x7fda7806c510 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:50.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda98159ab0 0x7fda98157bb0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:50.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda980cec30 0x7fda98155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:50.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 --2- 172.21.15.17:0/414326436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda980ce090 0x7fda9814df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:50.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 >> 172.21.15.17:0/414326436 conn(0x7fda980697c0 msgr2=0x7fda9806fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:50.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 shutdown_connections 2023-08-09T12:47:50.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:50.859+0000 7fda9e0f9640 1 -- 172.21.15.17:0/414326436 wait complete. 2023-08-09T12:47:50.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-09T12:47:51.127 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_mon_report_interval":"5"} 2023-08-09T12:47:51.127 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-09T12:47:51.128 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-08-09T12:47:51.128 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:51.128 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:51.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:51.182 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-08-09T12:47:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:16+0 records in 2023-08-09T12:47:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:16+0 records out 2023-08-09T12:47:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.174617 s, 96.1 MB/s 2023-08-09T12:47:51.421 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:47:51.422 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:47:51.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:47:51.482 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-08-09T12:47:51.743 INFO:teuthology.orchestra.run.smithi017.stderr:17+0 records in 2023-08-09T12:47:51.743 INFO:teuthology.orchestra.run.smithi017.stderr:17+0 records out 2023-08-09T12:47:51.744 INFO:teuthology.orchestra.run.smithi017.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.204103 s, 87.3 MB/s 2023-08-09T12:47:51.745 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-08-09T12:47:51.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:47:51.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.956+0000 7f3695ba4640 1 Processor -- start 2023-08-09T12:47:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.956+0000 7f3695ba4640 1 -- start start 2023-08-09T12:47:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.957+0000 7f3695ba4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3690070f00 0x7f369015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.957+0000 7f3695ba4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f369015bce0 0x7f36900cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3695ba4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3690071340 con 0x7f36901587e0 2023-08-09T12:47:51.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3695ba4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900715c0 con 0x7f3690070f00 2023-08-09T12:47:51.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3695ba4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900718a0 con 0x7f369015bce0 2023-08-09T12:47:51.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3687fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3690070f00 0x7f369015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:51.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3694ba2640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f36901587e0 0x7f36900b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47786/0 (socket says 172.21.15.17:47786) 2023-08-09T12:47:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3694ba2640 1 -- 172.21.15.17:0/80606442 learned_addr learned my addr 172.21.15.17:0/80606442 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f36953a3640 1 --2- 172.21.15.17:0/80606442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f369015bce0 0x7f36900cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:51.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3687fff640 1 -- 172.21.15.17:0/80606442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f369015bce0 msgr2=0x7f36900cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:51.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3687fff640 1 --2- 172.21.15.17:0/80606442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f369015bce0 0x7f36900cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:51.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.958+0000 7f3687fff640 1 -- 172.21.15.17:0/80606442 >> v1:172.21.15.17:6789/0 conn(0x7f36901587e0 legacy=0x7f36900b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:51.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.959+0000 7f3687fff640 1 -- 172.21.15.17:0/80606442 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690071b80 con 0x7f3690070f00 2023-08-09T12:47:51.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.959+0000 7f36953a3640 1 --2- 172.21.15.17:0/80606442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f369015bce0 0x7f36900cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:47:51.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.960+0000 7f3687fff640 1 --2- 172.21.15.17:0/80606442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3690070f00 0x7f369015b7a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f36800097a0 tx=0x7f368002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c740f59bd678ee52 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.960+0000 7f36877fe640 1 -- 172.21.15.17:0/80606442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368002d040 con 0x7f3690070f00 2023-08-09T12:47:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.960+0000 7f36877fe640 1 -- 172.21.15.17:0/80606442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680031810 con 0x7f3690070f00 2023-08-09T12:47:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.960+0000 7f36877fe640 1 -- 172.21.15.17:0/80606442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680031ba0 con 0x7f3690070f00 2023-08-09T12:47:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.961+0000 7f3695ba4640 1 -- 172.21.15.17:0/80606442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3690070f00 msgr2=0x7f369015b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.961+0000 7f3695ba4640 1 --2- 172.21.15.17:0/80606442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3690070f00 0x7f369015b7a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f36800097a0 tx=0x7f368002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:47:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.961+0000 7f3695ba4640 1 -- 172.21.15.17:0/80606442 shutdown_connections 2023-08-09T12:47:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.961+0000 7f3695ba4640 1 --2- 172.21.15.17:0/80606442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f369015bce0 0x7f36900cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.961+0000 7f3695ba4640 1 --2- 172.21.15.17:0/80606442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3690070f00 0x7f369015b7a0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.961+0000 7f3695ba4640 1 -- 172.21.15.17:0/80606442 >> 172.21.15.17:0/80606442 conn(0x7f36900b1d50 msgr2=0x7f369006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.961+0000 7f3695ba4640 1 -- 172.21.15.17:0/80606442 shutdown_connections 2023-08-09T12:47:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.961+0000 7f3695ba4640 1 -- 172.21.15.17:0/80606442 wait complete. 2023-08-09T12:47:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.963+0000 7f3695ba4640 1 Processor -- start 2023-08-09T12:47:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.963+0000 7f3695ba4640 1 -- start start 2023-08-09T12:47:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3695ba4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3690070f00 0x7f36900c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3695ba4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36901587e0 0x7f36900c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3695ba4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3690157220 0x7f36900ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3695ba4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900c57c0 con 0x7f36901587e0 2023-08-09T12:47:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3695ba4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36901576b0 con 0x7f3690070f00 2023-08-09T12:47:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3695ba4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900c5a10 con 0x7f3690157220 2023-08-09T12:47:51.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3687fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36901587e0 0x7f36900c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:51.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3687fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36901587e0 0x7f36900c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54374/0 (socket says 172.21.15.17:54374) 2023-08-09T12:47:51.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.964+0000 7f3687fff640 1 -- 172.21.15.17:0/144299346 learned_addr learned my addr 172.21.15.17:0/144299346 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:51.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f3694ba2640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3690070f00 0x7f36900c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:51.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f3687fff640 1 -- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3690157220 msgr2=0x7f36900ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:51.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f3687fff640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3690157220 0x7f36900ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:51.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f3687fff640 1 -- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3690070f00 msgr2=0x7f36900c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:51.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f3687fff640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3690070f00 0x7f36900c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:51.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f3687fff640 1 -- 172.21.15.17:0/144299346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680009400 con 0x7f36901587e0 2023-08-09T12:47:51.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f3687fff640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36901587e0 0x7f36900c9d90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f36800098c0 tx=0x7f36800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:51.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f36857fa640 1 -- 172.21.15.17:0/144299346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368003ad60 con 0x7f36901587e0 2023-08-09T12:47:51.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f36857fa640 1 -- 172.21.15.17:0/144299346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680044400 con 0x7f36901587e0 2023-08-09T12:47:51.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.965+0000 7f36857fa640 1 -- 172.21.15.17:0/144299346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36800447b0 con 0x7f36901587e0 2023-08-09T12:47:51.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.966+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36900c5cf0 con 0x7f36901587e0 2023-08-09T12:47:51.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.966+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36900c8670 con 0x7f36901587e0 2023-08-09T12:47:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.967+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36900c6210 con 0x7f36901587e0 2023-08-09T12:47:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.968+0000 7f36857fa640 1 -- 172.21.15.17:0/144299346 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f368004d440 con 0x7f36901587e0 2023-08-09T12:47:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.969+0000 7f36857fa640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f367c06a050 0x7f367c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.969+0000 7f36857fa640 1 -- 172.21.15.17:0/144299346 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36800aaac0 con 0x7f36901587e0 2023-08-09T12:47:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.969+0000 7f3694ba2640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f367c06a050 0x7f367c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.970+0000 7f3694ba2640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f367c06a050 0x7f367c06c510 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f368c005880 tx=0x7f368c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:51.973+0000 7f36857fa640 1 -- 172.21.15.17:0/144299346 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f36900c6210 con 0x7f36901587e0 2023-08-09T12:47:52.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.167+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f36900c6210 con 0x7f36901587e0 2023-08-09T12:47:52.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.169+0000 7f36857fa640 1 -- 172.21.15.17:0/144299346 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+36993 (secure 0 0 0) 0x7f36900c6210 con 0x7f36901587e0 2023-08-09T12:47:52.173 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:47:52.174 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 147, 2023-08-09T12:47:52.174 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:47:52.174 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:47:52.174 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:47:50.840580+0000", 2023-08-09T12:47:52.174 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:47:52.174 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:47:52.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:47:52.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:47:52.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:47:52.175 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:47:52.175 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:47:52.175 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:47:52.175 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:47:52.176 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:47:52.176 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:47:52.176 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:47:52.176 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:47:52.176 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:47:52.176 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:47:52.177 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 18, 2023-08-09T12:47:52.177 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:47:52.177 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:47:52.177 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:47:52.177 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:47:52.177 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:47:52.177 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:47:52.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.178 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:47:52.178 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:47:52.178 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:47:52.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:47:52.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:47:52.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:47:52.178 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:47:52.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:47:52.179 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:47:52.179 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:47:52.179 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:47:52.179 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:47:52.179 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:47:52.179 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:47:52.179 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:47:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:47:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:47:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:47:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:47:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:47:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:47:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:47:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:47:52.181 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:47:52.181 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:47:52.181 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:47:52.181 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:47:52.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:47:52.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:47:52.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:47:52.182 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:47:52.182 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:47:52.182 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:47:52.182 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:47:52.182 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:47:52.183 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:47:52.183 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:47:52.183 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:47:52.183 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:47:52.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:47:52.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:47:52.183 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:47:52.183 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:47:52.184 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:47:52.184 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:47:52.184 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:47:52.184 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:47:52.184 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:47:52.184 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:47:52.184 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:47:52.185 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:47:52.185 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:47:52.185 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:47:52.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:47:52.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.185 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:47:52.185 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:47:52.186 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:47:52.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:47:52.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:47:52.186 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:47:52.186 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:47:52.186 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:47:52.187 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:47:52.187 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:47:52.187 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:47:52.187 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:47:52.187 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:47:52.187 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:47:52.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.188 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:47:52.188 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:47:52.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.188 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:47:52.188 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:47:52.188 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:47:52.189 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:47:52.189 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:47:52.189 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:47:52.189 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:47:52.189 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:47:52.189 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:47:52.190 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.190 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:47:52.190 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:47:52.190 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:47:52.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:47:52.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:47:52.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:47:52.191 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:47:52.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:47:52.191 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:47:52.191 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:47:52.192 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:47:52.192 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:47:52.192 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:47:52.192 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:47:52.192 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:47:52.193 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:47:52.193 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:47:52.193 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:47:52.193 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:47:52.193 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:47:52.193 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:47:52.193 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:47:52.194 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:47:52.194 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:47:52.194 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:47:52.194 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:47:52.194 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:47:52.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.194 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:47:52.194 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:47:52.195 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:47:52.195 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:47:52.195 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:47:52.195 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:47:52.195 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:47:52.195 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:47:52.196 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:47:52.196 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:47:52.196 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:47:52.196 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:47:52.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:47:52.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:47:52.196 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:47:52.197 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:47:52.197 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:47:52.197 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:47:52.197 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:47:52.197 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:47:52.197 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:47:52.198 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:47:52.198 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:47:52.198 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:47:52.198 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:47:52.198 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:47:52.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:47:52.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.199 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:47:52.199 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:47:52.199 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:47:52.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:47:52.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:47:52.199 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:47:52.199 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:47:52.199 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:47:52.200 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:47:52.200 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:47:52.200 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:47:52.200 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:47:52.201 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:47:52.201 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:47:52.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.201 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:47:52.201 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:47:52.201 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:47:52.202 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:47:52.202 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:47:52.203 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:47:52.203 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:47:52.203 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:47:52.203 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:47:52.203 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.204 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 17, 2023-08-09T12:47:52.204 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:47:52.204 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:36.431201+0000", 2023-08-09T12:47:52.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:47:52.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:47:52.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:47:52.205 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:47:52.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:47:52.205 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:47:52.205 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:47:52.205 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:47:52.205 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:47:52.206 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:47:52.206 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:47:52.206 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:47:52.206 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:47:52.207 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:47:52.207 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:47:52.207 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:47:52.207 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:47:52.207 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:47:52.207 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:47:52.207 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:47:52.208 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:47:52.208 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:47:52.208 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:47:52.208 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:47:52.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.208 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "145", 2023-08-09T12:47:52.208 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:47:52.209 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:47:52.209 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:47:52.209 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:47:52.209 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:47:52.209 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:47:52.209 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:47:52.209 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:47:52.210 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:47:52.210 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:47:52.210 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:47:52.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:47:52.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:47:52.210 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:47:52.210 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:47:52.210 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:47:52.211 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:47:52.211 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:47:52.211 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:47:52.211 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:47:52.211 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:47:52.211 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:47:52.211 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:47:52.212 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:47:52.212 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:47:52.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:47:52.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.212 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:47:52.212 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:47:52.212 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:47:52.212 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:47:52.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:47:52.213 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:47:52.213 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:47:52.213 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:47:52.213 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:47:52.213 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:47:52.213 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:47:52.213 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:47:52.214 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:47:52.214 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:47:52.214 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:47:52.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.214 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:47:52.214 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:47:52.214 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:47:52.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.215 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:47:52.215 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:47:52.215 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:47:52.215 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:47:52.215 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:47:52.215 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:47:52.216 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:47:52.216 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:47:52.216 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:47:52.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.217 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 18, 2023-08-09T12:47:52.217 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:47:52.217 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:37.108075+0000", 2023-08-09T12:47:52.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:47:52.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:47:52.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:47:52.218 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:47:52.218 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:47:52.218 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:47:52.218 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:47:52.218 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:47:52.218 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:47:52.218 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:47:52.219 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:47:52.219 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:47:52.219 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:47:52.219 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:47:52.219 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:47:52.219 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:47:52.219 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:47:52.219 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:47:52.220 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:47:52.220 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:47:52.220 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:47:52.220 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:47:52.220 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:47:52.220 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:47:52.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.220 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "147", 2023-08-09T12:47:52.221 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:47:52.221 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:47:52.221 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:47:52.221 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:47:52.221 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:47:52.221 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:47:52.221 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:47:52.221 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:47:52.222 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:47:52.222 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:47:52.222 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:47:52.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:47:52.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:47:52.222 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:47:52.222 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:47:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:47:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:47:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:47:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:47:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:47:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:47:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:47:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:47:52.224 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:47:52.224 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:47:52.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:47:52.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.224 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:47:52.224 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:47:52.224 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:47:52.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:47:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:47:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:47:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:47:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:47:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:47:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:47:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:47:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:47:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:47:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:47:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:47:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:47:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:47:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.227 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:47:52.227 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.3799999952316284, 2023-08-09T12:47:52.227 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.3799999952316284, 2023-08-09T12:47:52.227 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:47:52.227 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-09T12:47:52.227 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-09T12:47:52.228 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:47:52.228 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:47:52.228 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:47:52.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.228 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:47:52.228 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:47:52.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.229 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:47:52.229 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:52.229 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:52.229 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:52.229 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:52.229 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:52.229 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:52.229 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:52.230 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:52.230 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:52.230 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:52.230 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:52.230 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:52.230 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.231 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:47:52.231 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:52.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.231 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:47:52.231 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:52.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.232 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.232 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:52.232 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.232 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:47:52.233 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:52.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.233 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:47:52.233 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:52.233 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.233 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.234 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:52.234 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.234 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:47:52.234 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:52.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.235 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:47:52.235 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:52.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.235 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.235 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:52.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:47:52.236 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:52.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.237 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:47:52.237 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:52.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.237 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.237 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:47:52.237 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:47:52.238 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:47:52.238 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:47:52.238 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:52.238 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:52.238 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:52.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.239 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:47:52.239 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:52.239 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:52.239 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:52.239 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:52.239 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:52.239 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:52.239 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:52.240 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:52.240 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:52.240 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:52.240 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:52.240 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:52.240 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.241 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:47:52.241 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:52.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.241 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:47:52.241 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:52.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.242 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.242 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:52.242 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.242 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:47:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:47:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:47:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:47:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:52.246 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.246 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:47:52.246 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:52.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.247 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:47:52.247 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:52.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.247 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.247 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:47:52.247 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:47:52.248 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:47:52.248 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:47:52.248 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:52.248 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:52.248 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:52.248 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.249 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:47:52.249 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:52.249 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:52.249 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:52.249 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:52.249 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:52.249 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:52.249 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:52.250 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:52.250 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:52.250 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:52.250 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:52.250 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:52.250 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.251 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:47:52.251 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:52.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.251 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:47:52.251 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:52.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:47:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:52.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.253 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:47:52.253 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:52.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.253 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:47:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.255 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:47:52.255 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:52.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.255 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.255 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:52.256 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.256 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:47:52.256 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:52.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.257 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:47:52.257 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:52.257 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.257 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.257 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:47:52.257 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:47:52.258 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:47:52.258 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:47:52.258 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:52.258 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:52.258 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:52.258 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.259 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:47:52.259 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:52.259 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:52.259 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:52.259 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:52.259 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:52.259 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:52.259 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:52.260 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:52.260 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:52.260 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:52.260 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:52.260 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:52.260 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.261 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:47:52.261 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:52.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.261 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:47:52.261 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:52.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.262 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.262 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:52.262 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.262 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:47:52.263 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:52.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.263 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:47:52.263 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:52.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.264 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.264 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:52.264 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.264 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:47:52.264 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:52.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.265 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:47:52.265 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:52.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.265 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.266 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:52.266 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.266 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:47:52.266 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:52.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:47:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:47:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:47:52.268 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:47:52.268 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:47:52.268 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:52.268 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:52.268 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:52.268 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.269 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:47:52.269 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:52.269 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:52.269 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:52.269 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:52.269 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:52.269 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:52.270 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:52.270 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:52.270 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:52.270 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:52.270 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:52.270 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:52.270 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:47:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:47:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:52.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.272 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.272 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:52.272 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.273 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:47:52.273 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:52.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.273 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:47:52.273 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:52.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.274 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.274 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:52.274 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.274 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:47:52.274 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:47:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:47:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:52.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.277 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:47:52.277 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:52.277 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.277 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:47:52.278 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:47:52.278 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:47:52.278 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:47:52.278 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:52.278 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:52.278 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:52.278 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.279 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:47:52.279 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:52.279 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:52.279 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:52.279 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:52.279 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:52.279 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:52.280 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:52.280 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:52.280 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:52.280 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:52.280 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:52.280 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:52.280 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.281 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:47:52.281 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:52.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.281 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:47:52.281 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:52.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.282 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.282 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:52.282 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.282 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:47:52.283 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:52.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.283 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:47:52.283 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:52.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.284 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.284 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:52.284 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.284 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:47:52.284 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:47:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:47:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:47:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:47:52.287 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:47:52.288 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:47:52.288 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:47:52.288 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:52.288 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:52.288 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:52.288 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.289 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:47:52.289 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:52.289 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:52.289 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:52.289 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:52.289 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:52.289 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:52.290 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:52.290 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:52.290 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:52.290 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:52.290 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:52.290 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:52.290 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.291 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:47:52.291 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:52.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.291 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:47:52.291 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:52.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.292 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.292 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:52.292 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.292 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:47:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:47:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.294 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:52.294 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.294 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:47:52.294 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:52.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.295 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:47:52.295 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:52.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.295 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.296 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:52.296 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.296 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:47:52.296 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:52.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.297 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:47:52.297 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:52.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.297 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.297 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:47:52.297 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:47:52.298 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:47:52.298 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:47:52.298 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:52.298 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:52.298 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:52.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.299 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:47:52.299 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:52.299 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:52.299 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:52.299 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:52.299 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:52.299 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:52.299 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:52.300 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:52.300 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:52.300 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:52.300 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:52.300 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:52.300 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:47:52.301 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:52.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:47:52.301 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:52.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.302 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.302 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:52.302 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.302 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:47:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:47:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.304 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:52.304 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.304 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:47:52.304 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:52.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.305 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:47:52.305 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:52.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.305 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.306 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:52.306 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:52.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:52.306 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:47:52.306 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:52.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:52.307 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:47:52.307 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:52.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.307 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.307 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:47:52.307 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:47:52.308 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:47:52.308 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:47:52.308 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:52.308 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:52.308 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:52.308 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:52.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.308 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:47:52.309 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:47:52.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.309 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:47:52.309 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:52.309 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:52.309 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:52.309 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:52.310 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:52.310 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:47:52.310 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:52.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.310 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:47:52.310 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:52.310 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:52.311 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:52.311 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:52.311 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:52.311 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:47:52.311 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:52.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.311 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:47:52.312 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:52.312 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:52.312 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:52.312 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:52.312 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:52.312 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:47:52.312 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:52.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.313 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:47:52.313 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:52.313 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:52.313 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:52.313 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:52.313 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:52.313 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:47:52.314 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:52.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.314 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:47:52.314 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:52.314 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:52.314 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:52.315 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:52.315 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:52.315 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:47:52.315 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:52.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.315 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:47:52.315 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:52.316 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:52.316 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:52.316 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:52.316 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:52.316 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:47:52.316 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:52.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.317 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:47:52.317 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:52.317 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:52.317 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:52.317 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:52.317 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:52.317 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:47:52.317 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:52.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:52.318 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:47:52.318 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:52.318 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:52.318 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:52.318 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:52.318 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:47:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:47:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:47:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:47:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:47:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:47:52.320 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:47:52.320 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:47:52.320 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:47:52.320 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:47:52.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:47:52.320 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:47:52.320 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:47:52.320 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:47:52.321 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:47:52.321 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:47:52.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:52.321 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:47:52.321 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:47:52.321 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:47:52.322 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:47:52.322 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:47:52.322 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:47:52.322 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:47:52.322 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:47:52.322 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:47:52.322 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:47:52.322 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:47:52.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:52.323 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:47:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f367c06a050 msgr2=0x7f367c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f367c06a050 0x7f367c06c510 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f368c005880 tx=0x7f368c009040 comp rx=0 tx=0).stop 2023-08-09T12:47:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36901587e0 msgr2=0x7f36900c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36901587e0 0x7f36900c9d90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f36800098c0 tx=0x7f36800046c0 comp rx=0 tx=0).stop 2023-08-09T12:47:52.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 shutdown_connections 2023-08-09T12:47:52.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f367c06a050 0x7f367c06c510 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:52.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3690157220 0x7f36900ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:52.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36901587e0 0x7f36900c9d90 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:52.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 --2- 172.21.15.17:0/144299346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3690070f00 0x7f36900c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:52.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.172+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 >> 172.21.15.17:0/144299346 conn(0x7f36900b1d50 msgr2=0x7f36900cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:52.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.173+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 shutdown_connections 2023-08-09T12:47:52.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:52.173+0000 7f3695ba4640 1 -- 172.21.15.17:0/144299346 wait complete. 2023-08-09T12:47:52.326 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:47:57.328 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:47:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.564+0000 7f62c89b0640 1 Processor -- start 2023-08-09T12:47:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.564+0000 7f62c89b0640 1 -- start start 2023-08-09T12:47:57.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.565+0000 7f62c89b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 0x7f62c4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:57.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62c89b0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62c40cfb50 0x7f62c40d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:57.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62c89b0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40b5a30 con 0x7f62c40b86e0 2023-08-09T12:47:57.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62c89b0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40d1110 con 0x7f62c40cfb50 2023-08-09T12:47:57.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62c89b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40ceac0 con 0x7f62c4160030 2023-08-09T12:47:57.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62ba59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f62c40b86e0 0x7f62c40cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47792/0 (socket says 172.21.15.17:47792) 2023-08-09T12:47:57.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62ba59c640 1 -- 172.21.15.17:0/2430939260 learned_addr learned my addr 172.21.15.17:0/2430939260 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:47:57.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62c359e640 1 --2- 172.21.15.17:0/2430939260 >> v2:172.21.15.17:3300/0 conn(0x7f62c40cfb50 0x7f62c40d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62c2d9d640 1 --2- 172.21.15.17:0/2430939260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 0x7f62c4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.566+0000 7f62c259c640 1 -- 172.21.15.17:0/2430939260 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810224335 0 0) 0x7f62c40b5a30 con 0x7f62c40b86e0 2023-08-09T12:47:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.567+0000 7f62c259c640 1 -- 172.21.15.17:0/2430939260 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b0003520 con 0x7f62c40b86e0 2023-08-09T12:47:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.567+0000 7f62c359e640 1 -- 172.21.15.17:0/2430939260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 msgr2=0x7f62c4160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:47:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.567+0000 7f62c359e640 1 --2- 172.21.15.17:0/2430939260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 0x7f62c4160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.567+0000 7f62c359e640 1 -- 172.21.15.17:0/2430939260 >> v1:172.21.15.17:6789/0 conn(0x7f62c40b86e0 legacy=0x7f62c40cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.567+0000 7f62c259c640 1 -- 172.21.15.17:0/2430939260 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 663236099 0 0) 0x7f62b0003520 con 0x7f62c40b86e0 2023-08-09T12:47:57.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.567+0000 7f62c359e640 1 -- 172.21.15.17:0/2430939260 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40d0d70 con 0x7f62c40cfb50 2023-08-09T12:47:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.568+0000 7f62c359e640 1 --2- 172.21.15.17:0/2430939260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c40d1530 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0097a0 tx=0x7f62bc02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4380ed847d0e0ba server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.568+0000 7f62c259c640 1 -- 172.21.15.17:0/2430939260 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac001670 con 0x7f62c40cfb50 2023-08-09T12:47:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.568+0000 7f62c259c640 1 -- 172.21.15.17:0/2430939260 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc02e050 con 0x7f62c40cfb50 2023-08-09T12:47:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.568+0000 7f62c259c640 1 -- 172.21.15.17:0/2430939260 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc030710 con 0x7f62c40cfb50 2023-08-09T12:47:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.569+0000 7f62c89b0640 1 -- 172.21.15.17:0/2430939260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 msgr2=0x7f62c40d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.569+0000 7f62c89b0640 1 --2- 172.21.15.17:0/2430939260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c40d1530 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0097a0 tx=0x7f62bc02b790 comp rx=0 tx=0).stop 2023-08-09T12:47:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.569+0000 7f62c89b0640 1 -- 172.21.15.17:0/2430939260 shutdown_connections 2023-08-09T12:47:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.569+0000 7f62c89b0640 1 --2- 172.21.15.17:0/2430939260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c40d1530 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.569+0000 7f62c89b0640 1 --2- 172.21.15.17:0/2430939260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 0x7f62c4160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.569+0000 7f62c89b0640 1 -- 172.21.15.17:0/2430939260 >> 172.21.15.17:0/2430939260 conn(0x7f62c40697c0 msgr2=0x7f62c4069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.569+0000 7f62c89b0640 1 -- 172.21.15.17:0/2430939260 shutdown_connections 2023-08-09T12:47:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.569+0000 7f62c89b0640 1 -- 172.21.15.17:0/2430939260 wait complete. 2023-08-09T12:47:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.571+0000 7f62c89b0640 1 Processor -- start 2023-08-09T12:47:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.571+0000 7f62c89b0640 1 -- start start 2023-08-09T12:47:57.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.572+0000 7f62c89b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c40b86e0 0x7f62c41549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:57.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.572+0000 7f62c89b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c4157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:57.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.572+0000 7f62c89b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 0x7f62c4157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:57.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.572+0000 7f62c89b0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c415b320 con 0x7f62c40cfb50 2023-08-09T12:47:57.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.572+0000 7f62c89b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40cb020 con 0x7f62c40b86e0 2023-08-09T12:47:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.572+0000 7f62c89b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4154f00 con 0x7f62c4160030 2023-08-09T12:47:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.572+0000 7f62ba59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c4157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62ba59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c4157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54384/0 (socket says 172.21.15.17:54384) 2023-08-09T12:47:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62ba59c640 1 -- 172.21.15.17:0/3124107290 learned_addr learned my addr 172.21.15.17:0/3124107290 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:47:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62c2d9d640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c40b86e0 0x7f62c41549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62ba59c640 1 -- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 msgr2=0x7f62c4157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62ba59c640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 0x7f62c4157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62ba59c640 1 -- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c40b86e0 msgr2=0x7f62c41549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62ba59c640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c40b86e0 0x7f62c41549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62ba59c640 1 -- 172.21.15.17:0/3124107290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009400 con 0x7f62c40cfb50 2023-08-09T12:47:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62ba59c640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c4157a30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c750 tx=0x7f62ac00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62bbfff640 1 -- 172.21.15.17:0/3124107290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac005ad0 con 0x7f62c40cfb50 2023-08-09T12:47:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62bbfff640 1 -- 172.21.15.17:0/3124107290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac005c30 con 0x7f62c40cfb50 2023-08-09T12:47:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.573+0000 7f62bbfff640 1 -- 172.21.15.17:0/3124107290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac007070 con 0x7f62c40cfb50 2023-08-09T12:47:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.574+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c415a710 con 0x7f62c40cfb50 2023-08-09T12:47:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.574+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c415acd0 con 0x7f62c40cfb50 2023-08-09T12:47:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.575+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c404e390 con 0x7f62c40cfb50 2023-08-09T12:47:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.576+0000 7f62bbfff640 1 -- 172.21.15.17:0/3124107290 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f62ac0071d0 con 0x7f62c40cfb50 2023-08-09T12:47:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.577+0000 7f62bbfff640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f62a406a080 0x7f62a406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:47:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.577+0000 7f62bbfff640 1 -- 172.21.15.17:0/3124107290 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62ac087c70 con 0x7f62c40cfb50 2023-08-09T12:47:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.577+0000 7f62c2d9d640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f62a406a080 0x7f62a406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:47:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.579+0000 7f62c2d9d640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f62a406a080 0x7f62a406c540 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f62c40cae10 tx=0x7f62b400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:47:57.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.581+0000 7f62bbfff640 1 -- 172.21.15.17:0/3124107290 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f62ac053350 con 0x7f62c40cfb50 2023-08-09T12:47:57.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.780+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f62c4161500 con 0x7f62c40cfb50 2023-08-09T12:47:57.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.783+0000 7f62bbfff640 1 -- 172.21.15.17:0/3124107290 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v147) v1 ==== 81+0+36993 (secure 0 0 0) 0x7f62ac017020 con 0x7f62c40cfb50 2023-08-09T12:47:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:47:57.788 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:47:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 147, 2023-08-09T12:47:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:47:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:47:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:47:50.840580+0000", 2023-08-09T12:47:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:47:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:47:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:47:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:47:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:47:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:47:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:47:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:47:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:47:57.790 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 18, 2023-08-09T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:47:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:47:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:47:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:47:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:47:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.792 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:47:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:47:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:47:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:47:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:47:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:47:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:47:57.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:47:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:47:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:47:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:47:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:47:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:47:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:47:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:47:57.794 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:47:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:47:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:47:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:47:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:47:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:47:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:47:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:47:57.795 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:47:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:47:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:47:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:47:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:47:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:47:57.796 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:47:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:47:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:47:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:47:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:47:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:47:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:47:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:47:57.797 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:47:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:47:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:47:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:47:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:47:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:47:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:47:57.798 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:47:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:47:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:47:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:47:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:47:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:47:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:47:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:47:57.799 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:47:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:47:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:47:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:47:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:47:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:47:57.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:47:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:47:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:47:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:47:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:47:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:47:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:47:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:47:57.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:47:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:47:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:47:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:47:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:47:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:47:57.802 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:47:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:47:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:47:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:47:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:47:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:47:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:47:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:47:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:47:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:47:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:47:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:47:57.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:47:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:47:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:47:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:47:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:47:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:47:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:47:57.805 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:47:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:47:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:47:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:47:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:47:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:47:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:47:57.806 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:47:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:47:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:47:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:47:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:47:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:47:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:47:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:47:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:47:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:47:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:47:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:47:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:47:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:47:57.808 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:47:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:47:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:47:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:47:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:47:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:47:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:47:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:47:57.809 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:47:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:47:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:47:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:47:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:47:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:47:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:47:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:47:57.810 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:47:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:47:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:47:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:47:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:47:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:47:57.811 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:47:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:47:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:47:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:47:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:47:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:47:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:47:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:47:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:47:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:47:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:47:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:47:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:47:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:47:57.813 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:47:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:47:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:47:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:47:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:47:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:47:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:47:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:47:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 17, 2023-08-09T12:47:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:47:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:36.431201+0000", 2023-08-09T12:47:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:47:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:47:57.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:47:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:47:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:47:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:47:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:47:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:47:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:47:57.816 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:47:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:47:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:47:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:47:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:47:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:47:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:47:57.817 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:47:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:47:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:47:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:47:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:47:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:47:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:47:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:47:57.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "145", 2023-08-09T12:47:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:47:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:47:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:47:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:47:57.819 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:47:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:47:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:47:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:47:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:47:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:47:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:47:57.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:47:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:47:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:47:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:47:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:47:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:47:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:47:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:47:57.821 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:47:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:47:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:47:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:47:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:47:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:47:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:47:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:47:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:47:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:47:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:47:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:47:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:47:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:47:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:47:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:47:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:47:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:47:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:47:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:47:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:47:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:47:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:47:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:47:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:47:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.825 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:47:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:47:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:47:57.826 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:47:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:47:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:47:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:47:57.827 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:47:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:47:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 18, 2023-08-09T12:47:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:47:57.829 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:37.108075+0000", 2023-08-09T12:47:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:47:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:47:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:47:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:47:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:47:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:47:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:47:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:47:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:47:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:47:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:47:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:47:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:47:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:47:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:47:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:47:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:47:57.832 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:47:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:47:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:47:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:47:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:47:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:47:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:47:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.833 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "147", 2023-08-09T12:47:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:47:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:47:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:47:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:47:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:47:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:47:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:47:57.834 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:47:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:47:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:47:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:47:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:47:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:47:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:47:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:47:57.835 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:47:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:47:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:47:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:47:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:47:57.836 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:47:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:47:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:47:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:47:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:47:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:47:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.837 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:47:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:47:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:47:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:47:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:47:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:47:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:47:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:47:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:47:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:47:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:47:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:47:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:47:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:47:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.839 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:47:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:47:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:47:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:47:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.3799999952316284, 2023-08-09T12:47:57.840 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.3799999952316284, 2023-08-09T12:47:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:47:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-09T12:47:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-09T12:47:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:47:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:47:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:47:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:47:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:47:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:47:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:57.842 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:57.843 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:47:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:57.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:47:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:47:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:57.847 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:47:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:47:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:47:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:47:57.850 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:47:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:47:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:47:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:47:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:47:57.851 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:47:57.852 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:57.853 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.854 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:47:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:47:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:47:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:47:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:47:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:47:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:47:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:47:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:47:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:47:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:47:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:47:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:47:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:47:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:47:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:47:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:47:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:47:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:47:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:47:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:47:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:57.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:47:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:47:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:47:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:47:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:47:57.879 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:47:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:57.880 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:57.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.881 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:47:57.882 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:57.882 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:57.882 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:57.882 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:57.882 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:57.883 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:57.883 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:57.883 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:57.883 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:57.884 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:57.884 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:57.884 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:57.884 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.885 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:47:57.885 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:57.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:47:57.886 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:57.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.886 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.886 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:57.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:47:57.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:57.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:47:57.888 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:57.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.888 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.888 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:57.888 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.889 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:47:57.889 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:57.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.889 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:47:57.890 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:57.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.890 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:57.890 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:47:57.891 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:57.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:47:57.891 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:47:57.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.892 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.892 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:47:57.892 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:47:57.892 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:47:57.892 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:47:57.893 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:57.893 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:57.893 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:57.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.894 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:47:57.894 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:57.894 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:57.894 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:57.894 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:57.894 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:57.895 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:57.895 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:57.895 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:57.895 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:57.896 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:57.896 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:57.896 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:57.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:47:57.897 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:57.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:47:57.899 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:57.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:47:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:47:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:47:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:47:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:47:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:47:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:47:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:47:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:47:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:47:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:47:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:47:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:47:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:47:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:47:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:47:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:47:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:47:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:47:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:47:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:47:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:47:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:47:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:47:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:47:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:47:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:47:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:47:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:47:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:47:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:47:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:47:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:47:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:47:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:47:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:47:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:47:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:47:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:47:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:47:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:47:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:47:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:47:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:47:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:47:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:47:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:47:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:47:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:47:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:47:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:47:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:47:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:47:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:47:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:47:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:47:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:47:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:47:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:47:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:47:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:47:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:47:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:47:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:47:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:47:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:47:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:47:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:47:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:47:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:47:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:47:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:47:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:47:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:47:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:47:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:47:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:47:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:47:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:47:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:47:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:47:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:47:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:47:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:47:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:47:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:47:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:47:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:47:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:47:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:47:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:47:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:47:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:47:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:47:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:47:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:47:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:47:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:47:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:47:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:47:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:47:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:47:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:47:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:47:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:47:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:47:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:47:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:47:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:47:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:47:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:47:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:47:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:47:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:47:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:47:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:47:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:47:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:47:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:47:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:47:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:47:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:47:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:47:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:47:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:47:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:47:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:47:57.965 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:47:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.786+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f62a406a080 msgr2=0x7f62a406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.786+0000 7f62c89b0640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f62a406a080 0x7f62a406c540 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f62c40cae10 tx=0x7f62b400b040 comp rx=0 tx=0).stop 2023-08-09T12:47:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.786+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 msgr2=0x7f62c4157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:47:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.786+0000 7f62c89b0640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c4157a30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c750 tx=0x7f62ac00cc10 comp rx=0 tx=0).stop 2023-08-09T12:47:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.787+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 shutdown_connections 2023-08-09T12:47:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.787+0000 7f62c89b0640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f62a406a080 0x7f62a406c540 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.787+0000 7f62c89b0640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c4160030 0x7f62c4157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.787+0000 7f62c89b0640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62c40cfb50 0x7f62c4157a30 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.787+0000 7f62c89b0640 1 --2- 172.21.15.17:0/3124107290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c40b86e0 0x7f62c41549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:47:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.787+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 >> 172.21.15.17:0/3124107290 conn(0x7f62c40697c0 msgr2=0x7f62c40c7030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:47:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.787+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 shutdown_connections 2023-08-09T12:47:57.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:47:57.787+0000 7f62c89b0640 1 -- 172.21.15.17:0/3124107290 wait complete. 2023-08-09T12:47:57.971 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:48:02.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:48:03.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.209+0000 7f87b0d74640 1 Processor -- start 2023-08-09T12:48:03.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.210+0000 7f87b0d74640 1 -- start start 2023-08-09T12:48:03.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.211+0000 7f87b0d74640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f87ac1601f0 0x7f87ac0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:03.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.211+0000 7f87b0d74640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f87ac0cb610 0x7f87ac0c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.211+0000 7f87b0d74640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0b34a0 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.211+0000 7f87b0d74640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0b4120 con 0x7f87ac1601f0 2023-08-09T12:48:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.211+0000 7f87b0d74640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0b3780 con 0x7f87ac0cb610 2023-08-09T12:48:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.212+0000 7f87ab7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f87ac1601f0 0x7f87ac0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.212+0000 7f87ab7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f87ac1601f0 0x7f87ac0b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50078/0 (socket says 172.21.15.17:50078) 2023-08-09T12:48:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.212+0000 7f87ab7fe640 1 -- 172.21.15.17:0/457154001 learned_addr learned my addr 172.21.15.17:0/457154001 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.212+0000 7f87abfff640 1 --2- 172.21.15.17:0/457154001 >> v2:172.21.15.142:3300/0 conn(0x7f87ac0cb610 0x7f87ac0c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.212+0000 7f87ab7fe640 1 -- 172.21.15.17:0/457154001 >> v2:172.21.15.142:3300/0 conn(0x7f87ac0cb610 msgr2=0x7f87ac0c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.212+0000 7f87ab7fe640 1 --2- 172.21.15.17:0/457154001 >> v2:172.21.15.142:3300/0 conn(0x7f87ac0cb610 0x7f87ac0c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.212+0000 7f87ab7fe640 1 -- 172.21.15.17:0/457154001 >> v1:172.21.15.142:6789/0 conn(0x7f87ac0b2ee0 legacy=0x7f87ac0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:03.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.212+0000 7f87ab7fe640 1 -- 172.21.15.17:0/457154001 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0b3a60 con 0x7f87ac1601f0 2023-08-09T12:48:03.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.214+0000 7f87ab7fe640 1 --2- 172.21.15.17:0/457154001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac1601f0 0x7f87ac0b29a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0c8cf0 tx=0x7f879c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c6db04ad925aa1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:03.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.214+0000 7f87aa7fc640 1 -- 172.21.15.17:0/457154001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c031870 con 0x7f87ac1601f0 2023-08-09T12:48:03.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.214+0000 7f87aa7fc640 1 -- 172.21.15.17:0/457154001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c0319d0 con 0x7f87ac1601f0 2023-08-09T12:48:03.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.214+0000 7f87aa7fc640 1 -- 172.21.15.17:0/457154001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c031d60 con 0x7f87ac1601f0 2023-08-09T12:48:03.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.215+0000 7f87b0d74640 1 -- 172.21.15.17:0/457154001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac1601f0 msgr2=0x7f87ac0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:03.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.215+0000 7f87b0d74640 1 --2- 172.21.15.17:0/457154001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac1601f0 0x7f87ac0b29a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0c8cf0 tx=0x7f879c02b910 comp rx=0 tx=0).stop 2023-08-09T12:48:03.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.215+0000 7f87b0d74640 1 -- 172.21.15.17:0/457154001 shutdown_connections 2023-08-09T12:48:03.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.215+0000 7f87b0d74640 1 --2- 172.21.15.17:0/457154001 >> v2:172.21.15.142:3300/0 conn(0x7f87ac0cb610 0x7f87ac0c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.215+0000 7f87b0d74640 1 --2- 172.21.15.17:0/457154001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac1601f0 0x7f87ac0b29a0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.215+0000 7f87b0d74640 1 -- 172.21.15.17:0/457154001 >> 172.21.15.17:0/457154001 conn(0x7f87ac0b1d50 msgr2=0x7f87ac06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:03.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.215+0000 7f87b0d74640 1 -- 172.21.15.17:0/457154001 shutdown_connections 2023-08-09T12:48:03.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.215+0000 7f87b0d74640 1 -- 172.21.15.17:0/457154001 wait complete. 2023-08-09T12:48:03.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.218+0000 7f87b0d74640 1 Processor -- start 2023-08-09T12:48:03.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.218+0000 7f87b0d74640 1 -- start start 2023-08-09T12:48:03.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.219+0000 7f87b0d74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac0b2ee0 0x7f87ac145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:03.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.219+0000 7f87b0d74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0cb610 0x7f87ac157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:03.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.219+0000 7f87b0d74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87ac1601f0 0x7f87ac1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:03.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.219+0000 7f87b0d74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac1590c0 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.219+0000 7f87b0d74640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac1458a0 con 0x7f87ac1601f0 2023-08-09T12:48:03.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.219+0000 7f87b0d74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0c2cb0 con 0x7f87ac0cb610 2023-08-09T12:48:03.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac0b2ee0 0x7f87ac145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:03.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac0b2ee0 0x7f87ac145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50094/0 (socket says 172.21.15.17:50094) 2023-08-09T12:48:03.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87ab7fe640 1 -- 172.21.15.17:0/3569762769 learned_addr learned my addr 172.21.15.17:0/3569762769 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:03.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87abfff640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87ac1601f0 0x7f87ac1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:03.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87ab7fe640 1 -- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0cb610 msgr2=0x7f87ac157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:03.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87ab7fe640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0cb610 0x7f87ac157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87ab7fe640 1 -- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87ac1601f0 msgr2=0x7f87ac1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:03.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87ab7fe640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87ac1601f0 0x7f87ac1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87ab7fe640 1 -- 172.21.15.17:0/3569762769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0094d0 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.220+0000 7f87abfff640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87ac1601f0 0x7f87ac1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:03.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.221+0000 7f87ab7fe640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac0b2ee0 0x7f87ac145360 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f879c000c00 tx=0x7f879c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:03.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.221+0000 7f8793fff640 1 -- 172.21.15.17:0/3569762769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c03abe0 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.221+0000 7f8793fff640 1 -- 172.21.15.17:0/3569762769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c03ad40 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.221+0000 7f8793fff640 1 -- 172.21.15.17:0/3569762769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c044610 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.221+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac158820 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.221+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac158de0 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.222+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac0c2a60 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.224+0000 7f8793fff640 1 -- 172.21.15.17:0/3569762769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f879c04d450 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.226+0000 7f8793fff640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f879806a080 0x7f879806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.226+0000 7f8793fff640 1 -- 172.21.15.17:0/3569762769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f879c02d040 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.226+0000 7f8793fff640 1 -- 172.21.15.17:0/3569762769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f87980721d0 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.226+0000 7f87aaffd640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f879806a080 0x7f879806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.227+0000 7f87aaffd640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f879806a080 0x7f879806c540 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0cc8a0 tx=0x7f87a00079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:03.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.231+0000 7f8793fff640 1 -- 172.21.15.17:0/3569762769 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f879c076260 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.426+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f87ac04e390 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.429+0000 7f8793fff640 1 -- 172.21.15.17:0/3569762769 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+37012 (secure 0 0 0) 0x7f879c035020 con 0x7f87ac0b2ee0 2023-08-09T12:48:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:03.434 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:48:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 148, 2023-08-09T12:48:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:48:03.434 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:48:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:47:58.837923+0000", 2023-08-09T12:48:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:48:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:48:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:48:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:48:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:48:03.435 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:48:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:48:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:48:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:48:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:48:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:48:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:48:03.436 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:48:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:48:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 18, 2023-08-09T12:48:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:48:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:48:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:48:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:48:03.437 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:48:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:48:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:48:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:48:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:48:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:03.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:48:03.440 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:48:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:48:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:48:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:48:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:03.441 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:03.442 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:03.443 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:03.444 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.446 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:03.447 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:48:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:48:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.448 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:48:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:48:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:48:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:48:03.449 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:48:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:48:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.450 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:48:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:48:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:48:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:03.451 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:03.452 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:48:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:48:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:48:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:48:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:48:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:03.453 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:03.454 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:03.455 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:48:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:48:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:48:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:48:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:48:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:48:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:48:03.461 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 17, 2023-08-09T12:48:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:48:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:36.431201+0000", 2023-08-09T12:48:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:03.463 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:48:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:48:03.464 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:48:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:48:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:48:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:03.465 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "145", 2023-08-09T12:48:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:03.466 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:03.467 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:03.469 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:03.470 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:03.471 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:48:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:48:03.472 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:48:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:48:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.473 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:48:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:48:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:48:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:48:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:03.474 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 18, 2023-08-09T12:48:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:48:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:37.108075+0000", 2023-08-09T12:48:03.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1027, 2023-08-09T12:48:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-09T12:48:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:03.476 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:48:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:48:03.477 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:48:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:48:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:48:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:03.478 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "148", 2023-08-09T12:48:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:03.479 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:03.480 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:48:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:03.481 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:03.482 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:03.483 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:03.484 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:03.485 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:48:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:48:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:03.486 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:48:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.3799999952316284, 2023-08-09T12:48:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.3799999952316284, 2023-08-09T12:48:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-09T12:48:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-09T12:48:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.488 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:48:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:03.489 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:03.490 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:48:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:48:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:03.492 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:48:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.493 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:48:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:48:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:48:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:03.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:48:03.496 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:48:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:48:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:48:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:48:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:48:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:03.498 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:03.499 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:03.500 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:48:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:48:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.502 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:48:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:48:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:48:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:48:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:48:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:48:03.508 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:48:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:48:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:48:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:48:03.509 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:03.510 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:03.511 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:48:03.512 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:48:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.513 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:48:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:03.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:48:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.515 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:48:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:48:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:03.517 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:48:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:48:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:48:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:48:03.519 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:48:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:48:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:03.521 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:03.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:48:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:48:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:48:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:48:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:48:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:48:03.527 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.528 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:48:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:48:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:03.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:48:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:48:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:48:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:48:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:03.530 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:03.531 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:03.532 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:48:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:48:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:03.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:48:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:48:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:03.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:48:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:48:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:48:03.539 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:48:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:48:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:48:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:48:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:48:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:03.541 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:03.542 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:03.543 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:48:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:03.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:48:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.545 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:48:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:48:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:03.547 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:48:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:48:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:48:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.550 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:48:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:48:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:48:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:48:03.551 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:48:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:03.553 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.554 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:48:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:48:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:03.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.556 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:48:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:48:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:48:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:48:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:48:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:48:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:48:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:48:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:48:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:48:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:48:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:48:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:48:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:48:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:48:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:48:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:48:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:48:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:48:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:48:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:48:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:48:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:48:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:48:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:48:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:48:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:48:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:48:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:48:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:48:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:48:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:48:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:48:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:48:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:48:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:48:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:48:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:48:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:48:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:48:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:48:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:03.588 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:48:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f879806a080 msgr2=0x7f879806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f879806a080 0x7f879806c540 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0cc8a0 tx=0x7f87a00079b0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac0b2ee0 msgr2=0x7f87ac145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:03.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac0b2ee0 0x7f87ac145360 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f879c000c00 tx=0x7f879c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 shutdown_connections 2023-08-09T12:48:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f879806a080 0x7f879806c540 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87ac1601f0 0x7f87ac1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87ac0cb610 0x7f87ac157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 --2- 172.21.15.17:0/3569762769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac0b2ee0 0x7f87ac145360 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 >> 172.21.15.17:0/3569762769 conn(0x7f87ac0b1d50 msgr2=0x7f87ac15f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 shutdown_connections 2023-08-09T12:48:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:03.432+0000 7f87b0d74640 1 -- 172.21.15.17:0/3569762769 wait complete. 2023-08-09T12:48:03.591 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-09T12:48:03.592 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:48:03.592 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:03.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:03.656 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-08-09T12:48:04.100 INFO:teuthology.orchestra.run.smithi017.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-08-09T12:48:04.100 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records in 2023-08-09T12:48:04.100 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records out 2023-08-09T12:48:04.101 INFO:teuthology.orchestra.run.smithi017.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.375024 s, 140 MB/s 2023-08-09T12:48:04.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:48:04.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:48:04.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.321+0000 7f4aa4fdd640 1 Processor -- start 2023-08-09T12:48:04.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.322+0000 7f4aa4fdd640 1 -- start start 2023-08-09T12:48:04.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.323+0000 7f4aa4fdd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4aa015cab0 0x7f4aa00cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.323+0000 7f4aa4fdd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00cbf50 con 0x7f4aa015ce90 2023-08-09T12:48:04.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.323+0000 7f4aa4fdd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00caed0 con 0x7f4aa00b2a10 2023-08-09T12:48:04.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.323+0000 7f4aa4fdd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa00cb1b0 con 0x7f4aa015cab0 2023-08-09T12:48:04.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.324+0000 7f4a9effd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4aa015ce90 0x7f4aa00b2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53676/0 (socket says 172.21.15.17:53676) 2023-08-09T12:48:04.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.324+0000 7f4a9effd640 1 -- 172.21.15.17:0/623531740 learned_addr learned my addr 172.21.15.17:0/623531740 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:04.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.324+0000 7f4a9f7fe640 1 --2- 172.21.15.17:0/623531740 >> v2:172.21.15.142:3300/0 conn(0x7f4aa015cab0 0x7f4aa00cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.324+0000 7f4a9e7fc640 1 -- 172.21.15.17:0/623531740 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136482590 0 0) 0x7f4aa00cbf50 con 0x7f4aa015ce90 2023-08-09T12:48:04.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.324+0000 7f4a9e7fc640 1 -- 172.21.15.17:0/623531740 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a88003520 con 0x7f4aa015ce90 2023-08-09T12:48:04.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.325+0000 7f4a9e7fc640 1 -- 172.21.15.17:0/623531740 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079120235 0 0) 0x7f4a88003520 con 0x7f4aa015ce90 2023-08-09T12:48:04.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.325+0000 7f4a9f7fe640 1 -- 172.21.15.17:0/623531740 >> v1:172.21.15.142:6789/0 conn(0x7f4aa00b2a10 legacy=0x7f4aa00ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.325+0000 7f4a9f7fe640 1 -- 172.21.15.17:0/623531740 >> v1:172.21.15.17:6789/0 conn(0x7f4aa015ce90 legacy=0x7f4aa00b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.325+0000 7f4a9f7fe640 1 -- 172.21.15.17:0/623531740 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00cb490 con 0x7f4aa015cab0 2023-08-09T12:48:04.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.326+0000 7f4a9f7fe640 1 --2- 172.21.15.17:0/623531740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 0x7f4aa00cb8e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4a900097a0 tx=0x7f4a9002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab7a9576cbed94d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:04.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4a9e7fc640 1 -- 172.21.15.17:0/623531740 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94001670 con 0x7f4aa015cab0 2023-08-09T12:48:04.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4a9e7fc640 1 -- 172.21.15.17:0/623531740 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9002e050 con 0x7f4aa015cab0 2023-08-09T12:48:04.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4a9e7fc640 1 -- 172.21.15.17:0/623531740 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90030730 con 0x7f4aa015cab0 2023-08-09T12:48:04.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/623531740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 msgr2=0x7f4aa00cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4aa4fdd640 1 --2- 172.21.15.17:0/623531740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 0x7f4aa00cb8e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4a900097a0 tx=0x7f4a9002b790 comp rx=0 tx=0).stop 2023-08-09T12:48:04.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/623531740 shutdown_connections 2023-08-09T12:48:04.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4aa4fdd640 1 --2- 172.21.15.17:0/623531740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 0x7f4aa00cb8e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/623531740 >> 172.21.15.17:0/623531740 conn(0x7f4aa00cd300 msgr2=0x7f4aa00cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:04.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.327+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/623531740 shutdown_connections 2023-08-09T12:48:04.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.328+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/623531740 wait complete. 2023-08-09T12:48:04.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.329+0000 7f4aa4fdd640 1 Processor -- start 2023-08-09T12:48:04.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.329+0000 7f4aa4fdd640 1 -- start start 2023-08-09T12:48:04.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.330+0000 7f4aa4fdd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa00b2a10 0x7f4aa01f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.330+0000 7f4aa4fdd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 0x7f4aa01f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.330+0000 7f4aa4fdd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4aa014ea40 0x7f4aa015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.330+0000 7f4aa4fdd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa015e6c0 con 0x7f4aa00b2a10 2023-08-09T12:48:04.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.330+0000 7f4aa4fdd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa015e9a0 con 0x7f4aa015cab0 2023-08-09T12:48:04.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.330+0000 7f4aa4fdd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa015ec80 con 0x7f4aa014ea40 2023-08-09T12:48:04.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa00b2a10 0x7f4aa01f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa00b2a10 0x7f4aa01f5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50106/0 (socket says 172.21.15.17:50106) 2023-08-09T12:48:04.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9f7fe640 1 -- 172.21.15.17:0/3748382170 learned_addr learned my addr 172.21.15.17:0/3748382170 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:04.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9effd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 0x7f4aa01f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9ffff640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4aa014ea40 0x7f4aa015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9f7fe640 1 -- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4aa014ea40 msgr2=0x7f4aa015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9f7fe640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4aa014ea40 0x7f4aa015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9f7fe640 1 -- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 msgr2=0x7f4aa01f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9f7fe640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 0x7f4aa01f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9f7fe640 1 -- 172.21.15.17:0/3748382170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a90009400 con 0x7f4aa00b2a10 2023-08-09T12:48:04.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.331+0000 7f4a9effd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 0x7f4aa01f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:04.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.332+0000 7f4a9f7fe640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa00b2a10 0x7f4aa01f5aa0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4a90035040 tx=0x7f4a900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:04.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.332+0000 7f4a87fff640 1 -- 172.21.15.17:0/3748382170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90004220 con 0x7f4aa00b2a10 2023-08-09T12:48:04.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.332+0000 7f4a87fff640 1 -- 172.21.15.17:0/3748382170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a90004380 con 0x7f4aa00b2a10 2023-08-09T12:48:04.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.332+0000 7f4a87fff640 1 -- 172.21.15.17:0/3748382170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9003c8c0 con 0x7f4aa00b2a10 2023-08-09T12:48:04.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.332+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa015ef60 con 0x7f4aa00b2a10 2023-08-09T12:48:04.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.332+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa015e070 con 0x7f4aa00b2a10 2023-08-09T12:48:04.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.333+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa004e390 con 0x7f4aa00b2a10 2023-08-09T12:48:04.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.334+0000 7f4a87fff640 1 -- 172.21.15.17:0/3748382170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4a90039040 con 0x7f4aa00b2a10 2023-08-09T12:48:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.335+0000 7f4a87fff640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a8c06a050 0x7f4a8c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.335+0000 7f4a87fff640 1 -- 172.21.15.17:0/3748382170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a900a9ee0 con 0x7f4aa00b2a10 2023-08-09T12:48:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.335+0000 7f4a87fff640 1 -- 172.21.15.17:0/3748382170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f4a8c0721a0 con 0x7f4aa00b2a10 2023-08-09T12:48:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.336+0000 7f4a9effd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a8c06a050 0x7f4a8c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.337+0000 7f4a9effd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a8c06a050 0x7f4a8c06c510 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0160160 tx=0x7f4a94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:04.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.340+0000 7f4a87fff640 1 -- 172.21.15.17:0/3748382170 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4a90037070 con 0x7f4aa00b2a10 2023-08-09T12:48:04.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.536+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4aa00b3630 con 0x7f4aa00b2a10 2023-08-09T12:48:04.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.538+0000 7f4a87fff640 1 -- 172.21.15.17:0/3748382170 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+37012 (secure 0 0 0) 0x7f4a900756e0 con 0x7f4aa00b2a10 2023-08-09T12:48:04.542 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:04.542 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:48:04.542 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 148, 2023-08-09T12:48:04.543 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:48:04.543 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:48:04.543 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:47:58.837923+0000", 2023-08-09T12:48:04.543 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:48:04.543 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:48:04.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:48:04.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:48:04.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:48:04.544 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:48:04.544 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:48:04.544 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:48:04.545 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:48:04.545 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:04.545 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:48:04.546 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:48:04.546 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:48:04.546 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:48:04.546 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:48:04.547 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 18, 2023-08-09T12:48:04.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:48:04.547 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:48:04.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:48:04.547 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:48:04.547 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:48:04.547 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:48:04.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.548 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:48:04.548 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:48:04.548 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:48:04.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:04.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:04.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:04.549 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:04.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:04.549 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:04.549 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:04.549 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:04.549 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:04.550 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:04.550 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:04.550 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:04.550 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:48:04.550 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:48:04.550 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:48:04.551 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:48:04.551 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:48:04.551 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:04.552 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:04.552 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:04.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:04.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:04.553 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:04.553 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:04.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.554 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:04.554 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:04.554 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:04.555 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:04.555 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:04.555 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:04.555 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:04.555 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:04.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:04.556 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:04.556 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:04.556 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:04.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:04.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:04.557 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:04.558 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:04.558 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:04.558 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:04.559 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:04.559 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:04.559 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:04.559 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:04.560 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:04.560 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:04.560 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:04.560 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:04.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:04.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.561 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:04.561 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:04.562 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:04.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:04.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:04.562 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:04.563 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:04.563 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:04.563 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:04.563 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:04.563 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:04.563 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:04.563 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:48:04.564 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:48:04.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.564 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:04.564 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:48:04.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.565 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:04.565 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:48:04.565 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:48:04.565 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:48:04.565 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:48:04.565 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:48:04.566 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:04.566 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:04.566 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:04.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.567 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:48:04.567 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:48:04.567 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:48:04.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:04.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:04.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:04.567 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:04.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:04.568 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:04.568 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:04.568 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:04.568 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:04.568 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:48:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:48:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:48:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:48:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:48:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:04.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:04.571 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:04.571 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:04.572 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:04.572 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:04.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.572 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:04.573 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:04.573 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:04.573 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:04.573 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:04.574 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:04.574 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:04.574 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:04.574 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:04.575 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:04.575 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:04.575 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:04.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:04.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:04.576 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:04.576 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:04.577 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:04.577 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:04.577 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:04.577 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:04.578 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:04.578 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:04.578 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:04.578 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:04.579 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:04.579 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:04.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:04.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.579 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:04.580 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:04.580 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:04.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:04.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:04.580 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:04.580 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:04.581 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:04.581 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:04.581 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:04.581 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:04.581 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:48:04.581 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:04.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:48:04.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.582 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:04.582 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:48:04.582 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:48:04.582 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:48:04.582 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:48:04.582 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:48:04.583 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:04.583 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:04.583 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:04.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.583 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 17, 2023-08-09T12:48:04.584 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:48:04.584 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:36.431201+0000", 2023-08-09T12:48:04.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:04.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:04.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:04.584 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:04.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:04.585 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:04.585 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:04.585 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:04.585 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:04.585 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:04.585 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:04.585 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:04.585 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:48:04.586 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:48:04.586 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:48:04.586 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:48:04.586 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:48:04.586 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:04.587 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:04.587 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:04.587 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:04.587 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:04.587 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:04.587 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:04.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.588 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "145", 2023-08-09T12:48:04.588 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:04.588 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:04.589 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:04.589 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:04.589 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:04.589 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:04.590 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:04.590 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:04.590 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:04.590 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:04.590 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:04.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:04.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:04.591 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:04.591 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:04.591 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:04.591 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:04.591 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:04.591 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:04.592 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:04.592 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:04.592 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:04.592 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:04.593 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:04.593 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:04.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:04.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.593 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:04.593 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:04.593 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:04.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:04.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:04.594 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:04.594 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:04.594 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:04.594 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:04.595 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:04.595 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:04.595 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:04.595 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:48:04.595 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:48:04.595 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:48:04.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.595 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:04.596 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:04.596 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:48:04.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.596 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:04.596 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:48:04.596 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:48:04.597 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:04.597 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:48:04.597 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:48:04.597 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:04.597 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:04.597 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:04.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.598 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 18, 2023-08-09T12:48:04.598 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:48:04.598 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:37.108075+0000", 2023-08-09T12:48:04.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1027, 2023-08-09T12:48:04.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-09T12:48:04.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:04.600 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:04.600 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:48:04.600 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:48:04.600 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:48:04.600 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:48:04.600 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:48:04.600 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:04.600 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:04.601 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:04.601 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:04.601 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:04.601 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:04.601 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:04.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.601 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "148", 2023-08-09T12:48:04.601 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:04.602 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:04.602 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:04.602 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:04.602 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:04.602 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:04.602 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:04.602 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:04.603 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:04.603 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:48:04.603 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:04.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:04.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:04.603 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:04.603 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:04.603 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:04.604 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:04.604 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:04.604 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:04.604 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:04.604 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:04.604 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:04.604 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:04.604 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:04.605 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:04.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:04.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.605 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:04.605 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:04.605 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:04.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:04.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:04.606 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:04.606 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:04.606 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:04.606 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:04.606 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:04.606 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:04.606 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:04.607 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:48:04.607 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:48:04.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.607 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:04.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:04.607 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:48:04.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.608 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:04.608 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.3799999952316284, 2023-08-09T12:48:04.608 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.3799999952316284, 2023-08-09T12:48:04.608 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:04.608 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-09T12:48:04.608 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-09T12:48:04.608 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:04.608 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:04.609 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:04.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.609 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:04.609 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:48:04.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.609 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:04.609 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:04.610 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:04.610 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:04.610 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:04.610 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:04.610 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:04.610 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:04.610 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:04.611 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:04.611 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:04.611 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:04.611 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:04.611 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.611 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.611 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:48:04.612 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:04.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.612 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:48:04.612 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:04.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.612 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.613 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:04.613 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.613 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:48:04.613 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:04.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.614 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:48:04.614 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:04.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.614 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.614 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:04.615 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.615 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:48:04.615 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:04.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.616 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:48:04.616 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:04.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.616 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.616 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:04.616 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.617 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:48:04.617 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:04.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.617 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:48:04.618 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:04.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.618 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.618 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:48:04.618 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:48:04.618 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:48:04.618 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:48:04.619 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:04.619 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:04.619 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:04.619 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.619 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:04.619 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:04.620 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:04.620 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:04.620 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:04.620 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:04.620 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:04.620 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:04.620 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:04.620 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:04.621 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:04.621 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:04.621 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:04.621 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.621 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:48:04.622 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:04.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.623 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:48:04.623 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:04.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.623 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.624 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:04.624 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.624 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:48:04.624 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:04.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.625 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:48:04.625 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:04.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.625 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.626 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:04.626 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.626 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:48:04.626 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:04.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.627 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:48:04.627 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:04.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.627 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:04.627 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.628 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:48:04.628 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:04.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.628 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:48:04.629 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:04.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.629 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.629 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:48:04.629 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:48:04.629 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:48:04.630 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:48:04.630 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:04.630 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:04.630 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:04.630 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.630 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:04.631 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:04.631 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:04.631 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:04.631 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:04.631 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:04.631 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:04.631 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:04.631 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:48:04.633 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:04.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.633 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:48:04.633 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:04.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.633 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.634 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:04.634 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.634 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:48:04.634 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:04.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.635 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:48:04.635 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:04.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.635 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.636 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:04.636 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.636 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:48:04.636 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:04.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.637 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:48:04.637 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:04.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.637 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:04.637 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.638 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:48:04.638 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:04.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.638 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:48:04.639 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:04.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.639 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.639 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:48:04.639 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:48:04.639 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:48:04.640 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:48:04.640 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:04.640 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:04.640 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:04.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.640 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:04.642 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:04.642 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:04.642 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:04.642 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:04.642 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.642 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:48:04.643 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:04.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.643 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:48:04.643 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:04.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.643 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.644 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:04.644 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.644 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:48:04.644 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:04.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.645 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:48:04.645 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:04.645 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.645 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.645 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:04.646 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.646 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:48:04.646 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:04.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.647 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:48:04.647 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:04.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.647 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.647 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:04.647 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:48:04.648 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:04.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:48:04.649 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:04.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.649 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.649 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:48:04.649 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:48:04.649 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:48:04.649 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:48:04.650 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:04.650 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:04.650 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:04.650 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.650 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:04.650 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:48:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:04.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.653 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:48:04.653 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:04.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.653 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.654 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:04.654 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.654 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:48:04.654 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:04.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.655 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:48:04.655 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:04.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.655 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.655 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:04.656 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.656 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:48:04.656 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:04.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.657 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:48:04.657 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:04.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.657 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:04.657 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:48:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:48:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:48:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:48:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:48:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:48:04.660 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:04.660 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:04.660 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:04.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:04.661 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:04.661 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:04.661 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:04.661 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:04.661 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:04.661 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:04.661 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:04.661 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.662 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:48:04.663 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:04.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.663 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:48:04.663 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:04.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.663 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.664 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:04.664 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.664 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:48:04.664 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:04.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:48:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:48:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.667 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:48:04.667 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:04.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.667 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.667 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:04.667 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.668 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:48:04.668 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:04.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.668 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:48:04.669 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:04.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.669 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:48:04.669 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:48:04.669 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:48:04.669 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:48:04.670 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:04.670 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:04.670 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:04.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:04.670 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:04.671 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:04.671 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:04.671 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:04.671 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:04.671 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:04.671 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:04.671 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:04.671 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:04.672 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:04.672 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:04.672 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:04.672 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.672 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:48:04.672 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:04.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.673 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:48:04.673 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:04.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.673 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.674 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:04.674 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.674 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:48:04.674 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:04.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.675 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:48:04.675 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:04.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.675 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:04.676 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.676 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:48:04.676 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:04.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.677 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:48:04.677 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:04.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.677 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:04.677 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.678 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:48:04.678 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:04.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.678 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:48:04.678 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:04.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.679 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:48:04.679 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:48:04.679 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:48:04.679 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:48:04.680 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:04.680 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:04.680 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:04.680 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.680 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:04.680 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:04.681 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:04.681 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:04.681 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:04.681 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:04.681 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:04.681 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:04.681 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:04.681 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:04.682 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:04.682 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:04.682 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:04.682 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.682 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:48:04.682 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:04.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.683 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:48:04.683 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:04.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.684 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:04.684 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.684 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:48:04.684 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:04.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.685 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:48:04.685 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:04.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.685 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.685 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:04.686 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.686 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:48:04.686 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:04.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.687 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:48:04.687 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:04.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.687 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.687 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:04.687 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:04.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:04.688 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:48:04.688 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:04.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:04.688 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:48:04.689 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:04.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.689 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.689 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:48:04.689 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:48:04.689 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:48:04.689 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:48:04.690 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:04.690 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:04.690 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:04.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:04.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.690 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:04.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:48:04.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:04.691 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:04.691 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:04.691 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:04.691 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:04.691 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:04.691 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:48:04.691 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:04.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:04.692 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:04.692 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:04.692 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:04.692 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:04.693 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:04.693 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:48:04.693 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:04.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:04.693 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:04.693 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:04.694 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:04.694 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:04.694 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:04.694 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:48:04.694 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:04.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:04.695 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:04.695 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:04.695 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:04.695 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:04.695 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:04.695 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:48:04.695 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:04.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:04.696 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:04.696 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:04.696 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:04.696 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:04.696 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:04.696 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:48:04.697 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:04.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:04.697 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:04.697 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:04.697 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:04.698 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:04.698 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:04.698 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:48:04.698 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:04.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:04.698 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:04.699 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:04.699 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:04.699 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:04.699 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:04.699 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:48:04.699 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:04.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:04.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:04.700 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:04.700 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:04.700 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:04.700 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:04.700 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:04.700 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:48:04.700 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:04.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.701 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:04.701 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:48:04.701 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:48:04.701 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:48:04.701 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:48:04.701 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:48:04.701 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:48:04.702 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:48:04.702 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:48:04.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:48:04.702 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:48:04.702 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:48:04.702 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:48:04.702 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:48:04.702 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:48:04.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:04.703 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:48:04.703 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:48:04.703 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:48:04.703 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:48:04.703 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:48:04.704 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:48:04.704 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:48:04.704 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:48:04.704 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:48:04.704 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:48:04.704 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:48:04.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:04.704 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:48:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a8c06a050 msgr2=0x7f4a8c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a8c06a050 0x7f4a8c06c510 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0160160 tx=0x7f4a94009040 comp rx=0 tx=0).stop 2023-08-09T12:48:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa00b2a10 msgr2=0x7f4aa01f5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa00b2a10 0x7f4aa01f5aa0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4a90035040 tx=0x7f4a900046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 shutdown_connections 2023-08-09T12:48:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4a8c06a050 0x7f4a8c06c510 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4aa014ea40 0x7f4aa015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa015cab0 0x7f4aa01f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 --2- 172.21.15.17:0/3748382170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa00b2a10 0x7f4aa01f5aa0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.541+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 >> 172.21.15.17:0/3748382170 conn(0x7f4aa00cd300 msgr2=0x7f4aa015a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.542+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 shutdown_connections 2023-08-09T12:48:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.542+0000 7f4aa4fdd640 1 -- 172.21.15.17:0/3748382170 wait complete. 2023-08-09T12:48:04.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.947+0000 7fa1e520b640 1 Processor -- start 2023-08-09T12:48:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.947+0000 7fa1e520b640 1 -- start start 2023-08-09T12:48:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.949+0000 7fa1e520b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 0x7fa1e00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.949+0000 7fa1e520b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e00b4630 con 0x7fa1e00ad810 2023-08-09T12:48:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.949+0000 7fa1e520b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e00b3ab0 con 0x7fa1e0159d80 2023-08-09T12:48:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.949+0000 7fa1e520b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e015a160 con 0x7fa1e0070a90 2023-08-09T12:48:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.949+0000 7fa1df59e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa1e00ad810 0x7fa1e00c8fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53690/0 (socket says 172.21.15.17:53690) 2023-08-09T12:48:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.949+0000 7fa1df59e640 1 -- 172.21.15.17:0/1461462176 learned_addr learned my addr 172.21.15.17:0/1461462176 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1de59c640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 0x7fa1e00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515979410 0 0) 0x7fa1e00b4630 con 0x7fa1e00ad810 2023-08-09T12:48:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c8003520 con 0x7fa1e00ad810 2023-08-09T12:48:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807245247 0 0) 0x7fa1c8003520 con 0x7fa1e00ad810 2023-08-09T12:48:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 msgr2=0x7fa1e00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 0x7fa1e00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 >> v1:172.21.15.142:6789/0 conn(0x7fa1e0159d80 legacy=0x7fa1e0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e00b3d90 con 0x7fa1e00ad810 2023-08-09T12:48:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa1d80019f0 con 0x7fa1e00ad810 2023-08-09T12:48:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 >> v1:172.21.15.17:6789/0 conn(0x7fa1e00ad810 legacy=0x7fa1e00c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c80039a0 0x7fa1c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 0x7fa1c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c8004d00 0x7fa1c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e015a160 con 0x7fa1c80039a0 2023-08-09T12:48:04.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c800dc40 con 0x7fa1c8004d00 2023-08-09T12:48:04.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.950+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c800de00 con 0x7fa1e0070a90 2023-08-09T12:48:04.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1ded9d640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c80039a0 0x7fa1c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1df59e640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c8004d00 0x7fa1c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1de59c640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 0x7fa1c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1ded9d640 1 -- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 msgr2=0x7fa1c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:04.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1ded9d640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 0x7fa1c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1ded9d640 1 -- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c8004d00 msgr2=0x7fa1c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:04.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1ded9d640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c8004d00 0x7fa1c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1ded9d640 1 -- 172.21.15.17:0/1461462176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c8003520 con 0x7fa1c80039a0 2023-08-09T12:48:04.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1de59c640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1e0070a90 0x7fa1c80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:48:04.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.951+0000 7fa1df59e640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c8004d00 0x7fa1c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:48:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.953+0000 7fa1ded9d640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c80039a0 0x7fa1c8003dc0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0001720 tx=0x7fa1c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04c1d7c491ab20d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.953+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00052d0 con 0x7fa1c80039a0 2023-08-09T12:48:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.953+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d002e050 con 0x7fa1c80039a0 2023-08-09T12:48:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.953+0000 7fa1ddd9b640 1 -- 172.21.15.17:0/1461462176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00035f0 con 0x7fa1c80039a0 2023-08-09T12:48:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.954+0000 7fa1e520b640 1 -- 172.21.15.17:0/1461462176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c80039a0 msgr2=0x7fa1c8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.954+0000 7fa1e520b640 1 --2- 172.21.15.17:0/1461462176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c80039a0 0x7fa1c8003dc0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0001720 tx=0x7fa1c80057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.954+0000 7fa1df59e640 1 -- 172.21.15.17:0/1461462176 reap_dead start 2023-08-09T12:48:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.954+0000 7fa1e520b640 1 -- 172.21.15.17:0/1461462176 shutdown_connections 2023-08-09T12:48:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.954+0000 7fa1e520b640 1 -- 172.21.15.17:0/1461462176 >> 172.21.15.17:0/1461462176 conn(0x7fa1e00cb1b0 msgr2=0x7fa1e00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.954+0000 7fa1e520b640 1 -- 172.21.15.17:0/1461462176 shutdown_connections 2023-08-09T12:48:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.954+0000 7fa1e520b640 1 -- 172.21.15.17:0/1461462176 wait complete. 2023-08-09T12:48:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.956+0000 7fa1e520b640 1 Processor -- start 2023-08-09T12:48:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.956+0000 7fa1e520b640 1 -- start start 2023-08-09T12:48:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1e520b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c80039a0 0x7fa1e014f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1e520b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e00c6d60 0x7fa1e00c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1e520b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e00ac8b0 0x7fa1e00acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1e520b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e00af630 con 0x7fa1e00c6d60 2023-08-09T12:48:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1e520b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e00ad250 con 0x7fa1e00ac8b0 2023-08-09T12:48:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1e520b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e00c7dc0 con 0x7fa1c80039a0 2023-08-09T12:48:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e00c6d60 0x7fa1e00c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e00c6d60 0x7fa1e00c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50120/0 (socket says 172.21.15.17:50120) 2023-08-09T12:48:04.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.957+0000 7fa1de59c640 1 -- 172.21.15.17:0/1179967473 learned_addr learned my addr 172.21.15.17:0/1179967473 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:04.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1ded9d640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c80039a0 0x7fa1e014f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1df59e640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e00ac8b0 0x7fa1e00acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1de59c640 1 -- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c80039a0 msgr2=0x7fa1e014f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1de59c640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c80039a0 0x7fa1e014f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1de59c640 1 -- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e00ac8b0 msgr2=0x7fa1e00acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:04.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1de59c640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e00ac8b0 0x7fa1e00acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:04.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1de59c640 1 -- 172.21.15.17:0/1179967473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e00afbd0 con 0x7fa1e00c6d60 2023-08-09T12:48:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1df59e640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e00ac8b0 0x7fa1e00acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.958+0000 7fa1de59c640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e00c6d60 0x7fa1e00c71e0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40116d0 tx=0x7fa1d4011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.959+0000 7fa1c77fe640 1 -- 172.21.15.17:0/1179967473 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4004220 con 0x7fa1e00c6d60 2023-08-09T12:48:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.959+0000 7fa1c77fe640 1 -- 172.21.15.17:0/1179967473 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4004380 con 0x7fa1e00c6d60 2023-08-09T12:48:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.959+0000 7fa1c77fe640 1 -- 172.21.15.17:0/1179967473 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4005bd0 con 0x7fa1e00c6d60 2023-08-09T12:48:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.959+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e00c2040 con 0x7fa1e00c6d60 2023-08-09T12:48:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.959+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e00c7ae0 con 0x7fa1e00c6d60 2023-08-09T12:48:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.960+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e0067a80 con 0x7fa1e00c6d60 2023-08-09T12:48:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.961+0000 7fa1c77fe640 1 -- 172.21.15.17:0/1179967473 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa1d4005d30 con 0x7fa1e00c6d60 2023-08-09T12:48:04.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.962+0000 7fa1c77fe640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1cc06a050 0x7fa1cc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:04.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.962+0000 7fa1c77fe640 1 -- 172.21.15.17:0/1179967473 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1d40888b0 con 0x7fa1e00c6d60 2023-08-09T12:48:04.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.962+0000 7fa1c77fe640 1 -- 172.21.15.17:0/1179967473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7fa1cc0721a0 con 0x7fa1e00c6d60 2023-08-09T12:48:04.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.963+0000 7fa1ded9d640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1cc06a050 0x7fa1cc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:04.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.964+0000 7fa1ded9d640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1cc06a050 0x7fa1cc06c510 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0033000 tx=0x7fa1d0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:04.966+0000 7fa1c77fe640 1 -- 172.21.15.17:0/1179967473 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa1d4053f90 con 0x7fa1e00c6d60 2023-08-09T12:48:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.197+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1e006d4a0 con 0x7fa1e00c6d60 2023-08-09T12:48:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.198+0000 7fa1c77fe640 1 -- 172.21.15.17:0/1179967473 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7fa1d4022020 con 0x7fa1e00c6d60 2023-08-09T12:48:05.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:05.202 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:48:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:48:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1cc06a050 msgr2=0x7fa1cc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:05.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1cc06a050 0x7fa1cc06c510 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0033000 tx=0x7fa1d0009030 comp rx=0 tx=0).stop 2023-08-09T12:48:05.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e00c6d60 msgr2=0x7fa1e00c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:05.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e00c6d60 0x7fa1e00c71e0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40116d0 tx=0x7fa1d4011b90 comp rx=0 tx=0).stop 2023-08-09T12:48:05.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 shutdown_connections 2023-08-09T12:48:05.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1cc06a050 0x7fa1cc06c510 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e00ac8b0 0x7fa1e00acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e00c6d60 0x7fa1e00c71e0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 --2- 172.21.15.17:0/1179967473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c80039a0 0x7fa1e014f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.201+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 >> 172.21.15.17:0/1179967473 conn(0x7fa1e00cb1b0 msgr2=0x7fa1e006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:05.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.202+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 shutdown_connections 2023-08-09T12:48:05.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.202+0000 7fa1e520b640 1 -- 172.21.15.17:0/1179967473 wait complete. 2023-08-09T12:48:05.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-08-09T12:48:05.464 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":7992,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.856961711,"mdsmap_epoch":67,"osdmap_epoch":148,"osdmap_epoch_barrier":148,"uptime":32.777654705000003} 2023-08-09T12:48:05.464 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 7992, "mdsmap_epoch": 67, "osdmap_epoch": 148, "osdmap_epoch_barrier": 148, "rank_uptime": 26.856961711, "state": "up:active", "uptime": 32.777654705, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:48:05.465 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:48:05.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:05.466 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-08-09T12:48:05.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:05.529 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-08-09T12:48:05.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:48:05.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.827+0000 7f8aada0a640 1 Processor -- start 2023-08-09T12:48:05.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.827+0000 7f8aada0a640 1 -- start start 2023-08-09T12:48:05.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.828+0000 7f8aada0a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8aa815a930 0x7f8aa80ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.828+0000 7f8aada0a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa80cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aada0a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa80cb400 con 0x7f8aa80cae80 2023-08-09T12:48:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aada0a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa8070940 con 0x7f8aa815a930 2023-08-09T12:48:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aada0a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8070c20 con 0x7f8aa80b10b0 2023-08-09T12:48:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aaca08640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8aa815a930 0x7f8aa80ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aaca08640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8aa815a930 0x7f8aa80ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50126/0 (socket says 172.21.15.17:50126) 2023-08-09T12:48:05.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aaca08640 1 -- 172.21.15.17:0/79280672 learned_addr learned my addr 172.21.15.17:0/79280672 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:05.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aad209640 1 --2- 172.21.15.17:0/79280672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa80cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:05.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aaca08640 1 -- 172.21.15.17:0/79280672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 msgr2=0x7f8aa80cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:05.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aaca08640 1 --2- 172.21.15.17:0/79280672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa80cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aaca08640 1 -- 172.21.15.17:0/79280672 >> v1:172.21.15.142:6789/0 conn(0x7f8aa80cae80 legacy=0x7f8aa80b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:05.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.829+0000 7f8aaca08640 1 -- 172.21.15.17:0/79280672 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8070f00 con 0x7f8aa815a930 2023-08-09T12:48:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.831+0000 7f8aaca08640 1 --2- 172.21.15.17:0/79280672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80ca940 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009850 tx=0x7f8a9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19869beec2b4bbec server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.831+0000 7f8aa77fe640 1 -- 172.21.15.17:0/79280672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c02e070 con 0x7f8aa815a930 2023-08-09T12:48:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.831+0000 7f8aa77fe640 1 -- 172.21.15.17:0/79280672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c004030 con 0x7f8aa815a930 2023-08-09T12:48:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.831+0000 7f8aa77fe640 1 -- 172.21.15.17:0/79280672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c004420 con 0x7f8aa815a930 2023-08-09T12:48:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.832+0000 7f8aada0a640 1 -- 172.21.15.17:0/79280672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 msgr2=0x7f8aa80ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.832+0000 7f8aada0a640 1 --2- 172.21.15.17:0/79280672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80ca940 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009850 tx=0x7f8a9c02b840 comp rx=0 tx=0).stop 2023-08-09T12:48:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.832+0000 7f8aada0a640 1 -- 172.21.15.17:0/79280672 shutdown_connections 2023-08-09T12:48:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.832+0000 7f8aada0a640 1 --2- 172.21.15.17:0/79280672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa80cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.832+0000 7f8aada0a640 1 --2- 172.21.15.17:0/79280672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80ca940 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.832+0000 7f8aada0a640 1 -- 172.21.15.17:0/79280672 >> 172.21.15.17:0/79280672 conn(0x7f8aa80cb9a0 msgr2=0x7f8aa80cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.832+0000 7f8aada0a640 1 -- 172.21.15.17:0/79280672 shutdown_connections 2023-08-09T12:48:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.832+0000 7f8aada0a640 1 -- 172.21.15.17:0/79280672 wait complete. 2023-08-09T12:48:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.834+0000 7f8aada0a640 1 Processor -- start 2023-08-09T12:48:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.834+0000 7f8aada0a640 1 -- start start 2023-08-09T12:48:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.835+0000 7f8aada0a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa815b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.835+0000 7f8aada0a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa80cae80 0x7f8aa81efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.835+0000 7f8aada0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.835+0000 7f8aada0a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8157400 con 0x7f8aa815a930 2023-08-09T12:48:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.835+0000 7f8aada0a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa815cea0 con 0x7f8aa80cae80 2023-08-09T12:48:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.835+0000 7f8aada0a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8156d80 con 0x7f8aa80b10b0 2023-08-09T12:48:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aad209640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aad209640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50134/0 (socket says 172.21.15.17:50134) 2023-08-09T12:48:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aad209640 1 -- 172.21.15.17:0/283305150 learned_addr learned my addr 172.21.15.17:0/283305150 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aaca08640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa815b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aa7fff640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa80cae80 0x7f8aa81efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aad209640 1 -- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 msgr2=0x7f8aa815b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aad209640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa815b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aad209640 1 -- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa80cae80 msgr2=0x7f8aa81efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aad209640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa80cae80 0x7f8aa81efb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aad209640 1 -- 172.21.15.17:0/283305150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c009460 con 0x7f8aa815a930 2023-08-09T12:48:05.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.836+0000 7f8aaca08640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa815b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:48:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.837+0000 7f8aad209640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80acdb0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0007d70 tx=0x7f8aa000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.837+0000 7f8aa57fa640 1 -- 172.21.15.17:0/283305150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0014420 con 0x7f8aa815a930 2023-08-09T12:48:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.837+0000 7f8aa57fa640 1 -- 172.21.15.17:0/283305150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa00145a0 con 0x7f8aa815a930 2023-08-09T12:48:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.837+0000 7f8aa57fa640 1 -- 172.21.15.17:0/283305150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0014950 con 0x7f8aa815a930 2023-08-09T12:48:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.837+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa815cbc0 con 0x7f8aa815a930 2023-08-09T12:48:05.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.837+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa815bef0 con 0x7f8aa815a930 2023-08-09T12:48:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.838+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa8156be0 con 0x7f8aa815a930 2023-08-09T12:48:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.839+0000 7f8aa57fa640 1 -- 172.21.15.17:0/283305150 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8aa0014ab0 con 0x7f8aa815a930 2023-08-09T12:48:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.840+0000 7f8aa57fa640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a8c06a050 0x7f8a8c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.840+0000 7f8aa57fa640 1 -- 172.21.15.17:0/283305150 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8aa0088e60 con 0x7f8aa815a930 2023-08-09T12:48:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.841+0000 7f8aa57fa640 1 -- 172.21.15.17:0/283305150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f8a8c0721a0 con 0x7f8aa815a930 2023-08-09T12:48:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.841+0000 7f8aaca08640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a8c06a050 0x7f8a8c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.842+0000 7f8aaca08640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a8c06a050 0x7f8a8c06c510 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c034000 tx=0x7f8a9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:05.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:05.845+0000 7f8aa57fa640 1 -- 172.21.15.17:0/283305150 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8aa8156be0 con 0x7f8aa815a930 2023-08-09T12:48:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.037+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8aa8157540 con 0x7f8aa815a930 2023-08-09T12:48:06.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.040+0000 7f8aa57fa640 1 -- 172.21.15.17:0/283305150 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+37012 (secure 0 0 0) 0x7f8aa8157540 con 0x7f8aa815a930 2023-08-09T12:48:06.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:06.044 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:48:06.044 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 148, 2023-08-09T12:48:06.045 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:48:06.045 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:48:06.045 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:47:58.837923+0000", 2023-08-09T12:48:06.045 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:48:06.045 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:48:06.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:48:06.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:48:06.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:48:06.046 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:48:06.046 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:48:06.046 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:48:06.046 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:48:06.046 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:06.047 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:48:06.047 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:48:06.047 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:48:06.047 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:48:06.047 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:48:06.047 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 18, 2023-08-09T12:48:06.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:48:06.048 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:48:06.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:48:06.048 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:48:06.048 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:48:06.048 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:48:06.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.049 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:48:06.049 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:48:06.049 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:48:06.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:06.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:06.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:06.049 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:06.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:06.050 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:06.050 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:06.050 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:06.050 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:06.050 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:06.050 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:06.051 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:06.051 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:48:06.051 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:48:06.051 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:48:06.051 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:48:06.051 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:48:06.051 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:06.052 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:06.052 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:06.052 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:06.052 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:06.052 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:06.052 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:06.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.053 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:06.053 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:06.053 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:06.053 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:06.053 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:06.053 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:06.053 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:06.054 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:06.054 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:06.054 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:06.054 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:06.054 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:06.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:06.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:06.055 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:06.055 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:06.055 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:06.055 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:06.055 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:06.056 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:06.056 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:06.056 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:06.056 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:06.056 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:06.056 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:06.056 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:06.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:06.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.057 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:06.057 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:06.057 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:06.057 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:06.057 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:06.058 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:06.058 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:06.058 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:06.058 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:06.058 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:06.058 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:06.058 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:06.059 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:48:06.059 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:48:06.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.059 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:06.059 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:48:06.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.059 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:06.060 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:48:06.060 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:48:06.060 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:48:06.060 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:48:06.060 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:48:06.060 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:06.060 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:48:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:48:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:48:06.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:06.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:06.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:06.062 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:06.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:06.062 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:06.062 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:06.063 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:06.063 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:06.063 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:06.063 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:06.063 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:06.063 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:48:06.063 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:48:06.064 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:48:06.064 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:48:06.064 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:48:06.064 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:06.064 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:06.064 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:06.064 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:06.065 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:06.065 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:06.065 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:06.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.065 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:06.065 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:06.065 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:06.065 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:06.066 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:06.066 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:06.066 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:06.066 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:06.066 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:06.066 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:06.066 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:06.067 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:06.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:06.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:06.067 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:06.067 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:06.067 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:06.067 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:06.068 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:06.068 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:06.068 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:06.068 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:06.068 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:06.068 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:06.068 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:06.069 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:06.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:06.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.069 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:06.069 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:06.069 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:06.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:06.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:06.070 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:06.070 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:06.070 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:06.070 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:06.070 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:06.070 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:06.071 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:48:06.071 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:06.071 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:48:06.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.071 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:06.071 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:48:06.071 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:48:06.072 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:48:06.072 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:48:06.072 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:48:06.072 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:06.072 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:06.072 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:06.073 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 17, 2023-08-09T12:48:06.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:48:06.073 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:36.431201+0000", 2023-08-09T12:48:06.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:06.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:06.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:06.074 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:06.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:06.074 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:06.074 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:06.075 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:06.075 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:06.075 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:06.075 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:06.075 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:06.075 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:48:06.075 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:48:06.076 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:48:06.076 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:48:06.076 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:48:06.076 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:06.076 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:06.076 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:06.076 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:06.077 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:06.077 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:06.077 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:06.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.077 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "145", 2023-08-09T12:48:06.077 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:06.077 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:06.078 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:06.078 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:06.078 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:06.078 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:06.078 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:06.078 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:06.078 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:06.079 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:06.079 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:06.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:06.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:06.079 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:06.079 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:06.079 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:06.080 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:06.080 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:06.080 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:06.080 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:06.080 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:06.080 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:06.080 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:06.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:06.082 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:06.082 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:06.082 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:06.082 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:06.082 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:06.082 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:06.083 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:06.083 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:48:06.083 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:48:06.083 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:48:06.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.083 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:06.084 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:06.084 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:48:06.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.084 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:06.084 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:48:06.084 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:48:06.085 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:06.085 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:48:06.085 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:48:06.085 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:06.085 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:06.085 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:06.085 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 18, 2023-08-09T12:48:06.086 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:48:06.086 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:37.108075+0000", 2023-08-09T12:48:06.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1027, 2023-08-09T12:48:06.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-09T12:48:06.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:06.087 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:06.087 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:06.087 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:06.087 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:06.087 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:06.087 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:06.087 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:06.088 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:06.088 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:06.088 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:48:06.088 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:48:06.088 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:48:06.088 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:48:06.088 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:48:06.089 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:06.089 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:06.089 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:06.089 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:06.089 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:06.089 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:06.089 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:06.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.090 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "148", 2023-08-09T12:48:06.090 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:06.090 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:06.090 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:06.090 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:06.090 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:06.091 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:06.091 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:06.091 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:06.091 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:06.091 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:48:06.091 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:06.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:06.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:06.092 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:06.092 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:06.092 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:06.092 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:06.092 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:06.092 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:06.093 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:06.093 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:06.093 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:06.093 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:06.093 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:06.093 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:06.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:06.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.094 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:06.094 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:06.094 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:06.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:06.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:06.094 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:06.095 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:06.095 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:06.095 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:06.095 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:06.095 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:06.095 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:06.096 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:48:06.096 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:48:06.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.096 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:06.096 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:06.096 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:48:06.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.097 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:06.097 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.3799999952316284, 2023-08-09T12:48:06.097 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.3799999952316284, 2023-08-09T12:48:06.097 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:06.097 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-09T12:48:06.097 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-09T12:48:06.098 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:06.098 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:06.098 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:06.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.098 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:06.099 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:48:06.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.099 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:06.099 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:06.099 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:06.099 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:06.099 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:06.100 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:06.100 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:06.100 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:06.100 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:06.100 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:06.101 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:06.101 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:06.101 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:06.101 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.101 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:48:06.102 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:06.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.102 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:48:06.102 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:06.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.103 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.103 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:06.103 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.103 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:48:06.104 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:06.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.104 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:48:06.104 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:06.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.105 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.105 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:06.105 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.105 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:48:06.106 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:06.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.106 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:48:06.106 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:06.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.107 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.107 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:06.107 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.107 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:48:06.108 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:06.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.108 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:48:06.108 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:06.108 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.109 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.109 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:48:06.109 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:48:06.109 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:48:06.109 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:48:06.109 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:06.110 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:06.110 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:06.110 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.110 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:06.110 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:06.111 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:06.111 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:06.111 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:06.111 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:06.111 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:06.111 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:06.111 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:06.112 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:06.112 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:06.112 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:06.112 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:06.112 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.113 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:48:06.113 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:06.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.113 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:48:06.113 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:06.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.114 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.114 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:06.114 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.115 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:48:06.115 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:06.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.115 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:48:06.115 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:06.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.116 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.116 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:06.116 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.117 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:48:06.117 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:06.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.117 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:48:06.117 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:48:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:48:06.120 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:06.120 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.120 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.120 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:48:06.120 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:48:06.120 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:48:06.121 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:48:06.121 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:06.121 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:06.121 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:06.121 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:06.122 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:06.122 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:06.122 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:06.122 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:06.122 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:06.122 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:06.123 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:06.123 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:06.123 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:06.123 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:06.123 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:06.123 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:06.123 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.124 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:48:06.124 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:06.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.124 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:48:06.125 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:06.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.125 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.125 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:06.125 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.126 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:48:06.126 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:06.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.126 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:48:06.127 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:06.127 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.127 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.127 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:06.127 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.128 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:48:06.128 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:06.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.128 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:48:06.129 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:06.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.129 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.129 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:06.129 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.130 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:48:06.130 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:06.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.130 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:48:06.130 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:48:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:48:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:48:06.131 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:48:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.132 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:06.133 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:48:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:48:06.135 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:48:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:48:06.137 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.138 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:48:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:48:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:06.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:48:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:48:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.141 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:48:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:48:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:48:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:48:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:06.142 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:06.143 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:06.144 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:48:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:48:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:06.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:48:06.147 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:48:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:06.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:48:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:48:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.150 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:48:06.151 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:48:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.152 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:48:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:48:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:48:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:48:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:06.153 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:06.154 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:06.155 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.156 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:48:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:48:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.157 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:48:06.158 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:48:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.159 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:48:06.160 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:48:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.161 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:48:06.162 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:48:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:48:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:48:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:48:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:48:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:06.165 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:06.166 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:48:06.167 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:48:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.168 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:48:06.169 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:48:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.170 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:48:06.171 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:48:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.172 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:48:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:48:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.174 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:48:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:48:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:48:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:48:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:06.175 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:06.176 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:06.177 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:48:06.178 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:48:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.179 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:48:06.180 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:48:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.181 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:48:06.182 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:48:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.183 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:48:06.184 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:48:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.185 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:48:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:48:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:48:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:48:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:06.186 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:48:06.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:06.188 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:48:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:48:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:06.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:06.192 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:48:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:06.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:06.194 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:48:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:06.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:06.196 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:48:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:48:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:06.199 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:48:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:06.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:06.201 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:48:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:48:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:48:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:48:06.202 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:48:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:48:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:48:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:48:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:48:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:48:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:48:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:48:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:48:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:48:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:48:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:48:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:48:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:48:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:48:06.205 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:48:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:48:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:48:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:48:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:48:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:48:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:48:06.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:06.207 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:48:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a8c06a050 msgr2=0x7f8a8c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a8c06a050 0x7f8a8c06c510 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c034000 tx=0x7f8a9c008030 comp rx=0 tx=0).stop 2023-08-09T12:48:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 msgr2=0x7f8aa80acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80acdb0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0007d70 tx=0x7f8aa000e4b0 comp rx=0 tx=0).stop 2023-08-09T12:48:06.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 shutdown_connections 2023-08-09T12:48:06.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8a8c06a050 0x7f8a8c06c510 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:06.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8aa815a930 0x7f8aa80acdb0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:06.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa80cae80 0x7f8aa81efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:06.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 --2- 172.21.15.17:0/283305150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8aa80b10b0 0x7f8aa815b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:06.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 >> 172.21.15.17:0/283305150 conn(0x7f8aa80cb9a0 msgr2=0x7f8aa80c2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:06.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.043+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 shutdown_connections 2023-08-09T12:48:06.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:06.044+0000 7f8aada0a640 1 -- 172.21.15.17:0/283305150 wait complete. 2023-08-09T12:48:06.211 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:48:11.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:48:11.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.446+0000 7fd6850ba640 1 Processor -- start 2023-08-09T12:48:11.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.446+0000 7fd6850ba640 1 -- start start 2023-08-09T12:48:11.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd6850ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd68015ce90 0x7fd6801616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:11.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd6850ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6800d29d0 0x7fd6800d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:11.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd6850ba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800d3360 con 0x7fd6800b6000 2023-08-09T12:48:11.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd6850ba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800b6460 con 0x7fd6800d29d0 2023-08-09T12:48:11.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd6850ba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800cdd10 con 0x7fd68015ce90 2023-08-09T12:48:11.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd67f59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6800d29d0 0x7fd6800d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:11.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd67f59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6800d29d0 0x7fd6800d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58040/0 (socket says 172.21.15.17:58040) 2023-08-09T12:48:11.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd67f59e640 1 -- 172.21.15.17:0/1224779813 learned_addr learned my addr 172.21.15.17:0/1224779813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:11.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.448+0000 7fd67ed9d640 1 --2- 172.21.15.17:0/1224779813 >> v2:172.21.15.142:3300/0 conn(0x7fd68015ce90 0x7fd6801616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:11.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.449+0000 7fd67f59e640 1 -- 172.21.15.17:0/1224779813 >> v2:172.21.15.142:3300/0 conn(0x7fd68015ce90 msgr2=0x7fd6801616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:11.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.449+0000 7fd67f59e640 1 --2- 172.21.15.17:0/1224779813 >> v2:172.21.15.142:3300/0 conn(0x7fd68015ce90 0x7fd6801616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.449+0000 7fd67f59e640 1 -- 172.21.15.17:0/1224779813 >> v1:172.21.15.17:6789/0 conn(0x7fd6800b6000 legacy=0x7fd6800cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:11.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.449+0000 7fd67f59e640 1 -- 172.21.15.17:0/1224779813 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800cdff0 con 0x7fd6800d29d0 2023-08-09T12:48:11.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.450+0000 7fd67f59e640 1 --2- 172.21.15.17:0/1224779813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6800d29d0 0x7fd6800d2e20 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fd6800d0690 tx=0x7fd67802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4f1b0235b29076 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:11.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.450+0000 7fd67dd9b640 1 -- 172.21.15.17:0/1224779813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678030860 con 0x7fd6800d29d0 2023-08-09T12:48:11.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.450+0000 7fd67dd9b640 1 -- 172.21.15.17:0/1224779813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6780309c0 con 0x7fd6800d29d0 2023-08-09T12:48:11.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.450+0000 7fd67dd9b640 1 -- 172.21.15.17:0/1224779813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678030d50 con 0x7fd6800d29d0 2023-08-09T12:48:11.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.451+0000 7fd6850ba640 1 -- 172.21.15.17:0/1224779813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6800d29d0 msgr2=0x7fd6800d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:11.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.451+0000 7fd6850ba640 1 --2- 172.21.15.17:0/1224779813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6800d29d0 0x7fd6800d2e20 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fd6800d0690 tx=0x7fd67802b9a0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.451+0000 7fd6850ba640 1 -- 172.21.15.17:0/1224779813 shutdown_connections 2023-08-09T12:48:11.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.451+0000 7fd6850ba640 1 --2- 172.21.15.17:0/1224779813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6800d29d0 0x7fd6800d2e20 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.451+0000 7fd6850ba640 1 --2- 172.21.15.17:0/1224779813 >> v2:172.21.15.142:3300/0 conn(0x7fd68015ce90 0x7fd6801616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.451+0000 7fd6850ba640 1 -- 172.21.15.17:0/1224779813 >> 172.21.15.17:0/1224779813 conn(0x7fd68006fde0 msgr2=0x7fd6800701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:11.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.451+0000 7fd6850ba640 1 -- 172.21.15.17:0/1224779813 shutdown_connections 2023-08-09T12:48:11.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.451+0000 7fd6850ba640 1 -- 172.21.15.17:0/1224779813 wait complete. 2023-08-09T12:48:11.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.453+0000 7fd6850ba640 1 Processor -- start 2023-08-09T12:48:11.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.454+0000 7fd6850ba640 1 -- start start 2023-08-09T12:48:11.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd6850ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800b6000 0x7fd6800cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:11.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd6850ba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6800d29d0 0x7fd6800c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:11.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd6850ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd68015ce90 0x7fd6800cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd6850ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800cafb0 con 0x7fd68015ce90 2023-08-09T12:48:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd6850ba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680158990 con 0x7fd6800d29d0 2023-08-09T12:48:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd6850ba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800ca330 con 0x7fd6800b6000 2023-08-09T12:48:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd67f59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd68015ce90 0x7fd6800cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd67f59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd68015ce90 0x7fd6800cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58044/0 (socket says 172.21.15.17:58044) 2023-08-09T12:48:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.455+0000 7fd67f59e640 1 -- 172.21.15.17:0/2046598263 learned_addr learned my addr 172.21.15.17:0/2046598263 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67ed9d640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800b6000 0x7fd6800cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67e59c640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6800d29d0 0x7fd6800c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67f59e640 1 -- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800b6000 msgr2=0x7fd6800cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67f59e640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800b6000 0x7fd6800cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67f59e640 1 -- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6800d29d0 msgr2=0x7fd6800c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67f59e640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6800d29d0 0x7fd6800c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67f59e640 1 -- 172.21.15.17:0/2046598263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780094d0 con 0x7fd68015ce90 2023-08-09T12:48:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67e59c640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6800d29d0 0x7fd6800c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.456+0000 7fd67f59e640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd68015ce90 0x7fd6800cc060 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd6780090b0 tx=0x7fd678004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.457+0000 7fd6677fe640 1 -- 172.21.15.17:0/2046598263 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678039c90 con 0x7fd68015ce90 2023-08-09T12:48:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.457+0000 7fd6677fe640 1 -- 172.21.15.17:0/2046598263 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678039df0 con 0x7fd68015ce90 2023-08-09T12:48:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.457+0000 7fd6677fe640 1 -- 172.21.15.17:0/2046598263 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678043640 con 0x7fd68015ce90 2023-08-09T12:48:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.457+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6800ca610 con 0x7fd68015ce90 2023-08-09T12:48:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.457+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6800cabd0 con 0x7fd68015ce90 2023-08-09T12:48:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.458+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6800cb0f0 con 0x7fd68015ce90 2023-08-09T12:48:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.459+0000 7fd6677fe640 1 -- 172.21.15.17:0/2046598263 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd6780437a0 con 0x7fd68015ce90 2023-08-09T12:48:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.460+0000 7fd6677fe640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd66c06a050 0x7fd66c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.460+0000 7fd6677fe640 1 -- 172.21.15.17:0/2046598263 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd67803e070 con 0x7fd68015ce90 2023-08-09T12:48:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.460+0000 7fd6677fe640 1 -- 172.21.15.17:0/2046598263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7fd66c0721a0 con 0x7fd68015ce90 2023-08-09T12:48:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.461+0000 7fd67ed9d640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd66c06a050 0x7fd66c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.462+0000 7fd67ed9d640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd66c06a050 0x7fd66c06c510 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd6801608a0 tx=0x7fd6700039b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.465+0000 7fd6677fe640 1 -- 172.21.15.17:0/2046598263 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd678034060 con 0x7fd68015ce90 2023-08-09T12:48:11.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:48:11.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:48:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.665+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd680067a80 con 0x7fd68015ce90 2023-08-09T12:48:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.670+0000 7fd6677fe640 1 -- 172.21.15.17:0/2046598263 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+37012 (secure 0 0 0) 0x7fd678034030 con 0x7fd68015ce90 2023-08-09T12:48:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:11.675 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:48:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 148, 2023-08-09T12:48:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:48:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:48:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:47:58.837923+0000", 2023-08-09T12:48:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:48:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:48:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:48:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:48:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:48:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:48:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:48:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:48:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:48:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:48:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:48:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:48:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:48:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:48:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 18, 2023-08-09T12:48:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:48:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:48:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:48:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:48:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:48:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:48:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:48:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:48:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:48:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:48:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:48:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:48:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:48:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:48:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:48:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:48:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:48:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:48:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:48:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:48:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:48:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:48:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:11.694 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:11.694 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.694 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:48:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:48:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:48:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:11.697 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:11.697 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:11.697 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:48:11.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:48:11.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:48:11.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:48:11.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:48:11.699 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:11.699 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:11.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:11.699 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:11.699 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:11.700 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:11.700 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:11.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.700 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:11.700 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:11.700 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:11.701 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:11.701 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:11.701 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:11.701 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:11.701 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:11.701 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:11.702 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:11.702 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:11.702 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:11.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:11.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:11.702 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:11.702 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:11.703 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:11.703 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:11.703 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:11.703 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:11.703 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:11.704 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:11.704 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:11.704 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:11.704 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:11.705 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:11.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:11.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.706 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:11.706 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:11.706 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:11.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:11.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:11.707 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:11.707 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:11.708 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:11.708 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:11.708 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:11.708 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:11.709 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:48:11.709 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:11.709 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:48:11.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.710 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:11.710 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:48:11.710 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:48:11.711 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:48:11.711 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:48:11.711 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:48:11.711 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:11.711 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:11.711 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:11.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.712 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 17, 2023-08-09T12:48:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:48:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:36.431201+0000", 2023-08-09T12:48:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:11.713 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:11.714 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:11.714 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:11.714 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:11.714 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:11.714 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:11.714 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:11.714 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:48:11.715 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:48:11.715 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:48:11.715 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:48:11.715 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:48:11.715 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:11.715 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:11.715 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:11.716 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:11.716 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:11.716 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:11.716 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:11.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.716 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "145", 2023-08-09T12:48:11.716 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:11.717 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:11.717 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:11.717 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:11.717 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:11.717 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:11.717 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:11.718 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:11.718 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:11.718 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:11.718 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:11.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:11.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:11.719 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:11.719 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:11.720 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:11.720 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:11.720 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:11.721 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:11.721 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:11.721 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:11.721 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:11.721 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:11.722 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:11.722 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:11.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:11.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.723 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:11.723 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:11.723 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:11.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:11.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:11.723 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:11.724 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:11.724 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:11.724 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:11.724 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:11.724 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:11.724 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:11.724 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:48:11.725 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:48:11.725 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:48:11.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.725 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:11.725 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:11.725 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:48:11.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.726 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:11.726 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:48:11.726 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:48:11.726 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:11.726 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:48:11.727 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:48:11.727 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:11.727 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:11.727 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:11.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.728 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 18, 2023-08-09T12:48:11.728 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:48:11.728 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:37.108075+0000", 2023-08-09T12:48:11.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1027, 2023-08-09T12:48:11.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-09T12:48:11.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:11.729 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:11.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:11.730 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:11.730 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:11.730 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:48:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:48:11.732 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:48:11.732 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:48:11.732 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:48:11.732 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:11.733 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:11.733 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:11.733 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:11.733 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:11.734 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:11.734 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:11.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.735 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "148", 2023-08-09T12:48:11.735 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:11.735 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:11.735 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:11.736 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:11.736 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:11.736 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:11.736 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:11.737 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:11.737 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:11.737 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:48:11.737 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:11.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:11.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:11.738 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:11.738 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:11.739 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:11.739 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:11.739 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:11.739 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:11.740 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:11.740 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:11.740 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:11.740 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:11.741 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:11.741 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:11.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:11.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.741 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:11.741 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:11.741 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:11.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:11.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:11.742 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:11.742 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:11.742 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:11.743 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:11.743 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:11.743 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:11.743 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:11.744 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:48:11.744 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:48:11.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.744 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:11.744 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:48:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.3799999952316284, 2023-08-09T12:48:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.3799999952316284, 2023-08-09T12:48:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:11.745 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-09T12:48:11.746 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-09T12:48:11.746 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:11.746 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:11.746 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:11.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.746 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:11.747 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:48:11.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.747 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:11.747 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:11.747 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:11.747 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:11.747 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:11.748 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:11.748 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:11.748 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:11.748 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:11.748 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:11.748 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:11.748 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:11.749 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:11.749 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.749 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:48:11.749 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:11.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.750 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:48:11.750 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:11.750 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.750 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.751 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:11.751 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.751 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:48:11.751 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:11.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.752 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:48:11.752 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:11.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.752 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.752 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:11.753 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.753 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:48:11.753 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:11.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.754 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:48:11.754 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:11.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.754 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.754 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:11.755 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.755 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:48:11.755 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:11.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.756 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:48:11.756 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:11.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.756 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.756 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:48:11.757 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:48:11.757 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:48:11.757 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:48:11.757 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:11.757 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:11.757 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:11.757 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:11.758 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:11.758 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:11.758 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:11.758 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:11.758 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:11.759 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:11.759 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:11.759 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:11.759 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:11.759 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:11.759 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:11.759 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:11.760 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.760 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:48:11.760 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:11.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.761 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:48:11.761 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:11.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.761 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.761 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:11.762 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.762 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:48:11.762 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:11.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.763 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:48:11.763 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:11.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.763 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:11.764 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.764 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:48:11.764 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:11.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.765 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:48:11.765 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:11.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.765 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.765 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:11.766 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.766 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:48:11.766 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:11.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.767 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:48:11.767 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:11.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.767 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:48:11.767 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:48:11.768 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:48:11.768 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:48:11.768 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:11.768 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:11.768 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:11.768 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:11.769 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:11.769 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:11.769 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:11.769 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:11.769 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:11.770 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:11.770 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:11.770 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:11.770 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:11.770 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:11.770 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:11.770 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:11.771 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.771 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:48:11.771 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:11.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.772 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:48:11.772 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:11.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.772 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.772 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:11.772 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.773 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:48:11.773 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:11.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.774 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:48:11.774 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:11.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.774 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.774 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:11.774 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.775 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:48:11.775 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:11.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.775 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:48:11.776 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:11.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.776 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.776 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:11.776 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.777 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:48:11.777 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:11.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.777 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:48:11.778 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:11.778 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.778 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.778 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:48:11.778 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:48:11.778 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:48:11.779 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:48:11.779 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:11.779 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:11.779 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:11.779 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:11.780 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:11.781 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:11.781 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:11.781 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:11.781 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:11.781 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:11.781 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:11.781 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.782 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:48:11.782 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:11.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.782 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:48:11.783 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:11.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.783 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.783 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:11.783 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.784 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:48:11.784 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:11.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.784 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:48:11.785 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:11.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.785 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:11.785 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.786 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:48:11.786 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:11.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.786 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:48:11.786 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:11.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.787 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.787 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:11.787 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.788 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:48:11.788 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:11.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.788 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:48:11.788 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:11.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.789 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.789 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:48:11.789 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:48:11.789 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:48:11.789 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:48:11.790 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:11.790 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:11.790 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:11.790 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:11.791 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:11.791 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:11.791 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:11.791 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:11.791 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:11.791 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:11.791 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:11.792 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:11.792 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:11.792 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:11.792 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:11.792 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:11.792 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.793 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:48:11.793 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:11.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.793 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:48:11.793 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:11.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.794 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.794 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:11.794 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.795 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:48:11.795 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:11.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.795 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:48:11.795 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:11.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.796 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.796 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:11.796 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.797 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:48:11.797 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:11.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.797 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:48:11.797 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:11.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.798 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.798 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:11.798 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.798 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:48:11.799 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:11.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.799 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:48:11.799 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:11.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.800 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.800 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:48:11.800 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:48:11.800 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:48:11.800 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:48:11.800 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:11.801 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:11.801 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:11.801 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.801 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:11.801 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:11.802 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:11.802 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:11.802 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:11.802 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:11.802 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:11.802 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:11.802 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:11.802 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:11.803 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:11.803 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:11.803 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:11.803 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.803 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:48:11.804 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:11.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.804 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:48:11.804 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:11.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.805 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.805 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:11.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:48:11.806 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:11.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.806 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:48:11.806 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:11.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.807 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.807 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:11.807 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.807 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:48:11.807 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:11.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.808 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:48:11.808 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:11.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.808 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.809 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:11.809 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.809 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:48:11.809 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:11.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.810 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:48:11.810 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:11.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.810 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.811 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:48:11.811 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:48:11.811 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:48:11.811 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:48:11.811 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:11.811 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:11.812 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:11.812 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.812 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:11.812 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:11.812 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:11.812 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:11.813 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:11.813 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:11.813 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:11.813 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:11.813 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:11.813 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:11.813 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:11.814 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:11.814 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:11.814 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.814 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:48:11.814 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:11.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.815 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:48:11.815 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:11.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.816 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:11.816 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.816 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:48:11.816 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:11.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.817 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:48:11.817 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:11.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.817 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.818 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:11.818 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.818 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:48:11.818 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:11.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.819 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:48:11.819 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:11.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.819 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.820 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:11.820 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.820 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:48:11.820 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:11.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.821 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:48:11.821 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:11.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.821 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.822 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:48:11.822 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:48:11.822 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:48:11.822 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:48:11.822 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:11.822 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:11.822 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:11.823 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.823 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:11.823 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:11.823 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:11.823 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:11.823 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:11.824 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:11.824 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:11.824 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:11.824 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:11.824 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:11.824 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:11.824 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:11.825 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:11.825 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.825 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:48:11.825 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:11.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.826 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:48:11.826 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:11.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.826 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.827 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:11.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:48:11.827 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:11.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.828 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:48:11.828 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:11.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.828 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.828 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:11.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:48:11.829 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:11.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.830 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:48:11.830 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:11.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.830 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.830 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:11.831 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:11.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:11.831 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:48:11.831 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:11.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:11.832 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:48:11.832 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:11.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.832 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.832 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:48:11.833 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:48:11.833 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:48:11.833 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:48:11.833 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:11.833 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:11.833 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:11.833 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:11.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.834 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:11.834 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:48:11.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.834 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:11.834 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:11.834 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:11.834 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:11.835 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:11.835 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:11.835 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:48:11.835 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:11.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.835 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:11.836 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:11.836 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:11.836 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:11.836 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:11.836 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:11.836 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:48:11.836 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:11.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.837 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:11.837 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:11.837 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:11.837 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:11.837 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:11.838 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:11.838 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:48:11.838 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:11.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.838 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:11.838 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:11.838 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:11.839 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:11.839 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:11.839 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:11.839 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:48:11.839 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:11.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.840 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:11.840 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:11.840 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:11.840 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:11.840 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:11.840 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:11.840 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:48:11.841 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:11.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.841 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:11.841 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:11.841 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:11.841 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:11.842 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:11.842 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:11.842 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:48:11.842 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:11.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.842 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:11.843 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:11.843 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:11.843 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:11.843 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:11.843 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:11.843 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:48:11.843 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:11.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:11.844 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:11.844 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:11.844 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:11.844 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:11.844 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:11.844 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:11.845 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:48:11.845 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:11.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.845 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:11.845 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:48:11.845 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:48:11.845 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:48:11.846 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:48:11.846 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:48:11.846 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:48:11.846 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:48:11.846 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:48:11.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:48:11.846 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:48:11.846 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:48:11.847 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:48:11.847 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:48:11.847 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:48:11.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:11.847 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:48:11.847 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:48:11.848 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:48:11.848 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:48:11.848 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:48:11.848 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:48:11.848 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:48:11.848 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:48:11.848 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:48:11.849 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:48:11.849 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:48:11.849 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:11.849 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:48:11.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd66c06a050 msgr2=0x7fd66c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:11.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd66c06a050 0x7fd66c06c510 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd6801608a0 tx=0x7fd6700039b0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd68015ce90 msgr2=0x7fd6800cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:11.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd68015ce90 0x7fd6800cc060 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd6780090b0 tx=0x7fd678004730 comp rx=0 tx=0).stop 2023-08-09T12:48:11.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 shutdown_connections 2023-08-09T12:48:11.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd66c06a050 0x7fd66c06c510 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd68015ce90 0x7fd6800cc060 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6800d29d0 0x7fd6800c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 --2- 172.21.15.17:0/2046598263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800b6000 0x7fd6800cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:11.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.672+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 >> 172.21.15.17:0/2046598263 conn(0x7fd68006fde0 msgr2=0x7fd68015b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:11.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.673+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 shutdown_connections 2023-08-09T12:48:11.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:11.673+0000 7fd6850ba640 1 -- 172.21.15.17:0/2046598263 wait complete. 2023-08-09T12:48:11.853 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:48:16.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:48:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.090+0000 7f9eb0ae5640 1 Processor -- start 2023-08-09T12:48:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.090+0000 7f9eb0ae5640 1 -- start start 2023-08-09T12:48:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.092+0000 7f9eb0ae5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eac160030 0x7f9eac160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.092+0000 7f9eb0ae5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0b5a30 con 0x7f9eac0b86e0 2023-08-09T12:48:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.092+0000 7f9eb0ae5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0d0d70 con 0x7f9eac0cfb50 2023-08-09T12:48:17.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.092+0000 7f9eb0ae5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0d1110 con 0x7f9eac160030 2023-08-09T12:48:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.092+0000 7f9ea2ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9eac0b86e0 0x7f9eac0cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39662/0 (socket says 172.21.15.17:39662) 2023-08-09T12:48:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.092+0000 7f9ea2ffd640 1 -- 172.21.15.17:0/6029596 learned_addr learned my addr 172.21.15.17:0/6029596 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.092+0000 7f9eab7fe640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eac160030 0x7f9eac160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103447034 0 0) 0x7f9eac0b5a30 con 0x7f9eac0b86e0 2023-08-09T12:48:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e98003520 con 0x7f9eac0b86e0 2023-08-09T12:48:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 136978909 0 0) 0x7f9e98003520 con 0x7f9eac0b86e0 2023-08-09T12:48:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eac160030 msgr2=0x7f9eac160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eac160030 0x7f9eac160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 >> v1:172.21.15.142:6789/0 conn(0x7f9eac0cfb50 legacy=0x7f9eac0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac160f70 con 0x7f9eac0b86e0 2023-08-09T12:48:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f9e940019f0 con 0x7f9eac0b86e0 2023-08-09T12:48:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 >> v1:172.21.15.17:6789/0 conn(0x7f9eac0b86e0 legacy=0x7f9eac0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e980039a0 0x7f9e98003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e980047c0 0x7f9e98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eac160030 0x7f9e98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0d1110 con 0x7f9e980047c0 2023-08-09T12:48:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9800ba60 con 0x7f9e980039a0 2023-08-09T12:48:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.093+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9800bc20 con 0x7f9eac160030 2023-08-09T12:48:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.094+0000 7f9ea2ffd640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e980047c0 0x7f9e98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.094+0000 7f9ea2ffd640 1 -- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eac160030 msgr2=0x7f9e98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.094+0000 7f9ea2ffd640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eac160030 0x7f9e98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.094+0000 7f9ea2ffd640 1 -- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e980039a0 msgr2=0x7f9e98003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.094+0000 7f9ea2ffd640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e980039a0 0x7f9e98003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.094+0000 7f9ea2ffd640 1 -- 172.21.15.17:0/6029596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98003520 con 0x7f9e980047c0 2023-08-09T12:48:17.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.095+0000 7f9ea2ffd640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e980047c0 0x7f9e98004c40 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f9e94002230 tx=0x7f9e980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccfeb0779629c20 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.095+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94034630 con 0x7f9e980047c0 2023-08-09T12:48:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.095+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9402f070 con 0x7f9e980047c0 2023-08-09T12:48:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.095+0000 7f9eaaffd640 1 -- 172.21.15.17:0/6029596 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94034a10 con 0x7f9e980047c0 2023-08-09T12:48:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.096+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/6029596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e980047c0 msgr2=0x7f9e98004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.096+0000 7f9eb0ae5640 1 --2- 172.21.15.17:0/6029596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e980047c0 0x7f9e98004c40 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f9e94002230 tx=0x7f9e980057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.096+0000 7f9eabfff640 1 -- 172.21.15.17:0/6029596 reap_dead start 2023-08-09T12:48:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.096+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/6029596 shutdown_connections 2023-08-09T12:48:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.096+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/6029596 >> 172.21.15.17:0/6029596 conn(0x7f9eac0697c0 msgr2=0x7f9eac069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.096+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/6029596 shutdown_connections 2023-08-09T12:48:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.096+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/6029596 wait complete. 2023-08-09T12:48:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.098+0000 7f9eb0ae5640 1 Processor -- start 2023-08-09T12:48:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.098+0000 7f9eb0ae5640 1 -- start start 2023-08-09T12:48:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.099+0000 7f9eb0ae5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e980047c0 0x7f9eac146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.099+0000 7f9eb0ae5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eac1536e0 0x7f9eac155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.099+0000 7f9eb0ae5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eac155860 0x7f9eac15c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.099+0000 7f9eb0ae5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac1447a0 con 0x7f9eac155860 2023-08-09T12:48:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.099+0000 7f9eb0ae5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac146840 con 0x7f9eac1536e0 2023-08-09T12:48:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.099+0000 7f9eb0ae5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac143b90 con 0x7f9e980047c0 2023-08-09T12:48:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.099+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eac155860 0x7f9eac15c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eac155860 0x7f9eac15c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58064/0 (socket says 172.21.15.17:58064) 2023-08-09T12:48:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eabfff640 1 -- 172.21.15.17:0/2255414615 learned_addr learned my addr 172.21.15.17:0/2255414615 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eab7fe640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e980047c0 0x7f9eac146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9ea2ffd640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eac1536e0 0x7f9eac155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eabfff640 1 -- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e980047c0 msgr2=0x7f9eac146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eabfff640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e980047c0 0x7f9eac146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eabfff640 1 -- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eac1536e0 msgr2=0x7f9eac155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eabfff640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eac1536e0 0x7f9eac155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eabfff640 1 -- 172.21.15.17:0/2255414615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac143e70 con 0x7f9eac155860 2023-08-09T12:48:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.100+0000 7f9eabfff640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eac155860 0x7f9eac15c260 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f9eac06a560 tx=0x7f9ea400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.101+0000 7f9ea8ff9640 1 -- 172.21.15.17:0/2255414615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4007480 con 0x7f9eac155860 2023-08-09T12:48:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.101+0000 7f9ea8ff9640 1 -- 172.21.15.17:0/2255414615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea40075e0 con 0x7f9eac155860 2023-08-09T12:48:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.101+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac144150 con 0x7f9eac155860 2023-08-09T12:48:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.101+0000 7f9ea8ff9640 1 -- 172.21.15.17:0/2255414615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4004260 con 0x7f9eac155860 2023-08-09T12:48:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.101+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac143860 con 0x7f9eac155860 2023-08-09T12:48:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.102+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac04e390 con 0x7f9eac155860 2023-08-09T12:48:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.103+0000 7f9ea8ff9640 1 -- 172.21.15.17:0/2255414615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ea40057c0 con 0x7f9eac155860 2023-08-09T12:48:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.105+0000 7f9ea8ff9640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e8c06a050 0x7f9e8c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.105+0000 7f9ea8ff9640 1 -- 172.21.15.17:0/2255414615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ea4087840 con 0x7f9eac155860 2023-08-09T12:48:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.105+0000 7f9eab7fe640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e8c06a050 0x7f9e8c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.106+0000 7f9eab7fe640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e8c06a050 0x7f9e8c06c510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9eac143730 tx=0x7f9e9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:17.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.109+0000 7f9ea8ff9640 1 -- 172.21.15.17:0/2255414615 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9ea4052e90 con 0x7f9eac155860 2023-08-09T12:48:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.311+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9eac0d0640 con 0x7f9eac155860 2023-08-09T12:48:17.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.313+0000 7f9ea8ff9640 1 -- 172.21.15.17:0/2255414615 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+36993 (secure 0 0 0) 0x7f9ea40564b0 con 0x7f9eac155860 2023-08-09T12:48:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:17.317 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:48:17.317 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 149, 2023-08-09T12:48:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:48:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:48:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:48:13.844363+0000", 2023-08-09T12:48:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:48:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:48:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:48:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:48:17.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:48:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:48:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:48:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:48:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:48:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:48:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:48:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:48:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:48:17.320 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:48:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 18, 2023-08-09T12:48:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:48:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:48:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:48:17.321 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:48:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:48:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:48:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:48:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:48:17.322 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:48:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:17.324 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:48:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:48:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:48:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:48:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:48:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:17.325 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:17.326 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:17.327 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:17.328 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:17.329 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:17.331 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:48:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:48:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:17.332 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:48:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:48:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:48:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:48:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:48:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:48:17.333 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:48:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:48:17.334 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:48:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:17.335 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:48:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:48:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:48:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:48:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:48:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:17.337 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:17.338 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:48:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:48:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.343 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:48:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:48:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:48:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:48:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:48:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:17.344 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 17, 2023-08-09T12:48:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:48:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:36.431201+0000", 2023-08-09T12:48:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:17.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:17.346 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:48:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:48:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:48:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:48:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:48:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:17.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "145", 2023-08-09T12:48:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:17.349 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:17.350 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:17.351 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:17.352 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:17.353 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:48:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:48:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:48:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:17.354 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:48:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:48:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:48:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:17.355 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:48:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:48:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.356 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 18, 2023-08-09T12:48:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:48:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:37.108075+0000", 2023-08-09T12:48:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:17.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:17.358 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:48:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:48:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:48:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:48:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:48:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:17.359 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "149", 2023-08-09T12:48:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:17.360 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:17.361 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:48:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:17.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:17.364 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:48:17.365 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:48:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:48:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:17.366 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.3799999952316284, 2023-08-09T12:48:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.3799999952316284, 2023-08-09T12:48:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-09T12:48:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-09T12:48:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:17.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:48:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.368 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.369 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:48:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:48:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:48:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:48:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:48:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:48:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.375 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:48:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:48:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:48:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:48:17.377 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:48:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:48:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.379 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:48:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:48:17.381 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.382 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:48:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:48:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.383 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:48:17.384 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:48:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:48:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:48:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:48:17.387 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:48:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:48:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:48:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:48:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:48:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.392 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:48:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:48:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:48:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:48:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.395 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:48:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:48:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:48:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:48:17.397 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:48:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:48:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.399 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:48:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:48:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:17.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:48:17.402 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:48:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:48:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:48:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.405 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:48:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.406 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:48:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:48:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:48:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:48:17.407 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:48:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.409 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.410 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.410 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.410 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.410 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.410 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.410 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:48:17.411 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:17.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.411 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:48:17.411 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:17.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.411 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:48:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:17.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:48:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:48:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:48:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.415 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:48:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.416 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:48:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:48:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:48:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:48:17.417 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:48:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:17.418 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.419 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:48:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:48:17.421 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:48:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:48:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:48:17.424 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:48:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:48:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:48:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:48:17.427 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:48:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:48:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:48:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.429 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:48:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:48:17.431 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.432 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:48:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:48:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:48:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:17.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:48:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:48:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:48:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:48:17.437 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:48:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:48:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:48:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.439 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:48:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:48:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:17.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:48:17.442 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:48:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:48:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:17.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:48:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.445 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:48:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:48:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:48:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:48:17.447 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:48:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:48:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:17.448 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:48:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:17.449 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:48:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:17.450 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:48:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:17.451 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:48:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:48:17.453 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:17.454 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:48:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:17.455 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:48:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:17.456 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:48:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:48:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:48:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:48:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:48:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:48:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:48:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:48:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:48:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:48:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:48:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:48:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:48:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:48:17.460 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:48:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:48:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:48:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:48:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:48:17.461 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:48:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:48:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:48:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:48:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:48:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:48:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:48:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:48:17.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.463 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:48:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e8c06a050 msgr2=0x7f9e8c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e8c06a050 0x7f9e8c06c510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9eac143730 tx=0x7f9e9c008040 comp rx=0 tx=0).stop 2023-08-09T12:48:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eac155860 msgr2=0x7f9eac15c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eac155860 0x7f9eac15c260 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f9eac06a560 tx=0x7f9ea400c820 comp rx=0 tx=0).stop 2023-08-09T12:48:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 shutdown_connections 2023-08-09T12:48:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9e8c06a050 0x7f9e8c06c510 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eac155860 0x7f9eac15c260 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eac1536e0 0x7f9eac155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 --2- 172.21.15.17:0/2255414615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e980047c0 0x7f9eac146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.316+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 >> 172.21.15.17:0/2255414615 conn(0x7f9eac0697c0 msgr2=0x7f9eac0c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.317+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 shutdown_connections 2023-08-09T12:48:17.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.317+0000 7f9eb0ae5640 1 -- 172.21.15.17:0/2255414615 wait complete. 2023-08-09T12:48:17.466 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-09T12:48:17.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:48:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.703+0000 7f6017fff640 1 Processor -- start 2023-08-09T12:48:17.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.703+0000 7f6017fff640 1 -- start start 2023-08-09T12:48:17.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.704+0000 7f6017fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6018072ea0 0x7f601806aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.704+0000 7f6017fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 0x7f601815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.704+0000 7f6017fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601806b000 con 0x7f6018072ac0 2023-08-09T12:48:17.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.704+0000 7f6017fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60180cada0 con 0x7f6018072ea0 2023-08-09T12:48:17.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.704+0000 7f6017fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601806fb40 con 0x7f601815c680 2023-08-09T12:48:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.705+0000 7f6016ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6018072ac0 0x7f601806a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39670/0 (socket says 172.21.15.17:39670) 2023-08-09T12:48:17.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.705+0000 7f6016ffd640 1 -- 172.21.15.17:0/731166782 learned_addr learned my addr 172.21.15.17:0/731166782 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.705+0000 7f60167fc640 1 --2- 172.21.15.17:0/731166782 >> v2:172.21.15.142:3300/0 conn(0x7f6018072ea0 0x7f601806aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.705+0000 7f60177fe640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 0x7f601815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.705+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322931079 0 0) 0x7f601806b000 con 0x7f6018072ac0 2023-08-09T12:48:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.705+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6000003520 con 0x7f6018072ac0 2023-08-09T12:48:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3216689863 0 0) 0x7f6000003520 con 0x7f6018072ac0 2023-08-09T12:48:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 msgr2=0x7f601815cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 0x7f601815cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 >> v2:172.21.15.142:3300/0 conn(0x7f6018072ea0 msgr2=0x7f601806aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 --2- 172.21.15.17:0/731166782 >> v2:172.21.15.142:3300/0 conn(0x7f6018072ea0 0x7f601806aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601806fe20 con 0x7f6018072ac0 2023-08-09T12:48:17.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f60080019f0 con 0x7f6018072ac0 2023-08-09T12:48:17.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 >> v1:172.21.15.17:6789/0 conn(0x7f6018072ac0 legacy=0x7f601806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f6000003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6000004360 0x7f6000004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 0x7f6000004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180cada0 con 0x7f6000003970 2023-08-09T12:48:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601806fb40 con 0x7f6000004360 2023-08-09T12:48:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600000b980 con 0x7f601815c680 2023-08-09T12:48:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.706+0000 7f6016ffd640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f6000003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.707+0000 7f60177fe640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 0x7f6000004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.707+0000 7f60167fc640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6000004360 0x7f6000004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.707+0000 7f6016ffd640 1 -- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 msgr2=0x7f6000004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.707+0000 7f6016ffd640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 0x7f6000004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.707+0000 7f6016ffd640 1 -- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6000004360 msgr2=0x7f6000004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.707+0000 7f6016ffd640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6000004360 0x7f6000004840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.707+0000 7f6016ffd640 1 -- 172.21.15.17:0/731166782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601806fe20 con 0x7f6000003970 2023-08-09T12:48:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.707+0000 7f60177fe640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f601815c680 0x7f6000004fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.708+0000 7f6016ffd640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f6000003d90 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f600800a970 tx=0x7f60000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f9ffde9c359bb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.708+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008034630 con 0x7f6000003970 2023-08-09T12:48:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.708+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600802f070 con 0x7f6000003970 2023-08-09T12:48:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.708+0000 7f6015ffb640 1 -- 172.21.15.17:0/731166782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080349f0 con 0x7f6000003970 2023-08-09T12:48:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.709+0000 7f6017fff640 1 -- 172.21.15.17:0/731166782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 msgr2=0x7f6000003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.709+0000 7f6017fff640 1 --2- 172.21.15.17:0/731166782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f6000003d90 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f600800a970 tx=0x7f60000057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.709+0000 7f60177fe640 1 -- 172.21.15.17:0/731166782 reap_dead start 2023-08-09T12:48:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.709+0000 7f6017fff640 1 -- 172.21.15.17:0/731166782 shutdown_connections 2023-08-09T12:48:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.709+0000 7f6017fff640 1 -- 172.21.15.17:0/731166782 >> 172.21.15.17:0/731166782 conn(0x7f60180cc430 msgr2=0x7f60180cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.709+0000 7f6017fff640 1 -- 172.21.15.17:0/731166782 shutdown_connections 2023-08-09T12:48:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.709+0000 7f6017fff640 1 -- 172.21.15.17:0/731166782 wait complete. 2023-08-09T12:48:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.711+0000 7f6017fff640 1 Processor -- start 2023-08-09T12:48:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.711+0000 7f6017fff640 1 -- start start 2023-08-09T12:48:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6017fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f601815f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6017fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601814c870 0x7f60180c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6017fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60180c8440 0x7f601814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6017fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601814a7e0 con 0x7f6000003970 2023-08-09T12:48:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6017fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180c8910 con 0x7f601814c870 2023-08-09T12:48:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6017fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6018149b60 con 0x7f60180c8440 2023-08-09T12:48:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6016ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f601815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6016ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f601815f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58082/0 (socket says 172.21.15.17:58082) 2023-08-09T12:48:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.712+0000 7f6016ffd640 1 -- 172.21.15.17:0/1293168207 learned_addr learned my addr 172.21.15.17:0/1293168207 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f60167fc640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601814c870 0x7f60180c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f6016ffd640 1 -- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60180c8440 msgr2=0x7f601814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f60177fe640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60180c8440 0x7f601814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f6016ffd640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60180c8440 0x7f601814bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f6016ffd640 1 -- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601814c870 msgr2=0x7f60180c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f6016ffd640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601814c870 0x7f60180c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f6016ffd640 1 -- 172.21.15.17:0/1293168207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018149e40 con 0x7f6000003970 2023-08-09T12:48:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f6016ffd640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f601815f550 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f600800aa90 tx=0x7f6008001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:17.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f5ffffff640 1 -- 172.21.15.17:0/1293168207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008040680 con 0x7f6000003970 2023-08-09T12:48:17.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f5ffffff640 1 -- 172.21.15.17:0/1293168207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080407e0 con 0x7f6000003970 2023-08-09T12:48:17.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f5ffffff640 1 -- 172.21.15.17:0/1293168207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008040b70 con 0x7f6000003970 2023-08-09T12:48:17.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.713+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601814a120 con 0x7f6000003970 2023-08-09T12:48:17.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.714+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601815fa90 con 0x7f6000003970 2023-08-09T12:48:17.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.715+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601804e390 con 0x7f6000003970 2023-08-09T12:48:17.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.716+0000 7f5ffffff640 1 -- 172.21.15.17:0/1293168207 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6008031030 con 0x7f6000003970 2023-08-09T12:48:17.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.717+0000 7f5ffffff640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f600406a050 0x7f600406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:17.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.717+0000 7f5ffffff640 1 -- 172.21.15.17:0/1293168207 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60080aa640 con 0x7f6000003970 2023-08-09T12:48:17.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.718+0000 7f60167fc640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f600406a050 0x7f600406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:17.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.719+0000 7f60167fc640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f600406a050 0x7f600406c510 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f601815a570 tx=0x7f600c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:17.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.722+0000 7f5ffffff640 1 -- 172.21.15.17:0/1293168207 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6008079730 con 0x7f6000003970 2023-08-09T12:48:17.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.919+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f60180c6580 con 0x7f6000003970 2023-08-09T12:48:17.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.922+0000 7f5ffffff640 1 -- 172.21.15.17:0/1293168207 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+36993 (secure 0 0 0) 0x7f60080792c0 con 0x7f6000003970 2023-08-09T12:48:17.926 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:17.926 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:48:17.926 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 149, 2023-08-09T12:48:17.926 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:48:17.926 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:48:17.927 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:48:13.844363+0000", 2023-08-09T12:48:17.927 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:48:17.927 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:48:17.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:48:17.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:48:17.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:48:17.927 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:48:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:48:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:48:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:48:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:48:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:48:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:48:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:48:17.929 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:48:17.929 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 18, 2023-08-09T12:48:17.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:48:17.929 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:48:17.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:48:17.929 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:48:17.929 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:48:17.930 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:48:17.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.930 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:48:17.930 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:48:17.930 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:48:17.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:17.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:17.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:17.931 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:17.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:17.931 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:17.931 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:17.931 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:17.931 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:17.931 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:17.931 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:17.932 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:17.932 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:48:17.932 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:48:17.932 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:48:17.932 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:48:17.932 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:48:17.932 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:17.932 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:17.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:17.933 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:17.933 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:17.933 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:17.933 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:17.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.933 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:17.934 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:17.934 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:17.934 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:17.934 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:17.934 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:17.934 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:17.934 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:17.934 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:17.935 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:17.935 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:17.935 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:17.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:17.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:17.935 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:17.935 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:17.935 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:17.936 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:17.936 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:17.936 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:17.936 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:17.936 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:17.936 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:17.936 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:17.936 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:17.937 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:17.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:17.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.937 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:17.937 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:17.937 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:17.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:17.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:17.938 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:17.938 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:17.938 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:17.938 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:17.938 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:17.938 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:17.938 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:17.938 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:48:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:48:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:48:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:48:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:48:17.940 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:48:17.940 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:48:17.940 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:48:17.940 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:17.940 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:17.940 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:17.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.941 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:48:17.941 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:48:17.941 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:48:17.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:17.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:17.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:17.942 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:17.942 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:17.942 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:17.942 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:17.942 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:17.942 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:17.942 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:17.942 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:48:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:48:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:48:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:48:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:48:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:48:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:17.945 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:17.945 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:17.945 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:17.945 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:17.945 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:17.945 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:17.945 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:17.946 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:17.946 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:17.946 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:17.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:17.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:17.946 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:17.946 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:17.946 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:17.947 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:17.947 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:17.947 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:17.947 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:17.947 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:17.947 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:17.947 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:17.947 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:17.948 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:17.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:17.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.948 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:17.948 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:17.948 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:17.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:17.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:17.949 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:17.949 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:17.949 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:17.949 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:17.949 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:17.949 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:17.949 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:48:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:48:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:48:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:48:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:48:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:48:17.951 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:48:17.951 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:17.951 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:17.951 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:17.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.951 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 17, 2023-08-09T12:48:17.952 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:48:17.952 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:36.431201+0000", 2023-08-09T12:48:17.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:17.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:17.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:17.952 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:17.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:17.953 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:17.953 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:17.953 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:17.953 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:17.953 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:17.953 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:17.953 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:17.953 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:48:17.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:48:17.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:48:17.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:48:17.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:48:17.954 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:17.954 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:17.954 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:17.954 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:17.955 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:17.955 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:17.955 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:17.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.955 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "145", 2023-08-09T12:48:17.955 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:17.955 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:17.955 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:17.956 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:17.956 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:17.956 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:17.956 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:17.956 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:17.956 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:17.956 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:48:17.957 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:17.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:17.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:17.957 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:17.957 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:17.957 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:17.957 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:17.957 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:17.958 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:17.958 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:17.958 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:17.958 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:17.958 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:17.958 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:17.958 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:17.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:17.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.959 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:17.959 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:17.959 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:17.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:17.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:17.959 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:17.959 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:17.960 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:17.960 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:17.960 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:17.960 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:17.960 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:17.960 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:48:17.960 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:48:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:48:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:48:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:48:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:48:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:48:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:48:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:17.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.963 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 18, 2023-08-09T12:48:17.963 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:48:17.963 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:47:37.108075+0000", 2023-08-09T12:48:17.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:48:17.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:48:17.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:48:17.964 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:48:17.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:48:17.964 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:48:17.964 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:48:17.964 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:48:17.964 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:48:17.965 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:48:17.965 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:48:17.965 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:48:17.965 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:48:17.965 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:48:17.965 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:48:17.965 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:48:17.965 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:48:17.966 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:48:17.966 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:48:17.966 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:48:17.966 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:48:17.966 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:48:17.966 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:48:17.966 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:48:17.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.967 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "149", 2023-08-09T12:48:17.967 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:48:17.967 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:48:17.967 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:48:17.967 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:48:17.967 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:48:17.967 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:48:17.967 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:48:17.968 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:48:17.968 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:48:17.968 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:48:17.968 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:48:17.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:48:17.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:48:17.968 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:48:17.969 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:48:17.969 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:48:17.969 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:48:17.969 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:48:17.969 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:48:17.969 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:48:17.969 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:48:17.969 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:48:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:48:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:48:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:48:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:48:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:48:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:48:17.970 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:48:17.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:48:17.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:48:17.971 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:48:17.971 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:48:17.971 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:48:17.971 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:48:17.971 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:48:17.971 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:48:17.972 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:48:17.972 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:48:17.972 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:48:17.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.972 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:48:17.972 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:48:17.972 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:48:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:48:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.3799999952316284, 2023-08-09T12:48:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.3799999952316284, 2023-08-09T12:48:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:48:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.3799999952316284, 2023-08-09T12:48:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.3799999952316284, 2023-08-09T12:48:17.974 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:48:17.974 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:48:17.974 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:48:17.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.974 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:17.974 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:48:17.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.975 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:17.975 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.975 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.975 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.975 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.975 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.975 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.975 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.976 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.976 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.976 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.976 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.976 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.976 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.977 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:48:17.977 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.977 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:48:17.977 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.978 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:48:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:48:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.979 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.980 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.980 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.980 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:48:17.980 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.981 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:48:17.981 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.981 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.982 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.982 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:48:17.982 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.983 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:48:17.983 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:48:17.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.983 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.983 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:48:17.983 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:48:17.983 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:48:17.984 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:48:17.984 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.984 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.984 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.985 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:17.985 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.985 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.985 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.985 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.985 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.985 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.985 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.986 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.986 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.986 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.986 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.986 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.986 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.987 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:48:17.987 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.987 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:48:17.987 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.988 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.988 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.988 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:48:17.989 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.989 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:48:17.989 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.989 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:48:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.991 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:48:17.991 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.991 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.991 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:17.992 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.992 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:48:17.992 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.993 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:48:17.993 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:48:17.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.994 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:48:17.994 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:48:17.994 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:48:17.994 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:48:17.994 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:17.994 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:17.994 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:17.996 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:17.996 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:17.996 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:17.996 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:17.996 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:17.996 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:17.996 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:17.996 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:17.997 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.997 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:48:17.997 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.998 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:48:17.998 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:17.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:17.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.998 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:17.998 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:17.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:17.999 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:48:17.999 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:17.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:17.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:17.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:17.999 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:48:17.999 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:18.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.000 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.000 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:18.000 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.001 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:48:18.001 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:18.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.001 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:48:18.001 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:18.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.002 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:18.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:48:18.002 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:48:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:48:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.004 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:48:18.004 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:48:18.004 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:48:18.004 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:48:18.004 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:18.004 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:18.004 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:18.005 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.005 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:18.005 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:18.005 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:18.005 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:18.005 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:18.006 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:18.006 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:18.006 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:18.006 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:18.006 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:18.006 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:18.006 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:18.006 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:18.007 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.007 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:48:18.007 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:18.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:48:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.009 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:48:18.009 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:18.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.009 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:48:18.009 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:18.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.010 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:18.010 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.010 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:48:18.011 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:18.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.011 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:48:18.011 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:18.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.012 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:18.012 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.012 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:48:18.012 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:18.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.013 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:48:18.013 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:48:18.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.014 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:48:18.014 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:48:18.014 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:48:18.014 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:48:18.014 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:18.014 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:18.014 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:18.014 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:48:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:48:18.018 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:18.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.018 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.018 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:18.018 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.019 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:48:18.019 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:18.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.019 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:48:18.019 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:18.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.020 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.020 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:18.020 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.020 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:48:18.021 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:18.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.021 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:48:18.021 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:18.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.022 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:18.022 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.022 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:48:18.022 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:18.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.023 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:48:18.023 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:48:18.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.023 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.023 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:48:18.024 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:48:18.024 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:48:18.024 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:48:18.024 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:18.024 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:18.024 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:18.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.025 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:18.025 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:18.025 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:18.025 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:18.025 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:18.025 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:18.026 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:18.026 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:18.026 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:18.026 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:18.026 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:18.026 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:18.026 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:18.026 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.027 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:48:18.027 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:18.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.027 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:48:18.028 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:18.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.028 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:18.028 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:48:18.029 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:18.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:48:18.029 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:18.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.030 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:18.030 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.030 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:48:18.031 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:18.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.031 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:48:18.031 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:18.031 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.031 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.032 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:18.032 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.032 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:48:18.032 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:18.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.033 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:48:18.033 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:48:18.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.033 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.033 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:48:18.034 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:48:18.034 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:48:18.034 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:48:18.034 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:18.034 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:18.034 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:18.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.035 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:18.035 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:18.035 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:18.035 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:18.035 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:18.035 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:18.035 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:18.036 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:18.036 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:18.036 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:18.036 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:18.036 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:18.036 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:18.036 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.037 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:48:18.037 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:18.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.037 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:48:18.039 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:18.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.039 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:48:18.039 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:18.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.040 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:18.040 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.040 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:48:18.040 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:18.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.041 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:48:18.041 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:18.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.041 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.042 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:18.042 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.042 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:48:18.042 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:18.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.043 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:48:18.043 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:48:18.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.043 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.043 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:48:18.043 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:48:18.044 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:48:18.044 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:48:18.044 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:18.044 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:18.044 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:18.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.045 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:18.045 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:48:18.045 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:48:18.045 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:48:18.045 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:48:18.045 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:48:18.045 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:48:18.045 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:48:18.046 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:48:18.046 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 144, 2023-08-09T12:48:18.046 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:48:18.046 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:48:18.046 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:48:18.046 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.047 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:48:18.047 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:18.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.047 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:48:18.047 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:18.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.048 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.048 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:48:18.048 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.048 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:48:18.049 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:18.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.049 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:48:18.049 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:18.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.049 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.050 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:48:18.050 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.050 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:48:18.050 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:18.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.051 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:48:18.051 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:18.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.051 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.051 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:48:18.052 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:48:18.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:48:18.052 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:48:18.052 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:18.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:48:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:48:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:48:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:48:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:48:18.054 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:48:18.054 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:48:18.054 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:48:18.054 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:48:18.054 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:48:18.054 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:18.054 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.054 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:18.055 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:48:18.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.055 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:48:18.055 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:18.055 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:18.055 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:18.055 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:18.055 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:18.056 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:48:18.056 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:18.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.056 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:48:18.056 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:18.056 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:18.057 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:18.057 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:18.057 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:18.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:48:18.057 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:18.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.057 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:48:18.058 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:18.058 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:18.058 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:18.058 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:18.058 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:18.058 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:48:18.058 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:18.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.059 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:48:18.059 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:18.059 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:18.059 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:18.059 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:18.059 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:18.059 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:48:18.060 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:18.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.060 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:48:18.060 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:18.060 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:18.060 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:18.060 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:48:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:48:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:18.062 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:18.062 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:18.062 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:18.062 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:48:18.062 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:18.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.062 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:48:18.063 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:18.063 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:18.063 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:18.063 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:18.063 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:18.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:48:18.063 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:18.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:18.064 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:48:18.064 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:48:18.064 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:48:18.064 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:48:18.064 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:48:18.064 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:48:18.064 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:48:18.065 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:48:18.065 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.065 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:48:18.065 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:48:18.065 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:48:18.065 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:48:18.065 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:48:18.065 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:48:18.066 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:48:18.066 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:48:18.066 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:48:18.066 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:48:18.066 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:48:18.066 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:48:18.066 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:48:18.067 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:48:18.067 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:48:18.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:18.067 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:48:18.067 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:48:18.067 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:48:18.067 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:48:18.068 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:48:18.068 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:48:18.068 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:48:18.068 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:48:18.068 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:48:18.068 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:48:18.068 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:48:18.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:18.069 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:48:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f600406a050 msgr2=0x7f600406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f600406a050 0x7f600406c510 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f601815a570 tx=0x7f600c008040 comp rx=0 tx=0).stop 2023-08-09T12:48:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 msgr2=0x7f601815f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f601815f550 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f600800aa90 tx=0x7f6008001360 comp rx=0 tx=0).stop 2023-08-09T12:48:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 shutdown_connections 2023-08-09T12:48:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f600406a050 0x7f600406c510 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60180c8440 0x7f601814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601814c870 0x7f60180c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 --2- 172.21.15.17:0/1293168207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6000003970 0x7f601815f550 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.925+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 >> 172.21.15.17:0/1293168207 conn(0x7f60180cc430 msgr2=0x7f60180ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.926+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 shutdown_connections 2023-08-09T12:48:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:17.926+0000 7f6017fff640 1 -- 172.21.15.17:0/1293168207 wait complete. 2023-08-09T12:48:18.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:18.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.307+0000 7f7311c6a640 1 Processor -- start 2023-08-09T12:48:18.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.307+0000 7f7311c6a640 1 -- start start 2023-08-09T12:48:18.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.309+0000 7f7311c6a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c0cb070 0x7f730c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:18.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.309+0000 7f7311c6a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c071340 con 0x7f730c070f00 2023-08-09T12:48:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.309+0000 7f7311c6a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c15beb0 con 0x7f730c1587e0 2023-08-09T12:48:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.309+0000 7f7311c6a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0cba20 con 0x7f730c0cb070 2023-08-09T12:48:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.309+0000 7f7303fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f730c070f00 0x7f730c15b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50816/0 (socket says 172.21.15.17:50816) 2023-08-09T12:48:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.309+0000 7f7303fff640 1 -- 172.21.15.17:0/1733383197 learned_addr learned my addr 172.21.15.17:0/1733383197 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.310+0000 7f7311469640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c0cb070 0x7f730c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.310+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141473306 0 0) 0x7f730c071340 con 0x7f730c070f00 2023-08-09T12:48:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.310+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f4003520 con 0x7f730c070f00 2023-08-09T12:48:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.310+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1180448353 0 0) 0x7f72f4003520 con 0x7f730c070f00 2023-08-09T12:48:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.310+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c0cb070 msgr2=0x7f730c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.310+0000 7f73037fe640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c0cb070 0x7f730c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.310+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 >> v1:172.21.15.142:6789/0 conn(0x7f730c1587e0 legacy=0x7f730c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0715c0 con 0x7f730c070f00 2023-08-09T12:48:18.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f72fc001670 con 0x7f730c070f00 2023-08-09T12:48:18.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 >> v1:172.21.15.17:6789/0 conn(0x7f730c070f00 legacy=0x7f730c15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f72f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:18.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c0cb070 0x7f72f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:18.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f4004d00 0x7f72f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:18.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0cba20 con 0x7f72f40039a0 2023-08-09T12:48:18.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f400ba30 con 0x7f72f4004d00 2023-08-09T12:48:18.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f400bbf0 con 0x7f730c0cb070 2023-08-09T12:48:18.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f7310c68640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f72f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:18.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f7311469640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f4004d00 0x7f72f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:18.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f7303fff640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c0cb070 0x7f72f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:18.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f7310c68640 1 -- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c0cb070 msgr2=0x7f72f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:18.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f7310c68640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c0cb070 0x7f72f40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f7310c68640 1 -- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f4004d00 msgr2=0x7f72f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:18.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.311+0000 7f7310c68640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f4004d00 0x7f72f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.312+0000 7f7310c68640 1 -- 172.21.15.17:0/1733383197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4003520 con 0x7f72f40039a0 2023-08-09T12:48:18.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.312+0000 7f7311469640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f4004d00 0x7f72f4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:18.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.313+0000 7f7310c68640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f72f4003dc0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f7308001e20 tx=0x7f72f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2c0fad70c41844 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:18.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.313+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308003b70 con 0x7f72f40039a0 2023-08-09T12:48:18.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.313+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7308003cd0 con 0x7f72f40039a0 2023-08-09T12:48:18.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.313+0000 7f73037fe640 1 -- 172.21.15.17:0/1733383197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308005310 con 0x7f72f40039a0 2023-08-09T12:48:18.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.313+0000 7f7311c6a640 1 -- 172.21.15.17:0/1733383197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 msgr2=0x7f72f4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.313+0000 7f7311c6a640 1 --2- 172.21.15.17:0/1733383197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f72f4003dc0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f7308001e20 tx=0x7f72f40057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.313+0000 7f7311469640 1 -- 172.21.15.17:0/1733383197 reap_dead start 2023-08-09T12:48:18.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.314+0000 7f7311c6a640 1 -- 172.21.15.17:0/1733383197 shutdown_connections 2023-08-09T12:48:18.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.314+0000 7f7311c6a640 1 -- 172.21.15.17:0/1733383197 >> 172.21.15.17:0/1733383197 conn(0x7f730c0b1d50 msgr2=0x7f730c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:18.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.314+0000 7f7311c6a640 1 -- 172.21.15.17:0/1733383197 shutdown_connections 2023-08-09T12:48:18.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.314+0000 7f7311c6a640 1 -- 172.21.15.17:0/1733383197 wait complete. 2023-08-09T12:48:18.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.316+0000 7f7311c6a640 1 Processor -- start 2023-08-09T12:48:18.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.316+0000 7f7311c6a640 1 -- start start 2023-08-09T12:48:18.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7311c6a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f730c1edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:18.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7311c6a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c06ac70 0x7f730c06b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:18.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7311c6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f730c15cae0 0x7f730c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:18.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7311c6a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c1ee190 con 0x7f72f40039a0 2023-08-09T12:48:18.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7311c6a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c06b630 con 0x7f730c15cae0 2023-08-09T12:48:18.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7311c6a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c151f90 con 0x7f730c06ac70 2023-08-09T12:48:18.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7310c68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f730c1edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:18.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7310c68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f730c1edc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38454/0 (socket says 172.21.15.17:38454) 2023-08-09T12:48:18.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.317+0000 7f7310c68640 1 -- 172.21.15.17:0/2494119220 learned_addr learned my addr 172.21.15.17:0/2494119220 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:18.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f7310c68640 1 -- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c06ac70 msgr2=0x7f730c06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f7310c68640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c06ac70 0x7f730c06b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f7310c68640 1 -- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f730c15cae0 msgr2=0x7f730c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f7311469640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f730c15cae0 0x7f730c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:18.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f7310c68640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f730c15cae0 0x7f730c15cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f7310c68640 1 -- 172.21.15.17:0/2494119220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c15d7a0 con 0x7f72f40039a0 2023-08-09T12:48:18.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f7310c68640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f730c1edc50 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7308001f40 tx=0x7f73080014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:18.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f73017fa640 1 -- 172.21.15.17:0/2494119220 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730803e070 con 0x7f72f40039a0 2023-08-09T12:48:18.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f73017fa640 1 -- 172.21.15.17:0/2494119220 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7308006b50 con 0x7f72f40039a0 2023-08-09T12:48:18.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f73017fa640 1 -- 172.21.15.17:0/2494119220 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308007030 con 0x7f72f40039a0 2023-08-09T12:48:18.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.318+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c15da80 con 0x7f72f40039a0 2023-08-09T12:48:18.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.319+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c15e040 con 0x7f72f40039a0 2023-08-09T12:48:18.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.320+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c04e390 con 0x7f72f40039a0 2023-08-09T12:48:18.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.321+0000 7f73017fa640 1 -- 172.21.15.17:0/2494119220 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7308007190 con 0x7f72f40039a0 2023-08-09T12:48:18.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.322+0000 7f73017fa640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:18.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.322+0000 7f73017fa640 1 -- 172.21.15.17:0/2494119220 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73080aa180 con 0x7f72f40039a0 2023-08-09T12:48:18.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.323+0000 7f7303fff640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:18.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.324+0000 7f7303fff640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f730c0cd390 tx=0x7f72fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:18.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.326+0000 7f73017fa640 1 -- 172.21.15.17:0/2494119220 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7308075860 con 0x7f72f40039a0 2023-08-09T12:48:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.556+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f730c06b8d0 con 0x7f72f40039a0 2023-08-09T12:48:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.557+0000 7f73017fa640 1 -- 172.21.15.17:0/2494119220 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f7308078e80 con 0x7f72f40039a0 2023-08-09T12:48:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:18.561 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:48:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:48:18.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 msgr2=0x7f72f806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f730c0cd390 tx=0x7f72fc009040 comp rx=0 tx=0).stop 2023-08-09T12:48:18.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 msgr2=0x7f730c1edc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:18.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f730c1edc50 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7308001f40 tx=0x7f73080014a0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 shutdown_connections 2023-08-09T12:48:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f730c15cae0 0x7f730c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730c06ac70 0x7f730c06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 --2- 172.21.15.17:0/2494119220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f40039a0 0x7f730c1edc50 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.560+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 >> 172.21.15.17:0/2494119220 conn(0x7f730c0b1d50 msgr2=0x7f730c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.561+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 shutdown_connections 2023-08-09T12:48:18.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:18.561+0000 7f7311c6a640 1 -- 172.21.15.17:0/2494119220 wait complete. 2023-08-09T12:48:18.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-08-09T12:48:18.822 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":7992,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":40.215283528999997,"mdsmap_epoch":67,"osdmap_epoch":149,"osdmap_epoch_barrier":148,"uptime":46.13598373} 2023-08-09T12:48:18.823 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 7992, "mdsmap_epoch": 67, "osdmap_epoch": 149, "osdmap_epoch_barrier": 148, "rank_uptime": 40.215283529, "state": "up:active", "uptime": 46.13598373, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:48:18.823 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:48:18.824 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:48:18.824 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:18.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:18.883 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-08-09T12:48:19.350 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records in 2023-08-09T12:48:19.351 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records out 2023-08-09T12:48:19.351 INFO:teuthology.orchestra.run.smithi017.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.411677 s, 127 MB/s 2023-08-09T12:48:19.352 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:48:19.353 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:48:19.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:48:19.601 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:48:19.602 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:48:19.602 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:19.665 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:48:19.666 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:19.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.957+0000 7f332cae0640 1 Processor -- start 2023-08-09T12:48:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.957+0000 7f332cae0640 1 -- start start 2023-08-09T12:48:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.958+0000 7f332cae0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f33280b86e0 0x7f33280cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.958+0000 7f332cae0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280b5a30 con 0x7f3328160030 2023-08-09T12:48:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.958+0000 7f332cae0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280cfdd0 con 0x7f33280cf980 2023-08-09T12:48:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.958+0000 7f332cae0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33280d1110 con 0x7f33280b86e0 2023-08-09T12:48:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.959+0000 7f3326ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f33280b86e0 0x7f33280cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.959+0000 7f3326ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f33280b86e0 0x7f33280cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38470/0 (socket says 172.21.15.17:38470) 2023-08-09T12:48:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.959+0000 7f3326ffd640 1 -- 172.21.15.17:0/3070087644 learned_addr learned my addr 172.21.15.17:0/3070087644 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.959+0000 7f33277fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3328160030 0x7f3328160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50818/0 (socket says 172.21.15.17:50818) 2023-08-09T12:48:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.959+0000 7f3326ffd640 1 -- 172.21.15.17:0/3070087644 >> v1:172.21.15.142:6789/0 conn(0x7f33280cf980 legacy=0x7f33280d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.959+0000 7f3326ffd640 1 -- 172.21.15.17:0/3070087644 >> v1:172.21.15.17:6789/0 conn(0x7f3328160030 legacy=0x7f3328160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.959+0000 7f3326ffd640 1 -- 172.21.15.17:0/3070087644 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280d0d70 con 0x7f33280b86e0 2023-08-09T12:48:19.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.960+0000 7f3326ffd640 1 --2- 172.21.15.17:0/3070087644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280b86e0 0x7f33280cf440 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f331c009870 tx=0x7f331c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fe546b68ba358c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:19.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f33267fc640 1 -- 172.21.15.17:0/3070087644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c030860 con 0x7f33280b86e0 2023-08-09T12:48:19.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f33267fc640 1 -- 172.21.15.17:0/3070087644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c0309c0 con 0x7f33280b86e0 2023-08-09T12:48:19.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f33267fc640 1 -- 172.21.15.17:0/3070087644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c030d50 con 0x7f33280b86e0 2023-08-09T12:48:19.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f332cae0640 1 -- 172.21.15.17:0/3070087644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280b86e0 msgr2=0x7f33280cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f332cae0640 1 --2- 172.21.15.17:0/3070087644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280b86e0 0x7f33280cf440 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f331c009870 tx=0x7f331c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:48:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f332cae0640 1 -- 172.21.15.17:0/3070087644 shutdown_connections 2023-08-09T12:48:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f332cae0640 1 --2- 172.21.15.17:0/3070087644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280b86e0 0x7f33280cf440 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f332cae0640 1 -- 172.21.15.17:0/3070087644 >> 172.21.15.17:0/3070087644 conn(0x7f33280697c0 msgr2=0x7f3328069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f332cae0640 1 -- 172.21.15.17:0/3070087644 shutdown_connections 2023-08-09T12:48:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.961+0000 7f332cae0640 1 -- 172.21.15.17:0/3070087644 wait complete. 2023-08-09T12:48:19.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.963+0000 7f332cae0640 1 Processor -- start 2023-08-09T12:48:19.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.963+0000 7f332cae0640 1 -- start start 2023-08-09T12:48:19.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.964+0000 7f332cae0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33280b86e0 0x7f33280b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:19.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.964+0000 7f332cae0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280cf980 0x7f33280c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:19.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.964+0000 7f332cae0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3328160030 0x7f33280c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:19.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.964+0000 7f332cae0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332814be50 con 0x7f33280cf980 2023-08-09T12:48:19.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.964+0000 7f332cae0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332814c990 con 0x7f3328160030 2023-08-09T12:48:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.964+0000 7f332cae0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332814c060 con 0x7f33280b86e0 2023-08-09T12:48:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.964+0000 7f3326ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280cf980 0x7f33280c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3326ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280cf980 0x7f33280c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38472/0 (socket says 172.21.15.17:38472) 2023-08-09T12:48:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3326ffd640 1 -- 172.21.15.17:0/1096315823 learned_addr learned my addr 172.21.15.17:0/1096315823 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f33277fe640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33280b86e0 0x7f33280b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3327fff640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3328160030 0x7f33280c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3326ffd640 1 -- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33280b86e0 msgr2=0x7f33280b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3326ffd640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33280b86e0 0x7f33280b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3326ffd640 1 -- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3328160030 msgr2=0x7f33280c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3326ffd640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3328160030 0x7f33280c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3326ffd640 1 -- 172.21.15.17:0/1096315823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c0094d0 con 0x7f33280cf980 2023-08-09T12:48:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.965+0000 7f3326ffd640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280cf980 0x7f33280c8600 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f331c009870 tx=0x7f331c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.966+0000 7f330ffff640 1 -- 172.21.15.17:0/1096315823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c030810 con 0x7f33280cf980 2023-08-09T12:48:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.966+0000 7f330ffff640 1 -- 172.21.15.17:0/1096315823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c043400 con 0x7f33280cf980 2023-08-09T12:48:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.966+0000 7f330ffff640 1 -- 172.21.15.17:0/1096315823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c0437b0 con 0x7f33280cf980 2023-08-09T12:48:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.966+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332814c340 con 0x7f33280cf980 2023-08-09T12:48:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.966+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33280c7980 con 0x7f33280cf980 2023-08-09T12:48:19.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.967+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332814cb40 con 0x7f33280cf980 2023-08-09T12:48:19.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.968+0000 7f330ffff640 1 -- 172.21.15.17:0/1096315823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f331c043910 con 0x7f33280cf980 2023-08-09T12:48:19.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.969+0000 7f330ffff640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f331406a050 0x7f331406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:19.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.969+0000 7f330ffff640 1 -- 172.21.15.17:0/1096315823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f331c03e070 con 0x7f33280cf980 2023-08-09T12:48:19.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.970+0000 7f33277fe640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f331406a050 0x7f331406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:19.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.971+0000 7f33277fe640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f331406a050 0x7f331406c510 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3318007ef0 tx=0x7f3318007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:19.974+0000 7f330ffff640 1 -- 172.21.15.17:0/1096315823 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f332814cb40 con 0x7f33280cf980 2023-08-09T12:48:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.170+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33280cfdd0 con 0x7f33280cf980 2023-08-09T12:48:20.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.172+0000 7f330ffff640 1 -- 172.21.15.17:0/1096315823 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f33280cfdd0 con 0x7f33280cf980 2023-08-09T12:48:20.176 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":149,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:13.844363+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:47:36.431201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-09T12:47:37.108075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:20.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.175+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f331406a050 msgr2=0x7f331406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.175+0000 7f332cae0640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f331406a050 0x7f331406c510 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3318007ef0 tx=0x7f3318007e80 comp rx=0 tx=0).stop 2023-08-09T12:48:20.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.175+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280cf980 msgr2=0x7f33280c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.175+0000 7f332cae0640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280cf980 0x7f33280c8600 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f331c009870 tx=0x7f331c004730 comp rx=0 tx=0).stop 2023-08-09T12:48:20.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.176+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 shutdown_connections 2023-08-09T12:48:20.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.176+0000 7f332cae0640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f331406a050 0x7f331406c510 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.176+0000 7f332cae0640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3328160030 0x7f33280c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.176+0000 7f332cae0640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33280cf980 0x7f33280c8600 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.176+0000 7f332cae0640 1 --2- 172.21.15.17:0/1096315823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33280b86e0 0x7f33280b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.176+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 >> 172.21.15.17:0/1096315823 conn(0x7f33280697c0 msgr2=0x7f33280c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:20.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.176+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 shutdown_connections 2023-08-09T12:48:20.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.176+0000 7f332cae0640 1 -- 172.21.15.17:0/1096315823 wait complete. 2023-08-09T12:48:20.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:47:36.431201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:47:37.108075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:48:20.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:48:20.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.442+0000 7fa7ecd47640 1 Processor -- start 2023-08-09T12:48:20.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.442+0000 7fa7ecd47640 1 -- start start 2023-08-09T12:48:20.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7ecd47640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b2060 0x7fa7e8161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7ecd47640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa7e80b1b10 0x7fa7e806fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7ecd47640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e8070190 con 0x7fa7e80cef50 2023-08-09T12:48:20.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7ecd47640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80b15c0 con 0x7fa7e80b1b10 2023-08-09T12:48:20.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7ecd47640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e8073180 con 0x7fa7e80b2060 2023-08-09T12:48:20.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7e659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa7e80cef50 0x7fa7e8160e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50824/0 (socket says 172.21.15.17:50824) 2023-08-09T12:48:20.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7e659c640 1 -- 172.21.15.17:0/3522944120 learned_addr learned my addr 172.21.15.17:0/3522944120 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:20.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7e6d9d640 1 --2- 172.21.15.17:0/3522944120 >> v2:172.21.15.17:3300/0 conn(0x7fa7e80b1b10 0x7fa7e806fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.444+0000 7fa7e5d9b640 1 --2- 172.21.15.17:0/3522944120 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b2060 0x7fa7e8161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.445+0000 7fa7e559a640 1 -- 172.21.15.17:0/3522944120 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378136795 0 0) 0x7fa7e8070190 con 0x7fa7e80cef50 2023-08-09T12:48:20.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.445+0000 7fa7e559a640 1 -- 172.21.15.17:0/3522944120 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d4003520 con 0x7fa7e80cef50 2023-08-09T12:48:20.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.445+0000 7fa7e6d9d640 1 -- 172.21.15.17:0/3522944120 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b2060 msgr2=0x7fa7e8161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:20.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.445+0000 7fa7e6d9d640 1 --2- 172.21.15.17:0/3522944120 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b2060 0x7fa7e8161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.445+0000 7fa7e6d9d640 1 -- 172.21.15.17:0/3522944120 >> v1:172.21.15.17:6789/0 conn(0x7fa7e80cef50 legacy=0x7fa7e8160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.445+0000 7fa7e6d9d640 1 -- 172.21.15.17:0/3522944120 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80cd680 con 0x7fa7e80b1b10 2023-08-09T12:48:20.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.446+0000 7fa7e6d9d640 1 --2- 172.21.15.17:0/3522944120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80b1b10 0x7fa7e806fc50 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa7e806b2d0 tx=0x7fa7e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d825efc764add45f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:20.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.447+0000 7fa7e559a640 1 -- 172.21.15.17:0/3522944120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0031830 con 0x7fa7e80b1b10 2023-08-09T12:48:20.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.447+0000 7fa7e559a640 1 -- 172.21.15.17:0/3522944120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0031990 con 0x7fa7e80b1b10 2023-08-09T12:48:20.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.447+0000 7fa7e559a640 1 -- 172.21.15.17:0/3522944120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0031d20 con 0x7fa7e80b1b10 2023-08-09T12:48:20.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.448+0000 7fa7ecd47640 1 -- 172.21.15.17:0/3522944120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80b1b10 msgr2=0x7fa7e806fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.448+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/3522944120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80b1b10 0x7fa7e806fc50 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa7e806b2d0 tx=0x7fa7e002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.448+0000 7fa7ecd47640 1 -- 172.21.15.17:0/3522944120 shutdown_connections 2023-08-09T12:48:20.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.448+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/3522944120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80b1b10 0x7fa7e806fc50 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.448+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/3522944120 >> v2:172.21.15.142:3300/0 conn(0x7fa7e80b2060 0x7fa7e8161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.448+0000 7fa7ecd47640 1 -- 172.21.15.17:0/3522944120 >> 172.21.15.17:0/3522944120 conn(0x7fa7e80cf930 msgr2=0x7fa7e80cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:20.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.448+0000 7fa7ecd47640 1 -- 172.21.15.17:0/3522944120 shutdown_connections 2023-08-09T12:48:20.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.448+0000 7fa7ecd47640 1 -- 172.21.15.17:0/3522944120 wait complete. 2023-08-09T12:48:20.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.450+0000 7fa7ecd47640 1 Processor -- start 2023-08-09T12:48:20.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.450+0000 7fa7ecd47640 1 -- start start 2023-08-09T12:48:20.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.451+0000 7fa7ecd47640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b1b10 0x7fa7e80c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.451+0000 7fa7ecd47640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e80b2060 0x7fa7e81fa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.451+0000 7fa7ecd47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80cef50 0x7fa7e80c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.451+0000 7fa7ecd47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80bf210 con 0x7fa7e80cef50 2023-08-09T12:48:20.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.451+0000 7fa7ecd47640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e81fad00 con 0x7fa7e80b2060 2023-08-09T12:48:20.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.451+0000 7fa7ecd47640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80be590 con 0x7fa7e80b1b10 2023-08-09T12:48:20.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.452+0000 7fa7e6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80cef50 0x7fa7e80c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.452+0000 7fa7e6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80cef50 0x7fa7e80c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38492/0 (socket says 172.21.15.17:38492) 2023-08-09T12:48:20.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.452+0000 7fa7e6d9d640 1 -- 172.21.15.17:0/2913033993 learned_addr learned my addr 172.21.15.17:0/2913033993 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:20.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.452+0000 7fa7e5d9b640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e80b2060 0x7fa7e81fa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.452+0000 7fa7e659c640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b1b10 0x7fa7e80c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.452+0000 7fa7e6d9d640 1 -- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b1b10 msgr2=0x7fa7e80c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7e6d9d640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b1b10 0x7fa7e80c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7e6d9d640 1 -- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e80b2060 msgr2=0x7fa7e81fa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7e6d9d640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e80b2060 0x7fa7e81fa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7e6d9d640 1 -- 172.21.15.17:0/2913033993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009400 con 0x7fa7e80cef50 2023-08-09T12:48:20.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7e659c640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b1b10 0x7fa7e80c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:48:20.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7e6d9d640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80cef50 0x7fa7e80c49b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009890 tx=0x7fa7e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:20.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7deffd640 1 -- 172.21.15.17:0/2913033993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e003a630 con 0x7fa7e80cef50 2023-08-09T12:48:20.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7deffd640 1 -- 172.21.15.17:0/2913033993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e003a790 con 0x7fa7e80cef50 2023-08-09T12:48:20.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.453+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80be870 con 0x7fa7e80cef50 2023-08-09T12:48:20.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.454+0000 7fa7deffd640 1 -- 172.21.15.17:0/2913033993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e003ab40 con 0x7fa7e80cef50 2023-08-09T12:48:20.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.454+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80bee30 con 0x7fa7e80cef50 2023-08-09T12:48:20.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.455+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e80662a0 con 0x7fa7e80cef50 2023-08-09T12:48:20.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.456+0000 7fa7deffd640 1 -- 172.21.15.17:0/2913033993 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7e003aca0 con 0x7fa7e80cef50 2023-08-09T12:48:20.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.457+0000 7fa7deffd640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7c806a050 0x7fa7c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.457+0000 7fa7deffd640 1 -- 172.21.15.17:0/2913033993 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7e00aa340 con 0x7fa7e80cef50 2023-08-09T12:48:20.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.458+0000 7fa7e659c640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7c806a050 0x7fa7c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.459+0000 7fa7e659c640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7c806a050 0x7fa7c806c510 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8001560 tx=0x7fa7d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:20.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.462+0000 7fa7deffd640 1 -- 172.21.15.17:0/2913033993 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa7e0075ae0 con 0x7fa7e80cef50 2023-08-09T12:48:20.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.656+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7e80bf350 con 0x7fa7e80cef50 2023-08-09T12:48:20.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.657+0000 7fa7deffd640 1 -- 172.21.15.17:0/2913033993 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7e80bf350 con 0x7fa7e80cef50 2023-08-09T12:48:20.661 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:48:20.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7c806a050 msgr2=0x7fa7c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7c806a050 0x7fa7c806c510 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8001560 tx=0x7fa7d8009040 comp rx=0 tx=0).stop 2023-08-09T12:48:20.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80cef50 msgr2=0x7fa7e80c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80cef50 0x7fa7e80c49b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009890 tx=0x7fa7e00046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 shutdown_connections 2023-08-09T12:48:20.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7c806a050 0x7fa7c806c510 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e80cef50 0x7fa7e80c49b0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7e80b2060 0x7fa7e81fa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 --2- 172.21.15.17:0/2913033993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7e80b1b10 0x7fa7e80c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 >> 172.21.15.17:0/2913033993 conn(0x7fa7e80cf930 msgr2=0x7fa7e806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 shutdown_connections 2023-08-09T12:48:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.660+0000 7fa7ecd47640 1 -- 172.21.15.17:0/2913033993 wait complete. 2023-08-09T12:48:20.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:48:20.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.909+0000 7f075ec15640 1 Processor -- start 2023-08-09T12:48:20.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.909+0000 7f075ec15640 1 -- start start 2023-08-09T12:48:20.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.911+0000 7f075ec15640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07580b0730 0x7f07580cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.911+0000 7f075ec15640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07580cc170 con 0x7f0758161000 2023-08-09T12:48:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.911+0000 7f075ec15640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07580cc450 con 0x7f07580b41c0 2023-08-09T12:48:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.911+0000 7f075ec15640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580cc730 con 0x7f07580b0730 2023-08-09T12:48:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075dc13640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0758161000 0x7f07580b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50834/0 (socket says 172.21.15.17:50834) 2023-08-09T12:48:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075dc13640 1 -- 172.21.15.17:0/864154332 learned_addr learned my addr 172.21.15.17:0/864154332 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075d412640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07580b0730 0x7f07580cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250477639 0 0) 0x7f07580cc170 con 0x7f0758161000 2023-08-09T12:48:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0744003520 con 0x7f0758161000 2023-08-09T12:48:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193760718 0 0) 0x7f0744003520 con 0x7f0758161000 2023-08-09T12:48:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07580b0730 msgr2=0x7f07580cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075cc11640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07580b0730 0x7f07580cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.912+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 >> v1:172.21.15.142:6789/0 conn(0x7f07580b41c0 legacy=0x7f07580cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580cca10 con 0x7f0758161000 2023-08-09T12:48:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0754001670 con 0x7f0758161000 2023-08-09T12:48:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 >> v1:172.21.15.17:6789/0 conn(0x7f0758161000 legacy=0x7f07580b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07580b0730 0x7f07440039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0744003f20 0x7f07440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744004d00 0x7f0744005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580cc730 con 0x7f0744003f20 2023-08-09T12:48:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074400ba60 con 0x7f0744004d00 2023-08-09T12:48:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074400bc20 con 0x7f07580b0730 2023-08-09T12:48:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075d412640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0744003f20 0x7f07440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075dc13640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07580b0730 0x7f07440039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075d412640 1 -- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07580b0730 msgr2=0x7f07440039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075d412640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07580b0730 0x7f07440039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075d412640 1 -- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744004d00 msgr2=0x7f0744005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075d412640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744004d00 0x7f0744005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.913+0000 7f075d412640 1 -- 172.21.15.17:0/864154332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744003520 con 0x7f0744003f20 2023-08-09T12:48:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.915+0000 7f075d412640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0744003f20 0x7f07440047c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f0748009ac0 tx=0x7f07440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5cca318c4a6a47 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:20.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.915+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074802c6b0 con 0x7f0744003f20 2023-08-09T12:48:20.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.915+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074802c810 con 0x7f0744003f20 2023-08-09T12:48:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.915+0000 7f075cc11640 1 -- 172.21.15.17:0/864154332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074802cba0 con 0x7f0744003f20 2023-08-09T12:48:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.915+0000 7f075ec15640 1 -- 172.21.15.17:0/864154332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0744003f20 msgr2=0x7f07440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.916+0000 7f075ec15640 1 --2- 172.21.15.17:0/864154332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0744003f20 0x7f07440047c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f0748009ac0 tx=0x7f07440057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.916+0000 7f075e414640 1 -- 172.21.15.17:0/864154332 reap_dead start 2023-08-09T12:48:20.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.916+0000 7f075ec15640 1 -- 172.21.15.17:0/864154332 shutdown_connections 2023-08-09T12:48:20.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.916+0000 7f075ec15640 1 -- 172.21.15.17:0/864154332 >> 172.21.15.17:0/864154332 conn(0x7f07580cb020 msgr2=0x7f07580cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:20.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.916+0000 7f075ec15640 1 -- 172.21.15.17:0/864154332 shutdown_connections 2023-08-09T12:48:20.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.916+0000 7f075ec15640 1 -- 172.21.15.17:0/864154332 wait complete. 2023-08-09T12:48:20.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.917+0000 7f075ec15640 1 Processor -- start 2023-08-09T12:48:20.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.918+0000 7f075ec15640 1 -- start start 2023-08-09T12:48:20.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075ec15640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744003f20 0x7f07580c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075ec15640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0758071280 0x7f07581fa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075ec15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07580ce4d0 0x7f0758162610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075ec15640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580c5040 con 0x7f07580ce4d0 2023-08-09T12:48:20.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075ec15640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07581fab80 con 0x7f0744003f20 2023-08-09T12:48:20.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075ec15640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580c3810 con 0x7f0758071280 2023-08-09T12:48:20.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075e414640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07580ce4d0 0x7f0758162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075e414640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07580ce4d0 0x7f0758162610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38510/0 (socket says 172.21.15.17:38510) 2023-08-09T12:48:20.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075e414640 1 -- 172.21.15.17:0/1200651213 learned_addr learned my addr 172.21.15.17:0/1200651213 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:20.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075dc13640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744003f20 0x7f07580c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075e414640 1 -- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0758071280 msgr2=0x7f07581fa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075d412640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0758071280 0x7f07581fa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075e414640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0758071280 0x7f07581fa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075e414640 1 -- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744003f20 msgr2=0x7f07580c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:20.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075e414640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744003f20 0x7f07580c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:20.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075e414640 1 -- 172.21.15.17:0/1200651213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580c3a60 con 0x7f07580ce4d0 2023-08-09T12:48:20.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.919+0000 7f075dc13640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744003f20 0x7f07580c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:20.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.920+0000 7f075e414640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07580ce4d0 0x7f0758162610 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f075806be50 tx=0x7f075000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:20.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.920+0000 7f074e7fc640 1 -- 172.21.15.17:0/1200651213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750005d40 con 0x7f07580ce4d0 2023-08-09T12:48:20.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.920+0000 7f074e7fc640 1 -- 172.21.15.17:0/1200651213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000ced0 con 0x7f07580ce4d0 2023-08-09T12:48:20.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.920+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07580c3d40 con 0x7f07580ce4d0 2023-08-09T12:48:20.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.920+0000 7f074e7fc640 1 -- 172.21.15.17:0/1200651213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000a7f0 con 0x7f07580ce4d0 2023-08-09T12:48:20.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.920+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07580c4300 con 0x7f07580ce4d0 2023-08-09T12:48:20.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.921+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075804e390 con 0x7f07580ce4d0 2023-08-09T12:48:20.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.922+0000 7f074e7fc640 1 -- 172.21.15.17:0/1200651213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f075000a950 con 0x7f07580ce4d0 2023-08-09T12:48:20.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.923+0000 7f074e7fc640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073c06a080 0x7f073c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:20.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.923+0000 7f074e7fc640 1 -- 172.21.15.17:0/1200651213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0750087aa0 con 0x7f07580ce4d0 2023-08-09T12:48:20.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.924+0000 7f075dc13640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073c06a080 0x7f073c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:20.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.925+0000 7f075dc13640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073c06a080 0x7f073c06c540 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f07540017a0 tx=0x7f0754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:20.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:20.928+0000 7f074e7fc640 1 -- 172.21.15.17:0/1200651213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f07500530f0 con 0x7f07580ce4d0 2023-08-09T12:48:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.122+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f075815ba70 con 0x7f07580ce4d0 2023-08-09T12:48:21.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.123+0000 7f074e7fc640 1 -- 172.21.15.17:0/1200651213 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07500170a0 con 0x7f07580ce4d0 2023-08-09T12:48:21.126 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:48:21.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073c06a080 msgr2=0x7f073c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073c06a080 0x7f073c06c540 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f07540017a0 tx=0x7f0754009040 comp rx=0 tx=0).stop 2023-08-09T12:48:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07580ce4d0 msgr2=0x7f0758162610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07580ce4d0 0x7f0758162610 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f075806be50 tx=0x7f075000cb90 comp rx=0 tx=0).stop 2023-08-09T12:48:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 shutdown_connections 2023-08-09T12:48:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073c06a080 0x7f073c06c540 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07580ce4d0 0x7f0758162610 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0758071280 0x7f07581fa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 --2- 172.21.15.17:0/1200651213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0744003f20 0x7f07580c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 >> 172.21.15.17:0/1200651213 conn(0x7f07580cb020 msgr2=0x7f075815e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 shutdown_connections 2023-08-09T12:48:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.125+0000 7f075ec15640 1 -- 172.21.15.17:0/1200651213 wait complete. 2023-08-09T12:48:21.148 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:48:21.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.376+0000 7fe47759e640 1 Processor -- start 2023-08-09T12:48:21.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.376+0000 7fe47759e640 1 -- start start 2023-08-09T12:48:21.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.378+0000 7fe47759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 0x7fe4780b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.378+0000 7fe47759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4780b4e50 con 0x7fe4780cd9a0 2023-08-09T12:48:21.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.378+0000 7fe47759e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe478069960 con 0x7fe4780b49f0 2023-08-09T12:48:21.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.378+0000 7fe47759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780cdfc0 con 0x7fe47815ce30 2023-08-09T12:48:21.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.378+0000 7fe476d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe4780cd9a0 0x7fe4780b59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50842/0 (socket says 172.21.15.17:50842) 2023-08-09T12:48:21.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.378+0000 7fe476d9d640 1 -- 172.21.15.17:0/3283687458 learned_addr learned my addr 172.21.15.17:0/3283687458 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:21.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe47659c640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 0x7fe4780b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582018034 0 0) 0x7fe4780b4e50 con 0x7fe4780cd9a0 2023-08-09T12:48:21.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe464003520 con 0x7fe4780cd9a0 2023-08-09T12:48:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906805407 0 0) 0x7fe464003520 con 0x7fe4780cd9a0 2023-08-09T12:48:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 msgr2=0x7fe4780b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 0x7fe4780b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 >> v1:172.21.15.142:6789/0 conn(0x7fe4780b49f0 legacy=0x7fe4780cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478069c40 con 0x7fe4780cd9a0 2023-08-09T12:48:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe470001670 con 0x7fe4780cd9a0 2023-08-09T12:48:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 >> v1:172.21.15.17:6789/0 conn(0x7fe4780cd9a0 legacy=0x7fe4780b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe464003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 0x7fe4640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.379+0000 7fe475d9b640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe464004d00 0x7fe464005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780cdfc0 con 0x7fe4640039a0 2023-08-09T12:48:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46400ba30 con 0x7fe464004d00 2023-08-09T12:48:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46400bbf0 con 0x7fe47815ce30 2023-08-09T12:48:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe47659c640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe464003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe46dd9b640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 0x7fe4640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe476d9d640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe464004d00 0x7fe464005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe47659c640 1 -- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 msgr2=0x7fe4640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe47659c640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 0x7fe4640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe47659c640 1 -- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe464004d00 msgr2=0x7fe464005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe47659c640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe464004d00 0x7fe464005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe47659c640 1 -- 172.21.15.17:0/3283687458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464003520 con 0x7fe4640039a0 2023-08-09T12:48:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.380+0000 7fe46dd9b640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47815ce30 0x7fe4640047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.381+0000 7fe47659c640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe464003dc0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fe468009a90 tx=0x7fe4640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674369b55896213 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.382+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46802c680 con 0x7fe4640039a0 2023-08-09T12:48:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.382+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46802c7e0 con 0x7fe4640039a0 2023-08-09T12:48:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.382+0000 7fe475d9b640 1 -- 172.21.15.17:0/3283687458 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46802cb70 con 0x7fe4640039a0 2023-08-09T12:48:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.382+0000 7fe47759e640 1 -- 172.21.15.17:0/3283687458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 msgr2=0x7fe464003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.382+0000 7fe47759e640 1 --2- 172.21.15.17:0/3283687458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe464003dc0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fe468009a90 tx=0x7fe4640057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.382+0000 7fe476d9d640 1 -- 172.21.15.17:0/3283687458 reap_dead start 2023-08-09T12:48:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.383+0000 7fe47759e640 1 -- 172.21.15.17:0/3283687458 shutdown_connections 2023-08-09T12:48:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.383+0000 7fe47759e640 1 -- 172.21.15.17:0/3283687458 >> 172.21.15.17:0/3283687458 conn(0x7fe4780cf4b0 msgr2=0x7fe4780cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.383+0000 7fe47759e640 1 -- 172.21.15.17:0/3283687458 shutdown_connections 2023-08-09T12:48:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.383+0000 7fe47759e640 1 -- 172.21.15.17:0/3283687458 wait complete. 2023-08-09T12:48:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.384+0000 7fe47759e640 1 Processor -- start 2023-08-09T12:48:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.385+0000 7fe47759e640 1 -- start start 2023-08-09T12:48:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe4780ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47814b0a0 0x7fe47814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4780c76b0 0x7fe4780c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c8430 con 0x7fe4640039a0 2023-08-09T12:48:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c8710 con 0x7fe4780c76b0 2023-08-09T12:48:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c89f0 con 0x7fe47814b0a0 2023-08-09T12:48:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe4780ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe4780ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38528/0 (socket says 172.21.15.17:38528) 2023-08-09T12:48:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47659c640 1 -- 172.21.15.17:0/4134650634 learned_addr learned my addr 172.21.15.17:0/4134650634 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe46dd9b640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47814b0a0 0x7fe47814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe476d9d640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4780c76b0 0x7fe4780c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47659c640 1 -- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47814b0a0 msgr2=0x7fe47814b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47659c640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47814b0a0 0x7fe47814b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47659c640 1 -- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4780c76b0 msgr2=0x7fe4780c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47659c640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4780c76b0 0x7fe4780c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.386+0000 7fe47659c640 1 -- 172.21.15.17:0/4134650634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780c8cd0 con 0x7fe4640039a0 2023-08-09T12:48:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.387+0000 7fe476d9d640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4780c76b0 0x7fe4780c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.387+0000 7fe47659c640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe4780ccaa0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fe468009a90 tx=0x7fe468004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.387+0000 7fe46f7fe640 1 -- 172.21.15.17:0/4134650634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46802dea0 con 0x7fe4640039a0 2023-08-09T12:48:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.387+0000 7fe46f7fe640 1 -- 172.21.15.17:0/4134650634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe468003810 con 0x7fe4640039a0 2023-08-09T12:48:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.387+0000 7fe46f7fe640 1 -- 172.21.15.17:0/4134650634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468003ba0 con 0x7fe4640039a0 2023-08-09T12:48:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.387+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4780c8fb0 con 0x7fe4640039a0 2023-08-09T12:48:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.388+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4780c8050 con 0x7fe4640039a0 2023-08-09T12:48:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.389+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47804e390 con 0x7fe4640039a0 2023-08-09T12:48:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.390+0000 7fe46f7fe640 1 -- 172.21.15.17:0/4134650634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe468003d00 con 0x7fe4640039a0 2023-08-09T12:48:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.391+0000 7fe46f7fe640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe45806a050 0x7fe45806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.391+0000 7fe46f7fe640 1 -- 172.21.15.17:0/4134650634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4680aa4c0 con 0x7fe4640039a0 2023-08-09T12:48:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.392+0000 7fe46dd9b640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe45806a050 0x7fe45806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.393+0000 7fe46dd9b640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe45806a050 0x7fe45806c510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe478151e20 tx=0x7fe460009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:21.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.396+0000 7fe46f7fe640 1 -- 172.21.15.17:0/4134650634 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe468075b10 con 0x7fe4640039a0 2023-08-09T12:48:21.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.587+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4780c61d0 con 0x7fe4640039a0 2023-08-09T12:48:21.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.588+0000 7fe46f7fe640 1 -- 172.21.15.17:0/4134650634 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe4680044e0 con 0x7fe4640039a0 2023-08-09T12:48:21.591 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:48:21.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe45806a050 msgr2=0x7fe45806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe45806a050 0x7fe45806c510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe478151e20 tx=0x7fe460009040 comp rx=0 tx=0).stop 2023-08-09T12:48:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 msgr2=0x7fe4780ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe4780ccaa0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fe468009a90 tx=0x7fe468004730 comp rx=0 tx=0).stop 2023-08-09T12:48:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 shutdown_connections 2023-08-09T12:48:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe45806a050 0x7fe45806c510 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4780c76b0 0x7fe4780c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe47814b0a0 0x7fe47814b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 --2- 172.21.15.17:0/4134650634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4640039a0 0x7fe4780ccaa0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 >> 172.21.15.17:0/4134650634 conn(0x7fe4780cf4b0 msgr2=0x7fe478065460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 shutdown_connections 2023-08-09T12:48:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.591+0000 7fe47759e640 1 -- 172.21.15.17:0/4134650634 wait complete. 2023-08-09T12:48:21.612 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:48:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.847+0000 7f13229cb640 1 Processor -- start 2023-08-09T12:48:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.847+0000 7f13229cb640 1 -- start start 2023-08-09T12:48:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.848+0000 7f13229cb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f131c0b8420 0x7f131c0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.848+0000 7f13229cb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131c0d0f00 con 0x7f131c15cb40 2023-08-09T12:48:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.848+0000 7f13229cb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131c1611f0 con 0x7f131c15cf20 2023-08-09T12:48:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.848+0000 7f13229cb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131c1614d0 con 0x7f131c0b8420 2023-08-09T12:48:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.849+0000 7f13211c8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f131c0b8420 0x7f131c0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.849+0000 7f13211c8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f131c0b8420 0x7f131c0cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38544/0 (socket says 172.21.15.17:38544) 2023-08-09T12:48:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.849+0000 7f13211c8640 1 -- 172.21.15.17:0/1854429600 learned_addr learned my addr 172.21.15.17:0/1854429600 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.849+0000 7f13211c8640 1 -- 172.21.15.17:0/1854429600 >> v1:172.21.15.142:6789/0 conn(0x7f131c15cf20 legacy=0x7f131c0d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.849+0000 7f13211c8640 1 -- 172.21.15.17:0/1854429600 >> v1:172.21.15.17:6789/0 conn(0x7f131c15cb40 legacy=0x7f131c1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.849+0000 7f13211c8640 1 -- 172.21.15.17:0/1854429600 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c1617b0 con 0x7f131c0b8420 2023-08-09T12:48:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.850+0000 7f13211c8640 1 --2- 172.21.15.17:0/1854429600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cd860 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91556245b3fa5935 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.851+0000 7f13209c7640 1 -- 172.21.15.17:0/1854429600 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c02f840 con 0x7f131c0b8420 2023-08-09T12:48:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.851+0000 7f13209c7640 1 -- 172.21.15.17:0/1854429600 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c02f9a0 con 0x7f131c0b8420 2023-08-09T12:48:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.851+0000 7f13209c7640 1 -- 172.21.15.17:0/1854429600 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c02fd30 con 0x7f131c0b8420 2023-08-09T12:48:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.851+0000 7f13229cb640 1 -- 172.21.15.17:0/1854429600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 msgr2=0x7f131c0cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.851+0000 7f13229cb640 1 --2- 172.21.15.17:0/1854429600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cd860 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c02ba20 comp rx=0 tx=0).stop 2023-08-09T12:48:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.852+0000 7f13229cb640 1 -- 172.21.15.17:0/1854429600 shutdown_connections 2023-08-09T12:48:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.852+0000 7f13229cb640 1 --2- 172.21.15.17:0/1854429600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cd860 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.852+0000 7f13229cb640 1 -- 172.21.15.17:0/1854429600 >> 172.21.15.17:0/1854429600 conn(0x7f131c0d2ab0 msgr2=0x7f131c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.852+0000 7f13229cb640 1 -- 172.21.15.17:0/1854429600 shutdown_connections 2023-08-09T12:48:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.852+0000 7f13229cb640 1 -- 172.21.15.17:0/1854429600 wait complete. 2023-08-09T12:48:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.853+0000 7f13229cb640 1 Processor -- start 2023-08-09T12:48:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.854+0000 7f13229cb640 1 -- start start 2023-08-09T12:48:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.854+0000 7f13229cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.854+0000 7f13229cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f131c15cb40 0x7f131c144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.854+0000 7f13229cb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f131c15cf20 0x7f131c144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.854+0000 7f13229cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c1f2330 con 0x7f131c0b8420 2023-08-09T12:48:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.854+0000 7f13229cb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0cbb20 con 0x7f131c15cf20 2023-08-09T12:48:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.854+0000 7f13229cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0cac70 con 0x7f131c15cb40 2023-08-09T12:48:21.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13219c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13219c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38550/0 (socket says 172.21.15.17:38550) 2023-08-09T12:48:21.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13219c9640 1 -- 172.21.15.17:0/3903120429 learned_addr learned my addr 172.21.15.17:0/3903120429 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:21.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13211c8640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f131c15cb40 0x7f131c144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13221ca640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f131c15cf20 0x7f131c144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13219c9640 1 -- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f131c15cb40 msgr2=0x7f131c144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13219c9640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f131c15cb40 0x7f131c144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13219c9640 1 -- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f131c15cf20 msgr2=0x7f131c144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13219c9640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f131c15cf20 0x7f131c144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13219c9640 1 -- 172.21.15.17:0/3903120429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0094d0 con 0x7f131c0b8420 2023-08-09T12:48:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13221ca640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f131c15cf20 0x7f131c144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.855+0000 7f13211c8640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f131c15cb40 0x7f131c144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.856+0000 7f13219c9640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cbfb0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f131800c870 tx=0x7f131800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.856+0000 7f13127fc640 1 -- 172.21.15.17:0/3903120429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318003b70 con 0x7f131c0b8420 2023-08-09T12:48:21.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.856+0000 7f13127fc640 1 -- 172.21.15.17:0/3903120429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318003cf0 con 0x7f131c0b8420 2023-08-09T12:48:21.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.856+0000 7f13127fc640 1 -- 172.21.15.17:0/3903120429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131800aa90 con 0x7f131c0b8420 2023-08-09T12:48:21.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.856+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131c0caf10 con 0x7f131c0b8420 2023-08-09T12:48:21.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.856+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c0cb4d0 con 0x7f131c0b8420 2023-08-09T12:48:21.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.857+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131c04e390 con 0x7f131c0b8420 2023-08-09T12:48:21.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.858+0000 7f13127fc640 1 -- 172.21.15.17:0/3903120429 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f131800abf0 con 0x7f131c0b8420 2023-08-09T12:48:21.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.859+0000 7f13127fc640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f130006a050 0x7f130006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:21.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.859+0000 7f13127fc640 1 -- 172.21.15.17:0/3903120429 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1318088510 con 0x7f131c0b8420 2023-08-09T12:48:21.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.860+0000 7f13211c8640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f130006a050 0x7f130006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:21.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.861+0000 7f13211c8640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f130006a050 0x7f130006c510 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f130c036000 tx=0x7f130c039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:21.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:21.863+0000 7f13127fc640 1 -- 172.21.15.17:0/3903120429 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1318053b60 con 0x7f131c0b8420 2023-08-09T12:48:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.058+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f131c0b44d0 con 0x7f131c0b8420 2023-08-09T12:48:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.059+0000 7f13127fc640 1 -- 172.21.15.17:0/3903120429 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1318003e60 con 0x7f131c0b8420 2023-08-09T12:48:22.063 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:48:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f130006a050 msgr2=0x7f130006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f130006a050 0x7f130006c510 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f130c036000 tx=0x7f130c039040 comp rx=0 tx=0).stop 2023-08-09T12:48:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 msgr2=0x7f131c0cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cbfb0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f131800c870 tx=0x7f131800cd30 comp rx=0 tx=0).stop 2023-08-09T12:48:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 shutdown_connections 2023-08-09T12:48:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f130006a050 0x7f130006c510 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f131c15cf20 0x7f131c144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f131c15cb40 0x7f131c144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 --2- 172.21.15.17:0/3903120429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f131c0b8420 0x7f131c0cbfb0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.062+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 >> 172.21.15.17:0/3903120429 conn(0x7f131c0d2ab0 msgr2=0x7f131c0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.063+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 shutdown_connections 2023-08-09T12:48:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.063+0000 7f13229cb640 1 -- 172.21.15.17:0/3903120429 wait complete. 2023-08-09T12:48:22.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:48:22.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.313+0000 7f80bc48e640 1 Processor -- start 2023-08-09T12:48:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.314+0000 7f80bc48e640 1 -- start start 2023-08-09T12:48:22.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.315+0000 7f80bc48e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80b40b3b40 0x7f80b40b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:22.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.315+0000 7f80bc48e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b406c990 con 0x7f80b40adc40 2023-08-09T12:48:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.315+0000 7f80bc48e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b40b2250 con 0x7f80b40cc630 2023-08-09T12:48:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.315+0000 7f80bc48e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b40ae020 con 0x7f80b40b3b40 2023-08-09T12:48:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.316+0000 7f80b9a29640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80b40b3b40 0x7f80b40b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.316+0000 7f80b9a29640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80b40b3b40 0x7f80b40b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38562/0 (socket says 172.21.15.17:38562) 2023-08-09T12:48:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.316+0000 7f80b9a29640 1 -- 172.21.15.17:0/1991090583 learned_addr learned my addr 172.21.15.17:0/1991090583 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.316+0000 7f80ba22a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f80b40adc40 0x7f80b406c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50850/0 (socket says 172.21.15.17:50850) 2023-08-09T12:48:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.316+0000 7f80b9a29640 1 -- 172.21.15.17:0/1991090583 >> v1:172.21.15.142:6789/0 conn(0x7f80b40cc630 legacy=0x7f80b40ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.316+0000 7f80b9a29640 1 -- 172.21.15.17:0/1991090583 >> v1:172.21.15.17:6789/0 conn(0x7f80b40adc40 legacy=0x7f80b406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.316+0000 7f80b9a29640 1 -- 172.21.15.17:0/1991090583 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40b2530 con 0x7f80b40b3b40 2023-08-09T12:48:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.316+0000 7f80b9228640 1 -- 172.21.15.17:0/1991090583 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645321369 0 0) 0x7f80b406c990 con 0x7f80b40adc40 2023-08-09T12:48:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.318+0000 7f80b9a29640 1 --2- 172.21.15.17:0/1991090583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40b3b40 0x7f80b40b3fd0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009860 tx=0x7f80a402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a038757d34783c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.318+0000 7f80b9228640 1 -- 172.21.15.17:0/1991090583 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4030840 con 0x7f80b40b3b40 2023-08-09T12:48:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.318+0000 7f80b9228640 1 -- 172.21.15.17:0/1991090583 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a40309a0 con 0x7f80b40b3b40 2023-08-09T12:48:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.318+0000 7f80b9228640 1 -- 172.21.15.17:0/1991090583 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4030d30 con 0x7f80b40b3b40 2023-08-09T12:48:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.318+0000 7f80bc48e640 1 -- 172.21.15.17:0/1991090583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40b3b40 msgr2=0x7f80b40b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.318+0000 7f80bc48e640 1 --2- 172.21.15.17:0/1991090583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40b3b40 0x7f80b40b3fd0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009860 tx=0x7f80a402b980 comp rx=0 tx=0).stop 2023-08-09T12:48:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.319+0000 7f80bc48e640 1 -- 172.21.15.17:0/1991090583 shutdown_connections 2023-08-09T12:48:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.319+0000 7f80bc48e640 1 --2- 172.21.15.17:0/1991090583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40b3b40 0x7f80b40b3fd0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.319+0000 7f80bc48e640 1 -- 172.21.15.17:0/1991090583 >> 172.21.15.17:0/1991090583 conn(0x7f80b40cb1b0 msgr2=0x7f80b40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.319+0000 7f80bc48e640 1 -- 172.21.15.17:0/1991090583 shutdown_connections 2023-08-09T12:48:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.319+0000 7f80bc48e640 1 -- 172.21.15.17:0/1991090583 wait complete. 2023-08-09T12:48:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.320+0000 7f80bc48e640 1 Processor -- start 2023-08-09T12:48:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.321+0000 7f80bc48e640 1 -- start start 2023-08-09T12:48:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80bc48e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40adc40 0x7f80b414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80bc48e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40b3b40 0x7f80b406a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80bc48e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40cc630 0x7f80b4158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80bc48e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c3220 con 0x7f80b40cc630 2023-08-09T12:48:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80bc48e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4157fc0 con 0x7f80b40adc40 2023-08-09T12:48:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80bc48e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b41582a0 con 0x7f80b40b3b40 2023-08-09T12:48:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80baa2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40cc630 0x7f80b4158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80baa2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40cc630 0x7f80b4158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38572/0 (socket says 172.21.15.17:38572) 2023-08-09T12:48:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80baa2b640 1 -- 172.21.15.17:0/2095945982 learned_addr learned my addr 172.21.15.17:0/2095945982 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80ba22a640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40adc40 0x7f80b414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.322+0000 7f80b9a29640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40b3b40 0x7f80b406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80baa2b640 1 -- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40b3b40 msgr2=0x7f80b406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80baa2b640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40b3b40 0x7f80b406a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80baa2b640 1 -- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40adc40 msgr2=0x7f80b414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80baa2b640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40adc40 0x7f80b414eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80baa2b640 1 -- 172.21.15.17:0/2095945982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4009470 con 0x7f80b40cc630 2023-08-09T12:48:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80baa2b640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40cc630 0x7f80b4158b80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00b970 tx=0x7f80ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80aaffd640 1 -- 172.21.15.17:0/2095945982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00cb40 con 0x7f80b40cc630 2023-08-09T12:48:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80aaffd640 1 -- 172.21.15.17:0/2095945982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00cca0 con 0x7f80b40cc630 2023-08-09T12:48:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80aaffd640 1 -- 172.21.15.17:0/2095945982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac014680 con 0x7f80b40cc630 2023-08-09T12:48:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.323+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b40c34e0 con 0x7f80b40cc630 2023-08-09T12:48:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.324+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b41f20c0 con 0x7f80b40cc630 2023-08-09T12:48:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.325+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b40c3a00 con 0x7f80b40cc630 2023-08-09T12:48:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.326+0000 7f80aaffd640 1 -- 172.21.15.17:0/2095945982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80ac01d3b0 con 0x7f80b40cc630 2023-08-09T12:48:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.326+0000 7f80aaffd640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f809806a050 0x7f809806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.327+0000 7f80aaffd640 1 -- 172.21.15.17:0/2095945982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80ac0884a0 con 0x7f80b40cc630 2023-08-09T12:48:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.327+0000 7f80ba22a640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f809806a050 0x7f809806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:22.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.329+0000 7f80ba22a640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f809806a050 0x7f809806c510 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f80b0000f60 tx=0x7f80b0007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.331+0000 7f80aaffd640 1 -- 172.21.15.17:0/2095945982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f80b40c3a00 con 0x7f80b40cc630 2023-08-09T12:48:22.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.540+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80b40c3a00 con 0x7f80b40cc630 2023-08-09T12:48:22.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.540+0000 7f80aaffd640 1 -- 172.21.15.17:0/2095945982 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v149) v1 ==== 80+0+0 (secure 0 0 0) 0x7f80b40c3a00 con 0x7f80b40cc630 2023-08-09T12:48:22.543 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:48:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f809806a050 msgr2=0x7f809806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f809806a050 0x7f809806c510 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f80b0000f60 tx=0x7f80b0007b50 comp rx=0 tx=0).stop 2023-08-09T12:48:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40cc630 msgr2=0x7f80b4158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40cc630 0x7f80b4158b80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00b970 tx=0x7f80ac00be30 comp rx=0 tx=0).stop 2023-08-09T12:48:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 shutdown_connections 2023-08-09T12:48:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f809806a050 0x7f809806c510 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80b40cc630 0x7f80b4158b80 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40b3b40 0x7f80b406a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 --2- 172.21.15.17:0/2095945982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40adc40 0x7f80b414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 >> 172.21.15.17:0/2095945982 conn(0x7f80b40cb1b0 msgr2=0x7f80b40ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 shutdown_connections 2023-08-09T12:48:22.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:22.543+0000 7f80bc48e640 1 -- 172.21.15.17:0/2095945982 wait complete. 2023-08-09T12:48:22.566 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:48:22.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:22.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:48:22.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:48:22.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:22.757 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:48:22.798 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:48:22.798 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:22.852 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:48:22.853 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:22.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:23.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.131+0000 7fa0ff497640 1 Processor -- start 2023-08-09T12:48:23.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.131+0000 7fa0ff497640 1 -- start start 2023-08-09T12:48:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.132+0000 7fa0ff497640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa0f81587e0 0x7fa0f8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.132+0000 7fa0ff497640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80cb070 0x7fa0f80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.132+0000 7fa0ff497640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f815beb0 con 0x7fa0f80b0b10 2023-08-09T12:48:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.132+0000 7fa0ff497640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80cba20 con 0x7fa0f81587e0 2023-08-09T12:48:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.132+0000 7fa0ff497640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80715c0 con 0x7fa0f80cb070 2023-08-09T12:48:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.133+0000 7fa0fe495640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa0f81587e0 0x7fa0f8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.133+0000 7fa0fe495640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa0f81587e0 0x7fa0f8070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38584/0 (socket says 172.21.15.17:38584) 2023-08-09T12:48:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.133+0000 7fa0fe495640 1 -- 172.21.15.17:0/2089064000 learned_addr learned my addr 172.21.15.17:0/2089064000 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.133+0000 7fa0fec96640 1 --2- 172.21.15.17:0/2089064000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80cb070 0x7fa0f80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.133+0000 7fa0fe495640 1 -- 172.21.15.17:0/2089064000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80cb070 msgr2=0x7fa0f80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.133+0000 7fa0fe495640 1 --2- 172.21.15.17:0/2089064000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80cb070 0x7fa0f80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.133+0000 7fa0fe495640 1 -- 172.21.15.17:0/2089064000 >> v1:172.21.15.17:6789/0 conn(0x7fa0f80b0b10 legacy=0x7fa0f815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.133+0000 7fa0fe495640 1 -- 172.21.15.17:0/2089064000 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80718a0 con 0x7fa0f81587e0 2023-08-09T12:48:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.135+0000 7fa0fe495640 1 --2- 172.21.15.17:0/2089064000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f8070f00 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009870 tx=0x7fa0f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8deb3550627b41a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.135+0000 7fa0fd493640 1 -- 172.21.15.17:0/2089064000 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4030840 con 0x7fa0f81587e0 2023-08-09T12:48:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.135+0000 7fa0fd493640 1 -- 172.21.15.17:0/2089064000 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f40309a0 con 0x7fa0f81587e0 2023-08-09T12:48:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.135+0000 7fa0fd493640 1 -- 172.21.15.17:0/2089064000 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4030d30 con 0x7fa0f81587e0 2023-08-09T12:48:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.136+0000 7fa0ff497640 1 -- 172.21.15.17:0/2089064000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 msgr2=0x7fa0f8070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.136+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2089064000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f8070f00 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009870 tx=0x7fa0f402b980 comp rx=0 tx=0).stop 2023-08-09T12:48:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.136+0000 7fa0ff497640 1 -- 172.21.15.17:0/2089064000 shutdown_connections 2023-08-09T12:48:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.136+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2089064000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80cb070 0x7fa0f80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.136+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2089064000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f8070f00 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.136+0000 7fa0ff497640 1 -- 172.21.15.17:0/2089064000 >> 172.21.15.17:0/2089064000 conn(0x7fa0f80b1d50 msgr2=0x7fa0f806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.136+0000 7fa0ff497640 1 -- 172.21.15.17:0/2089064000 shutdown_connections 2023-08-09T12:48:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.136+0000 7fa0ff497640 1 -- 172.21.15.17:0/2089064000 wait complete. 2023-08-09T12:48:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.138+0000 7fa0ff497640 1 Processor -- start 2023-08-09T12:48:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.138+0000 7fa0ff497640 1 -- start start 2023-08-09T12:48:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0ff497640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80b0b10 0x7fa0f80c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0ff497640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80cb070 0x7fa0f814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0ff497640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f814bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0ff497640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c7e10 con 0x7fa0f81587e0 2023-08-09T12:48:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0ff497640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f814d870 con 0x7fa0f80cb070 2023-08-09T12:48:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0ff497640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c7190 con 0x7fa0f80b0b10 2023-08-09T12:48:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0fec96640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f814bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0fec96640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f814bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38600/0 (socket says 172.21.15.17:38600) 2023-08-09T12:48:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0fec96640 1 -- 172.21.15.17:0/2118203564 learned_addr learned my addr 172.21.15.17:0/2118203564 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0fe495640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80b0b10 0x7fa0f80c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0fdc94640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80cb070 0x7fa0f814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.139+0000 7fa0fec96640 1 -- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80b0b10 msgr2=0x7fa0f80c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0fec96640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80b0b10 0x7fa0f80c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0fec96640 1 -- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80cb070 msgr2=0x7fa0f814d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0fec96640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80cb070 0x7fa0f814d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0fec96640 1 -- 172.21.15.17:0/2118203564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40094d0 con 0x7fa0f81587e0 2023-08-09T12:48:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0fec96640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f814bc60 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0007e40 tx=0x7fa0f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0eeffd640 1 -- 172.21.15.17:0/2118203564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0014620 con 0x7fa0f81587e0 2023-08-09T12:48:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0eeffd640 1 -- 172.21.15.17:0/2118203564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000ee90 con 0x7fa0f81587e0 2023-08-09T12:48:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0eeffd640 1 -- 172.21.15.17:0/2118203564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00149e0 con 0x7fa0f81587e0 2023-08-09T12:48:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f80c7470 con 0x7fa0f81587e0 2023-08-09T12:48:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.140+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80c7a30 con 0x7fa0f81587e0 2023-08-09T12:48:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.142+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f804e390 con 0x7fa0f81587e0 2023-08-09T12:48:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.142+0000 7fa0eeffd640 1 -- 172.21.15.17:0/2118203564 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0f0014b40 con 0x7fa0f81587e0 2023-08-09T12:48:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.143+0000 7fa0eeffd640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa0dc06a050 0x7fa0dc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.143+0000 7fa0eeffd640 1 -- 172.21.15.17:0/2118203564 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0f0088f70 con 0x7fa0f81587e0 2023-08-09T12:48:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.144+0000 7fa0fe495640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa0dc06a050 0x7fa0dc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.145+0000 7fa0fe495640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa0dc06a050 0x7fa0dc06c510 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4036000 tx=0x7fa0f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:23.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.148+0000 7fa0eeffd640 1 -- 172.21.15.17:0/2118203564 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa0f0054650 con 0x7fa0f81587e0 2023-08-09T12:48:23.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.347+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f806b8d0 con 0x7fa0f81587e0 2023-08-09T12:48:23.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.349+0000 7fa0eeffd640 1 -- 172.21.15.17:0/2118203564 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fa0f0057c70 con 0x7fa0f81587e0 2023-08-09T12:48:23.353 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:23.353 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":149,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:13.844363+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:47:36.431201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-09T12:47:37.108075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa0dc06a050 msgr2=0x7fa0dc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa0dc06a050 0x7fa0dc06c510 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4036000 tx=0x7fa0f4008030 comp rx=0 tx=0).stop 2023-08-09T12:48:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 msgr2=0x7fa0f814bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f814bc60 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0007e40 tx=0x7fa0f000e4b0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 shutdown_connections 2023-08-09T12:48:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa0dc06a050 0x7fa0dc06c510 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f81587e0 0x7fa0f814bc60 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80cb070 0x7fa0f814d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 --2- 172.21.15.17:0/2118203564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f80b0b10 0x7fa0f80c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.352+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 >> 172.21.15.17:0/2118203564 conn(0x7fa0f80b1d50 msgr2=0x7fa0f80cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:23.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.353+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 shutdown_connections 2023-08-09T12:48:23.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.353+0000 7fa0ff497640 1 -- 172.21.15.17:0/2118203564 wait complete. 2023-08-09T12:48:23.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:47:36.431201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:47:37.108075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:48:23.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:48:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.607+0000 7f9090929640 1 Processor -- start 2023-08-09T12:48:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.607+0000 7f9090929640 1 -- start start 2023-08-09T12:48:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.608+0000 7f9090929640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 0x7f908c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.609+0000 7f9090929640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f908c0b0020 0x7f908c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.609+0000 7f9090929640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908c15e7b0 con 0x7f908c0b13f0 2023-08-09T12:48:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.609+0000 7f9090929640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908c0b09f0 con 0x7f908c0b0020 2023-08-09T12:48:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.609+0000 7f9090929640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0b1850 con 0x7f908c15a8c0 2023-08-09T12:48:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.609+0000 7f908affd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f908c0b13f0 0x7f908c15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50872/0 (socket says 172.21.15.17:50872) 2023-08-09T12:48:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.609+0000 7f908affd640 1 -- 172.21.15.17:0/558717028 learned_addr learned my addr 172.21.15.17:0/558717028 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.609+0000 7f908bfff640 1 --2- 172.21.15.17:0/558717028 >> v2:172.21.15.142:3300/0 conn(0x7f908c0b0020 0x7f908c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.609+0000 7f908b7fe640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 0x7f908c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126486622 0 0) 0x7f908c15e7b0 con 0x7f908c0b13f0 2023-08-09T12:48:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9074003520 con 0x7f908c0b13f0 2023-08-09T12:48:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733860748 0 0) 0x7f9074003520 con 0x7f908c0b13f0 2023-08-09T12:48:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 msgr2=0x7f908c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 0x7f908c0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 >> v2:172.21.15.142:3300/0 conn(0x7f908c0b0020 msgr2=0x7f908c0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 --2- 172.21.15.17:0/558717028 >> v2:172.21.15.142:3300/0 conn(0x7f908c0b0020 0x7f908c0b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c15e460 con 0x7f908c0b13f0 2023-08-09T12:48:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f9080001670 con 0x7f908c0b13f0 2023-08-09T12:48:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 >> v1:172.21.15.17:6789/0 conn(0x7f908c0b13f0 legacy=0x7f908c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9074003970 0x7f9074003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 0x7f90740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f9074005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0b09f0 con 0x7f9074004d00 2023-08-09T12:48:23.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0b1850 con 0x7f9074003970 2023-08-09T12:48:23.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.610+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907400b980 con 0x7f908c15a8c0 2023-08-09T12:48:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908bfff640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f9074005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908b7fe640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9074003970 0x7f9074003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908affd640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 0x7f90740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908bfff640 1 -- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 msgr2=0x7f90740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908bfff640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 0x7f90740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908bfff640 1 -- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9074003970 msgr2=0x7f9074003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908bfff640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9074003970 0x7f9074003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908bfff640 1 -- 172.21.15.17:0/558717028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074003520 con 0x7f9074004d00 2023-08-09T12:48:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908affd640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15a8c0 0x7f90740047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.611+0000 7f908b7fe640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9074003970 0x7f9074003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.612+0000 7f908bfff640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f9074005180 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f9084009fc0 tx=0x7f90740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95df9834bd87420 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908402cc40 con 0x7f9074004d00 2023-08-09T12:48:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908400f040 con 0x7f9074004d00 2023-08-09T12:48:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f908a7fc640 1 -- 172.21.15.17:0/558717028 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084034440 con 0x7f9074004d00 2023-08-09T12:48:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f9090929640 1 -- 172.21.15.17:0/558717028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 msgr2=0x7f9074005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f9090929640 1 --2- 172.21.15.17:0/558717028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f9074005180 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f9084009fc0 tx=0x7f90740057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f908bfff640 1 -- 172.21.15.17:0/558717028 reap_dead start 2023-08-09T12:48:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f9090929640 1 -- 172.21.15.17:0/558717028 shutdown_connections 2023-08-09T12:48:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f9090929640 1 -- 172.21.15.17:0/558717028 >> 172.21.15.17:0/558717028 conn(0x7f908c0cb020 msgr2=0x7f908c0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f9090929640 1 -- 172.21.15.17:0/558717028 shutdown_connections 2023-08-09T12:48:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.613+0000 7f9090929640 1 -- 172.21.15.17:0/558717028 wait complete. 2023-08-09T12:48:23.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.616+0000 7f9090929640 1 Processor -- start 2023-08-09T12:48:23.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.616+0000 7f9090929640 1 -- start start 2023-08-09T12:48:23.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f9090929640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f908c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f9090929640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c154680 0x7f908c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f9090929640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f908c15ce70 0x7f908c15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f9090929640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c15c550 con 0x7f9074004d00 2023-08-09T12:48:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f9090929640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c15d830 con 0x7f908c15ce70 2023-08-09T12:48:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f9090929640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c151690 con 0x7f908c154680 2023-08-09T12:48:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f908b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f908c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f908b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f908c151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38616/0 (socket says 172.21.15.17:38616) 2023-08-09T12:48:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f908b7fe640 1 -- 172.21.15.17:0/3010209831 learned_addr learned my addr 172.21.15.17:0/3010209831 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.617+0000 7f908b7fe640 1 -- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c154680 msgr2=0x7f908c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f908b7fe640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c154680 0x7f908c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f908b7fe640 1 -- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f908c15ce70 msgr2=0x7f908c15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f908b7fe640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f908c15ce70 0x7f908c15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f908b7fe640 1 -- 172.21.15.17:0/3010209831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c15b8d0 con 0x7f9074004d00 2023-08-09T12:48:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f908b7fe640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f908c151150 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f907c0108b0 tx=0x7f907c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f9073fff640 1 -- 172.21.15.17:0/3010209831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00ea80 con 0x7f9074004d00 2023-08-09T12:48:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f9073fff640 1 -- 172.21.15.17:0/3010209831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c00ebe0 con 0x7f9074004d00 2023-08-09T12:48:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f9073fff640 1 -- 172.21.15.17:0/3010209831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c01c400 con 0x7f9074004d00 2023-08-09T12:48:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908c15bbb0 con 0x7f9074004d00 2023-08-09T12:48:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.618+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c15c170 con 0x7f9074004d00 2023-08-09T12:48:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.620+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c04e390 con 0x7f9074004d00 2023-08-09T12:48:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.621+0000 7f9073fff640 1 -- 172.21.15.17:0/3010209831 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f907c01c560 con 0x7f9074004d00 2023-08-09T12:48:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.621+0000 7f9073fff640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f907806a050 0x7f907806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.622+0000 7f9073fff640 1 -- 172.21.15.17:0/3010209831 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f907c088af0 con 0x7f9074004d00 2023-08-09T12:48:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.622+0000 7f908affd640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f907806a050 0x7f907806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.623+0000 7f908affd640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f907806a050 0x7f907806c510 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9080000ff0 tx=0x7f9080009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.626+0000 7f9073fff640 1 -- 172.21.15.17:0/3010209831 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f907c057d10 con 0x7f9074004d00 2023-08-09T12:48:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.819+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f908c0cbd50 con 0x7f9074004d00 2023-08-09T12:48:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.820+0000 7f9073fff640 1 -- 172.21.15.17:0/3010209831 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7f907c0578a0 con 0x7f9074004d00 2023-08-09T12:48:23.824 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:48:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f907806a050 msgr2=0x7f907806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f907806a050 0x7f907806c510 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9080000ff0 tx=0x7f9080009040 comp rx=0 tx=0).stop 2023-08-09T12:48:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 msgr2=0x7f908c151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f908c151150 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f907c0108b0 tx=0x7f907c010d70 comp rx=0 tx=0).stop 2023-08-09T12:48:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 shutdown_connections 2023-08-09T12:48:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f907806a050 0x7f907806c510 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f908c15ce70 0x7f908c15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c154680 0x7f908c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 --2- 172.21.15.17:0/3010209831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9074004d00 0x7f908c151150 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 >> 172.21.15.17:0/3010209831 conn(0x7f908c0cb020 msgr2=0x7f908c151970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:23.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 shutdown_connections 2023-08-09T12:48:23.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:23.823+0000 7f9090929640 1 -- 172.21.15.17:0/3010209831 wait complete. 2023-08-09T12:48:23.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:48:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.067+0000 7f5bc0e77640 1 Processor -- start 2023-08-09T12:48:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.067+0000 7f5bc0e77640 1 -- start start 2023-08-09T12:48:24.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.069+0000 7f5bc0e77640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc161660 0x7f5bbc0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.069+0000 7f5bc0e77640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc15df30 con 0x7f5bbc161280 2023-08-09T12:48:24.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.069+0000 7f5bc0e77640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc0ca9d0 con 0x7f5bbc0acdf0 2023-08-09T12:48:24.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.069+0000 7f5bc0e77640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0ad2a0 con 0x7f5bbc161660 2023-08-09T12:48:24.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.069+0000 7f5bba59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5bbc161280 0x7f5bbc0c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50876/0 (socket says 172.21.15.17:50876) 2023-08-09T12:48:24.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.069+0000 7f5bba59c640 1 -- 172.21.15.17:0/3594734221 learned_addr learned my addr 172.21.15.17:0/3594734221 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:24.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb3fff640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc161660 0x7f5bbc0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303278072 0 0) 0x7f5bbc15df30 con 0x7f5bbc161280 2023-08-09T12:48:24.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ba8003520 con 0x7f5bbc161280 2023-08-09T12:48:24.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 246429338 0 0) 0x7f5ba8003520 con 0x7f5bbc161280 2023-08-09T12:48:24.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc161660 msgr2=0x7f5bbc0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc161660 0x7f5bbc0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 >> v1:172.21.15.142:6789/0 conn(0x7f5bbc0acdf0 legacy=0x7f5bbc0cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc15e3c0 con 0x7f5bbc161280 2023-08-09T12:48:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f5bac001670 con 0x7f5bbc161280 2023-08-09T12:48:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 >> v1:172.21.15.17:6789/0 conn(0x7f5bbc161280 legacy=0x7f5bbc0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5ba8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ba80047c0 0x7f5ba8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc161660 0x7f5ba80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0ad2a0 con 0x7f5ba80039a0 2023-08-09T12:48:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba800bae0 con 0x7f5ba80047c0 2023-08-09T12:48:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.070+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba800bca0 con 0x7f5bbc161660 2023-08-09T12:48:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.071+0000 7f5bba59c640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5ba8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.071+0000 7f5bbad9d640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc161660 0x7f5ba80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.071+0000 7f5bb3fff640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ba80047c0 0x7f5ba8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.071+0000 7f5bba59c640 1 -- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc161660 msgr2=0x7f5ba80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.071+0000 7f5bba59c640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc161660 0x7f5ba80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.071+0000 7f5bba59c640 1 -- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ba80047c0 msgr2=0x7f5ba8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.071+0000 7f5bba59c640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ba80047c0 0x7f5ba8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.071+0000 7f5bba59c640 1 -- 172.21.15.17:0/3594734221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8003520 con 0x7f5ba80039a0 2023-08-09T12:48:24.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.072+0000 7f5bba59c640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5ba8003dc0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c240 tx=0x7f5ba80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81f89f69cba72ee server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac005ad0 con 0x7f5ba80039a0 2023-08-09T12:48:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac005c30 con 0x7f5ba80039a0 2023-08-09T12:48:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bb9d9b640 1 -- 172.21.15.17:0/3594734221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac02c8b0 con 0x7f5ba80039a0 2023-08-09T12:48:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bc0e77640 1 -- 172.21.15.17:0/3594734221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 msgr2=0x7f5ba8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bc0e77640 1 --2- 172.21.15.17:0/3594734221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5ba8003dc0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c240 tx=0x7f5ba80057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bbad9d640 1 -- 172.21.15.17:0/3594734221 reap_dead start 2023-08-09T12:48:24.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bc0e77640 1 -- 172.21.15.17:0/3594734221 shutdown_connections 2023-08-09T12:48:24.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bc0e77640 1 -- 172.21.15.17:0/3594734221 >> 172.21.15.17:0/3594734221 conn(0x7f5bbc0cb1b0 msgr2=0x7f5bbc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:24.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bc0e77640 1 -- 172.21.15.17:0/3594734221 shutdown_connections 2023-08-09T12:48:24.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.073+0000 7f5bc0e77640 1 -- 172.21.15.17:0/3594734221 wait complete. 2023-08-09T12:48:24.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.075+0000 7f5bc0e77640 1 Processor -- start 2023-08-09T12:48:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.076+0000 7f5bc0e77640 1 -- start start 2023-08-09T12:48:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.076+0000 7f5bc0e77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5bbc150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bc0e77640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bbc0c49e0 0x7f5bbc15f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bc0e77640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc0c4e60 0x7f5bbc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bc0e77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0c4550 con 0x7f5ba80039a0 2023-08-09T12:48:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bc0e77640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0c3940 con 0x7f5bbc0c49e0 2023-08-09T12:48:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bc0e77640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0c3c20 con 0x7f5bbc0c4e60 2023-08-09T12:48:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bba59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5bbc150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bba59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5bbc150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38640/0 (socket says 172.21.15.17:38640) 2023-08-09T12:48:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bba59c640 1 -- 172.21.15.17:0/2093752591 learned_addr learned my addr 172.21.15.17:0/2093752591 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bb3fff640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bbc0c49e0 0x7f5bbc15f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bbad9d640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc0c4e60 0x7f5bbc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bba59c640 1 -- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc0c4e60 msgr2=0x7f5bbc15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bba59c640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc0c4e60 0x7f5bbc15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bba59c640 1 -- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bbc0c49e0 msgr2=0x7f5bbc15f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bba59c640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bbc0c49e0 0x7f5bbc15f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.077+0000 7f5bba59c640 1 -- 172.21.15.17:0/2093752591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0c3f00 con 0x7f5ba80039a0 2023-08-09T12:48:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.078+0000 7f5bba59c640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5bbc150fa0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f5bac02c450 tx=0x7f5bac001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.078+0000 7f5bb2ffd640 1 -- 172.21.15.17:0/2093752591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac039070 con 0x7f5ba80039a0 2023-08-09T12:48:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.078+0000 7f5bb2ffd640 1 -- 172.21.15.17:0/2093752591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac02dd50 con 0x7f5ba80039a0 2023-08-09T12:48:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.078+0000 7f5bb2ffd640 1 -- 172.21.15.17:0/2093752591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac03c040 con 0x7f5ba80039a0 2023-08-09T12:48:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.078+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc0c41e0 con 0x7f5ba80039a0 2023-08-09T12:48:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.078+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc1f25d0 con 0x7f5ba80039a0 2023-08-09T12:48:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.080+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc0c3d60 con 0x7f5ba80039a0 2023-08-09T12:48:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.080+0000 7f5bb2ffd640 1 -- 172.21.15.17:0/2093752591 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5bac032070 con 0x7f5ba80039a0 2023-08-09T12:48:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.081+0000 7f5bb2ffd640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b9c06a050 0x7f5b9c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.081+0000 7f5bb2ffd640 1 -- 172.21.15.17:0/2093752591 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5bac0a9730 con 0x7f5ba80039a0 2023-08-09T12:48:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.082+0000 7f5bb2ffd640 1 -- 172.21.15.17:0/2093752591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f5b9c0721a0 con 0x7f5ba80039a0 2023-08-09T12:48:24.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.082+0000 7f5bb3fff640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b9c06a050 0x7f5b9c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.083+0000 7f5bb3fff640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b9c06a050 0x7f5b9c06c510 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0b0580 tx=0x7f5ba4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:24.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.086+0000 7f5bb2ffd640 1 -- 172.21.15.17:0/2093752591 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5bac046060 con 0x7f5ba80039a0 2023-08-09T12:48:24.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.280+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5bbc067a80 con 0x7f5ba80039a0 2023-08-09T12:48:24.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.281+0000 7f5bb2ffd640 1 -- 172.21.15.17:0/2093752591 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v150) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5bbc0c3d60 con 0x7f5ba80039a0 2023-08-09T12:48:24.285 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:48:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b9c06a050 msgr2=0x7f5b9c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b9c06a050 0x7f5b9c06c510 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0b0580 tx=0x7f5ba4008040 comp rx=0 tx=0).stop 2023-08-09T12:48:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 msgr2=0x7f5bbc150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5bbc150fa0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f5bac02c450 tx=0x7f5bac001a00 comp rx=0 tx=0).stop 2023-08-09T12:48:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 shutdown_connections 2023-08-09T12:48:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5b9c06a050 0x7f5b9c06c510 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bbc0c4e60 0x7f5bbc15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bbc0c49e0 0x7f5bbc15f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 --2- 172.21.15.17:0/2093752591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba80039a0 0x7f5bbc150fa0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 >> 172.21.15.17:0/2093752591 conn(0x7f5bbc0cb1b0 msgr2=0x7f5bbc15e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 shutdown_connections 2023-08-09T12:48:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.284+0000 7f5bc0e77640 1 -- 172.21.15.17:0/2093752591 wait complete. 2023-08-09T12:48:24.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:48:24.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.528+0000 7f9d4b59e640 1 Processor -- start 2023-08-09T12:48:24.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.528+0000 7f9d4b59e640 1 -- start start 2023-08-09T12:48:24.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.530+0000 7f9d4b59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d4c0caff0 0x7f9d4c0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.530+0000 7f9d4b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c0ccc70 0x7f9d4c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.530+0000 7f9d4b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c0ad700 con 0x7f9d4c165470 2023-08-09T12:48:24.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.530+0000 7f9d4b59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c0adf10 con 0x7f9d4c0caff0 2023-08-09T12:48:24.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.530+0000 7f9d4b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0c9a20 con 0x7f9d4c0ccc70 2023-08-09T12:48:24.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.530+0000 7f9d4a59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d4c0caff0 0x7f9d4c0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.530+0000 7f9d4a59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d4c0caff0 0x7f9d4c0c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38650/0 (socket says 172.21.15.17:38650) 2023-08-09T12:48:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.530+0000 7f9d4a59c640 1 -- 172.21.15.17:0/777996368 learned_addr learned my addr 172.21.15.17:0/777996368 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.531+0000 7f9d4ad9d640 1 --2- 172.21.15.17:0/777996368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c0ccc70 0x7f9d4c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.531+0000 7f9d4a59c640 1 -- 172.21.15.17:0/777996368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c0ccc70 msgr2=0x7f9d4c0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.531+0000 7f9d4a59c640 1 --2- 172.21.15.17:0/777996368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c0ccc70 0x7f9d4c0cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.531+0000 7f9d4a59c640 1 -- 172.21.15.17:0/777996368 >> v1:172.21.15.142:6789/0 conn(0x7f9d4c165470 legacy=0x7f9d4c0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.531+0000 7f9d4a59c640 1 -- 172.21.15.17:0/777996368 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0ad950 con 0x7f9d4c0caff0 2023-08-09T12:48:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.531+0000 7f9d4ad9d640 1 --2- 172.21.15.17:0/777996368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c0ccc70 0x7f9d4c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.532+0000 7f9d4a59c640 1 --2- 172.21.15.17:0/777996368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c9440 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009870 tx=0x7f9d3c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc9f413a04a9e31 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.533+0000 7f9d4959a640 1 -- 172.21.15.17:0/777996368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c031640 con 0x7f9d4c0caff0 2023-08-09T12:48:24.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.533+0000 7f9d4959a640 1 -- 172.21.15.17:0/777996368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c0317a0 con 0x7f9d4c0caff0 2023-08-09T12:48:24.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.533+0000 7f9d4959a640 1 -- 172.21.15.17:0/777996368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c031b30 con 0x7f9d4c0caff0 2023-08-09T12:48:24.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.533+0000 7f9d4b59e640 1 -- 172.21.15.17:0/777996368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 msgr2=0x7f9d4c0c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.533+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/777996368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c9440 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009870 tx=0x7f9d3c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.534+0000 7f9d4b59e640 1 -- 172.21.15.17:0/777996368 shutdown_connections 2023-08-09T12:48:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.534+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/777996368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c0ccc70 0x7f9d4c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.534+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/777996368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c9440 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.534+0000 7f9d4b59e640 1 -- 172.21.15.17:0/777996368 >> 172.21.15.17:0/777996368 conn(0x7f9d4c06abd0 msgr2=0x7f9d4c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.534+0000 7f9d4b59e640 1 -- 172.21.15.17:0/777996368 shutdown_connections 2023-08-09T12:48:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.534+0000 7f9d4b59e640 1 -- 172.21.15.17:0/777996368 wait complete. 2023-08-09T12:48:24.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.536+0000 7f9d4b59e640 1 Processor -- start 2023-08-09T12:48:24.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.536+0000 7f9d4b59e640 1 -- start start 2023-08-09T12:48:24.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.537+0000 7f9d4b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.537+0000 7f9d4b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4c0ccc70 0x7f9d4c1f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.537+0000 7f9d4b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c165470 0x7f9d4c1f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.538+0000 7f9d4b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1f4360 con 0x7f9d4c0caff0 2023-08-09T12:48:24.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.538+0000 7f9d4b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1f7890 con 0x7f9d4c0ccc70 2023-08-09T12:48:24.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.538+0000 7f9d4b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0c3600 con 0x7f9d4c165470 2023-08-09T12:48:24.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.538+0000 7f9d4a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.538+0000 7f9d4a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38658/0 (socket says 172.21.15.17:38658) 2023-08-09T12:48:24.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.538+0000 7f9d4a59c640 1 -- 172.21.15.17:0/350671487 learned_addr learned my addr 172.21.15.17:0/350671487 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:24.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.538+0000 7f9d49d9b640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4c0ccc70 0x7f9d4c1f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.538+0000 7f9d4ad9d640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c165470 0x7f9d4c1f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.539+0000 7f9d4a59c640 1 -- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c165470 msgr2=0x7f9d4c1f7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.539+0000 7f9d4a59c640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c165470 0x7f9d4c1f7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.539+0000 7f9d4a59c640 1 -- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4c0ccc70 msgr2=0x7f9d4c1f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.539+0000 7f9d4a59c640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4c0ccc70 0x7f9d4c1f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.539+0000 7f9d4a59c640 1 -- 172.21.15.17:0/350671487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0094d0 con 0x7f9d4c0caff0 2023-08-09T12:48:24.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.539+0000 7f9d4a59c640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c2f90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c000c00 tx=0x7f9d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:24.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.540+0000 7f9d3affd640 1 -- 172.21.15.17:0/350671487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c03ac60 con 0x7f9d4c0caff0 2023-08-09T12:48:24.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.540+0000 7f9d3affd640 1 -- 172.21.15.17:0/350671487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c03ade0 con 0x7f9d4c0caff0 2023-08-09T12:48:24.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.540+0000 7f9d3affd640 1 -- 172.21.15.17:0/350671487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c044630 con 0x7f9d4c0caff0 2023-08-09T12:48:24.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.540+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c0c38e0 con 0x7f9d4c0caff0 2023-08-09T12:48:24.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.540+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c0c3ea0 con 0x7f9d4c0caff0 2023-08-09T12:48:24.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.541+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c04e390 con 0x7f9d4c0caff0 2023-08-09T12:48:24.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.542+0000 7f9d3affd640 1 -- 172.21.15.17:0/350671487 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9d3c02f050 con 0x7f9d4c0caff0 2023-08-09T12:48:24.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.543+0000 7f9d3affd640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9d2c06a050 0x7f9d2c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.543+0000 7f9d3affd640 1 -- 172.21.15.17:0/350671487 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d3c0aa700 con 0x7f9d4c0caff0 2023-08-09T12:48:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.543+0000 7f9d3affd640 1 -- 172.21.15.17:0/350671487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f9d2c0721a0 con 0x7f9d4c0caff0 2023-08-09T12:48:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.544+0000 7f9d49d9b640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9d2c06a050 0x7f9d2c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.545+0000 7f9d49d9b640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9d2c06a050 0x7f9d2c06c510 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c161230 tx=0x7f9d40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:24.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.548+0000 7f9d3affd640 1 -- 172.21.15.17:0/350671487 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9d3c075de0 con 0x7f9d4c0caff0 2023-08-09T12:48:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.737+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d4c0b4560 con 0x7f9d4c0caff0 2023-08-09T12:48:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.738+0000 7f9d3affd640 1 -- 172.21.15.17:0/350671487 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v150) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d3c0350a0 con 0x7f9d4c0caff0 2023-08-09T12:48:24.742 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:48:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9d2c06a050 msgr2=0x7f9d2c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9d2c06a050 0x7f9d2c06c510 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c161230 tx=0x7f9d40009040 comp rx=0 tx=0).stop 2023-08-09T12:48:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 msgr2=0x7f9d4c0c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c2f90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c000c00 tx=0x7f9d3c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 shutdown_connections 2023-08-09T12:48:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9d2c06a050 0x7f9d2c06c510 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d4c165470 0x7f9d4c1f7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4c0ccc70 0x7f9d4c1f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 --2- 172.21.15.17:0/350671487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c0caff0 0x7f9d4c0c2f90 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 >> 172.21.15.17:0/350671487 conn(0x7f9d4c06abd0 msgr2=0x7f9d4c0c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 shutdown_connections 2023-08-09T12:48:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.741+0000 7f9d4b59e640 1 -- 172.21.15.17:0/350671487 wait complete. 2023-08-09T12:48:24.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:48:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.983+0000 7f6a13fff640 1 Processor -- start 2023-08-09T12:48:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.983+0000 7f6a13fff640 1 -- start start 2023-08-09T12:48:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.984+0000 7f6a13fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6a1415cb40 0x7f6a141609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.984+0000 7f6a13fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a140b8420 0x7f6a140cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.984+0000 7f6a13fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a140d0f00 con 0x7f6a1415cf20 2023-08-09T12:48:24.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.984+0000 7f6a13fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a141611f0 con 0x7f6a1415cb40 2023-08-09T12:48:24.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.984+0000 7f6a13fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a141614d0 con 0x7f6a140b8420 2023-08-09T12:48:24.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.985+0000 7f6a12ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6a1415cb40 0x7f6a141609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.985+0000 7f6a12ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6a1415cb40 0x7f6a141609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38674/0 (socket says 172.21.15.17:38674) 2023-08-09T12:48:24.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.985+0000 7f6a12ffd640 1 -- 172.21.15.17:0/4245654313 learned_addr learned my addr 172.21.15.17:0/4245654313 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:24.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.985+0000 7f6a0a7fc640 1 --2- 172.21.15.17:0/4245654313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a140b8420 0x7f6a140cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.985+0000 7f6a12ffd640 1 -- 172.21.15.17:0/4245654313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a140b8420 msgr2=0x7f6a140cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.985+0000 7f6a12ffd640 1 --2- 172.21.15.17:0/4245654313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a140b8420 0x7f6a140cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.985+0000 7f6a12ffd640 1 -- 172.21.15.17:0/4245654313 >> v1:172.21.15.142:6789/0 conn(0x7f6a1415cf20 legacy=0x7f6a140697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.985+0000 7f6a12ffd640 1 -- 172.21.15.17:0/4245654313 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a141617b0 con 0x7f6a1415cb40 2023-08-09T12:48:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.986+0000 7f6a12ffd640 1 --2- 172.21.15.17:0/4245654313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a1415cb40 0x7f6a141609a0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009e50 tx=0x7f6a0402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76c9cae1996243a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a127fc640 1 -- 172.21.15.17:0/4245654313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0402cb00 con 0x7f6a1415cb40 2023-08-09T12:48:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a127fc640 1 -- 172.21.15.17:0/4245654313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0402cc60 con 0x7f6a1415cb40 2023-08-09T12:48:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a127fc640 1 -- 172.21.15.17:0/4245654313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040343f0 con 0x7f6a1415cb40 2023-08-09T12:48:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a13fff640 1 -- 172.21.15.17:0/4245654313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a1415cb40 msgr2=0x7f6a141609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a13fff640 1 --2- 172.21.15.17:0/4245654313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a1415cb40 0x7f6a141609a0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009e50 tx=0x7f6a0402bf60 comp rx=0 tx=0).stop 2023-08-09T12:48:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a13fff640 1 -- 172.21.15.17:0/4245654313 shutdown_connections 2023-08-09T12:48:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a13fff640 1 --2- 172.21.15.17:0/4245654313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a140b8420 0x7f6a140cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a13fff640 1 --2- 172.21.15.17:0/4245654313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a1415cb40 0x7f6a141609a0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.987+0000 7f6a13fff640 1 -- 172.21.15.17:0/4245654313 >> 172.21.15.17:0/4245654313 conn(0x7f6a140d2ab0 msgr2=0x7f6a140d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.988+0000 7f6a13fff640 1 -- 172.21.15.17:0/4245654313 shutdown_connections 2023-08-09T12:48:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.988+0000 7f6a13fff640 1 -- 172.21.15.17:0/4245654313 wait complete. 2023-08-09T12:48:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.989+0000 7f6a13fff640 1 Processor -- start 2023-08-09T12:48:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.990+0000 7f6a13fff640 1 -- start start 2023-08-09T12:48:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.990+0000 7f6a13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a140b8420 0x7f6a140a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.990+0000 7f6a13fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1415cb40 0x7f6a141590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.990+0000 7f6a13fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1415cf20 0x7f6a140c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.990+0000 7f6a13fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a141f5ab0 con 0x7f6a140b8420 2023-08-09T12:48:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.990+0000 7f6a13fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a141f5d00 con 0x7f6a1415cb40 2023-08-09T12:48:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.990+0000 7f6a13fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a141f5fe0 con 0x7f6a1415cf20 2023-08-09T12:48:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a12ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a140b8420 0x7f6a140a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a12ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a140b8420 0x7f6a140a9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38688/0 (socket says 172.21.15.17:38688) 2023-08-09T12:48:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a12ffd640 1 -- 172.21.15.17:0/1795900813 learned_addr learned my addr 172.21.15.17:0/1795900813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:24.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a12ffd640 1 -- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1415cf20 msgr2=0x7f6a140c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a12ffd640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1415cf20 0x7f6a140c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a12ffd640 1 -- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1415cb40 msgr2=0x7f6a141590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:24.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a0a7fc640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1415cb40 0x7f6a141590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:24.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a12ffd640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1415cb40 0x7f6a141590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:24.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a12ffd640 1 -- 172.21.15.17:0/1795900813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04009b30 con 0x7f6a140b8420 2023-08-09T12:48:24.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.991+0000 7f6a0a7fc640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1415cb40 0x7f6a141590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:24.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.992+0000 7f6a12ffd640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a140b8420 0x7f6a140a9580 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6a0402c4f0 tx=0x7f6a04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.992+0000 7f6a10ff9640 1 -- 172.21.15.17:0/1795900813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0403e450 con 0x7f6a140b8420 2023-08-09T12:48:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.992+0000 7f6a10ff9640 1 -- 172.21.15.17:0/1795900813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0403e5d0 con 0x7f6a140b8420 2023-08-09T12:48:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.992+0000 7f6a10ff9640 1 -- 172.21.15.17:0/1795900813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0403e980 con 0x7f6a140b8420 2023-08-09T12:48:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.992+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a141f62c0 con 0x7f6a140b8420 2023-08-09T12:48:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.992+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a140a9ac0 con 0x7f6a140b8420 2023-08-09T12:48:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.993+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a14149ed0 con 0x7f6a140b8420 2023-08-09T12:48:24.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.994+0000 7f6a10ff9640 1 -- 172.21.15.17:0/1795900813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6a0403eae0 con 0x7f6a140b8420 2023-08-09T12:48:24.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.995+0000 7f6a10ff9640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69f406a050 0x7f69f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:24.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.995+0000 7f6a10ff9640 1 -- 172.21.15.17:0/1795900813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a040ab5e0 con 0x7f6a140b8420 2023-08-09T12:48:25.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.996+0000 7f6a10ff9640 1 -- 172.21.15.17:0/1795900813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f69f40721a0 con 0x7f6a140b8420 2023-08-09T12:48:25.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.996+0000 7f6a0a7fc640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69f406a050 0x7f69f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:25.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:24.997+0000 7f6a0a7fc640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69f406a050 0x7f69f406c510 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6a141f5a10 tx=0x7f69fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:25.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.000+0000 7f6a10ff9640 1 -- 172.21.15.17:0/1795900813 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6a04076ce0 con 0x7f6a140b8420 2023-08-09T12:48:25.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.193+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a141f6120 con 0x7f6a140b8420 2023-08-09T12:48:25.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.194+0000 7f6a10ff9640 1 -- 172.21.15.17:0/1795900813 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v150) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a141f6120 con 0x7f6a140b8420 2023-08-09T12:48:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:48:25.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69f406a050 msgr2=0x7f69f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69f406a050 0x7f69f406c510 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6a141f5a10 tx=0x7f69fc008040 comp rx=0 tx=0).stop 2023-08-09T12:48:25.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a140b8420 msgr2=0x7f6a140a9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a140b8420 0x7f6a140a9580 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6a0402c4f0 tx=0x7f6a04004a40 comp rx=0 tx=0).stop 2023-08-09T12:48:25.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 shutdown_connections 2023-08-09T12:48:25.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f69f406a050 0x7f69f406c510 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1415cf20 0x7f6a140c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1415cb40 0x7f6a141590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 --2- 172.21.15.17:0/1795900813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a140b8420 0x7f6a140a9580 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 >> 172.21.15.17:0/1795900813 conn(0x7f6a140d2ab0 msgr2=0x7f6a140b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 shutdown_connections 2023-08-09T12:48:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.197+0000 7f6a13fff640 1 -- 172.21.15.17:0/1795900813 wait complete. 2023-08-09T12:48:25.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:48:25.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.452+0000 7fc259acd640 1 Processor -- start 2023-08-09T12:48:25.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.452+0000 7fc259acd640 1 -- start start 2023-08-09T12:48:25.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.454+0000 7fc259acd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2540cb610 0x7fc25406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.454+0000 7fc259acd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2540b3b60 con 0x7fc2540b0ea0 2023-08-09T12:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.454+0000 7fc259acd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2540b3550 con 0x7fc2540b0ac0 2023-08-09T12:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.454+0000 7fc259acd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2541617b0 con 0x7fc2540cb610 2023-08-09T12:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.454+0000 7fc253fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc2540b0ea0 0x7fc2540caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50892/0 (socket says 172.21.15.17:50892) 2023-08-09T12:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.454+0000 7fc253fff640 1 -- 172.21.15.17:0/373263077 learned_addr learned my addr 172.21.15.17:0/373263077 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2592cc640 1 --2- 172.21.15.17:0/373263077 >> v2:172.21.15.142:3300/0 conn(0x7fc2540cb610 0x7fc25406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614665648 0 0) 0x7fc2540b3b60 con 0x7fc2540b0ea0 2023-08-09T12:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc244003520 con 0x7fc2540b0ea0 2023-08-09T12:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 997178025 0 0) 0x7fc244003520 con 0x7fc2540b0ea0 2023-08-09T12:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 >> v2:172.21.15.142:3300/0 conn(0x7fc2540cb610 msgr2=0x7fc25406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 --2- 172.21.15.17:0/373263077 >> v2:172.21.15.142:3300/0 conn(0x7fc2540cb610 0x7fc25406ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 >> v1:172.21.15.142:6789/0 conn(0x7fc2540b0ac0 legacy=0x7fc2540b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2540c9e10 con 0x7fc2540b0ea0 2023-08-09T12:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc240001670 con 0x7fc2540b0ea0 2023-08-09T12:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.455+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 >> v1:172.21.15.17:6789/0 conn(0x7fc2540b0ea0 legacy=0x7fc2540caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc2537fe640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc244003970 0x7fc244003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc2537fe640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2440047c0 0x7fc244004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc2537fe640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc244005180 0x7fc24400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2541617b0 con 0x7fc244003970 2023-08-09T12:48:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24400c020 con 0x7fc2440047c0 2023-08-09T12:48:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24400c1e0 con 0x7fc244005180 2023-08-09T12:48:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc258acb640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc244003970 0x7fc244003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc258acb640 1 -- 172.21.15.17:0/373263077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc244005180 msgr2=0x7fc24400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc258acb640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc244005180 0x7fc24400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc258acb640 1 -- 172.21.15.17:0/373263077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2440047c0 msgr2=0x7fc244004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc258acb640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2440047c0 0x7fc244004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc258acb640 1 -- 172.21.15.17:0/373263077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc244003520 con 0x7fc244003970 2023-08-09T12:48:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.456+0000 7fc2592cc640 1 -- 172.21.15.17:0/373263077 reap_dead start 2023-08-09T12:48:25.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.457+0000 7fc258acb640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc244003970 0x7fc244003d90 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fc248001750 tx=0x7fc2440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519076b880841518 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.458+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480052d0 con 0x7fc244003970 2023-08-09T12:48:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.458+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24802e050 con 0x7fc244003970 2023-08-09T12:48:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.458+0000 7fc2537fe640 1 -- 172.21.15.17:0/373263077 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248003830 con 0x7fc244003970 2023-08-09T12:48:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.458+0000 7fc259acd640 1 -- 172.21.15.17:0/373263077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc244003970 msgr2=0x7fc244003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.458+0000 7fc259acd640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc244003970 0x7fc244003d90 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fc248001750 tx=0x7fc2440057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.458+0000 7fc259acd640 1 -- 172.21.15.17:0/373263077 shutdown_connections 2023-08-09T12:48:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.458+0000 7fc259acd640 1 --2- 172.21.15.17:0/373263077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc244003970 0x7fc244003d90 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.458+0000 7fc259acd640 1 -- 172.21.15.17:0/373263077 >> 172.21.15.17:0/373263077 conn(0x7fc2540b1d50 msgr2=0x7fc25406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.459+0000 7fc259acd640 1 -- 172.21.15.17:0/373263077 shutdown_connections 2023-08-09T12:48:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.459+0000 7fc259acd640 1 -- 172.21.15.17:0/373263077 wait complete. 2023-08-09T12:48:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.460+0000 7fc259acd640 1 Processor -- start 2023-08-09T12:48:25.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.461+0000 7fc259acd640 1 -- start start 2023-08-09T12:48:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc259acd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244003970 0x7fc254162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc259acd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254164030 0x7fc254149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc259acd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2540c7d20 0x7fc2540c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc259acd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2540c86e0 con 0x7fc2540c7d20 2023-08-09T12:48:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc259acd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254162f90 con 0x7fc244003970 2023-08-09T12:48:25.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc259acd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc254163270 con 0x7fc254164030 2023-08-09T12:48:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc2592cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2540c7d20 0x7fc2540c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc2592cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2540c7d20 0x7fc2540c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38704/0 (socket says 172.21.15.17:38704) 2023-08-09T12:48:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc2592cc640 1 -- 172.21.15.17:0/2156162225 learned_addr learned my addr 172.21.15.17:0/2156162225 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc258acb640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244003970 0x7fc254162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:25.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc253fff640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254164030 0x7fc254149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:25.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc2592cc640 1 -- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254164030 msgr2=0x7fc254149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc2592cc640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254164030 0x7fc254149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc2592cc640 1 -- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244003970 msgr2=0x7fc254162940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc2592cc640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244003970 0x7fc254162940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc2592cc640 1 -- 172.21.15.17:0/2156162225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254163550 con 0x7fc2540c7d20 2023-08-09T12:48:25.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc258acb640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244003970 0x7fc254162940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:25.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.462+0000 7fc253fff640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254164030 0x7fc254149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:25.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.463+0000 7fc2592cc640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2540c7d20 0x7fc2540c81a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fc2540cba20 tx=0x7fc24c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:25.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.463+0000 7fc2517fa640 1 -- 172.21.15.17:0/2156162225 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c010040 con 0x7fc2540c7d20 2023-08-09T12:48:25.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.463+0000 7fc2517fa640 1 -- 172.21.15.17:0/2156162225 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c00bb70 con 0x7fc2540c7d20 2023-08-09T12:48:25.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.463+0000 7fc2517fa640 1 -- 172.21.15.17:0/2156162225 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c014400 con 0x7fc2540c7d20 2023-08-09T12:48:25.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.463+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc254163830 con 0x7fc2540c7d20 2023-08-09T12:48:25.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.463+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc254149a70 con 0x7fc2540c7d20 2023-08-09T12:48:25.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.464+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc254149c30 con 0x7fc2540c7d20 2023-08-09T12:48:25.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.465+0000 7fc2517fa640 1 -- 172.21.15.17:0/2156162225 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc24c014560 con 0x7fc2540c7d20 2023-08-09T12:48:25.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.466+0000 7fc2517fa640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23806a080 0x7fc23806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:25.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.466+0000 7fc2517fa640 1 -- 172.21.15.17:0/2156162225 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc24c0888f0 con 0x7fc2540c7d20 2023-08-09T12:48:25.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.467+0000 7fc2517fa640 1 -- 172.21.15.17:0/2156162225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fc2380721d0 con 0x7fc2540c7d20 2023-08-09T12:48:25.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.467+0000 7fc258acb640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23806a080 0x7fc23806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.468+0000 7fc258acb640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23806a080 0x7fc23806c540 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc248033000 tx=0x7fc248009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.471+0000 7fc2517fa640 1 -- 172.21.15.17:0/2156162225 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc24c053eb0 con 0x7fc2540c7d20 2023-08-09T12:48:25.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.679+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc25404e390 con 0x7fc2540c7d20 2023-08-09T12:48:25.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.680+0000 7fc2517fa640 1 -- 172.21.15.17:0/2156162225 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v150) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc24c0574d0 con 0x7fc2540c7d20 2023-08-09T12:48:25.684 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:48:25.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23806a080 msgr2=0x7fc23806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23806a080 0x7fc23806c540 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc248033000 tx=0x7fc248009030 comp rx=0 tx=0).stop 2023-08-09T12:48:25.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2540c7d20 msgr2=0x7fc2540c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2540c7d20 0x7fc2540c81a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fc2540cba20 tx=0x7fc24c00ef30 comp rx=0 tx=0).stop 2023-08-09T12:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 shutdown_connections 2023-08-09T12:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc23806a080 0x7fc23806c540 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2540c7d20 0x7fc2540c81a0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254164030 0x7fc254149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 --2- 172.21.15.17:0/2156162225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244003970 0x7fc254162940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 >> 172.21.15.17:0/2156162225 conn(0x7fc2540b1d50 msgr2=0x7fc25406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.682+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 shutdown_connections 2023-08-09T12:48:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:25.683+0000 7fc259acd640 1 -- 172.21.15.17:0/2156162225 wait complete. 2023-08-09T12:48:25.706 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:48:25.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:25.707 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:48:25.836 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:48:25.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:25.837 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:48:25.887 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:48:25.888 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:25.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:48:25.952 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:48:25.952 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:26.011 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:48:26.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.246+0000 7fef271a6640 1 Processor -- start 2023-08-09T12:48:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.247+0000 7fef271a6640 1 -- start start 2023-08-09T12:48:26.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.248+0000 7fef271a6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fef200adc40 0x7fef2006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.248+0000 7fef271a6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200b2250 con 0x7fef200cc630 2023-08-09T12:48:26.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.248+0000 7fef271a6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200b2530 con 0x7fef200b3b40 2023-08-09T12:48:26.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.248+0000 7fef271a6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef200ae020 con 0x7fef200adc40 2023-08-09T12:48:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.249+0000 7fef25743640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fef200cc630 0x7fef200ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50894/0 (socket says 172.21.15.17:50894) 2023-08-09T12:48:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.249+0000 7fef25743640 1 -- 172.21.15.17:0/888785294 learned_addr learned my addr 172.21.15.17:0/888785294 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.249+0000 7fef24f42640 1 --2- 172.21.15.17:0/888785294 >> v2:172.21.15.17:3300/0 conn(0x7fef200adc40 0x7fef2006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.249+0000 7fef24f42640 1 -- 172.21.15.17:0/888785294 >> v1:172.21.15.142:6789/0 conn(0x7fef200b3b40 legacy=0x7fef200b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.250+0000 7fef24f42640 1 -- 172.21.15.17:0/888785294 >> v1:172.21.15.17:6789/0 conn(0x7fef200cc630 legacy=0x7fef200ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.250+0000 7fef1f7fe640 1 -- 172.21.15.17:0/888785294 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376694400 0 0) 0x7fef200b2250 con 0x7fef200cc630 2023-08-09T12:48:26.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.250+0000 7fef24f42640 1 -- 172.21.15.17:0/888785294 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2006fe80 con 0x7fef200adc40 2023-08-09T12:48:26.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.251+0000 7fef24f42640 1 --2- 172.21.15.17:0/888785294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200adc40 0x7fef2006c280 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fef140097a0 tx=0x7fef1402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe183e45db1e628 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:26.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.251+0000 7fef1f7fe640 1 -- 172.21.15.17:0/888785294 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14031830 con 0x7fef200adc40 2023-08-09T12:48:26.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.251+0000 7fef1f7fe640 1 -- 172.21.15.17:0/888785294 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14031990 con 0x7fef200adc40 2023-08-09T12:48:26.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.251+0000 7fef1f7fe640 1 -- 172.21.15.17:0/888785294 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14031d20 con 0x7fef200adc40 2023-08-09T12:48:26.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.252+0000 7fef271a6640 1 -- 172.21.15.17:0/888785294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200adc40 msgr2=0x7fef2006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.252+0000 7fef271a6640 1 --2- 172.21.15.17:0/888785294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200adc40 0x7fef2006c280 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fef140097a0 tx=0x7fef1402b8d0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.252+0000 7fef271a6640 1 -- 172.21.15.17:0/888785294 shutdown_connections 2023-08-09T12:48:26.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.252+0000 7fef271a6640 1 --2- 172.21.15.17:0/888785294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200adc40 0x7fef2006c280 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.252+0000 7fef271a6640 1 -- 172.21.15.17:0/888785294 >> 172.21.15.17:0/888785294 conn(0x7fef200cb1b0 msgr2=0x7fef200cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:26.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.252+0000 7fef271a6640 1 -- 172.21.15.17:0/888785294 shutdown_connections 2023-08-09T12:48:26.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.252+0000 7fef271a6640 1 -- 172.21.15.17:0/888785294 wait complete. 2023-08-09T12:48:26.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.254+0000 7fef271a6640 1 Processor -- start 2023-08-09T12:48:26.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.254+0000 7fef271a6640 1 -- start start 2023-08-09T12:48:26.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef271a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef200adc40 0x7fef2015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef271a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef200b3b40 0x7fef200a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef271a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200cc630 0x7fef200a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef271a6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200c3530 con 0x7fef200cc630 2023-08-09T12:48:26.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef271a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200c3220 con 0x7fef200b3b40 2023-08-09T12:48:26.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef271a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef201ec050 con 0x7fef200adc40 2023-08-09T12:48:26.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef25743640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200cc630 0x7fef200a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef25743640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200cc630 0x7fef200a8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38724/0 (socket says 172.21.15.17:38724) 2023-08-09T12:48:26.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.255+0000 7fef25743640 1 -- 172.21.15.17:0/3987024213 learned_addr learned my addr 172.21.15.17:0/3987024213 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:26.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef24f42640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef200adc40 0x7fef2015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef25743640 1 -- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef200adc40 msgr2=0x7fef2015ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef25743640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef200adc40 0x7fef2015ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef25743640 1 -- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef200b3b40 msgr2=0x7fef200a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef1ffff640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef200b3b40 0x7fef200a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef25743640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef200b3b40 0x7fef200a85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef25743640 1 -- 172.21.15.17:0/3987024213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14009400 con 0x7fef200cc630 2023-08-09T12:48:26.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef25743640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200cc630 0x7fef200a8b00 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c780 tx=0x7fef1800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:26.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.256+0000 7fef1d7fa640 1 -- 172.21.15.17:0/3987024213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800ce90 con 0x7fef200cc630 2023-08-09T12:48:26.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.257+0000 7fef1d7fa640 1 -- 172.21.15.17:0/3987024213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800a640 con 0x7fef200cc630 2023-08-09T12:48:26.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.257+0000 7fef1d7fa640 1 -- 172.21.15.17:0/3987024213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800a9d0 con 0x7fef200cc630 2023-08-09T12:48:26.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.257+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef201ec330 con 0x7fef200cc630 2023-08-09T12:48:26.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.257+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2015b0a0 con 0x7fef200cc630 2023-08-09T12:48:26.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.258+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef200c3670 con 0x7fef200cc630 2023-08-09T12:48:26.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.259+0000 7fef1d7fa640 1 -- 172.21.15.17:0/3987024213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef1800ab30 con 0x7fef200cc630 2023-08-09T12:48:26.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.260+0000 7fef1d7fa640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fef0406a080 0x7fef0406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.260+0000 7fef1d7fa640 1 -- 172.21.15.17:0/3987024213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef18087a40 con 0x7fef200cc630 2023-08-09T12:48:26.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.260+0000 7fef1d7fa640 1 -- 172.21.15.17:0/3987024213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fef040721d0 con 0x7fef200cc630 2023-08-09T12:48:26.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.261+0000 7fef24f42640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fef0406a080 0x7fef0406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.262+0000 7fef24f42640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fef0406a080 0x7fef0406c540 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fef14036000 tx=0x7fef1403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:26.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.264+0000 7fef1d7fa640 1 -- 172.21.15.17:0/3987024213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fef18018060 con 0x7fef200cc630 2023-08-09T12:48:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.493+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef20070130 con 0x7fef200cc630 2023-08-09T12:48:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.494+0000 7fef1d7fa640 1 -- 172.21.15.17:0/3987024213 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7fef18053090 con 0x7fef200cc630 2023-08-09T12:48:26.498 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:26.498 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:48:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:48:26.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fef0406a080 msgr2=0x7fef0406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fef0406a080 0x7fef0406c540 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fef14036000 tx=0x7fef1403c040 comp rx=0 tx=0).stop 2023-08-09T12:48:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200cc630 msgr2=0x7fef200a8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200cc630 0x7fef200a8b00 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c780 tx=0x7fef1800cc40 comp rx=0 tx=0).stop 2023-08-09T12:48:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 shutdown_connections 2023-08-09T12:48:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fef0406a080 0x7fef0406c540 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef200cc630 0x7fef200a8b00 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef200b3b40 0x7fef200a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 --2- 172.21.15.17:0/3987024213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef200adc40 0x7fef2015ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 >> 172.21.15.17:0/3987024213 conn(0x7fef200cb1b0 msgr2=0x7fef200ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.497+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 shutdown_connections 2023-08-09T12:48:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.498+0000 7fef271a6640 1 -- 172.21.15.17:0/3987024213 wait complete. 2023-08-09T12:48:26.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.751+0000 7fa4da0cc640 1 Processor -- start 2023-08-09T12:48:26.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.751+0000 7fa4da0cc640 1 -- start start 2023-08-09T12:48:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.753+0000 7fa4da0cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d40ad810 0x7fa4d40b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.753+0000 7fa4da0cc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40b4630 con 0x7fa4d4159d80 2023-08-09T12:48:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.753+0000 7fa4da0cc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40b3ab0 con 0x7fa4d4070a90 2023-08-09T12:48:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.753+0000 7fa4da0cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d415a160 con 0x7fa4d40ad810 2023-08-09T12:48:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.753+0000 7fa4d37fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa4d4159d80 0x7fa4d4070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50904/0 (socket says 172.21.15.17:50904) 2023-08-09T12:48:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.753+0000 7fa4d37fe640 1 -- 172.21.15.17:0/497983715 learned_addr learned my addr 172.21.15.17:0/497983715 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d3fff640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d40ad810 0x7fa4d40b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604581049 0 0) 0x7fa4d40b4630 con 0x7fa4d4159d80 2023-08-09T12:48:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c0003520 con 0x7fa4d4159d80 2023-08-09T12:48:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4105761739 0 0) 0x7fa4c0003520 con 0x7fa4d4159d80 2023-08-09T12:48:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d40ad810 msgr2=0x7fa4d40b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d40ad810 0x7fa4d40b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 >> v1:172.21.15.142:6789/0 conn(0x7fa4d4070a90 legacy=0x7fa4d40c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40b3d90 con 0x7fa4d4159d80 2023-08-09T12:48:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa4c4001670 con 0x7fa4d4159d80 2023-08-09T12:48:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 >> v1:172.21.15.17:6789/0 conn(0x7fa4d4159d80 legacy=0x7fa4d4070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c00039a0 0x7fa4c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.754+0000 7fa4d2ffd640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4d2ffd640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d40ad810 0x7fa4c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d415a160 con 0x7fa4c00047c0 2023-08-09T12:48:26.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c000dc70 con 0x7fa4c00039a0 2023-08-09T12:48:26.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c000de30 con 0x7fa4d40ad810 2023-08-09T12:48:26.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4caffd640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4d37fe640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c00039a0 0x7fa4c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4caffd640 1 -- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d40ad810 msgr2=0x7fa4c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:26.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4caffd640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d40ad810 0x7fa4c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4caffd640 1 -- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c00039a0 msgr2=0x7fa4c0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:26.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4caffd640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c00039a0 0x7fa4c0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4caffd640 1 -- 172.21.15.17:0/497983715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0003520 con 0x7fa4c00047c0 2023-08-09T12:48:26.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.755+0000 7fa4d37fe640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c00039a0 0x7fa4c0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:26.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.756+0000 7fa4caffd640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4c0004c40 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc007fd0 tx=0x7fa4c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316bb892e897497c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:26.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.757+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc003bc0 con 0x7fa4c00047c0 2023-08-09T12:48:26.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.757+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc003d20 con 0x7fa4c00047c0 2023-08-09T12:48:26.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.757+0000 7fa4d2ffd640 1 -- 172.21.15.17:0/497983715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc005310 con 0x7fa4c00047c0 2023-08-09T12:48:26.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.757+0000 7fa4da0cc640 1 -- 172.21.15.17:0/497983715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 msgr2=0x7fa4c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.757+0000 7fa4da0cc640 1 --2- 172.21.15.17:0/497983715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4c0004c40 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc007fd0 tx=0x7fa4c00057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.757+0000 7fa4d3fff640 1 -- 172.21.15.17:0/497983715 reap_dead start 2023-08-09T12:48:26.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.758+0000 7fa4da0cc640 1 -- 172.21.15.17:0/497983715 shutdown_connections 2023-08-09T12:48:26.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.758+0000 7fa4da0cc640 1 -- 172.21.15.17:0/497983715 >> 172.21.15.17:0/497983715 conn(0x7fa4d40cb1b0 msgr2=0x7fa4d40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:26.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.758+0000 7fa4da0cc640 1 -- 172.21.15.17:0/497983715 shutdown_connections 2023-08-09T12:48:26.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.758+0000 7fa4da0cc640 1 -- 172.21.15.17:0/497983715 wait complete. 2023-08-09T12:48:26.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.759+0000 7fa4da0cc640 1 Processor -- start 2023-08-09T12:48:26.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.760+0000 7fa4da0cc640 1 -- start start 2023-08-09T12:48:26.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.760+0000 7fa4da0cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4d41581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.760+0000 7fa4da0cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d41437d0 0x7fa4d40ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4da0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d40ae6a0 0x7fa4d40aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4da0cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d41444c0 con 0x7fa4c00047c0 2023-08-09T12:48:26.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4da0cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b0a80 con 0x7fa4d40ae6a0 2023-08-09T12:48:26.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4da0cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b0d60 con 0x7fa4d41437d0 2023-08-09T12:48:26.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4d41581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4d41581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38746/0 (socket says 172.21.15.17:38746) 2023-08-09T12:48:26.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d37fe640 1 -- 172.21.15.17:0/4123588641 learned_addr learned my addr 172.21.15.17:0/4123588641 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:26.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4caffd640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d41437d0 0x7fa4d40ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d3fff640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d40ae6a0 0x7fa4d40aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d37fe640 1 -- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d41437d0 msgr2=0x7fa4d40ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d37fe640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d41437d0 0x7fa4d40ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d37fe640 1 -- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d40ae6a0 msgr2=0x7fa4d40aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d37fe640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d40ae6a0 0x7fa4d40aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4d37fe640 1 -- 172.21.15.17:0/4123588641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40b1040 con 0x7fa4c00047c0 2023-08-09T12:48:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.761+0000 7fa4caffd640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d41437d0 0x7fa4d40ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:26.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.762+0000 7fa4d37fe640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4d41581c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400d8e0 tx=0x7fa4c400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.762+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/4123588641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40074e0 con 0x7fa4c00047c0 2023-08-09T12:48:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.762+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/4123588641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4007640 con 0x7fa4c00047c0 2023-08-09T12:48:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.762+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/4123588641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40049e0 con 0x7fa4c00047c0 2023-08-09T12:48:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.762+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d4144150 con 0x7fa4c00047c0 2023-08-09T12:48:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.762+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d4146140 con 0x7fa4c00047c0 2023-08-09T12:48:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.763+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d41442e0 con 0x7fa4c00047c0 2023-08-09T12:48:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.764+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/4123588641 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa4c4004b40 con 0x7fa4c00047c0 2023-08-09T12:48:26.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.765+0000 7fa4d0ff9640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa4b406a080 0x7fa4b406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:26.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.765+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/4123588641 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4c4087ff0 con 0x7fa4c00047c0 2023-08-09T12:48:26.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.765+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/4123588641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fa4b40721d0 con 0x7fa4c00047c0 2023-08-09T12:48:26.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.766+0000 7fa4caffd640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa4b406a080 0x7fa4b406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:26.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.767+0000 7fa4caffd640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa4b406a080 0x7fa4b406c540 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc034000 tx=0x7fa4bc009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:26.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.770+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/4123588641 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa4c40ba7b0 con 0x7fa4c00047c0 2023-08-09T12:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.963+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4d4067a80 con 0x7fa4c00047c0 2023-08-09T12:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.965+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/4123588641 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+18365 (secure 0 0 0) 0x7fa4c4019020 con 0x7fa4c00047c0 2023-08-09T12:48:26.969 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:26.969 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":150,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:23.848416+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:47:36.431201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-09T12:47:37.108075+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.967+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa4b406a080 msgr2=0x7fa4b406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.967+0000 7fa4da0cc640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa4b406a080 0x7fa4b406c540 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc034000 tx=0x7fa4bc009030 comp rx=0 tx=0).stop 2023-08-09T12:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.967+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 msgr2=0x7fa4d41581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.967+0000 7fa4da0cc640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4d41581c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400d8e0 tx=0x7fa4c400dda0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.967+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 shutdown_connections 2023-08-09T12:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.967+0000 7fa4da0cc640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa4b406a080 0x7fa4b406c540 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.967+0000 7fa4da0cc640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d40ae6a0 0x7fa4d40aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.967+0000 7fa4da0cc640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4d41437d0 0x7fa4d40ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.968+0000 7fa4da0cc640 1 --2- 172.21.15.17:0/4123588641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4c00047c0 0x7fa4d41581c0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.968+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 >> 172.21.15.17:0/4123588641 conn(0x7fa4d40cb1b0 msgr2=0x7fa4d4070380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.968+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 shutdown_connections 2023-08-09T12:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:26.968+0000 7fa4da0cc640 1 -- 172.21.15.17:0/4123588641 wait complete. 2023-08-09T12:48:26.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:47:36.431201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:47:37.108075+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:48:26.992 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:48:27.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.222+0000 7f39a33d6640 1 Processor -- start 2023-08-09T12:48:27.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.222+0000 7f39a33d6640 1 -- start start 2023-08-09T12:48:27.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a33d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a33d6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f399c0b0020 0x7f399c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a33d6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c15e7b0 con 0x7f399c15a8c0 2023-08-09T12:48:27.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a33d6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c0b09f0 con 0x7f399c0b0020 2023-08-09T12:48:27.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a33d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c15e460 con 0x7f399c0b4170 2023-08-09T12:48:27.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a2bd5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f399c0b0020 0x7f399c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a23d4640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f399c15a8c0 0x7f399c15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50918/0 (socket says 172.21.15.17:50918) 2023-08-09T12:48:27.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a23d4640 1 -- 172.21.15.17:0/2054471057 learned_addr learned my addr 172.21.15.17:0/2054471057 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.224+0000 7f39a2bd5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f399c0b0020 0x7f399c0b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38756/0 (socket says 172.21.15.17:38756) 2023-08-09T12:48:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.225+0000 7f39a1bd3640 1 --2- 172.21.15.17:0/2054471057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.225+0000 7f39a2bd5640 1 -- 172.21.15.17:0/2054471057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 msgr2=0x7f399c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:27.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.225+0000 7f39a2bd5640 1 --2- 172.21.15.17:0/2054471057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.225+0000 7f39a2bd5640 1 -- 172.21.15.17:0/2054471057 >> v1:172.21.15.17:6789/0 conn(0x7f399c15a8c0 legacy=0x7f399c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.225+0000 7f39a2bd5640 1 -- 172.21.15.17:0/2054471057 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c15aca0 con 0x7f399c0b0020 2023-08-09T12:48:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.225+0000 7f39a1bd3640 1 --2- 172.21.15.17:0/2054471057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.226+0000 7f39a2bd5640 1 --2- 172.21.15.17:0/2054471057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c0b0020 0x7f399c0b04b0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f39940097a0 tx=0x7f399402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d552e539182e8c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.227+0000 7f39a13d2640 1 -- 172.21.15.17:0/2054471057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399402d040 con 0x7f399c0b0020 2023-08-09T12:48:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.227+0000 7f39a13d2640 1 -- 172.21.15.17:0/2054471057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994031810 con 0x7f399c0b0020 2023-08-09T12:48:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.227+0000 7f39a13d2640 1 -- 172.21.15.17:0/2054471057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994031ba0 con 0x7f399c0b0020 2023-08-09T12:48:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.227+0000 7f39a33d6640 1 -- 172.21.15.17:0/2054471057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c0b0020 msgr2=0x7f399c0b04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.227+0000 7f39a33d6640 1 --2- 172.21.15.17:0/2054471057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c0b0020 0x7f399c0b04b0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f39940097a0 tx=0x7f399402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.228+0000 7f39a33d6640 1 -- 172.21.15.17:0/2054471057 shutdown_connections 2023-08-09T12:48:27.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.228+0000 7f39a33d6640 1 --2- 172.21.15.17:0/2054471057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c0b0020 0x7f399c0b04b0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.228+0000 7f39a33d6640 1 --2- 172.21.15.17:0/2054471057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.228+0000 7f39a33d6640 1 -- 172.21.15.17:0/2054471057 >> 172.21.15.17:0/2054471057 conn(0x7f399c0cb020 msgr2=0x7f399c0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:27.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.228+0000 7f39a33d6640 1 -- 172.21.15.17:0/2054471057 shutdown_connections 2023-08-09T12:48:27.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.228+0000 7f39a33d6640 1 -- 172.21.15.17:0/2054471057 wait complete. 2023-08-09T12:48:27.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.230+0000 7f39a33d6640 1 Processor -- start 2023-08-09T12:48:27.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.230+0000 7f39a33d6640 1 -- start start 2023-08-09T12:48:27.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.231+0000 7f39a33d6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399c0b0020 0x7f399c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a33d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a33d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c15a8c0 0x7f399c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a33d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c1569b0 con 0x7f399c15a8c0 2023-08-09T12:48:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a33d6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c156110 con 0x7f399c0b0020 2023-08-09T12:48:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a33d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c1563f0 con 0x7f399c0b4170 2023-08-09T12:48:27.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a2bd5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c15a8c0 0x7f399c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a2bd5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c15a8c0 0x7f399c153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38766/0 (socket says 172.21.15.17:38766) 2023-08-09T12:48:27.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a2bd5640 1 -- 172.21.15.17:0/449361282 learned_addr learned my addr 172.21.15.17:0/449361282 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:27.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a1bd3640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a23d4640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399c0b0020 0x7f399c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a2bd5640 1 -- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 msgr2=0x7f399c1536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a2bd5640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c1536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a2bd5640 1 -- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399c0b0020 msgr2=0x7f399c1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.232+0000 7f39a2bd5640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399c0b0020 0x7f399c1557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.233+0000 7f39a2bd5640 1 -- 172.21.15.17:0/449361282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994009400 con 0x7f399c15a8c0 2023-08-09T12:48:27.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.233+0000 7f39a1bd3640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c1536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.233+0000 7f39a2bd5640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c15a8c0 0x7f399c153c10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f39940097a0 tx=0x7f39940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.233+0000 7f3992ffd640 1 -- 172.21.15.17:0/449361282 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399403ace0 con 0x7f399c15a8c0 2023-08-09T12:48:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.233+0000 7f3992ffd640 1 -- 172.21.15.17:0/449361282 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399403ae40 con 0x7f399c15a8c0 2023-08-09T12:48:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.233+0000 7f3992ffd640 1 -- 172.21.15.17:0/449361282 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994044640 con 0x7f399c15a8c0 2023-08-09T12:48:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.233+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c1566d0 con 0x7f399c15a8c0 2023-08-09T12:48:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.233+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c155d20 con 0x7f399c15a8c0 2023-08-09T12:48:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.235+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c15b1c0 con 0x7f399c15a8c0 2023-08-09T12:48:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.235+0000 7f3992ffd640 1 -- 172.21.15.17:0/449361282 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f399404d440 con 0x7f399c15a8c0 2023-08-09T12:48:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.236+0000 7f3992ffd640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f398006a050 0x7f398006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.236+0000 7f3992ffd640 1 -- 172.21.15.17:0/449361282 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39940aaaa0 con 0x7f399c15a8c0 2023-08-09T12:48:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.237+0000 7f3992ffd640 1 -- 172.21.15.17:0/449361282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f39800721a0 con 0x7f399c15a8c0 2023-08-09T12:48:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.237+0000 7f39a23d4640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f398006a050 0x7f398006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.238+0000 7f39a23d4640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f398006a050 0x7f398006c510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3998005c00 tx=0x7f3998009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:27.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.241+0000 7f3992ffd640 1 -- 172.21.15.17:0/449361282 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f399c15b1c0 con 0x7f399c15a8c0 2023-08-09T12:48:27.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.433+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f399c15b1c0 con 0x7f399c15a8c0 2023-08-09T12:48:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.434+0000 7f3992ffd640 1 -- 172.21.15.17:0/449361282 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7f399c15b1c0 con 0x7f399c15a8c0 2023-08-09T12:48:27.438 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:48:27.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f398006a050 msgr2=0x7f398006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f398006a050 0x7f398006c510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3998005c00 tx=0x7f3998009040 comp rx=0 tx=0).stop 2023-08-09T12:48:27.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c15a8c0 msgr2=0x7f399c153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c15a8c0 0x7f399c153c10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f39940097a0 tx=0x7f39940046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 shutdown_connections 2023-08-09T12:48:27.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f398006a050 0x7f398006c510 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f399c15a8c0 0x7f399c153c10 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f399c0b4170 0x7f399c1536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 --2- 172.21.15.17:0/449361282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f399c0b0020 0x7f399c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.436+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 >> 172.21.15.17:0/449361282 conn(0x7f399c0cb020 msgr2=0x7f399c1590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:27.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.437+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 shutdown_connections 2023-08-09T12:48:27.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.437+0000 7f39a33d6640 1 -- 172.21.15.17:0/449361282 wait complete. 2023-08-09T12:48:27.458 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:48:27.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.682+0000 7f5fe0cf2640 1 Processor -- start 2023-08-09T12:48:27.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.682+0000 7f5fe0cf2640 1 -- start start 2023-08-09T12:48:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.684+0000 7f5fe0cf2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15ca80 0x7f5fdc06b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.684+0000 7f5fe0cf2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5fdc0b06b0 0x7f5fdc160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.684+0000 7f5fe0cf2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0ad950 con 0x7f5fdc15d7d0 2023-08-09T12:48:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.684+0000 7f5fe0cf2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc0cd6a0 con 0x7f5fdc0b06b0 2023-08-09T12:48:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.684+0000 7f5fe0cf2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0cd980 con 0x7f5fdc15ca80 2023-08-09T12:48:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.685+0000 7f5fdaffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5fdc15d7d0 0x7f5fdc0affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50932/0 (socket says 172.21.15.17:50932) 2023-08-09T12:48:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.685+0000 7f5fdaffd640 1 -- 172.21.15.17:0/4017210931 learned_addr learned my addr 172.21.15.17:0/4017210931 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.685+0000 7f5fdb7fe640 1 --2- 172.21.15.17:0/4017210931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15ca80 0x7f5fdc06b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.685+0000 7f5fdbfff640 1 --2- 172.21.15.17:0/4017210931 >> v2:172.21.15.142:3300/0 conn(0x7f5fdc0b06b0 0x7f5fdc160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.685+0000 7f5fda7fc640 1 -- 172.21.15.17:0/4017210931 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404811928 0 0) 0x7f5fdc0ad950 con 0x7f5fdc15d7d0 2023-08-09T12:48:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.685+0000 7f5fda7fc640 1 -- 172.21.15.17:0/4017210931 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc4003520 con 0x7f5fdc15d7d0 2023-08-09T12:48:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.686+0000 7f5fda7fc640 1 -- 172.21.15.17:0/4017210931 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2755983581 0 0) 0x7f5fc4003520 con 0x7f5fdc15d7d0 2023-08-09T12:48:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.686+0000 7f5fdb7fe640 1 -- 172.21.15.17:0/4017210931 >> v2:172.21.15.142:3300/0 conn(0x7f5fdc0b06b0 msgr2=0x7f5fdc160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.686+0000 7f5fdb7fe640 1 --2- 172.21.15.17:0/4017210931 >> v2:172.21.15.142:3300/0 conn(0x7f5fdc0b06b0 0x7f5fdc160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.686+0000 7f5fdb7fe640 1 -- 172.21.15.17:0/4017210931 >> v1:172.21.15.17:6789/0 conn(0x7f5fdc15d7d0 legacy=0x7f5fdc0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.686+0000 7f5fdb7fe640 1 -- 172.21.15.17:0/4017210931 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0cdc60 con 0x7f5fdc15ca80 2023-08-09T12:48:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.687+0000 7f5fdb7fe640 1 --2- 172.21.15.17:0/4017210931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15ca80 0x7f5fdc06b5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0097a0 tx=0x7f5fcc02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89bf5d5d3e19ecb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fda7fc640 1 -- 172.21.15.17:0/4017210931 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0001670 con 0x7f5fdc15ca80 2023-08-09T12:48:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fda7fc640 1 -- 172.21.15.17:0/4017210931 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc02e050 con 0x7f5fdc15ca80 2023-08-09T12:48:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fda7fc640 1 -- 172.21.15.17:0/4017210931 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc030730 con 0x7f5fdc15ca80 2023-08-09T12:48:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/4017210931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15ca80 msgr2=0x7f5fdc06b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/4017210931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15ca80 0x7f5fdc06b5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0097a0 tx=0x7f5fcc02b790 comp rx=0 tx=0).stop 2023-08-09T12:48:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/4017210931 shutdown_connections 2023-08-09T12:48:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/4017210931 >> v2:172.21.15.142:3300/0 conn(0x7f5fdc0b06b0 0x7f5fdc160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/4017210931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15ca80 0x7f5fdc06b5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/4017210931 >> 172.21.15.17:0/4017210931 conn(0x7f5fdc0cafa0 msgr2=0x7f5fdc0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.688+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/4017210931 shutdown_connections 2023-08-09T12:48:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.689+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/4017210931 wait complete. 2023-08-09T12:48:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.690+0000 7f5fe0cf2640 1 Processor -- start 2023-08-09T12:48:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.691+0000 7f5fe0cf2640 1 -- start start 2023-08-09T12:48:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.691+0000 7f5fe0cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0b06b0 0x7f5fdc146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.691+0000 7f5fe0cf2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fdc15ca80 0x7f5fdc070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.691+0000 7f5fe0cf2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15d7d0 0x7f5fdc0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fe0cf2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0b2990 con 0x7f5fdc15ca80 2023-08-09T12:48:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fe0cf2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0b2c70 con 0x7f5fdc0b06b0 2023-08-09T12:48:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fe0cf2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0b2f50 con 0x7f5fdc15d7d0 2023-08-09T12:48:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fdc15ca80 0x7f5fdc070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fdc15ca80 0x7f5fdc070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38782/0 (socket says 172.21.15.17:38782) 2023-08-09T12:48:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdaffd640 1 -- 172.21.15.17:0/2716974588 learned_addr learned my addr 172.21.15.17:0/2716974588 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:27.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdbfff640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15d7d0 0x7f5fdc0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdb7fe640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0b06b0 0x7f5fdc146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdaffd640 1 -- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15d7d0 msgr2=0x7f5fdc0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdaffd640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15d7d0 0x7f5fdc0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdaffd640 1 -- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0b06b0 msgr2=0x7f5fdc146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdaffd640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0b06b0 0x7f5fdc146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.692+0000 7f5fdaffd640 1 -- 172.21.15.17:0/2716974588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc009400 con 0x7f5fdc15ca80 2023-08-09T12:48:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.693+0000 7f5fdaffd640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fdc15ca80 0x7f5fdc070df0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c750 tx=0x7f5fd000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.693+0000 7f5fc3fff640 1 -- 172.21.15.17:0/2716974588 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0005ad0 con 0x7f5fdc15ca80 2023-08-09T12:48:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.693+0000 7f5fc3fff640 1 -- 172.21.15.17:0/2716974588 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0005c50 con 0x7f5fdc15ca80 2023-08-09T12:48:27.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.693+0000 7f5fc3fff640 1 -- 172.21.15.17:0/2716974588 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0007070 con 0x7f5fdc15ca80 2023-08-09T12:48:27.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.693+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc0b3230 con 0x7f5fdc15ca80 2023-08-09T12:48:27.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.693+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc146b60 con 0x7f5fdc15ca80 2023-08-09T12:48:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.694+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc146e40 con 0x7f5fdc15ca80 2023-08-09T12:48:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.695+0000 7f5fc3fff640 1 -- 172.21.15.17:0/2716974588 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5fd00071d0 con 0x7f5fdc15ca80 2023-08-09T12:48:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.696+0000 7f5fc3fff640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fc806a050 0x7f5fc806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.696+0000 7f5fc3fff640 1 -- 172.21.15.17:0/2716974588 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fd00883f0 con 0x7f5fdc15ca80 2023-08-09T12:48:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.696+0000 7f5fc3fff640 1 -- 172.21.15.17:0/2716974588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f5fc80721a0 con 0x7f5fdc15ca80 2023-08-09T12:48:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.697+0000 7f5fdb7fe640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fc806a050 0x7f5fc806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.698+0000 7f5fdb7fe640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fc806a050 0x7f5fc806c510 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc034000 tx=0x7f5fcc02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.701+0000 7f5fc3fff640 1 -- 172.21.15.17:0/2716974588 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5fd0053a40 con 0x7f5fdc15ca80 2023-08-09T12:48:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.895+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5fdc0b2ad0 con 0x7f5fdc15ca80 2023-08-09T12:48:27.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.896+0000 7f5fc3fff640 1 -- 172.21.15.17:0/2716974588 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v150) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5fdc0b2ad0 con 0x7f5fdc15ca80 2023-08-09T12:48:27.899 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:48:27.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.898+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fc806a050 msgr2=0x7f5fc806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.898+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fc806a050 0x7f5fc806c510 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc034000 tx=0x7f5fcc02f000 comp rx=0 tx=0).stop 2023-08-09T12:48:27.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.898+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fdc15ca80 msgr2=0x7f5fdc070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:27.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.898+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fdc15ca80 0x7f5fdc070df0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c750 tx=0x7f5fd000cc10 comp rx=0 tx=0).stop 2023-08-09T12:48:27.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.899+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 shutdown_connections 2023-08-09T12:48:27.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.899+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fc806a050 0x7f5fc806c510 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.899+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc15d7d0 0x7f5fdc0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.899+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fdc15ca80 0x7f5fdc070df0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.899+0000 7f5fe0cf2640 1 --2- 172.21.15.17:0/2716974588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0b06b0 0x7f5fdc146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:27.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.899+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 >> 172.21.15.17:0/2716974588 conn(0x7f5fdc0cafa0 msgr2=0x7f5fdc15bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:27.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.899+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 shutdown_connections 2023-08-09T12:48:27.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:27.899+0000 7f5fe0cf2640 1 -- 172.21.15.17:0/2716974588 wait complete. 2023-08-09T12:48:27.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:48:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.155+0000 7f943e174640 1 Processor -- start 2023-08-09T12:48:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.155+0000 7f943e174640 1 -- start start 2023-08-09T12:48:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.156+0000 7f943e174640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f943815cac0 0x7f94380cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943e174640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94380d09e0 con 0x7f94380b1fc0 2023-08-09T12:48:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943e174640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94380cdb70 con 0x7f94380b44b0 2023-08-09T12:48:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943e174640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94380d1010 con 0x7f943815cac0 2023-08-09T12:48:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943d172640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f943815cac0 0x7f94380cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943d172640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f943815cac0 0x7f94380cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56812/0 (socket says 172.21.15.17:56812) 2023-08-09T12:48:28.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943d172640 1 -- 172.21.15.17:0/694914102 learned_addr learned my addr 172.21.15.17:0/694914102 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:28.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943d172640 1 -- 172.21.15.17:0/694914102 >> v1:172.21.15.142:6789/0 conn(0x7f94380b44b0 legacy=0x7f94380b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:28.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943d172640 1 -- 172.21.15.17:0/694914102 >> v1:172.21.15.17:6789/0 conn(0x7f94380b1fc0 legacy=0x7f94380d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.157+0000 7f943d172640 1 -- 172.21.15.17:0/694914102 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380cde50 con 0x7f943815cac0 2023-08-09T12:48:28.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.159+0000 7f943d172640 1 --2- 172.21.15.17:0/694914102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f943815cac0 0x7f94380cd290 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9434009870 tx=0x7f943402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735953968d99eb91 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:28.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.159+0000 7f942ffff640 1 -- 172.21.15.17:0/694914102 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434030860 con 0x7f943815cac0 2023-08-09T12:48:28.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.159+0000 7f942ffff640 1 -- 172.21.15.17:0/694914102 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94340309c0 con 0x7f943815cac0 2023-08-09T12:48:28.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.159+0000 7f942ffff640 1 -- 172.21.15.17:0/694914102 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434030d50 con 0x7f943815cac0 2023-08-09T12:48:28.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.159+0000 7f943e174640 1 -- 172.21.15.17:0/694914102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f943815cac0 msgr2=0x7f94380cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.159+0000 7f943e174640 1 --2- 172.21.15.17:0/694914102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f943815cac0 0x7f94380cd290 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9434009870 tx=0x7f943402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.160+0000 7f943e174640 1 -- 172.21.15.17:0/694914102 shutdown_connections 2023-08-09T12:48:28.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.160+0000 7f943e174640 1 --2- 172.21.15.17:0/694914102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f943815cac0 0x7f94380cd290 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.160+0000 7f943e174640 1 -- 172.21.15.17:0/694914102 >> 172.21.15.17:0/694914102 conn(0x7f94380cf4b0 msgr2=0x7f94380cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:28.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.160+0000 7f943e174640 1 -- 172.21.15.17:0/694914102 shutdown_connections 2023-08-09T12:48:28.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.160+0000 7f943e174640 1 -- 172.21.15.17:0/694914102 wait complete. 2023-08-09T12:48:28.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.161+0000 7f943e174640 1 Processor -- start 2023-08-09T12:48:28.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.162+0000 7f943e174640 1 -- start start 2023-08-09T12:48:28.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.162+0000 7f943e174640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94380b1fc0 0x7f9438158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.162+0000 7f943e174640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94380b44b0 0x7f9438157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943e174640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943815cac0 0x7f94380c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943e174640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380d1b40 con 0x7f94380b44b0 2023-08-09T12:48:28.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943e174640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943815e000 con 0x7f943815cac0 2023-08-09T12:48:28.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943e174640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94381f2190 con 0x7f94380b1fc0 2023-08-09T12:48:28.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943c971640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94380b44b0 0x7f9438157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943c971640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94380b44b0 0x7f9438157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56824/0 (socket says 172.21.15.17:56824) 2023-08-09T12:48:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943c971640 1 -- 172.21.15.17:0/919920889 learned_addr learned my addr 172.21.15.17:0/919920889 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943d172640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94380b1fc0 0x7f9438158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.163+0000 7f943d973640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943815cac0 0x7f94380c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f943c971640 1 -- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94380b1fc0 msgr2=0x7f9438158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f943c971640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94380b1fc0 0x7f9438158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f943c971640 1 -- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943815cac0 msgr2=0x7f94380c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f943c971640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943815cac0 0x7f94380c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f943c971640 1 -- 172.21.15.17:0/919920889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94340094d0 con 0x7f94380b44b0 2023-08-09T12:48:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f943c971640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94380b44b0 0x7f9438157ce0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f942800c430 tx=0x7f942800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f942dffb640 1 -- 172.21.15.17:0/919920889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94280052d0 con 0x7f94380b44b0 2023-08-09T12:48:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f942dffb640 1 -- 172.21.15.17:0/919920889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9428005430 con 0x7f94380b44b0 2023-08-09T12:48:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f942dffb640 1 -- 172.21.15.17:0/919920889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428003830 con 0x7f94380b44b0 2023-08-09T12:48:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943815d3f0 con 0x7f94380b44b0 2023-08-09T12:48:28.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.164+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943815d9b0 con 0x7f94380b44b0 2023-08-09T12:48:28.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.165+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943815e190 con 0x7f94380b44b0 2023-08-09T12:48:28.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.167+0000 7f942dffb640 1 -- 172.21.15.17:0/919920889 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9428003990 con 0x7f94380b44b0 2023-08-09T12:48:28.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.167+0000 7f942dffb640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f941c06a050 0x7f941c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.168+0000 7f942dffb640 1 -- 172.21.15.17:0/919920889 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9428087b40 con 0x7f94380b44b0 2023-08-09T12:48:28.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.168+0000 7f942dffb640 1 -- 172.21.15.17:0/919920889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f941c0721a0 con 0x7f94380b44b0 2023-08-09T12:48:28.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.168+0000 7f943d172640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f941c06a050 0x7f941c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.169+0000 7f943d172640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f941c06a050 0x7f941c06c510 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9434036000 tx=0x7f9434008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:28.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.172+0000 7f942dffb640 1 -- 172.21.15.17:0/919920889 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9428053220 con 0x7f94380b44b0 2023-08-09T12:48:28.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.359+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f943804e390 con 0x7f94380b44b0 2023-08-09T12:48:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.360+0000 7f942dffb640 1 -- 172.21.15.17:0/919920889 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v150) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9428017030 con 0x7f94380b44b0 2023-08-09T12:48:28.363 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:48:28.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f941c06a050 msgr2=0x7f941c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f941c06a050 0x7f941c06c510 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9434036000 tx=0x7f9434008030 comp rx=0 tx=0).stop 2023-08-09T12:48:28.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94380b44b0 msgr2=0x7f9438157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94380b44b0 0x7f9438157ce0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f942800c430 tx=0x7f942800c8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 shutdown_connections 2023-08-09T12:48:28.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f941c06a050 0x7f941c06c510 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943815cac0 0x7f94380c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94380b44b0 0x7f9438157ce0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 --2- 172.21.15.17:0/919920889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94380b1fc0 0x7f9438158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 >> 172.21.15.17:0/919920889 conn(0x7f94380cf4b0 msgr2=0x7f94380b5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 shutdown_connections 2023-08-09T12:48:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.362+0000 7f943e174640 1 -- 172.21.15.17:0/919920889 wait complete. 2023-08-09T12:48:28.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:48:28.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.606+0000 7f732cf17640 1 Processor -- start 2023-08-09T12:48:28.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.606+0000 7f732cf17640 1 -- start start 2023-08-09T12:48:28.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f732cf17640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f732815aa80 0x7f73280ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f732cf17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815ae60 0x7f73280cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f732cf17640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280cd1e0 con 0x7f73280cbaf0 2023-08-09T12:48:28.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f732cf17640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73280cf1f0 con 0x7f732815aa80 2023-08-09T12:48:28.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f732cf17640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280cf4d0 con 0x7f732815ae60 2023-08-09T12:48:28.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f73277fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f732815aa80 0x7f73280ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f73277fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f732815aa80 0x7f73280ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56832/0 (socket says 172.21.15.17:56832) 2023-08-09T12:48:28.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f73277fe640 1 -- 172.21.15.17:0/3706676517 learned_addr learned my addr 172.21.15.17:0/3706676517 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:28.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f7326ffd640 1 --2- 172.21.15.17:0/3706676517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815ae60 0x7f73280cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f73277fe640 1 -- 172.21.15.17:0/3706676517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815ae60 msgr2=0x7f73280cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:28.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f73277fe640 1 --2- 172.21.15.17:0/3706676517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815ae60 0x7f73280cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.608+0000 7f73277fe640 1 -- 172.21.15.17:0/3706676517 >> v1:172.21.15.142:6789/0 conn(0x7f73280cbaf0 legacy=0x7f73280b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:28.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.609+0000 7f73277fe640 1 -- 172.21.15.17:0/3706676517 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280cf7b0 con 0x7f732815aa80 2023-08-09T12:48:28.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.610+0000 7f73277fe640 1 --2- 172.21.15.17:0/3706676517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815aa80 0x7f73280ce9a0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f7318009ea0 tx=0x7f731802bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1683ae21e5514 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:28.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.610+0000 7f73267fc640 1 -- 172.21.15.17:0/3706676517 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731802cab0 con 0x7f732815aa80 2023-08-09T12:48:28.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.610+0000 7f73267fc640 1 -- 172.21.15.17:0/3706676517 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731802cc10 con 0x7f732815aa80 2023-08-09T12:48:28.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.610+0000 7f73267fc640 1 -- 172.21.15.17:0/3706676517 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73180343f0 con 0x7f732815aa80 2023-08-09T12:48:28.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.611+0000 7f732cf17640 1 -- 172.21.15.17:0/3706676517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815aa80 msgr2=0x7f73280ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.611+0000 7f732cf17640 1 --2- 172.21.15.17:0/3706676517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815aa80 0x7f73280ce9a0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f7318009ea0 tx=0x7f731802bf10 comp rx=0 tx=0).stop 2023-08-09T12:48:28.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.611+0000 7f732cf17640 1 -- 172.21.15.17:0/3706676517 shutdown_connections 2023-08-09T12:48:28.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.611+0000 7f732cf17640 1 --2- 172.21.15.17:0/3706676517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815ae60 0x7f73280cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.611+0000 7f732cf17640 1 --2- 172.21.15.17:0/3706676517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815aa80 0x7f73280ce9a0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.611+0000 7f732cf17640 1 -- 172.21.15.17:0/3706676517 >> 172.21.15.17:0/3706676517 conn(0x7f73280b3750 msgr2=0x7f73280b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:28.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.611+0000 7f732cf17640 1 -- 172.21.15.17:0/3706676517 shutdown_connections 2023-08-09T12:48:28.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.611+0000 7f732cf17640 1 -- 172.21.15.17:0/3706676517 wait complete. 2023-08-09T12:48:28.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.613+0000 7f732cf17640 1 Processor -- start 2023-08-09T12:48:28.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.613+0000 7f732cf17640 1 -- start start 2023-08-09T12:48:28.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f732cf17640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73280cbaf0 0x7f7328156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f732cf17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815aa80 0x7f732809e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f732cf17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815ae60 0x7f7328154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f732cf17640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73281f5960 con 0x7f732815ae60 2023-08-09T12:48:28.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f732cf17640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73281f6200 con 0x7f73280cbaf0 2023-08-09T12:48:28.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f732cf17640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73281559c0 con 0x7f732815aa80 2023-08-09T12:48:28.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f7327fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815ae60 0x7f7328154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f7327fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815ae60 0x7f7328154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56840/0 (socket says 172.21.15.17:56840) 2023-08-09T12:48:28.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f7327fff640 1 -- 172.21.15.17:0/3460264687 learned_addr learned my addr 172.21.15.17:0/3460264687 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:28.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.614+0000 7f73277fe640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73280cbaf0 0x7f7328156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f7326ffd640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815aa80 0x7f732809e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f7327fff640 1 -- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815aa80 msgr2=0x7f732809e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f7327fff640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815aa80 0x7f732809e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f7327fff640 1 -- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73280cbaf0 msgr2=0x7f7328156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f7327fff640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73280cbaf0 0x7f7328156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f7327fff640 1 -- 172.21.15.17:0/3460264687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318009b30 con 0x7f732815ae60 2023-08-09T12:48:28.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f73277fe640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73280cbaf0 0x7f7328156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:28.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f7326ffd640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815aa80 0x7f732809e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:28.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f7327fff640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815ae60 0x7f7328154d50 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f732000c440 tx=0x7f732000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:28.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f730ffff640 1 -- 172.21.15.17:0/3460264687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200035f0 con 0x7f732815ae60 2023-08-09T12:48:28.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f730ffff640 1 -- 172.21.15.17:0/3460264687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320003750 con 0x7f732815ae60 2023-08-09T12:48:28.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73281565e0 con 0x7f732815ae60 2023-08-09T12:48:28.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f730ffff640 1 -- 172.21.15.17:0/3460264687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320003b00 con 0x7f732815ae60 2023-08-09T12:48:28.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.615+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73281f5e90 con 0x7f732815ae60 2023-08-09T12:48:28.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.617+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732804e390 con 0x7f732815ae60 2023-08-09T12:48:28.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.618+0000 7f730ffff640 1 -- 172.21.15.17:0/3460264687 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7320003c60 con 0x7f732815ae60 2023-08-09T12:48:28.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.619+0000 7f730ffff640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f731406a050 0x7f731406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:28.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.619+0000 7f730ffff640 1 -- 172.21.15.17:0/3460264687 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7320087800 con 0x7f732815ae60 2023-08-09T12:48:28.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.619+0000 7f730ffff640 1 -- 172.21.15.17:0/3460264687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f73140721a0 con 0x7f732815ae60 2023-08-09T12:48:28.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.619+0000 7f73277fe640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f731406a050 0x7f731406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:28.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.621+0000 7f73277fe640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f731406a050 0x7f731406c510 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7318035000 tx=0x7f7318030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:28.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.623+0000 7f730ffff640 1 -- 172.21.15.17:0/3460264687 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7320052ee0 con 0x7f732815ae60 2023-08-09T12:48:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.813+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73281f6340 con 0x7f732815ae60 2023-08-09T12:48:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.814+0000 7f730ffff640 1 -- 172.21.15.17:0/3460264687 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v150) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7320017020 con 0x7f732815ae60 2023-08-09T12:48:28.817 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:48:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f731406a050 msgr2=0x7f731406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f731406a050 0x7f731406c510 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7318035000 tx=0x7f7318030000 comp rx=0 tx=0).stop 2023-08-09T12:48:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815ae60 msgr2=0x7f7328154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815ae60 0x7f7328154d50 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f732000c440 tx=0x7f732000c900 comp rx=0 tx=0).stop 2023-08-09T12:48:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 shutdown_connections 2023-08-09T12:48:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f731406a050 0x7f731406c510 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f732815ae60 0x7f7328154d50 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f732815aa80 0x7f732809e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 --2- 172.21.15.17:0/3460264687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73280cbaf0 0x7f7328156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 >> 172.21.15.17:0/3460264687 conn(0x7f73280b3750 msgr2=0x7f73280b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 shutdown_connections 2023-08-09T12:48:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:28.817+0000 7f732cf17640 1 -- 172.21.15.17:0/3460264687 wait complete. 2023-08-09T12:48:28.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:29.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.065+0000 7fce072d7640 1 Processor -- start 2023-08-09T12:48:29.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.065+0000 7fce072d7640 1 -- start start 2023-08-09T12:48:29.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.067+0000 7fce072d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce00159bd0 0x7fce000ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.067+0000 7fce072d7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fce000b3fe0 0x7fce00070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.067+0000 7fce072d7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0006fe10 con 0x7fce000697c0 2023-08-09T12:48:29.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.067+0000 7fce072d7640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce000b11a0 con 0x7fce000b3fe0 2023-08-09T12:48:29.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.067+0000 7fce072d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce00159fb0 con 0x7fce00159bd0 2023-08-09T12:48:29.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.067+0000 7fce05ad4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fce000b3fe0 0x7fce00070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.067+0000 7fce06ad6640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fce000697c0 0x7fce000b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60192/0 (socket says 172.21.15.17:60192) 2023-08-09T12:48:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.067+0000 7fce06ad6640 1 -- 172.21.15.17:0/1740746835 learned_addr learned my addr 172.21.15.17:0/1740746835 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.068+0000 7fce062d5640 1 --2- 172.21.15.17:0/1740746835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce00159bd0 0x7fce000ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.068+0000 7fce05ad4640 1 -- 172.21.15.17:0/1740746835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce00159bd0 msgr2=0x7fce000ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:29.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.068+0000 7fce05ad4640 1 --2- 172.21.15.17:0/1740746835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce00159bd0 0x7fce000ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.068+0000 7fce05ad4640 1 -- 172.21.15.17:0/1740746835 >> v1:172.21.15.17:6789/0 conn(0x7fce000697c0 legacy=0x7fce000b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.068+0000 7fce05ad4640 1 -- 172.21.15.17:0/1740746835 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce00070970 con 0x7fce000b3fe0 2023-08-09T12:48:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.068+0000 7fce052d3640 1 -- 172.21.15.17:0/1740746835 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551529847 0 0) 0x7fce0006fe10 con 0x7fce000697c0 2023-08-09T12:48:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.069+0000 7fce05ad4640 1 --2- 172.21.15.17:0/1740746835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce000b3fe0 0x7fce00070e00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00097a0 tx=0x7fcdf002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b3f6a53d3f15fa server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.069+0000 7fce052d3640 1 -- 172.21.15.17:0/1740746835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf002d040 con 0x7fce000b3fe0 2023-08-09T12:48:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.069+0000 7fce052d3640 1 -- 172.21.15.17:0/1740746835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf0031810 con 0x7fce000b3fe0 2023-08-09T12:48:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.069+0000 7fce052d3640 1 -- 172.21.15.17:0/1740746835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0031ba0 con 0x7fce000b3fe0 2023-08-09T12:48:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.070+0000 7fce072d7640 1 -- 172.21.15.17:0/1740746835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce000b3fe0 msgr2=0x7fce00070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.070+0000 7fce072d7640 1 --2- 172.21.15.17:0/1740746835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce000b3fe0 0x7fce00070e00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00097a0 tx=0x7fcdf002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.070+0000 7fce072d7640 1 -- 172.21.15.17:0/1740746835 shutdown_connections 2023-08-09T12:48:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.070+0000 7fce072d7640 1 --2- 172.21.15.17:0/1740746835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce000b3fe0 0x7fce00070e00 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.070+0000 7fce072d7640 1 --2- 172.21.15.17:0/1740746835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce00159bd0 0x7fce000ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.070+0000 7fce072d7640 1 -- 172.21.15.17:0/1740746835 >> 172.21.15.17:0/1740746835 conn(0x7fce000b1d50 msgr2=0x7fce0006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.070+0000 7fce072d7640 1 -- 172.21.15.17:0/1740746835 shutdown_connections 2023-08-09T12:48:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.071+0000 7fce072d7640 1 -- 172.21.15.17:0/1740746835 wait complete. 2023-08-09T12:48:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.073+0000 7fce072d7640 1 Processor -- start 2023-08-09T12:48:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.073+0000 7fce072d7640 1 -- start start 2023-08-09T12:48:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce072d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce000697c0 0x7fce0015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce072d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce000b3fe0 0x7fce0015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce072d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce00159bd0 0x7fce0015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce072d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce00153960 con 0x7fce00159bd0 2023-08-09T12:48:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce072d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce000cd060 con 0x7fce000b3fe0 2023-08-09T12:48:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce072d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce000cd320 con 0x7fce000697c0 2023-08-09T12:48:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce06ad6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce00159bd0 0x7fce0015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce06ad6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce00159bd0 0x7fce0015a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56854/0 (socket says 172.21.15.17:56854) 2023-08-09T12:48:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce06ad6640 1 -- 172.21.15.17:0/1832540955 learned_addr learned my addr 172.21.15.17:0/1832540955 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce062d5640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce000697c0 0x7fce0015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.075+0000 7fce05ad4640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce000b3fe0 0x7fce0015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fce06ad6640 1 -- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce000697c0 msgr2=0x7fce0015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fce06ad6640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce000697c0 0x7fce0015cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fce06ad6640 1 -- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce000b3fe0 msgr2=0x7fce0015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fce06ad6640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce000b3fe0 0x7fce0015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fce06ad6640 1 -- 172.21.15.17:0/1832540955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf0009400 con 0x7fce00159bd0 2023-08-09T12:48:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fce06ad6640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce00159bd0 0x7fce0015a150 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800c7a0 tx=0x7fcdf800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fcdf6ffd640 1 -- 172.21.15.17:0/1832540955 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800a640 con 0x7fce00159bd0 2023-08-09T12:48:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fcdf6ffd640 1 -- 172.21.15.17:0/1832540955 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800a7a0 con 0x7fce00159bd0 2023-08-09T12:48:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fcdf6ffd640 1 -- 172.21.15.17:0/1832540955 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800abd0 con 0x7fce00159bd0 2023-08-09T12:48:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.076+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce00153bb0 con 0x7fce00159bd0 2023-08-09T12:48:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.077+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0015c760 con 0x7fce00159bd0 2023-08-09T12:48:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.078+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce001540d0 con 0x7fce00159bd0 2023-08-09T12:48:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.079+0000 7fcdf6ffd640 1 -- 172.21.15.17:0/1832540955 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcdf800ad30 con 0x7fce00159bd0 2023-08-09T12:48:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.080+0000 7fcdf6ffd640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcde406a050 0x7fcde406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.080+0000 7fcdf6ffd640 1 -- 172.21.15.17:0/1832540955 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcdf8087ab0 con 0x7fce00159bd0 2023-08-09T12:48:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.080+0000 7fcdf6ffd640 1 -- 172.21.15.17:0/1832540955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fcde40721a0 con 0x7fce00159bd0 2023-08-09T12:48:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.081+0000 7fce062d5640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcde406a050 0x7fcde406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.082+0000 7fce062d5640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcde406a050 0x7fcde406c510 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0079a0 tx=0x7fcdfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:29.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.084+0000 7fcdf6ffd640 1 -- 172.21.15.17:0/1832540955 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcdf8018020 con 0x7fce00159bd0 2023-08-09T12:48:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.313+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce0004e390 con 0x7fce00159bd0 2023-08-09T12:48:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.314+0000 7fcdf6ffd640 1 -- 172.21.15.17:0/1832540955 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7fce001540d0 con 0x7fce00159bd0 2023-08-09T12:48:29.317 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:29.317 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:48:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:48:29.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.316+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcde406a050 msgr2=0x7fcde406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.316+0000 7fce072d7640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcde406a050 0x7fcde406c510 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0079a0 tx=0x7fcdfc008040 comp rx=0 tx=0).stop 2023-08-09T12:48:29.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.316+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce00159bd0 msgr2=0x7fce0015a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.316+0000 7fce072d7640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce00159bd0 0x7fce0015a150 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800c7a0 tx=0x7fcdf800cc60 comp rx=0 tx=0).stop 2023-08-09T12:48:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.317+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 shutdown_connections 2023-08-09T12:48:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.317+0000 7fce072d7640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcde406a050 0x7fcde406c510 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.317+0000 7fce072d7640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce00159bd0 0x7fce0015a150 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.317+0000 7fce072d7640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce000b3fe0 0x7fce0015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.317+0000 7fce072d7640 1 --2- 172.21.15.17:0/1832540955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce000697c0 0x7fce0015cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.317+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 >> 172.21.15.17:0/1832540955 conn(0x7fce000b1d50 msgr2=0x7fce00158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.317+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 shutdown_connections 2023-08-09T12:48:29.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.317+0000 7fce072d7640 1 -- 172.21.15.17:0/1832540955 wait complete. 2023-08-09T12:48:29.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.560+0000 7fcd5ffff640 1 Processor -- start 2023-08-09T12:48:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.561+0000 7fcd5ffff640 1 -- start start 2023-08-09T12:48:29.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.562+0000 7fcd5ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd600b86e0 0x7fcd600cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.562+0000 7fcd5ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd600cf980 0x7fcd600d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.562+0000 7fcd5ffff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd600b5a30 con 0x7fcd60160030 2023-08-09T12:48:29.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.562+0000 7fcd5ffff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600d1110 con 0x7fcd600cf980 2023-08-09T12:48:29.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.562+0000 7fcd5ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600ceac0 con 0x7fcd600b86e0 2023-08-09T12:48:29.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.562+0000 7fcd5f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcd600cf980 0x7fcd600d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.562+0000 7fcd5effd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcd60160030 0x7fcd60160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60194/0 (socket says 172.21.15.17:60194) 2023-08-09T12:48:29.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.562+0000 7fcd5effd640 1 -- 172.21.15.17:0/287907977 learned_addr learned my addr 172.21.15.17:0/287907977 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:29.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.563+0000 7fcd5f7fe640 1 -- 172.21.15.17:0/287907977 >> v2:172.21.15.142:3300/0 conn(0x7fcd600b86e0 msgr2=0x7fcd600cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:29.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.563+0000 7fcd5f7fe640 1 --2- 172.21.15.17:0/287907977 >> v2:172.21.15.142:3300/0 conn(0x7fcd600b86e0 0x7fcd600cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.563+0000 7fcd5f7fe640 1 -- 172.21.15.17:0/287907977 >> v1:172.21.15.17:6789/0 conn(0x7fcd60160030 legacy=0x7fcd60160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.563+0000 7fcd5f7fe640 1 -- 172.21.15.17:0/287907977 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd600cfdd0 con 0x7fcd600cf980 2023-08-09T12:48:29.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.563+0000 7fcd5dffb640 1 -- 172.21.15.17:0/287907977 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996104418 0 0) 0x7fcd600b5a30 con 0x7fcd60160030 2023-08-09T12:48:29.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.564+0000 7fcd5f7fe640 1 --2- 172.21.15.17:0/287907977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd600cf980 0x7fcd600d1530 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fcd600d3b70 tx=0x7fcd5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4d2f80cd9f2d62 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:29.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.564+0000 7fcd5dffb640 1 -- 172.21.15.17:0/287907977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58031830 con 0x7fcd600cf980 2023-08-09T12:48:29.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.564+0000 7fcd5dffb640 1 -- 172.21.15.17:0/287907977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58031990 con 0x7fcd600cf980 2023-08-09T12:48:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.564+0000 7fcd5dffb640 1 -- 172.21.15.17:0/287907977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58031d20 con 0x7fcd600cf980 2023-08-09T12:48:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.565+0000 7fcd5ffff640 1 -- 172.21.15.17:0/287907977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd600cf980 msgr2=0x7fcd600d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.565+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/287907977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd600cf980 0x7fcd600d1530 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fcd600d3b70 tx=0x7fcd5802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.565+0000 7fcd5ffff640 1 -- 172.21.15.17:0/287907977 shutdown_connections 2023-08-09T12:48:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.565+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/287907977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd600cf980 0x7fcd600d1530 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.565+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/287907977 >> v2:172.21.15.142:3300/0 conn(0x7fcd600b86e0 0x7fcd600cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.565+0000 7fcd5ffff640 1 -- 172.21.15.17:0/287907977 >> 172.21.15.17:0/287907977 conn(0x7fcd600697c0 msgr2=0x7fcd60069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.565+0000 7fcd5ffff640 1 -- 172.21.15.17:0/287907977 shutdown_connections 2023-08-09T12:48:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.565+0000 7fcd5ffff640 1 -- 172.21.15.17:0/287907977 wait complete. 2023-08-09T12:48:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.567+0000 7fcd5ffff640 1 Processor -- start 2023-08-09T12:48:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.567+0000 7fcd5ffff640 1 -- start start 2023-08-09T12:48:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd600b86e0 0x7fcd60157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd600cf980 0x7fcd600cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd60160030 0x7fcd600ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5ffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600b2570 con 0x7fcd60160030 2023-08-09T12:48:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600b2850 con 0x7fcd600cf980 2023-08-09T12:48:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600b2b30 con 0x7fcd600b86e0 2023-08-09T12:48:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd60160030 0x7fcd600ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd60160030 0x7fcd600ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56860/0 (socket says 172.21.15.17:56860) 2023-08-09T12:48:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.568+0000 7fcd5f7fe640 1 -- 172.21.15.17:0/1982465254 learned_addr learned my addr 172.21.15.17:0/1982465254 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd5f7fe640 1 -- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd600b86e0 msgr2=0x7fcd60157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd5f7fe640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd600b86e0 0x7fcd60157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd5f7fe640 1 -- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd600cf980 msgr2=0x7fcd600cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd5e7fc640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd600cf980 0x7fcd600cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd5f7fe640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd600cf980 0x7fcd600cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd5f7fe640 1 -- 172.21.15.17:0/1982465254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58009400 con 0x7fcd60160030 2023-08-09T12:48:29.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd5f7fe640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd60160030 0x7fcd600ca670 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fcd5802bee0 tx=0x7fcd580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:29.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd477fe640 1 -- 172.21.15.17:0/1982465254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5803b9f0 con 0x7fcd60160030 2023-08-09T12:48:29.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd477fe640 1 -- 172.21.15.17:0/1982465254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5803bb50 con 0x7fcd60160030 2023-08-09T12:48:29.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd477fe640 1 -- 172.21.15.17:0/1982465254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580453f0 con 0x7fcd60160030 2023-08-09T12:48:29.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.569+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd600b2e10 con 0x7fcd60160030 2023-08-09T12:48:29.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.570+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd600c8750 con 0x7fcd60160030 2023-08-09T12:48:29.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.571+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd600d0cf0 con 0x7fcd60160030 2023-08-09T12:48:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.572+0000 7fcd477fe640 1 -- 172.21.15.17:0/1982465254 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd58045550 con 0x7fcd60160030 2023-08-09T12:48:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.573+0000 7fcd477fe640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4c06a050 0x7fcd4c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.573+0000 7fcd477fe640 1 -- 172.21.15.17:0/1982465254 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd580aa760 con 0x7fcd60160030 2023-08-09T12:48:29.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.574+0000 7fcd477fe640 1 -- 172.21.15.17:0/1982465254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fcd4c0721a0 con 0x7fcd60160030 2023-08-09T12:48:29.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.574+0000 7fcd5effd640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4c06a050 0x7fcd4c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:29.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.575+0000 7fcd5effd640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4c06a050 0x7fcd4c06c510 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fcd50005c00 tx=0x7fcd500015e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:29.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.578+0000 7fcd477fe640 1 -- 172.21.15.17:0/1982465254 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcd58075ed0 con 0x7fcd60160030 2023-08-09T12:48:29.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.762+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd600cfdd0 con 0x7fcd60160030 2023-08-09T12:48:29.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.764+0000 7fcd477fe640 1 -- 172.21.15.17:0/1982465254 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+18365 (secure 0 0 0) 0x7fcd600cfdd0 con 0x7fcd60160030 2023-08-09T12:48:29.767 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:29.767 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":150,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:23.848416+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:47:36.431201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-09T12:47:37.108075+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:29.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.766+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4c06a050 msgr2=0x7fcd4c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.766+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4c06a050 0x7fcd4c06c510 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fcd50005c00 tx=0x7fcd500015e0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.766+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd60160030 msgr2=0x7fcd600ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:29.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.766+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd60160030 0x7fcd600ca670 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fcd5802bee0 tx=0x7fcd580046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.767+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 shutdown_connections 2023-08-09T12:48:29.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.767+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcd4c06a050 0x7fcd4c06c510 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.767+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd60160030 0x7fcd600ca670 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.767+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd600cf980 0x7fcd600cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.767+0000 7fcd5ffff640 1 --2- 172.21.15.17:0/1982465254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd600b86e0 0x7fcd60157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:29.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.767+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 >> 172.21.15.17:0/1982465254 conn(0x7fcd600697c0 msgr2=0x7fcd600d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:29.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.767+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 shutdown_connections 2023-08-09T12:48:29.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:29.767+0000 7fcd5ffff640 1 -- 172.21.15.17:0/1982465254 wait complete. 2023-08-09T12:48:29.789 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:48:29.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:30.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.009+0000 7ff183fff640 1 Processor -- start 2023-08-09T12:48:30.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.009+0000 7ff183fff640 1 -- start start 2023-08-09T12:48:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.010+0000 7ff183fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff1840b86e0 0x7ff1840cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.011+0000 7ff183fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1840b5a30 con 0x7ff184160030 2023-08-09T12:48:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.011+0000 7ff183fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1840cfdd0 con 0x7ff1840cf980 2023-08-09T12:48:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.011+0000 7ff183fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1840d1110 con 0x7ff1840b86e0 2023-08-09T12:48:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.011+0000 7ff17a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff1840b86e0 0x7ff1840cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.011+0000 7ff17a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff1840b86e0 0x7ff1840cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56862/0 (socket says 172.21.15.17:56862) 2023-08-09T12:48:30.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.011+0000 7ff17a7fc640 1 -- 172.21.15.17:0/3923212056 learned_addr learned my addr 172.21.15.17:0/3923212056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:30.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.011+0000 7ff182ffd640 1 --1- 172.21.15.17:0/3923212056 >> v1:172.21.15.17:6789/0 conn(0x7ff184160030 0x7ff184160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60198/0 (socket says 172.21.15.17:60198) 2023-08-09T12:48:30.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.012+0000 7ff17a7fc640 1 -- 172.21.15.17:0/3923212056 >> v1:172.21.15.142:6789/0 conn(0x7ff1840cf980 legacy=0x7ff1840d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:30.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.012+0000 7ff17a7fc640 1 -- 172.21.15.17:0/3923212056 >> v1:172.21.15.17:6789/0 conn(0x7ff184160030 legacy=0x7ff184160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.012+0000 7ff17a7fc640 1 -- 172.21.15.17:0/3923212056 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1840d0d70 con 0x7ff1840b86e0 2023-08-09T12:48:30.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.013+0000 7ff17a7fc640 1 --2- 172.21.15.17:0/3923212056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840b86e0 0x7ff1840cf440 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009870 tx=0x7ff16c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d639bc8f79d6b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.013+0000 7ff1827fc640 1 -- 172.21.15.17:0/3923212056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c030860 con 0x7ff1840b86e0 2023-08-09T12:48:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.013+0000 7ff1827fc640 1 -- 172.21.15.17:0/3923212056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c0309c0 con 0x7ff1840b86e0 2023-08-09T12:48:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.013+0000 7ff1827fc640 1 -- 172.21.15.17:0/3923212056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c030d50 con 0x7ff1840b86e0 2023-08-09T12:48:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.014+0000 7ff183fff640 1 -- 172.21.15.17:0/3923212056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840b86e0 msgr2=0x7ff1840cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.014+0000 7ff183fff640 1 --2- 172.21.15.17:0/3923212056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840b86e0 0x7ff1840cf440 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009870 tx=0x7ff16c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.014+0000 7ff183fff640 1 -- 172.21.15.17:0/3923212056 shutdown_connections 2023-08-09T12:48:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.014+0000 7ff183fff640 1 --2- 172.21.15.17:0/3923212056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840b86e0 0x7ff1840cf440 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.014+0000 7ff183fff640 1 -- 172.21.15.17:0/3923212056 >> 172.21.15.17:0/3923212056 conn(0x7ff1840697c0 msgr2=0x7ff184069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.014+0000 7ff183fff640 1 -- 172.21.15.17:0/3923212056 shutdown_connections 2023-08-09T12:48:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.014+0000 7ff183fff640 1 -- 172.21.15.17:0/3923212056 wait complete. 2023-08-09T12:48:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.016+0000 7ff183fff640 1 Processor -- start 2023-08-09T12:48:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.016+0000 7ff183fff640 1 -- start start 2023-08-09T12:48:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff183fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1840b86e0 0x7ff1840cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff183fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840cf980 0x7ff1840b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff183fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff184160030 0x7ff184154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff183fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840ca680 con 0x7ff1840cf980 2023-08-09T12:48:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff183fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840b3420 con 0x7ff1840b86e0 2023-08-09T12:48:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff183fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840b3610 con 0x7ff184160030 2023-08-09T12:48:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff17a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840cf980 0x7ff1840b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff17a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840cf980 0x7ff1840b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56870/0 (socket says 172.21.15.17:56870) 2023-08-09T12:48:30.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.017+0000 7ff17a7fc640 1 -- 172.21.15.17:0/2703541944 learned_addr learned my addr 172.21.15.17:0/2703541944 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:30.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff182ffd640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1840b86e0 0x7ff1840cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff17a7fc640 1 -- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff184160030 msgr2=0x7ff184154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff1837fe640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff184160030 0x7ff184154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff17a7fc640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff184160030 0x7ff184154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff17a7fc640 1 -- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1840b86e0 msgr2=0x7ff1840cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff17a7fc640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1840b86e0 0x7ff1840cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff17a7fc640 1 -- 172.21.15.17:0/2703541944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c0094d0 con 0x7ff1840cf980 2023-08-09T12:48:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff1837fe640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff184160030 0x7ff184154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.018+0000 7ff17a7fc640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840cf980 0x7ff1840b2ee0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff16c000c00 tx=0x7ff16c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.019+0000 7ff180ff9640 1 -- 172.21.15.17:0/2703541944 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c030810 con 0x7ff1840cf980 2023-08-09T12:48:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.019+0000 7ff180ff9640 1 -- 172.21.15.17:0/2703541944 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c043400 con 0x7ff1840cf980 2023-08-09T12:48:30.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.019+0000 7ff180ff9640 1 -- 172.21.15.17:0/2703541944 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0437b0 con 0x7ff1840cf980 2023-08-09T12:48:30.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.019+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1840c9ce0 con 0x7ff1840cf980 2023-08-09T12:48:30.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.019+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1840ca2a0 con 0x7ff1840cf980 2023-08-09T12:48:30.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.020+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1840ca7c0 con 0x7ff1840cf980 2023-08-09T12:48:30.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.021+0000 7ff180ff9640 1 -- 172.21.15.17:0/2703541944 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff16c043910 con 0x7ff1840cf980 2023-08-09T12:48:30.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.022+0000 7ff180ff9640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff16406a050 0x7ff16406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.022+0000 7ff180ff9640 1 -- 172.21.15.17:0/2703541944 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff16c03e070 con 0x7ff1840cf980 2023-08-09T12:48:30.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.022+0000 7ff180ff9640 1 -- 172.21.15.17:0/2703541944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7ff1640721a0 con 0x7ff1840cf980 2023-08-09T12:48:30.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.023+0000 7ff182ffd640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff16406a050 0x7ff16406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.024+0000 7ff182ffd640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff16406a050 0x7ff16406c510 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff174007ef0 tx=0x7ff174007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:30.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.026+0000 7ff180ff9640 1 -- 172.21.15.17:0/2703541944 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff16c034060 con 0x7ff1840cf980 2023-08-09T12:48:30.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.257+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1840cfdd0 con 0x7ff1840cf980 2023-08-09T12:48:30.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.258+0000 7ff180ff9640 1 -- 172.21.15.17:0/2703541944 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7ff1840cfdd0 con 0x7ff1840cf980 2023-08-09T12:48:30.262 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:30.262 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:48:30.262 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:48:30.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff16406a050 msgr2=0x7ff16406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff16406a050 0x7ff16406c510 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff174007ef0 tx=0x7ff174007e80 comp rx=0 tx=0).stop 2023-08-09T12:48:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840cf980 msgr2=0x7ff1840b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840cf980 0x7ff1840b2ee0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff16c000c00 tx=0x7ff16c004730 comp rx=0 tx=0).stop 2023-08-09T12:48:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 shutdown_connections 2023-08-09T12:48:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff16406a050 0x7ff16406c510 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff184160030 0x7ff184154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1840cf980 0x7ff1840b2ee0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 --2- 172.21.15.17:0/2703541944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1840b86e0 0x7ff1840cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 >> 172.21.15.17:0/2703541944 conn(0x7ff1840697c0 msgr2=0x7ff18415db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 shutdown_connections 2023-08-09T12:48:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.261+0000 7ff183fff640 1 -- 172.21.15.17:0/2703541944 wait complete. 2023-08-09T12:48:30.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:30.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.513+0000 7f40a04cc640 1 Processor -- start 2023-08-09T12:48:30.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.513+0000 7f40a04cc640 1 -- start start 2023-08-09T12:48:30.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.515+0000 7f40a04cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4098163c10 0x7f4098166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.515+0000 7f40a04cc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409806c990 con 0x7f40980adc40 2023-08-09T12:48:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.515+0000 7f40a04cc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980b2250 con 0x7f40980b3b40 2023-08-09T12:48:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.515+0000 7f40a04cc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40980ae020 con 0x7f4098163c10 2023-08-09T12:48:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.515+0000 7f409e268640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f40980adc40 0x7f409806c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60204/0 (socket says 172.21.15.17:60204) 2023-08-09T12:48:30.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.515+0000 7f409e268640 1 -- 172.21.15.17:0/1739355060 learned_addr learned my addr 172.21.15.17:0/1739355060 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:30.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409ea69640 1 --2- 172.21.15.17:0/1739355060 >> v2:172.21.15.142:3300/0 conn(0x7f4098163c10 0x7f4098166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585966698 0 0) 0x7f409806c990 con 0x7f40980adc40 2023-08-09T12:48:30.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4084003520 con 0x7f40980adc40 2023-08-09T12:48:30.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3906524661 0 0) 0x7f4084003520 con 0x7f40980adc40 2023-08-09T12:48:30.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 >> v2:172.21.15.142:3300/0 conn(0x7f4098163c10 msgr2=0x7f4098166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:30.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409d266640 1 --2- 172.21.15.17:0/1739355060 >> v2:172.21.15.142:3300/0 conn(0x7f4098163c10 0x7f4098166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 >> v1:172.21.15.142:6789/0 conn(0x7f40980b3b40 legacy=0x7f40980b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980b2530 con 0x7f40980adc40 2023-08-09T12:48:30.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.516+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f4094001670 con 0x7f40980adc40 2023-08-09T12:48:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 >> v1:172.21.15.17:6789/0 conn(0x7f40980adc40 legacy=0x7f409806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409d266640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4084003970 0x7f4084003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409d266640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40840047c0 0x7f4084004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409d266640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4084005180 0x7f408400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40980ae020 con 0x7f40840047c0 2023-08-09T12:48:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408400c120 con 0x7f4084005180 2023-08-09T12:48:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408400c2e0 con 0x7f4084003970 2023-08-09T12:48:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409da67640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40840047c0 0x7f4084004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409e268640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4084003970 0x7f4084003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409da67640 1 -- 172.21.15.17:0/1739355060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4084003970 msgr2=0x7f4084003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409da67640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4084003970 0x7f4084003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409da67640 1 -- 172.21.15.17:0/1739355060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4084005180 msgr2=0x7f408400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409da67640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4084005180 0x7f408400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409da67640 1 -- 172.21.15.17:0/1739355060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4084003520 con 0x7f40840047c0 2023-08-09T12:48:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409e268640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4084003970 0x7f4084003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.517+0000 7f409ea69640 1 -- 172.21.15.17:0/1739355060 reap_dead start 2023-08-09T12:48:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.518+0000 7f409da67640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40840047c0 0x7f4084004c40 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4088001770 tx=0x7f40840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba1d569ccfd4ca3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.519+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40880052d0 con 0x7f40840047c0 2023-08-09T12:48:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.519+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408802e050 con 0x7f40840047c0 2023-08-09T12:48:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.519+0000 7f409d266640 1 -- 172.21.15.17:0/1739355060 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088003640 con 0x7f40840047c0 2023-08-09T12:48:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.519+0000 7f40a04cc640 1 -- 172.21.15.17:0/1739355060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40840047c0 msgr2=0x7f4084004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.519+0000 7f40a04cc640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40840047c0 0x7f4084004c40 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4088001770 tx=0x7f40840057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.520+0000 7f40a04cc640 1 -- 172.21.15.17:0/1739355060 shutdown_connections 2023-08-09T12:48:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.520+0000 7f40a04cc640 1 --2- 172.21.15.17:0/1739355060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40840047c0 0x7f4084004c40 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.520+0000 7f40a04cc640 1 -- 172.21.15.17:0/1739355060 >> 172.21.15.17:0/1739355060 conn(0x7f40980cb1b0 msgr2=0x7f40980cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.520+0000 7f40a04cc640 1 -- 172.21.15.17:0/1739355060 shutdown_connections 2023-08-09T12:48:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.520+0000 7f40a04cc640 1 -- 172.21.15.17:0/1739355060 wait complete. 2023-08-09T12:48:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.521+0000 7f40a04cc640 1 Processor -- start 2023-08-09T12:48:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.522+0000 7f40a04cc640 1 -- start start 2023-08-09T12:48:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f40a04cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40840047c0 0x7f40981f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f40a04cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40980c21d0 0x7f40980c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f40a04cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f409815d820 0x7f409815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f40a04cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40980c39a0 con 0x7f40980c21d0 2023-08-09T12:48:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f40a04cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409815e1e0 con 0x7f40840047c0 2023-08-09T12:48:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f40a04cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4098069b20 con 0x7f409815d820 2023-08-09T12:48:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409da67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40980c21d0 0x7f40980c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409da67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40980c21d0 0x7f40980c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56876/0 (socket says 172.21.15.17:56876) 2023-08-09T12:48:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409da67640 1 -- 172.21.15.17:0/2601038224 learned_addr learned my addr 172.21.15.17:0/2601038224 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409e268640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40840047c0 0x7f40981f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409da67640 1 -- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f409815d820 msgr2=0x7f409815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409ea69640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f409815d820 0x7f409815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409da67640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f409815d820 0x7f409815dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409da67640 1 -- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40840047c0 msgr2=0x7f40981f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409da67640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40840047c0 0x7f40981f4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.523+0000 7f409da67640 1 -- 172.21.15.17:0/2601038224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980c2d20 con 0x7f40980c21d0 2023-08-09T12:48:30.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.524+0000 7f409da67640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40980c21d0 0x7f40980c2650 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f4088005040 tx=0x7f4088001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:30.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.524+0000 7f408effd640 1 -- 172.21.15.17:0/2601038224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088006ea0 con 0x7f40980c21d0 2023-08-09T12:48:30.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.524+0000 7f408effd640 1 -- 172.21.15.17:0/2601038224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4088007a80 con 0x7f40980c21d0 2023-08-09T12:48:30.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.524+0000 7f408effd640 1 -- 172.21.15.17:0/2601038224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088007470 con 0x7f40980c21d0 2023-08-09T12:48:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.524+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40980c3000 con 0x7f40980c21d0 2023-08-09T12:48:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.524+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40980c35c0 con 0x7f40980c21d0 2023-08-09T12:48:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.525+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4098067a80 con 0x7f40980c21d0 2023-08-09T12:48:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.526+0000 7f408effd640 1 -- 172.21.15.17:0/2601038224 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f40880075d0 con 0x7f40980c21d0 2023-08-09T12:48:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.528+0000 7f408effd640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f407c06a050 0x7f407c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.528+0000 7f408effd640 1 -- 172.21.15.17:0/2601038224 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40880aa740 con 0x7f40980c21d0 2023-08-09T12:48:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.528+0000 7f408effd640 1 -- 172.21.15.17:0/2601038224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f407c0721a0 con 0x7f40980c21d0 2023-08-09T12:48:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.529+0000 7f409e268640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f407c06a050 0x7f407c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.530+0000 7f409e268640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f407c06a050 0x7f407c06c510 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f40980cab50 tx=0x7f4094009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.532+0000 7f408effd640 1 -- 172.21.15.17:0/2601038224 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4088079820 con 0x7f40980c21d0 2023-08-09T12:48:30.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.766+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f409806ed40 con 0x7f40980c21d0 2023-08-09T12:48:30.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.766+0000 7f408effd640 1 -- 172.21.15.17:0/2601038224 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f408804b030 con 0x7f40980c21d0 2023-08-09T12:48:30.770 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:30.770 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:47:38.101574+0000","modified":"2023-08-09T12:47:41.839924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7992":{"gid":7992,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4116172429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":4116172429},{"type":"v1","addr":"172.21.15.17:6835","nonce":4116172429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-09T12:48:30.770 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 67 2023-08-09T12:48:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f407c06a050 msgr2=0x7f407c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f407c06a050 0x7f407c06c510 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f40980cab50 tx=0x7f4094009040 comp rx=0 tx=0).stop 2023-08-09T12:48:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40980c21d0 msgr2=0x7f40980c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40980c21d0 0x7f40980c2650 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f4088005040 tx=0x7f4088001170 comp rx=0 tx=0).stop 2023-08-09T12:48:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 shutdown_connections 2023-08-09T12:48:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f407c06a050 0x7f407c06c510 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f409815d820 0x7f409815dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40980c21d0 0x7f40980c2650 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 --2- 172.21.15.17:0/2601038224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40840047c0 0x7f40981f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.769+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 >> 172.21.15.17:0/2601038224 conn(0x7f40980cb1b0 msgr2=0x7f409806f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.770+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 shutdown_connections 2023-08-09T12:48:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:30.770+0000 7f40a04cc640 1 -- 172.21.15.17:0/2601038224 wait complete. 2023-08-09T12:48:30.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.010+0000 7fe7a9e41640 1 Processor -- start 2023-08-09T12:48:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.011+0000 7fe7a9e41640 1 -- start start 2023-08-09T12:48:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.012+0000 7fe7a9e41640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7a4072ac0 0x7fe7a406a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.012+0000 7fe7a9e41640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a40cada0 con 0x7fe7a4072ea0 2023-08-09T12:48:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.012+0000 7fe7a9e41640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a406b000 con 0x7fe7a415c680 2023-08-09T12:48:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.012+0000 7fe7a9e41640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a406fb40 con 0x7fe7a4072ac0 2023-08-09T12:48:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.013+0000 7fe7a3fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe7a4072ea0 0x7fe7a406a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60212/0 (socket says 172.21.15.17:60212) 2023-08-09T12:48:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.013+0000 7fe7a3fff640 1 -- 172.21.15.17:0/233702142 learned_addr learned my addr 172.21.15.17:0/233702142 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.013+0000 7fe7a8e3f640 1 --2- 172.21.15.17:0/233702142 >> v2:172.21.15.142:3300/0 conn(0x7fe7a4072ac0 0x7fe7a406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.013+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362369067 0 0) 0x7fe7a40cada0 con 0x7fe7a4072ea0 2023-08-09T12:48:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.013+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe794003520 con 0x7fe7a4072ea0 2023-08-09T12:48:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1060652122 0 0) 0x7fe794003520 con 0x7fe7a4072ea0 2023-08-09T12:48:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 >> v2:172.21.15.142:3300/0 conn(0x7fe7a4072ac0 msgr2=0x7fe7a406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 --2- 172.21.15.17:0/233702142 >> v2:172.21.15.142:3300/0 conn(0x7fe7a4072ac0 0x7fe7a406a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 >> v1:172.21.15.142:6789/0 conn(0x7fe7a415c680 legacy=0x7fe7a415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a406fe20 con 0x7fe7a4072ea0 2023-08-09T12:48:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe790001670 con 0x7fe7a4072ea0 2023-08-09T12:48:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a8e3f640 1 --2- 172.21.15.17:0/233702142 >> v2:172.21.15.142:3300/0 conn(0x7fe7a4072ac0 0x7fe7a406a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:48:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 >> v1:172.21.15.17:6789/0 conn(0x7fe7a4072ea0 legacy=0x7fe7a406a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794003970 0x7fe794003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7940047c0 0x7fe794004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe794005180 0x7fe79400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a406fb40 con 0x7fe794005180 2023-08-09T12:48:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79400c020 con 0x7fe7940047c0 2023-08-09T12:48:31.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79400c1e0 con 0x7fe794003970 2023-08-09T12:48:31.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a9640640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe794005180 0x7fe79400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.014+0000 7fe7a3fff640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7940047c0 0x7fe794004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.015+0000 7fe7a8e3f640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794003970 0x7fe794003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.015+0000 7fe7a9640640 1 -- 172.21.15.17:0/233702142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794003970 msgr2=0x7fe794003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:31.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.015+0000 7fe7a9640640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794003970 0x7fe794003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.015+0000 7fe7a9640640 1 -- 172.21.15.17:0/233702142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7940047c0 msgr2=0x7fe794004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:31.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.015+0000 7fe7a9640640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7940047c0 0x7fe794004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.015+0000 7fe7a9640640 1 -- 172.21.15.17:0/233702142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794003520 con 0x7fe794005180 2023-08-09T12:48:31.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.016+0000 7fe7a9640640 1 -- 172.21.15.17:0/233702142 reap_dead start 2023-08-09T12:48:31.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.016+0000 7fe7a9640640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe794005180 0x7fe79400b980 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fe79c001e50 tx=0x7fe7940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a1ed30c72fb091 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.016+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c003b70 con 0x7fe794005180 2023-08-09T12:48:31.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.016+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c003cf0 con 0x7fe794005180 2023-08-09T12:48:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.016+0000 7fe7a37fe640 1 -- 172.21.15.17:0/233702142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c005310 con 0x7fe794005180 2023-08-09T12:48:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.017+0000 7fe7a9e41640 1 -- 172.21.15.17:0/233702142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe794005180 msgr2=0x7fe79400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.017+0000 7fe7a9e41640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe794005180 0x7fe79400b980 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fe79c001e50 tx=0x7fe7940057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.017+0000 7fe7a9e41640 1 -- 172.21.15.17:0/233702142 shutdown_connections 2023-08-09T12:48:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.017+0000 7fe7a9e41640 1 --2- 172.21.15.17:0/233702142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe794005180 0x7fe79400b980 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.017+0000 7fe7a9e41640 1 -- 172.21.15.17:0/233702142 >> 172.21.15.17:0/233702142 conn(0x7fe7a40cc430 msgr2=0x7fe7a40cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.017+0000 7fe7a9e41640 1 -- 172.21.15.17:0/233702142 shutdown_connections 2023-08-09T12:48:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.017+0000 7fe7a9e41640 1 -- 172.21.15.17:0/233702142 wait complete. 2023-08-09T12:48:31.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.019+0000 7fe7a9e41640 1 Processor -- start 2023-08-09T12:48:31.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.019+0000 7fe7a9e41640 1 -- start start 2023-08-09T12:48:31.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a9e41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794005180 0x7fe7a41f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a9e41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a414ebc0 0x7fe7a415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a9e41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7a415aa40 0x7fe7a414b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a9e41640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41f5ea0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a9e41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a415f720 con 0x7fe7a415aa40 2023-08-09T12:48:31.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a9e41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41f6110 con 0x7fe794005180 2023-08-09T12:48:31.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a414ebc0 0x7fe7a415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a414ebc0 0x7fe7a415ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56884/0 (socket says 172.21.15.17:56884) 2023-08-09T12:48:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.020+0000 7fe7a3fff640 1 -- 172.21.15.17:0/3227950342 learned_addr learned my addr 172.21.15.17:0/3227950342 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a3fff640 1 -- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794005180 msgr2=0x7fe7a41f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a9640640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7a415aa40 0x7fe7a414b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a8e3f640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794005180 0x7fe7a41f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a3fff640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794005180 0x7fe7a41f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a3fff640 1 -- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7a415aa40 msgr2=0x7fe7a414b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a3fff640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7a415aa40 0x7fe7a414b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a3fff640 1 -- 172.21.15.17:0/3227950342 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a41f63f0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a3fff640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a414ebc0 0x7fe7a415ee20 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe79000e6c0 tx=0x7fe79000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a17fa640 1 -- 172.21.15.17:0/3227950342 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79000c6c0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a17fa640 1 -- 172.21.15.17:0/3227950342 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79000c840 con 0x7fe7a414ebc0 2023-08-09T12:48:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a17fa640 1 -- 172.21.15.17:0/3227950342 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79000cbf0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.021+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a415fa00 con 0x7fe7a414ebc0 2023-08-09T12:48:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.022+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a415aec0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.023+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a404e390 con 0x7fe7a414ebc0 2023-08-09T12:48:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.024+0000 7fe7a17fa640 1 -- 172.21.15.17:0/3227950342 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe79000cd50 con 0x7fe7a414ebc0 2023-08-09T12:48:31.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.024+0000 7fe7a17fa640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe78806a050 0x7fe78806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.025+0000 7fe7a17fa640 1 -- 172.21.15.17:0/3227950342 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe790088560 con 0x7fe7a414ebc0 2023-08-09T12:48:31.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.025+0000 7fe7a17fa640 1 -- 172.21.15.17:0/3227950342 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fe7880721a0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.025+0000 7fe7a8e3f640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe78806a050 0x7fe78806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.026+0000 7fe7a8e3f640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe78806a050 0x7fe78806c510 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe798009ac0 tx=0x7fe798008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.029+0000 7fe7a17fa640 1 -- 172.21.15.17:0/3227950342 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe790053bb0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.225+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7a415b0e0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.228+0000 7fe7a17fa640 1 -- 172.21.15.17:0/3227950342 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+18365 (secure 0 0 0) 0x7fe7900571d0 con 0x7fe7a414ebc0 2023-08-09T12:48:31.232 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:31.232 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":150,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:23.848416+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:47:36.431201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-09T12:47:37.108075+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe78806a050 msgr2=0x7fe78806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe78806a050 0x7fe78806c510 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe798009ac0 tx=0x7fe798008040 comp rx=0 tx=0).stop 2023-08-09T12:48:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a414ebc0 msgr2=0x7fe7a415ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a414ebc0 0x7fe7a415ee20 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe79000e6c0 tx=0x7fe79000eb80 comp rx=0 tx=0).stop 2023-08-09T12:48:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 shutdown_connections 2023-08-09T12:48:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe78806a050 0x7fe78806c510 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7a415aa40 0x7fe7a414b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a414ebc0 0x7fe7a415ee20 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 --2- 172.21.15.17:0/3227950342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe794005180 0x7fe7a41f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 >> 172.21.15.17:0/3227950342 conn(0x7fe7a40cc430 msgr2=0x7fe7a40ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 shutdown_connections 2023-08-09T12:48:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.231+0000 7fe7a9e41640 1 -- 172.21.15.17:0/3227950342 wait complete. 2023-08-09T12:48:31.253 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:48:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.478+0000 7fe79fa3f640 1 Processor -- start 2023-08-09T12:48:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.478+0000 7fe79fa3f640 1 -- start start 2023-08-09T12:48:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79fa3f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7980adc40 0x7fe79806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79fa3f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7980cc630 0x7fe7980ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79fa3f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7980b2250 con 0x7fe7980b3b40 2023-08-09T12:48:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79fa3f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7980ae020 con 0x7fe7980cc630 2023-08-09T12:48:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79fa3f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7980b2530 con 0x7fe7980adc40 2023-08-09T12:48:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79dfdc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7980cc630 0x7fe7980ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79dfdc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7980cc630 0x7fe7980ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56894/0 (socket says 172.21.15.17:56894) 2023-08-09T12:48:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79dfdc640 1 -- 172.21.15.17:0/358440510 learned_addr learned my addr 172.21.15.17:0/358440510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.480+0000 7fe79cfda640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe7980b3b40 0x7fe7980b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60214/0 (socket says 172.21.15.17:60214) 2023-08-09T12:48:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.481+0000 7fe79d7db640 1 --2- 172.21.15.17:0/358440510 >> v2:172.21.15.142:3300/0 conn(0x7fe7980adc40 0x7fe79806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.481+0000 7fe79dfdc640 1 -- 172.21.15.17:0/358440510 >> v2:172.21.15.142:3300/0 conn(0x7fe7980adc40 msgr2=0x7fe79806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.481+0000 7fe79dfdc640 1 --2- 172.21.15.17:0/358440510 >> v2:172.21.15.142:3300/0 conn(0x7fe7980adc40 0x7fe79806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.481+0000 7fe79dfdc640 1 -- 172.21.15.17:0/358440510 >> v1:172.21.15.17:6789/0 conn(0x7fe7980b3b40 legacy=0x7fe7980b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.481+0000 7fe78ffff640 1 -- 172.21.15.17:0/358440510 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126694416 0 0) 0x7fe7980b2250 con 0x7fe7980b3b40 2023-08-09T12:48:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.481+0000 7fe79dfdc640 1 -- 172.21.15.17:0/358440510 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79806fe80 con 0x7fe7980cc630 2023-08-09T12:48:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.482+0000 7fe79dfdc640 1 --2- 172.21.15.17:0/358440510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980cc630 0x7fe7980ccaa0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fe7980b1320 tx=0x7fe79002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8300a37b35a08d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.482+0000 7fe78ffff640 1 -- 172.21.15.17:0/358440510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790031870 con 0x7fe7980cc630 2023-08-09T12:48:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe78ffff640 1 -- 172.21.15.17:0/358440510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7900319d0 con 0x7fe7980cc630 2023-08-09T12:48:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe78ffff640 1 -- 172.21.15.17:0/358440510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790031d60 con 0x7fe7980cc630 2023-08-09T12:48:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe79fa3f640 1 -- 172.21.15.17:0/358440510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980cc630 msgr2=0x7fe7980ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/358440510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980cc630 0x7fe7980ccaa0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fe7980b1320 tx=0x7fe79002b910 comp rx=0 tx=0).stop 2023-08-09T12:48:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe79fa3f640 1 -- 172.21.15.17:0/358440510 shutdown_connections 2023-08-09T12:48:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/358440510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980cc630 0x7fe7980ccaa0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/358440510 >> v2:172.21.15.142:3300/0 conn(0x7fe7980adc40 0x7fe79806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe79fa3f640 1 -- 172.21.15.17:0/358440510 >> 172.21.15.17:0/358440510 conn(0x7fe7980cb1b0 msgr2=0x7fe7980cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:31.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe79fa3f640 1 -- 172.21.15.17:0/358440510 shutdown_connections 2023-08-09T12:48:31.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.483+0000 7fe79fa3f640 1 -- 172.21.15.17:0/358440510 wait complete. 2023-08-09T12:48:31.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.485+0000 7fe79fa3f640 1 Processor -- start 2023-08-09T12:48:31.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.485+0000 7fe79fa3f640 1 -- start start 2023-08-09T12:48:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.486+0000 7fe79fa3f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980adc40 0x7fe7980c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.486+0000 7fe79fa3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980b3b40 0x7fe798159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.486+0000 7fe79fa3f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980cc630 0x7fe7980c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.486+0000 7fe79fa3f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980c68d0 con 0x7fe7980b3b40 2023-08-09T12:48:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.486+0000 7fe79fa3f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980c65f0 con 0x7fe7980adc40 2023-08-09T12:48:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.486+0000 7fe79fa3f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980c3070 con 0x7fe7980cc630 2023-08-09T12:48:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.486+0000 7fe79cfda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980b3b40 0x7fe798159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79cfda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980b3b40 0x7fe798159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56900/0 (socket says 172.21.15.17:56900) 2023-08-09T12:48:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79cfda640 1 -- 172.21.15.17:0/2771750086 learned_addr learned my addr 172.21.15.17:0/2771750086 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79d7db640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980adc40 0x7fe7980c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79dfdc640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980cc630 0x7fe7980c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79cfda640 1 -- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980cc630 msgr2=0x7fe7980c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79cfda640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980cc630 0x7fe7980c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79cfda640 1 -- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980adc40 msgr2=0x7fe7980c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79cfda640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980adc40 0x7fe7980c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79cfda640 1 -- 172.21.15.17:0/2771750086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900094d0 con 0x7fe7980b3b40 2023-08-09T12:48:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79d7db640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980adc40 0x7fe7980c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79dfdc640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980cc630 0x7fe7980c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:31.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.487+0000 7fe79cfda640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980b3b40 0x7fe798159cf0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c4d0 tx=0x7fe78800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.488+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788007480 con 0x7fe7980b3b40 2023-08-09T12:48:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.488+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7880075e0 con 0x7fe7980b3b40 2023-08-09T12:48:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.488+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7880059a0 con 0x7fe7980b3b40 2023-08-09T12:48:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.488+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7980c3350 con 0x7fe7980b3b40 2023-08-09T12:48:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.488+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79815a230 con 0x7fe7980b3b40 2023-08-09T12:48:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.489+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7980c2ed0 con 0x7fe7980b3b40 2023-08-09T12:48:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.490+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe788005b00 con 0x7fe7980b3b40 2023-08-09T12:48:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.491+0000 7fe78dffb640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe77c06a050 0x7fe77c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.492+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7880881b0 con 0x7fe7980b3b40 2023-08-09T12:48:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.492+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fe77c0721a0 con 0x7fe7980b3b40 2023-08-09T12:48:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.492+0000 7fe79d7db640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe77c06a050 0x7fe77c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.493+0000 7fe79d7db640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe77c06a050 0x7fe77c06c510 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe794007330 tx=0x7fe79400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.496+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe7980c2ed0 con 0x7fe7980b3b40 2023-08-09T12:48:31.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.729+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe7980c3870 con 0x7fe7980b3b40 2023-08-09T12:48:31.733 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:48:31.730+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:48:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.734+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(151..151 src has 1..151) v4 ==== 374+0+0 (secure 0 0 0) 0x7fe78805b280 con 0x7fe7980b3b40 2023-08-09T12:48:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.734+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fe77c072a50 con 0x7fe7980b3b40 2023-08-09T12:48:31.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.736+0000 7fe78dffb640 1 -- 172.21.15.17:0/2771750086 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe7980c3870 con 0x7fe7980b3b40 2023-08-09T12:48:31.740 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:48:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe77c06a050 msgr2=0x7fe77c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe77c06a050 0x7fe77c06c510 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe794007330 tx=0x7fe79400b040 comp rx=0 tx=0).stop 2023-08-09T12:48:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980b3b40 msgr2=0x7fe798159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980b3b40 0x7fe798159cf0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c4d0 tx=0x7fe78800c990 comp rx=0 tx=0).stop 2023-08-09T12:48:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 shutdown_connections 2023-08-09T12:48:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe77c06a050 0x7fe77c06c510 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980cc630 0x7fe7980c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7980b3b40 0x7fe798159cf0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 --2- 172.21.15.17:0/2771750086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980adc40 0x7fe7980c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 >> 172.21.15.17:0/2771750086 conn(0x7fe7980cb1b0 msgr2=0x7fe7980b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:31.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 shutdown_connections 2023-08-09T12:48:31.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.741+0000 7fe79fa3f640 1 -- 172.21.15.17:0/2771750086 wait complete. 2023-08-09T12:48:31.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:48:31.764 INFO:tasks.ceph.mds.a.smithi017.stderr: -9715> 2023-08-09T12:47:39.548+0000 7fc35ca7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:48:31.864 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:48:31.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.974+0000 7f570a301640 1 Processor -- start 2023-08-09T12:48:31.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.974+0000 7f570a301640 1 -- start start 2023-08-09T12:48:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.976+0000 7f570a301640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5704161280 0x7f57040c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.976+0000 7f570a301640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161660 0x7f57040ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.976+0000 7f570a301640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570415df30 con 0x7f57040ca450 2023-08-09T12:48:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.976+0000 7f570a301640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f570415d430 con 0x7f5704161280 2023-08-09T12:48:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.976+0000 7f570a301640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57040ca9d0 con 0x7f5704161660 2023-08-09T12:48:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.976+0000 7f5703fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5704161280 0x7f57040c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.976+0000 7f5703fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5704161280 0x7f57040c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56916/0 (socket says 172.21.15.17:56916) 2023-08-09T12:48:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.976+0000 7f5703fff640 1 -- 172.21.15.17:0/2648099762 learned_addr learned my addr 172.21.15.17:0/2648099762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.977+0000 7f57037fe640 1 --2- 172.21.15.17:0/2648099762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161660 0x7f57040ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.977+0000 7f5703fff640 1 -- 172.21.15.17:0/2648099762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161660 msgr2=0x7f57040ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.977+0000 7f5703fff640 1 --2- 172.21.15.17:0/2648099762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161660 0x7f57040ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.977+0000 7f5703fff640 1 -- 172.21.15.17:0/2648099762 >> v1:172.21.15.142:6789/0 conn(0x7f57040ca450 legacy=0x7f57040c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:31.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.977+0000 7f5703fff640 1 -- 172.21.15.17:0/2648099762 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570415e3c0 con 0x7f5704161280 2023-08-09T12:48:31.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.978+0000 7f5703fff640 1 --2- 172.21.15.17:0/2648099762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161280 0x7f57040c9f10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009e50 tx=0x7f56f402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6020b8da880ee982 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.978+0000 7f5702ffd640 1 -- 172.21.15.17:0/2648099762 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f402c9e0 con 0x7f5704161280 2023-08-09T12:48:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.978+0000 7f5702ffd640 1 -- 172.21.15.17:0/2648099762 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f402cb40 con 0x7f5704161280 2023-08-09T12:48:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.978+0000 7f5702ffd640 1 -- 172.21.15.17:0/2648099762 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f40343f0 con 0x7f5704161280 2023-08-09T12:48:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.979+0000 7f570a301640 1 -- 172.21.15.17:0/2648099762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161280 msgr2=0x7f57040c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.979+0000 7f570a301640 1 --2- 172.21.15.17:0/2648099762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161280 0x7f57040c9f10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009e50 tx=0x7f56f402be40 comp rx=0 tx=0).stop 2023-08-09T12:48:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.979+0000 7f570a301640 1 -- 172.21.15.17:0/2648099762 shutdown_connections 2023-08-09T12:48:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.979+0000 7f570a301640 1 --2- 172.21.15.17:0/2648099762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161660 0x7f57040ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.979+0000 7f570a301640 1 --2- 172.21.15.17:0/2648099762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161280 0x7f57040c9f10 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.979+0000 7f570a301640 1 -- 172.21.15.17:0/2648099762 >> 172.21.15.17:0/2648099762 conn(0x7f57040cb1b0 msgr2=0x7f57040cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.979+0000 7f570a301640 1 -- 172.21.15.17:0/2648099762 shutdown_connections 2023-08-09T12:48:31.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.979+0000 7f570a301640 1 -- 172.21.15.17:0/2648099762 wait complete. 2023-08-09T12:48:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.981+0000 7f570a301640 1 Processor -- start 2023-08-09T12:48:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.981+0000 7f570a301640 1 -- start start 2023-08-09T12:48:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.982+0000 7f570a301640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57040ca450 0x7f57040c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.982+0000 7f570a301640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161280 0x7f57040c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.982+0000 7f570a301640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161660 0x7f57040c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.982+0000 7f570a301640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57040c5060 con 0x7f5704161660 2023-08-09T12:48:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.982+0000 7f570a301640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57040c4450 con 0x7f57040ca450 2023-08-09T12:48:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.982+0000 7f570a301640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57040c4730 con 0x7f5704161280 2023-08-09T12:48:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.982+0000 7f570889e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161660 0x7f57040c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f570889e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161660 0x7f57040c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56932/0 (socket says 172.21.15.17:56932) 2023-08-09T12:48:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f570889e640 1 -- 172.21.15.17:0/3395952382 learned_addr learned my addr 172.21.15.17:0/3395952382 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f5703fff640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57040ca450 0x7f57040c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f57037fe640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161280 0x7f57040c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f570889e640 1 -- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161280 msgr2=0x7f57040c1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f570889e640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161280 0x7f57040c1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f570889e640 1 -- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57040ca450 msgr2=0x7f57040c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f570889e640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57040ca450 0x7f57040c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:31.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f570889e640 1 -- 172.21.15.17:0/3395952382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f4009b30 con 0x7f5704161660 2023-08-09T12:48:31.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f5703fff640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57040ca450 0x7f57040c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.983+0000 7f570889e640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161660 0x7f57040c23a0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00b410 tx=0x7f56fc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.984+0000 7f5700ff9640 1 -- 172.21.15.17:0/3395952382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc004020 con 0x7f5704161660 2023-08-09T12:48:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.984+0000 7f5700ff9640 1 -- 172.21.15.17:0/3395952382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56fc004180 con 0x7f5704161660 2023-08-09T12:48:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.984+0000 7f5700ff9640 1 -- 172.21.15.17:0/3395952382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc011630 con 0x7f5704161660 2023-08-09T12:48:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.984+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57040c4a10 con 0x7f5704161660 2023-08-09T12:48:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.984+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57041457f0 con 0x7f5704161660 2023-08-09T12:48:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.985+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57040c5210 con 0x7f5704161660 2023-08-09T12:48:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.986+0000 7f5700ff9640 1 -- 172.21.15.17:0/3395952382 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f56fc011790 con 0x7f5704161660 2023-08-09T12:48:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.987+0000 7f5700ff9640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f56f006a050 0x7f56f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.988+0000 7f5700ff9640 1 -- 172.21.15.17:0/3395952382 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f56fc088310 con 0x7f5704161660 2023-08-09T12:48:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.988+0000 7f5700ff9640 1 -- 172.21.15.17:0/3395952382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f56f00722b0 con 0x7f5704161660 2023-08-09T12:48:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.988+0000 7f5703fff640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f56f006a050 0x7f56f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.989+0000 7f5703fff640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f56f006a050 0x7f56f006c510 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f56f4035000 tx=0x7f56f4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:31.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:31.992+0000 7f5700ff9640 1 -- 172.21.15.17:0/3395952382 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f56fc053990 con 0x7f5704161660 2023-08-09T12:48:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.225+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5704067a80 con 0x7f5704161660 2023-08-09T12:48:32.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.741+0000 7f5700ff9640 1 -- 172.21.15.17:0/3395952382 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7f56fc056fb0 con 0x7f5704161660 2023-08-09T12:48:32.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.744+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f56f006a050 msgr2=0x7f56f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:32.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.744+0000 7f570a301640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f56f006a050 0x7f56f006c510 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f56f4035000 tx=0x7f56f4030000 comp rx=0 tx=0).stop 2023-08-09T12:48:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.744+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161660 msgr2=0x7f57040c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.744+0000 7f570a301640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161660 0x7f57040c23a0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00b410 tx=0x7f56fc00b8d0 comp rx=0 tx=0).stop 2023-08-09T12:48:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.745+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 shutdown_connections 2023-08-09T12:48:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.745+0000 7f570a301640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f56f006a050 0x7f56f006c510 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.745+0000 7f570a301640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5704161660 0x7f57040c23a0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.745+0000 7f570a301640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5704161280 0x7f57040c1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.745+0000 7f570a301640 1 --2- 172.21.15.17:0/3395952382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57040ca450 0x7f57040c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.745+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 >> 172.21.15.17:0/3395952382 conn(0x7f57040cb1b0 msgr2=0x7f57040b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.745+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 shutdown_connections 2023-08-09T12:48:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.745+0000 7f570a301640 1 -- 172.21.15.17:0/3395952382 wait complete. 2023-08-09T12:48:32.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:48:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.996+0000 7f6019bd2640 1 Processor -- start 2023-08-09T12:48:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.996+0000 7f6019bd2640 1 -- start start 2023-08-09T12:48:33.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.998+0000 7f6019bd2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60140b3dd0 0x7f60140b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.998+0000 7f6019bd2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140b18b0 con 0x7f60140c8240 2023-08-09T12:48:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.998+0000 7f6019bd2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140b1b10 con 0x7f60140b41b0 2023-08-09T12:48:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.998+0000 7f6019bd2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60140b1df0 con 0x7f60140b3dd0 2023-08-09T12:48:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.998+0000 7f60193d1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f60140c8240 0x7f60140affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60232/0 (socket says 172.21.15.17:60232) 2023-08-09T12:48:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.998+0000 7f60193d1640 1 -- 172.21.15.17:0/3389592818 learned_addr learned my addr 172.21.15.17:0/3389592818 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f6018bd0640 1 --2- 172.21.15.17:0/3389592818 >> v2:172.21.15.142:3300/0 conn(0x7f60140b3dd0 0x7f60140b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:33.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838243346 0 0) 0x7f60140b18b0 con 0x7f60140c8240 2023-08-09T12:48:33.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6004003520 con 0x7f60140c8240 2023-08-09T12:48:33.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884323399 0 0) 0x7f6004003520 con 0x7f60140c8240 2023-08-09T12:48:33.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 >> v2:172.21.15.142:3300/0 conn(0x7f60140b3dd0 msgr2=0x7f60140b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 --2- 172.21.15.17:0/3389592818 >> v2:172.21.15.142:3300/0 conn(0x7f60140b3dd0 0x7f60140b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 >> v1:172.21.15.142:6789/0 conn(0x7f60140b41b0 legacy=0x7f601415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140b20d0 con 0x7f60140c8240 2023-08-09T12:48:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f600c0019f0 con 0x7f60140c8240 2023-08-09T12:48:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:32.999+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 >> v1:172.21.15.17:6789/0 conn(0x7f60140c8240 legacy=0x7f60140affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60137fe640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60040039a0 0x7f6004003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60137fe640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60040047c0 0x7f6004004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60137fe640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6004005180 0x7f600400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:33.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140b1df0 con 0x7f60040039a0 2023-08-09T12:48:33.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600400c050 con 0x7f6004005180 2023-08-09T12:48:33.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600400c210 con 0x7f60040047c0 2023-08-09T12:48:33.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f6018bd0640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60040039a0 0x7f6004003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:33.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f6013fff640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60040047c0 0x7f6004004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:33.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f6018bd0640 1 -- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60040047c0 msgr2=0x7f6004004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:33.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60193d1640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6004005180 0x7f600400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:33.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f6018bd0640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60040047c0 0x7f6004004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f6018bd0640 1 -- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6004005180 msgr2=0x7f600400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:33.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f6018bd0640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6004005180 0x7f600400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f6018bd0640 1 -- 172.21.15.17:0/3389592818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004003520 con 0x7f60040039a0 2023-08-09T12:48:33.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60193d1640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6004005180 0x7f600400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.000+0000 7f60193d1640 1 -- 172.21.15.17:0/3389592818 reap_dead start 2023-08-09T12:48:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.002+0000 7f6018bd0640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60040039a0 0x7f6004003dc0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f6008009ac0 tx=0x7f60040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbac7bb18362094 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.002+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600802c6b0 con 0x7f60040039a0 2023-08-09T12:48:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.002+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600802c810 con 0x7f60040039a0 2023-08-09T12:48:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.002+0000 7f60137fe640 1 -- 172.21.15.17:0/3389592818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600802cba0 con 0x7f60040039a0 2023-08-09T12:48:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.002+0000 7f6019bd2640 1 -- 172.21.15.17:0/3389592818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60040039a0 msgr2=0x7f6004003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.002+0000 7f6019bd2640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60040039a0 0x7f6004003dc0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f6008009ac0 tx=0x7f60040057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.003+0000 7f6019bd2640 1 -- 172.21.15.17:0/3389592818 shutdown_connections 2023-08-09T12:48:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.003+0000 7f6019bd2640 1 --2- 172.21.15.17:0/3389592818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60040039a0 0x7f6004003dc0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.003+0000 7f6019bd2640 1 -- 172.21.15.17:0/3389592818 >> 172.21.15.17:0/3389592818 conn(0x7f60140cafa0 msgr2=0x7f60140cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.003+0000 7f6019bd2640 1 -- 172.21.15.17:0/3389592818 shutdown_connections 2023-08-09T12:48:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.003+0000 7f6019bd2640 1 -- 172.21.15.17:0/3389592818 wait complete. 2023-08-09T12:48:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.004+0000 7f6019bd2640 1 Processor -- start 2023-08-09T12:48:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.005+0000 7f6019bd2640 1 -- start start 2023-08-09T12:48:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6019bd2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60040039a0 0x7f6014070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6019bd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60141f2dd0 0x7f6014153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6019bd2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60140ac8b0 0x7f60140acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6019bd2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6014070a70 con 0x7f60141f2dd0 2023-08-09T12:48:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6019bd2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140ad270 con 0x7f60040039a0 2023-08-09T12:48:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6019bd2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60141f6880 con 0x7f60140ac8b0 2023-08-09T12:48:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6013fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60141f2dd0 0x7f6014153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6013fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60141f2dd0 0x7f6014153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56962/0 (socket says 172.21.15.17:56962) 2023-08-09T12:48:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6013fff640 1 -- 172.21.15.17:0/861970456 learned_addr learned my addr 172.21.15.17:0/861970456 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f6018bd0640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60040039a0 0x7f6014070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.006+0000 7f60193d1640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60140ac8b0 0x7f60140acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.007+0000 7f6013fff640 1 -- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60140ac8b0 msgr2=0x7f60140acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.007+0000 7f6013fff640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60140ac8b0 0x7f60140acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.007+0000 7f6013fff640 1 -- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60040039a0 msgr2=0x7f6014070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:33.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.007+0000 7f6013fff640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60040039a0 0x7f6014070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.007+0000 7f6013fff640 1 -- 172.21.15.17:0/861970456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60141f63f0 con 0x7f60141f2dd0 2023-08-09T12:48:33.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.007+0000 7f6013fff640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60141f2dd0 0x7f6014153af0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f600000d540 tx=0x7f600000da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:33.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.007+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000005480 con 0x7f60141f2dd0 2023-08-09T12:48:33.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.008+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6000003610 con 0x7f60141f2dd0 2023-08-09T12:48:33.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.008+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000003980 con 0x7f60141f2dd0 2023-08-09T12:48:33.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.008+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60141f3250 con 0x7f60141f2dd0 2023-08-09T12:48:33.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.008+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60141f5da0 con 0x7f60141f2dd0 2023-08-09T12:48:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.009+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601404e390 con 0x7f60141f2dd0 2023-08-09T12:48:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.010+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6000003ae0 con 0x7f60141f2dd0 2023-08-09T12:48:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.011+0000 7f60117fa640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ff806a050 0x7f5ff806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.011+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f60000883f0 con 0x7f60141f2dd0 2023-08-09T12:48:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.012+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f5ff80722b0 con 0x7f60141f2dd0 2023-08-09T12:48:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.012+0000 7f6018bd0640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ff806a050 0x7f5ff806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.013+0000 7f6018bd0640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ff806a050 0x7f5ff806c510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6008036000 tx=0x7f6008030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.016+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6000053a90 con 0x7f60141f2dd0 2023-08-09T12:48:33.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.207+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60140cbda0 con 0x7f60141f2dd0 2023-08-09T12:48:33.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.741+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(152..152 src has 1..152) v4 ==== 296+0+0 (secure 0 0 0) 0x7f600005b460 con 0x7f60141f2dd0 2023-08-09T12:48:33.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.742+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f5ff80706e0 con 0x7f60141f2dd0 2023-08-09T12:48:33.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.753+0000 7f60117fa640 1 -- 172.21.15.17:0/861970456 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v152) v1 ==== 181+0+0 (secure 0 0 0) 0x7f60000570b0 con 0x7f60141f2dd0 2023-08-09T12:48:33.761 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:48:33.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ff806a050 msgr2=0x7f5ff806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:33.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ff806a050 0x7f5ff806c510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6008036000 tx=0x7f6008030000 comp rx=0 tx=0).stop 2023-08-09T12:48:33.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60141f2dd0 msgr2=0x7f6014153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:33.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60141f2dd0 0x7f6014153af0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f600000d540 tx=0x7f600000da00 comp rx=0 tx=0).stop 2023-08-09T12:48:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 shutdown_connections 2023-08-09T12:48:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5ff806a050 0x7f5ff806c510 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60140ac8b0 0x7f60140acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60141f2dd0 0x7f6014153af0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 --2- 172.21.15.17:0/861970456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60040039a0 0x7f6014070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.762+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 >> 172.21.15.17:0/861970456 conn(0x7f60140cafa0 msgr2=0x7f6014154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.763+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 shutdown_connections 2023-08-09T12:48:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:33.763+0000 7f6019bd2640 1 -- 172.21.15.17:0/861970456 wait complete. 2023-08-09T12:48:33.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:48:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.015+0000 7f7e48f22640 1 Processor -- start 2023-08-09T12:48:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.015+0000 7f7e48f22640 1 -- start start 2023-08-09T12:48:34.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.017+0000 7f7e48f22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440adcf0 0x7f7e4415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:34.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.017+0000 7f7e48f22640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e440cb1c0 0x7f7e440cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.017+0000 7f7e48f22640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e440ce720 con 0x7f7e440ccb70 2023-08-09T12:48:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.017+0000 7f7e48f22640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e440cbb90 con 0x7f7e440cb1c0 2023-08-09T12:48:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.017+0000 7f7e48f22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440acfc0 con 0x7f7e440adcf0 2023-08-09T12:48:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.018+0000 7f7e42d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e440cb1c0 0x7f7e440cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.018+0000 7f7e41d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440adcf0 0x7f7e4415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.018+0000 7f7e42d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e440cb1c0 0x7f7e440cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:34606/0 (socket says 172.21.15.17:34606) 2023-08-09T12:48:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.018+0000 7f7e42d9d640 1 -- 172.21.15.17:0/3547701199 learned_addr learned my addr 172.21.15.17:0/3547701199 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.019+0000 7f7e42d9d640 1 -- 172.21.15.17:0/3547701199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440adcf0 msgr2=0x7f7e4415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.019+0000 7f7e42d9d640 1 --2- 172.21.15.17:0/3547701199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440adcf0 0x7f7e4415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.019+0000 7f7e42d9d640 1 -- 172.21.15.17:0/3547701199 >> v1:172.21.15.142:6789/0 conn(0x7f7e440ccb70 legacy=0x7f7e440ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.019+0000 7f7e42d9d640 1 -- 172.21.15.17:0/3547701199 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4415d9d0 con 0x7f7e440cb1c0 2023-08-09T12:48:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.019+0000 7f7e4159a640 1 -- 172.21.15.17:0/3547701199 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152269934 0 0) 0x7f7e440ce720 con 0x7f7e440ccb70 2023-08-09T12:48:34.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.020+0000 7f7e42d9d640 1 --2- 172.21.15.17:0/3547701199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440cb1c0 0x7f7e440cb650 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009e50 tx=0x7f7e3c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7455bc478022c2be server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:34.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e4159a640 1 -- 172.21.15.17:0/3547701199 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c02cb00 con 0x7f7e440cb1c0 2023-08-09T12:48:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e4159a640 1 -- 172.21.15.17:0/3547701199 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c02cc60 con 0x7f7e440cb1c0 2023-08-09T12:48:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e4159a640 1 -- 172.21.15.17:0/3547701199 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0343f0 con 0x7f7e440cb1c0 2023-08-09T12:48:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e48f22640 1 -- 172.21.15.17:0/3547701199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440cb1c0 msgr2=0x7f7e440cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e48f22640 1 --2- 172.21.15.17:0/3547701199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440cb1c0 0x7f7e440cb650 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009e50 tx=0x7f7e3c02bf60 comp rx=0 tx=0).stop 2023-08-09T12:48:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e48f22640 1 -- 172.21.15.17:0/3547701199 shutdown_connections 2023-08-09T12:48:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e48f22640 1 --2- 172.21.15.17:0/3547701199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440adcf0 0x7f7e4415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e48f22640 1 --2- 172.21.15.17:0/3547701199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440cb1c0 0x7f7e440cb650 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.021+0000 7f7e48f22640 1 -- 172.21.15.17:0/3547701199 >> 172.21.15.17:0/3547701199 conn(0x7f7e440697c0 msgr2=0x7f7e44069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.022+0000 7f7e48f22640 1 -- 172.21.15.17:0/3547701199 shutdown_connections 2023-08-09T12:48:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.022+0000 7f7e48f22640 1 -- 172.21.15.17:0/3547701199 wait complete. 2023-08-09T12:48:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.023+0000 7f7e48f22640 1 Processor -- start 2023-08-09T12:48:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.024+0000 7f7e48f22640 1 -- start start 2023-08-09T12:48:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e48f22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440adcf0 0x7f7e4415be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e48f22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440cb1c0 0x7f7e440c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e48f22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e440ccb70 0x7f7e440c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e48f22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c2d50 con 0x7f7e440ccb70 2023-08-09T12:48:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e48f22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c1e80 con 0x7f7e440adcf0 2023-08-09T12:48:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e48f22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c20d0 con 0x7f7e440cb1c0 2023-08-09T12:48:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e440ccb70 0x7f7e440c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e440ccb70 0x7f7e440c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56966/0 (socket says 172.21.15.17:56966) 2023-08-09T12:48:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e42d9d640 1 -- 172.21.15.17:0/484686509 learned_addr learned my addr 172.21.15.17:0/484686509 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e4259c640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440adcf0 0x7f7e4415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.025+0000 7f7e41d9b640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440cb1c0 0x7f7e440c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.026+0000 7f7e42d9d640 1 -- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440cb1c0 msgr2=0x7f7e440c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.026+0000 7f7e42d9d640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440cb1c0 0x7f7e440c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.026+0000 7f7e42d9d640 1 -- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440adcf0 msgr2=0x7f7e4415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.026+0000 7f7e42d9d640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440adcf0 0x7f7e4415be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.026+0000 7f7e42d9d640 1 -- 172.21.15.17:0/484686509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c009b30 con 0x7f7e440ccb70 2023-08-09T12:48:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.026+0000 7f7e41d9b640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440cb1c0 0x7f7e440c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:48:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.026+0000 7f7e42d9d640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e440ccb70 0x7f7e440c6100 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c036040 tx=0x7f7e3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.026+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c009510 con 0x7f7e440ccb70 2023-08-09T12:48:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.027+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c03e450 con 0x7f7e440ccb70 2023-08-09T12:48:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.027+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c03e7e0 con 0x7f7e440ccb70 2023-08-09T12:48:34.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.027+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e440c23b0 con 0x7f7e440ccb70 2023-08-09T12:48:34.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.027+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e440c2970 con 0x7f7e440ccb70 2023-08-09T12:48:34.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.028+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e44067a80 con 0x7f7e440ccb70 2023-08-09T12:48:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.029+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e3c03e940 con 0x7f7e440ccb70 2023-08-09T12:48:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.030+0000 7f7e32ffd640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e2406a050 0x7f7e2406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.030+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f7e3c0ab020 con 0x7f7e440ccb70 2023-08-09T12:48:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.030+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f7e24071440 con 0x7f7e440ccb70 2023-08-09T12:48:34.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.030+0000 7f7e4259c640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e2406a050 0x7f7e2406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:34.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.031+0000 7f7e4259c640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e2406a050 0x7f7e2406c510 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7e34000f60 tx=0x7f7e34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:34.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.034+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7e3c076900 con 0x7f7e440ccb70 2023-08-09T12:48:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.225+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7e4406b5e0 con 0x7f7e440ccb70 2023-08-09T12:48:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.857+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(153..153 src has 1..153) v4 ==== 296+0+0 (secure 0 0 0) 0x7f7e3c07ac50 con 0x7f7e440ccb70 2023-08-09T12:48:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.857+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f7e240701d0 con 0x7f7e440ccb70 2023-08-09T12:48:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.863+0000 7f7e32ffd640 1 -- 172.21.15.17:0/484686509 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v153) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7e3c043070 con 0x7f7e440ccb70 2023-08-09T12:48:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:48:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.880+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e2406a050 msgr2=0x7f7e2406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.880+0000 7f7e48f22640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e2406a050 0x7f7e2406c510 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7e34000f60 tx=0x7f7e34009040 comp rx=0 tx=0).stop 2023-08-09T12:48:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.880+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e440ccb70 msgr2=0x7f7e440c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.880+0000 7f7e48f22640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e440ccb70 0x7f7e440c6100 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c036040 tx=0x7f7e3c004a40 comp rx=0 tx=0).stop 2023-08-09T12:48:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.881+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 shutdown_connections 2023-08-09T12:48:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.881+0000 7f7e48f22640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e2406a050 0x7f7e2406c510 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.881+0000 7f7e48f22640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e440ccb70 0x7f7e440c6100 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.881+0000 7f7e48f22640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e440cb1c0 0x7f7e440c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.881+0000 7f7e48f22640 1 --2- 172.21.15.17:0/484686509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e440adcf0 0x7f7e4415be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.881+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 >> 172.21.15.17:0/484686509 conn(0x7f7e440697c0 msgr2=0x7f7e4415fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.881+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 shutdown_connections 2023-08-09T12:48:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:34.881+0000 7f7e48f22640 1 -- 172.21.15.17:0/484686509 wait complete. 2023-08-09T12:48:34.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:48:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.123+0000 7ff06a9a4640 1 Processor -- start 2023-08-09T12:48:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.124+0000 7ff06a9a4640 1 -- start start 2023-08-09T12:48:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.125+0000 7ff06a9a4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff06415cb40 0x7ff0641609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.125+0000 7ff06a9a4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0640cdf70 0x7ff0640d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.125+0000 7ff06a9a4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0640d0f00 con 0x7ff0640b8420 2023-08-09T12:48:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.125+0000 7ff06a9a4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0641611f0 con 0x7ff06415cb40 2023-08-09T12:48:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.125+0000 7ff06a9a4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0641614d0 con 0x7ff0640cdf70 2023-08-09T12:48:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.126+0000 7ff0699a2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff06415cb40 0x7ff0641609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.126+0000 7ff0699a2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff06415cb40 0x7ff0641609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56982/0 (socket says 172.21.15.17:56982) 2023-08-09T12:48:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.126+0000 7ff0699a2640 1 -- 172.21.15.17:0/2273704891 learned_addr learned my addr 172.21.15.17:0/2273704891 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.126+0000 7ff06a1a3640 1 --2- 172.21.15.17:0/2273704891 >> v2:172.21.15.142:3300/0 conn(0x7ff0640cdf70 0x7ff0640d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.126+0000 7ff0699a2640 1 -- 172.21.15.17:0/2273704891 >> v2:172.21.15.142:3300/0 conn(0x7ff0640cdf70 msgr2=0x7ff0640d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.126+0000 7ff0699a2640 1 --2- 172.21.15.17:0/2273704891 >> v2:172.21.15.142:3300/0 conn(0x7ff0640cdf70 0x7ff0640d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.126+0000 7ff0699a2640 1 -- 172.21.15.17:0/2273704891 >> v1:172.21.15.142:6789/0 conn(0x7ff0640b8420 legacy=0x7ff0640cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.126+0000 7ff0699a2640 1 -- 172.21.15.17:0/2273704891 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0641617b0 con 0x7ff06415cb40 2023-08-09T12:48:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.128+0000 7ff0699a2640 1 --2- 172.21.15.17:0/2273704891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06415cb40 0x7ff0641609a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7ff0640d0e50 tx=0x7ff06002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5110d3f50bb901 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.128+0000 7ff0689a0640 1 -- 172.21.15.17:0/2273704891 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060030860 con 0x7ff06415cb40 2023-08-09T12:48:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.128+0000 7ff0689a0640 1 -- 172.21.15.17:0/2273704891 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0600309c0 con 0x7ff06415cb40 2023-08-09T12:48:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.128+0000 7ff0689a0640 1 -- 172.21.15.17:0/2273704891 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060030d50 con 0x7ff06415cb40 2023-08-09T12:48:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.129+0000 7ff06a9a4640 1 -- 172.21.15.17:0/2273704891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06415cb40 msgr2=0x7ff0641609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.129+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/2273704891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06415cb40 0x7ff0641609a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7ff0640d0e50 tx=0x7ff06002b9a0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.129+0000 7ff06a9a4640 1 -- 172.21.15.17:0/2273704891 shutdown_connections 2023-08-09T12:48:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.129+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/2273704891 >> v2:172.21.15.142:3300/0 conn(0x7ff0640cdf70 0x7ff0640d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.129+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/2273704891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06415cb40 0x7ff0641609a0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.129+0000 7ff06a9a4640 1 -- 172.21.15.17:0/2273704891 >> 172.21.15.17:0/2273704891 conn(0x7ff0640d2ab0 msgr2=0x7ff0640d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.129+0000 7ff06a9a4640 1 -- 172.21.15.17:0/2273704891 shutdown_connections 2023-08-09T12:48:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.129+0000 7ff06a9a4640 1 -- 172.21.15.17:0/2273704891 wait complete. 2023-08-09T12:48:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.131+0000 7ff06a9a4640 1 Processor -- start 2023-08-09T12:48:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.131+0000 7ff06a9a4640 1 -- start start 2023-08-09T12:48:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff06a9a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0640b8420 0x7ff0640c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff06a9a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0640cdf70 0x7ff06415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff06a9a4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06415cb40 0x7ff0640cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff06a9a4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0640cac70 con 0x7ff0640b8420 2023-08-09T12:48:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff06a9a4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0640c8920 con 0x7ff06415cb40 2023-08-09T12:48:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff06a9a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0640ca060 con 0x7ff0640cdf70 2023-08-09T12:48:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff0699a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0640b8420 0x7ff0640c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff0699a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0640b8420 0x7ff0640c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56986/0 (socket says 172.21.15.17:56986) 2023-08-09T12:48:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.132+0000 7ff0699a2640 1 -- 172.21.15.17:0/3068366218 learned_addr learned my addr 172.21.15.17:0/3068366218 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff0699a2640 1 -- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0640cdf70 msgr2=0x7ff06415f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff0691a1640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0640cdf70 0x7ff06415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff06a1a3640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06415cb40 0x7ff0640cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff0699a2640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0640cdf70 0x7ff06415f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff0699a2640 1 -- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06415cb40 msgr2=0x7ff0640cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff0699a2640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06415cb40 0x7ff0640cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff0699a2640 1 -- 172.21.15.17:0/3068366218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600094d0 con 0x7ff0640b8420 2023-08-09T12:48:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff0691a1640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0640cdf70 0x7ff06415f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff06a1a3640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06415cb40 0x7ff0640cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff0699a2640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0640b8420 0x7ff0640c83e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7ff060000c00 tx=0x7ff060004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff05a7fc640 1 -- 172.21.15.17:0/3068366218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060039a90 con 0x7ff0640b8420 2023-08-09T12:48:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff05a7fc640 1 -- 172.21.15.17:0/3068366218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff060039bf0 con 0x7ff0640b8420 2023-08-09T12:48:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff05a7fc640 1 -- 172.21.15.17:0/3068366218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600433f0 con 0x7ff0640b8420 2023-08-09T12:48:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.133+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0640ca340 con 0x7ff0640b8420 2023-08-09T12:48:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.134+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0640ca900 con 0x7ff0640b8420 2023-08-09T12:48:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.135+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06404e390 con 0x7ff0640b8420 2023-08-09T12:48:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.136+0000 7ff05a7fc640 1 -- 172.21.15.17:0/3068366218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff06002f3b0 con 0x7ff0640b8420 2023-08-09T12:48:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.137+0000 7ff05a7fc640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff04806a050 0x7ff04806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.137+0000 7ff05a7fc640 1 -- 172.21.15.17:0/3068366218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff0600aa5e0 con 0x7ff0640b8420 2023-08-09T12:48:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.138+0000 7ff0691a1640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff04806a050 0x7ff04806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.139+0000 7ff0691a1640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff04806a050 0x7ff04806c510 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff0640c9020 tx=0x7ff054009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.142+0000 7ff05a7fc640 1 -- 172.21.15.17:0/3068366218 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff060075f50 con 0x7ff0640b8420 2023-08-09T12:48:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.338+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff0640ce470 con 0x7ff0640b8420 2023-08-09T12:48:35.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.344+0000 7ff05a7fc640 1 -- 172.21.15.17:0/3068366218 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff060079570 con 0x7ff0640b8420 2023-08-09T12:48:35.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff04806a050 msgr2=0x7ff04806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff04806a050 0x7ff04806c510 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff0640c9020 tx=0x7ff054009040 comp rx=0 tx=0).stop 2023-08-09T12:48:35.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0640b8420 msgr2=0x7ff0640c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0640b8420 0x7ff0640c83e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7ff060000c00 tx=0x7ff060004730 comp rx=0 tx=0).stop 2023-08-09T12:48:35.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 shutdown_connections 2023-08-09T12:48:35.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff04806a050 0x7ff04806c510 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06415cb40 0x7ff0640cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0640cdf70 0x7ff06415f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 --2- 172.21.15.17:0/3068366218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0640b8420 0x7ff0640c83e0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 >> 172.21.15.17:0/3068366218 conn(0x7ff0640d2ab0 msgr2=0x7ff0640d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:35.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 shutdown_connections 2023-08-09T12:48:35.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.347+0000 7ff06a9a4640 1 -- 172.21.15.17:0/3068366218 wait complete. 2023-08-09T12:48:35.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-08-09T12:48:35.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.595+0000 7f396359e640 1 Processor -- start 2023-08-09T12:48:35.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.595+0000 7f396359e640 1 -- start start 2023-08-09T12:48:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.597+0000 7f396359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f396406c020 0x7f39640ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.597+0000 7f396359e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640afe30 con 0x7f396406bc40 2023-08-09T12:48:35.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.597+0000 7f396359e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396415f510 con 0x7f39640cfa40 2023-08-09T12:48:35.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.597+0000 7f396359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640b6830 con 0x7f396406c020 2023-08-09T12:48:35.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.597+0000 7f396259c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f396406bc40 0x7f39640b5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60240/0 (socket says 172.21.15.17:60240) 2023-08-09T12:48:35.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.597+0000 7f396259c640 1 -- 172.21.15.17:0/616514483 learned_addr learned my addr 172.21.15.17:0/616514483 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:35.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.597+0000 7f3961d9b640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f396406c020 0x7f39640ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583854820 0 0) 0x7f39640afe30 con 0x7f396406bc40 2023-08-09T12:48:35.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c003520 con 0x7f396406bc40 2023-08-09T12:48:35.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3173273680 0 0) 0x7f394c003520 con 0x7f396406bc40 2023-08-09T12:48:35.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f396406c020 msgr2=0x7f39640ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:35.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f396406c020 0x7f39640ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 >> v1:172.21.15.142:6789/0 conn(0x7f39640cfa40 legacy=0x7f39640cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396415e770 con 0x7f396406bc40 2023-08-09T12:48:35.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f39540019f0 con 0x7f396406bc40 2023-08-09T12:48:35.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 >> v1:172.21.15.17:6789/0 conn(0x7f396406bc40 legacy=0x7f39640b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f394c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0047c0 0x7f394c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c005180 0x7f394c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640b6830 con 0x7f394c0039a0 2023-08-09T12:48:35.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00c020 con 0x7f394c0047c0 2023-08-09T12:48:35.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00c1e0 con 0x7f394c005180 2023-08-09T12:48:35.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.598+0000 7f3961d9b640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f396406c020 0x7f39640ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:48:35.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f396259c640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f394c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f3962d9d640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c005180 0x7f394c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f396259c640 1 -- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c005180 msgr2=0x7f394c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:35.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f3961d9b640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0047c0 0x7f394c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f396259c640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c005180 0x7f394c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f396259c640 1 -- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0047c0 msgr2=0x7f394c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:35.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f396259c640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0047c0 0x7f394c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f396259c640 1 -- 172.21.15.17:0/616514483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c003520 con 0x7f394c0039a0 2023-08-09T12:48:35.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.599+0000 7f3962d9d640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c005180 0x7f394c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:35.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.600+0000 7f396259c640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f394c003dc0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f395400a830 tx=0x7f394c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b703ec87e936f50 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:35.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.601+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540072d0 con 0x7f394c0039a0 2023-08-09T12:48:35.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.601+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395402f070 con 0x7f394c0039a0 2023-08-09T12:48:35.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.601+0000 7f396159a640 1 -- 172.21.15.17:0/616514483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540076b0 con 0x7f394c0039a0 2023-08-09T12:48:35.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.601+0000 7f396359e640 1 -- 172.21.15.17:0/616514483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 msgr2=0x7f394c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.601+0000 7f396359e640 1 --2- 172.21.15.17:0/616514483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f394c003dc0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f395400a830 tx=0x7f394c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.601+0000 7f3962d9d640 1 -- 172.21.15.17:0/616514483 reap_dead start 2023-08-09T12:48:35.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.602+0000 7f396359e640 1 -- 172.21.15.17:0/616514483 shutdown_connections 2023-08-09T12:48:35.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.602+0000 7f396359e640 1 -- 172.21.15.17:0/616514483 >> 172.21.15.17:0/616514483 conn(0x7f39640cd2f0 msgr2=0x7f39640cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:35.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.602+0000 7f396359e640 1 -- 172.21.15.17:0/616514483 shutdown_connections 2023-08-09T12:48:35.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.602+0000 7f396359e640 1 -- 172.21.15.17:0/616514483 wait complete. 2023-08-09T12:48:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.603+0000 7f396359e640 1 Processor -- start 2023-08-09T12:48:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.604+0000 7f396359e640 1 -- start start 2023-08-09T12:48:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.604+0000 7f396359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f39640c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.604+0000 7f396359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39640ae4f0 0x7f39641f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39641f61d0 0x7f39640b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39641f5a10 con 0x7f394c0039a0 2023-08-09T12:48:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640aec90 con 0x7f39641f61d0 2023-08-09T12:48:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640aef70 con 0x7f39640ae4f0 2023-08-09T12:48:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f39640c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f39640c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57010/0 (socket says 172.21.15.17:57010) 2023-08-09T12:48:35.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396259c640 1 -- 172.21.15.17:0/1738418112 learned_addr learned my addr 172.21.15.17:0/1738418112 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:35.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f3961d9b640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39640ae4f0 0x7f39641f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f3962d9d640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39641f61d0 0x7f39640b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396259c640 1 -- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39640ae4f0 msgr2=0x7f39641f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396259c640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39640ae4f0 0x7f39641f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396259c640 1 -- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39641f61d0 msgr2=0x7f39640b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:35.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396259c640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39641f61d0 0x7f39640b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f396259c640 1 -- 172.21.15.17:0/1738418112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39641f5cb0 con 0x7f394c0039a0 2023-08-09T12:48:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.605+0000 7f3962d9d640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39641f61d0 0x7f39640b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.606+0000 7f396259c640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f39640c7200 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f395400a830 tx=0x7f3954001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.606+0000 7f3952ffd640 1 -- 172.21.15.17:0/1738418112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954044070 con 0x7f394c0039a0 2023-08-09T12:48:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.606+0000 7f3952ffd640 1 -- 172.21.15.17:0/1738418112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954004d70 con 0x7f394c0039a0 2023-08-09T12:48:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.606+0000 7f3952ffd640 1 -- 172.21.15.17:0/1738418112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540070d0 con 0x7f394c0039a0 2023-08-09T12:48:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.606+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39640ae970 con 0x7f394c0039a0 2023-08-09T12:48:35.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.606+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39641f2120 con 0x7f394c0039a0 2023-08-09T12:48:35.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.607+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39641f5e40 con 0x7f394c0039a0 2023-08-09T12:48:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.608+0000 7f3952ffd640 1 -- 172.21.15.17:0/1738418112 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3954031030 con 0x7f394c0039a0 2023-08-09T12:48:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.609+0000 7f3952ffd640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f394406a080 0x7f394406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.609+0000 7f3952ffd640 1 -- 172.21.15.17:0/1738418112 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f39540a9b00 con 0x7f394c0039a0 2023-08-09T12:48:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.610+0000 7f3961d9b640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f394406a080 0x7f394406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:35.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.611+0000 7f3961d9b640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f394406a080 0x7f394406c540 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f39640b09e0 tx=0x7f3958008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:35.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.614+0000 7f3952ffd640 1 -- 172.21.15.17:0/1738418112 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f39540abe60 con 0x7f394c0039a0 2023-08-09T12:48:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:35.873+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f396404e390 con 0x7f394c0039a0 2023-08-09T12:48:36.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.762+0000 7f3952ffd640 1 -- 172.21.15.17:0/1738418112 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v484) v1 ==== 140+0+0 (secure 0 0 0) 0x7f3954075620 con 0x7f394c0039a0 2023-08-09T12:48:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f394406a080 msgr2=0x7f394406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f394406a080 0x7f394406c540 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f39640b09e0 tx=0x7f3958008040 comp rx=0 tx=0).stop 2023-08-09T12:48:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 msgr2=0x7f39640c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f39640c7200 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f395400a830 tx=0x7f3954001d80 comp rx=0 tx=0).stop 2023-08-09T12:48:36.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 shutdown_connections 2023-08-09T12:48:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f394406a080 0x7f394406c540 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39641f61d0 0x7f39640b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39640ae4f0 0x7f39641f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 --2- 172.21.15.17:0/1738418112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c0039a0 0x7f39640c7200 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.765+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 >> 172.21.15.17:0/1738418112 conn(0x7f39640cd2f0 msgr2=0x7f39640ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.766+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 shutdown_connections 2023-08-09T12:48:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:36.766+0000 7f396359e640 1 -- 172.21.15.17:0/1738418112 wait complete. 2023-08-09T12:48:36.792 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-09T12:48:36.792 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-08-09T12:48:36.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-08-09T12:48:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.019+0000 7f871cecc640 1 Processor -- start 2023-08-09T12:48:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.019+0000 7f871cecc640 1 -- start start 2023-08-09T12:48:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.021+0000 7f871cecc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f871815ac00 0x7f87180cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.021+0000 7f871cecc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 0x7f87180adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.021+0000 7f871cecc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871815afe0 con 0x7f87180ad700 2023-08-09T12:48:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.021+0000 7f871cecc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87180ae0f0 con 0x7f871815ac00 2023-08-09T12:48:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.021+0000 7f871cecc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871806c2c0 con 0x7f8718070de0 2023-08-09T12:48:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.021+0000 7f8715d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f87180ad700 0x7f87180706d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60248/0 (socket says 172.21.15.17:60248) 2023-08-09T12:48:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.021+0000 7f8715d9b640 1 -- 172.21.15.17:0/4072239834 learned_addr learned my addr 172.21.15.17:0/4072239834 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:37.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871659c640 1 --2- 172.21.15.17:0/4072239834 >> v2:172.21.15.142:3300/0 conn(0x7f871815ac00 0x7f87180cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:37.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f8716d9d640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 0x7f87180adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:37.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694626214 0 0) 0x7f871815afe0 con 0x7f87180ad700 2023-08-09T12:48:37.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8704003520 con 0x7f87180ad700 2023-08-09T12:48:37.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576897101 0 0) 0x7f8704003520 con 0x7f87180ad700 2023-08-09T12:48:37.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 msgr2=0x7f87180adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:37.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 0x7f87180adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 >> v2:172.21.15.142:3300/0 conn(0x7f871815ac00 msgr2=0x7f87180cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 --2- 172.21.15.17:0/4072239834 >> v2:172.21.15.142:3300/0 conn(0x7f871815ac00 0x7f87180cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871806d0e0 con 0x7f87180ad700 2023-08-09T12:48:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8700001670 con 0x7f87180ad700 2023-08-09T12:48:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 >> v1:172.21.15.17:6789/0 conn(0x7f87180ad700 legacy=0x7f87180706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f8704003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040047c0 0x7f8704004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 0x7f8704005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180ae0f0 con 0x7f8704003970 2023-08-09T12:48:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871806c2c0 con 0x7f87040047c0 2023-08-09T12:48:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.022+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870400ba30 con 0x7f8718070de0 2023-08-09T12:48:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f871659c640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f8704003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f8715d9b640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040047c0 0x7f8704004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f8716d9d640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 0x7f8704005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f871659c640 1 -- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 msgr2=0x7f8704005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f871659c640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 0x7f8704005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f871659c640 1 -- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040047c0 msgr2=0x7f8704004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f871659c640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040047c0 0x7f8704004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f871659c640 1 -- 172.21.15.17:0/4072239834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8704003520 con 0x7f8704003970 2023-08-09T12:48:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.023+0000 7f8716d9d640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8718070de0 0x7f8704005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.025+0000 7f871659c640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f8704003d90 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f8708009f90 tx=0x7f87040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ea5027f0c25cfe server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.025+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870802cb30 con 0x7f8704003970 2023-08-09T12:48:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.025+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800f040 con 0x7f8704003970 2023-08-09T12:48:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.025+0000 7f871559a640 1 -- 172.21.15.17:0/4072239834 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708034440 con 0x7f8704003970 2023-08-09T12:48:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.026+0000 7f871cecc640 1 -- 172.21.15.17:0/4072239834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 msgr2=0x7f8704003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.026+0000 7f871cecc640 1 --2- 172.21.15.17:0/4072239834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f8704003d90 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f8708009f90 tx=0x7f87040057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.026+0000 7f8716d9d640 1 -- 172.21.15.17:0/4072239834 reap_dead start 2023-08-09T12:48:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.026+0000 7f871cecc640 1 -- 172.21.15.17:0/4072239834 shutdown_connections 2023-08-09T12:48:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.026+0000 7f871cecc640 1 -- 172.21.15.17:0/4072239834 >> 172.21.15.17:0/4072239834 conn(0x7f87180cb250 msgr2=0x7f87180cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.026+0000 7f871cecc640 1 -- 172.21.15.17:0/4072239834 shutdown_connections 2023-08-09T12:48:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.026+0000 7f871cecc640 1 -- 172.21.15.17:0/4072239834 wait complete. 2023-08-09T12:48:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.028+0000 7f871cecc640 1 Processor -- start 2023-08-09T12:48:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.028+0000 7f871cecc640 1 -- start start 2023-08-09T12:48:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871cecc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f871815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871cecc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871814a7e0 0x7f8718154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871cecc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180b1890 0x7f87180b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871cecc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180b2280 con 0x7f8704003970 2023-08-09T12:48:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871cecc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87181edfd0 con 0x7f87180b1890 2023-08-09T12:48:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871cecc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8718154540 con 0x7f871814a7e0 2023-08-09T12:48:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f871815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f871815d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57034/0 (socket says 172.21.15.17:57034) 2023-08-09T12:48:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.029+0000 7f871659c640 1 -- 172.21.15.17:0/1102432387 learned_addr learned my addr 172.21.15.17:0/1102432387 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.030+0000 7f871659c640 1 -- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871814a7e0 msgr2=0x7f8718154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.030+0000 7f871659c640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871814a7e0 0x7f8718154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.030+0000 7f871659c640 1 -- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180b1890 msgr2=0x7f87180b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.030+0000 7f8716d9d640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180b1890 0x7f87180b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.030+0000 7f871659c640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180b1890 0x7f87180b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.030+0000 7f871659c640 1 -- 172.21.15.17:0/1102432387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87181547e0 con 0x7f8704003970 2023-08-09T12:48:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.030+0000 7f8716d9d640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180b1890 0x7f87180b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.030+0000 7f871659c640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f871815d6f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f870802c4d0 tx=0x7f8708009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.031+0000 7f870effd640 1 -- 172.21.15.17:0/1102432387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708034d40 con 0x7f8704003970 2023-08-09T12:48:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.031+0000 7f870effd640 1 -- 172.21.15.17:0/1102432387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708040450 con 0x7f8704003970 2023-08-09T12:48:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.031+0000 7f870effd640 1 -- 172.21.15.17:0/1102432387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708040800 con 0x7f8704003970 2023-08-09T12:48:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.031+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8718154ac0 con 0x7f8704003970 2023-08-09T12:48:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.031+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8718155080 con 0x7f8704003970 2023-08-09T12:48:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.032+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8718067a80 con 0x7f8704003970 2023-08-09T12:48:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.033+0000 7f870effd640 1 -- 172.21.15.17:0/1102432387 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8708040960 con 0x7f8704003970 2023-08-09T12:48:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.034+0000 7f870effd640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f86f806a040 0x7f86f806c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.034+0000 7f870effd640 1 -- 172.21.15.17:0/1102432387 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f87080aaab0 con 0x7f8704003970 2023-08-09T12:48:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.035+0000 7f8715d9b640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f86f806a040 0x7f86f806c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.036+0000 7f8715d9b640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f86f806a040 0x7f86f806c500 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8700001050 tx=0x7f8700000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:37.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.038+0000 7f870effd640 1 -- 172.21.15.17:0/1102432387 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f87080765d0 con 0x7f8704003970 2023-08-09T12:48:37.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.303+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f871814d1e0 con 0x7f8704003970 2023-08-09T12:48:37.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.771+0000 7f870effd640 1 -- 172.21.15.17:0/1102432387 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v485) v1 ==== 135+0+0 (secure 0 0 0) 0x7f8708079bf0 con 0x7f8704003970 2023-08-09T12:48:37.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f86f806a040 msgr2=0x7f86f806c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:37.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f86f806a040 0x7f86f806c500 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8700001050 tx=0x7f8700000fe0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 msgr2=0x7f871815d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:37.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f871815d6f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f870802c4d0 tx=0x7f8708009750 comp rx=0 tx=0).stop 2023-08-09T12:48:37.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 shutdown_connections 2023-08-09T12:48:37.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f86f806a040 0x7f86f806c500 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87180b1890 0x7f87180b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f871814a7e0 0x7f8718154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 --2- 172.21.15.17:0/1102432387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8704003970 0x7f871815d6f0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:37.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.775+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 >> 172.21.15.17:0/1102432387 conn(0x7f87180cb250 msgr2=0x7f87180706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:37.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.776+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 shutdown_connections 2023-08-09T12:48:37.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:37.776+0000 7f871cecc640 1 -- 172.21.15.17:0/1102432387 wait complete. 2023-08-09T12:48:37.799 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:38.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.026+0000 7ff53bfff640 1 Processor -- start 2023-08-09T12:48:38.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.026+0000 7ff53bfff640 1 -- start start 2023-08-09T12:48:38.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.028+0000 7ff53bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c1601f0 0x7ff53c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.028+0000 7ff53bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff53c0cb610 0x7ff53c0c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.028+0000 7ff53bfff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c0b34a0 con 0x7ff53c0b2ee0 2023-08-09T12:48:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.028+0000 7ff53bfff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c0b4120 con 0x7ff53c0cb610 2023-08-09T12:48:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.028+0000 7ff53bfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b3780 con 0x7ff53c1601f0 2023-08-09T12:48:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.028+0000 7ff53a7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff53c0b2ee0 0x7ff53c0caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37206/0 (socket says 172.21.15.17:37206) 2023-08-09T12:48:38.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.028+0000 7ff53a7fc640 1 -- 172.21.15.17:0/1218392791 learned_addr learned my addr 172.21.15.17:0/1218392791 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff53affd640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c1601f0 0x7ff53c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff53b7fe640 1 --2- 172.21.15.17:0/1218392791 >> v2:172.21.15.142:3300/0 conn(0x7ff53c0cb610 0x7ff53c0c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595559737 0 0) 0x7ff53c0b34a0 con 0x7ff53c0b2ee0 2023-08-09T12:48:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff524003520 con 0x7ff53c0b2ee0 2023-08-09T12:48:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797604669 0 0) 0x7ff524003520 con 0x7ff53c0b2ee0 2023-08-09T12:48:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c1601f0 msgr2=0x7ff53c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c1601f0 0x7ff53c0b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 >> v2:172.21.15.142:3300/0 conn(0x7ff53c0cb610 msgr2=0x7ff53c0c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 --2- 172.21.15.17:0/1218392791 >> v2:172.21.15.142:3300/0 conn(0x7ff53c0cb610 0x7ff53c0c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0b3a60 con 0x7ff53c0b2ee0 2023-08-09T12:48:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff530001670 con 0x7ff53c0b2ee0 2023-08-09T12:48:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 >> v1:172.21.15.17:6789/0 conn(0x7ff53c0b2ee0 legacy=0x7ff53c0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff524003970 0x7ff524003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5240047c0 0x7ff524004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.029+0000 7ff539ffb640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c1601f0 0x7ff524005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b4120 con 0x7ff524003970 2023-08-09T12:48:38.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b3780 con 0x7ff5240047c0 2023-08-09T12:48:38.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52400b980 con 0x7ff53c1601f0 2023-08-09T12:48:38.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff53affd640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff524003970 0x7ff524003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff53a7fc640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5240047c0 0x7ff524004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff53affd640 1 -- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c1601f0 msgr2=0x7ff524005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff53affd640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c1601f0 0x7ff524005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff53affd640 1 -- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5240047c0 msgr2=0x7ff524004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff53affd640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5240047c0 0x7ff524004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.030+0000 7ff53affd640 1 -- 172.21.15.17:0/1218392791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524003520 con 0x7ff524003970 2023-08-09T12:48:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.031+0000 7ff53affd640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff524003970 0x7ff524003d90 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009ac0 tx=0x7ff5240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60f8eed96a5a117 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c02c710 con 0x7ff524003970 2023-08-09T12:48:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c02c870 con 0x7ff524003970 2023-08-09T12:48:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff539ffb640 1 -- 172.21.15.17:0/1218392791 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c02cc00 con 0x7ff524003970 2023-08-09T12:48:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff53bfff640 1 -- 172.21.15.17:0/1218392791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff524003970 msgr2=0x7ff524003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff53bfff640 1 --2- 172.21.15.17:0/1218392791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff524003970 0x7ff524003d90 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009ac0 tx=0x7ff5240057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff53b7fe640 1 -- 172.21.15.17:0/1218392791 reap_dead start 2023-08-09T12:48:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff53bfff640 1 -- 172.21.15.17:0/1218392791 shutdown_connections 2023-08-09T12:48:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff53bfff640 1 -- 172.21.15.17:0/1218392791 >> 172.21.15.17:0/1218392791 conn(0x7ff53c0b1d50 msgr2=0x7ff53c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff53bfff640 1 -- 172.21.15.17:0/1218392791 shutdown_connections 2023-08-09T12:48:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.032+0000 7ff53bfff640 1 -- 172.21.15.17:0/1218392791 wait complete. 2023-08-09T12:48:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.034+0000 7ff53bfff640 1 Processor -- start 2023-08-09T12:48:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.034+0000 7ff53bfff640 1 -- start start 2023-08-09T12:48:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.035+0000 7ff53bfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff524003970 0x7ff53c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.035+0000 7ff53bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff53c155d70 0x7ff53c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.035+0000 7ff53bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c0cd0f0 0x7ff53c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.035+0000 7ff53bfff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c156ac0 con 0x7ff53c155d70 2023-08-09T12:48:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.035+0000 7ff53bfff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0cd570 con 0x7ff524003970 2023-08-09T12:48:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.035+0000 7ff53bfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c15cad0 con 0x7ff53c0cd0f0 2023-08-09T12:48:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.035+0000 7ff53a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff53c155d70 0x7ff53c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff53c155d70 0x7ff53c0ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41864/0 (socket says 172.21.15.17:41864) 2023-08-09T12:48:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53a7fc640 1 -- 172.21.15.17:0/197573311 learned_addr learned my addr 172.21.15.17:0/197573311 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53affd640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff524003970 0x7ff53c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53a7fc640 1 -- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c0cd0f0 msgr2=0x7ff53c15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53b7fe640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c0cd0f0 0x7ff53c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53a7fc640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c0cd0f0 0x7ff53c15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53a7fc640 1 -- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff524003970 msgr2=0x7ff53c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53a7fc640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff524003970 0x7ff53c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53a7fc640 1 -- 172.21.15.17:0/197573311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0acdf0 con 0x7ff53c155d70 2023-08-09T12:48:38.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53affd640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff524003970 0x7ff53c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:38.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.036+0000 7ff53a7fc640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff53c155d70 0x7ff53c0ccbb0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e840 tx=0x7ff53000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.037+0000 7ff5237fe640 1 -- 172.21.15.17:0/197573311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000c8d0 con 0x7ff53c155d70 2023-08-09T12:48:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.037+0000 7ff5237fe640 1 -- 172.21.15.17:0/197573311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53000ca30 con 0x7ff53c155d70 2023-08-09T12:48:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.037+0000 7ff5237fe640 1 -- 172.21.15.17:0/197573311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000cde0 con 0x7ff53c155d70 2023-08-09T12:48:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.037+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c15c510 con 0x7ff53c155d70 2023-08-09T12:48:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.037+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c1566e0 con 0x7ff53c155d70 2023-08-09T12:48:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.038+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c156c00 con 0x7ff53c155d70 2023-08-09T12:48:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.039+0000 7ff5237fe640 1 -- 172.21.15.17:0/197573311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff53001d460 con 0x7ff53c155d70 2023-08-09T12:48:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.040+0000 7ff5237fe640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff52806a050 0x7ff52806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.040+0000 7ff5237fe640 1 -- 172.21.15.17:0/197573311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff5300881f0 con 0x7ff53c155d70 2023-08-09T12:48:38.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.041+0000 7ff53affd640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff52806a050 0x7ff52806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.042+0000 7ff53affd640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff52806a050 0x7ff52806c510 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff52c036000 tx=0x7ff52c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.045+0000 7ff5237fe640 1 -- 172.21.15.17:0/197573311 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff53c156c00 con 0x7ff53c155d70 2023-08-09T12:48:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.237+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff53c156c00 con 0x7ff53c155d70 2023-08-09T12:48:38.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.239+0000 7ff5237fe640 1 -- 172.21.15.17:0/197573311 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+14756 (secure 0 0 0) 0x7ff53c156c00 con 0x7ff53c155d70 2023-08-09T12:48:38.242 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:38.243 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":153,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:34.854412+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/4116172429":"2023-08-10T12:48:31.730880+0000","172.21.15.17:6834/4116172429":"2023-08-10T12:48:31.730880+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.241+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff52806a050 msgr2=0x7ff52806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.241+0000 7ff53bfff640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff52806a050 0x7ff52806c510 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff52c036000 tx=0x7ff52c030000 comp rx=0 tx=0).stop 2023-08-09T12:48:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.241+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff53c155d70 msgr2=0x7ff53c0ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.241+0000 7ff53bfff640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff53c155d70 0x7ff53c0ccbb0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e840 tx=0x7ff53000ed00 comp rx=0 tx=0).stop 2023-08-09T12:48:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.242+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 shutdown_connections 2023-08-09T12:48:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.242+0000 7ff53bfff640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff52806a050 0x7ff52806c510 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.242+0000 7ff53bfff640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c0cd0f0 0x7ff53c15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.242+0000 7ff53bfff640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff53c155d70 0x7ff53c0ccbb0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.242+0000 7ff53bfff640 1 --2- 172.21.15.17:0/197573311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff524003970 0x7ff53c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.242+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 >> 172.21.15.17:0/197573311 conn(0x7ff53c0b1d50 msgr2=0x7ff53c15f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:38.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.242+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 shutdown_connections 2023-08-09T12:48:38.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.242+0000 7ff53bfff640 1 -- 172.21.15.17:0/197573311 wait complete. 2023-08-09T12:48:38.264 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:48:38.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:48:38.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.491+0000 7f5902f53640 1 Processor -- start 2023-08-09T12:48:38.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.491+0000 7f5902f53640 1 -- start start 2023-08-09T12:48:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.493+0000 7f5902f53640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58fc0b3d60 0x7f58fc0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.493+0000 7f5902f53640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0b2b90 con 0x7f58fc159bd0 2023-08-09T12:48:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.493+0000 7f5902f53640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0b2580 con 0x7f58fc0cc6b0 2023-08-09T12:48:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.493+0000 7f5902f53640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc0cabb0 con 0x7f58fc0b3d60 2023-08-09T12:48:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.493+0000 7f5901750640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58fc0b3d60 0x7f58fc0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.493+0000 7f5901750640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58fc0b3d60 0x7f58fc0cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41872/0 (socket says 172.21.15.17:41872) 2023-08-09T12:48:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.493+0000 7f5901750640 1 -- 172.21.15.17:0/718350231 learned_addr learned my addr 172.21.15.17:0/718350231 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.494+0000 7f5901750640 1 -- 172.21.15.17:0/718350231 >> v1:172.21.15.142:6789/0 conn(0x7f58fc0cc6b0 legacy=0x7f58fc0b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.494+0000 7f5901750640 1 -- 172.21.15.17:0/718350231 >> v1:172.21.15.17:6789/0 conn(0x7f58fc159bd0 legacy=0x7f58fc0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.494+0000 7f5900f4f640 1 -- 172.21.15.17:0/718350231 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925649391 0 0) 0x7f58fc0b2b90 con 0x7f58fc159bd0 2023-08-09T12:48:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.494+0000 7f5901750640 1 -- 172.21.15.17:0/718350231 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0ca5f0 con 0x7f58fc0b3d60 2023-08-09T12:48:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.495+0000 7f5901750640 1 --2- 172.21.15.17:0/718350231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc0b3d60 0x7f58fc0cc170 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f58f000bb10 tx=0x7f58f002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebd76e0569bacc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.495+0000 7f5900f4f640 1 -- 172.21.15.17:0/718350231 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0036440 con 0x7f58fc0b3d60 2023-08-09T12:48:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.496+0000 7f5900f4f640 1 -- 172.21.15.17:0/718350231 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f00365a0 con 0x7f58fc0b3d60 2023-08-09T12:48:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.496+0000 7f5900f4f640 1 -- 172.21.15.17:0/718350231 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0036930 con 0x7f58fc0b3d60 2023-08-09T12:48:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.496+0000 7f5902f53640 1 -- 172.21.15.17:0/718350231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc0b3d60 msgr2=0x7f58fc0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.496+0000 7f5902f53640 1 --2- 172.21.15.17:0/718350231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc0b3d60 0x7f58fc0cc170 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f58f000bb10 tx=0x7f58f002e170 comp rx=0 tx=0).stop 2023-08-09T12:48:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.496+0000 7f5902f53640 1 -- 172.21.15.17:0/718350231 shutdown_connections 2023-08-09T12:48:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.496+0000 7f5902f53640 1 --2- 172.21.15.17:0/718350231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc0b3d60 0x7f58fc0cc170 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.496+0000 7f5902f53640 1 -- 172.21.15.17:0/718350231 >> 172.21.15.17:0/718350231 conn(0x7f58fc0cb020 msgr2=0x7f58fc0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.496+0000 7f5902f53640 1 -- 172.21.15.17:0/718350231 shutdown_connections 2023-08-09T12:48:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.497+0000 7f5902f53640 1 -- 172.21.15.17:0/718350231 wait complete. 2023-08-09T12:48:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.499+0000 7f5902f53640 1 Processor -- start 2023-08-09T12:48:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.499+0000 7f5902f53640 1 -- start start 2023-08-09T12:48:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.500+0000 7f5902f53640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b3d60 0x7f58fc14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.500+0000 7f5902f53640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58fc0cc6b0 0x7f58fc0c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902f53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc159bd0 0x7f58fc0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902f53640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc14d270 con 0x7f58fc159bd0 2023-08-09T12:48:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902f53640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc06f160 con 0x7f58fc0b3d60 2023-08-09T12:48:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902f53640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0c3250 con 0x7f58fc0cc6b0 2023-08-09T12:48:38.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902752640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc159bd0 0x7f58fc0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902752640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc159bd0 0x7f58fc0ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41876/0 (socket says 172.21.15.17:41876) 2023-08-09T12:48:38.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902752640 1 -- 172.21.15.17:0/4172955106 learned_addr learned my addr 172.21.15.17:0/4172955106 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5901f51640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b3d60 0x7f58fc14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5901750640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58fc0cc6b0 0x7f58fc0c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902752640 1 -- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58fc0cc6b0 msgr2=0x7f58fc0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902752640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58fc0cc6b0 0x7f58fc0c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902752640 1 -- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b3d60 msgr2=0x7f58fc14cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902752640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b3d60 0x7f58fc14cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5902752640 1 -- 172.21.15.17:0/4172955106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f000b770 con 0x7f58fc159bd0 2023-08-09T12:48:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.501+0000 7f5901750640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58fc0cc6b0 0x7f58fc0c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.502+0000 7f5902752640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc159bd0 0x7f58fc0ce580 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c410 tx=0x7f58f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.502+0000 7f58fa7fc640 1 -- 172.21.15.17:0/4172955106 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40035f0 con 0x7f58fc159bd0 2023-08-09T12:48:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.502+0000 7f58fa7fc640 1 -- 172.21.15.17:0/4172955106 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f4003750 con 0x7f58fc159bd0 2023-08-09T12:48:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.502+0000 7f58fa7fc640 1 -- 172.21.15.17:0/4172955106 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4003b00 con 0x7f58fc159bd0 2023-08-09T12:48:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.502+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc0c2f70 con 0x7f58fc159bd0 2023-08-09T12:48:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.502+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc06edf0 con 0x7f58fc159bd0 2023-08-09T12:48:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.503+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc0b36b0 con 0x7f58fc159bd0 2023-08-09T12:48:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.504+0000 7f58fa7fc640 1 -- 172.21.15.17:0/4172955106 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f58f4003c60 con 0x7f58fc159bd0 2023-08-09T12:48:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.505+0000 7f58fa7fc640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f58e806a050 0x7f58e806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.505+0000 7f58fa7fc640 1 -- 172.21.15.17:0/4172955106 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f58f4087550 con 0x7f58fc159bd0 2023-08-09T12:48:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.506+0000 7f5901f51640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f58e806a050 0x7f58e806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.507+0000 7f5901f51640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f58e806a050 0x7f58e806c510 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f58ec007fd0 tx=0x7f58ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.509+0000 7f58fa7fc640 1 -- 172.21.15.17:0/4172955106 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f58f4052ec0 con 0x7f58fc159bd0 2023-08-09T12:48:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.701+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58fc04e390 con 0x7f58fc159bd0 2023-08-09T12:48:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.702+0000 7f58fa7fc640 1 -- 172.21.15.17:0/4172955106 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58f40564e0 con 0x7f58fc159bd0 2023-08-09T12:48:38.705 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:48:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f58e806a050 msgr2=0x7f58e806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f58e806a050 0x7f58e806c510 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f58ec007fd0 tx=0x7f58ec009040 comp rx=0 tx=0).stop 2023-08-09T12:48:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc159bd0 msgr2=0x7f58fc0ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc159bd0 0x7f58fc0ce580 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c410 tx=0x7f58f400c8d0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 shutdown_connections 2023-08-09T12:48:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f58e806a050 0x7f58e806c510 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58fc159bd0 0x7f58fc0ce580 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58fc0cc6b0 0x7f58fc0c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 --2- 172.21.15.17:0/4172955106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b3d60 0x7f58fc14cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 >> 172.21.15.17:0/4172955106 conn(0x7f58fc0cb020 msgr2=0x7f58fc0cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:38.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 shutdown_connections 2023-08-09T12:48:38.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.704+0000 7f5902f53640 1 -- 172.21.15.17:0/4172955106 wait complete. 2023-08-09T12:48:38.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:48:38.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.956+0000 7fcf582ba640 1 Processor -- start 2023-08-09T12:48:38.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.956+0000 7fcf582ba640 1 -- start start 2023-08-09T12:48:38.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.958+0000 7fcf582ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf500697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.958+0000 7fcf582ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf50069d00 0x7fcf5006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.958+0000 7fcf582ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf5006d020 0x7fcf50072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.958+0000 7fcf582ba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5006d4b0 con 0x7fcf50069d00 2023-08-09T12:48:38.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.958+0000 7fcf582ba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5006c090 con 0x7fcf5006d020 2023-08-09T12:48:38.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.958+0000 7fcf582ba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500aeb50 con 0x7fcf5015cc50 2023-08-09T12:48:38.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf55855640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf50069d00 0x7fcf5006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf55855640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf50069d00 0x7fcf5006cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41890/0 (socket says 172.21.15.17:41890) 2023-08-09T12:48:38.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf55855640 1 -- 172.21.15.17:0/785918966 learned_addr learned my addr 172.21.15.17:0/785918966 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:38.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf56056640 1 --2- 172.21.15.17:0/785918966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf500697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf56857640 1 --2- 172.21.15.17:0/785918966 >> v2:172.21.15.142:3300/0 conn(0x7fcf5006d020 0x7fcf50072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf55855640 1 -- 172.21.15.17:0/785918966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 msgr2=0x7fcf500697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:38.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf55855640 1 --2- 172.21.15.17:0/785918966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf500697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf55855640 1 -- 172.21.15.17:0/785918966 >> v2:172.21.15.142:3300/0 conn(0x7fcf5006d020 msgr2=0x7fcf50072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:38.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf55855640 1 --2- 172.21.15.17:0/785918966 >> v2:172.21.15.142:3300/0 conn(0x7fcf5006d020 0x7fcf50072850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.959+0000 7fcf55855640 1 -- 172.21.15.17:0/785918966 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500cbc80 con 0x7fcf50069d00 2023-08-09T12:48:38.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.961+0000 7fcf55855640 1 --2- 172.21.15.17:0/785918966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006cae0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fcf5006d620 tx=0x7fcf4002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3abf7672f52a262 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.961+0000 7fcf55054640 1 -- 172.21.15.17:0/785918966 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40031880 con 0x7fcf50069d00 2023-08-09T12:48:38.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.961+0000 7fcf55054640 1 -- 172.21.15.17:0/785918966 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf400319e0 con 0x7fcf50069d00 2023-08-09T12:48:38.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.961+0000 7fcf55054640 1 -- 172.21.15.17:0/785918966 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40031d70 con 0x7fcf50069d00 2023-08-09T12:48:38.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 -- 172.21.15.17:0/785918966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 msgr2=0x7fcf5006cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 --2- 172.21.15.17:0/785918966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006cae0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fcf5006d620 tx=0x7fcf4002b920 comp rx=0 tx=0).stop 2023-08-09T12:48:38.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 -- 172.21.15.17:0/785918966 shutdown_connections 2023-08-09T12:48:38.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 --2- 172.21.15.17:0/785918966 >> v2:172.21.15.142:3300/0 conn(0x7fcf5006d020 0x7fcf50072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 --2- 172.21.15.17:0/785918966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006cae0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 --2- 172.21.15.17:0/785918966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf500697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 -- 172.21.15.17:0/785918966 >> 172.21.15.17:0/785918966 conn(0x7fcf500cc2e0 msgr2=0x7fcf500cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:38.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 -- 172.21.15.17:0/785918966 shutdown_connections 2023-08-09T12:48:38.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.962+0000 7fcf582ba640 1 -- 172.21.15.17:0/785918966 wait complete. 2023-08-09T12:48:38.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.964+0000 7fcf582ba640 1 Processor -- start 2023-08-09T12:48:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.964+0000 7fcf582ba640 1 -- start start 2023-08-09T12:48:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf582ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf582ba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf5006d020 0x7fcf500b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf582ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf50144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf582ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500b5800 con 0x7fcf50069d00 2023-08-09T12:48:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf582ba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500b4bf0 con 0x7fcf5006d020 2023-08-09T12:48:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf582ba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500b4ed0 con 0x7fcf5015cc50 2023-08-09T12:48:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf56056640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf56056640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41904/0 (socket says 172.21.15.17:41904) 2023-08-09T12:48:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.965+0000 7fcf56056640 1 -- 172.21.15.17:0/2650811109 learned_addr learned my addr 172.21.15.17:0/2650811109 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf56857640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf50144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf55855640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf5006d020 0x7fcf500b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf56056640 1 -- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 msgr2=0x7fcf50144140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf56056640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf50144140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf56056640 1 -- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf5006d020 msgr2=0x7fcf500b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf56056640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf5006d020 0x7fcf500b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf56056640 1 -- 172.21.15.17:0/2650811109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400094d0 con 0x7fcf50069d00 2023-08-09T12:48:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf56857640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf50144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf55855640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf5006d020 0x7fcf500b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf56056640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006a370 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00d5f0 tx=0x7fcf4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf46ffd640 1 -- 172.21.15.17:0/2650811109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0125f0 con 0x7fcf50069d00 2023-08-09T12:48:38.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf46ffd640 1 -- 172.21.15.17:0/2650811109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c012750 con 0x7fcf50069d00 2023-08-09T12:48:38.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.966+0000 7fcf46ffd640 1 -- 172.21.15.17:0/2650811109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c012b00 con 0x7fcf50069d00 2023-08-09T12:48:38.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.967+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500b51b0 con 0x7fcf50069d00 2023-08-09T12:48:38.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.967+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5006a8b0 con 0x7fcf50069d00 2023-08-09T12:48:38.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.968+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf500cba00 con 0x7fcf50069d00 2023-08-09T12:48:38.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.969+0000 7fcf46ffd640 1 -- 172.21.15.17:0/2650811109 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf4c012c60 con 0x7fcf50069d00 2023-08-09T12:48:38.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.970+0000 7fcf46ffd640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf3406a050 0x7fcf3406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:38.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.970+0000 7fcf46ffd640 1 -- 172.21.15.17:0/2650811109 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcf4c088740 con 0x7fcf50069d00 2023-08-09T12:48:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.970+0000 7fcf55855640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf3406a050 0x7fcf3406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.971+0000 7fcf55855640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf3406a050 0x7fcf3406c510 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcf40036000 tx=0x7fcf4003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:38.974+0000 7fcf46ffd640 1 -- 172.21.15.17:0/2650811109 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcf4c054140 con 0x7fcf50069d00 2023-08-09T12:48:39.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.168+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcf5006aa40 con 0x7fcf50069d00 2023-08-09T12:48:39.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.169+0000 7fcf46ffd640 1 -- 172.21.15.17:0/2650811109 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v153) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf4c057760 con 0x7fcf50069d00 2023-08-09T12:48:39.172 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:48:39.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf3406a050 msgr2=0x7fcf3406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:39.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf3406a050 0x7fcf3406c510 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcf40036000 tx=0x7fcf4003c040 comp rx=0 tx=0).stop 2023-08-09T12:48:39.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 msgr2=0x7fcf5006a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:39.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006a370 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00d5f0 tx=0x7fcf4c00dab0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 shutdown_connections 2023-08-09T12:48:39.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf3406a050 0x7fcf3406c510 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf5015cc50 0x7fcf50144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf5006d020 0x7fcf500b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 --2- 172.21.15.17:0/2650811109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf50069d00 0x7fcf5006a370 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 >> 172.21.15.17:0/2650811109 conn(0x7fcf500cc2e0 msgr2=0x7fcf500caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:39.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 shutdown_connections 2023-08-09T12:48:39.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.172+0000 7fcf582ba640 1 -- 172.21.15.17:0/2650811109 wait complete. 2023-08-09T12:48:39.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:48:39.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.418+0000 7fe148f24640 1 Processor -- start 2023-08-09T12:48:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.418+0000 7fe148f24640 1 -- start start 2023-08-09T12:48:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.420+0000 7fe148f24640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 0x7fe1440cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.420+0000 7fe148f24640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe1440b21c0 0x7fe1440c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.420+0000 7fe148f24640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440c8c30 con 0x7fe1440c2670 2023-08-09T12:48:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.420+0000 7fe148f24640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1440cb9d0 con 0x7fe1440b21c0 2023-08-09T12:48:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.420+0000 7fe148f24640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440c8e80 con 0x7fe14415ab40 2023-08-09T12:48:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.421+0000 7fe142ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe1440b21c0 0x7fe1440c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.421+0000 7fe142ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe1440b21c0 0x7fe1440c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41920/0 (socket says 172.21.15.17:41920) 2023-08-09T12:48:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.421+0000 7fe142ffd640 1 -- 172.21.15.17:0/4207186726 learned_addr learned my addr 172.21.15.17:0/4207186726 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.421+0000 7fe1437fe640 1 --2- 172.21.15.17:0/4207186726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 0x7fe1440cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.421+0000 7fe142ffd640 1 -- 172.21.15.17:0/4207186726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 msgr2=0x7fe1440cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.421+0000 7fe142ffd640 1 --2- 172.21.15.17:0/4207186726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 0x7fe1440cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.421+0000 7fe142ffd640 1 -- 172.21.15.17:0/4207186726 >> v1:172.21.15.142:6789/0 conn(0x7fe1440c2670 legacy=0x7fe1440c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.421+0000 7fe142ffd640 1 -- 172.21.15.17:0/4207186726 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1440c9160 con 0x7fe1440b21c0 2023-08-09T12:48:39.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.422+0000 7fe142ffd640 1 --2- 172.21.15.17:0/4207186726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe1440c2130 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe138009870 tx=0x7fe13802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08095ffd1f124d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:39.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe1427fc640 1 -- 172.21.15.17:0/4207186726 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138030840 con 0x7fe1440b21c0 2023-08-09T12:48:39.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe1427fc640 1 -- 172.21.15.17:0/4207186726 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380309a0 con 0x7fe1440b21c0 2023-08-09T12:48:39.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe1427fc640 1 -- 172.21.15.17:0/4207186726 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138030d30 con 0x7fe1440b21c0 2023-08-09T12:48:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe148f24640 1 -- 172.21.15.17:0/4207186726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 msgr2=0x7fe1440c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe148f24640 1 --2- 172.21.15.17:0/4207186726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe1440c2130 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe138009870 tx=0x7fe13802b980 comp rx=0 tx=0).stop 2023-08-09T12:48:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe148f24640 1 -- 172.21.15.17:0/4207186726 shutdown_connections 2023-08-09T12:48:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe148f24640 1 --2- 172.21.15.17:0/4207186726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe1440c2130 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe148f24640 1 --2- 172.21.15.17:0/4207186726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 0x7fe1440cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.423+0000 7fe148f24640 1 -- 172.21.15.17:0/4207186726 >> 172.21.15.17:0/4207186726 conn(0x7fe14406abd0 msgr2=0x7fe14406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.424+0000 7fe148f24640 1 -- 172.21.15.17:0/4207186726 shutdown_connections 2023-08-09T12:48:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.424+0000 7fe148f24640 1 -- 172.21.15.17:0/4207186726 wait complete. 2023-08-09T12:48:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.425+0000 7fe148f24640 1 Processor -- start 2023-08-09T12:48:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.425+0000 7fe148f24640 1 -- start start 2023-08-09T12:48:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.426+0000 7fe148f24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe14406f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.426+0000 7fe148f24640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1440c2670 0x7fe144071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.426+0000 7fe148f24640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 0x7fe144156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.426+0000 7fe148f24640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415c630 con 0x7fe1440b21c0 2023-08-09T12:48:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.426+0000 7fe148f24640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440718d0 con 0x7fe1440c2670 2023-08-09T12:48:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.426+0000 7fe148f24640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415c8d0 con 0x7fe14415ab40 2023-08-09T12:48:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe1437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe14406f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe1437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe14406f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41928/0 (socket says 172.21.15.17:41928) 2023-08-09T12:48:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe1437fe640 1 -- 172.21.15.17:0/1168685993 learned_addr learned my addr 172.21.15.17:0/1168685993 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe142ffd640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1440c2670 0x7fe144071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe143fff640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 0x7fe144156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe1437fe640 1 -- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 msgr2=0x7fe144156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe1437fe640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 0x7fe144156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe1437fe640 1 -- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1440c2670 msgr2=0x7fe144071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe1437fe640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1440c2670 0x7fe144071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.427+0000 7fe1437fe640 1 -- 172.21.15.17:0/1168685993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1380094d0 con 0x7fe1440b21c0 2023-08-09T12:48:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.428+0000 7fe1437fe640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe14406f5c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe13400d800 tx=0x7fe13400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.428+0000 7fe12bfff640 1 -- 172.21.15.17:0/1168685993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13400b6c0 con 0x7fe1440b21c0 2023-08-09T12:48:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.428+0000 7fe12bfff640 1 -- 172.21.15.17:0/1168685993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13400b840 con 0x7fe1440b21c0 2023-08-09T12:48:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.428+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe144070540 con 0x7fe1440b21c0 2023-08-09T12:48:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.428+0000 7fe12bfff640 1 -- 172.21.15.17:0/1168685993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13400bbf0 con 0x7fe1440b21c0 2023-08-09T12:48:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.428+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14406ff80 con 0x7fe1440b21c0 2023-08-09T12:48:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.429+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14404e390 con 0x7fe1440b21c0 2023-08-09T12:48:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.430+0000 7fe12bfff640 1 -- 172.21.15.17:0/1168685993 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe13400bd50 con 0x7fe1440b21c0 2023-08-09T12:48:39.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.431+0000 7fe12bfff640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe13006a050 0x7fe13006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:39.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.431+0000 7fe12bfff640 1 -- 172.21.15.17:0/1168685993 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe134088830 con 0x7fe1440b21c0 2023-08-09T12:48:39.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.432+0000 7fe142ffd640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe13006a050 0x7fe13006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:39.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.433+0000 7fe142ffd640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe13006a050 0x7fe13006c510 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe138036000 tx=0x7fe13803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:39.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.436+0000 7fe12bfff640 1 -- 172.21.15.17:0/1168685993 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe134054230 con 0x7fe1440b21c0 2023-08-09T12:48:39.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.631+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe1440aeb70 con 0x7fe1440b21c0 2023-08-09T12:48:39.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.638+0000 7fe12bfff640 1 -- 172.21.15.17:0/1168685993 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe134057850 con 0x7fe1440b21c0 2023-08-09T12:48:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe13006a050 msgr2=0x7fe13006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe13006a050 0x7fe13006c510 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe138036000 tx=0x7fe13803b040 comp rx=0 tx=0).stop 2023-08-09T12:48:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 msgr2=0x7fe14406f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe14406f5c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe13400d800 tx=0x7fe13400dcc0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 shutdown_connections 2023-08-09T12:48:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe13006a050 0x7fe13006c510 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe14415ab40 0x7fe144156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1440c2670 0x7fe144071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 --2- 172.21.15.17:0/1168685993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1440b21c0 0x7fe14406f5c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.640+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 >> 172.21.15.17:0/1168685993 conn(0x7fe14406abd0 msgr2=0x7fe14406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.641+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 shutdown_connections 2023-08-09T12:48:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:39.641+0000 7fe148f24640 1 -- 172.21.15.17:0/1168685993 wait complete. 2023-08-09T12:48:39.663 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:48:39.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:48:39.797 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:48:39.925 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:48:39.925 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:48:39.926 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:39.990 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:48:39.990 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:48:39.991 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:40.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:48:40.051 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:48:40.051 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:40.117 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:48:40.118 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:48:40.118 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:48:40.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:48:40.179 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:48:40.179 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:40.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.412+0000 7f971a374640 1 Processor -- start 2023-08-09T12:48:40.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.412+0000 7f971a374640 1 -- start start 2023-08-09T12:48:40.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.414+0000 7f971a374640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97140b86e0 0x7f97140cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.414+0000 7f971a374640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97140cf980 0x7f97140d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.414+0000 7f971a374640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97140b5a30 con 0x7f9714160030 2023-08-09T12:48:40.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.414+0000 7f971a374640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97140d1110 con 0x7f97140b86e0 2023-08-09T12:48:40.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.414+0000 7f971a374640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97140ceac0 con 0x7f97140cf980 2023-08-09T12:48:40.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.414+0000 7f9718b71640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97140b86e0 0x7f97140cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.414+0000 7f9718b71640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97140b86e0 0x7f97140cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41936/0 (socket says 172.21.15.17:41936) 2023-08-09T12:48:40.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.414+0000 7f9718b71640 1 -- 172.21.15.17:0/3936223957 learned_addr learned my addr 172.21.15.17:0/3936223957 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.415+0000 7f9718b71640 1 -- 172.21.15.17:0/3936223957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97140cf980 msgr2=0x7f97140d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.415+0000 7f9718b71640 1 --2- 172.21.15.17:0/3936223957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97140cf980 0x7f97140d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.415+0000 7f9718b71640 1 -- 172.21.15.17:0/3936223957 >> v1:172.21.15.142:6789/0 conn(0x7f9714160030 legacy=0x7f9714160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.415+0000 7f9718b71640 1 -- 172.21.15.17:0/3936223957 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97140d0d70 con 0x7f97140b86e0 2023-08-09T12:48:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.416+0000 7f9718b71640 1 --2- 172.21.15.17:0/3936223957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140cf440 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f9704009870 tx=0x7f970402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b383c61a528fe7f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.416+0000 7f970bfff640 1 -- 172.21.15.17:0/3936223957 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704031640 con 0x7f97140b86e0 2023-08-09T12:48:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.416+0000 7f970bfff640 1 -- 172.21.15.17:0/3936223957 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97040317a0 con 0x7f97140b86e0 2023-08-09T12:48:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.416+0000 7f970bfff640 1 -- 172.21.15.17:0/3936223957 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704031b30 con 0x7f97140b86e0 2023-08-09T12:48:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.417+0000 7f971a374640 1 -- 172.21.15.17:0/3936223957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 msgr2=0x7f97140cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.417+0000 7f971a374640 1 --2- 172.21.15.17:0/3936223957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140cf440 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f9704009870 tx=0x7f970402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.417+0000 7f971a374640 1 -- 172.21.15.17:0/3936223957 shutdown_connections 2023-08-09T12:48:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.417+0000 7f971a374640 1 --2- 172.21.15.17:0/3936223957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97140cf980 0x7f97140d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.417+0000 7f971a374640 1 --2- 172.21.15.17:0/3936223957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140cf440 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.417+0000 7f971a374640 1 -- 172.21.15.17:0/3936223957 >> 172.21.15.17:0/3936223957 conn(0x7f97140697c0 msgr2=0x7f9714069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.417+0000 7f971a374640 1 -- 172.21.15.17:0/3936223957 shutdown_connections 2023-08-09T12:48:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.417+0000 7f971a374640 1 -- 172.21.15.17:0/3936223957 wait complete. 2023-08-09T12:48:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.419+0000 7f971a374640 1 Processor -- start 2023-08-09T12:48:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.419+0000 7f971a374640 1 -- start start 2023-08-09T12:48:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f971a374640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f971a374640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97140cf980 0x7f97140cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f971a374640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9714160030 0x7f971415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f971a374640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97141521f0 con 0x7f97140b86e0 2023-08-09T12:48:40.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f971a374640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97141524d0 con 0x7f97140cf980 2023-08-09T12:48:40.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f971a374640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97141527b0 con 0x7f9714160030 2023-08-09T12:48:40.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f9719372640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f9719372640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41948/0 (socket says 172.21.15.17:41948) 2023-08-09T12:48:40.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f9719372640 1 -- 172.21.15.17:0/511900683 learned_addr learned my addr 172.21.15.17:0/511900683 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:40.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f9718b71640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97140cf980 0x7f97140cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.420+0000 7f9719b73640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9714160030 0x7f971415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9719372640 1 -- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9714160030 msgr2=0x7f971415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9719372640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9714160030 0x7f971415c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9719372640 1 -- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97140cf980 msgr2=0x7f97140cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9719372640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97140cf980 0x7f97140cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9719372640 1 -- 172.21.15.17:0/511900683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040094d0 con 0x7f97140b86e0 2023-08-09T12:48:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9718b71640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97140cf980 0x7f97140cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:40.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9719372640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140b4f30 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f971000b3e0 tx=0x7f971000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:40.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9709ffb640 1 -- 172.21.15.17:0/511900683 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710011830 con 0x7f97140b86e0 2023-08-09T12:48:40.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9709ffb640 1 -- 172.21.15.17:0/511900683 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97100119b0 con 0x7f97140b86e0 2023-08-09T12:48:40.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f9709ffb640 1 -- 172.21.15.17:0/511900683 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710011d60 con 0x7f97140b86e0 2023-08-09T12:48:40.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9714152a90 con 0x7f97140b86e0 2023-08-09T12:48:40.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.421+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9714153ad0 con 0x7f97140b86e0 2023-08-09T12:48:40.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.422+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971404e390 con 0x7f97140b86e0 2023-08-09T12:48:40.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.424+0000 7f9709ffb640 1 -- 172.21.15.17:0/511900683 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f971001a400 con 0x7f97140b86e0 2023-08-09T12:48:40.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.425+0000 7f9709ffb640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96f806a050 0x7f96f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.425+0000 7f9709ffb640 1 -- 172.21.15.17:0/511900683 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f97100884e0 con 0x7f97140b86e0 2023-08-09T12:48:40.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.426+0000 7f9718b71640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96f806a050 0x7f96f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.427+0000 7f9718b71640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96f806a050 0x7f96f806c510 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9704036000 tx=0x7f970403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:40.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.430+0000 7f9709ffb640 1 -- 172.21.15.17:0/511900683 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9710053e50 con 0x7f97140b86e0 2023-08-09T12:48:40.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.659+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97140d0640 con 0x7f97140b86e0 2023-08-09T12:48:40.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.660+0000 7f9709ffb640 1 -- 172.21.15.17:0/511900683 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f9710015e90 con 0x7f97140b86e0 2023-08-09T12:48:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:40.664 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/832761690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":832761690},{"type":"v1","addr":"172.21.15.142:6837","nonce":832761690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/285647564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":285647564},{"type":"v1","addr":"172.21.15.142:6835","nonce":285647564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1294682496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1294682496},{"type":"v1","addr":"172.21.15.17:6833","nonce":1294682496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":8430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2410225756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2410225756},{"type":"v1","addr":"172.21.15.17:6835","nonce":2410225756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[]} 2023-08-09T12:48:40.664 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 69 2023-08-09T12:48:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96f806a050 msgr2=0x7f96f806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96f806a050 0x7f96f806c510 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9704036000 tx=0x7f970403c040 comp rx=0 tx=0).stop 2023-08-09T12:48:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 msgr2=0x7f97140b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140b4f30 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f971000b3e0 tx=0x7f971000b8a0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 shutdown_connections 2023-08-09T12:48:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f96f806a050 0x7f96f806c510 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9714160030 0x7f971415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97140cf980 0x7f97140cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 --2- 172.21.15.17:0/511900683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97140b86e0 0x7f97140b4f30 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.663+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 >> 172.21.15.17:0/511900683 conn(0x7f97140697c0 msgr2=0x7f97140c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.664+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 shutdown_connections 2023-08-09T12:48:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.664+0000 7f971a374640 1 -- 172.21.15.17:0/511900683 wait complete. 2023-08-09T12:48:40.685 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:48:40.686 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:48:40.686 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:48:40.686 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:48:40.686 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:48:40.686 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:48:40.687 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:48:40.687 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:48:40.687 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:48:40.687 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:48:40.688 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:48:40.688 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:48:40.688 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:48:40.689 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:48:40.689 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:48:40.689 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:48:40.708 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:48:40.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:48:40.709 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:48:40.709 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:48:40.710 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:48:40.710 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:48:40.711 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:48:40.712 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:48:40.758 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:48:40.759 DEBUG:teuthology.parallel:result is None 2023-08-09T12:48:40.760 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:48:40.760 DEBUG:teuthology.parallel:result is None 2023-08-09T12:48:40.765 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:48:40.765 DEBUG:teuthology.parallel:result is None 2023-08-09T12:48:40.768 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:48:40.768 DEBUG:teuthology.parallel:result is None 2023-08-09T12:48:40.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:48:40.924 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:48:40.930 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:48:40.930 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:48:40.931 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:48:40.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.971+0000 7fa96883f640 1 Processor -- start 2023-08-09T12:48:40.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.971+0000 7fa96883f640 1 -- start start 2023-08-09T12:48:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.972+0000 7fa96883f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa96415ce90 0x7fa9641616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.972+0000 7fa96883f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9640b6000 0x7fa9640cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.972+0000 7fa96883f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9640d29d0 0x7fa9640d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.972+0000 7fa96883f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640d33a0 con 0x7fa96415ce90 2023-08-09T12:48:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.972+0000 7fa96883f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640b6460 con 0x7fa9640b6000 2023-08-09T12:48:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.972+0000 7fa96883f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640cda40 con 0x7fa9640d29d0 2023-08-09T12:48:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa96259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa96415ce90 0x7fa9641616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa96259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa96415ce90 0x7fa9641616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41984/0 (socket says 172.21.15.17:41984) 2023-08-09T12:48:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa96259c640 1 -- 172.21.15.17:0/2812105510 learned_addr learned my addr 172.21.15.17:0/2812105510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa962d9d640 1 --2- 172.21.15.17:0/2812105510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9640d29d0 0x7fa9640d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa95bfff640 1 --2- 172.21.15.17:0/2812105510 >> v2:172.21.15.142:3300/0 conn(0x7fa9640b6000 0x7fa9640cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa96259c640 1 -- 172.21.15.17:0/2812105510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9640d29d0 msgr2=0x7fa9640d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa96259c640 1 --2- 172.21.15.17:0/2812105510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9640d29d0 0x7fa9640d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa96259c640 1 -- 172.21.15.17:0/2812105510 >> v2:172.21.15.142:3300/0 conn(0x7fa9640b6000 msgr2=0x7fa9640cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa96259c640 1 --2- 172.21.15.17:0/2812105510 >> v2:172.21.15.142:3300/0 conn(0x7fa9640b6000 0x7fa9640cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa96259c640 1 -- 172.21.15.17:0/2812105510 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640cdd10 con 0x7fa96415ce90 2023-08-09T12:48:40.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.973+0000 7fa95bfff640 1 --2- 172.21.15.17:0/2812105510 >> v2:172.21.15.142:3300/0 conn(0x7fa9640b6000 0x7fa9640cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:48:40.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.974+0000 7fa96259c640 1 --2- 172.21.15.17:0/2812105510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa96415ce90 0x7fa9641616e0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fa9640c9c00 tx=0x7fa95402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a61c77b49584953 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa961d9b640 1 -- 172.21.15.17:0/2812105510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954031870 con 0x7fa96415ce90 2023-08-09T12:48:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa961d9b640 1 -- 172.21.15.17:0/2812105510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9540319d0 con 0x7fa96415ce90 2023-08-09T12:48:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa961d9b640 1 -- 172.21.15.17:0/2812105510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954031d60 con 0x7fa96415ce90 2023-08-09T12:48:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 -- 172.21.15.17:0/2812105510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa96415ce90 msgr2=0x7fa9641616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 --2- 172.21.15.17:0/2812105510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa96415ce90 0x7fa9641616e0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fa9640c9c00 tx=0x7fa95402b910 comp rx=0 tx=0).stop 2023-08-09T12:48:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 -- 172.21.15.17:0/2812105510 shutdown_connections 2023-08-09T12:48:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 --2- 172.21.15.17:0/2812105510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9640d29d0 0x7fa9640d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 --2- 172.21.15.17:0/2812105510 >> v2:172.21.15.142:3300/0 conn(0x7fa9640b6000 0x7fa9640cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 --2- 172.21.15.17:0/2812105510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa96415ce90 0x7fa9641616e0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 -- 172.21.15.17:0/2812105510 >> 172.21.15.17:0/2812105510 conn(0x7fa96406fde0 msgr2=0x7fa9640701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 -- 172.21.15.17:0/2812105510 shutdown_connections 2023-08-09T12:48:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.975+0000 7fa96883f640 1 -- 172.21.15.17:0/2812105510 wait complete. 2023-08-09T12:48:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.977+0000 7fa96883f640 1 Processor -- start 2023-08-09T12:48:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.977+0000 7fa96883f640 1 -- start start 2023-08-09T12:48:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.978+0000 7fa96883f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9640b6000 0x7fa9640c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.978+0000 7fa96883f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9640d29d0 0x7fa9640caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.978+0000 7fa96883f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa96415ce90 0x7fa9641f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.978+0000 7fa96883f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96415f9b0 con 0x7fa9640d29d0 2023-08-09T12:48:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.978+0000 7fa96883f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa964156740 con 0x7fa9640b6000 2023-08-09T12:48:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.978+0000 7fa96883f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9641f6cb0 con 0x7fa96415ce90 2023-08-09T12:48:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9640d29d0 0x7fa9640caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9640d29d0 0x7fa9640caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41988/0 (socket says 172.21.15.17:41988) 2023-08-09T12:48:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 -- 172.21.15.17:0/2902332156 learned_addr learned my addr 172.21.15.17:0/2902332156 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa962d9d640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa96415ce90 0x7fa9641f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa96259c640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9640b6000 0x7fa9640c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 -- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa96415ce90 msgr2=0x7fa9641f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa96415ce90 0x7fa9641f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 -- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9640b6000 msgr2=0x7fa9640c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9640b6000 0x7fa9640c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 -- 172.21.15.17:0/2902332156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540094d0 con 0x7fa9640d29d0 2023-08-09T12:48:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.979+0000 7fa95bfff640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9640d29d0 0x7fa9640caca0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00e730 tx=0x7fa94c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.980+0000 7fa95affd640 1 -- 172.21.15.17:0/2902332156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c004230 con 0x7fa9640d29d0 2023-08-09T12:48:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.980+0000 7fa95affd640 1 -- 172.21.15.17:0/2902332156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c004390 con 0x7fa9640d29d0 2023-08-09T12:48:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.980+0000 7fa95affd640 1 -- 172.21.15.17:0/2902332156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00c8f0 con 0x7fa9640d29d0 2023-08-09T12:48:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.980+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9641f6f90 con 0x7fa9640d29d0 2023-08-09T12:48:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.980+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96415f260 con 0x7fa9640d29d0 2023-08-09T12:48:40.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.981+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96415f480 con 0x7fa9640d29d0 2023-08-09T12:48:40.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.982+0000 7fa95affd640 1 -- 172.21.15.17:0/2902332156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa94c00ca50 con 0x7fa9640d29d0 2023-08-09T12:48:40.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.983+0000 7fa95affd640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa94406a050 0x7fa94406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:40.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.984+0000 7fa95affd640 1 -- 172.21.15.17:0/2902332156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa94c087ee0 con 0x7fa9640d29d0 2023-08-09T12:48:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.984+0000 7fa96259c640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa94406a050 0x7fa94406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.985+0000 7fa96259c640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa94406a050 0x7fa94406c510 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa954036000 tx=0x7fa95403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:40.988+0000 7fa95affd640 1 -- 172.21.15.17:0/2902332156 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa94c0538e0 con 0x7fa9640d29d0 2023-08-09T12:48:41.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.193+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa964067a80 con 0x7fa9640d29d0 2023-08-09T12:48:41.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.812+0000 7fa95affd640 1 -- 172.21.15.17:0/2902332156 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v155) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa94c056f00 con 0x7fa9640d29d0 2023-08-09T12:48:41.815 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:48:41.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.815+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa94406a050 msgr2=0x7fa94406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:41.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.815+0000 7fa96883f640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa94406a050 0x7fa94406c510 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa954036000 tx=0x7fa95403c040 comp rx=0 tx=0).stop 2023-08-09T12:48:41.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.815+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9640d29d0 msgr2=0x7fa9640caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:41.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.815+0000 7fa96883f640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9640d29d0 0x7fa9640caca0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00e730 tx=0x7fa94c00ebf0 comp rx=0 tx=0).stop 2023-08-09T12:48:41.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.816+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 shutdown_connections 2023-08-09T12:48:41.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.816+0000 7fa96883f640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa94406a050 0x7fa94406c510 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:41.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.816+0000 7fa96883f640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa96415ce90 0x7fa9641f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:41.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.816+0000 7fa96883f640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9640d29d0 0x7fa9640caca0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:41.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.816+0000 7fa96883f640 1 --2- 172.21.15.17:0/2902332156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9640b6000 0x7fa9640c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:41.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.816+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 >> 172.21.15.17:0/2902332156 conn(0x7fa96406fde0 msgr2=0x7fa9640d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.816+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 shutdown_connections 2023-08-09T12:48:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:41.816+0000 7fa96883f640 1 -- 172.21.15.17:0/2902332156 wait complete. 2023-08-09T12:48:41.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:48:41.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:48:41.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:48:42.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.051+0000 7f8e62a4d640 1 Processor -- start 2023-08-09T12:48:42.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.051+0000 7f8e62a4d640 1 -- start start 2023-08-09T12:48:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e62a4d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e5c0adc40 0x7f8e5c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e62a4d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c0b3b40 0x7f8e5c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e62a4d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0b2250 con 0x7f8e5c15e8f0 2023-08-09T12:48:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e62a4d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c0ae020 con 0x7f8e5c0adc40 2023-08-09T12:48:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e62a4d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c0b2530 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e5bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e5c0adc40 0x7f8e5c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e60fea640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8e5c15e8f0 0x7f8e5c15ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37238/0 (socket says 172.21.15.17:37238) 2023-08-09T12:48:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e60fea640 1 -- 172.21.15.17:0/571086259 learned_addr learned my addr 172.21.15.17:0/571086259 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.053+0000 7f8e5b7fe640 1 --2- 172.21.15.17:0/571086259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c0b3b40 0x7f8e5c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.054+0000 7f8e5bfff640 1 -- 172.21.15.17:0/571086259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c0b3b40 msgr2=0x7f8e5c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.054+0000 7f8e5bfff640 1 --2- 172.21.15.17:0/571086259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c0b3b40 0x7f8e5c0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.054+0000 7f8e5bfff640 1 -- 172.21.15.17:0/571086259 >> v1:172.21.15.17:6789/0 conn(0x7f8e5c15e8f0 legacy=0x7f8e5c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.054+0000 7f8e5affd640 1 -- 172.21.15.17:0/571086259 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34016604 0 0) 0x7f8e5c0b2250 con 0x7f8e5c15e8f0 2023-08-09T12:48:42.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.054+0000 7f8e5bfff640 1 -- 172.21.15.17:0/571086259 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c06fe80 con 0x7f8e5c0adc40 2023-08-09T12:48:42.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.055+0000 7f8e5bfff640 1 --2- 172.21.15.17:0/571086259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0adc40 0x7f8e5c06c280 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0097a0 tx=0x7f8e4c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530fc91796788317 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:42.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.055+0000 7f8e5affd640 1 -- 172.21.15.17:0/571086259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c02d040 con 0x7f8e5c0adc40 2023-08-09T12:48:42.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.055+0000 7f8e5affd640 1 -- 172.21.15.17:0/571086259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c031810 con 0x7f8e5c0adc40 2023-08-09T12:48:42.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.055+0000 7f8e5affd640 1 -- 172.21.15.17:0/571086259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c031ba0 con 0x7f8e5c0adc40 2023-08-09T12:48:42.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.056+0000 7f8e62a4d640 1 -- 172.21.15.17:0/571086259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0adc40 msgr2=0x7f8e5c06c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.056+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/571086259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0adc40 0x7f8e5c06c280 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0097a0 tx=0x7f8e4c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.056+0000 7f8e62a4d640 1 -- 172.21.15.17:0/571086259 shutdown_connections 2023-08-09T12:48:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.056+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/571086259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c0b3b40 0x7f8e5c0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.056+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/571086259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0adc40 0x7f8e5c06c280 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.056+0000 7f8e62a4d640 1 -- 172.21.15.17:0/571086259 >> 172.21.15.17:0/571086259 conn(0x7f8e5c0cb1b0 msgr2=0x7f8e5c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.056+0000 7f8e62a4d640 1 -- 172.21.15.17:0/571086259 shutdown_connections 2023-08-09T12:48:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.056+0000 7f8e62a4d640 1 -- 172.21.15.17:0/571086259 wait complete. 2023-08-09T12:48:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.058+0000 7f8e62a4d640 1 Processor -- start 2023-08-09T12:48:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.058+0000 7f8e62a4d640 1 -- start start 2023-08-09T12:48:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e62a4d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e5c0adc40 0x7f8e5c1e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e62a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0b3b40 0x7f8e5c0c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e62a4d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c15e8f0 0x7f8e5c069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e62a4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c06b580 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e62a4d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c069e90 con 0x7f8e5c0adc40 2023-08-09T12:48:42.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e62a4d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1e3ff0 con 0x7f8e5c15e8f0 2023-08-09T12:48:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e5b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0b3b40 0x7f8e5c0c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e5b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0b3b40 0x7f8e5c0c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42004/0 (socket says 172.21.15.17:42004) 2023-08-09T12:48:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.059+0000 7f8e5b7fe640 1 -- 172.21.15.17:0/475969469 learned_addr learned my addr 172.21.15.17:0/475969469 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e5b7fe640 1 -- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c15e8f0 msgr2=0x7f8e5c069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e5b7fe640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c15e8f0 0x7f8e5c069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e5b7fe640 1 -- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e5c0adc40 msgr2=0x7f8e5c1e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e5b7fe640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e5c0adc40 0x7f8e5c1e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e5b7fe640 1 -- 172.21.15.17:0/475969469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c009400 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e5b7fe640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0b3b40 0x7f8e5c0c8af0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000d800 tx=0x7f8e5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e58ff9640 1 -- 172.21.15.17:0/475969469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000b6c0 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e58ff9640 1 -- 172.21.15.17:0/475969469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5000b820 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e58ff9640 1 -- 172.21.15.17:0/475969469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000bbd0 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.060+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c1e42d0 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.061+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c1e4890 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.062+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c067a80 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.063+0000 7f8e58ff9640 1 -- 172.21.15.17:0/475969469 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e5000bd30 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.064+0000 7f8e58ff9640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e4806a050 0x7f8e4806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.064+0000 7f8e58ff9640 1 -- 172.21.15.17:0/475969469 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8e500887b0 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.064+0000 7f8e5bfff640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e4806a050 0x7f8e4806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.066+0000 7f8e5bfff640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e4806a050 0x7f8e4806c510 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c036000 tx=0x7f8e4c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:42.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.069+0000 7f8e58ff9640 1 -- 172.21.15.17:0/475969469 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8e50054150 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.329+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8e5c06ed40 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.330+0000 7f8e58ff9640 1 -- 172.21.15.17:0/475969469 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8e50057770 con 0x7f8e5c0b3b40 2023-08-09T12:48:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:42.333 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:48:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:48:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:48:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:48:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:48:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:48:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:48:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:48:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:48:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:48:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:48:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:48:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:48:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:48:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:48:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:48:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:48:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:48:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:48:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:48:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:48:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:48:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:48:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:48:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:48:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:48:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:48:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:48:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:48:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:48:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:48:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:48:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:48:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:48:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:48:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:48:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:48:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:48:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:48:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:48:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:48:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:48:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:48:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:48:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:48:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:48:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:48:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:48:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:48:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:48:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:48:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:48:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:48:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:48:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:48:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:48:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:48:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:48:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:48:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:48:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:48:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:48:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:48:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:48:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:48:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:48:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:48:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:48:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:48:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:48:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:48:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:48:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:48:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:48:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:48:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:48:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:48:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:48:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:48:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:48:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:48:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:48:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:48:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:48:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:48:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:48:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:48:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:48:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:48:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:48:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:48:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:48:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:48:42.369 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:48:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e4806a050 msgr2=0x7f8e4806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e4806a050 0x7f8e4806c510 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c036000 tx=0x7f8e4c030000 comp rx=0 tx=0).stop 2023-08-09T12:48:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0b3b40 msgr2=0x7f8e5c0c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0b3b40 0x7f8e5c0c8af0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000d800 tx=0x7f8e5000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 shutdown_connections 2023-08-09T12:48:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8e4806a050 0x7f8e4806c510 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e5c15e8f0 0x7f8e5c069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c0b3b40 0x7f8e5c0c8af0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.332+0000 7f8e62a4d640 1 --2- 172.21.15.17:0/475969469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e5c0adc40 0x7f8e5c1e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.333+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 >> 172.21.15.17:0/475969469 conn(0x7f8e5c0cb1b0 msgr2=0x7f8e5c0c2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.333+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 shutdown_connections 2023-08-09T12:48:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.333+0000 7f8e62a4d640 1 -- 172.21.15.17:0/475969469 wait complete. 2023-08-09T12:48:42.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:42.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.594+0000 7f074b0f3640 1 Processor -- start 2023-08-09T12:48:42.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.595+0000 7f074b0f3640 1 -- start start 2023-08-09T12:48:42.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.596+0000 7f074b0f3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07440adc40 0x7f074406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.596+0000 7f074b0f3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07440b2250 con 0x7f07440b3b40 2023-08-09T12:48:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.596+0000 7f074b0f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07440b2530 con 0x7f07440cc630 2023-08-09T12:48:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.596+0000 7f074b0f3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07440ae020 con 0x7f07440adc40 2023-08-09T12:48:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.597+0000 7f073bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f07440b3b40 0x7f07440b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37254/0 (socket says 172.21.15.17:37254) 2023-08-09T12:48:42.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.597+0000 7f073bfff640 1 -- 172.21.15.17:0/2444056346 learned_addr learned my addr 172.21.15.17:0/2444056346 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:42.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.597+0000 7f0748e8f640 1 --2- 172.21.15.17:0/2444056346 >> v2:172.21.15.142:3300/0 conn(0x7f07440adc40 0x7f074406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.597+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687885950 0 0) 0x7f07440b2250 con 0x7f07440b3b40 2023-08-09T12:48:42.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.597+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f072c003520 con 0x7f07440b3b40 2023-08-09T12:48:42.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2224678544 0 0) 0x7f072c003520 con 0x7f07440b3b40 2023-08-09T12:48:42.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 >> v2:172.21.15.142:3300/0 conn(0x7f07440adc40 msgr2=0x7f074406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 --2- 172.21.15.17:0/2444056346 >> v2:172.21.15.142:3300/0 conn(0x7f07440adc40 0x7f074406c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 >> v1:172.21.15.142:6789/0 conn(0x7f07440cc630 legacy=0x7f07440ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074406fe80 con 0x7f07440b3b40 2023-08-09T12:48:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f07340017f0 con 0x7f07440b3b40 2023-08-09T12:48:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 >> v1:172.21.15.17:6789/0 conn(0x7f07440b3b40 legacy=0x7f07440b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f072c003970 0x7f072c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c0047c0 0x7f072c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c005180 0x7f072c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07440ae020 con 0x7f072c005180 2023-08-09T12:48:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c00c120 con 0x7f072c003970 2023-08-09T12:48:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c00c2e0 con 0x7f072c0047c0 2023-08-09T12:48:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.598+0000 7f0749690640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c005180 0x7f072c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.599+0000 7f0748e8f640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f072c003970 0x7f072c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.599+0000 7f073bfff640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c0047c0 0x7f072c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.599+0000 7f0749690640 1 -- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c0047c0 msgr2=0x7f072c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.599+0000 7f0749690640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c0047c0 0x7f072c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.599+0000 7f0749690640 1 -- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f072c003970 msgr2=0x7f072c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.599+0000 7f0749690640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f072c003970 0x7f072c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.599+0000 7f0749690640 1 -- 172.21.15.17:0/2444056346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c003520 con 0x7f072c005180 2023-08-09T12:48:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.599+0000 7f073bfff640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c0047c0 0x7f072c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:42.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.600+0000 7f0749690640 1 -- 172.21.15.17:0/2444056346 reap_dead start 2023-08-09T12:48:42.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.600+0000 7f0749690640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c005180 0x7f072c00b980 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f073c001750 tx=0x7f072c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bea4258d1e0e0d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:42.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0052d0 con 0x7f072c005180 2023-08-09T12:48:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c02e050 con 0x7f072c005180 2023-08-09T12:48:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f073b7fe640 1 -- 172.21.15.17:0/2444056346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0035f0 con 0x7f072c005180 2023-08-09T12:48:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f074b0f3640 1 -- 172.21.15.17:0/2444056346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c005180 msgr2=0x7f072c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f074b0f3640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c005180 0x7f072c00b980 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f073c001750 tx=0x7f072c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f074b0f3640 1 -- 172.21.15.17:0/2444056346 shutdown_connections 2023-08-09T12:48:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f074b0f3640 1 --2- 172.21.15.17:0/2444056346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c005180 0x7f072c00b980 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f074b0f3640 1 -- 172.21.15.17:0/2444056346 >> 172.21.15.17:0/2444056346 conn(0x7f07440cb1b0 msgr2=0x7f07440cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f074b0f3640 1 -- 172.21.15.17:0/2444056346 shutdown_connections 2023-08-09T12:48:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.601+0000 7f074b0f3640 1 -- 172.21.15.17:0/2444056346 wait complete. 2023-08-09T12:48:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.603+0000 7f074b0f3640 1 Processor -- start 2023-08-09T12:48:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.603+0000 7f074b0f3640 1 -- start start 2023-08-09T12:48:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.604+0000 7f074b0f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c005180 0x7f0744143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.604+0000 7f074b0f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07440af1b0 0x7f07440af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.604+0000 7f074b0f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440c3d40 0x7f07440c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.604+0000 7f074b0f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07440afb70 con 0x7f07440af1b0 2023-08-09T12:48:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.604+0000 7f074b0f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07440c4d80 con 0x7f07440c3d40 2023-08-09T12:48:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.604+0000 7f074b0f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07440c4aa0 con 0x7f072c005180 2023-08-09T12:48:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07440af1b0 0x7f07440af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07440af1b0 0x7f07440af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42016/0 (socket says 172.21.15.17:42016) 2023-08-09T12:48:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 -- 172.21.15.17:0/1106661984 learned_addr learned my addr 172.21.15.17:0/1106661984 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f0749690640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440c3d40 0x7f07440c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f0748e8f640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c005180 0x7f0744143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 -- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c005180 msgr2=0x7f0744143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c005180 0x7f0744143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 -- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440c3d40 msgr2=0x7f07440c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440c3d40 0x7f07440c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 -- 172.21.15.17:0/1106661984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744156b70 con 0x7f07440af1b0 2023-08-09T12:48:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f0749690640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440c3d40 0x7f07440c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.605+0000 7f073bfff640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07440af1b0 0x7f07440af630 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f073400d750 tx=0x7f073400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.606+0000 7f07397fa640 1 -- 172.21.15.17:0/1106661984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734007480 con 0x7f07440af1b0 2023-08-09T12:48:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.606+0000 7f07397fa640 1 -- 172.21.15.17:0/1106661984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07340075e0 con 0x7f07440af1b0 2023-08-09T12:48:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.606+0000 7f07397fa640 1 -- 172.21.15.17:0/1106661984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07340059a0 con 0x7f07440af1b0 2023-08-09T12:48:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.606+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0744156e50 con 0x7f07440af1b0 2023-08-09T12:48:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.606+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07440c4730 con 0x7f07440af1b0 2023-08-09T12:48:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.607+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07440b1e20 con 0x7f07440af1b0 2023-08-09T12:48:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.608+0000 7f07397fa640 1 -- 172.21.15.17:0/1106661984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0734005b00 con 0x7f07440af1b0 2023-08-09T12:48:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.609+0000 7f07397fa640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073006a080 0x7f073006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.609+0000 7f07397fa640 1 -- 172.21.15.17:0/1106661984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f07340883e0 con 0x7f07440af1b0 2023-08-09T12:48:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.610+0000 7f0748e8f640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073006a080 0x7f073006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.611+0000 7f0748e8f640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073006a080 0x7f073006c540 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0740007330 tx=0x7f074000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.614+0000 7f07397fa640 1 -- 172.21.15.17:0/1106661984 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0734057950 con 0x7f07440af1b0 2023-08-09T12:48:42.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.811+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0744067a80 con 0x7f07440af1b0 2023-08-09T12:48:42.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.812+0000 7f07397fa640 1 -- 172.21.15.17:0/1106661984 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f073400de60 con 0x7f07440af1b0 2023-08-09T12:48:42.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:42.816 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":157,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:41.821734+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:42.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073006a080 msgr2=0x7f073006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073006a080 0x7f073006c540 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0740007330 tx=0x7f074000b040 comp rx=0 tx=0).stop 2023-08-09T12:48:42.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07440af1b0 msgr2=0x7f07440af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:42.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07440af1b0 0x7f07440af630 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f073400d750 tx=0x7f073400dc10 comp rx=0 tx=0).stop 2023-08-09T12:48:42.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 shutdown_connections 2023-08-09T12:48:42.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f073006a080 0x7f073006c540 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07440c3d40 0x7f07440c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07440af1b0 0x7f07440af630 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 --2- 172.21.15.17:0/1106661984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f072c005180 0x7f0744143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:42.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 >> 172.21.15.17:0/1106661984 conn(0x7f07440cb1b0 msgr2=0x7f0744069850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:42.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 shutdown_connections 2023-08-09T12:48:42.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:42.815+0000 7f074b0f3640 1 -- 172.21.15.17:0/1106661984 wait complete. 2023-08-09T12:48:42.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:48:42.840 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:48:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.059+0000 7fc415386640 1 Processor -- start 2023-08-09T12:48:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.059+0000 7fc415386640 1 -- start start 2023-08-09T12:48:43.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.061+0000 7fc415386640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc41015a8c0 0x7fc4100b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.061+0000 7fc415386640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4100b13f0 0x7fc41015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.061+0000 7fc415386640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41015e7b0 con 0x7fc41015f180 2023-08-09T12:48:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.061+0000 7fc415386640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100b1850 con 0x7fc41015a8c0 2023-08-09T12:48:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.061+0000 7fc415386640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41015e460 con 0x7fc4100b13f0 2023-08-09T12:48:43.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.061+0000 7fc40ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc41015a8c0 0x7fc4100b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.062+0000 7fc40ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc41015a8c0 0x7fc4100b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42032/0 (socket says 172.21.15.17:42032) 2023-08-09T12:48:43.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.062+0000 7fc40ffff640 1 -- 172.21.15.17:0/1673824495 learned_addr learned my addr 172.21.15.17:0/1673824495 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:43.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.062+0000 7fc40ffff640 1 -- 172.21.15.17:0/1673824495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4100b13f0 msgr2=0x7fc41015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:43.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.062+0000 7fc40f7fe640 1 --2- 172.21.15.17:0/1673824495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4100b13f0 0x7fc41015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.062+0000 7fc40ffff640 1 --2- 172.21.15.17:0/1673824495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4100b13f0 0x7fc41015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.062+0000 7fc40ffff640 1 -- 172.21.15.17:0/1673824495 >> v1:172.21.15.142:6789/0 conn(0x7fc41015f180 legacy=0x7fc4100b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:43.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.062+0000 7fc40ffff640 1 -- 172.21.15.17:0/1673824495 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41015aca0 con 0x7fc41015a8c0 2023-08-09T12:48:43.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.062+0000 7fc40f7fe640 1 --2- 172.21.15.17:0/1673824495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4100b13f0 0x7fc41015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:43.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.063+0000 7fc40ffff640 1 --2- 172.21.15.17:0/1673824495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc41015a8c0 0x7fc4100b4170 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fc400009870 tx=0x7fc40002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a57911e6ccad26 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:43.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc40effd640 1 -- 172.21.15.17:0/1673824495 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400031640 con 0x7fc41015a8c0 2023-08-09T12:48:43.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc40effd640 1 -- 172.21.15.17:0/1673824495 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4000317a0 con 0x7fc41015a8c0 2023-08-09T12:48:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc40effd640 1 -- 172.21.15.17:0/1673824495 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400031b30 con 0x7fc41015a8c0 2023-08-09T12:48:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc415386640 1 -- 172.21.15.17:0/1673824495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc41015a8c0 msgr2=0x7fc4100b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc415386640 1 --2- 172.21.15.17:0/1673824495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc41015a8c0 0x7fc4100b4170 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fc400009870 tx=0x7fc40002b8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc415386640 1 -- 172.21.15.17:0/1673824495 shutdown_connections 2023-08-09T12:48:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc415386640 1 --2- 172.21.15.17:0/1673824495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4100b13f0 0x7fc41015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc415386640 1 --2- 172.21.15.17:0/1673824495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc41015a8c0 0x7fc4100b4170 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc415386640 1 -- 172.21.15.17:0/1673824495 >> 172.21.15.17:0/1673824495 conn(0x7fc4100cb020 msgr2=0x7fc4100cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:43.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.064+0000 7fc415386640 1 -- 172.21.15.17:0/1673824495 shutdown_connections 2023-08-09T12:48:43.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.065+0000 7fc415386640 1 -- 172.21.15.17:0/1673824495 wait complete. 2023-08-09T12:48:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.066+0000 7fc415386640 1 Processor -- start 2023-08-09T12:48:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.066+0000 7fc415386640 1 -- start start 2023-08-09T12:48:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.067+0000 7fc415386640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4100b13f0 0x7fc41014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.067+0000 7fc415386640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41015a8c0 0x7fc410147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.067+0000 7fc415386640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41015f180 0x7fc4100c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.067+0000 7fc415386640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410147960 con 0x7fc4100b13f0 2023-08-09T12:48:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.067+0000 7fc415386640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41014b820 con 0x7fc41015f180 2023-08-09T12:48:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.067+0000 7fc415386640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4101483e0 con 0x7fc41015a8c0 2023-08-09T12:48:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4100b13f0 0x7fc41014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4100b13f0 0x7fc41014aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42040/0 (socket says 172.21.15.17:42040) 2023-08-09T12:48:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 -- 172.21.15.17:0/566805272 learned_addr learned my addr 172.21.15.17:0/566805272 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 -- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41015a8c0 msgr2=0x7fc410147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41015a8c0 0x7fc410147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 -- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41015f180 msgr2=0x7fc4100c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41015f180 0x7fc4100c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 -- 172.21.15.17:0/566805272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4000094d0 con 0x7fc4100b13f0 2023-08-09T12:48:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.068+0000 7fc40ffff640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4100b13f0 0x7fc41014aea0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fc40002b930 tx=0x7fc4000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.069+0000 7fc40cff9640 1 -- 172.21.15.17:0/566805272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40003ac60 con 0x7fc4100b13f0 2023-08-09T12:48:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.069+0000 7fc40cff9640 1 -- 172.21.15.17:0/566805272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40003ade0 con 0x7fc4100b13f0 2023-08-09T12:48:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.069+0000 7fc40cff9640 1 -- 172.21.15.17:0/566805272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400042630 con 0x7fc4100b13f0 2023-08-09T12:48:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.069+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc410145590 con 0x7fc4100b13f0 2023-08-09T12:48:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.069+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc410147e20 con 0x7fc4100b13f0 2023-08-09T12:48:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.070+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41004e390 con 0x7fc4100b13f0 2023-08-09T12:48:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.071+0000 7fc40cff9640 1 -- 172.21.15.17:0/566805272 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc40002f050 con 0x7fc4100b13f0 2023-08-09T12:48:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.073+0000 7fc40cff9640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3fc06a050 0x7fc3fc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.073+0000 7fc40cff9640 1 -- 172.21.15.17:0/566805272 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc4000a9dd0 con 0x7fc4100b13f0 2023-08-09T12:48:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.073+0000 7fc40f7fe640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3fc06a050 0x7fc3fc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.075+0000 7fc40f7fe640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3fc06a050 0x7fc3fc06c510 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc404006fd0 tx=0x7fc404008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.077+0000 7fc40cff9640 1 -- 172.21.15.17:0/566805272 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc400075800 con 0x7fc4100b13f0 2023-08-09T12:48:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.268+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4100cf6b0 con 0x7fc4100b13f0 2023-08-09T12:48:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.268+0000 7fc40cff9640 1 -- 172.21.15.17:0/566805272 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v157) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc400035020 con 0x7fc4100b13f0 2023-08-09T12:48:43.272 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:48:43.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3fc06a050 msgr2=0x7fc3fc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3fc06a050 0x7fc3fc06c510 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc404006fd0 tx=0x7fc404008040 comp rx=0 tx=0).stop 2023-08-09T12:48:43.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4100b13f0 msgr2=0x7fc41014aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4100b13f0 0x7fc41014aea0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fc40002b930 tx=0x7fc4000046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 shutdown_connections 2023-08-09T12:48:43.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc3fc06a050 0x7fc3fc06c510 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc41015f180 0x7fc4100c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc41015a8c0 0x7fc410147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 --2- 172.21.15.17:0/566805272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4100b13f0 0x7fc41014aea0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 >> 172.21.15.17:0/566805272 conn(0x7fc4100cb020 msgr2=0x7fc410159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.271+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 shutdown_connections 2023-08-09T12:48:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.272+0000 7fc415386640 1 -- 172.21.15.17:0/566805272 wait complete. 2023-08-09T12:48:43.294 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:48:43.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.527+0000 7f18b3fff640 1 Processor -- start 2023-08-09T12:48:43.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.527+0000 7f18b3fff640 1 -- start start 2023-08-09T12:48:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18b415a8c0 0x7f18b40b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18b40b13f0 0x7f18b415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415f180 0x7f18b40b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b3fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b415e7b0 con 0x7f18b415a8c0 2023-08-09T12:48:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b3fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b40b1850 con 0x7f18b40b13f0 2023-08-09T12:48:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b415e460 con 0x7f18b415f180 2023-08-09T12:48:43.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b2ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18b415a8c0 0x7f18b40b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b2ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f18b415a8c0 0x7f18b40b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42050/0 (socket says 172.21.15.17:42050) 2023-08-09T12:48:43.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.529+0000 7f18b2ffd640 1 -- 172.21.15.17:0/2405027604 learned_addr learned my addr 172.21.15.17:0/2405027604 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:43.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.530+0000 7f18b2ffd640 1 -- 172.21.15.17:0/2405027604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415f180 msgr2=0x7f18b40b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:43.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.530+0000 7f18b2ffd640 1 --2- 172.21.15.17:0/2405027604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415f180 0x7f18b40b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.530+0000 7f18b2ffd640 1 -- 172.21.15.17:0/2405027604 >> v2:172.21.15.142:3300/0 conn(0x7f18b40b13f0 msgr2=0x7f18b415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.530+0000 7f18b2ffd640 1 --2- 172.21.15.17:0/2405027604 >> v2:172.21.15.142:3300/0 conn(0x7f18b40b13f0 0x7f18b415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.530+0000 7f18b2ffd640 1 -- 172.21.15.17:0/2405027604 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b415aca0 con 0x7f18b415a8c0 2023-08-09T12:48:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.531+0000 7f18b2ffd640 1 --2- 172.21.15.17:0/2405027604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415a8c0 0x7f18b40b4170 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f18b415e3c0 tx=0x7f18a402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bba6ae528981e00 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.531+0000 7f18b1ffb640 1 -- 172.21.15.17:0/2405027604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4031880 con 0x7f18b415a8c0 2023-08-09T12:48:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.531+0000 7f18b1ffb640 1 -- 172.21.15.17:0/2405027604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a40319e0 con 0x7f18b415a8c0 2023-08-09T12:48:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.531+0000 7f18b1ffb640 1 -- 172.21.15.17:0/2405027604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4031d70 con 0x7f18b415a8c0 2023-08-09T12:48:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 -- 172.21.15.17:0/2405027604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415a8c0 msgr2=0x7f18b40b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 --2- 172.21.15.17:0/2405027604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415a8c0 0x7f18b40b4170 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f18b415e3c0 tx=0x7f18a402b920 comp rx=0 tx=0).stop 2023-08-09T12:48:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 -- 172.21.15.17:0/2405027604 shutdown_connections 2023-08-09T12:48:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 --2- 172.21.15.17:0/2405027604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415f180 0x7f18b40b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 --2- 172.21.15.17:0/2405027604 >> v2:172.21.15.142:3300/0 conn(0x7f18b40b13f0 0x7f18b415ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 --2- 172.21.15.17:0/2405027604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415a8c0 0x7f18b40b4170 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 -- 172.21.15.17:0/2405027604 >> 172.21.15.17:0/2405027604 conn(0x7f18b40cb020 msgr2=0x7f18b40cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 -- 172.21.15.17:0/2405027604 shutdown_connections 2023-08-09T12:48:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.532+0000 7f18b3fff640 1 -- 172.21.15.17:0/2405027604 wait complete. 2023-08-09T12:48:43.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.534+0000 7f18b3fff640 1 Processor -- start 2023-08-09T12:48:43.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.534+0000 7f18b3fff640 1 -- start start 2023-08-09T12:48:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.535+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18b40b13f0 0x7f18b415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.535+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415a8c0 0x7f18b415c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.535+0000 7f18b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415f180 0x7f18b415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.535+0000 7f18b3fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b415c0b0 con 0x7f18b415f180 2023-08-09T12:48:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.535+0000 7f18b3fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b415b4a0 con 0x7f18b40b13f0 2023-08-09T12:48:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.535+0000 7f18b3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b415b780 con 0x7f18b415a8c0 2023-08-09T12:48:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.535+0000 7f18b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415f180 0x7f18b415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415f180 0x7f18b415ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42052/0 (socket says 172.21.15.17:42052) 2023-08-09T12:48:43.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b37fe640 1 -- 172.21.15.17:0/589031037 learned_addr learned my addr 172.21.15.17:0/589031037 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:43.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b2ffd640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18b40b13f0 0x7f18b415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b37fe640 1 -- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415a8c0 msgr2=0x7f18b415c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b27fc640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415a8c0 0x7f18b415c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b37fe640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415a8c0 0x7f18b415c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b37fe640 1 -- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18b40b13f0 msgr2=0x7f18b415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b37fe640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18b40b13f0 0x7f18b415aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b37fe640 1 -- 172.21.15.17:0/589031037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a40094d0 con 0x7f18b415f180 2023-08-09T12:48:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b27fc640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415a8c0 0x7f18b415c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b2ffd640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18b40b13f0 0x7f18b415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.536+0000 7f18b37fe640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415f180 0x7f18b415ca80 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b9e0 tx=0x7f18ac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.537+0000 7f189b7fe640 1 -- 172.21.15.17:0/589031037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00cb20 con 0x7f18b415f180 2023-08-09T12:48:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.537+0000 7f189b7fe640 1 -- 172.21.15.17:0/589031037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00cca0 con 0x7f18b415f180 2023-08-09T12:48:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.537+0000 7f189b7fe640 1 -- 172.21.15.17:0/589031037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac014680 con 0x7f18b415f180 2023-08-09T12:48:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.537+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b415ba60 con 0x7f18b415f180 2023-08-09T12:48:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.537+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b415d9e0 con 0x7f18b415f180 2023-08-09T12:48:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.538+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b415c260 con 0x7f18b415f180 2023-08-09T12:48:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.539+0000 7f189b7fe640 1 -- 172.21.15.17:0/589031037 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f18ac01d3b0 con 0x7f18b415f180 2023-08-09T12:48:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.540+0000 7f189b7fe640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a006a050 0x7f18a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.540+0000 7f189b7fe640 1 -- 172.21.15.17:0/589031037 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f18ac088210 con 0x7f18b415f180 2023-08-09T12:48:43.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.541+0000 7f18b2ffd640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a006a050 0x7f18a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.542+0000 7f18b2ffd640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a006a050 0x7f18a006c510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f18a4036000 tx=0x7f18a403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:43.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.544+0000 7f189b7fe640 1 -- 172.21.15.17:0/589031037 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f18b415c260 con 0x7f18b415f180 2023-08-09T12:48:43.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.736+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18b404e390 con 0x7f18b415f180 2023-08-09T12:48:43.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.737+0000 7f189b7fe640 1 -- 172.21.15.17:0/589031037 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v157) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18ac053bb0 con 0x7f18b415f180 2023-08-09T12:48:43.740 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:48:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a006a050 msgr2=0x7f18a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a006a050 0x7f18a006c510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f18a4036000 tx=0x7f18a403c040 comp rx=0 tx=0).stop 2023-08-09T12:48:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415f180 msgr2=0x7f18b415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415f180 0x7f18b415ca80 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b9e0 tx=0x7f18ac00bea0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 shutdown_connections 2023-08-09T12:48:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f18a006a050 0x7f18a006c510 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b415f180 0x7f18b415ca80 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18b415a8c0 0x7f18b415c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 --2- 172.21.15.17:0/589031037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18b40b13f0 0x7f18b415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.739+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 >> 172.21.15.17:0/589031037 conn(0x7f18b40cb020 msgr2=0x7f18b40ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:43.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.740+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 shutdown_connections 2023-08-09T12:48:43.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.740+0000 7f18b3fff640 1 -- 172.21.15.17:0/589031037 wait complete. 2023-08-09T12:48:43.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:48:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.992+0000 7fe058b01640 1 Processor -- start 2023-08-09T12:48:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.992+0000 7fe058b01640 1 -- start start 2023-08-09T12:48:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.993+0000 7fe058b01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe05415ce90 0x7fe0541616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.994+0000 7fe058b01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540b6000 0x7fe0540cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.994+0000 7fe058b01640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540b6460 con 0x7fe0540d29d0 2023-08-09T12:48:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.994+0000 7fe058b01640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540cda40 con 0x7fe05415ce90 2023-08-09T12:48:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.994+0000 7fe058b01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540cdd10 con 0x7fe0540b6000 2023-08-09T12:48:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.994+0000 7fe052d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe0540d29d0 0x7fe0540d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37262/0 (socket says 172.21.15.17:37262) 2023-08-09T12:48:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.994+0000 7fe052d9d640 1 -- 172.21.15.17:0/1481276769 learned_addr learned my addr 172.21.15.17:0/1481276769 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.994+0000 7fe05259c640 1 --2- 172.21.15.17:0/1481276769 >> v2:172.21.15.17:3300/0 conn(0x7fe05415ce90 0x7fe0541616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.994+0000 7fe049d9b640 1 --2- 172.21.15.17:0/1481276769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540b6000 0x7fe0540cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.995+0000 7fe05259c640 1 -- 172.21.15.17:0/1481276769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540b6000 msgr2=0x7fe0540cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.995+0000 7fe05259c640 1 --2- 172.21.15.17:0/1481276769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540b6000 0x7fe0540cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.995+0000 7fe05259c640 1 -- 172.21.15.17:0/1481276769 >> v1:172.21.15.17:6789/0 conn(0x7fe0540d29d0 legacy=0x7fe0540d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.995+0000 7fe05259c640 1 -- 172.21.15.17:0/1481276769 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540cdff0 con 0x7fe05415ce90 2023-08-09T12:48:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.996+0000 7fe05259c640 1 --2- 172.21.15.17:0/1481276769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe05415ce90 0x7fe0541616e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe0440097a0 tx=0x7fe04402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663f823f0e039456 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.996+0000 7fe051d9b640 1 -- 172.21.15.17:0/1481276769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04402d040 con 0x7fe05415ce90 2023-08-09T12:48:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.996+0000 7fe051d9b640 1 -- 172.21.15.17:0/1481276769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044031810 con 0x7fe05415ce90 2023-08-09T12:48:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.996+0000 7fe051d9b640 1 -- 172.21.15.17:0/1481276769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044031ba0 con 0x7fe05415ce90 2023-08-09T12:48:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.997+0000 7fe058b01640 1 -- 172.21.15.17:0/1481276769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe05415ce90 msgr2=0x7fe0541616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.997+0000 7fe058b01640 1 --2- 172.21.15.17:0/1481276769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe05415ce90 0x7fe0541616e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe0440097a0 tx=0x7fe04402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.997+0000 7fe058b01640 1 -- 172.21.15.17:0/1481276769 shutdown_connections 2023-08-09T12:48:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.997+0000 7fe058b01640 1 --2- 172.21.15.17:0/1481276769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540b6000 0x7fe0540cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.997+0000 7fe058b01640 1 --2- 172.21.15.17:0/1481276769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe05415ce90 0x7fe0541616e0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.997+0000 7fe058b01640 1 -- 172.21.15.17:0/1481276769 >> 172.21.15.17:0/1481276769 conn(0x7fe05406fde0 msgr2=0x7fe0540701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.997+0000 7fe058b01640 1 -- 172.21.15.17:0/1481276769 shutdown_connections 2023-08-09T12:48:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.997+0000 7fe058b01640 1 -- 172.21.15.17:0/1481276769 wait complete. 2023-08-09T12:48:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.999+0000 7fe058b01640 1 Processor -- start 2023-08-09T12:48:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:43.999+0000 7fe058b01640 1 -- start start 2023-08-09T12:48:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe058b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540b6000 0x7fe0540c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe058b01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540d29d0 0x7fe0540cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe058b01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05415ce90 0x7fe0540cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe058b01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0541e6c50 con 0x7fe0540b6000 2023-08-09T12:48:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe058b01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540cb600 con 0x7fe05415ce90 2023-08-09T12:48:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe058b01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0541e6590 con 0x7fe0540d29d0 2023-08-09T12:48:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe05259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540b6000 0x7fe0540c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe05259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540b6000 0x7fe0540c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42074/0 (socket says 172.21.15.17:42074) 2023-08-09T12:48:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.000+0000 7fe05259c640 1 -- 172.21.15.17:0/3793810926 learned_addr learned my addr 172.21.15.17:0/3793810926 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe049d9b640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540d29d0 0x7fe0540cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe052d9d640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05415ce90 0x7fe0540cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe05259c640 1 -- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540d29d0 msgr2=0x7fe0540cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe05259c640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540d29d0 0x7fe0540cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe05259c640 1 -- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05415ce90 msgr2=0x7fe0540cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe05259c640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05415ce90 0x7fe0540cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe05259c640 1 -- 172.21.15.17:0/3793810926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009400 con 0x7fe0540b6000 2023-08-09T12:48:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe05259c640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540b6000 0x7fe0540c8730 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe0440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe04b7fe640 1 -- 172.21.15.17:0/3793810926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04403ad60 con 0x7fe0540b6000 2023-08-09T12:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe04b7fe640 1 -- 172.21.15.17:0/3793810926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0440443f0 con 0x7fe0540b6000 2023-08-09T12:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe04b7fe640 1 -- 172.21.15.17:0/3793810926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0440447a0 con 0x7fe0540b6000 2023-08-09T12:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.001+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0541e6870 con 0x7fe0540b6000 2023-08-09T12:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.002+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05415e140 con 0x7fe0540b6000 2023-08-09T12:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.003+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0541e63f0 con 0x7fe0540b6000 2023-08-09T12:48:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.004+0000 7fe04b7fe640 1 -- 172.21.15.17:0/3793810926 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe04404d450 con 0x7fe0540b6000 2023-08-09T12:48:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.005+0000 7fe04b7fe640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe03406a050 0x7fe03406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.005+0000 7fe04b7fe640 1 -- 172.21.15.17:0/3793810926 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe0440aa5c0 con 0x7fe0540b6000 2023-08-09T12:48:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.005+0000 7fe049d9b640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe03406a050 0x7fe03406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.007+0000 7fe049d9b640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe03406a050 0x7fe03406c510 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe0540cbc10 tx=0x7fe03c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.010+0000 7fe04b7fe640 1 -- 172.21.15.17:0/3793810926 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe0541e63f0 con 0x7fe0540b6000 2023-08-09T12:48:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.210+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe0541e63f0 con 0x7fe0540b6000 2023-08-09T12:48:44.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.211+0000 7fe04b7fe640 1 -- 172.21.15.17:0/3793810926 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v157) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe044035090 con 0x7fe0540b6000 2023-08-09T12:48:44.214 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:44.214 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:48:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:48:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:48:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:48:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:48:44.215 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:48:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:48:44.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:48:44.216 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:48:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe03406a050 msgr2=0x7fe03406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe03406a050 0x7fe03406c510 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe0540cbc10 tx=0x7fe03c008040 comp rx=0 tx=0).stop 2023-08-09T12:48:44.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540b6000 msgr2=0x7fe0540c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540b6000 0x7fe0540c8730 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe0440046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 shutdown_connections 2023-08-09T12:48:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe03406a050 0x7fe03406c510 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05415ce90 0x7fe0540cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0540d29d0 0x7fe0540cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 --2- 172.21.15.17:0/3793810926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540b6000 0x7fe0540c8730 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 >> 172.21.15.17:0/3793810926 conn(0x7fe05406fde0 msgr2=0x7fe0540b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.214+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 shutdown_connections 2023-08-09T12:48:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.215+0000 7fe058b01640 1 -- 172.21.15.17:0/3793810926 wait complete. 2023-08-09T12:48:44.237 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:48:44.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:48:44.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.472+0000 7fc61f20f640 1 Processor -- start 2023-08-09T12:48:44.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.473+0000 7fc61f20f640 1 -- start start 2023-08-09T12:48:44.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.474+0000 7fc61f20f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6180cfe90 0x7fc6180d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.474+0000 7fc61f20f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6180d0960 0x7fc6180b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.474+0000 7fc61f20f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6180d2680 con 0x7fc61815ccb0 2023-08-09T12:48:44.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.474+0000 7fc61f20f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6180d0f20 con 0x7fc6180d0960 2023-08-09T12:48:44.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.474+0000 7fc61f20f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180d1200 con 0x7fc6180cfe90 2023-08-09T12:48:44.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.475+0000 7fc61ea0e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6180d0960 0x7fc6180b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.475+0000 7fc61da0c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6180cfe90 0x7fc6180d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.475+0000 7fc61da0c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6180cfe90 0x7fc6180d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:41258/0 (socket says 172.21.15.17:41258) 2023-08-09T12:48:44.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.475+0000 7fc61da0c640 1 -- 172.21.15.17:0/936177311 learned_addr learned my addr 172.21.15.17:0/936177311 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:44.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.475+0000 7fc61ea0e640 1 --2- 172.21.15.17:0/936177311 >> v2:172.21.15.142:3300/0 conn(0x7fc6180d0960 0x7fc6180b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:54060/0 (socket says 172.21.15.17:54060) 2023-08-09T12:48:44.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.476+0000 7fc61da0c640 1 -- 172.21.15.17:0/936177311 >> v2:172.21.15.142:3300/0 conn(0x7fc6180d0960 msgr2=0x7fc6180b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.476+0000 7fc61da0c640 1 --2- 172.21.15.17:0/936177311 >> v2:172.21.15.142:3300/0 conn(0x7fc6180d0960 0x7fc6180b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.476+0000 7fc61da0c640 1 -- 172.21.15.17:0/936177311 >> v1:172.21.15.142:6789/0 conn(0x7fc61815ccb0 legacy=0x7fc6180cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.476+0000 7fc61da0c640 1 -- 172.21.15.17:0/936177311 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180d14e0 con 0x7fc6180cfe90 2023-08-09T12:48:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.477+0000 7fc61da0c640 1 --2- 172.21.15.17:0/936177311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6180cfe90 0x7fc6180d1da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6180b23c0 tx=0x7fc60c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5fdd70cc06f3cc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.478+0000 7fc61d20b640 1 -- 172.21.15.17:0/936177311 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c031830 con 0x7fc6180cfe90 2023-08-09T12:48:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.478+0000 7fc61d20b640 1 -- 172.21.15.17:0/936177311 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c031990 con 0x7fc6180cfe90 2023-08-09T12:48:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.478+0000 7fc61d20b640 1 -- 172.21.15.17:0/936177311 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c031d20 con 0x7fc6180cfe90 2023-08-09T12:48:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.478+0000 7fc61f20f640 1 -- 172.21.15.17:0/936177311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6180cfe90 msgr2=0x7fc6180d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.478+0000 7fc61f20f640 1 --2- 172.21.15.17:0/936177311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6180cfe90 0x7fc6180d1da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6180b23c0 tx=0x7fc60c02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.479+0000 7fc61f20f640 1 -- 172.21.15.17:0/936177311 shutdown_connections 2023-08-09T12:48:44.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.479+0000 7fc61f20f640 1 --2- 172.21.15.17:0/936177311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6180cfe90 0x7fc6180d1da0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.479+0000 7fc61f20f640 1 --2- 172.21.15.17:0/936177311 >> v2:172.21.15.142:3300/0 conn(0x7fc6180d0960 0x7fc6180b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.479+0000 7fc61f20f640 1 -- 172.21.15.17:0/936177311 >> 172.21.15.17:0/936177311 conn(0x7fc6180699a0 msgr2=0x7fc618069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:44.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.479+0000 7fc61f20f640 1 -- 172.21.15.17:0/936177311 shutdown_connections 2023-08-09T12:48:44.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.479+0000 7fc61f20f640 1 -- 172.21.15.17:0/936177311 wait complete. 2023-08-09T12:48:44.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.481+0000 7fc61f20f640 1 Processor -- start 2023-08-09T12:48:44.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.481+0000 7fc61f20f640 1 -- start start 2023-08-09T12:48:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61f20f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6180cfe90 0x7fc61815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61f20f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6180d0960 0x7fc61815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61f20f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc61815ccb0 0x7fc61814f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61f20f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6181553a0 con 0x7fc6180d0960 2023-08-09T12:48:44.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61f20f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61815d220 con 0x7fc6180cfe90 2023-08-09T12:48:44.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61f20f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61815f0a0 con 0x7fc61815ccb0 2023-08-09T12:48:44.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61da0c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6180d0960 0x7fc61815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61da0c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6180d0960 0x7fc61815f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42078/0 (socket says 172.21.15.17:42078) 2023-08-09T12:48:44.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.483+0000 7fc61da0c640 1 -- 172.21.15.17:0/248729788 learned_addr learned my addr 172.21.15.17:0/248729788 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:44.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc61ea0e640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc61815ccb0 0x7fc61814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc61e20d640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6180cfe90 0x7fc61815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc61da0c640 1 -- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc61815ccb0 msgr2=0x7fc61814f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc61da0c640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc61815ccb0 0x7fc61814f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc61da0c640 1 -- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6180cfe90 msgr2=0x7fc61815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc61da0c640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6180cfe90 0x7fc61815e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc61da0c640 1 -- 172.21.15.17:0/248729788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c0094d0 con 0x7fc6180d0960 2023-08-09T12:48:44.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc61da0c640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6180d0960 0x7fc61815f810 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc60c02b910 tx=0x7fc60c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:44.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc616ffd640 1 -- 172.21.15.17:0/248729788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c03a830 con 0x7fc6180d0960 2023-08-09T12:48:44.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc616ffd640 1 -- 172.21.15.17:0/248729788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c03a990 con 0x7fc6180d0960 2023-08-09T12:48:44.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.484+0000 7fc616ffd640 1 -- 172.21.15.17:0/248729788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c03ad20 con 0x7fc6180d0960 2023-08-09T12:48:44.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.485+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6181510d0 con 0x7fc6180d0960 2023-08-09T12:48:44.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.485+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61815d750 con 0x7fc6180d0960 2023-08-09T12:48:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.486+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61804e390 con 0x7fc6180d0960 2023-08-09T12:48:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.487+0000 7fc616ffd640 1 -- 172.21.15.17:0/248729788 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc60c0443f0 con 0x7fc6180d0960 2023-08-09T12:48:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.488+0000 7fc616ffd640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc60406a020 0x7fc60406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.488+0000 7fc616ffd640 1 -- 172.21.15.17:0/248729788 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc60c0aa350 con 0x7fc6180d0960 2023-08-09T12:48:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.488+0000 7fc61e20d640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc60406a020 0x7fc60406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:44.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.490+0000 7fc61e20d640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc60406a020 0x7fc60406c4e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc608007bf0 tx=0x7fc608007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:44.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.494+0000 7fc616ffd640 1 -- 172.21.15.17:0/248729788 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc60c075e10 con 0x7fc6180d0960 2023-08-09T12:48:44.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.688+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc6180b26b0 con 0x7fc6180d0960 2023-08-09T12:48:44.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.880+0000 7fc616ffd640 1 -- 172.21.15.17:0/248729788 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v158) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc60c079430 con 0x7fc6180d0960 2023-08-09T12:48:44.884 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:48:44.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc60406a020 msgr2=0x7fc60406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc60406a020 0x7fc60406c4e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc608007bf0 tx=0x7fc608007240 comp rx=0 tx=0).stop 2023-08-09T12:48:44.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6180d0960 msgr2=0x7fc61815f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:44.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6180d0960 0x7fc61815f810 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc60c02b910 tx=0x7fc60c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 shutdown_connections 2023-08-09T12:48:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc60406a020 0x7fc60406c4e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc61815ccb0 0x7fc61814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6180d0960 0x7fc61815f810 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 --2- 172.21.15.17:0/248729788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6180cfe90 0x7fc61815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 >> 172.21.15.17:0/248729788 conn(0x7fc6180699a0 msgr2=0x7fc6180ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:44.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 shutdown_connections 2023-08-09T12:48:44.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:44.886+0000 7fc61f20f640 1 -- 172.21.15.17:0/248729788 wait complete. 2023-08-09T12:48:44.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:48:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.150+0000 7f0e66501640 1 Processor -- start 2023-08-09T12:48:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.151+0000 7f0e66501640 1 -- start start 2023-08-09T12:48:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.153+0000 7f0e66501640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0e600ca4b0 0x7f0e601608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.153+0000 7f0e66501640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e60160de0 0x7f0e600ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.153+0000 7f0e66501640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e60161760 con 0x7f0e600cae30 2023-08-09T12:48:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.153+0000 7f0e66501640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e60161270 con 0x7f0e600ca4b0 2023-08-09T12:48:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.153+0000 7f0e66501640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600ceee0 con 0x7f0e60160de0 2023-08-09T12:48:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.153+0000 7f0e5f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0e600ca4b0 0x7f0e601608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.153+0000 7f0e5f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0e600ca4b0 0x7f0e601608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42094/0 (socket says 172.21.15.17:42094) 2023-08-09T12:48:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.153+0000 7f0e5f7fe640 1 -- 172.21.15.17:0/1917000019 learned_addr learned my addr 172.21.15.17:0/1917000019 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.154+0000 7f0e64a9e640 1 --2- 172.21.15.17:0/1917000019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e60160de0 0x7f0e600ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.154+0000 7f0e5f7fe640 1 -- 172.21.15.17:0/1917000019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e60160de0 msgr2=0x7f0e600ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.154+0000 7f0e5f7fe640 1 --2- 172.21.15.17:0/1917000019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e60160de0 0x7f0e600ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.154+0000 7f0e5f7fe640 1 -- 172.21.15.17:0/1917000019 >> v1:172.21.15.142:6789/0 conn(0x7f0e600cae30 legacy=0x7f0e600cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:45.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.154+0000 7f0e5f7fe640 1 -- 172.21.15.17:0/1917000019 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60161480 con 0x7f0e600ca4b0 2023-08-09T12:48:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.155+0000 7f0e5f7fe640 1 --2- 172.21.15.17:0/1917000019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e600ca4b0 0x7f0e601608a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009870 tx=0x7f0e5402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be0a002a0d03887 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.155+0000 7f0e5effd640 1 -- 172.21.15.17:0/1917000019 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54031640 con 0x7f0e600ca4b0 2023-08-09T12:48:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e5effd640 1 -- 172.21.15.17:0/1917000019 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e540317a0 con 0x7f0e600ca4b0 2023-08-09T12:48:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e5effd640 1 -- 172.21.15.17:0/1917000019 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54031b30 con 0x7f0e600ca4b0 2023-08-09T12:48:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e66501640 1 -- 172.21.15.17:0/1917000019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e600ca4b0 msgr2=0x7f0e601608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e66501640 1 --2- 172.21.15.17:0/1917000019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e600ca4b0 0x7f0e601608a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009870 tx=0x7f0e5402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e66501640 1 -- 172.21.15.17:0/1917000019 shutdown_connections 2023-08-09T12:48:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e66501640 1 --2- 172.21.15.17:0/1917000019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e60160de0 0x7f0e600ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e66501640 1 --2- 172.21.15.17:0/1917000019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e600ca4b0 0x7f0e601608a0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e66501640 1 -- 172.21.15.17:0/1917000019 >> 172.21.15.17:0/1917000019 conn(0x7f0e600cf100 msgr2=0x7f0e600cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e66501640 1 -- 172.21.15.17:0/1917000019 shutdown_connections 2023-08-09T12:48:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.156+0000 7f0e66501640 1 -- 172.21.15.17:0/1917000019 wait complete. 2023-08-09T12:48:45.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.158+0000 7f0e66501640 1 Processor -- start 2023-08-09T12:48:45.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.158+0000 7f0e66501640 1 -- start start 2023-08-09T12:48:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.159+0000 7f0e66501640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e600ca4b0 0x7f0e6015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.159+0000 7f0e66501640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600cae30 0x7f0e600c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.159+0000 7f0e66501640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60160de0 0x7f0e601599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.159+0000 7f0e66501640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6015a370 con 0x7f0e60160de0 2023-08-09T12:48:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.159+0000 7f0e66501640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c3630 con 0x7f0e600ca4b0 2023-08-09T12:48:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.159+0000 7f0e66501640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c3910 con 0x7f0e600cae30 2023-08-09T12:48:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60160de0 0x7f0e601599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60160de0 0x7f0e601599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42100/0 (socket says 172.21.15.17:42100) 2023-08-09T12:48:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 -- 172.21.15.17:0/3062108333 learned_addr learned my addr 172.21.15.17:0/3062108333 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e5f7fe640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600cae30 0x7f0e600c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e5ffff640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e600ca4b0 0x7f0e6015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 -- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600cae30 msgr2=0x7f0e600c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600cae30 0x7f0e600c2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 -- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e600ca4b0 msgr2=0x7f0e6015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e600ca4b0 0x7f0e6015beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 -- 172.21.15.17:0/3062108333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e540094d0 con 0x7f0e60160de0 2023-08-09T12:48:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e5ffff640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e600ca4b0 0x7f0e6015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.160+0000 7f0e64a9e640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60160de0 0x7f0e601599d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800d800 tx=0x7f0e5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.161+0000 7f0e5cff9640 1 -- 172.21.15.17:0/3062108333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800b6c0 con 0x7f0e60160de0 2023-08-09T12:48:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.161+0000 7f0e5cff9640 1 -- 172.21.15.17:0/3062108333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5800b840 con 0x7f0e60160de0 2023-08-09T12:48:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.161+0000 7f0e5cff9640 1 -- 172.21.15.17:0/3062108333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800bbf0 con 0x7f0e60160de0 2023-08-09T12:48:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.161+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e600c3bf0 con 0x7f0e60160de0 2023-08-09T12:48:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.161+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e600c32c0 con 0x7f0e60160de0 2023-08-09T12:48:45.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.162+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6015a4e0 con 0x7f0e60160de0 2023-08-09T12:48:45.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.163+0000 7f0e5cff9640 1 -- 172.21.15.17:0/3062108333 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e5800bd50 con 0x7f0e60160de0 2023-08-09T12:48:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.164+0000 7f0e5cff9640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e4c06a050 0x7f0e4c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.164+0000 7f0e5cff9640 1 -- 172.21.15.17:0/3062108333 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f0e580892b0 con 0x7f0e60160de0 2023-08-09T12:48:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.165+0000 7f0e5ffff640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e4c06a050 0x7f0e4c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.166+0000 7f0e5ffff640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e4c06a050 0x7f0e4c06c510 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0e600c4c60 tx=0x7f0e500073c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:45.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.168+0000 7f0e5cff9640 1 -- 172.21.15.17:0/3062108333 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0e58054b60 con 0x7f0e60160de0 2023-08-09T12:48:45.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.360+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0e600c9f60 con 0x7f0e60160de0 2023-08-09T12:48:45.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.901+0000 7f0e5cff9640 1 -- 172.21.15.17:0/3062108333 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v159) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0e58058180 con 0x7f0e60160de0 2023-08-09T12:48:45.912 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:48:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e4c06a050 msgr2=0x7f0e4c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e4c06a050 0x7f0e4c06c510 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0e600c4c60 tx=0x7f0e500073c0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60160de0 msgr2=0x7f0e601599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60160de0 0x7f0e601599d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800d800 tx=0x7f0e5800dcc0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 shutdown_connections 2023-08-09T12:48:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e4c06a050 0x7f0e4c06c510 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60160de0 0x7f0e601599d0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e600cae30 0x7f0e600c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 --2- 172.21.15.17:0/3062108333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e600ca4b0 0x7f0e6015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 >> 172.21.15.17:0/3062108333 conn(0x7f0e600cf100 msgr2=0x7f0e600cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 shutdown_connections 2023-08-09T12:48:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:45.914+0000 7f0e66501640 1 -- 172.21.15.17:0/3062108333 wait complete. 2023-08-09T12:48:45.938 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:48:46.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.142+0000 7f42dffff640 1 Processor -- start 2023-08-09T12:48:46.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.142+0000 7f42dffff640 1 -- start start 2023-08-09T12:48:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.144+0000 7f42dffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f42e00d26d0 0x7f42e0167b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.144+0000 7f42dffff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e00d0f00 con 0x7f42e00b8420 2023-08-09T12:48:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.144+0000 7f42dffff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e01611f0 con 0x7f42e015cb40 2023-08-09T12:48:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.144+0000 7f42dffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e01614d0 con 0x7f42e00d26d0 2023-08-09T12:48:46.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.144+0000 7f42de7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f42e00b8420 0x7f42e00cd860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37278/0 (socket says 172.21.15.17:37278) 2023-08-09T12:48:46.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.144+0000 7f42de7fc640 1 -- 172.21.15.17:0/687768497 learned_addr learned my addr 172.21.15.17:0/687768497 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:46.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.144+0000 7f42df7fe640 1 --2- 172.21.15.17:0/687768497 >> v2:172.21.15.142:3300/0 conn(0x7f42e00d26d0 0x7f42e0167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:46.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845122130 0 0) 0x7f42e00d0f00 con 0x7f42e00b8420 2023-08-09T12:48:46.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc003520 con 0x7f42e00b8420 2023-08-09T12:48:46.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1314144781 0 0) 0x7f42cc003520 con 0x7f42e00b8420 2023-08-09T12:48:46.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 >> v2:172.21.15.142:3300/0 conn(0x7f42e00d26d0 msgr2=0x7f42e0167b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:46.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 --2- 172.21.15.17:0/687768497 >> v2:172.21.15.142:3300/0 conn(0x7f42e00d26d0 0x7f42e0167b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 >> v1:172.21.15.142:6789/0 conn(0x7f42e015cb40 legacy=0x7f42e01609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e01617b0 con 0x7f42e00b8420 2023-08-09T12:48:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f42c8001670 con 0x7f42e00b8420 2023-08-09T12:48:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 >> v1:172.21.15.17:6789/0 conn(0x7f42e00b8420 legacy=0x7f42e00cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42cc003970 0x7f42cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42cc005180 0x7f42cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01614d0 con 0x7f42cc0047c0 2023-08-09T12:48:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00c030 con 0x7f42cc005180 2023-08-09T12:48:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.145+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00c1f0 con 0x7f42cc003970 2023-08-09T12:48:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42de7fc640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:46.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42de7fc640 1 -- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42cc003970 msgr2=0x7f42cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:46.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42deffd640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42cc003970 0x7f42cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:46.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42df7fe640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42cc005180 0x7f42cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:46.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42de7fc640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42cc003970 0x7f42cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42de7fc640 1 -- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42cc005180 msgr2=0x7f42cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:46.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42de7fc640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42cc005180 0x7f42cc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42de7fc640 1 -- 172.21.15.17:0/687768497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc003520 con 0x7f42cc0047c0 2023-08-09T12:48:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42df7fe640 1 -- 172.21.15.17:0/687768497 reap_dead start 2023-08-09T12:48:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.146+0000 7f42deffd640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42cc003970 0x7f42cc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.147+0000 7f42de7fc640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42cc004c40 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c240 tx=0x7f42cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b26d23dd70651f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8005ad0 con 0x7f42cc0047c0 2023-08-09T12:48:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8005c30 con 0x7f42cc0047c0 2023-08-09T12:48:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42ddffb640 1 -- 172.21.15.17:0/687768497 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c802caf0 con 0x7f42cc0047c0 2023-08-09T12:48:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42dffff640 1 -- 172.21.15.17:0/687768497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 msgr2=0x7f42cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42dffff640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42cc004c40 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c240 tx=0x7f42cc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42dffff640 1 -- 172.21.15.17:0/687768497 shutdown_connections 2023-08-09T12:48:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42dffff640 1 --2- 172.21.15.17:0/687768497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42cc004c40 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42dffff640 1 -- 172.21.15.17:0/687768497 >> 172.21.15.17:0/687768497 conn(0x7f42e00d2ab0 msgr2=0x7f42e00d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42dffff640 1 -- 172.21.15.17:0/687768497 shutdown_connections 2023-08-09T12:48:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.148+0000 7f42dffff640 1 -- 172.21.15.17:0/687768497 wait complete. 2023-08-09T12:48:46.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.150+0000 7f42dffff640 1 Processor -- start 2023-08-09T12:48:46.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.150+0000 7f42dffff640 1 -- start start 2023-08-09T12:48:46.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.151+0000 7f42dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42e01f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:46.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.151+0000 7f42dffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e0153490 0x7f42e00c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:46.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.151+0000 7f42dffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e00d15c0 0x7f42e00d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:46.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.151+0000 7f42dffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e015e250 con 0x7f42cc0047c0 2023-08-09T12:48:46.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.151+0000 7f42dffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0154df0 con 0x7f42e00d15c0 2023-08-09T12:48:46.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.151+0000 7f42dffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00d1f80 con 0x7f42e0153490 2023-08-09T12:48:46.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42e01f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:46.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42e01f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42126/0 (socket says 172.21.15.17:42126) 2023-08-09T12:48:46.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 -- 172.21.15.17:0/414043943 learned_addr learned my addr 172.21.15.17:0/414043943 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:46.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42de7fc640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e0153490 0x7f42e00c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:46.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42df7fe640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e00d15c0 0x7f42e00d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:46.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 -- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e0153490 msgr2=0x7f42e00c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:46.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e0153490 0x7f42e00c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 -- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e00d15c0 msgr2=0x7f42e00d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e00d15c0 0x7f42e00d1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 -- 172.21.15.17:0/414043943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0155090 con 0x7f42cc0047c0 2023-08-09T12:48:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42df7fe640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e00d15c0 0x7f42e00d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.152+0000 7f42deffd640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42e01f5590 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f42d000d810 tx=0x7f42d000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.153+0000 7f42d77fe640 1 -- 172.21.15.17:0/414043943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0003990 con 0x7f42cc0047c0 2023-08-09T12:48:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.153+0000 7f42d77fe640 1 -- 172.21.15.17:0/414043943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d0003b10 con 0x7f42cc0047c0 2023-08-09T12:48:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.153+0000 7f42d77fe640 1 -- 172.21.15.17:0/414043943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d000b6b0 con 0x7f42cc0047c0 2023-08-09T12:48:46.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.153+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e01f5ad0 con 0x7f42cc0047c0 2023-08-09T12:48:46.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.153+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e01f6030 con 0x7f42cc0047c0 2023-08-09T12:48:46.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.154+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e004e390 con 0x7f42cc0047c0 2023-08-09T12:48:46.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.157+0000 7f42d77fe640 1 -- 172.21.15.17:0/414043943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f42d000b810 con 0x7f42cc0047c0 2023-08-09T12:48:46.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.157+0000 7f42d77fe640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f42c006a050 0x7f42c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:46.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.158+0000 7f42d77fe640 1 -- 172.21.15.17:0/414043943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f42d0088140 con 0x7f42cc0047c0 2023-08-09T12:48:46.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.158+0000 7f42de7fc640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f42c006a050 0x7f42c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:46.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.159+0000 7f42de7fc640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f42c006a050 0x7f42c006c510 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f42c8034000 tx=0x7f42c8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:46.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.161+0000 7f42d77fe640 1 -- 172.21.15.17:0/414043943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f42d0053a20 con 0x7f42cc0047c0 2023-08-09T12:48:46.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.394+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f42e0154bd0 con 0x7f42cc0047c0 2023-08-09T12:48:46.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.967+0000 7f42d77fe640 1 -- 172.21.15.17:0/414043943 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7f42d0057040 con 0x7f42cc0047c0 2023-08-09T12:48:46.971 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 19 and data pool 20 2023-08-09T12:48:46.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.973+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f42c006a050 msgr2=0x7f42c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:46.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f42c006a050 0x7f42c006c510 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f42c8034000 tx=0x7f42c8009030 comp rx=0 tx=0).stop 2023-08-09T12:48:46.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 msgr2=0x7f42e01f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:46.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42e01f5590 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f42d000d810 tx=0x7f42d000dcd0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 shutdown_connections 2023-08-09T12:48:46.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f42c006a050 0x7f42c006c510 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e00d15c0 0x7f42e00d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e0153490 0x7f42e00c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 --2- 172.21.15.17:0/414043943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc0047c0 0x7f42e01f5590 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:46.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.974+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 >> 172.21.15.17:0/414043943 conn(0x7f42e00d2ab0 msgr2=0x7f42e015be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:46.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.975+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 shutdown_connections 2023-08-09T12:48:46.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:46.975+0000 7f42dffff640 1 -- 172.21.15.17:0/414043943 wait complete. 2023-08-09T12:48:46.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:47.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.199+0000 7f917b46c640 1 Processor -- start 2023-08-09T12:48:47.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.200+0000 7f917b46c640 1 -- start start 2023-08-09T12:48:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.201+0000 7f917b46c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9174159d80 0x7f91740b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.201+0000 7f917b46c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9174070a90 0x7f91740c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.201+0000 7f917b46c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91740b4630 con 0x7f91740ad810 2023-08-09T12:48:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.201+0000 7f917b46c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917415a160 con 0x7f9174070a90 2023-08-09T12:48:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.201+0000 7f917b46c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91740b3ab0 con 0x7f9174159d80 2023-08-09T12:48:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.202+0000 7f9179a09640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9174070a90 0x7f91740c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.202+0000 7f9179a09640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9174070a90 0x7f91740c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42142/0 (socket says 172.21.15.17:42142) 2023-08-09T12:48:47.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.202+0000 7f9179a09640 1 -- 172.21.15.17:0/3372480269 learned_addr learned my addr 172.21.15.17:0/3372480269 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:47.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.202+0000 7f9179208640 1 --2- 172.21.15.17:0/3372480269 >> v2:172.21.15.142:3300/0 conn(0x7f9174159d80 0x7f91740b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.202+0000 7f9179a09640 1 -- 172.21.15.17:0/3372480269 >> v2:172.21.15.142:3300/0 conn(0x7f9174159d80 msgr2=0x7f91740b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:47.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.202+0000 7f9179a09640 1 --2- 172.21.15.17:0/3372480269 >> v2:172.21.15.142:3300/0 conn(0x7f9174159d80 0x7f91740b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.202+0000 7f9179a09640 1 -- 172.21.15.17:0/3372480269 >> v1:172.21.15.142:6789/0 conn(0x7f91740ad810 legacy=0x7f9174070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.202+0000 7f9179a09640 1 -- 172.21.15.17:0/3372480269 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740b3d90 con 0x7f9174070a90 2023-08-09T12:48:47.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.203+0000 7f9179a09640 1 --2- 172.21.15.17:0/3372480269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174070a90 0x7f91740c8fd0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f91740cb110 tx=0x7f916c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451d1ef86145292d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:47.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.204+0000 7f916bfff640 1 -- 172.21.15.17:0/3372480269 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c02ca80 con 0x7f9174070a90 2023-08-09T12:48:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.204+0000 7f916bfff640 1 -- 172.21.15.17:0/3372480269 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c02cbe0 con 0x7f9174070a90 2023-08-09T12:48:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.204+0000 7f916bfff640 1 -- 172.21.15.17:0/3372480269 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c0343f0 con 0x7f9174070a90 2023-08-09T12:48:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.204+0000 7f917b46c640 1 -- 172.21.15.17:0/3372480269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174070a90 msgr2=0x7f91740c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.204+0000 7f917b46c640 1 --2- 172.21.15.17:0/3372480269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174070a90 0x7f91740c8fd0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f91740cb110 tx=0x7f916c02bee0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.205+0000 7f917b46c640 1 -- 172.21.15.17:0/3372480269 shutdown_connections 2023-08-09T12:48:47.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.205+0000 7f917b46c640 1 --2- 172.21.15.17:0/3372480269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174070a90 0x7f91740c8fd0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.205+0000 7f917b46c640 1 --2- 172.21.15.17:0/3372480269 >> v2:172.21.15.142:3300/0 conn(0x7f9174159d80 0x7f91740b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.205+0000 7f917b46c640 1 -- 172.21.15.17:0/3372480269 >> 172.21.15.17:0/3372480269 conn(0x7f91740cb1b0 msgr2=0x7f91740cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:47.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.205+0000 7f917b46c640 1 -- 172.21.15.17:0/3372480269 shutdown_connections 2023-08-09T12:48:47.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.205+0000 7f917b46c640 1 -- 172.21.15.17:0/3372480269 wait complete. 2023-08-09T12:48:47.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.207+0000 7f917b46c640 1 Processor -- start 2023-08-09T12:48:47.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.207+0000 7f917b46c640 1 -- start start 2023-08-09T12:48:47.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.208+0000 7f917b46c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9174070a90 0x7f917415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.208+0000 7f917b46c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91740ad810 0x7f91740ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.208+0000 7f917b46c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174159d80 0x7f91740c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.208+0000 7f917b46c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917415d5d0 con 0x7f9174159d80 2023-08-09T12:48:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.208+0000 7f917b46c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91740ae160 con 0x7f91740ad810 2023-08-09T12:48:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.208+0000 7f917b46c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91740ae400 con 0x7f9174070a90 2023-08-09T12:48:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179a09640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174159d80 0x7f91740c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179a09640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174159d80 0x7f91740c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42144/0 (socket says 172.21.15.17:42144) 2023-08-09T12:48:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179a09640 1 -- 172.21.15.17:0/2966741225 learned_addr learned my addr 172.21.15.17:0/2966741225 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9178a07640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91740ad810 0x7f91740ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179208640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9174070a90 0x7f917415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179a09640 1 -- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9174070a90 msgr2=0x7f917415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179a09640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9174070a90 0x7f917415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179a09640 1 -- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91740ad810 msgr2=0x7f91740ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179a09640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91740ad810 0x7f91740ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.209+0000 7f9179a09640 1 -- 172.21.15.17:0/2966741225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009b30 con 0x7f9174159d80 2023-08-09T12:48:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.210+0000 7f9179a09640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174159d80 0x7f91740c5770 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f916c036040 tx=0x7f916c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.210+0000 7f9169ffb640 1 -- 172.21.15.17:0/2966741225 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c03e450 con 0x7f9174159d80 2023-08-09T12:48:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.210+0000 7f9169ffb640 1 -- 172.21.15.17:0/2966741225 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c03e5d0 con 0x7f9174159d80 2023-08-09T12:48:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.210+0000 7f9169ffb640 1 -- 172.21.15.17:0/2966741225 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c03e980 con 0x7f9174159d80 2023-08-09T12:48:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.210+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91740ae6e0 con 0x7f9174159d80 2023-08-09T12:48:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.210+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91740aeca0 con 0x7f9174159d80 2023-08-09T12:48:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.211+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9174067a80 con 0x7f9174159d80 2023-08-09T12:48:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.212+0000 7f9169ffb640 1 -- 172.21.15.17:0/2966741225 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f916c02cd50 con 0x7f9174159d80 2023-08-09T12:48:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.213+0000 7f9169ffb640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f915806a050 0x7f915806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.213+0000 7f9169ffb640 1 -- 172.21.15.17:0/2966741225 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f916c0ab150 con 0x7f9174159d80 2023-08-09T12:48:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.214+0000 7f9179208640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f915806a050 0x7f915806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.215+0000 7f9179208640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f915806a050 0x7f915806c510 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9170006fd0 tx=0x7f9170008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.218+0000 7f9169ffb640 1 -- 172.21.15.17:0/2966741225 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f916c076860 con 0x7f9174159d80 2023-08-09T12:48:47.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.414+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91740c6e70 con 0x7f9174159d80 2023-08-09T12:48:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.417+0000 7f9169ffb640 1 -- 172.21.15.17:0/2966741225 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+18300 (secure 0 0 0) 0x7f916c079e80 con 0x7f9174159d80 2023-08-09T12:48:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:47.422 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":160,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:46.396027+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:48:44.746706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-09T12:48:45.418671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f915806a050 msgr2=0x7f915806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f915806a050 0x7f915806c510 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9170006fd0 tx=0x7f9170008040 comp rx=0 tx=0).stop 2023-08-09T12:48:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174159d80 msgr2=0x7f91740c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174159d80 0x7f91740c5770 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f916c036040 tx=0x7f916c004a40 comp rx=0 tx=0).stop 2023-08-09T12:48:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 shutdown_connections 2023-08-09T12:48:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f915806a050 0x7f915806c510 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9174159d80 0x7f91740c5770 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91740ad810 0x7f91740ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 --2- 172.21.15.17:0/2966741225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9174070a90 0x7f917415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.420+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 >> 172.21.15.17:0/2966741225 conn(0x7f91740cb1b0 msgr2=0x7f9174070380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.421+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 shutdown_connections 2023-08-09T12:48:47.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.421+0000 7f917b46c640 1 -- 172.21.15.17:0/2966741225 wait complete. 2023-08-09T12:48:47.444 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:47.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.670+0000 7f0bb6922640 1 Processor -- start 2023-08-09T12:48:47.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.670+0000 7f0bb6922640 1 -- start start 2023-08-09T12:48:47.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.671+0000 7f0bb6922640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0bb00cfce0 0x7f0bb00afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.671+0000 7f0bb6922640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0bb00cdf60 0x7f0bb00d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.671+0000 7f0bb6922640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb0071270 con 0x7f0bb0071700 2023-08-09T12:48:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.671+0000 7f0bb6922640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb006b7d0 con 0x7f0bb00cdf60 2023-08-09T12:48:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.671+0000 7f0bb6922640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb00d0600 con 0x7f0bb00cfce0 2023-08-09T12:48:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baf7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0bb00cdf60 0x7f0bb00d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baf7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0bb00cdf60 0x7f0bb00d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42148/0 (socket says 172.21.15.17:42148) 2023-08-09T12:48:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baf7fe640 1 -- 172.21.15.17:0/922570616 learned_addr learned my addr 172.21.15.17:0/922570616 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0bb4ebf640 1 --1- 172.21.15.17:0/922570616 >> v1:172.21.15.17:6789/0 conn(0x7f0bb0071700 0x7f0bb01608b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37284/0 (socket says 172.21.15.17:37284) 2023-08-09T12:48:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baffff640 1 --2- 172.21.15.17:0/922570616 >> v2:172.21.15.142:3300/0 conn(0x7f0bb00cfce0 0x7f0bb00afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baf7fe640 1 -- 172.21.15.17:0/922570616 >> v2:172.21.15.142:3300/0 conn(0x7f0bb00cfce0 msgr2=0x7f0bb00afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baf7fe640 1 --2- 172.21.15.17:0/922570616 >> v2:172.21.15.142:3300/0 conn(0x7f0bb00cfce0 0x7f0bb00afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baf7fe640 1 -- 172.21.15.17:0/922570616 >> v1:172.21.15.17:6789/0 conn(0x7f0bb0071700 legacy=0x7f0bb01608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baf7fe640 1 -- 172.21.15.17:0/922570616 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00b2f70 con 0x7f0bb00cdf60 2023-08-09T12:48:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baeffd640 1 -- 172.21.15.17:0/922570616 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67159463 0 0) 0x7f0bb0071270 con 0x7f0bb0071700 2023-08-09T12:48:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.672+0000 7f0baffff640 1 --2- 172.21.15.17:0/922570616 >> v2:172.21.15.142:3300/0 conn(0x7f0bb00cfce0 0x7f0bb00afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:48:47.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0baf7fe640 1 --2- 172.21.15.17:0/922570616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb00cdf60 0x7f0bb00d00c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0066720 tx=0x7f0ba402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c235d2b5b150a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:47.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0baeffd640 1 -- 172.21.15.17:0/922570616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4030860 con 0x7f0bb00cdf60 2023-08-09T12:48:47.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0baeffd640 1 -- 172.21.15.17:0/922570616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba40309c0 con 0x7f0bb00cdf60 2023-08-09T12:48:47.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0baeffd640 1 -- 172.21.15.17:0/922570616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4030d50 con 0x7f0bb00cdf60 2023-08-09T12:48:47.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0bb6922640 1 -- 172.21.15.17:0/922570616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb00cdf60 msgr2=0x7f0bb00d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0bb6922640 1 --2- 172.21.15.17:0/922570616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb00cdf60 0x7f0bb00d00c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0066720 tx=0x7f0ba402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0bb6922640 1 -- 172.21.15.17:0/922570616 shutdown_connections 2023-08-09T12:48:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0bb6922640 1 --2- 172.21.15.17:0/922570616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb00cdf60 0x7f0bb00d00c0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0bb6922640 1 --2- 172.21.15.17:0/922570616 >> v2:172.21.15.142:3300/0 conn(0x7f0bb00cfce0 0x7f0bb00afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.674+0000 7f0bb6922640 1 -- 172.21.15.17:0/922570616 >> 172.21.15.17:0/922570616 conn(0x7f0bb00cd440 msgr2=0x7f0bb00cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.675+0000 7f0bb6922640 1 -- 172.21.15.17:0/922570616 shutdown_connections 2023-08-09T12:48:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.675+0000 7f0bb6922640 1 -- 172.21.15.17:0/922570616 wait complete. 2023-08-09T12:48:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.676+0000 7f0bb6922640 1 Processor -- start 2023-08-09T12:48:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.676+0000 7f0bb6922640 1 -- start start 2023-08-09T12:48:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.677+0000 7f0bb6922640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb0071700 0x7f0bb01e5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.677+0000 7f0bb6922640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bb00cdf60 0x7f0bb01e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.677+0000 7f0bb6922640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bb00cfce0 0x7f0bb01e2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.677+0000 7f0bb6922640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01e29c0 con 0x7f0bb0071700 2023-08-09T12:48:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.677+0000 7f0bb6922640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0144190 con 0x7f0bb00cfce0 2023-08-09T12:48:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.677+0000 7f0bb6922640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01e5d90 con 0x7f0bb00cdf60 2023-08-09T12:48:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb0071700 0x7f0bb01e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb0071700 0x7f0bb01e5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42154/0 (socket says 172.21.15.17:42154) 2023-08-09T12:48:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baffff640 1 -- 172.21.15.17:0/2183386026 learned_addr learned my addr 172.21.15.17:0/2183386026 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0bb4ebf640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bb00cfce0 0x7f0bb01e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baf7fe640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bb00cdf60 0x7f0bb01e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baffff640 1 -- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bb00cdf60 msgr2=0x7f0bb01e1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baffff640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bb00cdf60 0x7f0bb01e1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baffff640 1 -- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bb00cfce0 msgr2=0x7f0bb01e2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baffff640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bb00cfce0 0x7f0bb01e2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.678+0000 7f0baffff640 1 -- 172.21.15.17:0/2183386026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40094d0 con 0x7f0bb0071700 2023-08-09T12:48:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.679+0000 7f0baffff640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb0071700 0x7f0bb01e5850 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0007f20 tx=0x7f0ba000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.679+0000 7f0bacff9640 1 -- 172.21.15.17:0/2183386026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba000dee0 con 0x7f0bb0071700 2023-08-09T12:48:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.679+0000 7f0bacff9640 1 -- 172.21.15.17:0/2183386026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba000f040 con 0x7f0bb0071700 2023-08-09T12:48:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.679+0000 7f0bacff9640 1 -- 172.21.15.17:0/2183386026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0003db0 con 0x7f0bb0071700 2023-08-09T12:48:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.679+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb01e88a0 con 0x7f0bb0071700 2023-08-09T12:48:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.679+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb0143e20 con 0x7f0bb0071700 2023-08-09T12:48:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.680+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb0067a80 con 0x7f0bb0071700 2023-08-09T12:48:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.681+0000 7f0bacff9640 1 -- 172.21.15.17:0/2183386026 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ba0004030 con 0x7f0bb0071700 2023-08-09T12:48:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.682+0000 7f0bacff9640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b9c06a050 0x7f0b9c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.682+0000 7f0bacff9640 1 -- 172.21.15.17:0/2183386026 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ba0088880 con 0x7f0bb0071700 2023-08-09T12:48:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.683+0000 7f0baf7fe640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b9c06a050 0x7f0b9c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.684+0000 7f0baf7fe640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b9c06a050 0x7f0b9c06c510 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4036000 tx=0x7f0ba4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.687+0000 7f0bacff9640 1 -- 172.21.15.17:0/2183386026 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0ba0053f80 con 0x7f0bb0071700 2023-08-09T12:48:47.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.879+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bb006ab00 con 0x7f0bb0071700 2023-08-09T12:48:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.881+0000 7f0bacff9640 1 -- 172.21.15.17:0/2183386026 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+18300 (secure 0 0 0) 0x7f0ba00575a0 con 0x7f0bb0071700 2023-08-09T12:48:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:47.886 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":160,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:46.396027+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:48:44.746706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-09T12:48:45.418671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:47.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b9c06a050 msgr2=0x7f0b9c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b9c06a050 0x7f0b9c06c510 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4036000 tx=0x7f0ba4008030 comp rx=0 tx=0).stop 2023-08-09T12:48:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb0071700 msgr2=0x7f0bb01e5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb0071700 0x7f0bb01e5850 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0007f20 tx=0x7f0ba000d560 comp rx=0 tx=0).stop 2023-08-09T12:48:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 shutdown_connections 2023-08-09T12:48:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b9c06a050 0x7f0b9c06c510 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bb00cfce0 0x7f0bb01e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bb00cdf60 0x7f0bb01e1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 --2- 172.21.15.17:0/2183386026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb0071700 0x7f0bb01e5850 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 >> 172.21.15.17:0/2183386026 conn(0x7f0bb00cd440 msgr2=0x7f0bb00c42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.884+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 shutdown_connections 2023-08-09T12:48:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:47.885+0000 7f0bb6922640 1 -- 172.21.15.17:0/2183386026 wait complete. 2023-08-09T12:48:47.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:48:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.128+0000 7fd717b22640 1 Processor -- start 2023-08-09T12:48:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.128+0000 7fd717b22640 1 -- start start 2023-08-09T12:48:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.130+0000 7fd717b22640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd7100ce9e0 0x7fd7100cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.130+0000 7fd717b22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd71015b160 0x7fd71015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.130+0000 7fd717b22640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100cf380 con 0x7fd710158840 2023-08-09T12:48:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.130+0000 7fd717b22640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd710158c20 con 0x7fd7100ce9e0 2023-08-09T12:48:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.130+0000 7fd717b22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100b0220 con 0x7fd71015b160 2023-08-09T12:48:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.130+0000 7fd7150bd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd7100ce9e0 0x7fd7100cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.131+0000 7fd7150bd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd7100ce9e0 0x7fd7100cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57058/0 (socket says 172.21.15.17:57058) 2023-08-09T12:48:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.131+0000 7fd7150bd640 1 -- 172.21.15.17:0/686095961 learned_addr learned my addr 172.21.15.17:0/686095961 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.131+0000 7fd7160bf640 1 --2- 172.21.15.17:0/686095961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd71015b160 0x7fd71015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.131+0000 7fd7150bd640 1 -- 172.21.15.17:0/686095961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd71015b160 msgr2=0x7fd71015b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.131+0000 7fd7150bd640 1 --2- 172.21.15.17:0/686095961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd71015b160 0x7fd71015b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.131+0000 7fd7150bd640 1 -- 172.21.15.17:0/686095961 >> v1:172.21.15.142:6789/0 conn(0x7fd710158840 legacy=0x7fd7100af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.131+0000 7fd7150bd640 1 -- 172.21.15.17:0/686095961 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71015e7f0 con 0x7fd7100ce9e0 2023-08-09T12:48:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.132+0000 7fd7150bd640 1 --2- 172.21.15.17:0/686095961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd7100cee40 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e31b331694b1a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd7148bc640 1 -- 172.21.15.17:0/686095961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700031640 con 0x7fd7100ce9e0 2023-08-09T12:48:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd7148bc640 1 -- 172.21.15.17:0/686095961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7000317a0 con 0x7fd7100ce9e0 2023-08-09T12:48:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd7148bc640 1 -- 172.21.15.17:0/686095961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700031b30 con 0x7fd7100ce9e0 2023-08-09T12:48:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd717b22640 1 -- 172.21.15.17:0/686095961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 msgr2=0x7fd7100cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd717b22640 1 --2- 172.21.15.17:0/686095961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd7100cee40 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70002b8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd717b22640 1 -- 172.21.15.17:0/686095961 shutdown_connections 2023-08-09T12:48:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd717b22640 1 --2- 172.21.15.17:0/686095961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd71015b160 0x7fd71015b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd717b22640 1 --2- 172.21.15.17:0/686095961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd7100cee40 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd717b22640 1 -- 172.21.15.17:0/686095961 >> 172.21.15.17:0/686095961 conn(0x7fd710069be0 msgr2=0x7fd710069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd717b22640 1 -- 172.21.15.17:0/686095961 shutdown_connections 2023-08-09T12:48:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.133+0000 7fd717b22640 1 -- 172.21.15.17:0/686095961 wait complete. 2023-08-09T12:48:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.135+0000 7fd717b22640 1 Processor -- start 2023-08-09T12:48:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.135+0000 7fd717b22640 1 -- start start 2023-08-09T12:48:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.136+0000 7fd717b22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd710150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.136+0000 7fd717b22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd710158840 0x7fd7100b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.136+0000 7fd717b22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71015b160 0x7fd7100b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.136+0000 7fd717b22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015ccf0 con 0x7fd7100ce9e0 2023-08-09T12:48:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.136+0000 7fd717b22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015cf50 con 0x7fd71015b160 2023-08-09T12:48:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.136+0000 7fd717b22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015d210 con 0x7fd710158840 2023-08-09T12:48:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7158be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd710150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:48.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7158be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd710150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57062/0 (socket says 172.21.15.17:57062) 2023-08-09T12:48:48.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7158be640 1 -- 172.21.15.17:0/1959601665 learned_addr learned my addr 172.21.15.17:0/1959601665 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:48.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7160bf640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71015b160 0x7fd7100b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7150bd640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd710158840 0x7fd7100b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7158be640 1 -- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd710158840 msgr2=0x7fd7100b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7158be640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd710158840 0x7fd7100b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7158be640 1 -- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71015b160 msgr2=0x7fd7100b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7158be640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71015b160 0x7fd7100b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.137+0000 7fd7158be640 1 -- 172.21.15.17:0/1959601665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000094d0 con 0x7fd7100ce9e0 2023-08-09T12:48:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.138+0000 7fd7158be640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd710150140 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00c430 tx=0x7fd70c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.138+0000 7fd7067fc640 1 -- 172.21.15.17:0/1959601665 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c011790 con 0x7fd7100ce9e0 2023-08-09T12:48:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.138+0000 7fd7067fc640 1 -- 172.21.15.17:0/1959601665 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c0118f0 con 0x7fd7100ce9e0 2023-08-09T12:48:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.138+0000 7fd7067fc640 1 -- 172.21.15.17:0/1959601665 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c011ce0 con 0x7fd7100ce9e0 2023-08-09T12:48:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.138+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71015d4f0 con 0x7fd7100ce9e0 2023-08-09T12:48:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.138+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd710150680 con 0x7fd7100ce9e0 2023-08-09T12:48:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.139+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd710067a80 con 0x7fd7100ce9e0 2023-08-09T12:48:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.141+0000 7fd7067fc640 1 -- 172.21.15.17:0/1959601665 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd70c01c460 con 0x7fd7100ce9e0 2023-08-09T12:48:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.141+0000 7fd7067fc640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6f406a080 0x7fd6f406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:48.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.142+0000 7fd7067fc640 1 -- 172.21.15.17:0/1959601665 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd70c0885d0 con 0x7fd7100ce9e0 2023-08-09T12:48:48.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.142+0000 7fd7150bd640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6f406a080 0x7fd6f406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:48.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.143+0000 7fd7150bd640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6f406a080 0x7fd6f406c540 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd700036000 tx=0x7fd70003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:48.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.146+0000 7fd7067fc640 1 -- 172.21.15.17:0/1959601665 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd70c053c20 con 0x7fd7100ce9e0 2023-08-09T12:48:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.375+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd71006b380 con 0x7fd7100ce9e0 2023-08-09T12:48:48.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.971+0000 7fd7067fc640 1 -- 172.21.15.17:0/1959601665 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd70c057240 con 0x7fd7100ce9e0 2023-08-09T12:48:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6f406a080 msgr2=0x7fd6f406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6f406a080 0x7fd6f406c540 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd700036000 tx=0x7fd70003c040 comp rx=0 tx=0).stop 2023-08-09T12:48:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 msgr2=0x7fd710150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd710150140 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00c430 tx=0x7fd70c00c8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 shutdown_connections 2023-08-09T12:48:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6f406a080 0x7fd6f406c540 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71015b160 0x7fd7100b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd710158840 0x7fd7100b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 --2- 172.21.15.17:0/1959601665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7100ce9e0 0x7fd710150140 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.975+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 >> 172.21.15.17:0/1959601665 conn(0x7fd710069be0 msgr2=0x7fd71006eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.976+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 shutdown_connections 2023-08-09T12:48:48.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:48.976+0000 7fd717b22640 1 -- 172.21.15.17:0/1959601665 wait complete. 2023-08-09T12:48:48.999 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:48:49.000 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:48:49.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.233+0000 7fda620f5640 1 Processor -- start 2023-08-09T12:48:49.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.233+0000 7fda620f5640 1 -- start start 2023-08-09T12:48:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda620f5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda5c069ed0 0x7fda5c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda620f5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda620f5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c0cdd40 con 0x7fda5c15ca30 2023-08-09T12:48:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda620f5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c0cd130 con 0x7fda5c069ed0 2023-08-09T12:48:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda620f5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0cd410 con 0x7fda5c0ccbc0 2023-08-09T12:48:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda608f2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda5c069ed0 0x7fda5c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda608f2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda5c069ed0 0x7fda5c0c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57064/0 (socket says 172.21.15.17:57064) 2023-08-09T12:48:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda608f2640 1 -- 172.21.15.17:0/1747658587 learned_addr learned my addr 172.21.15.17:0/1747658587 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.235+0000 7fda610f3640 1 --1- 172.21.15.17:0/1747658587 >> v1:172.21.15.17:6789/0 conn(0x7fda5c15ca30 0x7fda5c0697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41018/0 (socket says 172.21.15.17:41018) 2023-08-09T12:48:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.236+0000 7fda608f2640 1 -- 172.21.15.17:0/1747658587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 msgr2=0x7fda5c0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.236+0000 7fda618f4640 1 --2- 172.21.15.17:0/1747658587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.236+0000 7fda608f2640 1 --2- 172.21.15.17:0/1747658587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.236+0000 7fda608f2640 1 -- 172.21.15.17:0/1747658587 >> v1:172.21.15.17:6789/0 conn(0x7fda5c15ca30 legacy=0x7fda5c0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:49.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.236+0000 7fda53fff640 1 -- 172.21.15.17:0/1747658587 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409302397 0 0) 0x7fda5c0cdd40 con 0x7fda5c15ca30 2023-08-09T12:48:49.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.236+0000 7fda608f2640 1 -- 172.21.15.17:0/1747658587 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0cd6f0 con 0x7fda5c069ed0 2023-08-09T12:48:49.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.236+0000 7fda618f4640 1 --2- 172.21.15.17:0/1747658587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.237+0000 7fda608f2640 1 --2- 172.21.15.17:0/1747658587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c069ed0 0x7fda5c0c9d00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009870 tx=0x7fda4c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a406757fb800eacb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda53fff640 1 -- 172.21.15.17:0/1747658587 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c030840 con 0x7fda5c069ed0 2023-08-09T12:48:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda53fff640 1 -- 172.21.15.17:0/1747658587 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c0309a0 con 0x7fda5c069ed0 2023-08-09T12:48:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda53fff640 1 -- 172.21.15.17:0/1747658587 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c030d30 con 0x7fda5c069ed0 2023-08-09T12:48:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda620f5640 1 -- 172.21.15.17:0/1747658587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c069ed0 msgr2=0x7fda5c0c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda620f5640 1 --2- 172.21.15.17:0/1747658587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c069ed0 0x7fda5c0c9d00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009870 tx=0x7fda4c02b980 comp rx=0 tx=0).stop 2023-08-09T12:48:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda620f5640 1 -- 172.21.15.17:0/1747658587 shutdown_connections 2023-08-09T12:48:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda620f5640 1 --2- 172.21.15.17:0/1747658587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda620f5640 1 --2- 172.21.15.17:0/1747658587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c069ed0 0x7fda5c0c9d00 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.238+0000 7fda620f5640 1 -- 172.21.15.17:0/1747658587 >> 172.21.15.17:0/1747658587 conn(0x7fda5c06abd0 msgr2=0x7fda5c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.239+0000 7fda620f5640 1 -- 172.21.15.17:0/1747658587 shutdown_connections 2023-08-09T12:48:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.239+0000 7fda620f5640 1 -- 172.21.15.17:0/1747658587 wait complete. 2023-08-09T12:48:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.240+0000 7fda620f5640 1 Processor -- start 2023-08-09T12:48:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.240+0000 7fda620f5640 1 -- start start 2023-08-09T12:48:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.241+0000 7fda620f5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda5c069ed0 0x7fda5c06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.241+0000 7fda620f5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.241+0000 7fda620f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c15ca30 0x7fda5c159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.241+0000 7fda620f5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0b2430 con 0x7fda5c15ca30 2023-08-09T12:48:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.241+0000 7fda620f5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c6550 con 0x7fda5c069ed0 2023-08-09T12:48:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda620f5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c159780 con 0x7fda5c0ccbc0 2023-08-09T12:48:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda618f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c15ca30 0x7fda5c159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda618f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c15ca30 0x7fda5c159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57074/0 (socket says 172.21.15.17:57074) 2023-08-09T12:48:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda618f4640 1 -- 172.21.15.17:0/393890539 learned_addr learned my addr 172.21.15.17:0/393890539 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda610f3640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda5c069ed0 0x7fda5c06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda608f2640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda618f4640 1 -- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 msgr2=0x7fda5c0c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda618f4640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda618f4640 1 -- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda5c069ed0 msgr2=0x7fda5c06fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda618f4640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda5c069ed0 0x7fda5c06fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.242+0000 7fda618f4640 1 -- 172.21.15.17:0/393890539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c0094d0 con 0x7fda5c15ca30 2023-08-09T12:48:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.243+0000 7fda618f4640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c15ca30 0x7fda5c159240 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fda5400cd50 tx=0x7fda5400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.243+0000 7fda51ffb640 1 -- 172.21.15.17:0/393890539 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400f680 con 0x7fda5c15ca30 2023-08-09T12:48:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.243+0000 7fda51ffb640 1 -- 172.21.15.17:0/393890539 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5400f800 con 0x7fda5c15ca30 2023-08-09T12:48:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.243+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c1f27b0 con 0x7fda5c15ca30 2023-08-09T12:48:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.243+0000 7fda51ffb640 1 -- 172.21.15.17:0/393890539 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400fbb0 con 0x7fda5c15ca30 2023-08-09T12:48:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.243+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c1f2d70 con 0x7fda5c15ca30 2023-08-09T12:48:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.245+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c0b25a0 con 0x7fda5c15ca30 2023-08-09T12:48:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.245+0000 7fda51ffb640 1 -- 172.21.15.17:0/393890539 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda5400b040 con 0x7fda5c15ca30 2023-08-09T12:48:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.246+0000 7fda51ffb640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4006a050 0x7fda4006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.246+0000 7fda51ffb640 1 -- 172.21.15.17:0/393890539 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda54088f20 con 0x7fda5c15ca30 2023-08-09T12:48:49.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.247+0000 7fda610f3640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4006a050 0x7fda4006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:49.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.248+0000 7fda610f3640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4006a050 0x7fda4006c510 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fda58000f60 tx=0x7fda58007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:49.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.251+0000 7fda51ffb640 1 -- 172.21.15.17:0/393890539 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fda5c0b25a0 con 0x7fda5c15ca30 2023-08-09T12:48:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.481+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fda5c0b25a0 con 0x7fda5c15ca30 2023-08-09T12:48:49.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.984+0000 7fda51ffb640 1 -- 172.21.15.17:0/393890539 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda5c0b25a0 con 0x7fda5c15ca30 2023-08-09T12:48:49.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4006a050 msgr2=0x7fda4006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:49.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4006a050 0x7fda4006c510 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fda58000f60 tx=0x7fda58007b70 comp rx=0 tx=0).stop 2023-08-09T12:48:49.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c15ca30 msgr2=0x7fda5c159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:49.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c15ca30 0x7fda5c159240 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fda5400cd50 tx=0x7fda5400a650 comp rx=0 tx=0).stop 2023-08-09T12:48:49.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 shutdown_connections 2023-08-09T12:48:49.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4006a050 0x7fda4006c510 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda5c15ca30 0x7fda5c159240 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda5c0ccbc0 0x7fda5c0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 --2- 172.21.15.17:0/393890539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda5c069ed0 0x7fda5c06fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:49.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.987+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 >> 172.21.15.17:0/393890539 conn(0x7fda5c06abd0 msgr2=0x7fda5c0af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:49.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.988+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 shutdown_connections 2023-08-09T12:48:49.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:49.988+0000 7fda620f5640 1 -- 172.21.15.17:0/393890539 wait complete. 2023-08-09T12:48:50.012 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:48:50.012 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:50.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.236+0000 7fa370764640 1 Processor -- start 2023-08-09T12:48:50.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.237+0000 7fa370764640 1 -- start start 2023-08-09T12:48:50.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.238+0000 7fa370764640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680adc40 0x7fa36806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.238+0000 7fa370764640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3680cc630 0x7fa3680ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.238+0000 7fa370764640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3680b2250 con 0x7fa3680b3b40 2023-08-09T12:48:50.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.238+0000 7fa370764640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3680ae020 con 0x7fa3680cc630 2023-08-09T12:48:50.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.238+0000 7fa370764640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680b2530 con 0x7fa3680adc40 2023-08-09T12:48:50.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.239+0000 7fa36ed01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3680cc630 0x7fa3680ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.239+0000 7fa36ed01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3680cc630 0x7fa3680ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57088/0 (socket says 172.21.15.17:57088) 2023-08-09T12:48:50.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.239+0000 7fa36ed01640 1 -- 172.21.15.17:0/3745822677 learned_addr learned my addr 172.21.15.17:0/3745822677 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:50.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.239+0000 7fa36dcff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa3680b3b40 0x7fa3680b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41020/0 (socket says 172.21.15.17:41020) 2023-08-09T12:48:50.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.239+0000 7fa36e500640 1 --2- 172.21.15.17:0/3745822677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680adc40 0x7fa36806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.239+0000 7fa36ed01640 1 -- 172.21.15.17:0/3745822677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680adc40 msgr2=0x7fa36806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:50.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.239+0000 7fa36ed01640 1 --2- 172.21.15.17:0/3745822677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680adc40 0x7fa36806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.239+0000 7fa36ed01640 1 -- 172.21.15.17:0/3745822677 >> v1:172.21.15.17:6789/0 conn(0x7fa3680b3b40 legacy=0x7fa3680b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.240+0000 7fa36ed01640 1 -- 172.21.15.17:0/3745822677 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36806fe80 con 0x7fa3680cc630 2023-08-09T12:48:50.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.240+0000 7fa36d4fe640 1 -- 172.21.15.17:0/3745822677 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410458318 0 0) 0x7fa3680b2250 con 0x7fa3680b3b40 2023-08-09T12:48:50.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.241+0000 7fa36ed01640 1 --2- 172.21.15.17:0/3745822677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680cc630 0x7fa3680ccac0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fa360009870 tx=0x7fa36002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd86eefe555020aa server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:50.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.241+0000 7fa36d4fe640 1 -- 172.21.15.17:0/3745822677 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360030840 con 0x7fa3680cc630 2023-08-09T12:48:50.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.241+0000 7fa36d4fe640 1 -- 172.21.15.17:0/3745822677 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600309a0 con 0x7fa3680cc630 2023-08-09T12:48:50.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.241+0000 7fa36d4fe640 1 -- 172.21.15.17:0/3745822677 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360030d30 con 0x7fa3680cc630 2023-08-09T12:48:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.241+0000 7fa370764640 1 -- 172.21.15.17:0/3745822677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680cc630 msgr2=0x7fa3680ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.241+0000 7fa370764640 1 --2- 172.21.15.17:0/3745822677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680cc630 0x7fa3680ccac0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fa360009870 tx=0x7fa36002b980 comp rx=0 tx=0).stop 2023-08-09T12:48:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.242+0000 7fa370764640 1 -- 172.21.15.17:0/3745822677 shutdown_connections 2023-08-09T12:48:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.242+0000 7fa370764640 1 --2- 172.21.15.17:0/3745822677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680cc630 0x7fa3680ccac0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.242+0000 7fa370764640 1 --2- 172.21.15.17:0/3745822677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680adc40 0x7fa36806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.242+0000 7fa370764640 1 -- 172.21.15.17:0/3745822677 >> 172.21.15.17:0/3745822677 conn(0x7fa3680cb1b0 msgr2=0x7fa3680cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.242+0000 7fa370764640 1 -- 172.21.15.17:0/3745822677 shutdown_connections 2023-08-09T12:48:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.242+0000 7fa370764640 1 -- 172.21.15.17:0/3745822677 wait complete. 2023-08-09T12:48:50.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.244+0000 7fa370764640 1 Processor -- start 2023-08-09T12:48:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.244+0000 7fa370764640 1 -- start start 2023-08-09T12:48:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa370764640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3680adc40 0x7fa3681490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa370764640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680b3b40 0x7fa36806abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa370764640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680cc630 0x7fa36806b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa370764640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3681499a0 con 0x7fa3680b3b40 2023-08-09T12:48:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa370764640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa368149600 con 0x7fa3680adc40 2023-08-09T12:48:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa370764640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa368149c10 con 0x7fa3680cc630 2023-08-09T12:48:50.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa36dcff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680b3b40 0x7fa36806abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa36dcff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680b3b40 0x7fa36806abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57104/0 (socket says 172.21.15.17:57104) 2023-08-09T12:48:50.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa36dcff640 1 -- 172.21.15.17:0/2542607020 learned_addr learned my addr 172.21.15.17:0/2542607020 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:50.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa36ed01640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680cc630 0x7fa36806b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.245+0000 7fa36e500640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3680adc40 0x7fa3681490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa36dcff640 1 -- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680cc630 msgr2=0x7fa36806b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa36dcff640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680cc630 0x7fa36806b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa36dcff640 1 -- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3680adc40 msgr2=0x7fa3681490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa36dcff640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3680adc40 0x7fa3681490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa36dcff640 1 -- 172.21.15.17:0/2542607020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600094d0 con 0x7fa3680b3b40 2023-08-09T12:48:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa36ed01640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680cc630 0x7fa36806b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa36e500640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3680adc40 0x7fa3681490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa36dcff640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680b3b40 0x7fa36806abc0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fa35800c4d0 tx=0x7fa35800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa35effd640 1 -- 172.21.15.17:0/2542607020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358007480 con 0x7fa3680b3b40 2023-08-09T12:48:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa35effd640 1 -- 172.21.15.17:0/2542607020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3580075e0 con 0x7fa3680b3b40 2023-08-09T12:48:50.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.246+0000 7fa35effd640 1 -- 172.21.15.17:0/2542607020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580059a0 con 0x7fa3680b3b40 2023-08-09T12:48:50.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.247+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa368149ef0 con 0x7fa3680b3b40 2023-08-09T12:48:50.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.247+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3681f1440 con 0x7fa3680b3b40 2023-08-09T12:48:50.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.248+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36814a410 con 0x7fa3680b3b40 2023-08-09T12:48:50.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.249+0000 7fa35effd640 1 -- 172.21.15.17:0/2542607020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa358005b00 con 0x7fa3680b3b40 2023-08-09T12:48:50.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.250+0000 7fa35effd640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34c06a050 0x7fa34c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.250+0000 7fa35effd640 1 -- 172.21.15.17:0/2542607020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3580881b0 con 0x7fa3680b3b40 2023-08-09T12:48:50.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.250+0000 7fa36e500640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34c06a050 0x7fa34c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.252+0000 7fa36e500640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34c06a050 0x7fa34c06c510 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa364007330 tx=0x7fa36400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:50.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.254+0000 7fa35effd640 1 -- 172.21.15.17:0/2542607020 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa36814a410 con 0x7fa3680b3b40 2023-08-09T12:48:50.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.484+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa36814a410 con 0x7fa3680b3b40 2023-08-09T12:48:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.485+0000 7fa35effd640 1 -- 172.21.15.17:0/2542607020 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4868 (secure 0 0 0) 0x7fa36814a410 con 0x7fa3680b3b40 2023-08-09T12:48:50.489 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:50.489 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/734006206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":734006206},{"type":"v1","addr":"172.21.15.142:6835","nonce":734006206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2545254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2545254},{"type":"v1","addr":"172.21.15.142:6837","nonce":2545254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/842290627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":842290627},{"type":"v1","addr":"172.21.15.17:6834","nonce":842290627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:48:46.396953+0000","modified":"2023-08-09T12:48:49.978198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8517":{"gid":8517,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1876401199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1876401199},{"type":"v1","addr":"172.21.15.17:6835","nonce":1876401199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-09T12:48:50.489 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 76 2023-08-09T12:48:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34c06a050 msgr2=0x7fa34c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34c06a050 0x7fa34c06c510 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa364007330 tx=0x7fa36400b040 comp rx=0 tx=0).stop 2023-08-09T12:48:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680b3b40 msgr2=0x7fa36806abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680b3b40 0x7fa36806abc0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fa35800c4d0 tx=0x7fa35800c990 comp rx=0 tx=0).stop 2023-08-09T12:48:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 shutdown_connections 2023-08-09T12:48:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa34c06a050 0x7fa34c06c510 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3680cc630 0x7fa36806b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3680b3b40 0x7fa36806abc0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 --2- 172.21.15.17:0/2542607020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3680adc40 0x7fa3681490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 >> 172.21.15.17:0/2542607020 conn(0x7fa3680cb1b0 msgr2=0x7fa3680c19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.488+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 shutdown_connections 2023-08-09T12:48:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.489+0000 7fa370764640 1 -- 172.21.15.17:0/2542607020 wait complete. 2023-08-09T12:48:50.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:48:50.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.736+0000 7f3764a7c640 1 Processor -- start 2023-08-09T12:48:50.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.737+0000 7f3764a7c640 1 -- start start 2023-08-09T12:48:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.738+0000 7f3764a7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f376015ce90 0x7f37601616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.738+0000 7f3764a7c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37600b6000 0x7f37600cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.738+0000 7f3764a7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 0x7f37600d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.738+0000 7f3764a7c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37600d33a0 con 0x7f37600b6000 2023-08-09T12:48:50.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.738+0000 7f3764a7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37600b6460 con 0x7f376015ce90 2023-08-09T12:48:50.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.738+0000 7f3764a7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37600cda40 con 0x7f37600d29d0 2023-08-09T12:48:50.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f3757fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37600b6000 0x7f37600cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f3757fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37600b6000 0x7f37600cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57120/0 (socket says 172.21.15.17:57120) 2023-08-09T12:48:50.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f3757fff640 1 -- 172.21.15.17:0/247537468 learned_addr learned my addr 172.21.15.17:0/247537468 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:50.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f375ed9d640 1 --2- 172.21.15.17:0/247537468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 0x7f37600d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f375e59c640 1 --2- 172.21.15.17:0/247537468 >> v2:172.21.15.142:3300/0 conn(0x7f376015ce90 0x7f37601616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f3757fff640 1 -- 172.21.15.17:0/247537468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 msgr2=0x7f37600d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:50.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f3757fff640 1 --2- 172.21.15.17:0/247537468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 0x7f37600d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f3757fff640 1 -- 172.21.15.17:0/247537468 >> v2:172.21.15.142:3300/0 conn(0x7f376015ce90 msgr2=0x7f37601616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:50.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f3757fff640 1 --2- 172.21.15.17:0/247537468 >> v2:172.21.15.142:3300/0 conn(0x7f376015ce90 0x7f37601616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f3757fff640 1 -- 172.21.15.17:0/247537468 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37600cdd10 con 0x7f37600b6000 2023-08-09T12:48:50.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.739+0000 7f375e59c640 1 --2- 172.21.15.17:0/247537468 >> v2:172.21.15.142:3300/0 conn(0x7f376015ce90 0x7f37601616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:48:50.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.741+0000 7f3757fff640 1 --2- 172.21.15.17:0/247537468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37600b6000 0x7f37600cd500 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f37600d0690 tx=0x7f374802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa7445b4c56ff21 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.741+0000 7f375dd9b640 1 -- 172.21.15.17:0/247537468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748031870 con 0x7f37600b6000 2023-08-09T12:48:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.741+0000 7f375dd9b640 1 -- 172.21.15.17:0/247537468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480319d0 con 0x7f37600b6000 2023-08-09T12:48:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.741+0000 7f375dd9b640 1 -- 172.21.15.17:0/247537468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748031d60 con 0x7f37600b6000 2023-08-09T12:48:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 -- 172.21.15.17:0/247537468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37600b6000 msgr2=0x7f37600cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 --2- 172.21.15.17:0/247537468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37600b6000 0x7f37600cd500 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f37600d0690 tx=0x7f374802b910 comp rx=0 tx=0).stop 2023-08-09T12:48:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 -- 172.21.15.17:0/247537468 shutdown_connections 2023-08-09T12:48:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 --2- 172.21.15.17:0/247537468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 0x7f37600d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 --2- 172.21.15.17:0/247537468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37600b6000 0x7f37600cd500 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 --2- 172.21.15.17:0/247537468 >> v2:172.21.15.142:3300/0 conn(0x7f376015ce90 0x7f37601616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 -- 172.21.15.17:0/247537468 >> 172.21.15.17:0/247537468 conn(0x7f376006fde0 msgr2=0x7f37600701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:50.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 -- 172.21.15.17:0/247537468 shutdown_connections 2023-08-09T12:48:50.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.742+0000 7f3764a7c640 1 -- 172.21.15.17:0/247537468 wait complete. 2023-08-09T12:48:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.744+0000 7f3764a7c640 1 Processor -- start 2023-08-09T12:48:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.744+0000 7f3764a7c640 1 -- start start 2023-08-09T12:48:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f3764a7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37600b6000 0x7f37601530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f3764a7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 0x7f37600cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f3764a7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376015ce90 0x7f3760159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f3764a7c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600cc480 con 0x7f376015ce90 2023-08-09T12:48:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f3764a7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600cc760 con 0x7f37600b6000 2023-08-09T12:48:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f3764a7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37600cca40 con 0x7f37600d29d0 2023-08-09T12:48:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f375ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376015ce90 0x7f3760159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f375ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376015ce90 0x7f3760159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57126/0 (socket says 172.21.15.17:57126) 2023-08-09T12:48:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f375ed9d640 1 -- 172.21.15.17:0/287163715 learned_addr learned my addr 172.21.15.17:0/287163715 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:50.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.745+0000 7f375e59c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37600b6000 0x7f37601530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f3757fff640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 0x7f37600cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f375ed9d640 1 -- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 msgr2=0x7f37600cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f375ed9d640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 0x7f37600cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f375ed9d640 1 -- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37600b6000 msgr2=0x7f37601530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f375ed9d640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37600b6000 0x7f37601530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f375ed9d640 1 -- 172.21.15.17:0/287163715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480094d0 con 0x7f376015ce90 2023-08-09T12:48:50.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f375ed9d640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376015ce90 0x7f3760159350 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f375800efc0 tx=0x7f375800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:50.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f3756ffd640 1 -- 172.21.15.17:0/287163715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758014480 con 0x7f376015ce90 2023-08-09T12:48:50.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f3756ffd640 1 -- 172.21.15.17:0/287163715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375800f040 con 0x7f376015ce90 2023-08-09T12:48:50.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f3756ffd640 1 -- 172.21.15.17:0/287163715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758014820 con 0x7f376015ce90 2023-08-09T12:48:50.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.746+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37601f2f70 con 0x7f376015ce90 2023-08-09T12:48:50.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.747+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37601f2be0 con 0x7f376015ce90 2023-08-09T12:48:50.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.748+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37601f3160 con 0x7f376015ce90 2023-08-09T12:48:50.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.749+0000 7f3756ffd640 1 -- 172.21.15.17:0/287163715 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3758014980 con 0x7f376015ce90 2023-08-09T12:48:50.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.750+0000 7f3756ffd640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f374006a050 0x7f374006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:50.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.750+0000 7f3756ffd640 1 -- 172.21.15.17:0/287163715 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37580891c0 con 0x7f376015ce90 2023-08-09T12:48:50.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.750+0000 7f375e59c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f374006a050 0x7f374006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:50.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.752+0000 7f375e59c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f374006a050 0x7f374006c510 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3760160910 tx=0x7f3750008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:50.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.754+0000 7f3756ffd640 1 -- 172.21.15.17:0/287163715 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3758054810 con 0x7f376015ce90 2023-08-09T12:48:50.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.948+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3760067a80 con 0x7f376015ce90 2023-08-09T12:48:50.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.950+0000 7f3756ffd640 1 -- 172.21.15.17:0/287163715 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+18287 (secure 0 0 0) 0x7f3758057e30 con 0x7f376015ce90 2023-08-09T12:48:50.955 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:50.955 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":161,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:48:47.919718+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:48:44.746706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-09T12:48:45.418671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:48:50.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f374006a050 msgr2=0x7f374006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f374006a050 0x7f374006c510 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3760160910 tx=0x7f3750008040 comp rx=0 tx=0).stop 2023-08-09T12:48:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376015ce90 msgr2=0x7f3760159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376015ce90 0x7f3760159350 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f375800efc0 tx=0x7f375800c490 comp rx=0 tx=0).stop 2023-08-09T12:48:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 shutdown_connections 2023-08-09T12:48:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f374006a050 0x7f374006c510 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376015ce90 0x7f3760159350 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600d29d0 0x7f37600cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 --2- 172.21.15.17:0/287163715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37600b6000 0x7f37601530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:50.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.953+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 >> 172.21.15.17:0/287163715 conn(0x7f376006fde0 msgr2=0x7f37600b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:50.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.954+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 shutdown_connections 2023-08-09T12:48:50.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:50.954+0000 7f3764a7c640 1 -- 172.21.15.17:0/287163715 wait complete. 2023-08-09T12:48:50.976 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:48:50.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:48:51.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.194+0000 7f534499f640 1 Processor -- start 2023-08-09T12:48:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.194+0000 7f534499f640 1 -- start start 2023-08-09T12:48:51.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.196+0000 7f534499f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5340070a90 0x7f53400b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.196+0000 7f534499f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400b4630 con 0x7f5340159d80 2023-08-09T12:48:51.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.196+0000 7f534499f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400b3ab0 con 0x7f53400ad810 2023-08-09T12:48:51.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.196+0000 7f534499f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534015a160 con 0x7f5340070a90 2023-08-09T12:48:51.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.196+0000 7f533dd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5340070a90 0x7f53400b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.196+0000 7f533e59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5340159d80 0x7f5340070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41034/0 (socket says 172.21.15.17:41034) 2023-08-09T12:48:51.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.196+0000 7f533e59c640 1 -- 172.21.15.17:0/505167064 learned_addr learned my addr 172.21.15.17:0/505167064 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:51.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.197+0000 7f533dd9b640 1 -- 172.21.15.17:0/505167064 >> v1:172.21.15.142:6789/0 conn(0x7f53400ad810 legacy=0x7f53400c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:51.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.197+0000 7f533dd9b640 1 -- 172.21.15.17:0/505167064 >> v1:172.21.15.17:6789/0 conn(0x7f5340159d80 legacy=0x7f5340070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.197+0000 7f533dd9b640 1 -- 172.21.15.17:0/505167064 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400b3d90 con 0x7f5340070a90 2023-08-09T12:48:51.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.198+0000 7f533dd9b640 1 --2- 172.21.15.17:0/505167064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5340070a90 0x7f53400b34d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f5334009790 tx=0x7f533402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e00bd534d1a3e21 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:51.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.198+0000 7f533d59a640 1 -- 172.21.15.17:0/505167064 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533402d040 con 0x7f5340070a90 2023-08-09T12:48:51.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.198+0000 7f533d59a640 1 -- 172.21.15.17:0/505167064 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334031810 con 0x7f5340070a90 2023-08-09T12:48:51.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.198+0000 7f533d59a640 1 -- 172.21.15.17:0/505167064 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334031ba0 con 0x7f5340070a90 2023-08-09T12:48:51.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.199+0000 7f534499f640 1 -- 172.21.15.17:0/505167064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5340070a90 msgr2=0x7f53400b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.199+0000 7f534499f640 1 --2- 172.21.15.17:0/505167064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5340070a90 0x7f53400b34d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f5334009790 tx=0x7f533402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.199+0000 7f534499f640 1 -- 172.21.15.17:0/505167064 shutdown_connections 2023-08-09T12:48:51.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.199+0000 7f534499f640 1 --2- 172.21.15.17:0/505167064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5340070a90 0x7f53400b34d0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.199+0000 7f534499f640 1 -- 172.21.15.17:0/505167064 >> 172.21.15.17:0/505167064 conn(0x7f53400cb1b0 msgr2=0x7f53400cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:51.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.199+0000 7f534499f640 1 -- 172.21.15.17:0/505167064 shutdown_connections 2023-08-09T12:48:51.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.199+0000 7f534499f640 1 -- 172.21.15.17:0/505167064 wait complete. 2023-08-09T12:48:51.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.201+0000 7f534499f640 1 Processor -- start 2023-08-09T12:48:51.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.201+0000 7f534499f640 1 -- start start 2023-08-09T12:48:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f534499f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5340070a90 0x7f53400c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f534499f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53400ad810 0x7f5340156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f534499f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5340159d80 0x7f534006b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f534499f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400c5770 con 0x7f53400ad810 2023-08-09T12:48:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f534499f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534015b3d0 con 0x7f5340070a90 2023-08-09T12:48:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f534499f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53400c6560 con 0x7f5340159d80 2023-08-09T12:48:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f533dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53400ad810 0x7f5340156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f533dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53400ad810 0x7f5340156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57144/0 (socket says 172.21.15.17:57144) 2023-08-09T12:48:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.202+0000 7f533dd9b640 1 -- 172.21.15.17:0/3846624497 learned_addr learned my addr 172.21.15.17:0/3846624497 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.203+0000 7f533e59c640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5340070a90 0x7f53400c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.203+0000 7f533dd9b640 1 -- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5340159d80 msgr2=0x7f534006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.203+0000 7f533dd9b640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5340159d80 0x7f534006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.203+0000 7f533dd9b640 1 -- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5340070a90 msgr2=0x7f53400c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.203+0000 7f533dd9b640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5340070a90 0x7f53400c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.203+0000 7f533dd9b640 1 -- 172.21.15.17:0/3846624497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340093a0 con 0x7f53400ad810 2023-08-09T12:48:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.203+0000 7f533dd9b640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53400ad810 0x7f5340156060 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5334000c00 tx=0x7f53340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:51.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.204+0000 7f532effd640 1 -- 172.21.15.17:0/3846624497 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533403ad60 con 0x7f53400ad810 2023-08-09T12:48:51.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.204+0000 7f532effd640 1 -- 172.21.15.17:0/3846624497 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334005990 con 0x7f53400ad810 2023-08-09T12:48:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.204+0000 7f532effd640 1 -- 172.21.15.17:0/3846624497 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334005d40 con 0x7f53400ad810 2023-08-09T12:48:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.204+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53400c59c0 con 0x7f53400ad810 2023-08-09T12:48:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.204+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53401565a0 con 0x7f53400ad810 2023-08-09T12:48:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.205+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534015b540 con 0x7f53400ad810 2023-08-09T12:48:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.206+0000 7f532effd640 1 -- 172.21.15.17:0/3846624497 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5334005ea0 con 0x7f53400ad810 2023-08-09T12:48:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.207+0000 7f532effd640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f532006a050 0x7f532006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.207+0000 7f532effd640 1 -- 172.21.15.17:0/3846624497 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53340aaaa0 con 0x7f53400ad810 2023-08-09T12:48:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.208+0000 7f533e59c640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f532006a050 0x7f532006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.209+0000 7f533e59c640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f532006a050 0x7f532006c510 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5330005880 tx=0x7f5330009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.211+0000 7f532effd640 1 -- 172.21.15.17:0/3846624497 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f53340762a0 con 0x7f53400ad810 2023-08-09T12:48:51.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.405+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53400b4350 con 0x7f532006a050 2023-08-09T12:48:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.430+0000 7f532effd640 1 -- 172.21.15.17:0/3846624497 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301920 (secure 0 0 0) 0x7f5330001350 con 0x7f532006a050 2023-08-09T12:48:51.439 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:51.440 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:48:51.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f532006a050 msgr2=0x7f532006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f532006a050 0x7f532006c510 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5330005880 tx=0x7f5330009040 comp rx=0 tx=0).stop 2023-08-09T12:48:51.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53400ad810 msgr2=0x7f5340156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53400ad810 0x7f5340156060 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5334000c00 tx=0x7f53340046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 shutdown_connections 2023-08-09T12:48:51.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f532006a050 0x7f532006c510 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5340159d80 0x7f534006b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53400ad810 0x7f5340156060 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 --2- 172.21.15.17:0/3846624497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5340070a90 0x7f53400c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 >> 172.21.15.17:0/3846624497 conn(0x7f53400cb1b0 msgr2=0x7f53400697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:51.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 shutdown_connections 2023-08-09T12:48:51.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.437+0000 7f534499f640 1 -- 172.21.15.17:0/3846624497 wait complete. 2023-08-09T12:48:51.464 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2023-08-09T12:48:50.851178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553969,"statfs":{"total":1600000000,"available":1591264362,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.974237"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961709+0000","last_change":"2023-08-09T12:48:46.961585+0000","last_active":"2023-08-09T12:48:46.961709+0000","last_peered":"2023-08-09T12:48:46.961709+0000","last_clean":"2023-08-09T12:48:46.961709+0000","last_became_active":"2023-08-09T12:48:46.961206+0000","last_became_peered":"2023-08-09T12:48:46.961206+0000","last_unstale":"2023-08-09T12:48:46.961709+0000","last_undegraded":"2023-08-09T12:48:46.961709+0000","last_fullsized":"2023-08-09T12:48:46.961709+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:51:40.488960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952759+0000","last_change":"2023-08-09T12:48:46.952118+0000","last_active":"2023-08-09T12:48:46.952759+0000","last_peered":"2023-08-09T12:48:46.952759+0000","last_clean":"2023-08-09T12:48:46.952759+0000","last_became_active":"2023-08-09T12:48:46.951749+0000","last_became_peered":"2023-08-09T12:48:46.951749+0000","last_unstale":"2023-08-09T12:48:46.952759+0000","last_undegraded":"2023-08-09T12:48:46.952759+0000","last_fullsized":"2023-08-09T12:48:46.952759+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:29:17.351750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962647+0000","last_change":"2023-08-09T12:48:46.962586+0000","last_active":"2023-08-09T12:48:46.962647+0000","last_peered":"2023-08-09T12:48:46.962647+0000","last_clean":"2023-08-09T12:48:46.962647+0000","last_became_active":"2023-08-09T12:48:46.962122+0000","last_became_peered":"2023-08-09T12:48:46.962122+0000","last_unstale":"2023-08-09T12:48:46.962647+0000","last_undegraded":"2023-08-09T12:48:46.962647+0000","last_fullsized":"2023-08-09T12:48:46.962647+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:30.851235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.958544+0000","last_change":"2023-08-09T12:48:46.958261+0000","last_active":"2023-08-09T12:48:46.958544+0000","last_peered":"2023-08-09T12:48:46.958544+0000","last_clean":"2023-08-09T12:48:46.958544+0000","last_became_active":"2023-08-09T12:48:46.957807+0000","last_became_peered":"2023-08-09T12:48:46.957807+0000","last_unstale":"2023-08-09T12:48:46.958544+0000","last_undegraded":"2023-08-09T12:48:46.958544+0000","last_fullsized":"2023-08-09T12:48:46.958544+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:33:09.426318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962928+0000","last_change":"2023-08-09T12:48:46.962514+0000","last_active":"2023-08-09T12:48:46.962928+0000","last_peered":"2023-08-09T12:48:46.962928+0000","last_clean":"2023-08-09T12:48:46.962928+0000","last_became_active":"2023-08-09T12:48:46.961600+0000","last_became_peered":"2023-08-09T12:48:46.961600+0000","last_unstale":"2023-08-09T12:48:46.962928+0000","last_undegraded":"2023-08-09T12:48:46.962928+0000","last_fullsized":"2023-08-09T12:48:46.962928+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:11:37.774360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.896096+0000","last_change":"2023-08-09T12:48:45.896096+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.896096+0000","last_undegraded":"2023-08-09T12:48:45.896096+0000","last_fullsized":"2023-08-09T12:48:45.896096+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.941877+0000","last_change":"2023-08-09T12:48:46.941718+0000","last_active":"2023-08-09T12:48:46.941877+0000","last_peered":"2023-08-09T12:48:46.941877+0000","last_clean":"2023-08-09T12:48:46.941877+0000","last_became_active":"2023-08-09T12:48:46.939246+0000","last_became_peered":"2023-08-09T12:48:46.939246+0000","last_unstale":"2023-08-09T12:48:46.941877+0000","last_undegraded":"2023-08-09T12:48:46.941877+0000","last_fullsized":"2023-08-09T12:48:46.941877+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:48:02.414553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.955621+0000","last_change":"2023-08-09T12:48:46.955542+0000","last_active":"2023-08-09T12:48:46.955621+0000","last_peered":"2023-08-09T12:48:46.955621+0000","last_clean":"2023-08-09T12:48:46.955621+0000","last_became_active":"2023-08-09T12:48:46.955219+0000","last_became_peered":"2023-08-09T12:48:46.955219+0000","last_unstale":"2023-08-09T12:48:46.955621+0000","last_undegraded":"2023-08-09T12:48:46.955621+0000","last_fullsized":"2023-08-09T12:48:46.955621+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:32.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.895523+0000","last_change":"2023-08-09T12:48:45.895523+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.895523+0000","last_undegraded":"2023-08-09T12:48:45.895523+0000","last_fullsized":"2023-08-09T12:48:45.895523+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887549+0000","last_change":"2023-08-09T12:48:45.887549+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887549+0000","last_undegraded":"2023-08-09T12:48:45.887549+0000","last_fullsized":"2023-08-09T12:48:45.887549+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.953832+0000","last_change":"2023-08-09T12:48:46.953736+0000","last_active":"2023-08-09T12:48:46.953832+0000","last_peered":"2023-08-09T12:48:46.953832+0000","last_clean":"2023-08-09T12:48:46.953832+0000","last_became_active":"2023-08-09T12:48:46.953362+0000","last_became_peered":"2023-08-09T12:48:46.953362+0000","last_unstale":"2023-08-09T12:48:46.953832+0000","last_undegraded":"2023-08-09T12:48:46.953832+0000","last_fullsized":"2023-08-09T12:48:46.953832+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:22:54.700195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.966605+0000","last_change":"2023-08-09T12:48:46.965972+0000","last_active":"2023-08-09T12:48:46.966605+0000","last_peered":"2023-08-09T12:48:46.966605+0000","last_clean":"2023-08-09T12:48:46.966605+0000","last_became_active":"2023-08-09T12:48:46.965713+0000","last_became_peered":"2023-08-09T12:48:46.965713+0000","last_unstale":"2023-08-09T12:48:46.966605+0000","last_undegraded":"2023-08-09T12:48:46.966605+0000","last_fullsized":"2023-08-09T12:48:46.966605+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:50:11.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.898244+0000","last_change":"2023-08-09T12:48:45.898244+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.898244+0000","last_undegraded":"2023-08-09T12:48:45.898244+0000","last_fullsized":"2023-08-09T12:48:45.898244+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937415+0000","last_change":"2023-08-09T12:48:46.937286+0000","last_active":"2023-08-09T12:48:46.937415+0000","last_peered":"2023-08-09T12:48:46.937415+0000","last_clean":"2023-08-09T12:48:46.937415+0000","last_became_active":"2023-08-09T12:48:46.936728+0000","last_became_peered":"2023-08-09T12:48:46.936728+0000","last_unstale":"2023-08-09T12:48:46.937415+0000","last_undegraded":"2023-08-09T12:48:46.937415+0000","last_fullsized":"2023-08-09T12:48:46.937415+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:28:00.860493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.936223+0000","last_change":"2023-08-09T12:48:46.936044+0000","last_active":"2023-08-09T12:48:46.936223+0000","last_peered":"2023-08-09T12:48:46.936223+0000","last_clean":"2023-08-09T12:48:46.936223+0000","last_became_active":"2023-08-09T12:48:46.935618+0000","last_became_peered":"2023-08-09T12:48:46.935618+0000","last_unstale":"2023-08-09T12:48:46.936223+0000","last_undegraded":"2023-08-09T12:48:46.936223+0000","last_fullsized":"2023-08-09T12:48:46.936223+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:47:07.896841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.895333+0000","last_change":"2023-08-09T12:48:45.895333+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.895333+0000","last_undegraded":"2023-08-09T12:48:45.895333+0000","last_fullsized":"2023-08-09T12:48:45.895333+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.892317+0000","last_change":"2023-08-09T12:48:45.892317+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.892317+0000","last_undegraded":"2023-08-09T12:48:45.892317+0000","last_fullsized":"2023-08-09T12:48:45.892317+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.960418+0000","last_change":"2023-08-09T12:48:46.960291+0000","last_active":"2023-08-09T12:48:46.960418+0000","last_peered":"2023-08-09T12:48:46.960418+0000","last_clean":"2023-08-09T12:48:46.960418+0000","last_became_active":"2023-08-09T12:48:46.959860+0000","last_became_peered":"2023-08-09T12:48:46.959860+0000","last_unstale":"2023-08-09T12:48:46.960418+0000","last_undegraded":"2023-08-09T12:48:46.960418+0000","last_fullsized":"2023-08-09T12:48:46.960418+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:54:25.433825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.935973+0000","last_change":"2023-08-09T12:48:46.935857+0000","last_active":"2023-08-09T12:48:46.935973+0000","last_peered":"2023-08-09T12:48:46.935973+0000","last_clean":"2023-08-09T12:48:46.935973+0000","last_became_active":"2023-08-09T12:48:46.935257+0000","last_became_peered":"2023-08-09T12:48:46.935257+0000","last_unstale":"2023-08-09T12:48:46.935973+0000","last_undegraded":"2023-08-09T12:48:46.935973+0000","last_fullsized":"2023-08-09T12:48:46.935973+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:32:02.852951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962892+0000","last_change":"2023-08-09T12:48:46.962333+0000","last_active":"2023-08-09T12:48:46.962892+0000","last_peered":"2023-08-09T12:48:46.962892+0000","last_clean":"2023-08-09T12:48:46.962892+0000","last_became_active":"2023-08-09T12:48:46.961277+0000","last_became_peered":"2023-08-09T12:48:46.961277+0000","last_unstale":"2023-08-09T12:48:46.962892+0000","last_undegraded":"2023-08-09T12:48:46.962892+0000","last_fullsized":"2023-08-09T12:48:46.962892+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:29.770394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959066+0000","last_change":"2023-08-09T12:48:46.958963+0000","last_active":"2023-08-09T12:48:46.959066+0000","last_peered":"2023-08-09T12:48:46.959066+0000","last_clean":"2023-08-09T12:48:46.959066+0000","last_became_active":"2023-08-09T12:48:46.958625+0000","last_became_peered":"2023-08-09T12:48:46.958625+0000","last_unstale":"2023-08-09T12:48:46.959066+0000","last_undegraded":"2023-08-09T12:48:46.959066+0000","last_fullsized":"2023-08-09T12:48:46.959066+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:27:08.669914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.965127+0000","last_change":"2023-08-09T12:48:46.965018+0000","last_active":"2023-08-09T12:48:46.965127+0000","last_peered":"2023-08-09T12:48:46.965127+0000","last_clean":"2023-08-09T12:48:46.965127+0000","last_became_active":"2023-08-09T12:48:46.963886+0000","last_became_peered":"2023-08-09T12:48:46.963886+0000","last_unstale":"2023-08-09T12:48:46.965127+0000","last_undegraded":"2023-08-09T12:48:46.965127+0000","last_fullsized":"2023-08-09T12:48:46.965127+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:53.292466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952938+0000","last_change":"2023-08-09T12:48:46.952852+0000","last_active":"2023-08-09T12:48:46.952938+0000","last_peered":"2023-08-09T12:48:46.952938+0000","last_clean":"2023-08-09T12:48:46.952938+0000","last_became_active":"2023-08-09T12:48:46.952361+0000","last_became_peered":"2023-08-09T12:48:46.952361+0000","last_unstale":"2023-08-09T12:48:46.952938+0000","last_undegraded":"2023-08-09T12:48:46.952938+0000","last_fullsized":"2023-08-09T12:48:46.952938+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:40.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.894654+0000","last_change":"2023-08-09T12:48:45.894654+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.894654+0000","last_undegraded":"2023-08-09T12:48:45.894654+0000","last_fullsized":"2023-08-09T12:48:45.894654+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.939548+0000","last_change":"2023-08-09T12:48:46.939417+0000","last_active":"2023-08-09T12:48:46.939548+0000","last_peered":"2023-08-09T12:48:46.939548+0000","last_clean":"2023-08-09T12:48:46.939548+0000","last_became_active":"2023-08-09T12:48:46.938512+0000","last_became_peered":"2023-08-09T12:48:46.938512+0000","last_unstale":"2023-08-09T12:48:46.939548+0000","last_undegraded":"2023-08-09T12:48:46.939548+0000","last_fullsized":"2023-08-09T12:48:46.939548+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:30:43.335439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937693+0000","last_change":"2023-08-09T12:48:46.937004+0000","last_active":"2023-08-09T12:48:46.937693+0000","last_peered":"2023-08-09T12:48:46.937693+0000","last_clean":"2023-08-09T12:48:46.937693+0000","last_became_active":"2023-08-09T12:48:46.936557+0000","last_became_peered":"2023-08-09T12:48:46.936557+0000","last_unstale":"2023-08-09T12:48:46.937693+0000","last_undegraded":"2023-08-09T12:48:46.937693+0000","last_fullsized":"2023-08-09T12:48:46.937693+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:58:08.137503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944480+0000","last_change":"2023-08-09T12:48:46.944383+0000","last_active":"2023-08-09T12:48:46.944480+0000","last_peered":"2023-08-09T12:48:46.944480+0000","last_clean":"2023-08-09T12:48:46.944480+0000","last_became_active":"2023-08-09T12:48:46.944042+0000","last_became_peered":"2023-08-09T12:48:46.944042+0000","last_unstale":"2023-08-09T12:48:46.944480+0000","last_undegraded":"2023-08-09T12:48:46.944480+0000","last_fullsized":"2023-08-09T12:48:46.944480+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:44.152926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888878+0000","last_change":"2023-08-09T12:48:45.888878+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888878+0000","last_undegraded":"2023-08-09T12:48:45.888878+0000","last_fullsized":"2023-08-09T12:48:45.888878+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954946+0000","last_change":"2023-08-09T12:48:46.954814+0000","last_active":"2023-08-09T12:48:46.954946+0000","last_peered":"2023-08-09T12:48:46.954946+0000","last_clean":"2023-08-09T12:48:46.954946+0000","last_became_active":"2023-08-09T12:48:46.954498+0000","last_became_peered":"2023-08-09T12:48:46.954498+0000","last_unstale":"2023-08-09T12:48:46.954946+0000","last_undegraded":"2023-08-09T12:48:46.954946+0000","last_fullsized":"2023-08-09T12:48:46.954946+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:02.941006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.939840+0000","last_change":"2023-08-09T12:48:46.939726+0000","last_active":"2023-08-09T12:48:46.939840+0000","last_peered":"2023-08-09T12:48:46.939840+0000","last_clean":"2023-08-09T12:48:46.939840+0000","last_became_active":"2023-08-09T12:48:46.939036+0000","last_became_peered":"2023-08-09T12:48:46.939036+0000","last_unstale":"2023-08-09T12:48:46.939840+0000","last_undegraded":"2023-08-09T12:48:46.939840+0000","last_fullsized":"2023-08-09T12:48:46.939840+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:56.191819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944168+0000","last_change":"2023-08-09T12:48:46.944030+0000","last_active":"2023-08-09T12:48:46.944168+0000","last_peered":"2023-08-09T12:48:46.944168+0000","last_clean":"2023-08-09T12:48:46.944168+0000","last_became_active":"2023-08-09T12:48:46.943711+0000","last_became_peered":"2023-08-09T12:48:46.943711+0000","last_unstale":"2023-08-09T12:48:46.944168+0000","last_undegraded":"2023-08-09T12:48:46.944168+0000","last_fullsized":"2023-08-09T12:48:46.944168+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:51:21.571300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888362+0000","last_change":"2023-08-09T12:48:45.888362+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888362+0000","last_undegraded":"2023-08-09T12:48:45.888362+0000","last_fullsized":"2023-08-09T12:48:45.888362+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937260+0000","last_change":"2023-08-09T12:48:46.937096+0000","last_active":"2023-08-09T12:48:46.937260+0000","last_peered":"2023-08-09T12:48:46.937260+0000","last_clean":"2023-08-09T12:48:46.937260+0000","last_became_active":"2023-08-09T12:48:46.936636+0000","last_became_peered":"2023-08-09T12:48:46.936636+0000","last_unstale":"2023-08-09T12:48:46.937260+0000","last_undegraded":"2023-08-09T12:48:46.937260+0000","last_fullsized":"2023-08-09T12:48:46.937260+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:51:22.190862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"160'4","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978417+0000","last_change":"2023-08-09T12:48:45.895190+0000","last_active":"2023-08-09T12:48:46.978417+0000","last_peered":"2023-08-09T12:48:46.978417+0000","last_clean":"2023-08-09T12:48:46.978417+0000","last_became_active":"2023-08-09T12:48:45.894548+0000","last_became_peered":"2023-08-09T12:48:45.894548+0000","last_unstale":"2023-08-09T12:48:46.978417+0000","last_undegraded":"2023-08-09T12:48:46.978417+0000","last_fullsized":"2023-08-09T12:48:46.978417+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:39:20.689668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.963435+0000","last_change":"2023-08-09T12:48:46.963254+0000","last_active":"2023-08-09T12:48:46.963435+0000","last_peered":"2023-08-09T12:48:46.963435+0000","last_clean":"2023-08-09T12:48:46.963435+0000","last_became_active":"2023-08-09T12:48:46.962887+0000","last_became_peered":"2023-08-09T12:48:46.962887+0000","last_unstale":"2023-08-09T12:48:46.963435+0000","last_undegraded":"2023-08-09T12:48:46.963435+0000","last_fullsized":"2023-08-09T12:48:46.963435+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:42.174030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978163+0000","last_change":"2023-08-09T12:48:45.912443+0000","last_active":"2023-08-09T12:48:46.978163+0000","last_peered":"2023-08-09T12:48:46.978163+0000","last_clean":"2023-08-09T12:48:46.978163+0000","last_became_active":"2023-08-09T12:48:45.912042+0000","last_became_peered":"2023-08-09T12:48:45.912042+0000","last_unstale":"2023-08-09T12:48:46.978163+0000","last_undegraded":"2023-08-09T12:48:46.978163+0000","last_fullsized":"2023-08-09T12:48:46.978163+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:48:00.932200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952804+0000","last_change":"2023-08-09T12:48:46.952678+0000","last_active":"2023-08-09T12:48:46.952804+0000","last_peered":"2023-08-09T12:48:46.952804+0000","last_clean":"2023-08-09T12:48:46.952804+0000","last_became_active":"2023-08-09T12:48:46.951843+0000","last_became_peered":"2023-08-09T12:48:46.951843+0000","last_unstale":"2023-08-09T12:48:46.952804+0000","last_undegraded":"2023-08-09T12:48:46.952804+0000","last_fullsized":"2023-08-09T12:48:46.952804+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:04.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978620+0000","last_change":"2023-08-09T12:48:45.912974+0000","last_active":"2023-08-09T12:48:46.978620+0000","last_peered":"2023-08-09T12:48:46.978620+0000","last_clean":"2023-08-09T12:48:46.978620+0000","last_became_active":"2023-08-09T12:48:45.912770+0000","last_became_peered":"2023-08-09T12:48:45.912770+0000","last_unstale":"2023-08-09T12:48:46.978620+0000","last_undegraded":"2023-08-09T12:48:46.978620+0000","last_fullsized":"2023-08-09T12:48:46.978620+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:42.482449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.934977+0000","last_change":"2023-08-09T12:48:46.934802+0000","last_active":"2023-08-09T12:48:46.934977+0000","last_peered":"2023-08-09T12:48:46.934977+0000","last_clean":"2023-08-09T12:48:46.934977+0000","last_became_active":"2023-08-09T12:48:46.934325+0000","last_became_peered":"2023-08-09T12:48:46.934325+0000","last_unstale":"2023-08-09T12:48:46.934977+0000","last_undegraded":"2023-08-09T12:48:46.934977+0000","last_fullsized":"2023-08-09T12:48:46.934977+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:16:25.400011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978272+0000","last_change":"2023-08-09T12:48:45.906701+0000","last_active":"2023-08-09T12:48:46.978272+0000","last_peered":"2023-08-09T12:48:46.978272+0000","last_clean":"2023-08-09T12:48:46.978272+0000","last_became_active":"2023-08-09T12:48:45.906397+0000","last_became_peered":"2023-08-09T12:48:45.906397+0000","last_unstale":"2023-08-09T12:48:46.978272+0000","last_undegraded":"2023-08-09T12:48:46.978272+0000","last_fullsized":"2023-08-09T12:48:46.978272+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:10.779720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.947557+0000","last_change":"2023-08-09T12:48:46.947241+0000","last_active":"2023-08-09T12:48:46.947557+0000","last_peered":"2023-08-09T12:48:46.947557+0000","last_clean":"2023-08-09T12:48:46.947557+0000","last_became_active":"2023-08-09T12:48:46.946611+0000","last_became_peered":"2023-08-09T12:48:46.946611+0000","last_unstale":"2023-08-09T12:48:46.947557+0000","last_undegraded":"2023-08-09T12:48:46.947557+0000","last_fullsized":"2023-08-09T12:48:46.947557+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:47.916737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977117+0000","last_change":"2023-08-09T12:48:45.904761+0000","last_active":"2023-08-09T12:48:46.977117+0000","last_peered":"2023-08-09T12:48:46.977117+0000","last_clean":"2023-08-09T12:48:46.977117+0000","last_became_active":"2023-08-09T12:48:45.904258+0000","last_became_peered":"2023-08-09T12:48:45.904258+0000","last_unstale":"2023-08-09T12:48:46.977117+0000","last_undegraded":"2023-08-09T12:48:46.977117+0000","last_fullsized":"2023-08-09T12:48:46.977117+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:58:11.511623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959998+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:46.959998+0000","last_peered":"2023-08-09T12:48:46.959998+0000","last_clean":"2023-08-09T12:48:46.959998+0000","last_became_active":"2023-08-09T12:48:46.959290+0000","last_became_peered":"2023-08-09T12:48:46.959290+0000","last_unstale":"2023-08-09T12:48:46.959998+0000","last_undegraded":"2023-08-09T12:48:46.959998+0000","last_fullsized":"2023-08-09T12:48:46.959998+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:09:19.355636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978501+0000","last_change":"2023-08-09T12:48:45.907778+0000","last_active":"2023-08-09T12:48:46.978501+0000","last_peered":"2023-08-09T12:48:46.978501+0000","last_clean":"2023-08-09T12:48:46.978501+0000","last_became_active":"2023-08-09T12:48:45.907326+0000","last_became_peered":"2023-08-09T12:48:45.907326+0000","last_unstale":"2023-08-09T12:48:46.978501+0000","last_undegraded":"2023-08-09T12:48:46.978501+0000","last_fullsized":"2023-08-09T12:48:46.978501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:37:02.238431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.963265+0000","last_change":"2023-08-09T12:48:46.963125+0000","last_active":"2023-08-09T12:48:46.963265+0000","last_peered":"2023-08-09T12:48:46.963265+0000","last_clean":"2023-08-09T12:48:46.963265+0000","last_became_active":"2023-08-09T12:48:46.955577+0000","last_became_peered":"2023-08-09T12:48:46.955577+0000","last_unstale":"2023-08-09T12:48:46.963265+0000","last_undegraded":"2023-08-09T12:48:46.963265+0000","last_fullsized":"2023-08-09T12:48:46.963265+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:33:51.801770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.912917+0000","last_change":"2023-08-09T12:48:45.912814+0000","last_active":"2023-08-09T12:48:45.912917+0000","last_peered":"2023-08-09T12:48:45.912917+0000","last_clean":"2023-08-09T12:48:45.912917+0000","last_became_active":"2023-08-09T12:48:45.911537+0000","last_became_peered":"2023-08-09T12:48:45.911537+0000","last_unstale":"2023-08-09T12:48:45.912917+0000","last_undegraded":"2023-08-09T12:48:45.912917+0000","last_fullsized":"2023-08-09T12:48:45.912917+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:10:39.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.945274+0000","last_change":"2023-08-09T12:48:46.945168+0000","last_active":"2023-08-09T12:48:46.945274+0000","last_peered":"2023-08-09T12:48:46.945274+0000","last_clean":"2023-08-09T12:48:46.945274+0000","last_became_active":"2023-08-09T12:48:46.944925+0000","last_became_peered":"2023-08-09T12:48:46.944925+0000","last_unstale":"2023-08-09T12:48:46.945274+0000","last_undegraded":"2023-08-09T12:48:46.945274+0000","last_fullsized":"2023-08-09T12:48:46.945274+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:27:53.915770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.930735+0000","last_change":"2023-08-09T12:48:45.912104+0000","last_active":"2023-08-09T12:48:46.930735+0000","last_peered":"2023-08-09T12:48:46.930735+0000","last_clean":"2023-08-09T12:48:46.930735+0000","last_became_active":"2023-08-09T12:48:45.911841+0000","last_became_peered":"2023-08-09T12:48:45.911841+0000","last_unstale":"2023-08-09T12:48:46.930735+0000","last_undegraded":"2023-08-09T12:48:46.930735+0000","last_fullsized":"2023-08-09T12:48:46.930735+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:18:14.246123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961679+0000","last_change":"2023-08-09T12:48:46.961576+0000","last_active":"2023-08-09T12:48:46.961679+0000","last_peered":"2023-08-09T12:48:46.961679+0000","last_clean":"2023-08-09T12:48:46.961679+0000","last_became_active":"2023-08-09T12:48:46.961193+0000","last_became_peered":"2023-08-09T12:48:46.961193+0000","last_unstale":"2023-08-09T12:48:46.961679+0000","last_undegraded":"2023-08-09T12:48:46.961679+0000","last_fullsized":"2023-08-09T12:48:46.961679+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:29:13.189094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.976856+0000","last_change":"2023-08-09T12:48:45.912029+0000","last_active":"2023-08-09T12:48:46.976856+0000","last_peered":"2023-08-09T12:48:46.976856+0000","last_clean":"2023-08-09T12:48:46.976856+0000","last_became_active":"2023-08-09T12:48:45.911596+0000","last_became_peered":"2023-08-09T12:48:45.911596+0000","last_unstale":"2023-08-09T12:48:46.976856+0000","last_undegraded":"2023-08-09T12:48:46.976856+0000","last_fullsized":"2023-08-09T12:48:46.976856+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:30:03.806678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962802+0000","last_change":"2023-08-09T12:48:46.962725+0000","last_active":"2023-08-09T12:48:46.962802+0000","last_peered":"2023-08-09T12:48:46.962802+0000","last_clean":"2023-08-09T12:48:46.962802+0000","last_became_active":"2023-08-09T12:48:46.962525+0000","last_became_peered":"2023-08-09T12:48:46.962525+0000","last_unstale":"2023-08-09T12:48:46.962802+0000","last_undegraded":"2023-08-09T12:48:46.962802+0000","last_fullsized":"2023-08-09T12:48:46.962802+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:40:02.104275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977861+0000","last_change":"2023-08-09T12:48:45.898690+0000","last_active":"2023-08-09T12:48:46.977861+0000","last_peered":"2023-08-09T12:48:46.977861+0000","last_clean":"2023-08-09T12:48:46.977861+0000","last_became_active":"2023-08-09T12:48:45.898044+0000","last_became_peered":"2023-08-09T12:48:45.898044+0000","last_unstale":"2023-08-09T12:48:46.977861+0000","last_undegraded":"2023-08-09T12:48:46.977861+0000","last_fullsized":"2023-08-09T12:48:46.977861+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:46:10.974195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950459+0000","last_change":"2023-08-09T12:48:46.949845+0000","last_active":"2023-08-09T12:48:46.950459+0000","last_peered":"2023-08-09T12:48:46.950459+0000","last_clean":"2023-08-09T12:48:46.950459+0000","last_became_active":"2023-08-09T12:48:46.949387+0000","last_became_peered":"2023-08-09T12:48:46.949387+0000","last_unstale":"2023-08-09T12:48:46.950459+0000","last_undegraded":"2023-08-09T12:48:46.950459+0000","last_fullsized":"2023-08-09T12:48:46.950459+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:25:45.202659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.914397+0000","last_change":"2023-08-09T12:48:45.914299+0000","last_active":"2023-08-09T12:48:45.914397+0000","last_peered":"2023-08-09T12:48:45.914397+0000","last_clean":"2023-08-09T12:48:45.914397+0000","last_became_active":"2023-08-09T12:48:45.913540+0000","last_became_peered":"2023-08-09T12:48:45.913540+0000","last_unstale":"2023-08-09T12:48:45.914397+0000","last_undegraded":"2023-08-09T12:48:45.914397+0000","last_fullsized":"2023-08-09T12:48:45.914397+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:49:19.826988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888002+0000","last_change":"2023-08-09T12:48:45.888002+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888002+0000","last_undegraded":"2023-08-09T12:48:45.888002+0000","last_fullsized":"2023-08-09T12:48:45.888002+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.958664+0000","last_change":"2023-08-09T12:48:45.913084+0000","last_active":"2023-08-09T12:48:46.958664+0000","last_peered":"2023-08-09T12:48:46.958664+0000","last_clean":"2023-08-09T12:48:46.958664+0000","last_became_active":"2023-08-09T12:48:45.912811+0000","last_became_peered":"2023-08-09T12:48:45.912811+0000","last_unstale":"2023-08-09T12:48:46.958664+0000","last_undegraded":"2023-08-09T12:48:46.958664+0000","last_fullsized":"2023-08-09T12:48:46.958664+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:27:48.322806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.966820+0000","last_change":"2023-08-09T12:48:46.966736+0000","last_active":"2023-08-09T12:48:46.966820+0000","last_peered":"2023-08-09T12:48:46.966820+0000","last_clean":"2023-08-09T12:48:46.966820+0000","last_became_active":"2023-08-09T12:48:46.966391+0000","last_became_peered":"2023-08-09T12:48:46.966391+0000","last_unstale":"2023-08-09T12:48:46.966820+0000","last_undegraded":"2023-08-09T12:48:46.966820+0000","last_fullsized":"2023-08-09T12:48:46.966820+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:03:52.085522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978238+0000","last_change":"2023-08-09T12:48:45.903454+0000","last_active":"2023-08-09T12:48:46.978238+0000","last_peered":"2023-08-09T12:48:46.978238+0000","last_clean":"2023-08-09T12:48:46.978238+0000","last_became_active":"2023-08-09T12:48:45.901990+0000","last_became_peered":"2023-08-09T12:48:45.901990+0000","last_unstale":"2023-08-09T12:48:46.978238+0000","last_undegraded":"2023-08-09T12:48:46.978238+0000","last_fullsized":"2023-08-09T12:48:46.978238+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:48:20.785574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.935251+0000","last_change":"2023-08-09T12:48:46.935102+0000","last_active":"2023-08-09T12:48:46.935251+0000","last_peered":"2023-08-09T12:48:46.935251+0000","last_clean":"2023-08-09T12:48:46.935251+0000","last_became_active":"2023-08-09T12:48:46.934483+0000","last_became_peered":"2023-08-09T12:48:46.934483+0000","last_unstale":"2023-08-09T12:48:46.935251+0000","last_undegraded":"2023-08-09T12:48:46.935251+0000","last_fullsized":"2023-08-09T12:48:46.935251+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:51:03.089254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.931154+0000","last_change":"2023-08-09T12:48:45.909979+0000","last_active":"2023-08-09T12:48:46.931154+0000","last_peered":"2023-08-09T12:48:46.931154+0000","last_clean":"2023-08-09T12:48:46.931154+0000","last_became_active":"2023-08-09T12:48:45.909318+0000","last_became_peered":"2023-08-09T12:48:45.909318+0000","last_unstale":"2023-08-09T12:48:46.931154+0000","last_undegraded":"2023-08-09T12:48:46.931154+0000","last_fullsized":"2023-08-09T12:48:46.931154+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:09.939517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962865+0000","last_change":"2023-08-09T12:48:46.961941+0000","last_active":"2023-08-09T12:48:46.962865+0000","last_peered":"2023-08-09T12:48:46.962865+0000","last_clean":"2023-08-09T12:48:46.962865+0000","last_became_active":"2023-08-09T12:48:46.959507+0000","last_became_peered":"2023-08-09T12:48:46.959507+0000","last_unstale":"2023-08-09T12:48:46.962865+0000","last_undegraded":"2023-08-09T12:48:46.962865+0000","last_fullsized":"2023-08-09T12:48:46.962865+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:09:01.457240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.924102+0000","last_change":"2023-08-09T12:48:45.906050+0000","last_active":"2023-08-09T12:48:46.924102+0000","last_peered":"2023-08-09T12:48:46.924102+0000","last_clean":"2023-08-09T12:48:46.924102+0000","last_became_active":"2023-08-09T12:48:45.905750+0000","last_became_peered":"2023-08-09T12:48:45.905750+0000","last_unstale":"2023-08-09T12:48:46.924102+0000","last_undegraded":"2023-08-09T12:48:46.924102+0000","last_fullsized":"2023-08-09T12:48:46.924102+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:28.690148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952782+0000","last_change":"2023-08-09T12:48:46.952499+0000","last_active":"2023-08-09T12:48:46.952782+0000","last_peered":"2023-08-09T12:48:46.952782+0000","last_clean":"2023-08-09T12:48:46.952782+0000","last_became_active":"2023-08-09T12:48:46.951915+0000","last_became_peered":"2023-08-09T12:48:46.951915+0000","last_unstale":"2023-08-09T12:48:46.952782+0000","last_undegraded":"2023-08-09T12:48:46.952782+0000","last_fullsized":"2023-08-09T12:48:46.952782+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:29.740823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911553+0000","last_change":"2023-08-09T12:48:45.904623+0000","last_active":"2023-08-09T12:48:45.911553+0000","last_peered":"2023-08-09T12:48:45.911553+0000","last_clean":"2023-08-09T12:48:45.911553+0000","last_became_active":"2023-08-09T12:48:45.904073+0000","last_became_peered":"2023-08-09T12:48:45.904073+0000","last_unstale":"2023-08-09T12:48:45.911553+0000","last_undegraded":"2023-08-09T12:48:45.911553+0000","last_fullsized":"2023-08-09T12:48:45.911553+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:45:41.792268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961768+0000","last_change":"2023-08-09T12:48:46.961129+0000","last_active":"2023-08-09T12:48:46.961768+0000","last_peered":"2023-08-09T12:48:46.961768+0000","last_clean":"2023-08-09T12:48:46.961768+0000","last_became_active":"2023-08-09T12:48:46.954671+0000","last_became_peered":"2023-08-09T12:48:46.954671+0000","last_unstale":"2023-08-09T12:48:46.961768+0000","last_undegraded":"2023-08-09T12:48:46.961768+0000","last_fullsized":"2023-08-09T12:48:46.961768+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:51:15.293415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978038+0000","last_change":"2023-08-09T12:48:45.900760+0000","last_active":"2023-08-09T12:48:46.978038+0000","last_peered":"2023-08-09T12:48:46.978038+0000","last_clean":"2023-08-09T12:48:46.978038+0000","last_became_active":"2023-08-09T12:48:45.899103+0000","last_became_peered":"2023-08-09T12:48:45.899103+0000","last_unstale":"2023-08-09T12:48:46.978038+0000","last_undegraded":"2023-08-09T12:48:46.978038+0000","last_fullsized":"2023-08-09T12:48:46.978038+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:03:34.437537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959693+0000","last_change":"2023-08-09T12:48:46.959599+0000","last_active":"2023-08-09T12:48:46.959693+0000","last_peered":"2023-08-09T12:48:46.959693+0000","last_clean":"2023-08-09T12:48:46.959693+0000","last_became_active":"2023-08-09T12:48:46.959283+0000","last_became_peered":"2023-08-09T12:48:46.959283+0000","last_unstale":"2023-08-09T12:48:46.959693+0000","last_undegraded":"2023-08-09T12:48:46.959693+0000","last_fullsized":"2023-08-09T12:48:46.959693+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:16.463734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.928975+0000","last_change":"2023-08-09T12:48:45.910936+0000","last_active":"2023-08-09T12:48:46.928975+0000","last_peered":"2023-08-09T12:48:46.928975+0000","last_clean":"2023-08-09T12:48:46.928975+0000","last_became_active":"2023-08-09T12:48:45.910460+0000","last_became_peered":"2023-08-09T12:48:45.910460+0000","last_unstale":"2023-08-09T12:48:46.928975+0000","last_undegraded":"2023-08-09T12:48:46.928975+0000","last_fullsized":"2023-08-09T12:48:46.928975+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:53:54.231683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.942981+0000","last_change":"2023-08-09T12:48:46.942752+0000","last_active":"2023-08-09T12:48:46.942981+0000","last_peered":"2023-08-09T12:48:46.942981+0000","last_clean":"2023-08-09T12:48:46.942981+0000","last_became_active":"2023-08-09T12:48:46.941039+0000","last_became_peered":"2023-08-09T12:48:46.941039+0000","last_unstale":"2023-08-09T12:48:46.942981+0000","last_undegraded":"2023-08-09T12:48:46.942981+0000","last_fullsized":"2023-08-09T12:48:46.942981+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:26:08.488438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.929590+0000","last_change":"2023-08-09T12:48:45.905909+0000","last_active":"2023-08-09T12:48:46.929590+0000","last_peered":"2023-08-09T12:48:46.929590+0000","last_clean":"2023-08-09T12:48:46.929590+0000","last_became_active":"2023-08-09T12:48:45.905567+0000","last_became_peered":"2023-08-09T12:48:45.905567+0000","last_unstale":"2023-08-09T12:48:46.929590+0000","last_undegraded":"2023-08-09T12:48:46.929590+0000","last_fullsized":"2023-08-09T12:48:46.929590+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:56.553013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887293+0000","last_change":"2023-08-09T12:48:45.887293+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887293+0000","last_undegraded":"2023-08-09T12:48:45.887293+0000","last_fullsized":"2023-08-09T12:48:45.887293+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911607+0000","last_change":"2023-08-09T12:48:45.911167+0000","last_active":"2023-08-09T12:48:45.911607+0000","last_peered":"2023-08-09T12:48:45.911607+0000","last_clean":"2023-08-09T12:48:45.911607+0000","last_became_active":"2023-08-09T12:48:45.910891+0000","last_became_peered":"2023-08-09T12:48:45.910891+0000","last_unstale":"2023-08-09T12:48:45.911607+0000","last_undegraded":"2023-08-09T12:48:45.911607+0000","last_fullsized":"2023-08-09T12:48:45.911607+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:18.953781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.892167+0000","last_change":"2023-08-09T12:48:45.892167+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.892167+0000","last_undegraded":"2023-08-09T12:48:45.892167+0000","last_fullsized":"2023-08-09T12:48:45.892167+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.951200+0000","last_change":"2023-08-09T12:48:45.910842+0000","last_active":"2023-08-09T12:48:46.951200+0000","last_peered":"2023-08-09T12:48:46.951200+0000","last_clean":"2023-08-09T12:48:46.951200+0000","last_became_active":"2023-08-09T12:48:45.910039+0000","last_became_peered":"2023-08-09T12:48:45.910039+0000","last_unstale":"2023-08-09T12:48:46.951200+0000","last_undegraded":"2023-08-09T12:48:46.951200+0000","last_fullsized":"2023-08-09T12:48:46.951200+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:19.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.893483+0000","last_change":"2023-08-09T12:48:45.893483+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.893483+0000","last_undegraded":"2023-08-09T12:48:45.893483+0000","last_fullsized":"2023-08-09T12:48:45.893483+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.928656+0000","last_change":"2023-08-09T12:48:45.907402+0000","last_active":"2023-08-09T12:48:46.928656+0000","last_peered":"2023-08-09T12:48:46.928656+0000","last_clean":"2023-08-09T12:48:46.928656+0000","last_became_active":"2023-08-09T12:48:45.906892+0000","last_became_peered":"2023-08-09T12:48:45.906892+0000","last_unstale":"2023-08-09T12:48:46.928656+0000","last_undegraded":"2023-08-09T12:48:46.928656+0000","last_fullsized":"2023-08-09T12:48:46.928656+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:58.088826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.894112+0000","last_change":"2023-08-09T12:48:45.894112+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.894112+0000","last_undegraded":"2023-08-09T12:48:45.894112+0000","last_fullsized":"2023-08-09T12:48:45.894112+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.912936+0000","last_change":"2023-08-09T12:48:45.911823+0000","last_active":"2023-08-09T12:48:45.912936+0000","last_peered":"2023-08-09T12:48:45.912936+0000","last_clean":"2023-08-09T12:48:45.912936+0000","last_became_active":"2023-08-09T12:48:45.911339+0000","last_became_peered":"2023-08-09T12:48:45.911339+0000","last_unstale":"2023-08-09T12:48:45.912936+0000","last_undegraded":"2023-08-09T12:48:45.912936+0000","last_fullsized":"2023-08-09T12:48:45.912936+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:49.711986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.942364+0000","last_change":"2023-08-09T12:48:46.942177+0000","last_active":"2023-08-09T12:48:46.942364+0000","last_peered":"2023-08-09T12:48:46.942364+0000","last_clean":"2023-08-09T12:48:46.942364+0000","last_became_active":"2023-08-09T12:48:46.940133+0000","last_became_peered":"2023-08-09T12:48:46.940133+0000","last_unstale":"2023-08-09T12:48:46.942364+0000","last_undegraded":"2023-08-09T12:48:46.942364+0000","last_fullsized":"2023-08-09T12:48:46.942364+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:41:18.263898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.953930+0000","last_change":"2023-08-09T12:48:45.909884+0000","last_active":"2023-08-09T12:48:46.953930+0000","last_peered":"2023-08-09T12:48:46.953930+0000","last_clean":"2023-08-09T12:48:46.953930+0000","last_became_active":"2023-08-09T12:48:45.909635+0000","last_became_peered":"2023-08-09T12:48:45.909635+0000","last_unstale":"2023-08-09T12:48:46.953930+0000","last_undegraded":"2023-08-09T12:48:46.953930+0000","last_fullsized":"2023-08-09T12:48:46.953930+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:26.713603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962465+0000","last_change":"2023-08-09T12:48:46.962403+0000","last_active":"2023-08-09T12:48:46.962465+0000","last_peered":"2023-08-09T12:48:46.962465+0000","last_clean":"2023-08-09T12:48:46.962465+0000","last_became_active":"2023-08-09T12:48:46.961621+0000","last_became_peered":"2023-08-09T12:48:46.961621+0000","last_unstale":"2023-08-09T12:48:46.962465+0000","last_undegraded":"2023-08-09T12:48:46.962465+0000","last_fullsized":"2023-08-09T12:48:46.962465+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:28:28.778739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.923002+0000","last_change":"2023-08-09T12:48:45.907971+0000","last_active":"2023-08-09T12:48:46.923002+0000","last_peered":"2023-08-09T12:48:46.923002+0000","last_clean":"2023-08-09T12:48:46.923002+0000","last_became_active":"2023-08-09T12:48:45.907721+0000","last_became_peered":"2023-08-09T12:48:45.907721+0000","last_unstale":"2023-08-09T12:48:46.923002+0000","last_undegraded":"2023-08-09T12:48:46.923002+0000","last_fullsized":"2023-08-09T12:48:46.923002+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:37:16.729312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":443,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.926685+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:48:46.926685+0000","last_peered":"2023-08-09T12:48:46.926685+0000","last_clean":"2023-08-09T12:48:46.926685+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:48:46.926685+0000","last_undegraded":"2023-08-09T12:48:46.926685+0000","last_fullsized":"2023-08-09T12:48:46.926685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:12.363669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.951305+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:48:46.951305+0000","last_peered":"2023-08-09T12:48:46.951305+0000","last_clean":"2023-08-09T12:48:46.951305+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:48:46.951305+0000","last_undegraded":"2023-08-09T12:48:46.951305+0000","last_fullsized":"2023-08-09T12:48:46.951305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:33.338962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954207+0000","last_change":"2023-08-09T12:48:46.953789+0000","last_active":"2023-08-09T12:48:46.954207+0000","last_peered":"2023-08-09T12:48:46.954207+0000","last_clean":"2023-08-09T12:48:46.954207+0000","last_became_active":"2023-08-09T12:48:46.953417+0000","last_became_peered":"2023-08-09T12:48:46.953417+0000","last_unstale":"2023-08-09T12:48:46.954207+0000","last_undegraded":"2023-08-09T12:48:46.954207+0000","last_fullsized":"2023-08-09T12:48:46.954207+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:24:58.657906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.927702+0000","last_change":"2023-08-09T12:48:45.907769+0000","last_active":"2023-08-09T12:48:46.927702+0000","last_peered":"2023-08-09T12:48:46.927702+0000","last_clean":"2023-08-09T12:48:46.927702+0000","last_became_active":"2023-08-09T12:48:45.906964+0000","last_became_peered":"2023-08-09T12:48:45.906964+0000","last_unstale":"2023-08-09T12:48:46.927702+0000","last_undegraded":"2023-08-09T12:48:46.927702+0000","last_fullsized":"2023-08-09T12:48:46.927702+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:08.623403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":287,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.926355+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:48:46.926355+0000","last_peered":"2023-08-09T12:48:46.926355+0000","last_clean":"2023-08-09T12:48:46.926355+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:48:46.926355+0000","last_undegraded":"2023-08-09T12:48:46.926355+0000","last_fullsized":"2023-08-09T12:48:46.926355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:43:49.173542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.968921+0000","last_change":"2023-08-09T12:48:46.968109+0000","last_active":"2023-08-09T12:48:46.968921+0000","last_peered":"2023-08-09T12:48:46.968921+0000","last_clean":"2023-08-09T12:48:46.968921+0000","last_became_active":"2023-08-09T12:48:46.967751+0000","last_became_peered":"2023-08-09T12:48:46.967751+0000","last_unstale":"2023-08-09T12:48:46.968921+0000","last_undegraded":"2023-08-09T12:48:46.968921+0000","last_fullsized":"2023-08-09T12:48:46.968921+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:13.639064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911733+0000","last_change":"2023-08-09T12:48:45.911662+0000","last_active":"2023-08-09T12:48:45.911733+0000","last_peered":"2023-08-09T12:48:45.911733+0000","last_clean":"2023-08-09T12:48:45.911733+0000","last_became_active":"2023-08-09T12:48:45.910793+0000","last_became_peered":"2023-08-09T12:48:45.910793+0000","last_unstale":"2023-08-09T12:48:45.911733+0000","last_undegraded":"2023-08-09T12:48:45.911733+0000","last_fullsized":"2023-08-09T12:48:45.911733+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:38.651036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.929950+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:48:46.929950+0000","last_peered":"2023-08-09T12:48:46.929950+0000","last_clean":"2023-08-09T12:48:46.929950+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:48:46.929950+0000","last_undegraded":"2023-08-09T12:48:46.929950+0000","last_fullsized":"2023-08-09T12:48:46.929950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:59:05.444945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887432+0000","last_change":"2023-08-09T12:48:45.887432+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887432+0000","last_undegraded":"2023-08-09T12:48:45.887432+0000","last_fullsized":"2023-08-09T12:48:45.887432+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977566+0000","last_change":"2023-08-09T12:48:45.889867+0000","last_active":"2023-08-09T12:48:46.977566+0000","last_peered":"2023-08-09T12:48:46.977566+0000","last_clean":"2023-08-09T12:48:46.977566+0000","last_became_active":"2023-08-09T12:48:45.889203+0000","last_became_peered":"2023-08-09T12:48:45.889203+0000","last_unstale":"2023-08-09T12:48:46.977566+0000","last_undegraded":"2023-08-09T12:48:46.977566+0000","last_fullsized":"2023-08-09T12:48:46.977566+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:22:25.084122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950924+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:48:46.950924+0000","last_peered":"2023-08-09T12:48:46.950924+0000","last_clean":"2023-08-09T12:48:46.950924+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:48:46.950924+0000","last_undegraded":"2023-08-09T12:48:46.950924+0000","last_fullsized":"2023-08-09T12:48:46.950924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:56.473393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954925+0000","last_change":"2023-08-09T12:48:46.954804+0000","last_active":"2023-08-09T12:48:46.954925+0000","last_peered":"2023-08-09T12:48:46.954925+0000","last_clean":"2023-08-09T12:48:46.954925+0000","last_became_active":"2023-08-09T12:48:46.954030+0000","last_became_peered":"2023-08-09T12:48:46.954030+0000","last_unstale":"2023-08-09T12:48:46.954925+0000","last_undegraded":"2023-08-09T12:48:46.954925+0000","last_fullsized":"2023-08-09T12:48:46.954925+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:49.911558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"160'3","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978359+0000","last_change":"2023-08-09T12:48:45.904271+0000","last_active":"2023-08-09T12:48:46.978359+0000","last_peered":"2023-08-09T12:48:46.978359+0000","last_clean":"2023-08-09T12:48:46.978359+0000","last_became_active":"2023-08-09T12:48:45.903570+0000","last_became_peered":"2023-08-09T12:48:45.903570+0000","last_unstale":"2023-08-09T12:48:46.978359+0000","last_undegraded":"2023-08-09T12:48:46.978359+0000","last_fullsized":"2023-08-09T12:48:46.978359+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:55.399101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.892643+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:48:45.892643+0000","last_peered":"2023-08-09T12:48:45.892643+0000","last_clean":"2023-08-09T12:48:45.892643+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:48:45.892643+0000","last_undegraded":"2023-08-09T12:48:45.892643+0000","last_fullsized":"2023-08-09T12:48:45.892643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:38.640549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.960104+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:46.960104+0000","last_peered":"2023-08-09T12:48:46.960104+0000","last_clean":"2023-08-09T12:48:46.960104+0000","last_became_active":"2023-08-09T12:48:46.959496+0000","last_became_peered":"2023-08-09T12:48:46.959496+0000","last_unstale":"2023-08-09T12:48:46.960104+0000","last_undegraded":"2023-08-09T12:48:46.960104+0000","last_fullsized":"2023-08-09T12:48:46.960104+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:31:39.093936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"160'6","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.980029+0000","last_change":"2023-08-09T12:48:45.908372+0000","last_active":"2023-08-09T12:48:46.980029+0000","last_peered":"2023-08-09T12:48:46.980029+0000","last_clean":"2023-08-09T12:48:46.980029+0000","last_became_active":"2023-08-09T12:48:45.907802+0000","last_became_peered":"2023-08-09T12:48:45.907802+0000","last_unstale":"2023-08-09T12:48:46.980029+0000","last_undegraded":"2023-08-09T12:48:46.980029+0000","last_fullsized":"2023-08-09T12:48:46.980029+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:21.647701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":287,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.925801+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:48:46.925801+0000","last_peered":"2023-08-09T12:48:46.925801+0000","last_clean":"2023-08-09T12:48:46.925801+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:48:46.925801+0000","last_undegraded":"2023-08-09T12:48:46.925801+0000","last_fullsized":"2023-08-09T12:48:46.925801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:07.531778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944679+0000","last_change":"2023-08-09T12:48:46.944465+0000","last_active":"2023-08-09T12:48:46.944679+0000","last_peered":"2023-08-09T12:48:46.944679+0000","last_clean":"2023-08-09T12:48:46.944679+0000","last_became_active":"2023-08-09T12:48:46.943732+0000","last_became_peered":"2023-08-09T12:48:46.943732+0000","last_unstale":"2023-08-09T12:48:46.944679+0000","last_undegraded":"2023-08-09T12:48:46.944679+0000","last_fullsized":"2023-08-09T12:48:46.944679+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:31.914515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950953+0000","last_change":"2023-08-09T12:48:45.910997+0000","last_active":"2023-08-09T12:48:46.950953+0000","last_peered":"2023-08-09T12:48:46.950953+0000","last_clean":"2023-08-09T12:48:46.950953+0000","last_became_active":"2023-08-09T12:48:45.910593+0000","last_became_peered":"2023-08-09T12:48:45.910593+0000","last_unstale":"2023-08-09T12:48:46.950953+0000","last_undegraded":"2023-08-09T12:48:46.950953+0000","last_fullsized":"2023-08-09T12:48:46.950953+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:56.684208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.908293+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:48:45.908293+0000","last_peered":"2023-08-09T12:48:45.908293+0000","last_clean":"2023-08-09T12:48:45.908293+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:48:45.908293+0000","last_undegraded":"2023-08-09T12:48:45.908293+0000","last_fullsized":"2023-08-09T12:48:45.908293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:55:08.007694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.891274+0000","last_change":"2023-08-09T12:48:45.891274+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.891274+0000","last_undegraded":"2023-08-09T12:48:45.891274+0000","last_fullsized":"2023-08-09T12:48:45.891274+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.931677+0000","last_change":"2023-08-09T12:48:45.890515+0000","last_active":"2023-08-09T12:48:46.931677+0000","last_peered":"2023-08-09T12:48:46.931677+0000","last_clean":"2023-08-09T12:48:46.931677+0000","last_became_active":"2023-08-09T12:48:45.889827+0000","last_became_peered":"2023-08-09T12:48:45.889827+0000","last_unstale":"2023-08-09T12:48:46.931677+0000","last_undegraded":"2023-08-09T12:48:46.931677+0000","last_fullsized":"2023-08-09T12:48:46.931677+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:13.113325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.927912+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:48:46.927912+0000","last_peered":"2023-08-09T12:48:46.927912+0000","last_clean":"2023-08-09T12:48:46.927912+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:48:46.927912+0000","last_undegraded":"2023-08-09T12:48:46.927912+0000","last_fullsized":"2023-08-09T12:48:46.927912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:20.443006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1507,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193805,"statfs":{"total":200000000,"available":198456779,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1439999999999999,"15min":1.107},"min":{"1min":0.64300000000000002,"5min":0.627,"15min":0.59899999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.544},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0900000000000001,"15min":1.091},"min":{"1min":0.70499999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7509999999999999,"5min":1.7769999999999999,"15min":2.0459999999999998},"last":1.355}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.224,"15min":1.149},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.63300000000000001},"max":{"1min":1.629,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.022},{"interface":"front","average":{"1min":1.119,"5min":1.167,"15min":1.133},"min":{"1min":0.73499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.26,"15min":1.2050000000000001},"min":{"1min":0.83299999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.591,"5min":1.96,"15min":2.1459999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.2230000000000001,"15min":1.1759999999999999},"min":{"1min":0.81200000000000006,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.7450000000000001,"15min":2.173},"last":1.593}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.341,"15min":1.268},"min":{"1min":0.79100000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.806,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.331,"15min":1.2949999999999999},"min":{"1min":0.97899999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6200000000000001,"5min":1.992,"15min":2.282},"last":1.4910000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.276,"15min":1.2330000000000001},"min":{"1min":0.98499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.948,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.706},{"interface":"front","average":{"1min":1.302,"5min":1.3799999999999999,"15min":1.3200000000000001},"min":{"1min":0.90800000000000003,"5min":0.82299999999999995,"15min":0.58599999999999997},"max":{"1min":1.764,"5min":2.5070000000000001,"15min":4.6200000000000001},"last":1.647}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.878,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.978,"5min":2.1699999999999999,"15min":2.802},"last":1.397},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.536,"15min":1.502},"min":{"1min":0.97799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1299999999999999,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.8009999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.522,"15min":1.486},"min":{"1min":1.1259999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2370000000000001,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":1.8839999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.542,"15min":1.476},"min":{"1min":1.073,"5min":1.0029999999999999,"15min":0.623},"max":{"1min":1.95,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.7490000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.135},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.544,"5min":1.986,"15min":2.54},"last":1.573},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.099,"15min":1.083},"min":{"1min":0.72099999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.615,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.179}]},{"osd":1,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.226,"15min":1.2290000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.51,"5min":1.996,"15min":2.306},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.3009999999999999,"15min":1.3160000000000001},"min":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":0.95199999999999996}]},{"osd":2,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1839999999999999,"15min":1.1240000000000001},"min":{"1min":0.91100000000000003,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.28,"15min":1.2789999999999999},"min":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.772,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7070000000000001,"5min":2.327,"15min":2.327},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.3680000000000001,"15min":1.3160000000000001},"min":{"1min":1.0549999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.724,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.327}]},{"osd":4,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3340000000000001,"15min":1.3540000000000001},"min":{"1min":1.01,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.651,"5min":2.028,"15min":11.058999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.339,"15min":1.351},"min":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":2.29,"15min":2.3479999999999999},"last":1.603}]},{"osd":5,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.0089999999999999,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.71,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.012},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4750000000000001,"15min":1.4890000000000001},"min":{"1min":1.087,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.8009999999999999,"5min":2.222,"15min":2.8580000000000001},"last":1.3600000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.5089999999999999,"15min":1.4670000000000001},"min":{"1min":1.137,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9059999999999999,"5min":2.1520000000000001,"15min":2.7999999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.5129999999999999,"15min":1.4690000000000001},"min":{"1min":1.1259999999999999,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.8109999999999999,"5min":2.7810000000000001,"15min":3.621},"last":1.236}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.68000000000000005,"15min":0.55300000000000005},"max":{"1min":1.591,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2070000000000001,"15min":1.113},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.97,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.2869999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3680000000000001,"15min":1.3109999999999999},"min":{"1min":0.78600000000000003,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.7190000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.284,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7310000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.97599999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.264,"15min":1.22},"min":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2310000000000001,"15min":1.2030000000000001},"min":{"1min":0.78800000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.554,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.347}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.2410000000000001},"min":{"1min":1.006,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5429999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.393,"15min":1.3740000000000001},"min":{"1min":0.998,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":1.7809999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.1259999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.335,"15min":1.2569999999999999},"min":{"1min":0.877,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":1.7549999999999999,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":0.877},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.456,"15min":1.389},"min":{"1min":1.032,"5min":0.80600000000000005,"15min":0.628},"max":{"1min":1.7190000000000001,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.4330000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.4419999999999999,"15min":1.367},"min":{"1min":1.006,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.833,"5min":2.952,"15min":2.952},"last":1.458},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":0.98199999999999998,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.762,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.4079999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.575,"15min":1.53},"min":{"1min":1.0860000000000001,"5min":0.86599999999999999,"15min":0.67200000000000004},"max":{"1min":2.0329999999999999,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6399999999999999,"15min":1.5469999999999999},"min":{"1min":1.069,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.9179999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.242}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194383,"statfs":{"total":200000000,"available":199048849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1040000000000001,"15min":1.0940000000000001},"min":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.579,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.391},{"interface":"front","average":{"1min":1.145,"5min":1.131,"15min":1.119},"min":{"1min":0.77000000000000002,"5min":0.66500000000000004,"15min":0.64800000000000002},"max":{"1min":1.5740000000000001,"5min":1.635,"15min":3.4100000000000001},"last":1.4750000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.288,"15min":1.3180000000000001},"min":{"1min":0.88100000000000001,"5min":0.77400000000000002,"15min":0.48899999999999999},"max":{"1min":1.863,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.92600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8240000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.4550000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.306,"15min":1.3169999999999999},"min":{"1min":0.86199999999999999,"5min":0.70799999999999996,"15min":0.54900000000000004},"max":{"1min":1.9470000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3420000000000001,"15min":1.3300000000000001},"min":{"1min":0.81499999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8100000000000001,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.5089999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2889999999999999,"15min":1.248},"min":{"1min":1.0329999999999999,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.728,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3320000000000001,"15min":1.335},"min":{"1min":0.98199999999999998,"5min":0.93999999999999995,"15min":0.82699999999999996},"max":{"1min":2.0539999999999998,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.631}]},{"osd":5,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3759999999999999,"15min":1.381},"min":{"1min":0.85499999999999998,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":1.857,"5min":3.137,"15min":3.137},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.367,"15min":1.381},"min":{"1min":0.89400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":2.403,"5min":2.403,"15min":3.3620000000000001},"last":1.3440000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4399999999999999,"15min":1.466},"min":{"1min":0.82299999999999995,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":2.262,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.143},{"interface":"front","average":{"1min":1.498,"5min":1.5469999999999999,"15min":1.538},"min":{"1min":1.0660000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1070000000000002,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.3100000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.5249999999999999,"15min":1.5289999999999999},"min":{"1min":1.1950000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.202},{"interface":"front","average":{"1min":1.621,"5min":1.599,"15min":1.613},"min":{"1min":1.2689999999999999,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.4590000000000001,"5min":2.875,"15min":2.875},"last":1.53}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.84699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.458,"5min":1.458,"15min":4.4109999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.024,"15min":0.94199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.698,"5min":2.778,"15min":3.2269999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.52000000000000002,"5min":0.41099999999999998,"15min":0.38100000000000001},"max":{"1min":1.448,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.127,"15min":0.98799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.407,"5min":2.0219999999999998,"15min":2.0880000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.103,"15min":1.129},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.48,"5min":1.9259999999999999,"15min":18.145},"last":0.874},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2569999999999999,"15min":1.208},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.619,"5min":2.169,"15min":2.169},"last":0.64900000000000002}]},{"osd":4,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.78200000000000003,"5min":0.75,"15min":0.745},"max":{"1min":1.7709999999999999,"5min":1.8660000000000001,"15min":3.5110000000000001},"last":1.151},{"interface":"front","average":{"1min":1.214,"5min":1.306,"15min":1.325},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":1.5640000000000001,"5min":2.056,"15min":3.5960000000000001},"last":1.208}]},{"osd":5,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.345,"15min":1.4299999999999999},"min":{"1min":0.82099999999999995,"5min":0.80500000000000005,"15min":0.72999999999999998},"max":{"1min":1.7150000000000001,"5min":2.2389999999999999,"15min":18.094000000000001},"last":1.385},{"interface":"front","average":{"1min":1.347,"5min":1.429,"15min":1.389},"min":{"1min":0.752,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.6020000000000001,"5min":2.2959999999999998,"15min":14.105},"last":0.97999999999999998}]},{"osd":6,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3899999999999999,"15min":1.357},"min":{"1min":0.92200000000000004,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.641,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4319999999999999,"15min":1.462},"min":{"1min":0.90300000000000002,"5min":0.86399999999999999,"15min":0.77700000000000002},"max":{"1min":1.792,"5min":2.0099999999999998,"15min":4.0220000000000002},"last":1.45}]},{"osd":7,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.526,"15min":1.4279999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":1.7430000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.012},{"interface":"front","average":{"1min":1.391,"5min":1.4950000000000001,"15min":1.4139999999999999},"min":{"1min":0.96299999999999997,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":1.6759999999999999,"5min":2.073,"15min":3.016},"last":1.266}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90900000000000003,"15min":0.86699999999999999},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":1.3759999999999999,"5min":1.597,"15min":1.716},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.028,"15min":0.96699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.5680000000000001,"5min":1.73,"15min":2.9009999999999998},"last":0.75700000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92000000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.004,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5,"5min":1.823,"15min":1.869},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.149,"15min":1.1559999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.615,"5min":1.681,"15min":3.2850000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1930000000000001,"15min":1.1639999999999999},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.637,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":0.871}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4510000000000001,"15min":1.419},"min":{"1min":0.93200000000000005,"5min":0.83499999999999996,"15min":0.81899999999999995},"max":{"1min":1.7250000000000001,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.351,"15min":1.3},"min":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.694,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":1.302}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.401,"15min":1.375},"min":{"1min":0.78900000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0110000000000001,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.448,"15min":1.472},"min":{"1min":0.878,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8120000000000001,"5min":2.4780000000000002,"15min":4.806},"last":1.3220000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8580000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.468,"15min":1.4299999999999999},"min":{"1min":0.89600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.901,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":1.4530000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.462,"15min":1.3839999999999999},"min":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"max":{"1min":1.8640000000000001,"5min":2.464,"15min":2.464},"last":1.663},{"interface":"front","average":{"1min":1.431,"5min":1.536,"15min":1.5269999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.036,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.4970000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":915,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194397,"statfs":{"total":200000000,"available":199062597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91000000000000003,"15min":0.89400000000000002},"min":{"1min":0.53000000000000003,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":1.542,"5min":2.621,"15min":2.621},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.008,"15min":1.2709999999999999},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.5169999999999999,"5min":1.9530000000000001,"15min":88.254999999999995},"last":1.0489999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.998,"15min":0.96699999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":3.0209999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2470000000000001,"15min":1.1699999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7849999999999999,"5min":2.0449999999999999,"15min":3.1890000000000001},"last":1.353}]},{"osd":3,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1879999999999999,"15min":1.1200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.7290000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.085,"15min":1.0069999999999999},"min":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.397,"5min":1.819,"15min":5.4320000000000004},"last":1.2230000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.24,"15min":1.304},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.581,"5min":2.391,"15min":25.172000000000001},"last":1.127},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.391,"15min":1.3300000000000001},"min":{"1min":0.93500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.085,"5min":3.762,"15min":3.762},"last":1.607}]},{"osd":5,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3260000000000001,"15min":1.4079999999999999},"min":{"1min":0.92200000000000004,"5min":0.751,"15min":0.751},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":28.710000000000001},"last":1.7709999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.327,"15min":1.2989999999999999},"min":{"1min":0.84599999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6910000000000001,"5min":1.9910000000000001,"15min":3.762},"last":1.2889999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4510000000000001,"15min":1.4379999999999999},"min":{"1min":1.022,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7230000000000001,"5min":1.841,"15min":6.0460000000000003},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.4419999999999999,"15min":1.397},"min":{"1min":1.0609999999999999,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":1.6759999999999999,"5min":2.0960000000000001,"15min":2.1480000000000001},"last":1.4079999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.532,"15min":1.595},"min":{"1min":0.89800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.2370000000000001,"5min":2.5089999999999999,"15min":26.975999999999999},"last":1.498},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5389999999999999,"15min":1.589},"min":{"1min":1.141,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.988,"5min":2.492,"15min":28.765000000000001},"last":1.6639999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1491,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193820,"statfs":{"total":200000000,"available":198472229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.61299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.819},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0249999999999999,"15min":0.97799999999999998},"min":{"1min":0.60699999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.331,"5min":1.6699999999999999,"15min":6.1749999999999998},"last":1.052}]},{"osd":2,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.032,"15min":0.97899999999999998},"min":{"1min":0.63500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.411,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.044},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5189999999999999,"5min":1.732,"15min":6.2549999999999999},"last":1.1439999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.0429999999999999,"15min":0.97899999999999998},"min":{"1min":0.68300000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4570000000000001,"5min":1.6699999999999999,"15min":9.6069999999999993},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.1850000000000001},"min":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.0940000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3240000000000001,"15min":1.337},"min":{"1min":0.90600000000000003,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.6919999999999999,"5min":1.8240000000000001,"15min":9.9629999999999992},"last":0.996},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.377,"15min":1.3129999999999999},"min":{"1min":0.85799999999999998,"5min":0.78600000000000003,"15min":0.77900000000000003},"max":{"1min":1.825,"5min":1.879,"15min":1.879},"last":1.252}]},{"osd":5,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.351,"15min":1.325},"min":{"1min":0.86299999999999999,"5min":0.82799999999999996,"15min":0.76300000000000001},"max":{"1min":1.8200000000000001,"5min":2.0419999999999998,"15min":10.004},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4359999999999999,"15min":1.3939999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.728,"5min":2.0569999999999999,"15min":2.161},"last":1.381}]},{"osd":6,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4259999999999999,"15min":1.369},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.863,"5min":2.2000000000000002,"15min":6.4290000000000003},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":1.7030000000000001,"5min":2.1549999999999998,"15min":9.9190000000000005},"last":1.355}]},{"osd":7,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.466,"15min":1.458},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.9319999999999999,"5min":2.2909999999999999,"15min":18.114000000000001},"last":1.278},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.5209999999999999,"15min":1.4850000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.891,"5min":2.1120000000000001,"15min":9.5640000000000001},"last":1.292}]}]}],"pool_statfs":[]}} 2023-08-09T12:48:51.471 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:48:51.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.738+0000 7fd5b59eb640 1 Processor -- start 2023-08-09T12:48:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.738+0000 7fd5b59eb640 1 -- start start 2023-08-09T12:48:51.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.740+0000 7fd5b59eb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5b0159bd0 0x7fd5b00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.740+0000 7fd5b59eb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b006fe10 con 0x7fd5b00697c0 2023-08-09T12:48:51.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.740+0000 7fd5b59eb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b0159fb0 con 0x7fd5b00b3fe0 2023-08-09T12:48:51.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.740+0000 7fd5b59eb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b00b11a0 con 0x7fd5b0159bd0 2023-08-09T12:48:51.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.741+0000 7fd5b49e9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5b0159bd0 0x7fd5b00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.741+0000 7fd5b51ea640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd5b00697c0 0x7fd5b00b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41046/0 (socket says 172.21.15.17:41046) 2023-08-09T12:48:51.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.741+0000 7fd5b51ea640 1 -- 172.21.15.17:0/3612120888 learned_addr learned my addr 172.21.15.17:0/3612120888 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:51.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.741+0000 7fd5b49e9640 1 --2- 172.21.15.17:0/3612120888 >> v2:172.21.15.17:3300/0 conn(0x7fd5b0159bd0 0x7fd5b00ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57150/0 (socket says 172.21.15.17:57150) 2023-08-09T12:48:51.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.741+0000 7fd5b49e9640 1 -- 172.21.15.17:0/3612120888 >> v1:172.21.15.142:6789/0 conn(0x7fd5b00b3fe0 legacy=0x7fd5b0070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:51.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.741+0000 7fd5b49e9640 1 -- 172.21.15.17:0/3612120888 >> v1:172.21.15.17:6789/0 conn(0x7fd5b00697c0 legacy=0x7fd5b00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.741+0000 7fd5b49e9640 1 -- 172.21.15.17:0/3612120888 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b0070970 con 0x7fd5b0159bd0 2023-08-09T12:48:51.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.742+0000 7fd5b49e9640 1 --2- 172.21.15.17:0/3612120888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b00ca730 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40097a0 tx=0x7fd5a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11115d17d1a88419 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:51.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.743+0000 7fd5af7fe640 1 -- 172.21.15.17:0/3612120888 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a402e070 con 0x7fd5b0159bd0 2023-08-09T12:48:51.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.743+0000 7fd5af7fe640 1 -- 172.21.15.17:0/3612120888 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a40315a0 con 0x7fd5b0159bd0 2023-08-09T12:48:51.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.743+0000 7fd5af7fe640 1 -- 172.21.15.17:0/3612120888 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4031930 con 0x7fd5b0159bd0 2023-08-09T12:48:51.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.743+0000 7fd5b59eb640 1 -- 172.21.15.17:0/3612120888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 msgr2=0x7fd5b00ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.743+0000 7fd5b59eb640 1 --2- 172.21.15.17:0/3612120888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b00ca730 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40097a0 tx=0x7fd5a402b840 comp rx=0 tx=0).stop 2023-08-09T12:48:51.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.743+0000 7fd5b59eb640 1 -- 172.21.15.17:0/3612120888 shutdown_connections 2023-08-09T12:48:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.743+0000 7fd5b59eb640 1 --2- 172.21.15.17:0/3612120888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b00ca730 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.744+0000 7fd5b59eb640 1 -- 172.21.15.17:0/3612120888 >> 172.21.15.17:0/3612120888 conn(0x7fd5b00b1d50 msgr2=0x7fd5b006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.744+0000 7fd5b59eb640 1 -- 172.21.15.17:0/3612120888 shutdown_connections 2023-08-09T12:48:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.744+0000 7fd5b59eb640 1 -- 172.21.15.17:0/3612120888 wait complete. 2023-08-09T12:48:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.745+0000 7fd5b59eb640 1 Processor -- start 2023-08-09T12:48:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.746+0000 7fd5b59eb640 1 -- start start 2023-08-09T12:48:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b59eb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5b00697c0 0x7fd5b015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b59eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5b00b3fe0 0x7fd5b015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b59eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b59eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00c2200 con 0x7fd5b0159bd0 2023-08-09T12:48:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b59eb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b015b5b0 con 0x7fd5b00697c0 2023-08-09T12:48:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b59eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b015b890 con 0x7fd5b00b3fe0 2023-08-09T12:48:51.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b51ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b51ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57158/0 (socket says 172.21.15.17:57158) 2023-08-09T12:48:51.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b51ea640 1 -- 172.21.15.17:0/681580527 learned_addr learned my addr 172.21.15.17:0/681580527 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:51.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b49e9640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5b00697c0 0x7fd5b015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5affff640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5b00b3fe0 0x7fd5b015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b51ea640 1 -- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5b00b3fe0 msgr2=0x7fd5b015c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b51ea640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5b00b3fe0 0x7fd5b015c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b51ea640 1 -- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5b00697c0 msgr2=0x7fd5b015ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.747+0000 7fd5b51ea640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5b00697c0 0x7fd5b015ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.748+0000 7fd5b51ea640 1 -- 172.21.15.17:0/681580527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009400 con 0x7fd5b0159bd0 2023-08-09T12:48:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.748+0000 7fd5b51ea640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b015cb80 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800cbc0 tx=0x7fd5a800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.748+0000 7fd5ad7fa640 1 -- 172.21.15.17:0/681580527 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800ad40 con 0x7fd5b0159bd0 2023-08-09T12:48:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.748+0000 7fd5ad7fa640 1 -- 172.21.15.17:0/681580527 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8012400 con 0x7fd5b0159bd0 2023-08-09T12:48:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.748+0000 7fd5ad7fa640 1 -- 172.21.15.17:0/681580527 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800aea0 con 0x7fd5b0159bd0 2023-08-09T12:48:51.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.748+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b00c2450 con 0x7fd5b0159bd0 2023-08-09T12:48:51.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.748+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b0151e40 con 0x7fd5b0159bd0 2023-08-09T12:48:51.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.750+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b00c2970 con 0x7fd5b0159bd0 2023-08-09T12:48:51.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.751+0000 7fd5ad7fa640 1 -- 172.21.15.17:0/681580527 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd5a8007070 con 0x7fd5b0159bd0 2023-08-09T12:48:51.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.751+0000 7fd5ad7fa640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd59406a050 0x7fd59406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:51.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.752+0000 7fd5ad7fa640 1 -- 172.21.15.17:0/681580527 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5a8088410 con 0x7fd5b0159bd0 2023-08-09T12:48:51.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.752+0000 7fd5b49e9640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd59406a050 0x7fd59406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:51.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.753+0000 7fd5b49e9640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd59406a050 0x7fd59406c510 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4036000 tx=0x7fd5a403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:51.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.756+0000 7fd5ad7fa640 1 -- 172.21.15.17:0/681580527 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd5b00c2970 con 0x7fd5b0159bd0 2023-08-09T12:48:51.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.944+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5b00caed0 con 0x7fd59406a050 2023-08-09T12:48:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.968+0000 7fd5ad7fa640 1 -- 172.21.15.17:0/681580527 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301920 (secure 0 0 0) 0x7fd5a4031b10 con 0x7fd59406a050 2023-08-09T12:48:51.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:51.976 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:48:51.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd59406a050 msgr2=0x7fd59406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd59406a050 0x7fd59406c510 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4036000 tx=0x7fd5a403d040 comp rx=0 tx=0).stop 2023-08-09T12:48:51.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 msgr2=0x7fd5b015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:51.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b015cb80 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800cbc0 tx=0x7fd5a800a430 comp rx=0 tx=0).stop 2023-08-09T12:48:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 shutdown_connections 2023-08-09T12:48:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd59406a050 0x7fd59406c510 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0159bd0 0x7fd5b015cb80 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5b00b3fe0 0x7fd5b015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 --2- 172.21.15.17:0/681580527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5b00697c0 0x7fd5b015ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:51.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 >> 172.21.15.17:0/681580527 conn(0x7fd5b00b1d50 msgr2=0x7fd5b00c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:51.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 shutdown_connections 2023-08-09T12:48:51.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:51.975+0000 7fd5b59eb640 1 -- 172.21.15.17:0/681580527 wait complete. 2023-08-09T12:48:51.999 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2023-08-09T12:48:50.851178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553969,"statfs":{"total":1600000000,"available":1591264362,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.974237"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961709+0000","last_change":"2023-08-09T12:48:46.961585+0000","last_active":"2023-08-09T12:48:46.961709+0000","last_peered":"2023-08-09T12:48:46.961709+0000","last_clean":"2023-08-09T12:48:46.961709+0000","last_became_active":"2023-08-09T12:48:46.961206+0000","last_became_peered":"2023-08-09T12:48:46.961206+0000","last_unstale":"2023-08-09T12:48:46.961709+0000","last_undegraded":"2023-08-09T12:48:46.961709+0000","last_fullsized":"2023-08-09T12:48:46.961709+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:51:40.488960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952759+0000","last_change":"2023-08-09T12:48:46.952118+0000","last_active":"2023-08-09T12:48:46.952759+0000","last_peered":"2023-08-09T12:48:46.952759+0000","last_clean":"2023-08-09T12:48:46.952759+0000","last_became_active":"2023-08-09T12:48:46.951749+0000","last_became_peered":"2023-08-09T12:48:46.951749+0000","last_unstale":"2023-08-09T12:48:46.952759+0000","last_undegraded":"2023-08-09T12:48:46.952759+0000","last_fullsized":"2023-08-09T12:48:46.952759+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:29:17.351750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962647+0000","last_change":"2023-08-09T12:48:46.962586+0000","last_active":"2023-08-09T12:48:46.962647+0000","last_peered":"2023-08-09T12:48:46.962647+0000","last_clean":"2023-08-09T12:48:46.962647+0000","last_became_active":"2023-08-09T12:48:46.962122+0000","last_became_peered":"2023-08-09T12:48:46.962122+0000","last_unstale":"2023-08-09T12:48:46.962647+0000","last_undegraded":"2023-08-09T12:48:46.962647+0000","last_fullsized":"2023-08-09T12:48:46.962647+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:30.851235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.958544+0000","last_change":"2023-08-09T12:48:46.958261+0000","last_active":"2023-08-09T12:48:46.958544+0000","last_peered":"2023-08-09T12:48:46.958544+0000","last_clean":"2023-08-09T12:48:46.958544+0000","last_became_active":"2023-08-09T12:48:46.957807+0000","last_became_peered":"2023-08-09T12:48:46.957807+0000","last_unstale":"2023-08-09T12:48:46.958544+0000","last_undegraded":"2023-08-09T12:48:46.958544+0000","last_fullsized":"2023-08-09T12:48:46.958544+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:33:09.426318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962928+0000","last_change":"2023-08-09T12:48:46.962514+0000","last_active":"2023-08-09T12:48:46.962928+0000","last_peered":"2023-08-09T12:48:46.962928+0000","last_clean":"2023-08-09T12:48:46.962928+0000","last_became_active":"2023-08-09T12:48:46.961600+0000","last_became_peered":"2023-08-09T12:48:46.961600+0000","last_unstale":"2023-08-09T12:48:46.962928+0000","last_undegraded":"2023-08-09T12:48:46.962928+0000","last_fullsized":"2023-08-09T12:48:46.962928+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:11:37.774360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.896096+0000","last_change":"2023-08-09T12:48:45.896096+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.896096+0000","last_undegraded":"2023-08-09T12:48:45.896096+0000","last_fullsized":"2023-08-09T12:48:45.896096+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.941877+0000","last_change":"2023-08-09T12:48:46.941718+0000","last_active":"2023-08-09T12:48:46.941877+0000","last_peered":"2023-08-09T12:48:46.941877+0000","last_clean":"2023-08-09T12:48:46.941877+0000","last_became_active":"2023-08-09T12:48:46.939246+0000","last_became_peered":"2023-08-09T12:48:46.939246+0000","last_unstale":"2023-08-09T12:48:46.941877+0000","last_undegraded":"2023-08-09T12:48:46.941877+0000","last_fullsized":"2023-08-09T12:48:46.941877+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:48:02.414553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.955621+0000","last_change":"2023-08-09T12:48:46.955542+0000","last_active":"2023-08-09T12:48:46.955621+0000","last_peered":"2023-08-09T12:48:46.955621+0000","last_clean":"2023-08-09T12:48:46.955621+0000","last_became_active":"2023-08-09T12:48:46.955219+0000","last_became_peered":"2023-08-09T12:48:46.955219+0000","last_unstale":"2023-08-09T12:48:46.955621+0000","last_undegraded":"2023-08-09T12:48:46.955621+0000","last_fullsized":"2023-08-09T12:48:46.955621+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:32.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.895523+0000","last_change":"2023-08-09T12:48:45.895523+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.895523+0000","last_undegraded":"2023-08-09T12:48:45.895523+0000","last_fullsized":"2023-08-09T12:48:45.895523+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887549+0000","last_change":"2023-08-09T12:48:45.887549+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887549+0000","last_undegraded":"2023-08-09T12:48:45.887549+0000","last_fullsized":"2023-08-09T12:48:45.887549+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.953832+0000","last_change":"2023-08-09T12:48:46.953736+0000","last_active":"2023-08-09T12:48:46.953832+0000","last_peered":"2023-08-09T12:48:46.953832+0000","last_clean":"2023-08-09T12:48:46.953832+0000","last_became_active":"2023-08-09T12:48:46.953362+0000","last_became_peered":"2023-08-09T12:48:46.953362+0000","last_unstale":"2023-08-09T12:48:46.953832+0000","last_undegraded":"2023-08-09T12:48:46.953832+0000","last_fullsized":"2023-08-09T12:48:46.953832+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:22:54.700195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.966605+0000","last_change":"2023-08-09T12:48:46.965972+0000","last_active":"2023-08-09T12:48:46.966605+0000","last_peered":"2023-08-09T12:48:46.966605+0000","last_clean":"2023-08-09T12:48:46.966605+0000","last_became_active":"2023-08-09T12:48:46.965713+0000","last_became_peered":"2023-08-09T12:48:46.965713+0000","last_unstale":"2023-08-09T12:48:46.966605+0000","last_undegraded":"2023-08-09T12:48:46.966605+0000","last_fullsized":"2023-08-09T12:48:46.966605+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:50:11.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.898244+0000","last_change":"2023-08-09T12:48:45.898244+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.898244+0000","last_undegraded":"2023-08-09T12:48:45.898244+0000","last_fullsized":"2023-08-09T12:48:45.898244+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937415+0000","last_change":"2023-08-09T12:48:46.937286+0000","last_active":"2023-08-09T12:48:46.937415+0000","last_peered":"2023-08-09T12:48:46.937415+0000","last_clean":"2023-08-09T12:48:46.937415+0000","last_became_active":"2023-08-09T12:48:46.936728+0000","last_became_peered":"2023-08-09T12:48:46.936728+0000","last_unstale":"2023-08-09T12:48:46.937415+0000","last_undegraded":"2023-08-09T12:48:46.937415+0000","last_fullsized":"2023-08-09T12:48:46.937415+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:28:00.860493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.936223+0000","last_change":"2023-08-09T12:48:46.936044+0000","last_active":"2023-08-09T12:48:46.936223+0000","last_peered":"2023-08-09T12:48:46.936223+0000","last_clean":"2023-08-09T12:48:46.936223+0000","last_became_active":"2023-08-09T12:48:46.935618+0000","last_became_peered":"2023-08-09T12:48:46.935618+0000","last_unstale":"2023-08-09T12:48:46.936223+0000","last_undegraded":"2023-08-09T12:48:46.936223+0000","last_fullsized":"2023-08-09T12:48:46.936223+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:47:07.896841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.895333+0000","last_change":"2023-08-09T12:48:45.895333+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.895333+0000","last_undegraded":"2023-08-09T12:48:45.895333+0000","last_fullsized":"2023-08-09T12:48:45.895333+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.892317+0000","last_change":"2023-08-09T12:48:45.892317+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.892317+0000","last_undegraded":"2023-08-09T12:48:45.892317+0000","last_fullsized":"2023-08-09T12:48:45.892317+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.960418+0000","last_change":"2023-08-09T12:48:46.960291+0000","last_active":"2023-08-09T12:48:46.960418+0000","last_peered":"2023-08-09T12:48:46.960418+0000","last_clean":"2023-08-09T12:48:46.960418+0000","last_became_active":"2023-08-09T12:48:46.959860+0000","last_became_peered":"2023-08-09T12:48:46.959860+0000","last_unstale":"2023-08-09T12:48:46.960418+0000","last_undegraded":"2023-08-09T12:48:46.960418+0000","last_fullsized":"2023-08-09T12:48:46.960418+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:54:25.433825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.935973+0000","last_change":"2023-08-09T12:48:46.935857+0000","last_active":"2023-08-09T12:48:46.935973+0000","last_peered":"2023-08-09T12:48:46.935973+0000","last_clean":"2023-08-09T12:48:46.935973+0000","last_became_active":"2023-08-09T12:48:46.935257+0000","last_became_peered":"2023-08-09T12:48:46.935257+0000","last_unstale":"2023-08-09T12:48:46.935973+0000","last_undegraded":"2023-08-09T12:48:46.935973+0000","last_fullsized":"2023-08-09T12:48:46.935973+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:32:02.852951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962892+0000","last_change":"2023-08-09T12:48:46.962333+0000","last_active":"2023-08-09T12:48:46.962892+0000","last_peered":"2023-08-09T12:48:46.962892+0000","last_clean":"2023-08-09T12:48:46.962892+0000","last_became_active":"2023-08-09T12:48:46.961277+0000","last_became_peered":"2023-08-09T12:48:46.961277+0000","last_unstale":"2023-08-09T12:48:46.962892+0000","last_undegraded":"2023-08-09T12:48:46.962892+0000","last_fullsized":"2023-08-09T12:48:46.962892+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:29.770394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959066+0000","last_change":"2023-08-09T12:48:46.958963+0000","last_active":"2023-08-09T12:48:46.959066+0000","last_peered":"2023-08-09T12:48:46.959066+0000","last_clean":"2023-08-09T12:48:46.959066+0000","last_became_active":"2023-08-09T12:48:46.958625+0000","last_became_peered":"2023-08-09T12:48:46.958625+0000","last_unstale":"2023-08-09T12:48:46.959066+0000","last_undegraded":"2023-08-09T12:48:46.959066+0000","last_fullsized":"2023-08-09T12:48:46.959066+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:27:08.669914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.965127+0000","last_change":"2023-08-09T12:48:46.965018+0000","last_active":"2023-08-09T12:48:46.965127+0000","last_peered":"2023-08-09T12:48:46.965127+0000","last_clean":"2023-08-09T12:48:46.965127+0000","last_became_active":"2023-08-09T12:48:46.963886+0000","last_became_peered":"2023-08-09T12:48:46.963886+0000","last_unstale":"2023-08-09T12:48:46.965127+0000","last_undegraded":"2023-08-09T12:48:46.965127+0000","last_fullsized":"2023-08-09T12:48:46.965127+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:53.292466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952938+0000","last_change":"2023-08-09T12:48:46.952852+0000","last_active":"2023-08-09T12:48:46.952938+0000","last_peered":"2023-08-09T12:48:46.952938+0000","last_clean":"2023-08-09T12:48:46.952938+0000","last_became_active":"2023-08-09T12:48:46.952361+0000","last_became_peered":"2023-08-09T12:48:46.952361+0000","last_unstale":"2023-08-09T12:48:46.952938+0000","last_undegraded":"2023-08-09T12:48:46.952938+0000","last_fullsized":"2023-08-09T12:48:46.952938+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:40.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.894654+0000","last_change":"2023-08-09T12:48:45.894654+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.894654+0000","last_undegraded":"2023-08-09T12:48:45.894654+0000","last_fullsized":"2023-08-09T12:48:45.894654+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.939548+0000","last_change":"2023-08-09T12:48:46.939417+0000","last_active":"2023-08-09T12:48:46.939548+0000","last_peered":"2023-08-09T12:48:46.939548+0000","last_clean":"2023-08-09T12:48:46.939548+0000","last_became_active":"2023-08-09T12:48:46.938512+0000","last_became_peered":"2023-08-09T12:48:46.938512+0000","last_unstale":"2023-08-09T12:48:46.939548+0000","last_undegraded":"2023-08-09T12:48:46.939548+0000","last_fullsized":"2023-08-09T12:48:46.939548+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:30:43.335439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937693+0000","last_change":"2023-08-09T12:48:46.937004+0000","last_active":"2023-08-09T12:48:46.937693+0000","last_peered":"2023-08-09T12:48:46.937693+0000","last_clean":"2023-08-09T12:48:46.937693+0000","last_became_active":"2023-08-09T12:48:46.936557+0000","last_became_peered":"2023-08-09T12:48:46.936557+0000","last_unstale":"2023-08-09T12:48:46.937693+0000","last_undegraded":"2023-08-09T12:48:46.937693+0000","last_fullsized":"2023-08-09T12:48:46.937693+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:58:08.137503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944480+0000","last_change":"2023-08-09T12:48:46.944383+0000","last_active":"2023-08-09T12:48:46.944480+0000","last_peered":"2023-08-09T12:48:46.944480+0000","last_clean":"2023-08-09T12:48:46.944480+0000","last_became_active":"2023-08-09T12:48:46.944042+0000","last_became_peered":"2023-08-09T12:48:46.944042+0000","last_unstale":"2023-08-09T12:48:46.944480+0000","last_undegraded":"2023-08-09T12:48:46.944480+0000","last_fullsized":"2023-08-09T12:48:46.944480+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:44.152926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888878+0000","last_change":"2023-08-09T12:48:45.888878+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888878+0000","last_undegraded":"2023-08-09T12:48:45.888878+0000","last_fullsized":"2023-08-09T12:48:45.888878+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954946+0000","last_change":"2023-08-09T12:48:46.954814+0000","last_active":"2023-08-09T12:48:46.954946+0000","last_peered":"2023-08-09T12:48:46.954946+0000","last_clean":"2023-08-09T12:48:46.954946+0000","last_became_active":"2023-08-09T12:48:46.954498+0000","last_became_peered":"2023-08-09T12:48:46.954498+0000","last_unstale":"2023-08-09T12:48:46.954946+0000","last_undegraded":"2023-08-09T12:48:46.954946+0000","last_fullsized":"2023-08-09T12:48:46.954946+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:02.941006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.939840+0000","last_change":"2023-08-09T12:48:46.939726+0000","last_active":"2023-08-09T12:48:46.939840+0000","last_peered":"2023-08-09T12:48:46.939840+0000","last_clean":"2023-08-09T12:48:46.939840+0000","last_became_active":"2023-08-09T12:48:46.939036+0000","last_became_peered":"2023-08-09T12:48:46.939036+0000","last_unstale":"2023-08-09T12:48:46.939840+0000","last_undegraded":"2023-08-09T12:48:46.939840+0000","last_fullsized":"2023-08-09T12:48:46.939840+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:56.191819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944168+0000","last_change":"2023-08-09T12:48:46.944030+0000","last_active":"2023-08-09T12:48:46.944168+0000","last_peered":"2023-08-09T12:48:46.944168+0000","last_clean":"2023-08-09T12:48:46.944168+0000","last_became_active":"2023-08-09T12:48:46.943711+0000","last_became_peered":"2023-08-09T12:48:46.943711+0000","last_unstale":"2023-08-09T12:48:46.944168+0000","last_undegraded":"2023-08-09T12:48:46.944168+0000","last_fullsized":"2023-08-09T12:48:46.944168+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:51:21.571300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888362+0000","last_change":"2023-08-09T12:48:45.888362+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888362+0000","last_undegraded":"2023-08-09T12:48:45.888362+0000","last_fullsized":"2023-08-09T12:48:45.888362+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937260+0000","last_change":"2023-08-09T12:48:46.937096+0000","last_active":"2023-08-09T12:48:46.937260+0000","last_peered":"2023-08-09T12:48:46.937260+0000","last_clean":"2023-08-09T12:48:46.937260+0000","last_became_active":"2023-08-09T12:48:46.936636+0000","last_became_peered":"2023-08-09T12:48:46.936636+0000","last_unstale":"2023-08-09T12:48:46.937260+0000","last_undegraded":"2023-08-09T12:48:46.937260+0000","last_fullsized":"2023-08-09T12:48:46.937260+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:51:22.190862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"160'4","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978417+0000","last_change":"2023-08-09T12:48:45.895190+0000","last_active":"2023-08-09T12:48:46.978417+0000","last_peered":"2023-08-09T12:48:46.978417+0000","last_clean":"2023-08-09T12:48:46.978417+0000","last_became_active":"2023-08-09T12:48:45.894548+0000","last_became_peered":"2023-08-09T12:48:45.894548+0000","last_unstale":"2023-08-09T12:48:46.978417+0000","last_undegraded":"2023-08-09T12:48:46.978417+0000","last_fullsized":"2023-08-09T12:48:46.978417+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:39:20.689668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.963435+0000","last_change":"2023-08-09T12:48:46.963254+0000","last_active":"2023-08-09T12:48:46.963435+0000","last_peered":"2023-08-09T12:48:46.963435+0000","last_clean":"2023-08-09T12:48:46.963435+0000","last_became_active":"2023-08-09T12:48:46.962887+0000","last_became_peered":"2023-08-09T12:48:46.962887+0000","last_unstale":"2023-08-09T12:48:46.963435+0000","last_undegraded":"2023-08-09T12:48:46.963435+0000","last_fullsized":"2023-08-09T12:48:46.963435+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:42.174030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978163+0000","last_change":"2023-08-09T12:48:45.912443+0000","last_active":"2023-08-09T12:48:46.978163+0000","last_peered":"2023-08-09T12:48:46.978163+0000","last_clean":"2023-08-09T12:48:46.978163+0000","last_became_active":"2023-08-09T12:48:45.912042+0000","last_became_peered":"2023-08-09T12:48:45.912042+0000","last_unstale":"2023-08-09T12:48:46.978163+0000","last_undegraded":"2023-08-09T12:48:46.978163+0000","last_fullsized":"2023-08-09T12:48:46.978163+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:48:00.932200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952804+0000","last_change":"2023-08-09T12:48:46.952678+0000","last_active":"2023-08-09T12:48:46.952804+0000","last_peered":"2023-08-09T12:48:46.952804+0000","last_clean":"2023-08-09T12:48:46.952804+0000","last_became_active":"2023-08-09T12:48:46.951843+0000","last_became_peered":"2023-08-09T12:48:46.951843+0000","last_unstale":"2023-08-09T12:48:46.952804+0000","last_undegraded":"2023-08-09T12:48:46.952804+0000","last_fullsized":"2023-08-09T12:48:46.952804+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:04.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978620+0000","last_change":"2023-08-09T12:48:45.912974+0000","last_active":"2023-08-09T12:48:46.978620+0000","last_peered":"2023-08-09T12:48:46.978620+0000","last_clean":"2023-08-09T12:48:46.978620+0000","last_became_active":"2023-08-09T12:48:45.912770+0000","last_became_peered":"2023-08-09T12:48:45.912770+0000","last_unstale":"2023-08-09T12:48:46.978620+0000","last_undegraded":"2023-08-09T12:48:46.978620+0000","last_fullsized":"2023-08-09T12:48:46.978620+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:42.482449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.934977+0000","last_change":"2023-08-09T12:48:46.934802+0000","last_active":"2023-08-09T12:48:46.934977+0000","last_peered":"2023-08-09T12:48:46.934977+0000","last_clean":"2023-08-09T12:48:46.934977+0000","last_became_active":"2023-08-09T12:48:46.934325+0000","last_became_peered":"2023-08-09T12:48:46.934325+0000","last_unstale":"2023-08-09T12:48:46.934977+0000","last_undegraded":"2023-08-09T12:48:46.934977+0000","last_fullsized":"2023-08-09T12:48:46.934977+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:16:25.400011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978272+0000","last_change":"2023-08-09T12:48:45.906701+0000","last_active":"2023-08-09T12:48:46.978272+0000","last_peered":"2023-08-09T12:48:46.978272+0000","last_clean":"2023-08-09T12:48:46.978272+0000","last_became_active":"2023-08-09T12:48:45.906397+0000","last_became_peered":"2023-08-09T12:48:45.906397+0000","last_unstale":"2023-08-09T12:48:46.978272+0000","last_undegraded":"2023-08-09T12:48:46.978272+0000","last_fullsized":"2023-08-09T12:48:46.978272+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:10.779720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.947557+0000","last_change":"2023-08-09T12:48:46.947241+0000","last_active":"2023-08-09T12:48:46.947557+0000","last_peered":"2023-08-09T12:48:46.947557+0000","last_clean":"2023-08-09T12:48:46.947557+0000","last_became_active":"2023-08-09T12:48:46.946611+0000","last_became_peered":"2023-08-09T12:48:46.946611+0000","last_unstale":"2023-08-09T12:48:46.947557+0000","last_undegraded":"2023-08-09T12:48:46.947557+0000","last_fullsized":"2023-08-09T12:48:46.947557+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:47.916737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977117+0000","last_change":"2023-08-09T12:48:45.904761+0000","last_active":"2023-08-09T12:48:46.977117+0000","last_peered":"2023-08-09T12:48:46.977117+0000","last_clean":"2023-08-09T12:48:46.977117+0000","last_became_active":"2023-08-09T12:48:45.904258+0000","last_became_peered":"2023-08-09T12:48:45.904258+0000","last_unstale":"2023-08-09T12:48:46.977117+0000","last_undegraded":"2023-08-09T12:48:46.977117+0000","last_fullsized":"2023-08-09T12:48:46.977117+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:58:11.511623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959998+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:46.959998+0000","last_peered":"2023-08-09T12:48:46.959998+0000","last_clean":"2023-08-09T12:48:46.959998+0000","last_became_active":"2023-08-09T12:48:46.959290+0000","last_became_peered":"2023-08-09T12:48:46.959290+0000","last_unstale":"2023-08-09T12:48:46.959998+0000","last_undegraded":"2023-08-09T12:48:46.959998+0000","last_fullsized":"2023-08-09T12:48:46.959998+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:09:19.355636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978501+0000","last_change":"2023-08-09T12:48:45.907778+0000","last_active":"2023-08-09T12:48:46.978501+0000","last_peered":"2023-08-09T12:48:46.978501+0000","last_clean":"2023-08-09T12:48:46.978501+0000","last_became_active":"2023-08-09T12:48:45.907326+0000","last_became_peered":"2023-08-09T12:48:45.907326+0000","last_unstale":"2023-08-09T12:48:46.978501+0000","last_undegraded":"2023-08-09T12:48:46.978501+0000","last_fullsized":"2023-08-09T12:48:46.978501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:37:02.238431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.963265+0000","last_change":"2023-08-09T12:48:46.963125+0000","last_active":"2023-08-09T12:48:46.963265+0000","last_peered":"2023-08-09T12:48:46.963265+0000","last_clean":"2023-08-09T12:48:46.963265+0000","last_became_active":"2023-08-09T12:48:46.955577+0000","last_became_peered":"2023-08-09T12:48:46.955577+0000","last_unstale":"2023-08-09T12:48:46.963265+0000","last_undegraded":"2023-08-09T12:48:46.963265+0000","last_fullsized":"2023-08-09T12:48:46.963265+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:33:51.801770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.912917+0000","last_change":"2023-08-09T12:48:45.912814+0000","last_active":"2023-08-09T12:48:45.912917+0000","last_peered":"2023-08-09T12:48:45.912917+0000","last_clean":"2023-08-09T12:48:45.912917+0000","last_became_active":"2023-08-09T12:48:45.911537+0000","last_became_peered":"2023-08-09T12:48:45.911537+0000","last_unstale":"2023-08-09T12:48:45.912917+0000","last_undegraded":"2023-08-09T12:48:45.912917+0000","last_fullsized":"2023-08-09T12:48:45.912917+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:10:39.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.945274+0000","last_change":"2023-08-09T12:48:46.945168+0000","last_active":"2023-08-09T12:48:46.945274+0000","last_peered":"2023-08-09T12:48:46.945274+0000","last_clean":"2023-08-09T12:48:46.945274+0000","last_became_active":"2023-08-09T12:48:46.944925+0000","last_became_peered":"2023-08-09T12:48:46.944925+0000","last_unstale":"2023-08-09T12:48:46.945274+0000","last_undegraded":"2023-08-09T12:48:46.945274+0000","last_fullsized":"2023-08-09T12:48:46.945274+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:27:53.915770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.930735+0000","last_change":"2023-08-09T12:48:45.912104+0000","last_active":"2023-08-09T12:48:46.930735+0000","last_peered":"2023-08-09T12:48:46.930735+0000","last_clean":"2023-08-09T12:48:46.930735+0000","last_became_active":"2023-08-09T12:48:45.911841+0000","last_became_peered":"2023-08-09T12:48:45.911841+0000","last_unstale":"2023-08-09T12:48:46.930735+0000","last_undegraded":"2023-08-09T12:48:46.930735+0000","last_fullsized":"2023-08-09T12:48:46.930735+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:18:14.246123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961679+0000","last_change":"2023-08-09T12:48:46.961576+0000","last_active":"2023-08-09T12:48:46.961679+0000","last_peered":"2023-08-09T12:48:46.961679+0000","last_clean":"2023-08-09T12:48:46.961679+0000","last_became_active":"2023-08-09T12:48:46.961193+0000","last_became_peered":"2023-08-09T12:48:46.961193+0000","last_unstale":"2023-08-09T12:48:46.961679+0000","last_undegraded":"2023-08-09T12:48:46.961679+0000","last_fullsized":"2023-08-09T12:48:46.961679+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:29:13.189094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.976856+0000","last_change":"2023-08-09T12:48:45.912029+0000","last_active":"2023-08-09T12:48:46.976856+0000","last_peered":"2023-08-09T12:48:46.976856+0000","last_clean":"2023-08-09T12:48:46.976856+0000","last_became_active":"2023-08-09T12:48:45.911596+0000","last_became_peered":"2023-08-09T12:48:45.911596+0000","last_unstale":"2023-08-09T12:48:46.976856+0000","last_undegraded":"2023-08-09T12:48:46.976856+0000","last_fullsized":"2023-08-09T12:48:46.976856+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:30:03.806678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962802+0000","last_change":"2023-08-09T12:48:46.962725+0000","last_active":"2023-08-09T12:48:46.962802+0000","last_peered":"2023-08-09T12:48:46.962802+0000","last_clean":"2023-08-09T12:48:46.962802+0000","last_became_active":"2023-08-09T12:48:46.962525+0000","last_became_peered":"2023-08-09T12:48:46.962525+0000","last_unstale":"2023-08-09T12:48:46.962802+0000","last_undegraded":"2023-08-09T12:48:46.962802+0000","last_fullsized":"2023-08-09T12:48:46.962802+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:40:02.104275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977861+0000","last_change":"2023-08-09T12:48:45.898690+0000","last_active":"2023-08-09T12:48:46.977861+0000","last_peered":"2023-08-09T12:48:46.977861+0000","last_clean":"2023-08-09T12:48:46.977861+0000","last_became_active":"2023-08-09T12:48:45.898044+0000","last_became_peered":"2023-08-09T12:48:45.898044+0000","last_unstale":"2023-08-09T12:48:46.977861+0000","last_undegraded":"2023-08-09T12:48:46.977861+0000","last_fullsized":"2023-08-09T12:48:46.977861+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:46:10.974195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950459+0000","last_change":"2023-08-09T12:48:46.949845+0000","last_active":"2023-08-09T12:48:46.950459+0000","last_peered":"2023-08-09T12:48:46.950459+0000","last_clean":"2023-08-09T12:48:46.950459+0000","last_became_active":"2023-08-09T12:48:46.949387+0000","last_became_peered":"2023-08-09T12:48:46.949387+0000","last_unstale":"2023-08-09T12:48:46.950459+0000","last_undegraded":"2023-08-09T12:48:46.950459+0000","last_fullsized":"2023-08-09T12:48:46.950459+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:25:45.202659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.914397+0000","last_change":"2023-08-09T12:48:45.914299+0000","last_active":"2023-08-09T12:48:45.914397+0000","last_peered":"2023-08-09T12:48:45.914397+0000","last_clean":"2023-08-09T12:48:45.914397+0000","last_became_active":"2023-08-09T12:48:45.913540+0000","last_became_peered":"2023-08-09T12:48:45.913540+0000","last_unstale":"2023-08-09T12:48:45.914397+0000","last_undegraded":"2023-08-09T12:48:45.914397+0000","last_fullsized":"2023-08-09T12:48:45.914397+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:49:19.826988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888002+0000","last_change":"2023-08-09T12:48:45.888002+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888002+0000","last_undegraded":"2023-08-09T12:48:45.888002+0000","last_fullsized":"2023-08-09T12:48:45.888002+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.958664+0000","last_change":"2023-08-09T12:48:45.913084+0000","last_active":"2023-08-09T12:48:46.958664+0000","last_peered":"2023-08-09T12:48:46.958664+0000","last_clean":"2023-08-09T12:48:46.958664+0000","last_became_active":"2023-08-09T12:48:45.912811+0000","last_became_peered":"2023-08-09T12:48:45.912811+0000","last_unstale":"2023-08-09T12:48:46.958664+0000","last_undegraded":"2023-08-09T12:48:46.958664+0000","last_fullsized":"2023-08-09T12:48:46.958664+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:27:48.322806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.966820+0000","last_change":"2023-08-09T12:48:46.966736+0000","last_active":"2023-08-09T12:48:46.966820+0000","last_peered":"2023-08-09T12:48:46.966820+0000","last_clean":"2023-08-09T12:48:46.966820+0000","last_became_active":"2023-08-09T12:48:46.966391+0000","last_became_peered":"2023-08-09T12:48:46.966391+0000","last_unstale":"2023-08-09T12:48:46.966820+0000","last_undegraded":"2023-08-09T12:48:46.966820+0000","last_fullsized":"2023-08-09T12:48:46.966820+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:03:52.085522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978238+0000","last_change":"2023-08-09T12:48:45.903454+0000","last_active":"2023-08-09T12:48:46.978238+0000","last_peered":"2023-08-09T12:48:46.978238+0000","last_clean":"2023-08-09T12:48:46.978238+0000","last_became_active":"2023-08-09T12:48:45.901990+0000","last_became_peered":"2023-08-09T12:48:45.901990+0000","last_unstale":"2023-08-09T12:48:46.978238+0000","last_undegraded":"2023-08-09T12:48:46.978238+0000","last_fullsized":"2023-08-09T12:48:46.978238+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:48:20.785574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.935251+0000","last_change":"2023-08-09T12:48:46.935102+0000","last_active":"2023-08-09T12:48:46.935251+0000","last_peered":"2023-08-09T12:48:46.935251+0000","last_clean":"2023-08-09T12:48:46.935251+0000","last_became_active":"2023-08-09T12:48:46.934483+0000","last_became_peered":"2023-08-09T12:48:46.934483+0000","last_unstale":"2023-08-09T12:48:46.935251+0000","last_undegraded":"2023-08-09T12:48:46.935251+0000","last_fullsized":"2023-08-09T12:48:46.935251+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:51:03.089254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.931154+0000","last_change":"2023-08-09T12:48:45.909979+0000","last_active":"2023-08-09T12:48:46.931154+0000","last_peered":"2023-08-09T12:48:46.931154+0000","last_clean":"2023-08-09T12:48:46.931154+0000","last_became_active":"2023-08-09T12:48:45.909318+0000","last_became_peered":"2023-08-09T12:48:45.909318+0000","last_unstale":"2023-08-09T12:48:46.931154+0000","last_undegraded":"2023-08-09T12:48:46.931154+0000","last_fullsized":"2023-08-09T12:48:46.931154+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:09.939517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962865+0000","last_change":"2023-08-09T12:48:46.961941+0000","last_active":"2023-08-09T12:48:46.962865+0000","last_peered":"2023-08-09T12:48:46.962865+0000","last_clean":"2023-08-09T12:48:46.962865+0000","last_became_active":"2023-08-09T12:48:46.959507+0000","last_became_peered":"2023-08-09T12:48:46.959507+0000","last_unstale":"2023-08-09T12:48:46.962865+0000","last_undegraded":"2023-08-09T12:48:46.962865+0000","last_fullsized":"2023-08-09T12:48:46.962865+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:09:01.457240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.924102+0000","last_change":"2023-08-09T12:48:45.906050+0000","last_active":"2023-08-09T12:48:46.924102+0000","last_peered":"2023-08-09T12:48:46.924102+0000","last_clean":"2023-08-09T12:48:46.924102+0000","last_became_active":"2023-08-09T12:48:45.905750+0000","last_became_peered":"2023-08-09T12:48:45.905750+0000","last_unstale":"2023-08-09T12:48:46.924102+0000","last_undegraded":"2023-08-09T12:48:46.924102+0000","last_fullsized":"2023-08-09T12:48:46.924102+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:28.690148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952782+0000","last_change":"2023-08-09T12:48:46.952499+0000","last_active":"2023-08-09T12:48:46.952782+0000","last_peered":"2023-08-09T12:48:46.952782+0000","last_clean":"2023-08-09T12:48:46.952782+0000","last_became_active":"2023-08-09T12:48:46.951915+0000","last_became_peered":"2023-08-09T12:48:46.951915+0000","last_unstale":"2023-08-09T12:48:46.952782+0000","last_undegraded":"2023-08-09T12:48:46.952782+0000","last_fullsized":"2023-08-09T12:48:46.952782+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:29.740823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911553+0000","last_change":"2023-08-09T12:48:45.904623+0000","last_active":"2023-08-09T12:48:45.911553+0000","last_peered":"2023-08-09T12:48:45.911553+0000","last_clean":"2023-08-09T12:48:45.911553+0000","last_became_active":"2023-08-09T12:48:45.904073+0000","last_became_peered":"2023-08-09T12:48:45.904073+0000","last_unstale":"2023-08-09T12:48:45.911553+0000","last_undegraded":"2023-08-09T12:48:45.911553+0000","last_fullsized":"2023-08-09T12:48:45.911553+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:45:41.792268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961768+0000","last_change":"2023-08-09T12:48:46.961129+0000","last_active":"2023-08-09T12:48:46.961768+0000","last_peered":"2023-08-09T12:48:46.961768+0000","last_clean":"2023-08-09T12:48:46.961768+0000","last_became_active":"2023-08-09T12:48:46.954671+0000","last_became_peered":"2023-08-09T12:48:46.954671+0000","last_unstale":"2023-08-09T12:48:46.961768+0000","last_undegraded":"2023-08-09T12:48:46.961768+0000","last_fullsized":"2023-08-09T12:48:46.961768+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:51:15.293415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978038+0000","last_change":"2023-08-09T12:48:45.900760+0000","last_active":"2023-08-09T12:48:46.978038+0000","last_peered":"2023-08-09T12:48:46.978038+0000","last_clean":"2023-08-09T12:48:46.978038+0000","last_became_active":"2023-08-09T12:48:45.899103+0000","last_became_peered":"2023-08-09T12:48:45.899103+0000","last_unstale":"2023-08-09T12:48:46.978038+0000","last_undegraded":"2023-08-09T12:48:46.978038+0000","last_fullsized":"2023-08-09T12:48:46.978038+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:03:34.437537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959693+0000","last_change":"2023-08-09T12:48:46.959599+0000","last_active":"2023-08-09T12:48:46.959693+0000","last_peered":"2023-08-09T12:48:46.959693+0000","last_clean":"2023-08-09T12:48:46.959693+0000","last_became_active":"2023-08-09T12:48:46.959283+0000","last_became_peered":"2023-08-09T12:48:46.959283+0000","last_unstale":"2023-08-09T12:48:46.959693+0000","last_undegraded":"2023-08-09T12:48:46.959693+0000","last_fullsized":"2023-08-09T12:48:46.959693+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:16.463734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.928975+0000","last_change":"2023-08-09T12:48:45.910936+0000","last_active":"2023-08-09T12:48:46.928975+0000","last_peered":"2023-08-09T12:48:46.928975+0000","last_clean":"2023-08-09T12:48:46.928975+0000","last_became_active":"2023-08-09T12:48:45.910460+0000","last_became_peered":"2023-08-09T12:48:45.910460+0000","last_unstale":"2023-08-09T12:48:46.928975+0000","last_undegraded":"2023-08-09T12:48:46.928975+0000","last_fullsized":"2023-08-09T12:48:46.928975+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:53:54.231683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.942981+0000","last_change":"2023-08-09T12:48:46.942752+0000","last_active":"2023-08-09T12:48:46.942981+0000","last_peered":"2023-08-09T12:48:46.942981+0000","last_clean":"2023-08-09T12:48:46.942981+0000","last_became_active":"2023-08-09T12:48:46.941039+0000","last_became_peered":"2023-08-09T12:48:46.941039+0000","last_unstale":"2023-08-09T12:48:46.942981+0000","last_undegraded":"2023-08-09T12:48:46.942981+0000","last_fullsized":"2023-08-09T12:48:46.942981+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:26:08.488438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.929590+0000","last_change":"2023-08-09T12:48:45.905909+0000","last_active":"2023-08-09T12:48:46.929590+0000","last_peered":"2023-08-09T12:48:46.929590+0000","last_clean":"2023-08-09T12:48:46.929590+0000","last_became_active":"2023-08-09T12:48:45.905567+0000","last_became_peered":"2023-08-09T12:48:45.905567+0000","last_unstale":"2023-08-09T12:48:46.929590+0000","last_undegraded":"2023-08-09T12:48:46.929590+0000","last_fullsized":"2023-08-09T12:48:46.929590+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:56.553013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887293+0000","last_change":"2023-08-09T12:48:45.887293+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887293+0000","last_undegraded":"2023-08-09T12:48:45.887293+0000","last_fullsized":"2023-08-09T12:48:45.887293+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911607+0000","last_change":"2023-08-09T12:48:45.911167+0000","last_active":"2023-08-09T12:48:45.911607+0000","last_peered":"2023-08-09T12:48:45.911607+0000","last_clean":"2023-08-09T12:48:45.911607+0000","last_became_active":"2023-08-09T12:48:45.910891+0000","last_became_peered":"2023-08-09T12:48:45.910891+0000","last_unstale":"2023-08-09T12:48:45.911607+0000","last_undegraded":"2023-08-09T12:48:45.911607+0000","last_fullsized":"2023-08-09T12:48:45.911607+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:18.953781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.892167+0000","last_change":"2023-08-09T12:48:45.892167+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.892167+0000","last_undegraded":"2023-08-09T12:48:45.892167+0000","last_fullsized":"2023-08-09T12:48:45.892167+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.951200+0000","last_change":"2023-08-09T12:48:45.910842+0000","last_active":"2023-08-09T12:48:46.951200+0000","last_peered":"2023-08-09T12:48:46.951200+0000","last_clean":"2023-08-09T12:48:46.951200+0000","last_became_active":"2023-08-09T12:48:45.910039+0000","last_became_peered":"2023-08-09T12:48:45.910039+0000","last_unstale":"2023-08-09T12:48:46.951200+0000","last_undegraded":"2023-08-09T12:48:46.951200+0000","last_fullsized":"2023-08-09T12:48:46.951200+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:19.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.893483+0000","last_change":"2023-08-09T12:48:45.893483+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.893483+0000","last_undegraded":"2023-08-09T12:48:45.893483+0000","last_fullsized":"2023-08-09T12:48:45.893483+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.928656+0000","last_change":"2023-08-09T12:48:45.907402+0000","last_active":"2023-08-09T12:48:46.928656+0000","last_peered":"2023-08-09T12:48:46.928656+0000","last_clean":"2023-08-09T12:48:46.928656+0000","last_became_active":"2023-08-09T12:48:45.906892+0000","last_became_peered":"2023-08-09T12:48:45.906892+0000","last_unstale":"2023-08-09T12:48:46.928656+0000","last_undegraded":"2023-08-09T12:48:46.928656+0000","last_fullsized":"2023-08-09T12:48:46.928656+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:58.088826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.894112+0000","last_change":"2023-08-09T12:48:45.894112+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.894112+0000","last_undegraded":"2023-08-09T12:48:45.894112+0000","last_fullsized":"2023-08-09T12:48:45.894112+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.912936+0000","last_change":"2023-08-09T12:48:45.911823+0000","last_active":"2023-08-09T12:48:45.912936+0000","last_peered":"2023-08-09T12:48:45.912936+0000","last_clean":"2023-08-09T12:48:45.912936+0000","last_became_active":"2023-08-09T12:48:45.911339+0000","last_became_peered":"2023-08-09T12:48:45.911339+0000","last_unstale":"2023-08-09T12:48:45.912936+0000","last_undegraded":"2023-08-09T12:48:45.912936+0000","last_fullsized":"2023-08-09T12:48:45.912936+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:49.711986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.942364+0000","last_change":"2023-08-09T12:48:46.942177+0000","last_active":"2023-08-09T12:48:46.942364+0000","last_peered":"2023-08-09T12:48:46.942364+0000","last_clean":"2023-08-09T12:48:46.942364+0000","last_became_active":"2023-08-09T12:48:46.940133+0000","last_became_peered":"2023-08-09T12:48:46.940133+0000","last_unstale":"2023-08-09T12:48:46.942364+0000","last_undegraded":"2023-08-09T12:48:46.942364+0000","last_fullsized":"2023-08-09T12:48:46.942364+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:41:18.263898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.953930+0000","last_change":"2023-08-09T12:48:45.909884+0000","last_active":"2023-08-09T12:48:46.953930+0000","last_peered":"2023-08-09T12:48:46.953930+0000","last_clean":"2023-08-09T12:48:46.953930+0000","last_became_active":"2023-08-09T12:48:45.909635+0000","last_became_peered":"2023-08-09T12:48:45.909635+0000","last_unstale":"2023-08-09T12:48:46.953930+0000","last_undegraded":"2023-08-09T12:48:46.953930+0000","last_fullsized":"2023-08-09T12:48:46.953930+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:26.713603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962465+0000","last_change":"2023-08-09T12:48:46.962403+0000","last_active":"2023-08-09T12:48:46.962465+0000","last_peered":"2023-08-09T12:48:46.962465+0000","last_clean":"2023-08-09T12:48:46.962465+0000","last_became_active":"2023-08-09T12:48:46.961621+0000","last_became_peered":"2023-08-09T12:48:46.961621+0000","last_unstale":"2023-08-09T12:48:46.962465+0000","last_undegraded":"2023-08-09T12:48:46.962465+0000","last_fullsized":"2023-08-09T12:48:46.962465+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:28:28.778739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.923002+0000","last_change":"2023-08-09T12:48:45.907971+0000","last_active":"2023-08-09T12:48:46.923002+0000","last_peered":"2023-08-09T12:48:46.923002+0000","last_clean":"2023-08-09T12:48:46.923002+0000","last_became_active":"2023-08-09T12:48:45.907721+0000","last_became_peered":"2023-08-09T12:48:45.907721+0000","last_unstale":"2023-08-09T12:48:46.923002+0000","last_undegraded":"2023-08-09T12:48:46.923002+0000","last_fullsized":"2023-08-09T12:48:46.923002+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:37:16.729312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":443,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.926685+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:48:46.926685+0000","last_peered":"2023-08-09T12:48:46.926685+0000","last_clean":"2023-08-09T12:48:46.926685+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:48:46.926685+0000","last_undegraded":"2023-08-09T12:48:46.926685+0000","last_fullsized":"2023-08-09T12:48:46.926685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:12.363669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.951305+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:48:46.951305+0000","last_peered":"2023-08-09T12:48:46.951305+0000","last_clean":"2023-08-09T12:48:46.951305+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:48:46.951305+0000","last_undegraded":"2023-08-09T12:48:46.951305+0000","last_fullsized":"2023-08-09T12:48:46.951305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:33.338962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954207+0000","last_change":"2023-08-09T12:48:46.953789+0000","last_active":"2023-08-09T12:48:46.954207+0000","last_peered":"2023-08-09T12:48:46.954207+0000","last_clean":"2023-08-09T12:48:46.954207+0000","last_became_active":"2023-08-09T12:48:46.953417+0000","last_became_peered":"2023-08-09T12:48:46.953417+0000","last_unstale":"2023-08-09T12:48:46.954207+0000","last_undegraded":"2023-08-09T12:48:46.954207+0000","last_fullsized":"2023-08-09T12:48:46.954207+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:24:58.657906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.927702+0000","last_change":"2023-08-09T12:48:45.907769+0000","last_active":"2023-08-09T12:48:46.927702+0000","last_peered":"2023-08-09T12:48:46.927702+0000","last_clean":"2023-08-09T12:48:46.927702+0000","last_became_active":"2023-08-09T12:48:45.906964+0000","last_became_peered":"2023-08-09T12:48:45.906964+0000","last_unstale":"2023-08-09T12:48:46.927702+0000","last_undegraded":"2023-08-09T12:48:46.927702+0000","last_fullsized":"2023-08-09T12:48:46.927702+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:08.623403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":287,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.926355+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:48:46.926355+0000","last_peered":"2023-08-09T12:48:46.926355+0000","last_clean":"2023-08-09T12:48:46.926355+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:48:46.926355+0000","last_undegraded":"2023-08-09T12:48:46.926355+0000","last_fullsized":"2023-08-09T12:48:46.926355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:43:49.173542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.968921+0000","last_change":"2023-08-09T12:48:46.968109+0000","last_active":"2023-08-09T12:48:46.968921+0000","last_peered":"2023-08-09T12:48:46.968921+0000","last_clean":"2023-08-09T12:48:46.968921+0000","last_became_active":"2023-08-09T12:48:46.967751+0000","last_became_peered":"2023-08-09T12:48:46.967751+0000","last_unstale":"2023-08-09T12:48:46.968921+0000","last_undegraded":"2023-08-09T12:48:46.968921+0000","last_fullsized":"2023-08-09T12:48:46.968921+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:13.639064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911733+0000","last_change":"2023-08-09T12:48:45.911662+0000","last_active":"2023-08-09T12:48:45.911733+0000","last_peered":"2023-08-09T12:48:45.911733+0000","last_clean":"2023-08-09T12:48:45.911733+0000","last_became_active":"2023-08-09T12:48:45.910793+0000","last_became_peered":"2023-08-09T12:48:45.910793+0000","last_unstale":"2023-08-09T12:48:45.911733+0000","last_undegraded":"2023-08-09T12:48:45.911733+0000","last_fullsized":"2023-08-09T12:48:45.911733+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:38.651036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.929950+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:48:46.929950+0000","last_peered":"2023-08-09T12:48:46.929950+0000","last_clean":"2023-08-09T12:48:46.929950+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:48:46.929950+0000","last_undegraded":"2023-08-09T12:48:46.929950+0000","last_fullsized":"2023-08-09T12:48:46.929950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:59:05.444945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887432+0000","last_change":"2023-08-09T12:48:45.887432+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887432+0000","last_undegraded":"2023-08-09T12:48:45.887432+0000","last_fullsized":"2023-08-09T12:48:45.887432+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977566+0000","last_change":"2023-08-09T12:48:45.889867+0000","last_active":"2023-08-09T12:48:46.977566+0000","last_peered":"2023-08-09T12:48:46.977566+0000","last_clean":"2023-08-09T12:48:46.977566+0000","last_became_active":"2023-08-09T12:48:45.889203+0000","last_became_peered":"2023-08-09T12:48:45.889203+0000","last_unstale":"2023-08-09T12:48:46.977566+0000","last_undegraded":"2023-08-09T12:48:46.977566+0000","last_fullsized":"2023-08-09T12:48:46.977566+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:22:25.084122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950924+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:48:46.950924+0000","last_peered":"2023-08-09T12:48:46.950924+0000","last_clean":"2023-08-09T12:48:46.950924+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:48:46.950924+0000","last_undegraded":"2023-08-09T12:48:46.950924+0000","last_fullsized":"2023-08-09T12:48:46.950924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:56.473393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954925+0000","last_change":"2023-08-09T12:48:46.954804+0000","last_active":"2023-08-09T12:48:46.954925+0000","last_peered":"2023-08-09T12:48:46.954925+0000","last_clean":"2023-08-09T12:48:46.954925+0000","last_became_active":"2023-08-09T12:48:46.954030+0000","last_became_peered":"2023-08-09T12:48:46.954030+0000","last_unstale":"2023-08-09T12:48:46.954925+0000","last_undegraded":"2023-08-09T12:48:46.954925+0000","last_fullsized":"2023-08-09T12:48:46.954925+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:49.911558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"160'3","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978359+0000","last_change":"2023-08-09T12:48:45.904271+0000","last_active":"2023-08-09T12:48:46.978359+0000","last_peered":"2023-08-09T12:48:46.978359+0000","last_clean":"2023-08-09T12:48:46.978359+0000","last_became_active":"2023-08-09T12:48:45.903570+0000","last_became_peered":"2023-08-09T12:48:45.903570+0000","last_unstale":"2023-08-09T12:48:46.978359+0000","last_undegraded":"2023-08-09T12:48:46.978359+0000","last_fullsized":"2023-08-09T12:48:46.978359+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:55.399101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.892643+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:48:45.892643+0000","last_peered":"2023-08-09T12:48:45.892643+0000","last_clean":"2023-08-09T12:48:45.892643+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:48:45.892643+0000","last_undegraded":"2023-08-09T12:48:45.892643+0000","last_fullsized":"2023-08-09T12:48:45.892643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:38.640549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.960104+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:46.960104+0000","last_peered":"2023-08-09T12:48:46.960104+0000","last_clean":"2023-08-09T12:48:46.960104+0000","last_became_active":"2023-08-09T12:48:46.959496+0000","last_became_peered":"2023-08-09T12:48:46.959496+0000","last_unstale":"2023-08-09T12:48:46.960104+0000","last_undegraded":"2023-08-09T12:48:46.960104+0000","last_fullsized":"2023-08-09T12:48:46.960104+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:31:39.093936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"160'6","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.980029+0000","last_change":"2023-08-09T12:48:45.908372+0000","last_active":"2023-08-09T12:48:46.980029+0000","last_peered":"2023-08-09T12:48:46.980029+0000","last_clean":"2023-08-09T12:48:46.980029+0000","last_became_active":"2023-08-09T12:48:45.907802+0000","last_became_peered":"2023-08-09T12:48:45.907802+0000","last_unstale":"2023-08-09T12:48:46.980029+0000","last_undegraded":"2023-08-09T12:48:46.980029+0000","last_fullsized":"2023-08-09T12:48:46.980029+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:21.647701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":287,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.925801+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:48:46.925801+0000","last_peered":"2023-08-09T12:48:46.925801+0000","last_clean":"2023-08-09T12:48:46.925801+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:48:46.925801+0000","last_undegraded":"2023-08-09T12:48:46.925801+0000","last_fullsized":"2023-08-09T12:48:46.925801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:07.531778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944679+0000","last_change":"2023-08-09T12:48:46.944465+0000","last_active":"2023-08-09T12:48:46.944679+0000","last_peered":"2023-08-09T12:48:46.944679+0000","last_clean":"2023-08-09T12:48:46.944679+0000","last_became_active":"2023-08-09T12:48:46.943732+0000","last_became_peered":"2023-08-09T12:48:46.943732+0000","last_unstale":"2023-08-09T12:48:46.944679+0000","last_undegraded":"2023-08-09T12:48:46.944679+0000","last_fullsized":"2023-08-09T12:48:46.944679+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:31.914515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950953+0000","last_change":"2023-08-09T12:48:45.910997+0000","last_active":"2023-08-09T12:48:46.950953+0000","last_peered":"2023-08-09T12:48:46.950953+0000","last_clean":"2023-08-09T12:48:46.950953+0000","last_became_active":"2023-08-09T12:48:45.910593+0000","last_became_peered":"2023-08-09T12:48:45.910593+0000","last_unstale":"2023-08-09T12:48:46.950953+0000","last_undegraded":"2023-08-09T12:48:46.950953+0000","last_fullsized":"2023-08-09T12:48:46.950953+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:56.684208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.908293+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:48:45.908293+0000","last_peered":"2023-08-09T12:48:45.908293+0000","last_clean":"2023-08-09T12:48:45.908293+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:48:45.908293+0000","last_undegraded":"2023-08-09T12:48:45.908293+0000","last_fullsized":"2023-08-09T12:48:45.908293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:55:08.007694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.891274+0000","last_change":"2023-08-09T12:48:45.891274+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.891274+0000","last_undegraded":"2023-08-09T12:48:45.891274+0000","last_fullsized":"2023-08-09T12:48:45.891274+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.931677+0000","last_change":"2023-08-09T12:48:45.890515+0000","last_active":"2023-08-09T12:48:46.931677+0000","last_peered":"2023-08-09T12:48:46.931677+0000","last_clean":"2023-08-09T12:48:46.931677+0000","last_became_active":"2023-08-09T12:48:45.889827+0000","last_became_peered":"2023-08-09T12:48:45.889827+0000","last_unstale":"2023-08-09T12:48:46.931677+0000","last_undegraded":"2023-08-09T12:48:46.931677+0000","last_fullsized":"2023-08-09T12:48:46.931677+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:13.113325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.927912+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:48:46.927912+0000","last_peered":"2023-08-09T12:48:46.927912+0000","last_clean":"2023-08-09T12:48:46.927912+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:48:46.927912+0000","last_undegraded":"2023-08-09T12:48:46.927912+0000","last_fullsized":"2023-08-09T12:48:46.927912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:20.443006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1507,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193805,"statfs":{"total":200000000,"available":198456779,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1439999999999999,"15min":1.107},"min":{"1min":0.64300000000000002,"5min":0.627,"15min":0.59899999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.544},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0900000000000001,"15min":1.091},"min":{"1min":0.70499999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7509999999999999,"5min":1.7769999999999999,"15min":2.0459999999999998},"last":1.355}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.224,"15min":1.149},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.63300000000000001},"max":{"1min":1.629,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.022},{"interface":"front","average":{"1min":1.119,"5min":1.167,"15min":1.133},"min":{"1min":0.73499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.26,"15min":1.2050000000000001},"min":{"1min":0.83299999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.591,"5min":1.96,"15min":2.1459999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.2230000000000001,"15min":1.1759999999999999},"min":{"1min":0.81200000000000006,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.7450000000000001,"15min":2.173},"last":1.593}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.341,"15min":1.268},"min":{"1min":0.79100000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.806,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.331,"15min":1.2949999999999999},"min":{"1min":0.97899999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6200000000000001,"5min":1.992,"15min":2.282},"last":1.4910000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.276,"15min":1.2330000000000001},"min":{"1min":0.98499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.948,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.706},{"interface":"front","average":{"1min":1.302,"5min":1.3799999999999999,"15min":1.3200000000000001},"min":{"1min":0.90800000000000003,"5min":0.82299999999999995,"15min":0.58599999999999997},"max":{"1min":1.764,"5min":2.5070000000000001,"15min":4.6200000000000001},"last":1.647}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.878,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.978,"5min":2.1699999999999999,"15min":2.802},"last":1.397},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.536,"15min":1.502},"min":{"1min":0.97799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1299999999999999,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.8009999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.522,"15min":1.486},"min":{"1min":1.1259999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2370000000000001,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":1.8839999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.542,"15min":1.476},"min":{"1min":1.073,"5min":1.0029999999999999,"15min":0.623},"max":{"1min":1.95,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.7490000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.135},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.544,"5min":1.986,"15min":2.54},"last":1.573},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.099,"15min":1.083},"min":{"1min":0.72099999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.615,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.179}]},{"osd":1,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.226,"15min":1.2290000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.51,"5min":1.996,"15min":2.306},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.3009999999999999,"15min":1.3160000000000001},"min":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":0.95199999999999996}]},{"osd":2,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1839999999999999,"15min":1.1240000000000001},"min":{"1min":0.91100000000000003,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.28,"15min":1.2789999999999999},"min":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.772,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7070000000000001,"5min":2.327,"15min":2.327},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.3680000000000001,"15min":1.3160000000000001},"min":{"1min":1.0549999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.724,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.327}]},{"osd":4,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3340000000000001,"15min":1.3540000000000001},"min":{"1min":1.01,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.651,"5min":2.028,"15min":11.058999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.339,"15min":1.351},"min":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":2.29,"15min":2.3479999999999999},"last":1.603}]},{"osd":5,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.0089999999999999,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.71,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.012},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4750000000000001,"15min":1.4890000000000001},"min":{"1min":1.087,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.8009999999999999,"5min":2.222,"15min":2.8580000000000001},"last":1.3600000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.5089999999999999,"15min":1.4670000000000001},"min":{"1min":1.137,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9059999999999999,"5min":2.1520000000000001,"15min":2.7999999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.5129999999999999,"15min":1.4690000000000001},"min":{"1min":1.1259999999999999,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.8109999999999999,"5min":2.7810000000000001,"15min":3.621},"last":1.236}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.68000000000000005,"15min":0.55300000000000005},"max":{"1min":1.591,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2070000000000001,"15min":1.113},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.97,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.2869999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3680000000000001,"15min":1.3109999999999999},"min":{"1min":0.78600000000000003,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.7190000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.284,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7310000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.97599999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.264,"15min":1.22},"min":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2310000000000001,"15min":1.2030000000000001},"min":{"1min":0.78800000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.554,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.347}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.2410000000000001},"min":{"1min":1.006,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5429999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.393,"15min":1.3740000000000001},"min":{"1min":0.998,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":1.7809999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.1259999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.335,"15min":1.2569999999999999},"min":{"1min":0.877,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":1.7549999999999999,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":0.877},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.456,"15min":1.389},"min":{"1min":1.032,"5min":0.80600000000000005,"15min":0.628},"max":{"1min":1.7190000000000001,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.4330000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.4419999999999999,"15min":1.367},"min":{"1min":1.006,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.833,"5min":2.952,"15min":2.952},"last":1.458},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":0.98199999999999998,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.762,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.4079999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.575,"15min":1.53},"min":{"1min":1.0860000000000001,"5min":0.86599999999999999,"15min":0.67200000000000004},"max":{"1min":2.0329999999999999,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6399999999999999,"15min":1.5469999999999999},"min":{"1min":1.069,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.9179999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.242}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194383,"statfs":{"total":200000000,"available":199048849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1040000000000001,"15min":1.0940000000000001},"min":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.579,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.391},{"interface":"front","average":{"1min":1.145,"5min":1.131,"15min":1.119},"min":{"1min":0.77000000000000002,"5min":0.66500000000000004,"15min":0.64800000000000002},"max":{"1min":1.5740000000000001,"5min":1.635,"15min":3.4100000000000001},"last":1.4750000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.288,"15min":1.3180000000000001},"min":{"1min":0.88100000000000001,"5min":0.77400000000000002,"15min":0.48899999999999999},"max":{"1min":1.863,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.92600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8240000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.4550000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.306,"15min":1.3169999999999999},"min":{"1min":0.86199999999999999,"5min":0.70799999999999996,"15min":0.54900000000000004},"max":{"1min":1.9470000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3420000000000001,"15min":1.3300000000000001},"min":{"1min":0.81499999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8100000000000001,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.5089999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2889999999999999,"15min":1.248},"min":{"1min":1.0329999999999999,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.728,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3320000000000001,"15min":1.335},"min":{"1min":0.98199999999999998,"5min":0.93999999999999995,"15min":0.82699999999999996},"max":{"1min":2.0539999999999998,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.631}]},{"osd":5,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3759999999999999,"15min":1.381},"min":{"1min":0.85499999999999998,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":1.857,"5min":3.137,"15min":3.137},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.367,"15min":1.381},"min":{"1min":0.89400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":2.403,"5min":2.403,"15min":3.3620000000000001},"last":1.3440000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4399999999999999,"15min":1.466},"min":{"1min":0.82299999999999995,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":2.262,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.143},{"interface":"front","average":{"1min":1.498,"5min":1.5469999999999999,"15min":1.538},"min":{"1min":1.0660000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1070000000000002,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.3100000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.5249999999999999,"15min":1.5289999999999999},"min":{"1min":1.1950000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.202},{"interface":"front","average":{"1min":1.621,"5min":1.599,"15min":1.613},"min":{"1min":1.2689999999999999,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.4590000000000001,"5min":2.875,"15min":2.875},"last":1.53}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.84699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.458,"5min":1.458,"15min":4.4109999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.024,"15min":0.94199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.698,"5min":2.778,"15min":3.2269999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.52000000000000002,"5min":0.41099999999999998,"15min":0.38100000000000001},"max":{"1min":1.448,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.127,"15min":0.98799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.407,"5min":2.0219999999999998,"15min":2.0880000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.103,"15min":1.129},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.48,"5min":1.9259999999999999,"15min":18.145},"last":0.874},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2569999999999999,"15min":1.208},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.619,"5min":2.169,"15min":2.169},"last":0.64900000000000002}]},{"osd":4,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.78200000000000003,"5min":0.75,"15min":0.745},"max":{"1min":1.7709999999999999,"5min":1.8660000000000001,"15min":3.5110000000000001},"last":1.151},{"interface":"front","average":{"1min":1.214,"5min":1.306,"15min":1.325},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":1.5640000000000001,"5min":2.056,"15min":3.5960000000000001},"last":1.208}]},{"osd":5,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.345,"15min":1.4299999999999999},"min":{"1min":0.82099999999999995,"5min":0.80500000000000005,"15min":0.72999999999999998},"max":{"1min":1.7150000000000001,"5min":2.2389999999999999,"15min":18.094000000000001},"last":1.385},{"interface":"front","average":{"1min":1.347,"5min":1.429,"15min":1.389},"min":{"1min":0.752,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.6020000000000001,"5min":2.2959999999999998,"15min":14.105},"last":0.97999999999999998}]},{"osd":6,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3899999999999999,"15min":1.357},"min":{"1min":0.92200000000000004,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.641,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4319999999999999,"15min":1.462},"min":{"1min":0.90300000000000002,"5min":0.86399999999999999,"15min":0.77700000000000002},"max":{"1min":1.792,"5min":2.0099999999999998,"15min":4.0220000000000002},"last":1.45}]},{"osd":7,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.526,"15min":1.4279999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":1.7430000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.012},{"interface":"front","average":{"1min":1.391,"5min":1.4950000000000001,"15min":1.4139999999999999},"min":{"1min":0.96299999999999997,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":1.6759999999999999,"5min":2.073,"15min":3.016},"last":1.266}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90900000000000003,"15min":0.86699999999999999},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":1.3759999999999999,"5min":1.597,"15min":1.716},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.028,"15min":0.96699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.5680000000000001,"5min":1.73,"15min":2.9009999999999998},"last":0.75700000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92000000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.004,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5,"5min":1.823,"15min":1.869},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.149,"15min":1.1559999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.615,"5min":1.681,"15min":3.2850000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1930000000000001,"15min":1.1639999999999999},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.637,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":0.871}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4510000000000001,"15min":1.419},"min":{"1min":0.93200000000000005,"5min":0.83499999999999996,"15min":0.81899999999999995},"max":{"1min":1.7250000000000001,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.351,"15min":1.3},"min":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.694,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":1.302}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.401,"15min":1.375},"min":{"1min":0.78900000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0110000000000001,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.448,"15min":1.472},"min":{"1min":0.878,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8120000000000001,"5min":2.4780000000000002,"15min":4.806},"last":1.3220000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8580000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.468,"15min":1.4299999999999999},"min":{"1min":0.89600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.901,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":1.4530000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.462,"15min":1.3839999999999999},"min":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"max":{"1min":1.8640000000000001,"5min":2.464,"15min":2.464},"last":1.663},{"interface":"front","average":{"1min":1.431,"5min":1.536,"15min":1.5269999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.036,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.4970000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":915,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194397,"statfs":{"total":200000000,"available":199062597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91000000000000003,"15min":0.89400000000000002},"min":{"1min":0.53000000000000003,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":1.542,"5min":2.621,"15min":2.621},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.008,"15min":1.2709999999999999},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.5169999999999999,"5min":1.9530000000000001,"15min":88.254999999999995},"last":1.0489999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.998,"15min":0.96699999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":3.0209999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2470000000000001,"15min":1.1699999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7849999999999999,"5min":2.0449999999999999,"15min":3.1890000000000001},"last":1.353}]},{"osd":3,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1879999999999999,"15min":1.1200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.7290000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.085,"15min":1.0069999999999999},"min":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.397,"5min":1.819,"15min":5.4320000000000004},"last":1.2230000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.24,"15min":1.304},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.581,"5min":2.391,"15min":25.172000000000001},"last":1.127},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.391,"15min":1.3300000000000001},"min":{"1min":0.93500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.085,"5min":3.762,"15min":3.762},"last":1.607}]},{"osd":5,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3260000000000001,"15min":1.4079999999999999},"min":{"1min":0.92200000000000004,"5min":0.751,"15min":0.751},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":28.710000000000001},"last":1.7709999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.327,"15min":1.2989999999999999},"min":{"1min":0.84599999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6910000000000001,"5min":1.9910000000000001,"15min":3.762},"last":1.2889999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4510000000000001,"15min":1.4379999999999999},"min":{"1min":1.022,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7230000000000001,"5min":1.841,"15min":6.0460000000000003},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.4419999999999999,"15min":1.397},"min":{"1min":1.0609999999999999,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":1.6759999999999999,"5min":2.0960000000000001,"15min":2.1480000000000001},"last":1.4079999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.532,"15min":1.595},"min":{"1min":0.89800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.2370000000000001,"5min":2.5089999999999999,"15min":26.975999999999999},"last":1.498},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5389999999999999,"15min":1.589},"min":{"1min":1.141,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.988,"5min":2.492,"15min":28.765000000000001},"last":1.6639999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1491,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193820,"statfs":{"total":200000000,"available":198472229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.61299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.819},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0249999999999999,"15min":0.97799999999999998},"min":{"1min":0.60699999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.331,"5min":1.6699999999999999,"15min":6.1749999999999998},"last":1.052}]},{"osd":2,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.032,"15min":0.97899999999999998},"min":{"1min":0.63500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.411,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.044},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5189999999999999,"5min":1.732,"15min":6.2549999999999999},"last":1.1439999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.0429999999999999,"15min":0.97899999999999998},"min":{"1min":0.68300000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4570000000000001,"5min":1.6699999999999999,"15min":9.6069999999999993},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.1850000000000001},"min":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.0940000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3240000000000001,"15min":1.337},"min":{"1min":0.90600000000000003,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.6919999999999999,"5min":1.8240000000000001,"15min":9.9629999999999992},"last":0.996},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.377,"15min":1.3129999999999999},"min":{"1min":0.85799999999999998,"5min":0.78600000000000003,"15min":0.77900000000000003},"max":{"1min":1.825,"5min":1.879,"15min":1.879},"last":1.252}]},{"osd":5,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.351,"15min":1.325},"min":{"1min":0.86299999999999999,"5min":0.82799999999999996,"15min":0.76300000000000001},"max":{"1min":1.8200000000000001,"5min":2.0419999999999998,"15min":10.004},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4359999999999999,"15min":1.3939999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.728,"5min":2.0569999999999999,"15min":2.161},"last":1.381}]},{"osd":6,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4259999999999999,"15min":1.369},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.863,"5min":2.2000000000000002,"15min":6.4290000000000003},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":1.7030000000000001,"5min":2.1549999999999998,"15min":9.9190000000000005},"last":1.355}]},{"osd":7,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.466,"15min":1.458},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.9319999999999999,"5min":2.2909999999999999,"15min":18.114000000000001},"last":1.278},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.5209999999999999,"15min":1.4850000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.891,"5min":2.1120000000000001,"15min":9.5640000000000001},"last":1.292}]}]}],"pool_statfs":[]}} 2023-08-09T12:48:52.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:48:52.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.276+0000 7f58bcc34640 1 Processor -- start 2023-08-09T12:48:52.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.276+0000 7f58bcc34640 1 -- start start 2023-08-09T12:48:52.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.277+0000 7f58bcc34640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58b8159d80 0x7f58b80b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.277+0000 7f58bcc34640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58b8070a90 0x7f58b80c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.277+0000 7f58bcc34640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b80b4630 con 0x7f58b80ad810 2023-08-09T12:48:52.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.277+0000 7f58bcc34640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b815a160 con 0x7f58b8159d80 2023-08-09T12:48:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.277+0000 7f58bcc34640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b80b3ab0 con 0x7f58b8070a90 2023-08-09T12:48:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58b8159d80 0x7f58b80b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58b8159d80 0x7f58b80b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57172/0 (socket says 172.21.15.17:57172) 2023-08-09T12:48:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b659c640 1 -- 172.21.15.17:0/1332958114 learned_addr learned my addr 172.21.15.17:0/1332958114 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58add9b640 1 --1- 172.21.15.17:0/1332958114 >> v1:172.21.15.17:6789/0 conn(0x7f58b80ad810 0x7f58b8070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41050/0 (socket says 172.21.15.17:41050) 2023-08-09T12:48:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b6d9d640 1 --2- 172.21.15.17:0/1332958114 >> v2:172.21.15.142:3300/0 conn(0x7f58b8070a90 0x7f58b80c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b659c640 1 -- 172.21.15.17:0/1332958114 >> v2:172.21.15.142:3300/0 conn(0x7f58b8070a90 msgr2=0x7f58b80c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b659c640 1 --2- 172.21.15.17:0/1332958114 >> v2:172.21.15.142:3300/0 conn(0x7f58b8070a90 0x7f58b80c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b659c640 1 -- 172.21.15.17:0/1332958114 >> v1:172.21.15.17:6789/0 conn(0x7f58b80ad810 legacy=0x7f58b8070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b659c640 1 -- 172.21.15.17:0/1332958114 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80b3d90 con 0x7f58b8159d80 2023-08-09T12:48:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b5d9b640 1 -- 172.21.15.17:0/1332958114 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635253269 0 0) 0x7f58b80b4630 con 0x7f58b80ad810 2023-08-09T12:48:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.278+0000 7f58b6d9d640 1 --2- 172.21.15.17:0/1332958114 >> v2:172.21.15.142:3300/0 conn(0x7f58b8070a90 0x7f58b80c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.280+0000 7f58b659c640 1 --2- 172.21.15.17:0/1332958114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b80b34d0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f58b806ce30 tx=0x7f58a802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe492ec0f439b5c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.280+0000 7f58b5d9b640 1 -- 172.21.15.17:0/1332958114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8030870 con 0x7f58b8159d80 2023-08-09T12:48:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.280+0000 7f58b5d9b640 1 -- 172.21.15.17:0/1332958114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a80309d0 con 0x7f58b8159d80 2023-08-09T12:48:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.280+0000 7f58b5d9b640 1 -- 172.21.15.17:0/1332958114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8030d60 con 0x7f58b8159d80 2023-08-09T12:48:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.280+0000 7f58bcc34640 1 -- 172.21.15.17:0/1332958114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 msgr2=0x7f58b80b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.280+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1332958114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b80b34d0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f58b806ce30 tx=0x7f58a802b9b0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.281+0000 7f58bcc34640 1 -- 172.21.15.17:0/1332958114 shutdown_connections 2023-08-09T12:48:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.281+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1332958114 >> v2:172.21.15.142:3300/0 conn(0x7f58b8070a90 0x7f58b80c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.281+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1332958114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b80b34d0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.281+0000 7f58bcc34640 1 -- 172.21.15.17:0/1332958114 >> 172.21.15.17:0/1332958114 conn(0x7f58b80cb1b0 msgr2=0x7f58b80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.281+0000 7f58bcc34640 1 -- 172.21.15.17:0/1332958114 shutdown_connections 2023-08-09T12:48:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.281+0000 7f58bcc34640 1 -- 172.21.15.17:0/1332958114 wait complete. 2023-08-09T12:48:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.283+0000 7f58bcc34640 1 Processor -- start 2023-08-09T12:48:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.283+0000 7f58bcc34640 1 -- start start 2023-08-09T12:48:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58bcc34640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8070a90 0x7f58b80c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58bcc34640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b80ad810 0x7f58b806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58bcc34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b81523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58bcc34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80c4820 con 0x7f58b8159d80 2023-08-09T12:48:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58bcc34640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80c4b00 con 0x7f58b80ad810 2023-08-09T12:48:52.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58bcc34640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80c4de0 con 0x7f58b8070a90 2023-08-09T12:48:52.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58b6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b81523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58b6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b81523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57178/0 (socket says 172.21.15.17:57178) 2023-08-09T12:48:52.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.284+0000 7f58b6d9d640 1 -- 172.21.15.17:0/1910820833 learned_addr learned my addr 172.21.15.17:0/1910820833 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:52.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58b659c640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8070a90 0x7f58b80c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58add9b640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b80ad810 0x7f58b806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58b6d9d640 1 -- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8070a90 msgr2=0x7f58b80c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58b6d9d640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8070a90 0x7f58b80c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58b6d9d640 1 -- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b80ad810 msgr2=0x7f58b806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58b6d9d640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b80ad810 0x7f58b806a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58b6d9d640 1 -- 172.21.15.17:0/1910820833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80094d0 con 0x7f58b8159d80 2023-08-09T12:48:52.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58b6d9d640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b81523c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c7f0 tx=0x7f58b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:52.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58af7fe640 1 -- 172.21.15.17:0/1910820833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0007820 con 0x7f58b8159d80 2023-08-09T12:48:52.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58af7fe640 1 -- 172.21.15.17:0/1910820833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0007980 con 0x7f58b8159d80 2023-08-09T12:48:52.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58af7fe640 1 -- 172.21.15.17:0/1910820833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0007d70 con 0x7f58b8159d80 2023-08-09T12:48:52.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.285+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b80ae640 con 0x7f58b8159d80 2023-08-09T12:48:52.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.286+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b80c2790 con 0x7f58b8159d80 2023-08-09T12:48:52.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.287+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b80ae4a0 con 0x7f58b8159d80 2023-08-09T12:48:52.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.288+0000 7f58af7fe640 1 -- 172.21.15.17:0/1910820833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f58b00113f0 con 0x7f58b8159d80 2023-08-09T12:48:52.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.289+0000 7f58af7fe640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f589806a050 0x7f589806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.289+0000 7f58af7fe640 1 -- 172.21.15.17:0/1910820833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58b00888e0 con 0x7f58b8159d80 2023-08-09T12:48:52.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.289+0000 7f58b659c640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f589806a050 0x7f589806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.290+0000 7f58b659c640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f589806a050 0x7f589806c510 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58a8036000 tx=0x7f58a803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:52.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.293+0000 7f58af7fe640 1 -- 172.21.15.17:0/1910820833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f58b80ae4a0 con 0x7f58b8159d80 2023-08-09T12:48:52.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.480+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58b80b4350 con 0x7f589806a050 2023-08-09T12:48:52.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.504+0000 7f58af7fe640 1 -- 172.21.15.17:0/1910820833 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+301920 (secure 0 0 0) 0x7f58a8030c40 con 0x7f589806a050 2023-08-09T12:48:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:52.514 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:48:52.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f589806a050 msgr2=0x7f589806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f589806a050 0x7f589806c510 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58a8036000 tx=0x7f58a803b040 comp rx=0 tx=0).stop 2023-08-09T12:48:52.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 msgr2=0x7f58b81523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b81523c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c7f0 tx=0x7f58b000ccb0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 shutdown_connections 2023-08-09T12:48:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f589806a050 0x7f589806c510 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b8159d80 0x7f58b81523c0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b80ad810 0x7f58b806a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 --2- 172.21.15.17:0/1910820833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8070a90 0x7f58b80c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 >> 172.21.15.17:0/1910820833 conn(0x7f58b80cb1b0 msgr2=0x7f58b806fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 shutdown_connections 2023-08-09T12:48:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.511+0000 7f58bcc34640 1 -- 172.21.15.17:0/1910820833 wait complete. 2023-08-09T12:48:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2023-08-09T12:48:50.851178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553969,"statfs":{"total":1600000000,"available":1591264362,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.974237"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961709+0000","last_change":"2023-08-09T12:48:46.961585+0000","last_active":"2023-08-09T12:48:46.961709+0000","last_peered":"2023-08-09T12:48:46.961709+0000","last_clean":"2023-08-09T12:48:46.961709+0000","last_became_active":"2023-08-09T12:48:46.961206+0000","last_became_peered":"2023-08-09T12:48:46.961206+0000","last_unstale":"2023-08-09T12:48:46.961709+0000","last_undegraded":"2023-08-09T12:48:46.961709+0000","last_fullsized":"2023-08-09T12:48:46.961709+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:51:40.488960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952759+0000","last_change":"2023-08-09T12:48:46.952118+0000","last_active":"2023-08-09T12:48:46.952759+0000","last_peered":"2023-08-09T12:48:46.952759+0000","last_clean":"2023-08-09T12:48:46.952759+0000","last_became_active":"2023-08-09T12:48:46.951749+0000","last_became_peered":"2023-08-09T12:48:46.951749+0000","last_unstale":"2023-08-09T12:48:46.952759+0000","last_undegraded":"2023-08-09T12:48:46.952759+0000","last_fullsized":"2023-08-09T12:48:46.952759+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:29:17.351750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962647+0000","last_change":"2023-08-09T12:48:46.962586+0000","last_active":"2023-08-09T12:48:46.962647+0000","last_peered":"2023-08-09T12:48:46.962647+0000","last_clean":"2023-08-09T12:48:46.962647+0000","last_became_active":"2023-08-09T12:48:46.962122+0000","last_became_peered":"2023-08-09T12:48:46.962122+0000","last_unstale":"2023-08-09T12:48:46.962647+0000","last_undegraded":"2023-08-09T12:48:46.962647+0000","last_fullsized":"2023-08-09T12:48:46.962647+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:30.851235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.958544+0000","last_change":"2023-08-09T12:48:46.958261+0000","last_active":"2023-08-09T12:48:46.958544+0000","last_peered":"2023-08-09T12:48:46.958544+0000","last_clean":"2023-08-09T12:48:46.958544+0000","last_became_active":"2023-08-09T12:48:46.957807+0000","last_became_peered":"2023-08-09T12:48:46.957807+0000","last_unstale":"2023-08-09T12:48:46.958544+0000","last_undegraded":"2023-08-09T12:48:46.958544+0000","last_fullsized":"2023-08-09T12:48:46.958544+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:33:09.426318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962928+0000","last_change":"2023-08-09T12:48:46.962514+0000","last_active":"2023-08-09T12:48:46.962928+0000","last_peered":"2023-08-09T12:48:46.962928+0000","last_clean":"2023-08-09T12:48:46.962928+0000","last_became_active":"2023-08-09T12:48:46.961600+0000","last_became_peered":"2023-08-09T12:48:46.961600+0000","last_unstale":"2023-08-09T12:48:46.962928+0000","last_undegraded":"2023-08-09T12:48:46.962928+0000","last_fullsized":"2023-08-09T12:48:46.962928+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:11:37.774360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.896096+0000","last_change":"2023-08-09T12:48:45.896096+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.896096+0000","last_undegraded":"2023-08-09T12:48:45.896096+0000","last_fullsized":"2023-08-09T12:48:45.896096+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.941877+0000","last_change":"2023-08-09T12:48:46.941718+0000","last_active":"2023-08-09T12:48:46.941877+0000","last_peered":"2023-08-09T12:48:46.941877+0000","last_clean":"2023-08-09T12:48:46.941877+0000","last_became_active":"2023-08-09T12:48:46.939246+0000","last_became_peered":"2023-08-09T12:48:46.939246+0000","last_unstale":"2023-08-09T12:48:46.941877+0000","last_undegraded":"2023-08-09T12:48:46.941877+0000","last_fullsized":"2023-08-09T12:48:46.941877+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:48:02.414553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.955621+0000","last_change":"2023-08-09T12:48:46.955542+0000","last_active":"2023-08-09T12:48:46.955621+0000","last_peered":"2023-08-09T12:48:46.955621+0000","last_clean":"2023-08-09T12:48:46.955621+0000","last_became_active":"2023-08-09T12:48:46.955219+0000","last_became_peered":"2023-08-09T12:48:46.955219+0000","last_unstale":"2023-08-09T12:48:46.955621+0000","last_undegraded":"2023-08-09T12:48:46.955621+0000","last_fullsized":"2023-08-09T12:48:46.955621+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:45:32.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.895523+0000","last_change":"2023-08-09T12:48:45.895523+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.895523+0000","last_undegraded":"2023-08-09T12:48:45.895523+0000","last_fullsized":"2023-08-09T12:48:45.895523+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887549+0000","last_change":"2023-08-09T12:48:45.887549+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887549+0000","last_undegraded":"2023-08-09T12:48:45.887549+0000","last_fullsized":"2023-08-09T12:48:45.887549+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.953832+0000","last_change":"2023-08-09T12:48:46.953736+0000","last_active":"2023-08-09T12:48:46.953832+0000","last_peered":"2023-08-09T12:48:46.953832+0000","last_clean":"2023-08-09T12:48:46.953832+0000","last_became_active":"2023-08-09T12:48:46.953362+0000","last_became_peered":"2023-08-09T12:48:46.953362+0000","last_unstale":"2023-08-09T12:48:46.953832+0000","last_undegraded":"2023-08-09T12:48:46.953832+0000","last_fullsized":"2023-08-09T12:48:46.953832+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:22:54.700195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.966605+0000","last_change":"2023-08-09T12:48:46.965972+0000","last_active":"2023-08-09T12:48:46.966605+0000","last_peered":"2023-08-09T12:48:46.966605+0000","last_clean":"2023-08-09T12:48:46.966605+0000","last_became_active":"2023-08-09T12:48:46.965713+0000","last_became_peered":"2023-08-09T12:48:46.965713+0000","last_unstale":"2023-08-09T12:48:46.966605+0000","last_undegraded":"2023-08-09T12:48:46.966605+0000","last_fullsized":"2023-08-09T12:48:46.966605+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:50:11.233723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.898244+0000","last_change":"2023-08-09T12:48:45.898244+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.898244+0000","last_undegraded":"2023-08-09T12:48:45.898244+0000","last_fullsized":"2023-08-09T12:48:45.898244+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937415+0000","last_change":"2023-08-09T12:48:46.937286+0000","last_active":"2023-08-09T12:48:46.937415+0000","last_peered":"2023-08-09T12:48:46.937415+0000","last_clean":"2023-08-09T12:48:46.937415+0000","last_became_active":"2023-08-09T12:48:46.936728+0000","last_became_peered":"2023-08-09T12:48:46.936728+0000","last_unstale":"2023-08-09T12:48:46.937415+0000","last_undegraded":"2023-08-09T12:48:46.937415+0000","last_fullsized":"2023-08-09T12:48:46.937415+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:28:00.860493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.936223+0000","last_change":"2023-08-09T12:48:46.936044+0000","last_active":"2023-08-09T12:48:46.936223+0000","last_peered":"2023-08-09T12:48:46.936223+0000","last_clean":"2023-08-09T12:48:46.936223+0000","last_became_active":"2023-08-09T12:48:46.935618+0000","last_became_peered":"2023-08-09T12:48:46.935618+0000","last_unstale":"2023-08-09T12:48:46.936223+0000","last_undegraded":"2023-08-09T12:48:46.936223+0000","last_fullsized":"2023-08-09T12:48:46.936223+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:47:07.896841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.895333+0000","last_change":"2023-08-09T12:48:45.895333+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.895333+0000","last_undegraded":"2023-08-09T12:48:45.895333+0000","last_fullsized":"2023-08-09T12:48:45.895333+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.892317+0000","last_change":"2023-08-09T12:48:45.892317+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.892317+0000","last_undegraded":"2023-08-09T12:48:45.892317+0000","last_fullsized":"2023-08-09T12:48:45.892317+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.960418+0000","last_change":"2023-08-09T12:48:46.960291+0000","last_active":"2023-08-09T12:48:46.960418+0000","last_peered":"2023-08-09T12:48:46.960418+0000","last_clean":"2023-08-09T12:48:46.960418+0000","last_became_active":"2023-08-09T12:48:46.959860+0000","last_became_peered":"2023-08-09T12:48:46.959860+0000","last_unstale":"2023-08-09T12:48:46.960418+0000","last_undegraded":"2023-08-09T12:48:46.960418+0000","last_fullsized":"2023-08-09T12:48:46.960418+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:54:25.433825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.935973+0000","last_change":"2023-08-09T12:48:46.935857+0000","last_active":"2023-08-09T12:48:46.935973+0000","last_peered":"2023-08-09T12:48:46.935973+0000","last_clean":"2023-08-09T12:48:46.935973+0000","last_became_active":"2023-08-09T12:48:46.935257+0000","last_became_peered":"2023-08-09T12:48:46.935257+0000","last_unstale":"2023-08-09T12:48:46.935973+0000","last_undegraded":"2023-08-09T12:48:46.935973+0000","last_fullsized":"2023-08-09T12:48:46.935973+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:32:02.852951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962892+0000","last_change":"2023-08-09T12:48:46.962333+0000","last_active":"2023-08-09T12:48:46.962892+0000","last_peered":"2023-08-09T12:48:46.962892+0000","last_clean":"2023-08-09T12:48:46.962892+0000","last_became_active":"2023-08-09T12:48:46.961277+0000","last_became_peered":"2023-08-09T12:48:46.961277+0000","last_unstale":"2023-08-09T12:48:46.962892+0000","last_undegraded":"2023-08-09T12:48:46.962892+0000","last_fullsized":"2023-08-09T12:48:46.962892+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:16:29.770394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959066+0000","last_change":"2023-08-09T12:48:46.958963+0000","last_active":"2023-08-09T12:48:46.959066+0000","last_peered":"2023-08-09T12:48:46.959066+0000","last_clean":"2023-08-09T12:48:46.959066+0000","last_became_active":"2023-08-09T12:48:46.958625+0000","last_became_peered":"2023-08-09T12:48:46.958625+0000","last_unstale":"2023-08-09T12:48:46.959066+0000","last_undegraded":"2023-08-09T12:48:46.959066+0000","last_fullsized":"2023-08-09T12:48:46.959066+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:27:08.669914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.965127+0000","last_change":"2023-08-09T12:48:46.965018+0000","last_active":"2023-08-09T12:48:46.965127+0000","last_peered":"2023-08-09T12:48:46.965127+0000","last_clean":"2023-08-09T12:48:46.965127+0000","last_became_active":"2023-08-09T12:48:46.963886+0000","last_became_peered":"2023-08-09T12:48:46.963886+0000","last_unstale":"2023-08-09T12:48:46.965127+0000","last_undegraded":"2023-08-09T12:48:46.965127+0000","last_fullsized":"2023-08-09T12:48:46.965127+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:36:53.292466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952938+0000","last_change":"2023-08-09T12:48:46.952852+0000","last_active":"2023-08-09T12:48:46.952938+0000","last_peered":"2023-08-09T12:48:46.952938+0000","last_clean":"2023-08-09T12:48:46.952938+0000","last_became_active":"2023-08-09T12:48:46.952361+0000","last_became_peered":"2023-08-09T12:48:46.952361+0000","last_unstale":"2023-08-09T12:48:46.952938+0000","last_undegraded":"2023-08-09T12:48:46.952938+0000","last_fullsized":"2023-08-09T12:48:46.952938+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:40.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.894654+0000","last_change":"2023-08-09T12:48:45.894654+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.894654+0000","last_undegraded":"2023-08-09T12:48:45.894654+0000","last_fullsized":"2023-08-09T12:48:45.894654+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.939548+0000","last_change":"2023-08-09T12:48:46.939417+0000","last_active":"2023-08-09T12:48:46.939548+0000","last_peered":"2023-08-09T12:48:46.939548+0000","last_clean":"2023-08-09T12:48:46.939548+0000","last_became_active":"2023-08-09T12:48:46.938512+0000","last_became_peered":"2023-08-09T12:48:46.938512+0000","last_unstale":"2023-08-09T12:48:46.939548+0000","last_undegraded":"2023-08-09T12:48:46.939548+0000","last_fullsized":"2023-08-09T12:48:46.939548+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:30:43.335439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937693+0000","last_change":"2023-08-09T12:48:46.937004+0000","last_active":"2023-08-09T12:48:46.937693+0000","last_peered":"2023-08-09T12:48:46.937693+0000","last_clean":"2023-08-09T12:48:46.937693+0000","last_became_active":"2023-08-09T12:48:46.936557+0000","last_became_peered":"2023-08-09T12:48:46.936557+0000","last_unstale":"2023-08-09T12:48:46.937693+0000","last_undegraded":"2023-08-09T12:48:46.937693+0000","last_fullsized":"2023-08-09T12:48:46.937693+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:58:08.137503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944480+0000","last_change":"2023-08-09T12:48:46.944383+0000","last_active":"2023-08-09T12:48:46.944480+0000","last_peered":"2023-08-09T12:48:46.944480+0000","last_clean":"2023-08-09T12:48:46.944480+0000","last_became_active":"2023-08-09T12:48:46.944042+0000","last_became_peered":"2023-08-09T12:48:46.944042+0000","last_unstale":"2023-08-09T12:48:46.944480+0000","last_undegraded":"2023-08-09T12:48:46.944480+0000","last_fullsized":"2023-08-09T12:48:46.944480+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:39:44.152926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888878+0000","last_change":"2023-08-09T12:48:45.888878+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888878+0000","last_undegraded":"2023-08-09T12:48:45.888878+0000","last_fullsized":"2023-08-09T12:48:45.888878+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954946+0000","last_change":"2023-08-09T12:48:46.954814+0000","last_active":"2023-08-09T12:48:46.954946+0000","last_peered":"2023-08-09T12:48:46.954946+0000","last_clean":"2023-08-09T12:48:46.954946+0000","last_became_active":"2023-08-09T12:48:46.954498+0000","last_became_peered":"2023-08-09T12:48:46.954498+0000","last_unstale":"2023-08-09T12:48:46.954946+0000","last_undegraded":"2023-08-09T12:48:46.954946+0000","last_fullsized":"2023-08-09T12:48:46.954946+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:02.941006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.939840+0000","last_change":"2023-08-09T12:48:46.939726+0000","last_active":"2023-08-09T12:48:46.939840+0000","last_peered":"2023-08-09T12:48:46.939840+0000","last_clean":"2023-08-09T12:48:46.939840+0000","last_became_active":"2023-08-09T12:48:46.939036+0000","last_became_peered":"2023-08-09T12:48:46.939036+0000","last_unstale":"2023-08-09T12:48:46.939840+0000","last_undegraded":"2023-08-09T12:48:46.939840+0000","last_fullsized":"2023-08-09T12:48:46.939840+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:16:56.191819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944168+0000","last_change":"2023-08-09T12:48:46.944030+0000","last_active":"2023-08-09T12:48:46.944168+0000","last_peered":"2023-08-09T12:48:46.944168+0000","last_clean":"2023-08-09T12:48:46.944168+0000","last_became_active":"2023-08-09T12:48:46.943711+0000","last_became_peered":"2023-08-09T12:48:46.943711+0000","last_unstale":"2023-08-09T12:48:46.944168+0000","last_undegraded":"2023-08-09T12:48:46.944168+0000","last_fullsized":"2023-08-09T12:48:46.944168+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:51:21.571300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888362+0000","last_change":"2023-08-09T12:48:45.888362+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888362+0000","last_undegraded":"2023-08-09T12:48:45.888362+0000","last_fullsized":"2023-08-09T12:48:45.888362+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.937260+0000","last_change":"2023-08-09T12:48:46.937096+0000","last_active":"2023-08-09T12:48:46.937260+0000","last_peered":"2023-08-09T12:48:46.937260+0000","last_clean":"2023-08-09T12:48:46.937260+0000","last_became_active":"2023-08-09T12:48:46.936636+0000","last_became_peered":"2023-08-09T12:48:46.936636+0000","last_unstale":"2023-08-09T12:48:46.937260+0000","last_undegraded":"2023-08-09T12:48:46.937260+0000","last_fullsized":"2023-08-09T12:48:46.937260+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:51:22.190862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"160'4","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978417+0000","last_change":"2023-08-09T12:48:45.895190+0000","last_active":"2023-08-09T12:48:46.978417+0000","last_peered":"2023-08-09T12:48:46.978417+0000","last_clean":"2023-08-09T12:48:46.978417+0000","last_became_active":"2023-08-09T12:48:45.894548+0000","last_became_peered":"2023-08-09T12:48:45.894548+0000","last_unstale":"2023-08-09T12:48:46.978417+0000","last_undegraded":"2023-08-09T12:48:46.978417+0000","last_fullsized":"2023-08-09T12:48:46.978417+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:39:20.689668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.963435+0000","last_change":"2023-08-09T12:48:46.963254+0000","last_active":"2023-08-09T12:48:46.963435+0000","last_peered":"2023-08-09T12:48:46.963435+0000","last_clean":"2023-08-09T12:48:46.963435+0000","last_became_active":"2023-08-09T12:48:46.962887+0000","last_became_peered":"2023-08-09T12:48:46.962887+0000","last_unstale":"2023-08-09T12:48:46.963435+0000","last_undegraded":"2023-08-09T12:48:46.963435+0000","last_fullsized":"2023-08-09T12:48:46.963435+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:51:42.174030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978163+0000","last_change":"2023-08-09T12:48:45.912443+0000","last_active":"2023-08-09T12:48:46.978163+0000","last_peered":"2023-08-09T12:48:46.978163+0000","last_clean":"2023-08-09T12:48:46.978163+0000","last_became_active":"2023-08-09T12:48:45.912042+0000","last_became_peered":"2023-08-09T12:48:45.912042+0000","last_unstale":"2023-08-09T12:48:46.978163+0000","last_undegraded":"2023-08-09T12:48:46.978163+0000","last_fullsized":"2023-08-09T12:48:46.978163+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:48:00.932200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952804+0000","last_change":"2023-08-09T12:48:46.952678+0000","last_active":"2023-08-09T12:48:46.952804+0000","last_peered":"2023-08-09T12:48:46.952804+0000","last_clean":"2023-08-09T12:48:46.952804+0000","last_became_active":"2023-08-09T12:48:46.951843+0000","last_became_peered":"2023-08-09T12:48:46.951843+0000","last_unstale":"2023-08-09T12:48:46.952804+0000","last_undegraded":"2023-08-09T12:48:46.952804+0000","last_fullsized":"2023-08-09T12:48:46.952804+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:04.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978620+0000","last_change":"2023-08-09T12:48:45.912974+0000","last_active":"2023-08-09T12:48:46.978620+0000","last_peered":"2023-08-09T12:48:46.978620+0000","last_clean":"2023-08-09T12:48:46.978620+0000","last_became_active":"2023-08-09T12:48:45.912770+0000","last_became_peered":"2023-08-09T12:48:45.912770+0000","last_unstale":"2023-08-09T12:48:46.978620+0000","last_undegraded":"2023-08-09T12:48:46.978620+0000","last_fullsized":"2023-08-09T12:48:46.978620+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:04:42.482449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.934977+0000","last_change":"2023-08-09T12:48:46.934802+0000","last_active":"2023-08-09T12:48:46.934977+0000","last_peered":"2023-08-09T12:48:46.934977+0000","last_clean":"2023-08-09T12:48:46.934977+0000","last_became_active":"2023-08-09T12:48:46.934325+0000","last_became_peered":"2023-08-09T12:48:46.934325+0000","last_unstale":"2023-08-09T12:48:46.934977+0000","last_undegraded":"2023-08-09T12:48:46.934977+0000","last_fullsized":"2023-08-09T12:48:46.934977+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:16:25.400011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978272+0000","last_change":"2023-08-09T12:48:45.906701+0000","last_active":"2023-08-09T12:48:46.978272+0000","last_peered":"2023-08-09T12:48:46.978272+0000","last_clean":"2023-08-09T12:48:46.978272+0000","last_became_active":"2023-08-09T12:48:45.906397+0000","last_became_peered":"2023-08-09T12:48:45.906397+0000","last_unstale":"2023-08-09T12:48:46.978272+0000","last_undegraded":"2023-08-09T12:48:46.978272+0000","last_fullsized":"2023-08-09T12:48:46.978272+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:51:10.779720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.947557+0000","last_change":"2023-08-09T12:48:46.947241+0000","last_active":"2023-08-09T12:48:46.947557+0000","last_peered":"2023-08-09T12:48:46.947557+0000","last_clean":"2023-08-09T12:48:46.947557+0000","last_became_active":"2023-08-09T12:48:46.946611+0000","last_became_peered":"2023-08-09T12:48:46.946611+0000","last_unstale":"2023-08-09T12:48:46.947557+0000","last_undegraded":"2023-08-09T12:48:46.947557+0000","last_fullsized":"2023-08-09T12:48:46.947557+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:47.916737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977117+0000","last_change":"2023-08-09T12:48:45.904761+0000","last_active":"2023-08-09T12:48:46.977117+0000","last_peered":"2023-08-09T12:48:46.977117+0000","last_clean":"2023-08-09T12:48:46.977117+0000","last_became_active":"2023-08-09T12:48:45.904258+0000","last_became_peered":"2023-08-09T12:48:45.904258+0000","last_unstale":"2023-08-09T12:48:46.977117+0000","last_undegraded":"2023-08-09T12:48:46.977117+0000","last_fullsized":"2023-08-09T12:48:46.977117+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:58:11.511623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959998+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:46.959998+0000","last_peered":"2023-08-09T12:48:46.959998+0000","last_clean":"2023-08-09T12:48:46.959998+0000","last_became_active":"2023-08-09T12:48:46.959290+0000","last_became_peered":"2023-08-09T12:48:46.959290+0000","last_unstale":"2023-08-09T12:48:46.959998+0000","last_undegraded":"2023-08-09T12:48:46.959998+0000","last_fullsized":"2023-08-09T12:48:46.959998+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:09:19.355636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978501+0000","last_change":"2023-08-09T12:48:45.907778+0000","last_active":"2023-08-09T12:48:46.978501+0000","last_peered":"2023-08-09T12:48:46.978501+0000","last_clean":"2023-08-09T12:48:46.978501+0000","last_became_active":"2023-08-09T12:48:45.907326+0000","last_became_peered":"2023-08-09T12:48:45.907326+0000","last_unstale":"2023-08-09T12:48:46.978501+0000","last_undegraded":"2023-08-09T12:48:46.978501+0000","last_fullsized":"2023-08-09T12:48:46.978501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:37:02.238431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.963265+0000","last_change":"2023-08-09T12:48:46.963125+0000","last_active":"2023-08-09T12:48:46.963265+0000","last_peered":"2023-08-09T12:48:46.963265+0000","last_clean":"2023-08-09T12:48:46.963265+0000","last_became_active":"2023-08-09T12:48:46.955577+0000","last_became_peered":"2023-08-09T12:48:46.955577+0000","last_unstale":"2023-08-09T12:48:46.963265+0000","last_undegraded":"2023-08-09T12:48:46.963265+0000","last_fullsized":"2023-08-09T12:48:46.963265+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:33:51.801770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.912917+0000","last_change":"2023-08-09T12:48:45.912814+0000","last_active":"2023-08-09T12:48:45.912917+0000","last_peered":"2023-08-09T12:48:45.912917+0000","last_clean":"2023-08-09T12:48:45.912917+0000","last_became_active":"2023-08-09T12:48:45.911537+0000","last_became_peered":"2023-08-09T12:48:45.911537+0000","last_unstale":"2023-08-09T12:48:45.912917+0000","last_undegraded":"2023-08-09T12:48:45.912917+0000","last_fullsized":"2023-08-09T12:48:45.912917+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:10:39.221725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.945274+0000","last_change":"2023-08-09T12:48:46.945168+0000","last_active":"2023-08-09T12:48:46.945274+0000","last_peered":"2023-08-09T12:48:46.945274+0000","last_clean":"2023-08-09T12:48:46.945274+0000","last_became_active":"2023-08-09T12:48:46.944925+0000","last_became_peered":"2023-08-09T12:48:46.944925+0000","last_unstale":"2023-08-09T12:48:46.945274+0000","last_undegraded":"2023-08-09T12:48:46.945274+0000","last_fullsized":"2023-08-09T12:48:46.945274+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:27:53.915770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.930735+0000","last_change":"2023-08-09T12:48:45.912104+0000","last_active":"2023-08-09T12:48:46.930735+0000","last_peered":"2023-08-09T12:48:46.930735+0000","last_clean":"2023-08-09T12:48:46.930735+0000","last_became_active":"2023-08-09T12:48:45.911841+0000","last_became_peered":"2023-08-09T12:48:45.911841+0000","last_unstale":"2023-08-09T12:48:46.930735+0000","last_undegraded":"2023-08-09T12:48:46.930735+0000","last_fullsized":"2023-08-09T12:48:46.930735+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:18:14.246123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961679+0000","last_change":"2023-08-09T12:48:46.961576+0000","last_active":"2023-08-09T12:48:46.961679+0000","last_peered":"2023-08-09T12:48:46.961679+0000","last_clean":"2023-08-09T12:48:46.961679+0000","last_became_active":"2023-08-09T12:48:46.961193+0000","last_became_peered":"2023-08-09T12:48:46.961193+0000","last_unstale":"2023-08-09T12:48:46.961679+0000","last_undegraded":"2023-08-09T12:48:46.961679+0000","last_fullsized":"2023-08-09T12:48:46.961679+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:29:13.189094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"160'1","reported_seq":12,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.976856+0000","last_change":"2023-08-09T12:48:45.912029+0000","last_active":"2023-08-09T12:48:46.976856+0000","last_peered":"2023-08-09T12:48:46.976856+0000","last_clean":"2023-08-09T12:48:46.976856+0000","last_became_active":"2023-08-09T12:48:45.911596+0000","last_became_peered":"2023-08-09T12:48:45.911596+0000","last_unstale":"2023-08-09T12:48:46.976856+0000","last_undegraded":"2023-08-09T12:48:46.976856+0000","last_fullsized":"2023-08-09T12:48:46.976856+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:30:03.806678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962802+0000","last_change":"2023-08-09T12:48:46.962725+0000","last_active":"2023-08-09T12:48:46.962802+0000","last_peered":"2023-08-09T12:48:46.962802+0000","last_clean":"2023-08-09T12:48:46.962802+0000","last_became_active":"2023-08-09T12:48:46.962525+0000","last_became_peered":"2023-08-09T12:48:46.962525+0000","last_unstale":"2023-08-09T12:48:46.962802+0000","last_undegraded":"2023-08-09T12:48:46.962802+0000","last_fullsized":"2023-08-09T12:48:46.962802+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:40:02.104275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977861+0000","last_change":"2023-08-09T12:48:45.898690+0000","last_active":"2023-08-09T12:48:46.977861+0000","last_peered":"2023-08-09T12:48:46.977861+0000","last_clean":"2023-08-09T12:48:46.977861+0000","last_became_active":"2023-08-09T12:48:45.898044+0000","last_became_peered":"2023-08-09T12:48:45.898044+0000","last_unstale":"2023-08-09T12:48:46.977861+0000","last_undegraded":"2023-08-09T12:48:46.977861+0000","last_fullsized":"2023-08-09T12:48:46.977861+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:46:10.974195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950459+0000","last_change":"2023-08-09T12:48:46.949845+0000","last_active":"2023-08-09T12:48:46.950459+0000","last_peered":"2023-08-09T12:48:46.950459+0000","last_clean":"2023-08-09T12:48:46.950459+0000","last_became_active":"2023-08-09T12:48:46.949387+0000","last_became_peered":"2023-08-09T12:48:46.949387+0000","last_unstale":"2023-08-09T12:48:46.950459+0000","last_undegraded":"2023-08-09T12:48:46.950459+0000","last_fullsized":"2023-08-09T12:48:46.950459+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:25:45.202659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.914397+0000","last_change":"2023-08-09T12:48:45.914299+0000","last_active":"2023-08-09T12:48:45.914397+0000","last_peered":"2023-08-09T12:48:45.914397+0000","last_clean":"2023-08-09T12:48:45.914397+0000","last_became_active":"2023-08-09T12:48:45.913540+0000","last_became_peered":"2023-08-09T12:48:45.913540+0000","last_unstale":"2023-08-09T12:48:45.914397+0000","last_undegraded":"2023-08-09T12:48:45.914397+0000","last_fullsized":"2023-08-09T12:48:45.914397+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:49:19.826988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.888002+0000","last_change":"2023-08-09T12:48:45.888002+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.888002+0000","last_undegraded":"2023-08-09T12:48:45.888002+0000","last_fullsized":"2023-08-09T12:48:45.888002+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.958664+0000","last_change":"2023-08-09T12:48:45.913084+0000","last_active":"2023-08-09T12:48:46.958664+0000","last_peered":"2023-08-09T12:48:46.958664+0000","last_clean":"2023-08-09T12:48:46.958664+0000","last_became_active":"2023-08-09T12:48:45.912811+0000","last_became_peered":"2023-08-09T12:48:45.912811+0000","last_unstale":"2023-08-09T12:48:46.958664+0000","last_undegraded":"2023-08-09T12:48:46.958664+0000","last_fullsized":"2023-08-09T12:48:46.958664+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:27:48.322806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.966820+0000","last_change":"2023-08-09T12:48:46.966736+0000","last_active":"2023-08-09T12:48:46.966820+0000","last_peered":"2023-08-09T12:48:46.966820+0000","last_clean":"2023-08-09T12:48:46.966820+0000","last_became_active":"2023-08-09T12:48:46.966391+0000","last_became_peered":"2023-08-09T12:48:46.966391+0000","last_unstale":"2023-08-09T12:48:46.966820+0000","last_undegraded":"2023-08-09T12:48:46.966820+0000","last_fullsized":"2023-08-09T12:48:46.966820+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:03:52.085522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978238+0000","last_change":"2023-08-09T12:48:45.903454+0000","last_active":"2023-08-09T12:48:46.978238+0000","last_peered":"2023-08-09T12:48:46.978238+0000","last_clean":"2023-08-09T12:48:46.978238+0000","last_became_active":"2023-08-09T12:48:45.901990+0000","last_became_peered":"2023-08-09T12:48:45.901990+0000","last_unstale":"2023-08-09T12:48:46.978238+0000","last_undegraded":"2023-08-09T12:48:46.978238+0000","last_fullsized":"2023-08-09T12:48:46.978238+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:48:20.785574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.935251+0000","last_change":"2023-08-09T12:48:46.935102+0000","last_active":"2023-08-09T12:48:46.935251+0000","last_peered":"2023-08-09T12:48:46.935251+0000","last_clean":"2023-08-09T12:48:46.935251+0000","last_became_active":"2023-08-09T12:48:46.934483+0000","last_became_peered":"2023-08-09T12:48:46.934483+0000","last_unstale":"2023-08-09T12:48:46.935251+0000","last_undegraded":"2023-08-09T12:48:46.935251+0000","last_fullsized":"2023-08-09T12:48:46.935251+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:51:03.089254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.931154+0000","last_change":"2023-08-09T12:48:45.909979+0000","last_active":"2023-08-09T12:48:46.931154+0000","last_peered":"2023-08-09T12:48:46.931154+0000","last_clean":"2023-08-09T12:48:46.931154+0000","last_became_active":"2023-08-09T12:48:45.909318+0000","last_became_peered":"2023-08-09T12:48:45.909318+0000","last_unstale":"2023-08-09T12:48:46.931154+0000","last_undegraded":"2023-08-09T12:48:46.931154+0000","last_fullsized":"2023-08-09T12:48:46.931154+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:09.939517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962865+0000","last_change":"2023-08-09T12:48:46.961941+0000","last_active":"2023-08-09T12:48:46.962865+0000","last_peered":"2023-08-09T12:48:46.962865+0000","last_clean":"2023-08-09T12:48:46.962865+0000","last_became_active":"2023-08-09T12:48:46.959507+0000","last_became_peered":"2023-08-09T12:48:46.959507+0000","last_unstale":"2023-08-09T12:48:46.962865+0000","last_undegraded":"2023-08-09T12:48:46.962865+0000","last_fullsized":"2023-08-09T12:48:46.962865+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:09:01.457240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.924102+0000","last_change":"2023-08-09T12:48:45.906050+0000","last_active":"2023-08-09T12:48:46.924102+0000","last_peered":"2023-08-09T12:48:46.924102+0000","last_clean":"2023-08-09T12:48:46.924102+0000","last_became_active":"2023-08-09T12:48:45.905750+0000","last_became_peered":"2023-08-09T12:48:45.905750+0000","last_unstale":"2023-08-09T12:48:46.924102+0000","last_undegraded":"2023-08-09T12:48:46.924102+0000","last_fullsized":"2023-08-09T12:48:46.924102+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:28.690148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.952782+0000","last_change":"2023-08-09T12:48:46.952499+0000","last_active":"2023-08-09T12:48:46.952782+0000","last_peered":"2023-08-09T12:48:46.952782+0000","last_clean":"2023-08-09T12:48:46.952782+0000","last_became_active":"2023-08-09T12:48:46.951915+0000","last_became_peered":"2023-08-09T12:48:46.951915+0000","last_unstale":"2023-08-09T12:48:46.952782+0000","last_undegraded":"2023-08-09T12:48:46.952782+0000","last_fullsized":"2023-08-09T12:48:46.952782+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:29.740823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911553+0000","last_change":"2023-08-09T12:48:45.904623+0000","last_active":"2023-08-09T12:48:45.911553+0000","last_peered":"2023-08-09T12:48:45.911553+0000","last_clean":"2023-08-09T12:48:45.911553+0000","last_became_active":"2023-08-09T12:48:45.904073+0000","last_became_peered":"2023-08-09T12:48:45.904073+0000","last_unstale":"2023-08-09T12:48:45.911553+0000","last_undegraded":"2023-08-09T12:48:45.911553+0000","last_fullsized":"2023-08-09T12:48:45.911553+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:45:41.792268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.961768+0000","last_change":"2023-08-09T12:48:46.961129+0000","last_active":"2023-08-09T12:48:46.961768+0000","last_peered":"2023-08-09T12:48:46.961768+0000","last_clean":"2023-08-09T12:48:46.961768+0000","last_became_active":"2023-08-09T12:48:46.954671+0000","last_became_peered":"2023-08-09T12:48:46.954671+0000","last_unstale":"2023-08-09T12:48:46.961768+0000","last_undegraded":"2023-08-09T12:48:46.961768+0000","last_fullsized":"2023-08-09T12:48:46.961768+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:51:15.293415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978038+0000","last_change":"2023-08-09T12:48:45.900760+0000","last_active":"2023-08-09T12:48:46.978038+0000","last_peered":"2023-08-09T12:48:46.978038+0000","last_clean":"2023-08-09T12:48:46.978038+0000","last_became_active":"2023-08-09T12:48:45.899103+0000","last_became_peered":"2023-08-09T12:48:45.899103+0000","last_unstale":"2023-08-09T12:48:46.978038+0000","last_undegraded":"2023-08-09T12:48:46.978038+0000","last_fullsized":"2023-08-09T12:48:46.978038+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:03:34.437537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.959693+0000","last_change":"2023-08-09T12:48:46.959599+0000","last_active":"2023-08-09T12:48:46.959693+0000","last_peered":"2023-08-09T12:48:46.959693+0000","last_clean":"2023-08-09T12:48:46.959693+0000","last_became_active":"2023-08-09T12:48:46.959283+0000","last_became_peered":"2023-08-09T12:48:46.959283+0000","last_unstale":"2023-08-09T12:48:46.959693+0000","last_undegraded":"2023-08-09T12:48:46.959693+0000","last_fullsized":"2023-08-09T12:48:46.959693+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:16.463734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.928975+0000","last_change":"2023-08-09T12:48:45.910936+0000","last_active":"2023-08-09T12:48:46.928975+0000","last_peered":"2023-08-09T12:48:46.928975+0000","last_clean":"2023-08-09T12:48:46.928975+0000","last_became_active":"2023-08-09T12:48:45.910460+0000","last_became_peered":"2023-08-09T12:48:45.910460+0000","last_unstale":"2023-08-09T12:48:46.928975+0000","last_undegraded":"2023-08-09T12:48:46.928975+0000","last_fullsized":"2023-08-09T12:48:46.928975+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:53:54.231683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.942981+0000","last_change":"2023-08-09T12:48:46.942752+0000","last_active":"2023-08-09T12:48:46.942981+0000","last_peered":"2023-08-09T12:48:46.942981+0000","last_clean":"2023-08-09T12:48:46.942981+0000","last_became_active":"2023-08-09T12:48:46.941039+0000","last_became_peered":"2023-08-09T12:48:46.941039+0000","last_unstale":"2023-08-09T12:48:46.942981+0000","last_undegraded":"2023-08-09T12:48:46.942981+0000","last_fullsized":"2023-08-09T12:48:46.942981+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:26:08.488438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.929590+0000","last_change":"2023-08-09T12:48:45.905909+0000","last_active":"2023-08-09T12:48:46.929590+0000","last_peered":"2023-08-09T12:48:46.929590+0000","last_clean":"2023-08-09T12:48:46.929590+0000","last_became_active":"2023-08-09T12:48:45.905567+0000","last_became_peered":"2023-08-09T12:48:45.905567+0000","last_unstale":"2023-08-09T12:48:46.929590+0000","last_undegraded":"2023-08-09T12:48:46.929590+0000","last_fullsized":"2023-08-09T12:48:46.929590+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:56.553013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887293+0000","last_change":"2023-08-09T12:48:45.887293+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887293+0000","last_undegraded":"2023-08-09T12:48:45.887293+0000","last_fullsized":"2023-08-09T12:48:45.887293+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911607+0000","last_change":"2023-08-09T12:48:45.911167+0000","last_active":"2023-08-09T12:48:45.911607+0000","last_peered":"2023-08-09T12:48:45.911607+0000","last_clean":"2023-08-09T12:48:45.911607+0000","last_became_active":"2023-08-09T12:48:45.910891+0000","last_became_peered":"2023-08-09T12:48:45.910891+0000","last_unstale":"2023-08-09T12:48:45.911607+0000","last_undegraded":"2023-08-09T12:48:45.911607+0000","last_fullsized":"2023-08-09T12:48:45.911607+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:18.953781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.892167+0000","last_change":"2023-08-09T12:48:45.892167+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.892167+0000","last_undegraded":"2023-08-09T12:48:45.892167+0000","last_fullsized":"2023-08-09T12:48:45.892167+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.951200+0000","last_change":"2023-08-09T12:48:45.910842+0000","last_active":"2023-08-09T12:48:46.951200+0000","last_peered":"2023-08-09T12:48:46.951200+0000","last_clean":"2023-08-09T12:48:46.951200+0000","last_became_active":"2023-08-09T12:48:45.910039+0000","last_became_peered":"2023-08-09T12:48:45.910039+0000","last_unstale":"2023-08-09T12:48:46.951200+0000","last_undegraded":"2023-08-09T12:48:46.951200+0000","last_fullsized":"2023-08-09T12:48:46.951200+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:50:19.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.893483+0000","last_change":"2023-08-09T12:48:45.893483+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.893483+0000","last_undegraded":"2023-08-09T12:48:45.893483+0000","last_fullsized":"2023-08-09T12:48:45.893483+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.928656+0000","last_change":"2023-08-09T12:48:45.907402+0000","last_active":"2023-08-09T12:48:46.928656+0000","last_peered":"2023-08-09T12:48:46.928656+0000","last_clean":"2023-08-09T12:48:46.928656+0000","last_became_active":"2023-08-09T12:48:45.906892+0000","last_became_peered":"2023-08-09T12:48:45.906892+0000","last_unstale":"2023-08-09T12:48:46.928656+0000","last_undegraded":"2023-08-09T12:48:46.928656+0000","last_fullsized":"2023-08-09T12:48:46.928656+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:43:58.088826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.894112+0000","last_change":"2023-08-09T12:48:45.894112+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.894112+0000","last_undegraded":"2023-08-09T12:48:45.894112+0000","last_fullsized":"2023-08-09T12:48:45.894112+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.912936+0000","last_change":"2023-08-09T12:48:45.911823+0000","last_active":"2023-08-09T12:48:45.912936+0000","last_peered":"2023-08-09T12:48:45.912936+0000","last_clean":"2023-08-09T12:48:45.912936+0000","last_became_active":"2023-08-09T12:48:45.911339+0000","last_became_peered":"2023-08-09T12:48:45.911339+0000","last_unstale":"2023-08-09T12:48:45.912936+0000","last_undegraded":"2023-08-09T12:48:45.912936+0000","last_fullsized":"2023-08-09T12:48:45.912936+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:49.711986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.942364+0000","last_change":"2023-08-09T12:48:46.942177+0000","last_active":"2023-08-09T12:48:46.942364+0000","last_peered":"2023-08-09T12:48:46.942364+0000","last_clean":"2023-08-09T12:48:46.942364+0000","last_became_active":"2023-08-09T12:48:46.940133+0000","last_became_peered":"2023-08-09T12:48:46.940133+0000","last_unstale":"2023-08-09T12:48:46.942364+0000","last_undegraded":"2023-08-09T12:48:46.942364+0000","last_fullsized":"2023-08-09T12:48:46.942364+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:41:18.263898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.953930+0000","last_change":"2023-08-09T12:48:45.909884+0000","last_active":"2023-08-09T12:48:46.953930+0000","last_peered":"2023-08-09T12:48:46.953930+0000","last_clean":"2023-08-09T12:48:46.953930+0000","last_became_active":"2023-08-09T12:48:45.909635+0000","last_became_peered":"2023-08-09T12:48:45.909635+0000","last_unstale":"2023-08-09T12:48:46.953930+0000","last_undegraded":"2023-08-09T12:48:46.953930+0000","last_fullsized":"2023-08-09T12:48:46.953930+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:33:26.713603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.962465+0000","last_change":"2023-08-09T12:48:46.962403+0000","last_active":"2023-08-09T12:48:46.962465+0000","last_peered":"2023-08-09T12:48:46.962465+0000","last_clean":"2023-08-09T12:48:46.962465+0000","last_became_active":"2023-08-09T12:48:46.961621+0000","last_became_peered":"2023-08-09T12:48:46.961621+0000","last_unstale":"2023-08-09T12:48:46.962465+0000","last_undegraded":"2023-08-09T12:48:46.962465+0000","last_fullsized":"2023-08-09T12:48:46.962465+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:28:28.778739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.923002+0000","last_change":"2023-08-09T12:48:45.907971+0000","last_active":"2023-08-09T12:48:46.923002+0000","last_peered":"2023-08-09T12:48:46.923002+0000","last_clean":"2023-08-09T12:48:46.923002+0000","last_became_active":"2023-08-09T12:48:45.907721+0000","last_became_peered":"2023-08-09T12:48:45.907721+0000","last_unstale":"2023-08-09T12:48:46.923002+0000","last_undegraded":"2023-08-09T12:48:46.923002+0000","last_fullsized":"2023-08-09T12:48:46.923002+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:37:16.729312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":443,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.926685+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:48:46.926685+0000","last_peered":"2023-08-09T12:48:46.926685+0000","last_clean":"2023-08-09T12:48:46.926685+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:48:46.926685+0000","last_undegraded":"2023-08-09T12:48:46.926685+0000","last_fullsized":"2023-08-09T12:48:46.926685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:12.363669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.951305+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:48:46.951305+0000","last_peered":"2023-08-09T12:48:46.951305+0000","last_clean":"2023-08-09T12:48:46.951305+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:48:46.951305+0000","last_undegraded":"2023-08-09T12:48:46.951305+0000","last_fullsized":"2023-08-09T12:48:46.951305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:34:33.338962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954207+0000","last_change":"2023-08-09T12:48:46.953789+0000","last_active":"2023-08-09T12:48:46.954207+0000","last_peered":"2023-08-09T12:48:46.954207+0000","last_clean":"2023-08-09T12:48:46.954207+0000","last_became_active":"2023-08-09T12:48:46.953417+0000","last_became_peered":"2023-08-09T12:48:46.953417+0000","last_unstale":"2023-08-09T12:48:46.954207+0000","last_undegraded":"2023-08-09T12:48:46.954207+0000","last_fullsized":"2023-08-09T12:48:46.954207+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:24:58.657906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.927702+0000","last_change":"2023-08-09T12:48:45.907769+0000","last_active":"2023-08-09T12:48:46.927702+0000","last_peered":"2023-08-09T12:48:46.927702+0000","last_clean":"2023-08-09T12:48:46.927702+0000","last_became_active":"2023-08-09T12:48:45.906964+0000","last_became_peered":"2023-08-09T12:48:45.906964+0000","last_unstale":"2023-08-09T12:48:46.927702+0000","last_undegraded":"2023-08-09T12:48:46.927702+0000","last_fullsized":"2023-08-09T12:48:46.927702+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:08.623403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":287,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.926355+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:48:46.926355+0000","last_peered":"2023-08-09T12:48:46.926355+0000","last_clean":"2023-08-09T12:48:46.926355+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:48:46.926355+0000","last_undegraded":"2023-08-09T12:48:46.926355+0000","last_fullsized":"2023-08-09T12:48:46.926355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:43:49.173542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.968921+0000","last_change":"2023-08-09T12:48:46.968109+0000","last_active":"2023-08-09T12:48:46.968921+0000","last_peered":"2023-08-09T12:48:46.968921+0000","last_clean":"2023-08-09T12:48:46.968921+0000","last_became_active":"2023-08-09T12:48:46.967751+0000","last_became_peered":"2023-08-09T12:48:46.967751+0000","last_unstale":"2023-08-09T12:48:46.968921+0000","last_undegraded":"2023-08-09T12:48:46.968921+0000","last_fullsized":"2023-08-09T12:48:46.968921+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:13.639064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.911733+0000","last_change":"2023-08-09T12:48:45.911662+0000","last_active":"2023-08-09T12:48:45.911733+0000","last_peered":"2023-08-09T12:48:45.911733+0000","last_clean":"2023-08-09T12:48:45.911733+0000","last_became_active":"2023-08-09T12:48:45.910793+0000","last_became_peered":"2023-08-09T12:48:45.910793+0000","last_unstale":"2023-08-09T12:48:45.911733+0000","last_undegraded":"2023-08-09T12:48:45.911733+0000","last_fullsized":"2023-08-09T12:48:45.911733+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:38.651036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.929950+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:48:46.929950+0000","last_peered":"2023-08-09T12:48:46.929950+0000","last_clean":"2023-08-09T12:48:46.929950+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:48:46.929950+0000","last_undegraded":"2023-08-09T12:48:46.929950+0000","last_fullsized":"2023-08-09T12:48:46.929950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:59:05.444945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.887432+0000","last_change":"2023-08-09T12:48:45.887432+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.887432+0000","last_undegraded":"2023-08-09T12:48:45.887432+0000","last_fullsized":"2023-08-09T12:48:45.887432+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"160'2","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.977566+0000","last_change":"2023-08-09T12:48:45.889867+0000","last_active":"2023-08-09T12:48:46.977566+0000","last_peered":"2023-08-09T12:48:46.977566+0000","last_clean":"2023-08-09T12:48:46.977566+0000","last_became_active":"2023-08-09T12:48:45.889203+0000","last_became_peered":"2023-08-09T12:48:45.889203+0000","last_unstale":"2023-08-09T12:48:46.977566+0000","last_undegraded":"2023-08-09T12:48:46.977566+0000","last_fullsized":"2023-08-09T12:48:46.977566+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:22:25.084122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950924+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:48:46.950924+0000","last_peered":"2023-08-09T12:48:46.950924+0000","last_clean":"2023-08-09T12:48:46.950924+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:48:46.950924+0000","last_undegraded":"2023-08-09T12:48:46.950924+0000","last_fullsized":"2023-08-09T12:48:46.950924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:46:56.473393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.954925+0000","last_change":"2023-08-09T12:48:46.954804+0000","last_active":"2023-08-09T12:48:46.954925+0000","last_peered":"2023-08-09T12:48:46.954925+0000","last_clean":"2023-08-09T12:48:46.954925+0000","last_became_active":"2023-08-09T12:48:46.954030+0000","last_became_peered":"2023-08-09T12:48:46.954030+0000","last_unstale":"2023-08-09T12:48:46.954925+0000","last_undegraded":"2023-08-09T12:48:46.954925+0000","last_fullsized":"2023-08-09T12:48:46.954925+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:49.911558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"160'3","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.978359+0000","last_change":"2023-08-09T12:48:45.904271+0000","last_active":"2023-08-09T12:48:46.978359+0000","last_peered":"2023-08-09T12:48:46.978359+0000","last_clean":"2023-08-09T12:48:46.978359+0000","last_became_active":"2023-08-09T12:48:45.903570+0000","last_became_peered":"2023-08-09T12:48:45.903570+0000","last_unstale":"2023-08-09T12:48:46.978359+0000","last_undegraded":"2023-08-09T12:48:46.978359+0000","last_fullsized":"2023-08-09T12:48:46.978359+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:06:55.399101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.892643+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:48:45.892643+0000","last_peered":"2023-08-09T12:48:45.892643+0000","last_clean":"2023-08-09T12:48:45.892643+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:48:45.892643+0000","last_undegraded":"2023-08-09T12:48:45.892643+0000","last_fullsized":"2023-08-09T12:48:45.892643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:38.640549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.960104+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:46.960104+0000","last_peered":"2023-08-09T12:48:46.960104+0000","last_clean":"2023-08-09T12:48:46.960104+0000","last_became_active":"2023-08-09T12:48:46.959496+0000","last_became_peered":"2023-08-09T12:48:46.959496+0000","last_unstale":"2023-08-09T12:48:46.960104+0000","last_undegraded":"2023-08-09T12:48:46.960104+0000","last_fullsized":"2023-08-09T12:48:46.960104+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:31:39.093936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"160'6","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.980029+0000","last_change":"2023-08-09T12:48:45.908372+0000","last_active":"2023-08-09T12:48:46.980029+0000","last_peered":"2023-08-09T12:48:46.980029+0000","last_clean":"2023-08-09T12:48:46.980029+0000","last_became_active":"2023-08-09T12:48:45.907802+0000","last_became_peered":"2023-08-09T12:48:45.907802+0000","last_unstale":"2023-08-09T12:48:46.980029+0000","last_undegraded":"2023-08-09T12:48:46.980029+0000","last_fullsized":"2023-08-09T12:48:46.980029+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:21.647701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":287,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.925801+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:48:46.925801+0000","last_peered":"2023-08-09T12:48:46.925801+0000","last_clean":"2023-08-09T12:48:46.925801+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:48:46.925801+0000","last_undegraded":"2023-08-09T12:48:46.925801+0000","last_fullsized":"2023-08-09T12:48:46.925801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:42:07.531778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.944679+0000","last_change":"2023-08-09T12:48:46.944465+0000","last_active":"2023-08-09T12:48:46.944679+0000","last_peered":"2023-08-09T12:48:46.944679+0000","last_clean":"2023-08-09T12:48:46.944679+0000","last_became_active":"2023-08-09T12:48:46.943732+0000","last_became_peered":"2023-08-09T12:48:46.943732+0000","last_unstale":"2023-08-09T12:48:46.944679+0000","last_undegraded":"2023-08-09T12:48:46.944679+0000","last_fullsized":"2023-08-09T12:48:46.944679+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:31.914515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.950953+0000","last_change":"2023-08-09T12:48:45.910997+0000","last_active":"2023-08-09T12:48:46.950953+0000","last_peered":"2023-08-09T12:48:46.950953+0000","last_clean":"2023-08-09T12:48:46.950953+0000","last_became_active":"2023-08-09T12:48:45.910593+0000","last_became_peered":"2023-08-09T12:48:45.910593+0000","last_unstale":"2023-08-09T12:48:46.950953+0000","last_undegraded":"2023-08-09T12:48:46.950953+0000","last_fullsized":"2023-08-09T12:48:46.950953+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:56.684208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-09T12:48:45.908293+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:48:45.908293+0000","last_peered":"2023-08-09T12:48:45.908293+0000","last_clean":"2023-08-09T12:48:45.908293+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:48:45.908293+0000","last_undegraded":"2023-08-09T12:48:45.908293+0000","last_fullsized":"2023-08-09T12:48:45.908293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:55:08.007694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2023-08-09T12:48:45.891274+0000","last_change":"2023-08-09T12:48:45.891274+0000","last_active":"2023-08-09T12:48:45.873762+0000","last_peered":"2023-08-09T12:48:45.873762+0000","last_clean":"2023-08-09T12:48:45.873762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:48:45.891274+0000","last_undegraded":"2023-08-09T12:48:45.891274+0000","last_fullsized":"2023-08-09T12:48:45.891274+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.931677+0000","last_change":"2023-08-09T12:48:45.890515+0000","last_active":"2023-08-09T12:48:46.931677+0000","last_peered":"2023-08-09T12:48:46.931677+0000","last_clean":"2023-08-09T12:48:46.931677+0000","last_became_active":"2023-08-09T12:48:45.889827+0000","last_became_peered":"2023-08-09T12:48:45.889827+0000","last_unstale":"2023-08-09T12:48:46.931677+0000","last_undegraded":"2023-08-09T12:48:46.931677+0000","last_fullsized":"2023-08-09T12:48:46.931677+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:13.113325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-09T12:48:46.927912+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:48:46.927912+0000","last_peered":"2023-08-09T12:48:46.927912+0000","last_clean":"2023-08-09T12:48:46.927912+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:48:46.927912+0000","last_undegraded":"2023-08-09T12:48:46.927912+0000","last_fullsized":"2023-08-09T12:48:46.927912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:52:20.443006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1507,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193805,"statfs":{"total":200000000,"available":198456779,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1439999999999999,"15min":1.107},"min":{"1min":0.64300000000000002,"5min":0.627,"15min":0.59899999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.544},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0900000000000001,"15min":1.091},"min":{"1min":0.70499999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7509999999999999,"5min":1.7769999999999999,"15min":2.0459999999999998},"last":1.355}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.224,"15min":1.149},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.63300000000000001},"max":{"1min":1.629,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.022},{"interface":"front","average":{"1min":1.119,"5min":1.167,"15min":1.133},"min":{"1min":0.73499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.26,"15min":1.2050000000000001},"min":{"1min":0.83299999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.591,"5min":1.96,"15min":2.1459999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.2230000000000001,"15min":1.1759999999999999},"min":{"1min":0.81200000000000006,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.7450000000000001,"15min":2.173},"last":1.593}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.341,"15min":1.268},"min":{"1min":0.79100000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.806,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.331,"15min":1.2949999999999999},"min":{"1min":0.97899999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6200000000000001,"5min":1.992,"15min":2.282},"last":1.4910000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.276,"15min":1.2330000000000001},"min":{"1min":0.98499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.948,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.706},{"interface":"front","average":{"1min":1.302,"5min":1.3799999999999999,"15min":1.3200000000000001},"min":{"1min":0.90800000000000003,"5min":0.82299999999999995,"15min":0.58599999999999997},"max":{"1min":1.764,"5min":2.5070000000000001,"15min":4.6200000000000001},"last":1.647}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.878,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.978,"5min":2.1699999999999999,"15min":2.802},"last":1.397},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.536,"15min":1.502},"min":{"1min":0.97799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1299999999999999,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.8009999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.522,"15min":1.486},"min":{"1min":1.1259999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2370000000000001,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":1.8839999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.542,"15min":1.476},"min":{"1min":1.073,"5min":1.0029999999999999,"15min":0.623},"max":{"1min":1.95,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.7490000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.135},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.544,"5min":1.986,"15min":2.54},"last":1.573},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.099,"15min":1.083},"min":{"1min":0.72099999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.615,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.179}]},{"osd":1,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.226,"15min":1.2290000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.51,"5min":1.996,"15min":2.306},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.3009999999999999,"15min":1.3160000000000001},"min":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":0.95199999999999996}]},{"osd":2,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1839999999999999,"15min":1.1240000000000001},"min":{"1min":0.91100000000000003,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.28,"15min":1.2789999999999999},"min":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.772,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7070000000000001,"5min":2.327,"15min":2.327},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.3680000000000001,"15min":1.3160000000000001},"min":{"1min":1.0549999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.724,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.327}]},{"osd":4,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3340000000000001,"15min":1.3540000000000001},"min":{"1min":1.01,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.651,"5min":2.028,"15min":11.058999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.339,"15min":1.351},"min":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":2.29,"15min":2.3479999999999999},"last":1.603}]},{"osd":5,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.0089999999999999,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.71,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.012},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4750000000000001,"15min":1.4890000000000001},"min":{"1min":1.087,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.8009999999999999,"5min":2.222,"15min":2.8580000000000001},"last":1.3600000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.5089999999999999,"15min":1.4670000000000001},"min":{"1min":1.137,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9059999999999999,"5min":2.1520000000000001,"15min":2.7999999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.5129999999999999,"15min":1.4690000000000001},"min":{"1min":1.1259999999999999,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.8109999999999999,"5min":2.7810000000000001,"15min":3.621},"last":1.236}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.68000000000000005,"15min":0.55300000000000005},"max":{"1min":1.591,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2070000000000001,"15min":1.113},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.97,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.2869999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3680000000000001,"15min":1.3109999999999999},"min":{"1min":0.78600000000000003,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.7190000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.284,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7310000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.97599999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.264,"15min":1.22},"min":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2310000000000001,"15min":1.2030000000000001},"min":{"1min":0.78800000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.554,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.347}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.2410000000000001},"min":{"1min":1.006,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5429999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.393,"15min":1.3740000000000001},"min":{"1min":0.998,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":1.7809999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.1259999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.335,"15min":1.2569999999999999},"min":{"1min":0.877,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":1.7549999999999999,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":0.877},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.456,"15min":1.389},"min":{"1min":1.032,"5min":0.80600000000000005,"15min":0.628},"max":{"1min":1.7190000000000001,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.4330000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.4419999999999999,"15min":1.367},"min":{"1min":1.006,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.833,"5min":2.952,"15min":2.952},"last":1.458},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":0.98199999999999998,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.762,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.4079999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.575,"15min":1.53},"min":{"1min":1.0860000000000001,"5min":0.86599999999999999,"15min":0.67200000000000004},"max":{"1min":2.0329999999999999,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6399999999999999,"15min":1.5469999999999999},"min":{"1min":1.069,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.9179999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.242}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194383,"statfs":{"total":200000000,"available":199048849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1040000000000001,"15min":1.0940000000000001},"min":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.579,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.391},{"interface":"front","average":{"1min":1.145,"5min":1.131,"15min":1.119},"min":{"1min":0.77000000000000002,"5min":0.66500000000000004,"15min":0.64800000000000002},"max":{"1min":1.5740000000000001,"5min":1.635,"15min":3.4100000000000001},"last":1.4750000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.288,"15min":1.3180000000000001},"min":{"1min":0.88100000000000001,"5min":0.77400000000000002,"15min":0.48899999999999999},"max":{"1min":1.863,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.92600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8240000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.4550000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.306,"15min":1.3169999999999999},"min":{"1min":0.86199999999999999,"5min":0.70799999999999996,"15min":0.54900000000000004},"max":{"1min":1.9470000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3420000000000001,"15min":1.3300000000000001},"min":{"1min":0.81499999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8100000000000001,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.5089999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2889999999999999,"15min":1.248},"min":{"1min":1.0329999999999999,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.728,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3320000000000001,"15min":1.335},"min":{"1min":0.98199999999999998,"5min":0.93999999999999995,"15min":0.82699999999999996},"max":{"1min":2.0539999999999998,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.631}]},{"osd":5,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3759999999999999,"15min":1.381},"min":{"1min":0.85499999999999998,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":1.857,"5min":3.137,"15min":3.137},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.367,"15min":1.381},"min":{"1min":0.89400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":2.403,"5min":2.403,"15min":3.3620000000000001},"last":1.3440000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4399999999999999,"15min":1.466},"min":{"1min":0.82299999999999995,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":2.262,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.143},{"interface":"front","average":{"1min":1.498,"5min":1.5469999999999999,"15min":1.538},"min":{"1min":1.0660000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1070000000000002,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.3100000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.5249999999999999,"15min":1.5289999999999999},"min":{"1min":1.1950000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.202},{"interface":"front","average":{"1min":1.621,"5min":1.599,"15min":1.613},"min":{"1min":1.2689999999999999,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.4590000000000001,"5min":2.875,"15min":2.875},"last":1.53}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.84699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.458,"5min":1.458,"15min":4.4109999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.024,"15min":0.94199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.698,"5min":2.778,"15min":3.2269999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.52000000000000002,"5min":0.41099999999999998,"15min":0.38100000000000001},"max":{"1min":1.448,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.127,"15min":0.98799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.407,"5min":2.0219999999999998,"15min":2.0880000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.103,"15min":1.129},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.48,"5min":1.9259999999999999,"15min":18.145},"last":0.874},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2569999999999999,"15min":1.208},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.619,"5min":2.169,"15min":2.169},"last":0.64900000000000002}]},{"osd":4,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.78200000000000003,"5min":0.75,"15min":0.745},"max":{"1min":1.7709999999999999,"5min":1.8660000000000001,"15min":3.5110000000000001},"last":1.151},{"interface":"front","average":{"1min":1.214,"5min":1.306,"15min":1.325},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":1.5640000000000001,"5min":2.056,"15min":3.5960000000000001},"last":1.208}]},{"osd":5,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.345,"15min":1.4299999999999999},"min":{"1min":0.82099999999999995,"5min":0.80500000000000005,"15min":0.72999999999999998},"max":{"1min":1.7150000000000001,"5min":2.2389999999999999,"15min":18.094000000000001},"last":1.385},{"interface":"front","average":{"1min":1.347,"5min":1.429,"15min":1.389},"min":{"1min":0.752,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.6020000000000001,"5min":2.2959999999999998,"15min":14.105},"last":0.97999999999999998}]},{"osd":6,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3899999999999999,"15min":1.357},"min":{"1min":0.92200000000000004,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.641,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4319999999999999,"15min":1.462},"min":{"1min":0.90300000000000002,"5min":0.86399999999999999,"15min":0.77700000000000002},"max":{"1min":1.792,"5min":2.0099999999999998,"15min":4.0220000000000002},"last":1.45}]},{"osd":7,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.526,"15min":1.4279999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":1.7430000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.012},{"interface":"front","average":{"1min":1.391,"5min":1.4950000000000001,"15min":1.4139999999999999},"min":{"1min":0.96299999999999997,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":1.6759999999999999,"5min":2.073,"15min":3.016},"last":1.266}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90900000000000003,"15min":0.86699999999999999},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":1.3759999999999999,"5min":1.597,"15min":1.716},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.028,"15min":0.96699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.5680000000000001,"5min":1.73,"15min":2.9009999999999998},"last":0.75700000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92000000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.004,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5,"5min":1.823,"15min":1.869},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.149,"15min":1.1559999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.615,"5min":1.681,"15min":3.2850000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1930000000000001,"15min":1.1639999999999999},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.637,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":0.871}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4510000000000001,"15min":1.419},"min":{"1min":0.93200000000000005,"5min":0.83499999999999996,"15min":0.81899999999999995},"max":{"1min":1.7250000000000001,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.351,"15min":1.3},"min":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.694,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":1.302}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.401,"15min":1.375},"min":{"1min":0.78900000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0110000000000001,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.448,"15min":1.472},"min":{"1min":0.878,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8120000000000001,"5min":2.4780000000000002,"15min":4.806},"last":1.3220000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8580000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.468,"15min":1.4299999999999999},"min":{"1min":0.89600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.901,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":1.4530000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.462,"15min":1.3839999999999999},"min":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"max":{"1min":1.8640000000000001,"5min":2.464,"15min":2.464},"last":1.663},{"interface":"front","average":{"1min":1.431,"5min":1.536,"15min":1.5269999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.036,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.4970000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":915,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194397,"statfs":{"total":200000000,"available":199062597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91000000000000003,"15min":0.89400000000000002},"min":{"1min":0.53000000000000003,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":1.542,"5min":2.621,"15min":2.621},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.008,"15min":1.2709999999999999},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.5169999999999999,"5min":1.9530000000000001,"15min":88.254999999999995},"last":1.0489999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.998,"15min":0.96699999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":3.0209999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2470000000000001,"15min":1.1699999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7849999999999999,"5min":2.0449999999999999,"15min":3.1890000000000001},"last":1.353}]},{"osd":3,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1879999999999999,"15min":1.1200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.7290000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.085,"15min":1.0069999999999999},"min":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.397,"5min":1.819,"15min":5.4320000000000004},"last":1.2230000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.24,"15min":1.304},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.581,"5min":2.391,"15min":25.172000000000001},"last":1.127},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.391,"15min":1.3300000000000001},"min":{"1min":0.93500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.085,"5min":3.762,"15min":3.762},"last":1.607}]},{"osd":5,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3260000000000001,"15min":1.4079999999999999},"min":{"1min":0.92200000000000004,"5min":0.751,"15min":0.751},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":28.710000000000001},"last":1.7709999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.327,"15min":1.2989999999999999},"min":{"1min":0.84599999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6910000000000001,"5min":1.9910000000000001,"15min":3.762},"last":1.2889999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4510000000000001,"15min":1.4379999999999999},"min":{"1min":1.022,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7230000000000001,"5min":1.841,"15min":6.0460000000000003},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.4419999999999999,"15min":1.397},"min":{"1min":1.0609999999999999,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":1.6759999999999999,"5min":2.0960000000000001,"15min":2.1480000000000001},"last":1.4079999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.532,"15min":1.595},"min":{"1min":0.89800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.2370000000000001,"5min":2.5089999999999999,"15min":26.975999999999999},"last":1.498},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5389999999999999,"15min":1.589},"min":{"1min":1.141,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.988,"5min":2.492,"15min":28.765000000000001},"last":1.6639999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1491,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193820,"statfs":{"total":200000000,"available":198472229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.61299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.819},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0249999999999999,"15min":0.97799999999999998},"min":{"1min":0.60699999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.331,"5min":1.6699999999999999,"15min":6.1749999999999998},"last":1.052}]},{"osd":2,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.032,"15min":0.97899999999999998},"min":{"1min":0.63500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.411,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.044},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5189999999999999,"5min":1.732,"15min":6.2549999999999999},"last":1.1439999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.0429999999999999,"15min":0.97899999999999998},"min":{"1min":0.68300000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4570000000000001,"5min":1.6699999999999999,"15min":9.6069999999999993},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.1850000000000001},"min":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.0940000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3240000000000001,"15min":1.337},"min":{"1min":0.90600000000000003,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.6919999999999999,"5min":1.8240000000000001,"15min":9.9629999999999992},"last":0.996},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.377,"15min":1.3129999999999999},"min":{"1min":0.85799999999999998,"5min":0.78600000000000003,"15min":0.77900000000000003},"max":{"1min":1.825,"5min":1.879,"15min":1.879},"last":1.252}]},{"osd":5,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.351,"15min":1.325},"min":{"1min":0.86299999999999999,"5min":0.82799999999999996,"15min":0.76300000000000001},"max":{"1min":1.8200000000000001,"5min":2.0419999999999998,"15min":10.004},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4359999999999999,"15min":1.3939999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.728,"5min":2.0569999999999999,"15min":2.161},"last":1.381}]},{"osd":6,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4259999999999999,"15min":1.369},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.863,"5min":2.2000000000000002,"15min":6.4290000000000003},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":1.7030000000000001,"5min":2.1549999999999998,"15min":9.9190000000000005},"last":1.355}]},{"osd":7,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.466,"15min":1.458},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.9319999999999999,"5min":2.2909999999999999,"15min":18.114000000000001},"last":1.278},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.5209999999999999,"15min":1.4850000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.891,"5min":2.1120000000000001,"15min":9.5640000000000001},"last":1.292}]}]}],"pool_statfs":[]}} 2023-08-09T12:48:52.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-08-09T12:48:52.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.896096+0000', 'last_change': '2023-08-09T12:48:45.896096+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.896096+0000', 'last_undegraded': '2023-08-09T12:48:45.896096+0000', 'last_fullsized': '2023-08-09T12:48:45.896096+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-08-09T12:48:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.895523+0000', 'last_change': '2023-08-09T12:48:45.895523+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.895523+0000', 'last_undegraded': '2023-08-09T12:48:45.895523+0000', 'last_fullsized': '2023-08-09T12:48:45.895523+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-08-09T12:48:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.887549+0000', 'last_change': '2023-08-09T12:48:45.887549+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.887549+0000', 'last_undegraded': '2023-08-09T12:48:45.887549+0000', 'last_fullsized': '2023-08-09T12:48:45.887549+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:48:52.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-08-09T12:48:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.898244+0000', 'last_change': '2023-08-09T12:48:45.898244+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.898244+0000', 'last_undegraded': '2023-08-09T12:48:45.898244+0000', 'last_fullsized': '2023-08-09T12:48:45.898244+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-08-09T12:48:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.895333+0000', 'last_change': '2023-08-09T12:48:45.895333+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.895333+0000', 'last_undegraded': '2023-08-09T12:48:45.895333+0000', 'last_fullsized': '2023-08-09T12:48:45.895333+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-08-09T12:48:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.892317+0000', 'last_change': '2023-08-09T12:48:45.892317+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.892317+0000', 'last_undegraded': '2023-08-09T12:48:45.892317+0000', 'last_fullsized': '2023-08-09T12:48:45.892317+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-08-09T12:48:52.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.894654+0000', 'last_change': '2023-08-09T12:48:45.894654+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.894654+0000', 'last_undegraded': '2023-08-09T12:48:45.894654+0000', 'last_fullsized': '2023-08-09T12:48:45.894654+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-08-09T12:48:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.888878+0000', 'last_change': '2023-08-09T12:48:45.888878+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.888878+0000', 'last_undegraded': '2023-08-09T12:48:45.888878+0000', 'last_fullsized': '2023-08-09T12:48:45.888878+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:48:52.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-08-09T12:48:52.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.888362+0000', 'last_change': '2023-08-09T12:48:45.888362+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.888362+0000', 'last_undegraded': '2023-08-09T12:48:45.888362+0000', 'last_fullsized': '2023-08-09T12:48:45.888362+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:48:52.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-08-09T12:48:52.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.888002+0000', 'last_change': '2023-08-09T12:48:45.888002+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.888002+0000', 'last_undegraded': '2023-08-09T12:48:45.888002+0000', 'last_fullsized': '2023-08-09T12:48:45.888002+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:48:52.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-08-09T12:48:52.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.887293+0000', 'last_change': '2023-08-09T12:48:45.887293+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.887293+0000', 'last_undegraded': '2023-08-09T12:48:45.887293+0000', 'last_fullsized': '2023-08-09T12:48:45.887293+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:48:52.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-08-09T12:48:52.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.892167+0000', 'last_change': '2023-08-09T12:48:45.892167+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.892167+0000', 'last_undegraded': '2023-08-09T12:48:45.892167+0000', 'last_fullsized': '2023-08-09T12:48:45.892167+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-08-09T12:48:52.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.893483+0000', 'last_change': '2023-08-09T12:48:45.893483+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.893483+0000', 'last_undegraded': '2023-08-09T12:48:45.893483+0000', 'last_fullsized': '2023-08-09T12:48:45.893483+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-08-09T12:48:52.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.894112+0000', 'last_change': '2023-08-09T12:48:45.894112+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.894112+0000', 'last_undegraded': '2023-08-09T12:48:45.894112+0000', 'last_fullsized': '2023-08-09T12:48:45.894112+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-08-09T12:48:52.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.887432+0000', 'last_change': '2023-08-09T12:48:45.887432+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.887432+0000', 'last_undegraded': '2023-08-09T12:48:45.887432+0000', 'last_fullsized': '2023-08-09T12:48:45.887432+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-09T12:48:52.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-08-09T12:48:52.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2023-08-09T12:48:45.891274+0000', 'last_change': '2023-08-09T12:48:45.891274+0000', 'last_active': '2023-08-09T12:48:45.873762+0000', 'last_peered': '2023-08-09T12:48:45.873762+0000', 'last_clean': '2023-08-09T12:48:45.873762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-09T12:48:45.891274+0000', 'last_undegraded': '2023-08-09T12:48:45.891274+0000', 'last_fullsized': '2023-08-09T12:48:45.891274+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'last_clean_scrub_stamp': '2023-08-09T12:48:45.873762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-09T12:48:52.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-09T12:48:52.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.806+0000 7fdc660e0640 1 Processor -- start 2023-08-09T12:48:52.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.806+0000 7fdc660e0640 1 -- start start 2023-08-09T12:48:52.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc660e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc6015ced0 0x7fdc600d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc660e0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc600d1490 con 0x7fdc600b4c60 2023-08-09T12:48:52.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc660e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc600d1730 con 0x7fdc600b83f0 2023-08-09T12:48:52.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc660e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6015d2b0 con 0x7fdc6015ced0 2023-08-09T12:48:52.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc658df640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdc600b4c60 0x7fdc600b5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41052/0 (socket says 172.21.15.17:41052) 2023-08-09T12:48:52.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc658df640 1 -- 172.21.15.17:0/1390793798 learned_addr learned my addr 172.21.15.17:0/1390793798 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc650de640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc6015ced0 0x7fdc600d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742599414 0 0) 0x7fdc600d1490 con 0x7fdc600b4c60 2023-08-09T12:48:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc48003520 con 0x7fdc600b4c60 2023-08-09T12:48:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035200448 0 0) 0x7fdc48003520 con 0x7fdc600b4c60 2023-08-09T12:48:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc6015ced0 msgr2=0x7fdc600d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc6015ced0 0x7fdc600d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 >> v1:172.21.15.142:6789/0 conn(0x7fdc600b83f0 legacy=0x7fdc600b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc600d1a10 con 0x7fdc600b4c60 2023-08-09T12:48:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fdc58001670 con 0x7fdc600b4c60 2023-08-09T12:48:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 >> v1:172.21.15.17:6789/0 conn(0x7fdc600b4c60 legacy=0x7fdc600b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc6015ced0 0x7fdc480039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc48003f20 0x7fdc480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48004d00 0x7fdc48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4800ba30 con 0x7fdc48003f20 2023-08-09T12:48:52.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4800bba0 con 0x7fdc48004d00 2023-08-09T12:48:52.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.808+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4800bd60 con 0x7fdc6015ced0 2023-08-09T12:48:52.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.809+0000 7fdc648dd640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc48003f20 0x7fdc480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.809+0000 7fdc658df640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48004d00 0x7fdc48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.809+0000 7fdc650de640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc6015ced0 0x7fdc480039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.809+0000 7fdc648dd640 1 -- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc6015ced0 msgr2=0x7fdc480039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:52.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.809+0000 7fdc648dd640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc6015ced0 0x7fdc480039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.809+0000 7fdc648dd640 1 -- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48004d00 msgr2=0x7fdc48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:52.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.809+0000 7fdc648dd640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48004d00 0x7fdc48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.809+0000 7fdc648dd640 1 -- 172.21.15.17:0/1390793798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48003520 con 0x7fdc48003f20 2023-08-09T12:48:52.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.810+0000 7fdc648dd640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc48003f20 0x7fdc480047c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fdc54001750 tx=0x7fdc480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52f6b06a37d1103 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:52.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc540052d0 con 0x7fdc48003f20 2023-08-09T12:48:52.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5402e050 con 0x7fdc48003f20 2023-08-09T12:48:52.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc5ffff640 1 -- 172.21.15.17:0/1390793798 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54003830 con 0x7fdc48003f20 2023-08-09T12:48:52.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc660e0640 1 -- 172.21.15.17:0/1390793798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc48003f20 msgr2=0x7fdc480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc660e0640 1 --2- 172.21.15.17:0/1390793798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc48003f20 0x7fdc480047c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fdc54001750 tx=0x7fdc480057f0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc658df640 1 -- 172.21.15.17:0/1390793798 reap_dead start 2023-08-09T12:48:52.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc660e0640 1 -- 172.21.15.17:0/1390793798 shutdown_connections 2023-08-09T12:48:52.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc660e0640 1 -- 172.21.15.17:0/1390793798 >> 172.21.15.17:0/1390793798 conn(0x7fdc600d2ad0 msgr2=0x7fdc600d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:52.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc660e0640 1 -- 172.21.15.17:0/1390793798 shutdown_connections 2023-08-09T12:48:52.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.811+0000 7fdc660e0640 1 -- 172.21.15.17:0/1390793798 wait complete. 2023-08-09T12:48:52.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.813+0000 7fdc660e0640 1 Processor -- start 2023-08-09T12:48:52.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.813+0000 7fdc660e0640 1 -- start start 2023-08-09T12:48:52.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.814+0000 7fdc660e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48003f20 0x7fdc600cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.814+0000 7fdc660e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc60155ed0 0x7fdc600ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.814+0000 7fdc660e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600b5bc0 0x7fdc600b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.814+0000 7fdc660e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6015ad00 con 0x7fdc60155ed0 2023-08-09T12:48:52.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.814+0000 7fdc660e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6015a6d0 con 0x7fdc48003f20 2023-08-09T12:48:52.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.814+0000 7fdc660e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600c9b10 con 0x7fdc600b5bc0 2023-08-09T12:48:52.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc648dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc60155ed0 0x7fdc600ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc648dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc60155ed0 0x7fdc600ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57200/0 (socket says 172.21.15.17:57200) 2023-08-09T12:48:52.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc648dd640 1 -- 172.21.15.17:0/571594546 learned_addr learned my addr 172.21.15.17:0/571594546 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:52.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc650de640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48003f20 0x7fdc600cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc648dd640 1 -- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600b5bc0 msgr2=0x7fdc600b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc648dd640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600b5bc0 0x7fdc600b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc648dd640 1 -- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48003f20 msgr2=0x7fdc600cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:52.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc648dd640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48003f20 0x7fdc600cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:52.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.815+0000 7fdc648dd640 1 -- 172.21.15.17:0/571594546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc600cc930 con 0x7fdc60155ed0 2023-08-09T12:48:52.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.816+0000 7fdc648dd640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc60155ed0 0x7fdc600ca740 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fdc54008fd0 tx=0x7fdc54001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:52.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.816+0000 7fdc5dffb640 1 -- 172.21.15.17:0/571594546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc540076c0 con 0x7fdc60155ed0 2023-08-09T12:48:52.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.816+0000 7fdc5dffb640 1 -- 172.21.15.17:0/571594546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc54007a30 con 0x7fdc60155ed0 2023-08-09T12:48:52.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.816+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc600c9db0 con 0x7fdc60155ed0 2023-08-09T12:48:52.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.816+0000 7fdc5dffb640 1 -- 172.21.15.17:0/571594546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54006c00 con 0x7fdc60155ed0 2023-08-09T12:48:52.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.816+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6015a920 con 0x7fdc60155ed0 2023-08-09T12:48:52.824 INFO:tasks.ceph.mds.a.smithi017.stderr:2023-08-09T12:48:52.816+0000 7f370df2d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:48:52.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.817+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6004e390 con 0x7fdc60155ed0 2023-08-09T12:48:52.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.818+0000 7fdc5dffb640 1 -- 172.21.15.17:0/571594546 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc540035f0 con 0x7fdc60155ed0 2023-08-09T12:48:52.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.819+0000 7fdc5dffb640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdc4c06a080 0x7fdc4c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.819+0000 7fdc5dffb640 1 -- 172.21.15.17:0/571594546 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc540aa590 con 0x7fdc60155ed0 2023-08-09T12:48:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.820+0000 7fdc650de640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdc4c06a080 0x7fdc4c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.821+0000 7fdc650de640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdc4c06a080 0x7fdc4c06c540 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdc500074a0 tx=0x7fdc5000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:52.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:52.824+0000 7fdc5dffb640 1 -- 172.21.15.17:0/571594546 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdc54075d10 con 0x7fdc60155ed0 2023-08-09T12:48:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.089+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdc6015ad00 con 0x7fdc60155ed0 2023-08-09T12:48:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.090+0000 7fdc5dffb640 1 -- 172.21.15.17:0/571594546 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1171 (secure 0 0 0) 0x7fdc54079330 con 0x7fdc60155ed0 2023-08-09T12:48:53.093 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:53.094 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":589,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":161,"num_osds":8,"num_up_osds":8,"osd_up_since":1691584751,"num_in_osds":8,"osd_in_since":1691584748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592778,"bytes_used":8847988,"bytes_avail":1591152012,"bytes_total":1600000000,"write_bytes_sec":2057,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":76,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8517}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-08-09T12:48:34.846563+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-09T12:48:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdc4c06a080 msgr2=0x7fdc4c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdc4c06a080 0x7fdc4c06c540 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdc500074a0 tx=0x7fdc5000d040 comp rx=0 tx=0).stop 2023-08-09T12:48:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc60155ed0 msgr2=0x7fdc600ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc60155ed0 0x7fdc600ca740 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fdc54008fd0 tx=0x7fdc54001120 comp rx=0 tx=0).stop 2023-08-09T12:48:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 shutdown_connections 2023-08-09T12:48:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdc4c06a080 0x7fdc4c06c540 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600b5bc0 0x7fdc600b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc60155ed0 0x7fdc600ca740 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 --2- 172.21.15.17:0/571594546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc48003f20 0x7fdc600cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 >> 172.21.15.17:0/571594546 conn(0x7fdc600d2ad0 msgr2=0x7fdc600cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 shutdown_connections 2023-08-09T12:48:53.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.093+0000 7fdc660e0640 1 -- 172.21.15.17:0/571594546 wait complete. 2023-08-09T12:48:53.117 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-09T12:48:53.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:48:53.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.352+0000 7fa5b095a640 1 Processor -- start 2023-08-09T12:48:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.352+0000 7fa5b095a640 1 -- start start 2023-08-09T12:48:53.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.353+0000 7fa5b095a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5ac0acef0 0x7fa5ac0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:53.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.353+0000 7fa5b095a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa5ac0cd010 0x7fa5ac0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:53.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.353+0000 7fa5b095a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac0c92c0 con 0x7fa5ac0acb10 2023-08-09T12:48:53.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.353+0000 7fa5b095a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac06efe0 con 0x7fa5ac0cd010 2023-08-09T12:48:53.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.353+0000 7fa5b095a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac15cef0 con 0x7fa5ac0acef0 2023-08-09T12:48:53.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5aad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa5ac0acb10 0x7fa5ac06b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41056/0 (socket says 172.21.15.17:41056) 2023-08-09T12:48:53.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5aad9d640 1 -- 172.21.15.17:0/2999780993 learned_addr learned my addr 172.21.15.17:0/2999780993 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:48:53.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5ab59e640 1 --2- 172.21.15.17:0/2999780993 >> v2:172.21.15.17:3300/0 conn(0x7fa5ac0cd010 0x7fa5ac0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5a3fff640 1 --2- 172.21.15.17:0/2999780993 >> v2:172.21.15.142:3300/0 conn(0x7fa5ac0acef0 0x7fa5ac0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5ab59e640 1 -- 172.21.15.17:0/2999780993 >> v2:172.21.15.142:3300/0 conn(0x7fa5ac0acef0 msgr2=0x7fa5ac0ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5ab59e640 1 --2- 172.21.15.17:0/2999780993 >> v2:172.21.15.142:3300/0 conn(0x7fa5ac0acef0 0x7fa5ac0ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5ab59e640 1 -- 172.21.15.17:0/2999780993 >> v1:172.21.15.17:6789/0 conn(0x7fa5ac0acb10 legacy=0x7fa5ac06b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5aa59c640 1 -- 172.21.15.17:0/2999780993 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298559997 0 0) 0x7fa5ac0c92c0 con 0x7fa5ac0acb10 2023-08-09T12:48:53.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.354+0000 7fa5ab59e640 1 -- 172.21.15.17:0/2999780993 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0cc940 con 0x7fa5ac0cd010 2023-08-09T12:48:53.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.356+0000 7fa5ab59e640 1 --2- 172.21.15.17:0/2999780993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0cd4c0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac06ef90 tx=0x7fa5a402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4940d5815a33d91 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.356+0000 7fa5aa59c640 1 -- 172.21.15.17:0/2999780993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a402cd00 con 0x7fa5ac0cd010 2023-08-09T12:48:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.356+0000 7fa5aa59c640 1 -- 172.21.15.17:0/2999780993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a402ce60 con 0x7fa5ac0cd010 2023-08-09T12:48:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.356+0000 7fa5aa59c640 1 -- 172.21.15.17:0/2999780993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4034660 con 0x7fa5ac0cd010 2023-08-09T12:48:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.357+0000 7fa5b095a640 1 -- 172.21.15.17:0/2999780993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 msgr2=0x7fa5ac0cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.357+0000 7fa5b095a640 1 --2- 172.21.15.17:0/2999780993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0cd4c0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac06ef90 tx=0x7fa5a402bf50 comp rx=0 tx=0).stop 2023-08-09T12:48:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.357+0000 7fa5b095a640 1 -- 172.21.15.17:0/2999780993 shutdown_connections 2023-08-09T12:48:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.357+0000 7fa5b095a640 1 --2- 172.21.15.17:0/2999780993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0cd4c0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.357+0000 7fa5b095a640 1 --2- 172.21.15.17:0/2999780993 >> v2:172.21.15.142:3300/0 conn(0x7fa5ac0acef0 0x7fa5ac0ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.357+0000 7fa5b095a640 1 -- 172.21.15.17:0/2999780993 >> 172.21.15.17:0/2999780993 conn(0x7fa5ac0cead0 msgr2=0x7fa5ac0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.357+0000 7fa5b095a640 1 -- 172.21.15.17:0/2999780993 shutdown_connections 2023-08-09T12:48:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.357+0000 7fa5b095a640 1 -- 172.21.15.17:0/2999780993 wait complete. 2023-08-09T12:48:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.360+0000 7fa5b095a640 1 Processor -- start 2023-08-09T12:48:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.360+0000 7fa5b095a640 1 -- start start 2023-08-09T12:48:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5b095a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ac0acb10 0x7fa5ac0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5b095a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5ac0acef0 0x7fa5ac0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5b095a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5b095a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0b43d0 con 0x7fa5ac0cd010 2023-08-09T12:48:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5b095a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0b3e10 con 0x7fa5ac0acb10 2023-08-09T12:48:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5b095a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0b40f0 con 0x7fa5ac0acef0 2023-08-09T12:48:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57230/0 (socket says 172.21.15.17:57230) 2023-08-09T12:48:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 -- 172.21.15.17:0/1472012300 learned_addr learned my addr 172.21.15.17:0/1472012300 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5aad9d640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ac0acb10 0x7fa5ac0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5a3fff640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5ac0acef0 0x7fa5ac0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 -- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5ac0acef0 msgr2=0x7fa5ac0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5ac0acef0 0x7fa5ac0b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 -- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ac0acb10 msgr2=0x7fa5ac0c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:53.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ac0acb10 0x7fa5ac0c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 -- 172.21.15.17:0/1472012300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4009a70 con 0x7fa5ac0cd010 2023-08-09T12:48:53.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5ab59e640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0af5a0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009e80 tx=0x7fa5a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:53.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5a37fe640 1 -- 172.21.15.17:0/1472012300 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a403d600 con 0x7fa5ac0cd010 2023-08-09T12:48:53.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5a37fe640 1 -- 172.21.15.17:0/1472012300 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a403d780 con 0x7fa5ac0cd010 2023-08-09T12:48:53.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5a37fe640 1 -- 172.21.15.17:0/1472012300 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a403db30 con 0x7fa5ac0cd010 2023-08-09T12:48:53.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.361+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac0c5d40 con 0x7fa5ac0cd010 2023-08-09T12:48:53.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.362+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac151dc0 con 0x7fa5ac0cd010 2023-08-09T12:48:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.363+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac0c5ba0 con 0x7fa5ac0cd010 2023-08-09T12:48:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.365+0000 7fa5a37fe640 1 -- 172.21.15.17:0/1472012300 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa5a403b040 con 0x7fa5ac0cd010 2023-08-09T12:48:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.365+0000 7fa5a37fe640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa58c06a050 0x7fa58c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.365+0000 7fa5a37fe640 1 -- 172.21.15.17:0/1472012300 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5a40aaba0 con 0x7fa5ac0cd010 2023-08-09T12:48:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.365+0000 7fa5aad9d640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa58c06a050 0x7fa58c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.367+0000 7fa5aad9d640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa58c06a050 0x7fa58c06c510 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa59c000f60 tx=0x7fa59c007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:53.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.370+0000 7fa5a37fe640 1 -- 172.21.15.17:0/1472012300 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa5ac0c5ba0 con 0x7fa5ac0cd010 2023-08-09T12:48:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.558+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5ac06f510 con 0x7fa58c06a050 2023-08-09T12:48:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.582+0000 7fa5a37fe640 1 -- 172.21.15.17:0/1472012300 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303344 (secure 0 0 0) 0x7fa59c007170 con 0x7fa58c06a050 2023-08-09T12:48:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:48:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.588+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa58c06a050 msgr2=0x7fa58c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.588+0000 7fa5b095a640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa58c06a050 0x7fa58c06c510 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa59c000f60 tx=0x7fa59c007b50 comp rx=0 tx=0).stop 2023-08-09T12:48:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.588+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 msgr2=0x7fa5ac0af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.588+0000 7fa5b095a640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0af5a0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009e80 tx=0x7fa5a4004a40 comp rx=0 tx=0).stop 2023-08-09T12:48:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.589+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 shutdown_connections 2023-08-09T12:48:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.589+0000 7fa5b095a640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa58c06a050 0x7fa58c06c510 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.589+0000 7fa5b095a640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5ac0cd010 0x7fa5ac0af5a0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.589+0000 7fa5b095a640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5ac0acef0 0x7fa5ac0b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.589+0000 7fa5b095a640 1 --2- 172.21.15.17:0/1472012300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ac0acb10 0x7fa5ac0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.589+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 >> 172.21.15.17:0/1472012300 conn(0x7fa5ac0cead0 msgr2=0x7fa5ac0c3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.589+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 shutdown_connections 2023-08-09T12:48:53.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:53.589+0000 7fa5b095a640 1 -- 172.21.15.17:0/1472012300 wait complete. 2023-08-09T12:48:53.612 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2023-08-09T12:48:52.851789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553859,"statfs":{"total":1600000000,"available":1591152012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.966247"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002670+0000","last_change":"2023-08-09T12:48:46.961585+0000","last_active":"2023-08-09T12:48:48.002670+0000","last_peered":"2023-08-09T12:48:48.002670+0000","last_clean":"2023-08-09T12:48:48.002670+0000","last_became_active":"2023-08-09T12:48:46.961206+0000","last_became_peered":"2023-08-09T12:48:46.961206+0000","last_unstale":"2023-08-09T12:48:48.002670+0000","last_undegraded":"2023-08-09T12:48:48.002670+0000","last_fullsized":"2023-08-09T12:48:48.002670+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:52:42.914790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929727+0000","last_change":"2023-08-09T12:48:46.952118+0000","last_active":"2023-08-09T12:48:47.929727+0000","last_peered":"2023-08-09T12:48:47.929727+0000","last_clean":"2023-08-09T12:48:47.929727+0000","last_became_active":"2023-08-09T12:48:46.951749+0000","last_became_peered":"2023-08-09T12:48:46.951749+0000","last_unstale":"2023-08-09T12:48:47.929727+0000","last_undegraded":"2023-08-09T12:48:47.929727+0000","last_fullsized":"2023-08-09T12:48:47.929727+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:10.366110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.931008+0000","last_change":"2023-08-09T12:48:46.962586+0000","last_active":"2023-08-09T12:48:47.931008+0000","last_peered":"2023-08-09T12:48:47.931008+0000","last_clean":"2023-08-09T12:48:47.931008+0000","last_became_active":"2023-08-09T12:48:46.962122+0000","last_became_peered":"2023-08-09T12:48:46.962122+0000","last_unstale":"2023-08-09T12:48:47.931008+0000","last_undegraded":"2023-08-09T12:48:47.931008+0000","last_fullsized":"2023-08-09T12:48:47.931008+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:53:42.349193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928828+0000","last_change":"2023-08-09T12:48:46.958261+0000","last_active":"2023-08-09T12:48:47.928828+0000","last_peered":"2023-08-09T12:48:47.928828+0000","last_clean":"2023-08-09T12:48:47.928828+0000","last_became_active":"2023-08-09T12:48:46.957807+0000","last_became_peered":"2023-08-09T12:48:46.957807+0000","last_unstale":"2023-08-09T12:48:47.928828+0000","last_undegraded":"2023-08-09T12:48:47.928828+0000","last_fullsized":"2023-08-09T12:48:47.928828+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:49.322907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401259+0000","last_change":"2023-08-09T12:48:46.962514+0000","last_active":"2023-08-09T12:48:48.401259+0000","last_peered":"2023-08-09T12:48:48.401259+0000","last_clean":"2023-08-09T12:48:48.401259+0000","last_became_active":"2023-08-09T12:48:46.961600+0000","last_became_peered":"2023-08-09T12:48:46.961600+0000","last_unstale":"2023-08-09T12:48:48.401259+0000","last_undegraded":"2023-08-09T12:48:48.401259+0000","last_fullsized":"2023-08-09T12:48:48.401259+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:27.900614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402704+0000","last_change":"2023-08-09T12:48:46.945929+0000","last_active":"2023-08-09T12:48:48.402704+0000","last_peered":"2023-08-09T12:48:48.402704+0000","last_clean":"2023-08-09T12:48:48.402704+0000","last_became_active":"2023-08-09T12:48:46.943618+0000","last_became_peered":"2023-08-09T12:48:46.943618+0000","last_unstale":"2023-08-09T12:48:48.402704+0000","last_undegraded":"2023-08-09T12:48:48.402704+0000","last_fullsized":"2023-08-09T12:48:48.402704+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:40:53.848174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927064+0000","last_change":"2023-08-09T12:48:46.941718+0000","last_active":"2023-08-09T12:48:47.927064+0000","last_peered":"2023-08-09T12:48:47.927064+0000","last_clean":"2023-08-09T12:48:47.927064+0000","last_became_active":"2023-08-09T12:48:46.939246+0000","last_became_peered":"2023-08-09T12:48:46.939246+0000","last_unstale":"2023-08-09T12:48:47.927064+0000","last_undegraded":"2023-08-09T12:48:47.927064+0000","last_fullsized":"2023-08-09T12:48:47.927064+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:10.888285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400590+0000","last_change":"2023-08-09T12:48:46.955542+0000","last_active":"2023-08-09T12:48:48.400590+0000","last_peered":"2023-08-09T12:48:48.400590+0000","last_clean":"2023-08-09T12:48:48.400590+0000","last_became_active":"2023-08-09T12:48:46.955219+0000","last_became_peered":"2023-08-09T12:48:46.955219+0000","last_unstale":"2023-08-09T12:48:48.400590+0000","last_undegraded":"2023-08-09T12:48:48.400590+0000","last_fullsized":"2023-08-09T12:48:48.400590+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:23:04.675560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401925+0000","last_change":"2023-08-09T12:48:46.969489+0000","last_active":"2023-08-09T12:48:48.401925+0000","last_peered":"2023-08-09T12:48:48.401925+0000","last_clean":"2023-08-09T12:48:48.401925+0000","last_became_active":"2023-08-09T12:48:46.967474+0000","last_became_peered":"2023-08-09T12:48:46.967474+0000","last_unstale":"2023-08-09T12:48:48.401925+0000","last_undegraded":"2023-08-09T12:48:48.401925+0000","last_fullsized":"2023-08-09T12:48:48.401925+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:53:54.961127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400203+0000","last_change":"2023-08-09T12:48:46.957863+0000","last_active":"2023-08-09T12:48:48.400203+0000","last_peered":"2023-08-09T12:48:48.400203+0000","last_clean":"2023-08-09T12:48:48.400203+0000","last_became_active":"2023-08-09T12:48:46.957367+0000","last_became_peered":"2023-08-09T12:48:46.957367+0000","last_unstale":"2023-08-09T12:48:48.400203+0000","last_undegraded":"2023-08-09T12:48:48.400203+0000","last_fullsized":"2023-08-09T12:48:48.400203+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:36.741262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927863+0000","last_change":"2023-08-09T12:48:46.953736+0000","last_active":"2023-08-09T12:48:47.927863+0000","last_peered":"2023-08-09T12:48:47.927863+0000","last_clean":"2023-08-09T12:48:47.927863+0000","last_became_active":"2023-08-09T12:48:46.953362+0000","last_became_peered":"2023-08-09T12:48:46.953362+0000","last_unstale":"2023-08-09T12:48:47.927863+0000","last_undegraded":"2023-08-09T12:48:47.927863+0000","last_fullsized":"2023-08-09T12:48:47.927863+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:53:54.961127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002489+0000","last_change":"2023-08-09T12:48:46.965972+0000","last_active":"2023-08-09T12:48:48.002489+0000","last_peered":"2023-08-09T12:48:48.002489+0000","last_clean":"2023-08-09T12:48:48.002489+0000","last_became_active":"2023-08-09T12:48:46.965713+0000","last_became_peered":"2023-08-09T12:48:46.965713+0000","last_unstale":"2023-08-09T12:48:48.002489+0000","last_undegraded":"2023-08-09T12:48:48.002489+0000","last_fullsized":"2023-08-09T12:48:48.002489+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:01:26.506985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402321+0000","last_change":"2023-08-09T12:48:46.948200+0000","last_active":"2023-08-09T12:48:48.402321+0000","last_peered":"2023-08-09T12:48:48.402321+0000","last_clean":"2023-08-09T12:48:48.402321+0000","last_became_active":"2023-08-09T12:48:46.946223+0000","last_became_peered":"2023-08-09T12:48:46.946223+0000","last_unstale":"2023-08-09T12:48:48.402321+0000","last_undegraded":"2023-08-09T12:48:48.402321+0000","last_fullsized":"2023-08-09T12:48:48.402321+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:49.322907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002618+0000","last_change":"2023-08-09T12:48:46.937286+0000","last_active":"2023-08-09T12:48:48.002618+0000","last_peered":"2023-08-09T12:48:48.002618+0000","last_clean":"2023-08-09T12:48:48.002618+0000","last_became_active":"2023-08-09T12:48:46.936728+0000","last_became_peered":"2023-08-09T12:48:46.936728+0000","last_unstale":"2023-08-09T12:48:48.002618+0000","last_undegraded":"2023-08-09T12:48:48.002618+0000","last_fullsized":"2023-08-09T12:48:48.002618+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:04:49.241531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002412+0000","last_change":"2023-08-09T12:48:46.936044+0000","last_active":"2023-08-09T12:48:48.002412+0000","last_peered":"2023-08-09T12:48:48.002412+0000","last_clean":"2023-08-09T12:48:48.002412+0000","last_became_active":"2023-08-09T12:48:46.935618+0000","last_became_peered":"2023-08-09T12:48:46.935618+0000","last_unstale":"2023-08-09T12:48:48.002412+0000","last_undegraded":"2023-08-09T12:48:48.002412+0000","last_fullsized":"2023-08-09T12:48:48.002412+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:42:40.983692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403094+0000","last_change":"2023-08-09T12:48:46.967285+0000","last_active":"2023-08-09T12:48:48.403094+0000","last_peered":"2023-08-09T12:48:48.403094+0000","last_clean":"2023-08-09T12:48:48.403094+0000","last_became_active":"2023-08-09T12:48:46.966922+0000","last_became_peered":"2023-08-09T12:48:46.966922+0000","last_unstale":"2023-08-09T12:48:48.403094+0000","last_undegraded":"2023-08-09T12:48:48.403094+0000","last_fullsized":"2023-08-09T12:48:48.403094+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:19:16.594380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402351+0000","last_change":"2023-08-09T12:48:46.964594+0000","last_active":"2023-08-09T12:48:48.402351+0000","last_peered":"2023-08-09T12:48:48.402351+0000","last_clean":"2023-08-09T12:48:48.402351+0000","last_became_active":"2023-08-09T12:48:46.962272+0000","last_became_peered":"2023-08-09T12:48:46.962272+0000","last_unstale":"2023-08-09T12:48:48.402351+0000","last_undegraded":"2023-08-09T12:48:48.402351+0000","last_fullsized":"2023-08-09T12:48:48.402351+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:25:53.056570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400828+0000","last_change":"2023-08-09T12:48:46.960291+0000","last_active":"2023-08-09T12:48:48.400828+0000","last_peered":"2023-08-09T12:48:48.400828+0000","last_clean":"2023-08-09T12:48:48.400828+0000","last_became_active":"2023-08-09T12:48:46.959860+0000","last_became_peered":"2023-08-09T12:48:46.959860+0000","last_unstale":"2023-08-09T12:48:48.400828+0000","last_undegraded":"2023-08-09T12:48:48.400828+0000","last_fullsized":"2023-08-09T12:48:48.400828+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:40.181758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925331+0000","last_change":"2023-08-09T12:48:46.935857+0000","last_active":"2023-08-09T12:48:47.925331+0000","last_peered":"2023-08-09T12:48:47.925331+0000","last_clean":"2023-08-09T12:48:47.925331+0000","last_became_active":"2023-08-09T12:48:46.935257+0000","last_became_peered":"2023-08-09T12:48:46.935257+0000","last_unstale":"2023-08-09T12:48:47.925331+0000","last_undegraded":"2023-08-09T12:48:47.925331+0000","last_fullsized":"2023-08-09T12:48:47.925331+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:21:54.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401605+0000","last_change":"2023-08-09T12:48:46.962333+0000","last_active":"2023-08-09T12:48:48.401605+0000","last_peered":"2023-08-09T12:48:48.401605+0000","last_clean":"2023-08-09T12:48:48.401605+0000","last_became_active":"2023-08-09T12:48:46.961277+0000","last_became_peered":"2023-08-09T12:48:46.961277+0000","last_unstale":"2023-08-09T12:48:48.401605+0000","last_undegraded":"2023-08-09T12:48:48.401605+0000","last_fullsized":"2023-08-09T12:48:48.401605+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:44:02.602474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928243+0000","last_change":"2023-08-09T12:48:46.958963+0000","last_active":"2023-08-09T12:48:47.928243+0000","last_peered":"2023-08-09T12:48:47.928243+0000","last_clean":"2023-08-09T12:48:47.928243+0000","last_became_active":"2023-08-09T12:48:46.958625+0000","last_became_peered":"2023-08-09T12:48:46.958625+0000","last_unstale":"2023-08-09T12:48:47.928243+0000","last_undegraded":"2023-08-09T12:48:47.928243+0000","last_fullsized":"2023-08-09T12:48:47.928243+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:55.205023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002675+0000","last_change":"2023-08-09T12:48:46.965018+0000","last_active":"2023-08-09T12:48:48.002675+0000","last_peered":"2023-08-09T12:48:48.002675+0000","last_clean":"2023-08-09T12:48:48.002675+0000","last_became_active":"2023-08-09T12:48:46.963886+0000","last_became_peered":"2023-08-09T12:48:46.963886+0000","last_unstale":"2023-08-09T12:48:48.002675+0000","last_undegraded":"2023-08-09T12:48:48.002675+0000","last_fullsized":"2023-08-09T12:48:48.002675+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:37:49.215398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927380+0000","last_change":"2023-08-09T12:48:46.952852+0000","last_active":"2023-08-09T12:48:47.927380+0000","last_peered":"2023-08-09T12:48:47.927380+0000","last_clean":"2023-08-09T12:48:47.927380+0000","last_became_active":"2023-08-09T12:48:46.952361+0000","last_became_peered":"2023-08-09T12:48:46.952361+0000","last_unstale":"2023-08-09T12:48:47.927380+0000","last_undegraded":"2023-08-09T12:48:47.927380+0000","last_fullsized":"2023-08-09T12:48:47.927380+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:05:04.814553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402235+0000","last_change":"2023-08-09T12:48:46.967994+0000","last_active":"2023-08-09T12:48:48.402235+0000","last_peered":"2023-08-09T12:48:48.402235+0000","last_clean":"2023-08-09T12:48:48.402235+0000","last_became_active":"2023-08-09T12:48:46.966330+0000","last_became_peered":"2023-08-09T12:48:46.966330+0000","last_unstale":"2023-08-09T12:48:48.402235+0000","last_undegraded":"2023-08-09T12:48:48.402235+0000","last_fullsized":"2023-08-09T12:48:48.402235+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:55.205023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928902+0000","last_change":"2023-08-09T12:48:46.939417+0000","last_active":"2023-08-09T12:48:47.928902+0000","last_peered":"2023-08-09T12:48:47.928902+0000","last_clean":"2023-08-09T12:48:47.928902+0000","last_became_active":"2023-08-09T12:48:46.938512+0000","last_became_peered":"2023-08-09T12:48:46.938512+0000","last_unstale":"2023-08-09T12:48:47.928902+0000","last_undegraded":"2023-08-09T12:48:47.928902+0000","last_fullsized":"2023-08-09T12:48:47.928902+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:19.303543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930256+0000","last_change":"2023-08-09T12:48:46.937004+0000","last_active":"2023-08-09T12:48:47.930256+0000","last_peered":"2023-08-09T12:48:47.930256+0000","last_clean":"2023-08-09T12:48:47.930256+0000","last_became_active":"2023-08-09T12:48:46.936557+0000","last_became_peered":"2023-08-09T12:48:46.936557+0000","last_unstale":"2023-08-09T12:48:47.930256+0000","last_undegraded":"2023-08-09T12:48:47.930256+0000","last_fullsized":"2023-08-09T12:48:47.930256+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:46:19.680233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925623+0000","last_change":"2023-08-09T12:48:46.944383+0000","last_active":"2023-08-09T12:48:47.925623+0000","last_peered":"2023-08-09T12:48:47.925623+0000","last_clean":"2023-08-09T12:48:47.925623+0000","last_became_active":"2023-08-09T12:48:46.944042+0000","last_became_peered":"2023-08-09T12:48:46.944042+0000","last_unstale":"2023-08-09T12:48:47.925623+0000","last_undegraded":"2023-08-09T12:48:47.925623+0000","last_fullsized":"2023-08-09T12:48:47.925623+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:58:34.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.399900+0000","last_change":"2023-08-09T12:48:46.957519+0000","last_active":"2023-08-09T12:48:48.399900+0000","last_peered":"2023-08-09T12:48:48.399900+0000","last_clean":"2023-08-09T12:48:48.399900+0000","last_became_active":"2023-08-09T12:48:46.955792+0000","last_became_peered":"2023-08-09T12:48:46.955792+0000","last_unstale":"2023-08-09T12:48:48.399900+0000","last_undegraded":"2023-08-09T12:48:48.399900+0000","last_fullsized":"2023-08-09T12:48:48.399900+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:27.410001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928065+0000","last_change":"2023-08-09T12:48:46.954814+0000","last_active":"2023-08-09T12:48:47.928065+0000","last_peered":"2023-08-09T12:48:47.928065+0000","last_clean":"2023-08-09T12:48:47.928065+0000","last_became_active":"2023-08-09T12:48:46.954498+0000","last_became_peered":"2023-08-09T12:48:46.954498+0000","last_unstale":"2023-08-09T12:48:47.928065+0000","last_undegraded":"2023-08-09T12:48:47.928065+0000","last_fullsized":"2023-08-09T12:48:47.928065+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:25:32.308701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929284+0000","last_change":"2023-08-09T12:48:46.939726+0000","last_active":"2023-08-09T12:48:47.929284+0000","last_peered":"2023-08-09T12:48:47.929284+0000","last_clean":"2023-08-09T12:48:47.929284+0000","last_became_active":"2023-08-09T12:48:46.939036+0000","last_became_peered":"2023-08-09T12:48:46.939036+0000","last_unstale":"2023-08-09T12:48:47.929284+0000","last_undegraded":"2023-08-09T12:48:47.929284+0000","last_fullsized":"2023-08-09T12:48:47.929284+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:37:31.425140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400789+0000","last_change":"2023-08-09T12:48:46.944030+0000","last_active":"2023-08-09T12:48:48.400789+0000","last_peered":"2023-08-09T12:48:48.400789+0000","last_clean":"2023-08-09T12:48:48.400789+0000","last_became_active":"2023-08-09T12:48:46.943711+0000","last_became_peered":"2023-08-09T12:48:46.943711+0000","last_unstale":"2023-08-09T12:48:48.400789+0000","last_undegraded":"2023-08-09T12:48:48.400789+0000","last_fullsized":"2023-08-09T12:48:48.400789+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:59:19.561948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.399935+0000","last_change":"2023-08-09T12:48:46.965452+0000","last_active":"2023-08-09T12:48:48.399935+0000","last_peered":"2023-08-09T12:48:48.399935+0000","last_clean":"2023-08-09T12:48:48.399935+0000","last_became_active":"2023-08-09T12:48:46.965169+0000","last_became_peered":"2023-08-09T12:48:46.965169+0000","last_unstale":"2023-08-09T12:48:48.399935+0000","last_undegraded":"2023-08-09T12:48:48.399935+0000","last_fullsized":"2023-08-09T12:48:48.399935+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:28.745289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401687+0000","last_change":"2023-08-09T12:48:46.937096+0000","last_active":"2023-08-09T12:48:48.401687+0000","last_peered":"2023-08-09T12:48:48.401687+0000","last_clean":"2023-08-09T12:48:48.401687+0000","last_became_active":"2023-08-09T12:48:46.936636+0000","last_became_peered":"2023-08-09T12:48:46.936636+0000","last_unstale":"2023-08-09T12:48:48.401687+0000","last_undegraded":"2023-08-09T12:48:48.401687+0000","last_fullsized":"2023-08-09T12:48:48.401687+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:48:16.494452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"160'4","reported_seq":17,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.932006+0000","last_change":"2023-08-09T12:48:45.895190+0000","last_active":"2023-08-09T12:48:47.932006+0000","last_peered":"2023-08-09T12:48:47.932006+0000","last_clean":"2023-08-09T12:48:47.932006+0000","last_became_active":"2023-08-09T12:48:45.894548+0000","last_became_peered":"2023-08-09T12:48:45.894548+0000","last_unstale":"2023-08-09T12:48:47.932006+0000","last_undegraded":"2023-08-09T12:48:47.932006+0000","last_fullsized":"2023-08-09T12:48:47.932006+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:20:13.304473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002403+0000","last_change":"2023-08-09T12:48:46.963254+0000","last_active":"2023-08-09T12:48:48.002403+0000","last_peered":"2023-08-09T12:48:48.002403+0000","last_clean":"2023-08-09T12:48:48.002403+0000","last_became_active":"2023-08-09T12:48:46.962887+0000","last_became_peered":"2023-08-09T12:48:46.962887+0000","last_unstale":"2023-08-09T12:48:48.002403+0000","last_undegraded":"2023-08-09T12:48:48.002403+0000","last_fullsized":"2023-08-09T12:48:48.002403+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:37:57.910566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401550+0000","last_change":"2023-08-09T12:48:45.912443+0000","last_active":"2023-08-09T12:48:48.401550+0000","last_peered":"2023-08-09T12:48:48.401550+0000","last_clean":"2023-08-09T12:48:48.401550+0000","last_became_active":"2023-08-09T12:48:45.912042+0000","last_became_peered":"2023-08-09T12:48:45.912042+0000","last_unstale":"2023-08-09T12:48:48.401550+0000","last_undegraded":"2023-08-09T12:48:48.401550+0000","last_fullsized":"2023-08-09T12:48:48.401550+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:22:20.272174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927746+0000","last_change":"2023-08-09T12:48:46.952678+0000","last_active":"2023-08-09T12:48:47.927746+0000","last_peered":"2023-08-09T12:48:47.927746+0000","last_clean":"2023-08-09T12:48:47.927746+0000","last_became_active":"2023-08-09T12:48:46.951843+0000","last_became_peered":"2023-08-09T12:48:46.951843+0000","last_unstale":"2023-08-09T12:48:47.927746+0000","last_undegraded":"2023-08-09T12:48:47.927746+0000","last_fullsized":"2023-08-09T12:48:47.927746+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:18.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927914+0000","last_change":"2023-08-09T12:48:45.912974+0000","last_active":"2023-08-09T12:48:47.927914+0000","last_peered":"2023-08-09T12:48:47.927914+0000","last_clean":"2023-08-09T12:48:47.927914+0000","last_became_active":"2023-08-09T12:48:45.912770+0000","last_became_peered":"2023-08-09T12:48:45.912770+0000","last_unstale":"2023-08-09T12:48:47.927914+0000","last_undegraded":"2023-08-09T12:48:47.927914+0000","last_fullsized":"2023-08-09T12:48:47.927914+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:56:09.299990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002842+0000","last_change":"2023-08-09T12:48:46.934802+0000","last_active":"2023-08-09T12:48:48.002842+0000","last_peered":"2023-08-09T12:48:48.002842+0000","last_clean":"2023-08-09T12:48:48.002842+0000","last_became_active":"2023-08-09T12:48:46.934325+0000","last_became_peered":"2023-08-09T12:48:46.934325+0000","last_unstale":"2023-08-09T12:48:48.002842+0000","last_undegraded":"2023-08-09T12:48:48.002842+0000","last_fullsized":"2023-08-09T12:48:48.002842+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:59.707943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925708+0000","last_change":"2023-08-09T12:48:45.906701+0000","last_active":"2023-08-09T12:48:47.925708+0000","last_peered":"2023-08-09T12:48:47.925708+0000","last_clean":"2023-08-09T12:48:47.925708+0000","last_became_active":"2023-08-09T12:48:45.906397+0000","last_became_peered":"2023-08-09T12:48:45.906397+0000","last_unstale":"2023-08-09T12:48:47.925708+0000","last_undegraded":"2023-08-09T12:48:47.925708+0000","last_fullsized":"2023-08-09T12:48:47.925708+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:04.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401011+0000","last_change":"2023-08-09T12:48:46.947241+0000","last_active":"2023-08-09T12:48:48.401011+0000","last_peered":"2023-08-09T12:48:48.401011+0000","last_clean":"2023-08-09T12:48:48.401011+0000","last_became_active":"2023-08-09T12:48:46.946611+0000","last_became_peered":"2023-08-09T12:48:46.946611+0000","last_unstale":"2023-08-09T12:48:48.401011+0000","last_undegraded":"2023-08-09T12:48:48.401011+0000","last_fullsized":"2023-08-09T12:48:48.401011+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:45.920759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400610+0000","last_change":"2023-08-09T12:48:45.904761+0000","last_active":"2023-08-09T12:48:48.400610+0000","last_peered":"2023-08-09T12:48:48.400610+0000","last_clean":"2023-08-09T12:48:48.400610+0000","last_became_active":"2023-08-09T12:48:45.904258+0000","last_became_peered":"2023-08-09T12:48:45.904258+0000","last_unstale":"2023-08-09T12:48:48.400610+0000","last_undegraded":"2023-08-09T12:48:48.400610+0000","last_fullsized":"2023-08-09T12:48:48.400610+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:34:35.308615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401182+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:48.401182+0000","last_peered":"2023-08-09T12:48:48.401182+0000","last_clean":"2023-08-09T12:48:48.401182+0000","last_became_active":"2023-08-09T12:48:46.959290+0000","last_became_peered":"2023-08-09T12:48:46.959290+0000","last_unstale":"2023-08-09T12:48:48.401182+0000","last_undegraded":"2023-08-09T12:48:48.401182+0000","last_fullsized":"2023-08-09T12:48:48.401182+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:12:39.259158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400998+0000","last_change":"2023-08-09T12:48:45.907778+0000","last_active":"2023-08-09T12:48:48.400998+0000","last_peered":"2023-08-09T12:48:48.400998+0000","last_clean":"2023-08-09T12:48:48.400998+0000","last_became_active":"2023-08-09T12:48:45.907326+0000","last_became_peered":"2023-08-09T12:48:45.907326+0000","last_unstale":"2023-08-09T12:48:48.400998+0000","last_undegraded":"2023-08-09T12:48:48.400998+0000","last_fullsized":"2023-08-09T12:48:48.400998+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:39:52.954554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400793+0000","last_change":"2023-08-09T12:48:46.963125+0000","last_active":"2023-08-09T12:48:48.400793+0000","last_peered":"2023-08-09T12:48:48.400793+0000","last_clean":"2023-08-09T12:48:48.400793+0000","last_became_active":"2023-08-09T12:48:46.955577+0000","last_became_peered":"2023-08-09T12:48:46.955577+0000","last_unstale":"2023-08-09T12:48:48.400793+0000","last_undegraded":"2023-08-09T12:48:48.400793+0000","last_fullsized":"2023-08-09T12:48:48.400793+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:50:34.959389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402972+0000","last_change":"2023-08-09T12:48:45.912814+0000","last_active":"2023-08-09T12:48:48.402972+0000","last_peered":"2023-08-09T12:48:48.402972+0000","last_clean":"2023-08-09T12:48:48.402972+0000","last_became_active":"2023-08-09T12:48:45.911537+0000","last_became_peered":"2023-08-09T12:48:45.911537+0000","last_unstale":"2023-08-09T12:48:48.402972+0000","last_undegraded":"2023-08-09T12:48:48.402972+0000","last_fullsized":"2023-08-09T12:48:48.402972+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:32:13.020495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925737+0000","last_change":"2023-08-09T12:48:46.945168+0000","last_active":"2023-08-09T12:48:47.925737+0000","last_peered":"2023-08-09T12:48:47.925737+0000","last_clean":"2023-08-09T12:48:47.925737+0000","last_became_active":"2023-08-09T12:48:46.944925+0000","last_became_peered":"2023-08-09T12:48:46.944925+0000","last_unstale":"2023-08-09T12:48:47.925737+0000","last_undegraded":"2023-08-09T12:48:47.925737+0000","last_fullsized":"2023-08-09T12:48:47.925737+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:54.312863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929957+0000","last_change":"2023-08-09T12:48:45.912104+0000","last_active":"2023-08-09T12:48:47.929957+0000","last_peered":"2023-08-09T12:48:47.929957+0000","last_clean":"2023-08-09T12:48:47.929957+0000","last_became_active":"2023-08-09T12:48:45.911841+0000","last_became_peered":"2023-08-09T12:48:45.911841+0000","last_unstale":"2023-08-09T12:48:47.929957+0000","last_undegraded":"2023-08-09T12:48:47.929957+0000","last_fullsized":"2023-08-09T12:48:47.929957+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:01.200847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930900+0000","last_change":"2023-08-09T12:48:46.961576+0000","last_active":"2023-08-09T12:48:47.930900+0000","last_peered":"2023-08-09T12:48:47.930900+0000","last_clean":"2023-08-09T12:48:47.930900+0000","last_became_active":"2023-08-09T12:48:46.961193+0000","last_became_peered":"2023-08-09T12:48:46.961193+0000","last_unstale":"2023-08-09T12:48:47.930900+0000","last_undegraded":"2023-08-09T12:48:47.930900+0000","last_fullsized":"2023-08-09T12:48:47.930900+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:36:59.651281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929454+0000","last_change":"2023-08-09T12:48:45.912029+0000","last_active":"2023-08-09T12:48:47.929454+0000","last_peered":"2023-08-09T12:48:47.929454+0000","last_clean":"2023-08-09T12:48:47.929454+0000","last_became_active":"2023-08-09T12:48:45.911596+0000","last_became_peered":"2023-08-09T12:48:45.911596+0000","last_unstale":"2023-08-09T12:48:47.929454+0000","last_undegraded":"2023-08-09T12:48:47.929454+0000","last_fullsized":"2023-08-09T12:48:47.929454+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:40:52.834357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927398+0000","last_change":"2023-08-09T12:48:46.962725+0000","last_active":"2023-08-09T12:48:47.927398+0000","last_peered":"2023-08-09T12:48:47.927398+0000","last_clean":"2023-08-09T12:48:47.927398+0000","last_became_active":"2023-08-09T12:48:46.962525+0000","last_became_peered":"2023-08-09T12:48:46.962525+0000","last_unstale":"2023-08-09T12:48:47.927398+0000","last_undegraded":"2023-08-09T12:48:47.927398+0000","last_fullsized":"2023-08-09T12:48:47.927398+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:24:19.347469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930308+0000","last_change":"2023-08-09T12:48:45.898690+0000","last_active":"2023-08-09T12:48:47.930308+0000","last_peered":"2023-08-09T12:48:47.930308+0000","last_clean":"2023-08-09T12:48:47.930308+0000","last_became_active":"2023-08-09T12:48:45.898044+0000","last_became_peered":"2023-08-09T12:48:45.898044+0000","last_unstale":"2023-08-09T12:48:47.930308+0000","last_undegraded":"2023-08-09T12:48:47.930308+0000","last_fullsized":"2023-08-09T12:48:47.930308+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:52:51.401162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925708+0000","last_change":"2023-08-09T12:48:46.949845+0000","last_active":"2023-08-09T12:48:47.925708+0000","last_peered":"2023-08-09T12:48:47.925708+0000","last_clean":"2023-08-09T12:48:47.925708+0000","last_became_active":"2023-08-09T12:48:46.949387+0000","last_became_peered":"2023-08-09T12:48:46.949387+0000","last_unstale":"2023-08-09T12:48:47.925708+0000","last_undegraded":"2023-08-09T12:48:47.925708+0000","last_fullsized":"2023-08-09T12:48:47.925708+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:45:19.262335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403439+0000","last_change":"2023-08-09T12:48:45.914299+0000","last_active":"2023-08-09T12:48:48.403439+0000","last_peered":"2023-08-09T12:48:48.403439+0000","last_clean":"2023-08-09T12:48:48.403439+0000","last_became_active":"2023-08-09T12:48:45.913540+0000","last_became_peered":"2023-08-09T12:48:45.913540+0000","last_unstale":"2023-08-09T12:48:48.403439+0000","last_undegraded":"2023-08-09T12:48:48.403439+0000","last_fullsized":"2023-08-09T12:48:48.403439+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:41:08.932916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400598+0000","last_change":"2023-08-09T12:48:46.954665+0000","last_active":"2023-08-09T12:48:48.400598+0000","last_peered":"2023-08-09T12:48:48.400598+0000","last_clean":"2023-08-09T12:48:48.400598+0000","last_became_active":"2023-08-09T12:48:46.953769+0000","last_became_peered":"2023-08-09T12:48:46.953769+0000","last_unstale":"2023-08-09T12:48:48.400598+0000","last_undegraded":"2023-08-09T12:48:48.400598+0000","last_fullsized":"2023-08-09T12:48:48.400598+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:32:52.558216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401371+0000","last_change":"2023-08-09T12:48:45.913084+0000","last_active":"2023-08-09T12:48:48.401371+0000","last_peered":"2023-08-09T12:48:48.401371+0000","last_clean":"2023-08-09T12:48:48.401371+0000","last_became_active":"2023-08-09T12:48:45.912811+0000","last_became_peered":"2023-08-09T12:48:45.912811+0000","last_unstale":"2023-08-09T12:48:48.401371+0000","last_undegraded":"2023-08-09T12:48:48.401371+0000","last_fullsized":"2023-08-09T12:48:48.401371+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:10:12.903104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401108+0000","last_change":"2023-08-09T12:48:46.966736+0000","last_active":"2023-08-09T12:48:48.401108+0000","last_peered":"2023-08-09T12:48:48.401108+0000","last_clean":"2023-08-09T12:48:48.401108+0000","last_became_active":"2023-08-09T12:48:46.966391+0000","last_became_peered":"2023-08-09T12:48:46.966391+0000","last_unstale":"2023-08-09T12:48:48.401108+0000","last_undegraded":"2023-08-09T12:48:48.401108+0000","last_fullsized":"2023-08-09T12:48:48.401108+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:36:25.408059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400798+0000","last_change":"2023-08-09T12:48:45.903454+0000","last_active":"2023-08-09T12:48:48.400798+0000","last_peered":"2023-08-09T12:48:48.400798+0000","last_clean":"2023-08-09T12:48:48.400798+0000","last_became_active":"2023-08-09T12:48:45.901990+0000","last_became_peered":"2023-08-09T12:48:45.901990+0000","last_unstale":"2023-08-09T12:48:48.400798+0000","last_undegraded":"2023-08-09T12:48:48.400798+0000","last_fullsized":"2023-08-09T12:48:48.400798+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:07:18.792210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.003031+0000","last_change":"2023-08-09T12:48:46.935102+0000","last_active":"2023-08-09T12:48:48.003031+0000","last_peered":"2023-08-09T12:48:48.003031+0000","last_clean":"2023-08-09T12:48:48.003031+0000","last_became_active":"2023-08-09T12:48:46.934483+0000","last_became_peered":"2023-08-09T12:48:46.934483+0000","last_unstale":"2023-08-09T12:48:48.003031+0000","last_undegraded":"2023-08-09T12:48:48.003031+0000","last_fullsized":"2023-08-09T12:48:48.003031+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:28:23.572626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002786+0000","last_change":"2023-08-09T12:48:45.909979+0000","last_active":"2023-08-09T12:48:48.002786+0000","last_peered":"2023-08-09T12:48:48.002786+0000","last_clean":"2023-08-09T12:48:48.002786+0000","last_became_active":"2023-08-09T12:48:45.909318+0000","last_became_peered":"2023-08-09T12:48:45.909318+0000","last_unstale":"2023-08-09T12:48:48.002786+0000","last_undegraded":"2023-08-09T12:48:48.002786+0000","last_fullsized":"2023-08-09T12:48:48.002786+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:58:44.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401948+0000","last_change":"2023-08-09T12:48:46.961941+0000","last_active":"2023-08-09T12:48:48.401948+0000","last_peered":"2023-08-09T12:48:48.401948+0000","last_clean":"2023-08-09T12:48:48.401948+0000","last_became_active":"2023-08-09T12:48:46.959507+0000","last_became_peered":"2023-08-09T12:48:46.959507+0000","last_unstale":"2023-08-09T12:48:48.401948+0000","last_undegraded":"2023-08-09T12:48:48.401948+0000","last_fullsized":"2023-08-09T12:48:48.401948+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:57:28.575318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928254+0000","last_change":"2023-08-09T12:48:45.906050+0000","last_active":"2023-08-09T12:48:47.928254+0000","last_peered":"2023-08-09T12:48:47.928254+0000","last_clean":"2023-08-09T12:48:47.928254+0000","last_became_active":"2023-08-09T12:48:45.905750+0000","last_became_peered":"2023-08-09T12:48:45.905750+0000","last_unstale":"2023-08-09T12:48:47.928254+0000","last_undegraded":"2023-08-09T12:48:47.928254+0000","last_fullsized":"2023-08-09T12:48:47.928254+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:10:50.430197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929159+0000","last_change":"2023-08-09T12:48:46.952499+0000","last_active":"2023-08-09T12:48:47.929159+0000","last_peered":"2023-08-09T12:48:47.929159+0000","last_clean":"2023-08-09T12:48:47.929159+0000","last_became_active":"2023-08-09T12:48:46.951915+0000","last_became_peered":"2023-08-09T12:48:46.951915+0000","last_unstale":"2023-08-09T12:48:47.929159+0000","last_undegraded":"2023-08-09T12:48:47.929159+0000","last_fullsized":"2023-08-09T12:48:47.929159+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:22:49.988893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403850+0000","last_change":"2023-08-09T12:48:45.904623+0000","last_active":"2023-08-09T12:48:48.403850+0000","last_peered":"2023-08-09T12:48:48.403850+0000","last_clean":"2023-08-09T12:48:48.403850+0000","last_became_active":"2023-08-09T12:48:45.904073+0000","last_became_peered":"2023-08-09T12:48:45.904073+0000","last_unstale":"2023-08-09T12:48:48.403850+0000","last_undegraded":"2023-08-09T12:48:48.403850+0000","last_fullsized":"2023-08-09T12:48:48.403850+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:31.729048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401284+0000","last_change":"2023-08-09T12:48:46.961129+0000","last_active":"2023-08-09T12:48:48.401284+0000","last_peered":"2023-08-09T12:48:48.401284+0000","last_clean":"2023-08-09T12:48:48.401284+0000","last_became_active":"2023-08-09T12:48:46.954671+0000","last_became_peered":"2023-08-09T12:48:46.954671+0000","last_unstale":"2023-08-09T12:48:48.401284+0000","last_undegraded":"2023-08-09T12:48:48.401284+0000","last_fullsized":"2023-08-09T12:48:48.401284+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:44:31.981784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.003228+0000","last_change":"2023-08-09T12:48:45.900760+0000","last_active":"2023-08-09T12:48:48.003228+0000","last_peered":"2023-08-09T12:48:48.003228+0000","last_clean":"2023-08-09T12:48:48.003228+0000","last_became_active":"2023-08-09T12:48:45.899103+0000","last_became_peered":"2023-08-09T12:48:45.899103+0000","last_unstale":"2023-08-09T12:48:48.003228+0000","last_undegraded":"2023-08-09T12:48:48.003228+0000","last_fullsized":"2023-08-09T12:48:48.003228+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:14:46.187149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.931691+0000","last_change":"2023-08-09T12:48:46.959599+0000","last_active":"2023-08-09T12:48:47.931691+0000","last_peered":"2023-08-09T12:48:47.931691+0000","last_clean":"2023-08-09T12:48:47.931691+0000","last_became_active":"2023-08-09T12:48:46.959283+0000","last_became_peered":"2023-08-09T12:48:46.959283+0000","last_unstale":"2023-08-09T12:48:47.931691+0000","last_undegraded":"2023-08-09T12:48:47.931691+0000","last_fullsized":"2023-08-09T12:48:47.931691+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:38:23.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401030+0000","last_change":"2023-08-09T12:48:45.910936+0000","last_active":"2023-08-09T12:48:48.401030+0000","last_peered":"2023-08-09T12:48:48.401030+0000","last_clean":"2023-08-09T12:48:48.401030+0000","last_became_active":"2023-08-09T12:48:45.910460+0000","last_became_peered":"2023-08-09T12:48:45.910460+0000","last_unstale":"2023-08-09T12:48:48.401030+0000","last_undegraded":"2023-08-09T12:48:48.401030+0000","last_fullsized":"2023-08-09T12:48:48.401030+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:56:51.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929872+0000","last_change":"2023-08-09T12:48:46.942752+0000","last_active":"2023-08-09T12:48:47.929872+0000","last_peered":"2023-08-09T12:48:47.929872+0000","last_clean":"2023-08-09T12:48:47.929872+0000","last_became_active":"2023-08-09T12:48:46.941039+0000","last_became_peered":"2023-08-09T12:48:46.941039+0000","last_unstale":"2023-08-09T12:48:47.929872+0000","last_undegraded":"2023-08-09T12:48:47.929872+0000","last_fullsized":"2023-08-09T12:48:47.929872+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:54.520543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400501+0000","last_change":"2023-08-09T12:48:45.905909+0000","last_active":"2023-08-09T12:48:48.400501+0000","last_peered":"2023-08-09T12:48:48.400501+0000","last_clean":"2023-08-09T12:48:48.400501+0000","last_became_active":"2023-08-09T12:48:45.905567+0000","last_became_peered":"2023-08-09T12:48:45.905567+0000","last_unstale":"2023-08-09T12:48:48.400501+0000","last_undegraded":"2023-08-09T12:48:48.400501+0000","last_fullsized":"2023-08-09T12:48:48.400501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:21.789435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400036+0000","last_change":"2023-08-09T12:48:46.953485+0000","last_active":"2023-08-09T12:48:48.400036+0000","last_peered":"2023-08-09T12:48:48.400036+0000","last_clean":"2023-08-09T12:48:48.400036+0000","last_became_active":"2023-08-09T12:48:46.952364+0000","last_became_peered":"2023-08-09T12:48:46.952364+0000","last_unstale":"2023-08-09T12:48:48.400036+0000","last_undegraded":"2023-08-09T12:48:48.400036+0000","last_fullsized":"2023-08-09T12:48:48.400036+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:55:45.375408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403216+0000","last_change":"2023-08-09T12:48:45.911167+0000","last_active":"2023-08-09T12:48:48.403216+0000","last_peered":"2023-08-09T12:48:48.403216+0000","last_clean":"2023-08-09T12:48:48.403216+0000","last_became_active":"2023-08-09T12:48:45.910891+0000","last_became_peered":"2023-08-09T12:48:45.910891+0000","last_unstale":"2023-08-09T12:48:48.403216+0000","last_undegraded":"2023-08-09T12:48:48.403216+0000","last_fullsized":"2023-08-09T12:48:48.403216+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:29:29.657175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402862+0000","last_change":"2023-08-09T12:48:46.946416+0000","last_active":"2023-08-09T12:48:48.402862+0000","last_peered":"2023-08-09T12:48:48.402862+0000","last_clean":"2023-08-09T12:48:48.402862+0000","last_became_active":"2023-08-09T12:48:46.943351+0000","last_became_peered":"2023-08-09T12:48:46.943351+0000","last_unstale":"2023-08-09T12:48:48.402862+0000","last_undegraded":"2023-08-09T12:48:48.402862+0000","last_fullsized":"2023-08-09T12:48:48.402862+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:10.366110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928860+0000","last_change":"2023-08-09T12:48:45.910842+0000","last_active":"2023-08-09T12:48:47.928860+0000","last_peered":"2023-08-09T12:48:47.928860+0000","last_clean":"2023-08-09T12:48:47.928860+0000","last_became_active":"2023-08-09T12:48:45.910039+0000","last_became_peered":"2023-08-09T12:48:45.910039+0000","last_unstale":"2023-08-09T12:48:47.928860+0000","last_undegraded":"2023-08-09T12:48:47.928860+0000","last_fullsized":"2023-08-09T12:48:47.928860+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:23:59.043267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402699+0000","last_change":"2023-08-09T12:48:46.947360+0000","last_active":"2023-08-09T12:48:48.402699+0000","last_peered":"2023-08-09T12:48:48.402699+0000","last_clean":"2023-08-09T12:48:48.402699+0000","last_became_active":"2023-08-09T12:48:46.946310+0000","last_became_peered":"2023-08-09T12:48:46.946310+0000","last_unstale":"2023-08-09T12:48:48.402699+0000","last_undegraded":"2023-08-09T12:48:48.402699+0000","last_fullsized":"2023-08-09T12:48:48.402699+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:24.289949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930196+0000","last_change":"2023-08-09T12:48:45.907402+0000","last_active":"2023-08-09T12:48:47.930196+0000","last_peered":"2023-08-09T12:48:47.930196+0000","last_clean":"2023-08-09T12:48:47.930196+0000","last_became_active":"2023-08-09T12:48:45.906892+0000","last_became_peered":"2023-08-09T12:48:45.906892+0000","last_unstale":"2023-08-09T12:48:47.930196+0000","last_undegraded":"2023-08-09T12:48:47.930196+0000","last_fullsized":"2023-08-09T12:48:47.930196+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:17:32.838718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403094+0000","last_change":"2023-08-09T12:48:46.946987+0000","last_active":"2023-08-09T12:48:48.403094+0000","last_peered":"2023-08-09T12:48:48.403094+0000","last_clean":"2023-08-09T12:48:48.403094+0000","last_became_active":"2023-08-09T12:48:46.943449+0000","last_became_peered":"2023-08-09T12:48:46.943449+0000","last_unstale":"2023-08-09T12:48:48.403094+0000","last_undegraded":"2023-08-09T12:48:48.403094+0000","last_fullsized":"2023-08-09T12:48:48.403094+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:43:07.531223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403429+0000","last_change":"2023-08-09T12:48:45.911823+0000","last_active":"2023-08-09T12:48:48.403429+0000","last_peered":"2023-08-09T12:48:48.403429+0000","last_clean":"2023-08-09T12:48:48.403429+0000","last_became_active":"2023-08-09T12:48:45.911339+0000","last_became_peered":"2023-08-09T12:48:45.911339+0000","last_unstale":"2023-08-09T12:48:48.403429+0000","last_undegraded":"2023-08-09T12:48:48.403429+0000","last_fullsized":"2023-08-09T12:48:48.403429+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:48:39.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927438+0000","last_change":"2023-08-09T12:48:46.942177+0000","last_active":"2023-08-09T12:48:47.927438+0000","last_peered":"2023-08-09T12:48:47.927438+0000","last_clean":"2023-08-09T12:48:47.927438+0000","last_became_active":"2023-08-09T12:48:46.940133+0000","last_became_peered":"2023-08-09T12:48:46.940133+0000","last_unstale":"2023-08-09T12:48:47.927438+0000","last_undegraded":"2023-08-09T12:48:47.927438+0000","last_fullsized":"2023-08-09T12:48:47.927438+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:14.747773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401820+0000","last_change":"2023-08-09T12:48:45.909884+0000","last_active":"2023-08-09T12:48:48.401820+0000","last_peered":"2023-08-09T12:48:48.401820+0000","last_clean":"2023-08-09T12:48:48.401820+0000","last_became_active":"2023-08-09T12:48:45.909635+0000","last_became_peered":"2023-08-09T12:48:45.909635+0000","last_unstale":"2023-08-09T12:48:48.401820+0000","last_undegraded":"2023-08-09T12:48:48.401820+0000","last_fullsized":"2023-08-09T12:48:48.401820+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:10.277671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.931370+0000","last_change":"2023-08-09T12:48:46.962403+0000","last_active":"2023-08-09T12:48:47.931370+0000","last_peered":"2023-08-09T12:48:47.931370+0000","last_clean":"2023-08-09T12:48:47.931370+0000","last_became_active":"2023-08-09T12:48:46.961621+0000","last_became_peered":"2023-08-09T12:48:46.961621+0000","last_unstale":"2023-08-09T12:48:47.931370+0000","last_undegraded":"2023-08-09T12:48:47.931370+0000","last_fullsized":"2023-08-09T12:48:47.931370+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:40:07.673451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927559+0000","last_change":"2023-08-09T12:48:45.907971+0000","last_active":"2023-08-09T12:48:47.927559+0000","last_peered":"2023-08-09T12:48:47.927559+0000","last_clean":"2023-08-09T12:48:47.927559+0000","last_became_active":"2023-08-09T12:48:45.907721+0000","last_became_peered":"2023-08-09T12:48:45.907721+0000","last_unstale":"2023-08-09T12:48:47.927559+0000","last_undegraded":"2023-08-09T12:48:47.927559+0000","last_fullsized":"2023-08-09T12:48:47.927559+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:42.388189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":445,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929531+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:48:47.929531+0000","last_peered":"2023-08-09T12:48:47.929531+0000","last_clean":"2023-08-09T12:48:47.929531+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:48:47.929531+0000","last_undegraded":"2023-08-09T12:48:47.929531+0000","last_fullsized":"2023-08-09T12:48:47.929531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:20:52.844875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":265,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929175+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:48:47.929175+0000","last_peered":"2023-08-09T12:48:47.929175+0000","last_clean":"2023-08-09T12:48:47.929175+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:48:47.929175+0000","last_undegraded":"2023-08-09T12:48:47.929175+0000","last_fullsized":"2023-08-09T12:48:47.929175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:56.679498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.926710+0000","last_change":"2023-08-09T12:48:46.953789+0000","last_active":"2023-08-09T12:48:47.926710+0000","last_peered":"2023-08-09T12:48:47.926710+0000","last_clean":"2023-08-09T12:48:47.926710+0000","last_became_active":"2023-08-09T12:48:46.953417+0000","last_became_peered":"2023-08-09T12:48:46.953417+0000","last_unstale":"2023-08-09T12:48:47.926710+0000","last_undegraded":"2023-08-09T12:48:47.926710+0000","last_fullsized":"2023-08-09T12:48:47.926710+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:05:36.327725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929385+0000","last_change":"2023-08-09T12:48:45.907769+0000","last_active":"2023-08-09T12:48:47.929385+0000","last_peered":"2023-08-09T12:48:47.929385+0000","last_clean":"2023-08-09T12:48:47.929385+0000","last_became_active":"2023-08-09T12:48:45.906964+0000","last_became_peered":"2023-08-09T12:48:45.906964+0000","last_unstale":"2023-08-09T12:48:47.929385+0000","last_undegraded":"2023-08-09T12:48:47.929385+0000","last_fullsized":"2023-08-09T12:48:47.929385+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:55.234439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":289,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929232+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:48:47.929232+0000","last_peered":"2023-08-09T12:48:47.929232+0000","last_clean":"2023-08-09T12:48:47.929232+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:48:47.929232+0000","last_undegraded":"2023-08-09T12:48:47.929232+0000","last_fullsized":"2023-08-09T12:48:47.929232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:49:55.702909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401226+0000","last_change":"2023-08-09T12:48:46.968109+0000","last_active":"2023-08-09T12:48:48.401226+0000","last_peered":"2023-08-09T12:48:48.401226+0000","last_clean":"2023-08-09T12:48:48.401226+0000","last_became_active":"2023-08-09T12:48:46.967751+0000","last_became_peered":"2023-08-09T12:48:46.967751+0000","last_unstale":"2023-08-09T12:48:48.401226+0000","last_undegraded":"2023-08-09T12:48:48.401226+0000","last_fullsized":"2023-08-09T12:48:48.401226+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:07:13.869924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"160'8","reported_seq":21,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402679+0000","last_change":"2023-08-09T12:48:45.911662+0000","last_active":"2023-08-09T12:48:48.402679+0000","last_peered":"2023-08-09T12:48:48.402679+0000","last_clean":"2023-08-09T12:48:48.402679+0000","last_became_active":"2023-08-09T12:48:45.910793+0000","last_became_peered":"2023-08-09T12:48:45.910793+0000","last_unstale":"2023-08-09T12:48:48.402679+0000","last_undegraded":"2023-08-09T12:48:48.402679+0000","last_fullsized":"2023-08-09T12:48:48.402679+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:22:48.975076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":267,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002790+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:48:48.002790+0000","last_peered":"2023-08-09T12:48:48.002790+0000","last_clean":"2023-08-09T12:48:48.002790+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:48:48.002790+0000","last_undegraded":"2023-08-09T12:48:48.002790+0000","last_fullsized":"2023-08-09T12:48:48.002790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:15.836637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.399992+0000","last_change":"2023-08-09T12:48:46.964313+0000","last_active":"2023-08-09T12:48:48.399992+0000","last_peered":"2023-08-09T12:48:48.399992+0000","last_clean":"2023-08-09T12:48:48.399992+0000","last_became_active":"2023-08-09T12:48:46.964066+0000","last_became_peered":"2023-08-09T12:48:46.964066+0000","last_unstale":"2023-08-09T12:48:48.399992+0000","last_undegraded":"2023-08-09T12:48:48.399992+0000","last_fullsized":"2023-08-09T12:48:48.399992+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:37.832654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002723+0000","last_change":"2023-08-09T12:48:45.889867+0000","last_active":"2023-08-09T12:48:48.002723+0000","last_peered":"2023-08-09T12:48:48.002723+0000","last_clean":"2023-08-09T12:48:48.002723+0000","last_became_active":"2023-08-09T12:48:45.889203+0000","last_became_peered":"2023-08-09T12:48:45.889203+0000","last_unstale":"2023-08-09T12:48:48.002723+0000","last_undegraded":"2023-08-09T12:48:48.002723+0000","last_fullsized":"2023-08-09T12:48:48.002723+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:48:52.716602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":265,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930379+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:48:47.930379+0000","last_peered":"2023-08-09T12:48:47.930379+0000","last_clean":"2023-08-09T12:48:47.930379+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:48:47.930379+0000","last_undegraded":"2023-08-09T12:48:47.930379+0000","last_fullsized":"2023-08-09T12:48:47.930379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:22:46.423861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930594+0000","last_change":"2023-08-09T12:48:46.954804+0000","last_active":"2023-08-09T12:48:47.930594+0000","last_peered":"2023-08-09T12:48:47.930594+0000","last_clean":"2023-08-09T12:48:47.930594+0000","last_became_active":"2023-08-09T12:48:46.954030+0000","last_became_peered":"2023-08-09T12:48:46.954030+0000","last_unstale":"2023-08-09T12:48:47.930594+0000","last_undegraded":"2023-08-09T12:48:47.930594+0000","last_fullsized":"2023-08-09T12:48:47.930594+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:43.593280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"160'3","reported_seq":16,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927973+0000","last_change":"2023-08-09T12:48:45.904271+0000","last_active":"2023-08-09T12:48:47.927973+0000","last_peered":"2023-08-09T12:48:47.927973+0000","last_clean":"2023-08-09T12:48:47.927973+0000","last_became_active":"2023-08-09T12:48:45.903570+0000","last_became_peered":"2023-08-09T12:48:45.903570+0000","last_unstale":"2023-08-09T12:48:47.927973+0000","last_undegraded":"2023-08-09T12:48:47.927973+0000","last_fullsized":"2023-08-09T12:48:47.927973+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:39.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403517+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:48:48.403517+0000","last_peered":"2023-08-09T12:48:48.403517+0000","last_clean":"2023-08-09T12:48:48.403517+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:48:48.403517+0000","last_undegraded":"2023-08-09T12:48:48.403517+0000","last_fullsized":"2023-08-09T12:48:48.403517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:34.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929633+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:47.929633+0000","last_peered":"2023-08-09T12:48:47.929633+0000","last_clean":"2023-08-09T12:48:47.929633+0000","last_became_active":"2023-08-09T12:48:46.959496+0000","last_became_peered":"2023-08-09T12:48:46.959496+0000","last_unstale":"2023-08-09T12:48:47.929633+0000","last_undegraded":"2023-08-09T12:48:47.929633+0000","last_fullsized":"2023-08-09T12:48:47.929633+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:50:56.437877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"160'6","reported_seq":19,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928636+0000","last_change":"2023-08-09T12:48:45.908372+0000","last_active":"2023-08-09T12:48:47.928636+0000","last_peered":"2023-08-09T12:48:47.928636+0000","last_clean":"2023-08-09T12:48:47.928636+0000","last_became_active":"2023-08-09T12:48:45.907802+0000","last_became_peered":"2023-08-09T12:48:45.907802+0000","last_unstale":"2023-08-09T12:48:47.928636+0000","last_undegraded":"2023-08-09T12:48:47.928636+0000","last_fullsized":"2023-08-09T12:48:47.928636+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:39:26.279179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":289,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928936+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:48:47.928936+0000","last_peered":"2023-08-09T12:48:47.928936+0000","last_clean":"2023-08-09T12:48:47.928936+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:48:47.928936+0000","last_undegraded":"2023-08-09T12:48:47.928936+0000","last_fullsized":"2023-08-09T12:48:47.928936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:06:29.287589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002203+0000","last_change":"2023-08-09T12:48:46.944465+0000","last_active":"2023-08-09T12:48:48.002203+0000","last_peered":"2023-08-09T12:48:48.002203+0000","last_clean":"2023-08-09T12:48:48.002203+0000","last_became_active":"2023-08-09T12:48:46.943732+0000","last_became_peered":"2023-08-09T12:48:46.943732+0000","last_unstale":"2023-08-09T12:48:48.002203+0000","last_undegraded":"2023-08-09T12:48:48.002203+0000","last_fullsized":"2023-08-09T12:48:48.002203+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:27:06.912340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928549+0000","last_change":"2023-08-09T12:48:45.910997+0000","last_active":"2023-08-09T12:48:47.928549+0000","last_peered":"2023-08-09T12:48:47.928549+0000","last_clean":"2023-08-09T12:48:47.928549+0000","last_became_active":"2023-08-09T12:48:45.910593+0000","last_became_peered":"2023-08-09T12:48:45.910593+0000","last_unstale":"2023-08-09T12:48:47.928549+0000","last_undegraded":"2023-08-09T12:48:47.928549+0000","last_fullsized":"2023-08-09T12:48:47.928549+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:25:52.042753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":263,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403622+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:48:48.403622+0000","last_peered":"2023-08-09T12:48:48.403622+0000","last_clean":"2023-08-09T12:48:48.403622+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:48:48.403622+0000","last_undegraded":"2023-08-09T12:48:48.403622+0000","last_fullsized":"2023-08-09T12:48:48.403622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:56:56.760218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402630+0000","last_change":"2023-08-09T12:48:46.964415+0000","last_active":"2023-08-09T12:48:48.402630+0000","last_peered":"2023-08-09T12:48:48.402630+0000","last_clean":"2023-08-09T12:48:48.402630+0000","last_became_active":"2023-08-09T12:48:46.961581+0000","last_became_peered":"2023-08-09T12:48:46.961581+0000","last_unstale":"2023-08-09T12:48:48.402630+0000","last_undegraded":"2023-08-09T12:48:48.402630+0000","last_fullsized":"2023-08-09T12:48:48.402630+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:00.057084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.003095+0000","last_change":"2023-08-09T12:48:45.890515+0000","last_active":"2023-08-09T12:48:48.003095+0000","last_peered":"2023-08-09T12:48:48.003095+0000","last_clean":"2023-08-09T12:48:48.003095+0000","last_became_active":"2023-08-09T12:48:45.889827+0000","last_became_peered":"2023-08-09T12:48:45.889827+0000","last_unstale":"2023-08-09T12:48:48.003095+0000","last_undegraded":"2023-08-09T12:48:48.003095+0000","last_fullsized":"2023-08-09T12:48:48.003095+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:45.775968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":287,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929696+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:48:47.929696+0000","last_peered":"2023-08-09T12:48:47.929696+0000","last_clean":"2023-08-09T12:48:47.929696+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:48:47.929696+0000","last_undegraded":"2023-08-09T12:48:47.929696+0000","last_fullsized":"2023-08-09T12:48:47.929696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:25:00.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1513,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193798,"statfs":{"total":200000000,"available":198450126,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1439999999999999,"15min":1.107},"min":{"1min":0.64300000000000002,"5min":0.627,"15min":0.59899999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0900000000000001,"15min":1.091},"min":{"1min":0.70499999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7509999999999999,"5min":1.7769999999999999,"15min":2.0459999999999998},"last":1.012}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.224,"15min":1.149},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.63300000000000001},"max":{"1min":1.629,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.167,"15min":1.133},"min":{"1min":0.73499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.83999999999999997}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.26,"15min":1.2050000000000001},"min":{"1min":0.83299999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.591,"5min":1.96,"15min":2.1459999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.218,"5min":1.2230000000000001,"15min":1.1759999999999999},"min":{"1min":0.81200000000000006,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.7450000000000001,"15min":2.173},"last":1.119}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.341,"15min":1.268},"min":{"1min":0.79100000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.806,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.331,"15min":1.2949999999999999},"min":{"1min":0.97899999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6200000000000001,"5min":1.992,"15min":2.282},"last":1.0509999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.276,"15min":1.2330000000000001},"min":{"1min":0.98499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.948,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.238},{"interface":"front","average":{"1min":1.302,"5min":1.3799999999999999,"15min":1.3200000000000001},"min":{"1min":0.90800000000000003,"5min":0.82299999999999995,"15min":0.58599999999999997},"max":{"1min":1.764,"5min":2.5070000000000001,"15min":4.6200000000000001},"last":1.2869999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.878,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.978,"5min":2.1699999999999999,"15min":2.802},"last":1.409},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.536,"15min":1.502},"min":{"1min":0.97799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1299999999999999,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.522,"15min":1.486},"min":{"1min":1.1259999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2370000000000001,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":1.337},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.542,"15min":1.476},"min":{"1min":1.073,"5min":1.0029999999999999,"15min":0.623},"max":{"1min":1.95,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.5609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":936,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194376,"statfs":{"total":200000000,"available":199041524,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.135},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.544,"5min":1.986,"15min":2.54},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.099,"15min":1.083},"min":{"1min":0.72099999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.615,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.3160000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.226,"15min":1.2290000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.51,"5min":1.996,"15min":2.306},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.3009999999999999,"15min":1.3160000000000001},"min":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":0.90200000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1839999999999999,"15min":1.1240000000000001},"min":{"1min":0.91100000000000003,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.28,"15min":1.2789999999999999},"min":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.772,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.3919999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7070000000000001,"5min":2.327,"15min":2.327},"last":1.633},{"interface":"front","average":{"1min":1.369,"5min":1.3680000000000001,"15min":1.3160000000000001},"min":{"1min":1.0549999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.724,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.1339999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3340000000000001,"15min":1.3540000000000001},"min":{"1min":1.01,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.651,"5min":2.028,"15min":11.058999999999999},"last":1.504},{"interface":"front","average":{"1min":1.337,"5min":1.339,"15min":1.351},"min":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":2.29,"15min":2.3479999999999999},"last":1.6990000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.0089999999999999,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.71,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4750000000000001,"15min":1.4890000000000001},"min":{"1min":1.087,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.8009999999999999,"5min":2.222,"15min":2.8580000000000001},"last":1.585}]},{"osd":7,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.5089999999999999,"15min":1.4670000000000001},"min":{"1min":1.137,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9059999999999999,"5min":2.1520000000000001,"15min":2.7999999999999998},"last":1.8320000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.5129999999999999,"15min":1.4690000000000001},"min":{"1min":1.1259999999999999,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.8109999999999999,"5min":2.7810000000000001,"15min":3.621},"last":1.534}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042174,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.68000000000000005,"15min":0.55300000000000005},"max":{"1min":1.591,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2070000000000001,"15min":1.113},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.97,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0629999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3680000000000001,"15min":1.3109999999999999},"min":{"1min":0.78600000000000003,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.7190000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.851},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.284,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7310000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.748}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.264,"15min":1.22},"min":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.151},{"interface":"front","average":{"1min":1.222,"5min":1.2310000000000001,"15min":1.2030000000000001},"min":{"1min":0.78800000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.554,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.2649999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.2410000000000001},"min":{"1min":1.006,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5429999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.47},{"interface":"front","average":{"1min":1.387,"5min":1.393,"15min":1.3740000000000001},"min":{"1min":0.998,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":1.7809999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.335,"15min":1.2569999999999999},"min":{"1min":0.877,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":1.7549999999999999,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.373},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.456,"15min":1.389},"min":{"1min":1.032,"5min":0.80600000000000005,"15min":0.628},"max":{"1min":1.7190000000000001,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.9830000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.4419999999999999,"15min":1.367},"min":{"1min":1.006,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.833,"5min":2.952,"15min":2.952},"last":1.9299999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":0.98199999999999998,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.762,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.6990000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.575,"15min":1.53},"min":{"1min":1.0860000000000001,"5min":0.86599999999999999,"15min":0.67200000000000004},"max":{"1min":2.0329999999999999,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":2.1709999999999998},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6399999999999999,"15min":1.5469999999999999},"min":{"1min":1.069,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.9179999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":2.0419999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1040000000000001,"15min":1.0940000000000001},"min":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.579,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.878},{"interface":"front","average":{"1min":1.145,"5min":1.131,"15min":1.119},"min":{"1min":0.77000000000000002,"5min":0.66500000000000004,"15min":0.64800000000000002},"max":{"1min":1.5740000000000001,"5min":1.635,"15min":3.4100000000000001},"last":1.1279999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.288,"15min":1.3180000000000001},"min":{"1min":0.88100000000000001,"5min":0.77400000000000002,"15min":0.48899999999999999},"max":{"1min":1.863,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.92600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8240000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":0.98199999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.306,"15min":1.3169999999999999},"min":{"1min":0.86199999999999999,"5min":0.70799999999999996,"15min":0.54900000000000004},"max":{"1min":1.9470000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.081},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3420000000000001,"15min":1.3300000000000001},"min":{"1min":0.81499999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8100000000000001,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.238}]},{"osd":3,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2889999999999999,"15min":1.248},"min":{"1min":1.0329999999999999,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.728,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3320000000000001,"15min":1.335},"min":{"1min":0.98199999999999998,"5min":0.93999999999999995,"15min":0.82699999999999996},"max":{"1min":2.0539999999999998,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.1699999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3759999999999999,"15min":1.381},"min":{"1min":0.85499999999999998,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":1.857,"5min":3.137,"15min":3.137},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.367,"15min":1.381},"min":{"1min":0.89400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":2.403,"5min":2.403,"15min":3.3620000000000001},"last":1.464}]},{"osd":6,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4399999999999999,"15min":1.466},"min":{"1min":0.82299999999999995,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":2.262,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.5469999999999999,"15min":1.538},"min":{"1min":1.0660000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1070000000000002,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.5069999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.5249999999999999,"15min":1.5289999999999999},"min":{"1min":1.1950000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.599,"15min":1.613},"min":{"1min":1.2689999999999999,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.4590000000000001,"5min":2.875,"15min":2.875},"last":1.6559999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":936,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194375,"statfs":{"total":200000000,"available":199040514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.84699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.458,"5min":1.458,"15min":4.4109999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.024,"15min":0.94199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.698,"5min":2.778,"15min":3.2269999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.52000000000000002,"5min":0.41099999999999998,"15min":0.38100000000000001},"max":{"1min":1.448,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.127,"15min":0.98799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.407,"5min":2.0219999999999998,"15min":2.0880000000000001},"last":0.92400000000000004}]},{"osd":2,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.103,"15min":1.129},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.48,"5min":1.9259999999999999,"15min":18.145},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2569999999999999,"15min":1.208},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.619,"5min":2.169,"15min":2.169},"last":1.0669999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.78200000000000003,"5min":0.75,"15min":0.745},"max":{"1min":1.7709999999999999,"5min":1.8660000000000001,"15min":3.5110000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.306,"15min":1.325},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":1.5640000000000001,"5min":2.056,"15min":3.5960000000000001},"last":1.357}]},{"osd":5,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.345,"15min":1.4299999999999999},"min":{"1min":0.82099999999999995,"5min":0.80500000000000005,"15min":0.72999999999999998},"max":{"1min":1.7150000000000001,"5min":2.2389999999999999,"15min":18.094000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.429,"15min":1.389},"min":{"1min":0.752,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.6020000000000001,"5min":2.2959999999999998,"15min":14.105},"last":1.2809999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3899999999999999,"15min":1.357},"min":{"1min":0.92200000000000004,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.641,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4319999999999999,"15min":1.462},"min":{"1min":0.90300000000000002,"5min":0.86399999999999999,"15min":0.77700000000000002},"max":{"1min":1.792,"5min":2.0099999999999998,"15min":4.0220000000000002},"last":1.571}]},{"osd":7,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.526,"15min":1.4279999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":1.7430000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4950000000000001,"15min":1.4139999999999999},"min":{"1min":0.96299999999999997,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":1.6759999999999999,"5min":2.073,"15min":3.016},"last":1.548}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194376,"statfs":{"total":200000000,"available":199041580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90900000000000003,"15min":0.86699999999999999},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":1.3759999999999999,"5min":1.597,"15min":1.716},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.024,"5min":1.028,"15min":0.96699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.5680000000000001,"5min":1.73,"15min":2.9009999999999998},"last":1.002}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92000000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5,"5min":1.823,"15min":1.869},"last":1.022}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.149,"15min":1.1559999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.615,"5min":1.681,"15min":3.2850000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1930000000000001,"15min":1.1639999999999999},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.637,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":1.325}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4510000000000001,"15min":1.419},"min":{"1min":0.93200000000000005,"5min":0.83499999999999996,"15min":0.81899999999999995},"max":{"1min":1.7250000000000001,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.351,"15min":1.3},"min":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.694,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":0.94699999999999995}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.401,"15min":1.375},"min":{"1min":0.78900000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0110000000000001,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.226},{"interface":"front","average":{"1min":1.419,"5min":1.448,"15min":1.472},"min":{"1min":0.878,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8120000000000001,"5min":2.4780000000000002,"15min":4.806},"last":1.5940000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8580000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.163},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.468,"15min":1.4299999999999999},"min":{"1min":0.89600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.901,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":1.671}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.462,"15min":1.3839999999999999},"min":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"max":{"1min":1.8640000000000001,"5min":2.464,"15min":2.464},"last":1.204},{"interface":"front","average":{"1min":1.431,"5min":1.536,"15min":1.5269999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.036,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.5369999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042126,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91000000000000003,"15min":0.89400000000000002},"min":{"1min":0.53000000000000003,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":1.542,"5min":2.621,"15min":2.621},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.008,"15min":1.2709999999999999},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.5169999999999999,"5min":1.9530000000000001,"15min":88.254999999999995},"last":0.66200000000000003}]},{"osd":2,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.998,"15min":0.96699999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":3.0209999999999999},"last":0.746},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2470000000000001,"15min":1.1699999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7849999999999999,"5min":2.0449999999999999,"15min":3.1890000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1879999999999999,"15min":1.1200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.085,"15min":1.0069999999999999},"min":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.397,"5min":1.819,"15min":5.4320000000000004},"last":0.73499999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.24,"15min":1.304},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.581,"5min":2.391,"15min":25.172000000000001},"last":1.272},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.391,"15min":1.3300000000000001},"min":{"1min":0.93500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.085,"5min":3.762,"15min":3.762},"last":1.3700000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3260000000000001,"15min":1.4079999999999999},"min":{"1min":0.92200000000000004,"5min":0.751,"15min":0.751},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":28.710000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.327,"15min":1.2989999999999999},"min":{"1min":0.84599999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6910000000000001,"5min":1.9910000000000001,"15min":3.762},"last":1.3340000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4510000000000001,"15min":1.4379999999999999},"min":{"1min":1.022,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7230000000000001,"5min":1.841,"15min":6.0460000000000003},"last":1.21},{"interface":"front","average":{"1min":1.383,"5min":1.4419999999999999,"15min":1.397},"min":{"1min":1.0609999999999999,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":1.6759999999999999,"5min":2.0960000000000001,"15min":2.1480000000000001},"last":1.528}]},{"osd":7,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.532,"15min":1.595},"min":{"1min":0.89800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.2370000000000001,"5min":2.5089999999999999,"15min":26.975999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5389999999999999,"15min":1.589},"min":{"1min":1.141,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.988,"5min":2.492,"15min":28.765000000000001},"last":1.151}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1511,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193800,"statfs":{"total":200000000,"available":198451772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.61299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.819},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0249999999999999,"15min":0.97799999999999998},"min":{"1min":0.60699999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.331,"5min":1.6699999999999999,"15min":6.1749999999999998},"last":1.4410000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.032,"15min":0.97899999999999998},"min":{"1min":0.63500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.411,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.044},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5189999999999999,"5min":1.732,"15min":6.2549999999999999},"last":1.137}]},{"osd":3,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.0429999999999999,"15min":0.97899999999999998},"min":{"1min":0.68300000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4570000000000001,"5min":1.6699999999999999,"15min":9.6069999999999993},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.1850000000000001},"min":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.2150000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3240000000000001,"15min":1.337},"min":{"1min":0.90600000000000003,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.6919999999999999,"5min":1.8240000000000001,"15min":9.9629999999999992},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.377,"15min":1.3129999999999999},"min":{"1min":0.85799999999999998,"5min":0.78600000000000003,"15min":0.77900000000000003},"max":{"1min":1.825,"5min":1.879,"15min":1.879},"last":1.476}]},{"osd":5,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.351,"15min":1.325},"min":{"1min":0.86299999999999999,"5min":0.82799999999999996,"15min":0.76300000000000001},"max":{"1min":1.8200000000000001,"5min":2.0419999999999998,"15min":10.004},"last":1.534},{"interface":"front","average":{"1min":1.411,"5min":1.4359999999999999,"15min":1.3939999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.728,"5min":2.0569999999999999,"15min":2.161},"last":1.5840000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4259999999999999,"15min":1.369},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.863,"5min":2.2000000000000002,"15min":6.4290000000000003},"last":1.51},{"interface":"front","average":{"1min":1.363,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":1.7030000000000001,"5min":2.1549999999999998,"15min":9.9190000000000005},"last":1.625}]},{"osd":7,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.466,"15min":1.458},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.9319999999999999,"5min":2.2909999999999999,"15min":18.114000000000001},"last":1.353},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.5209999999999999,"15min":1.4850000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.891,"5min":2.1120000000000001,"15min":9.5640000000000001},"last":1.702}]}]}],"pool_statfs":[]}} 2023-08-09T12:48:56.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:48:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.858+0000 7fa40cc63640 1 Processor -- start 2023-08-09T12:48:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.858+0000 7fa40cc63640 1 -- start start 2023-08-09T12:48:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa40cc63640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa408160030 0x7fa408160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa40cc63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4080b86e0 0x7fa4080cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa40cc63640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4080b5a30 con 0x7fa4080cf980 2023-08-09T12:48:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa40cc63640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4080d1110 con 0x7fa408160030 2023-08-09T12:48:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa40cc63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080ceac0 con 0x7fa4080b86e0 2023-08-09T12:48:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa4077fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa408160030 0x7fa408160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa4077fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa408160030 0x7fa408160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57234/0 (socket says 172.21.15.17:57234) 2023-08-09T12:48:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa4077fe640 1 -- 172.21.15.17:0/1916049280 learned_addr learned my addr 172.21.15.17:0/1916049280 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.860+0000 7fa406ffd640 1 --2- 172.21.15.17:0/1916049280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4080b86e0 0x7fa4080cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.861+0000 7fa4077fe640 1 -- 172.21.15.17:0/1916049280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4080b86e0 msgr2=0x7fa4080cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.861+0000 7fa4077fe640 1 --2- 172.21.15.17:0/1916049280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4080b86e0 0x7fa4080cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.861+0000 7fa4077fe640 1 -- 172.21.15.17:0/1916049280 >> v1:172.21.15.142:6789/0 conn(0x7fa4080cf980 legacy=0x7fa4080b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.861+0000 7fa4077fe640 1 -- 172.21.15.17:0/1916049280 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4080d0d70 con 0x7fa408160030 2023-08-09T12:48:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.862+0000 7fa4077fe640 1 --2- 172.21.15.17:0/1916049280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa408160030 0x7fa408160740 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceebf5760ed3bad9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:56.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.862+0000 7fa4067fc640 1 -- 172.21.15.17:0/1916049280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8031640 con 0x7fa408160030 2023-08-09T12:48:56.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.862+0000 7fa4067fc640 1 -- 172.21.15.17:0/1916049280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f80317a0 con 0x7fa408160030 2023-08-09T12:48:56.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.862+0000 7fa4067fc640 1 -- 172.21.15.17:0/1916049280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8031b30 con 0x7fa408160030 2023-08-09T12:48:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.863+0000 7fa40cc63640 1 -- 172.21.15.17:0/1916049280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa408160030 msgr2=0x7fa408160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.863+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1916049280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa408160030 0x7fa408160740 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.863+0000 7fa40cc63640 1 -- 172.21.15.17:0/1916049280 shutdown_connections 2023-08-09T12:48:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.863+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1916049280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4080b86e0 0x7fa4080cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.863+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1916049280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa408160030 0x7fa408160740 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.863+0000 7fa40cc63640 1 -- 172.21.15.17:0/1916049280 >> 172.21.15.17:0/1916049280 conn(0x7fa4080697c0 msgr2=0x7fa408069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.863+0000 7fa40cc63640 1 -- 172.21.15.17:0/1916049280 shutdown_connections 2023-08-09T12:48:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.863+0000 7fa40cc63640 1 -- 172.21.15.17:0/1916049280 wait complete. 2023-08-09T12:48:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.865+0000 7fa40cc63640 1 Processor -- start 2023-08-09T12:48:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.865+0000 7fa40cc63640 1 -- start start 2023-08-09T12:48:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa40cc63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4080b86e0 0x7fa4081f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa40cc63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4080cf980 0x7fa4080caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa40cc63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa408160030 0x7fa40815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa40cc63640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4081f56e0 con 0x7fa4080b86e0 2023-08-09T12:48:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa40cc63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080cc910 con 0x7fa4080cf980 2023-08-09T12:48:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa40cc63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080cb870 con 0x7fa408160030 2023-08-09T12:48:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4080b86e0 0x7fa4081f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4080b86e0 0x7fa4081f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57244/0 (socket says 172.21.15.17:57244) 2023-08-09T12:48:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.866+0000 7fa4077fe640 1 -- 172.21.15.17:0/1698093254 learned_addr learned my addr 172.21.15.17:0/1698093254 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.867+0000 7fa407fff640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa408160030 0x7fa40815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.867+0000 7fa406ffd640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4080cf980 0x7fa4080caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.867+0000 7fa4077fe640 1 -- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa408160030 msgr2=0x7fa40815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.867+0000 7fa4077fe640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa408160030 0x7fa40815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.867+0000 7fa4077fe640 1 -- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4080cf980 msgr2=0x7fa4080caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.867+0000 7fa4077fe640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4080cf980 0x7fa4080caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.867+0000 7fa4077fe640 1 -- 172.21.15.17:0/1698093254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80094d0 con 0x7fa4080b86e0 2023-08-09T12:48:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.867+0000 7fa4077fe640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4080b86e0 0x7fa4081f51a0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.868+0000 7fa3effff640 1 -- 172.21.15.17:0/1698093254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f803ac60 con 0x7fa4080b86e0 2023-08-09T12:48:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.868+0000 7fa3effff640 1 -- 172.21.15.17:0/1698093254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f803ade0 con 0x7fa4080b86e0 2023-08-09T12:48:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.868+0000 7fa3effff640 1 -- 172.21.15.17:0/1698093254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8044630 con 0x7fa4080b86e0 2023-08-09T12:48:56.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.868+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4080cbb50 con 0x7fa4080b86e0 2023-08-09T12:48:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.868+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4080cc110 con 0x7fa4080b86e0 2023-08-09T12:48:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.869+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40804e390 con 0x7fa4080b86e0 2023-08-09T12:48:56.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.870+0000 7fa3effff640 1 -- 172.21.15.17:0/1698093254 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa3f802f050 con 0x7fa4080b86e0 2023-08-09T12:48:56.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.871+0000 7fa3effff640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa3f406a050 0x7fa3f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:56.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.871+0000 7fa3effff640 1 -- 172.21.15.17:0/1698093254 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3f80aa690 con 0x7fa4080b86e0 2023-08-09T12:48:56.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.872+0000 7fa406ffd640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa3f406a050 0x7fa3f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:56.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.873+0000 7fa406ffd640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa3f406a050 0x7fa3f406c510 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa4080c8f60 tx=0x7fa3fc0079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:56.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:56.876+0000 7fa3effff640 1 -- 172.21.15.17:0/1698093254 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa3f8075d70 con 0x7fa4080b86e0 2023-08-09T12:48:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.066+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa408161250 con 0x7fa3f406a050 2023-08-09T12:48:57.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.089+0000 7fa3effff640 1 -- 172.21.15.17:0/1698093254 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303325 (secure 0 0 0) 0x7fa3fc007bb0 con 0x7fa3f406a050 2023-08-09T12:48:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:57.098 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:48:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa3f406a050 msgr2=0x7fa3f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa3f406a050 0x7fa3f406c510 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa4080c8f60 tx=0x7fa3fc0079a0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4080b86e0 msgr2=0x7fa4081f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4080b86e0 0x7fa4081f51a0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f80046c0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 shutdown_connections 2023-08-09T12:48:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa3f406a050 0x7fa3f406c510 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa408160030 0x7fa40815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4080cf980 0x7fa4080caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 --2- 172.21.15.17:0/1698093254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4080b86e0 0x7fa4081f51a0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 >> 172.21.15.17:0/1698093254 conn(0x7fa4080697c0 msgr2=0x7fa4080c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.095+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 shutdown_connections 2023-08-09T12:48:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.096+0000 7fa40cc63640 1 -- 172.21.15.17:0/1698093254 wait complete. 2023-08-09T12:48:57.117 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":447,"stamp":"2023-08-09T12:48:56.853561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553859,"statfs":{"total":1600000000,"available":1591152012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.927330"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002670+0000","last_change":"2023-08-09T12:48:46.961585+0000","last_active":"2023-08-09T12:48:48.002670+0000","last_peered":"2023-08-09T12:48:48.002670+0000","last_clean":"2023-08-09T12:48:48.002670+0000","last_became_active":"2023-08-09T12:48:46.961206+0000","last_became_peered":"2023-08-09T12:48:46.961206+0000","last_unstale":"2023-08-09T12:48:48.002670+0000","last_undegraded":"2023-08-09T12:48:48.002670+0000","last_fullsized":"2023-08-09T12:48:48.002670+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:52:42.914790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929727+0000","last_change":"2023-08-09T12:48:46.952118+0000","last_active":"2023-08-09T12:48:47.929727+0000","last_peered":"2023-08-09T12:48:47.929727+0000","last_clean":"2023-08-09T12:48:47.929727+0000","last_became_active":"2023-08-09T12:48:46.951749+0000","last_became_peered":"2023-08-09T12:48:46.951749+0000","last_unstale":"2023-08-09T12:48:47.929727+0000","last_undegraded":"2023-08-09T12:48:47.929727+0000","last_fullsized":"2023-08-09T12:48:47.929727+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:10.366110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.931008+0000","last_change":"2023-08-09T12:48:46.962586+0000","last_active":"2023-08-09T12:48:47.931008+0000","last_peered":"2023-08-09T12:48:47.931008+0000","last_clean":"2023-08-09T12:48:47.931008+0000","last_became_active":"2023-08-09T12:48:46.962122+0000","last_became_peered":"2023-08-09T12:48:46.962122+0000","last_unstale":"2023-08-09T12:48:47.931008+0000","last_undegraded":"2023-08-09T12:48:47.931008+0000","last_fullsized":"2023-08-09T12:48:47.931008+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:53:42.349193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928828+0000","last_change":"2023-08-09T12:48:46.958261+0000","last_active":"2023-08-09T12:48:47.928828+0000","last_peered":"2023-08-09T12:48:47.928828+0000","last_clean":"2023-08-09T12:48:47.928828+0000","last_became_active":"2023-08-09T12:48:46.957807+0000","last_became_peered":"2023-08-09T12:48:46.957807+0000","last_unstale":"2023-08-09T12:48:47.928828+0000","last_undegraded":"2023-08-09T12:48:47.928828+0000","last_fullsized":"2023-08-09T12:48:47.928828+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:49.322907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401259+0000","last_change":"2023-08-09T12:48:46.962514+0000","last_active":"2023-08-09T12:48:48.401259+0000","last_peered":"2023-08-09T12:48:48.401259+0000","last_clean":"2023-08-09T12:48:48.401259+0000","last_became_active":"2023-08-09T12:48:46.961600+0000","last_became_peered":"2023-08-09T12:48:46.961600+0000","last_unstale":"2023-08-09T12:48:48.401259+0000","last_undegraded":"2023-08-09T12:48:48.401259+0000","last_fullsized":"2023-08-09T12:48:48.401259+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:58:27.900614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402704+0000","last_change":"2023-08-09T12:48:46.945929+0000","last_active":"2023-08-09T12:48:48.402704+0000","last_peered":"2023-08-09T12:48:48.402704+0000","last_clean":"2023-08-09T12:48:48.402704+0000","last_became_active":"2023-08-09T12:48:46.943618+0000","last_became_peered":"2023-08-09T12:48:46.943618+0000","last_unstale":"2023-08-09T12:48:48.402704+0000","last_undegraded":"2023-08-09T12:48:48.402704+0000","last_fullsized":"2023-08-09T12:48:48.402704+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:40:53.848174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927064+0000","last_change":"2023-08-09T12:48:46.941718+0000","last_active":"2023-08-09T12:48:47.927064+0000","last_peered":"2023-08-09T12:48:47.927064+0000","last_clean":"2023-08-09T12:48:47.927064+0000","last_became_active":"2023-08-09T12:48:46.939246+0000","last_became_peered":"2023-08-09T12:48:46.939246+0000","last_unstale":"2023-08-09T12:48:47.927064+0000","last_undegraded":"2023-08-09T12:48:47.927064+0000","last_fullsized":"2023-08-09T12:48:47.927064+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:10.888285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400590+0000","last_change":"2023-08-09T12:48:46.955542+0000","last_active":"2023-08-09T12:48:48.400590+0000","last_peered":"2023-08-09T12:48:48.400590+0000","last_clean":"2023-08-09T12:48:48.400590+0000","last_became_active":"2023-08-09T12:48:46.955219+0000","last_became_peered":"2023-08-09T12:48:46.955219+0000","last_unstale":"2023-08-09T12:48:48.400590+0000","last_undegraded":"2023-08-09T12:48:48.400590+0000","last_fullsized":"2023-08-09T12:48:48.400590+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:23:04.675560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401925+0000","last_change":"2023-08-09T12:48:46.969489+0000","last_active":"2023-08-09T12:48:48.401925+0000","last_peered":"2023-08-09T12:48:48.401925+0000","last_clean":"2023-08-09T12:48:48.401925+0000","last_became_active":"2023-08-09T12:48:46.967474+0000","last_became_peered":"2023-08-09T12:48:46.967474+0000","last_unstale":"2023-08-09T12:48:48.401925+0000","last_undegraded":"2023-08-09T12:48:48.401925+0000","last_fullsized":"2023-08-09T12:48:48.401925+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:53:54.961127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400203+0000","last_change":"2023-08-09T12:48:46.957863+0000","last_active":"2023-08-09T12:48:48.400203+0000","last_peered":"2023-08-09T12:48:48.400203+0000","last_clean":"2023-08-09T12:48:48.400203+0000","last_became_active":"2023-08-09T12:48:46.957367+0000","last_became_peered":"2023-08-09T12:48:46.957367+0000","last_unstale":"2023-08-09T12:48:48.400203+0000","last_undegraded":"2023-08-09T12:48:48.400203+0000","last_fullsized":"2023-08-09T12:48:48.400203+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:36.741262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927863+0000","last_change":"2023-08-09T12:48:46.953736+0000","last_active":"2023-08-09T12:48:47.927863+0000","last_peered":"2023-08-09T12:48:47.927863+0000","last_clean":"2023-08-09T12:48:47.927863+0000","last_became_active":"2023-08-09T12:48:46.953362+0000","last_became_peered":"2023-08-09T12:48:46.953362+0000","last_unstale":"2023-08-09T12:48:47.927863+0000","last_undegraded":"2023-08-09T12:48:47.927863+0000","last_fullsized":"2023-08-09T12:48:47.927863+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:53:54.961127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002489+0000","last_change":"2023-08-09T12:48:46.965972+0000","last_active":"2023-08-09T12:48:48.002489+0000","last_peered":"2023-08-09T12:48:48.002489+0000","last_clean":"2023-08-09T12:48:48.002489+0000","last_became_active":"2023-08-09T12:48:46.965713+0000","last_became_peered":"2023-08-09T12:48:46.965713+0000","last_unstale":"2023-08-09T12:48:48.002489+0000","last_undegraded":"2023-08-09T12:48:48.002489+0000","last_fullsized":"2023-08-09T12:48:48.002489+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:01:26.506985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402321+0000","last_change":"2023-08-09T12:48:46.948200+0000","last_active":"2023-08-09T12:48:48.402321+0000","last_peered":"2023-08-09T12:48:48.402321+0000","last_clean":"2023-08-09T12:48:48.402321+0000","last_became_active":"2023-08-09T12:48:46.946223+0000","last_became_peered":"2023-08-09T12:48:46.946223+0000","last_unstale":"2023-08-09T12:48:48.402321+0000","last_undegraded":"2023-08-09T12:48:48.402321+0000","last_fullsized":"2023-08-09T12:48:48.402321+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:15:49.322907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002618+0000","last_change":"2023-08-09T12:48:46.937286+0000","last_active":"2023-08-09T12:48:48.002618+0000","last_peered":"2023-08-09T12:48:48.002618+0000","last_clean":"2023-08-09T12:48:48.002618+0000","last_became_active":"2023-08-09T12:48:46.936728+0000","last_became_peered":"2023-08-09T12:48:46.936728+0000","last_unstale":"2023-08-09T12:48:48.002618+0000","last_undegraded":"2023-08-09T12:48:48.002618+0000","last_fullsized":"2023-08-09T12:48:48.002618+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:04:49.241531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002412+0000","last_change":"2023-08-09T12:48:46.936044+0000","last_active":"2023-08-09T12:48:48.002412+0000","last_peered":"2023-08-09T12:48:48.002412+0000","last_clean":"2023-08-09T12:48:48.002412+0000","last_became_active":"2023-08-09T12:48:46.935618+0000","last_became_peered":"2023-08-09T12:48:46.935618+0000","last_unstale":"2023-08-09T12:48:48.002412+0000","last_undegraded":"2023-08-09T12:48:48.002412+0000","last_fullsized":"2023-08-09T12:48:48.002412+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:42:40.983692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403094+0000","last_change":"2023-08-09T12:48:46.967285+0000","last_active":"2023-08-09T12:48:48.403094+0000","last_peered":"2023-08-09T12:48:48.403094+0000","last_clean":"2023-08-09T12:48:48.403094+0000","last_became_active":"2023-08-09T12:48:46.966922+0000","last_became_peered":"2023-08-09T12:48:46.966922+0000","last_unstale":"2023-08-09T12:48:48.403094+0000","last_undegraded":"2023-08-09T12:48:48.403094+0000","last_fullsized":"2023-08-09T12:48:48.403094+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:19:16.594380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402351+0000","last_change":"2023-08-09T12:48:46.964594+0000","last_active":"2023-08-09T12:48:48.402351+0000","last_peered":"2023-08-09T12:48:48.402351+0000","last_clean":"2023-08-09T12:48:48.402351+0000","last_became_active":"2023-08-09T12:48:46.962272+0000","last_became_peered":"2023-08-09T12:48:46.962272+0000","last_unstale":"2023-08-09T12:48:48.402351+0000","last_undegraded":"2023-08-09T12:48:48.402351+0000","last_fullsized":"2023-08-09T12:48:48.402351+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:25:53.056570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400828+0000","last_change":"2023-08-09T12:48:46.960291+0000","last_active":"2023-08-09T12:48:48.400828+0000","last_peered":"2023-08-09T12:48:48.400828+0000","last_clean":"2023-08-09T12:48:48.400828+0000","last_became_active":"2023-08-09T12:48:46.959860+0000","last_became_peered":"2023-08-09T12:48:46.959860+0000","last_unstale":"2023-08-09T12:48:48.400828+0000","last_undegraded":"2023-08-09T12:48:48.400828+0000","last_fullsized":"2023-08-09T12:48:48.400828+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:40.181758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925331+0000","last_change":"2023-08-09T12:48:46.935857+0000","last_active":"2023-08-09T12:48:47.925331+0000","last_peered":"2023-08-09T12:48:47.925331+0000","last_clean":"2023-08-09T12:48:47.925331+0000","last_became_active":"2023-08-09T12:48:46.935257+0000","last_became_peered":"2023-08-09T12:48:46.935257+0000","last_unstale":"2023-08-09T12:48:47.925331+0000","last_undegraded":"2023-08-09T12:48:47.925331+0000","last_fullsized":"2023-08-09T12:48:47.925331+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:21:54.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401605+0000","last_change":"2023-08-09T12:48:46.962333+0000","last_active":"2023-08-09T12:48:48.401605+0000","last_peered":"2023-08-09T12:48:48.401605+0000","last_clean":"2023-08-09T12:48:48.401605+0000","last_became_active":"2023-08-09T12:48:46.961277+0000","last_became_peered":"2023-08-09T12:48:46.961277+0000","last_unstale":"2023-08-09T12:48:48.401605+0000","last_undegraded":"2023-08-09T12:48:48.401605+0000","last_fullsized":"2023-08-09T12:48:48.401605+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:44:02.602474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928243+0000","last_change":"2023-08-09T12:48:46.958963+0000","last_active":"2023-08-09T12:48:47.928243+0000","last_peered":"2023-08-09T12:48:47.928243+0000","last_clean":"2023-08-09T12:48:47.928243+0000","last_became_active":"2023-08-09T12:48:46.958625+0000","last_became_peered":"2023-08-09T12:48:46.958625+0000","last_unstale":"2023-08-09T12:48:47.928243+0000","last_undegraded":"2023-08-09T12:48:47.928243+0000","last_fullsized":"2023-08-09T12:48:47.928243+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:55.205023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002675+0000","last_change":"2023-08-09T12:48:46.965018+0000","last_active":"2023-08-09T12:48:48.002675+0000","last_peered":"2023-08-09T12:48:48.002675+0000","last_clean":"2023-08-09T12:48:48.002675+0000","last_became_active":"2023-08-09T12:48:46.963886+0000","last_became_peered":"2023-08-09T12:48:46.963886+0000","last_unstale":"2023-08-09T12:48:48.002675+0000","last_undegraded":"2023-08-09T12:48:48.002675+0000","last_fullsized":"2023-08-09T12:48:48.002675+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:37:49.215398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927380+0000","last_change":"2023-08-09T12:48:46.952852+0000","last_active":"2023-08-09T12:48:47.927380+0000","last_peered":"2023-08-09T12:48:47.927380+0000","last_clean":"2023-08-09T12:48:47.927380+0000","last_became_active":"2023-08-09T12:48:46.952361+0000","last_became_peered":"2023-08-09T12:48:46.952361+0000","last_unstale":"2023-08-09T12:48:47.927380+0000","last_undegraded":"2023-08-09T12:48:47.927380+0000","last_fullsized":"2023-08-09T12:48:47.927380+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:05:04.814553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402235+0000","last_change":"2023-08-09T12:48:46.967994+0000","last_active":"2023-08-09T12:48:48.402235+0000","last_peered":"2023-08-09T12:48:48.402235+0000","last_clean":"2023-08-09T12:48:48.402235+0000","last_became_active":"2023-08-09T12:48:46.966330+0000","last_became_peered":"2023-08-09T12:48:46.966330+0000","last_unstale":"2023-08-09T12:48:48.402235+0000","last_undegraded":"2023-08-09T12:48:48.402235+0000","last_fullsized":"2023-08-09T12:48:48.402235+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:05:55.205023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928902+0000","last_change":"2023-08-09T12:48:46.939417+0000","last_active":"2023-08-09T12:48:47.928902+0000","last_peered":"2023-08-09T12:48:47.928902+0000","last_clean":"2023-08-09T12:48:47.928902+0000","last_became_active":"2023-08-09T12:48:46.938512+0000","last_became_peered":"2023-08-09T12:48:46.938512+0000","last_unstale":"2023-08-09T12:48:47.928902+0000","last_undegraded":"2023-08-09T12:48:47.928902+0000","last_fullsized":"2023-08-09T12:48:47.928902+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:19.303543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930256+0000","last_change":"2023-08-09T12:48:46.937004+0000","last_active":"2023-08-09T12:48:47.930256+0000","last_peered":"2023-08-09T12:48:47.930256+0000","last_clean":"2023-08-09T12:48:47.930256+0000","last_became_active":"2023-08-09T12:48:46.936557+0000","last_became_peered":"2023-08-09T12:48:46.936557+0000","last_unstale":"2023-08-09T12:48:47.930256+0000","last_undegraded":"2023-08-09T12:48:47.930256+0000","last_fullsized":"2023-08-09T12:48:47.930256+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:46:19.680233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925623+0000","last_change":"2023-08-09T12:48:46.944383+0000","last_active":"2023-08-09T12:48:47.925623+0000","last_peered":"2023-08-09T12:48:47.925623+0000","last_clean":"2023-08-09T12:48:47.925623+0000","last_became_active":"2023-08-09T12:48:46.944042+0000","last_became_peered":"2023-08-09T12:48:46.944042+0000","last_unstale":"2023-08-09T12:48:47.925623+0000","last_undegraded":"2023-08-09T12:48:47.925623+0000","last_fullsized":"2023-08-09T12:48:47.925623+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:58:34.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.399900+0000","last_change":"2023-08-09T12:48:46.957519+0000","last_active":"2023-08-09T12:48:48.399900+0000","last_peered":"2023-08-09T12:48:48.399900+0000","last_clean":"2023-08-09T12:48:48.399900+0000","last_became_active":"2023-08-09T12:48:46.955792+0000","last_became_peered":"2023-08-09T12:48:46.955792+0000","last_unstale":"2023-08-09T12:48:48.399900+0000","last_undegraded":"2023-08-09T12:48:48.399900+0000","last_fullsized":"2023-08-09T12:48:48.399900+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:27:27.410001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928065+0000","last_change":"2023-08-09T12:48:46.954814+0000","last_active":"2023-08-09T12:48:47.928065+0000","last_peered":"2023-08-09T12:48:47.928065+0000","last_clean":"2023-08-09T12:48:47.928065+0000","last_became_active":"2023-08-09T12:48:46.954498+0000","last_became_peered":"2023-08-09T12:48:46.954498+0000","last_unstale":"2023-08-09T12:48:47.928065+0000","last_undegraded":"2023-08-09T12:48:47.928065+0000","last_fullsized":"2023-08-09T12:48:47.928065+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:25:32.308701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929284+0000","last_change":"2023-08-09T12:48:46.939726+0000","last_active":"2023-08-09T12:48:47.929284+0000","last_peered":"2023-08-09T12:48:47.929284+0000","last_clean":"2023-08-09T12:48:47.929284+0000","last_became_active":"2023-08-09T12:48:46.939036+0000","last_became_peered":"2023-08-09T12:48:46.939036+0000","last_unstale":"2023-08-09T12:48:47.929284+0000","last_undegraded":"2023-08-09T12:48:47.929284+0000","last_fullsized":"2023-08-09T12:48:47.929284+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:37:31.425140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400789+0000","last_change":"2023-08-09T12:48:46.944030+0000","last_active":"2023-08-09T12:48:48.400789+0000","last_peered":"2023-08-09T12:48:48.400789+0000","last_clean":"2023-08-09T12:48:48.400789+0000","last_became_active":"2023-08-09T12:48:46.943711+0000","last_became_peered":"2023-08-09T12:48:46.943711+0000","last_unstale":"2023-08-09T12:48:48.400789+0000","last_undegraded":"2023-08-09T12:48:48.400789+0000","last_fullsized":"2023-08-09T12:48:48.400789+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:59:19.561948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.399935+0000","last_change":"2023-08-09T12:48:46.965452+0000","last_active":"2023-08-09T12:48:48.399935+0000","last_peered":"2023-08-09T12:48:48.399935+0000","last_clean":"2023-08-09T12:48:48.399935+0000","last_became_active":"2023-08-09T12:48:46.965169+0000","last_became_peered":"2023-08-09T12:48:46.965169+0000","last_unstale":"2023-08-09T12:48:48.399935+0000","last_undegraded":"2023-08-09T12:48:48.399935+0000","last_fullsized":"2023-08-09T12:48:48.399935+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:06:28.745289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401687+0000","last_change":"2023-08-09T12:48:46.937096+0000","last_active":"2023-08-09T12:48:48.401687+0000","last_peered":"2023-08-09T12:48:48.401687+0000","last_clean":"2023-08-09T12:48:48.401687+0000","last_became_active":"2023-08-09T12:48:46.936636+0000","last_became_peered":"2023-08-09T12:48:46.936636+0000","last_unstale":"2023-08-09T12:48:48.401687+0000","last_undegraded":"2023-08-09T12:48:48.401687+0000","last_fullsized":"2023-08-09T12:48:48.401687+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:48:16.494452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"160'4","reported_seq":17,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.932006+0000","last_change":"2023-08-09T12:48:45.895190+0000","last_active":"2023-08-09T12:48:47.932006+0000","last_peered":"2023-08-09T12:48:47.932006+0000","last_clean":"2023-08-09T12:48:47.932006+0000","last_became_active":"2023-08-09T12:48:45.894548+0000","last_became_peered":"2023-08-09T12:48:45.894548+0000","last_unstale":"2023-08-09T12:48:47.932006+0000","last_undegraded":"2023-08-09T12:48:47.932006+0000","last_fullsized":"2023-08-09T12:48:47.932006+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:20:13.304473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002403+0000","last_change":"2023-08-09T12:48:46.963254+0000","last_active":"2023-08-09T12:48:48.002403+0000","last_peered":"2023-08-09T12:48:48.002403+0000","last_clean":"2023-08-09T12:48:48.002403+0000","last_became_active":"2023-08-09T12:48:46.962887+0000","last_became_peered":"2023-08-09T12:48:46.962887+0000","last_unstale":"2023-08-09T12:48:48.002403+0000","last_undegraded":"2023-08-09T12:48:48.002403+0000","last_fullsized":"2023-08-09T12:48:48.002403+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:37:57.910566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401550+0000","last_change":"2023-08-09T12:48:45.912443+0000","last_active":"2023-08-09T12:48:48.401550+0000","last_peered":"2023-08-09T12:48:48.401550+0000","last_clean":"2023-08-09T12:48:48.401550+0000","last_became_active":"2023-08-09T12:48:45.912042+0000","last_became_peered":"2023-08-09T12:48:45.912042+0000","last_unstale":"2023-08-09T12:48:48.401550+0000","last_undegraded":"2023-08-09T12:48:48.401550+0000","last_fullsized":"2023-08-09T12:48:48.401550+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:22:20.272174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927746+0000","last_change":"2023-08-09T12:48:46.952678+0000","last_active":"2023-08-09T12:48:47.927746+0000","last_peered":"2023-08-09T12:48:47.927746+0000","last_clean":"2023-08-09T12:48:47.927746+0000","last_became_active":"2023-08-09T12:48:46.951843+0000","last_became_peered":"2023-08-09T12:48:46.951843+0000","last_unstale":"2023-08-09T12:48:47.927746+0000","last_undegraded":"2023-08-09T12:48:47.927746+0000","last_fullsized":"2023-08-09T12:48:47.927746+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:18.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927914+0000","last_change":"2023-08-09T12:48:45.912974+0000","last_active":"2023-08-09T12:48:47.927914+0000","last_peered":"2023-08-09T12:48:47.927914+0000","last_clean":"2023-08-09T12:48:47.927914+0000","last_became_active":"2023-08-09T12:48:45.912770+0000","last_became_peered":"2023-08-09T12:48:45.912770+0000","last_unstale":"2023-08-09T12:48:47.927914+0000","last_undegraded":"2023-08-09T12:48:47.927914+0000","last_fullsized":"2023-08-09T12:48:47.927914+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:56:09.299990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002842+0000","last_change":"2023-08-09T12:48:46.934802+0000","last_active":"2023-08-09T12:48:48.002842+0000","last_peered":"2023-08-09T12:48:48.002842+0000","last_clean":"2023-08-09T12:48:48.002842+0000","last_became_active":"2023-08-09T12:48:46.934325+0000","last_became_peered":"2023-08-09T12:48:46.934325+0000","last_unstale":"2023-08-09T12:48:48.002842+0000","last_undegraded":"2023-08-09T12:48:48.002842+0000","last_fullsized":"2023-08-09T12:48:48.002842+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:19:59.707943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925708+0000","last_change":"2023-08-09T12:48:45.906701+0000","last_active":"2023-08-09T12:48:47.925708+0000","last_peered":"2023-08-09T12:48:47.925708+0000","last_clean":"2023-08-09T12:48:47.925708+0000","last_became_active":"2023-08-09T12:48:45.906397+0000","last_became_peered":"2023-08-09T12:48:45.906397+0000","last_unstale":"2023-08-09T12:48:47.925708+0000","last_undegraded":"2023-08-09T12:48:47.925708+0000","last_fullsized":"2023-08-09T12:48:47.925708+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:04.299784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401011+0000","last_change":"2023-08-09T12:48:46.947241+0000","last_active":"2023-08-09T12:48:48.401011+0000","last_peered":"2023-08-09T12:48:48.401011+0000","last_clean":"2023-08-09T12:48:48.401011+0000","last_became_active":"2023-08-09T12:48:46.946611+0000","last_became_peered":"2023-08-09T12:48:46.946611+0000","last_unstale":"2023-08-09T12:48:48.401011+0000","last_undegraded":"2023-08-09T12:48:48.401011+0000","last_fullsized":"2023-08-09T12:48:48.401011+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:51:45.920759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400610+0000","last_change":"2023-08-09T12:48:45.904761+0000","last_active":"2023-08-09T12:48:48.400610+0000","last_peered":"2023-08-09T12:48:48.400610+0000","last_clean":"2023-08-09T12:48:48.400610+0000","last_became_active":"2023-08-09T12:48:45.904258+0000","last_became_peered":"2023-08-09T12:48:45.904258+0000","last_unstale":"2023-08-09T12:48:48.400610+0000","last_undegraded":"2023-08-09T12:48:48.400610+0000","last_fullsized":"2023-08-09T12:48:48.400610+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:34:35.308615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401182+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:48.401182+0000","last_peered":"2023-08-09T12:48:48.401182+0000","last_clean":"2023-08-09T12:48:48.401182+0000","last_became_active":"2023-08-09T12:48:46.959290+0000","last_became_peered":"2023-08-09T12:48:46.959290+0000","last_unstale":"2023-08-09T12:48:48.401182+0000","last_undegraded":"2023-08-09T12:48:48.401182+0000","last_fullsized":"2023-08-09T12:48:48.401182+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:12:39.259158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400998+0000","last_change":"2023-08-09T12:48:45.907778+0000","last_active":"2023-08-09T12:48:48.400998+0000","last_peered":"2023-08-09T12:48:48.400998+0000","last_clean":"2023-08-09T12:48:48.400998+0000","last_became_active":"2023-08-09T12:48:45.907326+0000","last_became_peered":"2023-08-09T12:48:45.907326+0000","last_unstale":"2023-08-09T12:48:48.400998+0000","last_undegraded":"2023-08-09T12:48:48.400998+0000","last_fullsized":"2023-08-09T12:48:48.400998+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:39:52.954554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400793+0000","last_change":"2023-08-09T12:48:46.963125+0000","last_active":"2023-08-09T12:48:48.400793+0000","last_peered":"2023-08-09T12:48:48.400793+0000","last_clean":"2023-08-09T12:48:48.400793+0000","last_became_active":"2023-08-09T12:48:46.955577+0000","last_became_peered":"2023-08-09T12:48:46.955577+0000","last_unstale":"2023-08-09T12:48:48.400793+0000","last_undegraded":"2023-08-09T12:48:48.400793+0000","last_fullsized":"2023-08-09T12:48:48.400793+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:50:34.959389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402972+0000","last_change":"2023-08-09T12:48:45.912814+0000","last_active":"2023-08-09T12:48:48.402972+0000","last_peered":"2023-08-09T12:48:48.402972+0000","last_clean":"2023-08-09T12:48:48.402972+0000","last_became_active":"2023-08-09T12:48:45.911537+0000","last_became_peered":"2023-08-09T12:48:45.911537+0000","last_unstale":"2023-08-09T12:48:48.402972+0000","last_undegraded":"2023-08-09T12:48:48.402972+0000","last_fullsized":"2023-08-09T12:48:48.402972+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:32:13.020495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925737+0000","last_change":"2023-08-09T12:48:46.945168+0000","last_active":"2023-08-09T12:48:47.925737+0000","last_peered":"2023-08-09T12:48:47.925737+0000","last_clean":"2023-08-09T12:48:47.925737+0000","last_became_active":"2023-08-09T12:48:46.944925+0000","last_became_peered":"2023-08-09T12:48:46.944925+0000","last_unstale":"2023-08-09T12:48:47.925737+0000","last_undegraded":"2023-08-09T12:48:47.925737+0000","last_fullsized":"2023-08-09T12:48:47.925737+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:23:54.312863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929957+0000","last_change":"2023-08-09T12:48:45.912104+0000","last_active":"2023-08-09T12:48:47.929957+0000","last_peered":"2023-08-09T12:48:47.929957+0000","last_clean":"2023-08-09T12:48:47.929957+0000","last_became_active":"2023-08-09T12:48:45.911841+0000","last_became_peered":"2023-08-09T12:48:45.911841+0000","last_unstale":"2023-08-09T12:48:47.929957+0000","last_undegraded":"2023-08-09T12:48:47.929957+0000","last_fullsized":"2023-08-09T12:48:47.929957+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:20:01.200847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930900+0000","last_change":"2023-08-09T12:48:46.961576+0000","last_active":"2023-08-09T12:48:47.930900+0000","last_peered":"2023-08-09T12:48:47.930900+0000","last_clean":"2023-08-09T12:48:47.930900+0000","last_became_active":"2023-08-09T12:48:46.961193+0000","last_became_peered":"2023-08-09T12:48:46.961193+0000","last_unstale":"2023-08-09T12:48:47.930900+0000","last_undegraded":"2023-08-09T12:48:47.930900+0000","last_fullsized":"2023-08-09T12:48:47.930900+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:36:59.651281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929454+0000","last_change":"2023-08-09T12:48:45.912029+0000","last_active":"2023-08-09T12:48:47.929454+0000","last_peered":"2023-08-09T12:48:47.929454+0000","last_clean":"2023-08-09T12:48:47.929454+0000","last_became_active":"2023-08-09T12:48:45.911596+0000","last_became_peered":"2023-08-09T12:48:45.911596+0000","last_unstale":"2023-08-09T12:48:47.929454+0000","last_undegraded":"2023-08-09T12:48:47.929454+0000","last_fullsized":"2023-08-09T12:48:47.929454+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:40:52.834357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927398+0000","last_change":"2023-08-09T12:48:46.962725+0000","last_active":"2023-08-09T12:48:47.927398+0000","last_peered":"2023-08-09T12:48:47.927398+0000","last_clean":"2023-08-09T12:48:47.927398+0000","last_became_active":"2023-08-09T12:48:46.962525+0000","last_became_peered":"2023-08-09T12:48:46.962525+0000","last_unstale":"2023-08-09T12:48:47.927398+0000","last_undegraded":"2023-08-09T12:48:47.927398+0000","last_fullsized":"2023-08-09T12:48:47.927398+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:24:19.347469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930308+0000","last_change":"2023-08-09T12:48:45.898690+0000","last_active":"2023-08-09T12:48:47.930308+0000","last_peered":"2023-08-09T12:48:47.930308+0000","last_clean":"2023-08-09T12:48:47.930308+0000","last_became_active":"2023-08-09T12:48:45.898044+0000","last_became_peered":"2023-08-09T12:48:45.898044+0000","last_unstale":"2023-08-09T12:48:47.930308+0000","last_undegraded":"2023-08-09T12:48:47.930308+0000","last_fullsized":"2023-08-09T12:48:47.930308+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:52:51.401162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.925708+0000","last_change":"2023-08-09T12:48:46.949845+0000","last_active":"2023-08-09T12:48:47.925708+0000","last_peered":"2023-08-09T12:48:47.925708+0000","last_clean":"2023-08-09T12:48:47.925708+0000","last_became_active":"2023-08-09T12:48:46.949387+0000","last_became_peered":"2023-08-09T12:48:46.949387+0000","last_unstale":"2023-08-09T12:48:47.925708+0000","last_undegraded":"2023-08-09T12:48:47.925708+0000","last_fullsized":"2023-08-09T12:48:47.925708+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:45:19.262335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"160'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403439+0000","last_change":"2023-08-09T12:48:45.914299+0000","last_active":"2023-08-09T12:48:48.403439+0000","last_peered":"2023-08-09T12:48:48.403439+0000","last_clean":"2023-08-09T12:48:48.403439+0000","last_became_active":"2023-08-09T12:48:45.913540+0000","last_became_peered":"2023-08-09T12:48:45.913540+0000","last_unstale":"2023-08-09T12:48:48.403439+0000","last_undegraded":"2023-08-09T12:48:48.403439+0000","last_fullsized":"2023-08-09T12:48:48.403439+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:41:08.932916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400598+0000","last_change":"2023-08-09T12:48:46.954665+0000","last_active":"2023-08-09T12:48:48.400598+0000","last_peered":"2023-08-09T12:48:48.400598+0000","last_clean":"2023-08-09T12:48:48.400598+0000","last_became_active":"2023-08-09T12:48:46.953769+0000","last_became_peered":"2023-08-09T12:48:46.953769+0000","last_unstale":"2023-08-09T12:48:48.400598+0000","last_undegraded":"2023-08-09T12:48:48.400598+0000","last_fullsized":"2023-08-09T12:48:48.400598+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:32:52.558216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401371+0000","last_change":"2023-08-09T12:48:45.913084+0000","last_active":"2023-08-09T12:48:48.401371+0000","last_peered":"2023-08-09T12:48:48.401371+0000","last_clean":"2023-08-09T12:48:48.401371+0000","last_became_active":"2023-08-09T12:48:45.912811+0000","last_became_peered":"2023-08-09T12:48:45.912811+0000","last_unstale":"2023-08-09T12:48:48.401371+0000","last_undegraded":"2023-08-09T12:48:48.401371+0000","last_fullsized":"2023-08-09T12:48:48.401371+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:10:12.903104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401108+0000","last_change":"2023-08-09T12:48:46.966736+0000","last_active":"2023-08-09T12:48:48.401108+0000","last_peered":"2023-08-09T12:48:48.401108+0000","last_clean":"2023-08-09T12:48:48.401108+0000","last_became_active":"2023-08-09T12:48:46.966391+0000","last_became_peered":"2023-08-09T12:48:46.966391+0000","last_unstale":"2023-08-09T12:48:48.401108+0000","last_undegraded":"2023-08-09T12:48:48.401108+0000","last_fullsized":"2023-08-09T12:48:48.401108+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:36:25.408059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400798+0000","last_change":"2023-08-09T12:48:45.903454+0000","last_active":"2023-08-09T12:48:48.400798+0000","last_peered":"2023-08-09T12:48:48.400798+0000","last_clean":"2023-08-09T12:48:48.400798+0000","last_became_active":"2023-08-09T12:48:45.901990+0000","last_became_peered":"2023-08-09T12:48:45.901990+0000","last_unstale":"2023-08-09T12:48:48.400798+0000","last_undegraded":"2023-08-09T12:48:48.400798+0000","last_fullsized":"2023-08-09T12:48:48.400798+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:07:18.792210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.003031+0000","last_change":"2023-08-09T12:48:46.935102+0000","last_active":"2023-08-09T12:48:48.003031+0000","last_peered":"2023-08-09T12:48:48.003031+0000","last_clean":"2023-08-09T12:48:48.003031+0000","last_became_active":"2023-08-09T12:48:46.934483+0000","last_became_peered":"2023-08-09T12:48:46.934483+0000","last_unstale":"2023-08-09T12:48:48.003031+0000","last_undegraded":"2023-08-09T12:48:48.003031+0000","last_fullsized":"2023-08-09T12:48:48.003031+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:28:23.572626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002786+0000","last_change":"2023-08-09T12:48:45.909979+0000","last_active":"2023-08-09T12:48:48.002786+0000","last_peered":"2023-08-09T12:48:48.002786+0000","last_clean":"2023-08-09T12:48:48.002786+0000","last_became_active":"2023-08-09T12:48:45.909318+0000","last_became_peered":"2023-08-09T12:48:45.909318+0000","last_unstale":"2023-08-09T12:48:48.002786+0000","last_undegraded":"2023-08-09T12:48:48.002786+0000","last_fullsized":"2023-08-09T12:48:48.002786+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:58:44.014505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401948+0000","last_change":"2023-08-09T12:48:46.961941+0000","last_active":"2023-08-09T12:48:48.401948+0000","last_peered":"2023-08-09T12:48:48.401948+0000","last_clean":"2023-08-09T12:48:48.401948+0000","last_became_active":"2023-08-09T12:48:46.959507+0000","last_became_peered":"2023-08-09T12:48:46.959507+0000","last_unstale":"2023-08-09T12:48:48.401948+0000","last_undegraded":"2023-08-09T12:48:48.401948+0000","last_fullsized":"2023-08-09T12:48:48.401948+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:57:28.575318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928254+0000","last_change":"2023-08-09T12:48:45.906050+0000","last_active":"2023-08-09T12:48:47.928254+0000","last_peered":"2023-08-09T12:48:47.928254+0000","last_clean":"2023-08-09T12:48:47.928254+0000","last_became_active":"2023-08-09T12:48:45.905750+0000","last_became_peered":"2023-08-09T12:48:45.905750+0000","last_unstale":"2023-08-09T12:48:47.928254+0000","last_undegraded":"2023-08-09T12:48:47.928254+0000","last_fullsized":"2023-08-09T12:48:47.928254+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:10:50.430197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929159+0000","last_change":"2023-08-09T12:48:46.952499+0000","last_active":"2023-08-09T12:48:47.929159+0000","last_peered":"2023-08-09T12:48:47.929159+0000","last_clean":"2023-08-09T12:48:47.929159+0000","last_became_active":"2023-08-09T12:48:46.951915+0000","last_became_peered":"2023-08-09T12:48:46.951915+0000","last_unstale":"2023-08-09T12:48:47.929159+0000","last_undegraded":"2023-08-09T12:48:47.929159+0000","last_fullsized":"2023-08-09T12:48:47.929159+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:22:49.988893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403850+0000","last_change":"2023-08-09T12:48:45.904623+0000","last_active":"2023-08-09T12:48:48.403850+0000","last_peered":"2023-08-09T12:48:48.403850+0000","last_clean":"2023-08-09T12:48:48.403850+0000","last_became_active":"2023-08-09T12:48:45.904073+0000","last_became_peered":"2023-08-09T12:48:45.904073+0000","last_unstale":"2023-08-09T12:48:48.403850+0000","last_undegraded":"2023-08-09T12:48:48.403850+0000","last_fullsized":"2023-08-09T12:48:48.403850+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:19:31.729048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401284+0000","last_change":"2023-08-09T12:48:46.961129+0000","last_active":"2023-08-09T12:48:48.401284+0000","last_peered":"2023-08-09T12:48:48.401284+0000","last_clean":"2023-08-09T12:48:48.401284+0000","last_became_active":"2023-08-09T12:48:46.954671+0000","last_became_peered":"2023-08-09T12:48:46.954671+0000","last_unstale":"2023-08-09T12:48:48.401284+0000","last_undegraded":"2023-08-09T12:48:48.401284+0000","last_fullsized":"2023-08-09T12:48:48.401284+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:44:31.981784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.003228+0000","last_change":"2023-08-09T12:48:45.900760+0000","last_active":"2023-08-09T12:48:48.003228+0000","last_peered":"2023-08-09T12:48:48.003228+0000","last_clean":"2023-08-09T12:48:48.003228+0000","last_became_active":"2023-08-09T12:48:45.899103+0000","last_became_peered":"2023-08-09T12:48:45.899103+0000","last_unstale":"2023-08-09T12:48:48.003228+0000","last_undegraded":"2023-08-09T12:48:48.003228+0000","last_fullsized":"2023-08-09T12:48:48.003228+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:14:46.187149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.931691+0000","last_change":"2023-08-09T12:48:46.959599+0000","last_active":"2023-08-09T12:48:47.931691+0000","last_peered":"2023-08-09T12:48:47.931691+0000","last_clean":"2023-08-09T12:48:47.931691+0000","last_became_active":"2023-08-09T12:48:46.959283+0000","last_became_peered":"2023-08-09T12:48:46.959283+0000","last_unstale":"2023-08-09T12:48:47.931691+0000","last_undegraded":"2023-08-09T12:48:47.931691+0000","last_fullsized":"2023-08-09T12:48:47.931691+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:38:23.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401030+0000","last_change":"2023-08-09T12:48:45.910936+0000","last_active":"2023-08-09T12:48:48.401030+0000","last_peered":"2023-08-09T12:48:48.401030+0000","last_clean":"2023-08-09T12:48:48.401030+0000","last_became_active":"2023-08-09T12:48:45.910460+0000","last_became_peered":"2023-08-09T12:48:45.910460+0000","last_unstale":"2023-08-09T12:48:48.401030+0000","last_undegraded":"2023-08-09T12:48:48.401030+0000","last_fullsized":"2023-08-09T12:48:48.401030+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:56:51.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929872+0000","last_change":"2023-08-09T12:48:46.942752+0000","last_active":"2023-08-09T12:48:47.929872+0000","last_peered":"2023-08-09T12:48:47.929872+0000","last_clean":"2023-08-09T12:48:47.929872+0000","last_became_active":"2023-08-09T12:48:46.941039+0000","last_became_peered":"2023-08-09T12:48:46.941039+0000","last_unstale":"2023-08-09T12:48:47.929872+0000","last_undegraded":"2023-08-09T12:48:47.929872+0000","last_fullsized":"2023-08-09T12:48:47.929872+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:54.520543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400501+0000","last_change":"2023-08-09T12:48:45.905909+0000","last_active":"2023-08-09T12:48:48.400501+0000","last_peered":"2023-08-09T12:48:48.400501+0000","last_clean":"2023-08-09T12:48:48.400501+0000","last_became_active":"2023-08-09T12:48:45.905567+0000","last_became_peered":"2023-08-09T12:48:45.905567+0000","last_unstale":"2023-08-09T12:48:48.400501+0000","last_undegraded":"2023-08-09T12:48:48.400501+0000","last_fullsized":"2023-08-09T12:48:48.400501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:08:21.789435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.400036+0000","last_change":"2023-08-09T12:48:46.953485+0000","last_active":"2023-08-09T12:48:48.400036+0000","last_peered":"2023-08-09T12:48:48.400036+0000","last_clean":"2023-08-09T12:48:48.400036+0000","last_became_active":"2023-08-09T12:48:46.952364+0000","last_became_peered":"2023-08-09T12:48:46.952364+0000","last_unstale":"2023-08-09T12:48:48.400036+0000","last_undegraded":"2023-08-09T12:48:48.400036+0000","last_fullsized":"2023-08-09T12:48:48.400036+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:55:45.375408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403216+0000","last_change":"2023-08-09T12:48:45.911167+0000","last_active":"2023-08-09T12:48:48.403216+0000","last_peered":"2023-08-09T12:48:48.403216+0000","last_clean":"2023-08-09T12:48:48.403216+0000","last_became_active":"2023-08-09T12:48:45.910891+0000","last_became_peered":"2023-08-09T12:48:45.910891+0000","last_unstale":"2023-08-09T12:48:48.403216+0000","last_undegraded":"2023-08-09T12:48:48.403216+0000","last_fullsized":"2023-08-09T12:48:48.403216+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:29:29.657175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402862+0000","last_change":"2023-08-09T12:48:46.946416+0000","last_active":"2023-08-09T12:48:48.402862+0000","last_peered":"2023-08-09T12:48:48.402862+0000","last_clean":"2023-08-09T12:48:48.402862+0000","last_became_active":"2023-08-09T12:48:46.943351+0000","last_became_peered":"2023-08-09T12:48:46.943351+0000","last_unstale":"2023-08-09T12:48:48.402862+0000","last_undegraded":"2023-08-09T12:48:48.402862+0000","last_fullsized":"2023-08-09T12:48:48.402862+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:50:10.366110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928860+0000","last_change":"2023-08-09T12:48:45.910842+0000","last_active":"2023-08-09T12:48:47.928860+0000","last_peered":"2023-08-09T12:48:47.928860+0000","last_clean":"2023-08-09T12:48:47.928860+0000","last_became_active":"2023-08-09T12:48:45.910039+0000","last_became_peered":"2023-08-09T12:48:45.910039+0000","last_unstale":"2023-08-09T12:48:47.928860+0000","last_undegraded":"2023-08-09T12:48:47.928860+0000","last_fullsized":"2023-08-09T12:48:47.928860+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:23:59.043267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402699+0000","last_change":"2023-08-09T12:48:46.947360+0000","last_active":"2023-08-09T12:48:48.402699+0000","last_peered":"2023-08-09T12:48:48.402699+0000","last_clean":"2023-08-09T12:48:48.402699+0000","last_became_active":"2023-08-09T12:48:46.946310+0000","last_became_peered":"2023-08-09T12:48:46.946310+0000","last_unstale":"2023-08-09T12:48:48.402699+0000","last_undegraded":"2023-08-09T12:48:48.402699+0000","last_fullsized":"2023-08-09T12:48:48.402699+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:16:24.289949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930196+0000","last_change":"2023-08-09T12:48:45.907402+0000","last_active":"2023-08-09T12:48:47.930196+0000","last_peered":"2023-08-09T12:48:47.930196+0000","last_clean":"2023-08-09T12:48:47.930196+0000","last_became_active":"2023-08-09T12:48:45.906892+0000","last_became_peered":"2023-08-09T12:48:45.906892+0000","last_unstale":"2023-08-09T12:48:47.930196+0000","last_undegraded":"2023-08-09T12:48:47.930196+0000","last_fullsized":"2023-08-09T12:48:47.930196+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:17:32.838718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403094+0000","last_change":"2023-08-09T12:48:46.946987+0000","last_active":"2023-08-09T12:48:48.403094+0000","last_peered":"2023-08-09T12:48:48.403094+0000","last_clean":"2023-08-09T12:48:48.403094+0000","last_became_active":"2023-08-09T12:48:46.943449+0000","last_became_peered":"2023-08-09T12:48:46.943449+0000","last_unstale":"2023-08-09T12:48:48.403094+0000","last_undegraded":"2023-08-09T12:48:48.403094+0000","last_fullsized":"2023-08-09T12:48:48.403094+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:43:07.531223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403429+0000","last_change":"2023-08-09T12:48:45.911823+0000","last_active":"2023-08-09T12:48:48.403429+0000","last_peered":"2023-08-09T12:48:48.403429+0000","last_clean":"2023-08-09T12:48:48.403429+0000","last_became_active":"2023-08-09T12:48:45.911339+0000","last_became_peered":"2023-08-09T12:48:45.911339+0000","last_unstale":"2023-08-09T12:48:48.403429+0000","last_undegraded":"2023-08-09T12:48:48.403429+0000","last_fullsized":"2023-08-09T12:48:48.403429+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:48:39.489771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927438+0000","last_change":"2023-08-09T12:48:46.942177+0000","last_active":"2023-08-09T12:48:47.927438+0000","last_peered":"2023-08-09T12:48:47.927438+0000","last_clean":"2023-08-09T12:48:47.927438+0000","last_became_active":"2023-08-09T12:48:46.940133+0000","last_became_peered":"2023-08-09T12:48:46.940133+0000","last_unstale":"2023-08-09T12:48:47.927438+0000","last_undegraded":"2023-08-09T12:48:47.927438+0000","last_fullsized":"2023-08-09T12:48:47.927438+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:14.747773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401820+0000","last_change":"2023-08-09T12:48:45.909884+0000","last_active":"2023-08-09T12:48:48.401820+0000","last_peered":"2023-08-09T12:48:48.401820+0000","last_clean":"2023-08-09T12:48:48.401820+0000","last_became_active":"2023-08-09T12:48:45.909635+0000","last_became_peered":"2023-08-09T12:48:45.909635+0000","last_unstale":"2023-08-09T12:48:48.401820+0000","last_undegraded":"2023-08-09T12:48:48.401820+0000","last_fullsized":"2023-08-09T12:48:48.401820+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:31:10.277671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.931370+0000","last_change":"2023-08-09T12:48:46.962403+0000","last_active":"2023-08-09T12:48:47.931370+0000","last_peered":"2023-08-09T12:48:47.931370+0000","last_clean":"2023-08-09T12:48:47.931370+0000","last_became_active":"2023-08-09T12:48:46.961621+0000","last_became_peered":"2023-08-09T12:48:46.961621+0000","last_unstale":"2023-08-09T12:48:47.931370+0000","last_undegraded":"2023-08-09T12:48:47.931370+0000","last_fullsized":"2023-08-09T12:48:47.931370+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:40:07.673451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927559+0000","last_change":"2023-08-09T12:48:45.907971+0000","last_active":"2023-08-09T12:48:47.927559+0000","last_peered":"2023-08-09T12:48:47.927559+0000","last_clean":"2023-08-09T12:48:47.927559+0000","last_became_active":"2023-08-09T12:48:45.907721+0000","last_became_peered":"2023-08-09T12:48:45.907721+0000","last_unstale":"2023-08-09T12:48:47.927559+0000","last_undegraded":"2023-08-09T12:48:47.927559+0000","last_fullsized":"2023-08-09T12:48:47.927559+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:42.388189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":445,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929531+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:48:47.929531+0000","last_peered":"2023-08-09T12:48:47.929531+0000","last_clean":"2023-08-09T12:48:47.929531+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:48:47.929531+0000","last_undegraded":"2023-08-09T12:48:47.929531+0000","last_fullsized":"2023-08-09T12:48:47.929531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:20:52.844875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":265,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929175+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:48:47.929175+0000","last_peered":"2023-08-09T12:48:47.929175+0000","last_clean":"2023-08-09T12:48:47.929175+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:48:47.929175+0000","last_undegraded":"2023-08-09T12:48:47.929175+0000","last_fullsized":"2023-08-09T12:48:47.929175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:06:56.679498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.926710+0000","last_change":"2023-08-09T12:48:46.953789+0000","last_active":"2023-08-09T12:48:47.926710+0000","last_peered":"2023-08-09T12:48:47.926710+0000","last_clean":"2023-08-09T12:48:47.926710+0000","last_became_active":"2023-08-09T12:48:46.953417+0000","last_became_peered":"2023-08-09T12:48:46.953417+0000","last_unstale":"2023-08-09T12:48:47.926710+0000","last_undegraded":"2023-08-09T12:48:47.926710+0000","last_fullsized":"2023-08-09T12:48:47.926710+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:05:36.327725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929385+0000","last_change":"2023-08-09T12:48:45.907769+0000","last_active":"2023-08-09T12:48:47.929385+0000","last_peered":"2023-08-09T12:48:47.929385+0000","last_clean":"2023-08-09T12:48:47.929385+0000","last_became_active":"2023-08-09T12:48:45.906964+0000","last_became_peered":"2023-08-09T12:48:45.906964+0000","last_unstale":"2023-08-09T12:48:47.929385+0000","last_undegraded":"2023-08-09T12:48:47.929385+0000","last_fullsized":"2023-08-09T12:48:47.929385+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:55.234439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":289,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929232+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:48:47.929232+0000","last_peered":"2023-08-09T12:48:47.929232+0000","last_clean":"2023-08-09T12:48:47.929232+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:48:47.929232+0000","last_undegraded":"2023-08-09T12:48:47.929232+0000","last_fullsized":"2023-08-09T12:48:47.929232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:49:55.702909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.401226+0000","last_change":"2023-08-09T12:48:46.968109+0000","last_active":"2023-08-09T12:48:48.401226+0000","last_peered":"2023-08-09T12:48:48.401226+0000","last_clean":"2023-08-09T12:48:48.401226+0000","last_became_active":"2023-08-09T12:48:46.967751+0000","last_became_peered":"2023-08-09T12:48:46.967751+0000","last_unstale":"2023-08-09T12:48:48.401226+0000","last_undegraded":"2023-08-09T12:48:48.401226+0000","last_fullsized":"2023-08-09T12:48:48.401226+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:07:13.869924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"160'8","reported_seq":21,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402679+0000","last_change":"2023-08-09T12:48:45.911662+0000","last_active":"2023-08-09T12:48:48.402679+0000","last_peered":"2023-08-09T12:48:48.402679+0000","last_clean":"2023-08-09T12:48:48.402679+0000","last_became_active":"2023-08-09T12:48:45.910793+0000","last_became_peered":"2023-08-09T12:48:45.910793+0000","last_unstale":"2023-08-09T12:48:48.402679+0000","last_undegraded":"2023-08-09T12:48:48.402679+0000","last_fullsized":"2023-08-09T12:48:48.402679+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:22:48.975076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":267,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002790+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:48:48.002790+0000","last_peered":"2023-08-09T12:48:48.002790+0000","last_clean":"2023-08-09T12:48:48.002790+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:48:48.002790+0000","last_undegraded":"2023-08-09T12:48:48.002790+0000","last_fullsized":"2023-08-09T12:48:48.002790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:15.836637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.399992+0000","last_change":"2023-08-09T12:48:46.964313+0000","last_active":"2023-08-09T12:48:48.399992+0000","last_peered":"2023-08-09T12:48:48.399992+0000","last_clean":"2023-08-09T12:48:48.399992+0000","last_became_active":"2023-08-09T12:48:46.964066+0000","last_became_peered":"2023-08-09T12:48:46.964066+0000","last_unstale":"2023-08-09T12:48:48.399992+0000","last_undegraded":"2023-08-09T12:48:48.399992+0000","last_fullsized":"2023-08-09T12:48:48.399992+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:37.832654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"160'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002723+0000","last_change":"2023-08-09T12:48:45.889867+0000","last_active":"2023-08-09T12:48:48.002723+0000","last_peered":"2023-08-09T12:48:48.002723+0000","last_clean":"2023-08-09T12:48:48.002723+0000","last_became_active":"2023-08-09T12:48:45.889203+0000","last_became_peered":"2023-08-09T12:48:45.889203+0000","last_unstale":"2023-08-09T12:48:48.002723+0000","last_undegraded":"2023-08-09T12:48:48.002723+0000","last_fullsized":"2023-08-09T12:48:48.002723+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:48:52.716602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":265,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930379+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:48:47.930379+0000","last_peered":"2023-08-09T12:48:47.930379+0000","last_clean":"2023-08-09T12:48:47.930379+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:48:47.930379+0000","last_undegraded":"2023-08-09T12:48:47.930379+0000","last_fullsized":"2023-08-09T12:48:47.930379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:22:46.423861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.930594+0000","last_change":"2023-08-09T12:48:46.954804+0000","last_active":"2023-08-09T12:48:47.930594+0000","last_peered":"2023-08-09T12:48:47.930594+0000","last_clean":"2023-08-09T12:48:47.930594+0000","last_became_active":"2023-08-09T12:48:46.954030+0000","last_became_peered":"2023-08-09T12:48:46.954030+0000","last_unstale":"2023-08-09T12:48:47.930594+0000","last_undegraded":"2023-08-09T12:48:47.930594+0000","last_fullsized":"2023-08-09T12:48:47.930594+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:55:43.593280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"160'3","reported_seq":16,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.927973+0000","last_change":"2023-08-09T12:48:45.904271+0000","last_active":"2023-08-09T12:48:47.927973+0000","last_peered":"2023-08-09T12:48:47.927973+0000","last_clean":"2023-08-09T12:48:47.927973+0000","last_became_active":"2023-08-09T12:48:45.903570+0000","last_became_peered":"2023-08-09T12:48:45.903570+0000","last_unstale":"2023-08-09T12:48:47.927973+0000","last_undegraded":"2023-08-09T12:48:47.927973+0000","last_fullsized":"2023-08-09T12:48:47.927973+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:39.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403517+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:48:48.403517+0000","last_peered":"2023-08-09T12:48:48.403517+0000","last_clean":"2023-08-09T12:48:48.403517+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:48:48.403517+0000","last_undegraded":"2023-08-09T12:48:48.403517+0000","last_fullsized":"2023-08-09T12:48:48.403517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:56:34.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929633+0000","last_change":"2023-08-09T12:48:46.959896+0000","last_active":"2023-08-09T12:48:47.929633+0000","last_peered":"2023-08-09T12:48:47.929633+0000","last_clean":"2023-08-09T12:48:47.929633+0000","last_became_active":"2023-08-09T12:48:46.959496+0000","last_became_peered":"2023-08-09T12:48:46.959496+0000","last_unstale":"2023-08-09T12:48:47.929633+0000","last_undegraded":"2023-08-09T12:48:47.929633+0000","last_fullsized":"2023-08-09T12:48:47.929633+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:50:56.437877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"160'6","reported_seq":19,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928636+0000","last_change":"2023-08-09T12:48:45.908372+0000","last_active":"2023-08-09T12:48:47.928636+0000","last_peered":"2023-08-09T12:48:47.928636+0000","last_clean":"2023-08-09T12:48:47.928636+0000","last_became_active":"2023-08-09T12:48:45.907802+0000","last_became_peered":"2023-08-09T12:48:45.907802+0000","last_unstale":"2023-08-09T12:48:47.928636+0000","last_undegraded":"2023-08-09T12:48:47.928636+0000","last_fullsized":"2023-08-09T12:48:47.928636+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:39:26.279179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":289,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928936+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:48:47.928936+0000","last_peered":"2023-08-09T12:48:47.928936+0000","last_clean":"2023-08-09T12:48:47.928936+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:48:47.928936+0000","last_undegraded":"2023-08-09T12:48:47.928936+0000","last_fullsized":"2023-08-09T12:48:47.928936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:06:29.287589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.002203+0000","last_change":"2023-08-09T12:48:46.944465+0000","last_active":"2023-08-09T12:48:48.002203+0000","last_peered":"2023-08-09T12:48:48.002203+0000","last_clean":"2023-08-09T12:48:48.002203+0000","last_became_active":"2023-08-09T12:48:46.943732+0000","last_became_peered":"2023-08-09T12:48:46.943732+0000","last_unstale":"2023-08-09T12:48:48.002203+0000","last_undegraded":"2023-08-09T12:48:48.002203+0000","last_fullsized":"2023-08-09T12:48:48.002203+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:27:06.912340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.928549+0000","last_change":"2023-08-09T12:48:45.910997+0000","last_active":"2023-08-09T12:48:47.928549+0000","last_peered":"2023-08-09T12:48:47.928549+0000","last_clean":"2023-08-09T12:48:47.928549+0000","last_became_active":"2023-08-09T12:48:45.910593+0000","last_became_peered":"2023-08-09T12:48:45.910593+0000","last_unstale":"2023-08-09T12:48:47.928549+0000","last_undegraded":"2023-08-09T12:48:47.928549+0000","last_fullsized":"2023-08-09T12:48:47.928549+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:25:52.042753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":263,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.403622+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:48:48.403622+0000","last_peered":"2023-08-09T12:48:48.403622+0000","last_clean":"2023-08-09T12:48:48.403622+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:48:48.403622+0000","last_undegraded":"2023-08-09T12:48:48.403622+0000","last_fullsized":"2023-08-09T12:48:48.403622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:56:56.760218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.402630+0000","last_change":"2023-08-09T12:48:46.964415+0000","last_active":"2023-08-09T12:48:48.402630+0000","last_peered":"2023-08-09T12:48:48.402630+0000","last_clean":"2023-08-09T12:48:48.402630+0000","last_became_active":"2023-08-09T12:48:46.961581+0000","last_became_peered":"2023-08-09T12:48:46.961581+0000","last_unstale":"2023-08-09T12:48:48.402630+0000","last_undegraded":"2023-08-09T12:48:48.402630+0000","last_fullsized":"2023-08-09T12:48:48.402630+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:45.873762+0000","last_clean_scrub_stamp":"2023-08-09T12:48:45.873762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:00.057084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:48.003095+0000","last_change":"2023-08-09T12:48:45.890515+0000","last_active":"2023-08-09T12:48:48.003095+0000","last_peered":"2023-08-09T12:48:48.003095+0000","last_clean":"2023-08-09T12:48:48.003095+0000","last_became_active":"2023-08-09T12:48:45.889827+0000","last_became_peered":"2023-08-09T12:48:45.889827+0000","last_unstale":"2023-08-09T12:48:48.003095+0000","last_undegraded":"2023-08-09T12:48:48.003095+0000","last_fullsized":"2023-08-09T12:48:48.003095+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:48:44.859946+0000","last_clean_scrub_stamp":"2023-08-09T12:48:44.859946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:14:45.775968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":287,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-08-09T12:48:47.929696+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:48:47.929696+0000","last_peered":"2023-08-09T12:48:47.929696+0000","last_clean":"2023-08-09T12:48:47.929696+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:48:47.929696+0000","last_undegraded":"2023-08-09T12:48:47.929696+0000","last_fullsized":"2023-08-09T12:48:47.929696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:25:00.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1513,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193798,"statfs":{"total":200000000,"available":198450126,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1439999999999999,"15min":1.107},"min":{"1min":0.64300000000000002,"5min":0.627,"15min":0.59899999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0900000000000001,"15min":1.091},"min":{"1min":0.70499999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7509999999999999,"5min":1.7769999999999999,"15min":2.0459999999999998},"last":1.012}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.224,"15min":1.149},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.63300000000000001},"max":{"1min":1.629,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.167,"15min":1.133},"min":{"1min":0.73499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.83999999999999997}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.26,"15min":1.2050000000000001},"min":{"1min":0.83299999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.591,"5min":1.96,"15min":2.1459999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.218,"5min":1.2230000000000001,"15min":1.1759999999999999},"min":{"1min":0.81200000000000006,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.5489999999999999,"5min":1.7450000000000001,"15min":2.173},"last":1.119}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.341,"15min":1.268},"min":{"1min":0.79100000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.806,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.331,"15min":1.2949999999999999},"min":{"1min":0.97899999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.6200000000000001,"5min":1.992,"15min":2.282},"last":1.0509999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.276,"15min":1.2330000000000001},"min":{"1min":0.98499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.948,"5min":2.6179999999999999,"15min":2.8769999999999998},"last":1.238},{"interface":"front","average":{"1min":1.302,"5min":1.3799999999999999,"15min":1.3200000000000001},"min":{"1min":0.90800000000000003,"5min":0.82299999999999995,"15min":0.58599999999999997},"max":{"1min":1.764,"5min":2.5070000000000001,"15min":4.6200000000000001},"last":1.2869999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4219999999999999,"15min":1.3460000000000001},"min":{"1min":0.878,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.978,"5min":2.1699999999999999,"15min":2.802},"last":1.409},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.536,"15min":1.502},"min":{"1min":0.97799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.1299999999999999,"5min":2.7799999999999998,"15min":3.3580000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.522,"15min":1.486},"min":{"1min":1.1259999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2370000000000001,"5min":2.8849999999999998,"15min":3.4910000000000001},"last":1.337},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.542,"15min":1.476},"min":{"1min":1.073,"5min":1.0029999999999999,"15min":0.623},"max":{"1min":1.95,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.5609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":936,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194376,"statfs":{"total":200000000,"available":199041524,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.133,"15min":1.135},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.544,"5min":1.986,"15min":2.54},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.099,"15min":1.083},"min":{"1min":0.72099999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.615,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.3160000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.226,"15min":1.2290000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.51,"5min":1.996,"15min":2.306},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.3009999999999999,"15min":1.3160000000000001},"min":{"1min":0.81100000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":0.90200000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.1839999999999999,"15min":1.1240000000000001},"min":{"1min":0.91100000000000003,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.28,"15min":1.2789999999999999},"min":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.772,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.3919999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3109999999999999,"15min":1.2869999999999999},"min":{"1min":0.93400000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7070000000000001,"5min":2.327,"15min":2.327},"last":1.633},{"interface":"front","average":{"1min":1.369,"5min":1.3680000000000001,"15min":1.3160000000000001},"min":{"1min":1.0549999999999999,"5min":0.755,"15min":0.74099999999999999},"max":{"1min":1.724,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.1339999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3340000000000001,"15min":1.3540000000000001},"min":{"1min":1.01,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.651,"5min":2.028,"15min":11.058999999999999},"last":1.504},{"interface":"front","average":{"1min":1.337,"5min":1.339,"15min":1.351},"min":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.57399999999999995},"max":{"1min":1.736,"5min":2.29,"15min":2.3479999999999999},"last":1.6990000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.0089999999999999,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.71,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4750000000000001,"15min":1.4890000000000001},"min":{"1min":1.087,"5min":1.0720000000000001,"15min":0.81899999999999995},"max":{"1min":1.8009999999999999,"5min":2.222,"15min":2.8580000000000001},"last":1.585}]},{"osd":7,"last update":"Wed Aug 9 12:48:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.5089999999999999,"15min":1.4670000000000001},"min":{"1min":1.137,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9059999999999999,"5min":2.1520000000000001,"15min":2.7999999999999998},"last":1.8320000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.5129999999999999,"15min":1.4690000000000001},"min":{"1min":1.1259999999999999,"5min":0.94999999999999996,"15min":0.74399999999999999},"max":{"1min":1.8109999999999999,"5min":2.7810000000000001,"15min":3.621},"last":1.534}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042174,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.105,"15min":1.107},"min":{"1min":0.69799999999999995,"5min":0.68000000000000005,"15min":0.55300000000000005},"max":{"1min":1.591,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2070000000000001,"15min":1.113},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.97,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0629999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3680000000000001,"15min":1.3109999999999999},"min":{"1min":0.78600000000000003,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.7190000000000001,"5min":2.3540000000000001,"15min":2.6579999999999999},"last":1.851},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.284,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7310000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.748}]},{"osd":2,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.264,"15min":1.22},"min":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":1.589,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.151},{"interface":"front","average":{"1min":1.222,"5min":1.2310000000000001,"15min":1.2030000000000001},"min":{"1min":0.78800000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.554,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.2649999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.2410000000000001},"min":{"1min":1.006,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5429999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.47},{"interface":"front","average":{"1min":1.387,"5min":1.393,"15min":1.3740000000000001},"min":{"1min":0.998,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":1.7809999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.335,"15min":1.2569999999999999},"min":{"1min":0.877,"5min":0.79100000000000004,"15min":0.60699999999999998},"max":{"1min":1.7549999999999999,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.373},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.456,"15min":1.389},"min":{"1min":1.032,"5min":0.80600000000000005,"15min":0.628},"max":{"1min":1.7190000000000001,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.9830000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.4419999999999999,"15min":1.367},"min":{"1min":1.006,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.833,"5min":2.952,"15min":2.952},"last":1.9299999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":0.98199999999999998,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.762,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.6990000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.575,"15min":1.53},"min":{"1min":1.0860000000000001,"5min":0.86599999999999999,"15min":0.67200000000000004},"max":{"1min":2.0329999999999999,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":2.1709999999999998},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6399999999999999,"15min":1.5469999999999999},"min":{"1min":1.069,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.9179999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":2.0419999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1040000000000001,"15min":1.0940000000000001},"min":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.579,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.878},{"interface":"front","average":{"1min":1.145,"5min":1.131,"15min":1.119},"min":{"1min":0.77000000000000002,"5min":0.66500000000000004,"15min":0.64800000000000002},"max":{"1min":1.5740000000000001,"5min":1.635,"15min":3.4100000000000001},"last":1.1279999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.288,"15min":1.3180000000000001},"min":{"1min":0.88100000000000001,"5min":0.77400000000000002,"15min":0.48899999999999999},"max":{"1min":1.863,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.92600000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.8240000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":0.98199999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.306,"15min":1.3169999999999999},"min":{"1min":0.86199999999999999,"5min":0.70799999999999996,"15min":0.54900000000000004},"max":{"1min":1.9470000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.081},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3420000000000001,"15min":1.3300000000000001},"min":{"1min":0.81499999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8100000000000001,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.238}]},{"osd":3,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2889999999999999,"15min":1.248},"min":{"1min":1.0329999999999999,"5min":0.75700000000000001,"15min":0.71799999999999997},"max":{"1min":1.728,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3320000000000001,"15min":1.335},"min":{"1min":0.98199999999999998,"5min":0.93999999999999995,"15min":0.82699999999999996},"max":{"1min":2.0539999999999998,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.1699999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3759999999999999,"15min":1.381},"min":{"1min":0.85499999999999998,"5min":0.58099999999999996,"15min":0.55900000000000005},"max":{"1min":1.857,"5min":3.137,"15min":3.137},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.367,"15min":1.381},"min":{"1min":0.89400000000000002,"5min":0.623,"15min":0.623},"max":{"1min":2.403,"5min":2.403,"15min":3.3620000000000001},"last":1.464}]},{"osd":6,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4399999999999999,"15min":1.466},"min":{"1min":0.82299999999999995,"5min":0.76000000000000001,"15min":0.59999999999999998},"max":{"1min":2.262,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.5469999999999999,"15min":1.538},"min":{"1min":1.0660000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1070000000000002,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.5069999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:48:31 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.5249999999999999,"15min":1.5289999999999999},"min":{"1min":1.1950000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.599,"15min":1.613},"min":{"1min":1.2689999999999999,"5min":0.89400000000000002,"15min":0.65700000000000003},"max":{"1min":2.4590000000000001,"5min":2.875,"15min":2.875},"last":1.6559999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":936,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194375,"statfs":{"total":200000000,"available":199040514,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.87,"15min":0.84699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.458,"5min":1.458,"15min":4.4109999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.024,"15min":0.94199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.698,"5min":2.778,"15min":3.2269999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.52000000000000002,"5min":0.41099999999999998,"15min":0.38100000000000001},"max":{"1min":1.448,"5min":1.6539999999999999,"15min":2.1280000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.127,"15min":0.98799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.407,"5min":2.0219999999999998,"15min":2.0880000000000001},"last":0.92400000000000004}]},{"osd":2,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.103,"15min":1.129},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.48,"5min":1.9259999999999999,"15min":18.145},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2569999999999999,"15min":1.208},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.619,"5min":2.169,"15min":2.169},"last":1.0669999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.78200000000000003,"5min":0.75,"15min":0.745},"max":{"1min":1.7709999999999999,"5min":1.8660000000000001,"15min":3.5110000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.306,"15min":1.325},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":1.5640000000000001,"5min":2.056,"15min":3.5960000000000001},"last":1.357}]},{"osd":5,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.345,"15min":1.4299999999999999},"min":{"1min":0.82099999999999995,"5min":0.80500000000000005,"15min":0.72999999999999998},"max":{"1min":1.7150000000000001,"5min":2.2389999999999999,"15min":18.094000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.429,"15min":1.389},"min":{"1min":0.752,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.6020000000000001,"5min":2.2959999999999998,"15min":14.105},"last":1.2809999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3899999999999999,"15min":1.357},"min":{"1min":0.92200000000000004,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.641,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4319999999999999,"15min":1.462},"min":{"1min":0.90300000000000002,"5min":0.86399999999999999,"15min":0.77700000000000002},"max":{"1min":1.792,"5min":2.0099999999999998,"15min":4.0220000000000002},"last":1.571}]},{"osd":7,"last update":"Wed Aug 9 12:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.526,"15min":1.4279999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":1.7430000000000001,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4950000000000001,"15min":1.4139999999999999},"min":{"1min":0.96299999999999997,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":1.6759999999999999,"5min":2.073,"15min":3.016},"last":1.548}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194376,"statfs":{"total":200000000,"available":199041580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90900000000000003,"15min":0.86699999999999999},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":1.3759999999999999,"5min":1.597,"15min":1.716},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.024,"5min":1.028,"15min":0.96699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.5680000000000001,"5min":1.73,"15min":2.9009999999999998},"last":1.002}]},{"osd":1,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92600000000000005,"15min":0.92000000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5,"5min":1.823,"15min":1.869},"last":1.022}]},{"osd":3,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.149,"15min":1.1559999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.615,"5min":1.681,"15min":3.2850000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1930000000000001,"15min":1.1639999999999999},"min":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.637,"5min":2.0289999999999999,"15min":2.9409999999999998},"last":1.325}]},{"osd":4,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4510000000000001,"15min":1.419},"min":{"1min":0.93200000000000005,"5min":0.83499999999999996,"15min":0.81899999999999995},"max":{"1min":1.7250000000000001,"5min":2.7450000000000001,"15min":3.3300000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.351,"15min":1.3},"min":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.66800000000000004},"max":{"1min":1.694,"5min":2.6509999999999998,"15min":3.4500000000000002},"last":0.94699999999999995}]},{"osd":5,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.401,"15min":1.375},"min":{"1min":0.78900000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0110000000000001,"5min":2.3210000000000002,"15min":5.0140000000000002},"last":1.226},{"interface":"front","average":{"1min":1.419,"5min":1.448,"15min":1.472},"min":{"1min":0.878,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8120000000000001,"5min":2.4780000000000002,"15min":4.806},"last":1.5940000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.8580000000000001,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.163},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.468,"15min":1.4299999999999999},"min":{"1min":0.89600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.901,"5min":2.7309999999999999,"15min":3.6589999999999998},"last":1.671}]},{"osd":7,"last update":"Wed Aug 9 12:48:27 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.462,"15min":1.3839999999999999},"min":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"max":{"1min":1.8640000000000001,"5min":2.464,"15min":2.464},"last":1.204},{"interface":"front","average":{"1min":1.431,"5min":1.536,"15min":1.5269999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.036,"5min":2.6549999999999998,"15min":4.0730000000000004},"last":1.5369999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042126,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91000000000000003,"15min":0.89400000000000002},"min":{"1min":0.53000000000000003,"5min":0.45200000000000001,"15min":0.41399999999999998},"max":{"1min":1.542,"5min":2.621,"15min":2.621},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.008,"15min":1.2709999999999999},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.34300000000000003},"max":{"1min":1.5169999999999999,"5min":1.9530000000000001,"15min":88.254999999999995},"last":1.216}]},{"osd":2,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.998,"15min":0.96699999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":3.0209999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2470000000000001,"15min":1.1699999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7849999999999999,"5min":2.0449999999999999,"15min":3.1890000000000001},"last":1.595}]},{"osd":3,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1879999999999999,"15min":1.1200000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.177},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.085,"15min":1.0069999999999999},"min":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.397,"5min":1.819,"15min":5.4320000000000004},"last":1.103}]},{"osd":4,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.24,"15min":1.304},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.581,"5min":2.391,"15min":25.172000000000001},"last":1.444},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.391,"15min":1.3300000000000001},"min":{"1min":0.93500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.085,"5min":3.762,"15min":3.762},"last":1.3300000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.3260000000000001,"15min":1.4079999999999999},"min":{"1min":0.92200000000000004,"5min":0.751,"15min":0.751},"max":{"1min":1.7789999999999999,"5min":2.5419999999999998,"15min":28.710000000000001},"last":1.288},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.327,"15min":1.2989999999999999},"min":{"1min":0.84599999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6910000000000001,"5min":1.9910000000000001,"15min":3.762},"last":1.1419999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.4510000000000001,"15min":1.4379999999999999},"min":{"1min":1.022,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.7230000000000001,"5min":1.841,"15min":6.0460000000000003},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.4419999999999999,"15min":1.397},"min":{"1min":1.0609999999999999,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":1.6759999999999999,"5min":2.0960000000000001,"15min":2.1480000000000001},"last":1.361}]},{"osd":7,"last update":"Wed Aug 9 12:48:26 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.532,"15min":1.595},"min":{"1min":0.89800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.2370000000000001,"5min":2.5089999999999999,"15min":26.975999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.5389999999999999,"15min":1.589},"min":{"1min":1.141,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.988,"5min":2.492,"15min":28.765000000000001},"last":1.478}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1511,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193800,"statfs":{"total":200000000,"available":198451772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.61299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.819},"last":1.107},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0249999999999999,"15min":0.97799999999999998},"min":{"1min":0.60699999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.331,"5min":1.6699999999999999,"15min":6.1749999999999998},"last":1.0589999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.032,"15min":0.97899999999999998},"min":{"1min":0.63500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.411,"5min":1.6659999999999999,"15min":1.7669999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.044},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5189999999999999,"5min":1.732,"15min":6.2549999999999999},"last":1.2170000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.0429999999999999,"15min":0.97899999999999998},"min":{"1min":0.68300000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4570000000000001,"5min":1.6699999999999999,"15min":9.6069999999999993},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.1850000000000001},"min":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.1899999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3240000000000001,"15min":1.337},"min":{"1min":0.90600000000000003,"5min":0.81599999999999995,"15min":0.79500000000000004},"max":{"1min":1.6919999999999999,"5min":1.8240000000000001,"15min":9.9629999999999992},"last":1.26},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.377,"15min":1.3129999999999999},"min":{"1min":0.85799999999999998,"5min":0.78600000000000003,"15min":0.77900000000000003},"max":{"1min":1.825,"5min":1.879,"15min":1.879},"last":1.4059999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.351,"15min":1.325},"min":{"1min":0.86299999999999999,"5min":0.82799999999999996,"15min":0.76300000000000001},"max":{"1min":1.8200000000000001,"5min":2.0419999999999998,"15min":10.004},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4359999999999999,"15min":1.3939999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.728,"5min":2.0569999999999999,"15min":2.161},"last":1.3240000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4259999999999999,"15min":1.369},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.75900000000000001},"max":{"1min":1.863,"5min":2.2000000000000002,"15min":6.4290000000000003},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.4410000000000001,"15min":1.4399999999999999},"min":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.86799999999999999},"max":{"1min":1.7030000000000001,"5min":2.1549999999999998,"15min":9.9190000000000005},"last":1.498}]},{"osd":7,"last update":"Wed Aug 9 12:48:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.466,"15min":1.458},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.9319999999999999,"5min":2.2909999999999999,"15min":18.114000000000001},"last":1.74},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.5209999999999999,"15min":1.4850000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.891,"5min":2.1120000000000001,"15min":9.5640000000000001},"last":1.611}]}]}],"pool_statfs":[]}} 2023-08-09T12:48:57.124 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:48:57.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:48:57.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.404+0000 7f1b26aec640 1 Processor -- start 2023-08-09T12:48:57.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.404+0000 7f1b26aec640 1 -- start start 2023-08-09T12:48:57.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.405+0000 7f1b26aec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1b2015ac70 0x7f1b200af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b26aec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2006c020 0x7f1b200b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b26aec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2015b050 con 0x7f1b200b0340 2023-08-09T12:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b26aec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200b0d10 con 0x7f1b2015ac70 2023-08-09T12:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b26aec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200ca390 con 0x7f1b2006c020 2023-08-09T12:48:57.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b24888640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1b2015ac70 0x7f1b200af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b24888640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1b2015ac70 0x7f1b200af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57254/0 (socket says 172.21.15.17:57254) 2023-08-09T12:48:57.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b24888640 1 -- 172.21.15.17:0/3982450414 learned_addr learned my addr 172.21.15.17:0/3982450414 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:57.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b24888640 1 -- 172.21.15.17:0/3982450414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2006c020 msgr2=0x7f1b200b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:57.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b24888640 1 --2- 172.21.15.17:0/3982450414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2006c020 0x7f1b200b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b24888640 1 -- 172.21.15.17:0/3982450414 >> v1:172.21.15.142:6789/0 conn(0x7f1b200b0340 legacy=0x7f1b200c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:57.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.406+0000 7f1b24888640 1 -- 172.21.15.17:0/3982450414 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200ca670 con 0x7f1b2015ac70 2023-08-09T12:48:57.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.408+0000 7f1b24888640 1 --2- 172.21.15.17:0/3982450414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015ac70 0x7f1b200af710 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009870 tx=0x7f1b1402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f2cdbb95771800 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.408+0000 7f1b1f7fe640 1 -- 172.21.15.17:0/3982450414 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14031640 con 0x7f1b2015ac70 2023-08-09T12:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.408+0000 7f1b1f7fe640 1 -- 172.21.15.17:0/3982450414 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b140317a0 con 0x7f1b2015ac70 2023-08-09T12:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.408+0000 7f1b1f7fe640 1 -- 172.21.15.17:0/3982450414 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14031b30 con 0x7f1b2015ac70 2023-08-09T12:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.409+0000 7f1b26aec640 1 -- 172.21.15.17:0/3982450414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015ac70 msgr2=0x7f1b200af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.409+0000 7f1b26aec640 1 --2- 172.21.15.17:0/3982450414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015ac70 0x7f1b200af710 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009870 tx=0x7f1b1402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.409+0000 7f1b26aec640 1 -- 172.21.15.17:0/3982450414 shutdown_connections 2023-08-09T12:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.409+0000 7f1b26aec640 1 --2- 172.21.15.17:0/3982450414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b2006c020 0x7f1b200b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.409+0000 7f1b26aec640 1 --2- 172.21.15.17:0/3982450414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015ac70 0x7f1b200af710 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.409+0000 7f1b26aec640 1 -- 172.21.15.17:0/3982450414 >> 172.21.15.17:0/3982450414 conn(0x7f1b200ce840 msgr2=0x7f1b200cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.409+0000 7f1b26aec640 1 -- 172.21.15.17:0/3982450414 shutdown_connections 2023-08-09T12:48:57.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.409+0000 7f1b26aec640 1 -- 172.21.15.17:0/3982450414 wait complete. 2023-08-09T12:48:57.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.411+0000 7f1b26aec640 1 Processor -- start 2023-08-09T12:48:57.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.411+0000 7f1b26aec640 1 -- start start 2023-08-09T12:48:57.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.412+0000 7f1b26aec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b200b0340 0x7f1b2014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.412+0000 7f1b26aec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2015ac70 0x7f1b200c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.412+0000 7f1b26aec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015b2f0 0x7f1b20159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.412+0000 7f1b26aec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200b1580 con 0x7f1b2015b2f0 2023-08-09T12:48:57.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.412+0000 7f1b26aec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200b1e20 con 0x7f1b2015ac70 2023-08-09T12:48:57.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.412+0000 7f1b26aec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c7820 con 0x7f1b200b0340 2023-08-09T12:48:57.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.412+0000 7f1b25089640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015b2f0 0x7f1b20159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b25089640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015b2f0 0x7f1b20159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57270/0 (socket says 172.21.15.17:57270) 2023-08-09T12:48:57.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b25089640 1 -- 172.21.15.17:0/1947716584 learned_addr learned my addr 172.21.15.17:0/1947716584 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:57.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b24888640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b200b0340 0x7f1b2014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b1ffff640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2015ac70 0x7f1b200c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b25089640 1 -- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b200b0340 msgr2=0x7f1b2014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b25089640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b200b0340 0x7f1b2014d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b25089640 1 -- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2015ac70 msgr2=0x7f1b200c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b25089640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2015ac70 0x7f1b200c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b25089640 1 -- 172.21.15.17:0/1947716584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b140094d0 con 0x7f1b2015b2f0 2023-08-09T12:48:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b1ffff640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2015ac70 0x7f1b200c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.413+0000 7f1b25089640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015b2f0 0x7f1b20159020 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800b9e0 tx=0x7f1b1800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.414+0000 7f1b1d7fa640 1 -- 172.21.15.17:0/1947716584 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1800cb20 con 0x7f1b2015b2f0 2023-08-09T12:48:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.414+0000 7f1b1d7fa640 1 -- 172.21.15.17:0/1947716584 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1800cca0 con 0x7f1b2015b2f0 2023-08-09T12:48:57.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.414+0000 7f1b1d7fa640 1 -- 172.21.15.17:0/1947716584 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18014680 con 0x7f1b2015b2f0 2023-08-09T12:48:57.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.414+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200b17d0 con 0x7f1b2015b2f0 2023-08-09T12:48:57.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.414+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200c6850 con 0x7f1b2015b2f0 2023-08-09T12:48:57.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.415+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b200b1f90 con 0x7f1b2015b2f0 2023-08-09T12:48:57.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.416+0000 7f1b1d7fa640 1 -- 172.21.15.17:0/1947716584 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1b1801d3b0 con 0x7f1b2015b2f0 2023-08-09T12:48:57.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.417+0000 7f1b1d7fa640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1b0406a050 0x7f1b0406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.418+0000 7f1b1d7fa640 1 -- 172.21.15.17:0/1947716584 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b180885f0 con 0x7f1b2015b2f0 2023-08-09T12:48:57.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.418+0000 7f1b24888640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1b0406a050 0x7f1b0406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.419+0000 7f1b24888640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1b0406a050 0x7f1b0406c510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1b14036000 tx=0x7f1b1403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:57.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.422+0000 7f1b1d7fa640 1 -- 172.21.15.17:0/1947716584 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1b18053bb0 con 0x7f1b2015b2f0 2023-08-09T12:48:57.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.673+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1b20067a80 con 0x7f1b2015b2f0 2023-08-09T12:48:57.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.681+0000 7f1b1d7fa640 1 -- 172.21.15.17:0/1947716584 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1b180190e0 con 0x7f1b2015b2f0 2023-08-09T12:48:57.684 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:48:57.684 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:48:57.684 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:48:57.685 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:48:57.685 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:48:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:48:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.683+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1b0406a050 msgr2=0x7f1b0406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.683+0000 7f1b26aec640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1b0406a050 0x7f1b0406c510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1b14036000 tx=0x7f1b1403c040 comp rx=0 tx=0).stop 2023-08-09T12:48:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.683+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015b2f0 msgr2=0x7f1b20159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.683+0000 7f1b26aec640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015b2f0 0x7f1b20159020 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800b9e0 tx=0x7f1b1800bea0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.684+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 shutdown_connections 2023-08-09T12:48:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.684+0000 7f1b26aec640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f1b0406a050 0x7f1b0406c510 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.684+0000 7f1b26aec640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b2015b2f0 0x7f1b20159020 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.684+0000 7f1b26aec640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b2015ac70 0x7f1b200c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.684+0000 7f1b26aec640 1 --2- 172.21.15.17:0/1947716584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b200b0340 0x7f1b2014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.684+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 >> 172.21.15.17:0/1947716584 conn(0x7f1b200ce840 msgr2=0x7f1b200cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.684+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 shutdown_connections 2023-08-09T12:48:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.684+0000 7f1b26aec640 1 -- 172.21.15.17:0/1947716584 wait complete. 2023-08-09T12:48:57.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:48:57.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.899+0000 7f731be8e640 1 Processor -- start 2023-08-09T12:48:57.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.899+0000 7f731be8e640 1 -- start start 2023-08-09T12:48:57.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.900+0000 7f731be8e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73141616e0 0x7f73140b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.900+0000 7f731be8e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f73140d29d0 0x7f73140d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.901+0000 7f731be8e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73140d3360 con 0x7f731415ce90 2023-08-09T12:48:57.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.901+0000 7f731be8e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73140b6540 con 0x7f73140d29d0 2023-08-09T12:48:57.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.901+0000 7f731be8e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73140cdd10 con 0x7f73141616e0 2023-08-09T12:48:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.901+0000 7f731a42b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f73140d29d0 0x7f73140d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.901+0000 7f731a42b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f73140d29d0 0x7f73140d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57272/0 (socket says 172.21.15.17:57272) 2023-08-09T12:48:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.901+0000 7f731a42b640 1 -- 172.21.15.17:0/2754517540 learned_addr learned my addr 172.21.15.17:0/2754517540 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.901+0000 7f7319429640 1 --2- 172.21.15.17:0/2754517540 >> v2:172.21.15.142:3300/0 conn(0x7f73141616e0 0x7f73140b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.902+0000 7f731a42b640 1 -- 172.21.15.17:0/2754517540 >> v2:172.21.15.142:3300/0 conn(0x7f73141616e0 msgr2=0x7f73140b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.902+0000 7f731a42b640 1 --2- 172.21.15.17:0/2754517540 >> v2:172.21.15.142:3300/0 conn(0x7f73141616e0 0x7f73140b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.902+0000 7f731a42b640 1 -- 172.21.15.17:0/2754517540 >> v1:172.21.15.142:6789/0 conn(0x7f731415ce90 legacy=0x7f73140cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.902+0000 7f731a42b640 1 -- 172.21.15.17:0/2754517540 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140cdff0 con 0x7f73140d29d0 2023-08-09T12:48:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.903+0000 7f731a42b640 1 --2- 172.21.15.17:0/2754517540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73140d29d0 0x7f73140d2e20 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f73140c9c00 tx=0x7f730c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9b0dfc7afba927 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f7318c28640 1 -- 172.21.15.17:0/2754517540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c030860 con 0x7f73140d29d0 2023-08-09T12:48:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f7318c28640 1 -- 172.21.15.17:0/2754517540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c0309c0 con 0x7f73140d29d0 2023-08-09T12:48:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f7318c28640 1 -- 172.21.15.17:0/2754517540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c030d50 con 0x7f73140d29d0 2023-08-09T12:48:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f731be8e640 1 -- 172.21.15.17:0/2754517540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73140d29d0 msgr2=0x7f73140d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f731be8e640 1 --2- 172.21.15.17:0/2754517540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73140d29d0 0x7f73140d2e20 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f73140c9c00 tx=0x7f730c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f731be8e640 1 -- 172.21.15.17:0/2754517540 shutdown_connections 2023-08-09T12:48:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f731be8e640 1 --2- 172.21.15.17:0/2754517540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73140d29d0 0x7f73140d2e20 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f731be8e640 1 --2- 172.21.15.17:0/2754517540 >> v2:172.21.15.142:3300/0 conn(0x7f73141616e0 0x7f73140b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.904+0000 7f731be8e640 1 -- 172.21.15.17:0/2754517540 >> 172.21.15.17:0/2754517540 conn(0x7f731406fde0 msgr2=0x7f73140701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.905+0000 7f731be8e640 1 -- 172.21.15.17:0/2754517540 shutdown_connections 2023-08-09T12:48:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.905+0000 7f731be8e640 1 -- 172.21.15.17:0/2754517540 wait complete. 2023-08-09T12:48:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.906+0000 7f731be8e640 1 Processor -- start 2023-08-09T12:48:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.906+0000 7f731be8e640 1 -- start start 2023-08-09T12:48:57.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.907+0000 7f731be8e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140d29d0 0x7f73141e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.907+0000 7f731be8e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f731415ce90 0x7f731414b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.907+0000 7f731be8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73141616e0 0x7f73140c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.907+0000 7f731be8e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c9570 con 0x7f73141616e0 2023-08-09T12:48:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.907+0000 7f731be8e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73141e7fa0 con 0x7f73140d29d0 2023-08-09T12:48:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.907+0000 7f731be8e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73141e8280 con 0x7f731415ce90 2023-08-09T12:48:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f731a42b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73141616e0 0x7f73140c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f731a42b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73141616e0 0x7f73140c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37742/0 (socket says 172.21.15.17:37742) 2023-08-09T12:48:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f731a42b640 1 -- 172.21.15.17:0/1760294909 learned_addr learned my addr 172.21.15.17:0/1760294909 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f7319c2a640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140d29d0 0x7f73141e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f7319429640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f731415ce90 0x7f731414b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f731a42b640 1 -- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f731415ce90 msgr2=0x7f731414b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f731a42b640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f731415ce90 0x7f731414b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f731a42b640 1 -- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140d29d0 msgr2=0x7f73141e78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f731a42b640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140d29d0 0x7f73141e78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.908+0000 7f731a42b640 1 -- 172.21.15.17:0/1760294909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0094d0 con 0x7f73141616e0 2023-08-09T12:48:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.909+0000 7f731a42b640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73141616e0 0x7f73140c9030 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f730c02b9e0 tx=0x7f730c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.909+0000 7f730a7fc640 1 -- 172.21.15.17:0/1760294909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c039c90 con 0x7f73141616e0 2023-08-09T12:48:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.909+0000 7f730a7fc640 1 -- 172.21.15.17:0/1760294909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c039e10 con 0x7f73141616e0 2023-08-09T12:48:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.909+0000 7f730a7fc640 1 -- 172.21.15.17:0/1760294909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c043640 con 0x7f73141616e0 2023-08-09T12:48:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.909+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73141e8560 con 0x7f73141616e0 2023-08-09T12:48:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.909+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73141e8b20 con 0x7f73141616e0 2023-08-09T12:48:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.910+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7314067a80 con 0x7f73141616e0 2023-08-09T12:48:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.911+0000 7f730a7fc640 1 -- 172.21.15.17:0/1760294909 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f730c0437a0 con 0x7f73141616e0 2023-08-09T12:48:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.912+0000 7f730a7fc640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.912+0000 7f730a7fc640 1 -- 172.21.15.17:0/1760294909 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f730c03e070 con 0x7f73141616e0 2023-08-09T12:48:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.912+0000 7f7319c2a640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.914+0000 7f7319c2a640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f73100012e0 tx=0x7f7310009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:57.916+0000 7f730a7fc640 1 -- 172.21.15.17:0/1760294909 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f730c076cf0 con 0x7f73141616e0 2023-08-09T12:48:58.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.146+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73140d0ad0 con 0x7f73141616e0 2023-08-09T12:48:58.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.147+0000 7f730a7fc640 1 -- 172.21.15.17:0/1760294909 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4868 (secure 0 0 0) 0x7f730c07a310 con 0x7f73141616e0 2023-08-09T12:48:58.150 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:48:58.150 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/734006206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":734006206},{"type":"v1","addr":"172.21.15.142:6835","nonce":734006206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2545254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2545254},{"type":"v1","addr":"172.21.15.142:6837","nonce":2545254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/842290627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":842290627},{"type":"v1","addr":"172.21.15.17:6834","nonce":842290627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:48:46.396953+0000","modified":"2023-08-09T12:48:49.978198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8517":{"gid":8517,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1876401199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1876401199},{"type":"v1","addr":"172.21.15.17:6835","nonce":1876401199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-09T12:48:58.151 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 76 2023-08-09T12:48:58.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 msgr2=0x7f72f806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f73100012e0 tx=0x7f7310009040 comp rx=0 tx=0).stop 2023-08-09T12:48:58.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73141616e0 msgr2=0x7f73140c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73141616e0 0x7f73140c9030 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f730c02b9e0 tx=0x7f730c004730 comp rx=0 tx=0).stop 2023-08-09T12:48:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 shutdown_connections 2023-08-09T12:48:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72f806a050 0x7f72f806c510 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73141616e0 0x7f73140c9030 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f731415ce90 0x7f731414b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 --2- 172.21.15.17:0/1760294909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140d29d0 0x7f73141e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 >> 172.21.15.17:0/1760294909 conn(0x7f731406fde0 msgr2=0x7f73140b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 shutdown_connections 2023-08-09T12:48:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.150+0000 7f731be8e640 1 -- 172.21.15.17:0/1760294909 wait complete. 2023-08-09T12:48:58.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:48:46.396953+0000', 'modified': '2023-08-09T12:48:49.978198+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8517': {'gid': 8517, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/1876401199', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 1876401199}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 1876401199}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:48:58.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:48:58.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-09T12:48:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.815+0000 7f433759b640 1 Processor -- start 2023-08-09T12:48:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.815+0000 7f433759b640 1 -- start start 2023-08-09T12:48:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f433759b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43301601f0 0x7f43300b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f433759b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43300cb610 0x7f43300c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f433759b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43300b34a0 con 0x7f43300b2ee0 2023-08-09T12:48:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f433759b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43300b4120 con 0x7f43301601f0 2023-08-09T12:48:58.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f433759b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43300b3780 con 0x7f43300cb610 2023-08-09T12:48:58.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f4336599640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43301601f0 0x7f43300b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f4336599640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43301601f0 0x7f43300b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37754/0 (socket says 172.21.15.17:37754) 2023-08-09T12:48:58.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f4336599640 1 -- 172.21.15.17:0/3443246867 learned_addr learned my addr 172.21.15.17:0/3443246867 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:58.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f4336599640 1 -- 172.21.15.17:0/3443246867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43300cb610 msgr2=0x7f43300c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f4336599640 1 --2- 172.21.15.17:0/3443246867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43300cb610 0x7f43300c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.817+0000 7f4336599640 1 -- 172.21.15.17:0/3443246867 >> v1:172.21.15.142:6789/0 conn(0x7f43300b2ee0 legacy=0x7f43300caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.818+0000 7f4336599640 1 -- 172.21.15.17:0/3443246867 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300b3a60 con 0x7f43301601f0 2023-08-09T12:48:58.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.819+0000 7f4336599640 1 --2- 172.21.15.17:0/3443246867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43301601f0 0x7f43300b29a0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f432c009870 tx=0x7f432c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e210e538048fe server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:58.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.819+0000 7f4335597640 1 -- 172.21.15.17:0/3443246867 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c031640 con 0x7f43301601f0 2023-08-09T12:48:58.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.819+0000 7f4335597640 1 -- 172.21.15.17:0/3443246867 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c0317a0 con 0x7f43301601f0 2023-08-09T12:48:58.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.819+0000 7f4335597640 1 -- 172.21.15.17:0/3443246867 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c031b30 con 0x7f43301601f0 2023-08-09T12:48:58.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.820+0000 7f433759b640 1 -- 172.21.15.17:0/3443246867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43301601f0 msgr2=0x7f43300b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.820+0000 7f433759b640 1 --2- 172.21.15.17:0/3443246867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43301601f0 0x7f43300b29a0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f432c009870 tx=0x7f432c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.820+0000 7f433759b640 1 -- 172.21.15.17:0/3443246867 shutdown_connections 2023-08-09T12:48:58.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.820+0000 7f433759b640 1 --2- 172.21.15.17:0/3443246867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43300cb610 0x7f43300c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.820+0000 7f433759b640 1 --2- 172.21.15.17:0/3443246867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43301601f0 0x7f43300b29a0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.820+0000 7f433759b640 1 -- 172.21.15.17:0/3443246867 >> 172.21.15.17:0/3443246867 conn(0x7f43300b1d50 msgr2=0x7f433006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:58.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.820+0000 7f433759b640 1 -- 172.21.15.17:0/3443246867 shutdown_connections 2023-08-09T12:48:58.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.820+0000 7f433759b640 1 -- 172.21.15.17:0/3443246867 wait complete. 2023-08-09T12:48:58.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.822+0000 7f433759b640 1 Processor -- start 2023-08-09T12:48:58.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.823+0000 7f433759b640 1 -- start start 2023-08-09T12:48:58.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f433759b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43300b2ee0 0x7f43301475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f433759b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43300cb610 0x7f4330145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f433759b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43301601f0 0x7f43300cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f433759b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330157dc0 con 0x7f43300cb610 2023-08-09T12:48:58.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f433759b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330145a80 con 0x7f43301601f0 2023-08-09T12:48:58.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f433759b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4330148550 con 0x7f43300b2ee0 2023-08-09T12:48:58.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f4335d98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43300cb610 0x7f4330145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f4335d98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43300cb610 0x7f4330145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37756/0 (socket says 172.21.15.17:37756) 2023-08-09T12:48:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f4335d98640 1 -- 172.21.15.17:0/2249137942 learned_addr learned my addr 172.21.15.17:0/2249137942 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f4335d98640 1 -- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43300b2ee0 msgr2=0x7f43301475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f4335d98640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43300b2ee0 0x7f43301475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f4335d98640 1 -- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43301601f0 msgr2=0x7f43300cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.824+0000 7f4335d98640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43301601f0 0x7f43300cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.825+0000 7f4335d98640 1 -- 172.21.15.17:0/2249137942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0094d0 con 0x7f43300cb610 2023-08-09T12:48:58.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.825+0000 7f4335d98640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43300cb610 0x7f4330145540 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f432000c430 tx=0x7f432000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:58.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.825+0000 7f4326ffd640 1 -- 172.21.15.17:0/2249137942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320011790 con 0x7f43300cb610 2023-08-09T12:48:58.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.825+0000 7f4326ffd640 1 -- 172.21.15.17:0/2249137942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43200118f0 con 0x7f43300cb610 2023-08-09T12:48:58.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.825+0000 7f4326ffd640 1 -- 172.21.15.17:0/2249137942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320011ce0 con 0x7f43300cb610 2023-08-09T12:48:58.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.825+0000 7f433759b640 1 -- 172.21.15.17:0/2249137942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4330158060 con 0x7f43300cb610 2023-08-09T12:48:58.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.825+0000 7f433759b640 1 -- 172.21.15.17:0/2249137942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4330147f90 con 0x7f43300cb610 2023-08-09T12:48:58.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.828+0000 7f4326ffd640 1 -- 172.21.15.17:0/2249137942 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f432001c460 con 0x7f43300cb610 2023-08-09T12:48:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.829+0000 7f4326ffd640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f431406a050 0x7f431406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.830+0000 7f4326ffd640 1 -- 172.21.15.17:0/2249137942 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4320088600 con 0x7f43300cb610 2023-08-09T12:48:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.830+0000 7f433b36a740 1 Processor -- start 2023-08-09T12:48:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.830+0000 7f433b36a740 1 -- start start 2023-08-09T12:48:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.830+0000 7f4336599640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f431406a050 0x7f431406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f433b36a740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 0x55d5a446d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f433b36a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a443cdb0 0x55d5a446a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f433b36a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a44409b0 0x55d5a446a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f433b36a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a43ae8f0 con 0x55d5a44409b0 2023-08-09T12:48:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f433b36a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a43abfe0 con 0x55d5a443cdb0 2023-08-09T12:48:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f433b36a740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a43a78d0 con 0x55d5a446ce30 2023-08-09T12:48:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f4336d9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a44409b0 0x55d5a446a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f4336d9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a44409b0 0x55d5a446a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37764/0 (socket says 172.21.15.17:37764) 2023-08-09T12:48:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f4336d9a640 1 -- 172.21.15.17:0/1361177890 learned_addr learned my addr 172.21.15.17:0/1361177890 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.831+0000 7f4336599640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f431406a050 0x7f431406c510 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f432c036000 tx=0x7f432c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4335d98640 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a443cdb0 0x55d5a446a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4336599640 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 0x55d5a446d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4336d9a640 1 -- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 msgr2=0x55d5a446d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4336d9a640 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 0x55d5a446d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4336d9a640 1 -- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a443cdb0 msgr2=0x55d5a446a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4336d9a640 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a443cdb0 0x55d5a446a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4336d9a640 1 -- 172.21.15.17:0/1361177890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5a4360ac0 con 0x55d5a44409b0 2023-08-09T12:48:58.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4336599640 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 0x55d5a446d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:48:58.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4336d9a640 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a44409b0 0x55d5a446a5e0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f4328009cd0 tx=0x7f432800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607c7025115d04e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:58.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4313fff640 1 -- 172.21.15.17:0/1361177890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432800e070 con 0x55d5a44409b0 2023-08-09T12:48:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4313fff640 1 -- 172.21.15.17:0/1361177890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432800bd40 con 0x55d5a44409b0 2023-08-09T12:48:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.832+0000 7f4313fff640 1 -- 172.21.15.17:0/1361177890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328012650 con 0x55d5a44409b0 2023-08-09T12:48:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 -- 172.21.15.17:0/1361177890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a44409b0 msgr2=0x55d5a446a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a44409b0 0x55d5a446a5e0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f4328009cd0 tx=0x7f432800b420 comp rx=0 tx=0).stop 2023-08-09T12:48:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 -- 172.21.15.17:0/1361177890 shutdown_connections 2023-08-09T12:48:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a44409b0 0x55d5a446a5e0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a443cdb0 0x55d5a446a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 --2- 172.21.15.17:0/1361177890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 0x55d5a446d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 -- 172.21.15.17:0/1361177890 >> 172.21.15.17:0/1361177890 conn(0x55d5a443f0c0 msgr2=0x55d5a4487c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 -- 172.21.15.17:0/1361177890 shutdown_connections 2023-08-09T12:48:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.833+0000 7f433b36a740 1 -- 172.21.15.17:0/1361177890 wait complete. 2023-08-09T12:48:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.834+0000 7f433b36a740 1 -- start start 2023-08-09T12:48:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.834+0000 7f433b36a740 1 Processor -- start 2023-08-09T12:48:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.835+0000 7f433b36a740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 0x55d5a445cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.835+0000 7f433b36a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a446ce30 0x55d5a446f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.835+0000 7f433b36a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a4497cc0 0x55d5a4498140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.835+0000 7f433b36a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a4347d40 con 0x55d5a446ce30 2023-08-09T12:48:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.835+0000 7f433b36a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a43479e0 con 0x55d5a4497cc0 2023-08-09T12:48:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.835+0000 7f433b36a740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a410df20 con 0x55d5a44409b0 2023-08-09T12:48:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.835+0000 7f433b36a740 10 client.0 _ll_register_callbacks cb 0x55d5a4360160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:48:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a446ce30 0x55d5a446f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a446ce30 0x55d5a446f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37776/0 (socket says 172.21.15.17:37776) 2023-08-09T12:48:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 -- 172.21.15.17:0/3767015296 learned_addr learned my addr 172.21.15.17:0/3767015296 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4336d9a640 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a4497cc0 0x55d5a4498140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4336599640 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 0x55d5a445cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 -- 172.21.15.17:0/3767015296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 msgr2=0x55d5a445cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 0x55d5a445cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 -- 172.21.15.17:0/3767015296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a4497cc0 msgr2=0x55d5a4498140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a4497cc0 0x55d5a4498140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 -- 172.21.15.17:0/3767015296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4328009980 con 0x55d5a446ce30 2023-08-09T12:48:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f4335d98640 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a446ce30 0x55d5a446f170 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f43200868d0 tx=0x7f432005b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93438d9aa2ff60c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f43117fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:48:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.836+0000 7f43117fa640 1 -- 172.21.15.17:0/3767015296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432005f390 con 0x55d5a446ce30 2023-08-09T12:48:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f43117fa640 1 -- 172.21.15.17:0/3767015296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f432005b170 con 0x55d5a446ce30 2023-08-09T12:48:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 1 -- 172.21.15.17:0/3767015296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5a437f500 con 0x55d5a446ce30 2023-08-09T12:48:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f43117fa640 1 -- 172.21.15.17:0/3767015296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f432005b330 con 0x55d5a446ce30 2023-08-09T12:48:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 10 client.8694 fetch_fsmap learned FSMap version 76 2023-08-09T12:48:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 1 -- 172.21.15.17:0/3767015296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55d5a43a5f50 con 0x55d5a446ce30 2023-08-09T12:48:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f43117fa640 1 -- 172.21.15.17:0/3767015296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320072020 con 0x55d5a446ce30 2023-08-09T12:48:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f43117fa640 1 -- 172.21.15.17:0/3767015296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4320053700 con 0x55d5a446ce30 2023-08-09T12:48:58.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 10 client.8694 fetch_fsmap finished waiting for FSMap version 76 2023-08-09T12:48:58.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 10 client.8694 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:48:58.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 20 client.8694 populate_metadata read hostname 'smithi017' 2023-08-09T12:48:58.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] conn(0x55d5a44a3420 0x55d5a44a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 4 client.8694 mds_command: new command op to 8517 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:48:58.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f433b36a740 1 -- 172.21.15.17:0/3767015296 --> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5a437cbc0 con 0x55d5a44a3420 2023-08-09T12:48:58.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.837+0000 7f4336599640 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] conn(0x55d5a44a3420 0x55d5a44a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.838+0000 7f4336599640 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] conn(0x55d5a44a3420 0x55d5a44a5810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5136ca2a834b89b0 server_cookie=790657d4bac926f5 in_seq=0 out_seq=0 2023-08-09T12:48:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.838+0000 7f43117fa640 10 client.8694 ms_handle_connect on v2:172.21.15.17:6833/1876401199 2023-08-09T12:48:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f43117fa640 1 -- 172.21.15.17:0/3767015296 <== mds.0 v2:172.21.15.17:6833/1876401199 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d5a437cbc0 con 0x55d5a44a3420 2023-08-09T12:48:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f43117fa640 10 client.8694 handle_command_reply: tid=0 2023-08-09T12:48:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 client.8694 shutdown 2023-08-09T12:48:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 -- 172.21.15.17:0/3767015296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a446ce30 msgr2=0x55d5a446f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a446ce30 0x55d5a446f170 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f43200868d0 tx=0x7f432005b790 comp rx=0 tx=0).stop 2023-08-09T12:48:58.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 -- 172.21.15.17:0/3767015296 shutdown_connections 2023-08-09T12:48:58.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] conn(0x55d5a44a3420 0x55d5a44a5810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a4497cc0 0x55d5a4498140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a446ce30 0x55d5a446f170 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 --2- 172.21.15.17:0/3767015296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 0x55d5a445cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 -- 172.21.15.17:0/3767015296 >> 172.21.15.17:0/3767015296 conn(0x55d5a443cdb0 msgr2=0x55d5a4441160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:58.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f43117fa640 0 client.8694 ms_handle_reset on v2:172.21.15.17:6833/1876401199 2023-08-09T12:48:58.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 -- 172.21.15.17:0/3767015296 shutdown_connections 2023-08-09T12:48:58.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.839+0000 7f433b36a740 1 -- 172.21.15.17:0/3767015296 wait complete. 2023-08-09T12:48:58.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.840+0000 7f433b36a740 20 client.8694 trim_cache size 0 max 16384 2023-08-09T12:48:58.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.856+0000 7f433b36a740 1 Processor -- start 2023-08-09T12:48:58.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.856+0000 7f433b36a740 1 -- start start 2023-08-09T12:48:58.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f433b36a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a44409b0 0x55d5a448b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f433b36a740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 0x55d5a44a9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f433b36a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f433b36a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a448bc00 con 0x55d5a4497cc0 2023-08-09T12:48:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f433b36a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a4440f50 con 0x55d5a44409b0 2023-08-09T12:48:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f433b36a740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a446e030 con 0x55d5a446ce30 2023-08-09T12:48:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f4336d9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f4336d9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37780/0 (socket says 172.21.15.17:37780) 2023-08-09T12:48:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f4336d9a640 1 -- 172.21.15.17:0/3323867352 learned_addr learned my addr 172.21.15.17:0/3323867352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f4336d9a640 1 -- 172.21.15.17:0/3323867352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 msgr2=0x55d5a44a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f4336d9a640 1 --2- 172.21.15.17:0/3323867352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 0x55d5a44a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f4336d9a640 1 -- 172.21.15.17:0/3323867352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a44409b0 msgr2=0x55d5a448b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f4336d9a640 1 --2- 172.21.15.17:0/3323867352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a44409b0 0x55d5a448b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.857+0000 7f4336d9a640 1 -- 172.21.15.17:0/3323867352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5a43d9300 con 0x55d5a4497cc0 2023-08-09T12:48:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.858+0000 7f4336d9a640 1 --2- 172.21.15.17:0/3323867352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f432800b460 tx=0x7f4328010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c6a51f9fed8bb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.858+0000 7f4324ff9640 1 -- 172.21.15.17:0/3323867352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328012860 con 0x55d5a4497cc0 2023-08-09T12:48:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.858+0000 7f4324ff9640 1 -- 172.21.15.17:0/3323867352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280129e0 con 0x55d5a4497cc0 2023-08-09T12:48:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.858+0000 7f4324ff9640 1 -- 172.21.15.17:0/3323867352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328012d90 con 0x55d5a4497cc0 2023-08-09T12:48:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 -- 172.21.15.17:0/3323867352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 msgr2=0x55d5a44a9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 --2- 172.21.15.17:0/3323867352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f432800b460 tx=0x7f4328010000 comp rx=0 tx=0).stop 2023-08-09T12:48:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 -- 172.21.15.17:0/3323867352 shutdown_connections 2023-08-09T12:48:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 --2- 172.21.15.17:0/3323867352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 --2- 172.21.15.17:0/3323867352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a446ce30 0x55d5a44a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 --2- 172.21.15.17:0/3323867352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a44409b0 0x55d5a448b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 -- 172.21.15.17:0/3323867352 >> 172.21.15.17:0/3323867352 conn(0x55d5a443cdb0 msgr2=0x55d5a4470590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 -- 172.21.15.17:0/3323867352 shutdown_connections 2023-08-09T12:48:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.859+0000 7f433b36a740 1 -- 172.21.15.17:0/3323867352 wait complete. 2023-08-09T12:48:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.860+0000 7f433b36a740 1 -- start start 2023-08-09T12:48:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.860+0000 7f433b36a740 1 Processor -- start 2023-08-09T12:48:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f433b36a740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 0x55d5a44f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f433b36a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a446ce30 0x55d5a44a9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f433b36a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f433b36a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a44f0b60 con 0x55d5a4497cc0 2023-08-09T12:48:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f433b36a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a443c140 con 0x55d5a446ce30 2023-08-09T12:48:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f433b36a740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a443c380 con 0x55d5a44409b0 2023-08-09T12:48:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f433b36a740 10 client.0 _ll_register_callbacks cb 0x7f4320011f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:48:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f4336d9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f4336d9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37784/0 (socket says 172.21.15.17:37784) 2023-08-09T12:48:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.861+0000 7f4336d9a640 1 -- 172.21.15.17:0/375156710 learned_addr learned my addr 172.21.15.17:0/375156710 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f4336d9a640 1 -- 172.21.15.17:0/375156710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 msgr2=0x55d5a44f0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f4336d9a640 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 0x55d5a44f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f4335d98640 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a446ce30 0x55d5a44a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f4336d9a640 1 -- 172.21.15.17:0/375156710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a446ce30 msgr2=0x55d5a44a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f4336d9a640 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a446ce30 0x55d5a44a9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f4336d9a640 1 -- 172.21.15.17:0/375156710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5a4360ac0 con 0x55d5a4497cc0 2023-08-09T12:48:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f4336d9a640 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f4328000f80 tx=0x7f4328004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ccbf977f3d5209 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f43117fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:48:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f43117fa640 1 -- 172.21.15.17:0/375156710 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328036070 con 0x55d5a4497cc0 2023-08-09T12:48:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.862+0000 7f433b36a740 1 -- 172.21.15.17:0/375156710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5a43cf800 con 0x55d5a4497cc0 2023-08-09T12:48:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.863+0000 7f43117fa640 1 -- 172.21.15.17:0/375156710 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4328030420 con 0x55d5a4497cc0 2023-08-09T12:48:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.863+0000 7f43117fa640 1 -- 172.21.15.17:0/375156710 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4328012e60 con 0x55d5a4497cc0 2023-08-09T12:48:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.863+0000 7f433b36a740 10 client.8700 fetch_fsmap learned FSMap version 76 2023-08-09T12:48:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.863+0000 7f433b36a740 1 -- 172.21.15.17:0/375156710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55d5a4346a10 con 0x55d5a4497cc0 2023-08-09T12:48:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f43117fa640 1 -- 172.21.15.17:0/375156710 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d5a43cf800 con 0x55d5a4497cc0 2023-08-09T12:48:58.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f43117fa640 1 -- 172.21.15.17:0/375156710 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4328039020 con 0x55d5a4497cc0 2023-08-09T12:48:58.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f433b36a740 10 client.8700 fetch_fsmap finished waiting for FSMap version 76 2023-08-09T12:48:58.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f433b36a740 10 client.8700 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:48:58.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f433b36a740 20 client.8700 populate_metadata read hostname 'smithi017' 2023-08-09T12:48:58.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f433b36a740 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] conn(0x55d5a4496ad0 0x55d5a4496eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:58.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f433b36a740 4 client.8700 mds_command: new command op to 8517 tid=0[{"prefix": "status"}] 2023-08-09T12:48:58.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f433b36a740 1 -- 172.21.15.17:0/375156710 --> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d5a43a08b0 con 0x55d5a4496ad0 2023-08-09T12:48:58.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.865+0000 7f4336599640 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] conn(0x55d5a4496ad0 0x55d5a4496eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:58.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f4336599640 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] conn(0x55d5a4496ad0 0x55d5a4496eb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da746753b6894ada server_cookie=4fe42c0a5a7f7315 in_seq=0 out_seq=0 2023-08-09T12:48:58.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f43117fa640 10 client.8700 ms_handle_connect on v2:172.21.15.17:6833/1876401199 2023-08-09T12:48:58.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f43117fa640 1 -- 172.21.15.17:0/375156710 <== mds.0 v2:172.21.15.17:6833/1876401199 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d5a43a08b0 con 0x55d5a4496ad0 2023-08-09T12:48:58.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f43117fa640 10 client.8700 handle_command_reply: tid=0 2023-08-09T12:48:58.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 client.8700 shutdown 2023-08-09T12:48:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 -- 172.21.15.17:0/375156710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 msgr2=0x55d5a44a9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f4328000f80 tx=0x7f4328004bc0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 -- 172.21.15.17:0/375156710 shutdown_connections 2023-08-09T12:48:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5a4497cc0 0x55d5a44a9d70 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.17:6833/1876401199,v1:172.21.15.17:6835/1876401199] conn(0x55d5a4496ad0 0x55d5a4496eb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a446ce30 0x55d5a44a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 --2- 172.21.15.17:0/375156710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d5a44409b0 0x55d5a44f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f43117fa640 0 client.8700 ms_handle_reset on v2:172.21.15.17:6833/1876401199 2023-08-09T12:48:58.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.866+0000 7f433b36a740 1 -- 172.21.15.17:0/375156710 >> 172.21.15.17:0/375156710 conn(0x55d5a443cdb0 msgr2=0x55d5a44706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:58.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433b36a740 1 -- 172.21.15.17:0/375156710 shutdown_connections 2023-08-09T12:48:58.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433b36a740 1 -- 172.21.15.17:0/375156710 wait complete. 2023-08-09T12:48:58.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433b36a740 20 client.8700 trim_cache size 0 max 16384 2023-08-09T12:48:58.875 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:48:58.876 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:48:58.876 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:48:58.876 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 8517, 2023-08-09T12:48:58.876 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:48:58.876 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:48:58.876 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:48:58.877 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 11.907146416, 2023-08-09T12:48:58.877 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 76, 2023-08-09T12:48:58.877 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 161, 2023-08-09T12:48:58.877 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 161, 2023-08-09T12:48:58.878 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 17.934459242999999 2023-08-09T12:48:58.878 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:48:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 -- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f431406a050 msgr2=0x7f431406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f431406a050 0x7f431406c510 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f432c036000 tx=0x7f432c030000 comp rx=0 tx=0).stop 2023-08-09T12:48:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 -- 172.21.15.17:0/2249137942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43300cb610 msgr2=0x7f4330145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43300cb610 0x7f4330145540 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f432000c430 tx=0x7f432000c8f0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 -- 172.21.15.17:0/2249137942 shutdown_connections 2023-08-09T12:48:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f431406a050 0x7f431406c510 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43301601f0 0x7f43300cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43300cb610 0x7f4330145540 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 --2- 172.21.15.17:0/2249137942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43300b2ee0 0x7f43301475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.867+0000 7f433759b640 1 -- 172.21.15.17:0/2249137942 >> 172.21.15.17:0/2249137942 conn(0x7f43300b1d50 msgr2=0x7f43300c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.868+0000 7f433759b640 1 -- 172.21.15.17:0/2249137942 shutdown_connections 2023-08-09T12:48:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:58.868+0000 7f433759b640 1 -- 172.21.15.17:0/2249137942 wait complete. 2023-08-09T12:48:58.886 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:48:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.091+0000 7f607cf79640 1 Processor -- start 2023-08-09T12:48:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.092+0000 7f607cf79640 1 -- start start 2023-08-09T12:48:59.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.093+0000 7f607cf79640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60781616e0 0x7f60780b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:59.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.093+0000 7f607cf79640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f60780d29d0 0x7f60780d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:59.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.093+0000 7f607cf79640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60780cdd10 con 0x7f607815ce90 2023-08-09T12:48:59.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.093+0000 7f607cf79640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780b6540 con 0x7f60780d29d0 2023-08-09T12:48:59.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.093+0000 7f607cf79640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60780d33a0 con 0x7f60781616e0 2023-08-09T12:48:59.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.094+0000 7f6076d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f60780d29d0 0x7f60780d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:59.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.094+0000 7f6076d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f60780d29d0 0x7f60780d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37796/0 (socket says 172.21.15.17:37796) 2023-08-09T12:48:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.094+0000 7f6076d9d640 1 -- 172.21.15.17:0/1830958375 learned_addr learned my addr 172.21.15.17:0/1830958375 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.094+0000 7f6075d9b640 1 --2- 172.21.15.17:0/1830958375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60781616e0 0x7f60780b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.094+0000 7f6076d9d640 1 -- 172.21.15.17:0/1830958375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60781616e0 msgr2=0x7f60780b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.094+0000 7f6076d9d640 1 --2- 172.21.15.17:0/1830958375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60781616e0 0x7f60780b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.094+0000 7f6076d9d640 1 -- 172.21.15.17:0/1830958375 >> v1:172.21.15.142:6789/0 conn(0x7f607815ce90 legacy=0x7f60780cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:48:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.094+0000 7f6076d9d640 1 -- 172.21.15.17:0/1830958375 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780cdff0 con 0x7f60780d29d0 2023-08-09T12:48:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.095+0000 7f6076d9d640 1 --2- 172.21.15.17:0/1830958375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60780d29d0 0x7f60780d2e60 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f6070009e50 tx=0x7f607002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d62d88f73655df5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607559a640 1 -- 172.21.15.17:0/1830958375 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607002ca70 con 0x7f60780d29d0 2023-08-09T12:48:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607559a640 1 -- 172.21.15.17:0/1830958375 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607002cbd0 con 0x7f60780d29d0 2023-08-09T12:48:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607559a640 1 -- 172.21.15.17:0/1830958375 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700343f0 con 0x7f60780d29d0 2023-08-09T12:48:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607cf79640 1 -- 172.21.15.17:0/1830958375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60780d29d0 msgr2=0x7f60780d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607cf79640 1 --2- 172.21.15.17:0/1830958375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60780d29d0 0x7f60780d2e60 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f6070009e50 tx=0x7f607002bed0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607cf79640 1 -- 172.21.15.17:0/1830958375 shutdown_connections 2023-08-09T12:48:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607cf79640 1 --2- 172.21.15.17:0/1830958375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60780d29d0 0x7f60780d2e60 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607cf79640 1 --2- 172.21.15.17:0/1830958375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60781616e0 0x7f60780b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607cf79640 1 -- 172.21.15.17:0/1830958375 >> 172.21.15.17:0/1830958375 conn(0x7f607806fde0 msgr2=0x7f60780701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607cf79640 1 -- 172.21.15.17:0/1830958375 shutdown_connections 2023-08-09T12:48:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.096+0000 7f607cf79640 1 -- 172.21.15.17:0/1830958375 wait complete. 2023-08-09T12:48:59.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.098+0000 7f607cf79640 1 Processor -- start 2023-08-09T12:48:59.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.098+0000 7f607cf79640 1 -- start start 2023-08-09T12:48:59.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f607cf79640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780d29d0 0x7f60781e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:59.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f607cf79640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f607815ce90 0x7f60781f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:59.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f607cf79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60781616e0 0x7f60781f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:59.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f607cf79640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60780cc460 con 0x7f60781616e0 2023-08-09T12:48:59.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f607cf79640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781e7fc0 con 0x7f60780d29d0 2023-08-09T12:48:59.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f607cf79640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60781e82a0 con 0x7f607815ce90 2023-08-09T12:48:59.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f6076d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60781616e0 0x7f60781f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:59.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f6076d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60781616e0 0x7f60781f6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37812/0 (socket says 172.21.15.17:37812) 2023-08-09T12:48:59.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.099+0000 7f6076d9d640 1 -- 172.21.15.17:0/4161291146 learned_addr learned my addr 172.21.15.17:0/4161291146 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:48:59.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6076d9d640 1 -- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f607815ce90 msgr2=0x7f60781f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:59.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6076d9d640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f607815ce90 0x7f60781f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6076d9d640 1 -- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780d29d0 msgr2=0x7f60781e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:59.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f607659c640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780d29d0 0x7f60781e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:59.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6076d9d640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780d29d0 0x7f60781e7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6076d9d640 1 -- 172.21.15.17:0/4161291146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070009b30 con 0x7f60781616e0 2023-08-09T12:48:59.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6076d9d640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60781616e0 0x7f60781f6e50 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6070009e50 tx=0x7f6070004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:59.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6066ffd640 1 -- 172.21.15.17:0/4161291146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070009510 con 0x7f60781616e0 2023-08-09T12:48:59.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6066ffd640 1 -- 172.21.15.17:0/4161291146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607003e450 con 0x7f60781616e0 2023-08-09T12:48:59.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f6066ffd640 1 -- 172.21.15.17:0/4161291146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607003e800 con 0x7f60781616e0 2023-08-09T12:48:59.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.100+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60781e8580 con 0x7f60781616e0 2023-08-09T12:48:59.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.101+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60781e8b40 con 0x7f60781616e0 2023-08-09T12:48:59.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.102+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60780b1700 con 0x7f60781616e0 2023-08-09T12:48:59.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.102+0000 7f6066ffd640 1 -- 172.21.15.17:0/4161291146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f607003e960 con 0x7f60781616e0 2023-08-09T12:48:59.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.103+0000 7f6066ffd640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f605806a050 0x7f605806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:48:59.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.103+0000 7f6066ffd640 1 -- 172.21.15.17:0/4161291146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60700ab4e0 con 0x7f60781616e0 2023-08-09T12:48:59.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.104+0000 7f607659c640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f605806a050 0x7f605806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:48:59.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.105+0000 7f607659c640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f605806a050 0x7f605806c510 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6078070cd0 tx=0x7f6068009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:48:59.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.108+0000 7f6066ffd640 1 -- 172.21.15.17:0/4161291146 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6070076d00 con 0x7f60781616e0 2023-08-09T12:48:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.339+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6078067a80 con 0x7f60781616e0 2023-08-09T12:48:59.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.340+0000 7f6066ffd640 1 -- 172.21.15.17:0/4161291146 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f607007a320 con 0x7f60781616e0 2023-08-09T12:48:59.343 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:48:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.342+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f605806a050 msgr2=0x7f605806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.342+0000 7f607cf79640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f605806a050 0x7f605806c510 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6078070cd0 tx=0x7f6068009040 comp rx=0 tx=0).stop 2023-08-09T12:48:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.342+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60781616e0 msgr2=0x7f60781f6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:48:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.342+0000 7f607cf79640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60781616e0 0x7f60781f6e50 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6070009e50 tx=0x7f6070004a40 comp rx=0 tx=0).stop 2023-08-09T12:48:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.343+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 shutdown_connections 2023-08-09T12:48:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.343+0000 7f607cf79640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f605806a050 0x7f605806c510 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.343+0000 7f607cf79640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60781616e0 0x7f60781f6e50 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.343+0000 7f607cf79640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f607815ce90 0x7f60781f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.343+0000 7f607cf79640 1 --2- 172.21.15.17:0/4161291146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780d29d0 0x7f60781e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:48:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.343+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 >> 172.21.15.17:0/4161291146 conn(0x7f607806fde0 msgr2=0x7f60780b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:48:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.343+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 shutdown_connections 2023-08-09T12:48:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:48:59.343+0000 7f607cf79640 1 -- 172.21.15.17:0/4161291146 wait complete. 2023-08-09T12:48:59.364 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:48:59.365 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:48:59.366 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:48:59.366 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:48:59.367 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:48:59.367 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:48:59.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:48:59.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:48:59.369 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:48:59.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:59.371 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:48:59.424 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:48:59.425 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:48:59.425 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:48:59.425 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:48:59.425 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:48:59.425 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:48:59.426 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:48:59.426 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:48:59.426 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:48:59.426 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:48:59.426 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:48:59.426 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:48:59.426 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:48:59.427 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:48:59.427 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:48:59.427 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:48:59.427 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41641sec preferred_lft 41641sec 2023-08-09T12:48:59.427 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:48:59.427 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:48:59.427 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:48:59.428 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:48:59.428 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:48:59.428 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:48:59.428 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:48:59.428 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:48:59.428 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:48:59.428 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:48:59.429 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:48:59.429 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:48:59.429 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:48:59.429 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:48:59.429 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:48:59.429 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:48:59.429 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:48:59.429 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:48:59.430 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:48:59.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:59.431 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:48:59.524 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:48:59.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:59.532 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:48:59.593 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:48:59.593 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:48:59.594 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:48:59.594 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:48:59.594 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:48:59.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:59.597 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:48:59.598 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:48:59.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:48:59.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:48:59.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:48:59.601 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:48:59.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:59.812 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:48:59.870 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:48:59.871 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:48:59.872 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:48:59.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:48:59.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:48:59.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:48:59.984 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:49:00.048 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:49:00.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:49:00.049 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:49:00.107 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:49:00.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:00.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:49:00.262 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:49:00.263 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:49:00.263 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:49:00.285 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:49:00.285 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:49:00.285 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:49:00.286 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:49:00.286 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:49:00.310 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:49:00.310 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:49:00.310 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:49:00.310 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:49:00.310 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:49:00.311 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:49:00.311 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:49:00.311 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:49:00.312 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:49:00.312 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:49:00.312 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:49:00.312 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:49:00.313 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:49:00.316 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:49:00.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:00.317 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:49:00.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:00.413 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:49:00.484 INFO:teuthology.orchestra.run.smithi017.stdout:client8709 2023-08-09T12:49:00.484 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:49:00.485 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:49:00.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:49:00.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.776+0000 7f33c3ffd640 1 Processor -- start 2023-08-09T12:49:00.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.776+0000 7f33c3ffd640 1 -- start start 2023-08-09T12:49:00.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.778+0000 7f33c3ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33bc0adc40 0x7f33bc06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.778+0000 7f33c3ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 0x7f33bc0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.778+0000 7f33c3ffd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc0b2250 con 0x7f33bc15e8f0 2023-08-09T12:49:00.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.778+0000 7f33c3ffd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc0ae020 con 0x7f33bc0adc40 2023-08-09T12:49:00.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.778+0000 7f33c3ffd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0b2530 con 0x7f33bc0b3b40 2023-08-09T12:49:00.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.778+0000 7f33c259a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f33bc15e8f0 0x7f33bc15ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41934/0 (socket says 172.21.15.17:41934) 2023-08-09T12:49:00.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.778+0000 7f33c259a640 1 -- 172.21.15.17:0/516028581 learned_addr learned my addr 172.21.15.17:0/516028581 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:49:00.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c1d99640 1 --2- 172.21.15.17:0/516028581 >> v2:172.21.15.142:3300/0 conn(0x7f33bc0adc40 0x7f33bc06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c1598640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 0x7f33bc0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793481801 0 0) 0x7f33bc0b2250 con 0x7f33bc15e8f0 2023-08-09T12:49:00.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a8003520 con 0x7f33bc15e8f0 2023-08-09T12:49:00.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 878787808 0 0) 0x7f33a8003520 con 0x7f33bc15e8f0 2023-08-09T12:49:00.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 msgr2=0x7f33bc0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:49:00.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c0d97640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 0x7f33bc0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:00.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 >> v2:172.21.15.142:3300/0 conn(0x7f33bc0adc40 msgr2=0x7f33bc06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:49:00.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.779+0000 7f33c0d97640 1 --2- 172.21.15.17:0/516028581 >> v2:172.21.15.142:3300/0 conn(0x7f33bc0adc40 0x7f33bc06c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:00.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc06fe80 con 0x7f33bc15e8f0 2023-08-09T12:49:00.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f33b40019f0 con 0x7f33bc15e8f0 2023-08-09T12:49:00.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 >> v1:172.21.15.17:6789/0 conn(0x7f33bc15e8f0 legacy=0x7f33bc15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:00.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a8003970 0x7f33a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a80047c0 0x7f33a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 0x7f33a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0ae020 con 0x7f33a8003970 2023-08-09T12:49:00.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0b2530 con 0x7f33a80047c0 2023-08-09T12:49:00.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a800b980 con 0x7f33bc0b3b40 2023-08-09T12:49:00.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c1d99640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a8003970 0x7f33a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c259a640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 0x7f33a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.780+0000 7f33c1598640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a80047c0 0x7f33a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.781+0000 7f33c1d99640 1 -- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 msgr2=0x7f33a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:49:00.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.781+0000 7f33c1d99640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 0x7f33a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:00.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.781+0000 7f33c1d99640 1 -- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a80047c0 msgr2=0x7f33a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:49:00.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.781+0000 7f33c1d99640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a80047c0 0x7f33a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:00.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.781+0000 7f33c1d99640 1 -- 172.21.15.17:0/516028581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a8003520 con 0x7f33a8003970 2023-08-09T12:49:00.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.781+0000 7f33c259a640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc0b3b40 0x7f33a8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:49:00.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.781+0000 7f33c1598640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a80047c0 0x7f33a8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:49:00.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.782+0000 7f33c1d99640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a8003970 0x7f33a8003d90 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009ac0 tx=0x7f33a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587e96c35bbf0062 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:00.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.783+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b802c710 con 0x7f33a8003970 2023-08-09T12:49:00.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.783+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b802c870 con 0x7f33a8003970 2023-08-09T12:49:00.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.783+0000 7f33c0d97640 1 -- 172.21.15.17:0/516028581 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b802cc00 con 0x7f33a8003970 2023-08-09T12:49:00.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.783+0000 7f33c3ffd640 1 -- 172.21.15.17:0/516028581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a8003970 msgr2=0x7f33a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:00.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.783+0000 7f33c3ffd640 1 --2- 172.21.15.17:0/516028581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a8003970 0x7f33a8003d90 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009ac0 tx=0x7f33a80057f0 comp rx=0 tx=0).stop 2023-08-09T12:49:00.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.783+0000 7f33c259a640 1 -- 172.21.15.17:0/516028581 reap_dead start 2023-08-09T12:49:00.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.783+0000 7f33c3ffd640 1 -- 172.21.15.17:0/516028581 shutdown_connections 2023-08-09T12:49:00.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.783+0000 7f33c3ffd640 1 -- 172.21.15.17:0/516028581 >> 172.21.15.17:0/516028581 conn(0x7f33bc0cb1b0 msgr2=0x7f33bc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:49:00.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.784+0000 7f33c3ffd640 1 -- 172.21.15.17:0/516028581 shutdown_connections 2023-08-09T12:49:00.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.784+0000 7f33c3ffd640 1 -- 172.21.15.17:0/516028581 wait complete. 2023-08-09T12:49:00.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.785+0000 7f33c3ffd640 1 Processor -- start 2023-08-09T12:49:00.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.786+0000 7f33c3ffd640 1 -- start start 2023-08-09T12:49:00.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c3ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a8003970 0x7f33bc0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c3ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc1f28c0 0x7f33bc1f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c3ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33bc14e860 0x7f33bc14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c3ffd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1f3a80 con 0x7f33bc14e860 2023-08-09T12:49:00.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c3ffd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0c21d0 con 0x7f33a8003970 2023-08-09T12:49:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c3ffd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc14f220 con 0x7f33bc1f28c0 2023-08-09T12:49:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c259a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33bc14e860 0x7f33bc14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c259a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33bc14e860 0x7f33bc14ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37820/0 (socket says 172.21.15.17:37820) 2023-08-09T12:49:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c259a640 1 -- 172.21.15.17:0/827815462 learned_addr learned my addr 172.21.15.17:0/827815462 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:49:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c1d99640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a8003970 0x7f33bc0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c1598640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc1f28c0 0x7f33bc1f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c259a640 1 -- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc1f28c0 msgr2=0x7f33bc1f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c259a640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc1f28c0 0x7f33bc1f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c259a640 1 -- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a8003970 msgr2=0x7f33bc0acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c259a640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a8003970 0x7f33bc0acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.787+0000 7f33c259a640 1 -- 172.21.15.17:0/827815462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc1f33d0 con 0x7f33bc14e860 2023-08-09T12:49:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.788+0000 7f33c259a640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33bc14e860 0x7f33bc14ece0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0b01b0 tx=0x7f33b400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:00.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.788+0000 7f33b27fc640 1 -- 172.21.15.17:0/827815462 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b400eb90 con 0x7f33bc14e860 2023-08-09T12:49:00.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.788+0000 7f33b27fc640 1 -- 172.21.15.17:0/827815462 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b400ed10 con 0x7f33bc14e860 2023-08-09T12:49:00.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.788+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc1f36b0 con 0x7f33bc14e860 2023-08-09T12:49:00.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.788+0000 7f33b27fc640 1 -- 172.21.15.17:0/827815462 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4014670 con 0x7f33bc14e860 2023-08-09T12:49:00.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.788+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc0c26c0 con 0x7f33bc14e860 2023-08-09T12:49:00.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.789+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc1f38a0 con 0x7f33bc14e860 2023-08-09T12:49:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.790+0000 7f33b27fc640 1 -- 172.21.15.17:0/827815462 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f33b40147d0 con 0x7f33bc14e860 2023-08-09T12:49:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.791+0000 7f33b27fc640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f33a006a050 0x7f33a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.791+0000 7f33b27fc640 1 -- 172.21.15.17:0/827815462 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33b4088320 con 0x7f33bc14e860 2023-08-09T12:49:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.792+0000 7f33c1d99640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f33a006a050 0x7f33a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.793+0000 7f33c1d99640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f33a006a050 0x7f33a006c510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f33b8036000 tx=0x7f33b8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:00.796+0000 7f33b27fc640 1 -- 172.21.15.17:0/827815462 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f33b4053970 con 0x7f33bc14e860 2023-08-09T12:49:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.029+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33bc067a80 con 0x7f33bc14e860 2023-08-09T12:49:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.030+0000 7f33b27fc640 1 -- 172.21.15.17:0/827815462 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f33b4056f90 con 0x7f33bc14e860 2023-08-09T12:49:01.033 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:49:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f33a006a050 msgr2=0x7f33a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f33a006a050 0x7f33a006c510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f33b8036000 tx=0x7f33b8030000 comp rx=0 tx=0).stop 2023-08-09T12:49:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33bc14e860 msgr2=0x7f33bc14ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33bc14e860 0x7f33bc14ece0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0b01b0 tx=0x7f33b400e530 comp rx=0 tx=0).stop 2023-08-09T12:49:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 shutdown_connections 2023-08-09T12:49:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f33a006a050 0x7f33a006c510 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33bc14e860 0x7f33bc14ece0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33bc1f28c0 0x7f33bc1f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 --2- 172.21.15.17:0/827815462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33a8003970 0x7f33bc0acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 >> 172.21.15.17:0/827815462 conn(0x7f33bc0cb1b0 msgr2=0x7f33bc15db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:49:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 shutdown_connections 2023-08-09T12:49:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:01.033+0000 7f33c3ffd640 1 -- 172.21.15.17:0/827815462 wait complete. 2023-08-09T12:49:01.056 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:49:01.056 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:49:01.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:49:01.057 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:49:01.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:49:01.058 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:49:01.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:49:01.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:49:01.058 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:49:01.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.059 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:49:01.120 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:49:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:49:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:49:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:49:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:49:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:49:01.122 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:49:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:49:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:49:01.122 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:49:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:49:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:49:01.122 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:49:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:49:01.123 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:49:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:49:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:49:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41627sec preferred_lft 41627sec 2023-08-09T12:49:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:49:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:49:01.123 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:49:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:49:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:49:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:49:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:49:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:49:01.124 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:49:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:49:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:49:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:49:01.125 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:49:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:49:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:49:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:49:01.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.127 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:49:01.218 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:49:01.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.223 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:49:01.279 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:49:01.279 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:49:01.279 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:49:01.279 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:49:01.279 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:49:01.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.280 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:49:01.280 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:49:01.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:49:01.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:49:01.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:49:01.282 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:49:01.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.466 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:49:01.519 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:49:01.519 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:49:01.519 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:49:01.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:49:01.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:49:01.609 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:49:01.660 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:49:01.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:49:01.661 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:49:01.712 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:49:01.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.713 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:49:01.857 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:49:01.860 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:49:01.860 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:49:01.878 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:49:01.879 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:49:01.879 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:49:01.879 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:49:01.879 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:49:01.903 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:49:01.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:49:01.904 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:49:01.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:49:01.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:49:01.905 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:49:01.905 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:49:01.905 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:49:01.906 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:49:01.907 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:49:01.907 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:49:01.907 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:49:01.907 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:49:01.909 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:49:01.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:49:01.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:49:01.989 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:49:02.042 INFO:teuthology.orchestra.run.smithi142.stdout:client6658 2023-08-09T12:49:02.043 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:49:02.043 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:49:02.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:49:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.331+0000 7f520b683640 1 Processor -- start 2023-08-09T12:49:02.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.332+0000 7f520b683640 1 -- start start 2023-08-09T12:49:02.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.333+0000 7f520b683640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5204164f50 0x7f52040cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:02.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.333+0000 7f520b683640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040cd520 con 0x7f5204162650 2023-08-09T12:49:02.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.333+0000 7f520b683640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040cc630 con 0x7f52040c1980 2023-08-09T12:49:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.333+0000 7f520b683640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040cc910 con 0x7f5204164f50 2023-08-09T12:49:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.334+0000 7f5209c20640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5204162650 0x7f52040c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41950/0 (socket says 172.21.15.17:41950) 2023-08-09T12:49:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.334+0000 7f5209c20640 1 -- 172.21.15.17:0/2310137753 learned_addr learned my addr 172.21.15.17:0/2310137753 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:49:02.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.334+0000 7f520941f640 1 --2- 172.21.15.17:0/2310137753 >> v2:172.21.15.142:3300/0 conn(0x7f5204164f50 0x7f52040cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:02.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.334+0000 7f51fbfff640 1 -- 172.21.15.17:0/2310137753 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902788717 0 0) 0x7f52040cd520 con 0x7f5204162650 2023-08-09T12:49:02.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.334+0000 7f51fbfff640 1 -- 172.21.15.17:0/2310137753 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f0003520 con 0x7f5204162650 2023-08-09T12:49:02.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.335+0000 7f520941f640 1 -- 172.21.15.17:0/2310137753 >> v1:172.21.15.142:6789/0 conn(0x7f52040c1980 legacy=0x7f5204165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:02.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.335+0000 7f51fbfff640 1 -- 172.21.15.17:0/2310137753 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2212178949 0 0) 0x7f51f0003520 con 0x7f5204162650 2023-08-09T12:49:02.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.335+0000 7f520941f640 1 -- 172.21.15.17:0/2310137753 >> v1:172.21.15.17:6789/0 conn(0x7f5204162650 legacy=0x7f52040c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:02.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.335+0000 7f520941f640 1 -- 172.21.15.17:0/2310137753 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040ccbf0 con 0x7f5204164f50 2023-08-09T12:49:02.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.337+0000 7f520941f640 1 --2- 172.21.15.17:0/2310137753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5204164f50 0x7f52040cd9b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f52000097a0 tx=0x7f520002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15bb82ca3c21c5fb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.337+0000 7f51fbfff640 1 -- 172.21.15.17:0/2310137753 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520002f050 con 0x7f5204164f50 2023-08-09T12:49:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.337+0000 7f51fbfff640 1 -- 172.21.15.17:0/2310137753 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200031500 con 0x7f5204164f50 2023-08-09T12:49:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.337+0000 7f51fbfff640 1 -- 172.21.15.17:0/2310137753 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0019f0 con 0x7f5204164f50 2023-08-09T12:49:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.338+0000 7f520b683640 1 -- 172.21.15.17:0/2310137753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5204164f50 msgr2=0x7f52040cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.338+0000 7f520b683640 1 --2- 172.21.15.17:0/2310137753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5204164f50 0x7f52040cd9b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f52000097a0 tx=0x7f520002b820 comp rx=0 tx=0).stop 2023-08-09T12:49:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.338+0000 7f520b683640 1 -- 172.21.15.17:0/2310137753 shutdown_connections 2023-08-09T12:49:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.338+0000 7f520b683640 1 --2- 172.21.15.17:0/2310137753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5204164f50 0x7f52040cd9b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.338+0000 7f520b683640 1 -- 172.21.15.17:0/2310137753 >> 172.21.15.17:0/2310137753 conn(0x7f52040cb1b0 msgr2=0x7f52040cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:49:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.338+0000 7f520b683640 1 -- 172.21.15.17:0/2310137753 shutdown_connections 2023-08-09T12:49:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.338+0000 7f520b683640 1 -- 172.21.15.17:0/2310137753 wait complete. 2023-08-09T12:49:02.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.340+0000 7f520b683640 1 Processor -- start 2023-08-09T12:49:02.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.340+0000 7f520b683640 1 -- start start 2023-08-09T12:49:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.341+0000 7f520b683640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52040c1980 0x7f520406c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.341+0000 7f520b683640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5204162650 0x7f52041603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.341+0000 7f520b683640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5204164f50 0x7f5204156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.341+0000 7f520b683640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520406aa90 con 0x7f5204162650 2023-08-09T12:49:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.341+0000 7f520b683640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520406ad70 con 0x7f52040c1980 2023-08-09T12:49:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.341+0000 7f520b683640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520406b050 con 0x7f5204164f50 2023-08-09T12:49:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.341+0000 7f5208c1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5204162650 0x7f52041603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:02.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5208c1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5204162650 0x7f52041603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37822/0 (socket says 172.21.15.17:37822) 2023-08-09T12:49:02.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5208c1e640 1 -- 172.21.15.17:0/1367610270 learned_addr learned my addr 172.21.15.17:0/1367610270 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:49:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5209c20640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5204164f50 0x7f5204156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f520941f640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52040c1980 0x7f520406c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5208c1e640 1 -- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5204164f50 msgr2=0x7f5204156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5208c1e640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5204164f50 0x7f5204156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5208c1e640 1 -- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52040c1980 msgr2=0x7f520406c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5208c1e640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52040c1980 0x7f520406c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5208c1e640 1 -- 172.21.15.17:0/1367610270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200009400 con 0x7f5204162650 2023-08-09T12:49:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.342+0000 7f5208c1e640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5204162650 0x7f52041603d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f51f400c3a0 tx=0x7f51f400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.343+0000 7f51f9ffb640 1 -- 172.21.15.17:0/1367610270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f40052d0 con 0x7f5204162650 2023-08-09T12:49:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.343+0000 7f51f9ffb640 1 -- 172.21.15.17:0/1367610270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4005450 con 0x7f5204162650 2023-08-09T12:49:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.343+0000 7f51f9ffb640 1 -- 172.21.15.17:0/1367610270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4003880 con 0x7f5204162650 2023-08-09T12:49:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.343+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520406b330 con 0x7f5204162650 2023-08-09T12:49:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.343+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5204160910 con 0x7f5204162650 2023-08-09T12:49:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.344+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520406b850 con 0x7f5204162650 2023-08-09T12:49:02.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.345+0000 7f51f9ffb640 1 -- 172.21.15.17:0/1367610270 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f51f40039e0 con 0x7f5204162650 2023-08-09T12:49:02.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.346+0000 7f51f9ffb640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51e806a080 0x7f51e806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:02.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.346+0000 7f51f9ffb640 1 -- 172.21.15.17:0/1367610270 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51f4087c90 con 0x7f5204162650 2023-08-09T12:49:02.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.347+0000 7f520941f640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51e806a080 0x7f51e806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:02.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.348+0000 7f520941f640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51e806a080 0x7f51e806c540 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5200035000 tx=0x7f5200008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.351+0000 7f51f9ffb640 1 -- 172.21.15.17:0/1367610270 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f520406b850 con 0x7f5204162650 2023-08-09T12:49:02.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.581+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f520406b850 con 0x7f5204162650 2023-08-09T12:49:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.582+0000 7f51f9ffb640 1 -- 172.21.15.17:0/1367610270 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4868 (secure 0 0 0) 0x7f520406b850 con 0x7f5204162650 2023-08-09T12:49:02.585 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:49:02.586 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/734006206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":734006206},{"type":"v1","addr":"172.21.15.142:6835","nonce":734006206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2545254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2545254},{"type":"v1","addr":"172.21.15.142:6837","nonce":2545254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/842290627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":842290627},{"type":"v1","addr":"172.21.15.17:6834","nonce":842290627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:48:46.396953+0000","modified":"2023-08-09T12:48:49.978198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8517":{"gid":8517,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1876401199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1876401199},{"type":"v1","addr":"172.21.15.17:6835","nonce":1876401199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-09T12:49:02.586 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 76 2023-08-09T12:49:02.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.584+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51e806a080 msgr2=0x7f51e806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:02.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51e806a080 0x7f51e806c540 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5200035000 tx=0x7f5200008030 comp rx=0 tx=0).stop 2023-08-09T12:49:02.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5204162650 msgr2=0x7f52041603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5204162650 0x7f52041603d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f51f400c3a0 tx=0x7f51f400c860 comp rx=0 tx=0).stop 2023-08-09T12:49:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 shutdown_connections 2023-08-09T12:49:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f51e806a080 0x7f51e806c540 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5204164f50 0x7f5204156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5204162650 0x7f52041603d0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 --2- 172.21.15.17:0/1367610270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52040c1980 0x7f520406c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 >> 172.21.15.17:0/1367610270 conn(0x7f52040cb1b0 msgr2=0x7f5204163bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:49:02.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 shutdown_connections 2023-08-09T12:49:02.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:02.585+0000 7f520b683640 1 -- 172.21.15.17:0/1367610270 wait complete. 2023-08-09T12:49:02.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-08-09T12:49:02.854 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":8517,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.875369379,"mdsmap_epoch":76,"osdmap_epoch":161,"osdmap_epoch_barrier":161,"uptime":21.902694438000001} 2023-08-09T12:49:02.854 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 8517, "mdsmap_epoch": 76, "osdmap_epoch": 161, "osdmap_epoch_barrier": 161, "rank_uptime": 15.875369379, "state": "up:active", "uptime": 21.902694438, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:49:02.855 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-09T12:49:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.092+0000 7ff012623640 1 Processor -- start 2023-08-09T12:49:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.092+0000 7ff012623640 1 -- start start 2023-08-09T12:49:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.094+0000 7ff012623640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff00c15d000 0x7ff00c160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.094+0000 7ff012623640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c161490 con 0x7ff00c0cc0f0 2023-08-09T12:49:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.094+0000 7ff012623640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c160bf0 con 0x7ff00c0b06b0 2023-08-09T12:49:03.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.094+0000 7ff012623640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00c0c9990 con 0x7ff00c15d000 2023-08-09T12:49:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.094+0000 7ff010e20640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff00c0cc0f0 0x7ff00c0affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41952/0 (socket says 172.21.15.17:41952) 2023-08-09T12:49:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.095+0000 7ff010e20640 1 -- 172.21.15.17:0/1859260573 learned_addr learned my addr 172.21.15.17:0/1859260573 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:49:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.095+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103434890 0 0) 0x7ff00c161490 con 0x7ff00c0cc0f0 2023-08-09T12:49:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.095+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff8003520 con 0x7ff00c0cc0f0 2023-08-09T12:49:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.095+0000 7ff011621640 1 --2- 172.21.15.17:0/1859260573 >> v2:172.21.15.142:3300/0 conn(0x7ff00c15d000 0x7ff00c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.095+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2190344630 0 0) 0x7feff8003520 con 0x7ff00c0cc0f0 2023-08-09T12:49:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.095+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 >> v2:172.21.15.142:3300/0 conn(0x7ff00c15d000 msgr2=0x7ff00c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:49:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 --2- 172.21.15.17:0/1859260573 >> v2:172.21.15.142:3300/0 conn(0x7ff00c15d000 0x7ff00c160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 >> v1:172.21.15.142:6789/0 conn(0x7ff00c0b06b0 legacy=0x7ff00c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c160ed0 con 0x7ff00c0cc0f0 2023-08-09T12:49:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7feffc001670 con 0x7ff00c0cc0f0 2023-08-09T12:49:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 >> v1:172.21.15.17:6789/0 conn(0x7ff00c0cc0f0 legacy=0x7ff00c0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7feff8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff80047c0 0x7feff8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8005180 0x7feff800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0c9990 con 0x7feff8003970 2023-08-09T12:49:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff800c120 con 0x7feff8005180 2023-08-09T12:49:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff800c2e0 con 0x7feff80047c0 2023-08-09T12:49:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.096+0000 7ff011621640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7feff8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.097+0000 7ff011621640 1 -- 172.21.15.17:0/1859260573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff80047c0 msgr2=0x7feff8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:49:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.097+0000 7ff011621640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feff80047c0 0x7feff8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.097+0000 7ff011621640 1 -- 172.21.15.17:0/1859260573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8005180 msgr2=0x7feff800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:49:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.097+0000 7ff011621640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feff8005180 0x7feff800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.097+0000 7ff011621640 1 -- 172.21.15.17:0/1859260573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8003520 con 0x7feff8003970 2023-08-09T12:49:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.097+0000 7ff011e22640 1 -- 172.21.15.17:0/1859260573 reap_dead start 2023-08-09T12:49:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.098+0000 7ff011621640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7feff8003d90 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7ff008009ac0 tx=0x7feff80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450f97e4713d22fd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.098+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00802c710 con 0x7feff8003970 2023-08-09T12:49:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.098+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00802c870 con 0x7feff8003970 2023-08-09T12:49:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.098+0000 7ff003fff640 1 -- 172.21.15.17:0/1859260573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00802cc00 con 0x7feff8003970 2023-08-09T12:49:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.099+0000 7ff012623640 1 -- 172.21.15.17:0/1859260573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 msgr2=0x7feff8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.099+0000 7ff012623640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7feff8003d90 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7ff008009ac0 tx=0x7feff80057f0 comp rx=0 tx=0).stop 2023-08-09T12:49:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.099+0000 7ff012623640 1 -- 172.21.15.17:0/1859260573 shutdown_connections 2023-08-09T12:49:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.099+0000 7ff012623640 1 --2- 172.21.15.17:0/1859260573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7feff8003d90 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.099+0000 7ff012623640 1 -- 172.21.15.17:0/1859260573 >> 172.21.15.17:0/1859260573 conn(0x7ff00c0cafa0 msgr2=0x7ff00c0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:49:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.099+0000 7ff012623640 1 -- 172.21.15.17:0/1859260573 shutdown_connections 2023-08-09T12:49:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.099+0000 7ff012623640 1 -- 172.21.15.17:0/1859260573 wait complete. 2023-08-09T12:49:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.101+0000 7ff012623640 1 Processor -- start 2023-08-09T12:49:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.101+0000 7ff012623640 1 -- start start 2023-08-09T12:49:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff012623640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7ff00c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff012623640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00c0c5ac0 0x7ff00c0701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff012623640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c070730 0x7ff00c0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff012623640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c06fd60 con 0x7feff8003970 2023-08-09T12:49:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff012623640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0c64f0 con 0x7ff00c070730 2023-08-09T12:49:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff012623640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0c67d0 con 0x7ff00c0c5ac0 2023-08-09T12:49:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff011621640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7ff00c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff011621640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7ff00c156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37838/0 (socket says 172.21.15.17:37838) 2023-08-09T12:49:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.102+0000 7ff011621640 1 -- 172.21.15.17:0/2183883167 learned_addr learned my addr 172.21.15.17:0/2183883167 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:49:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff011621640 1 -- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00c0c5ac0 msgr2=0x7ff00c0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff011621640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00c0c5ac0 0x7ff00c0701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff011e22640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c070730 0x7ff00c0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff011621640 1 -- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c070730 msgr2=0x7ff00c0c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff011621640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c070730 0x7ff00c0c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff011621640 1 -- 172.21.15.17:0/2183883167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c0c6ab0 con 0x7feff8003970 2023-08-09T12:49:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff011621640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7ff00c156e70 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7ff008037040 tx=0x7ff008004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff001ffb640 1 -- 172.21.15.17:0/2183883167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008003810 con 0x7feff8003970 2023-08-09T12:49:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff001ffb640 1 -- 172.21.15.17:0/2183883167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008003970 con 0x7feff8003970 2023-08-09T12:49:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff001ffb640 1 -- 172.21.15.17:0/2183883167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008003d20 con 0x7feff8003970 2023-08-09T12:49:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.103+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00c06f9f0 con 0x7feff8003970 2023-08-09T12:49:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.104+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00c0c5f40 con 0x7feff8003970 2023-08-09T12:49:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.105+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00c0c9b80 con 0x7feff8003970 2023-08-09T12:49:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.106+0000 7ff001ffb640 1 -- 172.21.15.17:0/2183883167 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff008034440 con 0x7feff8003970 2023-08-09T12:49:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.107+0000 7ff001ffb640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feff006a050 0x7feff006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:49:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.107+0000 7ff001ffb640 1 -- 172.21.15.17:0/2183883167 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0080aa4f0 con 0x7feff8003970 2023-08-09T12:49:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.108+0000 7ff010e20640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feff006a050 0x7feff006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:49:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.109+0000 7ff010e20640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feff006a050 0x7feff006c510 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feffc000f60 tx=0x7feffc0015b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:49:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.111+0000 7ff001ffb640 1 -- 172.21.15.17:0/2183883167 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff00c0c9b80 con 0x7feff8003970 2023-08-09T12:49:03.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:03.306+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7ff00c0c9b80 con 0x7feff8003970 2023-08-09T12:49:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.076+0000 7ff001ffb640 1 -- 172.21.15.17:0/2183883167 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v162) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff00c0c9b80 con 0x7feff8003970 2023-08-09T12:49:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-09T12:49:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feff006a050 msgr2=0x7feff006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feff006a050 0x7feff006c510 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feffc000f60 tx=0x7feffc0015b0 comp rx=0 tx=0).stop 2023-08-09T12:49:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 msgr2=0x7ff00c156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:49:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7ff00c156e70 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7ff008037040 tx=0x7ff008004730 comp rx=0 tx=0).stop 2023-08-09T12:49:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 shutdown_connections 2023-08-09T12:49:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feff006a050 0x7feff006c510 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c070730 0x7ff00c0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00c0c5ac0 0x7ff00c0701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 --2- 172.21.15.17:0/2183883167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff8003970 0x7ff00c156e70 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:49:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 >> 172.21.15.17:0/2183883167 conn(0x7ff00c0cafa0 msgr2=0x7ff00c0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:49:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.080+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 shutdown_connections 2023-08-09T12:49:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:49:04.081+0000 7ff012623640 1 -- 172.21.15.17:0/2183883167 wait complete. 2023-08-09T12:49:04.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-09T12:49:04.362 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_mon_report_interval":"5"} 2023-08-09T12:49:04.363 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-09T12:49:04.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-08-09T12:49:04.601 INFO:teuthology.orchestra.run.smithi017.stdout:{"mon_tick_interval":"5"} 2023-08-09T12:49:04.602 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-08-09T12:49:04.602 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-08-09T12:49:04.603 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:49:04.604 DEBUG:teuthology.orchestra.run.smithi017:> import time 2023-08-09T12:49:04.605 DEBUG:teuthology.orchestra.run.smithi017:> import datetime 2023-08-09T12:49:04.606 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2023-08-09T12:49:04.607 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:49:04.607 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.608 DEBUG:teuthology.orchestra.run.smithi017:> # Write some buffered data through before going full, all should be well 2023-08-09T12:49:04.609 DEBUG:teuthology.orchestra.run.smithi017:> print("writing some data through which we expect to succeed") 2023-08-09T12:49:04.609 DEBUG:teuthology.orchestra.run.smithi017:> bytes = 0 2023-08-09T12:49:04.610 DEBUG:teuthology.orchestra.run.smithi017:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-08-09T12:49:04.611 DEBUG:teuthology.orchestra.run.smithi017:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-08-09T12:49:04.611 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-08-09T12:49:04.612 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f) 2023-08-09T12:49:04.613 DEBUG:teuthology.orchestra.run.smithi017:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-08-09T12:49:04.613 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.614 DEBUG:teuthology.orchestra.run.smithi017:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-08-09T12:49:04.615 DEBUG:teuthology.orchestra.run.smithi017:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-08-09T12:49:04.616 DEBUG:teuthology.orchestra.run.smithi017:> # buffered IO, the error should always only appear from fsync and not 2023-08-09T12:49:04.616 DEBUG:teuthology.orchestra.run.smithi017:> # from write 2023-08-09T12:49:04.617 DEBUG:teuthology.orchestra.run.smithi017:> full = False 2023-08-09T12:49:04.618 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.618 DEBUG:teuthology.orchestra.run.smithi017:> for n in range(0, int(32 * 0.9)): 2023-08-09T12:49:04.619 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-09T12:49:04.620 DEBUG:teuthology.orchestra.run.smithi017:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-08-09T12:49:04.620 DEBUG:teuthology.orchestra.run.smithi017:> print("done writing {0} bytes".format(bytes)) 2023-08-09T12:49:04.621 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.621 DEBUG:teuthology.orchestra.run.smithi017:> # OK, now we should sneak in under the full condition 2023-08-09T12:49:04.622 DEBUG:teuthology.orchestra.run.smithi017:> # due to the time it takes the OSDs to report to the 2023-08-09T12:49:04.622 DEBUG:teuthology.orchestra.run.smithi017:> # mons, and get a successful fsync on our full-making data 2023-08-09T12:49:04.623 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f) 2023-08-09T12:49:04.624 DEBUG:teuthology.orchestra.run.smithi017:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-08-09T12:49:04.624 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.625 DEBUG:teuthology.orchestra.run.smithi017:> # buffered write, add more dirty data to the buffer 2023-08-09T12:49:04.626 DEBUG:teuthology.orchestra.run.smithi017:> print("starting buffered write") 2023-08-09T12:49:04.626 DEBUG:teuthology.orchestra.run.smithi017:> try: 2023-08-09T12:49:04.626 DEBUG:teuthology.orchestra.run.smithi017:> for n in range(0, int(32 * 0.2)): 2023-08-09T12:49:04.627 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-09T12:49:04.627 DEBUG:teuthology.orchestra.run.smithi017:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-08-09T12:49:04.628 DEBUG:teuthology.orchestra.run.smithi017:> time.sleep(15.0) 2023-08-09T12:49:04.628 DEBUG:teuthology.orchestra.run.smithi017:> except OSError: 2023-08-09T12:49:04.628 DEBUG:teuthology.orchestra.run.smithi017:> pass; 2023-08-09T12:49:04.629 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.629 DEBUG:teuthology.orchestra.run.smithi017:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-08-09T12:49:04.630 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.630 DEBUG:teuthology.orchestra.run.smithi017:> # Wait long enough for a background flush that should fail 2023-08-09T12:49:04.631 DEBUG:teuthology.orchestra.run.smithi017:> time.sleep(30) 2023-08-09T12:49:04.631 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.632 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2023-08-09T12:49:04.632 DEBUG:teuthology.orchestra.run.smithi017:> # ...and check that the failed background flush is reflected in fclose 2023-08-09T12:49:04.633 DEBUG:teuthology.orchestra.run.smithi017:> try: 2023-08-09T12:49:04.633 DEBUG:teuthology.orchestra.run.smithi017:> os.close(f) 2023-08-09T12:49:04.634 DEBUG:teuthology.orchestra.run.smithi017:> except OSError: 2023-08-09T12:49:04.635 DEBUG:teuthology.orchestra.run.smithi017:> print("close() returned an error as expected") 2023-08-09T12:49:04.635 DEBUG:teuthology.orchestra.run.smithi017:> else: 2023-08-09T12:49:04.636 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("close() failed to raise error") 2023-08-09T12:49:04.636 DEBUG:teuthology.orchestra.run.smithi017:> else: 2023-08-09T12:49:04.636 DEBUG:teuthology.orchestra.run.smithi017:> # The kernel cephfs client does not raise errors on fclose 2023-08-09T12:49:04.637 DEBUG:teuthology.orchestra.run.smithi017:> os.close(f) 2023-08-09T12:49:04.637 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:49:04.637 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-08-09T12:49:04.638 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:49:12.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:49:12.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:49:42.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:49:42.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:50:12.570 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:50:12.585 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:50:42.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:50:42.738 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:51:06.257 INFO:teuthology.orchestra.run.smithi017.stdout:writing some data through which we expect to succeed 2023-08-09T12:51:06.258 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-08-09T12:51:06.258 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-08-09T12:51:06.258 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-08-09T12:51:06.259 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-08-09T12:51:06.259 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-08-09T12:51:06.259 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-08-09T12:51:06.260 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-08-09T12:51:06.260 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-08-09T12:51:06.260 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-08-09T12:51:06.260 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-08-09T12:51:06.261 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-08-09T12:51:06.261 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-08-09T12:51:06.261 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-08-09T12:51:06.261 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-08-09T12:51:06.262 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-08-09T12:51:06.262 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-08-09T12:51:06.262 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-08-09T12:51:06.262 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-08-09T12:51:06.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-08-09T12:51:06.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-08-09T12:51:06.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-08-09T12:51:06.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-08-09T12:51:06.263 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-08-09T12:51:06.264 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-08-09T12:51:06.264 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-08-09T12:51:06.264 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-08-09T12:51:06.265 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-08-09T12:51:06.265 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-08-09T12:51:06.265 INFO:teuthology.orchestra.run.smithi017.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-08-09T12:51:06.265 INFO:teuthology.orchestra.run.smithi017.stdout:done writing 29884416 bytes 2023-08-09T12:51:06.265 INFO:teuthology.orchestra.run.smithi017.stdout:successfully fsync'ed prior to getting full state reported 2023-08-09T12:51:06.266 INFO:teuthology.orchestra.run.smithi017.stdout:starting buffered write 2023-08-09T12:51:06.266 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:51:06.266 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:51:06.266 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:51:06.266 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:51:06.266 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:51:06.266 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:51:06.266 INFO:teuthology.orchestra.run.smithi017.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-08-09T12:51:06.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:51:06.290 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:51:06.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:51:06.427 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:51:06.553 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:51:06.553 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:51:06.554 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:06.619 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:51:06.620 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:06.680 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:06.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.909+0000 7fc6a49fd640 1 Processor -- start 2023-08-09T12:51:06.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.910+0000 7fc6a49fd640 1 -- start start 2023-08-09T12:51:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.911+0000 7fc6a49fd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc6a0163c10 0x7fc6a0166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.911+0000 7fc6a49fd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a006c990 con 0x7fc6a00adc40 2023-08-09T12:51:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.911+0000 7fc6a49fd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a00b2250 con 0x7fc6a00b3b40 2023-08-09T12:51:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.911+0000 7fc6a49fd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a00ae020 con 0x7fc6a0163c10 2023-08-09T12:51:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.912+0000 7fc69e59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc6a00adc40 0x7fc6a006c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48166/0 (socket says 172.21.15.17:48166) 2023-08-09T12:51:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.912+0000 7fc69e59c640 1 -- 172.21.15.17:0/493508989 learned_addr learned my addr 172.21.15.17:0/493508989 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:06.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.912+0000 7fc69ed9d640 1 --2- 172.21.15.17:0/493508989 >> v2:172.21.15.17:3300/0 conn(0x7fc6a0163c10 0x7fc6a0166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:06.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.912+0000 7fc69dd9b640 1 -- 172.21.15.17:0/493508989 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403383113 0 0) 0x7fc6a006c990 con 0x7fc6a00adc40 2023-08-09T12:51:06.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.912+0000 7fc69dd9b640 1 -- 172.21.15.17:0/493508989 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc68c003520 con 0x7fc6a00adc40 2023-08-09T12:51:06.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.913+0000 7fc69ed9d640 1 -- 172.21.15.17:0/493508989 >> v1:172.21.15.142:6789/0 conn(0x7fc6a00b3b40 legacy=0x7fc6a00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:06.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.913+0000 7fc69ed9d640 1 -- 172.21.15.17:0/493508989 >> v1:172.21.15.17:6789/0 conn(0x7fc6a00adc40 legacy=0x7fc6a006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:06.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.913+0000 7fc69dd9b640 1 -- 172.21.15.17:0/493508989 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340195207 0 0) 0x7fc68c003520 con 0x7fc6a00adc40 2023-08-09T12:51:06.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.913+0000 7fc69ed9d640 1 -- 172.21.15.17:0/493508989 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a00b2530 con 0x7fc6a0163c10 2023-08-09T12:51:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.914+0000 7fc69ed9d640 1 --2- 172.21.15.17:0/493508989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a0166000 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc698009d90 tx=0x7fc69802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c42e09e645754d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.915+0000 7fc69dd9b640 1 -- 172.21.15.17:0/493508989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690001670 con 0x7fc6a0163c10 2023-08-09T12:51:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.915+0000 7fc69dd9b640 1 -- 172.21.15.17:0/493508989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69802c8b0 con 0x7fc6a0163c10 2023-08-09T12:51:06.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.915+0000 7fc69dd9b640 1 -- 172.21.15.17:0/493508989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69802cc20 con 0x7fc6a0163c10 2023-08-09T12:51:06.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.915+0000 7fc6a49fd640 1 -- 172.21.15.17:0/493508989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 msgr2=0x7fc6a0166000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:06.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.915+0000 7fc6a49fd640 1 --2- 172.21.15.17:0/493508989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a0166000 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc698009d90 tx=0x7fc69802bd80 comp rx=0 tx=0).stop 2023-08-09T12:51:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.916+0000 7fc6a49fd640 1 -- 172.21.15.17:0/493508989 shutdown_connections 2023-08-09T12:51:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.916+0000 7fc6a49fd640 1 --2- 172.21.15.17:0/493508989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a0166000 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.916+0000 7fc6a49fd640 1 -- 172.21.15.17:0/493508989 >> 172.21.15.17:0/493508989 conn(0x7fc6a00cb1b0 msgr2=0x7fc6a00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.916+0000 7fc6a49fd640 1 -- 172.21.15.17:0/493508989 shutdown_connections 2023-08-09T12:51:06.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.916+0000 7fc6a49fd640 1 -- 172.21.15.17:0/493508989 wait complete. 2023-08-09T12:51:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.917+0000 7fc6a49fd640 1 Processor -- start 2023-08-09T12:51:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.917+0000 7fc6a49fd640 1 -- start start 2023-08-09T12:51:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.918+0000 7fc6a49fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6a00adc40 0x7fc6a01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.918+0000 7fc6a49fd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6a00b3b40 0x7fc6a00af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.918+0000 7fc6a49fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a00cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.918+0000 7fc6a49fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a0157370 con 0x7fc6a0163c10 2023-08-09T12:51:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.918+0000 7fc6a49fd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a00afc70 con 0x7fc6a00b3b40 2023-08-09T12:51:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.918+0000 7fc6a49fd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a01567f0 con 0x7fc6a00adc40 2023-08-09T12:51:06.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a00cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:06.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a00cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47330/0 (socket says 172.21.15.17:47330) 2023-08-09T12:51:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69ed9d640 1 -- 172.21.15.17:0/4045611779 learned_addr learned my addr 172.21.15.17:0/4045611779 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69e59c640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6a00adc40 0x7fc6a01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc697fff640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6a00b3b40 0x7fc6a00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69ed9d640 1 -- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6a00adc40 msgr2=0x7fc6a01545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69ed9d640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6a00adc40 0x7fc6a01545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69ed9d640 1 -- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6a00b3b40 msgr2=0x7fc6a00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:06.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69ed9d640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6a00b3b40 0x7fc6a00af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:06.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.919+0000 7fc69ed9d640 1 -- 172.21.15.17:0/4045611779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698009a70 con 0x7fc6a0163c10 2023-08-09T12:51:06.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.920+0000 7fc69ed9d640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a00cd4c0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fc69802c390 tx=0x7fc698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:06.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.920+0000 7fc696ffd640 1 -- 172.21.15.17:0/4045611779 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69802ce80 con 0x7fc6a0163c10 2023-08-09T12:51:06.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.920+0000 7fc696ffd640 1 -- 172.21.15.17:0/4045611779 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698009450 con 0x7fc6a0163c10 2023-08-09T12:51:06.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.920+0000 7fc696ffd640 1 -- 172.21.15.17:0/4045611779 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69803f420 con 0x7fc6a0163c10 2023-08-09T12:51:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.920+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a0156ad0 con 0x7fc6a0163c10 2023-08-09T12:51:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.920+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a0157090 con 0x7fc6a0163c10 2023-08-09T12:51:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.922+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a0154c20 con 0x7fc6a0163c10 2023-08-09T12:51:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.923+0000 7fc696ffd640 1 -- 172.21.15.17:0/4045611779 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc69803f580 con 0x7fc6a0163c10 2023-08-09T12:51:06.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.924+0000 7fc696ffd640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68006a050 0x7fc68006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:06.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.924+0000 7fc696ffd640 1 -- 172.21.15.17:0/4045611779 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6980aadc0 con 0x7fc6a0163c10 2023-08-09T12:51:06.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.924+0000 7fc696ffd640 1 -- 172.21.15.17:0/4045611779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fc6800721a0 con 0x7fc6a0163c10 2023-08-09T12:51:06.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.924+0000 7fc69e59c640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68006a050 0x7fc68006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:06.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.925+0000 7fc69e59c640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68006a050 0x7fc68006c510 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc690005880 tx=0x7fc690009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:06.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:06.928+0000 7fc696ffd640 1 -- 172.21.15.17:0/4045611779 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc698043060 con 0x7fc6a0163c10 2023-08-09T12:51:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.124+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6a0067a80 con 0x7fc6a0163c10 2023-08-09T12:51:07.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.127+0000 7fc696ffd640 1 -- 172.21.15.17:0/4045611779 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+18313 (secure 0 0 0) 0x7fc698039020 con 0x7fc6a0163c10 2023-08-09T12:51:07.131 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:07.131 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":163,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:50:33.896529+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:48:44.746706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-09T12:48:45.418671+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.130+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68006a050 msgr2=0x7fc68006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.130+0000 7fc6a49fd640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68006a050 0x7fc68006c510 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc690005880 tx=0x7fc690009040 comp rx=0 tx=0).stop 2023-08-09T12:51:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.130+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 msgr2=0x7fc6a00cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.130+0000 7fc6a49fd640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a00cd4c0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fc69802c390 tx=0x7fc698004a40 comp rx=0 tx=0).stop 2023-08-09T12:51:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.131+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 shutdown_connections 2023-08-09T12:51:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.131+0000 7fc6a49fd640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68006a050 0x7fc68006c510 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.131+0000 7fc6a49fd640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6a0163c10 0x7fc6a00cd4c0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.131+0000 7fc6a49fd640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6a00b3b40 0x7fc6a00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.131+0000 7fc6a49fd640 1 --2- 172.21.15.17:0/4045611779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6a00adc40 0x7fc6a01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.131+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 >> 172.21.15.17:0/4045611779 conn(0x7fc6a00cb1b0 msgr2=0x7fc6a00c21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.131+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 shutdown_connections 2023-08-09T12:51:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.131+0000 7fc6a49fd640 1 -- 172.21.15.17:0/4045611779 wait complete. 2023-08-09T12:51:07.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:48:44.746706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:48:45.418671+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:51:07.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:51:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.381+0000 7f9607122640 1 Processor -- start 2023-08-09T12:51:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.382+0000 7f9607122640 1 -- start start 2023-08-09T12:51:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.383+0000 7f9607122640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f960015cd60 0x7f96000d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.383+0000 7f9607122640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000b5ae0 con 0x7f96000d2490 2023-08-09T12:51:07.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.383+0000 7f9607122640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000d1970 con 0x7f96000d0960 2023-08-09T12:51:07.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.383+0000 7f9607122640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96000d10d0 con 0x7f960015cd60 2023-08-09T12:51:07.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.384+0000 7f9606120640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f960015cd60 0x7f96000d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.384+0000 7f9606120640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f960015cd60 0x7f96000d31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47340/0 (socket says 172.21.15.17:47340) 2023-08-09T12:51:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.384+0000 7f9606120640 1 -- 172.21.15.17:0/1437725654 learned_addr learned my addr 172.21.15.17:0/1437725654 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.384+0000 7f9606120640 1 -- 172.21.15.17:0/1437725654 >> v1:172.21.15.142:6789/0 conn(0x7f96000d0960 legacy=0x7f96000d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.384+0000 7f9606120640 1 -- 172.21.15.17:0/1437725654 >> v1:172.21.15.17:6789/0 conn(0x7f96000d2490 legacy=0x7f96000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.384+0000 7f9606120640 1 -- 172.21.15.17:0/1437725654 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000d13b0 con 0x7f960015cd60 2023-08-09T12:51:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.385+0000 7f9606120640 1 --2- 172.21.15.17:0/1437725654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f960015cd60 0x7f96000d31c0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009870 tx=0x7f95fc02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a413c5548bb3fd6b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.386+0000 7f960511e640 1 -- 172.21.15.17:0/1437725654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc02f850 con 0x7f960015cd60 2023-08-09T12:51:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.386+0000 7f960511e640 1 -- 172.21.15.17:0/1437725654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc02f9b0 con 0x7f960015cd60 2023-08-09T12:51:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.386+0000 7f960511e640 1 -- 172.21.15.17:0/1437725654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc02fd40 con 0x7f960015cd60 2023-08-09T12:51:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.386+0000 7f9607122640 1 -- 172.21.15.17:0/1437725654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f960015cd60 msgr2=0x7f96000d31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.386+0000 7f9607122640 1 --2- 172.21.15.17:0/1437725654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f960015cd60 0x7f96000d31c0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009870 tx=0x7f95fc02ba30 comp rx=0 tx=0).stop 2023-08-09T12:51:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.387+0000 7f9607122640 1 -- 172.21.15.17:0/1437725654 shutdown_connections 2023-08-09T12:51:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.387+0000 7f9607122640 1 --2- 172.21.15.17:0/1437725654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f960015cd60 0x7f96000d31c0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.387+0000 7f9607122640 1 -- 172.21.15.17:0/1437725654 >> 172.21.15.17:0/1437725654 conn(0x7f96000697c0 msgr2=0x7f9600069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.387+0000 7f9607122640 1 -- 172.21.15.17:0/1437725654 shutdown_connections 2023-08-09T12:51:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.387+0000 7f9607122640 1 -- 172.21.15.17:0/1437725654 wait complete. 2023-08-09T12:51:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.388+0000 7f9607122640 1 Processor -- start 2023-08-09T12:51:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.389+0000 7f9607122640 1 -- start start 2023-08-09T12:51:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f9607122640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96000d0960 0x7f9600155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f9607122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96000d2490 0x7f96000c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f9607122640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f960015cd60 0x7f96001567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f9607122640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96001597c0 con 0x7f96000d2490 2023-08-09T12:51:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f9607122640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960015e030 con 0x7f96000d0960 2023-08-09T12:51:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f9607122640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96001562c0 con 0x7f960015cd60 2023-08-09T12:51:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f960591f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96000d2490 0x7f96000c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f960591f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96000d2490 0x7f96000c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47348/0 (socket says 172.21.15.17:47348) 2023-08-09T12:51:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f960591f640 1 -- 172.21.15.17:0/1518434832 learned_addr learned my addr 172.21.15.17:0/1518434832 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f9606120640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96000d0960 0x7f9600155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.390+0000 7f9606921640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f960015cd60 0x7f96001567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f960591f640 1 -- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f960015cd60 msgr2=0x7f96001567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f960591f640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f960015cd60 0x7f96001567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f960591f640 1 -- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96000d0960 msgr2=0x7f9600155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f960591f640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96000d0960 0x7f9600155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f960591f640 1 -- 172.21.15.17:0/1518434832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0094d0 con 0x7f96000d2490 2023-08-09T12:51:07.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f9606120640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96000d0960 0x7f9600155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:07.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f960591f640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96000d2490 0x7f96000c87f0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c410 tx=0x7f95f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:07.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f95f6ffd640 1 -- 172.21.15.17:0/1518434832 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00035f0 con 0x7f96000d2490 2023-08-09T12:51:07.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f95f6ffd640 1 -- 172.21.15.17:0/1518434832 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0003750 con 0x7f96000d2490 2023-08-09T12:51:07.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f95f6ffd640 1 -- 172.21.15.17:0/1518434832 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0003b40 con 0x7f96000d2490 2023-08-09T12:51:07.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.391+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960015d140 con 0x7f96000d2490 2023-08-09T12:51:07.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.392+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960015d700 con 0x7f96000d2490 2023-08-09T12:51:07.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.393+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960015e1a0 con 0x7f96000d2490 2023-08-09T12:51:07.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.394+0000 7f95f6ffd640 1 -- 172.21.15.17:0/1518434832 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f95f0003ca0 con 0x7f96000d2490 2023-08-09T12:51:07.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.395+0000 7f95f6ffd640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f95e406a080 0x7f95e406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.395+0000 7f95f6ffd640 1 -- 172.21.15.17:0/1518434832 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95f0087840 con 0x7f96000d2490 2023-08-09T12:51:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.396+0000 7f95f6ffd640 1 -- 172.21.15.17:0/1518434832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f95e40721d0 con 0x7f96000d2490 2023-08-09T12:51:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.396+0000 7f9606120640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f95e406a080 0x7f95e406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.397+0000 7f9606120640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f95e406a080 0x7f95e406c540 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f95fc036000 tx=0x7f95fc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.400+0000 7f95f6ffd640 1 -- 172.21.15.17:0/1518434832 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f95f0052e90 con 0x7f96000d2490 2023-08-09T12:51:07.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.599+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f960004e390 con 0x7f96000d2490 2023-08-09T12:51:07.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.600+0000 7f95f6ffd640 1 -- 172.21.15.17:0/1518434832 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95f00170a0 con 0x7f96000d2490 2023-08-09T12:51:07.604 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:51:07.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f95e406a080 msgr2=0x7f95e406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f95e406a080 0x7f95e406c540 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f95fc036000 tx=0x7f95fc008030 comp rx=0 tx=0).stop 2023-08-09T12:51:07.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96000d2490 msgr2=0x7f96000c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96000d2490 0x7f96000c87f0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c410 tx=0x7f95f000c8d0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 shutdown_connections 2023-08-09T12:51:07.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f95e406a080 0x7f95e406c540 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f960015cd60 0x7f96001567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96000d2490 0x7f96000c87f0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 --2- 172.21.15.17:0/1518434832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96000d0960 0x7f9600155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 >> 172.21.15.17:0/1518434832 conn(0x7f96000697c0 msgr2=0x7f96000d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:07.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 shutdown_connections 2023-08-09T12:51:07.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.603+0000 7f9607122640 1 -- 172.21.15.17:0/1518434832 wait complete. 2023-08-09T12:51:07.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:51:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.857+0000 7fa61b59e640 1 Processor -- start 2023-08-09T12:51:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.857+0000 7fa61b59e640 1 -- start start 2023-08-09T12:51:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.858+0000 7fa61b59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa61c0b8420 0x7fa61c0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.858+0000 7fa61b59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c0d0f00 con 0x7fa61c15cf20 2023-08-09T12:51:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.858+0000 7fa61b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c1611f0 con 0x7fa61c15cb40 2023-08-09T12:51:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.858+0000 7fa61b59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c1614d0 con 0x7fa61c0b8420 2023-08-09T12:51:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.859+0000 7fa61ad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa61c15cf20 0x7fa61c0d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48174/0 (socket says 172.21.15.17:48174) 2023-08-09T12:51:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.859+0000 7fa61ad9d640 1 -- 172.21.15.17:0/3278002448 learned_addr learned my addr 172.21.15.17:0/3278002448 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.859+0000 7fa619d9b640 1 --2- 172.21.15.17:0/3278002448 >> v2:172.21.15.17:3300/0 conn(0x7fa61c0b8420 0x7fa61c0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.860+0000 7fa61959a640 1 -- 172.21.15.17:0/3278002448 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578006012 0 0) 0x7fa61c0d0f00 con 0x7fa61c15cf20 2023-08-09T12:51:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.860+0000 7fa61959a640 1 -- 172.21.15.17:0/3278002448 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa608003520 con 0x7fa61c15cf20 2023-08-09T12:51:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.860+0000 7fa619d9b640 1 -- 172.21.15.17:0/3278002448 >> v1:172.21.15.142:6789/0 conn(0x7fa61c15cb40 legacy=0x7fa61c1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.860+0000 7fa61959a640 1 -- 172.21.15.17:0/3278002448 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802638601 0 0) 0x7fa61c1611f0 con 0x7fa61c15cb40 2023-08-09T12:51:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.860+0000 7fa619d9b640 1 -- 172.21.15.17:0/3278002448 >> v1:172.21.15.17:6789/0 conn(0x7fa61c15cf20 legacy=0x7fa61c0d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.860+0000 7fa619d9b640 1 -- 172.21.15.17:0/3278002448 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c1617b0 con 0x7fa61c0b8420 2023-08-09T12:51:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.862+0000 7fa619d9b640 1 --2- 172.21.15.17:0/3278002448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c0b8420 0x7fa61c0cd860 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fa6040097a0 tx=0x7fa60402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed260643026d003 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.862+0000 7fa61959a640 1 -- 172.21.15.17:0/3278002448 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60402f810 con 0x7fa61c0b8420 2023-08-09T12:51:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.862+0000 7fa61959a640 1 -- 172.21.15.17:0/3278002448 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60402f970 con 0x7fa61c0b8420 2023-08-09T12:51:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.862+0000 7fa61959a640 1 -- 172.21.15.17:0/3278002448 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60402fce0 con 0x7fa61c0b8420 2023-08-09T12:51:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.863+0000 7fa61b59e640 1 -- 172.21.15.17:0/3278002448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c0b8420 msgr2=0x7fa61c0cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.863+0000 7fa61b59e640 1 --2- 172.21.15.17:0/3278002448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c0b8420 0x7fa61c0cd860 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fa6040097a0 tx=0x7fa60402b9f0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.863+0000 7fa61b59e640 1 -- 172.21.15.17:0/3278002448 shutdown_connections 2023-08-09T12:51:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.863+0000 7fa61b59e640 1 --2- 172.21.15.17:0/3278002448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c0b8420 0x7fa61c0cd860 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.863+0000 7fa61b59e640 1 -- 172.21.15.17:0/3278002448 >> 172.21.15.17:0/3278002448 conn(0x7fa61c0d2ab0 msgr2=0x7fa61c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.863+0000 7fa61b59e640 1 -- 172.21.15.17:0/3278002448 shutdown_connections 2023-08-09T12:51:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.863+0000 7fa61b59e640 1 -- 172.21.15.17:0/3278002448 wait complete. 2023-08-09T12:51:07.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.865+0000 7fa61b59e640 1 Processor -- start 2023-08-09T12:51:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.866+0000 7fa61b59e640 1 -- start start 2023-08-09T12:51:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa61c0b8420 0x7fa61c1490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa61c15cb40 0x7fa61c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c15cf20 0x7fa61c1f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1f6320 con 0x7fa61c15cf20 2023-08-09T12:51:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1485e0 con 0x7fa61c15cb40 2023-08-09T12:51:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1488c0 con 0x7fa61c0b8420 2023-08-09T12:51:07.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c15cf20 0x7fa61c1f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c15cf20 0x7fa61c1f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47366/0 (socket says 172.21.15.17:47366) 2023-08-09T12:51:07.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61ad9d640 1 -- 172.21.15.17:0/3410011622 learned_addr learned my addr 172.21.15.17:0/3410011622 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:07.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa619d9b640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa61c15cb40 0x7fa61c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61a59c640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa61c0b8420 0x7fa61c1490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.867+0000 7fa61ad9d640 1 -- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa61c0b8420 msgr2=0x7fa61c1490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa61ad9d640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa61c0b8420 0x7fa61c1490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa61ad9d640 1 -- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa61c15cb40 msgr2=0x7fa61c0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa61ad9d640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa61c15cb40 0x7fa61c0b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa61ad9d640 1 -- 172.21.15.17:0/3410011622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa604009400 con 0x7fa61c15cf20 2023-08-09T12:51:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa61a59c640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa61c0b8420 0x7fa61c1490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa61ad9d640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c15cf20 0x7fa61c1f57b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa61400caa0 tx=0x7fa61400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa612ffd640 1 -- 172.21.15.17:0/3410011622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400ac00 con 0x7fa61c15cf20 2023-08-09T12:51:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa612ffd640 1 -- 172.21.15.17:0/3410011622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61400ad60 con 0x7fa61c15cf20 2023-08-09T12:51:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa612ffd640 1 -- 172.21.15.17:0/3410011622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614012620 con 0x7fa61c15cf20 2023-08-09T12:51:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c148ba0 con 0x7fa61c15cf20 2023-08-09T12:51:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.868+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c1f6600 con 0x7fa61c15cf20 2023-08-09T12:51:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.870+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c148d90 con 0x7fa61c15cf20 2023-08-09T12:51:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.871+0000 7fa612ffd640 1 -- 172.21.15.17:0/3410011622 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa614007070 con 0x7fa61c15cf20 2023-08-09T12:51:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.872+0000 7fa612ffd640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5fc06a050 0x7fa5fc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.872+0000 7fa612ffd640 1 -- 172.21.15.17:0/3410011622 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6140885d0 con 0x7fa61c15cf20 2023-08-09T12:51:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.872+0000 7fa612ffd640 1 -- 172.21.15.17:0/3410011622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fa5fc0721a0 con 0x7fa61c15cf20 2023-08-09T12:51:07.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.872+0000 7fa61a59c640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5fc06a050 0x7fa5fc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:07.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.873+0000 7fa61a59c640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5fc06a050 0x7fa5fc06c510 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa60c000f60 tx=0x7fa60c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:07.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:07.876+0000 7fa612ffd640 1 -- 172.21.15.17:0/3410011622 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa614053c20 con 0x7fa61c15cf20 2023-08-09T12:51:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.071+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa61c04e390 con 0x7fa61c15cf20 2023-08-09T12:51:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.072+0000 7fa612ffd640 1 -- 172.21.15.17:0/3410011622 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa614017020 con 0x7fa61c15cf20 2023-08-09T12:51:08.075 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:51:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.074+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5fc06a050 msgr2=0x7fa5fc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.074+0000 7fa61b59e640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5fc06a050 0x7fa5fc06c510 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa60c000f60 tx=0x7fa60c009040 comp rx=0 tx=0).stop 2023-08-09T12:51:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.074+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c15cf20 msgr2=0x7fa61c1f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.074+0000 7fa61b59e640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c15cf20 0x7fa61c1f57b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa61400caa0 tx=0x7fa61400cf60 comp rx=0 tx=0).stop 2023-08-09T12:51:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.075+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 shutdown_connections 2023-08-09T12:51:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.075+0000 7fa61b59e640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa5fc06a050 0x7fa5fc06c510 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.075+0000 7fa61b59e640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c15cf20 0x7fa61c1f57b0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.075+0000 7fa61b59e640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa61c15cb40 0x7fa61c0b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.075+0000 7fa61b59e640 1 --2- 172.21.15.17:0/3410011622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa61c0b8420 0x7fa61c1490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.075+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 >> 172.21.15.17:0/3410011622 conn(0x7fa61c0d2ab0 msgr2=0x7fa61c1580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.075+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 shutdown_connections 2023-08-09T12:51:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.075+0000 7fa61b59e640 1 -- 172.21.15.17:0/3410011622 wait complete. 2023-08-09T12:51:08.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:51:08.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.334+0000 7fa008fb5640 1 Processor -- start 2023-08-09T12:51:08.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.334+0000 7fa008fb5640 1 -- start start 2023-08-09T12:51:08.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.336+0000 7fa008fb5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0040cf0f0 0x7fa0040c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.336+0000 7fa008fb5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00406bbb0 con 0x7fa004165710 2023-08-09T12:51:08.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.336+0000 7fa008fb5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa004164cc0 con 0x7fa004161130 2023-08-09T12:51:08.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.336+0000 7fa008fb5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b02d0 con 0x7fa0040cf0f0 2023-08-09T12:51:08.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.336+0000 7fa001d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa004165710 0x7fa0040ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52356/0 (socket says 172.21.15.17:52356) 2023-08-09T12:51:08.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.336+0000 7fa001d9b640 1 -- 172.21.15.17:0/751178483 learned_addr learned my addr 172.21.15.17:0/751178483 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:08.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa002d9d640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0040cf0f0 0x7fa0040c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142202119 0 0) 0x7fa00406bbb0 con 0x7fa004165710 2023-08-09T12:51:08.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fec003520 con 0x7fa004165710 2023-08-09T12:51:08.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1312704675 0 0) 0x7f9fec003520 con 0x7fa004165710 2023-08-09T12:51:08.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0040cf0f0 msgr2=0x7fa0040c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:08.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0040cf0f0 0x7fa0040c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 >> v1:172.21.15.142:6789/0 conn(0x7fa004161130 legacy=0x7fa0040afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa004161510 con 0x7fa004165710 2023-08-09T12:51:08.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f9ff8001670 con 0x7fa004165710 2023-08-09T12:51:08.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 >> v1:172.21.15.17:6789/0 conn(0x7fa004165710 legacy=0x7fa0040ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.337+0000 7fa00159a640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec0039a0 0x7f9fec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa00159a640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0040cf0f0 0x7f9fec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa00159a640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fec004d00 0x7f9fec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040b02d0 con 0x7f9fec004d00 2023-08-09T12:51:08.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec00bb10 con 0x7f9fec0039a0 2023-08-09T12:51:08.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec00bcd0 con 0x7fa0040cf0f0 2023-08-09T12:51:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa002d9d640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fec004d00 0x7f9fec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa00259c640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec0039a0 0x7f9fec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa001d9b640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0040cf0f0 0x7f9fec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa002d9d640 1 -- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0040cf0f0 msgr2=0x7f9fec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa002d9d640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0040cf0f0 0x7f9fec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa002d9d640 1 -- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec0039a0 msgr2=0x7f9fec003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa002d9d640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec0039a0 0x7f9fec003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.338+0000 7fa002d9d640 1 -- 172.21.15.17:0/751178483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec003520 con 0x7f9fec004d00 2023-08-09T12:51:08.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.340+0000 7fa002d9d640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fec004d00 0x7f9fec005180 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009fc0 tx=0x7f9fec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68528ce065f54da6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:08.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.340+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc02cc20 con 0x7f9fec004d00 2023-08-09T12:51:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.340+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc00f040 con 0x7f9fec004d00 2023-08-09T12:51:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.340+0000 7fa00159a640 1 -- 172.21.15.17:0/751178483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc034440 con 0x7f9fec004d00 2023-08-09T12:51:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.340+0000 7fa008fb5640 1 -- 172.21.15.17:0/751178483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fec004d00 msgr2=0x7f9fec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.340+0000 7fa008fb5640 1 --2- 172.21.15.17:0/751178483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fec004d00 0x7f9fec005180 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009fc0 tx=0x7f9fec0057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.340+0000 7fa002d9d640 1 -- 172.21.15.17:0/751178483 reap_dead start 2023-08-09T12:51:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.341+0000 7fa008fb5640 1 -- 172.21.15.17:0/751178483 shutdown_connections 2023-08-09T12:51:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.341+0000 7fa008fb5640 1 -- 172.21.15.17:0/751178483 >> 172.21.15.17:0/751178483 conn(0x7fa004069be0 msgr2=0x7fa004069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:08.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.341+0000 7fa008fb5640 1 -- 172.21.15.17:0/751178483 shutdown_connections 2023-08-09T12:51:08.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.341+0000 7fa008fb5640 1 -- 172.21.15.17:0/751178483 wait complete. 2023-08-09T12:51:08.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.343+0000 7fa008fb5640 1 Processor -- start 2023-08-09T12:51:08.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.343+0000 7fa008fb5640 1 -- start start 2023-08-09T12:51:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa008fb5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec004d00 0x7fa0041f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa008fb5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa004164150 0x7fa0040cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa008fb5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0041f3c00 0x7fa0041f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa008fb5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040ce160 con 0x7fa004164150 2023-08-09T12:51:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa008fb5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041645b0 con 0x7f9fec004d00 2023-08-09T12:51:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa008fb5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040cce60 con 0x7fa0041f3c00 2023-08-09T12:51:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa001d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa004164150 0x7fa0040cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa001d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa004164150 0x7fa0040cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53230/0 (socket says 172.21.15.17:53230) 2023-08-09T12:51:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa001d9b640 1 -- 172.21.15.17:0/1970500862 learned_addr learned my addr 172.21.15.17:0/1970500862 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa00259c640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec004d00 0x7fa0041f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa002d9d640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0041f3c00 0x7fa0041f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa001d9b640 1 -- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0041f3c00 msgr2=0x7fa0041f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.344+0000 7fa001d9b640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0041f3c00 0x7fa0041f9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7fa001d9b640 1 -- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec004d00 msgr2=0x7fa0041f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7fa001d9b640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec004d00 0x7fa0041f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7fa001d9b640 1 -- 172.21.15.17:0/1970500862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040cd140 con 0x7fa004164150 2023-08-09T12:51:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7fa00259c640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec004d00 0x7fa0041f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7fa001d9b640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa004164150 0x7fa0040cdc20 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800e7f0 tx=0x7f9ff800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7f9ff2ffd640 1 -- 172.21.15.17:0/1970500862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800eea0 con 0x7fa004164150 2023-08-09T12:51:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7f9ff2ffd640 1 -- 172.21.15.17:0/1970500862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800c870 con 0x7fa004164150 2023-08-09T12:51:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7f9ff2ffd640 1 -- 172.21.15.17:0/1970500862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800cc00 con 0x7fa004164150 2023-08-09T12:51:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0040cd420 con 0x7fa004164150 2023-08-09T12:51:08.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.345+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0040ccaa0 con 0x7fa004164150 2023-08-09T12:51:08.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.347+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0040cd940 con 0x7fa004164150 2023-08-09T12:51:08.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.348+0000 7f9ff2ffd640 1 -- 172.21.15.17:0/1970500862 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ff8013420 con 0x7fa004164150 2023-08-09T12:51:08.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.349+0000 7f9ff2ffd640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9fe406a080 0x7f9fe406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.349+0000 7f9ff2ffd640 1 -- 172.21.15.17:0/1970500862 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ff8088300 con 0x7fa004164150 2023-08-09T12:51:08.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.349+0000 7f9ff2ffd640 1 -- 172.21.15.17:0/1970500862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f9fe40721c0 con 0x7fa004164150 2023-08-09T12:51:08.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.349+0000 7fa00259c640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9fe406a080 0x7f9fe406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.351+0000 7fa00259c640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9fe406a080 0x7f9fe406c540 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40016b0 tx=0x7f9ff4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:08.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.353+0000 7f9ff2ffd640 1 -- 172.21.15.17:0/1970500862 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa0040cd940 con 0x7fa004164150 2023-08-09T12:51:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.546+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0040ccc30 con 0x7fa004164150 2023-08-09T12:51:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.547+0000 7f9ff2ffd640 1 -- 172.21.15.17:0/1970500862 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ff8053950 con 0x7fa004164150 2023-08-09T12:51:08.551 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:51:08.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9fe406a080 msgr2=0x7f9fe406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9fe406a080 0x7f9fe406c540 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40016b0 tx=0x7f9ff4009040 comp rx=0 tx=0).stop 2023-08-09T12:51:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa004164150 msgr2=0x7fa0040cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa004164150 0x7fa0040cdc20 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800e7f0 tx=0x7f9ff800ecb0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 shutdown_connections 2023-08-09T12:51:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9fe406a080 0x7f9fe406c540 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0041f3c00 0x7fa0041f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa004164150 0x7fa0040cdc20 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 --2- 172.21.15.17:0/1970500862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fec004d00 0x7fa0041f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 >> 172.21.15.17:0/1970500862 conn(0x7fa004069be0 msgr2=0x7fa004160120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 shutdown_connections 2023-08-09T12:51:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.550+0000 7fa008fb5640 1 -- 172.21.15.17:0/1970500862 wait complete. 2023-08-09T12:51:08.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:51:08.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.806+0000 7f79b0c2f640 1 Processor -- start 2023-08-09T12:51:08.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.806+0000 7f79b0c2f640 1 -- start start 2023-08-09T12:51:08.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.807+0000 7f79b0c2f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79ac15ce90 0x7f79ac1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79b0c2f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79ac0d29d0 0x7f79ac0d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79b0c2f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac0d3360 con 0x7f79ac0b6000 2023-08-09T12:51:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79b0c2f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0b6460 con 0x7f79ac0d29d0 2023-08-09T12:51:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79b0c2f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0cdd10 con 0x7f79ac15ce90 2023-08-09T12:51:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79aad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79ac0d29d0 0x7f79ac0d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79aad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79ac0d29d0 0x7f79ac0d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53238/0 (socket says 172.21.15.17:53238) 2023-08-09T12:51:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79aad9d640 1 -- 172.21.15.17:0/869924383 learned_addr learned my addr 172.21.15.17:0/869924383 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79aa59c640 1 --2- 172.21.15.17:0/869924383 >> v2:172.21.15.142:3300/0 conn(0x7f79ac15ce90 0x7f79ac1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79aad9d640 1 -- 172.21.15.17:0/869924383 >> v2:172.21.15.142:3300/0 conn(0x7f79ac15ce90 msgr2=0x7f79ac1616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.808+0000 7f79aad9d640 1 --2- 172.21.15.17:0/869924383 >> v2:172.21.15.142:3300/0 conn(0x7f79ac15ce90 0x7f79ac1616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.809+0000 7f79aad9d640 1 -- 172.21.15.17:0/869924383 >> v1:172.21.15.17:6789/0 conn(0x7f79ac0b6000 legacy=0x7f79ac0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.809+0000 7f79aad9d640 1 -- 172.21.15.17:0/869924383 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0cdff0 con 0x7f79ac0d29d0 2023-08-09T12:51:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.809+0000 7f79a959a640 1 -- 172.21.15.17:0/869924383 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940900384 0 0) 0x7f7994001110 con 0x7f79ac0b6000 2023-08-09T12:51:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.810+0000 7f79aad9d640 1 --2- 172.21.15.17:0/869924383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0d29d0 0x7f79ac0d2e20 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0d0690 tx=0x7f79a402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedff647c7c7e063 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.810+0000 7f79a959a640 1 -- 172.21.15.17:0/869924383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4030860 con 0x7f79ac0d29d0 2023-08-09T12:51:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.810+0000 7f79a959a640 1 -- 172.21.15.17:0/869924383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a40309c0 con 0x7f79ac0d29d0 2023-08-09T12:51:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.810+0000 7f79a959a640 1 -- 172.21.15.17:0/869924383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4030d50 con 0x7f79ac0d29d0 2023-08-09T12:51:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.810+0000 7f79b0c2f640 1 -- 172.21.15.17:0/869924383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0d29d0 msgr2=0x7f79ac0d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.811+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/869924383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0d29d0 0x7f79ac0d2e20 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0d0690 tx=0x7f79a402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.811+0000 7f79b0c2f640 1 -- 172.21.15.17:0/869924383 shutdown_connections 2023-08-09T12:51:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.811+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/869924383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0d29d0 0x7f79ac0d2e20 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.811+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/869924383 >> v2:172.21.15.142:3300/0 conn(0x7f79ac15ce90 0x7f79ac1616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.811+0000 7f79b0c2f640 1 -- 172.21.15.17:0/869924383 >> 172.21.15.17:0/869924383 conn(0x7f79ac06fde0 msgr2=0x7f79ac0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.811+0000 7f79b0c2f640 1 -- 172.21.15.17:0/869924383 shutdown_connections 2023-08-09T12:51:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.811+0000 7f79b0c2f640 1 -- 172.21.15.17:0/869924383 wait complete. 2023-08-09T12:51:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.813+0000 7f79b0c2f640 1 Processor -- start 2023-08-09T12:51:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.813+0000 7f79b0c2f640 1 -- start start 2023-08-09T12:51:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79b0c2f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79ac0b6000 0x7f79ac15fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79b0c2f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79ac0d29d0 0x7f79ac1e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79b0c2f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac15ce90 0x7f79ac1e7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79b0c2f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac15c450 con 0x7f79ac15ce90 2023-08-09T12:51:08.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79b0c2f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac148a50 con 0x7f79ac0b6000 2023-08-09T12:51:08.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79b0c2f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac1e7e50 con 0x7f79ac0d29d0 2023-08-09T12:51:08.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79aad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac15ce90 0x7f79ac1e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79aad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac15ce90 0x7f79ac1e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53240/0 (socket says 172.21.15.17:53240) 2023-08-09T12:51:08.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79aad9d640 1 -- 172.21.15.17:0/1781669491 learned_addr learned my addr 172.21.15.17:0/1781669491 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:08.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.814+0000 7f79aad9d640 1 -- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79ac0d29d0 msgr2=0x7f79ac1e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79aad9d640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79ac0d29d0 0x7f79ac1e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79aad9d640 1 -- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79ac0b6000 msgr2=0x7f79ac15fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:08.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79aad9d640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79ac0b6000 0x7f79ac15fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:08.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79aad9d640 1 -- 172.21.15.17:0/1781669491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40094d0 con 0x7f79ac15ce90 2023-08-09T12:51:08.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79aad9d640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac15ce90 0x7f79ac1e7780 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f79a40090b0 tx=0x7f79a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:08.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79a2ffd640 1 -- 172.21.15.17:0/1781669491 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4039c90 con 0x7f79ac15ce90 2023-08-09T12:51:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79a2ffd640 1 -- 172.21.15.17:0/1781669491 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a4039df0 con 0x7f79ac15ce90 2023-08-09T12:51:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac1e8130 con 0x7f79ac15ce90 2023-08-09T12:51:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79a2ffd640 1 -- 172.21.15.17:0/1781669491 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4043640 con 0x7f79ac15ce90 2023-08-09T12:51:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.815+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac148f80 con 0x7f79ac15ce90 2023-08-09T12:51:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.817+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac067a80 con 0x7f79ac15ce90 2023-08-09T12:51:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.818+0000 7f79a2ffd640 1 -- 172.21.15.17:0/1781669491 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79a40437a0 con 0x7f79ac15ce90 2023-08-09T12:51:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.819+0000 7f79a2ffd640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f798c06a050 0x7f798c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.819+0000 7f79a2ffd640 1 -- 172.21.15.17:0/1781669491 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79a403e070 con 0x7f79ac15ce90 2023-08-09T12:51:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.819+0000 7f79a2ffd640 1 -- 172.21.15.17:0/1781669491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f798c0721a0 con 0x7f79ac15ce90 2023-08-09T12:51:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.820+0000 7f79aa59c640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f798c06a050 0x7f798c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.821+0000 7f79aa59c640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f798c06a050 0x7f798c06c510 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f799c0070b0 tx=0x7f799c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:08.823+0000 7f79a2ffd640 1 -- 172.21.15.17:0/1781669491 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f79a4034060 con 0x7f79ac15ce90 2023-08-09T12:51:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.018+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79ac0d0ad0 con 0x7f79ac15ce90 2023-08-09T12:51:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.018+0000 7f79a2ffd640 1 -- 172.21.15.17:0/1781669491 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79a4034030 con 0x7f79ac15ce90 2023-08-09T12:51:09.022 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:51:09.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f798c06a050 msgr2=0x7f798c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:09.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f798c06a050 0x7f798c06c510 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f799c0070b0 tx=0x7f799c007040 comp rx=0 tx=0).stop 2023-08-09T12:51:09.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac15ce90 msgr2=0x7f79ac1e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:09.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac15ce90 0x7f79ac1e7780 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f79a40090b0 tx=0x7f79a4004730 comp rx=0 tx=0).stop 2023-08-09T12:51:09.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 shutdown_connections 2023-08-09T12:51:09.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f798c06a050 0x7f798c06c510 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac15ce90 0x7f79ac1e7780 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79ac0d29d0 0x7f79ac1e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 --2- 172.21.15.17:0/1781669491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79ac0b6000 0x7f79ac15fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 >> 172.21.15.17:0/1781669491 conn(0x7f79ac06fde0 msgr2=0x7f79ac0b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:09.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.021+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 shutdown_connections 2023-08-09T12:51:09.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.022+0000 7f79b0c2f640 1 -- 172.21.15.17:0/1781669491 wait complete. 2023-08-09T12:51:09.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:51:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.255+0000 7f26810cf640 1 Processor -- start 2023-08-09T12:51:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.255+0000 7f26810cf640 1 -- start start 2023-08-09T12:51:09.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.256+0000 7f26810cf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f267c1587e0 0x7f267c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:09.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.256+0000 7f26810cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f267c0cb070 0x7f267c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:09.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.256+0000 7f26810cf640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c0cb9e0 con 0x7f267c0b0b10 2023-08-09T12:51:09.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f26810cf640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c15beb0 con 0x7f267c1587e0 2023-08-09T12:51:09.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f26810cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c0715c0 con 0x7f267c0cb070 2023-08-09T12:51:09.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f267bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f267c1587e0 0x7f267c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:09.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f267bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f267c1587e0 0x7f267c070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53246/0 (socket says 172.21.15.17:53246) 2023-08-09T12:51:09.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f267bfff640 1 -- 172.21.15.17:0/3385031074 learned_addr learned my addr 172.21.15.17:0/3385031074 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:09.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f26808ce640 1 --2- 172.21.15.17:0/3385031074 >> v2:172.21.15.142:3300/0 conn(0x7f267c0cb070 0x7f267c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:09.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f267bfff640 1 -- 172.21.15.17:0/3385031074 >> v2:172.21.15.142:3300/0 conn(0x7f267c0cb070 msgr2=0x7f267c0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:09.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f267bfff640 1 --2- 172.21.15.17:0/3385031074 >> v2:172.21.15.142:3300/0 conn(0x7f267c0cb070 0x7f267c0cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.257+0000 7f267bfff640 1 -- 172.21.15.17:0/3385031074 >> v1:172.21.15.17:6789/0 conn(0x7f267c0b0b10 legacy=0x7f267c15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:09.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.258+0000 7f267bfff640 1 -- 172.21.15.17:0/3385031074 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c0718a0 con 0x7f267c1587e0 2023-08-09T12:51:09.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.258+0000 7f267affd640 1 -- 172.21.15.17:0/3385031074 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377433293 0 0) 0x7f267c0cb9e0 con 0x7f267c0b0b10 2023-08-09T12:51:09.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.259+0000 7f267bfff640 1 --2- 172.21.15.17:0/3385031074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c1587e0 0x7f267c070f00 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f267c0b4290 tx=0x7f266c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835bffde0c8c37f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:09.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.259+0000 7f267affd640 1 -- 172.21.15.17:0/3385031074 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c030860 con 0x7f267c1587e0 2023-08-09T12:51:09.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.259+0000 7f267affd640 1 -- 172.21.15.17:0/3385031074 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c0309c0 con 0x7f267c1587e0 2023-08-09T12:51:09.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.259+0000 7f267affd640 1 -- 172.21.15.17:0/3385031074 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c030d50 con 0x7f267c1587e0 2023-08-09T12:51:09.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.260+0000 7f26810cf640 1 -- 172.21.15.17:0/3385031074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c1587e0 msgr2=0x7f267c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:09.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.260+0000 7f26810cf640 1 --2- 172.21.15.17:0/3385031074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c1587e0 0x7f267c070f00 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f267c0b4290 tx=0x7f266c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.260+0000 7f26810cf640 1 -- 172.21.15.17:0/3385031074 shutdown_connections 2023-08-09T12:51:09.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.260+0000 7f26810cf640 1 --2- 172.21.15.17:0/3385031074 >> v2:172.21.15.142:3300/0 conn(0x7f267c0cb070 0x7f267c0cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.260+0000 7f26810cf640 1 --2- 172.21.15.17:0/3385031074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c1587e0 0x7f267c070f00 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.260+0000 7f26810cf640 1 -- 172.21.15.17:0/3385031074 >> 172.21.15.17:0/3385031074 conn(0x7f267c0b1d50 msgr2=0x7f267c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:09.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.260+0000 7f26810cf640 1 -- 172.21.15.17:0/3385031074 shutdown_connections 2023-08-09T12:51:09.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.260+0000 7f26810cf640 1 -- 172.21.15.17:0/3385031074 wait complete. 2023-08-09T12:51:09.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.262+0000 7f26810cf640 1 Processor -- start 2023-08-09T12:51:09.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.262+0000 7f26810cf640 1 -- start start 2023-08-09T12:51:09.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f26810cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c0b0b10 0x7f267c1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:09.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f26810cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267c0cb070 0x7f267c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:09.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f26810cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f267c1587e0 0x7f267c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:09.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f26810cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c150060 con 0x7f267c0b0b10 2023-08-09T12:51:09.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f26810cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0c7f80 con 0x7f267c0cb070 2023-08-09T12:51:09.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f26810cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c14dbb0 con 0x7f267c1587e0 2023-08-09T12:51:09.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f267bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c0b0b10 0x7f267c1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:09.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f267bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c0b0b10 0x7f267c1504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53262/0 (socket says 172.21.15.17:53262) 2023-08-09T12:51:09.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f267bfff640 1 -- 172.21.15.17:0/3814655597 learned_addr learned my addr 172.21.15.17:0/3814655597 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:09.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f267bfff640 1 -- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f267c1587e0 msgr2=0x7f267c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:09.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.263+0000 7f267bfff640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f267c1587e0 0x7f267c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f267bfff640 1 -- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267c0cb070 msgr2=0x7f267c14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:09.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f267bfff640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267c0cb070 0x7f267c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f267bfff640 1 -- 172.21.15.17:0/3814655597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0094d0 con 0x7f267c0b0b10 2023-08-09T12:51:09.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f267bfff640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c0b0b10 0x7f267c1504f0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f266c02b9e0 tx=0x7f266c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:09.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f2678ff9640 1 -- 172.21.15.17:0/3814655597 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c039d60 con 0x7f267c0b0b10 2023-08-09T12:51:09.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f2678ff9640 1 -- 172.21.15.17:0/3814655597 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c043400 con 0x7f267c0b0b10 2023-08-09T12:51:09.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f2678ff9640 1 -- 172.21.15.17:0/3814655597 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0437b0 con 0x7f267c0b0b10 2023-08-09T12:51:09.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c0c8220 con 0x7f267c0b0b10 2023-08-09T12:51:09.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.264+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c14fcf0 con 0x7f267c0b0b10 2023-08-09T12:51:09.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.266+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c0c8740 con 0x7f267c0b0b10 2023-08-09T12:51:09.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.266+0000 7f2678ff9640 1 -- 172.21.15.17:0/3814655597 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f266c043910 con 0x7f267c0b0b10 2023-08-09T12:51:09.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.267+0000 7f2678ff9640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f266806a050 0x7f266806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:09.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.267+0000 7f2678ff9640 1 -- 172.21.15.17:0/3814655597 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f266c03e070 con 0x7f267c0b0b10 2023-08-09T12:51:09.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.267+0000 7f2678ff9640 1 -- 172.21.15.17:0/3814655597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f26680721a0 con 0x7f267c0b0b10 2023-08-09T12:51:09.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.268+0000 7f267b7fe640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f266806a050 0x7f266806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:09.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.269+0000 7f267b7fe640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f266806a050 0x7f266806c510 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f267c1577c0 tx=0x7f2670007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:09.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.272+0000 7f2678ff9640 1 -- 172.21.15.17:0/3814655597 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f266c034060 con 0x7f267c0b0b10 2023-08-09T12:51:09.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.474+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f267c14fb50 con 0x7f267c0b0b10 2023-08-09T12:51:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.475+0000 7f2678ff9640 1 -- 172.21.15.17:0/3814655597 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v163) v1 ==== 80+0+0 (secure 0 0 0) 0x7f267c14fb50 con 0x7f267c0b0b10 2023-08-09T12:51:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:51:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.477+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f266806a050 msgr2=0x7f266806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.477+0000 7f26810cf640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f266806a050 0x7f266806c510 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f267c1577c0 tx=0x7f2670007930 comp rx=0 tx=0).stop 2023-08-09T12:51:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.477+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c0b0b10 msgr2=0x7f267c1504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.477+0000 7f26810cf640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c0b0b10 0x7f267c1504f0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f266c02b9e0 tx=0x7f266c004730 comp rx=0 tx=0).stop 2023-08-09T12:51:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.477+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 shutdown_connections 2023-08-09T12:51:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.478+0000 7f26810cf640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f266806a050 0x7f266806c510 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.478+0000 7f26810cf640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f267c1587e0 0x7f267c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.478+0000 7f26810cf640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267c0cb070 0x7f267c14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.478+0000 7f26810cf640 1 --2- 172.21.15.17:0/3814655597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267c0b0b10 0x7f267c1504f0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.478+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 >> 172.21.15.17:0/3814655597 conn(0x7f267c0b1d50 msgr2=0x7f267c0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:09.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.478+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 shutdown_connections 2023-08-09T12:51:09.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:09.478+0000 7f26810cf640 1 -- 172.21.15.17:0/3814655597 wait complete. 2023-08-09T12:51:09.503 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:51:09.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:09.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:51:09.623 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:51:09.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:09.625 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:51:09.682 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:51:09.682 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:09.745 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:51:09.745 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:09.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.038+0000 7fb40d586640 1 Processor -- start 2023-08-09T12:51:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.039+0000 7fb40d586640 1 -- start start 2023-08-09T12:51:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.040+0000 7fb40d586640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4080b0ea0 0x7fb4080caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.040+0000 7fb40d586640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4080c8d40 0x7fb4080cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.040+0000 7fb40d586640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4080b3b60 con 0x7fb4080b0ac0 2023-08-09T12:51:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.040+0000 7fb40d586640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4081617b0 con 0x7fb4080c8d40 2023-08-09T12:51:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.040+0000 7fb40d586640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4080b3550 con 0x7fb4080b0ea0 2023-08-09T12:51:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.041+0000 7fb40cd85640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4080c8d40 0x7fb4080cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.041+0000 7fb40cd85640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4080c8d40 0x7fb4080cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53268/0 (socket says 172.21.15.17:53268) 2023-08-09T12:51:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.041+0000 7fb40cd85640 1 -- 172.21.15.17:0/2315537604 learned_addr learned my addr 172.21.15.17:0/2315537604 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.041+0000 7fb40cd85640 1 -- 172.21.15.17:0/2315537604 >> v2:172.21.15.142:3300/0 conn(0x7fb4080b0ea0 msgr2=0x7fb4080caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.041+0000 7fb40cd85640 1 --2- 172.21.15.17:0/2315537604 >> v2:172.21.15.142:3300/0 conn(0x7fb4080b0ea0 0x7fb4080caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.041+0000 7fb40cd85640 1 -- 172.21.15.17:0/2315537604 >> v1:172.21.15.142:6789/0 conn(0x7fb4080b0ac0 legacy=0x7fb4080b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.041+0000 7fb40cd85640 1 -- 172.21.15.17:0/2315537604 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080c9e10 con 0x7fb4080c8d40 2023-08-09T12:51:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.042+0000 7fb40cd85640 1 --2- 172.21.15.17:0/2315537604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080c8d40 0x7fb4080cb440 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fb40806b780 tx=0x7fb40002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0dda135499260b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb406ffd640 1 -- 172.21.15.17:0/2315537604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40002ca80 con 0x7fb4080c8d40 2023-08-09T12:51:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb406ffd640 1 -- 172.21.15.17:0/2315537604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40002cbe0 con 0x7fb4080c8d40 2023-08-09T12:51:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb406ffd640 1 -- 172.21.15.17:0/2315537604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000343f0 con 0x7fb4080c8d40 2023-08-09T12:51:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb40d586640 1 -- 172.21.15.17:0/2315537604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080c8d40 msgr2=0x7fb4080cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb40d586640 1 --2- 172.21.15.17:0/2315537604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080c8d40 0x7fb4080cb440 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fb40806b780 tx=0x7fb40002bee0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb40d586640 1 -- 172.21.15.17:0/2315537604 shutdown_connections 2023-08-09T12:51:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb40d586640 1 --2- 172.21.15.17:0/2315537604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080c8d40 0x7fb4080cb440 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb40d586640 1 --2- 172.21.15.17:0/2315537604 >> v2:172.21.15.142:3300/0 conn(0x7fb4080b0ea0 0x7fb4080caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb40d586640 1 -- 172.21.15.17:0/2315537604 >> 172.21.15.17:0/2315537604 conn(0x7fb4080b1d50 msgr2=0x7fb40806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb40d586640 1 -- 172.21.15.17:0/2315537604 shutdown_connections 2023-08-09T12:51:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.043+0000 7fb40d586640 1 -- 172.21.15.17:0/2315537604 wait complete. 2023-08-09T12:51:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.045+0000 7fb40d586640 1 Processor -- start 2023-08-09T12:51:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.045+0000 7fb40d586640 1 -- start start 2023-08-09T12:51:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.046+0000 7fb40d586640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4080b0ac0 0x7fb408151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.046+0000 7fb40d586640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080b0ea0 0x7fb408162da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.046+0000 7fb40d586640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4080c8d40 0x7fb4080c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.046+0000 7fb40d586640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb408164320 con 0x7fb4080b0ea0 2023-08-09T12:51:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.046+0000 7fb40d586640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb408164740 con 0x7fb4080b0ac0 2023-08-09T12:51:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.046+0000 7fb40d586640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4081636a0 con 0x7fb4080c8d40 2023-08-09T12:51:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080b0ea0 0x7fb408162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080b0ea0 0x7fb408162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53274/0 (socket says 172.21.15.17:53274) 2023-08-09T12:51:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 -- 172.21.15.17:0/2599464651 learned_addr learned my addr 172.21.15.17:0/2599464651 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 -- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4080c8d40 msgr2=0x7fb4080c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4080c8d40 0x7fb4080c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 -- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4080b0ac0 msgr2=0x7fb408151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4080b0ac0 0x7fb408151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 -- 172.21.15.17:0/2599464651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb400009b30 con 0x7fb4080b0ea0 2023-08-09T12:51:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.047+0000 7fb4077fe640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080b0ea0 0x7fb408162da0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00b450 tx=0x7fb3fc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.048+0000 7fb404ff9640 1 -- 172.21.15.17:0/2599464651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc011890 con 0x7fb4080b0ea0 2023-08-09T12:51:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.048+0000 7fb404ff9640 1 -- 172.21.15.17:0/2599464651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0119f0 con 0x7fb4080b0ea0 2023-08-09T12:51:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.048+0000 7fb404ff9640 1 -- 172.21.15.17:0/2599464651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc011da0 con 0x7fb4080b0ea0 2023-08-09T12:51:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.048+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb408163980 con 0x7fb4080b0ea0 2023-08-09T12:51:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.048+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb408163f40 con 0x7fb4080b0ea0 2023-08-09T12:51:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.049+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb408164100 con 0x7fb4080b0ea0 2023-08-09T12:51:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.050+0000 7fb404ff9640 1 -- 172.21.15.17:0/2599464651 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb3fc01a400 con 0x7fb4080b0ea0 2023-08-09T12:51:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.051+0000 7fb404ff9640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3f406a050 0x7fb3f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.051+0000 7fb404ff9640 1 -- 172.21.15.17:0/2599464651 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3fc0889f0 con 0x7fb4080b0ea0 2023-08-09T12:51:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.051+0000 7fb404ff9640 1 -- 172.21.15.17:0/2599464651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fb3f40721a0 con 0x7fb4080b0ea0 2023-08-09T12:51:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.052+0000 7fb407fff640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3f406a050 0x7fb3f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.053+0000 7fb407fff640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3f406a050 0x7fb3f406c510 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8003cc0 tx=0x7fb3f80079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:10.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.055+0000 7fb404ff9640 1 -- 172.21.15.17:0/2599464651 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb3fc015060 con 0x7fb4080b0ea0 2023-08-09T12:51:10.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.262+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb40804e390 con 0x7fb4080b0ea0 2023-08-09T12:51:10.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.265+0000 7fb404ff9640 1 -- 172.21.15.17:0/2599464651 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+18313 (secure 0 0 0) 0x7fb3fc080e60 con 0x7fb4080b0ea0 2023-08-09T12:51:10.269 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:10.269 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":163,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:50:33.896529+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:48:44.746706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-09T12:48:45.418671+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:10.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.267+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3f406a050 msgr2=0x7fb3f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3f406a050 0x7fb3f406c510 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8003cc0 tx=0x7fb3f80079b0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080b0ea0 msgr2=0x7fb408162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080b0ea0 0x7fb408162da0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00b450 tx=0x7fb3fc00b910 comp rx=0 tx=0).stop 2023-08-09T12:51:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 shutdown_connections 2023-08-09T12:51:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb3f406a050 0x7fb3f406c510 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4080c8d40 0x7fb4080c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4080b0ea0 0x7fb408162da0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 --2- 172.21.15.17:0/2599464651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4080b0ac0 0x7fb408151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 >> 172.21.15.17:0/2599464651 conn(0x7fb4080b1d50 msgr2=0x7fb408160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:10.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 shutdown_connections 2023-08-09T12:51:10.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.268+0000 7fb40d586640 1 -- 172.21.15.17:0/2599464651 wait complete. 2023-08-09T12:51:10.290 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:48:44.746706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:48:45.418671+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:51:10.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:51:10.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.516+0000 7f7291755640 1 Processor -- start 2023-08-09T12:51:10.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.517+0000 7f7291755640 1 -- start start 2023-08-09T12:51:10.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.518+0000 7f7291755640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f728c164f50 0x7f728c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.518+0000 7f7291755640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f728c162650 0x7f728c165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.518+0000 7f7291755640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c0cd520 con 0x7f728c0c1980 2023-08-09T12:51:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.518+0000 7f7291755640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c0cc630 con 0x7f728c164f50 2023-08-09T12:51:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.518+0000 7f7291755640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c0cc910 con 0x7f728c162650 2023-08-09T12:51:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.518+0000 7f728affd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f728c164f50 0x7f728c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728affd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f728c164f50 0x7f728c0cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53288/0 (socket says 172.21.15.17:53288) 2023-08-09T12:51:10.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728affd640 1 -- 172.21.15.17:0/512238459 learned_addr learned my addr 172.21.15.17:0/512238459 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:10.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f72827fc640 1 --1- 172.21.15.17:0/512238459 >> v1:172.21.15.17:6789/0 conn(0x7f728c0c1980 0x7f728c165330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52384/0 (socket says 172.21.15.17:52384) 2023-08-09T12:51:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728b7fe640 1 --2- 172.21.15.17:0/512238459 >> v2:172.21.15.142:3300/0 conn(0x7f728c162650 0x7f728c165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728affd640 1 -- 172.21.15.17:0/512238459 >> v2:172.21.15.142:3300/0 conn(0x7f728c162650 msgr2=0x7f728c165a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728affd640 1 --2- 172.21.15.17:0/512238459 >> v2:172.21.15.142:3300/0 conn(0x7f728c162650 0x7f728c165a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728affd640 1 -- 172.21.15.17:0/512238459 >> v1:172.21.15.17:6789/0 conn(0x7f728c0c1980 legacy=0x7f728c165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728affd640 1 -- 172.21.15.17:0/512238459 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c0ccbf0 con 0x7f728c164f50 2023-08-09T12:51:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728a7fc640 1 -- 172.21.15.17:0/512238459 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760240336 0 0) 0x7f728c0cd520 con 0x7f728c0c1980 2023-08-09T12:51:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.519+0000 7f728b7fe640 1 --2- 172.21.15.17:0/512238459 >> v2:172.21.15.142:3300/0 conn(0x7f728c162650 0x7f728c165a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.520+0000 7f728affd640 1 --2- 172.21.15.17:0/512238459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c0cd9b0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f728c0c1910 tx=0x7f727c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc9d9cd66ce84b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f728a7fc640 1 -- 172.21.15.17:0/512238459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c030860 con 0x7f728c164f50 2023-08-09T12:51:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f728a7fc640 1 -- 172.21.15.17:0/512238459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c0309c0 con 0x7f728c164f50 2023-08-09T12:51:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f728a7fc640 1 -- 172.21.15.17:0/512238459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c030d50 con 0x7f728c164f50 2023-08-09T12:51:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f7291755640 1 -- 172.21.15.17:0/512238459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 msgr2=0x7f728c0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f7291755640 1 --2- 172.21.15.17:0/512238459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c0cd9b0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f728c0c1910 tx=0x7f727c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f7291755640 1 -- 172.21.15.17:0/512238459 shutdown_connections 2023-08-09T12:51:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f7291755640 1 --2- 172.21.15.17:0/512238459 >> v2:172.21.15.142:3300/0 conn(0x7f728c162650 0x7f728c165a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f7291755640 1 --2- 172.21.15.17:0/512238459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c0cd9b0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f7291755640 1 -- 172.21.15.17:0/512238459 >> 172.21.15.17:0/512238459 conn(0x7f728c0cb1b0 msgr2=0x7f728c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f7291755640 1 -- 172.21.15.17:0/512238459 shutdown_connections 2023-08-09T12:51:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.521+0000 7f7291755640 1 -- 172.21.15.17:0/512238459 wait complete. 2023-08-09T12:51:10.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.523+0000 7f7291755640 1 Processor -- start 2023-08-09T12:51:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.523+0000 7f7291755640 1 -- start start 2023-08-09T12:51:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.524+0000 7f7291755640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f728c0c1980 0x7f728c157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.524+0000 7f7291755640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f728c162650 0x7f728c163be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.524+0000 7f7291755640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f7291755640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0c79a0 con 0x7f728c164f50 2023-08-09T12:51:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f7291755640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0c2790 con 0x7f728c0c1980 2023-08-09T12:51:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f7291755640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c1fad10 con 0x7f728c162650 2023-08-09T12:51:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c164120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53298/0 (socket says 172.21.15.17:53298) 2023-08-09T12:51:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728b7fe640 1 -- 172.21.15.17:0/2737843674 learned_addr learned my addr 172.21.15.17:0/2737843674 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728affd640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f728c0c1980 0x7f728c157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f72827fc640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f728c162650 0x7f728c163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728b7fe640 1 -- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f728c162650 msgr2=0x7f728c163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728b7fe640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f728c162650 0x7f728c163be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728b7fe640 1 -- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f728c0c1980 msgr2=0x7f728c157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728b7fe640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f728c0c1980 0x7f728c157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.525+0000 7f728b7fe640 1 -- 172.21.15.17:0/2737843674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0094d0 con 0x7f728c164f50 2023-08-09T12:51:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.526+0000 7f728b7fe640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c164120 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f728400cef0 tx=0x7f728400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.526+0000 7f7283fff640 1 -- 172.21.15.17:0/2737843674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400d840 con 0x7f728c164f50 2023-08-09T12:51:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.526+0000 7f7283fff640 1 -- 172.21.15.17:0/2737843674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728400d9c0 con 0x7f728c164f50 2023-08-09T12:51:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.526+0000 7f7283fff640 1 -- 172.21.15.17:0/2737843674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400dd70 con 0x7f728c164f50 2023-08-09T12:51:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.526+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c1fa140 con 0x7f728c164f50 2023-08-09T12:51:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.526+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c1fa6c0 con 0x7f728c164f50 2023-08-09T12:51:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.527+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c067a80 con 0x7f728c164f50 2023-08-09T12:51:10.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.528+0000 7f7283fff640 1 -- 172.21.15.17:0/2737843674 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f728401f440 con 0x7f728c164f50 2023-08-09T12:51:10.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.529+0000 7f7283fff640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f726c06a050 0x7f726c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:10.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.529+0000 7f7283fff640 1 -- 172.21.15.17:0/2737843674 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7284089040 con 0x7f728c164f50 2023-08-09T12:51:10.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.529+0000 7f7283fff640 1 -- 172.21.15.17:0/2737843674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f726c0721a0 con 0x7f728c164f50 2023-08-09T12:51:10.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.530+0000 7f728affd640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f726c06a050 0x7f726c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:10.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.531+0000 7f728affd640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f726c06a050 0x7f726c06c510 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f727c036000 tx=0x7f727c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:10.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.534+0000 7f7283fff640 1 -- 172.21.15.17:0/2737843674 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f72840bb7b0 con 0x7f728c164f50 2023-08-09T12:51:10.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.730+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f728c0ccea0 con 0x7f728c164f50 2023-08-09T12:51:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.731+0000 7f7283fff640 1 -- 172.21.15.17:0/2737843674 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7f728401a060 con 0x7f728c164f50 2023-08-09T12:51:10.735 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:51:10.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f726c06a050 msgr2=0x7f726c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f726c06a050 0x7f726c06c510 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f727c036000 tx=0x7f727c008030 comp rx=0 tx=0).stop 2023-08-09T12:51:10.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 msgr2=0x7f728c164120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:10.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c164120 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f728400cef0 tx=0x7f728400a710 comp rx=0 tx=0).stop 2023-08-09T12:51:10.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 shutdown_connections 2023-08-09T12:51:10.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f726c06a050 0x7f726c06c510 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f728c164f50 0x7f728c164120 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f728c162650 0x7f728c163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 --2- 172.21.15.17:0/2737843674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f728c0c1980 0x7f728c157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:10.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 >> 172.21.15.17:0/2737843674 conn(0x7f728c0cb1b0 msgr2=0x7f728c06f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:10.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 shutdown_connections 2023-08-09T12:51:10.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.734+0000 7f7291755640 1 -- 172.21.15.17:0/2737843674 wait complete. 2023-08-09T12:51:10.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:51:10.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.994+0000 7fc792564640 1 Processor -- start 2023-08-09T12:51:10.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.995+0000 7fc792564640 1 -- start start 2023-08-09T12:51:11.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.996+0000 7fc792564640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc78c164f50 0x7fc78c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.996+0000 7fc792564640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c162650 0x7fc78c165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.996+0000 7fc792564640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0cd520 con 0x7fc78c0c1980 2023-08-09T12:51:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.996+0000 7fc792564640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c0cc630 con 0x7fc78c164f50 2023-08-09T12:51:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.996+0000 7fc792564640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0cc910 con 0x7fc78c162650 2023-08-09T12:51:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.997+0000 7fc78bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc78c164f50 0x7fc78c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.997+0000 7fc78bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc78c164f50 0x7fc78c0cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53310/0 (socket says 172.21.15.17:53310) 2023-08-09T12:51:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.997+0000 7fc78bfff640 1 -- 172.21.15.17:0/3469638485 learned_addr learned my addr 172.21.15.17:0/3469638485 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.997+0000 7fc790b01640 1 --2- 172.21.15.17:0/3469638485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c162650 0x7fc78c165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.997+0000 7fc78bfff640 1 -- 172.21.15.17:0/3469638485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c162650 msgr2=0x7fc78c165a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.997+0000 7fc78bfff640 1 --2- 172.21.15.17:0/3469638485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c162650 0x7fc78c165a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.997+0000 7fc78bfff640 1 -- 172.21.15.17:0/3469638485 >> v1:172.21.15.142:6789/0 conn(0x7fc78c0c1980 legacy=0x7fc78c165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.997+0000 7fc78bfff640 1 -- 172.21.15.17:0/3469638485 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0ccbf0 con 0x7fc78c164f50 2023-08-09T12:51:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.999+0000 7fc78bfff640 1 --2- 172.21.15.17:0/3469638485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c0cd9b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009870 tx=0x7fc77c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248d1ad84586f33a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.999+0000 7fc78affd640 1 -- 172.21.15.17:0/3469638485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c030840 con 0x7fc78c164f50 2023-08-09T12:51:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.999+0000 7fc78affd640 1 -- 172.21.15.17:0/3469638485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c0309a0 con 0x7fc78c164f50 2023-08-09T12:51:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:10.999+0000 7fc78affd640 1 -- 172.21.15.17:0/3469638485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c030d30 con 0x7fc78c164f50 2023-08-09T12:51:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.000+0000 7fc792564640 1 -- 172.21.15.17:0/3469638485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 msgr2=0x7fc78c0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.000+0000 7fc792564640 1 --2- 172.21.15.17:0/3469638485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c0cd9b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009870 tx=0x7fc77c02b980 comp rx=0 tx=0).stop 2023-08-09T12:51:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.000+0000 7fc792564640 1 -- 172.21.15.17:0/3469638485 shutdown_connections 2023-08-09T12:51:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.000+0000 7fc792564640 1 --2- 172.21.15.17:0/3469638485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c162650 0x7fc78c165a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.000+0000 7fc792564640 1 --2- 172.21.15.17:0/3469638485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c0cd9b0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.000+0000 7fc792564640 1 -- 172.21.15.17:0/3469638485 >> 172.21.15.17:0/3469638485 conn(0x7fc78c0cb1b0 msgr2=0x7fc78c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.000+0000 7fc792564640 1 -- 172.21.15.17:0/3469638485 shutdown_connections 2023-08-09T12:51:11.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.000+0000 7fc792564640 1 -- 172.21.15.17:0/3469638485 wait complete. 2023-08-09T12:51:11.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.002+0000 7fc792564640 1 Processor -- start 2023-08-09T12:51:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.002+0000 7fc792564640 1 -- start start 2023-08-09T12:51:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc792564640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c0c1980 0x7fc78c0b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc792564640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc78c162650 0x7fc78c06be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc792564640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c069c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc792564640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0c66f0 con 0x7fc78c164f50 2023-08-09T12:51:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc792564640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0c69d0 con 0x7fc78c162650 2023-08-09T12:51:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc792564640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0c6cb0 con 0x7fc78c0c1980 2023-08-09T12:51:11.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc790b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c069c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc790b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c069c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53312/0 (socket says 172.21.15.17:53312) 2023-08-09T12:51:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.003+0000 7fc790b01640 1 -- 172.21.15.17:0/2344828795 learned_addr learned my addr 172.21.15.17:0/2344828795 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc78bfff640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c0c1980 0x7fc78c0b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc78b7fe640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc78c162650 0x7fc78c06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc790b01640 1 -- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c0c1980 msgr2=0x7fc78c0b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc790b01640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c0c1980 0x7fc78c0b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc790b01640 1 -- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc78c162650 msgr2=0x7fc78c06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc790b01640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc78c162650 0x7fc78c06be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc790b01640 1 -- 172.21.15.17:0/2344828795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c0094d0 con 0x7fc78c164f50 2023-08-09T12:51:11.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc78bfff640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c0c1980 0x7fc78c0b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc790b01640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c069c10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fc784007e30 tx=0x7fc78400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc788ff9640 1 -- 172.21.15.17:0/2344828795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784014620 con 0x7fc78c164f50 2023-08-09T12:51:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc788ff9640 1 -- 172.21.15.17:0/2344828795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400ee90 con 0x7fc78c164f50 2023-08-09T12:51:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc788ff9640 1 -- 172.21.15.17:0/2344828795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840149c0 con 0x7fc78c164f50 2023-08-09T12:51:11.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.004+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c0c6f90 con 0x7fc78c164f50 2023-08-09T12:51:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.005+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c0b3090 con 0x7fc78c164f50 2023-08-09T12:51:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.006+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c164d70 con 0x7fc78c164f50 2023-08-09T12:51:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.007+0000 7fc788ff9640 1 -- 172.21.15.17:0/2344828795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc784014b20 con 0x7fc78c164f50 2023-08-09T12:51:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.007+0000 7fc788ff9640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc77806a080 0x7fc77806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.008+0000 7fc788ff9640 1 -- 172.21.15.17:0/2344828795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc784088f40 con 0x7fc78c164f50 2023-08-09T12:51:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.008+0000 7fc788ff9640 1 -- 172.21.15.17:0/2344828795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fc7780721d0 con 0x7fc78c164f50 2023-08-09T12:51:11.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.008+0000 7fc78bfff640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc77806a080 0x7fc77806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.009+0000 7fc78bfff640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc77806a080 0x7fc77806c540 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc77c036000 tx=0x7fc77c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.012+0000 7fc788ff9640 1 -- 172.21.15.17:0/2344828795 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc784054620 con 0x7fc78c164f50 2023-08-09T12:51:11.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.205+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc78c0b3220 con 0x7fc78c164f50 2023-08-09T12:51:11.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.206+0000 7fc788ff9640 1 -- 172.21.15.17:0/2344828795 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc784057c40 con 0x7fc78c164f50 2023-08-09T12:51:11.209 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:51:11.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc77806a080 msgr2=0x7fc77806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc77806a080 0x7fc77806c540 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc77c036000 tx=0x7fc77c03b040 comp rx=0 tx=0).stop 2023-08-09T12:51:11.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 msgr2=0x7fc78c069c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c069c10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fc784007e30 tx=0x7fc78400e4b0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 shutdown_connections 2023-08-09T12:51:11.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc77806a080 0x7fc77806c540 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc78c164f50 0x7fc78c069c10 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc78c162650 0x7fc78c06be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 --2- 172.21.15.17:0/2344828795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc78c0c1980 0x7fc78c0b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.209+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 >> 172.21.15.17:0/2344828795 conn(0x7fc78c0cb1b0 msgr2=0x7fc78c0b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:11.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.210+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 shutdown_connections 2023-08-09T12:51:11.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.210+0000 7fc792564640 1 -- 172.21.15.17:0/2344828795 wait complete. 2023-08-09T12:51:11.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:51:11.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.454+0000 7f011ee77640 1 Processor -- start 2023-08-09T12:51:11.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.454+0000 7f011ee77640 1 -- start start 2023-08-09T12:51:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.456+0000 7f011ee77640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01180cfd90 0x7f0118167e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.456+0000 7f011ee77640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180d1560 con 0x7f0118160bc0 2023-08-09T12:51:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.456+0000 7f011ee77640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180cdbe0 con 0x7f011815ce80 2023-08-09T12:51:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.456+0000 7f011ee77640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01180d1210 con 0x7f01180cfd90 2023-08-09T12:51:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.456+0000 7f0117fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0118160bc0 0x7f01180cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52386/0 (socket says 172.21.15.17:52386) 2023-08-09T12:51:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.456+0000 7f0117fff640 1 -- 172.21.15.17:0/1092243159 learned_addr learned my addr 172.21.15.17:0/1092243159 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721010002 0 0) 0x7f01180d1560 con 0x7f0118160bc0 2023-08-09T12:51:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0108003520 con 0x7f0118160bc0 2023-08-09T12:51:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f011d414640 1 --2- 172.21.15.17:0/1092243159 >> v2:172.21.15.142:3300/0 conn(0x7f01180cfd90 0x7f0118167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185020245 0 0) 0x7f0108003520 con 0x7f0118160bc0 2023-08-09T12:51:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 >> v2:172.21.15.142:3300/0 conn(0x7f01180cfd90 msgr2=0x7f0118167e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 --2- 172.21.15.17:0/1092243159 >> v2:172.21.15.142:3300/0 conn(0x7f01180cfd90 0x7f0118167e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 >> v1:172.21.15.142:6789/0 conn(0x7f011815ce80 legacy=0x7f01180cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180cde40 con 0x7f0118160bc0 2023-08-09T12:51:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f0104001670 con 0x7f0118160bc0 2023-08-09T12:51:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 >> v1:172.21.15.17:6789/0 conn(0x7f0118160bc0 legacy=0x7f01180cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0108003970 0x7f0108003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01080047c0 0x7f0108004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f010800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180d1210 con 0x7f0108005180 2023-08-09T12:51:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010800c0d0 con 0x7f0108003970 2023-08-09T12:51:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.457+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010800c290 con 0x7f01080047c0 2023-08-09T12:51:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.458+0000 7f011d414640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f010800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.458+0000 7f0117fff640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01080047c0 0x7f0108004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.458+0000 7f011cc13640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0108003970 0x7f0108003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.458+0000 7f011d414640 1 -- 172.21.15.17:0/1092243159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01080047c0 msgr2=0x7f0108004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.458+0000 7f011d414640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01080047c0 0x7f0108004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.458+0000 7f011d414640 1 -- 172.21.15.17:0/1092243159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0108003970 msgr2=0x7f0108003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.458+0000 7f011d414640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0108003970 0x7f0108003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.458+0000 7f011d414640 1 -- 172.21.15.17:0/1092243159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0108003520 con 0x7f0108005180 2023-08-09T12:51:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.459+0000 7f011d414640 1 -- 172.21.15.17:0/1092243159 reap_dead start 2023-08-09T12:51:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.459+0000 7f011d414640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f010800b980 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f0110007330 tx=0x7f01080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe14139137d4f351 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011002ccd0 con 0x7f0108005180 2023-08-09T12:51:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011002ce30 con 0x7f0108005180 2023-08-09T12:51:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f01177fe640 1 -- 172.21.15.17:0/1092243159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110003bd0 con 0x7f0108005180 2023-08-09T12:51:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f011ee77640 1 -- 172.21.15.17:0/1092243159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 msgr2=0x7f010800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f011ee77640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f010800b980 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f0110007330 tx=0x7f01080057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f011ee77640 1 -- 172.21.15.17:0/1092243159 shutdown_connections 2023-08-09T12:51:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f011ee77640 1 --2- 172.21.15.17:0/1092243159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f010800b980 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f011ee77640 1 -- 172.21.15.17:0/1092243159 >> 172.21.15.17:0/1092243159 conn(0x7f011806fde0 msgr2=0x7f01180701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f011ee77640 1 -- 172.21.15.17:0/1092243159 shutdown_connections 2023-08-09T12:51:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.460+0000 7f011ee77640 1 -- 172.21.15.17:0/1092243159 wait complete. 2023-08-09T12:51:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.462+0000 7f011ee77640 1 Processor -- start 2023-08-09T12:51:11.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.462+0000 7f011ee77640 1 -- start start 2023-08-09T12:51:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.463+0000 7f011ee77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f011815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.463+0000 7f011ee77640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0118150cc0 0x7f0118151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.463+0000 7f011ee77640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01180b2f30 0x7f01180b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.463+0000 7f011ee77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0118151680 con 0x7f0108005180 2023-08-09T12:51:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.463+0000 7f011ee77640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180b4d50 con 0x7f01180b2f30 2023-08-09T12:51:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.463+0000 7f011ee77640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180b3cb0 con 0x7f0118150cc0 2023-08-09T12:51:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011cc13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f011815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011cc13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f011815c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53336/0 (socket says 172.21.15.17:53336) 2023-08-09T12:51:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011cc13640 1 -- 172.21.15.17:0/1106947696 learned_addr learned my addr 172.21.15.17:0/1106947696 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f0117fff640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0118150cc0 0x7f0118151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011cc13640 1 -- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0118150cc0 msgr2=0x7f0118151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011cc13640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0118150cc0 0x7f0118151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011d414640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01180b2f30 0x7f01180b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011cc13640 1 -- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01180b2f30 msgr2=0x7f01180b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011cc13640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01180b2f30 0x7f01180b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f011cc13640 1 -- 172.21.15.17:0/1106947696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180b3f90 con 0x7f0108005180 2023-08-09T12:51:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.464+0000 7f0117fff640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0118150cc0 0x7f0118151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:11.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.465+0000 7f011cc13640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f011815c0e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f010c00e4d0 tx=0x7f010c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.465+0000 7f01157fa640 1 -- 172.21.15.17:0/1106947696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c0052e0 con 0x7f0108005180 2023-08-09T12:51:11.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.465+0000 7f01157fa640 1 -- 172.21.15.17:0/1106947696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c005440 con 0x7f0108005180 2023-08-09T12:51:11.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.465+0000 7f01157fa640 1 -- 172.21.15.17:0/1106947696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c003810 con 0x7f0108005180 2023-08-09T12:51:11.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.465+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01180b4270 con 0x7f0108005180 2023-08-09T12:51:11.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.465+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01180b4830 con 0x7f0108005180 2023-08-09T12:51:11.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.467+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01180b49c0 con 0x7f0108005180 2023-08-09T12:51:11.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.467+0000 7f01157fa640 1 -- 172.21.15.17:0/1106947696 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f010c003970 con 0x7f0108005180 2023-08-09T12:51:11.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.468+0000 7f01157fa640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f00fc06a0d0 0x7f00fc06c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.469+0000 7f01157fa640 1 -- 172.21.15.17:0/1106947696 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f010c088340 con 0x7f0108005180 2023-08-09T12:51:11.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.469+0000 7f01157fa640 1 -- 172.21.15.17:0/1106947696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f00fc0722a0 con 0x7f0108005180 2023-08-09T12:51:11.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.469+0000 7f0117fff640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f00fc06a0d0 0x7f00fc06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.470+0000 7f0117fff640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f00fc06a0d0 0x7f00fc06c590 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0104001eb0 tx=0x7f0104000f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.473+0000 7f01157fa640 1 -- 172.21.15.17:0/1106947696 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f010c053a10 con 0x7f0108005180 2023-08-09T12:51:11.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.668+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0118067a80 con 0x7f0108005180 2023-08-09T12:51:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.669+0000 7f01157fa640 1 -- 172.21.15.17:0/1106947696 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7f010c057030 con 0x7f0108005180 2023-08-09T12:51:11.673 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:51:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f00fc06a0d0 msgr2=0x7f00fc06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f00fc06a0d0 0x7f00fc06c590 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0104001eb0 tx=0x7f0104000f30 comp rx=0 tx=0).stop 2023-08-09T12:51:11.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 msgr2=0x7f011815c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f011815c0e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f010c00e4d0 tx=0x7f010c00e990 comp rx=0 tx=0).stop 2023-08-09T12:51:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 shutdown_connections 2023-08-09T12:51:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f00fc06a0d0 0x7f00fc06c590 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01180b2f30 0x7f01180b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0118150cc0 0x7f0118151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 --2- 172.21.15.17:0/1106947696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0108005180 0x7f011815c0e0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 >> 172.21.15.17:0/1106947696 conn(0x7f011806fde0 msgr2=0x7f01180c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 shutdown_connections 2023-08-09T12:51:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.672+0000 7f011ee77640 1 -- 172.21.15.17:0/1106947696 wait complete. 2023-08-09T12:51:11.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:51:11.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.918+0000 7fd2b7fff640 1 Processor -- start 2023-08-09T12:51:11.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.918+0000 7fd2b7fff640 1 -- start start 2023-08-09T12:51:11.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.919+0000 7fd2b7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2b80b8420 0x7fd2b80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.919+0000 7fd2b7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2b815cf20 0x7fd2b80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.919+0000 7fd2b7fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b80d0f00 con 0x7fd2b815cb40 2023-08-09T12:51:11.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.919+0000 7fd2b7fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b81611f0 con 0x7fd2b815cf20 2023-08-09T12:51:11.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.919+0000 7fd2b7fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b81614d0 con 0x7fd2b80b8420 2023-08-09T12:51:11.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.920+0000 7fd2b77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2b815cf20 0x7fd2b80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.920+0000 7fd2b77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2b815cf20 0x7fd2b80cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53346/0 (socket says 172.21.15.17:53346) 2023-08-09T12:51:11.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.920+0000 7fd2b77fe640 1 -- 172.21.15.17:0/2794131344 learned_addr learned my addr 172.21.15.17:0/2794131344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:11.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.920+0000 7fd2b77fe640 1 -- 172.21.15.17:0/2794131344 >> v2:172.21.15.142:3300/0 conn(0x7fd2b80b8420 msgr2=0x7fd2b80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:11.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.920+0000 7fd2b77fe640 1 --2- 172.21.15.17:0/2794131344 >> v2:172.21.15.142:3300/0 conn(0x7fd2b80b8420 0x7fd2b80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.920+0000 7fd2b77fe640 1 -- 172.21.15.17:0/2794131344 >> v1:172.21.15.142:6789/0 conn(0x7fd2b815cb40 legacy=0x7fd2b81609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.921+0000 7fd2b77fe640 1 -- 172.21.15.17:0/2794131344 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b81617b0 con 0x7fd2b815cf20 2023-08-09T12:51:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.922+0000 7fd2b77fe640 1 --2- 172.21.15.17:0/2794131344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cf20 0x7fd2b80cdda0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80cf4d0 tx=0x7fd2b002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da49d3fae0f4fb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.922+0000 7fd2b5ffb640 1 -- 172.21.15.17:0/2794131344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b002f850 con 0x7fd2b815cf20 2023-08-09T12:51:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.922+0000 7fd2b5ffb640 1 -- 172.21.15.17:0/2794131344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b002f9b0 con 0x7fd2b815cf20 2023-08-09T12:51:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.922+0000 7fd2b5ffb640 1 -- 172.21.15.17:0/2794131344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b002fd40 con 0x7fd2b815cf20 2023-08-09T12:51:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.923+0000 7fd2b7fff640 1 -- 172.21.15.17:0/2794131344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cf20 msgr2=0x7fd2b80cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.923+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/2794131344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cf20 0x7fd2b80cdda0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80cf4d0 tx=0x7fd2b002ba30 comp rx=0 tx=0).stop 2023-08-09T12:51:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.923+0000 7fd2b7fff640 1 -- 172.21.15.17:0/2794131344 shutdown_connections 2023-08-09T12:51:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.923+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/2794131344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cf20 0x7fd2b80cdda0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.923+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/2794131344 >> v2:172.21.15.142:3300/0 conn(0x7fd2b80b8420 0x7fd2b80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.923+0000 7fd2b7fff640 1 -- 172.21.15.17:0/2794131344 >> 172.21.15.17:0/2794131344 conn(0x7fd2b80d2ab0 msgr2=0x7fd2b80d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:11.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.923+0000 7fd2b7fff640 1 -- 172.21.15.17:0/2794131344 shutdown_connections 2023-08-09T12:51:11.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.923+0000 7fd2b7fff640 1 -- 172.21.15.17:0/2794131344 wait complete. 2023-08-09T12:51:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.925+0000 7fd2b7fff640 1 Processor -- start 2023-08-09T12:51:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.925+0000 7fd2b7fff640 1 -- start start 2023-08-09T12:51:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b80b8420 0x7fd2b815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cb40 0x7fd2b8154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b815cf20 0x7fd2b8157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b7fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8154fa0 con 0x7fd2b815cb40 2023-08-09T12:51:11.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b7fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8155240 con 0x7fd2b80b8420 2023-08-09T12:51:11.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b80cfbd0 con 0x7fd2b815cf20 2023-08-09T12:51:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cb40 0x7fd2b8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cb40 0x7fd2b8154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53362/0 (socket says 172.21.15.17:53362) 2023-08-09T12:51:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.926+0000 7fd2b67fc640 1 -- 172.21.15.17:0/748776155 learned_addr learned my addr 172.21.15.17:0/748776155 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd2b67fc640 1 -- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b815cf20 msgr2=0x7fd2b8157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd2b67fc640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b815cf20 0x7fd2b8157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd2b67fc640 1 -- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b80b8420 msgr2=0x7fd2b815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:11.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd2b67fc640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b80b8420 0x7fd2b815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:11.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd2b67fc640 1 -- 172.21.15.17:0/748776155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00094d0 con 0x7fd2b815cb40 2023-08-09T12:51:11.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd2b67fc640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cb40 0x7fd2b8154630 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00ba50 tx=0x7fd2ac00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd29f7fe640 1 -- 172.21.15.17:0/748776155 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00cbe0 con 0x7fd2b815cb40 2023-08-09T12:51:11.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd29f7fe640 1 -- 172.21.15.17:0/748776155 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac00cd60 con 0x7fd2b815cb40 2023-08-09T12:51:11.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b80cfeb0 con 0x7fd2b815cb40 2023-08-09T12:51:11.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.927+0000 7fd29f7fe640 1 -- 172.21.15.17:0/748776155 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac014680 con 0x7fd2b815cb40 2023-08-09T12:51:11.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.928+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b8154b70 con 0x7fd2b815cb40 2023-08-09T12:51:11.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.929+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b80d03d0 con 0x7fd2b815cb40 2023-08-09T12:51:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.929+0000 7fd29f7fe640 1 -- 172.21.15.17:0/748776155 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd2ac01d3b0 con 0x7fd2b815cb40 2023-08-09T12:51:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.930+0000 7fd29f7fe640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2a406a080 0x7fd2a406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.930+0000 7fd29f7fe640 1 -- 172.21.15.17:0/748776155 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2ac088510 con 0x7fd2b815cb40 2023-08-09T12:51:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.931+0000 7fd29f7fe640 1 -- 172.21.15.17:0/748776155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fd2a40721d0 con 0x7fd2b815cb40 2023-08-09T12:51:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.931+0000 7fd2b6ffd640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2a406a080 0x7fd2a406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:11.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.932+0000 7fd2b6ffd640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2a406a080 0x7fd2a406c540 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8000f60 tx=0x7fd2a80079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:11.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:11.935+0000 7fd29f7fe640 1 -- 172.21.15.17:0/748776155 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd2b80d03d0 con 0x7fd2b815cb40 2023-08-09T12:51:12.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.128+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2b80d03d0 con 0x7fd2b815cb40 2023-08-09T12:51:12.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.129+0000 7fd29f7fe640 1 -- 172.21.15.17:0/748776155 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v163) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2b80d03d0 con 0x7fd2b815cb40 2023-08-09T12:51:12.133 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:51:12.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2a406a080 msgr2=0x7fd2a406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:12.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2a406a080 0x7fd2a406c540 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8000f60 tx=0x7fd2a80079b0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cb40 msgr2=0x7fd2b8154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:12.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cb40 0x7fd2b8154630 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00ba50 tx=0x7fd2ac00bf10 comp rx=0 tx=0).stop 2023-08-09T12:51:12.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 shutdown_connections 2023-08-09T12:51:12.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd2a406a080 0x7fd2a406c540 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2b815cf20 0x7fd2b8157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b815cb40 0x7fd2b8154630 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 --2- 172.21.15.17:0/748776155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b80b8420 0x7fd2b815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 >> 172.21.15.17:0/748776155 conn(0x7fd2b80d2ab0 msgr2=0x7fd2b80cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.132+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 shutdown_connections 2023-08-09T12:51:12.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.133+0000 7fd2b7fff640 1 -- 172.21.15.17:0/748776155 wait complete. 2023-08-09T12:51:12.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:51:12.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.381+0000 7fb2b0d86640 1 Processor -- start 2023-08-09T12:51:12.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.381+0000 7fb2b0d86640 1 -- start start 2023-08-09T12:51:12.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.383+0000 7fb2b0d86640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2ac159d80 0x7fb2ac0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:12.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.383+0000 7fb2b0d86640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0ad810 0x7fb2ac070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:12.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.383+0000 7fb2b0d86640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac070d20 con 0x7fb2ac0708c0 2023-08-09T12:51:12.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.383+0000 7fb2b0d86640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ac15a160 con 0x7fb2ac159d80 2023-08-09T12:51:12.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.383+0000 7fb2b0d86640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0b4630 con 0x7fb2ac0ad810 2023-08-09T12:51:12.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.384+0000 7fb2a1d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0ad810 0x7fb2ac070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:12.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.384+0000 7fb2aa59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2ac159d80 0x7fb2ac0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:12.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.384+0000 7fb2aad9d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb2ac0708c0 0x7fb2ac06eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:39644/0 (socket says 172.21.15.17:39644) 2023-08-09T12:51:12.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.384+0000 7fb2aad9d640 1 -- 172.21.15.17:0/1537763222 learned_addr learned my addr 172.21.15.17:0/1537763222 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:12.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.385+0000 7fb2aa59c640 1 -- 172.21.15.17:0/1537763222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0ad810 msgr2=0x7fb2ac070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:12.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.385+0000 7fb2aa59c640 1 --2- 172.21.15.17:0/1537763222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0ad810 0x7fb2ac070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.385+0000 7fb2aa59c640 1 -- 172.21.15.17:0/1537763222 >> v1:172.21.15.142:6789/0 conn(0x7fb2ac0708c0 legacy=0x7fb2ac06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:12.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.385+0000 7fb2aa59c640 1 -- 172.21.15.17:0/1537763222 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac0b3ab0 con 0x7fb2ac159d80 2023-08-09T12:51:12.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.385+0000 7fb2a1d9b640 1 --2- 172.21.15.17:0/1537763222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0ad810 0x7fb2ac070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:51:12.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.386+0000 7fb2aa59c640 1 --2- 172.21.15.17:0/1537763222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0b34d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0097a0 tx=0x7fb29c02dac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e79868dff11bc2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:12.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2a9d9b640 1 -- 172.21.15.17:0/1537763222 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c02f880 con 0x7fb2ac159d80 2023-08-09T12:51:12.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2a9d9b640 1 -- 172.21.15.17:0/1537763222 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c02f9e0 con 0x7fb2ac159d80 2023-08-09T12:51:12.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2a9d9b640 1 -- 172.21.15.17:0/1537763222 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c02fd70 con 0x7fb2ac159d80 2023-08-09T12:51:12.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1537763222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac159d80 msgr2=0x7fb2ac0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:12.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1537763222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0b34d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0097a0 tx=0x7fb29c02dac0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1537763222 shutdown_connections 2023-08-09T12:51:12.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1537763222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0ad810 0x7fb2ac070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1537763222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0b34d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1537763222 >> 172.21.15.17:0/1537763222 conn(0x7fb2ac0cb1b0 msgr2=0x7fb2ac0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:12.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1537763222 shutdown_connections 2023-08-09T12:51:12.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.387+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1537763222 wait complete. 2023-08-09T12:51:12.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.389+0000 7fb2b0d86640 1 Processor -- start 2023-08-09T12:51:12.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.389+0000 7fb2b0d86640 1 -- start start 2023-08-09T12:51:12.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.390+0000 7fb2b0d86640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0708c0 0x7fb2ac1edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:12.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.390+0000 7fb2b0d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac0ad810 0x7fb2ac1ee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:12.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.390+0000 7fb2b0d86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:12.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.390+0000 7fb2b0d86640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0c2d30 con 0x7fb2ac159d80 2023-08-09T12:51:12.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.390+0000 7fb2b0d86640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0c72c0 con 0x7fb2ac0ad810 2023-08-09T12:51:12.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.390+0000 7fb2b0d86640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0c2f60 con 0x7fb2ac0708c0 2023-08-09T12:51:12.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:12.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53374/0 (socket says 172.21.15.17:53374) 2023-08-09T12:51:12.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 -- 172.21.15.17:0/1261577338 learned_addr learned my addr 172.21.15.17:0/1261577338 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:12.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2a1d9b640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac0ad810 0x7fb2ac1ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:12.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aa59c640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0708c0 0x7fb2ac1edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:12.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 -- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0708c0 msgr2=0x7fb2ac1edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:12.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0708c0 0x7fb2ac1edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 -- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac0ad810 msgr2=0x7fb2ac1ee490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac0ad810 0x7fb2ac1ee490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 -- 172.21.15.17:0/1261577338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb294009a70 con 0x7fb2ac159d80 2023-08-09T12:51:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aa59c640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0708c0 0x7fb2ac1edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.391+0000 7fb2aad9d640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0ae160 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c420 tx=0x7fb2a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.392+0000 7fb2a37fe640 1 -- 172.21.15.17:0/1261577338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005ce0 con 0x7fb2ac159d80 2023-08-09T12:51:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.392+0000 7fb2a37fe640 1 -- 172.21.15.17:0/1261577338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4005e40 con 0x7fb2ac159d80 2023-08-09T12:51:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.392+0000 7fb2a37fe640 1 -- 172.21.15.17:0/1261577338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40072d0 con 0x7fb2ac159d80 2023-08-09T12:51:12.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.392+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c009400 con 0x7fb2ac159d80 2023-08-09T12:51:12.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.392+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac0c3520 con 0x7fb2ac159d80 2023-08-09T12:51:12.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.393+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ac067240 con 0x7fb2ac159d80 2023-08-09T12:51:12.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.394+0000 7fb2a37fe640 1 -- 172.21.15.17:0/1261577338 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2a4007430 con 0x7fb2ac159d80 2023-08-09T12:51:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.395+0000 7fb2a37fe640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb28c06a080 0x7fb28c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.395+0000 7fb2a37fe640 1 -- 172.21.15.17:0/1261577338 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2a4087a00 con 0x7fb2ac159d80 2023-08-09T12:51:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.395+0000 7fb2a37fe640 1 -- 172.21.15.17:0/1261577338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7fb28c0721d0 con 0x7fb2ac159d80 2023-08-09T12:51:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.396+0000 7fb2aa59c640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb28c06a080 0x7fb28c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.397+0000 7fb2aa59c640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb28c06a080 0x7fb28c06c540 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb29c038000 tx=0x7fb29c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:12.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.399+0000 7fb2a37fe640 1 -- 172.21.15.17:0/1261577338 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb2a4017060 con 0x7fb2ac159d80 2023-08-09T12:51:12.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.605+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb2ac067a80 con 0x7fb2ac159d80 2023-08-09T12:51:12.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.606+0000 7fb2a37fe640 1 -- 172.21.15.17:0/1261577338 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v163) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb2a4053190 con 0x7fb2ac159d80 2023-08-09T12:51:12.610 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:51:12.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb28c06a080 msgr2=0x7fb28c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:12.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb28c06a080 0x7fb28c06c540 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb29c038000 tx=0x7fb29c03b040 comp rx=0 tx=0).stop 2023-08-09T12:51:12.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac159d80 msgr2=0x7fb2ac0ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:12.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0ae160 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c420 tx=0x7fb2a400c8e0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 shutdown_connections 2023-08-09T12:51:12.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb28c06a080 0x7fb28c06c540 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac159d80 0x7fb2ac0ae160 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2ac0ad810 0x7fb2ac1ee490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 --2- 172.21.15.17:0/1261577338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2ac0708c0 0x7fb2ac1edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:12.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 >> 172.21.15.17:0/1261577338 conn(0x7fb2ac0cb1b0 msgr2=0x7fb2ac0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:12.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 shutdown_connections 2023-08-09T12:51:12.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:12.609+0000 7fb2b0d86640 1 -- 172.21.15.17:0/1261577338 wait complete. 2023-08-09T12:51:12.632 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:51:12.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:12.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:51:12.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:51:12.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:12.757 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:51:12.808 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:51:12.808 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:12.872 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:51:12.872 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:51:12.873 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:12.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:51:12.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:51:12.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:51:12.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:51:13.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.149+0000 7f93bb08e640 1 Processor -- start 2023-08-09T12:51:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.149+0000 7f93bb08e640 1 -- start start 2023-08-09T12:51:13.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93bb08e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 0x7f93b41616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93bb08e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93b40b6000 0x7f93b40cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93bb08e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f93b40d29d0 0x7f93b40d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93bb08e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b40d33a0 con 0x7f93b40d29d0 2023-08-09T12:51:13.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93bb08e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b40b6460 con 0x7f93b40b6000 2023-08-09T12:51:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93bb08e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40cda40 con 0x7f93b415ce90 2023-08-09T12:51:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93b962b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f93b40d29d0 0x7f93b40d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93b962b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f93b40d29d0 0x7f93b40d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53378/0 (socket says 172.21.15.17:53378) 2023-08-09T12:51:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93b962b640 1 -- 172.21.15.17:0/4142680215 learned_addr learned my addr 172.21.15.17:0/4142680215 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.151+0000 7f93b8e2a640 1 --2- 172.21.15.17:0/4142680215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 0x7f93b41616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.152+0000 7f93b3fff640 1 --2- 172.21.15.17:0/4142680215 >> v2:172.21.15.142:3300/0 conn(0x7f93b40b6000 0x7f93b40cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.152+0000 7f93b962b640 1 -- 172.21.15.17:0/4142680215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 msgr2=0x7f93b41616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:13.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.152+0000 7f93b962b640 1 --2- 172.21.15.17:0/4142680215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 0x7f93b41616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.152+0000 7f93b962b640 1 -- 172.21.15.17:0/4142680215 >> v2:172.21.15.142:3300/0 conn(0x7f93b40b6000 msgr2=0x7f93b40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:13.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.152+0000 7f93b962b640 1 --2- 172.21.15.17:0/4142680215 >> v2:172.21.15.142:3300/0 conn(0x7f93b40b6000 0x7f93b40cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.152+0000 7f93b962b640 1 -- 172.21.15.17:0/4142680215 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b40cdd10 con 0x7f93b40d29d0 2023-08-09T12:51:13.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.153+0000 7f93b962b640 1 --2- 172.21.15.17:0/4142680215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b40d2e60 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f93b40d3c80 tx=0x7f93ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4c053c88a8cfe6 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:13.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.153+0000 7f93b37fe640 1 -- 172.21.15.17:0/4142680215 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac031870 con 0x7f93b40d29d0 2023-08-09T12:51:13.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.153+0000 7f93b37fe640 1 -- 172.21.15.17:0/4142680215 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac0319d0 con 0x7f93b40d29d0 2023-08-09T12:51:13.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.153+0000 7f93b37fe640 1 -- 172.21.15.17:0/4142680215 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac031d60 con 0x7f93b40d29d0 2023-08-09T12:51:13.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 -- 172.21.15.17:0/4142680215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 msgr2=0x7f93b40d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 --2- 172.21.15.17:0/4142680215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b40d2e60 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f93b40d3c80 tx=0x7f93ac02b910 comp rx=0 tx=0).stop 2023-08-09T12:51:13.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 -- 172.21.15.17:0/4142680215 shutdown_connections 2023-08-09T12:51:13.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 --2- 172.21.15.17:0/4142680215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b40d2e60 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 --2- 172.21.15.17:0/4142680215 >> v2:172.21.15.142:3300/0 conn(0x7f93b40b6000 0x7f93b40cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 --2- 172.21.15.17:0/4142680215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 0x7f93b41616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 -- 172.21.15.17:0/4142680215 >> 172.21.15.17:0/4142680215 conn(0x7f93b406fde0 msgr2=0x7f93b40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:13.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 -- 172.21.15.17:0/4142680215 shutdown_connections 2023-08-09T12:51:13.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.154+0000 7f93bb08e640 1 -- 172.21.15.17:0/4142680215 wait complete. 2023-08-09T12:51:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.156+0000 7f93bb08e640 1 Processor -- start 2023-08-09T12:51:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.156+0000 7f93bb08e640 1 -- start start 2023-08-09T12:51:13.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93bb08e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b40b6000 0x7f93b40cf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93bb08e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93bb08e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 0x7f93b41e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93bb08e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b41499b0 con 0x7f93b40d29d0 2023-08-09T12:51:13.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93bb08e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4148da0 con 0x7f93b40b6000 2023-08-09T12:51:13.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93bb08e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4149080 con 0x7f93b415ce90 2023-08-09T12:51:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b415ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53386/0 (socket says 172.21.15.17:53386) 2023-08-09T12:51:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.157+0000 7f93b3fff640 1 -- 172.21.15.17:0/2932310190 learned_addr learned my addr 172.21.15.17:0/2932310190 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b3fff640 1 -- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 msgr2=0x7f93b41e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b3fff640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 0x7f93b41e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b3fff640 1 -- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b40b6000 msgr2=0x7f93b40cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b8e2a640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b40b6000 0x7f93b40cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b3fff640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b40b6000 0x7f93b40cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b3fff640 1 -- 172.21.15.17:0/2932310190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0094d0 con 0x7f93b40d29d0 2023-08-09T12:51:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b3fff640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b415ecd0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f93a800d800 tx=0x7f93a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b17fa640 1 -- 172.21.15.17:0/2932310190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800b6c0 con 0x7f93b40d29d0 2023-08-09T12:51:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b17fa640 1 -- 172.21.15.17:0/2932310190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800b820 con 0x7f93b40d29d0 2023-08-09T12:51:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93b17fa640 1 -- 172.21.15.17:0/2932310190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800bbb0 con 0x7f93b40d29d0 2023-08-09T12:51:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.158+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b4149360 con 0x7f93b40d29d0 2023-08-09T12:51:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.159+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b41489c0 con 0x7f93b40d29d0 2023-08-09T12:51:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.160+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b4067a80 con 0x7f93b40d29d0 2023-08-09T12:51:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.161+0000 7f93b17fa640 1 -- 172.21.15.17:0/2932310190 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f93a800bd10 con 0x7f93b40d29d0 2023-08-09T12:51:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.162+0000 7f93b17fa640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f93a006a050 0x7f93a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.162+0000 7f93b17fa640 1 -- 172.21.15.17:0/2932310190 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93a8088b60 con 0x7f93b40d29d0 2023-08-09T12:51:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.163+0000 7f93b17fa640 1 -- 172.21.15.17:0/2932310190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f93a00721a0 con 0x7f93b40d29d0 2023-08-09T12:51:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.163+0000 7f93b8e2a640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f93a006a050 0x7f93a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.164+0000 7f93b8e2a640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f93a006a050 0x7f93a006c510 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009e10 tx=0x7f93a400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.167+0000 7f93b17fa640 1 -- 172.21.15.17:0/2932310190 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f93a80541b0 con 0x7f93b40d29d0 2023-08-09T12:51:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.396+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93b40d0ad0 con 0x7f93b40d29d0 2023-08-09T12:51:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.397+0000 7f93b17fa640 1 -- 172.21.15.17:0/2932310190 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4868 (secure 0 0 0) 0x7f93a80577d0 con 0x7f93b40d29d0 2023-08-09T12:51:13.401 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:13.402 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/734006206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":734006206},{"type":"v1","addr":"172.21.15.142:6835","nonce":734006206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2545254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2545254},{"type":"v1","addr":"172.21.15.142:6837","nonce":2545254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/842290627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":842290627},{"type":"v1","addr":"172.21.15.17:6834","nonce":842290627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:48:46.396953+0000","modified":"2023-08-09T12:48:49.978198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8517":{"gid":8517,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1876401199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1876401199},{"type":"v1","addr":"172.21.15.17:6835","nonce":1876401199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-09T12:51:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 76 2023-08-09T12:51:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f93a006a050 msgr2=0x7f93a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f93a006a050 0x7f93a006c510 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009e10 tx=0x7f93a400b040 comp rx=0 tx=0).stop 2023-08-09T12:51:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 msgr2=0x7f93b415ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b415ecd0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f93a800d800 tx=0x7f93a800dcc0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 shutdown_connections 2023-08-09T12:51:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f93a006a050 0x7f93a006c510 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93b415ce90 0x7f93b41e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93b40d29d0 0x7f93b415ecd0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 --2- 172.21.15.17:0/2932310190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93b40b6000 0x7f93b40cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 >> 172.21.15.17:0/2932310190 conn(0x7f93b406fde0 msgr2=0x7f93b40b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.400+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 shutdown_connections 2023-08-09T12:51:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.401+0000 7f93bb08e640 1 -- 172.21.15.17:0/2932310190 wait complete. 2023-08-09T12:51:13.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:13.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.643+0000 7f859ab22640 1 Processor -- start 2023-08-09T12:51:13.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.643+0000 7f859ab22640 1 -- start start 2023-08-09T12:51:13.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.645+0000 7f859ab22640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8594070f00 0x7f859415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.645+0000 7f859ab22640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8594071340 con 0x7f85941587e0 2023-08-09T12:51:13.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.645+0000 7f859ab22640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940715c0 con 0x7f859415bce0 2023-08-09T12:51:13.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.645+0000 7f859ab22640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85940718a0 con 0x7f8594070f00 2023-08-09T12:51:13.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.645+0000 7f8599b20640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f85941587e0 0x7f85940b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52390/0 (socket says 172.21.15.17:52390) 2023-08-09T12:51:13.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.645+0000 7f8599b20640 1 -- 172.21.15.17:0/3751395900 learned_addr learned my addr 172.21.15.17:0/3751395900 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:13.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.646+0000 7f859931f640 1 --2- 172.21.15.17:0/3751395900 >> v2:172.21.15.142:3300/0 conn(0x7f8594070f00 0x7f859415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.646+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739896069 0 0) 0x7f8594071340 con 0x7f85941587e0 2023-08-09T12:51:13.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.646+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8580003520 con 0x7f85941587e0 2023-08-09T12:51:13.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.646+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012619843 0 0) 0x7f85940715c0 con 0x7f859415bce0 2023-08-09T12:51:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.646+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8594071340 con 0x7f859415bce0 2023-08-09T12:51:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1152095719 0 0) 0x7f8580003520 con 0x7f85941587e0 2023-08-09T12:51:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 >> v2:172.21.15.142:3300/0 conn(0x7f8594070f00 msgr2=0x7f859415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 --2- 172.21.15.17:0/3751395900 >> v2:172.21.15.142:3300/0 conn(0x7f8594070f00 0x7f859415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 >> v1:172.21.15.142:6789/0 conn(0x7f859415bce0 legacy=0x7f85940cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8594071b80 con 0x7f85941587e0 2023-08-09T12:51:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8590001670 con 0x7f85941587e0 2023-08-09T12:51:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 >> v1:172.21.15.17:6789/0 conn(0x7f85941587e0 legacy=0x7f85940b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8580003b00 0x7f8580003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85800047c0 0x7f8580004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8580005180 0x7f858000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940718a0 con 0x7f8580005180 2023-08-09T12:51:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858000c000 con 0x7f8580003b00 2023-08-09T12:51:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858000c1c0 con 0x7f85800047c0 2023-08-09T12:51:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f859a321640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8580005180 0x7f858000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.647+0000 7f8599b20640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8580003b00 0x7f8580003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.648+0000 7f859a321640 1 -- 172.21.15.17:0/3751395900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85800047c0 msgr2=0x7f8580004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.648+0000 7f859a321640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85800047c0 0x7f8580004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.648+0000 7f859a321640 1 -- 172.21.15.17:0/3751395900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8580003b00 msgr2=0x7f8580003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.648+0000 7f859a321640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8580003b00 0x7f8580003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.648+0000 7f859a321640 1 -- 172.21.15.17:0/3751395900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580003520 con 0x7f8580005180 2023-08-09T12:51:13.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.649+0000 7f859a321640 1 -- 172.21.15.17:0/3751395900 reap_dead start 2023-08-09T12:51:13.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.649+0000 7f859a321640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8580005180 0x7f858000b980 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f858c001fd0 tx=0x7f85800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5038b61c359757a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:13.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.649+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c003b70 con 0x7f8580005180 2023-08-09T12:51:13.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.649+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c003cd0 con 0x7f8580005180 2023-08-09T12:51:13.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.649+0000 7f8598b1e640 1 -- 172.21.15.17:0/3751395900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c0052d0 con 0x7f8580005180 2023-08-09T12:51:13.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.650+0000 7f859ab22640 1 -- 172.21.15.17:0/3751395900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8580005180 msgr2=0x7f858000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.650+0000 7f859ab22640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8580005180 0x7f858000b980 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f858c001fd0 tx=0x7f85800057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.650+0000 7f859ab22640 1 -- 172.21.15.17:0/3751395900 shutdown_connections 2023-08-09T12:51:13.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.650+0000 7f859ab22640 1 --2- 172.21.15.17:0/3751395900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8580005180 0x7f858000b980 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.650+0000 7f859ab22640 1 -- 172.21.15.17:0/3751395900 >> 172.21.15.17:0/3751395900 conn(0x7f85940b1d50 msgr2=0x7f859406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:13.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.650+0000 7f859ab22640 1 -- 172.21.15.17:0/3751395900 shutdown_connections 2023-08-09T12:51:13.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.650+0000 7f859ab22640 1 -- 172.21.15.17:0/3751395900 wait complete. 2023-08-09T12:51:13.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.652+0000 7f859ab22640 1 Processor -- start 2023-08-09T12:51:13.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.652+0000 7f859ab22640 1 -- start start 2023-08-09T12:51:13.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859ab22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8580005180 0x7f8594157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859ab22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85941f6690 0x7f85941567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859ab22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85940c7e30 0x7f859415e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859ab22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594156fd0 con 0x7f85940c7e30 2023-08-09T12:51:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859ab22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85941572b0 con 0x7f85941f6690 2023-08-09T12:51:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859ab22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8594157590 con 0x7f8580005180 2023-08-09T12:51:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859a321640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85940c7e30 0x7f859415e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859a321640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85940c7e30 0x7f859415e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53406/0 (socket says 172.21.15.17:53406) 2023-08-09T12:51:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.653+0000 7f859a321640 1 -- 172.21.15.17:0/1408285571 learned_addr learned my addr 172.21.15.17:0/1408285571 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f859931f640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85941f6690 0x7f85941567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f8599b20640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8580005180 0x7f8594157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f859a321640 1 -- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8580005180 msgr2=0x7f8594157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f859a321640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8580005180 0x7f8594157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f859a321640 1 -- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85941f6690 msgr2=0x7f85941567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f859a321640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85941f6690 0x7f85941567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f859a321640 1 -- 172.21.15.17:0/1408285571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8594157870 con 0x7f85940c7e30 2023-08-09T12:51:13.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f8599b20640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8580005180 0x7f8594157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:13.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f859a321640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85940c7e30 0x7f859415e710 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f858c005040 tx=0x7f858c001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:13.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f858a7fc640 1 -- 172.21.15.17:0/1408285571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c03a070 con 0x7f85940c7e30 2023-08-09T12:51:13.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f858a7fc640 1 -- 172.21.15.17:0/1408285571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c02c570 con 0x7f85940c7e30 2023-08-09T12:51:13.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.654+0000 7f858a7fc640 1 -- 172.21.15.17:0/1408285571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c02c8e0 con 0x7f85940c7e30 2023-08-09T12:51:13.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.655+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940c82b0 con 0x7f85940c7e30 2023-08-09T12:51:13.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.655+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859415ee30 con 0x7f85940c7e30 2023-08-09T12:51:13.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.656+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859404e390 con 0x7f85940c7e30 2023-08-09T12:51:13.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.657+0000 7f858a7fc640 1 -- 172.21.15.17:0/1408285571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f858c02ca40 con 0x7f85940c7e30 2023-08-09T12:51:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.658+0000 7f858a7fc640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f857806a080 0x7f857806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.658+0000 7f858a7fc640 1 -- 172.21.15.17:0/1408285571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f858c003e40 con 0x7f85940c7e30 2023-08-09T12:51:13.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.659+0000 7f858a7fc640 1 -- 172.21.15.17:0/1408285571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=164}) v3 -- 0x7f85780721d0 con 0x7f85940c7e30 2023-08-09T12:51:13.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.659+0000 7f8599b20640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f857806a080 0x7f857806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:13.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.660+0000 7f8599b20640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f857806a080 0x7f857806c540 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8590001200 tx=0x7f8590001110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:13.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.663+0000 7f858a7fc640 1 -- 172.21.15.17:0/1408285571 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f858c074900 con 0x7f85940c7e30 2023-08-09T12:51:13.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.865+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8594157110 con 0x7f85940c7e30 2023-08-09T12:51:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.868+0000 7f858a7fc640 1 -- 172.21.15.17:0/1408285571 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+18313 (secure 0 0 0) 0x7f8594157110 con 0x7f85940c7e30 2023-08-09T12:51:13.872 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:13.872 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":163,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:50:33.896529+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:48:44.746706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-09T12:48:45.418671+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f857806a080 msgr2=0x7f857806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f857806a080 0x7f857806c540 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8590001200 tx=0x7f8590001110 comp rx=0 tx=0).stop 2023-08-09T12:51:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85940c7e30 msgr2=0x7f859415e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85940c7e30 0x7f859415e710 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f858c005040 tx=0x7f858c001650 comp rx=0 tx=0).stop 2023-08-09T12:51:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 shutdown_connections 2023-08-09T12:51:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f857806a080 0x7f857806c540 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85940c7e30 0x7f859415e710 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85941f6690 0x7f85941567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 --2- 172.21.15.17:0/1408285571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8580005180 0x7f8594157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 >> 172.21.15.17:0/1408285571 conn(0x7f85940b1d50 msgr2=0x7f85940cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 shutdown_connections 2023-08-09T12:51:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:13.872+0000 7f859ab22640 1 -- 172.21.15.17:0/1408285571 wait complete. 2023-08-09T12:51:13.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:48:44.746706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:48:45.418671+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:51:13.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:51:14.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.132+0000 7fbb49914640 1 Processor -- start 2023-08-09T12:51:14.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.132+0000 7fbb49914640 1 -- start start 2023-08-09T12:51:14.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.134+0000 7fbb49914640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb440b4170 0x7fbb440b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.134+0000 7fbb49914640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b0020 0x7fbb440b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.134+0000 7fbb49914640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4415e7b0 con 0x7fbb4415a8c0 2023-08-09T12:51:14.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.134+0000 7fbb49914640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb440b09d0 con 0x7fbb440b4170 2023-08-09T12:51:14.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.134+0000 7fbb49914640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4415e460 con 0x7fbb440b0020 2023-08-09T12:51:14.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.135+0000 7fbb43fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb440b4170 0x7fbb440b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.135+0000 7fbb49113640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b0020 0x7fbb440b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.135+0000 7fbb49113640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b0020 0x7fbb440b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:42216/0 (socket says 172.21.15.17:42216) 2023-08-09T12:51:14.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.135+0000 7fbb49113640 1 -- 172.21.15.17:0/3281915256 learned_addr learned my addr 172.21.15.17:0/3281915256 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.135+0000 7fbb43fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb440b4170 0x7fbb440b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:40444/0 (socket says 172.21.15.17:40444) 2023-08-09T12:51:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.136+0000 7fbb49113640 1 -- 172.21.15.17:0/3281915256 >> v2:172.21.15.142:3300/0 conn(0x7fbb440b4170 msgr2=0x7fbb440b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.136+0000 7fbb49113640 1 --2- 172.21.15.17:0/3281915256 >> v2:172.21.15.142:3300/0 conn(0x7fbb440b4170 0x7fbb440b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.136+0000 7fbb49113640 1 -- 172.21.15.17:0/3281915256 >> v1:172.21.15.142:6789/0 conn(0x7fbb4415a8c0 legacy=0x7fbb4415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.136+0000 7fbb49113640 1 -- 172.21.15.17:0/3281915256 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4415aca0 con 0x7fbb440b0020 2023-08-09T12:51:14.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.137+0000 7fbb49113640 1 --2- 172.21.15.17:0/3281915256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b0020 0x7fbb440b0490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009e50 tx=0x7fbb3c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf4767d874cb3330 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:14.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.138+0000 7fbb437fe640 1 -- 172.21.15.17:0/3281915256 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c02cb00 con 0x7fbb440b0020 2023-08-09T12:51:14.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.138+0000 7fbb437fe640 1 -- 172.21.15.17:0/3281915256 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c02cc60 con 0x7fbb440b0020 2023-08-09T12:51:14.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.138+0000 7fbb437fe640 1 -- 172.21.15.17:0/3281915256 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0343f0 con 0x7fbb440b0020 2023-08-09T12:51:14.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.139+0000 7fbb49914640 1 -- 172.21.15.17:0/3281915256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b0020 msgr2=0x7fbb440b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.139+0000 7fbb49914640 1 --2- 172.21.15.17:0/3281915256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b0020 0x7fbb440b0490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009e50 tx=0x7fbb3c02bf60 comp rx=0 tx=0).stop 2023-08-09T12:51:14.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.139+0000 7fbb49914640 1 -- 172.21.15.17:0/3281915256 shutdown_connections 2023-08-09T12:51:14.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.139+0000 7fbb49914640 1 --2- 172.21.15.17:0/3281915256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b0020 0x7fbb440b0490 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.139+0000 7fbb49914640 1 --2- 172.21.15.17:0/3281915256 >> v2:172.21.15.142:3300/0 conn(0x7fbb440b4170 0x7fbb440b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.139+0000 7fbb49914640 1 -- 172.21.15.17:0/3281915256 >> 172.21.15.17:0/3281915256 conn(0x7fbb440cb020 msgr2=0x7fbb440cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:14.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.139+0000 7fbb49914640 1 -- 172.21.15.17:0/3281915256 shutdown_connections 2023-08-09T12:51:14.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.139+0000 7fbb49914640 1 -- 172.21.15.17:0/3281915256 wait complete. 2023-08-09T12:51:14.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.142+0000 7fbb49914640 1 Processor -- start 2023-08-09T12:51:14.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.142+0000 7fbb49914640 1 -- start start 2023-08-09T12:51:14.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.143+0000 7fbb49914640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb440b0020 0x7fbb44158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.143+0000 7fbb49914640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b4170 0x7fbb44159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.143+0000 7fbb49914640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4415a8c0 0x7fbb441f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.143+0000 7fbb49914640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb441585d0 con 0x7fbb4415a8c0 2023-08-09T12:51:14.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.143+0000 7fbb49914640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44158fa0 con 0x7fbb440b0020 2023-08-09T12:51:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.143+0000 7fbb49914640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb441579c0 con 0x7fbb440b4170 2023-08-09T12:51:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb49113640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4415a8c0 0x7fbb441f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb49113640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4415a8c0 0x7fbb441f0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53418/0 (socket says 172.21.15.17:53418) 2023-08-09T12:51:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb49113640 1 -- 172.21.15.17:0/2871163749 learned_addr learned my addr 172.21.15.17:0/2871163749 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb48912640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb440b0020 0x7fbb44158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb43fff640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b4170 0x7fbb44159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb49113640 1 -- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b4170 msgr2=0x7fbb44159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb49113640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b4170 0x7fbb44159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb49113640 1 -- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb440b0020 msgr2=0x7fbb44158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb49113640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb440b0020 0x7fbb44158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb49113640 1 -- 172.21.15.17:0/2871163749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c009b30 con 0x7fbb4415a8c0 2023-08-09T12:51:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.144+0000 7fbb48912640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb440b0020 0x7fbb44158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.145+0000 7fbb49113640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4415a8c0 0x7fbb441f0010 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009e50 tx=0x7fbb3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.145+0000 7fbb417fa640 1 -- 172.21.15.17:0/2871163749 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c009510 con 0x7fbb4415a8c0 2023-08-09T12:51:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.145+0000 7fbb417fa640 1 -- 172.21.15.17:0/2871163749 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c03e450 con 0x7fbb4415a8c0 2023-08-09T12:51:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.145+0000 7fbb417fa640 1 -- 172.21.15.17:0/2871163749 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c03e800 con 0x7fbb4415a8c0 2023-08-09T12:51:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.145+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb44157ca0 con 0x7fbb4415a8c0 2023-08-09T12:51:14.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.145+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb44158260 con 0x7fbb4415a8c0 2023-08-09T12:51:14.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.146+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4404e390 con 0x7fbb4415a8c0 2023-08-09T12:51:14.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.148+0000 7fbb417fa640 1 -- 172.21.15.17:0/2871163749 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbb3c03e960 con 0x7fbb4415a8c0 2023-08-09T12:51:14.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.148+0000 7fbb417fa640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb2806a050 0x7fbb2806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.149+0000 7fbb417fa640 1 -- 172.21.15.17:0/2871163749 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb3c0ab350 con 0x7fbb4415a8c0 2023-08-09T12:51:14.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.149+0000 7fbb48912640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb2806a050 0x7fbb2806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.150+0000 7fbb48912640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb2806a050 0x7fbb2806c510 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbb38007fd0 tx=0x7fbb38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:14.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.153+0000 7fbb417fa640 1 -- 172.21.15.17:0/2871163749 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbb3c0769a0 con 0x7fbb4415a8c0 2023-08-09T12:51:14.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.347+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb44158710 con 0x7fbb4415a8c0 2023-08-09T12:51:14.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.348+0000 7fbb417fa640 1 -- 172.21.15.17:0/2871163749 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb3c079fc0 con 0x7fbb4415a8c0 2023-08-09T12:51:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:51:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.350+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb2806a050 msgr2=0x7fbb2806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.350+0000 7fbb49914640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb2806a050 0x7fbb2806c510 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbb38007fd0 tx=0x7fbb38009040 comp rx=0 tx=0).stop 2023-08-09T12:51:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.350+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4415a8c0 msgr2=0x7fbb441f0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.350+0000 7fbb49914640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4415a8c0 0x7fbb441f0010 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009e50 tx=0x7fbb3c004a40 comp rx=0 tx=0).stop 2023-08-09T12:51:14.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.351+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 shutdown_connections 2023-08-09T12:51:14.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.351+0000 7fbb49914640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb2806a050 0x7fbb2806c510 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.351+0000 7fbb49914640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4415a8c0 0x7fbb441f0010 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.351+0000 7fbb49914640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb440b4170 0x7fbb44159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.351+0000 7fbb49914640 1 --2- 172.21.15.17:0/2871163749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb440b0020 0x7fbb44158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.351+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 >> 172.21.15.17:0/2871163749 conn(0x7fbb440cb020 msgr2=0x7fbb4406f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:14.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.351+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 shutdown_connections 2023-08-09T12:51:14.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.351+0000 7fbb49914640 1 -- 172.21.15.17:0/2871163749 wait complete. 2023-08-09T12:51:14.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:51:14.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.610+0000 7f10cd9b5640 1 Processor -- start 2023-08-09T12:51:14.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.610+0000 7f10cd9b5640 1 -- start start 2023-08-09T12:51:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10cd9b5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f10c81616e0 0x7f10c80b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10cd9b5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c80cdd10 con 0x7f10c80d29d0 2023-08-09T12:51:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10cd9b5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c80cdff0 con 0x7f10c815ce90 2023-08-09T12:51:14.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10cd9b5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c80b6540 con 0x7f10c81616e0 2023-08-09T12:51:14.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10c67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f10c81616e0 0x7f10c80b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10c67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f10c81616e0 0x7f10c80b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53422/0 (socket says 172.21.15.17:53422) 2023-08-09T12:51:14.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10c67fc640 1 -- 172.21.15.17:0/3981262138 learned_addr learned my addr 172.21.15.17:0/3981262138 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:14.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10c77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f10c80d29d0 0x7f10c80d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52398/0 (socket says 172.21.15.17:52398) 2023-08-09T12:51:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10c67fc640 1 -- 172.21.15.17:0/3981262138 >> v1:172.21.15.142:6789/0 conn(0x7f10c815ce90 legacy=0x7f10c80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:14.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10c67fc640 1 -- 172.21.15.17:0/3981262138 >> v1:172.21.15.17:6789/0 conn(0x7f10c80d29d0 legacy=0x7f10c80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.612+0000 7f10c67fc640 1 -- 172.21.15.17:0/3981262138 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c80ce2d0 con 0x7f10c81616e0 2023-08-09T12:51:14.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.614+0000 7f10c67fc640 1 --2- 172.21.15.17:0/3981262138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b6000 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009870 tx=0x7f10b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1fab15ebb71734 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.614+0000 7f10c5ffb640 1 -- 172.21.15.17:0/3981262138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b0030860 con 0x7f10c81616e0 2023-08-09T12:51:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.614+0000 7f10c5ffb640 1 -- 172.21.15.17:0/3981262138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b00309c0 con 0x7f10c81616e0 2023-08-09T12:51:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.614+0000 7f10c5ffb640 1 -- 172.21.15.17:0/3981262138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b0030d50 con 0x7f10c81616e0 2023-08-09T12:51:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.615+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3981262138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 msgr2=0x7f10c80b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.615+0000 7f10cd9b5640 1 --2- 172.21.15.17:0/3981262138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b6000 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009870 tx=0x7f10b002b9a0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.615+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3981262138 shutdown_connections 2023-08-09T12:51:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.615+0000 7f10cd9b5640 1 --2- 172.21.15.17:0/3981262138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b6000 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.615+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3981262138 >> 172.21.15.17:0/3981262138 conn(0x7f10c806fde0 msgr2=0x7f10c80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.615+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3981262138 shutdown_connections 2023-08-09T12:51:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.615+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3981262138 wait complete. 2023-08-09T12:51:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.617+0000 7f10cd9b5640 1 Processor -- start 2023-08-09T12:51:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.617+0000 7f10cd9b5640 1 -- start start 2023-08-09T12:51:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10cd9b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c80d29d0 0x7f10c8150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10cd9b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c815ce90 0x7f10c80b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10cd9b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10cd9b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80cbb30 con 0x7f10c81616e0 2023-08-09T12:51:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10cd9b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81507c0 con 0x7f10c815ce90 2023-08-09T12:51:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10cd9b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80caca0 con 0x7f10c80d29d0 2023-08-09T12:51:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53432/0 (socket says 172.21.15.17:53432) 2023-08-09T12:51:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.618+0000 7f10c77fe640 1 -- 172.21.15.17:0/3181570610 learned_addr learned my addr 172.21.15.17:0/3181570610 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c67fc640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c815ce90 0x7f10c80b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c77fe640 1 -- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c80d29d0 msgr2=0x7f10c8150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c6ffd640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c80d29d0 0x7f10c8150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c77fe640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c80d29d0 0x7f10c8150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c77fe640 1 -- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c815ce90 msgr2=0x7f10c80b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c77fe640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c815ce90 0x7f10c80b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c77fe640 1 -- 172.21.15.17:0/3181570610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b00094d0 con 0x7f10c81616e0 2023-08-09T12:51:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c67fc640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c815ce90 0x7f10c80b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c6ffd640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c80d29d0 0x7f10c8150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10c77fe640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b39a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f10c0001eb0 tx=0x7f10c000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10bffff640 1 -- 172.21.15.17:0/3181570610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00074e0 con 0x7f10c81616e0 2023-08-09T12:51:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10bffff640 1 -- 172.21.15.17:0/3181570610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0007640 con 0x7f10c81616e0 2023-08-09T12:51:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10bffff640 1 -- 172.21.15.17:0/3181570610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00049e0 con 0x7f10c81616e0 2023-08-09T12:51:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.619+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c80caeb0 con 0x7f10c81616e0 2023-08-09T12:51:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.620+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c80cb470 con 0x7f10c81616e0 2023-08-09T12:51:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.621+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c8067a80 con 0x7f10c81616e0 2023-08-09T12:51:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.622+0000 7f10bffff640 1 -- 172.21.15.17:0/3181570610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f10c0004b40 con 0x7f10c81616e0 2023-08-09T12:51:14.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.623+0000 7f10bffff640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10a806a050 0x7f10a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:14.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.623+0000 7f10bffff640 1 -- 172.21.15.17:0/3181570610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10c0087fd0 con 0x7f10c81616e0 2023-08-09T12:51:14.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.623+0000 7f10c6ffd640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10a806a050 0x7f10a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:14.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.624+0000 7f10c6ffd640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10a806a050 0x7f10a806c510 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f10b8004520 tx=0x7f10b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:14.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.627+0000 7f10bffff640 1 -- 172.21.15.17:0/3181570610 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f10c0053620 con 0x7f10c81616e0 2023-08-09T12:51:14.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.822+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10c80d0ad0 con 0x7f10c81616e0 2023-08-09T12:51:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.823+0000 7f10bffff640 1 -- 172.21.15.17:0/3181570610 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v164) v1 ==== 92+0+10 (secure 0 0 0) 0x7f10c0056c40 con 0x7f10c81616e0 2023-08-09T12:51:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:51:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.825+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10a806a050 msgr2=0x7f10a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10a806a050 0x7f10a806c510 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f10b8004520 tx=0x7f10b8009040 comp rx=0 tx=0).stop 2023-08-09T12:51:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 msgr2=0x7f10c80b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b39a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f10c0001eb0 tx=0x7f10c000c820 comp rx=0 tx=0).stop 2023-08-09T12:51:14.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 shutdown_connections 2023-08-09T12:51:14.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f10a806a050 0x7f10a806c510 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10c81616e0 0x7f10c80b39a0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c815ce90 0x7f10c80b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 --2- 172.21.15.17:0/3181570610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c80d29d0 0x7f10c8150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:14.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 >> 172.21.15.17:0/3181570610 conn(0x7f10c806fde0 msgr2=0x7f10c815b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:14.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 shutdown_connections 2023-08-09T12:51:14.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:14.826+0000 7f10cd9b5640 1 -- 172.21.15.17:0/3181570610 wait complete. 2023-08-09T12:51:14.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:51:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.087+0000 7f7fafbd6640 1 Processor -- start 2023-08-09T12:51:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.087+0000 7f7fafbd6640 1 -- start start 2023-08-09T12:51:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.089+0000 7f7fafbd6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7fa8161040 0x7f7fa80d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.089+0000 7f7fafbd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80cdef0 0x7f7fa80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.089+0000 7f7fafbd6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80d1fa0 con 0x7f7fa80cfb50 2023-08-09T12:51:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.089+0000 7f7fafbd6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80cec70 con 0x7f7fa8161040 2023-08-09T12:51:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.089+0000 7f7fafbd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80ce990 con 0x7f7fa80cdef0 2023-08-09T12:51:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.089+0000 7f7fae173640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7fa80cfb50 0x7f7fa80b66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52404/0 (socket says 172.21.15.17:52404) 2023-08-09T12:51:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.089+0000 7f7fae173640 1 -- 172.21.15.17:0/1174776519 learned_addr learned my addr 172.21.15.17:0/1174776519 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.089+0000 7f7fad972640 1 --2- 172.21.15.17:0/1174776519 >> v2:172.21.15.142:3300/0 conn(0x7f7fa8161040 0x7f7fa80d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fad171640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80cdef0 0x7f7fa80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548617235 0 0) 0x7f7fa80d1fa0 con 0x7f7fa80cfb50 2023-08-09T12:51:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f94003520 con 0x7f7fa80cfb50 2023-08-09T12:51:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2190605357 0 0) 0x7f7f94003520 con 0x7f7fa80cfb50 2023-08-09T12:51:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80cdef0 msgr2=0x7f7fa80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80cdef0 0x7f7fa80ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 >> v2:172.21.15.142:3300/0 conn(0x7f7fa8161040 msgr2=0x7f7fa80d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 --2- 172.21.15.17:0/1174776519 >> v2:172.21.15.142:3300/0 conn(0x7f7fa8161040 0x7f7fa80d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80d1950 con 0x7f7fa80cfb50 2023-08-09T12:51:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f7fa0001670 con 0x7f7fa80cfb50 2023-08-09T12:51:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 >> v1:172.21.15.17:6789/0 conn(0x7f7fa80cfb50 legacy=0x7f7fa80b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f94003970 0x7f7f94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940047c0 0x7f7f94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80cdef0 0x7f7f94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80cec70 con 0x7f7f940047c0 2023-08-09T12:51:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80ce990 con 0x7f7f94003970 2023-08-09T12:51:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.090+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9400b980 con 0x7f7fa80cdef0 2023-08-09T12:51:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.091+0000 7f7fad171640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940047c0 0x7f7f94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.091+0000 7f7fad972640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f94003970 0x7f7f94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.091+0000 7f7fad171640 1 -- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80cdef0 msgr2=0x7f7f94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.091+0000 7f7fad171640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80cdef0 0x7f7f94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.091+0000 7f7fad171640 1 -- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f94003970 msgr2=0x7f7f94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.091+0000 7f7fad171640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f94003970 0x7f7f94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.091+0000 7f7fad171640 1 -- 172.21.15.17:0/1174776519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94003520 con 0x7f7f940047c0 2023-08-09T12:51:15.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.091+0000 7f7fad972640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f94003970 0x7f7f94003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:15.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.092+0000 7f7fad171640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940047c0 0x7f7f94004c40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009ac0 tx=0x7f7f940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06ef6d1c86390df server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:15.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9802c710 con 0x7f7f940047c0 2023-08-09T12:51:15.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9802c870 con 0x7f7f940047c0 2023-08-09T12:51:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fac970640 1 -- 172.21.15.17:0/1174776519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9802cc00 con 0x7f7f940047c0 2023-08-09T12:51:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1174776519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940047c0 msgr2=0x7f7f94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fafbd6640 1 --2- 172.21.15.17:0/1174776519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940047c0 0x7f7f94004c40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009ac0 tx=0x7f7f940057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fae173640 1 -- 172.21.15.17:0/1174776519 reap_dead start 2023-08-09T12:51:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1174776519 shutdown_connections 2023-08-09T12:51:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1174776519 >> 172.21.15.17:0/1174776519 conn(0x7f7fa8069be0 msgr2=0x7f7fa8069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.093+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1174776519 shutdown_connections 2023-08-09T12:51:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.094+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1174776519 wait complete. 2023-08-09T12:51:15.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.095+0000 7f7fafbd6640 1 Processor -- start 2023-08-09T12:51:15.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.095+0000 7f7fafbd6640 1 -- start start 2023-08-09T12:51:15.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.096+0000 7f7fafbd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fa814e040 0x7f7fa80c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.096+0000 7f7fafbd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80c6780 0x7f7fa815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.096+0000 7f7fafbd6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fa815f360 0x7f7fa80c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.096+0000 7f7fafbd6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa815f7e0 con 0x7f7fa814e040 2023-08-09T12:51:15.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.096+0000 7f7fafbd6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81f75f0 con 0x7f7fa815f360 2023-08-09T12:51:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.096+0000 7f7fafbd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81f69e0 con 0x7f7fa80c6780 2023-08-09T12:51:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fad972640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fa814e040 0x7f7fa80c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fad972640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fa814e040 0x7f7fa80c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53442/0 (socket says 172.21.15.17:53442) 2023-08-09T12:51:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fad972640 1 -- 172.21.15.17:0/1878928070 learned_addr learned my addr 172.21.15.17:0/1878928070 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fad972640 1 -- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80c6780 msgr2=0x7f7fa815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fad972640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80c6780 0x7f7fa815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fae173640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fa815f360 0x7f7fa80c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fad972640 1 -- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fa815f360 msgr2=0x7f7fa80c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fad972640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fa815f360 0x7f7fa80c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fad972640 1 -- 172.21.15.17:0/1878928070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa81f6cc0 con 0x7f7fa814e040 2023-08-09T12:51:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.097+0000 7f7fae173640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fa815f360 0x7f7fa80c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.098+0000 7f7fad972640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fa814e040 0x7f7fa80c6240 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400f3d0 tx=0x7f7fa400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.098+0000 7f7f9e7fc640 1 -- 172.21.15.17:0/1878928070 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa401a070 con 0x7f7fa814e040 2023-08-09T12:51:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.098+0000 7f7f9e7fc640 1 -- 172.21.15.17:0/1878928070 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4003990 con 0x7f7fa814e040 2023-08-09T12:51:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.098+0000 7f7f9e7fc640 1 -- 172.21.15.17:0/1878928070 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4003d00 con 0x7f7fa814e040 2023-08-09T12:51:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.098+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa81f6fa0 con 0x7f7fa814e040 2023-08-09T12:51:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.098+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa81f6690 con 0x7f7fa814e040 2023-08-09T12:51:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.099+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa8067a80 con 0x7f7fa814e040 2023-08-09T12:51:15.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.100+0000 7f7f9e7fc640 1 -- 172.21.15.17:0/1878928070 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7fa4004020 con 0x7f7fa814e040 2023-08-09T12:51:15.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.101+0000 7f7f9e7fc640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f8c06a080 0x7f7f8c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.101+0000 7f7f9e7fc640 1 -- 172.21.15.17:0/1878928070 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fa4089260 con 0x7f7fa814e040 2023-08-09T12:51:15.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.102+0000 7f7fad171640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f8c06a080 0x7f7f8c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.103+0000 7f7fad171640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f8c06a080 0x7f7f8c06c540 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7f98036000 tx=0x7f7f9802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.106+0000 7f7f9e7fc640 1 -- 172.21.15.17:0/1878928070 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7fa4054940 con 0x7f7fa814e040 2023-08-09T12:51:15.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.301+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fa80d1240 con 0x7f7fa814e040 2023-08-09T12:51:15.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.302+0000 7f7f9e7fc640 1 -- 172.21.15.17:0/1878928070 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v164) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7fa4003e60 con 0x7f7fa814e040 2023-08-09T12:51:15.307 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:51:15.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.304+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f8c06a080 msgr2=0x7f7f8c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.304+0000 7f7fafbd6640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f8c06a080 0x7f7f8c06c540 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7f98036000 tx=0x7f7f9802e000 comp rx=0 tx=0).stop 2023-08-09T12:51:15.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fa814e040 msgr2=0x7f7fa80c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fa814e040 0x7f7fa80c6240 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400f3d0 tx=0x7f7fa400f890 comp rx=0 tx=0).stop 2023-08-09T12:51:15.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 shutdown_connections 2023-08-09T12:51:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f8c06a080 0x7f7f8c06c540 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fa815f360 0x7f7fa80c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fa80c6780 0x7f7fa815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 --2- 172.21.15.17:0/1878928070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fa814e040 0x7f7fa80c6240 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 >> 172.21.15.17:0/1878928070 conn(0x7f7fa8069be0 msgr2=0x7f7fa80b49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 shutdown_connections 2023-08-09T12:51:15.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.305+0000 7f7fafbd6640 1 -- 172.21.15.17:0/1878928070 wait complete. 2023-08-09T12:51:15.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:51:15.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.550+0000 7f4923fff640 1 Processor -- start 2023-08-09T12:51:15.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.550+0000 7f4923fff640 1 -- start start 2023-08-09T12:51:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.552+0000 7f4923fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240aedc0 0x7f492406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.552+0000 7f4923fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492415f3a0 con 0x7f492406e310 2023-08-09T12:51:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.552+0000 7f4923fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49240cf2f0 con 0x7f4924072f60 2023-08-09T12:51:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.552+0000 7f4923fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240af1a0 con 0x7f49240aedc0 2023-08-09T12:51:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.552+0000 7f491bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f492406e310 0x7f4924072850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52414/0 (socket says 172.21.15.17:52414) 2023-08-09T12:51:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.552+0000 7f491bfff640 1 -- 172.21.15.17:0/1314208273 learned_addr learned my addr 172.21.15.17:0/1314208273 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f4922ffd640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240aedc0 0x7f492406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280809026 0 0) 0x7f492415f3a0 con 0x7f492406e310 2023-08-09T12:51:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4910003520 con 0x7f492406e310 2023-08-09T12:51:15.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690048080 0 0) 0x7f4910003520 con 0x7f492406e310 2023-08-09T12:51:15.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240aedc0 msgr2=0x7f492406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:15.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240aedc0 0x7f492406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 >> v1:172.21.15.142:6789/0 conn(0x7f4924072f60 legacy=0x7f492415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240cd5c0 con 0x7f492406e310 2023-08-09T12:51:15.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f490c001670 con 0x7f492406e310 2023-08-09T12:51:15.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 >> v1:172.21.15.17:6789/0 conn(0x7f492406e310 legacy=0x7f4924072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49100039a0 0x7f4910003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100047c0 0x7f4910004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240aedc0 0x7f4910005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240af1a0 con 0x7f49100039a0 2023-08-09T12:51:15.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491000fe40 con 0x7f49100047c0 2023-08-09T12:51:15.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.553+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4910010000 con 0x7f49240aedc0 2023-08-09T12:51:15.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f4922ffd640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49100039a0 0x7f4910003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f491bfff640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100047c0 0x7f4910004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f49237fe640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240aedc0 0x7f4910005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f4922ffd640 1 -- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240aedc0 msgr2=0x7f4910005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:15.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f4922ffd640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240aedc0 0x7f4910005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f4922ffd640 1 -- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100047c0 msgr2=0x7f4910004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:15.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f4922ffd640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100047c0 0x7f4910004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f4922ffd640 1 -- 172.21.15.17:0/1314208273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910003520 con 0x7f49100039a0 2023-08-09T12:51:15.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.554+0000 7f491bfff640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100047c0 0x7f4910004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:15.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.555+0000 7f4922ffd640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49100039a0 0x7f4910003dc0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f4914009a90 tx=0x7f49100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0a1b707cf8ea98 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:15.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.556+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491402c680 con 0x7f49100039a0 2023-08-09T12:51:15.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.556+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491402c7e0 con 0x7f49100039a0 2023-08-09T12:51:15.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.556+0000 7f49227fc640 1 -- 172.21.15.17:0/1314208273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491402cb70 con 0x7f49100039a0 2023-08-09T12:51:15.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.556+0000 7f4923fff640 1 -- 172.21.15.17:0/1314208273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49100039a0 msgr2=0x7f4910003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.556+0000 7f4923fff640 1 --2- 172.21.15.17:0/1314208273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49100039a0 0x7f4910003dc0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f4914009a90 tx=0x7f49100057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.556+0000 7f49237fe640 1 -- 172.21.15.17:0/1314208273 reap_dead start 2023-08-09T12:51:15.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.556+0000 7f4923fff640 1 -- 172.21.15.17:0/1314208273 shutdown_connections 2023-08-09T12:51:15.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.556+0000 7f4923fff640 1 -- 172.21.15.17:0/1314208273 >> 172.21.15.17:0/1314208273 conn(0x7f49240b1390 msgr2=0x7f49240b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:15.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.557+0000 7f4923fff640 1 -- 172.21.15.17:0/1314208273 shutdown_connections 2023-08-09T12:51:15.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.557+0000 7f4923fff640 1 -- 172.21.15.17:0/1314208273 wait complete. 2023-08-09T12:51:15.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.558+0000 7f4923fff640 1 Processor -- start 2023-08-09T12:51:15.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.558+0000 7f4923fff640 1 -- start start 2023-08-09T12:51:15.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.559+0000 7f4923fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100039a0 0x7f492414f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.559+0000 7f4923fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49240c46e0 0x7f49240c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.559+0000 7f4923fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240c4b60 0x7f49240c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f4923fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240c7120 con 0x7f49240c46e0 2023-08-09T12:51:15.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f4923fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241f2630 con 0x7f49100039a0 2023-08-09T12:51:15.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f4923fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492414f820 con 0x7f49240c4b60 2023-08-09T12:51:15.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f491bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49240c46e0 0x7f49240c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f491bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49240c46e0 0x7f49240c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53456/0 (socket says 172.21.15.17:53456) 2023-08-09T12:51:15.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f491bfff640 1 -- 172.21.15.17:0/515148353 learned_addr learned my addr 172.21.15.17:0/515148353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:15.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f49237fe640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240c4b60 0x7f49240c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f4922ffd640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100039a0 0x7f492414f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f491bfff640 1 -- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240c4b60 msgr2=0x7f49240c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f491bfff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240c4b60 0x7f49240c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f491bfff640 1 -- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100039a0 msgr2=0x7f492414f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f491bfff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100039a0 0x7f492414f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f491bfff640 1 -- 172.21.15.17:0/515148353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49241f1ab0 con 0x7f49240c46e0 2023-08-09T12:51:15.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f49237fe640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240c4b60 0x7f49240c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:15.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.560+0000 7f4922ffd640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100039a0 0x7f492414f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:15.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.561+0000 7f491bfff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49240c46e0 0x7f49240c50c0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f490c00d810 tx=0x7f490c00dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:15.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.561+0000 7f4920ff9640 1 -- 172.21.15.17:0/515148353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c0074e0 con 0x7f49240c46e0 2023-08-09T12:51:15.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.561+0000 7f4920ff9640 1 -- 172.21.15.17:0/515148353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c007640 con 0x7f49240c46e0 2023-08-09T12:51:15.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.561+0000 7f4920ff9640 1 -- 172.21.15.17:0/515148353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c004a00 con 0x7f49240c46e0 2023-08-09T12:51:15.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.561+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49241f1d90 con 0x7f49240c46e0 2023-08-09T12:51:15.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.561+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49241f2350 con 0x7f49240c46e0 2023-08-09T12:51:15.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.562+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492406e0b0 con 0x7f49240c46e0 2023-08-09T12:51:15.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.564+0000 7f4920ff9640 1 -- 172.21.15.17:0/515148353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f490c004b60 con 0x7f49240c46e0 2023-08-09T12:51:15.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.565+0000 7f4920ff9640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f490406a080 0x7f490406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:15.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.565+0000 7f4920ff9640 1 -- 172.21.15.17:0/515148353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f490c087f00 con 0x7f49240c46e0 2023-08-09T12:51:15.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.566+0000 7f4922ffd640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f490406a080 0x7f490406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:15.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.567+0000 7f4922ffd640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f490406a080 0x7f490406c540 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4914036000 tx=0x7f4914030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:15.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.570+0000 7f4920ff9640 1 -- 172.21.15.17:0/515148353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f490c0535f0 con 0x7f49240c46e0 2023-08-09T12:51:15.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.764+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f492404e390 con 0x7f49240c46e0 2023-08-09T12:51:15.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.765+0000 7f4920ff9640 1 -- 172.21.15.17:0/515148353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v164) v1 ==== 100+0+11 (secure 0 0 0) 0x7f490c0190a0 con 0x7f49240c46e0 2023-08-09T12:51:15.769 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:51:15.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f490406a080 msgr2=0x7f490406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f490406a080 0x7f490406c540 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4914036000 tx=0x7f4914030000 comp rx=0 tx=0).stop 2023-08-09T12:51:15.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49240c46e0 msgr2=0x7f49240c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:15.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49240c46e0 0x7f49240c50c0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f490c00d810 tx=0x7f490c00dcd0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 shutdown_connections 2023-08-09T12:51:15.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f490406a080 0x7f490406c540 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240c4b60 0x7f49240c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49240c46e0 0x7f49240c50c0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 --2- 172.21.15.17:0/515148353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100039a0 0x7f492414f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:15.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.767+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 >> 172.21.15.17:0/515148353 conn(0x7f49240b1390 msgr2=0x7f49240b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:15.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.768+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 shutdown_connections 2023-08-09T12:51:15.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:15.768+0000 7f4923fff640 1 -- 172.21.15.17:0/515148353 wait complete. 2023-08-09T12:51:15.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:51:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.013+0000 7f54bab8b640 1 Processor -- start 2023-08-09T12:51:16.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.013+0000 7f54bab8b640 1 -- start start 2023-08-09T12:51:16.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.015+0000 7f54bab8b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1980 0x7f54b4165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.015+0000 7f54bab8b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40cd520 con 0x7f54b4164f50 2023-08-09T12:51:16.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.015+0000 7f54bab8b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40cc630 con 0x7f54b4162650 2023-08-09T12:51:16.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.015+0000 7f54bab8b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b40cc910 con 0x7f54b40c1980 2023-08-09T12:51:16.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.015+0000 7f54b8927640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f54b4164f50 0x7f54b40cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52424/0 (socket says 172.21.15.17:52424) 2023-08-09T12:51:16.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.015+0000 7f54b8927640 1 -- 172.21.15.17:0/142741855 learned_addr learned my addr 172.21.15.17:0/142741855 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.016+0000 7f54b9128640 1 --2- 172.21.15.17:0/142741855 >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1980 0x7f54b4165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.016+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726455242 0 0) 0x7f54b40cd520 con 0x7f54b4164f50 2023-08-09T12:51:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.016+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549c003520 con 0x7f54b4164f50 2023-08-09T12:51:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3207819966 0 0) 0x7f549c003520 con 0x7f54b4164f50 2023-08-09T12:51:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1980 msgr2=0x7f54b4165a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 --2- 172.21.15.17:0/142741855 >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1980 0x7f54b4165a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 >> v1:172.21.15.142:6789/0 conn(0x7f54b4162650 legacy=0x7f54b4165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40ccbf0 con 0x7f54b4164f50 2023-08-09T12:51:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f54b00019f0 con 0x7f54b4164f50 2023-08-09T12:51:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 >> v1:172.21.15.17:6789/0 conn(0x7f54b4164f50 legacy=0x7f54b40cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f549c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549c0047c0 0x7f549c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549c005180 0x7f549c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40cc910 con 0x7f549c003970 2023-08-09T12:51:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c00c000 con 0x7f549c0047c0 2023-08-09T12:51:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c00c1c0 con 0x7f549c005180 2023-08-09T12:51:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54b8927640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f549c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54b8927640 1 -- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549c005180 msgr2=0x7f549c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54abfff640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549c0047c0 0x7f549c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.017+0000 7f54b9128640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549c005180 0x7f549c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.018+0000 7f54b8927640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549c005180 0x7f549c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.018+0000 7f54b8927640 1 -- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549c0047c0 msgr2=0x7f549c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.018+0000 7f54b8927640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549c0047c0 0x7f549c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.018+0000 7f54b8927640 1 -- 172.21.15.17:0/142741855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c003520 con 0x7f549c003970 2023-08-09T12:51:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.018+0000 7f54b9128640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549c005180 0x7f549c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:16.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.018+0000 7f54abfff640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549c0047c0 0x7f549c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:16.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.018+0000 7f54b9128640 1 -- 172.21.15.17:0/142741855 reap_dead start 2023-08-09T12:51:16.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.019+0000 7f54b8927640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f549c003d70 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f54b000a830 tx=0x7f549c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9229d3a3a792d81 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.019+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0034630 con 0x7f549c003970 2023-08-09T12:51:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.019+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b002f070 con 0x7f549c003970 2023-08-09T12:51:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.019+0000 7f54ab7fe640 1 -- 172.21.15.17:0/142741855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0034a30 con 0x7f549c003970 2023-08-09T12:51:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.019+0000 7f54bab8b640 1 -- 172.21.15.17:0/142741855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 msgr2=0x7f549c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.019+0000 7f54bab8b640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f549c003d70 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f54b000a830 tx=0x7f549c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.020+0000 7f54bab8b640 1 -- 172.21.15.17:0/142741855 shutdown_connections 2023-08-09T12:51:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.020+0000 7f54bab8b640 1 --2- 172.21.15.17:0/142741855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f549c003d70 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.020+0000 7f54bab8b640 1 -- 172.21.15.17:0/142741855 >> 172.21.15.17:0/142741855 conn(0x7f54b40cb1b0 msgr2=0x7f54b40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.020+0000 7f54bab8b640 1 -- 172.21.15.17:0/142741855 shutdown_connections 2023-08-09T12:51:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.020+0000 7f54bab8b640 1 -- 172.21.15.17:0/142741855 wait complete. 2023-08-09T12:51:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.021+0000 7f54bab8b640 1 Processor -- start 2023-08-09T12:51:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.022+0000 7f54bab8b640 1 -- start start 2023-08-09T12:51:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54bab8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f54b40b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54bab8b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b41eb300 0x7f54b4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54bab8b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b41eb740 0x7f54b4157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54bab8b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40b3220 con 0x7f549c003970 2023-08-09T12:51:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54bab8b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4158290 con 0x7f54b41eb300 2023-08-09T12:51:16.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54bab8b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40c4490 con 0x7f54b41eb740 2023-08-09T12:51:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b8927640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f54b40b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b8927640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f54b40b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53482/0 (socket says 172.21.15.17:53482) 2023-08-09T12:51:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b8927640 1 -- 172.21.15.17:0/1472967549 learned_addr learned my addr 172.21.15.17:0/1472967549 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b9128640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b41eb740 0x7f54b4157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54abfff640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b41eb300 0x7f54b4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b8927640 1 -- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b41eb740 msgr2=0x7f54b4157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b8927640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b41eb740 0x7f54b4157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b8927640 1 -- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b41eb300 msgr2=0x7f54b4157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b8927640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b41eb300 0x7f54b4157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b8927640 1 -- 172.21.15.17:0/1472967549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40c41b0 con 0x7f549c003970 2023-08-09T12:51:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.023+0000 7f54b9128640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b41eb740 0x7f54b4157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.024+0000 7f54b8927640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f54b40b3640 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f54b002ca80 tx=0x7f54b0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:16.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.024+0000 7f54a97fa640 1 -- 172.21.15.17:0/1472967549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0034840 con 0x7f549c003970 2023-08-09T12:51:16.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.024+0000 7f54a97fa640 1 -- 172.21.15.17:0/1472967549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b00349a0 con 0x7f549c003970 2023-08-09T12:51:16.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.024+0000 7f54a97fa640 1 -- 172.21.15.17:0/1472967549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0034d10 con 0x7f549c003970 2023-08-09T12:51:16.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.024+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b40b2b60 con 0x7f549c003970 2023-08-09T12:51:16.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.024+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b40c3460 con 0x7f549c003970 2023-08-09T12:51:16.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.025+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4067a80 con 0x7f549c003970 2023-08-09T12:51:16.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.026+0000 7f54a97fa640 1 -- 172.21.15.17:0/1472967549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f54b0031030 con 0x7f549c003970 2023-08-09T12:51:16.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.028+0000 7f54a97fa640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54a006a080 0x7f54a006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.028+0000 7f54a97fa640 1 -- 172.21.15.17:0/1472967549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54b00aabe0 con 0x7f549c003970 2023-08-09T12:51:16.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.028+0000 7f54abfff640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54a006a080 0x7f54a006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.029+0000 7f54abfff640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54a006a080 0x7f54a006c540 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f54b406d5a0 tx=0x7f54a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:16.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.032+0000 7f54a97fa640 1 -- 172.21.15.17:0/1472967549 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f54b00762c0 con 0x7f549c003970 2023-08-09T12:51:16.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.261+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54b40b46b0 con 0x7f549c003970 2023-08-09T12:51:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.262+0000 7f54a97fa640 1 -- 172.21.15.17:0/1472967549 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4868 (secure 0 0 0) 0x7f54b004f300 con 0x7f549c003970 2023-08-09T12:51:16.266 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:16.266 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/734006206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":734006206},{"type":"v1","addr":"172.21.15.142:6835","nonce":734006206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2545254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2545254},{"type":"v1","addr":"172.21.15.142:6837","nonce":2545254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/842290627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":842290627},{"type":"v1","addr":"172.21.15.17:6834","nonce":842290627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:48:46.396953+0000","modified":"2023-08-09T12:48:49.978198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8517":{"gid":8517,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1876401199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1876401199},{"type":"v1","addr":"172.21.15.17:6835","nonce":1876401199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-09T12:51:16.266 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 76 2023-08-09T12:51:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54a006a080 msgr2=0x7f54a006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54a006a080 0x7f54a006c540 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f54b406d5a0 tx=0x7f54a4009040 comp rx=0 tx=0).stop 2023-08-09T12:51:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 msgr2=0x7f54b40b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f54b40b3640 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f54b002ca80 tx=0x7f54b0001d80 comp rx=0 tx=0).stop 2023-08-09T12:51:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 shutdown_connections 2023-08-09T12:51:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f54a006a080 0x7f54a006c540 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b41eb740 0x7f54b4157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b41eb300 0x7f54b4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 --2- 172.21.15.17:0/1472967549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549c003970 0x7f54b40b3640 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 >> 172.21.15.17:0/1472967549 conn(0x7f54b40cb1b0 msgr2=0x7f54b406f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 shutdown_connections 2023-08-09T12:51:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.265+0000 7f54bab8b640 1 -- 172.21.15.17:0/1472967549 wait complete. 2023-08-09T12:51:16.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:16.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.511+0000 7f4f28a44640 1 Processor -- start 2023-08-09T12:51:16.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.511+0000 7f4f28a44640 1 -- start start 2023-08-09T12:51:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.512+0000 7f4f28a44640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f24069ed0 0x7f4f240ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.512+0000 7f4f28a44640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2406fe10 con 0x7f4f240b3fe0 2023-08-09T12:51:16.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.512+0000 7f4f28a44640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f24159fb0 con 0x7f4f24159bd0 2023-08-09T12:51:16.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.512+0000 7f4f28a44640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f240b11a0 con 0x7f4f24069ed0 2023-08-09T12:51:16.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.513+0000 7f4f22ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4f240b3fe0 0x7f4f240697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52438/0 (socket says 172.21.15.17:52438) 2023-08-09T12:51:16.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.513+0000 7f4f22ffd640 1 -- 172.21.15.17:0/2982030784 learned_addr learned my addr 172.21.15.17:0/2982030784 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:16.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.513+0000 7f4f23fff640 1 --2- 172.21.15.17:0/2982030784 >> v2:172.21.15.142:3300/0 conn(0x7f4f24069ed0 0x7f4f240ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.513+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471913778 0 0) 0x7f4f2406fe10 con 0x7f4f240b3fe0 2023-08-09T12:51:16.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.513+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f0c003520 con 0x7f4f240b3fe0 2023-08-09T12:51:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2278520453 0 0) 0x7f4f0c003520 con 0x7f4f240b3fe0 2023-08-09T12:51:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 >> v2:172.21.15.142:3300/0 conn(0x7f4f24069ed0 msgr2=0x7f4f240ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 --2- 172.21.15.17:0/2982030784 >> v2:172.21.15.142:3300/0 conn(0x7f4f24069ed0 0x7f4f240ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 >> v1:172.21.15.142:6789/0 conn(0x7f4f24159bd0 legacy=0x7f4f24070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24070970 con 0x7f4f240b3fe0 2023-08-09T12:51:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f4f18001670 con 0x7f4f240b3fe0 2023-08-09T12:51:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 >> v1:172.21.15.17:6789/0 conn(0x7f4f240b3fe0 legacy=0x7f4f240697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c003970 0x7f4f0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c0047c0 0x7f4f0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f0c005180 0x7f4f0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240b11a0 con 0x7f4f0c005180 2023-08-09T12:51:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c00c120 con 0x7f4f0c003970 2023-08-09T12:51:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c00c2e0 con 0x7f4f0c0047c0 2023-08-09T12:51:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f23fff640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f0c005180 0x7f4f0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.514+0000 7f4f237fe640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c003970 0x7f4f0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.515+0000 7f4f22ffd640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c0047c0 0x7f4f0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.515+0000 7f4f23fff640 1 -- 172.21.15.17:0/2982030784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c0047c0 msgr2=0x7f4f0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.515+0000 7f4f23fff640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c0047c0 0x7f4f0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.515+0000 7f4f23fff640 1 -- 172.21.15.17:0/2982030784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c003970 msgr2=0x7f4f0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.515+0000 7f4f23fff640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c003970 0x7f4f0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.515+0000 7f4f23fff640 1 -- 172.21.15.17:0/2982030784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c003520 con 0x7f4f0c005180 2023-08-09T12:51:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.516+0000 7f4f23fff640 1 -- 172.21.15.17:0/2982030784 reap_dead start 2023-08-09T12:51:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.516+0000 7f4f23fff640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f0c005180 0x7f4f0c00b980 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f4f240cf7f0 tx=0x7f4f0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c460b2c63f725928 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.516+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c02cbd0 con 0x7f4f0c005180 2023-08-09T12:51:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.516+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c00f040 con 0x7f4f0c005180 2023-08-09T12:51:16.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.516+0000 7f4f227fc640 1 -- 172.21.15.17:0/2982030784 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c003990 con 0x7f4f0c005180 2023-08-09T12:51:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.517+0000 7f4f28a44640 1 -- 172.21.15.17:0/2982030784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f0c005180 msgr2=0x7f4f0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.517+0000 7f4f28a44640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f0c005180 0x7f4f0c00b980 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f4f240cf7f0 tx=0x7f4f0c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.517+0000 7f4f28a44640 1 -- 172.21.15.17:0/2982030784 shutdown_connections 2023-08-09T12:51:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.517+0000 7f4f28a44640 1 --2- 172.21.15.17:0/2982030784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f0c005180 0x7f4f0c00b980 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.517+0000 7f4f28a44640 1 -- 172.21.15.17:0/2982030784 >> 172.21.15.17:0/2982030784 conn(0x7f4f240b1d50 msgr2=0x7f4f2406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.517+0000 7f4f28a44640 1 -- 172.21.15.17:0/2982030784 shutdown_connections 2023-08-09T12:51:16.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.517+0000 7f4f28a44640 1 -- 172.21.15.17:0/2982030784 wait complete. 2023-08-09T12:51:16.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.519+0000 7f4f28a44640 1 Processor -- start 2023-08-09T12:51:16.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.519+0000 7f4f28a44640 1 -- start start 2023-08-09T12:51:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f28a44640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c005180 0x7f4f2414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f28a44640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f241578d0 0x7f4f24157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f28a44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2414e4a0 0x7f4f2414e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f28a44640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f24157750 con 0x7f4f2414e4a0 2023-08-09T12:51:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f28a44640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240b3560 con 0x7f4f0c005180 2023-08-09T12:51:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f28a44640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2414ee90 con 0x7f4f241578d0 2023-08-09T12:51:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2414e4a0 0x7f4f2414e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2414e4a0 0x7f4f2414e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53500/0 (socket says 172.21.15.17:53500) 2023-08-09T12:51:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f23fff640 1 -- 172.21.15.17:0/1779441233 learned_addr learned my addr 172.21.15.17:0/1779441233 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f237fe640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c005180 0x7f4f2414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f22ffd640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f241578d0 0x7f4f24157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f23fff640 1 -- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f241578d0 msgr2=0x7f4f24157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f23fff640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f241578d0 0x7f4f24157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f23fff640 1 -- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c005180 msgr2=0x7f4f2414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f23fff640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c005180 0x7f4f2414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f23fff640 1 -- 172.21.15.17:0/1779441233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24156eb0 con 0x7f4f2414e4a0 2023-08-09T12:51:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f22ffd640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f241578d0 0x7f4f24157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.520+0000 7f4f237fe640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c005180 0x7f4f2414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:16.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.521+0000 7f4f23fff640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2414e4a0 0x7f4f2414e950 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c02c640 tx=0x7f4f1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:16.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.521+0000 7f4f0bfff640 1 -- 172.21.15.17:0/1779441233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c004230 con 0x7f4f2414e4a0 2023-08-09T12:51:16.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.521+0000 7f4f0bfff640 1 -- 172.21.15.17:0/1779441233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c004390 con 0x7f4f2414e4a0 2023-08-09T12:51:16.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.521+0000 7f4f0bfff640 1 -- 172.21.15.17:0/1779441233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c004720 con 0x7f4f2414e4a0 2023-08-09T12:51:16.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.521+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f24157190 con 0x7f4f2414e4a0 2023-08-09T12:51:16.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.521+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2415a2f0 con 0x7f4f2414e4a0 2023-08-09T12:51:16.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.522+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2415a150 con 0x7f4f2414e4a0 2023-08-09T12:51:16.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.523+0000 7f4f0bfff640 1 -- 172.21.15.17:0/1779441233 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f1c03f470 con 0x7f4f2414e4a0 2023-08-09T12:51:16.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.524+0000 7f4f0bfff640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f1006a080 0x7f4f1006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.524+0000 7f4f0bfff640 1 -- 172.21.15.17:0/1779441233 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f1c0aaec0 con 0x7f4f2414e4a0 2023-08-09T12:51:16.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.525+0000 7f4f237fe640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f1006a080 0x7f4f1006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.526+0000 7f4f237fe640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f1006a080 0x7f4f1006c540 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4f241594f0 tx=0x7f4f14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:16.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.529+0000 7f4f0bfff640 1 -- 172.21.15.17:0/1779441233 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4f2415a150 con 0x7f4f2414e4a0 2023-08-09T12:51:16.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.722+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f2415a150 con 0x7f4f2414e4a0 2023-08-09T12:51:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.725+0000 7f4f0bfff640 1 -- 172.21.15.17:0/1779441233 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f4f2415a150 con 0x7f4f2414e4a0 2023-08-09T12:51:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":164,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:51:13.914304+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:48:44.746706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-09T12:48:45.418671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:16.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f1006a080 msgr2=0x7f4f1006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f1006a080 0x7f4f1006c540 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4f241594f0 tx=0x7f4f14009040 comp rx=0 tx=0).stop 2023-08-09T12:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2414e4a0 msgr2=0x7f4f2414e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2414e4a0 0x7f4f2414e950 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c02c640 tx=0x7f4f1c009750 comp rx=0 tx=0).stop 2023-08-09T12:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 shutdown_connections 2023-08-09T12:51:16.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f1006a080 0x7f4f1006c540 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2414e4a0 0x7f4f2414e950 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f241578d0 0x7f4f24157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 --2- 172.21.15.17:0/1779441233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c005180 0x7f4f2414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.728+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 >> 172.21.15.17:0/1779441233 conn(0x7f4f240b1d50 msgr2=0x7f4f24150660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:16.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.729+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 shutdown_connections 2023-08-09T12:51:16.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.729+0000 7f4f28a44640 1 -- 172.21.15.17:0/1779441233 wait complete. 2023-08-09T12:51:16.753 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:51:16.753 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:51:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.982+0000 7fcec2122640 1 Processor -- start 2023-08-09T12:51:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.982+0000 7fcec2122640 1 -- start start 2023-08-09T12:51:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.983+0000 7fcec2122640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 0x7fcebc0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.983+0000 7fcec2122640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcebc0cf980 0x7fcebc0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.983+0000 7fcec2122640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0b5a30 con 0x7fcebc160030 2023-08-09T12:51:16.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.983+0000 7fcec2122640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc0d1110 con 0x7fcebc0cf980 2023-08-09T12:51:16.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.983+0000 7fcec2122640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0ceac0 con 0x7fcebc0b86e0 2023-08-09T12:51:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.984+0000 7fcec1921640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcebc0cf980 0x7fcebc0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.984+0000 7fcec1921640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcebc0cf980 0x7fcebc0d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53508/0 (socket says 172.21.15.17:53508) 2023-08-09T12:51:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.984+0000 7fcec1921640 1 -- 172.21.15.17:0/216813333 learned_addr learned my addr 172.21.15.17:0/216813333 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.984+0000 7fcec091f640 1 --2- 172.21.15.17:0/216813333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 0x7fcebc0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.985+0000 7fcec1921640 1 -- 172.21.15.17:0/216813333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 msgr2=0x7fcebc0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.985+0000 7fcec1921640 1 --2- 172.21.15.17:0/216813333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 0x7fcebc0cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.985+0000 7fcec1921640 1 -- 172.21.15.17:0/216813333 >> v1:172.21.15.142:6789/0 conn(0x7fcebc160030 legacy=0x7fcebc160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.985+0000 7fcec1921640 1 -- 172.21.15.17:0/216813333 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0d0d70 con 0x7fcebc0cf980 2023-08-09T12:51:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.986+0000 7fcec1921640 1 --2- 172.21.15.17:0/216813333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc0cf980 0x7fcebc0d1530 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009870 tx=0x7fceb402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b699447bb65c0856 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.986+0000 7fceb3fff640 1 -- 172.21.15.17:0/216813333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4031640 con 0x7fcebc0cf980 2023-08-09T12:51:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.986+0000 7fceb3fff640 1 -- 172.21.15.17:0/216813333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb40317a0 con 0x7fcebc0cf980 2023-08-09T12:51:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.986+0000 7fceb3fff640 1 -- 172.21.15.17:0/216813333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4031b30 con 0x7fcebc0cf980 2023-08-09T12:51:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.987+0000 7fcec2122640 1 -- 172.21.15.17:0/216813333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc0cf980 msgr2=0x7fcebc0d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.987+0000 7fcec2122640 1 --2- 172.21.15.17:0/216813333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc0cf980 0x7fcebc0d1530 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009870 tx=0x7fceb402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.987+0000 7fcec2122640 1 -- 172.21.15.17:0/216813333 shutdown_connections 2023-08-09T12:51:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.987+0000 7fcec2122640 1 --2- 172.21.15.17:0/216813333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc0cf980 0x7fcebc0d1530 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.987+0000 7fcec2122640 1 --2- 172.21.15.17:0/216813333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 0x7fcebc0cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.987+0000 7fcec2122640 1 -- 172.21.15.17:0/216813333 >> 172.21.15.17:0/216813333 conn(0x7fcebc0697c0 msgr2=0x7fcebc069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.987+0000 7fcec2122640 1 -- 172.21.15.17:0/216813333 shutdown_connections 2023-08-09T12:51:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.987+0000 7fcec2122640 1 -- 172.21.15.17:0/216813333 wait complete. 2023-08-09T12:51:16.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.989+0000 7fcec2122640 1 Processor -- start 2023-08-09T12:51:16.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.989+0000 7fcec2122640 1 -- start start 2023-08-09T12:51:16.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.990+0000 7fcec2122640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 0x7fcebc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.990+0000 7fcec2122640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcebc0cf980 0x7fcebc0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.990+0000 7fcec2122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc160030 0x7fcebc1455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:16.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.990+0000 7fcec2122640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0c9b40 con 0x7fcebc160030 2023-08-09T12:51:16.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.990+0000 7fcec2122640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc155040 con 0x7fcebc0cf980 2023-08-09T12:51:16.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.990+0000 7fcec2122640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0c9d90 con 0x7fcebc0b86e0 2023-08-09T12:51:16.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1921640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc160030 0x7fcebc1455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1921640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc160030 0x7fcebc1455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53512/0 (socket says 172.21.15.17:53512) 2023-08-09T12:51:16.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1921640 1 -- 172.21.15.17:0/3825937141 learned_addr learned my addr 172.21.15.17:0/3825937141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:16.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1120640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 0x7fcebc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec091f640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcebc0cf980 0x7fcebc0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:16.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1921640 1 -- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 msgr2=0x7fcebc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1921640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 0x7fcebc154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1921640 1 -- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcebc0cf980 msgr2=0x7fcebc0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:16.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1921640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcebc0cf980 0x7fcebc0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:16.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec1921640 1 -- 172.21.15.17:0/3825937141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40094d0 con 0x7fcebc160030 2023-08-09T12:51:16.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.991+0000 7fcec091f640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcebc0cf980 0x7fcebc0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:16.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.992+0000 7fcec1921640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc160030 0x7fcebc1455c0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009870 tx=0x7fceb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:16.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.992+0000 7fceb1ffb640 1 -- 172.21.15.17:0/3825937141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb403ac60 con 0x7fcebc160030 2023-08-09T12:51:16.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.992+0000 7fceb1ffb640 1 -- 172.21.15.17:0/3825937141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb403adc0 con 0x7fcebc160030 2023-08-09T12:51:16.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.992+0000 7fceb1ffb640 1 -- 172.21.15.17:0/3825937141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4044630 con 0x7fcebc160030 2023-08-09T12:51:16.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.992+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc0ca070 con 0x7fcebc160030 2023-08-09T12:51:16.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.992+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc0ca630 con 0x7fcebc160030 2023-08-09T12:51:16.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.993+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc04e390 con 0x7fcebc160030 2023-08-09T12:51:16.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.994+0000 7fceb1ffb640 1 -- 172.21.15.17:0/3825937141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fceb402f050 con 0x7fcebc160030 2023-08-09T12:51:17.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.996+0000 7fceb1ffb640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcea006a050 0x7fcea006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.996+0000 7fceb1ffb640 1 -- 172.21.15.17:0/3825937141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fceb40aa5c0 con 0x7fcebc160030 2023-08-09T12:51:17.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.996+0000 7fcec1120640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcea006a050 0x7fcea006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:16.998+0000 7fcec1120640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcea006a050 0x7fcea006c510 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009f20 tx=0x7fceb80094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:17.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.001+0000 7fceb1ffb640 1 -- 172.21.15.17:0/3825937141 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fceb4075b80 con 0x7fcebc160030 2023-08-09T12:51:17.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.236+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcebc0d0640 con 0x7fcebc160030 2023-08-09T12:51:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.237+0000 7fceb1ffb640 1 -- 172.21.15.17:0/3825937141 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4868 (secure 0 0 0) 0x7fceb4031e60 con 0x7fcebc160030 2023-08-09T12:51:17.242 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:17.242 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/734006206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":734006206},{"type":"v1","addr":"172.21.15.142:6835","nonce":734006206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2545254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2545254},{"type":"v1","addr":"172.21.15.142:6837","nonce":2545254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/842290627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":842290627},{"type":"v1","addr":"172.21.15.17:6834","nonce":842290627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:48:46.396953+0000","modified":"2023-08-09T12:48:49.978198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8517":{"gid":8517,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1876401199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1876401199},{"type":"v1","addr":"172.21.15.17:6835","nonce":1876401199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-09T12:51:17.243 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 76 2023-08-09T12:51:17.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcea006a050 msgr2=0x7fcea006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:17.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcea006a050 0x7fcea006c510 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009f20 tx=0x7fceb80094d0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc160030 msgr2=0x7fcebc1455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:17.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc160030 0x7fcebc1455c0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009870 tx=0x7fceb40046c0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 shutdown_connections 2023-08-09T12:51:17.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcea006a050 0x7fcea006c510 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc160030 0x7fcebc1455c0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcebc0cf980 0x7fcebc0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 --2- 172.21.15.17:0/3825937141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcebc0b86e0 0x7fcebc154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 >> 172.21.15.17:0/3825937141 conn(0x7fcebc0697c0 msgr2=0x7fcebc0d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:17.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.240+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 shutdown_connections 2023-08-09T12:51:17.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.241+0000 7fcec2122640 1 -- 172.21.15.17:0/3825937141 wait complete. 2023-08-09T12:51:17.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:51:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.482+0000 7efed7fff640 1 Processor -- start 2023-08-09T12:51:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.482+0000 7efed7fff640 1 -- start start 2023-08-09T12:51:17.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.483+0000 7efed7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efed81601f0 0x7efed80b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.483+0000 7efed7fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed80b34a0 con 0x7efed80cb610 2023-08-09T12:51:17.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.484+0000 7efed7fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed80b3780 con 0x7efed80b2ee0 2023-08-09T12:51:17.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.484+0000 7efed7fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80b4120 con 0x7efed81601f0 2023-08-09T12:51:17.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.484+0000 7efed77fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7efed80cb610 0x7efed80c2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52450/0 (socket says 172.21.15.17:52450) 2023-08-09T12:51:17.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.484+0000 7efed77fe640 1 -- 172.21.15.17:0/3492071533 learned_addr learned my addr 172.21.15.17:0/3492071533 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.484+0000 7efed6ffd640 1 --2- 172.21.15.17:0/3492071533 >> v2:172.21.15.142:3300/0 conn(0x7efed81601f0 0x7efed80b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.484+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002185881 0 0) 0x7efed80b34a0 con 0x7efed80cb610 2023-08-09T12:51:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.484+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec0003520 con 0x7efed80cb610 2023-08-09T12:51:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3573460519 0 0) 0x7efec0003520 con 0x7efed80cb610 2023-08-09T12:51:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 >> v2:172.21.15.142:3300/0 conn(0x7efed81601f0 msgr2=0x7efed80b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 --2- 172.21.15.17:0/3492071533 >> v2:172.21.15.142:3300/0 conn(0x7efed81601f0 0x7efed80b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 >> v1:172.21.15.142:6789/0 conn(0x7efed80b2ee0 legacy=0x7efed80caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80b3a60 con 0x7efed80cb610 2023-08-09T12:51:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7efed0001670 con 0x7efed80cb610 2023-08-09T12:51:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed6ffd640 1 --2- 172.21.15.17:0/3492071533 >> v2:172.21.15.142:3300/0 conn(0x7efed81601f0 0x7efed80b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 >> v1:172.21.15.17:6789/0 conn(0x7efed80cb610 legacy=0x7efed80c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec0003970 0x7efec0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec00047c0 0x7efec0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efec0005180 0x7efec000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80b4120 con 0x7efec00047c0 2023-08-09T12:51:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec000c0b0 con 0x7efec0005180 2023-08-09T12:51:17.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec000c270 con 0x7efec0003970 2023-08-09T12:51:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.485+0000 7efed67fc640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec00047c0 0x7efec0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed77fe640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efec0005180 0x7efec000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed6ffd640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec0003970 0x7efec0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed67fc640 1 -- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec0003970 msgr2=0x7efec0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed67fc640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec0003970 0x7efec0003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed67fc640 1 -- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efec0005180 msgr2=0x7efec000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed67fc640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efec0005180 0x7efec000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed67fc640 1 -- 172.21.15.17:0/3492071533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec0003520 con 0x7efec00047c0 2023-08-09T12:51:17.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed77fe640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efec0005180 0x7efec000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:17.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.486+0000 7efed77fe640 1 -- 172.21.15.17:0/3492071533 reap_dead start 2023-08-09T12:51:17.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.487+0000 7efed67fc640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec00047c0 0x7efec0004c40 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7efecc003d80 tx=0x7efec00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542e691b15348fc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:17.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.487+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc032600 con 0x7efec00047c0 2023-08-09T12:51:17.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.487+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc02e050 con 0x7efec00047c0 2023-08-09T12:51:17.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.487+0000 7efed5ffb640 1 -- 172.21.15.17:0/3492071533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0329e0 con 0x7efec00047c0 2023-08-09T12:51:17.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.488+0000 7efed7fff640 1 -- 172.21.15.17:0/3492071533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec00047c0 msgr2=0x7efec0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:17.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.488+0000 7efed7fff640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec00047c0 0x7efec0004c40 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7efecc003d80 tx=0x7efec00057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.488+0000 7efed7fff640 1 -- 172.21.15.17:0/3492071533 shutdown_connections 2023-08-09T12:51:17.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.488+0000 7efed7fff640 1 --2- 172.21.15.17:0/3492071533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec00047c0 0x7efec0004c40 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.488+0000 7efed7fff640 1 -- 172.21.15.17:0/3492071533 >> 172.21.15.17:0/3492071533 conn(0x7efed80b1d50 msgr2=0x7efed806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:17.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.488+0000 7efed7fff640 1 -- 172.21.15.17:0/3492071533 shutdown_connections 2023-08-09T12:51:17.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.488+0000 7efed7fff640 1 -- 172.21.15.17:0/3492071533 wait complete. 2023-08-09T12:51:17.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.490+0000 7efed7fff640 1 Processor -- start 2023-08-09T12:51:17.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.490+0000 7efed7fff640 1 -- start start 2023-08-09T12:51:17.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec00047c0 0x7efed8070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed8070c70 0x7efed81f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed81f1d80 0x7efed81f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed7fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed8145310 con 0x7efed8070c70 2023-08-09T12:51:17.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed7fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed815af70 con 0x7efed81f1d80 2023-08-09T12:51:17.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80711d0 con 0x7efec00047c0 2023-08-09T12:51:17.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed8070c70 0x7efed81f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed8070c70 0x7efed81f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53532/0 (socket says 172.21.15.17:53532) 2023-08-09T12:51:17.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.491+0000 7efed67fc640 1 -- 172.21.15.17:0/1897918159 learned_addr learned my addr 172.21.15.17:0/1897918159 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:17.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed77fe640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed81f1d80 0x7efed81f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed6ffd640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec00047c0 0x7efed8070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed67fc640 1 -- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec00047c0 msgr2=0x7efed8070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:17.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed67fc640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec00047c0 0x7efed8070730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed67fc640 1 -- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed81f1d80 msgr2=0x7efed81f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:17.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed67fc640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed81f1d80 0x7efed81f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed67fc640 1 -- 172.21.15.17:0/1897918159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80714b0 con 0x7efed8070c70 2023-08-09T12:51:17.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed77fe640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed81f1d80 0x7efed81f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:17.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed6ffd640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec00047c0 0x7efed8070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:17.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efed67fc640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed8070c70 0x7efed81f5740 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7efecc035040 tx=0x7efecc0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:17.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efebf7fe640 1 -- 172.21.15.17:0/1897918159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc03c410 con 0x7efed8070c70 2023-08-09T12:51:17.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efebf7fe640 1 -- 172.21.15.17:0/1897918159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc03c570 con 0x7efed8070c70 2023-08-09T12:51:17.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.492+0000 7efebf7fe640 1 -- 172.21.15.17:0/1897918159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc03c900 con 0x7efed8070c70 2023-08-09T12:51:17.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.493+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed815ac00 con 0x7efed8070c70 2023-08-09T12:51:17.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.493+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed815a8f0 con 0x7efed8070c70 2023-08-09T12:51:17.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.494+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed8145310 con 0x7efed8070c70 2023-08-09T12:51:17.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.495+0000 7efebf7fe640 1 -- 172.21.15.17:0/1897918159 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efecc039050 con 0x7efed8070c70 2023-08-09T12:51:17.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.496+0000 7efebf7fe640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efec406a080 0x7efec406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.496+0000 7efebf7fe640 1 -- 172.21.15.17:0/1897918159 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efecc0a9a30 con 0x7efed8070c70 2023-08-09T12:51:17.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.497+0000 7efed6ffd640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efec406a080 0x7efec406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.498+0000 7efed6ffd640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efec406a080 0x7efec406c540 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7efec80094c0 tx=0x7efec800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:17.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.501+0000 7efebf7fe640 1 -- 172.21.15.17:0/1897918159 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efecc075130 con 0x7efed8070c70 2023-08-09T12:51:17.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.731+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efed815b0e0 con 0x7efed8070c70 2023-08-09T12:51:17.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.732+0000 7efebf7fe640 1 -- 172.21.15.17:0/1897918159 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4868 (secure 0 0 0) 0x7efecc037090 con 0x7efed8070c70 2023-08-09T12:51:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:17.736 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/734006206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":734006206},{"type":"v1","addr":"172.21.15.142:6835","nonce":734006206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2545254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2545254},{"type":"v1","addr":"172.21.15.142:6837","nonce":2545254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/842290627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":842290627},{"type":"v1","addr":"172.21.15.17:6834","nonce":842290627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:48:46.396953+0000","modified":"2023-08-09T12:48:49.978198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8517":{"gid":8517,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1876401199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1876401199},{"type":"v1","addr":"172.21.15.17:6835","nonce":1876401199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-09T12:51:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 76 2023-08-09T12:51:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efec406a080 msgr2=0x7efec406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efec406a080 0x7efec406c540 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7efec80094c0 tx=0x7efec800b040 comp rx=0 tx=0).stop 2023-08-09T12:51:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed8070c70 msgr2=0x7efed81f5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed8070c70 0x7efed81f5740 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7efecc035040 tx=0x7efecc0036f0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 shutdown_connections 2023-08-09T12:51:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efec406a080 0x7efec406c540 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed81f1d80 0x7efed81f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed8070c70 0x7efed81f5740 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 --2- 172.21.15.17:0/1897918159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efec00047c0 0x7efed8070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 >> 172.21.15.17:0/1897918159 conn(0x7efed80b1d50 msgr2=0x7efed80c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 shutdown_connections 2023-08-09T12:51:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.735+0000 7efed7fff640 1 -- 172.21.15.17:0/1897918159 wait complete. 2023-08-09T12:51:17.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.988+0000 7fda693a4640 1 Processor -- start 2023-08-09T12:51:17.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.988+0000 7fda693a4640 1 -- start start 2023-08-09T12:51:17.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.989+0000 7fda693a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 0x7fda64070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.989+0000 7fda693a4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda640b0b10 0x7fda6415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.989+0000 7fda693a4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda6415bce0 0x7fda640cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:17.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.989+0000 7fda693a4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda640715c0 con 0x7fda6415bce0 2023-08-09T12:51:17.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.989+0000 7fda693a4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda640718a0 con 0x7fda640b0b10 2023-08-09T12:51:17.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.989+0000 7fda693a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda64071b80 con 0x7fda641587e0 2023-08-09T12:51:17.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda68ba3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda6415bce0 0x7fda640cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda68ba3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda6415bce0 0x7fda640cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58556/0 (socket says 172.21.15.17:58556) 2023-08-09T12:51:17.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda68ba3640 1 -- 172.21.15.17:0/2085543629 learned_addr learned my addr 172.21.15.17:0/2085543629 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:17.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda63fff640 1 --2- 172.21.15.17:0/2085543629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 0x7fda64070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda5bfff640 1 --2- 172.21.15.17:0/2085543629 >> v2:172.21.15.142:3300/0 conn(0x7fda640b0b10 0x7fda6415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:17.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda68ba3640 1 -- 172.21.15.17:0/2085543629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 msgr2=0x7fda64070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda68ba3640 1 --2- 172.21.15.17:0/2085543629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 0x7fda64070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda68ba3640 1 -- 172.21.15.17:0/2085543629 >> v2:172.21.15.142:3300/0 conn(0x7fda640b0b10 msgr2=0x7fda6415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda68ba3640 1 --2- 172.21.15.17:0/2085543629 >> v2:172.21.15.142:3300/0 conn(0x7fda640b0b10 0x7fda6415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:17.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.990+0000 7fda68ba3640 1 -- 172.21.15.17:0/2085543629 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6415b280 con 0x7fda6415bce0 2023-08-09T12:51:18.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.991+0000 7fda68ba3640 1 --2- 172.21.15.17:0/2085543629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6415bce0 0x7fda640cb070 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fda640cf780 tx=0x7fda5c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbef53da6b20d79 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda637fe640 1 -- 172.21.15.17:0/2085543629 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c02ca70 con 0x7fda6415bce0 2023-08-09T12:51:18.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda637fe640 1 -- 172.21.15.17:0/2085543629 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c02cbd0 con 0x7fda6415bce0 2023-08-09T12:51:18.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda637fe640 1 -- 172.21.15.17:0/2085543629 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0343f0 con 0x7fda6415bce0 2023-08-09T12:51:18.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda693a4640 1 -- 172.21.15.17:0/2085543629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6415bce0 msgr2=0x7fda640cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda693a4640 1 --2- 172.21.15.17:0/2085543629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6415bce0 0x7fda640cb070 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fda640cf780 tx=0x7fda5c02bed0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda693a4640 1 -- 172.21.15.17:0/2085543629 shutdown_connections 2023-08-09T12:51:18.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda693a4640 1 --2- 172.21.15.17:0/2085543629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6415bce0 0x7fda640cb070 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda693a4640 1 --2- 172.21.15.17:0/2085543629 >> v2:172.21.15.142:3300/0 conn(0x7fda640b0b10 0x7fda6415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda693a4640 1 --2- 172.21.15.17:0/2085543629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 0x7fda64070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.992+0000 7fda693a4640 1 -- 172.21.15.17:0/2085543629 >> 172.21.15.17:0/2085543629 conn(0x7fda640b1d50 msgr2=0x7fda6406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.993+0000 7fda693a4640 1 -- 172.21.15.17:0/2085543629 shutdown_connections 2023-08-09T12:51:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.993+0000 7fda693a4640 1 -- 172.21.15.17:0/2085543629 wait complete. 2023-08-09T12:51:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.994+0000 7fda693a4640 1 Processor -- start 2023-08-09T12:51:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.994+0000 7fda693a4640 1 -- start start 2023-08-09T12:51:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.995+0000 7fda693a4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda640b0b10 0x7fda640c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.995+0000 7fda693a4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 0x7fda640c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.995+0000 7fda693a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda64159d40 0x7fda640c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.995+0000 7fda693a4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640c3ef0 con 0x7fda64159d40 2023-08-09T12:51:18.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.995+0000 7fda693a4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6414d430 con 0x7fda640b0b10 2023-08-09T12:51:18.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.995+0000 7fda693a4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6414d710 con 0x7fda641587e0 2023-08-09T12:51:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda68ba3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda64159d40 0x7fda640c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda68ba3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda64159d40 0x7fda640c29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58570/0 (socket says 172.21.15.17:58570) 2023-08-09T12:51:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda68ba3640 1 -- 172.21.15.17:0/2547539711 learned_addr learned my addr 172.21.15.17:0/2547539711 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda63fff640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda640b0b10 0x7fda640c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda5bfff640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 0x7fda640c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda68ba3640 1 -- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 msgr2=0x7fda640c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda68ba3640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 0x7fda640c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda68ba3640 1 -- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda640b0b10 msgr2=0x7fda640c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda68ba3640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda640b0b10 0x7fda640c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.996+0000 7fda68ba3640 1 -- 172.21.15.17:0/2547539711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c009b30 con 0x7fda64159d40 2023-08-09T12:51:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.997+0000 7fda68ba3640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda64159d40 0x7fda640c29d0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fda5c036040 tx=0x7fda5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.997+0000 7fda617fa640 1 -- 172.21.15.17:0/2547539711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c009510 con 0x7fda64159d40 2023-08-09T12:51:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.997+0000 7fda617fa640 1 -- 172.21.15.17:0/2547539711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c03e450 con 0x7fda64159d40 2023-08-09T12:51:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.997+0000 7fda617fa640 1 -- 172.21.15.17:0/2547539711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c03e800 con 0x7fda64159d40 2023-08-09T12:51:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.997+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda640c4160 con 0x7fda64159d40 2023-08-09T12:51:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.997+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6414dec0 con 0x7fda64159d40 2023-08-09T12:51:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.998+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6406fa10 con 0x7fda64159d40 2023-08-09T12:51:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:17.999+0000 7fda617fa640 1 -- 172.21.15.17:0/2547539711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda5c03e960 con 0x7fda64159d40 2023-08-09T12:51:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.000+0000 7fda617fa640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4406a050 0x7fda4406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.000+0000 7fda617fa640 1 -- 172.21.15.17:0/2547539711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda5c0ab410 con 0x7fda64159d40 2023-08-09T12:51:18.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.001+0000 7fda63fff640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4406a050 0x7fda4406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.002+0000 7fda63fff640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4406a050 0x7fda4406c510 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fda54006fd0 tx=0x7fda54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.005+0000 7fda617fa640 1 -- 172.21.15.17:0/2547539711 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fda6406fa10 con 0x7fda64159d40 2023-08-09T12:51:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.203+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda6406fa10 con 0x7fda64159d40 2023-08-09T12:51:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.204+0000 7fda617fa640 1 -- 172.21.15.17:0/2547539711 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+18294 (secure 0 0 0) 0x7fda6406fa10 con 0x7fda64159d40 2023-08-09T12:51:18.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:18.209 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":164,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:51:13.914304+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:48:44.746706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-09T12:48:45.418671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4406a050 msgr2=0x7fda4406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4406a050 0x7fda4406c510 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fda54006fd0 tx=0x7fda54008040 comp rx=0 tx=0).stop 2023-08-09T12:51:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda64159d40 msgr2=0x7fda640c29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda64159d40 0x7fda640c29d0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fda5c036040 tx=0x7fda5c004a40 comp rx=0 tx=0).stop 2023-08-09T12:51:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 shutdown_connections 2023-08-09T12:51:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda4406a050 0x7fda4406c510 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda64159d40 0x7fda640c29d0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda641587e0 0x7fda640c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 --2- 172.21.15.17:0/2547539711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda640b0b10 0x7fda640c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 >> 172.21.15.17:0/2547539711 conn(0x7fda640b1d50 msgr2=0x7fda6406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 shutdown_connections 2023-08-09T12:51:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.208+0000 7fda693a4640 1 -- 172.21.15.17:0/2547539711 wait complete. 2023-08-09T12:51:18.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:51:18.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.457+0000 7f5feb59e640 1 Processor -- start 2023-08-09T12:51:18.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.457+0000 7f5feb59e640 1 -- start start 2023-08-09T12:51:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.459+0000 7f5feb59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5fec159bd0 0x7f5fec0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.459+0000 7f5feb59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0697c0 0x7f5fec069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.459+0000 7f5feb59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec06fe10 con 0x7f5fec0b3fe0 2023-08-09T12:51:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.459+0000 7f5feb59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0b11a0 con 0x7f5fec159bd0 2023-08-09T12:51:18.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.459+0000 7f5feb59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec06a190 con 0x7f5fec0697c0 2023-08-09T12:51:18.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.460+0000 7f5fead9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0697c0 0x7f5fec069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.460+0000 7f5fea59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5fec159bd0 0x7f5fec0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.460+0000 7f5fead9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0697c0 0x7f5fec069c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:46956/0 (socket says 172.21.15.17:46956) 2023-08-09T12:51:18.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.460+0000 7f5fead9d640 1 -- 172.21.15.17:0/3665120820 learned_addr learned my addr 172.21.15.17:0/3665120820 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.460+0000 7f5fead9d640 1 -- 172.21.15.17:0/3665120820 >> v2:172.21.15.142:3300/0 conn(0x7f5fec159bd0 msgr2=0x7f5fec0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.460+0000 7f5fead9d640 1 --2- 172.21.15.17:0/3665120820 >> v2:172.21.15.142:3300/0 conn(0x7f5fec159bd0 0x7f5fec0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.460+0000 7f5fead9d640 1 -- 172.21.15.17:0/3665120820 >> v1:172.21.15.142:6789/0 conn(0x7f5fec0b3fe0 legacy=0x7f5fec070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.460+0000 7f5fead9d640 1 -- 172.21.15.17:0/3665120820 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec159fb0 con 0x7f5fec0697c0 2023-08-09T12:51:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.462+0000 7f5fead9d640 1 --2- 172.21.15.17:0/3665120820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0697c0 0x7f5fec069c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009870 tx=0x7f5fe402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1117948c0207efc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.463+0000 7f5fe9d9b640 1 -- 172.21.15.17:0/3665120820 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4031640 con 0x7f5fec0697c0 2023-08-09T12:51:18.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.463+0000 7f5fe9d9b640 1 -- 172.21.15.17:0/3665120820 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe40317a0 con 0x7f5fec0697c0 2023-08-09T12:51:18.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.463+0000 7f5fe9d9b640 1 -- 172.21.15.17:0/3665120820 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4031b30 con 0x7f5fec0697c0 2023-08-09T12:51:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.464+0000 7f5feb59e640 1 -- 172.21.15.17:0/3665120820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0697c0 msgr2=0x7f5fec069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.464+0000 7f5feb59e640 1 --2- 172.21.15.17:0/3665120820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0697c0 0x7f5fec069c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009870 tx=0x7f5fe402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.464+0000 7f5feb59e640 1 -- 172.21.15.17:0/3665120820 shutdown_connections 2023-08-09T12:51:18.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.464+0000 7f5feb59e640 1 --2- 172.21.15.17:0/3665120820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0697c0 0x7f5fec069c50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.464+0000 7f5feb59e640 1 --2- 172.21.15.17:0/3665120820 >> v2:172.21.15.142:3300/0 conn(0x7f5fec159bd0 0x7f5fec0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.464+0000 7f5feb59e640 1 -- 172.21.15.17:0/3665120820 >> 172.21.15.17:0/3665120820 conn(0x7f5fec0b1d50 msgr2=0x7f5fec06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:18.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.464+0000 7f5feb59e640 1 -- 172.21.15.17:0/3665120820 shutdown_connections 2023-08-09T12:51:18.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.464+0000 7f5feb59e640 1 -- 172.21.15.17:0/3665120820 wait complete. 2023-08-09T12:51:18.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.466+0000 7f5feb59e640 1 Processor -- start 2023-08-09T12:51:18.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.467+0000 7f5feb59e640 1 -- start start 2023-08-09T12:51:18.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5feb59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fec0697c0 0x7f5fec0c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5feb59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0b3fe0 0x7f5fec0cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5feb59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fec159bd0 0x7f5fec0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5feb59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec1f0a40 con 0x7f5fec159bd0 2023-08-09T12:51:18.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5feb59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec1efea0 con 0x7f5fec0697c0 2023-08-09T12:51:18.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5feb59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec1f0110 con 0x7f5fec0b3fe0 2023-08-09T12:51:18.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5fead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fec159bd0 0x7f5fec0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5fead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fec159bd0 0x7f5fec0ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58584/0 (socket says 172.21.15.17:58584) 2023-08-09T12:51:18.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5fead9d640 1 -- 172.21.15.17:0/75122857 learned_addr learned my addr 172.21.15.17:0/75122857 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:18.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.468+0000 7f5fea59c640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fec0697c0 0x7f5fec0c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.469+0000 7f5fe1d9b640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0b3fe0 0x7f5fec0cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.469+0000 7f5fead9d640 1 -- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0b3fe0 msgr2=0x7f5fec0cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.469+0000 7f5fead9d640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0b3fe0 0x7f5fec0cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.469+0000 7f5fead9d640 1 -- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fec0697c0 msgr2=0x7f5fec0c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.469+0000 7f5fead9d640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fec0697c0 0x7f5fec0c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.469+0000 7f5fead9d640 1 -- 172.21.15.17:0/75122857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe40094d0 con 0x7f5fec159bd0 2023-08-09T12:51:18.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.469+0000 7f5fead9d640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fec159bd0 0x7f5fec0ce170 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009870 tx=0x7f5fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.470+0000 7f5fe37fe640 1 -- 172.21.15.17:0/75122857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe403a930 con 0x7f5fec159bd0 2023-08-09T12:51:18.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.470+0000 7f5fe37fe640 1 -- 172.21.15.17:0/75122857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe403aab0 con 0x7f5fec159bd0 2023-08-09T12:51:18.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.470+0000 7f5fe37fe640 1 -- 172.21.15.17:0/75122857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe403ae60 con 0x7f5fec159bd0 2023-08-09T12:51:18.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.470+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec1f03f0 con 0x7f5fec159bd0 2023-08-09T12:51:18.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.470+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec0c5420 con 0x7f5fec159bd0 2023-08-09T12:51:18.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.471+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec0c5610 con 0x7f5fec159bd0 2023-08-09T12:51:18.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.472+0000 7f5fe37fe640 1 -- 172.21.15.17:0/75122857 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5fe402f050 con 0x7f5fec159bd0 2023-08-09T12:51:18.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.473+0000 7f5fe37fe640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fcc06a050 0x7f5fcc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.473+0000 7f5fe37fe640 1 -- 172.21.15.17:0/75122857 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fe40aa200 con 0x7f5fec159bd0 2023-08-09T12:51:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.474+0000 7f5fea59c640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fcc06a050 0x7f5fcc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.475+0000 7f5fea59c640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fcc06a050 0x7f5fcc06c510 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0073f0 tx=0x7f5fdc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.479+0000 7f5fe37fe640 1 -- 172.21.15.17:0/75122857 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f5fe40758f0 con 0x7f5fec159bd0 2023-08-09T12:51:18.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.710+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5fec159fb0 con 0x7f5fec159bd0 2023-08-09T12:51:18.715 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:51:18.711+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:51:18.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.722+0000 7f5fe37fe640 1 -- 172.21.15.17:0/75122857 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5fec159fb0 con 0x7f5fec159bd0 2023-08-09T12:51:18.726 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:51:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fcc06a050 msgr2=0x7f5fcc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fcc06a050 0x7f5fcc06c510 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0073f0 tx=0x7f5fdc00b040 comp rx=0 tx=0).stop 2023-08-09T12:51:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fec159bd0 msgr2=0x7f5fec0ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fec159bd0 0x7f5fec0ce170 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009870 tx=0x7f5fe40046c0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 shutdown_connections 2023-08-09T12:51:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f5fcc06a050 0x7f5fcc06c510 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fec159bd0 0x7f5fec0ce170 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fec0b3fe0 0x7f5fec0cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 --2- 172.21.15.17:0/75122857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fec0697c0 0x7f5fec0c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 >> 172.21.15.17:0/75122857 conn(0x7f5fec0b1d50 msgr2=0x7f5fec0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 shutdown_connections 2023-08-09T12:51:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.726+0000 7f5feb59e640 1 -- 172.21.15.17:0/75122857 wait complete. 2023-08-09T12:51:18.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:51:18.804 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:51:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.974+0000 7fc11b59e640 1 Processor -- start 2023-08-09T12:51:18.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.974+0000 7fc11b59e640 1 -- start start 2023-08-09T12:51:18.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.975+0000 7fc11b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c15a8c0 0x7fc11c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.975+0000 7fc11b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b13f0 0x7fc11c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.975+0000 7fc11b59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c15e7b0 con 0x7fc11c15f180 2023-08-09T12:51:18.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.976+0000 7fc11b59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c0b1850 con 0x7fc11c0b13f0 2023-08-09T12:51:18.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.976+0000 7fc11b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c15e460 con 0x7fc11c15a8c0 2023-08-09T12:51:18.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.976+0000 7fc11ad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc11c15f180 0x7fc11c0b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45022/0 (socket says 172.21.15.17:45022) 2023-08-09T12:51:18.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.976+0000 7fc11ad9d640 1 -- 172.21.15.17:0/1639683844 learned_addr learned my addr 172.21.15.17:0/1639683844 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:18.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.976+0000 7fc11a59c640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c15a8c0 0x7fc11c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.976+0000 7fc119d9b640 1 --2- 172.21.15.17:0/1639683844 >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b13f0 0x7fc11c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.976+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117964874 0 0) 0x7fc11c15e7b0 con 0x7fc11c15f180 2023-08-09T12:51:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.976+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc104003520 con 0x7fc11c15f180 2023-08-09T12:51:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718188310 0 0) 0x7fc104003520 con 0x7fc11c15f180 2023-08-09T12:51:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c15a8c0 msgr2=0x7fc11c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c15a8c0 0x7fc11c0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b13f0 msgr2=0x7fc11c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:18.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 --2- 172.21.15.17:0/1639683844 >> v2:172.21.15.142:3300/0 conn(0x7fc11c0b13f0 0x7fc11c15ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c15aca0 con 0x7fc11c15f180 2023-08-09T12:51:18.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc1140019f0 con 0x7fc11c15f180 2023-08-09T12:51:18.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 >> v1:172.21.15.17:6789/0 conn(0x7fc11c15f180 legacy=0x7fc11c0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc104003970 0x7fc104003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c15a8c0 0x7fc1040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc104004d00 0x7fc104005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0b1850 con 0x7fc104004d00 2023-08-09T12:51:18.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c15e460 con 0x7fc104003970 2023-08-09T12:51:18.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10400b980 con 0x7fc11c15a8c0 2023-08-09T12:51:18.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11ad9d640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc104004d00 0x7fc104005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.977+0000 7fc11a59c640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc104003970 0x7fc104003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.978+0000 7fc119d9b640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c15a8c0 0x7fc1040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.978+0000 7fc11ad9d640 1 -- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c15a8c0 msgr2=0x7fc1040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:18.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.978+0000 7fc11ad9d640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11c15a8c0 0x7fc1040047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.978+0000 7fc11ad9d640 1 -- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc104003970 msgr2=0x7fc104003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:18.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.978+0000 7fc11ad9d640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc104003970 0x7fc104003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.978+0000 7fc11ad9d640 1 -- 172.21.15.17:0/1639683844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104003520 con 0x7fc104004d00 2023-08-09T12:51:18.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.979+0000 7fc11ad9d640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc104004d00 0x7fc104005180 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0addd0 tx=0x7fc1040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5151cee45e86da9 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.979+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114034630 con 0x7fc104004d00 2023-08-09T12:51:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.979+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11402f070 con 0x7fc104004d00 2023-08-09T12:51:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.979+0000 7fc11959a640 1 -- 172.21.15.17:0/1639683844 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140349f0 con 0x7fc104004d00 2023-08-09T12:51:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.980+0000 7fc11b59e640 1 -- 172.21.15.17:0/1639683844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc104004d00 msgr2=0x7fc104005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.980+0000 7fc11b59e640 1 --2- 172.21.15.17:0/1639683844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc104004d00 0x7fc104005180 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0addd0 tx=0x7fc1040057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.980+0000 7fc11ad9d640 1 -- 172.21.15.17:0/1639683844 reap_dead start 2023-08-09T12:51:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.980+0000 7fc11b59e640 1 -- 172.21.15.17:0/1639683844 shutdown_connections 2023-08-09T12:51:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.980+0000 7fc11b59e640 1 -- 172.21.15.17:0/1639683844 >> 172.21.15.17:0/1639683844 conn(0x7fc11c0cb020 msgr2=0x7fc11c0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.980+0000 7fc11b59e640 1 -- 172.21.15.17:0/1639683844 shutdown_connections 2023-08-09T12:51:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.980+0000 7fc11b59e640 1 -- 172.21.15.17:0/1639683844 wait complete. 2023-08-09T12:51:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.982+0000 7fc11b59e640 1 Processor -- start 2023-08-09T12:51:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.982+0000 7fc11b59e640 1 -- start start 2023-08-09T12:51:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.983+0000 7fc11b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc104004d00 0x7fc11c1ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.983+0000 7fc11b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c1f1bb0 0x7fc11c0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.983+0000 7fc11b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11c1f2030 0x7fc11c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.983+0000 7fc11b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c154390 con 0x7fc11c1f2030 2023-08-09T12:51:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.983+0000 7fc11b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c154630 con 0x7fc11c1f1bb0 2023-08-09T12:51:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.983+0000 7fc11b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0cdc70 con 0x7fc104004d00 2023-08-09T12:51:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11c1f2030 0x7fc11c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11c1f2030 0x7fc11c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58624/0 (socket says 172.21.15.17:58624) 2023-08-09T12:51:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 -- 172.21.15.17:0/999834017 learned_addr learned my addr 172.21.15.17:0/999834017 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:18.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11a59c640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc104004d00 0x7fc11c1ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc119d9b640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c1f1bb0 0x7fc11c0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 -- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc104004d00 msgr2=0x7fc11c1ed7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc104004d00 0x7fc11c1ed7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 -- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c1f1bb0 msgr2=0x7fc11c0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:18.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c1f1bb0 0x7fc11c0ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:18.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 -- 172.21.15.17:0/999834017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0cdf50 con 0x7fc11c1f2030 2023-08-09T12:51:18.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.984+0000 7fc11ad9d640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11c1f2030 0x7fc11c15bf30 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fc114001cb0 tx=0x7fc114001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.985+0000 7fc10affd640 1 -- 172.21.15.17:0/999834017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114034840 con 0x7fc11c1f2030 2023-08-09T12:51:18.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.985+0000 7fc10affd640 1 -- 172.21.15.17:0/999834017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11402ce90 con 0x7fc11c1f2030 2023-08-09T12:51:18.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.985+0000 7fc10affd640 1 -- 172.21.15.17:0/999834017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114034ba0 con 0x7fc11c1f2030 2023-08-09T12:51:18.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.985+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c0ce230 con 0x7fc11c1f2030 2023-08-09T12:51:18.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.985+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c0cc0e0 con 0x7fc11c1f2030 2023-08-09T12:51:18.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.986+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c0cdad0 con 0x7fc11c1f2030 2023-08-09T12:51:18.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.987+0000 7fc10affd640 1 -- 172.21.15.17:0/999834017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc114031030 con 0x7fc11c1f2030 2023-08-09T12:51:18.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.988+0000 7fc10affd640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0fc06a050 0x7fc0fc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.988+0000 7fc10affd640 1 -- 172.21.15.17:0/999834017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc1140aa860 con 0x7fc11c1f2030 2023-08-09T12:51:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.989+0000 7fc11a59c640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0fc06a050 0x7fc0fc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.990+0000 7fc11a59c640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0fc06a050 0x7fc0fc06c510 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0098d0 tx=0x7fc10c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:18.993+0000 7fc10affd640 1 -- 172.21.15.17:0/999834017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc11c0cdad0 con 0x7fc11c1f2030 2023-08-09T12:51:19.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.222+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc11c0cdad0 con 0x7fc11c1f2030 2023-08-09T12:51:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.722+0000 7fc10affd640 1 -- 172.21.15.17:0/999834017 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc11c0cdad0 con 0x7fc11c1f2030 2023-08-09T12:51:19.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.725+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0fc06a050 msgr2=0x7fc0fc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.725+0000 7fc11b59e640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0fc06a050 0x7fc0fc06c510 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0098d0 tx=0x7fc10c008040 comp rx=0 tx=0).stop 2023-08-09T12:51:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11c1f2030 msgr2=0x7fc11c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:19.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11c1f2030 0x7fc11c15bf30 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fc114001cb0 tx=0x7fc114001d80 comp rx=0 tx=0).stop 2023-08-09T12:51:19.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 shutdown_connections 2023-08-09T12:51:19.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc0fc06a050 0x7fc0fc06c510 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11c1f2030 0x7fc11c15bf30 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc11c1f1bb0 0x7fc11c0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 --2- 172.21.15.17:0/999834017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc104004d00 0x7fc11c1ed7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:19.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 >> 172.21.15.17:0/999834017 conn(0x7fc11c0cb020 msgr2=0x7fc11c158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 shutdown_connections 2023-08-09T12:51:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:19.726+0000 7fc11b59e640 1 -- 172.21.15.17:0/999834017 wait complete. 2023-08-09T12:51:19.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:51:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.028+0000 7fc5c9ff5640 1 Processor -- start 2023-08-09T12:51:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.028+0000 7fc5c9ff5640 1 -- start start 2023-08-09T12:51:20.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c9ff5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5c40cfe90 0x7fc5c40d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c9ff5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5c40d0960 0x7fc5c40b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c9ff5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40d2680 con 0x7fc5c415ccb0 2023-08-09T12:51:20.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c9ff5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40d0f20 con 0x7fc5c40cfe90 2023-08-09T12:51:20.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c9ff5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40d1200 con 0x7fc5c40d0960 2023-08-09T12:51:20.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5c40cfe90 0x7fc5c40d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5c40cfe90 0x7fc5c40d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58626/0 (socket says 172.21.15.17:58626) 2023-08-09T12:51:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c3fff640 1 -- 172.21.15.17:0/1334365442 learned_addr learned my addr 172.21.15.17:0/1334365442 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.030+0000 7fc5c8ff3640 1 --1- 172.21.15.17:0/1334365442 >> v1:172.21.15.17:6789/0 conn(0x7fc5c415ccb0 0x7fc5c40cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45034/0 (socket says 172.21.15.17:45034) 2023-08-09T12:51:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.031+0000 7fc5c97f4640 1 --2- 172.21.15.17:0/1334365442 >> v2:172.21.15.142:3300/0 conn(0x7fc5c40d0960 0x7fc5c40b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.031+0000 7fc5c3fff640 1 -- 172.21.15.17:0/1334365442 >> v2:172.21.15.142:3300/0 conn(0x7fc5c40d0960 msgr2=0x7fc5c40b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.031+0000 7fc5c3fff640 1 --2- 172.21.15.17:0/1334365442 >> v2:172.21.15.142:3300/0 conn(0x7fc5c40d0960 0x7fc5c40b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.031+0000 7fc5c3fff640 1 -- 172.21.15.17:0/1334365442 >> v1:172.21.15.17:6789/0 conn(0x7fc5c415ccb0 legacy=0x7fc5c40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.031+0000 7fc5c3fff640 1 -- 172.21.15.17:0/1334365442 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40d14e0 con 0x7fc5c40cfe90 2023-08-09T12:51:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.031+0000 7fc5c97f4640 1 --2- 172.21.15.17:0/1334365442 >> v2:172.21.15.142:3300/0 conn(0x7fc5c40d0960 0x7fc5c40b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:20.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.032+0000 7fc5c3fff640 1 --2- 172.21.15.17:0/1334365442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c40cfe90 0x7fc5c40d1da0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40d0460 tx=0x7fc5b002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865b63fd9a97f523 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:20.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c37fe640 1 -- 172.21.15.17:0/1334365442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0030870 con 0x7fc5c40cfe90 2023-08-09T12:51:20.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c37fe640 1 -- 172.21.15.17:0/1334365442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b00309d0 con 0x7fc5c40cfe90 2023-08-09T12:51:20.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c37fe640 1 -- 172.21.15.17:0/1334365442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0030d60 con 0x7fc5c40cfe90 2023-08-09T12:51:20.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/1334365442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c40cfe90 msgr2=0x7fc5c40d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/1334365442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c40cfe90 0x7fc5c40d1da0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40d0460 tx=0x7fc5b002b9b0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/1334365442 shutdown_connections 2023-08-09T12:51:20.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/1334365442 >> v2:172.21.15.142:3300/0 conn(0x7fc5c40d0960 0x7fc5c40b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/1334365442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c40cfe90 0x7fc5c40d1da0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/1334365442 >> 172.21.15.17:0/1334365442 conn(0x7fc5c40699a0 msgr2=0x7fc5c4069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:20.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/1334365442 shutdown_connections 2023-08-09T12:51:20.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.033+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/1334365442 wait complete. 2023-08-09T12:51:20.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.035+0000 7fc5c9ff5640 1 Processor -- start 2023-08-09T12:51:20.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.035+0000 7fc5c9ff5640 1 -- start start 2023-08-09T12:51:20.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c9ff5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5c40cfe90 0x7fc5c415fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c9ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5c40d0960 0x7fc5c40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c9ff5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c415ccb0 0x7fc5c415dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c9ff5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41f1fc0 con 0x7fc5c415ccb0 2023-08-09T12:51:20.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c9ff5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40a9660 con 0x7fc5c40d0960 2023-08-09T12:51:20.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c9ff5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c415ead0 con 0x7fc5c40cfe90 2023-08-09T12:51:20.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c97f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c415ccb0 0x7fc5c415dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c97f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c415ccb0 0x7fc5c415dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58634/0 (socket says 172.21.15.17:58634) 2023-08-09T12:51:20.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.036+0000 7fc5c97f4640 1 -- 172.21.15.17:0/846641338 learned_addr learned my addr 172.21.15.17:0/846641338 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:20.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c97f4640 1 -- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5c40cfe90 msgr2=0x7fc5c415fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c97f4640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5c40cfe90 0x7fc5c415fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c97f4640 1 -- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5c40d0960 msgr2=0x7fc5c40b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c3fff640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5c40d0960 0x7fc5c40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c97f4640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5c40d0960 0x7fc5c40b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c97f4640 1 -- 172.21.15.17:0/846641338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00094d0 con 0x7fc5c415ccb0 2023-08-09T12:51:20.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c97f4640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c415ccb0 0x7fc5c415dea0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00ce40 tx=0x7fc5bc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:20.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c17fa640 1 -- 172.21.15.17:0/846641338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00d840 con 0x7fc5c415ccb0 2023-08-09T12:51:20.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c17fa640 1 -- 172.21.15.17:0/846641338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc00d9a0 con 0x7fc5c415ccb0 2023-08-09T12:51:20.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.037+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c415edb0 con 0x7fc5c415ccb0 2023-08-09T12:51:20.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.038+0000 7fc5c17fa640 1 -- 172.21.15.17:0/846641338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00dd50 con 0x7fc5c415ccb0 2023-08-09T12:51:20.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.038+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c415f650 con 0x7fc5c415ccb0 2023-08-09T12:51:20.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.039+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c404e390 con 0x7fc5c415ccb0 2023-08-09T12:51:20.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.040+0000 7fc5c17fa640 1 -- 172.21.15.17:0/846641338 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5bc01e3b0 con 0x7fc5c415ccb0 2023-08-09T12:51:20.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.041+0000 7fc5c17fa640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a806a050 0x7fc5a806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.041+0000 7fc5c17fa640 1 -- 172.21.15.17:0/846641338 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc5bc088ff0 con 0x7fc5c415ccb0 2023-08-09T12:51:20.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.041+0000 7fc5c8ff3640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a806a050 0x7fc5a806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.042+0000 7fc5c8ff3640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a806a050 0x7fc5a806c510 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8007fd0 tx=0x7fc5b8007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:20.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.045+0000 7fc5c17fa640 1 -- 172.21.15.17:0/846641338 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc5bc054670 con 0x7fc5c415ccb0 2023-08-09T12:51:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.230+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc5c40b4ad0 con 0x7fc5c415ccb0 2023-08-09T12:51:20.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.735+0000 7fc5c17fa640 1 -- 172.21.15.17:0/846641338 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v166) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc5bc01a020 con 0x7fc5c415ccb0 2023-08-09T12:51:20.739 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:51:20.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a806a050 msgr2=0x7fc5a806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a806a050 0x7fc5a806c510 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8007fd0 tx=0x7fc5b8007980 comp rx=0 tx=0).stop 2023-08-09T12:51:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c415ccb0 msgr2=0x7fc5c415dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c415ccb0 0x7fc5c415dea0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00ce40 tx=0x7fc5bc00a710 comp rx=0 tx=0).stop 2023-08-09T12:51:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 shutdown_connections 2023-08-09T12:51:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc5a806a050 0x7fc5a806c510 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c415ccb0 0x7fc5c415dea0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5c40d0960 0x7fc5c40b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 --2- 172.21.15.17:0/846641338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5c40cfe90 0x7fc5c415fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.740+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 >> 172.21.15.17:0/846641338 conn(0x7fc5c40699a0 msgr2=0x7fc5c40cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.741+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 shutdown_connections 2023-08-09T12:51:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.741+0000 7fc5c9ff5640 1 -- 172.21.15.17:0/846641338 wait complete. 2023-08-09T12:51:20.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:51:20.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.983+0000 7f32e7fff640 1 Processor -- start 2023-08-09T12:51:20.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.983+0000 7f32e7fff640 1 -- start start 2023-08-09T12:51:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.984+0000 7f32e7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80cf380 0x7f32e80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.984+0000 7f32e7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f32e80ce470 0x7f32e80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.984+0000 7f32e7fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e815cff0 con 0x7f32e815cc10 2023-08-09T12:51:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.984+0000 7f32e7fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e80b21a0 con 0x7f32e80ce470 2023-08-09T12:51:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.984+0000 7f32e7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80b2a40 con 0x7f32e80cf380 2023-08-09T12:51:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.984+0000 7f32e77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f32e80ce470 0x7f32e80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.985+0000 7f32e77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f32e80ce470 0x7f32e80cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58638/0 (socket says 172.21.15.17:58638) 2023-08-09T12:51:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.985+0000 7f32e77fe640 1 -- 172.21.15.17:0/3593181298 learned_addr learned my addr 172.21.15.17:0/3593181298 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.985+0000 7f32e6ffd640 1 --1- 172.21.15.17:0/3593181298 >> v1:172.21.15.17:6789/0 conn(0x7f32e815cc10 0x7f32e80cec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45040/0 (socket says 172.21.15.17:45040) 2023-08-09T12:51:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.985+0000 7f32e67fc640 1 --2- 172.21.15.17:0/3593181298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80cf380 0x7f32e80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.985+0000 7f32e77fe640 1 -- 172.21.15.17:0/3593181298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80cf380 msgr2=0x7f32e80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.985+0000 7f32e77fe640 1 --2- 172.21.15.17:0/3593181298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80cf380 0x7f32e80cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.985+0000 7f32e77fe640 1 -- 172.21.15.17:0/3593181298 >> v1:172.21.15.17:6789/0 conn(0x7f32e815cc10 legacy=0x7f32e80cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.985+0000 7f32e77fe640 1 -- 172.21.15.17:0/3593181298 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80afb90 con 0x7f32e80ce470 2023-08-09T12:51:20.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.986+0000 7f32e77fe640 1 --2- 172.21.15.17:0/3593181298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e80ce470 0x7f32e80cb2a0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009870 tx=0x7f32e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e142557e8ef02b43 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.986+0000 7f32e5ffb640 1 -- 172.21.15.17:0/3593181298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0030840 con 0x7f32e80ce470 2023-08-09T12:51:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.986+0000 7f32e5ffb640 1 -- 172.21.15.17:0/3593181298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e00309a0 con 0x7f32e80ce470 2023-08-09T12:51:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.986+0000 7f32e5ffb640 1 -- 172.21.15.17:0/3593181298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0030d30 con 0x7f32e80ce470 2023-08-09T12:51:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.987+0000 7f32e7fff640 1 -- 172.21.15.17:0/3593181298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e80ce470 msgr2=0x7f32e80cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.987+0000 7f32e7fff640 1 --2- 172.21.15.17:0/3593181298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e80ce470 0x7f32e80cb2a0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009870 tx=0x7f32e002b980 comp rx=0 tx=0).stop 2023-08-09T12:51:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.987+0000 7f32e7fff640 1 -- 172.21.15.17:0/3593181298 shutdown_connections 2023-08-09T12:51:20.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.987+0000 7f32e7fff640 1 --2- 172.21.15.17:0/3593181298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e80ce470 0x7f32e80cb2a0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.987+0000 7f32e7fff640 1 --2- 172.21.15.17:0/3593181298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80cf380 0x7f32e80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.987+0000 7f32e7fff640 1 -- 172.21.15.17:0/3593181298 >> 172.21.15.17:0/3593181298 conn(0x7f32e80b3670 msgr2=0x7f32e80b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:20.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.987+0000 7f32e7fff640 1 -- 172.21.15.17:0/3593181298 shutdown_connections 2023-08-09T12:51:20.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.987+0000 7f32e7fff640 1 -- 172.21.15.17:0/3593181298 wait complete. 2023-08-09T12:51:20.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.989+0000 7f32e7fff640 1 Processor -- start 2023-08-09T12:51:20.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.989+0000 7f32e7fff640 1 -- start start 2023-08-09T12:51:20.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.990+0000 7f32e7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80ce470 0x7f32e8148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.990+0000 7f32e7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e80cf380 0x7f32e8156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.990+0000 7f32e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e815cc10 0x7f32e80c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.990+0000 7f32e7fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e815deb0 con 0x7f32e815cc10 2023-08-09T12:51:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.990+0000 7f32e7fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e8149060 con 0x7f32e80cf380 2023-08-09T12:51:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.990+0000 7f32e7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e815d230 con 0x7f32e80ce470 2023-08-09T12:51:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.990+0000 7f32e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e815cc10 0x7f32e80c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e815cc10 0x7f32e80c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58654/0 (socket says 172.21.15.17:58654) 2023-08-09T12:51:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e77fe640 1 -- 172.21.15.17:0/2868211645 learned_addr learned my addr 172.21.15.17:0/2868211645 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e6ffd640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80ce470 0x7f32e8148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e67fc640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e80cf380 0x7f32e8156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e77fe640 1 -- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80ce470 msgr2=0x7f32e8148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e77fe640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80ce470 0x7f32e8148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e77fe640 1 -- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e80cf380 msgr2=0x7f32e8156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e77fe640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e80cf380 0x7f32e8156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e77fe640 1 -- 172.21.15.17:0/2868211645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00094d0 con 0x7f32e815cc10 2023-08-09T12:51:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.991+0000 7f32e77fe640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e815cc10 0x7f32e80c9590 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009870 tx=0x7f32e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.992+0000 7f32df7fe640 1 -- 172.21.15.17:0/2868211645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0039c90 con 0x7f32e815cc10 2023-08-09T12:51:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.992+0000 7f32df7fe640 1 -- 172.21.15.17:0/2868211645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0039e10 con 0x7f32e815cc10 2023-08-09T12:51:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.992+0000 7f32df7fe640 1 -- 172.21.15.17:0/2868211645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0043640 con 0x7f32e815cc10 2023-08-09T12:51:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.992+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e815d510 con 0x7f32e815cc10 2023-08-09T12:51:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.992+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e815dad0 con 0x7f32e815cc10 2023-08-09T12:51:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.993+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e815dff0 con 0x7f32e815cc10 2023-08-09T12:51:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.994+0000 7f32df7fe640 1 -- 172.21.15.17:0/2868211645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f32e00437a0 con 0x7f32e815cc10 2023-08-09T12:51:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.995+0000 7f32df7fe640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f32c806a050 0x7f32c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:20.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.995+0000 7f32df7fe640 1 -- 172.21.15.17:0/2868211645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f32e003e070 con 0x7f32e815cc10 2023-08-09T12:51:20.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.996+0000 7f32e6ffd640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f32c806a050 0x7f32c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:20.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.997+0000 7f32e6ffd640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f32c806a050 0x7f32c806c510 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f32d8007fd0 tx=0x7f32d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:20.999+0000 7f32df7fe640 1 -- 172.21.15.17:0/2868211645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f32e815dff0 con 0x7f32e815cc10 2023-08-09T12:51:21.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.192+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32e815dff0 con 0x7f32e815cc10 2023-08-09T12:51:21.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.748+0000 7f32df7fe640 1 -- 172.21.15.17:0/2868211645 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v167) v1 ==== 169+0+0 (secure 0 0 0) 0x7f32e815dff0 con 0x7f32e815cc10 2023-08-09T12:51:21.753 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:51:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f32c806a050 msgr2=0x7f32c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f32c806a050 0x7f32c806c510 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f32d8007fd0 tx=0x7f32d8009040 comp rx=0 tx=0).stop 2023-08-09T12:51:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e815cc10 msgr2=0x7f32e80c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e815cc10 0x7f32e80c9590 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009870 tx=0x7f32e0004730 comp rx=0 tx=0).stop 2023-08-09T12:51:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 shutdown_connections 2023-08-09T12:51:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f32c806a050 0x7f32c806c510 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e815cc10 0x7f32e80c9590 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e80cf380 0x7f32e8156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 --2- 172.21.15.17:0/2868211645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e80ce470 0x7f32e8148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 >> 172.21.15.17:0/2868211645 conn(0x7f32e80b3670 msgr2=0x7f32e80af380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 shutdown_connections 2023-08-09T12:51:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:21.753+0000 7f32e7fff640 1 -- 172.21.15.17:0/2868211645 wait complete. 2023-08-09T12:51:21.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:51:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.014+0000 7f19baf4f640 1 Processor -- start 2023-08-09T12:51:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.014+0000 7f19baf4f640 1 -- start start 2023-08-09T12:51:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.015+0000 7f19baf4f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19b415cb40 0x7f19b41609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.015+0000 7f19baf4f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19b40b8420 0x7f19b40cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19baf4f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b40d0f00 con 0x7f19b415cf20 2023-08-09T12:51:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19baf4f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b41611f0 con 0x7f19b415cb40 2023-08-09T12:51:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19baf4f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b41614d0 con 0x7f19b40b8420 2023-08-09T12:51:22.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19b9f4d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19b415cb40 0x7f19b41609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19b9f4d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19b415cb40 0x7f19b41609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58662/0 (socket says 172.21.15.17:58662) 2023-08-09T12:51:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19b9f4d640 1 -- 172.21.15.17:0/356163702 learned_addr learned my addr 172.21.15.17:0/356163702 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19b9f4d640 1 -- 172.21.15.17:0/356163702 >> v2:172.21.15.142:3300/0 conn(0x7f19b40b8420 msgr2=0x7f19b40cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19b974c640 1 --2- 172.21.15.17:0/356163702 >> v2:172.21.15.142:3300/0 conn(0x7f19b40b8420 0x7f19b40cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19b9f4d640 1 --2- 172.21.15.17:0/356163702 >> v2:172.21.15.142:3300/0 conn(0x7f19b40b8420 0x7f19b40cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19b9f4d640 1 -- 172.21.15.17:0/356163702 >> v1:172.21.15.142:6789/0 conn(0x7f19b415cf20 legacy=0x7f19b40697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.016+0000 7f19b9f4d640 1 -- 172.21.15.17:0/356163702 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b41617b0 con 0x7f19b415cb40 2023-08-09T12:51:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.017+0000 7f19b974c640 1 --2- 172.21.15.17:0/356163702 >> v2:172.21.15.142:3300/0 conn(0x7f19b40b8420 0x7f19b40cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.018+0000 7f19b9f4d640 1 --2- 172.21.15.17:0/356163702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b415cb40 0x7f19b41609a0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f19b40cf4d0 tx=0x7f19a402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4af17513395980 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.018+0000 7f19b8f4b640 1 -- 172.21.15.17:0/356163702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a402cb20 con 0x7f19b415cb40 2023-08-09T12:51:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.018+0000 7f19b8f4b640 1 -- 172.21.15.17:0/356163702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a402cc80 con 0x7f19b415cb40 2023-08-09T12:51:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.018+0000 7f19b8f4b640 1 -- 172.21.15.17:0/356163702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40343f0 con 0x7f19b415cb40 2023-08-09T12:51:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.019+0000 7f19baf4f640 1 -- 172.21.15.17:0/356163702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b415cb40 msgr2=0x7f19b41609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.019+0000 7f19baf4f640 1 --2- 172.21.15.17:0/356163702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b415cb40 0x7f19b41609a0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f19b40cf4d0 tx=0x7f19a402bf80 comp rx=0 tx=0).stop 2023-08-09T12:51:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.019+0000 7f19baf4f640 1 -- 172.21.15.17:0/356163702 shutdown_connections 2023-08-09T12:51:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.019+0000 7f19baf4f640 1 --2- 172.21.15.17:0/356163702 >> v2:172.21.15.142:3300/0 conn(0x7f19b40b8420 0x7f19b40cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.019+0000 7f19baf4f640 1 --2- 172.21.15.17:0/356163702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b415cb40 0x7f19b41609a0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.019+0000 7f19baf4f640 1 -- 172.21.15.17:0/356163702 >> 172.21.15.17:0/356163702 conn(0x7f19b40d2ab0 msgr2=0x7f19b40d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.019+0000 7f19baf4f640 1 -- 172.21.15.17:0/356163702 shutdown_connections 2023-08-09T12:51:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.019+0000 7f19baf4f640 1 -- 172.21.15.17:0/356163702 wait complete. 2023-08-09T12:51:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.021+0000 7f19baf4f640 1 Processor -- start 2023-08-09T12:51:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.021+0000 7f19baf4f640 1 -- start start 2023-08-09T12:51:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19baf4f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b40b8420 0x7f19b4157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19baf4f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19b415cb40 0x7f19b40a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19baf4f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19b415cf20 0x7f19b415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19baf4f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40ab220 con 0x7f19b40b8420 2023-08-09T12:51:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19baf4f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b415e900 con 0x7f19b415cf20 2023-08-09T12:51:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19baf4f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b415ebe0 con 0x7f19b415cb40 2023-08-09T12:51:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19b9f4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b40b8420 0x7f19b4157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19b9f4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b40b8420 0x7f19b4157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58678/0 (socket says 172.21.15.17:58678) 2023-08-09T12:51:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19b9f4d640 1 -- 172.21.15.17:0/532216414 learned_addr learned my addr 172.21.15.17:0/532216414 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19b974c640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19b415cb40 0x7f19b40a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19b9f4d640 1 -- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19b415cb40 msgr2=0x7f19b40a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19b9f4d640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19b415cb40 0x7f19b40a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19b9f4d640 1 -- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19b415cf20 msgr2=0x7f19b415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.023+0000 7f19ba74e640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19b415cf20 0x7f19b415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.024+0000 7f19b9f4d640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19b415cf20 0x7f19b415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.024+0000 7f19b9f4d640 1 -- 172.21.15.17:0/532216414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4009b30 con 0x7f19b40b8420 2023-08-09T12:51:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.024+0000 7f19ba74e640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19b415cf20 0x7f19b415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.024+0000 7f19b9f4d640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b40b8420 0x7f19b4157450 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f19a4000f80 tx=0x7f19a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.024+0000 7f19b27fc640 1 -- 172.21.15.17:0/532216414 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4009510 con 0x7f19b40b8420 2023-08-09T12:51:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.024+0000 7f19b27fc640 1 -- 172.21.15.17:0/532216414 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a403e450 con 0x7f19b40b8420 2023-08-09T12:51:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.024+0000 7f19b27fc640 1 -- 172.21.15.17:0/532216414 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a403e800 con 0x7f19b40b8420 2023-08-09T12:51:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.024+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b415eec0 con 0x7f19b40b8420 2023-08-09T12:51:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.025+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b4157990 con 0x7f19b40b8420 2023-08-09T12:51:22.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.026+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b40ab3f0 con 0x7f19b40b8420 2023-08-09T12:51:22.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.027+0000 7f19b27fc640 1 -- 172.21.15.17:0/532216414 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f19a403e960 con 0x7f19b40b8420 2023-08-09T12:51:22.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.028+0000 7f19b27fc640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19a006a050 0x7f19a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.028+0000 7f19b27fc640 1 -- 172.21.15.17:0/532216414 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f19a40aaf90 con 0x7f19b40b8420 2023-08-09T12:51:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.028+0000 7f19b974c640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19a006a050 0x7f19a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.030+0000 7f19b974c640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19a006a050 0x7f19a006c510 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f19b41f5700 tx=0x7f19a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.032+0000 7f19b27fc640 1 -- 172.21.15.17:0/532216414 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f19b40ab3f0 con 0x7f19b40b8420 2023-08-09T12:51:22.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.227+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f19b415f380 con 0x7f19b40b8420 2023-08-09T12:51:22.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.232+0000 7f19b27fc640 1 -- 172.21.15.17:0/532216414 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f19a4076ab0 con 0x7f19b40b8420 2023-08-09T12:51:22.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19a006a050 msgr2=0x7f19a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19a006a050 0x7f19a006c510 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f19b41f5700 tx=0x7f19a8008040 comp rx=0 tx=0).stop 2023-08-09T12:51:22.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b40b8420 msgr2=0x7f19b4157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b40b8420 0x7f19b4157450 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f19a4000f80 tx=0x7f19a4004a40 comp rx=0 tx=0).stop 2023-08-09T12:51:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 shutdown_connections 2023-08-09T12:51:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f19a006a050 0x7f19a006c510 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19b415cf20 0x7f19b415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19b415cb40 0x7f19b40a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 --2- 172.21.15.17:0/532216414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b40b8420 0x7f19b4157450 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 >> 172.21.15.17:0/532216414 conn(0x7f19b40d2ab0 msgr2=0x7f19b4160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 shutdown_connections 2023-08-09T12:51:22.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.235+0000 7f19baf4f640 1 -- 172.21.15.17:0/532216414 wait complete. 2023-08-09T12:51:22.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-08-09T12:51:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.486+0000 7fb9e2542640 1 Processor -- start 2023-08-09T12:51:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.486+0000 7fb9e2542640 1 -- start start 2023-08-09T12:51:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.488+0000 7fb9e2542640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9dc15aab0 0x7fb9dc0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.488+0000 7fb9e2542640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9dc0b2880 0x7fb9dc06f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.488+0000 7fb9e2542640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc0cc970 con 0x7fb9dc0af8d0 2023-08-09T12:51:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.488+0000 7fb9e2542640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc0ccbc0 con 0x7fb9dc15aab0 2023-08-09T12:51:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.488+0000 7fb9e2542640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0ccea0 con 0x7fb9dc0b2880 2023-08-09T12:51:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.488+0000 7fb9e0adf640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb9dc0af8d0 0x7fb9dc0ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45044/0 (socket says 172.21.15.17:45044) 2023-08-09T12:51:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.488+0000 7fb9e0adf640 1 -- 172.21.15.17:0/3637791073 learned_addr learned my addr 172.21.15.17:0/3637791073 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:22.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3637791073 >> v2:172.21.15.142:3300/0 conn(0x7fb9dc15aab0 0x7fb9dc0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9db7fe640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9dc0b2880 0x7fb9dc06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801054105 0 0) 0x7fb9dc0cc970 con 0x7fb9dc0af8d0 2023-08-09T12:51:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c8003520 con 0x7fb9dc0af8d0 2023-08-09T12:51:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477493502 0 0) 0x7fb9c8003520 con 0x7fb9dc0af8d0 2023-08-09T12:51:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9dc0b2880 msgr2=0x7fb9dc06f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9dc0b2880 0x7fb9dc06f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 >> v2:172.21.15.142:3300/0 conn(0x7fb9dc15aab0 msgr2=0x7fb9dc0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 --2- 172.21.15.17:0/3637791073 >> v2:172.21.15.142:3300/0 conn(0x7fb9dc15aab0 0x7fb9dc0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0cd180 con 0x7fb9dc0af8d0 2023-08-09T12:51:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fb9d4001670 con 0x7fb9dc0af8d0 2023-08-09T12:51:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 >> v1:172.21.15.17:6789/0 conn(0x7fb9dc0af8d0 legacy=0x7fb9dc0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c8003970 0x7fb9c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c80047c0 0x7fb9c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9dc0b2880 0x7fb9c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0ccbc0 con 0x7fb9c8003970 2023-08-09T12:51:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0ccea0 con 0x7fb9c80047c0 2023-08-09T12:51:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.489+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c800b980 con 0x7fb9dc0b2880 2023-08-09T12:51:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3637791073 >> v2:172.21.15.142:3300/0 conn(0x7fb9dc15aab0 0x7fb9dc0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:51:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c8003970 0x7fb9c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9db7fe640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c80047c0 0x7fb9c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9e0adf640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9dc0b2880 0x7fb9c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9dbfff640 1 -- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9dc0b2880 msgr2=0x7fb9c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9dc0b2880 0x7fb9c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9dbfff640 1 -- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c80047c0 msgr2=0x7fb9c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c80047c0 0x7fb9c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9dbfff640 1 -- 172.21.15.17:0/3637791073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c8003520 con 0x7fb9c8003970 2023-08-09T12:51:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.490+0000 7fb9db7fe640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c80047c0 0x7fb9c8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.492+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c8003970 0x7fb9c8003d90 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009c70 tx=0x7fb9c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab0363b02b3a0ec server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.492+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4004020 con 0x7fb9c8003970 2023-08-09T12:51:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.492+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c4004180 con 0x7fb9c8003970 2023-08-09T12:51:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.492+0000 7fb9daffd640 1 -- 172.21.15.17:0/3637791073 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40044f0 con 0x7fb9c8003970 2023-08-09T12:51:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.492+0000 7fb9e2542640 1 -- 172.21.15.17:0/3637791073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c8003970 msgr2=0x7fb9c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.492+0000 7fb9e2542640 1 --2- 172.21.15.17:0/3637791073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c8003970 0x7fb9c8003d90 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009c70 tx=0x7fb9c80057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.492+0000 7fb9e0adf640 1 -- 172.21.15.17:0/3637791073 reap_dead start 2023-08-09T12:51:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.493+0000 7fb9e2542640 1 -- 172.21.15.17:0/3637791073 shutdown_connections 2023-08-09T12:51:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.493+0000 7fb9e2542640 1 -- 172.21.15.17:0/3637791073 >> 172.21.15.17:0/3637791073 conn(0x7fb9dc0cd440 msgr2=0x7fb9dc0cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.493+0000 7fb9e2542640 1 -- 172.21.15.17:0/3637791073 shutdown_connections 2023-08-09T12:51:22.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.493+0000 7fb9e2542640 1 -- 172.21.15.17:0/3637791073 wait complete. 2023-08-09T12:51:22.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.494+0000 7fb9e2542640 1 Processor -- start 2023-08-09T12:51:22.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.495+0000 7fb9e2542640 1 -- start start 2023-08-09T12:51:22.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9e2542640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9c8003970 0x7fb9dc154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9e2542640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc154eb0 0x7fb9dc158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9e2542640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9dc069d40 0x7fb9dc06a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9e2542640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0adaa0 con 0x7fb9dc154eb0 2023-08-09T12:51:22.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9e2542640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0add80 con 0x7fb9dc069d40 2023-08-09T12:51:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9e2542640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc158120 con 0x7fb9c8003970 2023-08-09T12:51:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc154eb0 0x7fb9dc158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc154eb0 0x7fb9dc158920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58698/0 (socket says 172.21.15.17:58698) 2023-08-09T12:51:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9db7fe640 1 -- 172.21.15.17:0/3752809425 learned_addr learned my addr 172.21.15.17:0/3752809425 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9e0adf640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9dc069d40 0x7fb9dc06a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9c8003970 0x7fb9dc154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9db7fe640 1 -- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9c8003970 msgr2=0x7fb9dc154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9db7fe640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9c8003970 0x7fb9dc154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9db7fe640 1 -- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9dc069d40 msgr2=0x7fb9dc06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9db7fe640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9dc069d40 0x7fb9dc06a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9db7fe640 1 -- 172.21.15.17:0/3752809425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc158400 con 0x7fb9dc154eb0 2023-08-09T12:51:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.496+0000 7fb9e0adf640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9dc069d40 0x7fb9dc06a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.497+0000 7fb9db7fe640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc154eb0 0x7fb9dc158920 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0101c0 tx=0x7fb9cc010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:22.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.497+0000 7fb9d8ff9640 1 -- 172.21.15.17:0/3752809425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00e050 con 0x7fb9dc154eb0 2023-08-09T12:51:22.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.497+0000 7fb9d8ff9640 1 -- 172.21.15.17:0/3752809425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc00f040 con 0x7fb9dc154eb0 2023-08-09T12:51:22.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.497+0000 7fb9d8ff9640 1 -- 172.21.15.17:0/3752809425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc003bb0 con 0x7fb9dc154eb0 2023-08-09T12:51:22.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.497+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc06a700 con 0x7fb9dc154eb0 2023-08-09T12:51:22.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.497+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc154bb0 con 0x7fb9dc154eb0 2023-08-09T12:51:22.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.498+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc158590 con 0x7fb9dc154eb0 2023-08-09T12:51:22.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.499+0000 7fb9d8ff9640 1 -- 172.21.15.17:0/3752809425 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb9cc003d10 con 0x7fb9dc154eb0 2023-08-09T12:51:22.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.500+0000 7fb9d8ff9640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9bc06a050 0x7fb9bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:22.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.500+0000 7fb9d8ff9640 1 -- 172.21.15.17:0/3752809425 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb9cc0891c0 con 0x7fb9dc154eb0 2023-08-09T12:51:22.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.501+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9bc06a050 0x7fb9bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.502+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9bc06a050 0x7fb9bc06c510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4035000 tx=0x7fb9c4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.504+0000 7fb9d8ff9640 1 -- 172.21.15.17:0/3752809425 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb9cc054b30 con 0x7fb9dc154eb0 2023-08-09T12:51:22.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:22.769+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fb9dc067a80 con 0x7fb9dc154eb0 2023-08-09T12:51:23.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.761+0000 7fb9d8ff9640 1 -- 172.21.15.17:0/3752809425 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v588) v1 ==== 132+0+0 (secure 0 0 0) 0x7fb9cc058150 con 0x7fb9dc154eb0 2023-08-09T12:51:23.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9bc06a050 msgr2=0x7fb9bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9bc06a050 0x7fb9bc06c510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4035000 tx=0x7fb9c4030000 comp rx=0 tx=0).stop 2023-08-09T12:51:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc154eb0 msgr2=0x7fb9dc158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc154eb0 0x7fb9dc158920 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0101c0 tx=0x7fb9cc010680 comp rx=0 tx=0).stop 2023-08-09T12:51:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 shutdown_connections 2023-08-09T12:51:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb9bc06a050 0x7fb9bc06c510 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9dc069d40 0x7fb9dc06a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc154eb0 0x7fb9dc158920 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:23.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 --2- 172.21.15.17:0/3752809425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9c8003970 0x7fb9dc154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:23.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 >> 172.21.15.17:0/3752809425 conn(0x7fb9dc0cd440 msgr2=0x7fb9dc0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:23.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 shutdown_connections 2023-08-09T12:51:23.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:23.765+0000 7fb9e2542640 1 -- 172.21.15.17:0/3752809425 wait complete. 2023-08-09T12:51:23.792 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-09T12:51:23.793 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-08-09T12:51:23.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-08-09T12:51:24.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.027+0000 7fb4e97b2640 1 Processor -- start 2023-08-09T12:51:24.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.027+0000 7fb4e97b2640 1 -- start start 2023-08-09T12:51:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.028+0000 7fb4e97b2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4e40abb40 0x7fb4e40ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.028+0000 7fb4e97b2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40ca5a0 0x7fb4e40b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.028+0000 7fb4e97b2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40ca1e0 con 0x7fb4e415aa70 2023-08-09T12:51:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.028+0000 7fb4e97b2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e40cadf0 con 0x7fb4e40abb40 2023-08-09T12:51:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.028+0000 7fb4e97b2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40c99a0 con 0x7fb4e40ca5a0 2023-08-09T12:51:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.029+0000 7fb4e3fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb4e415aa70 0x7fb4e40ab430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45052/0 (socket says 172.21.15.17:45052) 2023-08-09T12:51:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.029+0000 7fb4e3fff640 1 -- 172.21.15.17:0/3244753979 learned_addr learned my addr 172.21.15.17:0/3244753979 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.029+0000 7fb4e37fe640 1 --2- 172.21.15.17:0/3244753979 >> v2:172.21.15.142:3300/0 conn(0x7fb4e40abb40 0x7fb4e40ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.029+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244461925 0 0) 0x7fb4e40ca1e0 con 0x7fb4e415aa70 2023-08-09T12:51:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.029+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4cc003520 con 0x7fb4e415aa70 2023-08-09T12:51:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.029+0000 7fb4e8fb1640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40ca5a0 0x7fb4e40b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3427975367 0 0) 0x7fb4cc003520 con 0x7fb4e415aa70 2023-08-09T12:51:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40ca5a0 msgr2=0x7fb4e40b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40ca5a0 0x7fb4e40b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 >> v2:172.21.15.142:3300/0 conn(0x7fb4e40abb40 msgr2=0x7fb4e40ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 --2- 172.21.15.17:0/3244753979 >> v2:172.21.15.142:3300/0 conn(0x7fb4e40abb40 0x7fb4e40ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40cab10 con 0x7fb4e415aa70 2023-08-09T12:51:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fb4d40017f0 con 0x7fb4e415aa70 2023-08-09T12:51:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 >> v1:172.21.15.17:6789/0 conn(0x7fb4e415aa70 legacy=0x7fb4e40ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4cc003970 0x7fb4cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40ca5a0 0x7fb4cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40cadf0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc00b980 con 0x7fb4cc003970 2023-08-09T12:51:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc00bac0 con 0x7fb4e40ca5a0 2023-08-09T12:51:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e37fe640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.030+0000 7fb4e3fff640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4cc003970 0x7fb4cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.031+0000 7fb4e37fe640 1 -- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40ca5a0 msgr2=0x7fb4cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.031+0000 7fb4e8fb1640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40ca5a0 0x7fb4cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.031+0000 7fb4e37fe640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40ca5a0 0x7fb4cc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.031+0000 7fb4e37fe640 1 -- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4cc003970 msgr2=0x7fb4cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.031+0000 7fb4e37fe640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4cc003970 0x7fb4cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.031+0000 7fb4e37fe640 1 -- 172.21.15.17:0/3244753979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc003520 con 0x7fb4cc0047c0 2023-08-09T12:51:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.031+0000 7fb4e3fff640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4cc003970 0x7fb4cc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.032+0000 7fb4e37fe640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4cc004c40 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009fc0 tx=0x7fb4cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e7cd494b1054f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.032+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d802cc60 con 0x7fb4cc0047c0 2023-08-09T12:51:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.032+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d800f040 con 0x7fb4cc0047c0 2023-08-09T12:51:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.032+0000 7fb4e2ffd640 1 -- 172.21.15.17:0/3244753979 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8034440 con 0x7fb4cc0047c0 2023-08-09T12:51:24.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.033+0000 7fb4e97b2640 1 -- 172.21.15.17:0/3244753979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 msgr2=0x7fb4cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:24.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.033+0000 7fb4e97b2640 1 --2- 172.21.15.17:0/3244753979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4cc004c40 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009fc0 tx=0x7fb4cc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.033+0000 7fb4e8fb1640 1 -- 172.21.15.17:0/3244753979 reap_dead start 2023-08-09T12:51:24.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.033+0000 7fb4e97b2640 1 -- 172.21.15.17:0/3244753979 shutdown_connections 2023-08-09T12:51:24.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.033+0000 7fb4e97b2640 1 -- 172.21.15.17:0/3244753979 >> 172.21.15.17:0/3244753979 conn(0x7fb4e40cec00 msgr2=0x7fb4e40b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:24.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.033+0000 7fb4e97b2640 1 -- 172.21.15.17:0/3244753979 shutdown_connections 2023-08-09T12:51:24.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.033+0000 7fb4e97b2640 1 -- 172.21.15.17:0/3244753979 wait complete. 2023-08-09T12:51:24.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.035+0000 7fb4e97b2640 1 Processor -- start 2023-08-09T12:51:24.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.035+0000 7fb4e97b2640 1 -- start start 2023-08-09T12:51:24.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e97b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4e4097960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e97b2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40b0110 0x7fb4e415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e97b2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c30d0 0x7fb4e415b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e97b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40cc580 con 0x7fb4cc0047c0 2023-08-09T12:51:24.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e97b2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41f2650 con 0x7fb4e40c30d0 2023-08-09T12:51:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e97b2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4097ea0 con 0x7fb4e40b0110 2023-08-09T12:51:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4e4097960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4e4097960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58716/0 (socket says 172.21.15.17:58716) 2023-08-09T12:51:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.036+0000 7fb4e3fff640 1 -- 172.21.15.17:0/1553682500 learned_addr learned my addr 172.21.15.17:0/1553682500 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.037+0000 7fb4e8fb1640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c30d0 0x7fb4e415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.037+0000 7fb4e37fe640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40b0110 0x7fb4e415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.037+0000 7fb4e3fff640 1 -- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40b0110 msgr2=0x7fb4e415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.037+0000 7fb4e3fff640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40b0110 0x7fb4e415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.037+0000 7fb4e3fff640 1 -- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c30d0 msgr2=0x7fb4e415b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.037+0000 7fb4e3fff640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c30d0 0x7fb4e415b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.037+0000 7fb4e3fff640 1 -- 172.21.15.17:0/1553682500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40c43d0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.037+0000 7fb4e3fff640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4e4097960 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400e800 tx=0x7fb4d400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.038+0000 7fb4e0ff9640 1 -- 172.21.15.17:0/1553682500 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40072e0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.038+0000 7fb4e0ff9640 1 -- 172.21.15.17:0/1553682500 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4007440 con 0x7fb4cc0047c0 2023-08-09T12:51:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.038+0000 7fb4e0ff9640 1 -- 172.21.15.17:0/1553682500 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40057a0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.038+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e40c46b0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.038+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e40cc1a0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.039+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e40cc6c0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.040+0000 7fb4e0ff9640 1 -- 172.21.15.17:0/1553682500 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb4d4005900 con 0x7fb4cc0047c0 2023-08-09T12:51:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.042+0000 7fb4e0ff9640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb4d006a080 0x7fb4d006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.042+0000 7fb4e0ff9640 1 -- 172.21.15.17:0/1553682500 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb4d4088260 con 0x7fb4cc0047c0 2023-08-09T12:51:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.043+0000 7fb4e37fe640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb4d006a080 0x7fb4d006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:24.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.044+0000 7fb4e37fe640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb4d006a080 0x7fb4d006c540 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8036000 tx=0x7fb4d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:24.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.046+0000 7fb4e0ff9640 1 -- 172.21.15.17:0/1553682500 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb4e40cc6c0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.309+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7fb4e40cc6c0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.765+0000 7fb4e0ff9640 1 -- 172.21.15.17:0/1553682500 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v589) v1 ==== 134+0+0 (secure 0 0 0) 0x7fb4e40cc6c0 con 0x7fb4cc0047c0 2023-08-09T12:51:24.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.768+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb4d006a080 msgr2=0x7fb4d006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:24.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.768+0000 7fb4e97b2640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb4d006a080 0x7fb4d006c540 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8036000 tx=0x7fb4d802e000 comp rx=0 tx=0).stop 2023-08-09T12:51:24.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.768+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 msgr2=0x7fb4e4097960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:24.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.768+0000 7fb4e97b2640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4e4097960 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400e800 tx=0x7fb4d400ecc0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.769+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 shutdown_connections 2023-08-09T12:51:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.769+0000 7fb4e97b2640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb4d006a080 0x7fb4d006c540 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.769+0000 7fb4e97b2640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4e40c30d0 0x7fb4e415b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.769+0000 7fb4e97b2640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4e40b0110 0x7fb4e415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.769+0000 7fb4e97b2640 1 --2- 172.21.15.17:0/1553682500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4cc0047c0 0x7fb4e4097960 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.769+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 >> 172.21.15.17:0/1553682500 conn(0x7fb4e40cec00 msgr2=0x7fb4e4158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.769+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 shutdown_connections 2023-08-09T12:51:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:24.769+0000 7fb4e97b2640 1 -- 172.21.15.17:0/1553682500 wait complete. 2023-08-09T12:51:24.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:25.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.026+0000 7f30ad3eb640 1 Processor -- start 2023-08-09T12:51:25.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.026+0000 7f30ad3eb640 1 -- start start 2023-08-09T12:51:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f30ad3eb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f30a80b86e0 0x7f30a80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f30ad3eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a80cf980 0x7f30a80d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f30ad3eb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a80b5a30 con 0x7f30a8160030 2023-08-09T12:51:25.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f30ad3eb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a80d1110 con 0x7f30a80b86e0 2023-08-09T12:51:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f30ad3eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80ceac0 con 0x7f30a80cf980 2023-08-09T12:51:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f309f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f30a80b86e0 0x7f30a80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f30a7fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f30a8160030 0x7f30a8160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45068/0 (socket says 172.21.15.17:45068) 2023-08-09T12:51:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f30a7fff640 1 -- 172.21.15.17:0/922353597 learned_addr learned my addr 172.21.15.17:0/922353597 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.028+0000 7f30acbea640 1 --2- 172.21.15.17:0/922353597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a80cf980 0x7f30a80d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.029+0000 7f309f7fe640 1 -- 172.21.15.17:0/922353597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a80cf980 msgr2=0x7f30a80d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.029+0000 7f309f7fe640 1 --2- 172.21.15.17:0/922353597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a80cf980 0x7f30a80d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.029+0000 7f309f7fe640 1 -- 172.21.15.17:0/922353597 >> v1:172.21.15.17:6789/0 conn(0x7f30a8160030 legacy=0x7f30a8160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.029+0000 7f309f7fe640 1 -- 172.21.15.17:0/922353597 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a80d0d70 con 0x7f30a80b86e0 2023-08-09T12:51:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.029+0000 7f30a77fe640 1 -- 172.21.15.17:0/922353597 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273035374 0 0) 0x7f30a80b5a30 con 0x7f30a8160030 2023-08-09T12:51:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.030+0000 7f309f7fe640 1 --2- 172.21.15.17:0/922353597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a80cf440 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f30900097a0 tx=0x7f309002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db9f9d6c29daa7b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.030+0000 7f30a77fe640 1 -- 172.21.15.17:0/922353597 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309002d040 con 0x7f30a80b86e0 2023-08-09T12:51:25.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.030+0000 7f30a77fe640 1 -- 172.21.15.17:0/922353597 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090031810 con 0x7f30a80b86e0 2023-08-09T12:51:25.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.030+0000 7f30a77fe640 1 -- 172.21.15.17:0/922353597 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090031ba0 con 0x7f30a80b86e0 2023-08-09T12:51:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.031+0000 7f30ad3eb640 1 -- 172.21.15.17:0/922353597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 msgr2=0x7f30a80cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.031+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/922353597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a80cf440 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f30900097a0 tx=0x7f309002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.031+0000 7f30ad3eb640 1 -- 172.21.15.17:0/922353597 shutdown_connections 2023-08-09T12:51:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.031+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/922353597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a80cf980 0x7f30a80d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.031+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/922353597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a80cf440 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.031+0000 7f30ad3eb640 1 -- 172.21.15.17:0/922353597 >> 172.21.15.17:0/922353597 conn(0x7f30a80697c0 msgr2=0x7f30a8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.031+0000 7f30ad3eb640 1 -- 172.21.15.17:0/922353597 shutdown_connections 2023-08-09T12:51:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.031+0000 7f30ad3eb640 1 -- 172.21.15.17:0/922353597 wait complete. 2023-08-09T12:51:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.033+0000 7f30ad3eb640 1 Processor -- start 2023-08-09T12:51:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.033+0000 7f30ad3eb640 1 -- start start 2023-08-09T12:51:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30ad3eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a8153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30ad3eb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a80cf980 0x7f30a81575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30ad3eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a8160030 0x7f30a8157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30ad3eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a81f1f50 con 0x7f30a80b86e0 2023-08-09T12:51:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30ad3eb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80cab10 con 0x7f30a80cf980 2023-08-09T12:51:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30ad3eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80c9e90 con 0x7f30a8160030 2023-08-09T12:51:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a8153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a8153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58738/0 (socket says 172.21.15.17:58738) 2023-08-09T12:51:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.034+0000 7f30a7fff640 1 -- 172.21.15.17:0/1132312917 learned_addr learned my addr 172.21.15.17:0/1132312917 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30acbea640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a8160030 0x7f30a8157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f309f7fe640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a80cf980 0x7f30a81575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a7fff640 1 -- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a8160030 msgr2=0x7f30a8157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a7fff640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a8160030 0x7f30a8157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a7fff640 1 -- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a80cf980 msgr2=0x7f30a81575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a7fff640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a80cf980 0x7f30a81575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a7fff640 1 -- 172.21.15.17:0/1132312917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090009400 con 0x7f30a80b86e0 2023-08-09T12:51:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a7fff640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a8153880 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f309800c430 tx=0x7f309800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a57fa640 1 -- 172.21.15.17:0/1132312917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980074e0 con 0x7f30a80b86e0 2023-08-09T12:51:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a57fa640 1 -- 172.21.15.17:0/1132312917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3098007660 con 0x7f30a80b86e0 2023-08-09T12:51:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30a57fa640 1 -- 172.21.15.17:0/1132312917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098004a20 con 0x7f30a80b86e0 2023-08-09T12:51:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.035+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a80ca170 con 0x7f30a80b86e0 2023-08-09T12:51:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.036+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a80ca730 con 0x7f30a80b86e0 2023-08-09T12:51:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.037+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a80cae90 con 0x7f30a80b86e0 2023-08-09T12:51:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.038+0000 7f30a57fa640 1 -- 172.21.15.17:0/1132312917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3098004b80 con 0x7f30a80b86e0 2023-08-09T12:51:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.039+0000 7f30a57fa640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f308806a050 0x7f308806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.039+0000 7f30a57fa640 1 -- 172.21.15.17:0/1132312917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3098088110 con 0x7f30a80b86e0 2023-08-09T12:51:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.039+0000 7f309f7fe640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f308806a050 0x7f308806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.041+0000 7f309f7fe640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f308806a050 0x7f308806c510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3090036000 tx=0x7f309003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.043+0000 7f30a57fa640 1 -- 172.21.15.17:0/1132312917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3098053b10 con 0x7f30a80b86e0 2023-08-09T12:51:25.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.236+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30a804e390 con 0x7f30a80b86e0 2023-08-09T12:51:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.239+0000 7f30a57fa640 1 -- 172.21.15.17:0/1132312917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+14756 (secure 0 0 0) 0x7f3098057130 con 0x7f30a80b86e0 2023-08-09T12:51:25.243 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:25.243 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":167,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:51:21.730397+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/1876401199":"2023-08-10T12:51:18.712534+0000","172.21.15.17:6833/1876401199":"2023-08-10T12:51:18.712534+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f308806a050 msgr2=0x7f308806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f308806a050 0x7f308806c510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3090036000 tx=0x7f309003c040 comp rx=0 tx=0).stop 2023-08-09T12:51:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 msgr2=0x7f30a8153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a8153880 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f309800c430 tx=0x7f309800c8f0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 shutdown_connections 2023-08-09T12:51:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f308806a050 0x7f308806c510 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30a8160030 0x7f30a8157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a80cf980 0x7f30a81575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 --2- 172.21.15.17:0/1132312917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a80b86e0 0x7f30a8153880 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 >> 172.21.15.17:0/1132312917 conn(0x7f30a80697c0 msgr2=0x7f30a80c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:25.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 shutdown_connections 2023-08-09T12:51:25.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.242+0000 7f30ad3eb640 1 -- 172.21.15.17:0/1132312917 wait complete. 2023-08-09T12:51:25.263 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:51:25.264 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:51:25.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.492+0000 7f80c6f5c640 1 Processor -- start 2023-08-09T12:51:25.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.492+0000 7f80c6f5c640 1 -- start start 2023-08-09T12:51:25.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.493+0000 7f80c6f5c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c00b8420 0x7f80c00cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.494+0000 7f80c6f5c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80c015cf20 0x7f80c00cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.494+0000 7f80c6f5c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c00d0f00 con 0x7f80c015cb40 2023-08-09T12:51:25.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.494+0000 7f80c6f5c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c01611f0 con 0x7f80c015cf20 2023-08-09T12:51:25.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.494+0000 7f80c6f5c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01614d0 con 0x7f80c00b8420 2023-08-09T12:51:25.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.494+0000 7f80c5f5a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f80c015cb40 0x7f80c01609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45082/0 (socket says 172.21.15.17:45082) 2023-08-09T12:51:25.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.494+0000 7f80c5f5a640 1 -- 172.21.15.17:0/1643835291 learned_addr learned my addr 172.21.15.17:0/1643835291 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:25.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.494+0000 7f80c675b640 1 --2- 172.21.15.17:0/1643835291 >> v2:172.21.15.142:3300/0 conn(0x7f80c015cf20 0x7f80c00cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.494+0000 7f80c5759640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c00b8420 0x7f80c00cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612181860 0 0) 0x7f80c00d0f00 con 0x7f80c015cb40 2023-08-09T12:51:25.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ac003520 con 0x7f80c015cb40 2023-08-09T12:51:25.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3639208306 0 0) 0x7f80ac003520 con 0x7f80c015cb40 2023-08-09T12:51:25.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c00b8420 msgr2=0x7f80c00cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c00b8420 0x7f80c00cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 >> v2:172.21.15.142:3300/0 conn(0x7f80c015cf20 msgr2=0x7f80c00cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 --2- 172.21.15.17:0/1643835291 >> v2:172.21.15.142:3300/0 conn(0x7f80c015cf20 0x7f80c00cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c01617b0 con 0x7f80c015cb40 2023-08-09T12:51:25.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f80bc0019f0 con 0x7f80c015cb40 2023-08-09T12:51:25.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 >> v1:172.21.15.17:6789/0 conn(0x7f80c015cb40 legacy=0x7f80c01609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c00b8420 0x7f80ac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ac004d00 0x7f80ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01611f0 con 0x7f80ac003ef0 2023-08-09T12:51:25.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01614d0 con 0x7f80ac004d00 2023-08-09T12:51:25.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac00b9b0 con 0x7f80c00b8420 2023-08-09T12:51:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.495+0000 7f80c675b640 1 --2- 172.21.15.17:0/1643835291 >> v2:172.21.15.142:3300/0 conn(0x7f80c015cf20 0x7f80c00cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:51:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c5759640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c5f5a640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c00b8420 0x7f80ac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c675b640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ac004d00 0x7f80ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c5759640 1 -- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c00b8420 msgr2=0x7f80ac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c5759640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c00b8420 0x7f80ac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c5759640 1 -- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ac004d00 msgr2=0x7f80ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c5759640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ac004d00 0x7f80ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c5759640 1 -- 172.21.15.17:0/1643835291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac003520 con 0x7f80ac003ef0 2023-08-09T12:51:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.496+0000 7f80c675b640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80ac004d00 0x7f80ac005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.497+0000 7f80c5759640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80ac0047c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009ac0 tx=0x7f80ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37b3d5c12092999 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.498+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b002c6b0 con 0x7f80ac003ef0 2023-08-09T12:51:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.498+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b002c810 con 0x7f80ac003ef0 2023-08-09T12:51:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.498+0000 7f80c4f58640 1 -- 172.21.15.17:0/1643835291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b002cba0 con 0x7f80ac003ef0 2023-08-09T12:51:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.498+0000 7f80c6f5c640 1 -- 172.21.15.17:0/1643835291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 msgr2=0x7f80ac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.498+0000 7f80c6f5c640 1 --2- 172.21.15.17:0/1643835291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80ac0047c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009ac0 tx=0x7f80ac0057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.498+0000 7f80c675b640 1 -- 172.21.15.17:0/1643835291 reap_dead start 2023-08-09T12:51:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.498+0000 7f80c6f5c640 1 -- 172.21.15.17:0/1643835291 shutdown_connections 2023-08-09T12:51:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.498+0000 7f80c6f5c640 1 -- 172.21.15.17:0/1643835291 >> 172.21.15.17:0/1643835291 conn(0x7f80c00d2ab0 msgr2=0x7f80c00d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.499+0000 7f80c6f5c640 1 -- 172.21.15.17:0/1643835291 shutdown_connections 2023-08-09T12:51:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.499+0000 7f80c6f5c640 1 -- 172.21.15.17:0/1643835291 wait complete. 2023-08-09T12:51:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.500+0000 7f80c6f5c640 1 Processor -- start 2023-08-09T12:51:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.501+0000 7f80c6f5c640 1 -- start start 2023-08-09T12:51:25.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.501+0000 7f80c6f5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80c00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c6f5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c015d350 0x7f80c01f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c6f5c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c01f62a0 0x7f80c01f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c6f5c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01f6750 con 0x7f80ac003ef0 2023-08-09T12:51:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c6f5c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01f3930 con 0x7f80c015d350 2023-08-09T12:51:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c6f5c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01f3b80 con 0x7f80c01f62a0 2023-08-09T12:51:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5f5a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80c00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5f5a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80c00d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58766/0 (socket says 172.21.15.17:58766) 2023-08-09T12:51:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5f5a640 1 -- 172.21.15.17:0/242980680 learned_addr learned my addr 172.21.15.17:0/242980680 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5759640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c015d350 0x7f80c01f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c675b640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c01f62a0 0x7f80c01f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5f5a640 1 -- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c01f62a0 msgr2=0x7f80c01f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5f5a640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c01f62a0 0x7f80c01f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5f5a640 1 -- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c015d350 msgr2=0x7f80c01f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5f5a640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c015d350 0x7f80c01f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c5f5a640 1 -- 172.21.15.17:0/242980680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c01f3e60 con 0x7f80ac003ef0 2023-08-09T12:51:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.502+0000 7f80c675b640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c01f62a0 0x7f80c01f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.503+0000 7f80c5f5a640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80c00d1cd0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f80bc002230 tx=0x7f80bc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.503+0000 7f80b67fc640 1 -- 172.21.15.17:0/242980680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00edf0 con 0x7f80ac003ef0 2023-08-09T12:51:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.503+0000 7f80b67fc640 1 -- 172.21.15.17:0/242980680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc013420 con 0x7f80ac003ef0 2023-08-09T12:51:25.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.503+0000 7f80b67fc640 1 -- 172.21.15.17:0/242980680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0137d0 con 0x7f80ac003ef0 2023-08-09T12:51:25.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.503+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c01f4140 con 0x7f80ac003ef0 2023-08-09T12:51:25.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.503+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c01f4700 con 0x7f80ac003ef0 2023-08-09T12:51:25.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.504+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c00d3670 con 0x7f80ac003ef0 2023-08-09T12:51:25.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.505+0000 7f80b67fc640 1 -- 172.21.15.17:0/242980680 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80bc013930 con 0x7f80ac003ef0 2023-08-09T12:51:25.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.506+0000 7f80b67fc640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80a406a080 0x7f80a406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.506+0000 7f80b67fc640 1 -- 172.21.15.17:0/242980680 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f80bc088a10 con 0x7f80ac003ef0 2023-08-09T12:51:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.507+0000 7f80c5759640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80a406a080 0x7f80a406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.508+0000 7f80c5759640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80a406a080 0x7f80a406c540 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f80b0036000 tx=0x7f80b0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.511+0000 7f80b67fc640 1 -- 172.21.15.17:0/242980680 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f80bc054380 con 0x7f80ac003ef0 2023-08-09T12:51:25.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.701+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80c004e390 con 0x7f80ac003ef0 2023-08-09T12:51:25.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.702+0000 7f80b67fc640 1 -- 172.21.15.17:0/242980680 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v167) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80bc0579a0 con 0x7f80ac003ef0 2023-08-09T12:51:25.705 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:51:25.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.704+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80a406a080 msgr2=0x7f80a406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.704+0000 7f80c6f5c640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80a406a080 0x7f80a406c540 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f80b0036000 tx=0x7f80b0030000 comp rx=0 tx=0).stop 2023-08-09T12:51:25.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.704+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 msgr2=0x7f80c00d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.704+0000 7f80c6f5c640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80c00d1cd0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f80bc002230 tx=0x7f80bc00e530 comp rx=0 tx=0).stop 2023-08-09T12:51:25.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.705+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 shutdown_connections 2023-08-09T12:51:25.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.705+0000 7f80c6f5c640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f80a406a080 0x7f80a406c540 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.705+0000 7f80c6f5c640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c01f62a0 0x7f80c01f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.705+0000 7f80c6f5c640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c015d350 0x7f80c01f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.705+0000 7f80c6f5c640 1 --2- 172.21.15.17:0/242980680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac003ef0 0x7f80c00d1cd0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.705+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 >> 172.21.15.17:0/242980680 conn(0x7f80c00d2ab0 msgr2=0x7f80c00b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:25.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.705+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 shutdown_connections 2023-08-09T12:51:25.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.705+0000 7f80c6f5c640 1 -- 172.21.15.17:0/242980680 wait complete. 2023-08-09T12:51:25.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:51:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.954+0000 7f133e5e8640 1 Processor -- start 2023-08-09T12:51:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.954+0000 7f133e5e8640 1 -- start start 2023-08-09T12:51:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.956+0000 7f133e5e8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f13380d30e0 0x7f13380b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.956+0000 7f133e5e8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13380cdd10 con 0x7f13381616e0 2023-08-09T12:51:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.956+0000 7f133e5e8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13380cdff0 con 0x7f133815ce90 2023-08-09T12:51:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.956+0000 7f133e5e8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13380b6540 con 0x7f13380d30e0 2023-08-09T12:51:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.956+0000 7f133cb85640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f13380d30e0 0x7f13380b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.956+0000 7f13377fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f13381616e0 0x7f13380d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45088/0 (socket says 172.21.15.17:45088) 2023-08-09T12:51:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.956+0000 7f13377fe640 1 -- 172.21.15.17:0/1018876782 learned_addr learned my addr 172.21.15.17:0/1018876782 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.957+0000 7f133cb85640 1 -- 172.21.15.17:0/1018876782 >> v1:172.21.15.142:6789/0 conn(0x7f133815ce90 legacy=0x7f13380cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.957+0000 7f133cb85640 1 -- 172.21.15.17:0/1018876782 >> v1:172.21.15.17:6789/0 conn(0x7f13381616e0 legacy=0x7f13380d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.957+0000 7f133cb85640 1 -- 172.21.15.17:0/1018876782 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380ce2d0 con 0x7f13380d30e0 2023-08-09T12:51:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.957+0000 7f1336ffd640 1 -- 172.21.15.17:0/1018876782 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922052987 0 0) 0x7f13380cdd10 con 0x7f13381616e0 2023-08-09T12:51:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.958+0000 7f133cb85640 1 --2- 172.21.15.17:0/1018876782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13380d30e0 0x7f13380b6000 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f1330009d90 tx=0x7f133002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27e351d8dac26e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.958+0000 7f1336ffd640 1 -- 172.21.15.17:0/1018876782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133002cc60 con 0x7f13380d30e0 2023-08-09T12:51:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.958+0000 7f1336ffd640 1 -- 172.21.15.17:0/1018876782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133002cdc0 con 0x7f13380d30e0 2023-08-09T12:51:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.958+0000 7f1336ffd640 1 -- 172.21.15.17:0/1018876782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330034660 con 0x7f13380d30e0 2023-08-09T12:51:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.959+0000 7f133e5e8640 1 -- 172.21.15.17:0/1018876782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13380d30e0 msgr2=0x7f13380b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.959+0000 7f133e5e8640 1 --2- 172.21.15.17:0/1018876782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13380d30e0 0x7f13380b6000 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f1330009d90 tx=0x7f133002beb0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.959+0000 7f133e5e8640 1 -- 172.21.15.17:0/1018876782 shutdown_connections 2023-08-09T12:51:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.959+0000 7f133e5e8640 1 --2- 172.21.15.17:0/1018876782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13380d30e0 0x7f13380b6000 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.959+0000 7f133e5e8640 1 -- 172.21.15.17:0/1018876782 >> 172.21.15.17:0/1018876782 conn(0x7f133806fde0 msgr2=0x7f13380701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.959+0000 7f133e5e8640 1 -- 172.21.15.17:0/1018876782 shutdown_connections 2023-08-09T12:51:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.959+0000 7f133e5e8640 1 -- 172.21.15.17:0/1018876782 wait complete. 2023-08-09T12:51:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.961+0000 7f133e5e8640 1 Processor -- start 2023-08-09T12:51:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.961+0000 7f133e5e8640 1 -- start start 2023-08-09T12:51:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133e5e8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13380d30e0 0x7f133815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133e5e8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f133815ce90 0x7f133815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133e5e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13381616e0 0x7f1338150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133e5e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1338150e80 con 0x7f13381616e0 2023-08-09T12:51:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133e5e8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13381531c0 con 0x7f133815ce90 2023-08-09T12:51:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133e5e8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13381534a0 con 0x7f13380d30e0 2023-08-09T12:51:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133cb85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13381616e0 0x7f1338150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133cb85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13381616e0 0x7f1338150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58790/0 (socket says 172.21.15.17:58790) 2023-08-09T12:51:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.962+0000 7f133cb85640 1 -- 172.21.15.17:0/2925134774 learned_addr learned my addr 172.21.15.17:0/2925134774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.963+0000 7f13377fe640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f133815ce90 0x7f133815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.963+0000 7f133cb85640 1 -- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13380d30e0 msgr2=0x7f133815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.963+0000 7f133cb85640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13380d30e0 0x7f133815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.963+0000 7f133cb85640 1 -- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f133815ce90 msgr2=0x7f133815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:25.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.963+0000 7f133cb85640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f133815ce90 0x7f133815fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:25.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.963+0000 7f133cb85640 1 -- 172.21.15.17:0/2925134774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330009a70 con 0x7f13381616e0 2023-08-09T12:51:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.963+0000 7f133cb85640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13381616e0 0x7f1338150940 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f1330009eb0 tx=0x7f1330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.964+0000 7f1334ff9640 1 -- 172.21.15.17:0/2925134774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133003f420 con 0x7f13381616e0 2023-08-09T12:51:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.964+0000 7f1334ff9640 1 -- 172.21.15.17:0/2925134774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133003f580 con 0x7f13381616e0 2023-08-09T12:51:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.964+0000 7f1334ff9640 1 -- 172.21.15.17:0/2925134774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133003f910 con 0x7f13381616e0 2023-08-09T12:51:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.964+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1338153780 con 0x7f13381616e0 2023-08-09T12:51:25.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.964+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1338153f80 con 0x7f13381616e0 2023-08-09T12:51:25.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.965+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1338153ca0 con 0x7f13381616e0 2023-08-09T12:51:25.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.966+0000 7f1334ff9640 1 -- 172.21.15.17:0/2925134774 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f133003fa70 con 0x7f13381616e0 2023-08-09T12:51:25.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.967+0000 7f1334ff9640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f132406a050 0x7f132406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:25.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.967+0000 7f1334ff9640 1 -- 172.21.15.17:0/2925134774 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f13300aad20 con 0x7f13381616e0 2023-08-09T12:51:25.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.967+0000 7f1337fff640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f132406a050 0x7f132406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:25.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.968+0000 7f1337fff640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f132406a050 0x7f132406c510 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1328003cc0 tx=0x7f13280079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:25.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:25.971+0000 7f1334ff9640 1 -- 172.21.15.17:0/2925134774 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1338153ca0 con 0x7f13381616e0 2023-08-09T12:51:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.161+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1338153ca0 con 0x7f13381616e0 2023-08-09T12:51:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.162+0000 7f1334ff9640 1 -- 172.21.15.17:0/2925134774 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v167) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1330043020 con 0x7f13381616e0 2023-08-09T12:51:26.165 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:51:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.164+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f132406a050 msgr2=0x7f132406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.164+0000 7f133e5e8640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f132406a050 0x7f132406c510 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1328003cc0 tx=0x7f13280079b0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.164+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13381616e0 msgr2=0x7f1338150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.164+0000 7f133e5e8640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13381616e0 0x7f1338150940 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f1330009eb0 tx=0x7f1330004a40 comp rx=0 tx=0).stop 2023-08-09T12:51:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.165+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 shutdown_connections 2023-08-09T12:51:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.165+0000 7f133e5e8640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f132406a050 0x7f132406c510 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.165+0000 7f133e5e8640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13381616e0 0x7f1338150940 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.165+0000 7f133e5e8640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f133815ce90 0x7f133815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.165+0000 7f133e5e8640 1 --2- 172.21.15.17:0/2925134774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13380d30e0 0x7f133815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.165+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 >> 172.21.15.17:0/2925134774 conn(0x7f133806fde0 msgr2=0x7f13380c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.165+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 shutdown_connections 2023-08-09T12:51:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.165+0000 7f133e5e8640 1 -- 172.21.15.17:0/2925134774 wait complete. 2023-08-09T12:51:26.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:51:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.421+0000 7fb3174e7640 1 Processor -- start 2023-08-09T12:51:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.421+0000 7fb3174e7640 1 -- start start 2023-08-09T12:51:26.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.422+0000 7fb3174e7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3100cfab0 0x7fb3100b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:26.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.422+0000 7fb3174e7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100b2010 con 0x7fb31015d2d0 2023-08-09T12:51:26.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.423+0000 7fb3174e7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100b1d30 con 0x7fb31015cef0 2023-08-09T12:51:26.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.423+0000 7fb3174e7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3100cdee0 con 0x7fb3100cfab0 2023-08-09T12:51:26.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.423+0000 7fb314a82640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3100cfab0 0x7fb3100b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:26.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.423+0000 7fb315a84640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb31015d2d0 0x7fb3100d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45096/0 (socket says 172.21.15.17:45096) 2023-08-09T12:51:26.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.423+0000 7fb315a84640 1 -- 172.21.15.17:0/2203842803 learned_addr learned my addr 172.21.15.17:0/2203842803 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.424+0000 7fb307fff640 1 -- 172.21.15.17:0/2203842803 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170150497 0 0) 0x7fb3100b2010 con 0x7fb31015d2d0 2023-08-09T12:51:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.424+0000 7fb307fff640 1 -- 172.21.15.17:0/2203842803 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2fc003520 con 0x7fb31015d2d0 2023-08-09T12:51:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.424+0000 7fb314a82640 1 -- 172.21.15.17:0/2203842803 >> v1:172.21.15.142:6789/0 conn(0x7fb31015cef0 legacy=0x7fb3100cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.424+0000 7fb314a82640 1 -- 172.21.15.17:0/2203842803 >> v1:172.21.15.17:6789/0 conn(0x7fb31015d2d0 legacy=0x7fb3100d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.424+0000 7fb314a82640 1 -- 172.21.15.17:0/2203842803 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100cd820 con 0x7fb3100cfab0 2023-08-09T12:51:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.426+0000 7fb314a82640 1 --2- 172.21.15.17:0/2203842803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3100cfab0 0x7fb3100b1750 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097a0 tx=0x7fb30002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a6a8e4b499e317c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.426+0000 7fb307fff640 1 -- 172.21.15.17:0/2203842803 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30002e070 con 0x7fb3100cfab0 2023-08-09T12:51:26.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.426+0000 7fb307fff640 1 -- 172.21.15.17:0/2203842803 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3000315a0 con 0x7fb3100cfab0 2023-08-09T12:51:26.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.426+0000 7fb307fff640 1 -- 172.21.15.17:0/2203842803 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300031930 con 0x7fb3100cfab0 2023-08-09T12:51:26.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.427+0000 7fb3174e7640 1 -- 172.21.15.17:0/2203842803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3100cfab0 msgr2=0x7fb3100b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.427+0000 7fb3174e7640 1 --2- 172.21.15.17:0/2203842803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3100cfab0 0x7fb3100b1750 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097a0 tx=0x7fb30002b840 comp rx=0 tx=0).stop 2023-08-09T12:51:26.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.427+0000 7fb3174e7640 1 -- 172.21.15.17:0/2203842803 shutdown_connections 2023-08-09T12:51:26.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.427+0000 7fb3174e7640 1 --2- 172.21.15.17:0/2203842803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3100cfab0 0x7fb3100b1750 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.427+0000 7fb3174e7640 1 -- 172.21.15.17:0/2203842803 >> 172.21.15.17:0/2203842803 conn(0x7fb31006fde0 msgr2=0x7fb3100701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:26.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.427+0000 7fb3174e7640 1 -- 172.21.15.17:0/2203842803 shutdown_connections 2023-08-09T12:51:26.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.427+0000 7fb3174e7640 1 -- 172.21.15.17:0/2203842803 wait complete. 2023-08-09T12:51:26.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.429+0000 7fb3174e7640 1 Processor -- start 2023-08-09T12:51:26.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.429+0000 7fb3174e7640 1 -- start start 2023-08-09T12:51:26.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb3174e7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3100cfab0 0x7fb310148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:26.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb3174e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb31015cef0 0x7fb3100b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:26.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb3174e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31015d2d0 0x7fb3100b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:26.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb3174e7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310156270 con 0x7fb31015d2d0 2023-08-09T12:51:26.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb3174e7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310149490 con 0x7fb31015cef0 2023-08-09T12:51:26.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb3174e7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31015f2d0 con 0x7fb3100cfab0 2023-08-09T12:51:26.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb315a84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31015d2d0 0x7fb3100b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:26.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb315a84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31015d2d0 0x7fb3100b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58806/0 (socket says 172.21.15.17:58806) 2023-08-09T12:51:26.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.430+0000 7fb315a84640 1 -- 172.21.15.17:0/3638670981 learned_addr learned my addr 172.21.15.17:0/3638670981 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:26.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb314a82640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb31015cef0 0x7fb3100b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:26.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb315a84640 1 -- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3100cfab0 msgr2=0x7fb310148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb315283640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3100cfab0 0x7fb310148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:26.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb315a84640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3100cfab0 0x7fb310148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb315a84640 1 -- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb31015cef0 msgr2=0x7fb3100b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb315a84640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb31015cef0 0x7fb3100b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb315a84640 1 -- 172.21.15.17:0/3638670981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300009400 con 0x7fb31015d2d0 2023-08-09T12:51:26.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb314a82640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb31015cef0 0x7fb3100b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:26.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.431+0000 7fb315a84640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31015d2d0 0x7fb3100b3d90 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fb30800cb30 tx=0x7fb30800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:26.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.432+0000 7fb305ffb640 1 -- 172.21.15.17:0/3638670981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30800aca0 con 0x7fb31015d2d0 2023-08-09T12:51:26.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.432+0000 7fb305ffb640 1 -- 172.21.15.17:0/3638670981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30800ae00 con 0x7fb31015d2d0 2023-08-09T12:51:26.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.432+0000 7fb305ffb640 1 -- 172.21.15.17:0/3638670981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308012600 con 0x7fb31015d2d0 2023-08-09T12:51:26.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.432+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31015f5b0 con 0x7fb31015d2d0 2023-08-09T12:51:26.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.432+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31015fb70 con 0x7fb31015d2d0 2023-08-09T12:51:26.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.433+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb310067a80 con 0x7fb31015d2d0 2023-08-09T12:51:26.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.434+0000 7fb305ffb640 1 -- 172.21.15.17:0/3638670981 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb308012820 con 0x7fb31015d2d0 2023-08-09T12:51:26.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.435+0000 7fb305ffb640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb2f406a050 0x7fb2f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:26.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.435+0000 7fb305ffb640 1 -- 172.21.15.17:0/3638670981 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb3080881e0 con 0x7fb31015d2d0 2023-08-09T12:51:26.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.436+0000 7fb315283640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb2f406a050 0x7fb2f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:26.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.437+0000 7fb315283640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb2f406a050 0x7fb2f406c510 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb30c000f60 tx=0x7fb30c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.439+0000 7fb305ffb640 1 -- 172.21.15.17:0/3638670981 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb308053c00 con 0x7fb31015d2d0 2023-08-09T12:51:26.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.633+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb3100b17e0 con 0x7fb31015d2d0 2023-08-09T12:51:26.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.642+0000 7fb305ffb640 1 -- 172.21.15.17:0/3638670981 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb308057220 con 0x7fb31015d2d0 2023-08-09T12:51:26.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb2f406a050 msgr2=0x7fb2f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb2f406a050 0x7fb2f406c510 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb30c000f60 tx=0x7fb30c009040 comp rx=0 tx=0).stop 2023-08-09T12:51:26.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31015d2d0 msgr2=0x7fb3100b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:26.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31015d2d0 0x7fb3100b3d90 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fb30800cb30 tx=0x7fb30800a060 comp rx=0 tx=0).stop 2023-08-09T12:51:26.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 shutdown_connections 2023-08-09T12:51:26.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb2f406a050 0x7fb2f406c510 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31015d2d0 0x7fb3100b3d90 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb31015cef0 0x7fb3100b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 --2- 172.21.15.17:0/3638670981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3100cfab0 0x7fb310148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:26.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 >> 172.21.15.17:0/3638670981 conn(0x7fb31006fde0 msgr2=0x7fb3100701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:26.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 shutdown_connections 2023-08-09T12:51:26.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:26.645+0000 7fb3174e7640 1 -- 172.21.15.17:0/3638670981 wait complete. 2023-08-09T12:51:26.668 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:51:26.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:51:26.798 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:51:26.918 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:51:26.918 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:51:26.919 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:26.986 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:51:26.987 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:51:26.987 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:27.047 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:51:27.048 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:51:27.048 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:27.112 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:51:27.113 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:51:27.113 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:27.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:51:27.175 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:51:27.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:51:27.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.417+0000 7f5662fa4640 1 Processor -- start 2023-08-09T12:51:27.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.418+0000 7f5662fa4640 1 -- start start 2023-08-09T12:51:27.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.419+0000 7f5662fa4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f565c070f00 0x7f565c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.419+0000 7f5662fa4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15bce0 0x7f565c0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.419+0000 7f5662fa4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c071340 con 0x7f565c1587e0 2023-08-09T12:51:27.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.419+0000 7f5662fa4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0715c0 con 0x7f565c070f00 2023-08-09T12:51:27.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.419+0000 7f5662fa4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0718a0 con 0x7f565c15bce0 2023-08-09T12:51:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56617a1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f565c070f00 0x7f565c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56617a1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f565c070f00 0x7f565c15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58822/0 (socket says 172.21.15.17:58822) 2023-08-09T12:51:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56617a1640 1 -- 172.21.15.17:0/574154421 learned_addr learned my addr 172.21.15.17:0/574154421 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:27.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f5661fa2640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f565c1587e0 0x7f565c0b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45100/0 (socket says 172.21.15.17:45100) 2023-08-09T12:51:27.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56627a3640 1 --2- 172.21.15.17:0/574154421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15bce0 0x7f565c0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56617a1640 1 -- 172.21.15.17:0/574154421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15bce0 msgr2=0x7f565c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:27.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56617a1640 1 --2- 172.21.15.17:0/574154421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15bce0 0x7f565c0cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56617a1640 1 -- 172.21.15.17:0/574154421 >> v1:172.21.15.17:6789/0 conn(0x7f565c1587e0 legacy=0x7f565c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:27.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f5660fa0640 1 -- 172.21.15.17:0/574154421 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445578502 0 0) 0x7f565c071340 con 0x7f565c1587e0 2023-08-09T12:51:27.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56617a1640 1 -- 172.21.15.17:0/574154421 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c071b80 con 0x7f565c070f00 2023-08-09T12:51:27.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.420+0000 7f56627a3640 1 --2- 172.21.15.17:0/574154421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15bce0 0x7f565c0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:27.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.422+0000 7f56617a1640 1 --2- 172.21.15.17:0/574154421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c15b7a0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f9b274568155f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:27.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.422+0000 7f5660fa0640 1 -- 172.21.15.17:0/574154421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c030840 con 0x7f565c070f00 2023-08-09T12:51:27.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.422+0000 7f5660fa0640 1 -- 172.21.15.17:0/574154421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c0309a0 con 0x7f565c070f00 2023-08-09T12:51:27.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.422+0000 7f5660fa0640 1 -- 172.21.15.17:0/574154421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c030d30 con 0x7f565c070f00 2023-08-09T12:51:27.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.423+0000 7f5662fa4640 1 -- 172.21.15.17:0/574154421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 msgr2=0x7f565c15b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:27.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.423+0000 7f5662fa4640 1 --2- 172.21.15.17:0/574154421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c15b7a0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c02b980 comp rx=0 tx=0).stop 2023-08-09T12:51:27.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.423+0000 7f5662fa4640 1 -- 172.21.15.17:0/574154421 shutdown_connections 2023-08-09T12:51:27.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.423+0000 7f5662fa4640 1 --2- 172.21.15.17:0/574154421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15bce0 0x7f565c0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.423+0000 7f5662fa4640 1 --2- 172.21.15.17:0/574154421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c15b7a0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.423+0000 7f5662fa4640 1 -- 172.21.15.17:0/574154421 >> 172.21.15.17:0/574154421 conn(0x7f565c0b1d50 msgr2=0x7f565c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:27.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.423+0000 7f5662fa4640 1 -- 172.21.15.17:0/574154421 shutdown_connections 2023-08-09T12:51:27.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.423+0000 7f5662fa4640 1 -- 172.21.15.17:0/574154421 wait complete. 2023-08-09T12:51:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.425+0000 7f5662fa4640 1 Processor -- start 2023-08-09T12:51:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.425+0000 7f5662fa4640 1 -- start start 2023-08-09T12:51:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.426+0000 7f5662fa4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.426+0000 7f5662fa4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f565c1587e0 0x7f565c14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.426+0000 7f5662fa4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15a4d0 0x7f565c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.426+0000 7f5662fa4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c159430 con 0x7f565c070f00 2023-08-09T12:51:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.426+0000 7f5662fa4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c159710 con 0x7f565c1587e0 2023-08-09T12:51:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.426+0000 7f5662fa4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c1599f0 con 0x7f565c15a4d0 2023-08-09T12:51:27.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.426+0000 7f5661fa2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f5661fa2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58834/0 (socket says 172.21.15.17:58834) 2023-08-09T12:51:27.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f5661fa2640 1 -- 172.21.15.17:0/1055232977 learned_addr learned my addr 172.21.15.17:0/1055232977 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:27.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f56627a3640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15a4d0 0x7f565c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f56617a1640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f565c1587e0 0x7f565c14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f5661fa2640 1 -- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15a4d0 msgr2=0x7f565c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:27.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f5661fa2640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15a4d0 0x7f565c1504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f5661fa2640 1 -- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f565c1587e0 msgr2=0x7f565c14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:27.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f5661fa2640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f565c1587e0 0x7f565c14ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f5661fa2640 1 -- 172.21.15.17:0/1055232977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0094d0 con 0x7f565c070f00 2023-08-09T12:51:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.427+0000 7f5661fa2640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c158be0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f565800c4d0 tx=0x7f565800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.428+0000 7f56527fc640 1 -- 172.21.15.17:0/1055232977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56580074e0 con 0x7f565c070f00 2023-08-09T12:51:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.428+0000 7f56527fc640 1 -- 172.21.15.17:0/1055232977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5658007660 con 0x7f565c070f00 2023-08-09T12:51:27.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.428+0000 7f56527fc640 1 -- 172.21.15.17:0/1055232977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658004a20 con 0x7f565c070f00 2023-08-09T12:51:27.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.428+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c159cd0 con 0x7f565c070f00 2023-08-09T12:51:27.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.428+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c159120 con 0x7f565c070f00 2023-08-09T12:51:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.429+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c06fa10 con 0x7f565c070f00 2023-08-09T12:51:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.430+0000 7f56527fc640 1 -- 172.21.15.17:0/1055232977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5658004b80 con 0x7f565c070f00 2023-08-09T12:51:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.432+0000 7f56527fc640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f564006a050 0x7f564006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.432+0000 7f56527fc640 1 -- 172.21.15.17:0/1055232977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5658087520 con 0x7f565c070f00 2023-08-09T12:51:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.432+0000 7f56617a1640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f564006a050 0x7f564006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.433+0000 7f56617a1640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f564006a050 0x7f564006c510 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f564c036000 tx=0x7f564c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.436+0000 7f56527fc640 1 -- 172.21.15.17:0/1055232977 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f565c06fa10 con 0x7f565c070f00 2023-08-09T12:51:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.672+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f565c06fa10 con 0x7f565c070f00 2023-08-09T12:51:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.673+0000 7f56527fc640 1 -- 172.21.15.17:0/1055232977 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+3690 (secure 0 0 0) 0x7f565c06fa10 con 0x7f565c070f00 2023-08-09T12:51:27.681 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:27.681 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/734006206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":734006206},{"type":"v1","addr":"172.21.15.142:6835","nonce":734006206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":6574,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2545254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2545254},{"type":"v1","addr":"172.21.15.142:6837","nonce":2545254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/842290627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":842290627},{"type":"v1","addr":"172.21.15.17:6834","nonce":842290627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8889,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2081826449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2081826449},{"type":"v1","addr":"172.21.15.17:6835","nonce":2081826449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78}],"filesystems":[]} 2023-08-09T12:51:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 78 2023-08-09T12:51:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f564006a050 msgr2=0x7f564006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f564006a050 0x7f564006c510 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f564c036000 tx=0x7f564c03b040 comp rx=0 tx=0).stop 2023-08-09T12:51:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 msgr2=0x7f565c158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c158be0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f565800c4d0 tx=0x7f565800c990 comp rx=0 tx=0).stop 2023-08-09T12:51:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 shutdown_connections 2023-08-09T12:51:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f564006a050 0x7f564006c510 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f565c15a4d0 0x7f565c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f565c1587e0 0x7f565c14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 --2- 172.21.15.17:0/1055232977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f565c070f00 0x7f565c158be0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.675+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 >> 172.21.15.17:0/1055232977 conn(0x7f565c0b1d50 msgr2=0x7f565c151890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.676+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 shutdown_connections 2023-08-09T12:51:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.676+0000 7f5662fa4640 1 -- 172.21.15.17:0/1055232977 wait complete. 2023-08-09T12:51:27.698 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:51:27.699 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:51:27.699 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:51:27.699 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:51:27.699 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:51:27.700 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:51:27.700 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:51:27.700 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:51:27.700 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:51:27.700 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:51:27.701 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:51:27.701 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:51:27.701 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:51:27.701 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:51:27.702 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:51:27.702 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:51:27.716 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:51:27.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:51:27.721 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:51:27.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:51:27.725 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:51:27.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:51:27.727 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:51:27.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:51:27.770 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:51:27.771 DEBUG:teuthology.parallel:result is None 2023-08-09T12:51:27.778 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:51:27.779 DEBUG:teuthology.parallel:result is None 2023-08-09T12:51:27.779 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:51:27.780 DEBUG:teuthology.parallel:result is None 2023-08-09T12:51:27.784 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:51:27.785 DEBUG:teuthology.parallel:result is None 2023-08-09T12:51:27.785 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:51:27.941 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:51:27.941 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:51:27.943 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:51:27.943 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:51:27.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.981+0000 7f7306ecc640 1 Processor -- start 2023-08-09T12:51:27.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.981+0000 7f7306ecc640 1 -- start start 2023-08-09T12:51:27.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7306ecc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7300162650 0x7f7300165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7306ecc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f73000c1980 0x7f7300165870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7306ecc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73000cd520 con 0x7f7300164f50 2023-08-09T12:51:27.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7306ecc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73000cc630 con 0x7f73000c1980 2023-08-09T12:51:27.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7306ecc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73000cc910 con 0x7f7300162650 2023-08-09T12:51:27.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7305469640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f73000c1980 0x7f7300165870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7304c68640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7300164f50 0x7f73000cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58530/0 (socket says 172.21.15.17:58530) 2023-08-09T12:51:27.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7304c68640 1 -- 172.21.15.17:0/1036507168 learned_addr learned my addr 172.21.15.17:0/1036507168 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:27.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f72fffff640 1 --2- 172.21.15.17:0/1036507168 >> v2:172.21.15.142:3300/0 conn(0x7f7300162650 0x7f7300165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.983+0000 7f7305469640 1 -- 172.21.15.17:0/1036507168 >> v2:172.21.15.142:3300/0 conn(0x7f7300162650 msgr2=0x7f7300165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:27.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.984+0000 7f7305469640 1 --2- 172.21.15.17:0/1036507168 >> v2:172.21.15.142:3300/0 conn(0x7f7300162650 0x7f7300165330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.984+0000 7f7305469640 1 -- 172.21.15.17:0/1036507168 >> v1:172.21.15.17:6789/0 conn(0x7f7300164f50 legacy=0x7f73000cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:27.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.984+0000 7f7305469640 1 -- 172.21.15.17:0/1036507168 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000ccbf0 con 0x7f73000c1980 2023-08-09T12:51:27.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.984+0000 7f72fffff640 1 --2- 172.21.15.17:0/1036507168 >> v2:172.21.15.142:3300/0 conn(0x7f7300162650 0x7f7300165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:27.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.985+0000 7f7305469640 1 --2- 172.21.15.17:0/1036507168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f7300165870 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f7300164e90 tx=0x7f72f802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687f655b65b2d262 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:27.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.985+0000 7f72ff7fe640 1 -- 172.21.15.17:0/1036507168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f802cc70 con 0x7f73000c1980 2023-08-09T12:51:27.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.985+0000 7f72ff7fe640 1 -- 172.21.15.17:0/1036507168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f802cdd0 con 0x7f73000c1980 2023-08-09T12:51:27.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.985+0000 7f72ff7fe640 1 -- 172.21.15.17:0/1036507168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8034660 con 0x7f73000c1980 2023-08-09T12:51:27.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.986+0000 7f7306ecc640 1 -- 172.21.15.17:0/1036507168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 msgr2=0x7f7300165870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:27.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.986+0000 7f7306ecc640 1 --2- 172.21.15.17:0/1036507168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f7300165870 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f7300164e90 tx=0x7f72f802bec0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.986+0000 7f7306ecc640 1 -- 172.21.15.17:0/1036507168 shutdown_connections 2023-08-09T12:51:27.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.986+0000 7f7306ecc640 1 --2- 172.21.15.17:0/1036507168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f7300165870 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.986+0000 7f7306ecc640 1 --2- 172.21.15.17:0/1036507168 >> v2:172.21.15.142:3300/0 conn(0x7f7300162650 0x7f7300165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:27.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.986+0000 7f7306ecc640 1 -- 172.21.15.17:0/1036507168 >> 172.21.15.17:0/1036507168 conn(0x7f73000cb1b0 msgr2=0x7f73000cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:27.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.986+0000 7f7306ecc640 1 -- 172.21.15.17:0/1036507168 shutdown_connections 2023-08-09T12:51:27.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.986+0000 7f7306ecc640 1 -- 172.21.15.17:0/1036507168 wait complete. 2023-08-09T12:51:27.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.988+0000 7f7306ecc640 1 Processor -- start 2023-08-09T12:51:27.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.988+0000 7f7306ecc640 1 -- start start 2023-08-09T12:51:27.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7306ecc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f73000c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7306ecc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7300162650 0x7f73000aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7306ecc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7300164f50 0x7f73000af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:27.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7306ecc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730006c240 con 0x7f73000c1980 2023-08-09T12:51:27.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7306ecc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300162a30 con 0x7f7300162650 2023-08-09T12:51:27.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7306ecc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730006b1d0 con 0x7f7300164f50 2023-08-09T12:51:27.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7304c68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f73000c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:27.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7304c68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f73000c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51986/0 (socket says 172.21.15.17:51986) 2023-08-09T12:51:27.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.989+0000 7f7304c68640 1 -- 172.21.15.17:0/740590189 learned_addr learned my addr 172.21.15.17:0/740590189 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:28.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f72fffff640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7300162650 0x7f73000aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:28.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f7305469640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7300164f50 0x7f73000af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:28.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f7304c68640 1 -- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7300164f50 msgr2=0x7f73000af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:28.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f7304c68640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7300164f50 0x7f73000af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:28.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f7304c68640 1 -- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7300162650 msgr2=0x7f73000aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:28.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f7304c68640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7300162650 0x7f73000aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:28.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f7304c68640 1 -- 172.21.15.17:0/740590189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8009a70 con 0x7f73000c1980 2023-08-09T12:51:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f7305469640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7300164f50 0x7f73000af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.990+0000 7f7304c68640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f73000c8270 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f72f400c4a0 tx=0x7f72f400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.991+0000 7f72fd7fa640 1 -- 172.21.15.17:0/740590189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4005ce0 con 0x7f73000c1980 2023-08-09T12:51:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.991+0000 7f72fd7fa640 1 -- 172.21.15.17:0/740590189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4005e40 con 0x7f73000c1980 2023-08-09T12:51:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.991+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7300162c80 con 0x7f73000c1980 2023-08-09T12:51:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.991+0000 7f72fd7fa640 1 -- 172.21.15.17:0/740590189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4007270 con 0x7f73000c1980 2023-08-09T12:51:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.991+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7300163240 con 0x7f73000c1980 2023-08-09T12:51:28.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.992+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7300163890 con 0x7f73000c1980 2023-08-09T12:51:28.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.993+0000 7f72fd7fa640 1 -- 172.21.15.17:0/740590189 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f72f40073d0 con 0x7f73000c1980 2023-08-09T12:51:28.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.994+0000 7f72fd7fa640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72e406a080 0x7f72e406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:28.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.994+0000 7f72fd7fa640 1 -- 172.21.15.17:0/740590189 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f72f4087700 con 0x7f73000c1980 2023-08-09T12:51:28.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.995+0000 7f72fffff640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72e406a080 0x7f72e406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:28.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.995+0000 7f72fffff640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72e406a080 0x7f72e406c540 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f73000c87b0 tx=0x7f72ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:28.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:27.998+0000 7f72fd7fa640 1 -- 172.21.15.17:0/740590189 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f72f40531b0 con 0x7f73000c1980 2023-08-09T12:51:28.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.202+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7300067a80 con 0x7f73000c1980 2023-08-09T12:51:28.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.806+0000 7f72fd7fa640 1 -- 172.21.15.17:0/740590189 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v169) v1 ==== 97+0+0 (secure 0 0 0) 0x7f72f4087070 con 0x7f73000c1980 2023-08-09T12:51:28.810 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:51:28.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.809+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72e406a080 msgr2=0x7f72e406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:28.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.809+0000 7f7306ecc640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72e406a080 0x7f72e406c540 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f73000c87b0 tx=0x7f72ec008040 comp rx=0 tx=0).stop 2023-08-09T12:51:28.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.809+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 msgr2=0x7f73000c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:28.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.809+0000 7f7306ecc640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f73000c8270 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f72f400c4a0 tx=0x7f72f400c960 comp rx=0 tx=0).stop 2023-08-09T12:51:28.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.810+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 shutdown_connections 2023-08-09T12:51:28.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.810+0000 7f7306ecc640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f72e406a080 0x7f72e406c540 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:28.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.810+0000 7f7306ecc640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7300164f50 0x7f73000af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.810+0000 7f7306ecc640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7300162650 0x7f73000aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.810+0000 7f7306ecc640 1 --2- 172.21.15.17:0/740590189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73000c1980 0x7f73000c8270 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.810+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 >> 172.21.15.17:0/740590189 conn(0x7f73000cb1b0 msgr2=0x7f7300161e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.810+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 shutdown_connections 2023-08-09T12:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:28.810+0000 7f7306ecc640 1 -- 172.21.15.17:0/740590189 wait complete. 2023-08-09T12:51:28.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:51:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.061+0000 7fbb3cf76640 1 Processor -- start 2023-08-09T12:51:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.062+0000 7fbb3cf76640 1 -- start start 2023-08-09T12:51:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.063+0000 7fbb3cf76640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbb38072ce0 0x7fbb380ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.063+0000 7fbb3cf76640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3806a430 con 0x7fbb38072850 2023-08-09T12:51:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.063+0000 7fbb3cf76640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3815b320 con 0x7fbb3815af40 2023-08-09T12:51:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.063+0000 7fbb3cf76640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb38069860 con 0x7fbb38072ce0 2023-08-09T12:51:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.064+0000 7fbb36d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbb38072ce0 0x7fbb380ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.064+0000 7fbb36d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbb38072ce0 0x7fbb380ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51994/0 (socket says 172.21.15.17:51994) 2023-08-09T12:51:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.064+0000 7fbb36d9d640 1 -- 172.21.15.17:0/1398208148 learned_addr learned my addr 172.21.15.17:0/1398208148 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:29.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.064+0000 7fbb2dd9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fbb38072850 0x7fbb380ca1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58546/0 (socket says 172.21.15.17:58546) 2023-08-09T12:51:29.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.064+0000 7fbb36d9d640 1 -- 172.21.15.17:0/1398208148 >> v1:172.21.15.142:6789/0 conn(0x7fbb3815af40 legacy=0x7fbb3806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:29.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.064+0000 7fbb36d9d640 1 -- 172.21.15.17:0/1398208148 >> v1:172.21.15.17:6789/0 conn(0x7fbb38072850 legacy=0x7fbb380ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.064+0000 7fbb36d9d640 1 -- 172.21.15.17:0/1398208148 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38073150 con 0x7fbb38072ce0 2023-08-09T12:51:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.065+0000 7fbb36d9d640 1 --2- 172.21.15.17:0/1398208148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb38072ce0 0x7fbb380ca8e0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009870 tx=0x7fbb3002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46365a951c11bcb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.066+0000 7fbb35d9b640 1 -- 172.21.15.17:0/1398208148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3002f850 con 0x7fbb38072ce0 2023-08-09T12:51:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.066+0000 7fbb35d9b640 1 -- 172.21.15.17:0/1398208148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3002f9b0 con 0x7fbb38072ce0 2023-08-09T12:51:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.066+0000 7fbb35d9b640 1 -- 172.21.15.17:0/1398208148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3002fd40 con 0x7fbb38072ce0 2023-08-09T12:51:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.066+0000 7fbb3cf76640 1 -- 172.21.15.17:0/1398208148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb38072ce0 msgr2=0x7fbb380ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.066+0000 7fbb3cf76640 1 --2- 172.21.15.17:0/1398208148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb38072ce0 0x7fbb380ca8e0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009870 tx=0x7fbb3002ba30 comp rx=0 tx=0).stop 2023-08-09T12:51:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.067+0000 7fbb3cf76640 1 -- 172.21.15.17:0/1398208148 shutdown_connections 2023-08-09T12:51:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.067+0000 7fbb3cf76640 1 --2- 172.21.15.17:0/1398208148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb38072ce0 0x7fbb380ca8e0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.067+0000 7fbb3cf76640 1 -- 172.21.15.17:0/1398208148 >> 172.21.15.17:0/1398208148 conn(0x7fbb380cc2e0 msgr2=0x7fbb380cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.067+0000 7fbb3cf76640 1 -- 172.21.15.17:0/1398208148 shutdown_connections 2023-08-09T12:51:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.067+0000 7fbb3cf76640 1 -- 172.21.15.17:0/1398208148 wait complete. 2023-08-09T12:51:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.068+0000 7fbb3cf76640 1 Processor -- start 2023-08-09T12:51:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.069+0000 7fbb3cf76640 1 -- start start 2023-08-09T12:51:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb3cf76640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb38072850 0x7fbb3815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb3cf76640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb38072ce0 0x7fbb381e4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb3cf76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb3815af40 0x7fbb38154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb3cf76640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380b47f0 con 0x7fbb3815af40 2023-08-09T12:51:29.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb3cf76640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380b4ad0 con 0x7fbb38072850 2023-08-09T12:51:29.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb3cf76640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380b4db0 con 0x7fbb38072ce0 2023-08-09T12:51:29.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb36d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb3815af40 0x7fbb38154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb36d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb3815af40 0x7fbb38154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52004/0 (socket says 172.21.15.17:52004) 2023-08-09T12:51:29.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb36d9d640 1 -- 172.21.15.17:0/3503896110 learned_addr learned my addr 172.21.15.17:0/3503896110 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:29.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb36d9d640 1 -- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb38072ce0 msgr2=0x7fbb381e4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb3659c640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb38072850 0x7fbb3815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb2dd9b640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb38072ce0 0x7fbb381e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb36d9d640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb38072ce0 0x7fbb381e4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb36d9d640 1 -- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb38072850 msgr2=0x7fbb3815c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb36d9d640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb38072850 0x7fbb3815c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.070+0000 7fbb36d9d640 1 -- 172.21.15.17:0/3503896110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb300094d0 con 0x7fbb3815af40 2023-08-09T12:51:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.071+0000 7fbb3659c640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb38072850 0x7fbb3815c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.071+0000 7fbb36d9d640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb3815af40 0x7fbb38154a70 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009870 tx=0x7fbb30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.071+0000 7fbb2f7fe640 1 -- 172.21.15.17:0/3503896110 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3002f7e0 con 0x7fbb3815af40 2023-08-09T12:51:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.071+0000 7fbb2f7fe640 1 -- 172.21.15.17:0/3503896110 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb30041400 con 0x7fbb3815af40 2023-08-09T12:51:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.071+0000 7fbb2f7fe640 1 -- 172.21.15.17:0/3503896110 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb300417b0 con 0x7fbb3815af40 2023-08-09T12:51:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.071+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb380b5090 con 0x7fbb3815af40 2023-08-09T12:51:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.071+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb380b4430 con 0x7fbb3815af40 2023-08-09T12:51:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.073+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb38067a80 con 0x7fbb3815af40 2023-08-09T12:51:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.074+0000 7fbb2f7fe640 1 -- 172.21.15.17:0/3503896110 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbb30041910 con 0x7fbb3815af40 2023-08-09T12:51:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.075+0000 7fbb2f7fe640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb1806a050 0x7fbb1806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.075+0000 7fbb2f7fe640 1 -- 172.21.15.17:0/3503896110 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbb3003c070 con 0x7fbb3815af40 2023-08-09T12:51:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.075+0000 7fbb3659c640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb1806a050 0x7fbb1806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.076+0000 7fbb3659c640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb1806a050 0x7fbb1806c510 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fbb280012e0 tx=0x7fbb28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.079+0000 7fbb2f7fe640 1 -- 172.21.15.17:0/3503896110 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbb30076c20 con 0x7fbb3815af40 2023-08-09T12:51:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.346+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbb38067230 con 0x7fbb3815af40 2023-08-09T12:51:29.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.347+0000 7fbb2f7fe640 1 -- 172.21.15.17:0/3503896110 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbb3007a240 con 0x7fbb3815af40 2023-08-09T12:51:29.352 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:29.352 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:51:29.352 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:51:29.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.353 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:51:29.354 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:51:29.356 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.356 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:51:29.356 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:51:29.357 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:51:29.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.357 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:51:29.357 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:51:29.358 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.358 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:51:29.358 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:51:29.358 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:51:29.358 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.359 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:51:29.359 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:51:29.359 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:51:29.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:51:29.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:51:29.359 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.360 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:51:29.360 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:51:29.360 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:51:29.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:51:29.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:51:29.361 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.362 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:51:29.362 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:51:29.362 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.362 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:51:29.362 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:51:29.362 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.363 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:51:29.363 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:51:29.363 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.363 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:51:29.364 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:51:29.364 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.365 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:51:29.365 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:51:29.365 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.365 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:51:29.365 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:51:29.368 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.369 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:51:29.369 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:51:29.370 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:51:29.371 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:51:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:51:29.372 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:51:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:51:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:51:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:51:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:51:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:51:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:51:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.375 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:51:29.375 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:51:29.375 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.375 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:51:29.376 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:51:29.376 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.376 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.376 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:51:29.376 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:51:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:51:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:51:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.378 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:51:29.378 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:51:29.378 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.379 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:51:29.379 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:51:29.379 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:51:29.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.380 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:51:29.380 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:51:29.380 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.381 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:51:29.382 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:51:29.382 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:51:29.382 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:51:29.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.383 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:51:29.383 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:51:29.383 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.383 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:51:29.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:51:29.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:51:29.384 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:51:29.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.385 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:51:29.385 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:51:29.385 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.385 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:51:29.386 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:51:29.386 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:51:29.386 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:51:29.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.386 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:51:29.387 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:51:29.387 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.387 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:51:29.387 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:51:29.387 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:51:29.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.388 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:51:29.388 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:51:29.388 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:51:29.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:51:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:51:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:51:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:51:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:51:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:51:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:51:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:51:29.390 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:51:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.350+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb1806a050 msgr2=0x7fbb1806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.350+0000 7fbb3cf76640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb1806a050 0x7fbb1806c510 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fbb280012e0 tx=0x7fbb28009040 comp rx=0 tx=0).stop 2023-08-09T12:51:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.350+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb3815af40 msgr2=0x7fbb38154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.350+0000 7fbb3cf76640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb3815af40 0x7fbb38154a70 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009870 tx=0x7fbb30004730 comp rx=0 tx=0).stop 2023-08-09T12:51:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.351+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 shutdown_connections 2023-08-09T12:51:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.351+0000 7fbb3cf76640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbb1806a050 0x7fbb1806c510 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.351+0000 7fbb3cf76640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb3815af40 0x7fbb38154a70 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.351+0000 7fbb3cf76640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb38072ce0 0x7fbb381e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.351+0000 7fbb3cf76640 1 --2- 172.21.15.17:0/3503896110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb38072850 0x7fbb3815c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.351+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 >> 172.21.15.17:0/3503896110 conn(0x7fbb380cc2e0 msgr2=0x7fbb3815d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:29.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.351+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 shutdown_connections 2023-08-09T12:51:29.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.351+0000 7fbb3cf76640 1 -- 172.21.15.17:0/3503896110 wait complete. 2023-08-09T12:51:29.395 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.619+0000 7f864ed99640 1 Processor -- start 2023-08-09T12:51:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.619+0000 7f864ed99640 1 -- start start 2023-08-09T12:51:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.620+0000 7f864ed99640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8648159d80 0x7f86480b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.620+0000 7f864ed99640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86480ad810 0x7f8648070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.620+0000 7f864ed99640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86480b4630 con 0x7f86480708c0 2023-08-09T12:51:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.620+0000 7f864ed99640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8648070d50 con 0x7f8648159d80 2023-08-09T12:51:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.620+0000 7f864ed99640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864815a160 con 0x7f86480ad810 2023-08-09T12:51:29.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.621+0000 7f864cb35640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8648159d80 0x7f86480b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.621+0000 7f864cb35640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8648159d80 0x7f86480b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52020/0 (socket says 172.21.15.17:52020) 2023-08-09T12:51:29.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.621+0000 7f864cb35640 1 -- 172.21.15.17:0/1333074959 learned_addr learned my addr 172.21.15.17:0/1333074959 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:29.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.621+0000 7f8647fff640 1 --2- 172.21.15.17:0/1333074959 >> v2:172.21.15.142:3300/0 conn(0x7f86480ad810 0x7f8648070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.621+0000 7f864cb35640 1 -- 172.21.15.17:0/1333074959 >> v2:172.21.15.142:3300/0 conn(0x7f86480ad810 msgr2=0x7f8648070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:29.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.621+0000 7f864cb35640 1 --2- 172.21.15.17:0/1333074959 >> v2:172.21.15.142:3300/0 conn(0x7f86480ad810 0x7f8648070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.621+0000 7f864cb35640 1 -- 172.21.15.17:0/1333074959 >> v1:172.21.15.17:6789/0 conn(0x7f86480708c0 legacy=0x7f864806eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.622+0000 7f864cb35640 1 -- 172.21.15.17:0/1333074959 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86480b3ab0 con 0x7f8648159d80 2023-08-09T12:51:29.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.623+0000 7f864cb35640 1 --2- 172.21.15.17:0/1333074959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480b34d0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f86480b1270 tx=0x7f863c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ee6f6ea3f52e65 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.623+0000 7f86477fe640 1 -- 172.21.15.17:0/1333074959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c004230 con 0x7f8648159d80 2023-08-09T12:51:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.623+0000 7f86477fe640 1 -- 172.21.15.17:0/1333074959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c02e050 con 0x7f8648159d80 2023-08-09T12:51:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.623+0000 7f86477fe640 1 -- 172.21.15.17:0/1333074959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c003610 con 0x7f8648159d80 2023-08-09T12:51:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.624+0000 7f864ed99640 1 -- 172.21.15.17:0/1333074959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 msgr2=0x7f86480b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.624+0000 7f864ed99640 1 --2- 172.21.15.17:0/1333074959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480b34d0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f86480b1270 tx=0x7f863c02b7e0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.624+0000 7f864ed99640 1 -- 172.21.15.17:0/1333074959 shutdown_connections 2023-08-09T12:51:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.624+0000 7f864ed99640 1 --2- 172.21.15.17:0/1333074959 >> v2:172.21.15.142:3300/0 conn(0x7f86480ad810 0x7f8648070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.624+0000 7f864ed99640 1 --2- 172.21.15.17:0/1333074959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480b34d0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.624+0000 7f864ed99640 1 -- 172.21.15.17:0/1333074959 >> 172.21.15.17:0/1333074959 conn(0x7f86480cb1b0 msgr2=0x7f86480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.624+0000 7f864ed99640 1 -- 172.21.15.17:0/1333074959 shutdown_connections 2023-08-09T12:51:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.624+0000 7f864ed99640 1 -- 172.21.15.17:0/1333074959 wait complete. 2023-08-09T12:51:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.626+0000 7f864ed99640 1 Processor -- start 2023-08-09T12:51:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.626+0000 7f864ed99640 1 -- start start 2023-08-09T12:51:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.627+0000 7f864ed99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86480708c0 0x7f8648154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.627+0000 7f864ed99640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86480ad810 0x7f86480c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.627+0000 7f864ed99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.627+0000 7f864ed99640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8648155710 con 0x7f8648159d80 2023-08-09T12:51:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.627+0000 7f864ed99640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86481559b0 con 0x7f86480ad810 2023-08-09T12:51:29.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.627+0000 7f864ed99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8648155c90 con 0x7f86480708c0 2023-08-09T12:51:29.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864d336640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864d336640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52036/0 (socket says 172.21.15.17:52036) 2023-08-09T12:51:29.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864d336640 1 -- 172.21.15.17:0/2993839319 learned_addr learned my addr 172.21.15.17:0/2993839319 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:29.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f8647fff640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86480ad810 0x7f86480c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864cb35640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86480708c0 0x7f8648154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864d336640 1 -- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86480708c0 msgr2=0x7f8648154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864d336640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86480708c0 0x7f8648154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864d336640 1 -- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86480ad810 msgr2=0x7f86480c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864d336640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86480ad810 0x7f86480c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f864d336640 1 -- 172.21.15.17:0/2993839319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0094d0 con 0x7f8648159d80 2023-08-09T12:51:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.628+0000 7f8647fff640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86480ad810 0x7f86480c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.629+0000 7f864d336640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480c2710 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f864000c8c0 tx=0x7f864000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:29.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.629+0000 7f86457fa640 1 -- 172.21.15.17:0/2993839319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640003da0 con 0x7f8648159d80 2023-08-09T12:51:29.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.629+0000 7f86457fa640 1 -- 172.21.15.17:0/2993839319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640005070 con 0x7f8648159d80 2023-08-09T12:51:29.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.629+0000 7f86457fa640 1 -- 172.21.15.17:0/2993839319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640005440 con 0x7f8648159d80 2023-08-09T12:51:29.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.629+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8648155f70 con 0x7f8648159d80 2023-08-09T12:51:29.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.629+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86480c3f60 con 0x7f8648159d80 2023-08-09T12:51:29.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.630+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86481561b0 con 0x7f8648159d80 2023-08-09T12:51:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.632+0000 7f86457fa640 1 -- 172.21.15.17:0/2993839319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f86400055a0 con 0x7f8648159d80 2023-08-09T12:51:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.633+0000 7f86457fa640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862c06a050 0x7f862c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.633+0000 7f86457fa640 1 -- 172.21.15.17:0/2993839319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8640087cc0 con 0x7f8648159d80 2023-08-09T12:51:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.634+0000 7f864cb35640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862c06a050 0x7f862c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.635+0000 7f864cb35640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862c06a050 0x7f862c06c510 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f863c034000 tx=0x7f863c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.637+0000 7f86457fa640 1 -- 172.21.15.17:0/2993839319 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f86481561b0 con 0x7f8648159d80 2023-08-09T12:51:29.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.832+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8648156160 con 0x7f8648159d80 2023-08-09T12:51:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.834+0000 7f86457fa640 1 -- 172.21.15.17:0/2993839319 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f8640017070 con 0x7f8648159d80 2023-08-09T12:51:29.838 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:29.838 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":171,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:51:28.820482+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862c06a050 msgr2=0x7f862c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862c06a050 0x7f862c06c510 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f863c034000 tx=0x7f863c008030 comp rx=0 tx=0).stop 2023-08-09T12:51:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 msgr2=0x7f86480c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480c2710 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f864000c8c0 tx=0x7f864000cd80 comp rx=0 tx=0).stop 2023-08-09T12:51:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 shutdown_connections 2023-08-09T12:51:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862c06a050 0x7f862c06c510 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8648159d80 0x7f86480c2710 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86480ad810 0x7f86480c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 --2- 172.21.15.17:0/2993839319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86480708c0 0x7f8648154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:29.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 >> 172.21.15.17:0/2993839319 conn(0x7f86480cb1b0 msgr2=0x7f86480c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:29.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 shutdown_connections 2023-08-09T12:51:29.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:29.837+0000 7f864ed99640 1 -- 172.21.15.17:0/2993839319 wait complete. 2023-08-09T12:51:29.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:51:29.861 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:51:30.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.088+0000 7f886b257640 1 Processor -- start 2023-08-09T12:51:30.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.088+0000 7f886b257640 1 -- start start 2023-08-09T12:51:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.090+0000 7f886b257640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f88640adc40 0x7f886406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.090+0000 7f886b257640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88640cc630 0x7f88640ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.090+0000 7f886b257640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88640b2250 con 0x7f88640b3b40 2023-08-09T12:51:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.090+0000 7f886b257640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640ae020 con 0x7f88640adc40 2023-08-09T12:51:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.090+0000 7f886b257640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640b2530 con 0x7f88640cc630 2023-08-09T12:51:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.090+0000 7f8868ff3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f88640adc40 0x7f886406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.090+0000 7f8868ff3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f88640adc40 0x7f886406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52048/0 (socket says 172.21.15.17:52048) 2023-08-09T12:51:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.090+0000 7f8868ff3640 1 -- 172.21.15.17:0/2135494481 learned_addr learned my addr 172.21.15.17:0/2135494481 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.091+0000 7f8868ff3640 1 -- 172.21.15.17:0/2135494481 >> v2:172.21.15.142:3300/0 conn(0x7f88640cc630 msgr2=0x7f88640ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.091+0000 7f8868ff3640 1 --2- 172.21.15.17:0/2135494481 >> v2:172.21.15.142:3300/0 conn(0x7f88640cc630 0x7f88640ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.091+0000 7f8868ff3640 1 -- 172.21.15.17:0/2135494481 >> v1:172.21.15.142:6789/0 conn(0x7f88640b3b40 legacy=0x7f88640b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.091+0000 7f8868ff3640 1 -- 172.21.15.17:0/2135494481 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886406fe80 con 0x7f88640adc40 2023-08-09T12:51:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.092+0000 7f8868ff3640 1 --2- 172.21.15.17:0/2135494481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640adc40 0x7f886406c280 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f88640caff0 tx=0x7f886002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ffdbf75587afcf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:30.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.092+0000 7f885b7fe640 1 -- 172.21.15.17:0/2135494481 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886002c9f0 con 0x7f88640adc40 2023-08-09T12:51:30.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.092+0000 7f885b7fe640 1 -- 172.21.15.17:0/2135494481 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886002cb50 con 0x7f88640adc40 2023-08-09T12:51:30.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.092+0000 7f885b7fe640 1 -- 172.21.15.17:0/2135494481 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600343f0 con 0x7f88640adc40 2023-08-09T12:51:30.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.093+0000 7f886b257640 1 -- 172.21.15.17:0/2135494481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640adc40 msgr2=0x7f886406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.093+0000 7f886b257640 1 --2- 172.21.15.17:0/2135494481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640adc40 0x7f886406c280 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f88640caff0 tx=0x7f886002be50 comp rx=0 tx=0).stop 2023-08-09T12:51:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.093+0000 7f886b257640 1 -- 172.21.15.17:0/2135494481 shutdown_connections 2023-08-09T12:51:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.093+0000 7f886b257640 1 --2- 172.21.15.17:0/2135494481 >> v2:172.21.15.142:3300/0 conn(0x7f88640cc630 0x7f88640ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.093+0000 7f886b257640 1 --2- 172.21.15.17:0/2135494481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640adc40 0x7f886406c280 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.093+0000 7f886b257640 1 -- 172.21.15.17:0/2135494481 >> 172.21.15.17:0/2135494481 conn(0x7f88640cb1b0 msgr2=0x7f88640cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.093+0000 7f886b257640 1 -- 172.21.15.17:0/2135494481 shutdown_connections 2023-08-09T12:51:30.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.093+0000 7f886b257640 1 -- 172.21.15.17:0/2135494481 wait complete. 2023-08-09T12:51:30.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.095+0000 7f886b257640 1 Processor -- start 2023-08-09T12:51:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.095+0000 7f886b257640 1 -- start start 2023-08-09T12:51:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.096+0000 7f886b257640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88640adc40 0x7f88641496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.096+0000 7f886b257640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640b3b40 0x7f8864148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.096+0000 7f886b257640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88640cc630 0x7f88640c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.096+0000 7f886b257640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c66e0 con 0x7f88640b3b40 2023-08-09T12:51:30.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.096+0000 7f886b257640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864149d30 con 0x7f88640adc40 2023-08-09T12:51:30.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.096+0000 7f886b257640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886414a010 con 0x7f88640cc630 2023-08-09T12:51:30.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640b3b40 0x7f8864148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640b3b40 0x7f8864148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52056/0 (socket says 172.21.15.17:52056) 2023-08-09T12:51:30.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 -- 172.21.15.17:0/155656082 learned_addr learned my addr 172.21.15.17:0/155656082 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:30.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f8868ff3640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88640adc40 0x7f88641496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 -- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88640cc630 msgr2=0x7f88640c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88640cc630 0x7f88640c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 -- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88640adc40 msgr2=0x7f88641496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88640adc40 0x7f88641496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 -- 172.21.15.17:0/155656082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009b30 con 0x7f88640b3b40 2023-08-09T12:51:30.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.097+0000 7f885bfff640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640b3b40 0x7f8864148f90 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f885400c400 tx=0x7f885400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:30.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.098+0000 7f88597fa640 1 -- 172.21.15.17:0/155656082 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540054e0 con 0x7f88640b3b40 2023-08-09T12:51:30.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.098+0000 7f88597fa640 1 -- 172.21.15.17:0/155656082 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854003640 con 0x7f88640b3b40 2023-08-09T12:51:30.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.098+0000 7f88597fa640 1 -- 172.21.15.17:0/155656082 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540039f0 con 0x7f88640b3b40 2023-08-09T12:51:30.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.098+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886414a2f0 con 0x7f88640b3b40 2023-08-09T12:51:30.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.098+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886414a8b0 con 0x7f88640b3b40 2023-08-09T12:51:30.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.099+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8864067a80 con 0x7f88640b3b40 2023-08-09T12:51:30.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.100+0000 7f88597fa640 1 -- 172.21.15.17:0/155656082 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8854003b50 con 0x7f88640b3b40 2023-08-09T12:51:30.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.101+0000 7f88597fa640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.101+0000 7f88597fa640 1 -- 172.21.15.17:0/155656082 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f88540873a0 con 0x7f88640b3b40 2023-08-09T12:51:30.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.102+0000 7f8868ff3640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.103+0000 7f8868ff3640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8860035000 tx=0x7f8860030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:30.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.105+0000 7f88597fa640 1 -- 172.21.15.17:0/155656082 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8854052e80 con 0x7f88640b3b40 2023-08-09T12:51:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.299+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f886406ed40 con 0x7f88640b3b40 2023-08-09T12:51:30.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.299+0000 7f88597fa640 1 -- 172.21.15.17:0/155656082 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v171) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88540564a0 con 0x7f88640b3b40 2023-08-09T12:51:30.303 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:51:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 msgr2=0x7f885006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8860035000 tx=0x7f8860030000 comp rx=0 tx=0).stop 2023-08-09T12:51:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640b3b40 msgr2=0x7f8864148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640b3b40 0x7f8864148f90 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f885400c400 tx=0x7f885400c8c0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 shutdown_connections 2023-08-09T12:51:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f885006a050 0x7f885006c510 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88640cc630 0x7f88640c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88640b3b40 0x7f8864148f90 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 --2- 172.21.15.17:0/155656082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88640adc40 0x7f88641496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 >> 172.21.15.17:0/155656082 conn(0x7f88640cb1b0 msgr2=0x7f886406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 shutdown_connections 2023-08-09T12:51:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.302+0000 7f886b257640 1 -- 172.21.15.17:0/155656082 wait complete. 2023-08-09T12:51:30.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.548+0000 7f2ae4e7c640 1 Processor -- start 2023-08-09T12:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.549+0000 7f2ae4e7c640 1 -- start start 2023-08-09T12:51:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.550+0000 7f2ae4e7c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2ae00acfc0 0x7f2ae0167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.550+0000 7f2ae4e7c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae015df30 con 0x7f2ae0161280 2023-08-09T12:51:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.550+0000 7f2ae4e7c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae00ca9d0 con 0x7f2ae0161660 2023-08-09T12:51:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.550+0000 7f2ae4e7c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae015d430 con 0x7f2ae00acfc0 2023-08-09T12:51:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.551+0000 7f2ade59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2ae0161280 0x7f2ae00c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58574/0 (socket says 172.21.15.17:58574) 2023-08-09T12:51:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.551+0000 7f2ade59c640 1 -- 172.21.15.17:0/481994768 learned_addr learned my addr 172.21.15.17:0/481994768 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.551+0000 7f2aded9d640 1 --2- 172.21.15.17:0/481994768 >> v2:172.21.15.17:3300/0 conn(0x7f2ae00acfc0 0x7f2ae0167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.551+0000 7f2aded9d640 1 -- 172.21.15.17:0/481994768 >> v1:172.21.15.142:6789/0 conn(0x7f2ae0161660 legacy=0x7f2ae00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.551+0000 7f2addd9b640 1 -- 172.21.15.17:0/481994768 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702950174 0 0) 0x7f2ae015df30 con 0x7f2ae0161280 2023-08-09T12:51:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.551+0000 7f2aded9d640 1 -- 172.21.15.17:0/481994768 >> v1:172.21.15.17:6789/0 conn(0x7f2ae0161280 legacy=0x7f2ae00c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.551+0000 7f2aded9d640 1 -- 172.21.15.17:0/481994768 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae015e3c0 con 0x7f2ae00acfc0 2023-08-09T12:51:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.553+0000 7f2aded9d640 1 --2- 172.21.15.17:0/481994768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae00acfc0 0x7f2ae0167db0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009d90 tx=0x7f2ad802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc658614e8f9561a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.553+0000 7f2addd9b640 1 -- 172.21.15.17:0/481994768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad802cc60 con 0x7f2ae00acfc0 2023-08-09T12:51:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.553+0000 7f2addd9b640 1 -- 172.21.15.17:0/481994768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad802cdc0 con 0x7f2ae00acfc0 2023-08-09T12:51:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.553+0000 7f2addd9b640 1 -- 172.21.15.17:0/481994768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8034660 con 0x7f2ae00acfc0 2023-08-09T12:51:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.554+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/481994768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae00acfc0 msgr2=0x7f2ae0167db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.554+0000 7f2ae4e7c640 1 --2- 172.21.15.17:0/481994768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae00acfc0 0x7f2ae0167db0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009d90 tx=0x7f2ad802beb0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.554+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/481994768 shutdown_connections 2023-08-09T12:51:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.554+0000 7f2ae4e7c640 1 --2- 172.21.15.17:0/481994768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae00acfc0 0x7f2ae0167db0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.554+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/481994768 >> 172.21.15.17:0/481994768 conn(0x7f2ae00cb1b0 msgr2=0x7f2ae00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.554+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/481994768 shutdown_connections 2023-08-09T12:51:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.554+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/481994768 wait complete. 2023-08-09T12:51:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.556+0000 7f2ae4e7c640 1 Processor -- start 2023-08-09T12:51:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.556+0000 7f2ae4e7c640 1 -- start start 2023-08-09T12:51:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.557+0000 7f2ae4e7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae00acfc0 0x7f2ae00c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.557+0000 7f2ae4e7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae0161280 0x7f2ae0148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.557+0000 7f2ae4e7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0161660 0x7f2ae0156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.557+0000 7f2ae4e7c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00b4290 con 0x7f2ae0161660 2023-08-09T12:51:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.557+0000 7f2ae4e7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01467c0 con 0x7f2ae00acfc0 2023-08-09T12:51:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.557+0000 7f2ae4e7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0146aa0 con 0x7f2ae0161280 2023-08-09T12:51:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0161660 0x7f2ae0156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0161660 0x7f2ae0156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52072/0 (socket says 172.21.15.17:52072) 2023-08-09T12:51:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 -- 172.21.15.17:0/2990340444 learned_addr learned my addr 172.21.15.17:0/2990340444 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2ad7fff640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae0161280 0x7f2ae0148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2ade59c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae00acfc0 0x7f2ae00c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 -- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae0161280 msgr2=0x7f2ae0148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae0161280 0x7f2ae0148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 -- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae00acfc0 msgr2=0x7f2ae00c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae00acfc0 0x7f2ae00c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 -- 172.21.15.17:0/2990340444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad8009a70 con 0x7f2ae0161660 2023-08-09T12:51:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2ade59c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae00acfc0 0x7f2ae00c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.558+0000 7f2aded9d640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0161660 0x7f2ae0156ba0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009d90 tx=0x7f2ad8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:30.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.559+0000 7f2ad6ffd640 1 -- 172.21.15.17:0/2990340444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8003b90 con 0x7f2ae0161660 2023-08-09T12:51:30.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.559+0000 7f2ad6ffd640 1 -- 172.21.15.17:0/2990340444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8003cf0 con 0x7f2ae0161660 2023-08-09T12:51:30.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.559+0000 7f2ad6ffd640 1 -- 172.21.15.17:0/2990340444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8004230 con 0x7f2ae0161660 2023-08-09T12:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.559+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae0146d80 con 0x7f2ae0161660 2023-08-09T12:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.559+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae0147340 con 0x7f2ae0161660 2023-08-09T12:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.560+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae0147560 con 0x7f2ae0161660 2023-08-09T12:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.561+0000 7f2ad6ffd640 1 -- 172.21.15.17:0/2990340444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ad803b050 con 0x7f2ae0161660 2023-08-09T12:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.562+0000 7f2ad6ffd640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.562+0000 7f2ad6ffd640 1 -- 172.21.15.17:0/2990340444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2ad80aac40 con 0x7f2ae0161660 2023-08-09T12:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.563+0000 7f2ade59c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.564+0000 7f2ade59c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0000f60 tx=0x7f2ad0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.566+0000 7f2ad6ffd640 1 -- 172.21.15.17:0/2990340444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2ad80765e0 con 0x7f2ae0161660 2023-08-09T12:51:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.762+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2ae0067a80 con 0x7f2ae0161660 2023-08-09T12:51:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.763+0000 7f2ad6ffd640 1 -- 172.21.15.17:0/2990340444 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v171) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2ad80390a0 con 0x7f2ae0161660 2023-08-09T12:51:30.775 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:51:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 msgr2=0x7f2ac006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0000f60 tx=0x7f2ad0009040 comp rx=0 tx=0).stop 2023-08-09T12:51:30.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0161660 msgr2=0x7f2ae0156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:30.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0161660 0x7f2ae0156ba0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009d90 tx=0x7f2ad8004a40 comp rx=0 tx=0).stop 2023-08-09T12:51:30.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 shutdown_connections 2023-08-09T12:51:30.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ac006a050 0x7f2ac006c510 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0161660 0x7f2ae0156ba0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae0161280 0x7f2ae0148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 --2- 172.21.15.17:0/2990340444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae00acfc0 0x7f2ae00c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.765+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 >> 172.21.15.17:0/2990340444 conn(0x7f2ae00cb1b0 msgr2=0x7f2ae00703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.766+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 shutdown_connections 2023-08-09T12:51:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:30.766+0000 7f2ae4e7c640 1 -- 172.21.15.17:0/2990340444 wait complete. 2023-08-09T12:51:30.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:51:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.030+0000 7fcf6ffff640 1 Processor -- start 2023-08-09T12:51:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.030+0000 7fcf6ffff640 1 -- start start 2023-08-09T12:51:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf701587e0 0x7fcf70070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf700cb070 0x7fcf700cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6ffff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7015beb0 con 0x7fcf700b0b10 2023-08-09T12:51:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6ffff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf700cba20 con 0x7fcf701587e0 2023-08-09T12:51:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf700715c0 con 0x7fcf700cb070 2023-08-09T12:51:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf701587e0 0x7fcf70070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6effd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcf701587e0 0x7fcf70070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52084/0 (socket says 172.21.15.17:52084) 2023-08-09T12:51:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6effd640 1 -- 172.21.15.17:0/3714842132 learned_addr learned my addr 172.21.15.17:0/3714842132 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.032+0000 7fcf6e7fc640 1 --1- 172.21.15.17:0/3714842132 >> v1:172.21.15.17:6789/0 conn(0x7fcf700b0b10 0x7fcf7015b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58584/0 (socket says 172.21.15.17:58584) 2023-08-09T12:51:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.033+0000 7fcf6effd640 1 -- 172.21.15.17:0/3714842132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf700cb070 msgr2=0x7fcf700cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.033+0000 7fcf6effd640 1 --2- 172.21.15.17:0/3714842132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf700cb070 0x7fcf700cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.033+0000 7fcf6effd640 1 -- 172.21.15.17:0/3714842132 >> v1:172.21.15.17:6789/0 conn(0x7fcf700b0b10 legacy=0x7fcf7015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.033+0000 7fcf6effd640 1 -- 172.21.15.17:0/3714842132 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf700718a0 con 0x7fcf701587e0 2023-08-09T12:51:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.034+0000 7fcf6effd640 1 --2- 172.21.15.17:0/3714842132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf701587e0 0x7fcf70070f00 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c377404e86e59c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.034+0000 7fcf6dffb640 1 -- 172.21.15.17:0/3714842132 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60030840 con 0x7fcf701587e0 2023-08-09T12:51:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.034+0000 7fcf6dffb640 1 -- 172.21.15.17:0/3714842132 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf600309a0 con 0x7fcf701587e0 2023-08-09T12:51:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.034+0000 7fcf6dffb640 1 -- 172.21.15.17:0/3714842132 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60030d30 con 0x7fcf701587e0 2023-08-09T12:51:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.035+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3714842132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf701587e0 msgr2=0x7fcf70070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.035+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3714842132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf701587e0 0x7fcf70070f00 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6002b980 comp rx=0 tx=0).stop 2023-08-09T12:51:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.035+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3714842132 shutdown_connections 2023-08-09T12:51:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.035+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3714842132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf700cb070 0x7fcf700cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.035+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3714842132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf701587e0 0x7fcf70070f00 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.035+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3714842132 >> 172.21.15.17:0/3714842132 conn(0x7fcf700b1d50 msgr2=0x7fcf7006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.035+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3714842132 shutdown_connections 2023-08-09T12:51:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.035+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3714842132 wait complete. 2023-08-09T12:51:31.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.037+0000 7fcf6ffff640 1 Processor -- start 2023-08-09T12:51:31.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.038+0000 7fcf6ffff640 1 -- start start 2023-08-09T12:51:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf700b0b10 0x7fcf701f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf700cb070 0x7fcf700c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf701587e0 0x7fcf70153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6ffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf701f2220 con 0x7fcf700b0b10 2023-08-09T12:51:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf701f12d0 con 0x7fcf700cb070 2023-08-09T12:51:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf700c53c0 con 0x7fcf701587e0 2023-08-09T12:51:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf700b0b10 0x7fcf701f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf700b0b10 0x7fcf701f1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52092/0 (socket says 172.21.15.17:52092) 2023-08-09T12:51:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.039+0000 7fcf6effd640 1 -- 172.21.15.17:0/3788820228 learned_addr learned my addr 172.21.15.17:0/3788820228 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:31.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.040+0000 7fcf6effd640 1 -- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf701587e0 msgr2=0x7fcf70153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.040+0000 7fcf6effd640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf701587e0 0x7fcf70153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.040+0000 7fcf6effd640 1 -- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf700cb070 msgr2=0x7fcf700c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.040+0000 7fcf6effd640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf700cb070 0x7fcf700c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.040+0000 7fcf6effd640 1 -- 172.21.15.17:0/3788820228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600094d0 con 0x7fcf700b0b10 2023-08-09T12:51:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.040+0000 7fcf6effd640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf700b0b10 0x7fcf701f1ce0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.040+0000 7fcf577fe640 1 -- 172.21.15.17:0/3788820228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600307f0 con 0x7fcf700b0b10 2023-08-09T12:51:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.041+0000 7fcf577fe640 1 -- 172.21.15.17:0/3788820228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60043400 con 0x7fcf700b0b10 2023-08-09T12:51:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.041+0000 7fcf577fe640 1 -- 172.21.15.17:0/3788820228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60043790 con 0x7fcf700b0b10 2023-08-09T12:51:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.041+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf701541a0 con 0x7fcf700b0b10 2023-08-09T12:51:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.041+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf701f14e0 con 0x7fcf700b0b10 2023-08-09T12:51:31.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.042+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7006fa10 con 0x7fcf700b0b10 2023-08-09T12:51:31.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.043+0000 7fcf577fe640 1 -- 172.21.15.17:0/3788820228 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf600438f0 con 0x7fcf700b0b10 2023-08-09T12:51:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.044+0000 7fcf577fe640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf5c06a050 0x7fcf5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.044+0000 7fcf577fe640 1 -- 172.21.15.17:0/3788820228 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf6003e070 con 0x7fcf700b0b10 2023-08-09T12:51:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.044+0000 7fcf6e7fc640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf5c06a050 0x7fcf5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.046+0000 7fcf6e7fc640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf5c06a050 0x7fcf5c06c510 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcf700b3970 tx=0x7fcf640079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.048+0000 7fcf577fe640 1 -- 172.21.15.17:0/3788820228 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcf7006fa10 con 0x7fcf700b0b10 2023-08-09T12:51:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.243+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcf7006fa10 con 0x7fcf700b0b10 2023-08-09T12:51:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.244+0000 7fcf577fe640 1 -- 172.21.15.17:0/3788820228 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v171) v1 ==== 84+0+126 (secure 0 0 0) 0x7fcf60034090 con 0x7fcf700b0b10 2023-08-09T12:51:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:31.249 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:51:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:51:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:51:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:51:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:51:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:51:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:51:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:51:31.250 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:51:31.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf5c06a050 msgr2=0x7fcf5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf5c06a050 0x7fcf5c06c510 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcf700b3970 tx=0x7fcf640079c0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf700b0b10 msgr2=0x7fcf701f1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf700b0b10 0x7fcf701f1ce0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf60004730 comp rx=0 tx=0).stop 2023-08-09T12:51:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 shutdown_connections 2023-08-09T12:51:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcf5c06a050 0x7fcf5c06c510 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf701587e0 0x7fcf70153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf700cb070 0x7fcf700c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 --2- 172.21.15.17:0/3788820228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf700b0b10 0x7fcf701f1ce0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 >> 172.21.15.17:0/3788820228 conn(0x7fcf700b1d50 msgr2=0x7fcf7015ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 shutdown_connections 2023-08-09T12:51:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.247+0000 7fcf6ffff640 1 -- 172.21.15.17:0/3788820228 wait complete. 2023-08-09T12:51:31.269 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:51:31.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:51:31.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.506+0000 7f516dd71640 1 Processor -- start 2023-08-09T12:51:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.507+0000 7f516dd71640 1 -- start start 2023-08-09T12:51:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.508+0000 7f516dd71640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5168160520 0x7f51680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.509+0000 7f516dd71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 0x7f51680ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.509+0000 7f516dd71640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51680cb950 con 0x7f51680afa70 2023-08-09T12:51:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.509+0000 7f516dd71640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51680cfbf0 con 0x7f5168160520 2023-08-09T12:51:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.509+0000 7f516dd71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51680af830 con 0x7f51680ad470 2023-08-09T12:51:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.509+0000 7f5166ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f51680afa70 0x7f51680cc9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58594/0 (socket says 172.21.15.17:58594) 2023-08-09T12:51:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.509+0000 7f5166ffd640 1 -- 172.21.15.17:0/1745395548 learned_addr learned my addr 172.21.15.17:0/1745395548 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.509+0000 7f51677fe640 1 --2- 172.21.15.17:0/1745395548 >> v2:172.21.15.142:3300/0 conn(0x7f5168160520 0x7f51680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.509+0000 7f5167fff640 1 --2- 172.21.15.17:0/1745395548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 0x7f51680ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.510+0000 7f51667fc640 1 -- 172.21.15.17:0/1745395548 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313471504 0 0) 0x7f51680cb950 con 0x7f51680afa70 2023-08-09T12:51:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.510+0000 7f51667fc640 1 -- 172.21.15.17:0/1745395548 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5150003520 con 0x7f51680afa70 2023-08-09T12:51:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.510+0000 7f51667fc640 1 -- 172.21.15.17:0/1745395548 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1915201464 0 0) 0x7f5150003520 con 0x7f51680afa70 2023-08-09T12:51:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.510+0000 7f51677fe640 1 -- 172.21.15.17:0/1745395548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 msgr2=0x7f51680ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.510+0000 7f51677fe640 1 --2- 172.21.15.17:0/1745395548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 0x7f51680ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.510+0000 7f51677fe640 1 -- 172.21.15.17:0/1745395548 >> v1:172.21.15.17:6789/0 conn(0x7f51680afa70 legacy=0x7f51680cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.510+0000 7f51677fe640 1 -- 172.21.15.17:0/1745395548 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51680cbbf0 con 0x7f5168160520 2023-08-09T12:51:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.512+0000 7f51677fe640 1 --2- 172.21.15.17:0/1745395548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 0x7f51680cf4f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5158009790 tx=0x7f515802b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbbfca616a047ac server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.512+0000 7f51667fc640 1 -- 172.21.15.17:0/1745395548 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c001670 con 0x7f5168160520 2023-08-09T12:51:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.512+0000 7f51667fc640 1 -- 172.21.15.17:0/1745395548 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515802e050 con 0x7f5168160520 2023-08-09T12:51:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.512+0000 7f51667fc640 1 -- 172.21.15.17:0/1745395548 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158030730 con 0x7f5168160520 2023-08-09T12:51:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.513+0000 7f516dd71640 1 -- 172.21.15.17:0/1745395548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 msgr2=0x7f51680cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.513+0000 7f516dd71640 1 --2- 172.21.15.17:0/1745395548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 0x7f51680cf4f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5158009790 tx=0x7f515802b770 comp rx=0 tx=0).stop 2023-08-09T12:51:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.513+0000 7f516dd71640 1 -- 172.21.15.17:0/1745395548 shutdown_connections 2023-08-09T12:51:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.513+0000 7f516dd71640 1 --2- 172.21.15.17:0/1745395548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 0x7f51680ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.513+0000 7f516dd71640 1 --2- 172.21.15.17:0/1745395548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 0x7f51680cf4f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.513+0000 7f516dd71640 1 -- 172.21.15.17:0/1745395548 >> 172.21.15.17:0/1745395548 conn(0x7f51680d0940 msgr2=0x7f51680d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.513+0000 7f516dd71640 1 -- 172.21.15.17:0/1745395548 shutdown_connections 2023-08-09T12:51:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.513+0000 7f516dd71640 1 -- 172.21.15.17:0/1745395548 wait complete. 2023-08-09T12:51:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.515+0000 7f516dd71640 1 Processor -- start 2023-08-09T12:51:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.515+0000 7f516dd71640 1 -- start start 2023-08-09T12:51:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.516+0000 7f516dd71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 0x7f5168159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.516+0000 7f516dd71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51680afa70 0x7f5168159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.516+0000 7f516dd71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 0x7f51680b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.516+0000 7f516dd71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680b1be0 con 0x7f51680afa70 2023-08-09T12:51:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.516+0000 7f516dd71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680b49f0 con 0x7f5168160520 2023-08-09T12:51:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.516+0000 7f516dd71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51680b4cd0 con 0x7f51680ad470 2023-08-09T12:51:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.516+0000 7f5166ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51680afa70 0x7f5168159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5166ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51680afa70 0x7f5168159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52106/0 (socket says 172.21.15.17:52106) 2023-08-09T12:51:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5166ffd640 1 -- 172.21.15.17:0/1821631710 learned_addr learned my addr 172.21.15.17:0/1821631710 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:31.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5167fff640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 0x7f51680b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f51677fe640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 0x7f5168159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5166ffd640 1 -- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 msgr2=0x7f5168159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5166ffd640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 0x7f5168159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5166ffd640 1 -- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 msgr2=0x7f51680b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5166ffd640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 0x7f51680b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5166ffd640 1 -- 172.21.15.17:0/1821631710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580093a0 con 0x7f51680afa70 2023-08-09T12:51:31.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.517+0000 7f5166ffd640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51680afa70 0x7f5168159c70 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c710 tx=0x7f515c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:31.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.518+0000 7f514ffff640 1 -- 172.21.15.17:0/1821631710 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c005ad0 con 0x7f51680afa70 2023-08-09T12:51:31.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.518+0000 7f514ffff640 1 -- 172.21.15.17:0/1821631710 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c005c30 con 0x7f51680afa70 2023-08-09T12:51:31.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.518+0000 7f514ffff640 1 -- 172.21.15.17:0/1821631710 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c007070 con 0x7f51680afa70 2023-08-09T12:51:31.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.518+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51680b4fb0 con 0x7f51680afa70 2023-08-09T12:51:31.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.518+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5168151be0 con 0x7f51680afa70 2023-08-09T12:51:31.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.519+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51680b16d0 con 0x7f51680afa70 2023-08-09T12:51:31.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.520+0000 7f514ffff640 1 -- 172.21.15.17:0/1821631710 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f515c0071f0 con 0x7f51680afa70 2023-08-09T12:51:31.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.521+0000 7f514ffff640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f515406a080 0x7f515406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:31.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.521+0000 7f514ffff640 1 -- 172.21.15.17:0/1821631710 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f515c0880a0 con 0x7f51680afa70 2023-08-09T12:51:31.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.522+0000 7f51677fe640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f515406a080 0x7f515406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:31.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.523+0000 7f51677fe640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f515406a080 0x7f515406c540 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5158034000 tx=0x7f5158008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:31.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.526+0000 7f514ffff640 1 -- 172.21.15.17:0/1821631710 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f51680b16d0 con 0x7f51680afa70 2023-08-09T12:51:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.716+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f51680b16d0 con 0x7f51680afa70 2023-08-09T12:51:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.829+0000 7f514ffff640 1 -- 172.21.15.17:0/1821631710 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v172) v1 ==== 138+0+0 (secure 0 0 0) 0x7f51680b16d0 con 0x7f51680afa70 2023-08-09T12:51:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:51:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f515406a080 msgr2=0x7f515406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f515406a080 0x7f515406c540 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5158034000 tx=0x7f5158008030 comp rx=0 tx=0).stop 2023-08-09T12:51:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51680afa70 msgr2=0x7f5168159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51680afa70 0x7f5168159c70 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c710 tx=0x7f515c00cbd0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 shutdown_connections 2023-08-09T12:51:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f515406a080 0x7f515406c540 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5168160520 0x7f51680b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51680afa70 0x7f5168159c70 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 --2- 172.21.15.17:0/1821631710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51680ad470 0x7f5168159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 >> 172.21.15.17:0/1821631710 conn(0x7f51680d0940 msgr2=0x7f516815adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 shutdown_connections 2023-08-09T12:51:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:31.834+0000 7f516dd71640 1 -- 172.21.15.17:0/1821631710 wait complete. 2023-08-09T12:51:31.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:51:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.099+0000 7fd327955640 1 Processor -- start 2023-08-09T12:51:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.100+0000 7fd327955640 1 -- start start 2023-08-09T12:51:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.101+0000 7fd327955640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3200b1e30 0x7fd3200b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.101+0000 7fd327955640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3200b8930 0x7fd32006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.101+0000 7fd327955640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200d18a0 con 0x7fd32015cd10 2023-08-09T12:51:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.101+0000 7fd327955640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3200d0d00 con 0x7fd3200b8930 2023-08-09T12:51:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.101+0000 7fd327955640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3200d0f70 con 0x7fd3200b1e30 2023-08-09T12:51:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.102+0000 7fd325ef2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3200b8930 0x7fd32006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.102+0000 7fd325ef2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3200b8930 0x7fd32006fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52110/0 (socket says 172.21.15.17:52110) 2023-08-09T12:51:32.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.102+0000 7fd325ef2640 1 -- 172.21.15.17:0/2105132448 learned_addr learned my addr 172.21.15.17:0/2105132448 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:32.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.102+0000 7fd324ef0640 1 --2- 172.21.15.17:0/2105132448 >> v2:172.21.15.142:3300/0 conn(0x7fd3200b1e30 0x7fd3200b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:32.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.102+0000 7fd325ef2640 1 -- 172.21.15.17:0/2105132448 >> v2:172.21.15.142:3300/0 conn(0x7fd3200b1e30 msgr2=0x7fd3200b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:32.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.102+0000 7fd325ef2640 1 --2- 172.21.15.17:0/2105132448 >> v2:172.21.15.142:3300/0 conn(0x7fd3200b1e30 0x7fd3200b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.102+0000 7fd325ef2640 1 -- 172.21.15.17:0/2105132448 >> v1:172.21.15.142:6789/0 conn(0x7fd32015cd10 legacy=0x7fd3200b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:32.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.103+0000 7fd325ef2640 1 -- 172.21.15.17:0/2105132448 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200d1250 con 0x7fd3200b8930 2023-08-09T12:51:32.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.104+0000 7fd325ef2640 1 --2- 172.21.15.17:0/2105132448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd32006fde0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fd3200ce8b0 tx=0x7fd31802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55043f2fbfbc46a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.104+0000 7fd317fff640 1 -- 172.21.15.17:0/2105132448 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31802cb20 con 0x7fd3200b8930 2023-08-09T12:51:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.104+0000 7fd317fff640 1 -- 172.21.15.17:0/2105132448 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31802cc80 con 0x7fd3200b8930 2023-08-09T12:51:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.104+0000 7fd317fff640 1 -- 172.21.15.17:0/2105132448 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180343f0 con 0x7fd3200b8930 2023-08-09T12:51:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.105+0000 7fd327955640 1 -- 172.21.15.17:0/2105132448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 msgr2=0x7fd32006fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.105+0000 7fd327955640 1 --2- 172.21.15.17:0/2105132448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd32006fde0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fd3200ce8b0 tx=0x7fd31802bf80 comp rx=0 tx=0).stop 2023-08-09T12:51:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.105+0000 7fd327955640 1 -- 172.21.15.17:0/2105132448 shutdown_connections 2023-08-09T12:51:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.105+0000 7fd327955640 1 --2- 172.21.15.17:0/2105132448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd32006fde0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.105+0000 7fd327955640 1 --2- 172.21.15.17:0/2105132448 >> v2:172.21.15.142:3300/0 conn(0x7fd3200b1e30 0x7fd3200b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.105+0000 7fd327955640 1 -- 172.21.15.17:0/2105132448 >> 172.21.15.17:0/2105132448 conn(0x7fd3200d2b90 msgr2=0x7fd3200d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.105+0000 7fd327955640 1 -- 172.21.15.17:0/2105132448 shutdown_connections 2023-08-09T12:51:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.105+0000 7fd327955640 1 -- 172.21.15.17:0/2105132448 wait complete. 2023-08-09T12:51:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.107+0000 7fd327955640 1 Processor -- start 2023-08-09T12:51:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.107+0000 7fd327955640 1 -- start start 2023-08-09T12:51:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.108+0000 7fd327955640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3200b1e30 0x7fd3200c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.108+0000 7fd327955640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd3201f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.108+0000 7fd327955640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd32015cd10 0x7fd3201f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.108+0000 7fd327955640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200ca110 con 0x7fd3200b8930 2023-08-09T12:51:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.108+0000 7fd327955640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200ccd70 con 0x7fd32015cd10 2023-08-09T12:51:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.108+0000 7fd327955640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200cc160 con 0x7fd3200b1e30 2023-08-09T12:51:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.108+0000 7fd324ef0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd3201f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd324ef0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd3201f17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52114/0 (socket says 172.21.15.17:52114) 2023-08-09T12:51:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd324ef0640 1 -- 172.21.15.17:0/644629920 learned_addr learned my addr 172.21.15.17:0/644629920 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd325ef2640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd32015cd10 0x7fd3201f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd3256f1640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3200b1e30 0x7fd3200c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd324ef0640 1 -- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3200b1e30 msgr2=0x7fd3200c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:32.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd324ef0640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3200b1e30 0x7fd3200c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd324ef0640 1 -- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd32015cd10 msgr2=0x7fd3201f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd324ef0640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd32015cd10 0x7fd3201f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd324ef0640 1 -- 172.21.15.17:0/644629920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009b30 con 0x7fd3200b8930 2023-08-09T12:51:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd325ef2640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd32015cd10 0x7fd3201f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd3256f1640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3200b1e30 0x7fd3200c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.109+0000 7fd324ef0640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd3201f17d0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fd31000d800 tx=0x7fd31000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.110+0000 7fd315ffb640 1 -- 172.21.15.17:0/644629920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000b6c0 con 0x7fd3200b8930 2023-08-09T12:51:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.110+0000 7fd315ffb640 1 -- 172.21.15.17:0/644629920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000b820 con 0x7fd3200b8930 2023-08-09T12:51:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.110+0000 7fd315ffb640 1 -- 172.21.15.17:0/644629920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000bbb0 con 0x7fd3200b8930 2023-08-09T12:51:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.110+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3200cc440 con 0x7fd3200b8930 2023-08-09T12:51:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.110+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3200cca00 con 0x7fd3200b8930 2023-08-09T12:51:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.111+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd320067a80 con 0x7fd3200b8930 2023-08-09T12:51:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.113+0000 7fd315ffb640 1 -- 172.21.15.17:0/644629920 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd31000bd10 con 0x7fd3200b8930 2023-08-09T12:51:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.113+0000 7fd315ffb640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd30406a050 0x7fd30406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.114+0000 7fd315ffb640 1 -- 172.21.15.17:0/644629920 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd310089440 con 0x7fd3200b8930 2023-08-09T12:51:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.114+0000 7fd3256f1640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd30406a050 0x7fd30406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.115+0000 7fd3256f1640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd30406a050 0x7fd30406c510 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd320160420 tx=0x7fd31c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:32.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.118+0000 7fd315ffb640 1 -- 172.21.15.17:0/644629920 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd310054cf0 con 0x7fd3200b8930 2023-08-09T12:51:32.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.314+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd3200c86c0 con 0x7fd3200b8930 2023-08-09T12:51:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.849+0000 7fd315ffb640 1 -- 172.21.15.17:0/644629920 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v173) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd310058310 con 0x7fd3200b8930 2023-08-09T12:51:32.858 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:51:32.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd30406a050 msgr2=0x7fd30406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:32.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd30406a050 0x7fd30406c510 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd320160420 tx=0x7fd31c008040 comp rx=0 tx=0).stop 2023-08-09T12:51:32.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 msgr2=0x7fd3201f17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:32.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd3201f17d0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fd31000d800 tx=0x7fd31000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 shutdown_connections 2023-08-09T12:51:32.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd30406a050 0x7fd30406c510 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd32015cd10 0x7fd3201f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200b8930 0x7fd3201f17d0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 --2- 172.21.15.17:0/644629920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3200b1e30 0x7fd3200c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:32.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 >> 172.21.15.17:0/644629920 conn(0x7fd3200d2b90 msgr2=0x7fd3200d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:32.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 shutdown_connections 2023-08-09T12:51:32.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:32.859+0000 7fd327955640 1 -- 172.21.15.17:0/644629920 wait complete. 2023-08-09T12:51:32.884 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:51:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.101+0000 7ff27facc640 1 Processor -- start 2023-08-09T12:51:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.101+0000 7ff27facc640 1 -- start start 2023-08-09T12:51:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.102+0000 7ff27facc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 0x7ff27806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.102+0000 7ff27facc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff2780b3b40 0x7ff2780b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.102+0000 7ff27facc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff27815e8f0 0x7ff27815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.102+0000 7ff27facc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780ae020 con 0x7ff2780b3b40 2023-08-09T12:51:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.102+0000 7ff27facc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780b2250 con 0x7ff27815e8f0 2023-08-09T12:51:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.102+0000 7ff27facc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780b2530 con 0x7ff2780adc40 2023-08-09T12:51:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d067640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff2780b3b40 0x7ff2780b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d067640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff2780b3b40 0x7ff2780b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52120/0 (socket says 172.21.15.17:52120) 2023-08-09T12:51:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d067640 1 -- 172.21.15.17:0/3167176306 learned_addr learned my addr 172.21.15.17:0/3167176306 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d868640 1 --2- 172.21.15.17:0/3167176306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 0x7ff27806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d067640 1 -- 172.21.15.17:0/3167176306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 msgr2=0x7ff27806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d067640 1 --2- 172.21.15.17:0/3167176306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 0x7ff27806c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d067640 1 -- 172.21.15.17:0/3167176306 >> v2:172.21.15.142:3300/0 conn(0x7ff27815e8f0 msgr2=0x7ff27815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d067640 1 --2- 172.21.15.17:0/3167176306 >> v2:172.21.15.142:3300/0 conn(0x7ff27815e8f0 0x7ff27815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.103+0000 7ff27d067640 1 -- 172.21.15.17:0/3167176306 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27806fe80 con 0x7ff2780b3b40 2023-08-09T12:51:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.105+0000 7ff27d067640 1 --2- 172.21.15.17:0/3167176306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2780b3b40 0x7ff2780b3fa0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff2780cf780 tx=0x7ff26802b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c5a278d7454b66 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.105+0000 7ff27c866640 1 -- 172.21.15.17:0/3167176306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268004030 con 0x7ff2780b3b40 2023-08-09T12:51:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.105+0000 7ff27c866640 1 -- 172.21.15.17:0/3167176306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff268004190 con 0x7ff2780b3b40 2023-08-09T12:51:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.105+0000 7ff27c866640 1 -- 172.21.15.17:0/3167176306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268031640 con 0x7ff2780b3b40 2023-08-09T12:51:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 -- 172.21.15.17:0/3167176306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2780b3b40 msgr2=0x7ff2780b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 --2- 172.21.15.17:0/3167176306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2780b3b40 0x7ff2780b3fa0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff2780cf780 tx=0x7ff26802b8e0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 -- 172.21.15.17:0/3167176306 shutdown_connections 2023-08-09T12:51:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 --2- 172.21.15.17:0/3167176306 >> v2:172.21.15.142:3300/0 conn(0x7ff27815e8f0 0x7ff27815ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 --2- 172.21.15.17:0/3167176306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2780b3b40 0x7ff2780b3fa0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 --2- 172.21.15.17:0/3167176306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 0x7ff27806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 -- 172.21.15.17:0/3167176306 >> 172.21.15.17:0/3167176306 conn(0x7ff2780cb1b0 msgr2=0x7ff2780cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 -- 172.21.15.17:0/3167176306 shutdown_connections 2023-08-09T12:51:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.106+0000 7ff27facc640 1 -- 172.21.15.17:0/3167176306 wait complete. 2023-08-09T12:51:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.108+0000 7ff27facc640 1 Processor -- start 2023-08-09T12:51:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.108+0000 7ff27facc640 1 -- start start 2023-08-09T12:51:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27facc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 0x7ff278152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27facc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2780b3b40 0x7ff278157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27facc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27815e8f0 0x7ff2780c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27facc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781583d0 con 0x7ff27815e8f0 2023-08-09T12:51:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27facc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27806a9b0 con 0x7ff2780b3b40 2023-08-09T12:51:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27facc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff278159360 con 0x7ff2780adc40 2023-08-09T12:51:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27e069640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27815e8f0 0x7ff2780c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27e069640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27815e8f0 0x7ff2780c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52126/0 (socket says 172.21.15.17:52126) 2023-08-09T12:51:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.109+0000 7ff27e069640 1 -- 172.21.15.17:0/462843835 learned_addr learned my addr 172.21.15.17:0/462843835 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27d868640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 0x7ff278152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27d067640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2780b3b40 0x7ff278157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27e069640 1 -- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 msgr2=0x7ff278152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27e069640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 0x7ff278152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27e069640 1 -- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2780b3b40 msgr2=0x7ff278157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27e069640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2780b3b40 0x7ff278157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27e069640 1 -- 172.21.15.17:0/462843835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268009460 con 0x7ff27815e8f0 2023-08-09T12:51:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27e069640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27815e8f0 0x7ff2780c39d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7ff27000b970 tx=0x7ff27000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff26e7fc640 1 -- 172.21.15.17:0/462843835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000cb40 con 0x7ff27815e8f0 2023-08-09T12:51:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff26e7fc640 1 -- 172.21.15.17:0/462843835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000ccc0 con 0x7ff27815e8f0 2023-08-09T12:51:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff26e7fc640 1 -- 172.21.15.17:0/462843835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270014680 con 0x7ff27815e8f0 2023-08-09T12:51:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.110+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff278159640 con 0x7ff27815e8f0 2023-08-09T12:51:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.111+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff278159c00 con 0x7ff27815e8f0 2023-08-09T12:51:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.112+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27806ab20 con 0x7ff27815e8f0 2023-08-09T12:51:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.113+0000 7ff26e7fc640 1 -- 172.21.15.17:0/462843835 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff27001d3b0 con 0x7ff27815e8f0 2023-08-09T12:51:33.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.115+0000 7ff26e7fc640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff25c06a050 0x7ff25c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:33.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.115+0000 7ff26e7fc640 1 -- 172.21.15.17:0/462843835 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff2700889a0 con 0x7ff27815e8f0 2023-08-09T12:51:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.116+0000 7ff27d868640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff25c06a050 0x7ff25c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.117+0000 7ff27d868640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff25c06a050 0x7ff25c06c510 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff27400a970 tx=0x7ff274008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:33.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.119+0000 7ff26e7fc640 1 -- 172.21.15.17:0/462843835 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff270054040 con 0x7ff27815e8f0 2023-08-09T12:51:33.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.351+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff278067a80 con 0x7ff27815e8f0 2023-08-09T12:51:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.871+0000 7ff26e7fc640 1 -- 172.21.15.17:0/462843835 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff270019020 con 0x7ff27815e8f0 2023-08-09T12:51:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 21 and data pool 22 2023-08-09T12:51:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.877+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff25c06a050 msgr2=0x7ff25c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.877+0000 7ff27facc640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff25c06a050 0x7ff25c06c510 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff27400a970 tx=0x7ff274008040 comp rx=0 tx=0).stop 2023-08-09T12:51:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.878+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27815e8f0 msgr2=0x7ff2780c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.878+0000 7ff27facc640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27815e8f0 0x7ff2780c39d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7ff27000b970 tx=0x7ff27000be30 comp rx=0 tx=0).stop 2023-08-09T12:51:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.878+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 shutdown_connections 2023-08-09T12:51:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.878+0000 7ff27facc640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff25c06a050 0x7ff25c06c510 secure :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff27400a970 tx=0x7ff274008040 comp rx=0 tx=0).stop 2023-08-09T12:51:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.878+0000 7ff27facc640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27815e8f0 0x7ff2780c39d0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.878+0000 7ff27facc640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2780b3b40 0x7ff278157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.879+0000 7ff27facc640 1 --2- 172.21.15.17:0/462843835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2780adc40 0x7ff278152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.879+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 >> 172.21.15.17:0/462843835 conn(0x7ff2780cb1b0 msgr2=0x7ff27815da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:33.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.879+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 shutdown_connections 2023-08-09T12:51:33.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:33.880+0000 7ff27facc640 1 -- 172.21.15.17:0/462843835 wait complete. 2023-08-09T12:51:33.913 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.103+0000 7f2cbf59e640 1 Processor -- start 2023-08-09T12:51:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.104+0000 7f2cbf59e640 1 -- start start 2023-08-09T12:51:34.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbf59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2cc0160030 0x7f2cc0160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbf59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2cc00b86e0 0x7f2cc00cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbf59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00b5a30 con 0x7f2cc00cf980 2023-08-09T12:51:34.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbf59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00d1110 con 0x7f2cc00b86e0 2023-08-09T12:51:34.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbf59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00ceac0 con 0x7f2cc0160030 2023-08-09T12:51:34.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbdd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2cc00b86e0 0x7f2cc00cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbdd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2cc00b86e0 0x7f2cc00cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52138/0 (socket says 172.21.15.17:52138) 2023-08-09T12:51:34.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbdd9b640 1 -- 172.21.15.17:0/1383577976 learned_addr learned my addr 172.21.15.17:0/1383577976 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:34.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbdd9b640 1 -- 172.21.15.17:0/1383577976 >> v2:172.21.15.142:3300/0 conn(0x7f2cc0160030 msgr2=0x7f2cc0160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:34.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbdd9b640 1 --2- 172.21.15.17:0/1383577976 >> v2:172.21.15.142:3300/0 conn(0x7f2cc0160030 0x7f2cc0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbdd9b640 1 -- 172.21.15.17:0/1383577976 >> v1:172.21.15.17:6789/0 conn(0x7f2cc00cf980 legacy=0x7f2cc00b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.106+0000 7f2cbdd9b640 1 -- 172.21.15.17:0/1383577976 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00cfdd0 con 0x7f2cc00b86e0 2023-08-09T12:51:34.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.108+0000 7f2cbdd9b640 1 --2- 172.21.15.17:0/1383577976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc00b86e0 0x7f2cc00cf440 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0065f60 tx=0x7f2cb402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f477659fc3aa287 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:34.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.108+0000 7f2cbd59a640 1 -- 172.21.15.17:0/1383577976 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4030870 con 0x7f2cc00b86e0 2023-08-09T12:51:34.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.108+0000 7f2cbd59a640 1 -- 172.21.15.17:0/1383577976 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb40309d0 con 0x7f2cc00b86e0 2023-08-09T12:51:34.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.108+0000 7f2cbd59a640 1 -- 172.21.15.17:0/1383577976 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4030d60 con 0x7f2cc00b86e0 2023-08-09T12:51:34.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.108+0000 7f2cbf59e640 1 -- 172.21.15.17:0/1383577976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc00b86e0 msgr2=0x7f2cc00cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.108+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/1383577976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc00b86e0 0x7f2cc00cf440 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0065f60 tx=0x7f2cb402b9b0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.108+0000 7f2cbf59e640 1 -- 172.21.15.17:0/1383577976 shutdown_connections 2023-08-09T12:51:34.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.109+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/1383577976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc00b86e0 0x7f2cc00cf440 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.109+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/1383577976 >> v2:172.21.15.142:3300/0 conn(0x7f2cc0160030 0x7f2cc0160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.109+0000 7f2cbf59e640 1 -- 172.21.15.17:0/1383577976 >> 172.21.15.17:0/1383577976 conn(0x7f2cc00697c0 msgr2=0x7f2cc0069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:34.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.109+0000 7f2cbf59e640 1 -- 172.21.15.17:0/1383577976 shutdown_connections 2023-08-09T12:51:34.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.109+0000 7f2cbf59e640 1 -- 172.21.15.17:0/1383577976 wait complete. 2023-08-09T12:51:34.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.110+0000 7f2cbf59e640 1 Processor -- start 2023-08-09T12:51:34.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.111+0000 7f2cbf59e640 1 -- start start 2023-08-09T12:51:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbf59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc00b86e0 0x7f2cc0155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbf59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cc00cf980 0x7f2cc01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbf59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc0160030 0x7f2cc00b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbf59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00b4e20 con 0x7f2cc0160030 2023-08-09T12:51:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbf59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0155d10 con 0x7f2cc00b86e0 2023-08-09T12:51:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbf59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0155ff0 con 0x7f2cc00cf980 2023-08-09T12:51:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc0160030 0x7f2cc00b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc0160030 0x7f2cc00b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52154/0 (socket says 172.21.15.17:52154) 2023-08-09T12:51:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbed9d640 1 -- 172.21.15.17:0/988559643 learned_addr learned my addr 172.21.15.17:0/988559643 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbe59c640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc00b86e0 0x7f2cc0155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbdd9b640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cc00cf980 0x7f2cc01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbed9d640 1 -- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cc00cf980 msgr2=0x7f2cc01540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbed9d640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cc00cf980 0x7f2cc01540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbed9d640 1 -- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc00b86e0 msgr2=0x7f2cc0155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbed9d640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc00b86e0 0x7f2cc0155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.112+0000 7f2cbed9d640 1 -- 172.21.15.17:0/988559643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40094d0 con 0x7f2cc0160030 2023-08-09T12:51:34.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.113+0000 7f2cbed9d640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc0160030 0x7f2cc00b48e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800c730 tx=0x7f2cb800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:34.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.113+0000 7f2caeffd640 1 -- 172.21.15.17:0/988559643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8003b90 con 0x7f2cc0160030 2023-08-09T12:51:34.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.113+0000 7f2caeffd640 1 -- 172.21.15.17:0/988559643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb8003cf0 con 0x7f2cc0160030 2023-08-09T12:51:34.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.113+0000 7f2caeffd640 1 -- 172.21.15.17:0/988559643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800aa90 con 0x7f2cc0160030 2023-08-09T12:51:34.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.113+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc01562d0 con 0x7f2cc0160030 2023-08-09T12:51:34.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.113+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc0156890 con 0x7f2cc0160030 2023-08-09T12:51:34.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.114+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc00d0cf0 con 0x7f2cc0160030 2023-08-09T12:51:34.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.115+0000 7f2caeffd640 1 -- 172.21.15.17:0/988559643 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2cb800abf0 con 0x7f2cc0160030 2023-08-09T12:51:34.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.116+0000 7f2caeffd640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ca006a050 0x7f2ca006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.117+0000 7f2caeffd640 1 -- 172.21.15.17:0/988559643 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cb80883d0 con 0x7f2cc0160030 2023-08-09T12:51:34.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.117+0000 7f2cbe59c640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ca006a050 0x7f2ca006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.118+0000 7f2cbe59c640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ca006a050 0x7f2ca006c510 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000b810 tx=0x7f2cb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:34.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.122+0000 7f2caeffd640 1 -- 172.21.15.17:0/988559643 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2cb8053ac0 con 0x7f2cc0160030 2023-08-09T12:51:34.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.315+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cc004e390 con 0x7f2cc0160030 2023-08-09T12:51:34.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.318+0000 7f2caeffd640 1 -- 172.21.15.17:0/988559643 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f2cb80570e0 con 0x7f2cc0160030 2023-08-09T12:51:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:34.326 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":174,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:51:33.352806+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:51:31.771781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-09T12:51:32.371993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:34.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ca006a050 msgr2=0x7f2ca006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ca006a050 0x7f2ca006c510 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000b810 tx=0x7f2cb0008040 comp rx=0 tx=0).stop 2023-08-09T12:51:34.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc0160030 msgr2=0x7f2cc00b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc0160030 0x7f2cc00b48e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800c730 tx=0x7f2cb800cbf0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 shutdown_connections 2023-08-09T12:51:34.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ca006a050 0x7f2ca006c510 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cc0160030 0x7f2cc00b48e0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cc00cf980 0x7f2cc01540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 --2- 172.21.15.17:0/988559643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc00b86e0 0x7f2cc0155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 >> 172.21.15.17:0/988559643 conn(0x7f2cc00697c0 msgr2=0x7f2cc00c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:34.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.321+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 shutdown_connections 2023-08-09T12:51:34.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.322+0000 7f2cbf59e640 1 -- 172.21.15.17:0/988559643 wait complete. 2023-08-09T12:51:34.343 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:34.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.568+0000 7f821c9ab640 1 Processor -- start 2023-08-09T12:51:34.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.568+0000 7f821c9ab640 1 -- start start 2023-08-09T12:51:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.569+0000 7f821c9ab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f821815ce90 0x7f82181616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.569+0000 7f821c9ab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f82180b6000 0x7f82180cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.570+0000 7f821c9ab640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82180b6460 con 0x7f82180d29d0 2023-08-09T12:51:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.570+0000 7f821c9ab640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82180cda40 con 0x7f821815ce90 2023-08-09T12:51:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.570+0000 7f821c9ab640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82180cdd10 con 0x7f82180b6000 2023-08-09T12:51:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.570+0000 7f821659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f821815ce90 0x7f82181616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.570+0000 7f821659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f821815ce90 0x7f82181616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52156/0 (socket says 172.21.15.17:52156) 2023-08-09T12:51:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.570+0000 7f821659c640 1 -- 172.21.15.17:0/2013639142 learned_addr learned my addr 172.21.15.17:0/2013639142 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.570+0000 7f8215d9b640 1 --2- 172.21.15.17:0/2013639142 >> v2:172.21.15.142:3300/0 conn(0x7f82180b6000 0x7f82180cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.571+0000 7f821659c640 1 -- 172.21.15.17:0/2013639142 >> v2:172.21.15.142:3300/0 conn(0x7f82180b6000 msgr2=0x7f82180cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.571+0000 7f821659c640 1 --2- 172.21.15.17:0/2013639142 >> v2:172.21.15.142:3300/0 conn(0x7f82180b6000 0x7f82180cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.571+0000 7f821659c640 1 -- 172.21.15.17:0/2013639142 >> v1:172.21.15.17:6789/0 conn(0x7f82180d29d0 legacy=0x7f82180d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.571+0000 7f821659c640 1 -- 172.21.15.17:0/2013639142 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180cdff0 con 0x7f821815ce90 2023-08-09T12:51:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.572+0000 7f821659c640 1 --2- 172.21.15.17:0/2013639142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181616e0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f82180c9c00 tx=0x7f820802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffb7e467050f656 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.572+0000 7f821559a640 1 -- 172.21.15.17:0/2013639142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208030870 con 0x7f821815ce90 2023-08-09T12:51:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.572+0000 7f821559a640 1 -- 172.21.15.17:0/2013639142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82080309d0 con 0x7f821815ce90 2023-08-09T12:51:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.572+0000 7f821559a640 1 -- 172.21.15.17:0/2013639142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208030d60 con 0x7f821815ce90 2023-08-09T12:51:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.573+0000 7f821c9ab640 1 -- 172.21.15.17:0/2013639142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 msgr2=0x7f82181616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.573+0000 7f821c9ab640 1 --2- 172.21.15.17:0/2013639142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181616e0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f82180c9c00 tx=0x7f820802b9b0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.573+0000 7f821c9ab640 1 -- 172.21.15.17:0/2013639142 shutdown_connections 2023-08-09T12:51:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.573+0000 7f821c9ab640 1 --2- 172.21.15.17:0/2013639142 >> v2:172.21.15.142:3300/0 conn(0x7f82180b6000 0x7f82180cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.573+0000 7f821c9ab640 1 --2- 172.21.15.17:0/2013639142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181616e0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.573+0000 7f821c9ab640 1 -- 172.21.15.17:0/2013639142 >> 172.21.15.17:0/2013639142 conn(0x7f821806fde0 msgr2=0x7f82180701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:34.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.573+0000 7f821c9ab640 1 -- 172.21.15.17:0/2013639142 shutdown_connections 2023-08-09T12:51:34.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.573+0000 7f821c9ab640 1 -- 172.21.15.17:0/2013639142 wait complete. 2023-08-09T12:51:34.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.575+0000 7f821c9ab640 1 Processor -- start 2023-08-09T12:51:34.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.575+0000 7f821c9ab640 1 -- start start 2023-08-09T12:51:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.576+0000 7f821c9ab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82180b6000 0x7f821814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.576+0000 7f821c9ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82180d29d0 0x7f82181e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.576+0000 7f821c9ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.576+0000 7f821c9ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180cb040 con 0x7f821815ce90 2023-08-09T12:51:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.576+0000 7f821c9ab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821815dcb0 con 0x7f82180b6000 2023-08-09T12:51:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.576+0000 7f821c9ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180caa80 con 0x7f82180d29d0 2023-08-09T12:51:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.576+0000 7f8216d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.576+0000 7f8216d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181e8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52164/0 (socket says 172.21.15.17:52164) 2023-08-09T12:51:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f8216d9d640 1 -- 172.21.15.17:0/974800221 learned_addr learned my addr 172.21.15.17:0/974800221 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f8215d9b640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82180d29d0 0x7f82181e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f821659c640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82180b6000 0x7f821814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f8216d9d640 1 -- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82180d29d0 msgr2=0x7f82181e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f8216d9d640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82180d29d0 0x7f82181e8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f8216d9d640 1 -- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82180b6000 msgr2=0x7f821814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f8216d9d640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82180b6000 0x7f821814afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f8216d9d640 1 -- 172.21.15.17:0/974800221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82080094d0 con 0x7f821815ce90 2023-08-09T12:51:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.577+0000 7f8216d9d640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181e8d90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f8210001eb0 tx=0x7f821000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.578+0000 7f8206ffd640 1 -- 172.21.15.17:0/974800221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100052d0 con 0x7f821815ce90 2023-08-09T12:51:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.578+0000 7f8206ffd640 1 -- 172.21.15.17:0/974800221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210005430 con 0x7f821815ce90 2023-08-09T12:51:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.578+0000 7f8206ffd640 1 -- 172.21.15.17:0/974800221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210003810 con 0x7f821815ce90 2023-08-09T12:51:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.578+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82180cad60 con 0x7f821815ce90 2023-08-09T12:51:34.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.578+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82181e6870 con 0x7f821815ce90 2023-08-09T12:51:34.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.579+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8218160940 con 0x7f821815ce90 2023-08-09T12:51:34.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.580+0000 7f8206ffd640 1 -- 172.21.15.17:0/974800221 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8210003970 con 0x7f821815ce90 2023-08-09T12:51:34.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.581+0000 7f8206ffd640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81f806a050 0x7f81f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:34.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.581+0000 7f8206ffd640 1 -- 172.21.15.17:0/974800221 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8210087ba0 con 0x7f821815ce90 2023-08-09T12:51:34.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.582+0000 7f821659c640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81f806a050 0x7f81f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:34.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.583+0000 7f821659c640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81f806a050 0x7f81f806c510 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8208036000 tx=0x7f820803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.585+0000 7f8206ffd640 1 -- 172.21.15.17:0/974800221 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f82100531f0 con 0x7f821815ce90 2023-08-09T12:51:34.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.778+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82181e63f0 con 0x7f821815ce90 2023-08-09T12:51:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.782+0000 7f8206ffd640 1 -- 172.21.15.17:0/974800221 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f82181e63f0 con 0x7f821815ce90 2023-08-09T12:51:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:34.786 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":174,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:51:33.352806+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:51:31.771781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-09T12:51:32.371993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81f806a050 msgr2=0x7f81f806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81f806a050 0x7f81f806c510 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8208036000 tx=0x7f820803b040 comp rx=0 tx=0).stop 2023-08-09T12:51:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 msgr2=0x7f82181e8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181e8d90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f8210001eb0 tx=0x7f821000c890 comp rx=0 tx=0).stop 2023-08-09T12:51:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 shutdown_connections 2023-08-09T12:51:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81f806a050 0x7f81f806c510 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821815ce90 0x7f82181e8d90 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82180d29d0 0x7f82181e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 --2- 172.21.15.17:0/974800221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82180b6000 0x7f821814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.784+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 >> 172.21.15.17:0/974800221 conn(0x7f821806fde0 msgr2=0x7f82180b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.785+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 shutdown_connections 2023-08-09T12:51:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:34.785+0000 7f821c9ab640 1 -- 172.21.15.17:0/974800221 wait complete. 2023-08-09T12:51:34.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:51:34.821 INFO:tasks.ceph.mds.a.smithi017.stderr:2023-08-09T12:51:34.818+0000 7fc4fe145640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:51:35.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.041+0000 7f9bce883640 1 Processor -- start 2023-08-09T12:51:35.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.041+0000 7f9bce883640 1 -- start start 2023-08-09T12:51:35.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bce883640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80cfab0 0x7f9bc80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:35.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bce883640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9bc815d2d0 0x7f9bc80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:35.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bce883640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc80b2010 con 0x7f9bc815cef0 2023-08-09T12:51:35.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bce883640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc80cdee0 con 0x7f9bc815d2d0 2023-08-09T12:51:35.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bce883640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80b1d30 con 0x7f9bc80cfab0 2023-08-09T12:51:35.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bcce20640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9bc815d2d0 0x7f9bc80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:35.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bcce20640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9bc815d2d0 0x7f9bc80ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52176/0 (socket says 172.21.15.17:52176) 2023-08-09T12:51:35.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bcce20640 1 -- 172.21.15.17:0/331002272 learned_addr learned my addr 172.21.15.17:0/331002272 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:35.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.043+0000 7f9bc77fe640 1 --2- 172.21.15.17:0/331002272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80cfab0 0x7f9bc80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:35.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.044+0000 7f9bcce20640 1 -- 172.21.15.17:0/331002272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80cfab0 msgr2=0x7f9bc80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:35.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.044+0000 7f9bcce20640 1 --2- 172.21.15.17:0/331002272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80cfab0 0x7f9bc80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.044+0000 7f9bcce20640 1 -- 172.21.15.17:0/331002272 >> v1:172.21.15.142:6789/0 conn(0x7f9bc815cef0 legacy=0x7f9bc80cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:35.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.044+0000 7f9bcce20640 1 -- 172.21.15.17:0/331002272 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc80cd820 con 0x7f9bc815d2d0 2023-08-09T12:51:35.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.045+0000 7f9bcce20640 1 --2- 172.21.15.17:0/331002272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc815d2d0 0x7f9bc80ce300 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80b2680 tx=0x7f9bc002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dff07ec0cce930 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:35.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.046+0000 7f9bc6ffd640 1 -- 172.21.15.17:0/331002272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc002f050 con 0x7f9bc815d2d0 2023-08-09T12:51:35.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.046+0000 7f9bc6ffd640 1 -- 172.21.15.17:0/331002272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc0031700 con 0x7f9bc815d2d0 2023-08-09T12:51:35.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.046+0000 7f9bc6ffd640 1 -- 172.21.15.17:0/331002272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0031a90 con 0x7f9bc815d2d0 2023-08-09T12:51:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.046+0000 7f9bce883640 1 -- 172.21.15.17:0/331002272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc815d2d0 msgr2=0x7f9bc80ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.046+0000 7f9bce883640 1 --2- 172.21.15.17:0/331002272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc815d2d0 0x7f9bc80ce300 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80b2680 tx=0x7f9bc002b7a0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.047+0000 7f9bce883640 1 -- 172.21.15.17:0/331002272 shutdown_connections 2023-08-09T12:51:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.047+0000 7f9bce883640 1 --2- 172.21.15.17:0/331002272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc815d2d0 0x7f9bc80ce300 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.047+0000 7f9bce883640 1 --2- 172.21.15.17:0/331002272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80cfab0 0x7f9bc80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.047+0000 7f9bce883640 1 -- 172.21.15.17:0/331002272 >> 172.21.15.17:0/331002272 conn(0x7f9bc806fde0 msgr2=0x7f9bc80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:35.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.047+0000 7f9bce883640 1 -- 172.21.15.17:0/331002272 shutdown_connections 2023-08-09T12:51:35.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.047+0000 7f9bce883640 1 -- 172.21.15.17:0/331002272 wait complete. 2023-08-09T12:51:35.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.048+0000 7f9bce883640 1 Processor -- start 2023-08-09T12:51:35.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.049+0000 7f9bce883640 1 -- start start 2023-08-09T12:51:35.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.049+0000 7f9bce883640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc80cfab0 0x7f9bc81f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:35.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.049+0000 7f9bce883640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815cef0 0x7f9bc815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:35.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.049+0000 7f9bce883640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc815d2d0 0x7f9bc80c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:35.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.049+0000 7f9bce883640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80c99b0 con 0x7f9bc80cfab0 2023-08-09T12:51:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.049+0000 7f9bce883640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc81f6cc0 con 0x7f9bc815d2d0 2023-08-09T12:51:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.049+0000 7f9bce883640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc81f5f00 con 0x7f9bc815cef0 2023-08-09T12:51:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc80cfab0 0x7f9bc81f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc80cfab0 0x7f9bc81f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52184/0 (socket says 172.21.15.17:52184) 2023-08-09T12:51:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc7fff640 1 -- 172.21.15.17:0/3396030913 learned_addr learned my addr 172.21.15.17:0/3396030913 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc77fe640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815cef0 0x7f9bc815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc7fff640 1 -- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815cef0 msgr2=0x7f9bc815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc7fff640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815cef0 0x7f9bc815a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bcce20640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc815d2d0 0x7f9bc80c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc7fff640 1 -- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc815d2d0 msgr2=0x7f9bc80c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc7fff640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc815d2d0 0x7f9bc80c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.050+0000 7f9bc7fff640 1 -- 172.21.15.17:0/3396030913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc00094d0 con 0x7f9bc80cfab0 2023-08-09T12:51:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.051+0000 7f9bc7fff640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc80cfab0 0x7f9bc81f32f0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c7c0 tx=0x7f9bb800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.051+0000 7f9bc4ff9640 1 -- 172.21.15.17:0/3396030913 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800aa50 con 0x7f9bc80cfab0 2023-08-09T12:51:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.051+0000 7f9bc4ff9640 1 -- 172.21.15.17:0/3396030913 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800abb0 con 0x7f9bc80cfab0 2023-08-09T12:51:35.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.051+0000 7f9bc4ff9640 1 -- 172.21.15.17:0/3396030913 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8012420 con 0x7f9bc80cfab0 2023-08-09T12:51:35.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.051+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc81f61e0 con 0x7f9bc80cfab0 2023-08-09T12:51:35.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.051+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc81f67a0 con 0x7f9bc80cfab0 2023-08-09T12:51:35.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.052+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc80b1ab0 con 0x7f9bc80cfab0 2023-08-09T12:51:35.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.053+0000 7f9bc4ff9640 1 -- 172.21.15.17:0/3396030913 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9bb8012580 con 0x7f9bc80cfab0 2023-08-09T12:51:35.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.054+0000 7f9bc4ff9640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9bb406a050 0x7f9bb406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:35.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.054+0000 7f9bc4ff9640 1 -- 172.21.15.17:0/3396030913 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9bb8088530 con 0x7f9bc80cfab0 2023-08-09T12:51:35.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.055+0000 7f9bc77fe640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9bb406a050 0x7f9bb406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:35.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.056+0000 7f9bc77fe640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9bb406a050 0x7f9bb406c510 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80d2110 tx=0x7f9bbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.059+0000 7f9bc4ff9640 1 -- 172.21.15.17:0/3396030913 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9bb8053c10 con 0x7f9bc80cfab0 2023-08-09T12:51:35.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.298+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9bc81f69c0 con 0x7f9bc80cfab0 2023-08-09T12:51:35.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.906+0000 7f9bc4ff9640 1 -- 172.21.15.17:0/3396030913 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9bb8057230 con 0x7f9bc80cfab0 2023-08-09T12:51:35.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9bb406a050 msgr2=0x7f9bb406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:35.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9bb406a050 0x7f9bb406c510 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80d2110 tx=0x7f9bbc008040 comp rx=0 tx=0).stop 2023-08-09T12:51:35.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc80cfab0 msgr2=0x7f9bc81f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc80cfab0 0x7f9bc81f32f0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c7c0 tx=0x7f9bb800cc80 comp rx=0 tx=0).stop 2023-08-09T12:51:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 shutdown_connections 2023-08-09T12:51:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9bb406a050 0x7f9bb406c510 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc815d2d0 0x7f9bc80c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815cef0 0x7f9bc815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 --2- 172.21.15.17:0/3396030913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc80cfab0 0x7f9bc81f32f0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:35.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 >> 172.21.15.17:0/3396030913 conn(0x7f9bc806fde0 msgr2=0x7f9bc80cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:35.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 shutdown_connections 2023-08-09T12:51:35.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:35.910+0000 7f9bce883640 1 -- 172.21.15.17:0/3396030913 wait complete. 2023-08-09T12:51:35.937 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:51:35.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:51:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.217+0000 7fa21e949640 1 Processor -- start 2023-08-09T12:51:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.217+0000 7fa21e949640 1 -- start start 2023-08-09T12:51:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21e949640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa21815ca30 0x7fa2180697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21e949640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2180ccbc0 0x7fa218069d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21e949640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2180acaf0 0x7fa2181606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21e949640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180cdd40 con 0x7fa21815ca30 2023-08-09T12:51:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21e949640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180cd130 con 0x7fa2180ccbc0 2023-08-09T12:51:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21e949640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180cd410 con 0x7fa2180acaf0 2023-08-09T12:51:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21d947640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa21815ca30 0x7fa2180697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21d947640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa21815ca30 0x7fa2180697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52198/0 (socket says 172.21.15.17:52198) 2023-08-09T12:51:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.219+0000 7fa21d947640 1 -- 172.21.15.17:0/3939654627 learned_addr learned my addr 172.21.15.17:0/3939654627 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.220+0000 7fa21d947640 1 -- 172.21.15.17:0/3939654627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2180acaf0 msgr2=0x7fa2181606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.220+0000 7fa21d947640 1 --2- 172.21.15.17:0/3939654627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2180acaf0 0x7fa2181606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.220+0000 7fa21d947640 1 -- 172.21.15.17:0/3939654627 >> v2:172.21.15.142:3300/0 conn(0x7fa2180ccbc0 msgr2=0x7fa218069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.220+0000 7fa21d146640 1 --2- 172.21.15.17:0/3939654627 >> v2:172.21.15.142:3300/0 conn(0x7fa2180ccbc0 0x7fa218069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.220+0000 7fa21d947640 1 --2- 172.21.15.17:0/3939654627 >> v2:172.21.15.142:3300/0 conn(0x7fa2180ccbc0 0x7fa218069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.220+0000 7fa21d947640 1 -- 172.21.15.17:0/3939654627 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180cd6f0 con 0x7fa21815ca30 2023-08-09T12:51:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.220+0000 7fa21d146640 1 --2- 172.21.15.17:0/3939654627 >> v2:172.21.15.142:3300/0 conn(0x7fa2180ccbc0 0x7fa218069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.221+0000 7fa21d947640 1 --2- 172.21.15.17:0/3939654627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa21815ca30 0x7fa2180697c0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fa2180cbe80 tx=0x7fa21402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af09f300b081c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.221+0000 7fa21c945640 1 -- 172.21.15.17:0/3939654627 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214031870 con 0x7fa21815ca30 2023-08-09T12:51:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.221+0000 7fa21c945640 1 -- 172.21.15.17:0/3939654627 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2140319d0 con 0x7fa21815ca30 2023-08-09T12:51:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.221+0000 7fa21c945640 1 -- 172.21.15.17:0/3939654627 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214031d60 con 0x7fa21815ca30 2023-08-09T12:51:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 -- 172.21.15.17:0/3939654627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa21815ca30 msgr2=0x7fa2180697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 --2- 172.21.15.17:0/3939654627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa21815ca30 0x7fa2180697c0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fa2180cbe80 tx=0x7fa21402b910 comp rx=0 tx=0).stop 2023-08-09T12:51:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 -- 172.21.15.17:0/3939654627 shutdown_connections 2023-08-09T12:51:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 --2- 172.21.15.17:0/3939654627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2180acaf0 0x7fa2181606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 --2- 172.21.15.17:0/3939654627 >> v2:172.21.15.142:3300/0 conn(0x7fa2180ccbc0 0x7fa218069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 --2- 172.21.15.17:0/3939654627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa21815ca30 0x7fa2180697c0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 -- 172.21.15.17:0/3939654627 >> 172.21.15.17:0/3939654627 conn(0x7fa21806abd0 msgr2=0x7fa21806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 -- 172.21.15.17:0/3939654627 shutdown_connections 2023-08-09T12:51:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.222+0000 7fa21e949640 1 -- 172.21.15.17:0/3939654627 wait complete. 2023-08-09T12:51:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.224+0000 7fa21e949640 1 Processor -- start 2023-08-09T12:51:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.225+0000 7fa21e949640 1 -- start start 2023-08-09T12:51:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21e949640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2180acaf0 0x7fa2181579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21e949640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180ccbc0 0x7fa218150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21e949640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa21815ca30 0x7fa2180c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21e949640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21806fa00 con 0x7fa2180acaf0 2023-08-09T12:51:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21e949640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218157f00 con 0x7fa2180ccbc0 2023-08-09T12:51:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21e949640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa218156940 con 0x7fa21815ca30 2023-08-09T12:51:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21d947640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2180acaf0 0x7fa2181579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21d947640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2180acaf0 0x7fa2181579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52204/0 (socket says 172.21.15.17:52204) 2023-08-09T12:51:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.226+0000 7fa21d947640 1 -- 172.21.15.17:0/1270565426 learned_addr learned my addr 172.21.15.17:0/1270565426 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa21d947640 1 -- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa21815ca30 msgr2=0x7fa2180c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa21d947640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa21815ca30 0x7fa2180c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa21d947640 1 -- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180ccbc0 msgr2=0x7fa218150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa21d947640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180ccbc0 0x7fa218150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa21d947640 1 -- 172.21.15.17:0/1270565426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140094d0 con 0x7fa2180acaf0 2023-08-09T12:51:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa21d947640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2180acaf0 0x7fa2181579c0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fa21402b950 tx=0x7fa2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa20e7fc640 1 -- 172.21.15.17:0/1270565426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214031860 con 0x7fa2180acaf0 2023-08-09T12:51:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa20e7fc640 1 -- 172.21.15.17:0/1270565426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2140443f0 con 0x7fa2180acaf0 2023-08-09T12:51:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa218156c20 con 0x7fa2180acaf0 2023-08-09T12:51:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa20e7fc640 1 -- 172.21.15.17:0/1270565426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2140447a0 con 0x7fa2180acaf0 2023-08-09T12:51:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.227+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21806fef0 con 0x7fa2180acaf0 2023-08-09T12:51:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.229+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21804e390 con 0x7fa2180acaf0 2023-08-09T12:51:36.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.230+0000 7fa20e7fc640 1 -- 172.21.15.17:0/1270565426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa21404d450 con 0x7fa2180acaf0 2023-08-09T12:51:36.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.230+0000 7fa20e7fc640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1fc06a050 0x7fa1fc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:36.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.231+0000 7fa20e7fc640 1 -- 172.21.15.17:0/1270565426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa21402d040 con 0x7fa2180acaf0 2023-08-09T12:51:36.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.231+0000 7fa21d146640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1fc06a050 0x7fa1fc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:36.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.232+0000 7fa21d146640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1fc06a050 0x7fa1fc06c510 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa208006fd0 tx=0x7fa208008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:36.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.235+0000 7fa20e7fc640 1 -- 172.21.15.17:0/1270565426 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa214076490 con 0x7fa2180acaf0 2023-08-09T12:51:36.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.461+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa2180ac8d0 con 0x7fa2180acaf0 2023-08-09T12:51:36.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.909+0000 7fa20e7fc640 1 -- 172.21.15.17:0/1270565426 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa214035020 con 0x7fa2180acaf0 2023-08-09T12:51:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1fc06a050 msgr2=0x7fa1fc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1fc06a050 0x7fa1fc06c510 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa208006fd0 tx=0x7fa208008040 comp rx=0 tx=0).stop 2023-08-09T12:51:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2180acaf0 msgr2=0x7fa2181579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2180acaf0 0x7fa2181579c0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fa21402b950 tx=0x7fa2140046c0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 shutdown_connections 2023-08-09T12:51:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa1fc06a050 0x7fa1fc06c510 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa21815ca30 0x7fa2180c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180ccbc0 0x7fa218150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 --2- 172.21.15.17:0/1270565426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2180acaf0 0x7fa2181579c0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 >> 172.21.15.17:0/1270565426 conn(0x7fa21806abd0 msgr2=0x7fa2180b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 shutdown_connections 2023-08-09T12:51:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:36.912+0000 7fa21e949640 1 -- 172.21.15.17:0/1270565426 wait complete. 2023-08-09T12:51:36.937 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:51:36.938 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:51:37.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.169+0000 7f8c6e848640 1 Processor -- start 2023-08-09T12:51:37.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.169+0000 7f8c6e848640 1 -- start start 2023-08-09T12:51:37.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.170+0000 7f8c6e848640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680cd3d0 0x7f8c680cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.170+0000 7f8c6e848640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680b5740 con 0x7f8c680c6590 2023-08-09T12:51:37.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.170+0000 7f8c6e848640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680b26a0 con 0x7f8c680b5bd0 2023-08-09T12:51:37.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.170+0000 7f8c6e848640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680b6990 con 0x7f8c680cd3d0 2023-08-09T12:51:37.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.171+0000 7f8c6cde5640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8c680c6590 0x7f8c680c69f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:58610/0 (socket says 172.21.15.17:58610) 2023-08-09T12:51:37.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.171+0000 7f8c6cde5640 1 -- 172.21.15.17:0/859684234 learned_addr learned my addr 172.21.15.17:0/859684234 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:37.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.171+0000 7f8c67fff640 1 --2- 172.21.15.17:0/859684234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680cd3d0 0x7f8c680cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:37.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.171+0000 7f8c66ffd640 1 -- 172.21.15.17:0/859684234 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934994577 0 0) 0x7f8c680b5740 con 0x7f8c680c6590 2023-08-09T12:51:37.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.171+0000 7f8c66ffd640 1 -- 172.21.15.17:0/859684234 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c50003520 con 0x7f8c680c6590 2023-08-09T12:51:37.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.172+0000 7f8c66ffd640 1 -- 172.21.15.17:0/859684234 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429747779 0 0) 0x7f8c680b26a0 con 0x7f8c680b5bd0 2023-08-09T12:51:37.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.172+0000 7f8c66ffd640 1 -- 172.21.15.17:0/859684234 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c680b5740 con 0x7f8c680b5bd0 2023-08-09T12:51:37.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.172+0000 7f8c67fff640 1 -- 172.21.15.17:0/859684234 >> v1:172.21.15.142:6789/0 conn(0x7f8c680b5bd0 legacy=0x7f8c680b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.172+0000 7f8c66ffd640 1 -- 172.21.15.17:0/859684234 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924318720 0 0) 0x7f8c50003520 con 0x7f8c680c6590 2023-08-09T12:51:37.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.172+0000 7f8c67fff640 1 -- 172.21.15.17:0/859684234 >> v1:172.21.15.17:6789/0 conn(0x7f8c680c6590 legacy=0x7f8c680c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.172+0000 7f8c67fff640 1 -- 172.21.15.17:0/859684234 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680cdcf0 con 0x7f8c680cd3d0 2023-08-09T12:51:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.173+0000 7f8c67fff640 1 --2- 172.21.15.17:0/859684234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680cd3d0 0x7f8c680cd7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009dc0 tx=0x7f8c5802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c6de853b5a8e591 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c66ffd640 1 -- 172.21.15.17:0/859684234 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60001670 con 0x7f8c680cd3d0 2023-08-09T12:51:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c66ffd640 1 -- 172.21.15.17:0/859684234 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5802c9a0 con 0x7f8c680cd3d0 2023-08-09T12:51:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c66ffd640 1 -- 172.21.15.17:0/859684234 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5802cd30 con 0x7f8c680cd3d0 2023-08-09T12:51:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c6e848640 1 -- 172.21.15.17:0/859684234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680cd3d0 msgr2=0x7f8c680cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c6e848640 1 --2- 172.21.15.17:0/859684234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680cd3d0 0x7f8c680cd7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009dc0 tx=0x7f8c5802be70 comp rx=0 tx=0).stop 2023-08-09T12:51:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c6e848640 1 -- 172.21.15.17:0/859684234 shutdown_connections 2023-08-09T12:51:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c6e848640 1 --2- 172.21.15.17:0/859684234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680cd3d0 0x7f8c680cd7b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c6e848640 1 -- 172.21.15.17:0/859684234 >> 172.21.15.17:0/859684234 conn(0x7f8c6806b9d0 msgr2=0x7f8c6806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:37.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c6e848640 1 -- 172.21.15.17:0/859684234 shutdown_connections 2023-08-09T12:51:37.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.174+0000 7f8c6e848640 1 -- 172.21.15.17:0/859684234 wait complete. 2023-08-09T12:51:37.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.176+0000 7f8c6e848640 1 Processor -- start 2023-08-09T12:51:37.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.176+0000 7f8c6e848640 1 -- start start 2023-08-09T12:51:37.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.177+0000 7f8c6e848640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c680b5bd0 0x7f8c680d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.177+0000 7f8c6e848640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680c6590 0x7f8c68154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.177+0000 7f8c6e848640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c680cd3d0 0x7f8c680ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.177+0000 7f8c6e848640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680d0970 con 0x7f8c680cd3d0 2023-08-09T12:51:37.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.177+0000 7f8c6e848640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68150760 con 0x7f8c680b5bd0 2023-08-09T12:51:37.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.177+0000 7f8c6e848640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68150a40 con 0x7f8c680c6590 2023-08-09T12:51:37.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c6cde5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c680cd3d0 0x7f8c680ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:37.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c6cde5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c680cd3d0 0x7f8c680ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52206/0 (socket says 172.21.15.17:52206) 2023-08-09T12:51:37.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c6cde5640 1 -- 172.21.15.17:0/3779754309 learned_addr learned my addr 172.21.15.17:0/3779754309 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:37.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c677fe640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680c6590 0x7f8c68154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:37.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c67fff640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c680b5bd0 0x7f8c680d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:37.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c6cde5640 1 -- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680c6590 msgr2=0x7f8c68154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c6cde5640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680c6590 0x7f8c68154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c6cde5640 1 -- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c680b5bd0 msgr2=0x7f8c680d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c6cde5640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c680b5bd0 0x7f8c680d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.178+0000 7f8c6cde5640 1 -- 172.21.15.17:0/3779754309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c58009a70 con 0x7f8c680cd3d0 2023-08-09T12:51:37.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.179+0000 7f8c6cde5640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c680cd3d0 0x7f8c680ce580 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000c680 tx=0x7f8c6000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:37.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.179+0000 7f8c64ff9640 1 -- 172.21.15.17:0/3779754309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60005ad0 con 0x7f8c680cd3d0 2023-08-09T12:51:37.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.179+0000 7f8c64ff9640 1 -- 172.21.15.17:0/3779754309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60005c30 con 0x7f8c680cd3d0 2023-08-09T12:51:37.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.179+0000 7f8c64ff9640 1 -- 172.21.15.17:0/3779754309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60007070 con 0x7f8c680cd3d0 2023-08-09T12:51:37.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.179+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c680d0320 con 0x7f8c680cd3d0 2023-08-09T12:51:37.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.179+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c680d1340 con 0x7f8c680cd3d0 2023-08-09T12:51:37.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.180+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c680d0180 con 0x7f8c680cd3d0 2023-08-09T12:51:37.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.181+0000 7f8c64ff9640 1 -- 172.21.15.17:0/3779754309 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c600071d0 con 0x7f8c680cd3d0 2023-08-09T12:51:37.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.182+0000 7f8c64ff9640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5406a050 0x7f8c5406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.182+0000 7f8c64ff9640 1 -- 172.21.15.17:0/3779754309 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c60088340 con 0x7f8c680cd3d0 2023-08-09T12:51:37.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.183+0000 7f8c67fff640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5406a050 0x7f8c5406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:37.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.184+0000 7f8c67fff640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5406a050 0x7f8c5406c510 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8c58036000 tx=0x7f8c58030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:37.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.187+0000 7f8c64ff9640 1 -- 172.21.15.17:0/3779754309 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8c680d0180 con 0x7f8c680cd3d0 2023-08-09T12:51:37.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.417+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c680d0b20 con 0x7f8c680cd3d0 2023-08-09T12:51:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.418+0000 7f8c64ff9640 1 -- 172.21.15.17:0/3779754309 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4876 (secure 0 0 0) 0x7f8c680d0b20 con 0x7f8c680cd3d0 2023-08-09T12:51:37.423 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:37.423 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/53885323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":53885323},{"type":"v1","addr":"172.21.15.142:6836","nonce":53885323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1636287832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1636287832},{"type":"v1","addr":"172.21.15.142:6837","nonce":1636287832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/758642293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":758642293},{"type":"v1","addr":"172.21.15.17:6833","nonce":758642293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:51:33.353513+0000","modified":"2023-08-09T12:51:36.903336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9000},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9000":{"gid":9000,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2739343495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2739343495},{"type":"v1","addr":"172.21.15.17:6835","nonce":2739343495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-09T12:51:37.424 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 84 2023-08-09T12:51:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5406a050 msgr2=0x7f8c5406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5406a050 0x7f8c5406c510 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8c58036000 tx=0x7f8c58030000 comp rx=0 tx=0).stop 2023-08-09T12:51:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c680cd3d0 msgr2=0x7f8c680ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c680cd3d0 0x7f8c680ce580 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000c680 tx=0x7f8c6000cb40 comp rx=0 tx=0).stop 2023-08-09T12:51:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 shutdown_connections 2023-08-09T12:51:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8c5406a050 0x7f8c5406c510 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c680cd3d0 0x7f8c680ce580 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c680c6590 0x7f8c68154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 --2- 172.21.15.17:0/3779754309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c680b5bd0 0x7f8c680d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 >> 172.21.15.17:0/3779754309 conn(0x7f8c6806b9d0 msgr2=0x7f8c680af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:37.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 shutdown_connections 2023-08-09T12:51:37.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.421+0000 7f8c6e848640 1 -- 172.21.15.17:0/3779754309 wait complete. 2023-08-09T12:51:37.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:51:37.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.657+0000 7f43ad724640 1 Processor -- start 2023-08-09T12:51:37.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.657+0000 7f43ad724640 1 -- start start 2023-08-09T12:51:37.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.659+0000 7f43ad724640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43a80ca000 0x7f43a80cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.659+0000 7f43ad724640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43a815cd80 0x7f43a806f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.659+0000 7f43ad724640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a806fab0 con 0x7f43a8071450 2023-08-09T12:51:37.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.659+0000 7f43ad724640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a8159710 con 0x7f43a815cd80 2023-08-09T12:51:37.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.659+0000 7f43ad724640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a815d4f0 con 0x7f43a80ca000 2023-08-09T12:51:37.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.660+0000 7f43acf23640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43a815cd80 0x7f43a806f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:37.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.660+0000 7f43acf23640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43a815cd80 0x7f43a806f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52216/0 (socket says 172.21.15.17:52216) 2023-08-09T12:51:37.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.660+0000 7f43acf23640 1 -- 172.21.15.17:0/1704594965 learned_addr learned my addr 172.21.15.17:0/1704594965 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.660+0000 7f43acf23640 1 -- 172.21.15.17:0/1704594965 >> v2:172.21.15.142:3300/0 conn(0x7f43a80ca000 msgr2=0x7f43a80cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.660+0000 7f43acf23640 1 --2- 172.21.15.17:0/1704594965 >> v2:172.21.15.142:3300/0 conn(0x7f43a80ca000 0x7f43a80cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.660+0000 7f43acf23640 1 -- 172.21.15.17:0/1704594965 >> v1:172.21.15.142:6789/0 conn(0x7f43a8071450 legacy=0x7f43a80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.660+0000 7f43acf23640 1 -- 172.21.15.17:0/1704594965 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a815d7d0 con 0x7f43a815cd80 2023-08-09T12:51:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.661+0000 7f43acf23640 1 --2- 172.21.15.17:0/1704594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a806f570 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b2db0 tx=0x7f43a002cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8ebd732c377b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43a6ffd640 1 -- 172.21.15.17:0/1704594965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a002d900 con 0x7f43a815cd80 2023-08-09T12:51:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43a6ffd640 1 -- 172.21.15.17:0/1704594965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a002da60 con 0x7f43a815cd80 2023-08-09T12:51:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43a6ffd640 1 -- 172.21.15.17:0/1704594965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a002ddf0 con 0x7f43a815cd80 2023-08-09T12:51:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43ad724640 1 -- 172.21.15.17:0/1704594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 msgr2=0x7f43a806f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43ad724640 1 --2- 172.21.15.17:0/1704594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a806f570 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b2db0 tx=0x7f43a002cf60 comp rx=0 tx=0).stop 2023-08-09T12:51:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43ad724640 1 -- 172.21.15.17:0/1704594965 shutdown_connections 2023-08-09T12:51:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43ad724640 1 --2- 172.21.15.17:0/1704594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a806f570 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43ad724640 1 --2- 172.21.15.17:0/1704594965 >> v2:172.21.15.142:3300/0 conn(0x7f43a80ca000 0x7f43a80cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.662+0000 7f43ad724640 1 -- 172.21.15.17:0/1704594965 >> 172.21.15.17:0/1704594965 conn(0x7f43a80b1d50 msgr2=0x7f43a806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:37.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.663+0000 7f43ad724640 1 -- 172.21.15.17:0/1704594965 shutdown_connections 2023-08-09T12:51:37.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.663+0000 7f43ad724640 1 -- 172.21.15.17:0/1704594965 wait complete. 2023-08-09T12:51:37.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.664+0000 7f43ad724640 1 Processor -- start 2023-08-09T12:51:37.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.664+0000 7f43ad724640 1 -- start start 2023-08-09T12:51:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.665+0000 7f43ad724640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a8071450 0x7f43a8144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.665+0000 7f43ad724640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a80ca000 0x7f43a8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.665+0000 7f43ad724640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.665+0000 7f43ad724640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a81528e0 con 0x7f43a815cd80 2023-08-09T12:51:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.665+0000 7f43ad724640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8152bc0 con 0x7f43a80ca000 2023-08-09T12:51:37.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.665+0000 7f43ad724640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8152ea0 con 0x7f43a8071450 2023-08-09T12:51:37.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:37.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a815b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52232/0 (socket says 172.21.15.17:52232) 2023-08-09T12:51:37.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 -- 172.21.15.17:0/969844705 learned_addr learned my addr 172.21.15.17:0/969844705 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:37.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 -- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a8071450 msgr2=0x7f43a8144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a8071450 0x7f43a8144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 -- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a80ca000 msgr2=0x7f43a8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a80ca000 0x7f43a8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 -- 172.21.15.17:0/969844705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a000ac40 con 0x7f43a815cd80 2023-08-09T12:51:37.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.666+0000 7f43acf23640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a815b5b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f43a0037040 tx=0x7f43a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.667+0000 7f43a4ff9640 1 -- 172.21.15.17:0/969844705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0009ca0 con 0x7f43a815cd80 2023-08-09T12:51:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.667+0000 7f43a4ff9640 1 -- 172.21.15.17:0/969844705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a0009e40 con 0x7f43a815cd80 2023-08-09T12:51:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.667+0000 7f43a4ff9640 1 -- 172.21.15.17:0/969844705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a00406b0 con 0x7f43a815cd80 2023-08-09T12:51:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.667+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a8153180 con 0x7f43a815cd80 2023-08-09T12:51:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.667+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a8144fa0 con 0x7f43a815cd80 2023-08-09T12:51:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.668+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a80ce420 con 0x7f43a815cd80 2023-08-09T12:51:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.669+0000 7f43a4ff9640 1 -- 172.21.15.17:0/969844705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43a0040810 con 0x7f43a815cd80 2023-08-09T12:51:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.670+0000 7f43a4ff9640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f439406a050 0x7f439406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.670+0000 7f43a4ff9640 1 -- 172.21.15.17:0/969844705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43a00ab920 con 0x7f43a815cd80 2023-08-09T12:51:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.671+0000 7f43a7fff640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f439406a050 0x7f439406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.672+0000 7f43a7fff640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f439406a050 0x7f439406c510 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4398003cc0 tx=0x7f43980079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.674+0000 7f43a4ff9640 1 -- 172.21.15.17:0/969844705 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f43a0076f70 con 0x7f43a815cd80 2023-08-09T12:51:37.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.865+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43a8153640 con 0x7f43a815cd80 2023-08-09T12:51:37.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.868+0000 7f43a4ff9640 1 -- 172.21.15.17:0/969844705 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f43a007a590 con 0x7f43a815cd80 2023-08-09T12:51:37.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:37.873 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":175,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:51:34.859786+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:51:31.771781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-09T12:51:32.371993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:51:37.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f439406a050 msgr2=0x7f439406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f439406a050 0x7f439406c510 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4398003cc0 tx=0x7f43980079b0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 msgr2=0x7f43a815b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:37.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a815b5b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f43a0037040 tx=0x7f43a0004a40 comp rx=0 tx=0).stop 2023-08-09T12:51:37.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 shutdown_connections 2023-08-09T12:51:37.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f439406a050 0x7f439406c510 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43a815cd80 0x7f43a815b5b0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a80ca000 0x7f43a8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 --2- 172.21.15.17:0/969844705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a8071450 0x7f43a8144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 >> 172.21.15.17:0/969844705 conn(0x7f43a80b1d50 msgr2=0x7f43a80697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 shutdown_connections 2023-08-09T12:51:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:37.871+0000 7f43ad724640 1 -- 172.21.15.17:0/969844705 wait complete. 2023-08-09T12:51:37.894 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:51:37.894 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:51:38.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.110+0000 7f94e0234640 1 Processor -- start 2023-08-09T12:51:38.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.111+0000 7f94e0234640 1 -- start start 2023-08-09T12:51:38.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.112+0000 7f94e0234640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f94d80b3b40 0x7f94d80b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.112+0000 7f94e0234640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d806c990 con 0x7f94d80adc40 2023-08-09T12:51:38.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.112+0000 7f94e0234640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80b2250 con 0x7f94d80cc630 2023-08-09T12:51:38.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.112+0000 7f94e0234640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80ae020 con 0x7f94d80b3b40 2023-08-09T12:51:38.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.112+0000 7f94ddfd0640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f94d80adc40 0x7f94d806c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48364/0 (socket says 172.21.15.17:48364) 2023-08-09T12:51:38.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.112+0000 7f94ddfd0640 1 -- 172.21.15.17:0/4196022994 learned_addr learned my addr 172.21.15.17:0/4196022994 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:38.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967239163 0 0) 0x7f94d806c990 con 0x7f94d80adc40 2023-08-09T12:51:38.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c4003520 con 0x7f94d80adc40 2023-08-09T12:51:38.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dd7cf640 1 --2- 172.21.15.17:0/4196022994 >> v2:172.21.15.142:3300/0 conn(0x7f94d80b3b40 0x7f94d80b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118468795 0 0) 0x7f94c4003520 con 0x7f94d80adc40 2023-08-09T12:51:38.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 >> v2:172.21.15.142:3300/0 conn(0x7f94d80b3b40 msgr2=0x7f94d80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:38.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 --2- 172.21.15.17:0/4196022994 >> v2:172.21.15.142:3300/0 conn(0x7f94d80b3b40 0x7f94d80b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 >> v1:172.21.15.142:6789/0 conn(0x7f94d80cc630 legacy=0x7f94d80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80b2530 con 0x7f94d80adc40 2023-08-09T12:51:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f94d4001670 con 0x7f94d80adc40 2023-08-09T12:51:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 >> v1:172.21.15.17:6789/0 conn(0x7f94d80adc40 legacy=0x7f94d806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c4003970 0x7f94c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c40047c0 0x7f94c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80ae020 con 0x7f94c4005180 2023-08-09T12:51:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c400c0d0 con 0x7f94c4003970 2023-08-09T12:51:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.113+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c400c290 con 0x7f94c40047c0 2023-08-09T12:51:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94de7d1640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94ddfd0640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c4003970 0x7f94c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94dd7cf640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c40047c0 0x7f94c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94de7d1640 1 -- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c40047c0 msgr2=0x7f94c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94de7d1640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c40047c0 0x7f94c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94de7d1640 1 -- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c4003970 msgr2=0x7f94c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94de7d1640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c4003970 0x7f94c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94de7d1640 1 -- 172.21.15.17:0/4196022994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4003520 con 0x7f94c4005180 2023-08-09T12:51:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.114+0000 7f94ddfd0640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c4003970 0x7f94c4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:38.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.115+0000 7f94de7d1640 1 -- 172.21.15.17:0/4196022994 reap_dead start 2023-08-09T12:51:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.115+0000 7f94de7d1640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94c400b980 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f94d0001e50 tx=0x7f94c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653802226b49f58b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0003b70 con 0x7f94c4005180 2023-08-09T12:51:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0003cf0 con 0x7f94c4005180 2023-08-09T12:51:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94dcfce640 1 -- 172.21.15.17:0/4196022994 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0005310 con 0x7f94c4005180 2023-08-09T12:51:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94e0234640 1 -- 172.21.15.17:0/4196022994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 msgr2=0x7f94c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94e0234640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94c400b980 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f94d0001e50 tx=0x7f94c40057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94e0234640 1 -- 172.21.15.17:0/4196022994 shutdown_connections 2023-08-09T12:51:38.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94e0234640 1 --2- 172.21.15.17:0/4196022994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94c400b980 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94e0234640 1 -- 172.21.15.17:0/4196022994 >> 172.21.15.17:0/4196022994 conn(0x7f94d80cb1b0 msgr2=0x7f94d80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:38.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94e0234640 1 -- 172.21.15.17:0/4196022994 shutdown_connections 2023-08-09T12:51:38.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.116+0000 7f94e0234640 1 -- 172.21.15.17:0/4196022994 wait complete. 2023-08-09T12:51:38.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.118+0000 7f94e0234640 1 Processor -- start 2023-08-09T12:51:38.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.118+0000 7f94e0234640 1 -- start start 2023-08-09T12:51:38.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.119+0000 7f94e0234640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94d80c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.119+0000 7f94e0234640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d8153fc0 0x7f94d81523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.119+0000 7f94e0234640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d81528f0 0x7f94d815b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.119+0000 7f94e0234640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8153ba0 con 0x7f94c4005180 2023-08-09T12:51:38.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.119+0000 7f94e0234640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8152f20 con 0x7f94d81528f0 2023-08-09T12:51:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.119+0000 7f94e0234640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8153200 con 0x7f94d8153fc0 2023-08-09T12:51:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94d80c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94d80c1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48450/0 (socket says 172.21.15.17:48450) 2023-08-09T12:51:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 -- 172.21.15.17:0/4262879900 learned_addr learned my addr 172.21.15.17:0/4262879900 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94dd7cf640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d8153fc0 0x7f94d81523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 -- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d8153fc0 msgr2=0x7f94d81523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d8153fc0 0x7f94d81523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 -- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d81528f0 msgr2=0x7f94d815b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d81528f0 0x7f94d815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 -- 172.21.15.17:0/4262879900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d81534e0 con 0x7f94c4005180 2023-08-09T12:51:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.120+0000 7f94ddfd0640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94d80c1b00 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f94d4001200 tx=0x7f94d400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.121+0000 7f94ce7fc640 1 -- 172.21.15.17:0/4262879900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d400ee00 con 0x7f94c4005180 2023-08-09T12:51:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.121+0000 7f94ce7fc640 1 -- 172.21.15.17:0/4262879900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d400c8a0 con 0x7f94c4005180 2023-08-09T12:51:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.121+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d81537c0 con 0x7f94c4005180 2023-08-09T12:51:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.121+0000 7f94ce7fc640 1 -- 172.21.15.17:0/4262879900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d400cc10 con 0x7f94c4005180 2023-08-09T12:51:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.121+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d815b840 con 0x7f94c4005180 2023-08-09T12:51:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.122+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d80c2040 con 0x7f94c4005180 2023-08-09T12:51:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.123+0000 7f94ce7fc640 1 -- 172.21.15.17:0/4262879900 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f94d401d460 con 0x7f94c4005180 2023-08-09T12:51:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.124+0000 7f94ce7fc640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94bc06a080 0x7f94bc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.124+0000 7f94ce7fc640 1 -- 172.21.15.17:0/4262879900 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94d4088550 con 0x7f94c4005180 2023-08-09T12:51:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.125+0000 7f94dd7cf640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94bc06a080 0x7f94bc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.126+0000 7f94dd7cf640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94bc06a080 0x7f94bc06c540 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f94d806b8e0 tx=0x7f94c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.128+0000 7f94ce7fc640 1 -- 172.21.15.17:0/4262879900 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f94d4053ba0 con 0x7f94c4005180 2023-08-09T12:51:38.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.316+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94d8153370 con 0x7f94bc06a080 2023-08-09T12:51:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.339+0000 7f94ce7fc640 1 -- 172.21.15.17:0/4262879900 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294901 (secure 0 0 0) 0x7f94d8153370 con 0x7f94bc06a080 2023-08-09T12:51:38.346 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:51:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94bc06a080 msgr2=0x7f94bc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94bc06a080 0x7f94bc06c540 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f94d806b8e0 tx=0x7f94c8008040 comp rx=0 tx=0).stop 2023-08-09T12:51:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 msgr2=0x7f94d80c1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94d80c1b00 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f94d4001200 tx=0x7f94d400ec10 comp rx=0 tx=0).stop 2023-08-09T12:51:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 shutdown_connections 2023-08-09T12:51:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f94bc06a080 0x7f94bc06c540 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94d81528f0 0x7f94d815b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94d8153fc0 0x7f94d81523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 --2- 172.21.15.17:0/4262879900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94c4005180 0x7f94d80c1b00 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 >> 172.21.15.17:0/4262879900 conn(0x7f94d80cb1b0 msgr2=0x7f94d815d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 shutdown_connections 2023-08-09T12:51:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.345+0000 7f94e0234640 1 -- 172.21.15.17:0/4262879900 wait complete. 2023-08-09T12:51:38.370 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2023-08-09T12:51:36.917488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9180,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553319,"statfs":{"total":1600000000,"available":1590599072,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.090825"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867951+0000","last_change":"2023-08-09T12:51:33.892059+0000","last_active":"2023-08-09T12:51:34.867951+0000","last_peered":"2023-08-09T12:51:34.867951+0000","last_clean":"2023-08-09T12:51:34.867951+0000","last_became_active":"2023-08-09T12:51:33.891669+0000","last_became_peered":"2023-08-09T12:51:33.891669+0000","last_unstale":"2023-08-09T12:51:34.867951+0000","last_undegraded":"2023-08-09T12:51:34.867951+0000","last_fullsized":"2023-08-09T12:51:34.867951+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:57:15.133730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868200+0000","last_change":"2023-08-09T12:51:33.883993+0000","last_active":"2023-08-09T12:51:34.868200+0000","last_peered":"2023-08-09T12:51:34.868200+0000","last_clean":"2023-08-09T12:51:34.868200+0000","last_became_active":"2023-08-09T12:51:33.883575+0000","last_became_peered":"2023-08-09T12:51:33.883575+0000","last_unstale":"2023-08-09T12:51:34.868200+0000","last_undegraded":"2023-08-09T12:51:34.868200+0000","last_fullsized":"2023-08-09T12:51:34.868200+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:15.482835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868292+0000","last_change":"2023-08-09T12:51:33.892666+0000","last_active":"2023-08-09T12:51:34.868292+0000","last_peered":"2023-08-09T12:51:34.868292+0000","last_clean":"2023-08-09T12:51:34.868292+0000","last_became_active":"2023-08-09T12:51:33.892278+0000","last_became_peered":"2023-08-09T12:51:33.892278+0000","last_unstale":"2023-08-09T12:51:34.868292+0000","last_undegraded":"2023-08-09T12:51:34.868292+0000","last_fullsized":"2023-08-09T12:51:34.868292+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:43:27.271570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274226+0000","last_change":"2023-08-09T12:51:33.884956+0000","last_active":"2023-08-09T12:51:35.274226+0000","last_peered":"2023-08-09T12:51:35.274226+0000","last_clean":"2023-08-09T12:51:35.274226+0000","last_became_active":"2023-08-09T12:51:33.884406+0000","last_became_peered":"2023-08-09T12:51:33.884406+0000","last_unstale":"2023-08-09T12:51:35.274226+0000","last_undegraded":"2023-08-09T12:51:35.274226+0000","last_fullsized":"2023-08-09T12:51:35.274226+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:02.208478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868136+0000","last_change":"2023-08-09T12:51:33.881948+0000","last_active":"2023-08-09T12:51:34.868136+0000","last_peered":"2023-08-09T12:51:34.868136+0000","last_clean":"2023-08-09T12:51:34.868136+0000","last_became_active":"2023-08-09T12:51:33.881674+0000","last_became_peered":"2023-08-09T12:51:33.881674+0000","last_unstale":"2023-08-09T12:51:34.868136+0000","last_undegraded":"2023-08-09T12:51:34.868136+0000","last_fullsized":"2023-08-09T12:51:34.868136+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:19:26.933566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.840367+0000","last_change":"2023-08-09T12:51:31.840367+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.840367+0000","last_undegraded":"2023-08-09T12:51:31.840367+0000","last_fullsized":"2023-08-09T12:51:31.840367+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868482+0000","last_change":"2023-08-09T12:51:33.892503+0000","last_active":"2023-08-09T12:51:34.868482+0000","last_peered":"2023-08-09T12:51:34.868482+0000","last_clean":"2023-08-09T12:51:34.868482+0000","last_became_active":"2023-08-09T12:51:33.891683+0000","last_became_peered":"2023-08-09T12:51:33.891683+0000","last_unstale":"2023-08-09T12:51:34.868482+0000","last_undegraded":"2023-08-09T12:51:34.868482+0000","last_fullsized":"2023-08-09T12:51:34.868482+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:16.024680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.834178+0000","last_change":"2023-08-09T12:51:31.834178+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.834178+0000","last_undegraded":"2023-08-09T12:51:31.834178+0000","last_fullsized":"2023-08-09T12:51:31.834178+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.833505+0000","last_change":"2023-08-09T12:51:31.833505+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.833505+0000","last_undegraded":"2023-08-09T12:51:31.833505+0000","last_fullsized":"2023-08-09T12:51:31.833505+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868335+0000","last_change":"2023-08-09T12:51:32.855138+0000","last_active":"2023-08-09T12:51:34.868335+0000","last_peered":"2023-08-09T12:51:34.868335+0000","last_clean":"2023-08-09T12:51:34.868335+0000","last_became_active":"2023-08-09T12:51:32.854680+0000","last_became_peered":"2023-08-09T12:51:32.854680+0000","last_unstale":"2023-08-09T12:51:34.868335+0000","last_undegraded":"2023-08-09T12:51:34.868335+0000","last_fullsized":"2023-08-09T12:51:34.868335+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:01:02.364600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273802+0000","last_change":"2023-08-09T12:51:33.885141+0000","last_active":"2023-08-09T12:51:35.273802+0000","last_peered":"2023-08-09T12:51:35.273802+0000","last_clean":"2023-08-09T12:51:35.273802+0000","last_became_active":"2023-08-09T12:51:33.884727+0000","last_became_peered":"2023-08-09T12:51:33.884727+0000","last_unstale":"2023-08-09T12:51:35.273802+0000","last_undegraded":"2023-08-09T12:51:35.273802+0000","last_fullsized":"2023-08-09T12:51:35.273802+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:59.574268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.834695+0000","last_change":"2023-08-09T12:51:31.834695+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.834695+0000","last_undegraded":"2023-08-09T12:51:31.834695+0000","last_fullsized":"2023-08-09T12:51:31.834695+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.839872+0000","last_change":"2023-08-09T12:51:31.839872+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.839872+0000","last_undegraded":"2023-08-09T12:51:31.839872+0000","last_fullsized":"2023-08-09T12:51:31.839872+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867863+0000","last_change":"2023-08-09T12:51:33.883822+0000","last_active":"2023-08-09T12:51:34.867863+0000","last_peered":"2023-08-09T12:51:34.867863+0000","last_clean":"2023-08-09T12:51:34.867863+0000","last_became_active":"2023-08-09T12:51:33.883219+0000","last_became_peered":"2023-08-09T12:51:33.883219+0000","last_unstale":"2023-08-09T12:51:34.867863+0000","last_undegraded":"2023-08-09T12:51:34.867863+0000","last_fullsized":"2023-08-09T12:51:34.867863+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:44.448229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828394+0000","last_change":"2023-08-09T12:51:31.828394+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828394+0000","last_undegraded":"2023-08-09T12:51:31.828394+0000","last_fullsized":"2023-08-09T12:51:31.828394+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.840735+0000","last_change":"2023-08-09T12:51:31.840735+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.840735+0000","last_undegraded":"2023-08-09T12:51:31.840735+0000","last_fullsized":"2023-08-09T12:51:31.840735+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.831862+0000","last_change":"2023-08-09T12:51:31.831862+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.831862+0000","last_undegraded":"2023-08-09T12:51:31.831862+0000","last_fullsized":"2023-08-09T12:51:31.831862+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.832510+0000","last_change":"2023-08-09T12:51:31.832510+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.832510+0000","last_undegraded":"2023-08-09T12:51:31.832510+0000","last_fullsized":"2023-08-09T12:51:31.832510+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868518+0000","last_change":"2023-08-09T12:51:32.855685+0000","last_active":"2023-08-09T12:51:34.868518+0000","last_peered":"2023-08-09T12:51:34.868518+0000","last_clean":"2023-08-09T12:51:34.868518+0000","last_became_active":"2023-08-09T12:51:32.855417+0000","last_became_peered":"2023-08-09T12:51:32.855417+0000","last_unstale":"2023-08-09T12:51:34.868518+0000","last_undegraded":"2023-08-09T12:51:34.868518+0000","last_fullsized":"2023-08-09T12:51:34.868518+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:19.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.829596+0000","last_change":"2023-08-09T12:51:31.829596+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.829596+0000","last_undegraded":"2023-08-09T12:51:31.829596+0000","last_fullsized":"2023-08-09T12:51:31.829596+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274043+0000","last_change":"2023-08-09T12:51:32.857424+0000","last_active":"2023-08-09T12:51:35.274043+0000","last_peered":"2023-08-09T12:51:35.274043+0000","last_clean":"2023-08-09T12:51:35.274043+0000","last_became_active":"2023-08-09T12:51:32.857037+0000","last_became_peered":"2023-08-09T12:51:32.857037+0000","last_unstale":"2023-08-09T12:51:35.274043+0000","last_undegraded":"2023-08-09T12:51:35.274043+0000","last_fullsized":"2023-08-09T12:51:35.274043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:28.628180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868727+0000","last_change":"2023-08-09T12:51:33.899302+0000","last_active":"2023-08-09T12:51:34.868727+0000","last_peered":"2023-08-09T12:51:34.868727+0000","last_clean":"2023-08-09T12:51:34.868727+0000","last_became_active":"2023-08-09T12:51:33.899079+0000","last_became_peered":"2023-08-09T12:51:33.899079+0000","last_unstale":"2023-08-09T12:51:34.868727+0000","last_undegraded":"2023-08-09T12:51:34.868727+0000","last_fullsized":"2023-08-09T12:51:34.868727+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:26:00.015430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.832612+0000","last_change":"2023-08-09T12:51:31.832612+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.832612+0000","last_undegraded":"2023-08-09T12:51:31.832612+0000","last_fullsized":"2023-08-09T12:51:31.832612+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273926+0000","last_change":"2023-08-09T12:51:32.858425+0000","last_active":"2023-08-09T12:51:35.273926+0000","last_peered":"2023-08-09T12:51:35.273926+0000","last_clean":"2023-08-09T12:51:35.273926+0000","last_became_active":"2023-08-09T12:51:32.858189+0000","last_became_peered":"2023-08-09T12:51:32.858189+0000","last_unstale":"2023-08-09T12:51:35.273926+0000","last_undegraded":"2023-08-09T12:51:35.273926+0000","last_fullsized":"2023-08-09T12:51:35.273926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:20.381398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868009+0000","last_change":"2023-08-09T12:51:33.892220+0000","last_active":"2023-08-09T12:51:34.868009+0000","last_peered":"2023-08-09T12:51:34.868009+0000","last_clean":"2023-08-09T12:51:34.868009+0000","last_became_active":"2023-08-09T12:51:33.891968+0000","last_became_peered":"2023-08-09T12:51:33.891968+0000","last_unstale":"2023-08-09T12:51:34.868009+0000","last_undegraded":"2023-08-09T12:51:34.868009+0000","last_fullsized":"2023-08-09T12:51:34.868009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:54.338548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.833669+0000","last_change":"2023-08-09T12:51:31.833669+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.833669+0000","last_undegraded":"2023-08-09T12:51:31.833669+0000","last_fullsized":"2023-08-09T12:51:31.833669+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828365+0000","last_change":"2023-08-09T12:51:31.828365+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828365+0000","last_undegraded":"2023-08-09T12:51:31.828365+0000","last_fullsized":"2023-08-09T12:51:31.828365+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.829865+0000","last_change":"2023-08-09T12:51:31.829865+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.829865+0000","last_undegraded":"2023-08-09T12:51:31.829865+0000","last_fullsized":"2023-08-09T12:51:31.829865+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867750+0000","last_change":"2023-08-09T12:51:32.851600+0000","last_active":"2023-08-09T12:51:34.867750+0000","last_peered":"2023-08-09T12:51:34.867750+0000","last_clean":"2023-08-09T12:51:34.867750+0000","last_became_active":"2023-08-09T12:51:32.850913+0000","last_became_peered":"2023-08-09T12:51:32.850913+0000","last_unstale":"2023-08-09T12:51:34.867750+0000","last_undegraded":"2023-08-09T12:51:34.867750+0000","last_fullsized":"2023-08-09T12:51:34.867750+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:11:04.736611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.839982+0000","last_change":"2023-08-09T12:51:31.839982+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.839982+0000","last_undegraded":"2023-08-09T12:51:31.839982+0000","last_fullsized":"2023-08-09T12:51:31.839982+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828829+0000","last_change":"2023-08-09T12:51:31.828829+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828829+0000","last_undegraded":"2023-08-09T12:51:31.828829+0000","last_fullsized":"2023-08-09T12:51:31.828829+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.831863+0000","last_change":"2023-08-09T12:51:31.831863+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.831863+0000","last_undegraded":"2023-08-09T12:51:31.831863+0000","last_fullsized":"2023-08-09T12:51:31.831863+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868424+0000","last_change":"2023-08-09T12:51:33.897414+0000","last_active":"2023-08-09T12:51:34.868424+0000","last_peered":"2023-08-09T12:51:34.868424+0000","last_clean":"2023-08-09T12:51:34.868424+0000","last_became_active":"2023-08-09T12:51:33.897139+0000","last_became_peered":"2023-08-09T12:51:33.897139+0000","last_unstale":"2023-08-09T12:51:34.868424+0000","last_undegraded":"2023-08-09T12:51:34.868424+0000","last_fullsized":"2023-08-09T12:51:34.868424+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:21:16.180788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828545+0000","last_change":"2023-08-09T12:51:31.828545+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828545+0000","last_undegraded":"2023-08-09T12:51:31.828545+0000","last_fullsized":"2023-08-09T12:51:31.828545+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.833292+0000","last_change":"2023-08-09T12:51:31.833292+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.833292+0000","last_undegraded":"2023-08-09T12:51:31.833292+0000","last_fullsized":"2023-08-09T12:51:31.833292+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"174'6","reported_seq":19,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273350+0000","last_change":"2023-08-09T12:51:32.850475+0000","last_active":"2023-08-09T12:51:35.273350+0000","last_peered":"2023-08-09T12:51:35.273350+0000","last_clean":"2023-08-09T12:51:35.273350+0000","last_became_active":"2023-08-09T12:51:32.850029+0000","last_became_peered":"2023-08-09T12:51:32.850029+0000","last_unstale":"2023-08-09T12:51:35.273350+0000","last_undegraded":"2023-08-09T12:51:35.273350+0000","last_fullsized":"2023-08-09T12:51:35.273350+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:02:51.063192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":467,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.826267+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:51:31.826267+0000","last_peered":"2023-08-09T12:51:31.826267+0000","last_clean":"2023-08-09T12:51:31.826267+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:51:31.826267+0000","last_undegraded":"2023-08-09T12:51:31.826267+0000","last_fullsized":"2023-08-09T12:51:31.826267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:01:29.532132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":282,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.831575+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:51:31.831575+0000","last_peered":"2023-08-09T12:51:31.831575+0000","last_clean":"2023-08-09T12:51:31.831575+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:51:31.831575+0000","last_undegraded":"2023-08-09T12:51:31.831575+0000","last_fullsized":"2023-08-09T12:51:31.831575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:31:56.658620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.834394+0000","last_change":"2023-08-09T12:51:31.834394+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.834394+0000","last_undegraded":"2023-08-09T12:51:31.834394+0000","last_fullsized":"2023-08-09T12:51:31.834394+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":311,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.825927+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:51:31.825927+0000","last_peered":"2023-08-09T12:51:31.825927+0000","last_clean":"2023-08-09T12:51:31.825927+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:51:31.825927+0000","last_undegraded":"2023-08-09T12:51:31.825927+0000","last_fullsized":"2023-08-09T12:51:31.825927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:01.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828764+0000","last_change":"2023-08-09T12:51:31.828764+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828764+0000","last_undegraded":"2023-08-09T12:51:31.828764+0000","last_fullsized":"2023-08-09T12:51:31.828764+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.830657+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:51:31.830657+0000","last_peered":"2023-08-09T12:51:31.830657+0000","last_clean":"2023-08-09T12:51:31.830657+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:51:31.830657+0000","last_undegraded":"2023-08-09T12:51:31.830657+0000","last_fullsized":"2023-08-09T12:51:31.830657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:52.357147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.832129+0000","last_change":"2023-08-09T12:51:31.832129+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.832129+0000","last_undegraded":"2023-08-09T12:51:31.832129+0000","last_fullsized":"2023-08-09T12:51:31.832129+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":282,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.832306+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:51:31.832306+0000","last_peered":"2023-08-09T12:51:31.832306+0000","last_clean":"2023-08-09T12:51:31.832306+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:51:31.832306+0000","last_undegraded":"2023-08-09T12:51:31.832306+0000","last_fullsized":"2023-08-09T12:51:31.832306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:13.373749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.840401+0000","last_change":"2023-08-09T12:51:31.840401+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.840401+0000","last_undegraded":"2023-08-09T12:51:31.840401+0000","last_fullsized":"2023-08-09T12:51:31.840401+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868832+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:51:34.868832+0000","last_peered":"2023-08-09T12:51:34.868832+0000","last_clean":"2023-08-09T12:51:34.868832+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:51:34.868832+0000","last_undegraded":"2023-08-09T12:51:34.868832+0000","last_fullsized":"2023-08-09T12:51:34.868832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:14.836836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868225+0000","last_change":"2023-08-09T12:51:33.882724+0000","last_active":"2023-08-09T12:51:34.868225+0000","last_peered":"2023-08-09T12:51:34.868225+0000","last_clean":"2023-08-09T12:51:34.868225+0000","last_became_active":"2023-08-09T12:51:33.882489+0000","last_became_peered":"2023-08-09T12:51:33.882489+0000","last_unstale":"2023-08-09T12:51:34.868225+0000","last_undegraded":"2023-08-09T12:51:34.868225+0000","last_fullsized":"2023-08-09T12:51:34.868225+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:43.656090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828212+0000","last_change":"2023-08-09T12:51:31.828212+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828212+0000","last_undegraded":"2023-08-09T12:51:31.828212+0000","last_fullsized":"2023-08-09T12:51:31.828212+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":310,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.825594+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:51:31.825594+0000","last_peered":"2023-08-09T12:51:31.825594+0000","last_clean":"2023-08-09T12:51:31.825594+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:51:31.825594+0000","last_undegraded":"2023-08-09T12:51:31.825594+0000","last_fullsized":"2023-08-09T12:51:31.825594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:11:01.078194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.830501+0000","last_change":"2023-08-09T12:51:31.830501+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.830501+0000","last_undegraded":"2023-08-09T12:51:31.830501+0000","last_fullsized":"2023-08-09T12:51:31.830501+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868280+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:51:34.868280+0000","last_peered":"2023-08-09T12:51:34.868280+0000","last_clean":"2023-08-09T12:51:34.868280+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:51:34.868280+0000","last_undegraded":"2023-08-09T12:51:34.868280+0000","last_fullsized":"2023-08-09T12:51:34.868280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:47:16.871212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868617+0000","last_change":"2023-08-09T12:51:33.876711+0000","last_active":"2023-08-09T12:51:34.868617+0000","last_peered":"2023-08-09T12:51:34.868617+0000","last_clean":"2023-08-09T12:51:34.868617+0000","last_became_active":"2023-08-09T12:51:33.876457+0000","last_became_peered":"2023-08-09T12:51:33.876457+0000","last_unstale":"2023-08-09T12:51:34.868617+0000","last_undegraded":"2023-08-09T12:51:34.868617+0000","last_fullsized":"2023-08-09T12:51:34.868617+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:37:14.833669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.830752+0000","last_change":"2023-08-09T12:51:31.830752+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.830752+0000","last_undegraded":"2023-08-09T12:51:31.830752+0000","last_fullsized":"2023-08-09T12:51:31.830752+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":310,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.831055+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:51:31.831055+0000","last_peered":"2023-08-09T12:51:31.831055+0000","last_clean":"2023-08-09T12:51:31.831055+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:51:31.831055+0000","last_undegraded":"2023-08-09T12:51:31.831055+0000","last_fullsized":"2023-08-09T12:51:31.831055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:48:40.323579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1576,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385195,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1539999999999999,"15min":1.127},"min":{"1min":0.85599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.611},{"interface":"front","average":{"1min":1.228,"5min":1.1240000000000001,"15min":1.1100000000000001},"min":{"1min":0.873,"5min":0.70499999999999996,"15min":0.44500000000000001},"max":{"1min":1.575,"5min":1.7509999999999999,"15min":2.0459999999999998},"last":1.052}]},{"osd":1,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.173},"min":{"1min":1.032,"5min":0.628,"15min":0.628},"max":{"1min":1.6739999999999999,"5min":1.8069999999999999,"15min":2.0859999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.206,"15min":1.1599999999999999},"min":{"1min":0.95299999999999996,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.744,"5min":1.778,"15min":1.778},"last":0.97599999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.278,"15min":1.234},"min":{"1min":1.0880000000000001,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":1.78,"5min":1.804,"15min":2.1459999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.196},"min":{"1min":1.087,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.631,"5min":1.7450000000000001,"15min":2.173},"last":1.3400000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.2829999999999999},"min":{"1min":1.0089999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.806,"5min":1.806,"15min":3.4540000000000002},"last":1.381},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3360000000000001,"15min":1.3089999999999999},"min":{"1min":1.073,"5min":0.72699999999999998,"15min":0.61599999999999999},"max":{"1min":1.659,"5min":1.8460000000000001,"15min":2.282},"last":1.4379999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.272,"15min":1.23},"min":{"1min":0.83199999999999996,"5min":0.64500000000000002,"15min":0.48499999999999999},"max":{"1min":1.706,"5min":1.948,"15min":2.8769999999999998},"last":1.22},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.375,"15min":1.335},"min":{"1min":0.92700000000000005,"5min":0.67000000000000004,"15min":0.58599999999999997},"max":{"1min":1.7490000000000001,"5min":1.921,"15min":4.6200000000000001},"last":1.123}]},{"osd":5,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.4399999999999999,"15min":1.371},"min":{"1min":1.0920000000000001,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.8520000000000001,"5min":1.978,"15min":2.802},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.51},"min":{"1min":1.2030000000000001,"5min":0.86499999999999999,"15min":0.72299999999999998},"max":{"1min":1.8200000000000001,"5min":2.1299999999999999,"15min":3.3580000000000001},"last":1.5069999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":1.1950000000000001,"5min":0.71399999999999997,"15min":0.68400000000000005},"max":{"1min":1.8759999999999999,"5min":2.2370000000000001,"15min":3.4910000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.5249999999999999,"15min":1.4810000000000001},"min":{"1min":1.0449999999999999,"5min":0.74099999999999999,"15min":0.623},"max":{"1min":1.8560000000000001,"5min":1.998,"15min":2.4039999999999999},"last":1.8680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981733,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.093,"15min":1.133},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.56399999999999995},"max":{"1min":1.3180000000000001,"5min":1.573,"15min":2.54},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.155,"15min":1.109},"min":{"1min":0.83199999999999996,"5min":0.64400000000000002,"15min":0.54000000000000004},"max":{"1min":1.577,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.83199999999999996}]},{"osd":1,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.2769999999999999,"15min":1.258},"min":{"1min":0.97799999999999998,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.655,"5min":1.996,"15min":2.306},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":1.075,"5min":0.79100000000000004,"15min":0.76800000000000002},"max":{"1min":1.5980000000000001,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":1.1950000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.179,"15min":1.151},"min":{"1min":0.89600000000000002,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.587,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.405},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3009999999999999,"15min":1.296},"min":{"1min":0.86799999999999999,"5min":0.69699999999999995,"15min":0.66300000000000003},"max":{"1min":1.7170000000000001,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.2350000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":0.94699999999999995,"5min":0.79500000000000004,"15min":0.67600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":2.327},"last":1.089},{"interface":"front","average":{"1min":1.448,"5min":1.3520000000000001,"15min":1.3380000000000001},"min":{"1min":1.125,"5min":0.81799999999999995,"15min":0.74099999999999999},"max":{"1min":1.7789999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.677}]},{"osd":4,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.337,"15min":1.367},"min":{"1min":1.1140000000000001,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.821,"5min":1.8620000000000001,"15min":11.058999999999999},"last":1.821},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.377,"15min":1.367},"min":{"1min":1.0349999999999999,"5min":0.85399999999999998,"15min":0.57399999999999995},"max":{"1min":1.911,"5min":1.911,"15min":2.3479999999999999},"last":1.3320000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":1.018,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.96,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.4950000000000001,"15min":1.5049999999999999},"min":{"1min":1.232,"5min":0.95599999999999996,"15min":0.81899999999999995},"max":{"1min":1.929,"5min":1.986,"15min":2.8580000000000001},"last":1.73}]},{"osd":7,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.5369999999999999,"15min":1.508},"min":{"1min":1.4199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.7999999999999998},"last":1.633},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.5029999999999999,"15min":1.4990000000000001},"min":{"1min":1.0469999999999999,"5min":0.98699999999999999,"15min":0.74399999999999999},"max":{"1min":2.1280000000000001,"5min":2.7810000000000001,"15min":3.621},"last":1.786}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194312,"statfs":{"total":200000000,"available":198975563,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.0880000000000001,"15min":1.109},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.4590000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.1830000000000001,"15min":1.1399999999999999},"min":{"1min":0.68999999999999995,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.6439999999999999,"5min":1.97,"15min":2.0600000000000001},"last":1.0549999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3620000000000001,"15min":1.3300000000000001},"min":{"1min":0.98299999999999998,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.7410000000000001,"5min":1.851,"15min":2.6579999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.353,"5min":1.3069999999999999,"15min":1.2749999999999999},"min":{"1min":0.98699999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7669999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":2.262}]},{"osd":2,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2689999999999999,"15min":1.234},"min":{"1min":0.76800000000000002,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":1.7629999999999999,"5min":2.194,"15min":2.3039999999999998},"last":2.4700000000000002},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2669999999999999,"15min":1.224},"min":{"1min":0.97999999999999998,"5min":0.76300000000000001,"15min":0.67000000000000004},"max":{"1min":1.6870000000000001,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.5569999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3120000000000001,"15min":1.264},"min":{"1min":1.0900000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.712,"5min":1.7829999999999999,"15min":2.2330000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.355,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.93600000000000005,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":1.696,"5min":2.3319999999999999,"15min":2.6659999999999999},"last":2.6600000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3140000000000001,"15min":1.2669999999999999},"min":{"1min":0.83199999999999996,"5min":0.71299999999999997,"15min":0.60699999999999998},"max":{"1min":1.5820000000000001,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":2.169},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.444,"15min":1.395},"min":{"1min":0.93400000000000005,"5min":0.80600000000000005,"15min":0.628},"max":{"1min":1.8360000000000001,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":2.21}]},{"osd":6,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.4419999999999999,"15min":1.381},"min":{"1min":1.034,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.9470000000000001,"5min":2.952,"15min":2.952},"last":2.7719999999999998},{"interface":"front","average":{"1min":1.444,"5min":1.51,"15min":1.486},"min":{"1min":1.1140000000000001,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.8120000000000001,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.657}]},{"osd":7,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5700000000000001,"15min":1.536},"min":{"1min":1.0780000000000001,"5min":0.86599999999999999,"15min":0.67200000000000004},"max":{"1min":1.8029999999999999,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":2.0600000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.613,"15min":1.5589999999999999},"min":{"1min":1.2549999999999999,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.879,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":2.8849999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194312,"statfs":{"total":200000000,"available":198975563,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.86299999999999999,"5min":0.64600000000000002,"15min":0.58799999999999997},"max":{"1min":1.5089999999999999,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.143,"15min":1.1259999999999999},"min":{"1min":0.877,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.673,"5min":1.673,"15min":3.4100000000000001},"last":1.373}]},{"osd":1,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.3149999999999999,"15min":1.3100000000000001},"min":{"1min":1.0069999999999999,"5min":0.77400000000000002,"15min":0.48899999999999999},"max":{"1min":1.738,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.298},{"interface":"front","average":{"1min":1.425,"5min":1.367,"15min":1.337},"min":{"1min":1.1299999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6990000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.042}]},{"osd":2,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.321},"min":{"1min":1.0089999999999999,"5min":0.70899999999999996,"15min":0.54900000000000004},"max":{"1min":1.6639999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3939999999999999,"15min":1.3400000000000001},"min":{"1min":0.91300000000000003,"5min":0.81499999999999995,"15min":0.67900000000000005},"max":{"1min":1.72,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.2410000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.258,"15min":1.2470000000000001},"min":{"1min":0.91600000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6559999999999999,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.365,"15min":1.3360000000000001},"min":{"1min":1.0089999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7490000000000001,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2010000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.367,"15min":1.361},"min":{"1min":0.88600000000000001,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.7809999999999999,"5min":3.137,"15min":3.137},"last":1.157},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3280000000000001,"15min":1.367},"min":{"1min":0.91800000000000004,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.6819999999999999,"5min":2.403,"15min":3.3620000000000001},"last":1.534}]},{"osd":6,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4139999999999999,"15min":1.4470000000000001},"min":{"1min":1.006,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.802,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.101},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.548,"15min":1.534},"min":{"1min":0.98399999999999999,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.8819999999999999,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.331}]},{"osd":7,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.4910000000000001,"15min":1.5169999999999999},"min":{"1min":1.226,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.7749999999999999,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.661},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.587,"15min":1.597},"min":{"1min":1.1020000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.851,"5min":2.875,"15min":2.875},"last":1.514}]}]},{"osd":3,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981733,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.347,"5min":1.458,"15min":4.4109999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.077,"5min":1.006,"15min":0.96999999999999997},"min":{"1min":0.69299999999999995,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.5569999999999999,"5min":1.7170000000000001,"15min":3.2269999999999999},"last":0.80500000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.76800000000000002,"5min":0.44400000000000001,"15min":0.38100000000000001},"max":{"1min":1.302,"5min":1.4930000000000001,"15min":2.1280000000000001},"last":1.258},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1200000000000001,"15min":1.036},"min":{"1min":0.86099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5760000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.98499999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1299999999999999,"15min":1.159},"min":{"1min":0.93400000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.677,"5min":1.9259999999999999,"15min":18.145},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2450000000000001,"15min":1.224},"min":{"1min":1.0469999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.645,"5min":1.976,"15min":2.169},"last":1.1240000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2450000000000001,"15min":1.3009999999999999},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.745},"max":{"1min":1.7569999999999999,"5min":1.7709999999999999,"15min":3.5110000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.52,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":1.1619999999999999,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.466}]},{"osd":5,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.3999999999999999,"15min":1.4510000000000001},"min":{"1min":1.1379999999999999,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":2.25,"5min":2.25,"15min":18.094000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4079999999999999,"15min":1.4159999999999999},"min":{"1min":1.0760000000000001,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.9419999999999999,"5min":2.1219999999999999,"15min":14.105},"last":1.4430000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.393,"15min":1.373},"min":{"1min":0.96399999999999997,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.865,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.548},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.4690000000000001,"15min":1.4750000000000001},"min":{"1min":1.264,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":4.0220000000000002},"last":1.331}]},{"osd":7,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.5189999999999999,"15min":1.456},"min":{"1min":1.3169999999999999,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":2.109,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.512},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5169999999999999,"15min":1.4430000000000001},"min":{"1min":1.0760000000000001,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":2.0630000000000002,"5min":2.2629999999999999,"15min":3.016},"last":1.667}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981733,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.68500000000000005,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":1.5449999999999999,"5min":1.673,"15min":1.716},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.306,"5min":1.6970000000000001,"15min":2.9009999999999998},"last":0.81499999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90600000000000003,"15min":0.92300000000000004},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.099,"15min":1.069},"min":{"1min":0.77400000000000002,"5min":0.48799999999999999,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.004}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1559999999999999},"min":{"1min":0.85999999999999999,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.655,"5min":1.794,"15min":3.2850000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.2549999999999999,"15min":1.1990000000000001},"min":{"1min":0.92500000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"max":{"1min":1.7629999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":1.135}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.452,"15min":1.4370000000000001},"min":{"1min":1.135,"5min":0.88800000000000001,"15min":0.81899999999999995},"max":{"1min":1.8049999999999999,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.379,"15min":1.3360000000000001},"min":{"1min":0.93700000000000006,"5min":0.77300000000000002,"15min":0.66800000000000004},"max":{"1min":1.8160000000000001,"5min":1.974,"15min":3.4500000000000002},"last":1.3859999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.417,"15min":1.3979999999999999},"min":{"1min":1.012,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.95,"5min":2.0110000000000001,"15min":5.0140000000000002},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.5309999999999999,"15min":1.4970000000000001},"min":{"1min":1.3420000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8340000000000001,"5min":2.133,"15min":4.806},"last":1.413}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4019999999999999,"15min":1.359},"min":{"1min":1.0700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.976,"5min":1.976,"15min":2.5179999999999998},"last":1.619},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.492,"15min":1.4570000000000001},"min":{"1min":1.089,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9079999999999999,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.9079999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.456,"15min":1.4139999999999999},"min":{"1min":0.98399999999999999,"5min":0.80300000000000005,"15min":0.76200000000000001},"max":{"1min":1.8919999999999999,"5min":2.1309999999999998,"15min":2.464},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.5569999999999999,"15min":1.5469999999999999},"min":{"1min":1.248,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0150000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.792}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.47299999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3460000000000001,"5min":1.6859999999999999,"15min":2.621},"last":0.874},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0209999999999999,"15min":1.3160000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.4790000000000001,"5min":1.778,"15min":88.254999999999995},"last":1.0780000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.006,"15min":0.98899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2689999999999999,"15min":1.226},"min":{"1min":0.626,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.5960000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2330000000000001,"15min":1.169},"min":{"1min":0.67300000000000004,"5min":0.436,"15min":0.436},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.363},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1100000000000001,"15min":1.071},"min":{"1min":0.66700000000000004,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.222}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2649999999999999,"15min":1.3320000000000001},"min":{"1min":0.86099999999999999,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":25.172000000000001},"last":1.276},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.401,"15min":1.3660000000000001},"min":{"1min":1.081,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.887,"5min":2.085,"15min":3.762},"last":1.49}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.387,"15min":1.45},"min":{"1min":0.80100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.7250000000000001,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3300000000000001,"15min":1.3200000000000001},"min":{"1min":0.876,"5min":0.81899999999999995,"15min":0.77900000000000003},"max":{"1min":1.8400000000000001,"5min":1.9079999999999999,"15min":3.762},"last":1.4139999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.5309999999999999,"15min":1.4910000000000001},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.524},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.4790000000000001,"15min":1.4359999999999999},"min":{"1min":0.91100000000000003,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.546,"15min":1.627},"min":{"1min":1.117,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.109,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.593,"15min":1.6399999999999999},"min":{"1min":0.92600000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2080000000000002,"5min":2.464,"15min":28.765000000000001},"last":1.462}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193713,"statfs":{"total":200000000,"available":198362468,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.204,"5min":1.6259999999999999,"15min":1.819},"last":0.871},{"interface":"front","average":{"1min":1.022,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.437,"5min":0.437,"15min":0.436},"max":{"1min":1.4990000000000001,"5min":1.661,"15min":6.1749999999999998},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.016},"min":{"1min":0.84499999999999997,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.373,"5min":1.6120000000000001,"15min":1.7669999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0609999999999999,"15min":1.0700000000000001},"min":{"1min":0.59499999999999997,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5289999999999999,"5min":1.5609999999999999,"15min":6.2549999999999999},"last":1.325}]},{"osd":3,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.016},"min":{"1min":0.63700000000000001,"5min":0.55300000000000005,"15min":0.45300000000000001},"max":{"1min":1.601,"5min":1.665,"15min":9.6069999999999993},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.244,"5min":1.2110000000000001,"15min":1.2030000000000001},"min":{"1min":0.69099999999999995,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.5620000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.351},"min":{"1min":0.88300000000000001,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.9630000000000001,"5min":2.1019999999999999,"15min":9.9629999999999992},"last":1.8640000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4039999999999999,"15min":1.3480000000000001},"min":{"1min":0.99199999999999999,"5min":0.85799999999999998,"15min":0.77900000000000003},"max":{"1min":1.7589999999999999,"5min":1.8560000000000001,"15min":1.879},"last":1.615}]},{"osd":5,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.349,"15min":1.347},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":1.6910000000000001,"5min":1.8200000000000001,"15min":10.004},"last":1.498},{"interface":"front","average":{"1min":1.423,"5min":1.46,"15min":1.421},"min":{"1min":0.92900000000000005,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.798,"5min":2.1419999999999999,"15min":2.161},"last":1.464}]},{"osd":6,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.45,"15min":1.4019999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7729999999999999,"5min":2.1230000000000002,"15min":6.4290000000000003},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.47,"15min":1.4630000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.782,"5min":2.117,"15min":9.9190000000000005},"last":1.641}]},{"osd":7,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.492},"min":{"1min":1.016,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8839999999999999,"5min":2.2160000000000002,"15min":18.114000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.5289999999999999,"15min":1.5129999999999999},"min":{"1min":0.84099999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":9.5640000000000001},"last":1.758}]}]}],"pool_statfs":[]}} 2023-08-09T12:51:38.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:51:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.643+0000 7f38ef7fd640 1 Processor -- start 2023-08-09T12:51:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.643+0000 7f38ef7fd640 1 -- start start 2023-08-09T12:51:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.645+0000 7f38ef7fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e80ad810 0x7f38e80b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.645+0000 7f38ef7fd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e80b4630 con 0x7f38e8159d80 2023-08-09T12:51:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.645+0000 7f38ef7fd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e80b3ab0 con 0x7f38e8070a90 2023-08-09T12:51:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.645+0000 7f38ef7fd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e815a160 con 0x7f38e80ad810 2023-08-09T12:51:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.645+0000 7f38ed599640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f38e8159d80 0x7f38e8070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48366/0 (socket says 172.21.15.17:48366) 2023-08-09T12:51:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.645+0000 7f38ed599640 1 -- 172.21.15.17:0/2851672669 learned_addr learned my addr 172.21.15.17:0/2851672669 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38edd9a640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e80ad810 0x7f38e80b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704352960 0 0) 0x7f38e80b4630 con 0x7f38e8159d80 2023-08-09T12:51:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d4003520 con 0x7f38e8159d80 2023-08-09T12:51:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3371155764 0 0) 0x7f38d4003520 con 0x7f38e8159d80 2023-08-09T12:51:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e80ad810 msgr2=0x7f38e80b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e80ad810 0x7f38e80b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 >> v1:172.21.15.142:6789/0 conn(0x7f38e8070a90 legacy=0x7f38e80c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80b3d90 con 0x7f38e8159d80 2023-08-09T12:51:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f38e4001670 con 0x7f38e8159d80 2023-08-09T12:51:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 >> v1:172.21.15.17:6789/0 conn(0x7f38e8159d80 legacy=0x7f38e8070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38d4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e80ad810 0x7f38d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38d4004d00 0x7f38d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e815a160 con 0x7f38d40039a0 2023-08-09T12:51:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d400b9b0 con 0x7f38d4004d00 2023-08-09T12:51:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.646+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d400dd80 con 0x7f38e80ad810 2023-08-09T12:51:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38ed599640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38d4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38ecd98640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e80ad810 0x7f38d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38ed599640 1 -- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e80ad810 msgr2=0x7f38d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38edd9a640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38d4004d00 0x7f38d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38ed599640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e80ad810 0x7f38d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38ed599640 1 -- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38d4004d00 msgr2=0x7f38d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38ed599640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38d4004d00 0x7f38d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38ed599640 1 -- 172.21.15.17:0/2851672669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4003520 con 0x7f38d40039a0 2023-08-09T12:51:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.647+0000 7f38edd9a640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38d4004d00 0x7f38d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.648+0000 7f38ed599640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38d4003d80 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c190 tx=0x7f38d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6cbd8f72708df2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4005ad0 con 0x7f38d40039a0 2023-08-09T12:51:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e4005c50 con 0x7f38d40039a0 2023-08-09T12:51:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38dffff640 1 -- 172.21.15.17:0/2851672669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e402c790 con 0x7f38d40039a0 2023-08-09T12:51:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38ef7fd640 1 -- 172.21.15.17:0/2851672669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 msgr2=0x7f38d4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38ef7fd640 1 --2- 172.21.15.17:0/2851672669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38d4003d80 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c190 tx=0x7f38d40057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38edd9a640 1 -- 172.21.15.17:0/2851672669 reap_dead start 2023-08-09T12:51:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38ef7fd640 1 -- 172.21.15.17:0/2851672669 shutdown_connections 2023-08-09T12:51:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38ef7fd640 1 -- 172.21.15.17:0/2851672669 >> 172.21.15.17:0/2851672669 conn(0x7f38e80cb1b0 msgr2=0x7f38e80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38ef7fd640 1 -- 172.21.15.17:0/2851672669 shutdown_connections 2023-08-09T12:51:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.649+0000 7f38ef7fd640 1 -- 172.21.15.17:0/2851672669 wait complete. 2023-08-09T12:51:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.651+0000 7f38ef7fd640 1 Processor -- start 2023-08-09T12:51:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.651+0000 7f38ef7fd640 1 -- start start 2023-08-09T12:51:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.652+0000 7f38ef7fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38e81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.652+0000 7f38ef7fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e815ca40 0x7f38e80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.652+0000 7f38ef7fd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e815cec0 0x7f38e80acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.652+0000 7f38ef7fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80af6e0 con 0x7f38d40039a0 2023-08-09T12:51:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.652+0000 7f38ef7fd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e815b070 con 0x7f38e815cec0 2023-08-09T12:51:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.652+0000 7f38ef7fd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e815b350 con 0x7f38e815ca40 2023-08-09T12:51:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ed599640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38e81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ed599640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38e81565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48456/0 (socket says 172.21.15.17:48456) 2023-08-09T12:51:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ed599640 1 -- 172.21.15.17:0/1690609683 learned_addr learned my addr 172.21.15.17:0/1690609683 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ecd98640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e815ca40 0x7f38e80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38edd9a640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e815cec0 0x7f38e80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ed599640 1 -- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e815ca40 msgr2=0x7f38e80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ed599640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e815ca40 0x7f38e80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ed599640 1 -- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e815cec0 msgr2=0x7f38e80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ed599640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e815cec0 0x7f38e80acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ed599640 1 -- 172.21.15.17:0/1690609683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e815b630 con 0x7f38d40039a0 2023-08-09T12:51:38.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38ecd98640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e815ca40 0x7f38e80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.653+0000 7f38edd9a640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e815cec0 0x7f38e80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.654+0000 7f38ed599640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38e81565b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c190 tx=0x7f38e4001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.654+0000 7f38ddffb640 1 -- 172.21.15.17:0/1690609683 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4039070 con 0x7f38d40039a0 2023-08-09T12:51:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.654+0000 7f38ddffb640 1 -- 172.21.15.17:0/1690609683 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e402cba0 con 0x7f38d40039a0 2023-08-09T12:51:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.654+0000 7f38ddffb640 1 -- 172.21.15.17:0/1690609683 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e403c040 con 0x7f38d40039a0 2023-08-09T12:51:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.654+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e8156af0 con 0x7f38d40039a0 2023-08-09T12:51:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.654+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e815acb0 con 0x7f38d40039a0 2023-08-09T12:51:38.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.655+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e80af540 con 0x7f38d40039a0 2023-08-09T12:51:38.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.656+0000 7f38ddffb640 1 -- 172.21.15.17:0/1690609683 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f38e4032070 con 0x7f38d40039a0 2023-08-09T12:51:38.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.657+0000 7f38ddffb640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38cc06a080 0x7f38cc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:38.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.657+0000 7f38ddffb640 1 -- 172.21.15.17:0/1690609683 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38e40a9880 con 0x7f38d40039a0 2023-08-09T12:51:38.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.658+0000 7f38ecd98640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38cc06a080 0x7f38cc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:38.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.659+0000 7f38ecd98640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38cc06a080 0x7f38cc06c540 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f38d8007fd0 tx=0x7f38d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:38.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.662+0000 7f38ddffb640 1 -- 172.21.15.17:0/1690609683 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f38e80af540 con 0x7f38d40039a0 2023-08-09T12:51:38.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.849+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38e80b4070 con 0x7f38cc06a080 2023-08-09T12:51:38.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.871+0000 7f38ddffb640 1 -- 172.21.15.17:0/1690609683 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294901 (secure 0 0 0) 0x7f38d800d050 con 0x7f38cc06a080 2023-08-09T12:51:38.876 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:38.882 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:51:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38cc06a080 msgr2=0x7f38cc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38cc06a080 0x7f38cc06c540 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f38d8007fd0 tx=0x7f38d8009040 comp rx=0 tx=0).stop 2023-08-09T12:51:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 msgr2=0x7f38e81565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38e81565b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c190 tx=0x7f38e4001980 comp rx=0 tx=0).stop 2023-08-09T12:51:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 shutdown_connections 2023-08-09T12:51:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38cc06a080 0x7f38cc06c540 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e815cec0 0x7f38e80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38e815ca40 0x7f38e80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 --2- 172.21.15.17:0/1690609683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38d40039a0 0x7f38e81565b0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.878+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 >> 172.21.15.17:0/1690609683 conn(0x7f38e80cb1b0 msgr2=0x7f38e8070380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.879+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 shutdown_connections 2023-08-09T12:51:38.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:38.879+0000 7f38ef7fd640 1 -- 172.21.15.17:0/1690609683 wait complete. 2023-08-09T12:51:38.904 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2023-08-09T12:51:36.917488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9180,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553319,"statfs":{"total":1600000000,"available":1590599072,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.090825"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867951+0000","last_change":"2023-08-09T12:51:33.892059+0000","last_active":"2023-08-09T12:51:34.867951+0000","last_peered":"2023-08-09T12:51:34.867951+0000","last_clean":"2023-08-09T12:51:34.867951+0000","last_became_active":"2023-08-09T12:51:33.891669+0000","last_became_peered":"2023-08-09T12:51:33.891669+0000","last_unstale":"2023-08-09T12:51:34.867951+0000","last_undegraded":"2023-08-09T12:51:34.867951+0000","last_fullsized":"2023-08-09T12:51:34.867951+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:57:15.133730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868200+0000","last_change":"2023-08-09T12:51:33.883993+0000","last_active":"2023-08-09T12:51:34.868200+0000","last_peered":"2023-08-09T12:51:34.868200+0000","last_clean":"2023-08-09T12:51:34.868200+0000","last_became_active":"2023-08-09T12:51:33.883575+0000","last_became_peered":"2023-08-09T12:51:33.883575+0000","last_unstale":"2023-08-09T12:51:34.868200+0000","last_undegraded":"2023-08-09T12:51:34.868200+0000","last_fullsized":"2023-08-09T12:51:34.868200+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:15.482835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868292+0000","last_change":"2023-08-09T12:51:33.892666+0000","last_active":"2023-08-09T12:51:34.868292+0000","last_peered":"2023-08-09T12:51:34.868292+0000","last_clean":"2023-08-09T12:51:34.868292+0000","last_became_active":"2023-08-09T12:51:33.892278+0000","last_became_peered":"2023-08-09T12:51:33.892278+0000","last_unstale":"2023-08-09T12:51:34.868292+0000","last_undegraded":"2023-08-09T12:51:34.868292+0000","last_fullsized":"2023-08-09T12:51:34.868292+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:43:27.271570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274226+0000","last_change":"2023-08-09T12:51:33.884956+0000","last_active":"2023-08-09T12:51:35.274226+0000","last_peered":"2023-08-09T12:51:35.274226+0000","last_clean":"2023-08-09T12:51:35.274226+0000","last_became_active":"2023-08-09T12:51:33.884406+0000","last_became_peered":"2023-08-09T12:51:33.884406+0000","last_unstale":"2023-08-09T12:51:35.274226+0000","last_undegraded":"2023-08-09T12:51:35.274226+0000","last_fullsized":"2023-08-09T12:51:35.274226+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:02.208478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868136+0000","last_change":"2023-08-09T12:51:33.881948+0000","last_active":"2023-08-09T12:51:34.868136+0000","last_peered":"2023-08-09T12:51:34.868136+0000","last_clean":"2023-08-09T12:51:34.868136+0000","last_became_active":"2023-08-09T12:51:33.881674+0000","last_became_peered":"2023-08-09T12:51:33.881674+0000","last_unstale":"2023-08-09T12:51:34.868136+0000","last_undegraded":"2023-08-09T12:51:34.868136+0000","last_fullsized":"2023-08-09T12:51:34.868136+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:19:26.933566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.840367+0000","last_change":"2023-08-09T12:51:31.840367+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.840367+0000","last_undegraded":"2023-08-09T12:51:31.840367+0000","last_fullsized":"2023-08-09T12:51:31.840367+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868482+0000","last_change":"2023-08-09T12:51:33.892503+0000","last_active":"2023-08-09T12:51:34.868482+0000","last_peered":"2023-08-09T12:51:34.868482+0000","last_clean":"2023-08-09T12:51:34.868482+0000","last_became_active":"2023-08-09T12:51:33.891683+0000","last_became_peered":"2023-08-09T12:51:33.891683+0000","last_unstale":"2023-08-09T12:51:34.868482+0000","last_undegraded":"2023-08-09T12:51:34.868482+0000","last_fullsized":"2023-08-09T12:51:34.868482+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:16.024680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.834178+0000","last_change":"2023-08-09T12:51:31.834178+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.834178+0000","last_undegraded":"2023-08-09T12:51:31.834178+0000","last_fullsized":"2023-08-09T12:51:31.834178+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.833505+0000","last_change":"2023-08-09T12:51:31.833505+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.833505+0000","last_undegraded":"2023-08-09T12:51:31.833505+0000","last_fullsized":"2023-08-09T12:51:31.833505+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868335+0000","last_change":"2023-08-09T12:51:32.855138+0000","last_active":"2023-08-09T12:51:34.868335+0000","last_peered":"2023-08-09T12:51:34.868335+0000","last_clean":"2023-08-09T12:51:34.868335+0000","last_became_active":"2023-08-09T12:51:32.854680+0000","last_became_peered":"2023-08-09T12:51:32.854680+0000","last_unstale":"2023-08-09T12:51:34.868335+0000","last_undegraded":"2023-08-09T12:51:34.868335+0000","last_fullsized":"2023-08-09T12:51:34.868335+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:01:02.364600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273802+0000","last_change":"2023-08-09T12:51:33.885141+0000","last_active":"2023-08-09T12:51:35.273802+0000","last_peered":"2023-08-09T12:51:35.273802+0000","last_clean":"2023-08-09T12:51:35.273802+0000","last_became_active":"2023-08-09T12:51:33.884727+0000","last_became_peered":"2023-08-09T12:51:33.884727+0000","last_unstale":"2023-08-09T12:51:35.273802+0000","last_undegraded":"2023-08-09T12:51:35.273802+0000","last_fullsized":"2023-08-09T12:51:35.273802+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:59.574268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.834695+0000","last_change":"2023-08-09T12:51:31.834695+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.834695+0000","last_undegraded":"2023-08-09T12:51:31.834695+0000","last_fullsized":"2023-08-09T12:51:31.834695+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.839872+0000","last_change":"2023-08-09T12:51:31.839872+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.839872+0000","last_undegraded":"2023-08-09T12:51:31.839872+0000","last_fullsized":"2023-08-09T12:51:31.839872+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867863+0000","last_change":"2023-08-09T12:51:33.883822+0000","last_active":"2023-08-09T12:51:34.867863+0000","last_peered":"2023-08-09T12:51:34.867863+0000","last_clean":"2023-08-09T12:51:34.867863+0000","last_became_active":"2023-08-09T12:51:33.883219+0000","last_became_peered":"2023-08-09T12:51:33.883219+0000","last_unstale":"2023-08-09T12:51:34.867863+0000","last_undegraded":"2023-08-09T12:51:34.867863+0000","last_fullsized":"2023-08-09T12:51:34.867863+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:44.448229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828394+0000","last_change":"2023-08-09T12:51:31.828394+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828394+0000","last_undegraded":"2023-08-09T12:51:31.828394+0000","last_fullsized":"2023-08-09T12:51:31.828394+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.840735+0000","last_change":"2023-08-09T12:51:31.840735+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.840735+0000","last_undegraded":"2023-08-09T12:51:31.840735+0000","last_fullsized":"2023-08-09T12:51:31.840735+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.831862+0000","last_change":"2023-08-09T12:51:31.831862+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.831862+0000","last_undegraded":"2023-08-09T12:51:31.831862+0000","last_fullsized":"2023-08-09T12:51:31.831862+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.832510+0000","last_change":"2023-08-09T12:51:31.832510+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.832510+0000","last_undegraded":"2023-08-09T12:51:31.832510+0000","last_fullsized":"2023-08-09T12:51:31.832510+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868518+0000","last_change":"2023-08-09T12:51:32.855685+0000","last_active":"2023-08-09T12:51:34.868518+0000","last_peered":"2023-08-09T12:51:34.868518+0000","last_clean":"2023-08-09T12:51:34.868518+0000","last_became_active":"2023-08-09T12:51:32.855417+0000","last_became_peered":"2023-08-09T12:51:32.855417+0000","last_unstale":"2023-08-09T12:51:34.868518+0000","last_undegraded":"2023-08-09T12:51:34.868518+0000","last_fullsized":"2023-08-09T12:51:34.868518+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:19.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.829596+0000","last_change":"2023-08-09T12:51:31.829596+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.829596+0000","last_undegraded":"2023-08-09T12:51:31.829596+0000","last_fullsized":"2023-08-09T12:51:31.829596+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274043+0000","last_change":"2023-08-09T12:51:32.857424+0000","last_active":"2023-08-09T12:51:35.274043+0000","last_peered":"2023-08-09T12:51:35.274043+0000","last_clean":"2023-08-09T12:51:35.274043+0000","last_became_active":"2023-08-09T12:51:32.857037+0000","last_became_peered":"2023-08-09T12:51:32.857037+0000","last_unstale":"2023-08-09T12:51:35.274043+0000","last_undegraded":"2023-08-09T12:51:35.274043+0000","last_fullsized":"2023-08-09T12:51:35.274043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:28.628180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868727+0000","last_change":"2023-08-09T12:51:33.899302+0000","last_active":"2023-08-09T12:51:34.868727+0000","last_peered":"2023-08-09T12:51:34.868727+0000","last_clean":"2023-08-09T12:51:34.868727+0000","last_became_active":"2023-08-09T12:51:33.899079+0000","last_became_peered":"2023-08-09T12:51:33.899079+0000","last_unstale":"2023-08-09T12:51:34.868727+0000","last_undegraded":"2023-08-09T12:51:34.868727+0000","last_fullsized":"2023-08-09T12:51:34.868727+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:26:00.015430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.832612+0000","last_change":"2023-08-09T12:51:31.832612+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.832612+0000","last_undegraded":"2023-08-09T12:51:31.832612+0000","last_fullsized":"2023-08-09T12:51:31.832612+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273926+0000","last_change":"2023-08-09T12:51:32.858425+0000","last_active":"2023-08-09T12:51:35.273926+0000","last_peered":"2023-08-09T12:51:35.273926+0000","last_clean":"2023-08-09T12:51:35.273926+0000","last_became_active":"2023-08-09T12:51:32.858189+0000","last_became_peered":"2023-08-09T12:51:32.858189+0000","last_unstale":"2023-08-09T12:51:35.273926+0000","last_undegraded":"2023-08-09T12:51:35.273926+0000","last_fullsized":"2023-08-09T12:51:35.273926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:20.381398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868009+0000","last_change":"2023-08-09T12:51:33.892220+0000","last_active":"2023-08-09T12:51:34.868009+0000","last_peered":"2023-08-09T12:51:34.868009+0000","last_clean":"2023-08-09T12:51:34.868009+0000","last_became_active":"2023-08-09T12:51:33.891968+0000","last_became_peered":"2023-08-09T12:51:33.891968+0000","last_unstale":"2023-08-09T12:51:34.868009+0000","last_undegraded":"2023-08-09T12:51:34.868009+0000","last_fullsized":"2023-08-09T12:51:34.868009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:54.338548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.833669+0000","last_change":"2023-08-09T12:51:31.833669+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.833669+0000","last_undegraded":"2023-08-09T12:51:31.833669+0000","last_fullsized":"2023-08-09T12:51:31.833669+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828365+0000","last_change":"2023-08-09T12:51:31.828365+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828365+0000","last_undegraded":"2023-08-09T12:51:31.828365+0000","last_fullsized":"2023-08-09T12:51:31.828365+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.829865+0000","last_change":"2023-08-09T12:51:31.829865+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.829865+0000","last_undegraded":"2023-08-09T12:51:31.829865+0000","last_fullsized":"2023-08-09T12:51:31.829865+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867750+0000","last_change":"2023-08-09T12:51:32.851600+0000","last_active":"2023-08-09T12:51:34.867750+0000","last_peered":"2023-08-09T12:51:34.867750+0000","last_clean":"2023-08-09T12:51:34.867750+0000","last_became_active":"2023-08-09T12:51:32.850913+0000","last_became_peered":"2023-08-09T12:51:32.850913+0000","last_unstale":"2023-08-09T12:51:34.867750+0000","last_undegraded":"2023-08-09T12:51:34.867750+0000","last_fullsized":"2023-08-09T12:51:34.867750+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:11:04.736611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.839982+0000","last_change":"2023-08-09T12:51:31.839982+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.839982+0000","last_undegraded":"2023-08-09T12:51:31.839982+0000","last_fullsized":"2023-08-09T12:51:31.839982+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828829+0000","last_change":"2023-08-09T12:51:31.828829+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828829+0000","last_undegraded":"2023-08-09T12:51:31.828829+0000","last_fullsized":"2023-08-09T12:51:31.828829+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.831863+0000","last_change":"2023-08-09T12:51:31.831863+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.831863+0000","last_undegraded":"2023-08-09T12:51:31.831863+0000","last_fullsized":"2023-08-09T12:51:31.831863+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868424+0000","last_change":"2023-08-09T12:51:33.897414+0000","last_active":"2023-08-09T12:51:34.868424+0000","last_peered":"2023-08-09T12:51:34.868424+0000","last_clean":"2023-08-09T12:51:34.868424+0000","last_became_active":"2023-08-09T12:51:33.897139+0000","last_became_peered":"2023-08-09T12:51:33.897139+0000","last_unstale":"2023-08-09T12:51:34.868424+0000","last_undegraded":"2023-08-09T12:51:34.868424+0000","last_fullsized":"2023-08-09T12:51:34.868424+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:21:16.180788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828545+0000","last_change":"2023-08-09T12:51:31.828545+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828545+0000","last_undegraded":"2023-08-09T12:51:31.828545+0000","last_fullsized":"2023-08-09T12:51:31.828545+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.833292+0000","last_change":"2023-08-09T12:51:31.833292+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.833292+0000","last_undegraded":"2023-08-09T12:51:31.833292+0000","last_fullsized":"2023-08-09T12:51:31.833292+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"174'6","reported_seq":19,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273350+0000","last_change":"2023-08-09T12:51:32.850475+0000","last_active":"2023-08-09T12:51:35.273350+0000","last_peered":"2023-08-09T12:51:35.273350+0000","last_clean":"2023-08-09T12:51:35.273350+0000","last_became_active":"2023-08-09T12:51:32.850029+0000","last_became_peered":"2023-08-09T12:51:32.850029+0000","last_unstale":"2023-08-09T12:51:35.273350+0000","last_undegraded":"2023-08-09T12:51:35.273350+0000","last_fullsized":"2023-08-09T12:51:35.273350+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:02:51.063192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":467,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.826267+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:51:31.826267+0000","last_peered":"2023-08-09T12:51:31.826267+0000","last_clean":"2023-08-09T12:51:31.826267+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:51:31.826267+0000","last_undegraded":"2023-08-09T12:51:31.826267+0000","last_fullsized":"2023-08-09T12:51:31.826267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:01:29.532132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":282,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.831575+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:51:31.831575+0000","last_peered":"2023-08-09T12:51:31.831575+0000","last_clean":"2023-08-09T12:51:31.831575+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:51:31.831575+0000","last_undegraded":"2023-08-09T12:51:31.831575+0000","last_fullsized":"2023-08-09T12:51:31.831575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:31:56.658620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.834394+0000","last_change":"2023-08-09T12:51:31.834394+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.834394+0000","last_undegraded":"2023-08-09T12:51:31.834394+0000","last_fullsized":"2023-08-09T12:51:31.834394+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":311,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.825927+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:51:31.825927+0000","last_peered":"2023-08-09T12:51:31.825927+0000","last_clean":"2023-08-09T12:51:31.825927+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:51:31.825927+0000","last_undegraded":"2023-08-09T12:51:31.825927+0000","last_fullsized":"2023-08-09T12:51:31.825927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:01.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828764+0000","last_change":"2023-08-09T12:51:31.828764+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828764+0000","last_undegraded":"2023-08-09T12:51:31.828764+0000","last_fullsized":"2023-08-09T12:51:31.828764+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.830657+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:51:31.830657+0000","last_peered":"2023-08-09T12:51:31.830657+0000","last_clean":"2023-08-09T12:51:31.830657+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:51:31.830657+0000","last_undegraded":"2023-08-09T12:51:31.830657+0000","last_fullsized":"2023-08-09T12:51:31.830657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:45:52.357147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.832129+0000","last_change":"2023-08-09T12:51:31.832129+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.832129+0000","last_undegraded":"2023-08-09T12:51:31.832129+0000","last_fullsized":"2023-08-09T12:51:31.832129+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":282,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.832306+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:51:31.832306+0000","last_peered":"2023-08-09T12:51:31.832306+0000","last_clean":"2023-08-09T12:51:31.832306+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:51:31.832306+0000","last_undegraded":"2023-08-09T12:51:31.832306+0000","last_fullsized":"2023-08-09T12:51:31.832306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:13.373749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.840401+0000","last_change":"2023-08-09T12:51:31.840401+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.840401+0000","last_undegraded":"2023-08-09T12:51:31.840401+0000","last_fullsized":"2023-08-09T12:51:31.840401+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868832+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:51:34.868832+0000","last_peered":"2023-08-09T12:51:34.868832+0000","last_clean":"2023-08-09T12:51:34.868832+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:51:34.868832+0000","last_undegraded":"2023-08-09T12:51:34.868832+0000","last_fullsized":"2023-08-09T12:51:34.868832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:14.836836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868225+0000","last_change":"2023-08-09T12:51:33.882724+0000","last_active":"2023-08-09T12:51:34.868225+0000","last_peered":"2023-08-09T12:51:34.868225+0000","last_clean":"2023-08-09T12:51:34.868225+0000","last_became_active":"2023-08-09T12:51:33.882489+0000","last_became_peered":"2023-08-09T12:51:33.882489+0000","last_unstale":"2023-08-09T12:51:34.868225+0000","last_undegraded":"2023-08-09T12:51:34.868225+0000","last_fullsized":"2023-08-09T12:51:34.868225+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:43.656090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.828212+0000","last_change":"2023-08-09T12:51:31.828212+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.828212+0000","last_undegraded":"2023-08-09T12:51:31.828212+0000","last_fullsized":"2023-08-09T12:51:31.828212+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":310,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.825594+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:51:31.825594+0000","last_peered":"2023-08-09T12:51:31.825594+0000","last_clean":"2023-08-09T12:51:31.825594+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:51:31.825594+0000","last_undegraded":"2023-08-09T12:51:31.825594+0000","last_fullsized":"2023-08-09T12:51:31.825594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:11:01.078194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-09T12:51:32.823497+0000","last_change":"2023-08-09T12:51:32.823497+0000","last_active":"2023-08-09T12:51:32.823497+0000","last_peered":"2023-08-09T12:51:32.823497+0000","last_clean":"2023-08-09T12:51:32.823497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:32.823497+0000","last_undegraded":"2023-08-09T12:51:32.823497+0000","last_fullsized":"2023-08-09T12:51:32.823497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.830501+0000","last_change":"2023-08-09T12:51:31.830501+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.830501+0000","last_undegraded":"2023-08-09T12:51:31.830501+0000","last_fullsized":"2023-08-09T12:51:31.830501+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868280+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:51:34.868280+0000","last_peered":"2023-08-09T12:51:34.868280+0000","last_clean":"2023-08-09T12:51:34.868280+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:51:34.868280+0000","last_undegraded":"2023-08-09T12:51:34.868280+0000","last_fullsized":"2023-08-09T12:51:34.868280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:47:16.871212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868617+0000","last_change":"2023-08-09T12:51:33.876711+0000","last_active":"2023-08-09T12:51:34.868617+0000","last_peered":"2023-08-09T12:51:34.868617+0000","last_clean":"2023-08-09T12:51:34.868617+0000","last_became_active":"2023-08-09T12:51:33.876457+0000","last_became_peered":"2023-08-09T12:51:33.876457+0000","last_unstale":"2023-08-09T12:51:34.868617+0000","last_undegraded":"2023-08-09T12:51:34.868617+0000","last_fullsized":"2023-08-09T12:51:34.868617+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:37:14.833669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-08-09T12:51:31.830752+0000","last_change":"2023-08-09T12:51:31.830752+0000","last_active":"2023-08-09T12:51:31.810204+0000","last_peered":"2023-08-09T12:51:31.810204+0000","last_clean":"2023-08-09T12:51:31.810204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-09T12:51:31.830752+0000","last_undegraded":"2023-08-09T12:51:31.830752+0000","last_fullsized":"2023-08-09T12:51:31.830752+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":310,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-08-09T12:51:31.831055+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:51:31.831055+0000","last_peered":"2023-08-09T12:51:31.831055+0000","last_clean":"2023-08-09T12:51:31.831055+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:51:31.831055+0000","last_undegraded":"2023-08-09T12:51:31.831055+0000","last_fullsized":"2023-08-09T12:51:31.831055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:48:40.323579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1576,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385195,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1539999999999999,"15min":1.127},"min":{"1min":0.85599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.611},{"interface":"front","average":{"1min":1.228,"5min":1.1240000000000001,"15min":1.1100000000000001},"min":{"1min":0.873,"5min":0.70499999999999996,"15min":0.44500000000000001},"max":{"1min":1.575,"5min":1.7509999999999999,"15min":2.0459999999999998},"last":1.052}]},{"osd":1,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.173},"min":{"1min":1.032,"5min":0.628,"15min":0.628},"max":{"1min":1.6739999999999999,"5min":1.8069999999999999,"15min":2.0859999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.206,"15min":1.1599999999999999},"min":{"1min":0.95299999999999996,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.744,"5min":1.778,"15min":1.778},"last":0.97599999999999998}]},{"osd":2,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.278,"15min":1.234},"min":{"1min":1.0880000000000001,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":1.78,"5min":1.804,"15min":2.1459999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.196},"min":{"1min":1.087,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.631,"5min":1.7450000000000001,"15min":2.173},"last":1.3400000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.2829999999999999},"min":{"1min":1.0089999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.806,"5min":1.806,"15min":3.4540000000000002},"last":1.381},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3360000000000001,"15min":1.3089999999999999},"min":{"1min":1.073,"5min":0.72699999999999998,"15min":0.61599999999999999},"max":{"1min":1.659,"5min":1.8460000000000001,"15min":2.282},"last":1.4379999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.272,"15min":1.23},"min":{"1min":0.83199999999999996,"5min":0.64500000000000002,"15min":0.48499999999999999},"max":{"1min":1.706,"5min":1.948,"15min":2.8769999999999998},"last":1.22},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.375,"15min":1.335},"min":{"1min":0.92700000000000005,"5min":0.67000000000000004,"15min":0.58599999999999997},"max":{"1min":1.7490000000000001,"5min":1.921,"15min":4.6200000000000001},"last":1.123}]},{"osd":5,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.4399999999999999,"15min":1.371},"min":{"1min":1.0920000000000001,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.8520000000000001,"5min":1.978,"15min":2.802},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.51},"min":{"1min":1.2030000000000001,"5min":0.86499999999999999,"15min":0.72299999999999998},"max":{"1min":1.8200000000000001,"5min":2.1299999999999999,"15min":3.3580000000000001},"last":1.5069999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.5109999999999999,"15min":1.4850000000000001},"min":{"1min":1.1950000000000001,"5min":0.71399999999999997,"15min":0.68400000000000005},"max":{"1min":1.8759999999999999,"5min":2.2370000000000001,"15min":3.4910000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.5249999999999999,"15min":1.4810000000000001},"min":{"1min":1.0449999999999999,"5min":0.74099999999999999,"15min":0.623},"max":{"1min":1.8560000000000001,"5min":1.998,"15min":2.4039999999999999},"last":1.8680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981733,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.093,"15min":1.133},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.56399999999999995},"max":{"1min":1.3180000000000001,"5min":1.573,"15min":2.54},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.155,"15min":1.109},"min":{"1min":0.83199999999999996,"5min":0.64400000000000002,"15min":0.54000000000000004},"max":{"1min":1.577,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.83199999999999996}]},{"osd":1,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.2769999999999999,"15min":1.258},"min":{"1min":0.97799999999999998,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.655,"5min":1.996,"15min":2.306},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":1.075,"5min":0.79100000000000004,"15min":0.76800000000000002},"max":{"1min":1.5980000000000001,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":1.1950000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.179,"15min":1.151},"min":{"1min":0.89600000000000002,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.587,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.405},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3009999999999999,"15min":1.296},"min":{"1min":0.86799999999999999,"5min":0.69699999999999995,"15min":0.66300000000000003},"max":{"1min":1.7170000000000001,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.2350000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":0.94699999999999995,"5min":0.79500000000000004,"15min":0.67600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":2.327},"last":1.089},{"interface":"front","average":{"1min":1.448,"5min":1.3520000000000001,"15min":1.3380000000000001},"min":{"1min":1.125,"5min":0.81799999999999995,"15min":0.74099999999999999},"max":{"1min":1.7789999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.677}]},{"osd":4,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.337,"15min":1.367},"min":{"1min":1.1140000000000001,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.821,"5min":1.8620000000000001,"15min":11.058999999999999},"last":1.821},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.377,"15min":1.367},"min":{"1min":1.0349999999999999,"5min":0.85399999999999998,"15min":0.57399999999999995},"max":{"1min":1.911,"5min":1.911,"15min":2.3479999999999999},"last":1.3320000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":1.018,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.96,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.613,"5min":1.4950000000000001,"15min":1.5049999999999999},"min":{"1min":1.232,"5min":0.95599999999999996,"15min":0.81899999999999995},"max":{"1min":1.929,"5min":1.986,"15min":2.8580000000000001},"last":1.73}]},{"osd":7,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.5369999999999999,"15min":1.508},"min":{"1min":1.4199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.7999999999999998},"last":1.633},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.5029999999999999,"15min":1.4990000000000001},"min":{"1min":1.0469999999999999,"5min":0.98699999999999999,"15min":0.74399999999999999},"max":{"1min":2.1280000000000001,"5min":2.7810000000000001,"15min":3.621},"last":1.786}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194312,"statfs":{"total":200000000,"available":198975563,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.0880000000000001,"15min":1.109},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.4590000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.1830000000000001,"15min":1.1399999999999999},"min":{"1min":0.68999999999999995,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.6439999999999999,"5min":1.97,"15min":2.0600000000000001},"last":1.0549999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.3620000000000001,"15min":1.3300000000000001},"min":{"1min":0.98299999999999998,"5min":0.64400000000000002,"15min":0.63800000000000001},"max":{"1min":1.7410000000000001,"5min":1.851,"15min":2.6579999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.353,"5min":1.3069999999999999,"15min":1.2749999999999999},"min":{"1min":0.98699999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7669999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":2.262}]},{"osd":2,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2689999999999999,"15min":1.234},"min":{"1min":0.76800000000000002,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":1.7629999999999999,"5min":2.194,"15min":2.3039999999999998},"last":2.4700000000000002},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2669999999999999,"15min":1.224},"min":{"1min":0.97999999999999998,"5min":0.76300000000000001,"15min":0.67000000000000004},"max":{"1min":1.6870000000000001,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.5569999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3120000000000001,"15min":1.264},"min":{"1min":1.0900000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.712,"5min":1.7829999999999999,"15min":2.2330000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.355,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.93600000000000005,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":1.696,"5min":2.3319999999999999,"15min":2.6659999999999999},"last":2.6600000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3140000000000001,"15min":1.2669999999999999},"min":{"1min":0.83199999999999996,"5min":0.71299999999999997,"15min":0.60699999999999998},"max":{"1min":1.5820000000000001,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":2.169},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.444,"15min":1.395},"min":{"1min":0.93400000000000005,"5min":0.80600000000000005,"15min":0.628},"max":{"1min":1.8360000000000001,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":2.21}]},{"osd":6,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.4419999999999999,"15min":1.381},"min":{"1min":1.034,"5min":0.63500000000000001,"15min":0.58099999999999996},"max":{"1min":1.9470000000000001,"5min":2.952,"15min":2.952},"last":2.7719999999999998},{"interface":"front","average":{"1min":1.444,"5min":1.51,"15min":1.486},"min":{"1min":1.1140000000000001,"5min":0.83999999999999997,"15min":0.51000000000000001},"max":{"1min":1.8120000000000001,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.657}]},{"osd":7,"last update":"Wed Aug 9 12:50:32 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.5700000000000001,"15min":1.536},"min":{"1min":1.0780000000000001,"5min":0.86599999999999999,"15min":0.67200000000000004},"max":{"1min":1.8029999999999999,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":2.0600000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.613,"15min":1.5589999999999999},"min":{"1min":1.2549999999999999,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.879,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":2.8849999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194312,"statfs":{"total":200000000,"available":198975563,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.86299999999999999,"5min":0.64600000000000002,"15min":0.58799999999999997},"max":{"1min":1.5089999999999999,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.143,"15min":1.1259999999999999},"min":{"1min":0.877,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.673,"5min":1.673,"15min":3.4100000000000001},"last":1.373}]},{"osd":1,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.3149999999999999,"15min":1.3100000000000001},"min":{"1min":1.0069999999999999,"5min":0.77400000000000002,"15min":0.48899999999999999},"max":{"1min":1.738,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.298},{"interface":"front","average":{"1min":1.425,"5min":1.367,"15min":1.337},"min":{"1min":1.1299999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6990000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.042}]},{"osd":2,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.321},"min":{"1min":1.0089999999999999,"5min":0.70899999999999996,"15min":0.54900000000000004},"max":{"1min":1.6639999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3939999999999999,"15min":1.3400000000000001},"min":{"1min":0.91300000000000003,"5min":0.81499999999999995,"15min":0.67900000000000005},"max":{"1min":1.72,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.2410000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.258,"15min":1.2470000000000001},"min":{"1min":0.91600000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6559999999999999,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.365,"15min":1.3360000000000001},"min":{"1min":1.0089999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7490000000000001,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2010000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.367,"15min":1.361},"min":{"1min":0.88600000000000001,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.7809999999999999,"5min":3.137,"15min":3.137},"last":1.157},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3280000000000001,"15min":1.367},"min":{"1min":0.91800000000000004,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.6819999999999999,"5min":2.403,"15min":3.3620000000000001},"last":1.534}]},{"osd":6,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4139999999999999,"15min":1.4470000000000001},"min":{"1min":1.006,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.802,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.101},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.548,"15min":1.534},"min":{"1min":0.98399999999999999,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.8819999999999999,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.331}]},{"osd":7,"last update":"Wed Aug 9 12:50:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.4910000000000001,"15min":1.5169999999999999},"min":{"1min":1.226,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.7749999999999999,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.661},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.587,"15min":1.597},"min":{"1min":1.1020000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.851,"5min":2.875,"15min":2.875},"last":1.514}]}]},{"osd":3,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981733,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.347,"5min":1.458,"15min":4.4109999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.077,"5min":1.006,"15min":0.96999999999999997},"min":{"1min":0.69299999999999995,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.5569999999999999,"5min":1.7170000000000001,"15min":3.2269999999999999},"last":0.80500000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.76800000000000002,"5min":0.44400000000000001,"15min":0.38100000000000001},"max":{"1min":1.302,"5min":1.4930000000000001,"15min":2.1280000000000001},"last":1.258},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1200000000000001,"15min":1.036},"min":{"1min":0.86099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5760000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.98499999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1299999999999999,"15min":1.159},"min":{"1min":0.93400000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.677,"5min":1.9259999999999999,"15min":18.145},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2450000000000001,"15min":1.224},"min":{"1min":1.0469999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.645,"5min":1.976,"15min":2.169},"last":1.1240000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2450000000000001,"15min":1.3009999999999999},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.745},"max":{"1min":1.7569999999999999,"5min":1.7709999999999999,"15min":3.5110000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.52,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":1.1619999999999999,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.466}]},{"osd":5,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.3999999999999999,"15min":1.4510000000000001},"min":{"1min":1.1379999999999999,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":2.25,"5min":2.25,"15min":18.094000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4079999999999999,"15min":1.4159999999999999},"min":{"1min":1.0760000000000001,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.9419999999999999,"5min":2.1219999999999999,"15min":14.105},"last":1.4430000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.393,"15min":1.373},"min":{"1min":0.96399999999999997,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.865,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.548},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.4690000000000001,"15min":1.4750000000000001},"min":{"1min":1.264,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":4.0220000000000002},"last":1.331}]},{"osd":7,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.5189999999999999,"15min":1.456},"min":{"1min":1.3169999999999999,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":2.109,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.512},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5169999999999999,"15min":1.4430000000000001},"min":{"1min":1.0760000000000001,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":2.0630000000000002,"5min":2.2629999999999999,"15min":3.016},"last":1.667}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981733,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.68500000000000005,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":1.5449999999999999,"5min":1.673,"15min":1.716},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.306,"5min":1.6970000000000001,"15min":2.9009999999999998},"last":0.81499999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90600000000000003,"15min":0.92300000000000004},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.099,"15min":1.069},"min":{"1min":0.77400000000000002,"5min":0.48799999999999999,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.004}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1559999999999999},"min":{"1min":0.85999999999999999,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.655,"5min":1.794,"15min":3.2850000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.2549999999999999,"15min":1.1990000000000001},"min":{"1min":0.92500000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"max":{"1min":1.7629999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":1.135}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.452,"15min":1.4370000000000001},"min":{"1min":1.135,"5min":0.88800000000000001,"15min":0.81899999999999995},"max":{"1min":1.8049999999999999,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.379,"15min":1.3360000000000001},"min":{"1min":0.93700000000000006,"5min":0.77300000000000002,"15min":0.66800000000000004},"max":{"1min":1.8160000000000001,"5min":1.974,"15min":3.4500000000000002},"last":1.3859999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.417,"15min":1.3979999999999999},"min":{"1min":1.012,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.95,"5min":2.0110000000000001,"15min":5.0140000000000002},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.5309999999999999,"15min":1.4970000000000001},"min":{"1min":1.3420000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8340000000000001,"5min":2.133,"15min":4.806},"last":1.413}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4019999999999999,"15min":1.359},"min":{"1min":1.0700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.976,"5min":1.976,"15min":2.5179999999999998},"last":1.619},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.492,"15min":1.4570000000000001},"min":{"1min":1.089,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9079999999999999,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.9079999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.456,"15min":1.4139999999999999},"min":{"1min":0.98399999999999999,"5min":0.80300000000000005,"15min":0.76200000000000001},"max":{"1min":1.8919999999999999,"5min":2.1309999999999998,"15min":2.464},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.5569999999999999,"15min":1.5469999999999999},"min":{"1min":1.248,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0150000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.792}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.47299999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3460000000000001,"5min":1.6859999999999999,"15min":2.621},"last":0.874},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0209999999999999,"15min":1.3160000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.4790000000000001,"5min":1.778,"15min":88.254999999999995},"last":1.0780000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.006,"15min":0.98899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2689999999999999,"15min":1.226},"min":{"1min":0.626,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.5960000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2330000000000001,"15min":1.169},"min":{"1min":0.67300000000000004,"5min":0.436,"15min":0.436},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.363},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1100000000000001,"15min":1.071},"min":{"1min":0.66700000000000004,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.222}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2649999999999999,"15min":1.3320000000000001},"min":{"1min":0.86099999999999999,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":25.172000000000001},"last":1.276},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.401,"15min":1.3660000000000001},"min":{"1min":1.081,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.887,"5min":2.085,"15min":3.762},"last":1.49}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.387,"15min":1.45},"min":{"1min":0.80100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.7250000000000001,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3300000000000001,"15min":1.3200000000000001},"min":{"1min":0.876,"5min":0.81899999999999995,"15min":0.77900000000000003},"max":{"1min":1.8400000000000001,"5min":1.9079999999999999,"15min":3.762},"last":1.4139999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.5309999999999999,"15min":1.4910000000000001},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.524},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.4790000000000001,"15min":1.4359999999999999},"min":{"1min":0.91100000000000003,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.546,"15min":1.627},"min":{"1min":1.117,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.109,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.593,"15min":1.6399999999999999},"min":{"1min":0.92600000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2080000000000002,"5min":2.464,"15min":28.765000000000001},"last":1.462}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193713,"statfs":{"total":200000000,"available":198362468,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.204,"5min":1.6259999999999999,"15min":1.819},"last":0.871},{"interface":"front","average":{"1min":1.022,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.437,"5min":0.437,"15min":0.436},"max":{"1min":1.4990000000000001,"5min":1.661,"15min":6.1749999999999998},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.016},"min":{"1min":0.84499999999999997,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.373,"5min":1.6120000000000001,"15min":1.7669999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0609999999999999,"15min":1.0700000000000001},"min":{"1min":0.59499999999999997,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5289999999999999,"5min":1.5609999999999999,"15min":6.2549999999999999},"last":1.325}]},{"osd":3,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.016},"min":{"1min":0.63700000000000001,"5min":0.55300000000000005,"15min":0.45300000000000001},"max":{"1min":1.601,"5min":1.665,"15min":9.6069999999999993},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.244,"5min":1.2110000000000001,"15min":1.2030000000000001},"min":{"1min":0.69099999999999995,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.5620000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.351},"min":{"1min":0.88300000000000001,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.9630000000000001,"5min":2.1019999999999999,"15min":9.9629999999999992},"last":1.8640000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4039999999999999,"15min":1.3480000000000001},"min":{"1min":0.99199999999999999,"5min":0.85799999999999998,"15min":0.77900000000000003},"max":{"1min":1.7589999999999999,"5min":1.8560000000000001,"15min":1.879},"last":1.615}]},{"osd":5,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.349,"15min":1.347},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":1.6910000000000001,"5min":1.8200000000000001,"15min":10.004},"last":1.498},{"interface":"front","average":{"1min":1.423,"5min":1.46,"15min":1.421},"min":{"1min":0.92900000000000005,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.798,"5min":2.1419999999999999,"15min":2.161},"last":1.464}]},{"osd":6,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.45,"15min":1.4019999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7729999999999999,"5min":2.1230000000000002,"15min":6.4290000000000003},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.47,"15min":1.4630000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.782,"5min":2.117,"15min":9.9190000000000005},"last":1.641}]},{"osd":7,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.492},"min":{"1min":1.016,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8839999999999999,"5min":2.2160000000000002,"15min":18.114000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.5289999999999999,"15min":1.5129999999999999},"min":{"1min":0.84099999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":9.5640000000000001},"last":1.758}]}]}],"pool_statfs":[]}} 2023-08-09T12:51:38.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:51:39.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.179+0000 7f9853fff640 1 Processor -- start 2023-08-09T12:51:39.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.179+0000 7f9853fff640 1 -- start start 2023-08-09T12:51:39.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.180+0000 7f9853fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 0x7f985415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.180+0000 7f9853fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985415d2c0 con 0x7f9854071450 2023-08-09T12:51:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.181+0000 7f9853fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985415d4f0 con 0x7f98540ca000 2023-08-09T12:51:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.181+0000 7f9853fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9854159710 con 0x7f98540cb870 2023-08-09T12:51:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.181+0000 7f9852ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9854071450 0x7f98540c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48378/0 (socket says 172.21.15.17:48378) 2023-08-09T12:51:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.181+0000 7f9852ffd640 1 -- 172.21.15.17:0/1978859247 learned_addr learned my addr 172.21.15.17:0/1978859247 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.181+0000 7f98537fe640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 0x7f985415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.181+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365370754 0 0) 0x7f985415d2c0 con 0x7f9854071450 2023-08-09T12:51:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.181+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f983c004630 con 0x7f9854071450 2023-08-09T12:51:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14677272 0 0) 0x7f983c004630 con 0x7f9854071450 2023-08-09T12:51:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 msgr2=0x7f985415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 0x7f985415cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 >> v1:172.21.15.142:6789/0 conn(0x7f98540ca000 legacy=0x7f98540b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985415d7d0 con 0x7f9854071450 2023-08-09T12:51:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f9844001670 con 0x7f9854071450 2023-08-09T12:51:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 >> v1:172.21.15.17:6789/0 conn(0x7f9854071450 legacy=0x7f98540c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 0x7f983c004ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f983c0058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f983c005e10 0x7f983c006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c00cca0 con 0x7f983c0050e0 2023-08-09T12:51:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c00ce10 con 0x7f983c005e10 2023-08-09T12:51:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0034c0 con 0x7f98540cb870 2023-08-09T12:51:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f98527fc640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f983c0058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f98527fc640 1 -- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 msgr2=0x7f983c004ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.182+0000 7f9852ffd640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 0x7f983c004ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.183+0000 7f98537fe640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f983c005e10 0x7f983c006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.183+0000 7f98527fc640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 0x7f983c004ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.183+0000 7f98527fc640 1 -- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f983c005e10 msgr2=0x7f983c006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.183+0000 7f98527fc640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f983c005e10 0x7f983c006290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.183+0000 7f98527fc640 1 -- 172.21.15.17:0/1978859247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c004630 con 0x7f983c0050e0 2023-08-09T12:51:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.183+0000 7f9852ffd640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98540cb870 0x7f983c004ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.184+0000 7f98527fc640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f983c0058d0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9848001720 tx=0x7f983c006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6259411e1c6a4e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.184+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98480052d0 con 0x7f983c0050e0 2023-08-09T12:51:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.184+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984802e050 con 0x7f983c0050e0 2023-08-09T12:51:39.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.184+0000 7f9851ffb640 1 -- 172.21.15.17:0/1978859247 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848003830 con 0x7f983c0050e0 2023-08-09T12:51:39.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.185+0000 7f9853fff640 1 -- 172.21.15.17:0/1978859247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 msgr2=0x7f983c0058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.185+0000 7f9853fff640 1 --2- 172.21.15.17:0/1978859247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f983c0058d0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9848001720 tx=0x7f983c006900 comp rx=0 tx=0).stop 2023-08-09T12:51:39.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.185+0000 7f98537fe640 1 -- 172.21.15.17:0/1978859247 reap_dead start 2023-08-09T12:51:39.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.185+0000 7f9853fff640 1 -- 172.21.15.17:0/1978859247 shutdown_connections 2023-08-09T12:51:39.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.185+0000 7f9853fff640 1 -- 172.21.15.17:0/1978859247 >> 172.21.15.17:0/1978859247 conn(0x7f98540b1d50 msgr2=0x7f985406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.185+0000 7f9853fff640 1 -- 172.21.15.17:0/1978859247 shutdown_connections 2023-08-09T12:51:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.185+0000 7f9853fff640 1 -- 172.21.15.17:0/1978859247 wait complete. 2023-08-09T12:51:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.187+0000 7f9853fff640 1 Processor -- start 2023-08-09T12:51:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.187+0000 7f9853fff640 1 -- start start 2023-08-09T12:51:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9853fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f98540c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9853fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985414ba30 0x7f98540697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9853fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9854069d00 0x7f98540c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9853fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98540c2df0 con 0x7f983c0050e0 2023-08-09T12:51:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9853fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985406a180 con 0x7f985414ba30 2023-08-09T12:51:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9853fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98540c8430 con 0x7f9854069d00 2023-08-09T12:51:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9852ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f98540c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9852ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f98540c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48476/0 (socket says 172.21.15.17:48476) 2023-08-09T12:51:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.188+0000 7f9852ffd640 1 -- 172.21.15.17:0/3380087745 learned_addr learned my addr 172.21.15.17:0/3380087745 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f98527fc640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985414ba30 0x7f98540697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f9852ffd640 1 -- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9854069d00 msgr2=0x7f98540c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f9852ffd640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9854069d00 0x7f98540c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f9852ffd640 1 -- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985414ba30 msgr2=0x7f98540697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f9852ffd640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985414ba30 0x7f98540697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f9852ffd640 1 -- 172.21.15.17:0/3380087745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98540c2170 con 0x7f983c0050e0 2023-08-09T12:51:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f9852ffd640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f98540c7220 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f984400d8e0 tx=0x7f984400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:39.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f983bfff640 1 -- 172.21.15.17:0/3380087745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98440074e0 con 0x7f983c0050e0 2023-08-09T12:51:39.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f983bfff640 1 -- 172.21.15.17:0/3380087745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9844007640 con 0x7f983c0050e0 2023-08-09T12:51:39.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f983bfff640 1 -- 172.21.15.17:0/3380087745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98440049e0 con 0x7f983c0050e0 2023-08-09T12:51:39.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98540c2450 con 0x7f983c0050e0 2023-08-09T12:51:39.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.189+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98540c2a10 con 0x7f983c0050e0 2023-08-09T12:51:39.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.191+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985404e390 con 0x7f983c0050e0 2023-08-09T12:51:39.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.191+0000 7f983bfff640 1 -- 172.21.15.17:0/3380087745 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9844004b40 con 0x7f983c0050e0 2023-08-09T12:51:39.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.192+0000 7f983bfff640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f984006a050 0x7f984006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.193+0000 7f983bfff640 1 -- 172.21.15.17:0/3380087745 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9844087f80 con 0x7f983c0050e0 2023-08-09T12:51:39.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.193+0000 7f98527fc640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f984006a050 0x7f984006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.194+0000 7f98527fc640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f984006a050 0x7f984006c510 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9848033000 tx=0x7f9848009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:39.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.197+0000 7f983bfff640 1 -- 172.21.15.17:0/3380087745 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f98440570f0 con 0x7f983c0050e0 2023-08-09T12:51:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.386+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98540b33b0 con 0x7f984006a050 2023-08-09T12:51:39.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.411+0000 7f983bfff640 1 -- 172.21.15.17:0/3380087745 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303151 (secure 0 0 0) 0x7f9848005400 con 0x7f984006a050 2023-08-09T12:51:39.419 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:39.420 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:51:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f984006a050 msgr2=0x7f984006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f984006a050 0x7f984006c510 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9848033000 tx=0x7f9848009030 comp rx=0 tx=0).stop 2023-08-09T12:51:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 msgr2=0x7f98540c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f98540c7220 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f984400d8e0 tx=0x7f984400dda0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 shutdown_connections 2023-08-09T12:51:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f984006a050 0x7f984006c510 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9854069d00 0x7f98540c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985414ba30 0x7f98540697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 --2- 172.21.15.17:0/3380087745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f983c0050e0 0x7f98540c7220 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.417+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 >> 172.21.15.17:0/3380087745 conn(0x7f98540b1d50 msgr2=0x7f98540cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.418+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 shutdown_connections 2023-08-09T12:51:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.418+0000 7f9853fff640 1 -- 172.21.15.17:0/3380087745 wait complete. 2023-08-09T12:51:39.441 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-08-09T12:51:38.918181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553179,"statfs":{"total":1600000000,"available":1590455676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.084756"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277893+0000","last_change":"2023-08-09T12:51:33.904326+0000","last_active":"2023-08-09T12:51:35.277893+0000","last_peered":"2023-08-09T12:51:35.277893+0000","last_clean":"2023-08-09T12:51:35.277893+0000","last_became_active":"2023-08-09T12:51:33.904101+0000","last_became_peered":"2023-08-09T12:51:33.904101+0000","last_unstale":"2023-08-09T12:51:35.277893+0000","last_undegraded":"2023-08-09T12:51:35.277893+0000","last_fullsized":"2023-08-09T12:51:35.277893+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:03:20.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867951+0000","last_change":"2023-08-09T12:51:33.892059+0000","last_active":"2023-08-09T12:51:34.867951+0000","last_peered":"2023-08-09T12:51:34.867951+0000","last_clean":"2023-08-09T12:51:34.867951+0000","last_became_active":"2023-08-09T12:51:33.891669+0000","last_became_peered":"2023-08-09T12:51:33.891669+0000","last_unstale":"2023-08-09T12:51:34.867951+0000","last_undegraded":"2023-08-09T12:51:34.867951+0000","last_fullsized":"2023-08-09T12:51:34.867951+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:57:15.133730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868200+0000","last_change":"2023-08-09T12:51:33.883993+0000","last_active":"2023-08-09T12:51:34.868200+0000","last_peered":"2023-08-09T12:51:34.868200+0000","last_clean":"2023-08-09T12:51:34.868200+0000","last_became_active":"2023-08-09T12:51:33.883575+0000","last_became_peered":"2023-08-09T12:51:33.883575+0000","last_unstale":"2023-08-09T12:51:34.868200+0000","last_undegraded":"2023-08-09T12:51:34.868200+0000","last_fullsized":"2023-08-09T12:51:34.868200+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:15.482835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274312+0000","last_change":"2023-08-09T12:51:33.888118+0000","last_active":"2023-08-09T12:51:35.274312+0000","last_peered":"2023-08-09T12:51:35.274312+0000","last_clean":"2023-08-09T12:51:35.274312+0000","last_became_active":"2023-08-09T12:51:33.887560+0000","last_became_peered":"2023-08-09T12:51:33.887560+0000","last_unstale":"2023-08-09T12:51:35.274312+0000","last_undegraded":"2023-08-09T12:51:35.274312+0000","last_fullsized":"2023-08-09T12:51:35.274312+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:53:32.403752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867115+0000","last_change":"2023-08-09T12:51:33.900726+0000","last_active":"2023-08-09T12:51:34.867115+0000","last_peered":"2023-08-09T12:51:34.867115+0000","last_clean":"2023-08-09T12:51:34.867115+0000","last_became_active":"2023-08-09T12:51:33.899784+0000","last_became_peered":"2023-08-09T12:51:33.899784+0000","last_unstale":"2023-08-09T12:51:34.867115+0000","last_undegraded":"2023-08-09T12:51:34.867115+0000","last_fullsized":"2023-08-09T12:51:34.867115+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:45.820262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866175+0000","last_change":"2023-08-09T12:51:33.892942+0000","last_active":"2023-08-09T12:51:34.866175+0000","last_peered":"2023-08-09T12:51:34.866175+0000","last_clean":"2023-08-09T12:51:34.866175+0000","last_became_active":"2023-08-09T12:51:33.892647+0000","last_became_peered":"2023-08-09T12:51:33.892647+0000","last_unstale":"2023-08-09T12:51:34.866175+0000","last_undegraded":"2023-08-09T12:51:34.866175+0000","last_fullsized":"2023-08-09T12:51:34.866175+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:48:24.516600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277774+0000","last_change":"2023-08-09T12:51:33.895884+0000","last_active":"2023-08-09T12:51:35.277774+0000","last_peered":"2023-08-09T12:51:35.277774+0000","last_clean":"2023-08-09T12:51:35.277774+0000","last_became_active":"2023-08-09T12:51:33.895512+0000","last_became_peered":"2023-08-09T12:51:33.895512+0000","last_unstale":"2023-08-09T12:51:35.277774+0000","last_undegraded":"2023-08-09T12:51:35.277774+0000","last_fullsized":"2023-08-09T12:51:35.277774+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:20.598824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274691+0000","last_change":"2023-08-09T12:51:33.893650+0000","last_active":"2023-08-09T12:51:35.274691+0000","last_peered":"2023-08-09T12:51:35.274691+0000","last_clean":"2023-08-09T12:51:35.274691+0000","last_became_active":"2023-08-09T12:51:33.892816+0000","last_became_peered":"2023-08-09T12:51:33.892816+0000","last_unstale":"2023-08-09T12:51:35.274691+0000","last_undegraded":"2023-08-09T12:51:35.274691+0000","last_fullsized":"2023-08-09T12:51:35.274691+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:54.383368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866312+0000","last_change":"2023-08-09T12:51:33.873816+0000","last_active":"2023-08-09T12:51:34.866312+0000","last_peered":"2023-08-09T12:51:34.866312+0000","last_clean":"2023-08-09T12:51:34.866312+0000","last_became_active":"2023-08-09T12:51:33.872398+0000","last_became_peered":"2023-08-09T12:51:33.872398+0000","last_unstale":"2023-08-09T12:51:34.866312+0000","last_undegraded":"2023-08-09T12:51:34.866312+0000","last_fullsized":"2023-08-09T12:51:34.866312+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:21:23.831320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867220+0000","last_change":"2023-08-09T12:51:33.881426+0000","last_active":"2023-08-09T12:51:34.867220+0000","last_peered":"2023-08-09T12:51:34.867220+0000","last_clean":"2023-08-09T12:51:34.867220+0000","last_became_active":"2023-08-09T12:51:33.881173+0000","last_became_peered":"2023-08-09T12:51:33.881173+0000","last_unstale":"2023-08-09T12:51:34.867220+0000","last_undegraded":"2023-08-09T12:51:34.867220+0000","last_fullsized":"2023-08-09T12:51:34.867220+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:51:55.545505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274185+0000","last_change":"2023-08-09T12:51:33.879404+0000","last_active":"2023-08-09T12:51:35.274185+0000","last_peered":"2023-08-09T12:51:35.274185+0000","last_clean":"2023-08-09T12:51:35.274185+0000","last_became_active":"2023-08-09T12:51:33.879167+0000","last_became_peered":"2023-08-09T12:51:33.879167+0000","last_unstale":"2023-08-09T12:51:35.274185+0000","last_undegraded":"2023-08-09T12:51:35.274185+0000","last_fullsized":"2023-08-09T12:51:35.274185+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:46:47.899147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275247+0000","last_change":"2023-08-09T12:51:33.881233+0000","last_active":"2023-08-09T12:51:35.275247+0000","last_peered":"2023-08-09T12:51:35.275247+0000","last_clean":"2023-08-09T12:51:35.275247+0000","last_became_active":"2023-08-09T12:51:33.875953+0000","last_became_peered":"2023-08-09T12:51:33.875953+0000","last_unstale":"2023-08-09T12:51:35.275247+0000","last_undegraded":"2023-08-09T12:51:35.275247+0000","last_fullsized":"2023-08-09T12:51:35.275247+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:10:15.843221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865876+0000","last_change":"2023-08-09T12:51:33.881396+0000","last_active":"2023-08-09T12:51:34.865876+0000","last_peered":"2023-08-09T12:51:34.865876+0000","last_clean":"2023-08-09T12:51:34.865876+0000","last_became_active":"2023-08-09T12:51:33.881150+0000","last_became_peered":"2023-08-09T12:51:33.881150+0000","last_unstale":"2023-08-09T12:51:34.865876+0000","last_undegraded":"2023-08-09T12:51:34.865876+0000","last_fullsized":"2023-08-09T12:51:34.865876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:20.022303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274652+0000","last_change":"2023-08-09T12:51:33.881970+0000","last_active":"2023-08-09T12:51:35.274652+0000","last_peered":"2023-08-09T12:51:35.274652+0000","last_clean":"2023-08-09T12:51:35.274652+0000","last_became_active":"2023-08-09T12:51:33.877427+0000","last_became_peered":"2023-08-09T12:51:33.877427+0000","last_unstale":"2023-08-09T12:51:35.274652+0000","last_undegraded":"2023-08-09T12:51:35.274652+0000","last_fullsized":"2023-08-09T12:51:35.274652+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:35:24.449447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868292+0000","last_change":"2023-08-09T12:51:33.892666+0000","last_active":"2023-08-09T12:51:34.868292+0000","last_peered":"2023-08-09T12:51:34.868292+0000","last_clean":"2023-08-09T12:51:34.868292+0000","last_became_active":"2023-08-09T12:51:33.892278+0000","last_became_peered":"2023-08-09T12:51:33.892278+0000","last_unstale":"2023-08-09T12:51:34.868292+0000","last_undegraded":"2023-08-09T12:51:34.868292+0000","last_fullsized":"2023-08-09T12:51:34.868292+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:43:27.271570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866377+0000","last_change":"2023-08-09T12:51:33.903306+0000","last_active":"2023-08-09T12:51:34.866377+0000","last_peered":"2023-08-09T12:51:34.866377+0000","last_clean":"2023-08-09T12:51:34.866377+0000","last_became_active":"2023-08-09T12:51:33.903105+0000","last_became_peered":"2023-08-09T12:51:33.903105+0000","last_unstale":"2023-08-09T12:51:34.866377+0000","last_undegraded":"2023-08-09T12:51:34.866377+0000","last_fullsized":"2023-08-09T12:51:34.866377+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:49:30.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276751+0000","last_change":"2023-08-09T12:51:33.888560+0000","last_active":"2023-08-09T12:51:35.276751+0000","last_peered":"2023-08-09T12:51:35.276751+0000","last_clean":"2023-08-09T12:51:35.276751+0000","last_became_active":"2023-08-09T12:51:33.886503+0000","last_became_peered":"2023-08-09T12:51:33.886503+0000","last_unstale":"2023-08-09T12:51:35.276751+0000","last_undegraded":"2023-08-09T12:51:35.276751+0000","last_fullsized":"2023-08-09T12:51:35.276751+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:30:40.865504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274623+0000","last_change":"2023-08-09T12:51:33.893072+0000","last_active":"2023-08-09T12:51:35.274623+0000","last_peered":"2023-08-09T12:51:35.274623+0000","last_clean":"2023-08-09T12:51:35.274623+0000","last_became_active":"2023-08-09T12:51:33.892780+0000","last_became_peered":"2023-08-09T12:51:33.892780+0000","last_unstale":"2023-08-09T12:51:35.274623+0000","last_undegraded":"2023-08-09T12:51:35.274623+0000","last_fullsized":"2023-08-09T12:51:35.274623+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:07.759806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866857+0000","last_change":"2023-08-09T12:51:33.895991+0000","last_active":"2023-08-09T12:51:34.866857+0000","last_peered":"2023-08-09T12:51:34.866857+0000","last_clean":"2023-08-09T12:51:34.866857+0000","last_became_active":"2023-08-09T12:51:33.895733+0000","last_became_peered":"2023-08-09T12:51:33.895733+0000","last_unstale":"2023-08-09T12:51:34.866857+0000","last_undegraded":"2023-08-09T12:51:34.866857+0000","last_fullsized":"2023-08-09T12:51:34.866857+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:04:53.900797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274226+0000","last_change":"2023-08-09T12:51:33.884956+0000","last_active":"2023-08-09T12:51:35.274226+0000","last_peered":"2023-08-09T12:51:35.274226+0000","last_clean":"2023-08-09T12:51:35.274226+0000","last_became_active":"2023-08-09T12:51:33.884406+0000","last_became_peered":"2023-08-09T12:51:33.884406+0000","last_unstale":"2023-08-09T12:51:35.274226+0000","last_undegraded":"2023-08-09T12:51:35.274226+0000","last_fullsized":"2023-08-09T12:51:35.274226+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:02.208478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866582+0000","last_change":"2023-08-09T12:51:33.874719+0000","last_active":"2023-08-09T12:51:34.866582+0000","last_peered":"2023-08-09T12:51:34.866582+0000","last_clean":"2023-08-09T12:51:34.866582+0000","last_became_active":"2023-08-09T12:51:33.874474+0000","last_became_peered":"2023-08-09T12:51:33.874474+0000","last_unstale":"2023-08-09T12:51:34.866582+0000","last_undegraded":"2023-08-09T12:51:34.866582+0000","last_fullsized":"2023-08-09T12:51:34.866582+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:32:50.741381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278149+0000","last_change":"2023-08-09T12:51:33.895751+0000","last_active":"2023-08-09T12:51:35.278149+0000","last_peered":"2023-08-09T12:51:35.278149+0000","last_clean":"2023-08-09T12:51:35.278149+0000","last_became_active":"2023-08-09T12:51:33.895191+0000","last_became_peered":"2023-08-09T12:51:33.895191+0000","last_unstale":"2023-08-09T12:51:35.278149+0000","last_undegraded":"2023-08-09T12:51:35.278149+0000","last_fullsized":"2023-08-09T12:51:35.278149+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:17.416780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275049+0000","last_change":"2023-08-09T12:51:33.900991+0000","last_active":"2023-08-09T12:51:35.275049+0000","last_peered":"2023-08-09T12:51:35.275049+0000","last_clean":"2023-08-09T12:51:35.275049+0000","last_became_active":"2023-08-09T12:51:33.900647+0000","last_became_peered":"2023-08-09T12:51:33.900647+0000","last_unstale":"2023-08-09T12:51:35.275049+0000","last_undegraded":"2023-08-09T12:51:35.275049+0000","last_fullsized":"2023-08-09T12:51:35.275049+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:53.043419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273521+0000","last_change":"2023-08-09T12:51:33.876293+0000","last_active":"2023-08-09T12:51:35.273521+0000","last_peered":"2023-08-09T12:51:35.273521+0000","last_clean":"2023-08-09T12:51:35.273521+0000","last_became_active":"2023-08-09T12:51:33.875899+0000","last_became_peered":"2023-08-09T12:51:33.875899+0000","last_unstale":"2023-08-09T12:51:35.273521+0000","last_undegraded":"2023-08-09T12:51:35.273521+0000","last_fullsized":"2023-08-09T12:51:35.273521+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:59:11.033578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277261+0000","last_change":"2023-08-09T12:51:33.896400+0000","last_active":"2023-08-09T12:51:35.277261+0000","last_peered":"2023-08-09T12:51:35.277261+0000","last_clean":"2023-08-09T12:51:35.277261+0000","last_became_active":"2023-08-09T12:51:33.895863+0000","last_became_peered":"2023-08-09T12:51:33.895863+0000","last_unstale":"2023-08-09T12:51:35.277261+0000","last_undegraded":"2023-08-09T12:51:35.277261+0000","last_fullsized":"2023-08-09T12:51:35.277261+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:01.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278112+0000","last_change":"2023-08-09T12:51:33.892186+0000","last_active":"2023-08-09T12:51:35.278112+0000","last_peered":"2023-08-09T12:51:35.278112+0000","last_clean":"2023-08-09T12:51:35.278112+0000","last_became_active":"2023-08-09T12:51:33.891907+0000","last_became_peered":"2023-08-09T12:51:33.891907+0000","last_unstale":"2023-08-09T12:51:35.278112+0000","last_undegraded":"2023-08-09T12:51:35.278112+0000","last_fullsized":"2023-08-09T12:51:35.278112+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:29:21.732714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866591+0000","last_change":"2023-08-09T12:51:33.873172+0000","last_active":"2023-08-09T12:51:34.866591+0000","last_peered":"2023-08-09T12:51:34.866591+0000","last_clean":"2023-08-09T12:51:34.866591+0000","last_became_active":"2023-08-09T12:51:33.872428+0000","last_became_peered":"2023-08-09T12:51:33.872428+0000","last_unstale":"2023-08-09T12:51:34.866591+0000","last_undegraded":"2023-08-09T12:51:34.866591+0000","last_fullsized":"2023-08-09T12:51:34.866591+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:53.792171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274891+0000","last_change":"2023-08-09T12:51:33.881282+0000","last_active":"2023-08-09T12:51:35.274891+0000","last_peered":"2023-08-09T12:51:35.274891+0000","last_clean":"2023-08-09T12:51:35.274891+0000","last_became_active":"2023-08-09T12:51:33.881015+0000","last_became_peered":"2023-08-09T12:51:33.881015+0000","last_unstale":"2023-08-09T12:51:35.274891+0000","last_undegraded":"2023-08-09T12:51:35.274891+0000","last_fullsized":"2023-08-09T12:51:35.274891+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:07:51.764288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276035+0000","last_change":"2023-08-09T12:51:33.897415+0000","last_active":"2023-08-09T12:51:35.276035+0000","last_peered":"2023-08-09T12:51:35.276035+0000","last_clean":"2023-08-09T12:51:35.276035+0000","last_became_active":"2023-08-09T12:51:33.893957+0000","last_became_peered":"2023-08-09T12:51:33.893957+0000","last_unstale":"2023-08-09T12:51:35.276035+0000","last_undegraded":"2023-08-09T12:51:35.276035+0000","last_fullsized":"2023-08-09T12:51:35.276035+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:05.411567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274201+0000","last_change":"2023-08-09T12:51:33.874521+0000","last_active":"2023-08-09T12:51:35.274201+0000","last_peered":"2023-08-09T12:51:35.274201+0000","last_clean":"2023-08-09T12:51:35.274201+0000","last_became_active":"2023-08-09T12:51:33.874258+0000","last_became_peered":"2023-08-09T12:51:33.874258+0000","last_unstale":"2023-08-09T12:51:35.274201+0000","last_undegraded":"2023-08-09T12:51:35.274201+0000","last_fullsized":"2023-08-09T12:51:35.274201+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:32:51.770229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866803+0000","last_change":"2023-08-09T12:51:33.900307+0000","last_active":"2023-08-09T12:51:34.866803+0000","last_peered":"2023-08-09T12:51:34.866803+0000","last_clean":"2023-08-09T12:51:34.866803+0000","last_became_active":"2023-08-09T12:51:33.899704+0000","last_became_peered":"2023-08-09T12:51:33.899704+0000","last_unstale":"2023-08-09T12:51:34.866803+0000","last_undegraded":"2023-08-09T12:51:34.866803+0000","last_fullsized":"2023-08-09T12:51:34.866803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:42:45.312893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275236+0000","last_change":"2023-08-09T12:51:33.900717+0000","last_active":"2023-08-09T12:51:35.275236+0000","last_peered":"2023-08-09T12:51:35.275236+0000","last_clean":"2023-08-09T12:51:35.275236+0000","last_became_active":"2023-08-09T12:51:33.896549+0000","last_became_peered":"2023-08-09T12:51:33.896549+0000","last_unstale":"2023-08-09T12:51:35.275236+0000","last_undegraded":"2023-08-09T12:51:35.275236+0000","last_fullsized":"2023-08-09T12:51:35.275236+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:49:30.119634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868136+0000","last_change":"2023-08-09T12:51:33.881948+0000","last_active":"2023-08-09T12:51:34.868136+0000","last_peered":"2023-08-09T12:51:34.868136+0000","last_clean":"2023-08-09T12:51:34.868136+0000","last_became_active":"2023-08-09T12:51:33.881674+0000","last_became_peered":"2023-08-09T12:51:33.881674+0000","last_unstale":"2023-08-09T12:51:34.868136+0000","last_undegraded":"2023-08-09T12:51:34.868136+0000","last_fullsized":"2023-08-09T12:51:34.868136+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:19:26.933566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"174'4","reported_seq":17,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866262+0000","last_change":"2023-08-09T12:51:32.856874+0000","last_active":"2023-08-09T12:51:34.866262+0000","last_peered":"2023-08-09T12:51:34.866262+0000","last_clean":"2023-08-09T12:51:34.866262+0000","last_became_active":"2023-08-09T12:51:32.856173+0000","last_became_peered":"2023-08-09T12:51:32.856173+0000","last_unstale":"2023-08-09T12:51:34.866262+0000","last_undegraded":"2023-08-09T12:51:34.866262+0000","last_fullsized":"2023-08-09T12:51:34.866262+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:30:50.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868482+0000","last_change":"2023-08-09T12:51:33.892503+0000","last_active":"2023-08-09T12:51:34.868482+0000","last_peered":"2023-08-09T12:51:34.868482+0000","last_clean":"2023-08-09T12:51:34.868482+0000","last_became_active":"2023-08-09T12:51:33.891683+0000","last_became_peered":"2023-08-09T12:51:33.891683+0000","last_unstale":"2023-08-09T12:51:34.868482+0000","last_undegraded":"2023-08-09T12:51:34.868482+0000","last_fullsized":"2023-08-09T12:51:34.868482+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:16.024680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865281+0000","last_change":"2023-08-09T12:51:32.861940+0000","last_active":"2023-08-09T12:51:34.865281+0000","last_peered":"2023-08-09T12:51:34.865281+0000","last_clean":"2023-08-09T12:51:34.865281+0000","last_became_active":"2023-08-09T12:51:32.858863+0000","last_became_peered":"2023-08-09T12:51:32.858863+0000","last_unstale":"2023-08-09T12:51:34.865281+0000","last_undegraded":"2023-08-09T12:51:34.865281+0000","last_fullsized":"2023-08-09T12:51:34.865281+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:00:53.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276429+0000","last_change":"2023-08-09T12:51:33.899436+0000","last_active":"2023-08-09T12:51:35.276429+0000","last_peered":"2023-08-09T12:51:35.276429+0000","last_clean":"2023-08-09T12:51:35.276429+0000","last_became_active":"2023-08-09T12:51:33.898318+0000","last_became_peered":"2023-08-09T12:51:33.898318+0000","last_unstale":"2023-08-09T12:51:35.276429+0000","last_undegraded":"2023-08-09T12:51:35.276429+0000","last_fullsized":"2023-08-09T12:51:35.276429+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:44:30.192363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865665+0000","last_change":"2023-08-09T12:51:32.857688+0000","last_active":"2023-08-09T12:51:34.865665+0000","last_peered":"2023-08-09T12:51:34.865665+0000","last_clean":"2023-08-09T12:51:34.865665+0000","last_became_active":"2023-08-09T12:51:32.857349+0000","last_became_peered":"2023-08-09T12:51:32.857349+0000","last_unstale":"2023-08-09T12:51:34.865665+0000","last_undegraded":"2023-08-09T12:51:34.865665+0000","last_fullsized":"2023-08-09T12:51:34.865665+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:37.178113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865837+0000","last_change":"2023-08-09T12:51:33.891415+0000","last_active":"2023-08-09T12:51:34.865837+0000","last_peered":"2023-08-09T12:51:34.865837+0000","last_clean":"2023-08-09T12:51:34.865837+0000","last_became_active":"2023-08-09T12:51:33.891108+0000","last_became_peered":"2023-08-09T12:51:33.891108+0000","last_unstale":"2023-08-09T12:51:34.865837+0000","last_undegraded":"2023-08-09T12:51:34.865837+0000","last_fullsized":"2023-08-09T12:51:34.865837+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:17:05.671478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868335+0000","last_change":"2023-08-09T12:51:32.855138+0000","last_active":"2023-08-09T12:51:34.868335+0000","last_peered":"2023-08-09T12:51:34.868335+0000","last_clean":"2023-08-09T12:51:34.868335+0000","last_became_active":"2023-08-09T12:51:32.854680+0000","last_became_peered":"2023-08-09T12:51:32.854680+0000","last_unstale":"2023-08-09T12:51:34.868335+0000","last_undegraded":"2023-08-09T12:51:34.868335+0000","last_fullsized":"2023-08-09T12:51:34.868335+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:01:02.364600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273802+0000","last_change":"2023-08-09T12:51:33.885141+0000","last_active":"2023-08-09T12:51:35.273802+0000","last_peered":"2023-08-09T12:51:35.273802+0000","last_clean":"2023-08-09T12:51:35.273802+0000","last_became_active":"2023-08-09T12:51:33.884727+0000","last_became_peered":"2023-08-09T12:51:33.884727+0000","last_unstale":"2023-08-09T12:51:35.273802+0000","last_undegraded":"2023-08-09T12:51:35.273802+0000","last_fullsized":"2023-08-09T12:51:35.273802+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:59.574268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275649+0000","last_change":"2023-08-09T12:51:32.860052+0000","last_active":"2023-08-09T12:51:35.275649+0000","last_peered":"2023-08-09T12:51:35.275649+0000","last_clean":"2023-08-09T12:51:35.275649+0000","last_became_active":"2023-08-09T12:51:32.859796+0000","last_became_peered":"2023-08-09T12:51:32.859796+0000","last_unstale":"2023-08-09T12:51:35.275649+0000","last_undegraded":"2023-08-09T12:51:35.275649+0000","last_fullsized":"2023-08-09T12:51:35.275649+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:05.055340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275033+0000","last_change":"2023-08-09T12:51:33.882400+0000","last_active":"2023-08-09T12:51:35.275033+0000","last_peered":"2023-08-09T12:51:35.275033+0000","last_clean":"2023-08-09T12:51:35.275033+0000","last_became_active":"2023-08-09T12:51:33.878219+0000","last_became_peered":"2023-08-09T12:51:33.878219+0000","last_unstale":"2023-08-09T12:51:35.275033+0000","last_undegraded":"2023-08-09T12:51:35.275033+0000","last_fullsized":"2023-08-09T12:51:35.275033+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:43.824234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866386+0000","last_change":"2023-08-09T12:51:32.857082+0000","last_active":"2023-08-09T12:51:34.866386+0000","last_peered":"2023-08-09T12:51:34.866386+0000","last_clean":"2023-08-09T12:51:34.866386+0000","last_became_active":"2023-08-09T12:51:32.856554+0000","last_became_peered":"2023-08-09T12:51:32.856554+0000","last_unstale":"2023-08-09T12:51:34.866386+0000","last_undegraded":"2023-08-09T12:51:34.866386+0000","last_fullsized":"2023-08-09T12:51:34.866386+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:54.641005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867863+0000","last_change":"2023-08-09T12:51:33.883822+0000","last_active":"2023-08-09T12:51:34.867863+0000","last_peered":"2023-08-09T12:51:34.867863+0000","last_clean":"2023-08-09T12:51:34.867863+0000","last_became_active":"2023-08-09T12:51:33.883219+0000","last_became_peered":"2023-08-09T12:51:33.883219+0000","last_unstale":"2023-08-09T12:51:34.867863+0000","last_undegraded":"2023-08-09T12:51:34.867863+0000","last_fullsized":"2023-08-09T12:51:34.867863+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:44.448229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274400+0000","last_change":"2023-08-09T12:51:32.855186+0000","last_active":"2023-08-09T12:51:35.274400+0000","last_peered":"2023-08-09T12:51:35.274400+0000","last_clean":"2023-08-09T12:51:35.274400+0000","last_became_active":"2023-08-09T12:51:32.854035+0000","last_became_peered":"2023-08-09T12:51:32.854035+0000","last_unstale":"2023-08-09T12:51:35.274400+0000","last_undegraded":"2023-08-09T12:51:35.274400+0000","last_fullsized":"2023-08-09T12:51:35.274400+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:38.153645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278973+0000","last_change":"2023-08-09T12:51:33.898553+0000","last_active":"2023-08-09T12:51:35.278973+0000","last_peered":"2023-08-09T12:51:35.278973+0000","last_clean":"2023-08-09T12:51:35.278973+0000","last_became_active":"2023-08-09T12:51:33.898257+0000","last_became_peered":"2023-08-09T12:51:33.898257+0000","last_unstale":"2023-08-09T12:51:35.278973+0000","last_undegraded":"2023-08-09T12:51:35.278973+0000","last_fullsized":"2023-08-09T12:51:35.278973+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:41.562586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866867+0000","last_change":"2023-08-09T12:51:32.859417+0000","last_active":"2023-08-09T12:51:34.866867+0000","last_peered":"2023-08-09T12:51:34.866867+0000","last_clean":"2023-08-09T12:51:34.866867+0000","last_became_active":"2023-08-09T12:51:32.858622+0000","last_became_peered":"2023-08-09T12:51:32.858622+0000","last_unstale":"2023-08-09T12:51:34.866867+0000","last_undegraded":"2023-08-09T12:51:34.866867+0000","last_fullsized":"2023-08-09T12:51:34.866867+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:33.744391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865962+0000","last_change":"2023-08-09T12:51:33.871741+0000","last_active":"2023-08-09T12:51:34.865962+0000","last_peered":"2023-08-09T12:51:34.865962+0000","last_clean":"2023-08-09T12:51:34.865962+0000","last_became_active":"2023-08-09T12:51:33.870747+0000","last_became_peered":"2023-08-09T12:51:33.870747+0000","last_unstale":"2023-08-09T12:51:34.865962+0000","last_undegraded":"2023-08-09T12:51:34.865962+0000","last_fullsized":"2023-08-09T12:51:34.865962+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:39:30.139919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273914+0000","last_change":"2023-08-09T12:51:32.849945+0000","last_active":"2023-08-09T12:51:35.273914+0000","last_peered":"2023-08-09T12:51:35.273914+0000","last_clean":"2023-08-09T12:51:35.273914+0000","last_became_active":"2023-08-09T12:51:32.848584+0000","last_became_peered":"2023-08-09T12:51:32.848584+0000","last_unstale":"2023-08-09T12:51:35.273914+0000","last_undegraded":"2023-08-09T12:51:35.273914+0000","last_fullsized":"2023-08-09T12:51:35.273914+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:53:06.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866284+0000","last_change":"2023-08-09T12:51:33.902440+0000","last_active":"2023-08-09T12:51:34.866284+0000","last_peered":"2023-08-09T12:51:34.866284+0000","last_clean":"2023-08-09T12:51:34.866284+0000","last_became_active":"2023-08-09T12:51:33.902206+0000","last_became_peered":"2023-08-09T12:51:33.902206+0000","last_unstale":"2023-08-09T12:51:34.866284+0000","last_undegraded":"2023-08-09T12:51:34.866284+0000","last_fullsized":"2023-08-09T12:51:34.866284+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:39:16.421607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866163+0000","last_change":"2023-08-09T12:51:32.851188+0000","last_active":"2023-08-09T12:51:34.866163+0000","last_peered":"2023-08-09T12:51:34.866163+0000","last_clean":"2023-08-09T12:51:34.866163+0000","last_became_active":"2023-08-09T12:51:32.850562+0000","last_became_peered":"2023-08-09T12:51:32.850562+0000","last_unstale":"2023-08-09T12:51:34.866163+0000","last_undegraded":"2023-08-09T12:51:34.866163+0000","last_fullsized":"2023-08-09T12:51:34.866163+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:08.058703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277611+0000","last_change":"2023-08-09T12:51:33.899696+0000","last_active":"2023-08-09T12:51:35.277611+0000","last_peered":"2023-08-09T12:51:35.277611+0000","last_clean":"2023-08-09T12:51:35.277611+0000","last_became_active":"2023-08-09T12:51:33.899323+0000","last_became_peered":"2023-08-09T12:51:33.899323+0000","last_unstale":"2023-08-09T12:51:35.277611+0000","last_undegraded":"2023-08-09T12:51:35.277611+0000","last_fullsized":"2023-08-09T12:51:35.277611+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:15:33.161521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868518+0000","last_change":"2023-08-09T12:51:32.855685+0000","last_active":"2023-08-09T12:51:34.868518+0000","last_peered":"2023-08-09T12:51:34.868518+0000","last_clean":"2023-08-09T12:51:34.868518+0000","last_became_active":"2023-08-09T12:51:32.855417+0000","last_became_peered":"2023-08-09T12:51:32.855417+0000","last_unstale":"2023-08-09T12:51:34.868518+0000","last_undegraded":"2023-08-09T12:51:34.868518+0000","last_fullsized":"2023-08-09T12:51:34.868518+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:19.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274174+0000","last_change":"2023-08-09T12:51:33.892641+0000","last_active":"2023-08-09T12:51:35.274174+0000","last_peered":"2023-08-09T12:51:35.274174+0000","last_clean":"2023-08-09T12:51:35.274174+0000","last_became_active":"2023-08-09T12:51:33.892346+0000","last_became_peered":"2023-08-09T12:51:33.892346+0000","last_unstale":"2023-08-09T12:51:35.274174+0000","last_undegraded":"2023-08-09T12:51:35.274174+0000","last_fullsized":"2023-08-09T12:51:35.274174+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:04:34.192804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276341+0000","last_change":"2023-08-09T12:51:32.862265+0000","last_active":"2023-08-09T12:51:35.276341+0000","last_peered":"2023-08-09T12:51:35.276341+0000","last_clean":"2023-08-09T12:51:35.276341+0000","last_became_active":"2023-08-09T12:51:32.861143+0000","last_became_peered":"2023-08-09T12:51:32.861143+0000","last_unstale":"2023-08-09T12:51:35.276341+0000","last_undegraded":"2023-08-09T12:51:35.276341+0000","last_fullsized":"2023-08-09T12:51:35.276341+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:53:57.729979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867023+0000","last_change":"2023-08-09T12:51:33.903667+0000","last_active":"2023-08-09T12:51:34.867023+0000","last_peered":"2023-08-09T12:51:34.867023+0000","last_clean":"2023-08-09T12:51:34.867023+0000","last_became_active":"2023-08-09T12:51:33.903429+0000","last_became_peered":"2023-08-09T12:51:33.903429+0000","last_unstale":"2023-08-09T12:51:34.867023+0000","last_undegraded":"2023-08-09T12:51:34.867023+0000","last_fullsized":"2023-08-09T12:51:34.867023+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:15.451184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274043+0000","last_change":"2023-08-09T12:51:32.857424+0000","last_active":"2023-08-09T12:51:35.274043+0000","last_peered":"2023-08-09T12:51:35.274043+0000","last_clean":"2023-08-09T12:51:35.274043+0000","last_became_active":"2023-08-09T12:51:32.857037+0000","last_became_peered":"2023-08-09T12:51:32.857037+0000","last_unstale":"2023-08-09T12:51:35.274043+0000","last_undegraded":"2023-08-09T12:51:35.274043+0000","last_fullsized":"2023-08-09T12:51:35.274043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:28.628180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868727+0000","last_change":"2023-08-09T12:51:33.899302+0000","last_active":"2023-08-09T12:51:34.868727+0000","last_peered":"2023-08-09T12:51:34.868727+0000","last_clean":"2023-08-09T12:51:34.868727+0000","last_became_active":"2023-08-09T12:51:33.899079+0000","last_became_peered":"2023-08-09T12:51:33.899079+0000","last_unstale":"2023-08-09T12:51:34.868727+0000","last_undegraded":"2023-08-09T12:51:34.868727+0000","last_fullsized":"2023-08-09T12:51:34.868727+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:26:00.015430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277502+0000","last_change":"2023-08-09T12:51:32.845829+0000","last_active":"2023-08-09T12:51:35.277502+0000","last_peered":"2023-08-09T12:51:35.277502+0000","last_clean":"2023-08-09T12:51:35.277502+0000","last_became_active":"2023-08-09T12:51:32.845066+0000","last_became_peered":"2023-08-09T12:51:32.845066+0000","last_unstale":"2023-08-09T12:51:35.277502+0000","last_undegraded":"2023-08-09T12:51:35.277502+0000","last_fullsized":"2023-08-09T12:51:35.277502+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:41:40.496305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867660+0000","last_change":"2023-08-09T12:51:33.874607+0000","last_active":"2023-08-09T12:51:34.867660+0000","last_peered":"2023-08-09T12:51:34.867660+0000","last_clean":"2023-08-09T12:51:34.867660+0000","last_became_active":"2023-08-09T12:51:33.873494+0000","last_became_peered":"2023-08-09T12:51:33.873494+0000","last_unstale":"2023-08-09T12:51:34.867660+0000","last_undegraded":"2023-08-09T12:51:34.867660+0000","last_fullsized":"2023-08-09T12:51:34.867660+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:13:24.760727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273926+0000","last_change":"2023-08-09T12:51:32.858425+0000","last_active":"2023-08-09T12:51:35.273926+0000","last_peered":"2023-08-09T12:51:35.273926+0000","last_clean":"2023-08-09T12:51:35.273926+0000","last_became_active":"2023-08-09T12:51:32.858189+0000","last_became_peered":"2023-08-09T12:51:32.858189+0000","last_unstale":"2023-08-09T12:51:35.273926+0000","last_undegraded":"2023-08-09T12:51:35.273926+0000","last_fullsized":"2023-08-09T12:51:35.273926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:20.381398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868009+0000","last_change":"2023-08-09T12:51:33.892220+0000","last_active":"2023-08-09T12:51:34.868009+0000","last_peered":"2023-08-09T12:51:34.868009+0000","last_clean":"2023-08-09T12:51:34.868009+0000","last_became_active":"2023-08-09T12:51:33.891968+0000","last_became_peered":"2023-08-09T12:51:33.891968+0000","last_unstale":"2023-08-09T12:51:34.868009+0000","last_undegraded":"2023-08-09T12:51:34.868009+0000","last_fullsized":"2023-08-09T12:51:34.868009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:54.338548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277585+0000","last_change":"2023-08-09T12:51:32.853663+0000","last_active":"2023-08-09T12:51:35.277585+0000","last_peered":"2023-08-09T12:51:35.277585+0000","last_clean":"2023-08-09T12:51:35.277585+0000","last_became_active":"2023-08-09T12:51:32.853266+0000","last_became_peered":"2023-08-09T12:51:32.853266+0000","last_unstale":"2023-08-09T12:51:35.277585+0000","last_undegraded":"2023-08-09T12:51:35.277585+0000","last_fullsized":"2023-08-09T12:51:35.277585+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:18.588813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866752+0000","last_change":"2023-08-09T12:51:33.900420+0000","last_active":"2023-08-09T12:51:34.866752+0000","last_peered":"2023-08-09T12:51:34.866752+0000","last_clean":"2023-08-09T12:51:34.866752+0000","last_became_active":"2023-08-09T12:51:33.899333+0000","last_became_peered":"2023-08-09T12:51:33.899333+0000","last_unstale":"2023-08-09T12:51:34.866752+0000","last_undegraded":"2023-08-09T12:51:34.866752+0000","last_fullsized":"2023-08-09T12:51:34.866752+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:46.557912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276986+0000","last_change":"2023-08-09T12:51:32.862064+0000","last_active":"2023-08-09T12:51:35.276986+0000","last_peered":"2023-08-09T12:51:35.276986+0000","last_clean":"2023-08-09T12:51:35.276986+0000","last_became_active":"2023-08-09T12:51:32.860823+0000","last_became_peered":"2023-08-09T12:51:32.860823+0000","last_unstale":"2023-08-09T12:51:35.276986+0000","last_undegraded":"2023-08-09T12:51:35.276986+0000","last_fullsized":"2023-08-09T12:51:35.276986+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:34:48.789394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275388+0000","last_change":"2023-08-09T12:51:33.881581+0000","last_active":"2023-08-09T12:51:35.275388+0000","last_peered":"2023-08-09T12:51:35.275388+0000","last_clean":"2023-08-09T12:51:35.275388+0000","last_became_active":"2023-08-09T12:51:33.876210+0000","last_became_peered":"2023-08-09T12:51:33.876210+0000","last_unstale":"2023-08-09T12:51:35.275388+0000","last_undegraded":"2023-08-09T12:51:35.275388+0000","last_fullsized":"2023-08-09T12:51:35.275388+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:44:36.682984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276928+0000","last_change":"2023-08-09T12:51:32.855768+0000","last_active":"2023-08-09T12:51:35.276928+0000","last_peered":"2023-08-09T12:51:35.276928+0000","last_clean":"2023-08-09T12:51:35.276928+0000","last_became_active":"2023-08-09T12:51:32.855457+0000","last_became_peered":"2023-08-09T12:51:32.855457+0000","last_unstale":"2023-08-09T12:51:35.276928+0000","last_undegraded":"2023-08-09T12:51:35.276928+0000","last_fullsized":"2023-08-09T12:51:35.276928+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:09:14.295562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276376+0000","last_change":"2023-08-09T12:51:33.900191+0000","last_active":"2023-08-09T12:51:35.276376+0000","last_peered":"2023-08-09T12:51:35.276376+0000","last_clean":"2023-08-09T12:51:35.276376+0000","last_became_active":"2023-08-09T12:51:33.899952+0000","last_became_peered":"2023-08-09T12:51:33.899952+0000","last_unstale":"2023-08-09T12:51:35.276376+0000","last_undegraded":"2023-08-09T12:51:35.276376+0000","last_fullsized":"2023-08-09T12:51:35.276376+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:08:46.269263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867750+0000","last_change":"2023-08-09T12:51:32.851600+0000","last_active":"2023-08-09T12:51:34.867750+0000","last_peered":"2023-08-09T12:51:34.867750+0000","last_clean":"2023-08-09T12:51:34.867750+0000","last_became_active":"2023-08-09T12:51:32.850913+0000","last_became_peered":"2023-08-09T12:51:32.850913+0000","last_unstale":"2023-08-09T12:51:34.867750+0000","last_undegraded":"2023-08-09T12:51:34.867750+0000","last_fullsized":"2023-08-09T12:51:34.867750+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:11:04.736611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866929+0000","last_change":"2023-08-09T12:51:33.877600+0000","last_active":"2023-08-09T12:51:34.866929+0000","last_peered":"2023-08-09T12:51:34.866929+0000","last_clean":"2023-08-09T12:51:34.866929+0000","last_became_active":"2023-08-09T12:51:33.877381+0000","last_became_peered":"2023-08-09T12:51:33.877381+0000","last_unstale":"2023-08-09T12:51:34.866929+0000","last_undegraded":"2023-08-09T12:51:34.866929+0000","last_fullsized":"2023-08-09T12:51:34.866929+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:29:31.658264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867380+0000","last_change":"2023-08-09T12:51:32.860317+0000","last_active":"2023-08-09T12:51:34.867380+0000","last_peered":"2023-08-09T12:51:34.867380+0000","last_clean":"2023-08-09T12:51:34.867380+0000","last_became_active":"2023-08-09T12:51:32.859107+0000","last_became_peered":"2023-08-09T12:51:32.859107+0000","last_unstale":"2023-08-09T12:51:34.867380+0000","last_undegraded":"2023-08-09T12:51:34.867380+0000","last_fullsized":"2023-08-09T12:51:34.867380+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:06.896778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277111+0000","last_change":"2023-08-09T12:51:33.895017+0000","last_active":"2023-08-09T12:51:35.277111+0000","last_peered":"2023-08-09T12:51:35.277111+0000","last_clean":"2023-08-09T12:51:35.277111+0000","last_became_active":"2023-08-09T12:51:33.893038+0000","last_became_peered":"2023-08-09T12:51:33.893038+0000","last_unstale":"2023-08-09T12:51:35.277111+0000","last_undegraded":"2023-08-09T12:51:35.277111+0000","last_fullsized":"2023-08-09T12:51:35.277111+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:10.063766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278235+0000","last_change":"2023-08-09T12:51:32.858298+0000","last_active":"2023-08-09T12:51:35.278235+0000","last_peered":"2023-08-09T12:51:35.278235+0000","last_clean":"2023-08-09T12:51:35.278235+0000","last_became_active":"2023-08-09T12:51:32.857913+0000","last_became_peered":"2023-08-09T12:51:32.857913+0000","last_unstale":"2023-08-09T12:51:35.278235+0000","last_undegraded":"2023-08-09T12:51:35.278235+0000","last_fullsized":"2023-08-09T12:51:35.278235+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:49.090263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274464+0000","last_change":"2023-08-09T12:51:33.874710+0000","last_active":"2023-08-09T12:51:35.274464+0000","last_peered":"2023-08-09T12:51:35.274464+0000","last_clean":"2023-08-09T12:51:35.274464+0000","last_became_active":"2023-08-09T12:51:33.870399+0000","last_became_peered":"2023-08-09T12:51:33.870399+0000","last_unstale":"2023-08-09T12:51:35.274464+0000","last_undegraded":"2023-08-09T12:51:35.274464+0000","last_fullsized":"2023-08-09T12:51:35.274464+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:58:34.269702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273352+0000","last_change":"2023-08-09T12:51:32.845390+0000","last_active":"2023-08-09T12:51:35.273352+0000","last_peered":"2023-08-09T12:51:35.273352+0000","last_clean":"2023-08-09T12:51:35.273352+0000","last_became_active":"2023-08-09T12:51:32.844498+0000","last_became_peered":"2023-08-09T12:51:32.844498+0000","last_unstale":"2023-08-09T12:51:35.273352+0000","last_undegraded":"2023-08-09T12:51:35.273352+0000","last_fullsized":"2023-08-09T12:51:35.273352+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:13:43.634467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868424+0000","last_change":"2023-08-09T12:51:33.897414+0000","last_active":"2023-08-09T12:51:34.868424+0000","last_peered":"2023-08-09T12:51:34.868424+0000","last_clean":"2023-08-09T12:51:34.868424+0000","last_became_active":"2023-08-09T12:51:33.897139+0000","last_became_peered":"2023-08-09T12:51:33.897139+0000","last_unstale":"2023-08-09T12:51:34.868424+0000","last_undegraded":"2023-08-09T12:51:34.868424+0000","last_fullsized":"2023-08-09T12:51:34.868424+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:21:16.180788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277238+0000","last_change":"2023-08-09T12:51:32.860824+0000","last_active":"2023-08-09T12:51:35.277238+0000","last_peered":"2023-08-09T12:51:35.277238+0000","last_clean":"2023-08-09T12:51:35.277238+0000","last_became_active":"2023-08-09T12:51:32.859399+0000","last_became_peered":"2023-08-09T12:51:32.859399+0000","last_unstale":"2023-08-09T12:51:35.277238+0000","last_undegraded":"2023-08-09T12:51:35.277238+0000","last_fullsized":"2023-08-09T12:51:35.277238+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:52.954491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276979+0000","last_change":"2023-08-09T12:51:33.902835+0000","last_active":"2023-08-09T12:51:35.276979+0000","last_peered":"2023-08-09T12:51:35.276979+0000","last_clean":"2023-08-09T12:51:35.276979+0000","last_became_active":"2023-08-09T12:51:33.899388+0000","last_became_peered":"2023-08-09T12:51:33.899388+0000","last_unstale":"2023-08-09T12:51:35.276979+0000","last_undegraded":"2023-08-09T12:51:35.276979+0000","last_fullsized":"2023-08-09T12:51:35.276979+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:16.974365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865644+0000","last_change":"2023-08-09T12:51:32.861212+0000","last_active":"2023-08-09T12:51:34.865644+0000","last_peered":"2023-08-09T12:51:34.865644+0000","last_clean":"2023-08-09T12:51:34.865644+0000","last_became_active":"2023-08-09T12:51:32.857090+0000","last_became_peered":"2023-08-09T12:51:32.857090+0000","last_unstale":"2023-08-09T12:51:34.865644+0000","last_undegraded":"2023-08-09T12:51:34.865644+0000","last_fullsized":"2023-08-09T12:51:34.865644+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:17:12.741012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276666+0000","last_change":"2023-08-09T12:51:33.903329+0000","last_active":"2023-08-09T12:51:35.276666+0000","last_peered":"2023-08-09T12:51:35.276666+0000","last_clean":"2023-08-09T12:51:35.276666+0000","last_became_active":"2023-08-09T12:51:33.899727+0000","last_became_peered":"2023-08-09T12:51:33.899727+0000","last_unstale":"2023-08-09T12:51:35.276666+0000","last_undegraded":"2023-08-09T12:51:35.276666+0000","last_fullsized":"2023-08-09T12:51:35.276666+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:40.751286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"174'6","reported_seq":19,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273350+0000","last_change":"2023-08-09T12:51:32.850475+0000","last_active":"2023-08-09T12:51:35.273350+0000","last_peered":"2023-08-09T12:51:35.273350+0000","last_clean":"2023-08-09T12:51:35.273350+0000","last_became_active":"2023-08-09T12:51:32.850029+0000","last_became_peered":"2023-08-09T12:51:32.850029+0000","last_unstale":"2023-08-09T12:51:35.273350+0000","last_undegraded":"2023-08-09T12:51:35.273350+0000","last_fullsized":"2023-08-09T12:51:35.273350+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:02:51.063192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":473,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868190+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:51:34.868190+0000","last_peered":"2023-08-09T12:51:34.868190+0000","last_clean":"2023-08-09T12:51:34.868190+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:51:34.868190+0000","last_undegraded":"2023-08-09T12:51:34.868190+0000","last_fullsized":"2023-08-09T12:51:34.868190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:22.313967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278393+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:51:35.278393+0000","last_peered":"2023-08-09T12:51:35.278393+0000","last_clean":"2023-08-09T12:51:35.278393+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:51:35.278393+0000","last_undegraded":"2023-08-09T12:51:35.278393+0000","last_fullsized":"2023-08-09T12:51:35.278393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:55:16.916192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276750+0000","last_change":"2023-08-09T12:51:33.899592+0000","last_active":"2023-08-09T12:51:35.276750+0000","last_peered":"2023-08-09T12:51:35.276750+0000","last_clean":"2023-08-09T12:51:35.276750+0000","last_became_active":"2023-08-09T12:51:33.898674+0000","last_became_peered":"2023-08-09T12:51:33.898674+0000","last_unstale":"2023-08-09T12:51:35.276750+0000","last_undegraded":"2023-08-09T12:51:35.276750+0000","last_fullsized":"2023-08-09T12:51:35.276750+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:59:11.424097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867243+0000","last_change":"2023-08-09T12:51:32.852713+0000","last_active":"2023-08-09T12:51:34.867243+0000","last_peered":"2023-08-09T12:51:34.867243+0000","last_clean":"2023-08-09T12:51:34.867243+0000","last_became_active":"2023-08-09T12:51:32.852345+0000","last_became_peered":"2023-08-09T12:51:32.852345+0000","last_unstale":"2023-08-09T12:51:34.867243+0000","last_undegraded":"2023-08-09T12:51:34.867243+0000","last_fullsized":"2023-08-09T12:51:34.867243+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:19:53.576368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":317,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867859+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:51:34.867859+0000","last_peered":"2023-08-09T12:51:34.867859+0000","last_clean":"2023-08-09T12:51:34.867859+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:51:34.867859+0000","last_undegraded":"2023-08-09T12:51:34.867859+0000","last_fullsized":"2023-08-09T12:51:34.867859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:50:02.015915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275331+0000","last_change":"2023-08-09T12:51:33.877579+0000","last_active":"2023-08-09T12:51:35.275331+0000","last_peered":"2023-08-09T12:51:35.275331+0000","last_clean":"2023-08-09T12:51:35.275331+0000","last_became_active":"2023-08-09T12:51:33.877340+0000","last_became_peered":"2023-08-09T12:51:33.877340+0000","last_unstale":"2023-08-09T12:51:35.275331+0000","last_undegraded":"2023-08-09T12:51:35.275331+0000","last_fullsized":"2023-08-09T12:51:35.275331+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:41.910862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278378+0000","last_change":"2023-08-09T12:51:32.857165+0000","last_active":"2023-08-09T12:51:35.278378+0000","last_peered":"2023-08-09T12:51:35.278378+0000","last_clean":"2023-08-09T12:51:35.278378+0000","last_became_active":"2023-08-09T12:51:32.856539+0000","last_became_peered":"2023-08-09T12:51:32.856539+0000","last_unstale":"2023-08-09T12:51:35.278378+0000","last_undegraded":"2023-08-09T12:51:35.278378+0000","last_fullsized":"2023-08-09T12:51:35.278378+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:15.800974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275435+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:51:35.275435+0000","last_peered":"2023-08-09T12:51:35.275435+0000","last_clean":"2023-08-09T12:51:35.275435+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:51:35.275435+0000","last_undegraded":"2023-08-09T12:51:35.275435+0000","last_fullsized":"2023-08-09T12:51:35.275435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:27.594573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273266+0000","last_change":"2023-08-09T12:51:33.893133+0000","last_active":"2023-08-09T12:51:35.273266+0000","last_peered":"2023-08-09T12:51:35.273266+0000","last_clean":"2023-08-09T12:51:35.273266+0000","last_became_active":"2023-08-09T12:51:33.892875+0000","last_became_peered":"2023-08-09T12:51:33.892875+0000","last_unstale":"2023-08-09T12:51:35.273266+0000","last_undegraded":"2023-08-09T12:51:35.273266+0000","last_fullsized":"2023-08-09T12:51:35.273266+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:04.301485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"174'3","reported_seq":16,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275088+0000","last_change":"2023-08-09T12:51:32.856897+0000","last_active":"2023-08-09T12:51:35.275088+0000","last_peered":"2023-08-09T12:51:35.275088+0000","last_clean":"2023-08-09T12:51:35.275088+0000","last_became_active":"2023-08-09T12:51:32.854678+0000","last_became_peered":"2023-08-09T12:51:32.854678+0000","last_unstale":"2023-08-09T12:51:35.275088+0000","last_undegraded":"2023-08-09T12:51:35.275088+0000","last_fullsized":"2023-08-09T12:51:35.275088+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:22:04.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.279187+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:51:35.279187+0000","last_peered":"2023-08-09T12:51:35.279187+0000","last_clean":"2023-08-09T12:51:35.279187+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:51:35.279187+0000","last_undegraded":"2023-08-09T12:51:35.279187+0000","last_fullsized":"2023-08-09T12:51:35.279187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:33:21.306012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275401+0000","last_change":"2023-08-09T12:51:33.895168+0000","last_active":"2023-08-09T12:51:35.275401+0000","last_peered":"2023-08-09T12:51:35.275401+0000","last_clean":"2023-08-09T12:51:35.275401+0000","last_became_active":"2023-08-09T12:51:33.894891+0000","last_became_peered":"2023-08-09T12:51:33.894891+0000","last_unstale":"2023-08-09T12:51:35.275401+0000","last_undegraded":"2023-08-09T12:51:35.275401+0000","last_fullsized":"2023-08-09T12:51:35.275401+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:43:28.207591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867288+0000","last_change":"2023-08-09T12:51:32.855754+0000","last_active":"2023-08-09T12:51:34.867288+0000","last_peered":"2023-08-09T12:51:34.867288+0000","last_clean":"2023-08-09T12:51:34.867288+0000","last_became_active":"2023-08-09T12:51:32.854067+0000","last_became_peered":"2023-08-09T12:51:32.854067+0000","last_unstale":"2023-08-09T12:51:34.867288+0000","last_undegraded":"2023-08-09T12:51:34.867288+0000","last_fullsized":"2023-08-09T12:51:34.867288+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:15:15.478140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868832+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:51:34.868832+0000","last_peered":"2023-08-09T12:51:34.868832+0000","last_clean":"2023-08-09T12:51:34.868832+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:51:34.868832+0000","last_undegraded":"2023-08-09T12:51:34.868832+0000","last_fullsized":"2023-08-09T12:51:34.868832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:14.836836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868225+0000","last_change":"2023-08-09T12:51:33.882724+0000","last_active":"2023-08-09T12:51:34.868225+0000","last_peered":"2023-08-09T12:51:34.868225+0000","last_clean":"2023-08-09T12:51:34.868225+0000","last_became_active":"2023-08-09T12:51:33.882489+0000","last_became_peered":"2023-08-09T12:51:33.882489+0000","last_unstale":"2023-08-09T12:51:34.868225+0000","last_undegraded":"2023-08-09T12:51:34.868225+0000","last_fullsized":"2023-08-09T12:51:34.868225+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:43.656090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275484+0000","last_change":"2023-08-09T12:51:32.858693+0000","last_active":"2023-08-09T12:51:35.275484+0000","last_peered":"2023-08-09T12:51:35.275484+0000","last_clean":"2023-08-09T12:51:35.275484+0000","last_became_active":"2023-08-09T12:51:32.858352+0000","last_became_peered":"2023-08-09T12:51:32.858352+0000","last_unstale":"2023-08-09T12:51:35.275484+0000","last_undegraded":"2023-08-09T12:51:35.275484+0000","last_fullsized":"2023-08-09T12:51:35.275484+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:09.898610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":316,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867050+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:51:34.867050+0000","last_peered":"2023-08-09T12:51:34.867050+0000","last_clean":"2023-08-09T12:51:34.867050+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:51:34.867050+0000","last_undegraded":"2023-08-09T12:51:34.867050+0000","last_fullsized":"2023-08-09T12:51:34.867050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:46:43.974709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866983+0000","last_change":"2023-08-09T12:51:33.873573+0000","last_active":"2023-08-09T12:51:34.866983+0000","last_peered":"2023-08-09T12:51:34.866983+0000","last_clean":"2023-08-09T12:51:34.866983+0000","last_became_active":"2023-08-09T12:51:33.873312+0000","last_became_peered":"2023-08-09T12:51:33.873312+0000","last_unstale":"2023-08-09T12:51:34.866983+0000","last_undegraded":"2023-08-09T12:51:34.866983+0000","last_fullsized":"2023-08-09T12:51:34.866983+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:02:32.217729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276024+0000","last_change":"2023-08-09T12:51:32.862731+0000","last_active":"2023-08-09T12:51:35.276024+0000","last_peered":"2023-08-09T12:51:35.276024+0000","last_clean":"2023-08-09T12:51:35.276024+0000","last_became_active":"2023-08-09T12:51:32.861608+0000","last_became_peered":"2023-08-09T12:51:32.861608+0000","last_unstale":"2023-08-09T12:51:35.276024+0000","last_undegraded":"2023-08-09T12:51:35.276024+0000","last_fullsized":"2023-08-09T12:51:35.276024+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:23:22.776561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868280+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:51:34.868280+0000","last_peered":"2023-08-09T12:51:34.868280+0000","last_clean":"2023-08-09T12:51:34.868280+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:51:34.868280+0000","last_undegraded":"2023-08-09T12:51:34.868280+0000","last_fullsized":"2023-08-09T12:51:34.868280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:47:16.871212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868617+0000","last_change":"2023-08-09T12:51:33.876711+0000","last_active":"2023-08-09T12:51:34.868617+0000","last_peered":"2023-08-09T12:51:34.868617+0000","last_clean":"2023-08-09T12:51:34.868617+0000","last_became_active":"2023-08-09T12:51:33.876457+0000","last_became_peered":"2023-08-09T12:51:33.876457+0000","last_unstale":"2023-08-09T12:51:34.868617+0000","last_undegraded":"2023-08-09T12:51:34.868617+0000","last_fullsized":"2023-08-09T12:51:34.868617+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:37:14.833669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"174'8","reported_seq":21,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276609+0000","last_change":"2023-08-09T12:51:32.860530+0000","last_active":"2023-08-09T12:51:35.276609+0000","last_peered":"2023-08-09T12:51:35.276609+0000","last_clean":"2023-08-09T12:51:35.276609+0000","last_became_active":"2023-08-09T12:51:32.858793+0000","last_became_peered":"2023-08-09T12:51:32.858793+0000","last_unstale":"2023-08-09T12:51:35.276609+0000","last_undegraded":"2023-08-09T12:51:35.276609+0000","last_fullsized":"2023-08-09T12:51:35.276609+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:20.398869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":316,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277312+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:51:35.277312+0000","last_peered":"2023-08-09T12:51:35.277312+0000","last_clean":"2023-08-09T12:51:35.277312+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:51:35.277312+0000","last_undegraded":"2023-08-09T12:51:35.277312+0000","last_fullsized":"2023-08-09T12:51:35.277312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:34.493824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1596,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193715,"statfs":{"total":200000000,"available":198364764,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1819999999999999,"15min":1.135},"min":{"1min":0.72599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.611,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.873},{"interface":"front","average":{"1min":1.107,"5min":1.1259999999999999,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.70499999999999996,"15min":0.44500000000000001},"max":{"1min":1.369,"5min":1.7509999999999999,"15min":2.0459999999999998},"last":1.3400000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.24,"15min":1.1859999999999999},"min":{"1min":0.86299999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.5740000000000001,"5min":1.7809999999999999,"15min":2.0859999999999999},"last":1.05},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.70399999999999996,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.752,"5min":1.778,"15min":1.778},"last":1.0029999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.286,"15min":1.2450000000000001},"min":{"1min":0.84799999999999998,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":1.5960000000000001,"5min":1.78,"15min":2.1459999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2589999999999999,"15min":1.2090000000000001},"min":{"1min":0.81799999999999995,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.6519999999999999,"5min":1.6579999999999999,"15min":2.173},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.327,"15min":1.294},"min":{"1min":0.86399999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6699999999999999,"5min":1.806,"15min":3.4540000000000002},"last":1.5},{"interface":"front","average":{"1min":1.29,"5min":1.3049999999999999,"15min":1.3129999999999999},"min":{"1min":0.77800000000000002,"5min":0.72699999999999998,"15min":0.61599999999999999},"max":{"1min":1.681,"5min":1.8460000000000001,"15min":2.282},"last":1.161}]},{"osd":4,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.242,"15min":1.2310000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.873,"5min":1.948,"15min":2.8769999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.246,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.68700000000000006,"5min":0.67000000000000004,"15min":0.58599999999999997},"max":{"1min":1.655,"5min":1.8480000000000001,"15min":4.6200000000000001},"last":1.3819999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4159999999999999,"15min":1.3799999999999999},"min":{"1min":0.62,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.6599999999999999,"5min":1.978,"15min":2.802},"last":1.425},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.506,"15min":1.5089999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.8120000000000001,"5min":2.1299999999999999,"15min":3.3580000000000001},"last":1.4430000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.4830000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.901,"5min":2.2370000000000001,"15min":3.4910000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.8680000000000001,"5min":1.9770000000000001,"15min":2.4039999999999999},"last":1.284}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.093,"15min":1.133},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.56399999999999995},"max":{"1min":1.3180000000000001,"5min":1.573,"15min":2.54},"last":1.669},{"interface":"front","average":{"1min":1.117,"5min":1.155,"15min":1.109},"min":{"1min":0.83199999999999996,"5min":0.64400000000000002,"15min":0.54000000000000004},"max":{"1min":1.577,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.008}]},{"osd":1,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.2769999999999999,"15min":1.258},"min":{"1min":0.97799999999999998,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.655,"5min":1.996,"15min":2.306},"last":1.361},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":1.075,"5min":0.79100000000000004,"15min":0.76800000000000002},"max":{"1min":1.5980000000000001,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":1.232}]},{"osd":2,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.179,"15min":1.151},"min":{"1min":0.89600000000000002,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.587,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3009999999999999,"15min":1.296},"min":{"1min":0.86799999999999999,"5min":0.69699999999999995,"15min":0.66300000000000003},"max":{"1min":1.7170000000000001,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.0900000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":0.94699999999999995,"5min":0.79500000000000004,"15min":0.67600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":2.327},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.3520000000000001,"15min":1.3380000000000001},"min":{"1min":1.125,"5min":0.81799999999999995,"15min":0.74099999999999999},"max":{"1min":1.7789999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.599}]},{"osd":4,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.337,"15min":1.367},"min":{"1min":1.1140000000000001,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.821,"5min":1.8620000000000001,"15min":11.058999999999999},"last":1.518},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.377,"15min":1.367},"min":{"1min":1.0349999999999999,"5min":0.85399999999999998,"15min":0.57399999999999995},"max":{"1min":1.911,"5min":1.911,"15min":2.3479999999999999},"last":1.444}]},{"osd":5,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":1.018,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.96,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.718},{"interface":"front","average":{"1min":1.613,"5min":1.4950000000000001,"15min":1.5049999999999999},"min":{"1min":1.232,"5min":0.95599999999999996,"15min":0.81899999999999995},"max":{"1min":1.929,"5min":1.986,"15min":2.8580000000000001},"last":1.7689999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.5369999999999999,"15min":1.508},"min":{"1min":1.4199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.7999999999999998},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.5029999999999999,"15min":1.4990000000000001},"min":{"1min":1.0469999999999999,"5min":0.98699999999999999,"15min":0.74399999999999999},"max":{"1min":2.1280000000000001,"5min":2.7810000000000001,"15min":3.621},"last":1.8029999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.119,"15min":1.1120000000000001},"min":{"1min":0.76900000000000002,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.609,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.155},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.181,"15min":1.1499999999999999},"min":{"1min":0.77100000000000002,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.6180000000000001,"5min":1.97,"15min":2.0600000000000001},"last":1.2789999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.365,"15min":1.335},"min":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.63800000000000001},"max":{"1min":1.847,"5min":1.851,"15min":2.6579999999999999},"last":1.365},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.3520000000000001,"15min":1.292},"min":{"1min":1.135,"5min":0.73899999999999999,"15min":0.70199999999999996},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":0.93200000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2929999999999999,"15min":1.2450000000000001},"min":{"1min":0.91900000000000004,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.117},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2889999999999999,"15min":1.228},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.716,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.0429999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2949999999999999,"15min":1.2689999999999999},"min":{"1min":0.90500000000000003,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4810000000000001,"5min":1.7829999999999999,"15min":2.2330000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.3759999999999999,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.2270000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.323,"15min":1.2709999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":2.169,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.4239999999999999,"15min":1.3939999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.628},"max":{"1min":2.21,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.1839999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.4630000000000001,"15min":1.395},"min":{"1min":1.0449999999999999,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":2.7719999999999998,"5min":2.952,"15min":2.952},"last":1.325},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.518,"15min":1.4810000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":1.883,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.4139999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.55,"15min":1.5289999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":2.0600000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.629,"15min":1.5700000000000001},"min":{"1min":1.121,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":2.8849999999999998,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.4930000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1021,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194290,"statfs":{"total":200000000,"available":198953542,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.077,"15min":1.099},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.397,"5min":1.6060000000000001,"15min":2.5670000000000002},"last":1.397},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.123,"15min":1.1259999999999999},"min":{"1min":0.69399999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.373,"5min":1.673,"15min":3.4100000000000001},"last":1.0149999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.304,"15min":1.3009999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.611,"5min":1.863,"15min":2.3679999999999999},"last":1.181},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.331},"min":{"1min":0.84099999999999997,"5min":0.74399999999999999,"15min":0.71999999999999997},"max":{"1min":1.6020000000000001,"5min":1.8240000000000001,"15min":2.9590000000000001},"last":1.6020000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.349,"15min":1.323},"min":{"1min":0.96199999999999997,"5min":0.86199999999999999,"15min":0.54900000000000004},"max":{"1min":1.615,"5min":1.9470000000000001,"15min":2.4729999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.363,"15min":1.3420000000000001},"min":{"1min":0.99399999999999999,"5min":0.81499999999999995,"15min":0.67900000000000005},"max":{"1min":1.6890000000000001,"5min":1.978,"15min":3.0579999999999998},"last":1.5169999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.252,"15min":1.252},"min":{"1min":0.91700000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5800000000000001,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":1.341},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3340000000000001},"min":{"1min":0.94599999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7809999999999999,"5min":2.0539999999999998,"15min":2.5289999999999999},"last":0.94599999999999995}]},{"osd":5,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3340000000000001,"15min":1.357},"min":{"1min":0.94999999999999996,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.6839999999999999,"5min":1.857,"15min":3.137},"last":1.238},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3300000000000001,"15min":1.3640000000000001},"min":{"1min":0.89000000000000001,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.758,"5min":2.403,"15min":3.3620000000000001},"last":1.147}]},{"osd":6,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3879999999999999,"15min":1.4350000000000001},"min":{"1min":1.0549999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.788,"5min":2.262,"15min":2.5819999999999999},"last":1.081},{"interface":"front","average":{"1min":1.47,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":1.1000000000000001,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.732,"5min":2.1909999999999998,"15min":3.3340000000000001},"last":1.6799999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.494,"15min":1.516},"min":{"1min":1.1140000000000001,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.752,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.571,"15min":1.5940000000000001},"min":{"1min":1.419,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.887,"5min":2.4590000000000001,"15min":2.875},"last":1.462}]}]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194291,"statfs":{"total":200000000,"available":198954538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.347,"5min":1.458,"15min":4.4109999999999996},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.077,"5min":1.006,"15min":0.96999999999999997},"min":{"1min":0.69299999999999995,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.5569999999999999,"5min":1.7170000000000001,"15min":3.2269999999999999},"last":1.0800000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.76800000000000002,"5min":0.44400000000000001,"15min":0.38100000000000001},"max":{"1min":1.302,"5min":1.4930000000000001,"15min":2.1280000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1200000000000001,"15min":1.036},"min":{"1min":0.86099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5760000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.262}]},{"osd":2,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1299999999999999,"15min":1.159},"min":{"1min":0.93400000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.677,"5min":1.9259999999999999,"15min":18.145},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2450000000000001,"15min":1.224},"min":{"1min":1.0469999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.645,"5min":1.976,"15min":2.169},"last":1.379}]},{"osd":4,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2450000000000001,"15min":1.3009999999999999},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.745},"max":{"1min":1.7569999999999999,"5min":1.7709999999999999,"15min":3.5110000000000001},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":1.1619999999999999,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.4219999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.3999999999999999,"15min":1.4510000000000001},"min":{"1min":1.1379999999999999,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":2.25,"5min":2.25,"15min":18.094000000000001},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4079999999999999,"15min":1.4159999999999999},"min":{"1min":1.0760000000000001,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.9419999999999999,"5min":2.1219999999999999,"15min":14.105},"last":1.871}]},{"osd":6,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.393,"15min":1.373},"min":{"1min":0.96399999999999997,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.865,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.304},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.4690000000000001,"15min":1.4750000000000001},"min":{"1min":1.264,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":4.0220000000000002},"last":1.788}]},{"osd":7,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.5189999999999999,"15min":1.456},"min":{"1min":1.3169999999999999,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":2.109,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.532},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5169999999999999,"15min":1.4430000000000001},"min":{"1min":1.0760000000000001,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":2.0630000000000002,"5min":2.2629999999999999,"15min":3.016},"last":1.5009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.68500000000000005,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":1.5449999999999999,"5min":1.673,"15min":1.716},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.306,"5min":1.6970000000000001,"15min":2.9009999999999998},"last":1.214}]},{"osd":1,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90600000000000003,"15min":0.92300000000000004},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.151},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.099,"15min":1.069},"min":{"1min":0.77400000000000002,"5min":0.48799999999999999,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.999}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1559999999999999},"min":{"1min":0.85999999999999999,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.655,"5min":1.794,"15min":3.2850000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.2549999999999999,"15min":1.1990000000000001},"min":{"1min":0.92500000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"max":{"1min":1.7629999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":1.306}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.452,"15min":1.4370000000000001},"min":{"1min":1.135,"5min":0.88800000000000001,"15min":0.81899999999999995},"max":{"1min":1.8049999999999999,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.512},{"interface":"front","average":{"1min":1.383,"5min":1.379,"15min":1.3360000000000001},"min":{"1min":0.93700000000000006,"5min":0.77300000000000002,"15min":0.66800000000000004},"max":{"1min":1.8160000000000001,"5min":1.974,"15min":3.4500000000000002},"last":1.5649999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.417,"15min":1.3979999999999999},"min":{"1min":1.012,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.95,"5min":2.0110000000000001,"15min":5.0140000000000002},"last":1.603},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.5309999999999999,"15min":1.4970000000000001},"min":{"1min":1.3420000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8340000000000001,"5min":2.133,"15min":4.806},"last":1.627}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4019999999999999,"15min":1.359},"min":{"1min":1.0700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.976,"5min":1.976,"15min":2.5179999999999998},"last":1.369},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.492,"15min":1.4570000000000001},"min":{"1min":1.089,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9079999999999999,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.544}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.456,"15min":1.4139999999999999},"min":{"1min":0.98399999999999999,"5min":0.80300000000000005,"15min":0.76200000000000001},"max":{"1min":1.8919999999999999,"5min":2.1309999999999998,"15min":2.464},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.5569999999999999,"15min":1.5469999999999999},"min":{"1min":1.248,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0150000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.6659999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.47299999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3460000000000001,"5min":1.6859999999999999,"15min":2.621},"last":0.874},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0209999999999999,"15min":1.3160000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.4790000000000001,"5min":1.778,"15min":88.254999999999995},"last":1.0780000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.006,"15min":0.98899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2689999999999999,"15min":1.226},"min":{"1min":0.626,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.5960000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2330000000000001,"15min":1.169},"min":{"1min":0.67300000000000004,"5min":0.436,"15min":0.436},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.363},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1100000000000001,"15min":1.071},"min":{"1min":0.66700000000000004,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.222}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2649999999999999,"15min":1.3320000000000001},"min":{"1min":0.86099999999999999,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":25.172000000000001},"last":1.276},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.401,"15min":1.3660000000000001},"min":{"1min":1.081,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.887,"5min":2.085,"15min":3.762},"last":1.49}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.387,"15min":1.45},"min":{"1min":0.80100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.7250000000000001,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3300000000000001,"15min":1.3200000000000001},"min":{"1min":0.876,"5min":0.81899999999999995,"15min":0.77900000000000003},"max":{"1min":1.8400000000000001,"5min":1.9079999999999999,"15min":3.762},"last":1.4139999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.5309999999999999,"15min":1.4910000000000001},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.524},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.4790000000000001,"15min":1.4359999999999999},"min":{"1min":0.91100000000000003,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.546,"15min":1.627},"min":{"1min":1.117,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.109,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.593,"15min":1.6399999999999999},"min":{"1min":0.92600000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2080000000000002,"5min":2.464,"15min":28.765000000000001},"last":1.462}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193713,"statfs":{"total":200000000,"available":198362468,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.204,"5min":1.6259999999999999,"15min":1.819},"last":0.871},{"interface":"front","average":{"1min":1.022,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.437,"5min":0.437,"15min":0.436},"max":{"1min":1.4990000000000001,"5min":1.661,"15min":6.1749999999999998},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.016},"min":{"1min":0.84499999999999997,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.373,"5min":1.6120000000000001,"15min":1.7669999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0609999999999999,"15min":1.0700000000000001},"min":{"1min":0.59499999999999997,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5289999999999999,"5min":1.5609999999999999,"15min":6.2549999999999999},"last":1.325}]},{"osd":3,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.016},"min":{"1min":0.63700000000000001,"5min":0.55300000000000005,"15min":0.45300000000000001},"max":{"1min":1.601,"5min":1.665,"15min":9.6069999999999993},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.244,"5min":1.2110000000000001,"15min":1.2030000000000001},"min":{"1min":0.69099999999999995,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.5620000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.351},"min":{"1min":0.88300000000000001,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.9630000000000001,"5min":2.1019999999999999,"15min":9.9629999999999992},"last":1.8640000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4039999999999999,"15min":1.3480000000000001},"min":{"1min":0.99199999999999999,"5min":0.85799999999999998,"15min":0.77900000000000003},"max":{"1min":1.7589999999999999,"5min":1.8560000000000001,"15min":1.879},"last":1.615}]},{"osd":5,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.349,"15min":1.347},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":1.6910000000000001,"5min":1.8200000000000001,"15min":10.004},"last":1.498},{"interface":"front","average":{"1min":1.423,"5min":1.46,"15min":1.421},"min":{"1min":0.92900000000000005,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.798,"5min":2.1419999999999999,"15min":2.161},"last":1.464}]},{"osd":6,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.45,"15min":1.4019999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7729999999999999,"5min":2.1230000000000002,"15min":6.4290000000000003},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.47,"15min":1.4630000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.782,"5min":2.117,"15min":9.9190000000000005},"last":1.641}]},{"osd":7,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.492},"min":{"1min":1.016,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8839999999999999,"5min":2.2160000000000002,"15min":18.114000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.5289999999999999,"15min":1.5129999999999999},"min":{"1min":0.84099999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":9.5640000000000001},"last":1.758}]}]}],"pool_statfs":[]}} 2023-08-09T12:51:39.453 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-09T12:51:39.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.714+0000 7fc7acd5b640 1 Processor -- start 2023-08-09T12:51:39.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.714+0000 7fc7acd5b640 1 -- start start 2023-08-09T12:51:39.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.715+0000 7fc7acd5b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc7a80cab00 0x7fc7a80b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.715+0000 7fc7acd5b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7a80b0790 0x7fc7a806b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.715+0000 7fc7acd5b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a80b0ba0 con 0x7fc7a815cf70 2023-08-09T12:51:39.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.715+0000 7fc7acd5b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80c9a60 con 0x7fc7a80cab00 2023-08-09T12:51:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.715+0000 7fc7acd5b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80c9d40 con 0x7fc7a80b0790 2023-08-09T12:51:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.716+0000 7fc7a5d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc7a80cab00 0x7fc7a80b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.716+0000 7fc7a5d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc7a80cab00 0x7fc7a80b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48488/0 (socket says 172.21.15.17:48488) 2023-08-09T12:51:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.716+0000 7fc7a5d9b640 1 -- 172.21.15.17:0/1418221055 learned_addr learned my addr 172.21.15.17:0/1418221055 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.716+0000 7fc7a5d9b640 1 -- 172.21.15.17:0/1418221055 >> v2:172.21.15.142:3300/0 conn(0x7fc7a80b0790 msgr2=0x7fc7a806b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.716+0000 7fc7a5d9b640 1 --2- 172.21.15.17:0/1418221055 >> v2:172.21.15.142:3300/0 conn(0x7fc7a80b0790 0x7fc7a806b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.716+0000 7fc7a5d9b640 1 -- 172.21.15.17:0/1418221055 >> v1:172.21.15.142:6789/0 conn(0x7fc7a815cf70 legacy=0x7fc7a806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.716+0000 7fc7a5d9b640 1 -- 172.21.15.17:0/1418221055 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a80ca020 con 0x7fc7a80cab00 2023-08-09T12:51:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.717+0000 7fc7a5d9b640 1 --2- 172.21.15.17:0/1418221055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a80b0250 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80c8db0 tx=0x7fc79c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd432f5696a8037a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.717+0000 7fc7a559a640 1 -- 172.21.15.17:0/1418221055 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c031870 con 0x7fc7a80cab00 2023-08-09T12:51:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7a559a640 1 -- 172.21.15.17:0/1418221055 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c0319d0 con 0x7fc7a80cab00 2023-08-09T12:51:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7a559a640 1 -- 172.21.15.17:0/1418221055 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c031d60 con 0x7fc7a80cab00 2023-08-09T12:51:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1418221055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 msgr2=0x7fc7a80b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1418221055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a80b0250 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80c8db0 tx=0x7fc79c02b910 comp rx=0 tx=0).stop 2023-08-09T12:51:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1418221055 shutdown_connections 2023-08-09T12:51:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1418221055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a80b0250 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1418221055 >> v2:172.21.15.142:3300/0 conn(0x7fc7a80b0790 0x7fc7a806b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1418221055 >> 172.21.15.17:0/1418221055 conn(0x7fc7a80cb250 msgr2=0x7fc7a80cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:39.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1418221055 shutdown_connections 2023-08-09T12:51:39.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.718+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1418221055 wait complete. 2023-08-09T12:51:39.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.720+0000 7fc7acd5b640 1 Processor -- start 2023-08-09T12:51:39.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.720+0000 7fc7acd5b640 1 -- start start 2023-08-09T12:51:39.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.721+0000 7fc7acd5b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80b0790 0x7fc7a81e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.721+0000 7fc7acd5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a8158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.721+0000 7fc7acd5b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a815cf70 0x7fc7a80c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.721+0000 7fc7acd5b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c35e0 con 0x7fc7a80cab00 2023-08-09T12:51:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.721+0000 7fc7acd5b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c4e90 con 0x7fc7a80b0790 2023-08-09T12:51:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.721+0000 7fc7acd5b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c5130 con 0x7fc7a815cf70 2023-08-09T12:51:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a8158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a8158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48490/0 (socket says 172.21.15.17:48490) 2023-08-09T12:51:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 -- 172.21.15.17:0/1349866197 learned_addr learned my addr 172.21.15.17:0/1349866197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 -- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a815cf70 msgr2=0x7fc7a80c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a815cf70 0x7fc7a80c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 -- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80b0790 msgr2=0x7fc7a81e32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80b0790 0x7fc7a81e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 -- 172.21.15.17:0/1349866197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0094d0 con 0x7fc7a80cab00 2023-08-09T12:51:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.722+0000 7fc7a5d9b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a8158e10 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fc79c000c00 tx=0x7fc79c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:39.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.723+0000 7fc796ffd640 1 -- 172.21.15.17:0/1349866197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c03ad10 con 0x7fc7a80cab00 2023-08-09T12:51:39.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.723+0000 7fc796ffd640 1 -- 172.21.15.17:0/1349866197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c03ae70 con 0x7fc7a80cab00 2023-08-09T12:51:39.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.723+0000 7fc796ffd640 1 -- 172.21.15.17:0/1349866197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c044610 con 0x7fc7a80cab00 2023-08-09T12:51:39.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.723+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a80c5410 con 0x7fc7a80cab00 2023-08-09T12:51:39.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.723+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a81e3830 con 0x7fc7a80cab00 2023-08-09T12:51:39.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.724+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a8067a80 con 0x7fc7a80cab00 2023-08-09T12:51:39.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.725+0000 7fc796ffd640 1 -- 172.21.15.17:0/1349866197 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc79c04d450 con 0x7fc7a80cab00 2023-08-09T12:51:39.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.726+0000 7fc796ffd640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc78806a050 0x7fc78806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:39.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.726+0000 7fc796ffd640 1 -- 172.21.15.17:0/1349866197 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc79c02d040 con 0x7fc7a80cab00 2023-08-09T12:51:39.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.727+0000 7fc7a659c640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc78806a050 0x7fc78806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.728+0000 7fc7a659c640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc78806a050 0x7fc78806c510 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc798009650 tx=0x7fc798006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.731+0000 7fc796ffd640 1 -- 172.21.15.17:0/1349866197 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc79c0763f0 con 0x7fc7a80cab00 2023-08-09T12:51:39.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.989+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc7a80cbcb0 con 0x7fc7a80cab00 2023-08-09T12:51:39.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.990+0000 7fc796ffd640 1 -- 172.21.15.17:0/1349866197 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7fc79c079a10 con 0x7fc7a80cab00 2023-08-09T12:51:39.993 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:39.994 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":756,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":175,"num_osds":8,"num_up_osds":8,"osd_up_since":1691584751,"num_in_osds":8,"osd_in_since":1691584748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":9544324,"bytes_avail":1590455676,"bytes_total":1600000000,"write_bytes_sec":2356,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":84,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9000}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-08-09T12:49:52.877514+0000","services":{}},"progress_events":{}} 2023-08-09T12:51:39.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.992+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc78806a050 msgr2=0x7fc78806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.992+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc78806a050 0x7fc78806c510 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc798009650 tx=0x7fc798006ba0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.992+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 msgr2=0x7fc7a8158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:39.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.992+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a8158e10 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fc79c000c00 tx=0x7fc79c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.993+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 shutdown_connections 2023-08-09T12:51:39.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.993+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc78806a050 0x7fc78806c510 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.993+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a815cf70 0x7fc7a80c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.993+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7a80cab00 0x7fc7a8158e10 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.993+0000 7fc7acd5b640 1 --2- 172.21.15.17:0/1349866197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80b0790 0x7fc7a81e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:39.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.993+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 >> 172.21.15.17:0/1349866197 conn(0x7fc7a80cb250 msgr2=0x7fc7a80cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:39.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.993+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 shutdown_connections 2023-08-09T12:51:39.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:39.993+0000 7fc7acd5b640 1 -- 172.21.15.17:0/1349866197 wait complete. 2023-08-09T12:51:40.016 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-09T12:51:40.017 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:51:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.227+0000 7f7fb7fff640 1 Processor -- start 2023-08-09T12:51:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.228+0000 7f7fb7fff640 1 -- start start 2023-08-09T12:51:40.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7fb7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7fb80b86e0 0x7f7fb80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:40.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fb80cf980 0x7f7fb80d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7fb7fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb80b5a30 con 0x7f7fb8160030 2023-08-09T12:51:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7fb7fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb80d1110 con 0x7f7fb80b86e0 2023-08-09T12:51:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7fb7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80ceac0 con 0x7f7fb80cf980 2023-08-09T12:51:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7faffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7fb80b86e0 0x7f7fb80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7faffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7fb80b86e0 0x7f7fb80cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48496/0 (socket says 172.21.15.17:48496) 2023-08-09T12:51:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7faffff640 1 -- 172.21.15.17:0/579684402 learned_addr learned my addr 172.21.15.17:0/579684402 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:40.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.229+0000 7f7fb6ffd640 1 --1- 172.21.15.17:0/579684402 >> v1:172.21.15.17:6789/0 conn(0x7f7fb8160030 0x7f7fb8160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48392/0 (socket says 172.21.15.17:48392) 2023-08-09T12:51:40.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.230+0000 7f7faffff640 1 -- 172.21.15.17:0/579684402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fb80cf980 msgr2=0x7f7fb80d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.230+0000 7f7faffff640 1 --2- 172.21.15.17:0/579684402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fb80cf980 0x7f7fb80d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.230+0000 7f7faffff640 1 -- 172.21.15.17:0/579684402 >> v1:172.21.15.17:6789/0 conn(0x7f7fb8160030 legacy=0x7f7fb8160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.230+0000 7f7faffff640 1 -- 172.21.15.17:0/579684402 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb80d0d70 con 0x7f7fb80b86e0 2023-08-09T12:51:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.231+0000 7f7faffff640 1 --2- 172.21.15.17:0/579684402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb80b86e0 0x7f7fb80cf440 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009870 tx=0x7f7fa002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b90bf40e9da437 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.231+0000 7f7fb67fc640 1 -- 172.21.15.17:0/579684402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0030840 con 0x7f7fb80b86e0 2023-08-09T12:51:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.231+0000 7f7fb67fc640 1 -- 172.21.15.17:0/579684402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa00309a0 con 0x7f7fb80b86e0 2023-08-09T12:51:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.231+0000 7f7fb67fc640 1 -- 172.21.15.17:0/579684402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0030d30 con 0x7f7fb80b86e0 2023-08-09T12:51:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.231+0000 7f7fb7fff640 1 -- 172.21.15.17:0/579684402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb80b86e0 msgr2=0x7f7fb80cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.231+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/579684402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb80b86e0 0x7f7fb80cf440 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009870 tx=0x7f7fa002b980 comp rx=0 tx=0).stop 2023-08-09T12:51:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.232+0000 7f7fb7fff640 1 -- 172.21.15.17:0/579684402 shutdown_connections 2023-08-09T12:51:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.232+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/579684402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fb80cf980 0x7f7fb80d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.232+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/579684402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb80b86e0 0x7f7fb80cf440 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.232+0000 7f7fb7fff640 1 -- 172.21.15.17:0/579684402 >> 172.21.15.17:0/579684402 conn(0x7f7fb80697c0 msgr2=0x7f7fb8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.232+0000 7f7fb7fff640 1 -- 172.21.15.17:0/579684402 shutdown_connections 2023-08-09T12:51:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.232+0000 7f7fb7fff640 1 -- 172.21.15.17:0/579684402 wait complete. 2023-08-09T12:51:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.233+0000 7f7fb7fff640 1 Processor -- start 2023-08-09T12:51:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.234+0000 7f7fb7fff640 1 -- start start 2023-08-09T12:51:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb80b86e0 0x7f7fb8149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fb80cf980 0x7f7fb80cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8160030 0x7f7fb80b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb7fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80b33c0 con 0x7f7fb8160030 2023-08-09T12:51:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb7fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80b24d0 con 0x7f7fb80b86e0 2023-08-09T12:51:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80b27b0 con 0x7f7fb80cf980 2023-08-09T12:51:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8160030 0x7f7fb80b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8160030 0x7f7fb80b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48508/0 (socket says 172.21.15.17:48508) 2023-08-09T12:51:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb77fe640 1 -- 172.21.15.17:0/3889121313 learned_addr learned my addr 172.21.15.17:0/3889121313 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb77fe640 1 -- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fb80cf980 msgr2=0x7f7fb80cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb77fe640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fb80cf980 0x7f7fb80cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb77fe640 1 -- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb80b86e0 msgr2=0x7f7fb8149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb77fe640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb80b86e0 0x7f7fb8149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.235+0000 7f7fb77fe640 1 -- 172.21.15.17:0/3889121313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa00094d0 con 0x7f7fb8160030 2023-08-09T12:51:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.236+0000 7f7fb77fe640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8160030 0x7f7fb80b4120 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000b970 tx=0x7f7fb000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.236+0000 7f7fb4ff9640 1 -- 172.21.15.17:0/3889121313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000cb40 con 0x7f7fb8160030 2023-08-09T12:51:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.236+0000 7f7fb4ff9640 1 -- 172.21.15.17:0/3889121313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb000ccc0 con 0x7f7fb8160030 2023-08-09T12:51:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.236+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb80b2a90 con 0x7f7fb8160030 2023-08-09T12:51:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.236+0000 7f7fb4ff9640 1 -- 172.21.15.17:0/3889121313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0014680 con 0x7f7fb8160030 2023-08-09T12:51:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.236+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb80b3050 con 0x7f7fb8160030 2023-08-09T12:51:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.238+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb804e390 con 0x7f7fb8160030 2023-08-09T12:51:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.239+0000 7f7fb4ff9640 1 -- 172.21.15.17:0/3889121313 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7fb001d3b0 con 0x7f7fb8160030 2023-08-09T12:51:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.240+0000 7f7fb4ff9640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f9806a050 0x7f7f9806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.240+0000 7f7fb4ff9640 1 -- 172.21.15.17:0/3889121313 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fb0088590 con 0x7f7fb8160030 2023-08-09T12:51:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.240+0000 7f7fb6ffd640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f9806a050 0x7f7f9806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.242+0000 7f7fb6ffd640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f9806a050 0x7f7f9806c510 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8001540 tx=0x7f7fa80079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.244+0000 7f7fb4ff9640 1 -- 172.21.15.17:0/3889121313 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7fb0053be0 con 0x7f7fb8160030 2023-08-09T12:51:40.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.433+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fb8161250 con 0x7f7f9806a050 2023-08-09T12:51:40.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.457+0000 7f7fb4ff9640 1 -- 172.21.15.17:0/3889121313 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303151 (secure 0 0 0) 0x7f7fa80070d0 con 0x7f7f9806a050 2023-08-09T12:51:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:40.465 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:51:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f9806a050 msgr2=0x7f7f9806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f9806a050 0x7f7f9806c510 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8001540 tx=0x7f7fa80079c0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8160030 msgr2=0x7f7fb80b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8160030 0x7f7fb80b4120 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000b970 tx=0x7f7fb000be30 comp rx=0 tx=0).stop 2023-08-09T12:51:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 shutdown_connections 2023-08-09T12:51:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7f9806a050 0x7f7f9806c510 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8160030 0x7f7fb80b4120 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7fb80cf980 0x7f7fb80cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 --2- 172.21.15.17:0/3889121313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fb80b86e0 0x7f7fb8149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 >> 172.21.15.17:0/3889121313 conn(0x7f7fb80697c0 msgr2=0x7f7fb80c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 shutdown_connections 2023-08-09T12:51:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:40.463+0000 7f7fb7fff640 1 -- 172.21.15.17:0/3889121313 wait complete. 2023-08-09T12:51:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-08-09T12:51:38.918181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553179,"statfs":{"total":1600000000,"available":1590455676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.084756"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277893+0000","last_change":"2023-08-09T12:51:33.904326+0000","last_active":"2023-08-09T12:51:35.277893+0000","last_peered":"2023-08-09T12:51:35.277893+0000","last_clean":"2023-08-09T12:51:35.277893+0000","last_became_active":"2023-08-09T12:51:33.904101+0000","last_became_peered":"2023-08-09T12:51:33.904101+0000","last_unstale":"2023-08-09T12:51:35.277893+0000","last_undegraded":"2023-08-09T12:51:35.277893+0000","last_fullsized":"2023-08-09T12:51:35.277893+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:03:20.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867951+0000","last_change":"2023-08-09T12:51:33.892059+0000","last_active":"2023-08-09T12:51:34.867951+0000","last_peered":"2023-08-09T12:51:34.867951+0000","last_clean":"2023-08-09T12:51:34.867951+0000","last_became_active":"2023-08-09T12:51:33.891669+0000","last_became_peered":"2023-08-09T12:51:33.891669+0000","last_unstale":"2023-08-09T12:51:34.867951+0000","last_undegraded":"2023-08-09T12:51:34.867951+0000","last_fullsized":"2023-08-09T12:51:34.867951+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:57:15.133730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868200+0000","last_change":"2023-08-09T12:51:33.883993+0000","last_active":"2023-08-09T12:51:34.868200+0000","last_peered":"2023-08-09T12:51:34.868200+0000","last_clean":"2023-08-09T12:51:34.868200+0000","last_became_active":"2023-08-09T12:51:33.883575+0000","last_became_peered":"2023-08-09T12:51:33.883575+0000","last_unstale":"2023-08-09T12:51:34.868200+0000","last_undegraded":"2023-08-09T12:51:34.868200+0000","last_fullsized":"2023-08-09T12:51:34.868200+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:15.482835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274312+0000","last_change":"2023-08-09T12:51:33.888118+0000","last_active":"2023-08-09T12:51:35.274312+0000","last_peered":"2023-08-09T12:51:35.274312+0000","last_clean":"2023-08-09T12:51:35.274312+0000","last_became_active":"2023-08-09T12:51:33.887560+0000","last_became_peered":"2023-08-09T12:51:33.887560+0000","last_unstale":"2023-08-09T12:51:35.274312+0000","last_undegraded":"2023-08-09T12:51:35.274312+0000","last_fullsized":"2023-08-09T12:51:35.274312+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:53:32.403752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867115+0000","last_change":"2023-08-09T12:51:33.900726+0000","last_active":"2023-08-09T12:51:34.867115+0000","last_peered":"2023-08-09T12:51:34.867115+0000","last_clean":"2023-08-09T12:51:34.867115+0000","last_became_active":"2023-08-09T12:51:33.899784+0000","last_became_peered":"2023-08-09T12:51:33.899784+0000","last_unstale":"2023-08-09T12:51:34.867115+0000","last_undegraded":"2023-08-09T12:51:34.867115+0000","last_fullsized":"2023-08-09T12:51:34.867115+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:45.820262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866175+0000","last_change":"2023-08-09T12:51:33.892942+0000","last_active":"2023-08-09T12:51:34.866175+0000","last_peered":"2023-08-09T12:51:34.866175+0000","last_clean":"2023-08-09T12:51:34.866175+0000","last_became_active":"2023-08-09T12:51:33.892647+0000","last_became_peered":"2023-08-09T12:51:33.892647+0000","last_unstale":"2023-08-09T12:51:34.866175+0000","last_undegraded":"2023-08-09T12:51:34.866175+0000","last_fullsized":"2023-08-09T12:51:34.866175+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:48:24.516600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277774+0000","last_change":"2023-08-09T12:51:33.895884+0000","last_active":"2023-08-09T12:51:35.277774+0000","last_peered":"2023-08-09T12:51:35.277774+0000","last_clean":"2023-08-09T12:51:35.277774+0000","last_became_active":"2023-08-09T12:51:33.895512+0000","last_became_peered":"2023-08-09T12:51:33.895512+0000","last_unstale":"2023-08-09T12:51:35.277774+0000","last_undegraded":"2023-08-09T12:51:35.277774+0000","last_fullsized":"2023-08-09T12:51:35.277774+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:20.598824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274691+0000","last_change":"2023-08-09T12:51:33.893650+0000","last_active":"2023-08-09T12:51:35.274691+0000","last_peered":"2023-08-09T12:51:35.274691+0000","last_clean":"2023-08-09T12:51:35.274691+0000","last_became_active":"2023-08-09T12:51:33.892816+0000","last_became_peered":"2023-08-09T12:51:33.892816+0000","last_unstale":"2023-08-09T12:51:35.274691+0000","last_undegraded":"2023-08-09T12:51:35.274691+0000","last_fullsized":"2023-08-09T12:51:35.274691+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:54.383368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866312+0000","last_change":"2023-08-09T12:51:33.873816+0000","last_active":"2023-08-09T12:51:34.866312+0000","last_peered":"2023-08-09T12:51:34.866312+0000","last_clean":"2023-08-09T12:51:34.866312+0000","last_became_active":"2023-08-09T12:51:33.872398+0000","last_became_peered":"2023-08-09T12:51:33.872398+0000","last_unstale":"2023-08-09T12:51:34.866312+0000","last_undegraded":"2023-08-09T12:51:34.866312+0000","last_fullsized":"2023-08-09T12:51:34.866312+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:21:23.831320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867220+0000","last_change":"2023-08-09T12:51:33.881426+0000","last_active":"2023-08-09T12:51:34.867220+0000","last_peered":"2023-08-09T12:51:34.867220+0000","last_clean":"2023-08-09T12:51:34.867220+0000","last_became_active":"2023-08-09T12:51:33.881173+0000","last_became_peered":"2023-08-09T12:51:33.881173+0000","last_unstale":"2023-08-09T12:51:34.867220+0000","last_undegraded":"2023-08-09T12:51:34.867220+0000","last_fullsized":"2023-08-09T12:51:34.867220+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:51:55.545505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274185+0000","last_change":"2023-08-09T12:51:33.879404+0000","last_active":"2023-08-09T12:51:35.274185+0000","last_peered":"2023-08-09T12:51:35.274185+0000","last_clean":"2023-08-09T12:51:35.274185+0000","last_became_active":"2023-08-09T12:51:33.879167+0000","last_became_peered":"2023-08-09T12:51:33.879167+0000","last_unstale":"2023-08-09T12:51:35.274185+0000","last_undegraded":"2023-08-09T12:51:35.274185+0000","last_fullsized":"2023-08-09T12:51:35.274185+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:46:47.899147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275247+0000","last_change":"2023-08-09T12:51:33.881233+0000","last_active":"2023-08-09T12:51:35.275247+0000","last_peered":"2023-08-09T12:51:35.275247+0000","last_clean":"2023-08-09T12:51:35.275247+0000","last_became_active":"2023-08-09T12:51:33.875953+0000","last_became_peered":"2023-08-09T12:51:33.875953+0000","last_unstale":"2023-08-09T12:51:35.275247+0000","last_undegraded":"2023-08-09T12:51:35.275247+0000","last_fullsized":"2023-08-09T12:51:35.275247+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:10:15.843221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865876+0000","last_change":"2023-08-09T12:51:33.881396+0000","last_active":"2023-08-09T12:51:34.865876+0000","last_peered":"2023-08-09T12:51:34.865876+0000","last_clean":"2023-08-09T12:51:34.865876+0000","last_became_active":"2023-08-09T12:51:33.881150+0000","last_became_peered":"2023-08-09T12:51:33.881150+0000","last_unstale":"2023-08-09T12:51:34.865876+0000","last_undegraded":"2023-08-09T12:51:34.865876+0000","last_fullsized":"2023-08-09T12:51:34.865876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:20.022303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274652+0000","last_change":"2023-08-09T12:51:33.881970+0000","last_active":"2023-08-09T12:51:35.274652+0000","last_peered":"2023-08-09T12:51:35.274652+0000","last_clean":"2023-08-09T12:51:35.274652+0000","last_became_active":"2023-08-09T12:51:33.877427+0000","last_became_peered":"2023-08-09T12:51:33.877427+0000","last_unstale":"2023-08-09T12:51:35.274652+0000","last_undegraded":"2023-08-09T12:51:35.274652+0000","last_fullsized":"2023-08-09T12:51:35.274652+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:35:24.449447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868292+0000","last_change":"2023-08-09T12:51:33.892666+0000","last_active":"2023-08-09T12:51:34.868292+0000","last_peered":"2023-08-09T12:51:34.868292+0000","last_clean":"2023-08-09T12:51:34.868292+0000","last_became_active":"2023-08-09T12:51:33.892278+0000","last_became_peered":"2023-08-09T12:51:33.892278+0000","last_unstale":"2023-08-09T12:51:34.868292+0000","last_undegraded":"2023-08-09T12:51:34.868292+0000","last_fullsized":"2023-08-09T12:51:34.868292+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:43:27.271570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866377+0000","last_change":"2023-08-09T12:51:33.903306+0000","last_active":"2023-08-09T12:51:34.866377+0000","last_peered":"2023-08-09T12:51:34.866377+0000","last_clean":"2023-08-09T12:51:34.866377+0000","last_became_active":"2023-08-09T12:51:33.903105+0000","last_became_peered":"2023-08-09T12:51:33.903105+0000","last_unstale":"2023-08-09T12:51:34.866377+0000","last_undegraded":"2023-08-09T12:51:34.866377+0000","last_fullsized":"2023-08-09T12:51:34.866377+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:49:30.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276751+0000","last_change":"2023-08-09T12:51:33.888560+0000","last_active":"2023-08-09T12:51:35.276751+0000","last_peered":"2023-08-09T12:51:35.276751+0000","last_clean":"2023-08-09T12:51:35.276751+0000","last_became_active":"2023-08-09T12:51:33.886503+0000","last_became_peered":"2023-08-09T12:51:33.886503+0000","last_unstale":"2023-08-09T12:51:35.276751+0000","last_undegraded":"2023-08-09T12:51:35.276751+0000","last_fullsized":"2023-08-09T12:51:35.276751+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:30:40.865504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274623+0000","last_change":"2023-08-09T12:51:33.893072+0000","last_active":"2023-08-09T12:51:35.274623+0000","last_peered":"2023-08-09T12:51:35.274623+0000","last_clean":"2023-08-09T12:51:35.274623+0000","last_became_active":"2023-08-09T12:51:33.892780+0000","last_became_peered":"2023-08-09T12:51:33.892780+0000","last_unstale":"2023-08-09T12:51:35.274623+0000","last_undegraded":"2023-08-09T12:51:35.274623+0000","last_fullsized":"2023-08-09T12:51:35.274623+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:07.759806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866857+0000","last_change":"2023-08-09T12:51:33.895991+0000","last_active":"2023-08-09T12:51:34.866857+0000","last_peered":"2023-08-09T12:51:34.866857+0000","last_clean":"2023-08-09T12:51:34.866857+0000","last_became_active":"2023-08-09T12:51:33.895733+0000","last_became_peered":"2023-08-09T12:51:33.895733+0000","last_unstale":"2023-08-09T12:51:34.866857+0000","last_undegraded":"2023-08-09T12:51:34.866857+0000","last_fullsized":"2023-08-09T12:51:34.866857+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:04:53.900797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274226+0000","last_change":"2023-08-09T12:51:33.884956+0000","last_active":"2023-08-09T12:51:35.274226+0000","last_peered":"2023-08-09T12:51:35.274226+0000","last_clean":"2023-08-09T12:51:35.274226+0000","last_became_active":"2023-08-09T12:51:33.884406+0000","last_became_peered":"2023-08-09T12:51:33.884406+0000","last_unstale":"2023-08-09T12:51:35.274226+0000","last_undegraded":"2023-08-09T12:51:35.274226+0000","last_fullsized":"2023-08-09T12:51:35.274226+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:02.208478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866582+0000","last_change":"2023-08-09T12:51:33.874719+0000","last_active":"2023-08-09T12:51:34.866582+0000","last_peered":"2023-08-09T12:51:34.866582+0000","last_clean":"2023-08-09T12:51:34.866582+0000","last_became_active":"2023-08-09T12:51:33.874474+0000","last_became_peered":"2023-08-09T12:51:33.874474+0000","last_unstale":"2023-08-09T12:51:34.866582+0000","last_undegraded":"2023-08-09T12:51:34.866582+0000","last_fullsized":"2023-08-09T12:51:34.866582+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:32:50.741381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278149+0000","last_change":"2023-08-09T12:51:33.895751+0000","last_active":"2023-08-09T12:51:35.278149+0000","last_peered":"2023-08-09T12:51:35.278149+0000","last_clean":"2023-08-09T12:51:35.278149+0000","last_became_active":"2023-08-09T12:51:33.895191+0000","last_became_peered":"2023-08-09T12:51:33.895191+0000","last_unstale":"2023-08-09T12:51:35.278149+0000","last_undegraded":"2023-08-09T12:51:35.278149+0000","last_fullsized":"2023-08-09T12:51:35.278149+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:17.416780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275049+0000","last_change":"2023-08-09T12:51:33.900991+0000","last_active":"2023-08-09T12:51:35.275049+0000","last_peered":"2023-08-09T12:51:35.275049+0000","last_clean":"2023-08-09T12:51:35.275049+0000","last_became_active":"2023-08-09T12:51:33.900647+0000","last_became_peered":"2023-08-09T12:51:33.900647+0000","last_unstale":"2023-08-09T12:51:35.275049+0000","last_undegraded":"2023-08-09T12:51:35.275049+0000","last_fullsized":"2023-08-09T12:51:35.275049+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:53.043419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273521+0000","last_change":"2023-08-09T12:51:33.876293+0000","last_active":"2023-08-09T12:51:35.273521+0000","last_peered":"2023-08-09T12:51:35.273521+0000","last_clean":"2023-08-09T12:51:35.273521+0000","last_became_active":"2023-08-09T12:51:33.875899+0000","last_became_peered":"2023-08-09T12:51:33.875899+0000","last_unstale":"2023-08-09T12:51:35.273521+0000","last_undegraded":"2023-08-09T12:51:35.273521+0000","last_fullsized":"2023-08-09T12:51:35.273521+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:59:11.033578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277261+0000","last_change":"2023-08-09T12:51:33.896400+0000","last_active":"2023-08-09T12:51:35.277261+0000","last_peered":"2023-08-09T12:51:35.277261+0000","last_clean":"2023-08-09T12:51:35.277261+0000","last_became_active":"2023-08-09T12:51:33.895863+0000","last_became_peered":"2023-08-09T12:51:33.895863+0000","last_unstale":"2023-08-09T12:51:35.277261+0000","last_undegraded":"2023-08-09T12:51:35.277261+0000","last_fullsized":"2023-08-09T12:51:35.277261+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:01.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278112+0000","last_change":"2023-08-09T12:51:33.892186+0000","last_active":"2023-08-09T12:51:35.278112+0000","last_peered":"2023-08-09T12:51:35.278112+0000","last_clean":"2023-08-09T12:51:35.278112+0000","last_became_active":"2023-08-09T12:51:33.891907+0000","last_became_peered":"2023-08-09T12:51:33.891907+0000","last_unstale":"2023-08-09T12:51:35.278112+0000","last_undegraded":"2023-08-09T12:51:35.278112+0000","last_fullsized":"2023-08-09T12:51:35.278112+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:29:21.732714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866591+0000","last_change":"2023-08-09T12:51:33.873172+0000","last_active":"2023-08-09T12:51:34.866591+0000","last_peered":"2023-08-09T12:51:34.866591+0000","last_clean":"2023-08-09T12:51:34.866591+0000","last_became_active":"2023-08-09T12:51:33.872428+0000","last_became_peered":"2023-08-09T12:51:33.872428+0000","last_unstale":"2023-08-09T12:51:34.866591+0000","last_undegraded":"2023-08-09T12:51:34.866591+0000","last_fullsized":"2023-08-09T12:51:34.866591+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:53.792171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274891+0000","last_change":"2023-08-09T12:51:33.881282+0000","last_active":"2023-08-09T12:51:35.274891+0000","last_peered":"2023-08-09T12:51:35.274891+0000","last_clean":"2023-08-09T12:51:35.274891+0000","last_became_active":"2023-08-09T12:51:33.881015+0000","last_became_peered":"2023-08-09T12:51:33.881015+0000","last_unstale":"2023-08-09T12:51:35.274891+0000","last_undegraded":"2023-08-09T12:51:35.274891+0000","last_fullsized":"2023-08-09T12:51:35.274891+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:07:51.764288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276035+0000","last_change":"2023-08-09T12:51:33.897415+0000","last_active":"2023-08-09T12:51:35.276035+0000","last_peered":"2023-08-09T12:51:35.276035+0000","last_clean":"2023-08-09T12:51:35.276035+0000","last_became_active":"2023-08-09T12:51:33.893957+0000","last_became_peered":"2023-08-09T12:51:33.893957+0000","last_unstale":"2023-08-09T12:51:35.276035+0000","last_undegraded":"2023-08-09T12:51:35.276035+0000","last_fullsized":"2023-08-09T12:51:35.276035+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:05.411567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274201+0000","last_change":"2023-08-09T12:51:33.874521+0000","last_active":"2023-08-09T12:51:35.274201+0000","last_peered":"2023-08-09T12:51:35.274201+0000","last_clean":"2023-08-09T12:51:35.274201+0000","last_became_active":"2023-08-09T12:51:33.874258+0000","last_became_peered":"2023-08-09T12:51:33.874258+0000","last_unstale":"2023-08-09T12:51:35.274201+0000","last_undegraded":"2023-08-09T12:51:35.274201+0000","last_fullsized":"2023-08-09T12:51:35.274201+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:32:51.770229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866803+0000","last_change":"2023-08-09T12:51:33.900307+0000","last_active":"2023-08-09T12:51:34.866803+0000","last_peered":"2023-08-09T12:51:34.866803+0000","last_clean":"2023-08-09T12:51:34.866803+0000","last_became_active":"2023-08-09T12:51:33.899704+0000","last_became_peered":"2023-08-09T12:51:33.899704+0000","last_unstale":"2023-08-09T12:51:34.866803+0000","last_undegraded":"2023-08-09T12:51:34.866803+0000","last_fullsized":"2023-08-09T12:51:34.866803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:42:45.312893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275236+0000","last_change":"2023-08-09T12:51:33.900717+0000","last_active":"2023-08-09T12:51:35.275236+0000","last_peered":"2023-08-09T12:51:35.275236+0000","last_clean":"2023-08-09T12:51:35.275236+0000","last_became_active":"2023-08-09T12:51:33.896549+0000","last_became_peered":"2023-08-09T12:51:33.896549+0000","last_unstale":"2023-08-09T12:51:35.275236+0000","last_undegraded":"2023-08-09T12:51:35.275236+0000","last_fullsized":"2023-08-09T12:51:35.275236+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:49:30.119634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868136+0000","last_change":"2023-08-09T12:51:33.881948+0000","last_active":"2023-08-09T12:51:34.868136+0000","last_peered":"2023-08-09T12:51:34.868136+0000","last_clean":"2023-08-09T12:51:34.868136+0000","last_became_active":"2023-08-09T12:51:33.881674+0000","last_became_peered":"2023-08-09T12:51:33.881674+0000","last_unstale":"2023-08-09T12:51:34.868136+0000","last_undegraded":"2023-08-09T12:51:34.868136+0000","last_fullsized":"2023-08-09T12:51:34.868136+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:19:26.933566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"174'4","reported_seq":17,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866262+0000","last_change":"2023-08-09T12:51:32.856874+0000","last_active":"2023-08-09T12:51:34.866262+0000","last_peered":"2023-08-09T12:51:34.866262+0000","last_clean":"2023-08-09T12:51:34.866262+0000","last_became_active":"2023-08-09T12:51:32.856173+0000","last_became_peered":"2023-08-09T12:51:32.856173+0000","last_unstale":"2023-08-09T12:51:34.866262+0000","last_undegraded":"2023-08-09T12:51:34.866262+0000","last_fullsized":"2023-08-09T12:51:34.866262+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:30:50.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868482+0000","last_change":"2023-08-09T12:51:33.892503+0000","last_active":"2023-08-09T12:51:34.868482+0000","last_peered":"2023-08-09T12:51:34.868482+0000","last_clean":"2023-08-09T12:51:34.868482+0000","last_became_active":"2023-08-09T12:51:33.891683+0000","last_became_peered":"2023-08-09T12:51:33.891683+0000","last_unstale":"2023-08-09T12:51:34.868482+0000","last_undegraded":"2023-08-09T12:51:34.868482+0000","last_fullsized":"2023-08-09T12:51:34.868482+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:16.024680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865281+0000","last_change":"2023-08-09T12:51:32.861940+0000","last_active":"2023-08-09T12:51:34.865281+0000","last_peered":"2023-08-09T12:51:34.865281+0000","last_clean":"2023-08-09T12:51:34.865281+0000","last_became_active":"2023-08-09T12:51:32.858863+0000","last_became_peered":"2023-08-09T12:51:32.858863+0000","last_unstale":"2023-08-09T12:51:34.865281+0000","last_undegraded":"2023-08-09T12:51:34.865281+0000","last_fullsized":"2023-08-09T12:51:34.865281+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:00:53.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276429+0000","last_change":"2023-08-09T12:51:33.899436+0000","last_active":"2023-08-09T12:51:35.276429+0000","last_peered":"2023-08-09T12:51:35.276429+0000","last_clean":"2023-08-09T12:51:35.276429+0000","last_became_active":"2023-08-09T12:51:33.898318+0000","last_became_peered":"2023-08-09T12:51:33.898318+0000","last_unstale":"2023-08-09T12:51:35.276429+0000","last_undegraded":"2023-08-09T12:51:35.276429+0000","last_fullsized":"2023-08-09T12:51:35.276429+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:44:30.192363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865665+0000","last_change":"2023-08-09T12:51:32.857688+0000","last_active":"2023-08-09T12:51:34.865665+0000","last_peered":"2023-08-09T12:51:34.865665+0000","last_clean":"2023-08-09T12:51:34.865665+0000","last_became_active":"2023-08-09T12:51:32.857349+0000","last_became_peered":"2023-08-09T12:51:32.857349+0000","last_unstale":"2023-08-09T12:51:34.865665+0000","last_undegraded":"2023-08-09T12:51:34.865665+0000","last_fullsized":"2023-08-09T12:51:34.865665+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:37.178113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865837+0000","last_change":"2023-08-09T12:51:33.891415+0000","last_active":"2023-08-09T12:51:34.865837+0000","last_peered":"2023-08-09T12:51:34.865837+0000","last_clean":"2023-08-09T12:51:34.865837+0000","last_became_active":"2023-08-09T12:51:33.891108+0000","last_became_peered":"2023-08-09T12:51:33.891108+0000","last_unstale":"2023-08-09T12:51:34.865837+0000","last_undegraded":"2023-08-09T12:51:34.865837+0000","last_fullsized":"2023-08-09T12:51:34.865837+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:17:05.671478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868335+0000","last_change":"2023-08-09T12:51:32.855138+0000","last_active":"2023-08-09T12:51:34.868335+0000","last_peered":"2023-08-09T12:51:34.868335+0000","last_clean":"2023-08-09T12:51:34.868335+0000","last_became_active":"2023-08-09T12:51:32.854680+0000","last_became_peered":"2023-08-09T12:51:32.854680+0000","last_unstale":"2023-08-09T12:51:34.868335+0000","last_undegraded":"2023-08-09T12:51:34.868335+0000","last_fullsized":"2023-08-09T12:51:34.868335+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:01:02.364600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273802+0000","last_change":"2023-08-09T12:51:33.885141+0000","last_active":"2023-08-09T12:51:35.273802+0000","last_peered":"2023-08-09T12:51:35.273802+0000","last_clean":"2023-08-09T12:51:35.273802+0000","last_became_active":"2023-08-09T12:51:33.884727+0000","last_became_peered":"2023-08-09T12:51:33.884727+0000","last_unstale":"2023-08-09T12:51:35.273802+0000","last_undegraded":"2023-08-09T12:51:35.273802+0000","last_fullsized":"2023-08-09T12:51:35.273802+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:59.574268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275649+0000","last_change":"2023-08-09T12:51:32.860052+0000","last_active":"2023-08-09T12:51:35.275649+0000","last_peered":"2023-08-09T12:51:35.275649+0000","last_clean":"2023-08-09T12:51:35.275649+0000","last_became_active":"2023-08-09T12:51:32.859796+0000","last_became_peered":"2023-08-09T12:51:32.859796+0000","last_unstale":"2023-08-09T12:51:35.275649+0000","last_undegraded":"2023-08-09T12:51:35.275649+0000","last_fullsized":"2023-08-09T12:51:35.275649+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:05.055340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275033+0000","last_change":"2023-08-09T12:51:33.882400+0000","last_active":"2023-08-09T12:51:35.275033+0000","last_peered":"2023-08-09T12:51:35.275033+0000","last_clean":"2023-08-09T12:51:35.275033+0000","last_became_active":"2023-08-09T12:51:33.878219+0000","last_became_peered":"2023-08-09T12:51:33.878219+0000","last_unstale":"2023-08-09T12:51:35.275033+0000","last_undegraded":"2023-08-09T12:51:35.275033+0000","last_fullsized":"2023-08-09T12:51:35.275033+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:43.824234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866386+0000","last_change":"2023-08-09T12:51:32.857082+0000","last_active":"2023-08-09T12:51:34.866386+0000","last_peered":"2023-08-09T12:51:34.866386+0000","last_clean":"2023-08-09T12:51:34.866386+0000","last_became_active":"2023-08-09T12:51:32.856554+0000","last_became_peered":"2023-08-09T12:51:32.856554+0000","last_unstale":"2023-08-09T12:51:34.866386+0000","last_undegraded":"2023-08-09T12:51:34.866386+0000","last_fullsized":"2023-08-09T12:51:34.866386+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:54.641005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867863+0000","last_change":"2023-08-09T12:51:33.883822+0000","last_active":"2023-08-09T12:51:34.867863+0000","last_peered":"2023-08-09T12:51:34.867863+0000","last_clean":"2023-08-09T12:51:34.867863+0000","last_became_active":"2023-08-09T12:51:33.883219+0000","last_became_peered":"2023-08-09T12:51:33.883219+0000","last_unstale":"2023-08-09T12:51:34.867863+0000","last_undegraded":"2023-08-09T12:51:34.867863+0000","last_fullsized":"2023-08-09T12:51:34.867863+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:44.448229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274400+0000","last_change":"2023-08-09T12:51:32.855186+0000","last_active":"2023-08-09T12:51:35.274400+0000","last_peered":"2023-08-09T12:51:35.274400+0000","last_clean":"2023-08-09T12:51:35.274400+0000","last_became_active":"2023-08-09T12:51:32.854035+0000","last_became_peered":"2023-08-09T12:51:32.854035+0000","last_unstale":"2023-08-09T12:51:35.274400+0000","last_undegraded":"2023-08-09T12:51:35.274400+0000","last_fullsized":"2023-08-09T12:51:35.274400+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:38.153645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278973+0000","last_change":"2023-08-09T12:51:33.898553+0000","last_active":"2023-08-09T12:51:35.278973+0000","last_peered":"2023-08-09T12:51:35.278973+0000","last_clean":"2023-08-09T12:51:35.278973+0000","last_became_active":"2023-08-09T12:51:33.898257+0000","last_became_peered":"2023-08-09T12:51:33.898257+0000","last_unstale":"2023-08-09T12:51:35.278973+0000","last_undegraded":"2023-08-09T12:51:35.278973+0000","last_fullsized":"2023-08-09T12:51:35.278973+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:41.562586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866867+0000","last_change":"2023-08-09T12:51:32.859417+0000","last_active":"2023-08-09T12:51:34.866867+0000","last_peered":"2023-08-09T12:51:34.866867+0000","last_clean":"2023-08-09T12:51:34.866867+0000","last_became_active":"2023-08-09T12:51:32.858622+0000","last_became_peered":"2023-08-09T12:51:32.858622+0000","last_unstale":"2023-08-09T12:51:34.866867+0000","last_undegraded":"2023-08-09T12:51:34.866867+0000","last_fullsized":"2023-08-09T12:51:34.866867+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:33.744391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865962+0000","last_change":"2023-08-09T12:51:33.871741+0000","last_active":"2023-08-09T12:51:34.865962+0000","last_peered":"2023-08-09T12:51:34.865962+0000","last_clean":"2023-08-09T12:51:34.865962+0000","last_became_active":"2023-08-09T12:51:33.870747+0000","last_became_peered":"2023-08-09T12:51:33.870747+0000","last_unstale":"2023-08-09T12:51:34.865962+0000","last_undegraded":"2023-08-09T12:51:34.865962+0000","last_fullsized":"2023-08-09T12:51:34.865962+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:39:30.139919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273914+0000","last_change":"2023-08-09T12:51:32.849945+0000","last_active":"2023-08-09T12:51:35.273914+0000","last_peered":"2023-08-09T12:51:35.273914+0000","last_clean":"2023-08-09T12:51:35.273914+0000","last_became_active":"2023-08-09T12:51:32.848584+0000","last_became_peered":"2023-08-09T12:51:32.848584+0000","last_unstale":"2023-08-09T12:51:35.273914+0000","last_undegraded":"2023-08-09T12:51:35.273914+0000","last_fullsized":"2023-08-09T12:51:35.273914+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:53:06.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866284+0000","last_change":"2023-08-09T12:51:33.902440+0000","last_active":"2023-08-09T12:51:34.866284+0000","last_peered":"2023-08-09T12:51:34.866284+0000","last_clean":"2023-08-09T12:51:34.866284+0000","last_became_active":"2023-08-09T12:51:33.902206+0000","last_became_peered":"2023-08-09T12:51:33.902206+0000","last_unstale":"2023-08-09T12:51:34.866284+0000","last_undegraded":"2023-08-09T12:51:34.866284+0000","last_fullsized":"2023-08-09T12:51:34.866284+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:39:16.421607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866163+0000","last_change":"2023-08-09T12:51:32.851188+0000","last_active":"2023-08-09T12:51:34.866163+0000","last_peered":"2023-08-09T12:51:34.866163+0000","last_clean":"2023-08-09T12:51:34.866163+0000","last_became_active":"2023-08-09T12:51:32.850562+0000","last_became_peered":"2023-08-09T12:51:32.850562+0000","last_unstale":"2023-08-09T12:51:34.866163+0000","last_undegraded":"2023-08-09T12:51:34.866163+0000","last_fullsized":"2023-08-09T12:51:34.866163+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:08.058703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277611+0000","last_change":"2023-08-09T12:51:33.899696+0000","last_active":"2023-08-09T12:51:35.277611+0000","last_peered":"2023-08-09T12:51:35.277611+0000","last_clean":"2023-08-09T12:51:35.277611+0000","last_became_active":"2023-08-09T12:51:33.899323+0000","last_became_peered":"2023-08-09T12:51:33.899323+0000","last_unstale":"2023-08-09T12:51:35.277611+0000","last_undegraded":"2023-08-09T12:51:35.277611+0000","last_fullsized":"2023-08-09T12:51:35.277611+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:15:33.161521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868518+0000","last_change":"2023-08-09T12:51:32.855685+0000","last_active":"2023-08-09T12:51:34.868518+0000","last_peered":"2023-08-09T12:51:34.868518+0000","last_clean":"2023-08-09T12:51:34.868518+0000","last_became_active":"2023-08-09T12:51:32.855417+0000","last_became_peered":"2023-08-09T12:51:32.855417+0000","last_unstale":"2023-08-09T12:51:34.868518+0000","last_undegraded":"2023-08-09T12:51:34.868518+0000","last_fullsized":"2023-08-09T12:51:34.868518+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:19.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274174+0000","last_change":"2023-08-09T12:51:33.892641+0000","last_active":"2023-08-09T12:51:35.274174+0000","last_peered":"2023-08-09T12:51:35.274174+0000","last_clean":"2023-08-09T12:51:35.274174+0000","last_became_active":"2023-08-09T12:51:33.892346+0000","last_became_peered":"2023-08-09T12:51:33.892346+0000","last_unstale":"2023-08-09T12:51:35.274174+0000","last_undegraded":"2023-08-09T12:51:35.274174+0000","last_fullsized":"2023-08-09T12:51:35.274174+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:04:34.192804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276341+0000","last_change":"2023-08-09T12:51:32.862265+0000","last_active":"2023-08-09T12:51:35.276341+0000","last_peered":"2023-08-09T12:51:35.276341+0000","last_clean":"2023-08-09T12:51:35.276341+0000","last_became_active":"2023-08-09T12:51:32.861143+0000","last_became_peered":"2023-08-09T12:51:32.861143+0000","last_unstale":"2023-08-09T12:51:35.276341+0000","last_undegraded":"2023-08-09T12:51:35.276341+0000","last_fullsized":"2023-08-09T12:51:35.276341+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:53:57.729979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867023+0000","last_change":"2023-08-09T12:51:33.903667+0000","last_active":"2023-08-09T12:51:34.867023+0000","last_peered":"2023-08-09T12:51:34.867023+0000","last_clean":"2023-08-09T12:51:34.867023+0000","last_became_active":"2023-08-09T12:51:33.903429+0000","last_became_peered":"2023-08-09T12:51:33.903429+0000","last_unstale":"2023-08-09T12:51:34.867023+0000","last_undegraded":"2023-08-09T12:51:34.867023+0000","last_fullsized":"2023-08-09T12:51:34.867023+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:15.451184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274043+0000","last_change":"2023-08-09T12:51:32.857424+0000","last_active":"2023-08-09T12:51:35.274043+0000","last_peered":"2023-08-09T12:51:35.274043+0000","last_clean":"2023-08-09T12:51:35.274043+0000","last_became_active":"2023-08-09T12:51:32.857037+0000","last_became_peered":"2023-08-09T12:51:32.857037+0000","last_unstale":"2023-08-09T12:51:35.274043+0000","last_undegraded":"2023-08-09T12:51:35.274043+0000","last_fullsized":"2023-08-09T12:51:35.274043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:28.628180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868727+0000","last_change":"2023-08-09T12:51:33.899302+0000","last_active":"2023-08-09T12:51:34.868727+0000","last_peered":"2023-08-09T12:51:34.868727+0000","last_clean":"2023-08-09T12:51:34.868727+0000","last_became_active":"2023-08-09T12:51:33.899079+0000","last_became_peered":"2023-08-09T12:51:33.899079+0000","last_unstale":"2023-08-09T12:51:34.868727+0000","last_undegraded":"2023-08-09T12:51:34.868727+0000","last_fullsized":"2023-08-09T12:51:34.868727+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:26:00.015430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277502+0000","last_change":"2023-08-09T12:51:32.845829+0000","last_active":"2023-08-09T12:51:35.277502+0000","last_peered":"2023-08-09T12:51:35.277502+0000","last_clean":"2023-08-09T12:51:35.277502+0000","last_became_active":"2023-08-09T12:51:32.845066+0000","last_became_peered":"2023-08-09T12:51:32.845066+0000","last_unstale":"2023-08-09T12:51:35.277502+0000","last_undegraded":"2023-08-09T12:51:35.277502+0000","last_fullsized":"2023-08-09T12:51:35.277502+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:41:40.496305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867660+0000","last_change":"2023-08-09T12:51:33.874607+0000","last_active":"2023-08-09T12:51:34.867660+0000","last_peered":"2023-08-09T12:51:34.867660+0000","last_clean":"2023-08-09T12:51:34.867660+0000","last_became_active":"2023-08-09T12:51:33.873494+0000","last_became_peered":"2023-08-09T12:51:33.873494+0000","last_unstale":"2023-08-09T12:51:34.867660+0000","last_undegraded":"2023-08-09T12:51:34.867660+0000","last_fullsized":"2023-08-09T12:51:34.867660+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:13:24.760727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273926+0000","last_change":"2023-08-09T12:51:32.858425+0000","last_active":"2023-08-09T12:51:35.273926+0000","last_peered":"2023-08-09T12:51:35.273926+0000","last_clean":"2023-08-09T12:51:35.273926+0000","last_became_active":"2023-08-09T12:51:32.858189+0000","last_became_peered":"2023-08-09T12:51:32.858189+0000","last_unstale":"2023-08-09T12:51:35.273926+0000","last_undegraded":"2023-08-09T12:51:35.273926+0000","last_fullsized":"2023-08-09T12:51:35.273926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:20.381398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868009+0000","last_change":"2023-08-09T12:51:33.892220+0000","last_active":"2023-08-09T12:51:34.868009+0000","last_peered":"2023-08-09T12:51:34.868009+0000","last_clean":"2023-08-09T12:51:34.868009+0000","last_became_active":"2023-08-09T12:51:33.891968+0000","last_became_peered":"2023-08-09T12:51:33.891968+0000","last_unstale":"2023-08-09T12:51:34.868009+0000","last_undegraded":"2023-08-09T12:51:34.868009+0000","last_fullsized":"2023-08-09T12:51:34.868009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:54.338548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277585+0000","last_change":"2023-08-09T12:51:32.853663+0000","last_active":"2023-08-09T12:51:35.277585+0000","last_peered":"2023-08-09T12:51:35.277585+0000","last_clean":"2023-08-09T12:51:35.277585+0000","last_became_active":"2023-08-09T12:51:32.853266+0000","last_became_peered":"2023-08-09T12:51:32.853266+0000","last_unstale":"2023-08-09T12:51:35.277585+0000","last_undegraded":"2023-08-09T12:51:35.277585+0000","last_fullsized":"2023-08-09T12:51:35.277585+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:18.588813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866752+0000","last_change":"2023-08-09T12:51:33.900420+0000","last_active":"2023-08-09T12:51:34.866752+0000","last_peered":"2023-08-09T12:51:34.866752+0000","last_clean":"2023-08-09T12:51:34.866752+0000","last_became_active":"2023-08-09T12:51:33.899333+0000","last_became_peered":"2023-08-09T12:51:33.899333+0000","last_unstale":"2023-08-09T12:51:34.866752+0000","last_undegraded":"2023-08-09T12:51:34.866752+0000","last_fullsized":"2023-08-09T12:51:34.866752+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:46.557912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276986+0000","last_change":"2023-08-09T12:51:32.862064+0000","last_active":"2023-08-09T12:51:35.276986+0000","last_peered":"2023-08-09T12:51:35.276986+0000","last_clean":"2023-08-09T12:51:35.276986+0000","last_became_active":"2023-08-09T12:51:32.860823+0000","last_became_peered":"2023-08-09T12:51:32.860823+0000","last_unstale":"2023-08-09T12:51:35.276986+0000","last_undegraded":"2023-08-09T12:51:35.276986+0000","last_fullsized":"2023-08-09T12:51:35.276986+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:34:48.789394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275388+0000","last_change":"2023-08-09T12:51:33.881581+0000","last_active":"2023-08-09T12:51:35.275388+0000","last_peered":"2023-08-09T12:51:35.275388+0000","last_clean":"2023-08-09T12:51:35.275388+0000","last_became_active":"2023-08-09T12:51:33.876210+0000","last_became_peered":"2023-08-09T12:51:33.876210+0000","last_unstale":"2023-08-09T12:51:35.275388+0000","last_undegraded":"2023-08-09T12:51:35.275388+0000","last_fullsized":"2023-08-09T12:51:35.275388+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:44:36.682984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276928+0000","last_change":"2023-08-09T12:51:32.855768+0000","last_active":"2023-08-09T12:51:35.276928+0000","last_peered":"2023-08-09T12:51:35.276928+0000","last_clean":"2023-08-09T12:51:35.276928+0000","last_became_active":"2023-08-09T12:51:32.855457+0000","last_became_peered":"2023-08-09T12:51:32.855457+0000","last_unstale":"2023-08-09T12:51:35.276928+0000","last_undegraded":"2023-08-09T12:51:35.276928+0000","last_fullsized":"2023-08-09T12:51:35.276928+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:09:14.295562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276376+0000","last_change":"2023-08-09T12:51:33.900191+0000","last_active":"2023-08-09T12:51:35.276376+0000","last_peered":"2023-08-09T12:51:35.276376+0000","last_clean":"2023-08-09T12:51:35.276376+0000","last_became_active":"2023-08-09T12:51:33.899952+0000","last_became_peered":"2023-08-09T12:51:33.899952+0000","last_unstale":"2023-08-09T12:51:35.276376+0000","last_undegraded":"2023-08-09T12:51:35.276376+0000","last_fullsized":"2023-08-09T12:51:35.276376+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:08:46.269263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867750+0000","last_change":"2023-08-09T12:51:32.851600+0000","last_active":"2023-08-09T12:51:34.867750+0000","last_peered":"2023-08-09T12:51:34.867750+0000","last_clean":"2023-08-09T12:51:34.867750+0000","last_became_active":"2023-08-09T12:51:32.850913+0000","last_became_peered":"2023-08-09T12:51:32.850913+0000","last_unstale":"2023-08-09T12:51:34.867750+0000","last_undegraded":"2023-08-09T12:51:34.867750+0000","last_fullsized":"2023-08-09T12:51:34.867750+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:11:04.736611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866929+0000","last_change":"2023-08-09T12:51:33.877600+0000","last_active":"2023-08-09T12:51:34.866929+0000","last_peered":"2023-08-09T12:51:34.866929+0000","last_clean":"2023-08-09T12:51:34.866929+0000","last_became_active":"2023-08-09T12:51:33.877381+0000","last_became_peered":"2023-08-09T12:51:33.877381+0000","last_unstale":"2023-08-09T12:51:34.866929+0000","last_undegraded":"2023-08-09T12:51:34.866929+0000","last_fullsized":"2023-08-09T12:51:34.866929+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:29:31.658264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867380+0000","last_change":"2023-08-09T12:51:32.860317+0000","last_active":"2023-08-09T12:51:34.867380+0000","last_peered":"2023-08-09T12:51:34.867380+0000","last_clean":"2023-08-09T12:51:34.867380+0000","last_became_active":"2023-08-09T12:51:32.859107+0000","last_became_peered":"2023-08-09T12:51:32.859107+0000","last_unstale":"2023-08-09T12:51:34.867380+0000","last_undegraded":"2023-08-09T12:51:34.867380+0000","last_fullsized":"2023-08-09T12:51:34.867380+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:06.896778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277111+0000","last_change":"2023-08-09T12:51:33.895017+0000","last_active":"2023-08-09T12:51:35.277111+0000","last_peered":"2023-08-09T12:51:35.277111+0000","last_clean":"2023-08-09T12:51:35.277111+0000","last_became_active":"2023-08-09T12:51:33.893038+0000","last_became_peered":"2023-08-09T12:51:33.893038+0000","last_unstale":"2023-08-09T12:51:35.277111+0000","last_undegraded":"2023-08-09T12:51:35.277111+0000","last_fullsized":"2023-08-09T12:51:35.277111+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:10.063766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278235+0000","last_change":"2023-08-09T12:51:32.858298+0000","last_active":"2023-08-09T12:51:35.278235+0000","last_peered":"2023-08-09T12:51:35.278235+0000","last_clean":"2023-08-09T12:51:35.278235+0000","last_became_active":"2023-08-09T12:51:32.857913+0000","last_became_peered":"2023-08-09T12:51:32.857913+0000","last_unstale":"2023-08-09T12:51:35.278235+0000","last_undegraded":"2023-08-09T12:51:35.278235+0000","last_fullsized":"2023-08-09T12:51:35.278235+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:49.090263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274464+0000","last_change":"2023-08-09T12:51:33.874710+0000","last_active":"2023-08-09T12:51:35.274464+0000","last_peered":"2023-08-09T12:51:35.274464+0000","last_clean":"2023-08-09T12:51:35.274464+0000","last_became_active":"2023-08-09T12:51:33.870399+0000","last_became_peered":"2023-08-09T12:51:33.870399+0000","last_unstale":"2023-08-09T12:51:35.274464+0000","last_undegraded":"2023-08-09T12:51:35.274464+0000","last_fullsized":"2023-08-09T12:51:35.274464+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:58:34.269702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273352+0000","last_change":"2023-08-09T12:51:32.845390+0000","last_active":"2023-08-09T12:51:35.273352+0000","last_peered":"2023-08-09T12:51:35.273352+0000","last_clean":"2023-08-09T12:51:35.273352+0000","last_became_active":"2023-08-09T12:51:32.844498+0000","last_became_peered":"2023-08-09T12:51:32.844498+0000","last_unstale":"2023-08-09T12:51:35.273352+0000","last_undegraded":"2023-08-09T12:51:35.273352+0000","last_fullsized":"2023-08-09T12:51:35.273352+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:13:43.634467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868424+0000","last_change":"2023-08-09T12:51:33.897414+0000","last_active":"2023-08-09T12:51:34.868424+0000","last_peered":"2023-08-09T12:51:34.868424+0000","last_clean":"2023-08-09T12:51:34.868424+0000","last_became_active":"2023-08-09T12:51:33.897139+0000","last_became_peered":"2023-08-09T12:51:33.897139+0000","last_unstale":"2023-08-09T12:51:34.868424+0000","last_undegraded":"2023-08-09T12:51:34.868424+0000","last_fullsized":"2023-08-09T12:51:34.868424+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:21:16.180788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277238+0000","last_change":"2023-08-09T12:51:32.860824+0000","last_active":"2023-08-09T12:51:35.277238+0000","last_peered":"2023-08-09T12:51:35.277238+0000","last_clean":"2023-08-09T12:51:35.277238+0000","last_became_active":"2023-08-09T12:51:32.859399+0000","last_became_peered":"2023-08-09T12:51:32.859399+0000","last_unstale":"2023-08-09T12:51:35.277238+0000","last_undegraded":"2023-08-09T12:51:35.277238+0000","last_fullsized":"2023-08-09T12:51:35.277238+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:52.954491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276979+0000","last_change":"2023-08-09T12:51:33.902835+0000","last_active":"2023-08-09T12:51:35.276979+0000","last_peered":"2023-08-09T12:51:35.276979+0000","last_clean":"2023-08-09T12:51:35.276979+0000","last_became_active":"2023-08-09T12:51:33.899388+0000","last_became_peered":"2023-08-09T12:51:33.899388+0000","last_unstale":"2023-08-09T12:51:35.276979+0000","last_undegraded":"2023-08-09T12:51:35.276979+0000","last_fullsized":"2023-08-09T12:51:35.276979+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:16.974365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865644+0000","last_change":"2023-08-09T12:51:32.861212+0000","last_active":"2023-08-09T12:51:34.865644+0000","last_peered":"2023-08-09T12:51:34.865644+0000","last_clean":"2023-08-09T12:51:34.865644+0000","last_became_active":"2023-08-09T12:51:32.857090+0000","last_became_peered":"2023-08-09T12:51:32.857090+0000","last_unstale":"2023-08-09T12:51:34.865644+0000","last_undegraded":"2023-08-09T12:51:34.865644+0000","last_fullsized":"2023-08-09T12:51:34.865644+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:17:12.741012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276666+0000","last_change":"2023-08-09T12:51:33.903329+0000","last_active":"2023-08-09T12:51:35.276666+0000","last_peered":"2023-08-09T12:51:35.276666+0000","last_clean":"2023-08-09T12:51:35.276666+0000","last_became_active":"2023-08-09T12:51:33.899727+0000","last_became_peered":"2023-08-09T12:51:33.899727+0000","last_unstale":"2023-08-09T12:51:35.276666+0000","last_undegraded":"2023-08-09T12:51:35.276666+0000","last_fullsized":"2023-08-09T12:51:35.276666+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:40.751286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"174'6","reported_seq":19,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273350+0000","last_change":"2023-08-09T12:51:32.850475+0000","last_active":"2023-08-09T12:51:35.273350+0000","last_peered":"2023-08-09T12:51:35.273350+0000","last_clean":"2023-08-09T12:51:35.273350+0000","last_became_active":"2023-08-09T12:51:32.850029+0000","last_became_peered":"2023-08-09T12:51:32.850029+0000","last_unstale":"2023-08-09T12:51:35.273350+0000","last_undegraded":"2023-08-09T12:51:35.273350+0000","last_fullsized":"2023-08-09T12:51:35.273350+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:02:51.063192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":473,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868190+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:51:34.868190+0000","last_peered":"2023-08-09T12:51:34.868190+0000","last_clean":"2023-08-09T12:51:34.868190+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:51:34.868190+0000","last_undegraded":"2023-08-09T12:51:34.868190+0000","last_fullsized":"2023-08-09T12:51:34.868190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:22.313967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278393+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:51:35.278393+0000","last_peered":"2023-08-09T12:51:35.278393+0000","last_clean":"2023-08-09T12:51:35.278393+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:51:35.278393+0000","last_undegraded":"2023-08-09T12:51:35.278393+0000","last_fullsized":"2023-08-09T12:51:35.278393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:55:16.916192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276750+0000","last_change":"2023-08-09T12:51:33.899592+0000","last_active":"2023-08-09T12:51:35.276750+0000","last_peered":"2023-08-09T12:51:35.276750+0000","last_clean":"2023-08-09T12:51:35.276750+0000","last_became_active":"2023-08-09T12:51:33.898674+0000","last_became_peered":"2023-08-09T12:51:33.898674+0000","last_unstale":"2023-08-09T12:51:35.276750+0000","last_undegraded":"2023-08-09T12:51:35.276750+0000","last_fullsized":"2023-08-09T12:51:35.276750+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:59:11.424097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867243+0000","last_change":"2023-08-09T12:51:32.852713+0000","last_active":"2023-08-09T12:51:34.867243+0000","last_peered":"2023-08-09T12:51:34.867243+0000","last_clean":"2023-08-09T12:51:34.867243+0000","last_became_active":"2023-08-09T12:51:32.852345+0000","last_became_peered":"2023-08-09T12:51:32.852345+0000","last_unstale":"2023-08-09T12:51:34.867243+0000","last_undegraded":"2023-08-09T12:51:34.867243+0000","last_fullsized":"2023-08-09T12:51:34.867243+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:19:53.576368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":317,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867859+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:51:34.867859+0000","last_peered":"2023-08-09T12:51:34.867859+0000","last_clean":"2023-08-09T12:51:34.867859+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:51:34.867859+0000","last_undegraded":"2023-08-09T12:51:34.867859+0000","last_fullsized":"2023-08-09T12:51:34.867859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:50:02.015915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275331+0000","last_change":"2023-08-09T12:51:33.877579+0000","last_active":"2023-08-09T12:51:35.275331+0000","last_peered":"2023-08-09T12:51:35.275331+0000","last_clean":"2023-08-09T12:51:35.275331+0000","last_became_active":"2023-08-09T12:51:33.877340+0000","last_became_peered":"2023-08-09T12:51:33.877340+0000","last_unstale":"2023-08-09T12:51:35.275331+0000","last_undegraded":"2023-08-09T12:51:35.275331+0000","last_fullsized":"2023-08-09T12:51:35.275331+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:41.910862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278378+0000","last_change":"2023-08-09T12:51:32.857165+0000","last_active":"2023-08-09T12:51:35.278378+0000","last_peered":"2023-08-09T12:51:35.278378+0000","last_clean":"2023-08-09T12:51:35.278378+0000","last_became_active":"2023-08-09T12:51:32.856539+0000","last_became_peered":"2023-08-09T12:51:32.856539+0000","last_unstale":"2023-08-09T12:51:35.278378+0000","last_undegraded":"2023-08-09T12:51:35.278378+0000","last_fullsized":"2023-08-09T12:51:35.278378+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:15.800974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275435+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:51:35.275435+0000","last_peered":"2023-08-09T12:51:35.275435+0000","last_clean":"2023-08-09T12:51:35.275435+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:51:35.275435+0000","last_undegraded":"2023-08-09T12:51:35.275435+0000","last_fullsized":"2023-08-09T12:51:35.275435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:27.594573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273266+0000","last_change":"2023-08-09T12:51:33.893133+0000","last_active":"2023-08-09T12:51:35.273266+0000","last_peered":"2023-08-09T12:51:35.273266+0000","last_clean":"2023-08-09T12:51:35.273266+0000","last_became_active":"2023-08-09T12:51:33.892875+0000","last_became_peered":"2023-08-09T12:51:33.892875+0000","last_unstale":"2023-08-09T12:51:35.273266+0000","last_undegraded":"2023-08-09T12:51:35.273266+0000","last_fullsized":"2023-08-09T12:51:35.273266+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:04.301485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"174'3","reported_seq":16,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275088+0000","last_change":"2023-08-09T12:51:32.856897+0000","last_active":"2023-08-09T12:51:35.275088+0000","last_peered":"2023-08-09T12:51:35.275088+0000","last_clean":"2023-08-09T12:51:35.275088+0000","last_became_active":"2023-08-09T12:51:32.854678+0000","last_became_peered":"2023-08-09T12:51:32.854678+0000","last_unstale":"2023-08-09T12:51:35.275088+0000","last_undegraded":"2023-08-09T12:51:35.275088+0000","last_fullsized":"2023-08-09T12:51:35.275088+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:22:04.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.279187+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:51:35.279187+0000","last_peered":"2023-08-09T12:51:35.279187+0000","last_clean":"2023-08-09T12:51:35.279187+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:51:35.279187+0000","last_undegraded":"2023-08-09T12:51:35.279187+0000","last_fullsized":"2023-08-09T12:51:35.279187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:33:21.306012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275401+0000","last_change":"2023-08-09T12:51:33.895168+0000","last_active":"2023-08-09T12:51:35.275401+0000","last_peered":"2023-08-09T12:51:35.275401+0000","last_clean":"2023-08-09T12:51:35.275401+0000","last_became_active":"2023-08-09T12:51:33.894891+0000","last_became_peered":"2023-08-09T12:51:33.894891+0000","last_unstale":"2023-08-09T12:51:35.275401+0000","last_undegraded":"2023-08-09T12:51:35.275401+0000","last_fullsized":"2023-08-09T12:51:35.275401+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:43:28.207591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867288+0000","last_change":"2023-08-09T12:51:32.855754+0000","last_active":"2023-08-09T12:51:34.867288+0000","last_peered":"2023-08-09T12:51:34.867288+0000","last_clean":"2023-08-09T12:51:34.867288+0000","last_became_active":"2023-08-09T12:51:32.854067+0000","last_became_peered":"2023-08-09T12:51:32.854067+0000","last_unstale":"2023-08-09T12:51:34.867288+0000","last_undegraded":"2023-08-09T12:51:34.867288+0000","last_fullsized":"2023-08-09T12:51:34.867288+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:15:15.478140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868832+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:51:34.868832+0000","last_peered":"2023-08-09T12:51:34.868832+0000","last_clean":"2023-08-09T12:51:34.868832+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:51:34.868832+0000","last_undegraded":"2023-08-09T12:51:34.868832+0000","last_fullsized":"2023-08-09T12:51:34.868832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:14.836836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868225+0000","last_change":"2023-08-09T12:51:33.882724+0000","last_active":"2023-08-09T12:51:34.868225+0000","last_peered":"2023-08-09T12:51:34.868225+0000","last_clean":"2023-08-09T12:51:34.868225+0000","last_became_active":"2023-08-09T12:51:33.882489+0000","last_became_peered":"2023-08-09T12:51:33.882489+0000","last_unstale":"2023-08-09T12:51:34.868225+0000","last_undegraded":"2023-08-09T12:51:34.868225+0000","last_fullsized":"2023-08-09T12:51:34.868225+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:43.656090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275484+0000","last_change":"2023-08-09T12:51:32.858693+0000","last_active":"2023-08-09T12:51:35.275484+0000","last_peered":"2023-08-09T12:51:35.275484+0000","last_clean":"2023-08-09T12:51:35.275484+0000","last_became_active":"2023-08-09T12:51:32.858352+0000","last_became_peered":"2023-08-09T12:51:32.858352+0000","last_unstale":"2023-08-09T12:51:35.275484+0000","last_undegraded":"2023-08-09T12:51:35.275484+0000","last_fullsized":"2023-08-09T12:51:35.275484+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:09.898610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":316,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867050+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:51:34.867050+0000","last_peered":"2023-08-09T12:51:34.867050+0000","last_clean":"2023-08-09T12:51:34.867050+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:51:34.867050+0000","last_undegraded":"2023-08-09T12:51:34.867050+0000","last_fullsized":"2023-08-09T12:51:34.867050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:46:43.974709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866983+0000","last_change":"2023-08-09T12:51:33.873573+0000","last_active":"2023-08-09T12:51:34.866983+0000","last_peered":"2023-08-09T12:51:34.866983+0000","last_clean":"2023-08-09T12:51:34.866983+0000","last_became_active":"2023-08-09T12:51:33.873312+0000","last_became_peered":"2023-08-09T12:51:33.873312+0000","last_unstale":"2023-08-09T12:51:34.866983+0000","last_undegraded":"2023-08-09T12:51:34.866983+0000","last_fullsized":"2023-08-09T12:51:34.866983+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:02:32.217729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276024+0000","last_change":"2023-08-09T12:51:32.862731+0000","last_active":"2023-08-09T12:51:35.276024+0000","last_peered":"2023-08-09T12:51:35.276024+0000","last_clean":"2023-08-09T12:51:35.276024+0000","last_became_active":"2023-08-09T12:51:32.861608+0000","last_became_peered":"2023-08-09T12:51:32.861608+0000","last_unstale":"2023-08-09T12:51:35.276024+0000","last_undegraded":"2023-08-09T12:51:35.276024+0000","last_fullsized":"2023-08-09T12:51:35.276024+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:23:22.776561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868280+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:51:34.868280+0000","last_peered":"2023-08-09T12:51:34.868280+0000","last_clean":"2023-08-09T12:51:34.868280+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:51:34.868280+0000","last_undegraded":"2023-08-09T12:51:34.868280+0000","last_fullsized":"2023-08-09T12:51:34.868280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:47:16.871212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868617+0000","last_change":"2023-08-09T12:51:33.876711+0000","last_active":"2023-08-09T12:51:34.868617+0000","last_peered":"2023-08-09T12:51:34.868617+0000","last_clean":"2023-08-09T12:51:34.868617+0000","last_became_active":"2023-08-09T12:51:33.876457+0000","last_became_peered":"2023-08-09T12:51:33.876457+0000","last_unstale":"2023-08-09T12:51:34.868617+0000","last_undegraded":"2023-08-09T12:51:34.868617+0000","last_fullsized":"2023-08-09T12:51:34.868617+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:37:14.833669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"174'8","reported_seq":21,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276609+0000","last_change":"2023-08-09T12:51:32.860530+0000","last_active":"2023-08-09T12:51:35.276609+0000","last_peered":"2023-08-09T12:51:35.276609+0000","last_clean":"2023-08-09T12:51:35.276609+0000","last_became_active":"2023-08-09T12:51:32.858793+0000","last_became_peered":"2023-08-09T12:51:32.858793+0000","last_unstale":"2023-08-09T12:51:35.276609+0000","last_undegraded":"2023-08-09T12:51:35.276609+0000","last_fullsized":"2023-08-09T12:51:35.276609+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:20.398869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":316,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277312+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:51:35.277312+0000","last_peered":"2023-08-09T12:51:35.277312+0000","last_clean":"2023-08-09T12:51:35.277312+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:51:35.277312+0000","last_undegraded":"2023-08-09T12:51:35.277312+0000","last_fullsized":"2023-08-09T12:51:35.277312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:34.493824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1596,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193715,"statfs":{"total":200000000,"available":198364764,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1819999999999999,"15min":1.135},"min":{"1min":0.72599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.611,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.873},{"interface":"front","average":{"1min":1.107,"5min":1.1259999999999999,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.70499999999999996,"15min":0.44500000000000001},"max":{"1min":1.369,"5min":1.7509999999999999,"15min":2.0459999999999998},"last":1.3400000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.24,"15min":1.1859999999999999},"min":{"1min":0.86299999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.5740000000000001,"5min":1.7809999999999999,"15min":2.0859999999999999},"last":1.05},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.70399999999999996,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.752,"5min":1.778,"15min":1.778},"last":1.0029999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.286,"15min":1.2450000000000001},"min":{"1min":0.84799999999999998,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":1.5960000000000001,"5min":1.78,"15min":2.1459999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2589999999999999,"15min":1.2090000000000001},"min":{"1min":0.81799999999999995,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.6519999999999999,"5min":1.6579999999999999,"15min":2.173},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.327,"15min":1.294},"min":{"1min":0.86399999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6699999999999999,"5min":1.806,"15min":3.4540000000000002},"last":1.5},{"interface":"front","average":{"1min":1.29,"5min":1.3049999999999999,"15min":1.3129999999999999},"min":{"1min":0.77800000000000002,"5min":0.72699999999999998,"15min":0.61599999999999999},"max":{"1min":1.681,"5min":1.8460000000000001,"15min":2.282},"last":1.161}]},{"osd":4,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.242,"15min":1.2310000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.873,"5min":1.948,"15min":2.8769999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.246,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.68700000000000006,"5min":0.67000000000000004,"15min":0.58599999999999997},"max":{"1min":1.655,"5min":1.8480000000000001,"15min":4.6200000000000001},"last":1.3819999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4159999999999999,"15min":1.3799999999999999},"min":{"1min":0.62,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.6599999999999999,"5min":1.978,"15min":2.802},"last":1.425},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.506,"15min":1.5089999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.8120000000000001,"5min":2.1299999999999999,"15min":3.3580000000000001},"last":1.4430000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.4830000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.901,"5min":2.2370000000000001,"15min":3.4910000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.8680000000000001,"5min":1.9770000000000001,"15min":2.4039999999999999},"last":1.284}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.093,"15min":1.133},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.56399999999999995},"max":{"1min":1.3180000000000001,"5min":1.573,"15min":2.54},"last":1.669},{"interface":"front","average":{"1min":1.117,"5min":1.155,"15min":1.109},"min":{"1min":0.83199999999999996,"5min":0.64400000000000002,"15min":0.54000000000000004},"max":{"1min":1.577,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.008}]},{"osd":1,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.2769999999999999,"15min":1.258},"min":{"1min":0.97799999999999998,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.655,"5min":1.996,"15min":2.306},"last":1.361},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":1.075,"5min":0.79100000000000004,"15min":0.76800000000000002},"max":{"1min":1.5980000000000001,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":1.232}]},{"osd":2,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.179,"15min":1.151},"min":{"1min":0.89600000000000002,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.587,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3009999999999999,"15min":1.296},"min":{"1min":0.86799999999999999,"5min":0.69699999999999995,"15min":0.66300000000000003},"max":{"1min":1.7170000000000001,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.0900000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":0.94699999999999995,"5min":0.79500000000000004,"15min":0.67600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":2.327},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.3520000000000001,"15min":1.3380000000000001},"min":{"1min":1.125,"5min":0.81799999999999995,"15min":0.74099999999999999},"max":{"1min":1.7789999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.599}]},{"osd":4,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.337,"15min":1.367},"min":{"1min":1.1140000000000001,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.821,"5min":1.8620000000000001,"15min":11.058999999999999},"last":1.518},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.377,"15min":1.367},"min":{"1min":1.0349999999999999,"5min":0.85399999999999998,"15min":0.57399999999999995},"max":{"1min":1.911,"5min":1.911,"15min":2.3479999999999999},"last":1.444}]},{"osd":5,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":1.018,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.96,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.718},{"interface":"front","average":{"1min":1.613,"5min":1.4950000000000001,"15min":1.5049999999999999},"min":{"1min":1.232,"5min":0.95599999999999996,"15min":0.81899999999999995},"max":{"1min":1.929,"5min":1.986,"15min":2.8580000000000001},"last":1.7689999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.5369999999999999,"15min":1.508},"min":{"1min":1.4199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.7999999999999998},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.5029999999999999,"15min":1.4990000000000001},"min":{"1min":1.0469999999999999,"5min":0.98699999999999999,"15min":0.74399999999999999},"max":{"1min":2.1280000000000001,"5min":2.7810000000000001,"15min":3.621},"last":1.8029999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.119,"15min":1.1120000000000001},"min":{"1min":0.76900000000000002,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.609,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.155},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.181,"15min":1.1499999999999999},"min":{"1min":0.77100000000000002,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.6180000000000001,"5min":1.97,"15min":2.0600000000000001},"last":1.2789999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.365,"15min":1.335},"min":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.63800000000000001},"max":{"1min":1.847,"5min":1.851,"15min":2.6579999999999999},"last":1.365},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.3520000000000001,"15min":1.292},"min":{"1min":1.135,"5min":0.73899999999999999,"15min":0.70199999999999996},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":0.93200000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2929999999999999,"15min":1.2450000000000001},"min":{"1min":0.91900000000000004,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.117},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2889999999999999,"15min":1.228},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.716,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":1.0429999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2949999999999999,"15min":1.2689999999999999},"min":{"1min":0.90500000000000003,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4810000000000001,"5min":1.7829999999999999,"15min":2.2330000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.3759999999999999,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.2270000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.323,"15min":1.2709999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":2.169,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.4239999999999999,"15min":1.3939999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.628},"max":{"1min":2.21,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.1839999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.4630000000000001,"15min":1.395},"min":{"1min":1.0449999999999999,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":2.7719999999999998,"5min":2.952,"15min":2.952},"last":1.325},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.518,"15min":1.4810000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":1.883,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.4139999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.55,"15min":1.5289999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":2.0600000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.629,"15min":1.5700000000000001},"min":{"1min":1.121,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":2.8849999999999998,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.4930000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1021,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194290,"statfs":{"total":200000000,"available":198953542,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.077,"15min":1.099},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.397,"5min":1.6060000000000001,"15min":2.5670000000000002},"last":1.397},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.123,"15min":1.1259999999999999},"min":{"1min":0.69399999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.373,"5min":1.673,"15min":3.4100000000000001},"last":1.0149999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.304,"15min":1.3009999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.611,"5min":1.863,"15min":2.3679999999999999},"last":1.181},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.331},"min":{"1min":0.84099999999999997,"5min":0.74399999999999999,"15min":0.71999999999999997},"max":{"1min":1.6020000000000001,"5min":1.8240000000000001,"15min":2.9590000000000001},"last":1.6020000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.349,"15min":1.323},"min":{"1min":0.96199999999999997,"5min":0.86199999999999999,"15min":0.54900000000000004},"max":{"1min":1.615,"5min":1.9470000000000001,"15min":2.4729999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.363,"15min":1.3420000000000001},"min":{"1min":0.99399999999999999,"5min":0.81499999999999995,"15min":0.67900000000000005},"max":{"1min":1.6890000000000001,"5min":1.978,"15min":3.0579999999999998},"last":1.5169999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.252,"15min":1.252},"min":{"1min":0.91700000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5800000000000001,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":1.341},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3340000000000001},"min":{"1min":0.94599999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7809999999999999,"5min":2.0539999999999998,"15min":2.5289999999999999},"last":0.94599999999999995}]},{"osd":5,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3340000000000001,"15min":1.357},"min":{"1min":0.94999999999999996,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.6839999999999999,"5min":1.857,"15min":3.137},"last":1.238},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3300000000000001,"15min":1.3640000000000001},"min":{"1min":0.89000000000000001,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.758,"5min":2.403,"15min":3.3620000000000001},"last":1.147}]},{"osd":6,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3879999999999999,"15min":1.4350000000000001},"min":{"1min":1.0549999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.788,"5min":2.262,"15min":2.5819999999999999},"last":1.081},{"interface":"front","average":{"1min":1.47,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":1.1000000000000001,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.732,"5min":2.1909999999999998,"15min":3.3340000000000001},"last":1.6799999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.494,"15min":1.516},"min":{"1min":1.1140000000000001,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.752,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.571,"15min":1.5940000000000001},"min":{"1min":1.419,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.887,"5min":2.4590000000000001,"15min":2.875},"last":1.462}]}]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194291,"statfs":{"total":200000000,"available":198954538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.347,"5min":1.458,"15min":4.4109999999999996},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.077,"5min":1.006,"15min":0.96999999999999997},"min":{"1min":0.69299999999999995,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.5569999999999999,"5min":1.7170000000000001,"15min":3.2269999999999999},"last":1.0800000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.76800000000000002,"5min":0.44400000000000001,"15min":0.38100000000000001},"max":{"1min":1.302,"5min":1.4930000000000001,"15min":2.1280000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1200000000000001,"15min":1.036},"min":{"1min":0.86099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5760000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.262}]},{"osd":2,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1299999999999999,"15min":1.159},"min":{"1min":0.93400000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.677,"5min":1.9259999999999999,"15min":18.145},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2450000000000001,"15min":1.224},"min":{"1min":1.0469999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.645,"5min":1.976,"15min":2.169},"last":1.379}]},{"osd":4,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2450000000000001,"15min":1.3009999999999999},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.745},"max":{"1min":1.7569999999999999,"5min":1.7709999999999999,"15min":3.5110000000000001},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":1.1619999999999999,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.4219999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.3999999999999999,"15min":1.4510000000000001},"min":{"1min":1.1379999999999999,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":2.25,"5min":2.25,"15min":18.094000000000001},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4079999999999999,"15min":1.4159999999999999},"min":{"1min":1.0760000000000001,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.9419999999999999,"5min":2.1219999999999999,"15min":14.105},"last":1.871}]},{"osd":6,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.393,"15min":1.373},"min":{"1min":0.96399999999999997,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.865,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.304},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.4690000000000001,"15min":1.4750000000000001},"min":{"1min":1.264,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":4.0220000000000002},"last":1.788}]},{"osd":7,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.5189999999999999,"15min":1.456},"min":{"1min":1.3169999999999999,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":2.109,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.532},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5169999999999999,"15min":1.4430000000000001},"min":{"1min":1.0760000000000001,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":2.0630000000000002,"5min":2.2629999999999999,"15min":3.016},"last":1.5009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.68500000000000005,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":1.5449999999999999,"5min":1.673,"15min":1.716},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.306,"5min":1.6970000000000001,"15min":2.9009999999999998},"last":1.214}]},{"osd":1,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90600000000000003,"15min":0.92300000000000004},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.151},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.099,"15min":1.069},"min":{"1min":0.77400000000000002,"5min":0.48799999999999999,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.999}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1559999999999999},"min":{"1min":0.85999999999999999,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.655,"5min":1.794,"15min":3.2850000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.2549999999999999,"15min":1.1990000000000001},"min":{"1min":0.92500000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"max":{"1min":1.7629999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":1.306}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.452,"15min":1.4370000000000001},"min":{"1min":1.135,"5min":0.88800000000000001,"15min":0.81899999999999995},"max":{"1min":1.8049999999999999,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.512},{"interface":"front","average":{"1min":1.383,"5min":1.379,"15min":1.3360000000000001},"min":{"1min":0.93700000000000006,"5min":0.77300000000000002,"15min":0.66800000000000004},"max":{"1min":1.8160000000000001,"5min":1.974,"15min":3.4500000000000002},"last":1.5649999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.417,"15min":1.3979999999999999},"min":{"1min":1.012,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.95,"5min":2.0110000000000001,"15min":5.0140000000000002},"last":1.603},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.5309999999999999,"15min":1.4970000000000001},"min":{"1min":1.3420000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8340000000000001,"5min":2.133,"15min":4.806},"last":1.627}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4019999999999999,"15min":1.359},"min":{"1min":1.0700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.976,"5min":1.976,"15min":2.5179999999999998},"last":1.369},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.492,"15min":1.4570000000000001},"min":{"1min":1.089,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9079999999999999,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.544}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.456,"15min":1.4139999999999999},"min":{"1min":0.98399999999999999,"5min":0.80300000000000005,"15min":0.76200000000000001},"max":{"1min":1.8919999999999999,"5min":2.1309999999999998,"15min":2.464},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.5569999999999999,"15min":1.5469999999999999},"min":{"1min":1.248,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0150000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.6659999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.47299999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3460000000000001,"5min":1.6859999999999999,"15min":2.621},"last":0.874},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0209999999999999,"15min":1.3160000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.4790000000000001,"5min":1.778,"15min":88.254999999999995},"last":1.0780000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.006,"15min":0.98899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2689999999999999,"15min":1.226},"min":{"1min":0.626,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.5960000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2330000000000001,"15min":1.169},"min":{"1min":0.67300000000000004,"5min":0.436,"15min":0.436},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.363},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1100000000000001,"15min":1.071},"min":{"1min":0.66700000000000004,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.222}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2649999999999999,"15min":1.3320000000000001},"min":{"1min":0.86099999999999999,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":25.172000000000001},"last":1.276},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.401,"15min":1.3660000000000001},"min":{"1min":1.081,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.887,"5min":2.085,"15min":3.762},"last":1.49}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.387,"15min":1.45},"min":{"1min":0.80100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.7250000000000001,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3300000000000001,"15min":1.3200000000000001},"min":{"1min":0.876,"5min":0.81899999999999995,"15min":0.77900000000000003},"max":{"1min":1.8400000000000001,"5min":1.9079999999999999,"15min":3.762},"last":1.4139999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.5309999999999999,"15min":1.4910000000000001},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.524},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.4790000000000001,"15min":1.4359999999999999},"min":{"1min":0.91100000000000003,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.546,"15min":1.627},"min":{"1min":1.117,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.109,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.593,"15min":1.6399999999999999},"min":{"1min":0.92600000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2080000000000002,"5min":2.464,"15min":28.765000000000001},"last":1.462}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193713,"statfs":{"total":200000000,"available":198362468,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.204,"5min":1.6259999999999999,"15min":1.819},"last":0.871},{"interface":"front","average":{"1min":1.022,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.437,"5min":0.437,"15min":0.436},"max":{"1min":1.4990000000000001,"5min":1.661,"15min":6.1749999999999998},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.016},"min":{"1min":0.84499999999999997,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.373,"5min":1.6120000000000001,"15min":1.7669999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0609999999999999,"15min":1.0700000000000001},"min":{"1min":0.59499999999999997,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5289999999999999,"5min":1.5609999999999999,"15min":6.2549999999999999},"last":1.325}]},{"osd":3,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.016},"min":{"1min":0.63700000000000001,"5min":0.55300000000000005,"15min":0.45300000000000001},"max":{"1min":1.601,"5min":1.665,"15min":9.6069999999999993},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.244,"5min":1.2110000000000001,"15min":1.2030000000000001},"min":{"1min":0.69099999999999995,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.5620000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.351},"min":{"1min":0.88300000000000001,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.9630000000000001,"5min":2.1019999999999999,"15min":9.9629999999999992},"last":1.8640000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4039999999999999,"15min":1.3480000000000001},"min":{"1min":0.99199999999999999,"5min":0.85799999999999998,"15min":0.77900000000000003},"max":{"1min":1.7589999999999999,"5min":1.8560000000000001,"15min":1.879},"last":1.615}]},{"osd":5,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.349,"15min":1.347},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":1.6910000000000001,"5min":1.8200000000000001,"15min":10.004},"last":1.498},{"interface":"front","average":{"1min":1.423,"5min":1.46,"15min":1.421},"min":{"1min":0.92900000000000005,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.798,"5min":2.1419999999999999,"15min":2.161},"last":1.464}]},{"osd":6,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.45,"15min":1.4019999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7729999999999999,"5min":2.1230000000000002,"15min":6.4290000000000003},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.47,"15min":1.4630000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.782,"5min":2.117,"15min":9.9190000000000005},"last":1.641}]},{"osd":7,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.492},"min":{"1min":1.016,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8839999999999999,"5min":2.2160000000000002,"15min":18.114000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.5289999999999999,"15min":1.5129999999999999},"min":{"1min":0.84099999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":9.5640000000000001},"last":1.758}]}]}],"pool_statfs":[]}} 2023-08-09T12:51:43.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:51:43.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:51:43.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:51:43.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.725+0000 7fd4a4ccc640 1 Processor -- start 2023-08-09T12:51:43.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.725+0000 7fd4a4ccc640 1 -- start start 2023-08-09T12:51:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.727+0000 7fd4a4ccc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4a0070a90 0x7fd4a00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.727+0000 7fd4a4ccc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a00ad810 0x7fd4a00c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.727+0000 7fd4a4ccc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a00b4630 con 0x7fd4a0159d80 2023-08-09T12:51:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.727+0000 7fd4a4ccc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a015a160 con 0x7fd4a0070a90 2023-08-09T12:51:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.727+0000 7fd4a4ccc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00b3ab0 con 0x7fd4a00ad810 2023-08-09T12:51:43.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.728+0000 7fd49ed9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a00ad810 0x7fd4a00c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:43.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.728+0000 7fd49ed9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a00ad810 0x7fd4a00c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:43244/0 (socket says 172.21.15.17:43244) 2023-08-09T12:51:43.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.728+0000 7fd49ed9d640 1 -- 172.21.15.17:0/2908914363 learned_addr learned my addr 172.21.15.17:0/2908914363 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:43.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.728+0000 7fd49dd9b640 1 --2- 172.21.15.17:0/2908914363 >> v2:172.21.15.142:3300/0 conn(0x7fd4a0070a90 0x7fd4a00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:43.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.728+0000 7fd49ed9d640 1 -- 172.21.15.17:0/2908914363 >> v2:172.21.15.142:3300/0 conn(0x7fd4a0070a90 msgr2=0x7fd4a00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:43.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.728+0000 7fd49ed9d640 1 --2- 172.21.15.17:0/2908914363 >> v2:172.21.15.142:3300/0 conn(0x7fd4a0070a90 0x7fd4a00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.728+0000 7fd49ed9d640 1 -- 172.21.15.17:0/2908914363 >> v1:172.21.15.142:6789/0 conn(0x7fd4a0159d80 legacy=0x7fd4a0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.729+0000 7fd49ed9d640 1 -- 172.21.15.17:0/2908914363 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a00b3d90 con 0x7fd4a00ad810 2023-08-09T12:51:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.730+0000 7fd49ed9d640 1 --2- 172.21.15.17:0/2908914363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a00ad810 0x7fd4a00c8fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e50 tx=0x7fd49802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc23cdf5f4f5aa7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.730+0000 7fd49d59a640 1 -- 172.21.15.17:0/2908914363 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49802cb00 con 0x7fd4a00ad810 2023-08-09T12:51:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.731+0000 7fd49d59a640 1 -- 172.21.15.17:0/2908914363 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49802cc60 con 0x7fd4a00ad810 2023-08-09T12:51:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.731+0000 7fd49d59a640 1 -- 172.21.15.17:0/2908914363 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980343f0 con 0x7fd4a00ad810 2023-08-09T12:51:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.731+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/2908914363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a00ad810 msgr2=0x7fd4a00c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.731+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/2908914363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a00ad810 0x7fd4a00c8fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e50 tx=0x7fd49802bf60 comp rx=0 tx=0).stop 2023-08-09T12:51:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.731+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/2908914363 shutdown_connections 2023-08-09T12:51:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.731+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/2908914363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a00ad810 0x7fd4a00c8fd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.731+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/2908914363 >> v2:172.21.15.142:3300/0 conn(0x7fd4a0070a90 0x7fd4a00b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.731+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/2908914363 >> 172.21.15.17:0/2908914363 conn(0x7fd4a00cb1b0 msgr2=0x7fd4a00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.732+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/2908914363 shutdown_connections 2023-08-09T12:51:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.732+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/2908914363 wait complete. 2023-08-09T12:51:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.733+0000 7fd4a4ccc640 1 Processor -- start 2023-08-09T12:51:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.733+0000 7fd4a4ccc640 1 -- start start 2023-08-09T12:51:43.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.734+0000 7fd4a4ccc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a0070a90 0x7fd4a014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:43.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.734+0000 7fd4a4ccc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a00ad810 0x7fd4a015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:43.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.734+0000 7fd4a4ccc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a0159d80 0x7fd4a00c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:43.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.734+0000 7fd4a4ccc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a014b1d0 con 0x7fd4a0159d80 2023-08-09T12:51:43.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.734+0000 7fd4a4ccc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a015a330 con 0x7fd4a00ad810 2023-08-09T12:51:43.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.734+0000 7fd4a4ccc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c46d0 con 0x7fd4a0070a90 2023-08-09T12:51:43.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a0159d80 0x7fd4a00c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:43.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a0159d80 0x7fd4a00c37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48510/0 (socket says 172.21.15.17:48510) 2023-08-09T12:51:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49ed9d640 1 -- 172.21.15.17:0/484384001 learned_addr learned my addr 172.21.15.17:0/484384001 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49e59c640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a0070a90 0x7fd4a014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49dd9b640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a00ad810 0x7fd4a015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49ed9d640 1 -- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a0070a90 msgr2=0x7fd4a014ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49ed9d640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a0070a90 0x7fd4a014ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49ed9d640 1 -- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a00ad810 msgr2=0x7fd4a015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49ed9d640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a00ad810 0x7fd4a015c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49ed9d640 1 -- 172.21.15.17:0/484384001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498009b30 con 0x7fd4a0159d80 2023-08-09T12:51:43.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49dd9b640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a00ad810 0x7fd4a015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:43.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.735+0000 7fd49e59c640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a0070a90 0x7fd4a014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:43.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.736+0000 7fd49ed9d640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a0159d80 0x7fd4a00c37e0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e50 tx=0x7fd498004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:43.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.736+0000 7fd48effd640 1 -- 172.21.15.17:0/484384001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498009510 con 0x7fd4a0159d80 2023-08-09T12:51:43.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.736+0000 7fd48effd640 1 -- 172.21.15.17:0/484384001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49803e450 con 0x7fd4a0159d80 2023-08-09T12:51:43.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.736+0000 7fd48effd640 1 -- 172.21.15.17:0/484384001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49803e800 con 0x7fd4a0159d80 2023-08-09T12:51:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.736+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a00c49b0 con 0x7fd4a0159d80 2023-08-09T12:51:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.736+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a00c4f70 con 0x7fd4a0159d80 2023-08-09T12:51:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.737+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a015a4f0 con 0x7fd4a0159d80 2023-08-09T12:51:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.738+0000 7fd48effd640 1 -- 172.21.15.17:0/484384001 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd49803e960 con 0x7fd4a0159d80 2023-08-09T12:51:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.739+0000 7fd48effd640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48006a050 0x7fd48006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.739+0000 7fd48effd640 1 -- 172.21.15.17:0/484384001 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4980ab2e0 con 0x7fd4a0159d80 2023-08-09T12:51:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.740+0000 7fd49e59c640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48006a050 0x7fd48006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:43.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.741+0000 7fd49e59c640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48006a050 0x7fd48006c510 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd490007fd0 tx=0x7fd490009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:43.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.744+0000 7fd48effd640 1 -- 172.21.15.17:0/484384001 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd4a015a4f0 con 0x7fd4a0159d80 2023-08-09T12:51:43.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.934+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4a00b4350 con 0x7fd48006a050 2023-08-09T12:51:43.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.960+0000 7fd48effd640 1 -- 172.21.15.17:0/484384001 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303342 (secure 0 0 0) 0x7fd490001c90 con 0x7fd48006a050 2023-08-09T12:51:43.967 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:43.969 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:51:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.966+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48006a050 msgr2=0x7fd48006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.966+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48006a050 0x7fd48006c510 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd490007fd0 tx=0x7fd490009040 comp rx=0 tx=0).stop 2023-08-09T12:51:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.966+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a0159d80 msgr2=0x7fd4a00c37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.966+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a0159d80 0x7fd4a00c37e0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e50 tx=0x7fd498004a40 comp rx=0 tx=0).stop 2023-08-09T12:51:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.967+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 shutdown_connections 2023-08-09T12:51:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.967+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd48006a050 0x7fd48006c510 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.967+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a0159d80 0x7fd4a00c37e0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.967+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4a00ad810 0x7fd4a015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.967+0000 7fd4a4ccc640 1 --2- 172.21.15.17:0/484384001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4a0070a90 0x7fd4a014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.967+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 >> 172.21.15.17:0/484384001 conn(0x7fd4a00cb1b0 msgr2=0x7fd4a0158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.967+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 shutdown_connections 2023-08-09T12:51:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:43.967+0000 7fd4a4ccc640 1 -- 172.21.15.17:0/484384001 wait complete. 2023-08-09T12:51:43.994 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2023-08-09T12:51:42.919684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553179,"statfs":{"total":1600000000,"available":1590455676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.055960"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277893+0000","last_change":"2023-08-09T12:51:33.904326+0000","last_active":"2023-08-09T12:51:35.277893+0000","last_peered":"2023-08-09T12:51:35.277893+0000","last_clean":"2023-08-09T12:51:35.277893+0000","last_became_active":"2023-08-09T12:51:33.904101+0000","last_became_peered":"2023-08-09T12:51:33.904101+0000","last_unstale":"2023-08-09T12:51:35.277893+0000","last_undegraded":"2023-08-09T12:51:35.277893+0000","last_fullsized":"2023-08-09T12:51:35.277893+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:03:20.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867951+0000","last_change":"2023-08-09T12:51:33.892059+0000","last_active":"2023-08-09T12:51:34.867951+0000","last_peered":"2023-08-09T12:51:34.867951+0000","last_clean":"2023-08-09T12:51:34.867951+0000","last_became_active":"2023-08-09T12:51:33.891669+0000","last_became_peered":"2023-08-09T12:51:33.891669+0000","last_unstale":"2023-08-09T12:51:34.867951+0000","last_undegraded":"2023-08-09T12:51:34.867951+0000","last_fullsized":"2023-08-09T12:51:34.867951+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:57:15.133730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868200+0000","last_change":"2023-08-09T12:51:33.883993+0000","last_active":"2023-08-09T12:51:34.868200+0000","last_peered":"2023-08-09T12:51:34.868200+0000","last_clean":"2023-08-09T12:51:34.868200+0000","last_became_active":"2023-08-09T12:51:33.883575+0000","last_became_peered":"2023-08-09T12:51:33.883575+0000","last_unstale":"2023-08-09T12:51:34.868200+0000","last_undegraded":"2023-08-09T12:51:34.868200+0000","last_fullsized":"2023-08-09T12:51:34.868200+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:49:15.482835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274312+0000","last_change":"2023-08-09T12:51:33.888118+0000","last_active":"2023-08-09T12:51:35.274312+0000","last_peered":"2023-08-09T12:51:35.274312+0000","last_clean":"2023-08-09T12:51:35.274312+0000","last_became_active":"2023-08-09T12:51:33.887560+0000","last_became_peered":"2023-08-09T12:51:33.887560+0000","last_unstale":"2023-08-09T12:51:35.274312+0000","last_undegraded":"2023-08-09T12:51:35.274312+0000","last_fullsized":"2023-08-09T12:51:35.274312+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:53:32.403752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867115+0000","last_change":"2023-08-09T12:51:33.900726+0000","last_active":"2023-08-09T12:51:34.867115+0000","last_peered":"2023-08-09T12:51:34.867115+0000","last_clean":"2023-08-09T12:51:34.867115+0000","last_became_active":"2023-08-09T12:51:33.899784+0000","last_became_peered":"2023-08-09T12:51:33.899784+0000","last_unstale":"2023-08-09T12:51:34.867115+0000","last_undegraded":"2023-08-09T12:51:34.867115+0000","last_fullsized":"2023-08-09T12:51:34.867115+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:45.820262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866175+0000","last_change":"2023-08-09T12:51:33.892942+0000","last_active":"2023-08-09T12:51:34.866175+0000","last_peered":"2023-08-09T12:51:34.866175+0000","last_clean":"2023-08-09T12:51:34.866175+0000","last_became_active":"2023-08-09T12:51:33.892647+0000","last_became_peered":"2023-08-09T12:51:33.892647+0000","last_unstale":"2023-08-09T12:51:34.866175+0000","last_undegraded":"2023-08-09T12:51:34.866175+0000","last_fullsized":"2023-08-09T12:51:34.866175+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:48:24.516600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277774+0000","last_change":"2023-08-09T12:51:33.895884+0000","last_active":"2023-08-09T12:51:35.277774+0000","last_peered":"2023-08-09T12:51:35.277774+0000","last_clean":"2023-08-09T12:51:35.277774+0000","last_became_active":"2023-08-09T12:51:33.895512+0000","last_became_peered":"2023-08-09T12:51:33.895512+0000","last_unstale":"2023-08-09T12:51:35.277774+0000","last_undegraded":"2023-08-09T12:51:35.277774+0000","last_fullsized":"2023-08-09T12:51:35.277774+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:28:20.598824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274691+0000","last_change":"2023-08-09T12:51:33.893650+0000","last_active":"2023-08-09T12:51:35.274691+0000","last_peered":"2023-08-09T12:51:35.274691+0000","last_clean":"2023-08-09T12:51:35.274691+0000","last_became_active":"2023-08-09T12:51:33.892816+0000","last_became_peered":"2023-08-09T12:51:33.892816+0000","last_unstale":"2023-08-09T12:51:35.274691+0000","last_undegraded":"2023-08-09T12:51:35.274691+0000","last_fullsized":"2023-08-09T12:51:35.274691+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:25:54.383368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866312+0000","last_change":"2023-08-09T12:51:33.873816+0000","last_active":"2023-08-09T12:51:34.866312+0000","last_peered":"2023-08-09T12:51:34.866312+0000","last_clean":"2023-08-09T12:51:34.866312+0000","last_became_active":"2023-08-09T12:51:33.872398+0000","last_became_peered":"2023-08-09T12:51:33.872398+0000","last_unstale":"2023-08-09T12:51:34.866312+0000","last_undegraded":"2023-08-09T12:51:34.866312+0000","last_fullsized":"2023-08-09T12:51:34.866312+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:21:23.831320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867220+0000","last_change":"2023-08-09T12:51:33.881426+0000","last_active":"2023-08-09T12:51:34.867220+0000","last_peered":"2023-08-09T12:51:34.867220+0000","last_clean":"2023-08-09T12:51:34.867220+0000","last_became_active":"2023-08-09T12:51:33.881173+0000","last_became_peered":"2023-08-09T12:51:33.881173+0000","last_unstale":"2023-08-09T12:51:34.867220+0000","last_undegraded":"2023-08-09T12:51:34.867220+0000","last_fullsized":"2023-08-09T12:51:34.867220+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:51:55.545505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274185+0000","last_change":"2023-08-09T12:51:33.879404+0000","last_active":"2023-08-09T12:51:35.274185+0000","last_peered":"2023-08-09T12:51:35.274185+0000","last_clean":"2023-08-09T12:51:35.274185+0000","last_became_active":"2023-08-09T12:51:33.879167+0000","last_became_peered":"2023-08-09T12:51:33.879167+0000","last_unstale":"2023-08-09T12:51:35.274185+0000","last_undegraded":"2023-08-09T12:51:35.274185+0000","last_fullsized":"2023-08-09T12:51:35.274185+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:46:47.899147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275247+0000","last_change":"2023-08-09T12:51:33.881233+0000","last_active":"2023-08-09T12:51:35.275247+0000","last_peered":"2023-08-09T12:51:35.275247+0000","last_clean":"2023-08-09T12:51:35.275247+0000","last_became_active":"2023-08-09T12:51:33.875953+0000","last_became_peered":"2023-08-09T12:51:33.875953+0000","last_unstale":"2023-08-09T12:51:35.275247+0000","last_undegraded":"2023-08-09T12:51:35.275247+0000","last_fullsized":"2023-08-09T12:51:35.275247+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:10:15.843221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865876+0000","last_change":"2023-08-09T12:51:33.881396+0000","last_active":"2023-08-09T12:51:34.865876+0000","last_peered":"2023-08-09T12:51:34.865876+0000","last_clean":"2023-08-09T12:51:34.865876+0000","last_became_active":"2023-08-09T12:51:33.881150+0000","last_became_peered":"2023-08-09T12:51:33.881150+0000","last_unstale":"2023-08-09T12:51:34.865876+0000","last_undegraded":"2023-08-09T12:51:34.865876+0000","last_fullsized":"2023-08-09T12:51:34.865876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:12:20.022303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274652+0000","last_change":"2023-08-09T12:51:33.881970+0000","last_active":"2023-08-09T12:51:35.274652+0000","last_peered":"2023-08-09T12:51:35.274652+0000","last_clean":"2023-08-09T12:51:35.274652+0000","last_became_active":"2023-08-09T12:51:33.877427+0000","last_became_peered":"2023-08-09T12:51:33.877427+0000","last_unstale":"2023-08-09T12:51:35.274652+0000","last_undegraded":"2023-08-09T12:51:35.274652+0000","last_fullsized":"2023-08-09T12:51:35.274652+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:35:24.449447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868292+0000","last_change":"2023-08-09T12:51:33.892666+0000","last_active":"2023-08-09T12:51:34.868292+0000","last_peered":"2023-08-09T12:51:34.868292+0000","last_clean":"2023-08-09T12:51:34.868292+0000","last_became_active":"2023-08-09T12:51:33.892278+0000","last_became_peered":"2023-08-09T12:51:33.892278+0000","last_unstale":"2023-08-09T12:51:34.868292+0000","last_undegraded":"2023-08-09T12:51:34.868292+0000","last_fullsized":"2023-08-09T12:51:34.868292+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:43:27.271570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866377+0000","last_change":"2023-08-09T12:51:33.903306+0000","last_active":"2023-08-09T12:51:34.866377+0000","last_peered":"2023-08-09T12:51:34.866377+0000","last_clean":"2023-08-09T12:51:34.866377+0000","last_became_active":"2023-08-09T12:51:33.903105+0000","last_became_peered":"2023-08-09T12:51:33.903105+0000","last_unstale":"2023-08-09T12:51:34.866377+0000","last_undegraded":"2023-08-09T12:51:34.866377+0000","last_fullsized":"2023-08-09T12:51:34.866377+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:49:30.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276751+0000","last_change":"2023-08-09T12:51:33.888560+0000","last_active":"2023-08-09T12:51:35.276751+0000","last_peered":"2023-08-09T12:51:35.276751+0000","last_clean":"2023-08-09T12:51:35.276751+0000","last_became_active":"2023-08-09T12:51:33.886503+0000","last_became_peered":"2023-08-09T12:51:33.886503+0000","last_unstale":"2023-08-09T12:51:35.276751+0000","last_undegraded":"2023-08-09T12:51:35.276751+0000","last_fullsized":"2023-08-09T12:51:35.276751+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:30:40.865504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274623+0000","last_change":"2023-08-09T12:51:33.893072+0000","last_active":"2023-08-09T12:51:35.274623+0000","last_peered":"2023-08-09T12:51:35.274623+0000","last_clean":"2023-08-09T12:51:35.274623+0000","last_became_active":"2023-08-09T12:51:33.892780+0000","last_became_peered":"2023-08-09T12:51:33.892780+0000","last_unstale":"2023-08-09T12:51:35.274623+0000","last_undegraded":"2023-08-09T12:51:35.274623+0000","last_fullsized":"2023-08-09T12:51:35.274623+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:25:07.759806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866857+0000","last_change":"2023-08-09T12:51:33.895991+0000","last_active":"2023-08-09T12:51:34.866857+0000","last_peered":"2023-08-09T12:51:34.866857+0000","last_clean":"2023-08-09T12:51:34.866857+0000","last_became_active":"2023-08-09T12:51:33.895733+0000","last_became_peered":"2023-08-09T12:51:33.895733+0000","last_unstale":"2023-08-09T12:51:34.866857+0000","last_undegraded":"2023-08-09T12:51:34.866857+0000","last_fullsized":"2023-08-09T12:51:34.866857+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:04:53.900797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274226+0000","last_change":"2023-08-09T12:51:33.884956+0000","last_active":"2023-08-09T12:51:35.274226+0000","last_peered":"2023-08-09T12:51:35.274226+0000","last_clean":"2023-08-09T12:51:35.274226+0000","last_became_active":"2023-08-09T12:51:33.884406+0000","last_became_peered":"2023-08-09T12:51:33.884406+0000","last_unstale":"2023-08-09T12:51:35.274226+0000","last_undegraded":"2023-08-09T12:51:35.274226+0000","last_fullsized":"2023-08-09T12:51:35.274226+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:15:02.208478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866582+0000","last_change":"2023-08-09T12:51:33.874719+0000","last_active":"2023-08-09T12:51:34.866582+0000","last_peered":"2023-08-09T12:51:34.866582+0000","last_clean":"2023-08-09T12:51:34.866582+0000","last_became_active":"2023-08-09T12:51:33.874474+0000","last_became_peered":"2023-08-09T12:51:33.874474+0000","last_unstale":"2023-08-09T12:51:34.866582+0000","last_undegraded":"2023-08-09T12:51:34.866582+0000","last_fullsized":"2023-08-09T12:51:34.866582+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:32:50.741381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278149+0000","last_change":"2023-08-09T12:51:33.895751+0000","last_active":"2023-08-09T12:51:35.278149+0000","last_peered":"2023-08-09T12:51:35.278149+0000","last_clean":"2023-08-09T12:51:35.278149+0000","last_became_active":"2023-08-09T12:51:33.895191+0000","last_became_peered":"2023-08-09T12:51:33.895191+0000","last_unstale":"2023-08-09T12:51:35.278149+0000","last_undegraded":"2023-08-09T12:51:35.278149+0000","last_fullsized":"2023-08-09T12:51:35.278149+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:17.416780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275049+0000","last_change":"2023-08-09T12:51:33.900991+0000","last_active":"2023-08-09T12:51:35.275049+0000","last_peered":"2023-08-09T12:51:35.275049+0000","last_clean":"2023-08-09T12:51:35.275049+0000","last_became_active":"2023-08-09T12:51:33.900647+0000","last_became_peered":"2023-08-09T12:51:33.900647+0000","last_unstale":"2023-08-09T12:51:35.275049+0000","last_undegraded":"2023-08-09T12:51:35.275049+0000","last_fullsized":"2023-08-09T12:51:35.275049+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:04:53.043419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273521+0000","last_change":"2023-08-09T12:51:33.876293+0000","last_active":"2023-08-09T12:51:35.273521+0000","last_peered":"2023-08-09T12:51:35.273521+0000","last_clean":"2023-08-09T12:51:35.273521+0000","last_became_active":"2023-08-09T12:51:33.875899+0000","last_became_peered":"2023-08-09T12:51:33.875899+0000","last_unstale":"2023-08-09T12:51:35.273521+0000","last_undegraded":"2023-08-09T12:51:35.273521+0000","last_fullsized":"2023-08-09T12:51:35.273521+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:59:11.033578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277261+0000","last_change":"2023-08-09T12:51:33.896400+0000","last_active":"2023-08-09T12:51:35.277261+0000","last_peered":"2023-08-09T12:51:35.277261+0000","last_clean":"2023-08-09T12:51:35.277261+0000","last_became_active":"2023-08-09T12:51:33.895863+0000","last_became_peered":"2023-08-09T12:51:33.895863+0000","last_unstale":"2023-08-09T12:51:35.277261+0000","last_undegraded":"2023-08-09T12:51:35.277261+0000","last_fullsized":"2023-08-09T12:51:35.277261+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:17:01.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278112+0000","last_change":"2023-08-09T12:51:33.892186+0000","last_active":"2023-08-09T12:51:35.278112+0000","last_peered":"2023-08-09T12:51:35.278112+0000","last_clean":"2023-08-09T12:51:35.278112+0000","last_became_active":"2023-08-09T12:51:33.891907+0000","last_became_peered":"2023-08-09T12:51:33.891907+0000","last_unstale":"2023-08-09T12:51:35.278112+0000","last_undegraded":"2023-08-09T12:51:35.278112+0000","last_fullsized":"2023-08-09T12:51:35.278112+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:29:21.732714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866591+0000","last_change":"2023-08-09T12:51:33.873172+0000","last_active":"2023-08-09T12:51:34.866591+0000","last_peered":"2023-08-09T12:51:34.866591+0000","last_clean":"2023-08-09T12:51:34.866591+0000","last_became_active":"2023-08-09T12:51:33.872428+0000","last_became_peered":"2023-08-09T12:51:33.872428+0000","last_unstale":"2023-08-09T12:51:34.866591+0000","last_undegraded":"2023-08-09T12:51:34.866591+0000","last_fullsized":"2023-08-09T12:51:34.866591+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:14:53.792171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274891+0000","last_change":"2023-08-09T12:51:33.881282+0000","last_active":"2023-08-09T12:51:35.274891+0000","last_peered":"2023-08-09T12:51:35.274891+0000","last_clean":"2023-08-09T12:51:35.274891+0000","last_became_active":"2023-08-09T12:51:33.881015+0000","last_became_peered":"2023-08-09T12:51:33.881015+0000","last_unstale":"2023-08-09T12:51:35.274891+0000","last_undegraded":"2023-08-09T12:51:35.274891+0000","last_fullsized":"2023-08-09T12:51:35.274891+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:07:51.764288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276035+0000","last_change":"2023-08-09T12:51:33.897415+0000","last_active":"2023-08-09T12:51:35.276035+0000","last_peered":"2023-08-09T12:51:35.276035+0000","last_clean":"2023-08-09T12:51:35.276035+0000","last_became_active":"2023-08-09T12:51:33.893957+0000","last_became_peered":"2023-08-09T12:51:33.893957+0000","last_unstale":"2023-08-09T12:51:35.276035+0000","last_undegraded":"2023-08-09T12:51:35.276035+0000","last_fullsized":"2023-08-09T12:51:35.276035+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:05.411567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274201+0000","last_change":"2023-08-09T12:51:33.874521+0000","last_active":"2023-08-09T12:51:35.274201+0000","last_peered":"2023-08-09T12:51:35.274201+0000","last_clean":"2023-08-09T12:51:35.274201+0000","last_became_active":"2023-08-09T12:51:33.874258+0000","last_became_peered":"2023-08-09T12:51:33.874258+0000","last_unstale":"2023-08-09T12:51:35.274201+0000","last_undegraded":"2023-08-09T12:51:35.274201+0000","last_fullsized":"2023-08-09T12:51:35.274201+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:32:51.770229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866803+0000","last_change":"2023-08-09T12:51:33.900307+0000","last_active":"2023-08-09T12:51:34.866803+0000","last_peered":"2023-08-09T12:51:34.866803+0000","last_clean":"2023-08-09T12:51:34.866803+0000","last_became_active":"2023-08-09T12:51:33.899704+0000","last_became_peered":"2023-08-09T12:51:33.899704+0000","last_unstale":"2023-08-09T12:51:34.866803+0000","last_undegraded":"2023-08-09T12:51:34.866803+0000","last_fullsized":"2023-08-09T12:51:34.866803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:42:45.312893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275236+0000","last_change":"2023-08-09T12:51:33.900717+0000","last_active":"2023-08-09T12:51:35.275236+0000","last_peered":"2023-08-09T12:51:35.275236+0000","last_clean":"2023-08-09T12:51:35.275236+0000","last_became_active":"2023-08-09T12:51:33.896549+0000","last_became_peered":"2023-08-09T12:51:33.896549+0000","last_unstale":"2023-08-09T12:51:35.275236+0000","last_undegraded":"2023-08-09T12:51:35.275236+0000","last_fullsized":"2023-08-09T12:51:35.275236+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:49:30.119634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868136+0000","last_change":"2023-08-09T12:51:33.881948+0000","last_active":"2023-08-09T12:51:34.868136+0000","last_peered":"2023-08-09T12:51:34.868136+0000","last_clean":"2023-08-09T12:51:34.868136+0000","last_became_active":"2023-08-09T12:51:33.881674+0000","last_became_peered":"2023-08-09T12:51:33.881674+0000","last_unstale":"2023-08-09T12:51:34.868136+0000","last_undegraded":"2023-08-09T12:51:34.868136+0000","last_fullsized":"2023-08-09T12:51:34.868136+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:19:26.933566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"174'4","reported_seq":17,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866262+0000","last_change":"2023-08-09T12:51:32.856874+0000","last_active":"2023-08-09T12:51:34.866262+0000","last_peered":"2023-08-09T12:51:34.866262+0000","last_clean":"2023-08-09T12:51:34.866262+0000","last_became_active":"2023-08-09T12:51:32.856173+0000","last_became_peered":"2023-08-09T12:51:32.856173+0000","last_unstale":"2023-08-09T12:51:34.866262+0000","last_undegraded":"2023-08-09T12:51:34.866262+0000","last_fullsized":"2023-08-09T12:51:34.866262+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:30:50.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868482+0000","last_change":"2023-08-09T12:51:33.892503+0000","last_active":"2023-08-09T12:51:34.868482+0000","last_peered":"2023-08-09T12:51:34.868482+0000","last_clean":"2023-08-09T12:51:34.868482+0000","last_became_active":"2023-08-09T12:51:33.891683+0000","last_became_peered":"2023-08-09T12:51:33.891683+0000","last_unstale":"2023-08-09T12:51:34.868482+0000","last_undegraded":"2023-08-09T12:51:34.868482+0000","last_fullsized":"2023-08-09T12:51:34.868482+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:16.024680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865281+0000","last_change":"2023-08-09T12:51:32.861940+0000","last_active":"2023-08-09T12:51:34.865281+0000","last_peered":"2023-08-09T12:51:34.865281+0000","last_clean":"2023-08-09T12:51:34.865281+0000","last_became_active":"2023-08-09T12:51:32.858863+0000","last_became_peered":"2023-08-09T12:51:32.858863+0000","last_unstale":"2023-08-09T12:51:34.865281+0000","last_undegraded":"2023-08-09T12:51:34.865281+0000","last_fullsized":"2023-08-09T12:51:34.865281+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:00:53.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276429+0000","last_change":"2023-08-09T12:51:33.899436+0000","last_active":"2023-08-09T12:51:35.276429+0000","last_peered":"2023-08-09T12:51:35.276429+0000","last_clean":"2023-08-09T12:51:35.276429+0000","last_became_active":"2023-08-09T12:51:33.898318+0000","last_became_peered":"2023-08-09T12:51:33.898318+0000","last_unstale":"2023-08-09T12:51:35.276429+0000","last_undegraded":"2023-08-09T12:51:35.276429+0000","last_fullsized":"2023-08-09T12:51:35.276429+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:44:30.192363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865665+0000","last_change":"2023-08-09T12:51:32.857688+0000","last_active":"2023-08-09T12:51:34.865665+0000","last_peered":"2023-08-09T12:51:34.865665+0000","last_clean":"2023-08-09T12:51:34.865665+0000","last_became_active":"2023-08-09T12:51:32.857349+0000","last_became_peered":"2023-08-09T12:51:32.857349+0000","last_unstale":"2023-08-09T12:51:34.865665+0000","last_undegraded":"2023-08-09T12:51:34.865665+0000","last_fullsized":"2023-08-09T12:51:34.865665+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:33:37.178113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865837+0000","last_change":"2023-08-09T12:51:33.891415+0000","last_active":"2023-08-09T12:51:34.865837+0000","last_peered":"2023-08-09T12:51:34.865837+0000","last_clean":"2023-08-09T12:51:34.865837+0000","last_became_active":"2023-08-09T12:51:33.891108+0000","last_became_peered":"2023-08-09T12:51:33.891108+0000","last_unstale":"2023-08-09T12:51:34.865837+0000","last_undegraded":"2023-08-09T12:51:34.865837+0000","last_fullsized":"2023-08-09T12:51:34.865837+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:17:05.671478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868335+0000","last_change":"2023-08-09T12:51:32.855138+0000","last_active":"2023-08-09T12:51:34.868335+0000","last_peered":"2023-08-09T12:51:34.868335+0000","last_clean":"2023-08-09T12:51:34.868335+0000","last_became_active":"2023-08-09T12:51:32.854680+0000","last_became_peered":"2023-08-09T12:51:32.854680+0000","last_unstale":"2023-08-09T12:51:34.868335+0000","last_undegraded":"2023-08-09T12:51:34.868335+0000","last_fullsized":"2023-08-09T12:51:34.868335+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:01:02.364600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273802+0000","last_change":"2023-08-09T12:51:33.885141+0000","last_active":"2023-08-09T12:51:35.273802+0000","last_peered":"2023-08-09T12:51:35.273802+0000","last_clean":"2023-08-09T12:51:35.273802+0000","last_became_active":"2023-08-09T12:51:33.884727+0000","last_became_peered":"2023-08-09T12:51:33.884727+0000","last_unstale":"2023-08-09T12:51:35.273802+0000","last_undegraded":"2023-08-09T12:51:35.273802+0000","last_fullsized":"2023-08-09T12:51:35.273802+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:29:59.574268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275649+0000","last_change":"2023-08-09T12:51:32.860052+0000","last_active":"2023-08-09T12:51:35.275649+0000","last_peered":"2023-08-09T12:51:35.275649+0000","last_clean":"2023-08-09T12:51:35.275649+0000","last_became_active":"2023-08-09T12:51:32.859796+0000","last_became_peered":"2023-08-09T12:51:32.859796+0000","last_unstale":"2023-08-09T12:51:35.275649+0000","last_undegraded":"2023-08-09T12:51:35.275649+0000","last_fullsized":"2023-08-09T12:51:35.275649+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:05.055340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275033+0000","last_change":"2023-08-09T12:51:33.882400+0000","last_active":"2023-08-09T12:51:35.275033+0000","last_peered":"2023-08-09T12:51:35.275033+0000","last_clean":"2023-08-09T12:51:35.275033+0000","last_became_active":"2023-08-09T12:51:33.878219+0000","last_became_peered":"2023-08-09T12:51:33.878219+0000","last_unstale":"2023-08-09T12:51:35.275033+0000","last_undegraded":"2023-08-09T12:51:35.275033+0000","last_fullsized":"2023-08-09T12:51:35.275033+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:32:43.824234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866386+0000","last_change":"2023-08-09T12:51:32.857082+0000","last_active":"2023-08-09T12:51:34.866386+0000","last_peered":"2023-08-09T12:51:34.866386+0000","last_clean":"2023-08-09T12:51:34.866386+0000","last_became_active":"2023-08-09T12:51:32.856554+0000","last_became_peered":"2023-08-09T12:51:32.856554+0000","last_unstale":"2023-08-09T12:51:34.866386+0000","last_undegraded":"2023-08-09T12:51:34.866386+0000","last_fullsized":"2023-08-09T12:51:34.866386+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:47:54.641005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867863+0000","last_change":"2023-08-09T12:51:33.883822+0000","last_active":"2023-08-09T12:51:34.867863+0000","last_peered":"2023-08-09T12:51:34.867863+0000","last_clean":"2023-08-09T12:51:34.867863+0000","last_became_active":"2023-08-09T12:51:33.883219+0000","last_became_peered":"2023-08-09T12:51:33.883219+0000","last_unstale":"2023-08-09T12:51:34.867863+0000","last_undegraded":"2023-08-09T12:51:34.867863+0000","last_fullsized":"2023-08-09T12:51:34.867863+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:44.448229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274400+0000","last_change":"2023-08-09T12:51:32.855186+0000","last_active":"2023-08-09T12:51:35.274400+0000","last_peered":"2023-08-09T12:51:35.274400+0000","last_clean":"2023-08-09T12:51:35.274400+0000","last_became_active":"2023-08-09T12:51:32.854035+0000","last_became_peered":"2023-08-09T12:51:32.854035+0000","last_unstale":"2023-08-09T12:51:35.274400+0000","last_undegraded":"2023-08-09T12:51:35.274400+0000","last_fullsized":"2023-08-09T12:51:35.274400+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:00:38.153645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278973+0000","last_change":"2023-08-09T12:51:33.898553+0000","last_active":"2023-08-09T12:51:35.278973+0000","last_peered":"2023-08-09T12:51:35.278973+0000","last_clean":"2023-08-09T12:51:35.278973+0000","last_became_active":"2023-08-09T12:51:33.898257+0000","last_became_peered":"2023-08-09T12:51:33.898257+0000","last_unstale":"2023-08-09T12:51:35.278973+0000","last_undegraded":"2023-08-09T12:51:35.278973+0000","last_fullsized":"2023-08-09T12:51:35.278973+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:51:41.562586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866867+0000","last_change":"2023-08-09T12:51:32.859417+0000","last_active":"2023-08-09T12:51:34.866867+0000","last_peered":"2023-08-09T12:51:34.866867+0000","last_clean":"2023-08-09T12:51:34.866867+0000","last_became_active":"2023-08-09T12:51:32.858622+0000","last_became_peered":"2023-08-09T12:51:32.858622+0000","last_unstale":"2023-08-09T12:51:34.866867+0000","last_undegraded":"2023-08-09T12:51:34.866867+0000","last_fullsized":"2023-08-09T12:51:34.866867+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:39:33.744391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865962+0000","last_change":"2023-08-09T12:51:33.871741+0000","last_active":"2023-08-09T12:51:34.865962+0000","last_peered":"2023-08-09T12:51:34.865962+0000","last_clean":"2023-08-09T12:51:34.865962+0000","last_became_active":"2023-08-09T12:51:33.870747+0000","last_became_peered":"2023-08-09T12:51:33.870747+0000","last_unstale":"2023-08-09T12:51:34.865962+0000","last_undegraded":"2023-08-09T12:51:34.865962+0000","last_fullsized":"2023-08-09T12:51:34.865962+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:39:30.139919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273914+0000","last_change":"2023-08-09T12:51:32.849945+0000","last_active":"2023-08-09T12:51:35.273914+0000","last_peered":"2023-08-09T12:51:35.273914+0000","last_clean":"2023-08-09T12:51:35.273914+0000","last_became_active":"2023-08-09T12:51:32.848584+0000","last_became_peered":"2023-08-09T12:51:32.848584+0000","last_unstale":"2023-08-09T12:51:35.273914+0000","last_undegraded":"2023-08-09T12:51:35.273914+0000","last_fullsized":"2023-08-09T12:51:35.273914+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:53:06.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866284+0000","last_change":"2023-08-09T12:51:33.902440+0000","last_active":"2023-08-09T12:51:34.866284+0000","last_peered":"2023-08-09T12:51:34.866284+0000","last_clean":"2023-08-09T12:51:34.866284+0000","last_became_active":"2023-08-09T12:51:33.902206+0000","last_became_peered":"2023-08-09T12:51:33.902206+0000","last_unstale":"2023-08-09T12:51:34.866284+0000","last_undegraded":"2023-08-09T12:51:34.866284+0000","last_fullsized":"2023-08-09T12:51:34.866284+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:39:16.421607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866163+0000","last_change":"2023-08-09T12:51:32.851188+0000","last_active":"2023-08-09T12:51:34.866163+0000","last_peered":"2023-08-09T12:51:34.866163+0000","last_clean":"2023-08-09T12:51:34.866163+0000","last_became_active":"2023-08-09T12:51:32.850562+0000","last_became_peered":"2023-08-09T12:51:32.850562+0000","last_unstale":"2023-08-09T12:51:34.866163+0000","last_undegraded":"2023-08-09T12:51:34.866163+0000","last_fullsized":"2023-08-09T12:51:34.866163+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:35:08.058703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277611+0000","last_change":"2023-08-09T12:51:33.899696+0000","last_active":"2023-08-09T12:51:35.277611+0000","last_peered":"2023-08-09T12:51:35.277611+0000","last_clean":"2023-08-09T12:51:35.277611+0000","last_became_active":"2023-08-09T12:51:33.899323+0000","last_became_peered":"2023-08-09T12:51:33.899323+0000","last_unstale":"2023-08-09T12:51:35.277611+0000","last_undegraded":"2023-08-09T12:51:35.277611+0000","last_fullsized":"2023-08-09T12:51:35.277611+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:15:33.161521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"174'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868518+0000","last_change":"2023-08-09T12:51:32.855685+0000","last_active":"2023-08-09T12:51:34.868518+0000","last_peered":"2023-08-09T12:51:34.868518+0000","last_clean":"2023-08-09T12:51:34.868518+0000","last_became_active":"2023-08-09T12:51:32.855417+0000","last_became_peered":"2023-08-09T12:51:32.855417+0000","last_unstale":"2023-08-09T12:51:34.868518+0000","last_undegraded":"2023-08-09T12:51:34.868518+0000","last_fullsized":"2023-08-09T12:51:34.868518+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:36:19.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274174+0000","last_change":"2023-08-09T12:51:33.892641+0000","last_active":"2023-08-09T12:51:35.274174+0000","last_peered":"2023-08-09T12:51:35.274174+0000","last_clean":"2023-08-09T12:51:35.274174+0000","last_became_active":"2023-08-09T12:51:33.892346+0000","last_became_peered":"2023-08-09T12:51:33.892346+0000","last_unstale":"2023-08-09T12:51:35.274174+0000","last_undegraded":"2023-08-09T12:51:35.274174+0000","last_fullsized":"2023-08-09T12:51:35.274174+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:04:34.192804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276341+0000","last_change":"2023-08-09T12:51:32.862265+0000","last_active":"2023-08-09T12:51:35.276341+0000","last_peered":"2023-08-09T12:51:35.276341+0000","last_clean":"2023-08-09T12:51:35.276341+0000","last_became_active":"2023-08-09T12:51:32.861143+0000","last_became_peered":"2023-08-09T12:51:32.861143+0000","last_unstale":"2023-08-09T12:51:35.276341+0000","last_undegraded":"2023-08-09T12:51:35.276341+0000","last_fullsized":"2023-08-09T12:51:35.276341+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:53:57.729979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867023+0000","last_change":"2023-08-09T12:51:33.903667+0000","last_active":"2023-08-09T12:51:34.867023+0000","last_peered":"2023-08-09T12:51:34.867023+0000","last_clean":"2023-08-09T12:51:34.867023+0000","last_became_active":"2023-08-09T12:51:33.903429+0000","last_became_peered":"2023-08-09T12:51:33.903429+0000","last_unstale":"2023-08-09T12:51:34.867023+0000","last_undegraded":"2023-08-09T12:51:34.867023+0000","last_fullsized":"2023-08-09T12:51:34.867023+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:17:15.451184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274043+0000","last_change":"2023-08-09T12:51:32.857424+0000","last_active":"2023-08-09T12:51:35.274043+0000","last_peered":"2023-08-09T12:51:35.274043+0000","last_clean":"2023-08-09T12:51:35.274043+0000","last_became_active":"2023-08-09T12:51:32.857037+0000","last_became_peered":"2023-08-09T12:51:32.857037+0000","last_unstale":"2023-08-09T12:51:35.274043+0000","last_undegraded":"2023-08-09T12:51:35.274043+0000","last_fullsized":"2023-08-09T12:51:35.274043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:02:28.628180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868727+0000","last_change":"2023-08-09T12:51:33.899302+0000","last_active":"2023-08-09T12:51:34.868727+0000","last_peered":"2023-08-09T12:51:34.868727+0000","last_clean":"2023-08-09T12:51:34.868727+0000","last_became_active":"2023-08-09T12:51:33.899079+0000","last_became_peered":"2023-08-09T12:51:33.899079+0000","last_unstale":"2023-08-09T12:51:34.868727+0000","last_undegraded":"2023-08-09T12:51:34.868727+0000","last_fullsized":"2023-08-09T12:51:34.868727+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:26:00.015430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277502+0000","last_change":"2023-08-09T12:51:32.845829+0000","last_active":"2023-08-09T12:51:35.277502+0000","last_peered":"2023-08-09T12:51:35.277502+0000","last_clean":"2023-08-09T12:51:35.277502+0000","last_became_active":"2023-08-09T12:51:32.845066+0000","last_became_peered":"2023-08-09T12:51:32.845066+0000","last_unstale":"2023-08-09T12:51:35.277502+0000","last_undegraded":"2023-08-09T12:51:35.277502+0000","last_fullsized":"2023-08-09T12:51:35.277502+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:41:40.496305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867660+0000","last_change":"2023-08-09T12:51:33.874607+0000","last_active":"2023-08-09T12:51:34.867660+0000","last_peered":"2023-08-09T12:51:34.867660+0000","last_clean":"2023-08-09T12:51:34.867660+0000","last_became_active":"2023-08-09T12:51:33.873494+0000","last_became_peered":"2023-08-09T12:51:33.873494+0000","last_unstale":"2023-08-09T12:51:34.867660+0000","last_undegraded":"2023-08-09T12:51:34.867660+0000","last_fullsized":"2023-08-09T12:51:34.867660+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:13:24.760727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273926+0000","last_change":"2023-08-09T12:51:32.858425+0000","last_active":"2023-08-09T12:51:35.273926+0000","last_peered":"2023-08-09T12:51:35.273926+0000","last_clean":"2023-08-09T12:51:35.273926+0000","last_became_active":"2023-08-09T12:51:32.858189+0000","last_became_peered":"2023-08-09T12:51:32.858189+0000","last_unstale":"2023-08-09T12:51:35.273926+0000","last_undegraded":"2023-08-09T12:51:35.273926+0000","last_fullsized":"2023-08-09T12:51:35.273926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:20.381398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868009+0000","last_change":"2023-08-09T12:51:33.892220+0000","last_active":"2023-08-09T12:51:34.868009+0000","last_peered":"2023-08-09T12:51:34.868009+0000","last_clean":"2023-08-09T12:51:34.868009+0000","last_became_active":"2023-08-09T12:51:33.891968+0000","last_became_peered":"2023-08-09T12:51:33.891968+0000","last_unstale":"2023-08-09T12:51:34.868009+0000","last_undegraded":"2023-08-09T12:51:34.868009+0000","last_fullsized":"2023-08-09T12:51:34.868009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:15:54.338548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277585+0000","last_change":"2023-08-09T12:51:32.853663+0000","last_active":"2023-08-09T12:51:35.277585+0000","last_peered":"2023-08-09T12:51:35.277585+0000","last_clean":"2023-08-09T12:51:35.277585+0000","last_became_active":"2023-08-09T12:51:32.853266+0000","last_became_peered":"2023-08-09T12:51:32.853266+0000","last_unstale":"2023-08-09T12:51:35.277585+0000","last_undegraded":"2023-08-09T12:51:35.277585+0000","last_fullsized":"2023-08-09T12:51:35.277585+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:25:18.588813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866752+0000","last_change":"2023-08-09T12:51:33.900420+0000","last_active":"2023-08-09T12:51:34.866752+0000","last_peered":"2023-08-09T12:51:34.866752+0000","last_clean":"2023-08-09T12:51:34.866752+0000","last_became_active":"2023-08-09T12:51:33.899333+0000","last_became_peered":"2023-08-09T12:51:33.899333+0000","last_unstale":"2023-08-09T12:51:34.866752+0000","last_undegraded":"2023-08-09T12:51:34.866752+0000","last_fullsized":"2023-08-09T12:51:34.866752+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:44:46.557912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276986+0000","last_change":"2023-08-09T12:51:32.862064+0000","last_active":"2023-08-09T12:51:35.276986+0000","last_peered":"2023-08-09T12:51:35.276986+0000","last_clean":"2023-08-09T12:51:35.276986+0000","last_became_active":"2023-08-09T12:51:32.860823+0000","last_became_peered":"2023-08-09T12:51:32.860823+0000","last_unstale":"2023-08-09T12:51:35.276986+0000","last_undegraded":"2023-08-09T12:51:35.276986+0000","last_fullsized":"2023-08-09T12:51:35.276986+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:34:48.789394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275388+0000","last_change":"2023-08-09T12:51:33.881581+0000","last_active":"2023-08-09T12:51:35.275388+0000","last_peered":"2023-08-09T12:51:35.275388+0000","last_clean":"2023-08-09T12:51:35.275388+0000","last_became_active":"2023-08-09T12:51:33.876210+0000","last_became_peered":"2023-08-09T12:51:33.876210+0000","last_unstale":"2023-08-09T12:51:35.275388+0000","last_undegraded":"2023-08-09T12:51:35.275388+0000","last_fullsized":"2023-08-09T12:51:35.275388+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:44:36.682984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"175'1","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277009+0000","last_change":"2023-08-09T12:51:32.855768+0000","last_active":"2023-08-09T12:51:35.277009+0000","last_peered":"2023-08-09T12:51:35.277009+0000","last_clean":"2023-08-09T12:51:35.277009+0000","last_became_active":"2023-08-09T12:51:32.855457+0000","last_became_peered":"2023-08-09T12:51:32.855457+0000","last_unstale":"2023-08-09T12:51:35.277009+0000","last_undegraded":"2023-08-09T12:51:35.277009+0000","last_fullsized":"2023-08-09T12:51:35.277009+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:09:14.295562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276376+0000","last_change":"2023-08-09T12:51:33.900191+0000","last_active":"2023-08-09T12:51:35.276376+0000","last_peered":"2023-08-09T12:51:35.276376+0000","last_clean":"2023-08-09T12:51:35.276376+0000","last_became_active":"2023-08-09T12:51:33.899952+0000","last_became_peered":"2023-08-09T12:51:33.899952+0000","last_unstale":"2023-08-09T12:51:35.276376+0000","last_undegraded":"2023-08-09T12:51:35.276376+0000","last_fullsized":"2023-08-09T12:51:35.276376+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:08:46.269263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867750+0000","last_change":"2023-08-09T12:51:32.851600+0000","last_active":"2023-08-09T12:51:34.867750+0000","last_peered":"2023-08-09T12:51:34.867750+0000","last_clean":"2023-08-09T12:51:34.867750+0000","last_became_active":"2023-08-09T12:51:32.850913+0000","last_became_peered":"2023-08-09T12:51:32.850913+0000","last_unstale":"2023-08-09T12:51:34.867750+0000","last_undegraded":"2023-08-09T12:51:34.867750+0000","last_fullsized":"2023-08-09T12:51:34.867750+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:11:04.736611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866929+0000","last_change":"2023-08-09T12:51:33.877600+0000","last_active":"2023-08-09T12:51:34.866929+0000","last_peered":"2023-08-09T12:51:34.866929+0000","last_clean":"2023-08-09T12:51:34.866929+0000","last_became_active":"2023-08-09T12:51:33.877381+0000","last_became_peered":"2023-08-09T12:51:33.877381+0000","last_unstale":"2023-08-09T12:51:34.866929+0000","last_undegraded":"2023-08-09T12:51:34.866929+0000","last_fullsized":"2023-08-09T12:51:34.866929+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:29:31.658264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867380+0000","last_change":"2023-08-09T12:51:32.860317+0000","last_active":"2023-08-09T12:51:34.867380+0000","last_peered":"2023-08-09T12:51:34.867380+0000","last_clean":"2023-08-09T12:51:34.867380+0000","last_became_active":"2023-08-09T12:51:32.859107+0000","last_became_peered":"2023-08-09T12:51:32.859107+0000","last_unstale":"2023-08-09T12:51:34.867380+0000","last_undegraded":"2023-08-09T12:51:34.867380+0000","last_fullsized":"2023-08-09T12:51:34.867380+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:06.896778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277111+0000","last_change":"2023-08-09T12:51:33.895017+0000","last_active":"2023-08-09T12:51:35.277111+0000","last_peered":"2023-08-09T12:51:35.277111+0000","last_clean":"2023-08-09T12:51:35.277111+0000","last_became_active":"2023-08-09T12:51:33.893038+0000","last_became_peered":"2023-08-09T12:51:33.893038+0000","last_unstale":"2023-08-09T12:51:35.277111+0000","last_undegraded":"2023-08-09T12:51:35.277111+0000","last_fullsized":"2023-08-09T12:51:35.277111+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:03:10.063766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278235+0000","last_change":"2023-08-09T12:51:32.858298+0000","last_active":"2023-08-09T12:51:35.278235+0000","last_peered":"2023-08-09T12:51:35.278235+0000","last_clean":"2023-08-09T12:51:35.278235+0000","last_became_active":"2023-08-09T12:51:32.857913+0000","last_became_peered":"2023-08-09T12:51:32.857913+0000","last_unstale":"2023-08-09T12:51:35.278235+0000","last_undegraded":"2023-08-09T12:51:35.278235+0000","last_fullsized":"2023-08-09T12:51:35.278235+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:49.090263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.274464+0000","last_change":"2023-08-09T12:51:33.874710+0000","last_active":"2023-08-09T12:51:35.274464+0000","last_peered":"2023-08-09T12:51:35.274464+0000","last_clean":"2023-08-09T12:51:35.274464+0000","last_became_active":"2023-08-09T12:51:33.870399+0000","last_became_peered":"2023-08-09T12:51:33.870399+0000","last_unstale":"2023-08-09T12:51:35.274464+0000","last_undegraded":"2023-08-09T12:51:35.274464+0000","last_fullsized":"2023-08-09T12:51:35.274464+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:58:34.269702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273352+0000","last_change":"2023-08-09T12:51:32.845390+0000","last_active":"2023-08-09T12:51:35.273352+0000","last_peered":"2023-08-09T12:51:35.273352+0000","last_clean":"2023-08-09T12:51:35.273352+0000","last_became_active":"2023-08-09T12:51:32.844498+0000","last_became_peered":"2023-08-09T12:51:32.844498+0000","last_unstale":"2023-08-09T12:51:35.273352+0000","last_undegraded":"2023-08-09T12:51:35.273352+0000","last_fullsized":"2023-08-09T12:51:35.273352+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:13:43.634467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868424+0000","last_change":"2023-08-09T12:51:33.897414+0000","last_active":"2023-08-09T12:51:34.868424+0000","last_peered":"2023-08-09T12:51:34.868424+0000","last_clean":"2023-08-09T12:51:34.868424+0000","last_became_active":"2023-08-09T12:51:33.897139+0000","last_became_peered":"2023-08-09T12:51:33.897139+0000","last_unstale":"2023-08-09T12:51:34.868424+0000","last_undegraded":"2023-08-09T12:51:34.868424+0000","last_fullsized":"2023-08-09T12:51:34.868424+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:21:16.180788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277238+0000","last_change":"2023-08-09T12:51:32.860824+0000","last_active":"2023-08-09T12:51:35.277238+0000","last_peered":"2023-08-09T12:51:35.277238+0000","last_clean":"2023-08-09T12:51:35.277238+0000","last_became_active":"2023-08-09T12:51:32.859399+0000","last_became_peered":"2023-08-09T12:51:32.859399+0000","last_unstale":"2023-08-09T12:51:35.277238+0000","last_undegraded":"2023-08-09T12:51:35.277238+0000","last_fullsized":"2023-08-09T12:51:35.277238+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:52.954491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276979+0000","last_change":"2023-08-09T12:51:33.902835+0000","last_active":"2023-08-09T12:51:35.276979+0000","last_peered":"2023-08-09T12:51:35.276979+0000","last_clean":"2023-08-09T12:51:35.276979+0000","last_became_active":"2023-08-09T12:51:33.899388+0000","last_became_peered":"2023-08-09T12:51:33.899388+0000","last_unstale":"2023-08-09T12:51:35.276979+0000","last_undegraded":"2023-08-09T12:51:35.276979+0000","last_fullsized":"2023-08-09T12:51:35.276979+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:26:16.974365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.865644+0000","last_change":"2023-08-09T12:51:32.861212+0000","last_active":"2023-08-09T12:51:34.865644+0000","last_peered":"2023-08-09T12:51:34.865644+0000","last_clean":"2023-08-09T12:51:34.865644+0000","last_became_active":"2023-08-09T12:51:32.857090+0000","last_became_peered":"2023-08-09T12:51:32.857090+0000","last_unstale":"2023-08-09T12:51:34.865644+0000","last_undegraded":"2023-08-09T12:51:34.865644+0000","last_fullsized":"2023-08-09T12:51:34.865644+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:17:12.741012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276666+0000","last_change":"2023-08-09T12:51:33.903329+0000","last_active":"2023-08-09T12:51:35.276666+0000","last_peered":"2023-08-09T12:51:35.276666+0000","last_clean":"2023-08-09T12:51:35.276666+0000","last_became_active":"2023-08-09T12:51:33.899727+0000","last_became_peered":"2023-08-09T12:51:33.899727+0000","last_unstale":"2023-08-09T12:51:35.276666+0000","last_undegraded":"2023-08-09T12:51:35.276666+0000","last_fullsized":"2023-08-09T12:51:35.276666+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:40.751286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"174'6","reported_seq":19,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273350+0000","last_change":"2023-08-09T12:51:32.850475+0000","last_active":"2023-08-09T12:51:35.273350+0000","last_peered":"2023-08-09T12:51:35.273350+0000","last_clean":"2023-08-09T12:51:35.273350+0000","last_became_active":"2023-08-09T12:51:32.850029+0000","last_became_peered":"2023-08-09T12:51:32.850029+0000","last_unstale":"2023-08-09T12:51:35.273350+0000","last_undegraded":"2023-08-09T12:51:35.273350+0000","last_fullsized":"2023-08-09T12:51:35.273350+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:02:51.063192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":473,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868190+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:51:34.868190+0000","last_peered":"2023-08-09T12:51:34.868190+0000","last_clean":"2023-08-09T12:51:34.868190+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:51:34.868190+0000","last_undegraded":"2023-08-09T12:51:34.868190+0000","last_fullsized":"2023-08-09T12:51:34.868190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:39:22.313967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278393+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:51:35.278393+0000","last_peered":"2023-08-09T12:51:35.278393+0000","last_clean":"2023-08-09T12:51:35.278393+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:51:35.278393+0000","last_undegraded":"2023-08-09T12:51:35.278393+0000","last_fullsized":"2023-08-09T12:51:35.278393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:55:16.916192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276750+0000","last_change":"2023-08-09T12:51:33.899592+0000","last_active":"2023-08-09T12:51:35.276750+0000","last_peered":"2023-08-09T12:51:35.276750+0000","last_clean":"2023-08-09T12:51:35.276750+0000","last_became_active":"2023-08-09T12:51:33.898674+0000","last_became_peered":"2023-08-09T12:51:33.898674+0000","last_unstale":"2023-08-09T12:51:35.276750+0000","last_undegraded":"2023-08-09T12:51:35.276750+0000","last_fullsized":"2023-08-09T12:51:35.276750+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:59:11.424097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867243+0000","last_change":"2023-08-09T12:51:32.852713+0000","last_active":"2023-08-09T12:51:34.867243+0000","last_peered":"2023-08-09T12:51:34.867243+0000","last_clean":"2023-08-09T12:51:34.867243+0000","last_became_active":"2023-08-09T12:51:32.852345+0000","last_became_peered":"2023-08-09T12:51:32.852345+0000","last_unstale":"2023-08-09T12:51:34.867243+0000","last_undegraded":"2023-08-09T12:51:34.867243+0000","last_fullsized":"2023-08-09T12:51:34.867243+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:19:53.576368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":317,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867859+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:51:34.867859+0000","last_peered":"2023-08-09T12:51:34.867859+0000","last_clean":"2023-08-09T12:51:34.867859+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:51:34.867859+0000","last_undegraded":"2023-08-09T12:51:34.867859+0000","last_fullsized":"2023-08-09T12:51:34.867859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:50:02.015915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275331+0000","last_change":"2023-08-09T12:51:33.877579+0000","last_active":"2023-08-09T12:51:35.275331+0000","last_peered":"2023-08-09T12:51:35.275331+0000","last_clean":"2023-08-09T12:51:35.275331+0000","last_became_active":"2023-08-09T12:51:33.877340+0000","last_became_peered":"2023-08-09T12:51:33.877340+0000","last_unstale":"2023-08-09T12:51:35.275331+0000","last_undegraded":"2023-08-09T12:51:35.275331+0000","last_fullsized":"2023-08-09T12:51:35.275331+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:56:41.910862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.278378+0000","last_change":"2023-08-09T12:51:32.857165+0000","last_active":"2023-08-09T12:51:35.278378+0000","last_peered":"2023-08-09T12:51:35.278378+0000","last_clean":"2023-08-09T12:51:35.278378+0000","last_became_active":"2023-08-09T12:51:32.856539+0000","last_became_peered":"2023-08-09T12:51:32.856539+0000","last_unstale":"2023-08-09T12:51:35.278378+0000","last_undegraded":"2023-08-09T12:51:35.278378+0000","last_fullsized":"2023-08-09T12:51:35.278378+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:15.800974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275435+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:51:35.275435+0000","last_peered":"2023-08-09T12:51:35.275435+0000","last_clean":"2023-08-09T12:51:35.275435+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:51:35.275435+0000","last_undegraded":"2023-08-09T12:51:35.275435+0000","last_fullsized":"2023-08-09T12:51:35.275435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:56:27.594573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.273266+0000","last_change":"2023-08-09T12:51:33.893133+0000","last_active":"2023-08-09T12:51:35.273266+0000","last_peered":"2023-08-09T12:51:35.273266+0000","last_clean":"2023-08-09T12:51:35.273266+0000","last_became_active":"2023-08-09T12:51:33.892875+0000","last_became_peered":"2023-08-09T12:51:33.892875+0000","last_unstale":"2023-08-09T12:51:35.273266+0000","last_undegraded":"2023-08-09T12:51:35.273266+0000","last_fullsized":"2023-08-09T12:51:35.273266+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:04.301485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"174'3","reported_seq":16,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275088+0000","last_change":"2023-08-09T12:51:32.856897+0000","last_active":"2023-08-09T12:51:35.275088+0000","last_peered":"2023-08-09T12:51:35.275088+0000","last_clean":"2023-08-09T12:51:35.275088+0000","last_became_active":"2023-08-09T12:51:32.854678+0000","last_became_peered":"2023-08-09T12:51:32.854678+0000","last_unstale":"2023-08-09T12:51:35.275088+0000","last_undegraded":"2023-08-09T12:51:35.275088+0000","last_fullsized":"2023-08-09T12:51:35.275088+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:22:04.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.279187+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:51:35.279187+0000","last_peered":"2023-08-09T12:51:35.279187+0000","last_clean":"2023-08-09T12:51:35.279187+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:51:35.279187+0000","last_undegraded":"2023-08-09T12:51:35.279187+0000","last_fullsized":"2023-08-09T12:51:35.279187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:33:21.306012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275401+0000","last_change":"2023-08-09T12:51:33.895168+0000","last_active":"2023-08-09T12:51:35.275401+0000","last_peered":"2023-08-09T12:51:35.275401+0000","last_clean":"2023-08-09T12:51:35.275401+0000","last_became_active":"2023-08-09T12:51:33.894891+0000","last_became_peered":"2023-08-09T12:51:33.894891+0000","last_unstale":"2023-08-09T12:51:35.275401+0000","last_undegraded":"2023-08-09T12:51:35.275401+0000","last_fullsized":"2023-08-09T12:51:35.275401+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:43:28.207591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"174'2","reported_seq":15,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867288+0000","last_change":"2023-08-09T12:51:32.855754+0000","last_active":"2023-08-09T12:51:34.867288+0000","last_peered":"2023-08-09T12:51:34.867288+0000","last_clean":"2023-08-09T12:51:34.867288+0000","last_became_active":"2023-08-09T12:51:32.854067+0000","last_became_peered":"2023-08-09T12:51:32.854067+0000","last_unstale":"2023-08-09T12:51:34.867288+0000","last_undegraded":"2023-08-09T12:51:34.867288+0000","last_fullsized":"2023-08-09T12:51:34.867288+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:15:15.478140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868832+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:51:34.868832+0000","last_peered":"2023-08-09T12:51:34.868832+0000","last_clean":"2023-08-09T12:51:34.868832+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:51:34.868832+0000","last_undegraded":"2023-08-09T12:51:34.868832+0000","last_fullsized":"2023-08-09T12:51:34.868832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:24:14.836836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868225+0000","last_change":"2023-08-09T12:51:33.882724+0000","last_active":"2023-08-09T12:51:34.868225+0000","last_peered":"2023-08-09T12:51:34.868225+0000","last_clean":"2023-08-09T12:51:34.868225+0000","last_became_active":"2023-08-09T12:51:33.882489+0000","last_became_peered":"2023-08-09T12:51:33.882489+0000","last_unstale":"2023-08-09T12:51:34.868225+0000","last_undegraded":"2023-08-09T12:51:34.868225+0000","last_fullsized":"2023-08-09T12:51:34.868225+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:22:43.656090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.275484+0000","last_change":"2023-08-09T12:51:32.858693+0000","last_active":"2023-08-09T12:51:35.275484+0000","last_peered":"2023-08-09T12:51:35.275484+0000","last_clean":"2023-08-09T12:51:35.275484+0000","last_became_active":"2023-08-09T12:51:32.858352+0000","last_became_peered":"2023-08-09T12:51:32.858352+0000","last_unstale":"2023-08-09T12:51:35.275484+0000","last_undegraded":"2023-08-09T12:51:35.275484+0000","last_fullsized":"2023-08-09T12:51:35.275484+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:18:09.898610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":316,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.867050+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:51:34.867050+0000","last_peered":"2023-08-09T12:51:34.867050+0000","last_clean":"2023-08-09T12:51:34.867050+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:51:34.867050+0000","last_undegraded":"2023-08-09T12:51:34.867050+0000","last_fullsized":"2023-08-09T12:51:34.867050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:46:43.974709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.866983+0000","last_change":"2023-08-09T12:51:33.873573+0000","last_active":"2023-08-09T12:51:34.866983+0000","last_peered":"2023-08-09T12:51:34.866983+0000","last_clean":"2023-08-09T12:51:34.866983+0000","last_became_active":"2023-08-09T12:51:33.873312+0000","last_became_peered":"2023-08-09T12:51:33.873312+0000","last_unstale":"2023-08-09T12:51:34.866983+0000","last_undegraded":"2023-08-09T12:51:34.866983+0000","last_fullsized":"2023-08-09T12:51:34.866983+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:02:32.217729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276024+0000","last_change":"2023-08-09T12:51:32.862731+0000","last_active":"2023-08-09T12:51:35.276024+0000","last_peered":"2023-08-09T12:51:35.276024+0000","last_clean":"2023-08-09T12:51:35.276024+0000","last_became_active":"2023-08-09T12:51:32.861608+0000","last_became_peered":"2023-08-09T12:51:32.861608+0000","last_unstale":"2023-08-09T12:51:35.276024+0000","last_undegraded":"2023-08-09T12:51:35.276024+0000","last_fullsized":"2023-08-09T12:51:35.276024+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:23:22.776561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868280+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:51:34.868280+0000","last_peered":"2023-08-09T12:51:34.868280+0000","last_clean":"2023-08-09T12:51:34.868280+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:51:34.868280+0000","last_undegraded":"2023-08-09T12:51:34.868280+0000","last_fullsized":"2023-08-09T12:51:34.868280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:47:16.871212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:34.868617+0000","last_change":"2023-08-09T12:51:33.876711+0000","last_active":"2023-08-09T12:51:34.868617+0000","last_peered":"2023-08-09T12:51:34.868617+0000","last_clean":"2023-08-09T12:51:34.868617+0000","last_became_active":"2023-08-09T12:51:33.876457+0000","last_became_peered":"2023-08-09T12:51:33.876457+0000","last_unstale":"2023-08-09T12:51:34.868617+0000","last_undegraded":"2023-08-09T12:51:34.868617+0000","last_fullsized":"2023-08-09T12:51:34.868617+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:32.823497+0000","last_clean_scrub_stamp":"2023-08-09T12:51:32.823497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:37:14.833669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"174'8","reported_seq":21,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.276609+0000","last_change":"2023-08-09T12:51:32.860530+0000","last_active":"2023-08-09T12:51:35.276609+0000","last_peered":"2023-08-09T12:51:35.276609+0000","last_clean":"2023-08-09T12:51:35.276609+0000","last_became_active":"2023-08-09T12:51:32.858793+0000","last_became_peered":"2023-08-09T12:51:32.858793+0000","last_unstale":"2023-08-09T12:51:35.276609+0000","last_undegraded":"2023-08-09T12:51:35.276609+0000","last_fullsized":"2023-08-09T12:51:35.276609+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:51:31.810204+0000","last_clean_scrub_stamp":"2023-08-09T12:51:31.810204+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:56:20.398869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":316,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-09T12:51:35.277312+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:51:35.277312+0000","last_peered":"2023-08-09T12:51:35.277312+0000","last_clean":"2023-08-09T12:51:35.277312+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:51:35.277312+0000","last_undegraded":"2023-08-09T12:51:35.277312+0000","last_fullsized":"2023-08-09T12:51:35.277312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:30:34.493824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1596,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193715,"statfs":{"total":200000000,"available":198364764,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1819999999999999,"15min":1.135},"min":{"1min":0.72599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.611,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.593},{"interface":"front","average":{"1min":1.107,"5min":1.1259999999999999,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.70499999999999996,"15min":0.44500000000000001},"max":{"1min":1.369,"5min":1.7509999999999999,"15min":2.0459999999999998},"last":1.1040000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.24,"15min":1.1859999999999999},"min":{"1min":0.86299999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.5740000000000001,"5min":1.7809999999999999,"15min":2.0859999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1919999999999999,"15min":1.1659999999999999},"min":{"1min":0.70399999999999996,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.752,"5min":1.778,"15min":1.778},"last":1.6579999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.286,"15min":1.2450000000000001},"min":{"1min":0.84799999999999998,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":1.5960000000000001,"5min":1.78,"15min":2.1459999999999999},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.2589999999999999,"15min":1.2090000000000001},"min":{"1min":0.81799999999999995,"5min":0.71399999999999997,"15min":0.69799999999999995},"max":{"1min":1.6519999999999999,"5min":1.6579999999999999,"15min":2.173},"last":1.3320000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.327,"15min":1.294},"min":{"1min":0.86399999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6699999999999999,"5min":1.806,"15min":3.4540000000000002},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.3049999999999999,"15min":1.3129999999999999},"min":{"1min":0.77800000000000002,"5min":0.72699999999999998,"15min":0.61599999999999999},"max":{"1min":1.681,"5min":1.8460000000000001,"15min":2.282},"last":1.254}]},{"osd":4,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.242,"15min":1.2310000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.873,"5min":1.948,"15min":2.8769999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.68700000000000006,"5min":0.67000000000000004,"15min":0.58599999999999997},"max":{"1min":1.655,"5min":1.8480000000000001,"15min":4.6200000000000001},"last":1.1579999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.4159999999999999,"15min":1.3799999999999999},"min":{"1min":0.62,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.6599999999999999,"5min":1.978,"15min":2.802},"last":1.411},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.506,"15min":1.5089999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.8120000000000001,"5min":2.1299999999999999,"15min":3.3580000000000001},"last":1.45}]},{"osd":6,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.476,"15min":1.4830000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.901,"5min":2.2370000000000001,"15min":3.4910000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.8680000000000001,"5min":1.9770000000000001,"15min":2.4039999999999999},"last":1.5}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.093,"15min":1.133},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.56399999999999995},"max":{"1min":1.3180000000000001,"5min":1.573,"15min":2.54},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.155,"15min":1.109},"min":{"1min":0.83199999999999996,"5min":0.64400000000000002,"15min":0.54000000000000004},"max":{"1min":1.577,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.79400000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.2769999999999999,"15min":1.258},"min":{"1min":0.97799999999999998,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.655,"5min":1.996,"15min":2.306},"last":1.28},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.306,"15min":1.3280000000000001},"min":{"1min":1.075,"5min":0.79100000000000004,"15min":0.76800000000000002},"max":{"1min":1.5980000000000001,"5min":1.7509999999999999,"15min":1.9279999999999999},"last":1.4490000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.179,"15min":1.151},"min":{"1min":0.89600000000000002,"5min":0.69999999999999996,"15min":0.66900000000000004},"max":{"1min":1.587,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3009999999999999,"15min":1.296},"min":{"1min":0.86799999999999999,"5min":0.69699999999999995,"15min":0.66300000000000003},"max":{"1min":1.7170000000000001,"5min":2.1120000000000001,"15min":2.6499999999999999},"last":1.081}]},{"osd":3,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3300000000000001,"15min":1.3169999999999999},"min":{"1min":0.94699999999999995,"5min":0.79500000000000004,"15min":0.67600000000000005},"max":{"1min":1.845,"5min":1.845,"15min":2.327},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.3520000000000001,"15min":1.3380000000000001},"min":{"1min":1.125,"5min":0.81799999999999995,"15min":0.74099999999999999},"max":{"1min":1.7789999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.835}]},{"osd":4,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.337,"15min":1.367},"min":{"1min":1.1140000000000001,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.821,"5min":1.8620000000000001,"15min":11.058999999999999},"last":1.179},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.377,"15min":1.367},"min":{"1min":1.0349999999999999,"5min":0.85399999999999998,"15min":0.57399999999999995},"max":{"1min":1.911,"5min":1.911,"15min":2.3479999999999999},"last":1.038}]},{"osd":5,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.3380000000000001,"15min":1.3540000000000001},"min":{"1min":1.018,"5min":0.82999999999999996,"15min":0.77600000000000002},"max":{"1min":1.96,"5min":2.2349999999999999,"15min":2.5249999999999999},"last":1.599},{"interface":"front","average":{"1min":1.613,"5min":1.4950000000000001,"15min":1.5049999999999999},"min":{"1min":1.232,"5min":0.95599999999999996,"15min":0.81899999999999995},"max":{"1min":1.929,"5min":1.986,"15min":2.8580000000000001},"last":1.4139999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.5369999999999999,"15min":1.508},"min":{"1min":1.4199999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.7999999999999998},"last":1.768},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.5029999999999999,"15min":1.4990000000000001},"min":{"1min":1.0469999999999999,"5min":0.98699999999999999,"15min":0.74399999999999999},"max":{"1min":2.1280000000000001,"5min":2.7810000000000001,"15min":3.621},"last":2.0739999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.119,"15min":1.1120000000000001},"min":{"1min":0.76900000000000002,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.609,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.181,"15min":1.1499999999999999},"min":{"1min":0.77100000000000002,"5min":0.67800000000000005,"15min":0.625},"max":{"1min":1.6180000000000001,"5min":1.97,"15min":2.0600000000000001},"last":1.383}]},{"osd":1,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.365,"15min":1.335},"min":{"1min":0.79000000000000004,"5min":0.78600000000000003,"15min":0.63800000000000001},"max":{"1min":1.847,"5min":1.851,"15min":2.6579999999999999},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.3520000000000001,"15min":1.292},"min":{"1min":1.135,"5min":0.73899999999999999,"15min":0.70199999999999996},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":1.3620000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.2929999999999999,"15min":1.2450000000000001},"min":{"1min":0.91900000000000004,"5min":0.74299999999999999,"15min":0.69799999999999995},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.296},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2889999999999999,"15min":1.228},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.716,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2949999999999999,"15min":1.2689999999999999},"min":{"1min":0.90500000000000003,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4810000000000001,"5min":1.7829999999999999,"15min":2.2330000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.3759999999999999,"15min":1.375},"min":{"1min":0.95999999999999996,"5min":0.83399999999999996,"15min":0.78200000000000003},"max":{"1min":2.6600000000000001,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.153}]},{"osd":4,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.323,"15min":1.2709999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":2.169,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.091},{"interface":"front","average":{"1min":1.373,"5min":1.4239999999999999,"15min":1.3939999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.628},"max":{"1min":2.21,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.3280000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.4630000000000001,"15min":1.395},"min":{"1min":1.0449999999999999,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":2.7719999999999998,"5min":2.952,"15min":2.952},"last":1.405},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.518,"15min":1.4810000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":1.883,"5min":5.8570000000000002,"15min":5.8570000000000002},"last":1.2050000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:51:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.55,"15min":1.5289999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":2.0600000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.629,"15min":1.5700000000000001},"min":{"1min":1.121,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":2.8849999999999998,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.4510000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1021,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194290,"statfs":{"total":200000000,"available":198953542,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.077,"15min":1.099},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.397,"5min":1.6060000000000001,"15min":2.5670000000000002},"last":1.986},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.123,"15min":1.1259999999999999},"min":{"1min":0.69399999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.373,"5min":1.673,"15min":3.4100000000000001},"last":1.018}]},{"osd":1,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.304,"15min":1.3009999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.611,"5min":1.863,"15min":2.3679999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.331},"min":{"1min":0.84099999999999997,"5min":0.74399999999999999,"15min":0.71999999999999997},"max":{"1min":1.6020000000000001,"5min":1.8240000000000001,"15min":2.9590000000000001},"last":1.6319999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.349,"15min":1.323},"min":{"1min":0.96199999999999997,"5min":0.86199999999999999,"15min":0.54900000000000004},"max":{"1min":1.615,"5min":1.9470000000000001,"15min":2.4729999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.363,"15min":1.3420000000000001},"min":{"1min":0.99399999999999999,"5min":0.81499999999999995,"15min":0.67900000000000005},"max":{"1min":1.6890000000000001,"5min":1.978,"15min":3.0579999999999998},"last":1.887}]},{"osd":3,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.252,"15min":1.252},"min":{"1min":0.91700000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5800000000000001,"5min":1.9159999999999999,"15min":3.4430000000000001},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3340000000000001},"min":{"1min":0.94599999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7809999999999999,"5min":2.0539999999999998,"15min":2.5289999999999999},"last":1.2130000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3340000000000001,"15min":1.357},"min":{"1min":0.94999999999999996,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.6839999999999999,"5min":1.857,"15min":3.137},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3300000000000001,"15min":1.3640000000000001},"min":{"1min":0.89000000000000001,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.758,"5min":2.403,"15min":3.3620000000000001},"last":1.6899999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3879999999999999,"15min":1.4350000000000001},"min":{"1min":1.0549999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.788,"5min":2.262,"15min":2.5819999999999999},"last":1.373},{"interface":"front","average":{"1min":1.47,"5min":1.5129999999999999,"15min":1.5289999999999999},"min":{"1min":1.1000000000000001,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.732,"5min":2.1909999999999998,"15min":3.3340000000000001},"last":1.7390000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:51:36 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.494,"15min":1.516},"min":{"1min":1.1140000000000001,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.752,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.786},{"interface":"front","average":{"1min":1.609,"5min":1.571,"15min":1.5940000000000001},"min":{"1min":1.419,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.887,"5min":2.4590000000000001,"15min":2.875},"last":1.425}]}]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194291,"statfs":{"total":200000000,"available":198954538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.65800000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.347,"5min":1.458,"15min":4.4109999999999996},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.077,"5min":1.006,"15min":0.96999999999999997},"min":{"1min":0.69299999999999995,"5min":0.39900000000000002,"15min":0.35499999999999998},"max":{"1min":1.5569999999999999,"5min":1.7170000000000001,"15min":3.2269999999999999},"last":1.5049999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.76800000000000002,"5min":0.44400000000000001,"15min":0.38100000000000001},"max":{"1min":1.302,"5min":1.4930000000000001,"15min":2.1280000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1200000000000001,"15min":1.036},"min":{"1min":0.86099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5760000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.1859999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1299999999999999,"15min":1.159},"min":{"1min":0.93400000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.677,"5min":1.9259999999999999,"15min":18.145},"last":1.218},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2450000000000001,"15min":1.224},"min":{"1min":1.0469999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.645,"5min":1.976,"15min":2.169},"last":1.538}]},{"osd":4,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2450000000000001,"15min":1.3009999999999999},"min":{"1min":0.81599999999999995,"5min":0.75,"15min":0.745},"max":{"1min":1.7569999999999999,"5min":1.7709999999999999,"15min":3.5110000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.52,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":1.1619999999999999,"5min":0.66500000000000004,"15min":0.65400000000000003},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.3999999999999999,"15min":1.4510000000000001},"min":{"1min":1.1379999999999999,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":2.25,"5min":2.25,"15min":18.094000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4079999999999999,"15min":1.4159999999999999},"min":{"1min":1.0760000000000001,"5min":0.751,"15min":0.69899999999999995},"max":{"1min":1.9419999999999999,"5min":2.1219999999999999,"15min":14.105},"last":1.431}]},{"osd":6,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.393,"15min":1.373},"min":{"1min":0.96399999999999997,"5min":0.76300000000000001,"15min":0.66200000000000003},"max":{"1min":1.865,"5min":2.1659999999999999,"15min":3.2789999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.4690000000000001,"15min":1.4750000000000001},"min":{"1min":1.264,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":4.0220000000000002},"last":1.474}]},{"osd":7,"last update":"Wed Aug 9 12:50:45 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.5189999999999999,"15min":1.456},"min":{"1min":1.3169999999999999,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":2.109,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5169999999999999,"15min":1.4430000000000001},"min":{"1min":1.0760000000000001,"5min":0.81899999999999995,"15min":0.70799999999999996},"max":{"1min":2.0630000000000002,"5min":2.2629999999999999,"15min":3.016},"last":1.3460000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.68500000000000005,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":1.5449999999999999,"5min":1.673,"15min":1.716},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.306,"5min":1.6970000000000001,"15min":2.9009999999999998},"last":0.93700000000000006}]},{"osd":1,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90600000000000003,"15min":0.92300000000000004},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.099,"15min":1.069},"min":{"1min":0.77400000000000002,"5min":0.48799999999999999,"15min":0.46899999999999997},"max":{"1min":1.4259999999999999,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.88200000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1459999999999999,"15min":1.1559999999999999},"min":{"1min":0.85999999999999999,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.655,"5min":1.794,"15min":3.2850000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.2549999999999999,"15min":1.1990000000000001},"min":{"1min":0.92500000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"max":{"1min":1.7629999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":1.268}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.452,"15min":1.4370000000000001},"min":{"1min":1.135,"5min":0.88800000000000001,"15min":0.81899999999999995},"max":{"1min":1.8049999999999999,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.554},{"interface":"front","average":{"1min":1.383,"5min":1.379,"15min":1.3360000000000001},"min":{"1min":0.93700000000000006,"5min":0.77300000000000002,"15min":0.66800000000000004},"max":{"1min":1.8160000000000001,"5min":1.974,"15min":3.4500000000000002},"last":1.444}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.417,"15min":1.3979999999999999},"min":{"1min":1.012,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.95,"5min":2.0110000000000001,"15min":5.0140000000000002},"last":1.593},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.5309999999999999,"15min":1.4970000000000001},"min":{"1min":1.3420000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8340000000000001,"5min":2.133,"15min":4.806},"last":1.486}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4019999999999999,"15min":1.359},"min":{"1min":1.0700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.976,"5min":1.976,"15min":2.5179999999999998},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.492,"15min":1.4570000000000001},"min":{"1min":1.089,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9079999999999999,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.508}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.456,"15min":1.4139999999999999},"min":{"1min":0.98399999999999999,"5min":0.80300000000000005,"15min":0.76200000000000001},"max":{"1min":1.8919999999999999,"5min":2.1309999999999998,"15min":2.464},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.5569999999999999,"15min":1.5469999999999999},"min":{"1min":1.248,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0150000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.653}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1020,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194292,"statfs":{"total":200000000,"available":198955084,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.47299999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3460000000000001,"5min":1.6859999999999999,"15min":2.621},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0209999999999999,"15min":1.3160000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.4790000000000001,"5min":1.778,"15min":88.254999999999995},"last":0.84199999999999997}]},{"osd":2,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.006,"15min":0.98899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2689999999999999,"15min":1.226},"min":{"1min":0.626,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.3069999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2330000000000001,"15min":1.169},"min":{"1min":0.67300000000000004,"5min":0.436,"15min":0.436},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1100000000000001,"15min":1.071},"min":{"1min":0.66700000000000004,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":0.94499999999999995}]},{"osd":4,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.2649999999999999,"15min":1.3320000000000001},"min":{"1min":0.86099999999999999,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":25.172000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.401,"15min":1.3660000000000001},"min":{"1min":1.081,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.887,"5min":2.085,"15min":3.762},"last":1.45}]},{"osd":5,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.387,"15min":1.45},"min":{"1min":0.80100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.7250000000000001,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.49},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3300000000000001,"15min":1.3200000000000001},"min":{"1min":0.876,"5min":0.81899999999999995,"15min":0.77900000000000003},"max":{"1min":1.8400000000000001,"5min":1.9079999999999999,"15min":3.762},"last":1.3560000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.5309999999999999,"15min":1.4910000000000001},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.4790000000000001,"15min":1.4359999999999999},"min":{"1min":0.91100000000000003,"5min":0.83099999999999996,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.546,"15min":1.627},"min":{"1min":1.117,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.109,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.593,"15min":1.6399999999999999},"min":{"1min":0.92600000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2080000000000002,"5min":2.464,"15min":28.765000000000001},"last":1.6200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193713,"statfs":{"total":200000000,"available":198362468,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.47699999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.204,"5min":1.6259999999999999,"15min":1.819},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.022,"5min":1.0249999999999999,"15min":1.016},"min":{"1min":0.437,"5min":0.437,"15min":0.436},"max":{"1min":1.4990000000000001,"5min":1.661,"15min":6.1749999999999998},"last":1.1060000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.016},"min":{"1min":0.84499999999999997,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.373,"5min":1.6120000000000001,"15min":1.7669999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0609999999999999,"15min":1.0700000000000001},"min":{"1min":0.59499999999999997,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.5289999999999999,"5min":1.5609999999999999,"15min":6.2549999999999999},"last":1.4870000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.016},"min":{"1min":0.63700000000000001,"5min":0.55300000000000005,"15min":0.45300000000000001},"max":{"1min":1.601,"5min":1.665,"15min":9.6069999999999993},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.244,"5min":1.2110000000000001,"15min":1.2030000000000001},"min":{"1min":0.69099999999999995,"5min":0.60599999999999998,"15min":0.56000000000000005},"max":{"1min":1.5620000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.0489999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.3680000000000001,"15min":1.351},"min":{"1min":0.88300000000000001,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.9630000000000001,"5min":2.1019999999999999,"15min":9.9629999999999992},"last":1.724},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4039999999999999,"15min":1.3480000000000001},"min":{"1min":0.99199999999999999,"5min":0.85799999999999998,"15min":0.77900000000000003},"max":{"1min":1.7589999999999999,"5min":1.8560000000000001,"15min":1.879},"last":1.171}]},{"osd":5,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.349,"15min":1.347},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":1.6910000000000001,"5min":1.8200000000000001,"15min":10.004},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.46,"15min":1.421},"min":{"1min":0.92900000000000005,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.798,"5min":2.1419999999999999,"15min":2.161},"last":1.335}]},{"osd":6,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.45,"15min":1.4019999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7729999999999999,"5min":2.1230000000000002,"15min":6.4290000000000003},"last":1.361},{"interface":"front","average":{"1min":1.494,"5min":1.47,"15min":1.4630000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.782,"5min":2.117,"15min":9.9190000000000005},"last":1.5389999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.492},"min":{"1min":1.016,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8839999999999999,"5min":2.2160000000000002,"15min":18.114000000000001},"last":1.26},{"interface":"front","average":{"1min":1.526,"5min":1.5289999999999999,"15min":1.5129999999999999},"min":{"1min":0.84099999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":9.5640000000000001},"last":1.4219999999999999}]}]}],"pool_statfs":[]}} 2023-08-09T12:51:44.007 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:51:44.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:51:44.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.277+0000 7f2d481e3640 1 Processor -- start 2023-08-09T12:51:44.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.277+0000 7f2d481e3640 1 -- start start 2023-08-09T12:51:44.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.279+0000 7f2d481e3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2d4015cd10 0x7f2d400b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.279+0000 7f2d481e3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2d4006fde0 0x7f2d40070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.279+0000 7f2d481e3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d400d18a0 con 0x7f2d400b1e30 2023-08-09T12:51:44.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.279+0000 7f2d481e3640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d40070790 con 0x7f2d4015cd10 2023-08-09T12:51:44.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.279+0000 7f2d481e3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d400d0d00 con 0x7f2d4006fde0 2023-08-09T12:51:44.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.279+0000 7f2d45f7f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2d4015cd10 0x7f2d400b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.279+0000 7f2d45f7f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2d4015cd10 0x7f2d400b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48526/0 (socket says 172.21.15.17:48526) 2023-08-09T12:51:44.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.279+0000 7f2d45f7f640 1 -- 172.21.15.17:0/1116521037 learned_addr learned my addr 172.21.15.17:0/1116521037 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:44.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.280+0000 7f2d45f7f640 1 -- 172.21.15.17:0/1116521037 >> v2:172.21.15.142:3300/0 conn(0x7f2d4006fde0 msgr2=0x7f2d40070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:44.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.280+0000 7f2d45f7f640 1 --2- 172.21.15.17:0/1116521037 >> v2:172.21.15.142:3300/0 conn(0x7f2d4006fde0 0x7f2d40070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.280+0000 7f2d45f7f640 1 -- 172.21.15.17:0/1116521037 >> v1:172.21.15.142:6789/0 conn(0x7f2d400b1e30 legacy=0x7f2d400b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:44.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.280+0000 7f2d45f7f640 1 -- 172.21.15.17:0/1116521037 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400b6140 con 0x7f2d4015cd10 2023-08-09T12:51:44.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.281+0000 7f2d45f7f640 1 --2- 172.21.15.17:0/1116521037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4015cd10 0x7f2d400b5c00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f2d400d1810 tx=0x7f2d3c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd9cfdbb655e5e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:44.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.281+0000 7f2d44f7d640 1 -- 172.21.15.17:0/1116521037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c030860 con 0x7f2d4015cd10 2023-08-09T12:51:44.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.281+0000 7f2d44f7d640 1 -- 172.21.15.17:0/1116521037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0309c0 con 0x7f2d4015cd10 2023-08-09T12:51:44.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.281+0000 7f2d44f7d640 1 -- 172.21.15.17:0/1116521037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c030d50 con 0x7f2d4015cd10 2023-08-09T12:51:44.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.282+0000 7f2d481e3640 1 -- 172.21.15.17:0/1116521037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4015cd10 msgr2=0x7f2d400b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.282+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1116521037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4015cd10 0x7f2d400b5c00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f2d400d1810 tx=0x7f2d3c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.282+0000 7f2d481e3640 1 -- 172.21.15.17:0/1116521037 shutdown_connections 2023-08-09T12:51:44.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.282+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1116521037 >> v2:172.21.15.142:3300/0 conn(0x7f2d4006fde0 0x7f2d40070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.282+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1116521037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4015cd10 0x7f2d400b5c00 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.282+0000 7f2d481e3640 1 -- 172.21.15.17:0/1116521037 >> 172.21.15.17:0/1116521037 conn(0x7f2d400d2b90 msgr2=0x7f2d400d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:44.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.282+0000 7f2d481e3640 1 -- 172.21.15.17:0/1116521037 shutdown_connections 2023-08-09T12:51:44.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.282+0000 7f2d481e3640 1 -- 172.21.15.17:0/1116521037 wait complete. 2023-08-09T12:51:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.284+0000 7f2d481e3640 1 Processor -- start 2023-08-09T12:51:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.284+0000 7f2d481e3640 1 -- start start 2023-08-09T12:51:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d481e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4006fde0 0x7f2d40149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d481e3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d400b1e30 0x7f2d400b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d481e3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d4015cd10 0x7f2d400b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d481e3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400cbcc0 con 0x7f2d4006fde0 2023-08-09T12:51:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d481e3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400cbfa0 con 0x7f2d400b1e30 2023-08-09T12:51:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d481e3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400cc280 con 0x7f2d4015cd10 2023-08-09T12:51:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d45f7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4006fde0 0x7f2d40149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d45f7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4006fde0 0x7f2d40149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48534/0 (socket says 172.21.15.17:48534) 2023-08-09T12:51:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d45f7f640 1 -- 172.21.15.17:0/1359575444 learned_addr learned my addr 172.21.15.17:0/1359575444 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d45f7f640 1 -- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d4015cd10 msgr2=0x7f2d400b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.285+0000 7f2d46780640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d4015cd10 0x7f2d400b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d4577e640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d400b1e30 0x7f2d400b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d45f7f640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d4015cd10 0x7f2d400b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d45f7f640 1 -- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d400b1e30 msgr2=0x7f2d400b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d45f7f640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d400b1e30 0x7f2d400b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d45f7f640 1 -- 172.21.15.17:0/1359575444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0094d0 con 0x7f2d4006fde0 2023-08-09T12:51:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d4577e640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d400b1e30 0x7f2d400b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d45f7f640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4006fde0 0x7f2d40149de0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c000c00 tx=0x7f2d3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d367fc640 1 -- 172.21.15.17:0/1359575444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c039b40 con 0x7f2d4006fde0 2023-08-09T12:51:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d367fc640 1 -- 172.21.15.17:0/1359575444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c039ca0 con 0x7f2d4006fde0 2023-08-09T12:51:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d400cc560 con 0x7f2d4006fde0 2023-08-09T12:51:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.286+0000 7f2d367fc640 1 -- 172.21.15.17:0/1359575444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c043630 con 0x7f2d4006fde0 2023-08-09T12:51:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.287+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4014a320 con 0x7f2d4006fde0 2023-08-09T12:51:44.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.288+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d40067a80 con 0x7f2d4006fde0 2023-08-09T12:51:44.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.289+0000 7f2d367fc640 1 -- 172.21.15.17:0/1359575444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2d3c04c3b0 con 0x7f2d4006fde0 2023-08-09T12:51:44.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.290+0000 7f2d367fc640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2406a050 0x7f2d2406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.290+0000 7f2d367fc640 1 -- 172.21.15.17:0/1359575444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d3c0aab80 con 0x7f2d4006fde0 2023-08-09T12:51:44.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.290+0000 7f2d4577e640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2406a050 0x7f2d2406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.292+0000 7f2d4577e640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2406a050 0x7f2d2406c510 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2d30007fd0 tx=0x7f2d30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:44.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.294+0000 7f2d367fc640 1 -- 172.21.15.17:0/1359575444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2d3c076300 con 0x7f2d4006fde0 2023-08-09T12:51:44.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.554+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2d400c8f60 con 0x7f2d4006fde0 2023-08-09T12:51:44.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.561+0000 7f2d367fc640 1 -- 172.21.15.17:0/1359575444 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2d3c0340b0 con 0x7f2d4006fde0 2023-08-09T12:51:44.565 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:51:44.565 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:51:44.566 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:51:44.566 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:51:44.566 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:51:44.567 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:51:44.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.563+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2406a050 msgr2=0x7f2d2406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.563+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2406a050 0x7f2d2406c510 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2d30007fd0 tx=0x7f2d30009040 comp rx=0 tx=0).stop 2023-08-09T12:51:44.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4006fde0 msgr2=0x7f2d40149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4006fde0 0x7f2d40149de0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c000c00 tx=0x7f2d3c004730 comp rx=0 tx=0).stop 2023-08-09T12:51:44.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 shutdown_connections 2023-08-09T12:51:44.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2d2406a050 0x7f2d2406c510 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d4015cd10 0x7f2d400b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d400b1e30 0x7f2d400b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 --2- 172.21.15.17:0/1359575444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d4006fde0 0x7f2d40149de0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 >> 172.21.15.17:0/1359575444 conn(0x7f2d400d2b90 msgr2=0x7f2d400c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 shutdown_connections 2023-08-09T12:51:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.564+0000 7f2d481e3640 1 -- 172.21.15.17:0/1359575444 wait complete. 2023-08-09T12:51:44.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:51:44.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.796+0000 7f370c55d640 1 Processor -- start 2023-08-09T12:51:44.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.796+0000 7f370c55d640 1 -- start start 2023-08-09T12:51:44.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.797+0000 7f370c55d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3704159d80 0x7f37040b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.797+0000 7f370c55d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3704070a90 0x7f37040c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.797+0000 7f370c55d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37040b4630 con 0x7f37040ad810 2023-08-09T12:51:44.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.797+0000 7f370c55d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370415a160 con 0x7f3704070a90 2023-08-09T12:51:44.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.797+0000 7f370c55d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040b3ab0 con 0x7f3704159d80 2023-08-09T12:51:44.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.798+0000 7f3709af8640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f37040ad810 0x7f3704070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48402/0 (socket says 172.21.15.17:48402) 2023-08-09T12:51:44.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.798+0000 7f3709af8640 1 -- 172.21.15.17:0/3798979460 learned_addr learned my addr 172.21.15.17:0/3798979460 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:44.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.798+0000 7f370a2f9640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3704159d80 0x7f37040b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.798+0000 7f370aafa640 1 --2- 172.21.15.17:0/3798979460 >> v2:172.21.15.142:3300/0 conn(0x7f3704070a90 0x7f37040c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.798+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267980056 0 0) 0x7f37040b4630 con 0x7f37040ad810 2023-08-09T12:51:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f0003520 con 0x7f37040ad810 2023-08-09T12:51:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4273862655 0 0) 0x7f36f0003520 con 0x7f37040ad810 2023-08-09T12:51:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3704159d80 msgr2=0x7f37040b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3704159d80 0x7f37040b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 >> v2:172.21.15.142:3300/0 conn(0x7f3704070a90 msgr2=0x7f37040c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 --2- 172.21.15.17:0/3798979460 >> v2:172.21.15.142:3300/0 conn(0x7f3704070a90 0x7f37040c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37040b3d90 con 0x7f37040ad810 2023-08-09T12:51:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f36f4005090 con 0x7f37040ad810 2023-08-09T12:51:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 >> v1:172.21.15.17:6789/0 conn(0x7f37040ad810 legacy=0x7f3704070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36f0003970 0x7f36f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3704159d80 0x7f36f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f0004d00 0x7f36f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370415a160 con 0x7f36f0004d00 2023-08-09T12:51:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040b3ab0 con 0x7f36f0003970 2023-08-09T12:51:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f000b980 con 0x7f3704159d80 2023-08-09T12:51:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.799+0000 7f370aafa640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f0004d00 0x7f36f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.800+0000 7f370a2f9640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36f0003970 0x7f36f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.800+0000 7f3709af8640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3704159d80 0x7f36f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.800+0000 7f370aafa640 1 -- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3704159d80 msgr2=0x7f36f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.800+0000 7f370aafa640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3704159d80 0x7f36f00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.800+0000 7f370aafa640 1 -- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36f0003970 msgr2=0x7f36f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.800+0000 7f370aafa640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36f0003970 0x7f36f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.800+0000 7f370aafa640 1 -- 172.21.15.17:0/3798979460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0003520 con 0x7f36f0004d00 2023-08-09T12:51:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.801+0000 7f370aafa640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f0004d00 0x7f36f0005180 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009ac0 tx=0x7f36f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdae7d519e95060e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.801+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc02c710 con 0x7f36f0004d00 2023-08-09T12:51:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.801+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc02c870 con 0x7f36f0004d00 2023-08-09T12:51:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.801+0000 7f37092f7640 1 -- 172.21.15.17:0/3798979460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc02cc00 con 0x7f36f0004d00 2023-08-09T12:51:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.802+0000 7f370c55d640 1 -- 172.21.15.17:0/3798979460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f0004d00 msgr2=0x7f36f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.802+0000 7f370c55d640 1 --2- 172.21.15.17:0/3798979460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f0004d00 0x7f36f0005180 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009ac0 tx=0x7f36f00057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.802+0000 7f370aafa640 1 -- 172.21.15.17:0/3798979460 reap_dead start 2023-08-09T12:51:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.802+0000 7f370c55d640 1 -- 172.21.15.17:0/3798979460 shutdown_connections 2023-08-09T12:51:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.802+0000 7f370c55d640 1 -- 172.21.15.17:0/3798979460 >> 172.21.15.17:0/3798979460 conn(0x7f37040cb1b0 msgr2=0x7f37040cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:44.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.802+0000 7f370c55d640 1 -- 172.21.15.17:0/3798979460 shutdown_connections 2023-08-09T12:51:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.802+0000 7f370c55d640 1 -- 172.21.15.17:0/3798979460 wait complete. 2023-08-09T12:51:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.804+0000 7f370c55d640 1 Processor -- start 2023-08-09T12:51:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.804+0000 7f370c55d640 1 -- start start 2023-08-09T12:51:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.805+0000 7f370c55d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36f0004d00 0x7f37041670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.805+0000 7f370c55d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37040b0f10 0x7f37040c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.805+0000 7f370c55d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c21d0 0x7f3704152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.805+0000 7f370c55d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c3d00 con 0x7f37040b0f10 2023-08-09T12:51:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.805+0000 7f370c55d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704167600 con 0x7f37040c21d0 2023-08-09T12:51:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.805+0000 7f370c55d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c26d0 con 0x7f36f0004d00 2023-08-09T12:51:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f3709af8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37040b0f10 0x7f37040c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f3709af8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37040b0f10 0x7f37040c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48548/0 (socket says 172.21.15.17:48548) 2023-08-09T12:51:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f3709af8640 1 -- 172.21.15.17:0/1280707901 learned_addr learned my addr 172.21.15.17:0/1280707901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f370a2f9640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36f0004d00 0x7f37041670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f3709af8640 1 -- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36f0004d00 msgr2=0x7f37041670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f3709af8640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36f0004d00 0x7f37041670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f3709af8640 1 -- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c21d0 msgr2=0x7f3704152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f370aafa640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c21d0 0x7f3704152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f3709af8640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c21d0 0x7f3704152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f3709af8640 1 -- 172.21.15.17:0/1280707901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37040c29b0 con 0x7f37040b0f10 2023-08-09T12:51:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.806+0000 7f370aafa640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c21d0 0x7f3704152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.807+0000 7f3709af8640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37040b0f10 0x7f37040c4070 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f36f400d830 tx=0x7f36f400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.807+0000 7f36faffd640 1 -- 172.21.15.17:0/1280707901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400b6b0 con 0x7f37040b0f10 2023-08-09T12:51:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.807+0000 7f36faffd640 1 -- 172.21.15.17:0/1280707901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400b810 con 0x7f37040b0f10 2023-08-09T12:51:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.807+0000 7f36faffd640 1 -- 172.21.15.17:0/1280707901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400bba0 con 0x7f37040b0f10 2023-08-09T12:51:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.807+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37040c2c90 con 0x7f37040b0f10 2023-08-09T12:51:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.807+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37040c45b0 con 0x7f37040b0f10 2023-08-09T12:51:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.808+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3704067a80 con 0x7f37040b0f10 2023-08-09T12:51:44.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.809+0000 7f36faffd640 1 -- 172.21.15.17:0/1280707901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f36f400bd00 con 0x7f37040b0f10 2023-08-09T12:51:44.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.810+0000 7f36faffd640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36e806a050 0x7f36e806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:44.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.810+0000 7f36faffd640 1 -- 172.21.15.17:0/1280707901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36f4088900 con 0x7f37040b0f10 2023-08-09T12:51:44.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.811+0000 7f370a2f9640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36e806a050 0x7f36e806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:44.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.812+0000 7f370a2f9640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36e806a050 0x7f36e806c510 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3700009fd0 tx=0x7f370000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:44.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:44.814+0000 7f36faffd640 1 -- 172.21.15.17:0/1280707901 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f36f4053f50 con 0x7f37040b0f10 2023-08-09T12:51:45.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.042+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37040cac20 con 0x7f37040b0f10 2023-08-09T12:51:45.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.044+0000 7f36faffd640 1 -- 172.21.15.17:0/1280707901 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4876 (secure 0 0 0) 0x7f36f4057570 con 0x7f37040b0f10 2023-08-09T12:51:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:45.047 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/53885323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":53885323},{"type":"v1","addr":"172.21.15.142:6836","nonce":53885323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1636287832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1636287832},{"type":"v1","addr":"172.21.15.142:6837","nonce":1636287832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/758642293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":758642293},{"type":"v1","addr":"172.21.15.17:6833","nonce":758642293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:51:33.353513+0000","modified":"2023-08-09T12:51:36.903336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9000},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9000":{"gid":9000,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2739343495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2739343495},{"type":"v1","addr":"172.21.15.17:6835","nonce":2739343495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-09T12:51:45.048 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 84 2023-08-09T12:51:45.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36e806a050 msgr2=0x7f36e806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36e806a050 0x7f36e806c510 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3700009fd0 tx=0x7f370000b040 comp rx=0 tx=0).stop 2023-08-09T12:51:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37040b0f10 msgr2=0x7f37040c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37040b0f10 0x7f37040c4070 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f36f400d830 tx=0x7f36f400dcf0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 shutdown_connections 2023-08-09T12:51:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f36e806a050 0x7f36e806c510 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37040c21d0 0x7f3704152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37040b0f10 0x7f37040c4070 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 --2- 172.21.15.17:0/1280707901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36f0004d00 0x7f37041670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 >> 172.21.15.17:0/1280707901 conn(0x7f37040cb1b0 msgr2=0x7f37040cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 shutdown_connections 2023-08-09T12:51:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.047+0000 7f370c55d640 1 -- 172.21.15.17:0/1280707901 wait complete. 2023-08-09T12:51:45.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:51:33.353513+0000', 'modified': '2023-08-09T12:51:36.903336+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9000}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9000': {'gid': 9000, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/2739343495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 2739343495}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2739343495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:51:45.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:51:45.472 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-09T12:51:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.716+0000 7f7ae9c37640 1 Processor -- start 2023-08-09T12:51:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.716+0000 7f7ae9c37640 1 -- start start 2023-08-09T12:51:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.717+0000 7f7ae9c37640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ae4070f00 0x7f7ae415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.717+0000 7f7ae9c37640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7ae415bce0 0x7f7ae40cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.717+0000 7f7ae9c37640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae4071340 con 0x7f7ae41587e0 2023-08-09T12:51:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.717+0000 7f7ae9c37640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40715c0 con 0x7f7ae415bce0 2023-08-09T12:51:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.717+0000 7f7ae9c37640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40718a0 con 0x7f7ae4070f00 2023-08-09T12:51:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.718+0000 7f7ae9436640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7ae415bce0 0x7f7ae40cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.718+0000 7f7ae9436640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7ae415bce0 0x7f7ae40cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48552/0 (socket says 172.21.15.17:48552) 2023-08-09T12:51:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.718+0000 7f7ae9436640 1 -- 172.21.15.17:0/743333360 learned_addr learned my addr 172.21.15.17:0/743333360 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.718+0000 7f7ae9436640 1 -- 172.21.15.17:0/743333360 >> v2:172.21.15.142:3300/0 conn(0x7f7ae4070f00 msgr2=0x7f7ae415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.718+0000 7f7ae9436640 1 --2- 172.21.15.17:0/743333360 >> v2:172.21.15.142:3300/0 conn(0x7f7ae4070f00 0x7f7ae415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.718+0000 7f7ae9436640 1 -- 172.21.15.17:0/743333360 >> v1:172.21.15.142:6789/0 conn(0x7f7ae41587e0 legacy=0x7f7ae40b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.718+0000 7f7ae9436640 1 -- 172.21.15.17:0/743333360 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4071b80 con 0x7f7ae415bce0 2023-08-09T12:51:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.719+0000 7f7ae9436640 1 --2- 172.21.15.17:0/743333360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae415bce0 0x7f7ae40cb070 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f7ae406b8a0 tx=0x7f7adc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c00264aaba5de3e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.720+0000 7f7ae37fe640 1 -- 172.21.15.17:0/743333360 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc02ca80 con 0x7f7ae415bce0 2023-08-09T12:51:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.720+0000 7f7ae37fe640 1 -- 172.21.15.17:0/743333360 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc02cbe0 con 0x7f7ae415bce0 2023-08-09T12:51:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.720+0000 7f7ae37fe640 1 -- 172.21.15.17:0/743333360 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0343f0 con 0x7f7ae415bce0 2023-08-09T12:51:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.720+0000 7f7ae9c37640 1 -- 172.21.15.17:0/743333360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae415bce0 msgr2=0x7f7ae40cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.720+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/743333360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae415bce0 0x7f7ae40cb070 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f7ae406b8a0 tx=0x7f7adc02bee0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.720+0000 7f7ae9c37640 1 -- 172.21.15.17:0/743333360 shutdown_connections 2023-08-09T12:51:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.720+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/743333360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae415bce0 0x7f7ae40cb070 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.720+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/743333360 >> v2:172.21.15.142:3300/0 conn(0x7f7ae4070f00 0x7f7ae415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.721+0000 7f7ae9c37640 1 -- 172.21.15.17:0/743333360 >> 172.21.15.17:0/743333360 conn(0x7f7ae40b1d50 msgr2=0x7f7ae406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.721+0000 7f7ae9c37640 1 -- 172.21.15.17:0/743333360 shutdown_connections 2023-08-09T12:51:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.721+0000 7f7ae9c37640 1 -- 172.21.15.17:0/743333360 wait complete. 2023-08-09T12:51:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.722+0000 7f7ae9c37640 1 Processor -- start 2023-08-09T12:51:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.722+0000 7f7ae9c37640 1 -- start start 2023-08-09T12:51:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.723+0000 7f7ae9c37640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ae4070f00 0x7f7ae415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.723+0000 7f7ae9c37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae41587e0 0x7f7ae415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.723+0000 7f7ae9c37640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ae40ca3d0 0x7f7ae40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.723+0000 7f7ae9c37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40c2a10 con 0x7f7ae41587e0 2023-08-09T12:51:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.723+0000 7f7ae9c37640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40cadc0 con 0x7f7ae4070f00 2023-08-09T12:51:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.723+0000 7f7ae9c37640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae415f510 con 0x7f7ae40ca3d0 2023-08-09T12:51:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae41587e0 0x7f7ae415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae41587e0 0x7f7ae415cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48556/0 (socket says 172.21.15.17:48556) 2023-08-09T12:51:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 -- 172.21.15.17:0/436132487 learned_addr learned my addr 172.21.15.17:0/436132487 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ae4070f00 0x7f7ae415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 -- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ae40ca3d0 msgr2=0x7f7ae40ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ae40ca3d0 0x7f7ae40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 -- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ae4070f00 msgr2=0x7f7ae415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ae4070f00 0x7f7ae415efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 -- 172.21.15.17:0/436132487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc009b30 con 0x7f7ae41587e0 2023-08-09T12:51:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ae4070f00 0x7f7ae415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.724+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae41587e0 0x7f7ae415cfa0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000b410 tx=0x7f7ad000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.725+0000 7f7ae17fa640 1 -- 172.21.15.17:0/436132487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0011830 con 0x7f7ae41587e0 2023-08-09T12:51:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.725+0000 7f7ae17fa640 1 -- 172.21.15.17:0/436132487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad00119b0 con 0x7f7ae41587e0 2023-08-09T12:51:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.725+0000 7f7ae17fa640 1 -- 172.21.15.17:0/436132487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0011d60 con 0x7f7ae41587e0 2023-08-09T12:51:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.725+0000 7f7ae9c37640 1 -- 172.21.15.17:0/436132487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae40c7900 con 0x7f7ae41587e0 2023-08-09T12:51:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.725+0000 7f7ae9c37640 1 -- 172.21.15.17:0/436132487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae40c2350 con 0x7f7ae41587e0 2023-08-09T12:51:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.728+0000 7f7ae17fa640 1 -- 172.21.15.17:0/436132487 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ad001a400 con 0x7f7ae41587e0 2023-08-09T12:51:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.729+0000 7f7ae17fa640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ac806a050 0x7f7ac806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.729+0000 7f7ae17fa640 1 -- 172.21.15.17:0/436132487 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ad0088700 con 0x7f7ae41587e0 2023-08-09T12:51:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.729+0000 7f7aeda0b740 1 Processor -- start 2023-08-09T12:51:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.730+0000 7f7aeda0b740 1 -- start start 2023-08-09T12:51:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.730+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ac806a050 0x7f7ac806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.730+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826061e30 0x561826062210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.730+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561826031db0 0x56182605f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.730+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618260359b0 0x56182605f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.730+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561825fa38f0 con 0x561826031db0 2023-08-09T12:51:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.730+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561825fa0fe0 con 0x561826061e30 2023-08-09T12:51:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.730+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561825f9c8d0 con 0x5618260359b0 2023-08-09T12:51:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561826031db0 0x56182605f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561826031db0 0x56182605f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48570/0 (socket says 172.21.15.17:48570) 2023-08-09T12:51:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 -- 172.21.15.17:0/2119981733 learned_addr learned my addr 172.21.15.17:0/2119981733 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 -- 172.21.15.17:0/2119981733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618260359b0 msgr2=0x56182605f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/2119981733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618260359b0 0x56182605f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 -- 172.21.15.17:0/2119981733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826061e30 msgr2=0x561826062210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/2119981733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826061e30 0x561826062210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 -- 172.21.15.17:0/2119981733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561825f55ac0 con 0x561826031db0 2023-08-09T12:51:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ac806a050 0x7f7ac806c510 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8007fd0 tx=0x7f7ad8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.731+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/2119981733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561826031db0 0x56182605f0a0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7ad005f280 tx=0x7f7ad0058270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf370dc1120eb98 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7ace7fc640 1 -- 172.21.15.17:0/2119981733 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0055e40 con 0x561826031db0 2023-08-09T12:51:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7ace7fc640 1 -- 172.21.15.17:0/2119981733 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0086e90 con 0x561826031db0 2023-08-09T12:51:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7ace7fc640 1 -- 172.21.15.17:0/2119981733 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0053890 con 0x561826031db0 2023-08-09T12:51:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 -- 172.21.15.17:0/2119981733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561826031db0 msgr2=0x56182605f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/2119981733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561826031db0 0x56182605f0a0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7ad005f280 tx=0x7f7ad0058270 comp rx=0 tx=0).stop 2023-08-09T12:51:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 -- 172.21.15.17:0/2119981733 shutdown_connections 2023-08-09T12:51:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/2119981733 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618260359b0 0x56182605f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/2119981733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561826031db0 0x56182605f0a0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/2119981733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826061e30 0x561826062210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 -- 172.21.15.17:0/2119981733 >> 172.21.15.17:0/2119981733 conn(0x5618260340c0 msgr2=0x56182607cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 -- 172.21.15.17:0/2119981733 shutdown_connections 2023-08-09T12:51:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.732+0000 7f7aeda0b740 1 -- 172.21.15.17:0/2119981733 wait complete. 2023-08-09T12:51:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.733+0000 7f7aeda0b740 1 -- start start 2023-08-09T12:51:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.733+0000 7f7aeda0b740 1 Processor -- start 2023-08-09T12:51:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.734+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.734+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826061e30 0x56182607afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.734+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x5618260639d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.734+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561825f3cd40 con 0x5618260359b0 2023-08-09T12:51:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.734+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561825f3c9e0 con 0x56182605a9b0 2023-08-09T12:51:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.734+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561825d02f20 con 0x561826061e30 2023-08-09T12:51:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7aeda0b740 10 client.0 _ll_register_callbacks cb 0x561825f55160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:51:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae8c35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae8c35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48578/0 (socket says 172.21.15.17:48578) 2023-08-09T12:51:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae8c35640 1 -- 172.21.15.17:0/165291980 learned_addr learned my addr 172.21.15.17:0/165291980 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826061e30 0x56182607afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae8c35640 1 -- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826061e30 msgr2=0x56182607afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826061e30 0x56182607afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae9436640 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x5618260639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae8c35640 1 -- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 msgr2=0x5618260639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x5618260639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae8c35640 1 -- 172.21.15.17:0/165291980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae40c2350 con 0x5618260359b0 2023-08-09T12:51:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.735+0000 7f7ae9436640 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x5618260639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607aa90 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800dd60 tx=0x7f7ad80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b74be5b8d2a338a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7ac37fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:51:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7ac37fe640 1 -- 172.21.15.17:0/165291980 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8014630 con 0x5618260359b0 2023-08-09T12:51:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7ac37fe640 1 -- 172.21.15.17:0/165291980 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ad8022c30 con 0x5618260359b0 2023-08-09T12:51:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7aeda0b740 1 -- 172.21.15.17:0/165291980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561825f74500 con 0x5618260359b0 2023-08-09T12:51:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7ac37fe640 1 -- 172.21.15.17:0/165291980 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ad8022df0 con 0x5618260359b0 2023-08-09T12:51:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7aeda0b740 10 client.9171 fetch_fsmap learned FSMap version 84 2023-08-09T12:51:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7aeda0b740 1 -- 172.21.15.17:0/165291980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x561825f9af50 con 0x5618260359b0 2023-08-09T12:51:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7ac37fe640 1 -- 172.21.15.17:0/165291980 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561825f74500 con 0x5618260359b0 2023-08-09T12:51:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7ac37fe640 1 -- 172.21.15.17:0/165291980 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7ad8014790 con 0x5618260359b0 2023-08-09T12:51:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.736+0000 7f7aeda0b740 10 client.9171 fetch_fsmap finished waiting for FSMap version 84 2023-08-09T12:51:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.737+0000 7f7aeda0b740 10 client.9171 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:51:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.737+0000 7f7aeda0b740 20 client.9171 populate_metadata read hostname 'smithi017' 2023-08-09T12:51:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.737+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] conn(0x561826090600 0x5618260909e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.737+0000 7f7aeda0b740 4 client.9171 mds_command: new command op to 9000 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:51:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.737+0000 7f7aeda0b740 1 -- 172.21.15.17:0/165291980 --> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561825f71bc0 con 0x561826090600 2023-08-09T12:51:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.737+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] conn(0x561826090600 0x5618260909e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.737+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] conn(0x561826090600 0x5618260909e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b90966c74c55eca server_cookie=db255fbb78ce0ffa in_seq=0 out_seq=0 2023-08-09T12:51:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.737+0000 7f7ac37fe640 10 client.9171 ms_handle_connect on v2:172.21.15.17:6834/2739343495 2023-08-09T12:51:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.738+0000 7f7ac37fe640 1 -- 172.21.15.17:0/165291980 <== mds.0 v2:172.21.15.17:6834/2739343495 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561825f71bc0 con 0x561826090600 2023-08-09T12:51:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.738+0000 7f7ac37fe640 10 client.9171 handle_command_reply: tid=0 2023-08-09T12:51:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.738+0000 7f7aeda0b740 1 client.9171 shutdown 2023-08-09T12:51:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.738+0000 7f7aeda0b740 1 -- 172.21.15.17:0/165291980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 msgr2=0x56182607aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.738+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607aa90 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800dd60 tx=0x7f7ad80039c0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 1 -- 172.21.15.17:0/165291980 shutdown_connections 2023-08-09T12:51:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] conn(0x561826090600 0x5618260909e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x5618260639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826061e30 0x56182607afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/165291980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607aa90 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7ac37fe640 0 client.9171 ms_handle_reset on v2:172.21.15.17:6834/2739343495 2023-08-09T12:51:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 1 -- 172.21.15.17:0/165291980 >> 172.21.15.17:0/165291980 conn(0x561826031db0 msgr2=0x5618260659b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 1 -- 172.21.15.17:0/165291980 shutdown_connections 2023-08-09T12:51:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 1 -- 172.21.15.17:0/165291980 wait complete. 2023-08-09T12:51:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.739+0000 7f7aeda0b740 20 client.9171 trim_cache size 0 max 16384 2023-08-09T12:51:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.755+0000 7f7aeda0b740 1 Processor -- start 2023-08-09T12:51:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.755+0000 7f7aeda0b740 1 -- start start 2023-08-09T12:51:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826031db0 0x561826080340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x56182607ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561826031c70 con 0x5618260359b0 2023-08-09T12:51:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56182605c660 con 0x56182605a9b0 2023-08-09T12:51:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561826038990 con 0x561826031db0 2023-08-09T12:51:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48594/0 (socket says 172.21.15.17:48594) 2023-08-09T12:51:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.756+0000 7f7ae3fff640 1 -- 172.21.15.17:0/1623674570 learned_addr learned my addr 172.21.15.17:0/1623674570 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:45.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae3fff640 1 -- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826031db0 msgr2=0x561826080340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826031db0 0x561826080340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae9436640 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x56182607ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826031db0 0x561826080340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae3fff640 1 -- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 msgr2=0x56182607ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x56182607ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae3fff640 1 -- 172.21.15.17:0/1623674570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561825fce300 con 0x5618260359b0 2023-08-09T12:51:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae9436640 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x56182607ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607a840 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f7ad005f280 tx=0x7f7ad0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a571ed6322ef19 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.757+0000 7f7aceffd640 1 -- 172.21.15.17:0/1623674570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0055c60 con 0x5618260359b0 2023-08-09T12:51:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aceffd640 1 -- 172.21.15.17:0/1623674570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0086e90 con 0x5618260359b0 2023-08-09T12:51:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aceffd640 1 -- 172.21.15.17:0/1623674570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0053890 con 0x5618260359b0 2023-08-09T12:51:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 -- 172.21.15.17:0/1623674570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 msgr2=0x56182607a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607a840 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f7ad005f280 tx=0x7f7ad0015000 comp rx=0 tx=0).stop 2023-08-09T12:51:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 -- 172.21.15.17:0/1623674570 shutdown_connections 2023-08-09T12:51:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56182605a9b0 0x56182607ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x56182607a840 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/1623674570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826031db0 0x561826080340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 -- 172.21.15.17:0/1623674570 >> 172.21.15.17:0/1623674570 conn(0x56182602d9c0 msgr2=0x56182605eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 -- 172.21.15.17:0/1623674570 shutdown_connections 2023-08-09T12:51:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.758+0000 7f7aeda0b740 1 -- 172.21.15.17:0/1623674570 wait complete. 2023-08-09T12:51:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.759+0000 7f7aeda0b740 1 -- start start 2023-08-09T12:51:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.759+0000 7f7aeda0b740 1 Processor -- start 2023-08-09T12:51:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.760+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826031db0 0x5618260eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.760+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x561826035e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.760+0000 7f7aeda0b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56182605a9b0 0x5618260363c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.760+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56182607bfc0 con 0x5618260359b0 2023-08-09T12:51:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.760+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618260ef9f0 con 0x561826031db0 2023-08-09T12:51:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.760+0000 7f7aeda0b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56182607af70 con 0x56182605a9b0 2023-08-09T12:51:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.760+0000 7f7aeda0b740 10 client.0 _ll_register_callbacks cb 0x7f7ad8001dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:51:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x561826035e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x561826035e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48606/0 (socket says 172.21.15.17:48606) 2023-08-09T12:51:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 -- 172.21.15.17:0/200835663 learned_addr learned my addr 172.21.15.17:0/200835663 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae9436640 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56182605a9b0 0x5618260363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826031db0 0x5618260eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 -- 172.21.15.17:0/200835663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56182605a9b0 msgr2=0x5618260363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56182605a9b0 0x5618260363c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 -- 172.21.15.17:0/200835663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826031db0 msgr2=0x5618260eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826031db0 0x5618260eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 -- 172.21.15.17:0/200835663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561825f55ac0 con 0x5618260359b0 2023-08-09T12:51:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ae3fff640 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x561826035e80 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0057a30 tx=0x7f7ad0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60ccd07aca3732 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ac37fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:51:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ac37fe640 1 -- 172.21.15.17:0/200835663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad00541b0 con 0x5618260359b0 2023-08-09T12:51:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7ac37fe640 1 -- 172.21.15.17:0/200835663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ad0054310 con 0x5618260359b0 2023-08-09T12:51:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.761+0000 7f7aeda0b740 1 -- 172.21.15.17:0/200835663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561825fc4800 con 0x5618260359b0 2023-08-09T12:51:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7ac37fe640 1 -- 172.21.15.17:0/200835663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ad0053890 con 0x5618260359b0 2023-08-09T12:51:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7aeda0b740 10 client.9177 fetch_fsmap learned FSMap version 84 2023-08-09T12:51:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7aeda0b740 1 -- 172.21.15.17:0/200835663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x561825f3ba10 con 0x5618260359b0 2023-08-09T12:51:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7ac37fe640 1 -- 172.21.15.17:0/200835663 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561825fc4800 con 0x5618260359b0 2023-08-09T12:51:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7ac37fe640 1 -- 172.21.15.17:0/200835663 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7ad00539f0 con 0x5618260359b0 2023-08-09T12:51:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7aeda0b740 10 client.9177 fetch_fsmap finished waiting for FSMap version 84 2023-08-09T12:51:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7aeda0b740 10 client.9177 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-09T12:51:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7aeda0b740 20 client.9177 populate_metadata read hostname 'smithi017' 2023-08-09T12:51:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] conn(0x561826061e30 0x5618260ee720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7aeda0b740 4 client.9177 mds_command: new command op to 9000 tid=0[{"prefix": "status"}] 2023-08-09T12:51:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7aeda0b740 1 -- 172.21.15.17:0/200835663 --> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561825f958b0 con 0x561826061e30 2023-08-09T12:51:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.762+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] conn(0x561826061e30 0x5618260ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7ae8c35640 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] conn(0x561826061e30 0x5618260ee720 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8525de845dd23246 server_cookie=eb06b4955e5c76ee in_seq=0 out_seq=0 2023-08-09T12:51:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7ac37fe640 10 client.9177 ms_handle_connect on v2:172.21.15.17:6834/2739343495 2023-08-09T12:51:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7ac37fe640 1 -- 172.21.15.17:0/200835663 <== mds.0 v2:172.21.15.17:6834/2739343495 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561825f958b0 con 0x561826061e30 2023-08-09T12:51:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7ac37fe640 10 client.9177 handle_command_reply: tid=0 2023-08-09T12:51:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7aeda0b740 1 client.9177 shutdown 2023-08-09T12:51:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7aeda0b740 1 -- 172.21.15.17:0/200835663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 msgr2=0x561826035e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x561826035e80 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0057a30 tx=0x7f7ad0004730 comp rx=0 tx=0).stop 2023-08-09T12:51:45.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7aeda0b740 1 -- 172.21.15.17:0/200835663 shutdown_connections 2023-08-09T12:51:45.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.17:6834/2739343495,v1:172.21.15.17:6835/2739343495] conn(0x561826061e30 0x5618260ee720 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56182605a9b0 0x5618260363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618260359b0 0x561826035e80 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.763+0000 7f7aeda0b740 1 --2- 172.21.15.17:0/200835663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826031db0 0x5618260eddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ac37fe640 0 client.9177 ms_handle_reset on v2:172.21.15.17:6834/2739343495 2023-08-09T12:51:45.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7aeda0b740 1 -- 172.21.15.17:0/200835663 >> 172.21.15.17:0/200835663 conn(0x56182602d9c0 msgr2=0x561826059790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:45.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7aeda0b740 1 -- 172.21.15.17:0/200835663 shutdown_connections 2023-08-09T12:51:45.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7aeda0b740 1 -- 172.21.15.17:0/200835663 wait complete. 2023-08-09T12:51:45.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7aeda0b740 20 client.9177 trim_cache size 0 max 16384 2023-08-09T12:51:45.779 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:51:45.779 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:51:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:51:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 9000, 2023-08-09T12:51:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:51:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:51:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:51:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 11.902310589000001, 2023-08-09T12:51:45.781 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 84, 2023-08-09T12:51:45.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 175, 2023-08-09T12:51:45.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 175, 2023-08-09T12:51:45.781 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 17.817142935 2023-08-09T12:51:45.781 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:51:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 -- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ac806a050 msgr2=0x7f7ac806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ac806a050 0x7f7ac806c510 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8007fd0 tx=0x7f7ad8009040 comp rx=0 tx=0).stop 2023-08-09T12:51:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 -- 172.21.15.17:0/436132487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae41587e0 msgr2=0x7f7ae415cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae41587e0 0x7f7ae415cfa0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000b410 tx=0x7f7ad000b8d0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 -- 172.21.15.17:0/436132487 shutdown_connections 2023-08-09T12:51:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ac806a050 0x7f7ac806c510 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ae40ca3d0 0x7f7ae40ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae41587e0 0x7f7ae415cfa0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 --2- 172.21.15.17:0/436132487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ae4070f00 0x7f7ae415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.764+0000 7f7ae9c37640 1 -- 172.21.15.17:0/436132487 >> 172.21.15.17:0/436132487 conn(0x7f7ae40b1d50 msgr2=0x7f7ae40cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.765+0000 7f7ae9c37640 1 -- 172.21.15.17:0/436132487 shutdown_connections 2023-08-09T12:51:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.765+0000 7f7ae9c37640 1 -- 172.21.15.17:0/436132487 wait complete. 2023-08-09T12:51:45.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:51:45.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.991+0000 7efdcc3d6640 1 Processor -- start 2023-08-09T12:51:45.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.991+0000 7efdcc3d6640 1 -- start start 2023-08-09T12:51:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.993+0000 7efdcc3d6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efdc415ce90 0x7efdc41616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.993+0000 7efdcc3d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc40d29d0 0x7efdc40d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.993+0000 7efdcc3d6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc40b6460 con 0x7efdc40b6000 2023-08-09T12:51:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.993+0000 7efdcc3d6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc40d33a0 con 0x7efdc415ce90 2023-08-09T12:51:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.993+0000 7efdcc3d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40cdd10 con 0x7efdc40d29d0 2023-08-09T12:51:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.994+0000 7efdc9971640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7efdc40b6000 0x7efdc40cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48418/0 (socket says 172.21.15.17:48418) 2023-08-09T12:51:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.994+0000 7efdc9971640 1 -- 172.21.15.17:0/1919718627 learned_addr learned my addr 172.21.15.17:0/1919718627 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:45.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.994+0000 7efdca172640 1 --2- 172.21.15.17:0/1919718627 >> v2:172.21.15.142:3300/0 conn(0x7efdc415ce90 0x7efdc41616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:45.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.994+0000 7efdca973640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc40d29d0 0x7efdc40d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.994+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630437606 0 0) 0x7efdc40b6460 con 0x7efdc40b6000 2023-08-09T12:51:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.994+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb0003520 con 0x7efdc40b6000 2023-08-09T12:51:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736982500 0 0) 0x7efdb0003520 con 0x7efdc40b6000 2023-08-09T12:51:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc40d29d0 msgr2=0x7efdc40d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc40d29d0 0x7efdc40d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 >> v2:172.21.15.142:3300/0 conn(0x7efdc415ce90 msgr2=0x7efdc41616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:46.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 --2- 172.21.15.17:0/1919718627 >> v2:172.21.15.142:3300/0 conn(0x7efdc415ce90 0x7efdc41616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40cdff0 con 0x7efdc40b6000 2023-08-09T12:51:46.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7efdb4001670 con 0x7efdc40b6000 2023-08-09T12:51:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 >> v1:172.21.15.17:6789/0 conn(0x7efdc40b6000 legacy=0x7efdc40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb0003970 0x7efdb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb00047c0 0x7efdb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0005180 0x7efdb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40d33a0 con 0x7efdb0005180 2023-08-09T12:51:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40cdd10 con 0x7efdb0003970 2023-08-09T12:51:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb000bf40 con 0x7efdb00047c0 2023-08-09T12:51:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdca973640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc40d29d0 0x7efdc40d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdca973640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0005180 0x7efdb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.995+0000 7efdca172640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb0003970 0x7efdb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.996+0000 7efdc9971640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb00047c0 0x7efdb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.996+0000 7efdca973640 1 -- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb00047c0 msgr2=0x7efdb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.996+0000 7efdca973640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb00047c0 0x7efdb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.996+0000 7efdca973640 1 -- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb0003970 msgr2=0x7efdb0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:46.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.996+0000 7efdca973640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb0003970 0x7efdb0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.996+0000 7efdca973640 1 -- 172.21.15.17:0/1919718627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0003520 con 0x7efdb0005180 2023-08-09T12:51:46.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.996+0000 7efdca172640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb0003970 0x7efdb0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:46.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.996+0000 7efdc9971640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb00047c0 0x7efdb0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:46.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.997+0000 7efdca973640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0005180 0x7efdb000b980 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7efdc40d2db0 tx=0x7efdb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ecfb0892fa273 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:46.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.997+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc02cc80 con 0x7efdb0005180 2023-08-09T12:51:46.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.997+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc02cde0 con 0x7efdb0005180 2023-08-09T12:51:46.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.997+0000 7efdc9170640 1 -- 172.21.15.17:0/1919718627 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc003bb0 con 0x7efdb0005180 2023-08-09T12:51:46.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.998+0000 7efdcc3d6640 1 -- 172.21.15.17:0/1919718627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0005180 msgr2=0x7efdb000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:46.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.998+0000 7efdcc3d6640 1 --2- 172.21.15.17:0/1919718627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0005180 0x7efdb000b980 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7efdc40d2db0 tx=0x7efdb00057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.998+0000 7efdca973640 1 -- 172.21.15.17:0/1919718627 reap_dead start 2023-08-09T12:51:46.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.998+0000 7efdcc3d6640 1 -- 172.21.15.17:0/1919718627 shutdown_connections 2023-08-09T12:51:46.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.998+0000 7efdcc3d6640 1 -- 172.21.15.17:0/1919718627 >> 172.21.15.17:0/1919718627 conn(0x7efdc406fde0 msgr2=0x7efdc40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:46.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.998+0000 7efdcc3d6640 1 -- 172.21.15.17:0/1919718627 shutdown_connections 2023-08-09T12:51:46.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:45.998+0000 7efdcc3d6640 1 -- 172.21.15.17:0/1919718627 wait complete. 2023-08-09T12:51:46.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.000+0000 7efdcc3d6640 1 Processor -- start 2023-08-09T12:51:46.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.000+0000 7efdcc3d6640 1 -- start start 2023-08-09T12:51:46.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdcc3d6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc41530b0 0x7efdc41e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdcc3d6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc41e9040 0x7efdc40b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdcc3d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc40b8250 0x7efdc415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdcc3d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40b86e0 con 0x7efdc40b8250 2023-08-09T12:51:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdcc3d6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc41e79a0 con 0x7efdc41530b0 2023-08-09T12:51:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdcc3d6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc415e550 con 0x7efdc41e9040 2023-08-09T12:51:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdca973640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc40b8250 0x7efdc415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdca973640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc40b8250 0x7efdc415d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48622/0 (socket says 172.21.15.17:48622) 2023-08-09T12:51:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.001+0000 7efdca973640 1 -- 172.21.15.17:0/2505965606 learned_addr learned my addr 172.21.15.17:0/2505965606 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdca172640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc41530b0 0x7efdc41e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdc9971640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc41e9040 0x7efdc40b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdca973640 1 -- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc41e9040 msgr2=0x7efdc40b7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdca973640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc41e9040 0x7efdc40b7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdca973640 1 -- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc41530b0 msgr2=0x7efdc41e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdca973640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc41530b0 0x7efdc41e6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdca973640 1 -- 172.21.15.17:0/2505965606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc41e73e0 con 0x7efdc40b8250 2023-08-09T12:51:46.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdca172640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc41530b0 0x7efdc41e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:51:46.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.002+0000 7efdca973640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc40b8250 0x7efdc415d270 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7efdbc007330 tx=0x7efdbc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:46.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.003+0000 7efdbaffd640 1 -- 172.21.15.17:0/2505965606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc03c070 con 0x7efdc40b8250 2023-08-09T12:51:46.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.003+0000 7efdbaffd640 1 -- 172.21.15.17:0/2505965606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc004320 con 0x7efdc40b8250 2023-08-09T12:51:46.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.003+0000 7efdbaffd640 1 -- 172.21.15.17:0/2505965606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc009490 con 0x7efdc40b8250 2023-08-09T12:51:46.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.003+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc41e76c0 con 0x7efdc40b8250 2023-08-09T12:51:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.003+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc415ea80 con 0x7efdc40b8250 2023-08-09T12:51:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.004+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc4067400 con 0x7efdc40b8250 2023-08-09T12:51:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.005+0000 7efdbaffd640 1 -- 172.21.15.17:0/2505965606 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efdbc004690 con 0x7efdc40b8250 2023-08-09T12:51:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.006+0000 7efdbaffd640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efda806a050 0x7efda806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.006+0000 7efdbaffd640 1 -- 172.21.15.17:0/2505965606 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efdbc0a9590 con 0x7efdc40b8250 2023-08-09T12:51:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.006+0000 7efdca172640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efda806a050 0x7efda806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.007+0000 7efdca172640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efda806a050 0x7efda806c510 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009b50 tx=0x7efdc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.010+0000 7efdbaffd640 1 -- 172.21.15.17:0/2505965606 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efdbc074c70 con 0x7efdc40b8250 2023-08-09T12:51:46.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.242+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efdc4067a80 con 0x7efdc40b8250 2023-08-09T12:51:46.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.242+0000 7efdbaffd640 1 -- 172.21.15.17:0/2505965606 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7efdbc078290 con 0x7efdc40b8250 2023-08-09T12:51:46.246 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:51:46.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efda806a050 msgr2=0x7efda806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:46.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efda806a050 0x7efda806c510 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009b50 tx=0x7efdc0008040 comp rx=0 tx=0).stop 2023-08-09T12:51:46.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc40b8250 msgr2=0x7efdc415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:46.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc40b8250 0x7efdc415d270 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7efdbc007330 tx=0x7efdbc004ab0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 shutdown_connections 2023-08-09T12:51:46.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efda806a050 0x7efda806c510 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc40b8250 0x7efdc415d270 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc41e9040 0x7efdc40b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 --2- 172.21.15.17:0/2505965606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc41530b0 0x7efdc41e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:46.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 >> 172.21.15.17:0/2505965606 conn(0x7efdc406fde0 msgr2=0x7efdc40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:46.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 shutdown_connections 2023-08-09T12:51:46.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:46.245+0000 7efdcc3d6640 1 -- 172.21.15.17:0/2505965606 wait complete. 2023-08-09T12:51:46.266 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:51:46.267 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:51:46.267 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:51:46.267 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:51:46.268 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:51:46.268 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:51:46.268 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:51:46.268 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:51:46.269 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:51:46.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:46.269 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:51:46.321 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:51:46.321 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:51:46.321 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:51:46.321 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:46.321 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:51:46.322 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:46.322 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:51:46.322 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:46.322 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:51:46.323 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:51:46.323 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:46.323 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:51:46.323 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:51:46.323 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:46.323 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:51:46.323 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:51:46.324 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41474sec preferred_lft 41474sec 2023-08-09T12:51:46.324 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:51:46.324 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:46.324 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:51:46.324 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:46.324 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:51:46.324 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:51:46.324 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:46.325 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:51:46.325 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:46.325 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:51:46.325 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:46.325 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:51:46.325 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:51:46.325 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:51:46.326 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:46.326 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:51:46.326 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:51:46.326 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:51:46.326 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:46.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:46.328 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:51:46.426 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:51:46.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:46.432 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:51:46.491 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:51:46.491 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:51:46.491 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:51:46.491 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:51:46.492 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:51:46.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:46.492 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:51:46.493 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:51:46.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:51:46.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:51:46.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:51:46.494 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:51:46.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:46.695 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:51:46.751 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:51:46.752 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:51:46.753 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:51:46.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:46.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:51:46.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:51:46.862 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:51:46.925 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:51:46.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:51:46.926 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:51:46.986 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:51:46.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:46.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:51:47.142 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:51:47.142 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:51:47.143 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:51:47.166 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:51:47.166 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:51:47.167 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:51:47.167 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:51:47.167 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:51:47.191 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:51:47.191 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:51:47.191 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:51:47.192 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:51:47.192 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:51:47.192 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:51:47.192 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:51:47.192 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:51:47.193 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:51:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:51:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:51:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:51:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:51:47.198 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:51:47.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:47.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:51:47.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:47.294 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:51:47.365 INFO:teuthology.orchestra.run.smithi017.stdout:client6877 2023-08-09T12:51:47.365 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:51:47.366 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:47.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:51:47.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.648+0000 7efcb9bd6640 1 Processor -- start 2023-08-09T12:51:47.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.649+0000 7efcb9bd6640 1 -- start start 2023-08-09T12:51:47.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.650+0000 7efcb9bd6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcb4159250 0x7efcb40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.650+0000 7efcb9bd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb4070230 0x7efcb415b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.650+0000 7efcb9bd6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb4070650 con 0x7efcb40cd400 2023-08-09T12:51:47.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.650+0000 7efcb9bd6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40cd890 con 0x7efcb4159250 2023-08-09T12:51:47.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.650+0000 7efcb9bd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4070890 con 0x7efcb4070230 2023-08-09T12:51:47.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.651+0000 7efcaaffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7efcb40cd400 0x7efcb406fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48430/0 (socket says 172.21.15.17:48430) 2023-08-09T12:51:47.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.651+0000 7efcaaffd640 1 -- 172.21.15.17:0/2976113335 learned_addr learned my addr 172.21.15.17:0/2976113335 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:47.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.651+0000 7efcb37fe640 1 --2- 172.21.15.17:0/2976113335 >> v2:172.21.15.142:3300/0 conn(0x7efcb4159250 0x7efcb40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.651+0000 7efcb3fff640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb4070230 0x7efcb415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.651+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727361011 0 0) 0x7efc9c001610 con 0x7efcb40cd400 2023-08-09T12:51:47.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.651+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efca0003520 con 0x7efcb40cd400 2023-08-09T12:51:47.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797497108 0 0) 0x7efca0003520 con 0x7efcb40cd400 2023-08-09T12:51:47.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb4070230 msgr2=0x7efcb415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:47.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb4070230 0x7efcb415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 >> v2:172.21.15.142:3300/0 conn(0x7efcb4159250 msgr2=0x7efcb40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:47.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 --2- 172.21.15.17:0/2976113335 >> v2:172.21.15.142:3300/0 conn(0x7efcb4159250 0x7efcb40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb415a940 con 0x7efcb40cd400 2023-08-09T12:51:47.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7efc9c001d00 con 0x7efcb40cd400 2023-08-09T12:51:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 >> v1:172.21.15.17:6789/0 conn(0x7efcb40cd400 legacy=0x7efcb406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb4070230 0x7efca0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca0003ef0 0x7efca00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca0004d00 0x7efca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40cd890 con 0x7efca0004d00 2023-08-09T12:51:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4070890 con 0x7efca0003ef0 2023-08-09T12:51:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca000b980 con 0x7efcb4070230 2023-08-09T12:51:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.652+0000 7efcb3fff640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca0004d00 0x7efca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.653+0000 7efcb37fe640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb4070230 0x7efca0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.653+0000 7efcaaffd640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca0003ef0 0x7efca00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.653+0000 7efcb3fff640 1 -- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb4070230 msgr2=0x7efca0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.653+0000 7efcb3fff640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb4070230 0x7efca0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.653+0000 7efcb3fff640 1 -- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca0003ef0 msgr2=0x7efca00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.653+0000 7efcb3fff640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca0003ef0 0x7efca00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.653+0000 7efcb3fff640 1 -- 172.21.15.17:0/2976113335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca0003520 con 0x7efca0004d00 2023-08-09T12:51:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.654+0000 7efcb3fff640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca0004d00 0x7efca0005180 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7efcac009ac0 tx=0x7efca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d3c89e8ee36e22 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.654+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac02c6b0 con 0x7efca0004d00 2023-08-09T12:51:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.654+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac02c810 con 0x7efca0004d00 2023-08-09T12:51:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.654+0000 7efcb2ffd640 1 -- 172.21.15.17:0/2976113335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac02cba0 con 0x7efca0004d00 2023-08-09T12:51:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.655+0000 7efcb9bd6640 1 -- 172.21.15.17:0/2976113335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca0004d00 msgr2=0x7efca0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.655+0000 7efcb9bd6640 1 --2- 172.21.15.17:0/2976113335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca0004d00 0x7efca0005180 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7efcac009ac0 tx=0x7efca00057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.655+0000 7efcb3fff640 1 -- 172.21.15.17:0/2976113335 reap_dead start 2023-08-09T12:51:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.655+0000 7efcb9bd6640 1 -- 172.21.15.17:0/2976113335 shutdown_connections 2023-08-09T12:51:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.655+0000 7efcb9bd6640 1 -- 172.21.15.17:0/2976113335 >> 172.21.15.17:0/2976113335 conn(0x7efcb40cb1b0 msgr2=0x7efcb40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.655+0000 7efcb9bd6640 1 -- 172.21.15.17:0/2976113335 shutdown_connections 2023-08-09T12:51:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.655+0000 7efcb9bd6640 1 -- 172.21.15.17:0/2976113335 wait complete. 2023-08-09T12:51:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.657+0000 7efcb9bd6640 1 Processor -- start 2023-08-09T12:51:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.657+0000 7efcb9bd6640 1 -- start start 2023-08-09T12:51:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.658+0000 7efcb9bd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efca0004d00 0x7efcb4167190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.658+0000 7efcb9bd6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c43f0 0x7efcb414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.658+0000 7efcb9bd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcb40c1dd0 0x7efcb40c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.658+0000 7efcb9bd6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb406a1d0 con 0x7efcb40c1dd0 2023-08-09T12:51:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.658+0000 7efcb9bd6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb406a4b0 con 0x7efcb40c43f0 2023-08-09T12:51:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.658+0000 7efcb9bd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb406a790 con 0x7efca0004d00 2023-08-09T12:51:47.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcb40c1dd0 0x7efcb40c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcb40c1dd0 0x7efcb40c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48640/0 (socket says 172.21.15.17:48640) 2023-08-09T12:51:47.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 -- 172.21.15.17:0/198368663 learned_addr learned my addr 172.21.15.17:0/198368663 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:47.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb37fe640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efca0004d00 0x7efcb4167190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcaaffd640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c43f0 0x7efcb414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 -- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efca0004d00 msgr2=0x7efcb4167190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:47.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efca0004d00 0x7efcb4167190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 -- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c43f0 msgr2=0x7efcb414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:47.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c43f0 0x7efcb414ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 -- 172.21.15.17:0/198368663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb406aa70 con 0x7efcb40c1dd0 2023-08-09T12:51:47.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.659+0000 7efcb3fff640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcb40c1dd0 0x7efcb40c2250 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7efcac037040 tx=0x7efcac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:47.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.660+0000 7efcb0ff9640 1 -- 172.21.15.17:0/198368663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac003810 con 0x7efcb40c1dd0 2023-08-09T12:51:47.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.660+0000 7efcb0ff9640 1 -- 172.21.15.17:0/198368663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac003970 con 0x7efcb40c1dd0 2023-08-09T12:51:47.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.660+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb406ad50 con 0x7efcb40c1dd0 2023-08-09T12:51:47.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.660+0000 7efcb0ff9640 1 -- 172.21.15.17:0/198368663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac003ce0 con 0x7efcb40c1dd0 2023-08-09T12:51:47.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.660+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb41678b0 con 0x7efcb40c1dd0 2023-08-09T12:51:47.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.661+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb4067a80 con 0x7efcb40c1dd0 2023-08-09T12:51:47.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.662+0000 7efcb0ff9640 1 -- 172.21.15.17:0/198368663 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efcac03e440 con 0x7efcb40c1dd0 2023-08-09T12:51:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.663+0000 7efcb0ff9640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efc9406a080 0x7efc9406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.663+0000 7efcb0ff9640 1 -- 172.21.15.17:0/198368663 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcac0a9990 con 0x7efcb40c1dd0 2023-08-09T12:51:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.664+0000 7efcb37fe640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efc9406a080 0x7efc9406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.665+0000 7efcb37fe640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efc9406a080 0x7efc9406c540 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efca4009a90 tx=0x7efca4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:47.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.668+0000 7efcb0ff9640 1 -- 172.21.15.17:0/198368663 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7efcac078b00 con 0x7efcb40c1dd0 2023-08-09T12:51:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.896+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efcb406a8d0 con 0x7efcb40c1dd0 2023-08-09T12:51:47.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.897+0000 7efcb0ff9640 1 -- 172.21.15.17:0/198368663 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7efcb406a8d0 con 0x7efcb40c1dd0 2023-08-09T12:51:47.901 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:51:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efc9406a080 msgr2=0x7efc9406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efc9406a080 0x7efc9406c540 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efca4009a90 tx=0x7efca4008040 comp rx=0 tx=0).stop 2023-08-09T12:51:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcb40c1dd0 msgr2=0x7efcb40c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcb40c1dd0 0x7efcb40c2250 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7efcac037040 tx=0x7efcac004730 comp rx=0 tx=0).stop 2023-08-09T12:51:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 shutdown_connections 2023-08-09T12:51:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7efc9406a080 0x7efc9406c540 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcb40c1dd0 0x7efcb40c2250 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c43f0 0x7efcb414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 --2- 172.21.15.17:0/198368663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efca0004d00 0x7efcb4167190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 >> 172.21.15.17:0/198368663 conn(0x7efcb40cb1b0 msgr2=0x7efcb4157410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 shutdown_connections 2023-08-09T12:51:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:47.900+0000 7efcb9bd6640 1 -- 172.21.15.17:0/198368663 wait complete. 2023-08-09T12:51:47.924 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:51:47.924 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:51:47.925 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:51:47.925 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:51:47.925 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:51:47.925 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:51:47.926 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:51:47.926 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:51:47.926 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:51:47.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:47.927 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:51:47.989 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:51:47.989 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:51:47.989 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:51:47.990 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:47.990 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:51:47.990 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:47.990 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:51:47.990 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:47.990 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:51:47.991 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:51:47.991 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:47.991 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:51:47.991 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:51:47.991 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:47.991 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:51:47.991 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:47.992 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:51:47.992 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41460sec preferred_lft 41460sec 2023-08-09T12:51:47.992 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:51:47.992 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:47.992 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:51:47.992 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:51:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:51:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:47.993 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:51:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:47.994 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:51:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:51:47.994 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:51:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:47.995 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:51:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:51:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:51:47.995 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:51:47.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:47.997 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:51:48.087 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:51:48.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:48.091 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:51:48.143 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:51:48.143 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:51:48.143 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:51:48.143 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:51:48.143 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:51:48.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:48.144 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:51:48.144 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:51:48.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:51:48.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:51:48.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:51:48.147 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:51:48.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:48.330 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:51:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:51:48.381 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:51:48.382 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:51:48.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:48.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:51:48.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:51:48.470 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:51:48.519 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:51:48.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:51:48.520 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:51:48.618 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:51:48.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:48.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:51:48.764 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:51:48.765 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:51:48.765 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:51:48.786 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:51:48.786 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:51:48.786 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:51:48.786 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:51:48.786 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:51:48.812 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:51:48.812 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:51:48.812 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:51:48.812 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:51:48.812 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:51:48.813 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:51:48.813 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:51:48.813 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:51:48.814 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:51:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:51:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:51:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:51:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:51:48.819 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:51:48.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:48.820 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:51:48.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:51:48.908 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:51:48.966 INFO:teuthology.orchestra.run.smithi142.stdout:client9192 2023-08-09T12:51:48.967 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:51:48.967 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:51:49.020 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:51:49.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.262+0000 7ff6c9063640 1 Processor -- start 2023-08-09T12:51:49.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.262+0000 7ff6c9063640 1 -- start start 2023-08-09T12:51:49.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.263+0000 7ff6c9063640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6c41587e0 0x7ff6c4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:49.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.263+0000 7ff6c9063640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6c40b0b10 0x7ff6c415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:49.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.263+0000 7ff6c9063640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c415bce0 0x7ff6c40cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:49.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.263+0000 7ff6c9063640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40715c0 con 0x7ff6c41587e0 2023-08-09T12:51:49.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.263+0000 7ff6c9063640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40718a0 con 0x7ff6c40b0b10 2023-08-09T12:51:49.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.263+0000 7ff6c9063640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4071b80 con 0x7ff6c415bce0 2023-08-09T12:51:49.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.263+0000 7ff6c3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6c41587e0 0x7ff6c4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:49.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6c3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6c41587e0 0x7ff6c4070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38232/0 (socket says 172.21.15.17:38232) 2023-08-09T12:51:49.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6c3fff640 1 -- 172.21.15.17:0/3546734186 learned_addr learned my addr 172.21.15.17:0/3546734186 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:49.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6bbfff640 1 --2- 172.21.15.17:0/3546734186 >> v2:172.21.15.142:3300/0 conn(0x7ff6c40b0b10 0x7ff6c415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:49.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6c3fff640 1 -- 172.21.15.17:0/3546734186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c415bce0 msgr2=0x7ff6c40cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:49.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/3546734186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c415bce0 0x7ff6c40cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6c3fff640 1 -- 172.21.15.17:0/3546734186 >> v2:172.21.15.142:3300/0 conn(0x7ff6c40b0b10 msgr2=0x7ff6c415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:49.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/3546734186 >> v2:172.21.15.142:3300/0 conn(0x7ff6c40b0b10 0x7ff6c415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6c3fff640 1 -- 172.21.15.17:0/3546734186 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c415b280 con 0x7ff6c41587e0 2023-08-09T12:51:49.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.264+0000 7ff6bbfff640 1 --2- 172.21.15.17:0/3546734186 >> v2:172.21.15.142:3300/0 conn(0x7ff6c40b0b10 0x7ff6c415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:49.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.265+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/3546734186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c41587e0 0x7ff6c4070f00 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7ff6c406b8a0 tx=0x7ff6b402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50623280fc3bf557 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:49.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.265+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3546734186 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4031860 con 0x7ff6c41587e0 2023-08-09T12:51:49.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.265+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3546734186 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b40319c0 con 0x7ff6c41587e0 2023-08-09T12:51:49.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.265+0000 7ff6c37fe640 1 -- 172.21.15.17:0/3546734186 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4031d50 con 0x7ff6c41587e0 2023-08-09T12:51:49.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 -- 172.21.15.17:0/3546734186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c41587e0 msgr2=0x7ff6c4070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 --2- 172.21.15.17:0/3546734186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c41587e0 0x7ff6c4070f00 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7ff6c406b8a0 tx=0x7ff6b402b900 comp rx=0 tx=0).stop 2023-08-09T12:51:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 -- 172.21.15.17:0/3546734186 shutdown_connections 2023-08-09T12:51:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 --2- 172.21.15.17:0/3546734186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c415bce0 0x7ff6c40cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 --2- 172.21.15.17:0/3546734186 >> v2:172.21.15.142:3300/0 conn(0x7ff6c40b0b10 0x7ff6c415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 --2- 172.21.15.17:0/3546734186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c41587e0 0x7ff6c4070f00 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 -- 172.21.15.17:0/3546734186 >> 172.21.15.17:0/3546734186 conn(0x7ff6c40b1d50 msgr2=0x7ff6c406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 -- 172.21.15.17:0/3546734186 shutdown_connections 2023-08-09T12:51:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.266+0000 7ff6c9063640 1 -- 172.21.15.17:0/3546734186 wait complete. 2023-08-09T12:51:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.268+0000 7ff6c9063640 1 Processor -- start 2023-08-09T12:51:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.268+0000 7ff6c9063640 1 -- start start 2023-08-09T12:51:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.269+0000 7ff6c9063640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6c40b0b10 0x7ff6c415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.269+0000 7ff6c9063640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c41587e0 0x7ff6c415e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.269+0000 7ff6c9063640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c40b0340 0x7ff6c415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.269+0000 7ff6c9063640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c415d2c0 con 0x7ff6c40b0340 2023-08-09T12:51:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.269+0000 7ff6c9063640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c415c6b0 con 0x7ff6c40b0b10 2023-08-09T12:51:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.269+0000 7ff6c9063640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c415c990 con 0x7ff6c41587e0 2023-08-09T12:51:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c8862640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c40b0340 0x7ff6c415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c8862640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c40b0340 0x7ff6c415eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38234/0 (socket says 172.21.15.17:38234) 2023-08-09T12:51:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c8862640 1 -- 172.21.15.17:0/2187403389 learned_addr learned my addr 172.21.15.17:0/2187403389 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6c40b0b10 0x7ff6c415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6bbfff640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c41587e0 0x7ff6c415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:49.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c8862640 1 -- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c41587e0 msgr2=0x7ff6c415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:49.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c8862640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c41587e0 0x7ff6c415e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c8862640 1 -- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6c40b0b10 msgr2=0x7ff6c415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:49.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c8862640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6c40b0b10 0x7ff6c415d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.270+0000 7ff6c8862640 1 -- 172.21.15.17:0/2187403389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40094d0 con 0x7ff6c40b0340 2023-08-09T12:51:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.271+0000 7ff6c8862640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c40b0340 0x7ff6c415eeb0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00b9e0 tx=0x7ff6bc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.271+0000 7ff6c17fa640 1 -- 172.21.15.17:0/2187403389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc00cb20 con 0x7ff6c40b0340 2023-08-09T12:51:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.271+0000 7ff6c17fa640 1 -- 172.21.15.17:0/2187403389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc00cca0 con 0x7ff6c40b0340 2023-08-09T12:51:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.271+0000 7ff6c17fa640 1 -- 172.21.15.17:0/2187403389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc014680 con 0x7ff6c40b0340 2023-08-09T12:51:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.271+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c415cc70 con 0x7ff6c40b0340 2023-08-09T12:51:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.271+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c415dc90 con 0x7ff6c40b0340 2023-08-09T12:51:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.272+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c415df10 con 0x7ff6c40b0340 2023-08-09T12:51:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.273+0000 7ff6c17fa640 1 -- 172.21.15.17:0/2187403389 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff6bc01c360 con 0x7ff6c40b0340 2023-08-09T12:51:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.274+0000 7ff6c17fa640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6a406a050 0x7ff6a406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:49.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.274+0000 7ff6c17fa640 1 -- 172.21.15.17:0/2187403389 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6bc088540 con 0x7ff6c40b0340 2023-08-09T12:51:49.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.275+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6a406a050 0x7ff6a406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:49.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.277+0000 7ff6c3fff640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6a406a050 0x7ff6a406c510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4036000 tx=0x7ff6b403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:49.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.279+0000 7ff6c17fa640 1 -- 172.21.15.17:0/2187403389 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff6bc053c20 con 0x7ff6c40b0340 2023-08-09T12:51:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.510+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6c406fa10 con 0x7ff6c40b0340 2023-08-09T12:51:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.511+0000 7ff6c17fa640 1 -- 172.21.15.17:0/2187403389 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4876 (secure 0 0 0) 0x7ff6c406fa10 con 0x7ff6c40b0340 2023-08-09T12:51:49.515 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:51:49.515 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/53885323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":53885323},{"type":"v1","addr":"172.21.15.142:6836","nonce":53885323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1636287832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1636287832},{"type":"v1","addr":"172.21.15.142:6837","nonce":1636287832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/758642293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":758642293},{"type":"v1","addr":"172.21.15.17:6833","nonce":758642293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:51:33.353513+0000","modified":"2023-08-09T12:51:36.903336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9000},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9000":{"gid":9000,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2739343495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2739343495},{"type":"v1","addr":"172.21.15.17:6835","nonce":2739343495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-09T12:51:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 84 2023-08-09T12:51:49.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6a406a050 msgr2=0x7ff6a406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:49.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6a406a050 0x7ff6a406c510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4036000 tx=0x7ff6b403c040 comp rx=0 tx=0).stop 2023-08-09T12:51:49.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c40b0340 msgr2=0x7ff6c415eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c40b0340 0x7ff6c415eeb0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00b9e0 tx=0x7ff6bc00bea0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 shutdown_connections 2023-08-09T12:51:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff6a406a050 0x7ff6a406c510 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c40b0340 0x7ff6c415eeb0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6c41587e0 0x7ff6c415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 --2- 172.21.15.17:0/2187403389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6c40b0b10 0x7ff6c415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 >> 172.21.15.17:0/2187403389 conn(0x7ff6c40b1d50 msgr2=0x7ff6c4157260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 shutdown_connections 2023-08-09T12:51:49.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:49.514+0000 7ff6c9063640 1 -- 172.21.15.17:0/2187403389 wait complete. 2023-08-09T12:51:49.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-08-09T12:51:49.783 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":9000,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.902207592,"mdsmap_epoch":84,"osdmap_epoch":175,"osdmap_epoch_barrier":175,"uptime":21.817042094000001} 2023-08-09T12:51:49.783 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 9000, "mdsmap_epoch": 84, "osdmap_epoch": 175, "osdmap_epoch_barrier": 175, "rank_uptime": 15.902207592, "state": "up:active", "uptime": 21.817042094, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:51:49.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-09T12:51:50.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.023+0000 7fd1e4e60640 1 Processor -- start 2023-08-09T12:51:50.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.023+0000 7fd1e4e60640 1 -- start start 2023-08-09T12:51:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.025+0000 7fd1e4e60640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1e015abe0 0x7fd1e00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.025+0000 7fd1e4e60640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e00b4770 con 0x7fd1e00708a0 2023-08-09T12:51:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.025+0000 7fd1e4e60640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e00caa70 con 0x7fd1e00add60 2023-08-09T12:51:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.025+0000 7fd1e4e60640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e00b41b0 con 0x7fd1e015abe0 2023-08-09T12:51:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.025+0000 7fd1ded9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd1e00708a0 0x7fd1e00caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48712/0 (socket says 172.21.15.17:48712) 2023-08-09T12:51:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.025+0000 7fd1ded9d640 1 -- 172.21.15.17:0/1519779304 learned_addr learned my addr 172.21.15.17:0/1519779304 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:51:50.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.025+0000 7fd1de59c640 1 --2- 172.21.15.17:0/1519779304 >> v2:172.21.15.142:3300/0 conn(0x7fd1e015abe0 0x7fd1e00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:50.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349011428 0 0) 0x7fd1e00b4770 con 0x7fd1e00708a0 2023-08-09T12:51:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1cc003520 con 0x7fd1e00708a0 2023-08-09T12:51:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2180031434 0 0) 0x7fd1cc003520 con 0x7fd1e00708a0 2023-08-09T12:51:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 >> v2:172.21.15.142:3300/0 conn(0x7fd1e015abe0 msgr2=0x7fd1e00c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 --2- 172.21.15.17:0/1519779304 >> v2:172.21.15.142:3300/0 conn(0x7fd1e015abe0 0x7fd1e00c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 >> v1:172.21.15.142:6789/0 conn(0x7fd1e00add60 legacy=0x7fd1e0070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00b4490 con 0x7fd1e00708a0 2023-08-09T12:51:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fd1d8001670 con 0x7fd1e00708a0 2023-08-09T12:51:50.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 >> v1:172.21.15.17:6789/0 conn(0x7fd1e00708a0 legacy=0x7fd1e00caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:50.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1cc003970 0x7fd1cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:50.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0047c0 0x7fd1cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:50.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc0052a0 0x7fd1cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:50.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00b41b0 con 0x7fd1cc003970 2023-08-09T12:51:50.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc00c170 con 0x7fd1cc0047c0 2023-08-09T12:51:50.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.026+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc00c330 con 0x7fd1cc0052a0 2023-08-09T12:51:50.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.027+0000 7fd1de59c640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1cc003970 0x7fd1cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:50.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.027+0000 7fd1d5d9b640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0047c0 0x7fd1cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:50.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.027+0000 7fd1de59c640 1 -- 172.21.15.17:0/1519779304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc0052a0 msgr2=0x7fd1cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:50.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.027+0000 7fd1de59c640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1cc0052a0 0x7fd1cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:50.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.027+0000 7fd1de59c640 1 -- 172.21.15.17:0/1519779304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0047c0 msgr2=0x7fd1cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:51:50.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.027+0000 7fd1de59c640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc0047c0 0x7fd1cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:50.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.027+0000 7fd1de59c640 1 -- 172.21.15.17:0/1519779304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc003520 con 0x7fd1cc003970 2023-08-09T12:51:50.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.027+0000 7fd1ded9d640 1 -- 172.21.15.17:0/1519779304 reap_dead start 2023-08-09T12:51:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.028+0000 7fd1de59c640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1cc003970 0x7fd1cc003d90 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009f90 tx=0x7fd1cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bb03ae7af1b3e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:50.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.028+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d002cbd0 con 0x7fd1cc003970 2023-08-09T12:51:50.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.028+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d000f040 con 0x7fd1cc003970 2023-08-09T12:51:50.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.028+0000 7fd1ddd9b640 1 -- 172.21.15.17:0/1519779304 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0034440 con 0x7fd1cc003970 2023-08-09T12:51:50.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.029+0000 7fd1e4e60640 1 -- 172.21.15.17:0/1519779304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1cc003970 msgr2=0x7fd1cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:50.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.029+0000 7fd1e4e60640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1cc003970 0x7fd1cc003d90 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009f90 tx=0x7fd1cc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:51:50.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.029+0000 7fd1e4e60640 1 -- 172.21.15.17:0/1519779304 shutdown_connections 2023-08-09T12:51:50.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.029+0000 7fd1e4e60640 1 --2- 172.21.15.17:0/1519779304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1cc003970 0x7fd1cc003d90 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:50.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.029+0000 7fd1e4e60640 1 -- 172.21.15.17:0/1519779304 >> 172.21.15.17:0/1519779304 conn(0x7fd1e00697c0 msgr2=0x7fd1e0069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:50.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.029+0000 7fd1e4e60640 1 -- 172.21.15.17:0/1519779304 shutdown_connections 2023-08-09T12:51:50.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.029+0000 7fd1e4e60640 1 -- 172.21.15.17:0/1519779304 wait complete. 2023-08-09T12:51:50.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.031+0000 7fd1e4e60640 1 Processor -- start 2023-08-09T12:51:50.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.031+0000 7fd1e4e60640 1 -- start start 2023-08-09T12:51:50.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.032+0000 7fd1e4e60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc003970 0x7fd1e00cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.032+0000 7fd1e4e60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e00ae190 0x7fd1e00b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.032+0000 7fd1e4e60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e014e7b0 0x7fd1e014ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.032+0000 7fd1e4e60640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e014f170 con 0x7fd1e00ae190 2023-08-09T12:51:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.032+0000 7fd1e4e60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00ae610 con 0x7fd1cc003970 2023-08-09T12:51:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.032+0000 7fd1e4e60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00ae8e0 con 0x7fd1e014e7b0 2023-08-09T12:51:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e00ae190 0x7fd1e00b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:50.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e00ae190 0x7fd1e00b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38260/0 (socket says 172.21.15.17:38260) 2023-08-09T12:51:50.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 -- 172.21.15.17:0/280528833 learned_addr learned my addr 172.21.15.17:0/280528833 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:51:50.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1ded9d640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e014e7b0 0x7fd1e014ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:50.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 -- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e014e7b0 msgr2=0x7fd1e014ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:50.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1de59c640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc003970 0x7fd1e00cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:50.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e014e7b0 0x7fd1e014ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:50.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 -- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc003970 msgr2=0x7fd1e00cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:50.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc003970 0x7fd1e00cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:50.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 -- 172.21.15.17:0/280528833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00aebc0 con 0x7fd1e00ae190 2023-08-09T12:51:50.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1ded9d640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e014e7b0 0x7fd1e014ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:51:50.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.033+0000 7fd1d5d9b640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e00ae190 0x7fd1e00b32b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800e490 tx=0x7fd1c800e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:50.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.034+0000 7fd1d77fe640 1 -- 172.21.15.17:0/280528833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80053a0 con 0x7fd1e00ae190 2023-08-09T12:51:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.034+0000 7fd1d77fe640 1 -- 172.21.15.17:0/280528833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80035f0 con 0x7fd1e00ae190 2023-08-09T12:51:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.034+0000 7fd1d77fe640 1 -- 172.21.15.17:0/280528833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8003980 con 0x7fd1e00ae190 2023-08-09T12:51:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.034+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e00aeea0 con 0x7fd1e00ae190 2023-08-09T12:51:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.034+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e00af460 con 0x7fd1e00ae190 2023-08-09T12:51:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.035+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e00af5f0 con 0x7fd1e00ae190 2023-08-09T12:51:50.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.036+0000 7fd1d77fe640 1 -- 172.21.15.17:0/280528833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd1c8003ae0 con 0x7fd1e00ae190 2023-08-09T12:51:50.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.037+0000 7fd1d77fe640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1c006a080 0x7fd1c006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:51:50.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.037+0000 7fd1d77fe640 1 -- 172.21.15.17:0/280528833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1c8088390 con 0x7fd1e00ae190 2023-08-09T12:51:50.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.038+0000 7fd1de59c640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1c006a080 0x7fd1c006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:51:50.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.039+0000 7fd1de59c640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1c006a080 0x7fd1c006c540 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0036000 tx=0x7fd1d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:51:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.042+0000 7fd1d77fe640 1 -- 172.21.15.17:0/280528833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd1c80539e0 con 0x7fd1e00ae190 2023-08-09T12:51:50.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:50.235+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fd1e0067a80 con 0x7fd1e00ae190 2023-08-09T12:51:51.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.003+0000 7fd1d77fe640 1 -- 172.21.15.17:0/280528833 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v176) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd1c8057000 con 0x7fd1e00ae190 2023-08-09T12:51:51.007 INFO:teuthology.orchestra.run.smithi017.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-09T12:51:51.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1c006a080 msgr2=0x7fd1c006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:51.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1c006a080 0x7fd1c006c540 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0036000 tx=0x7fd1d002e000 comp rx=0 tx=0).stop 2023-08-09T12:51:51.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e00ae190 msgr2=0x7fd1e00b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:51:51.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e00ae190 0x7fd1e00b32b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800e490 tx=0x7fd1c800e950 comp rx=0 tx=0).stop 2023-08-09T12:51:51.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 shutdown_connections 2023-08-09T12:51:51.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd1c006a080 0x7fd1c006c540 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:51.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e014e7b0 0x7fd1e014ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:51.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e00ae190 0x7fd1e00b32b0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:51.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 --2- 172.21.15.17:0/280528833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1cc003970 0x7fd1e00cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:51:51.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.007+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 >> 172.21.15.17:0/280528833 conn(0x7fd1e00697c0 msgr2=0x7fd1e00cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:51:51.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.008+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 shutdown_connections 2023-08-09T12:51:51.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:51:51.008+0000 7fd1e4e60640 1 -- 172.21.15.17:0/280528833 wait complete. 2023-08-09T12:51:51.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-09T12:51:51.280 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_mon_report_interval":"5"} 2023-08-09T12:51:51.280 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-09T12:51:51.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-08-09T12:51:51.523 INFO:teuthology.orchestra.run.smithi017.stdout:{"mon_tick_interval":"5"} 2023-08-09T12:51:51.523 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-08-09T12:51:51.524 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-08-09T12:51:51.525 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2023-08-09T12:51:51.525 DEBUG:teuthology.orchestra.run.smithi017:> import time 2023-08-09T12:51:51.525 DEBUG:teuthology.orchestra.run.smithi017:> import datetime 2023-08-09T12:51:51.526 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2023-08-09T12:51:51.526 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-08-09T12:51:51.527 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:51:51.527 DEBUG:teuthology.orchestra.run.smithi017:> # Write some buffered data through before going full, all should be well 2023-08-09T12:51:51.527 DEBUG:teuthology.orchestra.run.smithi017:> print("writing some data through which we expect to succeed") 2023-08-09T12:51:51.528 DEBUG:teuthology.orchestra.run.smithi017:> bytes = 0 2023-08-09T12:51:51.528 DEBUG:teuthology.orchestra.run.smithi017:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-08-09T12:51:51.528 DEBUG:teuthology.orchestra.run.smithi017:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-08-09T12:51:51.530 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-08-09T12:51:51.531 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f) 2023-08-09T12:51:51.531 DEBUG:teuthology.orchestra.run.smithi017:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-08-09T12:51:51.532 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:51:51.533 DEBUG:teuthology.orchestra.run.smithi017:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-08-09T12:51:51.533 DEBUG:teuthology.orchestra.run.smithi017:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-08-09T12:51:51.534 DEBUG:teuthology.orchestra.run.smithi017:> # buffered IO, the error should always only appear from fsync and not 2023-08-09T12:51:51.535 DEBUG:teuthology.orchestra.run.smithi017:> # from write 2023-08-09T12:51:51.535 DEBUG:teuthology.orchestra.run.smithi017:> full = False 2023-08-09T12:51:51.536 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:51:51.537 DEBUG:teuthology.orchestra.run.smithi017:> for n in range(0, int(32 * 1.1)): 2023-08-09T12:51:51.537 DEBUG:teuthology.orchestra.run.smithi017:> try: 2023-08-09T12:51:51.538 DEBUG:teuthology.orchestra.run.smithi017:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-08-09T12:51:51.538 DEBUG:teuthology.orchestra.run.smithi017:> print("wrote bytes via buffered write, moving on to fsync") 2023-08-09T12:51:51.539 DEBUG:teuthology.orchestra.run.smithi017:> except OSError as e: 2023-08-09T12:51:51.539 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2023-08-09T12:51:51.540 DEBUG:teuthology.orchestra.run.smithi017:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-08-09T12:51:51.540 DEBUG:teuthology.orchestra.run.smithi017:> raise 2023-08-09T12:51:51.540 DEBUG:teuthology.orchestra.run.smithi017:> else: 2023-08-09T12:51:51.541 DEBUG:teuthology.orchestra.run.smithi017:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-09T12:51:51.541 DEBUG:teuthology.orchestra.run.smithi017:> full = True 2023-08-09T12:51:51.541 DEBUG:teuthology.orchestra.run.smithi017:> break 2023-08-09T12:51:51.542 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:51:51.542 DEBUG:teuthology.orchestra.run.smithi017:> try: 2023-08-09T12:51:51.542 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f) 2023-08-09T12:51:51.542 DEBUG:teuthology.orchestra.run.smithi017:> print("fsync'"'"'ed successfully") 2023-08-09T12:51:51.543 DEBUG:teuthology.orchestra.run.smithi017:> except OSError as e: 2023-08-09T12:51:51.543 DEBUG:teuthology.orchestra.run.smithi017:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-09T12:51:51.543 DEBUG:teuthology.orchestra.run.smithi017:> full = True 2023-08-09T12:51:51.544 DEBUG:teuthology.orchestra.run.smithi017:> break 2023-08-09T12:51:51.544 DEBUG:teuthology.orchestra.run.smithi017:> else: 2023-08-09T12:51:51.544 DEBUG:teuthology.orchestra.run.smithi017:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-08-09T12:51:51.545 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:51:51.545 DEBUG:teuthology.orchestra.run.smithi017:> if n > 32 * 0.9: 2023-08-09T12:51:51.545 DEBUG:teuthology.orchestra.run.smithi017:> # Be cautious in the last region where we expect to hit 2023-08-09T12:51:51.545 DEBUG:teuthology.orchestra.run.smithi017:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-08-09T12:51:51.546 DEBUG:teuthology.orchestra.run.smithi017:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-08-09T12:51:51.546 DEBUG:teuthology.orchestra.run.smithi017:> time.sleep(15.0) 2023-08-09T12:51:51.546 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:51:51.546 DEBUG:teuthology.orchestra.run.smithi017:> if not full: 2023-08-09T12:51:51.547 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-08-09T12:51:51.547 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:51:51.547 DEBUG:teuthology.orchestra.run.smithi017:> # close() should not raise an error because we already caught it in 2023-08-09T12:51:51.548 DEBUG:teuthology.orchestra.run.smithi017:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-08-09T12:51:51.548 DEBUG:teuthology.orchestra.run.smithi017:> # since then because all IOs got cancelled on the full flag. 2023-08-09T12:51:51.548 DEBUG:teuthology.orchestra.run.smithi017:> print("calling close") 2023-08-09T12:51:51.548 DEBUG:teuthology.orchestra.run.smithi017:> os.close(f) 2023-08-09T12:51:51.549 DEBUG:teuthology.orchestra.run.smithi017:> print("close() did not raise error") 2023-08-09T12:51:51.549 DEBUG:teuthology.orchestra.run.smithi017:> 2023-08-09T12:51:51.549 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-08-09T12:51:51.550 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-08-09T12:52:13.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:52:13.211 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:52:43.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:52:43.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:52:53.522 INFO:teuthology.orchestra.run.smithi017.stdout:writing some data through which we expect to succeed 2023-08-09T12:52:53.522 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-08-09T12:52:53.523 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.523 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.523 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 1.00 MB 2023-08-09T12:52:53.523 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.523 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.524 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 2.00 MB 2023-08-09T12:52:53.524 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.526 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.526 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 3.00 MB 2023-08-09T12:52:53.526 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.527 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.527 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 4.00 MB 2023-08-09T12:52:53.527 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.527 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.528 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 5.00 MB 2023-08-09T12:52:53.528 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.528 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.529 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 6.00 MB 2023-08-09T12:52:53.529 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.529 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.529 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 7.00 MB 2023-08-09T12:52:53.529 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.529 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.529 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 8.00 MB 2023-08-09T12:52:53.530 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.530 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.530 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 9.00 MB 2023-08-09T12:52:53.530 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.530 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.530 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 10.00 MB 2023-08-09T12:52:53.531 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.531 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.531 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 11.00 MB 2023-08-09T12:52:53.531 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.531 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.531 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 12.00 MB 2023-08-09T12:52:53.532 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.532 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.532 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 13.00 MB 2023-08-09T12:52:53.532 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.532 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.532 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 14.00 MB 2023-08-09T12:52:53.533 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.533 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.533 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 15.00 MB 2023-08-09T12:52:53.533 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.533 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.533 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 16.00 MB 2023-08-09T12:52:53.534 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.534 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.534 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 17.00 MB 2023-08-09T12:52:53.534 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.534 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.534 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 18.00 MB 2023-08-09T12:52:53.535 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.535 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.535 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 19.00 MB 2023-08-09T12:52:53.536 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.536 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.536 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 20.00 MB 2023-08-09T12:52:53.536 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.536 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.537 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 21.00 MB 2023-08-09T12:52:53.537 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.537 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.537 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 22.00 MB 2023-08-09T12:52:53.537 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.537 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.537 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 23.00 MB 2023-08-09T12:52:53.538 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.538 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 24.00 MB 2023-08-09T12:52:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 25.00 MB 2023-08-09T12:52:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 26.00 MB 2023-08-09T12:52:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 27.00 MB 2023-08-09T12:52:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 28.00 MB 2023-08-09T12:52:53.541 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.541 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.541 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 29.00 MB 2023-08-09T12:52:53.541 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.542 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.542 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 30.00 MB 2023-08-09T12:52:53.542 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:52:53.542 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.542 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.542 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 31.00 MB 2023-08-09T12:52:53.542 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:52:53.543 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.543 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.543 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 32.00 MB 2023-08-09T12:52:53.543 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:52:53.543 INFO:teuthology.orchestra.run.smithi017.stdout:wrote bytes via buffered write, moving on to fsync 2023-08-09T12:52:53.543 INFO:teuthology.orchestra.run.smithi017.stdout:fsync'ed successfully 2023-08-09T12:52:53.543 INFO:teuthology.orchestra.run.smithi017.stdout:Not full yet after 33.00 MB 2023-08-09T12:52:53.543 INFO:teuthology.orchestra.run.smithi017.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-08-09T12:52:53.544 INFO:teuthology.orchestra.run.smithi017.stdout:Reached fullness after 33.00 MB 2023-08-09T12:52:53.544 INFO:teuthology.orchestra.run.smithi017.stdout:calling close 2023-08-09T12:52:53.544 INFO:teuthology.orchestra.run.smithi017.stdout:close() did not raise error 2023-08-09T12:52:53.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-09T12:52:53.555 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:52:53.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:52:53.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:52:53.816 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:52:53.817 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:52:53.817 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:52:53.885 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:52:53.885 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:52:53.948 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:52:54.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.181+0000 7fc9bd77f640 1 Processor -- start 2023-08-09T12:52:54.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.181+0000 7fc9bd77f640 1 -- start start 2023-08-09T12:52:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.183+0000 7fc9bd77f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9b8160030 0x7fc9b8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.183+0000 7fc9bd77f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9b80cfb50 0x7fc9b80d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.183+0000 7fc9bd77f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b80b5a30 con 0x7fc9b80b86e0 2023-08-09T12:52:54.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.183+0000 7fc9bd77f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80d1110 con 0x7fc9b8160030 2023-08-09T12:52:54.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.183+0000 7fc9bd77f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80ceac0 con 0x7fc9b80cfb50 2023-08-09T12:52:54.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.183+0000 7fc9b7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9b8160030 0x7fc9b8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.183+0000 7fc9b7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9b8160030 0x7fc9b8160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50734/0 (socket says 172.21.15.17:50734) 2023-08-09T12:52:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.183+0000 7fc9b7fff640 1 -- 172.21.15.17:0/284086666 learned_addr learned my addr 172.21.15.17:0/284086666 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.184+0000 7fc9bcf7e640 1 --2- 172.21.15.17:0/284086666 >> v2:172.21.15.142:3300/0 conn(0x7fc9b80cfb50 0x7fc9b80d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.184+0000 7fc9b7fff640 1 -- 172.21.15.17:0/284086666 >> v2:172.21.15.142:3300/0 conn(0x7fc9b80cfb50 msgr2=0x7fc9b80d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.184+0000 7fc9b7fff640 1 --2- 172.21.15.17:0/284086666 >> v2:172.21.15.142:3300/0 conn(0x7fc9b80cfb50 0x7fc9b80d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.184+0000 7fc9b7fff640 1 -- 172.21.15.17:0/284086666 >> v1:172.21.15.142:6789/0 conn(0x7fc9b80b86e0 legacy=0x7fc9b80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:54.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.184+0000 7fc9b7fff640 1 -- 172.21.15.17:0/284086666 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80d0d70 con 0x7fc9b8160030 2023-08-09T12:52:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.185+0000 7fc9b7fff640 1 --2- 172.21.15.17:0/284086666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b8160030 0x7fc9b8160740 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8065f60 tx=0x7fc9a802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda8a935615abdd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:54.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.185+0000 7fc9b6ffd640 1 -- 172.21.15.17:0/284086666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a802ca80 con 0x7fc9b8160030 2023-08-09T12:52:54.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9b6ffd640 1 -- 172.21.15.17:0/284086666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a802cbe0 con 0x7fc9b8160030 2023-08-09T12:52:54.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9b6ffd640 1 -- 172.21.15.17:0/284086666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80343f0 con 0x7fc9b8160030 2023-08-09T12:52:54.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9bd77f640 1 -- 172.21.15.17:0/284086666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b8160030 msgr2=0x7fc9b8160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/284086666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b8160030 0x7fc9b8160740 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8065f60 tx=0x7fc9a802bee0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9bd77f640 1 -- 172.21.15.17:0/284086666 shutdown_connections 2023-08-09T12:52:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/284086666 >> v2:172.21.15.142:3300/0 conn(0x7fc9b80cfb50 0x7fc9b80d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/284086666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b8160030 0x7fc9b8160740 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9bd77f640 1 -- 172.21.15.17:0/284086666 >> 172.21.15.17:0/284086666 conn(0x7fc9b80697c0 msgr2=0x7fc9b8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9bd77f640 1 -- 172.21.15.17:0/284086666 shutdown_connections 2023-08-09T12:52:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.186+0000 7fc9bd77f640 1 -- 172.21.15.17:0/284086666 wait complete. 2023-08-09T12:52:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.188+0000 7fc9bd77f640 1 Processor -- start 2023-08-09T12:52:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.188+0000 7fc9bd77f640 1 -- start start 2023-08-09T12:52:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.189+0000 7fc9bd77f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80b86e0 0x7fc9b80c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.189+0000 7fc9bd77f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cfb50 0x7fc9b81f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.189+0000 7fc9bd77f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8160030 0x7fc9b80cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.189+0000 7fc9bd77f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80caf00 con 0x7fc9b80cfb50 2023-08-09T12:52:54.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.189+0000 7fc9bd77f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80ca380 con 0x7fc9b8160030 2023-08-09T12:52:54.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.189+0000 7fc9bd77f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80ca660 con 0x7fc9b80b86e0 2023-08-09T12:52:54.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cfb50 0x7fc9b81f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cfb50 0x7fc9b81f1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50750/0 (socket says 172.21.15.17:50750) 2023-08-09T12:52:54.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b77fe640 1 -- 172.21.15.17:0/2134158281 learned_addr learned my addr 172.21.15.17:0/2134158281 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:54.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9bcf7e640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8160030 0x7fc9b80cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b7fff640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80b86e0 0x7fc9b80c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b77fe640 1 -- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80b86e0 msgr2=0x7fc9b80c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b77fe640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80b86e0 0x7fc9b80c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b77fe640 1 -- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8160030 msgr2=0x7fc9b80cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b77fe640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8160030 0x7fc9b80cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9b77fe640 1 -- 172.21.15.17:0/2134158281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a8009b30 con 0x7fc9b80cfb50 2023-08-09T12:52:54.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.190+0000 7fc9bcf7e640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8160030 0x7fc9b80cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:52:54.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.191+0000 7fc9b77fe640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cfb50 0x7fc9b81f1f70 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c410 tx=0x7fc9ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:54.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.191+0000 7fc9b4ff9640 1 -- 172.21.15.17:0/2134158281 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0035f0 con 0x7fc9b80cfb50 2023-08-09T12:52:54.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.191+0000 7fc9b4ff9640 1 -- 172.21.15.17:0/2134158281 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac003750 con 0x7fc9b80cfb50 2023-08-09T12:52:54.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.191+0000 7fc9b4ff9640 1 -- 172.21.15.17:0/2134158281 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac003b40 con 0x7fc9b80cfb50 2023-08-09T12:52:54.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.191+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b80ca940 con 0x7fc9b80cfb50 2023-08-09T12:52:54.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.191+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b80ca010 con 0x7fc9b80cfb50 2023-08-09T12:52:54.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.192+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b804e390 con 0x7fc9b80cfb50 2023-08-09T12:52:54.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.194+0000 7fc9b4ff9640 1 -- 172.21.15.17:0/2134158281 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc9ac003ca0 con 0x7fc9b80cfb50 2023-08-09T12:52:54.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.195+0000 7fc9b4ff9640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a020 0x7fc9a406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.195+0000 7fc9b4ff9640 1 -- 172.21.15.17:0/2134158281 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc9ac087880 con 0x7fc9b80cfb50 2023-08-09T12:52:54.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.195+0000 7fc9b4ff9640 1 -- 172.21.15.17:0/2134158281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fc9a4072230 con 0x7fc9b80cfb50 2023-08-09T12:52:54.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.195+0000 7fc9b7fff640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a020 0x7fc9a406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.196+0000 7fc9b7fff640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a020 0x7fc9a406c4e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8035000 tx=0x7fc9a8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:54.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.200+0000 7fc9b4ff9640 1 -- 172.21.15.17:0/2134158281 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc9ac052e90 con 0x7fc9b80cfb50 2023-08-09T12:52:54.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.399+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9b80b7800 con 0x7fc9b80cfb50 2023-08-09T12:52:54.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.401+0000 7fc9b4ff9640 1 -- 172.21.15.17:0/2134158281 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+18463 (secure 0 0 0) 0x7fc9ac017090 con 0x7fc9b80cfb50 2023-08-09T12:52:54.405 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:52:54.406 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":179,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:52:33.944618+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:51:31.771781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-09T12:51:32.371993+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:52:54.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a020 msgr2=0x7fc9a406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a020 0x7fc9a406c4e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8035000 tx=0x7fc9a8030000 comp rx=0 tx=0).stop 2023-08-09T12:52:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cfb50 msgr2=0x7fc9b81f1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cfb50 0x7fc9b81f1f70 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c410 tx=0x7fc9ac00c8d0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 shutdown_connections 2023-08-09T12:52:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc9a406a020 0x7fc9a406c4e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9b8160030 0x7fc9b80cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b80cfb50 0x7fc9b81f1f70 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 --2- 172.21.15.17:0/2134158281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9b80b86e0 0x7fc9b80c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 >> 172.21.15.17:0/2134158281 conn(0x7fc9b80697c0 msgr2=0x7fc9b815f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 shutdown_connections 2023-08-09T12:52:54.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.405+0000 7fc9bd77f640 1 -- 172.21.15.17:0/2134158281 wait complete. 2023-08-09T12:52:54.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:51:31.771781+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:51:32.371993+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:52:54.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:52:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.657+0000 7f6deee6a640 1 Processor -- start 2023-08-09T12:52:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.658+0000 7f6deee6a640 1 -- start start 2023-08-09T12:52:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6deee6a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cb40 0x7f6de81609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6deee6a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6de80b8420 0x7f6de80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6deee6a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6de815cf20 0x7f6de80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6deee6a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de80d0f00 con 0x7f6de815cf20 2023-08-09T12:52:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6deee6a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de81611f0 con 0x7f6de80b8420 2023-08-09T12:52:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6deee6a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81614d0 con 0x7f6de815cb40 2023-08-09T12:52:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6dee669640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6de815cf20 0x7f6de80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6dee669640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6de815cf20 0x7f6de80cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50764/0 (socket says 172.21.15.17:50764) 2023-08-09T12:52:54.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.659+0000 7f6dee669640 1 -- 172.21.15.17:0/2179287491 learned_addr learned my addr 172.21.15.17:0/2179287491 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.660+0000 7f6ded667640 1 --2- 172.21.15.17:0/2179287491 >> v2:172.21.15.142:3300/0 conn(0x7f6de80b8420 0x7f6de80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.660+0000 7f6dede68640 1 --2- 172.21.15.17:0/2179287491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cb40 0x7f6de81609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.660+0000 7f6dee669640 1 -- 172.21.15.17:0/2179287491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cb40 msgr2=0x7f6de81609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.660+0000 7f6dee669640 1 --2- 172.21.15.17:0/2179287491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cb40 0x7f6de81609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.660+0000 7f6dee669640 1 -- 172.21.15.17:0/2179287491 >> v2:172.21.15.142:3300/0 conn(0x7f6de80b8420 msgr2=0x7f6de80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.660+0000 7f6dee669640 1 --2- 172.21.15.17:0/2179287491 >> v2:172.21.15.142:3300/0 conn(0x7f6de80b8420 0x7f6de80cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.660+0000 7f6dee669640 1 -- 172.21.15.17:0/2179287491 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de81617b0 con 0x7f6de815cf20 2023-08-09T12:52:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.660+0000 7f6dede68640 1 --2- 172.21.15.17:0/2179287491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cb40 0x7f6de81609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:52:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.661+0000 7f6dee669640 1 --2- 172.21.15.17:0/2179287491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de815cf20 0x7f6de80cdda0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f6de806a830 tx=0x7f6de002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c14c188bd0a71a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.661+0000 7f6dece66640 1 -- 172.21.15.17:0/2179287491 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de002cb00 con 0x7f6de815cf20 2023-08-09T12:52:54.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6dece66640 1 -- 172.21.15.17:0/2179287491 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de002cc60 con 0x7f6de815cf20 2023-08-09T12:52:54.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6dece66640 1 -- 172.21.15.17:0/2179287491 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00343f0 con 0x7f6de815cf20 2023-08-09T12:52:54.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6deee6a640 1 -- 172.21.15.17:0/2179287491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de815cf20 msgr2=0x7f6de80cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6deee6a640 1 --2- 172.21.15.17:0/2179287491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de815cf20 0x7f6de80cdda0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f6de806a830 tx=0x7f6de002bf60 comp rx=0 tx=0).stop 2023-08-09T12:52:54.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6deee6a640 1 -- 172.21.15.17:0/2179287491 shutdown_connections 2023-08-09T12:52:54.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6deee6a640 1 --2- 172.21.15.17:0/2179287491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de815cf20 0x7f6de80cdda0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6deee6a640 1 --2- 172.21.15.17:0/2179287491 >> v2:172.21.15.142:3300/0 conn(0x7f6de80b8420 0x7f6de80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6deee6a640 1 --2- 172.21.15.17:0/2179287491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cb40 0x7f6de81609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6deee6a640 1 -- 172.21.15.17:0/2179287491 >> 172.21.15.17:0/2179287491 conn(0x7f6de80d2ab0 msgr2=0x7f6de80d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:54.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.662+0000 7f6deee6a640 1 -- 172.21.15.17:0/2179287491 shutdown_connections 2023-08-09T12:52:54.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.663+0000 7f6deee6a640 1 -- 172.21.15.17:0/2179287491 wait complete. 2023-08-09T12:52:54.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.664+0000 7f6deee6a640 1 Processor -- start 2023-08-09T12:52:54.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.665+0000 7f6deee6a640 1 -- start start 2023-08-09T12:52:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6deee6a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de80b8420 0x7f6de80c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6deee6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815cb40 0x7f6de80c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6deee6a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cf20 0x7f6de8157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6deee6a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8145840 con 0x7f6de80b8420 2023-08-09T12:52:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6deee6a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81581e0 con 0x7f6de815cb40 2023-08-09T12:52:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6deee6a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8144f10 con 0x7f6de815cf20 2023-08-09T12:52:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6dede68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de80b8420 0x7f6de80c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6dede68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de80b8420 0x7f6de80c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50772/0 (socket says 172.21.15.17:50772) 2023-08-09T12:52:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6dede68640 1 -- 172.21.15.17:0/1081093352 learned_addr learned my addr 172.21.15.17:0/1081093352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6ded667640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815cb40 0x7f6de80c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6dede68640 1 -- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cf20 msgr2=0x7f6de8157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6dede68640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cf20 0x7f6de8157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6dede68640 1 -- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815cb40 msgr2=0x7f6de80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6dede68640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815cb40 0x7f6de80c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.666+0000 7f6dede68640 1 -- 172.21.15.17:0/1081093352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de0009b30 con 0x7f6de80b8420 2023-08-09T12:52:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.667+0000 7f6dede68640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de80b8420 0x7f6de80c5e50 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c7f0 tx=0x7f6de400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.667+0000 7f6dde7fc640 1 -- 172.21.15.17:0/1081093352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4007a30 con 0x7f6de80b8420 2023-08-09T12:52:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.667+0000 7f6dde7fc640 1 -- 172.21.15.17:0/1081093352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de4007b90 con 0x7f6de80b8420 2023-08-09T12:52:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.667+0000 7f6dde7fc640 1 -- 172.21.15.17:0/1081093352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400ce40 con 0x7f6de80b8420 2023-08-09T12:52:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.667+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de81451f0 con 0x7f6de80b8420 2023-08-09T12:52:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.667+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de80c7600 con 0x7f6de80b8420 2023-08-09T12:52:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.669+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de804e390 con 0x7f6de80b8420 2023-08-09T12:52:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.669+0000 7f6dde7fc640 1 -- 172.21.15.17:0/1081093352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6de40113f0 con 0x7f6de80b8420 2023-08-09T12:52:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.671+0000 7f6dde7fc640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dcc06a050 0x7f6dcc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.671+0000 7f6dde7fc640 1 -- 172.21.15.17:0/1081093352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6de40887c0 con 0x7f6de80b8420 2023-08-09T12:52:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.671+0000 7f6dde7fc640 1 -- 172.21.15.17:0/1081093352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f6dcc072260 con 0x7f6de80b8420 2023-08-09T12:52:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.672+0000 7f6ded667640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dcc06a050 0x7f6dcc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:54.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.673+0000 7f6ded667640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dcc06a050 0x7f6dcc06c510 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6de80c92c0 tx=0x7f6dd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:54.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.676+0000 7f6dde7fc640 1 -- 172.21.15.17:0/1081093352 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6de4053dd0 con 0x7f6de80b8420 2023-08-09T12:52:54.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.868+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6de80b60a0 con 0x7f6de80b8420 2023-08-09T12:52:54.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.869+0000 7f6dde7fc640 1 -- 172.21.15.17:0/1081093352 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6de401f0a0 con 0x7f6de80b8420 2023-08-09T12:52:54.873 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:52:54.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dcc06a050 msgr2=0x7f6dcc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dcc06a050 0x7f6dcc06c510 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6de80c92c0 tx=0x7f6dd8008040 comp rx=0 tx=0).stop 2023-08-09T12:52:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de80b8420 msgr2=0x7f6de80c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de80b8420 0x7f6de80c5e50 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c7f0 tx=0x7f6de400cbf0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 shutdown_connections 2023-08-09T12:52:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6dcc06a050 0x7f6dcc06c510 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de815cf20 0x7f6de8157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815cb40 0x7f6de80c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 --2- 172.21.15.17:0/1081093352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6de80b8420 0x7f6de80c5e50 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 >> 172.21.15.17:0/1081093352 conn(0x7f6de80d2ab0 msgr2=0x7f6de80c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.872+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 shutdown_connections 2023-08-09T12:52:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:54.873+0000 7f6deee6a640 1 -- 172.21.15.17:0/1081093352 wait complete. 2023-08-09T12:52:54.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:52:55.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.109+0000 7fce420ec640 1 Processor -- start 2023-08-09T12:52:55.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.109+0000 7fce420ec640 1 -- start start 2023-08-09T12:52:55.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce420ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce420ec640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fce3c0b2990 0x7fce3c0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce420ec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c0cfc20 con 0x7fce3c15cdc0 2023-08-09T12:52:55.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce420ec640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c0b2e00 con 0x7fce3c0b2990 2023-08-09T12:52:55.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce420ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c06ab40 con 0x7fce3c15d1a0 2023-08-09T12:52:55.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce3bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fce3c0b2990 0x7fce3c0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce3bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fce3c0b2990 0x7fce3c0d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50774/0 (socket says 172.21.15.17:50774) 2023-08-09T12:52:55.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce3bfff640 1 -- 172.21.15.17:0/567673128 learned_addr learned my addr 172.21.15.17:0/567673128 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:55.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.111+0000 7fce3affd640 1 --2- 172.21.15.17:0/567673128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.112+0000 7fce3bfff640 1 -- 172.21.15.17:0/567673128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 msgr2=0x7fce3c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:55.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.112+0000 7fce3bfff640 1 --2- 172.21.15.17:0/567673128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c0b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.112+0000 7fce3bfff640 1 -- 172.21.15.17:0/567673128 >> v1:172.21.15.142:6789/0 conn(0x7fce3c15cdc0 legacy=0x7fce3c0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:55.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.112+0000 7fce3bfff640 1 -- 172.21.15.17:0/567673128 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c06a2a0 con 0x7fce3c0b2990 2023-08-09T12:52:55.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.112+0000 7fce3affd640 1 --2- 172.21.15.17:0/567673128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c0b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:52:55.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.113+0000 7fce3bfff640 1 --2- 172.21.15.17:0/567673128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c0b2990 0x7fce3c0d0370 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fce34009870 tx=0x7fce3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d959da434ead1173 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:55.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.113+0000 7fce3a7fc640 1 -- 172.21.15.17:0/567673128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34031640 con 0x7fce3c0b2990 2023-08-09T12:52:55.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.113+0000 7fce3a7fc640 1 -- 172.21.15.17:0/567673128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce340317a0 con 0x7fce3c0b2990 2023-08-09T12:52:55.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.113+0000 7fce3a7fc640 1 -- 172.21.15.17:0/567673128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34031b30 con 0x7fce3c0b2990 2023-08-09T12:52:55.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.114+0000 7fce420ec640 1 -- 172.21.15.17:0/567673128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c0b2990 msgr2=0x7fce3c0d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.114+0000 7fce420ec640 1 --2- 172.21.15.17:0/567673128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c0b2990 0x7fce3c0d0370 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fce34009870 tx=0x7fce3402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.114+0000 7fce420ec640 1 -- 172.21.15.17:0/567673128 shutdown_connections 2023-08-09T12:52:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.114+0000 7fce420ec640 1 --2- 172.21.15.17:0/567673128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c0b2990 0x7fce3c0d0370 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.114+0000 7fce420ec640 1 --2- 172.21.15.17:0/567673128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c0b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.114+0000 7fce420ec640 1 -- 172.21.15.17:0/567673128 >> 172.21.15.17:0/567673128 conn(0x7fce3c06cf40 msgr2=0x7fce3c06d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.114+0000 7fce420ec640 1 -- 172.21.15.17:0/567673128 shutdown_connections 2023-08-09T12:52:55.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.114+0000 7fce420ec640 1 -- 172.21.15.17:0/567673128 wait complete. 2023-08-09T12:52:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.116+0000 7fce420ec640 1 Processor -- start 2023-08-09T12:52:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.116+0000 7fce420ec640 1 -- start start 2023-08-09T12:52:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce420ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c0b2990 0x7fce3c0c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce420ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c15cdc0 0x7fce3c1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce420ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce420ec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0c6390 con 0x7fce3c15cdc0 2023-08-09T12:52:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce420ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0c6d60 con 0x7fce3c0b2990 2023-08-09T12:52:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce420ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0c5780 con 0x7fce3c15d1a0 2023-08-09T12:52:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce3affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c15cdc0 0x7fce3c1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce3affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c15cdc0 0x7fce3c1f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50784/0 (socket says 172.21.15.17:50784) 2023-08-09T12:52:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce3affd640 1 -- 172.21.15.17:0/2733084610 learned_addr learned my addr 172.21.15.17:0/2733084610 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce3b7fe640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c0b2990 0x7fce3c0c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.117+0000 7fce3bfff640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce3affd640 1 -- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 msgr2=0x7fce3c15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce3affd640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c15b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce3affd640 1 -- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c0b2990 msgr2=0x7fce3c0c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce3affd640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c0b2990 0x7fce3c0c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce3affd640 1 -- 172.21.15.17:0/2733084610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340094d0 con 0x7fce3c15cdc0 2023-08-09T12:52:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce3bfff640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:52:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce3affd640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c15cdc0 0x7fce3c1f6630 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fce3000c7f0 tx=0x7fce3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce23fff640 1 -- 172.21.15.17:0/2733084610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30007820 con 0x7fce3c15cdc0 2023-08-09T12:52:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce23fff640 1 -- 172.21.15.17:0/2733084610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce30007980 con 0x7fce3c15cdc0 2023-08-09T12:52:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c0c5a60 con 0x7fce3c15cdc0 2023-08-09T12:52:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce23fff640 1 -- 172.21.15.17:0/2733084610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30007cf0 con 0x7fce3c15cdc0 2023-08-09T12:52:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.118+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c0c6020 con 0x7fce3c15cdc0 2023-08-09T12:52:55.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.120+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c0c6500 con 0x7fce3c15cdc0 2023-08-09T12:52:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.120+0000 7fce23fff640 1 -- 172.21.15.17:0/2733084610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce300113f0 con 0x7fce3c15cdc0 2023-08-09T12:52:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.121+0000 7fce23fff640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce2806a050 0x7fce2806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.122+0000 7fce23fff640 1 -- 172.21.15.17:0/2733084610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fce30088970 con 0x7fce3c15cdc0 2023-08-09T12:52:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.122+0000 7fce23fff640 1 -- 172.21.15.17:0/2733084610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fce28072260 con 0x7fce3c15cdc0 2023-08-09T12:52:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.122+0000 7fce3b7fe640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce2806a050 0x7fce2806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.123+0000 7fce3b7fe640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce2806a050 0x7fce2806c510 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fce2c005520 tx=0x7fce2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:55.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.125+0000 7fce23fff640 1 -- 172.21.15.17:0/2733084610 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fce30053f80 con 0x7fce3c15cdc0 2023-08-09T12:52:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.323+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce3c067a80 con 0x7fce3c15cdc0 2023-08-09T12:52:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.324+0000 7fce23fff640 1 -- 172.21.15.17:0/2733084610 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v179) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce3001f030 con 0x7fce3c15cdc0 2023-08-09T12:52:55.327 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:52:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.326+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce2806a050 msgr2=0x7fce2806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.326+0000 7fce420ec640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce2806a050 0x7fce2806c510 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fce2c005520 tx=0x7fce2c009040 comp rx=0 tx=0).stop 2023-08-09T12:52:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.326+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c15cdc0 msgr2=0x7fce3c1f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.326+0000 7fce420ec640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c15cdc0 0x7fce3c1f6630 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fce3000c7f0 tx=0x7fce3000ccb0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.327+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 shutdown_connections 2023-08-09T12:52:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.327+0000 7fce420ec640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce2806a050 0x7fce2806c510 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.327+0000 7fce420ec640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce3c15d1a0 0x7fce3c15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.327+0000 7fce420ec640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce3c15cdc0 0x7fce3c1f6630 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.327+0000 7fce420ec640 1 --2- 172.21.15.17:0/2733084610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c0b2990 0x7fce3c0c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.327+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 >> 172.21.15.17:0/2733084610 conn(0x7fce3c06cf40 msgr2=0x7fce3c0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:55.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.327+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 shutdown_connections 2023-08-09T12:52:55.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.327+0000 7fce420ec640 1 -- 172.21.15.17:0/2733084610 wait complete. 2023-08-09T12:52:55.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:52:55.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.586+0000 7fda71544640 1 Processor -- start 2023-08-09T12:52:55.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.586+0000 7fda71544640 1 -- start start 2023-08-09T12:52:55.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.587+0000 7fda71544640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda6c15ab40 0x7fda6c0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.587+0000 7fda71544640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0c9960 0x7fda6c0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.587+0000 7fda71544640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c0c8c30 con 0x7fda6c0b21c0 2023-08-09T12:52:55.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.587+0000 7fda71544640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c0cb9d0 con 0x7fda6c15ab40 2023-08-09T12:52:55.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.587+0000 7fda71544640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c0c8e80 con 0x7fda6c0c9960 2023-08-09T12:52:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.588+0000 7fda6bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda6c15ab40 0x7fda6c0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.588+0000 7fda6bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda6c15ab40 0x7fda6c0cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:48126/0 (socket says 172.21.15.17:48126) 2023-08-09T12:52:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.588+0000 7fda6bfff640 1 -- 172.21.15.17:0/2611324746 learned_addr learned my addr 172.21.15.17:0/2611324746 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.588+0000 7fda70d43640 1 --2- 172.21.15.17:0/2611324746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0c9960 0x7fda6c0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.589+0000 7fda6bfff640 1 -- 172.21.15.17:0/2611324746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0c9960 msgr2=0x7fda6c0c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:55.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.589+0000 7fda6bfff640 1 --2- 172.21.15.17:0/2611324746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0c9960 0x7fda6c0c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.589+0000 7fda6bfff640 1 -- 172.21.15.17:0/2611324746 >> v1:172.21.15.142:6789/0 conn(0x7fda6c0b21c0 legacy=0x7fda6c0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.589+0000 7fda6bfff640 1 -- 172.21.15.17:0/2611324746 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c0c9160 con 0x7fda6c15ab40 2023-08-09T12:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.590+0000 7fda6bfff640 1 --2- 172.21.15.17:0/2611324746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c15ab40 0x7fda6c0cb060 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009870 tx=0x7fda5c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68bc0dbb01645cbb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.591+0000 7fda6affd640 1 -- 172.21.15.17:0/2611324746 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c030840 con 0x7fda6c15ab40 2023-08-09T12:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.591+0000 7fda6affd640 1 -- 172.21.15.17:0/2611324746 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c0309a0 con 0x7fda6c15ab40 2023-08-09T12:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.591+0000 7fda6affd640 1 -- 172.21.15.17:0/2611324746 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c030d30 con 0x7fda6c15ab40 2023-08-09T12:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.592+0000 7fda71544640 1 -- 172.21.15.17:0/2611324746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c15ab40 msgr2=0x7fda6c0cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.592+0000 7fda71544640 1 --2- 172.21.15.17:0/2611324746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c15ab40 0x7fda6c0cb060 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009870 tx=0x7fda5c02b980 comp rx=0 tx=0).stop 2023-08-09T12:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.592+0000 7fda71544640 1 -- 172.21.15.17:0/2611324746 shutdown_connections 2023-08-09T12:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.592+0000 7fda71544640 1 --2- 172.21.15.17:0/2611324746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0c9960 0x7fda6c0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.592+0000 7fda71544640 1 --2- 172.21.15.17:0/2611324746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c15ab40 0x7fda6c0cb060 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.592+0000 7fda71544640 1 -- 172.21.15.17:0/2611324746 >> 172.21.15.17:0/2611324746 conn(0x7fda6c06abd0 msgr2=0x7fda6c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.592+0000 7fda71544640 1 -- 172.21.15.17:0/2611324746 shutdown_connections 2023-08-09T12:52:55.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.592+0000 7fda71544640 1 -- 172.21.15.17:0/2611324746 wait complete. 2023-08-09T12:52:55.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.594+0000 7fda71544640 1 Processor -- start 2023-08-09T12:52:55.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.594+0000 7fda71544640 1 -- start start 2023-08-09T12:52:55.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda71544640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6c0b21c0 0x7fda6c151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda71544640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c0c9960 0x7fda6c153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda71544640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c15ab40 0x7fda6c1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda71544640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c152c90 con 0x7fda6c0b21c0 2023-08-09T12:52:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda71544640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c06eec0 con 0x7fda6c0c9960 2023-08-09T12:52:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda71544640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c1526d0 con 0x7fda6c15ab40 2023-08-09T12:52:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6c0b21c0 0x7fda6c151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6c0b21c0 0x7fda6c151e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50794/0 (socket says 172.21.15.17:50794) 2023-08-09T12:52:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda6bfff640 1 -- 172.21.15.17:0/4273340939 learned_addr learned my addr 172.21.15.17:0/4273340939 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda6b7fe640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c0c9960 0x7fda6c153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.595+0000 7fda70d43640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c15ab40 0x7fda6c1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda6bfff640 1 -- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c15ab40 msgr2=0x7fda6c1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda6bfff640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c15ab40 0x7fda6c1543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda6bfff640 1 -- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c0c9960 msgr2=0x7fda6c153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda6bfff640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c0c9960 0x7fda6c153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda6bfff640 1 -- 172.21.15.17:0/4273340939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0094d0 con 0x7fda6c0b21c0 2023-08-09T12:52:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda6b7fe640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c0c9960 0x7fda6c153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:52:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda6bfff640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6c0b21c0 0x7fda6c151e80 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0090b0 tx=0x7fda5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda68ff9640 1 -- 172.21.15.17:0/4273340939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c039b50 con 0x7fda6c0b21c0 2023-08-09T12:52:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda68ff9640 1 -- 172.21.15.17:0/4273340939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c039cb0 con 0x7fda6c0b21c0 2023-08-09T12:52:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda68ff9640 1 -- 172.21.15.17:0/4273340939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c043630 con 0x7fda6c0b21c0 2023-08-09T12:52:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.596+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c0c29c0 con 0x7fda6c0b21c0 2023-08-09T12:52:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.597+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c06eb50 con 0x7fda6c0b21c0 2023-08-09T12:52:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.598+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c06e9b0 con 0x7fda6c0b21c0 2023-08-09T12:52:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.599+0000 7fda68ff9640 1 -- 172.21.15.17:0/4273340939 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda5c02f390 con 0x7fda6c0b21c0 2023-08-09T12:52:55.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.599+0000 7fda68ff9640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5806a050 0x7fda5806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:55.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.600+0000 7fda68ff9640 1 -- 172.21.15.17:0/4273340939 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fda5c0aa840 con 0x7fda6c0b21c0 2023-08-09T12:52:55.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.600+0000 7fda68ff9640 1 -- 172.21.15.17:0/4273340939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fda58072260 con 0x7fda6c0b21c0 2023-08-09T12:52:55.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.600+0000 7fda6b7fe640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5806a050 0x7fda5806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:55.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.601+0000 7fda6b7fe640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5806a050 0x7fda5806c510 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0b11d0 tx=0x7fda60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:55.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.604+0000 7fda68ff9640 1 -- 172.21.15.17:0/4273340939 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fda6c06e9b0 con 0x7fda6c0b21c0 2023-08-09T12:52:55.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.789+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda6c06e9b0 con 0x7fda6c0b21c0 2023-08-09T12:52:55.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.790+0000 7fda68ff9640 1 -- 172.21.15.17:0/4273340939 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v179) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda6c06e9b0 con 0x7fda6c0b21c0 2023-08-09T12:52:55.794 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:52:55.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5806a050 msgr2=0x7fda5806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5806a050 0x7fda5806c510 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0b11d0 tx=0x7fda60009040 comp rx=0 tx=0).stop 2023-08-09T12:52:55.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6c0b21c0 msgr2=0x7fda6c151e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6c0b21c0 0x7fda6c151e80 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0090b0 tx=0x7fda5c004730 comp rx=0 tx=0).stop 2023-08-09T12:52:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 shutdown_connections 2023-08-09T12:52:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fda5806a050 0x7fda5806c510 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c15ab40 0x7fda6c1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c0c9960 0x7fda6c153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 --2- 172.21.15.17:0/4273340939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda6c0b21c0 0x7fda6c151e80 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 >> 172.21.15.17:0/4273340939 conn(0x7fda6c06abd0 msgr2=0x7fda6c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 shutdown_connections 2023-08-09T12:52:55.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:55.793+0000 7fda71544640 1 -- 172.21.15.17:0/4273340939 wait complete. 2023-08-09T12:52:55.815 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:52:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.038+0000 7f56404b8640 1 Processor -- start 2023-08-09T12:52:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.038+0000 7f56404b8640 1 -- start start 2023-08-09T12:52:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.039+0000 7f56404b8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.039+0000 7f56404b8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f56380cd940 0x7f56380699f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.039+0000 7f56404b8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56380cdda0 con 0x7f5638069f30 2023-08-09T12:52:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.039+0000 7f56404b8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56380d0470 con 0x7f56380cd940 2023-08-09T12:52:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.039+0000 7f56404b8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380d18a0 con 0x7f56380ccd30 2023-08-09T12:52:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.040+0000 7f563e254640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.040+0000 7f563da53640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f56380cd940 0x7f56380699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.040+0000 7f563e254640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:56258/0 (socket says 172.21.15.17:56258) 2023-08-09T12:52:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.040+0000 7f563e254640 1 -- 172.21.15.17:0/723601588 learned_addr learned my addr 172.21.15.17:0/723601588 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.041+0000 7f563e254640 1 -- 172.21.15.17:0/723601588 >> v2:172.21.15.142:3300/0 conn(0x7f56380cd940 msgr2=0x7f56380699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.041+0000 7f563e254640 1 --2- 172.21.15.17:0/723601588 >> v2:172.21.15.142:3300/0 conn(0x7f56380cd940 0x7f56380699f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.041+0000 7f563e254640 1 -- 172.21.15.17:0/723601588 >> v1:172.21.15.142:6789/0 conn(0x7f5638069f30 legacy=0x7f5638160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.041+0000 7f563e254640 1 -- 172.21.15.17:0/723601588 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638160830 con 0x7f56380ccd30 2023-08-09T12:52:56.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.043+0000 7f563e254640 1 --2- 172.21.15.17:0/723601588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380cd400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5628009e50 tx=0x7f562802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c9f60625465a994 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.044+0000 7f563d252640 1 -- 172.21.15.17:0/723601588 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562802cb00 con 0x7f56380ccd30 2023-08-09T12:52:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.044+0000 7f563d252640 1 -- 172.21.15.17:0/723601588 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562802cc60 con 0x7f56380ccd30 2023-08-09T12:52:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.044+0000 7f563d252640 1 -- 172.21.15.17:0/723601588 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280343f0 con 0x7f56380ccd30 2023-08-09T12:52:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.044+0000 7f56404b8640 1 -- 172.21.15.17:0/723601588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 msgr2=0x7f56380cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.044+0000 7f56404b8640 1 --2- 172.21.15.17:0/723601588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380cd400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5628009e50 tx=0x7f562802bf60 comp rx=0 tx=0).stop 2023-08-09T12:52:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.044+0000 7f56404b8640 1 -- 172.21.15.17:0/723601588 shutdown_connections 2023-08-09T12:52:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.045+0000 7f56404b8640 1 --2- 172.21.15.17:0/723601588 >> v2:172.21.15.142:3300/0 conn(0x7f56380cd940 0x7f56380699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.045+0000 7f56404b8640 1 --2- 172.21.15.17:0/723601588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380cd400 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.045+0000 7f56404b8640 1 -- 172.21.15.17:0/723601588 >> 172.21.15.17:0/723601588 conn(0x7f563806b9d0 msgr2=0x7f563806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:56.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.045+0000 7f56404b8640 1 -- 172.21.15.17:0/723601588 shutdown_connections 2023-08-09T12:52:56.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.045+0000 7f56404b8640 1 -- 172.21.15.17:0/723601588 wait complete. 2023-08-09T12:52:56.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.046+0000 7f56404b8640 1 Processor -- start 2023-08-09T12:52:56.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.047+0000 7f56404b8640 1 -- start start 2023-08-09T12:52:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f56404b8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638069f30 0x7f563815d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f56404b8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f56404b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56380cd940 0x7f56380c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f56404b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380ae6c0 con 0x7f56380cd940 2023-08-09T12:52:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f56404b8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c6d40 con 0x7f5638069f30 2023-08-09T12:52:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f56404b8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380b0030 con 0x7f56380ccd30 2023-08-09T12:52:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f563ea55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56380cd940 0x7f56380c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f563ea55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56380cd940 0x7f56380c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50798/0 (socket says 172.21.15.17:50798) 2023-08-09T12:52:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f563ea55640 1 -- 172.21.15.17:0/2617156578 learned_addr learned my addr 172.21.15.17:0/2617156578 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f563da53640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.048+0000 7f563e254640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638069f30 0x7f563815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f563ea55640 1 -- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 msgr2=0x7f56380aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f563ea55640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f563ea55640 1 -- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638069f30 msgr2=0x7f563815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f563ea55640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638069f30 0x7f563815d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f563ea55640 1 -- 172.21.15.17:0/2617156578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628009b30 con 0x7f56380cd940 2023-08-09T12:52:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f563ea55640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56380cd940 0x7f56380c4500 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f5630001eb0 tx=0x7f563000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f5636ffd640 1 -- 172.21.15.17:0/2617156578 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300052d0 con 0x7f56380cd940 2023-08-09T12:52:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f5636ffd640 1 -- 172.21.15.17:0/2617156578 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630005430 con 0x7f56380cd940 2023-08-09T12:52:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f5636ffd640 1 -- 172.21.15.17:0/2617156578 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630003810 con 0x7f56380cd940 2023-08-09T12:52:56.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.049+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56380ada40 con 0x7f56380cd940 2023-08-09T12:52:56.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.050+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56380ae2e0 con 0x7f56380cd940 2023-08-09T12:52:56.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.051+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56380ae800 con 0x7f56380cd940 2023-08-09T12:52:56.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.052+0000 7f5636ffd640 1 -- 172.21.15.17:0/2617156578 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5630003970 con 0x7f56380cd940 2023-08-09T12:52:56.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.052+0000 7f5636ffd640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f562406a050 0x7f562406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.053+0000 7f5636ffd640 1 -- 172.21.15.17:0/2617156578 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5630087c30 con 0x7f56380cd940 2023-08-09T12:52:56.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.053+0000 7f5636ffd640 1 -- 172.21.15.17:0/2617156578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f56240722e0 con 0x7f56380cd940 2023-08-09T12:52:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.053+0000 7f563e254640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f562406a050 0x7f562406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.054+0000 7f563e254640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f562406a050 0x7f562406c510 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5628035000 tx=0x7f5628030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:56.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.059+0000 7f5636ffd640 1 -- 172.21.15.17:0/2617156578 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f56380ae800 con 0x7f56380cd940 2023-08-09T12:52:56.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.255+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56380ae800 con 0x7f56380cd940 2023-08-09T12:52:56.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.256+0000 7f5636ffd640 1 -- 172.21.15.17:0/2617156578 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v179) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56380ae800 con 0x7f56380cd940 2023-08-09T12:52:56.259 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:52:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.259+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f562406a050 msgr2=0x7f562406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.259+0000 7f56404b8640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f562406a050 0x7f562406c510 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5628035000 tx=0x7f5628030000 comp rx=0 tx=0).stop 2023-08-09T12:52:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56380cd940 msgr2=0x7f56380c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56380cd940 0x7f56380c4500 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f5630001eb0 tx=0x7f563000c890 comp rx=0 tx=0).stop 2023-08-09T12:52:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 shutdown_connections 2023-08-09T12:52:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f562406a050 0x7f562406c510 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56380cd940 0x7f56380c4500 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380ccd30 0x7f56380aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 --2- 172.21.15.17:0/2617156578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638069f30 0x7f563815d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 >> 172.21.15.17:0/2617156578 conn(0x7f563806b9d0 msgr2=0x7f563806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 shutdown_connections 2023-08-09T12:52:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.260+0000 7f56404b8640 1 -- 172.21.15.17:0/2617156578 wait complete. 2023-08-09T12:52:56.283 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:52:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.504+0000 7fd0b4b42640 1 Processor -- start 2023-08-09T12:52:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.504+0000 7fd0b4b42640 1 -- start start 2023-08-09T12:52:56.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0b4b42640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd0b015ce90 0x7fd0b01616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0b4b42640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0b00b6000 0x7fd0b00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0b4b42640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b00b6460 con 0x7fd0b00d29d0 2023-08-09T12:52:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0b4b42640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b00cda40 con 0x7fd0b00b6000 2023-08-09T12:52:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0b4b42640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b00cdd10 con 0x7fd0b015ce90 2023-08-09T12:52:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0add9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0b00b6000 0x7fd0b00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0add9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0b00b6000 0x7fd0b00cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50814/0 (socket says 172.21.15.17:50814) 2023-08-09T12:52:56.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0add9b640 1 -- 172.21.15.17:0/1082813976 learned_addr learned my addr 172.21.15.17:0/1082813976 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:56.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.506+0000 7fd0ae59c640 1 --2- 172.21.15.17:0/1082813976 >> v2:172.21.15.142:3300/0 conn(0x7fd0b015ce90 0x7fd0b01616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.507+0000 7fd0add9b640 1 -- 172.21.15.17:0/1082813976 >> v2:172.21.15.142:3300/0 conn(0x7fd0b015ce90 msgr2=0x7fd0b01616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:56.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.507+0000 7fd0add9b640 1 --2- 172.21.15.17:0/1082813976 >> v2:172.21.15.142:3300/0 conn(0x7fd0b015ce90 0x7fd0b01616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.507+0000 7fd0add9b640 1 -- 172.21.15.17:0/1082813976 >> v1:172.21.15.142:6789/0 conn(0x7fd0b00d29d0 legacy=0x7fd0b00d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:56.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.507+0000 7fd0add9b640 1 -- 172.21.15.17:0/1082813976 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00cdff0 con 0x7fd0b00b6000 2023-08-09T12:52:56.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.508+0000 7fd0add9b640 1 --2- 172.21.15.17:0/1082813976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b00cd500 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00d0690 tx=0x7fd0a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8a2d5bf329b04 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:56.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.508+0000 7fd0ad59a640 1 -- 172.21.15.17:0/1082813976 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4031870 con 0x7fd0b00b6000 2023-08-09T12:52:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.508+0000 7fd0ad59a640 1 -- 172.21.15.17:0/1082813976 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a40319d0 con 0x7fd0b00b6000 2023-08-09T12:52:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.508+0000 7fd0ad59a640 1 -- 172.21.15.17:0/1082813976 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4031d60 con 0x7fd0b00b6000 2023-08-09T12:52:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.509+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1082813976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 msgr2=0x7fd0b00cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.509+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1082813976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b00cd500 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00d0690 tx=0x7fd0a402b910 comp rx=0 tx=0).stop 2023-08-09T12:52:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.509+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1082813976 shutdown_connections 2023-08-09T12:52:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.509+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1082813976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b00cd500 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.509+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1082813976 >> v2:172.21.15.142:3300/0 conn(0x7fd0b015ce90 0x7fd0b01616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.509+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1082813976 >> 172.21.15.17:0/1082813976 conn(0x7fd0b006fde0 msgr2=0x7fd0b00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:56.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.509+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1082813976 shutdown_connections 2023-08-09T12:52:56.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.509+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1082813976 wait complete. 2023-08-09T12:52:56.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.511+0000 7fd0b4b42640 1 Processor -- start 2023-08-09T12:52:56.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.511+0000 7fd0b4b42640 1 -- start start 2023-08-09T12:52:56.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0b4b42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b0150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0b4b42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b00d29d0 0x7fd0b00cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0b4b42640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b015ce90 0x7fd0b00d2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0b4b42640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b015da60 con 0x7fd0b00b6000 2023-08-09T12:52:56.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0b4b42640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b0150ec0 con 0x7fd0b015ce90 2023-08-09T12:52:56.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0b4b42640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01f6340 con 0x7fd0b00d29d0 2023-08-09T12:52:56.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b0150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50826/0 (socket says 172.21.15.17:50826) 2023-08-09T12:52:56.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.512+0000 7fd0ae59c640 1 -- 172.21.15.17:0/1935111341 learned_addr learned my addr 172.21.15.17:0/1935111341 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:56.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd0ae59c640 1 -- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b00d29d0 msgr2=0x7fd0b00cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd0ae59c640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b00d29d0 0x7fd0b00cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd0ae59c640 1 -- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b015ce90 msgr2=0x7fd0b00d2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd0ae59c640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b015ce90 0x7fd0b00d2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd0ae59c640 1 -- 172.21.15.17:0/1935111341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40094d0 con 0x7fd0b00b6000 2023-08-09T12:52:56.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd0ae59c640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b0150980 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007e70 tx=0x7fd0a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:56.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd09effd640 1 -- 172.21.15.17:0/1935111341 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0014620 con 0x7fd0b00b6000 2023-08-09T12:52:56.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd09effd640 1 -- 172.21.15.17:0/1935111341 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a0014780 con 0x7fd0b00b6000 2023-08-09T12:52:56.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd09effd640 1 -- 172.21.15.17:0/1935111341 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0014b30 con 0x7fd0b00b6000 2023-08-09T12:52:56.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.513+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b00cbda0 con 0x7fd0b00b6000 2023-08-09T12:52:56.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.514+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b015d680 con 0x7fd0b00b6000 2023-08-09T12:52:56.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.515+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b0067a80 con 0x7fd0b00b6000 2023-08-09T12:52:56.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.516+0000 7fd09effd640 1 -- 172.21.15.17:0/1935111341 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd0a0014c90 con 0x7fd0b00b6000 2023-08-09T12:52:56.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.516+0000 7fd09effd640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd09006a050 0x7fd09006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:56.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.517+0000 7fd09effd640 1 -- 172.21.15.17:0/1935111341 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd0a0088f50 con 0x7fd0b00b6000 2023-08-09T12:52:56.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.517+0000 7fd09effd640 1 -- 172.21.15.17:0/1935111341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fd090072260 con 0x7fd0b00b6000 2023-08-09T12:52:56.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.517+0000 7fd0add9b640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd09006a050 0x7fd09006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:56.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.518+0000 7fd0add9b640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd09006a050 0x7fd09006c510 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4036000 tx=0x7fd0a4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:56.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.524+0000 7fd09effd640 1 -- 172.21.15.17:0/1935111341 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd0a0058080 con 0x7fd0b00b6000 2023-08-09T12:52:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.730+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd0b00ce2a0 con 0x7fd0b00b6000 2023-08-09T12:52:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.731+0000 7fd09effd640 1 -- 172.21.15.17:0/1935111341 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v179) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd0a0057c10 con 0x7fd0b00b6000 2023-08-09T12:52:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:52:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd09006a050 msgr2=0x7fd09006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd09006a050 0x7fd09006c510 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4036000 tx=0x7fd0a4030000 comp rx=0 tx=0).stop 2023-08-09T12:52:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 msgr2=0x7fd0b0150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b0150980 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007e70 tx=0x7fd0a000e4b0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 shutdown_connections 2023-08-09T12:52:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd09006a050 0x7fd09006c510 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b015ce90 0x7fd0b00d2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b00d29d0 0x7fd0b00cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 --2- 172.21.15.17:0/1935111341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b00b6000 0x7fd0b0150980 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:56.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 >> 172.21.15.17:0/1935111341 conn(0x7fd0b006fde0 msgr2=0x7fd0b0151840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:56.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 shutdown_connections 2023-08-09T12:52:56.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:56.734+0000 7fd0b4b42640 1 -- 172.21.15.17:0/1935111341 wait complete. 2023-08-09T12:52:56.758 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:52:56.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:52:56.759 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:52:56.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:52:56.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:52:56.890 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:52:56.942 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:52:56.943 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:52:57.002 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:52:57.002 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:52:57.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:52:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.299+0000 7f2381b9f640 1 Processor -- start 2023-08-09T12:52:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.300+0000 7f2381b9f640 1 -- start start 2023-08-09T12:52:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.301+0000 7f2381b9f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c1466b0 0x7f237c15de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.301+0000 7f2381b9f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f237c0cffe0 0x7f237c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.301+0000 7f2381b9f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f237c0d2a70 0x7f237c0d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.301+0000 7f2381b9f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c15e350 con 0x7f237c0d2a70 2023-08-09T12:52:57.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.301+0000 7f2381b9f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c15d980 con 0x7f237c0cffe0 2023-08-09T12:52:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.301+0000 7f2381b9f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0d3440 con 0x7f237c1466b0 2023-08-09T12:52:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.302+0000 7f237bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f237c0d2a70 0x7f237c0d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.302+0000 7f237bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f237c0d2a70 0x7f237c0d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50836/0 (socket says 172.21.15.17:50836) 2023-08-09T12:52:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.302+0000 7f237bfff640 1 -- 172.21.15.17:0/2515766200 learned_addr learned my addr 172.21.15.17:0/2515766200 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.302+0000 7f237affd640 1 --2- 172.21.15.17:0/2515766200 >> v2:172.21.15.142:3300/0 conn(0x7f237c0cffe0 0x7f237c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.302+0000 7f237b7fe640 1 --2- 172.21.15.17:0/2515766200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c1466b0 0x7f237c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.303+0000 7f237bfff640 1 -- 172.21.15.17:0/2515766200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c1466b0 msgr2=0x7f237c15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:57.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.303+0000 7f237bfff640 1 --2- 172.21.15.17:0/2515766200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c1466b0 0x7f237c15de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.303+0000 7f237bfff640 1 -- 172.21.15.17:0/2515766200 >> v2:172.21.15.142:3300/0 conn(0x7f237c0cffe0 msgr2=0x7f237c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:57.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.303+0000 7f237bfff640 1 --2- 172.21.15.17:0/2515766200 >> v2:172.21.15.142:3300/0 conn(0x7f237c0cffe0 0x7f237c0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.303+0000 7f237bfff640 1 -- 172.21.15.17:0/2515766200 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c146a90 con 0x7f237c0d2a70 2023-08-09T12:52:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.304+0000 7f237bfff640 1 --2- 172.21.15.17:0/2515766200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0d2a70 0x7f237c0d2f00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f237c0d3680 tx=0x7f237402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b6fc98722b73a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.304+0000 7f237a7fc640 1 -- 172.21.15.17:0/2515766200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237402c9f0 con 0x7f237c0d2a70 2023-08-09T12:52:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.304+0000 7f237a7fc640 1 -- 172.21.15.17:0/2515766200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237402cb50 con 0x7f237c0d2a70 2023-08-09T12:52:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.304+0000 7f237a7fc640 1 -- 172.21.15.17:0/2515766200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23740343f0 con 0x7f237c0d2a70 2023-08-09T12:52:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 -- 172.21.15.17:0/2515766200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0d2a70 msgr2=0x7f237c0d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 --2- 172.21.15.17:0/2515766200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0d2a70 0x7f237c0d2f00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f237c0d3680 tx=0x7f237402be50 comp rx=0 tx=0).stop 2023-08-09T12:52:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 -- 172.21.15.17:0/2515766200 shutdown_connections 2023-08-09T12:52:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 --2- 172.21.15.17:0/2515766200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0d2a70 0x7f237c0d2f00 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 --2- 172.21.15.17:0/2515766200 >> v2:172.21.15.142:3300/0 conn(0x7f237c0cffe0 0x7f237c0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 --2- 172.21.15.17:0/2515766200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c1466b0 0x7f237c15de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 -- 172.21.15.17:0/2515766200 >> 172.21.15.17:0/2515766200 conn(0x7f237c0b8340 msgr2=0x7f237c0697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 -- 172.21.15.17:0/2515766200 shutdown_connections 2023-08-09T12:52:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.305+0000 7f2381b9f640 1 -- 172.21.15.17:0/2515766200 wait complete. 2023-08-09T12:52:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.308+0000 7f2381b9f640 1 Processor -- start 2023-08-09T12:52:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.308+0000 7f2381b9f640 1 -- start start 2023-08-09T12:52:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.309+0000 7f2381b9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0cffe0 0x7f237c13b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.309+0000 7f2381b9f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c0d2a70 0x7f237c13aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.309+0000 7f2381b9f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c1466b0 0x7f237c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.309+0000 7f2381b9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c13aff0 con 0x7f237c0cffe0 2023-08-09T12:52:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.309+0000 7f2381b9f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c14f100 con 0x7f237c1466b0 2023-08-09T12:52:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.309+0000 7f2381b9f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c1401d0 con 0x7f237c0d2a70 2023-08-09T12:52:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0cffe0 0x7f237c13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0cffe0 0x7f237c13b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50844/0 (socket says 172.21.15.17:50844) 2023-08-09T12:52:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237b7fe640 1 -- 172.21.15.17:0/3355059198 learned_addr learned my addr 172.21.15.17:0/3355059198 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237affd640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c0d2a70 0x7f237c13aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237b7fe640 1 -- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c0d2a70 msgr2=0x7f237c13aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237b7fe640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c0d2a70 0x7f237c13aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237b7fe640 1 -- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c1466b0 msgr2=0x7f237c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237b7fe640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c1466b0 0x7f237c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237b7fe640 1 -- 172.21.15.17:0/3355059198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2374009b30 con 0x7f237c0cffe0 2023-08-09T12:52:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.310+0000 7f237affd640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c0d2a70 0x7f237c13aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:52:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.311+0000 7f237b7fe640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0cffe0 0x7f237c13b750 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d800 tx=0x7f236c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:57.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.311+0000 7f2363fff640 1 -- 172.21.15.17:0/3355059198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00b6c0 con 0x7f237c0cffe0 2023-08-09T12:52:57.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.311+0000 7f2363fff640 1 -- 172.21.15.17:0/3355059198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c00b820 con 0x7f237c0cffe0 2023-08-09T12:52:57.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.311+0000 7f2363fff640 1 -- 172.21.15.17:0/3355059198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00bbd0 con 0x7f237c0cffe0 2023-08-09T12:52:57.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.311+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c140d30 con 0x7f237c0cffe0 2023-08-09T12:52:57.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.311+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c13be10 con 0x7f237c0cffe0 2023-08-09T12:52:57.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.312+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c067a80 con 0x7f237c0cffe0 2023-08-09T12:52:57.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.313+0000 7f2363fff640 1 -- 172.21.15.17:0/3355059198 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f236c00bd30 con 0x7f237c0cffe0 2023-08-09T12:52:57.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.315+0000 7f2363fff640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f236806a050 0x7f236806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.315+0000 7f2363fff640 1 -- 172.21.15.17:0/3355059198 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f236c088be0 con 0x7f237c0cffe0 2023-08-09T12:52:57.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.315+0000 7f2363fff640 1 -- 172.21.15.17:0/3355059198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f2368072260 con 0x7f237c0cffe0 2023-08-09T12:52:57.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.315+0000 7f237affd640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f236806a050 0x7f236806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.316+0000 7f237affd640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f236806a050 0x7f236806c510 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f237c1f5da0 tx=0x7f2370008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:57.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.319+0000 7f2363fff640 1 -- 172.21.15.17:0/3355059198 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f236c0541f0 con 0x7f237c0cffe0 2023-08-09T12:52:57.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.510+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f237c0b5f50 con 0x7f237c0cffe0 2023-08-09T12:52:57.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.512+0000 7f2363fff640 1 -- 172.21.15.17:0/3355059198 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+18463 (secure 0 0 0) 0x7f236c057810 con 0x7f237c0cffe0 2023-08-09T12:52:57.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:52:57.516 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":179,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:52:33.944618+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:51:31.771781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-09T12:51:32.371993+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:52:57.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f236806a050 msgr2=0x7f236806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f236806a050 0x7f236806c510 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f237c1f5da0 tx=0x7f2370008040 comp rx=0 tx=0).stop 2023-08-09T12:52:57.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0cffe0 msgr2=0x7f237c13b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0cffe0 0x7f237c13b750 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d800 tx=0x7f236c00dcc0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 shutdown_connections 2023-08-09T12:52:57.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f236806a050 0x7f236806c510 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c1466b0 0x7f237c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f237c0d2a70 0x7f237c13aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 --2- 172.21.15.17:0/3355059198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f237c0cffe0 0x7f237c13b750 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 >> 172.21.15.17:0/3355059198 conn(0x7f237c0b8340 msgr2=0x7f237c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:57.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 shutdown_connections 2023-08-09T12:52:57.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.514+0000 7f2381b9f640 1 -- 172.21.15.17:0/3355059198 wait complete. 2023-08-09T12:52:57.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:51:31.771781+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:51:32.371993+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:52:57.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:52:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.765+0000 7f6f3bc5e640 1 Processor -- start 2023-08-09T12:52:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.765+0000 7f6f3bc5e640 1 -- start start 2023-08-09T12:52:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.767+0000 7f6f3bc5e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f34164f50 0x7f6f340cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.767+0000 7f6f3bc5e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6f340c1980 0x7f6f34165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.767+0000 7f6f3bc5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f34165870 0x7f6f340c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.767+0000 7f6f3bc5e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340cd520 con 0x7f6f340c1980 2023-08-09T12:52:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.767+0000 7f6f3bc5e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340cc630 con 0x7f6f34164f50 2023-08-09T12:52:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.767+0000 7f6f3bc5e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340cc910 con 0x7f6f34165870 2023-08-09T12:52:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f391f9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6f340c1980 0x7f6f34165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f391f9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6f340c1980 0x7f6f34165330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50846/0 (socket says 172.21.15.17:50846) 2023-08-09T12:52:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f391f9640 1 -- 172.21.15.17:0/3763816961 learned_addr learned my addr 172.21.15.17:0/3763816961 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f399fa640 1 --2- 172.21.15.17:0/3763816961 >> v2:172.21.15.142:3300/0 conn(0x7f6f34164f50 0x7f6f340cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f3a1fb640 1 --2- 172.21.15.17:0/3763816961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f34165870 0x7f6f340c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f391f9640 1 -- 172.21.15.17:0/3763816961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f34165870 msgr2=0x7f6f340c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f391f9640 1 --2- 172.21.15.17:0/3763816961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f34165870 0x7f6f340c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f391f9640 1 -- 172.21.15.17:0/3763816961 >> v2:172.21.15.142:3300/0 conn(0x7f6f34164f50 msgr2=0x7f6f340cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f391f9640 1 --2- 172.21.15.17:0/3763816961 >> v2:172.21.15.142:3300/0 conn(0x7f6f34164f50 0x7f6f340cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.768+0000 7f6f391f9640 1 -- 172.21.15.17:0/3763816961 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340ccbf0 con 0x7f6f340c1980 2023-08-09T12:52:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.769+0000 7f6f391f9640 1 --2- 172.21.15.17:0/3763816961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f340c1980 0x7f6f34165330 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f6f340ce4b0 tx=0x7f6f2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4055a5c96c990fb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.770+0000 7f6f389f8640 1 -- 172.21.15.17:0/3763816961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24004230 con 0x7f6f340c1980 2023-08-09T12:52:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.770+0000 7f6f389f8640 1 -- 172.21.15.17:0/3763816961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24004390 con 0x7f6f340c1980 2023-08-09T12:52:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.770+0000 7f6f389f8640 1 -- 172.21.15.17:0/3763816961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24003810 con 0x7f6f340c1980 2023-08-09T12:52:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.770+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3763816961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f340c1980 msgr2=0x7f6f34165330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.770+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3763816961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f340c1980 0x7f6f34165330 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f6f340ce4b0 tx=0x7f6f2402b8f0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.771+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3763816961 shutdown_connections 2023-08-09T12:52:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.771+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3763816961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f34165870 0x7f6f340c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.771+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3763816961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f340c1980 0x7f6f34165330 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.771+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3763816961 >> v2:172.21.15.142:3300/0 conn(0x7f6f34164f50 0x7f6f340cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.771+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3763816961 >> 172.21.15.17:0/3763816961 conn(0x7f6f340cb1b0 msgr2=0x7f6f340cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.771+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3763816961 shutdown_connections 2023-08-09T12:52:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.771+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3763816961 wait complete. 2023-08-09T12:52:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.772+0000 7f6f3bc5e640 1 Processor -- start 2023-08-09T12:52:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.773+0000 7f6f3bc5e640 1 -- start start 2023-08-09T12:52:57.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f3bc5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f340c1980 0x7f6f3406a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f3bc5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f34164f50 0x7f6f34160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f3bc5e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34165870 0x7f6f34160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f3bc5e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340c3a30 con 0x7f6f34164f50 2023-08-09T12:52:57.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f3bc5e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3406ae70 con 0x7f6f34165870 2023-08-09T12:52:57.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f3bc5e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340c3cd0 con 0x7f6f340c1980 2023-08-09T12:52:57.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f391f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f34164f50 0x7f6f34160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f391f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f34164f50 0x7f6f34160890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50860/0 (socket says 172.21.15.17:50860) 2023-08-09T12:52:57.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f391f9640 1 -- 172.21.15.17:0/3172079291 learned_addr learned my addr 172.21.15.17:0/3172079291 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:57.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f399fa640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f340c1980 0x7f6f3406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.774+0000 7f6f3a1fb640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34165870 0x7f6f34160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f391f9640 1 -- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f340c1980 msgr2=0x7f6f3406a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f391f9640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f340c1980 0x7f6f3406a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f391f9640 1 -- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34165870 msgr2=0x7f6f34160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f391f9640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34165870 0x7f6f34160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f391f9640 1 -- 172.21.15.17:0/3172079291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24009460 con 0x7f6f34164f50 2023-08-09T12:52:57.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f3a1fb640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34165870 0x7f6f34160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:52:57.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f391f9640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f34164f50 0x7f6f34160890 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f6f24000c00 tx=0x7f6f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:57.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f2a7fc640 1 -- 172.21.15.17:0/3172079291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24003e50 con 0x7f6f34164f50 2023-08-09T12:52:57.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f2a7fc640 1 -- 172.21.15.17:0/3172079291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24004500 con 0x7f6f34164f50 2023-08-09T12:52:57.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f2a7fc640 1 -- 172.21.15.17:0/3172079291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24006280 con 0x7f6f34164f50 2023-08-09T12:52:57.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f340c3fb0 con 0x7f6f34164f50 2023-08-09T12:52:57.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.775+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3406aad0 con 0x7f6f34164f50 2023-08-09T12:52:57.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.777+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f340c41c0 con 0x7f6f34164f50 2023-08-09T12:52:57.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.777+0000 7f6f2a7fc640 1 -- 172.21.15.17:0/3172079291 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f2402f050 con 0x7f6f34164f50 2023-08-09T12:52:57.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.779+0000 7f6f2a7fc640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1806a050 0x7f6f1806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:57.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.779+0000 7f6f2a7fc640 1 -- 172.21.15.17:0/3172079291 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6f240aa8f0 con 0x7f6f34164f50 2023-08-09T12:52:57.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.779+0000 7f6f2a7fc640 1 -- 172.21.15.17:0/3172079291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f6f18072260 con 0x7f6f34164f50 2023-08-09T12:52:57.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.780+0000 7f6f399fa640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1806a050 0x7f6f1806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:57.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.781+0000 7f6f399fa640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1806a050 0x7f6f1806c510 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6f30006fd0 tx=0x7f6f30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:57.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.784+0000 7f6f2a7fc640 1 -- 172.21.15.17:0/3172079291 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6f24075f90 con 0x7f6f34164f50 2023-08-09T12:52:57.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.978+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f340affd0 con 0x7f6f34164f50 2023-08-09T12:52:57.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.979+0000 7f6f2a7fc640 1 -- 172.21.15.17:0/3172079291 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f2403f0a0 con 0x7f6f34164f50 2023-08-09T12:52:57.983 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:52:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1806a050 msgr2=0x7f6f1806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1806a050 0x7f6f1806c510 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6f30006fd0 tx=0x7f6f30008040 comp rx=0 tx=0).stop 2023-08-09T12:52:57.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f34164f50 msgr2=0x7f6f34160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:57.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f34164f50 0x7f6f34160890 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f6f24000c00 tx=0x7f6f240046c0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 shutdown_connections 2023-08-09T12:52:57.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6f1806a050 0x7f6f1806c510 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34165870 0x7f6f34160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f34164f50 0x7f6f34160890 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 --2- 172.21.15.17:0/3172079291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f340c1980 0x7f6f3406a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:57.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.982+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 >> 172.21.15.17:0/3172079291 conn(0x7f6f340cb1b0 msgr2=0x7f6f340cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:57.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.983+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 shutdown_connections 2023-08-09T12:52:57.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:57.983+0000 7f6f3bc5e640 1 -- 172.21.15.17:0/3172079291 wait complete. 2023-08-09T12:52:58.006 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:52:58.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.230+0000 7fe9ddaad640 1 Processor -- start 2023-08-09T12:52:58.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.230+0000 7fe9ddaad640 1 -- start start 2023-08-09T12:52:58.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.232+0000 7fe9ddaad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9d80ca710 0x7fe9d815e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.232+0000 7fe9ddaad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8072f60 0x7fe9d8160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.232+0000 7fe9ddaad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d806af90 con 0x7fe9d8160b30 2023-08-09T12:52:58.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.232+0000 7fe9ddaad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d81616a0 con 0x7fe9d80ca710 2023-08-09T12:52:58.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.232+0000 7fe9ddaad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8161980 con 0x7fe9d8072f60 2023-08-09T12:52:58.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.233+0000 7fe9d7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8072f60 0x7fe9d8160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.233+0000 7fe9ceffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe9d8160b30 0x7fe9d8072850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:39434/0 (socket says 172.21.15.17:39434) 2023-08-09T12:52:58.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.233+0000 7fe9ceffd640 1 -- 172.21.15.17:0/100609152 learned_addr learned my addr 172.21.15.17:0/100609152 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:52:58.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.233+0000 7fe9d77fe640 1 --2- 172.21.15.17:0/100609152 >> v2:172.21.15.142:3300/0 conn(0x7fe9d80ca710 0x7fe9d815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.233+0000 7fe9d6ffd640 1 -- 172.21.15.17:0/100609152 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891007964 0 0) 0x7fe9d806af90 con 0x7fe9d8160b30 2023-08-09T12:52:58.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.233+0000 7fe9d6ffd640 1 -- 172.21.15.17:0/100609152 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c4003520 con 0x7fe9d8160b30 2023-08-09T12:52:58.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.234+0000 7fe9d7fff640 1 -- 172.21.15.17:0/100609152 >> v2:172.21.15.142:3300/0 conn(0x7fe9d80ca710 msgr2=0x7fe9d815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:58.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.234+0000 7fe9d7fff640 1 --2- 172.21.15.17:0/100609152 >> v2:172.21.15.142:3300/0 conn(0x7fe9d80ca710 0x7fe9d815e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.234+0000 7fe9d7fff640 1 -- 172.21.15.17:0/100609152 >> v1:172.21.15.142:6789/0 conn(0x7fe9d8160b30 legacy=0x7fe9d8072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.234+0000 7fe9d7fff640 1 -- 172.21.15.17:0/100609152 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d815d890 con 0x7fe9d8072f60 2023-08-09T12:52:58.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.235+0000 7fe9d7fff640 1 --2- 172.21.15.17:0/100609152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8072f60 0x7fe9d8160fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009d90 tx=0x7fe9d002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc714daaf3b9ebf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:58.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.236+0000 7fe9d6ffd640 1 -- 172.21.15.17:0/100609152 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d002cc60 con 0x7fe9d8072f60 2023-08-09T12:52:58.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.236+0000 7fe9d6ffd640 1 -- 172.21.15.17:0/100609152 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d002cdc0 con 0x7fe9d8072f60 2023-08-09T12:52:58.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.236+0000 7fe9d6ffd640 1 -- 172.21.15.17:0/100609152 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0034660 con 0x7fe9d8072f60 2023-08-09T12:52:58.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.236+0000 7fe9ddaad640 1 -- 172.21.15.17:0/100609152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8072f60 msgr2=0x7fe9d8160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.236+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/100609152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8072f60 0x7fe9d8160fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009d90 tx=0x7fe9d002beb0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.237+0000 7fe9ddaad640 1 -- 172.21.15.17:0/100609152 shutdown_connections 2023-08-09T12:52:58.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.237+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/100609152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8072f60 0x7fe9d8160fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.237+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/100609152 >> v2:172.21.15.142:3300/0 conn(0x7fe9d80ca710 0x7fe9d815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.237+0000 7fe9ddaad640 1 -- 172.21.15.17:0/100609152 >> 172.21.15.17:0/100609152 conn(0x7fe9d80cc2e0 msgr2=0x7fe9d80cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:58.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.237+0000 7fe9ddaad640 1 -- 172.21.15.17:0/100609152 shutdown_connections 2023-08-09T12:52:58.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.237+0000 7fe9ddaad640 1 -- 172.21.15.17:0/100609152 wait complete. 2023-08-09T12:52:58.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.239+0000 7fe9ddaad640 1 Processor -- start 2023-08-09T12:52:58.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.239+0000 7fe9ddaad640 1 -- start start 2023-08-09T12:52:58.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.240+0000 7fe9ddaad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8072f60 0x7fe9d81f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ddaad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d80ca710 0x7fe9d8153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ddaad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8160b30 0x7fe9d806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ddaad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81f32a0 con 0x7fe9d80ca710 2023-08-09T12:52:58.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ddaad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81f3580 con 0x7fe9d8072f60 2023-08-09T12:52:58.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ddaad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81f3860 con 0x7fe9d8160b30 2023-08-09T12:52:58.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ceffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d80ca710 0x7fe9d8153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ceffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d80ca710 0x7fe9d8153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51592/0 (socket says 172.21.15.17:51592) 2023-08-09T12:52:58.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ceffd640 1 -- 172.21.15.17:0/4154741898 learned_addr learned my addr 172.21.15.17:0/4154741898 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:58.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9d77fe640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8072f60 0x7fe9d81f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9d7fff640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8160b30 0x7fe9d806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ceffd640 1 -- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8160b30 msgr2=0x7fe9d806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ceffd640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8160b30 0x7fe9d806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ceffd640 1 -- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8072f60 msgr2=0x7fe9d81f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.241+0000 7fe9ceffd640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8072f60 0x7fe9d81f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.242+0000 7fe9ceffd640 1 -- 172.21.15.17:0/4154741898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0009a70 con 0x7fe9d80ca710 2023-08-09T12:52:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.242+0000 7fe9ceffd640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d80ca710 0x7fe9d8153c40 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c410 tx=0x7fe9c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.243+0000 7fe9d4ff9640 1 -- 172.21.15.17:0/4154741898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0005ce0 con 0x7fe9d80ca710 2023-08-09T12:52:58.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.243+0000 7fe9d4ff9640 1 -- 172.21.15.17:0/4154741898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0005e40 con 0x7fe9d80ca710 2023-08-09T12:52:58.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.243+0000 7fe9d4ff9640 1 -- 172.21.15.17:0/4154741898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00072f0 con 0x7fe9d80ca710 2023-08-09T12:52:58.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.243+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d81f6350 con 0x7fe9d80ca710 2023-08-09T12:52:58.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.243+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d8154180 con 0x7fe9d80ca710 2023-08-09T12:52:58.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.244+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d81f6590 con 0x7fe9d80ca710 2023-08-09T12:52:58.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.245+0000 7fe9d4ff9640 1 -- 172.21.15.17:0/4154741898 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe9c0007510 con 0x7fe9d80ca710 2023-08-09T12:52:58.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.246+0000 7fe9d4ff9640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9b806a050 0x7fe9b806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.246+0000 7fe9d4ff9640 1 -- 172.21.15.17:0/4154741898 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe9c0087cc0 con 0x7fe9d80ca710 2023-08-09T12:52:58.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.246+0000 7fe9d4ff9640 1 -- 172.21.15.17:0/4154741898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fe9b8072260 con 0x7fe9d80ca710 2023-08-09T12:52:58.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.247+0000 7fe9d77fe640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9b806a050 0x7fe9b806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.248+0000 7fe9d77fe640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9b806a050 0x7fe9b806c510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe9d815c6f0 tx=0x7fe9c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.252+0000 7fe9d4ff9640 1 -- 172.21.15.17:0/4154741898 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe9c0017060 con 0x7fe9d80ca710 2023-08-09T12:52:58.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.442+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9d8067a80 con 0x7fe9d80ca710 2023-08-09T12:52:58.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.443+0000 7fe9d4ff9640 1 -- 172.21.15.17:0/4154741898 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v179) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9d81f6590 con 0x7fe9d80ca710 2023-08-09T12:52:58.447 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:52:58.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9b806a050 msgr2=0x7fe9b806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9b806a050 0x7fe9b806c510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe9d815c6f0 tx=0x7fe9c8008040 comp rx=0 tx=0).stop 2023-08-09T12:52:58.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d80ca710 msgr2=0x7fe9d8153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d80ca710 0x7fe9d8153c40 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c410 tx=0x7fe9c000c8d0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 shutdown_connections 2023-08-09T12:52:58.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe9b806a050 0x7fe9b806c510 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d8160b30 0x7fe9d806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d80ca710 0x7fe9d8153c40 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 --2- 172.21.15.17:0/4154741898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8072f60 0x7fe9d81f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.446+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 >> 172.21.15.17:0/4154741898 conn(0x7fe9d80cc2e0 msgr2=0x7fe9d80697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.447+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 shutdown_connections 2023-08-09T12:52:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.447+0000 7fe9ddaad640 1 -- 172.21.15.17:0/4154741898 wait complete. 2023-08-09T12:52:58.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:52:58.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.682+0000 7f117102c640 1 Processor -- start 2023-08-09T12:52:58.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.682+0000 7f117102c640 1 -- start start 2023-08-09T12:52:58.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f117102c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f116c15cac0 0x7f116c0cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f117102c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f116c0b1fc0 0x7f116c0d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f117102c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116c0b44b0 0x7f116c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f117102c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116c0d1010 con 0x7f116c15cac0 2023-08-09T12:52:58.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f117102c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116c0d09e0 con 0x7f116c0b1fc0 2023-08-09T12:52:58.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f117102c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116c0b4e20 con 0x7f116c0b44b0 2023-08-09T12:52:58.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f116bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f116c15cac0 0x7f116c0cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f116bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f116c15cac0 0x7f116c0cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51604/0 (socket says 172.21.15.17:51604) 2023-08-09T12:52:58.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.684+0000 7f116bfff640 1 -- 172.21.15.17:0/4115665538 learned_addr learned my addr 172.21.15.17:0/4115665538 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:58.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.685+0000 7f116b7fe640 1 --2- 172.21.15.17:0/4115665538 >> v2:172.21.15.142:3300/0 conn(0x7f116c0b1fc0 0x7f116c0d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.685+0000 7f116bfff640 1 -- 172.21.15.17:0/4115665538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116c0b44b0 msgr2=0x7f116c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:58.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.685+0000 7f116bfff640 1 --2- 172.21.15.17:0/4115665538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116c0b44b0 0x7f116c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.685+0000 7f116bfff640 1 -- 172.21.15.17:0/4115665538 >> v2:172.21.15.142:3300/0 conn(0x7f116c0b1fc0 msgr2=0x7f116c0d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:58.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.685+0000 7f116bfff640 1 --2- 172.21.15.17:0/4115665538 >> v2:172.21.15.142:3300/0 conn(0x7f116c0b1fc0 0x7f116c0d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.685+0000 7f116bfff640 1 -- 172.21.15.17:0/4115665538 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c0cdb70 con 0x7f116c15cac0 2023-08-09T12:52:58.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.686+0000 7f116bfff640 1 --2- 172.21.15.17:0/4115665538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c15cac0 0x7f116c0cd290 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f116c0b50e0 tx=0x7f115c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab62b5d48d9709ea server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:58.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.686+0000 7f116affd640 1 -- 172.21.15.17:0/4115665538 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c02ca80 con 0x7f116c15cac0 2023-08-09T12:52:58.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.686+0000 7f116affd640 1 -- 172.21.15.17:0/4115665538 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c02cbe0 con 0x7f116c15cac0 2023-08-09T12:52:58.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.686+0000 7f116affd640 1 -- 172.21.15.17:0/4115665538 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0343f0 con 0x7f116c15cac0 2023-08-09T12:52:58.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 -- 172.21.15.17:0/4115665538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c15cac0 msgr2=0x7f116c0cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 --2- 172.21.15.17:0/4115665538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c15cac0 0x7f116c0cd290 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f116c0b50e0 tx=0x7f115c02bee0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 -- 172.21.15.17:0/4115665538 shutdown_connections 2023-08-09T12:52:58.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 --2- 172.21.15.17:0/4115665538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116c0b44b0 0x7f116c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 --2- 172.21.15.17:0/4115665538 >> v2:172.21.15.142:3300/0 conn(0x7f116c0b1fc0 0x7f116c0d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 --2- 172.21.15.17:0/4115665538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c15cac0 0x7f116c0cd290 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 -- 172.21.15.17:0/4115665538 >> 172.21.15.17:0/4115665538 conn(0x7f116c0cf4b0 msgr2=0x7f116c0cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 -- 172.21.15.17:0/4115665538 shutdown_connections 2023-08-09T12:52:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.687+0000 7f117102c640 1 -- 172.21.15.17:0/4115665538 wait complete. 2023-08-09T12:52:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.689+0000 7f117102c640 1 Processor -- start 2023-08-09T12:52:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.690+0000 7f117102c640 1 -- start start 2023-08-09T12:52:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f117102c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c0b1fc0 0x7f116c15fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f117102c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116c0b44b0 0x7f116c0cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f117102c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f116c15cac0 0x7f116c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f117102c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c0c7280 con 0x7f116c0b1fc0 2023-08-09T12:52:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f117102c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c0c6670 con 0x7f116c15cac0 2023-08-09T12:52:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f117102c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116c0c6950 con 0x7f116c0b44b0 2023-08-09T12:52:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f116bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c0b1fc0 0x7f116c15fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f116bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c0b1fc0 0x7f116c15fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51620/0 (socket says 172.21.15.17:51620) 2023-08-09T12:52:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f116bfff640 1 -- 172.21.15.17:0/1713261632 learned_addr learned my addr 172.21.15.17:0/1713261632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.691+0000 7f116bfff640 1 -- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116c0b44b0 msgr2=0x7f116c0cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f116bfff640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116c0b44b0 0x7f116c0cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f116bfff640 1 -- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f116c15cac0 msgr2=0x7f116c0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f116bfff640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f116c15cac0 0x7f116c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f116bfff640 1 -- 172.21.15.17:0/1713261632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c009b30 con 0x7f116c0b1fc0 2023-08-09T12:52:58.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f116bfff640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c0b1fc0 0x7f116c15fa10 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f115c000f80 tx=0x7f115c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:58.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f1168ff9640 1 -- 172.21.15.17:0/1713261632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c009510 con 0x7f116c0b1fc0 2023-08-09T12:52:58.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f1168ff9640 1 -- 172.21.15.17:0/1713261632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c03e450 con 0x7f116c0b1fc0 2023-08-09T12:52:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f1168ff9640 1 -- 172.21.15.17:0/1713261632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c03e800 con 0x7f116c0b1fc0 2023-08-09T12:52:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.692+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116c0c6c30 con 0x7f116c0b1fc0 2023-08-09T12:52:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.693+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116c0cb7e0 con 0x7f116c0b1fc0 2023-08-09T12:52:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.694+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116c04e390 con 0x7f116c0b1fc0 2023-08-09T12:52:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.695+0000 7f1168ff9640 1 -- 172.21.15.17:0/1713261632 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f115c02cd50 con 0x7f116c0b1fc0 2023-08-09T12:52:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.696+0000 7f1168ff9640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f115806a080 0x7f115806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.696+0000 7f1168ff9640 1 -- 172.21.15.17:0/1713261632 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f115c0aae70 con 0x7f116c0b1fc0 2023-08-09T12:52:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.696+0000 7f1168ff9640 1 -- 172.21.15.17:0/1713261632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f1158072290 con 0x7f116c0b1fc0 2023-08-09T12:52:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.697+0000 7f116b7fe640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f115806a080 0x7f115806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.698+0000 7f116b7fe640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f115806a080 0x7f115806c540 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1160006fd0 tx=0x7f1160008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.700+0000 7f1168ff9640 1 -- 172.21.15.17:0/1713261632 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f115c076550 con 0x7f116c0b1fc0 2023-08-09T12:52:58.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.891+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f116c1e8080 con 0x7f116c0b1fc0 2023-08-09T12:52:58.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.892+0000 7f1168ff9640 1 -- 172.21.15.17:0/1713261632 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v179) v1 ==== 104+0+11 (secure 0 0 0) 0x7f115c033e80 con 0x7f116c0b1fc0 2023-08-09T12:52:58.895 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:52:58.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.894+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f115806a080 msgr2=0x7f115806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.894+0000 7f117102c640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f115806a080 0x7f115806c540 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1160006fd0 tx=0x7f1160008040 comp rx=0 tx=0).stop 2023-08-09T12:52:58.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.894+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c0b1fc0 msgr2=0x7f116c15fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:58.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.894+0000 7f117102c640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c0b1fc0 0x7f116c15fa10 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f115c000f80 tx=0x7f115c004a40 comp rx=0 tx=0).stop 2023-08-09T12:52:58.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.895+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 shutdown_connections 2023-08-09T12:52:58.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.895+0000 7f117102c640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f115806a080 0x7f115806c540 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.895+0000 7f117102c640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f116c15cac0 0x7f116c0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.895+0000 7f117102c640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f116c0b44b0 0x7f116c0cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.895+0000 7f117102c640 1 --2- 172.21.15.17:0/1713261632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f116c0b1fc0 0x7f116c15fa10 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.895+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 >> 172.21.15.17:0/1713261632 conn(0x7f116c0cf4b0 msgr2=0x7f116c0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.895+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 shutdown_connections 2023-08-09T12:52:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:58.895+0000 7f117102c640 1 -- 172.21.15.17:0/1713261632 wait complete. 2023-08-09T12:52:58.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:52:59.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.144+0000 7f105d0b0640 1 Processor -- start 2023-08-09T12:52:59.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.144+0000 7f105d0b0640 1 -- start start 2023-08-09T12:52:59.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.145+0000 7f105d0b0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f105815caf0 0x7f10580703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.145+0000 7f105d0b0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f10580708e0 0x7f10580d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.145+0000 7f105d0b0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10580d0f00 con 0x7f10580d2360 2023-08-09T12:52:59.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.145+0000 7f105d0b0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580d1a80 con 0x7f10580708e0 2023-08-09T12:52:59.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.145+0000 7f105d0b0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580d27f0 con 0x7f105815caf0 2023-08-09T12:52:59.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f10577fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f10580708e0 0x7f10580d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f105c8af640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f10580d2360 0x7f10580697c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45858/0 (socket says 172.21.15.17:45858) 2023-08-09T12:52:59.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f105c8af640 1 -- 172.21.15.17:0/2978263886 learned_addr learned my addr 172.21.15.17:0/2978263886 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:52:59.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f1057fff640 1 --2- 172.21.15.17:0/2978263886 >> v2:172.21.15.142:3300/0 conn(0x7f105815caf0 0x7f10580703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f10577fe640 1 -- 172.21.15.17:0/2978263886 >> v2:172.21.15.142:3300/0 conn(0x7f105815caf0 msgr2=0x7f10580703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:59.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f10577fe640 1 --2- 172.21.15.17:0/2978263886 >> v2:172.21.15.142:3300/0 conn(0x7f105815caf0 0x7f10580703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f10577fe640 1 -- 172.21.15.17:0/2978263886 >> v1:172.21.15.17:6789/0 conn(0x7f10580d2360 legacy=0x7f10580697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f10577fe640 1 -- 172.21.15.17:0/2978263886 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10580d11e0 con 0x7f10580708e0 2023-08-09T12:52:59.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.146+0000 7f1056ffd640 1 -- 172.21.15.17:0/2978263886 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864217223 0 0) 0x7f10580d0f00 con 0x7f10580d2360 2023-08-09T12:52:59.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.148+0000 7f10577fe640 1 --2- 172.21.15.17:0/2978263886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10580708e0 0x7f10580d1e20 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f10580d04a0 tx=0x7f104c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aedf3978c705429 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:59.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.148+0000 7f1056ffd640 1 -- 172.21.15.17:0/2978263886 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c031830 con 0x7f10580708e0 2023-08-09T12:52:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.148+0000 7f1056ffd640 1 -- 172.21.15.17:0/2978263886 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c031990 con 0x7f10580708e0 2023-08-09T12:52:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.148+0000 7f1056ffd640 1 -- 172.21.15.17:0/2978263886 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c031d20 con 0x7f10580708e0 2023-08-09T12:52:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.149+0000 7f105d0b0640 1 -- 172.21.15.17:0/2978263886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10580708e0 msgr2=0x7f10580d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.149+0000 7f105d0b0640 1 --2- 172.21.15.17:0/2978263886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10580708e0 0x7f10580d1e20 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f10580d04a0 tx=0x7f104c02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.149+0000 7f105d0b0640 1 -- 172.21.15.17:0/2978263886 shutdown_connections 2023-08-09T12:52:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.149+0000 7f105d0b0640 1 --2- 172.21.15.17:0/2978263886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10580708e0 0x7f10580d1e20 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.149+0000 7f105d0b0640 1 --2- 172.21.15.17:0/2978263886 >> v2:172.21.15.142:3300/0 conn(0x7f105815caf0 0x7f10580703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.149+0000 7f105d0b0640 1 -- 172.21.15.17:0/2978263886 >> 172.21.15.17:0/2978263886 conn(0x7f10580cf6b0 msgr2=0x7f10580cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:59.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.149+0000 7f105d0b0640 1 -- 172.21.15.17:0/2978263886 shutdown_connections 2023-08-09T12:52:59.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.149+0000 7f105d0b0640 1 -- 172.21.15.17:0/2978263886 wait complete. 2023-08-09T12:52:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.151+0000 7f105d0b0640 1 Processor -- start 2023-08-09T12:52:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.151+0000 7f105d0b0640 1 -- start start 2023-08-09T12:52:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.152+0000 7f105d0b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10580d2360 0x7f10581521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.152+0000 7f105d0b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f105815caf0 0x7f105815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.152+0000 7f105d0b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f105815d770 0x7f10580c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.152+0000 7f105d0b0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10581526e0 con 0x7f105815caf0 2023-08-09T12:52:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.152+0000 7f105d0b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105815e2b0 con 0x7f105815d770 2023-08-09T12:52:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.152+0000 7f105d0b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105815dcf0 con 0x7f10580d2360 2023-08-09T12:52:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f10577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f105815caf0 0x7f105815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f10577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f105815caf0 0x7f105815d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51638/0 (socket says 172.21.15.17:51638) 2023-08-09T12:52:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f10577fe640 1 -- 172.21.15.17:0/4071727230 learned_addr learned my addr 172.21.15.17:0/4071727230 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f1057fff640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10580d2360 0x7f10581521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f105c8af640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f105815d770 0x7f10580c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f10577fe640 1 -- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10580d2360 msgr2=0x7f10581521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f10577fe640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10580d2360 0x7f10581521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f10577fe640 1 -- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f105815d770 msgr2=0x7f10580c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f10577fe640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f105815d770 0x7f10580c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.153+0000 7f10577fe640 1 -- 172.21.15.17:0/4071727230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c009400 con 0x7f105815caf0 2023-08-09T12:52:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.154+0000 7f10577fe640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f105815caf0 0x7f105815d230 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f104c000c00 tx=0x7f104c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.154+0000 7f1054ff9640 1 -- 172.21.15.17:0/4071727230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c004230 con 0x7f105815caf0 2023-08-09T12:52:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.154+0000 7f1054ff9640 1 -- 172.21.15.17:0/4071727230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c0043b0 con 0x7f105815caf0 2023-08-09T12:52:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.154+0000 7f1054ff9640 1 -- 172.21.15.17:0/4071727230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c004520 con 0x7f105815caf0 2023-08-09T12:52:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.154+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105815dfd0 con 0x7f105815caf0 2023-08-09T12:52:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.154+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105815eab0 con 0x7f105815caf0 2023-08-09T12:52:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.155+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105804e390 con 0x7f105815caf0 2023-08-09T12:52:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.156+0000 7f1054ff9640 1 -- 172.21.15.17:0/4071727230 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f104c03a8a0 con 0x7f105815caf0 2023-08-09T12:52:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.157+0000 7f1054ff9640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f104406a050 0x7f104406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.157+0000 7f1054ff9640 1 -- 172.21.15.17:0/4071727230 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f104c0aac30 con 0x7f105815caf0 2023-08-09T12:52:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.157+0000 7f1054ff9640 1 -- 172.21.15.17:0/4071727230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f1044072260 con 0x7f105815caf0 2023-08-09T12:52:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.158+0000 7f1057fff640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f104406a050 0x7f104406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.161+0000 7f1057fff640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f104406a050 0x7f104406c510 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f10480099c0 tx=0x7f1048003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:59.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.163+0000 7f1054ff9640 1 -- 172.21.15.17:0/4071727230 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f104c035020 con 0x7f105815caf0 2023-08-09T12:52:59.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.359+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10580c8ba0 con 0x7f105815caf0 2023-08-09T12:52:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.360+0000 7f1054ff9640 1 -- 172.21.15.17:0/4071727230 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v179) v1 ==== 100+0+11 (secure 0 0 0) 0x7f104c0763f0 con 0x7f105815caf0 2023-08-09T12:52:59.363 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:52:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f104406a050 msgr2=0x7f104406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f104406a050 0x7f104406c510 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f10480099c0 tx=0x7f1048003990 comp rx=0 tx=0).stop 2023-08-09T12:52:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f105815caf0 msgr2=0x7f105815d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f105815caf0 0x7f105815d230 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f104c000c00 tx=0x7f104c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 shutdown_connections 2023-08-09T12:52:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f104406a050 0x7f104406c510 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f105815d770 0x7f10580c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f105815caf0 0x7f105815d230 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 --2- 172.21.15.17:0/4071727230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10580d2360 0x7f10581521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 >> 172.21.15.17:0/4071727230 conn(0x7f10580cf6b0 msgr2=0x7f10580b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 shutdown_connections 2023-08-09T12:52:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.362+0000 7f105d0b0640 1 -- 172.21.15.17:0/4071727230 wait complete. 2023-08-09T12:52:59.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:52:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.613+0000 7fd0cd637640 1 Processor -- start 2023-08-09T12:52:59.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.613+0000 7fd0cd637640 1 -- start start 2023-08-09T12:52:59.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.614+0000 7fd0cd637640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c8070f00 0x7fd0c815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.614+0000 7fd0cd637640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0c815bce0 0x7fd0c80cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.614+0000 7fd0cd637640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c8071340 con 0x7fd0c81587e0 2023-08-09T12:52:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.614+0000 7fd0cd637640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c80715c0 con 0x7fd0c815bce0 2023-08-09T12:52:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.614+0000 7fd0cd637640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80718a0 con 0x7fd0c8070f00 2023-08-09T12:52:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0c7fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd0c81587e0 0x7fd0c80b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45874/0 (socket says 172.21.15.17:45874) 2023-08-09T12:52:59.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0c7fff640 1 -- 172.21.15.17:0/4235852887 learned_addr learned my addr 172.21.15.17:0/4235852887 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:52:59.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0cce36640 1 --2- 172.21.15.17:0/4235852887 >> v2:172.21.15.17:3300/0 conn(0x7fd0c815bce0 0x7fd0c80cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0c77fe640 1 --2- 172.21.15.17:0/4235852887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c8070f00 0x7fd0c815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0c6ffd640 1 -- 172.21.15.17:0/4235852887 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470412116 0 0) 0x7fd0c8071340 con 0x7fd0c81587e0 2023-08-09T12:52:59.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0c6ffd640 1 -- 172.21.15.17:0/4235852887 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b0003520 con 0x7fd0c81587e0 2023-08-09T12:52:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0cce36640 1 -- 172.21.15.17:0/4235852887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c8070f00 msgr2=0x7fd0c815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:52:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0cce36640 1 --2- 172.21.15.17:0/4235852887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c8070f00 0x7fd0c815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0cce36640 1 -- 172.21.15.17:0/4235852887 >> v1:172.21.15.17:6789/0 conn(0x7fd0c81587e0 legacy=0x7fd0c80b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.615+0000 7fd0cce36640 1 -- 172.21.15.17:0/4235852887 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8071b80 con 0x7fd0c815bce0 2023-08-09T12:52:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.616+0000 7fd0c77fe640 1 --2- 172.21.15.17:0/4235852887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c8070f00 0x7fd0c815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:52:59.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.617+0000 7fd0cce36640 1 --2- 172.21.15.17:0/4235852887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c815bce0 0x7fd0c80cb070 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009d90 tx=0x7fd0c002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3f2de7dcc36bf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:59.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.617+0000 7fd0c6ffd640 1 -- 172.21.15.17:0/4235852887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c002cc50 con 0x7fd0c815bce0 2023-08-09T12:52:59.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.617+0000 7fd0c6ffd640 1 -- 172.21.15.17:0/4235852887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c002cdb0 con 0x7fd0c815bce0 2023-08-09T12:52:59.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.617+0000 7fd0c6ffd640 1 -- 172.21.15.17:0/4235852887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0034640 con 0x7fd0c815bce0 2023-08-09T12:52:59.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.618+0000 7fd0cd637640 1 -- 172.21.15.17:0/4235852887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c815bce0 msgr2=0x7fd0c80cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.618+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4235852887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c815bce0 0x7fd0c80cb070 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009d90 tx=0x7fd0c002bea0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.618+0000 7fd0cd637640 1 -- 172.21.15.17:0/4235852887 shutdown_connections 2023-08-09T12:52:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.618+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4235852887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c815bce0 0x7fd0c80cb070 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.618+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4235852887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c8070f00 0x7fd0c815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.618+0000 7fd0cd637640 1 -- 172.21.15.17:0/4235852887 >> 172.21.15.17:0/4235852887 conn(0x7fd0c80b1d50 msgr2=0x7fd0c806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.618+0000 7fd0cd637640 1 -- 172.21.15.17:0/4235852887 shutdown_connections 2023-08-09T12:52:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.618+0000 7fd0cd637640 1 -- 172.21.15.17:0/4235852887 wait complete. 2023-08-09T12:52:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.620+0000 7fd0cd637640 1 Processor -- start 2023-08-09T12:52:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.620+0000 7fd0cd637640 1 -- start start 2023-08-09T12:52:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cd637640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0c8070f00 0x7fd0c8152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cd637640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c81587e0 0x7fd0c80ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cd637640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c8155130 0x7fd0c80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cd637640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80c97a0 con 0x7fd0c8155130 2023-08-09T12:52:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cd637640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80c3e70 con 0x7fd0c8070f00 2023-08-09T12:52:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cd637640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80ca030 con 0x7fd0c81587e0 2023-08-09T12:52:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cce36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c8155130 0x7fd0c80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cce36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c8155130 0x7fd0c80ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51664/0 (socket says 172.21.15.17:51664) 2023-08-09T12:52:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0cce36640 1 -- 172.21.15.17:0/4024217205 learned_addr learned my addr 172.21.15.17:0/4024217205 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:52:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0c7fff640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0c8070f00 0x7fd0c8152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.621+0000 7fd0c77fe640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c81587e0 0x7fd0c80ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0cce36640 1 -- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c81587e0 msgr2=0x7fd0c80ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0cce36640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c81587e0 0x7fd0c80ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0cce36640 1 -- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0c8070f00 msgr2=0x7fd0c8152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0cce36640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0c8070f00 0x7fd0c8152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0cce36640 1 -- 172.21.15.17:0/4024217205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0009a70 con 0x7fd0c8155130 2023-08-09T12:52:59.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0cce36640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c8155130 0x7fd0c80ac8b0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009d90 tx=0x7fd0c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0c4ff9640 1 -- 172.21.15.17:0/4024217205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0040650 con 0x7fd0c8155130 2023-08-09T12:52:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0c4ff9640 1 -- 172.21.15.17:0/4024217205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00407b0 con 0x7fd0c8155130 2023-08-09T12:52:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0c4ff9640 1 -- 172.21.15.17:0/4024217205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0040b60 con 0x7fd0c8155130 2023-08-09T12:52:59.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.622+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c80c3b90 con 0x7fd0c8155130 2023-08-09T12:52:59.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.623+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c80c9cc0 con 0x7fd0c8155130 2023-08-09T12:52:59.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.624+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c806fa10 con 0x7fd0c8155130 2023-08-09T12:52:59.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.625+0000 7fd0c4ff9640 1 -- 172.21.15.17:0/4024217205 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd0c0040cc0 con 0x7fd0c8155130 2023-08-09T12:52:59.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.626+0000 7fd0c4ff9640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd0b406a050 0x7fd0b406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:52:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.626+0000 7fd0c4ff9640 1 -- 172.21.15.17:0/4024217205 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd0c00ab350 con 0x7fd0c8155130 2023-08-09T12:52:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.626+0000 7fd0c4ff9640 1 -- 172.21.15.17:0/4024217205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fd0b4072260 con 0x7fd0c8155130 2023-08-09T12:52:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.626+0000 7fd0c7fff640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd0b406a050 0x7fd0b406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:52:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.628+0000 7fd0c7fff640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd0b406a050 0x7fd0b406c510 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80011e0 tx=0x7fd0b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:52:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.630+0000 7fd0c4ff9640 1 -- 172.21.15.17:0/4024217205 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd0c806fa10 con 0x7fd0c8155130 2023-08-09T12:52:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.838+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd0c806fa10 con 0x7fd0c8155130 2023-08-09T12:52:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.839+0000 7fd0c4ff9640 1 -- 172.21.15.17:0/4024217205 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v179) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd0c806fa10 con 0x7fd0c8155130 2023-08-09T12:52:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:52:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd0b406a050 msgr2=0x7fd0b406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd0b406a050 0x7fd0b406c510 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80011e0 tx=0x7fd0b8009040 comp rx=0 tx=0).stop 2023-08-09T12:52:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c8155130 msgr2=0x7fd0c80ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:52:59.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c8155130 0x7fd0c80ac8b0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009d90 tx=0x7fd0c0004a40 comp rx=0 tx=0).stop 2023-08-09T12:52:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 shutdown_connections 2023-08-09T12:52:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd0b406a050 0x7fd0b406c510 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c8155130 0x7fd0c80ac8b0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0c81587e0 0x7fd0c80ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 --2- 172.21.15.17:0/4024217205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0c8070f00 0x7fd0c8152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:52:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 >> 172.21.15.17:0/4024217205 conn(0x7fd0c80b1d50 msgr2=0x7fd0c8157240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:52:59.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 shutdown_connections 2023-08-09T12:52:59.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:52:59.842+0000 7fd0cd637640 1 -- 172.21.15.17:0/4024217205 wait complete. 2023-08-09T12:52:59.864 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:52:59.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:52:59.865 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:52:59.998 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:52:59.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:52:59.999 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:53:00.053 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:53:00.054 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:00.118 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:53:00.119 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:53:00.119 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:00.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:53:00.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.416+0000 7f63d4ec0640 1 Processor -- start 2023-08-09T12:53:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.416+0000 7f63d4ec0640 1 -- start start 2023-08-09T12:53:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.418+0000 7f63d4ec0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f63d00b10b0 0x7f63d00cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.418+0000 7f63d4ec0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f63d00cdd70 0x7f63d006b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.418+0000 7f63d4ec0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d015d200 con 0x7f63d015ce20 2023-08-09T12:53:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.418+0000 7f63d4ec0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00ceda0 con 0x7f63d00cdd70 2023-08-09T12:53:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.418+0000 7f63d4ec0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00ce1c0 con 0x7f63d00b10b0 2023-08-09T12:53:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.418+0000 7f63cffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f63d00cdd70 0x7f63d006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.418+0000 7f63cffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f63d00cdd70 0x7f63d006b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51672/0 (socket says 172.21.15.17:51672) 2023-08-09T12:53:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.418+0000 7f63cffff640 1 -- 172.21.15.17:0/2086891993 learned_addr learned my addr 172.21.15.17:0/2086891993 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.419+0000 7f63ceffd640 1 --2- 172.21.15.17:0/2086891993 >> v2:172.21.15.142:3300/0 conn(0x7f63d00b10b0 0x7f63d00cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.419+0000 7f63cffff640 1 -- 172.21.15.17:0/2086891993 >> v2:172.21.15.142:3300/0 conn(0x7f63d00b10b0 msgr2=0x7f63d00cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.419+0000 7f63cffff640 1 --2- 172.21.15.17:0/2086891993 >> v2:172.21.15.142:3300/0 conn(0x7f63d00b10b0 0x7f63d00cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.419+0000 7f63cffff640 1 -- 172.21.15.17:0/2086891993 >> v1:172.21.15.17:6789/0 conn(0x7f63d015ce20 legacy=0x7f63d00b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.419+0000 7f63cffff640 1 -- 172.21.15.17:0/2086891993 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00cad50 con 0x7f63d00cdd70 2023-08-09T12:53:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.420+0000 7f63cffff640 1 --2- 172.21.15.17:0/2086891993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00cdd70 0x7f63d006b330 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f63d006d4d0 tx=0x7f63c802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114513d957205cbd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63ce7fc640 1 -- 172.21.15.17:0/2086891993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c802c960 con 0x7f63d00cdd70 2023-08-09T12:53:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63ce7fc640 1 -- 172.21.15.17:0/2086891993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c802cac0 con 0x7f63d00cdd70 2023-08-09T12:53:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63ce7fc640 1 -- 172.21.15.17:0/2086891993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c802ce50 con 0x7f63d00cdd70 2023-08-09T12:53:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2086891993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00cdd70 msgr2=0x7f63d006b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2086891993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00cdd70 0x7f63d006b330 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f63d006d4d0 tx=0x7f63c802be40 comp rx=0 tx=0).stop 2023-08-09T12:53:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2086891993 shutdown_connections 2023-08-09T12:53:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2086891993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00cdd70 0x7f63d006b330 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2086891993 >> v2:172.21.15.142:3300/0 conn(0x7f63d00b10b0 0x7f63d00cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2086891993 >> 172.21.15.17:0/2086891993 conn(0x7f63d00cb9a0 msgr2=0x7f63d00cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2086891993 shutdown_connections 2023-08-09T12:53:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.421+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2086891993 wait complete. 2023-08-09T12:53:00.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.423+0000 7f63d4ec0640 1 Processor -- start 2023-08-09T12:53:00.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.423+0000 7f63d4ec0640 1 -- start start 2023-08-09T12:53:00.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.424+0000 7f63d4ec0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00b10b0 0x7f63d00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.424+0000 7f63d4ec0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d00cdd70 0x7f63d00b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.424+0000 7f63d4ec0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d015ce20 0x7f63d0156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.424+0000 7f63d4ec0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00c7ad0 con 0x7f63d00b10b0 2023-08-09T12:53:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.424+0000 7f63d4ec0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00c7230 con 0x7f63d015ce20 2023-08-09T12:53:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.424+0000 7f63d4ec0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00c7510 con 0x7f63d00cdd70 2023-08-09T12:53:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00b10b0 0x7f63d00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00b10b0 0x7f63d00c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51688/0 (socket says 172.21.15.17:51688) 2023-08-09T12:53:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cf7fe640 1 -- 172.21.15.17:0/2627162977 learned_addr learned my addr 172.21.15.17:0/2627162977 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cffff640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d015ce20 0x7f63d0156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63ceffd640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d00cdd70 0x7f63d00b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cf7fe640 1 -- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d00cdd70 msgr2=0x7f63d00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cf7fe640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d00cdd70 0x7f63d00b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cf7fe640 1 -- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d015ce20 msgr2=0x7f63d0156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cf7fe640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d015ce20 0x7f63d0156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.425+0000 7f63cf7fe640 1 -- 172.21.15.17:0/2627162977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8009b30 con 0x7f63d00b10b0 2023-08-09T12:53:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.426+0000 7f63cf7fe640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00b10b0 0x7f63d00c6a00 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c780 tx=0x7f63c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:00.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.426+0000 7f63b7fff640 1 -- 172.21.15.17:0/2627162977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0005270 con 0x7f63d00b10b0 2023-08-09T12:53:00.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.426+0000 7f63b7fff640 1 -- 172.21.15.17:0/2627162977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c00053d0 con 0x7f63d00b10b0 2023-08-09T12:53:00.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.426+0000 7f63b7fff640 1 -- 172.21.15.17:0/2627162977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000a880 con 0x7f63d00b10b0 2023-08-09T12:53:00.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.426+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d00c77f0 con 0x7f63d00b10b0 2023-08-09T12:53:00.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.426+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d00c6f40 con 0x7f63d00b10b0 2023-08-09T12:53:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.427+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d009a920 con 0x7f63d00b10b0 2023-08-09T12:53:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.428+0000 7f63b7fff640 1 -- 172.21.15.17:0/2627162977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f63c000a9e0 con 0x7f63d00b10b0 2023-08-09T12:53:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.429+0000 7f63b7fff640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f63bc06a050 0x7f63bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.429+0000 7f63b7fff640 1 -- 172.21.15.17:0/2627162977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f63c0087dd0 con 0x7f63d00b10b0 2023-08-09T12:53:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.429+0000 7f63b7fff640 1 -- 172.21.15.17:0/2627162977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f63bc072260 con 0x7f63d00b10b0 2023-08-09T12:53:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.430+0000 7f63ceffd640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f63bc06a050 0x7f63bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.431+0000 7f63ceffd640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f63bc06a050 0x7f63bc06c510 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f63c4006fd0 tx=0x7f63c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:00.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.433+0000 7f63b7fff640 1 -- 172.21.15.17:0/2627162977 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f63c0017070 con 0x7f63d00b10b0 2023-08-09T12:53:00.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.663+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63d004e390 con 0x7f63d00b10b0 2023-08-09T12:53:00.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.665+0000 7f63b7fff640 1 -- 172.21.15.17:0/2627162977 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4876 (secure 0 0 0) 0x7f63c00533e0 con 0x7f63d00b10b0 2023-08-09T12:53:00.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:00.668 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/53885323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":53885323},{"type":"v1","addr":"172.21.15.142:6836","nonce":53885323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1636287832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1636287832},{"type":"v1","addr":"172.21.15.142:6837","nonce":1636287832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/758642293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":758642293},{"type":"v1","addr":"172.21.15.17:6833","nonce":758642293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:51:33.353513+0000","modified":"2023-08-09T12:51:36.903336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9000},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9000":{"gid":9000,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2739343495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2739343495},{"type":"v1","addr":"172.21.15.17:6835","nonce":2739343495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-09T12:53:00.669 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 84 2023-08-09T12:53:00.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.667+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f63bc06a050 msgr2=0x7f63bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.667+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f63bc06a050 0x7f63bc06c510 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f63c4006fd0 tx=0x7f63c4008040 comp rx=0 tx=0).stop 2023-08-09T12:53:00.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.667+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00b10b0 msgr2=0x7f63d00c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.667+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00b10b0 0x7f63d00c6a00 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c780 tx=0x7f63c000cc40 comp rx=0 tx=0).stop 2023-08-09T12:53:00.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.668+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 shutdown_connections 2023-08-09T12:53:00.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.668+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f63bc06a050 0x7f63bc06c510 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.668+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d015ce20 0x7f63d0156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.668+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d00cdd70 0x7f63d00b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.668+0000 7f63d4ec0640 1 --2- 172.21.15.17:0/2627162977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d00b10b0 0x7f63d00c6a00 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.668+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 >> 172.21.15.17:0/2627162977 conn(0x7f63d00cb9a0 msgr2=0x7f63d00ad670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:00.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.668+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 shutdown_connections 2023-08-09T12:53:00.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.668+0000 7f63d4ec0640 1 -- 172.21.15.17:0/2627162977 wait complete. 2023-08-09T12:53:00.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:53:00.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.911+0000 7f4215afa640 1 Processor -- start 2023-08-09T12:53:00.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.911+0000 7f4215afa640 1 -- start start 2023-08-09T12:53:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f4215afa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42100adc40 0x7f421006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f4215afa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100cc630 0x7f42100ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f4215afa640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100b2250 con 0x7f42100b3b40 2023-08-09T12:53:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f4215afa640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42100ae020 con 0x7f42100adc40 2023-08-09T12:53:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f4215afa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100b2530 con 0x7f42100cc630 2023-08-09T12:53:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f420f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42100adc40 0x7f421006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f420f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42100adc40 0x7f421006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51700/0 (socket says 172.21.15.17:51700) 2023-08-09T12:53:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f4206ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f42100b3b40 0x7f42100b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45902/0 (socket says 172.21.15.17:45902) 2023-08-09T12:53:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.913+0000 7f420f7fe640 1 -- 172.21.15.17:0/3929011242 learned_addr learned my addr 172.21.15.17:0/3929011242 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.914+0000 7f420ffff640 1 --2- 172.21.15.17:0/3929011242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100cc630 0x7f42100ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.914+0000 7f420f7fe640 1 -- 172.21.15.17:0/3929011242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100cc630 msgr2=0x7f42100ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.914+0000 7f420f7fe640 1 --2- 172.21.15.17:0/3929011242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100cc630 0x7f42100ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.914+0000 7f420f7fe640 1 -- 172.21.15.17:0/3929011242 >> v1:172.21.15.17:6789/0 conn(0x7f42100b3b40 legacy=0x7f42100b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.914+0000 7f420f7fe640 1 -- 172.21.15.17:0/3929011242 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421006fe80 con 0x7f42100adc40 2023-08-09T12:53:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.914+0000 7f420ffff640 1 --2- 172.21.15.17:0/3929011242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100cc630 0x7f42100ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.914+0000 7f420effd640 1 -- 172.21.15.17:0/3929011242 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678507153 0 0) 0x7f42100b2250 con 0x7f42100b3b40 2023-08-09T12:53:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.915+0000 7f420f7fe640 1 --2- 172.21.15.17:0/3929011242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100adc40 0x7f421006c280 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f4200009870 tx=0x7f420002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4574976cbe9e83 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.915+0000 7f420effd640 1 -- 172.21.15.17:0/3929011242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200031640 con 0x7f42100adc40 2023-08-09T12:53:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.915+0000 7f420effd640 1 -- 172.21.15.17:0/3929011242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42000317a0 con 0x7f42100adc40 2023-08-09T12:53:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.915+0000 7f420effd640 1 -- 172.21.15.17:0/3929011242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200031b30 con 0x7f42100adc40 2023-08-09T12:53:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.916+0000 7f4215afa640 1 -- 172.21.15.17:0/3929011242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100adc40 msgr2=0x7f421006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.916+0000 7f4215afa640 1 --2- 172.21.15.17:0/3929011242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100adc40 0x7f421006c280 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f4200009870 tx=0x7f420002b8f0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.916+0000 7f4215afa640 1 -- 172.21.15.17:0/3929011242 shutdown_connections 2023-08-09T12:53:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.916+0000 7f4215afa640 1 --2- 172.21.15.17:0/3929011242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100cc630 0x7f42100ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.916+0000 7f4215afa640 1 --2- 172.21.15.17:0/3929011242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100adc40 0x7f421006c280 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.916+0000 7f4215afa640 1 -- 172.21.15.17:0/3929011242 >> 172.21.15.17:0/3929011242 conn(0x7f42100cb1b0 msgr2=0x7f42100cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.916+0000 7f4215afa640 1 -- 172.21.15.17:0/3929011242 shutdown_connections 2023-08-09T12:53:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.916+0000 7f4215afa640 1 -- 172.21.15.17:0/3929011242 wait complete. 2023-08-09T12:53:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.918+0000 7f4215afa640 1 Processor -- start 2023-08-09T12:53:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.918+0000 7f4215afa640 1 -- start start 2023-08-09T12:53:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4215afa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100adc40 0x7f421014fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4215afa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100b3b40 0x7f4210159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4215afa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42100cc630 0x7f421015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4215afa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100c5770 con 0x7f42100b3b40 2023-08-09T12:53:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4215afa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100c59c0 con 0x7f42100cc630 2023-08-09T12:53:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4215afa640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100c5ca0 con 0x7f42100adc40 2023-08-09T12:53:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4206ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100b3b40 0x7f4210159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4206ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100b3b40 0x7f4210159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51710/0 (socket says 172.21.15.17:51710) 2023-08-09T12:53:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.919+0000 7f4206ffd640 1 -- 172.21.15.17:0/183046867 learned_addr learned my addr 172.21.15.17:0/183046867 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f420f7fe640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100adc40 0x7f421014fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f4206ffd640 1 -- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100adc40 msgr2=0x7f421014fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f4206ffd640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100adc40 0x7f421014fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f4206ffd640 1 -- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42100cc630 msgr2=0x7f421015a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f4206ffd640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42100cc630 0x7f421015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f4206ffd640 1 -- 172.21.15.17:0/183046867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42000094d0 con 0x7f42100b3b40 2023-08-09T12:53:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f4206ffd640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100b3b40 0x7f4210159e50 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f41f800c840 tx=0x7f41f800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f420cff9640 1 -- 172.21.15.17:0/183046867 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800a640 con 0x7f42100b3b40 2023-08-09T12:53:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f420cff9640 1 -- 172.21.15.17:0/183046867 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f800a7c0 con 0x7f42100b3b40 2023-08-09T12:53:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f420cff9640 1 -- 172.21.15.17:0/183046867 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800abb0 con 0x7f42100b3b40 2023-08-09T12:53:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42100c5f80 con 0x7f42100b3b40 2023-08-09T12:53:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.920+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42100c6780 con 0x7f42100b3b40 2023-08-09T12:53:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.922+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4210067a80 con 0x7f42100b3b40 2023-08-09T12:53:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.923+0000 7f420cff9640 1 -- 172.21.15.17:0/183046867 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f41f800ad10 con 0x7f42100b3b40 2023-08-09T12:53:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.923+0000 7f420cff9640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f41f006a050 0x7f41f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.924+0000 7f420cff9640 1 -- 172.21.15.17:0/183046867 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f41f8087f30 con 0x7f42100b3b40 2023-08-09T12:53:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.924+0000 7f420cff9640 1 -- 172.21.15.17:0/183046867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f41f0072260 con 0x7f42100b3b40 2023-08-09T12:53:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.924+0000 7f420f7fe640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f41f006a050 0x7f41f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.925+0000 7f420f7fe640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f41f006a050 0x7f41f006c510 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4200036000 tx=0x7f420003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:00.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:00.928+0000 7f420cff9640 1 -- 172.21.15.17:0/183046867 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f41f8017020 con 0x7f42100b3b40 2023-08-09T12:53:01.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.122+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f421015b290 con 0x7f42100b3b40 2023-08-09T12:53:01.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.124+0000 7f420cff9640 1 -- 172.21.15.17:0/183046867 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+18463 (secure 0 0 0) 0x7f41f80535d0 con 0x7f42100b3b40 2023-08-09T12:53:01.127 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:01.128 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":179,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:52:33.944618+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:51:31.771781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-09T12:51:32.371993+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:53:01.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f41f006a050 msgr2=0x7f41f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f41f006a050 0x7f41f006c510 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4200036000 tx=0x7f420003c040 comp rx=0 tx=0).stop 2023-08-09T12:53:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100b3b40 msgr2=0x7f4210159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100b3b40 0x7f4210159e50 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f41f800c840 tx=0x7f41f800cd00 comp rx=0 tx=0).stop 2023-08-09T12:53:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 shutdown_connections 2023-08-09T12:53:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f41f006a050 0x7f41f006c510 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42100cc630 0x7f421015a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100b3b40 0x7f4210159e50 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 --2- 172.21.15.17:0/183046867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42100adc40 0x7f421014fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 >> 172.21.15.17:0/183046867 conn(0x7f42100cb1b0 msgr2=0x7f421006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:01.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 shutdown_connections 2023-08-09T12:53:01.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.127+0000 7f4215afa640 1 -- 172.21.15.17:0/183046867 wait complete. 2023-08-09T12:53:01.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:51:31.771781+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:51:32.371993+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:53:01.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:53:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.378+0000 7f99b4399640 1 Processor -- start 2023-08-09T12:53:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.378+0000 7f99b4399640 1 -- start start 2023-08-09T12:53:01.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.379+0000 7f99b4399640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99ac070a90 0x7f99ac0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.379+0000 7f99b4399640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac0b4630 con 0x7f99ac0ad810 2023-08-09T12:53:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.379+0000 7f99b4399640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac0b3ab0 con 0x7f99ac159d80 2023-08-09T12:53:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.379+0000 7f99b4399640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac15a160 con 0x7f99ac070a90 2023-08-09T12:53:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.380+0000 7f99b2936640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f99ac0ad810 0x7f99ac0c8fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45910/0 (socket says 172.21.15.17:45910) 2023-08-09T12:53:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.380+0000 7f99b2936640 1 -- 172.21.15.17:0/3503565971 learned_addr learned my addr 172.21.15.17:0/3503565971 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.380+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646242549 0 0) 0x7f99ac0b4630 con 0x7f99ac0ad810 2023-08-09T12:53:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.380+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9998005730 con 0x7f99ac0ad810 2023-08-09T12:53:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.380+0000 7f99b1934640 1 --2- 172.21.15.17:0/3503565971 >> v2:172.21.15.142:3300/0 conn(0x7f99ac070a90 0x7f99ac0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660307391 0 0) 0x7f9998005730 con 0x7f99ac0ad810 2023-08-09T12:53:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 >> v2:172.21.15.142:3300/0 conn(0x7f99ac070a90 msgr2=0x7f99ac0b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 --2- 172.21.15.17:0/3503565971 >> v2:172.21.15.142:3300/0 conn(0x7f99ac070a90 0x7f99ac0b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 >> v1:172.21.15.142:6789/0 conn(0x7f99ac159d80 legacy=0x7f99ac070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0b3d90 con 0x7f99ac0ad810 2023-08-09T12:53:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f99a40019f0 con 0x7f99ac0ad810 2023-08-09T12:53:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 >> v1:172.21.15.17:6789/0 conn(0x7f99ac0ad810 legacy=0x7f99ac0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9998005b80 0x7f9998005f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99980069d0 0x7f9998006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9998007390 0x7f999800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac15a160 con 0x7f99980069d0 2023-08-09T12:53:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999800e260 con 0x7f9998007390 2023-08-09T12:53:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999800e420 con 0x7f9998005b80 2023-08-09T12:53:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.381+0000 7f99b1934640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99980069d0 0x7f9998006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.382+0000 7f99b1934640 1 -- 172.21.15.17:0/3503565971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9998005b80 msgr2=0x7f9998005f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.382+0000 7f99b2135640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9998005b80 0x7f9998005f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.382+0000 7f99b2936640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9998007390 0x7f999800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.382+0000 7f99b1934640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9998005b80 0x7f9998005f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.382+0000 7f99b1934640 1 -- 172.21.15.17:0/3503565971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9998007390 msgr2=0x7f999800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:01.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.382+0000 7f99b1934640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9998007390 0x7f999800db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.382+0000 7f99b1934640 1 -- 172.21.15.17:0/3503565971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998005730 con 0x7f99980069d0 2023-08-09T12:53:01.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.382+0000 7f99b2936640 1 -- 172.21.15.17:0/3503565971 reap_dead start 2023-08-09T12:53:01.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.383+0000 7f99b1934640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99980069d0 0x7f9998006e50 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ba10 tx=0x7f9998007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37841bff2684929a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:01.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.383+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c005b90 con 0x7f99980069d0 2023-08-09T12:53:01.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.383+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c005cf0 con 0x7f99980069d0 2023-08-09T12:53:01.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.383+0000 7f99b1133640 1 -- 172.21.15.17:0/3503565971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c006270 con 0x7f99980069d0 2023-08-09T12:53:01.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.384+0000 7f99b4399640 1 -- 172.21.15.17:0/3503565971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99980069d0 msgr2=0x7f9998006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.384+0000 7f99b4399640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99980069d0 0x7f9998006e50 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ba10 tx=0x7f9998007a00 comp rx=0 tx=0).stop 2023-08-09T12:53:01.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.384+0000 7f99b4399640 1 -- 172.21.15.17:0/3503565971 shutdown_connections 2023-08-09T12:53:01.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.384+0000 7f99b4399640 1 --2- 172.21.15.17:0/3503565971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99980069d0 0x7f9998006e50 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.384+0000 7f99b4399640 1 -- 172.21.15.17:0/3503565971 >> 172.21.15.17:0/3503565971 conn(0x7f99ac0cb1b0 msgr2=0x7f99ac0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:01.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.385+0000 7f99b4399640 1 -- 172.21.15.17:0/3503565971 shutdown_connections 2023-08-09T12:53:01.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.385+0000 7f99b4399640 1 -- 172.21.15.17:0/3503565971 wait complete. 2023-08-09T12:53:01.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.387+0000 7f99b4399640 1 Processor -- start 2023-08-09T12:53:01.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.388+0000 7f99b4399640 1 -- start start 2023-08-09T12:53:01.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.389+0000 7f99b4399640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99980069d0 0x7f99ac153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.389+0000 7f99b4399640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ac0ae190 0x7f99ac0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.389+0000 7f99b4399640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0aeb50 0x7f99ac0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.389+0000 7f99b4399640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0af3c0 con 0x7f99ac0ae190 2023-08-09T12:53:01.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.389+0000 7f99b4399640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac1542d0 con 0x7f99ac0aeb50 2023-08-09T12:53:01.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.389+0000 7f99b4399640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0af0e0 con 0x7f99980069d0 2023-08-09T12:53:01.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b1934640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ac0ae190 0x7f99ac0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b1934640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ac0ae190 0x7f99ac0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51742/0 (socket says 172.21.15.17:51742) 2023-08-09T12:53:01.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b1934640 1 -- 172.21.15.17:0/176509149 learned_addr learned my addr 172.21.15.17:0/176509149 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:01.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b2135640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99980069d0 0x7f99ac153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b2936640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0aeb50 0x7f99ac0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b1934640 1 -- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99980069d0 msgr2=0x7f99ac153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b1934640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99980069d0 0x7f99ac153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b1934640 1 -- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0aeb50 msgr2=0x7f99ac0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b1934640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0aeb50 0x7f99ac0acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b1934640 1 -- 172.21.15.17:0/176509149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0b0ad0 con 0x7f99ac0ae190 2023-08-09T12:53:01.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.390+0000 7f99b2936640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0aeb50 0x7f99ac0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:01.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.391+0000 7f99b1934640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ac0ae190 0x7f99ac0ac8b0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f999c00bb30 tx=0x7f999c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:01.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.391+0000 7f99a2ffd640 1 -- 172.21.15.17:0/176509149 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c003c40 con 0x7f99ac0ae190 2023-08-09T12:53:01.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.391+0000 7f99a2ffd640 1 -- 172.21.15.17:0/176509149 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c040070 con 0x7f99ac0ae190 2023-08-09T12:53:01.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.391+0000 7f99a2ffd640 1 -- 172.21.15.17:0/176509149 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0044c0 con 0x7f99ac0ae190 2023-08-09T12:53:01.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.391+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac0b0db0 con 0x7f99ac0ae190 2023-08-09T12:53:01.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.391+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac0c84b0 con 0x7f99ac0ae190 2023-08-09T12:53:01.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.393+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac0c86a0 con 0x7f99ac0ae190 2023-08-09T12:53:01.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.393+0000 7f99a2ffd640 1 -- 172.21.15.17:0/176509149 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f999c042030 con 0x7f99ac0ae190 2023-08-09T12:53:01.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.394+0000 7f99a2ffd640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f999006a080 0x7f999006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.395+0000 7f99a2ffd640 1 -- 172.21.15.17:0/176509149 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f999c0aac60 con 0x7f99ac0ae190 2023-08-09T12:53:01.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.395+0000 7f99a2ffd640 1 -- 172.21.15.17:0/176509149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f9990072290 con 0x7f99ac0ae190 2023-08-09T12:53:01.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.395+0000 7f99b2135640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f999006a080 0x7f999006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.396+0000 7f99b2135640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f999006a080 0x7f999006c540 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f99a8007fd0 tx=0x7f99a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:01.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.399+0000 7f99a2ffd640 1 -- 172.21.15.17:0/176509149 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f999c076300 con 0x7f99ac0ae190 2023-08-09T12:53:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.589+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99ac0c6210 con 0x7f99ac0ae190 2023-08-09T12:53:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.590+0000 7f99a2ffd640 1 -- 172.21.15.17:0/176509149 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99ac0c6210 con 0x7f99ac0ae190 2023-08-09T12:53:01.593 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:53:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f999006a080 msgr2=0x7f999006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f999006a080 0x7f999006c540 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f99a8007fd0 tx=0x7f99a8009040 comp rx=0 tx=0).stop 2023-08-09T12:53:01.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ac0ae190 msgr2=0x7f99ac0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ac0ae190 0x7f99ac0ac8b0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f999c00bb30 tx=0x7f999c004730 comp rx=0 tx=0).stop 2023-08-09T12:53:01.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 shutdown_connections 2023-08-09T12:53:01.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f999006a080 0x7f999006c540 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99ac0aeb50 0x7f99ac0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ac0ae190 0x7f99ac0ac8b0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 --2- 172.21.15.17:0/176509149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99980069d0 0x7f99ac153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.592+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 >> 172.21.15.17:0/176509149 conn(0x7f99ac0cb1b0 msgr2=0x7f99ac069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:01.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.593+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 shutdown_connections 2023-08-09T12:53:01.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.593+0000 7f99b4399640 1 -- 172.21.15.17:0/176509149 wait complete. 2023-08-09T12:53:01.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:53:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.833+0000 7fcddde21640 1 Processor -- start 2023-08-09T12:53:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.834+0000 7fcddde21640 1 -- start start 2023-08-09T12:53:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.835+0000 7fcddde21640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcdd815cb40 0x7fcdd81609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.835+0000 7fcddde21640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd80d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.835+0000 7fcddde21640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd80d0f00 con 0x7fcdd80b8420 2023-08-09T12:53:01.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.835+0000 7fcddde21640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd81611f0 con 0x7fcdd815cb40 2023-08-09T12:53:01.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.835+0000 7fcddde21640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd81614d0 con 0x7fcdd80cdf70 2023-08-09T12:53:01.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.836+0000 7fcddd620640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd80d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.836+0000 7fcddd620640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd80d16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:53462/0 (socket says 172.21.15.17:53462) 2023-08-09T12:53:01.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.836+0000 7fcddd620640 1 -- 172.21.15.17:0/3182079387 learned_addr learned my addr 172.21.15.17:0/3182079387 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:01.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.837+0000 7fcddce1f640 1 --2- 172.21.15.17:0/3182079387 >> v2:172.21.15.142:3300/0 conn(0x7fcdd815cb40 0x7fcdd81609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.837+0000 7fcddd620640 1 -- 172.21.15.17:0/3182079387 >> v2:172.21.15.142:3300/0 conn(0x7fcdd815cb40 msgr2=0x7fcdd81609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:01.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.837+0000 7fcddd620640 1 --2- 172.21.15.17:0/3182079387 >> v2:172.21.15.142:3300/0 conn(0x7fcdd815cb40 0x7fcdd81609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.837+0000 7fcddd620640 1 -- 172.21.15.17:0/3182079387 >> v1:172.21.15.142:6789/0 conn(0x7fcdd80b8420 legacy=0x7fcdd80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.837+0000 7fcddd620640 1 -- 172.21.15.17:0/3182079387 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd81617b0 con 0x7fcdd80cdf70 2023-08-09T12:53:01.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.837+0000 7fcdd77fe640 1 -- 172.21.15.17:0/3182079387 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248652358 0 0) 0x7fcdd80d0f00 con 0x7fcdd80b8420 2023-08-09T12:53:01.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.839+0000 7fcddd620640 1 --2- 172.21.15.17:0/3182079387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd80d16c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009e50 tx=0x7fcdd002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6278cc36476c56dc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.839+0000 7fcdd77fe640 1 -- 172.21.15.17:0/3182079387 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd002cb90 con 0x7fcdd80cdf70 2023-08-09T12:53:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.839+0000 7fcdd77fe640 1 -- 172.21.15.17:0/3182079387 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd002ccf0 con 0x7fcdd80cdf70 2023-08-09T12:53:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.839+0000 7fcdd77fe640 1 -- 172.21.15.17:0/3182079387 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0034610 con 0x7fcdd80cdf70 2023-08-09T12:53:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.840+0000 7fcddde21640 1 -- 172.21.15.17:0/3182079387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 msgr2=0x7fcdd80d16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.840+0000 7fcddde21640 1 --2- 172.21.15.17:0/3182079387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd80d16c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009e50 tx=0x7fcdd002bff0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.840+0000 7fcddde21640 1 -- 172.21.15.17:0/3182079387 shutdown_connections 2023-08-09T12:53:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.840+0000 7fcddde21640 1 --2- 172.21.15.17:0/3182079387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd80d16c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.840+0000 7fcddde21640 1 --2- 172.21.15.17:0/3182079387 >> v2:172.21.15.142:3300/0 conn(0x7fcdd815cb40 0x7fcdd81609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.840+0000 7fcddde21640 1 -- 172.21.15.17:0/3182079387 >> 172.21.15.17:0/3182079387 conn(0x7fcdd80d2ab0 msgr2=0x7fcdd80d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.840+0000 7fcddde21640 1 -- 172.21.15.17:0/3182079387 shutdown_connections 2023-08-09T12:53:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.840+0000 7fcddde21640 1 -- 172.21.15.17:0/3182079387 wait complete. 2023-08-09T12:53:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.842+0000 7fcddde21640 1 Processor -- start 2023-08-09T12:53:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.842+0000 7fcddde21640 1 -- start start 2023-08-09T12:53:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.843+0000 7fcddde21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd80b8420 0x7fcdd81f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.843+0000 7fcddde21640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.843+0000 7fcddde21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd815cb40 0x7fcdd80b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.843+0000 7fcddde21640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd8149130 con 0x7fcdd815cb40 2023-08-09T12:53:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.843+0000 7fcddde21640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd815f920 con 0x7fcdd80b8420 2023-08-09T12:53:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.843+0000 7fcddde21640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd815fc00 con 0x7fcdd80cdf70 2023-08-09T12:53:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddd620640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd815cb40 0x7fcdd80b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddd620640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd815cb40 0x7fcdd80b5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51752/0 (socket says 172.21.15.17:51752) 2023-08-09T12:53:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddd620640 1 -- 172.21.15.17:0/327813989 learned_addr learned my addr 172.21.15.17:0/327813989 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcdd7fff640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddce1f640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd80b8420 0x7fcdd81f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddd620640 1 -- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 msgr2=0x7fcdd815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddd620640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd815f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddd620640 1 -- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd80b8420 msgr2=0x7fcdd81f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddd620640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd80b8420 0x7fcdd81f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.844+0000 7fcddd620640 1 -- 172.21.15.17:0/327813989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0009b30 con 0x7fcdd815cb40 2023-08-09T12:53:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.845+0000 7fcddd620640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd815cb40 0x7fcdd80b5ff0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009e50 tx=0x7fcdd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.845+0000 7fcdd57fa640 1 -- 172.21.15.17:0/327813989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd003e450 con 0x7fcdd815cb40 2023-08-09T12:53:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.845+0000 7fcdd57fa640 1 -- 172.21.15.17:0/327813989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd003e5b0 con 0x7fcdd815cb40 2023-08-09T12:53:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.845+0000 7fcdd57fa640 1 -- 172.21.15.17:0/327813989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd003e960 con 0x7fcdd815cb40 2023-08-09T12:53:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.845+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd815fee0 con 0x7fcdd815cb40 2023-08-09T12:53:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.845+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd81f24a0 con 0x7fcdd815cb40 2023-08-09T12:53:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.846+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd804e390 con 0x7fcdd815cb40 2023-08-09T12:53:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.847+0000 7fcdd57fa640 1 -- 172.21.15.17:0/327813989 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcdd003eac0 con 0x7fcdd815cb40 2023-08-09T12:53:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.848+0000 7fcdd57fa640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcdbc06a050 0x7fcdbc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:01.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.848+0000 7fcdd57fa640 1 -- 172.21.15.17:0/327813989 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcdd00ab1d0 con 0x7fcdd815cb40 2023-08-09T12:53:01.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.849+0000 7fcdd57fa640 1 -- 172.21.15.17:0/327813989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fcdbc072260 con 0x7fcdd815cb40 2023-08-09T12:53:01.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.849+0000 7fcddce1f640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcdbc06a050 0x7fcdbc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:01.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.850+0000 7fcddce1f640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcdbc06a050 0x7fcdbc06c510 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc006fd0 tx=0x7fcdcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:01.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:01.853+0000 7fcdd57fa640 1 -- 172.21.15.17:0/327813989 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcdd00767e0 con 0x7fcdd815cb40 2023-08-09T12:53:02.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.046+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcdd80ce470 con 0x7fcdd815cb40 2023-08-09T12:53:02.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.047+0000 7fcdd57fa640 1 -- 172.21.15.17:0/327813989 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v179) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcdd0043020 con 0x7fcdd815cb40 2023-08-09T12:53:02.050 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:53:02.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.049+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcdbc06a050 msgr2=0x7fcdbc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.049+0000 7fcddde21640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcdbc06a050 0x7fcdbc06c510 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc006fd0 tx=0x7fcdcc008040 comp rx=0 tx=0).stop 2023-08-09T12:53:02.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.049+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd815cb40 msgr2=0x7fcdd80b5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.049+0000 7fcddde21640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd815cb40 0x7fcdd80b5ff0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009e50 tx=0x7fcdd0004a40 comp rx=0 tx=0).stop 2023-08-09T12:53:02.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.050+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 shutdown_connections 2023-08-09T12:53:02.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.050+0000 7fcddde21640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcdbc06a050 0x7fcdbc06c510 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.050+0000 7fcddde21640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd815cb40 0x7fcdd80b5ff0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.050+0000 7fcddde21640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd80cdf70 0x7fcdd815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.050+0000 7fcddde21640 1 --2- 172.21.15.17:0/327813989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd80b8420 0x7fcdd81f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.050+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 >> 172.21.15.17:0/327813989 conn(0x7fcdd80d2ab0 msgr2=0x7fcdd80b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:02.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.050+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 shutdown_connections 2023-08-09T12:53:02.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.050+0000 7fcddde21640 1 -- 172.21.15.17:0/327813989 wait complete. 2023-08-09T12:53:02.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:53:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.288+0000 7f4f1cb5b640 1 Processor -- start 2023-08-09T12:53:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.288+0000 7f4f1cb5b640 1 -- start start 2023-08-09T12:53:02.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.289+0000 7f4f1cb5b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f18159b70 0x7f4f180cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.290+0000 7f4f1cb5b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180caf20 con 0x7f4f1806f900 2023-08-09T12:53:02.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.290+0000 7f4f1cb5b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180cf300 con 0x7f4f180ce9e0 2023-08-09T12:53:02.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.290+0000 7f4f1cb5b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180afc40 con 0x7f4f18159b70 2023-08-09T12:53:02.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.290+0000 7f4f16d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4f1806f900 0x7f4f1806ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45918/0 (socket says 172.21.15.17:45918) 2023-08-09T12:53:02.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.290+0000 7f4f16d9d640 1 -- 172.21.15.17:0/1278029067 learned_addr learned my addr 172.21.15.17:0/1278029067 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:02.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.290+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594582770 0 0) 0x7f4f180caf20 con 0x7f4f1806f900 2023-08-09T12:53:02.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.290+0000 7f4f15d9b640 1 --2- 172.21.15.17:0/1278029067 >> v2:172.21.15.142:3300/0 conn(0x7f4f18159b70 0x7f4f180cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.290+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f04005730 con 0x7f4f1806f900 2023-08-09T12:53:02.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537957383 0 0) 0x7f4f04005730 con 0x7f4f1806f900 2023-08-09T12:53:02.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 >> v2:172.21.15.142:3300/0 conn(0x7f4f18159b70 msgr2=0x7f4f180cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:02.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 --2- 172.21.15.17:0/1278029067 >> v2:172.21.15.142:3300/0 conn(0x7f4f18159b70 0x7f4f180cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 >> v1:172.21.15.142:6789/0 conn(0x7f4f180ce9e0 legacy=0x7f4f1815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180aff00 con 0x7f4f1806f900 2023-08-09T12:53:02.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f4f10001670 con 0x7f4f1806f900 2023-08-09T12:53:02.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 >> v1:172.21.15.17:6789/0 conn(0x7f4f1806f900 legacy=0x7f4f1806ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f04005b80 0x7f4f04005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f040069d0 0x7f4f04006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04007390 0x7f4f0400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180afc40 con 0x7f4f04005b80 2023-08-09T12:53:02.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0400e330 con 0x7f4f04007390 2023-08-09T12:53:02.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0400e4f0 con 0x7f4f040069d0 2023-08-09T12:53:02.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.291+0000 7f4f1659c640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f04005b80 0x7f4f04005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.292+0000 7f4f15d9b640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f040069d0 0x7f4f04006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.292+0000 7f4f1659c640 1 -- 172.21.15.17:0/1278029067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f040069d0 msgr2=0x7f4f04006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:02.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.292+0000 7f4f1659c640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f040069d0 0x7f4f04006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.292+0000 7f4f1659c640 1 -- 172.21.15.17:0/1278029067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04007390 msgr2=0x7f4f0400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:02.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.292+0000 7f4f1659c640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04007390 0x7f4f0400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.292+0000 7f4f1659c640 1 -- 172.21.15.17:0/1278029067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04005730 con 0x7f4f04005b80 2023-08-09T12:53:02.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.292+0000 7f4f16d9d640 1 -- 172.21.15.17:0/1278029067 reap_dead start 2023-08-09T12:53:02.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.293+0000 7f4f1659c640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f04005b80 0x7f4f04005fa0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f4f08001e50 tx=0x7f4f04007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3878e68db0ee0c46 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.293+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08003b70 con 0x7f4f04005b80 2023-08-09T12:53:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.293+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08003cd0 con 0x7f4f04005b80 2023-08-09T12:53:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.293+0000 7f4f1559a640 1 -- 172.21.15.17:0/1278029067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08005310 con 0x7f4f04005b80 2023-08-09T12:53:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.293+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/1278029067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f04005b80 msgr2=0x7f4f04005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.293+0000 7f4f1cb5b640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f04005b80 0x7f4f04005fa0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f4f08001e50 tx=0x7f4f04007a00 comp rx=0 tx=0).stop 2023-08-09T12:53:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.294+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/1278029067 shutdown_connections 2023-08-09T12:53:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.294+0000 7f4f1cb5b640 1 --2- 172.21.15.17:0/1278029067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f04005b80 0x7f4f04005fa0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.294+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/1278029067 >> 172.21.15.17:0/1278029067 conn(0x7f4f18069be0 msgr2=0x7f4f18069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.294+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/1278029067 shutdown_connections 2023-08-09T12:53:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.294+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/1278029067 wait complete. 2023-08-09T12:53:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.295+0000 7f4f1cb5b640 1 Processor -- start 2023-08-09T12:53:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.296+0000 7f4f1cb5b640 1 -- start start 2023-08-09T12:53:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.296+0000 7f4f1cb5b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04005b80 0x7f4f1814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.296+0000 7f4f1cb5b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180cde60 0x7f4f180ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.296+0000 7f4f1cb5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1814df70 0x7f4f1814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.296+0000 7f4f1cb5b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815c740 con 0x7f4f1814df70 2023-08-09T12:53:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.296+0000 7f4f1cb5b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815c920 con 0x7f4f04005b80 2023-08-09T12:53:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.296+0000 7f4f1cb5b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815cc00 con 0x7f4f180cde60 2023-08-09T12:53:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f16d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1814df70 0x7f4f1814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f16d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1814df70 0x7f4f1814d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51776/0 (socket says 172.21.15.17:51776) 2023-08-09T12:53:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f16d9d640 1 -- 172.21.15.17:0/883734134 learned_addr learned my addr 172.21.15.17:0/883734134 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f1659c640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04005b80 0x7f4f1814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f15d9b640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180cde60 0x7f4f180ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f16d9d640 1 -- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180cde60 msgr2=0x7f4f180ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f16d9d640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180cde60 0x7f4f180ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f16d9d640 1 -- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04005b80 msgr2=0x7f4f1814e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f16d9d640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04005b80 0x7f4f1814e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f16d9d640 1 -- 172.21.15.17:0/883734134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1815cee0 con 0x7f4f1814df70 2023-08-09T12:53:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f15d9b640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180cde60 0x7f4f180ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.297+0000 7f4f1659c640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04005b80 0x7f4f1814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.298+0000 7f4f16d9d640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1814df70 0x7f4f1814d340 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f4f100011e0 tx=0x7f4f1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.298+0000 7f4f0effd640 1 -- 172.21.15.17:0/883734134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10007440 con 0x7f4f1814df70 2023-08-09T12:53:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.298+0000 7f4f0effd640 1 -- 172.21.15.17:0/883734134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f100075c0 con 0x7f4f1814df70 2023-08-09T12:53:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.298+0000 7f4f0effd640 1 -- 172.21.15.17:0/883734134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10004a20 con 0x7f4f1814df70 2023-08-09T12:53:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.298+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180cd660 con 0x7f4f1814df70 2023-08-09T12:53:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.298+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180cb4c0 con 0x7f4f1814df70 2023-08-09T12:53:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.299+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f180cdb80 con 0x7f4f1814df70 2023-08-09T12:53:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.300+0000 7f4f0effd640 1 -- 172.21.15.17:0/883734134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f10004b80 con 0x7f4f1814df70 2023-08-09T12:53:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.301+0000 7f4f0effd640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ef806a050 0x7f4ef806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.301+0000 7f4f0effd640 1 -- 172.21.15.17:0/883734134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4f100878d0 con 0x7f4f1814df70 2023-08-09T12:53:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.301+0000 7f4f0effd640 1 -- 172.21.15.17:0/883734134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f4ef8072260 con 0x7f4f1814df70 2023-08-09T12:53:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.302+0000 7f4f1659c640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ef806a050 0x7f4ef806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.303+0000 7f4f1659c640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ef806a050 0x7f4ef806c510 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4f08034000 tx=0x7f4f08009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.306+0000 7f4f0effd640 1 -- 172.21.15.17:0/883734134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4f180cdb80 con 0x7f4f1814df70 2023-08-09T12:53:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.492+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f180cdb80 con 0x7f4f1814df70 2023-08-09T12:53:02.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.493+0000 7f4f0effd640 1 -- 172.21.15.17:0/883734134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v179) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f180cdb80 con 0x7f4f1814df70 2023-08-09T12:53:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:53:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ef806a050 msgr2=0x7f4ef806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ef806a050 0x7f4ef806c510 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4f08034000 tx=0x7f4f08009030 comp rx=0 tx=0).stop 2023-08-09T12:53:02.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1814df70 msgr2=0x7f4f1814d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1814df70 0x7f4f1814d340 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f4f100011e0 tx=0x7f4f1000c8e0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 shutdown_connections 2023-08-09T12:53:02.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4ef806a050 0x7f4ef806c510 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1814df70 0x7f4f1814d340 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180cde60 0x7f4f180ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 --2- 172.21.15.17:0/883734134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f04005b80 0x7f4f1814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.495+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 >> 172.21.15.17:0/883734134 conn(0x7f4f18069be0 msgr2=0x7f4f1806ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:02.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.496+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 shutdown_connections 2023-08-09T12:53:02.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.496+0000 7f4f1cb5b640 1 -- 172.21.15.17:0/883734134 wait complete. 2023-08-09T12:53:02.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:53:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.740+0000 7f9b7a2cd640 1 Processor -- start 2023-08-09T12:53:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.741+0000 7f9b7a2cd640 1 -- start start 2023-08-09T12:53:02.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.742+0000 7f9b7a2cd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9b7415cb40 0x7f9b741609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.742+0000 7f9b7a2cd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 0x7f9b740d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.742+0000 7f9b7a2cd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740d0f00 con 0x7f9b740b8420 2023-08-09T12:53:02.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.742+0000 7f9b7a2cd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b741611f0 con 0x7f9b7415cb40 2023-08-09T12:53:02.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.742+0000 7f9b7a2cd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b741614d0 con 0x7f9b740cdf70 2023-08-09T12:53:02.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b78aca640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9b740b8420 0x7f9b740cd860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45934/0 (socket says 172.21.15.17:45934) 2023-08-09T12:53:02.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b78aca640 1 -- 172.21.15.17:0/3321105606 learned_addr learned my addr 172.21.15.17:0/3321105606 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:02.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b792cb640 1 --2- 172.21.15.17:0/3321105606 >> v2:172.21.15.17:3300/0 conn(0x7f9b7415cb40 0x7f9b741609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b6bfff640 1 -- 172.21.15.17:0/3321105606 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163017050 0 0) 0x7f9b740d0f00 con 0x7f9b740b8420 2023-08-09T12:53:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b79acc640 1 --2- 172.21.15.17:0/3321105606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 0x7f9b740d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b6bfff640 1 -- 172.21.15.17:0/3321105606 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c003520 con 0x7f9b740b8420 2023-08-09T12:53:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b792cb640 1 -- 172.21.15.17:0/3321105606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 msgr2=0x7f9b740d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b792cb640 1 --2- 172.21.15.17:0/3321105606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 0x7f9b740d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b792cb640 1 -- 172.21.15.17:0/3321105606 >> v1:172.21.15.17:6789/0 conn(0x7f9b740b8420 legacy=0x7f9b740cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.743+0000 7f9b792cb640 1 -- 172.21.15.17:0/3321105606 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b741617b0 con 0x7f9b7415cb40 2023-08-09T12:53:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.745+0000 7f9b792cb640 1 --2- 172.21.15.17:0/3321105606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b7415cb40 0x7f9b741609a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f9b640097a0 tx=0x7f9b6402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b173207334eaa1c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.745+0000 7f9b6bfff640 1 -- 172.21.15.17:0/3321105606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64030800 con 0x7f9b7415cb40 2023-08-09T12:53:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.745+0000 7f9b6bfff640 1 -- 172.21.15.17:0/3321105606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64030960 con 0x7f9b7415cb40 2023-08-09T12:53:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.745+0000 7f9b6bfff640 1 -- 172.21.15.17:0/3321105606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64030cf0 con 0x7f9b7415cb40 2023-08-09T12:53:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.745+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/3321105606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b7415cb40 msgr2=0x7f9b741609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.745+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/3321105606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b7415cb40 0x7f9b741609a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f9b640097a0 tx=0x7f9b6402b940 comp rx=0 tx=0).stop 2023-08-09T12:53:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.746+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/3321105606 shutdown_connections 2023-08-09T12:53:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.746+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/3321105606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 0x7f9b740d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.746+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/3321105606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b7415cb40 0x7f9b741609a0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.746+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/3321105606 >> 172.21.15.17:0/3321105606 conn(0x7f9b740d2ab0 msgr2=0x7f9b740d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:02.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.746+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/3321105606 shutdown_connections 2023-08-09T12:53:02.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.746+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/3321105606 wait complete. 2023-08-09T12:53:02.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.747+0000 7f9b7a2cd640 1 Processor -- start 2023-08-09T12:53:02.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.748+0000 7f9b7a2cd640 1 -- start start 2023-08-09T12:53:02.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b7a2cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b740b8420 0x7f9b741f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b7a2cd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 0x7f9b740a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b7a2cd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b7415cb40 0x7f9b740a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b7a2cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b741f2630 con 0x7f9b740b8420 2023-08-09T12:53:02.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b7a2cd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740c8c00 con 0x7f9b7415cb40 2023-08-09T12:53:02.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b7a2cd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b74146b70 con 0x7f9b740cdf70 2023-08-09T12:53:02.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b792cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b740b8420 0x7f9b741f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b792cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b740b8420 0x7f9b741f20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51798/0 (socket says 172.21.15.17:51798) 2023-08-09T12:53:02.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b792cb640 1 -- 172.21.15.17:0/426372385 learned_addr learned my addr 172.21.15.17:0/426372385 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:02.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b79acc640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b7415cb40 0x7f9b740a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.749+0000 7f9b78aca640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 0x7f9b740a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b792cb640 1 -- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 msgr2=0x7f9b740a9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b792cb640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 0x7f9b740a9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b792cb640 1 -- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b7415cb40 msgr2=0x7f9b740a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b792cb640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b7415cb40 0x7f9b740a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b792cb640 1 -- 172.21.15.17:0/426372385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64009400 con 0x7f9b740b8420 2023-08-09T12:53:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b79acc640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b7415cb40 0x7f9b740a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b792cb640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b740b8420 0x7f9b741f20f0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f9b6402bf50 tx=0x7f9b640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b69ffb640 1 -- 172.21.15.17:0/426372385 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6403e070 con 0x7f9b740b8420 2023-08-09T12:53:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b69ffb640 1 -- 172.21.15.17:0/426372385 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64039a10 con 0x7f9b740b8420 2023-08-09T12:53:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b69ffb640 1 -- 172.21.15.17:0/426372385 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64039da0 con 0x7f9b740b8420 2023-08-09T12:53:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b74147410 con 0x7f9b740b8420 2023-08-09T12:53:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.750+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b741499e0 con 0x7f9b740b8420 2023-08-09T12:53:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.752+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7404e390 con 0x7f9b740b8420 2023-08-09T12:53:02.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.753+0000 7f9b69ffb640 1 -- 172.21.15.17:0/426372385 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b640423f0 con 0x7f9b740b8420 2023-08-09T12:53:02.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.754+0000 7f9b69ffb640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b6006a050 0x7f9b6006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:02.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.754+0000 7f9b69ffb640 1 -- 172.21.15.17:0/426372385 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9b640aa190 con 0x7f9b740b8420 2023-08-09T12:53:02.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.754+0000 7f9b69ffb640 1 -- 172.21.15.17:0/426372385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f9b60072260 con 0x7f9b740b8420 2023-08-09T12:53:02.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.755+0000 7f9b78aca640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b6006a050 0x7f9b6006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:02.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.756+0000 7f9b78aca640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b6006a050 0x7f9b6006c510 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9b74158080 tx=0x7f9b70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:02.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.759+0000 7f9b69ffb640 1 -- 172.21.15.17:0/426372385 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9b64048020 con 0x7f9b740b8420 2023-08-09T12:53:02.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.957+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b7415a230 con 0x7f9b740b8420 2023-08-09T12:53:02.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.958+0000 7f9b69ffb640 1 -- 172.21.15.17:0/426372385 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v179) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b640340a0 con 0x7f9b740b8420 2023-08-09T12:53:02.962 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:53:02.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b6006a050 msgr2=0x7f9b6006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b6006a050 0x7f9b6006c510 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9b74158080 tx=0x7f9b70009040 comp rx=0 tx=0).stop 2023-08-09T12:53:02.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b740b8420 msgr2=0x7f9b741f20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:02.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b740b8420 0x7f9b741f20f0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f9b6402bf50 tx=0x7f9b640046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 shutdown_connections 2023-08-09T12:53:02.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9b6006a050 0x7f9b6006c510 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b7415cb40 0x7f9b740a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b740cdf70 0x7f9b740a9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 --2- 172.21.15.17:0/426372385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b740b8420 0x7f9b741f20f0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:02.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.961+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 >> 172.21.15.17:0/426372385 conn(0x7f9b740d2ab0 msgr2=0x7f9b741581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:02.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.962+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 shutdown_connections 2023-08-09T12:53:02.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:02.962+0000 7f9b7a2cd640 1 -- 172.21.15.17:0/426372385 wait complete. 2023-08-09T12:53:02.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.200+0000 7fc2e3fff640 1 Processor -- start 2023-08-09T12:53:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.201+0000 7fc2e3fff640 1 -- start start 2023-08-09T12:53:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.202+0000 7fc2e3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2e4160030 0x7fc2e4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.202+0000 7fc2e3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 0x7fc2e40cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.202+0000 7fc2e3fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40b5a30 con 0x7fc2e40cf980 2023-08-09T12:53:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.202+0000 7fc2e3fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40d1110 con 0x7fc2e4160030 2023-08-09T12:53:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.202+0000 7fc2e3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40ceac0 con 0x7fc2e40b86e0 2023-08-09T12:53:03.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.202+0000 7fc2e37fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc2e40cf980 0x7fc2e40b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45946/0 (socket says 172.21.15.17:45946) 2023-08-09T12:53:03.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.202+0000 7fc2e37fe640 1 -- 172.21.15.17:0/2352131546 learned_addr learned my addr 172.21.15.17:0/2352131546 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:03.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e27fc640 1 --2- 172.21.15.17:0/2352131546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 0x7fc2e40cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e2ffd640 1 --2- 172.21.15.17:0/2352131546 >> v2:172.21.15.142:3300/0 conn(0x7fc2e4160030 0x7fc2e4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e1ffb640 1 -- 172.21.15.17:0/2352131546 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372470490 0 0) 0x7fc2e40b5a30 con 0x7fc2e40cf980 2023-08-09T12:53:03.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e1ffb640 1 -- 172.21.15.17:0/2352131546 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2cc003520 con 0x7fc2e40cf980 2023-08-09T12:53:03.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e27fc640 1 -- 172.21.15.17:0/2352131546 >> v2:172.21.15.142:3300/0 conn(0x7fc2e4160030 msgr2=0x7fc2e4160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:03.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e27fc640 1 --2- 172.21.15.17:0/2352131546 >> v2:172.21.15.142:3300/0 conn(0x7fc2e4160030 0x7fc2e4160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e27fc640 1 -- 172.21.15.17:0/2352131546 >> v1:172.21.15.17:6789/0 conn(0x7fc2e40cf980 legacy=0x7fc2e40b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e1ffb640 1 -- 172.21.15.17:0/2352131546 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3802771304 0 0) 0x7fc2cc003520 con 0x7fc2e40cf980 2023-08-09T12:53:03.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.203+0000 7fc2e27fc640 1 -- 172.21.15.17:0/2352131546 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40d0d70 con 0x7fc2e40b86e0 2023-08-09T12:53:03.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.205+0000 7fc2e27fc640 1 --2- 172.21.15.17:0/2352131546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 0x7fc2e40cf440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80097a0 tx=0x7fc2d802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0cb7e02bc5076c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:03.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.205+0000 7fc2e1ffb640 1 -- 172.21.15.17:0/2352131546 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc001670 con 0x7fc2e40b86e0 2023-08-09T12:53:03.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.205+0000 7fc2e1ffb640 1 -- 172.21.15.17:0/2352131546 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d802e050 con 0x7fc2e40b86e0 2023-08-09T12:53:03.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.205+0000 7fc2e1ffb640 1 -- 172.21.15.17:0/2352131546 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8030710 con 0x7fc2e40b86e0 2023-08-09T12:53:03.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.206+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2352131546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 msgr2=0x7fc2e40cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.206+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2352131546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 0x7fc2e40cf440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80097a0 tx=0x7fc2d802b790 comp rx=0 tx=0).stop 2023-08-09T12:53:03.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.206+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2352131546 shutdown_connections 2023-08-09T12:53:03.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.206+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2352131546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 0x7fc2e40cf440 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.206+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2352131546 >> v2:172.21.15.142:3300/0 conn(0x7fc2e4160030 0x7fc2e4160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.206+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2352131546 >> 172.21.15.17:0/2352131546 conn(0x7fc2e40697c0 msgr2=0x7fc2e4069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:03.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.206+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2352131546 shutdown_connections 2023-08-09T12:53:03.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.206+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2352131546 wait complete. 2023-08-09T12:53:03.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.208+0000 7fc2e3fff640 1 Processor -- start 2023-08-09T12:53:03.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.208+0000 7fc2e3fff640 1 -- start start 2023-08-09T12:53:03.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 0x7fc2e414db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e40cf980 0x7fc2e40c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e4160030 0x7fc2e40c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e3fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41f65b0 con 0x7fc2e40cf980 2023-08-09T12:53:03.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e3fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e414e040 con 0x7fc2e4160030 2023-08-09T12:53:03.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41f5970 con 0x7fc2e40b86e0 2023-08-09T12:53:03.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e40cf980 0x7fc2e40c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e40cf980 0x7fc2e40c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51806/0 (socket says 172.21.15.17:51806) 2023-08-09T12:53:03.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.209+0000 7fc2e27fc640 1 -- 172.21.15.17:0/2944617478 learned_addr learned my addr 172.21.15.17:0/2944617478 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:03.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2e27fc640 1 -- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 msgr2=0x7fc2e414db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2e27fc640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 0x7fc2e414db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2e27fc640 1 -- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e4160030 msgr2=0x7fc2e40c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2e27fc640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e4160030 0x7fc2e40c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2e27fc640 1 -- 172.21.15.17:0/2944617478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8009400 con 0x7fc2e40cf980 2023-08-09T12:53:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2e27fc640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e40cf980 0x7fc2e40c84d0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8000c00 tx=0x7fc2d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2cbfff640 1 -- 172.21.15.17:0/2944617478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8003ea0 con 0x7fc2e40cf980 2023-08-09T12:53:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2cbfff640 1 -- 172.21.15.17:0/2944617478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d80044c0 con 0x7fc2e40cf980 2023-08-09T12:53:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2cbfff640 1 -- 172.21.15.17:0/2944617478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8030750 con 0x7fc2e40cf980 2023-08-09T12:53:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e41f5c10 con 0x7fc2e40cf980 2023-08-09T12:53:03.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.210+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e41f61d0 con 0x7fc2e40cf980 2023-08-09T12:53:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.211+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e41f66f0 con 0x7fc2e40cf980 2023-08-09T12:53:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.212+0000 7fc2cbfff640 1 -- 172.21.15.17:0/2944617478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc2d8039070 con 0x7fc2e40cf980 2023-08-09T12:53:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.214+0000 7fc2cbfff640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2d006a050 0x7fc2d006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.214+0000 7fc2cbfff640 1 -- 172.21.15.17:0/2944617478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc2d80a9d40 con 0x7fc2e40cf980 2023-08-09T12:53:03.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.214+0000 7fc2cbfff640 1 -- 172.21.15.17:0/2944617478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fc2d0072260 con 0x7fc2e40cf980 2023-08-09T12:53:03.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.214+0000 7fc2e2ffd640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2d006a050 0x7fc2d006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.216+0000 7fc2e2ffd640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2d006a050 0x7fc2d006c510 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009fa0 tx=0x7fc2d400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:03.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.218+0000 7fc2cbfff640 1 -- 172.21.15.17:0/2944617478 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc2d8037060 con 0x7fc2e40cf980 2023-08-09T12:53:03.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.452+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2e404e390 con 0x7fc2e40cf980 2023-08-09T12:53:03.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.454+0000 7fc2cbfff640 1 -- 172.21.15.17:0/2944617478 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4876 (secure 0 0 0) 0x7fc2d8037030 con 0x7fc2e40cf980 2023-08-09T12:53:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/53885323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":53885323},{"type":"v1","addr":"172.21.15.142:6836","nonce":53885323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1636287832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1636287832},{"type":"v1","addr":"172.21.15.142:6837","nonce":1636287832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/758642293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":758642293},{"type":"v1","addr":"172.21.15.17:6833","nonce":758642293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:51:33.353513+0000","modified":"2023-08-09T12:51:36.903336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9000},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9000":{"gid":9000,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2739343495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2739343495},{"type":"v1","addr":"172.21.15.17:6835","nonce":2739343495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-09T12:53:03.459 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 84 2023-08-09T12:53:03.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.456+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2d006a050 msgr2=0x7fc2d006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.456+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2d006a050 0x7fc2d006c510 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009fa0 tx=0x7fc2d400b040 comp rx=0 tx=0).stop 2023-08-09T12:53:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.456+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e40cf980 msgr2=0x7fc2e40c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.456+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e40cf980 0x7fc2e40c84d0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8000c00 tx=0x7fc2d80046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.457+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 shutdown_connections 2023-08-09T12:53:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.457+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2d006a050 0x7fc2d006c510 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.457+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e4160030 0x7fc2e40c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.457+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e40cf980 0x7fc2e40c84d0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.457+0000 7fc2e3fff640 1 --2- 172.21.15.17:0/2944617478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2e40b86e0 0x7fc2e414db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.457+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 >> 172.21.15.17:0/2944617478 conn(0x7fc2e40697c0 msgr2=0x7fc2e40d1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:03.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.457+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 shutdown_connections 2023-08-09T12:53:03.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.457+0000 7fc2e3fff640 1 -- 172.21.15.17:0/2944617478 wait complete. 2023-08-09T12:53:03.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:53:03.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.707+0000 7fc1e8ecd640 1 Processor -- start 2023-08-09T12:53:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.708+0000 7fc1e8ecd640 1 -- start start 2023-08-09T12:53:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.709+0000 7fc1e8ecd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc1e4159bd0 0x7fc1e40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.709+0000 7fc1e8ecd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e406fe10 con 0x7fc1e40697c0 2023-08-09T12:53:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.709+0000 7fc1e8ecd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e4159fb0 con 0x7fc1e40b3fe0 2023-08-09T12:53:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.709+0000 7fc1e8ecd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40b11a0 con 0x7fc1e4159bd0 2023-08-09T12:53:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.709+0000 7fc1e37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc1e4159bd0 0x7fc1e40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.710+0000 7fc1e37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc1e4159bd0 0x7fc1e40ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51820/0 (socket says 172.21.15.17:51820) 2023-08-09T12:53:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.710+0000 7fc1e37fe640 1 -- 172.21.15.17:0/2069916954 learned_addr learned my addr 172.21.15.17:0/2069916954 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.710+0000 7fc1e37fe640 1 -- 172.21.15.17:0/2069916954 >> v1:172.21.15.142:6789/0 conn(0x7fc1e40b3fe0 legacy=0x7fc1e4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.710+0000 7fc1e37fe640 1 -- 172.21.15.17:0/2069916954 >> v1:172.21.15.17:6789/0 conn(0x7fc1e40697c0 legacy=0x7fc1e40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.710+0000 7fc1e37fe640 1 -- 172.21.15.17:0/2069916954 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4070970 con 0x7fc1e4159bd0 2023-08-09T12:53:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.710+0000 7fc1e2ffd640 1 -- 172.21.15.17:0/2069916954 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173781483 0 0) 0x7fc1e406fe10 con 0x7fc1e40697c0 2023-08-09T12:53:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.711+0000 7fc1e37fe640 1 --2- 172.21.15.17:0/2069916954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e40ca730 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009870 tx=0x7fc1d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd0812d26621c76 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.712+0000 7fc1e2ffd640 1 -- 172.21.15.17:0/2069916954 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4030860 con 0x7fc1e4159bd0 2023-08-09T12:53:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.712+0000 7fc1e2ffd640 1 -- 172.21.15.17:0/2069916954 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d40309c0 con 0x7fc1e4159bd0 2023-08-09T12:53:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.712+0000 7fc1e2ffd640 1 -- 172.21.15.17:0/2069916954 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4030d50 con 0x7fc1e4159bd0 2023-08-09T12:53:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.712+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/2069916954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 msgr2=0x7fc1e40ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.712+0000 7fc1e8ecd640 1 --2- 172.21.15.17:0/2069916954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e40ca730 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009870 tx=0x7fc1d402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.713+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/2069916954 shutdown_connections 2023-08-09T12:53:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.713+0000 7fc1e8ecd640 1 --2- 172.21.15.17:0/2069916954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e40ca730 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.713+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/2069916954 >> 172.21.15.17:0/2069916954 conn(0x7fc1e40b1d50 msgr2=0x7fc1e406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.713+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/2069916954 shutdown_connections 2023-08-09T12:53:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.713+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/2069916954 wait complete. 2023-08-09T12:53:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.714+0000 7fc1e8ecd640 1 Processor -- start 2023-08-09T12:53:03.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.715+0000 7fc1e8ecd640 1 -- start start 2023-08-09T12:53:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e8ecd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e40697c0 0x7fc1e40c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e8ecd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1e40b3fe0 0x7fc1e40c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e8ecd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e415bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e8ecd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e415bb10 con 0x7fc1e4159bd0 2023-08-09T12:53:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e8ecd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c4130 con 0x7fc1e40697c0 2023-08-09T12:53:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e8ecd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c3b70 con 0x7fc1e40b3fe0 2023-08-09T12:53:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e415bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e415bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51828/0 (socket says 172.21.15.17:51828) 2023-08-09T12:53:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e3fff640 1 -- 172.21.15.17:0/833392344 learned_addr learned my addr 172.21.15.17:0/833392344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e37fe640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e40697c0 0x7fc1e40c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1daffd640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1e40b3fe0 0x7fc1e40c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e3fff640 1 -- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1e40b3fe0 msgr2=0x7fc1e40c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e3fff640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1e40b3fe0 0x7fc1e40c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e3fff640 1 -- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e40697c0 msgr2=0x7fc1e40c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.716+0000 7fc1e3fff640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e40697c0 0x7fc1e40c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.717+0000 7fc1e3fff640 1 -- 172.21.15.17:0/833392344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40094d0 con 0x7fc1e4159bd0 2023-08-09T12:53:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.717+0000 7fc1daffd640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1e40b3fe0 0x7fc1e40c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.717+0000 7fc1e3fff640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e415bfa0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc001560 tx=0x7fc1dc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.717+0000 7fc1e0ff9640 1 -- 172.21.15.17:0/833392344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc003da0 con 0x7fc1e4159bd0 2023-08-09T12:53:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.717+0000 7fc1e0ff9640 1 -- 172.21.15.17:0/833392344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc005070 con 0x7fc1e4159bd0 2023-08-09T12:53:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.717+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e40c3e50 con 0x7fc1e4159bd0 2023-08-09T12:53:03.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.717+0000 7fc1e0ff9640 1 -- 172.21.15.17:0/833392344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc005420 con 0x7fc1e4159bd0 2023-08-09T12:53:03.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.717+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e40c37b0 con 0x7fc1e4159bd0 2023-08-09T12:53:03.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.718+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e404e390 con 0x7fc1e4159bd0 2023-08-09T12:53:03.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.720+0000 7fc1e0ff9640 1 -- 172.21.15.17:0/833392344 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc1dc005580 con 0x7fc1e4159bd0 2023-08-09T12:53:03.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.721+0000 7fc1e0ff9640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc1c806a080 0x7fc1c806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:03.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.721+0000 7fc1e0ff9640 1 -- 172.21.15.17:0/833392344 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc1dc087e60 con 0x7fc1e4159bd0 2023-08-09T12:53:03.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.721+0000 7fc1e0ff9640 1 -- 172.21.15.17:0/833392344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fc1c8072290 con 0x7fc1e4159bd0 2023-08-09T12:53:03.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.721+0000 7fc1e37fe640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc1c806a080 0x7fc1c806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:03.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.722+0000 7fc1e37fe640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc1c806a080 0x7fc1c806c540 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4036000 tx=0x7fc1d403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:03.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.725+0000 7fc1e0ff9640 1 -- 172.21.15.17:0/833392344 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc1dc017070 con 0x7fc1e4159bd0 2023-08-09T12:53:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.917+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1e40b2a70 con 0x7fc1e4159bd0 2023-08-09T12:53:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.919+0000 7fc1e0ff9640 1 -- 172.21.15.17:0/833392344 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+18463 (secure 0 0 0) 0x7fc1dc053500 con 0x7fc1e4159bd0 2023-08-09T12:53:03.922 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:03.922 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":179,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:52:33.944618+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:51:31.771781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-09T12:51:32.371993+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:53:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc1c806a080 msgr2=0x7fc1c806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc1c806a080 0x7fc1c806c540 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4036000 tx=0x7fc1d403b040 comp rx=0 tx=0).stop 2023-08-09T12:53:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 msgr2=0x7fc1e415bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e415bfa0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc001560 tx=0x7fc1dc00cc70 comp rx=0 tx=0).stop 2023-08-09T12:53:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 shutdown_connections 2023-08-09T12:53:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc1c806a080 0x7fc1c806c540 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4159bd0 0x7fc1e415bfa0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1e40b3fe0 0x7fc1e40c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 --2- 172.21.15.17:0/833392344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e40697c0 0x7fc1e40c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 >> 172.21.15.17:0/833392344 conn(0x7fc1e40b1d50 msgr2=0x7fc1e40b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.921+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 shutdown_connections 2023-08-09T12:53:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:03.922+0000 7fc1e8ecd640 1 -- 172.21.15.17:0/833392344 wait complete. 2023-08-09T12:53:03.945 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:53:03.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.155+0000 7fe34e3a6640 1 Processor -- start 2023-08-09T12:53:04.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.155+0000 7fe34e3a6640 1 -- start start 2023-08-09T12:53:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34e3a6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe348161280 0x7fe3480c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34e3a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe348161660 0x7fe3480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34e3a6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3480ca450 0x7fe3480acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34e3a6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34815d430 con 0x7fe3480ca450 2023-08-09T12:53:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34e3a6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34815df30 con 0x7fe348161280 2023-08-09T12:53:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34e3a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480ca9d0 con 0x7fe348161660 2023-08-09T12:53:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34c943640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3480ca450 0x7fe3480acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34c943640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3480ca450 0x7fe3480acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51840/0 (socket says 172.21.15.17:51840) 2023-08-09T12:53:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.157+0000 7fe34c943640 1 -- 172.21.15.17:0/4275365574 learned_addr learned my addr 172.21.15.17:0/4275365574 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe347fff640 1 --2- 172.21.15.17:0/4275365574 >> v2:172.21.15.142:3300/0 conn(0x7fe348161280 0x7fe3480c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe3477fe640 1 --2- 172.21.15.17:0/4275365574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe348161660 0x7fe3480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe34c943640 1 -- 172.21.15.17:0/4275365574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe348161660 msgr2=0x7fe3480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe34c943640 1 --2- 172.21.15.17:0/4275365574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe348161660 0x7fe3480ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe34c943640 1 -- 172.21.15.17:0/4275365574 >> v2:172.21.15.142:3300/0 conn(0x7fe348161280 msgr2=0x7fe3480c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe34c943640 1 --2- 172.21.15.17:0/4275365574 >> v2:172.21.15.142:3300/0 conn(0x7fe348161280 0x7fe3480c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe34c943640 1 -- 172.21.15.17:0/4275365574 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34815e3c0 con 0x7fe3480ca450 2023-08-09T12:53:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe347fff640 1 --2- 172.21.15.17:0/4275365574 >> v2:172.21.15.142:3300/0 conn(0x7fe348161280 0x7fe3480c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.158+0000 7fe3477fe640 1 --2- 172.21.15.17:0/4275365574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe348161660 0x7fe3480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.160+0000 7fe34c943640 1 --2- 172.21.15.17:0/4275365574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480ca450 0x7fe3480acdf0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fe3480ad990 tx=0x7fe34002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8dc506ead05ab3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.160+0000 7fe346ffd640 1 -- 172.21.15.17:0/4275365574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34002c9e0 con 0x7fe3480ca450 2023-08-09T12:53:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.160+0000 7fe346ffd640 1 -- 172.21.15.17:0/4275365574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34002cb40 con 0x7fe3480ca450 2023-08-09T12:53:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.160+0000 7fe346ffd640 1 -- 172.21.15.17:0/4275365574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3400343f0 con 0x7fe3480ca450 2023-08-09T12:53:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 -- 172.21.15.17:0/4275365574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480ca450 msgr2=0x7fe3480acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/4275365574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480ca450 0x7fe3480acdf0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fe3480ad990 tx=0x7fe34002be40 comp rx=0 tx=0).stop 2023-08-09T12:53:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 -- 172.21.15.17:0/4275365574 shutdown_connections 2023-08-09T12:53:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/4275365574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480ca450 0x7fe3480acdf0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/4275365574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe348161660 0x7fe3480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/4275365574 >> v2:172.21.15.142:3300/0 conn(0x7fe348161280 0x7fe3480c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 -- 172.21.15.17:0/4275365574 >> 172.21.15.17:0/4275365574 conn(0x7fe3480cb1b0 msgr2=0x7fe3480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 -- 172.21.15.17:0/4275365574 shutdown_connections 2023-08-09T12:53:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.161+0000 7fe34e3a6640 1 -- 172.21.15.17:0/4275365574 wait complete. 2023-08-09T12:53:04.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.163+0000 7fe34e3a6640 1 Processor -- start 2023-08-09T12:53:04.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.163+0000 7fe34e3a6640 1 -- start start 2023-08-09T12:53:04.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.164+0000 7fe34e3a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3480ca450 0x7fe348150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.164+0000 7fe34e3a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe348161280 0x7fe34814bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.164+0000 7fe34e3a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe348161660 0x7fe348149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.164+0000 7fe34e3a6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480af0e0 con 0x7fe348161660 2023-08-09T12:53:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.164+0000 7fe34e3a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480af3c0 con 0x7fe348161280 2023-08-09T12:53:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.164+0000 7fe34e3a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480af6a0 con 0x7fe3480ca450 2023-08-09T12:53:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe348161660 0x7fe348149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe348161660 0x7fe348149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51856/0 (socket says 172.21.15.17:51856) 2023-08-09T12:53:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 -- 172.21.15.17:0/2193443859 learned_addr learned my addr 172.21.15.17:0/2193443859 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe3477fe640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe348161280 0x7fe34814bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe347fff640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3480ca450 0x7fe348150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 -- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3480ca450 msgr2=0x7fe348150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3480ca450 0x7fe348150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 -- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe348161280 msgr2=0x7fe34814bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe348161280 0x7fe34814bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 -- 172.21.15.17:0/2193443859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340009b30 con 0x7fe348161660 2023-08-09T12:53:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.165+0000 7fe34c943640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe348161660 0x7fe348149e40 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fe340036040 tx=0x7fe340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.166+0000 7fe344ff9640 1 -- 172.21.15.17:0/2193443859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340009510 con 0x7fe348161660 2023-08-09T12:53:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.166+0000 7fe344ff9640 1 -- 172.21.15.17:0/2193443859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34003e450 con 0x7fe348161660 2023-08-09T12:53:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.166+0000 7fe344ff9640 1 -- 172.21.15.17:0/2193443859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34003e800 con 0x7fe348161660 2023-08-09T12:53:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.166+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3480af980 con 0x7fe348161660 2023-08-09T12:53:04.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.166+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3481510b0 con 0x7fe348161660 2023-08-09T12:53:04.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.167+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe348151240 con 0x7fe348161660 2023-08-09T12:53:04.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.168+0000 7fe344ff9640 1 -- 172.21.15.17:0/2193443859 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe34003e960 con 0x7fe348161660 2023-08-09T12:53:04.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.169+0000 7fe344ff9640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33406a080 0x7fe33406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.169+0000 7fe344ff9640 1 -- 172.21.15.17:0/2193443859 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe3400ab360 con 0x7fe348161660 2023-08-09T12:53:04.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.170+0000 7fe347fff640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33406a080 0x7fe33406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.171+0000 7fe347fff640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33406a080 0x7fe33406c540 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe338006fd0 tx=0x7fe338008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:04.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.174+0000 7fe344ff9640 1 -- 172.21.15.17:0/2193443859 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe340076b20 con 0x7fe348161660 2023-08-09T12:53:04.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.406+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3480afe40 con 0x7fe348161660 2023-08-09T12:53:04.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.407+0000 7fe344ff9640 1 -- 172.21.15.17:0/2193443859 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4876 (secure 0 0 0) 0x7fe34007a140 con 0x7fe348161660 2023-08-09T12:53:04.410 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:04.411 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/53885323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":53885323},{"type":"v1","addr":"172.21.15.142:6836","nonce":53885323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1636287832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1636287832},{"type":"v1","addr":"172.21.15.142:6837","nonce":1636287832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/758642293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":758642293},{"type":"v1","addr":"172.21.15.17:6833","nonce":758642293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:51:33.353513+0000","modified":"2023-08-09T12:51:36.903336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9000},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9000":{"gid":9000,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2739343495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2739343495},{"type":"v1","addr":"172.21.15.17:6835","nonce":2739343495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-09T12:53:04.411 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 84 2023-08-09T12:53:04.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33406a080 msgr2=0x7fe33406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33406a080 0x7fe33406c540 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe338006fd0 tx=0x7fe338008040 comp rx=0 tx=0).stop 2023-08-09T12:53:04.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe348161660 msgr2=0x7fe348149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe348161660 0x7fe348149e40 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fe340036040 tx=0x7fe340004a40 comp rx=0 tx=0).stop 2023-08-09T12:53:04.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 shutdown_connections 2023-08-09T12:53:04.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33406a080 0x7fe33406c540 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe348161660 0x7fe348149e40 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe348161280 0x7fe34814bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 --2- 172.21.15.17:0/2193443859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3480ca450 0x7fe348150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 >> 172.21.15.17:0/2193443859 conn(0x7fe3480cb1b0 msgr2=0x7fe3480ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:04.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 shutdown_connections 2023-08-09T12:53:04.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.410+0000 7fe34e3a6640 1 -- 172.21.15.17:0/2193443859 wait complete. 2023-08-09T12:53:04.432 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.658+0000 7faddd621640 1 Processor -- start 2023-08-09T12:53:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.658+0000 7faddd621640 1 -- start start 2023-08-09T12:53:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7faddd621640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fadd8159a10 0x7fadd8065f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7faddd621640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fadd80ce3e0 0x7fadd80cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7faddd621640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80cebc0 con 0x7fadd806b490 2023-08-09T12:53:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7faddd621640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd8159df0 con 0x7fadd8159a10 2023-08-09T12:53:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7faddd621640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80ce150 con 0x7fadd80ce3e0 2023-08-09T12:53:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7fadd7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fadd8159a10 0x7fadd8065f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7faddce20640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fadd806b490 0x7fadd806b8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45962/0 (socket says 172.21.15.17:45962) 2023-08-09T12:53:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7faddce20640 1 -- 172.21.15.17:0/4001740389 learned_addr learned my addr 172.21.15.17:0/4001740389 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.660+0000 7fadcf7fe640 1 --2- 172.21.15.17:0/4001740389 >> v2:172.21.15.142:3300/0 conn(0x7fadd80ce3e0 0x7fadd80cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.661+0000 7fadd77fe640 1 -- 172.21.15.17:0/4001740389 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443264751 0 0) 0x7fadd80cebc0 con 0x7fadd806b490 2023-08-09T12:53:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.661+0000 7fadd77fe640 1 -- 172.21.15.17:0/4001740389 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc4003520 con 0x7fadd806b490 2023-08-09T12:53:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.661+0000 7fadd7fff640 1 -- 172.21.15.17:0/4001740389 >> v2:172.21.15.142:3300/0 conn(0x7fadd80ce3e0 msgr2=0x7fadd80cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.661+0000 7fadd7fff640 1 --2- 172.21.15.17:0/4001740389 >> v2:172.21.15.142:3300/0 conn(0x7fadd80ce3e0 0x7fadd80cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.661+0000 7fadd7fff640 1 -- 172.21.15.17:0/4001740389 >> v1:172.21.15.17:6789/0 conn(0x7fadd806b490 legacy=0x7fadd806b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.661+0000 7fadd7fff640 1 -- 172.21.15.17:0/4001740389 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80ce8e0 con 0x7fadd8159a10 2023-08-09T12:53:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.661+0000 7fadcf7fe640 1 --2- 172.21.15.17:0/4001740389 >> v2:172.21.15.142:3300/0 conn(0x7fadd80ce3e0 0x7fadd80cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.662+0000 7fadd7fff640 1 --2- 172.21.15.17:0/4001740389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8159a10 0x7fadd8065f70 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fadd80ae8f0 tx=0x7fadc802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ec2134334294a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.662+0000 7fadd77fe640 1 -- 172.21.15.17:0/4001740389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8031830 con 0x7fadd8159a10 2023-08-09T12:53:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.662+0000 7fadd77fe640 1 -- 172.21.15.17:0/4001740389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc8031990 con 0x7fadd8159a10 2023-08-09T12:53:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.662+0000 7fadd77fe640 1 -- 172.21.15.17:0/4001740389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8031d20 con 0x7fadd8159a10 2023-08-09T12:53:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.663+0000 7faddd621640 1 -- 172.21.15.17:0/4001740389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8159a10 msgr2=0x7fadd8065f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.663+0000 7faddd621640 1 --2- 172.21.15.17:0/4001740389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8159a10 0x7fadd8065f70 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fadd80ae8f0 tx=0x7fadc802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.663+0000 7faddd621640 1 -- 172.21.15.17:0/4001740389 shutdown_connections 2023-08-09T12:53:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.663+0000 7faddd621640 1 --2- 172.21.15.17:0/4001740389 >> v2:172.21.15.142:3300/0 conn(0x7fadd80ce3e0 0x7fadd80cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.663+0000 7faddd621640 1 --2- 172.21.15.17:0/4001740389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8159a10 0x7fadd8065f70 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.663+0000 7faddd621640 1 -- 172.21.15.17:0/4001740389 >> 172.21.15.17:0/4001740389 conn(0x7fadd80cb900 msgr2=0x7fadd80cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:04.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.663+0000 7faddd621640 1 -- 172.21.15.17:0/4001740389 shutdown_connections 2023-08-09T12:53:04.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.663+0000 7faddd621640 1 -- 172.21.15.17:0/4001740389 wait complete. 2023-08-09T12:53:04.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.665+0000 7faddd621640 1 Processor -- start 2023-08-09T12:53:04.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.665+0000 7faddd621640 1 -- start start 2023-08-09T12:53:04.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7faddd621640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd806b490 0x7fadd8155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7faddd621640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80ce3e0 0x7fadd80c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7faddd621640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8159a10 0x7fadd815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7faddd621640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c7080 con 0x7fadd806b490 2023-08-09T12:53:04.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7faddd621640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81558a0 con 0x7fadd8159a10 2023-08-09T12:53:04.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7faddd621640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c69f0 con 0x7fadd80ce3e0 2023-08-09T12:53:04.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd806b490 0x7fadd8155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd806b490 0x7fadd8155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51884/0 (socket says 172.21.15.17:51884) 2023-08-09T12:53:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.666+0000 7fadd7fff640 1 -- 172.21.15.17:0/2037535303 learned_addr learned my addr 172.21.15.17:0/2037535303 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.667+0000 7fadd7fff640 1 -- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80ce3e0 msgr2=0x7fadd80c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.667+0000 7fadd7fff640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80ce3e0 0x7fadd80c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.667+0000 7faddce20640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8159a10 0x7fadd815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.667+0000 7fadd7fff640 1 -- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8159a10 msgr2=0x7fadd815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.667+0000 7fadd7fff640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8159a10 0x7fadd815af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.667+0000 7fadd7fff640 1 -- 172.21.15.17:0/2037535303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8009400 con 0x7fadd806b490 2023-08-09T12:53:04.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.667+0000 7fadd7fff640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd806b490 0x7fadd8155360 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009890 tx=0x7fadc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.668+0000 7fadd57fa640 1 -- 172.21.15.17:0/2037535303 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc803a6f0 con 0x7fadd806b490 2023-08-09T12:53:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.668+0000 7fadd57fa640 1 -- 172.21.15.17:0/2037535303 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc803a870 con 0x7fadd806b490 2023-08-09T12:53:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.668+0000 7fadd57fa640 1 -- 172.21.15.17:0/2037535303 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc803ac20 con 0x7fadd806b490 2023-08-09T12:53:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.668+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80c6cd0 con 0x7fadd806b490 2023-08-09T12:53:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.668+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd80c75b0 con 0x7fadd806b490 2023-08-09T12:53:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.669+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd804e390 con 0x7fadd806b490 2023-08-09T12:53:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.670+0000 7fadd57fa640 1 -- 172.21.15.17:0/2037535303 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fadc8043410 con 0x7fadd806b490 2023-08-09T12:53:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.671+0000 7fadd57fa640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fadb806a0a0 0x7fadb806c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.672+0000 7fadd57fa640 1 -- 172.21.15.17:0/2037535303 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fadc80aa120 con 0x7fadd806b490 2023-08-09T12:53:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.672+0000 7fadcf7fe640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fadb806a0a0 0x7fadb806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.674+0000 7fadcf7fe640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fadb806a0a0 0x7fadb806c560 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fadc0006e80 tx=0x7fadc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.676+0000 7fadd57fa640 1 -- 172.21.15.17:0/2037535303 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fadc8075840 con 0x7fadd806b490 2023-08-09T12:53:04.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.906+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadd80b4e00 con 0x7fadd806b490 2023-08-09T12:53:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.908+0000 7fadd57fa640 1 -- 172.21.15.17:0/2037535303 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4876 (secure 0 0 0) 0x7fadc8078e60 con 0x7fadd806b490 2023-08-09T12:53:04.911 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:04.911 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/53885323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":53885323},{"type":"v1","addr":"172.21.15.142:6836","nonce":53885323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1636287832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1636287832},{"type":"v1","addr":"172.21.15.142:6837","nonce":1636287832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/758642293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":758642293},{"type":"v1","addr":"172.21.15.17:6833","nonce":758642293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:51:33.353513+0000","modified":"2023-08-09T12:51:36.903336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9000},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9000":{"gid":9000,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/2739343495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2739343495},{"type":"v1","addr":"172.21.15.17:6835","nonce":2739343495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-09T12:53:04.912 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 84 2023-08-09T12:53:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fadb806a0a0 msgr2=0x7fadb806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fadb806a0a0 0x7fadb806c560 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fadc0006e80 tx=0x7fadc0008040 comp rx=0 tx=0).stop 2023-08-09T12:53:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd806b490 msgr2=0x7fadd8155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd806b490 0x7fadd8155360 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009890 tx=0x7fadc80046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 shutdown_connections 2023-08-09T12:53:04.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fadb806a0a0 0x7fadb806c560 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8159a10 0x7fadd815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80ce3e0 0x7fadd80c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 --2- 172.21.15.17:0/2037535303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd806b490 0x7fadd8155360 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.910+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 >> 172.21.15.17:0/2037535303 conn(0x7fadd80cb900 msgr2=0x7fadd80c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.911+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 shutdown_connections 2023-08-09T12:53:04.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:04.911+0000 7faddd621640 1 -- 172.21.15.17:0/2037535303 wait complete. 2023-08-09T12:53:04.932 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:53:05.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.158+0000 7fedc8226640 1 Processor -- start 2023-08-09T12:53:05.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.159+0000 7fedc8226640 1 -- start start 2023-08-09T12:53:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.160+0000 7fedc8226640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fedc01616e0 0x7fedc00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.160+0000 7fedc8226640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fedc00d29d0 0x7fedc00d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.160+0000 7fedc8226640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc00d3360 con 0x7fedc015ce90 2023-08-09T12:53:05.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.160+0000 7fedc8226640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc00b6540 con 0x7fedc01616e0 2023-08-09T12:53:05.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.160+0000 7fedc8226640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc00cdd10 con 0x7fedc00d29d0 2023-08-09T12:53:05.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.161+0000 7fedc57c1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fedc01616e0 0x7fedc00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.161+0000 7fedc57c1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fedc01616e0 0x7fedc00b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51898/0 (socket says 172.21.15.17:51898) 2023-08-09T12:53:05.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.161+0000 7fedc57c1640 1 -- 172.21.15.17:0/3904238425 learned_addr learned my addr 172.21.15.17:0/3904238425 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.161+0000 7fedc57c1640 1 -- 172.21.15.17:0/3904238425 >> v2:172.21.15.142:3300/0 conn(0x7fedc00d29d0 msgr2=0x7fedc00d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.161+0000 7fedc57c1640 1 --2- 172.21.15.17:0/3904238425 >> v2:172.21.15.142:3300/0 conn(0x7fedc00d29d0 0x7fedc00d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.161+0000 7fedc57c1640 1 -- 172.21.15.17:0/3904238425 >> v1:172.21.15.142:6789/0 conn(0x7fedc015ce90 legacy=0x7fedc00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.161+0000 7fedc57c1640 1 -- 172.21.15.17:0/3904238425 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00cdff0 con 0x7fedc01616e0 2023-08-09T12:53:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.163+0000 7fedc57c1640 1 --2- 172.21.15.17:0/3904238425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc00b6000 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fedc00d07e0 tx=0x7fedb002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc534aaf0f725c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.163+0000 7fedc4fc0640 1 -- 172.21.15.17:0/3904238425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0031890 con 0x7fedc01616e0 2023-08-09T12:53:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.163+0000 7fedc4fc0640 1 -- 172.21.15.17:0/3904238425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb00319f0 con 0x7fedc01616e0 2023-08-09T12:53:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.163+0000 7fedc4fc0640 1 -- 172.21.15.17:0/3904238425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0031d80 con 0x7fedc01616e0 2023-08-09T12:53:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.163+0000 7fedc8226640 1 -- 172.21.15.17:0/3904238425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 msgr2=0x7fedc00b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.163+0000 7fedc8226640 1 --2- 172.21.15.17:0/3904238425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc00b6000 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fedc00d07e0 tx=0x7fedb002b930 comp rx=0 tx=0).stop 2023-08-09T12:53:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.164+0000 7fedc8226640 1 -- 172.21.15.17:0/3904238425 shutdown_connections 2023-08-09T12:53:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.164+0000 7fedc8226640 1 --2- 172.21.15.17:0/3904238425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc00b6000 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.164+0000 7fedc8226640 1 --2- 172.21.15.17:0/3904238425 >> v2:172.21.15.142:3300/0 conn(0x7fedc00d29d0 0x7fedc00d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.164+0000 7fedc8226640 1 -- 172.21.15.17:0/3904238425 >> 172.21.15.17:0/3904238425 conn(0x7fedc006fde0 msgr2=0x7fedc00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.164+0000 7fedc8226640 1 -- 172.21.15.17:0/3904238425 shutdown_connections 2023-08-09T12:53:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.164+0000 7fedc8226640 1 -- 172.21.15.17:0/3904238425 wait complete. 2023-08-09T12:53:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.166+0000 7fedc8226640 1 Processor -- start 2023-08-09T12:53:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.166+0000 7fedc8226640 1 -- start start 2023-08-09T12:53:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc8226640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc00d29d0 0x7fedc00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc8226640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc015ce90 0x7fedc015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc8226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc0157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc8226640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc015da60 con 0x7fedc01616e0 2023-08-09T12:53:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc8226640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc00b4b40 con 0x7fedc00d29d0 2023-08-09T12:53:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc8226640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc015d410 con 0x7fedc015ce90 2023-08-09T12:53:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc67c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc0157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc67c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc0157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51906/0 (socket says 172.21.15.17:51906) 2023-08-09T12:53:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc67c3640 1 -- 172.21.15.17:0/1761267650 learned_addr learned my addr 172.21.15.17:0/1761267650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:05.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc57c1640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc015ce90 0x7fedc015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.167+0000 7fedc5fc2640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc00d29d0 0x7fedc00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc67c3640 1 -- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc015ce90 msgr2=0x7fedc015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc67c3640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc015ce90 0x7fedc015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc67c3640 1 -- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc00d29d0 msgr2=0x7fedc00b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc67c3640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc00d29d0 0x7fedc00b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc67c3640 1 -- 172.21.15.17:0/1761267650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb00094d0 con 0x7fedc01616e0 2023-08-09T12:53:05.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc57c1640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc015ce90 0x7fedc015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:05.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc67c3640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc0157290 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fedb800b970 tx=0x7fedb800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:05.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedb67fc640 1 -- 172.21.15.17:0/1761267650 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800cb40 con 0x7fedc01616e0 2023-08-09T12:53:05.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedb67fc640 1 -- 172.21.15.17:0/1761267650 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb800ccc0 con 0x7fedc01616e0 2023-08-09T12:53:05.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedb67fc640 1 -- 172.21.15.17:0/1761267650 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8014680 con 0x7fedc01616e0 2023-08-09T12:53:05.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc015d6f0 con 0x7fedc01616e0 2023-08-09T12:53:05.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.168+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc01523f0 con 0x7fedc01616e0 2023-08-09T12:53:05.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.170+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc015d270 con 0x7fedc01616e0 2023-08-09T12:53:05.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.171+0000 7fedb67fc640 1 -- 172.21.15.17:0/1761267650 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fedb801d3b0 con 0x7fedc01616e0 2023-08-09T12:53:05.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.171+0000 7fedb67fc640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feda406a050 0x7feda406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.171+0000 7fedb67fc640 1 -- 172.21.15.17:0/1761267650 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fedb80886c0 con 0x7fedc01616e0 2023-08-09T12:53:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.172+0000 7fedc5fc2640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feda406a050 0x7feda406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.173+0000 7fedc5fc2640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feda406a050 0x7feda406c510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fedbc003d90 tx=0x7fedbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.176+0000 7fedb67fc640 1 -- 172.21.15.17:0/1761267650 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fedc015d270 con 0x7fedc01616e0 2023-08-09T12:53:05.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.365+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedc015d270 con 0x7fedc01616e0 2023-08-09T12:53:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.367+0000 7fedb67fc640 1 -- 172.21.15.17:0/1761267650 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+18444 (secure 0 0 0) 0x7fedc015d270 con 0x7fedc01616e0 2023-08-09T12:53:05.371 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:05.371 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":180,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:53:03.955492+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:51:31.771781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-09T12:51:32.371993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.3b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:53:05.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feda406a050 msgr2=0x7feda406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feda406a050 0x7feda406c510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fedbc003d90 tx=0x7fedbc009040 comp rx=0 tx=0).stop 2023-08-09T12:53:05.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 msgr2=0x7fedc0157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc0157290 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fedb800b970 tx=0x7fedb800be30 comp rx=0 tx=0).stop 2023-08-09T12:53:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 shutdown_connections 2023-08-09T12:53:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feda406a050 0x7feda406c510 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc01616e0 0x7fedc0157290 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc015ce90 0x7fedc015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 --2- 172.21.15.17:0/1761267650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc00d29d0 0x7fedc00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 >> 172.21.15.17:0/1761267650 conn(0x7fedc006fde0 msgr2=0x7fedc00b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 shutdown_connections 2023-08-09T12:53:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.370+0000 7fedc8226640 1 -- 172.21.15.17:0/1761267650 wait complete. 2023-08-09T12:53:05.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:53:05.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.611+0000 7fc96f576640 1 Processor -- start 2023-08-09T12:53:05.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.611+0000 7fc96f576640 1 -- start start 2023-08-09T12:53:05.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.613+0000 7fc96f576640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc96815ce40 0x7fc968160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.613+0000 7fc96f576640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc968072f60 0x7fc9680cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.613+0000 7fc96f576640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680cd4d0 con 0x7fc96815d220 2023-08-09T12:53:05.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.613+0000 7fc96f576640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9681611b0 con 0x7fc96815ce40 2023-08-09T12:53:05.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.613+0000 7fc96f576640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc968161490 con 0x7fc968072f60 2023-08-09T12:53:05.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc96cb11640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc96815d220 0x7fc968072850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45970/0 (socket says 172.21.15.17:45970) 2023-08-09T12:53:05.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc96cb11640 1 -- 172.21.15.17:0/1303447051 learned_addr learned my addr 172.21.15.17:0/1303447051 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:05.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc96db13640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc968072f60 0x7fc9680cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc96d312640 1 --2- 172.21.15.17:0/1303447051 >> v2:172.21.15.142:3300/0 conn(0x7fc96815ce40 0x7fc968160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847080621 0 0) 0x7fc9680cd4d0 con 0x7fc96815d220 2023-08-09T12:53:05.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc954003520 con 0x7fc96815d220 2023-08-09T12:53:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1729314808 0 0) 0x7fc954003520 con 0x7fc96815d220 2023-08-09T12:53:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc968072f60 msgr2=0x7fc9680cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.614+0000 7fc95ffff640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc968072f60 0x7fc9680cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 >> v2:172.21.15.142:3300/0 conn(0x7fc96815ce40 msgr2=0x7fc968160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 --2- 172.21.15.17:0/1303447051 >> v2:172.21.15.142:3300/0 conn(0x7fc96815ce40 0x7fc968160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968161770 con 0x7fc96815d220 2023-08-09T12:53:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc958001670 con 0x7fc96815d220 2023-08-09T12:53:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 >> v1:172.21.15.17:6789/0 conn(0x7fc96815d220 legacy=0x7fc968072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc954003970 0x7fc954003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9540047c0 0x7fc954004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc968072f60 0x7fc954005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9681611b0 con 0x7fc9540047c0 2023-08-09T12:53:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968161490 con 0x7fc954003970 2023-08-09T12:53:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95400b9d0 con 0x7fc968072f60 2023-08-09T12:53:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc96cb11640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9540047c0 0x7fc954004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc96cb11640 1 -- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc968072f60 msgr2=0x7fc954005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:05.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc96cb11640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc968072f60 0x7fc954005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc96cb11640 1 -- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc954003970 msgr2=0x7fc954003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:05.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc96cb11640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc954003970 0x7fc954003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.615+0000 7fc96cb11640 1 -- 172.21.15.17:0/1303447051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc954003520 con 0x7fc9540047c0 2023-08-09T12:53:05.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.616+0000 7fc96cb11640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9540047c0 0x7fc954004c40 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c270 tx=0x7fc9540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bddf837e42f28e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:05.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95802cae0 con 0x7fc9540047c0 2023-08-09T12:53:05.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95802cc40 con 0x7fc9540047c0 2023-08-09T12:53:05.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc95ffff640 1 -- 172.21.15.17:0/1303447051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580058d0 con 0x7fc9540047c0 2023-08-09T12:53:05.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc96f576640 1 -- 172.21.15.17:0/1303447051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9540047c0 msgr2=0x7fc954004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc96f576640 1 --2- 172.21.15.17:0/1303447051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9540047c0 0x7fc954004c40 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c270 tx=0x7fc9540057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc96db13640 1 -- 172.21.15.17:0/1303447051 reap_dead start 2023-08-09T12:53:05.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc96f576640 1 -- 172.21.15.17:0/1303447051 shutdown_connections 2023-08-09T12:53:05.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc96f576640 1 -- 172.21.15.17:0/1303447051 >> 172.21.15.17:0/1303447051 conn(0x7fc9680cc2e0 msgr2=0x7fc9680cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:05.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.617+0000 7fc96f576640 1 -- 172.21.15.17:0/1303447051 shutdown_connections 2023-08-09T12:53:05.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.618+0000 7fc96f576640 1 -- 172.21.15.17:0/1303447051 wait complete. 2023-08-09T12:53:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.619+0000 7fc96f576640 1 Processor -- start 2023-08-09T12:53:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.619+0000 7fc96f576640 1 -- start start 2023-08-09T12:53:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.620+0000 7fc96f576640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9540047c0 0x7fc9681f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.620+0000 7fc96f576640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9680b4b80 0x7fc9680b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.620+0000 7fc96f576640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9680c8460 0x7fc9681556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.620+0000 7fc96f576640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9681f3350 con 0x7fc9680c8460 2023-08-09T12:53:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.620+0000 7fc96f576640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680c6fe0 con 0x7fc9680b4b80 2023-08-09T12:53:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.620+0000 7fc96f576640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680b4780 con 0x7fc9540047c0 2023-08-09T12:53:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9680c8460 0x7fc9681556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9680c8460 0x7fc9681556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51924/0 (socket says 172.21.15.17:51924) 2023-08-09T12:53:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 -- 172.21.15.17:0/596367854 learned_addr learned my addr 172.21.15.17:0/596367854 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 -- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9540047c0 msgr2=0x7fc9681f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9540047c0 0x7fc9681f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 -- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9680b4b80 msgr2=0x7fc9680b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9680b4b80 0x7fc9680b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 -- 172.21.15.17:0/596367854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680c69d0 con 0x7fc9680c8460 2023-08-09T12:53:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.621+0000 7fc96db13640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9680c8460 0x7fc9681556a0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fc9680cf810 tx=0x7fc96000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.622+0000 7fc95dffb640 1 -- 172.21.15.17:0/596367854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960010040 con 0x7fc9680c8460 2023-08-09T12:53:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.622+0000 7fc95dffb640 1 -- 172.21.15.17:0/596367854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96000bae0 con 0x7fc9680c8460 2023-08-09T12:53:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.622+0000 7fc95dffb640 1 -- 172.21.15.17:0/596367854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96000be70 con 0x7fc9680c8460 2023-08-09T12:53:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.622+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9680b5090 con 0x7fc9680c8460 2023-08-09T12:53:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.622+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9680b29c0 con 0x7fc9680c8460 2023-08-09T12:53:05.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.623+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc968067a80 con 0x7fc9680c8460 2023-08-09T12:53:05.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.624+0000 7fc95dffb640 1 -- 172.21.15.17:0/596367854 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc96001e410 con 0x7fc9680c8460 2023-08-09T12:53:05.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.625+0000 7fc95dffb640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc94c06a050 0x7fc94c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.625+0000 7fc95dffb640 1 -- 172.21.15.17:0/596367854 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc9600888d0 con 0x7fc9680c8460 2023-08-09T12:53:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.626+0000 7fc96d312640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc94c06a050 0x7fc94c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.627+0000 7fc96d312640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc94c06a050 0x7fc94c06c510 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc964006a90 tx=0x7fc964006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.630+0000 7fc95dffb640 1 -- 172.21.15.17:0/596367854 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc960057970 con 0x7fc9680c8460 2023-08-09T12:53:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.861+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc968160280 con 0x7fc9680c8460 2023-08-09T12:53:05.865 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:53:05.862+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:53:05.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.873+0000 7fc95dffb640 1 -- 172.21.15.17:0/596367854 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc960057500 con 0x7fc9680c8460 2023-08-09T12:53:05.877 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:53:05.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc94c06a050 msgr2=0x7fc94c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc94c06a050 0x7fc94c06c510 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc964006a90 tx=0x7fc964006a20 comp rx=0 tx=0).stop 2023-08-09T12:53:05.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9680c8460 msgr2=0x7fc9681556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:05.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9680c8460 0x7fc9681556a0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fc9680cf810 tx=0x7fc96000b480 comp rx=0 tx=0).stop 2023-08-09T12:53:05.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 shutdown_connections 2023-08-09T12:53:05.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc94c06a050 0x7fc94c06c510 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9680c8460 0x7fc9681556a0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9680b4b80 0x7fc9680b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 --2- 172.21.15.17:0/596367854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9540047c0 0x7fc9681f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:05.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 >> 172.21.15.17:0/596367854 conn(0x7fc9680cc2e0 msgr2=0x7fc9680697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:05.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 shutdown_connections 2023-08-09T12:53:05.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:05.876+0000 7fc96f576640 1 -- 172.21.15.17:0/596367854 wait complete. 2023-08-09T12:53:05.898 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:53:06.003 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:53:06.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.118+0000 7f43f8f34640 1 Processor -- start 2023-08-09T12:53:06.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.119+0000 7f43f8f34640 1 -- start start 2023-08-09T12:53:06.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.120+0000 7f43f8f34640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43f415a8c0 0x7f43f40b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:06.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.120+0000 7f43f8f34640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43f40b0020 0x7f43f40b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.120+0000 7f43f8f34640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f415e7b0 con 0x7f43f40b13f0 2023-08-09T12:53:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.120+0000 7f43f8f34640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f40b0990 con 0x7f43f415a8c0 2023-08-09T12:53:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.120+0000 7f43f8f34640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f40b1850 con 0x7f43f40b0020 2023-08-09T12:53:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.121+0000 7f43f37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43f415a8c0 0x7f43f40b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.121+0000 7f43f37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43f415a8c0 0x7f43f40b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51954/0 (socket says 172.21.15.17:51954) 2023-08-09T12:53:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.121+0000 7f43f37fe640 1 -- 172.21.15.17:0/2455743938 learned_addr learned my addr 172.21.15.17:0/2455743938 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.121+0000 7f43f3fff640 1 --2- 172.21.15.17:0/2455743938 >> v2:172.21.15.142:3300/0 conn(0x7f43f40b0020 0x7f43f40b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.121+0000 7f43f37fe640 1 -- 172.21.15.17:0/2455743938 >> v2:172.21.15.142:3300/0 conn(0x7f43f40b0020 msgr2=0x7f43f40b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:06.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.121+0000 7f43f37fe640 1 --2- 172.21.15.17:0/2455743938 >> v2:172.21.15.142:3300/0 conn(0x7f43f40b0020 0x7f43f40b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.121+0000 7f43f37fe640 1 -- 172.21.15.17:0/2455743938 >> v1:172.21.15.17:6789/0 conn(0x7f43f40b13f0 legacy=0x7f43f415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:06.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.121+0000 7f43f37fe640 1 -- 172.21.15.17:0/2455743938 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f415e460 con 0x7f43f415a8c0 2023-08-09T12:53:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.123+0000 7f43f37fe640 1 --2- 172.21.15.17:0/2455743938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f40b4170 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f43f40addb0 tx=0x7f43e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3577c5873eb429d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.123+0000 7f43f27fc640 1 -- 172.21.15.17:0/2455743938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4030860 con 0x7f43f415a8c0 2023-08-09T12:53:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.123+0000 7f43f27fc640 1 -- 172.21.15.17:0/2455743938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e40309c0 con 0x7f43f415a8c0 2023-08-09T12:53:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.123+0000 7f43f27fc640 1 -- 172.21.15.17:0/2455743938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4030d50 con 0x7f43f415a8c0 2023-08-09T12:53:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.124+0000 7f43f8f34640 1 -- 172.21.15.17:0/2455743938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 msgr2=0x7f43f40b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.124+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2455743938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f40b4170 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f43f40addb0 tx=0x7f43e402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.124+0000 7f43f8f34640 1 -- 172.21.15.17:0/2455743938 shutdown_connections 2023-08-09T12:53:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.124+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2455743938 >> v2:172.21.15.142:3300/0 conn(0x7f43f40b0020 0x7f43f40b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.124+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2455743938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f40b4170 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.124+0000 7f43f8f34640 1 -- 172.21.15.17:0/2455743938 >> 172.21.15.17:0/2455743938 conn(0x7f43f40cb020 msgr2=0x7f43f40cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.124+0000 7f43f8f34640 1 -- 172.21.15.17:0/2455743938 shutdown_connections 2023-08-09T12:53:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.124+0000 7f43f8f34640 1 -- 172.21.15.17:0/2455743938 wait complete. 2023-08-09T12:53:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.126+0000 7f43f8f34640 1 Processor -- start 2023-08-09T12:53:06.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.126+0000 7f43f8f34640 1 -- start start 2023-08-09T12:53:06.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.127+0000 7f43f8f34640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f40b0020 0x7f43f4157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:06.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.127+0000 7f43f8f34640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f40b13f0 0x7f43f40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:06.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.127+0000 7f43f8f34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:06.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.127+0000 7f43f8f34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f415bd80 con 0x7f43f415a8c0 2023-08-09T12:53:06.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.127+0000 7f43f8f34640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40cca80 con 0x7f43f40b0020 2023-08-09T12:53:06.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.127+0000 7f43f8f34640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40cc170 con 0x7f43f40b13f0 2023-08-09T12:53:06.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:06.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f415b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51964/0 (socket says 172.21.15.17:51964) 2023-08-09T12:53:06.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f3fff640 1 -- 172.21.15.17:0/2077384999 learned_addr learned my addr 172.21.15.17:0/2077384999 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:06.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f37fe640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f40b0020 0x7f43f4157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:06.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f2ffd640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f40b13f0 0x7f43f40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:06.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f3fff640 1 -- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f40b13f0 msgr2=0x7f43f40ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:06.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f3fff640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f40b13f0 0x7f43f40ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f3fff640 1 -- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f40b0020 msgr2=0x7f43f4157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:06.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f3fff640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f40b0020 0x7f43f4157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f3fff640 1 -- 172.21.15.17:0/2077384999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40094d0 con 0x7f43f415a8c0 2023-08-09T12:53:06.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.128+0000 7f43f37fe640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f40b0020 0x7f43f4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:06.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.129+0000 7f43f3fff640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f415b130 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f43ec007e60 tx=0x7f43ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:06.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.129+0000 7f43ebfff640 1 -- 172.21.15.17:0/2077384999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec014420 con 0x7f43f415a8c0 2023-08-09T12:53:06.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.129+0000 7f43ebfff640 1 -- 172.21.15.17:0/2077384999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec0145a0 con 0x7f43f415a8c0 2023-08-09T12:53:06.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.129+0000 7f43ebfff640 1 -- 172.21.15.17:0/2077384999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec014950 con 0x7f43f415a8c0 2023-08-09T12:53:06.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.129+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f4158440 con 0x7f43f415a8c0 2023-08-09T12:53:06.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.129+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f40cc3c0 con 0x7f43f415a8c0 2023-08-09T12:53:06.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.130+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f40ccbc0 con 0x7f43f415a8c0 2023-08-09T12:53:06.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.131+0000 7f43ebfff640 1 -- 172.21.15.17:0/2077384999 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43ec014ab0 con 0x7f43f415a8c0 2023-08-09T12:53:06.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.133+0000 7f43ebfff640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43dc06a050 0x7f43dc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:06.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.133+0000 7f43ebfff640 1 -- 172.21.15.17:0/2077384999 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f43ec088ff0 con 0x7f43f415a8c0 2023-08-09T12:53:06.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.134+0000 7f43f37fe640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43dc06a050 0x7f43dc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:06.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.135+0000 7f43f37fe640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43dc06a050 0x7f43dc06c510 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f43e4036000 tx=0x7f43e4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:06.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.138+0000 7f43ebfff640 1 -- 172.21.15.17:0/2077384999 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f43ec0bb7b0 con 0x7f43f415a8c0 2023-08-09T12:53:06.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.369+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f43f404e390 con 0x7f43f415a8c0 2023-08-09T12:53:06.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.873+0000 7f43ebfff640 1 -- 172.21.15.17:0/2077384999 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43f40ccbc0 con 0x7f43f415a8c0 2023-08-09T12:53:06.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.876+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43dc06a050 msgr2=0x7f43dc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:06.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.876+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43dc06a050 0x7f43dc06c510 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f43e4036000 tx=0x7f43e4008030 comp rx=0 tx=0).stop 2023-08-09T12:53:06.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 msgr2=0x7f43f415b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:06.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f415b130 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f43ec007e60 tx=0x7f43ec00e4b0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 shutdown_connections 2023-08-09T12:53:06.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f43dc06a050 0x7f43dc06c510 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43f415a8c0 0x7f43f415b130 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f40b13f0 0x7f43f40ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 --2- 172.21.15.17:0/2077384999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f40b0020 0x7f43f4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 >> 172.21.15.17:0/2077384999 conn(0x7f43f40cb020 msgr2=0x7f43f406e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 shutdown_connections 2023-08-09T12:53:06.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:06.877+0000 7f43f8f34640 1 -- 172.21.15.17:0/2077384999 wait complete. 2023-08-09T12:53:06.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:53:07.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.137+0000 7fdd127ab640 1 Processor -- start 2023-08-09T12:53:07.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.137+0000 7fdd127ab640 1 -- start start 2023-08-09T12:53:07.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.139+0000 7fdd127ab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdd0c15ce40 0x7fdd0c06ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:07.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.139+0000 7fdd127ab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd0c06d3b0 0x7fdd0c0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:07.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.139+0000 7fdd127ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:07.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.139+0000 7fdd127ab640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c15e200 con 0x7fdd0c15ce40 2023-08-09T12:53:07.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.139+0000 7fdd127ab640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c06bb30 con 0x7fdd0c06d3b0 2023-08-09T12:53:07.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.139+0000 7fdd127ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c06bdd0 con 0x7fdd0c0cdfb0 2023-08-09T12:53:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.140+0000 7fdd11faa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.140+0000 7fdd11faa640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c15d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:53624/0 (socket says 172.21.15.17:53624) 2023-08-09T12:53:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.140+0000 7fdd11faa640 1 -- 172.21.15.17:0/2694065895 learned_addr learned my addr 172.21.15.17:0/2694065895 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.140+0000 7fdd10fa8640 1 --2- 172.21.15.17:0/2694065895 >> v2:172.21.15.142:3300/0 conn(0x7fdd0c06d3b0 0x7fdd0c0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:07.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.140+0000 7fdd117a9640 1 --2- 172.21.15.17:0/2694065895 >> v2:172.21.15.17:3300/0 conn(0x7fdd0c15ce40 0x7fdd0c06ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:07.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.140+0000 7fdd11faa640 1 -- 172.21.15.17:0/2694065895 >> v2:172.21.15.142:3300/0 conn(0x7fdd0c06d3b0 msgr2=0x7fdd0c0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:07.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.140+0000 7fdd11faa640 1 --2- 172.21.15.17:0/2694065895 >> v2:172.21.15.142:3300/0 conn(0x7fdd0c06d3b0 0x7fdd0c0cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.140+0000 7fdd11faa640 1 -- 172.21.15.17:0/2694065895 >> v2:172.21.15.17:3300/0 conn(0x7fdd0c15ce40 msgr2=0x7fdd0c06ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.141+0000 7fdd11faa640 1 --2- 172.21.15.17:0/2694065895 >> v2:172.21.15.17:3300/0 conn(0x7fdd0c15ce40 0x7fdd0c06ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.141+0000 7fdd11faa640 1 -- 172.21.15.17:0/2694065895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c06c0b0 con 0x7fdd0c0cdfb0 2023-08-09T12:53:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.141+0000 7fdd117a9640 1 --2- 172.21.15.17:0/2694065895 >> v2:172.21.15.17:3300/0 conn(0x7fdd0c15ce40 0x7fdd0c06ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.142+0000 7fdd11faa640 1 --2- 172.21.15.17:0/2694065895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c15d3b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c06da50 tx=0x7fdd0402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e6f7693960f8c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd03fff640 1 -- 172.21.15.17:0/2694065895 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0402cb00 con 0x7fdd0c0cdfb0 2023-08-09T12:53:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd03fff640 1 -- 172.21.15.17:0/2694065895 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0402cc60 con 0x7fdd0c0cdfb0 2023-08-09T12:53:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd03fff640 1 -- 172.21.15.17:0/2694065895 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040343f0 con 0x7fdd0c0cdfb0 2023-08-09T12:53:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd127ab640 1 -- 172.21.15.17:0/2694065895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 msgr2=0x7fdd0c15d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd127ab640 1 --2- 172.21.15.17:0/2694065895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c15d3b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c06da50 tx=0x7fdd0402bf60 comp rx=0 tx=0).stop 2023-08-09T12:53:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd127ab640 1 -- 172.21.15.17:0/2694065895 shutdown_connections 2023-08-09T12:53:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd127ab640 1 --2- 172.21.15.17:0/2694065895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c15d3b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd127ab640 1 --2- 172.21.15.17:0/2694065895 >> v2:172.21.15.142:3300/0 conn(0x7fdd0c06d3b0 0x7fdd0c0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd127ab640 1 --2- 172.21.15.17:0/2694065895 >> v2:172.21.15.17:3300/0 conn(0x7fdd0c15ce40 0x7fdd0c06ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.143+0000 7fdd127ab640 1 -- 172.21.15.17:0/2694065895 >> 172.21.15.17:0/2694065895 conn(0x7fdd0c0b1110 msgr2=0x7fdd0c0b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.144+0000 7fdd127ab640 1 -- 172.21.15.17:0/2694065895 shutdown_connections 2023-08-09T12:53:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.144+0000 7fdd127ab640 1 -- 172.21.15.17:0/2694065895 wait complete. 2023-08-09T12:53:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.145+0000 7fdd127ab640 1 Processor -- start 2023-08-09T12:53:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.145+0000 7fdd127ab640 1 -- start start 2023-08-09T12:53:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.146+0000 7fdd127ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.146+0000 7fdd127ab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c15ce40 0x7fdd0c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.146+0000 7fdd127ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd0c157100 0x7fdd0c0c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.146+0000 7fdd127ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c15a640 con 0x7fdd0c157100 2023-08-09T12:53:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.146+0000 7fdd127ab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0c9500 con 0x7fdd0c15ce40 2023-08-09T12:53:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.146+0000 7fdd127ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1576c0 con 0x7fdd0c0cdfb0 2023-08-09T12:53:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd11faa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd0c157100 0x7fdd0c0c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd11faa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd0c157100 0x7fdd0c0c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51986/0 (socket says 172.21.15.17:51986) 2023-08-09T12:53:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd11faa640 1 -- 172.21.15.17:0/3875227405 learned_addr learned my addr 172.21.15.17:0/3875227405 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd10fa8640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c15ce40 0x7fdd0c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd117a9640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd11faa640 1 -- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 msgr2=0x7fdd0c0c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd11faa640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c0c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd11faa640 1 -- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c15ce40 msgr2=0x7fdd0c153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd11faa640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c15ce40 0x7fdd0c153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd11faa640 1 -- 172.21.15.17:0/3875227405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009b30 con 0x7fdd0c157100 2023-08-09T12:53:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd10fa8640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c15ce40 0x7fdd0c153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.147+0000 7fdd117a9640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c0c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.148+0000 7fdd11faa640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd0c157100 0x7fdd0c0c6e50 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009f40 tx=0x7fdd04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.148+0000 7fdd01ffb640 1 -- 172.21.15.17:0/3875227405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04009510 con 0x7fdd0c157100 2023-08-09T12:53:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.148+0000 7fdd01ffb640 1 -- 172.21.15.17:0/3875227405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0403e450 con 0x7fdd0c157100 2023-08-09T12:53:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.148+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c1579a0 con 0x7fdd0c157100 2023-08-09T12:53:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.148+0000 7fdd01ffb640 1 -- 172.21.15.17:0/3875227405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0403e800 con 0x7fdd0c157100 2023-08-09T12:53:07.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.148+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c1542f0 con 0x7fdd0c157100 2023-08-09T12:53:07.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.149+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c157ec0 con 0x7fdd0c157100 2023-08-09T12:53:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.152+0000 7fdd01ffb640 1 -- 172.21.15.17:0/3875227405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdd0403e960 con 0x7fdd0c157100 2023-08-09T12:53:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.152+0000 7fdd01ffb640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdcf006a080 0x7fdcf006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.153+0000 7fdd01ffb640 1 -- 172.21.15.17:0/3875227405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fdd040ab4c0 con 0x7fdd0c157100 2023-08-09T12:53:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.153+0000 7fdd117a9640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdcf006a080 0x7fdcf006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.155+0000 7fdd117a9640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdcf006a080 0x7fdcf006c540 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fdd08006fd0 tx=0x7fdd08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.156+0000 7fdd01ffb640 1 -- 172.21.15.17:0/3875227405 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdd04076b90 con 0x7fdd0c157100 2023-08-09T12:53:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:07.341+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd0c157ec0 con 0x7fdd0c157100 2023-08-09T12:53:08.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.316+0000 7fdd01ffb640 1 -- 172.21.15.17:0/3875227405 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v182) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdd0c157ec0 con 0x7fdd0c157100 2023-08-09T12:53:08.320 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:53:08.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdcf006a080 msgr2=0x7fdcf006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:08.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdcf006a080 0x7fdcf006c540 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fdd08006fd0 tx=0x7fdd08008040 comp rx=0 tx=0).stop 2023-08-09T12:53:08.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd0c157100 msgr2=0x7fdd0c0c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:08.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd0c157100 0x7fdd0c0c6e50 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009f40 tx=0x7fdd04004a40 comp rx=0 tx=0).stop 2023-08-09T12:53:08.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 shutdown_connections 2023-08-09T12:53:08.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdcf006a080 0x7fdcf006c540 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd0c157100 0x7fdd0c0c6e50 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd0c15ce40 0x7fdd0c153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 --2- 172.21.15.17:0/3875227405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd0c0cdfb0 0x7fdd0c0c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.320+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 >> 172.21.15.17:0/3875227405 conn(0x7fdd0c0b1110 msgr2=0x7fdd0c1599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:08.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.321+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 shutdown_connections 2023-08-09T12:53:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.321+0000 7fdd127ab640 1 -- 172.21.15.17:0/3875227405 wait complete. 2023-08-09T12:53:08.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:53:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.572+0000 7f011ffff640 1 Processor -- start 2023-08-09T12:53:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.572+0000 7f011ffff640 1 -- start start 2023-08-09T12:53:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.574+0000 7f011ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f012015ccb0 0x7f01200d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.574+0000 7f011ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f01200cfe90 0x7f01200b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.574+0000 7f011ffff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01200d2680 con 0x7f01200d0960 2023-08-09T12:53:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.574+0000 7f011ffff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01200d0f20 con 0x7f01200cfe90 2023-08-09T12:53:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.574+0000 7f011ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01200d1200 con 0x7f012015ccb0 2023-08-09T12:53:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.574+0000 7f011f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f01200cfe90 0x7f01200b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.575+0000 7f011f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f01200cfe90 0x7f01200b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60562/0 (socket says 172.21.15.17:60562) 2023-08-09T12:53:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.575+0000 7f011f7fe640 1 -- 172.21.15.17:0/3568968137 learned_addr learned my addr 172.21.15.17:0/3568968137 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.575+0000 7f011f7fe640 1 -- 172.21.15.17:0/3568968137 >> v2:172.21.15.142:3300/0 conn(0x7f012015ccb0 msgr2=0x7f01200d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.575+0000 7f011f7fe640 1 --2- 172.21.15.17:0/3568968137 >> v2:172.21.15.142:3300/0 conn(0x7f012015ccb0 0x7f01200d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.575+0000 7f011f7fe640 1 -- 172.21.15.17:0/3568968137 >> v1:172.21.15.142:6789/0 conn(0x7f01200d0960 legacy=0x7f01200cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.575+0000 7f011f7fe640 1 -- 172.21.15.17:0/3568968137 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01200d14e0 con 0x7f01200cfe90 2023-08-09T12:53:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.576+0000 7f011f7fe640 1 --2- 172.21.15.17:0/3568968137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200cfe90 0x7f01200b5e90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f01200b55a0 tx=0x7f011802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e15102a1990a9c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011dffb640 1 -- 172.21.15.17:0/3568968137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011802ca80 con 0x7f01200cfe90 2023-08-09T12:53:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011dffb640 1 -- 172.21.15.17:0/3568968137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011802cbe0 con 0x7f01200cfe90 2023-08-09T12:53:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011dffb640 1 -- 172.21.15.17:0/3568968137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01180343f0 con 0x7f01200cfe90 2023-08-09T12:53:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011ffff640 1 -- 172.21.15.17:0/3568968137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200cfe90 msgr2=0x7f01200b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011ffff640 1 --2- 172.21.15.17:0/3568968137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200cfe90 0x7f01200b5e90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f01200b55a0 tx=0x7f011802bee0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011ffff640 1 -- 172.21.15.17:0/3568968137 shutdown_connections 2023-08-09T12:53:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011ffff640 1 --2- 172.21.15.17:0/3568968137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200cfe90 0x7f01200b5e90 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011ffff640 1 --2- 172.21.15.17:0/3568968137 >> v2:172.21.15.142:3300/0 conn(0x7f012015ccb0 0x7f01200d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.577+0000 7f011ffff640 1 -- 172.21.15.17:0/3568968137 >> 172.21.15.17:0/3568968137 conn(0x7f01200699a0 msgr2=0x7f0120069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.578+0000 7f011ffff640 1 -- 172.21.15.17:0/3568968137 shutdown_connections 2023-08-09T12:53:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.578+0000 7f011ffff640 1 -- 172.21.15.17:0/3568968137 wait complete. 2023-08-09T12:53:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.579+0000 7f011ffff640 1 Processor -- start 2023-08-09T12:53:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.579+0000 7f011ffff640 1 -- start start 2023-08-09T12:53:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.580+0000 7f011ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01200cfe90 0x7f01201572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.580+0000 7f011ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200d0960 0x7f01201f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.580+0000 7f011ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f012015ccb0 0x7f01200cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.580+0000 7f011ffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01201f3540 con 0x7f01200d0960 2023-08-09T12:53:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.580+0000 7f011ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0120156ec0 con 0x7f01200cfe90 2023-08-09T12:53:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.580+0000 7f011ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01201f2f80 con 0x7f012015ccb0 2023-08-09T12:53:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200d0960 0x7f01201f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200d0960 0x7f01201f2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60576/0 (socket says 172.21.15.17:60576) 2023-08-09T12:53:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011e7fc640 1 -- 172.21.15.17:0/4234853510 learned_addr learned my addr 172.21.15.17:0/4234853510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011e7fc640 1 -- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f012015ccb0 msgr2=0x7f01200cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011e7fc640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f012015ccb0 0x7f01200cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011e7fc640 1 -- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01200cfe90 msgr2=0x7f01201572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011effd640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01200cfe90 0x7f01201572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011e7fc640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01200cfe90 0x7f01201572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.581+0000 7f011e7fc640 1 -- 172.21.15.17:0/4234853510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0118009b30 con 0x7f01200d0960 2023-08-09T12:53:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.582+0000 7f011e7fc640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200d0960 0x7f01201f2520 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f011400c410 tx=0x7f011400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.582+0000 7f01077fe640 1 -- 172.21.15.17:0/4234853510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01140035f0 con 0x7f01200d0960 2023-08-09T12:53:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.582+0000 7f01077fe640 1 -- 172.21.15.17:0/4234853510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0114003750 con 0x7f01200d0960 2023-08-09T12:53:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.582+0000 7f01077fe640 1 -- 172.21.15.17:0/4234853510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114003b40 con 0x7f01200d0960 2023-08-09T12:53:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.582+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01201f3260 con 0x7f01200d0960 2023-08-09T12:53:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.582+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012015f770 con 0x7f01200d0960 2023-08-09T12:53:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.583+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0120156940 con 0x7f01200d0960 2023-08-09T12:53:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.584+0000 7f01077fe640 1 -- 172.21.15.17:0/4234853510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0114003ca0 con 0x7f01200d0960 2023-08-09T12:53:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.585+0000 7f01077fe640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f010c06a050 0x7f010c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.586+0000 7f01077fe640 1 -- 172.21.15.17:0/4234853510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f0114087610 con 0x7f01200d0960 2023-08-09T12:53:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.587+0000 7f011effd640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f010c06a050 0x7f010c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:08.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.593+0000 7f01077fe640 1 -- 172.21.15.17:0/4234853510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0120156940 con 0x7f01200d0960 2023-08-09T12:53:08.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.595+0000 7f011effd640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f010c06a050 0x7f010c06c510 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f011000a770 tx=0x7f0110008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:08.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:08.783+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0120157000 con 0x7f01200d0960 2023-08-09T12:53:09.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.320+0000 7f01077fe640 1 -- 172.21.15.17:0/4234853510 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v183) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0120157000 con 0x7f01200d0960 2023-08-09T12:53:09.324 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f010c06a050 msgr2=0x7f010c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f010c06a050 0x7f010c06c510 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f011000a770 tx=0x7f0110008040 comp rx=0 tx=0).stop 2023-08-09T12:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200d0960 msgr2=0x7f01201f2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200d0960 0x7f01201f2520 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f011400c410 tx=0x7f011400c8d0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 shutdown_connections 2023-08-09T12:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f010c06a050 0x7f010c06c510 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f012015ccb0 0x7f01200cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01200d0960 0x7f01201f2520 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 --2- 172.21.15.17:0/4234853510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01200cfe90 0x7f01201572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 >> 172.21.15.17:0/4234853510 conn(0x7f01200699a0 msgr2=0x7f01200b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.325+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 shutdown_connections 2023-08-09T12:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.326+0000 7f011ffff640 1 -- 172.21.15.17:0/4234853510 wait complete. 2023-08-09T12:53:09.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:53:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.565+0000 7f407359e640 1 Processor -- start 2023-08-09T12:53:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.565+0000 7f407359e640 1 -- start start 2023-08-09T12:53:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.566+0000 7f407359e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40740b8420 0x7f40740cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:09.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.567+0000 7f407359e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f407415cf20 0x7f40740cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:09.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.567+0000 7f407359e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40740d0f00 con 0x7f407415cb40 2023-08-09T12:53:09.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.567+0000 7f407359e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40741611f0 con 0x7f407415cf20 2023-08-09T12:53:09.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.567+0000 7f407359e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40741614d0 con 0x7f40740b8420 2023-08-09T12:53:09.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.567+0000 7f4072d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f407415cf20 0x7f40740cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:09.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.567+0000 7f4072d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f407415cf20 0x7f40740cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60586/0 (socket says 172.21.15.17:60586) 2023-08-09T12:53:09.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.567+0000 7f4072d9d640 1 -- 172.21.15.17:0/1697452616 learned_addr learned my addr 172.21.15.17:0/1697452616 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:09.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.568+0000 7f4072d9d640 1 -- 172.21.15.17:0/1697452616 >> v2:172.21.15.142:3300/0 conn(0x7f40740b8420 msgr2=0x7f40740cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:09.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.568+0000 7f4072d9d640 1 --2- 172.21.15.17:0/1697452616 >> v2:172.21.15.142:3300/0 conn(0x7f40740b8420 0x7f40740cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.568+0000 7f4072d9d640 1 -- 172.21.15.17:0/1697452616 >> v1:172.21.15.142:6789/0 conn(0x7f407415cb40 legacy=0x7f40741609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:09.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.568+0000 7f4072d9d640 1 -- 172.21.15.17:0/1697452616 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40741617b0 con 0x7f407415cf20 2023-08-09T12:53:09.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.569+0000 7f4072d9d640 1 --2- 172.21.15.17:0/1697452616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f40740cdda0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f40740cf4d0 tx=0x7f406c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4754b00af8420a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:09.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.569+0000 7f407159a640 1 -- 172.21.15.17:0/1697452616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c030860 con 0x7f407415cf20 2023-08-09T12:53:09.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.569+0000 7f407159a640 1 -- 172.21.15.17:0/1697452616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c0309c0 con 0x7f407415cf20 2023-08-09T12:53:09.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.569+0000 7f407159a640 1 -- 172.21.15.17:0/1697452616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c030d50 con 0x7f407415cf20 2023-08-09T12:53:09.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.570+0000 7f407359e640 1 -- 172.21.15.17:0/1697452616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 msgr2=0x7f40740cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:09.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.570+0000 7f407359e640 1 --2- 172.21.15.17:0/1697452616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f40740cdda0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f40740cf4d0 tx=0x7f406c02b9a0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.570+0000 7f407359e640 1 -- 172.21.15.17:0/1697452616 shutdown_connections 2023-08-09T12:53:09.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.570+0000 7f407359e640 1 --2- 172.21.15.17:0/1697452616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f40740cdda0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.570+0000 7f407359e640 1 --2- 172.21.15.17:0/1697452616 >> v2:172.21.15.142:3300/0 conn(0x7f40740b8420 0x7f40740cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.570+0000 7f407359e640 1 -- 172.21.15.17:0/1697452616 >> 172.21.15.17:0/1697452616 conn(0x7f40740d2ab0 msgr2=0x7f40740d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:09.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.570+0000 7f407359e640 1 -- 172.21.15.17:0/1697452616 shutdown_connections 2023-08-09T12:53:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.570+0000 7f407359e640 1 -- 172.21.15.17:0/1697452616 wait complete. 2023-08-09T12:53:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.572+0000 7f407359e640 1 Processor -- start 2023-08-09T12:53:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.572+0000 7f407359e640 1 -- start start 2023-08-09T12:53:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f407359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40740b8420 0x7f4074152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f407359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f407415cb40 0x7f407415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f407359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f4074153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f407359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407415b870 con 0x7f407415cf20 2023-08-09T12:53:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f407359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40740ca2c0 con 0x7f40740b8420 2023-08-09T12:53:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f407359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40741529b0 con 0x7f407415cb40 2023-08-09T12:53:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f4072d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f4074153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f4072d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f4074153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60590/0 (socket says 172.21.15.17:60590) 2023-08-09T12:53:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.573+0000 7f4072d9d640 1 -- 172.21.15.17:0/670597661 learned_addr learned my addr 172.21.15.17:0/670597661 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:09.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f4072d9d640 1 -- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f407415cb40 msgr2=0x7f407415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:09.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f4072d9d640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f407415cb40 0x7f407415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f4072d9d640 1 -- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40740b8420 msgr2=0x7f4074152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f4072d9d640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40740b8420 0x7f4074152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f4072d9d640 1 -- 172.21.15.17:0/670597661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0094d0 con 0x7f407415cf20 2023-08-09T12:53:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f4072d9d640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f4074153d10 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f406c02b9e0 tx=0x7f406c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f406affd640 1 -- 172.21.15.17:0/670597661 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c039d90 con 0x7f407415cf20 2023-08-09T12:53:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f406affd640 1 -- 172.21.15.17:0/670597661 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c0433f0 con 0x7f407415cf20 2023-08-09T12:53:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f406affd640 1 -- 172.21.15.17:0/670597661 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c0437a0 con 0x7f407415cf20 2023-08-09T12:53:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.574+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407415b590 con 0x7f407415cf20 2023-08-09T12:53:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.575+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40740c9f50 con 0x7f407415cf20 2023-08-09T12:53:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.576+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407404e390 con 0x7f407415cf20 2023-08-09T12:53:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.577+0000 7f406affd640 1 -- 172.21.15.17:0/670597661 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f406c04c3b0 con 0x7f407415cf20 2023-08-09T12:53:09.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.577+0000 7f406affd640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f405406a050 0x7f405406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:09.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.578+0000 7f406affd640 1 -- 172.21.15.17:0/670597661 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f406c0aaa90 con 0x7f407415cf20 2023-08-09T12:53:09.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.578+0000 7f407259c640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f405406a050 0x7f405406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:09.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.579+0000 7f407259c640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f405406a050 0x7f405406c510 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f40640043c0 tx=0x7f4064007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.583+0000 7f406affd640 1 -- 172.21.15.17:0/670597661 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f406c076490 con 0x7f407415cf20 2023-08-09T12:53:09.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.782+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4074069cf0 con 0x7f407415cf20 2023-08-09T12:53:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.791+0000 7f406affd640 1 -- 172.21.15.17:0/670597661 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f406c07f0a0 con 0x7f407415cf20 2023-08-09T12:53:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f405406a050 msgr2=0x7f405406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f405406a050 0x7f405406c510 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f40640043c0 tx=0x7f4064007d30 comp rx=0 tx=0).stop 2023-08-09T12:53:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 msgr2=0x7f4074153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f4074153d10 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f406c02b9e0 tx=0x7f406c004730 comp rx=0 tx=0).stop 2023-08-09T12:53:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 shutdown_connections 2023-08-09T12:53:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f405406a050 0x7f405406c510 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f407415cf20 0x7f4074153d10 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f407415cb40 0x7f407415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 --2- 172.21.15.17:0/670597661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40740b8420 0x7f4074152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 >> 172.21.15.17:0/670597661 conn(0x7f40740d2ab0 msgr2=0x7f40740cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 shutdown_connections 2023-08-09T12:53:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:09.795+0000 7f407359e640 1 -- 172.21.15.17:0/670597661 wait complete. 2023-08-09T12:53:09.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-08-09T12:53:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.039+0000 7f830d063640 1 Processor -- start 2023-08-09T12:53:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.039+0000 7f830d063640 1 -- start start 2023-08-09T12:53:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.041+0000 7f830d063640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8308070f00 0x7f830815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.041+0000 7f830d063640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f830815bce0 0x7f83080cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.041+0000 7f830d063640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8308071340 con 0x7f83081587e0 2023-08-09T12:53:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.041+0000 7f830d063640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83080715c0 con 0x7f8308070f00 2023-08-09T12:53:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.041+0000 7f830d063640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83080718a0 con 0x7f830815bce0 2023-08-09T12:53:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.042+0000 7f830c862640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f830815bce0 0x7f83080cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.042+0000 7f830c862640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f830815bce0 0x7f83080cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:43654/0 (socket says 172.21.15.17:43654) 2023-08-09T12:53:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.042+0000 7f830c862640 1 -- 172.21.15.17:0/1440846835 learned_addr learned my addr 172.21.15.17:0/1440846835 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.042+0000 7f82fffff640 1 --2- 172.21.15.17:0/1440846835 >> v2:172.21.15.142:3300/0 conn(0x7f8308070f00 0x7f830815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.042+0000 7f830c862640 1 -- 172.21.15.17:0/1440846835 >> v2:172.21.15.142:3300/0 conn(0x7f8308070f00 msgr2=0x7f830815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.043+0000 7f830c862640 1 --2- 172.21.15.17:0/1440846835 >> v2:172.21.15.142:3300/0 conn(0x7f8308070f00 0x7f830815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.043+0000 7f830c862640 1 -- 172.21.15.17:0/1440846835 >> v1:172.21.15.142:6789/0 conn(0x7f83081587e0 legacy=0x7f83080b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.043+0000 7f830c862640 1 -- 172.21.15.17:0/1440846835 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8308071b80 con 0x7f830815bce0 2023-08-09T12:53:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.044+0000 7f830c862640 1 --2- 172.21.15.17:0/1440846835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f830815bce0 0x7f83080cb070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8300009e50 tx=0x7f830002bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ffc7aefb1e624e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f83077fe640 1 -- 172.21.15.17:0/1440846835 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830002caf0 con 0x7f830815bce0 2023-08-09T12:53:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f83077fe640 1 -- 172.21.15.17:0/1440846835 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830002cc50 con 0x7f830815bce0 2023-08-09T12:53:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f83077fe640 1 -- 172.21.15.17:0/1440846835 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83000343f0 con 0x7f830815bce0 2023-08-09T12:53:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f830d063640 1 -- 172.21.15.17:0/1440846835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f830815bce0 msgr2=0x7f83080cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f830d063640 1 --2- 172.21.15.17:0/1440846835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f830815bce0 0x7f83080cb070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8300009e50 tx=0x7f830002bf50 comp rx=0 tx=0).stop 2023-08-09T12:53:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f830d063640 1 -- 172.21.15.17:0/1440846835 shutdown_connections 2023-08-09T12:53:10.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f830d063640 1 --2- 172.21.15.17:0/1440846835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f830815bce0 0x7f83080cb070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f830d063640 1 --2- 172.21.15.17:0/1440846835 >> v2:172.21.15.142:3300/0 conn(0x7f8308070f00 0x7f830815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f830d063640 1 -- 172.21.15.17:0/1440846835 >> 172.21.15.17:0/1440846835 conn(0x7f83080b1d50 msgr2=0x7f830806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f830d063640 1 -- 172.21.15.17:0/1440846835 shutdown_connections 2023-08-09T12:53:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.045+0000 7f830d063640 1 -- 172.21.15.17:0/1440846835 wait complete. 2023-08-09T12:53:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.048+0000 7f830d063640 1 Processor -- start 2023-08-09T12:53:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.048+0000 7f830d063640 1 -- start start 2023-08-09T12:53:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f830d063640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8308070f00 0x7f830815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f830d063640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83081587e0 0x7f830815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f830d063640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f830814b590 0x7f830815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f830d063640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830815f540 con 0x7f8308070f00 2023-08-09T12:53:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f830d063640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830815eca0 con 0x7f830814b590 2023-08-09T12:53:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f830d063640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830815ef80 con 0x7f83081587e0 2023-08-09T12:53:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f8307fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8308070f00 0x7f830815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f8307fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8308070f00 0x7f830815e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60602/0 (socket says 172.21.15.17:60602) 2023-08-09T12:53:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.049+0000 7f8307fff640 1 -- 172.21.15.17:0/940201972 learned_addr learned my addr 172.21.15.17:0/940201972 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.050+0000 7f82fffff640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83081587e0 0x7f830815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.050+0000 7f830c862640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f830814b590 0x7f830815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.050+0000 7f8307fff640 1 -- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83081587e0 msgr2=0x7f830815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.050+0000 7f8307fff640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83081587e0 0x7f830815c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.050+0000 7f8307fff640 1 -- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f830814b590 msgr2=0x7f830815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.050+0000 7f8307fff640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f830814b590 0x7f830815c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.050+0000 7f8307fff640 1 -- 172.21.15.17:0/940201972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009b30 con 0x7f8308070f00 2023-08-09T12:53:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.050+0000 7f8307fff640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8308070f00 0x7f830815e1e0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f82f800c450 tx=0x7f82f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.051+0000 7f83057fa640 1 -- 172.21.15.17:0/940201972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f80052d0 con 0x7f8308070f00 2023-08-09T12:53:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.051+0000 7f83057fa640 1 -- 172.21.15.17:0/940201972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8005430 con 0x7f8308070f00 2023-08-09T12:53:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.051+0000 7f83057fa640 1 -- 172.21.15.17:0/940201972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8012870 con 0x7f8308070f00 2023-08-09T12:53:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.051+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830815f260 con 0x7f8308070f00 2023-08-09T12:53:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.051+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830815e720 con 0x7f8308070f00 2023-08-09T12:53:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.052+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83080c3270 con 0x7f8308070f00 2023-08-09T12:53:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.053+0000 7f83057fa640 1 -- 172.21.15.17:0/940201972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f82f80129d0 con 0x7f8308070f00 2023-08-09T12:53:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.054+0000 7f83057fa640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f82e806a080 0x7f82e806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.055+0000 7f83057fa640 1 -- 172.21.15.17:0/940201972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f82f8087e20 con 0x7f8308070f00 2023-08-09T12:53:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.055+0000 7f82fffff640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f82e806a080 0x7f82e806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.056+0000 7f82fffff640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f82e806a080 0x7f82e806c540 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f83080c5340 tx=0x7f82f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.059+0000 7f83057fa640 1 -- 172.21.15.17:0/940201972 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f83080c3270 con 0x7f8308070f00 2023-08-09T12:53:10.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.322+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f83080c3650 con 0x7f8308070f00 2023-08-09T12:53:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.337+0000 7f83057fa640 1 -- 172.21.15.17:0/940201972 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v662) v1 ==== 131+0+0 (secure 0 0 0) 0x7f83080c3650 con 0x7f8308070f00 2023-08-09T12:53:10.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.339+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f82e806a080 msgr2=0x7f82e806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.339+0000 7f830d063640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f82e806a080 0x7f82e806c540 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f83080c5340 tx=0x7f82f0008040 comp rx=0 tx=0).stop 2023-08-09T12:53:10.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8308070f00 msgr2=0x7f830815e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8308070f00 0x7f830815e1e0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f82f800c450 tx=0x7f82f800c910 comp rx=0 tx=0).stop 2023-08-09T12:53:10.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 shutdown_connections 2023-08-09T12:53:10.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f82e806a080 0x7f82e806c540 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f830814b590 0x7f830815c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83081587e0 0x7f830815c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 --2- 172.21.15.17:0/940201972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8308070f00 0x7f830815e1e0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 >> 172.21.15.17:0/940201972 conn(0x7f83080b1d50 msgr2=0x7f8308157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:10.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 shutdown_connections 2023-08-09T12:53:10.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.340+0000 7f830d063640 1 -- 172.21.15.17:0/940201972 wait complete. 2023-08-09T12:53:10.363 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-09T12:53:10.363 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-08-09T12:53:10.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-08-09T12:53:10.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.588+0000 7fd788a0d640 1 Processor -- start 2023-08-09T12:53:10.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.588+0000 7fd788a0d640 1 -- start start 2023-08-09T12:53:10.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.589+0000 7fd788a0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cac0 0x7fd7840cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.589+0000 7fd788a0d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd78415cea0 0x7fd7840cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.589+0000 7fd788a0d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7840b8030 con 0x7fd7840d1270 2023-08-09T12:53:10.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.589+0000 7fd788a0d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7840b7790 con 0x7fd78415cea0 2023-08-09T12:53:10.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.589+0000 7fd788a0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840b7a70 con 0x7fd78415cac0 2023-08-09T12:53:10.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.589+0000 7fd782d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd7840d1270 0x7fd7840d16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54516/0 (socket says 172.21.15.17:54516) 2023-08-09T12:53:10.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.589+0000 7fd782d9d640 1 -- 172.21.15.17:0/2018565776 learned_addr learned my addr 172.21.15.17:0/2018565776 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:10.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd781d9b640 1 --2- 172.21.15.17:0/2018565776 >> v2:172.21.15.17:3300/0 conn(0x7fd78415cea0 0x7fd7840cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd78259c640 1 --2- 172.21.15.17:0/2018565776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cac0 0x7fd7840cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd78159a640 1 -- 172.21.15.17:0/2018565776 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862038863 0 0) 0x7fd7840b8030 con 0x7fd7840d1270 2023-08-09T12:53:10.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd78159a640 1 -- 172.21.15.17:0/2018565776 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76c003520 con 0x7fd7840d1270 2023-08-09T12:53:10.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd781d9b640 1 -- 172.21.15.17:0/2018565776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cac0 msgr2=0x7fd7840cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:10.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd781d9b640 1 --2- 172.21.15.17:0/2018565776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cac0 0x7fd7840cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd781d9b640 1 -- 172.21.15.17:0/2018565776 >> v1:172.21.15.17:6789/0 conn(0x7fd7840d1270 legacy=0x7fd7840d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd78159a640 1 -- 172.21.15.17:0/2018565776 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261849333 0 0) 0x7fd76c003520 con 0x7fd7840d1270 2023-08-09T12:53:10.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.590+0000 7fd781d9b640 1 -- 172.21.15.17:0/2018565776 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840b7d50 con 0x7fd78415cea0 2023-08-09T12:53:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.592+0000 7fd781d9b640 1 --2- 172.21.15.17:0/2018565776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cea0 0x7fd7840cffd0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fd7780097a0 tx=0x7fd77802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b71ceafcbae15e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.592+0000 7fd78159a640 1 -- 172.21.15.17:0/2018565776 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c001670 con 0x7fd78415cea0 2023-08-09T12:53:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.592+0000 7fd78159a640 1 -- 172.21.15.17:0/2018565776 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77802e050 con 0x7fd78415cea0 2023-08-09T12:53:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.592+0000 7fd78159a640 1 -- 172.21.15.17:0/2018565776 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778030710 con 0x7fd78415cea0 2023-08-09T12:53:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.592+0000 7fd788a0d640 1 -- 172.21.15.17:0/2018565776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cea0 msgr2=0x7fd7840cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.592+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2018565776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cea0 0x7fd7840cffd0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fd7780097a0 tx=0x7fd77802b790 comp rx=0 tx=0).stop 2023-08-09T12:53:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.593+0000 7fd788a0d640 1 -- 172.21.15.17:0/2018565776 shutdown_connections 2023-08-09T12:53:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.593+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2018565776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cea0 0x7fd7840cffd0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.593+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2018565776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cac0 0x7fd7840cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.593+0000 7fd788a0d640 1 -- 172.21.15.17:0/2018565776 >> 172.21.15.17:0/2018565776 conn(0x7fd7840699a0 msgr2=0x7fd784069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.593+0000 7fd788a0d640 1 -- 172.21.15.17:0/2018565776 shutdown_connections 2023-08-09T12:53:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.593+0000 7fd788a0d640 1 -- 172.21.15.17:0/2018565776 wait complete. 2023-08-09T12:53:10.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.594+0000 7fd788a0d640 1 Processor -- start 2023-08-09T12:53:10.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.595+0000 7fd788a0d640 1 -- start start 2023-08-09T12:53:10.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd788a0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7840d1270 0x7fd78415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd788a0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cac0 0x7fd784150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd788a0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cea0 0x7fd7840c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd788a0d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd784151290 con 0x7fd78415cac0 2023-08-09T12:53:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd788a0d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840c9450 con 0x7fd7840d1270 2023-08-09T12:53:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd788a0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78415f3c0 con 0x7fd78415cea0 2023-08-09T12:53:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd781d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cac0 0x7fd784150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd781d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cac0 0x7fd784150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60614/0 (socket says 172.21.15.17:60614) 2023-08-09T12:53:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd781d9b640 1 -- 172.21.15.17:0/2174789638 learned_addr learned my addr 172.21.15.17:0/2174789638 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd78259c640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7840d1270 0x7fd78415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd781d9b640 1 -- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cea0 msgr2=0x7fd7840c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd781d9b640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cea0 0x7fd7840c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd781d9b640 1 -- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7840d1270 msgr2=0x7fd78415e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd781d9b640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7840d1270 0x7fd78415e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd781d9b640 1 -- 172.21.15.17:0/2174789638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778009400 con 0x7fd78415cac0 2023-08-09T12:53:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.596+0000 7fd78259c640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7840d1270 0x7fd78415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.597+0000 7fd781d9b640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cac0 0x7fd784150d50 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fd778000c00 tx=0x7fd7780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.597+0000 7fd772ffd640 1 -- 172.21.15.17:0/2174789638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77803c620 con 0x7fd78415cac0 2023-08-09T12:53:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.597+0000 7fd772ffd640 1 -- 172.21.15.17:0/2174789638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77803c7a0 con 0x7fd78415cac0 2023-08-09T12:53:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.597+0000 7fd772ffd640 1 -- 172.21.15.17:0/2174789638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77803cb50 con 0x7fd78415cac0 2023-08-09T12:53:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.597+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78415f6a0 con 0x7fd78415cac0 2023-08-09T12:53:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.597+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7840c6ce0 con 0x7fd78415cac0 2023-08-09T12:53:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.599+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78415fbc0 con 0x7fd78415cac0 2023-08-09T12:53:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.600+0000 7fd772ffd640 1 -- 172.21.15.17:0/2174789638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd778039070 con 0x7fd78415cac0 2023-08-09T12:53:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.601+0000 7fd772ffd640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd76406a050 0x7fd76406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.601+0000 7fd772ffd640 1 -- 172.21.15.17:0/2174789638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd7780a99b0 con 0x7fd78415cac0 2023-08-09T12:53:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.601+0000 7fd78259c640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd76406a050 0x7fd76406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.602+0000 7fd78259c640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd76406a050 0x7fd76406c510 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd774007520 tx=0x7fd77400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.605+0000 7fd772ffd640 1 -- 172.21.15.17:0/2174789638 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd7780754d0 con 0x7fd78415cac0 2023-08-09T12:53:10.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:10.871+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fd784067a80 con 0x7fd78415cac0 2023-08-09T12:53:11.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.347+0000 7fd772ffd640 1 -- 172.21.15.17:0/2174789638 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v663) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd7780370d0 con 0x7fd78415cac0 2023-08-09T12:53:11.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.350+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd76406a050 msgr2=0x7fd76406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:11.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.350+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd76406a050 0x7fd76406c510 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd774007520 tx=0x7fd77400b040 comp rx=0 tx=0).stop 2023-08-09T12:53:11.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.350+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cac0 msgr2=0x7fd784150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.350+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cac0 0x7fd784150d50 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fd778000c00 tx=0x7fd7780046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.351+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 shutdown_connections 2023-08-09T12:53:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.351+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd76406a050 0x7fd76406c510 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.351+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd78415cea0 0x7fd7840c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.351+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78415cac0 0x7fd784150d50 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.351+0000 7fd788a0d640 1 --2- 172.21.15.17:0/2174789638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7840d1270 0x7fd78415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.351+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 >> 172.21.15.17:0/2174789638 conn(0x7fd7840699a0 msgr2=0x7fd78415be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:11.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.351+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 shutdown_connections 2023-08-09T12:53:11.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.351+0000 7fd788a0d640 1 -- 172.21.15.17:0/2174789638 wait complete. 2023-08-09T12:53:11.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:53:11.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.608+0000 7fc69e3c4640 1 Processor -- start 2023-08-09T12:53:11.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.608+0000 7fc69e3c4640 1 -- start start 2023-08-09T12:53:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc69e3c4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc698164f50 0x7fc6980cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc69e3c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6980c1980 0x7fc698165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc69e3c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698165870 0x7fc6980c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc69e3c4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6980cd520 con 0x7fc698164f50 2023-08-09T12:53:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc69e3c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6980cc630 con 0x7fc6980c1980 2023-08-09T12:53:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc69e3c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980cc910 con 0x7fc698165870 2023-08-09T12:53:11.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc697fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc698164f50 0x7fc6980cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:11.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc697fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc698164f50 0x7fc6980cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60630/0 (socket says 172.21.15.17:60630) 2023-08-09T12:53:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc697fff640 1 -- 172.21.15.17:0/1769564261 learned_addr learned my addr 172.21.15.17:0/1769564261 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc69c961640 1 --2- 172.21.15.17:0/1769564261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698165870 0x7fc6980c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.610+0000 7fc6977fe640 1 --2- 172.21.15.17:0/1769564261 >> v2:172.21.15.142:3300/0 conn(0x7fc6980c1980 0x7fc698165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.611+0000 7fc697fff640 1 -- 172.21.15.17:0/1769564261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698165870 msgr2=0x7fc6980c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.611+0000 7fc697fff640 1 --2- 172.21.15.17:0/1769564261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698165870 0x7fc6980c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.611+0000 7fc697fff640 1 -- 172.21.15.17:0/1769564261 >> v2:172.21.15.142:3300/0 conn(0x7fc6980c1980 msgr2=0x7fc698165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.611+0000 7fc697fff640 1 --2- 172.21.15.17:0/1769564261 >> v2:172.21.15.142:3300/0 conn(0x7fc6980c1980 0x7fc698165330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.611+0000 7fc697fff640 1 -- 172.21.15.17:0/1769564261 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980ccbf0 con 0x7fc698164f50 2023-08-09T12:53:11.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.611+0000 7fc6977fe640 1 --2- 172.21.15.17:0/1769564261 >> v2:172.21.15.142:3300/0 conn(0x7fc6980c1980 0x7fc698165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:11.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.613+0000 7fc697fff640 1 --2- 172.21.15.17:0/1769564261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc698164f50 0x7fc6980cd9b0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fc6980c8d80 tx=0x7fc68802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37f773b9cdeaf02 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:11.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.613+0000 7fc696ffd640 1 -- 172.21.15.17:0/1769564261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688031860 con 0x7fc698164f50 2023-08-09T12:53:11.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.613+0000 7fc696ffd640 1 -- 172.21.15.17:0/1769564261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6880319c0 con 0x7fc698164f50 2023-08-09T12:53:11.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.613+0000 7fc696ffd640 1 -- 172.21.15.17:0/1769564261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688031d50 con 0x7fc698164f50 2023-08-09T12:53:11.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 -- 172.21.15.17:0/1769564261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc698164f50 msgr2=0x7fc6980cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:11.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/1769564261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc698164f50 0x7fc6980cd9b0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fc6980c8d80 tx=0x7fc68802b900 comp rx=0 tx=0).stop 2023-08-09T12:53:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 -- 172.21.15.17:0/1769564261 shutdown_connections 2023-08-09T12:53:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/1769564261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698165870 0x7fc6980c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/1769564261 >> v2:172.21.15.142:3300/0 conn(0x7fc6980c1980 0x7fc698165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/1769564261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc698164f50 0x7fc6980cd9b0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 -- 172.21.15.17:0/1769564261 >> 172.21.15.17:0/1769564261 conn(0x7fc6980cb1b0 msgr2=0x7fc6980cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 -- 172.21.15.17:0/1769564261 shutdown_connections 2023-08-09T12:53:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.614+0000 7fc69e3c4640 1 -- 172.21.15.17:0/1769564261 wait complete. 2023-08-09T12:53:11.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.617+0000 7fc69e3c4640 1 Processor -- start 2023-08-09T12:53:11.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.617+0000 7fc69e3c4640 1 -- start start 2023-08-09T12:53:11.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.618+0000 7fc69e3c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6980c1980 0x7fc69814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.618+0000 7fc69e3c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698164f50 0x7fc6981516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.618+0000 7fc69e3c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc698165870 0x7fc6981f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.618+0000 7fc69e3c4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6981f7d50 con 0x7fc6980c1980 2023-08-09T12:53:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.618+0000 7fc69e3c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980699f0 con 0x7fc698165870 2023-08-09T12:53:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.618+0000 7fc69e3c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6981f7250 con 0x7fc698164f50 2023-08-09T12:53:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6980c1980 0x7fc69814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:11.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6980c1980 0x7fc69814e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60640/0 (socket says 172.21.15.17:60640) 2023-08-09T12:53:11.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 -- 172.21.15.17:0/4293348875 learned_addr learned my addr 172.21.15.17:0/4293348875 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc69c961640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc698165870 0x7fc6981f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc6977fe640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698164f50 0x7fc6981516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 -- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698164f50 msgr2=0x7fc6981516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698164f50 0x7fc6981516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 -- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc698165870 msgr2=0x7fc6981f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc698165870 0x7fc6981f6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 -- 172.21.15.17:0/4293348875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880094d0 con 0x7fc6980c1980 2023-08-09T12:53:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc6977fe640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698164f50 0x7fc6981516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc69c961640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc698165870 0x7fc6981f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.619+0000 7fc697fff640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6980c1980 0x7fc69814e4a0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fc68802b940 tx=0x7fc6880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.620+0000 7fc694ff9640 1 -- 172.21.15.17:0/4293348875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68803ac60 con 0x7fc6980c1980 2023-08-09T12:53:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.620+0000 7fc694ff9640 1 -- 172.21.15.17:0/4293348875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68803ade0 con 0x7fc6980c1980 2023-08-09T12:53:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.620+0000 7fc694ff9640 1 -- 172.21.15.17:0/4293348875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688044630 con 0x7fc6980c1980 2023-08-09T12:53:11.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.620+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6981f74b0 con 0x7fc6980c1980 2023-08-09T12:53:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.620+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6981f7a70 con 0x7fc6980c1980 2023-08-09T12:53:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.622+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc698067a80 con 0x7fc6980c1980 2023-08-09T12:53:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.623+0000 7fc694ff9640 1 -- 172.21.15.17:0/4293348875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc68804d450 con 0x7fc6980c1980 2023-08-09T12:53:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.623+0000 7fc694ff9640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68406a050 0x7fc68406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.624+0000 7fc694ff9640 1 -- 172.21.15.17:0/4293348875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc6880aa840 con 0x7fc6980c1980 2023-08-09T12:53:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.624+0000 7fc6977fe640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68406a050 0x7fc68406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.626+0000 7fc6977fe640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68406a050 0x7fc68406c510 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc69806af20 tx=0x7fc68c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.628+0000 7fc694ff9640 1 -- 172.21.15.17:0/4293348875 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc688076260 con 0x7fc6980c1980 2023-08-09T12:53:11.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.822+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6980697c0 con 0x7fc6980c1980 2023-08-09T12:53:11.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.824+0000 7fc694ff9640 1 -- 172.21.15.17:0/4293348875 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+14756 (secure 0 0 0) 0x7fc688035090 con 0x7fc6980c1980 2023-08-09T12:53:11.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:11.828 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":183,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:53:09.312896+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/2739343495":"2023-08-10T12:53:05.862955+0000","172.21.15.17:6834/2739343495":"2023-08-10T12:53:05.862955+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:53:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68406a050 msgr2=0x7fc68406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68406a050 0x7fc68406c510 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc69806af20 tx=0x7fc68c008040 comp rx=0 tx=0).stop 2023-08-09T12:53:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6980c1980 msgr2=0x7fc69814e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6980c1980 0x7fc69814e4a0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fc68802b940 tx=0x7fc6880046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 shutdown_connections 2023-08-09T12:53:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc68406a050 0x7fc68406c510 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc698165870 0x7fc6981f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc698164f50 0x7fc6981516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 --2- 172.21.15.17:0/4293348875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6980c1980 0x7fc69814e4a0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 >> 172.21.15.17:0/4293348875 conn(0x7fc6980cb1b0 msgr2=0x7fc6980af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 shutdown_connections 2023-08-09T12:53:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:11.827+0000 7fc69e3c4640 1 -- 172.21.15.17:0/4293348875 wait complete. 2023-08-09T12:53:11.850 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:53:11.852 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:53:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.074+0000 7fcb3b502640 1 Processor -- start 2023-08-09T12:53:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.075+0000 7fcb3b502640 1 -- start start 2023-08-09T12:53:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.076+0000 7fcb3b502640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb340b8420 0x7fcb340cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.076+0000 7fcb3b502640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb340d0f00 con 0x7fcb3415cf20 2023-08-09T12:53:12.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.076+0000 7fcb3b502640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb341611f0 con 0x7fcb3415cb40 2023-08-09T12:53:12.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.076+0000 7fcb3b502640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb341614d0 con 0x7fcb340b8420 2023-08-09T12:53:12.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.077+0000 7fcb3ad01640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcb3415cf20 0x7fcb340d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54524/0 (socket says 172.21.15.17:54524) 2023-08-09T12:53:12.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.077+0000 7fcb3ad01640 1 -- 172.21.15.17:0/2157799115 learned_addr learned my addr 172.21.15.17:0/2157799115 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:12.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.077+0000 7fcb39cff640 1 --2- 172.21.15.17:0/2157799115 >> v2:172.21.15.142:3300/0 conn(0x7fcb340b8420 0x7fcb340cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.078+0000 7fcb394fe640 1 -- 172.21.15.17:0/2157799115 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102803768 0 0) 0x7fcb340d0f00 con 0x7fcb3415cf20 2023-08-09T12:53:12.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.078+0000 7fcb394fe640 1 -- 172.21.15.17:0/2157799115 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb20003520 con 0x7fcb3415cf20 2023-08-09T12:53:12.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.078+0000 7fcb39cff640 1 -- 172.21.15.17:0/2157799115 >> v1:172.21.15.142:6789/0 conn(0x7fcb3415cb40 legacy=0x7fcb341609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.078+0000 7fcb39cff640 1 -- 172.21.15.17:0/2157799115 >> v1:172.21.15.17:6789/0 conn(0x7fcb3415cf20 legacy=0x7fcb340d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.078+0000 7fcb39cff640 1 -- 172.21.15.17:0/2157799115 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb341617b0 con 0x7fcb340b8420 2023-08-09T12:53:12.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.079+0000 7fcb39cff640 1 --2- 172.21.15.17:0/2157799115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb340b8420 0x7fcb340cd860 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcb240097a0 tx=0x7fcb2402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d870d5ea4e3e797 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.080+0000 7fcb394fe640 1 -- 172.21.15.17:0/2157799115 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2402f810 con 0x7fcb340b8420 2023-08-09T12:53:12.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.080+0000 7fcb394fe640 1 -- 172.21.15.17:0/2157799115 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2402f970 con 0x7fcb340b8420 2023-08-09T12:53:12.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.080+0000 7fcb394fe640 1 -- 172.21.15.17:0/2157799115 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2402fce0 con 0x7fcb340b8420 2023-08-09T12:53:12.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.080+0000 7fcb3b502640 1 -- 172.21.15.17:0/2157799115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb340b8420 msgr2=0x7fcb340cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.080+0000 7fcb3b502640 1 --2- 172.21.15.17:0/2157799115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb340b8420 0x7fcb340cd860 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcb240097a0 tx=0x7fcb2402b9f0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.080+0000 7fcb3b502640 1 -- 172.21.15.17:0/2157799115 shutdown_connections 2023-08-09T12:53:12.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.080+0000 7fcb3b502640 1 --2- 172.21.15.17:0/2157799115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb340b8420 0x7fcb340cd860 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.080+0000 7fcb3b502640 1 -- 172.21.15.17:0/2157799115 >> 172.21.15.17:0/2157799115 conn(0x7fcb340d2ab0 msgr2=0x7fcb340d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:12.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.081+0000 7fcb3b502640 1 -- 172.21.15.17:0/2157799115 shutdown_connections 2023-08-09T12:53:12.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.081+0000 7fcb3b502640 1 -- 172.21.15.17:0/2157799115 wait complete. 2023-08-09T12:53:12.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.082+0000 7fcb3b502640 1 Processor -- start 2023-08-09T12:53:12.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.082+0000 7fcb3b502640 1 -- start start 2023-08-09T12:53:12.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.083+0000 7fcb3b502640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb340b8420 0x7fcb3414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.083+0000 7fcb3b502640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb3415cb40 0x7fcb3415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.083+0000 7fcb3b502640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb3415cf20 0x7fcb3415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.083+0000 7fcb3b502640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb340c9080 con 0x7fcb3415cf20 2023-08-09T12:53:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.083+0000 7fcb3b502640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb341f47b0 con 0x7fcb3415cb40 2023-08-09T12:53:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.083+0000 7fcb3b502640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb341f4a90 con 0x7fcb340b8420 2023-08-09T12:53:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3ad01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb3415cf20 0x7fcb3415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3ad01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb3415cf20 0x7fcb3415b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60656/0 (socket says 172.21.15.17:60656) 2023-08-09T12:53:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3ad01640 1 -- 172.21.15.17:0/402981166 learned_addr learned my addr 172.21.15.17:0/402981166 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:12.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb39cff640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb3415cb40 0x7fcb3415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3a500640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb340b8420 0x7fcb3414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3ad01640 1 -- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb340b8420 msgr2=0x7fcb3414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3ad01640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb340b8420 0x7fcb3414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3ad01640 1 -- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb3415cb40 msgr2=0x7fcb3415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3ad01640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb3415cb40 0x7fcb3415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.084+0000 7fcb3ad01640 1 -- 172.21.15.17:0/402981166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24009400 con 0x7fcb3415cf20 2023-08-09T12:53:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.085+0000 7fcb3ad01640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb3415cf20 0x7fcb3415b490 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00caa0 tx=0x7fcb2c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.085+0000 7fcb2affd640 1 -- 172.21.15.17:0/402981166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c00ac00 con 0x7fcb3415cf20 2023-08-09T12:53:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.085+0000 7fcb2affd640 1 -- 172.21.15.17:0/402981166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c00ad60 con 0x7fcb3415cf20 2023-08-09T12:53:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.085+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb341f4d70 con 0x7fcb3415cf20 2023-08-09T12:53:12.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.085+0000 7fcb2affd640 1 -- 172.21.15.17:0/402981166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c012620 con 0x7fcb3415cf20 2023-08-09T12:53:12.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.085+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb341f5330 con 0x7fcb3415cf20 2023-08-09T12:53:12.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.086+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3404e390 con 0x7fcb3415cf20 2023-08-09T12:53:12.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.088+0000 7fcb2affd640 1 -- 172.21.15.17:0/402981166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcb2c007070 con 0x7fcb3415cf20 2023-08-09T12:53:12.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.088+0000 7fcb2affd640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcb1806a050 0x7fcb1806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.089+0000 7fcb2affd640 1 -- 172.21.15.17:0/402981166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcb2c0882b0 con 0x7fcb3415cf20 2023-08-09T12:53:12.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.089+0000 7fcb3a500640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcb1806a050 0x7fcb1806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.090+0000 7fcb3a500640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcb1806a050 0x7fcb1806c510 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcb34160850 tx=0x7fcb30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.093+0000 7fcb2affd640 1 -- 172.21.15.17:0/402981166 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcb2c053c20 con 0x7fcb3415cf20 2023-08-09T12:53:12.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.283+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb340cea30 con 0x7fcb3415cf20 2023-08-09T12:53:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.284+0000 7fcb2affd640 1 -- 172.21.15.17:0/402981166 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb2c057240 con 0x7fcb3415cf20 2023-08-09T12:53:12.287 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:53:12.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcb1806a050 msgr2=0x7fcb1806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcb1806a050 0x7fcb1806c510 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcb34160850 tx=0x7fcb30009040 comp rx=0 tx=0).stop 2023-08-09T12:53:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb3415cf20 msgr2=0x7fcb3415b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb3415cf20 0x7fcb3415b490 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00caa0 tx=0x7fcb2c00cf60 comp rx=0 tx=0).stop 2023-08-09T12:53:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 shutdown_connections 2023-08-09T12:53:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcb1806a050 0x7fcb1806c510 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb3415cf20 0x7fcb3415b490 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb3415cb40 0x7fcb3415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 --2- 172.21.15.17:0/402981166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb340b8420 0x7fcb3414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 >> 172.21.15.17:0/402981166 conn(0x7fcb340d2ab0 msgr2=0x7fcb340b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.286+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 shutdown_connections 2023-08-09T12:53:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.287+0000 7fcb3b502640 1 -- 172.21.15.17:0/402981166 wait complete. 2023-08-09T12:53:12.309 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:53:12.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.503+0000 7faf7895d640 1 Processor -- start 2023-08-09T12:53:12.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.503+0000 7faf7895d640 1 -- start start 2023-08-09T12:53:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.504+0000 7faf7895d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf740adc40 0x7faf7406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.504+0000 7faf7895d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf740cc630 0x7faf740ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.504+0000 7faf7895d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf740b2250 con 0x7faf740b3b40 2023-08-09T12:53:12.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.504+0000 7faf7895d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf740ae020 con 0x7faf740adc40 2023-08-09T12:53:12.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.504+0000 7faf7895d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf740b2530 con 0x7faf740cc630 2023-08-09T12:53:12.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.504+0000 7faf71d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7faf740b3b40 0x7faf740b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54530/0 (socket says 172.21.15.17:54530) 2023-08-09T12:53:12.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf71d9b640 1 -- 172.21.15.17:0/1136777785 learned_addr learned my addr 172.21.15.17:0/1136777785 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:12.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf72d9d640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf740cc630 0x7faf740ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7259c640 1 --2- 172.21.15.17:0/1136777785 >> v2:172.21.15.142:3300/0 conn(0x7faf740adc40 0x7faf7406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048720153 0 0) 0x7faf740b2250 con 0x7faf740b3b40 2023-08-09T12:53:12.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf5c003520 con 0x7faf740b3b40 2023-08-09T12:53:12.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056626224 0 0) 0x7faf5c003520 con 0x7faf740b3b40 2023-08-09T12:53:12.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf740cc630 msgr2=0x7faf740ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:12.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf740cc630 0x7faf740ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 >> v2:172.21.15.142:3300/0 conn(0x7faf740adc40 msgr2=0x7faf7406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:12.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 --2- 172.21.15.17:0/1136777785 >> v2:172.21.15.142:3300/0 conn(0x7faf740adc40 0x7faf7406c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7406fe80 con 0x7faf740b3b40 2023-08-09T12:53:12.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7faf680017f0 con 0x7faf740b3b40 2023-08-09T12:53:12.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 >> v1:172.21.15.17:6789/0 conn(0x7faf740b3b40 legacy=0x7faf740b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.505+0000 7faf7159a640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf740cc630 0x7faf5c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf7159a640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c003ef0 0x7faf5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf7159a640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c004d00 0x7faf5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf740ae020 con 0x7faf5c003ef0 2023-08-09T12:53:12.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf740b2530 con 0x7faf5c004d00 2023-08-09T12:53:12.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c00b9d0 con 0x7faf740cc630 2023-08-09T12:53:12.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf71d9b640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c003ef0 0x7faf5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf7259c640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf740cc630 0x7faf5c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf71d9b640 1 -- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf740cc630 msgr2=0x7faf5c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf71d9b640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf740cc630 0x7faf5c003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf71d9b640 1 -- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c004d00 msgr2=0x7faf5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf72d9d640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c004d00 0x7faf5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf71d9b640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c004d00 0x7faf5c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.506+0000 7faf71d9b640 1 -- 172.21.15.17:0/1136777785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c003520 con 0x7faf5c003ef0 2023-08-09T12:53:12.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.507+0000 7faf71d9b640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c003ef0 0x7faf5c0047c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c240 tx=0x7faf5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cc21a79a3ac4d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68007270 con 0x7faf5c003ef0 2023-08-09T12:53:12.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680073d0 con 0x7faf5c003ef0 2023-08-09T12:53:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7159a640 1 -- 172.21.15.17:0/1136777785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6802c8b0 con 0x7faf5c003ef0 2023-08-09T12:53:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7895d640 1 -- 172.21.15.17:0/1136777785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c003ef0 msgr2=0x7faf5c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7895d640 1 --2- 172.21.15.17:0/1136777785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c003ef0 0x7faf5c0047c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c240 tx=0x7faf5c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf72d9d640 1 -- 172.21.15.17:0/1136777785 reap_dead start 2023-08-09T12:53:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7895d640 1 -- 172.21.15.17:0/1136777785 shutdown_connections 2023-08-09T12:53:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7895d640 1 -- 172.21.15.17:0/1136777785 >> 172.21.15.17:0/1136777785 conn(0x7faf740cb1b0 msgr2=0x7faf740cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:12.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7895d640 1 -- 172.21.15.17:0/1136777785 shutdown_connections 2023-08-09T12:53:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.508+0000 7faf7895d640 1 -- 172.21.15.17:0/1136777785 wait complete. 2023-08-09T12:53:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.510+0000 7faf7895d640 1 Processor -- start 2023-08-09T12:53:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.510+0000 7faf7895d640 1 -- start start 2023-08-09T12:53:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.511+0000 7faf7895d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c003ef0 0x7faf74157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.511+0000 7faf7895d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf7415b210 0x7faf7414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.511+0000 7faf7895d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7415c740 0x7faf7415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.511+0000 7faf7895d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7415c2b0 con 0x7faf7415c740 2023-08-09T12:53:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.511+0000 7faf7895d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7415b6a0 con 0x7faf5c003ef0 2023-08-09T12:53:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.511+0000 7faf7895d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7415b980 con 0x7faf7415b210 2023-08-09T12:53:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf72d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7415c740 0x7faf7415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf72d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7415c740 0x7faf7415cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60676/0 (socket says 172.21.15.17:60676) 2023-08-09T12:53:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf72d9d640 1 -- 172.21.15.17:0/4220770193 learned_addr learned my addr 172.21.15.17:0/4220770193 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf7259c640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c003ef0 0x7faf74157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf71d9b640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf7415b210 0x7faf7414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf72d9d640 1 -- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf7415b210 msgr2=0x7faf7414eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf72d9d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf7415b210 0x7faf7414eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf72d9d640 1 -- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c003ef0 msgr2=0x7faf74157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf72d9d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c003ef0 0x7faf74157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.512+0000 7faf72d9d640 1 -- 172.21.15.17:0/4220770193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7415bc60 con 0x7faf7415c740 2023-08-09T12:53:12.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.513+0000 7faf72d9d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7415c740 0x7faf7415cbf0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7faf740ae160 tx=0x7faf6c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.513+0000 7faf62ffd640 1 -- 172.21.15.17:0/4220770193 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c017400 con 0x7faf7415c740 2023-08-09T12:53:12.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.513+0000 7faf62ffd640 1 -- 172.21.15.17:0/4220770193 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c011040 con 0x7faf7415c740 2023-08-09T12:53:12.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.513+0000 7faf62ffd640 1 -- 172.21.15.17:0/4220770193 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0177c0 con 0x7faf7415c740 2023-08-09T12:53:12.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.513+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7415bf40 con 0x7faf7415c740 2023-08-09T12:53:12.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.513+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf74155d00 con 0x7faf7415c740 2023-08-09T12:53:12.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.514+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf74067a80 con 0x7faf7415c740 2023-08-09T12:53:12.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.515+0000 7faf62ffd640 1 -- 172.21.15.17:0/4220770193 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf6c017920 con 0x7faf7415c740 2023-08-09T12:53:12.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.516+0000 7faf62ffd640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf5406a080 0x7faf5406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.517+0000 7faf62ffd640 1 -- 172.21.15.17:0/4220770193 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7faf6c0887f0 con 0x7faf7415c740 2023-08-09T12:53:12.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.517+0000 7faf7259c640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf5406a080 0x7faf5406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.518+0000 7faf7259c640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf5406a080 0x7faf5406c540 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7faf64009a10 tx=0x7faf64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.521+0000 7faf62ffd640 1 -- 172.21.15.17:0/4220770193 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7faf6c0540d0 con 0x7faf7415c740 2023-08-09T12:53:12.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.711+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf7406ed40 con 0x7faf7415c740 2023-08-09T12:53:12.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.712+0000 7faf62ffd640 1 -- 172.21.15.17:0/4220770193 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v183) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf6c0576f0 con 0x7faf7415c740 2023-08-09T12:53:12.715 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:53:12.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.714+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf5406a080 msgr2=0x7faf5406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.714+0000 7faf7895d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf5406a080 0x7faf5406c540 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7faf64009a10 tx=0x7faf64008040 comp rx=0 tx=0).stop 2023-08-09T12:53:12.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.714+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7415c740 msgr2=0x7faf7415cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.714+0000 7faf7895d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7415c740 0x7faf7415cbf0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7faf740ae160 tx=0x7faf6c00f4a0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.715+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 shutdown_connections 2023-08-09T12:53:12.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.715+0000 7faf7895d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7faf5406a080 0x7faf5406c540 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.715+0000 7faf7895d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7415c740 0x7faf7415cbf0 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.715+0000 7faf7895d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf7415b210 0x7faf7414eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.715+0000 7faf7895d640 1 --2- 172.21.15.17:0/4220770193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5c003ef0 0x7faf74157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.715+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 >> 172.21.15.17:0/4220770193 conn(0x7faf740cb1b0 msgr2=0x7faf740cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:12.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.715+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 shutdown_connections 2023-08-09T12:53:12.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.715+0000 7faf7895d640 1 -- 172.21.15.17:0/4220770193 wait complete. 2023-08-09T12:53:12.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-09T12:53:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.968+0000 7f61d759e640 1 Processor -- start 2023-08-09T12:53:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.968+0000 7f61d759e640 1 -- start start 2023-08-09T12:53:12.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.969+0000 7f61d759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d815aa90 0x7f61d8070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.969+0000 7f61d759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d815e700 con 0x7f61d80b6020 2023-08-09T12:53:12.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.969+0000 7f61d759e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d815f2a0 con 0x7f61d806b9d0 2023-08-09T12:53:12.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.969+0000 7f61d759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8071bf0 con 0x7f61d815aa90 2023-08-09T12:53:12.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.969+0000 7f61d5d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f61d80b6020 0x7f61d815eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54536/0 (socket says 172.21.15.17:54536) 2023-08-09T12:53:12.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.969+0000 7f61d5d9b640 1 -- 172.21.15.17:0/625434703 learned_addr learned my addr 172.21.15.17:0/625434703 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:12.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d659c640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d815aa90 0x7f61d8070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850481774 0 0) 0x7f61d815e700 con 0x7f61d80b6020 2023-08-09T12:53:12.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c0003520 con 0x7f61d80b6020 2023-08-09T12:53:12.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104993129 0 0) 0x7f61c0003520 con 0x7f61d80b6020 2023-08-09T12:53:12.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d815aa90 msgr2=0x7f61d8070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:12.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d559a640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d815aa90 0x7f61d8070cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 >> v1:172.21.15.142:6789/0 conn(0x7f61d806b9d0 legacy=0x7f61d80cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8071350 con 0x7f61d80b6020 2023-08-09T12:53:12.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.970+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f61cc001670 con 0x7f61d80b6020 2023-08-09T12:53:12.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 >> v1:172.21.15.17:6789/0 conn(0x7f61d80b6020 legacy=0x7f61d815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d559a640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d559a640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c00047c0 0x7f61c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d559a640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d815aa90 0x7f61c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8071bf0 con 0x7f61c00039a0 2023-08-09T12:53:12.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000ba60 con 0x7f61c00047c0 2023-08-09T12:53:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000bc20 con 0x7f61d815aa90 2023-08-09T12:53:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d659c640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d6d9d640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d815aa90 0x7f61c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d5d9b640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c00047c0 0x7f61c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d659c640 1 -- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d815aa90 msgr2=0x7f61c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d659c640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d815aa90 0x7f61c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d659c640 1 -- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c00047c0 msgr2=0x7f61c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.971+0000 7f61d659c640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c00047c0 0x7f61c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.972+0000 7f61d659c640 1 -- 172.21.15.17:0/625434703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0003520 con 0x7f61c00039a0 2023-08-09T12:53:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.972+0000 7f61d5d9b640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c00047c0 0x7f61c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.973+0000 7f61d659c640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61c0003dc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009a90 tx=0x7f61c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f36ac0f2016e3c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.973+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c802c680 con 0x7f61c00039a0 2023-08-09T12:53:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.973+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c802c7e0 con 0x7f61c00039a0 2023-08-09T12:53:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.973+0000 7f61d559a640 1 -- 172.21.15.17:0/625434703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c802cb70 con 0x7f61c00039a0 2023-08-09T12:53:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.973+0000 7f61d759e640 1 -- 172.21.15.17:0/625434703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 msgr2=0x7f61c0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.973+0000 7f61d759e640 1 --2- 172.21.15.17:0/625434703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61c0003dc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009a90 tx=0x7f61c00057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.973+0000 7f61d6d9d640 1 -- 172.21.15.17:0/625434703 reap_dead start 2023-08-09T12:53:12.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.974+0000 7f61d759e640 1 -- 172.21.15.17:0/625434703 shutdown_connections 2023-08-09T12:53:12.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.974+0000 7f61d759e640 1 -- 172.21.15.17:0/625434703 >> 172.21.15.17:0/625434703 conn(0x7f61d80d0790 msgr2=0x7f61d80d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:12.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.974+0000 7f61d759e640 1 -- 172.21.15.17:0/625434703 shutdown_connections 2023-08-09T12:53:12.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.974+0000 7f61d759e640 1 -- 172.21.15.17:0/625434703 wait complete. 2023-08-09T12:53:12.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.975+0000 7f61d759e640 1 Processor -- start 2023-08-09T12:53:12.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.976+0000 7f61d759e640 1 -- start start 2023-08-09T12:53:12.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.976+0000 7f61d759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61d815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.976+0000 7f61d759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80b1990 0x7f61d80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.976+0000 7f61d759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d814ba30 0x7f61d814beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.976+0000 7f61d759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80b2350 con 0x7f61c00039a0 2023-08-09T12:53:12.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.976+0000 7f61d759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80c7860 con 0x7f61d80b1990 2023-08-09T12:53:12.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.976+0000 7f61d759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d814f7f0 con 0x7f61d814ba30 2023-08-09T12:53:12.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61d815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61d815d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60686/0 (socket says 172.21.15.17:60686) 2023-08-09T12:53:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d659c640 1 -- 172.21.15.17:0/213481254 learned_addr learned my addr 172.21.15.17:0/213481254 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d6d9d640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d814ba30 0x7f61d814beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d5d9b640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80b1990 0x7f61d80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d659c640 1 -- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d814ba30 msgr2=0x7f61d814beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d659c640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d814ba30 0x7f61d814beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d659c640 1 -- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80b1990 msgr2=0x7f61d80b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d659c640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80b1990 0x7f61d80b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:12.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.977+0000 7f61d659c640 1 -- 172.21.15.17:0/213481254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d80b2570 con 0x7f61c00039a0 2023-08-09T12:53:12.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.978+0000 7f61d659c640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61d815d2b0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009a90 tx=0x7f61c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.978+0000 7f61c6ffd640 1 -- 172.21.15.17:0/213481254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c802dea0 con 0x7f61c00039a0 2023-08-09T12:53:12.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.978+0000 7f61c6ffd640 1 -- 172.21.15.17:0/213481254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c8003810 con 0x7f61c00039a0 2023-08-09T12:53:12.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.978+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d80b2850 con 0x7f61c00039a0 2023-08-09T12:53:12.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.978+0000 7f61c6ffd640 1 -- 172.21.15.17:0/213481254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8003ba0 con 0x7f61c00039a0 2023-08-09T12:53:12.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.978+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d80c7ab0 con 0x7f61c00039a0 2023-08-09T12:53:12.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.980+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d804e390 con 0x7f61c00039a0 2023-08-09T12:53:12.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.980+0000 7f61c6ffd640 1 -- 172.21.15.17:0/213481254 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f61c8003d00 con 0x7f61c00039a0 2023-08-09T12:53:12.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.981+0000 7f61c6ffd640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f61b806a080 0x7f61b806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:12.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.981+0000 7f61c6ffd640 1 -- 172.21.15.17:0/213481254 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f61c80aa120 con 0x7f61c00039a0 2023-08-09T12:53:12.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.982+0000 7f61d5d9b640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f61b806a080 0x7f61b806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:12.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.983+0000 7f61d5d9b640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f61b806a080 0x7f61b806c540 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f61d815de70 tx=0x7f61cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:12.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:12.986+0000 7f61c6ffd640 1 -- 172.21.15.17:0/213481254 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f61c8075b10 con 0x7f61c00039a0 2023-08-09T12:53:13.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.177+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f61d814c3f0 con 0x7f61c00039a0 2023-08-09T12:53:13.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.185+0000 7f61c6ffd640 1 -- 172.21.15.17:0/213481254 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f61c8079130 con 0x7f61c00039a0 2023-08-09T12:53:13.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f61b806a080 msgr2=0x7f61b806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:13.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f61b806a080 0x7f61b806c540 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f61d815de70 tx=0x7f61cc009040 comp rx=0 tx=0).stop 2023-08-09T12:53:13.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 msgr2=0x7f61d815d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:13.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61d815d2b0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009a90 tx=0x7f61c8004730 comp rx=0 tx=0).stop 2023-08-09T12:53:13.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 shutdown_connections 2023-08-09T12:53:13.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f61b806a080 0x7f61b806c540 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d814ba30 0x7f61d814beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80b1990 0x7f61d80b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 --2- 172.21.15.17:0/213481254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00039a0 0x7f61d815d2b0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 >> 172.21.15.17:0/213481254 conn(0x7f61d80d0790 msgr2=0x7f61d80b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:13.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 shutdown_connections 2023-08-09T12:53:13.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.188+0000 7f61d759e640 1 -- 172.21.15.17:0/213481254 wait complete. 2023-08-09T12:53:13.213 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:53:13.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:53:13.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:53:13.456 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:53:13.457 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:53:13.458 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:13.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:53:13.524 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:53:13.524 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:13.532 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:53:13.540 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:53:13.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:53:13.586 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:53:13.586 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:13.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:53:13.641 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:53:13.642 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:13.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:53:13.697 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-09T12:53:13.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.947+0000 7f74e6e25640 1 Processor -- start 2023-08-09T12:53:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.947+0000 7f74e6e25640 1 -- start start 2023-08-09T12:53:13.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.949+0000 7f74e6e25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 0x7f74e00c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:13.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.949+0000 7f74e6e25640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e00b34a0 con 0x7f74e00caf00 2023-08-09T12:53:13.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.949+0000 7f74e6e25640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e00b3780 con 0x7f74e01601f0 2023-08-09T12:53:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.949+0000 7f74e6e25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00b4120 con 0x7f74e00cb3b0 2023-08-09T12:53:13.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.949+0000 7f74e5622640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f74e00caf00 0x7f74e00c2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54544/0 (socket says 172.21.15.17:54544) 2023-08-09T12:53:13.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.949+0000 7f74e5622640 1 -- 172.21.15.17:0/4012652934 learned_addr learned my addr 172.21.15.17:0/4012652934 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e6624640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 0x7f74e00c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755761101 0 0) 0x7f74e00b34a0 con 0x7f74e00caf00 2023-08-09T12:53:13.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74cc003520 con 0x7f74e00caf00 2023-08-09T12:53:13.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1911299695 0 0) 0x7f74cc003520 con 0x7f74e00caf00 2023-08-09T12:53:13.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 msgr2=0x7f74e00c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 0x7f74e00c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 >> v1:172.21.15.142:6789/0 conn(0x7f74e01601f0 legacy=0x7f74e00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e00b3a60 con 0x7f74e00caf00 2023-08-09T12:53:13.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f74d0001670 con 0x7f74e00caf00 2023-08-09T12:53:13.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.950+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 >> v1:172.21.15.17:6789/0 conn(0x7f74e00caf00 legacy=0x7f74e00c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:13.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e4e21640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 0x7f74cc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:13.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e4e21640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:13.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e4e21640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74cc004d00 0x7f74cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:13.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00b4120 con 0x7f74cc003f20 2023-08-09T12:53:13.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc00ba60 con 0x7f74cc004d00 2023-08-09T12:53:13.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc00bc20 con 0x7f74e00cb3b0 2023-08-09T12:53:13.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e5622640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:13.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e5e23640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 0x7f74cc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:13.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e5622640 1 -- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 msgr2=0x7f74cc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:13.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e5622640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 0x7f74cc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e5622640 1 -- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74cc004d00 msgr2=0x7f74cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:13.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e5622640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74cc004d00 0x7f74cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e5622640 1 -- 172.21.15.17:0/4012652934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc003520 con 0x7f74cc003f20 2023-08-09T12:53:13.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.951+0000 7f74e5e23640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e00cb3b0 0x7f74cc0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:13.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.952+0000 7f74e5622640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74cc0047c0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c240 tx=0x7f74cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdefe64cca355cfd server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:13.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.953+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0005ad0 con 0x7f74cc003f20 2023-08-09T12:53:13.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.953+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d0005c30 con 0x7f74cc003f20 2023-08-09T12:53:13.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.953+0000 7f74e4e21640 1 -- 172.21.15.17:0/4012652934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d002c8b0 con 0x7f74cc003f20 2023-08-09T12:53:13.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.953+0000 7f74e6e25640 1 -- 172.21.15.17:0/4012652934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 msgr2=0x7f74cc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:13.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.953+0000 7f74e6e25640 1 --2- 172.21.15.17:0/4012652934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74cc0047c0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c240 tx=0x7f74cc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.953+0000 7f74e6624640 1 -- 172.21.15.17:0/4012652934 reap_dead start 2023-08-09T12:53:13.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.954+0000 7f74e6e25640 1 -- 172.21.15.17:0/4012652934 shutdown_connections 2023-08-09T12:53:13.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.954+0000 7f74e6e25640 1 -- 172.21.15.17:0/4012652934 >> 172.21.15.17:0/4012652934 conn(0x7f74e00b1d50 msgr2=0x7f74e006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:13.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.954+0000 7f74e6e25640 1 -- 172.21.15.17:0/4012652934 shutdown_connections 2023-08-09T12:53:13.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.954+0000 7f74e6e25640 1 -- 172.21.15.17:0/4012652934 wait complete. 2023-08-09T12:53:13.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.956+0000 7f74e6e25640 1 Processor -- start 2023-08-09T12:53:13.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.956+0000 7f74e6e25640 1 -- start start 2023-08-09T12:53:13.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e6e25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74e015c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:13.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e6e25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e01595f0 0x7f74e01459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:13.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e6e25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0145ef0 0x7f74e00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:13.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e6e25640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e015bb70 con 0x7f74cc003f20 2023-08-09T12:53:13.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e6e25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0146410 con 0x7f74e01595f0 2023-08-09T12:53:13.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e6e25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0148820 con 0x7f74e0145ef0 2023-08-09T12:53:13.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e5e23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74e015c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:13.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e5e23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74e015c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60698/0 (socket says 172.21.15.17:60698) 2023-08-09T12:53:13.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.957+0000 7f74e5e23640 1 -- 172.21.15.17:0/2066373717 learned_addr learned my addr 172.21.15.17:0/2066373717 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:13.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74e5e23640 1 -- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0145ef0 msgr2=0x7f74e00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:13.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74e5e23640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0145ef0 0x7f74e00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74e5e23640 1 -- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e01595f0 msgr2=0x7f74e01459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:13.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74e5e23640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e01595f0 0x7f74e01459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:13.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74e5e23640 1 -- 172.21.15.17:0/2066373717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e015b520 con 0x7f74cc003f20 2023-08-09T12:53:13.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74e5e23640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74e015c000 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00d770 tx=0x7f74dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:13.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74d67fc640 1 -- 172.21.15.17:0/2066373717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc005270 con 0x7f74cc003f20 2023-08-09T12:53:13.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74d67fc640 1 -- 172.21.15.17:0/2066373717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc0053d0 con 0x7f74cc003f20 2023-08-09T12:53:13.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74d67fc640 1 -- 172.21.15.17:0/2066373717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00b870 con 0x7f74cc003f20 2023-08-09T12:53:13.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e015b800 con 0x7f74cc003f20 2023-08-09T12:53:13.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.958+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e015c540 con 0x7f74cc003f20 2023-08-09T12:53:13.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.960+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e004e390 con 0x7f74cc003f20 2023-08-09T12:53:13.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.961+0000 7f74d67fc640 1 -- 172.21.15.17:0/2066373717 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f74dc00b9d0 con 0x7f74cc003f20 2023-08-09T12:53:13.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.962+0000 7f74d67fc640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f74c406a050 0x7f74c406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:13.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.962+0000 7f74d67fc640 1 -- 172.21.15.17:0/2066373717 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f74dc088170 con 0x7f74cc003f20 2023-08-09T12:53:13.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.962+0000 7f74e5622640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f74c406a050 0x7f74c406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:13.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.963+0000 7f74e5622640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f74c406a050 0x7f74c406c510 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f74d0034000 tx=0x7f74d0007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:13.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:13.966+0000 7f74d67fc640 1 -- 172.21.15.17:0/2066373717 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f74dc053b60 con 0x7f74cc003f20 2023-08-09T12:53:14.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.198+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74e00c70d0 con 0x7f74cc003f20 2023-08-09T12:53:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.199+0000 7f74d67fc640 1 -- 172.21.15.17:0/2066373717 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f74dc019310 con 0x7f74cc003f20 2023-08-09T12:53:14.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:14.204 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/53885323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":53885323},{"type":"v1","addr":"172.21.15.142:6836","nonce":53885323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1636287832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1636287832},{"type":"v1","addr":"172.21.15.142:6837","nonce":1636287832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8994,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/758642293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":758642293},{"type":"v1","addr":"172.21.15.17:6833","nonce":758642293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":9363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2260664788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2260664788},{"type":"v1","addr":"172.21.15.17:6835","nonce":2260664788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[]} 2023-08-09T12:53:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 86 2023-08-09T12:53:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f74c406a050 msgr2=0x7f74c406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f74c406a050 0x7f74c406c510 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f74d0034000 tx=0x7f74d0007000 comp rx=0 tx=0).stop 2023-08-09T12:53:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 msgr2=0x7f74e015c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74e015c000 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00d770 tx=0x7f74dc00dc30 comp rx=0 tx=0).stop 2023-08-09T12:53:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 shutdown_connections 2023-08-09T12:53:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f74c406a050 0x7f74c406c510 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74e0145ef0 0x7f74e00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74e01595f0 0x7f74e01459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 --2- 172.21.15.17:0/2066373717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74cc003f20 0x7f74e015c000 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 >> 172.21.15.17:0/2066373717 conn(0x7f74e00b1d50 msgr2=0x7f74e00c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 shutdown_connections 2023-08-09T12:53:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.202+0000 7f74e6e25640 1 -- 172.21.15.17:0/2066373717 wait complete. 2023-08-09T12:53:14.225 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-09T12:53:14.225 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-09T12:53:14.225 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:53:14.225 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:53:14.226 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-09T12:53:14.226 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-09T12:53:14.226 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:53:14.226 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:53:14.227 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-09T12:53:14.227 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-09T12:53:14.227 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:53:14.227 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:53:14.228 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-09T12:53:14.228 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-09T12:53:14.228 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:53:14.228 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:53:14.246 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:53:14.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-09T12:53:14.253 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:53:14.254 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-09T12:53:14.254 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:53:14.255 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-09T12:53:14.256 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:53:14.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-09T12:53:14.302 INFO:tasks.ceph.mds.b:Started 2023-08-09T12:53:14.303 DEBUG:teuthology.parallel:result is None 2023-08-09T12:53:14.303 INFO:tasks.ceph.mds.c:Started 2023-08-09T12:53:14.304 DEBUG:teuthology.parallel:result is None 2023-08-09T12:53:14.310 INFO:tasks.ceph.mds.d:Started 2023-08-09T12:53:14.311 DEBUG:teuthology.parallel:result is None 2023-08-09T12:53:14.311 INFO:tasks.ceph.mds.a:Started 2023-08-09T12:53:14.312 DEBUG:teuthology.parallel:result is None 2023-08-09T12:53:14.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-09T12:53:14.471 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-08-09T12:53:14.472 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-08-09T12:53:14.481 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:53:14.481 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-08-09T12:53:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.508+0000 7f55e617f640 1 Processor -- start 2023-08-09T12:53:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.508+0000 7f55e617f640 1 -- start start 2023-08-09T12:53:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55e617f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f55e015ce90 0x7f55e01616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55e617f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 0x7f55e00d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55e617f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e00b6460 con 0x7f55e00b6000 2023-08-09T12:53:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55e617f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e00d33a0 con 0x7f55e015ce90 2023-08-09T12:53:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55e617f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e00cdd10 con 0x7f55e00d29d0 2023-08-09T12:53:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55df7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f55e015ce90 0x7f55e01616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55deffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f55e00b6000 0x7f55e00cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:37322/0 (socket says 172.21.15.17:37322) 2023-08-09T12:53:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55deffd640 1 -- 172.21.15.17:0/3834131359 learned_addr learned my addr 172.21.15.17:0/3834131359 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.509+0000 7f55dffff640 1 --2- 172.21.15.17:0/3834131359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 0x7f55e00d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.510+0000 7f55df7fe640 1 -- 172.21.15.17:0/3834131359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 msgr2=0x7f55e00d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.510+0000 7f55df7fe640 1 --2- 172.21.15.17:0/3834131359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 0x7f55e00d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.510+0000 7f55df7fe640 1 -- 172.21.15.17:0/3834131359 >> v1:172.21.15.142:6789/0 conn(0x7f55e00b6000 legacy=0x7f55e00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.510+0000 7f55df7fe640 1 -- 172.21.15.17:0/3834131359 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e00cdff0 con 0x7f55e015ce90 2023-08-09T12:53:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.511+0000 7f55df7fe640 1 --2- 172.21.15.17:0/3834131359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015ce90 0x7f55e01616e0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097a0 tx=0x7f55d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0668617747716d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.511+0000 7f55de7fc640 1 -- 172.21.15.17:0/3834131359 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0031830 con 0x7f55e015ce90 2023-08-09T12:53:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55de7fc640 1 -- 172.21.15.17:0/3834131359 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d0031990 con 0x7f55e015ce90 2023-08-09T12:53:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55de7fc640 1 -- 172.21.15.17:0/3834131359 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0031d20 con 0x7f55e015ce90 2023-08-09T12:53:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55e617f640 1 -- 172.21.15.17:0/3834131359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015ce90 msgr2=0x7f55e01616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55e617f640 1 --2- 172.21.15.17:0/3834131359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015ce90 0x7f55e01616e0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097a0 tx=0x7f55d002b8d0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55e617f640 1 -- 172.21.15.17:0/3834131359 shutdown_connections 2023-08-09T12:53:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55e617f640 1 --2- 172.21.15.17:0/3834131359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 0x7f55e00d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55e617f640 1 --2- 172.21.15.17:0/3834131359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015ce90 0x7f55e01616e0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55e617f640 1 -- 172.21.15.17:0/3834131359 >> 172.21.15.17:0/3834131359 conn(0x7f55e006fde0 msgr2=0x7f55e00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55e617f640 1 -- 172.21.15.17:0/3834131359 shutdown_connections 2023-08-09T12:53:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.512+0000 7f55e617f640 1 -- 172.21.15.17:0/3834131359 wait complete. 2023-08-09T12:53:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.514+0000 7f55e617f640 1 Processor -- start 2023-08-09T12:53:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.514+0000 7f55e617f640 1 -- start start 2023-08-09T12:53:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.515+0000 7f55e617f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e00b6000 0x7f55e01e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.515+0000 7f55e617f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 0x7f55e0152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:14.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.515+0000 7f55e617f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e015ce90 0x7f55e01f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:14.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.515+0000 7f55e617f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e01572f0 con 0x7f55e00b6000 2023-08-09T12:53:14.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.515+0000 7f55e617f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e01575d0 con 0x7f55e015ce90 2023-08-09T12:53:14.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.515+0000 7f55e617f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e01e6cd0 con 0x7f55e00d29d0 2023-08-09T12:53:14.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55df7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e00b6000 0x7f55e01e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:14.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55df7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e00b6000 0x7f55e01e63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60732/0 (socket says 172.21.15.17:60732) 2023-08-09T12:53:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55df7fe640 1 -- 172.21.15.17:0/3887875339 learned_addr learned my addr 172.21.15.17:0/3887875339 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55deffd640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 0x7f55e0152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55dffff640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e015ce90 0x7f55e01f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55df7fe640 1 -- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 msgr2=0x7f55e0152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55df7fe640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 0x7f55e0152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55df7fe640 1 -- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e015ce90 msgr2=0x7f55e01f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55df7fe640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e015ce90 0x7f55e01f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.516+0000 7f55df7fe640 1 -- 172.21.15.17:0/3887875339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d0009400 con 0x7f55e00b6000 2023-08-09T12:53:14.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.517+0000 7f55df7fe640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e00b6000 0x7f55e01e63f0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f55d0034040 tx=0x7f55d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:14.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.517+0000 7f55c7fff640 1 -- 172.21.15.17:0/3887875339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d003a8f0 con 0x7f55e00b6000 2023-08-09T12:53:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.517+0000 7f55c7fff640 1 -- 172.21.15.17:0/3887875339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d003aa50 con 0x7f55e00b6000 2023-08-09T12:53:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.517+0000 7f55c7fff640 1 -- 172.21.15.17:0/3887875339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d003ae00 con 0x7f55e00b6000 2023-08-09T12:53:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.517+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e01e6fb0 con 0x7f55e00b6000 2023-08-09T12:53:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.517+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e01e6930 con 0x7f55e00b6000 2023-08-09T12:53:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.518+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e0067a80 con 0x7f55e00b6000 2023-08-09T12:53:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.519+0000 7f55c7fff640 1 -- 172.21.15.17:0/3887875339 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f55d004d450 con 0x7f55e00b6000 2023-08-09T12:53:14.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.520+0000 7f55c7fff640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f55cc06a050 0x7f55cc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:14.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.520+0000 7f55c7fff640 1 -- 172.21.15.17:0/3887875339 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f55d00aa2a0 con 0x7f55e00b6000 2023-08-09T12:53:14.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.520+0000 7f55deffd640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f55cc06a050 0x7f55cc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:14.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.521+0000 7f55deffd640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f55cc06a050 0x7f55cc06c510 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f55e0160760 tx=0x7f55d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:14.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.525+0000 7f55c7fff640 1 -- 172.21.15.17:0/3887875339 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f55d0075ca0 con 0x7f55e00b6000 2023-08-09T12:53:14.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:14.734+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f55e00d2190 con 0x7f55e00b6000 2023-08-09T12:53:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.388+0000 7f55c7fff640 1 -- 172.21.15.17:0/3887875339 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v185) v1 ==== 97+0+0 (secure 0 0 0) 0x7f55d00792c0 con 0x7f55e00b6000 2023-08-09T12:53:15.393 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-08-09T12:53:15.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f55cc06a050 msgr2=0x7f55cc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:15.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f55cc06a050 0x7f55cc06c510 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f55e0160760 tx=0x7f55d4009040 comp rx=0 tx=0).stop 2023-08-09T12:53:15.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e00b6000 msgr2=0x7f55e01e63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:15.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e00b6000 0x7f55e01e63f0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f55d0034040 tx=0x7f55d00046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 shutdown_connections 2023-08-09T12:53:15.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f55cc06a050 0x7f55cc06c510 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e015ce90 0x7f55e01f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00d29d0 0x7f55e0152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 --2- 172.21.15.17:0/3887875339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e00b6000 0x7f55e01e63f0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 >> 172.21.15.17:0/3887875339 conn(0x7f55e006fde0 msgr2=0x7f55e00b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.392+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 shutdown_connections 2023-08-09T12:53:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.393+0000 7f55e617f640 1 -- 172.21.15.17:0/3887875339 wait complete. 2023-08-09T12:53:15.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-09T12:53:15.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.648+0000 7f7c3f742640 1 Processor -- start 2023-08-09T12:53:15.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.648+0000 7f7c3f742640 1 -- start start 2023-08-09T12:53:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.650+0000 7f7c3f742640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c380adc40 0x7f7c3806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.650+0000 7f7c3f742640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7c380cc630 0x7f7c380ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.650+0000 7f7c3f742640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c380b2250 con 0x7f7c380b3b40 2023-08-09T12:53:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.650+0000 7f7c3f742640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c380ae020 con 0x7f7c380cc630 2023-08-09T12:53:15.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.650+0000 7f7c3f742640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c380b2530 con 0x7f7c380adc40 2023-08-09T12:53:15.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.650+0000 7f7c3dcdf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7c380cc630 0x7f7c380ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:15.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.650+0000 7f7c3dcdf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7c380cc630 0x7f7c380ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60744/0 (socket says 172.21.15.17:60744) 2023-08-09T12:53:15.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.650+0000 7f7c3dcdf640 1 -- 172.21.15.17:0/1664755317 learned_addr learned my addr 172.21.15.17:0/1664755317 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.651+0000 7f7c3dcdf640 1 -- 172.21.15.17:0/1664755317 >> v2:172.21.15.142:3300/0 conn(0x7f7c380adc40 msgr2=0x7f7c3806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.651+0000 7f7c3dcdf640 1 --2- 172.21.15.17:0/1664755317 >> v2:172.21.15.142:3300/0 conn(0x7f7c380adc40 0x7f7c3806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.651+0000 7f7c3dcdf640 1 -- 172.21.15.17:0/1664755317 >> v1:172.21.15.142:6789/0 conn(0x7f7c380b3b40 legacy=0x7f7c380b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:15.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.651+0000 7f7c3dcdf640 1 -- 172.21.15.17:0/1664755317 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3806fe80 con 0x7f7c380cc630 2023-08-09T12:53:15.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.652+0000 7f7c3dcdf640 1 --2- 172.21.15.17:0/1664755317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380cc630 0x7f7c380ccaa0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f7c380b1320 tx=0x7f7c3002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ae22292dd39d45 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:15.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.652+0000 7f7c2ffff640 1 -- 172.21.15.17:0/1664755317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300317e0 con 0x7f7c380cc630 2023-08-09T12:53:15.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c2ffff640 1 -- 172.21.15.17:0/1664755317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30031940 con 0x7f7c380cc630 2023-08-09T12:53:15.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c2ffff640 1 -- 172.21.15.17:0/1664755317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30031cd0 con 0x7f7c380cc630 2023-08-09T12:53:15.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c3f742640 1 -- 172.21.15.17:0/1664755317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380cc630 msgr2=0x7f7c380ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c3f742640 1 --2- 172.21.15.17:0/1664755317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380cc630 0x7f7c380ccaa0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f7c380b1320 tx=0x7f7c3002b880 comp rx=0 tx=0).stop 2023-08-09T12:53:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c3f742640 1 -- 172.21.15.17:0/1664755317 shutdown_connections 2023-08-09T12:53:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c3f742640 1 --2- 172.21.15.17:0/1664755317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380cc630 0x7f7c380ccaa0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c3f742640 1 --2- 172.21.15.17:0/1664755317 >> v2:172.21.15.142:3300/0 conn(0x7f7c380adc40 0x7f7c3806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c3f742640 1 -- 172.21.15.17:0/1664755317 >> 172.21.15.17:0/1664755317 conn(0x7f7c380cb1b0 msgr2=0x7f7c380cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c3f742640 1 -- 172.21.15.17:0/1664755317 shutdown_connections 2023-08-09T12:53:15.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.653+0000 7f7c3f742640 1 -- 172.21.15.17:0/1664755317 wait complete. 2023-08-09T12:53:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.655+0000 7f7c3f742640 1 Processor -- start 2023-08-09T12:53:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.655+0000 7f7c3f742640 1 -- start start 2023-08-09T12:53:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.656+0000 7f7c3f742640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380adc40 0x7f7c38158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.656+0000 7f7c3f742640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c380b3b40 0x7f7c380c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:15.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.656+0000 7f7c3f742640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c380cc630 0x7f7c38151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.656+0000 7f7c3f742640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c381f20c0 con 0x7f7c380adc40 2023-08-09T12:53:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.656+0000 7f7c3f742640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3815a040 con 0x7f7c380cc630 2023-08-09T12:53:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.656+0000 7f7c3f742640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380c35d0 con 0x7f7c380b3b40 2023-08-09T12:53:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3d4de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380adc40 0x7f7c38158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3d4de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380adc40 0x7f7c38158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60754/0 (socket says 172.21.15.17:60754) 2023-08-09T12:53:15.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3d4de640 1 -- 172.21.15.17:0/4149465789 learned_addr learned my addr 172.21.15.17:0/4149465789 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3ccdd640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c380b3b40 0x7f7c380c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:15.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3dcdf640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c380cc630 0x7f7c38151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:15.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3d4de640 1 -- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c380b3b40 msgr2=0x7f7c380c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:15.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3d4de640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c380b3b40 0x7f7c380c3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3d4de640 1 -- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c380cc630 msgr2=0x7f7c38151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:15.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3d4de640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c380cc630 0x7f7c38151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3d4de640 1 -- 172.21.15.17:0/4149465789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300094d0 con 0x7f7c380adc40 2023-08-09T12:53:15.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.657+0000 7f7c3dcdf640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c380cc630 0x7f7c38151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:15.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.658+0000 7f7c3d4de640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380adc40 0x7f7c38158cc0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ba80 tx=0x7f7c3400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:15.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.658+0000 7f7c2dffb640 1 -- 172.21.15.17:0/4149465789 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400cc00 con 0x7f7c380adc40 2023-08-09T12:53:15.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.658+0000 7f7c2dffb640 1 -- 172.21.15.17:0/4149465789 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3400cd80 con 0x7f7c380adc40 2023-08-09T12:53:15.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.658+0000 7f7c2dffb640 1 -- 172.21.15.17:0/4149465789 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34014680 con 0x7f7c380adc40 2023-08-09T12:53:15.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.658+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c38151ac0 con 0x7f7c380adc40 2023-08-09T12:53:15.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.658+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c381596a0 con 0x7f7c380adc40 2023-08-09T12:53:15.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.659+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c38067a80 con 0x7f7c380adc40 2023-08-09T12:53:15.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.660+0000 7f7c2dffb640 1 -- 172.21.15.17:0/4149465789 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c3401d3b0 con 0x7f7c380adc40 2023-08-09T12:53:15.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.661+0000 7f7c2dffb640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c1c06a050 0x7f7c1c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:15.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.661+0000 7f7c2dffb640 1 -- 172.21.15.17:0/4149465789 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c340881b0 con 0x7f7c380adc40 2023-08-09T12:53:15.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.662+0000 7f7c3ccdd640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c1c06a050 0x7f7c1c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:15.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.663+0000 7f7c3ccdd640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c1c06a050 0x7f7c1c06c510 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7c38155330 tx=0x7f7c28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:15.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.666+0000 7f7c2dffb640 1 -- 172.21.15.17:0/4149465789 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7c34053c80 con 0x7f7c380adc40 2023-08-09T12:53:15.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.929+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7c38070130 con 0x7f7c380adc40 2023-08-09T12:53:15.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.930+0000 7f7c2dffb640 1 -- 172.21.15.17:0/4149465789 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7c340572a0 con 0x7f7c380adc40 2023-08-09T12:53:15.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:15.934 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:15.934 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-08-09T12:53:15.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.934 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-08-09T12:53:15.934 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkYQu8OhAAfMGfM3AsPjBdLKTKH8/KWQ==", 2023-08-09T12:53:15.935 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.935 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:53:15.935 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:53:15.935 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:53:15.935 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.936 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-08-09T12:53:15.936 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk/ffzIRAA2/i7nvVr5q27Vg0gpUZVBg==", 2023-08-09T12:53:15.936 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.936 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:53:15.936 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:53:15.936 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:53:15.936 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.937 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-08-09T12:53:15.937 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNkSGSLEBAAMcDxg2kgn5IPkHo7u/Ghag==", 2023-08-09T12:53:15.937 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.937 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:53:15.938 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:53:15.938 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:53:15.938 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.938 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-08-09T12:53:15.938 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDTiNNk+uuWMRAAgT4jtNUywcjDd+5R2J7exQ==", 2023-08-09T12:53:15.939 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.939 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:53:15.939 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:53:15.939 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:53:15.939 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.940 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-08-09T12:53:15.940 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNks0foKRAAUeBSKd1oHG9xEZhftQVEng==", 2023-08-09T12:53:15.940 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.940 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:53:15.940 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:53:15.940 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.941 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-08-09T12:53:15.941 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDWiNNkBDUuOhAA+k0rzCC3oGhU9INkmgTtTg==", 2023-08-09T12:53:15.941 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.941 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:53:15.941 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:53:15.941 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.942 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-08-09T12:53:15.942 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkAp/bDhAAlq4VJZSzFoxdj8nsb88zsg==", 2023-08-09T12:53:15.942 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.942 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:53:15.943 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:53:15.943 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.943 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-08-09T12:53:15.943 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDXiNNkQpAuHxAAo6GcuQ1YR5guD637gAAz1w==", 2023-08-09T12:53:15.943 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.944 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:53:15.944 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:53:15.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.944 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-08-09T12:53:15.944 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkeBHrKBAARENIfev3m/QbOFjPKz2y8Q==", 2023-08-09T12:53:15.945 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.945 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:53:15.945 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:53:15.945 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.946 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-08-09T12:53:15.946 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDbiNNkGXzmNxAAh8fb5A6DlP5Z3Mzx9ak5dQ==", 2023-08-09T12:53:15.946 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.946 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:53:15.946 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:53:15.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.947 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-08-09T12:53:15.947 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkWyUwDRAAnK0vZCx4MyKYKdlb+oSswQ==", 2023-08-09T12:53:15.947 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.948 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:53:15.948 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:53:15.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.949 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-08-09T12:53:15.949 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDciNNkszG1HhAAc8E9nfYbbwp16rMeKlnvVQ==", 2023-08-09T12:53:15.949 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.949 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-08-09T12:53:15.949 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-08-09T12:53:15.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-08-09T12:53:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ==", 2023-08-09T12:53:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:53:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2023-08-09T12:53:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-09T12:53:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-08-09T12:53:15.952 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkMEDCHBAAR86xVOgDzSjxMadHkoI/MA==", 2023-08-09T12:53:15.952 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.952 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:53:15.952 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:53:15.952 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:53:15.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:53:15.952 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.953 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-08-09T12:53:15.953 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkf1BaEBAAwEsj6JSPJFO1ZxkQJvuStA==", 2023-08-09T12:53:15.953 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.953 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:53:15.953 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:53:15.953 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:53:15.954 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:53:15.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.954 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-08-09T12:53:15.954 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDUiNNkidvpJxAA4JtcDqPehMWWMm6pKVtMzQ==", 2023-08-09T12:53:15.955 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.955 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-08-09T12:53:15.955 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-08-09T12:53:15.955 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-08-09T12:53:15.956 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-08-09T12:53:15.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.956 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-08-09T12:53:15.956 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDRiNNkY24eJxAAroFNGT8lR481SnzPnVr3Aw==", 2023-08-09T12:53:15.957 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.957 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:53:15.957 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-08-09T12:53:15.957 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-08-09T12:53:15.957 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.958 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-08-09T12:53:15.958 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkgYx8LRAAdU6Dw/YK1uJI/bx7KT3WvQ==", 2023-08-09T12:53:15.958 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.958 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:53:15.959 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:53:15.959 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:15.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:15.959 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-08-09T12:53:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDSiNNkBUnhIBAATrA8fZ2G+L+kTJJ5UYH+SA==", 2023-08-09T12:53:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-08-09T12:53:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-08-09T12:53:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-08-09T12:53:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-08-09T12:53:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:15.961 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c1c06a050 msgr2=0x7f7c1c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c1c06a050 0x7f7c1c06c510 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7c38155330 tx=0x7f7c28009040 comp rx=0 tx=0).stop 2023-08-09T12:53:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380adc40 msgr2=0x7f7c38158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380adc40 0x7f7c38158cc0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ba80 tx=0x7f7c3400bf40 comp rx=0 tx=0).stop 2023-08-09T12:53:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 shutdown_connections 2023-08-09T12:53:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7c1c06a050 0x7f7c1c06c510 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c380cc630 0x7f7c38151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c380b3b40 0x7f7c380c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 --2- 172.21.15.17:0/4149465789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c380adc40 0x7f7c38158cc0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.933+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 >> 172.21.15.17:0/4149465789 conn(0x7f7c380cb1b0 msgr2=0x7f7c3806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:15.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.934+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 shutdown_connections 2023-08-09T12:53:15.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:15.934+0000 7f7c3f742640 1 -- 172.21.15.17:0/4149465789 wait complete. 2023-08-09T12:53:15.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:53:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.190+0000 7f6878006640 1 Processor -- start 2023-08-09T12:53:16.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.190+0000 7f6878006640 1 -- start start 2023-08-09T12:53:16.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.192+0000 7f6878006640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700adc40 0x7f687006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.192+0000 7f6878006640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68700b3b40 0x7f68700b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.192+0000 7f6878006640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f687015e8f0 0x7f687015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.192+0000 7f6878006640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700ae020 con 0x7f687015e8f0 2023-08-09T12:53:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.192+0000 7f6878006640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700b2250 con 0x7f68700b3b40 2023-08-09T12:53:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.192+0000 7f6878006640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700b2530 con 0x7f68700adc40 2023-08-09T12:53:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68765a3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f687015e8f0 0x7f687015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68765a3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f687015e8f0 0x7f687015ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60756/0 (socket says 172.21.15.17:60756) 2023-08-09T12:53:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68765a3640 1 -- 172.21.15.17:0/2824308181 learned_addr learned my addr 172.21.15.17:0/2824308181 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f6875da2640 1 --2- 172.21.15.17:0/2824308181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700adc40 0x7f687006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68755a1640 1 --2- 172.21.15.17:0/2824308181 >> v2:172.21.15.142:3300/0 conn(0x7f68700b3b40 0x7f68700b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68765a3640 1 -- 172.21.15.17:0/2824308181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700adc40 msgr2=0x7f687006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68765a3640 1 --2- 172.21.15.17:0/2824308181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700adc40 0x7f687006c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68765a3640 1 -- 172.21.15.17:0/2824308181 >> v2:172.21.15.142:3300/0 conn(0x7f68700b3b40 msgr2=0x7f68700b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68765a3640 1 --2- 172.21.15.17:0/2824308181 >> v2:172.21.15.142:3300/0 conn(0x7f68700b3b40 0x7f68700b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.193+0000 7f68765a3640 1 -- 172.21.15.17:0/2824308181 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687006fe80 con 0x7f687015e8f0 2023-08-09T12:53:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.194+0000 7f68765a3640 1 --2- 172.21.15.17:0/2824308181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f687015e8f0 0x7f687015ed80 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f68700714f0 tx=0x7f686802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cb53894286f249 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.195+0000 7f6874da0640 1 -- 172.21.15.17:0/2824308181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686802ca80 con 0x7f687015e8f0 2023-08-09T12:53:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.195+0000 7f6874da0640 1 -- 172.21.15.17:0/2824308181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686802cbe0 con 0x7f687015e8f0 2023-08-09T12:53:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.195+0000 7f6874da0640 1 -- 172.21.15.17:0/2824308181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68680343f0 con 0x7f687015e8f0 2023-08-09T12:53:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.195+0000 7f6878006640 1 -- 172.21.15.17:0/2824308181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f687015e8f0 msgr2=0x7f687015ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.195+0000 7f6878006640 1 --2- 172.21.15.17:0/2824308181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f687015e8f0 0x7f687015ed80 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f68700714f0 tx=0x7f686802bee0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.196+0000 7f6878006640 1 -- 172.21.15.17:0/2824308181 shutdown_connections 2023-08-09T12:53:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.196+0000 7f6878006640 1 --2- 172.21.15.17:0/2824308181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f687015e8f0 0x7f687015ed80 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.196+0000 7f6878006640 1 --2- 172.21.15.17:0/2824308181 >> v2:172.21.15.142:3300/0 conn(0x7f68700b3b40 0x7f68700b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.196+0000 7f6878006640 1 --2- 172.21.15.17:0/2824308181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700adc40 0x7f687006c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.196+0000 7f6878006640 1 -- 172.21.15.17:0/2824308181 >> 172.21.15.17:0/2824308181 conn(0x7f68700cb1b0 msgr2=0x7f68700cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:16.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.196+0000 7f6878006640 1 -- 172.21.15.17:0/2824308181 shutdown_connections 2023-08-09T12:53:16.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.196+0000 7f6878006640 1 -- 172.21.15.17:0/2824308181 wait complete. 2023-08-09T12:53:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.198+0000 7f6878006640 1 Processor -- start 2023-08-09T12:53:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.198+0000 7f6878006640 1 -- start start 2023-08-09T12:53:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6878006640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68700adc40 0x7f687015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6878006640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700b3b40 0x7f68701e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6878006640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f687015e8f0 0x7f68701e6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6878006640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701e5850 con 0x7f68700adc40 2023-08-09T12:53:16.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6878006640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701e4c40 con 0x7f687015e8f0 2023-08-09T12:53:16.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6878006640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68701e4f20 con 0x7f68700b3b40 2023-08-09T12:53:16.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6875da2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68700adc40 0x7f687015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6875da2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68700adc40 0x7f687015bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60758/0 (socket says 172.21.15.17:60758) 2023-08-09T12:53:16.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.199+0000 7f6875da2640 1 -- 172.21.15.17:0/3899309018 learned_addr learned my addr 172.21.15.17:0/3899309018 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:16.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f6875da2640 1 -- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700b3b40 msgr2=0x7f68701e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f6875da2640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700b3b40 0x7f68701e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f6875da2640 1 -- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f687015e8f0 msgr2=0x7f68701e6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f6875da2640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f687015e8f0 0x7f68701e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f6875da2640 1 -- 172.21.15.17:0/3899309018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868009b30 con 0x7f68700adc40 2023-08-09T12:53:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f6875da2640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68700adc40 0x7f687015bb80 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f686c00d800 tx=0x7f686c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f68667fc640 1 -- 172.21.15.17:0/3899309018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0096a0 con 0x7f68700adc40 2023-08-09T12:53:16.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f68667fc640 1 -- 172.21.15.17:0/3899309018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c009800 con 0x7f68700adc40 2023-08-09T12:53:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f68667fc640 1 -- 172.21.15.17:0/3899309018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c009990 con 0x7f68700adc40 2023-08-09T12:53:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68701e5200 con 0x7f68700adc40 2023-08-09T12:53:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.200+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687015c0c0 con 0x7f68700adc40 2023-08-09T12:53:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.202+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68701f2490 con 0x7f68700adc40 2023-08-09T12:53:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.203+0000 7f68667fc640 1 -- 172.21.15.17:0/3899309018 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f686c009af0 con 0x7f68700adc40 2023-08-09T12:53:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.204+0000 7f68667fc640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f685406a050 0x7f685406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.204+0000 7f68667fc640 1 -- 172.21.15.17:0/3899309018 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f686c088760 con 0x7f68700adc40 2023-08-09T12:53:16.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.204+0000 7f68755a1640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f685406a050 0x7f685406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.205+0000 7f68755a1640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f685406a050 0x7f685406c510 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6860006e20 tx=0x7f6860008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:16.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.208+0000 7f68667fc640 1 -- 172.21.15.17:0/3899309018 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f686c054110 con 0x7f68700adc40 2023-08-09T12:53:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.407+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6870067a80 con 0x7f68700adc40 2023-08-09T12:53:16.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.409+0000 7f68667fc640 1 -- 172.21.15.17:0/3899309018 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f686c057730 con 0x7f68700adc40 2023-08-09T12:53:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:16.414 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":187,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:53:15.400112+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:53:16.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f685406a050 msgr2=0x7f685406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f685406a050 0x7f685406c510 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6860006e20 tx=0x7f6860008040 comp rx=0 tx=0).stop 2023-08-09T12:53:16.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68700adc40 msgr2=0x7f687015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68700adc40 0x7f687015bb80 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f686c00d800 tx=0x7f686c00dcc0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 shutdown_connections 2023-08-09T12:53:16.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f685406a050 0x7f685406c510 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f687015e8f0 0x7f68701e6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68700b3b40 0x7f68701e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 --2- 172.21.15.17:0/3899309018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68700adc40 0x7f687015bb80 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.412+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 >> 172.21.15.17:0/3899309018 conn(0x7f68700cb1b0 msgr2=0x7f687015dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.413+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 shutdown_connections 2023-08-09T12:53:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.413+0000 7f6878006640 1 -- 172.21.15.17:0/3899309018 wait complete. 2023-08-09T12:53:16.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:53:16.436 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:53:16.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.667+0000 7f1790ae5640 1 Processor -- start 2023-08-09T12:53:16.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.667+0000 7f1790ae5640 1 -- start start 2023-08-09T12:53:16.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f1790ae5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0b8420 0x7f178c0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f1790ae5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f178c15cf20 0x7f178c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f1790ae5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c0d0f00 con 0x7f178c15cb40 2023-08-09T12:53:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f1790ae5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c1611f0 con 0x7f178c15cf20 2023-08-09T12:53:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f1790ae5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c1614d0 con 0x7f178c0b8420 2023-08-09T12:53:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f178bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f178c15cf20 0x7f178c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f178bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f178c15cf20 0x7f178c0cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60762/0 (socket says 172.21.15.17:60762) 2023-08-09T12:53:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f178bfff640 1 -- 172.21.15.17:0/3034534146 learned_addr learned my addr 172.21.15.17:0/3034534146 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.669+0000 7f1782ffd640 1 --2- 172.21.15.17:0/3034534146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0b8420 0x7f178c0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.670+0000 7f178bfff640 1 -- 172.21.15.17:0/3034534146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0b8420 msgr2=0x7f178c0cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.670+0000 7f178bfff640 1 --2- 172.21.15.17:0/3034534146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0b8420 0x7f178c0cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.670+0000 7f178bfff640 1 -- 172.21.15.17:0/3034534146 >> v1:172.21.15.142:6789/0 conn(0x7f178c15cb40 legacy=0x7f178c1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.670+0000 7f178bfff640 1 -- 172.21.15.17:0/3034534146 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c1617b0 con 0x7f178c15cf20 2023-08-09T12:53:16.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.671+0000 7f178bfff640 1 --2- 172.21.15.17:0/3034534146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c0cdda0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f1784009e50 tx=0x7f178402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84c9b3cd9978ecf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:16.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.671+0000 7f178affd640 1 -- 172.21.15.17:0/3034534146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178402cb90 con 0x7f178c15cf20 2023-08-09T12:53:16.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.671+0000 7f178affd640 1 -- 172.21.15.17:0/3034534146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178402ccf0 con 0x7f178c15cf20 2023-08-09T12:53:16.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.671+0000 7f178affd640 1 -- 172.21.15.17:0/3034534146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784034610 con 0x7f178c15cf20 2023-08-09T12:53:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.672+0000 7f1790ae5640 1 -- 172.21.15.17:0/3034534146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 msgr2=0x7f178c0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.672+0000 7f1790ae5640 1 --2- 172.21.15.17:0/3034534146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c0cdda0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f1784009e50 tx=0x7f178402bff0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.672+0000 7f1790ae5640 1 -- 172.21.15.17:0/3034534146 shutdown_connections 2023-08-09T12:53:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.672+0000 7f1790ae5640 1 --2- 172.21.15.17:0/3034534146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c0cdda0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.672+0000 7f1790ae5640 1 --2- 172.21.15.17:0/3034534146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0b8420 0x7f178c0cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.672+0000 7f1790ae5640 1 -- 172.21.15.17:0/3034534146 >> 172.21.15.17:0/3034534146 conn(0x7f178c0d2ab0 msgr2=0x7f178c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.672+0000 7f1790ae5640 1 -- 172.21.15.17:0/3034534146 shutdown_connections 2023-08-09T12:53:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.672+0000 7f1790ae5640 1 -- 172.21.15.17:0/3034534146 wait complete. 2023-08-09T12:53:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.674+0000 7f1790ae5640 1 Processor -- start 2023-08-09T12:53:16.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.674+0000 7f1790ae5640 1 -- start start 2023-08-09T12:53:16.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f1790ae5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c0b8420 0x7f178c142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f1790ae5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15cb40 0x7f178c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f1790ae5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f1790ae5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c143410 con 0x7f178c15cf20 2023-08-09T12:53:16.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f1790ae5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0ccbc0 con 0x7f178c0b8420 2023-08-09T12:53:16.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f1790ae5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0cc040 con 0x7f178c15cb40 2023-08-09T12:53:16.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f178bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f178bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60776/0 (socket says 172.21.15.17:60776) 2023-08-09T12:53:16.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.675+0000 7f178bfff640 1 -- 172.21.15.17:0/2314426267 learned_addr learned my addr 172.21.15.17:0/2314426267 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:16.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f178b7fe640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c0b8420 0x7f178c142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f1782ffd640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15cb40 0x7f178c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f178bfff640 1 -- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15cb40 msgr2=0x7f178c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f178bfff640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15cb40 0x7f178c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f178bfff640 1 -- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c0b8420 msgr2=0x7f178c142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f178bfff640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c0b8420 0x7f178c142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f178bfff640 1 -- 172.21.15.17:0/2314426267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784009b30 con 0x7f178c15cf20 2023-08-09T12:53:16.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f1782ffd640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15cb40 0x7f178c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f178bfff640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c158bc0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f1784009e50 tx=0x7f1784004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f1788ff9640 1 -- 172.21.15.17:0/2314426267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784040670 con 0x7f178c15cf20 2023-08-09T12:53:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f1788ff9640 1 -- 172.21.15.17:0/2314426267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17840407d0 con 0x7f178c15cf20 2023-08-09T12:53:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f1788ff9640 1 -- 172.21.15.17:0/2314426267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784040b80 con 0x7f178c15cf20 2023-08-09T12:53:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.676+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0cc320 con 0x7f178c15cf20 2023-08-09T12:53:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.677+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c0cc8e0 con 0x7f178c15cf20 2023-08-09T12:53:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.678+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c04e390 con 0x7f178c15cf20 2023-08-09T12:53:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.679+0000 7f1788ff9640 1 -- 172.21.15.17:0/2314426267 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1784040ce0 con 0x7f178c15cf20 2023-08-09T12:53:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.679+0000 7f1788ff9640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f176c06a050 0x7f176c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.680+0000 7f1788ff9640 1 -- 172.21.15.17:0/2314426267 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f17840ab160 con 0x7f178c15cf20 2023-08-09T12:53:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.680+0000 7f178b7fe640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f176c06a050 0x7f176c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.681+0000 7f178b7fe640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f176c06a050 0x7f176c06c510 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f177c000f60 tx=0x7f177c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.684+0000 7f1788ff9640 1 -- 172.21.15.17:0/2314426267 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f1784076b90 con 0x7f178c15cf20 2023-08-09T12:53:16.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.877+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f178c0ce470 con 0x7f178c15cf20 2023-08-09T12:53:16.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.878+0000 7f1788ff9640 1 -- 172.21.15.17:0/2314426267 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v187) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1784009510 con 0x7f178c15cf20 2023-08-09T12:53:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:53:16.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.880+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f176c06a050 msgr2=0x7f176c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.880+0000 7f1790ae5640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f176c06a050 0x7f176c06c510 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f177c000f60 tx=0x7f177c009040 comp rx=0 tx=0).stop 2023-08-09T12:53:16.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.880+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 msgr2=0x7f178c158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:16.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c158bc0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f1784009e50 tx=0x7f1784004a40 comp rx=0 tx=0).stop 2023-08-09T12:53:16.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 shutdown_connections 2023-08-09T12:53:16.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f176c06a050 0x7f176c06c510 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178c15cf20 0x7f178c158bc0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15cb40 0x7f178c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 --2- 172.21.15.17:0/2314426267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c0b8420 0x7f178c142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:16.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 >> 172.21.15.17:0/2314426267 conn(0x7f178c0d2ab0 msgr2=0x7f178c0b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:16.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 shutdown_connections 2023-08-09T12:53:16.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:16.881+0000 7f1790ae5640 1 -- 172.21.15.17:0/2314426267 wait complete. 2023-08-09T12:53:16.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:53:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.128+0000 7f949acf3640 1 Processor -- start 2023-08-09T12:53:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.128+0000 7f949acf3640 1 -- start start 2023-08-09T12:53:17.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.129+0000 7f949acf3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f94940adc40 0x7f949406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.129+0000 7f949acf3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94940b3b40 0x7f94940b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.129+0000 7f949acf3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949415e8f0 0x7f949415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.129+0000 7f949acf3640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94940ae020 con 0x7f94940b3b40 2023-08-09T12:53:17.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f949acf3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94940b2250 con 0x7f94940adc40 2023-08-09T12:53:17.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f949acf3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94940b2530 con 0x7f949415e8f0 2023-08-09T12:53:17.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9493fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94940b3b40 0x7f94940b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9493fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94940b3b40 0x7f94940b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60782/0 (socket says 172.21.15.17:60782) 2023-08-09T12:53:17.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9493fff640 1 -- 172.21.15.17:0/1780889687 learned_addr learned my addr 172.21.15.17:0/1780889687 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:17.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9498a8f640 1 --2- 172.21.15.17:0/1780889687 >> v2:172.21.15.142:3300/0 conn(0x7f94940adc40 0x7f949406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9499290640 1 --2- 172.21.15.17:0/1780889687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949415e8f0 0x7f949415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9493fff640 1 -- 172.21.15.17:0/1780889687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949415e8f0 msgr2=0x7f949415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:17.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9493fff640 1 --2- 172.21.15.17:0/1780889687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949415e8f0 0x7f949415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9493fff640 1 -- 172.21.15.17:0/1780889687 >> v2:172.21.15.142:3300/0 conn(0x7f94940adc40 msgr2=0x7f949406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:17.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9493fff640 1 --2- 172.21.15.17:0/1780889687 >> v2:172.21.15.142:3300/0 conn(0x7f94940adc40 0x7f949406c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9493fff640 1 -- 172.21.15.17:0/1780889687 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949406fe80 con 0x7f94940b3b40 2023-08-09T12:53:17.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9498a8f640 1 --2- 172.21.15.17:0/1780889687 >> v2:172.21.15.142:3300/0 conn(0x7f94940adc40 0x7f949406c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:17.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.130+0000 7f9499290640 1 --2- 172.21.15.17:0/1780889687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949415e8f0 0x7f949415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:17.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.132+0000 7f9493fff640 1 --2- 172.21.15.17:0/1780889687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94940b3b40 0x7f94940b3fd0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f94940b1320 tx=0x7f948002b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef09d52920ef602e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:17.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.132+0000 7f94937fe640 1 -- 172.21.15.17:0/1780889687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480004030 con 0x7f94940b3b40 2023-08-09T12:53:17.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.132+0000 7f94937fe640 1 -- 172.21.15.17:0/1780889687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480004190 con 0x7f94940b3b40 2023-08-09T12:53:17.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.132+0000 7f94937fe640 1 -- 172.21.15.17:0/1780889687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480031640 con 0x7f94940b3b40 2023-08-09T12:53:17.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 -- 172.21.15.17:0/1780889687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94940b3b40 msgr2=0x7f94940b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 --2- 172.21.15.17:0/1780889687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94940b3b40 0x7f94940b3fd0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f94940b1320 tx=0x7f948002b8e0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 -- 172.21.15.17:0/1780889687 shutdown_connections 2023-08-09T12:53:17.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 --2- 172.21.15.17:0/1780889687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949415e8f0 0x7f949415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 --2- 172.21.15.17:0/1780889687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94940b3b40 0x7f94940b3fd0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 --2- 172.21.15.17:0/1780889687 >> v2:172.21.15.142:3300/0 conn(0x7f94940adc40 0x7f949406c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 -- 172.21.15.17:0/1780889687 >> 172.21.15.17:0/1780889687 conn(0x7f94940cb1b0 msgr2=0x7f94940cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 -- 172.21.15.17:0/1780889687 shutdown_connections 2023-08-09T12:53:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.133+0000 7f949acf3640 1 -- 172.21.15.17:0/1780889687 wait complete. 2023-08-09T12:53:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.135+0000 7f949acf3640 1 Processor -- start 2023-08-09T12:53:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.136+0000 7f949acf3640 1 -- start start 2023-08-09T12:53:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f949acf3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94940adc40 0x7f94940c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f949acf3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94940b3b40 0x7f94941e7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f949acf3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f949415e8f0 0x7f9494155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f949acf3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94941e7bc0 con 0x7f949415e8f0 2023-08-09T12:53:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f949acf3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94940c4650 con 0x7f94940b3b40 2023-08-09T12:53:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f949acf3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94940c4930 con 0x7f94940adc40 2023-08-09T12:53:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f9499290640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f949415e8f0 0x7f9494155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f9499290640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f949415e8f0 0x7f9494155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60792/0 (socket says 172.21.15.17:60792) 2023-08-09T12:53:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.137+0000 7f9499290640 1 -- 172.21.15.17:0/2493169174 learned_addr learned my addr 172.21.15.17:0/2493169174 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9498a8f640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94940adc40 0x7f94940c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9493fff640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94940b3b40 0x7f94941e7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9499290640 1 -- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94940adc40 msgr2=0x7f94940c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9499290640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94940adc40 0x7f94940c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9499290640 1 -- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94940b3b40 msgr2=0x7f94941e7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9499290640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94940b3b40 0x7f94941e7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9499290640 1 -- 172.21.15.17:0/2493169174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9480009460 con 0x7f949415e8f0 2023-08-09T12:53:17.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9498a8f640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94940adc40 0x7f94940c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:17.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9493fff640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94940b3b40 0x7f94941e7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.138+0000 7f9499290640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f949415e8f0 0x7f9494155910 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f948c00cd50 tx=0x7f948c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.139+0000 7f94917fa640 1 -- 172.21.15.17:0/2493169174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00f680 con 0x7f949415e8f0 2023-08-09T12:53:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.139+0000 7f94917fa640 1 -- 172.21.15.17:0/2493169174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c00f800 con 0x7f949415e8f0 2023-08-09T12:53:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.139+0000 7f94917fa640 1 -- 172.21.15.17:0/2493169174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00fbb0 con 0x7f949415e8f0 2023-08-09T12:53:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.139+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94941e5c10 con 0x7f949415e8f0 2023-08-09T12:53:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.139+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94941e58c0 con 0x7f949415e8f0 2023-08-09T12:53:17.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.140+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94941e6130 con 0x7f949415e8f0 2023-08-09T12:53:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.141+0000 7f94917fa640 1 -- 172.21.15.17:0/2493169174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f948c00b040 con 0x7f949415e8f0 2023-08-09T12:53:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.142+0000 7f94917fa640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947806a050 0x7f947806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.142+0000 7f94917fa640 1 -- 172.21.15.17:0/2493169174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f948c088cb0 con 0x7f949415e8f0 2023-08-09T12:53:17.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.143+0000 7f9498a8f640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947806a050 0x7f947806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.144+0000 7f9498a8f640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947806a050 0x7f947806c510 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f948800c940 tx=0x7f9488008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:17.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.146+0000 7f94917fa640 1 -- 172.21.15.17:0/2493169174 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f94941e6130 con 0x7f949415e8f0 2023-08-09T12:53:17.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.336+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f94941e6130 con 0x7f949415e8f0 2023-08-09T12:53:17.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.337+0000 7f94917fa640 1 -- 172.21.15.17:0/2493169174 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v187) v1 ==== 92+0+10 (secure 0 0 0) 0x7f94941e6130 con 0x7f949415e8f0 2023-08-09T12:53:17.340 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:53:17.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947806a050 msgr2=0x7f947806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947806a050 0x7f947806c510 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f948800c940 tx=0x7f9488008040 comp rx=0 tx=0).stop 2023-08-09T12:53:17.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f949415e8f0 msgr2=0x7f9494155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f949415e8f0 0x7f9494155910 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f948c00cd50 tx=0x7f948c00a650 comp rx=0 tx=0).stop 2023-08-09T12:53:17.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 shutdown_connections 2023-08-09T12:53:17.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f947806a050 0x7f947806c510 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f949415e8f0 0x7f9494155910 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94940b3b40 0x7f94941e7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 --2- 172.21.15.17:0/2493169174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94940adc40 0x7f94940c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.339+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 >> 172.21.15.17:0/2493169174 conn(0x7f94940cb1b0 msgr2=0x7f94940cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:17.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.340+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 shutdown_connections 2023-08-09T12:53:17.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.340+0000 7f949acf3640 1 -- 172.21.15.17:0/2493169174 wait complete. 2023-08-09T12:53:17.362 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-09T12:53:17.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.582+0000 7f7e7e99f640 1 Processor -- start 2023-08-09T12:53:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.583+0000 7f7e7e99f640 1 -- start start 2023-08-09T12:53:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.584+0000 7f7e7e99f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7e78070f00 0x7f7e7815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.584+0000 7f7e7e99f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e7815bce0 0x7f7e780cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.584+0000 7f7e7e99f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e78071340 con 0x7f7e781587e0 2023-08-09T12:53:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.584+0000 7f7e7e99f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780715c0 con 0x7f7e78070f00 2023-08-09T12:53:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.584+0000 7f7e7e99f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780718a0 con 0x7f7e7815bce0 2023-08-09T12:53:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7d99d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7e781587e0 0x7f7e780b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54552/0 (socket says 172.21.15.17:54552) 2023-08-09T12:53:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7d99d640 1 -- 172.21.15.17:0/144214764 learned_addr learned my addr 172.21.15.17:0/144214764 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7d19c640 1 --2- 172.21.15.17:0/144214764 >> v2:172.21.15.17:3300/0 conn(0x7f7e78070f00 0x7f7e7815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7e19e640 1 --2- 172.21.15.17:0/144214764 >> v2:172.21.15.142:3300/0 conn(0x7f7e7815bce0 0x7f7e780cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7c99b640 1 -- 172.21.15.17:0/144214764 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822176676 0 0) 0x7f7e78071340 con 0x7f7e781587e0 2023-08-09T12:53:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7c99b640 1 -- 172.21.15.17:0/144214764 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e64003520 con 0x7f7e781587e0 2023-08-09T12:53:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7d19c640 1 -- 172.21.15.17:0/144214764 >> v2:172.21.15.142:3300/0 conn(0x7f7e7815bce0 msgr2=0x7f7e780cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7d19c640 1 --2- 172.21.15.17:0/144214764 >> v2:172.21.15.142:3300/0 conn(0x7f7e7815bce0 0x7f7e780cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7d19c640 1 -- 172.21.15.17:0/144214764 >> v1:172.21.15.17:6789/0 conn(0x7f7e781587e0 legacy=0x7f7e780b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.585+0000 7f7e7d19c640 1 -- 172.21.15.17:0/144214764 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78071b80 con 0x7f7e78070f00 2023-08-09T12:53:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.586+0000 7f7e7d19c640 1 --2- 172.21.15.17:0/144214764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e7815b7a0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f7e780b4290 tx=0x7f7e6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4464b6804e818dc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7c99b640 1 -- 172.21.15.17:0/144214764 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68031830 con 0x7f7e78070f00 2023-08-09T12:53:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7c99b640 1 -- 172.21.15.17:0/144214764 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68031990 con 0x7f7e78070f00 2023-08-09T12:53:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7c99b640 1 -- 172.21.15.17:0/144214764 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68031d20 con 0x7f7e78070f00 2023-08-09T12:53:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7e99f640 1 -- 172.21.15.17:0/144214764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 msgr2=0x7f7e7815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/144214764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e7815b7a0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f7e780b4290 tx=0x7f7e6802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7e99f640 1 -- 172.21.15.17:0/144214764 shutdown_connections 2023-08-09T12:53:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/144214764 >> v2:172.21.15.142:3300/0 conn(0x7f7e7815bce0 0x7f7e780cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/144214764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e7815b7a0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7e99f640 1 -- 172.21.15.17:0/144214764 >> 172.21.15.17:0/144214764 conn(0x7f7e780b1d50 msgr2=0x7f7e7806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:17.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.587+0000 7f7e7e99f640 1 -- 172.21.15.17:0/144214764 shutdown_connections 2023-08-09T12:53:17.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.588+0000 7f7e7e99f640 1 -- 172.21.15.17:0/144214764 wait complete. 2023-08-09T12:53:17.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.589+0000 7f7e7e99f640 1 Processor -- start 2023-08-09T12:53:17.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.589+0000 7f7e7e99f640 1 -- start start 2023-08-09T12:53:17.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.590+0000 7f7e7e99f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e781f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.590+0000 7f7e7e99f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e781587e0 0x7f7e780c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.590+0000 7f7e7e99f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e780ca2d0 0x7f7e780c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.590+0000 7f7e7e99f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78154c80 con 0x7f7e78070f00 2023-08-09T12:53:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.590+0000 7f7e7e99f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780ca810 con 0x7f7e781587e0 2023-08-09T12:53:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.590+0000 7f7e7e99f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e781542e0 con 0x7f7e780ca2d0 2023-08-09T12:53:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e781f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e781f1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60804/0 (socket says 172.21.15.17:60804) 2023-08-09T12:53:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 -- 172.21.15.17:0/847464681 learned_addr learned my addr 172.21.15.17:0/847464681 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d19c640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e781587e0 0x7f7e780c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7e19e640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e780ca2d0 0x7f7e780c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 -- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e780ca2d0 msgr2=0x7f7e780c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e780ca2d0 0x7f7e780c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 -- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e781587e0 msgr2=0x7f7e780c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e781587e0 0x7f7e780c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 -- 172.21.15.17:0/847464681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68009400 con 0x7f7e78070f00 2023-08-09T12:53:17.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d19c640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e781587e0 0x7f7e780c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:17.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.591+0000 7f7e7d99d640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e781f1d20 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c500 tx=0x7f7e7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:17.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.592+0000 7f7e6e7fc640 1 -- 172.21.15.17:0/847464681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74005ce0 con 0x7f7e78070f00 2023-08-09T12:53:17.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.592+0000 7f7e6e7fc640 1 -- 172.21.15.17:0/847464681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74005e40 con 0x7f7e78070f00 2023-08-09T12:53:17.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.592+0000 7f7e6e7fc640 1 -- 172.21.15.17:0/847464681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74007330 con 0x7f7e78070f00 2023-08-09T12:53:17.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.592+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e781545c0 con 0x7f7e78070f00 2023-08-09T12:53:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.592+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e781f2260 con 0x7f7e78070f00 2023-08-09T12:53:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.593+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7806fa10 con 0x7f7e78070f00 2023-08-09T12:53:17.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.594+0000 7f7e6e7fc640 1 -- 172.21.15.17:0/847464681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e74007550 con 0x7f7e78070f00 2023-08-09T12:53:17.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.595+0000 7f7e6e7fc640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e5c06a050 0x7f7e5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:17.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.595+0000 7f7e6e7fc640 1 -- 172.21.15.17:0/847464681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7e74087930 con 0x7f7e78070f00 2023-08-09T12:53:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.596+0000 7f7e7d19c640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e5c06a050 0x7f7e5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.597+0000 7f7e7d19c640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e5c06a050 0x7f7e5c06c510 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7e68036000 tx=0x7f7e6803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.599+0000 7f7e6e7fc640 1 -- 172.21.15.17:0/847464681 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7e7806fa10 con 0x7f7e78070f00 2023-08-09T12:53:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.793+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7e78154dc0 con 0x7f7e78070f00 2023-08-09T12:53:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.794+0000 7f7e6e7fc640 1 -- 172.21.15.17:0/847464681 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v187) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7e78154dc0 con 0x7f7e78070f00 2023-08-09T12:53:17.797 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:17.798 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-08-09T12:53:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-08-09T12:53:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-08-09T12:53:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:17.798 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-08-09T12:53:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-08-09T12:53:17.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:17.799 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-08-09T12:53:17.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.796+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e5c06a050 msgr2=0x7f7e5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e5c06a050 0x7f7e5c06c510 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7e68036000 tx=0x7f7e6803c040 comp rx=0 tx=0).stop 2023-08-09T12:53:17.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 msgr2=0x7f7e781f1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e781f1d20 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c500 tx=0x7f7e7400c9c0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 shutdown_connections 2023-08-09T12:53:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7e5c06a050 0x7f7e5c06c510 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e780ca2d0 0x7f7e780c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e781587e0 0x7f7e780c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 --2- 172.21.15.17:0/847464681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e78070f00 0x7f7e781f1d20 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 >> 172.21.15.17:0/847464681 conn(0x7f7e780b1d50 msgr2=0x7f7e7806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 shutdown_connections 2023-08-09T12:53:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:17.797+0000 7f7e7e99f640 1 -- 172.21.15.17:0/847464681 wait complete. 2023-08-09T12:53:17.820 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-09T12:53:17.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-09T12:53:18.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.053+0000 7fd87fbe8640 1 Processor -- start 2023-08-09T12:53:18.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.053+0000 7fd87fbe8640 1 -- start start 2023-08-09T12:53:18.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.055+0000 7fd87fbe8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8780ce6f0 0x7fd8780ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.055+0000 7fd87fbe8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd87806f110 0x7fd87806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.055+0000 7fd87fbe8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8780cf070 con 0x7fd878159ab0 2023-08-09T12:53:18.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.055+0000 7fd87fbe8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87806fae0 con 0x7fd87806f110 2023-08-09T12:53:18.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.055+0000 7fd87fbe8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd878159e90 con 0x7fd8780ce6f0 2023-08-09T12:53:18.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.055+0000 7fd87d984640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd878159ab0 0x7fd8780cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48976/0 (socket says 172.21.15.17:48976) 2023-08-09T12:53:18.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.055+0000 7fd87d984640 1 -- 172.21.15.17:0/3632634829 learned_addr learned my addr 172.21.15.17:0/3632634829 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:18.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87d183640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8780ce6f0 0x7fd8780ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87e185640 1 --2- 172.21.15.17:0/3632634829 >> v2:172.21.15.142:3300/0 conn(0x7fd87806f110 0x7fd87806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061518346 0 0) 0x7fd8780cf070 con 0x7fd878159ab0 2023-08-09T12:53:18.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd864003520 con 0x7fd878159ab0 2023-08-09T12:53:18.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286619166 0 0) 0x7fd864003520 con 0x7fd878159ab0 2023-08-09T12:53:18.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8780ce6f0 msgr2=0x7fd8780ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:18.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87c982640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8780ce6f0 0x7fd8780ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 >> v2:172.21.15.142:3300/0 conn(0x7fd87806f110 msgr2=0x7fd87806f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:18.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87c982640 1 --2- 172.21.15.17:0/3632634829 >> v2:172.21.15.142:3300/0 conn(0x7fd87806f110 0x7fd87806f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.056+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780ccab0 con 0x7fd878159ab0 2023-08-09T12:53:18.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fd874001670 con 0x7fd878159ab0 2023-08-09T12:53:18.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 >> v1:172.21.15.17:6789/0 conn(0x7fd878159ab0 legacy=0x7fd8780cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87c982640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8780ce6f0 0x7fd864003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87c982640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd864003ef0 0x7fd8640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87c982640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd864004d00 0x7fd864005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87806fae0 con 0x7fd864004d00 2023-08-09T12:53:18.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd878159e90 con 0x7fd864003ef0 2023-08-09T12:53:18.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86400dbc0 con 0x7fd8780ce6f0 2023-08-09T12:53:18.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87e185640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd864004d00 0x7fd864005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87d183640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd864003ef0 0x7fd8640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87d984640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8780ce6f0 0x7fd864003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87e185640 1 -- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8780ce6f0 msgr2=0x7fd864003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:18.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87e185640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8780ce6f0 0x7fd864003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87e185640 1 -- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd864003ef0 msgr2=0x7fd8640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87e185640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd864003ef0 0x7fd8640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.057+0000 7fd87e185640 1 -- 172.21.15.17:0/3632634829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864003520 con 0x7fd864004d00 2023-08-09T12:53:18.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87e185640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd864004d00 0x7fd864005180 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fd870009fc0 tx=0x7fd8640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e873c368723efa server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:18.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87002cc60 con 0x7fd864004d00 2023-08-09T12:53:18.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87000f040 con 0x7fd864004d00 2023-08-09T12:53:18.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87c982640 1 -- 172.21.15.17:0/3632634829 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870034440 con 0x7fd864004d00 2023-08-09T12:53:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87fbe8640 1 -- 172.21.15.17:0/3632634829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd864004d00 msgr2=0x7fd864005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87fbe8640 1 --2- 172.21.15.17:0/3632634829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd864004d00 0x7fd864005180 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fd870009fc0 tx=0x7fd8640057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87e185640 1 -- 172.21.15.17:0/3632634829 reap_dead start 2023-08-09T12:53:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87fbe8640 1 -- 172.21.15.17:0/3632634829 shutdown_connections 2023-08-09T12:53:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.059+0000 7fd87fbe8640 1 -- 172.21.15.17:0/3632634829 >> 172.21.15.17:0/3632634829 conn(0x7fd8780697c0 msgr2=0x7fd878069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.060+0000 7fd87fbe8640 1 -- 172.21.15.17:0/3632634829 shutdown_connections 2023-08-09T12:53:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.060+0000 7fd87fbe8640 1 -- 172.21.15.17:0/3632634829 wait complete. 2023-08-09T12:53:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.061+0000 7fd87fbe8640 1 Processor -- start 2023-08-09T12:53:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.062+0000 7fd87fbe8640 1 -- start start 2023-08-09T12:53:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87fbe8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8781549b0 0x7fd878154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87fbe8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8781f2000 0x7fd8780c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87fbe8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8780c7430 0x7fd8780c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87fbe8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780ca290 con 0x7fd8781f2000 2023-08-09T12:53:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87fbe8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87814a770 con 0x7fd8780c7430 2023-08-09T12:53:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87fbe8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8781552d0 con 0x7fd8781549b0 2023-08-09T12:53:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d183640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8781f2000 0x7fd8780c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d183640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8781f2000 0x7fd8780c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46046/0 (socket says 172.21.15.17:46046) 2023-08-09T12:53:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d183640 1 -- 172.21.15.17:0/4112036955 learned_addr learned my addr 172.21.15.17:0/4112036955 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d984640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8781549b0 0x7fd878154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87e185640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8780c7430 0x7fd8780c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d183640 1 -- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8781549b0 msgr2=0x7fd878154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d183640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8781549b0 0x7fd878154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d183640 1 -- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8780c7430 msgr2=0x7fd8780c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d183640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8780c7430 0x7fd8780c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87d183640 1 -- 172.21.15.17:0/4112036955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780c78d0 con 0x7fd8781f2000 2023-08-09T12:53:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.063+0000 7fd87e185640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8780c7430 0x7fd8780c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.064+0000 7fd87d183640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8781f2000 0x7fd8780c6ef0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fd868011600 tx=0x7fd868011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.064+0000 7fd86e7fc640 1 -- 172.21.15.17:0/4112036955 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800f920 con 0x7fd8781f2000 2023-08-09T12:53:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.064+0000 7fd86e7fc640 1 -- 172.21.15.17:0/4112036955 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86800fa80 con 0x7fd8781f2000 2023-08-09T12:53:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.064+0000 7fd86e7fc640 1 -- 172.21.15.17:0/4112036955 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800fdf0 con 0x7fd8781f2000 2023-08-09T12:53:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.064+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8780c98f0 con 0x7fd8781f2000 2023-08-09T12:53:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.064+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8780c9eb0 con 0x7fd8781f2000 2023-08-09T12:53:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.065+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8780ca3d0 con 0x7fd8781f2000 2023-08-09T12:53:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.066+0000 7fd86e7fc640 1 -- 172.21.15.17:0/4112036955 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd868015460 con 0x7fd8781f2000 2023-08-09T12:53:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.068+0000 7fd86e7fc640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd85c06a050 0x7fd85c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.068+0000 7fd86e7fc640 1 -- 172.21.15.17:0/4112036955 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd8680887d0 con 0x7fd8781f2000 2023-08-09T12:53:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.069+0000 7fd87d984640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd85c06a050 0x7fd85c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.070+0000 7fd87d984640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd85c06a050 0x7fd85c06c510 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd874001eb0 tx=0x7fd874009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.072+0000 7fd86e7fc640 1 -- 172.21.15.17:0/4112036955 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd868054170 con 0x7fd8781f2000 2023-08-09T12:53:18.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.271+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd8780c2880 con 0x7fd8781f2000 2023-08-09T12:53:18.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.408+0000 7fd86e7fc640 1 -- 172.21.15.17:0/4112036955 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v188) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd868057790 con 0x7fd8781f2000 2023-08-09T12:53:18.412 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-08-09T12:53:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.414+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd85c06a050 msgr2=0x7fd85c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd85c06a050 0x7fd85c06c510 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd874001eb0 tx=0x7fd874009040 comp rx=0 tx=0).stop 2023-08-09T12:53:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8781f2000 msgr2=0x7fd8780c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8781f2000 0x7fd8780c6ef0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fd868011600 tx=0x7fd868011ac0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 shutdown_connections 2023-08-09T12:53:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd85c06a050 0x7fd85c06c510 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8780c7430 0x7fd8780c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8781f2000 0x7fd8780c6ef0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 --2- 172.21.15.17:0/4112036955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8781549b0 0x7fd878154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.415+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 >> 172.21.15.17:0/4112036955 conn(0x7fd8780697c0 msgr2=0x7fd8780ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.416+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 shutdown_connections 2023-08-09T12:53:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.417+0000 7fd87fbe8640 1 -- 172.21.15.17:0/4112036955 wait complete. 2023-08-09T12:53:18.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-09T12:53:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.667+0000 7ff9d3b22640 1 Processor -- start 2023-08-09T12:53:18.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.667+0000 7ff9d3b22640 1 -- start start 2023-08-09T12:53:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.669+0000 7ff9d3b22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ce260 0x7ff9cc0b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.669+0000 7ff9d3b22640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0cd670 con 0x7ff9cc161410 2023-08-09T12:53:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.669+0000 7ff9d3b22640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0b02e0 con 0x7ff9cc0b0cb0 2023-08-09T12:53:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.669+0000 7ff9d3b22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0af9b0 con 0x7ff9cc0ce260 2023-08-09T12:53:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.669+0000 7ff9d18be640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff9cc161410 0x7ff9cc0ccd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48978/0 (socket says 172.21.15.17:48978) 2023-08-09T12:53:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.669+0000 7ff9d18be640 1 -- 172.21.15.17:0/2179915374 learned_addr learned my addr 172.21.15.17:0/2179915374 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d10bd640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ce260 0x7ff9cc0b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816213351 0 0) 0x7ff9cc0cd670 con 0x7ff9cc161410 2023-08-09T12:53:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b8003520 con 0x7ff9cc161410 2023-08-09T12:53:18.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 671091719 0 0) 0x7ff9b8003520 con 0x7ff9cc161410 2023-08-09T12:53:18.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ce260 msgr2=0x7ff9cc0b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:18.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ce260 0x7ff9cc0b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 >> v1:172.21.15.142:6789/0 conn(0x7ff9cc0b0cb0 legacy=0x7ff9cc06ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0afc90 con 0x7ff9cc161410 2023-08-09T12:53:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff9c80019f0 con 0x7ff9cc161410 2023-08-09T12:53:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 >> v1:172.21.15.17:6789/0 conn(0x7ff9cc161410 legacy=0x7ff9cc0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b80039a0 0x7ff9b8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b8004350 0x7ff9b8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ce260 0x7ff9b8005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0af9b0 con 0x7ff9b80039a0 2023-08-09T12:53:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b800b980 con 0x7ff9b8004350 2023-08-09T12:53:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.670+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b800bb40 con 0x7ff9cc0ce260 2023-08-09T12:53:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.671+0000 7ff9d18be640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b80039a0 0x7ff9b8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.671+0000 7ff9d10bd640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b8004350 0x7ff9b8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.671+0000 7ff9d18be640 1 -- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ce260 msgr2=0x7ff9b8005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.671+0000 7ff9d18be640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc0ce260 0x7ff9b8005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.671+0000 7ff9d18be640 1 -- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b8004350 msgr2=0x7ff9b8004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.671+0000 7ff9d18be640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b8004350 0x7ff9b8004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.671+0000 7ff9d18be640 1 -- 172.21.15.17:0/2179915374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8003520 con 0x7ff9b80039a0 2023-08-09T12:53:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.671+0000 7ff9d10bd640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b8004350 0x7ff9b8004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.672+0000 7ff9d18be640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b80039a0 0x7ff9b8003d80 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800a830 tx=0x7ff9b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e16f9b3546c5f16 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8034630 con 0x7ff9b80039a0 2023-08-09T12:53:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c802f070 con 0x7ff9b80039a0 2023-08-09T12:53:18.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d08bc640 1 -- 172.21.15.17:0/2179915374 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80349f0 con 0x7ff9b80039a0 2023-08-09T12:53:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d3b22640 1 -- 172.21.15.17:0/2179915374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b80039a0 msgr2=0x7ff9b8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d3b22640 1 --2- 172.21.15.17:0/2179915374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b80039a0 0x7ff9b8003d80 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800a830 tx=0x7ff9b80057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d20bf640 1 -- 172.21.15.17:0/2179915374 reap_dead start 2023-08-09T12:53:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d3b22640 1 -- 172.21.15.17:0/2179915374 shutdown_connections 2023-08-09T12:53:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d3b22640 1 -- 172.21.15.17:0/2179915374 >> 172.21.15.17:0/2179915374 conn(0x7ff9cc0ce840 msgr2=0x7ff9cc0cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d3b22640 1 -- 172.21.15.17:0/2179915374 shutdown_connections 2023-08-09T12:53:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.673+0000 7ff9d3b22640 1 -- 172.21.15.17:0/2179915374 wait complete. 2023-08-09T12:53:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.675+0000 7ff9d3b22640 1 Processor -- start 2023-08-09T12:53:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.675+0000 7ff9d3b22640 1 -- start start 2023-08-09T12:53:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.676+0000 7ff9d3b22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b80039a0 0x7ff9cc0b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.676+0000 7ff9d3b22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0c8ac0 0x7ff9cc1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.676+0000 7ff9d3b22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc162790 0x7ff9cc163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.676+0000 7ff9d3b22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc161a10 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.676+0000 7ff9d3b22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc161cb0 con 0x7ff9cc162790 2023-08-09T12:53:18.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.676+0000 7ff9d3b22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc161f90 con 0x7ff9b80039a0 2023-08-09T12:53:18.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d10bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0c8ac0 0x7ff9cc1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d10bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0c8ac0 0x7ff9cc1578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46062/0 (socket says 172.21.15.17:46062) 2023-08-09T12:53:18.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d10bd640 1 -- 172.21.15.17:0/38581086 learned_addr learned my addr 172.21.15.17:0/38581086 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:18.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d20bf640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc162790 0x7ff9cc163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d18be640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b80039a0 0x7ff9cc0b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d10bd640 1 -- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b80039a0 msgr2=0x7ff9cc0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d10bd640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b80039a0 0x7ff9cc0b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d10bd640 1 -- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc162790 msgr2=0x7ff9cc163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.677+0000 7ff9d10bd640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc162790 0x7ff9cc163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.678+0000 7ff9d10bd640 1 -- 172.21.15.17:0/38581086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc162270 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.678+0000 7ff9d10bd640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0c8ac0 0x7ff9cc1578c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc010890 tx=0x7ff9bc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.678+0000 7ff9c27fc640 1 -- 172.21.15.17:0/38581086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00eb60 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.678+0000 7ff9c27fc640 1 -- 172.21.15.17:0/38581086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc00ecc0 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.678+0000 7ff9c27fc640 1 -- 172.21.15.17:0/38581086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc01c400 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.678+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc1581e0 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.678+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc162c10 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.679+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc162e30 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.681+0000 7ff9c27fc640 1 -- 172.21.15.17:0/38581086 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff9bc01c560 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.682+0000 7ff9c27fc640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:18.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.682+0000 7ff9c27fc640 1 -- 172.21.15.17:0/38581086 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff9bc0889e0 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.682+0000 7ff9d18be640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:18.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.684+0000 7ff9d18be640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800a830 tx=0x7ff9c802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:18.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.685+0000 7ff9c27fc640 1 -- 172.21.15.17:0/38581086 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff9bc0542c0 con 0x7ff9cc0c8ac0 2023-08-09T12:53:18.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:18.883+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff9cc06f300 con 0x7ff9cc0c8ac0 2023-08-09T12:53:19.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.417+0000 7ff9c27fc640 1 -- 172.21.15.17:0/38581086 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v189) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff9bc0578e0 con 0x7ff9cc0c8ac0 2023-08-09T12:53:19.422 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-08-09T12:53:19.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 msgr2=0x7ff9b006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:19.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800a830 tx=0x7ff9c802f000 comp rx=0 tx=0).stop 2023-08-09T12:53:19.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0c8ac0 msgr2=0x7ff9cc1578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:19.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0c8ac0 0x7ff9cc1578c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc010890 tx=0x7ff9bc010d50 comp rx=0 tx=0).stop 2023-08-09T12:53:19.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 shutdown_connections 2023-08-09T12:53:19.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff9b006a050 0x7ff9b006c510 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc162790 0x7ff9cc163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc0c8ac0 0x7ff9cc1578c0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 --2- 172.21.15.17:0/38581086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b80039a0 0x7ff9cc0b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.432+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 >> 172.21.15.17:0/38581086 conn(0x7ff9cc0ce840 msgr2=0x7ff9cc0c3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:19.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.434+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 shutdown_connections 2023-08-09T12:53:19.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.434+0000 7ff9d3b22640 1 -- 172.21.15.17:0/38581086 wait complete. 2023-08-09T12:53:19.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-09T12:53:19.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.664+0000 7fef1f8ee640 1 Processor -- start 2023-08-09T12:53:19.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.664+0000 7fef1f8ee640 1 -- start start 2023-08-09T12:53:19.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.666+0000 7fef1f8ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18164f50 0x7fef180cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:19.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.666+0000 7fef1f8ee640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fef180c1980 0x7fef18165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:19.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.666+0000 7fef1f8ee640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef180cd520 con 0x7fef18165870 2023-08-09T12:53:19.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.666+0000 7fef1f8ee640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef180cc630 con 0x7fef180c1980 2023-08-09T12:53:19.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.666+0000 7fef1f8ee640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180cc910 con 0x7fef18164f50 2023-08-09T12:53:19.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.666+0000 7fef1ce89640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fef180c1980 0x7fef18165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:19.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.666+0000 7fef1ce89640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fef180c1980 0x7fef18165330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46070/0 (socket says 172.21.15.17:46070) 2023-08-09T12:53:19.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.666+0000 7fef1ce89640 1 -- 172.21.15.17:0/4069060475 learned_addr learned my addr 172.21.15.17:0/4069060475 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:19.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.667+0000 7fef1d68a640 1 --2- 172.21.15.17:0/4069060475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18164f50 0x7fef180cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:19.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.667+0000 7fef1ce89640 1 -- 172.21.15.17:0/4069060475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18164f50 msgr2=0x7fef180cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:19.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.667+0000 7fef1ce89640 1 --2- 172.21.15.17:0/4069060475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18164f50 0x7fef180cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.667+0000 7fef1ce89640 1 -- 172.21.15.17:0/4069060475 >> v1:172.21.15.142:6789/0 conn(0x7fef18165870 legacy=0x7fef180c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:19.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.667+0000 7fef1ce89640 1 -- 172.21.15.17:0/4069060475 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180ccbf0 con 0x7fef180c1980 2023-08-09T12:53:19.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.668+0000 7fef1ce89640 1 --2- 172.21.15.17:0/4069060475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef180c1980 0x7fef18165330 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fef08009850 tx=0x7fef0802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c96af847f9928d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:19.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef0ffff640 1 -- 172.21.15.17:0/4069060475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08004230 con 0x7fef180c1980 2023-08-09T12:53:19.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef0ffff640 1 -- 172.21.15.17:0/4069060475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef08004390 con 0x7fef180c1980 2023-08-09T12:53:19.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef0ffff640 1 -- 172.21.15.17:0/4069060475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08003810 con 0x7fef180c1980 2023-08-09T12:53:19.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef1f8ee640 1 -- 172.21.15.17:0/4069060475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef180c1980 msgr2=0x7fef18165330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:19.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/4069060475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef180c1980 0x7fef18165330 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fef08009850 tx=0x7fef0802b960 comp rx=0 tx=0).stop 2023-08-09T12:53:19.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef1f8ee640 1 -- 172.21.15.17:0/4069060475 shutdown_connections 2023-08-09T12:53:19.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/4069060475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef180c1980 0x7fef18165330 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/4069060475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18164f50 0x7fef180cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef1f8ee640 1 -- 172.21.15.17:0/4069060475 >> 172.21.15.17:0/4069060475 conn(0x7fef180cb1b0 msgr2=0x7fef180cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:19.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef1f8ee640 1 -- 172.21.15.17:0/4069060475 shutdown_connections 2023-08-09T12:53:19.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.669+0000 7fef1f8ee640 1 -- 172.21.15.17:0/4069060475 wait complete. 2023-08-09T12:53:19.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.671+0000 7fef1f8ee640 1 Processor -- start 2023-08-09T12:53:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.671+0000 7fef1f8ee640 1 -- start start 2023-08-09T12:53:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.672+0000 7fef1f8ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef180c1980 0x7fef180c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.672+0000 7fef1f8ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18164f50 0x7fef18159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.672+0000 7fef1f8ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18165870 0x7fef18161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.672+0000 7fef1f8ee640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1806a690 con 0x7fef18164f50 2023-08-09T12:53:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.672+0000 7fef1f8ee640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef180697c0 con 0x7fef180c1980 2023-08-09T12:53:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.672+0000 7fef1f8ee640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef18069a10 con 0x7fef18165870 2023-08-09T12:53:19.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1ce89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18164f50 0x7fef18159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:19.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1ce89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18164f50 0x7fef18159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46084/0 (socket says 172.21.15.17:46084) 2023-08-09T12:53:19.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1ce89640 1 -- 172.21.15.17:0/2525840387 learned_addr learned my addr 172.21.15.17:0/2525840387 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:19.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1d68a640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef180c1980 0x7fef180c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:19.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1de8b640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18165870 0x7fef18161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:19.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1ce89640 1 -- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18165870 msgr2=0x7fef18161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:19.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1ce89640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18165870 0x7fef18161290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1ce89640 1 -- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef180c1980 msgr2=0x7fef180c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:19.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1ce89640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef180c1980 0x7fef180c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:19.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1ce89640 1 -- 172.21.15.17:0/2525840387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08009460 con 0x7fef18164f50 2023-08-09T12:53:19.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.673+0000 7fef1de8b640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18165870 0x7fef18161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:19.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.674+0000 7fef1ce89640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18164f50 0x7fef18159390 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fef08009970 tx=0x7fef080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:19.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.674+0000 7fef0dffb640 1 -- 172.21.15.17:0/2525840387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0803d070 con 0x7fef18164f50 2023-08-09T12:53:19.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.674+0000 7fef0dffb640 1 -- 172.21.15.17:0/2525840387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef08004500 con 0x7fef18164f50 2023-08-09T12:53:19.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.674+0000 7fef0dffb640 1 -- 172.21.15.17:0/2525840387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08003df0 con 0x7fef18164f50 2023-08-09T12:53:19.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.674+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef18069cf0 con 0x7fef18164f50 2023-08-09T12:53:19.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.674+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1806a2b0 con 0x7fef18164f50 2023-08-09T12:53:19.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.675+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1815afd0 con 0x7fef18164f50 2023-08-09T12:53:19.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.676+0000 7fef0dffb640 1 -- 172.21.15.17:0/2525840387 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef08006040 con 0x7fef18164f50 2023-08-09T12:53:19.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.677+0000 7fef0dffb640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feefc06a050 0x7feefc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:19.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.677+0000 7fef0dffb640 1 -- 172.21.15.17:0/2525840387 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fef080aa250 con 0x7fef18164f50 2023-08-09T12:53:19.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.678+0000 7fef1d68a640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feefc06a050 0x7feefc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:19.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.679+0000 7fef1d68a640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feefc06a050 0x7feefc06c510 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fef14006fd0 tx=0x7fef14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:19.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.682+0000 7fef0dffb640 1 -- 172.21.15.17:0/2525840387 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fef08075a20 con 0x7fef18164f50 2023-08-09T12:53:19.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:19.911+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fef1806a440 con 0x7fef18164f50 2023-08-09T12:53:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.488+0000 7fef0dffb640 1 -- 172.21.15.17:0/2525840387 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v89) v1 ==== 174+0+0 (secure 0 0 0) 0x7fef08079040 con 0x7fef18164f50 2023-08-09T12:53:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 23 and data pool 24 2023-08-09T12:53:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feefc06a050 msgr2=0x7feefc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feefc06a050 0x7feefc06c510 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fef14006fd0 tx=0x7fef14008040 comp rx=0 tx=0).stop 2023-08-09T12:53:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18164f50 msgr2=0x7fef18159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18164f50 0x7fef18159390 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fef08009970 tx=0x7fef080046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 shutdown_connections 2023-08-09T12:53:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7feefc06a050 0x7feefc06c510 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef18165870 0x7fef18161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18164f50 0x7fef18159390 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 --2- 172.21.15.17:0/2525840387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef180c1980 0x7fef180c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 >> 172.21.15.17:0/2525840387 conn(0x7fef180cb1b0 msgr2=0x7fef18065580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 shutdown_connections 2023-08-09T12:53:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.494+0000 7fef1f8ee640 1 -- 172.21.15.17:0/2525840387 wait complete. 2023-08-09T12:53:20.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:53:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.719+0000 7f40e6776640 1 Processor -- start 2023-08-09T12:53:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.720+0000 7f40e6776640 1 -- start start 2023-08-09T12:53:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.721+0000 7f40e6776640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40e00adc40 0x7f40e006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.721+0000 7f40e6776640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40e00b3b40 0x7f40e00b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.721+0000 7f40e6776640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e00b2250 con 0x7f40e015e8f0 2023-08-09T12:53:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.721+0000 7f40e6776640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00ae020 con 0x7f40e00adc40 2023-08-09T12:53:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.721+0000 7f40e6776640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00b2530 con 0x7f40e00b3b40 2023-08-09T12:53:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.721+0000 7f40dffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40e00adc40 0x7f40e006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.722+0000 7f40dffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40e00adc40 0x7f40e006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46096/0 (socket says 172.21.15.17:46096) 2023-08-09T12:53:20.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.722+0000 7f40dffff640 1 -- 172.21.15.17:0/2229860558 learned_addr learned my addr 172.21.15.17:0/2229860558 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.722+0000 7f40d77fe640 1 --2- 172.21.15.17:0/2229860558 >> v2:172.21.15.142:3300/0 conn(0x7f40e00b3b40 0x7f40e00b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.722+0000 7f40dffff640 1 -- 172.21.15.17:0/2229860558 >> v2:172.21.15.142:3300/0 conn(0x7f40e00b3b40 msgr2=0x7f40e00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.722+0000 7f40dffff640 1 --2- 172.21.15.17:0/2229860558 >> v2:172.21.15.142:3300/0 conn(0x7f40e00b3b40 0x7f40e00b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.722+0000 7f40dffff640 1 -- 172.21.15.17:0/2229860558 >> v1:172.21.15.17:6789/0 conn(0x7f40e015e8f0 legacy=0x7f40e015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.722+0000 7f40dffff640 1 -- 172.21.15.17:0/2229860558 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e006fe80 con 0x7f40e00adc40 2023-08-09T12:53:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.723+0000 7f40dffff640 1 --2- 172.21.15.17:0/2229860558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e006c280 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f40e00b48a0 tx=0x7f40d002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7759171716c8cce server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40df7fe640 1 -- 172.21.15.17:0/2229860558 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d002cb10 con 0x7f40e00adc40 2023-08-09T12:53:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40df7fe640 1 -- 172.21.15.17:0/2229860558 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d002cc70 con 0x7f40e00adc40 2023-08-09T12:53:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40df7fe640 1 -- 172.21.15.17:0/2229860558 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00343f0 con 0x7f40e00adc40 2023-08-09T12:53:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40e6776640 1 -- 172.21.15.17:0/2229860558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 msgr2=0x7f40e006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40e6776640 1 --2- 172.21.15.17:0/2229860558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e006c280 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f40e00b48a0 tx=0x7f40d002bf70 comp rx=0 tx=0).stop 2023-08-09T12:53:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40e6776640 1 -- 172.21.15.17:0/2229860558 shutdown_connections 2023-08-09T12:53:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40e6776640 1 --2- 172.21.15.17:0/2229860558 >> v2:172.21.15.142:3300/0 conn(0x7f40e00b3b40 0x7f40e00b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40e6776640 1 --2- 172.21.15.17:0/2229860558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e006c280 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.724+0000 7f40e6776640 1 -- 172.21.15.17:0/2229860558 >> 172.21.15.17:0/2229860558 conn(0x7f40e00cb1b0 msgr2=0x7f40e00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.725+0000 7f40e6776640 1 -- 172.21.15.17:0/2229860558 shutdown_connections 2023-08-09T12:53:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.725+0000 7f40e6776640 1 -- 172.21.15.17:0/2229860558 wait complete. 2023-08-09T12:53:20.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.726+0000 7f40e6776640 1 Processor -- start 2023-08-09T12:53:20.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.727+0000 7f40e6776640 1 -- start start 2023-08-09T12:53:20.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.727+0000 7f40e6776640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:20.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.727+0000 7f40e6776640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e00b3b40 0x7f40e0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:20.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40e6776640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e015e8f0 0x7f40e01f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:20.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40e6776640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e006b240 con 0x7f40e00adc40 2023-08-09T12:53:20.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40e6776640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0159d20 con 0x7f40e015e8f0 2023-08-09T12:53:20.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40e6776640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e015a000 con 0x7f40e00b3b40 2023-08-09T12:53:20.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:20.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46098/0 (socket says 172.21.15.17:46098) 2023-08-09T12:53:20.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40dffff640 1 -- 172.21.15.17:0/2385361736 learned_addr learned my addr 172.21.15.17:0/2385361736 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:20.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40d77fe640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e00b3b40 0x7f40e0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:20.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40dffff640 1 -- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e00b3b40 msgr2=0x7f40e0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:20.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40e4d13640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e015e8f0 0x7f40e01f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:20.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40dffff640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e00b3b40 0x7f40e0156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40dffff640 1 -- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e015e8f0 msgr2=0x7f40e01f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:20.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40dffff640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e015e8f0 0x7f40e01f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40dffff640 1 -- 172.21.15.17:0/2385361736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0009b30 con 0x7f40e00adc40 2023-08-09T12:53:20.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.728+0000 7f40e4d13640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e015e8f0 0x7f40e01f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:20.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.729+0000 7f40dffff640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e014ed60 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f40d0000f80 tx=0x7f40d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:20.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.729+0000 7f40dd7fa640 1 -- 172.21.15.17:0/2385361736 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0009510 con 0x7f40e00adc40 2023-08-09T12:53:20.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.729+0000 7f40dd7fa640 1 -- 172.21.15.17:0/2385361736 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d003e450 con 0x7f40e00adc40 2023-08-09T12:53:20.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.729+0000 7f40dd7fa640 1 -- 172.21.15.17:0/2385361736 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d003e800 con 0x7f40e00adc40 2023-08-09T12:53:20.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.729+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e006ab80 con 0x7f40e00adc40 2023-08-09T12:53:20.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.729+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e0157340 con 0x7f40e00adc40 2023-08-09T12:53:20.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.730+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e006b380 con 0x7f40e00adc40 2023-08-09T12:53:20.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.731+0000 7f40dd7fa640 1 -- 172.21.15.17:0/2385361736 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f40d003e960 con 0x7f40e00adc40 2023-08-09T12:53:20.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.732+0000 7f40dd7fa640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40c006a050 0x7f40c006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:20.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.732+0000 7f40dd7fa640 1 -- 172.21.15.17:0/2385361736 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40d00ab3b0 con 0x7f40e00adc40 2023-08-09T12:53:20.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.733+0000 7f40d77fe640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40c006a050 0x7f40c006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:20.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.734+0000 7f40d77fe640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40c006a050 0x7f40c006c510 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f40e015c780 tx=0x7f40c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:20.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.737+0000 7f40dd7fa640 1 -- 172.21.15.17:0/2385361736 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f40e006b380 con 0x7f40e00adc40 2023-08-09T12:53:20.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.928+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40e006b380 con 0x7f40e00adc40 2023-08-09T12:53:20.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.930+0000 7f40dd7fa640 1 -- 172.21.15.17:0/2385361736 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+18284 (secure 0 0 0) 0x7f40e006b380 con 0x7f40e00adc40 2023-08-09T12:53:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:20.934 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":190,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:53:19.913587+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:53:18.326271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-09T12:53:18.942904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:53:20.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40c006a050 msgr2=0x7f40c006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:20.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40c006a050 0x7f40c006c510 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f40e015c780 tx=0x7f40c8008040 comp rx=0 tx=0).stop 2023-08-09T12:53:20.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 msgr2=0x7f40e014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:20.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e014ed60 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f40d0000f80 tx=0x7f40d0004a40 comp rx=0 tx=0).stop 2023-08-09T12:53:20.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 shutdown_connections 2023-08-09T12:53:20.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f40c006a050 0x7f40c006c510 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e015e8f0 0x7f40e01f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e00b3b40 0x7f40e0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 --2- 172.21.15.17:0/2385361736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e00adc40 0x7f40e014ed60 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:20.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 >> 172.21.15.17:0/2385361736 conn(0x7f40e00cb1b0 msgr2=0x7f40e015dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:20.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 shutdown_connections 2023-08-09T12:53:20.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:20.933+0000 7f40e6776640 1 -- 172.21.15.17:0/2385361736 wait complete. 2023-08-09T12:53:20.955 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:53:21.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.172+0000 7f3e6998b640 1 Processor -- start 2023-08-09T12:53:21.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.172+0000 7f3e6998b640 1 -- start start 2023-08-09T12:53:21.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.174+0000 7f3e6998b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e641616e0 0x7f3e640b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.174+0000 7f3e6998b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e640d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.174+0000 7f3e6998b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e640cdd10 con 0x7f3e6415ce90 2023-08-09T12:53:21.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.174+0000 7f3e6998b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e640b6540 con 0x7f3e641616e0 2023-08-09T12:53:21.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.174+0000 7f3e6998b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640d33a0 con 0x7f3e640d29d0 2023-08-09T12:53:21.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.175+0000 7f3e62ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3e6415ce90 0x7f3e640cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:33238/0 (socket says 172.21.15.17:33238) 2023-08-09T12:53:21.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.175+0000 7f3e5bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e641616e0 0x7f3e640b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.175+0000 7f3e62ffd640 1 -- 172.21.15.17:0/3842192547 learned_addr learned my addr 172.21.15.17:0/3842192547 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.175+0000 7f3e637fe640 1 --2- 172.21.15.17:0/3842192547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e640d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.175+0000 7f3e5bfff640 1 -- 172.21.15.17:0/3842192547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 msgr2=0x7f3e640d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.175+0000 7f3e5bfff640 1 --2- 172.21.15.17:0/3842192547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e640d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.175+0000 7f3e5bfff640 1 -- 172.21.15.17:0/3842192547 >> v1:172.21.15.142:6789/0 conn(0x7f3e6415ce90 legacy=0x7f3e640cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.175+0000 7f3e5bfff640 1 -- 172.21.15.17:0/3842192547 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640cdff0 con 0x7f3e641616e0 2023-08-09T12:53:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.177+0000 7f3e5bfff640 1 --2- 172.21.15.17:0/3842192547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e641616e0 0x7f3e640b6000 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0097a0 tx=0x7f3e4c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d38036cb3f1d62c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.178+0000 7f3e627fc640 1 -- 172.21.15.17:0/3842192547 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c031830 con 0x7f3e641616e0 2023-08-09T12:53:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.178+0000 7f3e627fc640 1 -- 172.21.15.17:0/3842192547 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c031990 con 0x7f3e641616e0 2023-08-09T12:53:21.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.178+0000 7f3e627fc640 1 -- 172.21.15.17:0/3842192547 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c031d20 con 0x7f3e641616e0 2023-08-09T12:53:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.178+0000 7f3e6998b640 1 -- 172.21.15.17:0/3842192547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e641616e0 msgr2=0x7f3e640b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.178+0000 7f3e6998b640 1 --2- 172.21.15.17:0/3842192547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e641616e0 0x7f3e640b6000 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0097a0 tx=0x7f3e4c02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.179+0000 7f3e6998b640 1 -- 172.21.15.17:0/3842192547 shutdown_connections 2023-08-09T12:53:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.179+0000 7f3e6998b640 1 --2- 172.21.15.17:0/3842192547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e640d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.179+0000 7f3e6998b640 1 --2- 172.21.15.17:0/3842192547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e641616e0 0x7f3e640b6000 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.179+0000 7f3e6998b640 1 -- 172.21.15.17:0/3842192547 >> 172.21.15.17:0/3842192547 conn(0x7f3e6406fde0 msgr2=0x7f3e640701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.179+0000 7f3e6998b640 1 -- 172.21.15.17:0/3842192547 shutdown_connections 2023-08-09T12:53:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.179+0000 7f3e6998b640 1 -- 172.21.15.17:0/3842192547 wait complete. 2023-08-09T12:53:21.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.180+0000 7f3e6998b640 1 Processor -- start 2023-08-09T12:53:21.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.181+0000 7f3e6998b640 1 -- start start 2023-08-09T12:53:21.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.181+0000 7f3e6998b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e64157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e6998b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e6415ce90 0x7f3e64159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e6998b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e641616e0 0x7f3e6415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e6998b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641e67f0 con 0x7f3e641616e0 2023-08-09T12:53:21.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e6998b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64157fc0 con 0x7f3e6415ce90 2023-08-09T12:53:21.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e6998b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640ca700 con 0x7f3e640d29d0 2023-08-09T12:53:21.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e641616e0 0x7f3e6415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e641616e0 0x7f3e6415a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46110/0 (socket says 172.21.15.17:46110) 2023-08-09T12:53:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e637fe640 1 -- 172.21.15.17:0/2934424247 learned_addr learned my addr 172.21.15.17:0/2934424247 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e5bfff640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e6415ce90 0x7f3e64159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e62ffd640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e64157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e637fe640 1 -- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 msgr2=0x7f3e64157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e637fe640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e64157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e637fe640 1 -- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e6415ce90 msgr2=0x7f3e64159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e637fe640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e6415ce90 0x7f3e64159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e637fe640 1 -- 172.21.15.17:0/2934424247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c009400 con 0x7f3e641616e0 2023-08-09T12:53:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.182+0000 7f3e62ffd640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e64157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:21.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.183+0000 7f3e637fe640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e641616e0 0x7f3e6415a4e0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009dd0 tx=0x7f3e5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.183+0000 7f3e60ff9640 1 -- 172.21.15.17:0/2934424247 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c014480 con 0x7f3e641616e0 2023-08-09T12:53:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.183+0000 7f3e60ff9640 1 -- 172.21.15.17:0/2934424247 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c00f040 con 0x7f3e641616e0 2023-08-09T12:53:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.183+0000 7f3e60ff9640 1 -- 172.21.15.17:0/2934424247 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c014840 con 0x7f3e641616e0 2023-08-09T12:53:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.183+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e640c9dd0 con 0x7f3e641616e0 2023-08-09T12:53:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.183+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e640ca390 con 0x7f3e641616e0 2023-08-09T12:53:21.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.185+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e64067a80 con 0x7f3e641616e0 2023-08-09T12:53:21.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.185+0000 7f3e60ff9640 1 -- 172.21.15.17:0/2934424247 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3e5c0149a0 con 0x7f3e641616e0 2023-08-09T12:53:21.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.187+0000 7f3e60ff9640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e4406a050 0x7f3e4406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.187+0000 7f3e60ff9640 1 -- 172.21.15.17:0/2934424247 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e5c089240 con 0x7f3e641616e0 2023-08-09T12:53:21.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.188+0000 7f3e62ffd640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e4406a050 0x7f3e4406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.189+0000 7f3e62ffd640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e4406a050 0x7f3e4406c510 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005880 tx=0x7f3e54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:21.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.191+0000 7f3e60ff9640 1 -- 172.21.15.17:0/2934424247 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3e5c054800 con 0x7f3e641616e0 2023-08-09T12:53:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.386+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e640ca840 con 0x7f3e641616e0 2023-08-09T12:53:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.389+0000 7f3e60ff9640 1 -- 172.21.15.17:0/2934424247 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+18284 (secure 0 0 0) 0x7f3e5c057e20 con 0x7f3e641616e0 2023-08-09T12:53:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:21.393 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":190,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:53:19.913587+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:53:18.326271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-09T12:53:18.942904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:53:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e4406a050 msgr2=0x7f3e4406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e4406a050 0x7f3e4406c510 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005880 tx=0x7f3e54009040 comp rx=0 tx=0).stop 2023-08-09T12:53:21.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e641616e0 msgr2=0x7f3e6415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e641616e0 0x7f3e6415a4e0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009dd0 tx=0x7f3e5c00c490 comp rx=0 tx=0).stop 2023-08-09T12:53:21.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 shutdown_connections 2023-08-09T12:53:21.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e4406a050 0x7f3e4406c510 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e641616e0 0x7f3e6415a4e0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e6415ce90 0x7f3e64159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 --2- 172.21.15.17:0/2934424247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e640d29d0 0x7f3e64157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 >> 172.21.15.17:0/2934424247 conn(0x7f3e6406fde0 msgr2=0x7f3e6415ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:21.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 shutdown_connections 2023-08-09T12:53:21.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.392+0000 7f3e6998b640 1 -- 172.21.15.17:0/2934424247 wait complete. 2023-08-09T12:53:21.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-09T12:53:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.651+0000 7f676a364640 1 Processor -- start 2023-08-09T12:53:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.651+0000 7f676a364640 1 -- start start 2023-08-09T12:53:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.652+0000 7f676a364640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f676415cef0 0x7f67640b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.652+0000 7f676a364640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67640cfab0 0x7f67640ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.652+0000 7f676a364640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640b2010 con 0x7f676415d2d0 2023-08-09T12:53:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.652+0000 7f676a364640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640cdee0 con 0x7f67640cfab0 2023-08-09T12:53:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.652+0000 7f676a364640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640b1d30 con 0x7f676415cef0 2023-08-09T12:53:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.653+0000 7f6768901640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67640cfab0 0x7f67640ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.653+0000 7f6768901640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67640cfab0 0x7f67640ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46118/0 (socket says 172.21.15.17:46118) 2023-08-09T12:53:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.653+0000 7f6768901640 1 -- 172.21.15.17:0/1233441043 learned_addr learned my addr 172.21.15.17:0/1233441043 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.653+0000 7f6768901640 1 -- 172.21.15.17:0/1233441043 >> v2:172.21.15.142:3300/0 conn(0x7f676415cef0 msgr2=0x7f67640b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:21.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.653+0000 7f6768901640 1 --2- 172.21.15.17:0/1233441043 >> v2:172.21.15.142:3300/0 conn(0x7f676415cef0 0x7f67640b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.653+0000 7f6768901640 1 -- 172.21.15.17:0/1233441043 >> v1:172.21.15.142:6789/0 conn(0x7f676415d2d0 legacy=0x7f67640cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:21.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.653+0000 7f6768901640 1 -- 172.21.15.17:0/1233441043 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640cd820 con 0x7f67640cfab0 2023-08-09T12:53:21.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.654+0000 7f6768901640 1 --2- 172.21.15.17:0/1233441043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67640cfab0 0x7f67640ce300 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f67640c6740 tx=0x7f675c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ad420f1ae67def server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:21.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.655+0000 7f6762ffd640 1 -- 172.21.15.17:0/1233441043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c031740 con 0x7f67640cfab0 2023-08-09T12:53:21.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.655+0000 7f6762ffd640 1 -- 172.21.15.17:0/1233441043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c0318a0 con 0x7f67640cfab0 2023-08-09T12:53:21.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.655+0000 7f6762ffd640 1 -- 172.21.15.17:0/1233441043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c031c30 con 0x7f67640cfab0 2023-08-09T12:53:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.655+0000 7f676a364640 1 -- 172.21.15.17:0/1233441043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67640cfab0 msgr2=0x7f67640ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.655+0000 7f676a364640 1 --2- 172.21.15.17:0/1233441043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67640cfab0 0x7f67640ce300 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f67640c6740 tx=0x7f675c02b7e0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.656+0000 7f676a364640 1 -- 172.21.15.17:0/1233441043 shutdown_connections 2023-08-09T12:53:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.656+0000 7f676a364640 1 --2- 172.21.15.17:0/1233441043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67640cfab0 0x7f67640ce300 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.656+0000 7f676a364640 1 --2- 172.21.15.17:0/1233441043 >> v2:172.21.15.142:3300/0 conn(0x7f676415cef0 0x7f67640b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.656+0000 7f676a364640 1 -- 172.21.15.17:0/1233441043 >> 172.21.15.17:0/1233441043 conn(0x7f676406fde0 msgr2=0x7f67640701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.656+0000 7f676a364640 1 -- 172.21.15.17:0/1233441043 shutdown_connections 2023-08-09T12:53:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.656+0000 7f676a364640 1 -- 172.21.15.17:0/1233441043 wait complete. 2023-08-09T12:53:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.657+0000 7f676a364640 1 Processor -- start 2023-08-09T12:53:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.658+0000 7f676a364640 1 -- start start 2023-08-09T12:53:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f676a364640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67640cfab0 0x7f67641f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f676a364640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f676415cef0 0x7f67640d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f676a364640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676415d2d0 0x7f67640d1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f676a364640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67641f6e10 con 0x7f676415d2d0 2023-08-09T12:53:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f676a364640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640b5600 con 0x7f67640cfab0 2023-08-09T12:53:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f676a364640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67641f28d0 con 0x7f676415cef0 2023-08-09T12:53:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f6768901640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676415d2d0 0x7f67640d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f6768901640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676415d2d0 0x7f67640d1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46124/0 (socket says 172.21.15.17:46124) 2023-08-09T12:53:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f6768901640 1 -- 172.21.15.17:0/559470959 learned_addr learned my addr 172.21.15.17:0/559470959 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f6763fff640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67640cfab0 0x7f67641f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f67637fe640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f676415cef0 0x7f67640d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f6768901640 1 -- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f676415cef0 msgr2=0x7f67640d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f6768901640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f676415cef0 0x7f67640d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f6768901640 1 -- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67640cfab0 msgr2=0x7f67641f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:21.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.659+0000 7f6768901640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67640cfab0 0x7f67641f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:21.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f6768901640 1 -- 172.21.15.17:0/559470959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0094d0 con 0x7f676415d2d0 2023-08-09T12:53:21.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f67637fe640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f676415cef0 0x7f67640d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:21.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f6763fff640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67640cfab0 0x7f67641f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f6768901640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676415d2d0 0x7f67640d1240 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f675c0090b0 tx=0x7f675c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f6760ff9640 1 -- 172.21.15.17:0/559470959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c033c70 con 0x7f676415d2d0 2023-08-09T12:53:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f6760ff9640 1 -- 172.21.15.17:0/559470959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c033df0 con 0x7f676415d2d0 2023-08-09T12:53:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f6760ff9640 1 -- 172.21.15.17:0/559470959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c03d6b0 con 0x7f676415d2d0 2023-08-09T12:53:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67640b5320 con 0x7f676415d2d0 2023-08-09T12:53:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.660+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67641f2e10 con 0x7f676415d2d0 2023-08-09T12:53:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.662+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6764067a80 con 0x7f676415d2d0 2023-08-09T12:53:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.663+0000 7f6760ff9640 1 -- 172.21.15.17:0/559470959 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f675c03a040 con 0x7f676415d2d0 2023-08-09T12:53:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.663+0000 7f6760ff9640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674406a050 0x7f674406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.664+0000 7f6760ff9640 1 -- 172.21.15.17:0/559470959 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f675c0aa4e0 con 0x7f676415d2d0 2023-08-09T12:53:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.664+0000 7f6763fff640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674406a050 0x7f674406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.665+0000 7f6763fff640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674406a050 0x7f674406c510 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6754006fd0 tx=0x7f6754008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:21.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.668+0000 7f6760ff9640 1 -- 172.21.15.17:0/559470959 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f675c075ce0 con 0x7f676415d2d0 2023-08-09T12:53:21.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:21.902+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6764159aa0 con 0x7f676415d2d0 2023-08-09T12:53:22.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.507+0000 7f6760ff9640 1 -- 172.21.15.17:0/559470959 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) v1 ==== 118+0+0 (secure 0 0 0) 0x7f675c079300 con 0x7f676415d2d0 2023-08-09T12:53:22.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674406a050 msgr2=0x7f674406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:22.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674406a050 0x7f674406c510 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6754006fd0 tx=0x7f6754008040 comp rx=0 tx=0).stop 2023-08-09T12:53:22.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676415d2d0 msgr2=0x7f67640d1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:22.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676415d2d0 0x7f67640d1240 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f675c0090b0 tx=0x7f675c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 shutdown_connections 2023-08-09T12:53:22.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f674406a050 0x7f674406c510 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676415d2d0 0x7f67640d1240 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f676415cef0 0x7f67640d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 --2- 172.21.15.17:0/559470959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67640cfab0 0x7f67641f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 >> 172.21.15.17:0/559470959 conn(0x7f676406fde0 msgr2=0x7f67640c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:22.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 shutdown_connections 2023-08-09T12:53:22.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.511+0000 7f676a364640 1 -- 172.21.15.17:0/559470959 wait complete. 2023-08-09T12:53:22.541 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-09T12:53:22.541 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-09T12:53:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.773+0000 7fe839757640 1 Processor -- start 2023-08-09T12:53:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.773+0000 7fe839757640 1 -- start start 2023-08-09T12:53:22.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.775+0000 7fe839757640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe83415cca0 0x7fe8340d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:22.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.775+0000 7fe839757640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe8340cfa20 0x7fe8340b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:22.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.775+0000 7fe839757640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8340d1c50 con 0x7fe8340cf5c0 2023-08-09T12:53:22.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.775+0000 7fe839757640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8340d1040 con 0x7fe8340cfa20 2023-08-09T12:53:22.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.775+0000 7fe839757640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8340d1320 con 0x7fe83415cca0 2023-08-09T12:53:22.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.775+0000 7fe8327fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe8340cf5c0 0x7fe8340b1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48996/0 (socket says 172.21.15.17:48996) 2023-08-09T12:53:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.775+0000 7fe8327fc640 1 -- 172.21.15.17:0/2713913389 learned_addr learned my addr 172.21.15.17:0/2713913389 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe8337fe640 1 --2- 172.21.15.17:0/2713913389 >> v2:172.21.15.17:3300/0 conn(0x7fe8340cfa20 0x7fe8340b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe832ffd640 1 --2- 172.21.15.17:0/2713913389 >> v2:172.21.15.142:3300/0 conn(0x7fe83415cca0 0x7fe8340d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe831ffb640 1 -- 172.21.15.17:0/2713913389 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506602404 0 0) 0x7fe8340d1c50 con 0x7fe8340cf5c0 2023-08-09T12:53:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe831ffb640 1 -- 172.21.15.17:0/2713913389 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe820003520 con 0x7fe8340cf5c0 2023-08-09T12:53:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe831ffb640 1 -- 172.21.15.17:0/2713913389 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1898848697 0 0) 0x7fe820003520 con 0x7fe8340cf5c0 2023-08-09T12:53:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe8337fe640 1 -- 172.21.15.17:0/2713913389 >> v2:172.21.15.142:3300/0 conn(0x7fe83415cca0 msgr2=0x7fe8340d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:22.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe8337fe640 1 --2- 172.21.15.17:0/2713913389 >> v2:172.21.15.142:3300/0 conn(0x7fe83415cca0 0x7fe8340d2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe8337fe640 1 -- 172.21.15.17:0/2713913389 >> v1:172.21.15.17:6789/0 conn(0x7fe8340cf5c0 legacy=0x7fe8340b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:22.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.776+0000 7fe8337fe640 1 -- 172.21.15.17:0/2713913389 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8340d1600 con 0x7fe8340cfa20 2023-08-09T12:53:22.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.777+0000 7fe8337fe640 1 --2- 172.21.15.17:0/2713913389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8340cfa20 0x7fe8340b1d30 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fe834070e20 tx=0x7fe82c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf83f9d3e517160 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:22.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe831ffb640 1 -- 172.21.15.17:0/2713913389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c001670 con 0x7fe8340cfa20 2023-08-09T12:53:22.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe831ffb640 1 -- 172.21.15.17:0/2713913389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c031520 con 0x7fe8340cfa20 2023-08-09T12:53:22.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe831ffb640 1 -- 172.21.15.17:0/2713913389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c031690 con 0x7fe8340cfa20 2023-08-09T12:53:22.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe839757640 1 -- 172.21.15.17:0/2713913389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8340cfa20 msgr2=0x7fe8340b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:22.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe839757640 1 --2- 172.21.15.17:0/2713913389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8340cfa20 0x7fe8340b1d30 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fe834070e20 tx=0x7fe82c02b840 comp rx=0 tx=0).stop 2023-08-09T12:53:22.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe839757640 1 -- 172.21.15.17:0/2713913389 shutdown_connections 2023-08-09T12:53:22.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe839757640 1 --2- 172.21.15.17:0/2713913389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8340cfa20 0x7fe8340b1d30 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe839757640 1 --2- 172.21.15.17:0/2713913389 >> v2:172.21.15.142:3300/0 conn(0x7fe83415cca0 0x7fe8340d2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.778+0000 7fe839757640 1 -- 172.21.15.17:0/2713913389 >> 172.21.15.17:0/2713913389 conn(0x7fe83406fde0 msgr2=0x7fe8340701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:22.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.779+0000 7fe839757640 1 -- 172.21.15.17:0/2713913389 shutdown_connections 2023-08-09T12:53:22.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.779+0000 7fe839757640 1 -- 172.21.15.17:0/2713913389 wait complete. 2023-08-09T12:53:22.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.780+0000 7fe839757640 1 Processor -- start 2023-08-09T12:53:22.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.780+0000 7fe839757640 1 -- start start 2023-08-09T12:53:22.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.781+0000 7fe839757640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8340cf5c0 0x7fe834150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:22.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.781+0000 7fe839757640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8340cfa20 0x7fe8340ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:22.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.781+0000 7fe839757640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe83415cca0 0x7fe8341e6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:22.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe839757640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341e5490 con 0x7fe83415cca0 2023-08-09T12:53:22.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe839757640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341e5fd0 con 0x7fe8340cf5c0 2023-08-09T12:53:22.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe839757640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341e56a0 con 0x7fe8340cfa20 2023-08-09T12:53:22.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe83415cca0 0x7fe8341e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:22.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe83415cca0 0x7fe8341e6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46140/0 (socket says 172.21.15.17:46140) 2023-08-09T12:53:22.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8337fe640 1 -- 172.21.15.17:0/1465310247 learned_addr learned my addr 172.21.15.17:0/1465310247 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:22.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe832ffd640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8340cf5c0 0x7fe834150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:22.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8327fc640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8340cfa20 0x7fe8340ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:22.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8337fe640 1 -- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8340cfa20 msgr2=0x7fe8340ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:22.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8337fe640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8340cfa20 0x7fe8340ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8337fe640 1 -- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8340cf5c0 msgr2=0x7fe834150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8337fe640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8340cf5c0 0x7fe834150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8337fe640 1 -- 172.21.15.17:0/1465310247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c009400 con 0x7fe83415cca0 2023-08-09T12:53:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.782+0000 7fe8327fc640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8340cfa20 0x7fe8340ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.783+0000 7fe8337fe640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe83415cca0 0x7fe8341e6460 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fe82c036040 tx=0x7fe82c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.783+0000 7fe82b7fe640 1 -- 172.21.15.17:0/1465310247 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c003810 con 0x7fe83415cca0 2023-08-09T12:53:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.783+0000 7fe82b7fe640 1 -- 172.21.15.17:0/1465310247 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c003970 con 0x7fe83415cca0 2023-08-09T12:53:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.783+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8341e5980 con 0x7fe83415cca0 2023-08-09T12:53:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.783+0000 7fe82b7fe640 1 -- 172.21.15.17:0/1465310247 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c003d00 con 0x7fe83415cca0 2023-08-09T12:53:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.783+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe834150660 con 0x7fe83415cca0 2023-08-09T12:53:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.785+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8341e6160 con 0x7fe83415cca0 2023-08-09T12:53:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.785+0000 7fe82b7fe640 1 -- 172.21.15.17:0/1465310247 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe82c033410 con 0x7fe83415cca0 2023-08-09T12:53:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.787+0000 7fe82b7fe640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe81406a050 0x7fe81406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.787+0000 7fe82b7fe640 1 -- 172.21.15.17:0/1465310247 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe82c0aa320 con 0x7fe83415cca0 2023-08-09T12:53:22.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.787+0000 7fe832ffd640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe81406a050 0x7fe81406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:22.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.789+0000 7fe832ffd640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe81406a050 0x7fe81406c510 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe8240073f0 tx=0x7fe82400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:22.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:22.791+0000 7fe82b7fe640 1 -- 172.21.15.17:0/1465310247 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe82c075970 con 0x7fe83415cca0 2023-08-09T12:53:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.022+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe834067a80 con 0x7fe83415cca0 2023-08-09T12:53:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.522+0000 7fe82b7fe640 1 -- 172.21.15.17:0/1465310247 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe82c003e60 con 0x7fe83415cca0 2023-08-09T12:53:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe81406a050 msgr2=0x7fe81406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe81406a050 0x7fe81406c510 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe8240073f0 tx=0x7fe82400b040 comp rx=0 tx=0).stop 2023-08-09T12:53:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe83415cca0 msgr2=0x7fe8341e6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe83415cca0 0x7fe8341e6460 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fe82c036040 tx=0x7fe82c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 shutdown_connections 2023-08-09T12:53:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe81406a050 0x7fe81406c510 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe83415cca0 0x7fe8341e6460 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8340cfa20 0x7fe8340ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 --2- 172.21.15.17:0/1465310247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8340cf5c0 0x7fe834150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.526+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 >> 172.21.15.17:0/1465310247 conn(0x7fe83406fde0 msgr2=0x7fe834151fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.527+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 shutdown_connections 2023-08-09T12:53:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.527+0000 7fe839757640 1 -- 172.21.15.17:0/1465310247 wait complete. 2023-08-09T12:53:23.553 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-09T12:53:23.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:23.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.783+0000 7f2554a78640 1 Processor -- start 2023-08-09T12:53:23.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.783+0000 7f2554a78640 1 -- start start 2023-08-09T12:53:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.785+0000 7f2554a78640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2550160030 0x7f2550160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.785+0000 7f2554a78640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 0x7f25500d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.785+0000 7f2554a78640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25500b5a30 con 0x7f25500b86e0 2023-08-09T12:53:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.785+0000 7f2554a78640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25500d1110 con 0x7f2550160030 2023-08-09T12:53:23.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.785+0000 7f2554a78640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500ceac0 con 0x7f25500cfb50 2023-08-09T12:53:23.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.785+0000 7f254f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2550160030 0x7f2550160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.785+0000 7f254f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2550160030 0x7f2550160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46154/0 (socket says 172.21.15.17:46154) 2023-08-09T12:53:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.785+0000 7f254f7fe640 1 -- 172.21.15.17:0/4270395945 learned_addr learned my addr 172.21.15.17:0/4270395945 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.786+0000 7f254ffff640 1 --2- 172.21.15.17:0/4270395945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 0x7f25500d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.786+0000 7f254f7fe640 1 -- 172.21.15.17:0/4270395945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 msgr2=0x7f25500d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.786+0000 7f254f7fe640 1 --2- 172.21.15.17:0/4270395945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 0x7f25500d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.786+0000 7f254f7fe640 1 -- 172.21.15.17:0/4270395945 >> v1:172.21.15.142:6789/0 conn(0x7f25500b86e0 legacy=0x7f25500cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.786+0000 7f254f7fe640 1 -- 172.21.15.17:0/4270395945 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25500d0d70 con 0x7f2550160030 2023-08-09T12:53:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.787+0000 7f254f7fe640 1 --2- 172.21.15.17:0/4270395945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f2550160740 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f2540009e50 tx=0x7f254002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80df2c2cf41fda18 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.787+0000 7f254e7fc640 1 -- 172.21.15.17:0/4270395945 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254002ca70 con 0x7f2550160030 2023-08-09T12:53:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.787+0000 7f254e7fc640 1 -- 172.21.15.17:0/4270395945 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254002cbd0 con 0x7f2550160030 2023-08-09T12:53:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.787+0000 7f254e7fc640 1 -- 172.21.15.17:0/4270395945 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25400343f0 con 0x7f2550160030 2023-08-09T12:53:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.788+0000 7f2554a78640 1 -- 172.21.15.17:0/4270395945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 msgr2=0x7f2550160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.788+0000 7f2554a78640 1 --2- 172.21.15.17:0/4270395945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f2550160740 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f2540009e50 tx=0x7f254002bed0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.788+0000 7f2554a78640 1 -- 172.21.15.17:0/4270395945 shutdown_connections 2023-08-09T12:53:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.788+0000 7f2554a78640 1 --2- 172.21.15.17:0/4270395945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 0x7f25500d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.788+0000 7f2554a78640 1 --2- 172.21.15.17:0/4270395945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f2550160740 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.788+0000 7f2554a78640 1 -- 172.21.15.17:0/4270395945 >> 172.21.15.17:0/4270395945 conn(0x7f25500697c0 msgr2=0x7f2550069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:23.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.788+0000 7f2554a78640 1 -- 172.21.15.17:0/4270395945 shutdown_connections 2023-08-09T12:53:23.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.788+0000 7f2554a78640 1 -- 172.21.15.17:0/4270395945 wait complete. 2023-08-09T12:53:23.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.790+0000 7f2554a78640 1 Processor -- start 2023-08-09T12:53:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.790+0000 7f2554a78640 1 -- start start 2023-08-09T12:53:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.791+0000 7f2554a78640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25500b86e0 0x7f2550150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.791+0000 7f2554a78640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 0x7f25500cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.791+0000 7f2554a78640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f25500cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.791+0000 7f2554a78640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2550150640 con 0x7f2550160030 2023-08-09T12:53:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.791+0000 7f2554a78640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500cc9f0 con 0x7f25500b86e0 2023-08-09T12:53:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.791+0000 7f2554a78640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500c9f20 con 0x7f25500cfb50 2023-08-09T12:53:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f25500cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f25500cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46166/0 (socket says 172.21.15.17:46166) 2023-08-09T12:53:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254ffff640 1 -- 172.21.15.17:0/3410222420 learned_addr learned my addr 172.21.15.17:0/3410222420 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254f7fe640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25500b86e0 0x7f2550150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254effd640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 0x7f25500cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254ffff640 1 -- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 msgr2=0x7f25500cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254ffff640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 0x7f25500cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254ffff640 1 -- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25500b86e0 msgr2=0x7f2550150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254ffff640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25500b86e0 0x7f2550150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.792+0000 7f254ffff640 1 -- 172.21.15.17:0/3410222420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2540009b30 con 0x7f2550160030 2023-08-09T12:53:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.793+0000 7f254ffff640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f25500cafc0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f254800d5d0 tx=0x7f254800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.793+0000 7f2537fff640 1 -- 172.21.15.17:0/3410222420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480125f0 con 0x7f2550160030 2023-08-09T12:53:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.793+0000 7f2537fff640 1 -- 172.21.15.17:0/3410222420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548012750 con 0x7f2550160030 2023-08-09T12:53:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.793+0000 7f2537fff640 1 -- 172.21.15.17:0/3410222420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548012b00 con 0x7f2550160030 2023-08-09T12:53:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.793+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25500ca200 con 0x7f2550160030 2023-08-09T12:53:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.793+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25500ca7c0 con 0x7f2550160030 2023-08-09T12:53:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.794+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255004e390 con 0x7f2550160030 2023-08-09T12:53:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.795+0000 7f2537fff640 1 -- 172.21.15.17:0/3410222420 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2548012c60 con 0x7f2550160030 2023-08-09T12:53:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.796+0000 7f2537fff640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f253c06a050 0x7f253c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.796+0000 7f2537fff640 1 -- 172.21.15.17:0/3410222420 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2548088b20 con 0x7f2550160030 2023-08-09T12:53:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.797+0000 7f254f7fe640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f253c06a050 0x7f253c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.798+0000 7f254f7fe640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f253c06a050 0x7f253c06c510 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2540035000 tx=0x7f2540030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:23.801+0000 7f2537fff640 1 -- 172.21.15.17:0/3410222420 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2548054170 con 0x7f2550160030 2023-08-09T12:53:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.029+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25500d0640 con 0x7f2550160030 2023-08-09T12:53:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.030+0000 7f2537fff640 1 -- 172.21.15.17:0/3410222420 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f2548057790 con 0x7f2550160030 2023-08-09T12:53:24.033 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:24.033 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:53:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:53:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f253c06a050 msgr2=0x7f253c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f253c06a050 0x7f253c06c510 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2540035000 tx=0x7f2540030000 comp rx=0 tx=0).stop 2023-08-09T12:53:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 msgr2=0x7f25500cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f25500cafc0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f254800d5d0 tx=0x7f254800da90 comp rx=0 tx=0).stop 2023-08-09T12:53:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 shutdown_connections 2023-08-09T12:53:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f253c06a050 0x7f253c06c510 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550160030 0x7f25500cafc0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25500cfb50 0x7f25500cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 --2- 172.21.15.17:0/3410222420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25500b86e0 0x7f2550150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 >> 172.21.15.17:0/3410222420 conn(0x7f25500697c0 msgr2=0x7f25500c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 shutdown_connections 2023-08-09T12:53:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.033+0000 7f2554a78640 1 -- 172.21.15.17:0/3410222420 wait complete. 2023-08-09T12:53:24.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:53:24.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.270+0000 7f22b8c4b640 1 Processor -- start 2023-08-09T12:53:24.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.271+0000 7f22b8c4b640 1 -- start start 2023-08-09T12:53:24.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.272+0000 7f22b8c4b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f22b41601f0 0x7f22b40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.272+0000 7f22b8c4b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f22b40cb610 0x7f22b40c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.272+0000 7f22b8c4b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b40b34a0 con 0x7f22b40b2ee0 2023-08-09T12:53:24.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.272+0000 7f22b8c4b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b40b4120 con 0x7f22b41601f0 2023-08-09T12:53:24.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.272+0000 7f22b8c4b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b40b3780 con 0x7f22b40cb610 2023-08-09T12:53:24.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.273+0000 7f22b37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f22b41601f0 0x7f22b40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.273+0000 7f22b37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f22b41601f0 0x7f22b40b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46182/0 (socket says 172.21.15.17:46182) 2023-08-09T12:53:24.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.273+0000 7f22b37fe640 1 -- 172.21.15.17:0/735017351 learned_addr learned my addr 172.21.15.17:0/735017351 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:24.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.273+0000 7f22b37fe640 1 -- 172.21.15.17:0/735017351 >> v2:172.21.15.142:3300/0 conn(0x7f22b40cb610 msgr2=0x7f22b40c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:24.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.273+0000 7f22b37fe640 1 --2- 172.21.15.17:0/735017351 >> v2:172.21.15.142:3300/0 conn(0x7f22b40cb610 0x7f22b40c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.273+0000 7f22b37fe640 1 -- 172.21.15.17:0/735017351 >> v1:172.21.15.142:6789/0 conn(0x7f22b40b2ee0 legacy=0x7f22b40caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:24.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.273+0000 7f22b37fe640 1 -- 172.21.15.17:0/735017351 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40b3a60 con 0x7f22b41601f0 2023-08-09T12:53:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.274+0000 7f22b37fe640 1 --2- 172.21.15.17:0/735017351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b41601f0 0x7f22b40b29a0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f22b40c8cf0 tx=0x7f22a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf62782855f6da6c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.275+0000 7f22b2ffd640 1 -- 172.21.15.17:0/735017351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4031870 con 0x7f22b41601f0 2023-08-09T12:53:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.275+0000 7f22b2ffd640 1 -- 172.21.15.17:0/735017351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a40319d0 con 0x7f22b41601f0 2023-08-09T12:53:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.275+0000 7f22b2ffd640 1 -- 172.21.15.17:0/735017351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4031d60 con 0x7f22b41601f0 2023-08-09T12:53:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.275+0000 7f22b8c4b640 1 -- 172.21.15.17:0/735017351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b41601f0 msgr2=0x7f22b40b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.275+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/735017351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b41601f0 0x7f22b40b29a0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f22b40c8cf0 tx=0x7f22a402b910 comp rx=0 tx=0).stop 2023-08-09T12:53:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.276+0000 7f22b8c4b640 1 -- 172.21.15.17:0/735017351 shutdown_connections 2023-08-09T12:53:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.276+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/735017351 >> v2:172.21.15.142:3300/0 conn(0x7f22b40cb610 0x7f22b40c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.276+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/735017351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b41601f0 0x7f22b40b29a0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.276+0000 7f22b8c4b640 1 -- 172.21.15.17:0/735017351 >> 172.21.15.17:0/735017351 conn(0x7f22b40b1d50 msgr2=0x7f22b406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.276+0000 7f22b8c4b640 1 -- 172.21.15.17:0/735017351 shutdown_connections 2023-08-09T12:53:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.276+0000 7f22b8c4b640 1 -- 172.21.15.17:0/735017351 wait complete. 2023-08-09T12:53:24.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.277+0000 7f22b8c4b640 1 Processor -- start 2023-08-09T12:53:24.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.278+0000 7f22b8c4b640 1 -- start start 2023-08-09T12:53:24.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b8c4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b40b2ee0 0x7f22b41f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b8c4b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22b40cb610 0x7f22b4155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b8c4b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22b41601f0 0x7f22b4156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b8c4b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b415d3d0 con 0x7f22b40b2ee0 2023-08-09T12:53:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b8c4b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b415d670 con 0x7f22b41601f0 2023-08-09T12:53:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b8c4b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b415d950 con 0x7f22b40cb610 2023-08-09T12:53:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b40b2ee0 0x7f22b41f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b40b2ee0 0x7f22b41f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46188/0 (socket says 172.21.15.17:46188) 2023-08-09T12:53:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b37fe640 1 -- 172.21.15.17:0/2120028059 learned_addr learned my addr 172.21.15.17:0/2120028059 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22abfff640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22b40cb610 0x7f22b4155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b37fe640 1 -- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22b40cb610 msgr2=0x7f22b4155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b37fe640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22b40cb610 0x7f22b4155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b3fff640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22b41601f0 0x7f22b4156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b37fe640 1 -- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22b41601f0 msgr2=0x7f22b4156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b37fe640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22b41601f0 0x7f22b4156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22b37fe640 1 -- 172.21.15.17:0/2120028059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40094d0 con 0x7f22b40b2ee0 2023-08-09T12:53:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.279+0000 7f22abfff640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22b40cb610 0x7f22b4155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.280+0000 7f22b37fe640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b40b2ee0 0x7f22b41f1ac0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f22a4000c00 tx=0x7f22a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.280+0000 7f22b0ff9640 1 -- 172.21.15.17:0/2120028059 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a403ad10 con 0x7f22b40b2ee0 2023-08-09T12:53:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.280+0000 7f22b0ff9640 1 -- 172.21.15.17:0/2120028059 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a403ae70 con 0x7f22b40b2ee0 2023-08-09T12:53:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.280+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b415dc30 con 0x7f22b40b2ee0 2023-08-09T12:53:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.280+0000 7f22b0ff9640 1 -- 172.21.15.17:0/2120028059 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4044610 con 0x7f22b40b2ee0 2023-08-09T12:53:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.280+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b41f2000 con 0x7f22b40b2ee0 2023-08-09T12:53:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.281+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b404e390 con 0x7f22b40b2ee0 2023-08-09T12:53:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.282+0000 7f22b0ff9640 1 -- 172.21.15.17:0/2120028059 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22a404d450 con 0x7f22b40b2ee0 2023-08-09T12:53:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.283+0000 7f22b0ff9640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f229406a050 0x7f229406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.283+0000 7f22b0ff9640 1 -- 172.21.15.17:0/2120028059 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22a402d040 con 0x7f22b40b2ee0 2023-08-09T12:53:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.284+0000 7f22abfff640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f229406a050 0x7f229406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.285+0000 7f22abfff640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f229406a050 0x7f229406c510 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f22b40ca800 tx=0x7f229c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:24.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.288+0000 7f22b0ff9640 1 -- 172.21.15.17:0/2120028059 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f22a4076380 con 0x7f22b40b2ee0 2023-08-09T12:53:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.483+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22b415da90 con 0x7f22b40b2ee0 2023-08-09T12:53:24.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.484+0000 7f22b0ff9640 1 -- 172.21.15.17:0/2120028059 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18271 (secure 0 0 0) 0x7f22b415da90 con 0x7f22b40b2ee0 2023-08-09T12:53:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:24.489 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":191,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:53:21.445276+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:53:18.326271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-09T12:53:18.942904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:53:24.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f229406a050 msgr2=0x7f229406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f229406a050 0x7f229406c510 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f22b40ca800 tx=0x7f229c009040 comp rx=0 tx=0).stop 2023-08-09T12:53:24.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b40b2ee0 msgr2=0x7f22b41f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b40b2ee0 0x7f22b41f1ac0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f22a4000c00 tx=0x7f22a40046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 shutdown_connections 2023-08-09T12:53:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f229406a050 0x7f229406c510 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22b41601f0 0x7f22b4156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22b40cb610 0x7f22b4155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 --2- 172.21.15.17:0/2120028059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b40b2ee0 0x7f22b41f1ac0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 >> 172.21.15.17:0/2120028059 conn(0x7f22b40b1d50 msgr2=0x7f22b40c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 shutdown_connections 2023-08-09T12:53:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.488+0000 7f22b8c4b640 1 -- 172.21.15.17:0/2120028059 wait complete. 2023-08-09T12:53:24.511 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-09T12:53:24.512 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:53:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.739+0000 7fa2db283640 1 Processor -- start 2023-08-09T12:53:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.739+0000 7fa2db283640 1 -- start start 2023-08-09T12:53:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.741+0000 7fa2db283640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa2d4159d80 0x7fa2d40b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.741+0000 7fa2db283640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40b4630 con 0x7fa2d40ad810 2023-08-09T12:53:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.741+0000 7fa2db283640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40b3ab0 con 0x7fa2d4070a90 2023-08-09T12:53:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.741+0000 7fa2db283640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d415a160 con 0x7fa2d4159d80 2023-08-09T12:53:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.742+0000 7fa2d881e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa2d40ad810 0x7fa2d4070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49006/0 (socket says 172.21.15.17:49006) 2023-08-09T12:53:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.742+0000 7fa2d881e640 1 -- 172.21.15.17:0/2619119541 learned_addr learned my addr 172.21.15.17:0/2619119541 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.742+0000 7fa2d901f640 1 --2- 172.21.15.17:0/2619119541 >> v2:172.21.15.17:3300/0 conn(0x7fa2d4159d80 0x7fa2d40b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.742+0000 7fa2cbfff640 1 -- 172.21.15.17:0/2619119541 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919253937 0 0) 0x7fa2d40b4630 con 0x7fa2d40ad810 2023-08-09T12:53:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.742+0000 7fa2cbfff640 1 -- 172.21.15.17:0/2619119541 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c0005730 con 0x7fa2d40ad810 2023-08-09T12:53:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.742+0000 7fa2d901f640 1 -- 172.21.15.17:0/2619119541 >> v1:172.21.15.142:6789/0 conn(0x7fa2d4070a90 legacy=0x7fa2d40c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.742+0000 7fa2d901f640 1 -- 172.21.15.17:0/2619119541 >> v1:172.21.15.17:6789/0 conn(0x7fa2d40ad810 legacy=0x7fa2d4070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.742+0000 7fa2d901f640 1 -- 172.21.15.17:0/2619119541 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40b3d90 con 0x7fa2d4159d80 2023-08-09T12:53:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.743+0000 7fa2d901f640 1 --2- 172.21.15.17:0/2619119541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d4159d80 0x7fa2d40b34d0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00097a0 tx=0x7fa2d002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d803cf086430bb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2cbfff640 1 -- 172.21.15.17:0/2619119541 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0030610 con 0x7fa2d4159d80 2023-08-09T12:53:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2cbfff640 1 -- 172.21.15.17:0/2619119541 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0030770 con 0x7fa2d4159d80 2023-08-09T12:53:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2cbfff640 1 -- 172.21.15.17:0/2619119541 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0030ae0 con 0x7fa2d4159d80 2023-08-09T12:53:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2db283640 1 -- 172.21.15.17:0/2619119541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d4159d80 msgr2=0x7fa2d40b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2db283640 1 --2- 172.21.15.17:0/2619119541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d4159d80 0x7fa2d40b34d0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00097a0 tx=0x7fa2d002b960 comp rx=0 tx=0).stop 2023-08-09T12:53:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2db283640 1 -- 172.21.15.17:0/2619119541 shutdown_connections 2023-08-09T12:53:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2db283640 1 --2- 172.21.15.17:0/2619119541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d4159d80 0x7fa2d40b34d0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2db283640 1 -- 172.21.15.17:0/2619119541 >> 172.21.15.17:0/2619119541 conn(0x7fa2d40cb1b0 msgr2=0x7fa2d40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2db283640 1 -- 172.21.15.17:0/2619119541 shutdown_connections 2023-08-09T12:53:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.744+0000 7fa2db283640 1 -- 172.21.15.17:0/2619119541 wait complete. 2023-08-09T12:53:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.746+0000 7fa2db283640 1 Processor -- start 2023-08-09T12:53:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.746+0000 7fa2db283640 1 -- start start 2023-08-09T12:53:24.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2db283640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2d4070a90 0x7fa2d40aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2db283640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d40ad810 0x7fa2d41f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2db283640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4159d80 0x7fa2d40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2db283640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40ae3f0 con 0x7fa2d40ad810 2023-08-09T12:53:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2db283640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40af060 con 0x7fa2d4159d80 2023-08-09T12:53:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2db283640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41f2920 con 0x7fa2d4070a90 2023-08-09T12:53:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2d881e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d40ad810 0x7fa2d41f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2d881e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d40ad810 0x7fa2d41f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46206/0 (socket says 172.21.15.17:46206) 2023-08-09T12:53:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.747+0000 7fa2d881e640 1 -- 172.21.15.17:0/2958795614 learned_addr learned my addr 172.21.15.17:0/2958795614 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2d901f640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2d4070a90 0x7fa2d40aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2d881e640 1 -- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2d4070a90 msgr2=0x7fa2d40aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2d881e640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2d4070a90 0x7fa2d40aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2d881e640 1 -- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4159d80 msgr2=0x7fa2d40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2d881e640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4159d80 0x7fa2d40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2d881e640 1 -- 172.21.15.17:0/2958795614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0009400 con 0x7fa2d40ad810 2023-08-09T12:53:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2d901f640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2d4070a90 0x7fa2d40aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2d881e640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d40ad810 0x7fa2d41f30b0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4001260 tx=0x7fa2c400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2c9ffb640 1 -- 172.21.15.17:0/2958795614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4007480 con 0x7fa2d40ad810 2023-08-09T12:53:24.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2c9ffb640 1 -- 172.21.15.17:0/2958795614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c40075e0 con 0x7fa2d40ad810 2023-08-09T12:53:24.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.748+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d40af270 con 0x7fa2d40ad810 2023-08-09T12:53:24.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.749+0000 7fa2c9ffb640 1 -- 172.21.15.17:0/2958795614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40059c0 con 0x7fa2d40ad810 2023-08-09T12:53:24.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.749+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d41f2b90 con 0x7fa2d40ad810 2023-08-09T12:53:24.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.750+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d41f2d80 con 0x7fa2d40ad810 2023-08-09T12:53:24.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.751+0000 7fa2c9ffb640 1 -- 172.21.15.17:0/2958795614 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa2c4005b20 con 0x7fa2d40ad810 2023-08-09T12:53:24.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.752+0000 7fa2c9ffb640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa2b806a080 0x7fa2b806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:24.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.752+0000 7fa2c9ffb640 1 -- 172.21.15.17:0/2958795614 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2c4087bf0 con 0x7fa2d40ad810 2023-08-09T12:53:24.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.753+0000 7fa2d901f640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa2b806a080 0x7fa2b806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:24.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.754+0000 7fa2d901f640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa2b806a080 0x7fa2b806c540 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0036000 tx=0x7fa2d0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:24.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.757+0000 7fa2c9ffb640 1 -- 172.21.15.17:0/2958795614 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa2c4053240 con 0x7fa2d40ad810 2023-08-09T12:53:24.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.936+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2d40b4350 con 0x7fa2b806a080 2023-08-09T12:53:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.961+0000 7fa2c9ffb640 1 -- 172.21.15.17:0/2958795614 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302987 (secure 0 0 0) 0x7fa2d003f040 con 0x7fa2b806a080 2023-08-09T12:53:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:24.971 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:53:24.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa2b806a080 msgr2=0x7fa2b806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa2b806a080 0x7fa2b806c540 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0036000 tx=0x7fa2d0008030 comp rx=0 tx=0).stop 2023-08-09T12:53:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d40ad810 msgr2=0x7fa2d41f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d40ad810 0x7fa2d41f30b0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4001260 tx=0x7fa2c400c960 comp rx=0 tx=0).stop 2023-08-09T12:53:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 shutdown_connections 2023-08-09T12:53:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa2b806a080 0x7fa2b806c540 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4159d80 0x7fa2d40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d40ad810 0x7fa2d41f30b0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 --2- 172.21.15.17:0/2958795614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2d4070a90 0x7fa2d40aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:24.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 >> 172.21.15.17:0/2958795614 conn(0x7fa2d40cb1b0 msgr2=0x7fa2d40b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:24.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 shutdown_connections 2023-08-09T12:53:24.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:24.966+0000 7fa2db283640 1 -- 172.21.15.17:0/2958795614 wait complete. 2023-08-09T12:53:24.988 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2023-08-09T12:53:22.959118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10077,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552422,"statfs":{"total":1600000000,"available":1589680499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.550977"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454315+0000","last_change":"2023-08-09T12:53:20.471874+0000","last_active":"2023-08-09T12:53:21.454315+0000","last_peered":"2023-08-09T12:53:21.454315+0000","last_clean":"2023-08-09T12:53:21.454315+0000","last_became_active":"2023-08-09T12:53:20.471487+0000","last_became_peered":"2023-08-09T12:53:20.471487+0000","last_unstale":"2023-08-09T12:53:21.454315+0000","last_undegraded":"2023-08-09T12:53:21.454315+0000","last_fullsized":"2023-08-09T12:53:21.454315+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.299880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585548+0000","last_change":"2023-08-09T12:53:20.475921+0000","last_active":"2023-08-09T12:53:21.585548+0000","last_peered":"2023-08-09T12:53:21.585548+0000","last_clean":"2023-08-09T12:53:21.585548+0000","last_became_active":"2023-08-09T12:53:20.475633+0000","last_became_peered":"2023-08-09T12:53:20.475633+0000","last_unstale":"2023-08-09T12:53:21.585548+0000","last_undegraded":"2023-08-09T12:53:21.585548+0000","last_fullsized":"2023-08-09T12:53:21.585548+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:44:23.545370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453607+0000","last_change":"2023-08-09T12:53:20.472782+0000","last_active":"2023-08-09T12:53:21.453607+0000","last_peered":"2023-08-09T12:53:21.453607+0000","last_clean":"2023-08-09T12:53:21.453607+0000","last_became_active":"2023-08-09T12:53:20.472449+0000","last_became_peered":"2023-08-09T12:53:20.472449+0000","last_unstale":"2023-08-09T12:53:21.453607+0000","last_undegraded":"2023-08-09T12:53:21.453607+0000","last_fullsized":"2023-08-09T12:53:21.453607+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:58:07.993487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453181+0000","last_change":"2023-08-09T12:53:20.473373+0000","last_active":"2023-08-09T12:53:21.453181+0000","last_peered":"2023-08-09T12:53:21.453181+0000","last_clean":"2023-08-09T12:53:21.453181+0000","last_became_active":"2023-08-09T12:53:20.472974+0000","last_became_peered":"2023-08-09T12:53:20.472974+0000","last_unstale":"2023-08-09T12:53:21.453181+0000","last_undegraded":"2023-08-09T12:53:21.453181+0000","last_fullsized":"2023-08-09T12:53:21.453181+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:02:25.748263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.479268+0000","last_change":"2023-08-09T12:53:20.479015+0000","last_active":"2023-08-09T12:53:20.479268+0000","last_peered":"2023-08-09T12:53:20.479268+0000","last_clean":"2023-08-09T12:53:20.479268+0000","last_became_active":"2023-08-09T12:53:20.478409+0000","last_became_peered":"2023-08-09T12:53:20.478409+0000","last_unstale":"2023-08-09T12:53:20.479268+0000","last_undegraded":"2023-08-09T12:53:20.479268+0000","last_fullsized":"2023-08-09T12:53:20.479268+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:46:58.942510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587548+0000","last_change":"2023-08-09T12:53:20.473869+0000","last_active":"2023-08-09T12:53:21.587548+0000","last_peered":"2023-08-09T12:53:21.587548+0000","last_clean":"2023-08-09T12:53:21.587548+0000","last_became_active":"2023-08-09T12:53:20.473472+0000","last_became_peered":"2023-08-09T12:53:20.473472+0000","last_unstale":"2023-08-09T12:53:21.587548+0000","last_undegraded":"2023-08-09T12:53:21.587548+0000","last_fullsized":"2023-08-09T12:53:21.587548+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:20.996772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.483264+0000","last_change":"2023-08-09T12:53:20.483150+0000","last_active":"2023-08-09T12:53:20.483264+0000","last_peered":"2023-08-09T12:53:20.483264+0000","last_clean":"2023-08-09T12:53:20.483264+0000","last_became_active":"2023-08-09T12:53:20.482662+0000","last_became_peered":"2023-08-09T12:53:20.482662+0000","last_unstale":"2023-08-09T12:53:20.483264+0000","last_undegraded":"2023-08-09T12:53:20.483264+0000","last_fullsized":"2023-08-09T12:53:20.483264+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:49:29.440137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.485567+0000","last_change":"2023-08-09T12:53:20.485417+0000","last_active":"2023-08-09T12:53:20.485567+0000","last_peered":"2023-08-09T12:53:20.485567+0000","last_clean":"2023-08-09T12:53:20.485567+0000","last_became_active":"2023-08-09T12:53:20.484512+0000","last_became_peered":"2023-08-09T12:53:20.484512+0000","last_unstale":"2023-08-09T12:53:20.485567+0000","last_undegraded":"2023-08-09T12:53:20.485567+0000","last_fullsized":"2023-08-09T12:53:20.485567+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:21:51.033838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.482957+0000","last_change":"2023-08-09T12:53:20.482686+0000","last_active":"2023-08-09T12:53:20.482957+0000","last_peered":"2023-08-09T12:53:20.482957+0000","last_clean":"2023-08-09T12:53:20.482957+0000","last_became_active":"2023-08-09T12:53:20.481292+0000","last_became_peered":"2023-08-09T12:53:20.481292+0000","last_unstale":"2023-08-09T12:53:20.482957+0000","last_undegraded":"2023-08-09T12:53:20.482957+0000","last_fullsized":"2023-08-09T12:53:20.482957+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:37:13.038267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.482975+0000","last_change":"2023-08-09T12:53:20.482796+0000","last_active":"2023-08-09T12:53:20.482975+0000","last_peered":"2023-08-09T12:53:20.482975+0000","last_clean":"2023-08-09T12:53:20.482975+0000","last_became_active":"2023-08-09T12:53:20.482087+0000","last_became_peered":"2023-08-09T12:53:20.482087+0000","last_unstale":"2023-08-09T12:53:20.482975+0000","last_undegraded":"2023-08-09T12:53:20.482975+0000","last_fullsized":"2023-08-09T12:53:20.482975+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:55:22.502248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586690+0000","last_change":"2023-08-09T12:53:20.486030+0000","last_active":"2023-08-09T12:53:21.586690+0000","last_peered":"2023-08-09T12:53:21.586690+0000","last_clean":"2023-08-09T12:53:21.586690+0000","last_became_active":"2023-08-09T12:53:20.485475+0000","last_became_peered":"2023-08-09T12:53:20.485475+0000","last_unstale":"2023-08-09T12:53:21.586690+0000","last_undegraded":"2023-08-09T12:53:21.586690+0000","last_fullsized":"2023-08-09T12:53:21.586690+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:57:30.273892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586606+0000","last_change":"2023-08-09T12:53:20.475286+0000","last_active":"2023-08-09T12:53:21.586606+0000","last_peered":"2023-08-09T12:53:21.586606+0000","last_clean":"2023-08-09T12:53:21.586606+0000","last_became_active":"2023-08-09T12:53:20.474432+0000","last_became_peered":"2023-08-09T12:53:20.474432+0000","last_unstale":"2023-08-09T12:53:21.586606+0000","last_undegraded":"2023-08-09T12:53:21.586606+0000","last_fullsized":"2023-08-09T12:53:21.586606+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:02:26.922724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586274+0000","last_change":"2023-08-09T12:53:20.462620+0000","last_active":"2023-08-09T12:53:21.586274+0000","last_peered":"2023-08-09T12:53:21.586274+0000","last_clean":"2023-08-09T12:53:21.586274+0000","last_became_active":"2023-08-09T12:53:20.460781+0000","last_became_peered":"2023-08-09T12:53:20.460781+0000","last_unstale":"2023-08-09T12:53:21.586274+0000","last_undegraded":"2023-08-09T12:53:21.586274+0000","last_fullsized":"2023-08-09T12:53:21.586274+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:40:10.709480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.484164+0000","last_change":"2023-08-09T12:53:20.481875+0000","last_active":"2023-08-09T12:53:20.484164+0000","last_peered":"2023-08-09T12:53:20.484164+0000","last_clean":"2023-08-09T12:53:20.484164+0000","last_became_active":"2023-08-09T12:53:20.481369+0000","last_became_peered":"2023-08-09T12:53:20.481369+0000","last_unstale":"2023-08-09T12:53:20.484164+0000","last_undegraded":"2023-08-09T12:53:20.484164+0000","last_fullsized":"2023-08-09T12:53:20.484164+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:40:13.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586444+0000","last_change":"2023-08-09T12:53:20.484560+0000","last_active":"2023-08-09T12:53:21.586444+0000","last_peered":"2023-08-09T12:53:21.586444+0000","last_clean":"2023-08-09T12:53:21.586444+0000","last_became_active":"2023-08-09T12:53:20.484236+0000","last_became_peered":"2023-08-09T12:53:20.484236+0000","last_unstale":"2023-08-09T12:53:21.586444+0000","last_undegraded":"2023-08-09T12:53:21.586444+0000","last_fullsized":"2023-08-09T12:53:21.586444+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:43:16.136269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453752+0000","last_change":"2023-08-09T12:53:20.477514+0000","last_active":"2023-08-09T12:53:21.453752+0000","last_peered":"2023-08-09T12:53:21.453752+0000","last_clean":"2023-08-09T12:53:21.453752+0000","last_became_active":"2023-08-09T12:53:20.476739+0000","last_became_peered":"2023-08-09T12:53:20.476739+0000","last_unstale":"2023-08-09T12:53:21.453752+0000","last_undegraded":"2023-08-09T12:53:21.453752+0000","last_fullsized":"2023-08-09T12:53:21.453752+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:47.927161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.483224+0000","last_change":"2023-08-09T12:53:20.482930+0000","last_active":"2023-08-09T12:53:20.483224+0000","last_peered":"2023-08-09T12:53:20.483224+0000","last_clean":"2023-08-09T12:53:20.483224+0000","last_became_active":"2023-08-09T12:53:20.480847+0000","last_became_peered":"2023-08-09T12:53:20.480847+0000","last_unstale":"2023-08-09T12:53:20.483224+0000","last_undegraded":"2023-08-09T12:53:20.483224+0000","last_fullsized":"2023-08-09T12:53:20.483224+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:23:05.740596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585161+0000","last_change":"2023-08-09T12:53:20.486208+0000","last_active":"2023-08-09T12:53:21.585161+0000","last_peered":"2023-08-09T12:53:21.585161+0000","last_clean":"2023-08-09T12:53:21.585161+0000","last_became_active":"2023-08-09T12:53:20.485696+0000","last_became_peered":"2023-08-09T12:53:20.485696+0000","last_unstale":"2023-08-09T12:53:21.585161+0000","last_undegraded":"2023-08-09T12:53:21.585161+0000","last_fullsized":"2023-08-09T12:53:21.585161+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:37:01.857043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.584596+0000","last_change":"2023-08-09T12:53:20.482325+0000","last_active":"2023-08-09T12:53:21.584596+0000","last_peered":"2023-08-09T12:53:21.584596+0000","last_clean":"2023-08-09T12:53:21.584596+0000","last_became_active":"2023-08-09T12:53:20.482119+0000","last_became_peered":"2023-08-09T12:53:20.482119+0000","last_unstale":"2023-08-09T12:53:21.584596+0000","last_undegraded":"2023-08-09T12:53:21.584596+0000","last_fullsized":"2023-08-09T12:53:21.584596+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:20.313282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450462+0000","last_change":"2023-08-09T12:53:20.472744+0000","last_active":"2023-08-09T12:53:21.450462+0000","last_peered":"2023-08-09T12:53:21.450462+0000","last_clean":"2023-08-09T12:53:21.450462+0000","last_became_active":"2023-08-09T12:53:20.472268+0000","last_became_peered":"2023-08-09T12:53:20.472268+0000","last_unstale":"2023-08-09T12:53:21.450462+0000","last_undegraded":"2023-08-09T12:53:21.450462+0000","last_fullsized":"2023-08-09T12:53:21.450462+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:03:56.844420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.584828+0000","last_change":"2023-08-09T12:53:20.476624+0000","last_active":"2023-08-09T12:53:21.584828+0000","last_peered":"2023-08-09T12:53:21.584828+0000","last_clean":"2023-08-09T12:53:21.584828+0000","last_became_active":"2023-08-09T12:53:20.476126+0000","last_became_peered":"2023-08-09T12:53:20.476126+0000","last_unstale":"2023-08-09T12:53:21.584828+0000","last_undegraded":"2023-08-09T12:53:21.584828+0000","last_fullsized":"2023-08-09T12:53:21.584828+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:35.814126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585878+0000","last_change":"2023-08-09T12:53:20.474937+0000","last_active":"2023-08-09T12:53:21.585878+0000","last_peered":"2023-08-09T12:53:21.585878+0000","last_clean":"2023-08-09T12:53:21.585878+0000","last_became_active":"2023-08-09T12:53:20.473451+0000","last_became_peered":"2023-08-09T12:53:20.473451+0000","last_unstale":"2023-08-09T12:53:21.585878+0000","last_undegraded":"2023-08-09T12:53:21.585878+0000","last_fullsized":"2023-08-09T12:53:21.585878+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:02.962955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.470492+0000","last_change":"2023-08-09T12:53:20.469974+0000","last_active":"2023-08-09T12:53:20.470492+0000","last_peered":"2023-08-09T12:53:20.470492+0000","last_clean":"2023-08-09T12:53:20.470492+0000","last_became_active":"2023-08-09T12:53:20.469338+0000","last_became_peered":"2023-08-09T12:53:20.469338+0000","last_unstale":"2023-08-09T12:53:20.470492+0000","last_undegraded":"2023-08-09T12:53:20.470492+0000","last_fullsized":"2023-08-09T12:53:20.470492+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:36:55.304374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453572+0000","last_change":"2023-08-09T12:53:20.473224+0000","last_active":"2023-08-09T12:53:21.453572+0000","last_peered":"2023-08-09T12:53:21.453572+0000","last_clean":"2023-08-09T12:53:21.453572+0000","last_became_active":"2023-08-09T12:53:20.472621+0000","last_became_peered":"2023-08-09T12:53:20.472621+0000","last_unstale":"2023-08-09T12:53:21.453572+0000","last_undegraded":"2023-08-09T12:53:21.453572+0000","last_fullsized":"2023-08-09T12:53:21.453572+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:10:32.850588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585428+0000","last_change":"2023-08-09T12:53:20.482872+0000","last_active":"2023-08-09T12:53:21.585428+0000","last_peered":"2023-08-09T12:53:21.585428+0000","last_clean":"2023-08-09T12:53:21.585428+0000","last_became_active":"2023-08-09T12:53:20.481772+0000","last_became_peered":"2023-08-09T12:53:20.481772+0000","last_unstale":"2023-08-09T12:53:21.585428+0000","last_undegraded":"2023-08-09T12:53:21.585428+0000","last_fullsized":"2023-08-09T12:53:21.585428+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:05:45.190855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.449981+0000","last_change":"2023-08-09T12:53:20.477187+0000","last_active":"2023-08-09T12:53:21.449981+0000","last_peered":"2023-08-09T12:53:21.449981+0000","last_clean":"2023-08-09T12:53:21.449981+0000","last_became_active":"2023-08-09T12:53:20.476767+0000","last_became_peered":"2023-08-09T12:53:20.476767+0000","last_unstale":"2023-08-09T12:53:21.449981+0000","last_undegraded":"2023-08-09T12:53:21.449981+0000","last_fullsized":"2023-08-09T12:53:21.449981+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:28:52.878529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586242+0000","last_change":"2023-08-09T12:53:20.474761+0000","last_active":"2023-08-09T12:53:21.586242+0000","last_peered":"2023-08-09T12:53:21.586242+0000","last_clean":"2023-08-09T12:53:21.586242+0000","last_became_active":"2023-08-09T12:53:20.472858+0000","last_became_peered":"2023-08-09T12:53:20.472858+0000","last_unstale":"2023-08-09T12:53:21.586242+0000","last_undegraded":"2023-08-09T12:53:21.586242+0000","last_fullsized":"2023-08-09T12:53:21.586242+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:35:02.248627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585553+0000","last_change":"2023-08-09T12:53:20.477579+0000","last_active":"2023-08-09T12:53:21.585553+0000","last_peered":"2023-08-09T12:53:21.585553+0000","last_clean":"2023-08-09T12:53:21.585553+0000","last_became_active":"2023-08-09T12:53:20.476945+0000","last_became_peered":"2023-08-09T12:53:20.476945+0000","last_unstale":"2023-08-09T12:53:21.585553+0000","last_undegraded":"2023-08-09T12:53:21.585553+0000","last_fullsized":"2023-08-09T12:53:21.585553+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:51:47.458871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585525+0000","last_change":"2023-08-09T12:53:20.483209+0000","last_active":"2023-08-09T12:53:21.585525+0000","last_peered":"2023-08-09T12:53:21.585525+0000","last_clean":"2023-08-09T12:53:21.585525+0000","last_became_active":"2023-08-09T12:53:20.482764+0000","last_became_peered":"2023-08-09T12:53:20.482764+0000","last_unstale":"2023-08-09T12:53:21.585525+0000","last_undegraded":"2023-08-09T12:53:21.585525+0000","last_fullsized":"2023-08-09T12:53:21.585525+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:22:42.827047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586515+0000","last_change":"2023-08-09T12:53:20.471285+0000","last_active":"2023-08-09T12:53:21.586515+0000","last_peered":"2023-08-09T12:53:21.586515+0000","last_clean":"2023-08-09T12:53:21.586515+0000","last_became_active":"2023-08-09T12:53:20.470899+0000","last_became_peered":"2023-08-09T12:53:20.470899+0000","last_unstale":"2023-08-09T12:53:21.586515+0000","last_undegraded":"2023-08-09T12:53:21.586515+0000","last_fullsized":"2023-08-09T12:53:21.586515+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:55:13.835954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587018+0000","last_change":"2023-08-09T12:53:20.478134+0000","last_active":"2023-08-09T12:53:21.587018+0000","last_peered":"2023-08-09T12:53:21.587018+0000","last_clean":"2023-08-09T12:53:21.587018+0000","last_became_active":"2023-08-09T12:53:20.477816+0000","last_became_peered":"2023-08-09T12:53:20.477816+0000","last_unstale":"2023-08-09T12:53:21.587018+0000","last_undegraded":"2023-08-09T12:53:21.587018+0000","last_fullsized":"2023-08-09T12:53:21.587018+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:25:29.718045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587719+0000","last_change":"2023-08-09T12:53:20.461725+0000","last_active":"2023-08-09T12:53:21.587719+0000","last_peered":"2023-08-09T12:53:21.587719+0000","last_clean":"2023-08-09T12:53:21.587719+0000","last_became_active":"2023-08-09T12:53:20.459951+0000","last_became_peered":"2023-08-09T12:53:20.459951+0000","last_unstale":"2023-08-09T12:53:21.587719+0000","last_undegraded":"2023-08-09T12:53:21.587719+0000","last_fullsized":"2023-08-09T12:53:21.587719+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:22.748162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585546+0000","last_change":"2023-08-09T12:53:20.459570+0000","last_active":"2023-08-09T12:53:21.585546+0000","last_peered":"2023-08-09T12:53:21.585546+0000","last_clean":"2023-08-09T12:53:21.585546+0000","last_became_active":"2023-08-09T12:53:20.458850+0000","last_became_peered":"2023-08-09T12:53:20.458850+0000","last_unstale":"2023-08-09T12:53:21.585546+0000","last_undegraded":"2023-08-09T12:53:21.585546+0000","last_fullsized":"2023-08-09T12:53:21.585546+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:19:46.761600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"190'4","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454010+0000","last_change":"2023-08-09T12:53:19.437231+0000","last_active":"2023-08-09T12:53:21.454010+0000","last_peered":"2023-08-09T12:53:21.454010+0000","last_clean":"2023-08-09T12:53:21.454010+0000","last_became_active":"2023-08-09T12:53:19.436408+0000","last_became_peered":"2023-08-09T12:53:19.436408+0000","last_unstale":"2023-08-09T12:53:21.454010+0000","last_undegraded":"2023-08-09T12:53:21.454010+0000","last_fullsized":"2023-08-09T12:53:21.454010+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:17:18.727782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586609+0000","last_change":"2023-08-09T12:53:20.461088+0000","last_active":"2023-08-09T12:53:21.586609+0000","last_peered":"2023-08-09T12:53:21.586609+0000","last_clean":"2023-08-09T12:53:21.586609+0000","last_became_active":"2023-08-09T12:53:20.460401+0000","last_became_peered":"2023-08-09T12:53:20.460401+0000","last_unstale":"2023-08-09T12:53:21.586609+0000","last_undegraded":"2023-08-09T12:53:21.586609+0000","last_fullsized":"2023-08-09T12:53:21.586609+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:59:39.038251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"190'1","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.502491+0000","last_change":"2023-08-09T12:53:19.439621+0000","last_active":"2023-08-09T12:53:20.502491+0000","last_peered":"2023-08-09T12:53:20.502491+0000","last_clean":"2023-08-09T12:53:20.502491+0000","last_became_active":"2023-08-09T12:53:19.438880+0000","last_became_peered":"2023-08-09T12:53:19.438880+0000","last_unstale":"2023-08-09T12:53:20.502491+0000","last_undegraded":"2023-08-09T12:53:20.502491+0000","last_fullsized":"2023-08-09T12:53:20.502491+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:29:57.675335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.467367+0000","last_change":"2023-08-09T12:53:20.467100+0000","last_active":"2023-08-09T12:53:20.467367+0000","last_peered":"2023-08-09T12:53:20.467367+0000","last_clean":"2023-08-09T12:53:20.467367+0000","last_became_active":"2023-08-09T12:53:20.466464+0000","last_became_peered":"2023-08-09T12:53:20.466464+0000","last_unstale":"2023-08-09T12:53:20.467367+0000","last_undegraded":"2023-08-09T12:53:20.467367+0000","last_fullsized":"2023-08-09T12:53:20.467367+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:44:28.041897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586787+0000","last_change":"2023-08-09T12:53:19.437813+0000","last_active":"2023-08-09T12:53:21.586787+0000","last_peered":"2023-08-09T12:53:21.586787+0000","last_clean":"2023-08-09T12:53:21.586787+0000","last_became_active":"2023-08-09T12:53:19.437562+0000","last_became_peered":"2023-08-09T12:53:19.437562+0000","last_unstale":"2023-08-09T12:53:21.586787+0000","last_undegraded":"2023-08-09T12:53:21.586787+0000","last_fullsized":"2023-08-09T12:53:21.586787+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:03:43.459193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587347+0000","last_change":"2023-08-09T12:53:20.461367+0000","last_active":"2023-08-09T12:53:21.587347+0000","last_peered":"2023-08-09T12:53:21.587347+0000","last_clean":"2023-08-09T12:53:21.587347+0000","last_became_active":"2023-08-09T12:53:20.460315+0000","last_became_peered":"2023-08-09T12:53:20.460315+0000","last_unstale":"2023-08-09T12:53:21.587347+0000","last_undegraded":"2023-08-09T12:53:21.587347+0000","last_fullsized":"2023-08-09T12:53:21.587347+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:23:22.252970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450515+0000","last_change":"2023-08-09T12:53:19.431864+0000","last_active":"2023-08-09T12:53:21.450515+0000","last_peered":"2023-08-09T12:53:21.450515+0000","last_clean":"2023-08-09T12:53:21.450515+0000","last_became_active":"2023-08-09T12:53:19.430812+0000","last_became_peered":"2023-08-09T12:53:19.430812+0000","last_unstale":"2023-08-09T12:53:21.450515+0000","last_undegraded":"2023-08-09T12:53:21.450515+0000","last_fullsized":"2023-08-09T12:53:21.450515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:20:29.414035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.482907+0000","last_change":"2023-08-09T12:53:20.481912+0000","last_active":"2023-08-09T12:53:20.482907+0000","last_peered":"2023-08-09T12:53:20.482907+0000","last_clean":"2023-08-09T12:53:20.482907+0000","last_became_active":"2023-08-09T12:53:20.480909+0000","last_became_peered":"2023-08-09T12:53:20.480909+0000","last_unstale":"2023-08-09T12:53:20.482907+0000","last_undegraded":"2023-08-09T12:53:20.482907+0000","last_fullsized":"2023-08-09T12:53:20.482907+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:03.056998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"190'1","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501763+0000","last_change":"2023-08-09T12:53:19.437579+0000","last_active":"2023-08-09T12:53:20.501763+0000","last_peered":"2023-08-09T12:53:20.501763+0000","last_clean":"2023-08-09T12:53:20.501763+0000","last_became_active":"2023-08-09T12:53:19.436587+0000","last_became_peered":"2023-08-09T12:53:19.436587+0000","last_unstale":"2023-08-09T12:53:20.501763+0000","last_undegraded":"2023-08-09T12:53:20.501763+0000","last_fullsized":"2023-08-09T12:53:20.501763+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:34:15.453876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450397+0000","last_change":"2023-08-09T12:53:20.467668+0000","last_active":"2023-08-09T12:53:21.450397+0000","last_peered":"2023-08-09T12:53:21.450397+0000","last_clean":"2023-08-09T12:53:21.450397+0000","last_became_active":"2023-08-09T12:53:20.465885+0000","last_became_peered":"2023-08-09T12:53:20.465885+0000","last_unstale":"2023-08-09T12:53:21.450397+0000","last_undegraded":"2023-08-09T12:53:21.450397+0000","last_fullsized":"2023-08-09T12:53:21.450397+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:44:00.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"190'1","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.500877+0000","last_change":"2023-08-09T12:53:19.433724+0000","last_active":"2023-08-09T12:53:20.500877+0000","last_peered":"2023-08-09T12:53:20.500877+0000","last_clean":"2023-08-09T12:53:20.500877+0000","last_became_active":"2023-08-09T12:53:19.433392+0000","last_became_peered":"2023-08-09T12:53:19.433392+0000","last_unstale":"2023-08-09T12:53:20.500877+0000","last_undegraded":"2023-08-09T12:53:20.500877+0000","last_fullsized":"2023-08-09T12:53:20.500877+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:33.963701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450345+0000","last_change":"2023-08-09T12:53:20.469025+0000","last_active":"2023-08-09T12:53:21.450345+0000","last_peered":"2023-08-09T12:53:21.450345+0000","last_clean":"2023-08-09T12:53:21.450345+0000","last_became_active":"2023-08-09T12:53:20.466658+0000","last_became_peered":"2023-08-09T12:53:20.466658+0000","last_unstale":"2023-08-09T12:53:21.450345+0000","last_undegraded":"2023-08-09T12:53:21.450345+0000","last_fullsized":"2023-08-09T12:53:21.450345+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:15:24.975074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450512+0000","last_change":"2023-08-09T12:53:19.437581+0000","last_active":"2023-08-09T12:53:21.450512+0000","last_peered":"2023-08-09T12:53:21.450512+0000","last_clean":"2023-08-09T12:53:21.450512+0000","last_became_active":"2023-08-09T12:53:19.437125+0000","last_became_peered":"2023-08-09T12:53:19.437125+0000","last_unstale":"2023-08-09T12:53:21.450512+0000","last_undegraded":"2023-08-09T12:53:21.450512+0000","last_fullsized":"2023-08-09T12:53:21.450512+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:58.088134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454001+0000","last_change":"2023-08-09T12:53:20.477020+0000","last_active":"2023-08-09T12:53:21.454001+0000","last_peered":"2023-08-09T12:53:21.454001+0000","last_clean":"2023-08-09T12:53:21.454001+0000","last_became_active":"2023-08-09T12:53:20.475048+0000","last_became_peered":"2023-08-09T12:53:20.475048+0000","last_unstale":"2023-08-09T12:53:21.454001+0000","last_undegraded":"2023-08-09T12:53:21.454001+0000","last_fullsized":"2023-08-09T12:53:21.454001+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:26:40.549108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.477454+0000","last_change":"2023-08-09T12:53:19.431655+0000","last_active":"2023-08-09T12:53:20.477454+0000","last_peered":"2023-08-09T12:53:20.477454+0000","last_clean":"2023-08-09T12:53:20.477454+0000","last_became_active":"2023-08-09T12:53:19.430730+0000","last_became_peered":"2023-08-09T12:53:19.430730+0000","last_unstale":"2023-08-09T12:53:20.477454+0000","last_undegraded":"2023-08-09T12:53:20.477454+0000","last_fullsized":"2023-08-09T12:53:20.477454+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:02.784639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.483246+0000","last_change":"2023-08-09T12:53:20.483099+0000","last_active":"2023-08-09T12:53:20.483246+0000","last_peered":"2023-08-09T12:53:20.483246+0000","last_clean":"2023-08-09T12:53:20.483246+0000","last_became_active":"2023-08-09T12:53:20.482302+0000","last_became_peered":"2023-08-09T12:53:20.482302+0000","last_unstale":"2023-08-09T12:53:20.483246+0000","last_undegraded":"2023-08-09T12:53:20.483246+0000","last_fullsized":"2023-08-09T12:53:20.483246+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:50:40.220441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585602+0000","last_change":"2023-08-09T12:53:19.431627+0000","last_active":"2023-08-09T12:53:21.585602+0000","last_peered":"2023-08-09T12:53:21.585602+0000","last_clean":"2023-08-09T12:53:21.585602+0000","last_became_active":"2023-08-09T12:53:19.431134+0000","last_became_peered":"2023-08-09T12:53:19.431134+0000","last_unstale":"2023-08-09T12:53:21.585602+0000","last_undegraded":"2023-08-09T12:53:21.585602+0000","last_fullsized":"2023-08-09T12:53:21.585602+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:47:36.338397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585505+0000","last_change":"2023-08-09T12:53:20.476268+0000","last_active":"2023-08-09T12:53:21.585505+0000","last_peered":"2023-08-09T12:53:21.585505+0000","last_clean":"2023-08-09T12:53:21.585505+0000","last_became_active":"2023-08-09T12:53:20.475995+0000","last_became_peered":"2023-08-09T12:53:20.475995+0000","last_unstale":"2023-08-09T12:53:21.585505+0000","last_undegraded":"2023-08-09T12:53:21.585505+0000","last_fullsized":"2023-08-09T12:53:21.585505+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:18:05.609616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"190'2","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501811+0000","last_change":"2023-08-09T12:53:19.435753+0000","last_active":"2023-08-09T12:53:20.501811+0000","last_peered":"2023-08-09T12:53:20.501811+0000","last_clean":"2023-08-09T12:53:20.501811+0000","last_became_active":"2023-08-09T12:53:19.435510+0000","last_became_peered":"2023-08-09T12:53:19.435510+0000","last_unstale":"2023-08-09T12:53:20.501811+0000","last_undegraded":"2023-08-09T12:53:20.501811+0000","last_fullsized":"2023-08-09T12:53:20.501811+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:43:55.546602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587728+0000","last_change":"2023-08-09T12:53:20.474826+0000","last_active":"2023-08-09T12:53:21.587728+0000","last_peered":"2023-08-09T12:53:21.587728+0000","last_clean":"2023-08-09T12:53:21.587728+0000","last_became_active":"2023-08-09T12:53:20.474552+0000","last_became_peered":"2023-08-09T12:53:20.474552+0000","last_unstale":"2023-08-09T12:53:21.587728+0000","last_undegraded":"2023-08-09T12:53:21.587728+0000","last_fullsized":"2023-08-09T12:53:21.587728+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:25:07.372440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"190'1","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501231+0000","last_change":"2023-08-09T12:53:19.433660+0000","last_active":"2023-08-09T12:53:20.501231+0000","last_peered":"2023-08-09T12:53:20.501231+0000","last_clean":"2023-08-09T12:53:20.501231+0000","last_became_active":"2023-08-09T12:53:19.433244+0000","last_became_peered":"2023-08-09T12:53:19.433244+0000","last_unstale":"2023-08-09T12:53:20.501231+0000","last_undegraded":"2023-08-09T12:53:20.501231+0000","last_fullsized":"2023-08-09T12:53:20.501231+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:02:07.271523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587683+0000","last_change":"2023-08-09T12:53:20.485763+0000","last_active":"2023-08-09T12:53:21.587683+0000","last_peered":"2023-08-09T12:53:21.587683+0000","last_clean":"2023-08-09T12:53:21.587683+0000","last_became_active":"2023-08-09T12:53:20.484996+0000","last_became_peered":"2023-08-09T12:53:20.484996+0000","last_unstale":"2023-08-09T12:53:21.587683+0000","last_undegraded":"2023-08-09T12:53:21.587683+0000","last_fullsized":"2023-08-09T12:53:21.587683+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:57:24.809767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.473921+0000","last_change":"2023-08-09T12:53:19.436825+0000","last_active":"2023-08-09T12:53:20.473921+0000","last_peered":"2023-08-09T12:53:20.473921+0000","last_clean":"2023-08-09T12:53:20.473921+0000","last_became_active":"2023-08-09T12:53:19.436268+0000","last_became_peered":"2023-08-09T12:53:19.436268+0000","last_unstale":"2023-08-09T12:53:20.473921+0000","last_undegraded":"2023-08-09T12:53:20.473921+0000","last_fullsized":"2023-08-09T12:53:20.473921+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:23.119214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585701+0000","last_change":"2023-08-09T12:53:20.483097+0000","last_active":"2023-08-09T12:53:21.585701+0000","last_peered":"2023-08-09T12:53:21.585701+0000","last_clean":"2023-08-09T12:53:21.585701+0000","last_became_active":"2023-08-09T12:53:20.482198+0000","last_became_peered":"2023-08-09T12:53:20.482198+0000","last_unstale":"2023-08-09T12:53:21.585701+0000","last_undegraded":"2023-08-09T12:53:21.585701+0000","last_fullsized":"2023-08-09T12:53:21.585701+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:07.929049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"190'2","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501525+0000","last_change":"2023-08-09T12:53:19.439865+0000","last_active":"2023-08-09T12:53:20.501525+0000","last_peered":"2023-08-09T12:53:20.501525+0000","last_clean":"2023-08-09T12:53:20.501525+0000","last_became_active":"2023-08-09T12:53:19.439598+0000","last_became_peered":"2023-08-09T12:53:19.439598+0000","last_unstale":"2023-08-09T12:53:20.501525+0000","last_undegraded":"2023-08-09T12:53:20.501525+0000","last_fullsized":"2023-08-09T12:53:20.501525+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:48:58.675234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.486003+0000","last_change":"2023-08-09T12:53:20.485863+0000","last_active":"2023-08-09T12:53:20.486003+0000","last_peered":"2023-08-09T12:53:20.486003+0000","last_clean":"2023-08-09T12:53:20.486003+0000","last_became_active":"2023-08-09T12:53:20.485263+0000","last_became_peered":"2023-08-09T12:53:20.485263+0000","last_unstale":"2023-08-09T12:53:20.486003+0000","last_undegraded":"2023-08-09T12:53:20.486003+0000","last_fullsized":"2023-08-09T12:53:20.486003+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:47:52.716071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585284+0000","last_change":"2023-08-09T12:53:19.428244+0000","last_active":"2023-08-09T12:53:21.585284+0000","last_peered":"2023-08-09T12:53:21.585284+0000","last_clean":"2023-08-09T12:53:21.585284+0000","last_became_active":"2023-08-09T12:53:19.427529+0000","last_became_peered":"2023-08-09T12:53:19.427529+0000","last_unstale":"2023-08-09T12:53:21.585284+0000","last_undegraded":"2023-08-09T12:53:21.585284+0000","last_fullsized":"2023-08-09T12:53:21.585284+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:19:47.740820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.486827+0000","last_change":"2023-08-09T12:53:20.486710+0000","last_active":"2023-08-09T12:53:20.486827+0000","last_peered":"2023-08-09T12:53:20.486827+0000","last_clean":"2023-08-09T12:53:20.486827+0000","last_became_active":"2023-08-09T12:53:20.486229+0000","last_became_peered":"2023-08-09T12:53:20.486229+0000","last_unstale":"2023-08-09T12:53:20.486827+0000","last_undegraded":"2023-08-09T12:53:20.486827+0000","last_fullsized":"2023-08-09T12:53:20.486827+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:14:43.697620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450881+0000","last_change":"2023-08-09T12:53:19.436010+0000","last_active":"2023-08-09T12:53:21.450881+0000","last_peered":"2023-08-09T12:53:21.450881+0000","last_clean":"2023-08-09T12:53:21.450881+0000","last_became_active":"2023-08-09T12:53:19.435752+0000","last_became_peered":"2023-08-09T12:53:19.435752+0000","last_unstale":"2023-08-09T12:53:21.450881+0000","last_undegraded":"2023-08-09T12:53:21.450881+0000","last_fullsized":"2023-08-09T12:53:21.450881+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:06.368530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586942+0000","last_change":"2023-08-09T12:53:20.475112+0000","last_active":"2023-08-09T12:53:21.586942+0000","last_peered":"2023-08-09T12:53:21.586942+0000","last_clean":"2023-08-09T12:53:21.586942+0000","last_became_active":"2023-08-09T12:53:20.473986+0000","last_became_peered":"2023-08-09T12:53:20.473986+0000","last_unstale":"2023-08-09T12:53:21.586942+0000","last_undegraded":"2023-08-09T12:53:21.586942+0000","last_fullsized":"2023-08-09T12:53:21.586942+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:07:29.173522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.588295+0000","last_change":"2023-08-09T12:53:19.440587+0000","last_active":"2023-08-09T12:53:21.588295+0000","last_peered":"2023-08-09T12:53:21.588295+0000","last_clean":"2023-08-09T12:53:21.588295+0000","last_became_active":"2023-08-09T12:53:19.439484+0000","last_became_peered":"2023-08-09T12:53:19.439484+0000","last_unstale":"2023-08-09T12:53:21.588295+0000","last_undegraded":"2023-08-09T12:53:21.588295+0000","last_fullsized":"2023-08-09T12:53:21.588295+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:44:17.459873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587385+0000","last_change":"2023-08-09T12:53:20.475239+0000","last_active":"2023-08-09T12:53:21.587385+0000","last_peered":"2023-08-09T12:53:21.587385+0000","last_clean":"2023-08-09T12:53:21.587385+0000","last_became_active":"2023-08-09T12:53:20.474934+0000","last_became_peered":"2023-08-09T12:53:20.474934+0000","last_unstale":"2023-08-09T12:53:21.587385+0000","last_undegraded":"2023-08-09T12:53:21.587385+0000","last_fullsized":"2023-08-09T12:53:21.587385+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:31:17.339341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"190'2","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501824+0000","last_change":"2023-08-09T12:53:19.440686+0000","last_active":"2023-08-09T12:53:20.501824+0000","last_peered":"2023-08-09T12:53:20.501824+0000","last_clean":"2023-08-09T12:53:20.501824+0000","last_became_active":"2023-08-09T12:53:19.439937+0000","last_became_peered":"2023-08-09T12:53:19.439937+0000","last_unstale":"2023-08-09T12:53:20.501824+0000","last_undegraded":"2023-08-09T12:53:20.501824+0000","last_fullsized":"2023-08-09T12:53:20.501824+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:57:43.790051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.482938+0000","last_change":"2023-08-09T12:53:20.482493+0000","last_active":"2023-08-09T12:53:20.482938+0000","last_peered":"2023-08-09T12:53:20.482938+0000","last_clean":"2023-08-09T12:53:20.482938+0000","last_became_active":"2023-08-09T12:53:20.481623+0000","last_became_peered":"2023-08-09T12:53:20.481623+0000","last_unstale":"2023-08-09T12:53:20.482938+0000","last_undegraded":"2023-08-09T12:53:20.482938+0000","last_fullsized":"2023-08-09T12:53:20.482938+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:59:59.096608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586591+0000","last_change":"2023-08-09T12:53:19.430459+0000","last_active":"2023-08-09T12:53:21.586591+0000","last_peered":"2023-08-09T12:53:21.586591+0000","last_clean":"2023-08-09T12:53:21.586591+0000","last_became_active":"2023-08-09T12:53:19.429834+0000","last_became_peered":"2023-08-09T12:53:19.429834+0000","last_unstale":"2023-08-09T12:53:21.586591+0000","last_undegraded":"2023-08-09T12:53:21.586591+0000","last_fullsized":"2023-08-09T12:53:21.586591+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:16:23.867659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450349+0000","last_change":"2023-08-09T12:53:20.466882+0000","last_active":"2023-08-09T12:53:21.450349+0000","last_peered":"2023-08-09T12:53:21.450349+0000","last_clean":"2023-08-09T12:53:21.450349+0000","last_became_active":"2023-08-09T12:53:20.466233+0000","last_became_peered":"2023-08-09T12:53:20.466233+0000","last_unstale":"2023-08-09T12:53:21.450349+0000","last_undegraded":"2023-08-09T12:53:21.450349+0000","last_fullsized":"2023-08-09T12:53:21.450349+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:29:14.198587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585943+0000","last_change":"2023-08-09T12:53:19.426301+0000","last_active":"2023-08-09T12:53:21.585943+0000","last_peered":"2023-08-09T12:53:21.585943+0000","last_clean":"2023-08-09T12:53:21.585943+0000","last_became_active":"2023-08-09T12:53:19.425950+0000","last_became_peered":"2023-08-09T12:53:19.425950+0000","last_unstale":"2023-08-09T12:53:21.585943+0000","last_undegraded":"2023-08-09T12:53:21.585943+0000","last_fullsized":"2023-08-09T12:53:21.585943+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:39:40.125757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.485869+0000","last_change":"2023-08-09T12:53:20.485793+0000","last_active":"2023-08-09T12:53:20.485869+0000","last_peered":"2023-08-09T12:53:20.485869+0000","last_clean":"2023-08-09T12:53:20.485869+0000","last_became_active":"2023-08-09T12:53:20.485037+0000","last_became_peered":"2023-08-09T12:53:20.485037+0000","last_unstale":"2023-08-09T12:53:20.485869+0000","last_undegraded":"2023-08-09T12:53:20.485869+0000","last_fullsized":"2023-08-09T12:53:20.485869+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:44:38.749644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.451029+0000","last_change":"2023-08-09T12:53:19.434848+0000","last_active":"2023-08-09T12:53:21.451029+0000","last_peered":"2023-08-09T12:53:21.451029+0000","last_clean":"2023-08-09T12:53:21.451029+0000","last_became_active":"2023-08-09T12:53:19.434529+0000","last_became_peered":"2023-08-09T12:53:19.434529+0000","last_unstale":"2023-08-09T12:53:21.451029+0000","last_undegraded":"2023-08-09T12:53:21.451029+0000","last_fullsized":"2023-08-09T12:53:21.451029+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:11:10.872258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453693+0000","last_change":"2023-08-09T12:53:20.479918+0000","last_active":"2023-08-09T12:53:21.453693+0000","last_peered":"2023-08-09T12:53:21.453693+0000","last_clean":"2023-08-09T12:53:21.453693+0000","last_became_active":"2023-08-09T12:53:20.479688+0000","last_became_peered":"2023-08-09T12:53:20.479688+0000","last_unstale":"2023-08-09T12:53:21.453693+0000","last_undegraded":"2023-08-09T12:53:21.453693+0000","last_fullsized":"2023-08-09T12:53:21.453693+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:11:01.890180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454465+0000","last_change":"2023-08-09T12:53:19.437059+0000","last_active":"2023-08-09T12:53:21.454465+0000","last_peered":"2023-08-09T12:53:21.454465+0000","last_clean":"2023-08-09T12:53:21.454465+0000","last_became_active":"2023-08-09T12:53:19.436429+0000","last_became_peered":"2023-08-09T12:53:19.436429+0000","last_unstale":"2023-08-09T12:53:21.454465+0000","last_undegraded":"2023-08-09T12:53:21.454465+0000","last_fullsized":"2023-08-09T12:53:21.454465+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:07.298975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587884+0000","last_change":"2023-08-09T12:53:20.457498+0000","last_active":"2023-08-09T12:53:21.587884+0000","last_peered":"2023-08-09T12:53:21.587884+0000","last_clean":"2023-08-09T12:53:21.587884+0000","last_became_active":"2023-08-09T12:53:20.455685+0000","last_became_peered":"2023-08-09T12:53:20.455685+0000","last_unstale":"2023-08-09T12:53:21.587884+0000","last_undegraded":"2023-08-09T12:53:21.587884+0000","last_fullsized":"2023-08-09T12:53:21.587884+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:12.902887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586854+0000","last_change":"2023-08-09T12:53:19.433371+0000","last_active":"2023-08-09T12:53:21.586854+0000","last_peered":"2023-08-09T12:53:21.586854+0000","last_clean":"2023-08-09T12:53:21.586854+0000","last_became_active":"2023-08-09T12:53:19.433038+0000","last_became_peered":"2023-08-09T12:53:19.433038+0000","last_unstale":"2023-08-09T12:53:21.586854+0000","last_undegraded":"2023-08-09T12:53:21.586854+0000","last_fullsized":"2023-08-09T12:53:21.586854+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:29.282948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585564+0000","last_change":"2023-08-09T12:53:20.483820+0000","last_active":"2023-08-09T12:53:21.585564+0000","last_peered":"2023-08-09T12:53:21.585564+0000","last_clean":"2023-08-09T12:53:21.585564+0000","last_became_active":"2023-08-09T12:53:20.482568+0000","last_became_peered":"2023-08-09T12:53:20.482568+0000","last_unstale":"2023-08-09T12:53:21.585564+0000","last_undegraded":"2023-08-09T12:53:21.585564+0000","last_fullsized":"2023-08-09T12:53:21.585564+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:04:00.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585917+0000","last_change":"2023-08-09T12:53:19.435416+0000","last_active":"2023-08-09T12:53:21.585917+0000","last_peered":"2023-08-09T12:53:21.585917+0000","last_clean":"2023-08-09T12:53:21.585917+0000","last_became_active":"2023-08-09T12:53:19.434880+0000","last_became_peered":"2023-08-09T12:53:19.434880+0000","last_unstale":"2023-08-09T12:53:21.585917+0000","last_undegraded":"2023-08-09T12:53:21.585917+0000","last_fullsized":"2023-08-09T12:53:21.585917+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:34.275209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450162+0000","last_change":"2023-08-09T12:53:20.480617+0000","last_active":"2023-08-09T12:53:21.450162+0000","last_peered":"2023-08-09T12:53:21.450162+0000","last_clean":"2023-08-09T12:53:21.450162+0000","last_became_active":"2023-08-09T12:53:20.475922+0000","last_became_peered":"2023-08-09T12:53:20.475922+0000","last_unstale":"2023-08-09T12:53:21.450162+0000","last_undegraded":"2023-08-09T12:53:21.450162+0000","last_fullsized":"2023-08-09T12:53:21.450162+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:36:16.933066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.466564+0000","last_change":"2023-08-09T12:53:19.440155+0000","last_active":"2023-08-09T12:53:20.466564+0000","last_peered":"2023-08-09T12:53:20.466564+0000","last_clean":"2023-08-09T12:53:20.466564+0000","last_became_active":"2023-08-09T12:53:19.439868+0000","last_became_peered":"2023-08-09T12:53:19.439868+0000","last_unstale":"2023-08-09T12:53:20.466564+0000","last_undegraded":"2023-08-09T12:53:20.466564+0000","last_fullsized":"2023-08-09T12:53:20.466564+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:52:09.528281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586554+0000","last_change":"2023-08-09T12:53:20.460635+0000","last_active":"2023-08-09T12:53:21.586554+0000","last_peered":"2023-08-09T12:53:21.586554+0000","last_clean":"2023-08-09T12:53:21.586554+0000","last_became_active":"2023-08-09T12:53:20.459490+0000","last_became_peered":"2023-08-09T12:53:20.459490+0000","last_unstale":"2023-08-09T12:53:21.586554+0000","last_undegraded":"2023-08-09T12:53:21.586554+0000","last_fullsized":"2023-08-09T12:53:21.586554+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:49:47.238641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586737+0000","last_change":"2023-08-09T12:53:19.429225+0000","last_active":"2023-08-09T12:53:21.586737+0000","last_peered":"2023-08-09T12:53:21.586737+0000","last_clean":"2023-08-09T12:53:21.586737+0000","last_became_active":"2023-08-09T12:53:19.428610+0000","last_became_peered":"2023-08-09T12:53:19.428610+0000","last_unstale":"2023-08-09T12:53:21.586737+0000","last_undegraded":"2023-08-09T12:53:21.586737+0000","last_fullsized":"2023-08-09T12:53:21.586737+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:23.307400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":504,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586796+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:53:21.586796+0000","last_peered":"2023-08-09T12:53:21.586796+0000","last_clean":"2023-08-09T12:53:21.586796+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:53:21.586796+0000","last_undegraded":"2023-08-09T12:53:21.586796+0000","last_fullsized":"2023-08-09T12:53:21.586796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:23:23.962149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":317,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587802+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:53:21.587802+0000","last_peered":"2023-08-09T12:53:21.587802+0000","last_clean":"2023-08-09T12:53:21.587802+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:53:21.587802+0000","last_undegraded":"2023-08-09T12:53:21.587802+0000","last_fullsized":"2023-08-09T12:53:21.587802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:53:22.930738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585909+0000","last_change":"2023-08-09T12:53:20.487601+0000","last_active":"2023-08-09T12:53:21.585909+0000","last_peered":"2023-08-09T12:53:21.585909+0000","last_clean":"2023-08-09T12:53:21.585909+0000","last_became_active":"2023-08-09T12:53:20.487244+0000","last_became_peered":"2023-08-09T12:53:20.487244+0000","last_unstale":"2023-08-09T12:53:21.585909+0000","last_undegraded":"2023-08-09T12:53:21.585909+0000","last_fullsized":"2023-08-09T12:53:21.585909+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:58:02.126812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"190'3","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454228+0000","last_change":"2023-08-09T12:53:19.438195+0000","last_active":"2023-08-09T12:53:21.454228+0000","last_peered":"2023-08-09T12:53:21.454228+0000","last_clean":"2023-08-09T12:53:21.454228+0000","last_became_active":"2023-08-09T12:53:19.436897+0000","last_became_peered":"2023-08-09T12:53:19.436897+0000","last_unstale":"2023-08-09T12:53:21.454228+0000","last_undegraded":"2023-08-09T12:53:21.454228+0000","last_fullsized":"2023-08-09T12:53:21.454228+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:06.165085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":348,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586165+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:53:21.586165+0000","last_peered":"2023-08-09T12:53:21.586165+0000","last_clean":"2023-08-09T12:53:21.586165+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:53:21.586165+0000","last_undegraded":"2023-08-09T12:53:21.586165+0000","last_fullsized":"2023-08-09T12:53:21.586165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:34:43.460502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450159+0000","last_change":"2023-08-09T12:53:20.478943+0000","last_active":"2023-08-09T12:53:21.450159+0000","last_peered":"2023-08-09T12:53:21.450159+0000","last_clean":"2023-08-09T12:53:21.450159+0000","last_became_active":"2023-08-09T12:53:20.478636+0000","last_became_peered":"2023-08-09T12:53:20.478636+0000","last_unstale":"2023-08-09T12:53:21.450159+0000","last_undegraded":"2023-08-09T12:53:21.450159+0000","last_fullsized":"2023-08-09T12:53:21.450159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:26:48.278833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"190'6","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585228+0000","last_change":"2023-08-09T12:53:19.433442+0000","last_active":"2023-08-09T12:53:21.585228+0000","last_peered":"2023-08-09T12:53:21.585228+0000","last_clean":"2023-08-09T12:53:21.585228+0000","last_became_active":"2023-08-09T12:53:19.432526+0000","last_became_peered":"2023-08-09T12:53:19.432526+0000","last_unstale":"2023-08-09T12:53:21.585228+0000","last_undegraded":"2023-08-09T12:53:21.585228+0000","last_fullsized":"2023-08-09T12:53:21.585228+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:29:31.556414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450503+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:53:21.450503+0000","last_peered":"2023-08-09T12:53:21.450503+0000","last_clean":"2023-08-09T12:53:21.450503+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:53:21.450503+0000","last_undegraded":"2023-08-09T12:53:21.450503+0000","last_fullsized":"2023-08-09T12:53:21.450503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:22:26.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585881+0000","last_change":"2023-08-09T12:53:20.460967+0000","last_active":"2023-08-09T12:53:21.585881+0000","last_peered":"2023-08-09T12:53:21.585881+0000","last_clean":"2023-08-09T12:53:21.585881+0000","last_became_active":"2023-08-09T12:53:20.459365+0000","last_became_peered":"2023-08-09T12:53:20.459365+0000","last_unstale":"2023-08-09T12:53:21.585881+0000","last_undegraded":"2023-08-09T12:53:21.585881+0000","last_fullsized":"2023-08-09T12:53:21.585881+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:57.182326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.584963+0000","last_change":"2023-08-09T12:53:19.428109+0000","last_active":"2023-08-09T12:53:21.584963+0000","last_peered":"2023-08-09T12:53:21.584963+0000","last_clean":"2023-08-09T12:53:21.584963+0000","last_became_active":"2023-08-09T12:53:19.427588+0000","last_became_peered":"2023-08-09T12:53:19.427588+0000","last_unstale":"2023-08-09T12:53:21.584963+0000","last_undegraded":"2023-08-09T12:53:21.584963+0000","last_fullsized":"2023-08-09T12:53:21.584963+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:24:57.294454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":317,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587931+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:53:21.587931+0000","last_peered":"2023-08-09T12:53:21.587931+0000","last_clean":"2023-08-09T12:53:21.587931+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:53:21.587931+0000","last_undegraded":"2023-08-09T12:53:21.587931+0000","last_fullsized":"2023-08-09T12:53:21.587931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:09:04.599085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.584936+0000","last_change":"2023-08-09T12:53:20.478954+0000","last_active":"2023-08-09T12:53:21.584936+0000","last_peered":"2023-08-09T12:53:21.584936+0000","last_clean":"2023-08-09T12:53:21.584936+0000","last_became_active":"2023-08-09T12:53:20.478706+0000","last_became_peered":"2023-08-09T12:53:20.478706+0000","last_unstale":"2023-08-09T12:53:21.584936+0000","last_undegraded":"2023-08-09T12:53:21.584936+0000","last_fullsized":"2023-08-09T12:53:21.584936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:49.772672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587403+0000","last_change":"2023-08-09T12:53:19.438787+0000","last_active":"2023-08-09T12:53:21.587403+0000","last_peered":"2023-08-09T12:53:21.587403+0000","last_clean":"2023-08-09T12:53:21.587403+0000","last_became_active":"2023-08-09T12:53:19.438425+0000","last_became_peered":"2023-08-09T12:53:19.438425+0000","last_unstale":"2023-08-09T12:53:21.587403+0000","last_undegraded":"2023-08-09T12:53:21.587403+0000","last_fullsized":"2023-08-09T12:53:21.587403+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:58:01.010853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":315,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.480064+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:53:20.480064+0000","last_peered":"2023-08-09T12:53:20.480064+0000","last_clean":"2023-08-09T12:53:20.480064+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:53:20.480064+0000","last_undegraded":"2023-08-09T12:53:20.480064+0000","last_fullsized":"2023-08-09T12:53:20.480064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:38:22.891520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450217+0000","last_change":"2023-08-09T12:53:20.474361+0000","last_active":"2023-08-09T12:53:21.450217+0000","last_peered":"2023-08-09T12:53:21.450217+0000","last_clean":"2023-08-09T12:53:21.450217+0000","last_became_active":"2023-08-09T12:53:20.472148+0000","last_became_peered":"2023-08-09T12:53:20.472148+0000","last_unstale":"2023-08-09T12:53:21.450217+0000","last_undegraded":"2023-08-09T12:53:21.450217+0000","last_fullsized":"2023-08-09T12:53:21.450217+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:00:43.844866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"190'8","reported_seq":19,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501954+0000","last_change":"2023-08-09T12:53:19.434887+0000","last_active":"2023-08-09T12:53:20.501954+0000","last_peered":"2023-08-09T12:53:20.501954+0000","last_clean":"2023-08-09T12:53:20.501954+0000","last_became_active":"2023-08-09T12:53:19.434588+0000","last_became_peered":"2023-08-09T12:53:19.434588+0000","last_unstale":"2023-08-09T12:53:20.501954+0000","last_undegraded":"2023-08-09T12:53:20.501954+0000","last_fullsized":"2023-08-09T12:53:20.501954+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:52:54.052866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":347,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585744+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:53:21.585744+0000","last_peered":"2023-08-09T12:53:21.585744+0000","last_clean":"2023-08-09T12:53:21.585744+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:53:21.585744+0000","last_undegraded":"2023-08-09T12:53:21.585744+0000","last_fullsized":"2023-08-09T12:53:21.585744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:23:22.426735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586022+0000","last_change":"2023-08-09T12:53:20.466596+0000","last_active":"2023-08-09T12:53:21.586022+0000","last_peered":"2023-08-09T12:53:21.586022+0000","last_clean":"2023-08-09T12:53:21.586022+0000","last_became_active":"2023-08-09T12:53:20.466056+0000","last_became_peered":"2023-08-09T12:53:20.466056+0000","last_unstale":"2023-08-09T12:53:21.586022+0000","last_undegraded":"2023-08-09T12:53:21.586022+0000","last_fullsized":"2023-08-09T12:53:21.586022+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:55:52.052858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"190'2","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501260+0000","last_change":"2023-08-09T12:53:19.438587+0000","last_active":"2023-08-09T12:53:20.501260+0000","last_peered":"2023-08-09T12:53:20.501260+0000","last_clean":"2023-08-09T12:53:20.501260+0000","last_became_active":"2023-08-09T12:53:19.438350+0000","last_became_peered":"2023-08-09T12:53:19.438350+0000","last_unstale":"2023-08-09T12:53:20.501260+0000","last_undegraded":"2023-08-09T12:53:20.501260+0000","last_fullsized":"2023-08-09T12:53:20.501260+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:46:37.053942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":315,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.480202+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:53:20.480202+0000","last_peered":"2023-08-09T12:53:20.480202+0000","last_clean":"2023-08-09T12:53:20.480202+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:53:20.480202+0000","last_undegraded":"2023-08-09T12:53:20.480202+0000","last_fullsized":"2023-08-09T12:53:20.480202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:55:35.898214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.485661+0000","last_change":"2023-08-09T12:53:20.485566+0000","last_active":"2023-08-09T12:53:20.485661+0000","last_peered":"2023-08-09T12:53:20.485661+0000","last_clean":"2023-08-09T12:53:20.485661+0000","last_became_active":"2023-08-09T12:53:20.485258+0000","last_became_peered":"2023-08-09T12:53:20.485258+0000","last_unstale":"2023-08-09T12:53:20.485661+0000","last_undegraded":"2023-08-09T12:53:20.485661+0000","last_fullsized":"2023-08-09T12:53:20.485661+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:52:45.900462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585106+0000","last_change":"2023-08-09T12:53:19.438029+0000","last_active":"2023-08-09T12:53:21.585106+0000","last_peered":"2023-08-09T12:53:21.585106+0000","last_clean":"2023-08-09T12:53:21.585106+0000","last_became_active":"2023-08-09T12:53:19.437795+0000","last_became_peered":"2023-08-09T12:53:19.437795+0000","last_unstale":"2023-08-09T12:53:21.585106+0000","last_undegraded":"2023-08-09T12:53:21.585106+0000","last_fullsized":"2023-08-09T12:53:21.585106+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:18:54.838117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587930+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:53:21.587930+0000","last_peered":"2023-08-09T12:53:21.587930+0000","last_clean":"2023-08-09T12:53:21.587930+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:53:21.587930+0000","last_undegraded":"2023-08-09T12:53:21.587930+0000","last_fullsized":"2023-08-09T12:53:21.587930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:46:37.774203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575020,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193617,"statfs":{"total":200000000,"available":198264490,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.194,"15min":1.1419999999999999},"min":{"1min":0.61899999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.593,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.143,"15min":1.1200000000000001},"min":{"1min":0.83299999999999996,"5min":0.70499999999999996,"15min":0.44500000000000001},"max":{"1min":1.615,"5min":1.7509999999999999,"15min":2.0459999999999998},"last":0.86499999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2350000000000001,"15min":1.1970000000000001},"min":{"1min":0.75600000000000001,"5min":0.628,"15min":0.628},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":2.0859999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2110000000000001,"15min":1.175},"min":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.6579999999999999,"5min":1.778,"15min":1.778},"last":0.93600000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.286,"15min":1.2529999999999999},"min":{"1min":0.82599999999999996,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":1.625,"5min":1.78,"15min":2.1459999999999999},"last":1.367},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2689999999999999,"15min":1.2190000000000001},"min":{"1min":0.871,"5min":0.76900000000000002,"15min":0.69799999999999995},"max":{"1min":1.5169999999999999,"5min":1.6579999999999999,"15min":2.173},"last":1.494}]},{"osd":3,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3240000000000001,"15min":1.2989999999999999},"min":{"1min":0.95599999999999996,"5min":0.78500000000000003,"15min":0.72299999999999998},"max":{"1min":1.6200000000000001,"5min":1.806,"15min":3.4540000000000002},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3120000000000001,"15min":1.3180000000000001},"min":{"1min":0.88600000000000001,"5min":0.754,"15min":0.61599999999999999},"max":{"1min":1.704,"5min":1.71,"15min":2.282},"last":1.097}]},{"osd":4,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2150000000000001,"15min":1.2330000000000001},"min":{"1min":0.878,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.7589999999999999,"5min":1.948,"15min":2.8769999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.3180000000000001,"15min":1.3440000000000001},"min":{"1min":1.054,"5min":0.67000000000000004,"15min":0.58599999999999997},"max":{"1min":1.6200000000000001,"5min":1.7909999999999999,"15min":4.6200000000000001},"last":1.276}]},{"osd":5,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.427,"15min":1.393},"min":{"1min":1.119,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.806,"5min":1.978,"15min":2.802},"last":1.423},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4910000000000001,"15min":1.5069999999999999},"min":{"1min":0.99099999999999999,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.722,"5min":2.1299999999999999,"15min":3.3580000000000001},"last":1.204}]},{"osd":6,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4630000000000001,"15min":1.482},"min":{"1min":1.155,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8260000000000001,"5min":2.2370000000000001,"15min":3.4910000000000001},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.48,"15min":1.486},"min":{"1min":1.1859999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.76,"5min":1.95,"15min":2.4039999999999999},"last":1.4550000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575020,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198854858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.123,"15min":1.139},"min":{"1min":0.73099999999999998,"5min":0.63100000000000001,"15min":0.56399999999999995},"max":{"1min":1.669,"5min":1.669,"15min":2.54},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.171,"15min":1.1160000000000001},"min":{"1min":0.79400000000000004,"5min":0.72099999999999997,"15min":0.54000000000000004},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":2.1629999999999998},"last":1.2030000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.329,"15min":1.27},"min":{"1min":0.90500000000000003,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.722,"5min":1.9219999999999999,"15min":2.306},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.341,"15min":1.335},"min":{"1min":0.98499999999999999,"5min":0.81100000000000005,"15min":0.76800000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.9279999999999999},"last":1.6200000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.218,"15min":1.161},"min":{"1min":0.80900000000000005,"5min":0.74399999999999999,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.137},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.292,"15min":1.294},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.66300000000000003},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":2.6499999999999999},"last":1.28}]},{"osd":3,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.375,"15min":1.327},"min":{"1min":0.96899999999999997,"5min":0.88600000000000001,"15min":0.67600000000000005},"max":{"1min":1.8169999999999999,"5min":1.845,"15min":2.327},"last":1.345},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.3899999999999999,"15min":1.351},"min":{"1min":1.1859999999999999,"5min":0.95799999999999996,"15min":0.74099999999999999},"max":{"1min":1.835,"5min":1.835,"15min":2.5979999999999999},"last":1.431}]},{"osd":4,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3440000000000001,"15min":1.3720000000000001},"min":{"1min":0.94499999999999995,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":11.058999999999999},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.393,"15min":1.3759999999999999},"min":{"1min":1.0289999999999999,"5min":0.94699999999999995,"15min":0.57399999999999995},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.3479999999999999},"last":1.4950000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.3560000000000001,"15min":1.3620000000000001},"min":{"1min":0.99099999999999999,"5min":0.89800000000000002,"15min":0.77600000000000002},"max":{"1min":1.754,"5min":1.96,"15min":2.5249999999999999},"last":1.536},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.496,"15min":1.5089999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.81899999999999995},"max":{"1min":2.077,"5min":2.077,"15min":2.8580000000000001},"last":1.6499999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.544,"15min":1.5189999999999999},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":0.59099999999999997},"max":{"1min":2.093,"5min":2.093,"15min":2.7999999999999998},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.526,"15min":1.514},"min":{"1min":1.159,"5min":1.0469999999999999,"15min":0.74399999999999999},"max":{"1min":2.0739999999999998,"5min":2.1280000000000001,"15min":3.621},"last":1.6679999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575020,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198854734,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1379999999999999,"15min":1.117},"min":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.4810000000000001,"5min":1.609,"15min":3.4060000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.1619999999999999},"min":{"1min":0.80900000000000005,"5min":0.68999999999999995,"15min":0.625},"max":{"1min":1.8460000000000001,"5min":1.97,"15min":2.0600000000000001},"last":1.089}]},{"osd":1,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3759999999999999,"15min":1.341},"min":{"1min":0.98499999999999999,"5min":0.78600000000000003,"15min":0.63800000000000001},"max":{"1min":1.7909999999999999,"5min":1.851,"15min":2.6579999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.355,"15min":1.2969999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.70199999999999996},"max":{"1min":1.7250000000000001,"5min":2.262,"15min":2.262},"last":1.4890000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3029999999999999,"15min":1.248},"min":{"1min":0.95499999999999996,"5min":0.76800000000000002,"15min":0.69799999999999995},"max":{"1min":1.482,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.282,"15min":1.232},"min":{"1min":0.85399999999999998,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.716,"5min":1.7370000000000001,"15min":3.8149999999999999},"last":1.2929999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.304,"15min":1.2769999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.71799999999999997},"max":{"1min":1.5900000000000001,"5min":1.712,"15min":2.2330000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3779999999999999,"15min":1.373},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.78200000000000003},"max":{"1min":1.6579999999999999,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.264}]},{"osd":4,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.294,"15min":1.276},"min":{"1min":0.97799999999999998,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.8009999999999999,"5min":2.169,"15min":4.6920000000000002},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3939999999999999},"min":{"1min":0.93100000000000005,"5min":0.875,"15min":0.628},"max":{"1min":1.7230000000000001,"5min":2.21,"15min":3.3109999999999999},"last":1.577}]},{"osd":6,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4350000000000001,"15min":1.399},"min":{"1min":1.0900000000000001,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":1.669,"5min":2.7719999999999998,"15min":2.952},"last":1.675},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.466,"15min":1.4770000000000001},"min":{"1min":1.0800000000000001,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":5.8570000000000002},"last":1.6259999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.5369999999999999,"15min":1.5309999999999999},"min":{"1min":1.2709999999999999,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":1.8919999999999999,"5min":2.1709999999999998,"15min":3.4590000000000001},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5980000000000001,"15min":1.5720000000000001},"min":{"1min":1.286,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.8340000000000001,"5min":2.8849999999999998,"15min":3.0649999999999999},"last":1.839}]}]},{"osd":4,"up_from":13,"seq":55834575020,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1119,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194193,"statfs":{"total":200000000,"available":198854094,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.1100000000000001,"15min":1.113},"min":{"1min":0.83399999999999996,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.986,"5min":1.986,"15min":2.5670000000000002},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.125,"15min":1.1319999999999999},"min":{"1min":0.85699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":3.4100000000000001},"last":0.79100000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3149999999999999,"15min":1.296},"min":{"1min":0.89400000000000002,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.5549999999999999,"5min":1.863,"15min":2.3679999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.353,"15min":1.3340000000000001},"min":{"1min":1.026,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":1.6319999999999999,"5min":1.8240000000000001,"15min":2.9590000000000001},"last":1.6870000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.347,"15min":1.323},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.54900000000000004},"max":{"1min":1.708,"5min":1.9470000000000001,"15min":2.4729999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.367,"15min":1.351},"min":{"1min":0.996,"5min":0.81499999999999995,"15min":0.67900000000000005},"max":{"1min":1.887,"5min":1.887,"15min":3.0579999999999998},"last":1.2609999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2509999999999999,"15min":1.256},"min":{"1min":0.92900000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.625,"5min":1.728,"15min":3.4430000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.343,"15min":1.3340000000000001},"min":{"1min":1.0760000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6950000000000001,"5min":2.0539999999999998,"15min":2.5289999999999999},"last":1.3779999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.323,"15min":1.3540000000000001},"min":{"1min":0.86599999999999999,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.77,"5min":1.857,"15min":3.137},"last":1.9059999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.3069999999999999,"15min":1.357},"min":{"1min":0.90400000000000003,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":2.403,"15min":3.3620000000000001},"last":1.298}]},{"osd":6,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3460000000000001,"15min":1.417},"min":{"1min":0.90700000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.748,"5min":2.262,"15min":2.5819999999999999},"last":2.0670000000000002},{"interface":"front","average":{"1min":1.478,"5min":1.4930000000000001,"15min":1.524},"min":{"1min":1.034,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.8300000000000001,"5min":2.1070000000000002,"15min":3.3340000000000001},"last":1.5209999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.468,"15min":1.5109999999999999},"min":{"1min":1.046,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.786,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.429},{"interface":"front","average":{"1min":1.5,"5min":1.5600000000000001,"15min":1.5840000000000001},"min":{"1min":1.151,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.758,"5min":2.4590000000000001,"15min":2.875},"last":1.722}]}]},{"osd":3,"up_from":13,"seq":55834575020,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1113,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194198,"statfs":{"total":200000000,"available":198859295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.90700000000000003,"15min":0.877},"min":{"1min":0.66600000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.494,"5min":1.494,"15min":4.4109999999999996},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0529999999999999,"15min":1.0009999999999999},"min":{"1min":0.76900000000000002,"5min":0.38600000000000001,"15min":0.35499999999999998},"max":{"1min":1.4259999999999999,"5min":1.99,"15min":3.2269999999999999},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.94799999999999995,"15min":0.91600000000000004},"min":{"1min":0.80600000000000005,"5min":0.52000000000000002,"15min":0.38100000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":2.1280000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.179,"15min":1.0820000000000001},"min":{"1min":0.86199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.458,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.198,"15min":1.1910000000000001},"min":{"1min":1.099,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0539999999999998,"5min":2.089,"15min":18.145},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.296,"15min":1.236},"min":{"1min":1.034,"5min":0.379,"15min":0.379},"max":{"1min":2.0910000000000002,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.302,"15min":1.304},"min":{"1min":1.0149999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.905,"5min":1.905,"15min":3.5110000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.456,"5min":1.379,"15min":1.3440000000000001},"min":{"1min":1.1639999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.641,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.107}]},{"osd":5,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.49,"15min":1.47},"min":{"1min":1.367,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":1.962,"5min":2.302,"15min":18.094000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.454,"15min":1.4530000000000001},"min":{"1min":1.379,"5min":0.752,"15min":0.69899999999999995},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":14.105},"last":1.004}]},{"osd":6,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.4039999999999999,"15min":1.3839999999999999},"min":{"1min":1.1519999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.7230000000000001,"5min":2.2120000000000002,"15min":3.2789999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.548,"5min":1.5329999999999999,"15min":1.4830000000000001},"min":{"1min":1.3029999999999999,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":1.8029999999999999,"5min":2.3730000000000002,"15min":4.0220000000000002},"last":1.2549999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.5629999999999999,"15min":1.4850000000000001},"min":{"1min":1.4359999999999999,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":2.0129999999999999,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.149},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.5249999999999999,"15min":1.4690000000000001},"min":{"1min":1.268,"5min":0.71799999999999997,"15min":0.70799999999999996},"max":{"1min":2.0750000000000002,"5min":2.3380000000000001,"15min":3.016},"last":1.1240000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198854858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.95099999999999996,"15min":0.89300000000000002},"min":{"1min":0.55900000000000005,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":1.462,"5min":1.673,"15min":1.716},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.022,"15min":0.98299999999999998},"min":{"1min":0.67500000000000004,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.4770000000000001,"5min":1.6970000000000001,"15min":2.9009999999999998},"last":0.74399999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.95399999999999996,"15min":0.93500000000000005},"min":{"1min":0.80600000000000005,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.3859999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.129,"15min":1.0760000000000001},"min":{"1min":0.72399999999999998,"5min":0.48799999999999999,"15min":0.46899999999999997},"max":{"1min":1.589,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1799999999999999,"15min":1.1639999999999999},"min":{"1min":0.92900000000000005,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.7350000000000001,"5min":1.794,"15min":3.2850000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2969999999999999,"15min":1.212},"min":{"1min":0.94199999999999995,"5min":0.53000000000000003,"15min":0.52800000000000002},"max":{"1min":1.758,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":0.72099999999999997}]},{"osd":4,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.504,"15min":1.45},"min":{"1min":1.3560000000000001,"5min":0.93200000000000005,"15min":0.81899999999999995},"max":{"1min":1.899,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4159999999999999,"15min":1.3520000000000001},"min":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.66800000000000004},"max":{"1min":2.109,"5min":2.109,"15min":3.4500000000000002},"last":1.2450000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.4350000000000001,"15min":1.4079999999999999},"min":{"1min":1.089,"5min":0.78900000000000003,"15min":0.69599999999999995},"max":{"1min":1.948,"5min":2.0110000000000001,"15min":5.0140000000000002},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.653,"5min":1.577,"15min":1.508},"min":{"1min":1.4259999999999999,"5min":0.878,"15min":0.78700000000000003},"max":{"1min":1.9079999999999999,"5min":2.133,"15min":4.806},"last":1.163}]},{"osd":6,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.409,"15min":1.3640000000000001},"min":{"1min":0.96199999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.7090000000000001,"5min":1.976,"15min":2.5179999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5229999999999999,"15min":1.466},"min":{"1min":1.1339999999999999,"5min":0.89600000000000002,"15min":0.73399999999999999},"max":{"1min":1.931,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":0.96099999999999997}]},{"osd":7,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4219999999999999},"min":{"1min":1.0089999999999999,"5min":0.80300000000000005,"15min":0.76200000000000001},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":2.464},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.653,"5min":1.5900000000000001,"15min":1.556},"min":{"1min":1.2310000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9990000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.0620000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1113,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194199,"statfs":{"total":200000000,"available":198859899,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.622,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5249999999999999,"5min":1.6859999999999999,"15min":2.621},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0349999999999999,"15min":1.329},"min":{"1min":0.47099999999999997,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.46,"5min":1.6559999999999999,"15min":88.254999999999995},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.016,"15min":0.998},"min":{"1min":0.76000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.837,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.327,"15min":1.248},"min":{"1min":0.55100000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.879,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.0569999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.26,"15min":1.1819999999999999},"min":{"1min":0.503,"5min":0.436,"15min":0.436},"max":{"1min":1.6719999999999999,"5min":2.181,"15min":2.181},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.135,"5min":1.137,"15min":1.089},"min":{"1min":0.57499999999999996,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":1.506,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":0.98599999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2769999999999999,"15min":1.3380000000000001},"min":{"1min":0.83399999999999996,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.921,"5min":1.921,"15min":25.172000000000001},"last":0.87},{"interface":"front","average":{"1min":1.47,"5min":1.4330000000000001,"15min":1.3799999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.76,"5min":2.085,"15min":3.762},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.409,"15min":1.456},"min":{"1min":0.93100000000000005,"5min":0.80100000000000005,"15min":0.751},"max":{"1min":1.6259999999999999,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.294},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.335,"15min":1.327},"min":{"1min":1.129,"5min":0.84599999999999997,"15min":0.77900000000000003},"max":{"1min":1.5589999999999999,"5min":1.9079999999999999,"15min":3.762},"last":1.022}]},{"osd":6,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5640000000000001,"15min":1.5009999999999999},"min":{"1min":1.0289999999999999,"5min":0.93600000000000005,"15min":0.79700000000000004},"max":{"1min":1.873,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.171},{"interface":"front","average":{"1min":1.494,"5min":1.496,"15min":1.4470000000000001},"min":{"1min":1.161,"5min":0.89500000000000002,"15min":0.79500000000000004},"max":{"1min":1.8680000000000001,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.256}]},{"osd":7,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.5820000000000001,"15min":1.637},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.982,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.613,"5min":1.6220000000000001,"15min":1.653},"min":{"1min":1.1359999999999999,"5min":0.92600000000000005,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.464,"15min":28.765000000000001},"last":1.0920000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575020,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1681,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193631,"statfs":{"total":200000000,"available":198278271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90200000000000002,"15min":0.89000000000000001},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.35799999999999998},"max":{"1min":1.538,"5min":1.6259999999999999,"15min":1.819},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.109,"5min":1.0680000000000001,"15min":1.03},"min":{"1min":0.504,"5min":0.437,"15min":0.436},"max":{"1min":1.5720000000000001,"5min":1.661,"15min":6.1749999999999998},"last":1.1379999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.081,"15min":1.0269999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.53,"5min":1.6120000000000001,"15min":1.7669999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.099,"15min":1.083},"min":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":6.2549999999999999},"last":1.28}]},{"osd":3,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.034,"15min":1.0269999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.45300000000000001},"max":{"1min":1.893,"5min":1.893,"15min":9.6069999999999993},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.302,"5min":1.2509999999999999,"15min":1.212},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.56000000000000005},"max":{"1min":1.7130000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.028}]},{"osd":4,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.391,"15min":1.3640000000000001},"min":{"1min":0.98899999999999999,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":2.286,"5min":2.286,"15min":9.9629999999999992},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.417,"15min":1.361},"min":{"1min":1.085,"5min":0.85799999999999998,"15min":0.77900000000000003},"max":{"1min":1.7649999999999999,"5min":1.825,"15min":1.879},"last":1.2350000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.3740000000000001,"15min":1.359},"min":{"1min":0.90300000000000002,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":1.8,"5min":1.8200000000000001,"15min":10.004},"last":1.099},{"interface":"front","average":{"1min":1.516,"5min":1.4830000000000001,"15min":1.431},"min":{"1min":0.95999999999999996,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.857,"5min":2.1419999999999999,"15min":2.161},"last":0.92200000000000004}]},{"osd":6,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4339999999999999,"15min":1.4079999999999999},"min":{"1min":0.94299999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6839999999999999,"5min":2.1230000000000002,"15min":6.4290000000000003},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.486,"15min":1.474},"min":{"1min":1.0529999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":9.9190000000000005},"last":1.194}]},{"osd":7,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.486,"15min":1.4970000000000001},"min":{"1min":0.89200000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8380000000000001,"5min":2.2160000000000002,"15min":18.114000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.548,"15min":1.528},"min":{"1min":1.1220000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":9.5640000000000001},"last":1.411}]}]}],"pool_statfs":[]}} 2023-08-09T12:53:24.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:53:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.261+0000 7f3d875b7640 1 Processor -- start 2023-08-09T12:53:25.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.261+0000 7f3d875b7640 1 -- start start 2023-08-09T12:53:25.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.262+0000 7f3d875b7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3d800adc40 0x7f3d8006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.262+0000 7f3d875b7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800b2250 con 0x7f3d800cc630 2023-08-09T12:53:25.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.262+0000 7f3d875b7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800b2530 con 0x7f3d800b3b40 2023-08-09T12:53:25.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.262+0000 7f3d875b7640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800ae020 con 0x7f3d800adc40 2023-08-09T12:53:25.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.262+0000 7f3d85353640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3d800adc40 0x7f3d8006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.262+0000 7f3d85b54640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3d800cc630 0x7f3d800ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49010/0 (socket says 172.21.15.17:49010) 2023-08-09T12:53:25.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.262+0000 7f3d85b54640 1 -- 172.21.15.17:0/1251179469 learned_addr learned my addr 172.21.15.17:0/1251179469 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.263+0000 7f3d85353640 1 -- 172.21.15.17:0/1251179469 >> v1:172.21.15.142:6789/0 conn(0x7f3d800b3b40 legacy=0x7f3d800b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.263+0000 7f3d85353640 1 -- 172.21.15.17:0/1251179469 >> v1:172.21.15.17:6789/0 conn(0x7f3d800cc630 legacy=0x7f3d800ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.263+0000 7f3d85353640 1 -- 172.21.15.17:0/1251179469 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8006fe80 con 0x7f3d800adc40 2023-08-09T12:53:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.263+0000 7f3d77fff640 1 -- 172.21.15.17:0/1251179469 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345390894 0 0) 0x7f3d800b2250 con 0x7f3d800cc630 2023-08-09T12:53:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.264+0000 7f3d85353640 1 --2- 172.21.15.17:0/1251179469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800adc40 0x7f3d8006c280 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d5a389ac73aca0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d77fff640 1 -- 172.21.15.17:0/1251179469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c02cc60 con 0x7f3d800adc40 2023-08-09T12:53:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d77fff640 1 -- 172.21.15.17:0/1251179469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c02cdc0 con 0x7f3d800adc40 2023-08-09T12:53:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d77fff640 1 -- 172.21.15.17:0/1251179469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c034660 con 0x7f3d800adc40 2023-08-09T12:53:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d875b7640 1 -- 172.21.15.17:0/1251179469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800adc40 msgr2=0x7f3d8006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d875b7640 1 --2- 172.21.15.17:0/1251179469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800adc40 0x7f3d8006c280 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c02beb0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d875b7640 1 -- 172.21.15.17:0/1251179469 shutdown_connections 2023-08-09T12:53:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d875b7640 1 --2- 172.21.15.17:0/1251179469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800adc40 0x7f3d8006c280 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d875b7640 1 -- 172.21.15.17:0/1251179469 >> 172.21.15.17:0/1251179469 conn(0x7f3d800cb1b0 msgr2=0x7f3d800cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:25.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d875b7640 1 -- 172.21.15.17:0/1251179469 shutdown_connections 2023-08-09T12:53:25.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.265+0000 7f3d875b7640 1 -- 172.21.15.17:0/1251179469 wait complete. 2023-08-09T12:53:25.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.267+0000 7f3d875b7640 1 Processor -- start 2023-08-09T12:53:25.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.267+0000 7f3d875b7640 1 -- start start 2023-08-09T12:53:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.268+0000 7f3d875b7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d800adc40 0x7f3d800c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.268+0000 7f3d875b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d800b3b40 0x7f3d800c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.268+0000 7f3d875b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800cc630 0x7f3d800c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.268+0000 7f3d875b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800c78e0 con 0x7f3d800cc630 2023-08-09T12:53:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.268+0000 7f3d875b7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800c64b0 con 0x7f3d800b3b40 2023-08-09T12:53:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.268+0000 7f3d875b7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800c9e60 con 0x7f3d800adc40 2023-08-09T12:53:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85b54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800cc630 0x7f3d800c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85b54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800cc630 0x7f3d800c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46218/0 (socket says 172.21.15.17:46218) 2023-08-09T12:53:25.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85b54640 1 -- 172.21.15.17:0/2617956687 learned_addr learned my addr 172.21.15.17:0/2617956687 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:25.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85353640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d800adc40 0x7f3d800c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d84b52640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d800b3b40 0x7f3d800c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85b54640 1 -- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d800adc40 msgr2=0x7f3d800c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85b54640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d800adc40 0x7f3d800c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85b54640 1 -- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d800b3b40 msgr2=0x7f3d800c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85b54640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d800b3b40 0x7f3d800c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.269+0000 7f3d85b54640 1 -- 172.21.15.17:0/2617956687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c009a70 con 0x7f3d800cc630 2023-08-09T12:53:25.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.270+0000 7f3d85b54640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800cc630 0x7f3d800c4690 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f3d78001eb0 tx=0x7f3d7800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:25.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.270+0000 7f3d75ffb640 1 -- 172.21.15.17:0/2617956687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780074e0 con 0x7f3d800cc630 2023-08-09T12:53:25.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.270+0000 7f3d75ffb640 1 -- 172.21.15.17:0/2617956687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78007640 con 0x7f3d800cc630 2023-08-09T12:53:25.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.270+0000 7f3d75ffb640 1 -- 172.21.15.17:0/2617956687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78004a00 con 0x7f3d800cc630 2023-08-09T12:53:25.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.270+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d800ca140 con 0x7f3d800cc630 2023-08-09T12:53:25.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.270+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8015cd80 con 0x7f3d800cc630 2023-08-09T12:53:25.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.271+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d80067a80 con 0x7f3d800cc630 2023-08-09T12:53:25.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.272+0000 7f3d75ffb640 1 -- 172.21.15.17:0/2617956687 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d78004b60 con 0x7f3d800cc630 2023-08-09T12:53:25.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.273+0000 7f3d75ffb640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d6406a050 0x7f3d6406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.274+0000 7f3d75ffb640 1 -- 172.21.15.17:0/2617956687 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d78088360 con 0x7f3d800cc630 2023-08-09T12:53:25.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.274+0000 7f3d85353640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d6406a050 0x7f3d6406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.275+0000 7f3d85353640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d6406a050 0x7f3d6406c510 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c036000 tx=0x7f3d7c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.278+0000 7f3d75ffb640 1 -- 172.21.15.17:0/2617956687 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3d78057440 con 0x7f3d800cc630 2023-08-09T12:53:25.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.468+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d800664f0 con 0x7f3d6406a050 2023-08-09T12:53:25.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.492+0000 7f3d75ffb640 1 -- 172.21.15.17:0/2617956687 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+302987 (secure 0 0 0) 0x7f3d800664f0 con 0x7f3d6406a050 2023-08-09T12:53:25.497 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:25.502 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:53:25.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.499+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d6406a050 msgr2=0x7f3d6406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.499+0000 7f3d875b7640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d6406a050 0x7f3d6406c510 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c036000 tx=0x7f3d7c030000 comp rx=0 tx=0).stop 2023-08-09T12:53:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.499+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800cc630 msgr2=0x7f3d800c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.499+0000 7f3d875b7640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800cc630 0x7f3d800c4690 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f3d78001eb0 tx=0x7f3d7800c870 comp rx=0 tx=0).stop 2023-08-09T12:53:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.500+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 shutdown_connections 2023-08-09T12:53:25.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.500+0000 7f3d875b7640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3d6406a050 0x7f3d6406c510 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.500+0000 7f3d875b7640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d800cc630 0x7f3d800c4690 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.500+0000 7f3d875b7640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d800b3b40 0x7f3d800c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.500+0000 7f3d875b7640 1 --2- 172.21.15.17:0/2617956687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d800adc40 0x7f3d800c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.500+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 >> 172.21.15.17:0/2617956687 conn(0x7f3d800cb1b0 msgr2=0x7f3d800ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:25.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.500+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 shutdown_connections 2023-08-09T12:53:25.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.500+0000 7f3d875b7640 1 -- 172.21.15.17:0/2617956687 wait complete. 2023-08-09T12:53:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":611,"stamp":"2023-08-09T12:53:24.959950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10077,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552422,"statfs":{"total":1600000000,"available":1589680499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002086"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454315+0000","last_change":"2023-08-09T12:53:20.471874+0000","last_active":"2023-08-09T12:53:21.454315+0000","last_peered":"2023-08-09T12:53:21.454315+0000","last_clean":"2023-08-09T12:53:21.454315+0000","last_became_active":"2023-08-09T12:53:20.471487+0000","last_became_peered":"2023-08-09T12:53:20.471487+0000","last_unstale":"2023-08-09T12:53:21.454315+0000","last_undegraded":"2023-08-09T12:53:21.454315+0000","last_fullsized":"2023-08-09T12:53:21.454315+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:05:07.299880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585548+0000","last_change":"2023-08-09T12:53:20.475921+0000","last_active":"2023-08-09T12:53:21.585548+0000","last_peered":"2023-08-09T12:53:21.585548+0000","last_clean":"2023-08-09T12:53:21.585548+0000","last_became_active":"2023-08-09T12:53:20.475633+0000","last_became_peered":"2023-08-09T12:53:20.475633+0000","last_unstale":"2023-08-09T12:53:21.585548+0000","last_undegraded":"2023-08-09T12:53:21.585548+0000","last_fullsized":"2023-08-09T12:53:21.585548+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:44:23.545370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453607+0000","last_change":"2023-08-09T12:53:20.472782+0000","last_active":"2023-08-09T12:53:21.453607+0000","last_peered":"2023-08-09T12:53:21.453607+0000","last_clean":"2023-08-09T12:53:21.453607+0000","last_became_active":"2023-08-09T12:53:20.472449+0000","last_became_peered":"2023-08-09T12:53:20.472449+0000","last_unstale":"2023-08-09T12:53:21.453607+0000","last_undegraded":"2023-08-09T12:53:21.453607+0000","last_fullsized":"2023-08-09T12:53:21.453607+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:58:07.993487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453181+0000","last_change":"2023-08-09T12:53:20.473373+0000","last_active":"2023-08-09T12:53:21.453181+0000","last_peered":"2023-08-09T12:53:21.453181+0000","last_clean":"2023-08-09T12:53:21.453181+0000","last_became_active":"2023-08-09T12:53:20.472974+0000","last_became_peered":"2023-08-09T12:53:20.472974+0000","last_unstale":"2023-08-09T12:53:21.453181+0000","last_undegraded":"2023-08-09T12:53:21.453181+0000","last_fullsized":"2023-08-09T12:53:21.453181+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:02:25.748263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.479268+0000","last_change":"2023-08-09T12:53:20.479015+0000","last_active":"2023-08-09T12:53:20.479268+0000","last_peered":"2023-08-09T12:53:20.479268+0000","last_clean":"2023-08-09T12:53:20.479268+0000","last_became_active":"2023-08-09T12:53:20.478409+0000","last_became_peered":"2023-08-09T12:53:20.478409+0000","last_unstale":"2023-08-09T12:53:20.479268+0000","last_undegraded":"2023-08-09T12:53:20.479268+0000","last_fullsized":"2023-08-09T12:53:20.479268+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:46:58.942510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587548+0000","last_change":"2023-08-09T12:53:20.473869+0000","last_active":"2023-08-09T12:53:21.587548+0000","last_peered":"2023-08-09T12:53:21.587548+0000","last_clean":"2023-08-09T12:53:21.587548+0000","last_became_active":"2023-08-09T12:53:20.473472+0000","last_became_peered":"2023-08-09T12:53:20.473472+0000","last_unstale":"2023-08-09T12:53:21.587548+0000","last_undegraded":"2023-08-09T12:53:21.587548+0000","last_fullsized":"2023-08-09T12:53:21.587548+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:42:20.996772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.483264+0000","last_change":"2023-08-09T12:53:20.483150+0000","last_active":"2023-08-09T12:53:20.483264+0000","last_peered":"2023-08-09T12:53:20.483264+0000","last_clean":"2023-08-09T12:53:20.483264+0000","last_became_active":"2023-08-09T12:53:20.482662+0000","last_became_peered":"2023-08-09T12:53:20.482662+0000","last_unstale":"2023-08-09T12:53:20.483264+0000","last_undegraded":"2023-08-09T12:53:20.483264+0000","last_fullsized":"2023-08-09T12:53:20.483264+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:49:29.440137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.485567+0000","last_change":"2023-08-09T12:53:20.485417+0000","last_active":"2023-08-09T12:53:20.485567+0000","last_peered":"2023-08-09T12:53:20.485567+0000","last_clean":"2023-08-09T12:53:20.485567+0000","last_became_active":"2023-08-09T12:53:20.484512+0000","last_became_peered":"2023-08-09T12:53:20.484512+0000","last_unstale":"2023-08-09T12:53:20.485567+0000","last_undegraded":"2023-08-09T12:53:20.485567+0000","last_fullsized":"2023-08-09T12:53:20.485567+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:21:51.033838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.482957+0000","last_change":"2023-08-09T12:53:20.482686+0000","last_active":"2023-08-09T12:53:20.482957+0000","last_peered":"2023-08-09T12:53:20.482957+0000","last_clean":"2023-08-09T12:53:20.482957+0000","last_became_active":"2023-08-09T12:53:20.481292+0000","last_became_peered":"2023-08-09T12:53:20.481292+0000","last_unstale":"2023-08-09T12:53:20.482957+0000","last_undegraded":"2023-08-09T12:53:20.482957+0000","last_fullsized":"2023-08-09T12:53:20.482957+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:37:13.038267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.482975+0000","last_change":"2023-08-09T12:53:20.482796+0000","last_active":"2023-08-09T12:53:20.482975+0000","last_peered":"2023-08-09T12:53:20.482975+0000","last_clean":"2023-08-09T12:53:20.482975+0000","last_became_active":"2023-08-09T12:53:20.482087+0000","last_became_peered":"2023-08-09T12:53:20.482087+0000","last_unstale":"2023-08-09T12:53:20.482975+0000","last_undegraded":"2023-08-09T12:53:20.482975+0000","last_fullsized":"2023-08-09T12:53:20.482975+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:55:22.502248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586690+0000","last_change":"2023-08-09T12:53:20.486030+0000","last_active":"2023-08-09T12:53:21.586690+0000","last_peered":"2023-08-09T12:53:21.586690+0000","last_clean":"2023-08-09T12:53:21.586690+0000","last_became_active":"2023-08-09T12:53:20.485475+0000","last_became_peered":"2023-08-09T12:53:20.485475+0000","last_unstale":"2023-08-09T12:53:21.586690+0000","last_undegraded":"2023-08-09T12:53:21.586690+0000","last_fullsized":"2023-08-09T12:53:21.586690+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:57:30.273892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586606+0000","last_change":"2023-08-09T12:53:20.475286+0000","last_active":"2023-08-09T12:53:21.586606+0000","last_peered":"2023-08-09T12:53:21.586606+0000","last_clean":"2023-08-09T12:53:21.586606+0000","last_became_active":"2023-08-09T12:53:20.474432+0000","last_became_peered":"2023-08-09T12:53:20.474432+0000","last_unstale":"2023-08-09T12:53:21.586606+0000","last_undegraded":"2023-08-09T12:53:21.586606+0000","last_fullsized":"2023-08-09T12:53:21.586606+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:02:26.922724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586274+0000","last_change":"2023-08-09T12:53:20.462620+0000","last_active":"2023-08-09T12:53:21.586274+0000","last_peered":"2023-08-09T12:53:21.586274+0000","last_clean":"2023-08-09T12:53:21.586274+0000","last_became_active":"2023-08-09T12:53:20.460781+0000","last_became_peered":"2023-08-09T12:53:20.460781+0000","last_unstale":"2023-08-09T12:53:21.586274+0000","last_undegraded":"2023-08-09T12:53:21.586274+0000","last_fullsized":"2023-08-09T12:53:21.586274+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:40:10.709480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.484164+0000","last_change":"2023-08-09T12:53:20.481875+0000","last_active":"2023-08-09T12:53:20.484164+0000","last_peered":"2023-08-09T12:53:20.484164+0000","last_clean":"2023-08-09T12:53:20.484164+0000","last_became_active":"2023-08-09T12:53:20.481369+0000","last_became_peered":"2023-08-09T12:53:20.481369+0000","last_unstale":"2023-08-09T12:53:20.484164+0000","last_undegraded":"2023-08-09T12:53:20.484164+0000","last_fullsized":"2023-08-09T12:53:20.484164+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:40:13.470256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586444+0000","last_change":"2023-08-09T12:53:20.484560+0000","last_active":"2023-08-09T12:53:21.586444+0000","last_peered":"2023-08-09T12:53:21.586444+0000","last_clean":"2023-08-09T12:53:21.586444+0000","last_became_active":"2023-08-09T12:53:20.484236+0000","last_became_peered":"2023-08-09T12:53:20.484236+0000","last_unstale":"2023-08-09T12:53:21.586444+0000","last_undegraded":"2023-08-09T12:53:21.586444+0000","last_fullsized":"2023-08-09T12:53:21.586444+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:43:16.136269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453752+0000","last_change":"2023-08-09T12:53:20.477514+0000","last_active":"2023-08-09T12:53:21.453752+0000","last_peered":"2023-08-09T12:53:21.453752+0000","last_clean":"2023-08-09T12:53:21.453752+0000","last_became_active":"2023-08-09T12:53:20.476739+0000","last_became_peered":"2023-08-09T12:53:20.476739+0000","last_unstale":"2023-08-09T12:53:21.453752+0000","last_undegraded":"2023-08-09T12:53:21.453752+0000","last_fullsized":"2023-08-09T12:53:21.453752+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:18:47.927161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.483224+0000","last_change":"2023-08-09T12:53:20.482930+0000","last_active":"2023-08-09T12:53:20.483224+0000","last_peered":"2023-08-09T12:53:20.483224+0000","last_clean":"2023-08-09T12:53:20.483224+0000","last_became_active":"2023-08-09T12:53:20.480847+0000","last_became_peered":"2023-08-09T12:53:20.480847+0000","last_unstale":"2023-08-09T12:53:20.483224+0000","last_undegraded":"2023-08-09T12:53:20.483224+0000","last_fullsized":"2023-08-09T12:53:20.483224+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:23:05.740596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585161+0000","last_change":"2023-08-09T12:53:20.486208+0000","last_active":"2023-08-09T12:53:21.585161+0000","last_peered":"2023-08-09T12:53:21.585161+0000","last_clean":"2023-08-09T12:53:21.585161+0000","last_became_active":"2023-08-09T12:53:20.485696+0000","last_became_peered":"2023-08-09T12:53:20.485696+0000","last_unstale":"2023-08-09T12:53:21.585161+0000","last_undegraded":"2023-08-09T12:53:21.585161+0000","last_fullsized":"2023-08-09T12:53:21.585161+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:37:01.857043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.584596+0000","last_change":"2023-08-09T12:53:20.482325+0000","last_active":"2023-08-09T12:53:21.584596+0000","last_peered":"2023-08-09T12:53:21.584596+0000","last_clean":"2023-08-09T12:53:21.584596+0000","last_became_active":"2023-08-09T12:53:20.482119+0000","last_became_peered":"2023-08-09T12:53:20.482119+0000","last_unstale":"2023-08-09T12:53:21.584596+0000","last_undegraded":"2023-08-09T12:53:21.584596+0000","last_fullsized":"2023-08-09T12:53:21.584596+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:20.313282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450462+0000","last_change":"2023-08-09T12:53:20.472744+0000","last_active":"2023-08-09T12:53:21.450462+0000","last_peered":"2023-08-09T12:53:21.450462+0000","last_clean":"2023-08-09T12:53:21.450462+0000","last_became_active":"2023-08-09T12:53:20.472268+0000","last_became_peered":"2023-08-09T12:53:20.472268+0000","last_unstale":"2023-08-09T12:53:21.450462+0000","last_undegraded":"2023-08-09T12:53:21.450462+0000","last_fullsized":"2023-08-09T12:53:21.450462+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:03:56.844420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.584828+0000","last_change":"2023-08-09T12:53:20.476624+0000","last_active":"2023-08-09T12:53:21.584828+0000","last_peered":"2023-08-09T12:53:21.584828+0000","last_clean":"2023-08-09T12:53:21.584828+0000","last_became_active":"2023-08-09T12:53:20.476126+0000","last_became_peered":"2023-08-09T12:53:20.476126+0000","last_unstale":"2023-08-09T12:53:21.584828+0000","last_undegraded":"2023-08-09T12:53:21.584828+0000","last_fullsized":"2023-08-09T12:53:21.584828+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:35.814126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585878+0000","last_change":"2023-08-09T12:53:20.474937+0000","last_active":"2023-08-09T12:53:21.585878+0000","last_peered":"2023-08-09T12:53:21.585878+0000","last_clean":"2023-08-09T12:53:21.585878+0000","last_became_active":"2023-08-09T12:53:20.473451+0000","last_became_peered":"2023-08-09T12:53:20.473451+0000","last_unstale":"2023-08-09T12:53:21.585878+0000","last_undegraded":"2023-08-09T12:53:21.585878+0000","last_fullsized":"2023-08-09T12:53:21.585878+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:02.962955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.470492+0000","last_change":"2023-08-09T12:53:20.469974+0000","last_active":"2023-08-09T12:53:20.470492+0000","last_peered":"2023-08-09T12:53:20.470492+0000","last_clean":"2023-08-09T12:53:20.470492+0000","last_became_active":"2023-08-09T12:53:20.469338+0000","last_became_peered":"2023-08-09T12:53:20.469338+0000","last_unstale":"2023-08-09T12:53:20.470492+0000","last_undegraded":"2023-08-09T12:53:20.470492+0000","last_fullsized":"2023-08-09T12:53:20.470492+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:36:55.304374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453572+0000","last_change":"2023-08-09T12:53:20.473224+0000","last_active":"2023-08-09T12:53:21.453572+0000","last_peered":"2023-08-09T12:53:21.453572+0000","last_clean":"2023-08-09T12:53:21.453572+0000","last_became_active":"2023-08-09T12:53:20.472621+0000","last_became_peered":"2023-08-09T12:53:20.472621+0000","last_unstale":"2023-08-09T12:53:21.453572+0000","last_undegraded":"2023-08-09T12:53:21.453572+0000","last_fullsized":"2023-08-09T12:53:21.453572+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:10:32.850588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585428+0000","last_change":"2023-08-09T12:53:20.482872+0000","last_active":"2023-08-09T12:53:21.585428+0000","last_peered":"2023-08-09T12:53:21.585428+0000","last_clean":"2023-08-09T12:53:21.585428+0000","last_became_active":"2023-08-09T12:53:20.481772+0000","last_became_peered":"2023-08-09T12:53:20.481772+0000","last_unstale":"2023-08-09T12:53:21.585428+0000","last_undegraded":"2023-08-09T12:53:21.585428+0000","last_fullsized":"2023-08-09T12:53:21.585428+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:05:45.190855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.449981+0000","last_change":"2023-08-09T12:53:20.477187+0000","last_active":"2023-08-09T12:53:21.449981+0000","last_peered":"2023-08-09T12:53:21.449981+0000","last_clean":"2023-08-09T12:53:21.449981+0000","last_became_active":"2023-08-09T12:53:20.476767+0000","last_became_peered":"2023-08-09T12:53:20.476767+0000","last_unstale":"2023-08-09T12:53:21.449981+0000","last_undegraded":"2023-08-09T12:53:21.449981+0000","last_fullsized":"2023-08-09T12:53:21.449981+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:28:52.878529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586242+0000","last_change":"2023-08-09T12:53:20.474761+0000","last_active":"2023-08-09T12:53:21.586242+0000","last_peered":"2023-08-09T12:53:21.586242+0000","last_clean":"2023-08-09T12:53:21.586242+0000","last_became_active":"2023-08-09T12:53:20.472858+0000","last_became_peered":"2023-08-09T12:53:20.472858+0000","last_unstale":"2023-08-09T12:53:21.586242+0000","last_undegraded":"2023-08-09T12:53:21.586242+0000","last_fullsized":"2023-08-09T12:53:21.586242+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:35:02.248627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585553+0000","last_change":"2023-08-09T12:53:20.477579+0000","last_active":"2023-08-09T12:53:21.585553+0000","last_peered":"2023-08-09T12:53:21.585553+0000","last_clean":"2023-08-09T12:53:21.585553+0000","last_became_active":"2023-08-09T12:53:20.476945+0000","last_became_peered":"2023-08-09T12:53:20.476945+0000","last_unstale":"2023-08-09T12:53:21.585553+0000","last_undegraded":"2023-08-09T12:53:21.585553+0000","last_fullsized":"2023-08-09T12:53:21.585553+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:51:47.458871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585525+0000","last_change":"2023-08-09T12:53:20.483209+0000","last_active":"2023-08-09T12:53:21.585525+0000","last_peered":"2023-08-09T12:53:21.585525+0000","last_clean":"2023-08-09T12:53:21.585525+0000","last_became_active":"2023-08-09T12:53:20.482764+0000","last_became_peered":"2023-08-09T12:53:20.482764+0000","last_unstale":"2023-08-09T12:53:21.585525+0000","last_undegraded":"2023-08-09T12:53:21.585525+0000","last_fullsized":"2023-08-09T12:53:21.585525+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:22:42.827047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586515+0000","last_change":"2023-08-09T12:53:20.471285+0000","last_active":"2023-08-09T12:53:21.586515+0000","last_peered":"2023-08-09T12:53:21.586515+0000","last_clean":"2023-08-09T12:53:21.586515+0000","last_became_active":"2023-08-09T12:53:20.470899+0000","last_became_peered":"2023-08-09T12:53:20.470899+0000","last_unstale":"2023-08-09T12:53:21.586515+0000","last_undegraded":"2023-08-09T12:53:21.586515+0000","last_fullsized":"2023-08-09T12:53:21.586515+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:55:13.835954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587018+0000","last_change":"2023-08-09T12:53:20.478134+0000","last_active":"2023-08-09T12:53:21.587018+0000","last_peered":"2023-08-09T12:53:21.587018+0000","last_clean":"2023-08-09T12:53:21.587018+0000","last_became_active":"2023-08-09T12:53:20.477816+0000","last_became_peered":"2023-08-09T12:53:20.477816+0000","last_unstale":"2023-08-09T12:53:21.587018+0000","last_undegraded":"2023-08-09T12:53:21.587018+0000","last_fullsized":"2023-08-09T12:53:21.587018+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:25:29.718045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587719+0000","last_change":"2023-08-09T12:53:20.461725+0000","last_active":"2023-08-09T12:53:21.587719+0000","last_peered":"2023-08-09T12:53:21.587719+0000","last_clean":"2023-08-09T12:53:21.587719+0000","last_became_active":"2023-08-09T12:53:20.459951+0000","last_became_peered":"2023-08-09T12:53:20.459951+0000","last_unstale":"2023-08-09T12:53:21.587719+0000","last_undegraded":"2023-08-09T12:53:21.587719+0000","last_fullsized":"2023-08-09T12:53:21.587719+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:09:22.748162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585546+0000","last_change":"2023-08-09T12:53:20.459570+0000","last_active":"2023-08-09T12:53:21.585546+0000","last_peered":"2023-08-09T12:53:21.585546+0000","last_clean":"2023-08-09T12:53:21.585546+0000","last_became_active":"2023-08-09T12:53:20.458850+0000","last_became_peered":"2023-08-09T12:53:20.458850+0000","last_unstale":"2023-08-09T12:53:21.585546+0000","last_undegraded":"2023-08-09T12:53:21.585546+0000","last_fullsized":"2023-08-09T12:53:21.585546+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:19:46.761600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"190'4","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454010+0000","last_change":"2023-08-09T12:53:19.437231+0000","last_active":"2023-08-09T12:53:21.454010+0000","last_peered":"2023-08-09T12:53:21.454010+0000","last_clean":"2023-08-09T12:53:21.454010+0000","last_became_active":"2023-08-09T12:53:19.436408+0000","last_became_peered":"2023-08-09T12:53:19.436408+0000","last_unstale":"2023-08-09T12:53:21.454010+0000","last_undegraded":"2023-08-09T12:53:21.454010+0000","last_fullsized":"2023-08-09T12:53:21.454010+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:17:18.727782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586609+0000","last_change":"2023-08-09T12:53:20.461088+0000","last_active":"2023-08-09T12:53:21.586609+0000","last_peered":"2023-08-09T12:53:21.586609+0000","last_clean":"2023-08-09T12:53:21.586609+0000","last_became_active":"2023-08-09T12:53:20.460401+0000","last_became_peered":"2023-08-09T12:53:20.460401+0000","last_unstale":"2023-08-09T12:53:21.586609+0000","last_undegraded":"2023-08-09T12:53:21.586609+0000","last_fullsized":"2023-08-09T12:53:21.586609+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:59:39.038251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"190'1","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.502491+0000","last_change":"2023-08-09T12:53:19.439621+0000","last_active":"2023-08-09T12:53:20.502491+0000","last_peered":"2023-08-09T12:53:20.502491+0000","last_clean":"2023-08-09T12:53:20.502491+0000","last_became_active":"2023-08-09T12:53:19.438880+0000","last_became_peered":"2023-08-09T12:53:19.438880+0000","last_unstale":"2023-08-09T12:53:20.502491+0000","last_undegraded":"2023-08-09T12:53:20.502491+0000","last_fullsized":"2023-08-09T12:53:20.502491+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:29:57.675335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.467367+0000","last_change":"2023-08-09T12:53:20.467100+0000","last_active":"2023-08-09T12:53:20.467367+0000","last_peered":"2023-08-09T12:53:20.467367+0000","last_clean":"2023-08-09T12:53:20.467367+0000","last_became_active":"2023-08-09T12:53:20.466464+0000","last_became_peered":"2023-08-09T12:53:20.466464+0000","last_unstale":"2023-08-09T12:53:20.467367+0000","last_undegraded":"2023-08-09T12:53:20.467367+0000","last_fullsized":"2023-08-09T12:53:20.467367+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:44:28.041897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586787+0000","last_change":"2023-08-09T12:53:19.437813+0000","last_active":"2023-08-09T12:53:21.586787+0000","last_peered":"2023-08-09T12:53:21.586787+0000","last_clean":"2023-08-09T12:53:21.586787+0000","last_became_active":"2023-08-09T12:53:19.437562+0000","last_became_peered":"2023-08-09T12:53:19.437562+0000","last_unstale":"2023-08-09T12:53:21.586787+0000","last_undegraded":"2023-08-09T12:53:21.586787+0000","last_fullsized":"2023-08-09T12:53:21.586787+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:03:43.459193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587347+0000","last_change":"2023-08-09T12:53:20.461367+0000","last_active":"2023-08-09T12:53:21.587347+0000","last_peered":"2023-08-09T12:53:21.587347+0000","last_clean":"2023-08-09T12:53:21.587347+0000","last_became_active":"2023-08-09T12:53:20.460315+0000","last_became_peered":"2023-08-09T12:53:20.460315+0000","last_unstale":"2023-08-09T12:53:21.587347+0000","last_undegraded":"2023-08-09T12:53:21.587347+0000","last_fullsized":"2023-08-09T12:53:21.587347+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:23:22.252970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450515+0000","last_change":"2023-08-09T12:53:19.431864+0000","last_active":"2023-08-09T12:53:21.450515+0000","last_peered":"2023-08-09T12:53:21.450515+0000","last_clean":"2023-08-09T12:53:21.450515+0000","last_became_active":"2023-08-09T12:53:19.430812+0000","last_became_peered":"2023-08-09T12:53:19.430812+0000","last_unstale":"2023-08-09T12:53:21.450515+0000","last_undegraded":"2023-08-09T12:53:21.450515+0000","last_fullsized":"2023-08-09T12:53:21.450515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:20:29.414035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.482907+0000","last_change":"2023-08-09T12:53:20.481912+0000","last_active":"2023-08-09T12:53:20.482907+0000","last_peered":"2023-08-09T12:53:20.482907+0000","last_clean":"2023-08-09T12:53:20.482907+0000","last_became_active":"2023-08-09T12:53:20.480909+0000","last_became_peered":"2023-08-09T12:53:20.480909+0000","last_unstale":"2023-08-09T12:53:20.482907+0000","last_undegraded":"2023-08-09T12:53:20.482907+0000","last_fullsized":"2023-08-09T12:53:20.482907+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:11:03.056998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"190'1","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501763+0000","last_change":"2023-08-09T12:53:19.437579+0000","last_active":"2023-08-09T12:53:20.501763+0000","last_peered":"2023-08-09T12:53:20.501763+0000","last_clean":"2023-08-09T12:53:20.501763+0000","last_became_active":"2023-08-09T12:53:19.436587+0000","last_became_peered":"2023-08-09T12:53:19.436587+0000","last_unstale":"2023-08-09T12:53:20.501763+0000","last_undegraded":"2023-08-09T12:53:20.501763+0000","last_fullsized":"2023-08-09T12:53:20.501763+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:34:15.453876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450397+0000","last_change":"2023-08-09T12:53:20.467668+0000","last_active":"2023-08-09T12:53:21.450397+0000","last_peered":"2023-08-09T12:53:21.450397+0000","last_clean":"2023-08-09T12:53:21.450397+0000","last_became_active":"2023-08-09T12:53:20.465885+0000","last_became_peered":"2023-08-09T12:53:20.465885+0000","last_unstale":"2023-08-09T12:53:21.450397+0000","last_undegraded":"2023-08-09T12:53:21.450397+0000","last_fullsized":"2023-08-09T12:53:21.450397+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:44:00.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"190'1","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.500877+0000","last_change":"2023-08-09T12:53:19.433724+0000","last_active":"2023-08-09T12:53:20.500877+0000","last_peered":"2023-08-09T12:53:20.500877+0000","last_clean":"2023-08-09T12:53:20.500877+0000","last_became_active":"2023-08-09T12:53:19.433392+0000","last_became_peered":"2023-08-09T12:53:19.433392+0000","last_unstale":"2023-08-09T12:53:20.500877+0000","last_undegraded":"2023-08-09T12:53:20.500877+0000","last_fullsized":"2023-08-09T12:53:20.500877+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:01:33.963701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450345+0000","last_change":"2023-08-09T12:53:20.469025+0000","last_active":"2023-08-09T12:53:21.450345+0000","last_peered":"2023-08-09T12:53:21.450345+0000","last_clean":"2023-08-09T12:53:21.450345+0000","last_became_active":"2023-08-09T12:53:20.466658+0000","last_became_peered":"2023-08-09T12:53:20.466658+0000","last_unstale":"2023-08-09T12:53:21.450345+0000","last_undegraded":"2023-08-09T12:53:21.450345+0000","last_fullsized":"2023-08-09T12:53:21.450345+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:15:24.975074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450512+0000","last_change":"2023-08-09T12:53:19.437581+0000","last_active":"2023-08-09T12:53:21.450512+0000","last_peered":"2023-08-09T12:53:21.450512+0000","last_clean":"2023-08-09T12:53:21.450512+0000","last_became_active":"2023-08-09T12:53:19.437125+0000","last_became_peered":"2023-08-09T12:53:19.437125+0000","last_unstale":"2023-08-09T12:53:21.450512+0000","last_undegraded":"2023-08-09T12:53:21.450512+0000","last_fullsized":"2023-08-09T12:53:21.450512+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:34:58.088134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454001+0000","last_change":"2023-08-09T12:53:20.477020+0000","last_active":"2023-08-09T12:53:21.454001+0000","last_peered":"2023-08-09T12:53:21.454001+0000","last_clean":"2023-08-09T12:53:21.454001+0000","last_became_active":"2023-08-09T12:53:20.475048+0000","last_became_peered":"2023-08-09T12:53:20.475048+0000","last_unstale":"2023-08-09T12:53:21.454001+0000","last_undegraded":"2023-08-09T12:53:21.454001+0000","last_fullsized":"2023-08-09T12:53:21.454001+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:26:40.549108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.477454+0000","last_change":"2023-08-09T12:53:19.431655+0000","last_active":"2023-08-09T12:53:20.477454+0000","last_peered":"2023-08-09T12:53:20.477454+0000","last_clean":"2023-08-09T12:53:20.477454+0000","last_became_active":"2023-08-09T12:53:19.430730+0000","last_became_peered":"2023-08-09T12:53:19.430730+0000","last_unstale":"2023-08-09T12:53:20.477454+0000","last_undegraded":"2023-08-09T12:53:20.477454+0000","last_fullsized":"2023-08-09T12:53:20.477454+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:35:02.784639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.483246+0000","last_change":"2023-08-09T12:53:20.483099+0000","last_active":"2023-08-09T12:53:20.483246+0000","last_peered":"2023-08-09T12:53:20.483246+0000","last_clean":"2023-08-09T12:53:20.483246+0000","last_became_active":"2023-08-09T12:53:20.482302+0000","last_became_peered":"2023-08-09T12:53:20.482302+0000","last_unstale":"2023-08-09T12:53:20.483246+0000","last_undegraded":"2023-08-09T12:53:20.483246+0000","last_fullsized":"2023-08-09T12:53:20.483246+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:50:40.220441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585602+0000","last_change":"2023-08-09T12:53:19.431627+0000","last_active":"2023-08-09T12:53:21.585602+0000","last_peered":"2023-08-09T12:53:21.585602+0000","last_clean":"2023-08-09T12:53:21.585602+0000","last_became_active":"2023-08-09T12:53:19.431134+0000","last_became_peered":"2023-08-09T12:53:19.431134+0000","last_unstale":"2023-08-09T12:53:21.585602+0000","last_undegraded":"2023-08-09T12:53:21.585602+0000","last_fullsized":"2023-08-09T12:53:21.585602+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:47:36.338397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585505+0000","last_change":"2023-08-09T12:53:20.476268+0000","last_active":"2023-08-09T12:53:21.585505+0000","last_peered":"2023-08-09T12:53:21.585505+0000","last_clean":"2023-08-09T12:53:21.585505+0000","last_became_active":"2023-08-09T12:53:20.475995+0000","last_became_peered":"2023-08-09T12:53:20.475995+0000","last_unstale":"2023-08-09T12:53:21.585505+0000","last_undegraded":"2023-08-09T12:53:21.585505+0000","last_fullsized":"2023-08-09T12:53:21.585505+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:18:05.609616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"190'2","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501811+0000","last_change":"2023-08-09T12:53:19.435753+0000","last_active":"2023-08-09T12:53:20.501811+0000","last_peered":"2023-08-09T12:53:20.501811+0000","last_clean":"2023-08-09T12:53:20.501811+0000","last_became_active":"2023-08-09T12:53:19.435510+0000","last_became_peered":"2023-08-09T12:53:19.435510+0000","last_unstale":"2023-08-09T12:53:20.501811+0000","last_undegraded":"2023-08-09T12:53:20.501811+0000","last_fullsized":"2023-08-09T12:53:20.501811+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:43:55.546602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587728+0000","last_change":"2023-08-09T12:53:20.474826+0000","last_active":"2023-08-09T12:53:21.587728+0000","last_peered":"2023-08-09T12:53:21.587728+0000","last_clean":"2023-08-09T12:53:21.587728+0000","last_became_active":"2023-08-09T12:53:20.474552+0000","last_became_peered":"2023-08-09T12:53:20.474552+0000","last_unstale":"2023-08-09T12:53:21.587728+0000","last_undegraded":"2023-08-09T12:53:21.587728+0000","last_fullsized":"2023-08-09T12:53:21.587728+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:25:07.372440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"190'1","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501231+0000","last_change":"2023-08-09T12:53:19.433660+0000","last_active":"2023-08-09T12:53:20.501231+0000","last_peered":"2023-08-09T12:53:20.501231+0000","last_clean":"2023-08-09T12:53:20.501231+0000","last_became_active":"2023-08-09T12:53:19.433244+0000","last_became_peered":"2023-08-09T12:53:19.433244+0000","last_unstale":"2023-08-09T12:53:20.501231+0000","last_undegraded":"2023-08-09T12:53:20.501231+0000","last_fullsized":"2023-08-09T12:53:20.501231+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:02:07.271523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587683+0000","last_change":"2023-08-09T12:53:20.485763+0000","last_active":"2023-08-09T12:53:21.587683+0000","last_peered":"2023-08-09T12:53:21.587683+0000","last_clean":"2023-08-09T12:53:21.587683+0000","last_became_active":"2023-08-09T12:53:20.484996+0000","last_became_peered":"2023-08-09T12:53:20.484996+0000","last_unstale":"2023-08-09T12:53:21.587683+0000","last_undegraded":"2023-08-09T12:53:21.587683+0000","last_fullsized":"2023-08-09T12:53:21.587683+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:57:24.809767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.473921+0000","last_change":"2023-08-09T12:53:19.436825+0000","last_active":"2023-08-09T12:53:20.473921+0000","last_peered":"2023-08-09T12:53:20.473921+0000","last_clean":"2023-08-09T12:53:20.473921+0000","last_became_active":"2023-08-09T12:53:19.436268+0000","last_became_peered":"2023-08-09T12:53:19.436268+0000","last_unstale":"2023-08-09T12:53:20.473921+0000","last_undegraded":"2023-08-09T12:53:20.473921+0000","last_fullsized":"2023-08-09T12:53:20.473921+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:24:23.119214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585701+0000","last_change":"2023-08-09T12:53:20.483097+0000","last_active":"2023-08-09T12:53:21.585701+0000","last_peered":"2023-08-09T12:53:21.585701+0000","last_clean":"2023-08-09T12:53:21.585701+0000","last_became_active":"2023-08-09T12:53:20.482198+0000","last_became_peered":"2023-08-09T12:53:20.482198+0000","last_unstale":"2023-08-09T12:53:21.585701+0000","last_undegraded":"2023-08-09T12:53:21.585701+0000","last_fullsized":"2023-08-09T12:53:21.585701+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:13:07.929049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"190'2","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501525+0000","last_change":"2023-08-09T12:53:19.439865+0000","last_active":"2023-08-09T12:53:20.501525+0000","last_peered":"2023-08-09T12:53:20.501525+0000","last_clean":"2023-08-09T12:53:20.501525+0000","last_became_active":"2023-08-09T12:53:19.439598+0000","last_became_peered":"2023-08-09T12:53:19.439598+0000","last_unstale":"2023-08-09T12:53:20.501525+0000","last_undegraded":"2023-08-09T12:53:20.501525+0000","last_fullsized":"2023-08-09T12:53:20.501525+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:48:58.675234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.486003+0000","last_change":"2023-08-09T12:53:20.485863+0000","last_active":"2023-08-09T12:53:20.486003+0000","last_peered":"2023-08-09T12:53:20.486003+0000","last_clean":"2023-08-09T12:53:20.486003+0000","last_became_active":"2023-08-09T12:53:20.485263+0000","last_became_peered":"2023-08-09T12:53:20.485263+0000","last_unstale":"2023-08-09T12:53:20.486003+0000","last_undegraded":"2023-08-09T12:53:20.486003+0000","last_fullsized":"2023-08-09T12:53:20.486003+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:47:52.716071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585284+0000","last_change":"2023-08-09T12:53:19.428244+0000","last_active":"2023-08-09T12:53:21.585284+0000","last_peered":"2023-08-09T12:53:21.585284+0000","last_clean":"2023-08-09T12:53:21.585284+0000","last_became_active":"2023-08-09T12:53:19.427529+0000","last_became_peered":"2023-08-09T12:53:19.427529+0000","last_unstale":"2023-08-09T12:53:21.585284+0000","last_undegraded":"2023-08-09T12:53:21.585284+0000","last_fullsized":"2023-08-09T12:53:21.585284+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:19:47.740820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.486827+0000","last_change":"2023-08-09T12:53:20.486710+0000","last_active":"2023-08-09T12:53:20.486827+0000","last_peered":"2023-08-09T12:53:20.486827+0000","last_clean":"2023-08-09T12:53:20.486827+0000","last_became_active":"2023-08-09T12:53:20.486229+0000","last_became_peered":"2023-08-09T12:53:20.486229+0000","last_unstale":"2023-08-09T12:53:20.486827+0000","last_undegraded":"2023-08-09T12:53:20.486827+0000","last_fullsized":"2023-08-09T12:53:20.486827+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:14:43.697620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450881+0000","last_change":"2023-08-09T12:53:19.436010+0000","last_active":"2023-08-09T12:53:21.450881+0000","last_peered":"2023-08-09T12:53:21.450881+0000","last_clean":"2023-08-09T12:53:21.450881+0000","last_became_active":"2023-08-09T12:53:19.435752+0000","last_became_peered":"2023-08-09T12:53:19.435752+0000","last_unstale":"2023-08-09T12:53:21.450881+0000","last_undegraded":"2023-08-09T12:53:21.450881+0000","last_fullsized":"2023-08-09T12:53:21.450881+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:22:06.368530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586942+0000","last_change":"2023-08-09T12:53:20.475112+0000","last_active":"2023-08-09T12:53:21.586942+0000","last_peered":"2023-08-09T12:53:21.586942+0000","last_clean":"2023-08-09T12:53:21.586942+0000","last_became_active":"2023-08-09T12:53:20.473986+0000","last_became_peered":"2023-08-09T12:53:20.473986+0000","last_unstale":"2023-08-09T12:53:21.586942+0000","last_undegraded":"2023-08-09T12:53:21.586942+0000","last_fullsized":"2023-08-09T12:53:21.586942+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:07:29.173522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.588295+0000","last_change":"2023-08-09T12:53:19.440587+0000","last_active":"2023-08-09T12:53:21.588295+0000","last_peered":"2023-08-09T12:53:21.588295+0000","last_clean":"2023-08-09T12:53:21.588295+0000","last_became_active":"2023-08-09T12:53:19.439484+0000","last_became_peered":"2023-08-09T12:53:19.439484+0000","last_unstale":"2023-08-09T12:53:21.588295+0000","last_undegraded":"2023-08-09T12:53:21.588295+0000","last_fullsized":"2023-08-09T12:53:21.588295+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:44:17.459873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587385+0000","last_change":"2023-08-09T12:53:20.475239+0000","last_active":"2023-08-09T12:53:21.587385+0000","last_peered":"2023-08-09T12:53:21.587385+0000","last_clean":"2023-08-09T12:53:21.587385+0000","last_became_active":"2023-08-09T12:53:20.474934+0000","last_became_peered":"2023-08-09T12:53:20.474934+0000","last_unstale":"2023-08-09T12:53:21.587385+0000","last_undegraded":"2023-08-09T12:53:21.587385+0000","last_fullsized":"2023-08-09T12:53:21.587385+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:31:17.339341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"190'2","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501824+0000","last_change":"2023-08-09T12:53:19.440686+0000","last_active":"2023-08-09T12:53:20.501824+0000","last_peered":"2023-08-09T12:53:20.501824+0000","last_clean":"2023-08-09T12:53:20.501824+0000","last_became_active":"2023-08-09T12:53:19.439937+0000","last_became_peered":"2023-08-09T12:53:19.439937+0000","last_unstale":"2023-08-09T12:53:20.501824+0000","last_undegraded":"2023-08-09T12:53:20.501824+0000","last_fullsized":"2023-08-09T12:53:20.501824+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:57:43.790051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.482938+0000","last_change":"2023-08-09T12:53:20.482493+0000","last_active":"2023-08-09T12:53:20.482938+0000","last_peered":"2023-08-09T12:53:20.482938+0000","last_clean":"2023-08-09T12:53:20.482938+0000","last_became_active":"2023-08-09T12:53:20.481623+0000","last_became_peered":"2023-08-09T12:53:20.481623+0000","last_unstale":"2023-08-09T12:53:20.482938+0000","last_undegraded":"2023-08-09T12:53:20.482938+0000","last_fullsized":"2023-08-09T12:53:20.482938+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:59:59.096608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586591+0000","last_change":"2023-08-09T12:53:19.430459+0000","last_active":"2023-08-09T12:53:21.586591+0000","last_peered":"2023-08-09T12:53:21.586591+0000","last_clean":"2023-08-09T12:53:21.586591+0000","last_became_active":"2023-08-09T12:53:19.429834+0000","last_became_peered":"2023-08-09T12:53:19.429834+0000","last_unstale":"2023-08-09T12:53:21.586591+0000","last_undegraded":"2023-08-09T12:53:21.586591+0000","last_fullsized":"2023-08-09T12:53:21.586591+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:16:23.867659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450349+0000","last_change":"2023-08-09T12:53:20.466882+0000","last_active":"2023-08-09T12:53:21.450349+0000","last_peered":"2023-08-09T12:53:21.450349+0000","last_clean":"2023-08-09T12:53:21.450349+0000","last_became_active":"2023-08-09T12:53:20.466233+0000","last_became_peered":"2023-08-09T12:53:20.466233+0000","last_unstale":"2023-08-09T12:53:21.450349+0000","last_undegraded":"2023-08-09T12:53:21.450349+0000","last_fullsized":"2023-08-09T12:53:21.450349+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:29:14.198587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585943+0000","last_change":"2023-08-09T12:53:19.426301+0000","last_active":"2023-08-09T12:53:21.585943+0000","last_peered":"2023-08-09T12:53:21.585943+0000","last_clean":"2023-08-09T12:53:21.585943+0000","last_became_active":"2023-08-09T12:53:19.425950+0000","last_became_peered":"2023-08-09T12:53:19.425950+0000","last_unstale":"2023-08-09T12:53:21.585943+0000","last_undegraded":"2023-08-09T12:53:21.585943+0000","last_fullsized":"2023-08-09T12:53:21.585943+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:39:40.125757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.485869+0000","last_change":"2023-08-09T12:53:20.485793+0000","last_active":"2023-08-09T12:53:20.485869+0000","last_peered":"2023-08-09T12:53:20.485869+0000","last_clean":"2023-08-09T12:53:20.485869+0000","last_became_active":"2023-08-09T12:53:20.485037+0000","last_became_peered":"2023-08-09T12:53:20.485037+0000","last_unstale":"2023-08-09T12:53:20.485869+0000","last_undegraded":"2023-08-09T12:53:20.485869+0000","last_fullsized":"2023-08-09T12:53:20.485869+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:44:38.749644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.451029+0000","last_change":"2023-08-09T12:53:19.434848+0000","last_active":"2023-08-09T12:53:21.451029+0000","last_peered":"2023-08-09T12:53:21.451029+0000","last_clean":"2023-08-09T12:53:21.451029+0000","last_became_active":"2023-08-09T12:53:19.434529+0000","last_became_peered":"2023-08-09T12:53:19.434529+0000","last_unstale":"2023-08-09T12:53:21.451029+0000","last_undegraded":"2023-08-09T12:53:21.451029+0000","last_fullsized":"2023-08-09T12:53:21.451029+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:11:10.872258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.453693+0000","last_change":"2023-08-09T12:53:20.479918+0000","last_active":"2023-08-09T12:53:21.453693+0000","last_peered":"2023-08-09T12:53:21.453693+0000","last_clean":"2023-08-09T12:53:21.453693+0000","last_became_active":"2023-08-09T12:53:20.479688+0000","last_became_peered":"2023-08-09T12:53:20.479688+0000","last_unstale":"2023-08-09T12:53:21.453693+0000","last_undegraded":"2023-08-09T12:53:21.453693+0000","last_fullsized":"2023-08-09T12:53:21.453693+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:11:01.890180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454465+0000","last_change":"2023-08-09T12:53:19.437059+0000","last_active":"2023-08-09T12:53:21.454465+0000","last_peered":"2023-08-09T12:53:21.454465+0000","last_clean":"2023-08-09T12:53:21.454465+0000","last_became_active":"2023-08-09T12:53:19.436429+0000","last_became_peered":"2023-08-09T12:53:19.436429+0000","last_unstale":"2023-08-09T12:53:21.454465+0000","last_undegraded":"2023-08-09T12:53:21.454465+0000","last_fullsized":"2023-08-09T12:53:21.454465+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:31:07.298975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587884+0000","last_change":"2023-08-09T12:53:20.457498+0000","last_active":"2023-08-09T12:53:21.587884+0000","last_peered":"2023-08-09T12:53:21.587884+0000","last_clean":"2023-08-09T12:53:21.587884+0000","last_became_active":"2023-08-09T12:53:20.455685+0000","last_became_peered":"2023-08-09T12:53:20.455685+0000","last_unstale":"2023-08-09T12:53:21.587884+0000","last_undegraded":"2023-08-09T12:53:21.587884+0000","last_fullsized":"2023-08-09T12:53:21.587884+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:12.902887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586854+0000","last_change":"2023-08-09T12:53:19.433371+0000","last_active":"2023-08-09T12:53:21.586854+0000","last_peered":"2023-08-09T12:53:21.586854+0000","last_clean":"2023-08-09T12:53:21.586854+0000","last_became_active":"2023-08-09T12:53:19.433038+0000","last_became_peered":"2023-08-09T12:53:19.433038+0000","last_unstale":"2023-08-09T12:53:21.586854+0000","last_undegraded":"2023-08-09T12:53:21.586854+0000","last_fullsized":"2023-08-09T12:53:21.586854+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:32:29.282948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585564+0000","last_change":"2023-08-09T12:53:20.483820+0000","last_active":"2023-08-09T12:53:21.585564+0000","last_peered":"2023-08-09T12:53:21.585564+0000","last_clean":"2023-08-09T12:53:21.585564+0000","last_became_active":"2023-08-09T12:53:20.482568+0000","last_became_peered":"2023-08-09T12:53:20.482568+0000","last_unstale":"2023-08-09T12:53:21.585564+0000","last_undegraded":"2023-08-09T12:53:21.585564+0000","last_fullsized":"2023-08-09T12:53:21.585564+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:04:00.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585917+0000","last_change":"2023-08-09T12:53:19.435416+0000","last_active":"2023-08-09T12:53:21.585917+0000","last_peered":"2023-08-09T12:53:21.585917+0000","last_clean":"2023-08-09T12:53:21.585917+0000","last_became_active":"2023-08-09T12:53:19.434880+0000","last_became_peered":"2023-08-09T12:53:19.434880+0000","last_unstale":"2023-08-09T12:53:21.585917+0000","last_undegraded":"2023-08-09T12:53:21.585917+0000","last_fullsized":"2023-08-09T12:53:21.585917+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:03:34.275209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450162+0000","last_change":"2023-08-09T12:53:20.480617+0000","last_active":"2023-08-09T12:53:21.450162+0000","last_peered":"2023-08-09T12:53:21.450162+0000","last_clean":"2023-08-09T12:53:21.450162+0000","last_became_active":"2023-08-09T12:53:20.475922+0000","last_became_peered":"2023-08-09T12:53:20.475922+0000","last_unstale":"2023-08-09T12:53:21.450162+0000","last_undegraded":"2023-08-09T12:53:21.450162+0000","last_fullsized":"2023-08-09T12:53:21.450162+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:36:16.933066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.466564+0000","last_change":"2023-08-09T12:53:19.440155+0000","last_active":"2023-08-09T12:53:20.466564+0000","last_peered":"2023-08-09T12:53:20.466564+0000","last_clean":"2023-08-09T12:53:20.466564+0000","last_became_active":"2023-08-09T12:53:19.439868+0000","last_became_peered":"2023-08-09T12:53:19.439868+0000","last_unstale":"2023-08-09T12:53:20.466564+0000","last_undegraded":"2023-08-09T12:53:20.466564+0000","last_fullsized":"2023-08-09T12:53:20.466564+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:52:09.528281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586554+0000","last_change":"2023-08-09T12:53:20.460635+0000","last_active":"2023-08-09T12:53:21.586554+0000","last_peered":"2023-08-09T12:53:21.586554+0000","last_clean":"2023-08-09T12:53:21.586554+0000","last_became_active":"2023-08-09T12:53:20.459490+0000","last_became_peered":"2023-08-09T12:53:20.459490+0000","last_unstale":"2023-08-09T12:53:21.586554+0000","last_undegraded":"2023-08-09T12:53:21.586554+0000","last_fullsized":"2023-08-09T12:53:21.586554+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:49:47.238641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586737+0000","last_change":"2023-08-09T12:53:19.429225+0000","last_active":"2023-08-09T12:53:21.586737+0000","last_peered":"2023-08-09T12:53:21.586737+0000","last_clean":"2023-08-09T12:53:21.586737+0000","last_became_active":"2023-08-09T12:53:19.428610+0000","last_became_peered":"2023-08-09T12:53:19.428610+0000","last_unstale":"2023-08-09T12:53:21.586737+0000","last_undegraded":"2023-08-09T12:53:21.586737+0000","last_fullsized":"2023-08-09T12:53:21.586737+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T16:38:23.307400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":504,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586796+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:53:21.586796+0000","last_peered":"2023-08-09T12:53:21.586796+0000","last_clean":"2023-08-09T12:53:21.586796+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:53:21.586796+0000","last_undegraded":"2023-08-09T12:53:21.586796+0000","last_fullsized":"2023-08-09T12:53:21.586796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:23:23.962149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":317,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587802+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:53:21.587802+0000","last_peered":"2023-08-09T12:53:21.587802+0000","last_clean":"2023-08-09T12:53:21.587802+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:53:21.587802+0000","last_undegraded":"2023-08-09T12:53:21.587802+0000","last_fullsized":"2023-08-09T12:53:21.587802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:53:22.930738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585909+0000","last_change":"2023-08-09T12:53:20.487601+0000","last_active":"2023-08-09T12:53:21.585909+0000","last_peered":"2023-08-09T12:53:21.585909+0000","last_clean":"2023-08-09T12:53:21.585909+0000","last_became_active":"2023-08-09T12:53:20.487244+0000","last_became_peered":"2023-08-09T12:53:20.487244+0000","last_unstale":"2023-08-09T12:53:21.585909+0000","last_undegraded":"2023-08-09T12:53:21.585909+0000","last_fullsized":"2023-08-09T12:53:21.585909+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:58:02.126812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"190'3","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.454228+0000","last_change":"2023-08-09T12:53:19.438195+0000","last_active":"2023-08-09T12:53:21.454228+0000","last_peered":"2023-08-09T12:53:21.454228+0000","last_clean":"2023-08-09T12:53:21.454228+0000","last_became_active":"2023-08-09T12:53:19.436897+0000","last_became_peered":"2023-08-09T12:53:19.436897+0000","last_unstale":"2023-08-09T12:53:21.454228+0000","last_undegraded":"2023-08-09T12:53:21.454228+0000","last_fullsized":"2023-08-09T12:53:21.454228+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:30:06.165085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":348,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586165+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:53:21.586165+0000","last_peered":"2023-08-09T12:53:21.586165+0000","last_clean":"2023-08-09T12:53:21.586165+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:53:21.586165+0000","last_undegraded":"2023-08-09T12:53:21.586165+0000","last_fullsized":"2023-08-09T12:53:21.586165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:34:43.460502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450159+0000","last_change":"2023-08-09T12:53:20.478943+0000","last_active":"2023-08-09T12:53:21.450159+0000","last_peered":"2023-08-09T12:53:21.450159+0000","last_clean":"2023-08-09T12:53:21.450159+0000","last_became_active":"2023-08-09T12:53:20.478636+0000","last_became_peered":"2023-08-09T12:53:20.478636+0000","last_unstale":"2023-08-09T12:53:21.450159+0000","last_undegraded":"2023-08-09T12:53:21.450159+0000","last_fullsized":"2023-08-09T12:53:21.450159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:26:48.278833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"190'6","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585228+0000","last_change":"2023-08-09T12:53:19.433442+0000","last_active":"2023-08-09T12:53:21.585228+0000","last_peered":"2023-08-09T12:53:21.585228+0000","last_clean":"2023-08-09T12:53:21.585228+0000","last_became_active":"2023-08-09T12:53:19.432526+0000","last_became_peered":"2023-08-09T12:53:19.432526+0000","last_unstale":"2023-08-09T12:53:21.585228+0000","last_undegraded":"2023-08-09T12:53:21.585228+0000","last_fullsized":"2023-08-09T12:53:21.585228+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:29:31.556414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450503+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:53:21.450503+0000","last_peered":"2023-08-09T12:53:21.450503+0000","last_clean":"2023-08-09T12:53:21.450503+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:53:21.450503+0000","last_undegraded":"2023-08-09T12:53:21.450503+0000","last_fullsized":"2023-08-09T12:53:21.450503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:22:26.910093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585881+0000","last_change":"2023-08-09T12:53:20.460967+0000","last_active":"2023-08-09T12:53:21.585881+0000","last_peered":"2023-08-09T12:53:21.585881+0000","last_clean":"2023-08-09T12:53:21.585881+0000","last_became_active":"2023-08-09T12:53:20.459365+0000","last_became_peered":"2023-08-09T12:53:20.459365+0000","last_unstale":"2023-08-09T12:53:21.585881+0000","last_undegraded":"2023-08-09T12:53:21.585881+0000","last_fullsized":"2023-08-09T12:53:21.585881+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:57.182326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.584963+0000","last_change":"2023-08-09T12:53:19.428109+0000","last_active":"2023-08-09T12:53:21.584963+0000","last_peered":"2023-08-09T12:53:21.584963+0000","last_clean":"2023-08-09T12:53:21.584963+0000","last_became_active":"2023-08-09T12:53:19.427588+0000","last_became_peered":"2023-08-09T12:53:19.427588+0000","last_unstale":"2023-08-09T12:53:21.584963+0000","last_undegraded":"2023-08-09T12:53:21.584963+0000","last_fullsized":"2023-08-09T12:53:21.584963+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:24:57.294454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":317,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587931+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:53:21.587931+0000","last_peered":"2023-08-09T12:53:21.587931+0000","last_clean":"2023-08-09T12:53:21.587931+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:53:21.587931+0000","last_undegraded":"2023-08-09T12:53:21.587931+0000","last_fullsized":"2023-08-09T12:53:21.587931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:09:04.599085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.584936+0000","last_change":"2023-08-09T12:53:20.478954+0000","last_active":"2023-08-09T12:53:21.584936+0000","last_peered":"2023-08-09T12:53:21.584936+0000","last_clean":"2023-08-09T12:53:21.584936+0000","last_became_active":"2023-08-09T12:53:20.478706+0000","last_became_peered":"2023-08-09T12:53:20.478706+0000","last_unstale":"2023-08-09T12:53:21.584936+0000","last_undegraded":"2023-08-09T12:53:21.584936+0000","last_fullsized":"2023-08-09T12:53:21.584936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T00:02:49.772672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587403+0000","last_change":"2023-08-09T12:53:19.438787+0000","last_active":"2023-08-09T12:53:21.587403+0000","last_peered":"2023-08-09T12:53:21.587403+0000","last_clean":"2023-08-09T12:53:21.587403+0000","last_became_active":"2023-08-09T12:53:19.438425+0000","last_became_peered":"2023-08-09T12:53:19.438425+0000","last_unstale":"2023-08-09T12:53:21.587403+0000","last_undegraded":"2023-08-09T12:53:21.587403+0000","last_fullsized":"2023-08-09T12:53:21.587403+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:58:01.010853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":315,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.480064+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:53:20.480064+0000","last_peered":"2023-08-09T12:53:20.480064+0000","last_clean":"2023-08-09T12:53:20.480064+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:53:20.480064+0000","last_undegraded":"2023-08-09T12:53:20.480064+0000","last_fullsized":"2023-08-09T12:53:20.480064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:38:22.891520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.450217+0000","last_change":"2023-08-09T12:53:20.474361+0000","last_active":"2023-08-09T12:53:21.450217+0000","last_peered":"2023-08-09T12:53:21.450217+0000","last_clean":"2023-08-09T12:53:21.450217+0000","last_became_active":"2023-08-09T12:53:20.472148+0000","last_became_peered":"2023-08-09T12:53:20.472148+0000","last_unstale":"2023-08-09T12:53:21.450217+0000","last_undegraded":"2023-08-09T12:53:21.450217+0000","last_fullsized":"2023-08-09T12:53:21.450217+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:00:43.844866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"190'8","reported_seq":19,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501954+0000","last_change":"2023-08-09T12:53:19.434887+0000","last_active":"2023-08-09T12:53:20.501954+0000","last_peered":"2023-08-09T12:53:20.501954+0000","last_clean":"2023-08-09T12:53:20.501954+0000","last_became_active":"2023-08-09T12:53:19.434588+0000","last_became_peered":"2023-08-09T12:53:19.434588+0000","last_unstale":"2023-08-09T12:53:20.501954+0000","last_undegraded":"2023-08-09T12:53:20.501954+0000","last_fullsized":"2023-08-09T12:53:20.501954+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:52:54.052866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":347,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585744+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:53:21.585744+0000","last_peered":"2023-08-09T12:53:21.585744+0000","last_clean":"2023-08-09T12:53:21.585744+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:53:21.585744+0000","last_undegraded":"2023-08-09T12:53:21.585744+0000","last_fullsized":"2023-08-09T12:53:21.585744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T17:23:22.426735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.586022+0000","last_change":"2023-08-09T12:53:20.466596+0000","last_active":"2023-08-09T12:53:21.586022+0000","last_peered":"2023-08-09T12:53:21.586022+0000","last_clean":"2023-08-09T12:53:21.586022+0000","last_became_active":"2023-08-09T12:53:20.466056+0000","last_became_peered":"2023-08-09T12:53:20.466056+0000","last_unstale":"2023-08-09T12:53:21.586022+0000","last_undegraded":"2023-08-09T12:53:21.586022+0000","last_fullsized":"2023-08-09T12:53:21.586022+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:55:52.052858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"190'2","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.501260+0000","last_change":"2023-08-09T12:53:19.438587+0000","last_active":"2023-08-09T12:53:20.501260+0000","last_peered":"2023-08-09T12:53:20.501260+0000","last_clean":"2023-08-09T12:53:20.501260+0000","last_became_active":"2023-08-09T12:53:19.438350+0000","last_became_peered":"2023-08-09T12:53:19.438350+0000","last_unstale":"2023-08-09T12:53:20.501260+0000","last_undegraded":"2023-08-09T12:53:20.501260+0000","last_fullsized":"2023-08-09T12:53:20.501260+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:46:37.053942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":315,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.480202+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:53:20.480202+0000","last_peered":"2023-08-09T12:53:20.480202+0000","last_clean":"2023-08-09T12:53:20.480202+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:53:20.480202+0000","last_undegraded":"2023-08-09T12:53:20.480202+0000","last_fullsized":"2023-08-09T12:53:20.480202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:55:35.898214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-09T12:53:20.485661+0000","last_change":"2023-08-09T12:53:20.485566+0000","last_active":"2023-08-09T12:53:20.485661+0000","last_peered":"2023-08-09T12:53:20.485661+0000","last_clean":"2023-08-09T12:53:20.485661+0000","last_became_active":"2023-08-09T12:53:20.485258+0000","last_became_peered":"2023-08-09T12:53:20.485258+0000","last_unstale":"2023-08-09T12:53:20.485661+0000","last_undegraded":"2023-08-09T12:53:20.485661+0000","last_fullsized":"2023-08-09T12:53:20.485661+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:19.404822+0000","last_clean_scrub_stamp":"2023-08-09T12:53:19.404822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T15:52:45.900462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.585106+0000","last_change":"2023-08-09T12:53:19.438029+0000","last_active":"2023-08-09T12:53:21.585106+0000","last_peered":"2023-08-09T12:53:21.585106+0000","last_clean":"2023-08-09T12:53:21.585106+0000","last_became_active":"2023-08-09T12:53:19.437795+0000","last_became_peered":"2023-08-09T12:53:19.437795+0000","last_unstale":"2023-08-09T12:53:21.585106+0000","last_undegraded":"2023-08-09T12:53:21.585106+0000","last_fullsized":"2023-08-09T12:53:21.585106+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:53:18.389758+0000","last_clean_scrub_stamp":"2023-08-09T12:53:18.389758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:18:54.838117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-09T12:53:21.587930+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:53:21.587930+0000","last_peered":"2023-08-09T12:53:21.587930+0000","last_clean":"2023-08-09T12:53:21.587930+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:53:21.587930+0000","last_undegraded":"2023-08-09T12:53:21.587930+0000","last_fullsized":"2023-08-09T12:53:21.587930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:46:37.774203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575020,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193617,"statfs":{"total":200000000,"available":198264490,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.194,"15min":1.1419999999999999},"min":{"1min":0.61899999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.593,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.143,"15min":1.1200000000000001},"min":{"1min":0.83299999999999996,"5min":0.70499999999999996,"15min":0.44500000000000001},"max":{"1min":1.615,"5min":1.7509999999999999,"15min":2.0459999999999998},"last":0.86499999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2350000000000001,"15min":1.1970000000000001},"min":{"1min":0.75600000000000001,"5min":0.628,"15min":0.628},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":2.0859999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2110000000000001,"15min":1.175},"min":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.6579999999999999,"5min":1.778,"15min":1.778},"last":0.93600000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.286,"15min":1.2529999999999999},"min":{"1min":0.82599999999999996,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":1.625,"5min":1.78,"15min":2.1459999999999999},"last":1.367},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2689999999999999,"15min":1.2190000000000001},"min":{"1min":0.871,"5min":0.76900000000000002,"15min":0.69799999999999995},"max":{"1min":1.5169999999999999,"5min":1.6579999999999999,"15min":2.173},"last":1.494}]},{"osd":3,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3240000000000001,"15min":1.2989999999999999},"min":{"1min":0.95599999999999996,"5min":0.78500000000000003,"15min":0.72299999999999998},"max":{"1min":1.6200000000000001,"5min":1.806,"15min":3.4540000000000002},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3120000000000001,"15min":1.3180000000000001},"min":{"1min":0.88600000000000001,"5min":0.754,"15min":0.61599999999999999},"max":{"1min":1.704,"5min":1.71,"15min":2.282},"last":1.097}]},{"osd":4,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2150000000000001,"15min":1.2330000000000001},"min":{"1min":0.878,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.7589999999999999,"5min":1.948,"15min":2.8769999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.3180000000000001,"15min":1.3440000000000001},"min":{"1min":1.054,"5min":0.67000000000000004,"15min":0.58599999999999997},"max":{"1min":1.6200000000000001,"5min":1.7909999999999999,"15min":4.6200000000000001},"last":1.276}]},{"osd":5,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.427,"15min":1.393},"min":{"1min":1.119,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.806,"5min":1.978,"15min":2.802},"last":1.423},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4910000000000001,"15min":1.5069999999999999},"min":{"1min":0.99099999999999999,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.722,"5min":2.1299999999999999,"15min":3.3580000000000001},"last":1.204}]},{"osd":6,"last update":"Wed Aug 9 12:52:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4630000000000001,"15min":1.482},"min":{"1min":1.155,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.8260000000000001,"5min":2.2370000000000001,"15min":3.4910000000000001},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.48,"15min":1.486},"min":{"1min":1.1859999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.76,"5min":1.95,"15min":2.4039999999999999},"last":1.4550000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575020,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198854858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.123,"15min":1.139},"min":{"1min":0.73099999999999998,"5min":0.63100000000000001,"15min":0.56399999999999995},"max":{"1min":1.669,"5min":1.669,"15min":2.54},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.171,"15min":1.1160000000000001},"min":{"1min":0.79400000000000004,"5min":0.72099999999999997,"15min":0.54000000000000004},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":2.1629999999999998},"last":1.2030000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.329,"15min":1.27},"min":{"1min":0.90500000000000003,"5min":0.71399999999999997,"15min":0.66500000000000004},"max":{"1min":1.722,"5min":1.9219999999999999,"15min":2.306},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.341,"15min":1.335},"min":{"1min":0.98499999999999999,"5min":0.81100000000000005,"15min":0.76800000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.9279999999999999},"last":1.6200000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.218,"15min":1.161},"min":{"1min":0.80900000000000005,"5min":0.74399999999999999,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.137},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.292,"15min":1.294},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.66300000000000003},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":2.6499999999999999},"last":1.28}]},{"osd":3,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.375,"15min":1.327},"min":{"1min":0.96899999999999997,"5min":0.88600000000000001,"15min":0.67600000000000005},"max":{"1min":1.8169999999999999,"5min":1.845,"15min":2.327},"last":1.345},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.3899999999999999,"15min":1.351},"min":{"1min":1.1859999999999999,"5min":0.95799999999999996,"15min":0.74099999999999999},"max":{"1min":1.835,"5min":1.835,"15min":2.5979999999999999},"last":1.431}]},{"osd":4,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3440000000000001,"15min":1.3720000000000001},"min":{"1min":0.94499999999999995,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":11.058999999999999},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.393,"15min":1.3759999999999999},"min":{"1min":1.0289999999999999,"5min":0.94699999999999995,"15min":0.57399999999999995},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.3479999999999999},"last":1.4950000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.3560000000000001,"15min":1.3620000000000001},"min":{"1min":0.99099999999999999,"5min":0.89800000000000002,"15min":0.77600000000000002},"max":{"1min":1.754,"5min":1.96,"15min":2.5249999999999999},"last":1.536},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.496,"15min":1.5089999999999999},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.81899999999999995},"max":{"1min":2.077,"5min":2.077,"15min":2.8580000000000001},"last":1.6499999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:52:33 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.544,"15min":1.5189999999999999},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":0.59099999999999997},"max":{"1min":2.093,"5min":2.093,"15min":2.7999999999999998},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.526,"15min":1.514},"min":{"1min":1.159,"5min":1.0469999999999999,"15min":0.74399999999999999},"max":{"1min":2.0739999999999998,"5min":2.1280000000000001,"15min":3.621},"last":1.6679999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575020,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198854734,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1379999999999999,"15min":1.117},"min":{"1min":0.70899999999999996,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.4810000000000001,"5min":1.609,"15min":3.4060000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.1619999999999999},"min":{"1min":0.80900000000000005,"5min":0.68999999999999995,"15min":0.625},"max":{"1min":1.8460000000000001,"5min":1.97,"15min":2.0600000000000001},"last":1.089}]},{"osd":1,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3759999999999999,"15min":1.341},"min":{"1min":0.98499999999999999,"5min":0.78600000000000003,"15min":0.63800000000000001},"max":{"1min":1.7909999999999999,"5min":1.851,"15min":2.6579999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.355,"15min":1.2969999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.70199999999999996},"max":{"1min":1.7250000000000001,"5min":2.262,"15min":2.262},"last":1.4890000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3029999999999999,"15min":1.248},"min":{"1min":0.95499999999999996,"5min":0.76800000000000002,"15min":0.69799999999999995},"max":{"1min":1.482,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.282,"15min":1.232},"min":{"1min":0.85399999999999998,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.716,"5min":1.7370000000000001,"15min":3.8149999999999999},"last":1.2929999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.304,"15min":1.2769999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.71799999999999997},"max":{"1min":1.5900000000000001,"5min":1.712,"15min":2.2330000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3779999999999999,"15min":1.373},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.78200000000000003},"max":{"1min":1.6579999999999999,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.264}]},{"osd":4,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.294,"15min":1.276},"min":{"1min":0.97799999999999998,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.8009999999999999,"5min":2.169,"15min":4.6920000000000002},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3939999999999999},"min":{"1min":0.93100000000000005,"5min":0.875,"15min":0.628},"max":{"1min":1.7230000000000001,"5min":2.21,"15min":3.3109999999999999},"last":1.577}]},{"osd":6,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4350000000000001,"15min":1.399},"min":{"1min":1.0900000000000001,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":1.669,"5min":2.7719999999999998,"15min":2.952},"last":1.675},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.466,"15min":1.4770000000000001},"min":{"1min":1.0800000000000001,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":5.8570000000000002},"last":1.6259999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.5369999999999999,"15min":1.5309999999999999},"min":{"1min":1.2709999999999999,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":1.8919999999999999,"5min":2.1709999999999998,"15min":3.4590000000000001},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5980000000000001,"15min":1.5720000000000001},"min":{"1min":1.286,"5min":1.069,"15min":0.65300000000000002},"max":{"1min":1.8340000000000001,"5min":2.8849999999999998,"15min":3.0649999999999999},"last":1.839}]}]},{"osd":4,"up_from":13,"seq":55834575020,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1119,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194193,"statfs":{"total":200000000,"available":198854094,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.1100000000000001,"15min":1.113},"min":{"1min":0.83399999999999996,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.986,"5min":1.986,"15min":2.5670000000000002},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.125,"15min":1.1319999999999999},"min":{"1min":0.85699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":3.4100000000000001},"last":0.79100000000000004}]},{"osd":1,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3149999999999999,"15min":1.296},"min":{"1min":0.89400000000000002,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.5549999999999999,"5min":1.863,"15min":2.3679999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.353,"15min":1.3340000000000001},"min":{"1min":1.026,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":1.6319999999999999,"5min":1.8240000000000001,"15min":2.9590000000000001},"last":1.6870000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.347,"15min":1.323},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.54900000000000004},"max":{"1min":1.708,"5min":1.9470000000000001,"15min":2.4729999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.367,"15min":1.351},"min":{"1min":0.996,"5min":0.81499999999999995,"15min":0.67900000000000005},"max":{"1min":1.887,"5min":1.887,"15min":3.0579999999999998},"last":1.2609999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2509999999999999,"15min":1.256},"min":{"1min":0.92900000000000005,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.625,"5min":1.728,"15min":3.4430000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.343,"15min":1.3340000000000001},"min":{"1min":1.0760000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6950000000000001,"5min":2.0539999999999998,"15min":2.5289999999999999},"last":1.3779999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.323,"15min":1.3540000000000001},"min":{"1min":0.86599999999999999,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.77,"5min":1.857,"15min":3.137},"last":1.9059999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.3069999999999999,"15min":1.357},"min":{"1min":0.90400000000000003,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":2.403,"15min":3.3620000000000001},"last":1.298}]},{"osd":6,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3460000000000001,"15min":1.417},"min":{"1min":0.90700000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.748,"5min":2.262,"15min":2.5819999999999999},"last":2.0670000000000002},{"interface":"front","average":{"1min":1.478,"5min":1.4930000000000001,"15min":1.524},"min":{"1min":1.034,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.8300000000000001,"5min":2.1070000000000002,"15min":3.3340000000000001},"last":1.5209999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:52:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.468,"15min":1.5109999999999999},"min":{"1min":1.046,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.786,"5min":2.5190000000000001,"15min":3.4900000000000002},"last":1.429},{"interface":"front","average":{"1min":1.5,"5min":1.5600000000000001,"15min":1.5840000000000001},"min":{"1min":1.151,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.758,"5min":2.4590000000000001,"15min":2.875},"last":1.722}]}]},{"osd":3,"up_from":13,"seq":55834575020,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1113,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194198,"statfs":{"total":200000000,"available":198859295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.90700000000000003,"15min":0.877},"min":{"1min":0.66600000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.494,"5min":1.494,"15min":4.4109999999999996},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0529999999999999,"15min":1.0009999999999999},"min":{"1min":0.76900000000000002,"5min":0.38600000000000001,"15min":0.35499999999999998},"max":{"1min":1.4259999999999999,"5min":1.99,"15min":3.2269999999999999},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.94799999999999995,"15min":0.91600000000000004},"min":{"1min":0.80600000000000005,"5min":0.52000000000000002,"15min":0.38100000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":2.1280000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.179,"15min":1.0820000000000001},"min":{"1min":0.86199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.458,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.198,"15min":1.1910000000000001},"min":{"1min":1.099,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0539999999999998,"5min":2.089,"15min":18.145},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.296,"15min":1.236},"min":{"1min":1.034,"5min":0.379,"15min":0.379},"max":{"1min":2.0910000000000002,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.302,"15min":1.304},"min":{"1min":1.0149999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.905,"5min":1.905,"15min":3.5110000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.456,"5min":1.379,"15min":1.3440000000000001},"min":{"1min":1.1639999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.641,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.107}]},{"osd":5,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.49,"15min":1.47},"min":{"1min":1.367,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":1.962,"5min":2.302,"15min":18.094000000000001},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.454,"15min":1.4530000000000001},"min":{"1min":1.379,"5min":0.752,"15min":0.69899999999999995},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":14.105},"last":1.004}]},{"osd":6,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.4039999999999999,"15min":1.3839999999999999},"min":{"1min":1.1519999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.7230000000000001,"5min":2.2120000000000002,"15min":3.2789999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.548,"5min":1.5329999999999999,"15min":1.4830000000000001},"min":{"1min":1.3029999999999999,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":1.8029999999999999,"5min":2.3730000000000002,"15min":4.0220000000000002},"last":1.2549999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:52:52 2023","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":1.5629999999999999,"15min":1.4850000000000001},"min":{"1min":1.4359999999999999,"5min":0.84799999999999998,"15min":0.72499999999999998},"max":{"1min":2.0129999999999999,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.149},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.5249999999999999,"15min":1.4690000000000001},"min":{"1min":1.268,"5min":0.71799999999999997,"15min":0.70799999999999996},"max":{"1min":2.0750000000000002,"5min":2.3380000000000001,"15min":3.016},"last":1.1240000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194194,"statfs":{"total":200000000,"available":198854858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.95099999999999996,"15min":0.89300000000000002},"min":{"1min":0.55900000000000005,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":1.462,"5min":1.673,"15min":1.716},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.022,"15min":0.98299999999999998},"min":{"1min":0.67500000000000004,"5min":0.39500000000000002,"15min":0.38900000000000001},"max":{"1min":1.4770000000000001,"5min":1.6970000000000001,"15min":2.9009999999999998},"last":0.74399999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.95399999999999996,"15min":0.93500000000000005},"min":{"1min":0.80600000000000005,"5min":0.42099999999999999,"15min":0.36299999999999999},"max":{"1min":1.3859999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.129,"15min":1.0760000000000001},"min":{"1min":0.72399999999999998,"5min":0.48799999999999999,"15min":0.46899999999999997},"max":{"1min":1.589,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.1799999999999999,"15min":1.1639999999999999},"min":{"1min":0.92900000000000005,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.7350000000000001,"5min":1.794,"15min":3.2850000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2969999999999999,"15min":1.212},"min":{"1min":0.94199999999999995,"5min":0.53000000000000003,"15min":0.52800000000000002},"max":{"1min":1.758,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":0.72099999999999997}]},{"osd":4,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.504,"15min":1.45},"min":{"1min":1.3560000000000001,"5min":0.93200000000000005,"15min":0.81899999999999995},"max":{"1min":1.899,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4159999999999999,"15min":1.3520000000000001},"min":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.66800000000000004},"max":{"1min":2.109,"5min":2.109,"15min":3.4500000000000002},"last":1.2450000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.4350000000000001,"15min":1.4079999999999999},"min":{"1min":1.089,"5min":0.78900000000000003,"15min":0.69599999999999995},"max":{"1min":1.948,"5min":2.0110000000000001,"15min":5.0140000000000002},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.653,"5min":1.577,"15min":1.508},"min":{"1min":1.4259999999999999,"5min":0.878,"15min":0.78700000000000003},"max":{"1min":1.9079999999999999,"5min":2.133,"15min":4.806},"last":1.163}]},{"osd":6,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.409,"15min":1.3640000000000001},"min":{"1min":0.96199999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.7090000000000001,"5min":1.976,"15min":2.5179999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5229999999999999,"15min":1.466},"min":{"1min":1.1339999999999999,"5min":0.89600000000000002,"15min":0.73399999999999999},"max":{"1min":1.931,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":0.96099999999999997}]},{"osd":7,"last update":"Wed Aug 9 12:52:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4219999999999999},"min":{"1min":1.0089999999999999,"5min":0.80300000000000005,"15min":0.76200000000000001},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":2.464},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.653,"5min":1.5900000000000001,"15min":1.556},"min":{"1min":1.2310000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9990000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.0620000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1113,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194199,"statfs":{"total":200000000,"available":198859899,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.622,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5249999999999999,"5min":1.6859999999999999,"15min":2.621},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0349999999999999,"15min":1.329},"min":{"1min":0.47099999999999997,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.46,"5min":1.6559999999999999,"15min":88.254999999999995},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.016,"15min":0.998},"min":{"1min":0.76000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.837,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.327,"15min":1.248},"min":{"1min":0.55100000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.879,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.0569999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.26,"15min":1.1819999999999999},"min":{"1min":0.503,"5min":0.436,"15min":0.436},"max":{"1min":1.6719999999999999,"5min":2.181,"15min":2.181},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.135,"5min":1.137,"15min":1.089},"min":{"1min":0.57499999999999996,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":1.506,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":0.98599999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2769999999999999,"15min":1.3380000000000001},"min":{"1min":0.83399999999999996,"5min":0.78200000000000003,"15min":0.76200000000000001},"max":{"1min":1.921,"5min":1.921,"15min":25.172000000000001},"last":0.87},{"interface":"front","average":{"1min":1.47,"5min":1.4330000000000001,"15min":1.3799999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.76,"5min":2.085,"15min":3.762},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.409,"15min":1.456},"min":{"1min":0.93100000000000005,"5min":0.80100000000000005,"15min":0.751},"max":{"1min":1.6259999999999999,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.294},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.335,"15min":1.327},"min":{"1min":1.129,"5min":0.84599999999999997,"15min":0.77900000000000003},"max":{"1min":1.5589999999999999,"5min":1.9079999999999999,"15min":3.762},"last":1.022}]},{"osd":6,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5640000000000001,"15min":1.5009999999999999},"min":{"1min":1.0289999999999999,"5min":0.93600000000000005,"15min":0.79700000000000004},"max":{"1min":1.873,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.171},{"interface":"front","average":{"1min":1.494,"5min":1.496,"15min":1.4470000000000001},"min":{"1min":1.161,"5min":0.89500000000000002,"15min":0.79500000000000004},"max":{"1min":1.8680000000000001,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.256}]},{"osd":7,"last update":"Wed Aug 9 12:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.5820000000000001,"15min":1.637},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.982,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.613,"5min":1.6220000000000001,"15min":1.653},"min":{"1min":1.1359999999999999,"5min":0.92600000000000005,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.464,"15min":28.765000000000001},"last":1.0920000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575020,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1681,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193631,"statfs":{"total":200000000,"available":198278271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90200000000000002,"15min":0.89000000000000001},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.35799999999999998},"max":{"1min":1.538,"5min":1.6259999999999999,"15min":1.819},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.109,"5min":1.0680000000000001,"15min":1.03},"min":{"1min":0.504,"5min":0.437,"15min":0.436},"max":{"1min":1.5720000000000001,"5min":1.661,"15min":6.1749999999999998},"last":1.1379999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.081,"15min":1.0269999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.53,"5min":1.6120000000000001,"15min":1.7669999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.099,"15min":1.083},"min":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":6.2549999999999999},"last":1.28}]},{"osd":3,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.034,"15min":1.0269999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.45300000000000001},"max":{"1min":1.893,"5min":1.893,"15min":9.6069999999999993},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.302,"5min":1.2509999999999999,"15min":1.212},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.56000000000000005},"max":{"1min":1.7130000000000001,"5min":1.9350000000000001,"15min":2.2730000000000001},"last":1.028}]},{"osd":4,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.391,"15min":1.3640000000000001},"min":{"1min":0.98899999999999999,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":2.286,"5min":2.286,"15min":9.9629999999999992},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.417,"15min":1.361},"min":{"1min":1.085,"5min":0.85799999999999998,"15min":0.77900000000000003},"max":{"1min":1.7649999999999999,"5min":1.825,"15min":1.879},"last":1.2350000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.3740000000000001,"15min":1.359},"min":{"1min":0.90300000000000002,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":1.8,"5min":1.8200000000000001,"15min":10.004},"last":1.099},{"interface":"front","average":{"1min":1.516,"5min":1.4830000000000001,"15min":1.431},"min":{"1min":0.95999999999999996,"5min":0.89600000000000002,"15min":0.84999999999999998},"max":{"1min":1.857,"5min":2.1419999999999999,"15min":2.161},"last":0.92200000000000004}]},{"osd":6,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.4339999999999999,"15min":1.4079999999999999},"min":{"1min":0.94299999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6839999999999999,"5min":2.1230000000000002,"15min":6.4290000000000003},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.486,"15min":1.474},"min":{"1min":1.0529999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":9.9190000000000005},"last":1.194}]},{"osd":7,"last update":"Wed Aug 9 12:52:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.486,"15min":1.4970000000000001},"min":{"1min":0.89200000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8380000000000001,"5min":2.2160000000000002,"15min":18.114000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.548,"15min":1.528},"min":{"1min":1.1220000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":9.5640000000000001},"last":1.411}]}]}],"pool_statfs":[]}} 2023-08-09T12:53:25.532 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-09T12:53:25.532 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-09T12:53:25.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.805+0000 7ffb43fff640 1 Processor -- start 2023-08-09T12:53:25.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.806+0000 7ffb43fff640 1 -- start start 2023-08-09T12:53:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.807+0000 7ffb43fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb4415a8c0 0x7ffb440b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.807+0000 7ffb43fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffb440b13f0 0x7ffb4415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.807+0000 7ffb43fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4415e7b0 con 0x7ffb4415f180 2023-08-09T12:53:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.807+0000 7ffb43fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb440b1850 con 0x7ffb440b13f0 2023-08-09T12:53:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.807+0000 7ffb43fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4415e460 con 0x7ffb4415a8c0 2023-08-09T12:53:25.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.807+0000 7ffb427fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffb440b13f0 0x7ffb4415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.807+0000 7ffb427fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffb440b13f0 0x7ffb4415ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46226/0 (socket says 172.21.15.17:46226) 2023-08-09T12:53:25.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.807+0000 7ffb427fc640 1 -- 172.21.15.17:0/4146473557 learned_addr learned my addr 172.21.15.17:0/4146473557 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.808+0000 7ffb42ffd640 1 --2- 172.21.15.17:0/4146473557 >> v2:172.21.15.142:3300/0 conn(0x7ffb4415a8c0 0x7ffb440b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.808+0000 7ffb427fc640 1 -- 172.21.15.17:0/4146473557 >> v2:172.21.15.142:3300/0 conn(0x7ffb4415a8c0 msgr2=0x7ffb440b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.808+0000 7ffb427fc640 1 --2- 172.21.15.17:0/4146473557 >> v2:172.21.15.142:3300/0 conn(0x7ffb4415a8c0 0x7ffb440b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.808+0000 7ffb427fc640 1 -- 172.21.15.17:0/4146473557 >> v1:172.21.15.142:6789/0 conn(0x7ffb4415f180 legacy=0x7ffb440b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.808+0000 7ffb427fc640 1 -- 172.21.15.17:0/4146473557 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4415aca0 con 0x7ffb440b13f0 2023-08-09T12:53:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.809+0000 7ffb427fc640 1 --2- 172.21.15.17:0/4146473557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb440b13f0 0x7ffb4415ec40 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7ffb440ce460 tx=0x7ffb3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447d90280d11706a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.810+0000 7ffb41ffb640 1 -- 172.21.15.17:0/4146473557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38031870 con 0x7ffb440b13f0 2023-08-09T12:53:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.810+0000 7ffb41ffb640 1 -- 172.21.15.17:0/4146473557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb380319d0 con 0x7ffb440b13f0 2023-08-09T12:53:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.810+0000 7ffb41ffb640 1 -- 172.21.15.17:0/4146473557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38031d60 con 0x7ffb440b13f0 2023-08-09T12:53:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.810+0000 7ffb43fff640 1 -- 172.21.15.17:0/4146473557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb440b13f0 msgr2=0x7ffb4415ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.810+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4146473557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb440b13f0 0x7ffb4415ec40 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7ffb440ce460 tx=0x7ffb3802b910 comp rx=0 tx=0).stop 2023-08-09T12:53:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.810+0000 7ffb43fff640 1 -- 172.21.15.17:0/4146473557 shutdown_connections 2023-08-09T12:53:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.810+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4146473557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb440b13f0 0x7ffb4415ec40 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.810+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4146473557 >> v2:172.21.15.142:3300/0 conn(0x7ffb4415a8c0 0x7ffb440b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.811+0000 7ffb43fff640 1 -- 172.21.15.17:0/4146473557 >> 172.21.15.17:0/4146473557 conn(0x7ffb440cb020 msgr2=0x7ffb440cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.811+0000 7ffb43fff640 1 -- 172.21.15.17:0/4146473557 shutdown_connections 2023-08-09T12:53:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.811+0000 7ffb43fff640 1 -- 172.21.15.17:0/4146473557 wait complete. 2023-08-09T12:53:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.812+0000 7ffb43fff640 1 Processor -- start 2023-08-09T12:53:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.813+0000 7ffb43fff640 1 -- start start 2023-08-09T12:53:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.813+0000 7ffb43fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb440b13f0 0x7ffb440aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.813+0000 7ffb43fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb4415a8c0 0x7ffb441f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.813+0000 7ffb43fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb4415f180 0x7ffb440ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.813+0000 7ffb43fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414f730 con 0x7ffb4415f180 2023-08-09T12:53:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.813+0000 7ffb43fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440cd2a0 con 0x7ffb4415a8c0 2023-08-09T12:53:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.813+0000 7ffb43fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441f3050 con 0x7ffb440b13f0 2023-08-09T12:53:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb4415f180 0x7ffb440ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb4415f180 0x7ffb440ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46230/0 (socket says 172.21.15.17:46230) 2023-08-09T12:53:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb437fe640 1 -- 172.21.15.17:0/4172360181 learned_addr learned my addr 172.21.15.17:0/4172360181 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb42ffd640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb440b13f0 0x7ffb440aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb427fc640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb4415a8c0 0x7ffb441f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb437fe640 1 -- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb440b13f0 msgr2=0x7ffb440aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb437fe640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb440b13f0 0x7ffb440aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb437fe640 1 -- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb4415a8c0 msgr2=0x7ffb441f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb437fe640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb4415a8c0 0x7ffb441f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb437fe640 1 -- 172.21.15.17:0/4172360181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380094d0 con 0x7ffb4415f180 2023-08-09T12:53:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.814+0000 7ffb42ffd640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb440b13f0 0x7ffb440aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.815+0000 7ffb437fe640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb4415f180 0x7ffb440ac8b0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00b970 tx=0x7ffb3c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.815+0000 7ffb2bfff640 1 -- 172.21.15.17:0/4172360181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00cb40 con 0x7ffb4415f180 2023-08-09T12:53:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.815+0000 7ffb2bfff640 1 -- 172.21.15.17:0/4172360181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c00cca0 con 0x7ffb4415f180 2023-08-09T12:53:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.815+0000 7ffb2bfff640 1 -- 172.21.15.17:0/4172360181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c014680 con 0x7ffb4415f180 2023-08-09T12:53:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.815+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb440cc690 con 0x7ffb4415f180 2023-08-09T12:53:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.815+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb440ccc50 con 0x7ffb4415f180 2023-08-09T12:53:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.817+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb440cd410 con 0x7ffb4415f180 2023-08-09T12:53:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.818+0000 7ffb2bfff640 1 -- 172.21.15.17:0/4172360181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffb3c01d3b0 con 0x7ffb4415f180 2023-08-09T12:53:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.818+0000 7ffb2bfff640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb3006a080 0x7ffb3006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.819+0000 7ffb2bfff640 1 -- 172.21.15.17:0/4172360181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb3c088330 con 0x7ffb4415f180 2023-08-09T12:53:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.819+0000 7ffb42ffd640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb3006a080 0x7ffb3006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.820+0000 7ffb42ffd640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb3006a080 0x7ffb3006c540 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ffb4414f970 tx=0x7ffb34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:25.823+0000 7ffb2bfff640 1 -- 172.21.15.17:0/4172360181 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ffb3c053ab0 con 0x7ffb4415f180 2023-08-09T12:53:26.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.091+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ffb4404e390 con 0x7ffb4415f180 2023-08-09T12:53:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.100+0000 7ffb2bfff640 1 -- 172.21.15.17:0/4172360181 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+147 (secure 0 0 0) 0x7ffb3c0570d0 con 0x7ffb4415f180 2023-08-09T12:53:26.105 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-08-09T12:53:26.105 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDUiNNkLASzBBAA9bkbdYNcojfKkQwyW361xQ== 2023-08-09T12:53:26.105 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2023-08-09T12:53:26.105 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2023-08-09T12:53:26.106 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-09T12:53:26.106 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-08-09T12:53:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.102+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb3006a080 msgr2=0x7ffb3006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.102+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb3006a080 0x7ffb3006c540 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ffb4414f970 tx=0x7ffb34008040 comp rx=0 tx=0).stop 2023-08-09T12:53:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.102+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb4415f180 msgr2=0x7ffb440ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.102+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb4415f180 0x7ffb440ac8b0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00b970 tx=0x7ffb3c00be30 comp rx=0 tx=0).stop 2023-08-09T12:53:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.103+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 shutdown_connections 2023-08-09T12:53:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.103+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ffb3006a080 0x7ffb3006c540 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.103+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb4415f180 0x7ffb440ac8b0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.103+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb4415a8c0 0x7ffb441f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.103+0000 7ffb43fff640 1 --2- 172.21.15.17:0/4172360181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb440b13f0 0x7ffb440aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.103+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 >> 172.21.15.17:0/4172360181 conn(0x7ffb440cb020 msgr2=0x7ffb440709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.103+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 shutdown_connections 2023-08-09T12:53:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.103+0000 7ffb43fff640 1 -- 172.21.15.17:0/4172360181 wait complete. 2023-08-09T12:53:26.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.359+0000 7f27c4c8e640 1 Processor -- start 2023-08-09T12:53:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.359+0000 7f27c4c8e640 1 -- start start 2023-08-09T12:53:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.360+0000 7f27c4c8e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0070a90 0x7f27c00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.360+0000 7f27c4c8e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27c00ad810 0x7f27c00c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.360+0000 7f27c4c8e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c00b4630 con 0x7f27c0159d80 2023-08-09T12:53:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.360+0000 7f27c4c8e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c015a160 con 0x7f27c00ad810 2023-08-09T12:53:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.360+0000 7f27c4c8e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00b3ab0 con 0x7f27c0070a90 2023-08-09T12:53:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.361+0000 7f27bdd9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0070a90 0x7f27c00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:26.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.361+0000 7f27bed9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27c00ad810 0x7f27c00c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:26.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.361+0000 7f27be59c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f27c0159d80 0x7f27c0070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:33304/0 (socket says 172.21.15.17:33304) 2023-08-09T12:53:26.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.361+0000 7f27be59c640 1 -- 172.21.15.17:0/741135800 learned_addr learned my addr 172.21.15.17:0/741135800 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:26.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.362+0000 7f27bed9d640 1 -- 172.21.15.17:0/741135800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0070a90 msgr2=0x7f27c00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:26.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.362+0000 7f27bed9d640 1 --2- 172.21.15.17:0/741135800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0070a90 0x7f27c00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.362+0000 7f27bed9d640 1 -- 172.21.15.17:0/741135800 >> v1:172.21.15.142:6789/0 conn(0x7f27c0159d80 legacy=0x7f27c0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:26.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.362+0000 7f27bed9d640 1 -- 172.21.15.17:0/741135800 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00b3d90 con 0x7f27c00ad810 2023-08-09T12:53:26.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.364+0000 7f27bed9d640 1 --2- 172.21.15.17:0/741135800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 0x7f27c00c8fd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f27b80097a0 tx=0x7f27b802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b74c45f103eb475 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:26.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.364+0000 7f27bd59a640 1 -- 172.21.15.17:0/741135800 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b802d040 con 0x7f27c00ad810 2023-08-09T12:53:26.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.364+0000 7f27bd59a640 1 -- 172.21.15.17:0/741135800 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b8031810 con 0x7f27c00ad810 2023-08-09T12:53:26.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.364+0000 7f27bd59a640 1 -- 172.21.15.17:0/741135800 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8031ba0 con 0x7f27c00ad810 2023-08-09T12:53:26.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.365+0000 7f27c4c8e640 1 -- 172.21.15.17:0/741135800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 msgr2=0x7f27c00c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:26.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.365+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/741135800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 0x7f27c00c8fd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f27b80097a0 tx=0x7f27b802b8b0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.365+0000 7f27c4c8e640 1 -- 172.21.15.17:0/741135800 shutdown_connections 2023-08-09T12:53:26.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.365+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/741135800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0070a90 0x7f27c00b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.365+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/741135800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 0x7f27c00c8fd0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.365+0000 7f27c4c8e640 1 -- 172.21.15.17:0/741135800 >> 172.21.15.17:0/741135800 conn(0x7f27c00cb1b0 msgr2=0x7f27c00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:26.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.365+0000 7f27c4c8e640 1 -- 172.21.15.17:0/741135800 shutdown_connections 2023-08-09T12:53:26.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.365+0000 7f27c4c8e640 1 -- 172.21.15.17:0/741135800 wait complete. 2023-08-09T12:53:26.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.367+0000 7f27c4c8e640 1 Processor -- start 2023-08-09T12:53:26.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.367+0000 7f27c4c8e640 1 -- start start 2023-08-09T12:53:26.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27c4c8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0070a90 0x7f27c0157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:26.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27c4c8e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 0x7f27c00697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:26.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27c4c8e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0159d80 0x7f27c0069d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:26.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27c4c8e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00af6b0 con 0x7f27c0070a90 2023-08-09T12:53:26.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27c4c8e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00af990 con 0x7f27c00ad810 2023-08-09T12:53:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27c4c8e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00afc70 con 0x7f27c0159d80 2023-08-09T12:53:26.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27be59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0070a90 0x7f27c0157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:26.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27be59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0070a90 0x7f27c0157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46232/0 (socket says 172.21.15.17:46232) 2023-08-09T12:53:26.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.368+0000 7f27be59c640 1 -- 172.21.15.17:0/2991918222 learned_addr learned my addr 172.21.15.17:0/2991918222 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:26.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27bed9d640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0159d80 0x7f27c0069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:26.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27bdd9b640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 0x7f27c00697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:26.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27be59c640 1 -- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0159d80 msgr2=0x7f27c0069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:26.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27be59c640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0159d80 0x7f27c0069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27be59c640 1 -- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 msgr2=0x7f27c00697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:26.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27be59c640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 0x7f27c00697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27be59c640 1 -- 172.21.15.17:0/2991918222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b8009400 con 0x7f27c0070a90 2023-08-09T12:53:26.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27be59c640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0070a90 0x7f27c0157cf0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c480 tx=0x7f27b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:26.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.369+0000 7f27b6ffd640 1 -- 172.21.15.17:0/2991918222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0005ce0 con 0x7f27c0070a90 2023-08-09T12:53:26.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.370+0000 7f27b6ffd640 1 -- 172.21.15.17:0/2991918222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b0005e40 con 0x7f27c0070a90 2023-08-09T12:53:26.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.370+0000 7f27b6ffd640 1 -- 172.21.15.17:0/2991918222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b00072f0 con 0x7f27c0070a90 2023-08-09T12:53:26.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.370+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c00aff50 con 0x7f27c0070a90 2023-08-09T12:53:26.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.370+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c00af390 con 0x7f27c0070a90 2023-08-09T12:53:26.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.371+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c00b0190 con 0x7f27c0070a90 2023-08-09T12:53:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.372+0000 7f27b6ffd640 1 -- 172.21.15.17:0/2991918222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f27b0007510 con 0x7f27c0070a90 2023-08-09T12:53:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.373+0000 7f27b6ffd640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27a406a050 0x7f27a406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.373+0000 7f27b6ffd640 1 -- 172.21.15.17:0/2991918222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27b0087ad0 con 0x7f27c0070a90 2023-08-09T12:53:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.374+0000 7f27bdd9b640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27a406a050 0x7f27a406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:26.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.375+0000 7f27bdd9b640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27a406a050 0x7f27a406c510 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f27c0158560 tx=0x7f27a800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.377+0000 7f27b6ffd640 1 -- 172.21.15.17:0/2991918222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f27c00b0190 con 0x7f27c0070a90 2023-08-09T12:53:26.394 INFO:tasks.ceph.mds.c.smithi017.stderr:2023-08-09T12:53:26.391+0000 7f2a83355640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:53:26.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.608+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27c00b2320 con 0x7f27c0070a90 2023-08-09T12:53:26.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.609+0000 7f27b6ffd640 1 -- 172.21.15.17:0/2991918222 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f27b0053260 con 0x7f27c0070a90 2023-08-09T12:53:26.613 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:26.613 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:53:26.613 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:53:26.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27a406a050 msgr2=0x7f27a406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:26.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27a406a050 0x7f27a406c510 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f27c0158560 tx=0x7f27a800b040 comp rx=0 tx=0).stop 2023-08-09T12:53:26.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0070a90 msgr2=0x7f27c0157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:26.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0070a90 0x7f27c0157cf0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c480 tx=0x7f27b000c940 comp rx=0 tx=0).stop 2023-08-09T12:53:26.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 shutdown_connections 2023-08-09T12:53:26.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f27a406a050 0x7f27a406c510 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27c0159d80 0x7f27c0069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27c00ad810 0x7f27c00697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 --2- 172.21.15.17:0/2991918222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0070a90 0x7f27c0157cf0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:26.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 >> 172.21.15.17:0/2991918222 conn(0x7f27c00cb1b0 msgr2=0x7f27c00cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:26.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 shutdown_connections 2023-08-09T12:53:26.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:26.612+0000 7f27c4c8e640 1 -- 172.21.15.17:0/2991918222 wait complete. 2023-08-09T12:53:27.037 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-09T12:53:19.914432+0000', 'modified': '2023-08-09T12:53:23.505794+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9453}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9453': {'gid': 9453, 'name': 'c', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6834/918927752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6832', 'nonce': 918927752}, {'type': 'v1', 'addr': '172.21.15.17:6834', 'nonce': 918927752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-09T12:53:27.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-09T12:53:27.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-09T12:53:27.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.280+0000 7ff8cb05e640 1 Processor -- start 2023-08-09T12:53:27.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.280+0000 7ff8cb05e640 1 -- start start 2023-08-09T12:53:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8cb05e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8c40adc40 0x7ff8c406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8cb05e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8c40b3b40 0x7ff8c40b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8cb05e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c415e8f0 0x7ff8c415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8cb05e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c40ae020 con 0x7ff8c40adc40 2023-08-09T12:53:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8cb05e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c40b2250 con 0x7ff8c40b3b40 2023-08-09T12:53:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8cb05e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40b2530 con 0x7ff8c415e8f0 2023-08-09T12:53:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8c8dfa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8c40adc40 0x7ff8c406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8c8dfa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8c40adc40 0x7ff8c406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46234/0 (socket says 172.21.15.17:46234) 2023-08-09T12:53:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.282+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/2276737553 learned_addr learned my addr 172.21.15.17:0/2276737553 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/2276737553 >> v2:172.21.15.142:3300/0 conn(0x7ff8c40b3b40 0x7ff8c40b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/2276737553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c415e8f0 0x7ff8c415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/2276737553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c415e8f0 msgr2=0x7ff8c415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/2276737553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c415e8f0 0x7ff8c415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/2276737553 >> v2:172.21.15.142:3300/0 conn(0x7ff8c40b3b40 msgr2=0x7ff8c40b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/2276737553 >> v2:172.21.15.142:3300/0 conn(0x7ff8c40b3b40 0x7ff8c40b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/2276737553 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c406fe80 con 0x7ff8c40adc40 2023-08-09T12:53:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/2276737553 >> v2:172.21.15.142:3300/0 conn(0x7ff8c40b3b40 0x7ff8c40b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.283+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/2276737553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c415e8f0 0x7ff8c415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.284+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/2276737553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40adc40 0x7ff8c406c280 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40b48a0 tx=0x7ff8c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c5e0212ae5b250 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.284+0000 7ff8bb7fe640 1 -- 172.21.15.17:0/2276737553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0031870 con 0x7ff8c40adc40 2023-08-09T12:53:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.284+0000 7ff8bb7fe640 1 -- 172.21.15.17:0/2276737553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c00319d0 con 0x7ff8c40adc40 2023-08-09T12:53:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.284+0000 7ff8bb7fe640 1 -- 172.21.15.17:0/2276737553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0031d60 con 0x7ff8c40adc40 2023-08-09T12:53:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 -- 172.21.15.17:0/2276737553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40adc40 msgr2=0x7ff8c406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/2276737553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40adc40 0x7ff8c406c280 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40b48a0 tx=0x7ff8c002b910 comp rx=0 tx=0).stop 2023-08-09T12:53:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 -- 172.21.15.17:0/2276737553 shutdown_connections 2023-08-09T12:53:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/2276737553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c415e8f0 0x7ff8c415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/2276737553 >> v2:172.21.15.142:3300/0 conn(0x7ff8c40b3b40 0x7ff8c40b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/2276737553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40adc40 0x7ff8c406c280 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 -- 172.21.15.17:0/2276737553 >> 172.21.15.17:0/2276737553 conn(0x7ff8c40cb1b0 msgr2=0x7ff8c40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 -- 172.21.15.17:0/2276737553 shutdown_connections 2023-08-09T12:53:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.285+0000 7ff8cb05e640 1 -- 172.21.15.17:0/2276737553 wait complete. 2023-08-09T12:53:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.287+0000 7ff8cb05e640 1 Processor -- start 2023-08-09T12:53:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.287+0000 7ff8cb05e640 1 -- start start 2023-08-09T12:53:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.288+0000 7ff8cb05e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40adc40 0x7ff8c415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.288+0000 7ff8cb05e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40b3b40 0x7ff8c415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.288+0000 7ff8cb05e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c415e8f0 0x7ff8c415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.288+0000 7ff8cb05e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c415b350 con 0x7ff8c40b3b40 2023-08-09T12:53:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.288+0000 7ff8cb05e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c406c210 con 0x7ff8c415e8f0 2023-08-09T12:53:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.288+0000 7ff8cb05e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c406c4f0 con 0x7ff8c40adc40 2023-08-09T12:53:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.288+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40b3b40 0x7ff8c415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40b3b40 0x7ff8c415a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46242/0 (socket says 172.21.15.17:46242) 2023-08-09T12:53:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8bbfff640 1 -- 172.21.15.17:0/3077008302 learned_addr learned my addr 172.21.15.17:0/3077008302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40adc40 0x7ff8c415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8bbfff640 1 -- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40adc40 msgr2=0x7ff8c415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c415e8f0 0x7ff8c415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40adc40 0x7ff8c415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8bbfff640 1 -- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c415e8f0 msgr2=0x7ff8c415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c415e8f0 0x7ff8c415ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8bbfff640 1 -- 172.21.15.17:0/3077008302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c00094d0 con 0x7ff8c40b3b40 2023-08-09T12:53:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40adc40 0x7ff8c415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c415e8f0 0x7ff8c415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.289+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40b3b40 0x7ff8c415a8d0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400c7c0 tx=0x7ff8b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.290+0000 7ff8b97fa640 1 -- 172.21.15.17:0/3077008302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4005b90 con 0x7ff8c40b3b40 2023-08-09T12:53:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.290+0000 7ff8b97fa640 1 -- 172.21.15.17:0/3077008302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b4005cf0 con 0x7ff8c40b3b40 2023-08-09T12:53:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.290+0000 7ff8b97fa640 1 -- 172.21.15.17:0/3077008302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4006250 con 0x7ff8c40b3b40 2023-08-09T12:53:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.290+0000 7ff8cb05e640 1 -- 172.21.15.17:0/3077008302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c41e6410 con 0x7ff8c40b3b40 2023-08-09T12:53:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.290+0000 7ff8cb05e640 1 -- 172.21.15.17:0/3077008302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c415bb20 con 0x7ff8c40b3b40 2023-08-09T12:53:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.293+0000 7ff8b97fa640 1 -- 172.21.15.17:0/3077008302 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff8b40063b0 con 0x7ff8c40b3b40 2023-08-09T12:53:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.294+0000 7ff8b97fa640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff8b006a050 0x7ff8b006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.294+0000 7ff8b97fa640 1 -- 172.21.15.17:0/3077008302 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8b4088530 con 0x7ff8c40b3b40 2023-08-09T12:53:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.295+0000 7ff8cdbce740 1 Processor -- start 2023-08-09T12:53:27.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.295+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff8b006a050 0x7ff8b006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.295+0000 7ff8cdbce740 1 -- start start 2023-08-09T12:53:27.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff8b006a050 0x7ff8b006c510 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0036000 tx=0x7ff8c003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 0x55e27e8fb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8cabd0 0x55e27e8f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e27e83c8f0 con 0x55e27e8ce7d0 2023-08-09T12:53:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e27e839fe0 con 0x55e27e8cabd0 2023-08-09T12:53:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e27e8358d0 con 0x55e27e8fac50 2023-08-09T12:53:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8c95fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8c95fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8f8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46246/0 (socket says 172.21.15.17:46246) 2023-08-09T12:53:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.296+0000 7ff8c95fb640 1 -- 172.21.15.17:0/408370714 learned_addr learned my addr 172.21.15.17:0/408370714 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8cabd0 0x55e27e8f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 0x55e27e8fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8c95fb640 1 -- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 msgr2=0x55e27e8fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 0x55e27e8fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8c95fb640 1 -- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8cabd0 msgr2=0x55e27e8f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8cabd0 0x55e27e8f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8c95fb640 1 -- 172.21.15.17:0/408370714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e27e7eeac0 con 0x55e27e8ce7d0 2023-08-09T12:53:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 0x55e27e8fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8f8400 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc007f80 tx=0x7ff8bc00d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f231d2c581cba5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8aa7fc640 1 -- 172.21.15.17:0/408370714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00f920 con 0x55e27e8ce7d0 2023-08-09T12:53:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8aa7fc640 1 -- 172.21.15.17:0/408370714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00fa80 con 0x55e27e8ce7d0 2023-08-09T12:53:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.297+0000 7ff8aa7fc640 1 -- 172.21.15.17:0/408370714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00fe10 con 0x55e27e8ce7d0 2023-08-09T12:53:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 -- 172.21.15.17:0/408370714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 msgr2=0x55e27e8f8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8f8400 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc007f80 tx=0x7ff8bc00d800 comp rx=0 tx=0).stop 2023-08-09T12:53:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 -- 172.21.15.17:0/408370714 shutdown_connections 2023-08-09T12:53:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8f8400 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8cabd0 0x55e27e8f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/408370714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 0x55e27e8fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 -- 172.21.15.17:0/408370714 >> 172.21.15.17:0/408370714 conn(0x55e27e8ccee0 msgr2=0x55e27e915a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:27.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 -- 172.21.15.17:0/408370714 shutdown_connections 2023-08-09T12:53:27.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.298+0000 7ff8cdbce740 1 -- 172.21.15.17:0/408370714 wait complete. 2023-08-09T12:53:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.299+0000 7ff8cdbce740 1 -- start start 2023-08-09T12:53:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.299+0000 7ff8cdbce740 1 Processor -- start 2023-08-09T12:53:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.300+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.300+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fac50 0x55e27e8fda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.300+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 0x55e27e902b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.300+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e27e7d5d40 con 0x55e27e8ce7d0 2023-08-09T12:53:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.300+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e27e7d59e0 con 0x55e27e8fac50 2023-08-09T12:53:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.300+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e27e59bf20 con 0x55e27e8fdf80 2023-08-09T12:53:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.300+0000 7ff8cdbce740 10 client.0 _ll_register_callbacks cb 0x55e27e7ee160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:53:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8e9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46252/0 (socket says 172.21.15.17:46252) 2023-08-09T12:53:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/1458299744 learned_addr learned my addr 172.21.15.17:0/1458299744 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fac50 0x55e27e8fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 0x55e27e902b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 msgr2=0x55e27e902b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 0x55e27e902b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fac50 msgr2=0x55e27e8fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fac50 0x55e27e8fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/1458299744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc007bb0 con 0x55e27e8ce7d0 2023-08-09T12:53:27.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fac50 0x55e27e8fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:27.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8e9090 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7ff8c002bf20 tx=0x7ff8c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f366b5b9eab28192 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.301+0000 7ff8a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:53:27.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8a37fe640 1 -- 172.21.15.17:0/1458299744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0046db0 con 0x55e27e8ce7d0 2023-08-09T12:53:27.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8a37fe640 1 -- 172.21.15.17:0/1458299744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8c002d040 con 0x55e27e8ce7d0 2023-08-09T12:53:27.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8cdbce740 1 -- 172.21.15.17:0/1458299744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e27e80d500 con 0x55e27e8ce7d0 2023-08-09T12:53:27.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8a37fe640 1 -- 172.21.15.17:0/1458299744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8c004e3f0 con 0x55e27e8ce7d0 2023-08-09T12:53:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8cdbce740 10 client.9591 fetch_fsmap learned FSMap version 93 2023-08-09T12:53:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8cdbce740 1 -- 172.21.15.17:0/1458299744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55e27e833f50 con 0x55e27e8ce7d0 2023-08-09T12:53:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8a37fe640 1 -- 172.21.15.17:0/1458299744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e27e80d500 con 0x55e27e8ce7d0 2023-08-09T12:53:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8a37fe640 1 -- 172.21.15.17:0/1458299744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff8c004e550 con 0x55e27e8ce7d0 2023-08-09T12:53:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.302+0000 7ff8cdbce740 10 client.9591 fetch_fsmap finished waiting for FSMap version 93 2023-08-09T12:53:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.303+0000 7ff8cdbce740 10 client.9591 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T12:53:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.303+0000 7ff8cdbce740 20 client.9591 populate_metadata read hostname 'smithi017' 2023-08-09T12:53:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.303+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] conn(0x55e27e925b80 0x55e27e925f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.303+0000 7ff8cdbce740 4 client.9591 mds_command: new command op to 9453 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-09T12:53:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.303+0000 7ff8cdbce740 1 -- 172.21.15.17:0/1458299744 --> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e27e80abc0 con 0x55e27e925b80 2023-08-09T12:53:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.303+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] conn(0x55e27e925b80 0x55e27e925f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.303+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] conn(0x55e27e925b80 0x55e27e925f60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99830b8beecc637a server_cookie=15a95c39ed26aea3 in_seq=0 out_seq=0 2023-08-09T12:53:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.303+0000 7ff8a37fe640 10 client.9591 ms_handle_connect on v2:172.21.15.17:6832/918927752 2023-08-09T12:53:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8a37fe640 1 -- 172.21.15.17:0/1458299744 <== mds.0 v2:172.21.15.17:6832/918927752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e27e80abc0 con 0x55e27e925b80 2023-08-09T12:53:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8a37fe640 10 client.9591 handle_command_reply: tid=0 2023-08-09T12:53:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 client.9591 shutdown 2023-08-09T12:53:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 -- 172.21.15.17:0/1458299744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 msgr2=0x55e27e8e9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8e9090 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7ff8c002bf20 tx=0x7ff8c0004730 comp rx=0 tx=0).stop 2023-08-09T12:53:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 -- 172.21.15.17:0/1458299744 shutdown_connections 2023-08-09T12:53:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] conn(0x55e27e925b80 0x55e27e925f60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 0x55e27e902b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fac50 0x55e27e8fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/1458299744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e8e9090 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8a37fe640 0 client.9591 ms_handle_reset on v2:172.21.15.17:6832/918927752 2023-08-09T12:53:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.304+0000 7ff8cdbce740 1 -- 172.21.15.17:0/1458299744 >> 172.21.15.17:0/1458299744 conn(0x55e27e8cabd0 msgr2=0x55e27e8fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.305+0000 7ff8cdbce740 1 -- 172.21.15.17:0/1458299744 shutdown_connections 2023-08-09T12:53:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.305+0000 7ff8cdbce740 1 -- 172.21.15.17:0/1458299744 wait complete. 2023-08-09T12:53:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.305+0000 7ff8cdbce740 20 client.9591 trim_cache size 0 max 16384 2023-08-09T12:53:27.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.322+0000 7ff8cdbce740 1 Processor -- start 2023-08-09T12:53:27.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.322+0000 7ff8cdbce740 1 -- start start 2023-08-09T12:53:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8ce7d0 0x55e27e926280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8fac50 0x55e27e9267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 0x55e27e8fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e27e9288d0 con 0x55e27e8fac50 2023-08-09T12:53:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e27e8d1200 con 0x55e27e8ce7d0 2023-08-09T12:53:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e27e867010 con 0x55e27e8fdf80 2023-08-09T12:53:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8fac50 0x55e27e9267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8fac50 0x55e27e9267c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46256/0 (socket says 172.21.15.17:46256) 2023-08-09T12:53:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.323+0000 7ff8bbfff640 1 -- 172.21.15.17:0/3506448281 learned_addr learned my addr 172.21.15.17:0/3506448281 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8bbfff640 1 -- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 msgr2=0x55e27e8fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 0x55e27e8fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8ce7d0 0x55e27e926280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 0x55e27e8fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8bbfff640 1 -- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8ce7d0 msgr2=0x55e27e926280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8ce7d0 0x55e27e926280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8bbfff640 1 -- 172.21.15.17:0/3506448281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e27e867300 con 0x55e27e8fac50 2023-08-09T12:53:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8ce7d0 0x55e27e926280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8fac50 0x55e27e9267c0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4086860 tx=0x7ff8b405d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f331e2a2d36d971 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8aaffd640 1 -- 172.21.15.17:0/3506448281 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4086970 con 0x55e27e8fac50 2023-08-09T12:53:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8aaffd640 1 -- 172.21.15.17:0/3506448281 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b4055be0 con 0x55e27e8fac50 2023-08-09T12:53:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.324+0000 7ff8aaffd640 1 -- 172.21.15.17:0/3506448281 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4006660 con 0x55e27e8fac50 2023-08-09T12:53:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3506448281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8fac50 msgr2=0x55e27e9267c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8fac50 0x55e27e9267c0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4086860 tx=0x7ff8b405d040 comp rx=0 tx=0).stop 2023-08-09T12:53:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3506448281 shutdown_connections 2023-08-09T12:53:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fdf80 0x55e27e8fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8fac50 0x55e27e9267c0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3506448281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8ce7d0 0x55e27e926280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3506448281 >> 172.21.15.17:0/3506448281 conn(0x55e27e8cabd0 msgr2=0x55e27e903930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3506448281 shutdown_connections 2023-08-09T12:53:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.325+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3506448281 wait complete. 2023-08-09T12:53:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.326+0000 7ff8cdbce740 1 -- start start 2023-08-09T12:53:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.326+0000 7ff8cdbce740 1 Processor -- start 2023-08-09T12:53:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e986970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 0x55e27e926280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8cdbce740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fdf80 0x55e27e9267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e27e986eb0 con 0x55e27e8ce7d0 2023-08-09T12:53:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e27e936aa0 con 0x55e27e8fdf80 2023-08-09T12:53:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8cdbce740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e27e8fce40 con 0x55e27e8fac50 2023-08-09T12:53:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8cdbce740 10 client.0 _ll_register_callbacks cb 0x7ff8c00096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-09T12:53:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8c8dfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e986970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8c8dfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e986970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46262/0 (socket says 172.21.15.17:46262) 2023-08-09T12:53:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.327+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/3942754545 learned_addr learned my addr 172.21.15.17:0/3942754545 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/3942754545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 msgr2=0x55e27e926280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 0x55e27e926280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fdf80 0x55e27e9267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/3942754545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fdf80 msgr2=0x55e27e9267c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fdf80 0x55e27e9267c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8c8dfa640 1 -- 172.21.15.17:0/3942754545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c415bb20 con 0x55e27e8ce7d0 2023-08-09T12:53:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8c95fb640 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fdf80 0x55e27e9267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:27.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8c8dfa640 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e986970 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7ff8c002b950 tx=0x7ff8c0031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cb912fb626a4af server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.328+0000 7ff8a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-08-09T12:53:27.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8a37fe640 1 -- 172.21.15.17:0/3942754545 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0004230 con 0x55e27e8ce7d0 2023-08-09T12:53:27.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8a37fe640 1 -- 172.21.15.17:0/3942754545 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8c0004390 con 0x55e27e8ce7d0 2023-08-09T12:53:27.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3942754545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e27e85d800 con 0x55e27e8ce7d0 2023-08-09T12:53:27.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8a37fe640 1 -- 172.21.15.17:0/3942754545 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8c0003610 con 0x55e27e8ce7d0 2023-08-09T12:53:27.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8cdbce740 10 client.9597 fetch_fsmap learned FSMap version 93 2023-08-09T12:53:27.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3942754545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55e27e7d4a10 con 0x55e27e8ce7d0 2023-08-09T12:53:27.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8a37fe640 1 -- 172.21.15.17:0/3942754545 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e27e85d800 con 0x55e27e8ce7d0 2023-08-09T12:53:27.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8a37fe640 1 -- 172.21.15.17:0/3942754545 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff8c0003770 con 0x55e27e8ce7d0 2023-08-09T12:53:27.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8cdbce740 10 client.9597 fetch_fsmap finished waiting for FSMap version 93 2023-08-09T12:53:27.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8cdbce740 10 client.9597 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-09T12:53:27.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8cdbce740 20 client.9597 populate_metadata read hostname 'smithi017' 2023-08-09T12:53:27.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.329+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] conn(0x55e27e914e70 0x55e27e915250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.330+0000 7ff8cdbce740 4 client.9597 mds_command: new command op to 9453 tid=0[{"prefix": "status"}] 2023-08-09T12:53:27.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.330+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3942754545 --> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e27e82e8b0 con 0x55e27e914e70 2023-08-09T12:53:27.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.330+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] conn(0x55e27e914e70 0x55e27e915250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.330+0000 7ff8bbfff640 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] conn(0x55e27e914e70 0x55e27e915250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e992457d603ad4 server_cookie=14b6162429f7294d in_seq=0 out_seq=0 2023-08-09T12:53:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.330+0000 7ff8a37fe640 10 client.9597 ms_handle_connect on v2:172.21.15.17:6832/918927752 2023-08-09T12:53:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8a37fe640 1 -- 172.21.15.17:0/3942754545 <== mds.0 v2:172.21.15.17:6832/918927752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55e27e82e8b0 con 0x55e27e914e70 2023-08-09T12:53:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8a37fe640 10 client.9597 handle_command_reply: tid=0 2023-08-09T12:53:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 client.9597 shutdown 2023-08-09T12:53:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3942754545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 msgr2=0x55e27e986970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e986970 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7ff8c002b950 tx=0x7ff8c0031000 comp rx=0 tx=0).stop 2023-08-09T12:53:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3942754545 shutdown_connections 2023-08-09T12:53:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.17:6832/918927752,v1:172.21.15.17:6834/918927752] conn(0x55e27e914e70 0x55e27e915250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e27e8fdf80 0x55e27e9267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e27e8fac50 0x55e27e926280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 --2- 172.21.15.17:0/3942754545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e27e8ce7d0 0x55e27e986970 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8a37fe640 0 client.9597 ms_handle_reset on v2:172.21.15.17:6832/918927752 2023-08-09T12:53:27.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3942754545 >> 172.21.15.17:0/3942754545 conn(0x55e27e8cabd0 msgr2=0x55e27e8fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:27.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3942754545 shutdown_connections 2023-08-09T12:53:27.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 1 -- 172.21.15.17:0/3942754545 wait complete. 2023-08-09T12:53:27.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.331+0000 7ff8cdbce740 20 client.9597 trim_cache size 0 max 16384 2023-08-09T12:53:27.341 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:27.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:27.341 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-08-09T12:53:27.342 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 9453, 2023-08-09T12:53:27.342 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-08-09T12:53:27.342 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-08-09T12:53:27.342 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-08-09T12:53:27.342 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.844064404, 2023-08-09T12:53:27.342 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 93, 2023-08-09T12:53:27.342 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 191, 2023-08-09T12:53:27.342 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 191, 2023-08-09T12:53:27.343 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 12.85114651 2023-08-09T12:53:27.343 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:27.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 -- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff8b006a050 msgr2=0x7ff8b006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff8b006a050 0x7ff8b006c510 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0036000 tx=0x7ff8c003c040 comp rx=0 tx=0).stop 2023-08-09T12:53:27.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 -- 172.21.15.17:0/3077008302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40b3b40 msgr2=0x7ff8c415a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40b3b40 0x7ff8c415a8d0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400c7c0 tx=0x7ff8b400cc80 comp rx=0 tx=0).stop 2023-08-09T12:53:27.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 -- 172.21.15.17:0/3077008302 shutdown_connections 2023-08-09T12:53:27.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff8b006a050 0x7ff8b006c510 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c415e8f0 0x7ff8c415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c40b3b40 0x7ff8c415a8d0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 --2- 172.21.15.17:0/3077008302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8c40adc40 0x7ff8c415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 -- 172.21.15.17:0/3077008302 >> 172.21.15.17:0/3077008302 conn(0x7ff8c40cb1b0 msgr2=0x7ff8c415d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:27.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 -- 172.21.15.17:0/3077008302 shutdown_connections 2023-08-09T12:53:27.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.332+0000 7ff8cb05e640 1 -- 172.21.15.17:0/3077008302 wait complete. 2023-08-09T12:53:27.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:53:27.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.592+0000 7f07ec542640 1 Processor -- start 2023-08-09T12:53:27.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.592+0000 7f07ec542640 1 -- start start 2023-08-09T12:53:27.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.594+0000 7f07ec542640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07e4161280 0x7f07e40c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.594+0000 7f07ec542640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e415df30 con 0x7f07e4161660 2023-08-09T12:53:27.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.594+0000 7f07ec542640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e40ca9d0 con 0x7f07e40acfc0 2023-08-09T12:53:27.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.594+0000 7f07ec542640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e415d430 con 0x7f07e4161280 2023-08-09T12:53:27.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.594+0000 7f07e9add640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f07e4161660 0x7f07e40ac8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49020/0 (socket says 172.21.15.17:49020) 2023-08-09T12:53:27.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.594+0000 7f07e9add640 1 -- 172.21.15.17:0/359230789 learned_addr learned my addr 172.21.15.17:0/359230789 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:27.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727577170 0 0) 0x7f07e415df30 con 0x7f07e4161660 2023-08-09T12:53:27.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d0003520 con 0x7f07e4161660 2023-08-09T12:53:27.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07ea2de640 1 --2- 172.21.15.17:0/359230789 >> v2:172.21.15.142:3300/0 conn(0x7f07e4161280 0x7f07e40c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 359217010 0 0) 0x7f07d0003520 con 0x7f07e4161660 2023-08-09T12:53:27.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 >> v2:172.21.15.142:3300/0 conn(0x7f07e4161280 msgr2=0x7f07e40c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07e92dc640 1 --2- 172.21.15.17:0/359230789 >> v2:172.21.15.142:3300/0 conn(0x7f07e4161280 0x7f07e40c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 >> v1:172.21.15.142:6789/0 conn(0x7f07e40acfc0 legacy=0x7f07e40cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e415e3c0 con 0x7f07e4161660 2023-08-09T12:53:27.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.595+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f07d40017f0 con 0x7f07e4161660 2023-08-09T12:53:27.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 >> v1:172.21.15.17:6789/0 conn(0x7f07e4161660 legacy=0x7f07e40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07e92dc640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07d0003970 0x7f07d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07e92dc640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d00047c0 0x7f07d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07e92dc640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d00052a0 0x7f07d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d000c140 con 0x7f07d0003970 2023-08-09T12:53:27.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d000c2b0 con 0x7f07d00047c0 2023-08-09T12:53:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d000c470 con 0x7f07d00052a0 2023-08-09T12:53:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07ea2de640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07d0003970 0x7f07d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07e9add640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d00047c0 0x7f07d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.596+0000 7f07eaadf640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d00052a0 0x7f07d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.597+0000 7f07ea2de640 1 -- 172.21.15.17:0/359230789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d00052a0 msgr2=0x7f07d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.597+0000 7f07ea2de640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d00052a0 0x7f07d000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.597+0000 7f07ea2de640 1 -- 172.21.15.17:0/359230789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d00047c0 msgr2=0x7f07d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.597+0000 7f07ea2de640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07d00047c0 0x7f07d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.597+0000 7f07ea2de640 1 -- 172.21.15.17:0/359230789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0003520 con 0x7f07d0003970 2023-08-09T12:53:27.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.597+0000 7f07eaadf640 1 -- 172.21.15.17:0/359230789 reap_dead start 2023-08-09T12:53:27.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.598+0000 7f07ea2de640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07d0003970 0x7f07d0003d90 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f07e000ba00 tx=0x7f07d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d783ed49ce92e2f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.598+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e00325f0 con 0x7f07d0003970 2023-08-09T12:53:27.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.598+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0032750 con 0x7f07d0003970 2023-08-09T12:53:27.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.598+0000 7f07e92dc640 1 -- 172.21.15.17:0/359230789 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0032ae0 con 0x7f07d0003970 2023-08-09T12:53:27.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.599+0000 7f07ec542640 1 -- 172.21.15.17:0/359230789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07d0003970 msgr2=0x7f07d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.599+0000 7f07ec542640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07d0003970 0x7f07d0003d90 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f07e000ba00 tx=0x7f07d00057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.599+0000 7f07ec542640 1 -- 172.21.15.17:0/359230789 shutdown_connections 2023-08-09T12:53:27.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.599+0000 7f07ec542640 1 --2- 172.21.15.17:0/359230789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07d0003970 0x7f07d0003d90 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.599+0000 7f07ec542640 1 -- 172.21.15.17:0/359230789 >> 172.21.15.17:0/359230789 conn(0x7f07e40cb1b0 msgr2=0x7f07e40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:27.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.599+0000 7f07ec542640 1 -- 172.21.15.17:0/359230789 shutdown_connections 2023-08-09T12:53:27.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.599+0000 7f07ec542640 1 -- 172.21.15.17:0/359230789 wait complete. 2023-08-09T12:53:27.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.601+0000 7f07ec542640 1 Processor -- start 2023-08-09T12:53:27.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.601+0000 7f07ec542640 1 -- start start 2023-08-09T12:53:27.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07ec542640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0003970 0x7f07e4154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07ec542640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e40c3220 0x7f07e40ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07ec542640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e40c4830 0x7f07e40aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07ec542640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e41f2670 con 0x7f07e40c3220 2023-08-09T12:53:27.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07ec542640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40c3790 con 0x7f07e40c4830 2023-08-09T12:53:27.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07ec542640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40c3a70 con 0x7f07d0003970 2023-08-09T12:53:27.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07e9add640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e40c3220 0x7f07e40ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07e9add640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e40c3220 0x7f07e40ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46286/0 (socket says 172.21.15.17:46286) 2023-08-09T12:53:27.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.602+0000 7f07e9add640 1 -- 172.21.15.17:0/3977827872 learned_addr learned my addr 172.21.15.17:0/3977827872 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:27.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07ea2de640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0003970 0x7f07e4154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07eaadf640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e40c4830 0x7f07e40aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07e9add640 1 -- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0003970 msgr2=0x7f07e4154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07e9add640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0003970 0x7f07e4154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07e9add640 1 -- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e40c4830 msgr2=0x7f07e40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07e9add640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e40c4830 0x7f07e40aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07e9add640 1 -- 172.21.15.17:0/3977827872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e40c3d50 con 0x7f07e40c3220 2023-08-09T12:53:27.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07e9add640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e40c3220 0x7f07e40ae4d0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f07d400f8b0 tx=0x7f07d400fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07daffd640 1 -- 172.21.15.17:0/3977827872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40072e0 con 0x7f07e40c3220 2023-08-09T12:53:27.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07daffd640 1 -- 172.21.15.17:0/3977827872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4007440 con 0x7f07e40c3220 2023-08-09T12:53:27.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07daffd640 1 -- 172.21.15.17:0/3977827872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40057a0 con 0x7f07e40c3220 2023-08-09T12:53:27.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.603+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e40c4030 con 0x7f07e40c3220 2023-08-09T12:53:27.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.604+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e4154b50 con 0x7f07e40c3220 2023-08-09T12:53:27.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.605+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e40c4550 con 0x7f07e40c3220 2023-08-09T12:53:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.606+0000 7f07daffd640 1 -- 172.21.15.17:0/3977827872 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f07d4005900 con 0x7f07e40c3220 2023-08-09T12:53:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.607+0000 7f07daffd640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07c806a050 0x7f07c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.607+0000 7f07daffd640 1 -- 172.21.15.17:0/3977827872 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07d4088870 con 0x7f07e40c3220 2023-08-09T12:53:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.607+0000 7f07ea2de640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07c806a050 0x7f07c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:27.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.608+0000 7f07ea2de640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07c806a050 0x7f07c806c510 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f07d0004740 tx=0x7f07e003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:27.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.611+0000 7f07daffd640 1 -- 172.21.15.17:0/3977827872 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f07e40c4550 con 0x7f07e40c3220 2023-08-09T12:53:27.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.839+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f07e40c4550 con 0x7f07e40c3220 2023-08-09T12:53:27.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.840+0000 7f07daffd640 1 -- 172.21.15.17:0/3977827872 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7f07e40c4550 con 0x7f07e40c3220 2023-08-09T12:53:27.843 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:53:27.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.842+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07c806a050 msgr2=0x7f07c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07c806a050 0x7f07c806c510 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f07d0004740 tx=0x7f07e003d040 comp rx=0 tx=0).stop 2023-08-09T12:53:27.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e40c3220 msgr2=0x7f07e40ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:27.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e40c3220 0x7f07e40ae4d0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f07d400f8b0 tx=0x7f07d400fd70 comp rx=0 tx=0).stop 2023-08-09T12:53:27.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 shutdown_connections 2023-08-09T12:53:27.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f07c806a050 0x7f07c806c510 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07e40c4830 0x7f07e40aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e40c3220 0x7f07e40ae4d0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 --2- 172.21.15.17:0/3977827872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07d0003970 0x7f07e4154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:27.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 >> 172.21.15.17:0/3977827872 conn(0x7f07e40cb1b0 msgr2=0x7f07e415fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:27.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 shutdown_connections 2023-08-09T12:53:27.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:27.843+0000 7f07ec542640 1 -- 172.21.15.17:0/3977827872 wait complete. 2023-08-09T12:53:27.867 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:53:27.868 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:53:27.868 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-08-09T12:53:27.869 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-09T12:53:27.870 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-09T12:53:27.870 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:53:27.871 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:53:27.871 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:53:27.872 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:53:27.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:27.874 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-08-09T12:53:27.930 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:53:27.931 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:53:27.931 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:53:27.931 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:27.931 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-08-09T12:53:27.931 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:27.931 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:53:27.932 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:27.932 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-08-09T12:53:27.932 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:53:27.932 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:27.932 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-08-09T12:53:27.933 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:53:27.933 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:27.933 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-08-09T12:53:27.933 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-09T12:53:27.933 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41372sec preferred_lft 41372sec 2023-08-09T12:53:27.933 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-08-09T12:53:27.933 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:27.934 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:53:27.934 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:27.934 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-08-09T12:53:27.934 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:53:27.934 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:27.934 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:53:27.935 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:27.936 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::18ca:aaff:fe51:1153/64 scope link 2023-08-09T12:53:27.936 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:27.936 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:53:27.936 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 16:ba:8d:c1:26:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:53:27.936 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::14ba:8dff:fec1:26f9/64 scope link 2023-08-09T12:53:27.936 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:27.937 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:53:27.937 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether fa:7b:bf:52:49:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:53:27.937 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::f87b:bfff:fe52:49ef/64 scope link 2023-08-09T12:53:27.937 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:27.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:27.938 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:53:28.041 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-08-09T12:53:28.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:28.046 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-08-09T12:53:28.107 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-08-09T12:53:28.108 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:53:28.108 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-09T12:53:28.108 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-09T12:53:28.108 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:53:28.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:28.109 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-08-09T12:53:28.109 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-08-09T12:53:28.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-09T12:53:28.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-09T12:53:28.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-09T12:53:28.110 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-08-09T12:53:28.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:28.306 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:53:28.358 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:53:28.359 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:53:28.359 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:53:28.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:28.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-08-09T12:53:28.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:53:28.460 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-09T12:53:28.520 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-09T12:53:28.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:53:28.521 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:53:28.576 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:53:28.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:28.577 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:53:28.731 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:53:28.731 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:53:28.732 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:53:28.755 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:53:28.755 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:53:28.755 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:53:28.755 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:53:28.756 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:53:28.780 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-09T12:53:28.780 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-09T12:53:28.780 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-08-09T12:53:28.780 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:53:28.780 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:53:28.781 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:53:28.781 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:53:28.781 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:53:28.784 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-09T12:53:28.784 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:53:28.784 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:53:28.784 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:53:28.785 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:53:28.788 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:53:28.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:28.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-09T12:53:28.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:28.883 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:53:28.951 INFO:teuthology.orchestra.run.smithi017.stdout:client6401 2023-08-09T12:53:28.951 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:53:28.952 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:29.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-09T12:53:29.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.236+0000 7ff962c57640 1 Processor -- start 2023-08-09T12:53:29.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.236+0000 7ff962c57640 1 -- start start 2023-08-09T12:53:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.238+0000 7ff962c57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0d30e0 0x7ff95c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.238+0000 7ff962c57640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95c0cdd10 con 0x7ff95c1616e0 2023-08-09T12:53:29.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.238+0000 7ff962c57640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95c0cdff0 con 0x7ff95c15ce90 2023-08-09T12:53:29.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.238+0000 7ff962c57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c0b6540 con 0x7ff95c0d30e0 2023-08-09T12:53:29.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.238+0000 7ff95bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff95c1616e0 0x7ff95c0d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57898/0 (socket says 172.21.15.17:57898) 2023-08-09T12:53:29.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.238+0000 7ff95bfff640 1 -- 172.21.15.17:0/374380164 learned_addr learned my addr 172.21.15.17:0/374380164 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff9611f4640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0d30e0 0x7ff95c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008125112 0 0) 0x7ff95c0cdd10 con 0x7ff95c1616e0 2023-08-09T12:53:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94c003520 con 0x7ff95c1616e0 2023-08-09T12:53:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 254562283 0 0) 0x7ff94c003520 con 0x7ff95c1616e0 2023-08-09T12:53:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0d30e0 msgr2=0x7ff95c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0d30e0 0x7ff95c0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 >> v1:172.21.15.142:6789/0 conn(0x7ff95c15ce90 legacy=0x7ff95c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c0ce2d0 con 0x7ff95c1616e0 2023-08-09T12:53:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff948001690 con 0x7ff95c1616e0 2023-08-09T12:53:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 >> v1:172.21.15.17:6789/0 conn(0x7ff95c1616e0 legacy=0x7ff95c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff94c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.239+0000 7ff95b7fe640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0d30e0 0x7ff94c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff95b7fe640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94c004d00 0x7ff94c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c0b6540 con 0x7ff94c0039a0 2023-08-09T12:53:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c00bb10 con 0x7ff94c004d00 2023-08-09T12:53:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c00bcd0 con 0x7ff95c0d30e0 2023-08-09T12:53:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff9609f3640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff94c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff95bfff640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0d30e0 0x7ff94c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff9611f4640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94c004d00 0x7ff94c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff9609f3640 1 -- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0d30e0 msgr2=0x7ff94c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff9609f3640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0d30e0 0x7ff94c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff9609f3640 1 -- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94c004d00 msgr2=0x7ff94c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff9609f3640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94c004d00 0x7ff94c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff9609f3640 1 -- 172.21.15.17:0/374380164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c003520 con 0x7ff94c0039a0 2023-08-09T12:53:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.240+0000 7ff9611f4640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94c004d00 0x7ff94c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.241+0000 7ff9609f3640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff94c003dc0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7ff950001750 tx=0x7ff94c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d59badbe6a795a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500052d0 con 0x7ff94c0039a0 2023-08-09T12:53:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95002e050 con 0x7ff94c0039a0 2023-08-09T12:53:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff95b7fe640 1 -- 172.21.15.17:0/374380164 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500035f0 con 0x7ff94c0039a0 2023-08-09T12:53:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff962c57640 1 -- 172.21.15.17:0/374380164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 msgr2=0x7ff94c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff962c57640 1 --2- 172.21.15.17:0/374380164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff94c003dc0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7ff950001750 tx=0x7ff94c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff9611f4640 1 -- 172.21.15.17:0/374380164 reap_dead start 2023-08-09T12:53:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff962c57640 1 -- 172.21.15.17:0/374380164 shutdown_connections 2023-08-09T12:53:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff962c57640 1 -- 172.21.15.17:0/374380164 >> 172.21.15.17:0/374380164 conn(0x7ff95c06fde0 msgr2=0x7ff95c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff962c57640 1 -- 172.21.15.17:0/374380164 shutdown_connections 2023-08-09T12:53:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.242+0000 7ff962c57640 1 -- 172.21.15.17:0/374380164 wait complete. 2023-08-09T12:53:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.244+0000 7ff962c57640 1 Processor -- start 2023-08-09T12:53:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.244+0000 7ff962c57640 1 -- start start 2023-08-09T12:53:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.245+0000 7ff962c57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff95c15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.245+0000 7ff962c57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0cc9c0 0x7ff95c0a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.245+0000 7ff962c57640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff95c15f620 0x7ff95c15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.245+0000 7ff962c57640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c15ffe0 con 0x7ff94c0039a0 2023-08-09T12:53:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.245+0000 7ff962c57640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c0cb920 con 0x7ff95c15f620 2023-08-09T12:53:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.245+0000 7ff962c57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c0cbc00 con 0x7ff95c0cc9c0 2023-08-09T12:53:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff95c15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff95c15a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48804/0 (socket says 172.21.15.17:48804) 2023-08-09T12:53:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 -- 172.21.15.17:0/4099583760 learned_addr learned my addr 172.21.15.17:0/4099583760 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff95bfff640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0cc9c0 0x7ff95c0a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 -- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0cc9c0 msgr2=0x7ff95c0a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0cc9c0 0x7ff95c0a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 -- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff95c15f620 msgr2=0x7ff95c15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff95c15f620 0x7ff95c15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 -- 172.21.15.17:0/4099583760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c0cbee0 con 0x7ff94c0039a0 2023-08-09T12:53:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.246+0000 7ff9609f3640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff95c15a070 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7ff95002bc30 tx=0x7ff950001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.247+0000 7ff9597fa640 1 -- 172.21.15.17:0/4099583760 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500076c0 con 0x7ff94c0039a0 2023-08-09T12:53:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.247+0000 7ff9597fa640 1 -- 172.21.15.17:0/4099583760 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950007a30 con 0x7ff94c0039a0 2023-08-09T12:53:29.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.247+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95c0cc1c0 con 0x7ff94c0039a0 2023-08-09T12:53:29.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.247+0000 7ff9597fa640 1 -- 172.21.15.17:0/4099583760 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950006c00 con 0x7ff94c0039a0 2023-08-09T12:53:29.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.247+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95c15a5b0 con 0x7ff94c0039a0 2023-08-09T12:53:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.248+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95c067a80 con 0x7ff94c0039a0 2023-08-09T12:53:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.249+0000 7ff9597fa640 1 -- 172.21.15.17:0/4099583760 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff9500035f0 con 0x7ff94c0039a0 2023-08-09T12:53:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.250+0000 7ff9597fa640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff94006a080 0x7ff94006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.250+0000 7ff9597fa640 1 -- 172.21.15.17:0/4099583760 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9500aa380 con 0x7ff94c0039a0 2023-08-09T12:53:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.251+0000 7ff95bfff640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff94006a080 0x7ff94006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.252+0000 7ff95bfff640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff94006a080 0x7ff94006c540 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff948001050 tx=0x7ff948001d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.255+0000 7ff9597fa640 1 -- 172.21.15.17:0/4099583760 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff950079460 con 0x7ff94c0039a0 2023-08-09T12:53:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.486+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff95c0d0ad0 con 0x7ff94c0039a0 2023-08-09T12:53:29.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.486+0000 7ff9597fa640 1 -- 172.21.15.17:0/4099583760 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff950078ff0 con 0x7ff94c0039a0 2023-08-09T12:53:29.490 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-09T12:53:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff94006a080 msgr2=0x7ff94006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff94006a080 0x7ff94006c540 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff948001050 tx=0x7ff948001d60 comp rx=0 tx=0).stop 2023-08-09T12:53:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 msgr2=0x7ff95c15a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff95c15a070 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7ff95002bc30 tx=0x7ff950001120 comp rx=0 tx=0).stop 2023-08-09T12:53:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 shutdown_connections 2023-08-09T12:53:29.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff94006a080 0x7ff94006c540 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff95c15f620 0x7ff95c15faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff95c0cc9c0 0x7ff95c0a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 --2- 172.21.15.17:0/4099583760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff94c0039a0 0x7ff95c15a070 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 >> 172.21.15.17:0/4099583760 conn(0x7ff95c06fde0 msgr2=0x7ff95c0c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 shutdown_connections 2023-08-09T12:53:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:29.489+0000 7ff962c57640 1 -- 172.21.15.17:0/4099583760 wait complete. 2023-08-09T12:53:29.514 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-09T12:53:29.515 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-09T12:53:29.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-08-09T12:53:29.515 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-09T12:53:29.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-09T12:53:29.516 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-09T12:53:29.516 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-09T12:53:29.516 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-09T12:53:29.517 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:53:29.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:29.517 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-08-09T12:53:29.583 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-09T12:53:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-09T12:53:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-08-09T12:53:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-08-09T12:53:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:29.584 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:53:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-08-09T12:53:29.585 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:53:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-08-09T12:53:29.585 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-09T12:53:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:29.586 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-09T12:53:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-09T12:53:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41359sec preferred_lft 41359sec 2023-08-09T12:53:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2023-08-09T12:53:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:29.586 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-09T12:53:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff 2023-08-09T12:53:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-09T12:53:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::a4a5:20ff:fe12:1904/64 scope link 2023-08-09T12:53:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:29.587 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:53:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether b6:15:4d:4a:a3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:53:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::b415:4dff:fe4a:a3c7/64 scope link 2023-08-09T12:53:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:29.588 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-09T12:53:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether d2:04:98:df:76:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:53:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d004:98ff:fedf:7694/64 scope link 2023-08-09T12:53:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-08-09T12:53:29.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:29.590 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-09T12:53:29.677 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-08-09T12:53:29.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:29.682 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-08-09T12:53:29.735 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-08-09T12:53:29.736 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-09T12:53:29.736 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-09T12:53:29.736 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-09T12:53:29.737 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-09T12:53:29.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:29.738 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-08-09T12:53:29.738 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-08-09T12:53:29.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-09T12:53:29.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-09T12:53:29.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-09T12:53:29.740 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-08-09T12:53:29.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:29.933 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:53:29.989 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:53:29.989 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:53:29.989 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:53:29.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:29.990 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-08-09T12:53:30.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:53:30.084 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-09T12:53:30.140 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-09T12:53:30.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-09T12:53:30.141 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:53:30.193 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-09T12:53:30.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:30.194 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:53:30.338 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:53:30.338 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:53:30.338 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:53:30.358 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:53:30.358 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:53:30.359 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:53:30.359 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:53:30.359 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:53:30.384 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-09T12:53:30.384 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-09T12:53:30.384 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2023-08-09T12:53:30.384 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-08-09T12:53:30.384 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-09T12:53:30.385 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-08-09T12:53:30.385 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-08-09T12:53:30.385 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=00c647bf-6030-4006-bfa6-56fa996e3ac5" will pass to kernel 2023-08-09T12:53:30.386 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-08-09T12:53:30.386 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-08-09T12:53:30.386 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-09T12:53:30.386 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-08-09T12:53:30.387 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-09T12:53:30.389 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-09T12:53:30.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:30.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-09T12:53:30.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:30.482 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-09T12:53:30.541 INFO:teuthology.orchestra.run.smithi142.stdout:client7159 2023-08-09T12:53:30.541 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:53:30.542 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:30.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:30.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.831+0000 7f721b221640 1 Processor -- start 2023-08-09T12:53:30.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.831+0000 7f721b221640 1 -- start start 2023-08-09T12:53:30.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.833+0000 7f721b221640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72140cb3b0 0x7f72140c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:30.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.833+0000 7f721b221640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72140b34a0 con 0x7f72140caf00 2023-08-09T12:53:30.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.833+0000 7f721b221640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72140b3780 con 0x7f72141601f0 2023-08-09T12:53:30.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.833+0000 7f721b221640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140b4120 con 0x7f72140cb3b0 2023-08-09T12:53:30.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.833+0000 7f7219a1e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f72140caf00 0x7f72140c2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57910/0 (socket says 172.21.15.17:57910) 2023-08-09T12:53:30.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.833+0000 7f7219a1e640 1 -- 172.21.15.17:0/2563758535 learned_addr learned my addr 172.21.15.17:0/2563758535 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:30.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649675422 0 0) 0x7f72140b34a0 con 0x7f72140caf00 2023-08-09T12:53:30.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7200003520 con 0x7f72140caf00 2023-08-09T12:53:30.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721aa20640 1 --2- 172.21.15.17:0/2563758535 >> v2:172.21.15.142:3300/0 conn(0x7f72140cb3b0 0x7f72140c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:30.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321400230 0 0) 0x7f7200003520 con 0x7f72140caf00 2023-08-09T12:53:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 >> v2:172.21.15.142:3300/0 conn(0x7f72140cb3b0 msgr2=0x7f72140c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 --2- 172.21.15.17:0/2563758535 >> v2:172.21.15.142:3300/0 conn(0x7f72140cb3b0 0x7f72140c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 >> v1:172.21.15.142:6789/0 conn(0x7f72141601f0 legacy=0x7f72140b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72140b3a60 con 0x7f72140caf00 2023-08-09T12:53:30.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f7204001670 con 0x7f72140caf00 2023-08-09T12:53:30.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 >> v1:172.21.15.17:6789/0 conn(0x7f72140caf00 legacy=0x7f72140c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:30.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.834+0000 7f721921d640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7200003970 0x7f7200003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:30.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721921d640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f7200004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:30.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721921d640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7200005180 0x7f720000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:30.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140b4120 con 0x7f72000047c0 2023-08-09T12:53:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720000c0b0 con 0x7f7200005180 2023-08-09T12:53:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720000c270 con 0x7f7200003970 2023-08-09T12:53:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f7219a1e640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f7200004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721aa20640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7200005180 0x7f720000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f7219a1e640 1 -- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7200003970 msgr2=0x7f7200003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721a21f640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7200003970 0x7f7200003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f7219a1e640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7200003970 0x7f7200003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f7219a1e640 1 -- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7200005180 msgr2=0x7f720000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f7219a1e640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7200005180 0x7f720000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f7219a1e640 1 -- 172.21.15.17:0/2563758535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200003520 con 0x7f72000047c0 2023-08-09T12:53:30.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721aa20640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7200005180 0x7f720000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:30.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721aa20640 1 -- 172.21.15.17:0/2563758535 reap_dead start 2023-08-09T12:53:30.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.835+0000 7f721a21f640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7200003970 0x7f7200003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:30.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.837+0000 7f7219a1e640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f7200004c40 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f7204001eb0 tx=0x7f72000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c45e9ba52f9557 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.837+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204005ad0 con 0x7f72000047c0 2023-08-09T12:53:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.837+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7204005c50 con 0x7f72000047c0 2023-08-09T12:53:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.837+0000 7f721921d640 1 -- 172.21.15.17:0/2563758535 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720402c890 con 0x7f72000047c0 2023-08-09T12:53:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.838+0000 7f721b221640 1 -- 172.21.15.17:0/2563758535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 msgr2=0x7f7200004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.838+0000 7f721b221640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f7200004c40 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f7204001eb0 tx=0x7f72000057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.838+0000 7f721b221640 1 -- 172.21.15.17:0/2563758535 shutdown_connections 2023-08-09T12:53:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.838+0000 7f721b221640 1 --2- 172.21.15.17:0/2563758535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f7200004c40 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.838+0000 7f721b221640 1 -- 172.21.15.17:0/2563758535 >> 172.21.15.17:0/2563758535 conn(0x7f72140b1d50 msgr2=0x7f721406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.838+0000 7f721b221640 1 -- 172.21.15.17:0/2563758535 shutdown_connections 2023-08-09T12:53:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.838+0000 7f721b221640 1 -- 172.21.15.17:0/2563758535 wait complete. 2023-08-09T12:53:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.840+0000 7f721b221640 1 Processor -- start 2023-08-09T12:53:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.840+0000 7f721b221640 1 -- start start 2023-08-09T12:53:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721b221640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f721415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721b221640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7214159220 0x7f72141596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721b221640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214156cf0 0x7f72141571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721b221640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72141576e0 con 0x7f72000047c0 2023-08-09T12:53:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721b221640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7214159be0 con 0x7f7214159220 2023-08-09T12:53:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721b221640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721415b780 con 0x7f7214156cf0 2023-08-09T12:53:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721a21f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f721415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721a21f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f721415bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48820/0 (socket says 172.21.15.17:48820) 2023-08-09T12:53:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721a21f640 1 -- 172.21.15.17:0/3771298651 learned_addr learned my addr 172.21.15.17:0/3771298651 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f7219a1e640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7214159220 0x7f72141596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721aa20640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214156cf0 0x7f72141571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:30.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721a21f640 1 -- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214156cf0 msgr2=0x7f72141571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:30.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721a21f640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214156cf0 0x7f72141571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:30.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721a21f640 1 -- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7214159220 msgr2=0x7f72141596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:30.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.841+0000 7f721a21f640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7214159220 0x7f72141596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:30.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.842+0000 7f721a21f640 1 -- 172.21.15.17:0/3771298651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72141578d0 con 0x7f72000047c0 2023-08-09T12:53:30.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.842+0000 7f7219a1e640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7214159220 0x7f72141596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:30.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.842+0000 7f721a21f640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f721415bfb0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f721000d7a0 tx=0x7f721000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:30.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.842+0000 7f720affd640 1 -- 172.21.15.17:0/3771298651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210006d50 con 0x7f72000047c0 2023-08-09T12:53:30.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.842+0000 7f720affd640 1 -- 172.21.15.17:0/3771298651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7210004950 con 0x7f72000047c0 2023-08-09T12:53:30.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.842+0000 7f720affd640 1 -- 172.21.15.17:0/3771298651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210004d00 con 0x7f72000047c0 2023-08-09T12:53:30.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.842+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7214157bb0 con 0x7f72000047c0 2023-08-09T12:53:30.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.842+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7214158170 con 0x7f72000047c0 2023-08-09T12:53:30.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.843+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721404e390 con 0x7f72000047c0 2023-08-09T12:53:30.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.844+0000 7f720affd640 1 -- 172.21.15.17:0/3771298651 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f721000b8c0 con 0x7f72000047c0 2023-08-09T12:53:30.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.845+0000 7f720affd640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71f806a080 0x7f71f806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:30.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.845+0000 7f720affd640 1 -- 172.21.15.17:0/3771298651 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7210088a70 con 0x7f72000047c0 2023-08-09T12:53:30.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.846+0000 7f7219a1e640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71f806a080 0x7f71f806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:30.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.847+0000 7f7219a1e640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71f806a080 0x7f71f806c540 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7204034000 tx=0x7f7204009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:30.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:30.850+0000 7f720affd640 1 -- 172.21.15.17:0/3771298651 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f72100540c0 con 0x7f72000047c0 2023-08-09T12:53:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.079+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72140c8270 con 0x7f72000047c0 2023-08-09T12:53:31.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.080+0000 7f720affd640 1 -- 172.21.15.17:0/3771298651 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f72100576e0 con 0x7f72000047c0 2023-08-09T12:53:31.083 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:31.084 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:53:31.084 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:53:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71f806a080 msgr2=0x7f71f806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71f806a080 0x7f71f806c540 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7204034000 tx=0x7f7204009030 comp rx=0 tx=0).stop 2023-08-09T12:53:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 msgr2=0x7f721415bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f721415bfb0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f721000d7a0 tx=0x7f721000dc60 comp rx=0 tx=0).stop 2023-08-09T12:53:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 shutdown_connections 2023-08-09T12:53:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f71f806a080 0x7f71f806c540 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214156cf0 0x7f72141571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7214159220 0x7f72141596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 --2- 172.21.15.17:0/3771298651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72000047c0 0x7f721415bfb0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.083+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 >> 172.21.15.17:0/3771298651 conn(0x7f72140b1d50 msgr2=0x7f72140b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.084+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 shutdown_connections 2023-08-09T12:53:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.084+0000 7f721b221640 1 -- 172.21.15.17:0/3771298651 wait complete. 2023-08-09T12:53:31.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-09T12:53:31.357 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":9453,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.85112324,"mdsmap_epoch":93,"osdmap_epoch":191,"osdmap_epoch_barrier":191,"uptime":16.858219025} 2023-08-09T12:53:31.357 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 9453, "mdsmap_epoch": 93, "osdmap_epoch": 191, "osdmap_epoch_barrier": 191, "rank_uptime": 10.85112324, "state": "up:active", "uptime": 16.858219025, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:53:31.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-08-09T12:53:31.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.590+0000 7fc656425640 1 Processor -- start 2023-08-09T12:53:31.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.590+0000 7fc656425640 1 -- start start 2023-08-09T12:53:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.592+0000 7fc656425640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6500b3dd0 0x7fc6500b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.592+0000 7fc656425640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500c8240 0x7fc6500affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.592+0000 7fc656425640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6500b18b0 con 0x7fc6500b41b0 2023-08-09T12:53:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.592+0000 7fc656425640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6500b1b10 con 0x7fc6500b3dd0 2023-08-09T12:53:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.592+0000 7fc656425640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6500b1df0 con 0x7fc6500c8240 2023-08-09T12:53:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.592+0000 7fc654c22640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc6500b41b0 0x7fc65015eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57912/0 (socket says 172.21.15.17:57912) 2023-08-09T12:53:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.592+0000 7fc654c22640 1 -- 172.21.15.17:0/2658721666 learned_addr learned my addr 172.21.15.17:0/2658721666 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.593+0000 7fc655423640 1 --2- 172.21.15.17:0/2658721666 >> v2:172.21.15.142:3300/0 conn(0x7fc6500b3dd0 0x7fc6500b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.593+0000 7fc655c24640 1 --2- 172.21.15.17:0/2658721666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500c8240 0x7fc6500affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.593+0000 7fc647fff640 1 -- 172.21.15.17:0/2658721666 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836269744 0 0) 0x7fc6500b18b0 con 0x7fc6500b41b0 2023-08-09T12:53:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.593+0000 7fc647fff640 1 -- 172.21.15.17:0/2658721666 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc63c003520 con 0x7fc6500b41b0 2023-08-09T12:53:31.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.593+0000 7fc655423640 1 -- 172.21.15.17:0/2658721666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500c8240 msgr2=0x7fc6500affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:31.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.593+0000 7fc655423640 1 --2- 172.21.15.17:0/2658721666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500c8240 0x7fc6500affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.593+0000 7fc655423640 1 -- 172.21.15.17:0/2658721666 >> v1:172.21.15.17:6789/0 conn(0x7fc6500b41b0 legacy=0x7fc65015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:31.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.593+0000 7fc655423640 1 -- 172.21.15.17:0/2658721666 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6500b20d0 con 0x7fc6500b3dd0 2023-08-09T12:53:31.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.595+0000 7fc655423640 1 --2- 172.21.15.17:0/2658721666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 0x7fc6500b1370 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0097d0 tx=0x7fc64c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7ce2c1fc2303d0b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:31.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.595+0000 7fc647fff640 1 -- 172.21.15.17:0/2658721666 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031800 con 0x7fc6500b3dd0 2023-08-09T12:53:31.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.595+0000 7fc647fff640 1 -- 172.21.15.17:0/2658721666 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c031960 con 0x7fc6500b3dd0 2023-08-09T12:53:31.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.595+0000 7fc647fff640 1 -- 172.21.15.17:0/2658721666 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031cf0 con 0x7fc6500b3dd0 2023-08-09T12:53:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.596+0000 7fc656425640 1 -- 172.21.15.17:0/2658721666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 msgr2=0x7fc6500b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:31.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.596+0000 7fc656425640 1 --2- 172.21.15.17:0/2658721666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 0x7fc6500b1370 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0097d0 tx=0x7fc64c02b8a0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.596+0000 7fc656425640 1 -- 172.21.15.17:0/2658721666 shutdown_connections 2023-08-09T12:53:31.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.596+0000 7fc656425640 1 --2- 172.21.15.17:0/2658721666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500c8240 0x7fc6500affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.596+0000 7fc656425640 1 --2- 172.21.15.17:0/2658721666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 0x7fc6500b1370 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.597+0000 7fc656425640 1 -- 172.21.15.17:0/2658721666 >> 172.21.15.17:0/2658721666 conn(0x7fc6500cafa0 msgr2=0x7fc6500cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.597+0000 7fc656425640 1 -- 172.21.15.17:0/2658721666 shutdown_connections 2023-08-09T12:53:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.597+0000 7fc656425640 1 -- 172.21.15.17:0/2658721666 wait complete. 2023-08-09T12:53:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.599+0000 7fc656425640 1 Processor -- start 2023-08-09T12:53:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.599+0000 7fc656425640 1 -- start start 2023-08-09T12:53:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.600+0000 7fc656425640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 0x7fc6501502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc656425640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500b41b0 0x7fc650152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc656425640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6500c8240 0x7fc6500ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc656425640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6500aec80 con 0x7fc6500c8240 2023-08-09T12:53:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc656425640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc650150a20 con 0x7fc6500b3dd0 2023-08-09T12:53:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc656425640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc650150d00 con 0x7fc6500b41b0 2023-08-09T12:53:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655c24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6500c8240 0x7fc6500ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655c24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6500c8240 0x7fc6500ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48826/0 (socket says 172.21.15.17:48826) 2023-08-09T12:53:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655c24640 1 -- 172.21.15.17:0/1140772490 learned_addr learned my addr 172.21.15.17:0/1140772490 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc654c22640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500b41b0 0x7fc650152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655423640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 0x7fc6501502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655c24640 1 -- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500b41b0 msgr2=0x7fc650152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655c24640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500b41b0 0x7fc650152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655c24640 1 -- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 msgr2=0x7fc6501502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655c24640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 0x7fc6501502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.601+0000 7fc655c24640 1 -- 172.21.15.17:0/1140772490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c009400 con 0x7fc6500c8240 2023-08-09T12:53:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.602+0000 7fc655c24640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6500c8240 0x7fc6500ae450 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fc64800ec10 tx=0x7fc64800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.602+0000 7fc645ffb640 1 -- 172.21.15.17:0/1140772490 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800cd20 con 0x7fc6500c8240 2023-08-09T12:53:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.602+0000 7fc645ffb640 1 -- 172.21.15.17:0/1140772490 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800f040 con 0x7fc6500c8240 2023-08-09T12:53:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.602+0000 7fc645ffb640 1 -- 172.21.15.17:0/1140772490 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6480146c0 con 0x7fc6500c8240 2023-08-09T12:53:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.602+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc650150fe0 con 0x7fc6500c8240 2023-08-09T12:53:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.602+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6500ae990 con 0x7fc6500c8240 2023-08-09T12:53:31.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.604+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc650151500 con 0x7fc6500c8240 2023-08-09T12:53:31.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.605+0000 7fc645ffb640 1 -- 172.21.15.17:0/1140772490 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc648014a30 con 0x7fc6500c8240 2023-08-09T12:53:31.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.606+0000 7fc645ffb640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc63406a080 0x7fc63406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:31.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.606+0000 7fc645ffb640 1 -- 172.21.15.17:0/1140772490 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc648089500 con 0x7fc6500c8240 2023-08-09T12:53:31.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.607+0000 7fc655423640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc63406a080 0x7fc63406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:31.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.608+0000 7fc655423640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc63406a080 0x7fc63406c540 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc64c036000 tx=0x7fc64c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:31.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.612+0000 7fc645ffb640 1 -- 172.21.15.17:0/1140772490 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc650151500 con 0x7fc6500c8240 2023-08-09T12:53:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.808+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fc650151500 con 0x7fc6500c8240 2023-08-09T12:53:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.985+0000 7fc645ffb640 1 -- 172.21.15.17:0/1140772490 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v192) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc650151500 con 0x7fc6500c8240 2023-08-09T12:53:31.989 INFO:teuthology.orchestra.run.smithi017.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-08-09T12:53:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.988+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc63406a080 msgr2=0x7fc63406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.988+0000 7fc656425640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc63406a080 0x7fc63406c540 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc64c036000 tx=0x7fc64c03c040 comp rx=0 tx=0).stop 2023-08-09T12:53:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.988+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6500c8240 msgr2=0x7fc6500ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.988+0000 7fc656425640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6500c8240 0x7fc6500ae450 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fc64800ec10 tx=0x7fc64800c490 comp rx=0 tx=0).stop 2023-08-09T12:53:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.989+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 shutdown_connections 2023-08-09T12:53:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.989+0000 7fc656425640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc63406a080 0x7fc63406c540 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.989+0000 7fc656425640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6500c8240 0x7fc6500ae450 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.989+0000 7fc656425640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6500b41b0 0x7fc650152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.989+0000 7fc656425640 1 --2- 172.21.15.17:0/1140772490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500b3dd0 0x7fc6501502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.989+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 >> 172.21.15.17:0/1140772490 conn(0x7fc6500cafa0 msgr2=0x7fc6500ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.989+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 shutdown_connections 2023-08-09T12:53:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:31.989+0000 7fc656425640 1 -- 172.21.15.17:0/1140772490 wait complete. 2023-08-09T12:53:32.015 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-08-09T12:53:32.266 INFO:teuthology.orchestra.run.smithi017.stdout:{"osd_mon_report_interval":"5"} 2023-08-09T12:53:32.267 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-08-09T12:53:32.267 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-08-09T12:53:32.268 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:53:32.268 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:32.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:32.326 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-08-09T12:53:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:16+0 records in 2023-08-09T12:53:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:16+0 records out 2023-08-09T12:53:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.196423 s, 85.4 MB/s 2023-08-09T12:53:32.593 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:53:32.593 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:32.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:32.642 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-08-09T12:53:32.912 INFO:teuthology.orchestra.run.smithi017.stderr:17+0 records in 2023-08-09T12:53:32.913 INFO:teuthology.orchestra.run.smithi017.stderr:17+0 records out 2023-08-09T12:53:32.913 INFO:teuthology.orchestra.run.smithi017.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.166278 s, 107 MB/s 2023-08-09T12:53:32.914 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-08-09T12:53:32.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:53:33.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.141+0000 7fc8adce0640 1 Processor -- start 2023-08-09T12:53:33.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.141+0000 7fc8adce0640 1 -- start start 2023-08-09T12:53:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.143+0000 7fc8adce0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8a8160030 0x7fc8a8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.143+0000 7fc8adce0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a80b86e0 0x7fc8a80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:33.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.143+0000 7fc8adce0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a80b5a30 con 0x7fc8a80cf980 2023-08-09T12:53:33.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.143+0000 7fc8adce0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a80d1110 con 0x7fc8a8160030 2023-08-09T12:53:33.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.143+0000 7fc8adce0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80ceac0 con 0x7fc8a80b86e0 2023-08-09T12:53:33.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.144+0000 7fc8accde640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8a8160030 0x7fc8a8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:33.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.144+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a80b86e0 0x7fc8a80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:33.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.144+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a80b86e0 0x7fc8a80cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:42420/0 (socket says 172.21.15.17:42420) 2023-08-09T12:53:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.144+0000 7fc8a7fff640 1 -- 172.21.15.17:0/1295956607 learned_addr learned my addr 172.21.15.17:0/1295956607 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.145+0000 7fc8accde640 1 -- 172.21.15.17:0/1295956607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a80b86e0 msgr2=0x7fc8a80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.145+0000 7fc8accde640 1 --2- 172.21.15.17:0/1295956607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a80b86e0 0x7fc8a80cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.145+0000 7fc8accde640 1 -- 172.21.15.17:0/1295956607 >> v1:172.21.15.142:6789/0 conn(0x7fc8a80cf980 legacy=0x7fc8a80b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:33.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.145+0000 7fc8accde640 1 -- 172.21.15.17:0/1295956607 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80d0d70 con 0x7fc8a8160030 2023-08-09T12:53:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.145+0000 7fc8a7fff640 1 --2- 172.21.15.17:0/1295956607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a80b86e0 0x7fc8a80cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:53:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.146+0000 7fc8accde640 1 --2- 172.21.15.17:0/1295956607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a8160030 0x7fc8a8160740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0097a0 tx=0x7fc89c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dbe0d9059e34a9e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8a77fe640 1 -- 172.21.15.17:0/1295956607 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c02d040 con 0x7fc8a8160030 2023-08-09T12:53:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8a77fe640 1 -- 172.21.15.17:0/1295956607 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c031810 con 0x7fc8a8160030 2023-08-09T12:53:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8a77fe640 1 -- 172.21.15.17:0/1295956607 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c031ba0 con 0x7fc8a8160030 2023-08-09T12:53:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8adce0640 1 -- 172.21.15.17:0/1295956607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a8160030 msgr2=0x7fc8a8160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8adce0640 1 --2- 172.21.15.17:0/1295956607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a8160030 0x7fc8a8160740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0097a0 tx=0x7fc89c02b8b0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8adce0640 1 -- 172.21.15.17:0/1295956607 shutdown_connections 2023-08-09T12:53:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8adce0640 1 --2- 172.21.15.17:0/1295956607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a80b86e0 0x7fc8a80cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8adce0640 1 --2- 172.21.15.17:0/1295956607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a8160030 0x7fc8a8160740 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.147+0000 7fc8adce0640 1 -- 172.21.15.17:0/1295956607 >> 172.21.15.17:0/1295956607 conn(0x7fc8a80697c0 msgr2=0x7fc8a8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.148+0000 7fc8adce0640 1 -- 172.21.15.17:0/1295956607 shutdown_connections 2023-08-09T12:53:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.148+0000 7fc8adce0640 1 -- 172.21.15.17:0/1295956607 wait complete. 2023-08-09T12:53:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.149+0000 7fc8adce0640 1 Processor -- start 2023-08-09T12:53:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.149+0000 7fc8adce0640 1 -- start start 2023-08-09T12:53:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.150+0000 7fc8adce0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a80b86e0 0x7fc8a8154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.150+0000 7fc8adce0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a80cf980 0x7fc8a81f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.150+0000 7fc8adce0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a8160030 0x7fc8a81564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.150+0000 7fc8adce0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a814d760 con 0x7fc8a80b86e0 2023-08-09T12:53:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.150+0000 7fc8adce0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a8156080 con 0x7fc8a80cf980 2023-08-09T12:53:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.150+0000 7fc8adce0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a8155470 con 0x7fc8a8160030 2023-08-09T12:53:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8accde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a80b86e0 0x7fc8a8154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8accde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a80b86e0 0x7fc8a8154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48836/0 (socket says 172.21.15.17:48836) 2023-08-09T12:53:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8accde640 1 -- 172.21.15.17:0/2157238697 learned_addr learned my addr 172.21.15.17:0/2157238697 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8a7fff640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a80cf980 0x7fc8a81f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8ad4df640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a8160030 0x7fc8a81564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8accde640 1 -- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a8160030 msgr2=0x7fc8a81564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8accde640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a8160030 0x7fc8a81564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8accde640 1 -- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a80cf980 msgr2=0x7fc8a81f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.151+0000 7fc8accde640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a80cf980 0x7fc8a81f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.152+0000 7fc8accde640 1 -- 172.21.15.17:0/2157238697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940094d0 con 0x7fc8a80b86e0 2023-08-09T12:53:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.152+0000 7fc8accde640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a80b86e0 0x7fc8a8154c20 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fc89c000c00 tx=0x7fc89c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.152+0000 7fc8a57fa640 1 -- 172.21.15.17:0/2157238697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c03ace0 con 0x7fc8a80b86e0 2023-08-09T12:53:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.152+0000 7fc8a57fa640 1 -- 172.21.15.17:0/2157238697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c03ae40 con 0x7fc8a80b86e0 2023-08-09T12:53:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.152+0000 7fc8a57fa640 1 -- 172.21.15.17:0/2157238697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c044630 con 0x7fc8a80b86e0 2023-08-09T12:53:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.152+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c009400 con 0x7fc8a80b86e0 2023-08-09T12:53:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.153+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a8155a30 con 0x7fc8a80b86e0 2023-08-09T12:53:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.154+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a804e390 con 0x7fc8a80b86e0 2023-08-09T12:53:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.155+0000 7fc8a57fa640 1 -- 172.21.15.17:0/2157238697 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc89c04d450 con 0x7fc8a80b86e0 2023-08-09T12:53:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.155+0000 7fc8a57fa640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc88c06a050 0x7fc88c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.156+0000 7fc8a57fa640 1 -- 172.21.15.17:0/2157238697 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc89c0aa600 con 0x7fc8a80b86e0 2023-08-09T12:53:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.156+0000 7fc8a7fff640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc88c06a050 0x7fc88c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.157+0000 7fc8a7fff640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc88c06a050 0x7fc88c06c510 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc8a815e900 tx=0x7fc894009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.160+0000 7fc8a57fa640 1 -- 172.21.15.17:0/2157238697 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc89c075d90 con 0x7fc8a80b86e0 2023-08-09T12:53:33.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.358+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc8a80d0640 con 0x7fc8a80b86e0 2023-08-09T12:53:33.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.360+0000 7fc8a57fa640 1 -- 172.21.15.17:0/2157238697 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+36925 (secure 0 0 0) 0x7fc89c0793b0 con 0x7fc8a80b86e0 2023-08-09T12:53:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:33.364 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 192, 2023-08-09T12:53:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:53:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:53:31.977136+0000", 2023-08-09T12:53:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:53:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:53:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:53:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:53:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:53:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:53:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:53:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:53:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:53:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:53:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:53:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:53:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:53:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:53:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 24, 2023-08-09T12:53:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:53:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:53:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:53:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:53:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:53:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:53:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:53:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:53:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:53:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:53:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:53:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:53:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:53:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:53:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:53:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:53:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:53:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:53:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:53:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:53:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:53:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:53:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:53:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:33.386 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:33.386 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:33.386 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:33.386 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:33.386 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:53:33.386 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:53:33.386 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:53:33.386 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:53:33.387 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:53:33.387 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:33.387 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:33.387 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:33.387 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:33.387 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:33.387 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:33.387 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:33.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.388 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:33.388 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:33.388 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:33.388 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:33.388 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:33.388 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:33.389 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:33.389 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:33.389 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:33.389 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:33.389 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:33.389 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:33.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:33.391 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:33.391 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:33.391 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:33.391 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:33.391 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:33.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:33.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.392 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:33.392 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:33.392 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:33.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:33.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:33.392 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:33.393 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:33.393 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:33.393 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:33.393 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:33.393 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:33.393 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:53:33.394 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:33.394 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:53:33.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.394 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:33.394 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:53:33.394 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:53:33.394 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:53:33.395 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:53:33.395 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:53:33.395 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:33.395 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:33.395 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:33.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.396 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 23, 2023-08-09T12:53:33.396 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:53:33.396 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.326271+0000", 2023-08-09T12:53:33.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:33.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:33.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:33.397 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:33.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:33.397 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:33.397 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:33.397 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:33.398 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:33.398 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:33.398 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:33.398 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:33.398 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:53:33.398 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:53:33.398 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:53:33.402 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:53:33.403 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:53:33.403 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:33.403 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:33.403 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:33.403 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:33.403 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:33.404 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:33.404 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:33.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "190", 2023-08-09T12:53:33.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:33.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:33.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:33.405 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:33.405 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:33.405 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:33.405 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:33.405 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:33.406 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:33.406 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:33.406 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:33.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:33.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:33.406 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:33.407 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:33.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:33.407 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:33.407 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:33.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:33.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:33.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:33.408 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:33.408 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:33.408 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:33.408 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:33.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:33.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.409 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:33.409 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:33.409 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:33.409 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:33.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:33.410 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:33.410 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:33.410 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:33.410 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:33.410 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:33.411 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:33.411 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:33.411 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:53:33.411 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:53:33.411 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:53:33.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.412 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:33.412 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:33.412 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:53:33.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.412 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:33.413 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2023-08-09T12:53:33.413 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2023-08-09T12:53:33.413 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:33.413 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:33.413 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:33.413 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:33.413 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:33.413 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:33.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.414 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 24, 2023-08-09T12:53:33.414 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:53:33.414 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.942904+0000", 2023-08-09T12:53:33.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:33.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:33.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:33.415 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:33.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:33.415 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:33.415 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:33.415 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:33.415 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:33.416 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:33.416 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:33.416 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:33.416 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:53:33.416 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:53:33.416 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:53:33.417 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:53:33.417 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:53:33.417 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:33.417 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:33.417 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:33.417 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:33.419 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:33.419 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:33.419 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:33.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "192", 2023-08-09T12:53:33.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:33.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:33.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:33.420 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:33.421 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:33.421 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:33.421 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:33.421 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:33.421 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:33.422 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:53:33.422 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:33.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:33.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:33.422 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:33.422 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:33.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:33.423 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:33.423 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:33.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:33.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:33.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:33.424 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:33.424 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:33.424 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:33.424 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:33.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:33.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.424 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:33.425 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:33.425 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:33.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:33.426 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:33.426 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:33.426 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:33.426 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:33.427 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:33.428 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:33.428 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:33.428 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:33.429 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:53:33.429 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:53:33.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.429 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:33.429 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:33.429 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:53:33.429 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.430 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:33.430 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:53:33.430 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:53:33.430 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:33.430 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:53:33.430 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:53:33.430 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:33.431 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:33.431 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:33.431 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.431 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.432 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:33.432 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:53:33.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.433 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:33.433 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:33.433 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:33.433 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:33.434 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:33.434 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:33.434 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:33.435 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:33.435 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:33.435 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:33.435 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:33.436 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:33.436 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:33.436 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.437 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:53:33.437 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:33.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.438 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:53:33.438 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:33.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.438 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.439 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:33.439 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.440 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:53:33.440 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:33.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.441 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:53:33.441 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:33.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.443 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:33.443 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.444 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:53:33.444 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:33.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.445 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:53:33.445 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:33.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.446 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.446 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:33.446 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.447 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:53:33.447 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:33.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.448 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:53:33.448 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:33.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.449 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:53:33.449 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:53:33.449 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:53:33.449 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:53:33.449 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:33.449 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:33.449 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:33.450 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.450 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:33.450 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:33.450 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:33.450 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:33.451 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:33.451 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:33.451 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:33.451 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:33.451 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:33.451 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:33.451 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:33.451 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:33.452 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:33.452 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.452 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:53:33.452 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:33.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.453 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:53:33.453 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:33.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.453 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.454 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:33.454 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.454 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:53:33.454 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:33.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.455 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:53:33.455 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:33.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.455 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.455 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:33.456 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.456 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:53:33.456 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:33.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.457 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:53:33.457 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:33.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.457 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.458 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:33.458 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.458 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:53:33.458 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:33.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.459 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:53:33.459 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:33.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.459 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.460 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:53:33.460 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:53:33.460 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:53:33.460 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:53:33.460 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:33.460 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:33.460 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:33.461 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.461 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:33.461 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:33.461 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:33.461 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:33.462 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:33.462 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:33.462 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:33.462 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:33.462 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:33.462 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:33.462 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:33.462 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:33.463 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:33.463 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.463 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:53:33.464 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:33.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.465 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:53:33.465 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:33.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.466 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:33.466 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.467 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:53:33.467 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:33.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.469 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:53:33.469 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:33.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.470 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.470 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:33.471 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.471 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:53:33.472 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:33.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.473 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:53:33.473 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:33.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.474 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:33.474 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.475 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:53:33.475 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:33.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.476 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:53:33.476 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:33.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.477 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.477 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:53:33.477 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:53:33.477 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:53:33.478 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:53:33.478 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:33.478 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:33.478 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:33.478 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.479 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:33.479 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:33.479 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:33.480 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:33.480 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:33.480 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:33.480 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:33.480 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:33.481 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:33.481 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:33.481 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:33.481 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:33.481 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:33.481 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.482 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:53:33.482 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:33.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.483 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:53:33.483 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:33.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.483 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.484 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:33.484 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:53:33.485 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:33.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:53:33.486 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:33.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.486 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:33.487 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.487 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:53:33.487 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:53:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:33.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.489 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:33.489 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.490 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:53:33.490 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:33.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.491 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:53:33.491 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:33.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.492 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.493 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:53:33.493 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:53:33.493 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:53:33.494 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:53:33.494 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:33.494 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:33.494 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:33.494 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:33.496 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:33.496 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:33.496 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:33.496 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:33.496 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:33.496 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:33.497 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:33.497 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:33.497 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:33.497 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:53:33.498 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:33.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.498 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:53:33.499 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:33.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.499 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:33.499 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.500 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:53:33.500 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:33.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.500 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:53:33.500 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:33.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.502 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:33.502 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.502 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:53:33.502 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:33.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.503 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:53:33.504 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:33.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.504 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:33.504 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:53:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:53:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:33.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.506 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.506 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:53:33.506 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:53:33.506 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:53:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:53:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.510 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:53:33.510 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:33.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.511 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:53:33.511 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:33.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.511 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.511 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:33.512 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.513 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:53:33.513 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:33.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.514 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:53:33.514 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:33.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.515 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.515 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:33.515 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.515 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:53:33.516 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:33.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.517 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:53:33.517 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:33.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.517 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.517 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:33.518 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.518 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:53:33.518 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:33.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.519 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:53:33.519 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:33.519 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.519 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.520 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:53:33.520 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:53:33.520 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:53:33.520 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:53:33.520 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:33.520 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:33.521 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:33.521 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.521 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:33.521 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:33.522 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:33.522 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:33.522 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:33.522 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:33.522 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:33.522 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:33.522 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:33.523 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:33.523 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:33.523 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:33.523 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:33.523 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.523 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:53:33.524 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:33.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.524 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:53:33.525 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:33.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.525 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.526 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:33.526 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.526 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:53:33.526 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:33.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.527 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:53:33.527 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:33.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.527 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.528 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:33.528 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.528 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:53:33.528 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:33.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.529 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:53:33.529 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:33.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.529 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:33.530 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.530 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:53:33.530 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:33.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.531 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:53:33.531 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:33.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.531 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:53:33.531 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:53:33.532 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:53:33.532 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:53:33.532 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:33.532 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:33.532 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:33.532 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.533 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:33.533 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:33.533 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:33.533 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:33.533 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:33.533 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:33.533 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:33.534 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:33.534 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:33.534 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:33.534 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:33.534 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:33.534 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:33.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:53:33.535 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:33.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:53:33.535 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:33.536 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.536 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.536 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:33.536 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:53:33.537 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:33.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:53:33.537 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:33.537 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.538 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:33.538 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.538 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:53:33.538 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:53:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.540 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:33.540 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:33.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:33.540 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:53:33.540 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:33.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:33.541 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:53:33.541 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:33.541 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.541 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.541 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:53:33.542 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:53:33.542 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:53:33.542 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:53:33.542 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:33.542 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:33.542 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:33.542 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:33.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.543 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:33.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:53:33.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:33.543 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:33.543 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:33.544 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:33.544 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:33.544 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:33.544 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:53:33.544 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:33.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:33.545 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:33.545 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:33.545 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:33.545 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:33.545 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:33.546 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:53:33.546 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:33.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:33.546 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:33.546 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:33.547 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:33.547 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:33.547 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:33.547 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:53:33.547 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:33.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:33.548 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:33.548 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:33.548 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:33.548 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:33.548 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:53:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:33.550 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:33.550 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:33.550 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:33.550 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:53:33.550 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:33.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:33.551 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:33.551 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:33.551 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:33.551 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:33.551 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:33.552 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:53:33.552 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:33.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:33.552 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:33.553 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:33.553 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:33.553 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:33.553 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:33.553 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:53:33.553 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:33.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:33.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:33.554 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:33.554 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:33.554 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:33.555 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:33.555 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:33.555 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:53:33.555 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:33.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.555 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:33.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:53:33.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:53:33.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:53:33.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:53:33.556 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:53:33.556 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:53:33.556 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:53:33.557 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:53:33.557 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:53:33.557 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:53:33.557 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:53:33.557 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:53:33.557 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:53:33.558 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:53:33.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:33.558 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:53:33.558 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:53:33.558 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:53:33.558 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:53:33.559 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:53:33.559 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:53:33.559 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:53:33.559 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:53:33.559 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:53:33.559 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:53:33.559 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:53:33.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:33.560 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.362+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc88c06a050 msgr2=0x7fc88c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.362+0000 7fc8adce0640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc88c06a050 0x7fc88c06c510 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc8a815e900 tx=0x7fc894009240 comp rx=0 tx=0).stop 2023-08-09T12:53:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.362+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a80b86e0 msgr2=0x7fc8a8154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.362+0000 7fc8adce0640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a80b86e0 0x7fc8a8154c20 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fc89c000c00 tx=0x7fc89c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.362+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 shutdown_connections 2023-08-09T12:53:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.363+0000 7fc8adce0640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc88c06a050 0x7fc88c06c510 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.363+0000 7fc8adce0640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a8160030 0x7fc8a81564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.363+0000 7fc8adce0640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a80cf980 0x7fc8a81f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.363+0000 7fc8adce0640 1 --2- 172.21.15.17:0/2157238697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a80b86e0 0x7fc8a8154c20 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.363+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 >> 172.21.15.17:0/2157238697 conn(0x7fc8a80697c0 msgr2=0x7fc8a815f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.363+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 shutdown_connections 2023-08-09T12:53:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:33.363+0000 7fc8adce0640 1 -- 172.21.15.17:0/2157238697 wait complete. 2023-08-09T12:53:33.563 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:53:38.565 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:53:38.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.800+0000 7fe357a0b640 1 Processor -- start 2023-08-09T12:53:38.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.801+0000 7fe357a0b640 1 -- start start 2023-08-09T12:53:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.802+0000 7fe357a0b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3501616e0 0x7fe3500b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.802+0000 7fe357a0b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500cdd10 con 0x7fe35015ce90 2023-08-09T12:53:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.802+0000 7fe357a0b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500cdff0 con 0x7fe3500d29d0 2023-08-09T12:53:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.802+0000 7fe357a0b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500b6540 con 0x7fe3501616e0 2023-08-09T12:53:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.802+0000 7fe3557a7640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe35015ce90 0x7fe3500cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:46442/0 (socket says 172.21.15.17:46442) 2023-08-09T12:53:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.802+0000 7fe3557a7640 1 -- 172.21.15.17:0/3609357156 learned_addr learned my addr 172.21.15.17:0/3609357156 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930444580 0 0) 0x7fe3500cdd10 con 0x7fe35015ce90 2023-08-09T12:53:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe338003520 con 0x7fe35015ce90 2023-08-09T12:53:38.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe354fa6640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3501616e0 0x7fe3500b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:38.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4247163130 0 0) 0x7fe338003520 con 0x7fe35015ce90 2023-08-09T12:53:38.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3501616e0 msgr2=0x7fe3500b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:38.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3501616e0 0x7fe3500b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:38.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 >> v1:172.21.15.142:6789/0 conn(0x7fe3500d29d0 legacy=0x7fe3500d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:38.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500ce2d0 con 0x7fe35015ce90 2023-08-09T12:53:38.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe3400019f0 con 0x7fe35015ce90 2023-08-09T12:53:38.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 >> v1:172.21.15.17:6789/0 conn(0x7fe35015ce90 legacy=0x7fe3500cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:38.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3380039a0 0x7fe338003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:38.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3380047c0 0x7fe338004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:38.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe338005180 0x7fe33800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:38.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500b6540 con 0x7fe3380047c0 2023-08-09T12:53:38.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33800c020 con 0x7fe3380039a0 2023-08-09T12:53:38.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33800c1e0 con 0x7fe338005180 2023-08-09T12:53:38.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.803+0000 7fe354fa6640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3501616e0 0x7fe3500b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:38.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.804+0000 7fe354fa6640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3380047c0 0x7fe338004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:38.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.804+0000 7fe3557a7640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3380039a0 0x7fe338003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:38.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.804+0000 7fe355fa8640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe338005180 0x7fe33800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:38.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.804+0000 7fe354fa6640 1 -- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe338005180 msgr2=0x7fe33800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:38.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.804+0000 7fe354fa6640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe338005180 0x7fe33800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:38.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.804+0000 7fe354fa6640 1 -- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3380039a0 msgr2=0x7fe338003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:38.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.804+0000 7fe354fa6640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3380039a0 0x7fe338003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:38.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.804+0000 7fe354fa6640 1 -- 172.21.15.17:0/3609357156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe338003520 con 0x7fe3380047c0 2023-08-09T12:53:38.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.806+0000 7fe354fa6640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3380047c0 0x7fe338004c40 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fe344006fd0 tx=0x7fe3380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d0b2ccdbd2fb9f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:38.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.806+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344033600 con 0x7fe3380047c0 2023-08-09T12:53:38.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.806+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34402f050 con 0x7fe3380047c0 2023-08-09T12:53:38.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.806+0000 7fe34ffff640 1 -- 172.21.15.17:0/3609357156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344033980 con 0x7fe3380047c0 2023-08-09T12:53:38.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.806+0000 7fe357a0b640 1 -- 172.21.15.17:0/3609357156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3380047c0 msgr2=0x7fe338004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:38.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.806+0000 7fe357a0b640 1 --2- 172.21.15.17:0/3609357156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3380047c0 0x7fe338004c40 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fe344006fd0 tx=0x7fe3380057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:38.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.807+0000 7fe355fa8640 1 -- 172.21.15.17:0/3609357156 reap_dead start 2023-08-09T12:53:38.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.807+0000 7fe357a0b640 1 -- 172.21.15.17:0/3609357156 shutdown_connections 2023-08-09T12:53:38.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.807+0000 7fe357a0b640 1 -- 172.21.15.17:0/3609357156 >> 172.21.15.17:0/3609357156 conn(0x7fe35006fde0 msgr2=0x7fe3500701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.807+0000 7fe357a0b640 1 -- 172.21.15.17:0/3609357156 shutdown_connections 2023-08-09T12:53:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.807+0000 7fe357a0b640 1 -- 172.21.15.17:0/3609357156 wait complete. 2023-08-09T12:53:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.809+0000 7fe357a0b640 1 Processor -- start 2023-08-09T12:53:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.809+0000 7fe357a0b640 1 -- start start 2023-08-09T12:53:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe357a0b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3380047c0 0x7fe35015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe357a0b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe350159c40 0x7fe3500d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe357a0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3500b0a20 0x7fe3500b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe357a0b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500b13e0 con 0x7fe3500b0a20 2023-08-09T12:53:38.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe357a0b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500d2120 con 0x7fe350159c40 2023-08-09T12:53:38.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe357a0b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35015df70 con 0x7fe3380047c0 2023-08-09T12:53:38.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe355fa8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3500b0a20 0x7fe3500b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:38.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe355fa8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3500b0a20 0x7fe3500b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56358/0 (socket says 172.21.15.17:56358) 2023-08-09T12:53:38.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe355fa8640 1 -- 172.21.15.17:0/997871794 learned_addr learned my addr 172.21.15.17:0/997871794 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:38.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe355fa8640 1 -- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3380047c0 msgr2=0x7fe35015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:38.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe355fa8640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3380047c0 0x7fe35015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe355fa8640 1 -- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe350159c40 msgr2=0x7fe3500d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe355fa8640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe350159c40 0x7fe3500d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.810+0000 7fe355fa8640 1 -- 172.21.15.17:0/997871794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500a9800 con 0x7fe3500b0a20 2023-08-09T12:53:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.811+0000 7fe355fa8640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3500b0a20 0x7fe3500b0ea0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fe350071ae0 tx=0x7fe34800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.811+0000 7fe34dffb640 1 -- 172.21.15.17:0/997871794 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480052e0 con 0x7fe3500b0a20 2023-08-09T12:53:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.811+0000 7fe34dffb640 1 -- 172.21.15.17:0/997871794 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe348005440 con 0x7fe3500b0a20 2023-08-09T12:53:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.811+0000 7fe34dffb640 1 -- 172.21.15.17:0/997871794 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348003830 con 0x7fe3500b0a20 2023-08-09T12:53:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.811+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35015a0c0 con 0x7fe3500b0a20 2023-08-09T12:53:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.811+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35015d920 con 0x7fe3500b0a20 2023-08-09T12:53:38.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.812+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3500b7800 con 0x7fe3500b0a20 2023-08-09T12:53:38.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.813+0000 7fe34dffb640 1 -- 172.21.15.17:0/997871794 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe348003990 con 0x7fe3500b0a20 2023-08-09T12:53:38.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.814+0000 7fe34dffb640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33c06a050 0x7fe33c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:38.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.814+0000 7fe34dffb640 1 -- 172.21.15.17:0/997871794 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe348087bd0 con 0x7fe3500b0a20 2023-08-09T12:53:38.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.815+0000 7fe3557a7640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33c06a050 0x7fe33c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:38.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.816+0000 7fe3557a7640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33c06a050 0x7fe33c06c510 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe340005c30 tx=0x7fe340001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:38.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:38.819+0000 7fe34dffb640 1 -- 172.21.15.17:0/997871794 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe3480532b0 con 0x7fe3500b0a20 2023-08-09T12:53:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.021+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe350067a80 con 0x7fe3500b0a20 2023-08-09T12:53:39.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.025+0000 7fe34dffb640 1 -- 172.21.15.17:0/997871794 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+36925 (secure 0 0 0) 0x7fe348019090 con 0x7fe3500b0a20 2023-08-09T12:53:39.029 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:39.029 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 192, 2023-08-09T12:53:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:53:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:53:31.977136+0000", 2023-08-09T12:53:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:53:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:53:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:53:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:53:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:53:39.031 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:53:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:53:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:53:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:53:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:53:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:53:39.032 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:53:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:53:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:53:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 24, 2023-08-09T12:53:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:53:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:53:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:53:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:53:39.033 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:53:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:53:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:53:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:53:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:53:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:39.036 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:53:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:53:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:53:39.037 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:53:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:53:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:39.038 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:39.039 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:39.040 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:39.041 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:39.043 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:53:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:53:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:53:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:53:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:53:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:53:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:39.046 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:53:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:53:39.047 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:53:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:53:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:53:39.049 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:53:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:53:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:53:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:39.050 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:39.051 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:39.052 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:39.053 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:39.054 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:39.054 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:39.054 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:39.054 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:39.054 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:39.054 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:39.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:39.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.055 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:39.055 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:39.055 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:39.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:39.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:39.056 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:39.056 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:39.056 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:39.056 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:39.056 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:39.056 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:39.056 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:53:39.057 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:39.057 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:53:39.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.057 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:39.057 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:53:39.057 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:53:39.057 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:53:39.058 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:53:39.058 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:53:39.058 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:39.058 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:39.058 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:39.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.059 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 23, 2023-08-09T12:53:39.059 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:53:39.059 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.326271+0000", 2023-08-09T12:53:39.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:39.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:39.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:39.059 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:39.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:39.060 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:39.060 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:39.061 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:39.061 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:39.061 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:39.061 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:39.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:39.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:53:39.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:53:39.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:53:39.062 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:53:39.062 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:53:39.062 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:39.062 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:39.062 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:39.062 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:39.062 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:39.063 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:39.063 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:39.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "190", 2023-08-09T12:53:39.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:39.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:39.063 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:39.063 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:39.064 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:39.064 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:39.064 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:39.064 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:39.064 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:39.064 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:39.065 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:39.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:39.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:39.065 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:39.065 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:39.065 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:39.065 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:39.066 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:39.066 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:39.066 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:39.066 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:39.066 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:39.066 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:39.066 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:39.066 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:39.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:39.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.067 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:39.067 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:39.067 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:39.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:39.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:39.068 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:39.068 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:39.068 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:39.068 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:39.068 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:39.068 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:39.068 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:39.068 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:53:39.069 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:53:39.069 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:53:39.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.069 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:39.069 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:39.069 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:53:39.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.070 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:39.070 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2023-08-09T12:53:39.070 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2023-08-09T12:53:39.070 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:39.070 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:39.070 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:39.070 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:39.071 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:39.071 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:39.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.071 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 24, 2023-08-09T12:53:39.071 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:53:39.072 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.942904+0000", 2023-08-09T12:53:39.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:39.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:39.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:39.072 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:39.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:39.072 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:39.072 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:39.073 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:39.073 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:39.073 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:39.073 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:39.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:39.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:53:39.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:53:39.074 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:53:39.074 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:53:39.074 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:53:39.074 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:39.074 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:39.074 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "192", 2023-08-09T12:53:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:39.076 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:39.076 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:39.076 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:39.076 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:39.076 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:39.076 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:39.076 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:39.077 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:53:39.077 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:39.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:39.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:39.077 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:39.078 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:39.078 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:39.078 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:39.078 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:39.078 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:39.078 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.079 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:39.080 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:39.080 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:39.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:39.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:39.080 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:39.080 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:39.080 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:39.081 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:39.081 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:39.081 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:39.081 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:39.081 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:53:39.081 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:53:39.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.082 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:39.082 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:39.082 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:53:39.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.082 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:53:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:53:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:53:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:53:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:39.083 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:39.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.084 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:39.084 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:53:39.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.084 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:39.084 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:39.086 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:39.086 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:39.086 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:39.086 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.086 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:53:39.087 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:39.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.087 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:53:39.087 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:39.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.087 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.088 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:39.088 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.088 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:53:39.088 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:39.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.089 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:53:39.089 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:39.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.089 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:53:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:53:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:53:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:53:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:53:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:53:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:53:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:53:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:53:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:53:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:53:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:53:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:53:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:53:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:53:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:53:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:53:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:53:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:53:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:53:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:53:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:53:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:53:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:53:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:53:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:53:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:53:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:53:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:53:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:53:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:53:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:53:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:53:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:53:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:53:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:53:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:53:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:53:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:53:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:53:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:53:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:53:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:53:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:53:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:53:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:53:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:53:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.137 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:53:39.137 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:39.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.137 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.137 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:39.137 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.138 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:53:39.138 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:39.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.138 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:53:39.139 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:39.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.139 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.139 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:39.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:53:39.140 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:39.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:53:39.140 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:39.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.141 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.141 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:53:39.141 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:53:39.141 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:53:39.141 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:53:39.141 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:39.142 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:39.142 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:39.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.142 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:39.142 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:39.142 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:39.143 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:39.143 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:39.143 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:39.143 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:39.143 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:39.143 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:39.143 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:39.143 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:39.144 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:39.144 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:39.144 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.144 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:53:39.144 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:39.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:53:39.145 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:39.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.145 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.146 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:39.146 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.146 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:53:39.146 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:39.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.147 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:53:39.147 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:39.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.148 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:39.148 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.148 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.148 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:53:39.148 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:39.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:53:39.149 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:39.149 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.149 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.149 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:39.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:53:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:53:39.151 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:39.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.151 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:53:39.151 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:53:39.151 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:53:39.152 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:53:39.152 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:39.152 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:39.152 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:39.152 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.152 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:39.153 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:39.153 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:39.153 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:39.153 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:39.153 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:39.153 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:39.153 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:39.153 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:39.154 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:39.154 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:39.154 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:39.154 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:39.154 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.154 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:53:39.155 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:39.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.155 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:53:39.155 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:39.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.155 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.156 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:39.156 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.156 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:53:39.156 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:39.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.157 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:53:39.157 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:39.157 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.157 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.158 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:39.158 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.158 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:53:39.158 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:39.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.159 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:53:39.159 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:39.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.159 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.159 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:39.160 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.160 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:53:39.160 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:39.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.161 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:53:39.161 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:39.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.161 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.161 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:53:39.161 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:53:39.162 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:53:39.162 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:53:39.162 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:39.162 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:39.162 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:39.162 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.163 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:39.163 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:39.163 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:39.163 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:39.163 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:39.163 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:39.163 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:39.163 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:39.164 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:39.164 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:39.164 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:39.164 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:39.164 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:39.164 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.165 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:53:39.165 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:39.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.165 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:53:39.165 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:39.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.166 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.166 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:39.166 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.166 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:53:39.167 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:39.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.167 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:53:39.167 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:39.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.167 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.168 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:39.168 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.168 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:53:39.168 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:39.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:53:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:39.170 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:39.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:39.170 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:53:39.170 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:39.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:39.171 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:53:39.171 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:39.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.171 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.171 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:53:39.171 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:53:39.172 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:53:39.172 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:53:39.172 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:39.172 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:39.172 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:39.172 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:39.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.172 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:39.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:53:39.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:39.173 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:39.173 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:39.173 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:39.173 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:39.173 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:39.174 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:53:39.174 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:39.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.174 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:39.174 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:39.174 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:53:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:53:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:39.178 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:53:39.178 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:39.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.178 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:39.178 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:39.178 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:39.178 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:39.179 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:39.179 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:39.179 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:53:39.179 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:39.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.179 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:39.179 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:39.180 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:39.180 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:39.180 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:39.180 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:39.180 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:53:39.180 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:39.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:53:39.182 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:39.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:39.182 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:39.182 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:39.182 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:39.182 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:39.182 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:53:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:53:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:53:39.183 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:53:39.184 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:53:39.184 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:53:39.184 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:53:39.184 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:53:39.184 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:53:39.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:53:39.184 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:53:39.184 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:53:39.185 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:53:39.185 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:53:39.185 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:53:39.185 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:39.185 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:53:39.185 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:53:39.185 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:53:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:53:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:53:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:53:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:53:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:53:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:53:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:53:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:53:39.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:39.187 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33c06a050 msgr2=0x7fe33c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33c06a050 0x7fe33c06c510 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe340005c30 tx=0x7fe340001370 comp rx=0 tx=0).stop 2023-08-09T12:53:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3500b0a20 msgr2=0x7fe3500b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3500b0a20 0x7fe3500b0ea0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fe350071ae0 tx=0x7fe34800e8a0 comp rx=0 tx=0).stop 2023-08-09T12:53:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 shutdown_connections 2023-08-09T12:53:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe33c06a050 0x7fe33c06c510 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3500b0a20 0x7fe3500b0ea0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe350159c40 0x7fe3500d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 --2- 172.21.15.17:0/997871794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3380047c0 0x7fe35015a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 >> 172.21.15.17:0/997871794 conn(0x7fe35006fde0 msgr2=0x7fe35015abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 shutdown_connections 2023-08-09T12:53:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:39.028+0000 7fe357a0b640 1 -- 172.21.15.17:0/997871794 wait complete. 2023-08-09T12:53:39.190 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:53:43.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:53:43.741 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:53:44.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:53:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.430+0000 7f2865eec640 1 Processor -- start 2023-08-09T12:53:44.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.431+0000 7f2865eec640 1 -- start start 2023-08-09T12:53:44.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.432+0000 7f2865eec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 0x7f2860166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:44.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.432+0000 7f2865eec640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286006c990 con 0x7f28600adc40 2023-08-09T12:53:44.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.432+0000 7f2865eec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28600b2250 con 0x7f28600b3b40 2023-08-09T12:53:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.432+0000 7f2865eec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28600ae020 con 0x7f2860163c10 2023-08-09T12:53:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.432+0000 7f285f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f28600adc40 0x7f286006c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:46450/0 (socket says 172.21.15.17:46450) 2023-08-09T12:53:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.432+0000 7f285f7fe640 1 -- 172.21.15.17:0/2606167110 learned_addr learned my addr 172.21.15.17:0/2606167110 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117478113 0 0) 0x7f286006c990 con 0x7f28600adc40 2023-08-09T12:53:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2848003520 con 0x7f28600adc40 2023-08-09T12:53:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285ffff640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 0x7f2860166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2923289489 0 0) 0x7f2848003520 con 0x7f28600adc40 2023-08-09T12:53:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 msgr2=0x7f2860166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 0x7f2860166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 >> v1:172.21.15.142:6789/0 conn(0x7f28600b3b40 legacy=0x7f28600b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600b2530 con 0x7f28600adc40 2023-08-09T12:53:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f2850001670 con 0x7f28600adc40 2023-08-09T12:53:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 >> v1:172.21.15.17:6789/0 conn(0x7f28600adc40 legacy=0x7f286006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 0x7f28480039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848004020 0x7f28480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004d00 0x7f2848005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:44.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28600ae020 con 0x7f2848004020 2023-08-09T12:53:44.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284800bc60 con 0x7f2848004d00 2023-08-09T12:53:44.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.433+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284800be20 con 0x7f2860163c10 2023-08-09T12:53:44.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285effd640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848004020 0x7f28480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:44.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285f7fe640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 0x7f28480039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:44.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285ffff640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004d00 0x7f2848005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:44.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285effd640 1 -- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 msgr2=0x7f28480039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:44.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285effd640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 0x7f28480039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285effd640 1 -- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004d00 msgr2=0x7f2848005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:44.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285effd640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004d00 0x7f2848005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285effd640 1 -- 172.21.15.17:0/2606167110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848003520 con 0x7f2848004020 2023-08-09T12:53:44.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.434+0000 7f285f7fe640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2860163c10 0x7f28480039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:53:44.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.435+0000 7f285effd640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848004020 0x7f28480047c0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f2854001e70 tx=0x7f28480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7946ef665b3f66f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:44.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854003bc0 con 0x7f2848004020 2023-08-09T12:53:44.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854003d20 con 0x7f2848004020 2023-08-09T12:53:44.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f285e7fc640 1 -- 172.21.15.17:0/2606167110 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854005310 con 0x7f2848004020 2023-08-09T12:53:44.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f2865eec640 1 -- 172.21.15.17:0/2606167110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848004020 msgr2=0x7f28480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:44.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f2865eec640 1 --2- 172.21.15.17:0/2606167110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848004020 0x7f28480047c0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f2854001e70 tx=0x7f28480057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f285ffff640 1 -- 172.21.15.17:0/2606167110 reap_dead start 2023-08-09T12:53:44.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f2865eec640 1 -- 172.21.15.17:0/2606167110 shutdown_connections 2023-08-09T12:53:44.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f2865eec640 1 -- 172.21.15.17:0/2606167110 >> 172.21.15.17:0/2606167110 conn(0x7f28600cb1b0 msgr2=0x7f28600cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:44.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f2865eec640 1 -- 172.21.15.17:0/2606167110 shutdown_connections 2023-08-09T12:53:44.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.436+0000 7f2865eec640 1 -- 172.21.15.17:0/2606167110 wait complete. 2023-08-09T12:53:44.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.438+0000 7f2865eec640 1 Processor -- start 2023-08-09T12:53:44.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.438+0000 7f2865eec640 1 -- start start 2023-08-09T12:53:44.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.439+0000 7f2865eec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004020 0x7f28600c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:44.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.439+0000 7f2865eec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2860153300 0x7f28601f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:44.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.439+0000 7f2865eec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28601f1f50 0x7f286015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:44.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.439+0000 7f2865eec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28601f23d0 con 0x7f2860153300 2023-08-09T12:53:44.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.439+0000 7f2865eec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28600c4fe0 con 0x7f2848004020 2023-08-09T12:53:44.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.439+0000 7f2865eec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286015cc10 con 0x7f28601f1f50 2023-08-09T12:53:44.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2860153300 0x7f28601f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:44.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2860153300 0x7f28601f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56374/0 (socket says 172.21.15.17:56374) 2023-08-09T12:53:44.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285effd640 1 -- 172.21.15.17:0/1502779594 learned_addr learned my addr 172.21.15.17:0/1502779594 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:44.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285f7fe640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004020 0x7f28600c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:44.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285ffff640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28601f1f50 0x7f286015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:44.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285effd640 1 -- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28601f1f50 msgr2=0x7f286015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285effd640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28601f1f50 0x7f286015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285effd640 1 -- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004020 msgr2=0x7f28600c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285effd640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004020 0x7f28600c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.440+0000 7f285effd640 1 -- 172.21.15.17:0/1502779594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600c3b70 con 0x7f2860153300 2023-08-09T12:53:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.441+0000 7f285effd640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2860153300 0x7f28601f1a10 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f2854001f90 tx=0x7f28540014f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.441+0000 7f2847fff640 1 -- 172.21.15.17:0/1502779594 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854006da0 con 0x7f2860153300 2023-08-09T12:53:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.441+0000 7f2847fff640 1 -- 172.21.15.17:0/1502779594 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285402f440 con 0x7f2860153300 2023-08-09T12:53:44.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.441+0000 7f2847fff640 1 -- 172.21.15.17:0/1502779594 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285402f7d0 con 0x7f2860153300 2023-08-09T12:53:44.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.441+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286015c000 con 0x7f2860153300 2023-08-09T12:53:44.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.441+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286015c5c0 con 0x7f2860153300 2023-08-09T12:53:44.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.442+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28601f2330 con 0x7f2860153300 2023-08-09T12:53:44.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.443+0000 7f2847fff640 1 -- 172.21.15.17:0/1502779594 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f285402f930 con 0x7f2860153300 2023-08-09T12:53:44.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.444+0000 7f2847fff640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f284c06a050 0x7f284c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:44.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.444+0000 7f2847fff640 1 -- 172.21.15.17:0/1502779594 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28540aa540 con 0x7f2860153300 2023-08-09T12:53:44.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.445+0000 7f2847fff640 1 -- 172.21.15.17:0/1502779594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7f284c0721a0 con 0x7f2860153300 2023-08-09T12:53:44.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.445+0000 7f285f7fe640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f284c06a050 0x7f284c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:44.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.446+0000 7f285f7fe640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f284c06a050 0x7f284c06c510 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2850001030 tx=0x7f2850009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:44.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.449+0000 7f2847fff640 1 -- 172.21.15.17:0/1502779594 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2854047060 con 0x7f2860153300 2023-08-09T12:53:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.650+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2860067a80 con 0x7f2860153300 2023-08-09T12:53:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.652+0000 7f2847fff640 1 -- 172.21.15.17:0/1502779594 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+36944 (secure 0 0 0) 0x7f2854075cb0 con 0x7f2860153300 2023-08-09T12:53:44.656 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:44.656 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:44.656 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 193, 2023-08-09T12:53:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:53:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:53:43.975129+0000", 2023-08-09T12:53:44.658 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:53:44.658 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:53:44.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:53:44.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:53:44.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:53:44.660 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:53:44.660 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:53:44.660 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:53:44.660 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:53:44.661 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:44.661 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:53:44.661 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:53:44.661 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:53:44.661 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:53:44.661 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:53:44.661 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 24, 2023-08-09T12:53:44.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:53:44.662 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:53:44.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:53:44.662 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:53:44.662 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:53:44.662 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:53:44.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.662 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:53:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:53:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:53:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:44.664 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:44.664 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:44.664 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:44.664 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:44.664 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:44.664 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:44.664 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:53:44.665 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:53:44.665 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:53:44.665 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:53:44.665 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:53:44.665 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:44.665 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:44.665 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:44.665 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:44.666 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:44.666 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:44.666 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:44.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.666 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:44.666 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:44.666 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:44.667 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:44.667 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:44.667 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:44.667 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:44.667 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:44.667 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:44.667 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:44.667 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:44.668 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:44.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:44.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:44.668 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:44.668 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:44.668 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:44.668 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:44.669 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:44.669 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:44.669 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:44.669 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:44.669 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:44.669 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:44.669 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:44.669 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:44.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:44.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.670 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:44.670 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:44.670 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:44.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:44.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:44.671 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:44.671 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:44.671 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:44.671 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:44.671 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:44.671 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:44.671 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:44.671 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:53:44.672 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:53:44.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.672 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:44.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:53:44.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.672 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:44.672 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:53:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:53:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:53:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:53:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:53:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:53:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:44.676 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:44.676 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:44.676 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:53:44.676 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:53:44.676 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:53:44.676 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:53:44.676 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:53:44.677 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:44.677 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:44.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:44.677 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:44.677 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:44.677 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:44.677 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:44.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.678 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:44.678 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:44.678 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:44.678 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:44.678 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:44.678 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:44.678 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:44.678 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:44.679 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:44.679 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:44.679 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:44.679 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:44.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:44.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:44.679 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:44.679 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:44.680 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:44.680 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:44.680 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:44.680 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:44.680 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:44.680 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:44.680 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:44.680 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:44.681 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:44.681 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:44.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:44.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.681 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:44.681 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:44.681 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:44.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:44.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:44.682 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:44.682 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:44.682 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:44.682 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:44.682 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:44.682 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:53:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:53:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:53:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:53:44.683 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:53:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:53:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:53:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 23, 2023-08-09T12:53:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:53:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.326271+0000", 2023-08-09T12:53:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:44.685 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:44.686 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:53:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:53:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:53:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:53:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:53:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:44.687 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "190", 2023-08-09T12:53:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:44.688 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:44.689 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:44.690 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:44.691 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:44.692 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:53:44.693 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:53:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:53:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:53:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2023-08-09T12:53:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2023-08-09T12:53:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:44.695 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 24, 2023-08-09T12:53:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:53:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.942904+0000", 2023-08-09T12:53:44.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1027, 2023-08-09T12:53:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-09T12:53:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:44.697 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:53:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:53:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:53:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:53:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:53:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:44.699 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "193", 2023-08-09T12:53:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:44.700 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:53:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:44.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:44.702 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:44.703 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:44.704 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:53:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:53:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:44.705 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:53:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:53:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:53:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:44.706 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:53:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:53:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:53:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:44.708 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:44.709 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:53:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.710 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:53:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:53:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:53:44.712 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.713 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:53:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:53:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:53:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:44.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:53:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:53:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:53:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:53:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:53:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:44.717 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:44.718 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:44.719 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:53:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:53:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:53:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:53:44.722 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.723 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:53:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:53:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:44.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:53:44.725 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:53:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:53:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:53:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:53:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:53:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:44.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:44.728 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:44.729 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:53:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:53:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:53:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:53:44.732 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.733 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:53:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:53:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:44.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:53:44.735 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:53:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:53:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:53:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:53:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:53:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:44.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:44.738 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:44.739 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:53:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:53:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:53:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.742 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:53:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:53:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:53:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:44.744 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:53:44.745 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:53:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:53:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:53:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:53:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:53:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:44.748 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:44.749 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:53:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:53:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:44.751 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:53:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:53:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:53:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.754 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:53:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:53:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:53:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:44.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:53:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:53:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:53:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:53:44.757 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:44.758 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:44.759 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:53:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:44.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:53:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:53:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:53:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:44.763 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:53:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.764 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:53:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:53:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:53:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:44.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:53:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:53:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:53:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:53:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:44.767 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:44.768 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:44.769 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:53:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:44.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:53:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:53:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:53:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:53:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:53:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:53:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:53:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:53:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:53:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:53:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:53:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:53:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:53:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:53:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:53:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:53:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.784 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:53:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:44.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:53:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:53:44.786 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:53:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:53:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:53:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:53:44.787 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:53:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:53:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:53:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:44.791 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:53:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:44.792 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:53:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:53:44.794 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:53:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:53:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:44.797 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:53:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:53:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:53:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:53:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:53:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:53:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:53:44.799 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:53:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:53:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:53:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:53:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:53:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:53:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:53:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:53:44.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:53:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:53:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:53:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:53:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:53:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:53:44.801 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:53:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:53:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:53:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:53:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:53:44.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:44.802 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.655+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f284c06a050 msgr2=0x7f284c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.655+0000 7f2865eec640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f284c06a050 0x7f284c06c510 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2850001030 tx=0x7f2850009040 comp rx=0 tx=0).stop 2023-08-09T12:53:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.655+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2860153300 msgr2=0x7f28601f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.655+0000 7f2865eec640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2860153300 0x7f28601f1a10 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f2854001f90 tx=0x7f28540014f0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.656+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 shutdown_connections 2023-08-09T12:53:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.656+0000 7f2865eec640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f284c06a050 0x7f284c06c510 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.656+0000 7f2865eec640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28601f1f50 0x7f286015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.656+0000 7f2865eec640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2860153300 0x7f28601f1a10 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.656+0000 7f2865eec640 1 --2- 172.21.15.17:0/1502779594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2848004020 0x7f28600c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.656+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 >> 172.21.15.17:0/1502779594 conn(0x7f28600cb1b0 msgr2=0x7f2860159b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.656+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 shutdown_connections 2023-08-09T12:53:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:44.656+0000 7f2865eec640 1 -- 172.21.15.17:0/1502779594 wait complete. 2023-08-09T12:53:44.806 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-09T12:53:44.806 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:53:44.807 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:53:44.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:44.871 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-08-09T12:53:45.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:53:45.311 INFO:teuthology.orchestra.run.smithi017.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-08-09T12:53:45.311 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records in 2023-08-09T12:53:45.311 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records out 2023-08-09T12:53:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.375355 s, 140 MB/s 2023-08-09T12:53:45.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:53:45.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.534+0000 7f1629b99640 1 Processor -- start 2023-08-09T12:53:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.534+0000 7f1629b99640 1 -- start start 2023-08-09T12:53:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.536+0000 7f1629b99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ad810 0x7f16240b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.536+0000 7f1629b99640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16240b4630 con 0x7f1624159d80 2023-08-09T12:53:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.536+0000 7f1629b99640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16240b3ab0 con 0x7f1624070a90 2023-08-09T12:53:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.536+0000 7f1629b99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162415a160 con 0x7f16240ad810 2023-08-09T12:53:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.536+0000 7f16237fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1624159d80 0x7f1624070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:46466/0 (socket says 172.21.15.17:46466) 2023-08-09T12:53:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.536+0000 7f16237fe640 1 -- 172.21.15.17:0/456342318 learned_addr learned my addr 172.21.15.17:0/456342318 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143180647 0 0) 0x7f16240b4630 con 0x7f1624159d80 2023-08-09T12:53:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1610003520 con 0x7f1624159d80 2023-08-09T12:53:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1623fff640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ad810 0x7f16240b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2774678246 0 0) 0x7f1610003520 con 0x7f1624159d80 2023-08-09T12:53:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ad810 msgr2=0x7f16240b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ad810 0x7f16240b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 >> v1:172.21.15.142:6789/0 conn(0x7f1624070a90 legacy=0x7f16240c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240b3d90 con 0x7f1624159d80 2023-08-09T12:53:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f1614001670 con 0x7f1624159d80 2023-08-09T12:53:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 >> v1:172.21.15.17:6789/0 conn(0x7f1624159d80 legacy=0x7f1624070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ad810 0x7f16100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610003f20 0x7f16100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610004d00 0x7f1610005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162415a160 con 0x7f1610004d00 2023-08-09T12:53:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.537+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161000ba60 con 0x7f1610003f20 2023-08-09T12:53:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161000de30 con 0x7f16240ad810 2023-08-09T12:53:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f1623fff640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610004d00 0x7f1610005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f161affd640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610003f20 0x7f16100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f16237fe640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ad810 0x7f16100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f1623fff640 1 -- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ad810 msgr2=0x7f16100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f1623fff640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ad810 0x7f16100039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f1623fff640 1 -- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610003f20 msgr2=0x7f16100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:45.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f1623fff640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610003f20 0x7f16100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.538+0000 7f1623fff640 1 -- 172.21.15.17:0/456342318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610003520 con 0x7f1610004d00 2023-08-09T12:53:45.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.539+0000 7f1623fff640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610004d00 0x7f1610005180 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f161c009ac0 tx=0x7f16100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d4dcebc6955bc3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:45.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.540+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c02c6b0 con 0x7f1610004d00 2023-08-09T12:53:45.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.540+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c02c810 con 0x7f1610004d00 2023-08-09T12:53:45.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.540+0000 7f1622ffd640 1 -- 172.21.15.17:0/456342318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c02cba0 con 0x7f1610004d00 2023-08-09T12:53:45.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.540+0000 7f1629b99640 1 -- 172.21.15.17:0/456342318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610004d00 msgr2=0x7f1610005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:45.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.540+0000 7f1629b99640 1 --2- 172.21.15.17:0/456342318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610004d00 0x7f1610005180 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f161c009ac0 tx=0x7f16100057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.540+0000 7f1623fff640 1 -- 172.21.15.17:0/456342318 reap_dead start 2023-08-09T12:53:45.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.541+0000 7f1629b99640 1 -- 172.21.15.17:0/456342318 shutdown_connections 2023-08-09T12:53:45.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.541+0000 7f1629b99640 1 -- 172.21.15.17:0/456342318 >> 172.21.15.17:0/456342318 conn(0x7f16240cb1b0 msgr2=0x7f16240cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:45.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.541+0000 7f1629b99640 1 -- 172.21.15.17:0/456342318 shutdown_connections 2023-08-09T12:53:45.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.541+0000 7f1629b99640 1 -- 172.21.15.17:0/456342318 wait complete. 2023-08-09T12:53:45.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.543+0000 7f1629b99640 1 Processor -- start 2023-08-09T12:53:45.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.543+0000 7f1629b99640 1 -- start start 2023-08-09T12:53:45.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f1629b99640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610004d00 0x7f16240c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:45.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f1629b99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1624157df0 0x7f16241ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:45.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f1629b99640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240b0910 0x7f16240c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:45.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f1629b99640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240b10d0 con 0x7f1624157df0 2023-08-09T12:53:45.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f1629b99640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240c5de0 con 0x7f1610004d00 2023-08-09T12:53:45.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f1629b99640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16240c60c0 con 0x7f16240b0910 2023-08-09T12:53:45.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f161affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1624157df0 0x7f16241ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:45.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f161affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1624157df0 0x7f16241ee8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56388/0 (socket says 172.21.15.17:56388) 2023-08-09T12:53:45.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.544+0000 7f161affd640 1 -- 172.21.15.17:0/3677367471 learned_addr learned my addr 172.21.15.17:0/3677367471 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:45.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f1623fff640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240b0910 0x7f16240c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:45.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f16237fe640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610004d00 0x7f16240c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f161affd640 1 -- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240b0910 msgr2=0x7f16240c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f161affd640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240b0910 0x7f16240c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f161affd640 1 -- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610004d00 msgr2=0x7f16240c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f161affd640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610004d00 0x7f16240c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f161affd640 1 -- 172.21.15.17:0/3677367471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240c63a0 con 0x7f1624157df0 2023-08-09T12:53:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f1623fff640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240b0910 0x7f16240c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f16237fe640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610004d00 0x7f16240c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f161affd640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1624157df0 0x7f16241ee8f0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f160c00e8f0 tx=0x7f160c00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:45.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f1620ff9640 1 -- 172.21.15.17:0/3677367471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c003bd0 con 0x7f1624157df0 2023-08-09T12:53:45.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f1620ff9640 1 -- 172.21.15.17:0/3677367471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c003d30 con 0x7f1624157df0 2023-08-09T12:53:45.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.545+0000 7f1620ff9640 1 -- 172.21.15.17:0/3677367471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c003ea0 con 0x7f1624157df0 2023-08-09T12:53:45.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.546+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16240c6680 con 0x7f1624157df0 2023-08-09T12:53:45.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.546+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16240c7c70 con 0x7f1624157df0 2023-08-09T12:53:45.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.547+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1624067a80 con 0x7f1624157df0 2023-08-09T12:53:45.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.548+0000 7f1620ff9640 1 -- 172.21.15.17:0/3677367471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f160c00c8e0 con 0x7f1624157df0 2023-08-09T12:53:45.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.549+0000 7f1620ff9640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f160406a080 0x7f160406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:45.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.549+0000 7f1620ff9640 1 -- 172.21.15.17:0/3677367471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f160c088700 con 0x7f1624157df0 2023-08-09T12:53:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.549+0000 7f1620ff9640 1 -- 172.21.15.17:0/3677367471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7f16040721d0 con 0x7f1624157df0 2023-08-09T12:53:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.550+0000 7f16237fe640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f160406a080 0x7f160406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.551+0000 7f16237fe640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f160406a080 0x7f160406c540 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1614001200 tx=0x7f1614001150 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:45.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.553+0000 7f1620ff9640 1 -- 172.21.15.17:0/3677367471 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f160c053de0 con 0x7f1624157df0 2023-08-09T12:53:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.751+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f16240ca4b0 con 0x7f1624157df0 2023-08-09T12:53:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.754+0000 7f1620ff9640 1 -- 172.21.15.17:0/3677367471 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+36944 (secure 0 0 0) 0x7f160c001940 con 0x7f1624157df0 2023-08-09T12:53:45.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:45.758 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:45.759 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 193, 2023-08-09T12:53:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:53:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:53:43.975129+0000", 2023-08-09T12:53:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:53:45.762 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:53:45.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:53:45.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:53:45.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:53:45.763 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:53:45.763 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:53:45.763 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:53:45.764 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:53:45.764 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:45.764 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:53:45.765 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:53:45.765 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:53:45.765 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:53:45.765 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:53:45.766 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 24, 2023-08-09T12:53:45.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:53:45.766 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:53:45.767 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:53:45.767 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:53:45.767 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:53:45.767 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:53:45.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:53:45.768 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:53:45.768 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:53:45.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:45.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:45.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:45.770 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:45.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:45.771 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:45.771 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:45.771 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:45.771 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:45.771 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:45.772 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:45.772 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:45.772 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:53:45.772 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:53:45.772 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:53:45.772 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:53:45.773 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:53:45.773 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:45.773 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:45.773 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:45.774 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:45.774 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:45.774 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:45.774 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:45.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.775 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:45.775 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:45.775 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:45.775 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:45.776 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:45.776 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:45.776 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:45.776 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:45.776 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:45.777 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:45.777 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:45.777 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:45.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:45.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:45.777 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:45.777 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:45.778 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:45.778 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:45.778 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:45.778 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:45.778 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:45.779 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:45.779 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:45.779 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:45.779 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:45.779 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:45.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:45.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:45.780 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:45.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:45.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:45.781 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:45.781 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:45.782 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:45.782 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:45.782 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:45.782 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:45.782 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:45.782 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:53:45.783 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:53:45.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.783 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:45.783 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:53:45.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.783 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:45.783 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:53:45.783 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:53:45.784 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:53:45.784 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:45.784 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:45.784 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:45.784 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:45.784 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:45.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.785 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:53:45.785 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:53:45.785 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:53:45.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:45.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:45.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:45.786 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:45.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:45.787 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:45.787 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:45.788 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:45.788 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:45.788 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:45.788 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:45.789 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:45.789 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:53:45.789 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:53:45.789 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:53:45.790 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:53:45.790 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:53:45.791 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:45.791 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:45.791 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:45.791 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:45.791 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:45.791 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:45.791 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:45.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.792 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:45.792 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:45.792 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:45.792 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:45.792 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:45.792 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:45.794 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:45.794 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:45.794 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:45.794 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:45.794 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:45.794 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:45.794 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:45.794 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:45.795 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:45.795 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:45.795 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:45.795 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:45.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:45.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.795 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:45.796 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:45.796 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:45.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:45.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:45.796 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:45.796 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:45.796 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:45.796 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:45.797 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:45.797 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:45.797 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:53:45.797 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:45.797 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:53:45.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.797 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:45.798 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:53:45.798 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:53:45.798 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:53:45.798 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:53:45.798 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:53:45.798 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:45.798 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:45.798 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:45.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.799 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 23, 2023-08-09T12:53:45.799 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:53:45.799 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.326271+0000", 2023-08-09T12:53:45.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:45.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:45.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:45.800 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:45.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:45.800 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:45.800 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:45.800 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:45.800 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:45.801 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:45.801 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:45.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:45.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:53:45.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:53:45.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:53:45.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:53:45.801 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:53:45.802 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:45.802 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:45.802 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:45.802 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:45.802 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:45.802 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:45.802 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:45.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.803 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "190", 2023-08-09T12:53:45.803 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:45.803 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:45.803 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:45.803 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:45.803 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:45.804 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:45.804 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:45.804 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:45.804 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:45.804 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:45.804 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:45.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:45.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:45.805 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:45.805 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:45.805 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:45.805 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:45.805 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:45.805 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:45.805 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:45.806 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:45.806 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:45.806 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:45.806 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:45.806 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:45.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:45.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.806 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:45.807 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:45.807 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:45.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:45.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:45.807 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:45.807 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:45.807 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:45.807 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:45.808 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:45.808 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:45.808 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:45.808 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:53:45.808 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:53:45.808 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:53:45.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:53:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2023-08-09T12:53:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2023-08-09T12:53:45.810 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:45.810 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:45.810 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:45.810 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:45.810 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:45.810 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:45.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.811 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 24, 2023-08-09T12:53:45.811 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:53:45.811 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.942904+0000", 2023-08-09T12:53:45.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1027, 2023-08-09T12:53:45.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-09T12:53:45.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:45.812 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:45.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:45.812 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:45.812 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:45.812 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:45.813 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:45.813 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:45.813 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:45.813 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:45.813 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:53:45.813 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:53:45.813 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:53:45.813 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:53:45.814 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:53:45.814 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:45.814 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:45.814 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:45.814 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:45.814 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:45.814 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:45.814 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:45.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.815 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "193", 2023-08-09T12:53:45.815 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:45.815 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:45.815 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:45.815 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:45.815 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:45.816 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:45.816 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:45.816 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:45.816 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:45.816 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:53:45.816 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:45.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:45.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:45.817 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:45.817 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:45.817 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:45.817 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:45.817 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:45.817 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:45.817 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:45.817 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:45.818 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:45.818 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:45.818 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:45.818 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:45.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:45.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.818 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:45.819 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:45.819 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:45.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:45.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:45.819 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:45.819 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:45.819 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:45.819 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:45.820 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:45.820 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:45.820 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:45.820 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:53:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:53:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:53:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:45.822 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:53:45.822 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:53:45.822 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:45.822 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:53:45.822 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:53:45.822 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:45.822 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:53:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:45.823 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:45.824 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:45.825 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:45.825 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:45.825 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:45.825 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:45.825 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.825 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:53:45.826 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:45.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.826 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:53:45.826 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:45.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.826 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.827 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:45.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:53:45.827 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:45.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:53:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.829 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:45.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:53:45.829 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:45.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.830 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:53:45.830 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:45.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.830 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.830 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:45.830 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.831 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:53:45.831 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:45.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.831 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:53:45.832 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:45.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.832 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.832 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:53:45.832 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:53:45.832 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:53:45.833 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:53:45.833 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:45.833 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:45.833 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:45.833 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.833 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:45.834 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:45.834 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:45.834 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:45.834 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:45.834 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:45.834 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:45.834 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:45.834 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:45.835 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:45.835 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:45.835 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:45.835 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:45.835 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.835 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:53:45.836 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:45.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.836 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:53:45.836 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:45.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.837 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.837 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:45.837 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.837 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:53:45.838 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:45.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.838 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:53:45.838 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:45.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.838 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.839 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:45.839 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.839 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:53:45.839 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:45.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.840 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:53:45.840 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:45.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.840 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.841 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:45.841 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.841 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:53:45.841 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:45.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.842 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:53:45.842 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:45.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.842 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.842 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:53:45.842 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:53:45.843 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:53:45.843 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:53:45.843 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:45.843 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:45.843 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:45.843 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.844 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:45.844 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:45.844 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:45.844 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:45.844 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:45.844 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:45.844 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:45.845 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:45.845 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:45.845 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:45.845 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:45.845 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:45.845 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:45.845 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.846 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:53:45.846 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:45.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.846 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:53:45.846 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:45.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.847 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.847 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:45.847 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.847 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:53:45.848 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:45.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.848 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:53:45.848 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:45.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.849 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.849 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:45.849 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.849 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:53:45.849 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:45.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:53:45.850 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:45.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.851 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:45.851 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.851 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:53:45.851 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:45.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.852 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:53:45.852 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:45.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.852 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:53:45.853 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:53:45.853 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:53:45.853 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:53:45.853 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:45.853 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:45.853 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:45.853 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.854 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:45.854 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:45.854 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:45.854 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:45.854 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:45.854 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:45.854 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:45.855 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:45.855 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:45.855 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:45.855 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:45.855 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:45.855 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:45.855 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.856 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:53:45.856 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:45.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.856 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:53:45.857 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:45.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.857 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.857 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:45.857 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:53:45.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:45.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.858 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:53:45.858 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:45.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.859 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.859 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:45.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.859 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:53:45.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:45.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.860 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:53:45.860 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:45.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.861 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:45.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.861 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:53:45.861 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:53:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.863 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:53:45.863 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:53:45.863 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:53:45.863 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:53:45.863 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:45.863 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:45.863 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:45.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.864 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:45.864 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:45.864 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:45.864 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:45.864 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:45.865 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:45.865 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:45.865 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:45.865 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:45.865 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:45.865 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:45.865 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:45.865 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:45.866 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.866 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:53:45.866 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:45.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:53:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:53:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:53:45.869 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:45.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.869 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.869 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:45.869 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:53:45.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:45.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.870 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:53:45.870 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:45.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.871 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.871 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:45.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.871 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:53:45.871 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:53:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.873 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:53:45.873 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:53:45.873 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:53:45.873 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:53:45.873 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:45.873 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:45.873 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:45.875 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:45.875 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:45.875 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:45.875 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:45.875 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:45.875 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:45.875 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:45.875 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:45.876 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.876 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:53:45.876 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:45.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:53:45.877 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:45.877 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.877 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.877 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:45.877 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:53:45.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:45.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.878 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:53:45.878 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:45.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.879 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.879 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:45.879 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.880 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:53:45.880 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:45.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.880 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:53:45.880 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:45.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.881 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:45.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.881 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:53:45.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:45.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.882 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:53:45.882 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:45.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.882 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.883 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:53:45.883 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:53:45.883 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:53:45.883 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:53:45.883 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:45.883 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:45.883 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:45.884 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.884 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:45.884 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:45.884 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:45.884 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:45.884 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:45.885 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:45.885 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:45.885 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:45.885 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:45.885 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:45.885 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:45.885 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:45.885 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:53:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:53:45.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:45.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.887 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:45.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:53:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:53:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.890 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:53:45.890 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:45.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.890 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:53:45.890 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:45.891 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.891 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.891 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:45.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.891 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:53:45.892 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:45.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.892 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:53:45.892 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:45.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.892 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.893 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:53:45.893 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:53:45.893 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:53:45.893 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:53:45.893 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:45.893 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:45.893 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:45.894 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.894 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:45.894 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:45.894 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:45.894 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:45.895 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:45.895 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:45.895 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:45.895 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:45.895 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:45.895 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:45.895 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:45.895 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:45.896 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:45.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.896 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:53:45.896 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:45.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:53:45.897 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:45.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.897 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.897 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:45.897 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:53:45.898 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:45.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.898 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:53:45.899 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:45.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.899 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:45.899 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:53:45.900 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:45.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.900 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:53:45.900 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:45.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.901 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:45.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:45.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:45.901 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:53:45.902 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:45.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:45.902 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:53:45.902 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:45.902 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.902 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.903 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:53:45.903 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:53:45.903 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:53:45.903 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:53:45.903 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:45.903 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:45.903 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:45.904 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:45.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.904 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:45.904 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:53:45.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.904 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:45.904 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:45.905 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:45.905 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:45.905 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:45.905 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:45.905 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:53:45.905 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:45.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.906 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:45.906 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:45.906 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:45.906 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:45.906 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:45.906 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:45.906 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:53:45.906 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:45.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.907 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:45.907 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:45.907 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:45.907 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:45.907 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:45.907 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:45.908 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:53:45.908 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:45.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.908 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:45.908 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:45.908 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:45.908 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:45.909 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:45.909 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:45.909 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:53:45.909 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:45.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.909 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:45.910 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:45.910 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:45.910 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:45.910 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:45.910 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:45.910 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:53:45.910 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:45.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.911 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:45.911 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:45.911 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:45.911 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:45.911 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:45.911 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:45.911 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:53:45.912 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:45.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.912 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:45.912 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:45.912 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:45.913 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:45.913 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:45.913 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:45.913 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:53:45.913 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:45.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:45.914 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:45.914 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:45.914 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:45.914 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:45.914 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:45.914 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:45.914 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:53:45.914 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:45.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.915 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:45.915 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:53:45.915 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:53:45.915 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:53:45.915 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:53:45.915 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:53:45.915 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:53:45.916 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:53:45.916 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:53:45.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:53:45.916 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:53:45.916 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:53:45.916 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:53:45.916 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:53:45.917 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:53:45.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:45.917 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:53:45.917 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:53:45.917 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:53:45.917 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:53:45.917 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:53:45.918 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:53:45.918 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:53:45.918 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:53:45.918 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:53:45.918 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:53:45.918 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:53:45.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:45.918 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f160406a080 msgr2=0x7f160406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f160406a080 0x7f160406c540 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1614001200 tx=0x7f1614001150 comp rx=0 tx=0).stop 2023-08-09T12:53:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1624157df0 msgr2=0x7f16241ee8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1624157df0 0x7f16241ee8f0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f160c00e8f0 tx=0x7f160c00edb0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 shutdown_connections 2023-08-09T12:53:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f160406a080 0x7f160406c540 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240b0910 0x7f16240c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1624157df0 0x7f16241ee8f0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 --2- 172.21.15.17:0/3677367471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1610004d00 0x7f16240c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.757+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 >> 172.21.15.17:0/3677367471 conn(0x7f16240cb1b0 msgr2=0x7f16241590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.758+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 shutdown_connections 2023-08-09T12:53:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:45.758+0000 7f1629b99640 1 -- 172.21.15.17:0/3677367471 wait complete. 2023-08-09T12:53:45.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:46.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.157+0000 7f048eb71640 1 Processor -- start 2023-08-09T12:53:46.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.158+0000 7f048eb71640 1 -- start start 2023-08-09T12:53:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.159+0000 7f048eb71640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f04881616e0 0x7f04880b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.159+0000 7f048eb71640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f04880d29d0 0x7f04880d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.159+0000 7f048eb71640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04880d3360 con 0x7f048815ce90 2023-08-09T12:53:46.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.159+0000 7f048eb71640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04880b6540 con 0x7f04880d29d0 2023-08-09T12:53:46.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.159+0000 7f048eb71640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04880cdd10 con 0x7f04881616e0 2023-08-09T12:53:46.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.159+0000 7f048c90d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f048815ce90 0x7f04880cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:46474/0 (socket says 172.21.15.17:46474) 2023-08-09T12:53:46.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.159+0000 7f048c90d640 1 -- 172.21.15.17:0/4267595971 learned_addr learned my addr 172.21.15.17:0/4267595971 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:46.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.160+0000 7f048d10e640 1 --2- 172.21.15.17:0/4267595971 >> v2:172.21.15.17:3300/0 conn(0x7f04880d29d0 0x7f04880d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:46.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.160+0000 7f0487fff640 1 --2- 172.21.15.17:0/4267595971 >> v2:172.21.15.142:3300/0 conn(0x7f04881616e0 0x7f04880b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:46.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.160+0000 7f04877fe640 1 -- 172.21.15.17:0/4267595971 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605229894 0 0) 0x7f047c001110 con 0x7f048815ce90 2023-08-09T12:53:46.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.160+0000 7f04877fe640 1 -- 172.21.15.17:0/4267595971 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0478003520 con 0x7f048815ce90 2023-08-09T12:53:46.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.160+0000 7f048d10e640 1 -- 172.21.15.17:0/4267595971 >> v2:172.21.15.142:3300/0 conn(0x7f04881616e0 msgr2=0x7f04880b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:46.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.160+0000 7f048d10e640 1 --2- 172.21.15.17:0/4267595971 >> v2:172.21.15.142:3300/0 conn(0x7f04881616e0 0x7f04880b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.160+0000 7f048d10e640 1 -- 172.21.15.17:0/4267595971 >> v1:172.21.15.17:6789/0 conn(0x7f048815ce90 legacy=0x7f04880cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:46.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.160+0000 7f048d10e640 1 -- 172.21.15.17:0/4267595971 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04880cdff0 con 0x7f04880d29d0 2023-08-09T12:53:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.162+0000 7f048d10e640 1 --2- 172.21.15.17:0/4267595971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04880d29d0 0x7f04880d2e20 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f04880c9c00 tx=0x7f048002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865e8dae39d753ab server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.162+0000 7f04877fe640 1 -- 172.21.15.17:0/4267595971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048002cc80 con 0x7f04880d29d0 2023-08-09T12:53:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.162+0000 7f04877fe640 1 -- 172.21.15.17:0/4267595971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048002cde0 con 0x7f04880d29d0 2023-08-09T12:53:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.162+0000 7f04877fe640 1 -- 172.21.15.17:0/4267595971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480034660 con 0x7f04880d29d0 2023-08-09T12:53:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.163+0000 7f048eb71640 1 -- 172.21.15.17:0/4267595971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04880d29d0 msgr2=0x7f04880d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.163+0000 7f048eb71640 1 --2- 172.21.15.17:0/4267595971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04880d29d0 0x7f04880d2e20 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f04880c9c00 tx=0x7f048002bed0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.163+0000 7f048eb71640 1 -- 172.21.15.17:0/4267595971 shutdown_connections 2023-08-09T12:53:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.163+0000 7f048eb71640 1 --2- 172.21.15.17:0/4267595971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04880d29d0 0x7f04880d2e20 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.163+0000 7f048eb71640 1 --2- 172.21.15.17:0/4267595971 >> v2:172.21.15.142:3300/0 conn(0x7f04881616e0 0x7f04880b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.163+0000 7f048eb71640 1 -- 172.21.15.17:0/4267595971 >> 172.21.15.17:0/4267595971 conn(0x7f048806fde0 msgr2=0x7f04880701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.163+0000 7f048eb71640 1 -- 172.21.15.17:0/4267595971 shutdown_connections 2023-08-09T12:53:46.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.163+0000 7f048eb71640 1 -- 172.21.15.17:0/4267595971 wait complete. 2023-08-09T12:53:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.165+0000 7f048eb71640 1 Processor -- start 2023-08-09T12:53:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.165+0000 7f048eb71640 1 -- start start 2023-08-09T12:53:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f048eb71640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04880d29d0 0x7f04881f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f048eb71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f048815ce90 0x7f04880a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f048eb71640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04881616e0 0x7f04880cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:46.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f048eb71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04881493a0 con 0x7f048815ce90 2023-08-09T12:53:46.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f048eb71640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488149680 con 0x7f04880d29d0 2023-08-09T12:53:46.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f048eb71640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0488149960 con 0x7f04881616e0 2023-08-09T12:53:46.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f0487fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f048815ce90 0x7f04880a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f0487fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f048815ce90 0x7f04880a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56410/0 (socket says 172.21.15.17:56410) 2023-08-09T12:53:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.166+0000 7f0487fff640 1 -- 172.21.15.17:0/1147236 learned_addr learned my addr 172.21.15.17:0/1147236 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.167+0000 7f048c90d640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04880d29d0 0x7f04881f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.167+0000 7f0487fff640 1 -- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04881616e0 msgr2=0x7f04880cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.167+0000 7f0487fff640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04881616e0 0x7f04880cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.167+0000 7f0487fff640 1 -- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04880d29d0 msgr2=0x7f04881f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.167+0000 7f0487fff640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04880d29d0 0x7f04881f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.167+0000 7f0487fff640 1 -- 172.21.15.17:0/1147236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0480009a70 con 0x7f048815ce90 2023-08-09T12:53:46.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.167+0000 7f0487fff640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f048815ce90 0x7f04880a9680 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f047400e870 tx=0x7f047400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:46.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.167+0000 7f04857fa640 1 -- 172.21.15.17:0/1147236 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04740094f0 con 0x7f048815ce90 2023-08-09T12:53:46.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.168+0000 7f04857fa640 1 -- 172.21.15.17:0/1147236 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047400c940 con 0x7f048815ce90 2023-08-09T12:53:46.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.168+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0488149c40 con 0x7f048815ce90 2023-08-09T12:53:46.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.168+0000 7f04857fa640 1 -- 172.21.15.17:0/1147236 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400ccf0 con 0x7f048815ce90 2023-08-09T12:53:46.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.168+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04881f5f60 con 0x7f048815ce90 2023-08-09T12:53:46.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.169+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0488067a80 con 0x7f048815ce90 2023-08-09T12:53:46.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.170+0000 7f04857fa640 1 -- 172.21.15.17:0/1147236 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0474013470 con 0x7f048815ce90 2023-08-09T12:53:46.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.171+0000 7f04857fa640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f046c06a050 0x7f046c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:46.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.171+0000 7f04857fa640 1 -- 172.21.15.17:0/1147236 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04740886f0 con 0x7f048815ce90 2023-08-09T12:53:46.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.171+0000 7f04857fa640 1 -- 172.21.15.17:0/1147236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7f046c0721a0 con 0x7f048815ce90 2023-08-09T12:53:46.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.172+0000 7f048c90d640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f046c06a050 0x7f046c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:46.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.173+0000 7f048c90d640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f046c06a050 0x7f046c06c510 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f047c001370 tx=0x7f047c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:46.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.175+0000 7f04857fa640 1 -- 172.21.15.17:0/1147236 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0474053dd0 con 0x7f048815ce90 2023-08-09T12:53:46.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.406+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04880cc4e0 con 0x7f048815ce90 2023-08-09T12:53:46.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.407+0000 7f04857fa640 1 -- 172.21.15.17:0/1147236 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f0474021020 con 0x7f048815ce90 2023-08-09T12:53:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:46.411 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:53:46.411 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:53:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f046c06a050 msgr2=0x7f046c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f046c06a050 0x7f046c06c510 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f047c001370 tx=0x7f047c009040 comp rx=0 tx=0).stop 2023-08-09T12:53:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f048815ce90 msgr2=0x7f04880a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f048815ce90 0x7f04880a9680 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f047400e870 tx=0x7f047400ed30 comp rx=0 tx=0).stop 2023-08-09T12:53:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 shutdown_connections 2023-08-09T12:53:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f046c06a050 0x7f046c06c510 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04881616e0 0x7f04880cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f048815ce90 0x7f04880a9680 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 --2- 172.21.15.17:0/1147236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04880d29d0 0x7f04881f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 >> 172.21.15.17:0/1147236 conn(0x7f048806fde0 msgr2=0x7f04880b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 shutdown_connections 2023-08-09T12:53:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:46.410+0000 7f048eb71640 1 -- 172.21.15.17:0/1147236 wait complete. 2023-08-09T12:53:46.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-09T12:53:46.663 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":9453,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.159807830999998,"mdsmap_epoch":93,"osdmap_epoch":193,"osdmap_epoch_barrier":193,"uptime":32.166904029000001} 2023-08-09T12:53:46.664 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 9453, "mdsmap_epoch": 93, "osdmap_epoch": 193, "osdmap_epoch_barrier": 193, "rank_uptime": 26.159807831, "state": "up:active", "uptime": 32.166904029, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:53:46.664 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:53:46.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:46.665 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-08-09T12:53:46.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:53:46.720 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-08-09T12:53:46.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:53:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.028+0000 7ff4af59e640 1 Processor -- start 2023-08-09T12:53:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.028+0000 7ff4af59e640 1 -- start start 2023-08-09T12:53:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.030+0000 7ff4af59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4b0159bd0 0x7ff4b00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.030+0000 7ff4af59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff4b00697c0 0x7ff4b0069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.030+0000 7ff4af59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b006fe10 con 0x7ff4b00b3fe0 2023-08-09T12:53:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.030+0000 7ff4af59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b00b11a0 con 0x7ff4b00697c0 2023-08-09T12:53:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.030+0000 7ff4af59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b006a190 con 0x7ff4b0159bd0 2023-08-09T12:53:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4a5d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff4b00b3fe0 0x7ff4b0070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:46488/0 (socket says 172.21.15.17:46488) 2023-08-09T12:53:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4a5d9b640 1 -- 172.21.15.17:0/263514065 learned_addr learned my addr 172.21.15.17:0/263514065 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4aed9d640 1 --2- 172.21.15.17:0/263514065 >> v2:172.21.15.17:3300/0 conn(0x7ff4b00697c0 0x7ff4b0069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4ae59c640 1 --2- 172.21.15.17:0/263514065 >> v2:172.21.15.142:3300/0 conn(0x7ff4b0159bd0 0x7ff4b00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4aed9d640 1 -- 172.21.15.17:0/263514065 >> v2:172.21.15.142:3300/0 conn(0x7ff4b0159bd0 msgr2=0x7ff4b00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4aed9d640 1 --2- 172.21.15.17:0/263514065 >> v2:172.21.15.142:3300/0 conn(0x7ff4b0159bd0 0x7ff4b00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4aed9d640 1 -- 172.21.15.17:0/263514065 >> v1:172.21.15.17:6789/0 conn(0x7ff4b00b3fe0 legacy=0x7ff4b0070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:47.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4add9b640 1 -- 172.21.15.17:0/263514065 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199359446 0 0) 0x7ff4b006fe10 con 0x7ff4b00b3fe0 2023-08-09T12:53:47.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.031+0000 7ff4aed9d640 1 -- 172.21.15.17:0/263514065 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0159fb0 con 0x7ff4b00697c0 2023-08-09T12:53:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.032+0000 7ff4aed9d640 1 --2- 172.21.15.17:0/263514065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b0069c50 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7ff4b006cca0 tx=0x7ff4a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0d88f1e70122f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.033+0000 7ff4add9b640 1 -- 172.21.15.17:0/263514065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a802e070 con 0x7ff4b00697c0 2023-08-09T12:53:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.033+0000 7ff4add9b640 1 -- 172.21.15.17:0/263514065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80315a0 con 0x7ff4b00697c0 2023-08-09T12:53:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.033+0000 7ff4add9b640 1 -- 172.21.15.17:0/263514065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8031930 con 0x7ff4b00697c0 2023-08-09T12:53:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.033+0000 7ff4af59e640 1 -- 172.21.15.17:0/263514065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 msgr2=0x7ff4b0069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.033+0000 7ff4af59e640 1 --2- 172.21.15.17:0/263514065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b0069c50 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7ff4b006cca0 tx=0x7ff4a802b840 comp rx=0 tx=0).stop 2023-08-09T12:53:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.034+0000 7ff4af59e640 1 -- 172.21.15.17:0/263514065 shutdown_connections 2023-08-09T12:53:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.034+0000 7ff4af59e640 1 --2- 172.21.15.17:0/263514065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b0069c50 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.034+0000 7ff4af59e640 1 --2- 172.21.15.17:0/263514065 >> v2:172.21.15.142:3300/0 conn(0x7ff4b0159bd0 0x7ff4b00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.034+0000 7ff4af59e640 1 -- 172.21.15.17:0/263514065 >> 172.21.15.17:0/263514065 conn(0x7ff4b00b1d50 msgr2=0x7ff4b006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.034+0000 7ff4af59e640 1 -- 172.21.15.17:0/263514065 shutdown_connections 2023-08-09T12:53:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.034+0000 7ff4af59e640 1 -- 172.21.15.17:0/263514065 wait complete. 2023-08-09T12:53:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.035+0000 7ff4af59e640 1 Processor -- start 2023-08-09T12:53:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.036+0000 7ff4af59e640 1 -- start start 2023-08-09T12:53:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4af59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b01577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4af59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4b00b3fe0 0x7ff4b00aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4af59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b0159bd0 0x7ff4b00b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4af59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00ae720 con 0x7ff4b00697c0 2023-08-09T12:53:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4af59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00aea00 con 0x7ff4b00b3fe0 2023-08-09T12:53:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4af59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00aece0 con 0x7ff4b0159bd0 2023-08-09T12:53:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b01577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b01577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56436/0 (socket says 172.21.15.17:56436) 2023-08-09T12:53:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4ae59c640 1 -- 172.21.15.17:0/1547115868 learned_addr learned my addr 172.21.15.17:0/1547115868 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4aed9d640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b0159bd0 0x7ff4b00b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4a5d9b640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4b00b3fe0 0x7ff4b00aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4ae59c640 1 -- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b0159bd0 msgr2=0x7ff4b00b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4ae59c640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b0159bd0 0x7ff4b00b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4ae59c640 1 -- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4b00b3fe0 msgr2=0x7ff4b00aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4ae59c640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4b00b3fe0 0x7ff4b00aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.037+0000 7ff4ae59c640 1 -- 172.21.15.17:0/1547115868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009400 con 0x7ff4b00697c0 2023-08-09T12:53:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.038+0000 7ff4ae59c640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b01577c0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000e870 tx=0x7ff4a000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.038+0000 7ff4a77fe640 1 -- 172.21.15.17:0/1547115868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00094f0 con 0x7ff4b00697c0 2023-08-09T12:53:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.038+0000 7ff4a77fe640 1 -- 172.21.15.17:0/1547115868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a000c940 con 0x7ff4b00697c0 2023-08-09T12:53:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.038+0000 7ff4a77fe640 1 -- 172.21.15.17:0/1547115868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000ccf0 con 0x7ff4b00697c0 2023-08-09T12:53:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.038+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b00aefc0 con 0x7ff4b00697c0 2023-08-09T12:53:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.038+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b00ae410 con 0x7ff4b00697c0 2023-08-09T12:53:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.040+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b004e390 con 0x7ff4b00697c0 2023-08-09T12:53:47.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.041+0000 7ff4a77fe640 1 -- 172.21.15.17:0/1547115868 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff4a0013470 con 0x7ff4b00697c0 2023-08-09T12:53:47.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.041+0000 7ff4a77fe640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff49006a050 0x7ff49006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:47.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.042+0000 7ff4a77fe640 1 -- 172.21.15.17:0/1547115868 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4a0088680 con 0x7ff4b00697c0 2023-08-09T12:53:47.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.042+0000 7ff4a77fe640 1 -- 172.21.15.17:0/1547115868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7ff4900721a0 con 0x7ff4b00697c0 2023-08-09T12:53:47.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.042+0000 7ff4a5d9b640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff49006a050 0x7ff49006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:47.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.043+0000 7ff4a5d9b640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff49006a050 0x7ff49006c510 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff4b01e7ef0 tx=0x7ff498007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:47.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.047+0000 7ff4a77fe640 1 -- 172.21.15.17:0/1547115868 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff4a0053d60 con 0x7ff4b00697c0 2023-08-09T12:53:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.245+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff4b01590a0 con 0x7ff4b00697c0 2023-08-09T12:53:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.248+0000 7ff4a77fe640 1 -- 172.21.15.17:0/1547115868 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+36944 (secure 0 0 0) 0x7ff4a0021090 con 0x7ff4b00697c0 2023-08-09T12:53:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:47.252 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 193, 2023-08-09T12:53:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:53:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:53:43.975129+0000", 2023-08-09T12:53:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:53:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:53:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:53:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:53:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:53:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:53:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:53:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:53:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:53:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:53:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:53:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:53:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:53:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:53:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 24, 2023-08-09T12:53:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:53:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:53:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:53:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:53:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:53:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:53:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:53:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:53:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:53:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:53:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:53:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:53:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:53:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:53:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:53:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:53:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:53:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:53:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:53:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:53:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:53:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:53:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:53:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:53:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:53:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:53:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:53:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:53:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:53:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:53:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:53:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:53:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:53:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:53:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:53:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 23, 2023-08-09T12:53:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:53:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.326271+0000", 2023-08-09T12:53:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:53:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:53:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:53:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:53:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:53:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "190", 2023-08-09T12:53:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:53:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:53:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:53:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:53:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2023-08-09T12:53:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2023-08-09T12:53:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 24, 2023-08-09T12:53:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:53:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.942904+0000", 2023-08-09T12:53:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1027, 2023-08-09T12:53:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-09T12:53:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:53:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:53:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:53:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:53:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:53:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "193", 2023-08-09T12:53:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:53:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:53:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:53:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:53:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:53:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:53:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:53:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:53:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:53:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:53:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:53:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:53:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:53:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:53:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:53:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:53:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:53:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:53:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:53:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:53:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:53:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:53:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:53:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:53:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:53:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:53:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:53:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:53:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:53:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:53:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:53:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:53:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:53:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:53:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:53:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:53:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:53:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:53:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:53:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:53:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:53:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:53:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:53:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:53:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:53:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:53:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:53:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:53:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:53:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:53:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:53:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:53:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:53:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:53:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:53:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:53:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:53:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:53:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:53:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:53:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:53:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:53:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:53:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:53:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:53:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:53:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:53:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:53:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:53:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:53:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:53:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:53:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:53:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:53:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:53:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:53:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:53:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:53:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:53:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:53:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:53:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:53:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:53:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:53:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:53:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:53:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:53:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:53:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:53:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:53:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:53:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:53:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:53:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:53:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:53:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:53:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:53:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:53:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:53:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:53:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:53:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:53:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:53:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:53:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:53:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:53:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:53:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:53:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:53:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:53:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:53:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:53:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:53:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:53:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:53:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:53:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:53:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:53:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:53:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:53:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:53:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:53:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:53:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:53:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:53:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:53:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:53:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:53:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:53:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:53:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:53:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:53:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:53:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:53:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:53:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:53:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:53:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:53:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:53:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:47.430 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff49006a050 msgr2=0x7ff49006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff49006a050 0x7ff49006c510 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff4b01e7ef0 tx=0x7ff498007ed0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 msgr2=0x7ff4b01577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b01577c0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000e870 tx=0x7ff4a000ed30 comp rx=0 tx=0).stop 2023-08-09T12:53:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 shutdown_connections 2023-08-09T12:53:47.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff49006a050 0x7ff49006c510 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b0159bd0 0x7ff4b00b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4b00b3fe0 0x7ff4b00aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 --2- 172.21.15.17:0/1547115868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b00697c0 0x7ff4b01577c0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 >> 172.21.15.17:0/1547115868 conn(0x7ff4b00b1d50 msgr2=0x7ff4b00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 shutdown_connections 2023-08-09T12:53:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:47.252+0000 7ff4af59e640 1 -- 172.21.15.17:0/1547115868 wait complete. 2023-08-09T12:53:47.434 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:53:52.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:53:52.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.669+0000 7f6ede39b640 1 Processor -- start 2023-08-09T12:53:52.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.669+0000 7f6ede39b640 1 -- start start 2023-08-09T12:53:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.671+0000 7f6ede39b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ed81587e0 0x7f6ed8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.671+0000 7f6ede39b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed815beb0 con 0x7f6ed80b0b10 2023-08-09T12:53:52.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.671+0000 7f6ede39b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed80715c0 con 0x7f6ed80cb070 2023-08-09T12:53:52.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.671+0000 7f6ede39b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80718a0 con 0x7f6ed81587e0 2023-08-09T12:53:52.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.671+0000 7f6edcb98640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6ed80b0b10 0x7f6ed815b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39062/0 (socket says 172.21.15.17:39062) 2023-08-09T12:53:52.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.671+0000 7f6edcb98640 1 -- 172.21.15.17:0/2082077991 learned_addr learned my addr 172.21.15.17:0/2082077991 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:52.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053277080 0 0) 0x7f6ed815beb0 con 0x7f6ed80b0b10 2023-08-09T12:53:52.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6edd399640 1 --2- 172.21.15.17:0/2082077991 >> v2:172.21.15.142:3300/0 conn(0x7f6ed81587e0 0x7f6ed8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:52.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec4003520 con 0x7f6ed80b0b10 2023-08-09T12:53:52.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821950278 0 0) 0x7f6ec4003520 con 0x7f6ed80b0b10 2023-08-09T12:53:52.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 >> v2:172.21.15.142:3300/0 conn(0x7f6ed81587e0 msgr2=0x7f6ed8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:52.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 --2- 172.21.15.17:0/2082077991 >> v2:172.21.15.142:3300/0 conn(0x7f6ed81587e0 0x7f6ed8070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:52.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 >> v1:172.21.15.142:6789/0 conn(0x7f6ed80cb070 legacy=0x7f6ed815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:52.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8071b80 con 0x7f6ed80b0b10 2023-08-09T12:53:52.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f6ec8001670 con 0x7f6ed80b0b10 2023-08-09T12:53:52.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 >> v1:172.21.15.17:6789/0 conn(0x7f6ed80b0b10 legacy=0x7f6ed815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:52.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ec4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:52.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec40047c0 0x7f6ec4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:52.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec4005180 0x7f6ec400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:52.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80718a0 con 0x7f6ec4003970 2023-08-09T12:53:52.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec400c020 con 0x7f6ec4005180 2023-08-09T12:53:52.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.672+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec400c1e0 con 0x7f6ec40047c0 2023-08-09T12:53:52.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.673+0000 7f6edd399640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ec4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:52.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.673+0000 7f6eddb9a640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec4005180 0x7f6ec400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:52.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.673+0000 7f6edd399640 1 -- 172.21.15.17:0/2082077991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec40047c0 msgr2=0x7f6ec4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:52.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.673+0000 7f6edd399640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec40047c0 0x7f6ec4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:52.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.673+0000 7f6edd399640 1 -- 172.21.15.17:0/2082077991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec4005180 msgr2=0x7f6ec400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:52.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.673+0000 7f6edd399640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec4005180 0x7f6ec400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:52.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.673+0000 7f6eddb9a640 1 -- 172.21.15.17:0/2082077991 reap_dead start 2023-08-09T12:53:52.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.673+0000 7f6edd399640 1 -- 172.21.15.17:0/2082077991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4003520 con 0x7f6ec4003970 2023-08-09T12:53:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.674+0000 7f6edd399640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ec4003d90 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40093c0 tx=0x7f6ec40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7394a5a87d5da1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.674+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4030ac0 con 0x7f6ec4003970 2023-08-09T12:53:52.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.674+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed4030c20 con 0x7f6ec4003970 2023-08-09T12:53:52.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.674+0000 7f6ecffff640 1 -- 172.21.15.17:0/2082077991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4038440 con 0x7f6ec4003970 2023-08-09T12:53:52.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.675+0000 7f6ede39b640 1 -- 172.21.15.17:0/2082077991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 msgr2=0x7f6ec4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.675+0000 7f6ede39b640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ec4003d90 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40093c0 tx=0x7f6ec40057f0 comp rx=0 tx=0).stop 2023-08-09T12:53:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.675+0000 7f6ede39b640 1 -- 172.21.15.17:0/2082077991 shutdown_connections 2023-08-09T12:53:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.675+0000 7f6ede39b640 1 --2- 172.21.15.17:0/2082077991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ec4003d90 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.675+0000 7f6ede39b640 1 -- 172.21.15.17:0/2082077991 >> 172.21.15.17:0/2082077991 conn(0x7f6ed80b1d50 msgr2=0x7f6ed806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:52.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.675+0000 7f6ede39b640 1 -- 172.21.15.17:0/2082077991 shutdown_connections 2023-08-09T12:53:52.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.675+0000 7f6ede39b640 1 -- 172.21.15.17:0/2082077991 wait complete. 2023-08-09T12:53:52.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.677+0000 7f6ede39b640 1 Processor -- start 2023-08-09T12:53:52.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.677+0000 7f6ede39b640 1 -- start start 2023-08-09T12:53:52.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.678+0000 7f6ede39b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ed8150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:52.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.678+0000 7f6ede39b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ed814b6a0 0x7f6ed814aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:52.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.678+0000 7f6ede39b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ed80cce90 0x7f6ed80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:52.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.678+0000 7f6ede39b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80cd850 con 0x7f6ec4003970 2023-08-09T12:53:52.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.678+0000 7f6ede39b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80c8f50 con 0x7f6ed80cce90 2023-08-09T12:53:52.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.678+0000 7f6ede39b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed81513d0 con 0x7f6ed814b6a0 2023-08-09T12:53:52.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ed8150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:52.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ed8150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58190/0 (socket says 172.21.15.17:58190) 2023-08-09T12:53:52.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 -- 172.21.15.17:0/3744025260 learned_addr learned my addr 172.21.15.17:0/3744025260 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:52.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edcb98640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ed814b6a0 0x7f6ed814aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:52.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 -- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ed814b6a0 msgr2=0x7f6ed814aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:52.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6eddb9a640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ed80cce90 0x7f6ed80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ed814b6a0 0x7f6ed814aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 -- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ed80cce90 msgr2=0x7f6ed80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ed80cce90 0x7f6ed80cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 -- 172.21.15.17:0/3744025260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed81516b0 con 0x7f6ec4003970 2023-08-09T12:53:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edcb98640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ed814b6a0 0x7f6ed814aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.679+0000 7f6edd399640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ed8150d80 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009bb0 tx=0x7f6ed4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:52.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.680+0000 7f6ecdffb640 1 -- 172.21.15.17:0/3744025260 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4003a20 con 0x7f6ec4003970 2023-08-09T12:53:52.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.680+0000 7f6ecdffb640 1 -- 172.21.15.17:0/3744025260 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed4003b80 con 0x7f6ec4003970 2023-08-09T12:53:52.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.680+0000 7f6ecdffb640 1 -- 172.21.15.17:0/3744025260 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4044450 con 0x7f6ec4003970 2023-08-09T12:53:52.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.680+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed8151990 con 0x7f6ec4003970 2023-08-09T12:53:52.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.680+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed814bdb0 con 0x7f6ec4003970 2023-08-09T12:53:52.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.681+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed80c8d20 con 0x7f6ec4003970 2023-08-09T12:53:52.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.682+0000 7f6ecdffb640 1 -- 172.21.15.17:0/3744025260 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ed40445b0 con 0x7f6ec4003970 2023-08-09T12:53:52.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.683+0000 7f6ecdffb640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ebc06a050 0x7f6ebc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:52.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.683+0000 7f6ecdffb640 1 -- 172.21.15.17:0/3744025260 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ed40aee00 con 0x7f6ec4003970 2023-08-09T12:53:52.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.683+0000 7f6ecdffb640 1 -- 172.21.15.17:0/3744025260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7f6ebc0721a0 con 0x7f6ec4003970 2023-08-09T12:53:52.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.684+0000 7f6edcb98640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ebc06a050 0x7f6ebc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:52.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.685+0000 7f6edcb98640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ebc06a050 0x7f6ebc06c510 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8001eb0 tx=0x7f6ec8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:52.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.688+0000 7f6ecdffb640 1 -- 172.21.15.17:0/3744025260 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f6ed403d060 con 0x7f6ec4003970 2023-08-09T12:53:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.883+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6ed8151bb0 con 0x7f6ec4003970 2023-08-09T12:53:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.887+0000 7f6ecdffb640 1 -- 172.21.15.17:0/3744025260 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+36944 (secure 0 0 0) 0x7f6ed4048020 con 0x7f6ec4003970 2023-08-09T12:53:52.891 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:52.892 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 193, 2023-08-09T12:53:52.892 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:53:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:53:43.975129+0000", 2023-08-09T12:53:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:53:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:53:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:53:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:53:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:53:52.894 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:53:52.894 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:53:52.894 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:53:52.894 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:53:52.894 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:52.894 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:53:52.894 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:53:52.894 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:53:52.895 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:53:52.895 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:53:52.895 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 24, 2023-08-09T12:53:52.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:53:52.895 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:53:52.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:53:52.895 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:53:52.895 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:53:52.896 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:53:52.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.896 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:53:52.896 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:53:52.896 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:53:52.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:52.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:52.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:52.897 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:52.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:52.897 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:52.897 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:52.897 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:52.897 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:53:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:53:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:53:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:53:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:53:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:52.901 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:52.901 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:52.901 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:52.901 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:52.901 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:52.901 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:52.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:52.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:52.902 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:52.902 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:52.902 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:52.902 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:52.902 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:52.902 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.904 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:52.904 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:52.904 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:52.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:52.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:52.904 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:52.904 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:52.905 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:52.905 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:52.905 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:52.905 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:52.905 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:52.905 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:53:52.905 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:53:52.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.906 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:52.906 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:53:52.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.906 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:52.906 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:53:52.906 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:53:52.906 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:53:52.907 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:52.907 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:52.907 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:52.907 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:52.907 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:52.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.908 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:53:52.908 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:53:52.908 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:53:52.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:52.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:52.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:52.909 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:52.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:52.909 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:52.909 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:52.909 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:52.909 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:52.909 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:52.910 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:52.910 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:52.910 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:53:52.910 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:53:52.910 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:53:52.910 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:53:52.911 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:53:52.911 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:52.911 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:52.911 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:52.911 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:52.911 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:52.911 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:52.913 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:52.916 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:52.916 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:52.916 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:52.917 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:52.917 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:52.917 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:52.917 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:52.917 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:52.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:52.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:52.918 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:52.918 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:52.918 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:52.918 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:52.918 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:52.919 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:52.919 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:52.919 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:52.919 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:52.919 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:52.919 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:52.919 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:52.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:52.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.920 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:52.920 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:52.920 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:52.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:52.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:52.921 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:52.921 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:52.921 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:52.921 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:52.921 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:52.921 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:52.922 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:53:52.922 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:52.922 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:53:52.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.922 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:52.922 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:53:52.922 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:53:52.923 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:53:52.923 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:53:52.923 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:53:52.923 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:52.924 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:52.924 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:52.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.924 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 23, 2023-08-09T12:53:52.925 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:53:52.925 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.326271+0000", 2023-08-09T12:53:52.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:52.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:52.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:52.925 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:52.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:52.926 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:52.926 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:52.926 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:52.926 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:52.926 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:52.926 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:52.927 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:52.927 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:53:52.927 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:53:52.927 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:53:52.927 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:53:52.927 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:53:52.927 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:52.928 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:52.928 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:52.928 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:52.928 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:52.928 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:52.928 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:52.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.929 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "190", 2023-08-09T12:53:52.929 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:52.929 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:52.929 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:52.929 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:52.929 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:52.930 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:52.930 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:52.930 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:52.930 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:52.930 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:52.930 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:52.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:52.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:52.931 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:52.931 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:52.931 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:52.931 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:52.931 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:52.932 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:52.932 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:52.932 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:52.932 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:52.932 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:52.932 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:52.932 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:52.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:52.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.933 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:52.933 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:52.934 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:52.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:52.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:52.934 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:52.934 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:52.934 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:52.935 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:52.935 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:52.935 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:52.935 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:52.935 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:53:52.935 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:53:52.935 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:53:52.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.936 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:52.936 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:52.936 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:53:52.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.936 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:52.937 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2023-08-09T12:53:52.937 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2023-08-09T12:53:52.937 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:52.937 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:52.937 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:52.937 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:52.938 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:52.938 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:52.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.938 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 24, 2023-08-09T12:53:52.938 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:53:52.939 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.942904+0000", 2023-08-09T12:53:52.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1027, 2023-08-09T12:53:52.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool,full,full_quota", 2023-08-09T12:53:52.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:52.939 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:52.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:52.940 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:52.940 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:52.940 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:52.940 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:52.940 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:52.940 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:52.940 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:52.941 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:53:52.941 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:53:52.941 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:53:52.941 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:53:52.941 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:53:52.941 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:52.941 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "193", 2023-08-09T12:53:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:52.943 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:52.943 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:52.943 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:52.943 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:52.943 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:52.944 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:52.944 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:52.944 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:52.944 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:53:52.944 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:52.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:52.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:52.945 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:52.945 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:52.945 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:52.945 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:52.945 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:52.946 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:52.946 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:52.946 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:52.946 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:52.946 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:52.946 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:52.946 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:52.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:52.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.947 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:52.947 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:52.947 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:52.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:52.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:52.948 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:52.948 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:52.948 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:52.948 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:52.948 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:52.948 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:53:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:53:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:52.949 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:53:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:52.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:53:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:52.952 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:52.953 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:53:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.955 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:53:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:53:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.957 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:53:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:53:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.968 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:53:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:53:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:53:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:53:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:53:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:53:52.974 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:52.976 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:52.977 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:53:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:53:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:52.979 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:53:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:53:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:52.981 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:53:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:53:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:52.983 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:53:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:53:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.985 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:53:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:53:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:53:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:53:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:52.986 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:52.987 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:52.988 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:53:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:53:52.990 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:53:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:53:52.992 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.993 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:53:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:53:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:53:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:53:52.997 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:53:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:53:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:53:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:53:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:52.999 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:53.000 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:53:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:53:53.002 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:53:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:53:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:53:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:53:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.007 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:53:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:53:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:53:53.009 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:53:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:53:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:53:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:53.011 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:53.012 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:53:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:53:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.015 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:53:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.017 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:53:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:53:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:53:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.020 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:53:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:53:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.022 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:53:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:53:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:53:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:53:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:53.023 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:53.024 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:53.025 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:53:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:53:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:53:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:53.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:53:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:53:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:53.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:53:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:53:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:53.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:53:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:53:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:53:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:53:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:53:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:53.035 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:53.036 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:53.037 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:53:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:53:53.039 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:53:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:53:53.041 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.042 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:53:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:53:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:53.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:53:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:53.045 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:53:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:53:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:53:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:53:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:53:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.047 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:53:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:53:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:53.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:53.050 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:53.051 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:53:53.051 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:53.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.051 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:53.051 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:53.051 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:53.051 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:53:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:53.052 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:53:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:53:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:53:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:53:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:53:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:53:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:53:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:53:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:53:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:53:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:53:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:53:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:53:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:53:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:53:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:53:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:53:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:53:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:53:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:53:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:53:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:53:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:53:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:53:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:53:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:53:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:53:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:53:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:53:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:53:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:53.063 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:53.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ebc06a050 msgr2=0x7f6ebc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:53.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ebc06a050 0x7f6ebc06c510 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8001eb0 tx=0x7f6ec8009040 comp rx=0 tx=0).stop 2023-08-09T12:53:53.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 msgr2=0x7f6ed8150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:53.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ed8150d80 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009bb0 tx=0x7f6ed4004730 comp rx=0 tx=0).stop 2023-08-09T12:53:53.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 shutdown_connections 2023-08-09T12:53:53.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f6ebc06a050 0x7f6ebc06c510 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:53.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ed80cce90 0x7f6ed80cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:53.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ed814b6a0 0x7f6ed814aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:53.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 --2- 172.21.15.17:0/3744025260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ec4003970 0x7f6ed8150d80 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:53.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 >> 172.21.15.17:0/3744025260 conn(0x7f6ed80b1d50 msgr2=0x7f6ed806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:53.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.889+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 shutdown_connections 2023-08-09T12:53:53.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:52.890+0000 7f6ede39b640 1 -- 172.21.15.17:0/3744025260 wait complete. 2023-08-09T12:53:53.066 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-08-09T12:53:58.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:53:58.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.305+0000 7f2c31fd6640 1 Processor -- start 2023-08-09T12:53:58.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.305+0000 7f2c31fd6640 1 -- start start 2023-08-09T12:53:58.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.306+0000 7f2c31fd6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2c2c0adc40 0x7f2c2c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.306+0000 7f2c31fd6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c2c0cc630 0x7f2c2c0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.306+0000 7f2c31fd6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c0b2250 con 0x7f2c2c0b3b40 2023-08-09T12:53:58.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.306+0000 7f2c31fd6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c0ae020 con 0x7f2c2c0adc40 2023-08-09T12:53:58.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.306+0000 7f2c31fd6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c0b2530 con 0x7f2c2c0cc630 2023-08-09T12:53:58.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.306+0000 7f2c2b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2c2c0adc40 0x7f2c2c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.306+0000 7f2c2b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2c2c0adc40 0x7f2c2c06c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59208/0 (socket says 172.21.15.17:59208) 2023-08-09T12:53:58.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.306+0000 7f2c2b7fe640 1 -- 172.21.15.17:0/2785491441 learned_addr learned my addr 172.21.15.17:0/2785491441 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:58.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.307+0000 7f2c2bfff640 1 --2- 172.21.15.17:0/2785491441 >> v2:172.21.15.142:3300/0 conn(0x7f2c2c0cc630 0x7f2c2c0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.307+0000 7f2c2b7fe640 1 -- 172.21.15.17:0/2785491441 >> v2:172.21.15.142:3300/0 conn(0x7f2c2c0cc630 msgr2=0x7f2c2c0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.307+0000 7f2c2b7fe640 1 --2- 172.21.15.17:0/2785491441 >> v2:172.21.15.142:3300/0 conn(0x7f2c2c0cc630 0x7f2c2c0ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.307+0000 7f2c2b7fe640 1 -- 172.21.15.17:0/2785491441 >> v1:172.21.15.142:6789/0 conn(0x7f2c2c0b3b40 legacy=0x7f2c2c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.307+0000 7f2c2b7fe640 1 -- 172.21.15.17:0/2785491441 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c06fe80 con 0x7f2c2c0adc40 2023-08-09T12:53:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.307+0000 7f2c2bfff640 1 --2- 172.21.15.17:0/2785491441 >> v2:172.21.15.142:3300/0 conn(0x7f2c2c0cc630 0x7f2c2c0ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.308+0000 7f2c2b7fe640 1 --2- 172.21.15.17:0/2785491441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0adc40 0x7f2c2c06c280 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0caff0 tx=0x7f2c1c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905efa8ed5adf9f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.308+0000 7f2c2a7fc640 1 -- 172.21.15.17:0/2785491441 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0317e0 con 0x7f2c2c0adc40 2023-08-09T12:53:58.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.308+0000 7f2c2a7fc640 1 -- 172.21.15.17:0/2785491441 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c031940 con 0x7f2c2c0adc40 2023-08-09T12:53:58.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c2a7fc640 1 -- 172.21.15.17:0/2785491441 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c031cd0 con 0x7f2c2c0adc40 2023-08-09T12:53:58.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c31fd6640 1 -- 172.21.15.17:0/2785491441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0adc40 msgr2=0x7f2c2c06c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/2785491441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0adc40 0x7f2c2c06c280 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0caff0 tx=0x7f2c1c02b880 comp rx=0 tx=0).stop 2023-08-09T12:53:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c31fd6640 1 -- 172.21.15.17:0/2785491441 shutdown_connections 2023-08-09T12:53:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/2785491441 >> v2:172.21.15.142:3300/0 conn(0x7f2c2c0cc630 0x7f2c2c0ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/2785491441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0adc40 0x7f2c2c06c280 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c31fd6640 1 -- 172.21.15.17:0/2785491441 >> 172.21.15.17:0/2785491441 conn(0x7f2c2c0cb1b0 msgr2=0x7f2c2c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c31fd6640 1 -- 172.21.15.17:0/2785491441 shutdown_connections 2023-08-09T12:53:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.309+0000 7f2c31fd6640 1 -- 172.21.15.17:0/2785491441 wait complete. 2023-08-09T12:53:58.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.311+0000 7f2c31fd6640 1 Processor -- start 2023-08-09T12:53:58.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.311+0000 7f2c31fd6640 1 -- start start 2023-08-09T12:53:58.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.312+0000 7f2c31fd6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c2c0adc40 0x7f2c2c1f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.312+0000 7f2c31fd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c2c0b3b40 0x7f2c2c159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.312+0000 7f2c31fd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0cc630 0x7f2c2c0af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.312+0000 7f2c31fd6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c157cc0 con 0x7f2c2c0cc630 2023-08-09T12:53:58.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.312+0000 7f2c31fd6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c157fa0 con 0x7f2c2c0adc40 2023-08-09T12:53:58.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.312+0000 7f2c31fd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c158280 con 0x7f2c2c0b3b40 2023-08-09T12:53:58.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0cc630 0x7f2c2c0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0cc630 0x7f2c2c0af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59224/0 (socket says 172.21.15.17:59224) 2023-08-09T12:53:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2bfff640 1 -- 172.21.15.17:0/1510689923 learned_addr learned my addr 172.21.15.17:0/1510689923 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2b7fe640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c2c0adc40 0x7f2c2c1f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2affd640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c2c0b3b40 0x7f2c2c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2bfff640 1 -- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c2c0b3b40 msgr2=0x7f2c2c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2bfff640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c2c0b3b40 0x7f2c2c159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2bfff640 1 -- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c2c0adc40 msgr2=0x7f2c2c1f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2bfff640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c2c0adc40 0x7f2c2c1f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2bfff640 1 -- 172.21.15.17:0/1510689923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0094d0 con 0x7f2c2c0cc630 2023-08-09T12:53:58.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.313+0000 7f2c2affd640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c2c0b3b40 0x7f2c2c159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:58.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.314+0000 7f2c2bfff640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0cc630 0x7f2c2c0af520 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400cd50 tx=0x7f2c2400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:58.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.314+0000 7f2c13fff640 1 -- 172.21.15.17:0/1510689923 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400f680 con 0x7f2c2c0cc630 2023-08-09T12:53:58.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.314+0000 7f2c13fff640 1 -- 172.21.15.17:0/1510689923 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2400f800 con 0x7f2c2c0cc630 2023-08-09T12:53:58.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.314+0000 7f2c13fff640 1 -- 172.21.15.17:0/1510689923 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400fbb0 con 0x7f2c2c0cc630 2023-08-09T12:53:58.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.314+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c158560 con 0x7f2c2c0cc630 2023-08-09T12:53:58.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.314+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c1f5e50 con 0x7f2c2c0cc630 2023-08-09T12:53:58.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.316+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c158a80 con 0x7f2c2c0cc630 2023-08-09T12:53:58.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.316+0000 7f2c13fff640 1 -- 172.21.15.17:0/1510689923 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2c2400b040 con 0x7f2c2c0cc630 2023-08-09T12:53:58.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.317+0000 7f2c13fff640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2c1806a050 0x7f2c1806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.317+0000 7f2c13fff640 1 -- 172.21.15.17:0/1510689923 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c24088fe0 con 0x7f2c2c0cc630 2023-08-09T12:53:58.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.318+0000 7f2c2b7fe640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2c1806a050 0x7f2c1806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.319+0000 7f2c2b7fe640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2c1806a050 0x7f2c1806c510 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c036000 tx=0x7f2c1c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:58.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.322+0000 7f2c13fff640 1 -- 172.21.15.17:0/1510689923 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2c2c158a80 con 0x7f2c2c0cc630 2023-08-09T12:53:58.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.518+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2c2c158a80 con 0x7f2c2c0cc630 2023-08-09T12:53:58.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.520+0000 7f2c13fff640 1 -- 172.21.15.17:0/1510689923 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v194) v1 ==== 81+0+36925 (secure 0 0 0) 0x7f2c2c158a80 con 0x7f2c2c0cc630 2023-08-09T12:53:58.525 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:58.525 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:58.526 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 194, 2023-08-09T12:53:58.526 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:58.526 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:53:58.526 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:53:53.980440+0000", 2023-08-09T12:53:58.527 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:53:58.527 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:53:58.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:53:58.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:53:58.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:53:58.528 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:53:58.528 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:53:58.528 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:53:58.528 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:53:58.528 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:58.528 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:53:58.528 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:53:58.529 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:53:58.529 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:53:58.529 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:53:58.529 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 24, 2023-08-09T12:53:58.529 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:53:58.529 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:53:58.529 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:53:58.529 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:53:58.530 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:53:58.530 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:53:58.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.530 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:53:58.530 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:53:58.530 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:53:58.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:58.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:58.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:58.531 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:58.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:58.531 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:58.532 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:58.532 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:58.532 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:58.533 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:58.533 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:58.533 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:58.534 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:53:58.534 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:53:58.534 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:53:58.535 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:53:58.535 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:53:58.536 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:58.537 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:58.537 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:58.537 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:58.537 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:58.538 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:58.538 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:58.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.538 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:58.538 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:58.539 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:58.539 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:58.539 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:58.539 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:58.539 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:58.539 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:58.539 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:58.540 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:58.540 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:58.540 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:58.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:58.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:58.540 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:58.540 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:58.541 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:58.541 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:58.541 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:58.541 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:58.541 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:58.541 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:58.541 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:58.542 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:58.542 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:58.542 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:58.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:58.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.542 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:58.542 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:58.542 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:58.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:58.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:58.543 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:58.543 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:58.543 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:58.544 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:58.544 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:58.544 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:58.544 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:58.544 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:53:58.544 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:53:58.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:53:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:53:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:53:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:53:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:58.546 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:58.546 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:58.546 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:58.546 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:58.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.547 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:53:58.547 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:53:58.547 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:53:58.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:58.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:58.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:58.547 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:58.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:58.548 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:58.548 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:58.548 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:58.548 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:58.548 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:58.548 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:58.548 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:58.549 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:53:58.549 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:53:58.549 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:53:58.549 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:53:58.549 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:53:58.549 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:58.549 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:58.549 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:58.550 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:58.550 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:58.550 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:58.550 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:58.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.550 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:58.550 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:58.551 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:58.551 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:58.551 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:58.551 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:58.551 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:58.551 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:58.551 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:58.551 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:58.552 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:58.552 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:58.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:58.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:58.552 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:58.552 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:58.552 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:58.553 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:58.553 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:58.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:58.555 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:53:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:53:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:53:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:53:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:53:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:53:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:53:58.557 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 23, 2023-08-09T12:53:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:53:58.558 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.326271+0000", 2023-08-09T12:53:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:58.559 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:53:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:53:58.560 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:53:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:53:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:53:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:58.561 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "190", 2023-08-09T12:53:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:58.562 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:58.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:58.564 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:58.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:53:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:53:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:53:58.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:53:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.568 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2023-08-09T12:53:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2023-08-09T12:53:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:58.569 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 24, 2023-08-09T12:53:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:53:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.942904+0000", 2023-08-09T12:53:58.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:58.571 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:53:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:53:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:53:58.572 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:53:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:53:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:58.573 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "194", 2023-08-09T12:53:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:58.574 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:53:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:58.575 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:58.576 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:58.577 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:58.578 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:53:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:53:58.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:53:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:58.580 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:53:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:53:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:53:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:53:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:58.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:53:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:58.582 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:58.583 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:53:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:58.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:53:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.585 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:53:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:53:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:53:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:53:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:53:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:53:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:58.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:53:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:53:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:53:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:53:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:58.591 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:58.592 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:58.593 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:53:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:58.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:53:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:53:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:53:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:58.597 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:53:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.598 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:53:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:53:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:53:58.600 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:53:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:53:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:53:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:53:58.601 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:58.602 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:58.603 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:53:58.604 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:53:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.605 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:53:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:58.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:53:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.607 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:53:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:53:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:58.609 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:53:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.610 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:53:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:53:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:53:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:53:58.611 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:53:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:58.612 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:58.613 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:53:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:53:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:53:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:58.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:53:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.617 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:53:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:53:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:58.619 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:53:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.620 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:53:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:53:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:53:58.621 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:53:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:53:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.622 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:58.623 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:53:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:53:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:58.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:53:58.626 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:53:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:53:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:53:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.629 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:53:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:53:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:53:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:53:58.631 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:53:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:53:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.632 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:58.633 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:53:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:53:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:53:58.636 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:53:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:53:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:53:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.639 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:53:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:53:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:53:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:53:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:53:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:53:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.642 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:58.643 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:53:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:53:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:58.645 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:53:58.646 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:53:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:53:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:58.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:53:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.649 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:53:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:53:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:53:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:53:58.651 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:53:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:53:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:58.653 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:53:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:53:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:53:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:53:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:53:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:53:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.659 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:53:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:53:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:53:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:53:58.661 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:53:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:53:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:58.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:53:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:58.663 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:53:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:58.664 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:53:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:53:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:58.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:58.667 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:53:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:53:58.669 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:58.670 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:53:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:53:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:58.673 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:53:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:53:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:53:58.674 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:53:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:53:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:53:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:53:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:53:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:53:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:53:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:53:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:53:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:53:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:53:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:53:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:53:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:53:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:53:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:53:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:53:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:53:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:53:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:53:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:53:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:53:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:53:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:58.678 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:58.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2c1806a050 msgr2=0x7f2c1806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2c1806a050 0x7f2c1806c510 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c036000 tx=0x7f2c1c03d040 comp rx=0 tx=0).stop 2023-08-09T12:53:58.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0cc630 msgr2=0x7f2c2c0af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0cc630 0x7f2c2c0af520 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400cd50 tx=0x7f2c2400a650 comp rx=0 tx=0).stop 2023-08-09T12:53:58.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 shutdown_connections 2023-08-09T12:53:58.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2c1806a050 0x7f2c1806c510 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c2c0cc630 0x7f2c2c0af520 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c2c0b3b40 0x7f2c2c159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 --2- 172.21.15.17:0/1510689923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c2c0adc40 0x7f2c2c1f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 >> 172.21.15.17:0/1510689923 conn(0x7f2c2c0cb1b0 msgr2=0x7f2c2c0cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:58.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.523+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 shutdown_connections 2023-08-09T12:53:58.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.524+0000 7f2c31fd6640 1 -- 172.21.15.17:0/1510689923 wait complete. 2023-08-09T12:53:58.681 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-08-09T12:53:58.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-08-09T12:53:58.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.916+0000 7fd688af9640 1 Processor -- start 2023-08-09T12:53:58.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.916+0000 7fd688af9640 1 -- start start 2023-08-09T12:53:58.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.917+0000 7fd688af9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd6841587e0 0x7fd684070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.917+0000 7fd688af9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6840b0b10 0x7fd68415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.917+0000 7fd688af9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6840715c0 con 0x7fd68415bce0 2023-08-09T12:53:58.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.917+0000 7fd688af9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6840718a0 con 0x7fd6840b0b10 2023-08-09T12:53:58.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.917+0000 7fd688af9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd684071b80 con 0x7fd6841587e0 2023-08-09T12:53:58.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd683fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd68415bce0 0x7fd6840cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36252/0 (socket says 172.21.15.17:36252) 2023-08-09T12:53:58.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd683fff640 1 -- 172.21.15.17:0/4149554685 learned_addr learned my addr 172.21.15.17:0/4149554685 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:58.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd682ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6840b0b10 0x7fd68415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd6837fe640 1 --2- 172.21.15.17:0/4149554685 >> v2:172.21.15.142:3300/0 conn(0x7fd6841587e0 0x7fd684070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd6827fc640 1 -- 172.21.15.17:0/4149554685 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466060462 0 0) 0x7fd6840715c0 con 0x7fd68415bce0 2023-08-09T12:53:58.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd6827fc640 1 -- 172.21.15.17:0/4149554685 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd66c003520 con 0x7fd68415bce0 2023-08-09T12:53:58.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd682ffd640 1 -- 172.21.15.17:0/4149554685 >> v2:172.21.15.142:3300/0 conn(0x7fd6841587e0 msgr2=0x7fd684070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:53:58.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd682ffd640 1 --2- 172.21.15.17:0/4149554685 >> v2:172.21.15.142:3300/0 conn(0x7fd6841587e0 0x7fd684070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd682ffd640 1 -- 172.21.15.17:0/4149554685 >> v1:172.21.15.17:6789/0 conn(0x7fd68415bce0 legacy=0x7fd6840cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.918+0000 7fd682ffd640 1 -- 172.21.15.17:0/4149554685 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68415b280 con 0x7fd6840b0b10 2023-08-09T12:53:58.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.920+0000 7fd682ffd640 1 --2- 172.21.15.17:0/4149554685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd68415b7a0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fd68406cc50 tx=0x7fd67802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd9aa62d91ee9d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:58.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.920+0000 7fd6827fc640 1 -- 172.21.15.17:0/4149554685 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678031830 con 0x7fd6840b0b10 2023-08-09T12:53:58.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.920+0000 7fd6827fc640 1 -- 172.21.15.17:0/4149554685 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678031990 con 0x7fd6840b0b10 2023-08-09T12:53:58.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.920+0000 7fd6827fc640 1 -- 172.21.15.17:0/4149554685 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678031d00 con 0x7fd6840b0b10 2023-08-09T12:53:58.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.920+0000 7fd688af9640 1 -- 172.21.15.17:0/4149554685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 msgr2=0x7fd68415b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.920+0000 7fd688af9640 1 --2- 172.21.15.17:0/4149554685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd68415b7a0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fd68406cc50 tx=0x7fd67802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.921+0000 7fd688af9640 1 -- 172.21.15.17:0/4149554685 shutdown_connections 2023-08-09T12:53:58.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.921+0000 7fd688af9640 1 --2- 172.21.15.17:0/4149554685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd68415b7a0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.921+0000 7fd688af9640 1 --2- 172.21.15.17:0/4149554685 >> v2:172.21.15.142:3300/0 conn(0x7fd6841587e0 0x7fd684070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.921+0000 7fd688af9640 1 -- 172.21.15.17:0/4149554685 >> 172.21.15.17:0/4149554685 conn(0x7fd6840b1d50 msgr2=0x7fd68406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:58.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.921+0000 7fd688af9640 1 -- 172.21.15.17:0/4149554685 shutdown_connections 2023-08-09T12:53:58.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.921+0000 7fd688af9640 1 -- 172.21.15.17:0/4149554685 wait complete. 2023-08-09T12:53:58.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.922+0000 7fd688af9640 1 Processor -- start 2023-08-09T12:53:58.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.923+0000 7fd688af9640 1 -- start start 2023-08-09T12:53:58.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.923+0000 7fd688af9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd684155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.923+0000 7fd688af9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6841587e0 0x7fd6840afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd688af9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd68415d120 0x7fd68415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd688af9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd684156240 con 0x7fd6840b0b10 2023-08-09T12:53:58.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd688af9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68415daf0 con 0x7fd6841587e0 2023-08-09T12:53:58.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd688af9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840c7c50 con 0x7fd68415d120 2023-08-09T12:53:58.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd6837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd684155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd6837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd684155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59242/0 (socket says 172.21.15.17:59242) 2023-08-09T12:53:58.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd6837fe640 1 -- 172.21.15.17:0/3911793166 learned_addr learned my addr 172.21.15.17:0/3911793166 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:58.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd682ffd640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6841587e0 0x7fd6840afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.924+0000 7fd683fff640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd68415d120 0x7fd68415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd6837fe640 1 -- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd68415d120 msgr2=0x7fd68415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd6837fe640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd68415d120 0x7fd68415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd6837fe640 1 -- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6841587e0 msgr2=0x7fd6840afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:58.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd6837fe640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6841587e0 0x7fd6840afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:58.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd6837fe640 1 -- 172.21.15.17:0/3911793166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678009400 con 0x7fd6840b0b10 2023-08-09T12:53:58.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd683fff640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd68415d120 0x7fd68415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:58.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd6837fe640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd684155d00 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fd67400d800 tx=0x7fd67400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:58.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd66bfff640 1 -- 172.21.15.17:0/3911793166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400b660 con 0x7fd6840b0b10 2023-08-09T12:53:58.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd66bfff640 1 -- 172.21.15.17:0/3911793166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400b7c0 con 0x7fd6840b0b10 2023-08-09T12:53:58.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd66bfff640 1 -- 172.21.15.17:0/3911793166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400bb50 con 0x7fd6840b0b10 2023-08-09T12:53:58.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.925+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6840c7f30 con 0x7fd6840b0b10 2023-08-09T12:53:58.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.926+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6840c84f0 con 0x7fd6840b0b10 2023-08-09T12:53:58.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.927+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68406fa10 con 0x7fd6840b0b10 2023-08-09T12:53:58.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.928+0000 7fd66bfff640 1 -- 172.21.15.17:0/3911793166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd67400bcb0 con 0x7fd6840b0b10 2023-08-09T12:53:58.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.928+0000 7fd66bfff640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd67006a050 0x7fd67006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:58.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.929+0000 7fd66bfff640 1 -- 172.21.15.17:0/3911793166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd674088b30 con 0x7fd6840b0b10 2023-08-09T12:53:58.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.929+0000 7fd682ffd640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd67006a050 0x7fd67006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:58.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.930+0000 7fd682ffd640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd67006a050 0x7fd67006c510 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd678036000 tx=0x7fd67803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:58.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:58.933+0000 7fd66bfff640 1 -- 172.21.15.17:0/3911793166 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd68406fa10 con 0x7fd6840b0b10 2023-08-09T12:53:59.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.132+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd68406fa10 con 0x7fd6840b0b10 2023-08-09T12:53:59.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.136+0000 7fd66bfff640 1 -- 172.21.15.17:0/3911793166 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v194) v1 ==== 81+0+36925 (secure 0 0 0) 0x7fd68406fa10 con 0x7fd6840b0b10 2023-08-09T12:53:59.140 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:59.141 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:53:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 194, 2023-08-09T12:53:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", 2023-08-09T12:53:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-08-09T12:39:03.674610+0000", 2023-08-09T12:53:59.141 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-08-09T12:53:53.980440+0000", 2023-08-09T12:53:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-08-09T12:39:11.099343+0000", 2023-08-09T12:53:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-08-09T12:39:08.087505+0000", 2023-08-09T12:53:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-09T12:53:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-08-09T12:53:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-08-09T12:53:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-08-09T12:53:59.142 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-08-09T12:53:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-08-09T12:53:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-08-09T12:53:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-08-09T12:53:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.69999998807907104, 2023-08-09T12:53:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-08-09T12:53:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.60000002384185791, 2023-08-09T12:53:59.143 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-08-09T12:53:59.144 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 24, 2023-08-09T12:53:59.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 8, 2023-08-09T12:53:59.144 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-08-09T12:53:59.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-08-09T12:53:59.144 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-08-09T12:53:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-08-09T12:53:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-08-09T12:53:59.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-08-09T12:53:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-08-09T12:53:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:12.706671+0000", 2023-08-09T12:53:59.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:59.147 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:59.148 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-08-09T12:53:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-08-09T12:53:59.150 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-08-09T12:53:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-08-09T12:53:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-08-09T12:53:59.151 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:59.152 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.153 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:59.155 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:59.156 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:59.157 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:59.158 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:59.161 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:59.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:59.163 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:59.164 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:59.165 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-08-09T12:53:59.165 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-08-09T12:53:59.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-08-09T12:53:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.166 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 8, 2023-08-09T12:53:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 8, 2023-08-09T12:53:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.25, 2023-08-09T12:53:59.167 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:59.168 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-08-09T12:53:59.169 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-08-09T12:53:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:39:17.365312+0000", 2023-08-09T12:53:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:59.170 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-08-09T12:53:59.171 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-08-09T12:53:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-08-09T12:53:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-08-09T12:53:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-08-09T12:53:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:59.172 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.173 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "118", 2023-08-09T12:53:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:59.174 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:59.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:59.176 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.177 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:59.178 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-08-09T12:53:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-08-09T12:53:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:59.179 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.9900000095367432, 2023-08-09T12:53:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.9900000095367432, 2023-08-09T12:53:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.87999999523162842, 2023-08-09T12:53:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.75, 2023-08-09T12:53:59.180 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.75, 2023-08-09T12:53:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.181 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 23, 2023-08-09T12:53:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-08-09T12:53:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.326271+0000", 2023-08-09T12:53:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:59.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:59.183 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:59.184 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-08-09T12:53:59.185 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-08-09T12:53:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-08-09T12:53:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-08-09T12:53:59.186 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-08-09T12:53:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:59.187 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:59.188 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "190", 2023-08-09T12:53:59.189 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:59.190 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-08-09T12:53:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:59.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:59.193 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:59.194 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:59.195 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:59.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:59.197 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:59.198 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:59.199 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:59.200 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:59.202 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-08-09T12:53:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-08-09T12:53:59.203 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-08-09T12:53:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-08-09T12:53:59.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2, 2023-08-09T12:53:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2, 2023-08-09T12:53:59.206 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-08-09T12:53:59.207 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-08-09T12:53:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 24, 2023-08-09T12:53:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-08-09T12:53:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-08-09T12:53:18.942904+0000", 2023-08-09T12:53:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-08-09T12:53:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-08-09T12:53:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-08-09T12:53:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-08-09T12:53:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-08-09T12:53:59.210 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-08-09T12:53:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-08-09T12:53:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-08-09T12:53:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-08-09T12:53:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-09T12:53:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-08-09T12:53:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-08-09T12:53:59.211 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-08-09T12:53:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-08-09T12:53:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-08-09T12:53:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-08-09T12:53:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-08-09T12:53:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-08-09T12:53:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-08-09T12:53:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-08-09T12:53:59.212 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-08-09T12:53:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-08-09T12:53:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-08-09T12:53:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-08-09T12:53:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "194", 2023-08-09T12:53:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-08-09T12:53:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-09T12:53:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-08-09T12:53:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-08-09T12:53:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-08-09T12:53:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-08-09T12:53:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-08-09T12:53:59.214 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-08-09T12:53:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-08-09T12:53:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 33554432, 2023-08-09T12:53:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-08-09T12:53:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-08-09T12:53:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-08-09T12:53:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-08-09T12:53:59.215 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-08-09T12:53:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-08-09T12:53:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-08-09T12:53:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-08-09T12:53:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-09T12:53:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-09T12:53:59.216 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-09T12:53:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-08-09T12:53:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-08-09T12:53:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-08-09T12:53:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-08-09T12:53:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-08-09T12:53:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.217 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-08-09T12:53:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-08-09T12:53:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-08-09T12:53:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-08-09T12:53:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-08-09T12:53:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-08-09T12:53:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-08-09T12:53:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-08-09T12:53:59.218 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-08-09T12:53:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-08-09T12:53:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-08-09T12:53:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-08-09T12:53:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-08-09T12:53:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-08-09T12:53:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-08-09T12:53:59.219 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-08-09T12:53:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-08-09T12:53:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.220 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-08-09T12:53:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-08-09T12:53:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-08-09T12:53:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-08-09T12:53:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-08-09T12:53:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-08-09T12:53:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-08-09T12:53:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-08-09T12:53:59.221 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-08-09T12:53:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-08-09T12:53:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:59.222 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6808", 2023-08-09T12:53:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6809", 2023-08-09T12:53:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:59.226 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6810", 2023-08-09T12:53:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.227 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6811", 2023-08-09T12:53:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:59.228 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6814", 2023-08-09T12:53:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.229 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6815", 2023-08-09T12:53:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.230 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6812", 2023-08-09T12:53:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6813", 2023-08-09T12:53:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1208264847 2023-08-09T12:53:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.232 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6809/1208264847", 2023-08-09T12:53:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6811/1208264847", 2023-08-09T12:53:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6815/1208264847", 2023-08-09T12:53:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6813/1208264847", 2023-08-09T12:53:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:59.234 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:59.235 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6816", 2023-08-09T12:53:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:59.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6817", 2023-08-09T12:53:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:59.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.238 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6818", 2023-08-09T12:53:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6819", 2023-08-09T12:53:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6822", 2023-08-09T12:53:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:59.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6823", 2023-08-09T12:53:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6820", 2023-08-09T12:53:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:59.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6821", 2023-08-09T12:53:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 160883259 2023-08-09T12:53:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.244 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6817/160883259", 2023-08-09T12:53:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6819/160883259", 2023-08-09T12:53:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6823/160883259", 2023-08-09T12:53:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6821/160883259", 2023-08-09T12:53:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:59.245 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:59.246 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:59.247 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-08-09T12:53:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.249 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-08-09T12:53:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6802", 2023-08-09T12:53:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6803", 2023-08-09T12:53:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:59.252 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6806", 2023-08-09T12:53:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.253 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6807", 2023-08-09T12:53:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6804", 2023-08-09T12:53:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6805", 2023-08-09T12:53:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1219800306 2023-08-09T12:53:59.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6801/1219800306", 2023-08-09T12:53:59.256 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6803/1219800306", 2023-08-09T12:53:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6807/1219800306", 2023-08-09T12:53:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6805/1219800306", 2023-08-09T12:53:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:59.258 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6824", 2023-08-09T12:53:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6825", 2023-08-09T12:53:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:59.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.261 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:59.261 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.262 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6826", 2023-08-09T12:53:59.262 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:59.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.262 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6827", 2023-08-09T12:53:59.263 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:59.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.263 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.263 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:59.263 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.264 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6830", 2023-08-09T12:53:59.264 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:59.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.264 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6831", 2023-08-09T12:53:59.264 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:59.265 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.265 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.265 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:59.265 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.265 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6828", 2023-08-09T12:53:59.266 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:59.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.266 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6829", 2023-08-09T12:53:59.267 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2232182345 2023-08-09T12:53:59.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.267 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.17:6825/2232182345", 2023-08-09T12:53:59.267 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.17:6827/2232182345", 2023-08-09T12:53:59.267 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.17:6831/2232182345", 2023-08-09T12:53:59.267 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.17:6829/2232182345", 2023-08-09T12:53:59.268 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:59.268 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:59.268 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:59.268 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.268 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:59.269 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:59.269 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:59.270 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:59.270 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:59.270 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:59.270 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:59.271 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:59.271 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:59.271 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:59.271 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:59.271 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:59.271 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:59.271 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.272 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6808", 2023-08-09T12:53:59.272 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:59.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.273 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6809", 2023-08-09T12:53:59.273 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:59.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.273 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:59.274 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.275 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6810", 2023-08-09T12:53:59.275 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:59.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.276 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6811", 2023-08-09T12:53:59.276 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:59.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.277 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.277 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:59.277 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.277 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6814", 2023-08-09T12:53:59.278 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:59.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.278 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6815", 2023-08-09T12:53:59.278 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:59.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.279 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.279 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:59.279 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.279 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6812", 2023-08-09T12:53:59.279 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6813", 2023-08-09T12:53:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 701351329 2023-08-09T12:53:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.281 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6809/701351329", 2023-08-09T12:53:59.281 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6811/701351329", 2023-08-09T12:53:59.281 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6815/701351329", 2023-08-09T12:53:59.281 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6813/701351329", 2023-08-09T12:53:59.281 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:59.281 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:59.281 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:59.282 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.282 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:59.282 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:59.282 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:59.282 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:59.282 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:59.283 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:59.283 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:59.283 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:59.283 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:59.283 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:59.283 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:59.283 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:59.283 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:59.284 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.284 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6800", 2023-08-09T12:53:59.284 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:59.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.285 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6801", 2023-08-09T12:53:59.285 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:59.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.285 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:59.285 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.286 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6802", 2023-08-09T12:53:59.286 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:59.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.287 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6803", 2023-08-09T12:53:59.287 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:59.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.288 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:59.288 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.288 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6806", 2023-08-09T12:53:59.288 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:59.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.289 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6807", 2023-08-09T12:53:59.289 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:59.289 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.289 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.289 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:59.290 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6804", 2023-08-09T12:53:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6805", 2023-08-09T12:53:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 445717890 2023-08-09T12:53:59.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.293 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6801/445717890", 2023-08-09T12:53:59.293 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6803/445717890", 2023-08-09T12:53:59.293 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6807/445717890", 2023-08-09T12:53:59.293 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6805/445717890", 2023-08-09T12:53:59.294 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:59.294 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:59.294 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:59.294 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.294 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:59.295 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:59.295 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:59.295 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:59.295 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:59.295 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:59.295 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:59.296 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:59.296 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:59.296 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:59.296 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:59.296 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:59.296 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:59.296 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.297 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6821", 2023-08-09T12:53:59.297 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:59.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.297 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6823", 2023-08-09T12:53:59.298 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:59.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.298 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:59.298 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.299 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6825", 2023-08-09T12:53:59.299 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:59.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.299 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6827", 2023-08-09T12:53:59.299 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:59.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.300 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:59.300 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.300 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6830", 2023-08-09T12:53:59.301 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:59.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6831", 2023-08-09T12:53:59.301 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:59.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.302 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.302 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:59.302 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.303 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6828", 2023-08-09T12:53:59.303 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:59.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.303 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6829", 2023-08-09T12:53:59.304 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1908382838 2023-08-09T12:53:59.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.304 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.304 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6823/1908382838", 2023-08-09T12:53:59.304 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6827/1908382838", 2023-08-09T12:53:59.304 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6831/1908382838", 2023-08-09T12:53:59.305 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6829/1908382838", 2023-08-09T12:53:59.305 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:59.305 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:59.305 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:59.305 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.306 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:59.306 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-08-09T12:53:59.306 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-08-09T12:53:59.306 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-08-09T12:53:59.306 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-08-09T12:53:59.307 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-08-09T12:53:59.307 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-08-09T12:53:59.307 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-08-09T12:53:59.307 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 13, 2023-08-09T12:53:59.307 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 189, 2023-08-09T12:53:59.307 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-08-09T12:53:59.308 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-08-09T12:53:59.309 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-08-09T12:53:59.309 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.309 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6816", 2023-08-09T12:53:59.309 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:59.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.310 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6817", 2023-08-09T12:53:59.310 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:59.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.310 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.311 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-08-09T12:53:59.311 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.311 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6818", 2023-08-09T12:53:59.311 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:59.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.312 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6819", 2023-08-09T12:53:59.312 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:59.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.312 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-08-09T12:53:59.313 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.313 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6824", 2023-08-09T12:53:59.313 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:59.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.315 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6826", 2023-08-09T12:53:59.315 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:59.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.315 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.315 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-08-09T12:53:59.316 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-08-09T12:53:59.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-08-09T12:53:59.316 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6820", 2023-08-09T12:53:59.316 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:59.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-08-09T12:53:59.317 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.142:6822", 2023-08-09T12:53:59.317 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3944800056 2023-08-09T12:53:59.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.317 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.317 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.142:6817/3944800056", 2023-08-09T12:53:59.318 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.142:6819/3944800056", 2023-08-09T12:53:59.318 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.142:6826/3944800056", 2023-08-09T12:53:59.318 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.142:6822/3944800056", 2023-08-09T12:53:59.318 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-08-09T12:53:59.318 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-08-09T12:53:59.318 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-08-09T12:53:59.318 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-08-09T12:53:59.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.319 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:59.319 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-08-09T12:53:59.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.319 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-08-09T12:53:59.319 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:59.319 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:59.320 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:59.320 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:59.320 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:59.320 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.366639+0000", 2023-08-09T12:53:59.320 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:59.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.321 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-08-09T12:53:59.321 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:59.321 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:59.321 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:59.321 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:59.321 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:59.321 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.370986+0000", 2023-08-09T12:53:59.321 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:59.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.322 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-08-09T12:53:59.322 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:59.322 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:59.323 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:59.323 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:59.323 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:59.323 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.383950+0000", 2023-08-09T12:53:59.323 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:59.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.324 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 3, 2023-08-09T12:53:59.324 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:59.324 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:59.324 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:59.324 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:59.324 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:59.324 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.421868+0000", 2023-08-09T12:53:59.325 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:59.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.325 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 4, 2023-08-09T12:53:59.325 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:59.325 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:59.325 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:59.325 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:59.326 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:59.326 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.407813+0000", 2023-08-09T12:53:59.326 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:59.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.326 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 5, 2023-08-09T12:53:59.326 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:59.326 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:59.327 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:59.327 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:59.327 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:59.327 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.353988+0000", 2023-08-09T12:53:59.327 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:59.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.328 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 6, 2023-08-09T12:53:59.328 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:59.328 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:59.328 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:59.328 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:59.328 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:59.328 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.422266+0000", 2023-08-09T12:53:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-08-09T12:53:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 7, 2023-08-09T12:53:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-08-09T12:53:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-08-09T12:53:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-08-09T12:53:59.329 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-08-09T12:53:59.330 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-08-09T12:53:59.330 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-08-09T12:39:09.385610+0000", 2023-08-09T12:53:59.330 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-08-09T12:53:59.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.330 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-08-09T12:53:59.330 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-08-09T12:53:59.330 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-08-09T12:53:59.330 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-08-09T12:53:59.331 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-08-09T12:53:59.331 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-08-09T12:53:59.331 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-08-09T12:53:59.331 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-08-09T12:53:59.331 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-08-09T12:53:59.332 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-08-09T12:53:59.332 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-08-09T12:53:59.332 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-08-09T12:53:59.332 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-08-09T12:53:59.332 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-08-09T12:53:59.332 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-08-09T12:53:59.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-08-09T12:53:59.333 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-08-09T12:53:59.333 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-08-09T12:53:59.333 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-08-09T12:53:59.333 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-08-09T12:53:59.333 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-08-09T12:53:59.333 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-08-09T12:53:59.333 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-08-09T12:53:59.334 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-08-09T12:53:59.334 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-08-09T12:53:59.334 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-08-09T12:53:59.334 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-08-09T12:53:59.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-08-09T12:53:59.334 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:53:59.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd67006a050 msgr2=0x7fd67006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd67006a050 0x7fd67006c510 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd678036000 tx=0x7fd67803c040 comp rx=0 tx=0).stop 2023-08-09T12:53:59.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 msgr2=0x7fd684155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd684155d00 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fd67400d800 tx=0x7fd67400dcc0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 shutdown_connections 2023-08-09T12:53:59.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd67006a050 0x7fd67006c510 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd68415d120 0x7fd68415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6841587e0 0x7fd6840afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 --2- 172.21.15.17:0/3911793166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6840b0b10 0x7fd684155d00 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.139+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 >> 172.21.15.17:0/3911793166 conn(0x7fd6840b1d50 msgr2=0x7fd68415eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:59.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.140+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 shutdown_connections 2023-08-09T12:53:59.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.140+0000 7fd688af9640 1 -- 172.21.15.17:0/3911793166 wait complete. 2023-08-09T12:53:59.338 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:53:59.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.580+0000 7f85dd283640 1 Processor -- start 2023-08-09T12:53:59.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.580+0000 7f85dd283640 1 -- start start 2023-08-09T12:53:59.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.582+0000 7f85dd283640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85d80c1980 0x7f85d8165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:59.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.582+0000 7f85dd283640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d80cd520 con 0x7f85d8162650 2023-08-09T12:53:59.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.582+0000 7f85dd283640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d80cc630 con 0x7f85d8164f50 2023-08-09T12:53:59.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.582+0000 7f85dd283640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d80cc910 con 0x7f85d80c1980 2023-08-09T12:53:59.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.582+0000 7f85d77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85d80c1980 0x7f85d8165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:59.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.582+0000 7f85ce7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f85d8162650 0x7f85d8165330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36268/0 (socket says 172.21.15.17:36268) 2023-08-09T12:53:59.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.582+0000 7f85ce7fc640 1 -- 172.21.15.17:0/2350210621 learned_addr learned my addr 172.21.15.17:0/2350210621 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:53:59.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.583+0000 7f85d77fe640 1 -- 172.21.15.17:0/2350210621 >> v1:172.21.15.142:6789/0 conn(0x7f85d8164f50 legacy=0x7f85d80cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.583+0000 7f85d77fe640 1 -- 172.21.15.17:0/2350210621 >> v1:172.21.15.17:6789/0 conn(0x7f85d8162650 legacy=0x7f85d8165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.583+0000 7f85d77fe640 1 -- 172.21.15.17:0/2350210621 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d80ccbf0 con 0x7f85d80c1980 2023-08-09T12:53:59.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.583+0000 7f85d67fc640 1 -- 172.21.15.17:0/2350210621 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776588402 0 0) 0x7f85d80cd520 con 0x7f85d8162650 2023-08-09T12:53:59.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.584+0000 7f85d77fe640 1 --2- 172.21.15.17:0/2350210621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80c1980 0x7f85d8165a40 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097a0 tx=0x7f85d002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17510e7237d31e2b server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:59.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.584+0000 7f85d67fc640 1 -- 172.21.15.17:0/2350210621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0030610 con 0x7f85d80c1980 2023-08-09T12:53:59.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.584+0000 7f85d67fc640 1 -- 172.21.15.17:0/2350210621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d0030770 con 0x7f85d80c1980 2023-08-09T12:53:59.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.584+0000 7f85d67fc640 1 -- 172.21.15.17:0/2350210621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0030b00 con 0x7f85d80c1980 2023-08-09T12:53:59.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.585+0000 7f85dd283640 1 -- 172.21.15.17:0/2350210621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80c1980 msgr2=0x7f85d8165a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.585+0000 7f85dd283640 1 --2- 172.21.15.17:0/2350210621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80c1980 0x7f85d8165a40 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097a0 tx=0x7f85d002b960 comp rx=0 tx=0).stop 2023-08-09T12:53:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.585+0000 7f85dd283640 1 -- 172.21.15.17:0/2350210621 shutdown_connections 2023-08-09T12:53:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.585+0000 7f85dd283640 1 --2- 172.21.15.17:0/2350210621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80c1980 0x7f85d8165a40 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.585+0000 7f85dd283640 1 -- 172.21.15.17:0/2350210621 >> 172.21.15.17:0/2350210621 conn(0x7f85d80cb1b0 msgr2=0x7f85d80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.585+0000 7f85dd283640 1 -- 172.21.15.17:0/2350210621 shutdown_connections 2023-08-09T12:53:59.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.585+0000 7f85dd283640 1 -- 172.21.15.17:0/2350210621 wait complete. 2023-08-09T12:53:59.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.587+0000 7f85dd283640 1 Processor -- start 2023-08-09T12:53:59.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.587+0000 7f85dd283640 1 -- start start 2023-08-09T12:53:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85dd283640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d80c1980 0x7f85d80c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:59.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85dd283640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d8162650 0x7f85d815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85dd283640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8164f50 0x7f85d806a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85dd283640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d80c4760 con 0x7f85d8164f50 2023-08-09T12:53:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85dd283640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d80c3b50 con 0x7f85d8162650 2023-08-09T12:53:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85dd283640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d80c3e30 con 0x7f85d80c1980 2023-08-09T12:53:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8164f50 0x7f85d806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85d77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8164f50 0x7f85d806a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59260/0 (socket says 172.21.15.17:59260) 2023-08-09T12:53:59.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.588+0000 7f85d77fe640 1 -- 172.21.15.17:0/371115865 learned_addr learned my addr 172.21.15.17:0/371115865 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:53:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85d6ffd640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d80c1980 0x7f85d80c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85ce7fc640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d8162650 0x7f85d815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85d77fe640 1 -- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d80c1980 msgr2=0x7f85d80c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85d77fe640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d80c1980 0x7f85d80c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85d77fe640 1 -- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d8162650 msgr2=0x7f85d815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85d77fe640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d8162650 0x7f85d815eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85d77fe640 1 -- 172.21.15.17:0/371115865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0009400 con 0x7f85d8164f50 2023-08-09T12:53:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85d6ffd640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d80c1980 0x7f85d80c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:53:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85d77fe640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8164f50 0x7f85d806a520 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f85d00098c0 tx=0x7f85d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.589+0000 7f85cffff640 1 -- 172.21.15.17:0/371115865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d003e070 con 0x7f85d8164f50 2023-08-09T12:53:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.590+0000 7f85cffff640 1 -- 172.21.15.17:0/371115865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d0039990 con 0x7f85d8164f50 2023-08-09T12:53:59.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.590+0000 7f85cffff640 1 -- 172.21.15.17:0/371115865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0039d40 con 0x7f85d8164f50 2023-08-09T12:53:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.590+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d80c4110 con 0x7f85d8164f50 2023-08-09T12:53:59.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.590+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d815f0e0 con 0x7f85d8164f50 2023-08-09T12:53:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.591+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d80c48d0 con 0x7f85d8164f50 2023-08-09T12:53:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.592+0000 7f85cffff640 1 -- 172.21.15.17:0/371115865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f85d004b400 con 0x7f85d8164f50 2023-08-09T12:53:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.593+0000 7f85cffff640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85b806a050 0x7f85b806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:53:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.594+0000 7f85cffff640 1 -- 172.21.15.17:0/371115865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85d00aaaf0 con 0x7f85d8164f50 2023-08-09T12:53:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.594+0000 7f85d6ffd640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85b806a050 0x7f85b806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:53:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.595+0000 7f85d6ffd640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85b806a050 0x7f85b806c510 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f85d806f640 tx=0x7f85c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:53:59.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.598+0000 7f85cffff640 1 -- 172.21.15.17:0/371115865 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f85d0076140 con 0x7f85d8164f50 2023-08-09T12:53:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.833+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85d8067a80 con 0x7f85d8164f50 2023-08-09T12:53:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.834+0000 7f85cffff640 1 -- 172.21.15.17:0/371115865 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f85d0079760 con 0x7f85d8164f50 2023-08-09T12:53:59.838 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:53:59.839 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:53:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:53:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85b806a050 msgr2=0x7f85b806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85b806a050 0x7f85b806c510 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f85d806f640 tx=0x7f85c8009040 comp rx=0 tx=0).stop 2023-08-09T12:53:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8164f50 msgr2=0x7f85d806a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:53:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8164f50 0x7f85d806a520 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f85d00098c0 tx=0x7f85d00046c0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 shutdown_connections 2023-08-09T12:53:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f85b806a050 0x7f85b806c510 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8164f50 0x7f85d806a520 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d8162650 0x7f85d815eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 --2- 172.21.15.17:0/371115865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d80c1980 0x7f85d80c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:53:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 >> 172.21.15.17:0/371115865 conn(0x7f85d80cb1b0 msgr2=0x7f85d80ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:53:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.837+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 shutdown_connections 2023-08-09T12:53:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:53:59.838+0000 7f85dd283640 1 -- 172.21.15.17:0/371115865 wait complete. 2023-08-09T12:53:59.860 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-08-09T12:54:00.107 INFO:teuthology.orchestra.run.smithi017.stdout:{"cluster_fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","whoami":0,"id":9453,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":39.601853095000003,"mdsmap_epoch":93,"osdmap_epoch":194,"osdmap_epoch_barrier":193,"uptime":45.608948765999997} 2023-08-09T12:54:00.108 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "00c647bf-6030-4006-bfa6-56fa996e3ac5", "fs_name": "cephfs", "id": 9453, "mdsmap_epoch": 93, "osdmap_epoch": 194, "osdmap_epoch_barrier": 193, "rank_uptime": 39.601853095, "state": "up:active", "uptime": 45.608948766, "want_state": "up:active", "whoami": 0 } 2023-08-09T12:54:00.108 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-09T12:54:00.109 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:54:00.109 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:00.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:00.167 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-08-09T12:54:00.654 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records in 2023-08-09T12:54:00.655 INFO:teuthology.orchestra.run.smithi017.stderr:50+0 records out 2023-08-09T12:54:00.655 INFO:teuthology.orchestra.run.smithi017.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.427828 s, 123 MB/s 2023-08-09T12:54:00.656 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-09T12:54:00.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:54:00.759 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-09T12:54:00.883 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-09T12:54:00.884 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:54:00.884 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:00.949 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:54:00.949 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:01.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:54:01.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.230+0000 7f9ef1b76640 1 Processor -- start 2023-08-09T12:54:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.230+0000 7f9ef1b76640 1 -- start start 2023-08-09T12:54:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.231+0000 7f9ef1b76640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9eec159d80 0x7f9eec0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.231+0000 7f9ef1b76640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.231+0000 7f9ef1b76640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec070d20 con 0x7f9eec0708c0 2023-08-09T12:54:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.231+0000 7f9ef1b76640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec15a160 con 0x7f9eec159d80 2023-08-09T12:54:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.231+0000 7f9ef1b76640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0b4630 con 0x7f9eec0ad810 2023-08-09T12:54:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9eeb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9eec159d80 0x7f9eec0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9eeb7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9eec159d80 0x7f9eec0b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59276/0 (socket says 172.21.15.17:59276) 2023-08-09T12:54:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9eeb7fe640 1 -- 172.21.15.17:0/374823508 learned_addr learned my addr 172.21.15.17:0/374823508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9ee2ffd640 1 --2- 172.21.15.17:0/374823508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9eeb7fe640 1 -- 172.21.15.17:0/374823508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 msgr2=0x7f9eec070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9eeb7fe640 1 --2- 172.21.15.17:0/374823508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9eeb7fe640 1 -- 172.21.15.17:0/374823508 >> v1:172.21.15.17:6789/0 conn(0x7f9eec0708c0 legacy=0x7f9eec06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9eeb7fe640 1 -- 172.21.15.17:0/374823508 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0b3ab0 con 0x7f9eec159d80 2023-08-09T12:54:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.232+0000 7f9ee2ffd640 1 --2- 172.21.15.17:0/374823508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.233+0000 7f9eeb7fe640 1 --2- 172.21.15.17:0/374823508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec159d80 0x7f9eec0b34d0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009e50 tx=0x7f9edc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db5d4c32270f1bc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.234+0000 7f9eeaffd640 1 -- 172.21.15.17:0/374823508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc02cb00 con 0x7f9eec159d80 2023-08-09T12:54:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.234+0000 7f9eeaffd640 1 -- 172.21.15.17:0/374823508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc02cc60 con 0x7f9eec159d80 2023-08-09T12:54:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.234+0000 7f9eeaffd640 1 -- 172.21.15.17:0/374823508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0343f0 con 0x7f9eec159d80 2023-08-09T12:54:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.234+0000 7f9ef1b76640 1 -- 172.21.15.17:0/374823508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec159d80 msgr2=0x7f9eec0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.234+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/374823508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec159d80 0x7f9eec0b34d0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009e50 tx=0x7f9edc02bf60 comp rx=0 tx=0).stop 2023-08-09T12:54:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.235+0000 7f9ef1b76640 1 -- 172.21.15.17:0/374823508 shutdown_connections 2023-08-09T12:54:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.235+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/374823508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.235+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/374823508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec159d80 0x7f9eec0b34d0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.235+0000 7f9ef1b76640 1 -- 172.21.15.17:0/374823508 >> 172.21.15.17:0/374823508 conn(0x7f9eec0cb1b0 msgr2=0x7f9eec0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.235+0000 7f9ef1b76640 1 -- 172.21.15.17:0/374823508 shutdown_connections 2023-08-09T12:54:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.235+0000 7f9ef1b76640 1 -- 172.21.15.17:0/374823508 wait complete. 2023-08-09T12:54:01.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.236+0000 7f9ef1b76640 1 Processor -- start 2023-08-09T12:54:01.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.237+0000 7f9ef1b76640 1 -- start start 2023-08-09T12:54:01.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.237+0000 7f9ef1b76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec0708c0 0x7f9eec1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9ef1b76640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9ef1b76640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eec159d80 0x7f9eec148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9ef1b76640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1f6a20 con 0x7f9eec0708c0 2023-08-09T12:54:01.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9ef1b76640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1f6460 con 0x7f9eec159d80 2023-08-09T12:54:01.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9ef1b76640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1f6740 con 0x7f9eec0ad810 2023-08-09T12:54:01.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec0708c0 0x7f9eec1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec0708c0 0x7f9eec1f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59278/0 (socket says 172.21.15.17:59278) 2023-08-09T12:54:01.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eeb7fe640 1 -- 172.21.15.17:0/3602821914 learned_addr learned my addr 172.21.15.17:0/3602821914 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:01.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9ee2ffd640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eeb7fe640 1 -- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 msgr2=0x7f9eec0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eebfff640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eec159d80 0x7f9eec148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eeb7fe640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec0c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eeb7fe640 1 -- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eec159d80 msgr2=0x7f9eec148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eeb7fe640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eec159d80 0x7f9eec148940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.238+0000 7f9eeb7fe640 1 -- 172.21.15.17:0/3602821914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009b30 con 0x7f9eec0708c0 2023-08-09T12:54:01.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.239+0000 7f9eeb7fe640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec0708c0 0x7f9eec1f5b60 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f9edc036040 tx=0x7f9edc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:01.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.239+0000 7f9ee8ff9640 1 -- 172.21.15.17:0/3602821914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc03e450 con 0x7f9eec0708c0 2023-08-09T12:54:01.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.239+0000 7f9ee8ff9640 1 -- 172.21.15.17:0/3602821914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc03e5f0 con 0x7f9eec0708c0 2023-08-09T12:54:01.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.239+0000 7f9ee8ff9640 1 -- 172.21.15.17:0/3602821914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc03e9a0 con 0x7f9eec0708c0 2023-08-09T12:54:01.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.239+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec0c58a0 con 0x7f9eec0708c0 2023-08-09T12:54:01.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.239+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec1f60a0 con 0x7f9eec0708c0 2023-08-09T12:54:01.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.241+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec1f6230 con 0x7f9eec0708c0 2023-08-09T12:54:01.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.242+0000 7f9ee8ff9640 1 -- 172.21.15.17:0/3602821914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9edc03eb00 con 0x7f9eec0708c0 2023-08-09T12:54:01.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.242+0000 7f9ee8ff9640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9ecc06a050 0x7f9ecc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.243+0000 7f9ee8ff9640 1 -- 172.21.15.17:0/3602821914 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9edc0ab520 con 0x7f9eec0708c0 2023-08-09T12:54:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.243+0000 7f9ee2ffd640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9ecc06a050 0x7f9ecc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.245+0000 7f9ee2ffd640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9ecc06a050 0x7f9ecc06c510 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006fd0 tx=0x7f9ed4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:01.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.247+0000 7f9ee8ff9640 1 -- 172.21.15.17:0/3602821914 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f9edc076d50 con 0x7f9eec0708c0 2023-08-09T12:54:01.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.441+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9eec0c5d60 con 0x7f9eec0708c0 2023-08-09T12:54:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.443+0000 7f9ee8ff9640 1 -- 172.21.15.17:0/3602821914 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+18278 (secure 0 0 0) 0x7f9edc03edb0 con 0x7f9eec0708c0 2023-08-09T12:54:01.447 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:01.447 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":194,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:53:53.980440+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:53:18.326271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-09T12:53:18.942904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:54:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.445+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9ecc06a050 msgr2=0x7f9ecc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.445+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9ecc06a050 0x7f9ecc06c510 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006fd0 tx=0x7f9ed4008040 comp rx=0 tx=0).stop 2023-08-09T12:54:01.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.445+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec0708c0 msgr2=0x7f9eec1f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.445+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec0708c0 0x7f9eec1f5b60 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f9edc036040 tx=0x7f9edc004a40 comp rx=0 tx=0).stop 2023-08-09T12:54:01.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.446+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 shutdown_connections 2023-08-09T12:54:01.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.446+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f9ecc06a050 0x7f9ecc06c510 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.446+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9eec159d80 0x7f9eec148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.446+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9eec0ad810 0x7f9eec0c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.446+0000 7f9ef1b76640 1 --2- 172.21.15.17:0/3602821914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eec0708c0 0x7f9eec1f5b60 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.446+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 >> 172.21.15.17:0/3602821914 conn(0x7f9eec0cb1b0 msgr2=0x7f9eec06f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.446+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 shutdown_connections 2023-08-09T12:54:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.446+0000 7f9ef1b76640 1 -- 172.21.15.17:0/3602821914 wait complete. 2023-08-09T12:54:01.468 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:53:18.326271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:53:18.942904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '194', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:54:01.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:54:01.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.691+0000 7fdc17dd6640 1 Processor -- start 2023-08-09T12:54:01.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.691+0000 7fdc17dd6640 1 -- start start 2023-08-09T12:54:01.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.693+0000 7fdc17dd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.693+0000 7fdc17dd6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdc100cc630 0x7fdc100ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.693+0000 7fdc17dd6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100b2250 con 0x7fdc100b3b40 2023-08-09T12:54:01.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.693+0000 7fdc17dd6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc100ae020 con 0x7fdc100cc630 2023-08-09T12:54:01.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.693+0000 7fdc17dd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100b2530 con 0x7fdc100adc40 2023-08-09T12:54:01.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.693+0000 7fdc15371640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdc100b3b40 0x7fdc100b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36288/0 (socket says 172.21.15.17:36288) 2023-08-09T12:54:01.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc15371640 1 -- 172.21.15.17:0/1850357681 learned_addr learned my addr 172.21.15.17:0/1850357681 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:01.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc16373640 1 --2- 172.21.15.17:0/1850357681 >> v2:172.21.15.17:3300/0 conn(0x7fdc100cc630 0x7fdc100ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc15b72640 1 --2- 172.21.15.17:0/1850357681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc14b70640 1 -- 172.21.15.17:0/1850357681 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456533180 0 0) 0x7fdc100b2250 con 0x7fdc100b3b40 2023-08-09T12:54:01.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc14b70640 1 -- 172.21.15.17:0/1850357681 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbfc003520 con 0x7fdc100b3b40 2023-08-09T12:54:01.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc16373640 1 -- 172.21.15.17:0/1850357681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 msgr2=0x7fdc1006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc16373640 1 --2- 172.21.15.17:0/1850357681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1006c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc16373640 1 -- 172.21.15.17:0/1850357681 >> v1:172.21.15.17:6789/0 conn(0x7fdc100b3b40 legacy=0x7fdc100b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.694+0000 7fdc16373640 1 -- 172.21.15.17:0/1850357681 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1006fe80 con 0x7fdc100cc630 2023-08-09T12:54:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.696+0000 7fdc16373640 1 --2- 172.21.15.17:0/1850357681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100cc630 0x7fdc100ccac0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009d90 tx=0x7fdc0802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8732458dd0d6c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.696+0000 7fdc14b70640 1 -- 172.21.15.17:0/1850357681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0802cc60 con 0x7fdc100cc630 2023-08-09T12:54:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.696+0000 7fdc14b70640 1 -- 172.21.15.17:0/1850357681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0802cdc0 con 0x7fdc100cc630 2023-08-09T12:54:01.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.696+0000 7fdc14b70640 1 -- 172.21.15.17:0/1850357681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08034640 con 0x7fdc100cc630 2023-08-09T12:54:01.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.696+0000 7fdc17dd6640 1 -- 172.21.15.17:0/1850357681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100cc630 msgr2=0x7fdc100ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.696+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/1850357681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100cc630 0x7fdc100ccac0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009d90 tx=0x7fdc0802beb0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.697+0000 7fdc17dd6640 1 -- 172.21.15.17:0/1850357681 shutdown_connections 2023-08-09T12:54:01.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.697+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/1850357681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100cc630 0x7fdc100ccac0 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.697+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/1850357681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1006c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.697+0000 7fdc17dd6640 1 -- 172.21.15.17:0/1850357681 >> 172.21.15.17:0/1850357681 conn(0x7fdc100cb1b0 msgr2=0x7fdc100cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:01.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.697+0000 7fdc17dd6640 1 -- 172.21.15.17:0/1850357681 shutdown_connections 2023-08-09T12:54:01.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.697+0000 7fdc17dd6640 1 -- 172.21.15.17:0/1850357681 wait complete. 2023-08-09T12:54:01.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.698+0000 7fdc17dd6640 1 Processor -- start 2023-08-09T12:54:01.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.699+0000 7fdc17dd6640 1 -- start start 2023-08-09T12:54:01.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc17dd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc17dd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100b3b40 0x7fdc1006b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc17dd6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc100cc630 0x7fdc1006b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc17dd6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100697c0 con 0x7fdc100b3b40 2023-08-09T12:54:01.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc17dd6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10069a60 con 0x7fdc100cc630 2023-08-09T12:54:01.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc17dd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10069d40 con 0x7fdc100adc40 2023-08-09T12:54:01.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15371640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100b3b40 0x7fdc1006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15371640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100b3b40 0x7fdc1006b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59284/0 (socket says 172.21.15.17:59284) 2023-08-09T12:54:01.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15371640 1 -- 172.21.15.17:0/2516864357 learned_addr learned my addr 172.21.15.17:0/2516864357 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:01.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15b72640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc16373640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc100cc630 0x7fdc1006b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15371640 1 -- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 msgr2=0x7fdc1015a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15371640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1015a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15371640 1 -- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc100cc630 msgr2=0x7fdc1006b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15371640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc100cc630 0x7fdc1006b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15371640 1 -- 172.21.15.17:0/2516864357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009a70 con 0x7fdc100b3b40 2023-08-09T12:54:01.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc15b72640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:01.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.700+0000 7fdc16373640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc100cc630 0x7fdc1006b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:01.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.701+0000 7fdc15371640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100b3b40 0x7fdc1006b310 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c700 tx=0x7fdc0000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:01.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.701+0000 7fdc067fc640 1 -- 172.21.15.17:0/2516864357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00007270 con 0x7fdc100b3b40 2023-08-09T12:54:01.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.701+0000 7fdc067fc640 1 -- 172.21.15.17:0/2516864357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc000073f0 con 0x7fdc100b3b40 2023-08-09T12:54:01.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.701+0000 7fdc067fc640 1 -- 172.21.15.17:0/2516864357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00001d40 con 0x7fdc100b3b40 2023-08-09T12:54:01.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.701+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1006a020 con 0x7fdc100b3b40 2023-08-09T12:54:01.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.701+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1006a5e0 con 0x7fdc100b3b40 2023-08-09T12:54:01.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.702+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc100c8a10 con 0x7fdc100b3b40 2023-08-09T12:54:01.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.703+0000 7fdc067fc640 1 -- 172.21.15.17:0/2516864357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc000057a0 con 0x7fdc100b3b40 2023-08-09T12:54:01.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.704+0000 7fdc067fc640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdbf406a050 0x7fdbf406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:01.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.705+0000 7fdc067fc640 1 -- 172.21.15.17:0/2516864357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc00087b80 con 0x7fdc100b3b40 2023-08-09T12:54:01.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.705+0000 7fdc15b72640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdbf406a050 0x7fdbf406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:01.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.706+0000 7fdc15b72640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdbf406a050 0x7fdbf406c510 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdc100cded0 tx=0x7fdc0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:01.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.709+0000 7fdc067fc640 1 -- 172.21.15.17:0/2516864357 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fdc00053260 con 0x7fdc100b3b40 2023-08-09T12:54:01.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.899+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc10067a80 con 0x7fdc100b3b40 2023-08-09T12:54:01.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.900+0000 7fdc067fc640 1 -- 172.21.15.17:0/2516864357 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v194) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc00087e60 con 0x7fdc100b3b40 2023-08-09T12:54:01.903 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:54:01.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.902+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdbf406a050 msgr2=0x7fdbf406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.902+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdbf406a050 0x7fdbf406c510 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdc100cded0 tx=0x7fdc0c008040 comp rx=0 tx=0).stop 2023-08-09T12:54:01.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.902+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100b3b40 msgr2=0x7fdc1006b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:01.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.902+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100b3b40 0x7fdc1006b310 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c700 tx=0x7fdc0000cbc0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.903+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 shutdown_connections 2023-08-09T12:54:01.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.903+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fdbf406a050 0x7fdbf406c510 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.903+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc100cc630 0x7fdc1006b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.903+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc100b3b40 0x7fdc1006b310 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.903+0000 7fdc17dd6640 1 --2- 172.21.15.17:0/2516864357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc100adc40 0x7fdc1015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.903+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 >> 172.21.15.17:0/2516864357 conn(0x7fdc100cb1b0 msgr2=0x7fdc100ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.903+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 shutdown_connections 2023-08-09T12:54:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:01.903+0000 7fdc17dd6640 1 -- 172.21.15.17:0/2516864357 wait complete. 2023-08-09T12:54:01.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:54:02.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.155+0000 7fa0b84b8640 1 Processor -- start 2023-08-09T12:54:02.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.155+0000 7fa0b84b8640 1 -- start start 2023-08-09T12:54:02.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b84b8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b015ce90 0x7fa0b01616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b84b8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0b00b6000 0x7fa0b00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b84b8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b00b6460 con 0x7fa0b00d29d0 2023-08-09T12:54:02.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b84b8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b00cda40 con 0x7fa0b00b6000 2023-08-09T12:54:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b84b8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b00cdd10 con 0x7fa0b015ce90 2023-08-09T12:54:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b5a53640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0b00b6000 0x7fa0b00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b6254640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b015ce90 0x7fa0b01616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b5a53640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0b00b6000 0x7fa0b00cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:50146/0 (socket says 172.21.15.17:50146) 2023-08-09T12:54:02.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.157+0000 7fa0b5a53640 1 -- 172.21.15.17:0/3298870450 learned_addr learned my addr 172.21.15.17:0/3298870450 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:02.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.158+0000 7fa0b6254640 1 -- 172.21.15.17:0/3298870450 >> v2:172.21.15.142:3300/0 conn(0x7fa0b00b6000 msgr2=0x7fa0b00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:02.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.158+0000 7fa0b6254640 1 --2- 172.21.15.17:0/3298870450 >> v2:172.21.15.142:3300/0 conn(0x7fa0b00b6000 0x7fa0b00cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.158+0000 7fa0b6254640 1 -- 172.21.15.17:0/3298870450 >> v1:172.21.15.142:6789/0 conn(0x7fa0b00d29d0 legacy=0x7fa0b00d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.158+0000 7fa0b6254640 1 -- 172.21.15.17:0/3298870450 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b00cdff0 con 0x7fa0b015ce90 2023-08-09T12:54:02.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.160+0000 7fa0b6254640 1 --2- 172.21.15.17:0/3298870450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b015ce90 0x7fa0b01616e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009d90 tx=0x7fa0ac02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e228b108325dfe6e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:02.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b5252640 1 -- 172.21.15.17:0/3298870450 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac02cc60 con 0x7fa0b015ce90 2023-08-09T12:54:02.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b5252640 1 -- 172.21.15.17:0/3298870450 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac02cdc0 con 0x7fa0b015ce90 2023-08-09T12:54:02.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b5252640 1 -- 172.21.15.17:0/3298870450 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac034660 con 0x7fa0b015ce90 2023-08-09T12:54:02.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b84b8640 1 -- 172.21.15.17:0/3298870450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b015ce90 msgr2=0x7fa0b01616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/3298870450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b015ce90 0x7fa0b01616e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009d90 tx=0x7fa0ac02beb0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b84b8640 1 -- 172.21.15.17:0/3298870450 shutdown_connections 2023-08-09T12:54:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/3298870450 >> v2:172.21.15.142:3300/0 conn(0x7fa0b00b6000 0x7fa0b00cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/3298870450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b015ce90 0x7fa0b01616e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.161+0000 7fa0b84b8640 1 -- 172.21.15.17:0/3298870450 >> 172.21.15.17:0/3298870450 conn(0x7fa0b006fde0 msgr2=0x7fa0b00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.162+0000 7fa0b84b8640 1 -- 172.21.15.17:0/3298870450 shutdown_connections 2023-08-09T12:54:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.162+0000 7fa0b84b8640 1 -- 172.21.15.17:0/3298870450 wait complete. 2023-08-09T12:54:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.163+0000 7fa0b84b8640 1 Processor -- start 2023-08-09T12:54:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.164+0000 7fa0b84b8640 1 -- start start 2023-08-09T12:54:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.164+0000 7fa0b84b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b00b6000 0x7fa0b015fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.164+0000 7fa0b84b8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b00d29d0 0x7fa0b00c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b84b8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b015ce90 0x7fa0b014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b84b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b00cae40 con 0x7fa0b00b6000 2023-08-09T12:54:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b84b8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b00cb730 con 0x7fa0b015ce90 2023-08-09T12:54:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b84b8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b00ca2c0 con 0x7fa0b00d29d0 2023-08-09T12:54:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6254640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b00b6000 0x7fa0b015fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6254640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b00b6000 0x7fa0b015fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59298/0 (socket says 172.21.15.17:59298) 2023-08-09T12:54:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6254640 1 -- 172.21.15.17:0/492853859 learned_addr learned my addr 172.21.15.17:0/492853859 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b5a53640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b00d29d0 0x7fa0b00c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6254640 1 -- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b00d29d0 msgr2=0x7fa0b00c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6254640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b00d29d0 0x7fa0b00c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6254640 1 -- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b015ce90 msgr2=0x7fa0b014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6a55640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b015ce90 0x7fa0b014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6254640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b015ce90 0x7fa0b014ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.165+0000 7fa0b6254640 1 -- 172.21.15.17:0/492853859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac009a70 con 0x7fa0b00b6000 2023-08-09T12:54:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.166+0000 7fa0b6a55640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b015ce90 0x7fa0b014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.166+0000 7fa0b6254640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b00b6000 0x7fa0b015fc10 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009d90 tx=0x7fa0ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.166+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/492853859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac040650 con 0x7fa0b00b6000 2023-08-09T12:54:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.166+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/492853859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac0407b0 con 0x7fa0b00b6000 2023-08-09T12:54:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.166+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b00ca5a0 con 0x7fa0b00b6000 2023-08-09T12:54:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.166+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/492853859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac040b60 con 0x7fa0b00b6000 2023-08-09T12:54:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.166+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b00cab60 con 0x7fa0b00b6000 2023-08-09T12:54:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.168+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b0067a80 con 0x7fa0b00b6000 2023-08-09T12:54:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.169+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/492853859 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0ac040cc0 con 0x7fa0b00b6000 2023-08-09T12:54:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.170+0000 7fa0a6ffd640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa09406a050 0x7fa09406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.170+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/492853859 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0ac0ab390 con 0x7fa0b00b6000 2023-08-09T12:54:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.170+0000 7fa0b5a53640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa09406a050 0x7fa09406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.172+0000 7fa0b5a53640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa09406a050 0x7fa09406c510 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa0b015ec40 tx=0x7fa0a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.178+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/492853859 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa0ac076b10 con 0x7fa0b00b6000 2023-08-09T12:54:02.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.370+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0b00d0ad0 con 0x7fa0b00b6000 2023-08-09T12:54:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.371+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/492853859 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v194) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0ac07a130 con 0x7fa0b00b6000 2023-08-09T12:54:02.374 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:54:02.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.373+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa09406a050 msgr2=0x7fa09406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.373+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa09406a050 0x7fa09406c510 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa0b015ec40 tx=0x7fa0a0008040 comp rx=0 tx=0).stop 2023-08-09T12:54:02.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.373+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b00b6000 msgr2=0x7fa0b015fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.373+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b00b6000 0x7fa0b015fc10 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009d90 tx=0x7fa0ac004a40 comp rx=0 tx=0).stop 2023-08-09T12:54:02.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.374+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 shutdown_connections 2023-08-09T12:54:02.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.374+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa09406a050 0x7fa09406c510 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.374+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b015ce90 0x7fa0b014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.374+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b00d29d0 0x7fa0b00c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.374+0000 7fa0b84b8640 1 --2- 172.21.15.17:0/492853859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b00b6000 0x7fa0b015fc10 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.374+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 >> 172.21.15.17:0/492853859 conn(0x7fa0b006fde0 msgr2=0x7fa0b015bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:02.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.374+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 shutdown_connections 2023-08-09T12:54:02.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.374+0000 7fa0b84b8640 1 -- 172.21.15.17:0/492853859 wait complete. 2023-08-09T12:54:02.395 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:54:02.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.621+0000 7f783b226640 1 Processor -- start 2023-08-09T12:54:02.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.621+0000 7f783b226640 1 -- start start 2023-08-09T12:54:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.622+0000 7f783b226640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78340b1dc0 0x7f78340b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.622+0000 7f783b226640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78340b8970 0x7f783406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.622+0000 7f783b226640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7834160640 con 0x7f7834160260 2023-08-09T12:54:02.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.622+0000 7f783b226640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78340d0d40 con 0x7f78340b1dc0 2023-08-09T12:54:02.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.622+0000 7f783b226640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78340d1020 con 0x7f78340b8970 2023-08-09T12:54:02.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.623+0000 7f7833fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78340b1dc0 0x7f78340b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.623+0000 7f7833fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78340b1dc0 0x7f78340b8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59312/0 (socket says 172.21.15.17:59312) 2023-08-09T12:54:02.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.623+0000 7f7833fff640 1 -- 172.21.15.17:0/766011645 learned_addr learned my addr 172.21.15.17:0/766011645 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:02.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.623+0000 7f78397c3640 1 --2- 172.21.15.17:0/766011645 >> v2:172.21.15.142:3300/0 conn(0x7f78340b8970 0x7f783406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.624+0000 7f7833fff640 1 -- 172.21.15.17:0/766011645 >> v2:172.21.15.142:3300/0 conn(0x7f78340b8970 msgr2=0x7f783406fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:02.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.624+0000 7f7833fff640 1 --2- 172.21.15.17:0/766011645 >> v2:172.21.15.142:3300/0 conn(0x7f78340b8970 0x7f783406fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.624+0000 7f7833fff640 1 -- 172.21.15.17:0/766011645 >> v1:172.21.15.142:6789/0 conn(0x7f7834160260 legacy=0x7f78340b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.624+0000 7f7833fff640 1 -- 172.21.15.17:0/766011645 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78340d1300 con 0x7f78340b1dc0 2023-08-09T12:54:02.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.625+0000 7f7833fff640 1 --2- 172.21.15.17:0/766011645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78340b1dc0 0x7f78340b8430 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f78340709d0 tx=0x7f781c02ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f706f675f8256fa2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:02.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.625+0000 7f78337fe640 1 -- 172.21.15.17:0/766011645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c02f860 con 0x7f78340b1dc0 2023-08-09T12:54:02.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.625+0000 7f78337fe640 1 -- 172.21.15.17:0/766011645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c02f9c0 con 0x7f78340b1dc0 2023-08-09T12:54:02.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.625+0000 7f78337fe640 1 -- 172.21.15.17:0/766011645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c02fd50 con 0x7f78340b1dc0 2023-08-09T12:54:02.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.626+0000 7f783b226640 1 -- 172.21.15.17:0/766011645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78340b1dc0 msgr2=0x7f78340b8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.626+0000 7f783b226640 1 --2- 172.21.15.17:0/766011645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78340b1dc0 0x7f78340b8430 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f78340709d0 tx=0x7f781c02ba40 comp rx=0 tx=0).stop 2023-08-09T12:54:02.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.626+0000 7f783b226640 1 -- 172.21.15.17:0/766011645 shutdown_connections 2023-08-09T12:54:02.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.626+0000 7f783b226640 1 --2- 172.21.15.17:0/766011645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78340b1dc0 0x7f78340b8430 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.626+0000 7f783b226640 1 --2- 172.21.15.17:0/766011645 >> v2:172.21.15.142:3300/0 conn(0x7f78340b8970 0x7f783406fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.626+0000 7f783b226640 1 -- 172.21.15.17:0/766011645 >> 172.21.15.17:0/766011645 conn(0x7f7834069be0 msgr2=0x7f7834069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:02.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.626+0000 7f783b226640 1 -- 172.21.15.17:0/766011645 shutdown_connections 2023-08-09T12:54:02.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.626+0000 7f783b226640 1 -- 172.21.15.17:0/766011645 wait complete. 2023-08-09T12:54:02.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.628+0000 7f783b226640 1 Processor -- start 2023-08-09T12:54:02.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.628+0000 7f783b226640 1 -- start start 2023-08-09T12:54:02.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f783b226640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78340b1dc0 0x7f7834157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f783b226640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340b8970 0x7f783415b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f783b226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7834160260 0x7f78341537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f783b226640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783415bc50 con 0x7f7834160260 2023-08-09T12:54:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f783b226640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7834158640 con 0x7f78340b8970 2023-08-09T12:54:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f783b226640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7834158920 con 0x7f78340b1dc0 2023-08-09T12:54:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f78397c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7834160260 0x7f78341537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f78397c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7834160260 0x7f78341537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59324/0 (socket says 172.21.15.17:59324) 2023-08-09T12:54:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.629+0000 7f78397c3640 1 -- 172.21.15.17:0/3346974485 learned_addr learned my addr 172.21.15.17:0/3346974485 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:02.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f7838fc2640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78340b1dc0 0x7f7834157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f7833fff640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340b8970 0x7f783415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78397c3640 1 -- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78340b1dc0 msgr2=0x7f7834157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78397c3640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78340b1dc0 0x7f7834157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78397c3640 1 -- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340b8970 msgr2=0x7f783415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78397c3640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340b8970 0x7f783415b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78397c3640 1 -- 172.21.15.17:0/3346974485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c0094d0 con 0x7f7834160260 2023-08-09T12:54:02.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78397c3640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7834160260 0x7f78341537b0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f782c00d800 tx=0x7f782c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:02.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78317fa640 1 -- 172.21.15.17:0/3346974485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c00b6c0 con 0x7f7834160260 2023-08-09T12:54:02.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78317fa640 1 -- 172.21.15.17:0/3346974485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c00b840 con 0x7f7834160260 2023-08-09T12:54:02.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f78317fa640 1 -- 172.21.15.17:0/3346974485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c00bbf0 con 0x7f7834160260 2023-08-09T12:54:02.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.630+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7834158c00 con 0x7f7834160260 2023-08-09T12:54:02.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.631+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78341591c0 con 0x7f7834160260 2023-08-09T12:54:02.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.632+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7834067a80 con 0x7f7834160260 2023-08-09T12:54:02.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.633+0000 7f78317fa640 1 -- 172.21.15.17:0/3346974485 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f782c00bd50 con 0x7f7834160260 2023-08-09T12:54:02.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.634+0000 7f78317fa640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781406a050 0x7f781406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:02.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.634+0000 7f78317fa640 1 -- 172.21.15.17:0/3346974485 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f782c088a00 con 0x7f7834160260 2023-08-09T12:54:02.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.634+0000 7f7838fc2640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781406a050 0x7f781406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:02.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.636+0000 7f7838fc2640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781406a050 0x7f781406c510 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7824007fd0 tx=0x7f7824009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.638+0000 7f78317fa640 1 -- 172.21.15.17:0/3346974485 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f782c054180 con 0x7f7834160260 2023-08-09T12:54:02.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.835+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78340d15b0 con 0x7f7834160260 2023-08-09T12:54:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.836+0000 7f78317fa640 1 -- 172.21.15.17:0/3346974485 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v194) v1 ==== 104+0+11 (secure 0 0 0) 0x7f782c05be60 con 0x7f7834160260 2023-08-09T12:54:02.839 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:54:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781406a050 msgr2=0x7f781406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781406a050 0x7f781406c510 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7824007fd0 tx=0x7f7824009040 comp rx=0 tx=0).stop 2023-08-09T12:54:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7834160260 msgr2=0x7f78341537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7834160260 0x7f78341537b0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f782c00d800 tx=0x7f782c00dcc0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 shutdown_connections 2023-08-09T12:54:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f781406a050 0x7f781406c510 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7834160260 0x7f78341537b0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340b8970 0x7f783415b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 --2- 172.21.15.17:0/3346974485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78340b1dc0 0x7f7834157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:02.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 >> 172.21.15.17:0/3346974485 conn(0x7f7834069be0 msgr2=0x7f783415f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:02.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 shutdown_connections 2023-08-09T12:54:02.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:02.839+0000 7f783b226640 1 -- 172.21.15.17:0/3346974485 wait complete. 2023-08-09T12:54:02.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:54:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.087+0000 7f265e0e0640 1 Processor -- start 2023-08-09T12:54:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.087+0000 7f265e0e0640 1 -- start start 2023-08-09T12:54:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.088+0000 7f265e0e0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26580b8420 0x7f26580cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.089+0000 7f265e0e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 0x7f26580cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.089+0000 7f265e0e0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26580d0f00 con 0x7f265815cb40 2023-08-09T12:54:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.089+0000 7f265e0e0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26581611f0 con 0x7f26580b8420 2023-08-09T12:54:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.089+0000 7f265e0e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26581614d0 con 0x7f265815cf20 2023-08-09T12:54:03.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.089+0000 7f265d0de640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f265815cb40 0x7f26581609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36298/0 (socket says 172.21.15.17:36298) 2023-08-09T12:54:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.089+0000 7f265d0de640 1 -- 172.21.15.17:0/1340985752 learned_addr learned my addr 172.21.15.17:0/1340985752 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.089+0000 7f265c8dd640 1 --2- 172.21.15.17:0/1340985752 >> v2:172.21.15.142:3300/0 conn(0x7f26580b8420 0x7f26580cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.089+0000 7f265d8df640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 0x7f26580cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190175611 0 0) 0x7f26580d0f00 con 0x7f265815cb40 2023-08-09T12:54:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2644003520 con 0x7f265815cb40 2023-08-09T12:54:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4082111679 0 0) 0x7f2644003520 con 0x7f265815cb40 2023-08-09T12:54:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 msgr2=0x7f26580cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 0x7f26580cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 >> v2:172.21.15.142:3300/0 conn(0x7f26580b8420 msgr2=0x7f26580cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 --2- 172.21.15.17:0/1340985752 >> v2:172.21.15.142:3300/0 conn(0x7f26580b8420 0x7f26580cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26581617b0 con 0x7f265815cb40 2023-08-09T12:54:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f2654001670 con 0x7f265815cb40 2023-08-09T12:54:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 >> v1:172.21.15.17:6789/0 conn(0x7f265815cb40 legacy=0x7f26581609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 0x7f2644003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2644003ef0 0x7f26440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2644004d00 0x7f2644005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26581611f0 con 0x7f2644003ef0 2023-08-09T12:54:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26581614d0 con 0x7f2644004d00 2023-08-09T12:54:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264400b9b0 con 0x7f265815cf20 2023-08-09T12:54:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.090+0000 7f265c8dd640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2644003ef0 0x7f26440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.091+0000 7f265d0de640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 0x7f2644003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.091+0000 7f265c8dd640 1 -- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 msgr2=0x7f2644003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:03.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.091+0000 7f265c8dd640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 0x7f2644003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.091+0000 7f265c8dd640 1 -- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2644004d00 msgr2=0x7f2644005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:03.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.091+0000 7f265c8dd640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2644004d00 0x7f2644005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.091+0000 7f265c8dd640 1 -- 172.21.15.17:0/1340985752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644003520 con 0x7f2644003ef0 2023-08-09T12:54:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.091+0000 7f265d0de640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f265815cf20 0x7f2644003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.092+0000 7f265c8dd640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2644003ef0 0x7f26440047c0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f2648009ac0 tx=0x7f26440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cbdaff3bffd082 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264802c710 con 0x7f2644003ef0 2023-08-09T12:54:03.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264802c870 con 0x7f2644003ef0 2023-08-09T12:54:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f264ffff640 1 -- 172.21.15.17:0/1340985752 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264802cc00 con 0x7f2644003ef0 2023-08-09T12:54:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f265e0e0640 1 -- 172.21.15.17:0/1340985752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2644003ef0 msgr2=0x7f26440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f265e0e0640 1 --2- 172.21.15.17:0/1340985752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2644003ef0 0x7f26440047c0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f2648009ac0 tx=0x7f26440057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f265d8df640 1 -- 172.21.15.17:0/1340985752 reap_dead start 2023-08-09T12:54:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f265e0e0640 1 -- 172.21.15.17:0/1340985752 shutdown_connections 2023-08-09T12:54:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f265e0e0640 1 -- 172.21.15.17:0/1340985752 >> 172.21.15.17:0/1340985752 conn(0x7f26580d2ab0 msgr2=0x7f26580d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f265e0e0640 1 -- 172.21.15.17:0/1340985752 shutdown_connections 2023-08-09T12:54:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.093+0000 7f265e0e0640 1 -- 172.21.15.17:0/1340985752 wait complete. 2023-08-09T12:54:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.095+0000 7f265e0e0640 1 Processor -- start 2023-08-09T12:54:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.095+0000 7f265e0e0640 1 -- start start 2023-08-09T12:54:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.096+0000 7f265e0e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2644003ef0 0x7f26580c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.096+0000 7f265e0e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815ffb0 0x7f26581f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.096+0000 7f265e0e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2658154fc0 0x7f2658156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.096+0000 7f265e0e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26581f6170 con 0x7f2658154fc0 2023-08-09T12:54:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.096+0000 7f265e0e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265815efa0 con 0x7f265815ffb0 2023-08-09T12:54:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.096+0000 7f265e0e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265815fb20 con 0x7f2644003ef0 2023-08-09T12:54:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d8df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2658154fc0 0x7f2658156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d8df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2658154fc0 0x7f2658156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59342/0 (socket says 172.21.15.17:59342) 2023-08-09T12:54:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d8df640 1 -- 172.21.15.17:0/4100988692 learned_addr learned my addr 172.21.15.17:0/4100988692 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d8df640 1 -- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2644003ef0 msgr2=0x7f26580c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d0de640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2644003ef0 0x7f26580c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265c8dd640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815ffb0 0x7f26581f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d8df640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2644003ef0 0x7f26580c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d8df640 1 -- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815ffb0 msgr2=0x7f26581f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d8df640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815ffb0 0x7f26581f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.097+0000 7f265d8df640 1 -- 172.21.15.17:0/4100988692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265815f1f0 con 0x7f2658154fc0 2023-08-09T12:54:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.098+0000 7f265d8df640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2658154fc0 0x7f2658156bb0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f26580b88b0 tx=0x7f265000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.098+0000 7f264dffb640 1 -- 172.21.15.17:0/4100988692 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650010040 con 0x7f2658154fc0 2023-08-09T12:54:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.098+0000 7f264dffb640 1 -- 172.21.15.17:0/4100988692 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265000bb10 con 0x7f2658154fc0 2023-08-09T12:54:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.098+0000 7f264dffb640 1 -- 172.21.15.17:0/4100988692 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265000bea0 con 0x7f2658154fc0 2023-08-09T12:54:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.098+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265815f4d0 con 0x7f2658154fc0 2023-08-09T12:54:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.098+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2658155440 con 0x7f2658154fc0 2023-08-09T12:54:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.099+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265804e390 con 0x7f2658154fc0 2023-08-09T12:54:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.100+0000 7f264dffb640 1 -- 172.21.15.17:0/4100988692 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f265001d400 con 0x7f2658154fc0 2023-08-09T12:54:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.101+0000 7f264dffb640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f263c06a080 0x7f263c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.101+0000 7f264dffb640 1 -- 172.21.15.17:0/4100988692 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2650088be0 con 0x7f2658154fc0 2023-08-09T12:54:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.102+0000 7f265d0de640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f263c06a080 0x7f263c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.103+0000 7f265d0de640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f263c06a080 0x7f263c06c540 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f26540018a0 tx=0x7f2654009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.105+0000 7f264dffb640 1 -- 172.21.15.17:0/4100988692 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2650057d50 con 0x7f2658154fc0 2023-08-09T12:54:03.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.299+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f265815fc60 con 0x7f2658154fc0 2023-08-09T12:54:03.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.300+0000 7f264dffb640 1 -- 172.21.15.17:0/4100988692 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v194) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2650018020 con 0x7f2658154fc0 2023-08-09T12:54:03.305 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:54:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f263c06a080 msgr2=0x7f263c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f263c06a080 0x7f263c06c540 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f26540018a0 tx=0x7f2654009040 comp rx=0 tx=0).stop 2023-08-09T12:54:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2658154fc0 msgr2=0x7f2658156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2658154fc0 0x7f2658156bb0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f26580b88b0 tx=0x7f265000b480 comp rx=0 tx=0).stop 2023-08-09T12:54:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 shutdown_connections 2023-08-09T12:54:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f263c06a080 0x7f263c06c540 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2658154fc0 0x7f2658156bb0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f265815ffb0 0x7f26581f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 --2- 172.21.15.17:0/4100988692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2644003ef0 0x7f26580c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.302+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 >> 172.21.15.17:0/4100988692 conn(0x7f26580d2ab0 msgr2=0x7f26581563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.303+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 shutdown_connections 2023-08-09T12:54:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.303+0000 7f265e0e0640 1 -- 172.21.15.17:0/4100988692 wait complete. 2023-08-09T12:54:03.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:54:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.542+0000 7f028e02c640 1 Processor -- start 2023-08-09T12:54:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.542+0000 7f028e02c640 1 -- start start 2023-08-09T12:54:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.543+0000 7f028e02c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0288070f00 0x7f028815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.543+0000 7f028e02c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028815bce0 0x7f02880cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.543+0000 7f028e02c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0288071340 con 0x7f02881587e0 2023-08-09T12:54:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.543+0000 7f028e02c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880715c0 con 0x7f0288070f00 2023-08-09T12:54:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.543+0000 7f028e02c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880718a0 con 0x7f028815bce0 2023-08-09T12:54:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.544+0000 7f028c829640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0288070f00 0x7f028815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.544+0000 7f028c829640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0288070f00 0x7f028815b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59354/0 (socket says 172.21.15.17:59354) 2023-08-09T12:54:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.544+0000 7f028c829640 1 -- 172.21.15.17:0/2030253600 learned_addr learned my addr 172.21.15.17:0/2030253600 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.544+0000 7f028c829640 1 -- 172.21.15.17:0/2030253600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028815bce0 msgr2=0x7f02880cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.544+0000 7f028c829640 1 --2- 172.21.15.17:0/2030253600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028815bce0 0x7f02880cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.544+0000 7f028c829640 1 -- 172.21.15.17:0/2030253600 >> v1:172.21.15.142:6789/0 conn(0x7f02881587e0 legacy=0x7f02880b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.544+0000 7f028c829640 1 -- 172.21.15.17:0/2030253600 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288071b80 con 0x7f0288070f00 2023-08-09T12:54:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.545+0000 7f028c829640 1 --2- 172.21.15.17:0/2030253600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288070f00 0x7f028815b7a0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f0278009870 tx=0x7f027802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476d295401b53e25 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.546+0000 7f027ffff640 1 -- 172.21.15.17:0/2030253600 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278031640 con 0x7f0288070f00 2023-08-09T12:54:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.546+0000 7f027ffff640 1 -- 172.21.15.17:0/2030253600 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02780317a0 con 0x7f0288070f00 2023-08-09T12:54:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.546+0000 7f027ffff640 1 -- 172.21.15.17:0/2030253600 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278031b30 con 0x7f0288070f00 2023-08-09T12:54:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.546+0000 7f028e02c640 1 -- 172.21.15.17:0/2030253600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288070f00 msgr2=0x7f028815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.546+0000 7f028e02c640 1 --2- 172.21.15.17:0/2030253600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288070f00 0x7f028815b7a0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f0278009870 tx=0x7f027802b8f0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.546+0000 7f028e02c640 1 -- 172.21.15.17:0/2030253600 shutdown_connections 2023-08-09T12:54:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.547+0000 7f028e02c640 1 --2- 172.21.15.17:0/2030253600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028815bce0 0x7f02880cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.547+0000 7f028e02c640 1 --2- 172.21.15.17:0/2030253600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288070f00 0x7f028815b7a0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.547+0000 7f028e02c640 1 -- 172.21.15.17:0/2030253600 >> 172.21.15.17:0/2030253600 conn(0x7f02880b1d50 msgr2=0x7f028806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.547+0000 7f028e02c640 1 -- 172.21.15.17:0/2030253600 shutdown_connections 2023-08-09T12:54:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.547+0000 7f028e02c640 1 -- 172.21.15.17:0/2030253600 wait complete. 2023-08-09T12:54:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.548+0000 7f028e02c640 1 Processor -- start 2023-08-09T12:54:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.549+0000 7f028e02c640 1 -- start start 2023-08-09T12:54:03.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.549+0000 7f028e02c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0288070f00 0x7f028814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.549+0000 7f028e02c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02881587e0 0x7f02880c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028e02c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880c6020 0x7f02880b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028e02c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028815c0d0 con 0x7f02881587e0 2023-08-09T12:54:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028e02c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028815c320 con 0x7f02880c6020 2023-08-09T12:54:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028e02c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028815c600 con 0x7f0288070f00 2023-08-09T12:54:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028c829640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02881587e0 0x7f02880c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028c829640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02881587e0 0x7f02880c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59356/0 (socket says 172.21.15.17:59356) 2023-08-09T12:54:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028c829640 1 -- 172.21.15.17:0/1643207707 learned_addr learned my addr 172.21.15.17:0/1643207707 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028d82b640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880c6020 0x7f02880b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028d02a640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0288070f00 0x7f028814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028c829640 1 -- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0288070f00 msgr2=0x7f028814dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028c829640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0288070f00 0x7f028814dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028c829640 1 -- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880c6020 msgr2=0x7f02880b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.550+0000 7f028c829640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880c6020 0x7f02880b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.551+0000 7f028c829640 1 -- 172.21.15.17:0/1643207707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02780094d0 con 0x7f02881587e0 2023-08-09T12:54:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.551+0000 7f028c829640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02881587e0 0x7f02880c5ae0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f0278009870 tx=0x7f02780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.551+0000 7f027dffb640 1 -- 172.21.15.17:0/1643207707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027803ac60 con 0x7f02881587e0 2023-08-09T12:54:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.551+0000 7f027dffb640 1 -- 172.21.15.17:0/1643207707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027803ade0 con 0x7f02881587e0 2023-08-09T12:54:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.551+0000 7f027dffb640 1 -- 172.21.15.17:0/1643207707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278044630 con 0x7f02881587e0 2023-08-09T12:54:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.551+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028815c8e0 con 0x7f02881587e0 2023-08-09T12:54:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.551+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028814e110 con 0x7f02881587e0 2023-08-09T12:54:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.552+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028806fa10 con 0x7f02881587e0 2023-08-09T12:54:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.553+0000 7f027dffb640 1 -- 172.21.15.17:0/1643207707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f027802f050 con 0x7f02881587e0 2023-08-09T12:54:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.554+0000 7f027dffb640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f026c06a050 0x7f026c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.554+0000 7f027dffb640 1 -- 172.21.15.17:0/1643207707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02780aa7f0 con 0x7f02881587e0 2023-08-09T12:54:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.555+0000 7f028d02a640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f026c06a050 0x7f026c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:03.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.556+0000 7f028d02a640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f026c06a050 0x7f026c06c510 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0284004ea0 tx=0x7f0284009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.559+0000 7f027dffb640 1 -- 172.21.15.17:0/1643207707 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f028806fa10 con 0x7f02881587e0 2023-08-09T12:54:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.768+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f028815ce00 con 0x7f02881587e0 2023-08-09T12:54:03.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.769+0000 7f027dffb640 1 -- 172.21.15.17:0/1643207707 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v194) v1 ==== 80+0+0 (secure 0 0 0) 0x7f028815ce00 con 0x7f02881587e0 2023-08-09T12:54:03.773 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:54:03.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f026c06a050 msgr2=0x7f026c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f026c06a050 0x7f026c06c510 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0284004ea0 tx=0x7f0284009040 comp rx=0 tx=0).stop 2023-08-09T12:54:03.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02881587e0 msgr2=0x7f02880c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:03.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02881587e0 0x7f02880c5ae0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f0278009870 tx=0x7f02780046c0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 shutdown_connections 2023-08-09T12:54:03.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f026c06a050 0x7f026c06c510 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02880c6020 0x7f02880b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02881587e0 0x7f02880c5ae0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 --2- 172.21.15.17:0/1643207707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0288070f00 0x7f028814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:03.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.772+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 >> 172.21.15.17:0/1643207707 conn(0x7f02880b1d50 msgr2=0x7f028806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:03.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.773+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 shutdown_connections 2023-08-09T12:54:03.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:03.773+0000 7f028e02c640 1 -- 172.21.15.17:0/1643207707 wait complete. 2023-08-09T12:54:03.794 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-09T12:54:03.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:03.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-09T12:54:03.977 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:54:03.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:03.977 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-09T12:54:04.025 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:54:04.026 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:04.075 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:54:04.076 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:04.172 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:54:04.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.414+0000 7f204704d640 1 Processor -- start 2023-08-09T12:54:04.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.415+0000 7f204704d640 1 -- start start 2023-08-09T12:54:04.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.416+0000 7f204704d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2040163c10 0x7f2040166000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.417+0000 7f204704d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204006c990 con 0x7f20400adc40 2023-08-09T12:54:04.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.417+0000 7f204704d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20400b2250 con 0x7f20400b3b40 2023-08-09T12:54:04.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.417+0000 7f204704d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20400ae020 con 0x7f2040163c10 2023-08-09T12:54:04.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.417+0000 7f20455ea640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2040163c10 0x7f2040166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.417+0000 7f2044de9640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f20400adc40 0x7f204006c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36310/0 (socket says 172.21.15.17:36310) 2023-08-09T12:54:04.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.417+0000 7f2044de9640 1 -- 172.21.15.17:0/263830595 learned_addr learned my addr 172.21.15.17:0/263830595 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:04.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.417+0000 7f20455ea640 1 -- 172.21.15.17:0/263830595 >> v1:172.21.15.142:6789/0 conn(0x7f20400b3b40 legacy=0x7f20400b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:04.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.417+0000 7f20455ea640 1 -- 172.21.15.17:0/263830595 >> v1:172.21.15.17:6789/0 conn(0x7f20400adc40 legacy=0x7f204006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.418+0000 7f20455ea640 1 -- 172.21.15.17:0/263830595 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400b2530 con 0x7f2040163c10 2023-08-09T12:54:04.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.419+0000 7f20455ea640 1 --2- 172.21.15.17:0/263830595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040163c10 0x7f2040166000 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f2038009d90 tx=0x7f203802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ba173323ac2fca server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:04.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.419+0000 7f203f7fe640 1 -- 172.21.15.17:0/263830595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203802cbd0 con 0x7f2040163c10 2023-08-09T12:54:04.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.419+0000 7f203f7fe640 1 -- 172.21.15.17:0/263830595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203802cd30 con 0x7f2040163c10 2023-08-09T12:54:04.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.419+0000 7f203f7fe640 1 -- 172.21.15.17:0/263830595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203802cea0 con 0x7f2040163c10 2023-08-09T12:54:04.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.420+0000 7f204704d640 1 -- 172.21.15.17:0/263830595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040163c10 msgr2=0x7f2040166000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.420+0000 7f204704d640 1 --2- 172.21.15.17:0/263830595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040163c10 0x7f2040166000 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f2038009d90 tx=0x7f203802be20 comp rx=0 tx=0).stop 2023-08-09T12:54:04.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.420+0000 7f204704d640 1 -- 172.21.15.17:0/263830595 shutdown_connections 2023-08-09T12:54:04.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.420+0000 7f204704d640 1 --2- 172.21.15.17:0/263830595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040163c10 0x7f2040166000 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.420+0000 7f204704d640 1 -- 172.21.15.17:0/263830595 >> 172.21.15.17:0/263830595 conn(0x7f20400cb1b0 msgr2=0x7f20400cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:04.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.420+0000 7f204704d640 1 -- 172.21.15.17:0/263830595 shutdown_connections 2023-08-09T12:54:04.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.420+0000 7f204704d640 1 -- 172.21.15.17:0/263830595 wait complete. 2023-08-09T12:54:04.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.422+0000 7f204704d640 1 Processor -- start 2023-08-09T12:54:04.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.422+0000 7f204704d640 1 -- start start 2023-08-09T12:54:04.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f204704d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20400adc40 0x7f204015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f204704d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20400b3b40 0x7f20401f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f204704d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2040163c10 0x7f2040145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f204704d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204015c7a0 con 0x7f20400adc40 2023-08-09T12:54:04.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f204704d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20401f4680 con 0x7f2040163c10 2023-08-09T12:54:04.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f204704d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20401f4960 con 0x7f20400b3b40 2023-08-09T12:54:04.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f2044de9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20400adc40 0x7f204015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f2044de9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20400adc40 0x7f204015d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59364/0 (socket says 172.21.15.17:59364) 2023-08-09T12:54:04.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.423+0000 7f2044de9640 1 -- 172.21.15.17:0/4261202412 learned_addr learned my addr 172.21.15.17:0/4261202412 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:04.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f2044de9640 1 -- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20400b3b40 msgr2=0x7f20401f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f20455ea640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2040163c10 0x7f2040145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f2044de9640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20400b3b40 0x7f20401f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f2044de9640 1 -- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2040163c10 msgr2=0x7f2040145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f2044de9640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2040163c10 0x7f2040145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f2044de9640 1 -- 172.21.15.17:0/4261202412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009a70 con 0x7f20400adc40 2023-08-09T12:54:04.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f2044de9640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20400adc40 0x7f204015d1b0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f203400c4a0 tx=0x7f203400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:04.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f203d7fa640 1 -- 172.21.15.17:0/4261202412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034005ce0 con 0x7f20400adc40 2023-08-09T12:54:04.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f203d7fa640 1 -- 172.21.15.17:0/4261202412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2034005e40 con 0x7f20400adc40 2023-08-09T12:54:04.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f203d7fa640 1 -- 172.21.15.17:0/4261202412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034007270 con 0x7f20400adc40 2023-08-09T12:54:04.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.424+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204015c9b0 con 0x7f20400adc40 2023-08-09T12:54:04.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.425+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204014c0d0 con 0x7f20400adc40 2023-08-09T12:54:04.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.426+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204015ced0 con 0x7f20400adc40 2023-08-09T12:54:04.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.426+0000 7f203d7fa640 1 -- 172.21.15.17:0/4261202412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2034007490 con 0x7f20400adc40 2023-08-09T12:54:04.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.427+0000 7f203d7fa640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f202406a050 0x7f202406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.427+0000 7f203d7fa640 1 -- 172.21.15.17:0/4261202412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2034087a70 con 0x7f20400adc40 2023-08-09T12:54:04.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.428+0000 7f203d7fa640 1 -- 172.21.15.17:0/4261202412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f20240721a0 con 0x7f20400adc40 2023-08-09T12:54:04.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.428+0000 7f203ffff640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f202406a050 0x7f202406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.429+0000 7f203ffff640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f202406a050 0x7f202406c510 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f204015b3f0 tx=0x7f202c007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:04.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.432+0000 7f203d7fa640 1 -- 172.21.15.17:0/4261202412 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2034017060 con 0x7f20400adc40 2023-08-09T12:54:04.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.626+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2040067a80 con 0x7f20400adc40 2023-08-09T12:54:04.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.628+0000 7f203d7fa640 1 -- 172.21.15.17:0/4261202412 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18297 (secure 0 0 0) 0x7f204015ced0 con 0x7f20400adc40 2023-08-09T12:54:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:04.633 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":195,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:54:03.984689+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:53:18.326271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-09T12:53:18.942904+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:54:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f202406a050 msgr2=0x7f202406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f202406a050 0x7f202406c510 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f204015b3f0 tx=0x7f202c007a00 comp rx=0 tx=0).stop 2023-08-09T12:54:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20400adc40 msgr2=0x7f204015d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20400adc40 0x7f204015d1b0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f203400c4a0 tx=0x7f203400c960 comp rx=0 tx=0).stop 2023-08-09T12:54:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 shutdown_connections 2023-08-09T12:54:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f202406a050 0x7f202406c510 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2040163c10 0x7f2040145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20400b3b40 0x7f20401f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 --2- 172.21.15.17:0/4261202412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20400adc40 0x7f204015d1b0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 >> 172.21.15.17:0/4261202412 conn(0x7f20400cb1b0 msgr2=0x7f20400c1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:04.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 shutdown_connections 2023-08-09T12:54:04.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.631+0000 7f204704d640 1 -- 172.21.15.17:0/4261202412 wait complete. 2023-08-09T12:54:04.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:53:18.326271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:53:18.942904+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:54:04.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:54:04.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.882+0000 7f3a19f49640 1 Processor -- start 2023-08-09T12:54:04.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.883+0000 7f3a19f49640 1 -- start start 2023-08-09T12:54:04.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.884+0000 7f3a19f49640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a1415a8c0 0x7f3a140b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.884+0000 7f3a19f49640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1415e7b0 con 0x7f3a140b0020 2023-08-09T12:54:04.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.885+0000 7f3a19f49640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140b1850 con 0x7f3a140b13f0 2023-08-09T12:54:04.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.885+0000 7f3a19f49640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1415e460 con 0x7f3a1415a8c0 2023-08-09T12:54:04.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.885+0000 7f3a18f47640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a1415a8c0 0x7f3a140b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.885+0000 7f3a19748640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3a140b0020 0x7f3a140c8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36316/0 (socket says 172.21.15.17:36316) 2023-08-09T12:54:04.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.885+0000 7f3a19748640 1 -- 172.21.15.17:0/2827098019 learned_addr learned my addr 172.21.15.17:0/2827098019 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:04.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.885+0000 7f3a18f47640 1 -- 172.21.15.17:0/2827098019 >> v1:172.21.15.142:6789/0 conn(0x7f3a140b13f0 legacy=0x7f3a1415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:04.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.885+0000 7f3a18f47640 1 -- 172.21.15.17:0/2827098019 >> v1:172.21.15.17:6789/0 conn(0x7f3a140b0020 legacy=0x7f3a140c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.885+0000 7f3a18f47640 1 -- 172.21.15.17:0/2827098019 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1415aca0 con 0x7f3a1415a8c0 2023-08-09T12:54:04.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.887+0000 7f3a18f47640 1 --2- 172.21.15.17:0/2827098019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1415a8c0 0x7f3a140b4170 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f3a080097a0 tx=0x7f3a0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d415a72c6466f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:04.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.887+0000 7f3a137fe640 1 -- 172.21.15.17:0/2827098019 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08031830 con 0x7f3a1415a8c0 2023-08-09T12:54:04.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.887+0000 7f3a137fe640 1 -- 172.21.15.17:0/2827098019 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08031990 con 0x7f3a1415a8c0 2023-08-09T12:54:04.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.887+0000 7f3a137fe640 1 -- 172.21.15.17:0/2827098019 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08031d20 con 0x7f3a1415a8c0 2023-08-09T12:54:04.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.887+0000 7f3a19f49640 1 -- 172.21.15.17:0/2827098019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1415a8c0 msgr2=0x7f3a140b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.887+0000 7f3a19f49640 1 --2- 172.21.15.17:0/2827098019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1415a8c0 0x7f3a140b4170 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f3a080097a0 tx=0x7f3a0802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.888+0000 7f3a19f49640 1 -- 172.21.15.17:0/2827098019 shutdown_connections 2023-08-09T12:54:04.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.888+0000 7f3a19f49640 1 --2- 172.21.15.17:0/2827098019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a1415a8c0 0x7f3a140b4170 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.888+0000 7f3a19f49640 1 -- 172.21.15.17:0/2827098019 >> 172.21.15.17:0/2827098019 conn(0x7f3a140cb020 msgr2=0x7f3a140cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:04.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.888+0000 7f3a19f49640 1 -- 172.21.15.17:0/2827098019 shutdown_connections 2023-08-09T12:54:04.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.888+0000 7f3a19f49640 1 -- 172.21.15.17:0/2827098019 wait complete. 2023-08-09T12:54:04.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.889+0000 7f3a19f49640 1 Processor -- start 2023-08-09T12:54:04.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.890+0000 7f3a19f49640 1 -- start start 2023-08-09T12:54:04.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.890+0000 7f3a19f49640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a140b0020 0x7f3a1414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a19f49640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a140b13f0 0x7f3a1415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a19f49640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1415a8c0 0x7f3a140c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a19f49640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140c2c30 con 0x7f3a140b13f0 2023-08-09T12:54:04.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a19f49640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140c4f40 con 0x7f3a1415a8c0 2023-08-09T12:54:04.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a19f49640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140c4c60 con 0x7f3a140b0020 2023-08-09T12:54:04.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a140b13f0 0x7f3a1415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a140b13f0 0x7f3a1415aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59376/0 (socket says 172.21.15.17:59376) 2023-08-09T12:54:04.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a13fff640 1 -- 172.21.15.17:0/3188020511 learned_addr learned my addr 172.21.15.17:0/3188020511 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:04.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a18f47640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a140b0020 0x7f3a1414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a19748640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1415a8c0 0x7f3a140c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a13fff640 1 -- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a140b0020 msgr2=0x7f3a1414fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a13fff640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a140b0020 0x7f3a1414fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a13fff640 1 -- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1415a8c0 msgr2=0x7f3a140c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a13fff640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1415a8c0 0x7f3a140c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.891+0000 7f3a13fff640 1 -- 172.21.15.17:0/3188020511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009400 con 0x7f3a140b13f0 2023-08-09T12:54:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.892+0000 7f3a13fff640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a140b13f0 0x7f3a1415aee0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c430 tx=0x7f3a0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.892+0000 7f3a117fa640 1 -- 172.21.15.17:0/3188020511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00011790 con 0x7f3a140b13f0 2023-08-09T12:54:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.892+0000 7f3a117fa640 1 -- 172.21.15.17:0/3188020511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a000118f0 con 0x7f3a140b13f0 2023-08-09T12:54:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.892+0000 7f3a117fa640 1 -- 172.21.15.17:0/3188020511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00011ce0 con 0x7f3a140b13f0 2023-08-09T12:54:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.892+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a140c2e60 con 0x7f3a140b13f0 2023-08-09T12:54:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.892+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a140c3420 con 0x7f3a140b13f0 2023-08-09T12:54:04.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.894+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1404e390 con 0x7f3a140b13f0 2023-08-09T12:54:04.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.895+0000 7f3a117fa640 1 -- 172.21.15.17:0/3188020511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3a0001c460 con 0x7f3a140b13f0 2023-08-09T12:54:04.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.896+0000 7f3a117fa640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f39f806a050 0x7f39f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:04.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.896+0000 7f3a117fa640 1 -- 172.21.15.17:0/3188020511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a000885a0 con 0x7f3a140b13f0 2023-08-09T12:54:04.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.896+0000 7f3a117fa640 1 -- 172.21.15.17:0/3188020511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f39f8072220 con 0x7f3a140b13f0 2023-08-09T12:54:04.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.896+0000 7f3a18f47640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f39f806a050 0x7f39f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:04.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.897+0000 7f3a18f47640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f39f806a050 0x7f39f806c510 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3a08036000 tx=0x7f3a0803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:04.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:04.900+0000 7f3a117fa640 1 -- 172.21.15.17:0/3188020511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3a00053bf0 con 0x7f3a140b13f0 2023-08-09T12:54:05.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.104+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a140cbd50 con 0x7f3a140b13f0 2023-08-09T12:54:05.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.105+0000 7f3a117fa640 1 -- 172.21.15.17:0/3188020511 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v195) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a00057210 con 0x7f3a140b13f0 2023-08-09T12:54:05.108 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:54:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f39f806a050 msgr2=0x7f39f806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f39f806a050 0x7f39f806c510 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3a08036000 tx=0x7f3a0803c040 comp rx=0 tx=0).stop 2023-08-09T12:54:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a140b13f0 msgr2=0x7f3a1415aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a140b13f0 0x7f3a1415aee0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c430 tx=0x7f3a0000c8f0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 shutdown_connections 2023-08-09T12:54:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f39f806a050 0x7f39f806c510 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1415a8c0 0x7f3a140c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a140b13f0 0x7f3a1415aee0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 --2- 172.21.15.17:0/3188020511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a140b0020 0x7f3a1414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.107+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 >> 172.21.15.17:0/3188020511 conn(0x7f3a140cb020 msgr2=0x7f3a14070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.108+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 shutdown_connections 2023-08-09T12:54:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.108+0000 7f3a19f49640 1 -- 172.21.15.17:0/3188020511 wait complete. 2023-08-09T12:54:05.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:54:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.339+0000 7f572759e640 1 Processor -- start 2023-08-09T12:54:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.339+0000 7f572759e640 1 -- start start 2023-08-09T12:54:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.341+0000 7f572759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f572815a8c0 0x7f57280b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.341+0000 7f572759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f57280b13f0 0x7f572815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.341+0000 7f572759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572815e7b0 con 0x7f572815f180 2023-08-09T12:54:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.341+0000 7f572759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57280b1850 con 0x7f572815a8c0 2023-08-09T12:54:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.341+0000 7f572759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572815e460 con 0x7f57280b13f0 2023-08-09T12:54:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.341+0000 7f5726d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f572815f180 0x7f57280b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36330/0 (socket says 172.21.15.17:36330) 2023-08-09T12:54:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.341+0000 7f5726d9d640 1 -- 172.21.15.17:0/3879560050 learned_addr learned my addr 172.21.15.17:0/3879560050 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.341+0000 7f572659c640 1 --2- 172.21.15.17:0/3879560050 >> v2:172.21.15.17:3300/0 conn(0x7f572815a8c0 0x7f57280b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.342+0000 7f571dd9b640 1 --2- 172.21.15.17:0/3879560050 >> v2:172.21.15.142:3300/0 conn(0x7f57280b13f0 0x7f572815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.342+0000 7f572659c640 1 -- 172.21.15.17:0/3879560050 >> v2:172.21.15.142:3300/0 conn(0x7f57280b13f0 msgr2=0x7f572815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.342+0000 7f572659c640 1 --2- 172.21.15.17:0/3879560050 >> v2:172.21.15.142:3300/0 conn(0x7f57280b13f0 0x7f572815ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.342+0000 7f572659c640 1 -- 172.21.15.17:0/3879560050 >> v1:172.21.15.17:6789/0 conn(0x7f572815f180 legacy=0x7f57280b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.342+0000 7f572659c640 1 -- 172.21.15.17:0/3879560050 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572815aca0 con 0x7f572815a8c0 2023-08-09T12:54:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.342+0000 7f5725d9b640 1 -- 172.21.15.17:0/3879560050 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983578702 0 0) 0x7f572815e7b0 con 0x7f572815f180 2023-08-09T12:54:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.343+0000 7f572659c640 1 --2- 172.21.15.17:0/3879560050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f57280b4170 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f572815e3c0 tx=0x7f571802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe16c5a119f17cc server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.343+0000 7f5725d9b640 1 -- 172.21.15.17:0/3879560050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718031830 con 0x7f572815a8c0 2023-08-09T12:54:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.343+0000 7f5725d9b640 1 -- 172.21.15.17:0/3879560050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718031990 con 0x7f572815a8c0 2023-08-09T12:54:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.343+0000 7f5725d9b640 1 -- 172.21.15.17:0/3879560050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718031d20 con 0x7f572815a8c0 2023-08-09T12:54:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.344+0000 7f572759e640 1 -- 172.21.15.17:0/3879560050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 msgr2=0x7f57280b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.344+0000 7f572759e640 1 --2- 172.21.15.17:0/3879560050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f57280b4170 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f572815e3c0 tx=0x7f571802b8d0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.344+0000 7f572759e640 1 -- 172.21.15.17:0/3879560050 shutdown_connections 2023-08-09T12:54:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.344+0000 7f572759e640 1 --2- 172.21.15.17:0/3879560050 >> v2:172.21.15.142:3300/0 conn(0x7f57280b13f0 0x7f572815ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.344+0000 7f572759e640 1 --2- 172.21.15.17:0/3879560050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f57280b4170 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.344+0000 7f572759e640 1 -- 172.21.15.17:0/3879560050 >> 172.21.15.17:0/3879560050 conn(0x7f57280cb020 msgr2=0x7f57280cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.344+0000 7f572759e640 1 -- 172.21.15.17:0/3879560050 shutdown_connections 2023-08-09T12:54:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.345+0000 7f572759e640 1 -- 172.21.15.17:0/3879560050 wait complete. 2023-08-09T12:54:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.346+0000 7f572759e640 1 Processor -- start 2023-08-09T12:54:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.346+0000 7f572759e640 1 -- start start 2023-08-09T12:54:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.347+0000 7f572759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57280b13f0 0x7f57280b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.347+0000 7f572759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f5728159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.347+0000 7f572759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f572815f180 0x7f57281f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.347+0000 7f572759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57281f3be0 con 0x7f572815a8c0 2023-08-09T12:54:05.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.347+0000 7f572759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57281ef9b0 con 0x7f57280b13f0 2023-08-09T12:54:05.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.347+0000 7f572759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57281f2fd0 con 0x7f572815f180 2023-08-09T12:54:05.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f571dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f5728159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f571dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f5728159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59394/0 (socket says 172.21.15.17:59394) 2023-08-09T12:54:05.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f571dd9b640 1 -- 172.21.15.17:0/757369135 learned_addr learned my addr 172.21.15.17:0/757369135 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:05.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f572659c640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57280b13f0 0x7f57280b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f571dd9b640 1 -- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f572815f180 msgr2=0x7f57281f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f571dd9b640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f572815f180 0x7f57281f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f571dd9b640 1 -- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57280b13f0 msgr2=0x7f57280b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f571dd9b640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57280b13f0 0x7f57280b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.348+0000 7f571dd9b640 1 -- 172.21.15.17:0/757369135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009400 con 0x7f572815a8c0 2023-08-09T12:54:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.349+0000 7f571dd9b640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f5728159360 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f571000d800 tx=0x7f571000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.349+0000 7f571f7fe640 1 -- 172.21.15.17:0/757369135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000b6c0 con 0x7f572815a8c0 2023-08-09T12:54:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.349+0000 7f571f7fe640 1 -- 172.21.15.17:0/757369135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000b820 con 0x7f572815a8c0 2023-08-09T12:54:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.349+0000 7f571f7fe640 1 -- 172.21.15.17:0/757369135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000bbb0 con 0x7f572815a8c0 2023-08-09T12:54:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.349+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57281f32b0 con 0x7f572815a8c0 2023-08-09T12:54:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.349+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57281f3870 con 0x7f572815a8c0 2023-08-09T12:54:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.350+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57281f3d90 con 0x7f572815a8c0 2023-08-09T12:54:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.351+0000 7f571f7fe640 1 -- 172.21.15.17:0/757369135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f571000bd10 con 0x7f572815a8c0 2023-08-09T12:54:05.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.352+0000 7f571f7fe640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f570806a080 0x7f570806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.352+0000 7f571f7fe640 1 -- 172.21.15.17:0/757369135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5710088b10 con 0x7f572815a8c0 2023-08-09T12:54:05.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.352+0000 7f571f7fe640 1 -- 172.21.15.17:0/757369135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f57080721d0 con 0x7f572815a8c0 2023-08-09T12:54:05.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.353+0000 7f572659c640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f570806a080 0x7f570806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.354+0000 7f572659c640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f570806a080 0x7f570806c540 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5718036000 tx=0x7f5718008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.357+0000 7f571f7fe640 1 -- 172.21.15.17:0/757369135 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f57281f3d90 con 0x7f572815a8c0 2023-08-09T12:54:05.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.557+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f572804e390 con 0x7f572815a8c0 2023-08-09T12:54:05.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.558+0000 7f571f7fe640 1 -- 172.21.15.17:0/757369135 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v195) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5710054160 con 0x7f572815a8c0 2023-08-09T12:54:05.561 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:54:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f570806a080 msgr2=0x7f570806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f570806a080 0x7f570806c540 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5718036000 tx=0x7f5718008030 comp rx=0 tx=0).stop 2023-08-09T12:54:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 msgr2=0x7f5728159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f5728159360 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f571000d800 tx=0x7f571000dcc0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 shutdown_connections 2023-08-09T12:54:05.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f570806a080 0x7f570806c540 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f572815f180 0x7f57281f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572815a8c0 0x7f5728159360 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 --2- 172.21.15.17:0/757369135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57280b13f0 0x7f57280b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 >> 172.21.15.17:0/757369135 conn(0x7f57280cb020 msgr2=0x7f57280cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:05.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 shutdown_connections 2023-08-09T12:54:05.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.561+0000 7f572759e640 1 -- 172.21.15.17:0/757369135 wait complete. 2023-08-09T12:54:05.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:54:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.794+0000 7fcea4c85640 1 Processor -- start 2023-08-09T12:54:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.794+0000 7fcea4c85640 1 -- start start 2023-08-09T12:54:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.795+0000 7fcea4c85640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcea015cef0 0x7fcea00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.795+0000 7fcea4c85640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 0x7fcea00ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.795+0000 7fcea4c85640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea00b2010 con 0x7fcea01616b0 2023-08-09T12:54:05.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.795+0000 7fcea4c85640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea00cdee0 con 0x7fcea015cef0 2023-08-09T12:54:05.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.795+0000 7fcea4c85640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea00b1d30 con 0x7fcea015d2d0 2023-08-09T12:54:05.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.796+0000 7fce9e59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcea015cef0 0x7fcea00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.796+0000 7fce9ed9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcea01616b0 0x7fcea00cf3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36344/0 (socket says 172.21.15.17:36344) 2023-08-09T12:54:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.796+0000 7fce9ed9d640 1 -- 172.21.15.17:0/3053919616 learned_addr learned my addr 172.21.15.17:0/3053919616 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.796+0000 7fce9dd9b640 1 --2- 172.21.15.17:0/3053919616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 0x7fcea00ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.796+0000 7fce9e59c640 1 -- 172.21.15.17:0/3053919616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 msgr2=0x7fcea00ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.796+0000 7fce9e59c640 1 --2- 172.21.15.17:0/3053919616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 0x7fcea00ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.796+0000 7fce9e59c640 1 -- 172.21.15.17:0/3053919616 >> v1:172.21.15.17:6789/0 conn(0x7fcea01616b0 legacy=0x7fcea00cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.797+0000 7fce9d59a640 1 -- 172.21.15.17:0/3053919616 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511968895 0 0) 0x7fcea00b2010 con 0x7fcea01616b0 2023-08-09T12:54:05.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.797+0000 7fce9e59c640 1 -- 172.21.15.17:0/3053919616 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea00cd820 con 0x7fcea015cef0 2023-08-09T12:54:05.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.798+0000 7fce9e59c640 1 --2- 172.21.15.17:0/3053919616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00b1750 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fce90009d90 tx=0x7fce9002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28df1cb87c31640e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:05.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.798+0000 7fce9d59a640 1 -- 172.21.15.17:0/3053919616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9002cb30 con 0x7fcea015cef0 2023-08-09T12:54:05.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.798+0000 7fce9d59a640 1 -- 172.21.15.17:0/3053919616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9002cc90 con 0x7fcea015cef0 2023-08-09T12:54:05.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.798+0000 7fce9d59a640 1 -- 172.21.15.17:0/3053919616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90034440 con 0x7fcea015cef0 2023-08-09T12:54:05.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.798+0000 7fcea4c85640 1 -- 172.21.15.17:0/3053919616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 msgr2=0x7fcea00b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.798+0000 7fcea4c85640 1 --2- 172.21.15.17:0/3053919616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00b1750 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fce90009d90 tx=0x7fce9002bd80 comp rx=0 tx=0).stop 2023-08-09T12:54:05.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.799+0000 7fcea4c85640 1 -- 172.21.15.17:0/3053919616 shutdown_connections 2023-08-09T12:54:05.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.799+0000 7fcea4c85640 1 --2- 172.21.15.17:0/3053919616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 0x7fcea00ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.799+0000 7fcea4c85640 1 --2- 172.21.15.17:0/3053919616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00b1750 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.799+0000 7fcea4c85640 1 -- 172.21.15.17:0/3053919616 >> 172.21.15.17:0/3053919616 conn(0x7fcea006fde0 msgr2=0x7fcea00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:05.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.799+0000 7fcea4c85640 1 -- 172.21.15.17:0/3053919616 shutdown_connections 2023-08-09T12:54:05.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.799+0000 7fcea4c85640 1 -- 172.21.15.17:0/3053919616 wait complete. 2023-08-09T12:54:05.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.801+0000 7fcea4c85640 1 Processor -- start 2023-08-09T12:54:05.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.801+0000 7fcea4c85640 1 -- start start 2023-08-09T12:54:05.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fcea4c85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fcea4c85640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 0x7fcea01f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fcea4c85640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcea01616b0 0x7fcea00b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fcea4c85640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea00c6ce0 con 0x7fcea015cef0 2023-08-09T12:54:05.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fcea4c85640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea00b3e40 con 0x7fcea01616b0 2023-08-09T12:54:05.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fcea4c85640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea015ec50 con 0x7fcea015d2d0 2023-08-09T12:54:05.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fce9e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fce9e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59422/0 (socket says 172.21.15.17:59422) 2023-08-09T12:54:05.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.802+0000 7fce9e59c640 1 -- 172.21.15.17:0/2348817997 learned_addr learned my addr 172.21.15.17:0/2348817997 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:05.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce9dd9b640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 0x7fcea01f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce9e59c640 1 -- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 msgr2=0x7fcea01f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce9e59c640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 0x7fcea01f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce9e59c640 1 -- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcea01616b0 msgr2=0x7fcea00b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce9e59c640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcea01616b0 0x7fcea00b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:05.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce9e59c640 1 -- 172.21.15.17:0/2348817997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90009a70 con 0x7fcea015cef0 2023-08-09T12:54:05.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce9e59c640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00c67a0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fce90009d90 tx=0x7fce90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:05.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce8effd640 1 -- 172.21.15.17:0/2348817997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90035e80 con 0x7fcea015cef0 2023-08-09T12:54:05.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce8effd640 1 -- 172.21.15.17:0/2348817997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce90009450 con 0x7fcea015cef0 2023-08-09T12:54:05.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea015ef30 con 0x7fcea015cef0 2023-08-09T12:54:05.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.803+0000 7fce8effd640 1 -- 172.21.15.17:0/2348817997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9003e840 con 0x7fcea015cef0 2023-08-09T12:54:05.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.804+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea015f4f0 con 0x7fcea015cef0 2023-08-09T12:54:05.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.805+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea0067a80 con 0x7fcea015cef0 2023-08-09T12:54:05.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.806+0000 7fce8effd640 1 -- 172.21.15.17:0/2348817997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce9003b050 con 0x7fcea015cef0 2023-08-09T12:54:05.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.807+0000 7fce8effd640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8006a050 0x7fce8006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.807+0000 7fce8effd640 1 -- 172.21.15.17:0/2348817997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce900aab50 con 0x7fcea015cef0 2023-08-09T12:54:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.807+0000 7fce8effd640 1 -- 172.21.15.17:0/2348817997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fce800721a0 con 0x7fcea015cef0 2023-08-09T12:54:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.807+0000 7fce9dd9b640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8006a050 0x7fce8006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.808+0000 7fce9dd9b640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8006a050 0x7fce8006c510 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcea015ebc0 tx=0x7fce94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:05.811+0000 7fce8effd640 1 -- 172.21.15.17:0/2348817997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fce900761a0 con 0x7fcea015cef0 2023-08-09T12:54:06.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.011+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcea00d0ae0 con 0x7fcea015cef0 2023-08-09T12:54:06.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.012+0000 7fce8effd640 1 -- 172.21.15.17:0/2348817997 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v195) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce9004d0a0 con 0x7fcea015cef0 2023-08-09T12:54:06.016 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:54:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8006a050 msgr2=0x7fce8006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8006a050 0x7fce8006c510 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcea015ebc0 tx=0x7fce94008040 comp rx=0 tx=0).stop 2023-08-09T12:54:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 msgr2=0x7fcea00c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00c67a0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fce90009d90 tx=0x7fce90004a40 comp rx=0 tx=0).stop 2023-08-09T12:54:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 shutdown_connections 2023-08-09T12:54:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fce8006a050 0x7fce8006c510 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcea01616b0 0x7fcea00b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcea015d2d0 0x7fcea01f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 --2- 172.21.15.17:0/2348817997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcea015cef0 0x7fcea00c67a0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 >> 172.21.15.17:0/2348817997 conn(0x7fcea006fde0 msgr2=0x7fcea00cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 shutdown_connections 2023-08-09T12:54:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.016+0000 7fcea4c85640 1 -- 172.21.15.17:0/2348817997 wait complete. 2023-08-09T12:54:06.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:54:06.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.266+0000 7f0b56364640 1 Processor -- start 2023-08-09T12:54:06.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.266+0000 7f0b56364640 1 -- start start 2023-08-09T12:54:06.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.268+0000 7f0b56364640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0b50161660 0x7f0b500ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.268+0000 7f0b56364640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b500acdf0 0x7f0b500cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.268+0000 7f0b56364640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b500ad240 con 0x7f0b50161280 2023-08-09T12:54:06.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.268+0000 7f0b56364640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5015d430 con 0x7f0b50161660 2023-08-09T12:54:06.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.268+0000 7f0b56364640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5015df30 con 0x7f0b500acdf0 2023-08-09T12:54:06.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.268+0000 7f0b4f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0b50161660 0x7f0b500ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.268+0000 7f0b4f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0b50161660 0x7f0b500ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59438/0 (socket says 172.21.15.17:59438) 2023-08-09T12:54:06.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.268+0000 7f0b4f7fe640 1 -- 172.21.15.17:0/422154107 learned_addr learned my addr 172.21.15.17:0/422154107 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:06.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.269+0000 7f0b4f7fe640 1 -- 172.21.15.17:0/422154107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b500acdf0 msgr2=0x7f0b500cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:06.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.269+0000 7f0b4f7fe640 1 --2- 172.21.15.17:0/422154107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b500acdf0 0x7f0b500cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.269+0000 7f0b4f7fe640 1 -- 172.21.15.17:0/422154107 >> v1:172.21.15.142:6789/0 conn(0x7f0b50161280 legacy=0x7f0b500c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:06.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.269+0000 7f0b4f7fe640 1 -- 172.21.15.17:0/422154107 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500ca9d0 con 0x7f0b50161660 2023-08-09T12:54:06.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.270+0000 7f0b4f7fe640 1 --2- 172.21.15.17:0/422154107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b50161660 0x7f0b500ac8b0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f0b5006ce30 tx=0x7f0b4402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eefad18f6dd2bcb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:06.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.270+0000 7f0b4effd640 1 -- 172.21.15.17:0/422154107 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44004230 con 0x7f0b50161660 2023-08-09T12:54:06.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b4effd640 1 -- 172.21.15.17:0/422154107 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44004390 con 0x7f0b50161660 2023-08-09T12:54:06.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b4effd640 1 -- 172.21.15.17:0/422154107 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44003810 con 0x7f0b50161660 2023-08-09T12:54:06.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b56364640 1 -- 172.21.15.17:0/422154107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b50161660 msgr2=0x7f0b500ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b56364640 1 --2- 172.21.15.17:0/422154107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b50161660 0x7f0b500ac8b0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f0b5006ce30 tx=0x7f0b4402b820 comp rx=0 tx=0).stop 2023-08-09T12:54:06.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b56364640 1 -- 172.21.15.17:0/422154107 shutdown_connections 2023-08-09T12:54:06.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b56364640 1 --2- 172.21.15.17:0/422154107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b500acdf0 0x7f0b500cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b56364640 1 --2- 172.21.15.17:0/422154107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b50161660 0x7f0b500ac8b0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b56364640 1 -- 172.21.15.17:0/422154107 >> 172.21.15.17:0/422154107 conn(0x7f0b500cb1b0 msgr2=0x7f0b500cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b56364640 1 -- 172.21.15.17:0/422154107 shutdown_connections 2023-08-09T12:54:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.271+0000 7f0b56364640 1 -- 172.21.15.17:0/422154107 wait complete. 2023-08-09T12:54:06.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.273+0000 7f0b56364640 1 Processor -- start 2023-08-09T12:54:06.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.273+0000 7f0b56364640 1 -- start start 2023-08-09T12:54:06.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.274+0000 7f0b56364640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b500acdf0 0x7f0b500c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.274+0000 7f0b56364640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b50161280 0x7f0b501422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.274+0000 7f0b56364640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b50161660 0x7f0b500b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.274+0000 7f0b56364640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500b2fc0 con 0x7f0b500acdf0 2023-08-09T12:54:06.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.274+0000 7f0b56364640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500b1890 con 0x7f0b50161660 2023-08-09T12:54:06.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.274+0000 7f0b56364640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500b3b00 con 0x7f0b50161280 2023-08-09T12:54:06.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.274+0000 7f0b4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b500acdf0 0x7f0b500c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b500acdf0 0x7f0b500c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59450/0 (socket says 172.21.15.17:59450) 2023-08-09T12:54:06.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4ffff640 1 -- 172.21.15.17:0/553331206 learned_addr learned my addr 172.21.15.17:0/553331206 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:06.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4ffff640 1 -- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b50161280 msgr2=0x7f0b501422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4ffff640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b50161280 0x7f0b501422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4ffff640 1 -- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b50161660 msgr2=0x7f0b500b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4ffff640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b50161660 0x7f0b500b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4ffff640 1 -- 172.21.15.17:0/553331206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44009460 con 0x7f0b500acdf0 2023-08-09T12:54:06.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4ffff640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b500acdf0 0x7f0b500c4c10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000b3f0 tx=0x7f0b4000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:06.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.275+0000 7f0b4cff9640 1 -- 172.21.15.17:0/553331206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40011830 con 0x7f0b500acdf0 2023-08-09T12:54:06.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.276+0000 7f0b4cff9640 1 -- 172.21.15.17:0/553331206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b40011990 con 0x7f0b500acdf0 2023-08-09T12:54:06.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.276+0000 7f0b4cff9640 1 -- 172.21.15.17:0/553331206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40011d40 con 0x7f0b500acdf0 2023-08-09T12:54:06.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.276+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b500b31d0 con 0x7f0b500acdf0 2023-08-09T12:54:06.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.276+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b500b3790 con 0x7f0b500acdf0 2023-08-09T12:54:06.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.277+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5015e3a0 con 0x7f0b500acdf0 2023-08-09T12:54:06.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.278+0000 7f0b4cff9640 1 -- 172.21.15.17:0/553331206 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b4001a400 con 0x7f0b500acdf0 2023-08-09T12:54:06.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.279+0000 7f0b4cff9640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b3c06a080 0x7f0b3c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.279+0000 7f0b4cff9640 1 -- 172.21.15.17:0/553331206 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b40088450 con 0x7f0b500acdf0 2023-08-09T12:54:06.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.279+0000 7f0b4cff9640 1 -- 172.21.15.17:0/553331206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f0b3c0721d0 con 0x7f0b500acdf0 2023-08-09T12:54:06.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.279+0000 7f0b4f7fe640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b3c06a080 0x7f0b3c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.281+0000 7f0b4f7fe640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b3c06a080 0x7f0b3c06c540 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0b44034000 tx=0x7f0b44030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:06.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.283+0000 7f0b4cff9640 1 -- 172.21.15.17:0/553331206 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0b5015e3a0 con 0x7f0b500acdf0 2023-08-09T12:54:06.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.477+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b5015e3a0 con 0x7f0b500acdf0 2023-08-09T12:54:06.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.478+0000 7f0b4cff9640 1 -- 172.21.15.17:0/553331206 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v195) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b5015e3a0 con 0x7f0b500acdf0 2023-08-09T12:54:06.481 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:54:06.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b3c06a080 msgr2=0x7f0b3c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b3c06a080 0x7f0b3c06c540 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0b44034000 tx=0x7f0b44030000 comp rx=0 tx=0).stop 2023-08-09T12:54:06.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b500acdf0 msgr2=0x7f0b500c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b500acdf0 0x7f0b500c4c10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000b3f0 tx=0x7f0b4000b8b0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 shutdown_connections 2023-08-09T12:54:06.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0b3c06a080 0x7f0b3c06c540 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b50161660 0x7f0b500b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b50161280 0x7f0b501422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 --2- 172.21.15.17:0/553331206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b500acdf0 0x7f0b500c4c10 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 >> 172.21.15.17:0/553331206 conn(0x7f0b500cb1b0 msgr2=0x7f0b500703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:06.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.481+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 shutdown_connections 2023-08-09T12:54:06.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.482+0000 7f0b56364640 1 -- 172.21.15.17:0/553331206 wait complete. 2023-08-09T12:54:06.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-09T12:54:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.736+0000 7fc14cb0f640 1 Processor -- start 2023-08-09T12:54:06.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.736+0000 7fc14cb0f640 1 -- start start 2023-08-09T12:54:06.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.737+0000 7fc14cb0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc148160030 0x7fc148160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.737+0000 7fc14cb0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480b86e0 0x7fc1480cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.737+0000 7fc14cb0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1480b5a30 con 0x7fc1480cf980 2023-08-09T12:54:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.737+0000 7fc14cb0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1480d1110 con 0x7fc148160030 2023-08-09T12:54:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.737+0000 7fc14cb0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480ceac0 con 0x7fc1480b86e0 2023-08-09T12:54:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.738+0000 7fc1477fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc148160030 0x7fc148160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.738+0000 7fc146ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480b86e0 0x7fc1480cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.738+0000 7fc1477fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc148160030 0x7fc148160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.17:50254/0 (socket says 172.21.15.17:50254) 2023-08-09T12:54:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.738+0000 7fc1477fe640 1 -- 172.21.15.17:0/2430173716 learned_addr learned my addr 172.21.15.17:0/2430173716 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.738+0000 7fc147fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc1480cf980 0x7fc1480b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:57022/0 (socket says 172.21.15.17:57022) 2023-08-09T12:54:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.739+0000 7fc1477fe640 1 -- 172.21.15.17:0/2430173716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480b86e0 msgr2=0x7fc1480cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.739+0000 7fc1477fe640 1 --2- 172.21.15.17:0/2430173716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480b86e0 0x7fc1480cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.739+0000 7fc1477fe640 1 -- 172.21.15.17:0/2430173716 >> v1:172.21.15.142:6789/0 conn(0x7fc1480cf980 legacy=0x7fc1480b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.739+0000 7fc1477fe640 1 -- 172.21.15.17:0/2430173716 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1480d0d70 con 0x7fc148160030 2023-08-09T12:54:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.741+0000 7fc1477fe640 1 --2- 172.21.15.17:0/2430173716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc148160030 0x7fc148160740 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc130009870 tx=0x7fc13002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cc64863085c5741 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.741+0000 7fc1467fc640 1 -- 172.21.15.17:0/2430173716 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130030840 con 0x7fc148160030 2023-08-09T12:54:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc1467fc640 1 -- 172.21.15.17:0/2430173716 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1300309a0 con 0x7fc148160030 2023-08-09T12:54:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc1467fc640 1 -- 172.21.15.17:0/2430173716 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130030d30 con 0x7fc148160030 2023-08-09T12:54:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc14cb0f640 1 -- 172.21.15.17:0/2430173716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc148160030 msgr2=0x7fc148160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/2430173716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc148160030 0x7fc148160740 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc130009870 tx=0x7fc13002b980 comp rx=0 tx=0).stop 2023-08-09T12:54:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc14cb0f640 1 -- 172.21.15.17:0/2430173716 shutdown_connections 2023-08-09T12:54:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/2430173716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480b86e0 0x7fc1480cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/2430173716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc148160030 0x7fc148160740 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc14cb0f640 1 -- 172.21.15.17:0/2430173716 >> 172.21.15.17:0/2430173716 conn(0x7fc1480697c0 msgr2=0x7fc148069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc14cb0f640 1 -- 172.21.15.17:0/2430173716 shutdown_connections 2023-08-09T12:54:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.742+0000 7fc14cb0f640 1 -- 172.21.15.17:0/2430173716 wait complete. 2023-08-09T12:54:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.744+0000 7fc14cb0f640 1 Processor -- start 2023-08-09T12:54:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.744+0000 7fc14cb0f640 1 -- start start 2023-08-09T12:54:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.745+0000 7fc14cb0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1480b86e0 0x7fc14815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.745+0000 7fc14cb0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480cf980 0x7fc1480aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.745+0000 7fc14cb0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148160030 0x7fc1480aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.745+0000 7fc14cb0f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14815a8c0 con 0x7fc148160030 2023-08-09T12:54:06.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.745+0000 7fc14cb0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480aab80 con 0x7fc1480b86e0 2023-08-09T12:54:06.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.745+0000 7fc14cb0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1481f42b0 con 0x7fc1480cf980 2023-08-09T12:54:06.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc147fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148160030 0x7fc1480aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc147fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148160030 0x7fc1480aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59458/0 (socket says 172.21.15.17:59458) 2023-08-09T12:54:06.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc147fff640 1 -- 172.21.15.17:0/288727552 learned_addr learned my addr 172.21.15.17:0/288727552 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:06.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc146ffd640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480cf980 0x7fc1480aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc1477fe640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1480b86e0 0x7fc14815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc147fff640 1 -- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480cf980 msgr2=0x7fc1480aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc147fff640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480cf980 0x7fc1480aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc147fff640 1 -- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1480b86e0 msgr2=0x7fc14815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc147fff640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1480b86e0 0x7fc14815a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.746+0000 7fc147fff640 1 -- 172.21.15.17:0/288727552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300094d0 con 0x7fc148160030 2023-08-09T12:54:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.747+0000 7fc147fff640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148160030 0x7fc1480aa640 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c400 tx=0x7fc14000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.747+0000 7fc13ffff640 1 -- 172.21.15.17:0/288727552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400074e0 con 0x7fc148160030 2023-08-09T12:54:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.747+0000 7fc13ffff640 1 -- 172.21.15.17:0/288727552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc140007640 con 0x7fc148160030 2023-08-09T12:54:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.747+0000 7fc13ffff640 1 -- 172.21.15.17:0/288727552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400049e0 con 0x7fc148160030 2023-08-09T12:54:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.747+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1480a9550 con 0x7fc148160030 2023-08-09T12:54:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.747+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1481f36a0 con 0x7fc148160030 2023-08-09T12:54:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.748+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14804e390 con 0x7fc148160030 2023-08-09T12:54:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.749+0000 7fc13ffff640 1 -- 172.21.15.17:0/288727552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc140004b40 con 0x7fc148160030 2023-08-09T12:54:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.750+0000 7fc13ffff640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12806a080 0x7fc12806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.750+0000 7fc13ffff640 1 -- 172.21.15.17:0/288727552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc140087fd0 con 0x7fc148160030 2023-08-09T12:54:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.750+0000 7fc13ffff640 1 -- 172.21.15.17:0/288727552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fc1280721d0 con 0x7fc148160030 2023-08-09T12:54:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.751+0000 7fc1477fe640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12806a080 0x7fc12806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.752+0000 7fc1477fe640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12806a080 0x7fc12806c540 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc130036000 tx=0x7fc13003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.755+0000 7fc13ffff640 1 -- 172.21.15.17:0/288727552 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fc1400536b0 con 0x7fc148160030 2023-08-09T12:54:06.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.963+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1480d0640 con 0x7fc148160030 2023-08-09T12:54:06.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.964+0000 7fc13ffff640 1 -- 172.21.15.17:0/288727552 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v195) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc140056cd0 con 0x7fc148160030 2023-08-09T12:54:06.968 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-08-09T12:54:06.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.966+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12806a080 msgr2=0x7fc12806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.966+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12806a080 0x7fc12806c540 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc130036000 tx=0x7fc13003b040 comp rx=0 tx=0).stop 2023-08-09T12:54:06.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.966+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148160030 msgr2=0x7fc1480aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:06.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.966+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148160030 0x7fc1480aa640 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c400 tx=0x7fc14000c8c0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.967+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 shutdown_connections 2023-08-09T12:54:06.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.967+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc12806a080 0x7fc12806c540 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.967+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148160030 0x7fc1480aa640 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.967+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1480cf980 0x7fc1480aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.967+0000 7fc14cb0f640 1 --2- 172.21.15.17:0/288727552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1480b86e0 0x7fc14815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:06.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.967+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 >> 172.21.15.17:0/288727552 conn(0x7fc1480697c0 msgr2=0x7fc14815db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:06.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.967+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 shutdown_connections 2023-08-09T12:54:06.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:06.967+0000 7fc14cb0f640 1 -- 172.21.15.17:0/288727552 wait complete. 2023-08-09T12:54:06.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-09T12:54:06.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:06.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-09T12:54:07.123 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:54:07.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:07.124 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-09T12:54:07.174 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:54:07.175 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:07.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:54:07.245 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:54:07.245 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:07.304 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:54:07.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:54:07.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.533+0000 7fd6fff01640 1 Processor -- start 2023-08-09T12:54:07.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.534+0000 7fd6fff01640 1 -- start start 2023-08-09T12:54:07.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.535+0000 7fd6fff01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f815ce90 0x7fd6f81616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:07.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.535+0000 7fd6fff01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6f80d29d0 0x7fd6f80d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:07.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.535+0000 7fd6fff01640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f80b6460 con 0x7fd6f80b6000 2023-08-09T12:54:07.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.535+0000 7fd6fff01640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f80d33a0 con 0x7fd6f80d29d0 2023-08-09T12:54:07.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.535+0000 7fd6fff01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80cdd10 con 0x7fd6f815ce90 2023-08-09T12:54:07.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.536+0000 7fd6fd49c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd6f80b6000 0x7fd6f80cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36356/0 (socket says 172.21.15.17:36356) 2023-08-09T12:54:07.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.536+0000 7fd6fd49c640 1 -- 172.21.15.17:0/590188387 learned_addr learned my addr 172.21.15.17:0/590188387 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:07.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.536+0000 7fd6fe49e640 1 --2- 172.21.15.17:0/590188387 >> v2:172.21.15.17:3300/0 conn(0x7fd6f80d29d0 0x7fd6f80d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:07.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.536+0000 7fd6fdc9d640 1 --2- 172.21.15.17:0/590188387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f815ce90 0x7fd6f81616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:07.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.536+0000 7fd6fe49e640 1 -- 172.21.15.17:0/590188387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f815ce90 msgr2=0x7fd6f81616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:07.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.536+0000 7fd6fe49e640 1 --2- 172.21.15.17:0/590188387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f815ce90 0x7fd6f81616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.536+0000 7fd6fe49e640 1 -- 172.21.15.17:0/590188387 >> v1:172.21.15.17:6789/0 conn(0x7fd6f80b6000 legacy=0x7fd6f80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:07.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.536+0000 7fd6fe49e640 1 -- 172.21.15.17:0/590188387 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80cdff0 con 0x7fd6f80d29d0 2023-08-09T12:54:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.538+0000 7fd6fe49e640 1 --2- 172.21.15.17:0/590188387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80d2e60 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009d90 tx=0x7fd6f002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440a5d13f8a1702c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.538+0000 7fd6fcc9b640 1 -- 172.21.15.17:0/590188387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f002cc50 con 0x7fd6f80d29d0 2023-08-09T12:54:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.538+0000 7fd6fcc9b640 1 -- 172.21.15.17:0/590188387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f002cdb0 con 0x7fd6f80d29d0 2023-08-09T12:54:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.538+0000 7fd6fcc9b640 1 -- 172.21.15.17:0/590188387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0034660 con 0x7fd6f80d29d0 2023-08-09T12:54:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.539+0000 7fd6fff01640 1 -- 172.21.15.17:0/590188387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 msgr2=0x7fd6f80d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.539+0000 7fd6fff01640 1 --2- 172.21.15.17:0/590188387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80d2e60 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009d90 tx=0x7fd6f002bea0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.539+0000 7fd6fff01640 1 -- 172.21.15.17:0/590188387 shutdown_connections 2023-08-09T12:54:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.539+0000 7fd6fff01640 1 --2- 172.21.15.17:0/590188387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80d2e60 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.539+0000 7fd6fff01640 1 --2- 172.21.15.17:0/590188387 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f815ce90 0x7fd6f81616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.539+0000 7fd6fff01640 1 -- 172.21.15.17:0/590188387 >> 172.21.15.17:0/590188387 conn(0x7fd6f806fde0 msgr2=0x7fd6f80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.539+0000 7fd6fff01640 1 -- 172.21.15.17:0/590188387 shutdown_connections 2023-08-09T12:54:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.539+0000 7fd6fff01640 1 -- 172.21.15.17:0/590188387 wait complete. 2023-08-09T12:54:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.541+0000 7fd6fff01640 1 Processor -- start 2023-08-09T12:54:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.541+0000 7fd6fff01640 1 -- start start 2023-08-09T12:54:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fff01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f80b6000 0x7fd6f80cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fff01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fff01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f815ce90 0x7fd6f80c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fff01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80cac30 con 0x7fd6f80d29d0 2023-08-09T12:54:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fff01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80ccc00 con 0x7fd6f815ce90 2023-08-09T12:54:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fff01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80cbb60 con 0x7fd6f80b6000 2023-08-09T12:54:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fd49c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fd49c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59470/0 (socket says 172.21.15.17:59470) 2023-08-09T12:54:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fd49c640 1 -- 172.21.15.17:0/103263889 learned_addr learned my addr 172.21.15.17:0/103263889 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fdc9d640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f80b6000 0x7fd6f80cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.542+0000 7fd6fd49c640 1 -- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f80b6000 msgr2=0x7fd6f80cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6fd49c640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f80b6000 0x7fd6f80cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6fd49c640 1 -- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f815ce90 msgr2=0x7fd6f80c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6fd49c640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f815ce90 0x7fd6f80c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6fd49c640 1 -- 172.21.15.17:0/103263889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0009a70 con 0x7fd6f80d29d0 2023-08-09T12:54:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6fdc9d640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f80b6000 0x7fd6f80cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6fd49c640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80ca6f0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c4a0 tx=0x7fd6e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6ee7fc640 1 -- 172.21.15.17:0/103263889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8005ce0 con 0x7fd6f80d29d0 2023-08-09T12:54:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6ee7fc640 1 -- 172.21.15.17:0/103263889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8005e40 con 0x7fd6f80d29d0 2023-08-09T12:54:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6ee7fc640 1 -- 172.21.15.17:0/103263889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8007270 con 0x7fd6f80d29d0 2023-08-09T12:54:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f80cbe40 con 0x7fd6f80d29d0 2023-08-09T12:54:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.543+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f80cc400 con 0x7fd6f80d29d0 2023-08-09T12:54:07.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.545+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f8067a80 con 0x7fd6f80d29d0 2023-08-09T12:54:07.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.545+0000 7fd6ee7fc640 1 -- 172.21.15.17:0/103263889 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd6e80073d0 con 0x7fd6f80d29d0 2023-08-09T12:54:07.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.546+0000 7fd6ee7fc640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6dc06a050 0x7fd6dc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:07.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.546+0000 7fd6ee7fc640 1 -- 172.21.15.17:0/103263889 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6e8087a80 con 0x7fd6f80d29d0 2023-08-09T12:54:07.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.547+0000 7fd6ee7fc640 1 -- 172.21.15.17:0/103263889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fd6dc0721a0 con 0x7fd6f80d29d0 2023-08-09T12:54:07.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.547+0000 7fd6fdc9d640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6dc06a050 0x7fd6dc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:07.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.548+0000 7fd6fdc9d640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6dc06a050 0x7fd6dc06c510 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4006fd0 tx=0x7fd6f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:07.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.551+0000 7fd6ee7fc640 1 -- 172.21.15.17:0/103263889 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd6e8017060 con 0x7fd6f80d29d0 2023-08-09T12:54:07.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.786+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6f80ce2a0 con 0x7fd6f80d29d0 2023-08-09T12:54:07.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.788+0000 7fd6ee7fc640 1 -- 172.21.15.17:0/103263889 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7fd6e8053180 con 0x7fd6f80d29d0 2023-08-09T12:54:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:07.791 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:54:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:54:07.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.790+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6dc06a050 msgr2=0x7fd6dc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:07.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.790+0000 7fd6fff01640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6dc06a050 0x7fd6dc06c510 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4006fd0 tx=0x7fd6f4008040 comp rx=0 tx=0).stop 2023-08-09T12:54:07.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.790+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 msgr2=0x7fd6f80ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:07.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.790+0000 7fd6fff01640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80ca6f0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c4a0 tx=0x7fd6e800c960 comp rx=0 tx=0).stop 2023-08-09T12:54:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.791+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 shutdown_connections 2023-08-09T12:54:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.791+0000 7fd6fff01640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd6dc06a050 0x7fd6dc06c510 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.791+0000 7fd6fff01640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f815ce90 0x7fd6f80c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.791+0000 7fd6fff01640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6f80d29d0 0x7fd6f80ca6f0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.791+0000 7fd6fff01640 1 --2- 172.21.15.17:0/103263889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f80b6000 0x7fd6f80cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:07.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.791+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 >> 172.21.15.17:0/103263889 conn(0x7fd6f806fde0 msgr2=0x7fd6f81582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:07.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.791+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 shutdown_connections 2023-08-09T12:54:07.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:07.791+0000 7fd6fff01640 1 -- 172.21.15.17:0/103263889 wait complete. 2023-08-09T12:54:07.814 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:54:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.031+0000 7fd835786640 1 Processor -- start 2023-08-09T12:54:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.031+0000 7fd835786640 1 -- start start 2023-08-09T12:54:08.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.033+0000 7fd835786640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd830159d80 0x7fd8300b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.033+0000 7fd835786640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300ad810 0x7fd830070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.033+0000 7fd835786640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd830070d20 con 0x7fd8300708c0 2023-08-09T12:54:08.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.033+0000 7fd835786640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83015a160 con 0x7fd830159d80 2023-08-09T12:54:08.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.033+0000 7fd835786640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300b4630 con 0x7fd8300ad810 2023-08-09T12:54:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.033+0000 7fd82f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd8300708c0 0x7fd83006eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53874/0 (socket says 172.21.15.17:53874) 2023-08-09T12:54:08.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.033+0000 7fd82f7fe640 1 -- 172.21.15.17:0/3208092020 learned_addr learned my addr 172.21.15.17:0/3208092020 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:08.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82e7fc640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300ad810 0x7fd830070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017469018 0 0) 0x7fd830070d20 con 0x7fd8300708c0 2023-08-09T12:54:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82effd640 1 --2- 172.21.15.17:0/3208092020 >> v2:172.21.15.142:3300/0 conn(0x7fd830159d80 0x7fd8300b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd818005730 con 0x7fd8300708c0 2023-08-09T12:54:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999901261 0 0) 0x7fd818005730 con 0x7fd8300708c0 2023-08-09T12:54:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300ad810 msgr2=0x7fd830070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300ad810 0x7fd830070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 >> v2:172.21.15.142:3300/0 conn(0x7fd830159d80 msgr2=0x7fd8300b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 --2- 172.21.15.17:0/3208092020 >> v2:172.21.15.142:3300/0 conn(0x7fd830159d80 0x7fd8300b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300b3ab0 con 0x7fd8300708c0 2023-08-09T12:54:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fd8280019f0 con 0x7fd8300708c0 2023-08-09T12:54:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.034+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 >> v1:172.21.15.17:6789/0 conn(0x7fd8300708c0 legacy=0x7fd83006eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82dffb640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300ad810 0x7fd818005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82dffb640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8180060c0 0x7fd8180069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82dffb640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd818006f10 0x7fd818007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83015a160 con 0x7fd818006f10 2023-08-09T12:54:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300b4630 con 0x7fd8180060c0 2023-08-09T12:54:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd818006820 con 0x7fd8300ad810 2023-08-09T12:54:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82f7fe640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd818006f10 0x7fd818007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82effd640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300ad810 0x7fd818005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82f7fe640 1 -- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300ad810 msgr2=0x7fd818005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82f7fe640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300ad810 0x7fd818005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82f7fe640 1 -- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8180060c0 msgr2=0x7fd8180069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82f7fe640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8180060c0 0x7fd8180069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.035+0000 7fd82f7fe640 1 -- 172.21.15.17:0/3208092020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818005730 con 0x7fd818006f10 2023-08-09T12:54:08.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.036+0000 7fd82f7fe640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd818006f10 0x7fd818007390 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fd82800a790 tx=0x7fd818007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ceca85616a470a server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.037+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828034630 con 0x7fd818006f10 2023-08-09T12:54:08.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.037+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82802f070 con 0x7fd818006f10 2023-08-09T12:54:08.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.037+0000 7fd82dffb640 1 -- 172.21.15.17:0/3208092020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828034a30 con 0x7fd818006f10 2023-08-09T12:54:08.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.037+0000 7fd835786640 1 -- 172.21.15.17:0/3208092020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd818006f10 msgr2=0x7fd818007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.037+0000 7fd835786640 1 --2- 172.21.15.17:0/3208092020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd818006f10 0x7fd818007390 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fd82800a790 tx=0x7fd818007a00 comp rx=0 tx=0).stop 2023-08-09T12:54:08.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.037+0000 7fd82f7fe640 1 -- 172.21.15.17:0/3208092020 reap_dead start 2023-08-09T12:54:08.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.037+0000 7fd835786640 1 -- 172.21.15.17:0/3208092020 shutdown_connections 2023-08-09T12:54:08.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.037+0000 7fd835786640 1 -- 172.21.15.17:0/3208092020 >> 172.21.15.17:0/3208092020 conn(0x7fd8300cb1b0 msgr2=0x7fd8300cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:08.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.038+0000 7fd835786640 1 -- 172.21.15.17:0/3208092020 shutdown_connections 2023-08-09T12:54:08.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.038+0000 7fd835786640 1 -- 172.21.15.17:0/3208092020 wait complete. 2023-08-09T12:54:08.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.039+0000 7fd835786640 1 Processor -- start 2023-08-09T12:54:08.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.040+0000 7fd835786640 1 -- start start 2023-08-09T12:54:08.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd835786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd818006f10 0x7fd8300c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd835786640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300c3df0 0x7fd8300c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd835786640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8300c4270 0x7fd8300c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd835786640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c8760 con 0x7fd8300c4270 2023-08-09T12:54:08.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd835786640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c2750 con 0x7fd818006f10 2023-08-09T12:54:08.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd835786640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c81a0 con 0x7fd8300c3df0 2023-08-09T12:54:08.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8300c4270 0x7fd8300c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8300c4270 0x7fd8300c2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46810/0 (socket says 172.21.15.17:46810) 2023-08-09T12:54:08.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82f7fe640 1 -- 172.21.15.17:0/2296379747 learned_addr learned my addr 172.21.15.17:0/2296379747 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:08.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82e7fc640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300c3df0 0x7fd8300c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82effd640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd818006f10 0x7fd8300c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82f7fe640 1 -- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300c3df0 msgr2=0x7fd8300c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82f7fe640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300c3df0 0x7fd8300c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82f7fe640 1 -- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd818006f10 msgr2=0x7fd8300c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82f7fe640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd818006f10 0x7fd8300c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.041+0000 7fd82f7fe640 1 -- 172.21.15.17:0/2296379747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300c8480 con 0x7fd8300c4270 2023-08-09T12:54:08.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.042+0000 7fd82f7fe640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8300c4270 0x7fd8300c2b70 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fd82802cad0 tx=0x7fd828001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.042+0000 7fd8177fe640 1 -- 172.21.15.17:0/2296379747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828001f00 con 0x7fd8300c4270 2023-08-09T12:54:08.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.042+0000 7fd8177fe640 1 -- 172.21.15.17:0/2296379747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd828034640 con 0x7fd8300c4270 2023-08-09T12:54:08.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.042+0000 7fd8177fe640 1 -- 172.21.15.17:0/2296379747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8280349b0 con 0x7fd8300c4270 2023-08-09T12:54:08.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.042+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8300c2370 con 0x7fd8300c4270 2023-08-09T12:54:08.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.042+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8300c7c90 con 0x7fd8300c4270 2023-08-09T12:54:08.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.043+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8300c21d0 con 0x7fd8300c4270 2023-08-09T12:54:08.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.044+0000 7fd8177fe640 1 -- 172.21.15.17:0/2296379747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd828031030 con 0x7fd8300c4270 2023-08-09T12:54:08.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.046+0000 7fd8177fe640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd81c06a050 0x7fd81c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.046+0000 7fd8177fe640 1 -- 172.21.15.17:0/2296379747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd8280aa890 con 0x7fd8300c4270 2023-08-09T12:54:08.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.046+0000 7fd8177fe640 1 -- 172.21.15.17:0/2296379747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fd81c0721a0 con 0x7fd8300c4270 2023-08-09T12:54:08.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.046+0000 7fd82effd640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd81c06a050 0x7fd81c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.047+0000 7fd82effd640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd81c06a050 0x7fd81c06c510 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd820006fd0 tx=0x7fd820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.050+0000 7fd8177fe640 1 -- 172.21.15.17:0/2296379747 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd8300c21d0 con 0x7fd8300c4270 2023-08-09T12:54:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.240+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8300c2890 con 0x7fd8300c4270 2023-08-09T12:54:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.242+0000 7fd8177fe640 1 -- 172.21.15.17:0/2296379747 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18297 (secure 0 0 0) 0x7fd8300c2890 con 0x7fd8300c4270 2023-08-09T12:54:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":195,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:54:03.984689+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:53:18.326271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-09T12:53:18.942904+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:54:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd81c06a050 msgr2=0x7fd81c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd81c06a050 0x7fd81c06c510 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd820006fd0 tx=0x7fd820008040 comp rx=0 tx=0).stop 2023-08-09T12:54:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8300c4270 msgr2=0x7fd8300c2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8300c4270 0x7fd8300c2b70 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fd82802cad0 tx=0x7fd828001cb0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 shutdown_connections 2023-08-09T12:54:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd81c06a050 0x7fd81c06c510 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8300c4270 0x7fd8300c2b70 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8300c3df0 0x7fd8300c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 --2- 172.21.15.17:0/2296379747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd818006f10 0x7fd8300c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 >> 172.21.15.17:0/2296379747 conn(0x7fd8300cb1b0 msgr2=0x7fd83006f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:08.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 shutdown_connections 2023-08-09T12:54:08.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.245+0000 7fd835786640 1 -- 172.21.15.17:0/2296379747 wait complete. 2023-08-09T12:54:08.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-09T12:39:12.706671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-09T12:39:17.365312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-09T12:53:18.326271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-09T12:53:18.942904+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-09T12:54:08.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-09T12:54:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.493+0000 7fbb14779640 1 Processor -- start 2023-08-09T12:54:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.493+0000 7fbb14779640 1 -- start start 2023-08-09T12:54:08.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb14779640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbb0c15ce90 0x7fbb0c1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb14779640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 0x7fbb0c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb14779640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb0c0d29d0 0x7fbb0c0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb14779640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c0d33a0 con 0x7fbb0c15ce90 2023-08-09T12:54:08.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb14779640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b6460 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb14779640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0cda40 con 0x7fbb0c0b6000 2023-08-09T12:54:08.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb12515640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbb0c15ce90 0x7fbb0c1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb12515640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbb0c15ce90 0x7fbb0c1616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46822/0 (socket says 172.21.15.17:46822) 2023-08-09T12:54:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb12515640 1 -- 172.21.15.17:0/2461141290 learned_addr learned my addr 172.21.15.17:0/2461141290 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb11d14640 1 --2- 172.21.15.17:0/2461141290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 0x7fbb0c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.495+0000 7fbb12d16640 1 --2- 172.21.15.17:0/2461141290 >> v2:172.21.15.142:3300/0 conn(0x7fbb0c0d29d0 0x7fbb0c0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.496+0000 7fbb12515640 1 -- 172.21.15.17:0/2461141290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 msgr2=0x7fbb0c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.496+0000 7fbb12515640 1 --2- 172.21.15.17:0/2461141290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 0x7fbb0c0cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.496+0000 7fbb12515640 1 -- 172.21.15.17:0/2461141290 >> v2:172.21.15.142:3300/0 conn(0x7fbb0c0d29d0 msgr2=0x7fbb0c0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.496+0000 7fbb12515640 1 --2- 172.21.15.17:0/2461141290 >> v2:172.21.15.142:3300/0 conn(0x7fbb0c0d29d0 0x7fbb0c0d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.496+0000 7fbb12515640 1 -- 172.21.15.17:0/2461141290 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0cdd10 con 0x7fbb0c15ce90 2023-08-09T12:54:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.497+0000 7fbb12515640 1 --2- 172.21.15.17:0/2461141290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c15ce90 0x7fbb0c1616e0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0d0a70 tx=0x7fbb0802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fad21d68068156 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.497+0000 7fbb11513640 1 -- 172.21.15.17:0/2461141290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb08031860 con 0x7fbb0c15ce90 2023-08-09T12:54:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.497+0000 7fbb11513640 1 -- 172.21.15.17:0/2461141290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb080319c0 con 0x7fbb0c15ce90 2023-08-09T12:54:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.497+0000 7fbb11513640 1 -- 172.21.15.17:0/2461141290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb08031d50 con 0x7fbb0c15ce90 2023-08-09T12:54:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 -- 172.21.15.17:0/2461141290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c15ce90 msgr2=0x7fbb0c1616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 --2- 172.21.15.17:0/2461141290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c15ce90 0x7fbb0c1616e0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0d0a70 tx=0x7fbb0802b900 comp rx=0 tx=0).stop 2023-08-09T12:54:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 -- 172.21.15.17:0/2461141290 shutdown_connections 2023-08-09T12:54:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 --2- 172.21.15.17:0/2461141290 >> v2:172.21.15.142:3300/0 conn(0x7fbb0c0d29d0 0x7fbb0c0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 --2- 172.21.15.17:0/2461141290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 0x7fbb0c0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 --2- 172.21.15.17:0/2461141290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c15ce90 0x7fbb0c1616e0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 -- 172.21.15.17:0/2461141290 >> 172.21.15.17:0/2461141290 conn(0x7fbb0c06fde0 msgr2=0x7fbb0c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 -- 172.21.15.17:0/2461141290 shutdown_connections 2023-08-09T12:54:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.498+0000 7fbb14779640 1 -- 172.21.15.17:0/2461141290 wait complete. 2023-08-09T12:54:08.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.500+0000 7fbb14779640 1 Processor -- start 2023-08-09T12:54:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.500+0000 7fbb14779640 1 -- start start 2023-08-09T12:54:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb14779640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 0x7fbb0c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb14779640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0d29d0 0x7fbb0c0abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb14779640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0c15ce90 0x7fbb0c0ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb14779640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0cb650 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb14779640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c14c000 con 0x7fbb0c15ce90 2023-08-09T12:54:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb14779640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c14c2e0 con 0x7fbb0c0b6000 2023-08-09T12:54:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb11d14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0d29d0 0x7fbb0c0abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb11d14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0d29d0 0x7fbb0c0abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46828/0 (socket says 172.21.15.17:46828) 2023-08-09T12:54:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.501+0000 7fbb11d14640 1 -- 172.21.15.17:0/4003591942 learned_addr learned my addr 172.21.15.17:0/4003591942 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:08.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb12515640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 0x7fbb0c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb12d16640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0c15ce90 0x7fbb0c0ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb11d14640 1 -- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 msgr2=0x7fbb0c14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb11d14640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 0x7fbb0c14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb11d14640 1 -- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0c15ce90 msgr2=0x7fbb0c0ac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb11d14640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0c15ce90 0x7fbb0c0ac190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb11d14640 1 -- 172.21.15.17:0/4003591942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080094d0 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb11d14640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0d29d0 0x7fbb0c0abc50 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00d800 tx=0x7fbafc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb02ffd640 1 -- 172.21.15.17:0/4003591942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc00b6c0 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.502+0000 7fbb02ffd640 1 -- 172.21.15.17:0/4003591942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc00b820 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.503+0000 7fbb02ffd640 1 -- 172.21.15.17:0/4003591942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc00bbb0 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.503+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c14c5c0 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.503+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c14bc00 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.504+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c067a80 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.505+0000 7fbb02ffd640 1 -- 172.21.15.17:0/4003591942 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbafc00bd10 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.506+0000 7fbb02ffd640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a050 0x7fbaf006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.506+0000 7fbb02ffd640 1 -- 172.21.15.17:0/4003591942 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbafc088b30 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.506+0000 7fbb02ffd640 1 -- 172.21.15.17:0/4003591942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fbaf00721a0 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.506+0000 7fbb12515640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a050 0x7fbaf006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.507+0000 7fbb12515640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a050 0x7fbaf006c510 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbb08036000 tx=0x7fbb0803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.510+0000 7fbb02ffd640 1 -- 172.21.15.17:0/4003591942 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fbafc054210 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.703+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb0c0d0ad0 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.704+0000 7fbb02ffd640 1 -- 172.21.15.17:0/4003591942 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v195) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbafc057830 con 0x7fbb0c0d29d0 2023-08-09T12:54:08.707 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-08-09T12:54:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a050 msgr2=0x7fbaf006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a050 0x7fbaf006c510 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbb08036000 tx=0x7fbb0803c040 comp rx=0 tx=0).stop 2023-08-09T12:54:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0d29d0 msgr2=0x7fbb0c0abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0d29d0 0x7fbb0c0abc50 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00d800 tx=0x7fbafc00dcc0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 shutdown_connections 2023-08-09T12:54:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fbaf006a050 0x7fbaf006c510 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0c15ce90 0x7fbb0c0ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0d29d0 0x7fbb0c0abc50 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 --2- 172.21.15.17:0/4003591942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0c0b6000 0x7fbb0c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 >> 172.21.15.17:0/4003591942 conn(0x7fbb0c06fde0 msgr2=0x7fbb0c0b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 shutdown_connections 2023-08-09T12:54:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.707+0000 7fbb14779640 1 -- 172.21.15.17:0/4003591942 wait complete. 2023-08-09T12:54:08.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-09T12:54:08.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.951+0000 7f4b60a44640 1 Processor -- start 2023-08-09T12:54:08.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.951+0000 7f4b60a44640 1 -- start start 2023-08-09T12:54:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.953+0000 7f4b60a44640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c0d2290 0x7f4b5c0b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.953+0000 7f4b60a44640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c070ab0 con 0x7f4b5c15caf0 2023-08-09T12:54:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.953+0000 7f4b60a44640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c0d2720 con 0x7f4b5c0d1e20 2023-08-09T12:54:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.953+0000 7f4b60a44640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0d1a80 con 0x7f4b5c0d2290 2023-08-09T12:54:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.953+0000 7f4b5ad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4b5c15caf0 0x7f4b5c0703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53884/0 (socket says 172.21.15.17:53884) 2023-08-09T12:54:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.953+0000 7f4b5ad9d640 1 -- 172.21.15.17:0/2881117596 learned_addr learned my addr 172.21.15.17:0/2881117596 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.953+0000 7f4b5b59e640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c0d2290 0x7f4b5c0b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.953+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084210552 0 0) 0x7f4b5c070ab0 con 0x7f4b5c15caf0 2023-08-09T12:54:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b44003520 con 0x7f4b5c15caf0 2023-08-09T12:54:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2491807360 0 0) 0x7f4b44003520 con 0x7f4b5c15caf0 2023-08-09T12:54:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c0d2290 msgr2=0x7f4b5c0b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c0d2290 0x7f4b5c0b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 >> v1:172.21.15.142:6789/0 conn(0x7f4b5c0d1e20 legacy=0x7f4b5c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0d0f00 con 0x7f4b5c15caf0 2023-08-09T12:54:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f4b4c001670 con 0x7f4b5c15caf0 2023-08-09T12:54:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 >> v1:172.21.15.17:6789/0 conn(0x7f4b5c15caf0 legacy=0x7f4b5c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b440039a0 0x7f4b44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c0d2290 0x7f4b440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44004d00 0x7f4b44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0d1a80 con 0x7f4b44004d00 2023-08-09T12:54:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4400bac0 con 0x7f4b440039a0 2023-08-09T12:54:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4400bc80 con 0x7f4b5c0d2290 2023-08-09T12:54:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.954+0000 7f4b5b59e640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44004d00 0x7f4b44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.955+0000 7f4b5ad9d640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b440039a0 0x7f4b44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.955+0000 7f4b5a59c640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c0d2290 0x7f4b440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.955+0000 7f4b5b59e640 1 -- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c0d2290 msgr2=0x7f4b440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.955+0000 7f4b5b59e640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c0d2290 0x7f4b440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.955+0000 7f4b5b59e640 1 -- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b440039a0 msgr2=0x7f4b44003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.955+0000 7f4b5b59e640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b440039a0 0x7f4b44003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.955+0000 7f4b5b59e640 1 -- 172.21.15.17:0/2881117596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44003520 con 0x7f4b44004d00 2023-08-09T12:54:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b5b59e640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44004d00 0x7f4b44005180 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009f90 tx=0x7f4b440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d8469cdeaa8b9e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5402cbd0 con 0x7f4b44004d00 2023-08-09T12:54:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400f040 con 0x7f4b44004d00 2023-08-09T12:54:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b59d9b640 1 -- 172.21.15.17:0/2881117596 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54034440 con 0x7f4b44004d00 2023-08-09T12:54:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b60a44640 1 -- 172.21.15.17:0/2881117596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44004d00 msgr2=0x7f4b44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b60a44640 1 --2- 172.21.15.17:0/2881117596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44004d00 0x7f4b44005180 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009f90 tx=0x7f4b440057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b5b59e640 1 -- 172.21.15.17:0/2881117596 reap_dead start 2023-08-09T12:54:08.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b60a44640 1 -- 172.21.15.17:0/2881117596 shutdown_connections 2023-08-09T12:54:08.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.957+0000 7f4b60a44640 1 -- 172.21.15.17:0/2881117596 >> 172.21.15.17:0/2881117596 conn(0x7f4b5c0cf6b0 msgr2=0x7f4b5c0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:08.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.958+0000 7f4b60a44640 1 -- 172.21.15.17:0/2881117596 shutdown_connections 2023-08-09T12:54:08.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.958+0000 7f4b60a44640 1 -- 172.21.15.17:0/2881117596 wait complete. 2023-08-09T12:54:08.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.959+0000 7f4b60a44640 1 Processor -- start 2023-08-09T12:54:08.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.959+0000 7f4b60a44640 1 -- start start 2023-08-09T12:54:08.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.960+0000 7f4b60a44640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b44004d00 0x7f4b5c158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.960+0000 7f4b60a44640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c15ced0 0x7f4b5c14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.960+0000 7f4b60a44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b5c0c7f20 0x7f4b5c0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.960+0000 7f4b60a44640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c88e0 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.960+0000 7f4b60a44640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c15d420 con 0x7f4b44004d00 2023-08-09T12:54:08.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.960+0000 7f4b60a44640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c15d700 con 0x7f4b5c15ced0 2023-08-09T12:54:08.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b5c0c7f20 0x7f4b5c0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b5c0c7f20 0x7f4b5c0c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46846/0 (socket says 172.21.15.17:46846) 2023-08-09T12:54:08.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 -- 172.21.15.17:0/3975650132 learned_addr learned my addr 172.21.15.17:0/3975650132 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:08.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5ad9d640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b44004d00 0x7f4b5c158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5a59c640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c15ced0 0x7f4b5c14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 -- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c15ced0 msgr2=0x7f4b5c14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c15ced0 0x7f4b5c14f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 -- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b44004d00 msgr2=0x7f4b5c158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:08.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b44004d00 0x7f4b5c158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 -- 172.21.15.17:0/3975650132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c15d9e0 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5ad9d640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b44004d00 0x7f4b5c158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.961+0000 7f4b5b59e640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b5c0c7f20 0x7f4b5c0c83a0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f4b54037040 tx=0x7f4b54009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.962+0000 7f4b437fe640 1 -- 172.21.15.17:0/3975650132 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54034d50 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.962+0000 7f4b437fe640 1 -- 172.21.15.17:0/3975650132 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b54003990 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.962+0000 7f4b437fe640 1 -- 172.21.15.17:0/3975650132 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54003d20 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.962+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c15dcc0 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.962+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c1569d0 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.963+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c04e390 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.964+0000 7f4b437fe640 1 -- 172.21.15.17:0/3975650132 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b54004030 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.965+0000 7f4b437fe640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b4806a050 0x7f4b4806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:08.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.965+0000 7f4b437fe640 1 -- 172.21.15.17:0/3975650132 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b540a9cc0 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.965+0000 7f4b437fe640 1 -- 172.21.15.17:0/3975650132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f4b480721a0 con 0x7f4b5c0c7f20 2023-08-09T12:54:08.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.965+0000 7f4b5ad9d640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b4806a050 0x7f4b4806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:08.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.967+0000 7f4b5ad9d640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b4806a050 0x7f4b4806c510 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c001c90 tx=0x7f4b4c001500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:08.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:08.969+0000 7f4b437fe640 1 -- 172.21.15.17:0/3975650132 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4b54045060 con 0x7f4b5c0c7f20 2023-08-09T12:54:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.162+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4b5c0b59d0 con 0x7f4b5c0c7f20 2023-08-09T12:54:09.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.165+0000 7f4b437fe640 1 -- 172.21.15.17:0/3975650132 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v195) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4b54039070 con 0x7f4b5c0c7f20 2023-08-09T12:54:09.169 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-08-09T12:54:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b4806a050 msgr2=0x7f4b4806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b4806a050 0x7f4b4806c510 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c001c90 tx=0x7f4b4c001500 comp rx=0 tx=0).stop 2023-08-09T12:54:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b5c0c7f20 msgr2=0x7f4b5c0c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b5c0c7f20 0x7f4b5c0c83a0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f4b54037040 tx=0x7f4b54009750 comp rx=0 tx=0).stop 2023-08-09T12:54:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 shutdown_connections 2023-08-09T12:54:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4b4806a050 0x7f4b4806c510 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b5c0c7f20 0x7f4b5c0c83a0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b5c15ced0 0x7f4b5c14f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 --2- 172.21.15.17:0/3975650132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b44004d00 0x7f4b5c158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 >> 172.21.15.17:0/3975650132 conn(0x7f4b5c0cf6b0 msgr2=0x7f4b5c0d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:09.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 shutdown_connections 2023-08-09T12:54:09.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.168+0000 7f4b60a44640 1 -- 172.21.15.17:0/3975650132 wait complete. 2023-08-09T12:54:09.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-09T12:54:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.409+0000 7faba759e640 1 Processor -- start 2023-08-09T12:54:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.409+0000 7faba759e640 1 -- start start 2023-08-09T12:54:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.411+0000 7faba759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba815ab40 0x7faba80cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.411+0000 7faba759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faba80b21c0 0x7faba80c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.411+0000 7faba759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba80c8c30 con 0x7faba80c2670 2023-08-09T12:54:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.411+0000 7faba759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba80cb9d0 con 0x7faba80b21c0 2023-08-09T12:54:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.411+0000 7faba759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba80c8e80 con 0x7faba815ab40 2023-08-09T12:54:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.411+0000 7faba6d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7faba80c2670 0x7faba80c9960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53890/0 (socket says 172.21.15.17:53890) 2023-08-09T12:54:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.411+0000 7faba6d9d640 1 -- 172.21.15.17:0/1438887215 learned_addr learned my addr 172.21.15.17:0/1438887215 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba659c640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba815ab40 0x7faba80cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7fab9ffff640 1 --2- 172.21.15.17:0/1438887215 >> v2:172.21.15.142:3300/0 conn(0x7faba80b21c0 0x7faba80c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156777186 0 0) 0x7faba80c8c30 con 0x7faba80c2670 2023-08-09T12:54:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab94003520 con 0x7faba80c2670 2023-08-09T12:54:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1166039713 0 0) 0x7fab94003520 con 0x7faba80c2670 2023-08-09T12:54:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba815ab40 msgr2=0x7faba80cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba815ab40 0x7faba80cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 >> v2:172.21.15.142:3300/0 conn(0x7faba80b21c0 msgr2=0x7faba80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 --2- 172.21.15.17:0/1438887215 >> v2:172.21.15.142:3300/0 conn(0x7faba80b21c0 0x7faba80c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba80c9160 con 0x7faba80c2670 2023-08-09T12:54:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7faba00019f0 con 0x7faba80c2670 2023-08-09T12:54:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 >> v1:172.21.15.17:6789/0 conn(0x7faba80c2670 legacy=0x7faba80c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7fab94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba815ab40 0x7fab940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab94004d00 0x7fab94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba80cb9d0 con 0x7fab94003970 2023-08-09T12:54:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba80c8e80 con 0x7fab94004d00 2023-08-09T12:54:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.412+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9400b980 con 0x7faba815ab40 2023-08-09T12:54:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.413+0000 7faba659c640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7fab94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.413+0000 7fab9ffff640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba815ab40 0x7fab940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.413+0000 7faba659c640 1 -- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba815ab40 msgr2=0x7fab940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:09.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.413+0000 7faba659c640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba815ab40 0x7fab940047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.413+0000 7faba659c640 1 -- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab94004d00 msgr2=0x7fab94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:09.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.413+0000 7faba659c640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab94004d00 0x7fab94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.413+0000 7faba659c640 1 -- 172.21.15.17:0/1438887215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94003520 con 0x7fab94003970 2023-08-09T12:54:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.414+0000 7faba659c640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7fab94003d90 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fab98009af0 tx=0x7fab940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2c78ae509de62c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.414+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9802c6b0 con 0x7fab94003970 2023-08-09T12:54:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.414+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9802c810 con 0x7fab94003970 2023-08-09T12:54:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.414+0000 7faba5d9b640 1 -- 172.21.15.17:0/1438887215 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9802cba0 con 0x7fab94003970 2023-08-09T12:54:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.415+0000 7faba759e640 1 -- 172.21.15.17:0/1438887215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 msgr2=0x7fab94003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.415+0000 7faba759e640 1 --2- 172.21.15.17:0/1438887215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7fab94003d90 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fab98009af0 tx=0x7fab940057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.415+0000 7faba6d9d640 1 -- 172.21.15.17:0/1438887215 reap_dead start 2023-08-09T12:54:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.415+0000 7faba759e640 1 -- 172.21.15.17:0/1438887215 shutdown_connections 2023-08-09T12:54:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.415+0000 7faba759e640 1 -- 172.21.15.17:0/1438887215 >> 172.21.15.17:0/1438887215 conn(0x7faba806abd0 msgr2=0x7faba806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.415+0000 7faba759e640 1 -- 172.21.15.17:0/1438887215 shutdown_connections 2023-08-09T12:54:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.415+0000 7faba759e640 1 -- 172.21.15.17:0/1438887215 wait complete. 2023-08-09T12:54:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.417+0000 7faba759e640 1 Processor -- start 2023-08-09T12:54:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.417+0000 7faba759e640 1 -- start start 2023-08-09T12:54:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7faba814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba81f5680 0x7faba80c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba80ac8b0 0x7faba80acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba80cc6e0 con 0x7fab94003970 2023-08-09T12:54:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba80ad280 con 0x7faba80ac8b0 2023-08-09T12:54:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba81f5b80 con 0x7faba81f5680 2023-08-09T12:54:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7faba814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7faba814d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46866/0 (socket says 172.21.15.17:46866) 2023-08-09T12:54:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba659c640 1 -- 172.21.15.17:0/1123859986 learned_addr learned my addr 172.21.15.17:0/1123859986 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba659c640 1 -- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba81f5680 msgr2=0x7faba80c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba659c640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba81f5680 0x7faba80c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba659c640 1 -- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba80ac8b0 msgr2=0x7faba80acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba659c640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba80ac8b0 0x7faba80acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.418+0000 7faba659c640 1 -- 172.21.15.17:0/1123859986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba81f5e60 con 0x7fab94003970 2023-08-09T12:54:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.419+0000 7faba659c640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7faba814d940 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fab9802c250 tx=0x7fab98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.419+0000 7fab9effd640 1 -- 172.21.15.17:0/1123859986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98003810 con 0x7fab94003970 2023-08-09T12:54:09.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.419+0000 7fab9effd640 1 -- 172.21.15.17:0/1123859986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98003970 con 0x7fab94003970 2023-08-09T12:54:09.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.419+0000 7fab9effd640 1 -- 172.21.15.17:0/1123859986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98003d00 con 0x7fab94003970 2023-08-09T12:54:09.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.419+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba81f6140 con 0x7fab94003970 2023-08-09T12:54:09.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.419+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba814de80 con 0x7fab94003970 2023-08-09T12:54:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.421+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba804e390 con 0x7fab94003970 2023-08-09T12:54:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.421+0000 7fab9effd640 1 -- 172.21.15.17:0/1123859986 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab98034440 con 0x7fab94003970 2023-08-09T12:54:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.422+0000 7fab9effd640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab8806a050 0x7fab8806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.422+0000 7fab9effd640 1 -- 172.21.15.17:0/1123859986 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab980aa8c0 con 0x7fab94003970 2023-08-09T12:54:09.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.423+0000 7fab9effd640 1 -- 172.21.15.17:0/1123859986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fab880721a0 con 0x7fab94003970 2023-08-09T12:54:09.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.423+0000 7fab9ffff640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab8806a050 0x7fab8806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.424+0000 7fab9ffff640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab8806a050 0x7fab8806c510 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fab90006a90 tx=0x7fab90006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:09.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.427+0000 7fab9effd640 1 -- 172.21.15.17:0/1123859986 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fab98075fc0 con 0x7fab94003970 2023-08-09T12:54:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.617+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faba80719e0 con 0x7fab94003970 2023-08-09T12:54:09.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.618+0000 7fab9effd640 1 -- 172.21.15.17:0/1123859986 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v195) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab980390a0 con 0x7fab94003970 2023-08-09T12:54:09.621 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-08-09T12:54:09.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab8806a050 msgr2=0x7fab8806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab8806a050 0x7fab8806c510 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fab90006a90 tx=0x7fab90006a20 comp rx=0 tx=0).stop 2023-08-09T12:54:09.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 msgr2=0x7faba814d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7faba814d940 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fab9802c250 tx=0x7fab98004730 comp rx=0 tx=0).stop 2023-08-09T12:54:09.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 shutdown_connections 2023-08-09T12:54:09.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fab8806a050 0x7fab8806c510 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba80ac8b0 0x7faba80acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba81f5680 0x7faba80c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 --2- 172.21.15.17:0/1123859986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab94003970 0x7faba814d940 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.620+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 >> 172.21.15.17:0/1123859986 conn(0x7faba806abd0 msgr2=0x7faba80c4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.621+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 shutdown_connections 2023-08-09T12:54:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.621+0000 7faba759e640 1 -- 172.21.15.17:0/1123859986 wait complete. 2023-08-09T12:54:09.644 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-09T12:54:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.866+0000 7f0a962e0640 1 Processor -- start 2023-08-09T12:54:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.866+0000 7f0a962e0640 1 -- start start 2023-08-09T12:54:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a962e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a9015cb40 0x7f0a901609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a962e0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a900cdf70 0x7f0a900d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a962e0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a900d0f00 con 0x7f0a900b8420 2023-08-09T12:54:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a962e0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a901611f0 con 0x7f0a900cdf70 2023-08-09T12:54:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a962e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a901614d0 con 0x7f0a9015cb40 2023-08-09T12:54:09.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a95adf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a900cdf70 0x7f0a900d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a94add640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0a900b8420 0x7f0a900cd860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53906/0 (socket says 172.21.15.17:53906) 2023-08-09T12:54:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a94add640 1 -- 172.21.15.17:0/2911926529 learned_addr learned my addr 172.21.15.17:0/2911926529 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.868+0000 7f0a952de640 1 --2- 172.21.15.17:0/2911926529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a9015cb40 0x7f0a901609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.869+0000 7f0a95adf640 1 -- 172.21.15.17:0/2911926529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a9015cb40 msgr2=0x7f0a901609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.869+0000 7f0a95adf640 1 --2- 172.21.15.17:0/2911926529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a9015cb40 0x7f0a901609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.869+0000 7f0a95adf640 1 -- 172.21.15.17:0/2911926529 >> v1:172.21.15.17:6789/0 conn(0x7f0a900b8420 legacy=0x7f0a900cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.869+0000 7f0a95adf640 1 -- 172.21.15.17:0/2911926529 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a901617b0 con 0x7f0a900cdf70 2023-08-09T12:54:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.869+0000 7f0a87fff640 1 -- 172.21.15.17:0/2911926529 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249301326 0 0) 0x7f0a900d0f00 con 0x7f0a900b8420 2023-08-09T12:54:09.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.870+0000 7f0a95adf640 1 --2- 172.21.15.17:0/2911926529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900d16c0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009d90 tx=0x7f0a8802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab445c927d2476b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:09.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.870+0000 7f0a87fff640 1 -- 172.21.15.17:0/2911926529 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8802cce0 con 0x7f0a900cdf70 2023-08-09T12:54:09.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.870+0000 7f0a87fff640 1 -- 172.21.15.17:0/2911926529 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8802ce40 con 0x7f0a900cdf70 2023-08-09T12:54:09.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.870+0000 7f0a87fff640 1 -- 172.21.15.17:0/2911926529 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88034660 con 0x7f0a900cdf70 2023-08-09T12:54:09.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.871+0000 7f0a962e0640 1 -- 172.21.15.17:0/2911926529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 msgr2=0x7f0a900d16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.871+0000 7f0a962e0640 1 --2- 172.21.15.17:0/2911926529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900d16c0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009d90 tx=0x7f0a8802bf30 comp rx=0 tx=0).stop 2023-08-09T12:54:09.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.871+0000 7f0a962e0640 1 -- 172.21.15.17:0/2911926529 shutdown_connections 2023-08-09T12:54:09.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.871+0000 7f0a962e0640 1 --2- 172.21.15.17:0/2911926529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900d16c0 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.871+0000 7f0a962e0640 1 --2- 172.21.15.17:0/2911926529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a9015cb40 0x7f0a901609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.871+0000 7f0a962e0640 1 -- 172.21.15.17:0/2911926529 >> 172.21.15.17:0/2911926529 conn(0x7f0a900d2ab0 msgr2=0x7f0a900d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:09.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.871+0000 7f0a962e0640 1 -- 172.21.15.17:0/2911926529 shutdown_connections 2023-08-09T12:54:09.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.871+0000 7f0a962e0640 1 -- 172.21.15.17:0/2911926529 wait complete. 2023-08-09T12:54:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.873+0000 7f0a962e0640 1 Processor -- start 2023-08-09T12:54:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.873+0000 7f0a962e0640 1 -- start start 2023-08-09T12:54:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a962e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900b8420 0x7f0a900c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a962e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a962e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a9015cb40 0x7f0a900b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a962e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900cb160 con 0x7f0a900cdf70 2023-08-09T12:54:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a962e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900c58a0 con 0x7f0a9015cb40 2023-08-09T12:54:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a962e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900cb3b0 con 0x7f0a900b8420 2023-08-09T12:54:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a94add640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a94add640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46892/0 (socket says 172.21.15.17:46892) 2023-08-09T12:54:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a94add640 1 -- 172.21.15.17:0/136632822 learned_addr learned my addr 172.21.15.17:0/136632822 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a952de640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900b8420 0x7f0a900c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a95adf640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a9015cb40 0x7f0a900b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a94add640 1 -- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900b8420 msgr2=0x7f0a900c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a94add640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900b8420 0x7f0a900c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a94add640 1 -- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a9015cb40 msgr2=0x7f0a900b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a94add640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a9015cb40 0x7f0a900b7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a94add640 1 -- 172.21.15.17:0/136632822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009a70 con 0x7f0a900cdf70 2023-08-09T12:54:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.874+0000 7f0a952de640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900b8420 0x7f0a900c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.875+0000 7f0a94add640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900cc450 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c4d0 tx=0x7f0a8000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.875+0000 7f0a85ffb640 1 -- 172.21.15.17:0/136632822 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a800074e0 con 0x7f0a900cdf70 2023-08-09T12:54:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.875+0000 7f0a85ffb640 1 -- 172.21.15.17:0/136632822 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80007660 con 0x7f0a900cdf70 2023-08-09T12:54:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.875+0000 7f0a85ffb640 1 -- 172.21.15.17:0/136632822 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80004a20 con 0x7f0a900cdf70 2023-08-09T12:54:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.875+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a900cb690 con 0x7f0a900cdf70 2023-08-09T12:54:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.875+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a900cbc50 con 0x7f0a900cdf70 2023-08-09T12:54:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.876+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9004e390 con 0x7f0a900cdf70 2023-08-09T12:54:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.877+0000 7f0a85ffb640 1 -- 172.21.15.17:0/136632822 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a80004b80 con 0x7f0a900cdf70 2023-08-09T12:54:09.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.878+0000 7f0a85ffb640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7406a050 0x7f0a7406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:09.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.878+0000 7f0a85ffb640 1 -- 172.21.15.17:0/136632822 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a80087840 con 0x7f0a900cdf70 2023-08-09T12:54:09.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.879+0000 7f0a85ffb640 1 -- 172.21.15.17:0/136632822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f0a740721a0 con 0x7f0a900cdf70 2023-08-09T12:54:09.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.879+0000 7f0a952de640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7406a050 0x7f0a7406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:09.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.880+0000 7f0a952de640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7406a050 0x7f0a7406c510 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c006fd0 tx=0x7f0a8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:09.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:09.883+0000 7f0a85ffb640 1 -- 172.21.15.17:0/136632822 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f0a80052e90 con 0x7f0a900cdf70 2023-08-09T12:54:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.076+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a9015a2b0 con 0x7f0a900cdf70 2023-08-09T12:54:10.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.077+0000 7f0a85ffb640 1 -- 172.21.15.17:0/136632822 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v195) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a800564b0 con 0x7f0a900cdf70 2023-08-09T12:54:10.080 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-08-09T12:54:10.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7406a050 msgr2=0x7f0a7406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7406a050 0x7f0a7406c510 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c006fd0 tx=0x7f0a8c008040 comp rx=0 tx=0).stop 2023-08-09T12:54:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 msgr2=0x7f0a900cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900cc450 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c4d0 tx=0x7f0a8000c990 comp rx=0 tx=0).stop 2023-08-09T12:54:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 shutdown_connections 2023-08-09T12:54:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0a7406a050 0x7f0a7406c510 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a9015cb40 0x7f0a900b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a900cdf70 0x7f0a900cc450 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 --2- 172.21.15.17:0/136632822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a900b8420 0x7f0a900c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 >> 172.21.15.17:0/136632822 conn(0x7f0a900d2ab0 msgr2=0x7f0a90156360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:10.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 shutdown_connections 2023-08-09T12:54:10.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.080+0000 7f0a962e0640 1 -- 172.21.15.17:0/136632822 wait complete. 2023-08-09T12:54:10.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:54:10.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.322+0000 7f8ce3fff640 1 Processor -- start 2023-08-09T12:54:10.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.323+0000 7f8ce3fff640 1 -- start start 2023-08-09T12:54:10.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.324+0000 7f8ce3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 0x7f8ce40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.324+0000 7f8ce3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8ce40697c0 0x7f8ce4069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.324+0000 7f8ce3fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce406fe10 con 0x7f8ce4159bd0 2023-08-09T12:54:10.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8ce3fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce40b11a0 con 0x7f8ce40697c0 2023-08-09T12:54:10.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8ce3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce406a190 con 0x7f8ce40b3fe0 2023-08-09T12:54:10.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8ce37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8ce40697c0 0x7f8ce4069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8ce37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8ce40697c0 0x7f8ce4069c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46908/0 (socket says 172.21.15.17:46908) 2023-08-09T12:54:10.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8ce37fe640 1 -- 172.21.15.17:0/1258449664 learned_addr learned my addr 172.21.15.17:0/1258449664 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8cdbfff640 1 --2- 172.21.15.17:0/1258449664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 0x7f8ce40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8ce37fe640 1 -- 172.21.15.17:0/1258449664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 msgr2=0x7f8ce40ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8ce37fe640 1 --2- 172.21.15.17:0/1258449664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 0x7f8ce40ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.325+0000 7f8ce37fe640 1 -- 172.21.15.17:0/1258449664 >> v1:172.21.15.142:6789/0 conn(0x7f8ce4159bd0 legacy=0x7f8ce4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.326+0000 7f8ce37fe640 1 -- 172.21.15.17:0/1258449664 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce4159fb0 con 0x7f8ce40697c0 2023-08-09T12:54:10.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.327+0000 7f8ce37fe640 1 --2- 172.21.15.17:0/1258449664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce40697c0 0x7f8ce4069c50 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009e50 tx=0x7f8cdc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39092da4af035e80 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:10.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.327+0000 7f8ce27fc640 1 -- 172.21.15.17:0/1258449664 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc02ca70 con 0x7f8ce40697c0 2023-08-09T12:54:10.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.327+0000 7f8ce27fc640 1 -- 172.21.15.17:0/1258449664 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc02cbd0 con 0x7f8ce40697c0 2023-08-09T12:54:10.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.327+0000 7f8ce27fc640 1 -- 172.21.15.17:0/1258449664 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0343f0 con 0x7f8ce40697c0 2023-08-09T12:54:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.328+0000 7f8ce3fff640 1 -- 172.21.15.17:0/1258449664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce40697c0 msgr2=0x7f8ce4069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.328+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/1258449664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce40697c0 0x7f8ce4069c50 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009e50 tx=0x7f8cdc02bed0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.328+0000 7f8ce3fff640 1 -- 172.21.15.17:0/1258449664 shutdown_connections 2023-08-09T12:54:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.328+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/1258449664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce40697c0 0x7f8ce4069c50 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.328+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/1258449664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 0x7f8ce40ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.328+0000 7f8ce3fff640 1 -- 172.21.15.17:0/1258449664 >> 172.21.15.17:0/1258449664 conn(0x7f8ce40b1d50 msgr2=0x7f8ce406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.328+0000 7f8ce3fff640 1 -- 172.21.15.17:0/1258449664 shutdown_connections 2023-08-09T12:54:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.328+0000 7f8ce3fff640 1 -- 172.21.15.17:0/1258449664 wait complete. 2023-08-09T12:54:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.329+0000 7f8ce3fff640 1 Processor -- start 2023-08-09T12:54:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.330+0000 7f8ce3fff640 1 -- start start 2023-08-09T12:54:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce40697c0 0x7f8ce40c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 0x7f8ce4155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce4159bd0 0x7f8ce40ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce3fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40c4e80 con 0x7f8ce4159bd0 2023-08-09T12:54:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce3fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce415d0e0 con 0x7f8ce40697c0 2023-08-09T12:54:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40c4550 con 0x7f8ce40b3fe0 2023-08-09T12:54:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce4159bd0 0x7f8ce40ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce4159bd0 0x7f8ce40ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46924/0 (socket says 172.21.15.17:46924) 2023-08-09T12:54:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce37fe640 1 -- 172.21.15.17:0/391232715 learned_addr learned my addr 172.21.15.17:0/391232715 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8cdbfff640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 0x7f8ce4155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce2ffd640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce40697c0 0x7f8ce40c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce37fe640 1 -- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 msgr2=0x7f8ce4155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce37fe640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 0x7f8ce4155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce37fe640 1 -- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce40697c0 msgr2=0x7f8ce40c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce37fe640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce40697c0 0x7f8ce40c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce37fe640 1 -- 172.21.15.17:0/391232715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc009b30 con 0x7f8ce4159bd0 2023-08-09T12:54:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.331+0000 7f8ce2ffd640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce40697c0 0x7f8ce40c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.332+0000 7f8ce37fe640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce4159bd0 0x7f8ce40ce600 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009e50 tx=0x7f8cdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.332+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/391232715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc009510 con 0x7f8ce4159bd0 2023-08-09T12:54:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.332+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/391232715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc03e450 con 0x7f8ce4159bd0 2023-08-09T12:54:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.332+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/391232715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc03e800 con 0x7f8ce4159bd0 2023-08-09T12:54:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.332+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce40c4830 con 0x7f8ce4159bd0 2023-08-09T12:54:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.332+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce415cd70 con 0x7f8ce4159bd0 2023-08-09T12:54:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.333+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce40c5030 con 0x7f8ce4159bd0 2023-08-09T12:54:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.334+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/391232715 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8cdc03e960 con 0x7f8ce4159bd0 2023-08-09T12:54:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.336+0000 7f8cdb7fe640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8cc406a050 0x7f8cc406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.336+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/391232715 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8cdc0ab280 con 0x7f8ce4159bd0 2023-08-09T12:54:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.336+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/391232715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f8cc40721a0 con 0x7f8ce4159bd0 2023-08-09T12:54:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.337+0000 7f8ce2ffd640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8cc406a050 0x7f8cc406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.338+0000 7f8ce2ffd640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8cc406a050 0x7f8cc406c510 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8ce415c650 tx=0x7f8cd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:10.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.340+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/391232715 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8ce40c5030 con 0x7f8ce4159bd0 2023-08-09T12:54:10.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.581+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce404e390 con 0x7f8ce4159bd0 2023-08-09T12:54:10.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.582+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/391232715 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f8cdc043090 con 0x7f8ce4159bd0 2023-08-09T12:54:10.585 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:10.585 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:54:10.586 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:54:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.584+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8cc406a050 msgr2=0x7f8cc406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.584+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8cc406a050 0x7f8cc406c510 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8ce415c650 tx=0x7f8cd4009040 comp rx=0 tx=0).stop 2023-08-09T12:54:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.584+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce4159bd0 msgr2=0x7f8ce40ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.584+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce4159bd0 0x7f8ce40ce600 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009e50 tx=0x7f8cdc004a40 comp rx=0 tx=0).stop 2023-08-09T12:54:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.585+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 shutdown_connections 2023-08-09T12:54:10.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.585+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8cc406a050 0x7f8cc406c510 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.585+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce4159bd0 0x7f8ce40ce600 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.585+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ce40b3fe0 0x7f8ce4155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.585+0000 7f8ce3fff640 1 --2- 172.21.15.17:0/391232715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ce40697c0 0x7f8ce40c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.585+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 >> 172.21.15.17:0/391232715 conn(0x7f8ce40b1d50 msgr2=0x7f8ce40b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:10.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.585+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 shutdown_connections 2023-08-09T12:54:10.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.585+0000 7f8ce3fff640 1 -- 172.21.15.17:0/391232715 wait complete. 2023-08-09T12:54:10.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:54:10.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.815+0000 7f7166c8c640 1 Processor -- start 2023-08-09T12:54:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.815+0000 7f7166c8c640 1 -- start start 2023-08-09T12:54:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.817+0000 7f7166c8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71601601f0 0x7f71600b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.817+0000 7f7166c8c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600b34a0 con 0x7f71600b2ee0 2023-08-09T12:54:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.817+0000 7f7166c8c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600b3780 con 0x7f71600cb610 2023-08-09T12:54:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.817+0000 7f7166c8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71600b4120 con 0x7f71601601f0 2023-08-09T12:54:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.818+0000 7f7165489640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f71600b2ee0 0x7f71600caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53908/0 (socket says 172.21.15.17:53908) 2023-08-09T12:54:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.818+0000 7f7165489640 1 -- 172.21.15.17:0/2852557046 learned_addr learned my addr 172.21.15.17:0/2852557046 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.818+0000 7f7165c8a640 1 --2- 172.21.15.17:0/2852557046 >> v2:172.21.15.142:3300/0 conn(0x7f71601601f0 0x7f71600b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.818+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272830597 0 0) 0x7f71600b34a0 con 0x7f71600b2ee0 2023-08-09T12:54:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.818+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c003520 con 0x7f71600b2ee0 2023-08-09T12:54:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3282265202 0 0) 0x7f714c003520 con 0x7f71600b2ee0 2023-08-09T12:54:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 >> v2:172.21.15.142:3300/0 conn(0x7f71601601f0 msgr2=0x7f71600b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:10.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 --2- 172.21.15.17:0/2852557046 >> v2:172.21.15.142:3300/0 conn(0x7f71601601f0 0x7f71600b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 >> v1:172.21.15.142:6789/0 conn(0x7f71600cb610 legacy=0x7f71600c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600b3a60 con 0x7f71600b2ee0 2023-08-09T12:54:10.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f7150001670 con 0x7f71600b2ee0 2023-08-09T12:54:10.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 >> v1:172.21.15.17:6789/0 conn(0x7f71600b2ee0 legacy=0x7f71600caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c003970 0x7f714c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714c0047c0 0x7f714c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f714c005180 0x7f714c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600b4120 con 0x7f714c005180 2023-08-09T12:54:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c00c020 con 0x7f714c003970 2023-08-09T12:54:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c00c1e0 con 0x7f714c0047c0 2023-08-09T12:54:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f716648b640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f714c005180 0x7f714c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7165c8a640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c003970 0x7f714c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.819+0000 7f7165489640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714c0047c0 0x7f714c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.820+0000 7f716648b640 1 -- 172.21.15.17:0/2852557046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714c0047c0 msgr2=0x7f714c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:10.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.820+0000 7f716648b640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714c0047c0 0x7f714c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.820+0000 7f716648b640 1 -- 172.21.15.17:0/2852557046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c003970 msgr2=0x7f714c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:10.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.820+0000 7f716648b640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c003970 0x7f714c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.820+0000 7f716648b640 1 -- 172.21.15.17:0/2852557046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c003520 con 0x7f714c005180 2023-08-09T12:54:10.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.821+0000 7f716648b640 1 -- 172.21.15.17:0/2852557046 reap_dead start 2023-08-09T12:54:10.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.821+0000 7f716648b640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f714c005180 0x7f714c00b980 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f7158001e20 tx=0x7f714c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2ee5dddb30704d server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.821+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158003b70 con 0x7f714c005180 2023-08-09T12:54:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.821+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7158003cd0 con 0x7f714c005180 2023-08-09T12:54:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.821+0000 7f7164c88640 1 -- 172.21.15.17:0/2852557046 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158005310 con 0x7f714c005180 2023-08-09T12:54:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.822+0000 7f7166c8c640 1 -- 172.21.15.17:0/2852557046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f714c005180 msgr2=0x7f714c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.822+0000 7f7166c8c640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f714c005180 0x7f714c00b980 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f7158001e20 tx=0x7f714c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.822+0000 7f7166c8c640 1 -- 172.21.15.17:0/2852557046 shutdown_connections 2023-08-09T12:54:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.822+0000 7f7166c8c640 1 --2- 172.21.15.17:0/2852557046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f714c005180 0x7f714c00b980 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.822+0000 7f7166c8c640 1 -- 172.21.15.17:0/2852557046 >> 172.21.15.17:0/2852557046 conn(0x7f71600b1d50 msgr2=0x7f716006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.822+0000 7f7166c8c640 1 -- 172.21.15.17:0/2852557046 shutdown_connections 2023-08-09T12:54:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.822+0000 7f7166c8c640 1 -- 172.21.15.17:0/2852557046 wait complete. 2023-08-09T12:54:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.824+0000 7f7166c8c640 1 Processor -- start 2023-08-09T12:54:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.824+0000 7f7166c8c640 1 -- start start 2023-08-09T12:54:10.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7166c8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c005180 0x7f7160155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7166c8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716006f6a0 0x7f716015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7166c8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f716015dba0 0x7f71601f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7166c8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716015e020 con 0x7f716006f6a0 2023-08-09T12:54:10.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7166c8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7160158ea0 con 0x7f714c005180 2023-08-09T12:54:10.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7166c8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7160155550 con 0x7f716015dba0 2023-08-09T12:54:10.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7165489640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716006f6a0 0x7f716015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7165489640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716006f6a0 0x7f716015d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46938/0 (socket says 172.21.15.17:46938) 2023-08-09T12:54:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.825+0000 7f7165489640 1 -- 172.21.15.17:0/1670097268 learned_addr learned my addr 172.21.15.17:0/1670097268 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7165c8a640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c005180 0x7f7160155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7165489640 1 -- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f716015dba0 msgr2=0x7f71601f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7165489640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f716015dba0 0x7f71601f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7165489640 1 -- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c005180 msgr2=0x7f7160155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7165489640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c005180 0x7f7160155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7165489640 1 -- 172.21.15.17:0/1670097268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160156d30 con 0x7f716006f6a0 2023-08-09T12:54:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7165c8a640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c005180 0x7f7160155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7165489640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716006f6a0 0x7f716015d660 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f715000e790 tx=0x7f715000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f71567fc640 1 -- 172.21.15.17:0/1670097268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715000eea0 con 0x7f716006f6a0 2023-08-09T12:54:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f71567fc640 1 -- 172.21.15.17:0/1670097268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715000c870 con 0x7f716006f6a0 2023-08-09T12:54:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f71567fc640 1 -- 172.21.15.17:0/1670097268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715000cc20 con 0x7f716006f6a0 2023-08-09T12:54:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.826+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7160157010 con 0x7f716006f6a0 2023-08-09T12:54:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.827+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71600706a0 con 0x7f716006f6a0 2023-08-09T12:54:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.828+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716004e390 con 0x7f716006f6a0 2023-08-09T12:54:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.829+0000 7f71567fc640 1 -- 172.21.15.17:0/1670097268 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f715001d460 con 0x7f716006f6a0 2023-08-09T12:54:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.830+0000 7f71567fc640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f714406a080 0x7f714406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.830+0000 7f71567fc640 1 -- 172.21.15.17:0/1670097268 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7150088520 con 0x7f716006f6a0 2023-08-09T12:54:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.830+0000 7f71567fc640 1 -- 172.21.15.17:0/1670097268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f71440721d0 con 0x7f716006f6a0 2023-08-09T12:54:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.830+0000 7f7165c8a640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f714406a080 0x7f714406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.831+0000 7f7165c8a640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f714406a080 0x7f714406c540 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7160070060 tx=0x7f715c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:10.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:10.834+0000 7f71567fc640 1 -- 172.21.15.17:0/1670097268 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7150053c00 con 0x7f716006f6a0 2023-08-09T12:54:11.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.028+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71600c8150 con 0x7f716006f6a0 2023-08-09T12:54:11.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.031+0000 7f71567fc640 1 -- 172.21.15.17:0/1670097268 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18297 (secure 0 0 0) 0x7f7150057220 con 0x7f716006f6a0 2023-08-09T12:54:11.035 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:11.036 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":195,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:54:03.984689+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:53:18.326271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-09T12:53:18.942904+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:54:11.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f714406a080 msgr2=0x7f714406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f714406a080 0x7f714406c540 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7160070060 tx=0x7f715c008040 comp rx=0 tx=0).stop 2023-08-09T12:54:11.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716006f6a0 msgr2=0x7f716015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716006f6a0 0x7f716015d660 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f715000e790 tx=0x7f715000ec50 comp rx=0 tx=0).stop 2023-08-09T12:54:11.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 shutdown_connections 2023-08-09T12:54:11.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f714406a080 0x7f714406c540 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f716015dba0 0x7f71601f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716006f6a0 0x7f716015d660 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 --2- 172.21.15.17:0/1670097268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c005180 0x7f7160155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 >> 172.21.15.17:0/1670097268 conn(0x7f71600b1d50 msgr2=0x7f71600c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:11.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 shutdown_connections 2023-08-09T12:54:11.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.034+0000 7f7166c8c640 1 -- 172.21.15.17:0/1670097268 wait complete. 2023-08-09T12:54:11.057 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:54:11.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:54:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.289+0000 7f64d0877640 1 Processor -- start 2023-08-09T12:54:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.289+0000 7f64d0877640 1 -- start start 2023-08-09T12:54:11.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.290+0000 7f64d0877640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64cc159d80 0x7f64cc0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.291+0000 7f64d0877640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc0b4630 con 0x7f64cc070a90 2023-08-09T12:54:11.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.291+0000 7f64d0877640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc0b3ab0 con 0x7f64cc0ad810 2023-08-09T12:54:11.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.291+0000 7f64d0877640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc15a160 con 0x7f64cc159d80 2023-08-09T12:54:11.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.291+0000 7f64cad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f64cc070a90 0x7f64cc0c8fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53914/0 (socket says 172.21.15.17:53914) 2023-08-09T12:54:11.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.291+0000 7f64cad9d640 1 -- 172.21.15.17:0/2514215142 learned_addr learned my addr 172.21.15.17:0/2514215142 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:11.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.291+0000 7f64ca59c640 1 --2- 172.21.15.17:0/2514215142 >> v2:172.21.15.142:3300/0 conn(0x7f64cc159d80 0x7f64cc0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.291+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143872979 0 0) 0x7f64cc0b4630 con 0x7f64cc070a90 2023-08-09T12:54:11.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b8003520 con 0x7f64cc070a90 2023-08-09T12:54:11.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3933829311 0 0) 0x7f64b8003520 con 0x7f64cc070a90 2023-08-09T12:54:11.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 >> v2:172.21.15.142:3300/0 conn(0x7f64cc159d80 msgr2=0x7f64cc0b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:11.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 --2- 172.21.15.17:0/2514215142 >> v2:172.21.15.142:3300/0 conn(0x7f64cc159d80 0x7f64cc0b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 >> v1:172.21.15.142:6789/0 conn(0x7f64cc0ad810 legacy=0x7f64cc070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0b3d90 con 0x7f64cc070a90 2023-08-09T12:54:11.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f64c40019f0 con 0x7f64cc070a90 2023-08-09T12:54:11.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 >> v1:172.21.15.17:6789/0 conn(0x7f64cc070a90 legacy=0x7f64cc0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b8003970 0x7f64b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b80047c0 0x7f64b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b8005180 0x7f64b800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc15a160 con 0x7f64b80047c0 2023-08-09T12:54:11.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b800e2e0 con 0x7f64b8003970 2023-08-09T12:54:11.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b800e4a0 con 0x7f64b8005180 2023-08-09T12:54:11.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.292+0000 7f64c3fff640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b80047c0 0x7f64b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64ca59c640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b8003970 0x7f64b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64c3fff640 1 -- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b8005180 msgr2=0x7f64b800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:11.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64cad9d640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b8005180 0x7f64b800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64c3fff640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b8005180 0x7f64b800db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64c3fff640 1 -- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b8003970 msgr2=0x7f64b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:11.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64c3fff640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b8003970 0x7f64b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64c3fff640 1 -- 172.21.15.17:0/2514215142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8003520 con 0x7f64b80047c0 2023-08-09T12:54:11.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64ca59c640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b8003970 0x7f64b8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:11.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64cad9d640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64b8005180 0x7f64b800db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:11.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.293+0000 7f64cad9d640 1 -- 172.21.15.17:0/2514215142 reap_dead start 2023-08-09T12:54:11.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.294+0000 7f64c3fff640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b80047c0 0x7f64b8004c40 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f64b4001770 tx=0x7f64b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d830e11381517862 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:11.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.294+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40052d0 con 0x7f64b80047c0 2023-08-09T12:54:11.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.294+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b402e050 con 0x7f64b80047c0 2023-08-09T12:54:11.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.294+0000 7f64c9d9b640 1 -- 172.21.15.17:0/2514215142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4003640 con 0x7f64b80047c0 2023-08-09T12:54:11.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.295+0000 7f64d0877640 1 -- 172.21.15.17:0/2514215142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b80047c0 msgr2=0x7f64b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.295+0000 7f64d0877640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b80047c0 0x7f64b8004c40 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f64b4001770 tx=0x7f64b80057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.295+0000 7f64d0877640 1 -- 172.21.15.17:0/2514215142 shutdown_connections 2023-08-09T12:54:11.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.295+0000 7f64d0877640 1 --2- 172.21.15.17:0/2514215142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b80047c0 0x7f64b8004c40 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.295+0000 7f64d0877640 1 -- 172.21.15.17:0/2514215142 >> 172.21.15.17:0/2514215142 conn(0x7f64cc0cb1b0 msgr2=0x7f64cc0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:11.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.295+0000 7f64d0877640 1 -- 172.21.15.17:0/2514215142 shutdown_connections 2023-08-09T12:54:11.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.295+0000 7f64d0877640 1 -- 172.21.15.17:0/2514215142 wait complete. 2023-08-09T12:54:11.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.297+0000 7f64d0877640 1 Processor -- start 2023-08-09T12:54:11.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.297+0000 7f64d0877640 1 -- start start 2023-08-09T12:54:11.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.298+0000 7f64d0877640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b80047c0 0x7f64cc0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.298+0000 7f64d0877640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64cc14a660 0x7f64cc14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.298+0000 7f64d0877640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64cc14cd70 0x7f64cc14d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.298+0000 7f64d0877640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc14c870 con 0x7f64cc14cd70 2023-08-09T12:54:11.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.298+0000 7f64d0877640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1f2c80 con 0x7f64b80047c0 2023-08-09T12:54:11.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.298+0000 7f64d0877640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1f2f60 con 0x7f64cc14a660 2023-08-09T12:54:11.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.298+0000 7f64cad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64cc14cd70 0x7f64cc14d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64cad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64cc14cd70 0x7f64cc14d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46970/0 (socket says 172.21.15.17:46970) 2023-08-09T12:54:11.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64cad9d640 1 -- 172.21.15.17:0/272478474 learned_addr learned my addr 172.21.15.17:0/272478474 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:11.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64c3fff640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64cc14a660 0x7f64cc14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64ca59c640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b80047c0 0x7f64cc0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64cad9d640 1 -- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64cc14a660 msgr2=0x7f64cc14aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64cad9d640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64cc14a660 0x7f64cc14aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64cad9d640 1 -- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b80047c0 msgr2=0x7f64cc0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64cad9d640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b80047c0 0x7f64cc0b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64cad9d640 1 -- 172.21.15.17:0/272478474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc1f3240 con 0x7f64cc14cd70 2023-08-09T12:54:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64ca59c640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b80047c0 0x7f64cc0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.299+0000 7f64cad9d640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64cc14cd70 0x7f64cc14d1f0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0b2170 tx=0x7f64c400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.300+0000 7f64c2ffd640 1 -- 172.21.15.17:0/272478474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40018a0 con 0x7f64cc14cd70 2023-08-09T12:54:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.300+0000 7f64c2ffd640 1 -- 172.21.15.17:0/272478474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c400b860 con 0x7f64cc14cd70 2023-08-09T12:54:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.300+0000 7f64c2ffd640 1 -- 172.21.15.17:0/272478474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c400bc10 con 0x7f64cc14cd70 2023-08-09T12:54:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.300+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc0c9e80 con 0x7f64cc14cd70 2023-08-09T12:54:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.300+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc0ca310 con 0x7f64cc14cd70 2023-08-09T12:54:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.301+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc067a80 con 0x7f64cc14cd70 2023-08-09T12:54:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.302+0000 7f64c2ffd640 1 -- 172.21.15.17:0/272478474 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f64c400bd70 con 0x7f64cc14cd70 2023-08-09T12:54:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.303+0000 7f64c2ffd640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ac06a080 0x7f64ac06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.303+0000 7f64c2ffd640 1 -- 172.21.15.17:0/272478474 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64c40888d0 con 0x7f64cc14cd70 2023-08-09T12:54:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.303+0000 7f64c2ffd640 1 -- 172.21.15.17:0/272478474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f64ac0721d0 con 0x7f64cc14cd70 2023-08-09T12:54:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.304+0000 7f64ca59c640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ac06a080 0x7f64ac06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.305+0000 7f64ca59c640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ac06a080 0x7f64ac06c540 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f64bc006fd0 tx=0x7f64bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:11.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.307+0000 7f64c2ffd640 1 -- 172.21.15.17:0/272478474 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f64c4053f20 con 0x7f64cc14cd70 2023-08-09T12:54:11.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.540+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64cc0b4040 con 0x7f64cc14cd70 2023-08-09T12:54:11.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.541+0000 7f64c2ffd640 1 -- 172.21.15.17:0/272478474 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f64c4057540 con 0x7f64cc14cd70 2023-08-09T12:54:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:11.551 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:54:11.553 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:54:11.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ac06a080 msgr2=0x7f64ac06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ac06a080 0x7f64ac06c540 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f64bc006fd0 tx=0x7f64bc008040 comp rx=0 tx=0).stop 2023-08-09T12:54:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64cc14cd70 msgr2=0x7f64cc14d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64cc14cd70 0x7f64cc14d1f0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0b2170 tx=0x7f64c400df70 comp rx=0 tx=0).stop 2023-08-09T12:54:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 shutdown_connections 2023-08-09T12:54:11.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f64ac06a080 0x7f64ac06c540 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64cc14cd70 0x7f64cc14d1f0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64cc14a660 0x7f64cc14aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 --2- 172.21.15.17:0/272478474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64b80047c0 0x7f64cc0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 >> 172.21.15.17:0/272478474 conn(0x7f64cc0cb1b0 msgr2=0x7f64cc0697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 shutdown_connections 2023-08-09T12:54:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.544+0000 7f64d0877640 1 -- 172.21.15.17:0/272478474 wait complete. 2023-08-09T12:54:11.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:54:11.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.785+0000 7fa90b44b640 1 Processor -- start 2023-08-09T12:54:11.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.785+0000 7fa90b44b640 1 -- start start 2023-08-09T12:54:11.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.786+0000 7fa90b44b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9041587e0 0x7fa904070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.787+0000 7fa90b44b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90415beb0 con 0x7fa9040cb070 2023-08-09T12:54:11.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.787+0000 7fa90b44b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9040715c0 con 0x7fa9040b0b10 2023-08-09T12:54:11.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.787+0000 7fa90b44b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9040718a0 con 0x7fa9041587e0 2023-08-09T12:54:11.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.787+0000 7fa90ac4a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa9040cb070 0x7fa90415e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53922/0 (socket says 172.21.15.17:53922) 2023-08-09T12:54:11.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.787+0000 7fa90ac4a640 1 -- 172.21.15.17:0/2351290283 learned_addr learned my addr 172.21.15.17:0/2351290283 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:11.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.787+0000 7fa90a449640 1 --2- 172.21.15.17:0/2351290283 >> v2:172.21.15.142:3300/0 conn(0x7fa9041587e0 0x7fa904070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310768062 0 0) 0x7fa90415beb0 con 0x7fa9040cb070 2023-08-09T12:54:11.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f0003520 con 0x7fa9040cb070 2023-08-09T12:54:11.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698421803 0 0) 0x7fa8f0003520 con 0x7fa9040cb070 2023-08-09T12:54:11.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 >> v2:172.21.15.142:3300/0 conn(0x7fa9041587e0 msgr2=0x7fa904070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:11.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 --2- 172.21.15.17:0/2351290283 >> v2:172.21.15.142:3300/0 conn(0x7fa9041587e0 0x7fa904070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 >> v1:172.21.15.142:6789/0 conn(0x7fa9040b0b10 legacy=0x7fa90415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904071b80 con 0x7fa9040cb070 2023-08-09T12:54:11.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fa8fc001670 con 0x7fa9040cb070 2023-08-09T12:54:11.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 >> v1:172.21.15.17:6789/0 conn(0x7fa9040cb070 legacy=0x7fa90415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8f0003970 0x7fa8f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8f00047c0 0x7fa8f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0005180 0x7fa8f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040718a0 con 0x7fa8f0005180 2023-08-09T12:54:11.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f000c020 con 0x7fa8f0003970 2023-08-09T12:54:11.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.788+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f000c1e0 con 0x7fa8f00047c0 2023-08-09T12:54:11.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.789+0000 7fa90ac4a640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0005180 0x7fa8f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.789+0000 7fa909c48640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8f00047c0 0x7fa8f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.789+0000 7fa90ac4a640 1 -- 172.21.15.17:0/2351290283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8f00047c0 msgr2=0x7fa8f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:11.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.789+0000 7fa90ac4a640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8f00047c0 0x7fa8f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.789+0000 7fa90ac4a640 1 -- 172.21.15.17:0/2351290283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8f0003970 msgr2=0x7fa8f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:11.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.789+0000 7fa90ac4a640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8f0003970 0x7fa8f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.789+0000 7fa90ac4a640 1 -- 172.21.15.17:0/2351290283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f0003520 con 0x7fa8f0005180 2023-08-09T12:54:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.790+0000 7fa90ac4a640 1 -- 172.21.15.17:0/2351290283 reap_dead start 2023-08-09T12:54:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.790+0000 7fa90ac4a640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0005180 0x7fa8f000b980 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c240 tx=0x7fa8f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9af0f53c1763c88 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc005ad0 con 0x7fa8f0005180 2023-08-09T12:54:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc005c70 con 0x7fa8f0005180 2023-08-09T12:54:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa909447640 1 -- 172.21.15.17:0/2351290283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc02c8b0 con 0x7fa8f0005180 2023-08-09T12:54:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa90b44b640 1 -- 172.21.15.17:0/2351290283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0005180 msgr2=0x7fa8f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa90b44b640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0005180 0x7fa8f000b980 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c240 tx=0x7fa8f00057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa90b44b640 1 -- 172.21.15.17:0/2351290283 shutdown_connections 2023-08-09T12:54:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa90b44b640 1 --2- 172.21.15.17:0/2351290283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0005180 0x7fa8f000b980 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa90b44b640 1 -- 172.21.15.17:0/2351290283 >> 172.21.15.17:0/2351290283 conn(0x7fa9040b1d50 msgr2=0x7fa90406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa90b44b640 1 -- 172.21.15.17:0/2351290283 shutdown_connections 2023-08-09T12:54:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.791+0000 7fa90b44b640 1 -- 172.21.15.17:0/2351290283 wait complete. 2023-08-09T12:54:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.793+0000 7fa90b44b640 1 Processor -- start 2023-08-09T12:54:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.794+0000 7fa90b44b640 1 -- start start 2023-08-09T12:54:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.794+0000 7fa90b44b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8f0005180 0x7fa904156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90b44b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9040c68c0 0x7fa9040cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90b44b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9040cd8d0 0x7fa9040c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90b44b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040cdd60 con 0x7fa9040cd8d0 2023-08-09T12:54:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90b44b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040c6430 con 0x7fa8f0005180 2023-08-09T12:54:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90b44b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040c5860 con 0x7fa9040c68c0 2023-08-09T12:54:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90ac4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9040cd8d0 0x7fa9040c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90ac4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9040cd8d0 0x7fa9040c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46994/0 (socket says 172.21.15.17:46994) 2023-08-09T12:54:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90ac4a640 1 -- 172.21.15.17:0/496893641 learned_addr learned my addr 172.21.15.17:0/496893641 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90a449640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8f0005180 0x7fa904156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa909c48640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9040c68c0 0x7fa9040cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90ac4a640 1 -- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9040c68c0 msgr2=0x7fa9040cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90ac4a640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9040c68c0 0x7fa9040cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90ac4a640 1 -- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8f0005180 msgr2=0x7fa904156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90ac4a640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8f0005180 0x7fa904156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.795+0000 7fa90ac4a640 1 -- 172.21.15.17:0/496893641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040c5b00 con 0x7fa9040cd8d0 2023-08-09T12:54:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.796+0000 7fa90ac4a640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9040cd8d0 0x7fa9040c6f20 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c360 tx=0x7fa8fc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.796+0000 7fa8faffd640 1 -- 172.21.15.17:0/496893641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0049e0 con 0x7fa9040cd8d0 2023-08-09T12:54:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.796+0000 7fa8faffd640 1 -- 172.21.15.17:0/496893641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc004b40 con 0x7fa9040cd8d0 2023-08-09T12:54:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.796+0000 7fa8faffd640 1 -- 172.21.15.17:0/496893641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc007070 con 0x7fa9040cd8d0 2023-08-09T12:54:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.796+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9040c5de0 con 0x7fa9040cd8d0 2023-08-09T12:54:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.796+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa904157150 con 0x7fa9040cd8d0 2023-08-09T12:54:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.798+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90404e390 con 0x7fa9040cd8d0 2023-08-09T12:54:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.799+0000 7fa8faffd640 1 -- 172.21.15.17:0/496893641 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa8fc032070 con 0x7fa9040cd8d0 2023-08-09T12:54:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.800+0000 7fa8faffd640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa8e806a080 0x7fa8e806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.800+0000 7fa8faffd640 1 -- 172.21.15.17:0/496893641 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8fc03c070 con 0x7fa9040cd8d0 2023-08-09T12:54:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.800+0000 7fa8faffd640 1 -- 172.21.15.17:0/496893641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fa8e80721d0 con 0x7fa9040cd8d0 2023-08-09T12:54:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.801+0000 7fa90a449640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa8e806a080 0x7fa8e806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.802+0000 7fa90a449640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa8e806a080 0x7fa8e806c540 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa900007520 tx=0x7fa90000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:11.804+0000 7fa8faffd640 1 -- 172.21.15.17:0/496893641 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa8fc045020 con 0x7fa9040cd8d0 2023-08-09T12:54:12.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.034+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9040c6570 con 0x7fa9040cd8d0 2023-08-09T12:54:12.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.035+0000 7fa8faffd640 1 -- 172.21.15.17:0/496893641 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4879 (secure 0 0 0) 0x7fa8fc0751c0 con 0x7fa9040cd8d0 2023-08-09T12:54:12.039 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:12.039 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-09T12:53:19.914432+0000","modified":"2023-08-09T12:53:23.505794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9453":{"gid":9453,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/918927752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":918927752},{"type":"v1","addr":"172.21.15.17:6834","nonce":918927752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-09T12:54:12.040 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 93 2023-08-09T12:54:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.037+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa8e806a080 msgr2=0x7fa8e806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa8e806a080 0x7fa8e806c540 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa900007520 tx=0x7fa90000d040 comp rx=0 tx=0).stop 2023-08-09T12:54:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9040cd8d0 msgr2=0x7fa9040c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9040cd8d0 0x7fa9040c6f20 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c360 tx=0x7fa8fc001a00 comp rx=0 tx=0).stop 2023-08-09T12:54:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 shutdown_connections 2023-08-09T12:54:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa8e806a080 0x7fa8e806c540 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9040cd8d0 0x7fa9040c6f20 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9040c68c0 0x7fa9040cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 --2- 172.21.15.17:0/496893641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8f0005180 0x7fa904156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 >> 172.21.15.17:0/496893641 conn(0x7fa9040b1d50 msgr2=0x7fa90406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 shutdown_connections 2023-08-09T12:54:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.038+0000 7fa90b44b640 1 -- 172.21.15.17:0/496893641 wait complete. 2023-08-09T12:54:12.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:54:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.285+0000 7fcc5c986640 1 Processor -- start 2023-08-09T12:54:12.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.285+0000 7fcc5c986640 1 -- start start 2023-08-09T12:54:12.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.286+0000 7fcc5c986640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcc580b86e0 0x7fcc580cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.286+0000 7fcc5c986640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc580b5a30 con 0x7fcc580cf980 2023-08-09T12:54:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.286+0000 7fcc5c986640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc580cfdd0 con 0x7fcc58160030 2023-08-09T12:54:12.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.286+0000 7fcc5c986640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc580d1110 con 0x7fcc580b86e0 2023-08-09T12:54:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.287+0000 7fcc57fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcc580cf980 0x7fcc580d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53932/0 (socket says 172.21.15.17:53932) 2023-08-09T12:54:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.287+0000 7fcc57fff640 1 -- 172.21.15.17:0/3735356985 learned_addr learned my addr 172.21.15.17:0/3735356985 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.287+0000 7fcc56ffd640 1 --2- 172.21.15.17:0/3735356985 >> v2:172.21.15.17:3300/0 conn(0x7fcc580b86e0 0x7fcc580cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.287+0000 7fcc567fc640 1 -- 172.21.15.17:0/3735356985 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607729612 0 0) 0x7fcc580b5a30 con 0x7fcc580cf980 2023-08-09T12:54:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.287+0000 7fcc567fc640 1 -- 172.21.15.17:0/3735356985 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc40003520 con 0x7fcc580cf980 2023-08-09T12:54:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.287+0000 7fcc56ffd640 1 -- 172.21.15.17:0/3735356985 >> v1:172.21.15.142:6789/0 conn(0x7fcc58160030 legacy=0x7fcc58160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.287+0000 7fcc56ffd640 1 -- 172.21.15.17:0/3735356985 >> v1:172.21.15.17:6789/0 conn(0x7fcc580cf980 legacy=0x7fcc580d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.287+0000 7fcc56ffd640 1 -- 172.21.15.17:0/3735356985 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc580d0d70 con 0x7fcc580b86e0 2023-08-09T12:54:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.289+0000 7fcc56ffd640 1 --2- 172.21.15.17:0/3735356985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc580b86e0 0x7fcc580cf440 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0097a0 tx=0x7fcc4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7e5f7587647d2f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.289+0000 7fcc567fc640 1 -- 172.21.15.17:0/3735356985 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c031830 con 0x7fcc580b86e0 2023-08-09T12:54:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.289+0000 7fcc567fc640 1 -- 172.21.15.17:0/3735356985 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c031990 con 0x7fcc580b86e0 2023-08-09T12:54:12.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.289+0000 7fcc567fc640 1 -- 172.21.15.17:0/3735356985 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c031d00 con 0x7fcc580b86e0 2023-08-09T12:54:12.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.289+0000 7fcc5c986640 1 -- 172.21.15.17:0/3735356985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc580b86e0 msgr2=0x7fcc580cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.289+0000 7fcc5c986640 1 --2- 172.21.15.17:0/3735356985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc580b86e0 0x7fcc580cf440 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0097a0 tx=0x7fcc4c02b8d0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.290+0000 7fcc5c986640 1 -- 172.21.15.17:0/3735356985 shutdown_connections 2023-08-09T12:54:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.290+0000 7fcc5c986640 1 --2- 172.21.15.17:0/3735356985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc580b86e0 0x7fcc580cf440 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.290+0000 7fcc5c986640 1 -- 172.21.15.17:0/3735356985 >> 172.21.15.17:0/3735356985 conn(0x7fcc580697c0 msgr2=0x7fcc58069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.290+0000 7fcc5c986640 1 -- 172.21.15.17:0/3735356985 shutdown_connections 2023-08-09T12:54:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.290+0000 7fcc5c986640 1 -- 172.21.15.17:0/3735356985 wait complete. 2023-08-09T12:54:12.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.292+0000 7fcc5c986640 1 Processor -- start 2023-08-09T12:54:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.292+0000 7fcc5c986640 1 -- start start 2023-08-09T12:54:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc5c986640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc580b86e0 0x7fcc58153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc5c986640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc580cf980 0x7fcc580d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc5c986640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc58160030 0x7fcc580d2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc5c986640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc58156fa0 con 0x7fcc58160030 2023-08-09T12:54:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc5c986640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc581f2a50 con 0x7fcc580b86e0 2023-08-09T12:54:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc5c986640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc581f2180 con 0x7fcc580cf980 2023-08-09T12:54:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc58160030 0x7fcc580d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc58160030 0x7fcc580d2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47018/0 (socket says 172.21.15.17:47018) 2023-08-09T12:54:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc57fff640 1 -- 172.21.15.17:0/1927531784 learned_addr learned my addr 172.21.15.17:0/1927531784 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.293+0000 7fcc56ffd640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc580cf980 0x7fcc580d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc57fff640 1 -- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc580cf980 msgr2=0x7fcc580d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc57fff640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc580cf980 0x7fcc580d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc57fff640 1 -- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc580b86e0 msgr2=0x7fcc58153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc577fe640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc580b86e0 0x7fcc58153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc57fff640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc580b86e0 0x7fcc58153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc57fff640 1 -- 172.21.15.17:0/1927531784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c009400 con 0x7fcc58160030 2023-08-09T12:54:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc577fe640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc580b86e0 0x7fcc58153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc57fff640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc58160030 0x7fcc580d2010 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000c400 tx=0x7fcc5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc3ffff640 1 -- 172.21.15.17:0/1927531784 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50005ce0 con 0x7fcc58160030 2023-08-09T12:54:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc3ffff640 1 -- 172.21.15.17:0/1927531784 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50005e60 con 0x7fcc58160030 2023-08-09T12:54:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.294+0000 7fcc3ffff640 1 -- 172.21.15.17:0/1927531784 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500072f0 con 0x7fcc58160030 2023-08-09T12:54:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.295+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc581542a0 con 0x7fcc58160030 2023-08-09T12:54:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.295+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc581f2390 con 0x7fcc58160030 2023-08-09T12:54:12.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.296+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc581f2b90 con 0x7fcc58160030 2023-08-09T12:54:12.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.297+0000 7fcc3ffff640 1 -- 172.21.15.17:0/1927531784 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcc50007450 con 0x7fcc58160030 2023-08-09T12:54:12.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.298+0000 7fcc3ffff640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcc4406a050 0x7fcc4406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.298+0000 7fcc3ffff640 1 -- 172.21.15.17:0/1927531784 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc50087bd0 con 0x7fcc58160030 2023-08-09T12:54:12.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.298+0000 7fcc3ffff640 1 -- 172.21.15.17:0/1927531784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fcc440721a0 con 0x7fcc58160030 2023-08-09T12:54:12.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.298+0000 7fcc577fe640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcc4406a050 0x7fcc4406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.300+0000 7fcc577fe640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcc4406a050 0x7fcc4406c510 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcc48007e90 tx=0x7fcc480073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:12.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.302+0000 7fcc3ffff640 1 -- 172.21.15.17:0/1927531784 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fcc581f2b90 con 0x7fcc58160030 2023-08-09T12:54:12.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.497+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc581f2b90 con 0x7fcc58160030 2023-08-09T12:54:12.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.499+0000 7fcc3ffff640 1 -- 172.21.15.17:0/1927531784 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18297 (secure 0 0 0) 0x7fcc581f2b90 con 0x7fcc58160030 2023-08-09T12:54:12.503 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:12.504 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":195,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:54:03.984689+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-09T12:53:18.326271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-09T12:53:18.942904+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:54:12.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.501+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcc4406a050 msgr2=0x7fcc4406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.501+0000 7fcc5c986640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcc4406a050 0x7fcc4406c510 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcc48007e90 tx=0x7fcc480073a0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.502+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc58160030 msgr2=0x7fcc580d2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.502+0000 7fcc5c986640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc58160030 0x7fcc580d2010 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000c400 tx=0x7fcc5000c8c0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.502+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 shutdown_connections 2023-08-09T12:54:12.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.502+0000 7fcc5c986640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fcc4406a050 0x7fcc4406c510 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.502+0000 7fcc5c986640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc58160030 0x7fcc580d2010 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.502+0000 7fcc5c986640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc580cf980 0x7fcc580d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.502+0000 7fcc5c986640 1 --2- 172.21.15.17:0/1927531784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc580b86e0 0x7fcc58153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.502+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 >> 172.21.15.17:0/1927531784 conn(0x7fcc580697c0 msgr2=0x7fcc580c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.503+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 shutdown_connections 2023-08-09T12:54:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.503+0000 7fcc5c986640 1 -- 172.21.15.17:0/1927531784 wait complete. 2023-08-09T12:54:12.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-09T12:54:12.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.745+0000 7fd3d0803640 1 Processor -- start 2023-08-09T12:54:12.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.745+0000 7fd3d0803640 1 -- start start 2023-08-09T12:54:12.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.746+0000 7fd3d0803640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3cc1587e0 0x7fd3cc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.746+0000 7fd3d0803640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0b0b10 0x7fd3cc15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.746+0000 7fd3d0803640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3cc15bce0 0x7fd3cc0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.747+0000 7fd3d0803640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc0715c0 con 0x7fd3cc15bce0 2023-08-09T12:54:12.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.747+0000 7fd3d0803640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc0718a0 con 0x7fd3cc1587e0 2023-08-09T12:54:12.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.747+0000 7fd3d0803640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc071b80 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.747+0000 7fd3cb59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3cc15bce0 0x7fd3cc0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.747+0000 7fd3cb59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3cc15bce0 0x7fd3cc0cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47022/0 (socket says 172.21.15.17:47022) 2023-08-09T12:54:12.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.747+0000 7fd3cb59e640 1 -- 172.21.15.17:0/3376668524 learned_addr learned my addr 172.21.15.17:0/3376668524 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:12.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.747+0000 7fd3c259c640 1 --2- 172.21.15.17:0/3376668524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0b0b10 0x7fd3cc15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.747+0000 7fd3cad9d640 1 --2- 172.21.15.17:0/3376668524 >> v2:172.21.15.142:3300/0 conn(0x7fd3cc1587e0 0x7fd3cc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.748+0000 7fd3cb59e640 1 -- 172.21.15.17:0/3376668524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0b0b10 msgr2=0x7fd3cc15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:12.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.748+0000 7fd3cb59e640 1 --2- 172.21.15.17:0/3376668524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0b0b10 0x7fd3cc15b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.748+0000 7fd3cb59e640 1 -- 172.21.15.17:0/3376668524 >> v2:172.21.15.142:3300/0 conn(0x7fd3cc1587e0 msgr2=0x7fd3cc070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:12.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.748+0000 7fd3cb59e640 1 --2- 172.21.15.17:0/3376668524 >> v2:172.21.15.142:3300/0 conn(0x7fd3cc1587e0 0x7fd3cc070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.748+0000 7fd3cb59e640 1 -- 172.21.15.17:0/3376668524 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc15b280 con 0x7fd3cc15bce0 2023-08-09T12:54:12.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.748+0000 7fd3cad9d640 1 --2- 172.21.15.17:0/3376668524 >> v2:172.21.15.142:3300/0 conn(0x7fd3cc1587e0 0x7fd3cc070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:12.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.748+0000 7fd3c259c640 1 --2- 172.21.15.17:0/3376668524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0b0b10 0x7fd3cc15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:54:12.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.749+0000 7fd3cb59e640 1 --2- 172.21.15.17:0/3376668524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc15bce0 0x7fd3cc0cb070 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc06cc50 tx=0x7fd3c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fe38254a37bf73 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:12.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.749+0000 7fd3ca59c640 1 -- 172.21.15.17:0/3376668524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4031870 con 0x7fd3cc15bce0 2023-08-09T12:54:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.749+0000 7fd3ca59c640 1 -- 172.21.15.17:0/3376668524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c40319d0 con 0x7fd3cc15bce0 2023-08-09T12:54:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.749+0000 7fd3ca59c640 1 -- 172.21.15.17:0/3376668524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4031d60 con 0x7fd3cc15bce0 2023-08-09T12:54:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 -- 172.21.15.17:0/3376668524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc15bce0 msgr2=0x7fd3cc0cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 --2- 172.21.15.17:0/3376668524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc15bce0 0x7fd3cc0cb070 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc06cc50 tx=0x7fd3c402b910 comp rx=0 tx=0).stop 2023-08-09T12:54:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 -- 172.21.15.17:0/3376668524 shutdown_connections 2023-08-09T12:54:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 --2- 172.21.15.17:0/3376668524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc15bce0 0x7fd3cc0cb070 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 --2- 172.21.15.17:0/3376668524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0b0b10 0x7fd3cc15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 --2- 172.21.15.17:0/3376668524 >> v2:172.21.15.142:3300/0 conn(0x7fd3cc1587e0 0x7fd3cc070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 -- 172.21.15.17:0/3376668524 >> 172.21.15.17:0/3376668524 conn(0x7fd3cc0b1d50 msgr2=0x7fd3cc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 -- 172.21.15.17:0/3376668524 shutdown_connections 2023-08-09T12:54:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.750+0000 7fd3d0803640 1 -- 172.21.15.17:0/3376668524 wait complete. 2023-08-09T12:54:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.752+0000 7fd3d0803640 1 Processor -- start 2023-08-09T12:54:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.752+0000 7fd3d0803640 1 -- start start 2023-08-09T12:54:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.753+0000 7fd3d0803640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc0b0b10 0x7fd3cc0c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.753+0000 7fd3d0803640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc1587e0 0x7fd3cc0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.753+0000 7fd3d0803640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0cceb0 0x7fd3cc1f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.753+0000 7fd3d0803640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0ca110 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.753+0000 7fd3d0803640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0c9280 con 0x7fd3cc1587e0 2023-08-09T12:54:12.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.753+0000 7fd3d0803640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0c9500 con 0x7fd3cc0cceb0 2023-08-09T12:54:12.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc0b0b10 0x7fd3cc0c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc0b0b10 0x7fd3cc0c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47028/0 (socket says 172.21.15.17:47028) 2023-08-09T12:54:12.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 -- 172.21.15.17:0/2238540128 learned_addr learned my addr 172.21.15.17:0/2238540128 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cb59e640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0cceb0 0x7fd3cc1f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3c259c640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc1587e0 0x7fd3cc0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 -- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0cceb0 msgr2=0x7fd3cc1f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0cceb0 0x7fd3cc1f1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 -- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc1587e0 msgr2=0x7fd3cc0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc1587e0 0x7fd3cc0c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 -- 172.21.15.17:0/2238540128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40094d0 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3c259c640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc1587e0 0x7fd3cc0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:12.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.754+0000 7fd3cad9d640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc0b0b10 0x7fd3cc0c2ce0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00cf60 tx=0x7fd3bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:12.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.755+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00d840 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.755+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00d9a0 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.755+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00dd30 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.755+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc0c97e0 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.755+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc0c9da0 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.756+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc04e390 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.757+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd3bc015440 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.758+0000 7fd3c3fff640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3ac06a050 0x7fd3ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:12.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.758+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3bc088ff0 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.758+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fd3ac0721a0 con 0x7fd3cc0b0b10 2023-08-09T12:54:12.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.759+0000 7fd3c259c640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3ac06a050 0x7fd3ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:12.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.760+0000 7fd3c259c640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3ac06a050 0x7fd3ac06c510 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4006fd0 tx=0x7fd3b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:12.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:12.762+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd3bc01a020 con 0x7fd3cc0b0b10 2023-08-09T12:54:13.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.004+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd3cc06b8d0 con 0x7fd3cc0b0b10 2023-08-09T12:54:13.009 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-08-09T12:54:13.006+0000 7ff9c857e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-09T12:54:13.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.011+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(196..196 src has 1..196) v4 ==== 374+0+0 (secure 0 0 0) 0x7fd3bc060010 con 0x7fd3cc0b0b10 2023-08-09T12:54:13.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.011+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7fd3ac072a50 con 0x7fd3cc0b0b10 2023-08-09T12:54:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.017+0000 7fd3c3fff640 1 -- 172.21.15.17:0/2238540128 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd3bc0546f0 con 0x7fd3cc0b0b10 2023-08-09T12:54:13.024 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-09T12:54:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3ac06a050 msgr2=0x7fd3ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3ac06a050 0x7fd3ac06c510 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4006fd0 tx=0x7fd3b4008040 comp rx=0 tx=0).stop 2023-08-09T12:54:13.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc0b0b10 msgr2=0x7fd3cc0c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:13.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc0b0b10 0x7fd3cc0c2ce0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00cf60 tx=0x7fd3bc00cf90 comp rx=0 tx=0).stop 2023-08-09T12:54:13.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 shutdown_connections 2023-08-09T12:54:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd3ac06a050 0x7fd3ac06c510 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3cc0cceb0 0x7fd3cc1f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc1587e0 0x7fd3cc0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 --2- 172.21.15.17:0/2238540128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3cc0b0b10 0x7fd3cc0c2ce0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.021+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 >> 172.21.15.17:0/2238540128 conn(0x7fd3cc0b1d50 msgr2=0x7fd3cc0b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.022+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 shutdown_connections 2023-08-09T12:54:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.022+0000 7fd3d0803640 1 -- 172.21.15.17:0/2238540128 wait complete. 2023-08-09T12:54:13.033 INFO:tasks.ceph.mds.c.smithi017.stderr: -9534> 2023-08-09T12:53:26.391+0000 7f2a83355640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-09T12:54:13.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-09T12:54:13.095 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-08-09T12:54:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.248+0000 7f243f59e640 1 Processor -- start 2023-08-09T12:54:13.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.248+0000 7f243f59e640 1 -- start start 2023-08-09T12:54:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.250+0000 7f243f59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24400b0730 0x7f24400b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.250+0000 7f243f59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244015e7b0 con 0x7f244015a8c0 2023-08-09T12:54:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.250+0000 7f243f59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244015e460 con 0x7f24400b4170 2023-08-09T12:54:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.250+0000 7f243f59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244015aca0 con 0x7f24400b0730 2023-08-09T12:54:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.250+0000 7f243e59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f244015a8c0 0x7f244015ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53938/0 (socket says 172.21.15.17:53938) 2023-08-09T12:54:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.250+0000 7f243e59c640 1 -- 172.21.15.17:0/3580171026 learned_addr learned my addr 172.21.15.17:0/3580171026 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186045814 0 0) 0x7f244015e7b0 con 0x7f244015a8c0 2023-08-09T12:54:13.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f242c003520 con 0x7f244015a8c0 2023-08-09T12:54:13.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243ed9d640 1 --2- 172.21.15.17:0/3580171026 >> v2:172.21.15.142:3300/0 conn(0x7f24400b0730 0x7f24400b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:13.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 846517432 0 0) 0x7f242c003520 con 0x7f244015a8c0 2023-08-09T12:54:13.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 >> v2:172.21.15.142:3300/0 conn(0x7f24400b0730 msgr2=0x7f24400b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:13.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 --2- 172.21.15.17:0/3580171026 >> v2:172.21.15.142:3300/0 conn(0x7f24400b0730 0x7f24400b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 >> v1:172.21.15.142:6789/0 conn(0x7f24400b4170 legacy=0x7f24400b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:13.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400b1af0 con 0x7f244015a8c0 2023-08-09T12:54:13.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f2430001670 con 0x7f244015a8c0 2023-08-09T12:54:13.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 >> v1:172.21.15.17:6789/0 conn(0x7f244015a8c0 legacy=0x7f244015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:13.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c003970 0x7f242c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:13.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:13.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c005180 0x7f242c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:13.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244015aca0 con 0x7f242c0047c0 2023-08-09T12:54:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c00c0d0 con 0x7f242c003970 2023-08-09T12:54:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.251+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c00c290 con 0x7f242c005180 2023-08-09T12:54:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.252+0000 7f2437fff640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.252+0000 7f243e59c640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c003970 0x7f242c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.252+0000 7f2437fff640 1 -- 172.21.15.17:0/3580171026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c005180 msgr2=0x7f242c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.252+0000 7f2437fff640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c005180 0x7f242c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.252+0000 7f2437fff640 1 -- 172.21.15.17:0/3580171026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c003970 msgr2=0x7f242c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:13.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.252+0000 7f2437fff640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f242c003970 0x7f242c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.252+0000 7f2437fff640 1 -- 172.21.15.17:0/3580171026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c003520 con 0x7f242c0047c0 2023-08-09T12:54:13.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.252+0000 7f243ed9d640 1 -- 172.21.15.17:0/3580171026 reap_dead start 2023-08-09T12:54:13.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.253+0000 7f2437fff640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f2428001750 tx=0x7f242c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123b1e24058376c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:13.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280052d0 con 0x7f242c0047c0 2023-08-09T12:54:13.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242802e050 con 0x7f242c0047c0 2023-08-09T12:54:13.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243dd9b640 1 -- 172.21.15.17:0/3580171026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428003830 con 0x7f242c0047c0 2023-08-09T12:54:13.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243f59e640 1 -- 172.21.15.17:0/3580171026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c0047c0 msgr2=0x7f242c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243f59e640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f2428001750 tx=0x7f242c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243f59e640 1 -- 172.21.15.17:0/3580171026 shutdown_connections 2023-08-09T12:54:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243f59e640 1 --2- 172.21.15.17:0/3580171026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f242c0047c0 0x7f242c004c40 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243f59e640 1 -- 172.21.15.17:0/3580171026 >> 172.21.15.17:0/3580171026 conn(0x7f24400cb020 msgr2=0x7f24400cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243f59e640 1 -- 172.21.15.17:0/3580171026 shutdown_connections 2023-08-09T12:54:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.254+0000 7f243f59e640 1 -- 172.21.15.17:0/3580171026 wait complete. 2023-08-09T12:54:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.256+0000 7f243f59e640 1 Processor -- start 2023-08-09T12:54:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.256+0000 7f243f59e640 1 -- start start 2023-08-09T12:54:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.257+0000 7f243f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c0047c0 0x7f2440157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.257+0000 7f243f59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f244015bd40 0x7f24400ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.257+0000 7f243f59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244015c1c0 0x7f24400cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.257+0000 7f243f59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244015d920 con 0x7f244015c1c0 2023-08-09T12:54:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.257+0000 7f243f59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244015af80 con 0x7f244015bd40 2023-08-09T12:54:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.257+0000 7f243f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244015b260 con 0x7f242c0047c0 2023-08-09T12:54:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244015c1c0 0x7f24400cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244015c1c0 0x7f24400cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47074/0 (socket says 172.21.15.17:47074) 2023-08-09T12:54:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 -- 172.21.15.17:0/745685168 learned_addr learned my addr 172.21.15.17:0/745685168 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243e59c640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c0047c0 0x7f2440157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f2437fff640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f244015bd40 0x7f24400ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 -- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c0047c0 msgr2=0x7f2440157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c0047c0 0x7f2440157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 -- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f244015bd40 msgr2=0x7f24400ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f244015bd40 0x7f24400ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 -- 172.21.15.17:0/745685168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244015b540 con 0x7f244015c1c0 2023-08-09T12:54:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f2437fff640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f244015bd40 0x7f24400ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.258+0000 7f243ed9d640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244015c1c0 0x7f24400cd270 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f2440071e70 tx=0x7f243800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.259+0000 7f2436ffd640 1 -- 172.21.15.17:0/745685168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438007e40 con 0x7f244015c1c0 2023-08-09T12:54:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.259+0000 7f2436ffd640 1 -- 172.21.15.17:0/745685168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438014420 con 0x7f244015c1c0 2023-08-09T12:54:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.259+0000 7f2436ffd640 1 -- 172.21.15.17:0/745685168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380147d0 con 0x7f244015c1c0 2023-08-09T12:54:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.259+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244015b820 con 0x7f244015c1c0 2023-08-09T12:54:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.259+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244015ce10 con 0x7f244015c1c0 2023-08-09T12:54:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.260+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244004e390 con 0x7f244015c1c0 2023-08-09T12:54:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.261+0000 7f2436ffd640 1 -- 172.21.15.17:0/745685168 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2438014930 con 0x7f244015c1c0 2023-08-09T12:54:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.262+0000 7f2436ffd640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242006a050 0x7f242006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.262+0000 7f2436ffd640 1 -- 172.21.15.17:0/745685168 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f2438088be0 con 0x7f244015c1c0 2023-08-09T12:54:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.262+0000 7f2436ffd640 1 -- 172.21.15.17:0/745685168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7f24200722b0 con 0x7f244015c1c0 2023-08-09T12:54:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.263+0000 7f243e59c640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242006a050 0x7f242006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.264+0000 7f243e59c640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242006a050 0x7f242006c510 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2430001c90 tx=0x7f2430009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.266+0000 7f2436ffd640 1 -- 172.21.15.17:0/745685168 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f24380541d0 con 0x7f244015c1c0 2023-08-09T12:54:13.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:13.500+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f24400cbd50 con 0x7f244015c1c0 2023-08-09T12:54:13.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:54:13.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:54:14.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.015+0000 7f2436ffd640 1 -- 172.21.15.17:0/745685168 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) v1 ==== 104+0+0 (secure 0 0 0) 0x7f24380577f0 con 0x7f244015c1c0 2023-08-09T12:54:14.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242006a050 msgr2=0x7f242006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:14.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242006a050 0x7f242006c510 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2430001c90 tx=0x7f2430009040 comp rx=0 tx=0).stop 2023-08-09T12:54:14.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244015c1c0 msgr2=0x7f24400cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:14.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244015c1c0 0x7f24400cd270 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f2440071e70 tx=0x7f243800e4b0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 shutdown_connections 2023-08-09T12:54:14.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f242006a050 0x7f242006c510 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244015c1c0 0x7f24400cd270 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f244015bd40 0x7f24400ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 --2- 172.21.15.17:0/745685168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f242c0047c0 0x7f2440157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.018+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 >> 172.21.15.17:0/745685168 conn(0x7f24400cb020 msgr2=0x7f2440159c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:14.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.019+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 shutdown_connections 2023-08-09T12:54:14.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.019+0000 7f243f59e640 1 -- 172.21.15.17:0/745685168 wait complete. 2023-08-09T12:54:14.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-09T12:54:14.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.260+0000 7fe7775cf640 1 Processor -- start 2023-08-09T12:54:14.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.260+0000 7fe7775cf640 1 -- start start 2023-08-09T12:54:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.262+0000 7fe7775cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7700708a0 0x7fe7700c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.262+0000 7fe7775cf640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7700b4770 con 0x7fe77015abe0 2023-08-09T12:54:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.262+0000 7fe7775cf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7700caa70 con 0x7fe7700add60 2023-08-09T12:54:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.262+0000 7fe7775cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7700b41b0 con 0x7fe7700708a0 2023-08-09T12:54:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.262+0000 7fe77536b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe77015abe0 0x7fe770070190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53946/0 (socket says 172.21.15.17:53946) 2023-08-09T12:54:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.262+0000 7fe77536b640 1 -- 172.21.15.17:0/4087263607 learned_addr learned my addr 172.21.15.17:0/4087263607 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:14.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371543814 0 0) 0x7fe7700b4770 con 0x7fe77015abe0 2023-08-09T12:54:14.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe775b6c640 1 --2- 172.21.15.17:0/4087263607 >> v2:172.21.15.142:3300/0 conn(0x7fe7700708a0 0x7fe7700c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:14.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe75c003520 con 0x7fe77015abe0 2023-08-09T12:54:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1235815366 0 0) 0x7fe75c003520 con 0x7fe77015abe0 2023-08-09T12:54:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 >> v2:172.21.15.142:3300/0 conn(0x7fe7700708a0 msgr2=0x7fe7700c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 --2- 172.21.15.17:0/4087263607 >> v2:172.21.15.142:3300/0 conn(0x7fe7700708a0 0x7fe7700c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 >> v1:172.21.15.142:6789/0 conn(0x7fe7700add60 legacy=0x7fe7700caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700b4490 con 0x7fe77015abe0 2023-08-09T12:54:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fe76c001670 con 0x7fe77015abe0 2023-08-09T12:54:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 >> v1:172.21.15.17:6789/0 conn(0x7fe77015abe0 legacy=0x7fe770070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c003970 0x7fe75c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe75c0047c0 0x7fe75c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c005380 0x7fe75c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700b41b0 con 0x7fe75c0047c0 2023-08-09T12:54:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c00c210 con 0x7fe75c003970 2023-08-09T12:54:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.263+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c00c3d0 con 0x7fe75c005380 2023-08-09T12:54:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe774b6a640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe75c0047c0 0x7fe75c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe77536b640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c003970 0x7fe75c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe775b6c640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c005380 0x7fe75c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe774b6a640 1 -- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c005380 msgr2=0x7fe75c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe774b6a640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c005380 0x7fe75c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe774b6a640 1 -- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c003970 msgr2=0x7fe75c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe774b6a640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c003970 0x7fe75c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe774b6a640 1 -- 172.21.15.17:0/4087263607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c003520 con 0x7fe75c0047c0 2023-08-09T12:54:14.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe77536b640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75c003970 0x7fe75c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:14.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.264+0000 7fe775b6c640 1 -- 172.21.15.17:0/4087263607 reap_dead start 2023-08-09T12:54:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.265+0000 7fe774b6a640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe75c0047c0 0x7fe75c004c40 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fe760001720 tx=0x7fe75c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72bbe3cf504a54 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.265+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7600052d0 con 0x7fe75c0047c0 2023-08-09T12:54:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.265+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76002e050 con 0x7fe75c0047c0 2023-08-09T12:54:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.266+0000 7fe767fff640 1 -- 172.21.15.17:0/4087263607 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760003830 con 0x7fe75c0047c0 2023-08-09T12:54:14.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.266+0000 7fe7775cf640 1 -- 172.21.15.17:0/4087263607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe75c0047c0 msgr2=0x7fe75c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:14.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.266+0000 7fe7775cf640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe75c0047c0 0x7fe75c004c40 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fe760001720 tx=0x7fe75c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.266+0000 7fe7775cf640 1 -- 172.21.15.17:0/4087263607 shutdown_connections 2023-08-09T12:54:14.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.266+0000 7fe7775cf640 1 --2- 172.21.15.17:0/4087263607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe75c0047c0 0x7fe75c004c40 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.266+0000 7fe7775cf640 1 -- 172.21.15.17:0/4087263607 >> 172.21.15.17:0/4087263607 conn(0x7fe7700697c0 msgr2=0x7fe770069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.266+0000 7fe7775cf640 1 -- 172.21.15.17:0/4087263607 shutdown_connections 2023-08-09T12:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.266+0000 7fe7775cf640 1 -- 172.21.15.17:0/4087263607 wait complete. 2023-08-09T12:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.268+0000 7fe7775cf640 1 Processor -- start 2023-08-09T12:54:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.268+0000 7fe7775cf640 1 -- start start 2023-08-09T12:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.269+0000 7fe7775cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c0047c0 0x7fe77014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.269+0000 7fe7775cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7700ce720 0x7fe7700ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.269+0000 7fe7775cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7700ccf80 0x7fe7700cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.269+0000 7fe7775cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77014ae90 con 0x7fe7700ccf80 2023-08-09T12:54:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.269+0000 7fe7775cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700cf0c0 con 0x7fe7700ce720 2023-08-09T12:54:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.269+0000 7fe7775cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700cdce0 con 0x7fe75c0047c0 2023-08-09T12:54:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe775b6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7700ccf80 0x7fe7700cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe775b6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7700ccf80 0x7fe7700cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47096/0 (socket says 172.21.15.17:47096) 2023-08-09T12:54:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe775b6c640 1 -- 172.21.15.17:0/803226344 learned_addr learned my addr 172.21.15.17:0/803226344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe77536b640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c0047c0 0x7fe77014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe774b6a640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7700ce720 0x7fe7700ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe775b6c640 1 -- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c0047c0 msgr2=0x7fe77014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe775b6c640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c0047c0 0x7fe77014a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe775b6c640 1 -- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7700ce720 msgr2=0x7fe7700ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:14.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe775b6c640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7700ce720 0x7fe7700ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:14.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.270+0000 7fe775b6c640 1 -- 172.21.15.17:0/803226344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700cdfc0 con 0x7fe7700ccf80 2023-08-09T12:54:14.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.271+0000 7fe775b6c640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7700ccf80 0x7fe7700cd400 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fe7700c8d90 tx=0x7fe768009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:14.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.271+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768007de0 con 0x7fe7700ccf80 2023-08-09T12:54:14.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.271+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe768014400 con 0x7fe7700ccf80 2023-08-09T12:54:14.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.271+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7700ce2a0 con 0x7fe7700ccf80 2023-08-09T12:54:14.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.271+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7680147b0 con 0x7fe7700ccf80 2023-08-09T12:54:14.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.271+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7700ae470 con 0x7fe7700ccf80 2023-08-09T12:54:14.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.272+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7700ae690 con 0x7fe7700ccf80 2023-08-09T12:54:14.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.273+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe76801d3b0 con 0x7fe7700ccf80 2023-08-09T12:54:14.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.274+0000 7fe765ffb640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe75406a080 0x7fe75406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:14.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.274+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe768088580 con 0x7fe7700ccf80 2023-08-09T12:54:14.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.274+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7fe7540722e0 con 0x7fe7700ccf80 2023-08-09T12:54:14.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.275+0000 7fe77536b640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe75406a080 0x7fe75406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:14.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.276+0000 7fe77536b640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe75406a080 0x7fe75406c540 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0017a0 tx=0x7fe76c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:14.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.279+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe768019060 con 0x7fe7700ccf80 2023-08-09T12:54:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:14.472+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe770067a80 con 0x7fe7700ccf80 2023-08-09T12:54:15.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.214+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(197..197 src has 1..197) v4 ==== 296+0+0 (secure 0 0 0) 0x7fe768057e30 con 0x7fe7700ccf80 2023-08-09T12:54:15.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.214+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=198}) v3 -- 0x7fe754070710 con 0x7fe7700ccf80 2023-08-09T12:54:15.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.223+0000 7fe765ffb640 1 -- 172.21.15.17:0/803226344 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v197) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe768057570 con 0x7fe7700ccf80 2023-08-09T12:54:15.233 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-08-09T12:54:15.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.235+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe75406a080 msgr2=0x7fe75406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:15.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.235+0000 7fe7775cf640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe75406a080 0x7fe75406c540 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0017a0 tx=0x7fe76c009040 comp rx=0 tx=0).stop 2023-08-09T12:54:15.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.235+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7700ccf80 msgr2=0x7fe7700cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.235+0000 7fe7775cf640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7700ccf80 0x7fe7700cd400 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fe7700c8d90 tx=0x7fe768009dc0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.236+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 shutdown_connections 2023-08-09T12:54:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.236+0000 7fe7775cf640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe75406a080 0x7fe75406c540 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.236+0000 7fe7775cf640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7700ccf80 0x7fe7700cd400 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.236+0000 7fe7775cf640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7700ce720 0x7fe7700ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.236+0000 7fe7775cf640 1 --2- 172.21.15.17:0/803226344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe75c0047c0 0x7fe77014a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.236+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 >> 172.21.15.17:0/803226344 conn(0x7fe7700697c0 msgr2=0x7fe770159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:15.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.236+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 shutdown_connections 2023-08-09T12:54:15.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.237+0000 7fe7775cf640 1 -- 172.21.15.17:0/803226344 wait complete. 2023-08-09T12:54:15.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-09T12:54:15.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.489+0000 7fb08a5e8640 1 Processor -- start 2023-08-09T12:54:15.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.489+0000 7fb08a5e8640 1 -- start start 2023-08-09T12:54:15.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.491+0000 7fb08a5e8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb0840ca850 0x7fb084070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.491+0000 7fb08a5e8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 0x7fb08406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.491+0000 7fb08a5e8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840cd030 con 0x7fb0840cd4c0 2023-08-09T12:54:15.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.491+0000 7fb08a5e8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08406c220 con 0x7fb0840ca850 2023-08-09T12:54:15.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.491+0000 7fb08a5e8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840cc420 con 0x7fb0840cb8d0 2023-08-09T12:54:15.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.491+0000 7fb07b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb0840cd4c0 0x7fb0840cb1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53960/0 (socket says 172.21.15.17:53960) 2023-08-09T12:54:15.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.491+0000 7fb07b7fe640 1 -- 172.21.15.17:0/1176310482 learned_addr learned my addr 172.21.15.17:0/1176310482 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:15.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408483715 0 0) 0x7fb0840cd030 con 0x7fb0840cd4c0 2023-08-09T12:54:15.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb083fff640 1 --2- 172.21.15.17:0/1176310482 >> v2:172.21.15.142:3300/0 conn(0x7fb0840ca850 0x7fb084070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb088b85640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 0x7fb08406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb070003520 con 0x7fb0840cd4c0 2023-08-09T12:54:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2216556009 0 0) 0x7fb070003520 con 0x7fb0840cd4c0 2023-08-09T12:54:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 msgr2=0x7fb08406bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 0x7fb08406bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 >> v2:172.21.15.142:3300/0 conn(0x7fb0840ca850 msgr2=0x7fb084070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 --2- 172.21.15.17:0/1176310482 >> v2:172.21.15.142:3300/0 conn(0x7fb0840ca850 0x7fb084070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840cc700 con 0x7fb0840cd4c0 2023-08-09T12:54:15.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fb06c001670 con 0x7fb0840cd4c0 2023-08-09T12:54:15.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb088b85640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 0x7fb08406bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:54:15.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb083fff640 1 --2- 172.21.15.17:0/1176310482 >> v2:172.21.15.142:3300/0 conn(0x7fb0840ca850 0x7fb084070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:54:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 >> v1:172.21.15.17:6789/0 conn(0x7fb0840cd4c0 legacy=0x7fb0840cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 0x7fb070003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb070003f60 0x7fb0700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb070005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840cc420 con 0x7fb070004d00 2023-08-09T12:54:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07000b9e0 con 0x7fb070003f60 2023-08-09T12:54:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.492+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07000bba0 con 0x7fb0840cb8d0 2023-08-09T12:54:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.493+0000 7fb088b85640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb070005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.493+0000 7fb083fff640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 0x7fb070003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.493+0000 7fb07b7fe640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb070003f60 0x7fb0700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.493+0000 7fb088b85640 1 -- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 msgr2=0x7fb070003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.493+0000 7fb088b85640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840cb8d0 0x7fb070003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.493+0000 7fb088b85640 1 -- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb070003f60 msgr2=0x7fb0700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.493+0000 7fb088b85640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb070003f60 0x7fb0700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.493+0000 7fb088b85640 1 -- 172.21.15.17:0/1176310482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070003520 con 0x7fb070004d00 2023-08-09T12:54:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.494+0000 7fb088b85640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb070005180 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0098a0 tx=0x7fb0700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9dcabd445d5b59 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c004230 con 0x7fb070004d00 2023-08-09T12:54:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c004390 con 0x7fb070004d00 2023-08-09T12:54:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb0837fe640 1 -- 172.21.15.17:0/1176310482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c003830 con 0x7fb070004d00 2023-08-09T12:54:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb08a5e8640 1 -- 172.21.15.17:0/1176310482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 msgr2=0x7fb070005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb08a5e8640 1 --2- 172.21.15.17:0/1176310482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb070005180 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0098a0 tx=0x7fb0700057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb088b85640 1 -- 172.21.15.17:0/1176310482 reap_dead start 2023-08-09T12:54:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb08a5e8640 1 -- 172.21.15.17:0/1176310482 shutdown_connections 2023-08-09T12:54:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb08a5e8640 1 -- 172.21.15.17:0/1176310482 >> 172.21.15.17:0/1176310482 conn(0x7fb0840697c0 msgr2=0x7fb084069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb08a5e8640 1 -- 172.21.15.17:0/1176310482 shutdown_connections 2023-08-09T12:54:15.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.495+0000 7fb08a5e8640 1 -- 172.21.15.17:0/1176310482 wait complete. 2023-08-09T12:54:15.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.497+0000 7fb08a5e8640 1 Processor -- start 2023-08-09T12:54:15.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.498+0000 7fb08a5e8640 1 -- start start 2023-08-09T12:54:15.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb08a5e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb08415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb08a5e8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840c35e0 0x7fb0840c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb08a5e8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0840c3a60 0x7fb0840c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb08a5e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c4030 con 0x7fb070004d00 2023-08-09T12:54:15.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb08a5e8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c4310 con 0x7fb0840c3a60 2023-08-09T12:54:15.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb08a5e8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c45f0 con 0x7fb0840c35e0 2023-08-09T12:54:15.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb083fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb08415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb083fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb08415beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47100/0 (socket says 172.21.15.17:47100) 2023-08-09T12:54:15.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb083fff640 1 -- 172.21.15.17:0/224941501 learned_addr learned my addr 172.21.15.17:0/224941501 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:15.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb07b7fe640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840c35e0 0x7fb0840c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb083fff640 1 -- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840c35e0 msgr2=0x7fb0840c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:15.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb088b85640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0840c3a60 0x7fb0840c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb083fff640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840c35e0 0x7fb0840c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb083fff640 1 -- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0840c3a60 msgr2=0x7fb0840c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:15.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb083fff640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0840c3a60 0x7fb0840c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:15.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb083fff640 1 -- 172.21.15.17:0/224941501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840c48d0 con 0x7fb070004d00 2023-08-09T12:54:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb07b7fe640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840c35e0 0x7fb0840c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.499+0000 7fb088b85640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0840c3a60 0x7fb0840c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.500+0000 7fb083fff640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb08415beb0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fb074004660 tx=0x7fb074007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.500+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074014610 con 0x7fb070004d00 2023-08-09T12:54:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.500+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400f050 con 0x7fb070004d00 2023-08-09T12:54:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.500+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074014970 con 0x7fb070004d00 2023-08-09T12:54:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.500+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840c4bb0 con 0x7fb070004d00 2023-08-09T12:54:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.500+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840b2000 con 0x7fb070004d00 2023-08-09T12:54:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.501+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb084067a80 con 0x7fb070004d00 2023-08-09T12:54:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.502+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb074014ad0 con 0x7fb070004d00 2023-08-09T12:54:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.503+0000 7fb0817fa640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb06406a050 0x7fb06406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.503+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fb074088de0 con 0x7fb070004d00 2023-08-09T12:54:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.504+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=198}) v3 -- 0x7fb064071440 con 0x7fb070004d00 2023-08-09T12:54:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.504+0000 7fb07b7fe640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb06406a050 0x7fb06406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.505+0000 7fb07b7fe640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb06406a050 0x7fb06406c510 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb06c001eb0 tx=0x7fb06c000fb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.508+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb074054620 con 0x7fb070004d00 2023-08-09T12:54:15.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:15.704+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb08406ac70 con 0x7fb070004d00 2023-08-09T12:54:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.217+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 <== mon.0 v2:172.21.15.17:3300/0 7 ==== osd_map(198..198 src has 1..198) v4 ==== 296+0+0 (secure 0 0 0) 0x7fb074003e80 con 0x7fb070004d00 2023-08-09T12:54:16.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.217+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=199}) v3 -- 0x7fb0640701d0 con 0x7fb070004d00 2023-08-09T12:54:16.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.239+0000 7fb0817fa640 1 -- 172.21.15.17:0/224941501 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v198) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb074057c40 con 0x7fb070004d00 2023-08-09T12:54:16.249 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-08-09T12:54:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb06406a050 msgr2=0x7fb06406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb06406a050 0x7fb06406c510 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb06c001eb0 tx=0x7fb06c000fb0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 msgr2=0x7fb08415beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb08415beb0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fb074004660 tx=0x7fb074007700 comp rx=0 tx=0).stop 2023-08-09T12:54:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 shutdown_connections 2023-08-09T12:54:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb06406a050 0x7fb06406c510 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0840c3a60 0x7fb0840c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0840c35e0 0x7fb0840c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 --2- 172.21.15.17:0/224941501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb070004d00 0x7fb08415beb0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 >> 172.21.15.17:0/224941501 conn(0x7fb0840697c0 msgr2=0x7fb0840afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 shutdown_connections 2023-08-09T12:54:16.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.250+0000 7fb08a5e8640 1 -- 172.21.15.17:0/224941501 wait complete. 2023-08-09T12:54:16.273 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-09T12:54:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.484+0000 7ff070dfc640 1 Processor -- start 2023-08-09T12:54:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.484+0000 7ff070dfc640 1 -- start start 2023-08-09T12:54:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.486+0000 7ff070dfc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c0ca390 0x7ff06c0697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.486+0000 7ff070dfc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c0cb6b0 con 0x7ff06c153e40 2023-08-09T12:54:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.486+0000 7ff070dfc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c0ceaf0 con 0x7ff06c0ca9a0 2023-08-09T12:54:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.486+0000 7ff070dfc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c06b1b0 con 0x7ff06c0ca390 2023-08-09T12:54:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.486+0000 7ff06b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff06c153e40 0x7ff06c0cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53972/0 (socket says 172.21.15.17:53972) 2023-08-09T12:54:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.486+0000 7ff06b7fe640 1 -- 172.21.15.17:0/2099467133 learned_addr learned my addr 172.21.15.17:0/2099467133 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06bfff640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c0ca390 0x7ff06c0697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391769284 0 0) 0x7ff05c001490 con 0x7ff06c153e40 2023-08-09T12:54:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff054005730 con 0x7ff06c153e40 2023-08-09T12:54:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650601510 0 0) 0x7ff054005730 con 0x7ff06c153e40 2023-08-09T12:54:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c0ca390 msgr2=0x7ff06c0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c0ca390 0x7ff06c0697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 >> v1:172.21.15.142:6789/0 conn(0x7ff06c0ca9a0 legacy=0x7ff06c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c0cb3d0 con 0x7ff06c153e40 2023-08-09T12:54:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7ff05c001b80 con 0x7ff06c153e40 2023-08-09T12:54:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 >> v1:172.21.15.17:6789/0 conn(0x7ff06c153e40 legacy=0x7ff06c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c0ca390 0x7ff054005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff0540069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff054006f10 0x7ff054007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c06b1b0 con 0x7ff0540061e0 2023-08-09T12:54:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05400dd50 con 0x7ff054006f10 2023-08-09T12:54:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.487+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05400df10 con 0x7ff06c0ca390 2023-08-09T12:54:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06affd640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff0540069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06b7fe640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c0ca390 0x7ff054005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06bfff640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff054006f10 0x7ff054007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06affd640 1 -- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c0ca390 msgr2=0x7ff054005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06affd640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c0ca390 0x7ff054005bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06affd640 1 -- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff054006f10 msgr2=0x7ff054007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06affd640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff054006f10 0x7ff054007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06affd640 1 -- 172.21.15.17:0/2099467133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054005730 con 0x7ff0540061e0 2023-08-09T12:54:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.488+0000 7ff06bfff640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff054006f10 0x7ff054007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.489+0000 7ff06affd640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff0540069d0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7ff060001750 tx=0x7ff054007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d9805cbb917caf server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.489+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600052d0 con 0x7ff0540061e0 2023-08-09T12:54:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.489+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06002e050 con 0x7ff0540061e0 2023-08-09T12:54:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.490+0000 7ff06a7fc640 1 -- 172.21.15.17:0/2099467133 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060003830 con 0x7ff0540061e0 2023-08-09T12:54:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.490+0000 7ff070dfc640 1 -- 172.21.15.17:0/2099467133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 msgr2=0x7ff0540069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.490+0000 7ff070dfc640 1 --2- 172.21.15.17:0/2099467133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff0540069d0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7ff060001750 tx=0x7ff054007a00 comp rx=0 tx=0).stop 2023-08-09T12:54:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.490+0000 7ff06bfff640 1 -- 172.21.15.17:0/2099467133 reap_dead start 2023-08-09T12:54:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.490+0000 7ff070dfc640 1 -- 172.21.15.17:0/2099467133 shutdown_connections 2023-08-09T12:54:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.490+0000 7ff070dfc640 1 -- 172.21.15.17:0/2099467133 >> 172.21.15.17:0/2099467133 conn(0x7ff06c0b1390 msgr2=0x7ff06c0b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.490+0000 7ff070dfc640 1 -- 172.21.15.17:0/2099467133 shutdown_connections 2023-08-09T12:54:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.490+0000 7ff070dfc640 1 -- 172.21.15.17:0/2099467133 wait complete. 2023-08-09T12:54:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.492+0000 7ff070dfc640 1 Processor -- start 2023-08-09T12:54:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.492+0000 7ff070dfc640 1 -- start start 2023-08-09T12:54:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.493+0000 7ff070dfc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff06c143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.493+0000 7ff070dfc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06c0c8a10 0x7ff06c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff070dfc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c146520 0x7ff06c1469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff070dfc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0c93d0 con 0x7ff0540061e0 2023-08-09T12:54:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff070dfc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c144610 con 0x7ff06c0c8a10 2023-08-09T12:54:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff070dfc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c147250 con 0x7ff06c146520 2023-08-09T12:54:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff06c143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff06c143bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47116/0 (socket says 172.21.15.17:47116) 2023-08-09T12:54:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06b7fe640 1 -- 172.21.15.17:0/4012117670 learned_addr learned my addr 172.21.15.17:0/4012117670 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06bfff640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c146520 0x7ff06c1469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06affd640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06c0c8a10 0x7ff06c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06b7fe640 1 -- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c146520 msgr2=0x7ff06c1469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06b7fe640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c146520 0x7ff06c1469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06b7fe640 1 -- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06c0c8a10 msgr2=0x7ff06c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06b7fe640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06c0c8a10 0x7ff06c0c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.494+0000 7ff06b7fe640 1 -- 172.21.15.17:0/4012117670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c1448d0 con 0x7ff0540061e0 2023-08-09T12:54:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.495+0000 7ff06b7fe640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff06c143bc0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0015f0 tx=0x7ff05c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.495+0000 7ff053fff640 1 -- 172.21.15.17:0/4012117670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c004d60 con 0x7ff0540061e0 2023-08-09T12:54:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.495+0000 7ff053fff640 1 -- 172.21.15.17:0/4012117670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c00be80 con 0x7ff0540061e0 2023-08-09T12:54:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.495+0000 7ff053fff640 1 -- 172.21.15.17:0/4012117670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0072d0 con 0x7ff0540061e0 2023-08-09T12:54:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.495+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c144bb0 con 0x7ff0540061e0 2023-08-09T12:54:16.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.495+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c146ee0 con 0x7ff0540061e0 2023-08-09T12:54:16.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.496+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c04e390 con 0x7ff0540061e0 2023-08-09T12:54:16.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.498+0000 7ff053fff640 1 -- 172.21.15.17:0/4012117670 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff05c007430 con 0x7ff0540061e0 2023-08-09T12:54:16.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.498+0000 7ff053fff640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff05806a080 0x7ff05806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.499+0000 7ff053fff640 1 -- 172.21.15.17:0/4012117670 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff05c088100 con 0x7ff0540061e0 2023-08-09T12:54:16.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.499+0000 7ff06affd640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff05806a080 0x7ff05806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.500+0000 7ff06affd640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff05806a080 0x7ff05806c540 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff060033000 tx=0x7ff060009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.503+0000 7ff053fff640 1 -- 172.21.15.17:0/4012117670 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff05c053af0 con 0x7ff0540061e0 2023-08-09T12:54:16.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.699+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff06c0cb6b0 con 0x7ff0540061e0 2023-08-09T12:54:16.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.705+0000 7ff053fff640 1 -- 172.21.15.17:0/4012117670 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff06c0cb6b0 con 0x7ff0540061e0 2023-08-09T12:54:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.708+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff05806a080 msgr2=0x7ff05806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.708+0000 7ff070dfc640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff05806a080 0x7ff05806c540 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff060033000 tx=0x7ff060009030 comp rx=0 tx=0).stop 2023-08-09T12:54:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 msgr2=0x7ff06c143bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff06c143bc0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0015f0 tx=0x7ff05c00b4a0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 shutdown_connections 2023-08-09T12:54:16.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff05806a080 0x7ff05806c540 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff06c146520 0x7ff06c1469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff06c0c8a10 0x7ff06c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 --2- 172.21.15.17:0/4012117670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540061e0 0x7ff06c143bc0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 >> 172.21.15.17:0/4012117670 conn(0x7ff06c0b1390 msgr2=0x7ff06c0b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 shutdown_connections 2023-08-09T12:54:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.709+0000 7ff070dfc640 1 -- 172.21.15.17:0/4012117670 wait complete. 2023-08-09T12:54:16.733 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-08-09T12:54:16.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.966+0000 7f8ef48f3640 1 Processor -- start 2023-08-09T12:54:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.966+0000 7f8ef48f3640 1 -- start start 2023-08-09T12:54:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.967+0000 7f8ef48f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef015cd10 0x7f8ef006acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.967+0000 7f8ef48f3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef015d0f0 con 0x7f8ef00b1e90 2023-08-09T12:54:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.967+0000 7f8ef48f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef0069c30 con 0x7f8ef00b1a70 2023-08-09T12:54:16.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.967+0000 7f8ef48f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef006b210 con 0x7f8ef015cd10 2023-08-09T12:54:16.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.968+0000 7f8eeffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8ef00b1e90 0x7f8ef00b5a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53980/0 (socket says 172.21.15.17:53980) 2023-08-09T12:54:16.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.968+0000 7f8eeffff640 1 -- 172.21.15.17:0/4010822299 learned_addr learned my addr 172.21.15.17:0/4010822299 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.968+0000 7f8eef7fe640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef015cd10 0x7f8ef006acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995222911 0 0) 0x7f8ef015d0f0 con 0x7f8ef00b1e90 2023-08-09T12:54:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed8003520 con 0x7f8ef00b1e90 2023-08-09T12:54:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221435084 0 0) 0x7f8ef0069c30 con 0x7f8ef00b1a70 2023-08-09T12:54:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef015d0f0 con 0x7f8ef00b1a70 2023-08-09T12:54:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2279659645 0 0) 0x7f8ed8003520 con 0x7f8ef00b1e90 2023-08-09T12:54:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef015cd10 msgr2=0x7f8ef006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef015cd10 0x7f8ef006acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 >> v1:172.21.15.142:6789/0 conn(0x7f8ef00b1a70 legacy=0x7f8ef00cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef0069f10 con 0x7f8ef00b1e90 2023-08-09T12:54:16.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f8ee8001670 con 0x7f8ef00b1e90 2023-08-09T12:54:16.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 >> v1:172.21.15.17:6789/0 conn(0x7f8ef00b1e90 legacy=0x7f8ef00b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef015cd10 0x7f8ed8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ed8004090 0x7f8ed80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.969+0000 7f8eee7fc640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ed8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef006b210 con 0x7f8ed8004d00 2023-08-09T12:54:16.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800ba60 con 0x7f8ed8004090 2023-08-09T12:54:16.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800bc20 con 0x7f8ef015cd10 2023-08-09T12:54:16.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eeffff640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ed8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eef7fe640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef015cd10 0x7f8ed8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eeffff640 1 -- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef015cd10 msgr2=0x7f8ed8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:16.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eeffff640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef015cd10 0x7f8ed8003b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eeffff640 1 -- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ed8004090 msgr2=0x7f8ed80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:16.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eeeffd640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ed8004090 0x7f8ed80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eeffff640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ed8004090 0x7f8ed80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.970+0000 7f8eeffff640 1 -- 172.21.15.17:0/4010822299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8003520 con 0x7f8ed8004d00 2023-08-09T12:54:16.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.971+0000 7f8eeffff640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ed8005180 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f8ef008be50 tx=0x7f8ed80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204a2cb6ca52f4ac server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:16.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8005ad0 con 0x7f8ed8004d00 2023-08-09T12:54:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8005c50 con 0x7f8ed8004d00 2023-08-09T12:54:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8eee7fc640 1 -- 172.21.15.17:0/4010822299 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee802c7e0 con 0x7f8ed8004d00 2023-08-09T12:54:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8ef48f3640 1 -- 172.21.15.17:0/4010822299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 msgr2=0x7f8ed8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8ef48f3640 1 --2- 172.21.15.17:0/4010822299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ed8005180 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f8ef008be50 tx=0x7f8ed80057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8eeffff640 1 -- 172.21.15.17:0/4010822299 reap_dead start 2023-08-09T12:54:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8ef48f3640 1 -- 172.21.15.17:0/4010822299 shutdown_connections 2023-08-09T12:54:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8ef48f3640 1 -- 172.21.15.17:0/4010822299 >> 172.21.15.17:0/4010822299 conn(0x7f8ef00d2a10 msgr2=0x7f8ef00d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:16.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8ef48f3640 1 -- 172.21.15.17:0/4010822299 shutdown_connections 2023-08-09T12:54:16.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.972+0000 7f8ef48f3640 1 -- 172.21.15.17:0/4010822299 wait complete. 2023-08-09T12:54:16.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.974+0000 7f8ef48f3640 1 Processor -- start 2023-08-09T12:54:16.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.974+0000 7f8ef48f3640 1 -- start start 2023-08-09T12:54:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.975+0000 7f8ef48f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ef00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.975+0000 7f8ef48f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef0151b10 0x7f8ef0151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.975+0000 7f8ef48f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef00a95f0 0x7f8ef00a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.975+0000 7f8ef48f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef01524d0 con 0x7f8ed8004d00 2023-08-09T12:54:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.975+0000 7f8ef48f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00aa3b0 con 0x7f8ef0151b10 2023-08-09T12:54:16.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.975+0000 7f8ef48f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00aa690 con 0x7f8ef00a95f0 2023-08-09T12:54:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.976+0000 7f8eef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ef00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.976+0000 7f8eef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ef00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47140/0 (socket says 172.21.15.17:47140) 2023-08-09T12:54:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.976+0000 7f8eef7fe640 1 -- 172.21.15.17:0/2558212137 learned_addr learned my addr 172.21.15.17:0/2558212137 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:16.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.976+0000 7f8eef7fe640 1 -- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef00a95f0 msgr2=0x7f8ef00a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.976+0000 7f8eef7fe640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef00a95f0 0x7f8ef00a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.976+0000 7f8eef7fe640 1 -- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef0151b10 msgr2=0x7f8ef0151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.976+0000 7f8eef7fe640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef0151b10 0x7f8ef0151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.976+0000 7f8eef7fe640 1 -- 172.21.15.17:0/2558212137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00aa970 con 0x7f8ed8004d00 2023-08-09T12:54:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.977+0000 7f8eef7fe640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ef00b3940 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000f350 tx=0x7f8ee000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.977+0000 7f8ed7fff640 1 -- 172.21.15.17:0/2558212137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000fee0 con 0x7f8ed8004d00 2023-08-09T12:54:16.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.977+0000 7f8ed7fff640 1 -- 172.21.15.17:0/2558212137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee0011040 con 0x7f8ed8004d00 2023-08-09T12:54:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.977+0000 7f8ed7fff640 1 -- 172.21.15.17:0/2558212137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0017860 con 0x7f8ed8004d00 2023-08-09T12:54:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.977+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef00aac50 con 0x7f8ed8004d00 2023-08-09T12:54:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.977+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef00a9f90 con 0x7f8ed8004d00 2023-08-09T12:54:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.978+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef004e390 con 0x7f8ed8004d00 2023-08-09T12:54:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.979+0000 7f8ed7fff640 1 -- 172.21.15.17:0/2558212137 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ee00179c0 con 0x7f8ed8004d00 2023-08-09T12:54:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.980+0000 7f8ed7fff640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8edc06a080 0x7f8edc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:16.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.980+0000 7f8ed7fff640 1 -- 172.21.15.17:0/2558212137 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8ee0088950 con 0x7f8ed8004d00 2023-08-09T12:54:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.981+0000 7f8eeeffd640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8edc06a080 0x7f8edc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:16.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.982+0000 7f8eeeffd640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8edc06a080 0x7f8edc06c540 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4007fd0 tx=0x7f8ee4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:16.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:16.985+0000 7f8ed7fff640 1 -- 172.21.15.17:0/2558212137 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f8ee0054380 con 0x7f8ed8004d00 2023-08-09T12:54:17.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:17.258+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f8ef00d3860 con 0x7f8ed8004d00 2023-08-09T12:54:18.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.254+0000 7f8ed7fff640 1 -- 172.21.15.17:0/2558212137 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v717) v1 ==== 135+0+0 (secure 0 0 0) 0x7f8ee001c070 con 0x7f8ed8004d00 2023-08-09T12:54:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.257+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8edc06a080 msgr2=0x7f8edc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.257+0000 7f8ef48f3640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8edc06a080 0x7f8edc06c540 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4007fd0 tx=0x7f8ee4009040 comp rx=0 tx=0).stop 2023-08-09T12:54:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.257+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 msgr2=0x7f8ef00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.257+0000 7f8ef48f3640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ef00b3940 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000f350 tx=0x7f8ee000f810 comp rx=0 tx=0).stop 2023-08-09T12:54:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.258+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 shutdown_connections 2023-08-09T12:54:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.258+0000 7f8ef48f3640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f8edc06a080 0x7f8edc06c540 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.258+0000 7f8ef48f3640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ef00a95f0 0x7f8ef00a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.258+0000 7f8ef48f3640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ef0151b10 0x7f8ef0151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.258+0000 7f8ef48f3640 1 --2- 172.21.15.17:0/2558212137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8004d00 0x7f8ef00b3940 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.258+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 >> 172.21.15.17:0/2558212137 conn(0x7f8ef00d2a10 msgr2=0x7f8ef00b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.258+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 shutdown_connections 2023-08-09T12:54:18.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:18.258+0000 7f8ef48f3640 1 -- 172.21.15.17:0/2558212137 wait complete. 2023-08-09T12:54:18.282 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-08-09T12:54:18.282 INFO:tasks.cephfs_test_runner: 2023-08-09T12:54:18.283 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-09T12:54:18.283 INFO:tasks.cephfs_test_runner:Ran 10 tests in 852.189s 2023-08-09T12:54:18.283 INFO:tasks.cephfs_test_runner: 2023-08-09T12:54:18.283 INFO:tasks.cephfs_test_runner:OK 2023-08-09T12:54:18.284 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-09T12:54:18.294 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-09T12:54:18.337 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-09T12:54:18.338 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:54:18.338 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:18.404 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:54:18.405 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-08-09T12:54:18.405 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:18.465 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054441,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249420k,nr_inodes=812355,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498844k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-09T12:54:18.466 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:54:18.466 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:18.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:54:18.527 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-08-09T12:54:18.527 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-09T12:54:18.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053656,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248792k,nr_inodes=812198,mode=700,uid=1000,gid=1275 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497588k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-09T12:54:18.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:18.588 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:54:18.650 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-09T12:54:18.650 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-09T12:54:18.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:18.651 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-09T12:54:18.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:18.759 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-09T12:54:18.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:18.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-08-09T12:54:18.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:18.972 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-08-09T12:54:19.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:19.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-08-09T12:54:19.105 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2023-08-09T12:54:19.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:54:19.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:19.109 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:54:19.169 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-09T12:54:19.169 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-09T12:54:19.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:19.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-09T12:54:19.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:19.278 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-09T12:54:19.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:19.368 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-08-09T12:54:19.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:19.498 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-08-09T12:54:19.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-09T12:54:19.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-08-09T12:54:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-08-09T12:54:19.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:54:19.676 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-09T12:54:19.691 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-09T12:54:19.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:54:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.936+0000 7ff21e399640 1 Processor -- start 2023-08-09T12:54:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.936+0000 7ff21e399640 1 -- start start 2023-08-09T12:54:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.938+0000 7ff21e399640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff218164f50 0x7ff2180cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.938+0000 7ff21e399640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2180c1980 0x7ff218165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.938+0000 7ff21e399640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff218165870 0x7ff2180c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.938+0000 7ff21e399640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180cd520 con 0x7ff218165870 2023-08-09T12:54:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.938+0000 7ff21e399640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180cc630 con 0x7ff218164f50 2023-08-09T12:54:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.938+0000 7ff21e399640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180cc910 con 0x7ff2180c1980 2023-08-09T12:54:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff21c936640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff218165870 0x7ff2180c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff21c936640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff218165870 0x7ff2180c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52064/0 (socket says 172.21.15.17:52064) 2023-08-09T12:54:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff21c936640 1 -- 172.21.15.17:0/229282906 learned_addr learned my addr 172.21.15.17:0/229282906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff2177fe640 1 --2- 172.21.15.17:0/229282906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2180c1980 0x7ff218165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff217fff640 1 --2- 172.21.15.17:0/229282906 >> v2:172.21.15.142:3300/0 conn(0x7ff218164f50 0x7ff2180cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff21c936640 1 -- 172.21.15.17:0/229282906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2180c1980 msgr2=0x7ff218165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff21c936640 1 --2- 172.21.15.17:0/229282906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2180c1980 0x7ff218165330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff21c936640 1 -- 172.21.15.17:0/229282906 >> v2:172.21.15.142:3300/0 conn(0x7ff218164f50 msgr2=0x7ff2180cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff21c936640 1 --2- 172.21.15.17:0/229282906 >> v2:172.21.15.142:3300/0 conn(0x7ff218164f50 0x7ff2180cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff21c936640 1 -- 172.21.15.17:0/229282906 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180ccbf0 con 0x7ff218165870 2023-08-09T12:54:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.939+0000 7ff2177fe640 1 --2- 172.21.15.17:0/229282906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2180c1980 0x7ff218165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.940+0000 7ff21c936640 1 --2- 172.21.15.17:0/229282906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180c9290 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7ff2180ce4b0 tx=0x7ff21002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2614096b42d6959 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.941+0000 7ff216ffd640 1 -- 172.21.15.17:0/229282906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210031870 con 0x7ff218165870 2023-08-09T12:54:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.941+0000 7ff216ffd640 1 -- 172.21.15.17:0/229282906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100319d0 con 0x7ff218165870 2023-08-09T12:54:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.941+0000 7ff216ffd640 1 -- 172.21.15.17:0/229282906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210031d60 con 0x7ff218165870 2023-08-09T12:54:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 -- 172.21.15.17:0/229282906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 msgr2=0x7ff2180c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 --2- 172.21.15.17:0/229282906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180c9290 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7ff2180ce4b0 tx=0x7ff21002b910 comp rx=0 tx=0).stop 2023-08-09T12:54:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 -- 172.21.15.17:0/229282906 shutdown_connections 2023-08-09T12:54:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 --2- 172.21.15.17:0/229282906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180c9290 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:19.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 --2- 172.21.15.17:0/229282906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2180c1980 0x7ff218165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:19.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 --2- 172.21.15.17:0/229282906 >> v2:172.21.15.142:3300/0 conn(0x7ff218164f50 0x7ff2180cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:19.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 -- 172.21.15.17:0/229282906 >> 172.21.15.17:0/229282906 conn(0x7ff2180cb1b0 msgr2=0x7ff2180cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:19.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 -- 172.21.15.17:0/229282906 shutdown_connections 2023-08-09T12:54:19.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.942+0000 7ff21e399640 1 -- 172.21.15.17:0/229282906 wait complete. 2023-08-09T12:54:19.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.944+0000 7ff21e399640 1 Processor -- start 2023-08-09T12:54:19.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.945+0000 7ff21e399640 1 -- start start 2023-08-09T12:54:19.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.946+0000 7ff21e399640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2180c1980 0x7ff2180697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:19.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.946+0000 7ff21e399640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff218164f50 0x7ff2180b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:19.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.946+0000 7ff21e399640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:19.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.946+0000 7ff21e399640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c3790 con 0x7ff218165870 2023-08-09T12:54:19.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.946+0000 7ff21e399640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff218069d00 con 0x7ff2180c1980 2023-08-09T12:54:19.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.946+0000 7ff21e399640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c5140 con 0x7ff218164f50 2023-08-09T12:54:19.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.946+0000 7ff21c936640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:19.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff21c936640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52080/0 (socket says 172.21.15.17:52080) 2023-08-09T12:54:19.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff21c936640 1 -- 172.21.15.17:0/657856278 learned_addr learned my addr 172.21.15.17:0/657856278 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:19.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff217fff640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2180c1980 0x7ff2180697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:19.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff2177fe640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff218164f50 0x7ff2180b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:19.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff21c936640 1 -- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff218164f50 msgr2=0x7ff2180b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:19.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff21c936640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff218164f50 0x7ff2180b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:19.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff21c936640 1 -- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2180c1980 msgr2=0x7ff2180697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:19.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff21c936640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2180c1980 0x7ff2180697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:19.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.947+0000 7ff21c936640 1 -- 172.21.15.17:0/657856278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100094d0 con 0x7ff218165870 2023-08-09T12:54:19.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.948+0000 7ff21c936640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180b2eb0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7ff21002b950 tx=0x7ff2100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:19.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.948+0000 7ff214ff9640 1 -- 172.21.15.17:0/657856278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21003adf0 con 0x7ff218165870 2023-08-09T12:54:19.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.948+0000 7ff214ff9640 1 -- 172.21.15.17:0/657856278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100443f0 con 0x7ff218165870 2023-08-09T12:54:19.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.948+0000 7ff214ff9640 1 -- 172.21.15.17:0/657856278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100447a0 con 0x7ff218165870 2023-08-09T12:54:19.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.948+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2180b3be0 con 0x7ff218165870 2023-08-09T12:54:19.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.948+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21806a350 con 0x7ff218165870 2023-08-09T12:54:19.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.950+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2180c38d0 con 0x7ff218165870 2023-08-09T12:54:19.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.951+0000 7ff214ff9640 1 -- 172.21.15.17:0/657856278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff210044900 con 0x7ff218165870 2023-08-09T12:54:19.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.952+0000 7ff214ff9640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff20406a080 0x7ff20406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:19.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.952+0000 7ff214ff9640 1 -- 172.21.15.17:0/657856278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff21002d040 con 0x7ff218165870 2023-08-09T12:54:19.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.953+0000 7ff217fff640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff20406a080 0x7ff20406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:19.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.954+0000 7ff217fff640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff20406a080 0x7ff20406c540 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff2080070b0 tx=0x7ff208007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:19.957+0000 7ff214ff9640 1 -- 172.21.15.17:0/657856278 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7ff2180c38d0 con 0x7ff218165870 2023-08-09T12:54:20.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.147+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2180cd1b0 con 0x7ff20406a080 2023-08-09T12:54:20.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.155+0000 7ff214ff9640 1 -- 172.21.15.17:0/657856278 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67784 (secure 0 0 0) 0x7ff208013070 con 0x7ff20406a080 2023-08-09T12:54:20.159 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:54:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.157+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff20406a080 msgr2=0x7ff20406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.157+0000 7ff21e399640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff20406a080 0x7ff20406c540 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff2080070b0 tx=0x7ff208007040 comp rx=0 tx=0).stop 2023-08-09T12:54:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.157+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 msgr2=0x7ff2180b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.157+0000 7ff21e399640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180b2eb0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7ff21002b950 tx=0x7ff2100046c0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.158+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 shutdown_connections 2023-08-09T12:54:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.158+0000 7ff21e399640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7ff20406a080 0x7ff20406c540 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.158+0000 7ff21e399640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff218165870 0x7ff2180b2eb0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.158+0000 7ff21e399640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff218164f50 0x7ff2180b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.158+0000 7ff21e399640 1 --2- 172.21.15.17:0/657856278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2180c1980 0x7ff2180697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.158+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 >> 172.21.15.17:0/657856278 conn(0x7ff2180cb1b0 msgr2=0x7ff2180aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.158+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 shutdown_connections 2023-08-09T12:54:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.158+0000 7ff21e399640 1 -- 172.21.15.17:0/657856278 wait complete. 2023-08-09T12:54:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":645,"stamp":"2023-08-09T12:54:18.981369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":37065,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1525434,"statfs":{"total":1600000000,"available":1562044428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490893,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-127,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002406"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":518,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.236579+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:54:16.236579+0000","last_peered":"2023-08-09T12:54:16.236579+0000","last_clean":"2023-08-09T12:54:16.236579+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:54:16.236579+0000","last_undegraded":"2023-08-09T12:54:16.236579+0000","last_fullsized":"2023-08-09T12:54:16.236579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:19:40.258128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.234091+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:54:16.234091+0000","last_peered":"2023-08-09T12:54:16.234091+0000","last_clean":"2023-08-09T12:54:16.234091+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:54:16.234091+0000","last_undegraded":"2023-08-09T12:54:16.234091+0000","last_fullsized":"2023-08-09T12:54:16.234091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:44:27.556881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":362,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.235474+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:54:16.235474+0000","last_peered":"2023-08-09T12:54:16.235474+0000","last_clean":"2023-08-09T12:54:16.235474+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:54:16.235474+0000","last_undegraded":"2023-08-09T12:54:16.235474+0000","last_fullsized":"2023-08-09T12:54:16.235474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:46.960577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":336,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.229044+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:54:16.229044+0000","last_peered":"2023-08-09T12:54:16.229044+0000","last_clean":"2023-08-09T12:54:16.229044+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:54:16.229044+0000","last_undegraded":"2023-08-09T12:54:16.229044+0000","last_fullsized":"2023-08-09T12:54:16.229044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:16.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.238458+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:54:16.238458+0000","last_peered":"2023-08-09T12:54:16.238458+0000","last_clean":"2023-08-09T12:54:16.238458+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:54:16.238458+0000","last_undegraded":"2023-08-09T12:54:16.238458+0000","last_fullsized":"2023-08-09T12:54:16.238458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:49.882949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.232628+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:54:16.232628+0000","last_peered":"2023-08-09T12:54:16.232628+0000","last_clean":"2023-08-09T12:54:16.232628+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:54:16.232628+0000","last_undegraded":"2023-08-09T12:54:16.232628+0000","last_fullsized":"2023-08-09T12:54:16.232628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:41:41.067746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":362,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.235273+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:54:16.235273+0000","last_peered":"2023-08-09T12:54:16.235273+0000","last_clean":"2023-08-09T12:54:16.235273+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:54:16.235273+0000","last_undegraded":"2023-08-09T12:54:16.235273+0000","last_fullsized":"2023-08-09T12:54:16.235273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:54.620759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":331,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.245875+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:54:16.245875+0000","last_peered":"2023-08-09T12:54:16.245875+0000","last_clean":"2023-08-09T12:54:16.245875+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:54:16.245875+0000","last_undegraded":"2023-08-09T12:54:16.245875+0000","last_fullsized":"2023-08-09T12:54:16.245875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:20.057836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.239727+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:54:16.239727+0000","last_peered":"2023-08-09T12:54:16.239727+0000","last_clean":"2023-08-09T12:54:16.239727+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:54:16.239727+0000","last_undegraded":"2023-08-09T12:54:16.239727+0000","last_fullsized":"2023-08-09T12:54:16.239727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:41:05.481490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193573,"statfs":{"total":200000000,"available":198219170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1899999999999999,"15min":1.1399999999999999},"min":{"1min":0.71099999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5309999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.177},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.159,"15min":1.1259999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":1.4950000000000001,"5min":1.615,"15min":2.0459999999999998},"last":1.488}]},{"osd":1,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.222,"15min":1.2},"min":{"1min":0.70599999999999996,"5min":0.628,"15min":0.628},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":2.0859999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2210000000000001,"15min":1.1819999999999999},"min":{"1min":0.74299999999999999,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.6950000000000001,"5min":1.752,"15min":1.778},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.306,"15min":1.266},"min":{"1min":0.80600000000000005,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.88},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.2529999999999999,"15min":1.22},"min":{"1min":0.80000000000000004,"5min":0.76900000000000002,"15min":0.69799999999999995},"max":{"1min":1.5920000000000001,"5min":1.6579999999999999,"15min":2.173},"last":1.669}]},{"osd":3,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3080000000000001,"15min":1.3009999999999999},"min":{"1min":0.79800000000000004,"5min":0.78500000000000003,"15min":0.72299999999999998},"max":{"1min":1.79,"5min":1.806,"15min":3.4540000000000002},"last":0.996},{"interface":"front","average":{"1min":1.214,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.84799999999999998,"5min":0.754,"15min":0.61599999999999999},"max":{"1min":1.53,"5min":1.71,"15min":2.282},"last":1.407}]},{"osd":4,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1859999999999999,"15min":1.2330000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.611,"5min":1.873,"15min":2.8769999999999998},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3240000000000001,"15min":1.351},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":4.6200000000000001},"last":1.379}]},{"osd":5,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4039999999999999,"15min":1.399},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.702,"5min":1.8520000000000001,"15min":2.802},"last":1.635},{"interface":"front","average":{"1min":1.462,"5min":1.484,"15min":1.506},"min":{"1min":0.82799999999999996,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.7529999999999999,"5min":1.8300000000000001,"15min":3.3580000000000001},"last":1.78}]},{"osd":6,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.4370000000000001,"15min":1.478},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.696,"5min":1.998,"15min":3.4910000000000001},"last":1.605},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4690000000000001,"15min":1.49},"min":{"1min":0.69799999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.7350000000000001,"5min":1.8680000000000001,"15min":2.4039999999999999},"last":1.46}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1259999999999999,"15min":1.1439999999999999},"min":{"1min":0.80800000000000005,"5min":0.68400000000000005,"15min":0.56399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.54},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.159,"15min":1.121},"min":{"1min":0.626,"5min":0.626,"15min":0.54000000000000004},"max":{"1min":1.5109999999999999,"5min":1.6859999999999999,"15min":2.1629999999999998},"last":1.228}]},{"osd":1,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.337,"15min":1.2689999999999999},"min":{"1min":0.80400000000000005,"5min":0.73999999999999999,"15min":0.66500000000000004},"max":{"1min":1.8089999999999999,"5min":1.9219999999999999,"15min":2.306},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.399,"5min":1.3779999999999999,"15min":1.341},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.675,"5min":1.881,"15min":1.9279999999999999},"last":1.0860000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.169},"min":{"1min":0.871,"5min":0.74399999999999999,"15min":0.66900000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.262,"5min":1.304,"15min":1.2949999999999999},"min":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.66300000000000003},"max":{"1min":1.6040000000000001,"5min":1.8580000000000001,"15min":2.6499999999999999},"last":1.3400000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3759999999999999,"15min":1.333},"min":{"1min":0.745,"5min":0.745,"15min":0.67600000000000005},"max":{"1min":1.756,"5min":1.845,"15min":2.327},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3779999999999999,"15min":1.3540000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.74099999999999999},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.5979999999999999},"last":1.29}]},{"osd":4,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3420000000000001,"15min":1.377},"min":{"1min":0.85999999999999999,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.837,"5min":1.9910000000000001,"15min":11.058999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.4059999999999999,"15min":1.3819999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.0179999999999998,"15min":2.3479999999999999},"last":1.1659999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.353,"15min":1.365},"min":{"1min":0.94599999999999995,"5min":0.89800000000000002,"15min":0.77600000000000002},"max":{"1min":1.9099999999999999,"5min":1.96,"15min":2.5249999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.512,"15min":1.512},"min":{"1min":1.028,"5min":0.94399999999999995,"15min":0.81899999999999995},"max":{"1min":1.9039999999999999,"5min":2.077,"15min":2.8580000000000001},"last":1.49}]},{"osd":7,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.5669999999999999,"15min":1.536},"min":{"1min":1.234,"5min":1.1100000000000001,"15min":0.59099999999999997},"max":{"1min":1.9630000000000001,"5min":2.093,"15min":2.7999999999999998},"last":1.403},{"interface":"front","average":{"1min":1.528,"5min":1.542,"15min":1.524},"min":{"1min":1.1970000000000001,"5min":1.0469999999999999,"15min":0.74399999999999999},"max":{"1min":2.0870000000000002,"5min":2.1280000000000001,"15min":3.621},"last":1.4410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1459999999999999,"15min":1.119},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.4830000000000001,"5min":1.609,"15min":3.4060000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.2010000000000001,"15min":1.171},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.625},"max":{"1min":1.5469999999999999,"5min":1.8460000000000001,"15min":2.0600000000000001},"last":0.86099999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.379,"15min":1.3480000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.63800000000000001},"max":{"1min":2.048,"5min":2.048,"15min":2.6579999999999999},"last":1.208},{"interface":"front","average":{"1min":1.371,"5min":1.375,"15min":1.306},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.70199999999999996},"max":{"1min":1.9179999999999999,"5min":2.262,"15min":2.262},"last":0.92700000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.76800000000000002,"15min":0.69799999999999995},"max":{"1min":1.8260000000000001,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2829999999999999,"15min":1.2350000000000001},"min":{"1min":0.746,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.8149999999999999},"last":0.996}]},{"osd":3,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.3069999999999999,"15min":1.288},"min":{"1min":0.999,"5min":0.81100000000000005,"15min":0.71799999999999997},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.2330000000000001},"last":1.117},{"interface":"front","average":{"1min":1.383,"5min":1.377,"15min":1.373},"min":{"1min":0.95199999999999996,"5min":0.93000000000000005,"15min":0.78200000000000003},"max":{"1min":1.716,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.1599999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2969999999999999,"15min":1.282},"min":{"1min":0.92400000000000004,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.698,"5min":2.169,"15min":4.6920000000000002},"last":1.387},{"interface":"front","average":{"1min":1.45,"5min":1.407,"15min":1.399},"min":{"1min":1.1160000000000001,"5min":0.875,"15min":0.628},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":3.3109999999999999},"last":1.3089999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4590000000000001,"15min":1.4119999999999999},"min":{"1min":1.0920000000000001,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":2.0259999999999998,"5min":2.7719999999999998,"15min":2.952},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.5,"15min":1.478},"min":{"1min":1.127,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.1059999999999999,"15min":5.8570000000000002},"last":1.665}]},{"osd":7,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.556,"15min":1.538},"min":{"1min":1.3200000000000001,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":2.302,"5min":2.302,"15min":3.4590000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6120000000000001,"15min":1.5840000000000001},"min":{"1min":1.3340000000000001,"5min":1.121,"15min":0.65300000000000002},"max":{"1min":2.2069999999999999,"5min":2.8849999999999998,"15min":3.0649999999999999},"last":1.347}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.123,"15min":1.115},"min":{"1min":0.747,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":1.986,"15min":2.5670000000000002},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.72199999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":3.4100000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.296,"15min":1.29},"min":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.6399999999999999,"5min":1.8180000000000001,"15min":2.3679999999999999},"last":1.077},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3380000000000001,"15min":1.335},"min":{"1min":0.96699999999999997,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":1.889,"5min":1.889,"15min":2.9590000000000001},"last":1.113}]},{"osd":2,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.3640000000000001,"15min":1.331},"min":{"1min":0.92000000000000004,"5min":0.81499999999999995,"15min":0.54900000000000004},"max":{"1min":1.6779999999999999,"5min":1.865,"15min":2.4729999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.27,"5min":1.363,"15min":1.3480000000000001},"min":{"1min":1.004,"5min":0.91300000000000003,"15min":0.67900000000000005},"max":{"1min":1.6679999999999999,"5min":1.887,"15min":3.0579999999999998},"last":0.96699999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.226,"15min":1.256},"min":{"1min":0.82699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5329999999999999,"5min":1.6559999999999999,"15min":3.4430000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3480000000000001,"15min":1.337},"min":{"1min":1.02,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":2.5289999999999999},"last":1.4019999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3200000000000001,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":3.137},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.306,"15min":1.3560000000000001},"min":{"1min":0.76800000000000002,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":3.3620000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.3640000000000001,"15min":1.411},"min":{"1min":1.087,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.5819999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.486,"15min":1.518},"min":{"1min":1.1319999999999999,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.952,"5min":1.952,"15min":3.3340000000000001},"last":1.359}]},{"osd":7,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4450000000000001,"15min":1.506},"min":{"1min":0.995,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.853,"5min":1.853,"15min":3.4900000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.552,"15min":1.579},"min":{"1min":1.2609999999999999,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.875},"last":1.5069999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.89600000000000002,"15min":0.877},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.29199999999999998},"max":{"1min":1.381,"5min":1.494,"15min":4.4109999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0409999999999999,"15min":1.006},"min":{"1min":0.41899999999999998,"5min":0.38600000000000001,"15min":0.35499999999999998},"max":{"1min":1.2729999999999999,"5min":1.99,"15min":3.2269999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.38100000000000001},"max":{"1min":1.456,"5min":1.4830000000000001,"15min":2.1280000000000001},"last":0.443},{"interface":"front","average":{"1min":1,"5min":1.159,"15min":1.0920000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.33900000000000002},"max":{"1min":1.5820000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2,"15min":1.1919999999999999},"min":{"1min":0.63600000000000001,"5min":0.47999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6870000000000001,"5min":2.089,"15min":18.145},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2729999999999999,"15min":1.2330000000000001},"min":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.379},"max":{"1min":1.663,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.621}]},{"osd":4,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2869999999999999,"15min":1.296},"min":{"1min":0.79500000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.895,"5min":1.905,"15min":3.5110000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.401,"15min":1.3420000000000001},"min":{"1min":1.0089999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5940000000000001,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.0640000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.51,"15min":1.4750000000000001},"min":{"1min":1.044,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":1.845,"5min":2.302,"15min":18.094000000000001},"last":1.004},{"interface":"front","average":{"1min":1.345,"5min":1.454,"15min":1.4590000000000001},"min":{"1min":0.879,"5min":0.80900000000000005,"15min":0.69899999999999995},"max":{"1min":1.7350000000000001,"5min":2.1150000000000002,"15min":14.105},"last":1.0309999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.413,"15min":1.387},"min":{"1min":0.80100000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":3.2789999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5429999999999999,"15min":1.4810000000000001},"min":{"1min":0.96899999999999997,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.3730000000000002,"15min":4.0220000000000002},"last":0.90300000000000002}]},{"osd":7,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5600000000000001,"15min":1.4910000000000001},"min":{"1min":1.0169999999999999,"5min":0.88600000000000001,"15min":0.72499999999999998},"max":{"1min":1.9650000000000001,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.167},{"interface":"front","average":{"1min":1.375,"5min":1.522,"15min":1.47},"min":{"1min":0.86099999999999999,"5min":0.71799999999999997,"15min":0.70799999999999996},"max":{"1min":1.774,"5min":2.3380000000000001,"15min":3.016},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.94099999999999995,"15min":0.89300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":1.3300000000000001,"5min":1.673,"15min":1.716},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":0.98699999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.38900000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":2.9009999999999998},"last":0.61599999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.36299999999999999},"max":{"1min":1.2669999999999999,"5min":1.5149999999999999,"15min":1.8700000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1359999999999999,"15min":1.0740000000000001},"min":{"1min":0.58099999999999996,"5min":0.501,"15min":0.46899999999999997},"max":{"1min":1.625,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.05}]},{"osd":3,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1679999999999999,"15min":1.1539999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.46600000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":3.2850000000000001},"last":0.75},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3089999999999999,"15min":1.2190000000000001},"min":{"1min":0.64700000000000002,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.7689999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":1.2370000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.512,"15min":1.4550000000000001},"min":{"1min":1.0800000000000001,"5min":0.95499999999999996,"15min":0.81899999999999995},"max":{"1min":1.8140000000000001,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.341},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3979999999999999,"15min":1.3520000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.66800000000000004},"max":{"1min":1.7490000000000001,"5min":2.109,"15min":3.4500000000000002},"last":0.94299999999999995}]},{"osd":5,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.4139999999999999,"15min":1.403},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.69599999999999995},"max":{"1min":1.7549999999999999,"5min":1.95,"15min":5.0140000000000002},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.5880000000000001,"15min":1.508},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.78700000000000003},"max":{"1min":1.9179999999999999,"5min":2.133,"15min":4.806},"last":1.306}]},{"osd":6,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.405,"15min":1.367},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.67500000000000004},"max":{"1min":1.8540000000000001,"5min":1.976,"15min":2.5179999999999998},"last":1.008},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4990000000000001,"15min":1.46},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.73399999999999999},"max":{"1min":1.79,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.1599999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4610000000000001,"15min":1.4219999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.76200000000000001},"max":{"1min":1.867,"5min":1.9510000000000001,"15min":2.464},"last":1.105},{"interface":"front","average":{"1min":1.446,"5min":1.593,"15min":1.55},"min":{"1min":1.03,"5min":1.03,"15min":0.69299999999999995},"max":{"1min":1.8620000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.2709999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179819,"statfs":{"total":200000000,"available":184135392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5469999999999999,"5min":1.6859999999999999,"15min":2.621},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.3380000000000001},"min":{"1min":0.52700000000000002,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.778,"5min":1.778,"15min":88.254999999999995},"last":1.46}]},{"osd":2,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.0029999999999999},"min":{"1min":0.55900000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.6679999999999999,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.325,"15min":1.2549999999999999},"min":{"1min":0.65100000000000002,"5min":0.55100000000000005,"15min":0.45900000000000002},"max":{"1min":1.629,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.411}]},{"osd":3,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.2370000000000001,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.6599999999999999,"5min":2.181,"15min":2.181},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1719999999999999,"15min":1.107},"min":{"1min":0.56499999999999995,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":1.863,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.228}]},{"osd":4,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2749999999999999,"15min":1.3420000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.921,"15min":25.172000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4179999999999999,"15min":1.381},"min":{"1min":0.81299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6739999999999999,"5min":1.9259999999999999,"15min":3.762},"last":1.579}]},{"osd":5,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.419,"15min":1.4590000000000001},"min":{"1min":0.85999999999999999,"5min":0.80100000000000005,"15min":0.751},"max":{"1min":1.859,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.345},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.333,"15min":1.331},"min":{"1min":0.97299999999999998,"5min":0.876,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":1.9079999999999999,"15min":3.762},"last":0.98199999999999998}]},{"osd":6,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.5740000000000001,"15min":1.5049999999999999},"min":{"1min":0.96899999999999997,"5min":0.93600000000000005,"15min":0.79700000000000004},"max":{"1min":1.913,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.4990000000000001,"15min":1.4510000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.79500000000000004},"max":{"1min":1.9279999999999999,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.579,"15min":1.6379999999999999},"min":{"1min":0.94199999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8420000000000001,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.794},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.6359999999999999,"15min":1.663},"min":{"1min":1.0680000000000001,"5min":0.92600000000000005,"15min":0.65600000000000003},"max":{"1min":2.1949999999999998,"5min":2.464,"15min":28.765000000000001},"last":1.6359999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575031,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":14021,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181291,"statfs":{"total":200000000,"available":185642176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.88,"15min":0.88800000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.35799999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.819},"last":1.206},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.087,"15min":1.042},"min":{"1min":0.54000000000000004,"5min":0.437,"15min":0.436},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":6.1749999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.099,"15min":1.0349999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.7669999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1100000000000001,"15min":1.089},"min":{"1min":0.59999999999999998,"5min":0.54500000000000004,"15min":0.5},"max":{"1min":1.736,"5min":1.7410000000000001,"15min":6.2549999999999999},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.032,"15min":1.0309999999999999},"min":{"1min":0.63800000000000001,"5min":0.52400000000000002,"15min":0.45300000000000001},"max":{"1min":1.2889999999999999,"5min":1.893,"15min":9.6069999999999993},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.2470000000000001,"15min":1.212},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56000000000000005},"max":{"1min":1.962,"5min":1.962,"15min":2.2730000000000001},"last":0.91500000000000004}]},{"osd":4,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.397,"15min":1.365},"min":{"1min":0.99399999999999999,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.726,"5min":2.286,"15min":9.9629999999999992},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.456,"15min":1.381},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.77900000000000003},"max":{"1min":3.2759999999999998,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.139}]},{"osd":5,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.3660000000000001},"min":{"1min":0.94899999999999995,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":10.004},"last":1.456},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4930000000000001,"15min":1.4379999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":2.1419999999999999,"15min":2.161},"last":1.393}]},{"osd":6,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.458,"15min":1.4239999999999999},"min":{"1min":0.78000000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":6.4290000000000003},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.48,"5min":1.51,"15min":1.4810000000000001},"min":{"1min":0.86299999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.294,"5min":2.294,"15min":9.9190000000000005},"last":1.698}]},{"osd":7,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.524,"15min":1.5149999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.73699999999999999},"max":{"1min":3.5920000000000001,"5min":3.5920000000000001,"15min":18.114000000000001},"last":1.327},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.577,"15min":1.54},"min":{"1min":1.034,"5min":0.84099999999999997,"15min":0.82299999999999995},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":9.5640000000000001},"last":1.5780000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:54:20.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:54:20.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.410+0000 7fb5857ab640 1 Processor -- start 2023-08-09T12:54:20.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.410+0000 7fb5857ab640 1 -- start start 2023-08-09T12:54:20.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.412+0000 7fb5857ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580070a90 0x7fb5800b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.412+0000 7fb5857ab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5800ad810 0x7fb5800c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.412+0000 7fb5857ab640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5800b4630 con 0x7fb580159d80 2023-08-09T12:54:20.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.412+0000 7fb5857ab640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58015a160 con 0x7fb5800ad810 2023-08-09T12:54:20.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.412+0000 7fb5857ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800b3ab0 con 0x7fb580070a90 2023-08-09T12:54:20.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.413+0000 7fb577fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580070a90 0x7fb5800b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.413+0000 7fb57effd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb580159d80 0x7fb580070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:47548/0 (socket says 172.21.15.17:47548) 2023-08-09T12:54:20.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.413+0000 7fb57effd640 1 -- 172.21.15.17:0/2617321615 learned_addr learned my addr 172.21.15.17:0/2617321615 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:20.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.413+0000 7fb57f7fe640 1 --2- 172.21.15.17:0/2617321615 >> v2:172.21.15.142:3300/0 conn(0x7fb5800ad810 0x7fb5800c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.414+0000 7fb577fff640 1 -- 172.21.15.17:0/2617321615 >> v2:172.21.15.142:3300/0 conn(0x7fb5800ad810 msgr2=0x7fb5800c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:20.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.414+0000 7fb577fff640 1 --2- 172.21.15.17:0/2617321615 >> v2:172.21.15.142:3300/0 conn(0x7fb5800ad810 0x7fb5800c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.414+0000 7fb577fff640 1 -- 172.21.15.17:0/2617321615 >> v1:172.21.15.142:6789/0 conn(0x7fb580159d80 legacy=0x7fb580070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.414+0000 7fb577fff640 1 -- 172.21.15.17:0/2617321615 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5800b3d90 con 0x7fb580070a90 2023-08-09T12:54:20.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.415+0000 7fb577fff640 1 --2- 172.21.15.17:0/2617321615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580070a90 0x7fb5800b34d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb568009790 tx=0x7fb56802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642aaf8acc2c4c86 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:20.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.416+0000 7fb57e7fc640 1 -- 172.21.15.17:0/2617321615 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568031800 con 0x7fb580070a90 2023-08-09T12:54:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.416+0000 7fb57e7fc640 1 -- 172.21.15.17:0/2617321615 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568031960 con 0x7fb580070a90 2023-08-09T12:54:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.416+0000 7fb57e7fc640 1 -- 172.21.15.17:0/2617321615 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568031cf0 con 0x7fb580070a90 2023-08-09T12:54:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.417+0000 7fb5857ab640 1 -- 172.21.15.17:0/2617321615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580070a90 msgr2=0x7fb5800b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.417+0000 7fb5857ab640 1 --2- 172.21.15.17:0/2617321615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580070a90 0x7fb5800b34d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb568009790 tx=0x7fb56802b8a0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.417+0000 7fb5857ab640 1 -- 172.21.15.17:0/2617321615 shutdown_connections 2023-08-09T12:54:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.417+0000 7fb5857ab640 1 --2- 172.21.15.17:0/2617321615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580070a90 0x7fb5800b34d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.417+0000 7fb5857ab640 1 --2- 172.21.15.17:0/2617321615 >> v2:172.21.15.142:3300/0 conn(0x7fb5800ad810 0x7fb5800c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.417+0000 7fb5857ab640 1 -- 172.21.15.17:0/2617321615 >> 172.21.15.17:0/2617321615 conn(0x7fb5800cb1b0 msgr2=0x7fb5800cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.417+0000 7fb5857ab640 1 -- 172.21.15.17:0/2617321615 shutdown_connections 2023-08-09T12:54:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.417+0000 7fb5857ab640 1 -- 172.21.15.17:0/2617321615 wait complete. 2023-08-09T12:54:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.419+0000 7fb5857ab640 1 Processor -- start 2023-08-09T12:54:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.419+0000 7fb5857ab640 1 -- start start 2023-08-09T12:54:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb5857ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb580070a90 0x7fb5801ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb5857ab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5800ad810 0x7fb5801f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb5857ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580159d80 0x7fb5801f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb5857ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800c6990 con 0x7fb580070a90 2023-08-09T12:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb5857ab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580155410 con 0x7fb5800ad810 2023-08-09T12:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb5857ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800c6180 con 0x7fb580159d80 2023-08-09T12:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb57effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb580070a90 0x7fb5801ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb57effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb580070a90 0x7fb5801ed6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52088/0 (socket says 172.21.15.17:52088) 2023-08-09T12:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.420+0000 7fb57effd640 1 -- 172.21.15.17:0/1982736746 learned_addr learned my addr 172.21.15.17:0/1982736746 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.421+0000 7fb57f7fe640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580159d80 0x7fb5801f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.421+0000 7fb577fff640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5800ad810 0x7fb5801f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.421+0000 7fb57effd640 1 -- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580159d80 msgr2=0x7fb5801f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.421+0000 7fb57effd640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580159d80 0x7fb5801f1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.421+0000 7fb57effd640 1 -- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5800ad810 msgr2=0x7fb5801f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.421+0000 7fb57effd640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5800ad810 0x7fb5801f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.421+0000 7fb57effd640 1 -- 172.21.15.17:0/1982736746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680093a0 con 0x7fb580070a90 2023-08-09T12:54:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.421+0000 7fb57effd640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb580070a90 0x7fb5801ed6c0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c4b0 tx=0x7fb57000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.422+0000 7fb5777fe640 1 -- 172.21.15.17:0/1982736746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570005ce0 con 0x7fb580070a90 2023-08-09T12:54:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.422+0000 7fb5777fe640 1 -- 172.21.15.17:0/1982736746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570005e40 con 0x7fb580070a90 2023-08-09T12:54:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.422+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5800c63d0 con 0x7fb580070a90 2023-08-09T12:54:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.422+0000 7fb5777fe640 1 -- 172.21.15.17:0/1982736746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570007270 con 0x7fb580070a90 2023-08-09T12:54:20.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.422+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5800c6760 con 0x7fb580070a90 2023-08-09T12:54:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.423+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5800c30c0 con 0x7fb580070a90 2023-08-09T12:54:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.424+0000 7fb5777fe640 1 -- 172.21.15.17:0/1982736746 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb5700073d0 con 0x7fb580070a90 2023-08-09T12:54:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.425+0000 7fb5777fe640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb56006a050 0x7fb56006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.425+0000 7fb5777fe640 1 -- 172.21.15.17:0/1982736746 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb570087730 con 0x7fb580070a90 2023-08-09T12:54:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.426+0000 7fb577fff640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb56006a050 0x7fb56006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.427+0000 7fb577fff640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb56006a050 0x7fb56006c510 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb568036000 tx=0x7fb568008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:20.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.429+0000 7fb5777fe640 1 -- 172.21.15.17:0/1982736746 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fb5800c30c0 con 0x7fb580070a90 2023-08-09T12:54:20.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.620+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5800b4350 con 0x7fb56006a050 2023-08-09T12:54:20.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.628+0000 7fb5777fe640 1 -- 172.21.15.17:0/1982736746 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67784 (secure 0 0 0) 0x7fb568045400 con 0x7fb56006a050 2023-08-09T12:54:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:54:20.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb56006a050 msgr2=0x7fb56006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb56006a050 0x7fb56006c510 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb568036000 tx=0x7fb568008030 comp rx=0 tx=0).stop 2023-08-09T12:54:20.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb580070a90 msgr2=0x7fb5801ed6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb580070a90 0x7fb5801ed6c0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c4b0 tx=0x7fb57000c970 comp rx=0 tx=0).stop 2023-08-09T12:54:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 shutdown_connections 2023-08-09T12:54:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fb56006a050 0x7fb56006c510 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb580159d80 0x7fb5801f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5800ad810 0x7fb5801f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 --2- 172.21.15.17:0/1982736746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb580070a90 0x7fb5801ed6c0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.630+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 >> 172.21.15.17:0/1982736746 conn(0x7fb5800cb1b0 msgr2=0x7fb5800cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.631+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 shutdown_connections 2023-08-09T12:54:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.631+0000 7fb5857ab640 1 -- 172.21.15.17:0/1982736746 wait complete. 2023-08-09T12:54:20.653 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":645,"stamp":"2023-08-09T12:54:18.981369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":37065,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1525434,"statfs":{"total":1600000000,"available":1562044428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490893,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-127,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002406"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":518,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.236579+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:54:16.236579+0000","last_peered":"2023-08-09T12:54:16.236579+0000","last_clean":"2023-08-09T12:54:16.236579+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:54:16.236579+0000","last_undegraded":"2023-08-09T12:54:16.236579+0000","last_fullsized":"2023-08-09T12:54:16.236579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:19:40.258128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.234091+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:54:16.234091+0000","last_peered":"2023-08-09T12:54:16.234091+0000","last_clean":"2023-08-09T12:54:16.234091+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:54:16.234091+0000","last_undegraded":"2023-08-09T12:54:16.234091+0000","last_fullsized":"2023-08-09T12:54:16.234091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:44:27.556881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":362,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.235474+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:54:16.235474+0000","last_peered":"2023-08-09T12:54:16.235474+0000","last_clean":"2023-08-09T12:54:16.235474+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:54:16.235474+0000","last_undegraded":"2023-08-09T12:54:16.235474+0000","last_fullsized":"2023-08-09T12:54:16.235474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:46.960577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":336,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.229044+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:54:16.229044+0000","last_peered":"2023-08-09T12:54:16.229044+0000","last_clean":"2023-08-09T12:54:16.229044+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:54:16.229044+0000","last_undegraded":"2023-08-09T12:54:16.229044+0000","last_fullsized":"2023-08-09T12:54:16.229044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:16.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.238458+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:54:16.238458+0000","last_peered":"2023-08-09T12:54:16.238458+0000","last_clean":"2023-08-09T12:54:16.238458+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:54:16.238458+0000","last_undegraded":"2023-08-09T12:54:16.238458+0000","last_fullsized":"2023-08-09T12:54:16.238458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:49.882949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.232628+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:54:16.232628+0000","last_peered":"2023-08-09T12:54:16.232628+0000","last_clean":"2023-08-09T12:54:16.232628+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:54:16.232628+0000","last_undegraded":"2023-08-09T12:54:16.232628+0000","last_fullsized":"2023-08-09T12:54:16.232628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:41:41.067746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":362,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.235273+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:54:16.235273+0000","last_peered":"2023-08-09T12:54:16.235273+0000","last_clean":"2023-08-09T12:54:16.235273+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:54:16.235273+0000","last_undegraded":"2023-08-09T12:54:16.235273+0000","last_fullsized":"2023-08-09T12:54:16.235273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:54.620759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":331,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.245875+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:54:16.245875+0000","last_peered":"2023-08-09T12:54:16.245875+0000","last_clean":"2023-08-09T12:54:16.245875+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:54:16.245875+0000","last_undegraded":"2023-08-09T12:54:16.245875+0000","last_fullsized":"2023-08-09T12:54:16.245875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:20.057836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.239727+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:54:16.239727+0000","last_peered":"2023-08-09T12:54:16.239727+0000","last_clean":"2023-08-09T12:54:16.239727+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:54:16.239727+0000","last_undegraded":"2023-08-09T12:54:16.239727+0000","last_fullsized":"2023-08-09T12:54:16.239727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:41:05.481490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193573,"statfs":{"total":200000000,"available":198219170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1899999999999999,"15min":1.1399999999999999},"min":{"1min":0.71099999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5309999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.177},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.159,"15min":1.1259999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":1.4950000000000001,"5min":1.615,"15min":2.0459999999999998},"last":1.488}]},{"osd":1,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.222,"15min":1.2},"min":{"1min":0.70599999999999996,"5min":0.628,"15min":0.628},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":2.0859999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2210000000000001,"15min":1.1819999999999999},"min":{"1min":0.74299999999999999,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.6950000000000001,"5min":1.752,"15min":1.778},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.306,"15min":1.266},"min":{"1min":0.80600000000000005,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.88},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.2529999999999999,"15min":1.22},"min":{"1min":0.80000000000000004,"5min":0.76900000000000002,"15min":0.69799999999999995},"max":{"1min":1.5920000000000001,"5min":1.6579999999999999,"15min":2.173},"last":1.669}]},{"osd":3,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3080000000000001,"15min":1.3009999999999999},"min":{"1min":0.79800000000000004,"5min":0.78500000000000003,"15min":0.72299999999999998},"max":{"1min":1.79,"5min":1.806,"15min":3.4540000000000002},"last":0.996},{"interface":"front","average":{"1min":1.214,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.84799999999999998,"5min":0.754,"15min":0.61599999999999999},"max":{"1min":1.53,"5min":1.71,"15min":2.282},"last":1.407}]},{"osd":4,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1859999999999999,"15min":1.2330000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.611,"5min":1.873,"15min":2.8769999999999998},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3240000000000001,"15min":1.351},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":4.6200000000000001},"last":1.379}]},{"osd":5,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4039999999999999,"15min":1.399},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.702,"5min":1.8520000000000001,"15min":2.802},"last":1.635},{"interface":"front","average":{"1min":1.462,"5min":1.484,"15min":1.506},"min":{"1min":0.82799999999999996,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.7529999999999999,"5min":1.8300000000000001,"15min":3.3580000000000001},"last":1.78}]},{"osd":6,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.4370000000000001,"15min":1.478},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.696,"5min":1.998,"15min":3.4910000000000001},"last":1.605},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4690000000000001,"15min":1.49},"min":{"1min":0.69799999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.7350000000000001,"5min":1.8680000000000001,"15min":2.4039999999999999},"last":1.46}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1259999999999999,"15min":1.1439999999999999},"min":{"1min":0.80800000000000005,"5min":0.68400000000000005,"15min":0.56399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.54},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.159,"15min":1.121},"min":{"1min":0.626,"5min":0.626,"15min":0.54000000000000004},"max":{"1min":1.5109999999999999,"5min":1.6859999999999999,"15min":2.1629999999999998},"last":1.228}]},{"osd":1,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.337,"15min":1.2689999999999999},"min":{"1min":0.80400000000000005,"5min":0.73999999999999999,"15min":0.66500000000000004},"max":{"1min":1.8089999999999999,"5min":1.9219999999999999,"15min":2.306},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.399,"5min":1.3779999999999999,"15min":1.341},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.675,"5min":1.881,"15min":1.9279999999999999},"last":1.0860000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.169},"min":{"1min":0.871,"5min":0.74399999999999999,"15min":0.66900000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.262,"5min":1.304,"15min":1.2949999999999999},"min":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.66300000000000003},"max":{"1min":1.6040000000000001,"5min":1.8580000000000001,"15min":2.6499999999999999},"last":1.3400000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3759999999999999,"15min":1.333},"min":{"1min":0.745,"5min":0.745,"15min":0.67600000000000005},"max":{"1min":1.756,"5min":1.845,"15min":2.327},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3779999999999999,"15min":1.3540000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.74099999999999999},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.5979999999999999},"last":1.29}]},{"osd":4,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3420000000000001,"15min":1.377},"min":{"1min":0.85999999999999999,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.837,"5min":1.9910000000000001,"15min":11.058999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.4059999999999999,"15min":1.3819999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.0179999999999998,"15min":2.3479999999999999},"last":1.1659999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.353,"15min":1.365},"min":{"1min":0.94599999999999995,"5min":0.89800000000000002,"15min":0.77600000000000002},"max":{"1min":1.9099999999999999,"5min":1.96,"15min":2.5249999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.512,"15min":1.512},"min":{"1min":1.028,"5min":0.94399999999999995,"15min":0.81899999999999995},"max":{"1min":1.9039999999999999,"5min":2.077,"15min":2.8580000000000001},"last":1.49}]},{"osd":7,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.5669999999999999,"15min":1.536},"min":{"1min":1.234,"5min":1.1100000000000001,"15min":0.59099999999999997},"max":{"1min":1.9630000000000001,"5min":2.093,"15min":2.7999999999999998},"last":1.403},{"interface":"front","average":{"1min":1.528,"5min":1.542,"15min":1.524},"min":{"1min":1.1970000000000001,"5min":1.0469999999999999,"15min":0.74399999999999999},"max":{"1min":2.0870000000000002,"5min":2.1280000000000001,"15min":3.621},"last":1.4410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1459999999999999,"15min":1.119},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.4830000000000001,"5min":1.609,"15min":3.4060000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.2010000000000001,"15min":1.171},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.625},"max":{"1min":1.5469999999999999,"5min":1.8460000000000001,"15min":2.0600000000000001},"last":0.86099999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.379,"15min":1.3480000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.63800000000000001},"max":{"1min":2.048,"5min":2.048,"15min":2.6579999999999999},"last":1.208},{"interface":"front","average":{"1min":1.371,"5min":1.375,"15min":1.306},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.70199999999999996},"max":{"1min":1.9179999999999999,"5min":2.262,"15min":2.262},"last":0.92700000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.76800000000000002,"15min":0.69799999999999995},"max":{"1min":1.8260000000000001,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2829999999999999,"15min":1.2350000000000001},"min":{"1min":0.746,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.8149999999999999},"last":0.996}]},{"osd":3,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.3069999999999999,"15min":1.288},"min":{"1min":0.999,"5min":0.81100000000000005,"15min":0.71799999999999997},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.2330000000000001},"last":1.117},{"interface":"front","average":{"1min":1.383,"5min":1.377,"15min":1.373},"min":{"1min":0.95199999999999996,"5min":0.93000000000000005,"15min":0.78200000000000003},"max":{"1min":1.716,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.1599999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2969999999999999,"15min":1.282},"min":{"1min":0.92400000000000004,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.698,"5min":2.169,"15min":4.6920000000000002},"last":1.387},{"interface":"front","average":{"1min":1.45,"5min":1.407,"15min":1.399},"min":{"1min":1.1160000000000001,"5min":0.875,"15min":0.628},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":3.3109999999999999},"last":1.3089999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4590000000000001,"15min":1.4119999999999999},"min":{"1min":1.0920000000000001,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":2.0259999999999998,"5min":2.7719999999999998,"15min":2.952},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.5,"15min":1.478},"min":{"1min":1.127,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.1059999999999999,"15min":5.8570000000000002},"last":1.665}]},{"osd":7,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.556,"15min":1.538},"min":{"1min":1.3200000000000001,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":2.302,"5min":2.302,"15min":3.4590000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6120000000000001,"15min":1.5840000000000001},"min":{"1min":1.3340000000000001,"5min":1.121,"15min":0.65300000000000002},"max":{"1min":2.2069999999999999,"5min":2.8849999999999998,"15min":3.0649999999999999},"last":1.347}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.123,"15min":1.115},"min":{"1min":0.747,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":1.986,"15min":2.5670000000000002},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.72199999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":3.4100000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.296,"15min":1.29},"min":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.6399999999999999,"5min":1.8180000000000001,"15min":2.3679999999999999},"last":1.077},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3380000000000001,"15min":1.335},"min":{"1min":0.96699999999999997,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":1.889,"5min":1.889,"15min":2.9590000000000001},"last":1.113}]},{"osd":2,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.3640000000000001,"15min":1.331},"min":{"1min":0.92000000000000004,"5min":0.81499999999999995,"15min":0.54900000000000004},"max":{"1min":1.6779999999999999,"5min":1.865,"15min":2.4729999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.27,"5min":1.363,"15min":1.3480000000000001},"min":{"1min":1.004,"5min":0.91300000000000003,"15min":0.67900000000000005},"max":{"1min":1.6679999999999999,"5min":1.887,"15min":3.0579999999999998},"last":0.96699999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.226,"15min":1.256},"min":{"1min":0.82699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5329999999999999,"5min":1.6559999999999999,"15min":3.4430000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3480000000000001,"15min":1.337},"min":{"1min":1.02,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":2.5289999999999999},"last":1.4019999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3200000000000001,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":3.137},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.306,"15min":1.3560000000000001},"min":{"1min":0.76800000000000002,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":3.3620000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.3640000000000001,"15min":1.411},"min":{"1min":1.087,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.5819999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.486,"15min":1.518},"min":{"1min":1.1319999999999999,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.952,"5min":1.952,"15min":3.3340000000000001},"last":1.359}]},{"osd":7,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4450000000000001,"15min":1.506},"min":{"1min":0.995,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.853,"5min":1.853,"15min":3.4900000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.552,"15min":1.579},"min":{"1min":1.2609999999999999,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.875},"last":1.5069999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.89600000000000002,"15min":0.877},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.29199999999999998},"max":{"1min":1.381,"5min":1.494,"15min":4.4109999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0409999999999999,"15min":1.006},"min":{"1min":0.41899999999999998,"5min":0.38600000000000001,"15min":0.35499999999999998},"max":{"1min":1.2729999999999999,"5min":1.99,"15min":3.2269999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.38100000000000001},"max":{"1min":1.456,"5min":1.4830000000000001,"15min":2.1280000000000001},"last":0.443},{"interface":"front","average":{"1min":1,"5min":1.159,"15min":1.0920000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.33900000000000002},"max":{"1min":1.5820000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2,"15min":1.1919999999999999},"min":{"1min":0.63600000000000001,"5min":0.47999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6870000000000001,"5min":2.089,"15min":18.145},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2729999999999999,"15min":1.2330000000000001},"min":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.379},"max":{"1min":1.663,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.621}]},{"osd":4,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2869999999999999,"15min":1.296},"min":{"1min":0.79500000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.895,"5min":1.905,"15min":3.5110000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.401,"15min":1.3420000000000001},"min":{"1min":1.0089999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5940000000000001,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.0640000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.51,"15min":1.4750000000000001},"min":{"1min":1.044,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":1.845,"5min":2.302,"15min":18.094000000000001},"last":1.004},{"interface":"front","average":{"1min":1.345,"5min":1.454,"15min":1.4590000000000001},"min":{"1min":0.879,"5min":0.80900000000000005,"15min":0.69899999999999995},"max":{"1min":1.7350000000000001,"5min":2.1150000000000002,"15min":14.105},"last":1.0309999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.413,"15min":1.387},"min":{"1min":0.80100000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":3.2789999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5429999999999999,"15min":1.4810000000000001},"min":{"1min":0.96899999999999997,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.3730000000000002,"15min":4.0220000000000002},"last":0.90300000000000002}]},{"osd":7,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5600000000000001,"15min":1.4910000000000001},"min":{"1min":1.0169999999999999,"5min":0.88600000000000001,"15min":0.72499999999999998},"max":{"1min":1.9650000000000001,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.167},{"interface":"front","average":{"1min":1.375,"5min":1.522,"15min":1.47},"min":{"1min":0.86099999999999999,"5min":0.71799999999999997,"15min":0.70799999999999996},"max":{"1min":1.774,"5min":2.3380000000000001,"15min":3.016},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.94099999999999995,"15min":0.89300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":1.3300000000000001,"5min":1.673,"15min":1.716},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":0.98699999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.38900000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":2.9009999999999998},"last":0.61599999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.36299999999999999},"max":{"1min":1.2669999999999999,"5min":1.5149999999999999,"15min":1.8700000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1359999999999999,"15min":1.0740000000000001},"min":{"1min":0.58099999999999996,"5min":0.501,"15min":0.46899999999999997},"max":{"1min":1.625,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.05}]},{"osd":3,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1679999999999999,"15min":1.1539999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.46600000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":3.2850000000000001},"last":0.75},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3089999999999999,"15min":1.2190000000000001},"min":{"1min":0.64700000000000002,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.7689999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":1.2370000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.512,"15min":1.4550000000000001},"min":{"1min":1.0800000000000001,"5min":0.95499999999999996,"15min":0.81899999999999995},"max":{"1min":1.8140000000000001,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.341},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3979999999999999,"15min":1.3520000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.66800000000000004},"max":{"1min":1.7490000000000001,"5min":2.109,"15min":3.4500000000000002},"last":0.94299999999999995}]},{"osd":5,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.4139999999999999,"15min":1.403},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.69599999999999995},"max":{"1min":1.7549999999999999,"5min":1.95,"15min":5.0140000000000002},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.5880000000000001,"15min":1.508},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.78700000000000003},"max":{"1min":1.9179999999999999,"5min":2.133,"15min":4.806},"last":1.306}]},{"osd":6,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.405,"15min":1.367},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.67500000000000004},"max":{"1min":1.8540000000000001,"5min":1.976,"15min":2.5179999999999998},"last":1.008},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4990000000000001,"15min":1.46},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.73399999999999999},"max":{"1min":1.79,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.1599999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4610000000000001,"15min":1.4219999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.76200000000000001},"max":{"1min":1.867,"5min":1.9510000000000001,"15min":2.464},"last":1.105},{"interface":"front","average":{"1min":1.446,"5min":1.593,"15min":1.55},"min":{"1min":1.03,"5min":1.03,"15min":0.69299999999999995},"max":{"1min":1.8620000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.2709999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179819,"statfs":{"total":200000000,"available":184135392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5469999999999999,"5min":1.6859999999999999,"15min":2.621},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.3380000000000001},"min":{"1min":0.52700000000000002,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.778,"5min":1.778,"15min":88.254999999999995},"last":1.46}]},{"osd":2,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.0029999999999999},"min":{"1min":0.55900000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.6679999999999999,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.325,"15min":1.2549999999999999},"min":{"1min":0.65100000000000002,"5min":0.55100000000000005,"15min":0.45900000000000002},"max":{"1min":1.629,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.411}]},{"osd":3,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.2370000000000001,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.6599999999999999,"5min":2.181,"15min":2.181},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1719999999999999,"15min":1.107},"min":{"1min":0.56499999999999995,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":1.863,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.228}]},{"osd":4,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2749999999999999,"15min":1.3420000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.921,"15min":25.172000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4179999999999999,"15min":1.381},"min":{"1min":0.81299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6739999999999999,"5min":1.9259999999999999,"15min":3.762},"last":1.579}]},{"osd":5,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.419,"15min":1.4590000000000001},"min":{"1min":0.85999999999999999,"5min":0.80100000000000005,"15min":0.751},"max":{"1min":1.859,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.345},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.333,"15min":1.331},"min":{"1min":0.97299999999999998,"5min":0.876,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":1.9079999999999999,"15min":3.762},"last":0.98199999999999998}]},{"osd":6,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.5740000000000001,"15min":1.5049999999999999},"min":{"1min":0.96899999999999997,"5min":0.93600000000000005,"15min":0.79700000000000004},"max":{"1min":1.913,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.4990000000000001,"15min":1.4510000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.79500000000000004},"max":{"1min":1.9279999999999999,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.579,"15min":1.6379999999999999},"min":{"1min":0.94199999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8420000000000001,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.794},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.6359999999999999,"15min":1.663},"min":{"1min":1.0680000000000001,"5min":0.92600000000000005,"15min":0.65600000000000003},"max":{"1min":2.1949999999999998,"5min":2.464,"15min":28.765000000000001},"last":1.6359999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575031,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":14021,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181291,"statfs":{"total":200000000,"available":185642176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.88,"15min":0.88800000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.35799999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.819},"last":1.206},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.087,"15min":1.042},"min":{"1min":0.54000000000000004,"5min":0.437,"15min":0.436},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":6.1749999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.099,"15min":1.0349999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.7669999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1100000000000001,"15min":1.089},"min":{"1min":0.59999999999999998,"5min":0.54500000000000004,"15min":0.5},"max":{"1min":1.736,"5min":1.7410000000000001,"15min":6.2549999999999999},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.032,"15min":1.0309999999999999},"min":{"1min":0.63800000000000001,"5min":0.52400000000000002,"15min":0.45300000000000001},"max":{"1min":1.2889999999999999,"5min":1.893,"15min":9.6069999999999993},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.2470000000000001,"15min":1.212},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56000000000000005},"max":{"1min":1.962,"5min":1.962,"15min":2.2730000000000001},"last":0.91500000000000004}]},{"osd":4,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.397,"15min":1.365},"min":{"1min":0.99399999999999999,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.726,"5min":2.286,"15min":9.9629999999999992},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.456,"15min":1.381},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.77900000000000003},"max":{"1min":3.2759999999999998,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.139}]},{"osd":5,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.3660000000000001},"min":{"1min":0.94899999999999995,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":10.004},"last":1.456},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4930000000000001,"15min":1.4379999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":2.1419999999999999,"15min":2.161},"last":1.393}]},{"osd":6,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.458,"15min":1.4239999999999999},"min":{"1min":0.78000000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":6.4290000000000003},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.48,"5min":1.51,"15min":1.4810000000000001},"min":{"1min":0.86299999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.294,"5min":2.294,"15min":9.9190000000000005},"last":1.698}]},{"osd":7,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.524,"15min":1.5149999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.73699999999999999},"max":{"1min":3.5920000000000001,"5min":3.5920000000000001,"15min":18.114000000000001},"last":1.327},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.577,"15min":1.54},"min":{"1min":1.034,"5min":0.84099999999999997,"15min":0.82299999999999995},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":9.5640000000000001},"last":1.5780000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:54:20.657 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-09T12:54:20.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:54:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.880+0000 7f81e6c47640 1 Processor -- start 2023-08-09T12:54:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.880+0000 7f81e6c47640 1 -- start start 2023-08-09T12:54:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.882+0000 7f81e6c47640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81e0070f00 0x7f81e015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.882+0000 7f81e6c47640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e015bce0 0x7f81e00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.882+0000 7f81e6c47640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e0071340 con 0x7f81e01587e0 2023-08-09T12:54:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.882+0000 7f81e6c47640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00715c0 con 0x7f81e0070f00 2023-08-09T12:54:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.882+0000 7f81e6c47640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00718a0 con 0x7f81e015bce0 2023-08-09T12:54:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.882+0000 7f81e5c45640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f81e01587e0 0x7f81e00b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49210/0 (socket says 172.21.15.17:49210) 2023-08-09T12:54:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.882+0000 7f81e5c45640 1 -- 172.21.15.17:0/3974654285 learned_addr learned my addr 172.21.15.17:0/3974654285 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e6446640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e015bce0 0x7f81e00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e5444640 1 --2- 172.21.15.17:0/3974654285 >> v2:172.21.15.142:3300/0 conn(0x7f81e0070f00 0x7f81e015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279910496 0 0) 0x7f81e0071340 con 0x7f81e01587e0 2023-08-09T12:54:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81cc003520 con 0x7f81e01587e0 2023-08-09T12:54:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2582504360 0 0) 0x7f81cc003520 con 0x7f81e01587e0 2023-08-09T12:54:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e015bce0 msgr2=0x7f81e00cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e015bce0 0x7f81e00cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 >> v2:172.21.15.142:3300/0 conn(0x7f81e0070f00 msgr2=0x7f81e015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 --2- 172.21.15.17:0/3974654285 >> v2:172.21.15.142:3300/0 conn(0x7f81e0070f00 0x7f81e015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0071b80 con 0x7f81e01587e0 2023-08-09T12:54:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f81dc001670 con 0x7f81e01587e0 2023-08-09T12:54:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 >> v1:172.21.15.17:6789/0 conn(0x7f81e01587e0 legacy=0x7f81e00b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81cc003970 0x7f81cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.883+0000 7f81e4c43640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81cc0047c0 0x7f81cc004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e4c43640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc005140 0x7f81cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00715c0 con 0x7f81cc003970 2023-08-09T12:54:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00718a0 con 0x7f81cc005140 2023-08-09T12:54:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0045c0 con 0x7f81cc0047c0 2023-08-09T12:54:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e5c45640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81cc003970 0x7f81cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e5c45640 1 -- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81cc0047c0 msgr2=0x7f81cc004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e6446640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc005140 0x7f81cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e5444640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81cc0047c0 0x7f81cc004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e5c45640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81cc0047c0 0x7f81cc004c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e5c45640 1 -- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc005140 msgr2=0x7f81cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e5c45640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc005140 0x7f81cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e5c45640 1 -- 172.21.15.17:0/3974654285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc003520 con 0x7f81cc003970 2023-08-09T12:54:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.884+0000 7f81e6446640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc005140 0x7f81cc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.886+0000 7f81e5c45640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81cc003970 0x7f81cc003d90 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c240 tx=0x7f81cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84a28c1984d863f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.886+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc02cb00 con 0x7f81cc003970 2023-08-09T12:54:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.886+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc02cc60 con 0x7f81cc003970 2023-08-09T12:54:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.886+0000 7f81e4c43640 1 -- 172.21.15.17:0/3974654285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc005af0 con 0x7f81cc003970 2023-08-09T12:54:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.887+0000 7f81e6c47640 1 -- 172.21.15.17:0/3974654285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81cc003970 msgr2=0x7f81cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.887+0000 7f81e6c47640 1 --2- 172.21.15.17:0/3974654285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81cc003970 0x7f81cc003d90 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c240 tx=0x7f81cc0057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.887+0000 7f81e6446640 1 -- 172.21.15.17:0/3974654285 reap_dead start 2023-08-09T12:54:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.887+0000 7f81e6c47640 1 -- 172.21.15.17:0/3974654285 shutdown_connections 2023-08-09T12:54:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.887+0000 7f81e6c47640 1 -- 172.21.15.17:0/3974654285 >> 172.21.15.17:0/3974654285 conn(0x7f81e00b1d50 msgr2=0x7f81e006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.887+0000 7f81e6c47640 1 -- 172.21.15.17:0/3974654285 shutdown_connections 2023-08-09T12:54:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.887+0000 7f81e6c47640 1 -- 172.21.15.17:0/3974654285 wait complete. 2023-08-09T12:54:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.889+0000 7f81e6c47640 1 Processor -- start 2023-08-09T12:54:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.889+0000 7f81e6c47640 1 -- start start 2023-08-09T12:54:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e6c47640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc003970 0x7f81e0157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e6c47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e00ad1e0 0x7f81e01f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e6c47640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e01f21c0 0x7f81e00c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e6c47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00ae470 con 0x7f81e00ad1e0 2023-08-09T12:54:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e6c47640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00acfd0 con 0x7f81cc003970 2023-08-09T12:54:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e6c47640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00ac950 con 0x7f81e01f21c0 2023-08-09T12:54:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e5444640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e00ad1e0 0x7f81e01f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e5444640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e00ad1e0 0x7f81e01f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52110/0 (socket says 172.21.15.17:52110) 2023-08-09T12:54:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.890+0000 7f81e5444640 1 -- 172.21.15.17:0/638263480 learned_addr learned my addr 172.21.15.17:0/638263480 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e6446640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e01f21c0 0x7f81e00c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e5444640 1 -- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e01f21c0 msgr2=0x7f81e00c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e5c45640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc003970 0x7f81e0157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e5444640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e01f21c0 0x7f81e00c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e5444640 1 -- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc003970 msgr2=0x7f81e0157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e5444640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc003970 0x7f81e0157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e5444640 1 -- 172.21.15.17:0/638263480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00cd920 con 0x7f81e00ad1e0 2023-08-09T12:54:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e5444640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e00ad1e0 0x7f81e01f1c80 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f81d0010910 tx=0x7f81d0010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81d67fc640 1 -- 172.21.15.17:0/638263480 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0009690 con 0x7f81e00ad1e0 2023-08-09T12:54:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81d67fc640 1 -- 172.21.15.17:0/638263480 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000ebc0 con 0x7f81e00ad1e0 2023-08-09T12:54:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81d67fc640 1 -- 172.21.15.17:0/638263480 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d001c400 con 0x7f81e00ad1e0 2023-08-09T12:54:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.891+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e00acbf0 con 0x7f81e00ad1e0 2023-08-09T12:54:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.892+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e00c47c0 con 0x7f81e00ad1e0 2023-08-09T12:54:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.893+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e004e390 con 0x7f81e00ad1e0 2023-08-09T12:54:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.894+0000 7f81d67fc640 1 -- 172.21.15.17:0/638263480 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81d001c560 con 0x7f81e00ad1e0 2023-08-09T12:54:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.894+0000 7f81d67fc640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81c406a050 0x7f81c406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.895+0000 7f81d67fc640 1 -- 172.21.15.17:0/638263480 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f81d00887d0 con 0x7f81e00ad1e0 2023-08-09T12:54:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.895+0000 7f81e5c45640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81c406a050 0x7f81c406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.897+0000 7f81e5c45640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81c406a050 0x7f81c406c510 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f81dc034000 tx=0x7f81dc007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:20.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:20.899+0000 7f81d67fc640 1 -- 172.21.15.17:0/638263480 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f81d00541f0 con 0x7f81e00ad1e0 2023-08-09T12:54:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.091+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81e006fa30 con 0x7f81c406a050 2023-08-09T12:54:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.100+0000 7f81d67fc640 1 -- 172.21.15.17:0/638263480 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67784 (secure 0 0 0) 0x7f81dc02c980 con 0x7f81c406a050 2023-08-09T12:54:21.104 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:54:21.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81c406a050 msgr2=0x7f81c406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:21.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81c406a050 0x7f81c406c510 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f81dc034000 tx=0x7f81dc007000 comp rx=0 tx=0).stop 2023-08-09T12:54:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e00ad1e0 msgr2=0x7f81e01f1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e00ad1e0 0x7f81e01f1c80 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f81d0010910 tx=0x7f81d0010dd0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 shutdown_connections 2023-08-09T12:54:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f81c406a050 0x7f81c406c510 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e01f21c0 0x7f81e00c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e00ad1e0 0x7f81e01f1c80 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 --2- 172.21.15.17:0/638263480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81cc003970 0x7f81e0157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.102+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 >> 172.21.15.17:0/638263480 conn(0x7f81e00b1d50 msgr2=0x7f81e00cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.103+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 shutdown_connections 2023-08-09T12:54:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.103+0000 7f81e6c47640 1 -- 172.21.15.17:0/638263480 wait complete. 2023-08-09T12:54:21.125 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":646,"stamp":"2023-08-09T12:54:20.982007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":37065,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1525434,"statfs":{"total":1600000000,"available":1562044428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490893,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-127,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.958483"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":518,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.236579+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:54:16.236579+0000","last_peered":"2023-08-09T12:54:16.236579+0000","last_clean":"2023-08-09T12:54:16.236579+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:54:16.236579+0000","last_undegraded":"2023-08-09T12:54:16.236579+0000","last_fullsized":"2023-08-09T12:54:16.236579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:19:40.258128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.234091+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:54:16.234091+0000","last_peered":"2023-08-09T12:54:16.234091+0000","last_clean":"2023-08-09T12:54:16.234091+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:54:16.234091+0000","last_undegraded":"2023-08-09T12:54:16.234091+0000","last_fullsized":"2023-08-09T12:54:16.234091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:44:27.556881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":362,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.235474+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:54:16.235474+0000","last_peered":"2023-08-09T12:54:16.235474+0000","last_clean":"2023-08-09T12:54:16.235474+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:54:16.235474+0000","last_undegraded":"2023-08-09T12:54:16.235474+0000","last_fullsized":"2023-08-09T12:54:16.235474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:46.960577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":336,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.229044+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:54:16.229044+0000","last_peered":"2023-08-09T12:54:16.229044+0000","last_clean":"2023-08-09T12:54:16.229044+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:54:16.229044+0000","last_undegraded":"2023-08-09T12:54:16.229044+0000","last_fullsized":"2023-08-09T12:54:16.229044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:16.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.238458+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:54:16.238458+0000","last_peered":"2023-08-09T12:54:16.238458+0000","last_clean":"2023-08-09T12:54:16.238458+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:54:16.238458+0000","last_undegraded":"2023-08-09T12:54:16.238458+0000","last_fullsized":"2023-08-09T12:54:16.238458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:49.882949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.232628+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:54:16.232628+0000","last_peered":"2023-08-09T12:54:16.232628+0000","last_clean":"2023-08-09T12:54:16.232628+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:54:16.232628+0000","last_undegraded":"2023-08-09T12:54:16.232628+0000","last_fullsized":"2023-08-09T12:54:16.232628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:41:41.067746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":362,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.235273+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:54:16.235273+0000","last_peered":"2023-08-09T12:54:16.235273+0000","last_clean":"2023-08-09T12:54:16.235273+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:54:16.235273+0000","last_undegraded":"2023-08-09T12:54:16.235273+0000","last_fullsized":"2023-08-09T12:54:16.235273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:54.620759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":331,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.245875+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:54:16.245875+0000","last_peered":"2023-08-09T12:54:16.245875+0000","last_clean":"2023-08-09T12:54:16.245875+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:54:16.245875+0000","last_undegraded":"2023-08-09T12:54:16.245875+0000","last_fullsized":"2023-08-09T12:54:16.245875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:17:20.057836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.239727+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:54:16.239727+0000","last_peered":"2023-08-09T12:54:16.239727+0000","last_clean":"2023-08-09T12:54:16.239727+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:54:16.239727+0000","last_undegraded":"2023-08-09T12:54:16.239727+0000","last_fullsized":"2023-08-09T12:54:16.239727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:41:05.481490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193573,"statfs":{"total":200000000,"available":198219170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1899999999999999,"15min":1.1399999999999999},"min":{"1min":0.71099999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5309999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.177},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.159,"15min":1.1259999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":1.4950000000000001,"5min":1.615,"15min":2.0459999999999998},"last":1.488}]},{"osd":1,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.222,"15min":1.2},"min":{"1min":0.70599999999999996,"5min":0.628,"15min":0.628},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":2.0859999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2210000000000001,"15min":1.1819999999999999},"min":{"1min":0.74299999999999999,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.6950000000000001,"5min":1.752,"15min":1.778},"last":1.5720000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.306,"15min":1.266},"min":{"1min":0.80600000000000005,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.88},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.2529999999999999,"15min":1.22},"min":{"1min":0.80000000000000004,"5min":0.76900000000000002,"15min":0.69799999999999995},"max":{"1min":1.5920000000000001,"5min":1.6579999999999999,"15min":2.173},"last":1.669}]},{"osd":3,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3080000000000001,"15min":1.3009999999999999},"min":{"1min":0.79800000000000004,"5min":0.78500000000000003,"15min":0.72299999999999998},"max":{"1min":1.79,"5min":1.806,"15min":3.4540000000000002},"last":0.996},{"interface":"front","average":{"1min":1.214,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.84799999999999998,"5min":0.754,"15min":0.61599999999999999},"max":{"1min":1.53,"5min":1.71,"15min":2.282},"last":1.407}]},{"osd":4,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1859999999999999,"15min":1.2330000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.611,"5min":1.873,"15min":2.8769999999999998},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3240000000000001,"15min":1.351},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":4.6200000000000001},"last":1.379}]},{"osd":5,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4039999999999999,"15min":1.399},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.702,"5min":1.8520000000000001,"15min":2.802},"last":1.635},{"interface":"front","average":{"1min":1.462,"5min":1.484,"15min":1.506},"min":{"1min":0.82799999999999996,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.7529999999999999,"5min":1.8300000000000001,"15min":3.3580000000000001},"last":1.78}]},{"osd":6,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.4370000000000001,"15min":1.478},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.696,"5min":1.998,"15min":3.4910000000000001},"last":1.605},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4690000000000001,"15min":1.49},"min":{"1min":0.69799999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.7350000000000001,"5min":1.8680000000000001,"15min":2.4039999999999999},"last":1.46}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1259999999999999,"15min":1.1439999999999999},"min":{"1min":0.80800000000000005,"5min":0.68400000000000005,"15min":0.56399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.54},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.159,"15min":1.121},"min":{"1min":0.626,"5min":0.626,"15min":0.54000000000000004},"max":{"1min":1.5109999999999999,"5min":1.6859999999999999,"15min":2.1629999999999998},"last":1.228}]},{"osd":1,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.337,"15min":1.2689999999999999},"min":{"1min":0.80400000000000005,"5min":0.73999999999999999,"15min":0.66500000000000004},"max":{"1min":1.8089999999999999,"5min":1.9219999999999999,"15min":2.306},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.399,"5min":1.3779999999999999,"15min":1.341},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.675,"5min":1.881,"15min":1.9279999999999999},"last":1.0860000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.169},"min":{"1min":0.871,"5min":0.74399999999999999,"15min":0.66900000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.262,"5min":1.304,"15min":1.2949999999999999},"min":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.66300000000000003},"max":{"1min":1.6040000000000001,"5min":1.8580000000000001,"15min":2.6499999999999999},"last":1.3400000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3759999999999999,"15min":1.333},"min":{"1min":0.745,"5min":0.745,"15min":0.67600000000000005},"max":{"1min":1.756,"5min":1.845,"15min":2.327},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3779999999999999,"15min":1.3540000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.74099999999999999},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.5979999999999999},"last":1.29}]},{"osd":4,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3420000000000001,"15min":1.377},"min":{"1min":0.85999999999999999,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.837,"5min":1.9910000000000001,"15min":11.058999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.4059999999999999,"15min":1.3819999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.0179999999999998,"15min":2.3479999999999999},"last":1.1659999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.353,"15min":1.365},"min":{"1min":0.94599999999999995,"5min":0.89800000000000002,"15min":0.77600000000000002},"max":{"1min":1.9099999999999999,"5min":1.96,"15min":2.5249999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.512,"15min":1.512},"min":{"1min":1.028,"5min":0.94399999999999995,"15min":0.81899999999999995},"max":{"1min":1.9039999999999999,"5min":2.077,"15min":2.8580000000000001},"last":1.49}]},{"osd":7,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.5669999999999999,"15min":1.536},"min":{"1min":1.234,"5min":1.1100000000000001,"15min":0.59099999999999997},"max":{"1min":1.9630000000000001,"5min":2.093,"15min":2.7999999999999998},"last":1.403},{"interface":"front","average":{"1min":1.528,"5min":1.542,"15min":1.524},"min":{"1min":1.1970000000000001,"5min":1.0469999999999999,"15min":0.74399999999999999},"max":{"1min":2.0870000000000002,"5min":2.1280000000000001,"15min":3.621},"last":1.4410000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1459999999999999,"15min":1.119},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.4830000000000001,"5min":1.609,"15min":3.4060000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.2010000000000001,"15min":1.171},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.625},"max":{"1min":1.5469999999999999,"5min":1.8460000000000001,"15min":2.0600000000000001},"last":0.86099999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.379,"15min":1.3480000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.63800000000000001},"max":{"1min":2.048,"5min":2.048,"15min":2.6579999999999999},"last":1.208},{"interface":"front","average":{"1min":1.371,"5min":1.375,"15min":1.306},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.70199999999999996},"max":{"1min":1.9179999999999999,"5min":2.262,"15min":2.262},"last":0.92700000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.76800000000000002,"15min":0.69799999999999995},"max":{"1min":1.8260000000000001,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2829999999999999,"15min":1.2350000000000001},"min":{"1min":0.746,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.8149999999999999},"last":0.996}]},{"osd":3,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.3069999999999999,"15min":1.288},"min":{"1min":0.999,"5min":0.81100000000000005,"15min":0.71799999999999997},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.2330000000000001},"last":1.117},{"interface":"front","average":{"1min":1.383,"5min":1.377,"15min":1.373},"min":{"1min":0.95199999999999996,"5min":0.93000000000000005,"15min":0.78200000000000003},"max":{"1min":1.716,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.1599999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2969999999999999,"15min":1.282},"min":{"1min":0.92400000000000004,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.698,"5min":2.169,"15min":4.6920000000000002},"last":1.387},{"interface":"front","average":{"1min":1.45,"5min":1.407,"15min":1.399},"min":{"1min":1.1160000000000001,"5min":0.875,"15min":0.628},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":3.3109999999999999},"last":1.3089999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4590000000000001,"15min":1.4119999999999999},"min":{"1min":1.0920000000000001,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":2.0259999999999998,"5min":2.7719999999999998,"15min":2.952},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.5,"15min":1.478},"min":{"1min":1.127,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.1059999999999999,"15min":5.8570000000000002},"last":1.665}]},{"osd":7,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.556,"15min":1.538},"min":{"1min":1.3200000000000001,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":2.302,"5min":2.302,"15min":3.4590000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6120000000000001,"15min":1.5840000000000001},"min":{"1min":1.3340000000000001,"5min":1.121,"15min":0.65300000000000002},"max":{"1min":2.2069999999999999,"5min":2.8849999999999998,"15min":3.0649999999999999},"last":1.347}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.123,"15min":1.115},"min":{"1min":0.747,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":1.986,"15min":2.5670000000000002},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.72199999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":3.4100000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.296,"15min":1.29},"min":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.6399999999999999,"5min":1.8180000000000001,"15min":2.3679999999999999},"last":1.077},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3380000000000001,"15min":1.335},"min":{"1min":0.96699999999999997,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":1.889,"5min":1.889,"15min":2.9590000000000001},"last":1.113}]},{"osd":2,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.3640000000000001,"15min":1.331},"min":{"1min":0.92000000000000004,"5min":0.81499999999999995,"15min":0.54900000000000004},"max":{"1min":1.6779999999999999,"5min":1.865,"15min":2.4729999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.27,"5min":1.363,"15min":1.3480000000000001},"min":{"1min":1.004,"5min":0.91300000000000003,"15min":0.67900000000000005},"max":{"1min":1.6679999999999999,"5min":1.887,"15min":3.0579999999999998},"last":0.96699999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.226,"15min":1.256},"min":{"1min":0.82699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5329999999999999,"5min":1.6559999999999999,"15min":3.4430000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3480000000000001,"15min":1.337},"min":{"1min":1.02,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":2.5289999999999999},"last":1.4019999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3200000000000001,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":3.137},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.306,"15min":1.3560000000000001},"min":{"1min":0.76800000000000002,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":3.3620000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.3640000000000001,"15min":1.411},"min":{"1min":1.087,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.5819999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.486,"15min":1.518},"min":{"1min":1.1319999999999999,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.952,"5min":1.952,"15min":3.3340000000000001},"last":1.359}]},{"osd":7,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4450000000000001,"15min":1.506},"min":{"1min":0.995,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.853,"5min":1.853,"15min":3.4900000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.577,"5min":1.552,"15min":1.579},"min":{"1min":1.2609999999999999,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.875},"last":1.5069999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.89600000000000002,"15min":0.877},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.29199999999999998},"max":{"1min":1.381,"5min":1.494,"15min":4.4109999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0409999999999999,"15min":1.006},"min":{"1min":0.41899999999999998,"5min":0.38600000000000001,"15min":0.35499999999999998},"max":{"1min":1.2729999999999999,"5min":1.99,"15min":3.2269999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.38100000000000001},"max":{"1min":1.456,"5min":1.4830000000000001,"15min":2.1280000000000001},"last":0.443},{"interface":"front","average":{"1min":1,"5min":1.159,"15min":1.0920000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.33900000000000002},"max":{"1min":1.5820000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2,"15min":1.1919999999999999},"min":{"1min":0.63600000000000001,"5min":0.47999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6870000000000001,"5min":2.089,"15min":18.145},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2729999999999999,"15min":1.2330000000000001},"min":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.379},"max":{"1min":1.663,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.621}]},{"osd":4,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2869999999999999,"15min":1.296},"min":{"1min":0.79500000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.895,"5min":1.905,"15min":3.5110000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.401,"15min":1.3420000000000001},"min":{"1min":1.0089999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5940000000000001,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.0640000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.51,"15min":1.4750000000000001},"min":{"1min":1.044,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":1.845,"5min":2.302,"15min":18.094000000000001},"last":1.004},{"interface":"front","average":{"1min":1.345,"5min":1.454,"15min":1.4590000000000001},"min":{"1min":0.879,"5min":0.80900000000000005,"15min":0.69899999999999995},"max":{"1min":1.7350000000000001,"5min":2.1150000000000002,"15min":14.105},"last":1.0309999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.413,"15min":1.387},"min":{"1min":0.80100000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":3.2789999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5429999999999999,"15min":1.4810000000000001},"min":{"1min":0.96899999999999997,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.3730000000000002,"15min":4.0220000000000002},"last":0.90300000000000002}]},{"osd":7,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5600000000000001,"15min":1.4910000000000001},"min":{"1min":1.0169999999999999,"5min":0.88600000000000001,"15min":0.72499999999999998},"max":{"1min":1.9650000000000001,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.167},{"interface":"front","average":{"1min":1.375,"5min":1.522,"15min":1.47},"min":{"1min":0.86099999999999999,"5min":0.71799999999999997,"15min":0.70799999999999996},"max":{"1min":1.774,"5min":2.3380000000000001,"15min":3.016},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.94099999999999995,"15min":0.89300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":1.3300000000000001,"5min":1.673,"15min":1.716},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":0.98699999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.38900000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":2.9009999999999998},"last":0.61599999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.36299999999999999},"max":{"1min":1.2669999999999999,"5min":1.5149999999999999,"15min":1.8700000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1359999999999999,"15min":1.0740000000000001},"min":{"1min":0.58099999999999996,"5min":0.501,"15min":0.46899999999999997},"max":{"1min":1.625,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.05}]},{"osd":3,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1679999999999999,"15min":1.1539999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.46600000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":3.2850000000000001},"last":0.75},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3089999999999999,"15min":1.2190000000000001},"min":{"1min":0.64700000000000002,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.7689999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":1.2370000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.512,"15min":1.4550000000000001},"min":{"1min":1.0800000000000001,"5min":0.95499999999999996,"15min":0.81899999999999995},"max":{"1min":1.8140000000000001,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.341},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3979999999999999,"15min":1.3520000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.66800000000000004},"max":{"1min":1.7490000000000001,"5min":2.109,"15min":3.4500000000000002},"last":0.94299999999999995}]},{"osd":5,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.4139999999999999,"15min":1.403},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.69599999999999995},"max":{"1min":1.7549999999999999,"5min":1.95,"15min":5.0140000000000002},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.5880000000000001,"15min":1.508},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.78700000000000003},"max":{"1min":1.9179999999999999,"5min":2.133,"15min":4.806},"last":1.306}]},{"osd":6,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.405,"15min":1.367},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.67500000000000004},"max":{"1min":1.8540000000000001,"5min":1.976,"15min":2.5179999999999998},"last":1.008},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4990000000000001,"15min":1.46},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.73399999999999999},"max":{"1min":1.79,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.1599999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4610000000000001,"15min":1.4219999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.76200000000000001},"max":{"1min":1.867,"5min":1.9510000000000001,"15min":2.464},"last":1.105},{"interface":"front","average":{"1min":1.446,"5min":1.593,"15min":1.55},"min":{"1min":1.03,"5min":1.03,"15min":0.69299999999999995},"max":{"1min":1.8620000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.2709999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179819,"statfs":{"total":200000000,"available":184135392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5469999999999999,"5min":1.6859999999999999,"15min":2.621},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.3380000000000001},"min":{"1min":0.52700000000000002,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.778,"5min":1.778,"15min":88.254999999999995},"last":1.46}]},{"osd":2,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.0029999999999999},"min":{"1min":0.55900000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.6679999999999999,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.325,"15min":1.2549999999999999},"min":{"1min":0.65100000000000002,"5min":0.55100000000000005,"15min":0.45900000000000002},"max":{"1min":1.629,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.411}]},{"osd":3,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.2370000000000001,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.6599999999999999,"5min":2.181,"15min":2.181},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1719999999999999,"15min":1.107},"min":{"1min":0.56499999999999995,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":1.863,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.228}]},{"osd":4,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2749999999999999,"15min":1.3420000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.921,"15min":25.172000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4179999999999999,"15min":1.381},"min":{"1min":0.81299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6739999999999999,"5min":1.9259999999999999,"15min":3.762},"last":1.579}]},{"osd":5,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.419,"15min":1.4590000000000001},"min":{"1min":0.85999999999999999,"5min":0.80100000000000005,"15min":0.751},"max":{"1min":1.859,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.345},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.333,"15min":1.331},"min":{"1min":0.97299999999999998,"5min":0.876,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":1.9079999999999999,"15min":3.762},"last":0.98199999999999998}]},{"osd":6,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.5740000000000001,"15min":1.5049999999999999},"min":{"1min":0.96899999999999997,"5min":0.93600000000000005,"15min":0.79700000000000004},"max":{"1min":1.913,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.4990000000000001,"15min":1.4510000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.79500000000000004},"max":{"1min":1.9279999999999999,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.556}]},{"osd":7,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.579,"15min":1.6379999999999999},"min":{"1min":0.94199999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8420000000000001,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.794},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.6359999999999999,"15min":1.663},"min":{"1min":1.0680000000000001,"5min":0.92600000000000005,"15min":0.65600000000000003},"max":{"1min":2.1949999999999998,"5min":2.464,"15min":28.765000000000001},"last":1.6359999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575031,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":14021,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181291,"statfs":{"total":200000000,"available":185642176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.88,"15min":0.88800000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.35799999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.819},"last":1.206},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.087,"15min":1.042},"min":{"1min":0.54000000000000004,"5min":0.437,"15min":0.436},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":6.1749999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.099,"15min":1.0349999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.7669999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1100000000000001,"15min":1.089},"min":{"1min":0.59999999999999998,"5min":0.54500000000000004,"15min":0.5},"max":{"1min":1.736,"5min":1.7410000000000001,"15min":6.2549999999999999},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.032,"15min":1.0309999999999999},"min":{"1min":0.63800000000000001,"5min":0.52400000000000002,"15min":0.45300000000000001},"max":{"1min":1.2889999999999999,"5min":1.893,"15min":9.6069999999999993},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.2470000000000001,"15min":1.212},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56000000000000005},"max":{"1min":1.962,"5min":1.962,"15min":2.2730000000000001},"last":0.91500000000000004}]},{"osd":4,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.397,"15min":1.365},"min":{"1min":0.99399999999999999,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.726,"5min":2.286,"15min":9.9629999999999992},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.456,"15min":1.381},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.77900000000000003},"max":{"1min":3.2759999999999998,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.139}]},{"osd":5,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.3660000000000001},"min":{"1min":0.94899999999999995,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":10.004},"last":1.456},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4930000000000001,"15min":1.4379999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":2.1419999999999999,"15min":2.161},"last":1.393}]},{"osd":6,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.458,"15min":1.4239999999999999},"min":{"1min":0.78000000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":6.4290000000000003},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.48,"5min":1.51,"15min":1.4810000000000001},"min":{"1min":0.86299999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.294,"5min":2.294,"15min":9.9190000000000005},"last":1.698}]},{"osd":7,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.524,"15min":1.5149999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.73699999999999999},"max":{"1min":3.5920000000000001,"5min":3.5920000000000001,"15min":18.114000000000001},"last":1.327},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.577,"15min":1.54},"min":{"1min":1.034,"5min":0.84099999999999997,"15min":0.82299999999999995},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":9.5640000000000001},"last":1.5780000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:54:21.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-09T12:54:21.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.357+0000 7f4f9d3b7640 1 Processor -- start 2023-08-09T12:54:21.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.358+0000 7f4f9d3b7640 1 -- start start 2023-08-09T12:54:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.359+0000 7f4f9d3b7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4f981616e0 0x7f4f980b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:21.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.359+0000 7f4f9d3b7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 0x7f4f980d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:21.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.359+0000 7f4f9d3b7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f980cdd10 con 0x7f4f9815ce90 2023-08-09T12:54:21.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.359+0000 7f4f9d3b7640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f980b6540 con 0x7f4f981616e0 2023-08-09T12:54:21.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.359+0000 7f4f9d3b7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f980d33a0 con 0x7f4f980d29d0 2023-08-09T12:54:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.360+0000 7f4f96ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4f9815ce90 0x7f4f980cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49216/0 (socket says 172.21.15.17:49216) 2023-08-09T12:54:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.360+0000 7f4f96ffd640 1 -- 172.21.15.17:0/1967752042 learned_addr learned my addr 172.21.15.17:0/1967752042 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.360+0000 7f4f967fc640 1 --2- 172.21.15.17:0/1967752042 >> v2:172.21.15.17:3300/0 conn(0x7f4f981616e0 0x7f4f980b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.360+0000 7f4f977fe640 1 --2- 172.21.15.17:0/1967752042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 0x7f4f980d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.360+0000 7f4f95ffb640 1 -- 172.21.15.17:0/1967752042 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250687706 0 0) 0x7f4f980cdd10 con 0x7f4f9815ce90 2023-08-09T12:54:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.360+0000 7f4f95ffb640 1 -- 172.21.15.17:0/1967752042 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f84003520 con 0x7f4f9815ce90 2023-08-09T12:54:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.361+0000 7f4f967fc640 1 -- 172.21.15.17:0/1967752042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 msgr2=0x7f4f980d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.361+0000 7f4f967fc640 1 --2- 172.21.15.17:0/1967752042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 0x7f4f980d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.361+0000 7f4f967fc640 1 -- 172.21.15.17:0/1967752042 >> v1:172.21.15.17:6789/0 conn(0x7f4f9815ce90 legacy=0x7f4f980cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.361+0000 7f4f967fc640 1 -- 172.21.15.17:0/1967752042 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f980cdff0 con 0x7f4f981616e0 2023-08-09T12:54:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.362+0000 7f4f967fc640 1 --2- 172.21.15.17:0/1967752042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f981616e0 0x7f4f980b6000 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4f800097a0 tx=0x7f4f8002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3162de2bde46fca server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.362+0000 7f4f95ffb640 1 -- 172.21.15.17:0/1967752042 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8002d040 con 0x7f4f981616e0 2023-08-09T12:54:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.362+0000 7f4f95ffb640 1 -- 172.21.15.17:0/1967752042 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80031810 con 0x7f4f981616e0 2023-08-09T12:54:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.362+0000 7f4f95ffb640 1 -- 172.21.15.17:0/1967752042 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80031ba0 con 0x7f4f981616e0 2023-08-09T12:54:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.363+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/1967752042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f981616e0 msgr2=0x7f4f980b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.363+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/1967752042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f981616e0 0x7f4f980b6000 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4f800097a0 tx=0x7f4f8002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.363+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/1967752042 shutdown_connections 2023-08-09T12:54:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.363+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/1967752042 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 0x7f4f980d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.363+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/1967752042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f981616e0 0x7f4f980b6000 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.363+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/1967752042 >> 172.21.15.17:0/1967752042 conn(0x7f4f9806fde0 msgr2=0x7f4f980701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.363+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/1967752042 shutdown_connections 2023-08-09T12:54:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.363+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/1967752042 wait complete. 2023-08-09T12:54:21.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.365+0000 7f4f9d3b7640 1 Processor -- start 2023-08-09T12:54:21.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.365+0000 7f4f9d3b7640 1 -- start start 2023-08-09T12:54:21.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f9d3b7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 0x7f4f9815f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:21.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f9d3b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f9815ce90 0x7f4f9814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:21.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f9d3b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f981616e0 0x7f4f980b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:21.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f9d3b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9815e020 con 0x7f4f9815ce90 2023-08-09T12:54:21.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f9d3b7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9815d3a0 con 0x7f4f981616e0 2023-08-09T12:54:21.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f9d3b7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9815d680 con 0x7f4f980d29d0 2023-08-09T12:54:21.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f967fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f9815ce90 0x7f4f9814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f967fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f9815ce90 0x7f4f9814b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52120/0 (socket says 172.21.15.17:52120) 2023-08-09T12:54:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.366+0000 7f4f967fc640 1 -- 172.21.15.17:0/299125866 learned_addr learned my addr 172.21.15.17:0/299125866 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f96ffd640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 0x7f4f9815f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f967fc640 1 -- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 msgr2=0x7f4f9815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f967fc640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 0x7f4f9815f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f967fc640 1 -- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f981616e0 msgr2=0x7f4f980b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f977fe640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f981616e0 0x7f4f980b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f967fc640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f981616e0 0x7f4f980b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f967fc640 1 -- 172.21.15.17:0/299125866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009400 con 0x7f4f9815ce90 2023-08-09T12:54:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f977fe640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f981616e0 0x7f4f980b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.367+0000 7f4f967fc640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f9815ce90 0x7f4f9814b9f0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f4f80000c00 tx=0x7f4f800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.368+0000 7f4f8f7fe640 1 -- 172.21.15.17:0/299125866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8003ad60 con 0x7f4f9815ce90 2023-08-09T12:54:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.368+0000 7f4f8f7fe640 1 -- 172.21.15.17:0/299125866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f800443f0 con 0x7f4f9815ce90 2023-08-09T12:54:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.368+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9815d960 con 0x7f4f9815ce90 2023-08-09T12:54:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.368+0000 7f4f8f7fe640 1 -- 172.21.15.17:0/299125866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800445a0 con 0x7f4f9815ce90 2023-08-09T12:54:21.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.368+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9815bce0 con 0x7f4f9815ce90 2023-08-09T12:54:21.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.369+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f98067a80 con 0x7f4f9815ce90 2023-08-09T12:54:21.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.370+0000 7f4f8f7fe640 1 -- 172.21.15.17:0/299125866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f8004d450 con 0x7f4f9815ce90 2023-08-09T12:54:21.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.371+0000 7f4f8f7fe640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7806a050 0x7f4f7806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:21.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.371+0000 7f4f8f7fe640 1 -- 172.21.15.17:0/299125866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4f800aa510 con 0x7f4f9815ce90 2023-08-09T12:54:21.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.372+0000 7f4f96ffd640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7806a050 0x7f4f7806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:21.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.373+0000 7f4f96ffd640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7806a050 0x7f4f7806c510 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4f88001560 tx=0x7f4f88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:21.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.376+0000 7f4f8f7fe640 1 -- 172.21.15.17:0/299125866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f4f80076030 con 0x7f4f9815ce90 2023-08-09T12:54:21.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.571+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f980d0320 con 0x7f4f9815ce90 2023-08-09T12:54:21.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.573+0000 7f4f8f7fe640 1 -- 172.21.15.17:0/299125866 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+14754 (secure 0 0 0) 0x7f4f80079650 con 0x7f4f9815ce90 2023-08-09T12:54:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:21.577 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":198,"fsid":"00c647bf-6030-4006-bfa6-56fa996e3ac5","created":"2023-08-09T12:39:03.674610+0000","modified":"2023-08-09T12:54:16.213970+0000","last_up_change":"2023-08-09T12:39:11.099343+0000","last_in_change":"2023-08-09T12:39:08.087505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-09T12:39:12.706671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-09T12:39:17.365312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6809","nonce":1208264847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6811","nonce":1208264847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6815","nonce":1208264847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1208264847},{"type":"v1","addr":"172.21.15.17:6813","nonce":1208264847}]},"public_addr":"172.21.15.17:6809/1208264847","cluster_addr":"172.21.15.17:6811/1208264847","heartbeat_back_addr":"172.21.15.17:6815/1208264847","heartbeat_front_addr":"172.21.15.17:6813/1208264847","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6817","nonce":160883259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6819","nonce":160883259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6823","nonce":160883259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":160883259},{"type":"v1","addr":"172.21.15.17:6821","nonce":160883259}]},"public_addr":"172.21.15.17:6817/160883259","cluster_addr":"172.21.15.17:6819/160883259","heartbeat_back_addr":"172.21.15.17:6823/160883259","heartbeat_front_addr":"172.21.15.17:6821/160883259","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6801","nonce":1219800306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6803","nonce":1219800306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6807","nonce":1219800306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1219800306},{"type":"v1","addr":"172.21.15.17:6805","nonce":1219800306}]},"public_addr":"172.21.15.17:6801/1219800306","cluster_addr":"172.21.15.17:6803/1219800306","heartbeat_back_addr":"172.21.15.17:6807/1219800306","heartbeat_front_addr":"172.21.15.17:6805/1219800306","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6825","nonce":2232182345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6827","nonce":2232182345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6831","nonce":2232182345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2232182345},{"type":"v1","addr":"172.21.15.17:6829","nonce":2232182345}]},"public_addr":"172.21.15.17:6825/2232182345","cluster_addr":"172.21.15.17:6827/2232182345","heartbeat_back_addr":"172.21.15.17:6831/2232182345","heartbeat_front_addr":"172.21.15.17:6829/2232182345","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6809","nonce":701351329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6811","nonce":701351329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6815","nonce":701351329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":701351329},{"type":"v1","addr":"172.21.15.142:6813","nonce":701351329}]},"public_addr":"172.21.15.142:6809/701351329","cluster_addr":"172.21.15.142:6811/701351329","heartbeat_back_addr":"172.21.15.142:6815/701351329","heartbeat_front_addr":"172.21.15.142:6813/701351329","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6801","nonce":445717890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6803","nonce":445717890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6807","nonce":445717890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":445717890},{"type":"v1","addr":"172.21.15.142:6805","nonce":445717890}]},"public_addr":"172.21.15.142:6801/445717890","cluster_addr":"172.21.15.142:6803/445717890","heartbeat_back_addr":"172.21.15.142:6807/445717890","heartbeat_front_addr":"172.21.15.142:6805/445717890","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6823","nonce":1908382838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6827","nonce":1908382838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6831","nonce":1908382838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1908382838},{"type":"v1","addr":"172.21.15.142:6829","nonce":1908382838}]},"public_addr":"172.21.15.142:6823/1908382838","cluster_addr":"172.21.15.142:6827/1908382838","heartbeat_back_addr":"172.21.15.142:6831/1908382838","heartbeat_front_addr":"172.21.15.142:6829/1908382838","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6817","nonce":3944800056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6819","nonce":3944800056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6826","nonce":3944800056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3944800056},{"type":"v1","addr":"172.21.15.142:6822","nonce":3944800056}]},"public_addr":"172.21.15.142:6817/3944800056","cluster_addr":"172.21.15.142:6819/3944800056","heartbeat_back_addr":"172.21.15.142:6826/3944800056","heartbeat_front_addr":"172.21.15.142:6822/3944800056","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.366639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.370986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.383950+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.421868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.407813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.353988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.422266+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-09T12:39:09.385610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6834/918927752":"2023-08-10T12:54:13.006659+0000","172.21.15.17:6832/918927752":"2023-08-10T12:54:13.006659+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-09T12:54:21.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7806a050 msgr2=0x7f4f7806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:21.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7806a050 0x7f4f7806c510 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4f88001560 tx=0x7f4f88009040 comp rx=0 tx=0).stop 2023-08-09T12:54:21.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f9815ce90 msgr2=0x7f4f9814b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:21.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f9815ce90 0x7f4f9814b9f0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f4f80000c00 tx=0x7f4f800046c0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 shutdown_connections 2023-08-09T12:54:21.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f4f7806a050 0x7f4f7806c510 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f981616e0 0x7f4f980b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f9815ce90 0x7f4f9814b9f0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 --2- 172.21.15.17:0/299125866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f980d29d0 0x7f4f9815f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:21.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.576+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 >> 172.21.15.17:0/299125866 conn(0x7f4f9806fde0 msgr2=0x7f4f980cc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:21.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.577+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 shutdown_connections 2023-08-09T12:54:21.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:21.577+0000 7f4f9d3b7640 1 -- 172.21.15.17:0/299125866 wait complete. 2023-08-09T12:54:22.601 INFO:tasks.ceph:Scrubbing osd.0 2023-08-09T12:54:22.602 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-09T12:54:22.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.845+0000 7fc2d5df5640 1 Processor -- start 2023-08-09T12:54:22.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.845+0000 7fc2d5df5640 1 -- start start 2023-08-09T12:54:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.847+0000 7fc2d5df5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2d00b41b0 0x7fc2d00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.848+0000 7fc2d5df5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d00b18b0 con 0x7fc2d00b3dd0 2023-08-09T12:54:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.848+0000 7fc2d5df5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d00b1b10 con 0x7fc2d00c8240 2023-08-09T12:54:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.848+0000 7fc2d5df5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d00b1df0 con 0x7fc2d00b41b0 2023-08-09T12:54:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.848+0000 7fc2d4df3640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc2d00b3dd0 0x7fc2d015eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49226/0 (socket says 172.21.15.17:49226) 2023-08-09T12:54:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.848+0000 7fc2d4df3640 1 -- 172.21.15.17:0/846660928 learned_addr learned my addr 172.21.15.17:0/846660928 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.848+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766464819 0 0) 0x7fc2d00b18b0 con 0x7fc2d00b3dd0 2023-08-09T12:54:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.848+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2c0003520 con 0x7fc2d00b3dd0 2023-08-09T12:54:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.848+0000 7fc2cffff640 1 --2- 172.21.15.17:0/846660928 >> v2:172.21.15.142:3300/0 conn(0x7fc2d00b41b0 0x7fc2d00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443122086 0 0) 0x7fc2c0003520 con 0x7fc2d00b3dd0 2023-08-09T12:54:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 >> v2:172.21.15.142:3300/0 conn(0x7fc2d00b41b0 msgr2=0x7fc2d00b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 --2- 172.21.15.17:0/846660928 >> v2:172.21.15.142:3300/0 conn(0x7fc2d00b41b0 0x7fc2d00b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 >> v1:172.21.15.142:6789/0 conn(0x7fc2d00c8240 legacy=0x7fc2d00affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00b20d0 con 0x7fc2d00b3dd0 2023-08-09T12:54:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7fc2c4001670 con 0x7fc2d00b3dd0 2023-08-09T12:54:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 >> v1:172.21.15.17:6789/0 conn(0x7fc2d00b3dd0 legacy=0x7fc2d015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2c00039a0 0x7fc2c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2c00047c0 0x7fc2c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00b1df0 con 0x7fc2c0005180 2023-08-09T12:54:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c000c050 con 0x7fc2c00039a0 2023-08-09T12:54:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c000c210 con 0x7fc2c00047c0 2023-08-09T12:54:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.849+0000 7fc2d55f4640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:22.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.850+0000 7fc2cffff640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2c00047c0 0x7fc2c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:22.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.850+0000 7fc2d55f4640 1 -- 172.21.15.17:0/846660928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2c00047c0 msgr2=0x7fc2c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.850+0000 7fc2d55f4640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2c00047c0 0x7fc2c0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.850+0000 7fc2d55f4640 1 -- 172.21.15.17:0/846660928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2c00039a0 msgr2=0x7fc2c0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.850+0000 7fc2d55f4640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2c00039a0 0x7fc2c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.850+0000 7fc2d55f4640 1 -- 172.21.15.17:0/846660928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c0003520 con 0x7fc2c0005180 2023-08-09T12:54:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.851+0000 7fc2d55f4640 1 -- 172.21.15.17:0/846660928 reap_dead start 2023-08-09T12:54:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.851+0000 7fc2d55f4640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2c000b980 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8001e50 tx=0x7fc2c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d5add575ba3c33 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.851+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8003b70 con 0x7fc2c0005180 2023-08-09T12:54:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.851+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8003cf0 con 0x7fc2c0005180 2023-08-09T12:54:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.851+0000 7fc2cf7fe640 1 -- 172.21.15.17:0/846660928 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8005310 con 0x7fc2c0005180 2023-08-09T12:54:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.852+0000 7fc2d5df5640 1 -- 172.21.15.17:0/846660928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 msgr2=0x7fc2c000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.852+0000 7fc2d5df5640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2c000b980 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8001e50 tx=0x7fc2c00057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.852+0000 7fc2d5df5640 1 -- 172.21.15.17:0/846660928 shutdown_connections 2023-08-09T12:54:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.852+0000 7fc2d5df5640 1 --2- 172.21.15.17:0/846660928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2c000b980 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.852+0000 7fc2d5df5640 1 -- 172.21.15.17:0/846660928 >> 172.21.15.17:0/846660928 conn(0x7fc2d00cafa0 msgr2=0x7fc2d00cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.852+0000 7fc2d5df5640 1 -- 172.21.15.17:0/846660928 shutdown_connections 2023-08-09T12:54:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.852+0000 7fc2d5df5640 1 -- 172.21.15.17:0/846660928 wait complete. 2023-08-09T12:54:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.854+0000 7fc2d5df5640 1 Processor -- start 2023-08-09T12:54:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.854+0000 7fc2d5df5640 1 -- start start 2023-08-09T12:54:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.855+0000 7fc2d5df5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2d00c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.855+0000 7fc2d5df5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d014dcc0 0x7fc2d00c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.855+0000 7fc2d5df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d00ccb00 0x7fc2d00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.855+0000 7fc2d5df5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00cda80 con 0x7fc2c0005180 2023-08-09T12:54:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.855+0000 7fc2d5df5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d006f080 con 0x7fc2d00ccb00 2023-08-09T12:54:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.855+0000 7fc2d5df5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00adfd0 con 0x7fc2d014dcc0 2023-08-09T12:54:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.855+0000 7fc2d4df3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2d00c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d4df3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2d00c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52140/0 (socket says 172.21.15.17:52140) 2023-08-09T12:54:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d4df3640 1 -- 172.21.15.17:0/3371225136 learned_addr learned my addr 172.21.15.17:0/3371225136 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2cffff640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d014dcc0 0x7fc2d00c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d55f4640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d00ccb00 0x7fc2d00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d4df3640 1 -- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d014dcc0 msgr2=0x7fc2d00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d4df3640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2d014dcc0 0x7fc2d00c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d4df3640 1 -- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d00ccb00 msgr2=0x7fc2d00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d4df3640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d00ccb00 0x7fc2d00ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d4df3640 1 -- 172.21.15.17:0/3371225136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00cd4d0 con 0x7fc2c0005180 2023-08-09T12:54:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d55f4640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2d00ccb00 0x7fc2d00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.856+0000 7fc2d4df3640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2d00c69c0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40011e0 tx=0x7fc2c400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.857+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40074e0 con 0x7fc2c0005180 2023-08-09T12:54:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.857+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c4007640 con 0x7fc2c0005180 2023-08-09T12:54:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.857+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d00cd7a0 con 0x7fc2c0005180 2023-08-09T12:54:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.857+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4004a00 con 0x7fc2c0005180 2023-08-09T12:54:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.857+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d006ed10 con 0x7fc2c0005180 2023-08-09T12:54:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.858+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2d015e6a0 con 0x7fc2c0005180 2023-08-09T12:54:22.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.859+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc2c4004b60 con 0x7fc2c0005180 2023-08-09T12:54:22.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.860+0000 7fc2cd7fa640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2b406a050 0x7fc2b406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.860+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc2c4087980 con 0x7fc2c0005180 2023-08-09T12:54:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.860+0000 7fc2cd7fa640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7fc2b40704d0 0x7fc2b40728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.860+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 --> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2b4072fa0 con 0x7fc2b40704d0 2023-08-09T12:54:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.860+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2c408c2a0 con 0x7fc2c0005180 2023-08-09T12:54:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.861+0000 7fc2d55f4640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7fc2b40704d0 0x7fc2b40728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.861+0000 7fc2cffff640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2b406a050 0x7fc2b406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.861+0000 7fc2d55f4640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7fc2b40704d0 0x7fc2b40728f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:22.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.862+0000 7fc2cffff640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2b406a050 0x7fc2b406c510 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00b06a0 tx=0x7fc2bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:22.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.862+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 <== osd.0 v2:172.21.15.17:6808/1208264847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fc2b4072fa0 con 0x7fc2b40704d0 2023-08-09T12:54:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.875+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 --> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc2d015e3c0 con 0x7fc2b40704d0 2023-08-09T12:54:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2cd7fa640 1 -- 172.21.15.17:0/3371225136 <== osd.0 v2:172.21.15.17:6808/1208264847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fc2c8006b50 con 0x7fc2b40704d0 2023-08-09T12:54:22.879 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:54:22.879 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-09T12:54:22.879 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:54:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7fc2b40704d0 msgr2=0x7fc2b40728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d5df5640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.17:6808/1208264847,v1:172.21.15.17:6809/1208264847] conn(0x7fc2b40704d0 0x7fc2b40728f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2b406a050 msgr2=0x7fc2b406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d5df5640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fc2b406a050 0x7fc2b406c510 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00b06a0 tx=0x7fc2bc008040 comp rx=0 tx=0).stop 2023-08-09T12:54:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 msgr2=0x7fc2d00c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d5df5640 1 --2- 172.21.15.17:0/3371225136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c0005180 0x7fc2d00c69c0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40011e0 tx=0x7fc2c400cc20 comp rx=0 tx=0).stop 2023-08-09T12:54:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d55f4640 1 -- 172.21.15.17:0/3371225136 reap_dead start 2023-08-09T12:54:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 shutdown_connections 2023-08-09T12:54:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.876+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 >> 172.21.15.17:0/3371225136 conn(0x7fc2d00cafa0 msgr2=0x7fc2d015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.877+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 shutdown_connections 2023-08-09T12:54:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:22.877+0000 7fc2d5df5640 1 -- 172.21.15.17:0/3371225136 wait complete. 2023-08-09T12:54:22.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-09T12:54:23.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.127+0000 7f781c576640 1 Processor -- start 2023-08-09T12:54:23.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.128+0000 7f781c576640 1 -- start start 2023-08-09T12:54:23.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.129+0000 7f781c576640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78140adc40 0x7f781406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.129+0000 7f781c576640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78140b3b40 0x7f78140b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.129+0000 7f781c576640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78140b2250 con 0x7f781415e8f0 2023-08-09T12:54:23.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.129+0000 7f781c576640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140ae020 con 0x7f78140adc40 2023-08-09T12:54:23.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.129+0000 7f781c576640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140b2530 con 0x7f78140b3b40 2023-08-09T12:54:23.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f781a312640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78140adc40 0x7f781406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f781a312640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78140adc40 0x7f781406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52156/0 (socket says 172.21.15.17:52156) 2023-08-09T12:54:23.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f781a312640 1 -- 172.21.15.17:0/4019169791 learned_addr learned my addr 172.21.15.17:0/4019169791 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:23.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f7819b11640 1 --2- 172.21.15.17:0/4019169791 >> v2:172.21.15.142:3300/0 conn(0x7f78140b3b40 0x7f78140b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f781a312640 1 -- 172.21.15.17:0/4019169791 >> v2:172.21.15.142:3300/0 conn(0x7f78140b3b40 msgr2=0x7f78140b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f781a312640 1 --2- 172.21.15.17:0/4019169791 >> v2:172.21.15.142:3300/0 conn(0x7f78140b3b40 0x7f78140b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f781a312640 1 -- 172.21.15.17:0/4019169791 >> v1:172.21.15.142:6789/0 conn(0x7f781415e8f0 legacy=0x7f781415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f781a312640 1 -- 172.21.15.17:0/4019169791 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781406fe80 con 0x7f78140adc40 2023-08-09T12:54:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.130+0000 7f7819b11640 1 --2- 172.21.15.17:0/4019169791 >> v2:172.21.15.142:3300/0 conn(0x7f78140b3b40 0x7f78140b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.132+0000 7f781a312640 1 --2- 172.21.15.17:0/4019169791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f781406c280 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f78140b48a0 tx=0x7f781002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cdfb6835338aea server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.132+0000 7f7819310640 1 -- 172.21.15.17:0/4019169791 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810031870 con 0x7f78140adc40 2023-08-09T12:54:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.132+0000 7f7819310640 1 -- 172.21.15.17:0/4019169791 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78100319d0 con 0x7f78140adc40 2023-08-09T12:54:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.132+0000 7f7819310640 1 -- 172.21.15.17:0/4019169791 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810031d60 con 0x7f78140adc40 2023-08-09T12:54:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.133+0000 7f781c576640 1 -- 172.21.15.17:0/4019169791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 msgr2=0x7f781406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.133+0000 7f781c576640 1 --2- 172.21.15.17:0/4019169791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f781406c280 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f78140b48a0 tx=0x7f781002b910 comp rx=0 tx=0).stop 2023-08-09T12:54:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.133+0000 7f781c576640 1 -- 172.21.15.17:0/4019169791 shutdown_connections 2023-08-09T12:54:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.133+0000 7f781c576640 1 --2- 172.21.15.17:0/4019169791 >> v2:172.21.15.142:3300/0 conn(0x7f78140b3b40 0x7f78140b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.133+0000 7f781c576640 1 --2- 172.21.15.17:0/4019169791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f781406c280 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.133+0000 7f781c576640 1 -- 172.21.15.17:0/4019169791 >> 172.21.15.17:0/4019169791 conn(0x7f78140cb1b0 msgr2=0x7f78140cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.133+0000 7f781c576640 1 -- 172.21.15.17:0/4019169791 shutdown_connections 2023-08-09T12:54:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.133+0000 7f781c576640 1 -- 172.21.15.17:0/4019169791 wait complete. 2023-08-09T12:54:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.135+0000 7f781c576640 1 Processor -- start 2023-08-09T12:54:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.135+0000 7f781c576640 1 -- start start 2023-08-09T12:54:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.136+0000 7f781c576640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f78141eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.136+0000 7f781c576640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78140b3b40 0x7f7814152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.136+0000 7f781c576640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781415e8f0 0x7f78141f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.136+0000 7f781c576640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141f2220 con 0x7f78140adc40 2023-08-09T12:54:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.136+0000 7f781c576640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141ee210 con 0x7f78140b3b40 2023-08-09T12:54:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.136+0000 7f781c576640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78141ee4f0 con 0x7f781415e8f0 2023-08-09T12:54:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.136+0000 7f781a312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f78141eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.136+0000 7f781a312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f78141eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52158/0 (socket says 172.21.15.17:52158) 2023-08-09T12:54:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f781a312640 1 -- 172.21.15.17:0/1183305419 learned_addr learned my addr 172.21.15.17:0/1183305419 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f7819b11640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78140b3b40 0x7f7814152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f781ab13640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781415e8f0 0x7f78141f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f781a312640 1 -- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781415e8f0 msgr2=0x7f78141f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f781a312640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781415e8f0 0x7f78141f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f781a312640 1 -- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78140b3b40 msgr2=0x7f7814152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f781a312640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78140b3b40 0x7f7814152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f781a312640 1 -- 172.21.15.17:0/1183305419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100094d0 con 0x7f78140adc40 2023-08-09T12:54:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.137+0000 7f781ab13640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781415e8f0 0x7f78141f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.138+0000 7f781a312640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f78141eecf0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f781002b950 tx=0x7f78100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.138+0000 7f780affd640 1 -- 172.21.15.17:0/1183305419 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810031860 con 0x7f78140adc40 2023-08-09T12:54:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.138+0000 7f780affd640 1 -- 172.21.15.17:0/1183305419 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78100443f0 con 0x7f78140adc40 2023-08-09T12:54:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.138+0000 7f780affd640 1 -- 172.21.15.17:0/1183305419 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78100447a0 con 0x7f78140adc40 2023-08-09T12:54:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.138+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78141ee7d0 con 0x7f78140adc40 2023-08-09T12:54:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.138+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7814150e10 con 0x7f78140adc40 2023-08-09T12:54:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.139+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78141ee9e0 con 0x7f78140adc40 2023-08-09T12:54:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.140+0000 7f780affd640 1 -- 172.21.15.17:0/1183305419 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f781004d450 con 0x7f78140adc40 2023-08-09T12:54:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.141+0000 7f780affd640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77f806a050 0x7f77f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.142+0000 7f780affd640 1 -- 172.21.15.17:0/1183305419 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f781002d040 con 0x7f78140adc40 2023-08-09T12:54:23.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.142+0000 7f7819b11640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77f806a050 0x7f77f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.143+0000 7f7819b11640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77f806a050 0x7f77f806c510 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7804006fd0 tx=0x7f7804008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.146+0000 7f780affd640 1 -- 172.21.15.17:0/1183305419 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f78100764d0 con 0x7f78140adc40 2023-08-09T12:54:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.339+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7814070440 con 0x7f77f806a050 2023-08-09T12:54:23.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.340+0000 7f780affd640 1 -- 172.21.15.17:0/1183305419 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f780400a720 con 0x7f77f806a050 2023-08-09T12:54:23.343 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2023-08-09T12:54:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77f806a050 msgr2=0x7f77f806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77f806a050 0x7f77f806c510 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7804006fd0 tx=0x7f7804008040 comp rx=0 tx=0).stop 2023-08-09T12:54:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 msgr2=0x7f78141eecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f78141eecf0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f781002b950 tx=0x7f78100046c0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 shutdown_connections 2023-08-09T12:54:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f77f806a050 0x7f77f806c510 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781415e8f0 0x7f78141f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78140b3b40 0x7f7814152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 --2- 172.21.15.17:0/1183305419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78140adc40 0x7f78141eecf0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.343+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 >> 172.21.15.17:0/1183305419 conn(0x7f78140cb1b0 msgr2=0x7f7814154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.344+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 shutdown_connections 2023-08-09T12:54:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.344+0000 7f781c576640 1 -- 172.21.15.17:0/1183305419 wait complete. 2023-08-09T12:54:23.367 INFO:tasks.ceph:Scrubbing osd.1 2023-08-09T12:54:23.368 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-09T12:54:23.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.593+0000 7f86422c5640 1 Processor -- start 2023-08-09T12:54:23.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.593+0000 7f86422c5640 1 -- start start 2023-08-09T12:54:23.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.595+0000 7f86422c5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f863c15add0 0x7f863c06fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.595+0000 7f86422c5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c15b1b0 con 0x7f863c161570 2023-08-09T12:54:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.595+0000 7f86422c5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c0cd6e0 con 0x7f863c070320 2023-08-09T12:54:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.595+0000 7f86422c5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c0707b0 con 0x7f863c15add0 2023-08-09T12:54:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.595+0000 7f8640862640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f863c161570 0x7f863c0d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49242/0 (socket says 172.21.15.17:49242) 2023-08-09T12:54:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.595+0000 7f8640862640 1 -- 172.21.15.17:0/4269605862 learned_addr learned my addr 172.21.15.17:0/4269605862 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.595+0000 7f863bfff640 1 --2- 172.21.15.17:0/4269605862 >> v2:172.21.15.17:3300/0 conn(0x7f863c15add0 0x7f863c06fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.596+0000 7f863affd640 1 -- 172.21.15.17:0/4269605862 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404630381 0 0) 0x7f863c15b1b0 con 0x7f863c161570 2023-08-09T12:54:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.596+0000 7f863bfff640 1 -- 172.21.15.17:0/4269605862 >> v1:172.21.15.142:6789/0 conn(0x7f863c070320 legacy=0x7f863c160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.596+0000 7f863bfff640 1 -- 172.21.15.17:0/4269605862 >> v1:172.21.15.17:6789/0 conn(0x7f863c161570 legacy=0x7f863c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.596+0000 7f863bfff640 1 -- 172.21.15.17:0/4269605862 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0cd9c0 con 0x7f863c15add0 2023-08-09T12:54:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.597+0000 7f863bfff640 1 --2- 172.21.15.17:0/4269605862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 0x7f863c06fde0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f862c009d90 tx=0x7f862c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415f9e14d3897914 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f863affd640 1 -- 172.21.15.17:0/4269605862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c02cd00 con 0x7f863c15add0 2023-08-09T12:54:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f863affd640 1 -- 172.21.15.17:0/4269605862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c02ce60 con 0x7f863c15add0 2023-08-09T12:54:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f863affd640 1 -- 172.21.15.17:0/4269605862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c034660 con 0x7f863c15add0 2023-08-09T12:54:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f86422c5640 1 -- 172.21.15.17:0/4269605862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 msgr2=0x7f863c06fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f86422c5640 1 --2- 172.21.15.17:0/4269605862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 0x7f863c06fde0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f862c009d90 tx=0x7f862c02bf50 comp rx=0 tx=0).stop 2023-08-09T12:54:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f86422c5640 1 -- 172.21.15.17:0/4269605862 shutdown_connections 2023-08-09T12:54:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f86422c5640 1 --2- 172.21.15.17:0/4269605862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 0x7f863c06fde0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f86422c5640 1 -- 172.21.15.17:0/4269605862 >> 172.21.15.17:0/4269605862 conn(0x7f863c0d2b50 msgr2=0x7f863c0d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f86422c5640 1 -- 172.21.15.17:0/4269605862 shutdown_connections 2023-08-09T12:54:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.598+0000 7f86422c5640 1 -- 172.21.15.17:0/4269605862 wait complete. 2023-08-09T12:54:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.600+0000 7f86422c5640 1 Processor -- start 2023-08-09T12:54:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.600+0000 7f86422c5640 1 -- start start 2023-08-09T12:54:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.601+0000 7f86422c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f863c070320 0x7f863c1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.601+0000 7f86422c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 0x7f863c0b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.601+0000 7f86422c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f863c161570 0x7f863c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.601+0000 7f86422c5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c14f860 con 0x7f863c15add0 2023-08-09T12:54:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.601+0000 7f86422c5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0b7aa0 con 0x7f863c070320 2023-08-09T12:54:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.601+0000 7f86422c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0b74e0 con 0x7f863c161570 2023-08-09T12:54:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 0x7f863c0b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 0x7f863c0b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52178/0 (socket says 172.21.15.17:52178) 2023-08-09T12:54:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 -- 172.21.15.17:0/1959852465 learned_addr learned my addr 172.21.15.17:0/1959852465 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863bfff640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f863c070320 0x7f863c1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 -- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f863c161570 msgr2=0x7f863c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f863c161570 0x7f863c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 -- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f863c070320 msgr2=0x7f863c1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f863c070320 0x7f863c1558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 -- 172.21.15.17:0/1959852465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c009a70 con 0x7f863c15add0 2023-08-09T12:54:23.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.602+0000 7f863b7fe640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 0x7f863c0b6b20 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f863000c400 tx=0x7f863000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.603+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300052d0 con 0x7f863c15add0 2023-08-09T12:54:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.603+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8630005450 con 0x7f863c15add0 2023-08-09T12:54:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.603+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c0b77c0 con 0x7f863c15add0 2023-08-09T12:54:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.603+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630007260 con 0x7f863c15add0 2023-08-09T12:54:23.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.603+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c0c7600 con 0x7f863c15add0 2023-08-09T12:54:23.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.604+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f863c0cdf80 con 0x7f863c15add0 2023-08-09T12:54:23.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.605+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f86300073c0 con 0x7f863c15add0 2023-08-09T12:54:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.606+0000 7f8638ff9640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862806a050 0x7f862806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.606+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f86300876b0 con 0x7f863c15add0 2023-08-09T12:54:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.606+0000 7f8638ff9640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f86280704d0 0x7f86280728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.606+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 --> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8628072fa0 con 0x7f86280704d0 2023-08-09T12:54:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.606+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8630089c90 con 0x7f863c15add0 2023-08-09T12:54:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.607+0000 7f8640862640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f86280704d0 0x7f86280728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.607+0000 7f863bfff640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862806a050 0x7f862806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.607+0000 7f8640862640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f86280704d0 0x7f86280728f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.608+0000 7f863bfff640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862806a050 0x7f862806c510 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f862c036000 tx=0x7f862c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.608+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 <== osd.1 v2:172.21.15.17:6816/160883259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f8628072fa0 con 0x7f86280704d0 2023-08-09T12:54:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.621+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 --> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f863c0cdca0 con 0x7f86280704d0 2023-08-09T12:54:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.621+0000 7f8638ff9640 1 -- 172.21.15.17:0/1959852465 <== osd.1 v2:172.21.15.17:6816/160883259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f8634007370 con 0x7f86280704d0 2023-08-09T12:54:23.625 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:54:23.625 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-09T12:54:23.626 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:54:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f86280704d0 msgr2=0x7f86280728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.17:6816/160883259,v1:172.21.15.17:6817/160883259] conn(0x7f86280704d0 0x7f86280728f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862806a050 msgr2=0x7f862806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f862806a050 0x7f862806c510 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f862c036000 tx=0x7f862c030000 comp rx=0 tx=0).stop 2023-08-09T12:54:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 msgr2=0x7f863c0b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 --2- 172.21.15.17:0/1959852465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f863c15add0 0x7f863c0b6b20 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f863000c400 tx=0x7f863000c8c0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f8640862640 1 -- 172.21.15.17:0/1959852465 reap_dead start 2023-08-09T12:54:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 shutdown_connections 2023-08-09T12:54:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 >> 172.21.15.17:0/1959852465 conn(0x7f863c0d2b50 msgr2=0x7f863c15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 shutdown_connections 2023-08-09T12:54:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.622+0000 7f86422c5640 1 -- 172.21.15.17:0/1959852465 wait complete. 2023-08-09T12:54:23.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-09T12:54:23.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.852+0000 7fd8a0f64640 1 Processor -- start 2023-08-09T12:54:23.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.852+0000 7fd8a0f64640 1 -- start start 2023-08-09T12:54:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.853+0000 7fd8a0f64640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd89c1466b0 0x7fd89c15de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.854+0000 7fd8a0f64640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c15e350 con 0x7fd89c0d2a70 2023-08-09T12:54:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.854+0000 7fd8a0f64640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c15d980 con 0x7fd89c0cffe0 2023-08-09T12:54:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.854+0000 7fd8a0f64640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c146a90 con 0x7fd89c1466b0 2023-08-09T12:54:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.854+0000 7fd89ad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd89c0d2a70 0x7fd89c0d2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49258/0 (socket says 172.21.15.17:49258) 2023-08-09T12:54:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.854+0000 7fd89a59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd89c1466b0 0x7fd89c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.854+0000 7fd89ad9d640 1 -- 172.21.15.17:0/1640524026 learned_addr learned my addr 172.21.15.17:0/1640524026 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.855+0000 7fd89a59c640 1 -- 172.21.15.17:0/1640524026 >> v1:172.21.15.142:6789/0 conn(0x7fd89c0cffe0 legacy=0x7fd89c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.855+0000 7fd89a59c640 1 -- 172.21.15.17:0/1640524026 >> v1:172.21.15.17:6789/0 conn(0x7fd89c0d2a70 legacy=0x7fd89c0d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.855+0000 7fd89a59c640 1 -- 172.21.15.17:0/1640524026 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0d0580 con 0x7fd89c1466b0 2023-08-09T12:54:23.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.855+0000 7fd89959a640 1 -- 172.21.15.17:0/1640524026 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504618327 0 0) 0x7fd894001110 con 0x7fd89c0d2a70 2023-08-09T12:54:23.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.856+0000 7fd89a59c640 1 --2- 172.21.15.17:0/1640524026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c15de10 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009de0 tx=0x7fd88c02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6ac1c92e09a2b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.856+0000 7fd89959a640 1 -- 172.21.15.17:0/1640524026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c02ccb0 con 0x7fd89c1466b0 2023-08-09T12:54:23.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.856+0000 7fd89959a640 1 -- 172.21.15.17:0/1640524026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c02ce10 con 0x7fd89c1466b0 2023-08-09T12:54:23.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.856+0000 7fd89959a640 1 -- 172.21.15.17:0/1640524026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c034660 con 0x7fd89c1466b0 2023-08-09T12:54:23.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.857+0000 7fd8a0f64640 1 -- 172.21.15.17:0/1640524026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 msgr2=0x7fd89c15de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.857+0000 7fd8a0f64640 1 --2- 172.21.15.17:0/1640524026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c15de10 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009de0 tx=0x7fd88c02bf00 comp rx=0 tx=0).stop 2023-08-09T12:54:23.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.857+0000 7fd8a0f64640 1 -- 172.21.15.17:0/1640524026 shutdown_connections 2023-08-09T12:54:23.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.857+0000 7fd8a0f64640 1 --2- 172.21.15.17:0/1640524026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c15de10 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.857+0000 7fd8a0f64640 1 -- 172.21.15.17:0/1640524026 >> 172.21.15.17:0/1640524026 conn(0x7fd89c0b8340 msgr2=0x7fd89c0697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:23.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.857+0000 7fd8a0f64640 1 -- 172.21.15.17:0/1640524026 shutdown_connections 2023-08-09T12:54:23.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.857+0000 7fd8a0f64640 1 -- 172.21.15.17:0/1640524026 wait complete. 2023-08-09T12:54:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.859+0000 7fd8a0f64640 1 Processor -- start 2023-08-09T12:54:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.859+0000 7fd8a0f64640 1 -- start start 2023-08-09T12:54:23.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd8a0f64640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd89c0cffe0 0x7fd89c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd8a0f64640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89c0d2a70 0x7fd89c13df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd8a0f64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd8a0f64640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c13c2e0 con 0x7fd89c1466b0 2023-08-09T12:54:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd8a0f64640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c13c5c0 con 0x7fd89c0cffe0 2023-08-09T12:54:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd8a0f64640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c13c8a0 con 0x7fd89c0d2a70 2023-08-09T12:54:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd89ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd89ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c1402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52190/0 (socket says 172.21.15.17:52190) 2023-08-09T12:54:23.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd89ad9d640 1 -- 172.21.15.17:0/3604271807 learned_addr learned my addr 172.21.15.17:0/3604271807 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:23.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.860+0000 7fd89a59c640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd89c0cffe0 0x7fd89c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd899d9b640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89c0d2a70 0x7fd89c13df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd89ad9d640 1 -- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89c0d2a70 msgr2=0x7fd89c13df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd89ad9d640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89c0d2a70 0x7fd89c13df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd89ad9d640 1 -- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd89c0cffe0 msgr2=0x7fd89c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:23.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd89ad9d640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd89c0cffe0 0x7fd89c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:23.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd89ad9d640 1 -- 172.21.15.17:0/3604271807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c009a70 con 0x7fd89c1466b0 2023-08-09T12:54:23.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd899d9b640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89c0d2a70 0x7fd89c13df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:23.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd89ad9d640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c1402c0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c780 tx=0x7fd89400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd892ffd640 1 -- 172.21.15.17:0/3604271807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8940072d0 con 0x7fd89c1466b0 2023-08-09T12:54:23.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd892ffd640 1 -- 172.21.15.17:0/3604271807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894007430 con 0x7fd89c1466b0 2023-08-09T12:54:23.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd892ffd640 1 -- 172.21.15.17:0/3604271807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894001d10 con 0x7fd89c1466b0 2023-08-09T12:54:23.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.861+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c13cb80 con 0x7fd89c1466b0 2023-08-09T12:54:23.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.862+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c13bf20 con 0x7fd89c1466b0 2023-08-09T12:54:23.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.863+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c067a80 con 0x7fd89c1466b0 2023-08-09T12:54:23.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.864+0000 7fd892ffd640 1 -- 172.21.15.17:0/3604271807 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd8940047e0 con 0x7fd89c1466b0 2023-08-09T12:54:23.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.865+0000 7fd892ffd640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd87c06a050 0x7fd87c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:23.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.865+0000 7fd892ffd640 1 -- 172.21.15.17:0/3604271807 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd894087370 con 0x7fd89c1466b0 2023-08-09T12:54:23.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.865+0000 7fd89a59c640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd87c06a050 0x7fd87c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.866+0000 7fd89a59c640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd87c06a050 0x7fd87c06c510 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd88c036000 tx=0x7fd88c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:23.869+0000 7fd892ffd640 1 -- 172.21.15.17:0/3604271807 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fd894056770 con 0x7fd89c1466b0 2023-08-09T12:54:24.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.071+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd89c0664f0 con 0x7fd87c06a050 2023-08-09T12:54:24.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.072+0000 7fd892ffd640 1 -- 172.21.15.17:0/3604271807 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd89c0664f0 con 0x7fd87c06a050 2023-08-09T12:54:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2023-08-09T12:54:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd87c06a050 msgr2=0x7fd87c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd87c06a050 0x7fd87c06c510 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd88c036000 tx=0x7fd88c030000 comp rx=0 tx=0).stop 2023-08-09T12:54:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 msgr2=0x7fd89c1402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c1402c0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c780 tx=0x7fd89400cc40 comp rx=0 tx=0).stop 2023-08-09T12:54:24.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 shutdown_connections 2023-08-09T12:54:24.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fd87c06a050 0x7fd87c06c510 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c1466b0 0x7fd89c1402c0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89c0d2a70 0x7fd89c13df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 --2- 172.21.15.17:0/3604271807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd89c0cffe0 0x7fd89c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 >> 172.21.15.17:0/3604271807 conn(0x7fd89c0b8340 msgr2=0x7fd89c160db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:24.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 shutdown_connections 2023-08-09T12:54:24.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.076+0000 7fd8a0f64640 1 -- 172.21.15.17:0/3604271807 wait complete. 2023-08-09T12:54:24.100 INFO:tasks.ceph:Scrubbing osd.2 2023-08-09T12:54:24.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-09T12:54:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.325+0000 7f390bad9640 1 Processor -- start 2023-08-09T12:54:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.325+0000 7f390bad9640 1 -- start start 2023-08-09T12:54:24.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.326+0000 7f390bad9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f390415add0 0x7f390406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.326+0000 7f390bad9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3904070320 0x7f3904160e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.326+0000 7f390bad9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3904070780 con 0x7f39041613a0 2023-08-09T12:54:24.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.326+0000 7f390bad9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390415b1b0 con 0x7f3904070320 2023-08-09T12:54:24.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.326+0000 7f390bad9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040cd6e0 con 0x7f390415add0 2023-08-09T12:54:24.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.327+0000 7f3909875640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f390415add0 0x7f390406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.327+0000 7f3909875640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f390415add0 0x7f390406fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.17:33648/0 (socket says 172.21.15.17:33648) 2023-08-09T12:54:24.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.327+0000 7f3909875640 1 -- 172.21.15.17:0/2585311206 learned_addr learned my addr 172.21.15.17:0/2585311206 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:24.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.328+0000 7f3909074640 1 --2- 172.21.15.17:0/2585311206 >> v2:172.21.15.142:3300/0 conn(0x7f3904070320 0x7f3904160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.328+0000 7f3908873640 1 -- 172.21.15.17:0/2585311206 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118465592 0 0) 0x7f3904070780 con 0x7f39041613a0 2023-08-09T12:54:24.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.328+0000 7f3908873640 1 -- 172.21.15.17:0/2585311206 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f0003520 con 0x7f39041613a0 2023-08-09T12:54:24.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.328+0000 7f3909875640 1 -- 172.21.15.17:0/2585311206 >> v2:172.21.15.142:3300/0 conn(0x7f3904070320 msgr2=0x7f3904160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:24.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.328+0000 7f3909875640 1 --2- 172.21.15.17:0/2585311206 >> v2:172.21.15.142:3300/0 conn(0x7f3904070320 0x7f3904160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.328+0000 7f3909875640 1 -- 172.21.15.17:0/2585311206 >> v1:172.21.15.142:6789/0 conn(0x7f39041613a0 legacy=0x7f39040b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.328+0000 7f3909875640 1 -- 172.21.15.17:0/2585311206 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040cd9c0 con 0x7f390415add0 2023-08-09T12:54:24.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.330+0000 7f3909875640 1 --2- 172.21.15.17:0/2585311206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f390415add0 0x7f390406fde0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f39000098a0 tx=0x7f390002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48007a718eccc9c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:24.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.330+0000 7f3908873640 1 -- 172.21.15.17:0/2585311206 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900030840 con 0x7f390415add0 2023-08-09T12:54:24.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.330+0000 7f3908873640 1 -- 172.21.15.17:0/2585311206 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000309a0 con 0x7f390415add0 2023-08-09T12:54:24.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.330+0000 7f3908873640 1 -- 172.21.15.17:0/2585311206 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900030d30 con 0x7f390415add0 2023-08-09T12:54:24.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.331+0000 7f390bad9640 1 -- 172.21.15.17:0/2585311206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f390415add0 msgr2=0x7f390406fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.331+0000 7f390bad9640 1 --2- 172.21.15.17:0/2585311206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f390415add0 0x7f390406fde0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f39000098a0 tx=0x7f390002b980 comp rx=0 tx=0).stop 2023-08-09T12:54:24.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.331+0000 7f390bad9640 1 -- 172.21.15.17:0/2585311206 shutdown_connections 2023-08-09T12:54:24.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.331+0000 7f390bad9640 1 --2- 172.21.15.17:0/2585311206 >> v2:172.21.15.142:3300/0 conn(0x7f3904070320 0x7f3904160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.331+0000 7f390bad9640 1 --2- 172.21.15.17:0/2585311206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f390415add0 0x7f390406fde0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.331+0000 7f390bad9640 1 -- 172.21.15.17:0/2585311206 >> 172.21.15.17:0/2585311206 conn(0x7f39040d2b50 msgr2=0x7f39040d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:24.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.331+0000 7f390bad9640 1 -- 172.21.15.17:0/2585311206 shutdown_connections 2023-08-09T12:54:24.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.331+0000 7f390bad9640 1 -- 172.21.15.17:0/2585311206 wait complete. 2023-08-09T12:54:24.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.334+0000 7f390bad9640 1 Processor -- start 2023-08-09T12:54:24.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.334+0000 7f390bad9640 1 -- start start 2023-08-09T12:54:24.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.335+0000 7f390bad9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3904070320 0x7f39041f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.335+0000 7f390bad9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390415add0 0x7f390415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.335+0000 7f390bad9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39041613a0 0x7f390415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.335+0000 7f390bad9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040b8030 con 0x7f390415add0 2023-08-09T12:54:24.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.335+0000 7f390bad9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040c9ec0 con 0x7f3904070320 2023-08-09T12:54:24.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.335+0000 7f390bad9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040b7d50 con 0x7f39041613a0 2023-08-09T12:54:24.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909074640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390415add0 0x7f390415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909074640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390415add0 0x7f390415e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52202/0 (socket says 172.21.15.17:52202) 2023-08-09T12:54:24.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909074640 1 -- 172.21.15.17:0/3113808536 learned_addr learned my addr 172.21.15.17:0/3113808536 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:24.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909875640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3904070320 0x7f39041f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f390a076640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39041613a0 0x7f390415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909074640 1 -- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39041613a0 msgr2=0x7f390415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909074640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39041613a0 0x7f390415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909074640 1 -- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3904070320 msgr2=0x7f39041f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909074640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3904070320 0x7f39041f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909074640 1 -- 172.21.15.17:0/3113808536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39000094d0 con 0x7f390415add0 2023-08-09T12:54:24.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.336+0000 7f3909875640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3904070320 0x7f39041f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:24.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.337+0000 7f3909074640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390415add0 0x7f390415e8f0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f38f400e870 tx=0x7f38f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:24.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.337+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40094f0 con 0x7f390415add0 2023-08-09T12:54:24.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.337+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f400c940 con 0x7f390415add0 2023-08-09T12:54:24.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.337+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400ccf0 con 0x7f390415add0 2023-08-09T12:54:24.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.337+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3904140c80 con 0x7f390415add0 2023-08-09T12:54:24.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.337+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3904141240 con 0x7f390415add0 2023-08-09T12:54:24.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.338+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39040cdf80 con 0x7f390415add0 2023-08-09T12:54:24.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.340+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f38f4013470 con 0x7f390415add0 2023-08-09T12:54:24.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.341+0000 7f38fa7fc640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38e806a050 0x7f38e806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.341+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f38f40883d0 con 0x7f390415add0 2023-08-09T12:54:24.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.341+0000 7f38fa7fc640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f38e80704d0 0x7f38e80728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.341+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 --> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38e8072fa0 con 0x7f38e80704d0 2023-08-09T12:54:24.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.341+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38f408a950 con 0x7f390415add0 2023-08-09T12:54:24.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.341+0000 7f390a076640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f38e80704d0 0x7f38e80728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.341+0000 7f3909875640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38e806a050 0x7f38e806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.342+0000 7f390a076640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f38e80704d0 0x7f38e80728f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:24.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.343+0000 7f3909875640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38e806a050 0x7f38e806c510 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3900036000 tx=0x7f390003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:24.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.343+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 <== osd.2 v2:172.21.15.17:6800/1219800306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f38e8072fa0 con 0x7f38e80704d0 2023-08-09T12:54:24.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.356+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 --> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f39040cdca0 con 0x7f38e80704d0 2023-08-09T12:54:24.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.357+0000 7f38fa7fc640 1 -- 172.21.15.17:0/3113808536 <== osd.2 v2:172.21.15.17:6800/1219800306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f38fc001e80 con 0x7f38e80704d0 2023-08-09T12:54:24.360 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:54:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-09T12:54:24.361 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:54:24.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.357+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f38e80704d0 msgr2=0x7f38e80728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.357+0000 7f390bad9640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.17:6800/1219800306,v1:172.21.15.17:6801/1219800306] conn(0x7f38e80704d0 0x7f38e80728f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38e806a050 msgr2=0x7f38e806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390bad9640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f38e806a050 0x7f38e806c510 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3900036000 tx=0x7f390003b040 comp rx=0 tx=0).stop 2023-08-09T12:54:24.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390415add0 msgr2=0x7f390415e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390bad9640 1 --2- 172.21.15.17:0/3113808536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390415add0 0x7f390415e8f0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f38f400e870 tx=0x7f38f400ed30 comp rx=0 tx=0).stop 2023-08-09T12:54:24.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390a076640 1 -- 172.21.15.17:0/3113808536 reap_dead start 2023-08-09T12:54:24.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 shutdown_connections 2023-08-09T12:54:24.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 >> 172.21.15.17:0/3113808536 conn(0x7f39040d2b50 msgr2=0x7f3904159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:24.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 shutdown_connections 2023-08-09T12:54:24.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.358+0000 7f390bad9640 1 -- 172.21.15.17:0/3113808536 wait complete. 2023-08-09T12:54:24.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-09T12:54:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.613+0000 7f3e9faad640 1 Processor -- start 2023-08-09T12:54:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.613+0000 7f3e9faad640 1 -- start start 2023-08-09T12:54:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.614+0000 7f3e9faad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e9815ce90 0x7f3e981616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.614+0000 7f3e9faad640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e980b6000 0x7f3e980cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.614+0000 7f3e9faad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980d29d0 0x7f3e980d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.614+0000 7f3e9faad640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980d33a0 con 0x7f3e980b6000 2023-08-09T12:54:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.614+0000 7f3e9faad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980b6460 con 0x7f3e9815ce90 2023-08-09T12:54:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.614+0000 7f3e9faad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980cda40 con 0x7f3e980d29d0 2023-08-09T12:54:24.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.614+0000 7f3e9d048640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e980b6000 0x7f3e980cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.615+0000 7f3e9d048640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e980b6000 0x7f3e980cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52206/0 (socket says 172.21.15.17:52206) 2023-08-09T12:54:24.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.615+0000 7f3e9d048640 1 -- 172.21.15.17:0/3977703326 learned_addr learned my addr 172.21.15.17:0/3977703326 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:24.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.615+0000 7f3e9d048640 1 -- 172.21.15.17:0/3977703326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980d29d0 msgr2=0x7f3e980d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:24.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.615+0000 7f3e9d048640 1 --2- 172.21.15.17:0/3977703326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980d29d0 0x7f3e980d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.615+0000 7f3e9d048640 1 -- 172.21.15.17:0/3977703326 >> v2:172.21.15.142:3300/0 conn(0x7f3e9815ce90 msgr2=0x7f3e981616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.615+0000 7f3e9d048640 1 --2- 172.21.15.17:0/3977703326 >> v2:172.21.15.142:3300/0 conn(0x7f3e9815ce90 0x7f3e981616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.615+0000 7f3e9d048640 1 -- 172.21.15.17:0/3977703326 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980cdd10 con 0x7f3e980b6000 2023-08-09T12:54:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.616+0000 7f3e9d048640 1 --2- 172.21.15.17:0/3977703326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980b6000 0x7f3e980cd500 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f3e980d0690 tx=0x7f3e8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9be7e1eabc1c97 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.616+0000 7f3e9c847640 1 -- 172.21.15.17:0/3977703326 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c031870 con 0x7f3e980b6000 2023-08-09T12:54:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.616+0000 7f3e9c847640 1 -- 172.21.15.17:0/3977703326 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c0319d0 con 0x7f3e980b6000 2023-08-09T12:54:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.616+0000 7f3e9c847640 1 -- 172.21.15.17:0/3977703326 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c031d60 con 0x7f3e980b6000 2023-08-09T12:54:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 -- 172.21.15.17:0/3977703326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980b6000 msgr2=0x7f3e980cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 --2- 172.21.15.17:0/3977703326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980b6000 0x7f3e980cd500 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f3e980d0690 tx=0x7f3e8c02b910 comp rx=0 tx=0).stop 2023-08-09T12:54:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 -- 172.21.15.17:0/3977703326 shutdown_connections 2023-08-09T12:54:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 --2- 172.21.15.17:0/3977703326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980d29d0 0x7f3e980d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 --2- 172.21.15.17:0/3977703326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980b6000 0x7f3e980cd500 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 --2- 172.21.15.17:0/3977703326 >> v2:172.21.15.142:3300/0 conn(0x7f3e9815ce90 0x7f3e981616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 -- 172.21.15.17:0/3977703326 >> 172.21.15.17:0/3977703326 conn(0x7f3e9806fde0 msgr2=0x7f3e980701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 -- 172.21.15.17:0/3977703326 shutdown_connections 2023-08-09T12:54:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.617+0000 7f3e9faad640 1 -- 172.21.15.17:0/3977703326 wait complete. 2023-08-09T12:54:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.619+0000 7f3e9faad640 1 Processor -- start 2023-08-09T12:54:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.619+0000 7f3e9faad640 1 -- start start 2023-08-09T12:54:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.620+0000 7f3e9faad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980b6000 0x7f3e980b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.620+0000 7f3e9faad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980d29d0 0x7f3e98150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.620+0000 7f3e9faad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9815ce90 0x7f3e981510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.620+0000 7f3e9faad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981515e0 con 0x7f3e980d29d0 2023-08-09T12:54:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.620+0000 7f3e9faad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980aac60 con 0x7f3e9815ce90 2023-08-09T12:54:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.620+0000 7f3e9faad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980aaf40 con 0x7f3e980b6000 2023-08-09T12:54:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980d29d0 0x7f3e98150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980d29d0 0x7f3e98150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52220/0 (socket says 172.21.15.17:52220) 2023-08-09T12:54:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 -- 172.21.15.17:0/4089679580 learned_addr learned my addr 172.21.15.17:0/4089679580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9e04a640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9815ce90 0x7f3e981510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d849640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980b6000 0x7f3e980b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 -- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980b6000 msgr2=0x7f3e980b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980b6000 0x7f3e980b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 -- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9815ce90 msgr2=0x7f3e981510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9815ce90 0x7f3e981510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 -- 172.21.15.17:0/4089679580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0094d0 con 0x7f3e980d29d0 2023-08-09T12:54:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d849640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980b6000 0x7f3e980b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.621+0000 7f3e9d048640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980d29d0 0x7f3e98150b60 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c000c00 tx=0x7f3e8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.622+0000 7f3e967fc640 1 -- 172.21.15.17:0/4089679580 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c03ad10 con 0x7f3e980d29d0 2023-08-09T12:54:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.622+0000 7f3e967fc640 1 -- 172.21.15.17:0/4089679580 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c03ae70 con 0x7f3e980d29d0 2023-08-09T12:54:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.622+0000 7f3e967fc640 1 -- 172.21.15.17:0/4089679580 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c044610 con 0x7f3e980d29d0 2023-08-09T12:54:24.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.622+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e980ab220 con 0x7f3e980d29d0 2023-08-09T12:54:24.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.622+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e980acc00 con 0x7f3e980d29d0 2023-08-09T12:54:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.623+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e980acdf0 con 0x7f3e980d29d0 2023-08-09T12:54:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.624+0000 7f3e967fc640 1 -- 172.21.15.17:0/4089679580 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3e8c04d450 con 0x7f3e980d29d0 2023-08-09T12:54:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.625+0000 7f3e967fc640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e8406a050 0x7f3e8406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.625+0000 7f3e967fc640 1 -- 172.21.15.17:0/4089679580 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3e8c02d040 con 0x7f3e980d29d0 2023-08-09T12:54:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.626+0000 7f3e9d849640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e8406a050 0x7f3e8406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.627+0000 7f3e9d849640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e8406a050 0x7f3e8406c510 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3e88007eb0 tx=0x7f3e880073c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.629+0000 7f3e967fc640 1 -- 172.21.15.17:0/4089679580 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3e8c0763f0 con 0x7f3e980d29d0 2023-08-09T12:54:24.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.812+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e980ce2d0 con 0x7f3e8406a050 2023-08-09T12:54:24.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.813+0000 7f3e967fc640 1 -- 172.21.15.17:0/4089679580 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3e8800cdd0 con 0x7f3e8406a050 2023-08-09T12:54:24.817 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2023-08-09T12:54:24.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e8406a050 msgr2=0x7f3e8406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e8406a050 0x7f3e8406c510 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3e88007eb0 tx=0x7f3e880073c0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980d29d0 msgr2=0x7f3e98150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:24.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980d29d0 0x7f3e98150b60 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c000c00 tx=0x7f3e8c0046c0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 shutdown_connections 2023-08-09T12:54:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3e8406a050 0x7f3e8406c510 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9815ce90 0x7f3e981510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e980d29d0 0x7f3e98150b60 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 --2- 172.21.15.17:0/4089679580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e980b6000 0x7f3e980b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 >> 172.21.15.17:0/4089679580 conn(0x7f3e9806fde0 msgr2=0x7f3e980d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:24.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 shutdown_connections 2023-08-09T12:54:24.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:24.816+0000 7f3e9faad640 1 -- 172.21.15.17:0/4089679580 wait complete. 2023-08-09T12:54:24.837 INFO:tasks.ceph:Scrubbing osd.3 2023-08-09T12:54:24.838 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-09T12:54:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.056+0000 7f78bf59e640 1 Processor -- start 2023-08-09T12:54:25.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.056+0000 7f78bf59e640 1 -- start start 2023-08-09T12:54:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.058+0000 7f78bf59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78c015d000 0x7f78c0160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.058+0000 7f78bf59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78c00b06b0 0x7f78c015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.058+0000 7f78bf59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c0161490 con 0x7f78c00cc0f0 2023-08-09T12:54:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.058+0000 7f78bf59e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c00c9990 con 0x7f78c015d000 2023-08-09T12:54:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.058+0000 7f78bf59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c00cc560 con 0x7f78c00b06b0 2023-08-09T12:54:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.058+0000 7f78be59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78c015d000 0x7f78c0160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.058+0000 7f78be59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78c015d000 0x7f78c0160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52234/0 (socket says 172.21.15.17:52234) 2023-08-09T12:54:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.058+0000 7f78be59c640 1 -- 172.21.15.17:0/3025476350 learned_addr learned my addr 172.21.15.17:0/3025476350 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:25.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.059+0000 7f78be59c640 1 -- 172.21.15.17:0/3025476350 >> v2:172.21.15.142:3300/0 conn(0x7f78c00b06b0 msgr2=0x7f78c015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:25.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.059+0000 7f78be59c640 1 --2- 172.21.15.17:0/3025476350 >> v2:172.21.15.142:3300/0 conn(0x7f78c00b06b0 0x7f78c015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.059+0000 7f78be59c640 1 -- 172.21.15.17:0/3025476350 >> v1:172.21.15.142:6789/0 conn(0x7f78c00cc0f0 legacy=0x7f78c00affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:25.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.059+0000 7f78be59c640 1 -- 172.21.15.17:0/3025476350 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0160bf0 con 0x7f78c015d000 2023-08-09T12:54:25.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.060+0000 7f78be59c640 1 --2- 172.21.15.17:0/3025476350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015d000 0x7f78c0160580 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f78c00cc070 tx=0x7f78b002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7d89227978b789 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.060+0000 7f78bd59a640 1 -- 172.21.15.17:0/3025476350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b00317e0 con 0x7f78c015d000 2023-08-09T12:54:25.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.061+0000 7f78bd59a640 1 -- 172.21.15.17:0/3025476350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0031940 con 0x7f78c015d000 2023-08-09T12:54:25.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.061+0000 7f78bd59a640 1 -- 172.21.15.17:0/3025476350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0031cd0 con 0x7f78c015d000 2023-08-09T12:54:25.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.061+0000 7f78bf59e640 1 -- 172.21.15.17:0/3025476350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015d000 msgr2=0x7f78c0160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.061+0000 7f78bf59e640 1 --2- 172.21.15.17:0/3025476350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015d000 0x7f78c0160580 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f78c00cc070 tx=0x7f78b002b880 comp rx=0 tx=0).stop 2023-08-09T12:54:25.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.061+0000 7f78bf59e640 1 -- 172.21.15.17:0/3025476350 shutdown_connections 2023-08-09T12:54:25.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.061+0000 7f78bf59e640 1 --2- 172.21.15.17:0/3025476350 >> v2:172.21.15.142:3300/0 conn(0x7f78c00b06b0 0x7f78c015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.061+0000 7f78bf59e640 1 --2- 172.21.15.17:0/3025476350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c015d000 0x7f78c0160580 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.061+0000 7f78bf59e640 1 -- 172.21.15.17:0/3025476350 >> 172.21.15.17:0/3025476350 conn(0x7f78c00cafa0 msgr2=0x7f78c00cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:25.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.062+0000 7f78bf59e640 1 -- 172.21.15.17:0/3025476350 shutdown_connections 2023-08-09T12:54:25.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.062+0000 7f78bf59e640 1 -- 172.21.15.17:0/3025476350 wait complete. 2023-08-09T12:54:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.063+0000 7f78bf59e640 1 Processor -- start 2023-08-09T12:54:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.063+0000 7f78bf59e640 1 -- start start 2023-08-09T12:54:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.064+0000 7f78bf59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c00b06b0 0x7f78c0148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.064+0000 7f78bf59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00cc0f0 0x7f78c00b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.064+0000 7f78bf59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78c015d000 0x7f78c01456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.064+0000 7f78bf59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0149070 con 0x7f78c00cc0f0 2023-08-09T12:54:25.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.064+0000 7f78bf59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00b1610 con 0x7f78c015d000 2023-08-09T12:54:25.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.064+0000 7f78bf59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00b1800 con 0x7f78c00b06b0 2023-08-09T12:54:25.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00cc0f0 0x7f78c00b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00cc0f0 0x7f78c00b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52242/0 (socket says 172.21.15.17:52242) 2023-08-09T12:54:25.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 -- 172.21.15.17:0/360646806 learned_addr learned my addr 172.21.15.17:0/360646806 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:25.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 -- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c00b06b0 msgr2=0x7f78c0148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78c00b06b0 0x7f78c0148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 -- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78c015d000 msgr2=0x7f78c01456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78c015d000 0x7f78c01456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 -- 172.21.15.17:0/360646806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00094d0 con 0x7f78c00cc0f0 2023-08-09T12:54:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.065+0000 7f78bdd9b640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00cc0f0 0x7f78c00b10d0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c430 tx=0x7f78b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.066+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4011790 con 0x7f78c00cc0f0 2023-08-09T12:54:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.066+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b40118f0 con 0x7f78c00cc0f0 2023-08-09T12:54:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.066+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4011ce0 con 0x7f78c00cc0f0 2023-08-09T12:54:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.066+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c00b1ae0 con 0x7f78c00cc0f0 2023-08-09T12:54:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.066+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c00b20a0 con 0x7f78c00cc0f0 2023-08-09T12:54:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.067+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78c01611b0 con 0x7f78c00cc0f0 2023-08-09T12:54:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.068+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f78b401c460 con 0x7f78c00cc0f0 2023-08-09T12:54:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.069+0000 7f78aeffd640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a080 0x7f78a006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.069+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f78b4088260 con 0x7f78c00cc0f0 2023-08-09T12:54:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.069+0000 7f78aeffd640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f78a0070500 0x7f78a0072920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.070+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 --> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78a0072fd0 con 0x7f78a0070500 2023-08-09T12:54:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.070+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78b408a840 con 0x7f78c00cc0f0 2023-08-09T12:54:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.070+0000 7f78bed9d640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f78a0070500 0x7f78a0072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.070+0000 7f78be59c640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a080 0x7f78a006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.070+0000 7f78bed9d640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f78a0070500 0x7f78a0072920 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.071+0000 7f78be59c640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a080 0x7f78a006c540 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f78b0036000 tx=0x7f78b0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.071+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 <== osd.3 v2:172.21.15.17:6824/2232182345 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f78a0072fd0 con 0x7f78a0070500 2023-08-09T12:54:25.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.084+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 --> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f78c0160ed0 con 0x7f78a0070500 2023-08-09T12:54:25.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78aeffd640 1 -- 172.21.15.17:0/360646806 <== osd.3 v2:172.21.15.17:6824/2232182345 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f78b800ac40 con 0x7f78a0070500 2023-08-09T12:54:25.088 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:54:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-09T12:54:25.089 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:54:25.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f78a0070500 msgr2=0x7f78a0072920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bf59e640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.17:6824/2232182345,v1:172.21.15.17:6825/2232182345] conn(0x7f78a0070500 0x7f78a0072920 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a080 msgr2=0x7f78a006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bf59e640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f78a006a080 0x7f78a006c540 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f78b0036000 tx=0x7f78b0030000 comp rx=0 tx=0).stop 2023-08-09T12:54:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00cc0f0 msgr2=0x7f78c00b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bf59e640 1 --2- 172.21.15.17:0/360646806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78c00cc0f0 0x7f78c00b10d0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c430 tx=0x7f78b400c8f0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bed9d640 1 -- 172.21.15.17:0/360646806 reap_dead start 2023-08-09T12:54:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 shutdown_connections 2023-08-09T12:54:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.085+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 >> 172.21.15.17:0/360646806 conn(0x7f78c00cafa0 msgr2=0x7f78c015f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.086+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 shutdown_connections 2023-08-09T12:54:25.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.086+0000 7f78bf59e640 1 -- 172.21.15.17:0/360646806 wait complete. 2023-08-09T12:54:25.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-09T12:54:25.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.331+0000 7f7f0090e640 1 Processor -- start 2023-08-09T12:54:25.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.331+0000 7f7f0090e640 1 -- start start 2023-08-09T12:54:25.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.332+0000 7f7f0090e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0cca50 0x7f7efc15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.332+0000 7f7f0090e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7efc0adad0 0x7f7efc160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.332+0000 7f7f0090e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc15d7b0 con 0x7f7efc0697c0 2023-08-09T12:54:25.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.332+0000 7f7f0090e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc0cecb0 con 0x7f7efc0adad0 2023-08-09T12:54:25.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.332+0000 7f7f0090e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0ae360 con 0x7f7efc0cca50 2023-08-09T12:54:25.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.333+0000 7f7efb59e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7efc0adad0 0x7f7efc160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.333+0000 7f7efad9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7efc0697c0 0x7f7efc069ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49262/0 (socket says 172.21.15.17:49262) 2023-08-09T12:54:25.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.333+0000 7f7efad9d640 1 -- 172.21.15.17:0/2037019564 learned_addr learned my addr 172.21.15.17:0/2037019564 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.333+0000 7f7efb59e640 1 -- 172.21.15.17:0/2037019564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0cca50 msgr2=0x7f7efc15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.333+0000 7f7efb59e640 1 --2- 172.21.15.17:0/2037019564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0cca50 0x7f7efc15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.333+0000 7f7efb59e640 1 -- 172.21.15.17:0/2037019564 >> v1:172.21.15.17:6789/0 conn(0x7f7efc0697c0 legacy=0x7f7efc069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.333+0000 7f7efb59e640 1 -- 172.21.15.17:0/2037019564 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0ae640 con 0x7f7efc0adad0 2023-08-09T12:54:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.333+0000 7f7ef9d9b640 1 -- 172.21.15.17:0/2037019564 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330179357 0 0) 0x7f7efc15d7b0 con 0x7f7efc0697c0 2023-08-09T12:54:25.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.334+0000 7f7efb59e640 1 --2- 172.21.15.17:0/2037019564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0adad0 0x7f7efc160700 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40097a0 tx=0x7f7ef402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff47dabb8fd7547 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.335+0000 7f7ef9d9b640 1 -- 172.21.15.17:0/2037019564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef402d040 con 0x7f7efc0adad0 2023-08-09T12:54:25.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.335+0000 7f7ef9d9b640 1 -- 172.21.15.17:0/2037019564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4031810 con 0x7f7efc0adad0 2023-08-09T12:54:25.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.335+0000 7f7ef9d9b640 1 -- 172.21.15.17:0/2037019564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4031ba0 con 0x7f7efc0adad0 2023-08-09T12:54:25.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.335+0000 7f7f0090e640 1 -- 172.21.15.17:0/2037019564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0adad0 msgr2=0x7f7efc160700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.335+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2037019564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0adad0 0x7f7efc160700 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40097a0 tx=0x7f7ef402b8b0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.335+0000 7f7f0090e640 1 -- 172.21.15.17:0/2037019564 shutdown_connections 2023-08-09T12:54:25.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.336+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2037019564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0adad0 0x7f7efc160700 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.336+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2037019564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0cca50 0x7f7efc15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.336+0000 7f7f0090e640 1 -- 172.21.15.17:0/2037019564 >> 172.21.15.17:0/2037019564 conn(0x7f7efc0cb900 msgr2=0x7f7efc0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:25.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.336+0000 7f7f0090e640 1 -- 172.21.15.17:0/2037019564 shutdown_connections 2023-08-09T12:54:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.336+0000 7f7f0090e640 1 -- 172.21.15.17:0/2037019564 wait complete. 2023-08-09T12:54:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.337+0000 7f7f0090e640 1 Processor -- start 2023-08-09T12:54:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.338+0000 7f7f0090e640 1 -- start start 2023-08-09T12:54:25.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7f0090e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0697c0 0x7f7efc070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7f0090e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0adad0 0x7f7efc150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7f0090e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7efc0cca50 0x7f7efc06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7f0090e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc1f2800 con 0x7f7efc0697c0 2023-08-09T12:54:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7f0090e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc1f2ae0 con 0x7f7efc0cca50 2023-08-09T12:54:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7f0090e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc1f2dc0 con 0x7f7efc0adad0 2023-08-09T12:54:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0697c0 0x7f7efc070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0697c0 0x7f7efc070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52264/0 (socket says 172.21.15.17:52264) 2023-08-09T12:54:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efad9d640 1 -- 172.21.15.17:0/2996451788 learned_addr learned my addr 172.21.15.17:0/2996451788 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efb59e640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7efc0cca50 0x7f7efc06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efad9d640 1 -- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0adad0 msgr2=0x7f7efc150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efa59c640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0adad0 0x7f7efc150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efad9d640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0adad0 0x7f7efc150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efad9d640 1 -- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7efc0cca50 msgr2=0x7f7efc06f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.339+0000 7f7efad9d640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7efc0cca50 0x7f7efc06f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7efad9d640 1 -- 172.21.15.17:0/2996451788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4009400 con 0x7f7efc0697c0 2023-08-09T12:54:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7efa59c640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0adad0 0x7f7efc150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7efb59e640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7efc0cca50 0x7f7efc06f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7efad9d640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0697c0 0x7f7efc070730 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00c7c0 tx=0x7f7eec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7ee37fe640 1 -- 172.21.15.17:0/2996451788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00a640 con 0x7f7efc0697c0 2023-08-09T12:54:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7ee37fe640 1 -- 172.21.15.17:0/2996451788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00a7c0 con 0x7f7efc0697c0 2023-08-09T12:54:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7ee37fe640 1 -- 172.21.15.17:0/2996451788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00ab70 con 0x7f7efc0697c0 2023-08-09T12:54:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc1f30a0 con 0x7f7efc0697c0 2023-08-09T12:54:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.340+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc070c70 con 0x7f7efc0697c0 2023-08-09T12:54:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.341+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc070e90 con 0x7f7efc0697c0 2023-08-09T12:54:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.342+0000 7f7ee37fe640 1 -- 172.21.15.17:0/2996451788 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7eec00acd0 con 0x7f7efc0697c0 2023-08-09T12:54:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.343+0000 7f7ee37fe640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ee806a050 0x7f7ee806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.344+0000 7f7ee37fe640 1 -- 172.21.15.17:0/2996451788 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7eec0878c0 con 0x7f7efc0697c0 2023-08-09T12:54:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.344+0000 7f7efa59c640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ee806a050 0x7f7ee806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.345+0000 7f7efa59c640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ee806a050 0x7f7ee806c510 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0cdf20 tx=0x7f7ef0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.348+0000 7f7ee37fe640 1 -- 172.21.15.17:0/2996451788 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f7efc070e90 con 0x7f7efc0697c0 2023-08-09T12:54:25.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.541+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7efc15d110 con 0x7f7ee806a050 2023-08-09T12:54:25.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.543+0000 7f7ee37fe640 1 -- 172.21.15.17:0/2996451788 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7ef000ae70 con 0x7f7ee806a050 2023-08-09T12:54:25.546 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2023-08-09T12:54:25.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.545+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ee806a050 msgr2=0x7f7ee806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.545+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ee806a050 0x7f7ee806c510 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0cdf20 tx=0x7f7ef0008040 comp rx=0 tx=0).stop 2023-08-09T12:54:25.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.545+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0697c0 msgr2=0x7f7efc070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.545+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0697c0 0x7f7efc070730 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00c7c0 tx=0x7f7eec00cc80 comp rx=0 tx=0).stop 2023-08-09T12:54:25.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.546+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 shutdown_connections 2023-08-09T12:54:25.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.546+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f7ee806a050 0x7f7ee806c510 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.546+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7efc0cca50 0x7f7efc06f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.546+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7efc0adad0 0x7f7efc150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.546+0000 7f7f0090e640 1 --2- 172.21.15.17:0/2996451788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7efc0697c0 0x7f7efc070730 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.546+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 >> 172.21.15.17:0/2996451788 conn(0x7f7efc0cb900 msgr2=0x7f7efc06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:25.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.546+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 shutdown_connections 2023-08-09T12:54:25.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.546+0000 7f7f0090e640 1 -- 172.21.15.17:0/2996451788 wait complete. 2023-08-09T12:54:25.566 INFO:tasks.ceph:Scrubbing osd.4 2023-08-09T12:54:25.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-09T12:54:25.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.798+0000 7f973359e640 1 Processor -- start 2023-08-09T12:54:25.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.798+0000 7f973359e640 1 -- start start 2023-08-09T12:54:25.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f973359e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97340cfe90 0x7f97340d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f973359e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97340d0960 0x7f97340b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f973359e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97340d2680 con 0x7f973415ccb0 2023-08-09T12:54:25.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f973359e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97340d0f20 con 0x7f97340cfe90 2023-08-09T12:54:25.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f973359e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97340d1200 con 0x7f97340d0960 2023-08-09T12:54:25.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f9731d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97340cfe90 0x7f97340d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f9731d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f97340cfe90 0x7f97340d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52276/0 (socket says 172.21.15.17:52276) 2023-08-09T12:54:25.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f9731d9b640 1 -- 172.21.15.17:0/279142214 learned_addr learned my addr 172.21.15.17:0/279142214 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:25.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f9731d9b640 1 -- 172.21.15.17:0/279142214 >> v2:172.21.15.142:3300/0 conn(0x7f97340d0960 msgr2=0x7f97340b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:25.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f9731d9b640 1 --2- 172.21.15.17:0/279142214 >> v2:172.21.15.142:3300/0 conn(0x7f97340d0960 0x7f97340b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.800+0000 7f9731d9b640 1 -- 172.21.15.17:0/279142214 >> v1:172.21.15.142:6789/0 conn(0x7f973415ccb0 legacy=0x7f97340cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:25.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.801+0000 7f9731d9b640 1 -- 172.21.15.17:0/279142214 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97340d14e0 con 0x7f97340cfe90 2023-08-09T12:54:25.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.802+0000 7f9731d9b640 1 --2- 172.21.15.17:0/279142214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97340cfe90 0x7f97340d1da0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f97340cf3d0 tx=0x7f971c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c9f7cc94329cdb server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.802+0000 7f973159a640 1 -- 172.21.15.17:0/279142214 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c031640 con 0x7f97340cfe90 2023-08-09T12:54:25.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.802+0000 7f973159a640 1 -- 172.21.15.17:0/279142214 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c0317a0 con 0x7f97340cfe90 2023-08-09T12:54:25.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.802+0000 7f973159a640 1 -- 172.21.15.17:0/279142214 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c031b30 con 0x7f97340cfe90 2023-08-09T12:54:25.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.803+0000 7f973359e640 1 -- 172.21.15.17:0/279142214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97340cfe90 msgr2=0x7f97340d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.803+0000 7f973359e640 1 --2- 172.21.15.17:0/279142214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97340cfe90 0x7f97340d1da0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f97340cf3d0 tx=0x7f971c02b8f0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.803+0000 7f973359e640 1 -- 172.21.15.17:0/279142214 shutdown_connections 2023-08-09T12:54:25.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.803+0000 7f973359e640 1 --2- 172.21.15.17:0/279142214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97340cfe90 0x7f97340d1da0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.803+0000 7f973359e640 1 --2- 172.21.15.17:0/279142214 >> v2:172.21.15.142:3300/0 conn(0x7f97340d0960 0x7f97340b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.803+0000 7f973359e640 1 -- 172.21.15.17:0/279142214 >> 172.21.15.17:0/279142214 conn(0x7f97340699a0 msgr2=0x7f9734069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:25.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.803+0000 7f973359e640 1 -- 172.21.15.17:0/279142214 shutdown_connections 2023-08-09T12:54:25.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.803+0000 7f973359e640 1 -- 172.21.15.17:0/279142214 wait complete. 2023-08-09T12:54:25.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.805+0000 7f973359e640 1 Processor -- start 2023-08-09T12:54:25.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.805+0000 7f973359e640 1 -- start start 2023-08-09T12:54:25.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f973359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97340cfe90 0x7f973414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f973359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97340d0960 0x7f973415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f973359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973415ccb0 0x7f9734155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f973359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973415f730 con 0x7f973415ccb0 2023-08-09T12:54:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f973359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97341f0160 con 0x7f97340cfe90 2023-08-09T12:54:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f973359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97341f3330 con 0x7f97340d0960 2023-08-09T12:54:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f9732d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973415ccb0 0x7f9734155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f9732d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973415ccb0 0x7f9734155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52278/0 (socket says 172.21.15.17:52278) 2023-08-09T12:54:25.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.806+0000 7f9732d9d640 1 -- 172.21.15.17:0/1556572870 learned_addr learned my addr 172.21.15.17:0/1556572870 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:25.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f9732d9d640 1 -- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97340d0960 msgr2=0x7f973415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f9732d9d640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97340d0960 0x7f973415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f9732d9d640 1 -- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97340cfe90 msgr2=0x7f973414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f9732d9d640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97340cfe90 0x7f973414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f9732d9d640 1 -- 172.21.15.17:0/1556572870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0094d0 con 0x7f973415ccb0 2023-08-09T12:54:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f9732d9d640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973415ccb0 0x7f9734155510 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f972c00b3e0 tx=0x7f972c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c011830 con 0x7f973415ccb0 2023-08-09T12:54:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c011990 con 0x7f973415ccb0 2023-08-09T12:54:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c011d20 con 0x7f973415ccb0 2023-08-09T12:54:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.807+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97341f3610 con 0x7f973415ccb0 2023-08-09T12:54:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.808+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9734154d10 con 0x7f973415ccb0 2023-08-09T12:54:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.809+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97340b5900 con 0x7f973415ccb0 2023-08-09T12:54:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.810+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f972c01a400 con 0x7f973415ccb0 2023-08-09T12:54:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.811+0000 7f972affd640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f971406a050 0x7f971406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.811+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f972c0883f0 con 0x7f973415ccb0 2023-08-09T12:54:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.811+0000 7f972affd640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f97140704d0 0x7f97140728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.811+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 --> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9714072fa0 con 0x7f97140704d0 2023-08-09T12:54:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.811+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f972c08a9d0 con 0x7f973415ccb0 2023-08-09T12:54:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.811+0000 7f973259c640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f971406a050 0x7f971406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.812+0000 7f9731d9b640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f97140704d0 0x7f97140728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.813+0000 7f973259c640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f971406a050 0x7f971406c510 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f972400ab90 tx=0x7f9724009230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.813+0000 7f9731d9b640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f97140704d0 0x7f97140728f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.815+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 <== osd.4 v2:172.21.15.142:6808/701351329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9714072fa0 con 0x7f97140704d0 2023-08-09T12:54:25.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.828+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 --> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f97340d17c0 con 0x7f97140704d0 2023-08-09T12:54:25.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.829+0000 7f972affd640 1 -- 172.21.15.17:0/1556572870 <== osd.4 v2:172.21.15.142:6808/701351329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f971c031910 con 0x7f97140704d0 2023-08-09T12:54:25.832 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:54:25.832 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-09T12:54:25.833 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:54:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.829+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f97140704d0 msgr2=0x7f97140728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.829+0000 7f973359e640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6808/701351329,v1:172.21.15.142:6809/701351329] conn(0x7f97140704d0 0x7f97140728f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f971406a050 msgr2=0x7f971406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f973359e640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f971406a050 0x7f971406c510 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f972400ab90 tx=0x7f9724009230 comp rx=0 tx=0).stop 2023-08-09T12:54:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973415ccb0 msgr2=0x7f9734155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f973359e640 1 --2- 172.21.15.17:0/1556572870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973415ccb0 0x7f9734155510 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f972c00b3e0 tx=0x7f972c009f90 comp rx=0 tx=0).stop 2023-08-09T12:54:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f9732d9d640 1 -- 172.21.15.17:0/1556572870 reap_dead start 2023-08-09T12:54:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 shutdown_connections 2023-08-09T12:54:25.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 >> 172.21.15.17:0/1556572870 conn(0x7f97340699a0 msgr2=0x7f9734069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:25.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 shutdown_connections 2023-08-09T12:54:25.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:25.830+0000 7f973359e640 1 -- 172.21.15.17:0/1556572870 wait complete. 2023-08-09T12:54:25.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-09T12:54:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.076+0000 7f59a62b0640 1 Processor -- start 2023-08-09T12:54:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.076+0000 7f59a62b0640 1 -- start start 2023-08-09T12:54:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.077+0000 7f59a62b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0160030 0x7f59a0160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.077+0000 7f59a62b0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a00b5a30 con 0x7f59a00b86e0 2023-08-09T12:54:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.077+0000 7f59a62b0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a00d0d70 con 0x7f59a00cfb50 2023-08-09T12:54:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.077+0000 7f59a62b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00d1110 con 0x7f59a0160030 2023-08-09T12:54:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.077+0000 7f59a4aad640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f59a00b86e0 0x7f59a00cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49278/0 (socket says 172.21.15.17:49278) 2023-08-09T12:54:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.077+0000 7f59a4aad640 1 -- 172.21.15.17:0/739489348 learned_addr learned my addr 172.21.15.17:0/739489348 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f59a52ae640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0160030 0x7f59a0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575119507 0 0) 0x7f59a00b5a30 con 0x7f59a00b86e0 2023-08-09T12:54:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f598c003520 con 0x7f59a00b86e0 2023-08-09T12:54:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4098088232 0 0) 0x7f598c003520 con 0x7f59a00b86e0 2023-08-09T12:54:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0160030 msgr2=0x7f59a0160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0160030 0x7f59a0160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 >> v1:172.21.15.142:6789/0 conn(0x7f59a00cfb50 legacy=0x7f59a00d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a0160f70 con 0x7f59a00b86e0 2023-08-09T12:54:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f5990001670 con 0x7f59a00b86e0 2023-08-09T12:54:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.078+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 >> v1:172.21.15.17:6789/0 conn(0x7f59a00b86e0 legacy=0x7f59a00cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f5997fff640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f598c0039a0 0x7f598c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f5997fff640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0160030 0x7f598c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f5997fff640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f598c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00d1110 con 0x7f598c004d00 2023-08-09T12:54:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c00ba30 con 0x7f598c0039a0 2023-08-09T12:54:26.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c00bbf0 con 0x7f59a0160030 2023-08-09T12:54:26.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f59a5aaf640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f598c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f59a52ae640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f598c0039a0 0x7f598c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.079+0000 7f59a4aad640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0160030 0x7f598c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.080+0000 7f59a5aaf640 1 -- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0160030 msgr2=0x7f598c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.080+0000 7f59a5aaf640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0160030 0x7f598c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.080+0000 7f59a5aaf640 1 -- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f598c0039a0 msgr2=0x7f598c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.080+0000 7f59a5aaf640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f598c0039a0 0x7f598c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.080+0000 7f59a5aaf640 1 -- 172.21.15.17:0/739489348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c003520 con 0x7f598c004d00 2023-08-09T12:54:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.081+0000 7f59a5aaf640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f598c005180 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f59a006b9a0 tx=0x7f598c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7b1bed1ae2b526 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.081+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998003b70 con 0x7f598c004d00 2023-08-09T12:54:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.081+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5998003cd0 con 0x7f598c004d00 2023-08-09T12:54:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.081+0000 7f5997fff640 1 -- 172.21.15.17:0/739489348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998005310 con 0x7f598c004d00 2023-08-09T12:54:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.082+0000 7f59a62b0640 1 -- 172.21.15.17:0/739489348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 msgr2=0x7f598c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.082+0000 7f59a62b0640 1 --2- 172.21.15.17:0/739489348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f598c005180 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f59a006b9a0 tx=0x7f598c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.082+0000 7f59a5aaf640 1 -- 172.21.15.17:0/739489348 reap_dead start 2023-08-09T12:54:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.082+0000 7f59a62b0640 1 -- 172.21.15.17:0/739489348 shutdown_connections 2023-08-09T12:54:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.082+0000 7f59a62b0640 1 -- 172.21.15.17:0/739489348 >> 172.21.15.17:0/739489348 conn(0x7f59a00697c0 msgr2=0x7f59a0069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.082+0000 7f59a62b0640 1 -- 172.21.15.17:0/739489348 shutdown_connections 2023-08-09T12:54:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.082+0000 7f59a62b0640 1 -- 172.21.15.17:0/739489348 wait complete. 2023-08-09T12:54:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.084+0000 7f59a62b0640 1 Processor -- start 2023-08-09T12:54:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.084+0000 7f59a62b0640 1 -- start start 2023-08-09T12:54:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a62b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f59a01f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a62b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0151b50 0x7f59a00b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a62b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00a93c0 0x7f59a00a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a62b0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01f2360 con 0x7f598c004d00 2023-08-09T12:54:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a62b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01519d0 con 0x7f59a00a93c0 2023-08-09T12:54:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a62b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00a9d80 con 0x7f59a0151b50 2023-08-09T12:54:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a52ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f59a01f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a52ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f59a01f1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52286/0 (socket says 172.21.15.17:52286) 2023-08-09T12:54:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.085+0000 7f59a52ae640 1 -- 172.21.15.17:0/3315981924 learned_addr learned my addr 172.21.15.17:0/3315981924 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:26.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f59a52ae640 1 -- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0151b50 msgr2=0x7f59a00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f59a52ae640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0151b50 0x7f59a00b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f59a52ae640 1 -- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00a93c0 msgr2=0x7f59a00a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f59a52ae640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00a93c0 0x7f59a00a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f59a52ae640 1 -- 172.21.15.17:0/3315981924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00b65e0 con 0x7f598c004d00 2023-08-09T12:54:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f59a52ae640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f59a01f1e20 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f599c0115e0 tx=0x7f599c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f5995ffb640 1 -- 172.21.15.17:0/3315981924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c015870 con 0x7f598c004d00 2023-08-09T12:54:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f5995ffb640 1 -- 172.21.15.17:0/3315981924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c0159d0 con 0x7f598c004d00 2023-08-09T12:54:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f5995ffb640 1 -- 172.21.15.17:0/3315981924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c015d80 con 0x7f598c004d00 2023-08-09T12:54:26.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a00b6810 con 0x7f598c004d00 2023-08-09T12:54:26.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.086+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a00b6dd0 con 0x7f598c004d00 2023-08-09T12:54:26.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.088+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a004e390 con 0x7f598c004d00 2023-08-09T12:54:26.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.089+0000 7f5995ffb640 1 -- 172.21.15.17:0/3315981924 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f599c00f460 con 0x7f598c004d00 2023-08-09T12:54:26.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.089+0000 7f5995ffb640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f598406a080 0x7f598406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.090+0000 7f5995ffb640 1 -- 172.21.15.17:0/3315981924 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f599c088aa0 con 0x7f598c004d00 2023-08-09T12:54:26.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.090+0000 7f59a4aad640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f598406a080 0x7f598406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.091+0000 7f59a4aad640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f598406a080 0x7f598406c540 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5990001eb0 tx=0x7f5990001d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.094+0000 7f5995ffb640 1 -- 172.21.15.17:0/3315981924 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f599c057ea0 con 0x7f598c004d00 2023-08-09T12:54:26.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.289+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f59a0161530 con 0x7f598406a080 2023-08-09T12:54:26.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.290+0000 7f5995ffb640 1 -- 172.21.15.17:0/3315981924 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f599000e7b0 con 0x7f598406a080 2023-08-09T12:54:26.293 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2023-08-09T12:54:26.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f598406a080 msgr2=0x7f598406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f598406a080 0x7f598406c540 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5990001eb0 tx=0x7f5990001d60 comp rx=0 tx=0).stop 2023-08-09T12:54:26.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 msgr2=0x7f59a01f1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f59a01f1e20 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f599c0115e0 tx=0x7f599c011aa0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 shutdown_connections 2023-08-09T12:54:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f598406a080 0x7f598406c540 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59a00a93c0 0x7f59a00a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59a0151b50 0x7f59a00b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 --2- 172.21.15.17:0/3315981924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f598c004d00 0x7f59a01f1e20 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 >> 172.21.15.17:0/3315981924 conn(0x7f59a00697c0 msgr2=0x7f59a00c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:26.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 shutdown_connections 2023-08-09T12:54:26.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.293+0000 7f59a62b0640 1 -- 172.21.15.17:0/3315981924 wait complete. 2023-08-09T12:54:26.319 INFO:tasks.ceph:Scrubbing osd.5 2023-08-09T12:54:26.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-09T12:54:26.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.556+0000 7f19a9885640 1 Processor -- start 2023-08-09T12:54:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.556+0000 7f19a9885640 1 -- start start 2023-08-09T12:54:26.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9885640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19a40b3dd0 0x7f19a40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9885640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a40b41b0 0x7f19a415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9885640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19a415f0e0 0x7f19a40affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9885640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a40b18b0 con 0x7f19a415f0e0 2023-08-09T12:54:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9885640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a40b1b10 con 0x7f19a40b3dd0 2023-08-09T12:54:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9885640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40b1df0 con 0x7f19a40b41b0 2023-08-09T12:54:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9084640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19a415f0e0 0x7f19a40affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9084640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19a415f0e0 0x7f19a40affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52288/0 (socket says 172.21.15.17:52288) 2023-08-09T12:54:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.558+0000 7f19a9084640 1 -- 172.21.15.17:0/2123784150 learned_addr learned my addr 172.21.15.17:0/2123784150 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.559+0000 7f19a8883640 1 --2- 172.21.15.17:0/2123784150 >> v2:172.21.15.142:3300/0 conn(0x7f19a40b3dd0 0x7f19a40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.559+0000 7f19a3fff640 1 --2- 172.21.15.17:0/2123784150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a40b41b0 0x7f19a415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.559+0000 7f19a9084640 1 -- 172.21.15.17:0/2123784150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a40b41b0 msgr2=0x7f19a415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:26.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.559+0000 7f19a9084640 1 --2- 172.21.15.17:0/2123784150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a40b41b0 0x7f19a415eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.559+0000 7f19a9084640 1 -- 172.21.15.17:0/2123784150 >> v2:172.21.15.142:3300/0 conn(0x7f19a40b3dd0 msgr2=0x7f19a40b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:26.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.559+0000 7f19a9084640 1 --2- 172.21.15.17:0/2123784150 >> v2:172.21.15.142:3300/0 conn(0x7f19a40b3dd0 0x7f19a40b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.559+0000 7f19a9084640 1 -- 172.21.15.17:0/2123784150 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a40b20d0 con 0x7f19a415f0e0 2023-08-09T12:54:26.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.560+0000 7f19a9084640 1 --2- 172.21.15.17:0/2123784150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a415f0e0 0x7f19a40affa0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f19a406a7a0 tx=0x7f199c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473f7f4f9681cb29 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.560+0000 7f19a37fe640 1 -- 172.21.15.17:0/2123784150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c02ca70 con 0x7f19a415f0e0 2023-08-09T12:54:26.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.560+0000 7f19a37fe640 1 -- 172.21.15.17:0/2123784150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c02cbd0 con 0x7f19a415f0e0 2023-08-09T12:54:26.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.560+0000 7f19a37fe640 1 -- 172.21.15.17:0/2123784150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0343f0 con 0x7f19a415f0e0 2023-08-09T12:54:26.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 -- 172.21.15.17:0/2123784150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a415f0e0 msgr2=0x7f19a40affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 --2- 172.21.15.17:0/2123784150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a415f0e0 0x7f19a40affa0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f19a406a7a0 tx=0x7f199c02bed0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 -- 172.21.15.17:0/2123784150 shutdown_connections 2023-08-09T12:54:26.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 --2- 172.21.15.17:0/2123784150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a415f0e0 0x7f19a40affa0 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 --2- 172.21.15.17:0/2123784150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a40b41b0 0x7f19a415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 --2- 172.21.15.17:0/2123784150 >> v2:172.21.15.142:3300/0 conn(0x7f19a40b3dd0 0x7f19a40b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 -- 172.21.15.17:0/2123784150 >> 172.21.15.17:0/2123784150 conn(0x7f19a40cafa0 msgr2=0x7f19a40cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:26.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 -- 172.21.15.17:0/2123784150 shutdown_connections 2023-08-09T12:54:26.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.561+0000 7f19a9885640 1 -- 172.21.15.17:0/2123784150 wait complete. 2023-08-09T12:54:26.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.563+0000 7f19a9885640 1 Processor -- start 2023-08-09T12:54:26.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.563+0000 7f19a9885640 1 -- start start 2023-08-09T12:54:26.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a9885640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a40b3dd0 0x7f19a40af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a9885640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a40b41b0 0x7f19a414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a9885640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a415f0e0 0x7f19a40cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a9885640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40ae6e0 con 0x7f19a40b3dd0 2023-08-09T12:54:26.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a9885640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a406f6e0 con 0x7f19a415f0e0 2023-08-09T12:54:26.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a9885640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40ae930 con 0x7f19a40b41b0 2023-08-09T12:54:26.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a8883640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a40b3dd0 0x7f19a40af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a8883640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a40b3dd0 0x7f19a40af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52302/0 (socket says 172.21.15.17:52302) 2023-08-09T12:54:26.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.564+0000 7f19a8883640 1 -- 172.21.15.17:0/906762379 learned_addr learned my addr 172.21.15.17:0/906762379 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:26.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a8883640 1 -- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a40b41b0 msgr2=0x7f19a414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a8883640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a40b41b0 0x7f19a414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a8883640 1 -- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a415f0e0 msgr2=0x7f19a40cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a8883640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a415f0e0 0x7f19a40cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a8883640 1 -- 172.21.15.17:0/906762379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c009b30 con 0x7f19a40b3dd0 2023-08-09T12:54:26.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a8883640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a40b3dd0 0x7f19a40af410 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f199800d800 tx=0x7f199800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800b6c0 con 0x7f19a40b3dd0 2023-08-09T12:54:26.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199800b820 con 0x7f19a40b3dd0 2023-08-09T12:54:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800bbb0 con 0x7f19a40b3dd0 2023-08-09T12:54:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.565+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a40aec10 con 0x7f19a40b3dd0 2023-08-09T12:54:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.566+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a414f110 con 0x7f19a40b3dd0 2023-08-09T12:54:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.567+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19a415e6a0 con 0x7f19a40b3dd0 2023-08-09T12:54:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.568+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f199800bd10 con 0x7f19a40b3dd0 2023-08-09T12:54:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.569+0000 7f19a17fa640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f198806a050 0x7f198806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.569+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1998088850 con 0x7f19a40b3dd0 2023-08-09T12:54:26.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.569+0000 7f19a17fa640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f19880704d0 0x7f19880728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.569+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 --> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1988072fa0 con 0x7f19880704d0 2023-08-09T12:54:26.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.569+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f199808ae30 con 0x7f19a40b3dd0 2023-08-09T12:54:26.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.569+0000 7f19a3fff640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f198806a050 0x7f198806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.570+0000 7f19a9084640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f19880704d0 0x7f19880728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.570+0000 7f19a3fff640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f198806a050 0x7f198806c510 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1990006b10 tx=0x7f1990008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.571+0000 7f19a9084640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f19880704d0 0x7f19880728f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.572+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 <== osd.5 v2:172.21.15.142:6800/445717890 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f1988072fa0 con 0x7f19880704d0 2023-08-09T12:54:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.585+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 --> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19a415e3c0 con 0x7f19880704d0 2023-08-09T12:54:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.586+0000 7f19a17fa640 1 -- 172.21.15.17:0/906762379 <== osd.5 v2:172.21.15.142:6800/445717890 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f199c009510 con 0x7f19880704d0 2023-08-09T12:54:26.590 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:54:26.591 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-09T12:54:26.591 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:54:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f19880704d0 msgr2=0x7f19880728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6800/445717890,v1:172.21.15.142:6801/445717890] conn(0x7f19880704d0 0x7f19880728f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f198806a050 msgr2=0x7f198806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f198806a050 0x7f198806c510 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1990006b10 tx=0x7f1990008040 comp rx=0 tx=0).stop 2023-08-09T12:54:26.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a40b3dd0 msgr2=0x7f19a40af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 --2- 172.21.15.17:0/906762379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a40b3dd0 0x7f19a40af410 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f199800d800 tx=0x7f199800dcc0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9084640 1 -- 172.21.15.17:0/906762379 reap_dead start 2023-08-09T12:54:26.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 shutdown_connections 2023-08-09T12:54:26.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 >> 172.21.15.17:0/906762379 conn(0x7f19a40cafa0 msgr2=0x7f19a40ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:26.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 shutdown_connections 2023-08-09T12:54:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.587+0000 7f19a9885640 1 -- 172.21.15.17:0/906762379 wait complete. 2023-08-09T12:54:26.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-09T12:54:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.825+0000 7fa7fc2cc640 1 Processor -- start 2023-08-09T12:54:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.825+0000 7fa7fc2cc640 1 -- start start 2023-08-09T12:54:26.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.827+0000 7fa7fc2cc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa7f4161280 0x7fa7f40c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.827+0000 7fa7fc2cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161660 0x7fa7f40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.827+0000 7fa7fc2cc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f415df30 con 0x7fa7f40ca450 2023-08-09T12:54:26.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.827+0000 7fa7fc2cc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f415d430 con 0x7fa7f4161280 2023-08-09T12:54:26.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.827+0000 7fa7fc2cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40ca9d0 con 0x7fa7f4161660 2023-08-09T12:54:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.827+0000 7fa7fa068640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa7f4161280 0x7fa7f40c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.827+0000 7fa7fa869640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa7f40ca450 0x7fa7f40c8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49290/0 (socket says 172.21.15.17:49290) 2023-08-09T12:54:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.827+0000 7fa7fa869640 1 -- 172.21.15.17:0/804149287 learned_addr learned my addr 172.21.15.17:0/804149287 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.828+0000 7fa7f9867640 1 --2- 172.21.15.17:0/804149287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161660 0x7fa7f40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.828+0000 7fa7fa068640 1 -- 172.21.15.17:0/804149287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161660 msgr2=0x7fa7f40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:26.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.828+0000 7fa7fa068640 1 --2- 172.21.15.17:0/804149287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161660 0x7fa7f40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.828+0000 7fa7fa068640 1 -- 172.21.15.17:0/804149287 >> v1:172.21.15.17:6789/0 conn(0x7fa7f40ca450 legacy=0x7fa7f40c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.828+0000 7fa7fa068640 1 -- 172.21.15.17:0/804149287 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f415e3c0 con 0x7fa7f4161280 2023-08-09T12:54:26.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.828+0000 7fa7f9066640 1 -- 172.21.15.17:0/804149287 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123048491 0 0) 0x7fa7f415df30 con 0x7fa7f40ca450 2023-08-09T12:54:26.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.829+0000 7fa7fa068640 1 --2- 172.21.15.17:0/804149287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161280 0x7fa7f40c9f10 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00097a0 tx=0x7fa7f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcacf6278c1c96c server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.829+0000 7fa7f9066640 1 -- 172.21.15.17:0/804149287 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f002e070 con 0x7fa7f4161280 2023-08-09T12:54:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7f9066640 1 -- 172.21.15.17:0/804149287 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f00315a0 con 0x7fa7f4161280 2023-08-09T12:54:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7f9066640 1 -- 172.21.15.17:0/804149287 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0031930 con 0x7fa7f4161280 2023-08-09T12:54:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/804149287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161280 msgr2=0x7fa7f40c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/804149287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161280 0x7fa7f40c9f10 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00097a0 tx=0x7fa7f002b840 comp rx=0 tx=0).stop 2023-08-09T12:54:26.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/804149287 shutdown_connections 2023-08-09T12:54:26.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/804149287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161660 0x7fa7f40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/804149287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161280 0x7fa7f40c9f10 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/804149287 >> 172.21.15.17:0/804149287 conn(0x7fa7f40cb1b0 msgr2=0x7fa7f40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:26.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.830+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/804149287 shutdown_connections 2023-08-09T12:54:26.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.831+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/804149287 wait complete. 2023-08-09T12:54:26.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.832+0000 7fa7fc2cc640 1 Processor -- start 2023-08-09T12:54:26.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.832+0000 7fa7fc2cc640 1 -- start start 2023-08-09T12:54:26.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.833+0000 7fa7fc2cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f40ca450 0x7fa7f40b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.833+0000 7fa7fc2cc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161280 0x7fa7f4156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.833+0000 7fa7fc2cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161660 0x7fa7f41f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.833+0000 7fa7fc2cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40b0260 con 0x7fa7f4161660 2023-08-09T12:54:26.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.833+0000 7fa7fc2cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4146890 con 0x7fa7f40ca450 2023-08-09T12:54:26.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.833+0000 7fa7fc2cc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40af5e0 con 0x7fa7f4161280 2023-08-09T12:54:26.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa869640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161660 0x7fa7f41f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa869640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161660 0x7fa7f41f6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52332/0 (socket says 172.21.15.17:52332) 2023-08-09T12:54:26.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa869640 1 -- 172.21.15.17:0/1256987902 learned_addr learned my addr 172.21.15.17:0/1256987902 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:26.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7f9867640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161280 0x7fa7f4156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa869640 1 -- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161280 msgr2=0x7fa7f4156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa068640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f40ca450 0x7fa7f40b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa869640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161280 0x7fa7f4156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa869640 1 -- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f40ca450 msgr2=0x7fa7f40b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:26.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa869640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f40ca450 0x7fa7f40b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:26.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7fa869640 1 -- 172.21.15.17:0/1256987902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0009400 con 0x7fa7f4161660 2023-08-09T12:54:26.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.834+0000 7fa7f9867640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161280 0x7fa7f4156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:26.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.835+0000 7fa7fa869640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161660 0x7fa7f41f6490 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00c700 tx=0x7fa7ec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.835+0000 7fa7eaffd640 1 -- 172.21.15.17:0/1256987902 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00ce10 con 0x7fa7f4161660 2023-08-09T12:54:26.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.835+0000 7fa7eaffd640 1 -- 172.21.15.17:0/1256987902 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec00a640 con 0x7fa7f4161660 2023-08-09T12:54:26.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.835+0000 7fa7eaffd640 1 -- 172.21.15.17:0/1256987902 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00a9f0 con 0x7fa7f4161660 2023-08-09T12:54:26.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.835+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f40af8c0 con 0x7fa7f4161660 2023-08-09T12:54:26.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.835+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f40afe80 con 0x7fa7f4161660 2023-08-09T12:54:26.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.836+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f40b03a0 con 0x7fa7f4161660 2023-08-09T12:54:26.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.837+0000 7fa7eaffd640 1 -- 172.21.15.17:0/1256987902 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7ec00ab50 con 0x7fa7f4161660 2023-08-09T12:54:26.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.838+0000 7fa7eaffd640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7d806a080 0x7fa7d806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:26.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.838+0000 7fa7eaffd640 1 -- 172.21.15.17:0/1256987902 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa7ec0875c0 con 0x7fa7f4161660 2023-08-09T12:54:26.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.839+0000 7fa7fa068640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7d806a080 0x7fa7d806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:26.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.840+0000 7fa7fa068640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7d806a080 0x7fa7d806c540 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0036000 tx=0x7fa7f003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:26.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:26.843+0000 7fa7eaffd640 1 -- 172.21.15.17:0/1256987902 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fa7f40b03a0 con 0x7fa7f4161660 2023-08-09T12:54:27.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.033+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7f415d8e0 con 0x7fa7d806a080 2023-08-09T12:54:27.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.034+0000 7fa7eaffd640 1 -- 172.21.15.17:0/1256987902 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa7f00319f0 con 0x7fa7d806a080 2023-08-09T12:54:27.038 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2023-08-09T12:54:27.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.036+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7d806a080 msgr2=0x7fa7d806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7d806a080 0x7fa7d806c540 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0036000 tx=0x7fa7f003d040 comp rx=0 tx=0).stop 2023-08-09T12:54:27.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161660 msgr2=0x7fa7f41f6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161660 0x7fa7f41f6490 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00c700 tx=0x7fa7ec00cbc0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 shutdown_connections 2023-08-09T12:54:27.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fa7d806a080 0x7fa7d806c540 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4161660 0x7fa7f41f6490 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7f4161280 0x7fa7f4156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 --2- 172.21.15.17:0/1256987902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f40ca450 0x7fa7f40b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 >> 172.21.15.17:0/1256987902 conn(0x7fa7f40cb1b0 msgr2=0x7fa7f40cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:27.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 shutdown_connections 2023-08-09T12:54:27.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.037+0000 7fa7fc2cc640 1 -- 172.21.15.17:0/1256987902 wait complete. 2023-08-09T12:54:27.058 INFO:tasks.ceph:Scrubbing osd.6 2023-08-09T12:54:27.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-09T12:54:27.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.280+0000 7f0e26221640 1 Processor -- start 2023-08-09T12:54:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.280+0000 7f0e26221640 1 -- start start 2023-08-09T12:54:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.282+0000 7f0e26221640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e20158fa0 0x7f0e200cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.282+0000 7f0e26221640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0e2006f3a0 0x7f0e2006f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.282+0000 7f0e26221640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e20070180 con 0x7f0e2006fd50 2023-08-09T12:54:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.282+0000 7f0e26221640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200cb0d0 con 0x7f0e2006f3a0 2023-08-09T12:54:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.282+0000 7f0e26221640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200cb7c0 con 0x7f0e20158fa0 2023-08-09T12:54:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.282+0000 7f0e24a1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0e2006f3a0 0x7f0e2006f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.282+0000 7f0e24a1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0e2006f3a0 0x7f0e2006f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52338/0 (socket says 172.21.15.17:52338) 2023-08-09T12:54:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.282+0000 7f0e24a1e640 1 -- 172.21.15.17:0/964666865 learned_addr learned my addr 172.21.15.17:0/964666865 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.283+0000 7f0e24a1e640 1 -- 172.21.15.17:0/964666865 >> v2:172.21.15.142:3300/0 conn(0x7f0e20158fa0 msgr2=0x7f0e200cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.283+0000 7f0e24a1e640 1 --2- 172.21.15.17:0/964666865 >> v2:172.21.15.142:3300/0 conn(0x7f0e20158fa0 0x7f0e200cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.283+0000 7f0e24a1e640 1 -- 172.21.15.17:0/964666865 >> v1:172.21.15.142:6789/0 conn(0x7f0e2006fd50 legacy=0x7f0e200c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.283+0000 7f0e24a1e640 1 -- 172.21.15.17:0/964666865 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20070450 con 0x7f0e2006f3a0 2023-08-09T12:54:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.284+0000 7f0e24a1e640 1 --2- 172.21.15.17:0/964666865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 0x7f0e2006f810 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f0e200cedf0 tx=0x7f0e1402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c835126907de02e server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.284+0000 7f0e13fff640 1 -- 172.21.15.17:0/964666865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14030860 con 0x7f0e2006f3a0 2023-08-09T12:54:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.284+0000 7f0e13fff640 1 -- 172.21.15.17:0/964666865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e140309c0 con 0x7f0e2006f3a0 2023-08-09T12:54:27.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.284+0000 7f0e13fff640 1 -- 172.21.15.17:0/964666865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14030d50 con 0x7f0e2006f3a0 2023-08-09T12:54:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.285+0000 7f0e26221640 1 -- 172.21.15.17:0/964666865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 msgr2=0x7f0e2006f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.285+0000 7f0e26221640 1 --2- 172.21.15.17:0/964666865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 0x7f0e2006f810 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f0e200cedf0 tx=0x7f0e1402b9a0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.285+0000 7f0e26221640 1 -- 172.21.15.17:0/964666865 shutdown_connections 2023-08-09T12:54:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.285+0000 7f0e26221640 1 --2- 172.21.15.17:0/964666865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 0x7f0e2006f810 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.285+0000 7f0e26221640 1 --2- 172.21.15.17:0/964666865 >> v2:172.21.15.142:3300/0 conn(0x7f0e20158fa0 0x7f0e200cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.285+0000 7f0e26221640 1 -- 172.21.15.17:0/964666865 >> 172.21.15.17:0/964666865 conn(0x7f0e200ceeb0 msgr2=0x7f0e200cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.285+0000 7f0e26221640 1 -- 172.21.15.17:0/964666865 shutdown_connections 2023-08-09T12:54:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.285+0000 7f0e26221640 1 -- 172.21.15.17:0/964666865 wait complete. 2023-08-09T12:54:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.287+0000 7f0e26221640 1 Processor -- start 2023-08-09T12:54:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.287+0000 7f0e26221640 1 -- start start 2023-08-09T12:54:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e26221640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 0x7f0e200c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e26221640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e2006fd50 0x7f0e200c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e26221640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e20158fa0 0x7f0e2006b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e26221640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2009bee0 con 0x7f0e2006f3a0 2023-08-09T12:54:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e26221640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200c4740 con 0x7f0e2006fd50 2023-08-09T12:54:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e26221640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200c4a20 con 0x7f0e20158fa0 2023-08-09T12:54:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e2521f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 0x7f0e200c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e2521f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 0x7f0e200c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52348/0 (socket says 172.21.15.17:52348) 2023-08-09T12:54:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.288+0000 7f0e2521f640 1 -- 172.21.15.17:0/3829273455 learned_addr learned my addr 172.21.15.17:0/3829273455 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e2521f640 1 -- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e20158fa0 msgr2=0x7f0e2006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e2521f640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e20158fa0 0x7f0e2006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e2521f640 1 -- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e2006fd50 msgr2=0x7f0e200c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e2521f640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e2006fd50 0x7f0e200c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e2521f640 1 -- 172.21.15.17:0/3829273455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140094d0 con 0x7f0e2006f3a0 2023-08-09T12:54:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e2521f640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 0x7f0e200c3bd0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00b410 tx=0x7f0e1c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c011830 con 0x7f0e2006f3a0 2023-08-09T12:54:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c0119b0 con 0x7f0e2006f3a0 2023-08-09T12:54:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c011d60 con 0x7f0e2006f3a0 2023-08-09T12:54:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e200c4d00 con 0x7f0e2006f3a0 2023-08-09T12:54:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.289+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e200c52c0 con 0x7f0e2006f3a0 2023-08-09T12:54:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.290+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e200c4b90 con 0x7f0e2006f3a0 2023-08-09T12:54:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.291+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e1c01a400 con 0x7f0e2006f3a0 2023-08-09T12:54:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.292+0000 7f0e11ffb640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e0406a050 0x7f0e0406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.292+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0e1c088470 con 0x7f0e2006f3a0 2023-08-09T12:54:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.292+0000 7f0e11ffb640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f0e040704d0 0x7f0e040728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.293+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 --> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e04072fa0 con 0x7f0e040704d0 2023-08-09T12:54:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.293+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e1c08aa50 con 0x7f0e2006f3a0 2023-08-09T12:54:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.293+0000 7f0e24a1e640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e0406a050 0x7f0e0406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.293+0000 7f0e25a20640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f0e040704d0 0x7f0e040728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.294+0000 7f0e25a20640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f0e040704d0 0x7f0e040728f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.295+0000 7f0e24a1e640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e0406a050 0x7f0e0406c510 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0e14036000 tx=0x7f0e1403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:27.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.296+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 <== osd.6 v2:172.21.15.142:6821/1908382838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0e04072fa0 con 0x7f0e040704d0 2023-08-09T12:54:27.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.309+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 --> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0e200cd910 con 0x7f0e040704d0 2023-08-09T12:54:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e11ffb640 1 -- 172.21.15.17:0/3829273455 <== osd.6 v2:172.21.15.142:6821/1908382838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f0e18001d40 con 0x7f0e040704d0 2023-08-09T12:54:27.313 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:54:27.313 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-09T12:54:27.313 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:54:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f0e040704d0 msgr2=0x7f0e040728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e26221640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6821/1908382838,v1:172.21.15.142:6823/1908382838] conn(0x7f0e040704d0 0x7f0e040728f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e0406a050 msgr2=0x7f0e0406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e26221640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f0e0406a050 0x7f0e0406c510 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0e14036000 tx=0x7f0e1403b040 comp rx=0 tx=0).stop 2023-08-09T12:54:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 msgr2=0x7f0e200c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e26221640 1 --2- 172.21.15.17:0/3829273455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e2006f3a0 0x7f0e200c3bd0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00b410 tx=0x7f0e1c00b8d0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e25a20640 1 -- 172.21.15.17:0/3829273455 reap_dead start 2023-08-09T12:54:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 shutdown_connections 2023-08-09T12:54:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.310+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 >> 172.21.15.17:0/3829273455 conn(0x7f0e200ceeb0 msgr2=0x7f0e201585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.311+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 shutdown_connections 2023-08-09T12:54:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.311+0000 7f0e26221640 1 -- 172.21.15.17:0/3829273455 wait complete. 2023-08-09T12:54:27.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-09T12:54:27.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.552+0000 7f3393fff640 1 Processor -- start 2023-08-09T12:54:27.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.552+0000 7f3393fff640 1 -- start start 2023-08-09T12:54:27.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.553+0000 7f3393fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3394160030 0x7f3394160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.553+0000 7f3393fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33940cfb50 0x7f33940d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.553+0000 7f3393fff640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940b5a30 con 0x7f33940b86e0 2023-08-09T12:54:27.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.553+0000 7f3393fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33940d1110 con 0x7f3394160030 2023-08-09T12:54:27.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.553+0000 7f3393fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940ceac0 con 0x7f33940cfb50 2023-08-09T12:54:27.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.553+0000 7f33927fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f33940b86e0 0x7f33940cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49306/0 (socket says 172.21.15.17:49306) 2023-08-09T12:54:27.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.553+0000 7f33927fc640 1 -- 172.21.15.17:0/113741282 learned_addr learned my addr 172.21.15.17:0/113741282 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:27.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3392ffd640 1 --2- 172.21.15.17:0/113741282 >> v2:172.21.15.142:3300/0 conn(0x7f3394160030 0x7f3394160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842713266 0 0) 0x7f33940b5a30 con 0x7f33940b86e0 2023-08-09T12:54:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c003520 con 0x7f33940b86e0 2023-08-09T12:54:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f33937fe640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33940cfb50 0x7f33940d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2317882699 0 0) 0x7f337c003520 con 0x7f33940b86e0 2023-08-09T12:54:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33940cfb50 msgr2=0x7f33940d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33940cfb50 0x7f33940d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 >> v2:172.21.15.142:3300/0 conn(0x7f3394160030 msgr2=0x7f3394160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 --2- 172.21.15.17:0/113741282 >> v2:172.21.15.142:3300/0 conn(0x7f3394160030 0x7f3394160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940d0d70 con 0x7f33940b86e0 2023-08-09T12:54:27.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 875587194 0 0) 0x7f3388001670 con 0x7f33940b86e0 2023-08-09T12:54:27.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 >> v1:172.21.15.17:6789/0 conn(0x7f33940b86e0 legacy=0x7f33940cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33940cfb50 0x7f337c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c003ef0 0x7f337c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f337c004d00 0x7f337c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940d1110 con 0x7f337c004d00 2023-08-09T12:54:27.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00b980 con 0x7f337c003ef0 2023-08-09T12:54:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.554+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bb10 con 0x7f33940cfb50 2023-08-09T12:54:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.555+0000 7f33937fe640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f337c004d00 0x7f337c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.555+0000 7f3392ffd640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33940cfb50 0x7f337c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.555+0000 7f33937fe640 1 -- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33940cfb50 msgr2=0x7f337c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.555+0000 7f33927fc640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c003ef0 0x7f337c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.555+0000 7f33937fe640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33940cfb50 0x7f337c003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.555+0000 7f33937fe640 1 -- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c003ef0 msgr2=0x7f337c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:27.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.555+0000 7f33937fe640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c003ef0 0x7f337c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.555+0000 7f33937fe640 1 -- 172.21.15.17:0/113741282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c003520 con 0x7f337c004d00 2023-08-09T12:54:27.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.556+0000 7f33937fe640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f337c004d00 0x7f337c005180 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f339406a560 tx=0x7f337c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf9c0d4b7e29339 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:27.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.556+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c033680 con 0x7f337c004d00 2023-08-09T12:54:27.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c0337e0 con 0x7f337c004d00 2023-08-09T12:54:27.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f3391ffb640 1 -- 172.21.15.17:0/113741282 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c033b70 con 0x7f337c004d00 2023-08-09T12:54:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f3393fff640 1 -- 172.21.15.17:0/113741282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f337c004d00 msgr2=0x7f337c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f3393fff640 1 --2- 172.21.15.17:0/113741282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f337c004d00 0x7f337c005180 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f339406a560 tx=0x7f337c0057f0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f33937fe640 1 -- 172.21.15.17:0/113741282 reap_dead start 2023-08-09T12:54:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f3393fff640 1 -- 172.21.15.17:0/113741282 shutdown_connections 2023-08-09T12:54:27.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f3393fff640 1 -- 172.21.15.17:0/113741282 >> 172.21.15.17:0/113741282 conn(0x7f33940697c0 msgr2=0x7f3394069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f3393fff640 1 -- 172.21.15.17:0/113741282 shutdown_connections 2023-08-09T12:54:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.557+0000 7f3393fff640 1 -- 172.21.15.17:0/113741282 wait complete. 2023-08-09T12:54:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.559+0000 7f3393fff640 1 Processor -- start 2023-08-09T12:54:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.559+0000 7f3393fff640 1 -- start start 2023-08-09T12:54:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f3393fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c004d00 0x7f3394150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f3393fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33941530a0 0x7f3394153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f3393fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3394151a50 0x7f3394151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f3393fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3394153a60 con 0x7f3394151a50 2023-08-09T12:54:27.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f3393fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33941527b0 con 0x7f337c004d00 2023-08-09T12:54:27.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f3393fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940b46a0 con 0x7f33941530a0 2023-08-09T12:54:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f33937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3394151a50 0x7f3394151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f33937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3394151a50 0x7f3394151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52358/0 (socket says 172.21.15.17:52358) 2023-08-09T12:54:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.560+0000 7f33937fe640 1 -- 172.21.15.17:0/450148974 learned_addr learned my addr 172.21.15.17:0/450148974 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:27.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f3392ffd640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c004d00 0x7f3394150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f33927fc640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33941530a0 0x7f3394153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f33937fe640 1 -- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33941530a0 msgr2=0x7f3394153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f33937fe640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33941530a0 0x7f3394153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f33937fe640 1 -- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c004d00 msgr2=0x7f3394150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f33937fe640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c004d00 0x7f3394150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f33937fe640 1 -- 172.21.15.17:0/450148974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940b4b30 con 0x7f3394151a50 2023-08-09T12:54:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f33927fc640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33941530a0 0x7f3394153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.561+0000 7f33937fe640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3394151a50 0x7f3394151ed0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f338c02bf30 tx=0x7f338c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.562+0000 7f337bfff640 1 -- 172.21.15.17:0/450148974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c004220 con 0x7f3394151a50 2023-08-09T12:54:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.562+0000 7f337bfff640 1 -- 172.21.15.17:0/450148974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c033e90 con 0x7f3394151a50 2023-08-09T12:54:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.562+0000 7f337bfff640 1 -- 172.21.15.17:0/450148974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c003610 con 0x7f3394151a50 2023-08-09T12:54:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.562+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33940b3d70 con 0x7f3394151a50 2023-08-09T12:54:27.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.562+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33940b4330 con 0x7f3394151a50 2023-08-09T12:54:27.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.563+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33940b44f0 con 0x7f3394151a50 2023-08-09T12:54:27.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.564+0000 7f337bfff640 1 -- 172.21.15.17:0/450148974 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f338c003770 con 0x7f3394151a50 2023-08-09T12:54:27.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.565+0000 7f337bfff640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f338006a080 0x7f338006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:27.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.565+0000 7f337bfff640 1 -- 172.21.15.17:0/450148974 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f338c042030 con 0x7f3394151a50 2023-08-09T12:54:27.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.565+0000 7f3392ffd640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f338006a080 0x7f338006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:27.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.567+0000 7f3392ffd640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f338006a080 0x7f338006c540 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f33840074a0 tx=0x7f338400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:27.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.569+0000 7f337bfff640 1 -- 172.21.15.17:0/450148974 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f338c076260 con 0x7f3394151a50 2023-08-09T12:54:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.761+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f3394161250 con 0x7f338006a080 2023-08-09T12:54:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.762+0000 7f337bfff640 1 -- 172.21.15.17:0/450148974 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f338400f050 con 0x7f338006a080 2023-08-09T12:54:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 6 to deep-scrub 2023-08-09T12:54:27.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f338006a080 msgr2=0x7f338006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f338006a080 0x7f338006c540 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f33840074a0 tx=0x7f338400b040 comp rx=0 tx=0).stop 2023-08-09T12:54:27.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3394151a50 msgr2=0x7f3394151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:27.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3394151a50 0x7f3394151ed0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f338c02bf30 tx=0x7f338c004730 comp rx=0 tx=0).stop 2023-08-09T12:54:27.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 shutdown_connections 2023-08-09T12:54:27.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f338006a080 0x7f338006c540 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3394151a50 0x7f3394151ed0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33941530a0 0x7f3394153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 --2- 172.21.15.17:0/450148974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f337c004d00 0x7f3394150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:27.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 >> 172.21.15.17:0/450148974 conn(0x7f33940697c0 msgr2=0x7f33940c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:27.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 shutdown_connections 2023-08-09T12:54:27.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:27.765+0000 7f3393fff640 1 -- 172.21.15.17:0/450148974 wait complete. 2023-08-09T12:54:27.786 INFO:tasks.ceph:Scrubbing osd.7 2023-08-09T12:54:27.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-09T12:54:28.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.012+0000 7f3c9cecc640 1 Processor -- start 2023-08-09T12:54:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.012+0000 7f3c9cecc640 1 -- start start 2023-08-09T12:54:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c9cecc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3c9815add0 0x7f3c9806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c9cecc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c98070320 0x7f3c98160e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c9cecc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9815b1b0 con 0x7f3c981613a0 2023-08-09T12:54:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c9cecc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c980707b0 con 0x7f3c9815add0 2023-08-09T12:54:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c9cecc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c980cd6e0 con 0x7f3c98070320 2023-08-09T12:54:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c9659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3c9815add0 0x7f3c9806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c9659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3c9815add0 0x7f3c9806fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50516/0 (socket says 172.21.15.17:50516) 2023-08-09T12:54:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c96d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3c981613a0 0x7f3c980b45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38578/0 (socket says 172.21.15.17:38578) 2023-08-09T12:54:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c9659c640 1 -- 172.21.15.17:0/1039487406 learned_addr learned my addr 172.21.15.17:0/1039487406 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:28.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.014+0000 7f3c95d9b640 1 --2- 172.21.15.17:0/1039487406 >> v2:172.21.15.142:3300/0 conn(0x7f3c98070320 0x7f3c98160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.015+0000 7f3c9659c640 1 -- 172.21.15.17:0/1039487406 >> v2:172.21.15.142:3300/0 conn(0x7f3c98070320 msgr2=0x7f3c98160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:28.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.015+0000 7f3c9659c640 1 --2- 172.21.15.17:0/1039487406 >> v2:172.21.15.142:3300/0 conn(0x7f3c98070320 0x7f3c98160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.015+0000 7f3c9659c640 1 -- 172.21.15.17:0/1039487406 >> v1:172.21.15.17:6789/0 conn(0x7f3c981613a0 legacy=0x7f3c980b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.015+0000 7f3c9659c640 1 -- 172.21.15.17:0/1039487406 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c980cd9c0 con 0x7f3c9815add0 2023-08-09T12:54:28.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.015+0000 7f3c9559a640 1 -- 172.21.15.17:0/1039487406 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566911873 0 0) 0x7f3c9815b1b0 con 0x7f3c981613a0 2023-08-09T12:54:28.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.016+0000 7f3c9659c640 1 --2- 172.21.15.17:0/1039487406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 0x7f3c9806fde0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f3c98071480 tx=0x7f3c8802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e642f50552c020c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.016+0000 7f3c9559a640 1 -- 172.21.15.17:0/1039487406 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88030860 con 0x7f3c9815add0 2023-08-09T12:54:28.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.016+0000 7f3c9559a640 1 -- 172.21.15.17:0/1039487406 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c880309c0 con 0x7f3c9815add0 2023-08-09T12:54:28.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.016+0000 7f3c9559a640 1 -- 172.21.15.17:0/1039487406 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88030d50 con 0x7f3c9815add0 2023-08-09T12:54:28.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.017+0000 7f3c9cecc640 1 -- 172.21.15.17:0/1039487406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 msgr2=0x7f3c9806fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.017+0000 7f3c9cecc640 1 --2- 172.21.15.17:0/1039487406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 0x7f3c9806fde0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f3c98071480 tx=0x7f3c8802b9a0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.017+0000 7f3c9cecc640 1 -- 172.21.15.17:0/1039487406 shutdown_connections 2023-08-09T12:54:28.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.017+0000 7f3c9cecc640 1 --2- 172.21.15.17:0/1039487406 >> v2:172.21.15.142:3300/0 conn(0x7f3c98070320 0x7f3c98160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.017+0000 7f3c9cecc640 1 --2- 172.21.15.17:0/1039487406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 0x7f3c9806fde0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.017+0000 7f3c9cecc640 1 -- 172.21.15.17:0/1039487406 >> 172.21.15.17:0/1039487406 conn(0x7f3c980d2b50 msgr2=0x7f3c980d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:28.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.017+0000 7f3c9cecc640 1 -- 172.21.15.17:0/1039487406 shutdown_connections 2023-08-09T12:54:28.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.017+0000 7f3c9cecc640 1 -- 172.21.15.17:0/1039487406 wait complete. 2023-08-09T12:54:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.019+0000 7f3c9cecc640 1 Processor -- start 2023-08-09T12:54:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.019+0000 7f3c9cecc640 1 -- start start 2023-08-09T12:54:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.020+0000 7f3c9cecc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c98070320 0x7f3c981581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.020+0000 7f3c9cecc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 0x7f3c980b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.020+0000 7f3c9cecc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c981613a0 0x7f3c981f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.020+0000 7f3c9cecc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980b2af0 con 0x7f3c9815add0 2023-08-09T12:54:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.020+0000 7f3c9cecc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980cabf0 con 0x7f3c98070320 2023-08-09T12:54:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.020+0000 7f3c9cecc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c981f36f0 con 0x7f3c981613a0 2023-08-09T12:54:28.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 0x7f3c980b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 0x7f3c980b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50528/0 (socket says 172.21.15.17:50528) 2023-08-09T12:54:28.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 -- 172.21.15.17:0/626398565 learned_addr learned my addr 172.21.15.17:0/626398565 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c9659c640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c98070320 0x7f3c981581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 -- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c981613a0 msgr2=0x7f3c981f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c981613a0 0x7f3c981f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 -- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c98070320 msgr2=0x7f3c981581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c98070320 0x7f3c981581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 -- 172.21.15.17:0/626398565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c880094d0 con 0x7f3c9815add0 2023-08-09T12:54:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c9659c640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c98070320 0x7f3c981581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.021+0000 7f3c95d9b640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 0x7f3c980b25b0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f3c80007ef0 tx=0x7f3c8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.022+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80014620 con 0x7f3c9815add0 2023-08-09T12:54:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.022+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c80014780 con 0x7f3c9815add0 2023-08-09T12:54:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.022+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c981f39d0 con 0x7f3c9815add0 2023-08-09T12:54:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.022+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80014b30 con 0x7f3c9815add0 2023-08-09T12:54:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.022+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c980cb190 con 0x7f3c9815add0 2023-08-09T12:54:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.023+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c980cdf80 con 0x7f3c9815add0 2023-08-09T12:54:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.024+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c80014c90 con 0x7f3c9815add0 2023-08-09T12:54:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.025+0000 7f3c8effd640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c7806a050 0x7f3c7806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.025+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3c80088c70 con 0x7f3c9815add0 2023-08-09T12:54:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.025+0000 7f3c8effd640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f3c780704d0 0x7f3c780728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.025+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 --> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c78072fa0 con 0x7f3c780704d0 2023-08-09T12:54:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.025+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c8008e070 con 0x7f3c9815add0 2023-08-09T12:54:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.026+0000 7f3c9659c640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c7806a050 0x7f3c7806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.026+0000 7f3c96d9d640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f3c780704d0 0x7f3c780728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.027+0000 7f3c96d9d640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f3c780704d0 0x7f3c780728f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.027+0000 7f3c9659c640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c7806a050 0x7f3c7806c510 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3c88036000 tx=0x7f3c8803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.029+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 <== osd.7 v2:172.21.15.142:6816/3944800056 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f3c78072fa0 con 0x7f3c780704d0 2023-08-09T12:54:28.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.042+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 --> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3c980cdca0 con 0x7f3c780704d0 2023-08-09T12:54:28.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.043+0000 7f3c8effd640 1 -- 172.21.15.17:0/626398565 <== osd.7 v2:172.21.15.142:6816/3944800056 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f3c90001150 con 0x7f3c780704d0 2023-08-09T12:54:28.046 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-08-09T12:54:28.047 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-08-09T12:54:28.047 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-08-09T12:54:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f3c780704d0 msgr2=0x7f3c780728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6816/3944800056,v1:172.21.15.142:6817/3944800056] conn(0x7f3c780704d0 0x7f3c780728f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c7806a050 msgr2=0x7f3c7806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c7806a050 0x7f3c7806c510 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3c88036000 tx=0x7f3c8803b040 comp rx=0 tx=0).stop 2023-08-09T12:54:28.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 msgr2=0x7f3c980b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 --2- 172.21.15.17:0/626398565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c9815add0 0x7f3c980b25b0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f3c80007ef0 tx=0x7f3c8000e4b0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c96d9d640 1 -- 172.21.15.17:0/626398565 reap_dead start 2023-08-09T12:54:28.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 shutdown_connections 2023-08-09T12:54:28.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 >> 172.21.15.17:0/626398565 conn(0x7f3c980d2b50 msgr2=0x7f3c980b8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:28.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 shutdown_connections 2023-08-09T12:54:28.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.044+0000 7f3c9cecc640 1 -- 172.21.15.17:0/626398565 wait complete. 2023-08-09T12:54:28.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-09T12:54:28.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.284+0000 7fedaf9fd640 1 Processor -- start 2023-08-09T12:54:28.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.284+0000 7fedaf9fd640 1 -- start start 2023-08-09T12:54:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.286+0000 7fedaf9fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda815ce90 0x7feda81616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.286+0000 7fedaf9fd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feda80b6000 0x7feda80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.286+0000 7fedaf9fd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda80b6460 con 0x7feda80d29d0 2023-08-09T12:54:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.286+0000 7fedaf9fd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda80cda40 con 0x7feda80b6000 2023-08-09T12:54:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.286+0000 7fedaf9fd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda80cdd10 con 0x7feda815ce90 2023-08-09T12:54:28.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.286+0000 7fedacf98640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feda80b6000 0x7feda80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.287+0000 7fedacf98640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feda80b6000 0x7feda80cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50534/0 (socket says 172.21.15.17:50534) 2023-08-09T12:54:28.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.287+0000 7fedacf98640 1 -- 172.21.15.17:0/3153941442 learned_addr learned my addr 172.21.15.17:0/3153941442 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:28.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.287+0000 7fedad799640 1 --2- 172.21.15.17:0/3153941442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda815ce90 0x7feda81616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.287+0000 7fedacf98640 1 -- 172.21.15.17:0/3153941442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda815ce90 msgr2=0x7feda81616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:28.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.287+0000 7fedacf98640 1 --2- 172.21.15.17:0/3153941442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda815ce90 0x7feda81616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.287+0000 7fedacf98640 1 -- 172.21.15.17:0/3153941442 >> v1:172.21.15.142:6789/0 conn(0x7feda80d29d0 legacy=0x7feda80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.287+0000 7fedacf98640 1 -- 172.21.15.17:0/3153941442 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80cdff0 con 0x7feda80b6000 2023-08-09T12:54:28.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.287+0000 7fedad799640 1 --2- 172.21.15.17:0/3153941442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda815ce90 0x7feda81616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-09T12:54:28.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.289+0000 7fedacf98640 1 --2- 172.21.15.17:0/3153941442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda80b6000 0x7feda80cd500 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009870 tx=0x7fed9c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107e286a532680db server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.289+0000 7fed9bfff640 1 -- 172.21.15.17:0/3153941442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c030840 con 0x7feda80b6000 2023-08-09T12:54:28.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.289+0000 7fed9bfff640 1 -- 172.21.15.17:0/3153941442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c0309a0 con 0x7feda80b6000 2023-08-09T12:54:28.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.289+0000 7fed9bfff640 1 -- 172.21.15.17:0/3153941442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c030d30 con 0x7feda80b6000 2023-08-09T12:54:28.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.290+0000 7fedaf9fd640 1 -- 172.21.15.17:0/3153941442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda80b6000 msgr2=0x7feda80cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.290+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/3153941442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda80b6000 0x7feda80cd500 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009870 tx=0x7fed9c02b980 comp rx=0 tx=0).stop 2023-08-09T12:54:28.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.290+0000 7fedaf9fd640 1 -- 172.21.15.17:0/3153941442 shutdown_connections 2023-08-09T12:54:28.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.290+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/3153941442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda80b6000 0x7feda80cd500 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.290+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/3153941442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda815ce90 0x7feda81616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.290+0000 7fedaf9fd640 1 -- 172.21.15.17:0/3153941442 >> 172.21.15.17:0/3153941442 conn(0x7feda806fde0 msgr2=0x7feda80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:28.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.290+0000 7fedaf9fd640 1 -- 172.21.15.17:0/3153941442 shutdown_connections 2023-08-09T12:54:28.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.290+0000 7fedaf9fd640 1 -- 172.21.15.17:0/3153941442 wait complete. 2023-08-09T12:54:28.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.292+0000 7fedaf9fd640 1 Processor -- start 2023-08-09T12:54:28.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.292+0000 7fedaf9fd640 1 -- start start 2023-08-09T12:54:28.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedaf9fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda80b6000 0x7feda815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedaf9fd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feda80d29d0 0x7feda8159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedaf9fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda815ce90 0x7feda80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedaf9fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda80a9700 con 0x7feda815ce90 2023-08-09T12:54:28.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedaf9fd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda815e8b0 con 0x7feda80d29d0 2023-08-09T12:54:28.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedaf9fd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda815d310 con 0x7feda80b6000 2023-08-09T12:54:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedadf9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda815ce90 0x7feda80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedadf9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda815ce90 0x7feda80b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50548/0 (socket says 172.21.15.17:50548) 2023-08-09T12:54:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedadf9a640 1 -- 172.21.15.17:0/2051849895 learned_addr learned my addr 172.21.15.17:0/2051849895 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedad799640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda80b6000 0x7feda815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.293+0000 7fedacf98640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feda80d29d0 0x7feda8159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedadf9a640 1 -- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda80b6000 msgr2=0x7feda815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedadf9a640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda80b6000 0x7feda815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedadf9a640 1 -- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feda80d29d0 msgr2=0x7feda8159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedadf9a640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feda80d29d0 0x7feda8159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedadf9a640 1 -- 172.21.15.17:0/2051849895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0094d0 con 0x7feda815ce90 2023-08-09T12:54:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedacf98640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feda80d29d0 0x7feda8159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:28.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedadf9a640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda815ce90 0x7feda80b0fd0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7feda000c7a0 tx=0x7feda000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fed99ffb640 1 -- 172.21.15.17:0/2051849895 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0003b70 con 0x7feda815ce90 2023-08-09T12:54:28.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fed99ffb640 1 -- 172.21.15.17:0/2051849895 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0003cf0 con 0x7feda815ce90 2023-08-09T12:54:28.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fed99ffb640 1 -- 172.21.15.17:0/2051849895 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0003ea0 con 0x7feda815ce90 2023-08-09T12:54:28.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda815d5b0 con 0x7feda815ce90 2023-08-09T12:54:28.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.294+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda815db70 con 0x7feda815ce90 2023-08-09T12:54:28.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.295+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda8067a80 con 0x7feda815ce90 2023-08-09T12:54:28.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.296+0000 7fed99ffb640 1 -- 172.21.15.17:0/2051849895 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feda000aa90 con 0x7feda815ce90 2023-08-09T12:54:28.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.298+0000 7fed99ffb640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed8c06a050 0x7fed8c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.298+0000 7fed99ffb640 1 -- 172.21.15.17:0/2051849895 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7feda0088200 con 0x7feda815ce90 2023-08-09T12:54:28.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.298+0000 7fedad799640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed8c06a050 0x7fed8c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.300+0000 7fedad799640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed8c06a050 0x7fed8c06c510 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7feda81e8550 tx=0x7feda4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.302+0000 7fed99ffb640 1 -- 172.21.15.17:0/2051849895 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7feda0053ae0 con 0x7feda815ce90 2023-08-09T12:54:28.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.496+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7feda80d0fc0 con 0x7fed8c06a050 2023-08-09T12:54:28.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.497+0000 7fed99ffb640 1 -- 172.21.15.17:0/2051849895 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feda400b540 con 0x7fed8c06a050 2023-08-09T12:54:28.500 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 7 to deep-scrub 2023-08-09T12:54:28.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.499+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed8c06a050 msgr2=0x7fed8c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed8c06a050 0x7fed8c06c510 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7feda81e8550 tx=0x7feda4008040 comp rx=0 tx=0).stop 2023-08-09T12:54:28.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda815ce90 msgr2=0x7feda80b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda815ce90 0x7feda80b0fd0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7feda000c7a0 tx=0x7feda000cc60 comp rx=0 tx=0).stop 2023-08-09T12:54:28.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 shutdown_connections 2023-08-09T12:54:28.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fed8c06a050 0x7fed8c06c510 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda815ce90 0x7feda80b0fd0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feda80d29d0 0x7feda8159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 --2- 172.21.15.17:0/2051849895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feda80b6000 0x7feda815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 >> 172.21.15.17:0/2051849895 conn(0x7feda806fde0 msgr2=0x7feda80d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:28.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 shutdown_connections 2023-08-09T12:54:28.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.500+0000 7fedaf9fd640 1 -- 172.21.15.17:0/2051849895 wait complete. 2023-08-09T12:54:28.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:54:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.746+0000 7f59e1386640 1 Processor -- start 2023-08-09T12:54:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.746+0000 7f59e1386640 1 -- start start 2023-08-09T12:54:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.747+0000 7f59e1386640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59dc1601f0 0x7f59dc0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.747+0000 7f59e1386640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc0cb610 0x7f59dc0c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.748+0000 7f59e1386640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0b34a0 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.748+0000 7f59e1386640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0b4120 con 0x7f59dc1601f0 2023-08-09T12:54:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.748+0000 7f59e1386640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0b3780 con 0x7f59dc0cb610 2023-08-09T12:54:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.748+0000 7f59e0b85640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc0cb610 0x7f59dc0c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.748+0000 7f59db7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f59dc0b2ee0 0x7f59dc0caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.17:55346/0 (socket says 172.21.15.17:55346) 2023-08-09T12:54:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.748+0000 7f59db7fe640 1 -- 172.21.15.17:0/4154545259 learned_addr learned my addr 172.21.15.17:0/4154545259 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.748+0000 7f59dbfff640 1 --2- 172.21.15.17:0/4154545259 >> v2:172.21.15.142:3300/0 conn(0x7f59dc1601f0 0x7f59dc0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.749+0000 7f59e0b85640 1 -- 172.21.15.17:0/4154545259 >> v2:172.21.15.142:3300/0 conn(0x7f59dc1601f0 msgr2=0x7f59dc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:28.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.749+0000 7f59e0b85640 1 --2- 172.21.15.17:0/4154545259 >> v2:172.21.15.142:3300/0 conn(0x7f59dc1601f0 0x7f59dc0b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.749+0000 7f59e0b85640 1 -- 172.21.15.17:0/4154545259 >> v1:172.21.15.142:6789/0 conn(0x7f59dc0b2ee0 legacy=0x7f59dc0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.749+0000 7f59e0b85640 1 -- 172.21.15.17:0/4154545259 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0b3a60 con 0x7f59dc0cb610 2023-08-09T12:54:28.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.749+0000 7f59dbfff640 1 --2- 172.21.15.17:0/4154545259 >> v2:172.21.15.142:3300/0 conn(0x7f59dc1601f0 0x7f59dc0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-09T12:54:28.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.749+0000 7f59daffd640 1 -- 172.21.15.17:0/4154545259 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179756279 0 0) 0x7f59dc0b34a0 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.751+0000 7f59e0b85640 1 --2- 172.21.15.17:0/4154545259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc0cb610 0x7f59dc0c2240 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009d90 tx=0x7f59d402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a64995e038f9aa82 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.751+0000 7f59daffd640 1 -- 172.21.15.17:0/4154545259 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d402cc50 con 0x7f59dc0cb610 2023-08-09T12:54:28.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.751+0000 7f59daffd640 1 -- 172.21.15.17:0/4154545259 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d402cdb0 con 0x7f59dc0cb610 2023-08-09T12:54:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.751+0000 7f59daffd640 1 -- 172.21.15.17:0/4154545259 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4034660 con 0x7f59dc0cb610 2023-08-09T12:54:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.752+0000 7f59e1386640 1 -- 172.21.15.17:0/4154545259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc0cb610 msgr2=0x7f59dc0c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.752+0000 7f59e1386640 1 --2- 172.21.15.17:0/4154545259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc0cb610 0x7f59dc0c2240 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009d90 tx=0x7f59d402bea0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.752+0000 7f59e1386640 1 -- 172.21.15.17:0/4154545259 shutdown_connections 2023-08-09T12:54:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.752+0000 7f59e1386640 1 --2- 172.21.15.17:0/4154545259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc0cb610 0x7f59dc0c2240 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.752+0000 7f59e1386640 1 --2- 172.21.15.17:0/4154545259 >> v2:172.21.15.142:3300/0 conn(0x7f59dc1601f0 0x7f59dc0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.752+0000 7f59e1386640 1 -- 172.21.15.17:0/4154545259 >> 172.21.15.17:0/4154545259 conn(0x7f59dc0b1d50 msgr2=0x7f59dc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.752+0000 7f59e1386640 1 -- 172.21.15.17:0/4154545259 shutdown_connections 2023-08-09T12:54:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.752+0000 7f59e1386640 1 -- 172.21.15.17:0/4154545259 wait complete. 2023-08-09T12:54:28.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.754+0000 7f59e1386640 1 Processor -- start 2023-08-09T12:54:28.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.754+0000 7f59e1386640 1 -- start start 2023-08-09T12:54:28.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59e1386640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59dc0b2ee0 0x7f59dc158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59e1386640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59dc0cb610 0x7f59dc15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59e1386640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc1601f0 0x7f59dc152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59e1386640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc06ec90 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59e1386640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc06ef70 con 0x7f59dc0cb610 2023-08-09T12:54:28.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59e1386640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc15d460 con 0x7f59dc1601f0 2023-08-09T12:54:28.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59dc0b2ee0 0x7f59dc158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59dc0b2ee0 0x7f59dc158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50550/0 (socket says 172.21.15.17:50550) 2023-08-09T12:54:28.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.755+0000 7f59dbfff640 1 -- 172.21.15.17:0/3901933272 learned_addr learned my addr 172.21.15.17:0/3901933272 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:28.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59e0b85640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc1601f0 0x7f59dc152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59db7fe640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59dc0cb610 0x7f59dc15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59dbfff640 1 -- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc1601f0 msgr2=0x7f59dc152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59dbfff640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc1601f0 0x7f59dc152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59dbfff640 1 -- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59dc0cb610 msgr2=0x7f59dc15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59dbfff640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59dc0cb610 0x7f59dc15cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59dbfff640 1 -- 172.21.15.17:0/3901933272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc009400 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59e0b85640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc1601f0 0x7f59dc152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59dbfff640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59dc0b2ee0 0x7f59dc158830 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00e990 tx=0x7f59cc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59d8ff9640 1 -- 172.21.15.17:0/3901933272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00c9e0 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59d8ff9640 1 -- 172.21.15.17:0/3901933272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc00cb40 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d4009a70 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.756+0000 7f59d8ff9640 1 -- 172.21.15.17:0/3901933272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00ced0 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.757+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc152fe0 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.758+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc04e390 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.759+0000 7f59d8ff9640 1 -- 172.21.15.17:0/3901933272 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f59cc013470 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.760+0000 7f59d8ff9640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c806a050 0x7f59c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:28.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.760+0000 7f59d8ff9640 1 -- 172.21.15.17:0/3901933272 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f59cc088590 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.761+0000 7f59db7fe640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c806a050 0x7f59c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.762+0000 7f59db7fe640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c806a050 0x7f59c806c510 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f59d0007fd0 tx=0x7f59d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:28.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.765+0000 7f59d8ff9640 1 -- 172.21.15.17:0/3901933272 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f59cc057990 con 0x7f59dc0b2ee0 2023-08-09T12:54:28.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.951+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59dc1605d0 con 0x7f59c806a050 2023-08-09T12:54:28.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.958+0000 7f59d8ff9640 1 -- 172.21.15.17:0/3901933272 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67826 (secure 0 0 0) 0x7f59d0001c70 con 0x7f59c806a050 2023-08-09T12:54:28.962 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:28.963 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:54:28.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.960+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c806a050 msgr2=0x7f59c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.960+0000 7f59e1386640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c806a050 0x7f59c806c510 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f59d0007fd0 tx=0x7f59d0009040 comp rx=0 tx=0).stop 2023-08-09T12:54:28.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.960+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59dc0b2ee0 msgr2=0x7f59dc158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:28.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.960+0000 7f59e1386640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59dc0b2ee0 0x7f59dc158830 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00e990 tx=0x7f59cc00ee50 comp rx=0 tx=0).stop 2023-08-09T12:54:28.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.961+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 shutdown_connections 2023-08-09T12:54:28.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.961+0000 7f59e1386640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f59c806a050 0x7f59c806c510 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.961+0000 7f59e1386640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59dc1601f0 0x7f59dc152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.961+0000 7f59e1386640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59dc0cb610 0x7f59dc15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.961+0000 7f59e1386640 1 --2- 172.21.15.17:0/3901933272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59dc0b2ee0 0x7f59dc158830 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:28.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.961+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 >> 172.21.15.17:0/3901933272 conn(0x7f59dc0b1d50 msgr2=0x7f59dc155280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:28.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.961+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 shutdown_connections 2023-08-09T12:54:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:28.961+0000 7f59e1386640 1 -- 172.21.15.17:0/3901933272 wait complete. 2023-08-09T12:54:28.986 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":649,"stamp":"2023-08-09T12:54:26.983756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552046,"statfs":{"total":1600000000,"available":1589295568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.763404"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":518,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.236579+0000","last_change":"2023-08-09T12:39:14.442129+0000","last_active":"2023-08-09T12:54:16.236579+0000","last_peered":"2023-08-09T12:54:16.236579+0000","last_clean":"2023-08-09T12:54:16.236579+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:54:16.236579+0000","last_undegraded":"2023-08-09T12:54:16.236579+0000","last_fullsized":"2023-08-09T12:54:16.236579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:13.146498+0000","last_clean_scrub_stamp":"2023-08-09T12:39:13.146498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:19:40.258128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.234091+0000","last_change":"2023-08-09T12:39:19.299752+0000","last_active":"2023-08-09T12:54:16.234091+0000","last_peered":"2023-08-09T12:54:16.234091+0000","last_clean":"2023-08-09T12:54:16.234091+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:54:16.234091+0000","last_undegraded":"2023-08-09T12:54:16.234091+0000","last_fullsized":"2023-08-09T12:54:16.234091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:44:27.556881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":362,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.235474+0000","last_change":"2023-08-09T12:39:19.301671+0000","last_active":"2023-08-09T12:54:16.235474+0000","last_peered":"2023-08-09T12:54:16.235474+0000","last_clean":"2023-08-09T12:54:16.235474+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:54:16.235474+0000","last_undegraded":"2023-08-09T12:54:16.235474+0000","last_fullsized":"2023-08-09T12:54:16.235474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:40:46.960577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":336,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.229044+0000","last_change":"2023-08-09T12:39:19.483369+0000","last_active":"2023-08-09T12:54:16.229044+0000","last_peered":"2023-08-09T12:54:16.229044+0000","last_clean":"2023-08-09T12:54:16.229044+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:54:16.229044+0000","last_undegraded":"2023-08-09T12:54:16.229044+0000","last_fullsized":"2023-08-09T12:54:16.229044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T13:28:16.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.238458+0000","last_change":"2023-08-09T12:39:19.301872+0000","last_active":"2023-08-09T12:54:16.238458+0000","last_peered":"2023-08-09T12:54:16.238458+0000","last_clean":"2023-08-09T12:54:16.238458+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:54:16.238458+0000","last_undegraded":"2023-08-09T12:54:16.238458+0000","last_fullsized":"2023-08-09T12:54:16.238458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:10:49.882949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":333,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.232730+0000","last_change":"2023-08-09T12:39:19.300520+0000","last_active":"2023-08-09T12:54:16.232730+0000","last_peered":"2023-08-09T12:54:16.232730+0000","last_clean":"2023-08-09T12:54:16.232730+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:54:16.232730+0000","last_undegraded":"2023-08-09T12:54:16.232730+0000","last_fullsized":"2023-08-09T12:54:16.232730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":362,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.235273+0000","last_change":"2023-08-09T12:39:19.292249+0000","last_active":"2023-08-09T12:54:16.235273+0000","last_peered":"2023-08-09T12:54:16.235273+0000","last_clean":"2023-08-09T12:54:16.235273+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:54:16.235273+0000","last_undegraded":"2023-08-09T12:54:16.235273+0000","last_fullsized":"2023-08-09T12:54:16.235273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T12:53:54.620759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.245942+0000","last_change":"2023-08-09T12:39:19.300854+0000","last_active":"2023-08-09T12:54:16.245942+0000","last_peered":"2023-08-09T12:54:16.245942+0000","last_clean":"2023-08-09T12:54:16.245942+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:54:16.245942+0000","last_undegraded":"2023-08-09T12:54:16.245942+0000","last_fullsized":"2023-08-09T12:54:16.245942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:16.239727+0000","last_change":"2023-08-09T12:39:19.293281+0000","last_active":"2023-08-09T12:54:16.239727+0000","last_peered":"2023-08-09T12:54:16.239727+0000","last_clean":"2023-08-09T12:54:16.239727+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:54:16.239727+0000","last_undegraded":"2023-08-09T12:54:16.239727+0000","last_fullsized":"2023-08-09T12:54:16.239727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:39:18.263312+0000","last_clean_scrub_stamp":"2023-08-09T12:39:18.263312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:41:05.481490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193573,"statfs":{"total":200000000,"available":198219170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1899999999999999,"15min":1.1399999999999999},"min":{"1min":0.71099999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5309999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.159,"15min":1.1259999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":1.4950000000000001,"5min":1.615,"15min":2.0459999999999998},"last":0.94399999999999995}]},{"osd":1,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.222,"15min":1.2},"min":{"1min":0.70599999999999996,"5min":0.628,"15min":0.628},"max":{"1min":1.657,"5min":1.6870000000000001,"15min":2.0859999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2210000000000001,"15min":1.1819999999999999},"min":{"1min":0.74299999999999999,"5min":0.69299999999999995,"15min":0.39300000000000002},"max":{"1min":1.6950000000000001,"5min":1.752,"15min":1.778},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.306,"15min":1.266},"min":{"1min":0.80600000000000005,"5min":0.73099999999999998,"15min":0.496},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":1.093},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.2529999999999999,"15min":1.22},"min":{"1min":0.80000000000000004,"5min":0.76900000000000002,"15min":0.69799999999999995},"max":{"1min":1.5920000000000001,"5min":1.6579999999999999,"15min":2.173},"last":0.71999999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3080000000000001,"15min":1.3009999999999999},"min":{"1min":0.79800000000000004,"5min":0.78500000000000003,"15min":0.72299999999999998},"max":{"1min":1.79,"5min":1.806,"15min":3.4540000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.304,"15min":1.3160000000000001},"min":{"1min":0.84799999999999998,"5min":0.754,"15min":0.61599999999999999},"max":{"1min":1.53,"5min":1.71,"15min":2.282},"last":1.05}]},{"osd":4,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1859999999999999,"15min":1.2330000000000001},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.48499999999999999},"max":{"1min":1.611,"5min":1.873,"15min":2.8769999999999998},"last":0.499},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3240000000000001,"15min":1.351},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":4.6200000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.4039999999999999,"15min":1.399},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.702,"5min":1.8520000000000001,"15min":2.802},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.462,"5min":1.484,"15min":1.506},"min":{"1min":0.82799999999999996,"5min":0.749,"15min":0.72299999999999998},"max":{"1min":1.7529999999999999,"5min":1.8300000000000001,"15min":3.3580000000000001},"last":0.53200000000000003}]},{"osd":6,"last update":"Wed Aug 9 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.4370000000000001,"15min":1.478},"min":{"1min":0.76000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.696,"5min":1.998,"15min":3.4910000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4690000000000001,"15min":1.49},"min":{"1min":0.69799999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.7350000000000001,"5min":1.8680000000000001,"15min":2.4039999999999999},"last":0.68000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1259999999999999,"15min":1.1439999999999999},"min":{"1min":0.80800000000000005,"5min":0.68400000000000005,"15min":0.56399999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":2.54},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.159,"15min":1.121},"min":{"1min":0.626,"5min":0.626,"15min":0.54000000000000004},"max":{"1min":1.5109999999999999,"5min":1.6859999999999999,"15min":2.1629999999999998},"last":1.3069999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.337,"15min":1.2689999999999999},"min":{"1min":0.80400000000000005,"5min":0.73999999999999999,"15min":0.66500000000000004},"max":{"1min":1.8089999999999999,"5min":1.9219999999999999,"15min":2.306},"last":1.006},{"interface":"front","average":{"1min":1.399,"5min":1.3779999999999999,"15min":1.341},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.675,"5min":1.881,"15min":1.9279999999999999},"last":1.1850000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.169},"min":{"1min":0.871,"5min":0.74399999999999999,"15min":0.66900000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.304,"15min":1.2949999999999999},"min":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.66300000000000003},"max":{"1min":1.6040000000000001,"5min":1.8580000000000001,"15min":2.6499999999999999},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3759999999999999,"15min":1.333},"min":{"1min":0.745,"5min":0.745,"15min":0.67600000000000005},"max":{"1min":1.756,"5min":1.845,"15min":2.327},"last":1.079},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3779999999999999,"15min":1.3540000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.74099999999999999},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.5979999999999999},"last":1.5249999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3420000000000001,"15min":1.377},"min":{"1min":0.85999999999999999,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":1.837,"5min":1.9910000000000001,"15min":11.058999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.4059999999999999,"15min":1.3819999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.57399999999999995},"max":{"1min":1.7749999999999999,"5min":2.0179999999999998,"15min":2.3479999999999999},"last":1.498}]},{"osd":5,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.353,"15min":1.365},"min":{"1min":0.94599999999999995,"5min":0.89800000000000002,"15min":0.77600000000000002},"max":{"1min":1.9099999999999999,"5min":1.96,"15min":2.5249999999999999},"last":1.585},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.512,"15min":1.512},"min":{"1min":1.028,"5min":0.94399999999999995,"15min":0.81899999999999995},"max":{"1min":1.9039999999999999,"5min":2.077,"15min":2.8580000000000001},"last":1.4259999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.5669999999999999,"15min":1.536},"min":{"1min":1.234,"5min":1.1100000000000001,"15min":0.59099999999999997},"max":{"1min":1.9630000000000001,"5min":2.093,"15min":2.7999999999999998},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.528,"5min":1.542,"15min":1.524},"min":{"1min":1.1970000000000001,"5min":1.0469999999999999,"15min":0.74399999999999999},"max":{"1min":2.0870000000000002,"5min":2.1280000000000001,"15min":3.621},"last":1.633}]}]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1459999999999999,"15min":1.119},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.4830000000000001,"5min":1.609,"15min":3.4060000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.2010000000000001,"15min":1.171},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.625},"max":{"1min":1.5469999999999999,"5min":1.8460000000000001,"15min":2.0600000000000001},"last":1.123}]},{"osd":1,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.379,"15min":1.3480000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.63800000000000001},"max":{"1min":2.048,"5min":2.048,"15min":2.6579999999999999},"last":1.325},{"interface":"front","average":{"1min":1.371,"5min":1.375,"15min":1.306},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.70199999999999996},"max":{"1min":1.9179999999999999,"5min":2.262,"15min":2.262},"last":1.5800000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.96199999999999997,"5min":0.76800000000000002,"15min":0.69799999999999995},"max":{"1min":1.8260000000000001,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.264},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2829999999999999,"15min":1.2350000000000001},"min":{"1min":0.746,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.8149999999999999},"last":1.758}]},{"osd":3,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.3069999999999999,"15min":1.288},"min":{"1min":0.999,"5min":0.81100000000000005,"15min":0.71799999999999997},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.2330000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.377,"15min":1.373},"min":{"1min":0.95199999999999996,"5min":0.93000000000000005,"15min":0.78200000000000003},"max":{"1min":1.716,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.391}]},{"osd":4,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2969999999999999,"15min":1.282},"min":{"1min":0.92400000000000004,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.698,"5min":2.169,"15min":4.6920000000000002},"last":1.629},{"interface":"front","average":{"1min":1.45,"5min":1.407,"15min":1.399},"min":{"1min":1.1160000000000001,"5min":0.875,"15min":0.628},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":3.3109999999999999},"last":1.446}]},{"osd":6,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4590000000000001,"15min":1.4119999999999999},"min":{"1min":1.0920000000000001,"5min":1.0049999999999999,"15min":0.58099999999999996},"max":{"1min":2.0259999999999998,"5min":2.7719999999999998,"15min":2.952},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.5,"15min":1.478},"min":{"1min":1.127,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":2.0179999999999998,"5min":2.1059999999999999,"15min":5.8570000000000002},"last":1.8169999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.556,"15min":1.538},"min":{"1min":1.3200000000000001,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":2.302,"5min":2.302,"15min":3.4590000000000001},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6120000000000001,"15min":1.5840000000000001},"min":{"1min":1.3340000000000001,"5min":1.121,"15min":0.65300000000000002},"max":{"1min":2.2069999999999999,"5min":2.8849999999999998,"15min":3.0649999999999999},"last":1.7929999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.123,"15min":1.115},"min":{"1min":0.747,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":1.986,"15min":2.5670000000000002},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.72199999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":3.4100000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.296,"15min":1.29},"min":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.6399999999999999,"5min":1.8180000000000001,"15min":2.3679999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3380000000000001,"15min":1.335},"min":{"1min":0.96699999999999997,"5min":0.84099999999999997,"15min":0.71999999999999997},"max":{"1min":1.889,"5min":1.889,"15min":2.9590000000000001},"last":1.327}]},{"osd":2,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.3640000000000001,"15min":1.331},"min":{"1min":0.92000000000000004,"5min":0.81499999999999995,"15min":0.54900000000000004},"max":{"1min":1.6779999999999999,"5min":1.865,"15min":2.4729999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.363,"15min":1.3480000000000001},"min":{"1min":1.004,"5min":0.91300000000000003,"15min":0.67900000000000005},"max":{"1min":1.6679999999999999,"5min":1.887,"15min":3.0579999999999998},"last":1.4670000000000001}]},{"osd":3,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.226,"15min":1.256},"min":{"1min":0.82699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5329999999999999,"5min":1.6559999999999999,"15min":3.4430000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3480000000000001,"15min":1.337},"min":{"1min":1.02,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":2.5289999999999999},"last":1.264}]},{"osd":5,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3200000000000001,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.67700000000000005,"15min":0.55900000000000005},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":3.137},"last":1.7270000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.306,"15min":1.3560000000000001},"min":{"1min":0.76800000000000002,"5min":0.63300000000000001,"15min":0.623},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":3.3620000000000001},"last":1.21}]},{"osd":6,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.3640000000000001,"15min":1.411},"min":{"1min":1.087,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.5819999999999999},"last":1.504},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.486,"15min":1.518},"min":{"1min":1.1319999999999999,"5min":0.748,"15min":0.65200000000000002},"max":{"1min":1.952,"5min":1.952,"15min":3.3340000000000001},"last":2.0720000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4450000000000001,"15min":1.506},"min":{"1min":0.995,"5min":0.72799999999999998,"15min":0.68999999999999995},"max":{"1min":1.853,"5min":1.853,"15min":3.4900000000000002},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.552,"15min":1.579},"min":{"1min":1.2609999999999999,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.875},"last":1.579}]}]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.89600000000000002,"15min":0.877},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.29199999999999998},"max":{"1min":1.381,"5min":1.494,"15min":4.4109999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0409999999999999,"15min":1.006},"min":{"1min":0.41899999999999998,"5min":0.38600000000000001,"15min":0.35499999999999998},"max":{"1min":1.2729999999999999,"5min":1.99,"15min":3.2269999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.38100000000000001},"max":{"1min":1.456,"5min":1.4830000000000001,"15min":2.1280000000000001},"last":1.212},{"interface":"front","average":{"1min":1,"5min":1.159,"15min":1.0920000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.33900000000000002},"max":{"1min":1.5820000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.93500000000000005}]},{"osd":2,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2,"15min":1.1919999999999999},"min":{"1min":0.63600000000000001,"5min":0.47999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6870000000000001,"5min":2.089,"15min":18.145},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2729999999999999,"15min":1.2330000000000001},"min":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.379},"max":{"1min":1.663,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.288}]},{"osd":4,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2869999999999999,"15min":1.296},"min":{"1min":0.79500000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.895,"5min":1.905,"15min":3.5110000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.401,"15min":1.3420000000000001},"min":{"1min":1.0089999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5940000000000001,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.147}]},{"osd":5,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.51,"15min":1.4750000000000001},"min":{"1min":1.044,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":1.845,"5min":2.302,"15min":18.094000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.454,"15min":1.4590000000000001},"min":{"1min":0.879,"5min":0.80900000000000005,"15min":0.69899999999999995},"max":{"1min":1.7350000000000001,"5min":2.1150000000000002,"15min":14.105},"last":1.4139999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.413,"15min":1.387},"min":{"1min":0.80100000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":3.2789999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5429999999999999,"15min":1.4810000000000001},"min":{"1min":0.96899999999999997,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.3730000000000002,"15min":4.0220000000000002},"last":1.2689999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5600000000000001,"15min":1.4910000000000001},"min":{"1min":1.0169999999999999,"5min":0.88600000000000001,"15min":0.72499999999999998},"max":{"1min":1.9650000000000001,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.522,"15min":1.47},"min":{"1min":0.86099999999999999,"5min":0.71799999999999997,"15min":0.70799999999999996},"max":{"1min":1.774,"5min":2.3380000000000001,"15min":3.016},"last":1.5980000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.94099999999999995,"15min":0.89300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":1.3300000000000001,"5min":1.673,"15min":1.716},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.022,"15min":0.98699999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.38900000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":2.9009999999999998},"last":0.93100000000000005}]},{"osd":1,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.36299999999999999},"max":{"1min":1.2669999999999999,"5min":1.5149999999999999,"15min":1.8700000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1359999999999999,"15min":1.0740000000000001},"min":{"1min":0.58099999999999996,"5min":0.501,"15min":0.46899999999999997},"max":{"1min":1.625,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1679999999999999,"15min":1.1539999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.46600000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":3.2850000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3089999999999999,"15min":1.2190000000000001},"min":{"1min":0.64700000000000002,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.7689999999999999,"5min":1.8839999999999999,"15min":2.9409999999999998},"last":0.83899999999999997}]},{"osd":4,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.512,"15min":1.4550000000000001},"min":{"1min":1.0800000000000001,"5min":0.95499999999999996,"15min":0.81899999999999995},"max":{"1min":1.8140000000000001,"5min":1.9870000000000001,"15min":3.3300000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3979999999999999,"15min":1.3520000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.66800000000000004},"max":{"1min":1.7490000000000001,"5min":2.109,"15min":3.4500000000000002},"last":1.4510000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.4139999999999999,"15min":1.403},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.69599999999999995},"max":{"1min":1.7549999999999999,"5min":1.95,"15min":5.0140000000000002},"last":1.504},{"interface":"front","average":{"1min":1.474,"5min":1.5880000000000001,"15min":1.508},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.78700000000000003},"max":{"1min":1.9179999999999999,"5min":2.133,"15min":4.806},"last":1.4119999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.405,"15min":1.367},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.67500000000000004},"max":{"1min":1.8540000000000001,"5min":1.976,"15min":2.5179999999999998},"last":1.607},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4990000000000001,"15min":1.46},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.73399999999999999},"max":{"1min":1.79,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.381}]},{"osd":7,"last update":"Wed Aug 9 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4610000000000001,"15min":1.4219999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.76200000000000001},"max":{"1min":1.867,"5min":1.9510000000000001,"15min":2.464},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.593,"15min":1.55},"min":{"1min":1.03,"5min":1.03,"15min":0.69299999999999995},"max":{"1min":1.8620000000000001,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.5700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575033,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5469999999999999,"5min":1.6859999999999999,"15min":2.621},"last":1.423},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.3380000000000001},"min":{"1min":0.52700000000000002,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.778,"5min":1.778,"15min":88.254999999999995},"last":0.90100000000000002}]},{"osd":2,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.0029999999999999},"min":{"1min":0.55900000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.6679999999999999,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":1.353},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.325,"15min":1.2549999999999999},"min":{"1min":0.65100000000000002,"5min":0.55100000000000005,"15min":0.45900000000000002},"max":{"1min":1.629,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.708}]},{"osd":3,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.2370000000000001,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.6599999999999999,"5min":2.181,"15min":2.181},"last":1.8799999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1719999999999999,"15min":1.107},"min":{"1min":0.56499999999999995,"5min":0.53600000000000003,"15min":0.503},"max":{"1min":1.863,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.298}]},{"osd":4,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2749999999999999,"15min":1.3420000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.921,"15min":25.172000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.4179999999999999,"15min":1.381},"min":{"1min":0.81299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6739999999999999,"5min":1.9259999999999999,"15min":3.762},"last":1.2370000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.419,"15min":1.4590000000000001},"min":{"1min":0.85999999999999999,"5min":0.80100000000000005,"15min":0.751},"max":{"1min":1.859,"5min":2.1859999999999999,"15min":28.710000000000001},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.333,"15min":1.331},"min":{"1min":0.97299999999999998,"5min":0.876,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":1.9079999999999999,"15min":3.762},"last":1.6439999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.5740000000000001,"15min":1.5049999999999999},"min":{"1min":0.96899999999999997,"5min":0.93600000000000005,"15min":0.79700000000000004},"max":{"1min":1.913,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.486},{"interface":"front","average":{"1min":1.397,"5min":1.4990000000000001,"15min":1.4510000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.79500000000000004},"max":{"1min":1.9279999999999999,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.8180000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.579,"15min":1.6379999999999999},"min":{"1min":0.94199999999999995,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8420000000000001,"5min":2.4390000000000001,"15min":26.975999999999999},"last":1.978},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.6359999999999999,"15min":1.663},"min":{"1min":1.0680000000000001,"5min":0.92600000000000005,"15min":0.65600000000000003},"max":{"1min":2.1949999999999998,"5min":2.464,"15min":28.765000000000001},"last":1.7689999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193573,"statfs":{"total":200000000,"available":198219170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.88,"15min":0.88800000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.35799999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.819},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.087,"15min":1.042},"min":{"1min":0.54000000000000004,"5min":0.437,"15min":0.436},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":6.1749999999999998},"last":0.78600000000000003}]},{"osd":2,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.099,"15min":1.0349999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.7669999999999999},"last":0.751},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1100000000000001,"15min":1.089},"min":{"1min":0.59999999999999998,"5min":0.54500000000000004,"15min":0.5},"max":{"1min":1.736,"5min":1.7410000000000001,"15min":6.2549999999999999},"last":0.85799999999999998}]},{"osd":3,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.032,"15min":1.0309999999999999},"min":{"1min":0.63800000000000001,"5min":0.52400000000000002,"15min":0.45300000000000001},"max":{"1min":1.2889999999999999,"5min":1.893,"15min":9.6069999999999993},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.2470000000000001,"15min":1.212},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56000000000000005},"max":{"1min":1.962,"5min":1.962,"15min":2.2730000000000001},"last":0.995}]},{"osd":4,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.397,"15min":1.365},"min":{"1min":0.99399999999999999,"5min":0.871,"15min":0.79500000000000004},"max":{"1min":1.726,"5min":2.286,"15min":9.9629999999999992},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.456,"15min":1.381},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.77900000000000003},"max":{"1min":3.2759999999999998,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.6240000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.387,"15min":1.3660000000000001},"min":{"1min":0.94899999999999995,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":10.004},"last":1.177},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4930000000000001,"15min":1.4379999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.84999999999999998},"max":{"1min":1.8520000000000001,"5min":2.1419999999999999,"15min":2.161},"last":1.446}]},{"osd":6,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.458,"15min":1.4239999999999999},"min":{"1min":0.78000000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":6.4290000000000003},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.48,"5min":1.51,"15min":1.4810000000000001},"min":{"1min":0.86299999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.294,"5min":2.294,"15min":9.9190000000000005},"last":1.4239999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:53:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.524,"15min":1.5149999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.73699999999999999},"max":{"1min":3.5920000000000001,"5min":3.5920000000000001,"15min":18.114000000000001},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.577,"15min":1.54},"min":{"1min":1.034,"5min":0.84099999999999997,"15min":0.82299999999999995},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":9.5640000000000001},"last":1.4710000000000001}]}]}],"pool_statfs":[]}} 2023-08-09T12:54:28.991 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-09T12:39:13.146498+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=13, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.991 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-09T12:39:18.263312+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=18, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.992 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-09T12:39:18.263312+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=18, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.992 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-08-09T12:39:18.263312+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=18, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.992 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-09T12:39:18.263312+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=18, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.992 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-09T12:39:18.263312+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=18, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.993 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-09T12:39:18.263312+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=18, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.993 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-09T12:39:18.263312+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=18, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.993 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-09T12:39:18.263312+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=39, tm_sec=18, tm_wday=2, tm_yday=221, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=9, tm_hour=12, tm_min=54, tm_sec=21, tm_wday=2, tm_yday=221, tm_isdst=0) 2023-08-09T12:54:28.993 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-09T12:54:44.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:54:44.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:54:48.994 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-09T12:54:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.229+0000 7f3cbffcb640 1 Processor -- start 2023-08-09T12:54:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.230+0000 7f3cbffcb640 1 -- start start 2023-08-09T12:54:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.231+0000 7f3cbffcb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3cb815ce90 0x7f3cb81616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.231+0000 7f3cbffcb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 0x7f3cb80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.231+0000 7f3cbffcb640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb80b6460 con 0x7f3cb80d29d0 2023-08-09T12:54:49.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.231+0000 7f3cbffcb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb80cda40 con 0x7f3cb815ce90 2023-08-09T12:54:49.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.231+0000 7f3cbffcb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80cdd10 con 0x7f3cb80b6000 2023-08-09T12:54:49.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbe568640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3cb80d29d0 0x7f3cb80d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38010/0 (socket says 172.21.15.17:38010) 2023-08-09T12:54:49.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbe568640 1 -- 172.21.15.17:0/1435911801 learned_addr learned my addr 172.21.15.17:0/1435911801 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbdd67640 1 --2- 172.21.15.17:0/1435911801 >> v2:172.21.15.17:3300/0 conn(0x7f3cb815ce90 0x7f3cb81616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbd566640 1 --2- 172.21.15.17:0/1435911801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 0x7f3cb80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbcd65640 1 -- 172.21.15.17:0/1435911801 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830227704 0 0) 0x7f3cb80b6460 con 0x7f3cb80d29d0 2023-08-09T12:54:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbcd65640 1 -- 172.21.15.17:0/1435911801 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca4003520 con 0x7f3cb80d29d0 2023-08-09T12:54:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbdd67640 1 -- 172.21.15.17:0/1435911801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 msgr2=0x7f3cb80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbdd67640 1 --2- 172.21.15.17:0/1435911801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 0x7f3cb80cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbdd67640 1 -- 172.21.15.17:0/1435911801 >> v1:172.21.15.17:6789/0 conn(0x7f3cb80d29d0 legacy=0x7f3cb80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.232+0000 7f3cbdd67640 1 -- 172.21.15.17:0/1435911801 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb80cdff0 con 0x7f3cb815ce90 2023-08-09T12:54:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.234+0000 7f3cbdd67640 1 --2- 172.21.15.17:0/1435911801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb815ce90 0x7f3cb81616e0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009d90 tx=0x7f3cb402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2a696b0e36a4a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.234+0000 7f3cbcd65640 1 -- 172.21.15.17:0/1435911801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb402cc50 con 0x7f3cb815ce90 2023-08-09T12:54:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.234+0000 7f3cbcd65640 1 -- 172.21.15.17:0/1435911801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb402cdb0 con 0x7f3cb815ce90 2023-08-09T12:54:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.234+0000 7f3cbcd65640 1 -- 172.21.15.17:0/1435911801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4034640 con 0x7f3cb815ce90 2023-08-09T12:54:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.234+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1435911801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb815ce90 msgr2=0x7f3cb81616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.234+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1435911801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb815ce90 0x7f3cb81616e0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009d90 tx=0x7f3cb402bea0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.235+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1435911801 shutdown_connections 2023-08-09T12:54:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.235+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1435911801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 0x7f3cb80cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.235+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1435911801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb815ce90 0x7f3cb81616e0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.235+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1435911801 >> 172.21.15.17:0/1435911801 conn(0x7f3cb806fde0 msgr2=0x7f3cb80701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.235+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1435911801 shutdown_connections 2023-08-09T12:54:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.235+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1435911801 wait complete. 2023-08-09T12:54:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.236+0000 7f3cbffcb640 1 Processor -- start 2023-08-09T12:54:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.237+0000 7f3cbffcb640 1 -- start start 2023-08-09T12:54:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbffcb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 0x7f3cb80cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbffcb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb80d29d0 0x7f3cb81f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbffcb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cb815ce90 0x7f3cb815fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbffcb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb815e1f0 con 0x7f3cb80d29d0 2023-08-09T12:54:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbffcb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb815e4d0 con 0x7f3cb815ce90 2023-08-09T12:54:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbffcb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb815e7b0 con 0x7f3cb80b6000 2023-08-09T12:54:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbd566640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb80d29d0 0x7f3cb81f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbd566640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb80d29d0 0x7f3cb81f5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44362/0 (socket says 172.21.15.17:44362) 2023-08-09T12:54:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbd566640 1 -- 172.21.15.17:0/1410750350 learned_addr learned my addr 172.21.15.17:0/1410750350 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbdd67640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 0x7f3cb80cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbd566640 1 -- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 msgr2=0x7f3cb80cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbd566640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 0x7f3cb80cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbd566640 1 -- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cb815ce90 msgr2=0x7f3cb815fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbe568640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cb815ce90 0x7f3cb815fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbd566640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cb815ce90 0x7f3cb815fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbd566640 1 -- 172.21.15.17:0/1410750350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4009a70 con 0x7f3cb80d29d0 2023-08-09T12:54:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.238+0000 7f3cbe568640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cb815ce90 0x7f3cb815fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.239+0000 7f3cbd566640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb80d29d0 0x7f3cb81f5620 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800d800 tx=0x7f3ca800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.239+0000 7f3cae7fc640 1 -- 172.21.15.17:0/1410750350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800b6c0 con 0x7f3cb80d29d0 2023-08-09T12:54:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.239+0000 7f3cae7fc640 1 -- 172.21.15.17:0/1410750350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca800b820 con 0x7f3cb80d29d0 2023-08-09T12:54:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.239+0000 7f3cae7fc640 1 -- 172.21.15.17:0/1410750350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800bbb0 con 0x7f3cb80d29d0 2023-08-09T12:54:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.239+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb815ea90 con 0x7f3cb80d29d0 2023-08-09T12:54:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.239+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb80cb7c0 con 0x7f3cb80d29d0 2023-08-09T12:54:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.240+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb8067a80 con 0x7f3cb80d29d0 2023-08-09T12:54:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.241+0000 7f3cae7fc640 1 -- 172.21.15.17:0/1410750350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ca800bd10 con 0x7f3cb80d29d0 2023-08-09T12:54:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.242+0000 7f3cae7fc640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c9c06a080 0x7f3c9c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.242+0000 7f3cae7fc640 1 -- 172.21.15.17:0/1410750350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3ca8088840 con 0x7f3cb80d29d0 2023-08-09T12:54:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.243+0000 7f3cbdd67640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c9c06a080 0x7f3c9c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.244+0000 7f3cbdd67640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c9c06a080 0x7f3c9c06c540 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4036000 tx=0x7f3cb4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.247+0000 7f3cae7fc640 1 -- 172.21.15.17:0/1410750350 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f3ca80541b0 con 0x7f3cb80d29d0 2023-08-09T12:54:49.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.442+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 --> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cb815e640 con 0x7f3c9c06a080 2023-08-09T12:54:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.450+0000 7f3cae7fc640 1 -- 172.21.15.17:0/1410750350 <== mgr.4100 v2:172.21.15.142:6832/1755133845 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67982 (secure 0 0 0) 0x7f3cb815e640 con 0x7f3c9c06a080 2023-08-09T12:54:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-08-09T12:54:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c9c06a080 msgr2=0x7f3c9c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c9c06a080 0x7f3c9c06c540 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4036000 tx=0x7f3cb4030000 comp rx=0 tx=0).stop 2023-08-09T12:54:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb80d29d0 msgr2=0x7f3cb81f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb80d29d0 0x7f3cb81f5620 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800d800 tx=0x7f3ca800dcc0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 shutdown_connections 2023-08-09T12:54:49.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f3c9c06a080 0x7f3c9c06c540 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cb815ce90 0x7f3cb815fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb80d29d0 0x7f3cb81f5620 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 --2- 172.21.15.17:0/1410750350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cb80b6000 0x7f3cb80cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 >> 172.21.15.17:0/1410750350 conn(0x7f3cb806fde0 msgr2=0x7f3cb80b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.453+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 shutdown_connections 2023-08-09T12:54:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.454+0000 7f3cbffcb640 1 -- 172.21.15.17:0/1410750350 wait complete. 2023-08-09T12:54:49.475 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":660,"stamp":"2023-08-09T12:54:48.990392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552046,"statfs":{"total":1600000000,"available":1589295568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003504"},"pg_stats":[{"pgid":"1.0","version":"198'119","reported_seq":529,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:30.967363+0000","last_change":"2023-08-09T12:54:30.967491+0000","last_active":"2023-08-09T12:54:30.967363+0000","last_peered":"2023-08-09T12:54:30.967363+0000","last_clean":"2023-08-09T12:54:30.967363+0000","last_became_active":"2023-08-09T12:39:14.441624+0000","last_became_peered":"2023-08-09T12:39:14.441624+0000","last_unstale":"2023-08-09T12:54:30.967363+0000","last_undegraded":"2023-08-09T12:54:30.967363+0000","last_fullsized":"2023-08-09T12:54:30.967363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'119","last_scrub_stamp":"2023-08-09T12:54:30.967273+0000","last_deep_scrub":"198'119","last_deep_scrub_stamp":"2023-08-09T12:54:30.967273+0000","last_clean_scrub_stamp":"2023-08-09T12:54:30.967273+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T23:45:05.412336+0000","scrub_duration":0.0062381049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":341,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:30.556912+0000","last_change":"2023-08-09T12:54:30.557013+0000","last_active":"2023-08-09T12:54:30.556912+0000","last_peered":"2023-08-09T12:54:30.556912+0000","last_clean":"2023-08-09T12:54:30.556912+0000","last_became_active":"2023-08-09T12:39:19.299312+0000","last_became_peered":"2023-08-09T12:39:19.299312+0000","last_unstale":"2023-08-09T12:54:30.556912+0000","last_undegraded":"2023-08-09T12:54:30.556912+0000","last_fullsized":"2023-08-09T12:54:30.556912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:54:30.556823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:54:30.556823+0000","last_clean_scrub_stamp":"2023-08-09T12:54:30.556823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:09:15.138059+0000","scrub_duration":0.0031517440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":371,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:41.017655+0000","last_change":"2023-08-09T12:54:41.017759+0000","last_active":"2023-08-09T12:54:41.017655+0000","last_peered":"2023-08-09T12:54:41.017655+0000","last_clean":"2023-08-09T12:54:41.017655+0000","last_became_active":"2023-08-09T12:39:19.301014+0000","last_became_peered":"2023-08-09T12:39:19.301014+0000","last_unstale":"2023-08-09T12:54:41.017655+0000","last_undegraded":"2023-08-09T12:54:41.017655+0000","last_fullsized":"2023-08-09T12:54:41.017655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:54:41.017564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:54:41.017564+0000","last_clean_scrub_stamp":"2023-08-09T12:54:41.017564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T14:05:43.322611+0000","scrub_duration":0.0033141630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:28.040182+0000","last_change":"2023-08-09T12:54:28.040228+0000","last_active":"2023-08-09T12:54:28.040182+0000","last_peered":"2023-08-09T12:54:28.040182+0000","last_clean":"2023-08-09T12:54:28.040182+0000","last_became_active":"2023-08-09T12:39:19.483098+0000","last_became_peered":"2023-08-09T12:39:19.483098+0000","last_unstale":"2023-08-09T12:54:28.040182+0000","last_undegraded":"2023-08-09T12:54:28.040182+0000","last_fullsized":"2023-08-09T12:54:28.040182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:54:28.040136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:54:28.040136+0000","last_clean_scrub_stamp":"2023-08-09T12:54:28.040136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:45:45.178682+0000","scrub_duration":0.0015971640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":341,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:28.525448+0000","last_change":"2023-08-09T12:54:28.525549+0000","last_active":"2023-08-09T12:54:28.525448+0000","last_peered":"2023-08-09T12:54:28.525448+0000","last_clean":"2023-08-09T12:54:28.525448+0000","last_became_active":"2023-08-09T12:39:19.301261+0000","last_became_peered":"2023-08-09T12:39:19.301261+0000","last_unstale":"2023-08-09T12:54:28.525448+0000","last_undegraded":"2023-08-09T12:54:28.525448+0000","last_fullsized":"2023-08-09T12:54:28.525448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:54:28.525365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:54:28.525365+0000","last_clean_scrub_stamp":"2023-08-09T12:54:28.525365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T19:47:16.407550+0000","scrub_duration":0.0024320370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":341,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:31.960904+0000","last_change":"2023-08-09T12:54:31.961023+0000","last_active":"2023-08-09T12:54:31.960904+0000","last_peered":"2023-08-09T12:54:31.960904+0000","last_clean":"2023-08-09T12:54:31.960904+0000","last_became_active":"2023-08-09T12:39:19.299817+0000","last_became_peered":"2023-08-09T12:39:19.299817+0000","last_unstale":"2023-08-09T12:54:31.960904+0000","last_undegraded":"2023-08-09T12:54:31.960904+0000","last_fullsized":"2023-08-09T12:54:31.960904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:54:31.960814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:54:31.960814+0000","last_clean_scrub_stamp":"2023-08-09T12:54:31.960814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T21:43:48.162168+0000","scrub_duration":0.0028490770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":371,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:38.988704+0000","last_change":"2023-08-09T12:54:38.988875+0000","last_active":"2023-08-09T12:54:38.988704+0000","last_peered":"2023-08-09T12:54:38.988704+0000","last_clean":"2023-08-09T12:54:38.988704+0000","last_became_active":"2023-08-09T12:39:19.291556+0000","last_became_peered":"2023-08-09T12:39:19.291556+0000","last_unstale":"2023-08-09T12:54:38.988704+0000","last_undegraded":"2023-08-09T12:54:38.988704+0000","last_fullsized":"2023-08-09T12:54:38.988704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:54:38.988552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:54:38.988552+0000","last_clean_scrub_stamp":"2023-08-09T12:54:38.988552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T20:46:40.016584+0000","scrub_duration":0.0030335129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":341,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:32.966765+0000","last_change":"2023-08-09T12:54:32.966870+0000","last_active":"2023-08-09T12:54:32.966765+0000","last_peered":"2023-08-09T12:54:32.966765+0000","last_clean":"2023-08-09T12:54:32.966765+0000","last_became_active":"2023-08-09T12:39:19.300213+0000","last_became_peered":"2023-08-09T12:39:19.300213+0000","last_unstale":"2023-08-09T12:54:32.966765+0000","last_undegraded":"2023-08-09T12:54:32.966765+0000","last_fullsized":"2023-08-09T12:54:32.966765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:54:32.966678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:54:32.966678+0000","last_clean_scrub_stamp":"2023-08-09T12:54:32.966678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T22:34:23.023012+0000","scrub_duration":0.003106134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":369,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-09T12:54:28.374624+0000","last_change":"2023-08-09T12:54:28.374624+0000","last_active":"2023-08-09T12:54:28.374624+0000","last_peered":"2023-08-09T12:54:28.374624+0000","last_clean":"2023-08-09T12:54:28.374624+0000","last_became_active":"2023-08-09T12:39:19.292649+0000","last_became_peered":"2023-08-09T12:39:19.292649+0000","last_unstale":"2023-08-09T12:54:28.374624+0000","last_undegraded":"2023-08-09T12:54:28.374624+0000","last_fullsized":"2023-08-09T12:54:28.374624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-09T12:54:28.374434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-09T12:54:28.374434+0000","last_clean_scrub_stamp":"2023-08-09T12:54:28.374434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-10T18:45:49.203070+0000","scrub_duration":0.0028547389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193573,"statfs":{"total":200000000,"available":198219170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1930000000000001,"15min":1.1499999999999999},"min":{"1min":0.72999999999999998,"5min":0.61899999999999999,"15min":0.58699999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1639999999999999,"15min":1.1359999999999999},"min":{"1min":0.73499999999999999,"5min":0.63100000000000001,"15min":0.44500000000000001},"max":{"1min":1.677,"5min":1.677,"15min":2.0459999999999998},"last":1.119}]},{"osd":1,"last update":"Wed Aug 9 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.222,"15min":1.2110000000000001},"min":{"1min":0.84099999999999997,"5min":0.70599999999999996,"15min":0.628},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":2.0859999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":2.2269999999999999,"5min":1.425,"15min":1.258},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.39300000000000002},"max":{"1min":20.939,"5min":20.939,"15min":20.939},"last":1.2210000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":2.1949999999999998,"5min":1.4850000000000001,"15min":1.3380000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.496},"max":{"1min":19.984000000000002,"5min":19.984000000000002,"15min":19.984000000000002},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2450000000000001,"15min":1.226},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.69799999999999995},"max":{"1min":1.669,"5min":1.669,"15min":2.173},"last":1.327}]},{"osd":3,"last update":"Wed Aug 9 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6679999999999999,"5min":1.806,"15min":3.4540000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":2.3559999999999999,"5min":1.508,"15min":1.391},"min":{"1min":1.05,"5min":0.77800000000000002,"15min":0.61599999999999999},"max":{"1min":20.119,"5min":20.119,"15min":20.119},"last":1.45}]},{"osd":4,"last update":"Wed Aug 9 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.181,"15min":1.2330000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.48499999999999999},"max":{"1min":1.7330000000000001,"5min":1.873,"15min":2.8769999999999998},"last":1.401},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3320000000000001,"15min":1.3580000000000001},"min":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"max":{"1min":1.7969999999999999,"5min":1.8069999999999999,"15min":4.6200000000000001},"last":1.2829999999999999}]},{"osd":5,"last update":"Wed Aug 9 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":2.246,"5min":1.5780000000000001,"15min":1.4650000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"max":{"1min":20.064,"5min":20.064,"15min":20.064},"last":1.593},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4770000000000001,"15min":1.5069999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.78,"5min":1.8200000000000001,"15min":3.3580000000000001},"last":1.5720000000000001}]},{"osd":6,"last update":"Wed Aug 9 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.419,"15min":1.474},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.849,"5min":1.901,"15min":3.4910000000000001},"last":1.504},{"interface":"front","average":{"1min":1.415,"5min":1.4590000000000001,"15min":1.4890000000000001},"min":{"1min":0.68000000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":2.4039999999999999},"last":1.3640000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.139,"15min":1.1419999999999999},"min":{"1min":0.73599999999999999,"5min":0.73099999999999998,"15min":0.56399999999999995},"max":{"1min":1.605,"5min":1.6919999999999999,"15min":2.54},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.151,"15min":1.1259999999999999},"min":{"1min":0.76600000000000001,"5min":0.626,"15min":0.54000000000000004},"max":{"1min":1.3999999999999999,"5min":1.6859999999999999,"15min":2.1629999999999998},"last":1.2170000000000001}]},{"osd":1,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.302,"15min":1.264},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.66500000000000004},"max":{"1min":1.607,"5min":1.8089999999999999,"15min":2.306},"last":1.399},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.367,"15min":1.341},"min":{"1min":0.85999999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.756,"5min":1.881,"15min":1.9279999999999999},"last":1.375}]},{"osd":2,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2290000000000001,"15min":1.1799999999999999},"min":{"1min":0.84499999999999997,"5min":0.80900000000000005,"15min":0.66900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.167},{"interface":"front","average":{"1min":1.284,"5min":1.2929999999999999,"15min":1.296},"min":{"1min":0.93799999999999994,"5min":0.76100000000000001,"15min":0.66300000000000003},"max":{"1min":1.6220000000000001,"5min":1.8580000000000001,"15min":2.6499999999999999},"last":1.1299999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.347,"15min":1.3360000000000001},"min":{"1min":0.754,"5min":0.745,"15min":0.67600000000000005},"max":{"1min":1.5569999999999999,"5min":1.845,"15min":2.327},"last":1.488},{"interface":"front","average":{"1min":1.397,"5min":1.3959999999999999,"15min":1.3620000000000001},"min":{"1min":0.92600000000000005,"5min":0.749,"15min":0.74099999999999999},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.5979999999999999},"last":1.5129999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3500000000000001,"15min":1.3799999999999999},"min":{"1min":0.88800000000000001,"5min":0.84899999999999998,"15min":0.61799999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":11.058999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.3979999999999999,"15min":1.3859999999999999},"min":{"1min":0.99299999999999999,"5min":0.97099999999999997,"15min":0.57399999999999995},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.3479999999999999},"last":1.5820000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.381,"15min":1.3680000000000001},"min":{"1min":0.95299999999999996,"5min":0.93600000000000005,"15min":0.77600000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.5249999999999999},"last":1.343},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.502,"15min":1.512},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.81899999999999995},"max":{"1min":1.833,"5min":2.077,"15min":2.8580000000000001},"last":1.5349999999999999}]},{"osd":7,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5620000000000001,"15min":1.546},"min":{"1min":1.155,"5min":1.1100000000000001,"15min":0.59099999999999997},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.7999999999999998},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.552,"15min":1.5349999999999999},"min":{"1min":1.2330000000000001,"5min":1.0469999999999999,"15min":0.74399999999999999},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":3.621},"last":1.45}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.1319999999999999,"15min":1.1160000000000001},"min":{"1min":0.71699999999999997,"5min":0.67300000000000004,"15min":0.55300000000000005},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":3.4060000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1839999999999999,"15min":1.177},"min":{"1min":0.73299999999999998,"5min":0.68999999999999995,"15min":0.625},"max":{"1min":1.593,"5min":1.8460000000000001,"15min":2.0600000000000001},"last":0.77000000000000002}]},{"osd":1,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.373,"15min":1.3520000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.63800000000000001},"max":{"1min":1.7270000000000001,"5min":2.048,"15min":2.6579999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.3440000000000001,"15min":1.3049999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.70199999999999996},"max":{"1min":1.706,"5min":2.262,"15min":2.262},"last":1.302}]},{"osd":2,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.288,"15min":1.26},"min":{"1min":1.034,"5min":0.76800000000000002,"15min":0.69799999999999995},"max":{"1min":1.5069999999999999,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.04},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.2350000000000001},"min":{"1min":0.86799999999999999,"5min":0.72699999999999998,"15min":0.67000000000000004},"max":{"1min":1.758,"5min":1.8140000000000001,"15min":3.8149999999999999},"last":1.153}]},{"osd":3,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3069999999999999,"15min":1.2969999999999999},"min":{"1min":0.98899999999999999,"5min":0.81100000000000005,"15min":0.71799999999999997},"max":{"1min":1.587,"5min":2.1629999999999998,"15min":2.2330000000000001},"last":1.077},{"interface":"front","average":{"1min":1.353,"5min":1.367,"15min":1.371},"min":{"1min":0.98999999999999999,"5min":0.93000000000000005,"15min":0.78200000000000003},"max":{"1min":1.639,"5min":2.6600000000000001,"15min":2.6659999999999999},"last":1.399}]},{"osd":4,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2789999999999999,"15min":1.2849999999999999},"min":{"1min":0.90700000000000003,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.696,"5min":2.169,"15min":4.6920000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.409,"5min":1.3859999999999999,"15min":1.401},"min":{"1min":0.96899999999999997,"5min":0.875,"15min":0.628},"max":{"1min":1.722,"5min":2.2429999999999999,"15min":3.3109999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.458,"15min":1.4219999999999999},"min":{"1min":1.226,"5min":1.034,"15min":0.58099999999999996},"max":{"1min":1.76,"5min":2.7719999999999998,"15min":2.952},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4750000000000001},"min":{"1min":1.1539999999999999,"5min":0.72899999999999998,"15min":0.51000000000000001},"max":{"1min":1.8169999999999999,"5min":2.1059999999999999,"15min":5.8570000000000002},"last":1.099}]},{"osd":7,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.5449999999999999,"15min":1.5429999999999999},"min":{"1min":1.4179999999999999,"5min":0.70799999999999996,"15min":0.67200000000000004},"max":{"1min":1.8480000000000001,"5min":2.302,"15min":3.4590000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.573,"5min":1.5920000000000001,"15min":1.589},"min":{"1min":1.3100000000000001,"5min":1.121,"15min":0.65300000000000002},"max":{"1min":1.8149999999999999,"5min":2.8849999999999998,"15min":3.0649999999999999},"last":1.484}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1240000000000001,"15min":1.117},"min":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.58799999999999997},"max":{"1min":1.702,"5min":1.986,"15min":2.5670000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1240000000000001,"15min":1.141},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.61499999999999999},"max":{"1min":1.456,"5min":1.7569999999999999,"15min":3.4100000000000001},"last":1.0389999999999999}]},{"osd":1,"last update":"Wed Aug 9 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2889999999999999,"15min":1.282},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.48899999999999999},"max":{"1min":1.6599999999999999,"5min":1.738,"15min":2.3679999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.345,"15min":1.3320000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.71999999999999997},"max":{"1min":1.657,"5min":1.889,"15min":2.9590000000000001},"last":1.5369999999999999}]},{"osd":2,"last update":"Wed Aug 9 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.387,"15min":1.3380000000000001},"min":{"1min":0.90700000000000003,"5min":0.81499999999999995,"15min":0.54900000000000004},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":2.4729999999999999},"last":1.647},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":1.349},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.67900000000000005},"max":{"1min":1.6879999999999999,"5min":1.887,"15min":3.0579999999999998},"last":1.6879999999999999}]},{"osd":3,"last update":"Wed Aug 9 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.244,"15min":1.2549999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.57499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":3.4430000000000001},"last":1.24},{"interface":"front","average":{"1min":1.373,"5min":1.353,"15min":1.339},"min":{"1min":0.95799999999999996,"5min":0.94599999999999995,"15min":0.70699999999999996},"max":{"1min":1.804,"5min":1.8819999999999999,"15min":2.5289999999999999},"last":1.4770000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.55900000000000005},"max":{"1min":1.7270000000000001,"5min":1.9059999999999999,"15min":3.137},"last":1.605},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3089999999999999,"15min":1.347},"min":{"1min":0.88800000000000001,"5min":0.76800000000000002,"15min":0.623},"max":{"1min":1.5649999999999999,"5min":1.8600000000000001,"15min":3.3620000000000001},"last":1.353}]},{"osd":6,"last update":"Wed Aug 9 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3799999999999999,"15min":1.4019999999999999},"min":{"1min":0.97899999999999998,"5min":0.90700000000000003,"15min":0.59799999999999998},"max":{"1min":1.7649999999999999,"5min":2.0670000000000002,"15min":2.5819999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.482,"15min":1.5109999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":3.3340000000000001},"last":1.839}]},{"osd":7,"last update":"Wed Aug 9 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.456,"15min":1.4970000000000001},"min":{"1min":1.0369999999999999,"5min":0.995,"15min":0.68999999999999995},"max":{"1min":1.7889999999999999,"5min":1.853,"15min":3.4900000000000002},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.552,"15min":1.569},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":0.65600000000000003},"max":{"1min":1.788,"5min":2.004,"15min":2.875},"last":1.788}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.89600000000000002,"15min":0.877},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.29199999999999998},"max":{"1min":1.381,"5min":1.494,"15min":4.4109999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.0409999999999999,"15min":1.006},"min":{"1min":0.41899999999999998,"5min":0.38600000000000001,"15min":0.35499999999999998},"max":{"1min":1.2729999999999999,"5min":1.99,"15min":3.2269999999999999},"last":0.871}]},{"osd":1,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.38100000000000001},"max":{"1min":1.456,"5min":1.4830000000000001,"15min":2.1280000000000001},"last":1.26},{"interface":"front","average":{"1min":1,"5min":1.159,"15min":1.0920000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.33900000000000002},"max":{"1min":1.5820000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.6180000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.2,"15min":1.1919999999999999},"min":{"1min":0.63600000000000001,"5min":0.47999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6870000000000001,"5min":2.089,"15min":18.145},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2729999999999999,"15min":1.2330000000000001},"min":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.379},"max":{"1min":1.663,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.466}]},{"osd":4,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2869999999999999,"15min":1.296},"min":{"1min":0.79500000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.895,"5min":1.905,"15min":3.5110000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.401,"15min":1.3420000000000001},"min":{"1min":1.0089999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5940000000000001,"5min":2.1190000000000002,"15min":3.5960000000000001},"last":1.875}]},{"osd":5,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.51,"15min":1.4750000000000001},"min":{"1min":1.044,"5min":0.79100000000000004,"15min":0.72999999999999998},"max":{"1min":1.845,"5min":2.302,"15min":18.094000000000001},"last":1.7450000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.454,"15min":1.4590000000000001},"min":{"1min":0.879,"5min":0.80900000000000005,"15min":0.69899999999999995},"max":{"1min":1.7350000000000001,"5min":2.1150000000000002,"15min":14.105},"last":1.556}]},{"osd":6,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.413,"15min":1.387},"min":{"1min":0.80100000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":3.2789999999999999},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5429999999999999,"15min":1.4810000000000001},"min":{"1min":0.96899999999999997,"5min":0.83299999999999996,"15min":0.77700000000000002},"max":{"1min":1.8089999999999999,"5min":2.3730000000000002,"15min":4.0220000000000002},"last":1.9750000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.5600000000000001,"15min":1.4910000000000001},"min":{"1min":1.0169999999999999,"5min":0.88600000000000001,"15min":0.72499999999999998},"max":{"1min":1.9650000000000001,"5min":2.3319999999999999,"15min":2.4239999999999999},"last":1.698},{"interface":"front","average":{"1min":1.375,"5min":1.522,"15min":1.47},"min":{"1min":0.86099999999999999,"5min":0.71799999999999997,"15min":0.70799999999999996},"max":{"1min":1.774,"5min":2.3380000000000001,"15min":3.016},"last":1.669}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.92300000000000004,"15min":0.89100000000000001},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":1.375,"5min":1.673,"15min":1.716},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":0.97899999999999998},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.38900000000000001},"max":{"1min":1.3200000000000001,"5min":1.9810000000000001,"15min":2.9009999999999998},"last":1.216}]},{"osd":1,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.95199999999999996,"15min":0.93000000000000005},"min":{"1min":0.56399999999999995,"5min":0.51800000000000002,"15min":0.36299999999999999},"max":{"1min":1.5129999999999999,"5min":1.5149999999999999,"15min":1.8700000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.119,"15min":1.0720000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.46899999999999997},"max":{"1min":1.6200000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.472}]},{"osd":3,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.147,"15min":1.1439999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.46600000000000003},"max":{"1min":1.575,"5min":1.8109999999999999,"15min":3.2850000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2849999999999999,"15min":1.218},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.671,"5min":1.7689999999999999,"15min":2.9409999999999998},"last":1.3280000000000001}]},{"osd":4,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.4910000000000001,"15min":1.4490000000000001},"min":{"1min":1.048,"5min":1.0309999999999999,"15min":0.81899999999999995},"max":{"1min":1.5740000000000001,"5min":1.9430000000000001,"15min":3.3300000000000001},"last":1.706},{"interface":"front","average":{"1min":1.232,"5min":1.359,"15min":1.351},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.66800000000000004},"max":{"1min":1.6879999999999999,"5min":2.109,"15min":3.4500000000000002},"last":1.0880000000000001}]},{"osd":5,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.4079999999999999,"15min":1.4019999999999999},"min":{"1min":0.96899999999999997,"5min":0.86599999999999999,"15min":0.69599999999999995},"max":{"1min":1.756,"5min":1.95,"15min":5.0140000000000002},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.5640000000000001,"15min":1.506},"min":{"1min":1.036,"5min":0.96299999999999997,"15min":0.78700000000000003},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":4.806},"last":1.633}]},{"osd":6,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3620000000000001,"15min":1.363},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.67500000000000004},"max":{"1min":1.821,"5min":1.976,"15min":2.5179999999999998},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.472,"15min":1.4550000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.73399999999999999},"max":{"1min":1.8839999999999999,"5min":2.0270000000000001,"15min":3.6589999999999998},"last":1.579}]},{"osd":7,"last update":"Wed Aug 9 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4199999999999999,"15min":1.421},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.76200000000000001},"max":{"1min":1.9490000000000001,"5min":1.9510000000000001,"15min":2.464},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.5720000000000001,"15min":1.5449999999999999},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.69299999999999995},"max":{"1min":1.984,"5min":2.0800000000000001,"15min":4.0730000000000004},"last":1.4139999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1162,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194149,"statfs":{"total":200000000,"available":198809538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.498,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":1.423,"5min":1.6719999999999999,"15min":2.621},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.071,"15min":1.349},"min":{"1min":0.67000000000000004,"5min":0.441,"15min":0.34300000000000003},"max":{"1min":1.46,"5min":1.778,"15min":88.254999999999995},"last":1.135}]},{"osd":2,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0169999999999999,"15min":1.0069999999999999},"min":{"1min":0.625,"5min":0.376,"15min":0.376},"max":{"1min":1.3560000000000001,"5min":2.0310000000000001,"15min":3.0209999999999999},"last":1.53},{"interface":"front","average":{"1min":1.242,"5min":1.298,"15min":1.2669999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":1.708,"5min":2.0840000000000001,"15min":3.1890000000000001},"last":1.635}]},{"osd":3,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.214,"15min":1.1919999999999999},"min":{"1min":0.71299999999999997,"5min":0.503,"15min":0.436},"max":{"1min":1.8799999999999999,"5min":2.181,"15min":2.181},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.145,"15min":1.117},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.5049999999999999,"5min":2.3410000000000002,"15min":5.4320000000000004},"last":1.2529999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.28,"15min":1.3480000000000001},"min":{"1min":0.88500000000000001,"5min":0.81100000000000005,"15min":0.76200000000000001},"max":{"1min":1.702,"5min":1.921,"15min":25.172000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3979999999999999,"15min":1.3879999999999999},"min":{"1min":0.92200000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6910000000000001,"5min":1.887,"15min":3.762},"last":1.762}]},{"osd":5,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3919999999999999,"15min":1.4630000000000001},"min":{"1min":0.92800000000000005,"5min":0.80100000000000005,"15min":0.751},"max":{"1min":1.6000000000000001,"5min":2.0110000000000001,"15min":28.710000000000001},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.88200000000000001,"5min":0.876,"15min":0.77900000000000003},"max":{"1min":1.744,"5min":1.9079999999999999,"15min":3.762},"last":1.696}]},{"osd":6,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.5349999999999999,"15min":1.5069999999999999},"min":{"1min":1.0349999999999999,"5min":0.96899999999999997,"15min":0.79700000000000004},"max":{"1min":1.7390000000000001,"5min":2.4569999999999999,"15min":6.0460000000000003},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.4990000000000001,"15min":1.4590000000000001},"min":{"1min":0.89500000000000002,"5min":0.82699999999999996,"15min":0.79500000000000004},"max":{"1min":1.9139999999999999,"5min":2.1440000000000001,"15min":2.1480000000000001},"last":1.3740000000000001}]},{"osd":7,"last update":"Wed Aug 9 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5600000000000001,"15min":1.6439999999999999},"min":{"1min":1.107,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.978,"5min":2.109,"15min":26.975999999999999},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.611,"15min":1.669},"min":{"1min":1.151,"5min":0.92600000000000005,"15min":0.65600000000000003},"max":{"1min":1.851,"5min":2.464,"15min":28.765000000000001},"last":1.6719999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193573,"statfs":{"total":200000000,"available":198219170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 9 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.85599999999999998,"15min":0.88800000000000001},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.35799999999999998},"max":{"1min":1.4319999999999999,"5min":1.6579999999999999,"15min":1.819},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.0509999999999999,"15min":1.044},"min":{"1min":0.44900000000000001,"5min":0.437,"15min":0.436},"max":{"1min":1.327,"5min":2.1030000000000002,"15min":6.1749999999999998},"last":1.4970000000000001}]},{"osd":2,"last update":"Wed Aug 9 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.075,"15min":1.038},"min":{"1min":0.60899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.24,"5min":1.73,"15min":1.7669999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.1120000000000001,"15min":1.097},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.534,"5min":1.7410000000000001,"15min":6.2549999999999999},"last":1.216}]},{"osd":3,"last update":"Wed Aug 9 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.04,"15min":1.044},"min":{"1min":0.71199999999999997,"5min":0.52400000000000002,"15min":0.45300000000000001},"max":{"1min":1.8300000000000001,"5min":1.893,"15min":9.6069999999999993},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.24,"15min":1.212},"min":{"1min":0.76500000000000001,"5min":0.58299999999999996,"15min":0.56000000000000005},"max":{"1min":1.5740000000000001,"5min":1.962,"15min":2.2730000000000001},"last":1.2769999999999999}]},{"osd":4,"last update":"Wed Aug 9 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3759999999999999,"15min":1.3640000000000001},"min":{"1min":0.92100000000000004,"5min":0.88300000000000001,"15min":0.79500000000000004},"max":{"1min":1.6259999999999999,"5min":2.286,"15min":9.9629999999999992},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.456,"15min":1.3919999999999999},"min":{"1min":1.1180000000000001,"5min":0.90100000000000002,"15min":0.77900000000000003},"max":{"1min":1.873,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.389}]},{"osd":5,"last update":"Wed Aug 9 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3919999999999999,"15min":1.375},"min":{"1min":0.88400000000000001,"5min":0.77400000000000002,"15min":0.76300000000000001},"max":{"1min":1.734,"5min":2.1760000000000002,"15min":10.004},"last":1.327},{"interface":"front","average":{"1min":1.431,"5min":1.474,"15min":1.4419999999999999},"min":{"1min":1.036,"5min":0.85099999999999998,"15min":0.84999999999999998},"max":{"1min":1.827,"5min":1.857,"15min":2.161},"last":1.5649999999999999}]},{"osd":6,"last update":"Wed Aug 9 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4450000000000001,"15min":1.431},"min":{"1min":0.88200000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.744,"5min":3.5470000000000002,"15min":6.4290000000000003},"last":1.615},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.502,"15min":1.4870000000000001},"min":{"1min":1.145,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.774,"5min":2.294,"15min":9.9190000000000005},"last":1.893}]},{"osd":7,"last update":"Wed Aug 9 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.534,"15min":1.528},"min":{"1min":1.0549999999999999,"5min":0.88700000000000001,"15min":0.73699999999999999},"max":{"1min":1.9370000000000001,"5min":3.5920000000000001,"15min":18.114000000000001},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.577,"15min":1.548},"min":{"1min":1.034,"5min":0.84099999999999997,"15min":0.82299999999999995},"max":{"1min":1.8460000000000001,"5min":2.3959999999999999,"15min":9.5640000000000001},"last":1.7769999999999999}]}]}],"pool_statfs":[]}} 2023-08-09T12:54:49.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-09T12:54:49.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.692+0000 7fe2288c4640 1 Processor -- start 2023-08-09T12:54:49.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.693+0000 7fe2288c4640 1 -- start start 2023-08-09T12:54:49.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.694+0000 7fe2288c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe224159650 0x7fe2240b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.694+0000 7fe2288c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe224159a30 0x7fe2240b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.694+0000 7fe2288c4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2240c9a80 con 0x7fe2240c8c30 2023-08-09T12:54:49.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.694+0000 7fe2288c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2240ca010 con 0x7fe224159a30 2023-08-09T12:54:49.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.694+0000 7fe2288c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240ca2f0 con 0x7fe224159650 2023-08-09T12:54:49.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.695+0000 7fe22359e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe2240c8c30 0x7fe22415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38022/0 (socket says 172.21.15.17:38022) 2023-08-09T12:54:49.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.695+0000 7fe22359e640 1 -- 172.21.15.17:0/760602992 learned_addr learned my addr 172.21.15.17:0/760602992 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:49.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.695+0000 7fe222d9d640 1 --2- 172.21.15.17:0/760602992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe224159650 0x7fe2240b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.695+0000 7fe21bfff640 1 --2- 172.21.15.17:0/760602992 >> v2:172.21.15.142:3300/0 conn(0x7fe224159a30 0x7fe2240b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.695+0000 7fe22259c640 1 -- 172.21.15.17:0/760602992 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126838826 0 0) 0x7fe2240c9a80 con 0x7fe2240c8c30 2023-08-09T12:54:49.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.695+0000 7fe22259c640 1 -- 172.21.15.17:0/760602992 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe210003520 con 0x7fe2240c8c30 2023-08-09T12:54:49.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.696+0000 7fe222d9d640 1 -- 172.21.15.17:0/760602992 >> v2:172.21.15.142:3300/0 conn(0x7fe224159a30 msgr2=0x7fe2240b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:49.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.696+0000 7fe222d9d640 1 --2- 172.21.15.17:0/760602992 >> v2:172.21.15.142:3300/0 conn(0x7fe224159a30 0x7fe2240b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.696+0000 7fe22259c640 1 -- 172.21.15.17:0/760602992 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 693782953 0 0) 0x7fe210003520 con 0x7fe2240c8c30 2023-08-09T12:54:49.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.696+0000 7fe222d9d640 1 -- 172.21.15.17:0/760602992 >> v1:172.21.15.17:6789/0 conn(0x7fe2240c8c30 legacy=0x7fe22415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.696+0000 7fe222d9d640 1 -- 172.21.15.17:0/760602992 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2240ca5d0 con 0x7fe224159650 2023-08-09T12:54:49.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.697+0000 7fe222d9d640 1 --2- 172.21.15.17:0/760602992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe224159650 0x7fe2240b2870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2140097a0 tx=0x7fe21402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41dcb4557a152b5f server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:49.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.698+0000 7fe22259c640 1 -- 172.21.15.17:0/760602992 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0019f0 con 0x7fe224159650 2023-08-09T12:54:49.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.698+0000 7fe22259c640 1 -- 172.21.15.17:0/760602992 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21402e050 con 0x7fe224159650 2023-08-09T12:54:49.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.698+0000 7fe22259c640 1 -- 172.21.15.17:0/760602992 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214030730 con 0x7fe224159650 2023-08-09T12:54:49.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.698+0000 7fe2288c4640 1 -- 172.21.15.17:0/760602992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe224159650 msgr2=0x7fe2240b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.698+0000 7fe2288c4640 1 --2- 172.21.15.17:0/760602992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe224159650 0x7fe2240b2870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2140097a0 tx=0x7fe21402b790 comp rx=0 tx=0).stop 2023-08-09T12:54:49.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.699+0000 7fe2288c4640 1 -- 172.21.15.17:0/760602992 shutdown_connections 2023-08-09T12:54:49.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.699+0000 7fe2288c4640 1 --2- 172.21.15.17:0/760602992 >> v2:172.21.15.142:3300/0 conn(0x7fe224159a30 0x7fe2240b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.699+0000 7fe2288c4640 1 --2- 172.21.15.17:0/760602992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe224159650 0x7fe2240b2870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.699+0000 7fe2288c4640 1 -- 172.21.15.17:0/760602992 >> 172.21.15.17:0/760602992 conn(0x7fe22406abd0 msgr2=0x7fe22406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:49.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.699+0000 7fe2288c4640 1 -- 172.21.15.17:0/760602992 shutdown_connections 2023-08-09T12:54:49.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.699+0000 7fe2288c4640 1 -- 172.21.15.17:0/760602992 wait complete. 2023-08-09T12:54:49.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.701+0000 7fe2288c4640 1 Processor -- start 2023-08-09T12:54:49.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.701+0000 7fe2288c4640 1 -- start start 2023-08-09T12:54:49.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe2288c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2240c8c30 0x7fe2241f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe2288c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe224159650 0x7fe224071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe2288c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2241f54c0 0x7fe224071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe2288c4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22414d760 con 0x7fe2240c8c30 2023-08-09T12:54:49.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe2288c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22406fb30 con 0x7fe224159650 2023-08-09T12:54:49.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe2288c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22406fdd0 con 0x7fe2241f54c0 2023-08-09T12:54:49.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe222d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2240c8c30 0x7fe2241f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe222d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2240c8c30 0x7fe2241f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44378/0 (socket says 172.21.15.17:44378) 2023-08-09T12:54:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe222d9d640 1 -- 172.21.15.17:0/2472685824 learned_addr learned my addr 172.21.15.17:0/2472685824 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe21bfff640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe224159650 0x7fe224071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe222d9d640 1 -- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2241f54c0 msgr2=0x7fe224071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe222d9d640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2241f54c0 0x7fe224071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe222d9d640 1 -- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe224159650 msgr2=0x7fe224071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.703+0000 7fe222d9d640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe224159650 0x7fe224071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.704+0000 7fe222d9d640 1 -- 172.21.15.17:0/2472685824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe214009400 con 0x7fe2240c8c30 2023-08-09T12:54:49.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.704+0000 7fe222d9d640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2240c8c30 0x7fe2241f35a0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7fe214000c00 tx=0x7fe2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:49.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.704+0000 7fe21b7fe640 1 -- 172.21.15.17:0/2472685824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21403b810 con 0x7fe2240c8c30 2023-08-09T12:54:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.704+0000 7fe21b7fe640 1 -- 172.21.15.17:0/2472685824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21403b970 con 0x7fe2240c8c30 2023-08-09T12:54:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.704+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2240700b0 con 0x7fe2240c8c30 2023-08-09T12:54:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.704+0000 7fe21b7fe640 1 -- 172.21.15.17:0/2472685824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21403bd20 con 0x7fe2240c8c30 2023-08-09T12:54:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.704+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe224070670 con 0x7fe2240c8c30 2023-08-09T12:54:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.706+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22404e390 con 0x7fe2240c8c30 2023-08-09T12:54:49.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.707+0000 7fe21b7fe640 1 -- 172.21.15.17:0/2472685824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe214039040 con 0x7fe2240c8c30 2023-08-09T12:54:49.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.708+0000 7fe21b7fe640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe20406a050 0x7fe20406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:49.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.708+0000 7fe21b7fe640 1 -- 172.21.15.17:0/2472685824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe2140a9a00 con 0x7fe2240c8c30 2023-08-09T12:54:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.708+0000 7fe21bfff640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe20406a050 0x7fe20406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.709+0000 7fe21bfff640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe20406a050 0x7fe20406c510 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe2241e76c0 tx=0x7fe20c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:49.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.712+0000 7fe21b7fe640 1 -- 172.21.15.17:0/2472685824 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7fe214075370 con 0x7fe2240c8c30 2023-08-09T12:54:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.910+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe22415d060 con 0x7fe2240c8c30 2023-08-09T12:54:49.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.918+0000 7fe21b7fe640 1 -- 172.21.15.17:0/2472685824 <== mon.0 v2:172.21.15.17:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe21403be80 con 0x7fe2240c8c30 2023-08-09T12:54:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.920+0000 7fe21b7fe640 1 -- 172.21.15.17:0/2472685824 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe214037020 con 0x7fe2240c8c30 2023-08-09T12:54:49.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe20406a050 msgr2=0x7fe20406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe20406a050 0x7fe20406c510 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe2241e76c0 tx=0x7fe20c008040 comp rx=0 tx=0).stop 2023-08-09T12:54:49.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2240c8c30 msgr2=0x7fe2241f35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2240c8c30 0x7fe2241f35a0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7fe214000c00 tx=0x7fe2140046c0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 shutdown_connections 2023-08-09T12:54:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7fe20406a050 0x7fe20406c510 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2241f54c0 0x7fe224071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe224159650 0x7fe224071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 --2- 172.21.15.17:0/2472685824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2240c8c30 0x7fe2241f35a0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 >> 172.21.15.17:0/2472685824 conn(0x7fe22406abd0 msgr2=0x7fe2240cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 shutdown_connections 2023-08-09T12:54:49.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:49.923+0000 7fe2288c4640 1 -- 172.21.15.17:0/2472685824 wait complete. 2023-08-09T12:54:49.946 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-09T12:54:49.946 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-09T12:54:50.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.165+0000 7f2f167ab640 1 Processor -- start 2023-08-09T12:54:50.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.165+0000 7f2f167ab640 1 -- start start 2023-08-09T12:54:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.166+0000 7f2f167ab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f1015ce90 0x7f2f101616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.167+0000 7f2f167ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.167+0000 7f2f167ab640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100b6460 con 0x7f2f100b6000 2023-08-09T12:54:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.167+0000 7f2f167ab640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100d33a0 con 0x7f2f1015ce90 2023-08-09T12:54:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.167+0000 7f2f167ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100cdd10 con 0x7f2f100d29d0 2023-08-09T12:54:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.167+0000 7f2f07fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2f100b6000 0x7f2f100cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38038/0 (socket says 172.21.15.17:38038) 2023-08-09T12:54:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.167+0000 7f2f0ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f1015ce90 0x7f2f101616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.167+0000 7f2f07fff640 1 -- 172.21.15.17:0/987219696 learned_addr learned my addr 172.21.15.17:0/987219696 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-08-09T12:54:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.167+0000 7f2f14d48640 1 --2- 172.21.15.17:0/987219696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.168+0000 7f2f0f7fe640 1 -- 172.21.15.17:0/987219696 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430370067 0 0) 0x7f2f100b6460 con 0x7f2f100b6000 2023-08-09T12:54:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.168+0000 7f2f0ffff640 1 -- 172.21.15.17:0/987219696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 msgr2=0x7f2f100d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-09T12:54:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.168+0000 7f2f0ffff640 1 --2- 172.21.15.17:0/987219696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.168+0000 7f2f0ffff640 1 -- 172.21.15.17:0/987219696 >> v1:172.21.15.17:6789/0 conn(0x7f2f100b6000 legacy=0x7f2f100cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.168+0000 7f2f0ffff640 1 -- 172.21.15.17:0/987219696 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100cdff0 con 0x7f2f1015ce90 2023-08-09T12:54:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.169+0000 7f2f0ffff640 1 --2- 172.21.15.17:0/987219696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015ce90 0x7f2f101616e0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f2f000097a0 tx=0x7f2f0002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c854022ee8a9f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.169+0000 7f2f0f7fe640 1 -- 172.21.15.17:0/987219696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0002d040 con 0x7f2f1015ce90 2023-08-09T12:54:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.169+0000 7f2f0f7fe640 1 -- 172.21.15.17:0/987219696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2f00031810 con 0x7f2f1015ce90 2023-08-09T12:54:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.169+0000 7f2f0f7fe640 1 -- 172.21.15.17:0/987219696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00031bc0 con 0x7f2f1015ce90 2023-08-09T12:54:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.170+0000 7f2f167ab640 1 -- 172.21.15.17:0/987219696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015ce90 msgr2=0x7f2f101616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.170+0000 7f2f167ab640 1 --2- 172.21.15.17:0/987219696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015ce90 0x7f2f101616e0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f2f000097a0 tx=0x7f2f0002b8b0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.170+0000 7f2f167ab640 1 -- 172.21.15.17:0/987219696 shutdown_connections 2023-08-09T12:54:50.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.170+0000 7f2f167ab640 1 --2- 172.21.15.17:0/987219696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.170+0000 7f2f167ab640 1 --2- 172.21.15.17:0/987219696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015ce90 0x7f2f101616e0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.170+0000 7f2f167ab640 1 -- 172.21.15.17:0/987219696 >> 172.21.15.17:0/987219696 conn(0x7f2f1006fde0 msgr2=0x7f2f100701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:50.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.170+0000 7f2f167ab640 1 -- 172.21.15.17:0/987219696 shutdown_connections 2023-08-09T12:54:50.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.170+0000 7f2f167ab640 1 -- 172.21.15.17:0/987219696 wait complete. 2023-08-09T12:54:50.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.172+0000 7f2f167ab640 1 Processor -- start 2023-08-09T12:54:50.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.172+0000 7f2f167ab640 1 -- start start 2023-08-09T12:54:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.173+0000 7f2f167ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100b6000 0x7f2f10157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.173+0000 7f2f167ab640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.173+0000 7f2f167ab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f1015ce90 0x7f2f100cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:50.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.173+0000 7f2f167ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10156700 con 0x7f2f100b6000 2023-08-09T12:54:50.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.173+0000 7f2f167ab640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100b5570 con 0x7f2f1015ce90 2023-08-09T12:54:50.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.173+0000 7f2f167ab640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100b5850 con 0x7f2f100d29d0 2023-08-09T12:54:50.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100b6000 0x7f2f10157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:50.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100b6000 0x7f2f10157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44398/0 (socket says 172.21.15.17:44398) 2023-08-09T12:54:50.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f0ffff640 1 -- 172.21.15.17:0/1969907228 learned_addr learned my addr 172.21.15.17:0/1969907228 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-08-09T12:54:50.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f07fff640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:50.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f14d48640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f1015ce90 0x7f2f100cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:50.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f0ffff640 1 -- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 msgr2=0x7f2f100b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:50.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f0ffff640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f0ffff640 1 -- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f1015ce90 msgr2=0x7f2f100cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:50.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f0ffff640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f1015ce90 0x7f2f100cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f0ffff640 1 -- 172.21.15.17:0/1969907228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00009400 con 0x7f2f100b6000 2023-08-09T12:54:50.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.174+0000 7f2f07fff640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-09T12:54:50.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.175+0000 7f2f0ffff640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100b6000 0x7f2f10157630 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f2f00034040 tx=0x7f2f000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:50.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.175+0000 7f2f0d7fa640 1 -- 172.21.15.17:0/1969907228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0003ace0 con 0x7f2f100b6000 2023-08-09T12:54:50.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.175+0000 7f2f0d7fa640 1 -- 172.21.15.17:0/1969907228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2f0003ae60 con 0x7f2f100b6000 2023-08-09T12:54:50.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.175+0000 7f2f0d7fa640 1 -- 172.21.15.17:0/1969907228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00044660 con 0x7f2f100b6000 2023-08-09T12:54:50.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.175+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f10156b50 con 0x7f2f100b6000 2023-08-09T12:54:50.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.175+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f10157110 con 0x7f2f100b6000 2023-08-09T12:54:50.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.176+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f10067a80 con 0x7f2f100b6000 2023-08-09T12:54:50.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.177+0000 7f2f0d7fa640 1 -- 172.21.15.17:0/1969907228 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f0004d440 con 0x7f2f100b6000 2023-08-09T12:54:50.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.178+0000 7f2f0d7fa640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ef006a080 0x7f2ef006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-09T12:54:50.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.178+0000 7f2f0d7fa640 1 -- 172.21.15.17:0/1969907228 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2f000aa790 con 0x7f2f100b6000 2023-08-09T12:54:50.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.179+0000 7f2f07fff640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ef006a080 0x7f2ef006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-09T12:54:50.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.180+0000 7f2f07fff640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ef006a080 0x7f2ef006c540 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2f10156a60 tx=0x7f2ef8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-09T12:54:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.182+0000 7f2f0d7fa640 1 -- 172.21.15.17:0/1969907228 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178066 (secure 0 0 0) 0x7f2f00076100 con 0x7f2f100b6000 2023-08-09T12:54:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.415+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f100ceb50 con 0x7f2f100b6000 2023-08-09T12:54:50.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.416+0000 7f2f0d7fa640 1 -- 172.21.15.17:0/1969907228 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f2f00079720 con 0x7f2f100b6000 2023-08-09T12:54:50.420 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-08-09T12:54:50.420 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1595852692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1595852692},{"type":"v1","addr":"172.21.15.142:6835","nonce":1595852692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4227855635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":4227855635},{"type":"v1","addr":"172.21.15.142:6837","nonce":4227855635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":7060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/555011421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":555011421},{"type":"v1","addr":"172.21.15.17:6835","nonce":555011421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88},{"gid":9861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3582112388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3582112388},{"type":"v1","addr":"172.21.15.17:6834","nonce":3582112388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[]} 2023-08-09T12:54:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 95 2023-08-09T12:54:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ef006a080 msgr2=0x7f2ef006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ef006a080 0x7f2ef006c540 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2f10156a60 tx=0x7f2ef8009040 comp rx=0 tx=0).stop 2023-08-09T12:54:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100b6000 msgr2=0x7f2f10157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-09T12:54:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100b6000 0x7f2f10157630 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f2f00034040 tx=0x7f2f000046c0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 shutdown_connections 2023-08-09T12:54:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:6832/1755133845,v1:172.21.15.142:6833/1755133845] conn(0x7f2ef006a080 0x7f2ef006c540 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f1015ce90 0x7f2f100cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f100d29d0 0x7f2f100b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 --2- 172.21.15.17:0/1969907228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100b6000 0x7f2f10157630 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-09T12:54:50.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 >> 172.21.15.17:0/1969907228 conn(0x7f2f1006fde0 msgr2=0x7f2f100b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-09T12:54:50.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 shutdown_connections 2023-08-09T12:54:50.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-08-09T12:54:50.419+0000 7f2f167ab640 1 -- 172.21.15.17:0/1969907228 wait complete. 2023-08-09T12:54:50.443 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-09T12:54:50.444 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-09T12:54:50.444 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-09T12:54:50.445 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:54:50.470 INFO:tasks.ceph.mds.a:Stopped 2023-08-09T12:54:50.470 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-09T12:54:50.470 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:54:50.542 INFO:tasks.ceph.mds.c:Stopped 2023-08-09T12:54:50.542 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-09T12:54:50.542 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:54:50.567 INFO:tasks.ceph.mds.b:Stopped 2023-08-09T12:54:50.568 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-09T12:54:50.568 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:54:50.640 INFO:tasks.ceph.mds.d:Stopped 2023-08-09T12:54:50.640 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-09T12:54:50.641 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-09T12:54:50.641 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:54:52.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-08-09T12:54:56.743 INFO:tasks.ceph.osd.0:Stopped 2023-08-09T12:54:56.744 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-09T12:54:56.744 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:54:58.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-08-09T12:54:58.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-08-09T12:55:02.846 INFO:tasks.ceph.osd.1:Stopped 2023-08-09T12:55:02.847 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-09T12:55:02.847 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:04.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-08-09T12:55:04.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-08-09T12:55:08.949 INFO:tasks.ceph.osd.2:Stopped 2023-08-09T12:55:08.949 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-09T12:55:08.950 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:09.039 INFO:tasks.ceph.osd.3:Stopped 2023-08-09T12:55:09.039 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-09T12:55:09.039 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:09.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-08-09T12:55:09.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-08-09T12:55:14.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:55:14.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:55:15.141 INFO:tasks.ceph.osd.4:Stopped 2023-08-09T12:55:15.141 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-09T12:55:15.142 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:15.205 INFO:tasks.ceph.osd.5:Stopped 2023-08-09T12:55:15.205 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-09T12:55:15.206 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:15.251 INFO:tasks.ceph.osd.6:Stopped 2023-08-09T12:55:15.252 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-09T12:55:15.252 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:15.313 INFO:tasks.ceph.osd.7:Stopped 2023-08-09T12:55:15.314 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-09T12:55:15.314 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-09T12:55:15.315 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:15.383 INFO:tasks.ceph.mgr.y:Stopped 2023-08-09T12:55:15.384 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-09T12:55:15.385 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:15.461 INFO:tasks.ceph.mgr.x:Stopped 2023-08-09T12:55:15.461 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-09T12:55:15.462 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-09T12:55:15.462 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:15.494 INFO:tasks.ceph.mon.a:Stopped 2023-08-09T12:55:15.495 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-09T12:55:15.495 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:15.532 INFO:tasks.ceph.mon.b:Stopped 2023-08-09T12:55:15.533 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-09T12:55:15.533 INFO:teuthology.orchestra.run:waiting for 300 2023-08-09T12:55:15.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~6s 2023-08-09T12:55:15.613 INFO:tasks.ceph.mon.c:Stopped 2023-08-09T12:55:15.613 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-09T12:55:15.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-08-09T12:55:15.735 INFO:teuthology.orchestra.run.smithi017.stdout:2023-08-09T12:39:10.144954+0000 osd.7 (osd.7) 3 : cluster [WRN] OSD bench result of 96246.758209 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.7. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-08-09T12:55:15.736 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-08-09T12:55:15.736 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-08-09T12:55:15.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-08-09T12:55:15.928 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-08-09T12:55:16.019 INFO:teuthology.orchestra.run.smithi017.stdout:2023-08-09T12:39:10.144954+0000 osd.7 (osd.7) 3 : cluster [WRN] OSD bench result of 96246.758209 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.7. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-08-09T12:55:16.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:55:16.020 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-09T12:55:16.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:55:16.506 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-09T12:55:16.792 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:55:16.793 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-09T12:55:17.063 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:55:17.063 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-09T12:55:17.387 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:55:17.387 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-09T12:55:17.690 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:55:17.691 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-09T12:55:17.936 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:55:17.937 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-09T12:55:18.203 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:55:18.203 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-09T12:55:18.472 INFO:tasks.ceph:Archiving mon data... 2023-08-09T12:55:18.474 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/data/mon.a.tgz 2023-08-09T12:55:18.474 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-08-09T12:55:18.540 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.OVKKJFf3Tk 2023-08-09T12:55:18.541 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OVKKJFf3Tk 2023-08-09T12:55:18.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.OVKKJFf3Tk 2023-08-09T12:55:18.921 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.OVKKJFf3Tk is 442KB 2023-08-09T12:55:19.033 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.OVKKJFf3Tk 2023-08-09T12:55:19.097 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/data/mon.b.tgz 2023-08-09T12:55:19.098 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-08-09T12:55:19.158 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.LvkPEK49lN 2023-08-09T12:55:19.158 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LvkPEK49lN 2023-08-09T12:55:19.366 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.LvkPEK49lN 2023-08-09T12:55:19.519 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.LvkPEK49lN is 443KB 2023-08-09T12:55:19.630 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.LvkPEK49lN 2023-08-09T12:55:19.690 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/data/mon.c.tgz 2023-08-09T12:55:19.690 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-08-09T12:55:19.746 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.3GVfiy7fYk 2023-08-09T12:55:19.746 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3GVfiy7fYk 2023-08-09T12:55:19.944 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.3GVfiy7fYk 2023-08-09T12:55:20.095 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.3GVfiy7fYk is 443KB 2023-08-09T12:55:20.201 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.3GVfiy7fYk 2023-08-09T12:55:20.258 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-09T12:55:20.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-09T12:55:20.268 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-09T12:55:20.371 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-09T12:55:20.371 DEBUG:teuthology.orchestra.run.smithi017:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-09T12:55:20.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-09T12:55:20.479 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-09T12:55:20.486 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-09T12:55:20.498 INFO:tasks.ceph:Archiving crash dumps... 2023-08-09T12:55:20.500 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/remote/smithi017/crash 2023-08-09T12:55:20.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-09T12:55:20.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-08-09T12:55:20.587 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/remote/smithi142/crash 2023-08-09T12:55:20.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-09T12:55:20.691 INFO:tasks.ceph:Shutting down logrotate 2023-08-09T12:55:20.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:55:20.702 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-09T12:55:20.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-09T12:55:20.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-09T12:55:21.049 INFO:tasks.ceph:Compressing logs... 2023-08-09T12:55:21.050 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-09T12:55:21.059 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-09T12:55:21.154 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89434.log 2023-08-09T12:55:21.155 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89430.log 2023-08-09T12:55:21.156 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.89434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89434.log.gz 2023-08-09T12:55:21.156 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88323.log 2023-08-09T12:55:21.157 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101782.log 2023-08-09T12:55:21.158 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.89430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91517.log 2023-08-09T12:55:21.159 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89430.log.gz 2023-08-09T12:55:21.159 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.88323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88323.log.gz 2023-08-09T12:55:21.161 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101824.log 2023-08-09T12:55:21.161 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101698.log 2023-08-09T12:55:21.162 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101782.log.gz 2023-08-09T12:55:21.163 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91003.log 2023-08-09T12:55:21.163 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.91517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91517.log.gz 2023-08-09T12:55:21.163 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.86138.log 2023-08-09T12:55:21.164 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.91003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91003.log.gz 2023-08-09T12:55:21.164 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-09T12:55:21.164 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.3.86138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.86138.log.gz 2023-08-09T12:55:21.167 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84778.log 2023-08-09T12:55:21.168 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-09T12:55:21.168 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.84778.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84778.log.gz 2023-08-09T12:55:21.168 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.85750.log 2023-08-09T12:55:21.168 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-09T12:55:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94099.log 2023-08-09T12:55:21.169 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101824.log.gz 2023-08-09T12:55:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101698.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101698.log.gz 2023-08-09T12:55:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103116.log 2023-08-09T12:55:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94099.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94099.log.gz 2023-08-09T12:55:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120288.log 2023-08-09T12:55:21.170 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110812.log 2023-08-09T12:55:21.170 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103116.log.gz 2023-08-09T12:55:21.170 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120288.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120288.log.gz 2023-08-09T12:55:21.170 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125403.log 2023-08-09T12:55:21.170 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110812.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.110812.log.gz -- 2023-08-09T12:55:21.170 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.109688.log 2023-08-09T12:55:21.172 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125403.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125403.log.gz 2023-08-09T12:55:21.172 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103244.log 2023-08-09T12:55:21.172 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86490.log 2023-08-09T12:55:21.172 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109688.log.gz 2023-08-09T12:55:21.173 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.85750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.85750.log.gz 2023-08-09T12:55:21.173 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89929.log 2023-08-09T12:55:21.173 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-09T12:55:21.173 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.89929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89929.log.gz 2023-08-09T12:55:21.173 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87806.log 2023-08-09T12:55:21.174 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87232.log 2023-08-09T12:55:21.175 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.87806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87806.log.gz 2023-08-09T12:55:21.175 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87228.log 2023-08-09T12:55:21.176 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89130.log 2023-08-09T12:55:21.176 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103244.log.gz 2023-08-09T12:55:21.176 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109137.log 2023-08-09T12:55:21.176 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86490.log.gz 2023-08-09T12:55:21.177 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118718.log 2023-08-09T12:55:21.177 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89130.log.gz 2023-08-09T12:55:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109137.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109137.log.gz 2023-08-09T12:55:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-09T12:55:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118718.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118718.log.gz 2023-08-09T12:55:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107763.log 2023-08-09T12:55:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123741.log 2023-08-09T12:55:21.183 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107763.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107763.log.gz 2023-08-09T12:55:21.184 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119779.log 2023-08-09T12:55:21.184 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123741.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123741.log.gz 2023-08-09T12:55:21.184 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94613.log 2023-08-09T12:55:21.185 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.87232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87232.log.gz 2023-08-09T12:55:21.185 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88855.log 2023-08-09T12:55:21.185 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.87228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87228.log.gz 2023-08-09T12:55:21.185 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84818.log 2023-08-09T12:55:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.88855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88855.log.gz 2023-08-09T12:55:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.86724.log 2023-08-09T12:55:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.84818.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84818.log.gz 2023-08-09T12:55:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-09T12:55:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.86724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.86724.log.gz 2023-08-09T12:55:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.86720.log 2023-08-09T12:55:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84618.log 2023-08-09T12:55:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101908.log 2023-08-09T12:55:21.189 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119779.log.gz 2023-08-09T12:55:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118802.log 2023-08-09T12:55:21.189 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94613.log.gz 2023-08-09T12:55:21.190 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101908.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101908.log.gz -5 2023-08-09T12:55:21.190 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.111308.log 2023-08-09T12:55:21.190 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118802.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118802.log.gz 2023-08-09T12:55:21.190 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107933.log 2023-08-09T12:55:21.190 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126001.log 2023-08-09T12:55:21.191 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111308.log.gz 2023-08-09T12:55:21.192 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.86720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.86720.log.gz 2023-08-09T12:55:21.192 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84698.log 2023-08-09T12:55:21.193 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.84618.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.84618.log.gz 2023-08-09T12:55:21.193 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87810.log 2023-08-09T12:55:21.193 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.84698.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84698.log.gz 2023-08-09T12:55:21.193 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-09T12:55:21.193 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.87810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87810.log.gz 2023-08-09T12:55:21.193 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88327.log 2023-08-09T12:55:21.193 INFO:teuthology.orchestra.run.smithi142.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-09T12:55:21.203 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100009.log 2023-08-09T12:55:21.204 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107933.log.gz 2023-08-09T12:55:21.204 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115220.log 2023-08-09T12:55:21.204 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126001.log.gz 2023-08-09T12:55:21.204 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103286.log 2023-08-09T12:55:21.205 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100009.log.gz 2023-08-09T12:55:21.205 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96611.log 2023-08-09T12:55:21.205 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115220.log.gz 2023-08-09T12:55:21.205 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90450.log 2023-08-09T12:55:21.205 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103286.log.gz 2023-08-09T12:55:21.205 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127070.log 2023-08-09T12:55:21.205 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96611.log.gz 2023-08-09T12:55:21.206 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90450.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90450.log.gz 2023-08-09T12:55:21.206 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117260.log 2023-08-09T12:55:21.206 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85145.log 2023-08-09T12:55:21.206 INFO:teuthology.orchestra.run.smithi017.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.127070.log.gz 2023-08-09T12:55:21.206 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104846.log 2023-08-09T12:55:21.206 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117260.log.gz 2023-08-09T12:55:21.207 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85145.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85145.log.gz 2023-08-09T12:55:21.207 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119737.log 2023-08-09T12:55:21.207 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124497.log 2023-08-09T12:55:21.207 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104846.log.gz 2023-08-09T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.85741.log 2023-08-09T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.88327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88327.log.gz 2023-08-09T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90999.log 2023-08-09T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.85741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.85741.log.gz 2023-08-09T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90427.log 2023-08-09T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.90999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90999.log.gz 2023-08-09T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-09T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.90427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90427.log.gz 2023-08-09T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84578.log 2023-08-09T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84658.log 2023-08-09T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.84578.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.84578.log.gz 2023-08-09T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91521.log 2023-08-09T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-09T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.84658.log: /var/log/ceph/ceph-client.1.91521.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84658.log.gz 2023-08-09T12:55:21.211 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91521.log.gz 2023-08-09T12:55:21.211 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89933.log 2023-08-09T12:55:21.212 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-09T12:55:21.212 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.1.89933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89933.log.gz 2023-08-09T12:55:21.213 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90431.log 2023-08-09T12:55:21.214 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95426.log 2023-08-09T12:55:21.214 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119737.log.gz 2023-08-09T12:55:21.215 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115818.log 2023-08-09T12:55:21.215 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124497.log.gz 2023-08-09T12:55:21.215 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95426.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95426.log.gz 2023-08-09T12:55:21.215 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91935.log 2023-08-09T12:55:21.215 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106761.log 2023-08-09T12:55:21.215 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115818.log.gz 2023-08-09T12:55:21.215 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92931.log 2023-08-09T12:55:21.216 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91935.log.gz 2023-08-09T12:55:21.216 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101388.log 2023-08-09T12:55:21.216 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106761.log.gz 2023-08-09T12:55:21.216 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92931.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92931.log.gz 2023-08-09T12:55:21.216 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104290.log 2023-08-09T12:55:21.216 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123034.log 2023-08-09T12:55:21.217 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101388.log.gz 2023-08-09T12:55:21.217 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106298.log 2023-08-09T12:55:21.218 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104290.log.gz 2023-08-09T12:55:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113190.log 2023-08-09T12:55:21.218 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123034.log.gz 2023-08-09T12:55:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106298.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106298.log.gz 2023-08-09T12:55:21.219 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90204.log 2023-08-09T12:55:21.219 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102852.log 2023-08-09T12:55:21.220 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113190.log.gz 2023-08-09T12:55:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102323.log 2023-08-09T12:55:21.221 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90204.log.gz 2023-08-09T12:55:21.222 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96275.log 2023-08-09T12:55:21.222 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102852.log.gz 2023-08-09T12:55:21.224 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102323.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102323.log.gz 2023-08-09T12:55:21.224 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91416.log 2023-08-09T12:55:21.225 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96275.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96275.log.gz 2023-08-09T12:55:21.225 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127406.log 2023-08-09T12:55:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122469.log 2023-08-09T12:55:21.227 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-09T12:55:21.227 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91416.log.gz 2023-08-09T12:55:21.228 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101346.log 2023-08-09T12:55:21.228 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127406.log.gz 2023-08-09T12:55:21.229 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.90431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90431.log.gz 2023-08-09T12:55:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89088.log 2023-08-09T12:55:21.229 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122469.log.gz 2023-08-09T12:55:21.231 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101346.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101346.log.gz 2023-08-09T12:55:21.231 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91458.log 2023-08-09T12:55:21.232 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89949.log 2023-08-09T12:55:21.232 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89088.log.gz 2023-08-09T12:55:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123118.log 2023-08-09T12:55:21.234 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91458.log.gz 2023-08-09T12:55:21.234 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-09T12:55:21.235 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119653.log 2023-08-09T12:55:21.235 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89949.log.gz 2023-08-09T12:55:21.236 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110122.log 2023-08-09T12:55:21.236 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123118.log.gz 2023-08-09T12:55:21.237 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96107.log 2023-08-09T12:55:21.238 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119653.log.gz 2023-08-09T12:55:21.239 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105940.log 2023-08-09T12:55:21.239 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110122.log.gz 2023-08-09T12:55:21.240 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96107.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-09T12:55:21.241 INFO:teuthology.orchestra.run.smithi017.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96107.log.gz 2023-08-09T12:55:21.242 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105940.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.83035.log 2023-08-09T12:55:21.242 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105940.log.gz 2023-08-09T12:55:21.243 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105014.log 2023-08-09T12:55:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.tmp-client.admin.83035.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.83035.log.gz 2023-08-09T12:55:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101572.log 2023-08-09T12:55:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84615.log 2023-08-09T12:55:21.246 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105014.log.gz 2023-08-09T12:55:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101572.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101572.log.gz 2023-08-09T12:55:21.248 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106382.log 2023-08-09T12:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120204.log 2023-08-09T12:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.84615.log.gz 2023-08-09T12:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106382.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106382.log.gz 2023-08-09T12:55:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85664.log 2023-08-09T12:55:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94739.log 2023-08-09T12:55:21.253 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120204.log.gz 2023-08-09T12:55:21.254 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85664.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85664.log.gz 2023-08-09T12:55:21.254 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122679.log 2023-08-09T12:55:21.255 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85972.log 2023-08-09T12:55:21.256 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94739.log.gz 2023-08-09T12:55:21.257 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.86142.log 2023-08-09T12:55:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122679.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122679.log.gz 2023-08-09T12:55:21.258 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119527.log 2023-08-09T12:55:21.259 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95342.log 2023-08-09T12:55:21.260 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85972.log.gz 2023-08-09T12:55:21.260 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119527.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119527.log.gz 2023-08-09T12:55:21.260 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116425.log 2023-08-09T12:55:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-09T12:55:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125859.log 2023-08-09T12:55:21.263 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95342.log.gz 2023-08-09T12:55:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116425.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116425.log.gz 2023-08-09T12:55:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107486.log 2023-08-09T12:55:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94471.log 2023-08-09T12:55:21.265 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125859.log.gz 2023-08-09T12:55:21.266 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107486.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107486.log.gz 2023-08-09T12:55:21.266 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100686.log 2023-08-09T12:55:21.267 INFO:teuthology.orchestra.run.smithi142.stderr: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-09T12:55:21.268 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114063.log 2023-08-09T12:55:21.268 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94471.log.gz 2023-08-09T12:55:21.269 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84531.log 2023-08-09T12:55:21.269 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.100686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100686.log.gz 2023-08-09T12:55:21.269 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-09T12:55:21.270 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.3.86142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.86142.log.gz 2023-08-09T12:55:21.271 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.114063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114063.log.gz 2023-08-09T12:55:21.271 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106509.log 2023-08-09T12:55:21.271 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88851.log 2023-08-09T12:55:21.272 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104762.log 2023-08-09T12:55:21.273 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.84531.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84531.log.gz 2023-08-09T12:55:21.274 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106509.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106509.log.gz 2023-08-09T12:55:21.274 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106214.log 2023-08-09T12:55:21.275 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84738.log 2023-08-09T12:55:21.275 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123691.log 2023-08-09T12:55:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.88851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88851.log.gz 2023-08-09T12:55:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104762.log: /var/log/ceph/ceph-client.admin.106214.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104762.log.gz 2023-08-09T12:55:21.277 INFO:teuthology.orchestra.run.smithi017.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106214.log.gz 2023-08-09T12:55:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103872.log 2023-08-09T12:55:21.278 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103328.log 2023-08-09T12:55:21.279 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123691.log.gz 2023-08-09T12:55:21.281 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.84738.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.84738.log.gz 2023-08-09T12:55:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103872.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103872.log.gz 2023-08-09T12:55:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110374.log 2023-08-09T12:55:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116868.log 2023-08-09T12:55:21.283 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103328.log.gz 2023-08-09T12:55:21.284 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105200.log 2023-08-09T12:55:21.285 INFO:teuthology.orchestra.run.smithi017.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.110374.log.gz 2023-08-09T12:55:21.286 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102511.log 2023-08-09T12:55:21.286 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116868.log.gz 2023-08-09T12:55:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105200.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105200.log.gz 2023-08-09T12:55:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97800.log 2023-08-09T12:55:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89593.log 2023-08-09T12:55:21.289 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102511.log.gz 2023-08-09T12:55:21.290 INFO:teuthology.orchestra.run.smithi142.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-09T12:55:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97800.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97800.log.gz 2023-08-09T12:55:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106635.log 2023-08-09T12:55:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117218.log 2023-08-09T12:55:21.292 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89593.log.gz 2023-08-09T12:55:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106635.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106635.log.gz 2023-08-09T12:55:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123519.log 2023-08-09T12:55:21.296 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122217.log 2023-08-09T12:55:21.296 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117218.log.gz 2023-08-09T12:55:21.298 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125691.log 2023-08-09T12:55:21.298 INFO:teuthology.orchestra.run.smithi017.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.123519.log.gz 2023-08-09T12:55:21.299 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122217.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122217.log.gz 2023-08-09T12:55:21.300 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116996.log 2023-08-09T12:55:21.301 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115902.log 2023-08-09T12:55:21.301 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125691.log.gz 2023-08-09T12:55:21.303 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116070.log 2023-08-09T12:55:21.303 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116996.log.gz 2023-08-09T12:55:21.304 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115902.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115902.log.gz 2023-08-09T12:55:21.304 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90618.log 2023-08-09T12:55:21.306 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92763.log 2023-08-09T12:55:21.306 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116070.log.gz 2023-08-09T12:55:21.307 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90618.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90618.log.gz 2023-08-09T12:55:21.308 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116782.log 2023-08-09T12:55:21.309 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92763.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92763.log.gz 2023-08-09T12:55:21.309 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113768.log 2023-08-09T12:55:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120764.log 2023-08-09T12:55:21.311 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116782.log.gz 2023-08-09T12:55:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113768.log: gzip -5 87.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.113768.log.gz /var/log/ceph/ceph-client.admin.103914.log 2023-08-09T12:55:21.312 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120764.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120764.log.gz 2023-08-09T12:55:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115734.log 2023-08-09T12:55:21.315 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92973.log 2023-08-09T12:55:21.315 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103914.log.gz 2023-08-09T12:55:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115734.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115734.log.gz 2023-08-09T12:55:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92585.log 2023-08-09T12:55:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92973.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92973.log.gz 2023-08-09T12:55:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110708.log 2023-08-09T12:55:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101950.log 2023-08-09T12:55:21.320 INFO:teuthology.orchestra.run.smithi017.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92585.log.gz 2023-08-09T12:55:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101514.log 2023-08-09T12:55:21.322 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110708.log.gz 2023-08-09T12:55:21.323 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127616.log 2023-08-09T12:55:21.323 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101950.log.gz 2023-08-09T12:55:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86815.log 2023-08-09T12:55:21.325 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101514.log.gz 2023-08-09T12:55:21.326 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115010.log 2023-08-09T12:55:21.326 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127616.log.gz 2023-08-09T12:55:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119340.log 2023-08-09T12:55:21.328 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86815.log.gz 2023-08-09T12:55:21.329 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115010.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115010.log.gz 2023-08-09T12:55:21.330 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108531.log 2023-08-09T12:55:21.331 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122427.log 2023-08-09T12:55:21.331 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119340.log.gz 2023-08-09T12:55:21.332 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108531.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108531.log.gzgzip 2023-08-09T12:55:21.333 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.100682.log 2023-08-09T12:55:21.334 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122427.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122427.log.gz 2023-08-09T12:55:21.334 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115692.log 2023-08-09T12:55:21.335 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.100682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100682.log.gz 2023-08-09T12:55:21.335 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88962.log 2023-08-09T12:55:21.337 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115692.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.100387.log 2023-08-09T12:55:21.337 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115692.log.gz 2023-08-09T12:55:21.340 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88962.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88962.log.gz 2023-08-09T12:55:21.341 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127028.log 2023-08-09T12:55:21.341 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106803.log 2023-08-09T12:55:21.341 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100387.log.gz 2023-08-09T12:55:21.342 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127028.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127028.log.gz -5 2023-08-09T12:55:21.342 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.124906.log 2023-08-09T12:55:21.344 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109035.log 2023-08-09T12:55:21.345 INFO:teuthology.orchestra.run.smithi017.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.106803.log.gz 2023-08-09T12:55:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126127.log 2023-08-09T12:55:21.346 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124906.log.gz 2023-08-09T12:55:21.347 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90009.log 2023-08-09T12:55:21.347 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109035.log.gz 2023-08-09T12:55:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126127.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126127.log.gz 2023-08-09T12:55:21.349 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91374.log 2023-08-09T12:55:21.350 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90009.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90009.log.gz 2023-08-09T12:55:21.350 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120554.log 2023-08-09T12:55:21.351 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111086.log 2023-08-09T12:55:21.352 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91374.log.gz 2023-08-09T12:55:21.353 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116299.log 2023-08-09T12:55:21.353 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120554.log.gz 2023-08-09T12:55:21.355 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110750.log 2023-08-09T12:55:21.355 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111086.log.gz 2023-08-09T12:55:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89173.log 2023-08-09T12:55:21.357 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116299.log.gz 2023-08-09T12:55:21.358 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122595.log 2023-08-09T12:55:21.358 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110750.log.gz 2023-08-09T12:55:21.360 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89173.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.89173.log.gz 2023-08-09T12:55:21.360 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.122637.log 2023-08-09T12:55:21.362 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116952.log 2023-08-09T12:55:21.362 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122595.log.gz 2023-08-09T12:55:21.363 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89719.log 88.6% 2023-08-09T12:55:21.363 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.122637.log.gz 2023-08-09T12:55:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116952.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116952.log.gz 2023-08-09T12:55:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123477.log 2023-08-09T12:55:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89719.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89719.log.gz 2023-08-09T12:55:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114777.log 2023-08-09T12:55:21.369 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101992.log 2023-08-09T12:55:21.369 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123477.log.gz 2023-08-09T12:55:21.370 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86486.log 2023-08-09T12:55:21.370 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114777.log.gz 2023-08-09T12:55:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110248.log 2023-08-09T12:55:21.372 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101992.log.gz 2023-08-09T12:55:21.373 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105411.log 2023-08-09T12:55:21.373 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86486.log.gz 2023-08-09T12:55:21.375 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112860.log 2023-08-09T12:55:21.375 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110248.log.gz 2023-08-09T12:55:21.376 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126902.log 2023-08-09T12:55:21.376 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105411.log.gz 2023-08-09T12:55:21.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108909.log 2023-08-09T12:55:21.381 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112860.log.gz 2023-08-09T12:55:21.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123647.log 2023-08-09T12:55:21.381 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126902.log.gz 2023-08-09T12:55:21.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114186.log 2023-08-09T12:55:21.382 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108909.log.gz 2023-08-09T12:55:21.383 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123647.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123647.log.gz 2023-08-09T12:55:21.383 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127112.log 2023-08-09T12:55:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107180.log 2023-08-09T12:55:21.385 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114186.log.gz 2023-08-09T12:55:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96527.log 2023-08-09T12:55:21.387 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.127112.log.gz 2023-08-09T12:55:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97486.log 2023-08-09T12:55:21.388 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107180.log.gz 2023-08-09T12:55:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102281.log 2023-08-09T12:55:21.389 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96527.log.gz 2023-08-09T12:55:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97486.log: gzip 89.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.97486.log.gz -- 2023-08-09T12:55:21.391 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.85372.log 2023-08-09T12:55:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88836.log 2023-08-09T12:55:21.393 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102281.log.gz 2023-08-09T12:55:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119214.log 2023-08-09T12:55:21.394 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85372.log.gz 2023-08-09T12:55:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112429.log 2023-08-09T12:55:21.396 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88836.log.gz 2023-08-09T12:55:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121787.log 2023-08-09T12:55:21.397 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119214.log.gz 2023-08-09T12:55:21.399 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116562.log 2023-08-09T12:55:21.399 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112429.log.gz 2023-08-09T12:55:21.400 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89823.log 2023-08-09T12:55:21.400 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121787.log.gz 2023-08-09T12:55:21.402 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116562.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116562.log.gz 2023-08-09T12:55:21.402 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125487.log 2023-08-09T12:55:21.404 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93769.log 2023-08-09T12:55:21.404 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89823.log.gz 2023-08-09T12:55:21.405 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122301.log 2023-08-09T12:55:21.405 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125487.log.gz 2023-08-09T12:55:21.407 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112941.log 2023-08-09T12:55:21.407 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93769.log.gz 2023-08-09T12:55:21.408 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89215.log 2023-08-09T12:55:21.409 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122301.log.gz 2023-08-09T12:55:21.410 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88878.log 2023-08-09T12:55:21.410 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112941.log.gz 2023-08-09T12:55:21.411 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86817.log 2023-08-09T12:55:21.411 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89215.log.gz 2023-08-09T12:55:21.413 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-09T12:55:21.413 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88878.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88878.log.gz 2023-08-09T12:55:21.414 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109952.log 2023-08-09T12:55:21.415 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101614.log 2023-08-09T12:55:21.415 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86817.log.gz 2023-08-09T12:55:21.416 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101015.log 2023-08-09T12:55:21.417 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109952.log.gz 2023-08-09T12:55:21.418 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104122.log 2023-08-09T12:55:21.418 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101614.log.gz 2023-08-09T12:55:21.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101015.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.101015.log.gz 2023-08-09T12:55:21.420 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122117.log 2023-08-09T12:55:21.421 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92016.log 2023-08-09T12:55:21.422 INFO:teuthology.orchestra.run.smithi017.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104122.log.gz 2023-08-09T12:55:21.423 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93973.log 2023-08-09T12:55:21.423 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122117.log.gz 2023-08-09T12:55:21.425 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102427.log 2023-08-09T12:55:21.425 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92016.log.gz 2023-08-09T12:55:21.427 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99727.log 2023-08-09T12:55:21.427 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93973.log.gz 2023-08-09T12:55:21.428 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89341.log 2023-08-09T12:55:21.428 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102427.log.gz 2023-08-09T12:55:21.430 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92058.log 2023-08-09T12:55:21.430 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99727.log.gz 2023-08-09T12:55:21.432 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102050.log 2023-08-09T12:55:21.432 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89341.log.gz 2023-08-09T12:55:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92058.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.92058.log.gz -- 2023-08-09T12:55:21.433 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.100345.log 2023-08-09T12:55:21.435 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98046.log 2023-08-09T12:55:21.435 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102050.log.gz 2023-08-09T12:55:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121472.log 2023-08-09T12:55:21.437 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100345.log.gz 2023-08-09T12:55:21.438 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108867.log 2023-08-09T12:55:21.438 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98046.log.gz 2023-08-09T12:55:21.439 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119298.log 2023-08-09T12:55:21.439 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121472.log.gz 2023-08-09T12:55:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108867.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108867.log.gz 2023-08-09T12:55:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125212.log 2023-08-09T12:55:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90120.log 2023-08-09T12:55:21.443 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119298.log.gz 2023-08-09T12:55:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125212.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.125212.log.gz 2023-08-09T12:55:21.445 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.104930.log 2023-08-09T12:55:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123995.log 2023-08-09T12:55:21.446 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90120.log.gz 2023-08-09T12:55:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104930.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104930.log.gz 2023-08-09T12:55:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-09T12:55:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103370.log 2023-08-09T12:55:21.450 INFO:teuthology.orchestra.run.smithi017.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123995.log.gz 2023-08-09T12:55:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88232.log 2023-08-09T12:55:21.453 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120332.log 2023-08-09T12:55:21.453 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103370.log.gz 2023-08-09T12:55:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.88232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.88232.log.gz 2023-08-09T12:55:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110991.log 2023-08-09T12:55:21.456 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120332.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120332.log.gz 2023-08-09T12:55:21.456 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98944.log 2023-08-09T12:55:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119996.log 2023-08-09T12:55:21.458 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110991.log.gz 2023-08-09T12:55:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110038.log 2023-08-09T12:55:21.459 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98944.log.gz 2023-08-09T12:55:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119996.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119996.log.gz 2023-08-09T12:55:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86140.log 2023-08-09T12:55:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90576.log 2023-08-09T12:55:21.463 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110038.log.gz 2023-08-09T12:55:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103538.log 2023-08-09T12:55:21.464 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86140.log.gz 2023-08-09T12:55:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90576.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90576.log.gz 2023-08-09T12:55:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85836.log 2023-08-09T12:55:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108573.log 2023-08-09T12:55:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85836.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.103538.log.gz 2023-08-09T12:55:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97047.log 2023-08-09T12:55:21.469 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85836.log.gz 2023-08-09T12:55:21.470 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108573.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108573.log.gz 2023-08-09T12:55:21.470 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105557.log 2023-08-09T12:55:21.472 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108657.log 2023-08-09T12:55:21.472 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97047.log.gz 2023-08-09T12:55:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105557.log: gzip -5 --verbose 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105557.log.gz 2023-08-09T12:55:21.474 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.95935.log 2023-08-09T12:55:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108657.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108657.log.gz 2023-08-09T12:55:21.477 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86056.log 2023-08-09T12:55:21.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87022.log 2023-08-09T12:55:21.478 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95935.log.gz 2023-08-09T12:55:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98860.log 2023-08-09T12:55:21.479 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86056.log.gz 2023-08-09T12:55:21.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87022.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87022.log.gz 2023-08-09T12:55:21.481 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111350.log 2023-08-09T12:55:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98860.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98860.log.gz 2023-08-09T12:55:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105774.log 2023-08-09T12:55:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111350.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111350.log.gz 2023-08-09T12:55:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86488.log 2023-08-09T12:55:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105774.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105774.log.gz 2023-08-09T12:55:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91248.log 2023-08-09T12:55:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86488.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86488.log.gz 2023-08-09T12:55:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100219.log 2023-08-09T12:55:21.490 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91248.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91248.log.gz 2023-08-09T12:55:21.491 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.109858.log 2023-08-09T12:55:21.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100219.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100219.log.gz 2023-08-09T12:55:21.492 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112471.log 2023-08-09T12:55:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109858.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109858.log.gz 2023-08-09T12:55:21.494 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125445.log 2023-08-09T12:55:21.495 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94429.log 2023-08-09T12:55:21.495 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112471.log.gz 2023-08-09T12:55:21.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125445.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125445.log.gz 2023-08-09T12:55:21.497 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86805.log 2023-08-09T12:55:21.498 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94429.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94429.log.gz 2023-08-09T12:55:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109730.log 2023-08-09T12:55:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86805.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86805.log.gz 2023-08-09T12:55:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111518.log 2023-08-09T12:55:21.502 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109730.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109730.log.gz 2023-08-09T12:55:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92227.log 2023-08-09T12:55:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95563.log 2023-08-09T12:55:21.504 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111518.log.gz 2023-08-09T12:55:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92227.log: gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92227.log.gz 2023-08-09T12:55:21.506 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.122075.log 2023-08-09T12:55:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95563.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95563.log.gz 2023-08-09T12:55:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117132.log 2023-08-09T12:55:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122075.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122075.log.gz 2023-08-09T12:55:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102810.log 2023-08-09T12:55:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117132.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117132.log.gz 2023-08-09T12:55:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119442.log 2023-08-09T12:55:21.513 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102810.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102810.log.gz 2023-08-09T12:55:21.513 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112639.log 2023-08-09T12:55:21.514 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119442.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119442.log.gz 2023-08-09T12:55:21.516 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120076.log/var/log/ceph/ceph-client.admin.112639.log: 2023-08-09T12:55:21.516 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112639.log.gz 2023-08-09T12:55:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90288.log 2023-08-09T12:55:21.519 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120076.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120076.log.gz -5 2023-08-09T12:55:21.519 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.101656.log 2023-08-09T12:55:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.90288.log: -- /var/log/ceph/ceph-client.admin.111722.log 2023-08-09T12:55:21.521 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90288.log.gz 2023-08-09T12:55:21.522 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106467.log 2023-08-09T12:55:21.522 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101656.log.gz 2023-08-09T12:55:21.524 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111680.log 2023-08-09T12:55:21.525 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111722.log.gz 2023-08-09T12:55:21.525 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106467.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106467.log.gz 2023-08-09T12:55:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105599.log 2023-08-09T12:55:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87316.log 2023-08-09T12:55:21.528 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111680.log.gz 2023-08-09T12:55:21.528 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105599.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105599.log.gz 2023-08-09T12:55:21.529 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87754.log 2023-08-09T12:55:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89907.log 2023-08-09T12:55:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87316.log: /var/log/ceph/ceph-client.admin.87754.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93310.log 2023-08-09T12:55:21.532 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87316.log.gz 2023-08-09T12:55:21.533 INFO:teuthology.orchestra.run.smithi017.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.87754.log.gz 2023-08-09T12:55:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93433.log 2023-08-09T12:55:21.535 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110907.log 2023-08-09T12:55:21.536 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.93310.log: /var/log/ceph/ceph-client.admin.93433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93310.log.gz 2023-08-09T12:55:21.537 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93433.log.gz 2023-08-09T12:55:21.537 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89907.log.gz 2023-08-09T12:55:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98214.log 2023-08-09T12:55:21.540 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93057.log 2023-08-09T12:55:21.542 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110907.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110907.log.gz 2023-08-09T12:55:21.542 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89046.log 2023-08-09T12:55:21.542 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98214.log.gz 2023-08-09T12:55:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109814.log 2023-08-09T12:55:21.544 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93057.log.gz 2023-08-09T12:55:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121829.log 2023-08-09T12:55:21.545 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89046.log.gz 2023-08-09T12:55:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117386.log 2023-08-09T12:55:21.546 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109814.log.gz 2023-08-09T12:55:21.548 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121661.log 2023-08-09T12:55:21.548 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121829.log.gz 2023-08-09T12:55:21.551 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121368.log 2023-08-09T12:55:21.551 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117386.log.gz 2023-08-09T12:55:21.551 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95809.log 2023-08-09T12:55:21.552 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121661.log.gz 2023-08-09T12:55:21.553 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110949.log 2023-08-09T12:55:21.553 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121368.log.gz 2023-08-09T12:55:21.554 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89299.log 2023-08-09T12:55:21.555 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95809.log.gz 2023-08-09T12:55:21.555 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105982.log 2023-08-09T12:55:21.556 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110949.log.gz 2023-08-09T12:55:21.558 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89299.log: gzip -5 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89299.log.gz 2023-08-09T12:55:21.558 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97175.log 2023-08-09T12:55:21.558 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105982.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105982.log.gz 2023-08-09T12:55:21.559 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120638.log 2023-08-09T12:55:21.560 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90534.log 2023-08-09T12:55:21.561 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97175.log.gz 2023-08-09T12:55:21.562 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120638.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120638.log.gz 2023-08-09T12:55:21.562 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100261.log 2023-08-09T12:55:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99311.log 2023-08-09T12:55:21.563 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.90534.log.gz 2023-08-09T12:55:21.568 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100261.log: gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100261.log.gz 2023-08-09T12:55:21.568 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.91080.log 2023-08-09T12:55:21.568 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99311.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99311.log.gz 2023-08-09T12:55:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90792.log 2023-08-09T12:55:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91080.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91080.log.gz 2023-08-09T12:55:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122385.log 2023-08-09T12:55:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90792.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.90792.log.gz 2023-08-09T12:55:21.570 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.103158.log 2023-08-09T12:55:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122385.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122385.log.gz 2023-08-09T12:55:21.572 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96485.log 2023-08-09T12:55:21.573 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96191.log 2023-08-09T12:55:21.573 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103158.log.gz 2023-08-09T12:55:21.575 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96485.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96485.log.gz 2023-08-09T12:55:21.575 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.124229.log 2023-08-09T12:55:21.576 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96191.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96191.log.gz 2023-08-09T12:55:21.576 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101740.log 2023-08-09T12:55:21.578 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94907.log 2023-08-09T12:55:21.578 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124229.log.gz 2023-08-09T12:55:21.580 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101740.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101740.log.gz 2023-08-09T12:55:21.580 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.126043.log 2023-08-09T12:55:21.581 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94907.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94907.log.gz 2023-08-09T12:55:21.581 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99471.log 2023-08-09T12:55:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89677.log 2023-08-09T12:55:21.583 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126043.log.gz 2023-08-09T12:55:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99471.log: gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99471.log.gz 2023-08-09T12:55:21.585 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.87586.log 2023-08-09T12:55:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89677.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.89677.log.gz 2023-08-09T12:55:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106719.log 2023-08-09T12:55:21.588 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113684.log 2023-08-09T12:55:21.588 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87586.log.gz 2023-08-09T12:55:21.589 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106719.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106719.log.gz 2023-08-09T12:55:21.590 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.85622.log 2023-08-09T12:55:21.591 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113684.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113684.log.gz 2023-08-09T12:55:21.591 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84883.log 2023-08-09T12:55:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95384.log 2023-08-09T12:55:21.593 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85622.log.gz 2023-08-09T12:55:21.594 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84883.log: gzip -5 --verbose 86.9% -- replaced with /var/log/ceph/ceph-client.admin.84883.log.gz 2023-08-09T12:55:21.594 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.90834.log 2023-08-09T12:55:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95384.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95384.log.gz 2023-08-09T12:55:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115508.log 2023-08-09T12:55:21.598 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113021.log 2023-08-09T12:55:21.598 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90834.log.gz 2023-08-09T12:55:21.599 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115508.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115508.log.gz 2023-08-09T12:55:21.600 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93632.log 2023-08-09T12:55:21.601 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113021.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113021.log.gz 2023-08-09T12:55:21.601 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106593.log 2023-08-09T12:55:21.603 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96149.log 2023-08-09T12:55:21.603 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93632.log.gz 2023-08-09T12:55:21.604 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106593.log: gzip -5 88.3% --verbose -- /var/log/ceph/ceph-client.admin.108059.log 2023-08-09T12:55:21.604 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106593.log.gz 2023-08-09T12:55:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102936.log 2023-08-09T12:55:21.606 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96149.log.gz 2023-08-09T12:55:21.607 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107351.log 2023-08-09T12:55:21.608 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108059.log.gz 2023-08-09T12:55:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102936.log: gzip -5 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102936.log.gz 2023-08-09T12:55:21.609 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.101866.log 2023-08-09T12:55:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107351.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107351.log.gz 2023-08-09T12:55:21.611 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107138.log 2023-08-09T12:55:21.612 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91626.log 2023-08-09T12:55:21.612 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101866.log.gz 2023-08-09T12:55:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107138.log: gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107138.log.gz 2023-08-09T12:55:21.614 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.113876.log 2023-08-09T12:55:21.615 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91626.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91626.log.gz 2023-08-09T12:55:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99907.log 2023-08-09T12:55:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120162.log 2023-08-09T12:55:21.617 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113876.log.gz 2023-08-09T12:55:21.619 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99907.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99907.log.gz 2023-08-09T12:55:21.619 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107309.log 2023-08-09T12:55:21.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120162.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120162.log.gz 2023-08-09T12:55:21.620 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120428.log 2023-08-09T12:55:21.622 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102155.log 2023-08-09T12:55:21.622 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107309.log.gz 2023-08-09T12:55:21.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120428.log: gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120428.log.gz 2023-08-09T12:55:21.624 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.115608.log 2023-08-09T12:55:21.625 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102155.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102155.log.gz 2023-08-09T12:55:21.625 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108347.log 2023-08-09T12:55:21.627 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127280.log 2023-08-09T12:55:21.627 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115608.log.gz 2023-08-09T12:55:21.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108347.log: gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108347.log.gz 2023-08-09T12:55:21.629 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.123783.log 2023-08-09T12:55:21.629 INFO:teuthology.orchestra.run.smithi142.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-09T12:55:21.630 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127280.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127280.log.gz 2023-08-09T12:55:21.630 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125170.log 2023-08-09T12:55:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115178.log 2023-08-09T12:55:21.633 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123783.log.gz 2023-08-09T12:55:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125170.log: gzip -5 --verbose 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125170.log.gz 2023-08-09T12:55:21.634 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.127801.log 2023-08-09T12:55:21.635 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115178.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115178.log.gz 2023-08-09T12:55:21.635 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99771.log 2023-08-09T12:55:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91584.log 2023-08-09T12:55:21.637 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127801.log.gz 2023-08-09T12:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99771.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99771.log.gz 2023-08-09T12:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.89865.log 2023-08-09T12:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91584.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91584.log.gz 2023-08-09T12:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92889.log 2023-08-09T12:55:21.642 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127532.log 2023-08-09T12:55:21.642 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89865.log.gz 2023-08-09T12:55:21.644 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92889.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92889.log.gz 2023-08-09T12:55:21.644 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.102978.log 2023-08-09T12:55:21.645 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127532.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127532.log.gz 2023-08-09T12:55:21.645 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87190.log 2023-08-09T12:55:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122553.log 2023-08-09T12:55:21.647 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102978.log.gz 2023-08-09T12:55:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87190.log: gzip -5 88.5% --verbose -- /var/log/ceph/ceph-client.admin.91290.log 2023-08-09T12:55:21.649 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87190.log.gz 2023-08-09T12:55:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122553.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122553.log.gz 2023-08-09T12:55:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87892.log 2023-08-09T12:55:21.651 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99863.log 2023-08-09T12:55:21.652 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91290.log.gz 2023-08-09T12:55:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87892.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87892.log.gz 2023-08-09T12:55:21.654 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.126986.log 2023-08-09T12:55:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99863.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99863.log.gz 2023-08-09T12:55:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117176.log 2023-08-09T12:55:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115944.log 2023-08-09T12:55:21.657 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126986.log.gz 2023-08-09T12:55:21.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117176.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117176.log.gz 2023-08-09T12:55:21.658 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.99821.log 2023-08-09T12:55:21.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115944.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115944.log.gz 2023-08-09T12:55:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124079.log 2023-08-09T12:55:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119916.log 2023-08-09T12:55:21.662 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99821.log.gz 2023-08-09T12:55:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124079.log: gzip -5 88.3% --verbose -- /var/log/ceph/ceph-client.admin.89425.log 2023-08-09T12:55:21.663 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.124079.log.gz 2023-08-09T12:55:21.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119916.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119916.log.gz -5 2023-08-09T12:55:21.665 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.124037.log 2023-08-09T12:55:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92721.log 2023-08-09T12:55:21.666 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89425.log.gz 2023-08-09T12:55:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124037.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124037.log.gz 2023-08-09T12:55:21.668 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94865.log 2023-08-09T12:55:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92721.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92721.log.gz 2023-08-09T12:55:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98440.log 2023-08-09T12:55:21.671 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102469.log 2023-08-09T12:55:21.671 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94865.log.gz 2023-08-09T12:55:21.673 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98440.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98440.log.gz 2023-08-09T12:55:21.673 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.97335.log 2023-08-09T12:55:21.674 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102469.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102469.log.gz 2023-08-09T12:55:21.674 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106340.log 2023-08-09T12:55:21.676 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114377.log 2023-08-09T12:55:21.676 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97335.log.gz 2023-08-09T12:55:21.677 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98130.log 2023-08-09T12:55:21.678 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106340.log.gz 2023-08-09T12:55:21.679 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100429.log 2023-08-09T12:55:21.679 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114377.log.gz 2023-08-09T12:55:21.681 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95979.log 2023-08-09T12:55:21.681 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98130.log.gz 2023-08-09T12:55:21.682 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100429.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-09T12:55:21.683 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.100429.log.gz 2023-08-09T12:55:21.684 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109772.log 2023-08-09T12:55:21.684 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95979.log.gz 2023-08-09T12:55:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96653.log 2023-08-09T12:55:21.687 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95238.log 2023-08-09T12:55:21.687 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109772.log.gz 2023-08-09T12:55:21.689 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126818.log 2023-08-09T12:55:21.689 INFO:teuthology.orchestra.run.smithi017.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.96653.log.gz 2023-08-09T12:55:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95238.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-09T12:55:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108993.log 2023-08-09T12:55:21.690 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95238.log.gz 2023-08-09T12:55:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126379.log 2023-08-09T12:55:21.692 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126818.log.gz 2023-08-09T12:55:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103791.log 2023-08-09T12:55:21.693 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108993.log.gz 2023-08-09T12:55:21.694 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99513.log 2023-08-09T12:55:21.694 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126379.log.gz 2023-08-09T12:55:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.103791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103791.log.gz 2023-08-09T12:55:21.696 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104206.log 2023-08-09T12:55:21.696 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-09T12:55:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96924.log 2023-08-09T12:55:21.698 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99513.log.gz 2023-08-09T12:55:21.699 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106256.log 2023-08-09T12:55:21.699 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104206.log.gz 2023-08-09T12:55:21.700 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.96924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96924.log.gz 2023-08-09T12:55:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127448.log 2023-08-09T12:55:21.702 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120376.log 2023-08-09T12:55:21.702 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106256.log.gz 2023-08-09T12:55:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127448.log: gzip 87.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.104804.log 2023-08-09T12:55:21.704 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.127448.log.gz 2023-08-09T12:55:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96443.log 2023-08-09T12:55:21.705 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120376.log.gz 2023-08-09T12:55:21.707 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110290.log 2023-08-09T12:55:21.707 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104804.log.gz 2023-08-09T12:55:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96443.log: gzip -5 --verbose -- 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96443.log.gz 2023-08-09T12:55:21.714 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.87400.log 2023-08-09T12:55:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110290.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110290.log.gz 2023-08-09T12:55:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116642.log 2023-08-09T12:55:21.714 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121871.log 2023-08-09T12:55:21.714 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87400.log.gz 2023-08-09T12:55:21.715 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116642.log: gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116642.log.gz 2023-08-09T12:55:21.715 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.107891.log 2023-08-09T12:55:21.715 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121871.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121871.log.gz 2023-08-09T12:55:21.716 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115382.log 2023-08-09T12:55:21.717 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105056.log 2023-08-09T12:55:21.717 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107891.log.gz 2023-08-09T12:55:21.718 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115382.log: gzip -5 88.9% --verbose -- /var/log/ceph/ceph-client.admin.106024.log 2023-08-09T12:55:21.719 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115382.log.gz 2023-08-09T12:55:21.720 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119172.log 2023-08-09T12:55:21.720 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105056.log.gz 2023-08-09T12:55:21.721 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109221.log 2023-08-09T12:55:21.722 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106024.log.gz 2023-08-09T12:55:21.723 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87712.log 2023-08-09T12:55:21.723 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119172.log.gz 2023-08-09T12:55:21.724 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109221.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109221.log.gz 2023-08-09T12:55:21.725 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98776.log 2023-08-09T12:55:21.727 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87712.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87712.log.gz 2023-08-09T12:55:21.727 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107679.log 2023-08-09T12:55:21.728 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98776.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98776.log.gz 2023-08-09T12:55:21.728 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90708.log 2023-08-09T12:55:21.730 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115650.log 2023-08-09T12:55:21.730 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107679.log.gz 2023-08-09T12:55:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90708.log: gzip -5 --verbose -- 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90708.log.gz 2023-08-09T12:55:21.732 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.97570.log 2023-08-09T12:55:21.733 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115650.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115650.log.gz 2023-08-09T12:55:21.733 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114419.log 2023-08-09T12:55:21.735 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91500.log 2023-08-09T12:55:21.735 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97570.log.gz 2023-08-09T12:55:21.737 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114419.log: gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114419.log.gz 2023-08-09T12:55:21.737 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.120680.log 2023-08-09T12:55:21.738 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91500.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91500.log.gz 2023-08-09T12:55:21.738 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88920.log 2023-08-09T12:55:21.740 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111764.log 2023-08-09T12:55:21.740 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120680.log.gz 2023-08-09T12:55:21.742 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92353.log 2023-08-09T12:55:21.742 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88920.log.gz 2023-08-09T12:55:21.743 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111764.log: gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111764.log.gz 2023-08-09T12:55:21.743 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.121100.log 2023-08-09T12:55:21.744 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92353.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92353.log.gz 2023-08-09T12:55:21.745 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105515.log 2023-08-09T12:55:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121100.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-09T12:55:21.747 INFO:teuthology.orchestra.run.smithi017.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.121100.log.gz 2023-08-09T12:55:21.749 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105515.log: gzip -5 --verbose 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105515.log.gz 2023-08-09T12:55:21.749 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.125571.log 2023-08-09T12:55:21.750 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95280.log 2023-08-09T12:55:21.752 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125571.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125571.log.gz 2023-08-09T12:55:21.752 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98172.log 2023-08-09T12:55:21.753 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95280.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95280.log.gz 2023-08-09T12:55:21.754 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89781.log 2023-08-09T12:55:21.755 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98172.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.98172.log.gz 2023-08-09T12:55:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87064.log 2023-08-09T12:55:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89781.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89781.log.gz 2023-08-09T12:55:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117428.log 2023-08-09T12:55:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87064.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87064.log.gz 2023-08-09T12:55:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100093.log 2023-08-09T12:55:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116131.log 2023-08-09T12:55:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117428.log: /var/log/ceph/ceph-client.admin.100093.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122511.log 2023-08-09T12:55:21.763 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100093.log.gz 2023-08-09T12:55:21.763 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117428.log.gz 2023-08-09T12:55:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95851.log 2023-08-09T12:55:21.764 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116131.log.gz 2023-08-09T12:55:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120118.log 2023-08-09T12:55:21.766 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122511.log.gz 2023-08-09T12:55:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95851.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123603.log 2023-08-09T12:55:21.767 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95851.log.gz 2023-08-09T12:55:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124601.log 2023-08-09T12:55:21.769 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120118.log.gz 2023-08-09T12:55:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126169.log 2023-08-09T12:55:21.770 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123603.log.gz 2023-08-09T12:55:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93314.log 2023-08-09T12:55:21.772 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124601.log.gz 2023-08-09T12:55:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126169.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126169.log.gz 2023-08-09T12:55:21.774 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.86489.log 2023-08-09T12:55:21.774 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.93314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93314.log.gz 2023-08-09T12:55:21.775 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120512.log 2023-08-09T12:55:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86489.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86489.log.gz 2023-08-09T12:55:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102197.log 2023-08-09T12:55:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120512.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120512.log.gz 2023-08-09T12:55:21.779 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94261.log 2023-08-09T12:55:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102197.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102197.log.gz 2023-08-09T12:55:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112681.log 2023-08-09T12:55:21.782 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94261.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94261.log.gz 2023-08-09T12:55:21.782 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125044.log 2023-08-09T12:55:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112681.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112681.log.gz 2023-08-09T12:55:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123827.log 2023-08-09T12:55:21.786 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125044.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125044.log.gz 2023-08-09T12:55:21.786 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92677.log 2023-08-09T12:55:21.787 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123827.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123827.log.gz 2023-08-09T12:55:21.788 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122782.log 2023-08-09T12:55:21.789 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92677.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92677.log.gz 2023-08-09T12:55:21.790 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94345.log 2023-08-09T12:55:21.792 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122782.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122782.log.gz 2023-08-09T12:55:21.792 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111806.log 2023-08-09T12:55:21.794 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94345.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94345.log.gz 2023-08-09T12:55:21.795 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95069.log 2023-08-09T12:55:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111806.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111806.log.gz 2023-08-09T12:55:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119382.log 2023-08-09T12:55:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95069.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95069.log.gz 2023-08-09T12:55:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96359.log 2023-08-09T12:55:21.799 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100135.log 2023-08-09T12:55:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119382.log: /var/log/ceph/ceph-client.admin.96359.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105285.log 2023-08-09T12:55:21.801 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96359.log.gz 2023-08-09T12:55:21.801 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.119382.log.gz 2023-08-09T12:55:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118056.log 2023-08-09T12:55:21.802 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100135.log.gz 2023-08-09T12:55:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126542.log 2023-08-09T12:55:21.803 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105285.log.gz 2023-08-09T12:55:21.804 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85928.log 2023-08-09T12:55:21.805 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118056.log.gz 2023-08-09T12:55:21.806 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117746.log 2023-08-09T12:55:21.806 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126542.log.gz 2023-08-09T12:55:21.807 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119088.log 2023-08-09T12:55:21.807 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85928.log.gz 2023-08-09T12:55:21.809 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101183.log 2023-08-09T12:55:21.809 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117746.log.gz 2023-08-09T12:55:21.810 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126295.log 2023-08-09T12:55:21.810 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119088.log.gz 2023-08-09T12:55:21.812 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118760.log 2023-08-09T12:55:21.812 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101183.log.gz 2023-08-09T12:55:21.813 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90330.log 2023-08-09T12:55:21.813 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126295.log.gz 2023-08-09T12:55:21.815 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118760.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118760.log.gz 2023-08-09T12:55:21.815 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99641.log 2023-08-09T12:55:21.816 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90330.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90330.log.gz 2023-08-09T12:55:21.817 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91038.log 2023-08-09T12:55:21.818 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99641.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99641.log.gz 2023-08-09T12:55:21.819 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125817.log 2023-08-09T12:55:21.820 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91038.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91038.log.gz 2023-08-09T12:55:21.820 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93015.log 2023-08-09T12:55:21.821 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125817.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125817.log.gz 2023-08-09T12:55:21.822 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122343.log 2023-08-09T12:55:21.823 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93015.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93015.log.gz 2023-08-09T12:55:21.824 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94303.log 2023-08-09T12:55:21.826 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122343.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122343.log.gz 2023-08-09T12:55:21.826 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109179.log 2023-08-09T12:55:21.827 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94303.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94303.log.gz 2023-08-09T12:55:21.828 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121410.log 2023-08-09T12:55:21.829 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109179.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109179.log.gz 2023-08-09T12:55:21.830 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106128.log 2023-08-09T12:55:21.830 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121410.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121410.log.gz 2023-08-09T12:55:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91855.log 2023-08-09T12:55:21.833 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106128.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106128.log.gz 2023-08-09T12:55:21.833 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121991.log 2023-08-09T12:55:21.834 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91855.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91855.log.gz 2023-08-09T12:55:21.835 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123391.log 2023-08-09T12:55:21.836 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121991.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.121991.log.gz 2023-08-09T12:55:21.837 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118513.log 2023-08-09T12:55:21.838 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123391.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123391.log.gz 2023-08-09T12:55:21.838 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113600.log 2023-08-09T12:55:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118513.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118513.log.gz 2023-08-09T12:55:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106677.log 2023-08-09T12:55:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113600.log.gz 2023-08-09T12:55:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103496.log 2023-08-09T12:55:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106677.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106677.log.gz 2023-08-09T12:55:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97217.log 2023-08-09T12:55:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103496.log.gz 2023-08-09T12:55:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126253.log 2023-08-09T12:55:21.847 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97217.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97217.log.gz 2023-08-09T12:55:21.848 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112200.log 2023-08-09T12:55:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126253.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126253.log.gz 2023-08-09T12:55:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118555.log 2023-08-09T12:55:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112200.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86014.log 2023-08-09T12:55:21.852 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112200.log.gz 2023-08-09T12:55:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103412.log 2023-08-09T12:55:21.854 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118555.log.gz 2023-08-09T12:55:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86014.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86014.log.gz 2023-08-09T12:55:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107426.log 2023-08-09T12:55:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103412.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103412.log.gz 2023-08-09T12:55:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90246.log 2023-08-09T12:55:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107426.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107426.log.gz 2023-08-09T12:55:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88361.log 2023-08-09T12:55:21.860 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90246.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90246.log.gz 2023-08-09T12:55:21.860 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.0.117937.log 2023-08-09T12:55:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88361.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88361.log.gz 2023-08-09T12:55:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102606.log 2023-08-09T12:55:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.117937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.117937.log.gz 2023-08-09T12:55:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99216.log 2023-08-09T12:55:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102606.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102606.log.gz 2023-08-09T12:55:21.865 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114144.log 2023-08-09T12:55:21.866 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99216.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99216.log.gz 2023-08-09T12:55:21.867 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95893.log 2023-08-09T12:55:21.868 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111638.log 2023-08-09T12:55:21.870 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114144.log: /var/log/ceph/ceph-client.admin.95893.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111392.log 2023-08-09T12:55:21.870 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95893.log.gz 2023-08-09T12:55:21.870 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114144.log.gz 2023-08-09T12:55:21.871 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111638.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111638.log.gz 2023-08-09T12:55:21.871 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105243.log 2023-08-09T12:55:21.873 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107595.log 2023-08-09T12:55:21.874 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111392.log: /var/log/ceph/ceph-client.admin.105243.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111392.log.gz 2023-08-09T12:55:21.875 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89467.log 2023-08-09T12:55:21.875 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105243.log.gz 2023-08-09T12:55:21.876 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107595.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107595.log.gz 2023-08-09T12:55:21.876 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108783.log 2023-08-09T12:55:21.878 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126439.log 2023-08-09T12:55:21.878 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89467.log.gz 2023-08-09T12:55:21.879 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95643.log 2023-08-09T12:55:21.880 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108783.log.gz 2023-08-09T12:55:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118962.log 2023-08-09T12:55:21.881 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126439.log.gz 2023-08-09T12:55:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95766.log 2023-08-09T12:55:21.883 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95643.log.gz 2023-08-09T12:55:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98692.log 2023-08-09T12:55:21.884 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118962.log.gz 2023-08-09T12:55:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95766.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88794.log 2023-08-09T12:55:21.885 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95766.log.gz 2023-08-09T12:55:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86098.log 2023-08-09T12:55:21.887 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98692.log.gz 2023-08-09T12:55:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109347.log 2023-08-09T12:55:21.889 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88794.log.gz 2023-08-09T12:55:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86098.log: gzip 89.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.103604.log 2023-08-09T12:55:21.890 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86098.log.gz 2023-08-09T12:55:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109347.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98398.log 2023-08-09T12:55:21.891 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109347.log.gz 2023-08-09T12:55:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103604.log: gzip -5 --verbose 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103604.log.gz 2023-08-09T12:55:21.893 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.96317.log 2023-08-09T12:55:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98398.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98398.log.gz 2023-08-09T12:55:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127154.log 2023-08-09T12:55:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96317.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96317.log.gz 2023-08-09T12:55:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125959.log 2023-08-09T12:55:21.898 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127154.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127154.log.gz 2023-08-09T12:55:21.898 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108489.log 2023-08-09T12:55:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125959.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125959.log.gz 2023-08-09T12:55:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113726.log 2023-08-09T12:55:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108489.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108489.log.gz 2023-08-09T12:55:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115986.log 2023-08-09T12:55:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113726.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113726.log.gz 2023-08-09T12:55:21.904 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118429.log 2023-08-09T12:55:21.905 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115986.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115986.log.gz 2023-08-09T12:55:21.906 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97293.log 2023-08-09T12:55:21.907 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118429.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118429.log.gz 2023-08-09T12:55:21.908 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113320.log 2023-08-09T12:55:21.909 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97293.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97293.log.gz 2023-08-09T12:55:21.909 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98482.log 2023-08-09T12:55:21.911 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113320.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113320.log.gz 2023-08-09T12:55:21.911 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104164.log 2023-08-09T12:55:21.913 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98482.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100763.log 2023-08-09T12:55:21.913 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98482.log.gz 2023-08-09T12:55:21.914 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104164.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.2.88665.log 2023-08-09T12:55:21.914 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104164.log.gz 2023-08-09T12:55:21.916 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113370.log 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100763.log.gz 2023-08-09T12:55:21.916 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:21.917 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.2.88665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.88665.log.gz 2023-08-09T12:55:21.917 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120470.log 2023-08-09T12:55:21.919 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86818.log 2023-08-09T12:55:21.919 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113370.log.gz 2023-08-09T12:55:21.921 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120470.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120470.log.gz 2023-08-09T12:55:21.921 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90408.log 2023-08-09T12:55:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86818.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86818.log.gz 2023-08-09T12:55:21.923 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.108017.log 2023-08-09T12:55:21.924 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90408.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90408.log.gz 2023-08-09T12:55:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95009.log 2023-08-09T12:55:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108017.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108017.log.gz 2023-08-09T12:55:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110440.log 2023-08-09T12:55:21.928 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95009.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95009.log.gz 2023-08-09T12:55:21.929 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117302.log 2023-08-09T12:55:21.931 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110440.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110440.log.gz 2023-08-09T12:55:21.931 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97842.log 2023-08-09T12:55:21.932 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117302.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117302.log.gz 2023-08-09T12:55:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112116.log 2023-08-09T12:55:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97842.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97842.log.gz 2023-08-09T12:55:21.935 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105327.log 2023-08-09T12:55:21.935 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-08-09T12:55:21.936 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112116.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112116.log.gz 2023-08-09T12:55:21.936 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99132.log 2023-08-09T12:55:21.938 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105327.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.105327.log.gz 2023-08-09T12:55:21.938 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.117344.log 2023-08-09T12:55:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99132.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99132.log.gz 2023-08-09T12:55:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90162.log 2023-08-09T12:55:21.941 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124948.log 2023-08-09T12:55:21.941 INFO:teuthology.orchestra.run.smithi017.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.117344.log.gz 2023-08-09T12:55:21.941 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90162.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90162.log.gz 2023-08-09T12:55:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108741.log 2023-08-09T12:55:21.943 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124948.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124948.log.gz 2023-08-09T12:55:21.944 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93495.log 2023-08-09T12:55:21.945 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108741.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108741.log.gz 2023-08-09T12:55:21.945 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94057.log 2023-08-09T12:55:21.947 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93495.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93495.log.gz 2023-08-09T12:55:21.947 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94141.log 2023-08-09T12:55:21.948 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94057.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.94057.log.gz /var/log/ceph/ceph-client.admin.85580.log 2023-08-09T12:55:21.948 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:21.950 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108101.log 2023-08-09T12:55:21.950 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94141.log.gz 2023-08-09T12:55:21.951 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85580.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.85580.log.gz 2023-08-09T12:55:21.951 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111948.log 2023-08-09T12:55:21.952 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114537.log 2023-08-09T12:55:21.953 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108101.log.gz 2023-08-09T12:55:21.954 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111948.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111948.log.gz 2023-08-09T12:55:21.954 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108263.log 2023-08-09T12:55:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114537.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114537.log.gz 2023-08-09T12:55:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122723.log 2023-08-09T12:55:21.957 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108263.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.108263.log.gz --verbose 2023-08-09T12:55:21.957 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.116028.log 2023-08-09T12:55:21.958 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122723.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122723.log.gz 2023-08-09T12:55:21.959 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104410.log 2023-08-09T12:55:21.960 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116028.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116028.log.gz 2023-08-09T12:55:21.960 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125529.log 2023-08-09T12:55:21.962 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104410.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104410.log.gz 2023-08-09T12:55:21.962 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87106.log 2023-08-09T12:55:21.963 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125529.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125529.log.gz 2023-08-09T12:55:21.963 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105140.log 2023-08-09T12:55:21.965 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87106.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87106.log.gz 2023-08-09T12:55:21.965 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95724.log 2023-08-09T12:55:21.966 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105140.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105140.log.gz 2023-08-09T12:55:21.967 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105694.log 2023-08-09T12:55:21.968 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95724.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.114461.log 2023-08-09T12:55:21.968 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95724.log.gz 2023-08-09T12:55:21.970 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105694.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.105694.log.gz --verbose 2023-08-09T12:55:21.970 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.118014.log 2023-08-09T12:55:21.971 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114461.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114461.log.gz 2023-08-09T12:55:21.971 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116826.log 2023-08-09T12:55:21.973 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118014.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.118014.log.gz -5 2023-08-09T12:55:21.973 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.113063.log 2023-08-09T12:55:21.974 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116826.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116826.log.gz 2023-08-09T12:55:21.974 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90918.log 2023-08-09T12:55:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113063.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.113063.log.gz /var/log/ceph/ceph-client.admin.104888.log 2023-08-09T12:55:21.976 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:21.977 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90918.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.90918.log.gz -5 2023-08-09T12:55:21.978 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108179.log 2023-08-09T12:55:21.979 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111990.log 2023-08-09T12:55:21.979 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104888.log.gz 2023-08-09T12:55:21.980 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108179.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108179.log.gz 2023-08-09T12:55:21.980 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115052.log 2023-08-09T12:55:21.981 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127364.log 2023-08-09T12:55:21.982 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111990.log.gz 2023-08-09T12:55:21.983 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115052.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115052.log.gz 2023-08-09T12:55:21.983 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127322.log 2023-08-09T12:55:21.984 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127364.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127364.log.gz 2023-08-09T12:55:21.985 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122950.log 2023-08-09T12:55:21.986 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127322.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127322.log.gz 2023-08-09T12:55:21.987 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.117933.log 2023-08-09T12:55:21.988 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122950.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122950.log.gz 2023-08-09T12:55:21.988 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93391.log 2023-08-09T12:55:21.989 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.117933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91710.log 2023-08-09T12:55:21.990 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.117933.log.gz 2023-08-09T12:55:21.991 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93391.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93391.log.gz 2023-08-09T12:55:21.991 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.104972.log 2023-08-09T12:55:21.992 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91710.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91710.log.gz 2023-08-09T12:55:21.993 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112597.log 2023-08-09T12:55:21.994 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87628.log 2023-08-09T12:55:21.994 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104972.log.gz 2023-08-09T12:55:21.996 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112597.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112597.log.gz 2023-08-09T12:55:21.996 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.126337.log 2023-08-09T12:55:21.996 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87628.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87628.log.gz 2023-08-09T12:55:21.997 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126085.log 2023-08-09T12:55:21.998 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126337.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126337.log.gz 2023-08-09T12:55:21.999 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86825.log 2023-08-09T12:55:22.000 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126085.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126085.log.gz 2023-08-09T12:55:22.000 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91813.log 2023-08-09T12:55:22.002 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86825.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.86825.log.gz 2023-08-09T12:55:22.002 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102686.log 2023-08-09T12:55:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91813.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91813.log.gz 2023-08-09T12:55:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119004.log 2023-08-09T12:55:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102686.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102686.log.gz 2023-08-09T12:55:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126626.log 2023-08-09T12:55:22.006 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119004.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119004.log.gz 2023-08-09T12:55:22.006 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114717.log 2023-08-09T12:55:22.008 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101430.log 2023-08-09T12:55:22.008 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126626.log.gz 2023-08-09T12:55:22.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114717.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114717.log.gz 2023-08-09T12:55:22.010 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108951.log 2023-08-09T12:55:22.011 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101430.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101430.log.gz 2023-08-09T12:55:22.011 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120848.log 2023-08-09T12:55:22.012 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113810.log 2023-08-09T12:55:22.013 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108951.log.gz 2023-08-09T12:55:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120848.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120848.log.gz 2023-08-09T12:55:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85886.log 2023-08-09T12:55:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113810.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.113810.log.gz 2023-08-09T12:55:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85886.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.85886.log.gz 2023-08-09T12:55:22.019 INFO:teuthology.orchestra.run.smithi017.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-08-09T12:55:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98256.log 2023-08-09T12:55:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104678.log 2023-08-09T12:55:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98256.log: gzip 88.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.108447.log 2023-08-09T12:55:22.024 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98256.log.gz 2023-08-09T12:55:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101472.log 2023-08-09T12:55:22.026 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104678.log.gz 2023-08-09T12:55:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108447.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108447.log.gz 2023-08-09T12:55:22.028 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98818.log 2023-08-09T12:55:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119821.log 2023-08-09T12:55:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101472.log: /var/log/ceph/ceph-client.admin.98818.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101472.log.gz 2023-08-09T12:55:22.032 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98818.log.gz 2023-08-09T12:55:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91206.log 2023-08-09T12:55:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90492.log 2023-08-09T12:55:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119821.log: /var/log/ceph/ceph-client.admin.91206.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119821.log.gz 2023-08-09T12:55:22.035 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91206.log.gz 2023-08-09T12:55:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126211.log 2023-08-09T12:55:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114819.log 2023-08-09T12:55:22.037 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90492.log.gz 2023-08-09T12:55:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126211.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126211.log.gz 2023-08-09T12:55:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104494.log 2023-08-09T12:55:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86824.log 2023-08-09T12:55:22.040 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114819.log.gz 2023-08-09T12:55:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104494.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104494.log.gz 2023-08-09T12:55:22.041 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96023.log 2023-08-09T12:55:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86824.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86824.log.gz 2023-08-09T12:55:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98524.log 2023-08-09T12:55:22.043 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99028.log 2023-08-09T12:55:22.044 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96023.log.gz 2023-08-09T12:55:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98524.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98524.log.gz 2023-08-09T12:55:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112032.log 2023-08-09T12:55:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99028.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99028.log.gz 2023-08-09T12:55:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121034.log 2023-08-09T12:55:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118118.log 2023-08-09T12:55:22.048 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112032.log.gz 2023-08-09T12:55:22.049 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103066.log 2023-08-09T12:55:22.049 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.121034.log.gz 2023-08-09T12:55:22.050 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118118.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118118.log.gz 2023-08-09T12:55:22.050 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118634.log 2023-08-09T12:55:22.051 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85792.log 2023-08-09T12:55:22.052 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103066.log.gz 2023-08-09T12:55:22.053 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118634.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118634.log.gz 2023-08-09T12:55:22.053 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111434.log 2023-08-09T12:55:22.054 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85792.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85792.log.gz 2023-08-09T12:55:22.055 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105098.log 2023-08-09T12:55:22.055 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111434.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111434.log.gz 2023-08-09T12:55:22.056 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116910.log 2023-08-09T12:55:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110080.log 2023-08-09T12:55:22.057 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105098.log.gz 2023-08-09T12:55:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116910.log.gz 2023-08-09T12:55:22.059 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94655.log 2023-08-09T12:55:22.060 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110080.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110080.log.gz 2023-08-09T12:55:22.060 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123231.log 2023-08-09T12:55:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94655.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.94655.log.gz -5 2023-08-09T12:55:22.062 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94529.log 2023-08-09T12:55:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123231.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123231.log.gz 2023-08-09T12:55:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118676.log 2023-08-09T12:55:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117470.log 2023-08-09T12:55:22.065 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94529.log.gz 2023-08-09T12:55:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118676.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118676.log.gz 2023-08-09T12:55:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101057.log 2023-08-09T12:55:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117470.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117470.log.gz 2023-08-09T12:55:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108221.log 2023-08-09T12:55:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101057.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101057.log.gz 2023-08-09T12:55:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122159.log 2023-08-09T12:55:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.88661.log 2023-08-09T12:55:22.070 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108221.log.gz 2023-08-09T12:55:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122159.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122159.log.gz 2023-08-09T12:55:22.072 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85538.log 2023-08-09T12:55:22.072 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.2.88661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.88661.log.gz 2023-08-09T12:55:22.073 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125733.log 2023-08-09T12:55:22.074 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85538.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.85538.log.gz 2023-08-09T12:55:22.075 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108615.log 2023-08-09T12:55:22.075 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125733.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125733.log.gz 2023-08-09T12:55:22.076 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99090.log 2023-08-09T12:55:22.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106424.log 2023-08-09T12:55:22.077 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108615.log.gz 2023-08-09T12:55:22.078 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99090.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99090.log.gz 2023-08-09T12:55:22.079 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122824.log 2023-08-09T12:55:22.079 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106424.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106424.log.gz 2023-08-09T12:55:22.080 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104332.log 2023-08-09T12:55:22.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86308.log 2023-08-09T12:55:22.081 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122824.log.gz 2023-08-09T12:55:22.083 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104332.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104332.log.gz 2023-08-09T12:55:22.083 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125649.log 2023-08-09T12:55:22.084 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86308.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86308.log.gz 2023-08-09T12:55:22.084 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113642.log 2023-08-09T12:55:22.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94183.log 2023-08-09T12:55:22.086 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113642.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125649.log.gz 2023-08-09T12:55:22.086 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113642.log.gz 2023-08-09T12:55:22.087 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113558.log 2023-08-09T12:55:22.088 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94183.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94183.log.gz 2023-08-09T12:55:22.088 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119130.log 2023-08-09T12:55:22.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98356.log 2023-08-09T12:55:22.090 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113558.log.gz 2023-08-09T12:55:22.090 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119130.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119130.log.gz 2023-08-09T12:55:22.091 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106869.log 2023-08-09T12:55:22.092 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98356.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98356.log.gz 2023-08-09T12:55:22.092 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89004.log 2023-08-09T12:55:22.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106869.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-09T12:55:22.094 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106869.log.gz 2023-08-09T12:55:22.094 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89004.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89004.log.gz 2023-08-09T12:55:22.095 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115860.log 2023-08-09T12:55:22.096 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116173.log 2023-08-09T12:55:22.098 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111906.log 87.7% 2023-08-09T12:55:22.098 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115860.log.gz 2023-08-09T12:55:22.099 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127759.log 2023-08-09T12:55:22.099 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116173.log.gz 2023-08-09T12:55:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111906.log: gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111906.log.gz 2023-08-09T12:55:22.101 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.89257.log 2023-08-09T12:55:22.102 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127759.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127759.log.gz 2023-08-09T12:55:22.102 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92143.log 2023-08-09T12:55:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109442.log 2023-08-09T12:55:22.104 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89257.log.gz 2023-08-09T12:55:22.105 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92143.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92143.log.gz 2023-08-09T12:55:22.106 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99683.log 2023-08-09T12:55:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109442.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109442.log.gz 2023-08-09T12:55:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103795.log 2023-08-09T12:55:22.108 INFO:teuthology.orchestra.run.smithi017.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-09T12:55:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99683.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99683.log.gz 2023-08-09T12:55:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93123.log 2023-08-09T12:55:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.103795.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.0.103795.log.gz --verbose 2023-08-09T12:55:22.110 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.95112.log 2023-08-09T12:55:22.111 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93123.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93123.log.gz 2023-08-09T12:55:22.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-09T12:55:22.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95112.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95112.log.gz 2023-08-09T12:55:22.113 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123561.log 2023-08-09T12:55:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102239.log 2023-08-09T12:55:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123561.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123561.log.gz 2023-08-09T12:55:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114675.log 2023-08-09T12:55:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102239.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.102239.log.gz --verbose 2023-08-09T12:55:22.117 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.120806.log 2023-08-09T12:55:22.119 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89635.log 2023-08-09T12:55:22.119 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114675.log.gz 2023-08-09T12:55:22.120 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106066.log 2023-08-09T12:55:22.120 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120806.log.gz 2023-08-09T12:55:22.122 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89635.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89635.log.gz 2023-08-09T12:55:22.122 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100805.log 2023-08-09T12:55:22.123 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106066.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106066.log.gz 2023-08-09T12:55:22.123 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100051.log 2023-08-09T12:55:22.125 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100805.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100805.log.gz 2023-08-09T12:55:22.125 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120950.log 2023-08-09T12:55:22.126 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100051.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100051.log.gz 2023-08-09T12:55:22.127 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98566.log 2023-08-09T12:55:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120950.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120950.log.gz 2023-08-09T12:55:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121287.log 2023-08-09T12:55:22.129 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98566.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98566.log.gz 2023-08-09T12:55:22.130 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127490.log 2023-08-09T12:55:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.121287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121287.log.gz 2023-08-09T12:55:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97444.log 2023-08-09T12:55:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127490.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127490.log.gz 2023-08-09T12:55:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85194.log 2023-08-09T12:55:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97444.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97444.log.gz 2023-08-09T12:55:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-09T12:55:22.136 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85194.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85194.log.gz 2023-08-09T12:55:22.136 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94967.log 2023-08-09T12:55:22.137 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114067.log 2023-08-09T12:55:22.139 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94823.log 87.7% 2023-08-09T12:55:22.139 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94967.log.gz 2023-08-09T12:55:22.140 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.114067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114067.log.gz 2023-08-09T12:55:22.140 INFO:teuthology.orchestra.run.smithi017.stderr: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-09T12:55:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125775.log 2023-08-09T12:55:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126944.log 2023-08-09T12:55:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94823.log: /var/log/ceph/ceph-client.admin.125775.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94823.log.gz 2023-08-09T12:55:22.143 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125775.log.gz 2023-08-09T12:55:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105369.log 2023-08-09T12:55:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98650.log 2023-08-09T12:55:22.145 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126944.log.gz 2023-08-09T12:55:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105369.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126500.log 2023-08-09T12:55:22.146 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105369.log.gz 2023-08-09T12:55:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98650.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98650.log.gz 2023-08-09T12:55:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115298.log 2023-08-09T12:55:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126584.log 2023-08-09T12:55:22.149 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126500.log.gz 2023-08-09T12:55:22.150 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115298.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115298.log.gz 2023-08-09T12:55:22.150 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87274.log 2023-08-09T12:55:22.151 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126584.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126584.log.gz 2023-08-09T12:55:22.152 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98314.log 2023-08-09T12:55:22.152 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87274.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87274.log.gz 2023-08-09T12:55:22.153 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92635.log 2023-08-09T12:55:22.154 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104720.log 2023-08-09T12:55:22.155 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98314.log.gz 2023-08-09T12:55:22.155 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92635.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92635.log.gz 2023-08-09T12:55:22.156 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111596.log 2023-08-09T12:55:22.157 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95196.log 2023-08-09T12:55:22.157 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104720.log.gz 2023-08-09T12:55:22.158 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100303.log 2023-08-09T12:55:22.158 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111596.log.gz 2023-08-09T12:55:22.160 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119695.log 2023-08-09T12:55:22.160 INFO:teuthology.orchestra.run.smithi017.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95196.log.gz 2023-08-09T12:55:22.161 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113456.log 2023-08-09T12:55:22.162 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100303.log.gz 2023-08-09T12:55:22.162 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119695.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119695.log.gz 2023-08-09T12:55:22.163 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108825.log 2023-08-09T12:55:22.164 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114579.log 2023-08-09T12:55:22.164 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113456.log.gz 2023-08-09T12:55:22.165 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108825.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108825.log.gz 2023-08-09T12:55:22.166 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91770.log 2023-08-09T12:55:22.167 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114579.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114579.log.gz 2023-08-09T12:55:22.167 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103454.log 2023-08-09T12:55:22.169 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91770.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.91770.log.gz --verbose 2023-08-09T12:55:22.169 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.0.96928.log 2023-08-09T12:55:22.170 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103454.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103454.log.gz 2023-08-09T12:55:22.170 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85453.log 2023-08-09T12:55:22.171 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.96928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96928.log.gz 2023-08-09T12:55:22.172 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121949.log 2023-08-09T12:55:22.173 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85453.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85453.log.gz 2023-08-09T12:55:22.173 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117040.log 2023-08-09T12:55:22.175 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121949.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121949.log.gz 2023-08-09T12:55:22.175 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116738.log 2023-08-09T12:55:22.176 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117040.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117040.log.gz 2023-08-09T12:55:22.177 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99949.log 2023-08-09T12:55:22.178 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116738.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116738.log.gz 2023-08-09T12:55:22.179 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92479.log 2023-08-09T12:55:22.180 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99949.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99949.log.gz 2023-08-09T12:55:22.180 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112242.log 2023-08-09T12:55:22.182 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92479.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92479.log.gz 2023-08-09T12:55:22.182 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119046.log 2023-08-09T12:55:22.183 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112242.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112242.log.gz 2023-08-09T12:55:22.184 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92541.log 2023-08-09T12:55:22.185 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119046.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119046.log.gz 2023-08-09T12:55:22.185 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127719.log 2023-08-09T12:55:22.186 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92541.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92541.log.gz 2023-08-09T12:55:22.187 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91164.log 2023-08-09T12:55:22.188 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127719.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127719.log.gz 2023-08-09T12:55:22.188 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124729.log 2023-08-09T12:55:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91164.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91164.log.gz 2023-08-09T12:55:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119569.log 2023-08-09T12:55:22.191 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124729.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124729.log.gz 2023-08-09T12:55:22.191 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105473.log 2023-08-09T12:55:22.193 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119569.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119569.log.gz 2023-08-09T12:55:22.193 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120908.log 2023-08-09T12:55:22.194 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105473.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105473.log.gz 2023-08-09T12:55:22.195 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112555.log 2023-08-09T12:55:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120908.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120908.log.gz 2023-08-09T12:55:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96719.log 2023-08-09T12:55:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112555.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112555.log.gz 2023-08-09T12:55:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94697.log 2023-08-09T12:55:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96719.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96719.log.gz 2023-08-09T12:55:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102894.log 2023-08-09T12:55:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94697.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94697.log.gz 2023-08-09T12:55:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107721.log 2023-08-09T12:55:22.202 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102894.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102894.log.gz 2023-08-09T12:55:22.203 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101225.log 2023-08-09T12:55:22.204 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107721.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107721.log.gz 2023-08-09T12:55:22.204 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92311.log 2023-08-09T12:55:22.205 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-09T12:55:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101225.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101225.log.gz 2023-08-09T12:55:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121745.log 2023-08-09T12:55:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92311.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92311.log.gz 2023-08-09T12:55:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115340.log 2023-08-09T12:55:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121745.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121745.log.gz 2023-08-09T12:55:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118471.log 2023-08-09T12:55:22.211 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115340.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115340.log.gz 2023-08-09T12:55:22.211 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96569.log 2023-08-09T12:55:22.212 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118471.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118471.log.gz 2023-08-09T12:55:22.212 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115094.log 2023-08-09T12:55:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96569.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96569.log.gz 2023-08-09T12:55:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107060.log 2023-08-09T12:55:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115094.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115094.log.gz 2023-08-09T12:55:22.216 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97758.log 2023-08-09T12:55:22.216 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.107060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107060.log.gz 2023-08-09T12:55:22.217 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122866.log 2023-08-09T12:55:22.218 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97758.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97758.log.gz 2023-08-09T12:55:22.219 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86473.log 2023-08-09T12:55:22.220 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122866.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122866.log.gz 2023-08-09T12:55:22.220 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98608.log 2023-08-09T12:55:22.221 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86473.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86473.log.gz 2023-08-09T12:55:22.222 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93674.log 2023-08-09T12:55:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98608.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98608.log.gz 2023-08-09T12:55:22.223 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113414.log 2023-08-09T12:55:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124539.log 2023-08-09T12:55:22.225 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93674.log.gz 2023-08-09T12:55:22.226 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113414.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113414.log.gz 2023-08-09T12:55:22.226 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127238.log 2023-08-09T12:55:22.227 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124539.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-09T12:55:22.228 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124539.log.gz 2023-08-09T12:55:22.228 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127658.log 2023-08-09T12:55:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127238.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127238.log.gz 2023-08-09T12:55:22.229 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111864.log 2023-08-09T12:55:22.231 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99599.log 2023-08-09T12:55:22.231 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127658.log.gz 2023-08-09T12:55:22.232 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111864.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111864.log.gz 2023-08-09T12:55:22.232 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122259.log 2023-08-09T12:55:22.233 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92805.log 2023-08-09T12:55:22.233 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99599.log.gz 2023-08-09T12:55:22.234 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122259.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122259.log.gz 2023-08-09T12:55:22.234 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89551.log 2023-08-09T12:55:22.235 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119256.log 2023-08-09T12:55:22.236 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92805.log.gz 2023-08-09T12:55:22.237 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89551.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.89551.log.gz 2023-08-09T12:55:22.237 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112513.log 2023-08-09T12:55:22.238 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119256.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-09T12:55:22.238 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119256.log.gz 2023-08-09T12:55:22.239 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110631.log 2023-08-09T12:55:22.239 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112513.log.gz 2023-08-09T12:55:22.240 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109646.log 2023-08-09T12:55:22.241 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.110631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110631.log.gz 2023-08-09T12:55:22.242 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120722.log 2023-08-09T12:55:22.243 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109646.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109646.log.gz 2023-08-09T12:55:22.243 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86182.log 2023-08-09T12:55:22.245 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120722.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120722.log.gz 2023-08-09T12:55:22.245 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112158.log 2023-08-09T12:55:22.246 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86182.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.86182.log.gz 2023-08-09T12:55:22.246 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95468.log 2023-08-09T12:55:22.248 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112158.log: gzip -5 87.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.112158.log.gz /var/log/ceph/ceph-client.admin.118844.log 2023-08-09T12:55:22.248 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95468.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95468.log.gz 2023-08-09T12:55:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112386.log 2023-08-09T12:55:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118844.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118844.log.gz 2023-08-09T12:55:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109604.log 2023-08-09T12:55:22.253 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90996.log 2023-08-09T12:55:22.253 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112386.log.gz 2023-08-09T12:55:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107056.log 2023-08-09T12:55:22.254 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109604.log.gz 2023-08-09T12:55:22.256 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86224.log 2023-08-09T12:55:22.256 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90996.log.gz 2023-08-09T12:55:22.257 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.107056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107056.log.gz 2023-08-09T12:55:22.257 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87502.log 2023-08-09T12:55:22.258 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86224.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86224.log.gz 2023-08-09T12:55:22.259 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89509.log 2023-08-09T12:55:22.260 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87502.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87502.log.gz 2023-08-09T12:55:22.260 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124163.log 2023-08-09T12:55:22.261 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89509.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89509.log.gz 2023-08-09T12:55:22.262 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98088.log 2023-08-09T12:55:22.263 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97926.log 2023-08-09T12:55:22.264 INFO:teuthology.orchestra.run.smithi017.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.124163.log.gz 2023-08-09T12:55:22.264 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98088.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98088.log.gz 2023-08-09T12:55:22.265 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94387.log 2023-08-09T12:55:22.266 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104536.log 2023-08-09T12:55:22.266 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97926.log.gz 2023-08-09T12:55:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94387.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94387.log.gz 2023-08-09T12:55:22.268 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.87442.log 2023-08-09T12:55:22.269 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104536.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104536.log.gz 2023-08-09T12:55:22.269 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125917.log 2023-08-09T12:55:22.270 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94015.log 2023-08-09T12:55:22.271 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87442.log.gz 2023-08-09T12:55:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125917.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125917.log.gz 2023-08-09T12:55:22.272 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101141.log 2023-08-09T12:55:22.273 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94015.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94015.log.gz 2023-08-09T12:55:22.274 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120246.log 2023-08-09T12:55:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127196.log 2023-08-09T12:55:22.275 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101141.log.gz 2023-08-09T12:55:22.276 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120246.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120246.log.gz 2023-08-09T12:55:22.277 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108305.log 2023-08-09T12:55:22.277 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-09T12:55:22.277 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-09T12:55:22.278 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127196.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127196.log.gz 2023-08-09T12:55:22.278 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86814.log 2023-08-09T12:55:22.279 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-09T12:55:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108305.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108305.log.gz 2023-08-09T12:55:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117680.log 2023-08-09T12:55:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86814.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86814.log.gz 2023-08-09T12:55:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92269.log 2023-08-09T12:55:22.283 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115566.log 2023-08-09T12:55:22.283 INFO:teuthology.orchestra.run.smithi017.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.117680.log.gz 2023-08-09T12:55:22.284 INFO:teuthology.orchestra.run.smithi142.stderr: 2023-08-09T12:55:22.284 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m1.170s 2023-08-09T12:55:22.284 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m5.153s 2023-08-09T12:55:22.285 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.619s 2023-08-09T12:55:22.285 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92269.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92269.log.gz 2023-08-09T12:55:22.285 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116383.log 2023-08-09T12:55:22.286 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97612.log 2023-08-09T12:55:22.286 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115566.log.gz 2023-08-09T12:55:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116383.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116383.log.gz 2023-08-09T12:55:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86476.log 2023-08-09T12:55:22.288 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97612.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97612.log.gz 2023-08-09T12:55:22.289 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112284.log 2023-08-09T12:55:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86476.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86476.log.gz 2023-08-09T12:55:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107637.log 2023-08-09T12:55:22.292 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112284.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.112284.log.gz 2023-08-09T12:55:22.292 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98734.log 2023-08-09T12:55:22.293 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107637.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.118920.log -- replaced with /var/log/ceph/ceph-client.admin.107637.log.gz 2023-08-09T12:55:22.294 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:22.295 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85706.log 2023-08-09T12:55:22.295 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98734.log.gz 2023-08-09T12:55:22.296 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118920.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.105855.log -- replaced with /var/log/ceph/ceph-client.admin.118920.log.gz 2023-08-09T12:55:22.297 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:22.298 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87148.log 2023-08-09T12:55:22.298 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85706.log.gz 2023-08-09T12:55:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101304.log 2023-08-09T12:55:22.300 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105855.log.gz 2023-08-09T12:55:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88223.log 2023-08-09T12:55:22.301 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87148.log.gz 2023-08-09T12:55:22.303 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112765.log 2023-08-09T12:55:22.303 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101304.log.gz 2023-08-09T12:55:22.304 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.88223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.88223.log.gz 2023-08-09T12:55:22.304 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94781.log 2023-08-09T12:55:22.305 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112765.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112765.log.gz 2023-08-09T12:55:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123911.log 2023-08-09T12:55:22.307 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94781.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94781.log.gz 2023-08-09T12:55:22.307 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92185.log 2023-08-09T12:55:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123911.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123911.log.gz 2023-08-09T12:55:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86483.log 2023-08-09T12:55:22.310 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92185.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92185.log.gz 2023-08-09T12:55:22.310 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120596.log 2023-08-09T12:55:22.311 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86483.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86483.log.gz 2023-08-09T12:55:22.312 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109902.log 2023-08-09T12:55:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120596.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120596.log.gz 2023-08-09T12:55:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99391.log 2023-08-09T12:55:22.315 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109902.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109902.log.gz 2023-08-09T12:55:22.315 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115466.log 2023-08-09T12:55:22.316 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99391.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99391.log.gz 2023-08-09T12:55:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118345.log 2023-08-09T12:55:22.318 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115466.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115466.log.gz 2023-08-09T12:55:22.318 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124416.log 2023-08-09T12:55:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118345.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118345.log.gz 2023-08-09T12:55:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124771.log 2023-08-09T12:55:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.124416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.124416.log.gz 2023-08-09T12:55:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101099.log 2023-08-09T12:55:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124771.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124771.log.gz 2023-08-09T12:55:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105897.log 2023-08-09T12:55:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101099.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101099.log.gz 2023-08-09T12:55:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96401.log 2023-08-09T12:55:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105897.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105897.log.gz 2023-08-09T12:55:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119611.log 2023-08-09T12:55:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96401.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.96401.log.gz 2023-08-09T12:55:22.327 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97528.log 2023-08-09T12:55:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87544.log 2023-08-09T12:55:22.329 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119611.log.gz 2023-08-09T12:55:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86826.log 2023-08-09T12:55:22.330 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97528.log.gz 2023-08-09T12:55:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123311.log 2023-08-09T12:55:22.332 INFO:teuthology.orchestra.run.smithi017.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87544.log.gz 2023-08-09T12:55:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86826.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86826.log.gz 2023-08-09T12:55:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123869.log 2023-08-09T12:55:22.335 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123311.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123311.log.gz 2023-08-09T12:55:22.335 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117554.log 2023-08-09T12:55:22.336 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123869.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123869.log.gz 2023-08-09T12:55:22.336 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121703.log 2023-08-09T12:55:22.337 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117554.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117554.log.gz 2023-08-09T12:55:22.338 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100495.log 2023-08-09T12:55:22.339 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.121703.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121703.log.gz 2023-08-09T12:55:22.340 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113232.log 2023-08-09T12:55:22.341 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100495.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100495.log.gz 2023-08-09T12:55:22.341 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104578.log 2023-08-09T12:55:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113232.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113232.log.gz 2023-08-09T12:55:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126860.log 2023-08-09T12:55:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104578.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104578.log.gz 2023-08-09T12:55:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122033.log 2023-08-09T12:55:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.126860.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126860.log.gz 2023-08-09T12:55:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98986.log 2023-08-09T12:55:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122033.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122033.log.gz 2023-08-09T12:55:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85748.log 2023-08-09T12:55:22.348 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98986.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98986.log.gz 2023-08-09T12:55:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97968.log 2023-08-09T12:55:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85748.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85748.log.gz 2023-08-09T12:55:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86475.log 2023-08-09T12:55:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97968.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97968.log.gz 2023-08-09T12:55:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118387.log 2023-08-09T12:55:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86475.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86475.log.gz 2023-08-09T12:55:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93590.log 2023-08-09T12:55:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.118387.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118387.log.gz 2023-08-09T12:55:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98902.log 2023-08-09T12:55:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93590.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93590.log.gz 2023-08-09T12:55:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123433.log 2023-08-09T12:55:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98902.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98902.log.gz 2023-08-09T12:55:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106172.log 2023-08-09T12:55:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123433.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123433.log.gz 2023-08-09T12:55:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90750.log 2023-08-09T12:55:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106172.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106172.log.gz 2023-08-09T12:55:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96065.log 2023-08-09T12:55:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90750.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90750.log.gz 2023-08-09T12:55:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117638.log 2023-08-09T12:55:22.364 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96065.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96065.log.gz 2023-08-09T12:55:22.364 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117596.log 2023-08-09T12:55:22.365 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117638.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117638.log.gz 2023-08-09T12:55:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92101.log 2023-08-09T12:55:22.367 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117596.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117596.log.gz 2023-08-09T12:55:22.367 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125128.log 2023-08-09T12:55:22.368 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92101.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92101.log.gz 2023-08-09T12:55:22.369 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120992.log 2023-08-09T12:55:22.370 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125128.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125128.log.gz 2023-08-09T12:55:22.370 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87670.log 2023-08-09T12:55:22.371 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.120992.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120992.log.gz 2023-08-09T12:55:22.372 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119485.log 2023-08-09T12:55:22.373 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87670.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87670.log.gz 2023-08-09T12:55:22.373 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100177.log 2023-08-09T12:55:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.119485.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119485.log.gz 2023-08-09T12:55:22.375 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87358.log 2023-08-09T12:55:22.376 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100177.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100177.log.gz 2023-08-09T12:55:22.376 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99557.log 2023-08-09T12:55:22.378 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87358.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87358.log.gz 2023-08-09T12:55:22.378 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109305.log 2023-08-09T12:55:22.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99557.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99557.log.gz 2023-08-09T12:55:22.380 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127574.log 2023-08-09T12:55:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109305.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109305.log.gz 2023-08-09T12:55:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91668.log 2023-08-09T12:55:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.127574.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127574.log.gz 2023-08-09T12:55:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115136.log 2023-08-09T12:55:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91668.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91668.log.gz 2023-08-09T12:55:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106551.log 2023-08-09T12:55:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115136.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115136.log.gz 2023-08-09T12:55:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123076.log 2023-08-09T12:55:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106551.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.124831.log -- replaced with /var/log/ceph/ceph-client.admin.106551.log.gz 2023-08-09T12:55:22.387 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116467.log 2023-08-09T12:55:22.389 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123076.log.gz 2023-08-09T12:55:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113276.log 2023-08-09T12:55:22.390 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124831.log.gz 2023-08-09T12:55:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116467.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116467.log.gz 2023-08-09T12:55:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97005.log 2023-08-09T12:55:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115424.log 2023-08-09T12:55:22.393 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113276.log.gz 2023-08-09T12:55:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91542.log 2023-08-09T12:55:22.395 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97005.log.gz 2023-08-09T12:55:22.397 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122992.log 2023-08-09T12:55:22.397 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115424.log.gz 2023-08-09T12:55:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89383.log 2023-08-09T12:55:22.398 INFO:teuthology.orchestra.run.smithi017.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91542.log.gz 2023-08-09T12:55:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122992.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.122992.log.gz 2023-08-09T12:55:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109095.log 2023-08-09T12:55:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102112.log 2023-08-09T12:55:22.401 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89383.log.gz 2023-08-09T12:55:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109095.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125086.log 2023-08-09T12:55:22.402 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109095.log.gz 2023-08-09T12:55:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102112.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102112.log.gz 2023-08-09T12:55:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90876.log 2023-08-09T12:55:22.405 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109263.log 2023-08-09T12:55:22.405 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125086.log.gz/var/log/ceph/ceph-client.admin.90876.log: 2023-08-09T12:55:22.405 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.90876.log.gz 2023-08-09T12:55:22.406 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110627.log 2023-08-09T12:55:22.407 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109263.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109263.log.gz 2023-08-09T12:55:22.408 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92395.log 2023-08-09T12:55:22.408 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.110627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110627.log.gz 2023-08-09T12:55:22.409 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108699.log 2023-08-09T12:55:22.410 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92395.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92395.log.gz 2023-08-09T12:55:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110206.log 2023-08-09T12:55:22.412 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108699.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108699.log.gz 2023-08-09T12:55:22.412 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95154.log 2023-08-09T12:55:22.413 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110206.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110206.log.gz 2023-08-09T12:55:22.414 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85292.log 2023-08-09T12:55:22.415 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.95154.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95154.log.gz 2023-08-09T12:55:22.415 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102385.log 2023-08-09T12:55:22.417 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85292.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85292.log.gz 2023-08-09T12:55:22.417 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124121.log 2023-08-09T12:55:22.418 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102385.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102385.log.gz 2023-08-09T12:55:22.418 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116215.log 2023-08-09T12:55:22.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.124121.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124121.log.gz 2023-08-09T12:55:22.420 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97884.log 2023-08-09T12:55:22.421 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116215.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116215.log.gz 2023-08-09T12:55:22.421 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125361.log 2023-08-09T12:55:22.422 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97884.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97884.log.gz 2023-08-09T12:55:22.423 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113148.log 2023-08-09T12:55:22.424 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.125361.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125361.log.gz 2023-08-09T12:55:22.424 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96233.log 2023-08-09T12:55:22.426 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113148.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113148.log.gz 2023-08-09T12:55:22.426 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121291.log 2023-08-09T12:55:22.427 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96233.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96233.log.gz 2023-08-09T12:55:22.428 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85495.log 2023-08-09T12:55:22.428 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.121291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121291.log.gz 2023-08-09T12:55:22.429 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104248.log 2023-08-09T12:55:22.430 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85495.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85495.log.gz 2023-08-09T12:55:22.430 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114861.log 2023-08-09T12:55:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104248.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104248.log.gz 2023-08-09T12:55:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109522.log 2023-08-09T12:55:22.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114861.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114861.log.gz 2023-08-09T12:55:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102768.log 2023-08-09T12:55:22.435 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109522.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109522.log.gz 2023-08-09T12:55:22.435 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115776.log 2023-08-09T12:55:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102768.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102768.log.gz 2023-08-09T12:55:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113106.log 2023-08-09T12:55:22.438 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.115776.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115776.log.gz 2023-08-09T12:55:22.438 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87232.log 2023-08-09T12:55:22.440 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113106.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113106.log.gz 2023-08-09T12:55:22.440 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86266.log 2023-08-09T12:55:22.441 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87232.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87232.log.gz 2023-08-09T12:55:22.441 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113498.log 2023-08-09T12:55:22.443 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124420.log 2023-08-09T12:55:22.443 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86266.log.gz 2023-08-09T12:55:22.444 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.113498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85250.log 2023-08-09T12:55:22.444 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113498.log.gz 2023-08-09T12:55:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.124420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.124420.log.gz 2023-08-09T12:55:22.446 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104620.log 2023-08-09T12:55:22.447 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85250.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85250.log.gz 2023-08-09T12:55:22.447 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116257.log 2023-08-09T12:55:22.448 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104620.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104620.log.gz 2023-08-09T12:55:22.449 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108389.log 2023-08-09T12:55:22.450 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116257.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116257.log.gz 2023-08-09T12:55:22.450 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112326.log 2023-08-09T12:55:22.452 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108389.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108389.log.gz 2023-08-09T12:55:22.452 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103022.log 2023-08-09T12:55:22.453 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112326.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.112326.log.gz /var/log/ceph/ceph-client.admin.122908.log 2023-08-09T12:55:22.453 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:22.455 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103022.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103022.log.gz 2023-08-09T12:55:22.455 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91122.log 2023-08-09T12:55:22.456 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.122908.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122908.log.gz 2023-08-09T12:55:22.457 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107975.log 2023-08-09T12:55:22.458 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91122.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91122.log.gz 2023-08-09T12:55:22.458 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109994.log 2023-08-09T12:55:22.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107975.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107975.log.gz 2023-08-09T12:55:22.460 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114248.log 2023-08-09T12:55:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109994.log: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-09T12:55:22.461 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109994.log.gz 2023-08-09T12:55:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92437.log 2023-08-09T12:55:22.463 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.114248.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114248.log.gz 2023-08-09T12:55:22.463 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104452.log 2023-08-09T12:55:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92437.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92437.log.gz -5 2023-08-09T12:55:22.464 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94571.log 2023-08-09T12:55:22.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104452.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104452.log.gz 2023-08-09T12:55:22.465 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123953.log 2023-08-09T12:55:22.466 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.94571.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94571.log.gz 2023-08-09T12:55:22.466 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111476.log 2023-08-09T12:55:22.467 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.123953.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123953.log.gz 2023-08-09T12:55:22.468 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112723.log 2023-08-09T12:55:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.111476.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111476.log.gz 2023-08-09T12:55:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99174.log 2023-08-09T12:55:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112723.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112723.log.gz 2023-08-09T12:55:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116341.log 2023-08-09T12:55:22.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99174.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99174.log.gz 2023-08-09T12:55:22.471 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92847.log 2023-08-09T12:55:22.472 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.116341.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116341.log.gz 2023-08-09T12:55:22.472 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110332.log 2023-08-09T12:55:22.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92847.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92847.log.gz 2023-08-09T12:55:22.474 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112074.log 2023-08-09T12:55:22.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110332.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110332.log.gz 2023-08-09T12:55:22.475 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110164.log 2023-08-09T12:55:22.476 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.112074.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112074.log.gz 2023-08-09T12:55:22.476 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91332.log 2023-08-09T12:55:22.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110164.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110164.log.gz 2023-08-09T12:55:22.477 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117512.log 2023-08-09T12:55:22.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91332.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91332.log.gz 2023-08-09T12:55:22.478 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117090.log 2023-08-09T12:55:22.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117512.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117512.log.gz 2023-08-09T12:55:22.480 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103202.log 2023-08-09T12:55:22.480 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.117090.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117090.log.gz 2023-08-09T12:55:22.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103202.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103202.log.gz 2023-08-09T12:55:22.525 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-09T12:55:23.183 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-09T12:55:23.196 INFO:teuthology.orchestra.run.smithi017.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-09T12:55:23.200 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-08-09T12:55:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m2.089s 2023-08-09T12:55:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m6.112s 2023-08-09T12:55:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m3.118s 2023-08-09T12:55:23.201 INFO:tasks.ceph:Archiving logs... 2023-08-09T12:55:23.201 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/remote/smithi017/log 2023-08-09T12:55:23.202 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-09T12:55:24.419 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/remote/smithi142/log 2023-08-09T12:55:24.420 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-09T12:55:25.062 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-09T12:55:25.072 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-09T12:55:25.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-09T12:55:25.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-09T12:55:25.253 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-09T12:55:25.263 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-09T12:55:25.264 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-09T12:55:25.273 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-09T12:55:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2023-08-09T12:55:25.331 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2023-08-09T12:55:25.334 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-09T12:55:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-08-09T12:55:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 24 -117us[ -117us] +/- 88ms 2023-08-09T12:55:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv02.front.sepia.ceph.com 3 7 377 25 -2411us[-2414us] +/- 49ms 2023-08-09T12:55:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +3446us[+3443us] +/- 72ms 2023-08-09T12:55:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:55:25.341 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-09T12:55:25.341 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-08-09T12:55:25.341 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 -135us[ -141us] +/- 88ms 2023-08-09T12:55:25.341 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 -2485us[-2490us] +/- 49ms 2023-08-09T12:55:25.341 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +3430us[+3425us] +/- 72ms 2023-08-09T12:55:25.341 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-09T12:55:25.342 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-09T12:55:25.352 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-09T12:55:25.352 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-09T12:55:25.379 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-09T12:55:25.695 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-09T12:55:25.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-09T12:55:26.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:55:26.086 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-09T12:55:26.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:55:26.197 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-09T12:55:26.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-09T12:55:26.253 INFO:teuthology.task.internal:Duration was 1938.110206 seconds 2023-08-09T12:55:26.254 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-09T12:55:26.290 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-09T12:55:26.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-09T12:55:26.300 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-09T12:55:26.472 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-09T12:55:26.481 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-09T12:55:26.900 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-09T12:55:26.900 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2023-08-09T12:55:26.901 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-09T12:55:26.985 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2023-08-09T12:55:26.985 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-09T12:55:27.063 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-09T12:55:27.063 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-09T12:55:27.073 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-09T12:55:27.177 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-09T12:55:27.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-09T12:55:27.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-09T12:55:28.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-09T12:55:28.148 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-09T12:55:28.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-09T12:55:28.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-09T12:55:28.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-09T12:55:28.343 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-09T12:55:28.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-09T12:55:28.456 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2023-08-09T12:55:28.463 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2023-08-09T12:55:28.522 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-09T12:55:28.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:55:28.579 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-09T12:55:28.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-09T12:55:28.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-09T12:55:28.647 INFO:teuthology.task.internal:Transferring archived files... 2023-08-09T12:55:28.648 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/remote/smithi017 2023-08-09T12:55:28.648 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-09T12:55:28.766 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087/remote/smithi142 2023-08-09T12:55:28.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-09T12:55:28.879 INFO:teuthology.task.internal:Removing archive directory... 2023-08-09T12:55:28.879 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-09T12:55:28.889 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-09T12:55:28.948 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-09T12:55:28.960 INFO:teuthology.task.internal:Not uploading archives. 2023-08-09T12:55:28.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-09T12:55:28.978 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-09T12:55:28.979 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-09T12:55:28.988 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-09T12:55:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: 263913 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 9 12:55 /home/ubuntu/cephtest 2023-08-09T12:55:29.048 INFO:teuthology.orchestra.run.smithi142.stdout: 264349 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 9 12:55 /home/ubuntu/cephtest 2023-08-09T12:55:29.051 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-09T12:55:29.062 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-09T12:55:29.128 INFO:teuthology.nuke:Checking targets against current locks 2023-08-09T12:55:29.154 DEBUG:teuthology.nuke:shortname: smithi017 2023-08-09T12:55:29.155 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-09T12:55:29.181 DEBUG:teuthology.nuke:shortname: smithi142 2023-08-09T12:55:29.181 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-09T12:55:29.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 12:14:30.900113', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNiRdK8KBEkCYEFGVsnvyjQMwGl1X8ouvA0XeobFuLFtAWt6scI5wwoMHvtRHTRn4wL7f/vjXbrF891KPddar8U='} 2023-08-09T12:55:29.209 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-09_05:46:29-fs-wip-vshankar-testing-20230809.035933-testing-default-smithi/7364087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-09 12:14:30.901840', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMWSjGVLUMIzgjxvYuqvXv1yqr9ZFVjIg0RMuYd90lIDf8DfMCLsB4Y0IfblLZPBCDAS0yMY+nCtW0Ea/7ihJek='} 2023-08-09T12:55:29.238 INFO:teuthology.orchestra.console.smithi017:Power off 2023-08-09T12:55:29.239 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-09T12:55:29.266 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-08-09T12:55:29.267 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T12:55:29.284 INFO:teuthology.orchestra.console.smithi142:Power off 2023-08-09T12:55:29.285 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-09T12:55:29.297 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-08-09T12:55:29.309 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-08-09T12:55:29.309 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T12:55:29.334 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-08-09T12:55:33.299 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T12:55:33.336 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T12:55:33.414 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-08-09T12:55:33.448 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-08-09T12:55:37.416 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T12:55:37.449 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T12:55:37.528 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-08-09T12:55:37.561 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-08-09T12:55:37.630 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-08-09T12:55:41.563 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-09T12:55:41.675 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-08-09T12:55:41.776 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-08-09T12:55:41.882 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 client.1-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1938.1102056503296 failure_reason: '"2023-08-09T12:39:10.144954+0000 osd.7 (osd.7) 3 : cluster [WRN] OSD bench result of 96246.758209 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.7. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-08-09T12:55:41.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-09T12:55:41.970 INFO:teuthology.run:FAIL